[2025-09-29T00:00:03.735076] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:00:03.810512] [INFO ] [REMOTE ] INR: Fetching primary data for 2024-12. [2025-09-29T00:00:04.412471] [DEBUG] [REMOTE ] INR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:00:04.412903] [WARN ] [REMOTE ] INR: No data returned for month 2024-12 [2025-09-29T00:00:04.412997] [FATAL] [REMOTE ] INR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:00:12.064989] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:00:12.127591] [INFO ] [REMOTE ] JBS: Fetching primary data for 2024-12. [2025-09-29T00:00:12.388551] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:00:12.389106] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2024-12. [2025-09-29T00:00:12.417269] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:00:12.469947] [WARN ] [REMOTE ] JBS: No data returned for month 2024-12 [2025-09-29T00:00:12.503963] [FATAL] [REMOTE ] JBS: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:00:12.805897] [DEBUG] [REMOTE ] JBTM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:00:12.910763] [WARN ] [REMOTE ] JBTM: No data returned for month 2024-12 [2025-09-29T00:00:12.961526] [FATAL] [REMOTE ] JBTM: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:00:16.612088] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:00:16.659430] [INFO ] [REMOTE ] JMM: Fetching primary data for 2024-12. [2025-09-29T00:00:17.099799] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-29T00:00:17.100897] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-09-29T00:00:17.363509] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-09-29T00:00:17.417984] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-09-29T00:00:17.848791] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-29T00:00:17.939377] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-09-29T00:00:18.260460] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-29T00:00:18.348864] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-09-29T00:00:18.769536] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-29T00:00:18.798599] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-09-29T00:00:19.090432] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-09-29T00:00:19.092837] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-09-29T00:00:19.561990] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-29T00:00:19.564265] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-09-29T00:00:19.949766] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-29T00:00:19.962015] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-09-29T00:00:20.300356] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-29T00:00:20.326447] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-09-29T00:00:20.629517] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-09-29T00:00:20.632036] [INFO ] [REMOTE ] JMM: Full fetch complete (2292 records). [2025-09-29T00:00:22.515903] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:00:22.575794] [INFO ] [REMOTE ] KEY: Fetching primary data for 2024-12. [2025-09-29T00:00:23.745769] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-29T00:00:23.760041] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-09-29T00:00:25.001300] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-29T00:00:25.116266] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-09-29T00:00:25.923245] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:00:25.934456] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2024-12. [2025-09-29T00:00:26.062054] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:00:26.062490] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2024-12. [2025-09-29T00:00:26.101074] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:00:26.101395] [WARN ] [REMOTE ] KKRT: No data returned for month 2024-12 [2025-09-29T00:00:26.101482] [FATAL] [REMOTE ] KKRT: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:00:26.174599] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:00:26.175043] [WARN ] [REMOTE ] KLAR: No data returned for month 2024-12 [2025-09-29T00:00:26.175134] [FATAL] [REMOTE ] KLAR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:00:26.213895] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-29T00:00:26.224718] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-09-29T00:00:27.935007] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-29T00:00:27.947858] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-09-29T00:00:29.755211] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-29T00:00:29.767497] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-09-29T00:00:31.551457] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-29T00:00:31.564705] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-09-29T00:00:33.357967] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-29T00:00:33.369323] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-09-29T00:00:35.369479] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-29T00:00:35.381907] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-09-29T00:00:37.070985] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-29T00:00:37.087472] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-09-29T00:00:38.994623] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-29T00:00:39.005276] [INFO ] [REMOTE ] KEY: Full fetch complete (77256 records). [2025-09-29T00:00:43.063862] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:00:43.117689] [INFO ] [REMOTE ] KO: Fetching primary data for 2024-12. [2025-09-29T00:00:45.501943] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:00:45.518139] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2024-12. [2025-09-29T00:00:45.787912] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:00:45.818182] [WARN ] [REMOTE ] KRMN: No data returned for month 2024-12 [2025-09-29T00:00:45.818680] [FATAL] [REMOTE ] KRMN: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:00:46.103222] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2024-12 (2.99 seconds). [2025-09-29T00:00:46.122182] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-09-29T00:00:47.733663] [INFO ] [REMOTE ] KUKE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:00:47.734347] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2024-12. [2025-09-29T00:00:48.527930] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-29T00:00:48.564583] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-01. [2025-09-29T00:00:48.947542] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (2.83 seconds). [2025-09-29T00:00:48.968058] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-09-29T00:00:49.652367] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-29T00:00:49.659475] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-02. [2025-09-29T00:00:50.278917] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:00:50.279387] [INFO ] [REMOTE ] LAR: Fetching primary data for 2024-12. [2025-09-29T00:00:50.520319] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-29T00:00:50.522629] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-03. [2025-09-29T00:00:50.613113] [DEBUG] [REMOTE ] LAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:00:50.613469] [WARN ] [REMOTE ] LAR: No data returned for month 2024-12 [2025-09-29T00:00:50.613557] [FATAL] [REMOTE ] LAR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:00:51.350044] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (2.38 seconds). [2025-09-29T00:00:51.364942] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-09-29T00:00:51.497219] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-29T00:00:51.510383] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-04. [2025-09-29T00:00:51.850138] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-29T00:00:51.852855] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-05. [2025-09-29T00:00:52.322028] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-29T00:00:52.324044] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-06. [2025-09-29T00:00:52.765416] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-29T00:00:52.766917] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-07. [2025-09-29T00:00:53.079278] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-29T00:00:53.080589] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-08. [2025-09-29T00:00:53.666159] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-29T00:00:53.668020] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-09. [2025-09-29T00:00:53.915780] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-09-29T00:00:53.928000] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-09-29T00:00:54.449401] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-29T00:00:54.451627] [INFO ] [REMOTE ] KUKE: Full fetch complete (8120 records). [2025-09-29T00:00:56.464955] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.54 seconds). [2025-09-29T00:00:56.477281] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-09-29T00:00:59.037841] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (2.56 seconds). [2025-09-29T00:00:59.050841] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-09-29T00:01:01.768717] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.72 seconds). [2025-09-29T00:01:01.780548] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-09-29T00:01:04.541345] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (2.76 seconds). [2025-09-29T00:01:04.554210] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-09-29T00:01:07.318425] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.76 seconds). [2025-09-29T00:01:07.330453] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-09-29T00:01:09.688149] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-09-29T00:01:09.698226] [INFO ] [REMOTE ] KO: Full fetch complete (77214 records). [2025-09-29T00:01:20.713161] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:01:20.736357] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2024-12. [2025-09-29T00:01:21.900156] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:01:21.933148] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2024-12. [2025-09-29T00:01:22.235807] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:01:22.238768] [WARN ] [REMOTE ] LUXE: No data returned for month 2024-12 [2025-09-29T00:01:22.239196] [FATAL] [REMOTE ] LUXE: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:01:22.236971] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-29T00:01:22.247119] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-01. [2025-09-29T00:01:24.142968] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-29T00:01:24.242282] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-09-29T00:01:25.784345] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-29T00:01:25.826820] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-09-29T00:01:27.429393] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-29T00:01:27.529704] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-09-29T00:01:29.202380] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-29T00:01:29.339554] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-09-29T00:01:29.417636] [INFO ] [REMOTE ] MCD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:01:29.418870] [INFO ] [REMOTE ] MCD: Fetching primary data for 2024-12. [2025-09-29T00:01:30.553626] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-29T00:01:30.560881] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-09-29T00:01:31.571379] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-29T00:01:31.583020] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-01. [2025-09-29T00:01:31.771131] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-29T00:01:31.778419] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-09-29T00:01:32.781498] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-29T00:01:32.788461] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-09-29T00:01:33.348228] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-29T00:01:33.359801] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-02. [2025-09-29T00:01:33.568142] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-29T00:01:33.575055] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-09-29T00:01:34.667864] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-29T00:01:34.675412] [INFO ] [REMOTE ] LUCK: Full fetch complete (40658 records). [2025-09-29T00:01:35.018905] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-29T00:01:35.030137] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-03. [2025-09-29T00:01:37.149889] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-29T00:01:37.161606] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-04. [2025-09-29T00:01:39.353709] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-29T00:01:39.368504] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-05. [2025-09-29T00:01:41.411376] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-29T00:01:41.423718] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-06. [2025-09-29T00:01:43.660319] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-29T00:01:43.672688] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-07. [2025-09-29T00:01:46.040558] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-09-29T00:01:46.055499] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-08. [2025-09-29T00:01:48.332708] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-09-29T00:01:48.345604] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-09. [2025-09-29T00:01:50.309929] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-29T00:01:50.321022] [INFO ] [REMOTE ] MCD: Full fetch complete (77031 records). [2025-09-29T00:01:56.033264] [INFO ] [REMOTE ] MFSB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:01:56.060398] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2024-12. [2025-09-29T00:01:56.588813] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-29T00:01:56.611862] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-01. [2025-09-29T00:01:57.015697] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-29T00:01:57.042187] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-02. [2025-09-29T00:01:57.419797] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-29T00:01:57.420882] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-03. [2025-09-29T00:01:57.787586] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-29T00:01:57.899016] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-04. [2025-09-29T00:01:58.284119] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-29T00:01:58.316938] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-05. [2025-09-29T00:01:58.794816] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-29T00:01:58.835620] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-06. [2025-09-29T00:01:59.361754] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-29T00:01:59.401812] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-07. [2025-09-29T00:01:59.623407] [INFO ] [REMOTE ] MH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:01:59.624014] [INFO ] [REMOTE ] MH: Fetching primary data for 2024-12. [2025-09-29T00:01:59.889714] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:01:59.878845] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-29T00:01:59.908808] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-08. [2025-09-29T00:01:59.910593] [WARN ] [REMOTE ] MH: No data returned for month 2024-12 [2025-09-29T00:01:59.911247] [FATAL] [REMOTE ] MH: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:02:00.526497] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-29T00:02:00.565479] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-09. [2025-09-29T00:02:00.885567] [INFO ] [REMOTE ] MHLA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:02:00.925163] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2024-12. [2025-09-29T00:02:01.484417] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-29T00:02:01.498099] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-01. [2025-09-29T00:02:01.699758] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-29T00:02:01.707275] [INFO ] [REMOTE ] MFSB: Full fetch complete (1610 records). [2025-09-29T00:02:01.780397] [INFO ] [REMOTE ] MIAX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:02:01.780933] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2024-12. [2025-09-29T00:02:02.075481] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:02:02.075970] [WARN ] [REMOTE ] MIAX: No data returned for month 2024-12 [2025-09-29T00:02:02.076068] [FATAL] [REMOTE ] MIAX: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:02:02.215767] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-29T00:02:02.217506] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-02. [2025-09-29T00:02:02.794430] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-29T00:02:02.795431] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-03. [2025-09-29T00:02:03.106867] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-29T00:02:03.108051] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-04. [2025-09-29T00:02:03.512138] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-29T00:02:03.513321] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-05. [2025-09-29T00:02:04.012801] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-29T00:02:04.014408] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-06. [2025-09-29T00:02:04.360960] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-29T00:02:04.362101] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-07. [2025-09-29T00:02:04.630388] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-09-29T00:02:04.631373] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-08. [2025-09-29T00:02:04.980835] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-29T00:02:04.981980] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-09. [2025-09-29T00:02:05.334897] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-29T00:02:05.336274] [INFO ] [REMOTE ] MHLA: Full fetch complete (1547 records). [2025-09-29T00:02:07.365339] [INFO ] [REMOTE ] MITN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:02:07.426213] [INFO ] [REMOTE ] MITN: Fetching primary data for 2024-12. [2025-09-29T00:02:07.839369] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-29T00:02:07.872356] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-01. [2025-09-29T00:02:08.364439] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-29T00:02:08.409187] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-02. [2025-09-29T00:02:08.968803] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-29T00:02:08.997796] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-03. [2025-09-29T00:02:09.815491] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-29T00:02:09.840991] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-04. [2025-09-29T00:02:10.686034] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-29T00:02:10.780183] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-05. [2025-09-29T00:02:10.808850] [INFO ] [REMOTE ] MMID: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:02:10.862731] [INFO ] [REMOTE ] MMID: Fetching primary data for 2024-12. [2025-09-29T00:02:11.168129] [INFO ] [REMOTE ] MMKT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:02:11.198561] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2024-12. [2025-09-29T00:02:11.216441] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:02:11.223369] [WARN ] [REMOTE ] MMID: No data returned for month 2024-12 [2025-09-29T00:02:11.223514] [FATAL] [REMOTE ] MMID: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:02:11.329254] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-29T00:02:11.344693] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-06. [2025-09-29T00:02:11.560472] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-29T00:02:11.585738] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-01. [2025-09-29T00:02:11.803372] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-29T00:02:11.805246] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-07. [2025-09-29T00:02:12.021150] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-29T00:02:12.028512] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-02. [2025-09-29T00:02:12.238283] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-29T00:02:12.268881] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-08. [2025-09-29T00:02:12.582169] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-29T00:02:12.602086] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-03. [2025-09-29T00:02:12.680575] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-29T00:02:12.703273] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-09. [2025-09-29T00:02:13.030102] [INFO ] [REMOTE ] MNTN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:02:13.030882] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2024-12. [2025-09-29T00:02:13.299285] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-29T00:02:13.301028] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-04. [2025-09-29T00:02:13.295160] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-29T00:02:13.327309] [INFO ] [REMOTE ] MITN: Full fetch complete (2309 records). [2025-09-29T00:02:13.353506] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:02:13.385012] [WARN ] [REMOTE ] MNTN: No data returned for month 2024-12 [2025-09-29T00:02:13.402734] [FATAL] [REMOTE ] MNTN: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:02:13.563837] [INFO ] [REMOTE ] MO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:02:13.585728] [INFO ] [REMOTE ] MO: Fetching primary data for 2024-12. [2025-09-29T00:02:13.824094] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-29T00:02:13.887770] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-05. [2025-09-29T00:02:14.424216] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-29T00:02:14.456197] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-06. [2025-09-29T00:02:15.023294] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-29T00:02:15.103740] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-07. [2025-09-29T00:02:15.581161] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-29T00:02:15.599571] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-08. [2025-09-29T00:02:16.049330] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-29T00:02:16.076691] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-09. [2025-09-29T00:02:16.387605] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2024-12 (2.80 seconds). [2025-09-29T00:02:16.403192] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-01. [2025-09-29T00:02:16.539426] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-29T00:02:16.574103] [INFO ] [REMOTE ] MMKT: Full fetch complete (2099 records). [2025-09-29T00:02:18.829284] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-09-29T00:02:18.842030] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-02. [2025-09-29T00:02:20.849802] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-29T00:02:20.860404] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-03. [2025-09-29T00:02:23.261871] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-09-29T00:02:23.274066] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-04. [2025-09-29T00:02:25.714129] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-09-29T00:02:25.726468] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-05. [2025-09-29T00:02:28.082441] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-09-29T00:02:28.097383] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-06. [2025-09-29T00:02:30.378328] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-09-29T00:02:30.389625] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-07. [2025-09-29T00:02:32.604483] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-29T00:02:32.616726] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-08. [2025-09-29T00:02:34.881689] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-09-29T00:02:34.894973] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-09. [2025-09-29T00:02:36.661689] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-29T00:02:36.678175] [INFO ] [REMOTE ] MO: Full fetch complete (77495 records). [2025-09-29T00:02:38.752962] [INFO ] [REMOTE ] MRP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:02:38.847597] [INFO ] [REMOTE ] MRP: Fetching primary data for 2024-12. [2025-09-29T00:02:39.228868] [DEBUG] [REMOTE ] MRP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:02:39.248958] [WARN ] [REMOTE ] MRP: No data returned for month 2024-12 [2025-09-29T00:02:39.260451] [FATAL] [REMOTE ] MRP: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:02:40.421230] [INFO ] [REMOTE ] MSC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:02:40.464405] [INFO ] [REMOTE ] MSC: Fetching primary data for 2024-12. [2025-09-29T00:02:40.913282] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-29T00:02:40.950487] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-01. [2025-09-29T00:02:41.623350] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-29T00:02:41.636030] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-02. [2025-09-29T00:02:41.819819] [INFO ] [REMOTE ] MSIF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:02:41.856117] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2024-12. [2025-09-29T00:02:42.158265] [DEBUG] [REMOTE ] MSIF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:02:42.191714] [WARN ] [REMOTE ] MSIF: No data returned for month 2024-12 [2025-09-29T00:02:42.234835] [FATAL] [REMOTE ] MSIF: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:02:42.265829] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-29T00:02:42.279437] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-03. [2025-09-29T00:02:42.749452] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-29T00:02:42.754771] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-04. [2025-09-29T00:02:43.166337] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-29T00:02:43.185676] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-05. [2025-09-29T00:02:43.669310] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-29T00:02:43.745805] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-06. [2025-09-29T00:02:44.297801] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-29T00:02:44.371784] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-07. [2025-09-29T00:02:44.770072] [INFO ] [REMOTE ] MTR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:02:44.800245] [INFO ] [REMOTE ] MTR: Fetching primary data for 2024-12. [2025-09-29T00:02:44.944194] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-29T00:02:44.972399] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-08. [2025-09-29T00:02:45.440678] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-29T00:02:45.437482] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-29T00:02:45.464015] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-01. [2025-09-29T00:02:45.470807] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-09. [2025-09-29T00:02:45.991496] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-29T00:02:45.993122] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-02. [2025-09-29T00:02:46.108049] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-29T00:02:46.134772] [INFO ] [REMOTE ] MSC: Full fetch complete (2509 records). [2025-09-29T00:02:46.393792] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-29T00:02:46.421695] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-03. [2025-09-29T00:02:46.976190] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-29T00:02:47.098066] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-04. [2025-09-29T00:02:47.571581] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-29T00:02:47.573259] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-05. [2025-09-29T00:02:48.098084] [INFO ] [REMOTE ] MUSE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:02:48.145848] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-29T00:02:48.189757] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-06. [2025-09-29T00:02:48.146412] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2024-12. [2025-09-29T00:02:48.528481] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-09-29T00:02:48.552996] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-01. [2025-09-29T00:02:49.082377] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:02:49.085269] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-01 [2025-09-29T00:02:49.088577] [FATAL] [REMOTE ] MUSE: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:02:49.089542] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-29T00:02:49.092353] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-07. [2025-09-29T00:02:49.567092] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-29T00:02:49.568486] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-08. [2025-09-29T00:02:49.912222] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-29T00:02:49.913374] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-09. [2025-09-29T00:02:50.274306] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-29T00:02:50.275512] [INFO ] [REMOTE ] MTR: Full fetch complete (2549 records). [2025-09-29T00:02:52.158425] [INFO ] [REMOTE ] MXE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:02:52.207892] [INFO ] [REMOTE ] MXE: Fetching primary data for 2024-12. [2025-09-29T00:02:52.834275] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-29T00:02:52.875896] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-01. [2025-09-29T00:02:53.490900] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-29T00:02:53.544308] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-02. [2025-09-29T00:02:54.121168] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-29T00:02:54.160552] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-03. [2025-09-29T00:02:54.758146] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-29T00:02:54.853982] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-04. [2025-09-29T00:02:55.389998] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-29T00:02:55.396579] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-05. [2025-09-29T00:02:56.008978] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-29T00:02:56.045388] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-06. [2025-09-29T00:02:56.575343] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-29T00:02:56.626565] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-07. [2025-09-29T00:02:57.220561] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-29T00:02:57.257906] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-08. [2025-09-29T00:02:57.852628] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-29T00:02:57.854250] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-09. [2025-09-29T00:02:58.384919] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-29T00:02:58.472367] [INFO ] [REMOTE ] MXE: Full fetch complete (2667 records). [2025-09-29T00:03:03.710835] [INFO ] [REMOTE ] NIQ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:03:03.755024] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2024-12. [2025-09-29T00:03:04.074893] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:03:04.114970] [WARN ] [REMOTE ] NIQ: No data returned for month 2024-12 [2025-09-29T00:03:04.179758] [FATAL] [REMOTE ] NIQ: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:03:04.382229] [INFO ] [REMOTE ] NKE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:03:04.399373] [INFO ] [REMOTE ] NKE: Fetching primary data for 2024-12. [2025-09-29T00:03:05.011495] [INFO ] [REMOTE ] NL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:03:05.057506] [INFO ] [REMOTE ] NL: Fetching primary data for 2024-12. [2025-09-29T00:03:05.775178] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-29T00:03:05.898052] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-01. [2025-09-29T00:03:05.886189] [INFO ] [REMOTE ] NMAX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:03:05.898884] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2024-12. [2025-09-29T00:03:06.163268] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:03:06.198268] [WARN ] [REMOTE ] NMAX: No data returned for month 2024-12 [2025-09-29T00:03:06.198485] [FATAL] [REMOTE ] NMAX: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:03:06.690441] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-29T00:03:06.710412] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-02. [2025-09-29T00:03:07.356901] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-29T00:03:07.416843] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-03. [2025-09-29T00:03:08.091689] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2024-12 (3.69 seconds). [2025-09-29T00:03:08.121327] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-01. [2025-09-29T00:03:08.127034] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-29T00:03:08.132615] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-04. [2025-09-29T00:03:08.850363] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-29T00:03:08.910434] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-05. [2025-09-29T00:03:09.881369] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-29T00:03:09.918081] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-06. [2025-09-29T00:03:10.089428] [INFO ] [REMOTE ] NOM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:03:10.090024] [INFO ] [REMOTE ] NOM: Fetching primary data for 2024-12. [2025-09-29T00:03:10.765934] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-29T00:03:10.832809] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-01 (2.71 seconds). [2025-09-29T00:03:10.835221] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-07. [2025-09-29T00:03:10.909316] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-02. [2025-09-29T00:03:11.577556] [INFO ] [REMOTE ] NPB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:03:11.577947] [INFO ] [REMOTE ] NPB: Fetching primary data for 2024-12. [2025-09-29T00:03:11.692155] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-29T00:03:11.694313] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-08. [2025-09-29T00:03:11.791614] [DEBUG] [REMOTE ] NPB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:03:11.792226] [WARN ] [REMOTE ] NPB: No data returned for month 2024-12 [2025-09-29T00:03:11.792325] [FATAL] [REMOTE ] NPB: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:03:12.271310] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-29T00:03:12.276021] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-01. [2025-09-29T00:03:12.276587] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-29T00:03:12.279230] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-09. [2025-09-29T00:03:12.681873] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-29T00:03:12.682958] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-02. [2025-09-29T00:03:12.849193] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-29T00:03:12.851352] [INFO ] [REMOTE ] NL: Full fetch complete (6922 records). [2025-09-29T00:03:12.996907] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-29T00:03:13.023966] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-03. [2025-09-29T00:03:13.226794] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-09-29T00:03:13.237676] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-03. [2025-09-29T00:03:13.429351] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-29T00:03:13.430523] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-04. [2025-09-29T00:03:13.902057] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-29T00:03:13.903196] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-05. [2025-09-29T00:03:14.262546] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-29T00:03:14.263788] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-06. [2025-09-29T00:03:14.539484] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-09-29T00:03:14.541005] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-07. [2025-09-29T00:03:14.977151] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-29T00:03:14.978326] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-08. [2025-09-29T00:03:15.459061] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-29T00:03:15.460215] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-09. [2025-09-29T00:03:15.827359] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-09-29T00:03:15.839031] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-04. [2025-09-29T00:03:16.111406] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-29T00:03:16.112487] [INFO ] [REMOTE ] NOM: Full fetch complete (1626 records). [2025-09-29T00:03:18.600005] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-04 (2.76 seconds). [2025-09-29T00:03:18.611882] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-05. [2025-09-29T00:03:21.010183] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-09-29T00:03:21.022441] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-06. [2025-09-29T00:03:23.581490] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-06 (2.56 seconds). [2025-09-29T00:03:23.593385] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-07. [2025-09-29T00:03:26.297712] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-07 (2.70 seconds). [2025-09-29T00:03:26.310767] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-08. [2025-09-29T00:03:28.586069] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-09-29T00:03:28.597696] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-09. [2025-09-29T00:03:30.978336] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-09-29T00:03:30.992526] [INFO ] [REMOTE ] NKE: Full fetch complete (77197 records). [2025-09-29T00:03:32.975777] [INFO ] [REMOTE ] NPKI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:03:32.990775] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2024-12. [2025-09-29T00:03:34.000693] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-29T00:03:34.030295] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-01. [2025-09-29T00:03:35.520637] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-29T00:03:35.542351] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-02. [2025-09-29T00:03:37.025381] [INFO ] [REMOTE ] NTEST: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:03:37.055135] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2024-12. [2025-09-29T00:03:37.103732] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-29T00:03:37.113004] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-03. [2025-09-29T00:03:37.544156] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-29T00:03:37.591072] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-01. [2025-09-29T00:03:38.089284] [INFO ] [REMOTE ] NUE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:03:38.089856] [INFO ] [REMOTE ] NUE: Fetching primary data for 2024-12. [2025-09-29T00:03:38.250885] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-29T00:03:38.256165] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-02. [2025-09-29T00:03:38.885793] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-29T00:03:38.925977] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-03. [2025-09-29T00:03:39.027792] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-29T00:03:39.077228] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-04. [2025-09-29T00:03:39.479798] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-29T00:03:39.520327] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-04. [2025-09-29T00:03:40.049439] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-29T00:03:40.050576] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-05. [2025-09-29T00:03:40.335911] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-09-29T00:03:40.348222] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-01. [2025-09-29T00:03:40.610486] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-29T00:03:40.620950] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-05. [2025-09-29T00:03:40.905225] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-29T00:03:40.907737] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-06. [2025-09-29T00:03:41.500639] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-29T00:03:41.504706] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-07. [2025-09-29T00:03:42.142378] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-29T00:03:42.143605] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-08. [2025-09-29T00:03:42.175994] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-29T00:03:42.186845] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-06. [2025-09-29T00:03:42.483638] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-09-29T00:03:42.494806] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-02. [2025-09-29T00:03:42.708437] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-29T00:03:42.709585] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-09. [2025-09-29T00:03:43.121977] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-29T00:03:43.122864] [INFO ] [REMOTE ] NTEST: Full fetch complete (1986 records). [2025-09-29T00:03:43.520307] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-29T00:03:43.529111] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-07. [2025-09-29T00:03:44.829928] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-09-29T00:03:44.841406] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-03. [2025-09-29T00:03:45.170348] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-29T00:03:45.181031] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-08. [2025-09-29T00:03:46.821701] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-29T00:03:46.832882] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-09. [2025-09-29T00:03:47.344871] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-03 (2.50 seconds). [2025-09-29T00:03:47.356234] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-04. [2025-09-29T00:03:48.343371] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-29T00:03:48.350968] [INFO ] [REMOTE ] NPKI: Full fetch complete (53554 records). [2025-09-29T00:03:49.477478] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-29T00:03:49.489382] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-05. [2025-09-29T00:03:51.221298] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-29T00:03:51.233073] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-06. [2025-09-29T00:03:53.146344] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-29T00:03:53.158035] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-07. [2025-09-29T00:03:55.081962] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-29T00:03:55.093984] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-08. [2025-09-29T00:03:56.859731] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-29T00:03:56.870778] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-09. [2025-09-29T00:03:58.814779] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-29T00:03:58.826368] [INFO ] [REMOTE ] NUE: Full fetch complete (74902 records). [2025-09-29T00:04:00.996860] [INFO ] [REMOTE ] NXDR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:04:01.028838] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2024-12. [2025-09-29T00:04:01.490330] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:04:01.517145] [WARN ] [REMOTE ] NXDR: No data returned for month 2024-12 [2025-09-29T00:04:01.528322] [FATAL] [REMOTE ] NXDR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:04:02.480912] [INFO ] [REMOTE ] NYC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:04:02.512716] [INFO ] [REMOTE ] NYC: Fetching primary data for 2024-12. [2025-09-29T00:04:03.095151] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-29T00:04:03.167596] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-01. [2025-09-29T00:04:03.443027] [INFO ] [REMOTE ] O: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:04:03.447811] [INFO ] [REMOTE ] O: Fetching primary data for 2024-12. [2025-09-29T00:04:03.743867] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-29T00:04:03.798835] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-02. [2025-09-29T00:04:04.245257] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-29T00:04:04.251053] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-03. [2025-09-29T00:04:04.778550] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-29T00:04:04.795470] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-04. [2025-09-29T00:04:05.263622] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-29T00:04:05.268310] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-05. [2025-09-29T00:04:05.649520] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-29T00:04:05.679843] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-06. [2025-09-29T00:04:06.117034] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-29T00:04:06.129518] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-07. [2025-09-29T00:04:06.417545] [INFO ] [REMOTE ] O: Incremental fetch complete for 2024-12 (2.97 seconds). [2025-09-29T00:04:06.520553] [INFO ] [REMOTE ] O: Fetching primary data for 2025-01. [2025-09-29T00:04:06.570673] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-29T00:04:06.604542] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-08. [2025-09-29T00:04:06.951301] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-29T00:04:06.954275] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-09. [2025-09-29T00:04:07.459496] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-29T00:04:07.491441] [INFO ] [REMOTE ] NYC: Full fetch complete (1919 records). [2025-09-29T00:04:09.697780] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-01 (3.18 seconds). [2025-09-29T00:04:09.709688] [INFO ] [REMOTE ] O: Fetching primary data for 2025-02. [2025-09-29T00:04:12.153079] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-02 (2.44 seconds). [2025-09-29T00:04:12.164090] [INFO ] [REMOTE ] O: Fetching primary data for 2025-03. [2025-09-29T00:04:14.816935] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-03 (2.65 seconds). [2025-09-29T00:04:14.828810] [INFO ] [REMOTE ] O: Fetching primary data for 2025-04. [2025-09-29T00:04:17.042331] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-29T00:04:17.054627] [INFO ] [REMOTE ] O: Fetching primary data for 2025-05. [2025-09-29T00:04:19.706832] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-05 (2.65 seconds). [2025-09-29T00:04:19.718709] [INFO ] [REMOTE ] O: Fetching primary data for 2025-06. [2025-09-29T00:04:22.266860] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-06 (2.55 seconds). [2025-09-29T00:04:22.279838] [INFO ] [REMOTE ] O: Fetching primary data for 2025-07. [2025-09-29T00:04:24.931217] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-09-29T00:04:24.945297] [INFO ] [REMOTE ] O: Fetching primary data for 2025-08. [2025-09-29T00:04:27.618904] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-08 (2.67 seconds). [2025-09-29T00:04:27.630997] [INFO ] [REMOTE ] O: Fetching primary data for 2025-09. [2025-09-29T00:04:30.072889] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-09-29T00:04:30.088898] [INFO ] [REMOTE ] O: Full fetch complete (77559 records). [2025-09-29T00:04:32.578083] [INFO ] [REMOTE ] OPY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:04:32.604776] [INFO ] [REMOTE ] OPY: Fetching primary data for 2024-12. [2025-09-29T00:04:33.561048] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-29T00:04:33.676538] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-01. [2025-09-29T00:04:33.833434] [INFO ] [REMOTE ] ORCL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:04:33.881290] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2024-12. [2025-09-29T00:04:34.085542] [INFO ] [REMOTE ] ORI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:04:34.120749] [INFO ] [REMOTE ] ORI: Fetching primary data for 2024-12. [2025-09-29T00:04:34.474134] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-29T00:04:34.477269] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-02. [2025-09-29T00:04:34.980019] [INFO ] [REMOTE ] OSK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:04:34.980400] [INFO ] [REMOTE ] OSK: Fetching primary data for 2024-12. [2025-09-29T00:04:35.244976] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-29T00:04:35.246907] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-03. [2025-09-29T00:04:35.814712] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-29T00:04:35.824390] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-01. [2025-09-29T00:04:35.917068] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-29T00:04:35.928577] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-01. [2025-09-29T00:04:35.934275] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-29T00:04:35.936055] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-04. [2025-09-29T00:04:36.653294] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-29T00:04:36.662918] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-01. [2025-09-29T00:04:36.886812] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-29T00:04:36.889757] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-05. [2025-09-29T00:04:37.413708] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-29T00:04:37.424140] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-02. [2025-09-29T00:04:37.645521] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-29T00:04:37.648424] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-06. [2025-09-29T00:04:37.771308] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-29T00:04:37.780459] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-02. [2025-09-29T00:04:38.436263] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-01 (2.51 seconds). [2025-09-29T00:04:38.448339] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-02. [2025-09-29T00:04:38.457868] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-29T00:04:38.461217] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-07. [2025-09-29T00:04:39.076827] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-29T00:04:39.086803] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-03. [2025-09-29T00:04:39.129626] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-29T00:04:39.132588] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-08. [2025-09-29T00:04:39.164495] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-29T00:04:39.173526] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-03. [2025-09-29T00:04:39.707855] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-29T00:04:39.710372] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-09. [2025-09-29T00:04:40.205038] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-29T00:04:40.207893] [INFO ] [REMOTE ] OPY: Full fetch complete (10014 records). [2025-09-29T00:04:40.700236] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-29T00:04:40.744694] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-04. [2025-09-29T00:04:40.878232] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-09-29T00:04:40.987914] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-03. [2025-09-29T00:04:41.013372] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-29T00:04:41.056722] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-04. [2025-09-29T00:04:41.447552] [INFO ] [REMOTE ] OTF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:04:41.448169] [INFO ] [REMOTE ] OTF: Fetching primary data for 2024-12. [2025-09-29T00:04:41.664683] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:04:41.665290] [WARN ] [REMOTE ] OTF: No data returned for month 2024-12 [2025-09-29T00:04:41.665409] [FATAL] [REMOTE ] OTF: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:04:42.240815] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-29T00:04:42.251775] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-05. [2025-09-29T00:04:43.095001] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-29T00:04:43.107308] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-05. [2025-09-29T00:04:43.341669] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-09-29T00:04:43.354354] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-04. [2025-09-29T00:04:43.955425] [INFO ] [REMOTE ] OXY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:04:43.955945] [INFO ] [REMOTE ] OXY: Fetching primary data for 2024-12. [2025-09-29T00:04:43.981866] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-29T00:04:43.991583] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-06. [2025-09-29T00:04:44.890579] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-29T00:04:44.901933] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-06. [2025-09-29T00:04:45.569080] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-29T00:04:45.579823] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-07. [2025-09-29T00:04:46.005591] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-04 (2.65 seconds). [2025-09-29T00:04:46.017510] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-05. [2025-09-29T00:04:46.254878] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-09-29T00:04:46.266696] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-01. [2025-09-29T00:04:46.659028] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-29T00:04:46.669756] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-07. [2025-09-29T00:04:46.821807] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-29T00:04:46.831957] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-08. [2025-09-29T00:04:48.103634] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-29T00:04:48.113271] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-09. [2025-09-29T00:04:48.531362] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-09-29T00:04:48.543631] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-06. [2025-09-29T00:04:48.603787] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-29T00:04:48.615481] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-08. [2025-09-29T00:04:48.887440] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-01 (2.62 seconds). [2025-09-29T00:04:48.898495] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-02. [2025-09-29T00:04:49.749997] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-29T00:04:49.759567] [INFO ] [REMOTE ] OSK: Full fetch complete (61451 records). [2025-09-29T00:04:50.446058] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-29T00:04:50.457872] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-09. [2025-09-29T00:04:51.388340] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-02 (2.49 seconds). [2025-09-29T00:04:51.386494] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-06 (2.84 seconds). [2025-09-29T00:04:51.411589] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-03. [2025-09-29T00:04:51.413226] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-07. [2025-09-29T00:04:52.221880] [INFO ] [REMOTE ] PAII: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:04:52.222447] [INFO ] [REMOTE ] PAII: Fetching primary data for 2024-12. [2025-09-29T00:04:52.249214] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-29T00:04:52.259569] [INFO ] [REMOTE ] ORI: Full fetch complete (70200 records). [2025-09-29T00:04:52.534521] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:04:52.572881] [WARN ] [REMOTE ] PAII: No data returned for month 2024-12 [2025-09-29T00:04:52.586201] [FATAL] [REMOTE ] PAII: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:04:54.066086] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-03 (2.65 seconds). [2025-09-29T00:04:54.121172] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-04. [2025-09-29T00:04:54.473119] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-07 (3.06 seconds). [2025-09-29T00:04:54.562345] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-08. [2025-09-29T00:04:56.760104] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-04 (2.64 seconds). [2025-09-29T00:04:56.772938] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-05. [2025-09-29T00:04:57.171881] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-08 (2.61 seconds). [2025-09-29T00:04:57.184682] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-09. [2025-09-29T00:04:59.440520] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-05 (2.67 seconds). [2025-09-29T00:04:59.453019] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-06. [2025-09-29T00:04:59.700431] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-09-29T00:04:59.710989] [INFO ] [REMOTE ] ORCL: Full fetch complete (77532 records). [2025-09-29T00:05:01.925443] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-09-29T00:05:01.937236] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-07. [2025-09-29T00:05:04.839363] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-07 (2.90 seconds). [2025-09-29T00:05:04.852174] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-08. [2025-09-29T00:05:07.511468] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-08 (2.66 seconds). [2025-09-29T00:05:07.524663] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-09. [2025-09-29T00:05:09.860061] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-29T00:05:09.872126] [INFO ] [REMOTE ] OXY: Full fetch complete (77570 records). [2025-09-29T00:05:13.752035] [INFO ] [REMOTE ] PDCC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:05:13.758396] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2024-12. [2025-09-29T00:05:14.200000] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-29T00:05:14.222506] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-01. [2025-09-29T00:05:14.544740] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-09-29T00:05:14.599964] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-02. [2025-09-29T00:05:15.161795] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-29T00:05:15.191702] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-03. [2025-09-29T00:05:15.787575] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-29T00:05:15.819186] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-04. [2025-09-29T00:05:16.386233] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-29T00:05:16.436416] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-05. [2025-09-29T00:05:16.857283] [INFO ] [REMOTE ] PEW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:05:16.873176] [INFO ] [REMOTE ] PEW: Fetching primary data for 2024-12. [2025-09-29T00:05:16.909789] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-29T00:05:16.913292] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-06. [2025-09-29T00:05:17.116753] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:05:17.172032] [WARN ] [REMOTE ] PEW: No data returned for month 2024-12 [2025-09-29T00:05:17.240043] [FATAL] [REMOTE ] PEW: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:05:17.343023] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-29T00:05:17.345577] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-07. [2025-09-29T00:05:17.861843] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-29T00:05:17.873169] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-08. [2025-09-29T00:05:18.371608] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-29T00:05:18.383436] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-09. [2025-09-29T00:05:18.827118] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-29T00:05:18.873425] [INFO ] [REMOTE ] PDCC: Full fetch complete (1345 records). [2025-09-29T00:05:28.456101] [INFO ] [REMOTE ] PMTU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:05:28.489188] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2024-12. [2025-09-29T00:05:28.693845] [INFO ] [REMOTE ] PMTV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:05:28.699456] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2024-12. [2025-09-29T00:05:28.777792] [INFO ] [REMOTE ] PMTW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:05:28.792864] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2024-12. [2025-09-29T00:05:28.936393] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-29T00:05:28.954822] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-01. [2025-09-29T00:05:28.971054] [DEBUG] [REMOTE ] PMTV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:05:28.991173] [WARN ] [REMOTE ] PMTV: No data returned for month 2024-12 [2025-09-29T00:05:29.024320] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:05:29.024183] [FATAL] [REMOTE ] PMTV: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:05:29.025370] [WARN ] [REMOTE ] PMTW: No data returned for month 2024-12 [2025-09-29T00:05:29.025715] [FATAL] [REMOTE ] PMTW: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:05:29.411929] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-29T00:05:29.479342] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-02. [2025-09-29T00:05:29.997378] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-29T00:05:30.009900] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-03. [2025-09-29T00:05:30.435459] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-29T00:05:30.490006] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-04. [2025-09-29T00:05:31.052618] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-29T00:05:31.053855] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-05. [2025-09-29T00:05:31.473479] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-29T00:05:31.474494] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-06. [2025-09-29T00:05:31.801612] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-29T00:05:31.802810] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-07. [2025-09-29T00:05:32.155258] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-29T00:05:32.156332] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-08. [2025-09-29T00:05:32.471968] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-29T00:05:32.472943] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-09. [2025-09-29T00:05:32.800128] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-29T00:05:32.801230] [INFO ] [REMOTE ] PMTU: Full fetch complete (1236 records). [2025-09-29T00:05:35.002277] [INFO ] [REMOTE ] PRCS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:05:35.054364] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2024-12. [2025-09-29T00:05:35.616261] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-29T00:05:35.641427] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-01. [2025-09-29T00:05:36.237787] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-29T00:05:36.240727] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-02. [2025-09-29T00:05:36.805914] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-29T00:05:36.825805] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-03. [2025-09-29T00:05:37.480291] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-29T00:05:37.587413] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-04. [2025-09-29T00:05:37.901395] [INFO ] [REMOTE ] PRSU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:05:37.914769] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2024-12. [2025-09-29T00:05:38.174260] [DEBUG] [REMOTE ] PRSU: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:05:38.186241] [WARN ] [REMOTE ] PRSU: No data returned for month 2024-12 [2025-09-29T00:05:38.259921] [FATAL] [REMOTE ] PRSU: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:05:38.420566] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-29T00:05:38.480782] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-05. [2025-09-29T00:05:38.683898] [INFO ] [REMOTE ] PRVS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:05:38.684896] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2024-12. [2025-09-29T00:05:39.090554] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-29T00:05:39.144184] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-01. [2025-09-29T00:05:39.172258] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-29T00:05:39.211255] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-06. [2025-09-29T00:05:39.549593] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-29T00:05:39.552254] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-02. [2025-09-29T00:05:39.864881] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-29T00:05:39.908885] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-07. [2025-09-29T00:05:39.913819] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-29T00:05:39.922160] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-03. [2025-09-29T00:05:40.449802] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-29T00:05:40.484426] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-29T00:05:40.488412] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-08. [2025-09-29T00:05:40.478467] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-04. [2025-09-29T00:05:40.893889] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-29T00:05:40.923060] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-05. [2025-09-29T00:05:41.061305] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-29T00:05:41.072767] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-09. [2025-09-29T00:05:41.228431] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-29T00:05:41.266556] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-06. [2025-09-29T00:05:41.559712] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-29T00:05:41.583127] [INFO ] [REMOTE ] PRCS: Full fetch complete (3804 records). [2025-09-29T00:05:41.700419] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-29T00:05:41.718576] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-07. [2025-09-29T00:05:42.193928] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-29T00:05:42.236365] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-08. [2025-09-29T00:05:42.641580] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-29T00:05:42.696008] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-09. [2025-09-29T00:05:43.133144] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-29T00:05:43.134163] [INFO ] [REMOTE ] PRVS: Full fetch complete (1271 records). [2025-09-29T00:05:49.257913] [INFO ] [REMOTE ] RCB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:05:49.290031] [INFO ] [REMOTE ] RCB: Fetching primary data for 2024-12. [2025-09-29T00:05:49.299681] [INFO ] [REMOTE ] RCD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:05:49.315953] [INFO ] [REMOTE ] RCD: Fetching primary data for 2024-12. [2025-09-29T00:05:49.902165] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-29T00:05:49.916729] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-01. [2025-09-29T00:05:49.915301] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-29T00:05:49.930878] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-01. [2025-09-29T00:05:50.464473] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-29T00:05:50.483150] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-02. [2025-09-29T00:05:50.623243] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-29T00:05:50.627671] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-02. [2025-09-29T00:05:51.113730] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-29T00:05:51.139345] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-03. [2025-09-29T00:05:51.144455] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-29T00:05:51.146578] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-03. [2025-09-29T00:05:51.747288] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-29T00:05:51.782965] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-04. [2025-09-29T00:05:51.833589] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-29T00:05:51.837189] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-04. [2025-09-29T00:05:52.398747] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-29T00:05:52.463368] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-05. [2025-09-29T00:05:52.487172] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-29T00:05:52.490348] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-05. [2025-09-29T00:05:53.083315] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-29T00:05:53.090069] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-29T00:05:53.112581] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-06. [2025-09-29T00:05:53.119013] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-06. [2025-09-29T00:05:53.652981] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-29T00:05:53.714686] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-07. [2025-09-29T00:05:53.733965] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-29T00:05:53.783371] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-07. [2025-09-29T00:05:54.201139] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-29T00:05:54.203844] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-08. [2025-09-29T00:05:54.393781] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-29T00:05:54.396177] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-08. [2025-09-29T00:05:54.715382] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-29T00:05:54.716524] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-09. [2025-09-29T00:05:54.878458] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-29T00:05:54.880500] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-09. [2025-09-29T00:05:54.972745] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-09-29T00:05:54.974089] [INFO ] [REMOTE ] RCB: Full fetch complete (3747 records). [2025-09-29T00:05:55.506834] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-29T00:05:55.508462] [INFO ] [REMOTE ] RCD: Full fetch complete (6867 records). [2025-09-29T00:05:57.175108] [INFO ] [REMOTE ] RHLD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:05:57.251522] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2024-12. [2025-09-29T00:05:57.682396] [DEBUG] [REMOTE ] RHLD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:05:57.682869] [WARN ] [REMOTE ] RHLD: No data returned for month 2024-12 [2025-09-29T00:05:57.683286] [FATAL] [REMOTE ] RHLD: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:06:08.223760] [INFO ] [REMOTE ] RWTO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:06:08.252362] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2024-12. [2025-09-29T00:06:08.259424] [INFO ] [REMOTE ] RWTN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:06:08.273369] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2024-12. [2025-09-29T00:06:08.782933] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-29T00:06:08.828838] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-01. [2025-09-29T00:06:08.859967] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-29T00:06:08.942261] [INFO ] [REMOTE ] RWTP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:06:08.937350] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-01. [2025-09-29T00:06:08.944146] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2024-12. [2025-09-29T00:06:09.202859] [DEBUG] [REMOTE ] RWTP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:06:09.225549] [WARN ] [REMOTE ] RWTP: No data returned for month 2024-12 [2025-09-29T00:06:09.225735] [FATAL] [REMOTE ] RWTP: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:06:09.525456] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-29T00:06:09.548756] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-02. [2025-09-29T00:06:09.606077] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-29T00:06:09.641266] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-02. [2025-09-29T00:06:09.931063] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-29T00:06:09.933076] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-03. [2025-09-29T00:06:10.163417] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-29T00:06:10.165441] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-03. [2025-09-29T00:06:10.505245] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-29T00:06:10.513771] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-04. [2025-09-29T00:06:10.527293] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-29T00:06:10.529807] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-04. [2025-09-29T00:06:11.071457] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-29T00:06:11.073673] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-05. [2025-09-29T00:06:11.604324] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-29T00:06:11.627629] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-05. [2025-09-29T00:06:11.630800] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-29T00:06:11.654247] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-06. [2025-09-29T00:06:12.205116] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-29T00:06:12.229159] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-06. [2025-09-29T00:06:12.297807] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-29T00:06:12.306838] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-07. [2025-09-29T00:06:12.474228] [INFO ] [REMOTE ] SAJ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:06:12.495514] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2024-12. [2025-09-29T00:06:12.619460] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-29T00:06:12.620796] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-07. [2025-09-29T00:06:12.918588] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-29T00:06:12.934449] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-01. [2025-09-29T00:06:12.974255] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-29T00:06:13.006537] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-08. [2025-09-29T00:06:13.017048] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-29T00:06:13.038571] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-08. [2025-09-29T00:06:13.316378] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-29T00:06:13.318011] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-02. [2025-09-29T00:06:13.616737] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-29T00:06:13.619467] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-09. [2025-09-29T00:06:13.671534] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-29T00:06:13.674034] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-29T00:06:13.680403] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-03. [2025-09-29T00:06:13.681525] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-09. [2025-09-29T00:06:13.958273] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-09-29T00:06:13.982682] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-04. [2025-09-29T00:06:14.182242] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-29T00:06:14.194757] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-29T00:06:14.201945] [INFO ] [REMOTE ] RWTO: Full fetch complete (4801 records). [2025-09-29T00:06:14.203469] [INFO ] [REMOTE ] RWTN: Full fetch complete (3130 records). [2025-09-29T00:06:14.403157] [INFO ] [REMOTE ] SAT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:06:14.466567] [INFO ] [REMOTE ] SAT: Fetching primary data for 2024-12. [2025-09-29T00:06:14.460748] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-29T00:06:14.499207] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-05. [2025-09-29T00:06:15.014948] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-29T00:06:15.015128] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-29T00:06:15.063561] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-01. [2025-09-29T00:06:15.115501] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-06. [2025-09-29T00:06:15.555451] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-29T00:06:15.555703] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-29T00:06:15.631515] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-07. [2025-09-29T00:06:15.625392] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-02. [2025-09-29T00:06:15.933362] [INFO ] [REMOTE ] SAY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:06:15.957562] [INFO ] [REMOTE ] SAY: Fetching primary data for 2024-12. [2025-09-29T00:06:16.000715] [INFO ] [REMOTE ] SAZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:06:16.001319] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2024-12. [2025-09-29T00:06:16.003981] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-29T00:06:16.006184] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-08. [2025-09-29T00:06:16.125350] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-29T00:06:16.126438] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-03. [2025-09-29T00:06:16.314167] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-29T00:06:16.315396] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-01. [2025-09-29T00:06:16.361007] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-29T00:06:16.362045] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-09. [2025-09-29T00:06:16.385134] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-09-29T00:06:16.386317] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-01. [2025-09-29T00:06:16.440056] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-29T00:06:16.441253] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-04. [2025-09-29T00:06:16.596999] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-01 (0.28 seconds). [2025-09-29T00:06:16.598940] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-02. [2025-09-29T00:06:16.619242] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-09-29T00:06:16.620230] [INFO ] [REMOTE ] SAJ: Full fetch complete (924 records). [2025-09-29T00:06:16.718624] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-29T00:06:16.746035] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-02. [2025-09-29T00:06:16.754741] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-09-29T00:06:16.779405] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-05. [2025-09-29T00:06:16.867503] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-09-29T00:06:16.868821] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-03. [2025-09-29T00:06:17.202287] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-29T00:06:17.226018] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-06. [2025-09-29T00:06:17.234021] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-29T00:06:17.236239] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-03. [2025-09-29T00:06:17.347198] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-29T00:06:17.397181] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-04. [2025-09-29T00:06:17.536119] [INFO ] [REMOTE ] SBDS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:06:17.536500] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2024-12. [2025-09-29T00:06:17.581964] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-29T00:06:17.583038] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-07. [2025-09-29T00:06:17.733177] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-29T00:06:17.736855] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-04. [2025-09-29T00:06:17.736975] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-29T00:06:17.739054] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-05. [2025-09-29T00:06:17.746258] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:06:17.746633] [WARN ] [REMOTE ] SBDS: No data returned for month 2024-12 [2025-09-29T00:06:17.746770] [FATAL] [REMOTE ] SBDS: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:06:17.936335] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-29T00:06:17.937553] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-08. [2025-09-29T00:06:18.105306] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-29T00:06:18.105106] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-29T00:06:18.128160] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-06. [2025-09-29T00:06:18.150959] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-05. [2025-09-29T00:06:18.318790] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-29T00:06:18.323109] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-09. [2025-09-29T00:06:18.573573] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-29T00:06:18.606361] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-07. [2025-09-29T00:06:18.616320] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-09-29T00:06:18.617227] [INFO ] [REMOTE ] SAT: Full fetch complete (1599 records). [2025-09-29T00:06:18.691962] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-29T00:06:18.733109] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-06. [2025-09-29T00:06:18.920511] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-29T00:06:18.955476] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-08. [2025-09-29T00:06:19.174116] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-29T00:06:19.180962] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-07. [2025-09-29T00:06:19.337371] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-29T00:06:19.339125] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-09. [2025-09-29T00:06:19.578077] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-29T00:06:19.579221] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-08. [2025-09-29T00:06:19.697477] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-29T00:06:19.698441] [INFO ] [REMOTE ] SAY: Full fetch complete (1412 records). [2025-09-29T00:06:19.997707] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-29T00:06:19.999365] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-09. [2025-09-29T00:06:20.339322] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-29T00:06:20.340299] [INFO ] [REMOTE ] SAZ: Full fetch complete (1809 records). [2025-09-29T00:06:22.168574] [INFO ] [REMOTE ] SBXD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:06:22.242177] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2024-12. [2025-09-29T00:06:22.599073] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-29T00:06:22.632547] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-01. [2025-09-29T00:06:22.917747] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-01 (0.29 seconds). [2025-09-29T00:06:22.957598] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-02. [2025-09-29T00:06:23.397837] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-29T00:06:23.506051] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-03. [2025-09-29T00:06:23.929318] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-29T00:06:23.947959] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-04. [2025-09-29T00:06:24.284499] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-29T00:06:24.288043] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-05. [2025-09-29T00:06:24.680616] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-29T00:06:24.720524] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-06. [2025-09-29T00:06:25.796288] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-29T00:06:25.878274] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-07. [2025-09-29T00:06:26.549211] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-29T00:06:26.584587] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-08. [2025-09-29T00:06:27.241552] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-29T00:06:27.273953] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-09. [2025-09-29T00:06:27.702771] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-29T00:06:27.721334] [INFO ] [REMOTE ] SBXD: Full fetch complete (3078 records). [2025-09-29T00:06:28.165278] [INFO ] [REMOTE ] SGI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:06:28.219690] [INFO ] [REMOTE ] SGI: Fetching primary data for 2024-12. [2025-09-29T00:06:28.508443] [DEBUG] [REMOTE ] SGI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:06:28.524039] [WARN ] [REMOTE ] SGI: No data returned for month 2024-12 [2025-09-29T00:06:28.529801] [FATAL] [REMOTE ] SGI: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:06:30.881537] [INFO ] [REMOTE ] SI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:06:30.938852] [INFO ] [REMOTE ] SI: Fetching primary data for 2024-12. [2025-09-29T00:06:31.665974] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:06:31.666328] [WARN ] [REMOTE ] SI: No data returned for month 2024-12 [2025-09-29T00:06:31.666417] [FATAL] [REMOTE ] SI: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:06:36.167070] [INFO ] [REMOTE ] SLNZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:06:36.179306] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2024-12. [2025-09-29T00:06:36.709056] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-29T00:06:36.783039] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-01. [2025-09-29T00:06:37.192750] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-29T00:06:37.289544] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-02. [2025-09-29T00:06:37.528371] [INFO ] [REMOTE ] SMA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:06:37.551845] [INFO ] [REMOTE ] SMA: Fetching primary data for 2024-12. [2025-09-29T00:06:37.730626] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-29T00:06:37.769573] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-03. [2025-09-29T00:06:37.889791] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:06:37.890499] [WARN ] [REMOTE ] SMA: No data returned for month 2024-12 [2025-09-29T00:06:37.890592] [FATAL] [REMOTE ] SMA: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:06:38.225823] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-29T00:06:38.243068] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-04. [2025-09-29T00:06:38.686851] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-29T00:06:38.725761] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-05. [2025-09-29T00:06:39.149525] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-29T00:06:39.188746] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-06. [2025-09-29T00:06:39.678720] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-29T00:06:39.692821] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-07. [2025-09-29T00:06:40.148910] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-29T00:06:40.198104] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-08. [2025-09-29T00:06:40.591963] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-29T00:06:40.614691] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-09. [2025-09-29T00:06:41.118381] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-29T00:06:41.162012] [INFO ] [REMOTE ] SLNZ: Full fetch complete (1060 records). [2025-09-29T00:06:43.726735] [INFO ] [REMOTE ] SOJF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:06:43.740298] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2024-12. [2025-09-29T00:06:43.999448] [DEBUG] [REMOTE ] SOJF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:06:44.054381] [WARN ] [REMOTE ] SOJF: No data returned for month 2024-12 [2025-09-29T00:06:44.072966] [FATAL] [REMOTE ] SOJF: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:06:47.805005] [INFO ] [REMOTE ] SPME: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:06:47.806184] [INFO ] [REMOTE ] SPME: Fetching primary data for 2024-12. [2025-09-29T00:06:48.035506] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:06:48.061181] [WARN ] [REMOTE ] SPME: No data returned for month 2024-12 [2025-09-29T00:06:48.092059] [FATAL] [REMOTE ] SPME: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:06:51.914854] [INFO ] [REMOTE ] SRL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:06:51.957172] [INFO ] [REMOTE ] SRL: Fetching primary data for 2024-12. [2025-09-29T00:06:52.585897] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-29T00:06:52.587448] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-01. [2025-09-29T00:06:53.060918] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-29T00:06:53.062175] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-02. [2025-09-29T00:06:53.434630] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-29T00:06:53.435792] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-03. [2025-09-29T00:06:53.787679] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-29T00:06:53.788851] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-04. [2025-09-29T00:06:54.235896] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-29T00:06:54.237463] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-05. [2025-09-29T00:06:54.675663] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-29T00:06:54.676922] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-06. [2025-09-29T00:06:55.113032] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-29T00:06:55.114592] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-07. [2025-09-29T00:06:55.470043] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-29T00:06:55.471211] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-08. [2025-09-29T00:06:55.811796] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-29T00:06:55.812850] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-09. [2025-09-29T00:06:56.170989] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-29T00:06:56.172453] [INFO ] [REMOTE ] SRL: Full fetch complete (1966 records). [2025-09-29T00:06:59.868017] [INFO ] [REMOTE ] STG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:06:59.924502] [INFO ] [REMOTE ] STG: Fetching primary data for 2024-12. [2025-09-29T00:07:00.358725] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-29T00:07:00.420304] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-01. [2025-09-29T00:07:00.970332] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-29T00:07:01.039409] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-02. [2025-09-29T00:07:01.512462] [INFO ] [REMOTE ] STUB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:07:01.526455] [INFO ] [REMOTE ] STUB: Fetching primary data for 2024-12. [2025-09-29T00:07:01.525542] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-29T00:07:01.576881] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-03. [2025-09-29T00:07:01.822340] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:07:01.823522] [WARN ] [REMOTE ] STUB: No data returned for month 2024-12 [2025-09-29T00:07:01.823694] [FATAL] [REMOTE ] STUB: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:07:02.015074] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-29T00:07:02.053953] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-04. [2025-09-29T00:07:02.592817] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-29T00:07:02.625024] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-05. [2025-09-29T00:07:03.131337] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-29T00:07:03.132867] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-06. [2025-09-29T00:07:03.728192] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-29T00:07:03.789545] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-07. [2025-09-29T00:07:03.965045] [INFO ] [REMOTE ] STXM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:07:03.970307] [INFO ] [REMOTE ] STXM: Fetching primary data for 2024-12. [2025-09-29T00:07:04.380549] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-29T00:07:04.397756] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-01. [2025-09-29T00:07:04.673933] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-29T00:07:04.724342] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-08. [2025-09-29T00:07:04.922587] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-29T00:07:04.961955] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-02. [2025-09-29T00:07:05.244771] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-29T00:07:05.246856] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-09. [2025-09-29T00:07:05.424391] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-29T00:07:05.460834] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-03. [2025-09-29T00:07:05.714841] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-29T00:07:05.716166] [INFO ] [REMOTE ] STG: Full fetch complete (2496 records). [2025-09-29T00:07:05.823172] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-29T00:07:05.911666] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-04. [2025-09-29T00:07:06.511729] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-29T00:07:06.608140] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-05. [2025-09-29T00:07:07.052917] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-29T00:07:07.054817] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-06. [2025-09-29T00:07:07.399861] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-29T00:07:07.401137] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-07. [2025-09-29T00:07:07.815666] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-29T00:07:07.816932] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-08. [2025-09-29T00:07:08.354362] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-29T00:07:08.355454] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-09. [2025-09-29T00:07:08.706758] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-29T00:07:08.707686] [INFO ] [REMOTE ] STXM: Full fetch complete (1431 records). [2025-09-29T00:07:13.667593] [INFO ] [REMOTE ] TBLU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:07:13.733363] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2024-12. [2025-09-29T00:07:13.968726] [INFO ] [REMOTE ] TCAI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:07:13.969415] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2024-12. [2025-09-29T00:07:14.160300] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-29T00:07:14.192926] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-01. [2025-09-29T00:07:14.219206] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:07:14.226158] [WARN ] [REMOTE ] TCAI: No data returned for month 2024-12 [2025-09-29T00:07:14.259144] [FATAL] [REMOTE ] TCAI: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:07:14.683918] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-29T00:07:14.705834] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-02. [2025-09-29T00:07:15.111788] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-29T00:07:15.168835] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-03. [2025-09-29T00:07:15.721573] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-29T00:07:15.791949] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-04. [2025-09-29T00:07:16.175861] [INFO ] [REMOTE ] TE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:07:16.206037] [INFO ] [REMOTE ] TE: Fetching primary data for 2024-12. [2025-09-29T00:07:16.265961] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-29T00:07:16.295049] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-05. [2025-09-29T00:07:16.503810] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:07:16.508130] [WARN ] [REMOTE ] TE: No data returned for month 2024-12 [2025-09-29T00:07:16.539478] [FATAL] [REMOTE ] TE: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:07:16.797695] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-29T00:07:16.858162] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-06. [2025-09-29T00:07:17.362968] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-29T00:07:17.425822] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-07. [2025-09-29T00:07:17.906115] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-29T00:07:17.970682] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-08. [2025-09-29T00:07:18.462201] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-29T00:07:18.539195] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-09. [2025-09-29T00:07:18.955804] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-29T00:07:18.989263] [INFO ] [REMOTE ] TBLU: Full fetch complete (1172 records). [2025-09-29T00:07:20.350477] [INFO ] [REMOTE ] TGE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:07:20.350891] [INFO ] [REMOTE ] TGE: Fetching primary data for 2024-12. [2025-09-29T00:07:20.575785] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:07:20.576148] [WARN ] [REMOTE ] TGE: No data returned for month 2024-12 [2025-09-29T00:07:20.576237] [FATAL] [REMOTE ] TGE: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:07:25.232622] [INFO ] [REMOTE ] TIC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:07:25.239515] [INFO ] [REMOTE ] TIC: Fetching primary data for 2024-12. [2025-09-29T00:07:25.516203] [DEBUG] [REMOTE ] TIC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:07:25.543064] [WARN ] [REMOTE ] TIC: No data returned for month 2024-12 [2025-09-29T00:07:25.559732] [FATAL] [REMOTE ] TIC: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:07:29.383818] [INFO ] [REMOTE ] TNGY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:07:29.418831] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2024-12. [2025-09-29T00:07:29.706278] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:07:29.722403] [WARN ] [REMOTE ] TNGY: No data returned for month 2024-12 [2025-09-29T00:07:29.722589] [FATAL] [REMOTE ] TNGY: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:07:37.542140] [INFO ] [REMOTE ] TTAM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:07:37.564333] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2024-12. [2025-09-29T00:07:37.914549] [DEBUG] [REMOTE ] TTAM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:07:37.962051] [WARN ] [REMOTE ] TTAM: No data returned for month 2024-12 [2025-09-29T00:07:37.980170] [FATAL] [REMOTE ] TTAM: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:07:40.745978] [INFO ] [REMOTE ] TWOD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:07:40.746503] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2024-12. [2025-09-29T00:07:40.983141] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:07:40.983551] [WARN ] [REMOTE ] TWOD: No data returned for month 2024-12 [2025-09-29T00:07:40.983687] [FATAL] [REMOTE ] TWOD: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:07:56.090759] [INFO ] [REMOTE ] VG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:07:56.140346] [INFO ] [REMOTE ] VG: Fetching primary data for 2024-12. [2025-09-29T00:07:56.409448] [DEBUG] [REMOTE ] VG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:07:56.534786] [WARN ] [REMOTE ] VG: No data returned for month 2024-12 [2025-09-29T00:07:56.540255] [FATAL] [REMOTE ] VG: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:07:57.063254] [INFO ] [REMOTE ] VIA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:07:57.080883] [INFO ] [REMOTE ] VIA: Fetching primary data for 2024-12. [2025-09-29T00:07:57.495419] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:07:57.571234] [WARN ] [REMOTE ] VIA: No data returned for month 2024-12 [2025-09-29T00:07:57.592313] [FATAL] [REMOTE ] VIA: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:08:02.758317] [INFO ] [REMOTE ] VOYG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:08:02.836545] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2024-12. [2025-09-29T00:08:03.153125] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:08:03.166605] [WARN ] [REMOTE ] VOYG: No data returned for month 2024-12 [2025-09-29T00:08:03.172139] [FATAL] [REMOTE ] VOYG: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:08:09.005127] [INFO ] [REMOTE ] WBI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:08:09.061664] [INFO ] [REMOTE ] WBI: Fetching primary data for 2024-12. [2025-09-29T00:08:09.341842] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:08:09.365021] [WARN ] [REMOTE ] WBI: No data returned for month 2024-12 [2025-09-29T00:08:09.397409] [FATAL] [REMOTE ] WBI: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:08:16.756034] [INFO ] [REMOTE ] WLTG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:08:16.756955] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2024-12. [2025-09-29T00:08:17.169259] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-29T00:08:17.191224] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-01. [2025-09-29T00:08:17.573461] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-29T00:08:17.580243] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-02. [2025-09-29T00:08:18.034220] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-29T00:08:18.051449] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-03. [2025-09-29T00:08:18.504027] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-29T00:08:18.539560] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-04. [2025-09-29T00:08:19.110329] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-29T00:08:19.115404] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-05. [2025-09-29T00:08:19.512948] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-29T00:08:19.548068] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-06. [2025-09-29T00:08:19.975152] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-29T00:08:19.976554] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-07. [2025-09-29T00:08:20.400595] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-29T00:08:20.401982] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-08. [2025-09-29T00:08:20.861739] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-29T00:08:20.863059] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-09. [2025-09-29T00:08:21.208702] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-29T00:08:21.209594] [INFO ] [REMOTE ] WLTG: Full fetch complete (1661 records). [2025-09-29T00:08:24.674571] [INFO ] [REMOTE ] WTM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:08:24.778959] [INFO ] [REMOTE ] WTM: Fetching primary data for 2024-12. [2025-09-29T00:08:25.447589] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-29T00:08:25.484597] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-01. [2025-09-29T00:08:26.197350] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-29T00:08:26.237484] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-02. [2025-09-29T00:08:26.538368] [INFO ] [REMOTE ] XIFR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:08:26.557566] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2024-12. [2025-09-29T00:08:26.814362] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-29T00:08:26.816267] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-03. [2025-09-29T00:08:26.822334] [DEBUG] [REMOTE ] XIFR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:08:26.846550] [WARN ] [REMOTE ] XIFR: No data returned for month 2024-12 [2025-09-29T00:08:26.878995] [FATAL] [REMOTE ] XIFR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:08:27.453299] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-29T00:08:27.466177] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-04. [2025-09-29T00:08:28.070042] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-29T00:08:28.099626] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-05. [2025-09-29T00:08:28.687480] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-29T00:08:28.707066] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-06. [2025-09-29T00:08:29.240425] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-29T00:08:29.261955] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-07. [2025-09-29T00:08:29.619814] [INFO ] [REMOTE ] XYZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T00:08:29.689387] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2024-12. [2025-09-29T00:08:29.728959] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-29T00:08:29.743510] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-08. [2025-09-29T00:08:29.938908] [DEBUG] [REMOTE ] XYZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T00:08:29.963367] [WARN ] [REMOTE ] XYZ: No data returned for month 2024-12 [2025-09-29T00:08:29.993782] [FATAL] [REMOTE ] XYZ: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T00:08:30.438630] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-29T00:08:30.470984] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-09. [2025-09-29T00:08:31.209365] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-29T00:08:31.251004] [INFO ] [REMOTE ] WTM: Full fetch complete (2277 records). [2025-09-29T00:08:35.848202] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-09-29T00:08:37.274589] [DEBUG] [SYMBOL ] Found 2423 valid NYSE symbols. [2025-09-29T00:08:37.274820] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-09-29T01:57:20.048238] [INFO ] [MAIN ] Using last completed trading day: 2025-09-26 [2025-09-29T01:57:20.248862] [DEBUG] [R-STATUS ] Registered 'tdm' as a dependent service. [2025-09-29T01:57:20.249072] [INFO ] [STATE ] Waiting for all dependent services to be clear... [2025-09-29T01:57:20.460941] [WARN ] [tdm-status] Service 'tdm' is not running. [2025-09-29T01:57:20.461405] [WARN ] [STATE ] State set to: RUNNING [2025-09-29T01:57:20.461571] [INFO ] [MAIN ] Refreshing symbols list before update... [2025-09-29T01:57:20.461775] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-09-29T01:57:20.461963] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-09-29T01:57:20.462071] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-09-29T01:57:21.422295] [DEBUG] [SYMBOL ] Found 2423 valid NYSE symbols. [2025-09-29T01:57:21.422484] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-09-29T01:57:21.422792] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-09-29T01:57:21.423479] [INFO ] [LOCAL ] Symbols cache updated with 2371 symbols. [2025-09-29T01:57:21.423560] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-09-29T01:57:21.423632] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-09-29T01:57:21.423829] [INFO ] [MAIN ] Pruning stale symbols... [2025-09-29T01:57:21.423910] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-09-29T01:57:21.423985] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-29T01:57:21.424426] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-09-29T01:57:21.424503] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-29T01:57:21.424757] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-09-29T01:57:21.424862] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2371 valid symbols. [2025-09-29T01:57:21.424954] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-09-29T01:57:21.425031] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-09-29T01:57:21.453828] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-09-29T01:57:21.481969] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-09-29T01:57:21.482114] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-09-29T01:57:21.482192] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-09-29T01:57:21.482264] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-09-29T01:57:21.482398] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-29T01:57:21.482871] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-09-29T01:57:21.482949] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-29T01:57:21.483025] [INFO ] [MAIN ] Starting incremental update for 2371 symbols. [2025-09-29T01:57:21.483095] [INFO ] [MAIN ] Running in parallel mode [2025-09-29T01:57:21.483281] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2371 symbols [2025-09-29T01:57:22.193049] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:22.207446] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:22.263140] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:22.255768] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-09-29T01:57:22.269258] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-09-29T01:57:22.271744] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-09-29T01:57:22.298057] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:22.298771] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-29T01:57:22.299017] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-29T01:57:22.299165] [DEBUG] [LOCAL ] AAMI: No existing data file found in primary storage. [2025-09-29T01:57:22.299257] [WARN ] [MAIN ] AAMI: No existing data found, performing full refresh instead. [2025-09-29T01:57:22.299376] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-09-29T01:57:22.299579] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-09-29T01:57:22.301415] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-29T01:57:22.315695] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-09-29T01:57:22.327066] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-09-29T01:57:22.929970] [DEBUG] [LOCAL ] A: Loaded 51487 existing records from primary storage. [2025-09-29T01:57:22.972436] [INFO ] [MAIN ] A: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:23.010937] [INFO ] [MAIN ] Update Progress: 1/2371 symbols completed. A took 1.5s. Estimated remaining: 1h 0m 21s. Rate: 39.3 symbols/min [2025-09-29T01:57:23.104708] [DEBUG] [LOCAL ] AA: Loaded 54394 existing records from primary storage. [2025-09-29T01:57:23.164970] [INFO ] [MAIN ] AA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:23.296423] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:57:23.307257] [INFO ] [REMOTE ] AAM: Fetching primary data for 2024-12. [2025-09-29T01:57:23.307827] [INFO ] [MAIN ] Update Progress: 2/2371 symbols completed. AA took 1.8s. Estimated remaining: 36m 1s. Rate: 65.8 symbols/min [2025-09-29T01:57:23.382113] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:57:23.400602] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2024-12. [2025-09-29T01:57:23.516889] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:23.637931] [DEBUG] [REMOTE ] AAMI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:57:23.671147] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:23.671976] [WARN ] [REMOTE ] AAMI: No data returned for month 2024-12 [2025-09-29T01:57:23.672137] [FATAL] [REMOTE ] AAMI: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:57:23.672239] [FATAL] [MAIN ] AAMI: Failed to fetch primary data. [2025-09-29T01:57:23.672733] [WARN ] [MAIN ] AAMI: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:57:23.672828] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-29T01:57:23.672918] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-09-29T01:57:23.672990] [INFO ] [LOCAL ] AAMI: Starting deletion of derivative data. [2025-09-29T01:57:23.673057] [DEBUG] [LOCAL ] AAMI: No derivative data file found to delete. [2025-09-29T01:57:23.673125] [INFO ] [MAIN ] Update Progress: 3/2371 symbols completed. AAMI took 2.1s. Estimated remaining: 28m 49s. Rate: 82.2 symbols/min [2025-09-29T01:57:23.871286] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-29T01:57:23.913802] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-09-29T01:57:23.946510] [DEBUG] [LOCAL ] AAP: Loaded 52789 existing records from primary storage. [2025-09-29T01:57:23.953321] [INFO ] [MAIN ] AAP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:23.955514] [INFO ] [MAIN ] Update Progress: 4/2371 symbols completed. AAP took 0.9s. Estimated remaining: 24m 23s. Rate: 97.1 symbols/min [2025-09-29T01:57:23.953186] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:23.954211] [DEBUG] [LOCAL ] AAT: Loaded 31069 existing records from primary storage. [2025-09-29T01:57:23.968117] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-09-29T01:57:23.979397] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-09-29T01:57:23.996732] [INFO ] [MAIN ] AAT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:24.013691] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-09-29T01:57:24.013610] [INFO ] [MAIN ] Update Progress: 5/2371 symbols completed. AAT took 0.6s. Estimated remaining: 19m 57s. Rate: 118.6 symbols/min [2025-09-29T01:57:24.038800] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-29T01:57:24.071525] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-29T01:57:24.088187] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-09-29T01:57:24.303687] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-29T01:57:24.368135] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-09-29T01:57:24.379867] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:24.493475] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:24.666780] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-29T01:57:24.704118] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-09-29T01:57:24.772677] [DEBUG] [LOCAL ] AB: Loaded 28642 existing records from primary storage. [2025-09-29T01:57:24.812495] [INFO ] [MAIN ] AB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:24.839367] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:57:24.841595] [INFO ] [MAIN ] Update Progress: 6/2371 symbols completed. AB took 0.9s. Estimated remaining: 22m 4s. Rate: 107.2 symbols/min [2025-09-29T01:57:24.841959] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2024-12. [2025-09-29T01:57:24.945712] [DEBUG] [LOCAL ] ABBV: Loaded 54465 existing records from primary storage. [2025-09-29T01:57:24.975081] [INFO ] [MAIN ] ABBV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:24.980958] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-09-29T01:57:24.981616] [INFO ] [MAIN ] Update Progress: 7/2371 symbols completed. ABBV took 0.9s. Estimated remaining: 19m 41s. Rate: 120.1 symbols/min [2025-09-29T01:57:24.982803] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-09-29T01:57:25.046012] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:57:25.156020] [WARN ] [REMOTE ] AAUC: No data returned for month 2024-12 [2025-09-29T01:57:25.170778] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:25.185929] [FATAL] [REMOTE ] AAUC: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:57:25.191540] [FATAL] [MAIN ] AAUC: Failed to fetch primary data. [2025-09-29T01:57:25.192025] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:57:25.203752] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-29T01:57:25.209198] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-29T01:57:25.214410] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-09-29T01:57:25.220261] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-09-29T01:57:25.242771] [INFO ] [MAIN ] Update Progress: 8/2371 symbols completed. AAUC took 1.6s. Estimated remaining: 18m 30s. Rate: 127.7 symbols/min [2025-09-29T01:57:25.278995] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:25.324610] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-29T01:57:25.355375] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-09-29T01:57:25.504549] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:25.505438] [DEBUG] [LOCAL ] ABCB: Loaded 31144 existing records from primary storage. [2025-09-29T01:57:25.505803] [INFO ] [MAIN ] ABCB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:25.506552] [INFO ] [MAIN ] Update Progress: 9/2371 symbols completed. ABCB took 0.7s. Estimated remaining: 17m 36s. Rate: 134.2 symbols/min [2025-09-29T01:57:25.573417] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.22 seconds). [2025-09-29T01:57:25.594365] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-09-29T01:57:25.670113] [DEBUG] [LOCAL ] ABG: Loaded 19034 existing records from primary storage. [2025-09-29T01:57:25.690459] [INFO ] [MAIN ] ABG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:25.712568] [DEBUG] [LOCAL ] ABEV: Loaded 54055 existing records from primary storage. [2025-09-29T01:57:25.752680] [INFO ] [MAIN ] Update Progress: 10/2371 symbols completed. ABG took 0.5s. Estimated remaining: 16m 48s. Rate: 140.5 symbols/min [2025-09-29T01:57:25.778049] [INFO ] [MAIN ] ABEV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:25.778205] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.18 seconds). [2025-09-29T01:57:25.796957] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-09-29T01:57:25.779376] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:25.823861] [INFO ] [MAIN ] Update Progress: 11/2371 symbols completed. ABEV took 0.8s. Estimated remaining: 15m 31s. Rate: 152.1 symbols/min [2025-09-29T01:57:26.178491] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:26.172049] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-29T01:57:26.181733] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-09-29T01:57:26.214143] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:26.215733] [DEBUG] [LOCAL ] ABM: Loaded 32915 existing records from primary storage. [2025-09-29T01:57:26.220473] [INFO ] [MAIN ] ABM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:26.220719] [INFO ] [MAIN ] Update Progress: 12/2371 symbols completed. ABM took 0.7s. Estimated remaining: 15m 31s. Rate: 152.0 symbols/min [2025-09-29T01:57:26.470079] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:26.495101] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-29T01:57:26.513039] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-09-29T01:57:26.518985] [DEBUG] [LOCAL ] ABR: Loaded 52817 existing records from primary storage. [2025-09-29T01:57:26.521702] [INFO ] [MAIN ] ABR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:26.538534] [INFO ] [MAIN ] Update Progress: 13/2371 symbols completed. ABR took 0.8s. Estimated remaining: 15m 17s. Rate: 154.3 symbols/min [2025-09-29T01:57:26.588722] [DEBUG] [LOCAL ] ABT: Loaded 54400 existing records from primary storage. [2025-09-29T01:57:26.620126] [INFO ] [MAIN ] ABT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:26.634328] [INFO ] [MAIN ] Update Progress: 14/2371 symbols completed. ABT took 0.8s. Estimated remaining: 14m 27s. Rate: 163.1 symbols/min [2025-09-29T01:57:26.735820] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.22 seconds). [2025-09-29T01:57:26.792003] [DEBUG] [LOCAL ] ACA: Loaded 24034 existing records from primary storage. [2025-09-29T01:57:26.792943] [INFO ] [REMOTE ] AAM: Full fetch complete (966 records). [2025-09-29T01:57:26.870489] [INFO ] [MAIN ] ACA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:26.884186] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:26.889466] [INFO ] [MAIN ] Update Progress: 15/2371 symbols completed. ACA took 0.7s. Estimated remaining: 14m 9s. Rate: 166.5 symbols/min [2025-09-29T01:57:26.883172] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-09-29T01:57:27.003680] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:27.004303] [FATAL] [VALIDATOR ] AAM: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-29T01:57:27.004907] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-09-29T01:57:27.032265] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-09-29T01:57:27.055196] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-29T01:57:27.083718] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-29T01:57:27.084423] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-09-29T01:57:27.144073] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-09-29T01:57:27.174949] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:27.181626] [INFO ] [MAIN ] Update Progress: 16/2371 symbols completed. AAM took 5.6s. Estimated remaining: 13m 59s. Rate: 168.5 symbols/min [2025-09-29T01:57:27.301495] [DEBUG] [LOCAL ] ACEL: Loaded 27405 existing records from primary storage. [2025-09-29T01:57:27.319888] [INFO ] [MAIN ] ACEL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:27.328533] [INFO ] [MAIN ] Update Progress: 17/2371 symbols completed. ACEL took 0.7s. Estimated remaining: 13m 29s. Rate: 174.5 symbols/min [2025-09-29T01:57:27.307786] [DEBUG] [LOCAL ] ACCO: Loaded 38214 existing records from primary storage. [2025-09-29T01:57:27.356112] [INFO ] [MAIN ] ACCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:27.414727] [INFO ] [MAIN ] Update Progress: 18/2371 symbols completed. ACCO took 0.9s. Estimated remaining: 12m 55s. Rate: 182.1 symbols/min [2025-09-29T01:57:27.564131] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:27.777075] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:27.816912] [DEBUG] [LOCAL ] ACHR: Loaded 54598 existing records from primary storage. [2025-09-29T01:57:27.875743] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:27.870786] [INFO ] [MAIN ] ACHR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:27.876715] [INFO ] [MAIN ] Update Progress: 19/2371 symbols completed. ACHR took 1.0s. Estimated remaining: 13m 11s. Rate: 178.3 symbols/min [2025-09-29T01:57:28.059004] [DEBUG] [LOCAL ] ACI: Loaded 54044 existing records from primary storage. [2025-09-29T01:57:28.160302] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:28.115825] [INFO ] [MAIN ] ACI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:28.164276] [INFO ] [MAIN ] Update Progress: 20/2371 symbols completed. ACI took 1.0s. Estimated remaining: 13m 5s. Rate: 179.6 symbols/min [2025-09-29T01:57:28.239498] [DEBUG] [LOCAL ] ACM: Loaded 43767 existing records from primary storage. [2025-09-29T01:57:28.275453] [INFO ] [MAIN ] ACM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:28.292866] [INFO ] [MAIN ] Update Progress: 21/2371 symbols completed. ACM took 1.0s. Estimated remaining: 12m 42s. Rate: 185.0 symbols/min [2025-09-29T01:57:28.496083] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:28.497211] [DEBUG] [LOCAL ] ACN: Loaded 54204 existing records from primary storage. [2025-09-29T01:57:28.523686] [DEBUG] [LOCAL ] ACP: Loaded 31428 existing records from primary storage. [2025-09-29T01:57:28.546087] [INFO ] [MAIN ] ACP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:28.528973] [INFO ] [MAIN ] ACN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:28.546862] [INFO ] [MAIN ] Update Progress: 22/2371 symbols completed. ACN took 1.1s. Estimated remaining: 12m 34s. Rate: 186.9 symbols/min [2025-09-29T01:57:28.588974] [INFO ] [MAIN ] Update Progress: 23/2371 symbols completed. ACP took 0.7s. Estimated remaining: 12m 5s. Rate: 194.2 symbols/min [2025-09-29T01:57:28.697706] [DEBUG] [LOCAL ] ACR: Loaded 6352 existing records from primary storage. [2025-09-29T01:57:28.714123] [INFO ] [MAIN ] ACR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:28.785719] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:28.816565] [INFO ] [MAIN ] Update Progress: 24/2371 symbols completed. ACR took 0.7s. Estimated remaining: 11m 57s. Rate: 196.4 symbols/min [2025-09-29T01:57:28.997044] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:29.141824] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:29.196386] [DEBUG] [LOCAL ] ACV: Loaded 7095 existing records from primary storage. [2025-09-29T01:57:29.197495] [DEBUG] [LOCAL ] ACRE: Loaded 34027 existing records from primary storage. [2025-09-29T01:57:29.213971] [INFO ] [MAIN ] ACV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:29.222309] [INFO ] [MAIN ] ACRE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:29.222773] [INFO ] [MAIN ] Update Progress: 25/2371 symbols completed. ACV took 0.7s. Estimated remaining: 12m 6s. Rate: 193.8 symbols/min [2025-09-29T01:57:29.228420] [INFO ] [MAIN ] Update Progress: 26/2371 symbols completed. ACRE took 0.9s. Estimated remaining: 11m 39s. Rate: 201.4 symbols/min [2025-09-29T01:57:29.364244] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:29.418725] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-09-29T01:57:29.424041] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-09-29T01:57:29.429505] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-09-29T01:57:29.453303] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-29T01:57:29.517365] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-29T01:57:29.540409] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-09-29T01:57:29.666366] [DEBUG] [LOCAL ] ACVA: Loaded 50072 existing records from primary storage. [2025-09-29T01:57:29.796899] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:29.798328] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:29.814023] [INFO ] [MAIN ] ACVA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:29.826674] [INFO ] [MAIN ] Update Progress: 27/2371 symbols completed. ACVA took 1.1s. Estimated remaining: 12m 4s. Rate: 194.2 symbols/min [2025-09-29T01:57:30.135201] [DEBUG] [LOCAL ] ADCT: Loaded 34670 existing records from primary storage. [2025-09-29T01:57:30.233830] [INFO ] [MAIN ] ADCT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:30.275397] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:30.281006] [INFO ] [MAIN ] Update Progress: 28/2371 symbols completed. ADCT took 1.0s. Estimated remaining: 12m 16s. Rate: 191.0 symbols/min [2025-09-29T01:57:30.405003] [DEBUG] [LOCAL ] ADC: Loaded 46934 existing records from primary storage. [2025-09-29T01:57:30.441280] [INFO ] [MAIN ] ADC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:30.463944] [INFO ] [MAIN ] Update Progress: 29/2371 symbols completed. ADC took 1.2s. Estimated remaining: 12m 5s. Rate: 193.7 symbols/min [2025-09-29T01:57:30.596222] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:57:30.635896] [INFO ] [REMOTE ] AD: Fetching primary data for 2024-12. [2025-09-29T01:57:30.797362] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:30.876396] [DEBUG] [LOCAL ] ADM: Loaded 54175 existing records from primary storage. [2025-09-29T01:57:30.898758] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:30.899553] [INFO ] [MAIN ] ADM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:30.900143] [INFO ] [MAIN ] Update Progress: 30/2371 symbols completed. ADM took 1.0s. Estimated remaining: 12m 15s. Rate: 191.1 symbols/min [2025-09-29T01:57:30.949626] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:57:30.980460] [WARN ] [REMOTE ] AD: No data returned for month 2024-12 [2025-09-29T01:57:31.003956] [FATAL] [REMOTE ] AD: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:57:31.021702] [FATAL] [MAIN ] AD: Failed to fetch primary data. [2025-09-29T01:57:31.025522] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:57:31.025867] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-29T01:57:31.041945] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-29T01:57:31.063088] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-09-29T01:57:31.087185] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-09-29T01:57:31.123083] [INFO ] [MAIN ] Update Progress: 31/2371 symbols completed. AD took 2.3s. Estimated remaining: 12m 8s. Rate: 192.9 symbols/min [2025-09-29T01:57:31.127225] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:31.218450] [DEBUG] [LOCAL ] ADNT: Loaded 48095 existing records from primary storage. [2025-09-29T01:57:31.259065] [INFO ] [MAIN ] ADNT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:31.291734] [INFO ] [MAIN ] Update Progress: 32/2371 symbols completed. ADNT took 1.0s. Estimated remaining: 11m 57s. Rate: 195.7 symbols/min [2025-09-29T01:57:31.396972] [DEBUG] [LOCAL ] ADT: Loaded 54253 existing records from primary storage. [2025-09-29T01:57:31.464315] [INFO ] [MAIN ] ADT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:31.445731] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:31.465029] [INFO ] [MAIN ] Update Progress: 33/2371 symbols completed. ADT took 0.9s. Estimated remaining: 11m 47s. Rate: 198.4 symbols/min [2025-09-29T01:57:31.546899] [DEBUG] [LOCAL ] ADX: Loaded 28180 existing records from primary storage. [2025-09-29T01:57:31.577779] [INFO ] [MAIN ] ADX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:31.619119] [INFO ] [MAIN ] Update Progress: 34/2371 symbols completed. ADX took 0.7s. Estimated remaining: 11m 37s. Rate: 201.3 symbols/min [2025-09-29T01:57:31.887866] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:32.007084] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:32.061637] [DEBUG] [LOCAL ] AEFC: Loaded 8643 existing records from primary storage. [2025-09-29T01:57:32.115397] [INFO ] [MAIN ] AEFC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:32.100329] [DEBUG] [LOCAL ] AEE: Loaded 50875 existing records from primary storage. [2025-09-29T01:57:32.138162] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:32.139022] [INFO ] [MAIN ] AEE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:32.138435] [INFO ] [MAIN ] Update Progress: 35/2371 symbols completed. AEFC took 0.8s. Estimated remaining: 11m 51s. Rate: 197.1 symbols/min [2025-09-29T01:57:32.146267] [INFO ] [MAIN ] Update Progress: 36/2371 symbols completed. AEE took 1.0s. Estimated remaining: 11m 32s. Rate: 202.6 symbols/min [2025-09-29T01:57:32.472857] [DEBUG] [LOCAL ] AEG: Loaded 50307 existing records from primary storage. [2025-09-29T01:57:32.559259] [INFO ] [MAIN ] AEG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:32.583881] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:32.578999] [INFO ] [MAIN ] Update Progress: 37/2371 symbols completed. AEG took 1.1s. Estimated remaining: 11m 40s. Rate: 200.1 symbols/min [2025-09-29T01:57:32.604922] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:32.627711] [DEBUG] [LOCAL ] AEM: Loaded 54243 existing records from primary storage. [2025-09-29T01:57:32.628416] [INFO ] [MAIN ] AEM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:32.629253] [INFO ] [MAIN ] Update Progress: 38/2371 symbols completed. AEM took 0.9s. Estimated remaining: 11m 24s. Rate: 204.6 symbols/min [2025-09-29T01:57:32.711043] [DEBUG] [LOCAL ] AER: Loaded 49271 existing records from primary storage. [2025-09-29T01:57:32.711570] [INFO ] [MAIN ] AER: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:32.712140] [INFO ] [MAIN ] Update Progress: 39/2371 symbols completed. AER took 0.6s. Estimated remaining: 11m 11s. Rate: 208.4 symbols/min [2025-09-29T01:57:32.713471] [DEBUG] [LOCAL ] AEO: Loaded 54336 existing records from primary storage. [2025-09-29T01:57:32.713927] [INFO ] [MAIN ] AEO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:32.714691] [INFO ] [MAIN ] Update Progress: 40/2371 symbols completed. AEO took 0.6s. Estimated remaining: 10m 55s. Rate: 213.7 symbols/min [2025-09-29T01:57:33.488949] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:33.540863] [INFO ] [MAIN ] AEXA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:33.536509] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:33.546867] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:33.547992] [DEBUG] [LOCAL ] AEXA: No existing data file found in primary storage. [2025-09-29T01:57:33.549000] [WARN ] [MAIN ] AEXA: No existing data found, performing full refresh instead. [2025-09-29T01:57:33.549136] [INFO ] [MAIN ] AEXA: Wiping existing primary data before full refresh. [2025-09-29T01:57:33.549187] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-09-29T01:57:33.549245] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-09-29T01:57:33.549356] [INFO ] [MAIN ] AEXA: Starting full primary refresh. [2025-09-29T01:57:33.693925] [DEBUG] [LOCAL ] AFB: Loaded 11422 existing records from primary storage. [2025-09-29T01:57:33.780779] [INFO ] [MAIN ] AFB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:33.814513] [INFO ] [MAIN ] Update Progress: 41/2371 symbols completed. AFB took 1.1s. Estimated remaining: 11m 41s. Rate: 199.5 symbols/min [2025-09-29T01:57:34.074494] [DEBUG] [LOCAL ] AES: Loaded 54450 existing records from primary storage. [2025-09-29T01:57:34.085966] [INFO ] [MAIN ] AES: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:34.092203] [DEBUG] [LOCAL ] AESI: Loaded 50213 existing records from primary storage. [2025-09-29T01:57:34.098801] [INFO ] [MAIN ] AESI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:34.114951] [INFO ] [MAIN ] Update Progress: 42/2371 symbols completed. AES took 1.4s. Estimated remaining: 11m 40s. Rate: 199.5 symbols/min [2025-09-29T01:57:34.225710] [INFO ] [MAIN ] Update Progress: 43/2371 symbols completed. AESI took 1.4s. Estimated remaining: 11m 30s. Rate: 202.5 symbols/min [2025-09-29T01:57:34.203337] [INFO ] [REMOTE ] AEXA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:57:34.322432] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2024-12. [2025-09-29T01:57:34.434789] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:34.590607] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:57:34.683196] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:34.659472] [WARN ] [REMOTE ] AEXA: No data returned for month 2024-12 [2025-09-29T01:57:34.704623] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:34.704884] [FATAL] [REMOTE ] AEXA: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:57:34.705487] [FATAL] [MAIN ] AEXA: Failed to fetch primary data. [2025-09-29T01:57:34.706366] [WARN ] [MAIN ] AEXA: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:57:34.706927] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-09-29T01:57:34.707460] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-09-29T01:57:34.717261] [INFO ] [LOCAL ] AEXA: Starting deletion of derivative data. [2025-09-29T01:57:34.723149] [DEBUG] [LOCAL ] AFGB: Loaded 2404 existing records from primary storage. [2025-09-29T01:57:34.723793] [INFO ] [MAIN ] AFGB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:34.717610] [DEBUG] [LOCAL ] AEXA: No derivative data file found to delete. [2025-09-29T01:57:34.724323] [DEBUG] [LOCAL ] AFGC: Loaded 2602 existing records from primary storage. [2025-09-29T01:57:34.723936] [INFO ] [MAIN ] Update Progress: 44/2371 symbols completed. AFGB took 0.5s. Estimated remaining: 11m 40s. Rate: 199.4 symbols/min [2025-09-29T01:57:34.725059] [INFO ] [MAIN ] AFGC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:34.725452] [INFO ] [MAIN ] Update Progress: 45/2371 symbols completed. AEXA took 2.0s. Estimated remaining: 11m 24s. Rate: 203.9 symbols/min [2025-09-29T01:57:34.778784] [INFO ] [MAIN ] Update Progress: 46/2371 symbols completed. AFGC took 0.5s. Estimated remaining: 11m 12s. Rate: 207.6 symbols/min [2025-09-29T01:57:34.926724] [DEBUG] [LOCAL ] AFG: Loaded 33021 existing records from primary storage. [2025-09-29T01:57:35.019530] [INFO ] [MAIN ] AFG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:35.045567] [INFO ] [MAIN ] Update Progress: 47/2371 symbols completed. AFG took 1.2s. Estimated remaining: 11m 11s. Rate: 207.9 symbols/min [2025-09-29T01:57:35.247280] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:35.394416] [DEBUG] [LOCAL ] AFGD: Loaded 1859 existing records from primary storage. [2025-09-29T01:57:35.425919] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:35.445419] [INFO ] [MAIN ] AFGD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:35.474972] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:35.481420] [INFO ] [MAIN ] Update Progress: 48/2371 symbols completed. AFGD took 0.8s. Estimated remaining: 11m 17s. Rate: 205.7 symbols/min [2025-09-29T01:57:35.612026] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:35.641116] [DEBUG] [LOCAL ] AFGE: Loaded 2512 existing records from primary storage. [2025-09-29T01:57:35.652984] [INFO ] [MAIN ] AFGE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:35.658728] [INFO ] [MAIN ] Update Progress: 49/2371 symbols completed. AFGE took 0.9s. Estimated remaining: 11m 12s. Rate: 207.4 symbols/min [2025-09-29T01:57:35.882163] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:35.933493] [DEBUG] [LOCAL ] AFL: Loaded 53915 existing records from primary storage. [2025-09-29T01:57:35.974110] [INFO ] [MAIN ] AFL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:35.996102] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:36.011941] [INFO ] [MAIN ] Update Progress: 50/2371 symbols completed. AFL took 1.2s. Estimated remaining: 11m 14s. Rate: 206.5 symbols/min [2025-09-29T01:57:36.189587] [DEBUG] [LOCAL ] AG: Loaded 54423 existing records from primary storage. [2025-09-29T01:57:36.214577] [DEBUG] [LOCAL ] AGD: Loaded 17937 existing records from primary storage. [2025-09-29T01:57:36.226591] [INFO ] [MAIN ] AG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:36.244167] [INFO ] [MAIN ] AGD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:36.267006] [INFO ] [MAIN ] Update Progress: 51/2371 symbols completed. AG took 1.2s. Estimated remaining: 11m 13s. Rate: 207.0 symbols/min [2025-09-29T01:57:36.312339] [DEBUG] [LOCAL ] AGCO: Loaded 43086 existing records from primary storage. [2025-09-29T01:57:36.331146] [INFO ] [MAIN ] AGCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:36.324188] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:36.303698] [INFO ] [MAIN ] Update Progress: 52/2371 symbols completed. AGD took 0.6s. Estimated remaining: 11m 1s. Rate: 210.5 symbols/min [2025-09-29T01:57:36.363275] [INFO ] [MAIN ] Update Progress: 53/2371 symbols completed. AGCO took 0.9s. Estimated remaining: 10m 51s. Rate: 213.7 symbols/min [2025-09-29T01:57:36.760350] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:36.922594] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:36.927412] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:36.946949] [DEBUG] [LOCAL ] AGI: Loaded 54195 existing records from primary storage. [2025-09-29T01:57:36.948117] [INFO ] [MAIN ] AGI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:36.948681] [INFO ] [MAIN ] Update Progress: 54/2371 symbols completed. AGI took 0.9s. Estimated remaining: 11m 4s. Rate: 209.5 symbols/min [2025-09-29T01:57:37.055035] [DEBUG] [LOCAL ] AGM: Loaded 10125 existing records from primary storage. [2025-09-29T01:57:37.107437] [INFO ] [MAIN ] AGM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:37.133558] [INFO ] [MAIN ] Update Progress: 55/2371 symbols completed. AGM took 0.8s. Estimated remaining: 10m 59s. Rate: 210.9 symbols/min [2025-09-29T01:57:37.281972] [DEBUG] [LOCAL ] AGO: Loaded 28356 existing records from primary storage. [2025-09-29T01:57:37.330491] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:37.343245] [INFO ] [MAIN ] AGO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:37.337717] [DEBUG] [LOCAL ] AGL: Loaded 53191 existing records from primary storage. [2025-09-29T01:57:37.364790] [INFO ] [MAIN ] Update Progress: 56/2371 symbols completed. AGO took 1.0s. Estimated remaining: 10m 57s. Rate: 211.6 symbols/min [2025-09-29T01:57:37.376700] [INFO ] [MAIN ] AGL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:37.382828] [INFO ] [MAIN ] Update Progress: 57/2371 symbols completed. AGL took 1.1s. Estimated remaining: 10m 45s. Rate: 215.1 symbols/min [2025-09-29T01:57:37.639323] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:37.836284] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:37.859792] [DEBUG] [LOCAL ] AGRO: Loaded 34097 existing records from primary storage. [2025-09-29T01:57:37.903321] [INFO ] [MAIN ] AGRO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:37.904719] [INFO ] [MAIN ] Update Progress: 58/2371 symbols completed. AGRO took 1.0s. Estimated remaining: 10m 55s. Rate: 211.9 symbols/min [2025-09-29T01:57:37.925685] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:37.936355] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-09-29T01:57:37.936958] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-09-29T01:57:37.943730] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-09-29T01:57:37.938388] [DEBUG] [LOCAL ] AGX: Loaded 33823 existing records from primary storage. [2025-09-29T01:57:37.981988] [INFO ] [MAIN ] AGX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:37.988066] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-29T01:57:37.988413] [INFO ] [MAIN ] Update Progress: 59/2371 symbols completed. AGX took 0.8s. Estimated remaining: 10m 47s. Rate: 214.5 symbols/min [2025-09-29T01:57:38.018142] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-29T01:57:38.063745] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-09-29T01:57:38.388740] [DEBUG] [LOCAL ] AHH: Loaded 41885 existing records from primary storage. [2025-09-29T01:57:38.438245] [INFO ] [MAIN ] AHH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:38.497907] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:38.507252] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:38.474448] [INFO ] [MAIN ] Update Progress: 60/2371 symbols completed. AHH took 1.1s. Estimated remaining: 10m 54s. Rate: 211.9 symbols/min [2025-09-29T01:57:38.703541] [DEBUG] [LOCAL ] AHT: Loaded 6181 existing records from primary storage. [2025-09-29T01:57:38.774887] [INFO ] [MAIN ] AHT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:38.789516] [INFO ] [MAIN ] Update Progress: 61/2371 symbols completed. AHT took 0.8s. Estimated remaining: 10m 55s. Rate: 211.5 symbols/min [2025-09-29T01:57:39.165199] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:39.208075] [DEBUG] [LOCAL ] AHR: Loaded 49946 existing records from primary storage. [2025-09-29T01:57:39.199335] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:57:39.238249] [INFO ] [REMOTE ] AHL: Fetching primary data for 2024-12. [2025-09-29T01:57:39.240029] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:39.242300] [INFO ] [MAIN ] AHR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:39.244860] [INFO ] [MAIN ] Update Progress: 62/2371 symbols completed. AHR took 1.3s. Estimated remaining: 11m 1s. Rate: 209.4 symbols/min [2025-09-29T01:57:39.382614] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:57:39.400784] [WARN ] [REMOTE ] AHL: No data returned for month 2024-12 [2025-09-29T01:57:39.415079] [FATAL] [REMOTE ] AHL: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:57:39.415302] [FATAL] [MAIN ] AHL: Failed to fetch primary data. [2025-09-29T01:57:39.436904] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:57:39.468445] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-29T01:57:39.468233] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:39.468917] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-29T01:57:39.468971] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-09-29T01:57:39.469221] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-09-29T01:57:39.469425] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-09-29T01:57:39.469134] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-09-29T01:57:39.469625] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-09-29T01:57:39.469773] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-29T01:57:39.469919] [INFO ] [MAIN ] Update Progress: 63/2371 symbols completed. AHL took 2.1s. Estimated remaining: 10m 59s. Rate: 210.2 symbols/min [2025-09-29T01:57:39.470224] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-29T01:57:39.470306] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-09-29T01:57:39.621984] [DEBUG] [LOCAL ] AI: Loaded 54529 existing records from primary storage. [2025-09-29T01:57:39.686339] [INFO ] [MAIN ] AI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:39.715597] [INFO ] [MAIN ] Update Progress: 64/2371 symbols completed. AI took 1.2s. Estimated remaining: 10m 57s. Rate: 210.6 symbols/min [2025-09-29T01:57:39.895245] [DEBUG] [LOCAL ] AIG: Loaded 54254 existing records from primary storage. [2025-09-29T01:57:39.961117] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:40.012971] [INFO ] [MAIN ] AIG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:40.055097] [INFO ] [MAIN ] Update Progress: 65/2371 symbols completed. AIG took 1.3s. Estimated remaining: 10m 59s. Rate: 210.0 symbols/min [2025-09-29T01:57:40.479414] [DEBUG] [LOCAL ] AIN: Loaded 24906 existing records from primary storage. [2025-09-29T01:57:40.452932] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:40.518191] [INFO ] [MAIN ] AIN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:40.604532] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:40.599623] [INFO ] [MAIN ] Update Progress: 66/2371 symbols completed. AIN took 1.1s. Estimated remaining: 11m 8s. Rate: 207.2 symbols/min [2025-09-29T01:57:40.609075] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:57:40.626680] [INFO ] [REMOTE ] AII: Fetching primary data for 2024-12. [2025-09-29T01:57:40.674801] [DEBUG] [LOCAL ] AIO: Loaded 13477 existing records from primary storage. [2025-09-29T01:57:40.721829] [INFO ] [MAIN ] AIO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:40.737311] [INFO ] [MAIN ] Update Progress: 67/2371 symbols completed. AIO took 1.0s. Estimated remaining: 11m 2s. Rate: 208.8 symbols/min [2025-09-29T01:57:40.820906] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:57:40.876349] [WARN ] [REMOTE ] AII: No data returned for month 2024-12 [2025-09-29T01:57:40.932638] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:40.950069] [FATAL] [REMOTE ] AII: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:57:40.954780] [FATAL] [MAIN ] AII: Failed to fetch primary data. [2025-09-29T01:57:40.955344] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:57:40.972677] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-29T01:57:41.001362] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-29T01:57:40.967368] [DEBUG] [LOCAL ] AIR: Loaded 28152 existing records from primary storage. [2025-09-29T01:57:41.036341] [INFO ] [MAIN ] AIR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:41.008110] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-09-29T01:57:41.042322] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:41.040988] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-09-29T01:57:41.040877] [INFO ] [MAIN ] Update Progress: 68/2371 symbols completed. AIR took 0.9s. Estimated remaining: 11m 2s. Rate: 208.6 symbols/min [2025-09-29T01:57:41.043258] [INFO ] [MAIN ] Update Progress: 69/2371 symbols completed. AII took 1.8s. Estimated remaining: 10m 53s. Rate: 211.7 symbols/min [2025-09-29T01:57:41.321037] [DEBUG] [LOCAL ] AIT: Loaded 28208 existing records from primary storage. [2025-09-29T01:57:41.371284] [INFO ] [MAIN ] AIT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:41.449149] [INFO ] [MAIN ] Update Progress: 70/2371 symbols completed. AIT took 0.8s. Estimated remaining: 10m 56s. Rate: 210.4 symbols/min [2025-09-29T01:57:41.492100] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:41.507310] [DEBUG] [LOCAL ] AIV: Loaded 40950 existing records from primary storage. [2025-09-29T01:57:41.553590] [INFO ] [MAIN ] AIV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:41.599096] [INFO ] [MAIN ] Update Progress: 71/2371 symbols completed. AIV took 0.8s. Estimated remaining: 10m 52s. Rate: 211.8 symbols/min [2025-09-29T01:57:41.593710] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:41.700592] [DEBUG] [LOCAL ] AIZN: Loaded 3935 existing records from primary storage. [2025-09-29T01:57:41.766786] [INFO ] [MAIN ] AIZN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:41.787467] [INFO ] [MAIN ] Update Progress: 72/2371 symbols completed. AIZN took 0.7s. Estimated remaining: 10m 48s. Rate: 212.8 symbols/min [2025-09-29T01:57:42.088860] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:42.183781] [DEBUG] [LOCAL ] AIZ: Loaded 30543 existing records from primary storage. [2025-09-29T01:57:42.205997] [INFO ] [MAIN ] AIZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:42.268473] [INFO ] [MAIN ] Update Progress: 73/2371 symbols completed. AIZ took 1.2s. Estimated remaining: 10m 54s. Rate: 210.7 symbols/min [2025-09-29T01:57:42.357941] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:42.421289] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-09-29T01:57:42.504074] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-09-29T01:57:42.577982] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-09-29T01:57:42.572687] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:42.578346] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-29T01:57:42.579010] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-29T01:57:42.594975] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-09-29T01:57:42.641091] [DEBUG] [LOCAL ] AJG: Loaded 47710 existing records from primary storage. [2025-09-29T01:57:42.695390] [INFO ] [MAIN ] AJG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:42.743703] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:42.749710] [INFO ] [MAIN ] Update Progress: 74/2371 symbols completed. AJG took 1.2s. Estimated remaining: 11m 0s. Rate: 208.8 symbols/min [2025-09-29T01:57:43.012484] [DEBUG] [LOCAL ] AKR: Loaded 46481 existing records from primary storage. [2025-09-29T01:57:43.116050] [INFO ] [MAIN ] AKR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:43.228974] [INFO ] [MAIN ] Update Progress: 75/2371 symbols completed. AKR took 1.4s. Estimated remaining: 11m 6s. Rate: 206.9 symbols/min [2025-09-29T01:57:43.346751] [DEBUG] [LOCAL ] AL: Loaded 44831 existing records from primary storage. [2025-09-29T01:57:43.340266] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:43.412876] [INFO ] [MAIN ] AL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:43.518184] [INFO ] [MAIN ] Update Progress: 76/2371 symbols completed. AL took 1.2s. Estimated remaining: 11m 5s. Rate: 206.9 symbols/min [2025-09-29T01:57:43.560279] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:57:43.566389] [INFO ] [REMOTE ] AKA: Fetching primary data for 2024-12. [2025-09-29T01:57:43.685931] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:43.870384] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:43.874599] [DEBUG] [LOCAL ] ALB: Loaded 54000 existing records from primary storage. [2025-09-29T01:57:43.876212] [INFO ] [MAIN ] ALB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:43.876904] [INFO ] [MAIN ] Update Progress: 77/2371 symbols completed. ALB took 1.1s. Estimated remaining: 11m 7s. Rate: 206.3 symbols/min [2025-09-29T01:57:43.903260] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-09-29T01:57:43.904925] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-09-29T01:57:43.935784] [DEBUG] [LOCAL ] ALC: Loaded 51537 existing records from primary storage. [2025-09-29T01:57:43.936260] [INFO ] [MAIN ] ALC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:43.936721] [INFO ] [MAIN ] Update Progress: 78/2371 symbols completed. ALC took 0.7s. Estimated remaining: 11m 0s. Rate: 208.4 symbols/min [2025-09-29T01:57:43.948281] [DEBUG] [LOCAL ] ALE: Loaded 30788 existing records from primary storage. [2025-09-29T01:57:43.948626] [INFO ] [MAIN ] ALE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:43.948760] [INFO ] [MAIN ] Update Progress: 79/2371 symbols completed. ALE took 0.4s. Estimated remaining: 10m 52s. Rate: 211.0 symbols/min [2025-09-29T01:57:44.232240] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-29T01:57:44.233677] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-09-29T01:57:44.513630] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-09-29T01:57:44.515074] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-09-29T01:57:44.791502] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-09-29T01:57:44.792953] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-09-29T01:57:45.071227] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-09-29T01:57:45.072622] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-09-29T01:57:45.428164] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-29T01:57:45.429973] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-09-29T01:57:45.554236] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.12 seconds). [2025-09-29T01:57:45.555579] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-09-29T01:57:45.754572] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.20 seconds). [2025-09-29T01:57:45.755618] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-09-29T01:57:45.954863] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.20 seconds). [2025-09-29T01:57:45.955995] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-09-29T01:57:46.154966] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.20 seconds). [2025-09-29T01:57:46.155900] [INFO ] [REMOTE ] AKA: Full fetch complete (2428 records). [2025-09-29T01:57:46.156061] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-09-29T01:57:46.408578] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-29T01:57:46.408843] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-09-29T01:57:46.408954] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-09-29T01:57:46.409053] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-29T01:57:46.409197] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-29T01:57:46.409276] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-09-29T01:57:46.409394] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-09-29T01:57:46.409521] [INFO ] [MAIN ] Update Progress: 80/2371 symbols completed. AKA took 4.8s. Estimated remaining: 11m 54s. Rate: 192.6 symbols/min [2025-09-29T01:57:47.116443] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:47.191697] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:47.195686] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:47.187938] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:47.217541] [DEBUG] [LOCAL ] ALG: Loaded 10562 existing records from primary storage. [2025-09-29T01:57:47.218107] [INFO ] [MAIN ] ALG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:47.218240] [INFO ] [MAIN ] Update Progress: 81/2371 symbols completed. ALG took 0.8s. Estimated remaining: 12m 8s. Rate: 188.8 symbols/min [2025-09-29T01:57:47.456397] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:47.498702] [DEBUG] [LOCAL ] ALEX: Loaded 31769 existing records from primary storage. [2025-09-29T01:57:47.499200] [INFO ] [MAIN ] ALEX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:47.499319] [INFO ] [MAIN ] Update Progress: 82/2371 symbols completed. ALEX took 1.1s. Estimated remaining: 12m 6s. Rate: 189.1 symbols/min [2025-09-29T01:57:47.500550] [DEBUG] [LOCAL ] ALIT: Loaded 53534 existing records from primary storage. [2025-09-29T01:57:47.506861] [DEBUG] [LOCAL ] ALK: Loaded 53840 existing records from primary storage. [2025-09-29T01:57:47.534183] [INFO ] [MAIN ] ALIT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:47.534328] [INFO ] [MAIN ] ALK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:47.550894] [INFO ] [MAIN ] Update Progress: 83/2371 symbols completed. ALK took 1.1s. Estimated remaining: 11m 59s. Rate: 191.0 symbols/min [2025-09-29T01:57:47.585228] [INFO ] [MAIN ] Update Progress: 84/2371 symbols completed. ALIT took 1.1s. Estimated remaining: 11m 51s. Rate: 193.1 symbols/min [2025-09-29T01:57:48.000431] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:48.143434] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:48.149009] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:48.073675] [DEBUG] [LOCAL ] ALL: Loaded 50903 existing records from primary storage. [2025-09-29T01:57:48.150011] [INFO ] [MAIN ] ALL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:48.151524] [INFO ] [MAIN ] Update Progress: 85/2371 symbols completed. ALL took 0.9s. Estimated remaining: 11m 57s. Rate: 191.2 symbols/min [2025-09-29T01:57:48.442926] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:48.445181] [DEBUG] [LOCAL ] ALSN: Loaded 43953 existing records from primary storage. [2025-09-29T01:57:48.484115] [INFO ] [MAIN ] ALSN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:48.484713] [INFO ] [MAIN ] Update Progress: 86/2371 symbols completed. ALSN took 0.9s. Estimated remaining: 11m 57s. Rate: 191.1 symbols/min [2025-09-29T01:57:48.520231] [DEBUG] [LOCAL ] ALLY: Loaded 53997 existing records from primary storage. [2025-09-29T01:57:48.491823] [DEBUG] [LOCAL ] ALLE: Loaded 45637 existing records from primary storage. [2025-09-29T01:57:48.536536] [INFO ] [MAIN ] ALLY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:48.537197] [INFO ] [MAIN ] Update Progress: 87/2371 symbols completed. ALLY took 1.0s. Estimated remaining: 11m 50s. Rate: 192.9 symbols/min [2025-09-29T01:57:48.549374] [INFO ] [MAIN ] ALLE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:48.566044] [INFO ] [MAIN ] Update Progress: 88/2371 symbols completed. ALLE took 1.1s. Estimated remaining: 11m 43s. Rate: 195.0 symbols/min [2025-09-29T01:57:48.792186] [DEBUG] [LOCAL ] ALTG: Loaded 24161 existing records from primary storage. [2025-09-29T01:57:48.894404] [INFO ] [MAIN ] ALTG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:48.954128] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:48.974938] [INFO ] [MAIN ] Update Progress: 89/2371 symbols completed. ALTG took 0.8s. Estimated remaining: 11m 45s. Rate: 194.2 symbols/min [2025-09-29T01:57:49.071152] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:49.196056] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:49.226229] [DEBUG] [LOCAL ] ALUR: Loaded 10950 existing records from primary storage. [2025-09-29T01:57:49.259017] [INFO ] [MAIN ] ALUR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:49.276697] [INFO ] [MAIN ] Update Progress: 90/2371 symbols completed. ALUR took 0.8s. Estimated remaining: 11m 44s. Rate: 194.3 symbols/min [2025-09-29T01:57:49.402707] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:49.406312] [DEBUG] [LOCAL ] ALX: Loaded 6121 existing records from primary storage. [2025-09-29T01:57:49.422030] [INFO ] [MAIN ] ALX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:49.438996] [INFO ] [MAIN ] Update Progress: 91/2371 symbols completed. ALX took 0.8s. Estimated remaining: 11m 40s. Rate: 195.3 symbols/min [2025-09-29T01:57:49.687547] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:49.689378] [DEBUG] [LOCAL ] ALV: Loaded 43217 existing records from primary storage. [2025-09-29T01:57:49.690423] [INFO ] [MAIN ] ALV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:49.696325] [INFO ] [MAIN ] Update Progress: 92/2371 symbols completed. ALV took 1.1s. Estimated remaining: 11m 39s. Rate: 195.7 symbols/min [2025-09-29T01:57:49.835718] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:49.978525] [DEBUG] [LOCAL ] AM: Loaded 52887 existing records from primary storage. [2025-09-29T01:57:50.001727] [INFO ] [MAIN ] AM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:50.009359] [DEBUG] [LOCAL ] AMBC: Loaded 37453 existing records from primary storage. [2025-09-29T01:57:50.039251] [INFO ] [MAIN ] Update Progress: 93/2371 symbols completed. AM took 1.0s. Estimated remaining: 11m 39s. Rate: 195.4 symbols/min [2025-09-29T01:57:50.040633] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:50.051705] [INFO ] [MAIN ] AMBC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:50.064438] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-09-29T01:57:50.076285] [INFO ] [MAIN ] Update Progress: 94/2371 symbols completed. AMBC took 0.8s. Estimated remaining: 11m 33s. Rate: 197.3 symbols/min [2025-09-29T01:57:50.114612] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-09-29T01:57:50.195283] [DEBUG] [LOCAL ] AMBP: Loaded 45863 existing records from primary storage. [2025-09-29T01:57:50.195478] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-09-29T01:57:50.209136] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-29T01:57:50.216057] [INFO ] [MAIN ] AMBP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:50.228535] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-29T01:57:50.241943] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-09-29T01:57:50.285889] [INFO ] [MAIN ] Update Progress: 95/2371 symbols completed. AMBP took 0.8s. Estimated remaining: 11m 30s. Rate: 197.9 symbols/min [2025-09-29T01:57:50.473400] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:50.786726] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:50.992378] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:51.091071] [DEBUG] [LOCAL ] AMC: Loaded 54539 existing records from primary storage. [2025-09-29T01:57:51.118204] [INFO ] [MAIN ] AMC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:51.136440] [INFO ] [MAIN ] Update Progress: 96/2371 symbols completed. AMC took 1.1s. Estimated remaining: 11m 43s. Rate: 194.2 symbols/min [2025-09-29T01:57:51.203400] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:57:51.221602] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2024-12. [2025-09-29T01:57:51.316385] [DEBUG] [LOCAL ] AMCR: Loaded 54449 existing records from primary storage. [2025-09-29T01:57:51.340170] [INFO ] [MAIN ] AMCR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:51.357289] [INFO ] [MAIN ] Update Progress: 97/2371 symbols completed. AMCR took 1.2s. Estimated remaining: 11m 40s. Rate: 194.8 symbols/min [2025-09-29T01:57:51.398148] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:57:51.458756] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:51.453765] [WARN ] [REMOTE ] AMBQ: No data returned for month 2024-12 [2025-09-29T01:57:51.493301] [FATAL] [REMOTE ] AMBQ: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:57:51.545683] [FATAL] [MAIN ] AMBQ: Failed to fetch primary data. [2025-09-29T01:57:51.580723] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:57:51.587734] [DEBUG] [LOCAL ] AME: Loaded 49252 existing records from primary storage. [2025-09-29T01:57:51.591290] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-29T01:57:51.591947] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-29T01:57:51.607994] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-09-29T01:57:51.597535] [INFO ] [MAIN ] AME: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:51.682379] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:51.681296] [INFO ] [MAIN ] Update Progress: 98/2371 symbols completed. AME took 1.3s. Estimated remaining: 11m 40s. Rate: 194.7 symbols/min [2025-09-29T01:57:51.682536] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-09-29T01:57:51.683085] [INFO ] [MAIN ] Update Progress: 99/2371 symbols completed. AMBQ took 2.0s. Estimated remaining: 11m 33s. Rate: 196.7 symbols/min [2025-09-29T01:57:51.759604] [DEBUG] [LOCAL ] AMG: Loaded 21046 existing records from primary storage. [2025-09-29T01:57:51.831530] [INFO ] [MAIN ] AMG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:51.888923] [INFO ] [MAIN ] Update Progress: 100/2371 symbols completed. AMG took 0.7s. Estimated remaining: 11m 31s. Rate: 197.3 symbols/min [2025-09-29T01:57:52.115385] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:52.204487] [DEBUG] [LOCAL ] AMH: Loaded 52467 existing records from primary storage. [2025-09-29T01:57:52.264817] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:52.266601] [INFO ] [MAIN ] AMH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:52.279405] [INFO ] [MAIN ] Update Progress: 101/2371 symbols completed. AMH took 0.9s. Estimated remaining: 11m 32s. Rate: 196.8 symbols/min [2025-09-29T01:57:52.389234] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:52.611837] [DEBUG] [LOCAL ] AMP: Loaded 32959 existing records from primary storage. [2025-09-29T01:57:52.609436] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:52.610923] [DEBUG] [LOCAL ] AMN: Loaded 42588 existing records from primary storage. [2025-09-29T01:57:52.612450] [INFO ] [MAIN ] AMP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:52.613039] [INFO ] [MAIN ] AMN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:52.614077] [INFO ] [MAIN ] Update Progress: 102/2371 symbols completed. AMN took 0.9s. Estimated remaining: 11m 33s. Rate: 196.6 symbols/min [2025-09-29T01:57:52.629539] [INFO ] [MAIN ] Update Progress: 103/2371 symbols completed. AMP took 0.9s. Estimated remaining: 11m 26s. Rate: 198.4 symbols/min [2025-09-29T01:57:52.883628] [DEBUG] [LOCAL ] AMPX: Loaded 52949 existing records from primary storage. [2025-09-29T01:57:52.884773] [INFO ] [MAIN ] AMPX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:52.895965] [INFO ] [MAIN ] Update Progress: 104/2371 symbols completed. AMPX took 1.0s. Estimated remaining: 11m 25s. Rate: 198.6 symbols/min [2025-09-29T01:57:53.108112] [DEBUG] [LOCAL ] AMPY: Loaded 38164 existing records from primary storage. [2025-09-29T01:57:53.167784] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:53.152792] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:53.173623] [INFO ] [MAIN ] AMPY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:53.179112] [INFO ] [MAIN ] Update Progress: 105/2371 symbols completed. AMPY took 0.9s. Estimated remaining: 11m 24s. Rate: 198.8 symbols/min [2025-09-29T01:57:53.367976] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:53.405485] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-09-29T01:57:53.421745] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-09-29T01:57:53.462781] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-09-29T01:57:53.485886] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-29T01:57:53.491316] [DEBUG] [LOCAL ] AMR: Loaded 29441 existing records from primary storage. [2025-09-29T01:57:53.514051] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:53.525887] [INFO ] [MAIN ] AMR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:53.514274] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-29T01:57:53.526862] [INFO ] [MAIN ] Update Progress: 106/2371 symbols completed. AMR took 0.9s. Estimated remaining: 11m 25s. Rate: 198.5 symbols/min [2025-09-29T01:57:53.526669] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-09-29T01:57:53.545547] [DEBUG] [LOCAL ] AMRC: Loaded 38981 existing records from primary storage. [2025-09-29T01:57:53.593909] [INFO ] [MAIN ] AMRC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:53.695413] [INFO ] [MAIN ] Update Progress: 107/2371 symbols completed. AMRC took 1.0s. Estimated remaining: 11m 22s. Rate: 199.3 symbols/min [2025-09-29T01:57:54.256339] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:54.304597] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:54.337061] [DEBUG] [LOCAL ] AMT: Loaded 53212 existing records from primary storage. [2025-09-29T01:57:54.351082] [INFO ] [MAIN ] AMT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:54.372975] [INFO ] [MAIN ] Update Progress: 108/2371 symbols completed. AMT took 1.2s. Estimated remaining: 11m 29s. Rate: 197.0 symbols/min [2025-09-29T01:57:54.400691] [DEBUG] [LOCAL ] AMTD: Loaded 3622 existing records from primary storage. [2025-09-29T01:57:54.413924] [INFO ] [MAIN ] AMTD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:54.478390] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:57:54.489198] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2024-12. [2025-09-29T01:57:54.488888] [INFO ] [MAIN ] Update Progress: 109/2371 symbols completed. AMTD took 0.7s. Estimated remaining: 11m 25s. Rate: 198.1 symbols/min [2025-09-29T01:57:54.631744] [DEBUG] [LOCAL ] AMTB: Loaded 20599 existing records from primary storage. [2025-09-29T01:57:54.690485] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:57:54.700839] [WARN ] [REMOTE ] AMRZ: No data returned for month 2024-12 [2025-09-29T01:57:54.673158] [INFO ] [MAIN ] AMTB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:54.712064] [FATAL] [REMOTE ] AMRZ: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:57:54.718517] [INFO ] [MAIN ] Update Progress: 110/2371 symbols completed. AMTB took 1.2s. Estimated remaining: 11m 23s. Rate: 198.6 symbols/min [2025-09-29T01:57:54.729333] [FATAL] [MAIN ] AMRZ: Failed to fetch primary data. [2025-09-29T01:57:54.801030] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:57:54.870703] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-29T01:57:54.918609] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:54.891779] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:54.946357] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-29T01:57:54.953511] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-09-29T01:57:54.964182] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-09-29T01:57:54.979959] [INFO ] [MAIN ] Update Progress: 111/2371 symbols completed. AMRZ took 2.1s. Estimated remaining: 11m 22s. Rate: 198.8 symbols/min [2025-09-29T01:57:55.111252] [DEBUG] [LOCAL ] AMWL: Loaded 8830 existing records from primary storage. [2025-09-29T01:57:55.174846] [INFO ] [MAIN ] AMWL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:55.182782] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:55.193741] [INFO ] [MAIN ] Update Progress: 112/2371 symbols completed. AMWL took 0.7s. Estimated remaining: 11m 20s. Rate: 199.3 symbols/min [2025-09-29T01:57:55.350959] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:55.438171] [DEBUG] [LOCAL ] AMTM: Loaded 51451 existing records from primary storage. [2025-09-29T01:57:55.484846] [INFO ] [MAIN ] AMTM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:55.513747] [INFO ] [MAIN ] Update Progress: 113/2371 symbols completed. AMTM took 1.1s. Estimated remaining: 11m 20s. Rate: 199.2 symbols/min [2025-09-29T01:57:55.539951] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:55.656868] [DEBUG] [LOCAL ] AN: Loaded 32842 existing records from primary storage. [2025-09-29T01:57:55.658630] [DEBUG] [LOCAL ] AMX: Loaded 49855 existing records from primary storage. [2025-09-29T01:57:55.676203] [INFO ] [MAIN ] AMX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:55.688068] [INFO ] [MAIN ] Update Progress: 114/2371 symbols completed. AMX took 0.9s. Estimated remaining: 11m 17s. Rate: 200.0 symbols/min [2025-09-29T01:57:55.688500] [INFO ] [MAIN ] AN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:55.694772] [INFO ] [MAIN ] Update Progress: 115/2371 symbols completed. AN took 0.7s. Estimated remaining: 11m 11s. Rate: 201.7 symbols/min [2025-09-29T01:57:56.003121] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:56.187066] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:56.208350] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:56.225390] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-09-29T01:57:56.226020] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-09-29T01:57:56.226498] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-09-29T01:57:56.226616] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-29T01:57:56.226732] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-29T01:57:56.228362] [DEBUG] [LOCAL ] ANET: Loaded 54546 existing records from primary storage. [2025-09-29T01:57:56.227124] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-09-29T01:57:56.252282] [INFO ] [MAIN ] ANET: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:56.253131] [INFO ] [MAIN ] Update Progress: 116/2371 symbols completed. ANET took 1.0s. Estimated remaining: 11m 16s. Rate: 200.2 symbols/min [2025-09-29T01:57:56.569037] [DEBUG] [LOCAL ] ANRO: Loaded 19387 existing records from primary storage. [2025-09-29T01:57:56.604993] [INFO ] [MAIN ] ANRO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:56.604781] [DEBUG] [LOCAL ] ANF: Loaded 52967 existing records from primary storage. [2025-09-29T01:57:56.657679] [INFO ] [MAIN ] Update Progress: 117/2371 symbols completed. ANRO took 1.0s. Estimated remaining: 11m 18s. Rate: 199.6 symbols/min [2025-09-29T01:57:56.706530] [INFO ] [MAIN ] ANF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:56.732121] [INFO ] [MAIN ] Update Progress: 118/2371 symbols completed. ANF took 1.2s. Estimated remaining: 11m 13s. Rate: 200.9 symbols/min [2025-09-29T01:57:56.748386] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:56.926680] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:57:56.928104] [DEBUG] [LOCAL ] ANVS: Loaded 23508 existing records from primary storage. [2025-09-29T01:57:56.928711] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2024-12. [2025-09-29T01:57:56.929194] [INFO ] [MAIN ] ANVS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:56.929345] [INFO ] [MAIN ] Update Progress: 119/2371 symbols completed. ANVS took 0.7s. Estimated remaining: 11m 11s. Rate: 201.4 symbols/min [2025-09-29T01:57:57.046969] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:57:57.047333] [WARN ] [REMOTE ] ANGX: No data returned for month 2024-12 [2025-09-29T01:57:57.047423] [FATAL] [REMOTE ] ANGX: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:57:57.047496] [FATAL] [MAIN ] ANGX: Failed to fetch primary data. [2025-09-29T01:57:57.047562] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:57:57.047709] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-29T01:57:57.047818] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-29T01:57:57.047893] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-09-29T01:57:57.047991] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-09-29T01:57:57.048082] [INFO ] [MAIN ] Update Progress: 120/2371 symbols completed. ANGX took 1.4s. Estimated remaining: 11m 7s. Rate: 202.4 symbols/min [2025-09-29T01:57:57.724665] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:57.771522] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:57.809162] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:57.798600] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-09-29T01:57:57.833541] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-09-29T01:57:57.864133] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:57.865181] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-09-29T01:57:57.865289] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-29T01:57:57.865357] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-29T01:57:57.865405] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-09-29T01:57:58.019396] [DEBUG] [LOCAL ] AOMR: Loaded 16852 existing records from primary storage. [2025-09-29T01:57:58.064550] [INFO ] [MAIN ] AOMR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:58.140474] [DEBUG] [LOCAL ] AOD: Loaded 30414 existing records from primary storage. [2025-09-29T01:57:58.149241] [INFO ] [MAIN ] Update Progress: 121/2371 symbols completed. AOMR took 1.0s. Estimated remaining: 11m 22s. Rate: 198.0 symbols/min [2025-09-29T01:57:58.172829] [INFO ] [MAIN ] AOD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:58.247004] [INFO ] [MAIN ] Update Progress: 122/2371 symbols completed. AOD took 1.2s. Estimated remaining: 11m 18s. Rate: 199.1 symbols/min [2025-09-29T01:57:58.369970] [DEBUG] [LOCAL ] AON: Loaded 46248 existing records from primary storage. [2025-09-29T01:57:58.414705] [INFO ] [MAIN ] AON: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:58.426426] [INFO ] [MAIN ] Update Progress: 123/2371 symbols completed. AON took 1.4s. Estimated remaining: 11m 15s. Rate: 199.8 symbols/min [2025-09-29T01:57:58.766210] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:58.801165] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:57:58.859259] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2024-12. [2025-09-29T01:57:58.948341] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:59.045298] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:59.059242] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:57:59.061455] [DEBUG] [LOCAL ] AORT: Loaded 30087 existing records from primary storage. [2025-09-29T01:57:59.061602] [WARN ] [REMOTE ] AOMD: No data returned for month 2024-12 [2025-09-29T01:57:59.062232] [FATAL] [REMOTE ] AOMD: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:57:59.062415] [INFO ] [MAIN ] AORT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:59.063320] [INFO ] [MAIN ] Update Progress: 124/2371 symbols completed. AORT took 0.9s. Estimated remaining: 11m 21s. Rate: 198.0 symbols/min [2025-09-29T01:57:59.062720] [FATAL] [MAIN ] AOMD: Failed to fetch primary data. [2025-09-29T01:57:59.081758] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:57:59.123098] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-29T01:57:59.161444] [DEBUG] [LOCAL ] AP: Loaded 7236 existing records from primary storage. [2025-09-29T01:57:59.178666] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-29T01:57:59.189781] [INFO ] [MAIN ] AP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:59.200359] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-09-29T01:57:59.200671] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-09-29T01:57:59.190117] [INFO ] [MAIN ] Update Progress: 125/2371 symbols completed. AP took 0.7s. Estimated remaining: 11m 18s. Rate: 198.9 symbols/min [2025-09-29T01:57:59.206262] [INFO ] [MAIN ] Update Progress: 126/2371 symbols completed. AOMD took 2.1s. Estimated remaining: 11m 12s. Rate: 200.4 symbols/min [2025-09-29T01:57:59.370082] [DEBUG] [LOCAL ] AOS: Loaded 49769 existing records from primary storage. [2025-09-29T01:57:59.457442] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:59.507860] [INFO ] [MAIN ] AOS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:59.513740] [INFO ] [MAIN ] Update Progress: 127/2371 symbols completed. AOS took 1.2s. Estimated remaining: 11m 12s. Rate: 200.4 symbols/min [2025-09-29T01:57:59.794483] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:59.845381] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:59.964590] [DEBUG] [LOCAL ] APAM: Loaded 36969 existing records from primary storage. [2025-09-29T01:57:59.962878] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:57:59.965456] [INFO ] [MAIN ] APAM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:57:59.966108] [INFO ] [MAIN ] Update Progress: 128/2371 symbols completed. APAM took 0.9s. Estimated remaining: 11m 14s. Rate: 199.6 symbols/min [2025-09-29T01:58:00.220106] [DEBUG] [LOCAL ] APD: Loaded 46087 existing records from primary storage. [2025-09-29T01:58:00.245262] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:00.245714] [INFO ] [MAIN ] APD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:00.247142] [DEBUG] [LOCAL ] APG: Loaded 50931 existing records from primary storage. [2025-09-29T01:58:00.248015] [INFO ] [MAIN ] Update Progress: 129/2371 symbols completed. APD took 1.0s. Estimated remaining: 11m 14s. Rate: 199.7 symbols/min [2025-09-29T01:58:00.254371] [INFO ] [MAIN ] APG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:00.269816] [INFO ] [MAIN ] Update Progress: 130/2371 symbols completed. APG took 0.9s. Estimated remaining: 11m 9s. Rate: 201.1 symbols/min [2025-09-29T01:58:00.583552] [DEBUG] [LOCAL ] APH: Loaded 54471 existing records from primary storage. [2025-09-29T01:58:00.676062] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:00.681467] [INFO ] [MAIN ] APH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:00.706892] [INFO ] [MAIN ] Update Progress: 131/2371 symbols completed. APH took 1.2s. Estimated remaining: 11m 11s. Rate: 200.4 symbols/min [2025-09-29T01:58:00.755083] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:00.781292] [DEBUG] [LOCAL ] APLE: Loaded 52769 existing records from primary storage. [2025-09-29T01:58:00.828945] [INFO ] [MAIN ] APLE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:00.873350] [INFO ] [MAIN ] Update Progress: 132/2371 symbols completed. APLE took 0.9s. Estimated remaining: 11m 8s. Rate: 201.1 symbols/min [2025-09-29T01:58:00.883424] [DEBUG] [LOCAL ] APOS: Loaded 7568 existing records from primary storage. [2025-09-29T01:58:00.884267] [INFO ] [MAIN ] APOS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:00.884611] [INFO ] [MAIN ] Update Progress: 133/2371 symbols completed. APOS took 0.6s. Estimated remaining: 11m 3s. Rate: 202.5 symbols/min [2025-09-29T01:58:01.189543] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:01.384673] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:01.386271] [DEBUG] [LOCAL ] APO: Loaded 54162 existing records from primary storage. [2025-09-29T01:58:01.426203] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:01.427334] [INFO ] [MAIN ] APO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:01.428011] [INFO ] [MAIN ] Update Progress: 134/2371 symbols completed. APO took 1.2s. Estimated remaining: 11m 7s. Rate: 201.3 symbols/min [2025-09-29T01:58:01.511055] [DEBUG] [LOCAL ] AQNB: Loaded 4228 existing records from primary storage. [2025-09-29T01:58:01.545711] [INFO ] [MAIN ] AQNB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:01.579818] [INFO ] [MAIN ] Update Progress: 135/2371 symbols completed. AQNB took 0.6s. Estimated remaining: 11m 4s. Rate: 202.0 symbols/min [2025-09-29T01:58:01.694392] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:01.677931] [DEBUG] [LOCAL ] APTV: Loaded 52964 existing records from primary storage. [2025-09-29T01:58:01.724169] [INFO ] [MAIN ] APTV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:01.763723] [INFO ] [MAIN ] Update Progress: 136/2371 symbols completed. APTV took 1.0s. Estimated remaining: 11m 2s. Rate: 202.6 symbols/min [2025-09-29T01:58:01.923378] [DEBUG] [LOCAL ] AQN: Loaded 52684 existing records from primary storage. [2025-09-29T01:58:02.001832] [INFO ] [MAIN ] AQN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:02.075304] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:02.080808] [INFO ] [MAIN ] Update Progress: 137/2371 symbols completed. AQN took 1.2s. Estimated remaining: 11m 2s. Rate: 202.5 symbols/min [2025-09-29T01:58:02.219898] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:02.360924] [DEBUG] [LOCAL ] AR: Loaded 54364 existing records from primary storage. [2025-09-29T01:58:02.361684] [INFO ] [MAIN ] AR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:02.411276] [INFO ] [MAIN ] Update Progress: 138/2371 symbols completed. AR took 1.0s. Estimated remaining: 11m 2s. Rate: 202.3 symbols/min [2025-09-29T01:58:02.434979] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:02.435638] [DEBUG] [LOCAL ] ARDC: Loaded 14821 existing records from primary storage. [2025-09-29T01:58:02.490120] [INFO ] [MAIN ] ARDC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:02.523487] [INFO ] [MAIN ] Update Progress: 139/2371 symbols completed. ARDC took 0.7s. Estimated remaining: 10m 59s. Rate: 203.2 symbols/min [2025-09-29T01:58:02.496319] [DEBUG] [LOCAL ] ARCO: Loaded 45249 existing records from primary storage. [2025-09-29T01:58:02.572840] [INFO ] [MAIN ] ARCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:02.638224] [INFO ] [MAIN ] Update Progress: 140/2371 symbols completed. ARCO took 1.0s. Estimated remaining: 10m 56s. Rate: 204.1 symbols/min [2025-09-29T01:58:02.937902] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:02.965788] [DEBUG] [LOCAL ] ARDT: Loaded 28513 existing records from primary storage. [2025-09-29T01:58:02.970183] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:02.996303] [INFO ] [MAIN ] ARDT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:02.996676] [INFO ] [MAIN ] Update Progress: 141/2371 symbols completed. ARDT took 0.9s. Estimated remaining: 10m 57s. Rate: 203.8 symbols/min [2025-09-29T01:58:03.159905] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:03.307233] [INFO ] [MAIN ] ARIS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:03.350549] [DEBUG] [LOCAL ] ARE: Loaded 51319 existing records from primary storage. [2025-09-29T01:58:03.361318] [DEBUG] [LOCAL ] ARES: Loaded 50322 existing records from primary storage. [2025-09-29T01:58:03.362135] [INFO ] [MAIN ] ARE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:03.362757] [INFO ] [MAIN ] Update Progress: 142/2371 symbols completed. ARE took 0.9s. Estimated remaining: 10m 57s. Rate: 203.4 symbols/min [2025-09-29T01:58:03.372446] [INFO ] [MAIN ] ARES: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:03.383771] [INFO ] [MAIN ] Update Progress: 143/2371 symbols completed. ARES took 0.8s. Estimated remaining: 10m 53s. Rate: 204.8 symbols/min [2025-09-29T01:58:03.555590] [DEBUG] [LOCAL ] ARI: Loaded 44009 existing records from primary storage. [2025-09-29T01:58:03.598277] [INFO ] [MAIN ] ARI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:03.637144] [INFO ] [MAIN ] Update Progress: 144/2371 symbols completed. ARI took 1.0s. Estimated remaining: 10m 52s. Rate: 205.0 symbols/min [2025-09-29T01:58:03.753215] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:03.853325] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:03.854808] [DEBUG] [LOCAL ] ARIS: Loaded 42624 existing records from primary storage. [2025-09-29T01:58:03.871149] [INFO ] [MAIN ] ARIS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:03.911620] [INFO ] [MAIN ] Update Progress: 145/2371 symbols completed. ARIS took 0.9s. Estimated remaining: 10m 51s. Rate: 205.1 symbols/min [2025-09-29T01:58:04.166422] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:04.213638] [DEBUG] [LOCAL ] ARLO: Loaded 44493 existing records from primary storage. [2025-09-29T01:58:04.225992] [INFO ] [MAIN ] ARLO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:04.302556] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:04.298337] [INFO ] [MAIN ] Update Progress: 146/2371 symbols completed. ARLO took 0.9s. Estimated remaining: 10m 52s. Rate: 204.6 symbols/min [2025-09-29T01:58:04.373192] [DEBUG] [LOCAL ] ARMK: Loaded 51112 existing records from primary storage. [2025-09-29T01:58:04.407119] [INFO ] [MAIN ] ARMK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:04.418619] [INFO ] [MAIN ] Update Progress: 147/2371 symbols completed. ARMK took 1.0s. Estimated remaining: 10m 50s. Rate: 205.4 symbols/min [2025-09-29T01:58:04.661345] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:04.681729] [DEBUG] [LOCAL ] AROC: Loaded 49733 existing records from primary storage. [2025-09-29T01:58:04.726830] [INFO ] [MAIN ] AROC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:04.734087] [DEBUG] [LOCAL ] ARR: Loaded 52809 existing records from primary storage. [2025-09-29T01:58:04.735000] [INFO ] [MAIN ] Update Progress: 148/2371 symbols completed. AROC took 1.1s. Estimated remaining: 10m 50s. Rate: 205.3 symbols/min [2025-09-29T01:58:04.775159] [INFO ] [MAIN ] ARR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:04.825102] [INFO ] [MAIN ] Update Progress: 149/2371 symbols completed. ARR took 0.9s. Estimated remaining: 10m 46s. Rate: 206.3 symbols/min [2025-09-29T01:58:04.829476] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:04.863567] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-09-29T01:58:04.886736] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-09-29T01:58:04.887014] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-09-29T01:58:04.887106] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-29T01:58:04.887184] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-29T01:58:04.918405] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-09-29T01:58:05.282455] [DEBUG] [LOCAL ] ARW: Loaded 33660 existing records from primary storage. [2025-09-29T01:58:05.310548] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:05.351412] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:05.346475] [INFO ] [MAIN ] ARW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:05.395534] [INFO ] [MAIN ] Update Progress: 150/2371 symbols completed. ARW took 1.1s. Estimated remaining: 10m 50s. Rate: 205.0 symbols/min [2025-09-29T01:58:05.609306] [DEBUG] [LOCAL ] ASA: Loaded 14109 existing records from primary storage. [2025-09-29T01:58:05.645830] [INFO ] [MAIN ] ASA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:05.706038] [INFO ] [MAIN ] Update Progress: 151/2371 symbols completed. ASA took 0.9s. Estimated remaining: 10m 50s. Rate: 204.9 symbols/min [2025-09-29T01:58:05.816659] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:05.952996] [DEBUG] [LOCAL ] AS: Loaded 53854 existing records from primary storage. [2025-09-29T01:58:05.990947] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:58:06.033325] [INFO ] [REMOTE ] ARX: Fetching primary data for 2024-12. [2025-09-29T01:58:06.032901] [INFO ] [MAIN ] AS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:06.041508] [INFO ] [MAIN ] Update Progress: 152/2371 symbols completed. AS took 1.3s. Estimated remaining: 10m 50s. Rate: 204.7 symbols/min [2025-09-29T01:58:06.184302] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:06.287179] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:58:06.349395] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:06.344447] [WARN ] [REMOTE ] ARX: No data returned for month 2024-12 [2025-09-29T01:58:06.367050] [FATAL] [REMOTE ] ARX: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:58:06.367198] [FATAL] [MAIN ] ARX: Failed to fetch primary data. [2025-09-29T01:58:06.367324] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:58:06.367473] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-29T01:58:06.367628] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-29T01:58:06.367751] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-09-29T01:58:06.368021] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-09-29T01:58:06.368184] [INFO ] [MAIN ] Update Progress: 153/2371 symbols completed. ARX took 1.9s. Estimated remaining: 10m 51s. Rate: 204.5 symbols/min [2025-09-29T01:58:06.381859] [DEBUG] [LOCAL ] ASAN: Loaded 53512 existing records from primary storage. [2025-09-29T01:58:06.405477] [INFO ] [MAIN ] ASAN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:06.437929] [INFO ] [MAIN ] Update Progress: 154/2371 symbols completed. ASAN took 1.0s. Estimated remaining: 10m 47s. Rate: 205.5 symbols/min [2025-09-29T01:58:06.424551] [DEBUG] [LOCAL ] ASBA: Loaded 3458 existing records from primary storage. [2025-09-29T01:58:06.454477] [INFO ] [MAIN ] ASBA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:06.511479] [INFO ] [MAIN ] Update Progress: 155/2371 symbols completed. ASBA took 0.5s. Estimated remaining: 10m 44s. Rate: 206.5 symbols/min [2025-09-29T01:58:06.752755] [DEBUG] [LOCAL ] ASB: Loaded 50299 existing records from primary storage. [2025-09-29T01:58:06.849071] [INFO ] [MAIN ] ASB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:06.853473] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:06.880684] [INFO ] [MAIN ] Update Progress: 156/2371 symbols completed. ASB took 1.1s. Estimated remaining: 10m 45s. Rate: 206.2 symbols/min [2025-09-29T01:58:06.982772] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:07.074562] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:07.241933] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:07.262444] [DEBUG] [LOCAL ] ASC: Loaded 38153 existing records from primary storage. [2025-09-29T01:58:07.263898] [INFO ] [MAIN ] ASC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:07.271703] [INFO ] [MAIN ] Update Progress: 157/2371 symbols completed. ASC took 0.9s. Estimated remaining: 10m 46s. Rate: 205.7 symbols/min [2025-09-29T01:58:07.273933] [DEBUG] [LOCAL ] ASGI: Loaded 22711 existing records from primary storage. [2025-09-29T01:58:07.279831] [INFO ] [MAIN ] ASGI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:07.280885] [INFO ] [MAIN ] Update Progress: 158/2371 symbols completed. ASGI took 0.7s. Estimated remaining: 10m 41s. Rate: 207.0 symbols/min [2025-09-29T01:58:07.281304] [DEBUG] [LOCAL ] ASG: Loaded 20695 existing records from primary storage. [2025-09-29T01:58:07.281772] [INFO ] [MAIN ] ASG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:07.281893] [INFO ] [MAIN ] Update Progress: 159/2371 symbols completed. ASG took 0.8s. Estimated remaining: 10m 37s. Rate: 208.3 symbols/min [2025-09-29T01:58:07.313387] [DEBUG] [LOCAL ] ASGN: Loaded 36554 existing records from primary storage. [2025-09-29T01:58:07.313780] [INFO ] [MAIN ] ASGN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:07.313886] [INFO ] [MAIN ] Update Progress: 160/2371 symbols completed. ASGN took 0.4s. Estimated remaining: 10m 33s. Rate: 209.5 symbols/min [2025-09-29T01:58:08.012431] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:08.096103] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:08.097286] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:08.118451] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:08.135476] [DEBUG] [LOCAL ] ASR: Loaded 9381 existing records from primary storage. [2025-09-29T01:58:08.136205] [INFO ] [MAIN ] ASR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:08.136369] [INFO ] [MAIN ] Update Progress: 161/2371 symbols completed. ASR took 0.8s. Estimated remaining: 10m 40s. Rate: 207.1 symbols/min [2025-09-29T01:58:08.302393] [DEBUG] [LOCAL ] ASIX: Loaded 22834 existing records from primary storage. [2025-09-29T01:58:08.311081] [INFO ] [MAIN ] ASIX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:08.386033] [INFO ] [MAIN ] Update Progress: 162/2371 symbols completed. ASIX took 1.1s. Estimated remaining: 10m 40s. Rate: 207.2 symbols/min [2025-09-29T01:58:08.388522] [DEBUG] [LOCAL ] ASPN: Loaded 50293 existing records from primary storage. [2025-09-29T01:58:08.387357] [DEBUG] [LOCAL ] ASH: Loaded 38339 existing records from primary storage. [2025-09-29T01:58:08.420196] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:08.420341] [INFO ] [MAIN ] ASPN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:08.430679] [INFO ] [MAIN ] ASH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:08.431443] [INFO ] [MAIN ] Update Progress: 163/2371 symbols completed. ASPN took 1.1s. Estimated remaining: 10m 36s. Rate: 208.3 symbols/min [2025-09-29T01:58:08.447529] [INFO ] [MAIN ] Update Progress: 164/2371 symbols completed. ASH took 1.1s. Estimated remaining: 10m 32s. Rate: 209.5 symbols/min [2025-09-29T01:58:08.859711] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:08.971377] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:09.031898] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:09.050824] [DEBUG] [LOCAL ] ASX: Loaded 53639 existing records from primary storage. [2025-09-29T01:58:09.053536] [INFO ] [MAIN ] ASX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:09.054343] [INFO ] [MAIN ] Update Progress: 165/2371 symbols completed. ASX took 0.9s. Estimated remaining: 10m 36s. Rate: 208.1 symbols/min [2025-09-29T01:58:09.272812] [DEBUG] [LOCAL ] ATEN: Loaded 40398 existing records from primary storage. [2025-09-29T01:58:09.301474] [INFO ] [MAIN ] ATEN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:09.302001] [INFO ] [MAIN ] Update Progress: 166/2371 symbols completed. ATEN took 0.9s. Estimated remaining: 10m 35s. Rate: 208.3 symbols/min [2025-09-29T01:58:09.300583] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:09.366314] [DEBUG] [LOCAL ] ATHM: Loaded 33015 existing records from primary storage. [2025-09-29T01:58:09.394980] [DEBUG] [LOCAL ] ATGE: Loaded 32251 existing records from primary storage. [2025-09-29T01:58:09.400980] [INFO ] [MAIN ] ATHM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:09.411628] [INFO ] [MAIN ] ATGE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:09.443035] [INFO ] [MAIN ] Update Progress: 167/2371 symbols completed. ATHM took 1.0s. Estimated remaining: 10m 33s. Rate: 208.9 symbols/min [2025-09-29T01:58:09.449498] [INFO ] [MAIN ] Update Progress: 168/2371 symbols completed. ATGE took 1.0s. Estimated remaining: 10m 29s. Rate: 210.1 symbols/min [2025-09-29T01:58:09.471375] [DEBUG] [LOCAL ] ATHS: Loaded 7145 existing records from primary storage. [2025-09-29T01:58:09.515158] [INFO ] [MAIN ] ATHS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:09.581127] [INFO ] [MAIN ] Update Progress: 169/2371 symbols completed. ATHS took 0.5s. Estimated remaining: 10m 27s. Rate: 210.8 symbols/min [2025-09-29T01:58:09.778916] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:09.990266] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:10.165356] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:10.160965] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:10.218212] [DEBUG] [LOCAL ] ATI: Loaded 52283 existing records from primary storage. [2025-09-29T01:58:10.230270] [INFO ] [MAIN ] ATI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:10.233064] [INFO ] [MAIN ] Update Progress: 170/2371 symbols completed. ATI took 0.9s. Estimated remaining: 10m 31s. Rate: 209.2 symbols/min [2025-09-29T01:58:10.393773] [DEBUG] [LOCAL ] ATMU: Loaded 40274 existing records from primary storage. [2025-09-29T01:58:10.400636] [INFO ] [MAIN ] ATMU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:10.401331] [INFO ] [MAIN ] Update Progress: 171/2371 symbols completed. ATMU took 0.9s. Estimated remaining: 10m 29s. Rate: 209.7 symbols/min [2025-09-29T01:58:10.402189] [DEBUG] [LOCAL ] ATKR: Loaded 36196 existing records from primary storage. [2025-09-29T01:58:10.488343] [INFO ] [MAIN ] ATKR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:10.578375] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:10.578491] [INFO ] [MAIN ] Update Progress: 172/2371 symbols completed. ATKR took 1.1s. Estimated remaining: 10m 28s. Rate: 210.2 symbols/min [2025-09-29T01:58:10.575900] [DEBUG] [LOCAL ] ATO: Loaded 42489 existing records from primary storage. [2025-09-29T01:58:10.612527] [INFO ] [MAIN ] ATO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:10.613278] [INFO ] [MAIN ] Update Progress: 173/2371 symbols completed. ATO took 0.9s. Estimated remaining: 10m 24s. Rate: 211.3 symbols/min [2025-09-29T01:58:10.935671] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:11.006370] [DEBUG] [LOCAL ] ATR: Loaded 30839 existing records from primary storage. [2025-09-29T01:58:11.072967] [INFO ] [MAIN ] ATR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:11.100913] [INFO ] [MAIN ] Update Progress: 174/2371 symbols completed. ATR took 0.9s. Estimated remaining: 10m 26s. Rate: 210.4 symbols/min [2025-09-29T01:58:11.149485] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:11.143927] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:11.192002] [DEBUG] [LOCAL ] ATS: Loaded 18145 existing records from primary storage. [2025-09-29T01:58:11.203677] [INFO ] [MAIN ] ATS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:11.215114] [INFO ] [MAIN ] Update Progress: 175/2371 symbols completed. ATS took 0.8s. Estimated remaining: 10m 24s. Rate: 211.1 symbols/min [2025-09-29T01:58:11.546031] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:11.591483] [DEBUG] [LOCAL ] ATUS: Loaded 49958 existing records from primary storage. [2025-09-29T01:58:11.592756] [INFO ] [MAIN ] ATUS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:11.594780] [INFO ] [MAIN ] Update Progress: 176/2371 symbols completed. ATUS took 1.0s. Estimated remaining: 10m 25s. Rate: 210.7 symbols/min [2025-09-29T01:58:11.623697] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:11.762959] [DEBUG] [LOCAL ] AU: Loaded 53715 existing records from primary storage. [2025-09-29T01:58:11.773279] [DEBUG] [LOCAL ] AUNA: Loaded 4966 existing records from primary storage. [2025-09-29T01:58:11.774184] [INFO ] [MAIN ] AUNA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:11.774318] [INFO ] [MAIN ] Update Progress: 177/2371 symbols completed. AUNA took 0.6s. Estimated remaining: 10m 23s. Rate: 211.2 symbols/min [2025-09-29T01:58:11.779812] [INFO ] [MAIN ] AU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:11.851512] [INFO ] [MAIN ] Update Progress: 178/2371 symbols completed. AU took 1.2s. Estimated remaining: 10m 21s. Rate: 212.0 symbols/min [2025-09-29T01:58:11.955151] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:12.112036] [DEBUG] [LOCAL ] AUB: Loaded 47072 existing records from primary storage. [2025-09-29T01:58:12.176339] [INFO ] [MAIN ] AUB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:12.193991] [INFO ] [MAIN ] Update Progress: 179/2371 symbols completed. AUB took 1.0s. Estimated remaining: 10m 21s. Rate: 211.8 symbols/min [2025-09-29T01:58:12.256486] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:12.479507] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:12.479900] [DEBUG] [LOCAL ] AVA: Loaded 40183 existing records from primary storage. [2025-09-29T01:58:12.486404] [DEBUG] [LOCAL ] AVAL: Loaded 9040 existing records from primary storage. [2025-09-29T01:58:12.486965] [INFO ] [MAIN ] AVA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:12.492584] [INFO ] [MAIN ] AVAL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:12.535695] [INFO ] [MAIN ] Update Progress: 180/2371 symbols completed. AVAL took 0.8s. Estimated remaining: 10m 21s. Rate: 211.5 symbols/min [2025-09-29T01:58:12.578433] [INFO ] [MAIN ] Update Progress: 181/2371 symbols completed. AVA took 0.9s. Estimated remaining: 10m 18s. Rate: 212.5 symbols/min [2025-09-29T01:58:12.598921] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:12.697213] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-09-29T01:58:12.781477] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-09-29T01:58:12.846495] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-09-29T01:58:12.858004] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-29T01:58:12.874985] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-29T01:58:12.885289] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-09-29T01:58:12.972492] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:13.063944] [DEBUG] [LOCAL ] AVB: Loaded 42457 existing records from primary storage. [2025-09-29T01:58:13.057188] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:13.081860] [INFO ] [MAIN ] AVB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:13.087674] [INFO ] [MAIN ] Update Progress: 182/2371 symbols completed. AVB took 1.1s. Estimated remaining: 10m 21s. Rate: 211.6 symbols/min [2025-09-29T01:58:13.307154] [DEBUG] [LOCAL ] AVK: Loaded 18064 existing records from primary storage. [2025-09-29T01:58:13.430064] [INFO ] [MAIN ] AVK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:13.436262] [DEBUG] [LOCAL ] AVD: Loaded 23030 existing records from primary storage. [2025-09-29T01:58:13.501728] [INFO ] [MAIN ] AVD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:13.502678] [INFO ] [MAIN ] Update Progress: 183/2371 symbols completed. AVK took 0.9s. Estimated remaining: 10m 22s. Rate: 211.1 symbols/min [2025-09-29T01:58:13.535958] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:13.542098] [INFO ] [MAIN ] Update Progress: 184/2371 symbols completed. AVD took 1.0s. Estimated remaining: 10m 19s. Rate: 212.1 symbols/min [2025-09-29T01:58:14.060857] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:14.075073] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:58:14.076354] [DEBUG] [LOCAL ] AVNS: Loaded 34132 existing records from primary storage. [2025-09-29T01:58:14.102718] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2024-12. [2025-09-29T01:58:14.101881] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:14.105583] [INFO ] [MAIN ] AVNS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:14.107615] [INFO ] [MAIN ] Update Progress: 185/2371 symbols completed. AVNS took 1.0s. Estimated remaining: 10m 22s. Rate: 210.9 symbols/min [2025-09-29T01:58:14.268428] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:58:14.319257] [WARN ] [REMOTE ] AVBC: No data returned for month 2024-12 [2025-09-29T01:58:14.362759] [FATAL] [REMOTE ] AVBC: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:58:14.363187] [FATAL] [MAIN ] AVBC: Failed to fetch primary data. [2025-09-29T01:58:14.348010] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:14.365097] [DEBUG] [LOCAL ] AVNT: Loaded 39887 existing records from primary storage. [2025-09-29T01:58:14.363431] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:58:14.365612] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-29T01:58:14.365982] [INFO ] [MAIN ] AVNT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:14.366297] [INFO ] [MAIN ] Update Progress: 186/2371 symbols completed. AVNT took 0.8s. Estimated remaining: 10m 21s. Rate: 211.0 symbols/min [2025-09-29T01:58:14.366172] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-29T01:58:14.389496] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-09-29T01:58:14.406068] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-09-29T01:58:14.416684] [INFO ] [MAIN ] Update Progress: 187/2371 symbols completed. AVBC took 2.2s. Estimated remaining: 10m 18s. Rate: 212.0 symbols/min [2025-09-29T01:58:14.542622] [DEBUG] [LOCAL ] AVTR: Loaded 54345 existing records from primary storage. [2025-09-29T01:58:14.575109] [INFO ] [MAIN ] AVTR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:14.617404] [INFO ] [MAIN ] Update Progress: 188/2371 symbols completed. AVTR took 1.0s. Estimated remaining: 10m 17s. Rate: 212.3 symbols/min [2025-09-29T01:58:14.790189] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:14.791719] [DEBUG] [LOCAL ] AVY: Loaded 38102 existing records from primary storage. [2025-09-29T01:58:14.871234] [INFO ] [MAIN ] AVY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:14.916470] [INFO ] [MAIN ] Update Progress: 189/2371 symbols completed. AVY took 0.8s. Estimated remaining: 10m 17s. Rate: 212.2 symbols/min [2025-09-29T01:58:15.161827] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:15.163669] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:15.208200] [DEBUG] [LOCAL ] AWF: Loaded 24608 existing records from primary storage. [2025-09-29T01:58:15.230123] [INFO ] [MAIN ] AWF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:15.235836] [INFO ] [MAIN ] Update Progress: 190/2371 symbols completed. AWF took 0.9s. Estimated remaining: 10m 17s. Rate: 212.1 symbols/min [2025-09-29T01:58:15.432793] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:15.546625] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:15.564449] [DEBUG] [LOCAL ] AWI: Loaded 26185 existing records from primary storage. [2025-09-29T01:58:15.565328] [INFO ] [MAIN ] AWI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:15.565453] [INFO ] [MAIN ] Update Progress: 191/2371 symbols completed. AWI took 1.1s. Estimated remaining: 10m 17s. Rate: 211.9 symbols/min [2025-09-29T01:58:15.722527] [DEBUG] [LOCAL ] AWP: Loaded 21835 existing records from primary storage. [2025-09-29T01:58:15.731557] [DEBUG] [LOCAL ] AWK: Loaded 49489 existing records from primary storage. [2025-09-29T01:58:15.723303] [INFO ] [MAIN ] AWP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:15.742952] [INFO ] [MAIN ] Update Progress: 192/2371 symbols completed. AWP took 0.8s. Estimated remaining: 10m 16s. Rate: 212.3 symbols/min [2025-09-29T01:58:15.816788] [DEBUG] [LOCAL ] AWR: Loaded 22993 existing records from primary storage. [2025-09-29T01:58:15.743104] [INFO ] [MAIN ] AWK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:15.836169] [INFO ] [MAIN ] Update Progress: 193/2371 symbols completed. AWK took 1.2s. Estimated remaining: 10m 13s. Rate: 213.1 symbols/min [2025-09-29T01:58:15.847720] [INFO ] [MAIN ] AWR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:15.852327] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:15.852819] [INFO ] [MAIN ] Update Progress: 194/2371 symbols completed. AWR took 0.6s. Estimated remaining: 10m 10s. Rate: 214.1 symbols/min [2025-09-29T01:58:16.353244] [DEBUG] [LOCAL ] AX: Loaded 28929 existing records from primary storage. [2025-09-29T01:58:16.439758] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:16.463088] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:16.470597] [INFO ] [MAIN ] AX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:16.491871] [INFO ] [MAIN ] Update Progress: 195/2371 symbols completed. AX took 0.9s. Estimated remaining: 10m 14s. Rate: 212.7 symbols/min [2025-09-29T01:58:16.498472] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:16.628581] [DEBUG] [LOCAL ] AXR: Loaded 3220 existing records from primary storage. [2025-09-29T01:58:16.633911] [INFO ] [MAIN ] AXR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:16.640527] [INFO ] [MAIN ] Update Progress: 196/2371 symbols completed. AXR took 0.7s. Estimated remaining: 10m 12s. Rate: 213.2 symbols/min [2025-09-29T01:58:16.828196] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:16.908403] [DEBUG] [LOCAL ] AXL: Loaded 51239 existing records from primary storage. [2025-09-29T01:58:16.951492] [INFO ] [MAIN ] AXL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:16.967376] [DEBUG] [LOCAL ] AXP: Loaded 53999 existing records from primary storage. [2025-09-29T01:58:16.990986] [INFO ] [MAIN ] AXP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:16.990827] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:16.991790] [INFO ] [MAIN ] Update Progress: 197/2371 symbols completed. AXL took 1.2s. Estimated remaining: 10m 13s. Rate: 212.9 symbols/min [2025-09-29T01:58:16.992889] [INFO ] [MAIN ] Update Progress: 198/2371 symbols completed. AXP took 1.1s. Estimated remaining: 10m 9s. Rate: 214.0 symbols/min [2025-09-29T01:58:17.026360] [DEBUG] [LOCAL ] AXS: Loaded 38920 existing records from primary storage. [2025-09-29T01:58:17.026916] [INFO ] [MAIN ] AXS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:17.030848] [INFO ] [MAIN ] Update Progress: 199/2371 symbols completed. AXS took 0.5s. Estimated remaining: 10m 6s. Rate: 215.0 symbols/min [2025-09-29T01:58:17.081676] [DEBUG] [LOCAL ] AXTA: Loaded 52835 existing records from primary storage. [2025-09-29T01:58:17.082134] [INFO ] [MAIN ] AXTA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:17.082728] [INFO ] [MAIN ] Update Progress: 200/2371 symbols completed. AXTA took 0.4s. Estimated remaining: 10m 4s. Rate: 215.8 symbols/min [2025-09-29T01:58:17.867294] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:17.878221] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:17.904630] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:17.905083] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-09-29T01:58:17.914069] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-09-29T01:58:17.937938] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:17.938552] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-09-29T01:58:17.938787] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-29T01:58:17.938952] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-29T01:58:17.939397] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-09-29T01:58:18.070693] [DEBUG] [LOCAL ] AZO: Loaded 11687 existing records from primary storage. [2025-09-29T01:58:18.112420] [INFO ] [MAIN ] AZO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:18.114045] [DEBUG] [LOCAL ] AZZ: Loaded 22359 existing records from primary storage. [2025-09-29T01:58:18.130194] [INFO ] [MAIN ] Update Progress: 201/2371 symbols completed. AZO took 1.0s. Estimated remaining: 10m 12s. Rate: 212.9 symbols/min [2025-09-29T01:58:18.135557] [INFO ] [MAIN ] AZZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:18.235344] [DEBUG] [LOCAL ] AYI: Loaded 25446 existing records from primary storage. [2025-09-29T01:58:18.242213] [INFO ] [MAIN ] AYI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:18.216379] [INFO ] [MAIN ] Update Progress: 202/2371 symbols completed. AZZ took 1.1s. Estimated remaining: 10m 9s. Rate: 213.6 symbols/min [2025-09-29T01:58:18.316940] [INFO ] [MAIN ] Update Progress: 203/2371 symbols completed. AYI took 1.2s. Estimated remaining: 10m 7s. Rate: 214.3 symbols/min [2025-09-29T01:58:18.823996] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:18.928595] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:58:19.021062] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:19.026565] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:19.027054] [INFO ] [REMOTE ] B: Fetching primary data for 2024-12. [2025-09-29T01:58:19.155557] [DEBUG] [LOCAL ] BA: Loaded 54571 existing records from primary storage. [2025-09-29T01:58:19.157004] [DEBUG] [LOCAL ] BABA: Loaded 54600 existing records from primary storage. [2025-09-29T01:58:19.156128] [INFO ] [MAIN ] BA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:19.158033] [INFO ] [MAIN ] Update Progress: 204/2371 symbols completed. BA took 1.0s. Estimated remaining: 10m 13s. Rate: 212.2 symbols/min [2025-09-29T01:58:19.159227] [DEBUG] [LOCAL ] BAC: Loaded 54588 existing records from primary storage. [2025-09-29T01:58:19.159379] [INFO ] [MAIN ] BABA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:19.183820] [INFO ] [MAIN ] Update Progress: 205/2371 symbols completed. BABA took 0.9s. Estimated remaining: 10m 10s. Rate: 213.2 symbols/min [2025-09-29T01:58:19.183353] [INFO ] [MAIN ] BAC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:19.236499] [INFO ] [MAIN ] Update Progress: 206/2371 symbols completed. BAC took 0.9s. Estimated remaining: 10m 7s. Rate: 214.0 symbols/min [2025-09-29T01:58:19.579334] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:19.764109] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:19.787032] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:19.822517] [INFO ] [REMOTE ] B: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-29T01:58:19.831007] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-09-29T01:58:19.890528] [DEBUG] [LOCAL ] BAK: Loaded 39413 existing records from primary storage. [2025-09-29T01:58:19.906744] [INFO ] [MAIN ] BAK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:19.906947] [INFO ] [MAIN ] Update Progress: 207/2371 symbols completed. BAK took 0.7s. Estimated remaining: 10m 11s. Rate: 212.6 symbols/min [2025-09-29T01:58:20.050260] [DEBUG] [LOCAL ] BAH: Loaded 52477 existing records from primary storage. [2025-09-29T01:58:20.078703] [DEBUG] [LOCAL ] BALL: Loaded 52583 existing records from primary storage. [2025-09-29T01:58:20.099767] [INFO ] [MAIN ] BALL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:20.078981] [INFO ] [MAIN ] BAH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:20.105976] [INFO ] [MAIN ] Update Progress: 208/2371 symbols completed. BAH took 0.9s. Estimated remaining: 10m 10s. Rate: 212.9 symbols/min [2025-09-29T01:58:20.178732] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:20.150005] [INFO ] [MAIN ] Update Progress: 209/2371 symbols completed. BALL took 0.8s. Estimated remaining: 10m 7s. Rate: 213.7 symbols/min [2025-09-29T01:58:20.238831] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-09-29T01:58:20.253453] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-09-29T01:58:20.280157] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-09-29T01:58:20.295768] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-09-29T01:58:20.366995] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-09-29T01:58:20.390810] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-09-29T01:58:20.650721] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:20.779366] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:20.798852] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-29T01:58:20.822705] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-09-29T01:58:21.019381] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:58:21.063919] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-09-29T01:58:21.091324] [FATAL] [REMOTE ] B: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:58:21.115923] [FATAL] [MAIN ] B: Failed to fetch primary data. [2025-09-29T01:58:21.133883] [DEBUG] [LOCAL ] BAM: Loaded 52779 existing records from primary storage. [2025-09-29T01:58:21.151113] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:58:21.164302] [INFO ] [MAIN ] BAM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:21.213606] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:58:21.216501] [INFO ] [REMOTE ] BALY: Fetching primary data for 2024-12. [2025-09-29T01:58:21.215734] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-29T01:58:21.217164] [INFO ] [MAIN ] Update Progress: 210/2371 symbols completed. BAM took 1.1s. Estimated remaining: 10m 15s. Rate: 210.9 symbols/min [2025-09-29T01:58:21.217728] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-29T01:58:21.218974] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-09-29T01:58:21.219092] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-09-29T01:58:21.224932] [INFO ] [MAIN ] Update Progress: 211/2371 symbols completed. B took 4.1s. Estimated remaining: 10m 12s. Rate: 211.9 symbols/min [2025-09-29T01:58:21.226061] [DEBUG] [LOCAL ] BANC: Loaded 52019 existing records from primary storage. [2025-09-29T01:58:21.292785] [INFO ] [MAIN ] BANC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:21.339960] [INFO ] [MAIN ] Update Progress: 212/2371 symbols completed. BANC took 1.1s. Estimated remaining: 10m 10s. Rate: 212.5 symbols/min [2025-09-29T01:58:21.656987] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:21.779905] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:21.878821] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:21.896479] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-29T01:58:21.914692] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-09-29T01:58:21.927850] [DEBUG] [LOCAL ] BAP: Loaded 26635 existing records from primary storage. [2025-09-29T01:58:21.928547] [INFO ] [MAIN ] BAP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:21.928689] [INFO ] [MAIN ] Update Progress: 213/2371 symbols completed. BAP took 0.7s. Estimated remaining: 10m 12s. Rate: 211.4 symbols/min [2025-09-29T01:58:22.087850] [DEBUG] [LOCAL ] BARK: Loaded 38893 existing records from primary storage. [2025-09-29T01:58:22.114343] [INFO ] [MAIN ] BARK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:22.155210] [INFO ] [MAIN ] Update Progress: 214/2371 symbols completed. BARK took 0.9s. Estimated remaining: 10m 12s. Rate: 211.6 symbols/min [2025-09-29T01:58:22.182194] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:22.269802] [DEBUG] [LOCAL ] BAX: Loaded 54273 existing records from primary storage. [2025-09-29T01:58:22.316317] [INFO ] [MAIN ] BAX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:22.322232] [INFO ] [MAIN ] Update Progress: 215/2371 symbols completed. BAX took 0.9s. Estimated remaining: 10m 10s. Rate: 212.0 symbols/min [2025-09-29T01:58:22.535489] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:22.611085] [DEBUG] [LOCAL ] BB: Loaded 53701 existing records from primary storage. [2025-09-29T01:58:22.649121] [INFO ] [MAIN ] BB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:22.663924] [INFO ] [MAIN ] Update Progress: 216/2371 symbols completed. BB took 0.7s. Estimated remaining: 10m 10s. Rate: 211.8 symbols/min [2025-09-29T01:58:22.696670] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-29T01:58:22.717820] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:22.795290] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-09-29T01:58:22.939366] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:22.950692] [DEBUG] [LOCAL ] BBAI: Loaded 54600 existing records from primary storage. [2025-09-29T01:58:22.951678] [INFO ] [MAIN ] BBAI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:22.952251] [INFO ] [MAIN ] Update Progress: 217/2371 symbols completed. BBAI took 0.8s. Estimated remaining: 10m 10s. Rate: 211.8 symbols/min [2025-09-29T01:58:23.078837] [DEBUG] [LOCAL ] BBAR: Loaded 41988 existing records from primary storage. [2025-09-29T01:58:23.084091] [INFO ] [MAIN ] BBAR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:23.100333] [INFO ] [MAIN ] Update Progress: 218/2371 symbols completed. BBAR took 0.8s. Estimated remaining: 10m 9s. Rate: 212.3 symbols/min [2025-09-29T01:58:23.203088] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:23.307543] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-29T01:58:23.311108] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-09-29T01:58:23.382500] [DEBUG] [LOCAL ] BBD: Loaded 53959 existing records from primary storage. [2025-09-29T01:58:23.413364] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:23.423023] [INFO ] [MAIN ] BBD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:23.424097] [INFO ] [MAIN ] Update Progress: 219/2371 symbols completed. BBD took 0.8s. Estimated remaining: 10m 9s. Rate: 212.1 symbols/min [2025-09-29T01:58:23.561773] [DEBUG] [LOCAL ] BBDO: Loaded 5051 existing records from primary storage. [2025-09-29T01:58:23.563824] [DEBUG] [LOCAL ] BBDC: Loaded 33756 existing records from primary storage. [2025-09-29T01:58:23.627208] [INFO ] [MAIN ] BBDO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:23.649728] [INFO ] [MAIN ] BBDC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:23.649898] [INFO ] [MAIN ] Update Progress: 220/2371 symbols completed. BBDO took 0.5s. Estimated remaining: 10m 8s. Rate: 212.3 symbols/min [2025-09-29T01:58:23.650237] [INFO ] [MAIN ] Update Progress: 221/2371 symbols completed. BBDC took 0.7s. Estimated remaining: 10m 5s. Rate: 213.3 symbols/min [2025-09-29T01:58:23.649361] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:23.978061] [DEBUG] [LOCAL ] BBN: Loaded 18193 existing records from primary storage. [2025-09-29T01:58:23.970578] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-29T01:58:24.005461] [INFO ] [MAIN ] BBN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:24.015421] [INFO ] [MAIN ] Update Progress: 222/2371 symbols completed. BBN took 0.6s. Estimated remaining: 10m 5s. Rate: 213.0 symbols/min [2025-09-29T01:58:24.006752] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:24.015878] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-09-29T01:58:24.031901] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-09-29T01:58:24.065037] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-09-29T01:58:24.066521] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-09-29T01:58:24.078316] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-29T01:58:24.139465] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-29T01:58:24.161251] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:24.177977] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-09-29T01:58:24.298975] [DEBUG] [LOCAL ] BBU: Loaded 4478 existing records from primary storage. [2025-09-29T01:58:24.349286] [INFO ] [MAIN ] BBU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:24.389829] [INFO ] [MAIN ] Update Progress: 223/2371 symbols completed. BBU took 0.7s. Estimated remaining: 10m 6s. Rate: 212.7 symbols/min [2025-09-29T01:58:24.425744] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:24.629877] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-29T01:58:24.697233] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-09-29T01:58:24.696760] [DEBUG] [LOCAL ] BBUC: Loaded 13503 existing records from primary storage. [2025-09-29T01:58:24.737807] [INFO ] [MAIN ] BBUC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:24.801870] [INFO ] [MAIN ] Update Progress: 224/2371 symbols completed. BBUC took 0.7s. Estimated remaining: 10m 7s. Rate: 212.3 symbols/min [2025-09-29T01:58:24.904003] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:25.116673] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:58:25.138670] [INFO ] [REMOTE ] BBT: Fetching primary data for 2024-12. [2025-09-29T01:58:25.211092] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:25.233176] [DEBUG] [LOCAL ] BBVA: Loaded 50167 existing records from primary storage. [2025-09-29T01:58:25.233738] [INFO ] [MAIN ] BBVA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:25.234869] [INFO ] [MAIN ] Update Progress: 225/2371 symbols completed. BBVA took 0.8s. Estimated remaining: 10m 8s. Rate: 211.8 symbols/min [2025-09-29T01:58:25.296719] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:58:25.344429] [WARN ] [REMOTE ] BBT: No data returned for month 2024-12 [2025-09-29T01:58:25.345609] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-29T01:58:25.357040] [FATAL] [REMOTE ] BBT: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:58:25.375512] [FATAL] [MAIN ] BBT: Failed to fetch primary data. [2025-09-29T01:58:25.376498] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-09-29T01:58:25.386028] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:58:25.404573] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-29T01:58:25.453147] [DEBUG] [LOCAL ] BBW: Loaded 27177 existing records from primary storage. [2025-09-29T01:58:25.470128] [INFO ] [MAIN ] BBW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:25.441099] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-29T01:58:25.470390] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-09-29T01:58:25.475984] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:25.476137] [INFO ] [MAIN ] Update Progress: 226/2371 symbols completed. BBW took 0.6s. Estimated remaining: 10m 7s. Rate: 211.9 symbols/min [2025-09-29T01:58:25.476522] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-09-29T01:58:25.483603] [INFO ] [MAIN ] Update Progress: 227/2371 symbols completed. BBT took 1.8s. Estimated remaining: 10m 4s. Rate: 212.8 symbols/min [2025-09-29T01:58:25.830565] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:25.889822] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:25.903083] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-29T01:58:25.908947] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-09-29T01:58:25.936059] [DEBUG] [LOCAL ] BBWI: Loaded 54360 existing records from primary storage. [2025-09-29T01:58:25.937000] [INFO ] [MAIN ] BBWI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:25.938451] [INFO ] [MAIN ] Update Progress: 228/2371 symbols completed. BBWI took 0.7s. Estimated remaining: 10m 6s. Rate: 212.2 symbols/min [2025-09-29T01:58:26.161629] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:26.199137] [DEBUG] [LOCAL ] BBY: Loaded 54253 existing records from primary storage. [2025-09-29T01:58:26.199947] [INFO ] [MAIN ] BBY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:26.201578] [INFO ] [MAIN ] Update Progress: 229/2371 symbols completed. BBY took 0.7s. Estimated remaining: 10m 5s. Rate: 212.3 symbols/min [2025-09-29T01:58:26.350784] [DEBUG] [LOCAL ] BC: Loaded 45020 existing records from primary storage. [2025-09-29T01:58:26.421079] [INFO ] [MAIN ] BC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:26.425432] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:26.438218] [INFO ] [MAIN ] Update Progress: 230/2371 symbols completed. BC took 0.9s. Estimated remaining: 10m 5s. Rate: 212.5 symbols/min [2025-09-29T01:58:26.448019] [DEBUG] [LOCAL ] BCAT: Loaded 34910 existing records from primary storage. [2025-09-29T01:58:26.446773] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-29T01:58:26.485417] [INFO ] [MAIN ] BCAT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:26.500462] [INFO ] [MAIN ] Update Progress: 231/2371 symbols completed. BCAT took 0.6s. Estimated remaining: 10m 2s. Rate: 213.2 symbols/min [2025-09-29T01:58:26.505907] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-09-29T01:58:26.709237] [DEBUG] [LOCAL ] BCC: Loaded 28735 existing records from primary storage. [2025-09-29T01:58:26.787546] [INFO ] [MAIN ] BCC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:26.796932] [INFO ] [MAIN ] Update Progress: 232/2371 symbols completed. BCC took 0.6s. Estimated remaining: 10m 2s. Rate: 213.1 symbols/min [2025-09-29T01:58:26.827275] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:26.952936] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:26.995195] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-29T01:58:27.037171] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-09-29T01:58:27.128377] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:27.168158] [DEBUG] [LOCAL ] BCH: Loaded 30039 existing records from primary storage. [2025-09-29T01:58:27.170315] [INFO ] [MAIN ] BCH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:27.171248] [INFO ] [MAIN ] Update Progress: 233/2371 symbols completed. BCH took 0.6s. Estimated remaining: 10m 3s. Rate: 212.8 symbols/min [2025-09-29T01:58:27.200563] [DEBUG] [LOCAL ] BCE: Loaded 53072 existing records from primary storage. [2025-09-29T01:58:27.243194] [INFO ] [MAIN ] BCE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:27.270117] [INFO ] [MAIN ] Update Progress: 234/2371 symbols completed. BCE took 0.8s. Estimated remaining: 10m 1s. Rate: 213.4 symbols/min [2025-09-29T01:58:27.360243] [DEBUG] [LOCAL ] BCO: Loaded 26740 existing records from primary storage. [2025-09-29T01:58:27.378535] [INFO ] [MAIN ] BCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:27.402601] [INFO ] [MAIN ] Update Progress: 235/2371 symbols completed. BCO took 0.6s. Estimated remaining: 9m 59s. Rate: 213.9 symbols/min [2025-09-29T01:58:27.513215] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:27.729195] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-29T01:58:27.759132] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:27.769335] [INFO ] [REMOTE ] BALY: Full fetch complete (17169 records). [2025-09-29T01:58:27.780761] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-09-29T01:58:27.901990] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:27.999973] [DEBUG] [LOCAL ] BCS: Loaded 54242 existing records from primary storage. [2025-09-29T01:58:28.050027] [DEBUG] [LOCAL ] BCSF: Loaded 28231 existing records from primary storage. [2025-09-29T01:58:28.049082] [INFO ] [MAIN ] BCS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:28.099929] [INFO ] [MAIN ] BCSF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:28.119610] [INFO ] [MAIN ] Update Progress: 236/2371 symbols completed. BCS took 0.9s. Estimated remaining: 10m 3s. Rate: 212.5 symbols/min [2025-09-29T01:58:28.124094] [INFO ] [MAIN ] Update Progress: 237/2371 symbols completed. BCSF took 0.8s. Estimated remaining: 10m 0s. Rate: 213.4 symbols/min [2025-09-29T01:58:28.137065] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-29T01:58:28.150432] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-09-29T01:58:28.156865] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-09-29T01:58:28.178722] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-09-29T01:58:28.213996] [DEBUG] [LOCAL ] BCX: Loaded 21920 existing records from primary storage. [2025-09-29T01:58:28.219256] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-09-29T01:58:28.237568] [INFO ] [MAIN ] BCX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:28.244762] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-09-29T01:58:28.257411] [INFO ] [MAIN ] Update Progress: 238/2371 symbols completed. BCX took 0.8s. Estimated remaining: 9m 58s. Rate: 213.9 symbols/min [2025-09-29T01:58:28.298946] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-09-29T01:58:28.312861] [INFO ] [MAIN ] Update Progress: 239/2371 symbols completed. BALY took 8.4s. Estimated remaining: 9m 56s. Rate: 214.6 symbols/min [2025-09-29T01:58:28.333626] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:28.364444] [DEBUG] [LOCAL ] BDC: Loaded 25073 existing records from primary storage. [2025-09-29T01:58:28.364909] [INFO ] [MAIN ] BDC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:28.365033] [INFO ] [MAIN ] Update Progress: 240/2371 symbols completed. BDC took 0.2s. Estimated remaining: 9m 54s. Rate: 215.3 symbols/min [2025-09-29T01:58:28.911842] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:29.021296] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:29.059293] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:29.133493] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:29.182506] [DEBUG] [LOCAL ] BDJ: Loaded 29325 existing records from primary storage. [2025-09-29T01:58:29.184961] [INFO ] [MAIN ] BDJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:29.186440] [INFO ] [MAIN ] Update Progress: 241/2371 symbols completed. BDJ took 0.8s. Estimated remaining: 9m 58s. Rate: 213.6 symbols/min [2025-09-29T01:58:29.264366] [DEBUG] [LOCAL ] BE: Loaded 54433 existing records from primary storage. [2025-09-29T01:58:29.312120] [INFO ] [MAIN ] BE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:29.343149] [INFO ] [MAIN ] Update Progress: 242/2371 symbols completed. BE took 1.0s. Estimated remaining: 9m 57s. Rate: 214.0 symbols/min [2025-09-29T01:58:29.416172] [DEBUG] [LOCAL ] BDN: Loaded 48230 existing records from primary storage. [2025-09-29T01:58:29.573311] [DEBUG] [LOCAL ] BDX: Loaded 53191 existing records from primary storage. [2025-09-29T01:58:29.573975] [INFO ] [MAIN ] BDX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:29.526389] [INFO ] [MAIN ] BDN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:29.571949] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:29.575004] [INFO ] [MAIN ] Update Progress: 243/2371 symbols completed. BDN took 1.2s. Estimated remaining: 9m 56s. Rate: 214.1 symbols/min [2025-09-29T01:58:29.587266] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-09-29T01:58:29.581434] [INFO ] [MAIN ] Update Progress: 244/2371 symbols completed. BDX took 1.2s. Estimated remaining: 9m 54s. Rate: 215.0 symbols/min [2025-09-29T01:58:29.650223] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-09-29T01:58:29.746614] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:29.805877] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-09-29T01:58:29.863939] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-29T01:58:29.897291] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-09-29T01:58:29.909339] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-09-29T01:58:30.019460] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:30.184432] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:30.366178] [DEBUG] [LOCAL ] BEKE: Loaded 54025 existing records from primary storage. [2025-09-29T01:58:30.410528] [INFO ] [MAIN ] BEKE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:30.423770] [INFO ] [MAIN ] Update Progress: 245/2371 symbols completed. BEKE took 1.1s. Estimated remaining: 9m 58s. Rate: 213.2 symbols/min [2025-09-29T01:58:30.635177] [DEBUG] [LOCAL ] BEN: Loaded 53833 existing records from primary storage. [2025-09-29T01:58:30.707678] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:58:30.703321] [INFO ] [MAIN ] BEN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:30.708278] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2024-12. [2025-09-29T01:58:30.661807] [DEBUG] [LOCAL ] BEP: Loaded 39244 existing records from primary storage. [2025-09-29T01:58:30.708834] [INFO ] [MAIN ] Update Progress: 246/2371 symbols completed. BEN took 1.1s. Estimated remaining: 9m 58s. Rate: 213.2 symbols/min [2025-09-29T01:58:30.720296] [INFO ] [MAIN ] BEP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:30.758859] [INFO ] [MAIN ] Update Progress: 247/2371 symbols completed. BEP took 1.1s. Estimated remaining: 9m 56s. Rate: 213.9 symbols/min [2025-09-29T01:58:30.898695] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:31.097783] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:31.112576] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-29T01:58:31.144967] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-09-29T01:58:31.179526] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:31.184577] [DEBUG] [LOCAL ] BEPH: Loaded 5208 existing records from primary storage. [2025-09-29T01:58:31.184985] [INFO ] [MAIN ] BEPH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:31.185620] [INFO ] [MAIN ] Update Progress: 248/2371 symbols completed. BEPH took 0.5s. Estimated remaining: 9m 57s. Rate: 213.5 symbols/min [2025-09-29T01:58:31.270578] [DEBUG] [LOCAL ] BEPI: Loaded 3487 existing records from primary storage. [2025-09-29T01:58:31.319596] [INFO ] [MAIN ] BEPI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:31.343869] [INFO ] [MAIN ] Update Progress: 249/2371 symbols completed. BEPI took 0.5s. Estimated remaining: 9m 55s. Rate: 213.9 symbols/min [2025-09-29T01:58:31.346272] [DEBUG] [LOCAL ] BEPC: Loaded 47209 existing records from primary storage. [2025-09-29T01:58:31.415417] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-09-29T01:58:31.439471] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-09-29T01:58:31.397206] [INFO ] [MAIN ] BEPC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:31.495352] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:31.500939] [INFO ] [MAIN ] Update Progress: 250/2371 symbols completed. BEPC took 1.0s. Estimated remaining: 9m 54s. Rate: 214.2 symbols/min [2025-09-29T01:58:31.619670] [DEBUG] [LOCAL ] BEPJ: Loaded 3268 existing records from primary storage. [2025-09-29T01:58:31.704136] [INFO ] [MAIN ] BEPJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:31.714129] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:31.727313] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-09-29T01:58:31.725085] [INFO ] [MAIN ] Update Progress: 251/2371 symbols completed. BEPJ took 0.5s. Estimated remaining: 9m 53s. Rate: 214.4 symbols/min [2025-09-29T01:58:31.747004] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-09-29T01:58:31.936782] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:32.045309] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:32.057851] [DEBUG] [LOCAL ] BFAM: Loaded 33519 existing records from primary storage. [2025-09-29T01:58:32.058851] [INFO ] [MAIN ] BFAM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:32.058960] [INFO ] [MAIN ] Update Progress: 252/2371 symbols completed. BFAM took 0.7s. Estimated remaining: 9m 53s. Rate: 214.2 symbols/min [2025-09-29T01:58:32.101472] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-29T01:58:32.138869] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-09-29T01:58:32.254740] [DEBUG] [LOCAL ] BFK: Loaded 14145 existing records from primary storage. [2025-09-29T01:58:32.268372] [INFO ] [MAIN ] BFK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:32.292334] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:32.307369] [INFO ] [MAIN ] Update Progress: 253/2371 symbols completed. BFK took 0.6s. Estimated remaining: 9m 53s. Rate: 214.3 symbols/min [2025-09-29T01:58:32.334764] [DEBUG] [LOCAL ] BFH: Loaded 42308 existing records from primary storage. [2025-09-29T01:58:32.372612] [INFO ] [MAIN ] BFH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:32.395788] [INFO ] [MAIN ] Update Progress: 254/2371 symbols completed. BFH took 0.9s. Estimated remaining: 9m 51s. Rate: 214.9 symbols/min [2025-09-29T01:58:32.579394] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-29T01:58:32.622575] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:32.624483] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-09-29T01:58:32.679449] [DEBUG] [LOCAL ] BFLY: Loaded 52590 existing records from primary storage. [2025-09-29T01:58:32.704310] [INFO ] [MAIN ] BFLY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:32.750873] [INFO ] [MAIN ] Update Progress: 255/2371 symbols completed. BFLY took 0.7s. Estimated remaining: 9m 51s. Rate: 214.7 symbols/min [2025-09-29T01:58:32.774138] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:32.767700] [DEBUG] [LOCAL ] BFS: Loaded 9240 existing records from primary storage. [2025-09-29T01:58:32.819681] [INFO ] [MAIN ] BFS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:32.825071] [INFO ] [MAIN ] Update Progress: 256/2371 symbols completed. BFS took 0.5s. Estimated remaining: 9m 49s. Rate: 215.3 symbols/min [2025-09-29T01:58:32.901631] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-09-29T01:58:32.949422] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-09-29T01:58:33.077069] [DEBUG] [LOCAL ] BFZ: Loaded 12223 existing records from primary storage. [2025-09-29T01:58:33.099141] [INFO ] [MAIN ] BFZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:33.104450] [INFO ] [MAIN ] Update Progress: 257/2371 symbols completed. BFZ took 0.7s. Estimated remaining: 9m 49s. Rate: 215.3 symbols/min [2025-09-29T01:58:33.294082] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-29T01:58:33.312414] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-09-29T01:58:33.310340] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:33.348205] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:33.448860] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:33.459451] [DEBUG] [LOCAL ] BGB: Loaded 17621 existing records from primary storage. [2025-09-29T01:58:33.460018] [INFO ] [MAIN ] BGB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:33.460455] [INFO ] [MAIN ] Update Progress: 258/2371 symbols completed. BGB took 0.6s. Estimated remaining: 9m 49s. Rate: 215.1 symbols/min [2025-09-29T01:58:33.557025] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-09-29T01:58:33.607444] [DEBUG] [LOCAL ] BGH: Loaded 16728 existing records from primary storage. [2025-09-29T01:58:33.600951] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-09-29T01:58:33.620556] [INFO ] [MAIN ] BGH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:33.665513] [INFO ] [MAIN ] Update Progress: 259/2371 symbols completed. BGH took 0.5s. Estimated remaining: 9m 49s. Rate: 215.3 symbols/min [2025-09-29T01:58:33.702853] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:33.822365] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-09-29T01:58:33.804118] [DEBUG] [LOCAL ] BG: Loaded 51118 existing records from primary storage. [2025-09-29T01:58:33.837994] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-09-29T01:58:33.869863] [INFO ] [MAIN ] BG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:33.893404] [INFO ] [MAIN ] Update Progress: 260/2371 symbols completed. BG took 1.1s. Estimated remaining: 9m 48s. Rate: 215.4 symbols/min [2025-09-29T01:58:33.932000] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:33.967090] [DEBUG] [LOCAL ] BGR: Loaded 13658 existing records from primary storage. [2025-09-29T01:58:33.996582] [INFO ] [MAIN ] BGR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:34.015548] [INFO ] [MAIN ] Update Progress: 261/2371 symbols completed. BGR took 0.6s. Estimated remaining: 9m 46s. Rate: 215.9 symbols/min [2025-09-29T01:58:34.233032] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:34.238363] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-29T01:58:34.259210] [INFO ] [REMOTE ] BEDU: Full fetch complete (1429 records). [2025-09-29T01:58:34.293340] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-09-29T01:58:34.401711] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:34.402997] [DEBUG] [LOCAL ] BGSF: Loaded 7050 existing records from primary storage. [2025-09-29T01:58:34.403414] [INFO ] [MAIN ] BGSF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:34.419286] [INFO ] [MAIN ] Update Progress: 262/2371 symbols completed. BGSF took 0.5s. Estimated remaining: 9m 47s. Rate: 215.5 symbols/min [2025-09-29T01:58:34.512922] [DEBUG] [LOCAL ] BGS: Loaded 51183 existing records from primary storage. [2025-09-29T01:58:34.585338] [INFO ] [MAIN ] BGS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:34.607279] [INFO ] [MAIN ] Update Progress: 263/2371 symbols completed. BGS took 0.9s. Estimated remaining: 9m 46s. Rate: 215.8 symbols/min [2025-09-29T01:58:34.730547] [DEBUG] [LOCAL ] BGT: Loaded 16793 existing records from primary storage. [2025-09-29T01:58:34.789940] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-09-29T01:58:34.871371] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-09-29T01:58:34.871620] [INFO ] [MAIN ] BGT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:34.934845] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:34.902915] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-09-29T01:58:34.940236] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-29T01:58:34.945521] [INFO ] [MAIN ] Update Progress: 264/2371 symbols completed. BGT took 0.9s. Estimated remaining: 9m 46s. Rate: 215.6 symbols/min [2025-09-29T01:58:34.945826] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-09-29T01:58:34.968944] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-09-29T01:58:34.996048] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-09-29T01:58:35.054411] [INFO ] [MAIN ] Update Progress: 265/2371 symbols completed. BEDU took 5.9s. Estimated remaining: 9m 45s. Rate: 216.1 symbols/min [2025-09-29T01:58:35.147159] [DEBUG] [LOCAL ] BGX: Loaded 10900 existing records from primary storage. [2025-09-29T01:58:35.200558] [INFO ] [MAIN ] BGX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:35.237764] [INFO ] [MAIN ] Update Progress: 266/2371 symbols completed. BGX took 0.8s. Estimated remaining: 9m 44s. Rate: 216.4 symbols/min [2025-09-29T01:58:35.217097] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:35.396972] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:35.586605] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:35.585016] [DEBUG] [LOCAL ] BGY: Loaded 22790 existing records from primary storage. [2025-09-29T01:58:35.642061] [INFO ] [MAIN ] BGY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:35.666449] [INFO ] [MAIN ] Update Progress: 267/2371 symbols completed. BGY took 1.0s. Estimated remaining: 9m 45s. Rate: 216.0 symbols/min [2025-09-29T01:58:35.661305] [DEBUG] [LOCAL ] BH: Loaded 15938 existing records from primary storage. [2025-09-29T01:58:35.667287] [INFO ] [MAIN ] BH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:35.665794] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:35.679470] [INFO ] [MAIN ] Update Progress: 268/2371 symbols completed. BH took 0.7s. Estimated remaining: 9m 42s. Rate: 216.7 symbols/min [2025-09-29T01:58:36.073396] [DEBUG] [LOCAL ] BHE: Loaded 25353 existing records from primary storage. [2025-09-29T01:58:36.103169] [DEBUG] [LOCAL ] BHC: Loaded 47495 existing records from primary storage. [2025-09-29T01:58:36.129994] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:36.130612] [INFO ] [MAIN ] BHE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:36.131142] [INFO ] [MAIN ] BHC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:36.124900] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:36.131997] [INFO ] [MAIN ] Update Progress: 269/2371 symbols completed. BHE took 0.9s. Estimated remaining: 9m 43s. Rate: 216.2 symbols/min [2025-09-29T01:58:36.138678] [INFO ] [MAIN ] Update Progress: 270/2371 symbols completed. BHC took 1.1s. Estimated remaining: 9m 41s. Rate: 217.0 symbols/min [2025-09-29T01:58:36.523191] [DEBUG] [LOCAL ] BHK: Loaded 22922 existing records from primary storage. [2025-09-29T01:58:36.568988] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:36.554109] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:36.569370] [INFO ] [MAIN ] BHK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:36.570072] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-09-29T01:58:36.570221] [INFO ] [MAIN ] Update Progress: 271/2371 symbols completed. BHK took 0.9s. Estimated remaining: 9m 42s. Rate: 216.5 symbols/min [2025-09-29T01:58:36.570421] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-09-29T01:58:36.576436] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-09-29T01:58:36.585621] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-29T01:58:36.596117] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-09-29T01:58:36.624116] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-09-29T01:58:36.644591] [DEBUG] [LOCAL ] BHP: Loaded 54153 existing records from primary storage. [2025-09-29T01:58:36.726020] [INFO ] [MAIN ] BHP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:36.788023] [INFO ] [MAIN ] Update Progress: 272/2371 symbols completed. BHP took 1.1s. Estimated remaining: 9m 41s. Rate: 216.7 symbols/min [2025-09-29T01:58:36.879756] [DEBUG] [LOCAL ] BHR: Loaded 21771 existing records from primary storage. [2025-09-29T01:58:37.009089] [INFO ] [MAIN ] BHR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:37.087919] [INFO ] [MAIN ] Update Progress: 273/2371 symbols completed. BHR took 1.0s. Estimated remaining: 9m 41s. Rate: 216.7 symbols/min [2025-09-29T01:58:37.124757] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:37.448985] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:37.621869] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:37.657794] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:58:37.658799] [INFO ] [REMOTE ] BHV: Fetching primary data for 2024-12. [2025-09-29T01:58:37.687066] [DEBUG] [LOCAL ] BHVN: Loaded 50401 existing records from primary storage. [2025-09-29T01:58:37.687902] [INFO ] [MAIN ] BHVN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:37.688688] [INFO ] [MAIN ] Update Progress: 274/2371 symbols completed. BHVN took 1.1s. Estimated remaining: 9m 43s. Rate: 215.7 symbols/min [2025-09-29T01:58:37.880235] [DEBUG] [LOCAL ] BIO: Loaded 25533 existing records from primary storage. [2025-09-29T01:58:37.913246] [DEBUG] [LOCAL ] BILL: Loaded 53105 existing records from primary storage. [2025-09-29T01:58:37.903012] [INFO ] [MAIN ] BIO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:37.916469] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2024-12 (0.26 seconds). [2025-09-29T01:58:37.939236] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:37.942130] [INFO ] [MAIN ] Update Progress: 275/2371 symbols completed. BIO took 0.8s. Estimated remaining: 9m 43s. Rate: 215.8 symbols/min [2025-09-29T01:58:37.941265] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-09-29T01:58:37.941583] [INFO ] [MAIN ] BILL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:37.957089] [INFO ] [MAIN ] Update Progress: 276/2371 symbols completed. BILL took 1.1s. Estimated remaining: 9m 40s. Rate: 216.5 symbols/min [2025-09-29T01:58:38.200520] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-09-29T01:58:38.234302] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-09-29T01:58:38.327004] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:38.359844] [DEBUG] [LOCAL ] BIP: Loaded 40240 existing records from primary storage. [2025-09-29T01:58:38.379407] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:38.380245] [INFO ] [MAIN ] BIP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:38.380740] [INFO ] [MAIN ] Update Progress: 277/2371 symbols completed. BIP took 0.7s. Estimated remaining: 9m 41s. Rate: 216.1 symbols/min [2025-09-29T01:58:38.385531] [DEBUG] [LOCAL ] BIPH: Loaded 2632 existing records from primary storage. [2025-09-29T01:58:38.386127] [INFO ] [MAIN ] BIPH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:38.386230] [INFO ] [MAIN ] Update Progress: 278/2371 symbols completed. BIPH took 0.4s. Estimated remaining: 9m 39s. Rate: 216.9 symbols/min [2025-09-29T01:58:38.429147] [DEBUG] [LOCAL ] BIPC: Loaded 42317 existing records from primary storage. [2025-09-29T01:58:38.429545] [INFO ] [MAIN ] BIPC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:38.429677] [INFO ] [MAIN ] Update Progress: 279/2371 symbols completed. BIPC took 0.5s. Estimated remaining: 9m 37s. Rate: 217.6 symbols/min [2025-09-29T01:58:38.523098] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-09-29T01:58:38.524161] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-09-29T01:58:38.721463] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.20 seconds). [2025-09-29T01:58:38.722532] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-09-29T01:58:38.916981] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.19 seconds). [2025-09-29T01:58:38.918105] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-09-29T01:58:39.183746] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-09-29T01:58:39.185069] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-09-29T01:58:39.383070] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.20 seconds). [2025-09-29T01:58:39.384104] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-09-29T01:58:39.591780] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.21 seconds). [2025-09-29T01:58:39.592924] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-09-29T01:58:39.795295] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.20 seconds). [2025-09-29T01:58:39.796535] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-09-29T01:58:40.068843] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-09-29T01:58:40.070030] [INFO ] [REMOTE ] BHV: Full fetch complete (1368 records). [2025-09-29T01:58:40.070128] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-09-29T01:58:40.287318] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-29T01:58:40.287529] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-09-29T01:58:40.287622] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-09-29T01:58:40.287749] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-29T01:58:40.287894] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-09-29T01:58:40.287972] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-09-29T01:58:40.288093] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-09-29T01:58:40.288197] [INFO ] [MAIN ] Update Progress: 280/2371 symbols completed. BHV took 4.1s. Estimated remaining: 9m 49s. Rate: 213.2 symbols/min [2025-09-29T01:58:41.009148] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:41.083618] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:41.126309] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:41.132130] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:41.140486] [DEBUG] [LOCAL ] BIPJ: Loaded 3026 existing records from primary storage. [2025-09-29T01:58:41.141335] [INFO ] [MAIN ] BIPJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:41.143073] [INFO ] [MAIN ] Update Progress: 281/2371 symbols completed. BIPJ took 0.9s. Estimated remaining: 9m 52s. Rate: 211.6 symbols/min [2025-09-29T01:58:41.188593] [DEBUG] [LOCAL ] BIPI: Loaded 3282 existing records from primary storage. [2025-09-29T01:58:41.214007] [INFO ] [MAIN ] BIPI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:41.229962] [INFO ] [MAIN ] Update Progress: 282/2371 symbols completed. BIPI took 0.9s. Estimated remaining: 9m 51s. Rate: 212.2 symbols/min [2025-09-29T01:58:41.370157] [DEBUG] [LOCAL ] BIT: Loaded 22765 existing records from primary storage. [2025-09-29T01:58:41.440088] [INFO ] [MAIN ] BIT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:41.466915] [INFO ] [MAIN ] Update Progress: 283/2371 symbols completed. BIT took 1.2s. Estimated remaining: 9m 50s. Rate: 212.3 symbols/min [2025-09-29T01:58:41.497418] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:41.664449] [DEBUG] [LOCAL ] BIRK: Loaded 51674 existing records from primary storage. [2025-09-29T01:58:41.730454] [INFO ] [MAIN ] BIRK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:41.777813] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:41.801331] [INFO ] [MAIN ] Update Progress: 284/2371 symbols completed. BIRK took 1.5s. Estimated remaining: 9m 50s. Rate: 212.2 symbols/min [2025-09-29T01:58:41.901855] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:42.049516] [DEBUG] [LOCAL ] BJ: Loaded 52156 existing records from primary storage. [2025-09-29T01:58:42.083745] [INFO ] [MAIN ] BJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:42.084340] [INFO ] [MAIN ] Update Progress: 285/2371 symbols completed. BJ took 0.9s. Estimated remaining: 9m 50s. Rate: 212.2 symbols/min [2025-09-29T01:58:42.180971] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:42.276534] [DEBUG] [LOCAL ] BK: Loaded 54319 existing records from primary storage. [2025-09-29T01:58:42.300609] [DEBUG] [LOCAL ] BKD: Loaded 50889 existing records from primary storage. [2025-09-29T01:58:42.301764] [INFO ] [MAIN ] BK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:42.318170] [INFO ] [MAIN ] Update Progress: 286/2371 symbols completed. BK took 1.0s. Estimated remaining: 9m 49s. Rate: 212.3 symbols/min [2025-09-29T01:58:42.301885] [INFO ] [MAIN ] BKD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:42.319061] [INFO ] [MAIN ] Update Progress: 287/2371 symbols completed. BKD took 0.8s. Estimated remaining: 9m 47s. Rate: 213.0 symbols/min [2025-09-29T01:58:42.511697] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:42.638104] [DEBUG] [LOCAL ] BKE: Loaded 35206 existing records from primary storage. [2025-09-29T01:58:42.679460] [INFO ] [MAIN ] BKE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:42.704694] [INFO ] [MAIN ] Update Progress: 288/2371 symbols completed. BKE took 0.9s. Estimated remaining: 9m 47s. Rate: 212.8 symbols/min [2025-09-29T01:58:42.846383] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:42.873175] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:42.987888] [DEBUG] [LOCAL ] BKN: Loaded 7853 existing records from primary storage. [2025-09-29T01:58:43.037893] [INFO ] [MAIN ] BKN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:43.065217] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:43.067295] [DEBUG] [LOCAL ] BKH: Loaded 37133 existing records from primary storage. [2025-09-29T01:58:43.067819] [INFO ] [MAIN ] Update Progress: 289/2371 symbols completed. BKN took 0.7s. Estimated remaining: 9m 48s. Rate: 212.5 symbols/min [2025-09-29T01:58:43.074174] [INFO ] [MAIN ] BKH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:43.080394] [INFO ] [MAIN ] Update Progress: 290/2371 symbols completed. BKH took 1.0s. Estimated remaining: 9m 46s. Rate: 213.2 symbols/min [2025-09-29T01:58:43.210991] [DEBUG] [LOCAL ] BKKT: Loaded 35164 existing records from primary storage. [2025-09-29T01:58:43.267016] [INFO ] [MAIN ] BKKT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:43.308523] [INFO ] [MAIN ] Update Progress: 291/2371 symbols completed. BKKT took 1.0s. Estimated remaining: 9m 45s. Rate: 213.4 symbols/min [2025-09-29T01:58:43.562105] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:43.590775] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:43.624377] [DEBUG] [LOCAL ] BKSY: Loaded 48993 existing records from primary storage. [2025-09-29T01:58:43.683463] [INFO ] [MAIN ] BKSY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:43.704714] [INFO ] [MAIN ] Update Progress: 292/2371 symbols completed. BKSY took 1.0s. Estimated remaining: 9m 45s. Rate: 213.1 symbols/min [2025-09-29T01:58:43.710969] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:43.749145] [DEBUG] [LOCAL ] BKT: Loaded 11125 existing records from primary storage. [2025-09-29T01:58:43.814161] [INFO ] [MAIN ] BKT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:43.837621] [INFO ] [MAIN ] Update Progress: 293/2371 symbols completed. BKT took 0.8s. Estimated remaining: 9m 44s. Rate: 213.5 symbols/min [2025-09-29T01:58:43.993551] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:44.026743] [DEBUG] [LOCAL ] BKU: Loaded 42412 existing records from primary storage. [2025-09-29T01:58:44.065793] [INFO ] [MAIN ] BKU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:44.067214] [DEBUG] [LOCAL ] BKV: Loaded 30278 existing records from primary storage. [2025-09-29T01:58:44.066425] [INFO ] [MAIN ] Update Progress: 294/2371 symbols completed. BKU took 1.0s. Estimated remaining: 9m 43s. Rate: 213.6 symbols/min [2025-09-29T01:58:44.084566] [INFO ] [MAIN ] BKV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:44.123606] [INFO ] [MAIN ] Update Progress: 295/2371 symbols completed. BKV took 0.8s. Estimated remaining: 9m 42s. Rate: 214.2 symbols/min [2025-09-29T01:58:44.217730] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:44.384749] [DEBUG] [LOCAL ] BLCO: Loaded 36110 existing records from primary storage. [2025-09-29T01:58:44.435549] [INFO ] [MAIN ] BLCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:44.538532] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:44.539501] [INFO ] [MAIN ] Update Progress: 296/2371 symbols completed. BLCO took 0.8s. Estimated remaining: 9m 42s. Rate: 213.8 symbols/min [2025-09-29T01:58:44.574380] [DEBUG] [LOCAL ] BLD: Loaded 28408 existing records from primary storage. [2025-09-29T01:58:44.608475] [INFO ] [MAIN ] BLD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:44.619406] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:44.619689] [INFO ] [MAIN ] Update Progress: 297/2371 symbols completed. BLD took 0.8s. Estimated remaining: 9m 41s. Rate: 214.3 symbols/min [2025-09-29T01:58:44.838387] [DEBUG] [LOCAL ] BLE: Loaded 14718 existing records from primary storage. [2025-09-29T01:58:44.854900] [INFO ] [MAIN ] BLE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:44.910499] [INFO ] [MAIN ] Update Progress: 298/2371 symbols completed. BLE took 0.8s. Estimated remaining: 9m 40s. Rate: 214.3 symbols/min [2025-09-29T01:58:44.962501] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:45.148091] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:45.149899] [DEBUG] [LOCAL ] BLDR: Loaded 52403 existing records from primary storage. [2025-09-29T01:58:45.168422] [INFO ] [MAIN ] BLDR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:45.169144] [INFO ] [MAIN ] Update Progress: 299/2371 symbols completed. BLDR took 1.1s. Estimated remaining: 9m 40s. Rate: 214.4 symbols/min [2025-09-29T01:58:45.350426] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:45.381613] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-09-29T01:58:45.392884] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-09-29T01:58:45.393162] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-09-29T01:58:45.437023] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-09-29T01:58:45.410238] [DEBUG] [LOCAL ] BLK: Loaded 35240 existing records from primary storage. [2025-09-29T01:58:45.473217] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-09-29T01:58:45.476083] [INFO ] [MAIN ] BLK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:45.490173] [INFO ] [MAIN ] Update Progress: 300/2371 symbols completed. BLK took 0.9s. Estimated remaining: 9m 40s. Rate: 214.3 symbols/min [2025-09-29T01:58:45.489843] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:45.490302] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-09-29T01:58:45.700754] [DEBUG] [LOCAL ] BLND: Loaded 50107 existing records from primary storage. [2025-09-29T01:58:45.732089] [DEBUG] [LOCAL ] BLW: Loaded 13044 existing records from primary storage. [2025-09-29T01:58:45.756697] [INFO ] [MAIN ] BLW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:45.751333] [INFO ] [MAIN ] BLND: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:45.762131] [INFO ] [MAIN ] Update Progress: 301/2371 symbols completed. BLW took 0.6s. Estimated remaining: 9m 40s. Rate: 214.3 symbols/min [2025-09-29T01:58:45.783618] [INFO ] [MAIN ] Update Progress: 302/2371 symbols completed. BLND took 1.1s. Estimated remaining: 9m 38s. Rate: 214.9 symbols/min [2025-09-29T01:58:46.025687] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:46.349736] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:46.539439] [DEBUG] [LOCAL ] BLX: Loaded 15880 existing records from primary storage. [2025-09-29T01:58:46.565926] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:58:46.561666] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:46.567474] [INFO ] [MAIN ] BLX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:46.567635] [INFO ] [MAIN ] Update Progress: 303/2371 symbols completed. BLX took 1.1s. Estimated remaining: 9m 41s. Rate: 213.7 symbols/min [2025-09-29T01:58:46.567231] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2024-12. [2025-09-29T01:58:46.712913] [DEBUG] [LOCAL ] BME: Loaded 10968 existing records from primary storage. [2025-09-29T01:58:46.733695] [INFO ] [MAIN ] BME: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:46.745356] [DEBUG] [LOCAL ] BMA: Loaded 35645 existing records from primary storage. [2025-09-29T01:58:46.756843] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:58:46.745528] [INFO ] [MAIN ] Update Progress: 304/2371 symbols completed. BME took 0.9s. Estimated remaining: 9m 40s. Rate: 213.9 symbols/min [2025-09-29T01:58:46.756045] [INFO ] [MAIN ] BMA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:46.805604] [WARN ] [REMOTE ] BLSH: No data returned for month 2024-12 [2025-09-29T01:58:46.815023] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:46.821279] [FATAL] [REMOTE ] BLSH: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:58:46.832504] [FATAL] [MAIN ] BLSH: Failed to fetch primary data. [2025-09-29T01:58:46.832977] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:58:46.832625] [INFO ] [MAIN ] Update Progress: 305/2371 symbols completed. BMA took 1.1s. Estimated remaining: 9m 38s. Rate: 214.4 symbols/min [2025-09-29T01:58:46.844053] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-09-29T01:58:46.920086] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-09-29T01:58:47.029384] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-09-29T01:58:47.137755] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:47.138243] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-09-29T01:58:47.171051] [INFO ] [MAIN ] Update Progress: 306/2371 symbols completed. BLSH took 2.2s. Estimated remaining: 9m 38s. Rate: 214.3 symbols/min [2025-09-29T01:58:47.171784] [DEBUG] [LOCAL ] BMEZ: Loaded 26421 existing records from primary storage. [2025-09-29T01:58:47.213912] [INFO ] [MAIN ] BMEZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:47.255802] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:47.266874] [INFO ] [MAIN ] Update Progress: 307/2371 symbols completed. BMEZ took 0.7s. Estimated remaining: 9m 37s. Rate: 214.7 symbols/min [2025-09-29T01:58:47.452982] [DEBUG] [LOCAL ] BMN: Loaded 2548 existing records from primary storage. [2025-09-29T01:58:47.478241] [INFO ] [MAIN ] BMN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:47.484092] [INFO ] [MAIN ] Update Progress: 308/2371 symbols completed. BMN took 0.6s. Estimated remaining: 9m 36s. Rate: 214.9 symbols/min [2025-09-29T01:58:47.490468] [DEBUG] [LOCAL ] BMI: Loaded 24611 existing records from primary storage. [2025-09-29T01:58:47.559764] [INFO ] [MAIN ] BMI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:47.672503] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:47.626936] [INFO ] [MAIN ] Update Progress: 309/2371 symbols completed. BMI took 0.8s. Estimated remaining: 9m 35s. Rate: 215.2 symbols/min [2025-09-29T01:58:47.779221] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:47.974378] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:48.069310] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:48.102814] [DEBUG] [LOCAL ] BMO: Loaded 41940 existing records from primary storage. [2025-09-29T01:58:48.103408] [INFO ] [MAIN ] BMO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:48.104612] [INFO ] [MAIN ] Update Progress: 310/2371 symbols completed. BMO took 0.9s. Estimated remaining: 9m 36s. Rate: 214.7 symbols/min [2025-09-29T01:58:48.260373] [DEBUG] [LOCAL ] BMY: Loaded 54537 existing records from primary storage. [2025-09-29T01:58:48.287687] [INFO ] [MAIN ] BMY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:48.319285] [INFO ] [MAIN ] Update Progress: 311/2371 symbols completed. BMY took 1.1s. Estimated remaining: 9m 35s. Rate: 214.9 symbols/min [2025-09-29T01:58:48.423678] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:48.420080] [DEBUG] [LOCAL ] BNED: Loaded 30226 existing records from primary storage. [2025-09-29T01:58:48.495360] [INFO ] [MAIN ] BNED: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:48.501871] [DEBUG] [LOCAL ] BN: Loaded 53774 existing records from primary storage. [2025-09-29T01:58:48.527514] [INFO ] [MAIN ] BN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:48.525122] [INFO ] [MAIN ] Update Progress: 312/2371 symbols completed. BNED took 0.8s. Estimated remaining: 9m 34s. Rate: 215.1 symbols/min [2025-09-29T01:58:48.580633] [DEBUG] [LOCAL ] BNH: Loaded 4926 existing records from primary storage. [2025-09-29T01:58:48.615842] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:48.613943] [INFO ] [MAIN ] Update Progress: 313/2371 symbols completed. BN took 1.0s. Estimated remaining: 9m 33s. Rate: 215.5 symbols/min [2025-09-29T01:58:48.648896] [INFO ] [MAIN ] BNH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:48.703800] [INFO ] [MAIN ] Update Progress: 314/2371 symbols completed. BNH took 0.6s. Estimated remaining: 9m 31s. Rate: 216.0 symbols/min [2025-09-29T01:58:48.794308] [DEBUG] [LOCAL ] BNJ: Loaded 2631 existing records from primary storage. [2025-09-29T01:58:48.840729] [INFO ] [MAIN ] BNJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:48.873088] [INFO ] [MAIN ] Update Progress: 315/2371 symbols completed. BNJ took 0.5s. Estimated remaining: 9m 30s. Rate: 216.3 symbols/min [2025-09-29T01:58:49.210573] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:49.267026] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:49.355600] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:49.475426] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:49.479050] [DEBUG] [LOCAL ] BNT: Loaded 3473 existing records from primary storage. [2025-09-29T01:58:49.480962] [INFO ] [MAIN ] BNT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:49.481107] [INFO ] [MAIN ] Update Progress: 316/2371 symbols completed. BNT took 0.7s. Estimated remaining: 9m 32s. Rate: 215.5 symbols/min [2025-09-29T01:58:49.630470] [DEBUG] [LOCAL ] BNY: Loaded 7446 existing records from primary storage. [2025-09-29T01:58:49.647261] [INFO ] [MAIN ] BNY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:49.715200] [INFO ] [MAIN ] Update Progress: 317/2371 symbols completed. BNY took 0.8s. Estimated remaining: 9m 32s. Rate: 215.6 symbols/min [2025-09-29T01:58:49.714343] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:49.748806] [DEBUG] [LOCAL ] BNL: Loaded 47577 existing records from primary storage. [2025-09-29T01:58:49.747505] [DEBUG] [LOCAL ] BNS: Loaded 52212 existing records from primary storage. [2025-09-29T01:58:49.749351] [INFO ] [MAIN ] BNS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:49.749492] [INFO ] [MAIN ] BNL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:49.750053] [INFO ] [MAIN ] Update Progress: 318/2371 symbols completed. BNS took 1.1s. Estimated remaining: 9m 30s. Rate: 216.2 symbols/min [2025-09-29T01:58:49.750801] [INFO ] [MAIN ] Update Progress: 319/2371 symbols completed. BNL took 1.1s. Estimated remaining: 9m 28s. Rate: 216.8 symbols/min [2025-09-29T01:58:49.768459] [DEBUG] [LOCAL ] BOC: Loaded 18626 existing records from primary storage. [2025-09-29T01:58:49.768764] [INFO ] [MAIN ] BOC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:49.768864] [INFO ] [MAIN ] Update Progress: 320/2371 symbols completed. BOC took 0.3s. Estimated remaining: 9m 26s. Rate: 217.5 symbols/min [2025-09-29T01:58:50.331106] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:50.426528] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:50.536839] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:50.562792] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:50.601728] [DEBUG] [LOCAL ] BOE: Loaded 17816 existing records from primary storage. [2025-09-29T01:58:50.630468] [DEBUG] [LOCAL ] BOND: Loaded 32554 existing records from primary storage. [2025-09-29T01:58:50.631118] [INFO ] [MAIN ] BOND: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:50.631242] [INFO ] [MAIN ] Update Progress: 321/2371 symbols completed. BOND took 0.9s. Estimated remaining: 9m 29s. Rate: 216.0 symbols/min [2025-09-29T01:58:50.631393] [INFO ] [MAIN ] BOE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:50.637108] [INFO ] [MAIN ] Update Progress: 322/2371 symbols completed. BOE took 0.9s. Estimated remaining: 9m 27s. Rate: 216.7 symbols/min [2025-09-29T01:58:50.843730] [DEBUG] [LOCAL ] BOOT: Loaded 41409 existing records from primary storage. [2025-09-29T01:58:50.912952] [DEBUG] [LOCAL ] BOH: Loaded 31676 existing records from primary storage. [2025-09-29T01:58:50.929363] [INFO ] [MAIN ] BOH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:50.929559] [INFO ] [MAIN ] Update Progress: 323/2371 symbols completed. BOH took 1.2s. Estimated remaining: 9m 27s. Rate: 216.7 symbols/min [2025-09-29T01:58:50.942554] [INFO ] [MAIN ] BOOT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:50.991256] [INFO ] [MAIN ] Update Progress: 324/2371 symbols completed. BOOT took 1.2s. Estimated remaining: 9m 26s. Rate: 217.2 symbols/min [2025-09-29T01:58:51.061155] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:51.229589] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:51.426344] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:51.455934] [DEBUG] [LOCAL ] BOW: Loaded 23974 existing records from primary storage. [2025-09-29T01:58:51.500266] [INFO ] [MAIN ] BOW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:51.515964] [INFO ] [MAIN ] Update Progress: 325/2371 symbols completed. BOW took 0.9s. Estimated remaining: 9m 27s. Rate: 216.6 symbols/min [2025-09-29T01:58:51.550713] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:51.639618] [DEBUG] [LOCAL ] BORR: Loaded 51902 existing records from primary storage. [2025-09-29T01:58:51.661299] [INFO ] [MAIN ] BORR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:51.673129] [INFO ] [MAIN ] Update Progress: 326/2371 symbols completed. BORR took 1.0s. Estimated remaining: 9m 26s. Rate: 216.9 symbols/min [2025-09-29T01:58:51.926471] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:51.942848] [DEBUG] [LOCAL ] BOX: Loaded 51017 existing records from primary storage. [2025-09-29T01:58:51.955225] [INFO ] [MAIN ] BOX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:52.004320] [INFO ] [MAIN ] Update Progress: 327/2371 symbols completed. BOX took 1.1s. Estimated remaining: 9m 26s. Rate: 216.7 symbols/min [2025-09-29T01:58:52.034871] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:52.088019] [DEBUG] [LOCAL ] BP: Loaded 54491 existing records from primary storage. [2025-09-29T01:58:52.120138] [INFO ] [MAIN ] BP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:52.120775] [INFO ] [MAIN ] Update Progress: 328/2371 symbols completed. BP took 1.1s. Estimated remaining: 9m 25s. Rate: 217.1 symbols/min [2025-09-29T01:58:52.398125] [DEBUG] [LOCAL ] BR: Loaded 35251 existing records from primary storage. [2025-09-29T01:58:52.400185] [INFO ] [MAIN ] BR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:52.406041] [INFO ] [MAIN ] Update Progress: 329/2371 symbols completed. BR took 0.9s. Estimated remaining: 9m 24s. Rate: 217.1 symbols/min [2025-09-29T01:58:52.400001] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:52.579110] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:52.614553] [DEBUG] [LOCAL ] BRBR: Loaded 51987 existing records from primary storage. [2025-09-29T01:58:52.632384] [INFO ] [MAIN ] BRBR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:52.680072] [INFO ] [MAIN ] Update Progress: 330/2371 symbols completed. BRBR took 1.0s. Estimated remaining: 9m 24s. Rate: 217.1 symbols/min [2025-09-29T01:58:52.702474] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:52.783830] [DEBUG] [LOCAL ] BRC: Loaded 19567 existing records from primary storage. [2025-09-29T01:58:52.836341] [INFO ] [MAIN ] BRC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:52.867119] [INFO ] [MAIN ] Update Progress: 331/2371 symbols completed. BRC took 0.8s. Estimated remaining: 9m 23s. Rate: 217.3 symbols/min [2025-09-29T01:58:52.932620] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:52.946775] [DEBUG] [LOCAL ] BRCC: Loaded 40896 existing records from primary storage. [2025-09-29T01:58:52.978499] [INFO ] [MAIN ] BRCC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:52.995124] [INFO ] [MAIN ] Update Progress: 332/2371 symbols completed. BRCC took 0.8s. Estimated remaining: 9m 22s. Rate: 217.7 symbols/min [2025-09-29T01:58:53.215464] [DEBUG] [LOCAL ] BRO: Loaded 52664 existing records from primary storage. [2025-09-29T01:58:53.268593] [INFO ] [MAIN ] BRO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:53.387012] [INFO ] [MAIN ] Update Progress: 333/2371 symbols completed. BRO took 1.0s. Estimated remaining: 9m 22s. Rate: 217.4 symbols/min [2025-09-29T01:58:53.436879] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:53.459221] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:53.460935] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-09-29T01:58:53.515007] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-09-29T01:58:53.515680] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-09-29T01:58:53.515790] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-09-29T01:58:53.515879] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-09-29T01:58:53.522936] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-09-29T01:58:53.584160] [DEBUG] [LOCAL ] BROS: Loaded 54067 existing records from primary storage. [2025-09-29T01:58:53.665562] [INFO ] [MAIN ] BROS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:53.783399] [INFO ] [MAIN ] Update Progress: 334/2371 symbols completed. BROS took 1.1s. Estimated remaining: 9m 23s. Rate: 217.1 symbols/min [2025-09-29T01:58:53.931444] [DEBUG] [LOCAL ] BRSP: Loaded 37442 existing records from primary storage. [2025-09-29T01:58:53.932250] [INFO ] [MAIN ] BRSP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:53.932478] [INFO ] [MAIN ] Update Progress: 335/2371 symbols completed. BRSP took 0.9s. Estimated remaining: 9m 22s. Rate: 217.4 symbols/min [2025-09-29T01:58:54.285427] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:54.614634] [DEBUG] [LOCAL ] BRT: Loaded 5034 existing records from primary storage. [2025-09-29T01:58:54.685127] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:54.725459] [INFO ] [MAIN ] BRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:54.849691] [INFO ] [MAIN ] Update Progress: 336/2371 symbols completed. BRT took 1.4s. Estimated remaining: 9m 25s. Rate: 215.9 symbols/min [2025-09-29T01:58:54.864839] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:54.887883] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:58:54.900401] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2024-12. [2025-09-29T01:58:55.022559] [DEBUG] [LOCAL ] BRW: Loaded 19862 existing records from primary storage. [2025-09-29T01:58:55.023117] [INFO ] [MAIN ] BRW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:55.029356] [INFO ] [MAIN ] Update Progress: 337/2371 symbols completed. BRW took 1.2s. Estimated remaining: 9m 25s. Rate: 216.1 symbols/min [2025-09-29T01:58:55.089445] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:58:55.121743] [WARN ] [REMOTE ] BRSL: No data returned for month 2024-12 [2025-09-29T01:58:55.121030] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:55.144161] [FATAL] [REMOTE ] BRSL: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:58:55.191103] [FATAL] [MAIN ] BRSL: Failed to fetch primary data. [2025-09-29T01:58:55.233959] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:58:55.238451] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-09-29T01:58:55.311005] [DEBUG] [LOCAL ] BRX: Loaded 52462 existing records from primary storage. [2025-09-29T01:58:55.281099] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-09-29T01:58:55.329720] [INFO ] [MAIN ] BRX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:55.313381] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-09-29T01:58:55.334261] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:55.334781] [INFO ] [MAIN ] Update Progress: 338/2371 symbols completed. BRX took 1.4s. Estimated remaining: 9m 24s. Rate: 216.1 symbols/min [2025-09-29T01:58:55.341556] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-09-29T01:58:55.370737] [INFO ] [MAIN ] Update Progress: 339/2371 symbols completed. BRSL took 2.4s. Estimated remaining: 9m 23s. Rate: 216.6 symbols/min [2025-09-29T01:58:55.629996] [DEBUG] [LOCAL ] BSAC: Loaded 33389 existing records from primary storage. [2025-09-29T01:58:55.680869] [INFO ] [MAIN ] BSAC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:55.680496] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:55.681157] [INFO ] [MAIN ] Update Progress: 340/2371 symbols completed. BSAC took 0.8s. Estimated remaining: 9m 23s. Rate: 216.6 symbols/min [2025-09-29T01:58:55.842486] [DEBUG] [LOCAL ] BSBR: Loaded 35731 existing records from primary storage. [2025-09-29T01:58:55.879239] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:55.877330] [DEBUG] [LOCAL ] BSL: Loaded 8196 existing records from primary storage. [2025-09-29T01:58:55.884673] [INFO ] [MAIN ] BSBR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:55.895850] [INFO ] [MAIN ] Update Progress: 341/2371 symbols completed. BSBR took 0.8s. Estimated remaining: 9m 22s. Rate: 216.7 symbols/min [2025-09-29T01:58:55.911995] [INFO ] [MAIN ] BSL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:55.923123] [INFO ] [MAIN ] Update Progress: 342/2371 symbols completed. BSL took 0.6s. Estimated remaining: 9m 20s. Rate: 217.3 symbols/min [2025-09-29T01:58:56.159908] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:56.421312] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:56.396375] [DEBUG] [LOCAL ] BSM: Loaded 32809 existing records from primary storage. [2025-09-29T01:58:56.434828] [DEBUG] [LOCAL ] BST: Loaded 19385 existing records from primary storage. [2025-09-29T01:58:56.457299] [INFO ] [MAIN ] BSM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:56.456721] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:56.458221] [INFO ] [MAIN ] BST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:56.458480] [INFO ] [MAIN ] Update Progress: 343/2371 symbols completed. BSM took 1.1s. Estimated remaining: 9m 22s. Rate: 216.7 symbols/min [2025-09-29T01:58:56.459214] [INFO ] [MAIN ] Update Progress: 344/2371 symbols completed. BST took 0.8s. Estimated remaining: 9m 20s. Rate: 217.3 symbols/min [2025-09-29T01:58:56.784396] [DEBUG] [LOCAL ] BSTZ: Loaded 25188 existing records from primary storage. [2025-09-29T01:58:56.873367] [INFO ] [MAIN ] BSTZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:56.929875] [INFO ] [MAIN ] Update Progress: 345/2371 symbols completed. BSTZ took 1.0s. Estimated remaining: 9m 21s. Rate: 216.9 symbols/min [2025-09-29T01:58:56.927824] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:56.908301] [INFO ] [MAIN ] BTCM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:56.956602] [DEBUG] [LOCAL ] BSX: Loaded 54468 existing records from primary storage. [2025-09-29T01:58:57.007298] [INFO ] [MAIN ] BSX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:57.038594] [INFO ] [MAIN ] Update Progress: 346/2371 symbols completed. BSX took 1.1s. Estimated remaining: 9m 19s. Rate: 217.3 symbols/min [2025-09-29T01:58:57.088749] [DEBUG] [LOCAL ] BTA: Loaded 5464 existing records from primary storage. [2025-09-29T01:58:57.122108] [DEBUG] [LOCAL ] BTCM: Loaded 15122 existing records from primary storage. [2025-09-29T01:58:57.158680] [INFO ] [MAIN ] BTA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:57.191825] [INFO ] [MAIN ] Update Progress: 347/2371 symbols completed. BTA took 0.7s. Estimated remaining: 9m 18s. Rate: 217.5 symbols/min [2025-09-29T01:58:57.193095] [INFO ] [MAIN ] BTCM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:57.263213] [INFO ] [MAIN ] Update Progress: 348/2371 symbols completed. BTCM took 0.8s. Estimated remaining: 9m 17s. Rate: 218.0 symbols/min [2025-09-29T01:58:57.253082] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:57.730392] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:57.754516] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:57.794177] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:57.828799] [DEBUG] [LOCAL ] BTO: Loaded 8982 existing records from primary storage. [2025-09-29T01:58:57.834288] [INFO ] [MAIN ] BTO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:57.823969] [DEBUG] [LOCAL ] BTE: Loaded 53505 existing records from primary storage. [2025-09-29T01:58:57.834498] [INFO ] [MAIN ] Update Progress: 349/2371 symbols completed. BTO took 0.6s. Estimated remaining: 9m 18s. Rate: 217.3 symbols/min [2025-09-29T01:58:57.835161] [INFO ] [MAIN ] BTE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:57.858162] [INFO ] [MAIN ] Update Progress: 350/2371 symbols completed. BTE took 0.9s. Estimated remaining: 9m 16s. Rate: 217.9 symbols/min [2025-09-29T01:58:57.967739] [DEBUG] [LOCAL ] BTT: Loaded 16126 existing records from primary storage. [2025-09-29T01:58:57.995358] [INFO ] [MAIN ] BTT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:58.000789] [INFO ] [MAIN ] Update Progress: 351/2371 symbols completed. BTT took 0.7s. Estimated remaining: 9m 15s. Rate: 218.2 symbols/min [2025-09-29T01:58:58.376679] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:58.406219] [DEBUG] [LOCAL ] BTI: Loaded 54335 existing records from primary storage. [2025-09-29T01:58:58.432532] [INFO ] [MAIN ] BTI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:58.433182] [INFO ] [MAIN ] Update Progress: 352/2371 symbols completed. BTI took 1.4s. Estimated remaining: 9m 16s. Rate: 217.8 symbols/min [2025-09-29T01:58:58.398878] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:58.514433] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:58.526012] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-09-29T01:58:58.562201] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-09-29T01:58:58.584795] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-09-29T01:58:58.597012] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-09-29T01:58:58.603117] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-09-29T01:58:58.618900] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-09-29T01:58:58.718551] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:58.833018] [DEBUG] [LOCAL ] BTZ: Loaded 23002 existing records from primary storage. [2025-09-29T01:58:58.859445] [INFO ] [MAIN ] BTZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:58.886561] [INFO ] [MAIN ] Update Progress: 353/2371 symbols completed. BTZ took 0.9s. Estimated remaining: 9m 17s. Rate: 217.4 symbols/min [2025-09-29T01:58:58.908706] [DEBUG] [LOCAL ] BTU: Loaded 54082 existing records from primary storage. [2025-09-29T01:58:58.946304] [INFO ] [MAIN ] BTU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:59.002099] [INFO ] [MAIN ] Update Progress: 354/2371 symbols completed. BTU took 1.2s. Estimated remaining: 9m 16s. Rate: 217.8 symbols/min [2025-09-29T01:58:59.407337] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:58:59.556401] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:59.487270] [INFO ] [REMOTE ] BTX: Fetching primary data for 2024-12. [2025-09-29T01:58:59.579383] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:59.582023] [DEBUG] [LOCAL ] BUD: Loaded 53504 existing records from primary storage. [2025-09-29T01:58:59.583118] [INFO ] [MAIN ] BUD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:59.583803] [INFO ] [MAIN ] Update Progress: 355/2371 symbols completed. BUD took 1.1s. Estimated remaining: 9m 17s. Rate: 217.1 symbols/min [2025-09-29T01:58:59.672838] [DEBUG] [LOCAL ] BUI: Loaded 11615 existing records from primary storage. [2025-09-29T01:58:59.691967] [INFO ] [MAIN ] BUI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:58:59.703572] [INFO ] [MAIN ] Update Progress: 356/2371 symbols completed. BUI took 0.8s. Estimated remaining: 9m 16s. Rate: 217.5 symbols/min [2025-09-29T01:58:59.748049] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:58:59.797746] [WARN ] [REMOTE ] BTX: No data returned for month 2024-12 [2025-09-29T01:58:59.838777] [FATAL] [REMOTE ] BTX: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:58:59.910869] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:58:59.900935] [FATAL] [MAIN ] BTX: Failed to fetch primary data. [2025-09-29T01:58:59.956495] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:58:59.993332] [DEBUG] [LOCAL ] BUR: Loaded 45700 existing records from primary storage. [2025-09-29T01:59:00.015277] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-09-29T01:59:00.023896] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-09-29T01:59:00.028700] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-09-29T01:59:00.015935] [INFO ] [MAIN ] BUR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:00.048456] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:00.049185] [INFO ] [MAIN ] Update Progress: 357/2371 symbols completed. BUR took 1.0s. Estimated remaining: 9m 16s. Rate: 217.3 symbols/min [2025-09-29T01:59:00.049528] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-09-29T01:59:00.050133] [INFO ] [MAIN ] Update Progress: 358/2371 symbols completed. BTX took 2.2s. Estimated remaining: 9m 14s. Rate: 217.9 symbols/min [2025-09-29T01:59:00.081437] [DEBUG] [LOCAL ] BUXX: Loaded 15364 existing records from primary storage. [2025-09-29T01:59:00.081798] [INFO ] [MAIN ] BUXX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:00.082081] [INFO ] [MAIN ] Update Progress: 359/2371 symbols completed. BUXX took 0.4s. Estimated remaining: 9m 13s. Rate: 218.5 symbols/min [2025-09-29T01:59:00.103264] [DEBUG] [LOCAL ] BURL: Loaded 46896 existing records from primary storage. [2025-09-29T01:59:00.103764] [INFO ] [MAIN ] BURL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:00.104920] [INFO ] [MAIN ] Update Progress: 360/2371 symbols completed. BURL took 0.5s. Estimated remaining: 9m 11s. Rate: 219.0 symbols/min [2025-09-29T01:59:00.801202] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:00.883743] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:00.931418] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:00.933163] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:01.031051] [DEBUG] [LOCAL ] BV: Loaded 39048 existing records from primary storage. [2025-09-29T01:59:01.033310] [INFO ] [MAIN ] BV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:01.048180] [INFO ] [MAIN ] Update Progress: 361/2371 symbols completed. BV took 0.9s. Estimated remaining: 9m 14s. Rate: 217.5 symbols/min [2025-09-29T01:59:01.095878] [DEBUG] [LOCAL ] BW: Loaded 40297 existing records from primary storage. [2025-09-29T01:59:01.088881] [DEBUG] [LOCAL ] BVN: Loaded 44520 existing records from primary storage. [2025-09-29T01:59:01.101981] [INFO ] [MAIN ] BVN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:01.113044] [DEBUG] [LOCAL ] BWA: Loaded 52976 existing records from primary storage. [2025-09-29T01:59:01.102088] [INFO ] [MAIN ] BW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:01.151242] [INFO ] [MAIN ] BWA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:01.126803] [INFO ] [MAIN ] Update Progress: 362/2371 symbols completed. BVN took 1.0s. Estimated remaining: 9m 13s. Rate: 218.0 symbols/min [2025-09-29T01:59:01.189200] [INFO ] [MAIN ] Update Progress: 363/2371 symbols completed. BW took 1.1s. Estimated remaining: 9m 12s. Rate: 218.4 symbols/min [2025-09-29T01:59:01.268193] [INFO ] [MAIN ] Update Progress: 364/2371 symbols completed. BWA took 1.1s. Estimated remaining: 9m 10s. Rate: 218.9 symbols/min [2025-09-29T01:59:01.628119] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:01.862529] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:01.906193] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:01.935169] [DEBUG] [LOCAL ] BWG: Loaded 12478 existing records from primary storage. [2025-09-29T01:59:02.002116] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:02.004890] [INFO ] [MAIN ] BWG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:02.005819] [INFO ] [MAIN ] Update Progress: 365/2371 symbols completed. BWG took 0.9s. Estimated remaining: 9m 12s. Rate: 217.9 symbols/min [2025-09-29T01:59:02.024540] [DEBUG] [LOCAL ] BWMX: Loaded 7676 existing records from primary storage. [2025-09-29T01:59:02.058442] [INFO ] [MAIN ] BWMX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:02.081179] [INFO ] [MAIN ] Update Progress: 366/2371 symbols completed. BWMX took 0.9s. Estimated remaining: 9m 11s. Rate: 218.3 symbols/min [2025-09-29T01:59:02.081532] [DEBUG] [LOCAL ] BWNB: Loaded 4468 existing records from primary storage. [2025-09-29T01:59:02.128560] [INFO ] [MAIN ] BWNB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:02.213330] [INFO ] [MAIN ] Update Progress: 367/2371 symbols completed. BWNB took 0.9s. Estimated remaining: 9m 10s. Rate: 218.6 symbols/min [2025-09-29T01:59:02.396570] [DEBUG] [LOCAL ] BWLP: Loaded 33185 existing records from primary storage. [2025-09-29T01:59:02.411796] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:02.456633] [INFO ] [MAIN ] BWLP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:02.513064] [INFO ] [MAIN ] Update Progress: 368/2371 symbols completed. BWLP took 1.3s. Estimated remaining: 9m 10s. Rate: 218.5 symbols/min [2025-09-29T01:59:02.618289] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:02.671975] [DEBUG] [LOCAL ] BWSN: Loaded 5130 existing records from primary storage. [2025-09-29T01:59:02.708523] [INFO ] [MAIN ] BWSN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:02.715239] [INFO ] [MAIN ] Update Progress: 369/2371 symbols completed. BWSN took 0.7s. Estimated remaining: 9m 9s. Rate: 218.7 symbols/min [2025-09-29T01:59:03.033390] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:03.041811] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:03.191900] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:03.200468] [DEBUG] [LOCAL ] BWXT: Loaded 47442 existing records from primary storage. [2025-09-29T01:59:03.201503] [DEBUG] [LOCAL ] BXC: Loaded 13880 existing records from primary storage. [2025-09-29T01:59:03.202103] [INFO ] [MAIN ] BXC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:03.201705] [INFO ] [MAIN ] BWXT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:03.202314] [INFO ] [MAIN ] Update Progress: 370/2371 symbols completed. BXC took 0.6s. Estimated remaining: 9m 10s. Rate: 218.2 symbols/min [2025-09-29T01:59:03.208071] [INFO ] [MAIN ] Update Progress: 371/2371 symbols completed. BWXT took 1.1s. Estimated remaining: 9m 8s. Rate: 218.8 symbols/min [2025-09-29T01:59:03.578312] [DEBUG] [LOCAL ] BX: Loaded 54270 existing records from primary storage. [2025-09-29T01:59:03.604142] [INFO ] [MAIN ] BX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:03.641682] [INFO ] [MAIN ] Update Progress: 372/2371 symbols completed. BX took 1.4s. Estimated remaining: 9m 9s. Rate: 218.5 symbols/min [2025-09-29T01:59:03.651533] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:03.787146] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:03.820969] [DEBUG] [LOCAL ] BXMT: Loaded 47994 existing records from primary storage. [2025-09-29T01:59:03.840415] [INFO ] [MAIN ] BXMT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:03.855236] [INFO ] [MAIN ] Update Progress: 373/2371 symbols completed. BXMT took 1.1s. Estimated remaining: 9m 8s. Rate: 218.6 symbols/min [2025-09-29T01:59:03.993126] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:04.091440] [DEBUG] [LOCAL ] BXMX: Loaded 19855 existing records from primary storage. [2025-09-29T01:59:04.103170] [INFO ] [MAIN ] BXMX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:04.117691] [INFO ] [MAIN ] Update Progress: 374/2371 symbols completed. BXMX took 0.9s. Estimated remaining: 9m 8s. Rate: 218.6 symbols/min [2025-09-29T01:59:04.219779] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:04.269750] [DEBUG] [LOCAL ] BXP: Loaded 50577 existing records from primary storage. [2025-09-29T01:59:04.287179] [INFO ] [MAIN ] BXP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:04.298753] [INFO ] [MAIN ] Update Progress: 375/2371 symbols completed. BXP took 1.1s. Estimated remaining: 9m 7s. Rate: 218.8 symbols/min [2025-09-29T01:59:04.564159] [DEBUG] [LOCAL ] BXSL: Loaded 48276 existing records from primary storage. [2025-09-29T01:59:04.549772] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:04.569487] [DEBUG] [LOCAL ] BY: Loaded 21895 existing records from primary storage. [2025-09-29T01:59:04.569733] [INFO ] [MAIN ] BXSL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:04.571050] [INFO ] [MAIN ] Update Progress: 376/2371 symbols completed. BXSL took 0.9s. Estimated remaining: 9m 7s. Rate: 218.8 symbols/min [2025-09-29T01:59:04.594481] [INFO ] [MAIN ] BY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:04.615706] [INFO ] [MAIN ] Update Progress: 377/2371 symbols completed. BY took 0.8s. Estimated remaining: 9m 5s. Rate: 219.3 symbols/min [2025-09-29T01:59:04.797803] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:05.021081] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:05.021633] [DEBUG] [LOCAL ] BYM: Loaded 12225 existing records from primary storage. [2025-09-29T01:59:05.092110] [INFO ] [MAIN ] BYM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:05.098541] [INFO ] [MAIN ] Update Progress: 378/2371 symbols completed. BYM took 0.8s. Estimated remaining: 9m 6s. Rate: 218.9 symbols/min [2025-09-29T01:59:05.113929] [DEBUG] [LOCAL ] BYD: Loaded 45804 existing records from primary storage. [2025-09-29T01:59:05.123036] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:05.174743] [INFO ] [MAIN ] BYD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:05.197352] [INFO ] [MAIN ] Update Progress: 379/2371 symbols completed. BYD took 1.1s. Estimated remaining: 9m 5s. Rate: 219.3 symbols/min [2025-09-29T01:59:05.434366] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:05.466990] [DEBUG] [LOCAL ] BZH: Loaded 33088 existing records from primary storage. [2025-09-29T01:59:05.468086] [INFO ] [MAIN ] BZH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:05.473882] [INFO ] [MAIN ] Update Progress: 380/2371 symbols completed. BZH took 0.9s. Estimated remaining: 9m 5s. Rate: 219.3 symbols/min [2025-09-29T01:59:05.669154] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:05.775016] [DEBUG] [LOCAL ] C: Loaded 54521 existing records from primary storage. [2025-09-29T01:59:05.757509] [DEBUG] [LOCAL ] CAAP: Loaded 20021 existing records from primary storage. [2025-09-29T01:59:05.775638] [INFO ] [MAIN ] CAAP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:05.791616] [INFO ] [MAIN ] C: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:05.776204] [INFO ] [MAIN ] Update Progress: 381/2371 symbols completed. CAAP took 0.7s. Estimated remaining: 9m 5s. Rate: 219.2 symbols/min [2025-09-29T01:59:05.812613] [INFO ] [MAIN ] Update Progress: 382/2371 symbols completed. C took 1.1s. Estimated remaining: 9m 3s. Rate: 219.7 symbols/min [2025-09-29T01:59:05.903588] [DEBUG] [LOCAL ] CABO: Loaded 17549 existing records from primary storage. [2025-09-29T01:59:05.951913] [INFO ] [MAIN ] CABO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:05.918467] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:05.983455] [INFO ] [MAIN ] Update Progress: 383/2371 symbols completed. CABO took 0.8s. Estimated remaining: 9m 2s. Rate: 219.9 symbols/min [2025-09-29T01:59:06.352372] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:06.416688] [DEBUG] [LOCAL ] CACI: Loaded 25384 existing records from primary storage. [2025-09-29T01:59:06.442500] [INFO ] [MAIN ] CACI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:06.455023] [INFO ] [MAIN ] Update Progress: 384/2371 symbols completed. CACI took 1.0s. Estimated remaining: 9m 3s. Rate: 219.5 symbols/min [2025-09-29T01:59:06.448451] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:06.605181] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:06.738021] [DEBUG] [LOCAL ] CAF: Loaded 3471 existing records from primary storage. [2025-09-29T01:59:06.785907] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:06.789323] [INFO ] [MAIN ] CAF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:06.791025] [DEBUG] [LOCAL ] CADE: Loaded 49496 existing records from primary storage. [2025-09-29T01:59:06.792281] [INFO ] [MAIN ] CADE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:06.792436] [INFO ] [MAIN ] Update Progress: 385/2371 symbols completed. CAF took 0.7s. Estimated remaining: 9m 3s. Rate: 219.4 symbols/min [2025-09-29T01:59:06.809776] [INFO ] [MAIN ] Update Progress: 386/2371 symbols completed. CADE took 1.0s. Estimated remaining: 9m 2s. Rate: 219.9 symbols/min [2025-09-29T01:59:06.850799] [DEBUG] [LOCAL ] CAE: Loaded 39622 existing records from primary storage. [2025-09-29T01:59:06.856612] [INFO ] [MAIN ] CAE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:06.875698] [INFO ] [MAIN ] Update Progress: 387/2371 symbols completed. CAE took 0.9s. Estimated remaining: 9m 0s. Rate: 220.3 symbols/min [2025-09-29T01:59:07.366454] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:07.389518] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:07.392002] [DEBUG] [LOCAL ] CAG: Loaded 54439 existing records from primary storage. [2025-09-29T01:59:07.409180] [INFO ] [MAIN ] CAG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:07.421006] [INFO ] [MAIN ] Update Progress: 388/2371 symbols completed. CAG took 1.0s. Estimated remaining: 9m 1s. Rate: 219.8 symbols/min [2025-09-29T01:59:07.525074] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:07.715318] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:07.732111] [DEBUG] [LOCAL ] CAL: Loaded 43833 existing records from primary storage. [2025-09-29T01:59:07.743924] [INFO ] [MAIN ] CAL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:07.744099] [INFO ] [MAIN ] Update Progress: 389/2371 symbols completed. CAL took 0.9s. Estimated remaining: 9m 1s. Rate: 219.6 symbols/min [2025-09-29T01:59:07.913203] [DEBUG] [LOCAL ] CAH: Loaded 52209 existing records from primary storage. [2025-09-29T01:59:07.937863] [DEBUG] [LOCAL ] CALX: Loaded 38931 existing records from primary storage. [2025-09-29T01:59:07.948607] [INFO ] [MAIN ] CAH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:07.968624] [INFO ] [MAIN ] CALX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:07.985852] [INFO ] [MAIN ] Update Progress: 390/2371 symbols completed. CAH took 1.2s. Estimated remaining: 9m 1s. Rate: 219.7 symbols/min [2025-09-29T01:59:08.017429] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:08.012733] [INFO ] [MAIN ] Update Progress: 391/2371 symbols completed. CALX took 1.1s. Estimated remaining: 8m 59s. Rate: 220.2 symbols/min [2025-09-29T01:59:08.073058] [DEBUG] [LOCAL ] CANG: Loaded 27132 existing records from primary storage. [2025-09-29T01:59:08.141555] [DEBUG] [LOCAL ] CAPL: Loaded 5930 existing records from primary storage. [2025-09-29T01:59:08.152327] [INFO ] [MAIN ] CANG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:08.183740] [INFO ] [MAIN ] CAPL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:08.209734] [INFO ] [MAIN ] Update Progress: 392/2371 symbols completed. CANG took 0.8s. Estimated remaining: 8m 59s. Rate: 220.4 symbols/min [2025-09-29T01:59:08.261260] [INFO ] [MAIN ] Update Progress: 393/2371 symbols completed. CAPL took 0.5s. Estimated remaining: 8m 57s. Rate: 220.8 symbols/min [2025-09-29T01:59:08.519947] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:08.612609] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:08.842848] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:08.899766] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:08.944389] [DEBUG] [LOCAL ] CATO: Loaded 7286 existing records from primary storage. [2025-09-29T01:59:08.946846] [DEBUG] [LOCAL ] CARR: Loaded 54374 existing records from primary storage. [2025-09-29T01:59:08.948106] [INFO ] [MAIN ] CARR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:08.948291] [INFO ] [MAIN ] CATO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:08.949118] [INFO ] [MAIN ] Update Progress: 394/2371 symbols completed. CARR took 0.9s. Estimated remaining: 8m 59s. Rate: 220.0 symbols/min [2025-09-29T01:59:08.963831] [INFO ] [MAIN ] Update Progress: 395/2371 symbols completed. CATO took 0.7s. Estimated remaining: 8m 58s. Rate: 220.5 symbols/min [2025-09-29T01:59:09.095185] [DEBUG] [LOCAL ] CARS: Loaded 40616 existing records from primary storage. [2025-09-29T01:59:09.121849] [INFO ] [MAIN ] CARS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:09.188678] [INFO ] [MAIN ] Update Progress: 396/2371 symbols completed. CARS took 1.2s. Estimated remaining: 8m 57s. Rate: 220.6 symbols/min [2025-09-29T01:59:09.457908] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:09.480142] [DEBUG] [LOCAL ] CAT: Loaded 53693 existing records from primary storage. [2025-09-29T01:59:09.495579] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:09.517166] [INFO ] [MAIN ] CAT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:09.533166] [INFO ] [MAIN ] Update Progress: 397/2371 symbols completed. CAT took 1.3s. Estimated remaining: 8m 57s. Rate: 220.5 symbols/min [2025-09-29T01:59:09.626841] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:09.661045] [DEBUG] [LOCAL ] CBAN: Loaded 11141 existing records from primary storage. [2025-09-29T01:59:09.675394] [INFO ] [MAIN ] CBAN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:09.675627] [INFO ] [MAIN ] Update Progress: 398/2371 symbols completed. CBAN took 0.5s. Estimated remaining: 8m 56s. Rate: 220.7 symbols/min [2025-09-29T01:59:09.716045] [DEBUG] [LOCAL ] CAVA: Loaded 54330 existing records from primary storage. [2025-09-29T01:59:09.714969] [DEBUG] [LOCAL ] CB: Loaded 50773 existing records from primary storage. [2025-09-29T01:59:09.716587] [INFO ] [MAIN ] CAVA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:09.717293] [INFO ] [MAIN ] Update Progress: 399/2371 symbols completed. CAVA took 0.8s. Estimated remaining: 8m 55s. Rate: 221.2 symbols/min [2025-09-29T01:59:09.716722] [INFO ] [MAIN ] CB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:09.717869] [INFO ] [MAIN ] Update Progress: 400/2371 symbols completed. CB took 0.7s. Estimated remaining: 8m 53s. Rate: 221.7 symbols/min [2025-09-29T01:59:10.371550] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:10.521257] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:10.571313] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:10.556106] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:10.574323] [DEBUG] [LOCAL ] CBNA: Loaded 2923 existing records from primary storage. [2025-09-29T01:59:10.575900] [INFO ] [MAIN ] CBNA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:10.576067] [INFO ] [MAIN ] Update Progress: 401/2371 symbols completed. CBNA took 0.9s. Estimated remaining: 8m 56s. Rate: 220.5 symbols/min [2025-09-29T01:59:10.575408] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-09-29T01:59:10.581774] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-09-29T01:59:10.591035] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-09-29T01:59:10.607612] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-09-29T01:59:10.635680] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-09-29T01:59:10.642887] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-09-29T01:59:10.801602] [DEBUG] [LOCAL ] CBL: Loaded 16862 existing records from primary storage. [2025-09-29T01:59:10.898160] [INFO ] [MAIN ] CBL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:10.933118] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:10.936469] [INFO ] [MAIN ] Update Progress: 402/2371 symbols completed. CBL took 1.2s. Estimated remaining: 8m 56s. Rate: 220.4 symbols/min [2025-09-29T01:59:11.044870] [DEBUG] [LOCAL ] CBRE: Loaded 51366 existing records from primary storage. [2025-09-29T01:59:11.161164] [INFO ] [MAIN ] CBRE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:11.228521] [INFO ] [MAIN ] Update Progress: 403/2371 symbols completed. CBRE took 1.5s. Estimated remaining: 8m 56s. Rate: 220.3 symbols/min [2025-09-29T01:59:11.391630] [DEBUG] [LOCAL ] CBT: Loaded 31567 existing records from primary storage. [2025-09-29T01:59:11.447094] [INFO ] [MAIN ] CBT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:11.557280] [INFO ] [MAIN ] Update Progress: 404/2371 symbols completed. CBT took 1.0s. Estimated remaining: 8m 56s. Rate: 220.2 symbols/min [2025-09-29T01:59:11.604162] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:11.657374] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:59:11.720070] [INFO ] [REMOTE ] CBO: Fetching primary data for 2024-12. [2025-09-29T01:59:11.794930] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:11.807092] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-09-29T01:59:11.829154] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-09-29T01:59:11.862259] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-09-29T01:59:11.863088] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-09-29T01:59:11.869361] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-09-29T01:59:11.881111] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-09-29T01:59:11.987419] [DEBUG] [LOCAL ] CBU: Loaded 23130 existing records from primary storage. [2025-09-29T01:59:11.995807] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:59:12.014971] [WARN ] [REMOTE ] CBO: No data returned for month 2024-12 [2025-09-29T01:59:12.061589] [FATAL] [REMOTE ] CBO: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:59:12.026681] [INFO ] [MAIN ] CBU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:12.090622] [FATAL] [MAIN ] CBO: Failed to fetch primary data. [2025-09-29T01:59:12.085281] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:12.082953] [INFO ] [MAIN ] Update Progress: 405/2371 symbols completed. CBU took 1.1s. Estimated remaining: 8m 57s. Rate: 219.7 symbols/min [2025-09-29T01:59:12.095767] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:59:12.131425] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-09-29T01:59:12.182075] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-09-29T01:59:12.182385] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-09-29T01:59:12.199261] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-09-29T01:59:12.246302] [INFO ] [MAIN ] Update Progress: 406/2371 symbols completed. CBO took 2.5s. Estimated remaining: 8m 56s. Rate: 219.9 symbols/min [2025-09-29T01:59:12.698023] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:12.755895] [DEBUG] [LOCAL ] CBZ: Loaded 34130 existing records from primary storage. [2025-09-29T01:59:12.756707] [INFO ] [MAIN ] CBZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:12.776540] [INFO ] [MAIN ] Update Progress: 407/2371 symbols completed. CBZ took 1.2s. Estimated remaining: 8m 57s. Rate: 219.4 symbols/min [2025-09-29T01:59:12.857717] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:59:12.901064] [INFO ] [REMOTE ] CBX: Fetching primary data for 2024-12. [2025-09-29T01:59:12.905292] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:13.087351] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:59:13.111750] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:13.113984] [WARN ] [REMOTE ] CBX: No data returned for month 2024-12 [2025-09-29T01:59:13.114320] [FATAL] [REMOTE ] CBX: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:59:13.114146] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-09-29T01:59:13.114610] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-09-29T01:59:13.138798] [FATAL] [MAIN ] CBX: Failed to fetch primary data. [2025-09-29T01:59:13.139625] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:59:13.139773] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-09-29T01:59:13.139949] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-09-29T01:59:13.139997] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-09-29T01:59:13.142625] [DEBUG] [LOCAL ] CC: Loaded 53801 existing records from primary storage. [2025-09-29T01:59:13.142958] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-09-29T01:59:13.143627] [INFO ] [MAIN ] CC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:13.143746] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-09-29T01:59:13.144821] [INFO ] [MAIN ] Update Progress: 408/2371 symbols completed. CC took 1.0s. Estimated remaining: 8m 57s. Rate: 219.2 symbols/min [2025-09-29T01:59:13.144938] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-09-29T01:59:13.140329] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-09-29T01:59:13.150771] [INFO ] [MAIN ] Update Progress: 409/2371 symbols completed. CBX took 1.9s. Estimated remaining: 8m 56s. Rate: 219.8 symbols/min [2025-09-29T01:59:13.201789] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-09-29T01:59:13.555092] [DEBUG] [LOCAL ] CCI: Loaded 53922 existing records from primary storage. [2025-09-29T01:59:13.587397] [INFO ] [MAIN ] CCI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:13.614196] [INFO ] [MAIN ] Update Progress: 410/2371 symbols completed. CCI took 1.3s. Estimated remaining: 8m 56s. Rate: 219.4 symbols/min [2025-09-29T01:59:13.797574] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:13.817951] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:14.134018] [DEBUG] [LOCAL ] CCIF: Loaded 15698 existing records from primary storage. [2025-09-29T01:59:14.138293] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:14.155378] [INFO ] [MAIN ] CCIF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:14.160839] [INFO ] [MAIN ] Update Progress: 411/2371 symbols completed. CCIF took 1.0s. Estimated remaining: 8m 57s. Rate: 218.9 symbols/min [2025-09-29T01:59:14.410529] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:59:14.413014] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2024-12. [2025-09-29T01:59:14.437226] [DEBUG] [LOCAL ] CCJ: Loaded 54453 existing records from primary storage. [2025-09-29T01:59:14.474025] [INFO ] [MAIN ] CCJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:14.506412] [INFO ] [MAIN ] Update Progress: 412/2371 symbols completed. CCJ took 1.3s. Estimated remaining: 8m 57s. Rate: 218.7 symbols/min [2025-09-29T01:59:14.508296] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:14.651107] [DEBUG] [LOCAL ] CCK: Loaded 47083 existing records from primary storage. [2025-09-29T01:59:14.678696] [INFO ] [MAIN ] CCK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:14.728568] [INFO ] [MAIN ] Update Progress: 413/2371 symbols completed. CCK took 1.1s. Estimated remaining: 8m 57s. Rate: 218.8 symbols/min [2025-09-29T01:59:14.727929] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:14.743000] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-09-29T01:59:14.755269] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-09-29T01:59:14.896338] [DEBUG] [LOCAL ] CCL: Loaded 54580 existing records from primary storage. [2025-09-29T01:59:14.923612] [INFO ] [MAIN ] CCL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:14.930841] [INFO ] [MAIN ] Update Progress: 414/2371 symbols completed. CCL took 0.8s. Estimated remaining: 8m 56s. Rate: 219.0 symbols/min [2025-09-29T01:59:14.983244] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:15.095503] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-29T01:59:15.119897] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-09-29T01:59:15.170553] [DEBUG] [LOCAL ] CCRD: Loaded 9100 existing records from primary storage. [2025-09-29T01:59:15.194872] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:15.197709] [DEBUG] [LOCAL ] CCO: Loaded 48387 existing records from primary storage. [2025-09-29T01:59:15.195662] [INFO ] [MAIN ] CCRD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:15.198419] [INFO ] [MAIN ] Update Progress: 415/2371 symbols completed. CCRD took 0.5s. Estimated remaining: 8m 56s. Rate: 219.0 symbols/min [2025-09-29T01:59:15.198603] [INFO ] [MAIN ] CCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:15.221678] [INFO ] [MAIN ] Update Progress: 416/2371 symbols completed. CCO took 0.7s. Estimated remaining: 8m 55s. Rate: 219.5 symbols/min [2025-09-29T01:59:15.479995] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-29T01:59:15.518282] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:15.551190] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-09-29T01:59:15.582523] [DEBUG] [LOCAL ] CCS: Loaded 31155 existing records from primary storage. [2025-09-29T01:59:15.616008] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:15.616292] [INFO ] [MAIN ] CCS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:15.616943] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-09-29T01:59:15.617238] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-09-29T01:59:15.617154] [INFO ] [MAIN ] Update Progress: 417/2371 symbols completed. CCS took 0.7s. Estimated remaining: 8m 55s. Rate: 219.2 symbols/min [2025-09-29T01:59:15.617602] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-09-29T01:59:15.617860] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-09-29T01:59:15.641038] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-09-29T01:59:15.710183] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-09-29T01:59:15.905224] [DEBUG] [LOCAL ] CCU: Loaded 23800 existing records from primary storage. [2025-09-29T01:59:15.912569] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-29T01:59:15.927780] [INFO ] [MAIN ] CCU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:15.934249] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-09-29T01:59:15.959563] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:15.945263] [INFO ] [MAIN ] Update Progress: 418/2371 symbols completed. CCU took 0.7s. Estimated remaining: 8m 55s. Rate: 219.1 symbols/min [2025-09-29T01:59:16.252812] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-09-29T01:59:16.291427] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-09-29T01:59:16.437786] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:16.497479] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:59:16.500247] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2024-12. [2025-09-29T01:59:16.505265] [DEBUG] [LOCAL ] CDE: Loaded 54421 existing records from primary storage. [2025-09-29T01:59:16.507885] [INFO ] [MAIN ] CDE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:16.508477] [INFO ] [MAIN ] Update Progress: 419/2371 symbols completed. CDE took 0.9s. Estimated remaining: 8m 56s. Rate: 218.6 symbols/min [2025-09-29T01:59:16.594975] [DEBUG] [LOCAL ] CDLR: Loaded 9966 existing records from primary storage. [2025-09-29T01:59:16.613343] [INFO ] [MAIN ] CDLR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:16.595211] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-09-29T01:59:16.635160] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-09-29T01:59:16.634836] [INFO ] [MAIN ] Update Progress: 420/2371 symbols completed. CDLR took 0.7s. Estimated remaining: 8m 55s. Rate: 218.8 symbols/min [2025-09-29T01:59:16.805027] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2024-12 (0.30 seconds). [2025-09-29T01:59:16.814623] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:16.815611] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-09-29T01:59:16.914782] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-09-29T01:59:16.918401] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:16.919754] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-09-29T01:59:16.968428] [DEBUG] [LOCAL ] CDP: Loaded 43357 existing records from primary storage. [2025-09-29T01:59:16.978041] [INFO ] [MAIN ] CDP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:16.978518] [INFO ] [MAIN ] Update Progress: 421/2371 symbols completed. CDP took 0.5s. Estimated remaining: 8m 55s. Rate: 218.7 symbols/min [2025-09-29T01:59:16.979168] [DEBUG] [LOCAL ] CDRE: Loaded 25747 existing records from primary storage. [2025-09-29T01:59:17.007347] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.19 seconds). [2025-09-29T01:59:17.019857] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-09-29T01:59:17.046707] [INFO ] [MAIN ] CDRE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:17.090047] [INFO ] [MAIN ] Update Progress: 422/2371 symbols completed. CDRE took 0.5s. Estimated remaining: 8m 54s. Rate: 219.0 symbols/min [2025-09-29T01:59:17.156208] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-09-29T01:59:17.243279] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:17.239141] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-09-29T01:59:17.263350] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-09-29T01:59:17.271439] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-09-29T01:59:17.400997] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:17.416671] [DEBUG] [LOCAL ] CEE: Loaded 6697 existing records from primary storage. [2025-09-29T01:59:17.417230] [INFO ] [MAIN ] CEE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:17.418029] [INFO ] [MAIN ] Update Progress: 423/2371 symbols completed. CEE took 0.3s. Estimated remaining: 8m 54s. Rate: 218.9 symbols/min [2025-09-29T01:59:17.466521] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.20 seconds). [2025-09-29T01:59:17.513562] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-09-29T01:59:17.597355] [DEBUG] [LOCAL ] CE: Loaded 52316 existing records from primary storage. [2025-09-29T01:59:17.638972] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-29T01:59:17.666686] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-09-29T01:59:17.671324] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:17.664928] [INFO ] [MAIN ] CE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:17.672808] [INFO ] [MAIN ] Update Progress: 424/2371 symbols completed. CE took 0.7s. Estimated remaining: 8m 54s. Rate: 219.0 symbols/min [2025-09-29T01:59:17.803809] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-09-29T01:59:17.810680] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-09-29T01:59:17.898685] [DEBUG] [LOCAL ] CEPU: Loaded 26454 existing records from primary storage. [2025-09-29T01:59:17.900012] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:17.900678] [INFO ] [MAIN ] CEPU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:17.901114] [INFO ] [MAIN ] Update Progress: 425/2371 symbols completed. CEPU took 0.5s. Estimated remaining: 8m 53s. Rate: 219.0 symbols/min [2025-09-29T01:59:17.986345] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.18 seconds). [2025-09-29T01:59:17.986543] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-29T01:59:18.019063] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-09-29T01:59:18.029028] [INFO ] [REMOTE ] CCIA: Full fetch complete (2044 records). [2025-09-29T01:59:18.035950] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-09-29T01:59:18.160450] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:18.212877] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:59:18.242575] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-09-29T01:59:18.274146] [FATAL] [REMOTE ] CCZ: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:59:18.285180] [FATAL] [MAIN ] CCZ: Failed to fetch primary data. [2025-09-29T01:59:18.302622] [DEBUG] [LOCAL ] CF: Loaded 52983 existing records from primary storage. [2025-09-29T01:59:18.302852] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:59:18.328061] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-09-29T01:59:18.346829] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-09-29T01:59:18.334368] [INFO ] [MAIN ] CF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:18.374805] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-29T01:59:18.366445] [INFO ] [MAIN ] Update Progress: 426/2371 symbols completed. CF took 0.7s. Estimated remaining: 8m 54s. Rate: 218.7 symbols/min [2025-09-29T01:59:18.374974] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-09-29T01:59:18.375313] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-09-29T01:59:18.399542] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-09-29T01:59:18.393195] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-09-29T01:59:18.426622] [INFO ] [MAIN ] Update Progress: 427/2371 symbols completed. CCZ took 3.2s. Estimated remaining: 8m 52s. Rate: 219.1 symbols/min [2025-09-29T01:59:18.476475] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-09-29T01:59:18.528560] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-09-29T01:59:18.634787] [DEBUG] [LOCAL ] CFG: Loaded 54404 existing records from primary storage. [2025-09-29T01:59:18.588953] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-09-29T01:59:18.681342] [INFO ] [MAIN ] CFG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:18.726225] [INFO ] [MAIN ] Update Progress: 428/2371 symbols completed. CFG took 0.8s. Estimated remaining: 8m 52s. Rate: 219.0 symbols/min [2025-09-29T01:59:18.739335] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-09-29T01:59:18.806549] [INFO ] [MAIN ] Update Progress: 429/2371 symbols completed. CCIA took 6.0s. Estimated remaining: 8m 51s. Rate: 219.4 symbols/min [2025-09-29T01:59:18.806390] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:18.830182] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-09-29T01:59:18.935869] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:18.984441] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-09-29T01:59:19.027082] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-09-29T01:59:19.074723] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-09-29T01:59:19.084820] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-09-29T01:59:19.090731] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-09-29T01:59:19.339113] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:19.303616] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:19.418909] [DEBUG] [LOCAL ] CGV: Loaded 1431 existing records from primary storage. [2025-09-29T01:59:19.419865] [DEBUG] [LOCAL ] CFR: Loaded 33971 existing records from primary storage. [2025-09-29T01:59:19.477086] [INFO ] [MAIN ] CGV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:19.477489] [INFO ] [MAIN ] CFR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:19.477917] [INFO ] [MAIN ] Update Progress: 430/2371 symbols completed. CGV took 0.6s. Estimated remaining: 8m 53s. Rate: 218.7 symbols/min [2025-09-29T01:59:19.507559] [INFO ] [MAIN ] Update Progress: 431/2371 symbols completed. CFR took 1.0s. Estimated remaining: 8m 51s. Rate: 219.1 symbols/min [2025-09-29T01:59:20.018846] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:20.037806] [DEBUG] [LOCAL ] CGAU: Loaded 43406 existing records from primary storage. [2025-09-29T01:59:20.093399] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:20.096686] [INFO ] [MAIN ] CGAU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:20.097745] [INFO ] [MAIN ] Update Progress: 432/2371 symbols completed. CGAU took 1.3s. Estimated remaining: 8m 52s. Rate: 218.5 symbols/min [2025-09-29T01:59:20.101900] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:59:20.114897] [INFO ] [REMOTE ] CFND: Fetching primary data for 2024-12. [2025-09-29T01:59:20.273282] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:59:20.279410] [DEBUG] [LOCAL ] CHCT: Loaded 24309 existing records from primary storage. [2025-09-29T01:59:20.284941] [WARN ] [REMOTE ] CFND: No data returned for month 2024-12 [2025-09-29T01:59:20.308154] [FATAL] [REMOTE ] CFND: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:59:20.328936] [FATAL] [MAIN ] CFND: Failed to fetch primary data. [2025-09-29T01:59:20.308043] [INFO ] [MAIN ] CHCT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:20.339488] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:20.339734] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:59:20.339898] [INFO ] [MAIN ] Update Progress: 433/2371 symbols completed. CHCT took 0.9s. Estimated remaining: 8m 52s. Rate: 218.6 symbols/min [2025-09-29T01:59:20.339994] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-09-29T01:59:20.340750] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-09-29T01:59:20.353308] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-09-29T01:59:20.359691] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-09-29T01:59:20.389715] [INFO ] [MAIN ] Update Progress: 434/2371 symbols completed. CFND took 2.0s. Estimated remaining: 8m 51s. Rate: 219.0 symbols/min [2025-09-29T01:59:20.600974] [DEBUG] [LOCAL ] CHD: Loaded 52767 existing records from primary storage. [2025-09-29T01:59:20.636940] [DEBUG] [LOCAL ] CHE: Loaded 14983 existing records from primary storage. [2025-09-29T01:59:20.700027] [INFO ] [MAIN ] CHD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:20.744130] [INFO ] [MAIN ] CHE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:20.791160] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:20.787146] [INFO ] [MAIN ] Update Progress: 435/2371 symbols completed. CHD took 1.2s. Estimated remaining: 8m 51s. Rate: 218.8 symbols/min [2025-09-29T01:59:20.788499] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:20.791933] [INFO ] [MAIN ] Update Progress: 436/2371 symbols completed. CHE took 0.7s. Estimated remaining: 8m 50s. Rate: 219.3 symbols/min [2025-09-29T01:59:21.293377] [DEBUG] [LOCAL ] CHH: Loaded 32744 existing records from primary storage. [2025-09-29T01:59:21.294536] [INFO ] [MAIN ] CHH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:21.291983] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:21.287849] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:21.294704] [INFO ] [MAIN ] Update Progress: 437/2371 symbols completed. CHH took 0.9s. Estimated remaining: 8m 50s. Rate: 218.8 symbols/min [2025-09-29T01:59:21.311978] [DEBUG] [LOCAL ] CHGG: Loaded 48434 existing records from primary storage. [2025-09-29T01:59:21.313633] [INFO ] [MAIN ] CHGG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:21.314111] [INFO ] [MAIN ] Update Progress: 438/2371 symbols completed. CHGG took 1.0s. Estimated remaining: 8m 49s. Rate: 219.3 symbols/min [2025-09-29T01:59:21.317968] [DEBUG] [LOCAL ] CHN: Loaded 4900 existing records from primary storage. [2025-09-29T01:59:21.318155] [INFO ] [MAIN ] CHN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:21.318335] [INFO ] [MAIN ] Update Progress: 439/2371 symbols completed. CHN took 0.5s. Estimated remaining: 8m 47s. Rate: 219.8 symbols/min [2025-09-29T01:59:21.337053] [DEBUG] [LOCAL ] CHMI: Loaded 22359 existing records from primary storage. [2025-09-29T01:59:21.337337] [INFO ] [MAIN ] CHMI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:21.337438] [INFO ] [MAIN ] Update Progress: 440/2371 symbols completed. CHMI took 0.5s. Estimated remaining: 8m 46s. Rate: 220.3 symbols/min [2025-09-29T01:59:21.917545] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:21.948755] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:22.071926] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:22.112131] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:22.129452] [DEBUG] [LOCAL ] CHT: Loaded 19816 existing records from primary storage. [2025-09-29T01:59:22.129925] [INFO ] [MAIN ] CHT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:22.130050] [INFO ] [MAIN ] Update Progress: 441/2371 symbols completed. CHT took 0.8s. Estimated remaining: 8m 48s. Rate: 219.3 symbols/min [2025-09-29T01:59:22.380887] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:22.415950] [DEBUG] [LOCAL ] CI: Loaded 50561 existing records from primary storage. [2025-09-29T01:59:22.434565] [DEBUG] [LOCAL ] CHWY: Loaded 54434 existing records from primary storage. [2025-09-29T01:59:22.434882] [INFO ] [MAIN ] CI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:22.435488] [INFO ] [MAIN ] CHWY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:22.437413] [DEBUG] [LOCAL ] CHPT: Loaded 49765 existing records from primary storage. [2025-09-29T01:59:22.435938] [INFO ] [MAIN ] Update Progress: 442/2371 symbols completed. CHWY took 1.1s. Estimated remaining: 8m 48s. Rate: 219.3 symbols/min [2025-09-29T01:59:22.443848] [INFO ] [MAIN ] CHPT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:22.443749] [INFO ] [MAIN ] Update Progress: 443/2371 symbols completed. CI took 1.1s. Estimated remaining: 8m 46s. Rate: 219.7 symbols/min [2025-09-29T01:59:22.506782] [INFO ] [MAIN ] Update Progress: 444/2371 symbols completed. CHPT took 1.1s. Estimated remaining: 8m 45s. Rate: 220.1 symbols/min [2025-09-29T01:59:22.637281] [DEBUG] [LOCAL ] CIA: Loaded 17213 existing records from primary storage. [2025-09-29T01:59:22.657982] [INFO ] [MAIN ] CIA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:22.663601] [INFO ] [MAIN ] Update Progress: 445/2371 symbols completed. CIA took 0.5s. Estimated remaining: 8m 44s. Rate: 220.3 symbols/min [2025-09-29T01:59:22.943433] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:23.189295] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:23.124001] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:23.225487] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-09-29T01:59:23.226455] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:23.227424] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-09-29T01:59:23.227538] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-09-29T01:59:23.227586] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-09-29T01:59:23.227633] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-09-29T01:59:23.227713] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-09-29T01:59:23.335380] [DEBUG] [LOCAL ] CIF: Loaded 4396 existing records from primary storage. [2025-09-29T01:59:23.383560] [DEBUG] [LOCAL ] CIB: Loaded 31435 existing records from primary storage. [2025-09-29T01:59:23.381898] [INFO ] [MAIN ] CIF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:23.390287] [INFO ] [MAIN ] Update Progress: 446/2371 symbols completed. CIF took 0.7s. Estimated remaining: 8m 46s. Rate: 219.5 symbols/min [2025-09-29T01:59:23.406949] [INFO ] [MAIN ] CIB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:23.457801] [INFO ] [MAIN ] Update Progress: 447/2371 symbols completed. CIB took 1.0s. Estimated remaining: 8m 45s. Rate: 219.9 symbols/min [2025-09-29T01:59:23.939155] [DEBUG] [LOCAL ] CIEN: Loaded 52854 existing records from primary storage. [2025-09-29T01:59:23.949633] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:23.961834] [INFO ] [MAIN ] CIEN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:23.962492] [INFO ] [MAIN ] Update Progress: 448/2371 symbols completed. CIEN took 1.4s. Estimated remaining: 8m 46s. Rate: 219.5 symbols/min [2025-09-29T01:59:24.174616] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:24.211624] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:59:24.244139] [INFO ] [REMOTE ] CICB: Fetching primary data for 2024-12. [2025-09-29T01:59:24.350881] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:24.373718] [DEBUG] [LOCAL ] CIG: Loaded 44447 existing records from primary storage. [2025-09-29T01:59:24.374952] [DEBUG] [LOCAL ] CII: Loaded 15638 existing records from primary storage. [2025-09-29T01:59:24.375164] [INFO ] [MAIN ] CIG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:24.375663] [INFO ] [MAIN ] CII: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:24.376145] [INFO ] [MAIN ] Update Progress: 449/2371 symbols completed. CIG took 1.0s. Estimated remaining: 8m 46s. Rate: 219.2 symbols/min [2025-09-29T01:59:24.376681] [INFO ] [MAIN ] Update Progress: 450/2371 symbols completed. CII took 0.8s. Estimated remaining: 8m 45s. Rate: 219.7 symbols/min [2025-09-29T01:59:24.640004] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-29T01:59:24.670744] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-09-29T01:59:24.839105] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:24.846848] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-09-29T01:59:24.846088] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:24.847777] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-09-29T01:59:24.849800] [DEBUG] [LOCAL ] CIM: Loaded 37858 existing records from primary storage. [2025-09-29T01:59:24.851078] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-09-29T01:59:24.851380] [INFO ] [MAIN ] CIM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:24.852540] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-09-29T01:59:24.852911] [INFO ] [MAIN ] Update Progress: 451/2371 symbols completed. CIM took 0.9s. Estimated remaining: 8m 45s. Rate: 219.3 symbols/min [2025-09-29T01:59:24.853013] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-09-29T01:59:24.895788] [DEBUG] [LOCAL ] CIMN: Loaded 2697 existing records from primary storage. [2025-09-29T01:59:24.944013] [INFO ] [MAIN ] CIMN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:24.895441] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-09-29T01:59:24.956940] [INFO ] [MAIN ] Update Progress: 452/2371 symbols completed. CIMN took 0.6s. Estimated remaining: 8m 44s. Rate: 219.6 symbols/min [2025-09-29T01:59:25.158286] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-29T01:59:25.255376] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-09-29T01:59:25.292779] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:25.321408] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-09-29T01:59:25.328154] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-09-29T01:59:25.361324] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-09-29T01:59:25.361736] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-09-29T01:59:25.373183] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-09-29T01:59:25.418308] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-09-29T01:59:25.732213] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-29T01:59:25.702881] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:25.764335] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-09-29T01:59:26.137120] [DEBUG] [LOCAL ] CINT: Loaded 18868 existing records from primary storage. [2025-09-29T01:59:26.130206] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:59:26.150572] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-29T01:59:26.166492] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-09-29T01:59:26.156630] [INFO ] [MAIN ] CINT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:26.182756] [INFO ] [MAIN ] Update Progress: 453/2371 symbols completed. CINT took 1.2s. Estimated remaining: 8m 48s. Rate: 218.0 symbols/min [2025-09-29T01:59:26.170370] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2024-12. [2025-09-29T01:59:26.349710] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:59:26.379586] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2024-12. [2025-09-29T01:59:26.469530] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:26.494345] [DEBUG] [LOCAL ] CIO: Loaded 20406 existing records from primary storage. [2025-09-29T01:59:26.494739] [INFO ] [MAIN ] CIO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:26.494869] [INFO ] [MAIN ] Update Progress: 454/2371 symbols completed. CIO took 0.3s. Estimated remaining: 8m 48s. Rate: 217.9 symbols/min [2025-09-29T01:59:26.561204] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:59:26.571822] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-29T01:59:26.609755] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-09-29T01:59:26.607900] [WARN ] [REMOTE ] CIMP: No data returned for month 2024-12 [2025-09-29T01:59:26.616915] [FATAL] [REMOTE ] CIMP: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:59:26.642265] [FATAL] [MAIN ] CIMP: Failed to fetch primary data. [2025-09-29T01:59:26.653682] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:59:26.661225] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-09-29T01:59:26.661400] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-09-29T01:59:26.667767] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-09-29T01:59:26.683283] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-09-29T01:59:26.688546] [INFO ] [MAIN ] Update Progress: 455/2371 symbols completed. CIMP took 1.8s. Estimated remaining: 8m 47s. Rate: 218.0 symbols/min [2025-09-29T01:59:26.776600] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:26.876712] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-29T01:59:26.885771] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-09-29T01:59:26.918742] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-09-29T01:59:26.912496] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-09-29T01:59:26.984071] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:27.015598] [DEBUG] [LOCAL ] CION: Loaded 29661 existing records from primary storage. [2025-09-29T01:59:27.016056] [INFO ] [MAIN ] CION: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:27.016168] [INFO ] [MAIN ] Update Progress: 456/2371 symbols completed. CION took 0.5s. Estimated remaining: 8m 47s. Rate: 218.0 symbols/min [2025-09-29T01:59:27.248037] [DEBUG] [LOCAL ] CIVI: Loaded 53363 existing records from primary storage. [2025-09-29T01:59:27.249478] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:27.250094] [INFO ] [MAIN ] CIVI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:27.250790] [INFO ] [MAIN ] Update Progress: 457/2371 symbols completed. CIVI took 0.5s. Estimated remaining: 8m 47s. Rate: 218.0 symbols/min [2025-09-29T01:59:27.268728] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-29T01:59:27.291857] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-09-29T01:59:27.357799] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-29T01:59:27.385971] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-09-29T01:59:27.469498] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:27.514526] [DEBUG] [LOCAL ] CL: Loaded 54424 existing records from primary storage. [2025-09-29T01:59:27.515470] [INFO ] [MAIN ] CL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:27.515986] [INFO ] [MAIN ] Update Progress: 458/2371 symbols completed. CL took 0.5s. Estimated remaining: 8m 46s. Rate: 218.0 symbols/min [2025-09-29T01:59:27.642954] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-29T01:59:27.659466] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-09-29T01:59:27.695162] [DEBUG] [LOCAL ] CLB: Loaded 33475 existing records from primary storage. [2025-09-29T01:59:27.755999] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:27.757826] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-29T01:59:27.758018] [INFO ] [MAIN ] CLB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:27.758817] [INFO ] [MAIN ] Update Progress: 459/2371 symbols completed. CLB took 0.5s. Estimated remaining: 8m 46s. Rate: 218.1 symbols/min [2025-09-29T01:59:27.760507] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-09-29T01:59:27.891007] [DEBUG] [LOCAL ] CLCO: Loaded 13189 existing records from primary storage. [2025-09-29T01:59:27.891170] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-09-29T01:59:27.903704] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-09-29T01:59:27.909182] [INFO ] [MAIN ] CLCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:27.943778] [INFO ] [MAIN ] Update Progress: 460/2371 symbols completed. CLCO took 0.4s. Estimated remaining: 8m 45s. Rate: 218.2 symbols/min [2025-09-29T01:59:27.980867] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:28.066556] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.16 seconds). [2025-09-29T01:59:28.096797] [INFO ] [REMOTE ] CICB: Full fetch complete (2111 records). [2025-09-29T01:59:28.113283] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-09-29T01:59:28.134852] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-29T01:59:28.220802] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-09-29T01:59:28.224609] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:28.307531] [DEBUG] [LOCAL ] CLDT: Loaded 26082 existing records from primary storage. [2025-09-29T01:59:28.320119] [INFO ] [MAIN ] CLDT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:28.325957] [INFO ] [MAIN ] Update Progress: 461/2371 symbols completed. CLDT took 0.6s. Estimated remaining: 8m 46s. Rate: 218.1 symbols/min [2025-09-29T01:59:28.456670] [WARN ] [VALIDATOR ] CICB: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-29T01:59:28.499818] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-09-29T01:59:28.520865] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-09-29T01:59:28.546803] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-09-29T01:59:28.558948] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-09-29T01:59:28.559149] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-09-29T01:59:28.624283] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-09-29T01:59:28.645055] [DEBUG] [LOCAL ] CLF: Loaded 54521 existing records from primary storage. [2025-09-29T01:59:28.642707] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:28.652048] [INFO ] [MAIN ] CLF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:28.645676] [INFO ] [MAIN ] Update Progress: 462/2371 symbols completed. CICB took 6.2s. Estimated remaining: 8m 45s. Rate: 218.0 symbols/min [2025-09-29T01:59:28.653062] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-29T01:59:28.658578] [INFO ] [MAIN ] Update Progress: 463/2371 symbols completed. CLF took 0.7s. Estimated remaining: 8m 44s. Rate: 218.4 symbols/min [2025-09-29T01:59:28.699576] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-09-29T01:59:29.003370] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:29.068274] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:29.080546] [DEBUG] [LOCAL ] CLH: Loaded 28493 existing records from primary storage. [2025-09-29T01:59:29.080957] [INFO ] [MAIN ] CLH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:29.081067] [INFO ] [MAIN ] Update Progress: 464/2371 symbols completed. CLH took 0.7s. Estimated remaining: 8m 44s. Rate: 218.2 symbols/min [2025-09-29T01:59:29.138013] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-29T01:59:29.155282] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-09-29T01:59:29.222719] [DEBUG] [LOCAL ] CLPR: Loaded 11615 existing records from primary storage. [2025-09-29T01:59:29.223798] [INFO ] [MAIN ] CLPR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:29.224288] [INFO ] [MAIN ] Update Progress: 465/2371 symbols completed. CLPR took 0.6s. Estimated remaining: 8m 44s. Rate: 218.4 symbols/min [2025-09-29T01:59:29.407728] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:29.439846] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-09-29T01:59:29.481286] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-09-29T01:59:29.495702] [DEBUG] [LOCAL ] CLS: Loaded 54412 existing records from primary storage. [2025-09-29T01:59:29.528837] [INFO ] [MAIN ] CLS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:29.529776] [INFO ] [MAIN ] Update Progress: 466/2371 symbols completed. CLS took 0.8s. Estimated remaining: 8m 43s. Rate: 218.4 symbols/min [2025-09-29T01:59:29.587043] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:29.775243] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:29.800630] [DEBUG] [LOCAL ] CLVT: Loaded 52713 existing records from primary storage. [2025-09-29T01:59:29.814038] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-29T01:59:29.815619] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-09-29T01:59:29.802612] [INFO ] [MAIN ] CLVT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:29.816553] [DEBUG] [LOCAL ] CLW: Loaded 22226 existing records from primary storage. [2025-09-29T01:59:29.818295] [INFO ] [MAIN ] Update Progress: 467/2371 symbols completed. CLVT took 0.7s. Estimated remaining: 8m 43s. Rate: 218.3 symbols/min [2025-09-29T01:59:29.818743] [INFO ] [MAIN ] CLW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:29.825344] [INFO ] [MAIN ] Update Progress: 468/2371 symbols completed. CLW took 0.6s. Estimated remaining: 8m 42s. Rate: 218.8 symbols/min [2025-09-29T01:59:30.227708] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:30.273420] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:30.273882] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-29T01:59:30.277566] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-09-29T01:59:30.281063] [DEBUG] [LOCAL ] CLX: Loaded 52189 existing records from primary storage. [2025-09-29T01:59:30.282462] [INFO ] [MAIN ] CLX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:30.283035] [INFO ] [MAIN ] Update Progress: 469/2371 symbols completed. CLX took 0.7s. Estimated remaining: 8m 42s. Rate: 218.5 symbols/min [2025-09-29T01:59:30.493994] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:30.521251] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-09-29T01:59:30.540246] [INFO ] [REMOTE ] CIMO: Full fetch complete (5472 records). [2025-09-29T01:59:30.542084] [DEBUG] [LOCAL ] CM: Loaded 49317 existing records from primary storage. [2025-09-29T01:59:30.557141] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-09-29T01:59:30.557480] [INFO ] [MAIN ] CM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:30.570853] [DEBUG] [LOCAL ] CMA: Loaded 50721 existing records from primary storage. [2025-09-29T01:59:30.607554] [INFO ] [MAIN ] CMA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:30.576630] [INFO ] [MAIN ] Update Progress: 470/2371 symbols completed. CM took 0.8s. Estimated remaining: 8m 42s. Rate: 218.4 symbols/min [2025-09-29T01:59:30.674574] [INFO ] [MAIN ] Update Progress: 471/2371 symbols completed. CMA took 0.8s. Estimated remaining: 8m 41s. Rate: 218.7 symbols/min [2025-09-29T01:59:30.930300] [DEBUG] [LOCAL ] CMBT: Loaded 22911 existing records from primary storage. [2025-09-29T01:59:30.991683] [INFO ] [MAIN ] CMBT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:31.007540] [INFO ] [MAIN ] Update Progress: 472/2371 symbols completed. CMBT took 0.7s. Estimated remaining: 8m 41s. Rate: 218.6 symbols/min [2025-09-29T01:59:31.066531] [WARN ] [VALIDATOR ] CIMO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-29T01:59:31.143425] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-09-29T01:59:31.264740] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:31.263203] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-09-29T01:59:31.270210] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-09-29T01:59:31.202878] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:31.271106] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-09-29T01:59:31.278460] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-09-29T01:59:31.284568] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-09-29T01:59:31.286587] [INFO ] [MAIN ] Update Progress: 473/2371 symbols completed. CIMO took 6.9s. Estimated remaining: 8m 41s. Rate: 218.6 symbols/min [2025-09-29T01:59:31.355709] [DEBUG] [LOCAL ] CMCM: Loaded 4834 existing records from primary storage. [2025-09-29T01:59:31.372231] [INFO ] [MAIN ] CMCM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:31.392003] [INFO ] [MAIN ] Update Progress: 474/2371 symbols completed. CMCM took 0.7s. Estimated remaining: 8m 40s. Rate: 218.9 symbols/min [2025-09-29T01:59:31.581219] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:31.602293] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-09-29T01:59:31.629917] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-09-29T01:59:31.716138] [DEBUG] [LOCAL ] CMC: Loaded 46311 existing records from primary storage. [2025-09-29T01:59:31.737698] [INFO ] [MAIN ] CMC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:31.743008] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-09-29T01:59:31.759431] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-09-29T01:59:31.767461] [INFO ] [MAIN ] Update Progress: 475/2371 symbols completed. CMC took 1.1s. Estimated remaining: 8m 40s. Rate: 218.8 symbols/min [2025-09-29T01:59:31.855280] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-09-29T01:59:31.851834] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:31.890339] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:31.868506] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-09-29T01:59:32.244897] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:32.502626] [DEBUG] [LOCAL ] CMI: Loaded 42484 existing records from primary storage. [2025-09-29T01:59:32.525193] [DEBUG] [LOCAL ] CMG: Loaded 54501 existing records from primary storage. [2025-09-29T01:59:32.551757] [INFO ] [MAIN ] CMG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:32.552062] [INFO ] [MAIN ] CMI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:32.558782] [DEBUG] [LOCAL ] CMP: Loaded 36848 existing records from primary storage. [2025-09-29T01:59:32.569938] [INFO ] [MAIN ] Update Progress: 476/2371 symbols completed. CMG took 1.3s. Estimated remaining: 8m 42s. Rate: 217.9 symbols/min [2025-09-29T01:59:32.610520] [INFO ] [MAIN ] Update Progress: 477/2371 symbols completed. CMI took 1.2s. Estimated remaining: 8m 41s. Rate: 218.3 symbols/min [2025-09-29T01:59:32.610313] [INFO ] [MAIN ] CMP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:32.685466] [INFO ] [MAIN ] Update Progress: 478/2371 symbols completed. CMP took 0.8s. Estimated remaining: 8m 40s. Rate: 218.6 symbols/min [2025-09-29T01:59:32.732025] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:59:32.768161] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2024-12. [2025-09-29T01:59:32.850418] [INFO ] [MAIN ] CMPO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:32.897515] [DEBUG] [LOCAL ] CMPO: Loaded 40071 existing records from primary storage. [2025-09-29T01:59:32.897950] [INFO ] [MAIN ] CMPO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:32.898058] [INFO ] [MAIN ] Update Progress: 479/2371 symbols completed. CMPO took 0.3s. Estimated remaining: 8m 39s. Rate: 218.7 symbols/min [2025-09-29T01:59:32.920693] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:59:32.921098] [WARN ] [REMOTE ] CMDB: No data returned for month 2024-12 [2025-09-29T01:59:32.921192] [FATAL] [REMOTE ] CMDB: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:59:32.921277] [FATAL] [MAIN ] CMDB: Failed to fetch primary data. [2025-09-29T01:59:32.921347] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:59:32.921426] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-09-29T01:59:32.921537] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-09-29T01:59:32.921628] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-09-29T01:59:32.921759] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-09-29T01:59:32.921848] [INFO ] [MAIN ] Update Progress: 480/2371 symbols completed. CMDB took 1.8s. Estimated remaining: 8m 38s. Rate: 219.1 symbols/min [2025-09-29T01:59:33.620659] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:33.696592] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:33.721570] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:33.719583] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:33.730398] [DEBUG] [LOCAL ] CMSA: Loaded 3421 existing records from primary storage. [2025-09-29T01:59:33.732217] [INFO ] [MAIN ] CMSA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:33.732836] [INFO ] [MAIN ] Update Progress: 481/2371 symbols completed. CMSA took 0.8s. Estimated remaining: 8m 40s. Rate: 218.2 symbols/min [2025-09-29T01:59:33.748856] [DEBUG] [LOCAL ] CMSC: Loaded 5131 existing records from primary storage. [2025-09-29T01:59:33.780156] [INFO ] [MAIN ] CMSC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:33.807169] [INFO ] [MAIN ] Update Progress: 482/2371 symbols completed. CMSC took 0.9s. Estimated remaining: 8m 39s. Rate: 218.6 symbols/min [2025-09-29T01:59:34.051984] [DEBUG] [LOCAL ] CMRE: Loaded 36068 existing records from primary storage. [2025-09-29T01:59:34.071775] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:34.097924] [INFO ] [MAIN ] CMRE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:34.126308] [DEBUG] [LOCAL ] CMS: Loaded 53371 existing records from primary storage. [2025-09-29T01:59:34.129542] [INFO ] [MAIN ] Update Progress: 483/2371 symbols completed. CMRE took 1.2s. Estimated remaining: 8m 39s. Rate: 218.5 symbols/min [2025-09-29T01:59:34.130948] [INFO ] [MAIN ] CMS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:34.179157] [INFO ] [MAIN ] Update Progress: 484/2371 symbols completed. CMS took 1.3s. Estimated remaining: 8m 37s. Rate: 218.8 symbols/min [2025-09-29T01:59:34.293759] [DEBUG] [LOCAL ] CMSD: Loaded 8184 existing records from primary storage. [2025-09-29T01:59:34.336784] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:34.337104] [INFO ] [MAIN ] CMSD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:34.347678] [INFO ] [MAIN ] Update Progress: 485/2371 symbols completed. CMSD took 0.6s. Estimated remaining: 8m 37s. Rate: 219.0 symbols/min [2025-09-29T01:59:34.665513] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:34.744703] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:34.839856] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:34.843848] [DEBUG] [LOCAL ] CMTG: Loaded 37931 existing records from primary storage. [2025-09-29T01:59:34.844880] [INFO ] [MAIN ] CMTG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:34.845130] [INFO ] [MAIN ] Update Progress: 486/2371 symbols completed. CMTG took 1.0s. Estimated remaining: 8m 37s. Rate: 218.7 symbols/min [2025-09-29T01:59:34.850133] [DEBUG] [LOCAL ] CMU: Loaded 7303 existing records from primary storage. [2025-09-29T01:59:34.863537] [INFO ] [MAIN ] CMU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:34.875393] [INFO ] [MAIN ] Update Progress: 487/2371 symbols completed. CMU took 0.7s. Estimated remaining: 8m 36s. Rate: 219.1 symbols/min [2025-09-29T01:59:35.211944] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:35.246684] [DEBUG] [LOCAL ] CNA: Loaded 33235 existing records from primary storage. [2025-09-29T01:59:35.284857] [INFO ] [MAIN ] CNA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:35.284693] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:35.288236] [INFO ] [MAIN ] Update Progress: 488/2371 symbols completed. CNA took 1.1s. Estimated remaining: 8m 36s. Rate: 218.8 symbols/min [2025-09-29T01:59:35.317272] [DEBUG] [LOCAL ] CNC: Loaded 54518 existing records from primary storage. [2025-09-29T01:59:35.353963] [DEBUG] [LOCAL ] CNF: Loaded 11166 existing records from primary storage. [2025-09-29T01:59:35.378870] [INFO ] [MAIN ] CNC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:35.389671] [INFO ] [MAIN ] CNF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:35.400448] [INFO ] [MAIN ] Update Progress: 489/2371 symbols completed. CNC took 1.0s. Estimated remaining: 8m 35s. Rate: 219.1 symbols/min [2025-09-29T01:59:35.452074] [INFO ] [MAIN ] Update Progress: 490/2371 symbols completed. CNF took 0.6s. Estimated remaining: 8m 34s. Rate: 219.5 symbols/min [2025-09-29T01:59:35.599898] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:35.839270] [DEBUG] [LOCAL ] CNH: Loaded 54337 existing records from primary storage. [2025-09-29T01:59:35.875714] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:35.888567] [INFO ] [MAIN ] CNH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:35.925273] [INFO ] [MAIN ] Update Progress: 491/2371 symbols completed. CNH took 1.0s. Estimated remaining: 8m 35s. Rate: 219.1 symbols/min [2025-09-29T01:59:35.952602] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:36.208853] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:36.165405] [DEBUG] [LOCAL ] CNI: Loaded 52419 existing records from primary storage. [2025-09-29T01:59:36.209875] [INFO ] [MAIN ] CNI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:36.210676] [INFO ] [MAIN ] Update Progress: 492/2371 symbols completed. CNI took 0.9s. Estimated remaining: 8m 35s. Rate: 219.1 symbols/min [2025-09-29T01:59:36.363623] [DEBUG] [LOCAL ] CNK: Loaded 53658 existing records from primary storage. [2025-09-29T01:59:36.378096] [INFO ] [MAIN ] CNK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:36.414148] [INFO ] [MAIN ] Update Progress: 493/2371 symbols completed. CNK took 1.0s. Estimated remaining: 8m 34s. Rate: 219.2 symbols/min [2025-09-29T01:59:36.513667] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:36.464182] [DEBUG] [LOCAL ] CNM: Loaded 51747 existing records from primary storage. [2025-09-29T01:59:36.514891] [INFO ] [MAIN ] CNM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:36.529764] [INFO ] [MAIN ] Update Progress: 494/2371 symbols completed. CNM took 1.0s. Estimated remaining: 8m 33s. Rate: 219.5 symbols/min [2025-09-29T01:59:36.561062] [DEBUG] [LOCAL ] CNMD: Loaded 32884 existing records from primary storage. [2025-09-29T01:59:36.599346] [INFO ] [MAIN ] CNMD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:36.641271] [INFO ] [MAIN ] Update Progress: 495/2371 symbols completed. CNMD took 0.7s. Estimated remaining: 8m 32s. Rate: 219.7 symbols/min [2025-09-29T01:59:36.993124] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:37.078701] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:37.120883] [DEBUG] [LOCAL ] CNNE: Loaded 37257 existing records from primary storage. [2025-09-29T01:59:37.133534] [INFO ] [MAIN ] CNNE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:37.171568] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:37.171916] [INFO ] [MAIN ] Update Progress: 496/2371 symbols completed. CNNE took 1.0s. Estimated remaining: 8m 33s. Rate: 219.3 symbols/min [2025-09-29T01:59:37.411951] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:37.425597] [DEBUG] [LOCAL ] CNR: No existing data file found in primary storage. [2025-09-29T01:59:37.426109] [WARN ] [MAIN ] CNR: No existing data found, performing full refresh instead. [2025-09-29T01:59:37.426461] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-09-29T01:59:37.426581] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-09-29T01:59:37.426810] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-09-29T01:59:37.429277] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-09-29T01:59:37.450974] [DEBUG] [LOCAL ] CNO: Loaded 41901 existing records from primary storage. [2025-09-29T01:59:37.498684] [INFO ] [MAIN ] CNO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:37.517858] [INFO ] [MAIN ] Update Progress: 497/2371 symbols completed. CNO took 1.0s. Estimated remaining: 8m 33s. Rate: 219.2 symbols/min [2025-09-29T01:59:37.511833] [DEBUG] [LOCAL ] CNP: Loaded 54249 existing records from primary storage. [2025-09-29T01:59:37.539760] [INFO ] [MAIN ] CNP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:37.570753] [INFO ] [MAIN ] Update Progress: 498/2371 symbols completed. CNP took 1.0s. Estimated remaining: 8m 32s. Rate: 219.6 symbols/min [2025-09-29T01:59:37.750101] [DEBUG] [LOCAL ] CNQ: Loaded 54361 existing records from primary storage. [2025-09-29T01:59:37.802921] [INFO ] [MAIN ] CNQ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:37.855508] [INFO ] [MAIN ] Update Progress: 499/2371 symbols completed. CNQ took 1.2s. Estimated remaining: 8m 32s. Rate: 219.5 symbols/min [2025-09-29T01:59:38.222990] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:38.326078] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:38.441164] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:38.527820] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:59:38.528489] [INFO ] [REMOTE ] CNR: Fetching primary data for 2024-12. [2025-09-29T01:59:38.542921] [DEBUG] [LOCAL ] CNS: Loaded 21245 existing records from primary storage. [2025-09-29T01:59:38.543385] [INFO ] [MAIN ] CNS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:38.543854] [INFO ] [MAIN ] Update Progress: 500/2371 symbols completed. CNS took 1.0s. Estimated remaining: 8m 33s. Rate: 218.9 symbols/min [2025-09-29T01:59:38.692237] [DEBUG] [REMOTE ] CNR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:59:38.728529] [DEBUG] [LOCAL ] CODI: Loaded 40312 existing records from primary storage. [2025-09-29T01:59:38.745351] [WARN ] [REMOTE ] CNR: No data returned for month 2024-12 [2025-09-29T01:59:38.765576] [FATAL] [REMOTE ] CNR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:59:38.751099] [INFO ] [MAIN ] CODI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:38.766044] [FATAL] [MAIN ] CNR: Failed to fetch primary data. [2025-09-29T01:59:38.779316] [INFO ] [MAIN ] Update Progress: 501/2371 symbols completed. CODI took 0.9s. Estimated remaining: 8m 32s. Rate: 218.9 symbols/min [2025-09-29T01:59:38.787053] [DEBUG] [LOCAL ] CNX: Loaded 52150 existing records from primary storage. [2025-09-29T01:59:38.779763] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:59:38.803866] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-09-29T01:59:38.850282] [INFO ] [MAIN ] CNX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:38.866773] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-09-29T01:59:38.899153] [INFO ] [MAIN ] Update Progress: 502/2371 symbols completed. CNX took 1.3s. Estimated remaining: 8m 32s. Rate: 219.2 symbols/min [2025-09-29T01:59:38.898514] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-09-29T01:59:38.925824] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:38.947952] [DEBUG] [LOCAL ] CNR: No derivative data file found to delete. [2025-09-29T01:59:39.005206] [INFO ] [MAIN ] Update Progress: 503/2371 symbols completed. CNR took 1.8s. Estimated remaining: 8m 31s. Rate: 219.5 symbols/min [2025-09-29T01:59:39.306787] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:39.451318] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:39.481617] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:39.506739] [DEBUG] [LOCAL ] COF: Loaded 54389 existing records from primary storage. [2025-09-29T01:59:39.507549] [INFO ] [MAIN ] COF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:39.508492] [INFO ] [MAIN ] Update Progress: 504/2371 symbols completed. COF took 1.0s. Estimated remaining: 8m 31s. Rate: 219.1 symbols/min [2025-09-29T01:59:39.745335] [DEBUG] [LOCAL ] COHR: Loaded 54144 existing records from primary storage. [2025-09-29T01:59:39.746265] [INFO ] [MAIN ] COHR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:39.747264] [INFO ] [MAIN ] Update Progress: 505/2371 symbols completed. COHR took 1.0s. Estimated remaining: 8m 31s. Rate: 219.1 symbols/min [2025-09-29T01:59:39.817314] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:39.919059] [DEBUG] [LOCAL ] COMP: Loaded 54166 existing records from primary storage. [2025-09-29T01:59:39.970992] [INFO ] [MAIN ] COMP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:40.014153] [INFO ] [MAIN ] Update Progress: 506/2371 symbols completed. COMP took 1.0s. Estimated remaining: 8m 31s. Rate: 219.2 symbols/min [2025-09-29T01:59:40.018936] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:40.043926] [DEBUG] [LOCAL ] COLD: Loaded 52785 existing records from primary storage. [2025-09-29T01:59:40.122221] [INFO ] [MAIN ] COLD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:40.150615] [INFO ] [MAIN ] Update Progress: 507/2371 symbols completed. COLD took 1.2s. Estimated remaining: 8m 30s. Rate: 219.4 symbols/min [2025-09-29T01:59:40.230310] [DEBUG] [LOCAL ] COOK: Loaded 24850 existing records from primary storage. [2025-09-29T01:59:40.258434] [INFO ] [MAIN ] COOK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:40.303737] [INFO ] [MAIN ] Update Progress: 508/2371 symbols completed. COOK took 0.6s. Estimated remaining: 8m 29s. Rate: 219.6 symbols/min [2025-09-29T01:59:40.321376] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:40.356940] [DEBUG] [LOCAL ] CON: Loaded 39289 existing records from primary storage. [2025-09-29T01:59:40.443074] [INFO ] [MAIN ] CON: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:40.464242] [INFO ] [MAIN ] Update Progress: 509/2371 symbols completed. CON took 1.0s. Estimated remaining: 8m 28s. Rate: 219.7 symbols/min [2025-09-29T01:59:40.692690] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:40.770668] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:40.832862] [DEBUG] [LOCAL ] COP: Loaded 54507 existing records from primary storage. [2025-09-29T01:59:40.860268] [INFO ] [MAIN ] COP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:40.885462] [INFO ] [MAIN ] Update Progress: 510/2371 symbols completed. COP took 0.9s. Estimated remaining: 8m 29s. Rate: 219.5 symbols/min [2025-09-29T01:59:40.886768] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:41.137590] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:41.189456] [DEBUG] [LOCAL ] COTY: Loaded 54014 existing records from primary storage. [2025-09-29T01:59:41.187725] [DEBUG] [LOCAL ] COR: Loaded 47937 existing records from primary storage. [2025-09-29T01:59:41.190348] [INFO ] [MAIN ] COTY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:41.203781] [INFO ] [MAIN ] COR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:41.204479] [INFO ] [MAIN ] Update Progress: 511/2371 symbols completed. COTY took 0.9s. Estimated remaining: 8m 29s. Rate: 219.4 symbols/min [2025-09-29T01:59:41.207390] [INFO ] [MAIN ] Update Progress: 512/2371 symbols completed. COR took 1.0s. Estimated remaining: 8m 27s. Rate: 219.9 symbols/min [2025-09-29T01:59:41.245747] [DEBUG] [LOCAL ] COUR: Loaded 49636 existing records from primary storage. [2025-09-29T01:59:41.282202] [INFO ] [MAIN ] COUR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:41.340357] [INFO ] [MAIN ] Update Progress: 513/2371 symbols completed. COUR took 0.8s. Estimated remaining: 8m 27s. Rate: 220.1 symbols/min [2025-09-29T01:59:41.653190] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:41.833884] [DEBUG] [LOCAL ] CP: Loaded 54051 existing records from primary storage. [2025-09-29T01:59:41.838404] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:41.868704] [INFO ] [MAIN ] CP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:41.868959] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-09-29T01:59:41.869939] [INFO ] [MAIN ] Update Progress: 514/2371 symbols completed. CP took 1.0s. Estimated remaining: 8m 27s. Rate: 219.7 symbols/min [2025-09-29T01:59:41.868353] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:41.869179] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-09-29T01:59:41.905297] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-09-29T01:59:41.905578] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-09-29T01:59:41.905716] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-09-29T01:59:41.905795] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-09-29T01:59:42.139029] [DEBUG] [LOCAL ] CPA: Loaded 29208 existing records from primary storage. [2025-09-29T01:59:42.203689] [INFO ] [MAIN ] CPA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:42.267623] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:42.268575] [INFO ] [MAIN ] Update Progress: 515/2371 symbols completed. CPA took 1.1s. Estimated remaining: 8m 27s. Rate: 219.5 symbols/min [2025-09-29T01:59:42.474925] [DEBUG] [LOCAL ] CPAY: Loaded 31286 existing records from primary storage. [2025-09-29T01:59:42.517912] [INFO ] [MAIN ] CPAY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:42.570246] [INFO ] [MAIN ] Update Progress: 516/2371 symbols completed. CPAY took 1.2s. Estimated remaining: 8m 27s. Rate: 219.4 symbols/min [2025-09-29T01:59:42.602434] [DEBUG] [LOCAL ] CPF: Loaded 15618 existing records from primary storage. [2025-09-29T01:59:42.653426] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:42.679630] [INFO ] [MAIN ] CPF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:42.728716] [INFO ] [MAIN ] Update Progress: 517/2371 symbols completed. CPF took 0.9s. Estimated remaining: 8m 27s. Rate: 219.6 symbols/min [2025-09-29T01:59:42.807803] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:59:42.849989] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2024-12. [2025-09-29T01:59:42.910761] [DEBUG] [LOCAL ] CPK: Loaded 13588 existing records from primary storage. [2025-09-29T01:59:42.939715] [INFO ] [MAIN ] CPK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:42.939429] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:42.940012] [INFO ] [MAIN ] Update Progress: 518/2371 symbols completed. CPK took 0.7s. Estimated remaining: 8m 26s. Rate: 219.7 symbols/min [2025-09-29T01:59:43.000201] [DEBUG] [LOCAL ] CPNG: Loaded 54450 existing records from primary storage. [2025-09-29T01:59:43.000817] [INFO ] [MAIN ] CPNG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:43.001735] [INFO ] [MAIN ] Update Progress: 519/2371 symbols completed. CPNG took 0.4s. Estimated remaining: 8m 25s. Rate: 220.0 symbols/min [2025-09-29T01:59:43.212855] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-29T01:59:43.214259] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-09-29T01:59:43.478700] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-09-29T01:59:43.479920] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-09-29T01:59:43.684148] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.20 seconds). [2025-09-29T01:59:43.685312] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-09-29T01:59:43.888633] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.20 seconds). [2025-09-29T01:59:43.889882] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-09-29T01:59:44.008841] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.12 seconds). [2025-09-29T01:59:44.010154] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-09-29T01:59:44.211831] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.20 seconds). [2025-09-29T01:59:44.212952] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-09-29T01:59:44.414382] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.20 seconds). [2025-09-29T01:59:44.415458] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-09-29T01:59:44.691537] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-09-29T01:59:44.692801] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-09-29T01:59:44.892248] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.20 seconds). [2025-09-29T01:59:44.893381] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-09-29T01:59:45.178530] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-09-29T01:59:45.179513] [INFO ] [REMOTE ] CPAC: Full fetch complete (1887 records). [2025-09-29T01:59:45.179627] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-09-29T01:59:45.381752] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-29T01:59:45.381962] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-09-29T01:59:45.382034] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-09-29T01:59:45.382119] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-09-29T01:59:45.382226] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-09-29T01:59:45.382300] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-09-29T01:59:45.382381] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-09-29T01:59:45.382478] [INFO ] [MAIN ] Update Progress: 520/2371 symbols completed. CPAC took 4.1s. Estimated remaining: 8m 32s. Rate: 216.8 symbols/min [2025-09-29T01:59:46.256521] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:46.306521] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:46.383584] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:46.430270] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:46.456801] [DEBUG] [LOCAL ] CQP: Loaded 20033 existing records from primary storage. [2025-09-29T01:59:46.457544] [INFO ] [MAIN ] CQP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:46.458247] [INFO ] [MAIN ] Update Progress: 521/2371 symbols completed. CQP took 1.1s. Estimated remaining: 8m 35s. Rate: 215.6 symbols/min [2025-09-29T01:59:46.562557] [DEBUG] [LOCAL ] CPS: Loaded 26476 existing records from primary storage. [2025-09-29T01:59:46.605408] [INFO ] [MAIN ] CPS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:46.633351] [INFO ] [MAIN ] Update Progress: 522/2371 symbols completed. CPS took 1.2s. Estimated remaining: 8m 34s. Rate: 215.8 symbols/min [2025-09-29T01:59:46.874390] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:46.948901] [DEBUG] [LOCAL ] CPRI: Loaded 53326 existing records from primary storage. [2025-09-29T01:59:46.974479] [DEBUG] [LOCAL ] CPT: Loaded 45034 existing records from primary storage. [2025-09-29T01:59:46.980018] [INFO ] [MAIN ] CPRI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:46.980415] [INFO ] [MAIN ] CPT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:47.001910] [INFO ] [MAIN ] Update Progress: 523/2371 symbols completed. CPRI took 1.6s. Estimated remaining: 8m 34s. Rate: 215.6 symbols/min [2025-09-29T01:59:47.039615] [INFO ] [MAIN ] Update Progress: 524/2371 symbols completed. CPT took 1.6s. Estimated remaining: 8m 33s. Rate: 216.0 symbols/min [2025-09-29T01:59:47.089825] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:47.296271] [DEBUG] [LOCAL ] CRBD: Loaded 9131 existing records from primary storage. [2025-09-29T01:59:47.334119] [DEBUG] [LOCAL ] CR: Loaded 25019 existing records from primary storage. [2025-09-29T01:59:47.360272] [INFO ] [MAIN ] CRBD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:47.405114] [INFO ] [MAIN ] Update Progress: 525/2371 symbols completed. CRBD took 0.7s. Estimated remaining: 8m 33s. Rate: 215.9 symbols/min [2025-09-29T01:59:47.400591] [INFO ] [MAIN ] CR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:47.430819] [INFO ] [MAIN ] Update Progress: 526/2371 symbols completed. CR took 1.0s. Estimated remaining: 8m 32s. Rate: 216.2 symbols/min [2025-09-29T01:59:47.509164] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:47.695137] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:47.893937] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:47.907680] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-09-29T01:59:47.909874] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-09-29T01:59:47.910133] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-09-29T01:59:47.910214] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-09-29T01:59:47.910332] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-09-29T01:59:47.910411] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-09-29T01:59:47.954831] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:48.139572] [DEBUG] [LOCAL ] CRBG: Loaded 53110 existing records from primary storage. [2025-09-29T01:59:48.171291] [INFO ] [MAIN ] CRBG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:48.232978] [INFO ] [MAIN ] Update Progress: 527/2371 symbols completed. CRBG took 1.2s. Estimated remaining: 8m 33s. Rate: 215.5 symbols/min [2025-09-29T01:59:48.277274] [DEBUG] [LOCAL ] CRC: Loaded 44946 existing records from primary storage. [2025-09-29T01:59:48.454891] [INFO ] [MAIN ] CRC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:48.468312] [INFO ] [MAIN ] Update Progress: 528/2371 symbols completed. CRC took 1.4s. Estimated remaining: 8m 33s. Rate: 215.5 symbols/min [2025-09-29T01:59:48.678445] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:59:48.680090] [DEBUG] [LOCAL ] CRGY: Loaded 53290 existing records from primary storage. [2025-09-29T01:59:48.726141] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:48.747817] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2024-12. [2025-09-29T01:59:48.759503] [INFO ] [MAIN ] CRGY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:48.776722] [INFO ] [MAIN ] Update Progress: 529/2371 symbols completed. CRGY took 1.3s. Estimated remaining: 8m 33s. Rate: 215.5 symbols/min [2025-09-29T01:59:48.924503] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:59:48.962904] [WARN ] [REMOTE ] CRCL: No data returned for month 2024-12 [2025-09-29T01:59:48.963083] [FATAL] [REMOTE ] CRCL: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:59:48.995031] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:48.995102] [FATAL] [MAIN ] CRCL: Failed to fetch primary data. [2025-09-29T01:59:49.006773] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:59:49.029554] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-09-29T01:59:49.095381] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-09-29T01:59:49.094339] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:49.096042] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-09-29T01:59:49.111536] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-09-29T01:59:49.112177] [INFO ] [MAIN ] Update Progress: 530/2371 symbols completed. CRCL took 1.7s. Estimated remaining: 8m 33s. Rate: 215.4 symbols/min [2025-09-29T01:59:49.150728] [DEBUG] [LOCAL ] CRH: Loaded 54243 existing records from primary storage. [2025-09-29T01:59:49.169858] [INFO ] [MAIN ] CRH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:49.184746] [INFO ] [MAIN ] Update Progress: 531/2371 symbols completed. CRH took 0.9s. Estimated remaining: 8m 32s. Rate: 215.7 symbols/min [2025-09-29T01:59:49.491299] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:49.556893] [DEBUG] [LOCAL ] CRK: Loaded 52891 existing records from primary storage. [2025-09-29T01:59:49.589106] [DEBUG] [LOCAL ] CRI: Loaded 50713 existing records from primary storage. [2025-09-29T01:59:49.613148] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:49.613691] [INFO ] [MAIN ] CRK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:49.615053] [INFO ] [MAIN ] Update Progress: 532/2371 symbols completed. CRK took 0.8s. Estimated remaining: 8m 32s. Rate: 215.5 symbols/min [2025-09-29T01:59:49.613907] [INFO ] [MAIN ] CRI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:49.629705] [INFO ] [MAIN ] Update Progress: 533/2371 symbols completed. CRI took 1.1s. Estimated remaining: 8m 31s. Rate: 215.9 symbols/min [2025-09-29T01:59:49.998939] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:50.065088] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:50.068133] [DEBUG] [LOCAL ] CRL: Loaded 43853 existing records from primary storage. [2025-09-29T01:59:50.071907] [INFO ] [MAIN ] CRL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:50.073850] [INFO ] [MAIN ] Update Progress: 534/2371 symbols completed. CRL took 1.0s. Estimated remaining: 8m 31s. Rate: 215.6 symbols/min [2025-09-29T01:59:50.133818] [DEBUG] [LOCAL ] CRT: Loaded 5018 existing records from primary storage. [2025-09-29T01:59:50.162556] [INFO ] [MAIN ] CRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:50.179355] [INFO ] [MAIN ] Update Progress: 535/2371 symbols completed. CRT took 0.5s. Estimated remaining: 8m 30s. Rate: 215.9 symbols/min [2025-09-29T01:59:50.201680] [DEBUG] [LOCAL ] CRM: Loaded 54550 existing records from primary storage. [2025-09-29T01:59:50.241745] [INFO ] [MAIN ] CRM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:50.261977] [INFO ] [MAIN ] Update Progress: 536/2371 symbols completed. CRM took 1.0s. Estimated remaining: 8m 29s. Rate: 216.2 symbols/min [2025-09-29T01:59:50.487363] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:50.596108] [DEBUG] [LOCAL ] CRS: Loaded 43928 existing records from primary storage. [2025-09-29T01:59:50.638236] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:50.648538] [INFO ] [MAIN ] CRS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:50.670481] [INFO ] [MAIN ] Update Progress: 537/2371 symbols completed. CRS took 1.1s. Estimated remaining: 8m 30s. Rate: 216.0 symbols/min [2025-09-29T01:59:50.783451] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:50.943256] [DEBUG] [LOCAL ] CSAN: Loaded 42951 existing records from primary storage. [2025-09-29T01:59:50.963687] [INFO ] [MAIN ] CSAN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:50.968578] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:50.983981] [INFO ] [MAIN ] Update Progress: 538/2371 symbols completed. CSAN took 0.9s. Estimated remaining: 8m 29s. Rate: 215.9 symbols/min [2025-09-29T01:59:50.984468] [DEBUG] [LOCAL ] CSR: Loaded 12808 existing records from primary storage. [2025-09-29T01:59:51.016419] [DEBUG] [LOCAL ] CSL: Loaded 32100 existing records from primary storage. [2025-09-29T01:59:51.033740] [INFO ] [MAIN ] CSR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:51.052073] [INFO ] [MAIN ] Update Progress: 539/2371 symbols completed. CSR took 0.8s. Estimated remaining: 8m 28s. Rate: 216.2 symbols/min [2025-09-29T01:59:51.044554] [INFO ] [MAIN ] CSL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:51.057836] [INFO ] [MAIN ] Update Progress: 540/2371 symbols completed. CSL took 0.9s. Estimated remaining: 8m 27s. Rate: 216.6 symbols/min [2025-09-29T01:59:51.449241] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:51.631176] [DEBUG] [LOCAL ] CSTM: Loaded 48360 existing records from primary storage. [2025-09-29T01:59:51.629411] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:51.637212] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:51.638347] [INFO ] [MAIN ] CSTM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:51.639195] [INFO ] [MAIN ] Update Progress: 541/2371 symbols completed. CSTM took 0.9s. Estimated remaining: 8m 28s. Rate: 216.2 symbols/min [2025-09-29T01:59:51.638683] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-09-29T01:59:51.639564] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-09-29T01:59:51.639717] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-09-29T01:59:51.639905] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-09-29T01:59:51.640053] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-09-29T01:59:51.640127] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-09-29T01:59:51.710509] [DEBUG] [LOCAL ] CSV: Loaded 13198 existing records from primary storage. [2025-09-29T01:59:51.813024] [INFO ] [MAIN ] CSV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:51.858752] [DEBUG] [LOCAL ] CTBB: Loaded 7168 existing records from primary storage. [2025-09-29T01:59:51.858299] [INFO ] [MAIN ] Update Progress: 542/2371 symbols completed. CSV took 0.9s. Estimated remaining: 8m 27s. Rate: 216.3 symbols/min [2025-09-29T01:59:51.874796] [INFO ] [MAIN ] CTBB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:51.915928] [INFO ] [MAIN ] Update Progress: 543/2371 symbols completed. CTBB took 0.8s. Estimated remaining: 8m 26s. Rate: 216.6 symbols/min [2025-09-29T01:59:52.339735] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:52.579171] [DEBUG] [LOCAL ] CTDD: Loaded 5947 existing records from primary storage. [2025-09-29T01:59:52.636138] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:52.636370] [INFO ] [MAIN ] CTDD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:52.594424] [INFO ] [MAIN ] CTEST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:52.653024] [INFO ] [MAIN ] Update Progress: 544/2371 symbols completed. CTDD took 1.0s. Estimated remaining: 8m 28s. Rate: 215.9 symbols/min [2025-09-29T01:59:52.652852] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-09-29T01:59:52.680120] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-09-29T01:59:52.669578] [DEBUG] [LOCAL ] CTEST: No existing data file found in primary storage. [2025-09-29T01:59:52.713906] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-09-29T01:59:52.704837] [WARN ] [MAIN ] CTEST: No existing data found, performing full refresh instead. [2025-09-29T01:59:52.735796] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:59:52.746430] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-09-29T01:59:52.800862] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-09-29T01:59:52.759538] [INFO ] [REMOTE ] CSW: Fetching primary data for 2024-12. [2025-09-29T01:59:52.800997] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-09-29T01:59:52.746631] [INFO ] [MAIN ] CTEST: Wiping existing primary data before full refresh. [2025-09-29T01:59:52.835055] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-09-29T01:59:52.953708] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-09-29T01:59:52.982282] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:59:52.958092] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:52.998186] [WARN ] [REMOTE ] CSW: No data returned for month 2024-12 [2025-09-29T01:59:52.992771] [INFO ] [MAIN ] CTEST: Starting full primary refresh. [2025-09-29T01:59:53.013865] [FATAL] [REMOTE ] CSW: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:59:53.048720] [FATAL] [MAIN ] CSW: Failed to fetch primary data. [2025-09-29T01:59:53.120130] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:59:53.147161] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-09-29T01:59:53.173236] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-09-29T01:59:53.206164] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-09-29T01:59:53.275537] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-09-29T01:59:53.284900] [INFO ] [MAIN ] Update Progress: 545/2371 symbols completed. CSW took 2.2s. Estimated remaining: 8m 29s. Rate: 215.4 symbols/min [2025-09-29T01:59:53.506960] [DEBUG] [LOCAL ] CTO: Loaded 28661 existing records from primary storage. [2025-09-29T01:59:53.581471] [INFO ] [MAIN ] CTO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:53.648582] [INFO ] [MAIN ] Update Progress: 546/2371 symbols completed. CTO took 1.0s. Estimated remaining: 8m 29s. Rate: 215.3 symbols/min [2025-09-29T01:59:53.829932] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:54.035748] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:59:54.154585] [INFO ] [REMOTE ] CTEST: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:59:54.154996] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2024-12. [2025-09-29T01:59:54.094948] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2024-12. [2025-09-29T01:59:54.238375] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:54.265811] [DEBUG] [LOCAL ] CTOS: Loaded 37246 existing records from primary storage. [2025-09-29T01:59:54.266247] [INFO ] [MAIN ] CTOS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:54.266352] [INFO ] [MAIN ] Update Progress: 547/2371 symbols completed. CTOS took 1.0s. Estimated remaining: 8m 29s. Rate: 214.8 symbols/min [2025-09-29T01:59:54.300256] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:59:54.339846] [WARN ] [REMOTE ] CTEST: No data returned for month 2024-12 [2025-09-29T01:59:54.329040] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T01:59:54.356240] [FATAL] [REMOTE ] CTEST: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:59:54.373537] [FATAL] [MAIN ] CTEST: Failed to fetch primary data. [2025-09-29T01:59:54.378976] [WARN ] [REMOTE ] CTEV: No data returned for month 2024-12 [2025-09-29T01:59:54.390195] [WARN ] [MAIN ] CTEST: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:59:54.390718] [FATAL] [REMOTE ] CTEV: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T01:59:54.390825] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-09-29T01:59:54.401827] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-09-29T01:59:54.412271] [FATAL] [MAIN ] CTEV: Failed to fetch primary data. [2025-09-29T01:59:54.434631] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T01:59:54.417831] [INFO ] [LOCAL ] CTEST: Starting deletion of derivative data. [2025-09-29T01:59:54.519183] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:54.519338] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-09-29T01:59:54.520126] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-09-29T01:59:54.519676] [DEBUG] [LOCAL ] CTEST: No derivative data file found to delete. [2025-09-29T01:59:54.520257] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-09-29T01:59:54.520424] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-09-29T01:59:54.520534] [INFO ] [MAIN ] Update Progress: 548/2371 symbols completed. CTEV took 2.6s. Estimated remaining: 8m 29s. Rate: 214.8 symbols/min [2025-09-29T01:59:54.527209] [INFO ] [MAIN ] Update Progress: 549/2371 symbols completed. CTEST took 2.6s. Estimated remaining: 8m 28s. Rate: 215.2 symbols/min [2025-09-29T01:59:54.712842] [DEBUG] [LOCAL ] CTRA: Loaded 54428 existing records from primary storage. [2025-09-29T01:59:54.759112] [INFO ] [MAIN ] CTRA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:54.896684] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:54.864622] [INFO ] [MAIN ] Update Progress: 550/2371 symbols completed. CTRA took 1.1s. Estimated remaining: 8m 28s. Rate: 215.1 symbols/min [2025-09-29T01:59:55.094278] [DEBUG] [LOCAL ] CTRE: Loaded 49964 existing records from primary storage. [2025-09-29T01:59:55.087425] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:55.130506] [INFO ] [MAIN ] CTRE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:55.152802] [INFO ] [MAIN ] Update Progress: 551/2371 symbols completed. CTRE took 0.9s. Estimated remaining: 8m 28s. Rate: 215.1 symbols/min [2025-09-29T01:59:55.297455] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:55.358878] [DEBUG] [LOCAL ] CTRI: Loaded 38571 existing records from primary storage. [2025-09-29T01:59:55.378933] [INFO ] [MAIN ] CTRI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:55.390442] [INFO ] [MAIN ] Update Progress: 552/2371 symbols completed. CTRI took 0.9s. Estimated remaining: 8m 27s. Rate: 215.2 symbols/min [2025-09-29T01:59:55.414784] [DEBUG] [LOCAL ] CTS: Loaded 19637 existing records from primary storage. [2025-09-29T01:59:55.459485] [INFO ] [MAIN ] CTS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:55.508132] [INFO ] [MAIN ] Update Progress: 553/2371 symbols completed. CTS took 0.9s. Estimated remaining: 8m 26s. Rate: 215.4 symbols/min [2025-09-29T01:59:55.496339] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:55.535561] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-09-29T01:59:55.596560] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-09-29T01:59:55.668079] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-09-29T01:59:55.727010] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-09-29T01:59:55.749390] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-09-29T01:59:55.777249] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-09-29T01:59:55.849967] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:55.918361] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:55.960884] [DEBUG] [LOCAL ] CTVA: Loaded 54002 existing records from primary storage. [2025-09-29T01:59:56.006870] [INFO ] [MAIN ] CTVA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:56.021358] [INFO ] [MAIN ] Update Progress: 554/2371 symbols completed. CTVA took 1.1s. Estimated remaining: 8m 27s. Rate: 215.1 symbols/min [2025-09-29T01:59:56.354282] [DEBUG] [LOCAL ] CUBI: Loaded 27667 existing records from primary storage. [2025-09-29T01:59:56.432923] [INFO ] [MAIN ] CUBI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:56.478140] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:56.497452] [DEBUG] [LOCAL ] CUBE: Loaded 51391 existing records from primary storage. [2025-09-29T01:59:56.478432] [INFO ] [MAIN ] Update Progress: 555/2371 symbols completed. CUBI took 0.9s. Estimated remaining: 8m 27s. Rate: 214.8 symbols/min [2025-09-29T01:59:56.503895] [INFO ] [MAIN ] CUBE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:56.565399] [INFO ] [MAIN ] Update Progress: 556/2371 symbols completed. CUBE took 1.1s. Estimated remaining: 8m 26s. Rate: 215.1 symbols/min [2025-09-29T01:59:56.683015] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T01:59:56.728556] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2024-12. [2025-09-29T01:59:57.024218] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:57.052907] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:57.053122] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-09-29T01:59:57.028926] [DEBUG] [LOCAL ] CUK: Loaded 51762 existing records from primary storage. [2025-09-29T01:59:57.055439] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-09-29T01:59:57.057318] [INFO ] [MAIN ] CUK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:57.058760] [INFO ] [MAIN ] Update Progress: 557/2371 symbols completed. CUK took 1.0s. Estimated remaining: 8m 27s. Rate: 214.8 symbols/min [2025-09-29T01:59:57.064075] [DEBUG] [LOCAL ] CULP: Loaded 3111 existing records from primary storage. [2025-09-29T01:59:57.064412] [INFO ] [MAIN ] CULP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:57.064771] [INFO ] [MAIN ] Update Progress: 558/2371 symbols completed. CULP took 0.5s. Estimated remaining: 8m 26s. Rate: 215.2 symbols/min [2025-09-29T01:59:57.099069] [DEBUG] [LOCAL ] CURB: Loaded 33350 existing records from primary storage. [2025-09-29T01:59:57.099469] [INFO ] [MAIN ] CURB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:57.099965] [INFO ] [MAIN ] Update Progress: 559/2371 symbols completed. CURB took 0.5s. Estimated remaining: 8m 24s. Rate: 215.5 symbols/min [2025-09-29T01:59:57.251449] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.20 seconds). [2025-09-29T01:59:57.252436] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-09-29T01:59:57.451322] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.20 seconds). [2025-09-29T01:59:57.452411] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-09-29T01:59:57.648864] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.20 seconds). [2025-09-29T01:59:57.649916] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-09-29T01:59:57.851945] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.20 seconds). [2025-09-29T01:59:57.853167] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-09-29T01:59:58.054789] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.20 seconds). [2025-09-29T01:59:58.055802] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-09-29T01:59:58.180972] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.13 seconds). [2025-09-29T01:59:58.181934] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-09-29T01:59:58.376092] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.19 seconds). [2025-09-29T01:59:58.377176] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-09-29T01:59:58.572404] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.20 seconds). [2025-09-29T01:59:58.573508] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-09-29T01:59:58.766082] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.19 seconds). [2025-09-29T01:59:58.766976] [INFO ] [REMOTE ] CUBB: Full fetch complete (928 records). [2025-09-29T01:59:58.767077] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-09-29T01:59:58.965139] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-29T01:59:58.965355] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-09-29T01:59:58.965428] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-09-29T01:59:58.965504] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-09-29T01:59:58.965600] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-09-29T01:59:58.965694] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-09-29T01:59:58.965806] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-09-29T01:59:58.965909] [INFO ] [MAIN ] Update Progress: 560/2371 symbols completed. CUBB took 3.8s. Estimated remaining: 8m 29s. Rate: 213.4 symbols/min [2025-09-29T01:59:59.700473] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:59.705310] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:59.718534] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:59.775304] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T01:59:59.803736] [DEBUG] [LOCAL ] CVEO: Loaded 15402 existing records from primary storage. [2025-09-29T01:59:59.813280] [INFO ] [MAIN ] CVEO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:59.813444] [INFO ] [MAIN ] Update Progress: 561/2371 symbols completed. CVEO took 0.8s. Estimated remaining: 8m 31s. Rate: 212.6 symbols/min [2025-09-29T01:59:59.819584] [DEBUG] [LOCAL ] CURV: Loaded 26933 existing records from primary storage. [2025-09-29T01:59:59.841834] [INFO ] [MAIN ] CURV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T01:59:59.868801] [INFO ] [MAIN ] Update Progress: 562/2371 symbols completed. CURV took 0.9s. Estimated remaining: 8m 30s. Rate: 212.9 symbols/min [2025-09-29T02:00:00.236370] [DEBUG] [LOCAL ] CVE: Loaded 54336 existing records from primary storage. [2025-09-29T02:00:00.213747] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:00.244408] [INFO ] [MAIN ] CVE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:00.255792] [INFO ] [MAIN ] Update Progress: 563/2371 symbols completed. CVE took 1.3s. Estimated remaining: 8m 30s. Rate: 212.8 symbols/min [2025-09-29T02:00:00.287452] [DEBUG] [LOCAL ] CUZ: Loaded 50140 existing records from primary storage. [2025-09-29T02:00:00.311438] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:00.329104] [INFO ] [MAIN ] CUZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:00.329502] [INFO ] [MAIN ] Update Progress: 564/2371 symbols completed. CUZ took 1.4s. Estimated remaining: 8m 29s. Rate: 213.0 symbols/min [2025-09-29T02:00:00.534590] [DEBUG] [LOCAL ] CVLG: Loaded 15730 existing records from primary storage. [2025-09-29T02:00:00.558951] [INFO ] [MAIN ] CVLG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:00.566867] [INFO ] [MAIN ] Update Progress: 565/2371 symbols completed. CVLG took 0.7s. Estimated remaining: 8m 29s. Rate: 213.1 symbols/min [2025-09-29T02:00:00.845519] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:00.858593] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:00.860368] [DEBUG] [LOCAL ] CVI: Loaded 47160 existing records from primary storage. [2025-09-29T02:00:00.917893] [INFO ] [MAIN ] CVI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:00.948519] [INFO ] [MAIN ] Update Progress: 566/2371 symbols completed. CVI took 1.1s. Estimated remaining: 8m 29s. Rate: 213.0 symbols/min [2025-09-29T02:00:00.979089] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:01.234445] [DEBUG] [LOCAL ] CVS: Loaded 54476 existing records from primary storage. [2025-09-29T02:00:01.259459] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:01.259783] [INFO ] [MAIN ] CVS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:01.281136] [INFO ] [MAIN ] Update Progress: 567/2371 symbols completed. CVS took 0.9s. Estimated remaining: 8m 28s. Rate: 212.9 symbols/min [2025-09-29T02:00:01.310835] [DEBUG] [LOCAL ] CVNA: Loaded 53766 existing records from primary storage. [2025-09-29T02:00:01.333938] [INFO ] [MAIN ] CVNA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:01.359993] [INFO ] [MAIN ] Update Progress: 568/2371 symbols completed. CVNA took 1.1s. Estimated remaining: 8m 27s. Rate: 213.2 symbols/min [2025-09-29T02:00:01.491337] [DEBUG] [LOCAL ] CVX: Loaded 54540 existing records from primary storage. [2025-09-29T02:00:01.576149] [INFO ] [MAIN ] CVX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:01.582307] [DEBUG] [LOCAL ] CW: Loaded 22705 existing records from primary storage. [2025-09-29T02:00:01.603523] [INFO ] [MAIN ] CW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:01.603292] [INFO ] [MAIN ] Update Progress: 569/2371 symbols completed. CVX took 1.0s. Estimated remaining: 8m 27s. Rate: 213.2 symbols/min [2025-09-29T02:00:01.637153] [INFO ] [MAIN ] Update Progress: 570/2371 symbols completed. CW took 0.7s. Estimated remaining: 8m 26s. Rate: 213.5 symbols/min [2025-09-29T02:00:01.739799] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:02.008975] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:02.171011] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:02.244928] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:02.304860] [DEBUG] [LOCAL ] CWAN: Loaded 53154 existing records from primary storage. [2025-09-29T02:00:02.317853] [INFO ] [MAIN ] CWAN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:02.318377] [INFO ] [MAIN ] Update Progress: 571/2371 symbols completed. CWAN took 1.0s. Estimated remaining: 8m 27s. Rate: 213.0 symbols/min [2025-09-29T02:00:02.481087] [DEBUG] [LOCAL ] CWEN: Loaded 45717 existing records from primary storage. [2025-09-29T02:00:02.496095] [INFO ] [MAIN ] CWEN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:02.535261] [INFO ] [MAIN ] Update Progress: 572/2371 symbols completed. CWEN took 1.1s. Estimated remaining: 8m 27s. Rate: 213.1 symbols/min [2025-09-29T02:00:02.646272] [DEBUG] [LOCAL ] CWK: Loaded 50158 existing records from primary storage. [2025-09-29T02:00:02.669482] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:02.675127] [INFO ] [MAIN ] CWK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:02.720611] [INFO ] [MAIN ] Update Progress: 573/2371 symbols completed. CWK took 1.0s. Estimated remaining: 8m 26s. Rate: 213.2 symbols/min [2025-09-29T02:00:02.747540] [DEBUG] [LOCAL ] CWH: Loaded 52151 existing records from primary storage. [2025-09-29T02:00:02.829716] [INFO ] [MAIN ] CWH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:02.854806] [INFO ] [MAIN ] Update Progress: 574/2371 symbols completed. CWH took 1.3s. Estimated remaining: 8m 25s. Rate: 213.4 symbols/min [2025-09-29T02:00:03.051596] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:03.141256] [DEBUG] [LOCAL ] CWT: Loaded 28294 existing records from primary storage. [2025-09-29T02:00:03.217522] [INFO ] [MAIN ] CWT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:03.232529] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:03.249187] [INFO ] [MAIN ] Update Progress: 575/2371 symbols completed. CWT took 0.9s. Estimated remaining: 8m 25s. Rate: 213.3 symbols/min [2025-09-29T02:00:03.324295] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:03.408830] [DEBUG] [LOCAL ] CXE: Loaded 7247 existing records from primary storage. [2025-09-29T02:00:03.438361] [DEBUG] [LOCAL ] CXH: Loaded 4436 existing records from primary storage. [2025-09-29T02:00:03.445397] [INFO ] [MAIN ] CXE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:03.473214] [INFO ] [MAIN ] CXH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:03.473821] [INFO ] [MAIN ] Update Progress: 576/2371 symbols completed. CXE took 0.7s. Estimated remaining: 8m 25s. Rate: 213.3 symbols/min [2025-09-29T02:00:03.485785] [INFO ] [MAIN ] Update Progress: 577/2371 symbols completed. CXH took 0.6s. Estimated remaining: 8m 24s. Rate: 213.7 symbols/min [2025-09-29T02:00:03.697748] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:03.746724] [DEBUG] [LOCAL ] CX: Loaded 53603 existing records from primary storage. [2025-09-29T02:00:03.844793] [INFO ] [MAIN ] CX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:03.861177] [INFO ] [MAIN ] Update Progress: 578/2371 symbols completed. CX took 1.3s. Estimated remaining: 8m 24s. Rate: 213.6 symbols/min [2025-09-29T02:00:04.077757] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:04.147694] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:04.319702] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:04.322164] [DEBUG] [LOCAL ] CXM: Loaded 48607 existing records from primary storage. [2025-09-29T02:00:04.323419] [INFO ] [MAIN ] CXM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:04.323896] [INFO ] [MAIN ] Update Progress: 579/2371 symbols completed. CXM took 1.0s. Estimated remaining: 8m 24s. Rate: 213.3 symbols/min [2025-09-29T02:00:04.509389] [DEBUG] [LOCAL ] CXT: Loaded 31611 existing records from primary storage. [2025-09-29T02:00:04.535848] [DEBUG] [LOCAL ] CXW: Loaded 44899 existing records from primary storage. [2025-09-29T02:00:04.536037] [INFO ] [MAIN ] CXT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:04.559289] [INFO ] [MAIN ] Update Progress: 580/2371 symbols completed. CXT took 1.1s. Estimated remaining: 8m 24s. Rate: 213.4 symbols/min [2025-09-29T02:00:04.565306] [DEBUG] [LOCAL ] CYD: Loaded 27145 existing records from primary storage. [2025-09-29T02:00:04.559155] [INFO ] [MAIN ] CXW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:04.644587] [INFO ] [MAIN ] Update Progress: 581/2371 symbols completed. CXW took 1.1s. Estimated remaining: 8m 23s. Rate: 213.7 symbols/min [2025-09-29T02:00:04.653008] [INFO ] [MAIN ] CYD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:04.655385] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:04.689914] [INFO ] [MAIN ] Update Progress: 582/2371 symbols completed. CYD took 0.8s. Estimated remaining: 8m 22s. Rate: 214.0 symbols/min [2025-09-29T02:00:05.131771] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:05.160954] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:05.308443] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:05.314523] [DEBUG] [LOCAL ] DAC: Loaded 12769 existing records from primary storage. [2025-09-29T02:00:05.315158] [INFO ] [MAIN ] DAC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:05.315618] [INFO ] [MAIN ] Update Progress: 583/2371 symbols completed. DAC took 0.6s. Estimated remaining: 8m 22s. Rate: 213.5 symbols/min [2025-09-29T02:00:05.317469] [DEBUG] [LOCAL ] CYH: Loaded 48352 existing records from primary storage. [2025-09-29T02:00:05.323580] [INFO ] [MAIN ] CYH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:05.337124] [INFO ] [MAIN ] Update Progress: 584/2371 symbols completed. CYH took 1.0s. Estimated remaining: 8m 21s. Rate: 213.8 symbols/min [2025-09-29T02:00:05.668817] [DEBUG] [LOCAL ] D: Loaded 54426 existing records from primary storage. [2025-09-29T02:00:05.716683] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:05.752614] [INFO ] [MAIN ] D: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:05.795511] [INFO ] [MAIN ] Update Progress: 585/2371 symbols completed. D took 1.2s. Estimated remaining: 8m 22s. Rate: 213.6 symbols/min [2025-09-29T02:00:05.793907] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:05.834368] [DEBUG] [LOCAL ] DAL: Loaded 54533 existing records from primary storage. [2025-09-29T02:00:05.857617] [INFO ] [MAIN ] DAL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:05.869621] [INFO ] [MAIN ] Update Progress: 586/2371 symbols completed. DAL took 1.0s. Estimated remaining: 8m 21s. Rate: 213.9 symbols/min [2025-09-29T02:00:06.001851] [DEBUG] [LOCAL ] DAO: Loaded 21546 existing records from primary storage. [2025-09-29T02:00:06.049622] [INFO ] [MAIN ] DAO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:06.123079] [INFO ] [MAIN ] Update Progress: 587/2371 symbols completed. DAO took 0.7s. Estimated remaining: 8m 20s. Rate: 213.9 symbols/min [2025-09-29T02:00:06.217568] [DEBUG] [LOCAL ] DAN: Loaded 49753 existing records from primary storage. [2025-09-29T02:00:06.215865] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:06.244989] [INFO ] [MAIN ] DAN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:06.363931] [INFO ] [MAIN ] Update Progress: 588/2371 symbols completed. DAN took 1.0s. Estimated remaining: 8m 20s. Rate: 214.0 symbols/min [2025-09-29T02:00:06.397529] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:06.539511] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:06.754342] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:06.756628] [DEBUG] [LOCAL ] DAR: Loaded 52603 existing records from primary storage. [2025-09-29T02:00:06.771302] [INFO ] [MAIN ] DAR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:06.772077] [INFO ] [MAIN ] Update Progress: 589/2371 symbols completed. DAR took 1.0s. Estimated remaining: 8m 20s. Rate: 213.8 symbols/min [2025-09-29T02:00:06.778736] [DEBUG] [LOCAL ] DAVA: Loaded 41308 existing records from primary storage. [2025-09-29T02:00:06.823172] [INFO ] [MAIN ] DAVA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:06.851857] [INFO ] [MAIN ] Update Progress: 590/2371 symbols completed. DAVA took 0.9s. Estimated remaining: 8m 19s. Rate: 214.1 symbols/min [2025-09-29T02:00:06.978207] [DEBUG] [LOCAL ] DAY: Loaded 50491 existing records from primary storage. [2025-09-29T02:00:07.051780] [INFO ] [MAIN ] DAY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:07.094189] [INFO ] [MAIN ] Update Progress: 591/2371 symbols completed. DAY took 0.9s. Estimated remaining: 8m 19s. Rate: 214.1 symbols/min [2025-09-29T02:00:07.100600] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:07.380299] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:07.387242] [DEBUG] [LOCAL ] DB: Loaded 53377 existing records from primary storage. [2025-09-29T02:00:07.403278] [INFO ] [MAIN ] DB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:07.436198] [INFO ] [MAIN ] Update Progress: 592/2371 symbols completed. DB took 1.0s. Estimated remaining: 8m 19s. Rate: 214.0 symbols/min [2025-09-29T02:00:07.438783] [DEBUG] [LOCAL ] DBD: Loaded 24109 existing records from primary storage. [2025-09-29T02:00:07.462782] [INFO ] [MAIN ] DBD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:07.505183] [INFO ] [MAIN ] Update Progress: 593/2371 symbols completed. DBD took 0.7s. Estimated remaining: 8m 18s. Rate: 214.3 symbols/min [2025-09-29T02:00:07.669429] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:07.873054] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:07.890149] [DEBUG] [LOCAL ] DBL: Loaded 9259 existing records from primary storage. [2025-09-29T02:00:07.941479] [INFO ] [MAIN ] DBL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:07.983268] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:07.983697] [INFO ] [MAIN ] Update Progress: 594/2371 symbols completed. DBL took 0.9s. Estimated remaining: 8m 18s. Rate: 214.1 symbols/min [2025-09-29T02:00:07.978422] [DEBUG] [LOCAL ] DBI: Loaded 45524 existing records from primary storage. [2025-09-29T02:00:07.990762] [INFO ] [MAIN ] DBI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:08.020726] [INFO ] [MAIN ] Update Progress: 595/2371 symbols completed. DBI took 1.1s. Estimated remaining: 8m 17s. Rate: 214.4 symbols/min [2025-09-29T02:00:08.356243] [DEBUG] [LOCAL ] DBRG: Loaded 50526 existing records from primary storage. [2025-09-29T02:00:08.388330] [INFO ] [MAIN ] DBRG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:08.415223] [INFO ] [MAIN ] Update Progress: 596/2371 symbols completed. DBRG took 1.0s. Estimated remaining: 8m 17s. Rate: 214.2 symbols/min [2025-09-29T02:00:08.488499] [DEBUG] [LOCAL ] DCI: Loaded 38065 existing records from primary storage. [2025-09-29T02:00:08.547940] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:08.553715] [INFO ] [MAIN ] DCI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:08.532547] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:08.565371] [INFO ] [MAIN ] Update Progress: 597/2371 symbols completed. DCI took 1.0s. Estimated remaining: 8m 16s. Rate: 214.4 symbols/min [2025-09-29T02:00:08.692782] [DEBUG] [LOCAL ] DCO: Loaded 14003 existing records from primary storage. [2025-09-29T02:00:08.715386] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:08.719912] [INFO ] [MAIN ] DCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:08.720187] [INFO ] [MAIN ] Update Progress: 598/2371 symbols completed. DCO took 0.7s. Estimated remaining: 8m 16s. Rate: 214.5 symbols/min [2025-09-29T02:00:08.795782] [DEBUG] [LOCAL ] DD: Loaded 53595 existing records from primary storage. [2025-09-29T02:00:08.796396] [INFO ] [MAIN ] DD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:08.797037] [INFO ] [MAIN ] Update Progress: 599/2371 symbols completed. DD took 0.8s. Estimated remaining: 8m 15s. Rate: 214.8 symbols/min [2025-09-29T02:00:08.816732] [DEBUG] [LOCAL ] DDD: Loaded 51647 existing records from primary storage. [2025-09-29T02:00:08.817187] [INFO ] [MAIN ] DDD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:08.817737] [INFO ] [MAIN ] Update Progress: 600/2371 symbols completed. DDD took 0.4s. Estimated remaining: 8m 14s. Rate: 215.1 symbols/min [2025-09-29T02:00:09.493921] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:09.582798] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:09.576172] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:09.641088] [DEBUG] [LOCAL ] DDT: Loaded 2117 existing records from primary storage. [2025-09-29T02:00:09.638426] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:09.643775] [INFO ] [MAIN ] DDT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:09.644354] [INFO ] [MAIN ] Update Progress: 601/2371 symbols completed. DDT took 0.8s. Estimated remaining: 8m 15s. Rate: 214.4 symbols/min [2025-09-29T02:00:09.761681] [DEBUG] [LOCAL ] DDS: Loaded 13374 existing records from primary storage. [2025-09-29T02:00:09.798761] [INFO ] [MAIN ] DDS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:09.833057] [DEBUG] [LOCAL ] DDL: Loaded 37016 existing records from primary storage. [2025-09-29T02:00:09.831664] [INFO ] [MAIN ] Update Progress: 602/2371 symbols completed. DDS took 1.0s. Estimated remaining: 8m 15s. Rate: 214.6 symbols/min [2025-09-29T02:00:09.878100] [INFO ] [MAIN ] DDL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:09.969205] [DEBUG] [LOCAL ] DE: Loaded 48397 existing records from primary storage. [2025-09-29T02:00:09.980085] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:10.015806] [INFO ] [MAIN ] Update Progress: 603/2371 symbols completed. DDL took 1.2s. Estimated remaining: 8m 14s. Rate: 214.7 symbols/min [2025-09-29T02:00:10.052536] [INFO ] [MAIN ] DE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:10.082322] [INFO ] [MAIN ] Update Progress: 604/2371 symbols completed. DE took 1.3s. Estimated remaining: 8m 13s. Rate: 214.9 symbols/min [2025-09-29T02:00:10.308068] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:10.572312] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:10.631362] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:10.633781] [DEBUG] [LOCAL ] DEA: Loaded 41860 existing records from primary storage. [2025-09-29T02:00:10.635062] [INFO ] [MAIN ] DEA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:10.642447] [INFO ] [MAIN ] Update Progress: 605/2371 symbols completed. DEA took 1.0s. Estimated remaining: 8m 14s. Rate: 214.6 symbols/min [2025-09-29T02:00:10.683092] [DEBUG] [LOCAL ] DEC: Loaded 31121 existing records from primary storage. [2025-09-29T02:00:10.717992] [INFO ] [MAIN ] DEC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:10.772108] [INFO ] [MAIN ] Update Progress: 606/2371 symbols completed. DEC took 0.9s. Estimated remaining: 8m 13s. Rate: 214.8 symbols/min [2025-09-29T02:00:10.963766] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:11.106752] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:11.139639] [DEBUG] [LOCAL ] DEI: Loaded 49204 existing records from primary storage. [2025-09-29T02:00:11.140473] [INFO ] [MAIN ] DEI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:11.141344] [INFO ] [MAIN ] Update Progress: 607/2371 symbols completed. DEI took 1.0s. Estimated remaining: 8m 13s. Rate: 214.7 symbols/min [2025-09-29T02:00:11.142787] [DEBUG] [LOCAL ] DECK: Loaded 54078 existing records from primary storage. [2025-09-29T02:00:11.160979] [INFO ] [MAIN ] DECK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:11.193350] [INFO ] [MAIN ] Update Progress: 608/2371 symbols completed. DECK took 1.1s. Estimated remaining: 8m 12s. Rate: 215.0 symbols/min [2025-09-29T02:00:11.565054] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:11.584231] [DEBUG] [LOCAL ] DELL: Loaded 54515 existing records from primary storage. [2025-09-29T02:00:11.625137] [INFO ] [MAIN ] DELL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:11.621203] [DEBUG] [LOCAL ] DEO: Loaded 49777 existing records from primary storage. [2025-09-29T02:00:11.655716] [INFO ] [MAIN ] DEO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:11.653225] [INFO ] [MAIN ] Update Progress: 609/2371 symbols completed. DELL took 1.0s. Estimated remaining: 8m 12s. Rate: 214.7 symbols/min [2025-09-29T02:00:11.655373] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:11.656572] [INFO ] [MAIN ] Update Progress: 610/2371 symbols completed. DEO took 0.9s. Estimated remaining: 8m 11s. Rate: 215.1 symbols/min [2025-09-29T02:00:11.976459] [DEBUG] [LOCAL ] DFIN: Loaded 23650 existing records from primary storage. [2025-09-29T02:00:12.043083] [DEBUG] [LOCAL ] DFH: Loaded 33106 existing records from primary storage. [2025-09-29T02:00:12.043262] [INFO ] [MAIN ] DFIN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:12.079402] [INFO ] [MAIN ] Update Progress: 611/2371 symbols completed. DFIN took 0.9s. Estimated remaining: 8m 11s. Rate: 214.9 symbols/min [2025-09-29T02:00:12.109885] [INFO ] [MAIN ] DFH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:12.112084] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:12.176537] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:12.192613] [INFO ] [MAIN ] Update Progress: 612/2371 symbols completed. DFH took 1.1s. Estimated remaining: 8m 11s. Rate: 215.1 symbols/min [2025-09-29T02:00:12.447576] [DEBUG] [LOCAL ] DFP: Loaded 11771 existing records from primary storage. [2025-09-29T02:00:12.540143] [INFO ] [MAIN ] DFP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:12.573285] [INFO ] [MAIN ] Update Progress: 613/2371 symbols completed. DFP took 0.9s. Estimated remaining: 8m 11s. Rate: 215.0 symbols/min [2025-09-29T02:00:12.630705] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:12.686639] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:12.717497] [DEBUG] [LOCAL ] DG: Loaded 54068 existing records from primary storage. [2025-09-29T02:00:12.755305] [INFO ] [MAIN ] DG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:12.766362] [INFO ] [MAIN ] Update Progress: 614/2371 symbols completed. DG took 1.1s. Estimated remaining: 8m 10s. Rate: 215.1 symbols/min [2025-09-29T02:00:13.012197] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:13.117452] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:13.119980] [DEBUG] [LOCAL ] DHF: Loaded 20835 existing records from primary storage. [2025-09-29T02:00:13.133939] [INFO ] [MAIN ] DHF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:13.134562] [INFO ] [MAIN ] Update Progress: 615/2371 symbols completed. DHF took 0.9s. Estimated remaining: 8m 10s. Rate: 215.0 symbols/min [2025-09-29T02:00:13.143037] [DEBUG] [LOCAL ] DGX: Loaded 45736 existing records from primary storage. [2025-09-29T02:00:13.183143] [INFO ] [MAIN ] DGX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:13.199590] [INFO ] [MAIN ] Update Progress: 616/2371 symbols completed. DGX took 1.1s. Estimated remaining: 8m 9s. Rate: 215.2 symbols/min [2025-09-29T02:00:13.517807] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:13.610602] [DEBUG] [LOCAL ] DHI: Loaded 54147 existing records from primary storage. [2025-09-29T02:00:13.612427] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:13.614153] [DEBUG] [LOCAL ] DHR: Loaded 54139 existing records from primary storage. [2025-09-29T02:00:13.612823] [INFO ] [MAIN ] DHI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:13.615331] [INFO ] [MAIN ] DHR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:13.616373] [INFO ] [MAIN ] Update Progress: 617/2371 symbols completed. DHI took 1.0s. Estimated remaining: 8m 9s. Rate: 215.1 symbols/min [2025-09-29T02:00:13.623100] [INFO ] [MAIN ] Update Progress: 618/2371 symbols completed. DHR took 0.8s. Estimated remaining: 8m 8s. Rate: 215.4 symbols/min [2025-09-29T02:00:13.795757] [DEBUG] [LOCAL ] DHX: Loaded 13404 existing records from primary storage. [2025-09-29T02:00:13.807259] [INFO ] [MAIN ] DHX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:13.854292] [INFO ] [MAIN ] Update Progress: 619/2371 symbols completed. DHX took 0.7s. Estimated remaining: 8m 8s. Rate: 215.5 symbols/min [2025-09-29T02:00:14.045387] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:14.180421] [DEBUG] [LOCAL ] DHT: Loaded 48583 existing records from primary storage. [2025-09-29T02:00:14.197275] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:14.197866] [INFO ] [MAIN ] DHT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:14.214955] [INFO ] [MAIN ] Update Progress: 620/2371 symbols completed. DHT took 1.1s. Estimated remaining: 8m 8s. Rate: 215.4 symbols/min [2025-09-29T02:00:14.323880] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:14.387488] [DEBUG] [LOCAL ] DIAX: Loaded 12780 existing records from primary storage. [2025-09-29T02:00:14.403925] [INFO ] [MAIN ] DIAX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:14.425964] [INFO ] [MAIN ] Update Progress: 621/2371 symbols completed. DIAX took 0.8s. Estimated remaining: 8m 7s. Rate: 215.4 symbols/min [2025-09-29T02:00:14.561428] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:14.583592] [DEBUG] [LOCAL ] DIN: Loaded 37823 existing records from primary storage. [2025-09-29T02:00:14.619192] [INFO ] [MAIN ] DIN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:14.647987] [INFO ] [MAIN ] Update Progress: 622/2371 symbols completed. DIN took 1.0s. Estimated remaining: 8m 7s. Rate: 215.5 symbols/min [2025-09-29T02:00:14.847027] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:14.873903] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-09-29T02:00:14.891772] [DEBUG] [LOCAL ] DINO: Loaded 53729 existing records from primary storage. [2025-09-29T02:00:14.906564] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-09-29T02:00:14.913028] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-09-29T02:00:14.923986] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-09-29T02:00:14.924297] [INFO ] [MAIN ] DINO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:14.929896] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-09-29T02:00:14.986450] [INFO ] [MAIN ] Update Progress: 623/2371 symbols completed. DINO took 1.1s. Estimated remaining: 8m 7s. Rate: 215.4 symbols/min [2025-09-29T02:00:14.993137] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-09-29T02:00:14.993014] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:15.094990] [DEBUG] [LOCAL ] DIS: Loaded 54568 existing records from primary storage. [2025-09-29T02:00:15.155520] [INFO ] [MAIN ] DIS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:15.189963] [INFO ] [MAIN ] Update Progress: 624/2371 symbols completed. DIS took 0.9s. Estimated remaining: 8m 6s. Rate: 215.5 symbols/min [2025-09-29T02:00:15.592052] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:15.783127] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:15.816928] [DEBUG] [LOCAL ] DK: Loaded 50093 existing records from primary storage. [2025-09-29T02:00:15.882744] [DEBUG] [LOCAL ] DKL: Loaded 19229 existing records from primary storage. [2025-09-29T02:00:15.887109] [INFO ] [MAIN ] DKL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:15.870498] [INFO ] [MAIN ] DK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:15.886532] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:00:15.887855] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2024-12. [2025-09-29T02:00:15.889639] [INFO ] [MAIN ] Update Progress: 625/2371 symbols completed. DKL took 0.9s. Estimated remaining: 8m 7s. Rate: 215.0 symbols/min [2025-09-29T02:00:15.902334] [INFO ] [MAIN ] Update Progress: 626/2371 symbols completed. DK took 1.2s. Estimated remaining: 8m 6s. Rate: 215.3 symbols/min [2025-09-29T02:00:16.258194] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:16.284099] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-29T02:00:16.291487] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-09-29T02:00:16.293319] [DEBUG] [LOCAL ] DKS: Loaded 50579 existing records from primary storage. [2025-09-29T02:00:16.305213] [INFO ] [MAIN ] DKS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:16.336212] [INFO ] [MAIN ] Update Progress: 627/2371 symbols completed. DKS took 1.1s. Estimated remaining: 8m 6s. Rate: 215.2 symbols/min [2025-09-29T02:00:16.368011] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:16.506200] [DEBUG] [LOCAL ] DLNG: Loaded 6276 existing records from primary storage. [2025-09-29T02:00:16.516325] [INFO ] [MAIN ] DLNG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:16.516638] [INFO ] [MAIN ] Update Progress: 628/2371 symbols completed. DLNG took 0.6s. Estimated remaining: 8m 6s. Rate: 215.3 symbols/min [2025-09-29T02:00:16.530592] [DEBUG] [LOCAL ] DLB: Loaded 32601 existing records from primary storage. [2025-09-29T02:00:16.601038] [INFO ] [MAIN ] DLB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:16.619454] [INFO ] [MAIN ] Update Progress: 629/2371 symbols completed. DLB took 0.7s. Estimated remaining: 8m 5s. Rate: 215.5 symbols/min [2025-09-29T02:00:16.702389] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-29T02:00:16.774184] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:16.794567] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-09-29T02:00:16.922303] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:17.103870] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:17.108826] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-29T02:00:17.111731] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-09-29T02:00:17.126302] [DEBUG] [LOCAL ] DLX: Loaded 29284 existing records from primary storage. [2025-09-29T02:00:17.127112] [INFO ] [MAIN ] DLX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:17.127600] [INFO ] [MAIN ] Update Progress: 630/2371 symbols completed. DLX took 0.6s. Estimated remaining: 8m 5s. Rate: 215.2 symbols/min [2025-09-29T02:00:17.268781] [DEBUG] [LOCAL ] DLR: Loaded 51825 existing records from primary storage. [2025-09-29T02:00:17.289534] [INFO ] [MAIN ] DLR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:17.332126] [DEBUG] [LOCAL ] DLY: Loaded 19800 existing records from primary storage. [2025-09-29T02:00:17.333110] [INFO ] [MAIN ] Update Progress: 631/2371 symbols completed. DLR took 1.0s. Estimated remaining: 8m 5s. Rate: 215.3 symbols/min [2025-09-29T02:00:17.339848] [INFO ] [MAIN ] DLY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:17.381828] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:17.407213] [INFO ] [MAIN ] Update Progress: 632/2371 symbols completed. DLY took 0.7s. Estimated remaining: 8m 4s. Rate: 215.5 symbols/min [2025-09-29T02:00:17.432261] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-29T02:00:17.486143] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-09-29T02:00:17.593986] [DEBUG] [LOCAL ] DMA: Loaded 4604 existing records from primary storage. [2025-09-29T02:00:17.641275] [INFO ] [MAIN ] DMA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:17.672796] [INFO ] [MAIN ] Update Progress: 633/2371 symbols completed. DMA took 0.5s. Estimated remaining: 8m 4s. Rate: 215.6 symbols/min [2025-09-29T02:00:17.762520] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:17.814352] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:17.898872] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-29T02:00:17.932935] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-09-29T02:00:17.994897] [DEBUG] [LOCAL ] DMB: Loaded 10254 existing records from primary storage. [2025-09-29T02:00:17.994353] [DEBUG] [LOCAL ] DMO: Loaded 9981 existing records from primary storage. [2025-09-29T02:00:18.003963] [INFO ] [MAIN ] DMO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:18.020043] [INFO ] [MAIN ] DMB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:18.024745] [INFO ] [MAIN ] Update Progress: 634/2371 symbols completed. DMB took 0.7s. Estimated remaining: 8m 4s. Rate: 215.5 symbols/min [2025-09-29T02:00:18.024178] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:18.030181] [INFO ] [MAIN ] Update Progress: 635/2371 symbols completed. DMO took 0.6s. Estimated remaining: 8m 3s. Rate: 215.8 symbols/min [2025-09-29T02:00:18.395710] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-29T02:00:18.462111] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:18.459043] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-09-29T02:00:18.466314] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:18.484563] [DEBUG] [LOCAL ] DNA: Loaded 48990 existing records from primary storage. [2025-09-29T02:00:18.485817] [INFO ] [MAIN ] DNA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:18.486492] [INFO ] [MAIN ] Update Progress: 636/2371 symbols completed. DNA took 0.7s. Estimated remaining: 8m 3s. Rate: 215.6 symbols/min [2025-09-29T02:00:18.736170] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:18.712435] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-09-29T02:00:18.739002] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-09-29T02:00:18.739317] [DEBUG] [LOCAL ] DNP: Loaded 33786 existing records from primary storage. [2025-09-29T02:00:18.743422] [INFO ] [MAIN ] DNP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:18.744680] [INFO ] [MAIN ] Update Progress: 637/2371 symbols completed. DNP took 0.7s. Estimated remaining: 8m 3s. Rate: 215.6 symbols/min [2025-09-29T02:00:18.759559] [DEBUG] [LOCAL ] DNOW: Loaded 44205 existing records from primary storage. [2025-09-29T02:00:18.760263] [INFO ] [MAIN ] DNOW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:18.761024] [INFO ] [MAIN ] Update Progress: 638/2371 symbols completed. DNOW took 0.7s. Estimated remaining: 8m 2s. Rate: 215.9 symbols/min [2025-09-29T02:00:18.820342] [DEBUG] [LOCAL ] DOC: Loaded 54317 existing records from primary storage. [2025-09-29T02:00:18.820824] [INFO ] [MAIN ] DOC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:18.821308] [INFO ] [MAIN ] Update Progress: 639/2371 symbols completed. DOC took 0.3s. Estimated remaining: 8m 1s. Rate: 216.2 symbols/min [2025-09-29T02:00:18.964070] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-09-29T02:00:18.965246] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-09-29T02:00:19.087909] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.12 seconds). [2025-09-29T02:00:19.089054] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-09-29T02:00:19.286621] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.20 seconds). [2025-09-29T02:00:19.287607] [INFO ] [REMOTE ] DIVY: Full fetch complete (1720 records). [2025-09-29T02:00:19.287728] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-09-29T02:00:19.503813] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-29T02:00:19.504037] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:00:19.504116] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:00:19.504201] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-09-29T02:00:19.504306] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-09-29T02:00:19.504382] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-09-29T02:00:19.504488] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-09-29T02:00:19.504598] [INFO ] [MAIN ] Update Progress: 640/2371 symbols completed. DIVY took 5.1s. Estimated remaining: 8m 1s. Rate: 215.7 symbols/min [2025-09-29T02:00:20.256988] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:20.335772] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:20.286485] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:20.340258] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:20.386217] [DEBUG] [LOCAL ] DOUG: Loaded 35254 existing records from primary storage. [2025-09-29T02:00:20.386914] [INFO ] [MAIN ] DOUG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:20.387173] [INFO ] [MAIN ] Update Progress: 641/2371 symbols completed. DOUG took 0.9s. Estimated remaining: 8m 3s. Rate: 215.0 symbols/min [2025-09-29T02:00:20.591819] [DEBUG] [LOCAL ] DOLE: Loaded 38568 existing records from primary storage. [2025-09-29T02:00:20.597301] [INFO ] [MAIN ] DOLE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:20.598475] [DEBUG] [LOCAL ] DOCN: Loaded 51245 existing records from primary storage. [2025-09-29T02:00:20.610492] [DEBUG] [LOCAL ] DOCS: Loaded 51956 existing records from primary storage. [2025-09-29T02:00:20.626444] [INFO ] [MAIN ] DOCN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:20.616518] [INFO ] [MAIN ] DOCS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:20.616302] [INFO ] [MAIN ] Update Progress: 642/2371 symbols completed. DOLE took 1.1s. Estimated remaining: 8m 2s. Rate: 215.0 symbols/min [2025-09-29T02:00:20.696405] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:20.678556] [INFO ] [MAIN ] Update Progress: 643/2371 symbols completed. DOCS took 1.1s. Estimated remaining: 8m 2s. Rate: 215.3 symbols/min [2025-09-29T02:00:20.702227] [INFO ] [MAIN ] Update Progress: 644/2371 symbols completed. DOCN took 1.1s. Estimated remaining: 8m 1s. Rate: 215.6 symbols/min [2025-09-29T02:00:21.356893] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:21.374923] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:21.379612] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:21.388506] [DEBUG] [LOCAL ] DOV: Loaded 46376 existing records from primary storage. [2025-09-29T02:00:21.390484] [INFO ] [MAIN ] DOV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:21.391412] [INFO ] [MAIN ] Update Progress: 645/2371 symbols completed. DOV took 1.0s. Estimated remaining: 8m 1s. Rate: 215.1 symbols/min [2025-09-29T02:00:21.535850] [DEBUG] [LOCAL ] DPG: Loaded 13683 existing records from primary storage. [2025-09-29T02:00:21.559623] [INFO ] [MAIN ] DPG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:21.560014] [INFO ] [MAIN ] Update Progress: 646/2371 symbols completed. DPG took 0.9s. Estimated remaining: 8m 1s. Rate: 215.2 symbols/min [2025-09-29T02:00:21.754292] [DEBUG] [LOCAL ] DQ: Loaded 43880 existing records from primary storage. [2025-09-29T02:00:21.725740] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:21.785775] [INFO ] [MAIN ] DQ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:21.801163] [INFO ] [MAIN ] Update Progress: 647/2371 symbols completed. DQ took 1.0s. Estimated remaining: 8m 0s. Rate: 215.3 symbols/min [2025-09-29T02:00:21.902469] [DEBUG] [LOCAL ] DOW: Loaded 54513 existing records from primary storage. [2025-09-29T02:00:21.955105] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:21.975257] [INFO ] [MAIN ] DOW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:21.988726] [INFO ] [MAIN ] Update Progress: 648/2371 symbols completed. DOW took 1.3s. Estimated remaining: 7m 60s. Rate: 215.4 symbols/min [2025-09-29T02:00:22.255501] [DEBUG] [LOCAL ] DRD: Loaded 37397 existing records from primary storage. [2025-09-29T02:00:22.320171] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:22.342629] [INFO ] [MAIN ] DRD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:22.369235] [INFO ] [MAIN ] Update Progress: 649/2371 symbols completed. DRD took 1.0s. Estimated remaining: 7m 60s. Rate: 215.3 symbols/min [2025-09-29T02:00:22.407192] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:22.454504] [DEBUG] [LOCAL ] DRH: Loaded 51205 existing records from primary storage. [2025-09-29T02:00:22.478614] [INFO ] [MAIN ] DRH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:22.503769] [INFO ] [MAIN ] Update Progress: 650/2371 symbols completed. DRH took 0.9s. Estimated remaining: 7m 59s. Rate: 215.4 symbols/min [2025-09-29T02:00:22.602117] [DEBUG] [LOCAL ] DRLL: Loaded 9737 existing records from primary storage. [2025-09-29T02:00:22.664185] [INFO ] [MAIN ] DRLL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:22.761111] [INFO ] [MAIN ] Update Progress: 651/2371 symbols completed. DRLL took 0.8s. Estimated remaining: 7m 59s. Rate: 215.5 symbols/min [2025-09-29T02:00:22.786338] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:22.844850] [DEBUG] [LOCAL ] DRI: Loaded 48554 existing records from primary storage. [2025-09-29T02:00:22.891505] [INFO ] [MAIN ] DRI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:22.981988] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:22.982831] [INFO ] [MAIN ] Update Progress: 652/2371 symbols completed. DRI took 1.1s. Estimated remaining: 7m 59s. Rate: 215.5 symbols/min [2025-09-29T02:00:23.219769] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:23.225912] [DEBUG] [LOCAL ] DSM: Loaded 15895 existing records from primary storage. [2025-09-29T02:00:23.235272] [INFO ] [MAIN ] DSM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:23.260127] [INFO ] [MAIN ] Update Progress: 653/2371 symbols completed. DSM took 0.7s. Estimated remaining: 7m 58s. Rate: 215.5 symbols/min [2025-09-29T02:00:23.261551] [DEBUG] [LOCAL ] DSL: Loaded 28651 existing records from primary storage. [2025-09-29T02:00:23.303151] [INFO ] [MAIN ] DSL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:23.424073] [INFO ] [MAIN ] Update Progress: 654/2371 symbols completed. DSL took 1.0s. Estimated remaining: 7m 58s. Rate: 215.7 symbols/min [2025-09-29T02:00:23.302706] [DEBUG] [LOCAL ] DSMC: Loaded 1974 existing records from primary storage. [2025-09-29T02:00:23.400290] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:23.440070] [INFO ] [MAIN ] DSMC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:23.462560] [INFO ] [MAIN ] Update Progress: 655/2371 symbols completed. DSMC took 0.6s. Estimated remaining: 7m 57s. Rate: 216.0 symbols/min [2025-09-29T02:00:23.744978] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:23.866059] [DEBUG] [LOCAL ] DSU: Loaded 22684 existing records from primary storage. [2025-09-29T02:00:23.963573] [INFO ] [MAIN ] DSU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:24.027166] [INFO ] [MAIN ] Update Progress: 656/2371 symbols completed. DSU took 1.0s. Estimated remaining: 7m 57s. Rate: 215.6 symbols/min [2025-09-29T02:00:23.999087] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:24.044124] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:24.090371] [DEBUG] [LOCAL ] DSX: Loaded 24642 existing records from primary storage. [2025-09-29T02:00:24.124383] [INFO ] [MAIN ] DSX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:24.138799] [DEBUG] [LOCAL ] DTB: Loaded 4817 existing records from primary storage. [2025-09-29T02:00:24.177056] [INFO ] [MAIN ] Update Progress: 657/2371 symbols completed. DSX took 0.9s. Estimated remaining: 7m 57s. Rate: 215.8 symbols/min [2025-09-29T02:00:24.183085] [INFO ] [MAIN ] DTB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:24.269486] [INFO ] [MAIN ] Update Progress: 658/2371 symbols completed. DTB took 0.8s. Estimated remaining: 7m 56s. Rate: 216.0 symbols/min [2025-09-29T02:00:24.329447] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:24.626439] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:24.645377] [DEBUG] [LOCAL ] DT: Loaded 53708 existing records from primary storage. [2025-09-29T02:00:24.650812] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-09-29T02:00:24.651091] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-09-29T02:00:24.656697] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-09-29T02:00:24.678508] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-09-29T02:00:24.687811] [INFO ] [MAIN ] DT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:24.687941] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-09-29T02:00:24.689706] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-09-29T02:00:24.690427] [INFO ] [MAIN ] Update Progress: 659/2371 symbols completed. DT took 1.2s. Estimated remaining: 7m 56s. Rate: 215.8 symbols/min [2025-09-29T02:00:24.751732] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:25.064990] [DEBUG] [LOCAL ] DTG: Loaded 5952 existing records from primary storage. [2025-09-29T02:00:25.066598] [DEBUG] [LOCAL ] DTE: Loaded 48557 existing records from primary storage. [2025-09-29T02:00:25.092760] [INFO ] [MAIN ] DTG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:25.087082] [INFO ] [MAIN ] DTK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:25.113362] [INFO ] [MAIN ] Update Progress: 660/2371 symbols completed. DTG took 0.8s. Estimated remaining: 7m 56s. Rate: 215.7 symbols/min [2025-09-29T02:00:25.113954] [INFO ] [MAIN ] DTE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:25.129707] [DEBUG] [LOCAL ] DTK: No existing data file found in primary storage. [2025-09-29T02:00:25.130103] [INFO ] [MAIN ] Update Progress: 661/2371 symbols completed. DTE took 1.1s. Estimated remaining: 7m 55s. Rate: 216.0 symbols/min [2025-09-29T02:00:25.141486] [WARN ] [MAIN ] DTK: No existing data found, performing full refresh instead. [2025-09-29T02:00:25.295738] [INFO ] [MAIN ] DTK: Wiping existing primary data before full refresh. [2025-09-29T02:00:25.310164] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-09-29T02:00:25.401377] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-09-29T02:00:25.428002] [INFO ] [MAIN ] DTK: Starting full primary refresh. [2025-09-29T02:00:25.733500] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:25.827058] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:25.955871] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:00:25.956288] [DEBUG] [LOCAL ] DTW: Loaded 4923 existing records from primary storage. [2025-09-29T02:00:25.999940] [INFO ] [REMOTE ] DTF: Fetching primary data for 2024-12. [2025-09-29T02:00:26.000219] [INFO ] [MAIN ] DTW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:26.032711] [INFO ] [MAIN ] Update Progress: 662/2371 symbols completed. DTW took 0.9s. Estimated remaining: 7m 56s. Rate: 215.2 symbols/min [2025-09-29T02:00:26.385086] [INFO ] [REMOTE ] DTK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:00:26.387040] [DEBUG] [LOCAL ] DTM: Loaded 45043 existing records from primary storage. [2025-09-29T02:00:26.437010] [INFO ] [MAIN ] DTM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:26.429973] [INFO ] [REMOTE ] DTK: Fetching primary data for 2024-12. [2025-09-29T02:00:26.441253] [INFO ] [MAIN ] Update Progress: 663/2371 symbols completed. DTM took 1.3s. Estimated remaining: 7m 56s. Rate: 215.1 symbols/min [2025-09-29T02:00:26.506699] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:26.507724] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-29T02:00:26.537962] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-09-29T02:00:26.660002] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:00:26.671196] [WARN ] [REMOTE ] DTK: No data returned for month 2024-12 [2025-09-29T02:00:26.703994] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:26.704473] [FATAL] [REMOTE ] DTK: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:00:26.704718] [FATAL] [MAIN ] DTK: Failed to fetch primary data. [2025-09-29T02:00:26.705218] [WARN ] [MAIN ] DTK: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:00:26.705300] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-09-29T02:00:26.705409] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-09-29T02:00:26.705485] [INFO ] [LOCAL ] DTK: Starting deletion of derivative data. [2025-09-29T02:00:26.705588] [DEBUG] [LOCAL ] DTK: No derivative data file found to delete. [2025-09-29T02:00:26.705802] [INFO ] [MAIN ] Update Progress: 664/2371 symbols completed. DTK took 2.0s. Estimated remaining: 7m 56s. Rate: 215.1 symbols/min [2025-09-29T02:00:26.889306] [DEBUG] [LOCAL ] DUKB: Loaded 6414 existing records from primary storage. [2025-09-29T02:00:26.938006] [INFO ] [MAIN ] DUKB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:26.917831] [DEBUG] [LOCAL ] DUK: Loaded 54238 existing records from primary storage. [2025-09-29T02:00:26.939087] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-29T02:00:26.958966] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:26.960497] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-09-29T02:00:26.957953] [INFO ] [MAIN ] Update Progress: 665/2371 symbols completed. DUKB took 0.5s. Estimated remaining: 7m 56s. Rate: 215.1 symbols/min [2025-09-29T02:00:26.960720] [INFO ] [MAIN ] DUK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:26.979668] [INFO ] [MAIN ] Update Progress: 666/2371 symbols completed. DUK took 0.9s. Estimated remaining: 7m 55s. Rate: 215.4 symbols/min [2025-09-29T02:00:27.179601] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.22 seconds). [2025-09-29T02:00:27.192487] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-09-29T02:00:27.394484] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:27.395486] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:27.416493] [DEBUG] [LOCAL ] DV: Loaded 52038 existing records from primary storage. [2025-09-29T02:00:27.417070] [INFO ] [MAIN ] DV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:27.417770] [INFO ] [MAIN ] Update Progress: 667/2371 symbols completed. DV took 0.7s. Estimated remaining: 7m 55s. Rate: 215.2 symbols/min [2025-09-29T02:00:27.534149] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-29T02:00:27.535783] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-09-29T02:00:27.639518] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:27.685203] [DEBUG] [LOCAL ] DVA: Loaded 41877 existing records from primary storage. [2025-09-29T02:00:27.706148] [INFO ] [MAIN ] DVA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:27.706338] [INFO ] [MAIN ] Update Progress: 668/2371 symbols completed. DVA took 0.7s. Estimated remaining: 7m 55s. Rate: 215.2 symbols/min [2025-09-29T02:00:27.752323] [DEBUG] [LOCAL ] DVN: Loaded 54479 existing records from primary storage. [2025-09-29T02:00:27.787917] [INFO ] [MAIN ] DVN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:27.809192] [INFO ] [MAIN ] Update Progress: 669/2371 symbols completed. DVN took 0.8s. Estimated remaining: 7m 54s. Rate: 215.4 symbols/min [2025-09-29T02:00:27.900557] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-29T02:00:27.956280] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-09-29T02:00:28.101384] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:28.120773] [DEBUG] [LOCAL ] DX: Loaded 53228 existing records from primary storage. [2025-09-29T02:00:28.153857] [INFO ] [MAIN ] DX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:28.189786] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:28.190559] [INFO ] [MAIN ] Update Progress: 670/2371 symbols completed. DX took 0.8s. Estimated remaining: 7m 54s. Rate: 215.3 symbols/min [2025-09-29T02:00:28.433837] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-29T02:00:28.453790] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:28.455431] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-09-29T02:00:28.469405] [DEBUG] [LOCAL ] DXC: Loaded 50456 existing records from primary storage. [2025-09-29T02:00:28.467789] [DEBUG] [LOCAL ] DXYZ: Loaded 37246 existing records from primary storage. [2025-09-29T02:00:28.470417] [INFO ] [MAIN ] DXC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:28.471091] [INFO ] [MAIN ] Update Progress: 671/2371 symbols completed. DXC took 0.8s. Estimated remaining: 7m 54s. Rate: 215.3 symbols/min [2025-09-29T02:00:28.470506] [INFO ] [MAIN ] DXYZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:28.483886] [INFO ] [MAIN ] Update Progress: 672/2371 symbols completed. DXYZ took 0.6s. Estimated remaining: 7m 53s. Rate: 215.6 symbols/min [2025-09-29T02:00:28.747877] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-09-29T02:00:28.780890] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-09-29T02:00:28.850318] [DEBUG] [LOCAL ] DY: Loaded 30160 existing records from primary storage. [2025-09-29T02:00:28.937510] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:28.939229] [INFO ] [MAIN ] DY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:28.962312] [INFO ] [MAIN ] Update Progress: 673/2371 symbols completed. DY took 0.8s. Estimated remaining: 7m 53s. Rate: 215.4 symbols/min [2025-09-29T02:00:28.962154] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:29.142595] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-29T02:00:29.181818] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-09-29T02:00:29.217086] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:29.220187] [DEBUG] [LOCAL ] E: Loaded 33848 existing records from primary storage. [2025-09-29T02:00:29.234702] [INFO ] [MAIN ] E: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:29.234870] [INFO ] [MAIN ] Update Progress: 674/2371 symbols completed. E took 0.8s. Estimated remaining: 7m 53s. Rate: 215.4 symbols/min [2025-09-29T02:00:29.241503] [DEBUG] [LOCAL ] EAF: Loaded 44158 existing records from primary storage. [2025-09-29T02:00:29.261545] [INFO ] [MAIN ] EAF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:29.277913] [INFO ] [MAIN ] Update Progress: 675/2371 symbols completed. EAF took 0.7s. Estimated remaining: 7m 52s. Rate: 215.7 symbols/min [2025-09-29T02:00:29.312194] [DEBUG] [LOCAL ] EAI: Loaded 4008 existing records from primary storage. [2025-09-29T02:00:29.345730] [INFO ] [MAIN ] EAI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:29.391578] [INFO ] [MAIN ] Update Progress: 676/2371 symbols completed. EAI took 0.4s. Estimated remaining: 7m 51s. Rate: 215.8 symbols/min [2025-09-29T02:00:29.512165] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-29T02:00:29.643391] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:29.638610] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-09-29T02:00:29.795056] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:29.905604] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:29.907722] [DEBUG] [LOCAL ] EARN: Loaded 30576 existing records from primary storage. [2025-09-29T02:00:29.908505] [INFO ] [MAIN ] EARN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:29.908619] [INFO ] [MAIN ] Update Progress: 677/2371 symbols completed. EARN took 0.7s. Estimated remaining: 7m 51s. Rate: 215.6 symbols/min [2025-09-29T02:00:29.971290] [DEBUG] [LOCAL ] EB: Loaded 38017 existing records from primary storage. [2025-09-29T02:00:29.972413] [INFO ] [MAIN ] EB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:29.988385] [INFO ] [MAIN ] Update Progress: 678/2371 symbols completed. EB took 0.5s. Estimated remaining: 7m 51s. Rate: 215.8 symbols/min [2025-09-29T02:00:29.989705] [DEBUG] [LOCAL ] EAT: Loaded 50542 existing records from primary storage. [2025-09-29T02:00:29.990046] [INFO ] [MAIN ] EAT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:29.990499] [INFO ] [MAIN ] Update Progress: 679/2371 symbols completed. EAT took 0.7s. Estimated remaining: 7m 50s. Rate: 216.1 symbols/min [2025-09-29T02:00:30.042937] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-29T02:00:30.043935] [INFO ] [REMOTE ] DTF: Full fetch complete (2111 records). [2025-09-29T02:00:30.044055] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-09-29T02:00:30.248717] [WARN ] [VALIDATOR ] DTF: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-29T02:00:30.248987] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:00:30.249066] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:00:30.249154] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-09-29T02:00:30.249256] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-09-29T02:00:30.249330] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-09-29T02:00:30.249438] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-09-29T02:00:30.249579] [INFO ] [MAIN ] Update Progress: 680/2371 symbols completed. DTF took 6.1s. Estimated remaining: 7m 49s. Rate: 216.1 symbols/min [2025-09-29T02:00:30.934590] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:30.988796] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:31.014862] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:31.074604] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:31.101401] [DEBUG] [LOCAL ] EBF: Loaded 19635 existing records from primary storage. [2025-09-29T02:00:31.102291] [INFO ] [MAIN ] EBF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:31.102410] [INFO ] [MAIN ] Update Progress: 681/2371 symbols completed. EBF took 0.9s. Estimated remaining: 7m 51s. Rate: 215.5 symbols/min [2025-09-29T02:00:31.331630] [DEBUG] [LOCAL ] EC: Loaded 50056 existing records from primary storage. [2025-09-29T02:00:31.325407] [DEBUG] [LOCAL ] EBS: Loaded 47455 existing records from primary storage. [2025-09-29T02:00:31.348515] [DEBUG] [LOCAL ] EBR: Loaded 43731 existing records from primary storage. [2025-09-29T02:00:31.353954] [INFO ] [MAIN ] EC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:31.374195] [INFO ] [MAIN ] EBS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:31.367454] [INFO ] [MAIN ] Update Progress: 682/2371 symbols completed. EC took 1.1s. Estimated remaining: 7m 50s. Rate: 215.5 symbols/min [2025-09-29T02:00:31.382111] [INFO ] [MAIN ] EBR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:31.390177] [INFO ] [MAIN ] Update Progress: 683/2371 symbols completed. EBS took 1.1s. Estimated remaining: 7m 49s. Rate: 215.8 symbols/min [2025-09-29T02:00:31.460612] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:31.435141] [INFO ] [MAIN ] Update Progress: 684/2371 symbols completed. EBR took 1.2s. Estimated remaining: 7m 48s. Rate: 216.1 symbols/min [2025-09-29T02:00:31.907773] [DEBUG] [LOCAL ] ECAT: Loaded 30092 existing records from primary storage. [2025-09-29T02:00:32.061081] [INFO ] [MAIN ] ECAT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:32.065441] [INFO ] [MAIN ] Update Progress: 685/2371 symbols completed. ECAT took 1.0s. Estimated remaining: 7m 49s. Rate: 215.7 symbols/min [2025-09-29T02:00:32.067204] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:32.120055] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:32.128317] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:32.134317] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-09-29T02:00:32.134416] [DEBUG] [LOCAL ] ECCU: No existing data file found in primary storage. [2025-09-29T02:00:32.134506] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-09-29T02:00:32.150674] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-09-29T02:00:32.150409] [WARN ] [MAIN ] ECCU: No existing data found, performing full refresh instead. [2025-09-29T02:00:32.161408] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-09-29T02:00:32.179796] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-09-29T02:00:32.166897] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-09-29T02:00:32.189437] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-09-29T02:00:32.189785] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-09-29T02:00:32.200670] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-09-29T02:00:32.200772] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-09-29T02:00:32.548017] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:32.577473] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-09-29T02:00:32.592815] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-09-29T02:00:32.610398] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-09-29T02:00:32.660868] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-09-29T02:00:32.679633] [DEBUG] [LOCAL ] ECC: Loaded 44025 existing records from primary storage. [2025-09-29T02:00:32.711480] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-09-29T02:00:32.739278] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-09-29T02:00:32.805607] [INFO ] [MAIN ] ECC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:32.824618] [INFO ] [MAIN ] Update Progress: 686/2371 symbols completed. ECC took 1.4s. Estimated remaining: 7m 50s. Rate: 215.1 symbols/min [2025-09-29T02:00:33.664322] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:33.779907] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:00:33.759673] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-09-29T02:00:33.827493] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-09-29T02:00:33.856891] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:00:33.863581] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2024-12. [2025-09-29T02:00:33.891873] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2024-12. [2025-09-29T02:00:33.863963] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-09-29T02:00:33.893557] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-09-29T02:00:33.910502] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-09-29T02:00:33.943704] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-09-29T02:00:33.990447] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:00:34.050863] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2024-12. [2025-09-29T02:00:34.142456] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2024-12 (0.28 seconds). [2025-09-29T02:00:34.165900] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-09-29T02:00:34.248801] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-29T02:00:34.299219] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-09-29T02:00:34.315070] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2024-12 (0.26 seconds). [2025-09-29T02:00:34.324103] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-09-29T02:00:34.436518] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:00:34.440455] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-09-29T02:00:34.440829] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2024-12. [2025-09-29T02:00:34.442226] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-09-29T02:00:34.474554] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.15 seconds). [2025-09-29T02:00:34.475804] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-09-29T02:00:34.562913] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.12 seconds). [2025-09-29T02:00:34.569842] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-09-29T02:00:34.570250] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2024-12 (0.13 seconds). [2025-09-29T02:00:34.573206] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-09-29T02:00:34.677756] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.20 seconds). [2025-09-29T02:00:34.679076] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-09-29T02:00:34.699025] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.13 seconds). [2025-09-29T02:00:34.700214] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-09-29T02:00:34.736764] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-29T02:00:34.738827] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-09-29T02:00:34.771548] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.20 seconds). [2025-09-29T02:00:34.773154] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-09-29T02:00:34.825599] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.13 seconds). [2025-09-29T02:00:34.826906] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-09-29T02:00:34.844262] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.17 seconds). [2025-09-29T02:00:34.845511] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-09-29T02:00:34.895013] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.12 seconds). [2025-09-29T02:00:34.896745] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-09-29T02:00:34.955729] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.22 seconds). [2025-09-29T02:00:34.957407] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-09-29T02:00:34.973147] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.13 seconds). [2025-09-29T02:00:34.974396] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-09-29T02:00:35.095770] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.20 seconds). [2025-09-29T02:00:35.097117] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-09-29T02:00:35.112113] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-09-29T02:00:35.113592] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-09-29T02:00:35.262126] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-09-29T02:00:35.263707] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-09-29T02:00:35.270890] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-29T02:00:35.273658] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-09-29T02:00:35.289385] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.19 seconds). [2025-09-29T02:00:35.290490] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-09-29T02:00:35.307889] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.19 seconds). [2025-09-29T02:00:35.309074] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-09-29T02:00:35.399286] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.14 seconds). [2025-09-29T02:00:35.400566] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-09-29T02:00:35.417399] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.13 seconds). [2025-09-29T02:00:35.418525] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-09-29T02:00:35.435717] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.13 seconds). [2025-09-29T02:00:35.436860] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-09-29T02:00:35.474027] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.20 seconds). [2025-09-29T02:00:35.475576] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-09-29T02:00:35.523265] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.12 seconds). [2025-09-29T02:00:35.524450] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-09-29T02:00:35.623479] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.20 seconds). [2025-09-29T02:00:35.624698] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-09-29T02:00:35.629451] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.19 seconds). [2025-09-29T02:00:35.630448] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-09-29T02:00:35.654535] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.13 seconds). [2025-09-29T02:00:35.655717] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-09-29T02:00:35.677468] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.20 seconds). [2025-09-29T02:00:35.678923] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-09-29T02:00:35.761330] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.13 seconds). [2025-09-29T02:00:35.762553] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-09-29T02:00:35.819310] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.19 seconds). [2025-09-29T02:00:35.820218] [INFO ] [REMOTE ] ECCC: Full fetch complete (1284 records). [2025-09-29T02:00:35.820375] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-09-29T02:00:35.902668] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.22 seconds). [2025-09-29T02:00:35.906475] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-09-29T02:00:35.920567] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.16 seconds). [2025-09-29T02:00:35.951061] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-09-29T02:00:35.931209] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-09-29T02:00:35.954711] [INFO ] [REMOTE ] ECCW: Full fetch complete (1420 records). [2025-09-29T02:00:35.981705] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-09-29T02:00:36.151511] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-29T02:00:36.164465] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:00:36.164616] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:00:36.164751] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-09-29T02:00:36.170668] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-09-29T02:00:36.195460] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-09-29T02:00:36.181088] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-09-29T02:00:36.202431] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-09-29T02:00:36.214582] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-09-29T02:00:36.263842] [INFO ] [MAIN ] Update Progress: 687/2371 symbols completed. ECCC took 4.8s. Estimated remaining: 7m 57s. Rate: 211.6 symbols/min [2025-09-29T02:00:36.277258] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-09-29T02:00:36.272841] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-29T02:00:36.282751] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:00:36.292996] [INFO ] [REMOTE ] ECCX: Full fetch complete (1503 records). [2025-09-29T02:00:36.307774] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:00:36.313104] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-09-29T02:00:36.313409] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-09-29T02:00:36.313293] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-09-29T02:00:36.349767] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-09-29T02:00:36.390163] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-09-29T02:00:36.413555] [INFO ] [MAIN ] Update Progress: 688/2371 symbols completed. ECCW took 4.3s. Estimated remaining: 7m 57s. Rate: 211.8 symbols/min [2025-09-29T02:00:36.548130] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-29T02:00:36.602521] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-09-29T02:00:36.699037] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:36.849100] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-29T02:00:36.923345] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:36.918580] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:00:36.924009] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:00:36.924119] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-09-29T02:00:36.924210] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-09-29T02:00:36.924361] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-09-29T02:00:36.924466] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-09-29T02:00:36.924632] [INFO ] [MAIN ] Update Progress: 689/2371 symbols completed. ECCX took 4.0s. Estimated remaining: 7m 57s. Rate: 211.5 symbols/min [2025-09-29T02:00:36.993007] [DEBUG] [LOCAL ] ECG: Loaded 34619 existing records from primary storage. [2025-09-29T02:00:37.034810] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-29T02:00:37.026430] [INFO ] [MAIN ] ECG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:37.065200] [INFO ] [REMOTE ] ECCU: Full fetch complete (4460 records). [2025-09-29T02:00:37.065485] [INFO ] [MAIN ] Update Progress: 690/2371 symbols completed. ECG took 0.8s. Estimated remaining: 7m 56s. Rate: 211.7 symbols/min [2025-09-29T02:00:37.065742] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-09-29T02:00:37.257991] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:37.435135] [DEBUG] [LOCAL ] ECL: Loaded 47489 existing records from primary storage. [2025-09-29T02:00:37.527953] [INFO ] [MAIN ] ECL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:37.557082] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:37.582840] [INFO ] [MAIN ] Update Progress: 691/2371 symbols completed. ECL took 1.1s. Estimated remaining: 7m 57s. Rate: 211.4 symbols/min [2025-09-29T02:00:37.610452] [WARN ] [VALIDATOR ] ECCU: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-29T02:00:37.643358] [DEBUG] [LOCAL ] ECO: Loaded 18768 existing records from primary storage. [2025-09-29T02:00:37.666622] [INFO ] [MAIN ] ECO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:37.655632] [FATAL] [MAIN ] ECCU: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:00:37.672127] [WARN ] [MAIN ] ECCU: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:00:37.677523] [INFO ] [MAIN ] Update Progress: 692/2371 symbols completed. ECO took 0.8s. Estimated remaining: 7m 56s. Rate: 211.6 symbols/min [2025-09-29T02:00:37.677799] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-09-29T02:00:37.694837] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-09-29T02:00:37.695156] [INFO ] [LOCAL ] ECCU: Starting deletion of derivative data. [2025-09-29T02:00:37.712181] [DEBUG] [LOCAL ] ECCU: No derivative data file found to delete. [2025-09-29T02:00:37.757490] [INFO ] [MAIN ] Update Progress: 693/2371 symbols completed. ECCU took 6.3s. Estimated remaining: 7m 55s. Rate: 211.8 symbols/min [2025-09-29T02:00:38.124082] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:38.168062] [DEBUG] [LOCAL ] ECVT: Loaded 43587 existing records from primary storage. [2025-09-29T02:00:38.201795] [INFO ] [MAIN ] ECVT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:38.189692] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:38.218804] [INFO ] [MAIN ] Update Progress: 694/2371 symbols completed. ECVT took 1.2s. Estimated remaining: 7m 55s. Rate: 211.7 symbols/min [2025-09-29T02:00:38.501413] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:38.585260] [DEBUG] [LOCAL ] EDD: Loaded 27470 existing records from primary storage. [2025-09-29T02:00:38.594140] [INFO ] [MAIN ] EDD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:38.594404] [INFO ] [MAIN ] Update Progress: 695/2371 symbols completed. EDD took 0.9s. Estimated remaining: 7m 55s. Rate: 211.6 symbols/min [2025-09-29T02:00:38.825839] [DEBUG] [LOCAL ] ED: Loaded 53539 existing records from primary storage. [2025-09-29T02:00:38.875252] [INFO ] [MAIN ] ED: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:38.925604] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:38.818470] [DEBUG] [LOCAL ] EDF: Loaded 13627 existing records from primary storage. [2025-09-29T02:00:38.931939] [INFO ] [MAIN ] Update Progress: 696/2371 symbols completed. ED took 1.3s. Estimated remaining: 7m 55s. Rate: 211.5 symbols/min [2025-09-29T02:00:38.949101] [INFO ] [MAIN ] EDF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:38.976607] [INFO ] [MAIN ] Update Progress: 697/2371 symbols completed. EDF took 1.2s. Estimated remaining: 7m 54s. Rate: 211.8 symbols/min [2025-09-29T02:00:39.342515] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:39.364029] [DEBUG] [LOCAL ] EDN: Loaded 18501 existing records from primary storage. [2025-09-29T02:00:39.481140] [INFO ] [MAIN ] EDN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:39.506918] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:39.563361] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:39.563861] [DEBUG] [LOCAL ] EEA: No existing data file found in primary storage. [2025-09-29T02:00:39.536315] [INFO ] [MAIN ] Update Progress: 698/2371 symbols completed. EDN took 1.3s. Estimated remaining: 7m 55s. Rate: 211.5 symbols/min [2025-09-29T02:00:39.594510] [WARN ] [MAIN ] EEA: No existing data found, performing full refresh instead. [2025-09-29T02:00:39.595003] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-09-29T02:00:39.607694] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-09-29T02:00:39.632935] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-09-29T02:00:39.655269] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-09-29T02:00:39.870734] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:40.015553] [DEBUG] [LOCAL ] EDU: Loaded 45666 existing records from primary storage. [2025-09-29T02:00:40.036745] [DEBUG] [LOCAL ] EE: Loaded 32973 existing records from primary storage. [2025-09-29T02:00:40.057138] [INFO ] [MAIN ] EDU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:40.096685] [DEBUG] [LOCAL ] EEX: Loaded 12042 existing records from primary storage. [2025-09-29T02:00:40.083954] [INFO ] [MAIN ] EE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:40.085411] [INFO ] [MAIN ] Update Progress: 699/2371 symbols completed. EDU took 1.5s. Estimated remaining: 7m 55s. Rate: 211.2 symbols/min [2025-09-29T02:00:40.115202] [INFO ] [MAIN ] EEX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:40.120469] [INFO ] [MAIN ] Update Progress: 700/2371 symbols completed. EE took 1.2s. Estimated remaining: 7m 54s. Rate: 211.4 symbols/min [2025-09-29T02:00:40.198686] [INFO ] [MAIN ] Update Progress: 701/2371 symbols completed. EEX took 0.6s. Estimated remaining: 7m 53s. Rate: 211.7 symbols/min [2025-09-29T02:00:40.599592] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:00:40.649607] [INFO ] [REMOTE ] EEA: Fetching primary data for 2024-12. [2025-09-29T02:00:40.730373] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:40.776727] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:40.847954] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:40.866041] [DEBUG] [LOCAL ] EFR: Loaded 14474 existing records from primary storage. [2025-09-29T02:00:40.869586] [INFO ] [MAIN ] EFR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:40.869760] [INFO ] [MAIN ] Update Progress: 702/2371 symbols completed. EFR took 0.7s. Estimated remaining: 7m 54s. Rate: 211.2 symbols/min [2025-09-29T02:00:40.927140] [DEBUG] [LOCAL ] EFT: Loaded 12857 existing records from primary storage. [2025-09-29T02:00:40.959823] [INFO ] [MAIN ] EFT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:40.973104] [INFO ] [MAIN ] Update Progress: 703/2371 symbols completed. EFT took 0.8s. Estimated remaining: 7m 53s. Rate: 211.4 symbols/min [2025-09-29T02:00:41.166803] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-29T02:00:41.218446] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-09-29T02:00:41.212426] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:41.248095] [DEBUG] [LOCAL ] EFC: Loaded 46944 existing records from primary storage. [2025-09-29T02:00:41.259290] [INFO ] [MAIN ] EFC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:41.284857] [INFO ] [MAIN ] Update Progress: 704/2371 symbols completed. EFC took 1.2s. Estimated remaining: 7m 53s. Rate: 211.4 symbols/min [2025-09-29T02:00:41.345267] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:41.525745] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:41.552627] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-29T02:00:41.558245] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-09-29T02:00:41.584919] [DEBUG] [LOCAL ] EFXT: Loaded 29755 existing records from primary storage. [2025-09-29T02:00:41.586123] [DEBUG] [LOCAL ] EFX: Loaded 45419 existing records from primary storage. [2025-09-29T02:00:41.586688] [INFO ] [MAIN ] EFXT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:41.586792] [INFO ] [MAIN ] EFX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:41.587250] [INFO ] [MAIN ] Update Progress: 705/2371 symbols completed. EFXT took 0.6s. Estimated remaining: 7m 53s. Rate: 211.4 symbols/min [2025-09-29T02:00:41.593811] [INFO ] [MAIN ] Update Progress: 706/2371 symbols completed. EFX took 0.7s. Estimated remaining: 7m 52s. Rate: 211.7 symbols/min [2025-09-29T02:00:41.827739] [DEBUG] [LOCAL ] EG: Loaded 29024 existing records from primary storage. [2025-09-29T02:00:41.864923] [INFO ] [MAIN ] EG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:41.926429] [INFO ] [MAIN ] Update Progress: 707/2371 symbols completed. EG took 0.6s. Estimated remaining: 7m 52s. Rate: 211.6 symbols/min [2025-09-29T02:00:41.954362] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-29T02:00:41.955490] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:41.957340] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-09-29T02:00:42.162284] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:42.262160] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:42.299992] [DEBUG] [LOCAL ] EGO: Loaded 52295 existing records from primary storage. [2025-09-29T02:00:42.311899] [INFO ] [MAIN ] EGO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:42.314696] [INFO ] [MAIN ] Update Progress: 708/2371 symbols completed. EGO took 0.7s. Estimated remaining: 7m 52s. Rate: 211.5 symbols/min [2025-09-29T02:00:42.315533] [DEBUG] [LOCAL ] EGP: Loaded 31536 existing records from primary storage. [2025-09-29T02:00:42.350092] [INFO ] [MAIN ] EGP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:42.369484] [INFO ] [MAIN ] Update Progress: 709/2371 symbols completed. EGP took 0.8s. Estimated remaining: 7m 51s. Rate: 211.8 symbols/min [2025-09-29T02:00:42.537633] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-29T02:00:42.569573] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-09-29T02:00:42.557138] [DEBUG] [LOCAL ] EGY: Loaded 42824 existing records from primary storage. [2025-09-29T02:00:42.679254] [INFO ] [MAIN ] EGY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:42.684832] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:42.697317] [INFO ] [MAIN ] Update Progress: 710/2371 symbols completed. EGY took 0.7s. Estimated remaining: 7m 51s. Rate: 211.7 symbols/min [2025-09-29T02:00:42.828132] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:42.999728] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:43.001071] [DEBUG] [LOCAL ] EHAB: Loaded 30257 existing records from primary storage. [2025-09-29T02:00:43.001853] [INFO ] [MAIN ] EHAB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:43.002246] [INFO ] [MAIN ] Update Progress: 711/2371 symbols completed. EHAB took 0.7s. Estimated remaining: 7m 50s. Rate: 211.7 symbols/min [2025-09-29T02:00:43.057846] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-29T02:00:43.097043] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-09-29T02:00:43.146117] [DEBUG] [LOCAL ] EHI: Loaded 10472 existing records from primary storage. [2025-09-29T02:00:43.159526] [INFO ] [MAIN ] EHI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:43.160007] [INFO ] [MAIN ] Update Progress: 712/2371 symbols completed. EHI took 0.4s. Estimated remaining: 7m 50s. Rate: 211.8 symbols/min [2025-09-29T02:00:43.242921] [DEBUG] [LOCAL ] EHC: Loaded 41849 existing records from primary storage. [2025-09-29T02:00:43.291695] [INFO ] [MAIN ] EHC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:43.292487] [INFO ] [MAIN ] Update Progress: 713/2371 symbols completed. EHC took 0.9s. Estimated remaining: 7m 49s. Rate: 212.0 symbols/min [2025-09-29T02:00:43.311961] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:43.490818] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-29T02:00:43.541682] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-09-29T02:00:43.580055] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:43.607898] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-09-29T02:00:43.637284] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-09-29T02:00:43.658577] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-09-29T02:00:43.660450] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:43.668895] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-09-29T02:00:43.670283] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-09-29T02:00:43.671012] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-09-29T02:00:43.671887] [DEBUG] [LOCAL ] EIC: Loaded 24238 existing records from primary storage. [2025-09-29T02:00:43.671084] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-09-29T02:00:43.672349] [INFO ] [MAIN ] EIC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:43.672186] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-09-29T02:00:43.672636] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-09-29T02:00:43.672736] [INFO ] [MAIN ] Update Progress: 714/2371 symbols completed. EIC took 0.7s. Estimated remaining: 7m 49s. Rate: 211.9 symbols/min [2025-09-29T02:00:43.690486] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-09-29T02:00:43.737287] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-09-29T02:00:43.870057] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-09-29T02:00:43.964270] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-29T02:00:44.072801] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-09-29T02:00:44.301897] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:44.599277] [DEBUG] [LOCAL ] EICC: Loaded 6245 existing records from primary storage. [2025-09-29T02:00:44.650468] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:00:44.667515] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-29T02:00:44.663712] [INFO ] [MAIN ] EICC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:44.670442] [INFO ] [MAIN ] Update Progress: 715/2371 symbols completed. EICC took 1.0s. Estimated remaining: 7m 51s. Rate: 211.1 symbols/min [2025-09-29T02:00:44.668022] [INFO ] [REMOTE ] EICA: Fetching primary data for 2024-12. [2025-09-29T02:00:44.669887] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-09-29T02:00:44.873354] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:00:44.876767] [INFO ] [REMOTE ] EICB: Fetching primary data for 2024-12. [2025-09-29T02:00:44.956687] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:44.981448] [DEBUG] [LOCAL ] EIG: Loaded 20519 existing records from primary storage. [2025-09-29T02:00:44.983907] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-09-29T02:00:44.985029] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-09-29T02:00:44.985286] [INFO ] [MAIN ] EIG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:44.986263] [INFO ] [MAIN ] Update Progress: 716/2371 symbols completed. EIG took 0.3s. Estimated remaining: 7m 50s. Rate: 211.1 symbols/min [2025-09-29T02:00:45.106788] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-29T02:00:45.129611] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-09-29T02:00:45.192437] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:45.205729] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-09-29T02:00:45.207054] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-09-29T02:00:45.262406] [DEBUG] [LOCAL ] EIX: Loaded 54113 existing records from primary storage. [2025-09-29T02:00:45.262844] [INFO ] [MAIN ] EIX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:45.263617] [INFO ] [MAIN ] Update Progress: 717/2371 symbols completed. EIX took 0.3s. Estimated remaining: 7m 50s. Rate: 211.1 symbols/min [2025-09-29T02:00:45.304733] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.18 seconds). [2025-09-29T02:00:45.305791] [INFO ] [REMOTE ] EEA: Full fetch complete (3967 records). [2025-09-29T02:00:45.305889] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-09-29T02:00:45.371705] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-29T02:00:45.402471] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-09-29T02:00:45.485115] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.28 seconds). [2025-09-29T02:00:45.521889] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-09-29T02:00:45.565423] [WARN ] [VALIDATOR ] EEA: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-29T02:00:45.565846] [FATAL] [MAIN ] EEA: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:00:45.565923] [WARN ] [MAIN ] EEA: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:00:45.566003] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-09-29T02:00:45.566106] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-09-29T02:00:45.566178] [INFO ] [LOCAL ] EEA: Starting deletion of derivative data. [2025-09-29T02:00:45.566260] [DEBUG] [LOCAL ] EEA: No derivative data file found to delete. [2025-09-29T02:00:45.566385] [INFO ] [MAIN ] Update Progress: 718/2371 symbols completed. EEA took 6.5s. Estimated remaining: 7m 50s. Rate: 211.1 symbols/min [2025-09-29T02:00:45.618688] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.22 seconds). [2025-09-29T02:00:45.619864] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-09-29T02:00:45.756309] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-09-29T02:00:45.757819] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-09-29T02:00:45.820467] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.20 seconds). [2025-09-29T02:00:45.821510] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-09-29T02:00:46.027435] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.21 seconds). [2025-09-29T02:00:46.028698] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-09-29T02:00:46.147471] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.12 seconds). [2025-09-29T02:00:46.148758] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-09-29T02:00:46.200951] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-29T02:00:46.202210] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-09-29T02:00:46.270324] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.12 seconds). [2025-09-29T02:00:46.271441] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-09-29T02:00:46.415687] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.21 seconds). [2025-09-29T02:00:46.417247] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-09-29T02:00:46.472086] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.20 seconds). [2025-09-29T02:00:46.473313] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-09-29T02:00:46.666319] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.19 seconds). [2025-09-29T02:00:46.667480] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-09-29T02:00:46.692748] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-09-29T02:00:46.694432] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-09-29T02:00:46.864366] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.20 seconds). [2025-09-29T02:00:46.865267] [INFO ] [REMOTE ] EICA: Full fetch complete (1269 records). [2025-09-29T02:00:46.865376] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-09-29T02:00:46.985892] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-09-29T02:00:46.993205] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-09-29T02:00:47.081876] [WARN ] [VALIDATOR ] EICA: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-29T02:00:47.082116] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:00:47.082190] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:00:47.082267] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-09-29T02:00:47.082366] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-09-29T02:00:47.082439] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-09-29T02:00:47.082541] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-09-29T02:00:47.082660] [INFO ] [MAIN ] Update Progress: 719/2371 symbols completed. EICA took 3.9s. Estimated remaining: 7m 52s. Rate: 209.8 symbols/min [2025-09-29T02:00:47.330194] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-29T02:00:47.331605] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-09-29T02:00:47.607223] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-09-29T02:00:47.608637] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-09-29T02:00:47.745224] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.14 seconds). [2025-09-29T02:00:47.746361] [INFO ] [REMOTE ] EICB: Full fetch complete (2692 records). [2025-09-29T02:00:47.746460] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-09-29T02:00:47.947624] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-29T02:00:47.947860] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:00:47.947935] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:00:47.948014] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-09-29T02:00:47.948118] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-09-29T02:00:47.948228] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-09-29T02:00:47.948317] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-09-29T02:00:47.948416] [INFO ] [MAIN ] Update Progress: 720/2371 symbols completed. EICB took 4.6s. Estimated remaining: 7m 53s. Rate: 209.2 symbols/min [2025-09-29T02:00:48.543232] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:48.691771] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:48.692862] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:48.723405] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:48.736930] [DEBUG] [LOCAL ] ELC: Loaded 3512 existing records from primary storage. [2025-09-29T02:00:48.737491] [INFO ] [MAIN ] ELC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:48.737670] [INFO ] [MAIN ] Update Progress: 721/2371 symbols completed. ELC took 0.8s. Estimated remaining: 7m 54s. Rate: 208.7 symbols/min [2025-09-29T02:00:48.996567] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:49.043180] [DEBUG] [LOCAL ] EL: Loaded 54177 existing records from primary storage. [2025-09-29T02:00:49.060176] [DEBUG] [LOCAL ] ELF: Loaded 53037 existing records from primary storage. [2025-09-29T02:00:49.059157] [INFO ] [MAIN ] EL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:49.061178] [INFO ] [MAIN ] Update Progress: 722/2371 symbols completed. EL took 1.1s. Estimated remaining: 7m 54s. Rate: 208.7 symbols/min [2025-09-29T02:00:49.061329] [INFO ] [MAIN ] ELF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:49.063358] [INFO ] [MAIN ] Update Progress: 723/2371 symbols completed. ELF took 1.1s. Estimated remaining: 7m 53s. Rate: 209.0 symbols/min [2025-09-29T02:00:49.062746] [DEBUG] [LOCAL ] ELAN: Loaded 53985 existing records from primary storage. [2025-09-29T02:00:49.122721] [INFO ] [MAIN ] ELAN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:49.155149] [INFO ] [MAIN ] Update Progress: 724/2371 symbols completed. ELAN took 1.2s. Estimated remaining: 7m 52s. Rate: 209.2 symbols/min [2025-09-29T02:00:49.460269] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:49.512263] [DEBUG] [LOCAL ] ELME: Loaded 39817 existing records from primary storage. [2025-09-29T02:00:49.525061] [INFO ] [MAIN ] ELME: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:49.564322] [INFO ] [MAIN ] Update Progress: 725/2371 symbols completed. ELME took 0.8s. Estimated remaining: 7m 52s. Rate: 209.1 symbols/min [2025-09-29T02:00:49.712459] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:49.705056] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:49.767150] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-09-29T02:00:49.759333] [DEBUG] [LOCAL ] ELP: Loaded 26107 existing records from primary storage. [2025-09-29T02:00:49.810830] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-09-29T02:00:49.825081] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-09-29T02:00:49.825220] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-09-29T02:00:49.810591] [INFO ] [MAIN ] ELP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:49.825875] [INFO ] [MAIN ] Update Progress: 726/2371 symbols completed. ELP took 0.8s. Estimated remaining: 7m 52s. Rate: 209.1 symbols/min [2025-09-29T02:00:49.846622] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-09-29T02:00:49.852036] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-09-29T02:00:49.991797] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:50.301621] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:50.350434] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-09-29T02:00:50.379880] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-09-29T02:00:50.380227] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-09-29T02:00:50.380330] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-09-29T02:00:50.388478] [DEBUG] [LOCAL ] ELS: Loaded 50110 existing records from primary storage. [2025-09-29T02:00:50.399314] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-09-29T02:00:50.401124] [INFO ] [MAIN ] ELS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:50.401763] [INFO ] [MAIN ] Update Progress: 727/2371 symbols completed. ELS took 1.2s. Estimated remaining: 7m 52s. Rate: 208.8 symbols/min [2025-09-29T02:00:50.401338] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-09-29T02:00:50.618103] [DEBUG] [LOCAL ] ELV: Loaded 51334 existing records from primary storage. [2025-09-29T02:00:50.756668] [INFO ] [MAIN ] ELV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:50.821861] [INFO ] [MAIN ] Update Progress: 728/2371 symbols completed. ELV took 1.2s. Estimated remaining: 7m 52s. Rate: 208.7 symbols/min [2025-09-29T02:00:50.893973] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:00:50.962842] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2024-12. [2025-09-29T02:00:51.022575] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:51.338426] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-09-29T02:00:51.345551] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:51.348582] [DEBUG] [LOCAL ] EMD: Loaded 21338 existing records from primary storage. [2025-09-29T02:00:51.347205] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-09-29T02:00:51.361050] [INFO ] [MAIN ] EMD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:51.368744] [INFO ] [MAIN ] Update Progress: 729/2371 symbols completed. EMD took 0.9s. Estimated remaining: 7m 53s. Rate: 208.4 symbols/min [2025-09-29T02:00:51.556992] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:00:51.597243] [INFO ] [REMOTE ] EMA: Fetching primary data for 2024-12. [2025-09-29T02:00:51.690815] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:51.692078] [DEBUG] [LOCAL ] EME: Loaded 32035 existing records from primary storage. [2025-09-29T02:00:51.697009] [INFO ] [MAIN ] EME: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:51.697219] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-29T02:00:51.697483] [INFO ] [MAIN ] Update Progress: 730/2371 symbols completed. EME took 0.8s. Estimated remaining: 7m 53s. Rate: 208.4 symbols/min [2025-09-29T02:00:51.700408] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-09-29T02:00:51.746245] [DEBUG] [LOCAL ] EMF: Loaded 3575 existing records from primary storage. [2025-09-29T02:00:51.760894] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:00:51.768170] [INFO ] [MAIN ] EMF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:51.799049] [WARN ] [REMOTE ] EMA: No data returned for month 2024-12 [2025-09-29T02:00:51.793554] [INFO ] [MAIN ] Update Progress: 731/2371 symbols completed. EMF took 0.4s. Estimated remaining: 7m 52s. Rate: 208.5 symbols/min [2025-09-29T02:00:51.814016] [FATAL] [REMOTE ] EMA: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:00:51.856689] [FATAL] [MAIN ] EMA: Failed to fetch primary data. [2025-09-29T02:00:51.897942] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:00:51.924678] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-09-29T02:00:51.898176] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.20 seconds). [2025-09-29T02:00:51.962316] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-09-29T02:00:51.972902] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-09-29T02:00:51.996022] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-09-29T02:00:52.000432] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:52.000768] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-09-29T02:00:52.035857] [INFO ] [MAIN ] Update Progress: 732/2371 symbols completed. EMA took 2.2s. Estimated remaining: 7m 51s. Rate: 208.6 symbols/min [2025-09-29T02:00:52.232098] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:52.250929] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-09-29T02:00:52.253157] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-09-29T02:00:52.349323] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:52.365141] [DEBUG] [LOCAL ] EMO: Loaded 12656 existing records from primary storage. [2025-09-29T02:00:52.365674] [INFO ] [MAIN ] EMO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:52.365986] [INFO ] [MAIN ] Update Progress: 733/2371 symbols completed. EMO took 0.5s. Estimated remaining: 7m 51s. Rate: 208.6 symbols/min [2025-09-29T02:00:52.431201] [DEBUG] [LOCAL ] EMP: Loaded 3062 existing records from primary storage. [2025-09-29T02:00:52.489369] [INFO ] [MAIN ] EMP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:52.504179] [INFO ] [MAIN ] Update Progress: 734/2371 symbols completed. EMP took 0.5s. Estimated remaining: 7m 51s. Rate: 208.7 symbols/min [2025-09-29T02:00:52.511795] [DEBUG] [LOCAL ] EMN: Loaded 51117 existing records from primary storage. [2025-09-29T02:00:52.551081] [INFO ] [MAIN ] EMN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:52.596533] [INFO ] [MAIN ] Update Progress: 735/2371 symbols completed. EMN took 0.9s. Estimated remaining: 7m 50s. Rate: 208.9 symbols/min [2025-09-29T02:00:52.616934] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-29T02:00:52.645766] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-09-29T02:00:52.678570] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:52.939537] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:53.002124] [INFO ] [MAIN ] ENFY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:53.028991] [DEBUG] [LOCAL ] ENFY: Loaded 3106 existing records from primary storage. [2025-09-29T02:00:53.031828] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-29T02:00:53.033228] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-09-29T02:00:53.034847] [INFO ] [MAIN ] ENFY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:53.035008] [INFO ] [MAIN ] Update Progress: 736/2371 symbols completed. ENFY took 0.4s. Estimated remaining: 7m 50s. Rate: 208.7 symbols/min [2025-09-29T02:00:53.162231] [DEBUG] [LOCAL ] EMR: Loaded 54027 existing records from primary storage. [2025-09-29T02:00:53.186915] [INFO ] [MAIN ] EMR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:53.204867] [INFO ] [MAIN ] Update Progress: 737/2371 symbols completed. EMR took 0.8s. Estimated remaining: 7m 49s. Rate: 208.9 symbols/min [2025-09-29T02:00:53.294050] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-09-29T02:00:53.285771] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:53.325564] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-09-29T02:00:53.455602] [DEBUG] [LOCAL ] ENB: Loaded 54295 existing records from primary storage. [2025-09-29T02:00:53.495022] [INFO ] [MAIN ] ENB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:53.520127] [INFO ] [MAIN ] Update Progress: 738/2371 symbols completed. ENB took 1.0s. Estimated remaining: 7m 49s. Rate: 208.8 symbols/min [2025-09-29T02:00:53.544831] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:53.611395] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-09-29T02:00:53.675390] [DEBUG] [LOCAL ] ENIC: Loaded 36910 existing records from primary storage. [2025-09-29T02:00:53.682301] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-09-29T02:00:53.689957] [INFO ] [MAIN ] ENIC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:53.696012] [INFO ] [MAIN ] Update Progress: 739/2371 symbols completed. ENIC took 0.7s. Estimated remaining: 7m 49s. Rate: 208.9 symbols/min [2025-09-29T02:00:53.729380] [DEBUG] [LOCAL ] ENO: Loaded 1952 existing records from primary storage. [2025-09-29T02:00:53.833463] [INFO ] [MAIN ] ENO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:53.876471] [INFO ] [MAIN ] Update Progress: 740/2371 symbols completed. ENO took 0.6s. Estimated remaining: 7m 48s. Rate: 209.0 symbols/min [2025-09-29T02:00:53.897665] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:53.966003] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-09-29T02:00:53.973474] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-09-29T02:00:54.197525] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.22 seconds). [2025-09-29T02:00:54.194627] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:54.206371] [INFO ] [REMOTE ] ELPC: Full fetch complete (1481 records). [2025-09-29T02:00:54.220917] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-09-29T02:00:54.387716] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:54.414392] [DEBUG] [LOCAL ] ENOV: Loaded 45799 existing records from primary storage. [2025-09-29T02:00:54.459018] [INFO ] [MAIN ] ENOV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:54.503813] [INFO ] [MAIN ] Update Progress: 741/2371 symbols completed. ENOV took 1.0s. Estimated remaining: 7m 49s. Rate: 208.7 symbols/min [2025-09-29T02:00:54.552837] [WARN ] [VALIDATOR ] ELPC: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-29T02:00:54.565616] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:00:54.583175] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:00:54.618248] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-09-29T02:00:54.612990] [DEBUG] [LOCAL ] ENR: Loaded 43336 existing records from primary storage. [2025-09-29T02:00:54.647944] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-09-29T02:00:54.664487] [INFO ] [MAIN ] ENR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:54.685741] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-09-29T02:00:54.686171] [INFO ] [MAIN ] Update Progress: 742/2371 symbols completed. ENR took 1.0s. Estimated remaining: 7m 48s. Rate: 208.8 symbols/min [2025-09-29T02:00:54.706079] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-09-29T02:00:54.722484] [INFO ] [MAIN ] Update Progress: 743/2371 symbols completed. ELPC took 5.6s. Estimated remaining: 7m 47s. Rate: 209.1 symbols/min [2025-09-29T02:00:54.786623] [DEBUG] [LOCAL ] ENS: Loaded 29869 existing records from primary storage. [2025-09-29T02:00:54.818059] [INFO ] [MAIN ] ENS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:54.850030] [INFO ] [MAIN ] Update Progress: 744/2371 symbols completed. ENS took 0.9s. Estimated remaining: 7m 47s. Rate: 209.2 symbols/min [2025-09-29T02:00:55.012600] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:55.235631] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:55.325160] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:55.436721] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:55.438084] [DEBUG] [LOCAL ] ENVA: Loaded 25914 existing records from primary storage. [2025-09-29T02:00:55.439103] [INFO ] [MAIN ] ENVA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:55.445771] [INFO ] [MAIN ] Update Progress: 745/2371 symbols completed. ENVA took 0.9s. Estimated remaining: 7m 47s. Rate: 208.9 symbols/min [2025-09-29T02:00:55.448793] [DEBUG] [LOCAL ] EOD: Loaded 14232 existing records from primary storage. [2025-09-29T02:00:55.472750] [INFO ] [MAIN ] EOD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:55.473007] [INFO ] [MAIN ] Update Progress: 746/2371 symbols completed. EOD took 0.8s. Estimated remaining: 7m 46s. Rate: 209.2 symbols/min [2025-09-29T02:00:55.652926] [DEBUG] [LOCAL ] EOI: Loaded 10783 existing records from primary storage. [2025-09-29T02:00:55.679752] [INFO ] [MAIN ] EOI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:55.702776] [INFO ] [MAIN ] Update Progress: 747/2371 symbols completed. EOI took 0.8s. Estimated remaining: 7m 46s. Rate: 209.2 symbols/min [2025-09-29T02:00:55.947949] [DEBUG] [LOCAL ] EOG: Loaded 54121 existing records from primary storage. [2025-09-29T02:00:56.033095] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:56.109369] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:56.125490] [INFO ] [MAIN ] EOG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:56.175869] [INFO ] [MAIN ] Update Progress: 748/2371 symbols completed. EOG took 1.4s. Estimated remaining: 7m 46s. Rate: 209.0 symbols/min [2025-09-29T02:00:56.181198] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:56.307922] [DEBUG] [LOCAL ] EOS: Loaded 15589 existing records from primary storage. [2025-09-29T02:00:56.300945] [DEBUG] [LOCAL ] EOT: Loaded 6916 existing records from primary storage. [2025-09-29T02:00:56.321092] [INFO ] [MAIN ] EOT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:56.330270] [INFO ] [MAIN ] EOS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:56.346768] [INFO ] [MAIN ] Update Progress: 749/2371 symbols completed. EOT took 0.9s. Estimated remaining: 7m 45s. Rate: 209.2 symbols/min [2025-09-29T02:00:56.390524] [INFO ] [MAIN ] Update Progress: 750/2371 symbols completed. EOS took 0.9s. Estimated remaining: 7m 44s. Rate: 209.4 symbols/min [2025-09-29T02:00:56.469246] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:56.524798] [DEBUG] [LOCAL ] EPAC: Loaded 27416 existing records from primary storage. [2025-09-29T02:00:56.539639] [INFO ] [MAIN ] EPAC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:56.640458] [INFO ] [MAIN ] Update Progress: 751/2371 symbols completed. EPAC took 0.9s. Estimated remaining: 7m 44s. Rate: 209.4 symbols/min [2025-09-29T02:00:56.860857] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:56.907154] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:57.065624] [DEBUG] [LOCAL ] EPAM: Loaded 40450 existing records from primary storage. [2025-09-29T02:00:57.067963] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:57.069265] [INFO ] [MAIN ] EPAM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:57.069726] [INFO ] [MAIN ] Update Progress: 752/2371 symbols completed. EPAM took 0.9s. Estimated remaining: 7m 44s. Rate: 209.3 symbols/min [2025-09-29T02:00:57.258349] [DEBUG] [LOCAL ] EPC: Loaded 40383 existing records from primary storage. [2025-09-29T02:00:57.326760] [INFO ] [MAIN ] EPC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:57.357400] [DEBUG] [LOCAL ] EPD: Loaded 54389 existing records from primary storage. [2025-09-29T02:00:57.383880] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:57.384482] [INFO ] [MAIN ] EPD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:57.384819] [INFO ] [MAIN ] Update Progress: 753/2371 symbols completed. EPC took 1.0s. Estimated remaining: 7m 44s. Rate: 209.3 symbols/min [2025-09-29T02:00:57.398702] [INFO ] [MAIN ] Update Progress: 754/2371 symbols completed. EPD took 1.0s. Estimated remaining: 7m 43s. Rate: 209.5 symbols/min [2025-09-29T02:00:57.561063] [DEBUG] [LOCAL ] EPR: Loaded 44722 existing records from primary storage. [2025-09-29T02:00:57.603627] [INFO ] [MAIN ] EPR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:57.649167] [INFO ] [MAIN ] Update Progress: 755/2371 symbols completed. EPR took 1.0s. Estimated remaining: 7m 43s. Rate: 209.6 symbols/min [2025-09-29T02:00:57.859497] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:57.965597] [DEBUG] [LOCAL ] EPRT: Loaded 49306 existing records from primary storage. [2025-09-29T02:00:58.006313] [INFO ] [MAIN ] EPRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:58.090037] [INFO ] [MAIN ] Update Progress: 756/2371 symbols completed. EPRT took 1.0s. Estimated remaining: 7m 43s. Rate: 209.4 symbols/min [2025-09-29T02:00:58.099157] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:58.171181] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:58.183772] [DEBUG] [LOCAL ] EQBK: Loaded 11050 existing records from primary storage. [2025-09-29T02:00:58.198057] [INFO ] [MAIN ] EQBK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:58.239150] [INFO ] [MAIN ] Update Progress: 757/2371 symbols completed. EQBK took 0.9s. Estimated remaining: 7m 42s. Rate: 209.5 symbols/min [2025-09-29T02:00:58.367558] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:58.448834] [DEBUG] [LOCAL ] EQH: Loaded 53435 existing records from primary storage. [2025-09-29T02:00:58.449417] [INFO ] [MAIN ] EQH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:58.449926] [INFO ] [MAIN ] Update Progress: 758/2371 symbols completed. EQH took 1.0s. Estimated remaining: 7m 42s. Rate: 209.6 symbols/min [2025-09-29T02:00:58.451821] [DEBUG] [LOCAL ] EQNR: Loaded 53809 existing records from primary storage. [2025-09-29T02:00:58.452603] [INFO ] [MAIN ] EQNR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:58.453251] [INFO ] [MAIN ] Update Progress: 759/2371 symbols completed. EQNR took 0.8s. Estimated remaining: 7m 41s. Rate: 209.9 symbols/min [2025-09-29T02:00:58.496090] [DEBUG] [LOCAL ] EQR: Loaded 52190 existing records from primary storage. [2025-09-29T02:00:58.496497] [INFO ] [MAIN ] EQR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:58.496794] [INFO ] [MAIN ] Update Progress: 760/2371 symbols completed. EQR took 0.4s. Estimated remaining: 7m 40s. Rate: 210.1 symbols/min [2025-09-29T02:00:59.168084] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:59.242907] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-09-29T02:00:59.272959] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-09-29T02:00:59.200553] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:59.297393] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-09-29T02:00:59.297145] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:59.297787] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-09-29T02:00:59.293380] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:00:59.298664] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-09-29T02:00:59.298796] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-09-29T02:00:59.376361] [DEBUG] [LOCAL ] EQV: Loaded 2840 existing records from primary storage. [2025-09-29T02:00:59.398437] [INFO ] [MAIN ] EQV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:59.420528] [INFO ] [MAIN ] Update Progress: 761/2371 symbols completed. EQV took 0.9s. Estimated remaining: 7m 41s. Rate: 209.5 symbols/min [2025-09-29T02:00:59.848113] [DEBUG] [LOCAL ] EQT: Loaded 54462 existing records from primary storage. [2025-09-29T02:00:59.875702] [DEBUG] [LOCAL ] ERJ: Loaded 51477 existing records from primary storage. [2025-09-29T02:00:59.882762] [INFO ] [MAIN ] ERJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:59.892709] [INFO ] [MAIN ] Update Progress: 762/2371 symbols completed. ERJ took 1.4s. Estimated remaining: 7m 41s. Rate: 209.3 symbols/min [2025-09-29T02:00:59.886760] [INFO ] [MAIN ] EQT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:00:59.931958] [INFO ] [MAIN ] Update Progress: 763/2371 symbols completed. EQT took 1.4s. Estimated remaining: 7m 40s. Rate: 209.6 symbols/min [2025-09-29T02:00:59.931349] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:00.087797] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:01:00.159432] [INFO ] [REMOTE ] EQS: Fetching primary data for 2024-12. [2025-09-29T02:01:00.377086] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:00.413139] [DEBUG] [LOCAL ] ERO: Loaded 41901 existing records from primary storage. [2025-09-29T02:01:00.444329] [INFO ] [MAIN ] ERO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:00.443999] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:00.444524] [INFO ] [MAIN ] Update Progress: 764/2371 symbols completed. ERO took 1.0s. Estimated remaining: 7m 41s. Rate: 209.4 symbols/min [2025-09-29T02:01:00.583189] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-29T02:01:00.600811] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-09-29T02:01:00.672633] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:00.674312] [DEBUG] [LOCAL ] ESAB: Loaded 26683 existing records from primary storage. [2025-09-29T02:01:00.690751] [INFO ] [MAIN ] ESAB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:00.690892] [INFO ] [MAIN ] Update Progress: 765/2371 symbols completed. ESAB took 0.8s. Estimated remaining: 7m 40s. Rate: 209.4 symbols/min [2025-09-29T02:01:00.835333] [DEBUG] [LOCAL ] ES: Loaded 53309 existing records from primary storage. [2025-09-29T02:01:00.836424] [INFO ] [MAIN ] ES: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:00.875474] [INFO ] [MAIN ] Update Progress: 766/2371 symbols completed. ES took 1.0s. Estimated remaining: 7m 40s. Rate: 209.5 symbols/min [2025-09-29T02:01:00.937134] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:00.937399] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-29T02:01:00.938215] [DEBUG] [LOCAL ] ESE: Loaded 16878 existing records from primary storage. [2025-09-29T02:01:00.979632] [INFO ] [MAIN ] ESE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:00.996142] [INFO ] [MAIN ] Update Progress: 767/2371 symbols completed. ESE took 0.6s. Estimated remaining: 7m 39s. Rate: 209.6 symbols/min [2025-09-29T02:01:00.963318] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-09-29T02:01:01.279386] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-29T02:01:01.287067] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:01.325164] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-09-29T02:01:01.395027] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:01.414480] [DEBUG] [LOCAL ] ESI: Loaded 51566 existing records from primary storage. [2025-09-29T02:01:01.414981] [INFO ] [MAIN ] ESI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:01.415604] [INFO ] [MAIN ] Update Progress: 768/2371 symbols completed. ESI took 0.7s. Estimated remaining: 7m 39s. Rate: 209.5 symbols/min [2025-09-29T02:01:01.549423] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-09-29T02:01:01.562074] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-09-29T02:01:01.655359] [DEBUG] [LOCAL ] ESNT: Loaded 39065 existing records from primary storage. [2025-09-29T02:01:01.661550] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:01.662540] [INFO ] [MAIN ] ESNT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:01.663394] [INFO ] [MAIN ] Update Progress: 769/2371 symbols completed. ESNT took 0.7s. Estimated remaining: 7m 39s. Rate: 209.6 symbols/min [2025-09-29T02:01:01.788225] [DEBUG] [LOCAL ] ESRT: Loaded 47104 existing records from primary storage. [2025-09-29T02:01:01.817825] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-09-29T02:01:01.818030] [INFO ] [MAIN ] ESRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:01.840063] [INFO ] [MAIN ] Update Progress: 770/2371 symbols completed. ESRT took 0.8s. Estimated remaining: 7m 38s. Rate: 209.7 symbols/min [2025-09-29T02:01:01.841962] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-09-29T02:01:01.949367] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:02.006336] [DEBUG] [LOCAL ] ESS: Loaded 30441 existing records from primary storage. [2025-09-29T02:01:02.018192] [INFO ] [MAIN ] ESS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:02.037863] [INFO ] [MAIN ] Update Progress: 771/2371 symbols completed. ESS took 0.6s. Estimated remaining: 7m 38s. Rate: 209.7 symbols/min [2025-09-29T02:01:02.183601] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:02.204143] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-29T02:01:02.232215] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-09-29T02:01:02.332780] [DEBUG] [LOCAL ] ESTC: Loaded 50744 existing records from primary storage. [2025-09-29T02:01:02.373044] [INFO ] [MAIN ] ESTC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:02.404224] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:02.404613] [INFO ] [MAIN ] Update Progress: 772/2371 symbols completed. ESTC took 0.7s. Estimated remaining: 7m 38s. Rate: 209.7 symbols/min [2025-09-29T02:01:02.532095] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-29T02:01:02.545692] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-09-29T02:01:02.592758] [DEBUG] [LOCAL ] ETB: Loaded 12181 existing records from primary storage. [2025-09-29T02:01:02.605604] [INFO ] [MAIN ] ETB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:02.667134] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:02.667274] [INFO ] [MAIN ] Update Progress: 773/2371 symbols completed. ETB took 0.6s. Estimated remaining: 7m 37s. Rate: 209.7 symbols/min [2025-09-29T02:01:02.683025] [DEBUG] [LOCAL ] ET: Loaded 54569 existing records from primary storage. [2025-09-29T02:01:02.713110] [INFO ] [MAIN ] ET: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:02.749307] [INFO ] [MAIN ] Update Progress: 774/2371 symbols completed. ET took 0.9s. Estimated remaining: 7m 37s. Rate: 209.9 symbols/min [2025-09-29T02:01:02.838522] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-09-29T02:01:02.871774] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-09-29T02:01:03.067183] [DEBUG] [LOCAL ] ETD: Loaded 27661 existing records from primary storage. [2025-09-29T02:01:03.079090] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:03.084385] [INFO ] [MAIN ] ETD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:03.106586] [INFO ] [MAIN ] Update Progress: 775/2371 symbols completed. ETD took 0.7s. Estimated remaining: 7m 36s. Rate: 209.8 symbols/min [2025-09-29T02:01:03.240933] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:03.297175] [DEBUG] [LOCAL ] ETG: Loaded 16710 existing records from primary storage. [2025-09-29T02:01:03.313998] [INFO ] [MAIN ] ETG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:03.321207] [INFO ] [MAIN ] Update Progress: 776/2371 symbols completed. ETG took 0.7s. Estimated remaining: 7m 36s. Rate: 209.9 symbols/min [2025-09-29T02:01:03.384170] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:03.410450] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-29T02:01:03.425934] [DEBUG] [LOCAL ] ETJ: Loaded 16938 existing records from primary storage. [2025-09-29T02:01:03.439610] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-09-29T02:01:03.479380] [INFO ] [MAIN ] ETJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:03.513419] [INFO ] [MAIN ] Update Progress: 777/2371 symbols completed. ETJ took 0.7s. Estimated remaining: 7m 35s. Rate: 210.0 symbols/min [2025-09-29T02:01:03.687465] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:03.826151] [DEBUG] [LOCAL ] ETO: Loaded 6600 existing records from primary storage. [2025-09-29T02:01:03.831600] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:03.832216] [INFO ] [MAIN ] ETO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:03.832518] [INFO ] [MAIN ] Update Progress: 778/2371 symbols completed. ETO took 0.4s. Estimated remaining: 7m 35s. Rate: 209.9 symbols/min [2025-09-29T02:01:03.946254] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-29T02:01:03.954726] [DEBUG] [LOCAL ] ETN: Loaded 53593 existing records from primary storage. [2025-09-29T02:01:03.955894] [INFO ] [REMOTE ] EQS: Full fetch complete (2522 records). [2025-09-29T02:01:03.986058] [INFO ] [MAIN ] ETN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:03.986250] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-09-29T02:01:03.993024] [INFO ] [MAIN ] Update Progress: 779/2371 symbols completed. ETN took 0.9s. Estimated remaining: 7m 35s. Rate: 210.1 symbols/min [2025-09-29T02:01:04.289439] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:04.436802] [DEBUG] [LOCAL ] ETR: Loaded 54001 existing records from primary storage. [2025-09-29T02:01:04.479709] [INFO ] [MAIN ] ETR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:04.461559] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-09-29T02:01:04.523446] [INFO ] [MAIN ] Update Progress: 780/2371 symbols completed. ETR took 1.0s. Estimated remaining: 7m 35s. Rate: 209.8 symbols/min [2025-09-29T02:01:04.501245] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:01:04.524464] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:04.543415] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:01:04.598979] [DEBUG] [LOCAL ] ETV: Loaded 21729 existing records from primary storage. [2025-09-29T02:01:04.583969] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-09-29T02:01:04.619867] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-09-29T02:01:04.637182] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-09-29T02:01:04.660441] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-09-29T02:01:04.649009] [INFO ] [MAIN ] ETV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:04.660622] [INFO ] [MAIN ] Update Progress: 781/2371 symbols completed. ETV took 0.8s. Estimated remaining: 7m 34s. Rate: 210.0 symbols/min [2025-09-29T02:01:04.666464] [INFO ] [MAIN ] Update Progress: 782/2371 symbols completed. EQS took 6.2s. Estimated remaining: 7m 34s. Rate: 210.2 symbols/min [2025-09-29T02:01:04.869100] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:04.921972] [DEBUG] [LOCAL ] ETW: Loaded 25463 existing records from primary storage. [2025-09-29T02:01:04.933145] [INFO ] [MAIN ] ETW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:05.003638] [INFO ] [MAIN ] Update Progress: 783/2371 symbols completed. ETW took 1.0s. Estimated remaining: 7m 33s. Rate: 210.2 symbols/min [2025-09-29T02:01:05.083887] [DEBUG] [LOCAL ] ETX: Loaded 5028 existing records from primary storage. [2025-09-29T02:01:05.221491] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:05.266439] [INFO ] [MAIN ] ETX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:05.256532] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:05.283312] [INFO ] [MAIN ] Update Progress: 784/2371 symbols completed. ETX took 0.8s. Estimated remaining: 7m 33s. Rate: 210.2 symbols/min [2025-09-29T02:01:05.497102] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:05.551980] [DEBUG] [LOCAL ] ETY: Loaded 23078 existing records from primary storage. [2025-09-29T02:01:05.553923] [DEBUG] [LOCAL ] EVC: Loaded 19415 existing records from primary storage. [2025-09-29T02:01:05.575788] [INFO ] [MAIN ] ETY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:05.582262] [INFO ] [MAIN ] EVC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:05.606569] [INFO ] [MAIN ] Update Progress: 785/2371 symbols completed. ETY took 0.9s. Estimated remaining: 7m 33s. Rate: 210.2 symbols/min [2025-09-29T02:01:05.650719] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:05.645455] [INFO ] [MAIN ] Update Progress: 786/2371 symbols completed. EVC took 0.9s. Estimated remaining: 7m 32s. Rate: 210.4 symbols/min [2025-09-29T02:01:05.877671] [DEBUG] [LOCAL ] EVEX: Loaded 30549 existing records from primary storage. [2025-09-29T02:01:05.948619] [INFO ] [MAIN ] EVEX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:05.968582] [DEBUG] [LOCAL ] EVF: Loaded 9501 existing records from primary storage. [2025-09-29T02:01:05.990434] [INFO ] [MAIN ] Update Progress: 787/2371 symbols completed. EVEX took 0.9s. Estimated remaining: 7m 32s. Rate: 210.3 symbols/min [2025-09-29T02:01:05.995580] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:06.001454] [INFO ] [MAIN ] EVF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:06.012561] [INFO ] [MAIN ] Update Progress: 788/2371 symbols completed. EVF took 0.7s. Estimated remaining: 7m 31s. Rate: 210.6 symbols/min [2025-09-29T02:01:06.226999] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:06.282392] [DEBUG] [LOCAL ] EVG: Loaded 5862 existing records from primary storage. [2025-09-29T02:01:06.334947] [INFO ] [MAIN ] EVG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:06.347376] [INFO ] [MAIN ] Update Progress: 789/2371 symbols completed. EVG took 0.7s. Estimated remaining: 7m 31s. Rate: 210.5 symbols/min [2025-09-29T02:01:06.534806] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:06.573405] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:06.669402] [DEBUG] [LOCAL ] EVN: Loaded 11217 existing records from primary storage. [2025-09-29T02:01:06.670010] [INFO ] [MAIN ] EVN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:06.670278] [INFO ] [MAIN ] Update Progress: 790/2371 symbols completed. EVN took 0.7s. Estimated remaining: 7m 31s. Rate: 210.5 symbols/min [2025-09-29T02:01:06.836162] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:06.898626] [DEBUG] [LOCAL ] EVH: Loaded 50111 existing records from primary storage. [2025-09-29T02:01:06.914497] [INFO ] [MAIN ] EVH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:06.915209] [INFO ] [MAIN ] Update Progress: 791/2371 symbols completed. EVH took 1.2s. Estimated remaining: 7m 30s. Rate: 210.5 symbols/min [2025-09-29T02:01:07.007382] [DEBUG] [LOCAL ] EVR: Loaded 35882 existing records from primary storage. [2025-09-29T02:01:07.035734] [INFO ] [MAIN ] EVR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:07.099924] [DEBUG] [LOCAL ] EVT: Loaded 17270 existing records from primary storage. [2025-09-29T02:01:07.109727] [INFO ] [MAIN ] Update Progress: 792/2371 symbols completed. EVR took 1.1s. Estimated remaining: 7m 30s. Rate: 210.6 symbols/min [2025-09-29T02:01:07.109597] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:07.152881] [INFO ] [MAIN ] EVT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:07.164132] [INFO ] [MAIN ] Update Progress: 793/2371 symbols completed. EVT took 0.8s. Estimated remaining: 7m 29s. Rate: 210.8 symbols/min [2025-09-29T02:01:07.475362] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:07.624974] [DEBUG] [LOCAL ] EVTC: Loaded 26745 existing records from primary storage. [2025-09-29T02:01:07.645741] [INFO ] [MAIN ] EVTC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:07.657386] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:07.647062] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:07.659778] [INFO ] [MAIN ] Update Progress: 794/2371 symbols completed. EVTC took 1.0s. Estimated remaining: 7m 29s. Rate: 210.6 symbols/min [2025-09-29T02:01:07.821060] [DEBUG] [LOCAL ] EVTL: Loaded 38140 existing records from primary storage. [2025-09-29T02:01:07.826980] [INFO ] [MAIN ] EVTL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:07.862273] [INFO ] [MAIN ] Update Progress: 795/2371 symbols completed. EVTL took 0.9s. Estimated remaining: 7m 29s. Rate: 210.7 symbols/min [2025-09-29T02:01:07.905349] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:07.951347] [DEBUG] [LOCAL ] EVTR: Loaded 23675 existing records from primary storage. [2025-09-29T02:01:08.020327] [INFO ] [MAIN ] EVTR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:08.039768] [INFO ] [MAIN ] Update Progress: 796/2371 symbols completed. EVTR took 0.9s. Estimated remaining: 7m 28s. Rate: 210.8 symbols/min [2025-09-29T02:01:08.127583] [DEBUG] [LOCAL ] EW: Loaded 54176 existing records from primary storage. [2025-09-29T02:01:08.221209] [INFO ] [MAIN ] EW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:08.211485] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:08.227685] [INFO ] [MAIN ] Update Progress: 797/2371 symbols completed. EW took 1.1s. Estimated remaining: 7m 28s. Rate: 210.9 symbols/min [2025-09-29T02:01:08.308338] [DEBUG] [LOCAL ] EXG: Loaded 34725 existing records from primary storage. [2025-09-29T02:01:08.361082] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:08.361488] [INFO ] [MAIN ] EXG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:08.362114] [INFO ] [MAIN ] Update Progress: 798/2371 symbols completed. EXG took 0.7s. Estimated remaining: 7m 27s. Rate: 211.0 symbols/min [2025-09-29T02:01:08.435285] [DEBUG] [LOCAL ] EXP: Loaded 30275 existing records from primary storage. [2025-09-29T02:01:08.437009] [DEBUG] [LOCAL ] EXK: Loaded 53904 existing records from primary storage. [2025-09-29T02:01:08.437586] [INFO ] [MAIN ] EXK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:08.437714] [INFO ] [MAIN ] EXP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:08.438135] [INFO ] [MAIN ] Update Progress: 799/2371 symbols completed. EXK took 0.5s. Estimated remaining: 7m 27s. Rate: 211.2 symbols/min [2025-09-29T02:01:08.438479] [INFO ] [MAIN ] Update Progress: 800/2371 symbols completed. EXP took 0.4s. Estimated remaining: 7m 26s. Rate: 211.5 symbols/min [2025-09-29T02:01:09.141153] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:09.187891] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:09.204816] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:09.253418] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:09.309798] [DEBUG] [LOCAL ] FAF: Loaded 42474 existing records from primary storage. [2025-09-29T02:01:09.310274] [INFO ] [MAIN ] FAF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:09.310699] [INFO ] [MAIN ] Update Progress: 801/2371 symbols completed. FAF took 0.8s. Estimated remaining: 7m 27s. Rate: 210.9 symbols/min [2025-09-29T02:01:09.504908] [DEBUG] [LOCAL ] EXR: Loaded 46080 existing records from primary storage. [2025-09-29T02:01:09.553099] [DEBUG] [LOCAL ] EXPD: Loaded 48786 existing records from primary storage. [2025-09-29T02:01:09.585928] [DEBUG] [LOCAL ] F: Loaded 54600 existing records from primary storage. [2025-09-29T02:01:09.580559] [INFO ] [MAIN ] EXPD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:09.587797] [INFO ] [MAIN ] EXR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:09.606595] [INFO ] [MAIN ] Update Progress: 802/2371 symbols completed. EXPD took 1.2s. Estimated remaining: 7m 26s. Rate: 210.9 symbols/min [2025-09-29T02:01:09.611367] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:09.611490] [INFO ] [MAIN ] F: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:09.618043] [INFO ] [MAIN ] Update Progress: 803/2371 symbols completed. F took 1.2s. Estimated remaining: 7m 25s. Rate: 211.2 symbols/min [2025-09-29T02:01:09.629563] [INFO ] [MAIN ] Update Progress: 804/2371 symbols completed. EXR took 1.1s. Estimated remaining: 7m 25s. Rate: 211.4 symbols/min [2025-09-29T02:01:10.180124] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:10.184960] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:10.281522] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:10.308742] [DEBUG] [LOCAL ] FBIN: Loaded 51061 existing records from primary storage. [2025-09-29T02:01:10.309918] [INFO ] [MAIN ] FBIN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:10.311207] [INFO ] [MAIN ] Update Progress: 805/2371 symbols completed. FBIN took 1.0s. Estimated remaining: 7m 25s. Rate: 211.1 symbols/min [2025-09-29T02:01:10.452551] [DEBUG] [LOCAL ] FBK: Loaded 26066 existing records from primary storage. [2025-09-29T02:01:10.454115] [INFO ] [MAIN ] FBK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:10.487699] [INFO ] [MAIN ] Update Progress: 806/2371 symbols completed. FBK took 0.9s. Estimated remaining: 7m 25s. Rate: 211.2 symbols/min [2025-09-29T02:01:10.556584] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:10.571030] [DEBUG] [LOCAL ] FBP: Loaded 46874 existing records from primary storage. [2025-09-29T02:01:10.613953] [INFO ] [MAIN ] FBP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:10.628082] [INFO ] [MAIN ] Update Progress: 807/2371 symbols completed. FBP took 1.0s. Estimated remaining: 7m 24s. Rate: 211.3 symbols/min [2025-09-29T02:01:10.687206] [DEBUG] [LOCAL ] FBRT: Loaded 34985 existing records from primary storage. [2025-09-29T02:01:10.726284] [INFO ] [MAIN ] FBRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:10.762732] [INFO ] [MAIN ] Update Progress: 808/2371 symbols completed. FBRT took 1.1s. Estimated remaining: 7m 24s. Rate: 211.4 symbols/min [2025-09-29T02:01:10.814399] [DEBUG] [LOCAL ] FC: Loaded 15634 existing records from primary storage. [2025-09-29T02:01:10.885278] [INFO ] [MAIN ] FC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:10.935216] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:10.958189] [INFO ] [MAIN ] Update Progress: 809/2371 symbols completed. FC took 0.6s. Estimated remaining: 7m 23s. Rate: 211.5 symbols/min [2025-09-29T02:01:11.174984] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:11.329368] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:11.423601] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:11.424245] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-09-29T02:01:11.424320] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-09-29T02:01:11.424410] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-09-29T02:01:11.424453] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-09-29T02:01:11.424497] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-09-29T02:01:11.424675] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-09-29T02:01:11.536526] [DEBUG] [LOCAL ] FCN: Loaded 26559 existing records from primary storage. [2025-09-29T02:01:11.560353] [INFO ] [MAIN ] FCN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:11.565854] [INFO ] [MAIN ] Update Progress: 810/2371 symbols completed. FCN took 0.9s. Estimated remaining: 7m 23s. Rate: 211.2 symbols/min [2025-09-29T02:01:11.567056] [DEBUG] [LOCAL ] FCF: Loaded 40237 existing records from primary storage. [2025-09-29T02:01:11.612470] [INFO ] [MAIN ] FCF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:11.634702] [INFO ] [MAIN ] Update Progress: 811/2371 symbols completed. FCF took 1.1s. Estimated remaining: 7m 23s. Rate: 211.4 symbols/min [2025-09-29T02:01:11.987255] [DEBUG] [LOCAL ] FCPT: Loaded 37955 existing records from primary storage. [2025-09-29T02:01:12.075318] [INFO ] [MAIN ] FCPT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:12.162567] [INFO ] [MAIN ] Update Progress: 812/2371 symbols completed. FCPT took 1.3s. Estimated remaining: 7m 23s. Rate: 211.2 symbols/min [2025-09-29T02:01:12.232816] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:12.305364] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:12.367972] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:01:12.407526] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2024-12. [2025-09-29T02:01:12.491720] [DEBUG] [LOCAL ] FCT: Loaded 14613 existing records from primary storage. [2025-09-29T02:01:12.493073] [INFO ] [MAIN ] FCT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:12.558025] [INFO ] [MAIN ] Update Progress: 813/2371 symbols completed. FCT took 1.0s. Estimated remaining: 7m 23s. Rate: 211.1 symbols/min [2025-09-29T02:01:12.588581] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:12.726313] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-09-29T02:01:12.733693] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-09-29T02:01:12.735905] [DEBUG] [LOCAL ] FCX: Loaded 54480 existing records from primary storage. [2025-09-29T02:01:12.737690] [INFO ] [MAIN ] FCX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:12.743899] [INFO ] [MAIN ] Update Progress: 814/2371 symbols completed. FCX took 1.0s. Estimated remaining: 7m 22s. Rate: 211.2 symbols/min [2025-09-29T02:01:12.948045] [DEBUG] [LOCAL ] FDP: Loaded 30760 existing records from primary storage. [2025-09-29T02:01:12.983824] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:12.980838] [INFO ] [MAIN ] FDP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:12.986108] [INFO ] [MAIN ] Update Progress: 815/2371 symbols completed. FDP took 0.7s. Estimated remaining: 7m 22s. Rate: 211.2 symbols/min [2025-09-29T02:01:13.129269] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-29T02:01:13.172837] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-09-29T02:01:13.171192] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:13.284995] [DEBUG] [LOCAL ] FDS: Loaded 26759 existing records from primary storage. [2025-09-29T02:01:13.308152] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:13.309049] [INFO ] [MAIN ] FDS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:13.309834] [INFO ] [MAIN ] Update Progress: 816/2371 symbols completed. FDS took 0.7s. Estimated remaining: 7m 22s. Rate: 211.2 symbols/min [2025-09-29T02:01:13.550788] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-29T02:01:13.558009] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-09-29T02:01:13.575493] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:13.578916] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-09-29T02:01:13.579001] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-09-29T02:01:13.579106] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-09-29T02:01:13.579185] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-09-29T02:01:13.579288] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-09-29T02:01:13.577461] [DEBUG] [LOCAL ] FDX: Loaded 52362 existing records from primary storage. [2025-09-29T02:01:13.579374] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-09-29T02:01:13.605395] [INFO ] [MAIN ] FDX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:13.670230] [INFO ] [MAIN ] Update Progress: 817/2371 symbols completed. FDX took 0.9s. Estimated remaining: 7m 22s. Rate: 211.1 symbols/min [2025-09-29T02:01:13.743465] [DEBUG] [LOCAL ] FE: Loaded 54208 existing records from primary storage. [2025-09-29T02:01:13.772907] [INFO ] [MAIN ] FE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:13.798774] [INFO ] [MAIN ] Update Progress: 818/2371 symbols completed. FE took 0.8s. Estimated remaining: 7m 21s. Rate: 211.3 symbols/min [2025-09-29T02:01:13.860025] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-09-29T02:01:13.977904] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-09-29T02:01:14.328172] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:14.420144] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:14.467394] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-29T02:01:14.476405] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:01:14.479078] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-09-29T02:01:14.480900] [INFO ] [REMOTE ] FENG: Fetching primary data for 2024-12. [2025-09-29T02:01:14.497339] [DEBUG] [LOCAL ] FET: Loaded 12984 existing records from primary storage. [2025-09-29T02:01:14.497711] [INFO ] [MAIN ] FET: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:14.497826] [INFO ] [MAIN ] Update Progress: 819/2371 symbols completed. FET took 0.6s. Estimated remaining: 7m 22s. Rate: 210.9 symbols/min [2025-09-29T02:01:14.645418] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2024-12 (0.16 seconds). [2025-09-29T02:01:14.693385] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.21 seconds). [2025-09-29T02:01:14.694689] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-09-29T02:01:14.735542] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:14.740268] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-09-29T02:01:14.745980] [DEBUG] [LOCAL ] FERG: Loaded 49691 existing records from primary storage. [2025-09-29T02:01:14.746766] [INFO ] [MAIN ] FERG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:14.747287] [INFO ] [MAIN ] Update Progress: 820/2371 symbols completed. FERG took 1.0s. Estimated remaining: 7m 21s. Rate: 210.9 symbols/min [2025-09-29T02:01:14.979156] [DEBUG] [LOCAL ] FF: Loaded 25768 existing records from primary storage. [2025-09-29T02:01:14.977917] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:14.979605] [INFO ] [MAIN ] FF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:14.979952] [INFO ] [MAIN ] Update Progress: 821/2371 symbols completed. FF took 0.5s. Estimated remaining: 7m 21s. Rate: 211.0 symbols/min [2025-09-29T02:01:15.073429] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-29T02:01:15.091359] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-29T02:01:15.111686] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-09-29T02:01:15.110157] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-09-29T02:01:15.134814] [DEBUG] [LOCAL ] FFA: Loaded 5800 existing records from primary storage. [2025-09-29T02:01:15.201976] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:15.202200] [INFO ] [MAIN ] FFA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:15.202578] [INFO ] [MAIN ] Update Progress: 822/2371 symbols completed. FFA took 0.5s. Estimated remaining: 7m 20s. Rate: 211.0 symbols/min [2025-09-29T02:01:15.376154] [DEBUG] [LOCAL ] FFC: Loaded 16899 existing records from primary storage. [2025-09-29T02:01:15.392721] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-09-29T02:01:15.416496] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-09-29T02:01:15.415119] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:15.416727] [INFO ] [MAIN ] FFC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:15.417904] [INFO ] [MAIN ] Update Progress: 823/2371 symbols completed. FFC took 0.4s. Estimated remaining: 7m 20s. Rate: 211.1 symbols/min [2025-09-29T02:01:15.439366] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-29T02:01:15.478008] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-09-29T02:01:15.597637] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.18 seconds). [2025-09-29T02:01:15.631494] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-09-29T02:01:15.635837] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:15.650937] [DEBUG] [LOCAL ] FFWM: Loaded 36532 existing records from primary storage. [2025-09-29T02:01:15.651423] [INFO ] [MAIN ] FFWM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:15.651533] [INFO ] [MAIN ] Update Progress: 824/2371 symbols completed. FFWM took 0.4s. Estimated remaining: 7m 20s. Rate: 211.1 symbols/min [2025-09-29T02:01:15.816235] [DEBUG] [LOCAL ] FG: Loaded 22819 existing records from primary storage. [2025-09-29T02:01:15.837171] [INFO ] [MAIN ] FG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:15.857447] [INFO ] [MAIN ] Update Progress: 825/2371 symbols completed. FG took 0.4s. Estimated remaining: 7m 19s. Rate: 211.2 symbols/min [2025-09-29T02:01:15.922244] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:15.928526] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-29T02:01:15.957071] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-09-29T02:01:15.949216] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-29T02:01:15.975535] [INFO ] [REMOTE ] FCRX: Full fetch complete (1674 records). [2025-09-29T02:01:16.012343] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-09-29T02:01:16.038311] [DEBUG] [LOCAL ] FGN: Loaded 3915 existing records from primary storage. [2025-09-29T02:01:16.044299] [INFO ] [MAIN ] FGN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:16.051105] [INFO ] [MAIN ] Update Progress: 826/2371 symbols completed. FGN took 0.4s. Estimated remaining: 7m 19s. Rate: 211.3 symbols/min [2025-09-29T02:01:16.275574] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-09-29T02:01:16.250513] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:16.330699] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-09-29T02:01:16.334818] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-09-29T02:01:16.315062] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-09-29T02:01:16.380995] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-09-29T02:01:16.452748] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-09-29T02:01:16.503220] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-09-29T02:01:16.515114] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-09-29T02:01:16.513462] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-09-29T02:01:16.537159] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:16.572096] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:01:16.599924] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:01:16.629038] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-09-29T02:01:16.629251] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-09-29T02:01:16.636178] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-09-29T02:01:16.636333] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-09-29T02:01:16.642886] [INFO ] [MAIN ] Update Progress: 827/2371 symbols completed. FCRX took 5.6s. Estimated remaining: 7m 19s. Rate: 211.0 symbols/min [2025-09-29T02:01:16.791757] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-29T02:01:16.903689] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-09-29T02:01:17.016513] [DEBUG] [LOCAL ] FHI: Loaded 41203 existing records from primary storage. [2025-09-29T02:01:17.171819] [INFO ] [MAIN ] FHI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:17.153782] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:17.216361] [INFO ] [MAIN ] Update Progress: 828/2371 symbols completed. FHI took 1.1s. Estimated remaining: 7m 19s. Rate: 210.7 symbols/min [2025-09-29T02:01:17.225003] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:01:17.226565] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2024-12. [2025-09-29T02:01:17.294142] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-29T02:01:17.335831] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-09-29T02:01:17.409266] [DEBUG] [REMOTE ] FGSN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:01:17.446242] [WARN ] [REMOTE ] FGSN: No data returned for month 2024-12 [2025-09-29T02:01:17.467243] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:17.467934] [FATAL] [REMOTE ] FGSN: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:01:17.468185] [FATAL] [MAIN ] FGSN: Failed to fetch primary data. [2025-09-29T02:01:17.468744] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:01:17.468853] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-09-29T02:01:17.468969] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-09-29T02:01:17.469047] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-09-29T02:01:17.469157] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-09-29T02:01:17.469259] [INFO ] [MAIN ] Update Progress: 829/2371 symbols completed. FGSN took 1.6s. Estimated remaining: 7m 19s. Rate: 210.8 symbols/min [2025-09-29T02:01:17.610096] [DEBUG] [LOCAL ] FHN: Loaded 54148 existing records from primary storage. [2025-09-29T02:01:17.634408] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-09-29T02:01:17.692535] [INFO ] [MAIN ] FHN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:17.698508] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-09-29T02:01:17.699840] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:17.701360] [INFO ] [MAIN ] Update Progress: 830/2371 symbols completed. FHN took 1.0s. Estimated remaining: 7m 19s. Rate: 210.8 symbols/min [2025-09-29T02:01:17.955990] [DEBUG] [LOCAL ] FI: Loaded 54281 existing records from primary storage. [2025-09-29T02:01:17.957770] [DEBUG] [LOCAL ] FICO: Loaded 20674 existing records from primary storage. [2025-09-29T02:01:17.957028] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:17.960860] [INFO ] [MAIN ] FI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:17.962100] [INFO ] [MAIN ] Update Progress: 831/2371 symbols completed. FI took 0.7s. Estimated remaining: 7m 18s. Rate: 210.8 symbols/min [2025-09-29T02:01:17.961446] [INFO ] [MAIN ] FICO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:17.961254] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-09-29T02:01:17.967730] [INFO ] [MAIN ] Update Progress: 832/2371 symbols completed. FICO took 0.5s. Estimated remaining: 7m 17s. Rate: 211.1 symbols/min [2025-09-29T02:01:17.961152] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-09-29T02:01:17.975100] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-09-29T02:01:17.975210] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-09-29T02:01:18.029416] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-09-29T02:01:18.047478] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-09-29T02:01:18.095384] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-09-29T02:01:18.107168] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-09-29T02:01:18.407899] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:18.524669] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-29T02:01:18.524498] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:18.613519] [INFO ] [REMOTE ] FENG: Full fetch complete (2245 records). [2025-09-29T02:01:18.630888] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-09-29T02:01:19.002611] [DEBUG] [LOCAL ] FIGS: Loaded 49651 existing records from primary storage. [2025-09-29T02:01:19.001052] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:01:19.019842] [INFO ] [MAIN ] FIGS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:19.025969] [INFO ] [MAIN ] Update Progress: 833/2371 symbols completed. FIGS took 1.1s. Estimated remaining: 7m 19s. Rate: 210.4 symbols/min [2025-09-29T02:01:19.042812] [INFO ] [REMOTE ] FIG: Fetching primary data for 2024-12. [2025-09-29T02:01:19.032148] [DEBUG] [LOCAL ] FIHL: Loaded 40851 existing records from primary storage. [2025-09-29T02:01:19.076633] [INFO ] [MAIN ] FIHL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:19.099280] [INFO ] [MAIN ] Update Progress: 834/2371 symbols completed. FIHL took 1.1s. Estimated remaining: 7m 18s. Rate: 210.6 symbols/min [2025-09-29T02:01:19.198861] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-29T02:01:19.279193] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:01:19.284529] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:01:19.303192] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-09-29T02:01:19.330210] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-09-29T02:01:19.363624] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-09-29T02:01:19.405489] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-29T02:01:19.405610] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-09-29T02:01:19.417780] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-09-29T02:01:19.416743] [INFO ] [MAIN ] Update Progress: 835/2371 symbols completed. FENG took 6.1s. Estimated remaining: 7m 18s. Rate: 210.6 symbols/min [2025-09-29T02:01:19.453032] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:19.595544] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:19.633149] [DEBUG] [LOCAL ] FINS: Loaded 8309 existing records from primary storage. [2025-09-29T02:01:19.644960] [INFO ] [MAIN ] FINS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:19.633255] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.22 seconds). [2025-09-29T02:01:19.659952] [INFO ] [MAIN ] Update Progress: 836/2371 symbols completed. FINS took 0.6s. Estimated remaining: 7m 17s. Rate: 210.6 symbols/min [2025-09-29T02:01:19.661033] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-09-29T02:01:19.880389] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:20.000037] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:20.018487] [DEBUG] [LOCAL ] FINV: Loaded 45772 existing records from primary storage. [2025-09-29T02:01:20.019057] [INFO ] [MAIN ] FINV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:20.019356] [INFO ] [MAIN ] Update Progress: 837/2371 symbols completed. FINV took 0.8s. Estimated remaining: 7m 17s. Rate: 210.5 symbols/min [2025-09-29T02:01:20.083384] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-29T02:01:20.085174] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-09-29T02:01:20.086838] [DEBUG] [LOCAL ] FIS: Loaded 54144 existing records from primary storage. [2025-09-29T02:01:20.096700] [INFO ] [MAIN ] FIS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:20.097269] [INFO ] [MAIN ] Update Progress: 838/2371 symbols completed. FIS took 0.6s. Estimated remaining: 7m 17s. Rate: 210.7 symbols/min [2025-09-29T02:01:20.098562] [DEBUG] [LOCAL ] FIX: Loaded 30763 existing records from primary storage. [2025-09-29T02:01:20.098952] [INFO ] [MAIN ] FIX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:20.099088] [INFO ] [MAIN ] Update Progress: 839/2371 symbols completed. FIX took 0.4s. Estimated remaining: 7m 16s. Rate: 211.0 symbols/min [2025-09-29T02:01:20.220386] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.14 seconds). [2025-09-29T02:01:20.221561] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-09-29T02:01:20.419713] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.20 seconds). [2025-09-29T02:01:20.420794] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-09-29T02:01:20.637313] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.22 seconds). [2025-09-29T02:01:20.638477] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-09-29T02:01:20.807838] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:01:20.808229] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-09-29T02:01:20.808323] [FATAL] [REMOTE ] FIG: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:01:20.808434] [FATAL] [MAIN ] FIG: Failed to fetch primary data. [2025-09-29T02:01:20.808509] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:01:20.808584] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-09-29T02:01:20.808717] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-09-29T02:01:20.808803] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-09-29T02:01:20.808913] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-09-29T02:01:20.809005] [INFO ] [MAIN ] Update Progress: 840/2371 symbols completed. FIG took 3.1s. Estimated remaining: 7m 16s. Rate: 210.6 symbols/min [2025-09-29T02:01:21.492709] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:21.569768] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:21.638424] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:21.649164] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-09-29T02:01:21.649868] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-09-29T02:01:21.648719] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:21.650491] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-09-29T02:01:21.651141] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-09-29T02:01:21.651303] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-09-29T02:01:21.651577] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-09-29T02:01:21.747371] [DEBUG] [LOCAL ] FLC: Loaded 5559 existing records from primary storage. [2025-09-29T02:01:21.787205] [INFO ] [MAIN ] FLC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:21.802487] [INFO ] [MAIN ] Update Progress: 841/2371 symbols completed. FLC took 1.0s. Estimated remaining: 7m 17s. Rate: 210.0 symbols/min [2025-09-29T02:01:22.037715] [DEBUG] [LOCAL ] FLNG: Loaded 34431 existing records from primary storage. [2025-09-29T02:01:22.101469] [INFO ] [MAIN ] FLNG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:22.137225] [DEBUG] [LOCAL ] FLG: Loaded 54105 existing records from primary storage. [2025-09-29T02:01:22.165801] [INFO ] [MAIN ] Update Progress: 842/2371 symbols completed. FLNG took 1.3s. Estimated remaining: 7m 17s. Rate: 209.9 symbols/min [2025-09-29T02:01:22.203981] [INFO ] [MAIN ] FLG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:22.264101] [INFO ] [MAIN ] Update Progress: 843/2371 symbols completed. FLG took 1.4s. Estimated remaining: 7m 16s. Rate: 210.1 symbols/min [2025-09-29T02:01:22.387678] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:22.734224] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:01:22.734870] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2024-12. [2025-09-29T02:01:22.707395] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:22.797772] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-09-29T02:01:22.839436] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:22.840201] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-09-29T02:01:22.840921] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-09-29T02:01:22.841113] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-09-29T02:01:22.841204] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-09-29T02:01:22.841280] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-09-29T02:01:22.904743] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:01:22.926715] [WARN ] [REMOTE ] FIXT: No data returned for month 2024-12 [2025-09-29T02:01:22.964484] [FATAL] [REMOTE ] FIXT: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:01:22.978228] [FATAL] [MAIN ] FIXT: Failed to fetch primary data. [2025-09-29T02:01:22.982857] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:01:22.983172] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-09-29T02:01:22.990973] [DEBUG] [LOCAL ] FLO: Loaded 52656 existing records from primary storage. [2025-09-29T02:01:22.983348] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-09-29T02:01:23.001904] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-09-29T02:01:23.012769] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-09-29T02:01:23.013004] [INFO ] [MAIN ] FLO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:23.013783] [INFO ] [MAIN ] Update Progress: 844/2371 symbols completed. FLO took 1.2s. Estimated remaining: 7m 17s. Rate: 209.7 symbols/min [2025-09-29T02:01:23.037294] [INFO ] [MAIN ] Update Progress: 845/2371 symbols completed. FIXT took 2.2s. Estimated remaining: 7m 16s. Rate: 209.9 symbols/min [2025-09-29T02:01:23.425121] [DEBUG] [LOCAL ] FLR: Loaded 53892 existing records from primary storage. [2025-09-29T02:01:23.526099] [INFO ] [MAIN ] FLR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:23.647487] [INFO ] [MAIN ] Update Progress: 846/2371 symbols completed. FLR took 1.3s. Estimated remaining: 7m 17s. Rate: 209.6 symbols/min [2025-09-29T02:01:23.653609] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:23.735334] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:01:23.808631] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:23.787938] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2024-12. [2025-09-29T02:01:23.967283] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:23.987368] [DEBUG] [REMOTE ] FLOC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:01:23.988124] [WARN ] [REMOTE ] FLOC: No data returned for month 2024-12 [2025-09-29T02:01:23.988222] [FATAL] [REMOTE ] FLOC: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:01:23.988348] [FATAL] [MAIN ] FLOC: Failed to fetch primary data. [2025-09-29T02:01:23.988562] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:01:23.988732] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-09-29T02:01:23.988889] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-09-29T02:01:23.988954] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-09-29T02:01:23.989085] [DEBUG] [LOCAL ] FLOC: No derivative data file found to delete. [2025-09-29T02:01:23.989228] [INFO ] [MAIN ] Update Progress: 847/2371 symbols completed. FLOC took 1.8s. Estimated remaining: 7m 16s. Rate: 209.6 symbols/min [2025-09-29T02:01:24.110688] [DEBUG] [LOCAL ] FLS: Loaded 50934 existing records from primary storage. [2025-09-29T02:01:24.174270] [INFO ] [MAIN ] FLS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:24.174754] [DEBUG] [LOCAL ] FLXR: Loaded 20315 existing records from primary storage. [2025-09-29T02:01:24.234464] [INFO ] [MAIN ] FLXR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:24.175737] [DEBUG] [LOCAL ] FLUT: Loaded 51580 existing records from primary storage. [2025-09-29T02:01:24.256404] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:24.217759] [INFO ] [MAIN ] Update Progress: 848/2371 symbols completed. FLS took 1.2s. Estimated remaining: 7m 16s. Rate: 209.6 symbols/min [2025-09-29T02:01:24.262057] [INFO ] [MAIN ] Update Progress: 849/2371 symbols completed. FLXR took 0.6s. Estimated remaining: 7m 15s. Rate: 209.8 symbols/min [2025-09-29T02:01:24.273492] [INFO ] [MAIN ] FLUT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:24.280191] [INFO ] [MAIN ] Update Progress: 850/2371 symbols completed. FLUT took 1.2s. Estimated remaining: 7m 14s. Rate: 210.1 symbols/min [2025-09-29T02:01:24.854023] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:24.892109] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:24.890550] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:24.917597] [DEBUG] [LOCAL ] FMC: Loaded 52560 existing records from primary storage. [2025-09-29T02:01:24.918576] [INFO ] [MAIN ] FMC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:24.920538] [INFO ] [MAIN ] Update Progress: 851/2371 symbols completed. FMC took 0.9s. Estimated remaining: 7m 15s. Rate: 209.7 symbols/min [2025-09-29T02:01:24.968844] [DEBUG] [LOCAL ] FMN: Loaded 6097 existing records from primary storage. [2025-09-29T02:01:25.012891] [INFO ] [MAIN ] FMN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:25.032976] [INFO ] [MAIN ] Update Progress: 852/2371 symbols completed. FMN took 0.8s. Estimated remaining: 7m 14s. Rate: 209.9 symbols/min [2025-09-29T02:01:25.239468] [DEBUG] [LOCAL ] FMS: Loaded 30771 existing records from primary storage. [2025-09-29T02:01:25.299792] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:25.265501] [DEBUG] [LOCAL ] FMX: Loaded 41276 existing records from primary storage. [2025-09-29T02:01:25.311785] [INFO ] [MAIN ] FMS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:25.317544] [INFO ] [MAIN ] FMX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:25.344949] [INFO ] [MAIN ] Update Progress: 853/2371 symbols completed. FMS took 1.1s. Estimated remaining: 7m 14s. Rate: 209.9 symbols/min [2025-09-29T02:01:25.360910] [INFO ] [MAIN ] Update Progress: 854/2371 symbols completed. FMX took 1.0s. Estimated remaining: 7m 13s. Rate: 210.1 symbols/min [2025-09-29T02:01:25.402305] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:25.412920] [DEBUG] [LOCAL ] FMY: Loaded 1400 existing records from primary storage. [2025-09-29T02:01:25.526620] [INFO ] [MAIN ] FMY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:25.570235] [INFO ] [MAIN ] Update Progress: 855/2371 symbols completed. FMY took 0.6s. Estimated remaining: 7m 13s. Rate: 210.2 symbols/min [2025-09-29T02:01:25.939445] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:25.893322] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:25.991797] [DEBUG] [LOCAL ] FN: Loaded 39795 existing records from primary storage. [2025-09-29T02:01:26.022120] [INFO ] [MAIN ] FN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:26.046628] [INFO ] [MAIN ] Update Progress: 856/2371 symbols completed. FN took 1.0s. Estimated remaining: 7m 13s. Rate: 210.0 symbols/min [2025-09-29T02:01:26.046345] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:26.344876] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:26.379709] [DEBUG] [LOCAL ] FND: Loaded 52871 existing records from primary storage. [2025-09-29T02:01:26.380850] [DEBUG] [LOCAL ] FNF: Loaded 49871 existing records from primary storage. [2025-09-29T02:01:26.381851] [INFO ] [MAIN ] FND: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:26.382965] [DEBUG] [LOCAL ] FNB: Loaded 53226 existing records from primary storage. [2025-09-29T02:01:26.383226] [INFO ] [MAIN ] FNF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:26.383902] [INFO ] [MAIN ] Update Progress: 857/2371 symbols completed. FND took 1.0s. Estimated remaining: 7m 13s. Rate: 210.0 symbols/min [2025-09-29T02:01:26.384603] [INFO ] [MAIN ] Update Progress: 858/2371 symbols completed. FNF took 0.8s. Estimated remaining: 7m 12s. Rate: 210.2 symbols/min [2025-09-29T02:01:26.396777] [INFO ] [MAIN ] FNB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:26.454710] [INFO ] [MAIN ] Update Progress: 859/2371 symbols completed. FNB took 1.1s. Estimated remaining: 7m 11s. Rate: 210.4 symbols/min [2025-09-29T02:01:26.959742] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:26.969813] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:27.042502] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:27.046969] [DEBUG] [LOCAL ] FNV: Loaded 47028 existing records from primary storage. [2025-09-29T02:01:27.048123] [INFO ] [MAIN ] FNV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:27.048968] [INFO ] [MAIN ] Update Progress: 860/2371 symbols completed. FNV took 1.0s. Estimated remaining: 7m 11s. Rate: 210.1 symbols/min [2025-09-29T02:01:27.132886] [DEBUG] [LOCAL ] FOF: Loaded 8510 existing records from primary storage. [2025-09-29T02:01:27.153713] [INFO ] [MAIN ] FOF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:27.154588] [DEBUG] [LOCAL ] FOA: Loaded 13484 existing records from primary storage. [2025-09-29T02:01:27.171186] [INFO ] [MAIN ] FOA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:27.154787] [INFO ] [MAIN ] Update Progress: 861/2371 symbols completed. FOF took 0.8s. Estimated remaining: 7m 11s. Rate: 210.3 symbols/min [2025-09-29T02:01:27.208513] [INFO ] [MAIN ] Update Progress: 862/2371 symbols completed. FOA took 0.8s. Estimated remaining: 7m 10s. Rate: 210.5 symbols/min [2025-09-29T02:01:27.222022] [DEBUG] [LOCAL ] FOR: Loaded 20362 existing records from primary storage. [2025-09-29T02:01:27.254018] [INFO ] [MAIN ] FOR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:27.274828] [INFO ] [MAIN ] Update Progress: 863/2371 symbols completed. FOR took 0.7s. Estimated remaining: 7m 9s. Rate: 210.7 symbols/min [2025-09-29T02:01:27.511806] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:27.900497] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:27.927920] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:27.956274] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:27.999554] [DEBUG] [LOCAL ] FPH: Loaded 19890 existing records from primary storage. [2025-09-29T02:01:28.007472] [INFO ] [MAIN ] FPH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:28.033552] [INFO ] [MAIN ] Update Progress: 864/2371 symbols completed. FPH took 0.8s. Estimated remaining: 7m 10s. Rate: 210.3 symbols/min [2025-09-29T02:01:28.033413] [DEBUG] [LOCAL ] FPF: Loaded 17998 existing records from primary storage. [2025-09-29T02:01:28.065544] [INFO ] [MAIN ] FPF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:28.084372] [DEBUG] [LOCAL ] FOUR: Loaded 50306 existing records from primary storage. [2025-09-29T02:01:28.113355] [INFO ] [MAIN ] Update Progress: 865/2371 symbols completed. FPF took 0.9s. Estimated remaining: 7m 9s. Rate: 210.4 symbols/min [2025-09-29T02:01:28.132153] [INFO ] [MAIN ] FOUR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:28.143344] [DEBUG] [LOCAL ] FPI: Loaded 31525 existing records from primary storage. [2025-09-29T02:01:28.176301] [INFO ] [MAIN ] Update Progress: 866/2371 symbols completed. FOUR took 1.1s. Estimated remaining: 7m 9s. Rate: 210.6 symbols/min [2025-09-29T02:01:28.197481] [INFO ] [MAIN ] FPI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:28.208616] [INFO ] [MAIN ] Update Progress: 867/2371 symbols completed. FPI took 0.9s. Estimated remaining: 7m 8s. Rate: 210.8 symbols/min [2025-09-29T02:01:28.452905] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:28.726196] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:28.753191] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:28.827010] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:28.863737] [DEBUG] [LOCAL ] FRGE: Loaded 18571 existing records from primary storage. [2025-09-29T02:01:28.877563] [INFO ] [MAIN ] FRGE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:28.879895] [INFO ] [MAIN ] Update Progress: 868/2371 symbols completed. FRGE took 0.7s. Estimated remaining: 7m 8s. Rate: 210.5 symbols/min [2025-09-29T02:01:28.881991] [DEBUG] [LOCAL ] FR: Loaded 47174 existing records from primary storage. [2025-09-29T02:01:28.942307] [DEBUG] [LOCAL ] FRA: Loaded 14717 existing records from primary storage. [2025-09-29T02:01:28.931267] [INFO ] [MAIN ] FR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:28.963621] [INFO ] [MAIN ] Update Progress: 869/2371 symbols completed. FR took 0.9s. Estimated remaining: 7m 8s. Rate: 210.7 symbols/min [2025-09-29T02:01:28.969094] [INFO ] [MAIN ] FRA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:28.986267] [INFO ] [MAIN ] Update Progress: 870/2371 symbols completed. FRA took 0.8s. Estimated remaining: 7m 7s. Rate: 210.9 symbols/min [2025-09-29T02:01:29.376168] [DEBUG] [LOCAL ] FRO: Loaded 52603 existing records from primary storage. [2025-09-29T02:01:29.365424] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:29.479991] [INFO ] [MAIN ] FRO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:29.519173] [INFO ] [MAIN ] Update Progress: 871/2371 symbols completed. FRO took 1.2s. Estimated remaining: 7m 7s. Rate: 210.7 symbols/min [2025-09-29T02:01:29.502702] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:29.524717] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:29.771061] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:29.808611] [DEBUG] [LOCAL ] FRT: Loaded 42808 existing records from primary storage. [2025-09-29T02:01:29.812550] [INFO ] [MAIN ] FRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:29.813507] [INFO ] [MAIN ] Update Progress: 872/2371 symbols completed. FRT took 0.9s. Estimated remaining: 7m 7s. Rate: 210.7 symbols/min [2025-09-29T02:01:29.851600] [DEBUG] [LOCAL ] FSCO: Loaded 37725 existing records from primary storage. [2025-09-29T02:01:29.876633] [INFO ] [MAIN ] FSCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:29.913756] [INFO ] [MAIN ] Update Progress: 873/2371 symbols completed. FSCO took 0.9s. Estimated remaining: 7m 6s. Rate: 210.8 symbols/min [2025-09-29T02:01:29.953174] [DEBUG] [LOCAL ] FSK: Loaded 50173 existing records from primary storage. [2025-09-29T02:01:30.036427] [INFO ] [MAIN ] FSK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:30.082046] [INFO ] [MAIN ] Update Progress: 874/2371 symbols completed. FSK took 1.1s. Estimated remaining: 7m 6s. Rate: 210.9 symbols/min [2025-09-29T02:01:30.248797] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:30.390371] [DEBUG] [LOCAL ] FSLY: Loaded 51989 existing records from primary storage. [2025-09-29T02:01:30.447730] [INFO ] [MAIN ] FSLY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:30.470064] [INFO ] [MAIN ] Update Progress: 875/2371 symbols completed. FSLY took 0.9s. Estimated remaining: 7m 6s. Rate: 210.9 symbols/min [2025-09-29T02:01:30.521668] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:30.762806] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:30.908705] [DEBUG] [LOCAL ] FT: Loaded 6432 existing records from primary storage. [2025-09-29T02:01:30.921443] [INFO ] [MAIN ] FT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:30.925397] [DEBUG] [LOCAL ] FSS: Loaded 34888 existing records from primary storage. [2025-09-29T02:01:30.925810] [INFO ] [MAIN ] Update Progress: 876/2371 symbols completed. FT took 0.8s. Estimated remaining: 7m 6s. Rate: 210.7 symbols/min [2025-09-29T02:01:30.932135] [INFO ] [MAIN ] FSS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:30.981213] [DEBUG] [LOCAL ] FSM: Loaded 54065 existing records from primary storage. [2025-09-29T02:01:30.981415] [INFO ] [MAIN ] Update Progress: 877/2371 symbols completed. FSS took 1.0s. Estimated remaining: 7m 5s. Rate: 210.9 symbols/min [2025-09-29T02:01:31.015320] [INFO ] [MAIN ] FSM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:31.049296] [INFO ] [MAIN ] Update Progress: 878/2371 symbols completed. FSM took 1.2s. Estimated remaining: 7m 4s. Rate: 211.1 symbols/min [2025-09-29T02:01:31.107174] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:31.300559] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:31.301439] [DEBUG] [LOCAL ] FTHY: Loaded 11947 existing records from primary storage. [2025-09-29T02:01:31.302166] [INFO ] [MAIN ] FTHY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:31.302609] [INFO ] [MAIN ] Update Progress: 879/2371 symbols completed. FTHY took 0.8s. Estimated remaining: 7m 4s. Rate: 211.1 symbols/min [2025-09-29T02:01:31.366415] [DEBUG] [LOCAL ] FTI: Loaded 54078 existing records from primary storage. [2025-09-29T02:01:31.366973] [INFO ] [MAIN ] FTI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:31.367623] [INFO ] [MAIN ] Update Progress: 880/2371 symbols completed. FTI took 0.4s. Estimated remaining: 7m 3s. Rate: 211.3 symbols/min [2025-09-29T02:01:32.052161] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:32.144833] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:32.156374] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:32.216238] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:32.220829] [DEBUG] [LOCAL ] FTWO: Loaded 1837 existing records from primary storage. [2025-09-29T02:01:32.221438] [INFO ] [MAIN ] FTWO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:32.221546] [INFO ] [MAIN ] Update Progress: 881/2371 symbols completed. FTWO took 0.8s. Estimated remaining: 7m 4s. Rate: 210.8 symbols/min [2025-09-29T02:01:32.392471] [DEBUG] [LOCAL ] FTK: Loaded 32755 existing records from primary storage. [2025-09-29T02:01:32.398426] [INFO ] [MAIN ] FTK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:32.426608] [INFO ] [MAIN ] Update Progress: 882/2371 symbols completed. FTK took 1.1s. Estimated remaining: 7m 4s. Rate: 210.9 symbols/min [2025-09-29T02:01:32.470973] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:32.647085] [DEBUG] [LOCAL ] FTV: Loaded 53686 existing records from primary storage. [2025-09-29T02:01:32.629804] [DEBUG] [LOCAL ] FTS: Loaded 42695 existing records from primary storage. [2025-09-29T02:01:32.662948] [INFO ] [MAIN ] FTS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:32.663496] [INFO ] [MAIN ] Update Progress: 883/2371 symbols completed. FTS took 1.3s. Estimated remaining: 7m 3s. Rate: 210.9 symbols/min [2025-09-29T02:01:32.663752] [INFO ] [MAIN ] FTV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:32.670026] [INFO ] [MAIN ] Update Progress: 884/2371 symbols completed. FTV took 1.3s. Estimated remaining: 7m 3s. Rate: 211.2 symbols/min [2025-09-29T02:01:32.995064] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:33.059230] [DEBUG] [LOCAL ] FUBO: Loaded 54476 existing records from primary storage. [2025-09-29T02:01:33.120892] [INFO ] [MAIN ] FUBO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:33.178315] [INFO ] [MAIN ] Update Progress: 885/2371 symbols completed. FUBO took 1.0s. Estimated remaining: 7m 3s. Rate: 211.0 symbols/min [2025-09-29T02:01:33.220088] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:33.218875] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:33.403752] [DEBUG] [LOCAL ] FUL: Loaded 33570 existing records from primary storage. [2025-09-29T02:01:33.432415] [INFO ] [MAIN ] FUL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:33.433524] [DEBUG] [LOCAL ] FVR: Loaded 22328 existing records from primary storage. [2025-09-29T02:01:33.455201] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:33.453083] [INFO ] [MAIN ] Update Progress: 886/2371 symbols completed. FUL took 1.0s. Estimated remaining: 7m 2s. Rate: 211.0 symbols/min [2025-09-29T02:01:33.456795] [INFO ] [MAIN ] FVR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:33.468624] [INFO ] [MAIN ] Update Progress: 887/2371 symbols completed. FVR took 0.8s. Estimated remaining: 7m 2s. Rate: 211.2 symbols/min [2025-09-29T02:01:33.792718] [DEBUG] [LOCAL ] FUN: Loaded 52349 existing records from primary storage. [2025-09-29T02:01:33.813832] [INFO ] [MAIN ] FUN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:33.836435] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:33.837201] [INFO ] [MAIN ] Update Progress: 888/2371 symbols completed. FUN took 1.2s. Estimated remaining: 7m 1s. Rate: 211.1 symbols/min [2025-09-29T02:01:33.970544] [DEBUG] [LOCAL ] FXED: Loaded 1259 existing records from primary storage. [2025-09-29T02:01:33.957143] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:33.976743] [DEBUG] [LOCAL ] FVRR: Loaded 40749 existing records from primary storage. [2025-09-29T02:01:34.008126] [INFO ] [MAIN ] FVRR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:34.019715] [INFO ] [MAIN ] FXED: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:34.030388] [INFO ] [MAIN ] Update Progress: 889/2371 symbols completed. FXED took 0.6s. Estimated remaining: 7m 1s. Rate: 211.2 symbols/min [2025-09-29T02:01:34.054668] [INFO ] [MAIN ] Update Progress: 890/2371 symbols completed. FVRR took 0.9s. Estimated remaining: 7m 0s. Rate: 211.4 symbols/min [2025-09-29T02:01:34.327675] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:34.498775] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:34.600419] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:34.603105] [DEBUG] [LOCAL ] G: Loaded 50547 existing records from primary storage. [2025-09-29T02:01:34.604323] [INFO ] [MAIN ] G: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:34.607855] [DEBUG] [LOCAL ] GAM: Loaded 4174 existing records from primary storage. [2025-09-29T02:01:34.609849] [INFO ] [MAIN ] Update Progress: 891/2371 symbols completed. G took 1.1s. Estimated remaining: 7m 0s. Rate: 211.2 symbols/min [2025-09-29T02:01:34.622261] [INFO ] [MAIN ] GAM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:34.662961] [INFO ] [MAIN ] Update Progress: 892/2371 symbols completed. GAM took 0.6s. Estimated remaining: 6m 60s. Rate: 211.4 symbols/min [2025-09-29T02:01:34.727085] [DEBUG] [LOCAL ] GAB: Loaded 28493 existing records from primary storage. [2025-09-29T02:01:34.783701] [INFO ] [MAIN ] GAB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:34.831242] [INFO ] [MAIN ] Update Progress: 893/2371 symbols completed. GAB took 1.0s. Estimated remaining: 6m 59s. Rate: 211.5 symbols/min [2025-09-29T02:01:35.008547] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:35.175478] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:35.177315] [DEBUG] [LOCAL ] GAP: Loaded 54435 existing records from primary storage. [2025-09-29T02:01:35.194935] [INFO ] [MAIN ] GAP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:35.256242] [INFO ] [MAIN ] Update Progress: 894/2371 symbols completed. GAP took 1.2s. Estimated remaining: 6m 59s. Rate: 211.4 symbols/min [2025-09-29T02:01:35.265186] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:35.315600] [DEBUG] [LOCAL ] GBAB: Loaded 13142 existing records from primary storage. [2025-09-29T02:01:35.303982] [DEBUG] [LOCAL ] GATX: Loaded 18437 existing records from primary storage. [2025-09-29T02:01:35.353828] [INFO ] [MAIN ] GBAB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:35.387063] [INFO ] [MAIN ] Update Progress: 895/2371 symbols completed. GBAB took 0.7s. Estimated remaining: 6m 59s. Rate: 211.5 symbols/min [2025-09-29T02:01:35.353979] [INFO ] [MAIN ] GATX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:35.413158] [INFO ] [MAIN ] Update Progress: 896/2371 symbols completed. GATX took 0.8s. Estimated remaining: 6m 58s. Rate: 211.7 symbols/min [2025-09-29T02:01:35.725887] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:35.746457] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-09-29T02:01:35.819364] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-09-29T02:01:35.932510] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:35.913574] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-09-29T02:01:35.958778] [DEBUG] [LOCAL ] GBCI: Loaded 40720 existing records from primary storage. [2025-09-29T02:01:35.962718] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:35.962965] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-09-29T02:01:35.964023] [INFO ] [MAIN ] GBCI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:35.964259] [INFO ] [MAIN ] Update Progress: 897/2371 symbols completed. GBCI took 1.1s. Estimated remaining: 6m 58s. Rate: 211.5 symbols/min [2025-09-29T02:01:35.964158] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-09-29T02:01:35.979773] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-09-29T02:01:36.310509] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:36.418452] [DEBUG] [LOCAL ] GBX: Loaded 29497 existing records from primary storage. [2025-09-29T02:01:36.458058] [DEBUG] [LOCAL ] GBTG: Loaded 40807 existing records from primary storage. [2025-09-29T02:01:36.508847] [INFO ] [MAIN ] GBTG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:36.458240] [INFO ] [MAIN ] GBX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:36.525264] [INFO ] [MAIN ] Update Progress: 898/2371 symbols completed. GBTG took 1.1s. Estimated remaining: 6m 58s. Rate: 211.3 symbols/min [2025-09-29T02:01:36.551491] [INFO ] [MAIN ] Update Progress: 899/2371 symbols completed. GBX took 1.1s. Estimated remaining: 6m 58s. Rate: 211.5 symbols/min [2025-09-29T02:01:36.830790] [DEBUG] [LOCAL ] GCI: Loaded 44828 existing records from primary storage. [2025-09-29T02:01:36.810828] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:01:36.867884] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2024-12. [2025-09-29T02:01:36.873332] [INFO ] [MAIN ] GCI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:36.895299] [INFO ] [MAIN ] Update Progress: 900/2371 symbols completed. GCI took 0.9s. Estimated remaining: 6m 57s. Rate: 211.4 symbols/min [2025-09-29T02:01:37.079030] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:37.194029] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:37.227326] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-29T02:01:37.240329] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-09-29T02:01:37.314676] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:37.349200] [DEBUG] [LOCAL ] GCO: Loaded 25686 existing records from primary storage. [2025-09-29T02:01:37.349743] [DEBUG] [LOCAL ] GCTS: Loaded 20060 existing records from primary storage. [2025-09-29T02:01:37.350227] [INFO ] [MAIN ] GCTS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:37.352540] [INFO ] [MAIN ] GCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:37.352683] [INFO ] [MAIN ] Update Progress: 901/2371 symbols completed. GCTS took 0.8s. Estimated remaining: 6m 57s. Rate: 211.3 symbols/min [2025-09-29T02:01:37.353142] [INFO ] [MAIN ] Update Progress: 902/2371 symbols completed. GCO took 0.8s. Estimated remaining: 6m 57s. Rate: 211.5 symbols/min [2025-09-29T02:01:37.469781] [DEBUG] [LOCAL ] GCV: Loaded 7333 existing records from primary storage. [2025-09-29T02:01:37.533997] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.29 seconds). [2025-09-29T02:01:37.570155] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-09-29T02:01:37.486965] [INFO ] [MAIN ] GCV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:37.613472] [INFO ] [MAIN ] Update Progress: 903/2371 symbols completed. GCV took 0.7s. Estimated remaining: 6m 56s. Rate: 211.5 symbols/min [2025-09-29T02:01:37.753659] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:37.818026] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:37.825506] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-09-29T02:01:37.847597] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-09-29T02:01:37.974692] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:37.983306] [DEBUG] [LOCAL ] GDIV: Loaded 3724 existing records from primary storage. [2025-09-29T02:01:37.983724] [INFO ] [MAIN ] GDIV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:37.983829] [INFO ] [MAIN ] Update Progress: 904/2371 symbols completed. GDIV took 0.3s. Estimated remaining: 6m 56s. Rate: 211.5 symbols/min [2025-09-29T02:01:38.119750] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-09-29T02:01:38.149817] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-09-29T02:01:38.215055] [DEBUG] [LOCAL ] GDDY: Loaded 50449 existing records from primary storage. [2025-09-29T02:01:38.217011] [DEBUG] [LOCAL ] GD: Loaded 47940 existing records from primary storage. [2025-09-29T02:01:38.244702] [INFO ] [MAIN ] GDDY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:38.250921] [INFO ] [MAIN ] Update Progress: 905/2371 symbols completed. GDDY took 0.9s. Estimated remaining: 6m 56s. Rate: 211.5 symbols/min [2025-09-29T02:01:38.250215] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:38.275029] [INFO ] [MAIN ] GD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:38.295858] [INFO ] [MAIN ] Update Progress: 906/2371 symbols completed. GD took 0.9s. Estimated remaining: 6m 55s. Rate: 211.7 symbols/min [2025-09-29T02:01:38.415084] [DEBUG] [LOCAL ] GDL: Loaded 2572 existing records from primary storage. [2025-09-29T02:01:38.474228] [INFO ] [MAIN ] GDL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:38.494410] [INFO ] [MAIN ] Update Progress: 907/2371 symbols completed. GDL took 0.5s. Estimated remaining: 6m 55s. Rate: 211.7 symbols/min [2025-09-29T02:01:38.547185] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-29T02:01:38.606890] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:38.635381] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-09-29T02:01:38.763233] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:38.821027] [DEBUG] [LOCAL ] GDO: Loaded 6076 existing records from primary storage. [2025-09-29T02:01:38.844494] [INFO ] [MAIN ] GDO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:38.874803] [INFO ] [MAIN ] Update Progress: 908/2371 symbols completed. GDO took 0.6s. Estimated remaining: 6m 55s. Rate: 211.7 symbols/min [2025-09-29T02:01:38.874430] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:39.029740] [DEBUG] [LOCAL ] GDV: Loaded 19971 existing records from primary storage. [2025-09-29T02:01:39.050992] [INFO ] [MAIN ] GDV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:39.081894] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-29T02:01:39.121557] [INFO ] [MAIN ] Update Progress: 909/2371 symbols completed. GDV took 0.6s. Estimated remaining: 6m 54s. Rate: 211.7 symbols/min [2025-09-29T02:01:39.121290] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:39.122906] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-09-29T02:01:39.126288] [DEBUG] [LOCAL ] GDOT: Loaded 39279 existing records from primary storage. [2025-09-29T02:01:39.133014] [INFO ] [MAIN ] GDOT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:39.150155] [INFO ] [MAIN ] Update Progress: 910/2371 symbols completed. GDOT took 0.8s. Estimated remaining: 6m 54s. Rate: 211.9 symbols/min [2025-09-29T02:01:39.284981] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.16 seconds). [2025-09-29T02:01:39.304057] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-09-29T02:01:39.562054] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-09-29T02:01:39.570860] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-09-29T02:01:39.568091] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:39.536237] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:39.595505] [DEBUG] [LOCAL ] GE: Loaded 54493 existing records from primary storage. [2025-09-29T02:01:39.596604] [INFO ] [MAIN ] GE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:39.597287] [INFO ] [MAIN ] Update Progress: 911/2371 symbols completed. GE took 0.7s. Estimated remaining: 6m 54s. Rate: 211.8 symbols/min [2025-09-29T02:01:39.786245] [DEBUG] [LOCAL ] GEF: Loaded 20965 existing records from primary storage. [2025-09-29T02:01:39.827818] [INFO ] [MAIN ] GEF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:39.855510] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:39.855927] [INFO ] [MAIN ] Update Progress: 912/2371 symbols completed. GEF took 0.7s. Estimated remaining: 6m 53s. Rate: 211.8 symbols/min [2025-09-29T02:01:39.857614] [DEBUG] [LOCAL ] GEL: Loaded 34252 existing records from primary storage. [2025-09-29T02:01:39.917762] [INFO ] [MAIN ] GEL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:39.931787] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-29T02:01:39.953626] [INFO ] [MAIN ] Update Progress: 913/2371 symbols completed. GEL took 0.8s. Estimated remaining: 6m 53s. Rate: 211.9 symbols/min [2025-09-29T02:01:39.980314] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-09-29T02:01:40.222181] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:40.307598] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-29T02:01:40.308551] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:40.309990] [INFO ] [REMOTE ] GBLI: Full fetch complete (1330 records). [2025-09-29T02:01:40.311743] [DEBUG] [LOCAL ] GENI: Loaded 53679 existing records from primary storage. [2025-09-29T02:01:40.312318] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-09-29T02:01:40.318117] [INFO ] [MAIN ] GENI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:40.338421] [INFO ] [MAIN ] Update Progress: 914/2371 symbols completed. GENI took 0.7s. Estimated remaining: 6m 53s. Rate: 211.9 symbols/min [2025-09-29T02:01:40.661814] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 173 unique days, need 200 days [2025-09-29T02:01:40.691713] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:01:40.705276] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:01:40.716034] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-09-29T02:01:40.743133] [DEBUG] [LOCAL ] GES: Loaded 40424 existing records from primary storage. [2025-09-29T02:01:40.770959] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-09-29T02:01:40.791480] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:40.791898] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-09-29T02:01:40.792101] [INFO ] [MAIN ] GES: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:40.793385] [DEBUG] [LOCAL ] GEO: Loaded 52812 existing records from primary storage. [2025-09-29T02:01:40.793621] [INFO ] [MAIN ] Update Progress: 915/2371 symbols completed. GES took 0.8s. Estimated remaining: 6m 53s. Rate: 211.7 symbols/min [2025-09-29T02:01:40.794104] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-09-29T02:01:40.799964] [INFO ] [MAIN ] Update Progress: 916/2371 symbols completed. GBLI took 5.5s. Estimated remaining: 6m 52s. Rate: 211.9 symbols/min [2025-09-29T02:01:40.811183] [INFO ] [MAIN ] GEO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:40.936354] [INFO ] [MAIN ] Update Progress: 917/2371 symbols completed. GEO took 1.1s. Estimated remaining: 6m 51s. Rate: 212.1 symbols/min [2025-09-29T02:01:41.204710] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:41.209158] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:41.210745] [DEBUG] [LOCAL ] GETY: Loaded 36378 existing records from primary storage. [2025-09-29T02:01:41.211554] [INFO ] [MAIN ] GETY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:41.211777] [INFO ] [MAIN ] Update Progress: 918/2371 symbols completed. GETY took 0.8s. Estimated remaining: 6m 51s. Rate: 212.1 symbols/min [2025-09-29T02:01:41.218002] [DEBUG] [LOCAL ] GF: Loaded 3220 existing records from primary storage. [2025-09-29T02:01:41.218353] [INFO ] [MAIN ] GF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:41.218458] [INFO ] [MAIN ] Update Progress: 919/2371 symbols completed. GF took 0.4s. Estimated remaining: 6m 50s. Rate: 212.3 symbols/min [2025-09-29T02:01:41.278020] [DEBUG] [LOCAL ] GEV: Loaded 53878 existing records from primary storage. [2025-09-29T02:01:41.278411] [INFO ] [MAIN ] GEV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:41.278910] [INFO ] [MAIN ] Update Progress: 920/2371 symbols completed. GEV took 0.5s. Estimated remaining: 6m 50s. Rate: 212.5 symbols/min [2025-09-29T02:01:41.890575] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:41.975137] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:42.091679] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:42.090535] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:42.129960] [DEBUG] [LOCAL ] GFR: Loaded 8572 existing records from primary storage. [2025-09-29T02:01:42.130850] [INFO ] [MAIN ] GFR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:42.131006] [INFO ] [MAIN ] Update Progress: 921/2371 symbols completed. GFR took 0.8s. Estimated remaining: 6m 50s. Rate: 212.0 symbols/min [2025-09-29T02:01:42.221924] [DEBUG] [LOCAL ] GFF: Loaded 31088 existing records from primary storage. [2025-09-29T02:01:42.312908] [INFO ] [MAIN ] GFF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:42.339616] [INFO ] [MAIN ] Update Progress: 922/2371 symbols completed. GFF took 1.1s. Estimated remaining: 6m 50s. Rate: 212.1 symbols/min [2025-09-29T02:01:42.355101] [DEBUG] [LOCAL ] GFI: Loaded 53887 existing records from primary storage. [2025-09-29T02:01:42.410335] [INFO ] [MAIN ] GFI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:42.441459] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:42.441933] [INFO ] [MAIN ] Update Progress: 923/2371 symbols completed. GFI took 1.2s. Estimated remaining: 6m 49s. Rate: 212.2 symbols/min [2025-09-29T02:01:42.455474] [DEBUG] [LOCAL ] GFL: Loaded 48755 existing records from primary storage. [2025-09-29T02:01:42.496961] [INFO ] [MAIN ] GFL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:42.509214] [INFO ] [MAIN ] Update Progress: 924/2371 symbols completed. GFL took 1.2s. Estimated remaining: 6m 49s. Rate: 212.4 symbols/min [2025-09-29T02:01:42.997311] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:43.052807] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:43.085143] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:43.110908] [DEBUG] [LOCAL ] GGZ: Loaded 2465 existing records from primary storage. [2025-09-29T02:01:43.113353] [INFO ] [MAIN ] GGZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:43.113501] [INFO ] [MAIN ] Update Progress: 925/2371 symbols completed. GGZ took 0.6s. Estimated remaining: 6m 49s. Rate: 212.1 symbols/min [2025-09-29T02:01:43.112548] [DEBUG] [LOCAL ] GGB: Loaded 51813 existing records from primary storage. [2025-09-29T02:01:43.135321] [INFO ] [MAIN ] GGB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:43.178044] [INFO ] [MAIN ] Update Progress: 926/2371 symbols completed. GGB took 1.0s. Estimated remaining: 6m 48s. Rate: 212.3 symbols/min [2025-09-29T02:01:43.205784] [DEBUG] [LOCAL ] GGT: Loaded 14309 existing records from primary storage. [2025-09-29T02:01:43.266597] [INFO ] [MAIN ] GGT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:43.331845] [INFO ] [MAIN ] Update Progress: 927/2371 symbols completed. GGT took 0.8s. Estimated remaining: 6m 48s. Rate: 212.4 symbols/min [2025-09-29T02:01:43.487387] [DEBUG] [LOCAL ] GGG: Loaded 41580 existing records from primary storage. [2025-09-29T02:01:43.539244] [INFO ] [MAIN ] GGG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:43.582495] [INFO ] [MAIN ] Update Progress: 928/2371 symbols completed. GGG took 1.2s. Estimated remaining: 6m 48s. Rate: 212.4 symbols/min [2025-09-29T02:01:43.573588] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:43.744462] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:43.811198] [DEBUG] [LOCAL ] GHC: Loaded 2664 existing records from primary storage. [2025-09-29T02:01:43.893256] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:43.893775] [INFO ] [MAIN ] GHC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:43.896405] [INFO ] [MAIN ] Update Progress: 929/2371 symbols completed. GHC took 0.8s. Estimated remaining: 6m 47s. Rate: 212.4 symbols/min [2025-09-29T02:01:43.913948] [DEBUG] [LOCAL ] GHG: Loaded 3226 existing records from primary storage. [2025-09-29T02:01:43.963692] [INFO ] [MAIN ] GHG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:43.974425] [INFO ] [MAIN ] Update Progress: 930/2371 symbols completed. GHG took 0.8s. Estimated remaining: 6m 47s. Rate: 212.6 symbols/min [2025-09-29T02:01:44.133851] [DEBUG] [LOCAL ] GHI: Loaded 6963 existing records from primary storage. [2025-09-29T02:01:44.207171] [INFO ] [MAIN ] GHI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:44.277531] [INFO ] [MAIN ] Update Progress: 931/2371 symbols completed. GHI took 0.9s. Estimated remaining: 6m 46s. Rate: 212.6 symbols/min [2025-09-29T02:01:44.324699] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:44.440032] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:44.582065] [DEBUG] [LOCAL ] GHLD: Loaded 4168 existing records from primary storage. [2025-09-29T02:01:44.598639] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:44.613962] [INFO ] [MAIN ] GHLD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:44.647825] [INFO ] [MAIN ] Update Progress: 932/2371 symbols completed. GHLD took 1.0s. Estimated remaining: 6m 46s. Rate: 212.5 symbols/min [2025-09-29T02:01:44.673005] [DEBUG] [LOCAL ] GHM: Loaded 14350 existing records from primary storage. [2025-09-29T02:01:44.733624] [INFO ] [MAIN ] GHM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:44.806879] [INFO ] [MAIN ] Update Progress: 933/2371 symbols completed. GHM took 0.9s. Estimated remaining: 6m 46s. Rate: 212.6 symbols/min [2025-09-29T02:01:44.928578] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:44.929516] [DEBUG] [LOCAL ] GHY: Loaded 21190 existing records from primary storage. [2025-09-29T02:01:45.003202] [INFO ] [MAIN ] GHY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:45.029880] [INFO ] [MAIN ] Update Progress: 934/2371 symbols completed. GHY took 1.0s. Estimated remaining: 6m 45s. Rate: 212.6 symbols/min [2025-09-29T02:01:45.116179] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:45.331118] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:45.363078] [DEBUG] [LOCAL ] GIB: Loaded 32653 existing records from primary storage. [2025-09-29T02:01:45.401423] [INFO ] [MAIN ] GIB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:45.419272] [DEBUG] [LOCAL ] GIC: Loaded 13796 existing records from primary storage. [2025-09-29T02:01:45.440446] [INFO ] [MAIN ] Update Progress: 935/2371 symbols completed. GIB took 1.1s. Estimated remaining: 6m 45s. Rate: 212.5 symbols/min [2025-09-29T02:01:45.440085] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:45.440797] [INFO ] [MAIN ] GIC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:45.463689] [INFO ] [MAIN ] Update Progress: 936/2371 symbols completed. GIC took 0.8s. Estimated remaining: 6m 45s. Rate: 212.7 symbols/min [2025-09-29T02:01:45.887239] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:45.890692] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:45.908600] [DEBUG] [LOCAL ] GIL: Loaded 43906 existing records from primary storage. [2025-09-29T02:01:45.909856] [INFO ] [MAIN ] GIL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:45.910907] [INFO ] [MAIN ] Update Progress: 937/2371 symbols completed. GIL took 1.1s. Estimated remaining: 6m 45s. Rate: 212.6 symbols/min [2025-09-29T02:01:45.912040] [DEBUG] [LOCAL ] GIS: Loaded 54455 existing records from primary storage. [2025-09-29T02:01:45.934463] [INFO ] [MAIN ] GIS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:45.961745] [INFO ] [MAIN ] Update Progress: 938/2371 symbols completed. GIS took 0.9s. Estimated remaining: 6m 44s. Rate: 212.8 symbols/min [2025-09-29T02:01:46.345977] [DEBUG] [LOCAL ] GKOS: Loaded 43585 existing records from primary storage. [2025-09-29T02:01:46.313763] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:46.395939] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:46.393767] [INFO ] [MAIN ] GKOS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:46.397191] [INFO ] [MAIN ] Update Progress: 939/2371 symbols completed. GKOS took 1.0s. Estimated remaining: 6m 44s. Rate: 212.7 symbols/min [2025-09-29T02:01:46.399198] [DEBUG] [LOCAL ] GL: Loaded 38382 existing records from primary storage. [2025-09-29T02:01:46.412396] [INFO ] [MAIN ] GL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:46.468122] [INFO ] [MAIN ] Update Progress: 940/2371 symbols completed. GL took 1.0s. Estimated remaining: 6m 43s. Rate: 212.8 symbols/min [2025-09-29T02:01:46.601794] [DEBUG] [LOCAL ] GLP: Loaded 9585 existing records from primary storage. [2025-09-29T02:01:46.607775] [INFO ] [MAIN ] GLP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:46.613115] [INFO ] [MAIN ] Update Progress: 941/2371 symbols completed. GLP took 0.7s. Estimated remaining: 6m 43s. Rate: 213.0 symbols/min [2025-09-29T02:01:46.797794] [DEBUG] [LOCAL ] GLOB: Loaded 48111 existing records from primary storage. [2025-09-29T02:01:46.859337] [INFO ] [MAIN ] GLOB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:46.843224] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:46.876413] [INFO ] [MAIN ] Update Progress: 942/2371 symbols completed. GLOB took 1.0s. Estimated remaining: 6m 43s. Rate: 213.0 symbols/min [2025-09-29T02:01:47.081888] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:47.238900] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:47.345692] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:47.370445] [DEBUG] [LOCAL ] GLW: Loaded 54415 existing records from primary storage. [2025-09-29T02:01:47.371702] [INFO ] [MAIN ] GLW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:47.372453] [INFO ] [MAIN ] Update Progress: 943/2371 symbols completed. GLW took 1.0s. Estimated remaining: 6m 43s. Rate: 212.8 symbols/min [2025-09-29T02:01:47.613112] [DEBUG] [LOCAL ] GM: Loaded 54508 existing records from primary storage. [2025-09-29T02:01:47.658957] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:47.661847] [INFO ] [MAIN ] GM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:47.662813] [INFO ] [MAIN ] Update Progress: 944/2371 symbols completed. GM took 1.2s. Estimated remaining: 6m 42s. Rate: 212.8 symbols/min [2025-09-29T02:01:47.761191] [DEBUG] [LOCAL ] GME: Loaded 54540 existing records from primary storage. [2025-09-29T02:01:47.804324] [INFO ] [MAIN ] GME: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:47.818028] [DEBUG] [LOCAL ] GMED: Loaded 49096 existing records from primary storage. [2025-09-29T02:01:47.824212] [INFO ] [MAIN ] Update Progress: 945/2371 symbols completed. GME took 1.2s. Estimated remaining: 6m 42s. Rate: 212.9 symbols/min [2025-09-29T02:01:47.847952] [INFO ] [MAIN ] GMED: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:47.850187] [INFO ] [MAIN ] Update Progress: 946/2371 symbols completed. GMED took 0.9s. Estimated remaining: 6m 41s. Rate: 213.1 symbols/min [2025-09-29T02:01:48.127806] [DEBUG] [LOCAL ] GMRE: Loaded 38133 existing records from primary storage. [2025-09-29T02:01:48.137856] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:48.171552] [INFO ] [MAIN ] GMRE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:48.177212] [INFO ] [MAIN ] Update Progress: 947/2371 symbols completed. GMRE took 0.8s. Estimated remaining: 6m 41s. Rate: 213.1 symbols/min [2025-09-29T02:01:48.392769] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:48.470326] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:48.500044] [DEBUG] [LOCAL ] GNE: Loaded 17940 existing records from primary storage. [2025-09-29T02:01:48.532883] [INFO ] [MAIN ] GNE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:48.580753] [INFO ] [MAIN ] Update Progress: 948/2371 symbols completed. GNE took 0.9s. Estimated remaining: 6m 41s. Rate: 213.0 symbols/min [2025-09-29T02:01:48.585707] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:48.839955] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:48.842280] [DEBUG] [LOCAL ] GNK: Loaded 41039 existing records from primary storage. [2025-09-29T02:01:48.857069] [INFO ] [MAIN ] GNK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:48.857761] [INFO ] [MAIN ] Update Progress: 949/2371 symbols completed. GNK took 1.0s. Estimated remaining: 6m 41s. Rate: 213.0 symbols/min [2025-09-29T02:01:48.913102] [DEBUG] [LOCAL ] GNL: Loaded 47785 existing records from primary storage. [2025-09-29T02:01:48.966431] [INFO ] [MAIN ] GNL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:49.003246] [INFO ] [MAIN ] Update Progress: 950/2371 symbols completed. GNL took 1.1s. Estimated remaining: 6m 40s. Rate: 213.1 symbols/min [2025-09-29T02:01:49.002500] [DEBUG] [LOCAL ] GNRC: Loaded 45886 existing records from primary storage. [2025-09-29T02:01:49.003970] [DEBUG] [LOCAL ] GNT: Loaded 8177 existing records from primary storage. [2025-09-29T02:01:49.040329] [INFO ] [MAIN ] GNRC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:49.083081] [INFO ] [MAIN ] Update Progress: 951/2371 symbols completed. GNRC took 0.9s. Estimated remaining: 6m 40s. Rate: 213.2 symbols/min [2025-09-29T02:01:49.040554] [INFO ] [MAIN ] GNT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:49.129174] [INFO ] [MAIN ] Update Progress: 952/2371 symbols completed. GNT took 0.5s. Estimated remaining: 6m 39s. Rate: 213.4 symbols/min [2025-09-29T02:01:49.193262] [INFO ] [MAIN ] GNTY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:49.536637] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:49.559556] [DEBUG] [LOCAL ] GNTY: Loaded 7353 existing records from primary storage. [2025-09-29T02:01:49.596494] [INFO ] [MAIN ] GNTY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:49.625520] [INFO ] [MAIN ] Update Progress: 953/2371 symbols completed. GNTY took 0.8s. Estimated remaining: 6m 39s. Rate: 213.2 symbols/min [2025-09-29T02:01:49.722393] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:49.742818] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:49.941210] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:49.956697] [DEBUG] [LOCAL ] GOLF: Loaded 32049 existing records from primary storage. [2025-09-29T02:01:49.972427] [INFO ] [MAIN ] GOLF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:49.975336] [DEBUG] [LOCAL ] GNW: Loaded 52086 existing records from primary storage. [2025-09-29T02:01:49.986548] [INFO ] [MAIN ] Update Progress: 954/2371 symbols completed. GOLF took 0.8s. Estimated remaining: 6m 39s. Rate: 213.2 symbols/min [2025-09-29T02:01:49.987131] [INFO ] [MAIN ] GNW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:49.993133] [INFO ] [MAIN ] Update Progress: 955/2371 symbols completed. GNW took 1.0s. Estimated remaining: 6m 38s. Rate: 213.4 symbols/min [2025-09-29T02:01:50.273503] [DEBUG] [LOCAL ] GOF: Loaded 43374 existing records from primary storage. [2025-09-29T02:01:50.358388] [INFO ] [MAIN ] GOF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:50.357415] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:50.370204] [DEBUG] [LOCAL ] GOOS: Loaded 46008 existing records from primary storage. [2025-09-29T02:01:50.381218] [INFO ] [MAIN ] Update Progress: 956/2371 symbols completed. GOF took 1.3s. Estimated remaining: 6m 38s. Rate: 213.3 symbols/min [2025-09-29T02:01:50.406176] [INFO ] [MAIN ] GOOS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:50.431298] [INFO ] [MAIN ] Update Progress: 957/2371 symbols completed. GOOS took 0.7s. Estimated remaining: 6m 37s. Rate: 213.5 symbols/min [2025-09-29T02:01:50.478195] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:50.665711] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:50.686798] [DEBUG] [LOCAL ] GOTU: Loaded 39533 existing records from primary storage. [2025-09-29T02:01:50.687607] [INFO ] [MAIN ] GOTU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:50.688397] [INFO ] [MAIN ] Update Progress: 958/2371 symbols completed. GOTU took 0.7s. Estimated remaining: 6m 37s. Rate: 213.5 symbols/min [2025-09-29T02:01:50.715981] [DEBUG] [LOCAL ] GPI: Loaded 15126 existing records from primary storage. [2025-09-29T02:01:50.716466] [INFO ] [MAIN ] GPI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:50.716575] [INFO ] [MAIN ] Update Progress: 959/2371 symbols completed. GPI took 0.3s. Estimated remaining: 6m 36s. Rate: 213.7 symbols/min [2025-09-29T02:01:50.741571] [DEBUG] [LOCAL ] GPC: Loaded 47289 existing records from primary storage. [2025-09-29T02:01:50.742139] [INFO ] [MAIN ] GPC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:50.742735] [INFO ] [MAIN ] Update Progress: 960/2371 symbols completed. GPC took 0.7s. Estimated remaining: 6m 36s. Rate: 213.9 symbols/min [2025-09-29T02:01:51.365750] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:51.504308] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:51.553165] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:51.578804] [DEBUG] [LOCAL ] GPJA: Loaded 4140 existing records from primary storage. [2025-09-29T02:01:51.575561] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:51.579378] [INFO ] [MAIN ] GPJA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:51.579849] [INFO ] [MAIN ] Update Progress: 961/2371 symbols completed. GPJA took 0.8s. Estimated remaining: 6m 36s. Rate: 213.5 symbols/min [2025-09-29T02:01:51.802375] [DEBUG] [LOCAL ] GPMT: Loaded 26788 existing records from primary storage. [2025-09-29T02:01:51.851594] [INFO ] [MAIN ] GPMT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:51.851118] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:51.867581] [INFO ] [MAIN ] Update Progress: 962/2371 symbols completed. GPMT took 1.1s. Estimated remaining: 6m 36s. Rate: 213.5 symbols/min [2025-09-29T02:01:51.881374] [DEBUG] [LOCAL ] GPK: Loaded 53441 existing records from primary storage. [2025-09-29T02:01:51.897052] [INFO ] [MAIN ] GPK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:51.941700] [INFO ] [MAIN ] Update Progress: 963/2371 symbols completed. GPK took 1.2s. Estimated remaining: 6m 35s. Rate: 213.6 symbols/min [2025-09-29T02:01:51.974093] [DEBUG] [LOCAL ] GPN: Loaded 52822 existing records from primary storage. [2025-09-29T02:01:52.044285] [INFO ] [MAIN ] GPN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:52.098829] [INFO ] [MAIN ] Update Progress: 964/2371 symbols completed. GPN took 1.3s. Estimated remaining: 6m 35s. Rate: 213.7 symbols/min [2025-09-29T02:01:52.113273] [DEBUG] [LOCAL ] GPOR: Loaded 23328 existing records from primary storage. [2025-09-29T02:01:52.160541] [INFO ] [MAIN ] GPOR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:52.204789] [INFO ] [MAIN ] Update Progress: 965/2371 symbols completed. GPOR took 0.6s. Estimated remaining: 6m 34s. Rate: 213.9 symbols/min [2025-09-29T02:01:52.235952] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:52.436344] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:52.623989] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:52.726727] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:52.742402] [DEBUG] [LOCAL ] GRBK: Loaded 27375 existing records from primary storage. [2025-09-29T02:01:52.758795] [INFO ] [MAIN ] GRBK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:52.764773] [DEBUG] [LOCAL ] GRC: Loaded 9061 existing records from primary storage. [2025-09-29T02:01:52.766283] [DEBUG] [LOCAL ] GPRK: Loaded 39841 existing records from primary storage. [2025-09-29T02:01:52.764917] [INFO ] [MAIN ] Update Progress: 966/2371 symbols completed. GRBK took 0.8s. Estimated remaining: 6m 35s. Rate: 213.7 symbols/min [2025-09-29T02:01:52.766928] [INFO ] [MAIN ] GRC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:52.772474] [INFO ] [MAIN ] Update Progress: 967/2371 symbols completed. GRC took 0.6s. Estimated remaining: 6m 34s. Rate: 213.9 symbols/min [2025-09-29T02:01:52.767091] [INFO ] [MAIN ] GPRK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:52.811754] [INFO ] [MAIN ] Update Progress: 968/2371 symbols completed. GPRK took 0.9s. Estimated remaining: 6m 33s. Rate: 214.1 symbols/min [2025-09-29T02:01:52.923779] [DEBUG] [LOCAL ] GRDN: Loaded 20178 existing records from primary storage. [2025-09-29T02:01:52.972805] [INFO ] [MAIN ] GRDN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:53.012480] [INFO ] [MAIN ] Update Progress: 969/2371 symbols completed. GRDN took 0.7s. Estimated remaining: 6m 33s. Rate: 214.1 symbols/min [2025-09-29T02:01:53.402315] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:53.408582] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:53.553320] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:53.607956] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:53.624396] [DEBUG] [LOCAL ] GROV: Loaded 9240 existing records from primary storage. [2025-09-29T02:01:53.624977] [INFO ] [MAIN ] GROV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:53.625236] [INFO ] [MAIN ] Update Progress: 970/2371 symbols completed. GROV took 0.5s. Estimated remaining: 6m 33s. Rate: 213.9 symbols/min [2025-09-29T02:01:53.789501] [DEBUG] [LOCAL ] GRND: Loaded 50744 existing records from primary storage. [2025-09-29T02:01:53.807708] [INFO ] [MAIN ] GRND: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:53.831168] [INFO ] [MAIN ] Update Progress: 971/2371 symbols completed. GRND took 1.0s. Estimated remaining: 6m 33s. Rate: 213.9 symbols/min [2025-09-29T02:01:53.874308] [DEBUG] [LOCAL ] GRMN: Loaded 41798 existing records from primary storage. [2025-09-29T02:01:53.924592] [DEBUG] [LOCAL ] GRNT: Loaded 34235 existing records from primary storage. [2025-09-29T02:01:53.960954] [INFO ] [MAIN ] GRMN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:53.964549] [INFO ] [MAIN ] GRNT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:53.965613] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:53.980982] [INFO ] [MAIN ] Update Progress: 972/2371 symbols completed. GRMN took 1.2s. Estimated remaining: 6m 32s. Rate: 214.0 symbols/min [2025-09-29T02:01:54.004542] [INFO ] [MAIN ] Update Progress: 973/2371 symbols completed. GRNT took 1.1s. Estimated remaining: 6m 32s. Rate: 214.2 symbols/min [2025-09-29T02:01:54.222178] [DEBUG] [LOCAL ] GRX: Loaded 4547 existing records from primary storage. [2025-09-29T02:01:54.306698] [INFO ] [MAIN ] GRX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:54.349184] [INFO ] [MAIN ] Update Progress: 974/2371 symbols completed. GRX took 0.7s. Estimated remaining: 6m 31s. Rate: 214.2 symbols/min [2025-09-29T02:01:54.438931] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:54.561002] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:54.537226] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:54.744749] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:54.812746] [DEBUG] [LOCAL ] GSBD: Loaded 39756 existing records from primary storage. [2025-09-29T02:01:54.813591] [INFO ] [MAIN ] GSBD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:54.813758] [INFO ] [MAIN ] Update Progress: 975/2371 symbols completed. GSBD took 0.8s. Estimated remaining: 6m 31s. Rate: 214.0 symbols/min [2025-09-29T02:01:54.994046] [DEBUG] [LOCAL ] GS: Loaded 52736 existing records from primary storage. [2025-09-29T02:01:54.996776] [INFO ] [MAIN ] GS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:54.997535] [INFO ] [MAIN ] Update Progress: 976/2371 symbols completed. GS took 1.1s. Estimated remaining: 6m 31s. Rate: 214.1 symbols/min [2025-09-29T02:01:55.004276] [DEBUG] [LOCAL ] GSL: Loaded 33824 existing records from primary storage. [2025-09-29T02:01:54.996294] [DEBUG] [LOCAL ] GSK: Loaded 54272 existing records from primary storage. [2025-09-29T02:01:55.030301] [INFO ] [MAIN ] GSL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:55.101412] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:55.042166] [INFO ] [MAIN ] GSK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:55.069717] [INFO ] [MAIN ] Update Progress: 977/2371 symbols completed. GSL took 0.5s. Estimated remaining: 6m 30s. Rate: 214.3 symbols/min [2025-09-29T02:01:55.124068] [INFO ] [MAIN ] Update Progress: 978/2371 symbols completed. GSK took 1.1s. Estimated remaining: 6m 30s. Rate: 214.4 symbols/min [2025-09-29T02:01:55.565768] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:55.681719] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:55.689001] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:55.711412] [DEBUG] [LOCAL ] GTES: Loaded 51399 existing records from primary storage. [2025-09-29T02:01:55.712452] [INFO ] [MAIN ] GTES: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:55.713242] [INFO ] [MAIN ] Update Progress: 979/2371 symbols completed. GTES took 0.9s. Estimated remaining: 6m 30s. Rate: 214.2 symbols/min [2025-09-29T02:01:55.969627] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:55.992045] [DEBUG] [LOCAL ] GTN: Loaded 46301 existing records from primary storage. [2025-09-29T02:01:55.993250] [DEBUG] [LOCAL ] GTY: Loaded 30796 existing records from primary storage. [2025-09-29T02:01:55.993932] [INFO ] [MAIN ] GTN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:55.994822] [INFO ] [MAIN ] Update Progress: 980/2371 symbols completed. GTN took 0.9s. Estimated remaining: 6m 30s. Rate: 214.2 symbols/min [2025-09-29T02:01:55.995729] [DEBUG] [LOCAL ] GTLS: Loaded 43461 existing records from primary storage. [2025-09-29T02:01:55.994322] [INFO ] [MAIN ] GTY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:56.019488] [INFO ] [MAIN ] GTLS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:56.013557] [INFO ] [MAIN ] Update Progress: 981/2371 symbols completed. GTY took 0.8s. Estimated remaining: 6m 29s. Rate: 214.4 symbols/min [2025-09-29T02:01:56.034915] [INFO ] [MAIN ] Update Progress: 982/2371 symbols completed. GTLS took 1.0s. Estimated remaining: 6m 28s. Rate: 214.6 symbols/min [2025-09-29T02:01:56.254171] [DEBUG] [LOCAL ] GUG: Loaded 12138 existing records from primary storage. [2025-09-29T02:01:56.340115] [INFO ] [MAIN ] GUG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:56.367111] [INFO ] [MAIN ] Update Progress: 983/2371 symbols completed. GUG took 0.7s. Estimated remaining: 6m 28s. Rate: 214.6 symbols/min [2025-09-29T02:01:56.566030] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:56.542067] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:56.663682] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:56.822278] [DEBUG] [LOCAL ] GWH: Loaded 15825 existing records from primary storage. [2025-09-29T02:01:56.824111] [DEBUG] [LOCAL ] GUT: Loaded 15560 existing records from primary storage. [2025-09-29T02:01:56.825749] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:56.825973] [INFO ] [MAIN ] GUT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:56.824552] [INFO ] [MAIN ] GWH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:56.826388] [INFO ] [MAIN ] Update Progress: 984/2371 symbols completed. GUT took 0.8s. Estimated remaining: 6m 28s. Rate: 214.4 symbols/min [2025-09-29T02:01:56.827284] [INFO ] [MAIN ] Update Progress: 985/2371 symbols completed. GWH took 0.8s. Estimated remaining: 6m 27s. Rate: 214.6 symbols/min [2025-09-29T02:01:57.079443] [DEBUG] [LOCAL ] GVA: Loaded 34030 existing records from primary storage. [2025-09-29T02:01:57.084538] [INFO ] [MAIN ] GVA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:57.085115] [INFO ] [MAIN ] Update Progress: 986/2371 symbols completed. GVA took 1.1s. Estimated remaining: 6m 27s. Rate: 214.7 symbols/min [2025-09-29T02:01:57.338270] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:57.344987] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:57.385499] [DEBUG] [LOCAL ] GWRE: Loaded 41564 existing records from primary storage. [2025-09-29T02:01:57.407905] [INFO ] [MAIN ] GWRE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:57.469231] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:57.469470] [INFO ] [MAIN ] Update Progress: 987/2371 symbols completed. GWRE took 1.1s. Estimated remaining: 6m 27s. Rate: 214.6 symbols/min [2025-09-29T02:01:57.564912] [DEBUG] [LOCAL ] GYLD: Loaded 1569 existing records from primary storage. [2025-09-29T02:01:57.589126] [DEBUG] [LOCAL ] GWW: Loaded 20108 existing records from primary storage. [2025-09-29T02:01:57.588100] [INFO ] [MAIN ] GYLD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:57.632764] [INFO ] [MAIN ] Update Progress: 988/2371 symbols completed. GYLD took 0.5s. Estimated remaining: 6m 27s. Rate: 214.7 symbols/min [2025-09-29T02:01:57.637230] [INFO ] [MAIN ] GWW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:57.693056] [INFO ] [MAIN ] Update Progress: 989/2371 symbols completed. GWW took 0.9s. Estimated remaining: 6m 26s. Rate: 214.8 symbols/min [2025-09-29T02:01:57.763006] [DEBUG] [LOCAL ] GXO: Loaded 48260 existing records from primary storage. [2025-09-29T02:01:57.799208] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:57.807759] [INFO ] [MAIN ] GXO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:57.868437] [INFO ] [MAIN ] Update Progress: 990/2371 symbols completed. GXO took 1.0s. Estimated remaining: 6m 26s. Rate: 214.9 symbols/min [2025-09-29T02:01:58.242341] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:58.266426] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:58.363749] [DEBUG] [LOCAL ] H: Loaded 45492 existing records from primary storage. [2025-09-29T02:01:58.368220] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:58.368902] [INFO ] [MAIN ] H: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:58.374134] [INFO ] [MAIN ] Update Progress: 991/2371 symbols completed. H took 0.9s. Estimated remaining: 6m 26s. Rate: 214.7 symbols/min [2025-09-29T02:01:58.550934] [DEBUG] [LOCAL ] HAE: Loaded 40176 existing records from primary storage. [2025-09-29T02:01:58.605841] [INFO ] [MAIN ] HAE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:58.633207] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:58.649937] [DEBUG] [LOCAL ] HAFN: Loaded 44189 existing records from primary storage. [2025-09-29T02:01:58.650119] [INFO ] [MAIN ] Update Progress: 992/2371 symbols completed. HAE took 1.0s. Estimated remaining: 6m 25s. Rate: 214.7 symbols/min [2025-09-29T02:01:58.651514] [INFO ] [MAIN ] HAFN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:58.689192] [INFO ] [MAIN ] Update Progress: 993/2371 symbols completed. HAFN took 0.9s. Estimated remaining: 6m 25s. Rate: 214.9 symbols/min [2025-09-29T02:01:58.801791] [DEBUG] [LOCAL ] HAL: Loaded 54498 existing records from primary storage. [2025-09-29T02:01:58.872819] [INFO ] [MAIN ] HAL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:58.905473] [INFO ] [MAIN ] Update Progress: 994/2371 symbols completed. HAL took 1.0s. Estimated remaining: 6m 24s. Rate: 215.0 symbols/min [2025-09-29T02:01:59.093184] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:59.219025] [DEBUG] [LOCAL ] HASI: Loaded 47868 existing records from primary storage. [2025-09-29T02:01:59.217371] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:59.225193] [INFO ] [MAIN ] HASI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:59.232139] [INFO ] [MAIN ] Update Progress: 995/2371 symbols completed. HASI took 0.9s. Estimated remaining: 6m 24s. Rate: 214.9 symbols/min [2025-09-29T02:01:59.327857] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:59.370352] [DEBUG] [LOCAL ] HBB: Loaded 6912 existing records from primary storage. [2025-09-29T02:01:59.397573] [INFO ] [MAIN ] HBB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:59.435391] [INFO ] [MAIN ] Update Progress: 996/2371 symbols completed. HBB took 0.7s. Estimated remaining: 6m 24s. Rate: 215.0 symbols/min [2025-09-29T02:01:59.656393] [DEBUG] [LOCAL ] HAYW: Loaded 49444 existing records from primary storage. [2025-09-29T02:01:59.625599] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:59.680093] [INFO ] [MAIN ] HAYW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:59.687437] [INFO ] [MAIN ] Update Progress: 997/2371 symbols completed. HAYW took 1.0s. Estimated remaining: 6m 23s. Rate: 215.0 symbols/min [2025-09-29T02:01:59.774622] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:01:59.776243] [DEBUG] [LOCAL ] HBI: Loaded 53769 existing records from primary storage. [2025-09-29T02:01:59.776765] [INFO ] [MAIN ] HBI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:59.777266] [INFO ] [MAIN ] Update Progress: 998/2371 symbols completed. HBI took 0.8s. Estimated remaining: 6m 23s. Rate: 215.2 symbols/min [2025-09-29T02:01:59.851261] [DEBUG] [LOCAL ] HBM: Loaded 53683 existing records from primary storage. [2025-09-29T02:01:59.853048] [INFO ] [MAIN ] HBM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:59.853811] [DEBUG] [LOCAL ] HCA: Loaded 47781 existing records from primary storage. [2025-09-29T02:01:59.854263] [INFO ] [MAIN ] Update Progress: 999/2371 symbols completed. HBM took 0.6s. Estimated remaining: 6m 22s. Rate: 215.3 symbols/min [2025-09-29T02:01:59.854794] [INFO ] [MAIN ] HCA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:01:59.855234] [INFO ] [MAIN ] Update Progress: 1000/2371 symbols completed. HCA took 0.4s. Estimated remaining: 6m 22s. Rate: 215.5 symbols/min [2025-09-29T02:02:00.552483] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:00.545711] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:00.670749] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:00.639939] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:00.672565] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-09-29T02:02:00.673230] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-09-29T02:02:00.673501] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-09-29T02:02:00.673678] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-09-29T02:02:00.673858] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-09-29T02:02:00.673918] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-09-29T02:02:00.806595] [DEBUG] [LOCAL ] HCI: Loaded 14126 existing records from primary storage. [2025-09-29T02:02:00.841108] [INFO ] [MAIN ] HCI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:00.898395] [INFO ] [MAIN ] Update Progress: 1001/2371 symbols completed. HCI took 1.0s. Estimated remaining: 6m 22s. Rate: 214.9 symbols/min [2025-09-29T02:02:01.166175] [DEBUG] [LOCAL ] HCC: Loaded 46057 existing records from primary storage. [2025-09-29T02:02:01.182470] [DEBUG] [LOCAL ] HD: Loaded 54283 existing records from primary storage. [2025-09-29T02:02:01.238859] [INFO ] [MAIN ] HCC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:01.249421] [INFO ] [MAIN ] HD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:01.368920] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:02:01.293901] [INFO ] [MAIN ] Update Progress: 1002/2371 symbols completed. HCC took 1.4s. Estimated remaining: 6m 22s. Rate: 214.9 symbols/min [2025-09-29T02:02:01.371880] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2024-12. [2025-09-29T02:02:01.379055] [INFO ] [MAIN ] Update Progress: 1003/2371 symbols completed. HD took 1.5s. Estimated remaining: 6m 22s. Rate: 215.0 symbols/min [2025-09-29T02:02:01.381242] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:01.776261] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:01.769345] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-29T02:02:01.777574] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:01.794275] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-09-29T02:02:01.822113] [DEBUG] [LOCAL ] HDB: Loaded 52695 existing records from primary storage. [2025-09-29T02:02:01.822829] [INFO ] [MAIN ] HDB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:01.823180] [INFO ] [MAIN ] Update Progress: 1004/2371 symbols completed. HDB took 0.9s. Estimated remaining: 6m 22s. Rate: 214.9 symbols/min [2025-09-29T02:02:02.065437] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-09-29T02:02:02.061227] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:02.067247] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-09-29T02:02:02.070634] [DEBUG] [LOCAL ] HEI: Loaded 32846 existing records from primary storage. [2025-09-29T02:02:02.071370] [INFO ] [MAIN ] HEI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:02.073158] [INFO ] [MAIN ] Update Progress: 1005/2371 symbols completed. HEI took 0.7s. Estimated remaining: 6m 21s. Rate: 214.9 symbols/min [2025-09-29T02:02:02.130794] [DEBUG] [LOCAL ] HEQ: Loaded 6236 existing records from primary storage. [2025-09-29T02:02:02.184928] [DEBUG] [LOCAL ] HE: Loaded 49870 existing records from primary storage. [2025-09-29T02:02:02.195414] [INFO ] [MAIN ] HEQ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:02.206700] [INFO ] [MAIN ] HE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:02.206964] [INFO ] [MAIN ] Update Progress: 1006/2371 symbols completed. HEQ took 0.4s. Estimated remaining: 6m 21s. Rate: 215.0 symbols/min [2025-09-29T02:02:02.219298] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.15 seconds). [2025-09-29T02:02:02.229918] [INFO ] [MAIN ] Update Progress: 1007/2371 symbols completed. HE took 0.8s. Estimated remaining: 6m 20s. Rate: 215.2 symbols/min [2025-09-29T02:02:02.229795] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-09-29T02:02:02.377686] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:02.661102] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-29T02:02:02.662187] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:02.702936] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-09-29T02:02:02.731126] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-09-29T02:02:02.736339] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:02.737896] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-09-29T02:02:02.737826] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-09-29T02:02:02.738039] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-09-29T02:02:02.738302] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-09-29T02:02:02.738869] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-09-29T02:02:02.750682] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-09-29T02:02:02.750775] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-09-29T02:02:02.751325] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-09-29T02:02:02.751185] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-09-29T02:02:02.751483] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-09-29T02:02:02.751615] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-09-29T02:02:03.006539] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-09-29T02:02:02.995466] [DEBUG] [LOCAL ] HESM: Loaded 48879 existing records from primary storage. [2025-09-29T02:02:03.021964] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-09-29T02:02:03.023290] [INFO ] [MAIN ] HESM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:03.054391] [INFO ] [MAIN ] Update Progress: 1008/2371 symbols completed. HESM took 1.0s. Estimated remaining: 6m 21s. Rate: 214.8 symbols/min [2025-09-29T02:02:03.320749] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-09-29T02:02:03.453276] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-09-29T02:02:03.740148] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:02:03.807640] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:03.816175] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-29T02:02:03.829864] [INFO ] [REMOTE ] HF: Fetching primary data for 2024-12. [2025-09-29T02:02:03.868093] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-09-29T02:02:03.865803] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:02:03.869762] [INFO ] [REMOTE ] HFND: Fetching primary data for 2024-12. [2025-09-29T02:02:03.892719] [DEBUG] [LOCAL ] HFRO: Loaded 17798 existing records from primary storage. [2025-09-29T02:02:03.893032] [INFO ] [MAIN ] HFRO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:03.893148] [INFO ] [MAIN ] Update Progress: 1009/2371 symbols completed. HFRO took 0.8s. Estimated remaining: 6m 21s. Rate: 214.4 symbols/min [2025-09-29T02:02:04.080269] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2024-12 (0.25 seconds). [2025-09-29T02:02:04.081253] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-09-29T02:02:04.077982] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:04.083837] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.22 seconds). [2025-09-29T02:02:04.085346] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-09-29T02:02:04.107425] [DEBUG] [LOCAL ] HGER: Loaded 13428 existing records from primary storage. [2025-09-29T02:02:04.107851] [INFO ] [MAIN ] HGER: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:04.107963] [INFO ] [MAIN ] Update Progress: 1010/2371 symbols completed. HGER took 0.2s. Estimated remaining: 6m 21s. Rate: 214.4 symbols/min [2025-09-29T02:02:04.215332] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-29T02:02:04.222035] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.14 seconds). [2025-09-29T02:02:04.223281] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-09-29T02:02:04.307684] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-09-29T02:02:04.299963] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-09-29T02:02:04.309003] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-09-29T02:02:04.305220] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:04.324978] [DEBUG] [LOCAL ] HGLB: Loaded 9836 existing records from primary storage. [2025-09-29T02:02:04.325953] [INFO ] [MAIN ] HGLB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:04.326058] [INFO ] [MAIN ] Update Progress: 1011/2371 symbols completed. HGLB took 0.2s. Estimated remaining: 6m 20s. Rate: 214.5 symbols/min [2025-09-29T02:02:04.446794] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.15 seconds). [2025-09-29T02:02:04.469083] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-09-29T02:02:04.525556] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-09-29T02:02:04.527127] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-09-29T02:02:04.532406] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:04.550430] [DEBUG] [LOCAL ] HGTY: Loaded 13290 existing records from primary storage. [2025-09-29T02:02:04.550821] [INFO ] [MAIN ] HGTY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:04.550926] [INFO ] [MAIN ] Update Progress: 1012/2371 symbols completed. HGTY took 0.2s. Estimated remaining: 6m 20s. Rate: 214.5 symbols/min [2025-09-29T02:02:04.627141] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-29T02:02:04.652819] [INFO ] [REMOTE ] HCXY: Full fetch complete (592 records). [2025-09-29T02:02:04.669450] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.20 seconds). [2025-09-29T02:02:04.685249] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-09-29T02:02:04.702126] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-09-29T02:02:04.729478] [FATAL] [VALIDATOR ] HCXY: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-29T02:02:04.753042] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:04.748166] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:02:04.754573] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:02:04.754721] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-09-29T02:02:04.754848] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-09-29T02:02:04.754939] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-09-29T02:02:04.755045] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-09-29T02:02:04.755282] [INFO ] [MAIN ] Update Progress: 1013/2371 symbols completed. HCXY took 4.9s. Estimated remaining: 6m 20s. Rate: 214.6 symbols/min [2025-09-29T02:02:04.842972] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-29T02:02:04.886944] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-09-29T02:02:04.908148] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.21 seconds). [2025-09-29T02:02:04.943543] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-09-29T02:02:04.972369] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:05.010718] [DEBUG] [LOCAL ] HGV: Loaded 47426 existing records from primary storage. [2025-09-29T02:02:05.011333] [INFO ] [MAIN ] HGV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:05.011890] [INFO ] [MAIN ] Update Progress: 1014/2371 symbols completed. HGV took 0.5s. Estimated remaining: 6m 19s. Rate: 214.6 symbols/min [2025-09-29T02:02:05.152469] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.21 seconds). [2025-09-29T02:02:05.151961] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-09-29T02:02:05.167375] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-09-29T02:02:05.160130] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-09-29T02:02:05.234369] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:05.235854] [DEBUG] [LOCAL ] HHH: Loaded 33042 existing records from primary storage. [2025-09-29T02:02:05.237376] [INFO ] [MAIN ] HHH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:05.237514] [INFO ] [MAIN ] Update Progress: 1015/2371 symbols completed. HHH took 0.5s. Estimated remaining: 6m 19s. Rate: 214.6 symbols/min [2025-09-29T02:02:05.438203] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-09-29T02:02:05.439847] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-09-29T02:02:05.460618] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-09-29T02:02:05.483070] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-09-29T02:02:05.485709] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:05.489025] [DEBUG] [LOCAL ] HI: Loaded 35713 existing records from primary storage. [2025-09-29T02:02:05.489820] [INFO ] [MAIN ] HI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:05.490175] [INFO ] [MAIN ] Update Progress: 1016/2371 symbols completed. HI took 0.5s. Estimated remaining: 6m 19s. Rate: 214.6 symbols/min [2025-09-29T02:02:05.636140] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.20 seconds). [2025-09-29T02:02:05.650329] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-09-29T02:02:05.749778] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:05.753285] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-09-29T02:02:05.754998] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-09-29T02:02:05.779380] [DEBUG] [LOCAL ] HIG: Loaded 51962 existing records from primary storage. [2025-09-29T02:02:05.779877] [INFO ] [MAIN ] HIG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:05.780487] [INFO ] [MAIN ] Update Progress: 1017/2371 symbols completed. HIG took 0.5s. Estimated remaining: 6m 19s. Rate: 214.6 symbols/min [2025-09-29T02:02:05.830911] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.18 seconds). [2025-09-29T02:02:05.863262] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-09-29T02:02:05.917775] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.16 seconds). [2025-09-29T02:02:05.967159] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-09-29T02:02:06.063707] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:06.064914] [DEBUG] [LOCAL ] HII: Loaded 35728 existing records from primary storage. [2025-09-29T02:02:06.065725] [INFO ] [MAIN ] HII: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:06.066222] [INFO ] [MAIN ] Update Progress: 1018/2371 symbols completed. HII took 0.6s. Estimated remaining: 6m 18s. Rate: 214.6 symbols/min [2025-09-29T02:02:06.093031] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-09-29T02:02:06.119609] [INFO ] [REMOTE ] HF: Full fetch complete (505 records). [2025-09-29T02:02:06.143225] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-09-29T02:02:06.157699] [FATAL] [VALIDATOR ] HF: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-29T02:02:06.188847] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:02:06.189267] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:02:06.200844] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-09-29T02:02:06.235586] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-09-29T02:02:06.269529] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-09-29T02:02:06.275139] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-09-29T02:02:06.274994] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:06.293100] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-09-29T02:02:06.294908] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-09-29T02:02:06.295324] [INFO ] [MAIN ] Update Progress: 1019/2371 symbols completed. HF took 4.1s. Estimated remaining: 6m 18s. Rate: 214.7 symbols/min [2025-09-29T02:02:06.453005] [DEBUG] [LOCAL ] HIMS: Loaded 54597 existing records from primary storage. [2025-09-29T02:02:06.470089] [INFO ] [MAIN ] HIMS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:06.489070] [INFO ] [MAIN ] Update Progress: 1020/2371 symbols completed. HIMS took 0.7s. Estimated remaining: 6m 17s. Rate: 214.7 symbols/min [2025-09-29T02:02:06.548391] [DEBUG] [LOCAL ] HIO: Loaded 24107 existing records from primary storage. [2025-09-29T02:02:06.603963] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:06.640867] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-29T02:02:06.619979] [INFO ] [MAIN ] HIO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:06.656840] [INFO ] [MAIN ] Update Progress: 1021/2371 symbols completed. HIO took 0.6s. Estimated remaining: 6m 17s. Rate: 214.8 symbols/min [2025-09-29T02:02:06.695953] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-09-29T02:02:06.881474] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:06.951972] [DEBUG] [LOCAL ] HIPO: Loaded 22774 existing records from primary storage. [2025-09-29T02:02:06.976429] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:06.977748] [INFO ] [MAIN ] HIPO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:06.977984] [INFO ] [MAIN ] Update Progress: 1022/2371 symbols completed. HIPO took 0.7s. Estimated remaining: 6m 17s. Rate: 214.8 symbols/min [2025-09-29T02:02:07.062264] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-29T02:02:07.126009] [INFO ] [REMOTE ] HFND: Full fetch complete (1798 records). [2025-09-29T02:02:07.128002] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-09-29T02:02:07.256368] [DEBUG] [LOCAL ] HIX: Loaded 20714 existing records from primary storage. [2025-09-29T02:02:07.286141] [INFO ] [MAIN ] HIX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:07.287536] [DEBUG] [LOCAL ] HIW: Loaded 45329 existing records from primary storage. [2025-09-29T02:02:07.321480] [INFO ] [MAIN ] Update Progress: 1023/2371 symbols completed. HIX took 0.7s. Estimated remaining: 6m 17s. Rate: 214.7 symbols/min [2025-09-29T02:02:07.310736] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:07.337627] [INFO ] [MAIN ] HIW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:07.384754] [INFO ] [MAIN ] Update Progress: 1024/2371 symbols completed. HIW took 0.9s. Estimated remaining: 6m 16s. Rate: 214.9 symbols/min [2025-09-29T02:02:07.715635] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-29T02:02:07.727116] [DEBUG] [LOCAL ] HKD: Loaded 18654 existing records from primary storage. [2025-09-29T02:02:07.797758] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:02:07.767190] [INFO ] [MAIN ] HKD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:07.802054] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:07.802174] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:02:07.802841] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-09-29T02:02:07.803033] [INFO ] [MAIN ] Update Progress: 1025/2371 symbols completed. HKD took 0.8s. Estimated remaining: 6m 16s. Rate: 214.8 symbols/min [2025-09-29T02:02:07.813547] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-09-29T02:02:07.840314] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-09-29T02:02:07.904264] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-09-29T02:02:07.956555] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:07.952101] [INFO ] [MAIN ] Update Progress: 1026/2371 symbols completed. HFND took 5.7s. Estimated remaining: 6m 16s. Rate: 214.9 symbols/min [2025-09-29T02:02:08.225808] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:08.316426] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:08.334827] [DEBUG] [LOCAL ] HLF: Loaded 49357 existing records from primary storage. [2025-09-29T02:02:08.351528] [INFO ] [MAIN ] HLF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:08.352156] [INFO ] [MAIN ] Update Progress: 1027/2371 symbols completed. HLF took 1.0s. Estimated remaining: 6m 15s. Rate: 214.8 symbols/min [2025-09-29T02:02:08.359362] [DEBUG] [LOCAL ] HL: Loaded 54451 existing records from primary storage. [2025-09-29T02:02:08.371262] [INFO ] [MAIN ] HL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:08.412211] [INFO ] [MAIN ] Update Progress: 1028/2371 symbols completed. HL took 1.1s. Estimated remaining: 6m 15s. Rate: 215.0 symbols/min [2025-09-29T02:02:08.631265] [DEBUG] [LOCAL ] HLIO: Loaded 28490 existing records from primary storage. [2025-09-29T02:02:08.670501] [DEBUG] [LOCAL ] HLI: Loaded 31573 existing records from primary storage. [2025-09-29T02:02:08.669110] [INFO ] [MAIN ] HLIO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:08.706916] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:08.707107] [INFO ] [MAIN ] Update Progress: 1029/2371 symbols completed. HLIO took 0.7s. Estimated remaining: 6m 15s. Rate: 215.0 symbols/min [2025-09-29T02:02:08.705764] [INFO ] [MAIN ] HLI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:08.735828] [INFO ] [MAIN ] Update Progress: 1030/2371 symbols completed. HLI took 0.9s. Estimated remaining: 6m 14s. Rate: 215.1 symbols/min [2025-09-29T02:02:08.894463] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:09.196279] [DEBUG] [LOCAL ] HLLY: Loaded 33911 existing records from primary storage. [2025-09-29T02:02:09.220916] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:09.199393] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:09.221666] [INFO ] [MAIN ] HLLY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:09.222564] [INFO ] [MAIN ] Update Progress: 1031/2371 symbols completed. HLLY took 0.9s. Estimated remaining: 6m 14s. Rate: 215.0 symbols/min [2025-09-29T02:02:09.413587] [DEBUG] [LOCAL ] HLN: Loaded 53861 existing records from primary storage. [2025-09-29T02:02:09.445475] [INFO ] [MAIN ] HLN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:09.457591] [INFO ] [MAIN ] Update Progress: 1032/2371 symbols completed. HLN took 1.0s. Estimated remaining: 6m 14s. Rate: 215.0 symbols/min [2025-09-29T02:02:09.523337] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:09.535272] [DEBUG] [LOCAL ] HLX: Loaded 48650 existing records from primary storage. [2025-09-29T02:02:09.564342] [INFO ] [MAIN ] HLX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:09.581749] [INFO ] [MAIN ] Update Progress: 1033/2371 symbols completed. HLX took 0.8s. Estimated remaining: 6m 13s. Rate: 215.1 symbols/min [2025-09-29T02:02:09.833693] [DEBUG] [LOCAL ] HLT: Loaded 51450 existing records from primary storage. [2025-09-29T02:02:09.864637] [INFO ] [MAIN ] HLT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:09.875439] [INFO ] [MAIN ] Update Progress: 1034/2371 symbols completed. HLT took 1.2s. Estimated remaining: 6m 13s. Rate: 215.1 symbols/min [2025-09-29T02:02:09.863925] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:09.996978] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:10.110782] [DEBUG] [LOCAL ] HMC: Loaded 47500 existing records from primary storage. [2025-09-29T02:02:10.149402] [INFO ] [MAIN ] HMC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:10.198384] [DEBUG] [LOCAL ] HMN: Loaded 23671 existing records from primary storage. [2025-09-29T02:02:10.204685] [INFO ] [MAIN ] Update Progress: 1035/2371 symbols completed. HMC took 1.0s. Estimated remaining: 6m 13s. Rate: 215.1 symbols/min [2025-09-29T02:02:10.203541] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:10.204175] [INFO ] [MAIN ] HMN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:10.210768] [INFO ] [MAIN ] Update Progress: 1036/2371 symbols completed. HMN took 0.7s. Estimated remaining: 6m 12s. Rate: 215.3 symbols/min [2025-09-29T02:02:10.205236] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-09-29T02:02:10.240628] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-09-29T02:02:10.268763] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-09-29T02:02:10.284191] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-29T02:02:10.318082] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-29T02:02:10.402116] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-09-29T02:02:10.595410] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:10.680580] [DEBUG] [LOCAL ] HMY: Loaded 53914 existing records from primary storage. [2025-09-29T02:02:10.742469] [INFO ] [MAIN ] HMY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:10.742337] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:10.759933] [INFO ] [MAIN ] Update Progress: 1037/2371 symbols completed. HMY took 1.2s. Estimated remaining: 6m 12s. Rate: 215.1 symbols/min [2025-09-29T02:02:10.971760] [DEBUG] [LOCAL ] HNI: Loaded 29386 existing records from primary storage. [2025-09-29T02:02:11.021254] [INFO ] [MAIN ] HNI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:11.043056] [INFO ] [MAIN ] Update Progress: 1038/2371 symbols completed. HNI took 0.8s. Estimated remaining: 6m 12s. Rate: 215.1 symbols/min [2025-09-29T02:02:11.139952] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:02:11.141792] [DEBUG] [LOCAL ] HOG: Loaded 51958 existing records from primary storage. [2025-09-29T02:02:11.142504] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2024-12. [2025-09-29T02:02:11.142686] [INFO ] [MAIN ] HOG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:11.143312] [INFO ] [MAIN ] Update Progress: 1039/2371 symbols completed. HOG took 0.9s. Estimated remaining: 6m 11s. Rate: 215.2 symbols/min [2025-09-29T02:02:11.266488] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:02:11.266883] [WARN ] [REMOTE ] HNGE: No data returned for month 2024-12 [2025-09-29T02:02:11.266976] [FATAL] [REMOTE ] HNGE: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:02:11.267052] [FATAL] [MAIN ] HNGE: Failed to fetch primary data. [2025-09-29T02:02:11.267148] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:02:11.267249] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-29T02:02:11.267345] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-29T02:02:11.267436] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-09-29T02:02:11.267532] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-09-29T02:02:11.267632] [INFO ] [MAIN ] Update Progress: 1040/2371 symbols completed. HNGE took 1.4s. Estimated remaining: 6m 11s. Rate: 215.3 symbols/min [2025-09-29T02:02:11.921788] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:12.044344] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:12.113800] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:12.121177] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:12.143899] [DEBUG] [LOCAL ] HOV: Loaded 13975 existing records from primary storage. [2025-09-29T02:02:12.144295] [INFO ] [MAIN ] HOV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:12.144390] [INFO ] [MAIN ] Update Progress: 1041/2371 symbols completed. HOV took 0.9s. Estimated remaining: 6m 11s. Rate: 214.9 symbols/min [2025-09-29T02:02:12.353869] [DEBUG] [LOCAL ] HOMB: Loaded 44272 existing records from primary storage. [2025-09-29T02:02:12.379409] [DEBUG] [LOCAL ] HOUS: Loaded 44903 existing records from primary storage. [2025-09-29T02:02:12.410131] [INFO ] [MAIN ] HOMB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:12.412890] [INFO ] [MAIN ] Update Progress: 1042/2371 symbols completed. HOMB took 1.1s. Estimated remaining: 6m 11s. Rate: 214.9 symbols/min [2025-09-29T02:02:12.412264] [INFO ] [MAIN ] HOUS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:12.461058] [DEBUG] [LOCAL ] HP: Loaded 52313 existing records from primary storage. [2025-09-29T02:02:12.436614] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:12.448600] [INFO ] [MAIN ] Update Progress: 1043/2371 symbols completed. HOUS took 1.1s. Estimated remaining: 6m 10s. Rate: 215.1 symbols/min [2025-09-29T02:02:12.484867] [INFO ] [MAIN ] HP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:12.490953] [INFO ] [MAIN ] Update Progress: 1044/2371 symbols completed. HP took 1.2s. Estimated remaining: 6m 10s. Rate: 215.3 symbols/min [2025-09-29T02:02:12.973466] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:13.076264] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:13.124632] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:13.158399] [DEBUG] [LOCAL ] HPF: Loaded 7388 existing records from primary storage. [2025-09-29T02:02:13.162184] [INFO ] [MAIN ] HPF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:13.162413] [INFO ] [MAIN ] Update Progress: 1045/2371 symbols completed. HPF took 0.7s. Estimated remaining: 6m 10s. Rate: 215.0 symbols/min [2025-09-29T02:02:13.177231] [DEBUG] [LOCAL ] HPE: Loaded 54477 existing records from primary storage. [2025-09-29T02:02:13.188433] [INFO ] [MAIN ] HPE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:13.221444] [INFO ] [MAIN ] Update Progress: 1046/2371 symbols completed. HPE took 1.1s. Estimated remaining: 6m 10s. Rate: 215.1 symbols/min [2025-09-29T02:02:13.316873] [DEBUG] [LOCAL ] HPI: Loaded 10339 existing records from primary storage. [2025-09-29T02:02:13.421223] [INFO ] [MAIN ] HPI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:13.497036] [INFO ] [MAIN ] Update Progress: 1047/2371 symbols completed. HPI took 1.0s. Estimated remaining: 6m 9s. Rate: 215.1 symbols/min [2025-09-29T02:02:13.485215] [DEBUG] [LOCAL ] HPP: Loaded 51595 existing records from primary storage. [2025-09-29T02:02:13.623794] [INFO ] [MAIN ] HPP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:13.636962] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:13.642752] [INFO ] [MAIN ] Update Progress: 1048/2371 symbols completed. HPP took 1.1s. Estimated remaining: 6m 9s. Rate: 215.2 symbols/min [2025-09-29T02:02:13.747583] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:14.034407] [DEBUG] [LOCAL ] HPS: Loaded 10277 existing records from primary storage. [2025-09-29T02:02:14.084920] [INFO ] [MAIN ] HPS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:14.126329] [INFO ] [MAIN ] Update Progress: 1049/2371 symbols completed. HPS took 0.9s. Estimated remaining: 6m 9s. Rate: 215.1 symbols/min [2025-09-29T02:02:14.161278] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:14.162415] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:14.315563] [DEBUG] [LOCAL ] HPQ: Loaded 54448 existing records from primary storage. [2025-09-29T02:02:14.351549] [INFO ] [MAIN ] HPQ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:14.365258] [INFO ] [MAIN ] Update Progress: 1050/2371 symbols completed. HPQ took 1.2s. Estimated remaining: 6m 8s. Rate: 215.1 symbols/min [2025-09-29T02:02:14.364562] [DEBUG] [LOCAL ] HQL: Loaded 16206 existing records from primary storage. [2025-09-29T02:02:14.409414] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:14.437187] [DEBUG] [LOCAL ] HQH: Loaded 25387 existing records from primary storage. [2025-09-29T02:02:14.417831] [INFO ] [MAIN ] HQL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:14.437699] [INFO ] [MAIN ] Update Progress: 1051/2371 symbols completed. HQL took 0.7s. Estimated remaining: 6m 8s. Rate: 215.3 symbols/min [2025-09-29T02:02:14.437602] [INFO ] [MAIN ] HQH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:14.504458] [INFO ] [MAIN ] Update Progress: 1052/2371 symbols completed. HQH took 1.0s. Estimated remaining: 6m 7s. Rate: 215.4 symbols/min [2025-09-29T02:02:14.901332] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:15.028950] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:15.048491] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:15.067620] [DEBUG] [LOCAL ] HR: Loaded 52716 existing records from primary storage. [2025-09-29T02:02:15.070442] [INFO ] [MAIN ] HR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:15.071571] [INFO ] [MAIN ] Update Progress: 1053/2371 symbols completed. HR took 0.9s. Estimated remaining: 6m 7s. Rate: 215.2 symbols/min [2025-09-29T02:02:15.302105] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:15.332165] [DEBUG] [LOCAL ] HRI: Loaded 33507 existing records from primary storage. [2025-09-29T02:02:15.332917] [INFO ] [MAIN ] HRI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:15.333077] [INFO ] [MAIN ] Update Progress: 1054/2371 symbols completed. HRI took 0.9s. Estimated remaining: 6m 7s. Rate: 215.2 symbols/min [2025-09-29T02:02:15.348043] [DEBUG] [LOCAL ] HRB: Loaded 49275 existing records from primary storage. [2025-09-29T02:02:15.359936] [INFO ] [MAIN ] HRB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:15.366173] [INFO ] [MAIN ] Update Progress: 1055/2371 symbols completed. HRB took 1.0s. Estimated remaining: 6m 7s. Rate: 215.4 symbols/min [2025-09-29T02:02:15.494951] [DEBUG] [LOCAL ] HRL: Loaded 53855 existing records from primary storage. [2025-09-29T02:02:15.551426] [INFO ] [MAIN ] HRL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:15.612567] [INFO ] [MAIN ] Update Progress: 1056/2371 symbols completed. HRL took 1.1s. Estimated remaining: 6m 6s. Rate: 215.4 symbols/min [2025-09-29T02:02:15.819264] [DEBUG] [LOCAL ] HRTG: Loaded 33658 existing records from primary storage. [2025-09-29T02:02:15.854499] [INFO ] [MAIN ] HRTG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:15.848924] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:15.864004] [INFO ] [MAIN ] Update Progress: 1057/2371 symbols completed. HRTG took 0.8s. Estimated remaining: 6m 6s. Rate: 215.4 symbols/min [2025-09-29T02:02:15.913999] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:16.140585] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:16.167511] [DEBUG] [LOCAL ] HSHP: Loaded 15773 existing records from primary storage. [2025-09-29T02:02:16.196470] [INFO ] [MAIN ] HSHP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:16.256799] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:16.219276] [INFO ] [MAIN ] Update Progress: 1058/2371 symbols completed. HSHP took 0.8s. Estimated remaining: 6m 6s. Rate: 215.4 symbols/min [2025-09-29T02:02:16.257344] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-09-29T02:02:16.257441] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-09-29T02:02:16.281055] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-09-29T02:02:16.302825] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-09-29T02:02:16.343638] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-09-29T02:02:16.389578] [DEBUG] [LOCAL ] HSBC: Loaded 51868 existing records from primary storage. [2025-09-29T02:02:16.393399] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-09-29T02:02:16.394236] [INFO ] [MAIN ] HSBC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:16.405210] [INFO ] [MAIN ] Update Progress: 1059/2371 symbols completed. HSBC took 1.1s. Estimated remaining: 6m 5s. Rate: 215.4 symbols/min [2025-09-29T02:02:16.582197] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:16.744727] [DEBUG] [LOCAL ] HSY: Loaded 51161 existing records from primary storage. [2025-09-29T02:02:16.774569] [INFO ] [MAIN ] HSY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:16.820982] [INFO ] [MAIN ] Update Progress: 1060/2371 symbols completed. HSY took 1.2s. Estimated remaining: 6m 5s. Rate: 215.3 symbols/min [2025-09-29T02:02:17.008753] [DEBUG] [LOCAL ] HTD: Loaded 13754 existing records from primary storage. [2025-09-29T02:02:17.091096] [INFO ] [MAIN ] HTD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:17.122087] [INFO ] [MAIN ] Update Progress: 1061/2371 symbols completed. HTD took 0.9s. Estimated remaining: 6m 5s. Rate: 215.3 symbols/min [2025-09-29T02:02:17.183579] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:17.194346] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-09-29T02:02:17.194489] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-09-29T02:02:17.299619] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-09-29T02:02:17.390000] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-09-29T02:02:17.389855] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:17.433773] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-09-29T02:02:17.489959] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-09-29T02:02:17.616706] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:02:17.667978] [INFO ] [REMOTE ] HTB: Fetching primary data for 2024-12. [2025-09-29T02:02:17.710485] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:17.869887] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:02:17.872054] [WARN ] [REMOTE ] HTB: No data returned for month 2024-12 [2025-09-29T02:02:17.890446] [FATAL] [REMOTE ] HTB: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:02:17.919526] [FATAL] [MAIN ] HTB: Failed to fetch primary data. [2025-09-29T02:02:17.956905] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:02:17.965919] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-09-29T02:02:17.983363] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-09-29T02:02:17.965683] [DEBUG] [LOCAL ] HTGC: Loaded 48222 existing records from primary storage. [2025-09-29T02:02:17.983485] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-09-29T02:02:18.003984] [INFO ] [MAIN ] HTGC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:18.039607] [INFO ] [MAIN ] Update Progress: 1062/2371 symbols completed. HTGC took 1.2s. Estimated remaining: 6m 6s. Rate: 214.9 symbols/min [2025-09-29T02:02:18.013090] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-09-29T02:02:18.098731] [INFO ] [MAIN ] Update Progress: 1063/2371 symbols completed. HTB took 2.2s. Estimated remaining: 6m 5s. Rate: 215.0 symbols/min [2025-09-29T02:02:18.051234] [DEBUG] [LOCAL ] HTH: Loaded 32696 existing records from primary storage. [2025-09-29T02:02:18.115443] [INFO ] [MAIN ] HTH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:18.176048] [INFO ] [MAIN ] Update Progress: 1064/2371 symbols completed. HTH took 1.0s. Estimated remaining: 6m 4s. Rate: 215.2 symbols/min [2025-09-29T02:02:18.352182] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:02:18.401768] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2024-12. [2025-09-29T02:02:18.591369] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:18.660714] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2024-12 (0.26 seconds). [2025-09-29T02:02:18.697203] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:18.719312] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-09-29T02:02:18.756847] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:18.818222] [DEBUG] [LOCAL ] HUBB: Loaded 37650 existing records from primary storage. [2025-09-29T02:02:18.818882] [INFO ] [MAIN ] HUBB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:18.818996] [INFO ] [MAIN ] Update Progress: 1065/2371 symbols completed. HUBB took 0.8s. Estimated remaining: 6m 5s. Rate: 214.9 symbols/min [2025-09-29T02:02:18.961464] [DEBUG] [LOCAL ] HUM: Loaded 49568 existing records from primary storage. [2025-09-29T02:02:18.962746] [DEBUG] [LOCAL ] HUBS: Loaded 39953 existing records from primary storage. [2025-09-29T02:02:18.977305] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-09-29T02:02:18.999438] [INFO ] [MAIN ] HUBS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:18.998777] [INFO ] [MAIN ] HUM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:19.027024] [INFO ] [MAIN ] Update Progress: 1066/2371 symbols completed. HUBS took 0.9s. Estimated remaining: 6m 4s. Rate: 215.0 symbols/min [2025-09-29T02:02:19.031329] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-09-29T02:02:19.060247] [INFO ] [MAIN ] Update Progress: 1067/2371 symbols completed. HUM took 0.8s. Estimated remaining: 6m 4s. Rate: 215.1 symbols/min [2025-09-29T02:02:19.087776] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:19.366730] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-29T02:02:19.405347] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-09-29T02:02:19.398667] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:19.503736] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:19.525245] [DEBUG] [LOCAL ] HUN: Loaded 53976 existing records from primary storage. [2025-09-29T02:02:19.525950] [INFO ] [MAIN ] HUN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:19.526722] [INFO ] [MAIN ] Update Progress: 1068/2371 symbols completed. HUN took 0.7s. Estimated remaining: 6m 4s. Rate: 215.0 symbols/min [2025-09-29T02:02:19.653515] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-09-29T02:02:19.654340] [DEBUG] [LOCAL ] HVT: Loaded 16133 existing records from primary storage. [2025-09-29T02:02:19.677720] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-09-29T02:02:19.680182] [INFO ] [MAIN ] HVT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:19.695218] [INFO ] [MAIN ] Update Progress: 1069/2371 symbols completed. HVT took 0.6s. Estimated remaining: 6m 3s. Rate: 215.1 symbols/min [2025-09-29T02:02:19.746426] [DEBUG] [LOCAL ] HUYA: Loaded 44956 existing records from primary storage. [2025-09-29T02:02:19.806962] [INFO ] [MAIN ] HUYA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:19.846684] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:19.857685] [INFO ] [MAIN ] Update Progress: 1070/2371 symbols completed. HUYA took 0.8s. Estimated remaining: 6m 3s. Rate: 215.2 symbols/min [2025-09-29T02:02:20.054503] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-29T02:02:20.095409] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:20.096804] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-09-29T02:02:20.179770] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:20.239422] [DEBUG] [LOCAL ] HY: Loaded 10192 existing records from primary storage. [2025-09-29T02:02:20.241482] [DEBUG] [LOCAL ] HWM: Loaded 53767 existing records from primary storage. [2025-09-29T02:02:20.241983] [INFO ] [MAIN ] HY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:20.242271] [INFO ] [MAIN ] Update Progress: 1071/2371 symbols completed. HY took 0.4s. Estimated remaining: 6m 3s. Rate: 215.1 symbols/min [2025-09-29T02:02:20.242503] [INFO ] [MAIN ] HWM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:20.298215] [INFO ] [MAIN ] Update Progress: 1072/2371 symbols completed. HWM took 0.8s. Estimated remaining: 6m 2s. Rate: 215.3 symbols/min [2025-09-29T02:02:20.408056] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-29T02:02:20.460615] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-09-29T02:02:20.477330] [DEBUG] [LOCAL ] HXL: Loaded 46661 existing records from primary storage. [2025-09-29T02:02:20.516002] [INFO ] [MAIN ] HXL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:20.577446] [INFO ] [MAIN ] Update Progress: 1073/2371 symbols completed. HXL took 0.9s. Estimated remaining: 6m 2s. Rate: 215.2 symbols/min [2025-09-29T02:02:20.584731] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:20.598012] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-09-29T02:02:20.623435] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-09-29T02:02:20.680481] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-09-29T02:02:20.728282] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-29T02:02:20.749018] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:20.783404] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-09-29T02:02:20.788711] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-09-29T02:02:20.788880] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-09-29T02:02:20.810824] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-09-29T02:02:20.836190] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-29T02:02:20.895575] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-09-29T02:02:20.895791] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-09-29T02:02:20.951815] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-09-29T02:02:20.985935] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-09-29T02:02:20.996173] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-09-29T02:02:20.995936] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:21.078151] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.18 seconds). [2025-09-29T02:02:21.131501] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-09-29T02:02:21.247076] [DEBUG] [LOCAL ] HYI: Loaded 9254 existing records from primary storage. [2025-09-29T02:02:21.315316] [INFO ] [MAIN ] HYI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:21.390288] [INFO ] [MAIN ] Update Progress: 1074/2371 symbols completed. HYI took 0.8s. Estimated remaining: 6m 2s. Rate: 214.9 symbols/min [2025-09-29T02:02:21.492284] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-29T02:02:21.513212] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-09-29T02:02:21.816102] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:02:21.848994] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2024-12. [2025-09-29T02:02:21.955788] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:02:21.962817] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-29T02:02:21.993794] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:21.995193] [INFO ] [REMOTE ] HTFC: Full fetch complete (837 records). [2025-09-29T02:02:21.995465] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-09-29T02:02:21.989891] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2024-12. [2025-09-29T02:02:22.160393] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2024-12 (0.31 seconds). [2025-09-29T02:02:22.162157] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-09-29T02:02:22.266228] [WARN ] [VALIDATOR ] HTFC: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-09-29T02:02:22.267566] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:02:22.277356] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:02:22.278231] [DEBUG] [LOCAL ] HYT: Loaded 33853 existing records from primary storage. [2025-09-29T02:02:22.278304] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-09-29T02:02:22.278596] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-09-29T02:02:22.278752] [INFO ] [MAIN ] HYT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:22.278878] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-09-29T02:02:22.279000] [INFO ] [MAIN ] Update Progress: 1075/2371 symbols completed. HYT took 0.8s. Estimated remaining: 6m 3s. Rate: 214.4 symbols/min [2025-09-29T02:02:22.279312] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-09-29T02:02:22.330405] [INFO ] [MAIN ] Update Progress: 1076/2371 symbols completed. HTFC took 5.9s. Estimated remaining: 6m 2s. Rate: 214.6 symbols/min [2025-09-29T02:02:22.391462] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-29T02:02:22.437410] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-09-29T02:02:22.453779] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.29 seconds). [2025-09-29T02:02:22.475259] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-09-29T02:02:22.614333] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:22.676639] [DEBUG] [LOCAL ] HYTR: Loaded 3208 existing records from primary storage. [2025-09-29T02:02:22.697198] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:22.697415] [INFO ] [MAIN ] HYTR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:22.698266] [INFO ] [MAIN ] Update Progress: 1077/2371 symbols completed. HYTR took 0.4s. Estimated remaining: 6m 2s. Rate: 214.5 symbols/min [2025-09-29T02:02:22.746727] [DEBUG] [LOCAL ] HZO: Loaded 29733 existing records from primary storage. [2025-09-29T02:02:22.747114] [INFO ] [MAIN ] HZO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:22.747220] [INFO ] [MAIN ] Update Progress: 1078/2371 symbols completed. HZO took 0.4s. Estimated remaining: 6m 1s. Rate: 214.7 symbols/min [2025-09-29T02:02:22.792949] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-29T02:02:22.794285] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-09-29T02:02:22.811914] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-29T02:02:22.813258] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-09-29T02:02:22.923141] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.13 seconds). [2025-09-29T02:02:22.924481] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-09-29T02:02:22.929170] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.12 seconds). [2025-09-29T02:02:22.930505] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-09-29T02:02:23.048242] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.12 seconds). [2025-09-29T02:02:23.049324] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-09-29T02:02:23.066013] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.14 seconds). [2025-09-29T02:02:23.067289] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-09-29T02:02:23.259338] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.19 seconds). [2025-09-29T02:02:23.262247] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-09-29T02:02:23.262363] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.21 seconds). [2025-09-29T02:02:23.264125] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-09-29T02:02:23.377779] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.12 seconds). [2025-09-29T02:02:23.378863] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-09-29T02:02:23.382672] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.12 seconds). [2025-09-29T02:02:23.383898] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-09-29T02:02:23.503751] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.12 seconds). [2025-09-29T02:02:23.504781] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-09-29T02:02:23.590280] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.21 seconds). [2025-09-29T02:02:23.591524] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-09-29T02:02:23.710118] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.21 seconds). [2025-09-29T02:02:23.712946] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-09-29T02:02:23.713051] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.12 seconds). [2025-09-29T02:02:23.714911] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-09-29T02:02:23.832743] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.12 seconds). [2025-09-29T02:02:23.835450] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.12 seconds). [2025-09-29T02:02:23.836673] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-09-29T02:02:23.837944] [INFO ] [REMOTE ] HYAC: Full fetch complete (866 records). [2025-09-29T02:02:23.839116] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-09-29T02:02:23.839726] [FATAL] [VALIDATOR ] HYAC: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-29T02:02:23.839810] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:02:23.839881] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:02:23.839958] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-29T02:02:23.840040] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-09-29T02:02:23.840111] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-09-29T02:02:23.840294] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-09-29T02:02:23.840427] [INFO ] [MAIN ] Update Progress: 1079/2371 symbols completed. HYAC took 3.6s. Estimated remaining: 6m 2s. Rate: 214.1 symbols/min [2025-09-29T02:02:23.957293] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.12 seconds). [2025-09-29T02:02:23.958116] [INFO ] [REMOTE ] HYBX: Full fetch complete (799 records). [2025-09-29T02:02:23.958214] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-09-29T02:02:24.147530] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-29T02:02:24.147766] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:02:24.147847] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:02:24.147924] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-09-29T02:02:24.148061] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-09-29T02:02:24.148138] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-09-29T02:02:24.148275] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-09-29T02:02:24.148393] [INFO ] [MAIN ] Update Progress: 1080/2371 symbols completed. HYBX took 3.8s. Estimated remaining: 6m 2s. Rate: 214.1 symbols/min [2025-09-29T02:02:24.795435] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:24.878097] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:24.918786] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:24.953818] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:24.962969] [DEBUG] [LOCAL ] IAE: Loaded 6104 existing records from primary storage. [2025-09-29T02:02:24.965203] [INFO ] [MAIN ] IAE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:24.965363] [INFO ] [MAIN ] Update Progress: 1081/2371 symbols completed. IAE took 0.8s. Estimated remaining: 6m 2s. Rate: 213.7 symbols/min [2025-09-29T02:02:25.232524] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:25.261091] [DEBUG] [LOCAL ] IAG: Loaded 54225 existing records from primary storage. [2025-09-29T02:02:25.278492] [INFO ] [MAIN ] IAG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:25.282354] [INFO ] [MAIN ] Update Progress: 1082/2371 symbols completed. IAG took 1.1s. Estimated remaining: 6m 2s. Rate: 213.7 symbols/min [2025-09-29T02:02:25.308781] [DEBUG] [LOCAL ] IBM: Loaded 54416 existing records from primary storage. [2025-09-29T02:02:25.342145] [INFO ] [MAIN ] IBM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:25.365516] [DEBUG] [LOCAL ] IBN: Loaded 53654 existing records from primary storage. [2025-09-29T02:02:25.359178] [INFO ] [MAIN ] Update Progress: 1083/2371 symbols completed. IBM took 1.2s. Estimated remaining: 6m 1s. Rate: 213.8 symbols/min [2025-09-29T02:02:25.385080] [INFO ] [MAIN ] IBN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:25.445329] [INFO ] [MAIN ] Update Progress: 1084/2371 symbols completed. IBN took 1.3s. Estimated remaining: 6m 1s. Rate: 214.0 symbols/min [2025-09-29T02:02:25.792556] [DEBUG] [LOCAL ] IBP: Loaded 29584 existing records from primary storage. [2025-09-29T02:02:25.775731] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:25.803511] [INFO ] [MAIN ] IBP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:25.818739] [INFO ] [MAIN ] Update Progress: 1085/2371 symbols completed. IBP took 0.9s. Estimated remaining: 6m 1s. Rate: 213.9 symbols/min [2025-09-29T02:02:25.877872] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:26.050553] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:26.181782] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:26.183508] [DEBUG] [LOCAL ] IBTA: Loaded 38445 existing records from primary storage. [2025-09-29T02:02:26.184395] [INFO ] [MAIN ] IBTA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:26.184948] [INFO ] [MAIN ] Update Progress: 1086/2371 symbols completed. IBTA took 0.9s. Estimated remaining: 6m 1s. Rate: 213.8 symbols/min [2025-09-29T02:02:26.388691] [DEBUG] [LOCAL ] ICE: Loaded 53800 existing records from primary storage. [2025-09-29T02:02:26.423080] [DEBUG] [LOCAL ] ICL: Loaded 39135 existing records from primary storage. [2025-09-29T02:02:26.440572] [INFO ] [MAIN ] ICL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:26.460401] [INFO ] [MAIN ] ICE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:26.461153] [INFO ] [MAIN ] Update Progress: 1087/2371 symbols completed. ICE took 1.1s. Estimated remaining: 6m 0s. Rate: 213.9 symbols/min [2025-09-29T02:02:26.460267] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:26.462737] [INFO ] [MAIN ] Update Progress: 1088/2371 symbols completed. ICL took 1.0s. Estimated remaining: 5m 60s. Rate: 214.0 symbols/min [2025-09-29T02:02:26.608329] [DEBUG] [LOCAL ] IDA: Loaded 32398 existing records from primary storage. [2025-09-29T02:02:26.664173] [INFO ] [MAIN ] IDA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:26.706869] [INFO ] [MAIN ] Update Progress: 1089/2371 symbols completed. IDA took 0.9s. Estimated remaining: 5m 59s. Rate: 214.1 symbols/min [2025-09-29T02:02:26.734372] [DEBUG] [LOCAL ] IDE: Loaded 8755 existing records from primary storage. [2025-09-29T02:02:26.785038] [INFO ] [MAIN ] IDE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:26.880055] [INFO ] [MAIN ] Update Progress: 1090/2371 symbols completed. IDE took 0.7s. Estimated remaining: 5m 59s. Rate: 214.1 symbols/min [2025-09-29T02:02:26.955800] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:27.022705] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:27.253005] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:27.285220] [DEBUG] [LOCAL ] IDT: Loaded 17885 existing records from primary storage. [2025-09-29T02:02:27.323834] [INFO ] [MAIN ] IDT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:27.356710] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:27.355685] [INFO ] [MAIN ] Update Progress: 1091/2371 symbols completed. IDT took 0.9s. Estimated remaining: 5m 59s. Rate: 214.0 symbols/min [2025-09-29T02:02:27.513926] [DEBUG] [LOCAL ] IEX: Loaded 38978 existing records from primary storage. [2025-09-29T02:02:27.569606] [INFO ] [MAIN ] IEX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:27.581350] [INFO ] [MAIN ] Update Progress: 1092/2371 symbols completed. IEX took 1.1s. Estimated remaining: 5m 59s. Rate: 214.0 symbols/min [2025-09-29T02:02:27.625837] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:27.626394] [DEBUG] [LOCAL ] IFN: Loaded 18475 existing records from primary storage. [2025-09-29T02:02:27.639200] [DEBUG] [LOCAL ] IFF: Loaded 51727 existing records from primary storage. [2025-09-29T02:02:27.697619] [INFO ] [MAIN ] IFN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:27.709207] [INFO ] [MAIN ] IFF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:27.703540] [INFO ] [MAIN ] Update Progress: 1093/2371 symbols completed. IFN took 0.7s. Estimated remaining: 5m 58s. Rate: 214.2 symbols/min [2025-09-29T02:02:27.736293] [INFO ] [MAIN ] Update Progress: 1094/2371 symbols completed. IFF took 1.0s. Estimated remaining: 5m 57s. Rate: 214.3 symbols/min [2025-09-29T02:02:28.077220] [DEBUG] [LOCAL ] IFS: Loaded 23359 existing records from primary storage. [2025-09-29T02:02:28.078715] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:28.089262] [INFO ] [MAIN ] IFS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:28.161801] [INFO ] [MAIN ] Update Progress: 1095/2371 symbols completed. IFS took 0.8s. Estimated remaining: 5m 57s. Rate: 214.2 symbols/min [2025-09-29T02:02:28.244812] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:28.295569] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:28.352044] [DEBUG] [LOCAL ] IGA: Loaded 9779 existing records from primary storage. [2025-09-29T02:02:28.419581] [DEBUG] [LOCAL ] IGI: Loaded 3756 existing records from primary storage. [2025-09-29T02:02:28.422714] [INFO ] [MAIN ] IGI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:28.422427] [DEBUG] [LOCAL ] IGD: Loaded 19170 existing records from primary storage. [2025-09-29T02:02:28.419890] [INFO ] [MAIN ] IGA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:28.428401] [INFO ] [MAIN ] IGD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:28.428524] [INFO ] [MAIN ] Update Progress: 1096/2371 symbols completed. IGI took 0.6s. Estimated remaining: 5m 57s. Rate: 214.2 symbols/min [2025-09-29T02:02:28.454902] [INFO ] [MAIN ] Update Progress: 1097/2371 symbols completed. IGD took 0.7s. Estimated remaining: 5m 57s. Rate: 214.4 symbols/min [2025-09-29T02:02:28.538759] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:28.544154] [INFO ] [MAIN ] Update Progress: 1098/2371 symbols completed. IGA took 0.8s. Estimated remaining: 5m 56s. Rate: 214.6 symbols/min [2025-09-29T02:02:28.995502] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:29.129834] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:29.137151] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:29.139154] [DEBUG] [LOCAL ] IGR: Loaded 30882 existing records from primary storage. [2025-09-29T02:02:29.142175] [DEBUG] [LOCAL ] IH: Loaded 3450 existing records from primary storage. [2025-09-29T02:02:29.143073] [INFO ] [MAIN ] IGR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:29.143414] [INFO ] [MAIN ] IH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:29.143881] [INFO ] [MAIN ] Update Progress: 1099/2371 symbols completed. IGR took 0.9s. Estimated remaining: 5m 56s. Rate: 214.3 symbols/min [2025-09-29T02:02:29.149686] [INFO ] [MAIN ] Update Progress: 1100/2371 symbols completed. IH took 0.7s. Estimated remaining: 5m 55s. Rate: 214.5 symbols/min [2025-09-29T02:02:29.269966] [DEBUG] [LOCAL ] IHD: Loaded 7225 existing records from primary storage. [2025-09-29T02:02:29.338052] [INFO ] [MAIN ] IHD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:29.354046] [INFO ] [MAIN ] Update Progress: 1101/2371 symbols completed. IHD took 0.8s. Estimated remaining: 5m 55s. Rate: 214.6 symbols/min [2025-09-29T02:02:29.518894] [DEBUG] [LOCAL ] IHG: Loaded 24977 existing records from primary storage. [2025-09-29T02:02:29.622792] [INFO ] [MAIN ] IHG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:29.643496] [INFO ] [MAIN ] Update Progress: 1102/2371 symbols completed. IHG took 1.1s. Estimated remaining: 5m 55s. Rate: 214.6 symbols/min [2025-09-29T02:02:29.684065] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:29.745796] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:29.902631] [DEBUG] [LOCAL ] IIF: Loaded 5787 existing records from primary storage. [2025-09-29T02:02:29.930381] [INFO ] [MAIN ] IIF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:29.924595] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:29.951451] [INFO ] [MAIN ] Update Progress: 1103/2371 symbols completed. IIF took 0.8s. Estimated remaining: 5m 55s. Rate: 214.5 symbols/min [2025-09-29T02:02:30.090596] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:30.155944] [DEBUG] [LOCAL ] IHS: Loaded 39400 existing records from primary storage. [2025-09-29T02:02:30.178923] [INFO ] [MAIN ] IHS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:30.194578] [INFO ] [MAIN ] Update Progress: 1104/2371 symbols completed. IHS took 1.1s. Estimated remaining: 5m 54s. Rate: 214.6 symbols/min [2025-09-29T02:02:30.267974] [DEBUG] [LOCAL ] IIIN: Loaded 16828 existing records from primary storage. [2025-09-29T02:02:30.309811] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:30.310028] [INFO ] [MAIN ] IIIN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:30.310367] [INFO ] [MAIN ] Update Progress: 1105/2371 symbols completed. IIIN took 0.9s. Estimated remaining: 5m 54s. Rate: 214.7 symbols/min [2025-09-29T02:02:30.417175] [DEBUG] [LOCAL ] IIM: Loaded 16102 existing records from primary storage. [2025-09-29T02:02:30.473456] [INFO ] [MAIN ] IIM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:30.537382] [INFO ] [MAIN ] Update Progress: 1106/2371 symbols completed. IIM took 0.9s. Estimated remaining: 5m 53s. Rate: 214.7 symbols/min [2025-09-29T02:02:30.623909] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:30.753325] [DEBUG] [LOCAL ] IIPR: Loaded 30052 existing records from primary storage. [2025-09-29T02:02:30.802629] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:30.833104] [INFO ] [MAIN ] IIPR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:30.837670] [INFO ] [MAIN ] Update Progress: 1107/2371 symbols completed. IIPR took 0.9s. Estimated remaining: 5m 53s. Rate: 214.7 symbols/min [2025-09-29T02:02:31.032368] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:31.146549] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:31.168408] [DEBUG] [LOCAL ] IMAX: Loaded 43382 existing records from primary storage. [2025-09-29T02:02:31.169271] [INFO ] [MAIN ] IMAX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:31.169860] [INFO ] [MAIN ] Update Progress: 1108/2371 symbols completed. IMAX took 0.9s. Estimated remaining: 5m 53s. Rate: 214.7 symbols/min [2025-09-29T02:02:31.281400] [DEBUG] [LOCAL ] INFA: Loaded 50602 existing records from primary storage. [2025-09-29T02:02:31.292915] [INFO ] [MAIN ] INFA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:31.323332] [INFO ] [MAIN ] Update Progress: 1109/2371 symbols completed. INFA took 1.0s. Estimated remaining: 5m 53s. Rate: 214.8 symbols/min [2025-09-29T02:02:31.502159] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:31.504383] [DEBUG] [LOCAL ] INFY: Loaded 54378 existing records from primary storage. [2025-09-29T02:02:31.545116] [INFO ] [MAIN ] INFY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:31.571068] [INFO ] [MAIN ] Update Progress: 1110/2371 symbols completed. INFY took 0.9s. Estimated remaining: 5m 52s. Rate: 214.8 symbols/min [2025-09-29T02:02:31.576389] [DEBUG] [LOCAL ] ING: Loaded 51537 existing records from primary storage. [2025-09-29T02:02:31.614749] [INFO ] [MAIN ] ING: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:31.634214] [INFO ] [MAIN ] Update Progress: 1111/2371 symbols completed. ING took 0.8s. Estimated remaining: 5m 52s. Rate: 214.9 symbols/min [2025-09-29T02:02:31.754543] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:31.990173] [DEBUG] [LOCAL ] INGM: Loaded 29224 existing records from primary storage. [2025-09-29T02:02:32.029328] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:32.035537] [INFO ] [MAIN ] INGM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:32.051535] [INFO ] [MAIN ] Update Progress: 1112/2371 symbols completed. INGM took 0.9s. Estimated remaining: 5m 52s. Rate: 214.8 symbols/min [2025-09-29T02:02:32.166556] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:32.212055] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-09-29T02:02:32.225289] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-09-29T02:02:32.257550] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-09-29T02:02:32.269895] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-09-29T02:02:32.284585] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-09-29T02:02:32.284876] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-09-29T02:02:32.291940] [DEBUG] [LOCAL ] INGR: Loaded 33913 existing records from primary storage. [2025-09-29T02:02:32.333159] [INFO ] [MAIN ] INGR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:32.359418] [INFO ] [MAIN ] Update Progress: 1113/2371 symbols completed. INGR took 1.0s. Estimated remaining: 5m 51s. Rate: 214.8 symbols/min [2025-09-29T02:02:32.493249] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:32.627120] [DEBUG] [LOCAL ] INN: Loaded 42433 existing records from primary storage. [2025-09-29T02:02:32.730599] [INFO ] [MAIN ] INN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:32.752685] [INFO ] [MAIN ] Update Progress: 1114/2371 symbols completed. INN took 1.2s. Estimated remaining: 5m 51s. Rate: 214.7 symbols/min [2025-09-29T02:02:32.918344] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:33.166103] [DEBUG] [LOCAL ] INSP: Loaded 37492 existing records from primary storage. [2025-09-29T02:02:33.208788] [INFO ] [MAIN ] INSP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:33.310760] [INFO ] [MAIN ] Update Progress: 1115/2371 symbols completed. INSP took 1.2s. Estimated remaining: 5m 51s. Rate: 214.5 symbols/min [2025-09-29T02:02:33.315237] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:33.310565] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:02:33.369605] [INFO ] [REMOTE ] INR: Fetching primary data for 2024-12. [2025-09-29T02:02:33.413942] [DEBUG] [LOCAL ] INSW: Loaded 40831 existing records from primary storage. [2025-09-29T02:02:33.446755] [INFO ] [MAIN ] INSW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:33.452998] [INFO ] [MAIN ] Update Progress: 1116/2371 symbols completed. INSW took 1.1s. Estimated remaining: 5m 51s. Rate: 214.6 symbols/min [2025-09-29T02:02:33.575239] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:33.597297] [DEBUG] [REMOTE ] INR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:02:33.625564] [WARN ] [REMOTE ] INR: No data returned for month 2024-12 [2025-09-29T02:02:33.643198] [FATAL] [REMOTE ] INR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:02:33.657774] [FATAL] [MAIN ] INR: Failed to fetch primary data. [2025-09-29T02:02:33.658983] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:02:33.670438] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-09-29T02:02:33.720832] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-09-29T02:02:33.767832] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:33.762284] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-09-29T02:02:33.787217] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-09-29T02:02:33.787363] [INFO ] [MAIN ] Update Progress: 1117/2371 symbols completed. INR took 2.1s. Estimated remaining: 5m 51s. Rate: 214.6 symbols/min [2025-09-29T02:02:33.789941] [DEBUG] [LOCAL ] INVH: Loaded 53918 existing records from primary storage. [2025-09-29T02:02:33.791327] [INFO ] [MAIN ] INVH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:33.791889] [INFO ] [MAIN ] Update Progress: 1118/2371 symbols completed. INVH took 1.0s. Estimated remaining: 5m 50s. Rate: 214.8 symbols/min [2025-09-29T02:02:33.803722] [DEBUG] [LOCAL ] INVX: Loaded 29366 existing records from primary storage. [2025-09-29T02:02:33.804100] [INFO ] [MAIN ] INVX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:33.804243] [INFO ] [MAIN ] Update Progress: 1119/2371 symbols completed. INVX took 0.5s. Estimated remaining: 5m 49s. Rate: 215.0 symbols/min [2025-09-29T02:02:33.856714] [DEBUG] [LOCAL ] IONQ: Loaded 54568 existing records from primary storage. [2025-09-29T02:02:33.857140] [INFO ] [MAIN ] IONQ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:33.857429] [INFO ] [MAIN ] Update Progress: 1120/2371 symbols completed. IONQ took 0.4s. Estimated remaining: 5m 49s. Rate: 215.1 symbols/min [2025-09-29T02:02:34.507608] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:34.595443] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:34.661831] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:34.682724] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:34.716142] [DEBUG] [LOCAL ] IPI: Loaded 21704 existing records from primary storage. [2025-09-29T02:02:34.717580] [INFO ] [MAIN ] IPI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:34.717719] [INFO ] [MAIN ] Update Progress: 1121/2371 symbols completed. IPI took 0.8s. Estimated remaining: 5m 49s. Rate: 214.7 symbols/min [2025-09-29T02:02:34.938514] [DEBUG] [LOCAL ] IOT: Loaded 54249 existing records from primary storage. [2025-09-29T02:02:35.040122] [INFO ] [MAIN ] IOT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:35.043465] [DEBUG] [LOCAL ] IPG: Loaded 54110 existing records from primary storage. [2025-09-29T02:02:35.044530] [INFO ] [MAIN ] Update Progress: 1122/2371 symbols completed. IOT took 1.2s. Estimated remaining: 5m 49s. Rate: 214.7 symbols/min [2025-09-29T02:02:35.042277] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:35.066920] [INFO ] [MAIN ] IPG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:35.074181] [DEBUG] [LOCAL ] IP: Loaded 54093 existing records from primary storage. [2025-09-29T02:02:35.095951] [INFO ] [MAIN ] IP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:35.103007] [INFO ] [MAIN ] Update Progress: 1123/2371 symbols completed. IPG took 1.2s. Estimated remaining: 5m 49s. Rate: 214.8 symbols/min [2025-09-29T02:02:35.143483] [INFO ] [MAIN ] Update Progress: 1124/2371 symbols completed. IP took 1.2s. Estimated remaining: 5m 48s. Rate: 215.0 symbols/min [2025-09-29T02:02:35.468630] [DEBUG] [LOCAL ] IQI: Loaded 18161 existing records from primary storage. [2025-09-29T02:02:35.529112] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:35.534627] [INFO ] [MAIN ] IQI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:35.594334] [INFO ] [MAIN ] Update Progress: 1125/2371 symbols completed. IQI took 0.9s. Estimated remaining: 5m 48s. Rate: 214.9 symbols/min [2025-09-29T02:02:35.713399] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:35.738001] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:35.945763] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:35.964181] [DEBUG] [LOCAL ] IQV: Loaded 50895 existing records from primary storage. [2025-09-29T02:02:35.965083] [INFO ] [MAIN ] IQV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:35.965443] [INFO ] [MAIN ] Update Progress: 1126/2371 symbols completed. IQV took 0.9s. Estimated remaining: 5m 48s. Rate: 214.8 symbols/min [2025-09-29T02:02:36.133812] [DEBUG] [LOCAL ] IRM: Loaded 50159 existing records from primary storage. [2025-09-29T02:02:36.146338] [INFO ] [MAIN ] IRM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:36.180862] [INFO ] [MAIN ] Update Progress: 1127/2371 symbols completed. IRM took 0.9s. Estimated remaining: 5m 47s. Rate: 214.9 symbols/min [2025-09-29T02:02:36.287999] [DEBUG] [LOCAL ] IR: Loaded 53470 existing records from primary storage. [2025-09-29T02:02:36.298272] [DEBUG] [LOCAL ] IRS: Loaded 22136 existing records from primary storage. [2025-09-29T02:02:36.355461] [INFO ] [MAIN ] IR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:36.355322] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:36.367542] [INFO ] [MAIN ] Update Progress: 1128/2371 symbols completed. IR took 1.2s. Estimated remaining: 5m 47s. Rate: 214.9 symbols/min [2025-09-29T02:02:36.361017] [INFO ] [MAIN ] IRS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:36.396550] [INFO ] [MAIN ] Update Progress: 1129/2371 symbols completed. IRS took 0.7s. Estimated remaining: 5m 46s. Rate: 215.1 symbols/min [2025-09-29T02:02:36.633557] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:36.817157] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:36.901292] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:36.932144] [DEBUG] [LOCAL ] IRT: Loaded 51146 existing records from primary storage. [2025-09-29T02:02:36.930055] [DEBUG] [LOCAL ] ISD: Loaded 15803 existing records from primary storage. [2025-09-29T02:02:36.933895] [INFO ] [MAIN ] IRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:36.934735] [INFO ] [MAIN ] Update Progress: 1130/2371 symbols completed. IRT took 1.0s. Estimated remaining: 5m 46s. Rate: 214.9 symbols/min [2025-09-29T02:02:36.934156] [INFO ] [MAIN ] ISD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:36.947748] [INFO ] [MAIN ] Update Progress: 1131/2371 symbols completed. ISD took 0.8s. Estimated remaining: 5m 46s. Rate: 215.1 symbols/min [2025-09-29T02:02:37.239977] [DEBUG] [LOCAL ] ITGR: Loaded 31996 existing records from primary storage. [2025-09-29T02:02:37.300621] [DEBUG] [LOCAL ] IT: Loaded 42234 existing records from primary storage. [2025-09-29T02:02:37.319558] [INFO ] [MAIN ] ITGR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:37.319804] [INFO ] [MAIN ] IT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:37.346241] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:37.412101] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:37.356055] [INFO ] [MAIN ] Update Progress: 1132/2371 symbols completed. ITGR took 0.9s. Estimated remaining: 5m 46s. Rate: 215.0 symbols/min [2025-09-29T02:02:37.417784] [INFO ] [MAIN ] Update Progress: 1133/2371 symbols completed. IT took 1.0s. Estimated remaining: 5m 45s. Rate: 215.2 symbols/min [2025-09-29T02:02:37.721809] [DEBUG] [LOCAL ] ITT: Loaded 33511 existing records from primary storage. [2025-09-29T02:02:37.776099] [INFO ] [MAIN ] ITT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:37.859572] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:37.858110] [INFO ] [MAIN ] Update Progress: 1134/2371 symbols completed. ITT took 0.9s. Estimated remaining: 5m 45s. Rate: 215.1 symbols/min [2025-09-29T02:02:37.857217] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:38.024287] [DEBUG] [LOCAL ] ITUB: Loaded 54084 existing records from primary storage. [2025-09-29T02:02:38.041669] [INFO ] [MAIN ] ITUB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:38.042412] [INFO ] [MAIN ] Update Progress: 1135/2371 symbols completed. ITUB took 1.1s. Estimated remaining: 5m 45s. Rate: 215.1 symbols/min [2025-09-29T02:02:38.142159] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:38.301530] [DEBUG] [LOCAL ] IVR: Loaded 48557 existing records from primary storage. [2025-09-29T02:02:38.302159] [DEBUG] [LOCAL ] ITW: Loaded 46782 existing records from primary storage. [2025-09-29T02:02:38.308626] [INFO ] [MAIN ] IVR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:38.309399] [INFO ] [MAIN ] Update Progress: 1136/2371 symbols completed. IVR took 0.9s. Estimated remaining: 5m 44s. Rate: 215.1 symbols/min [2025-09-29T02:02:38.314875] [INFO ] [MAIN ] ITW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:38.380200] [INFO ] [MAIN ] Update Progress: 1137/2371 symbols completed. ITW took 1.0s. Estimated remaining: 5m 44s. Rate: 215.3 symbols/min [2025-09-29T02:02:38.558106] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:38.559395] [DEBUG] [LOCAL ] IVT: Loaded 31325 existing records from primary storage. [2025-09-29T02:02:38.644407] [INFO ] [MAIN ] IVT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:38.675803] [INFO ] [MAIN ] Update Progress: 1138/2371 symbols completed. IVT took 0.8s. Estimated remaining: 5m 44s. Rate: 215.3 symbols/min [2025-09-29T02:02:38.915212] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:38.976982] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:39.113381] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:39.144561] [DEBUG] [LOCAL ] IVZ: Loaded 53908 existing records from primary storage. [2025-09-29T02:02:39.145913] [INFO ] [MAIN ] IVZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:39.146856] [INFO ] [MAIN ] Update Progress: 1139/2371 symbols completed. IVZ took 1.1s. Estimated remaining: 5m 44s. Rate: 215.1 symbols/min [2025-09-29T02:02:39.187253] [DEBUG] [LOCAL ] IX: Loaded 22926 existing records from primary storage. [2025-09-29T02:02:39.214699] [INFO ] [MAIN ] IX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:39.262984] [INFO ] [MAIN ] Update Progress: 1140/2371 symbols completed. IX took 0.9s. Estimated remaining: 5m 43s. Rate: 215.2 symbols/min [2025-09-29T02:02:39.333602] [DEBUG] [LOCAL ] J: Loaded 40873 existing records from primary storage. [2025-09-29T02:02:39.419769] [INFO ] [MAIN ] J: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:39.489117] [INFO ] [MAIN ] Update Progress: 1141/2371 symbols completed. J took 1.1s. Estimated remaining: 5m 43s. Rate: 215.3 symbols/min [2025-09-29T02:02:39.523429] [DEBUG] [LOCAL ] JBGS: Loaded 43089 existing records from primary storage. [2025-09-29T02:02:39.572074] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:39.605110] [INFO ] [MAIN ] JBGS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:39.626155] [INFO ] [MAIN ] Update Progress: 1142/2371 symbols completed. JBGS took 0.9s. Estimated remaining: 5m 42s. Rate: 215.4 symbols/min [2025-09-29T02:02:39.941620] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:39.968104] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:40.048510] [DEBUG] [LOCAL ] JBI: Loaded 44362 existing records from primary storage. [2025-09-29T02:02:40.073424] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:40.074571] [INFO ] [MAIN ] JBI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:40.075293] [INFO ] [MAIN ] Update Progress: 1143/2371 symbols completed. JBI took 0.9s. Estimated remaining: 5m 42s. Rate: 215.3 symbols/min [2025-09-29T02:02:40.074771] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-09-29T02:02:40.075746] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-09-29T02:02:40.114365] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-09-29T02:02:40.139403] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-09-29T02:02:40.188920] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-09-29T02:02:40.236065] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-09-29T02:02:40.242908] [DEBUG] [LOCAL ] JBND: Loaded 26051 existing records from primary storage. [2025-09-29T02:02:40.295095] [INFO ] [MAIN ] JBND: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:40.390614] [DEBUG] [LOCAL ] JBL: Loaded 49145 existing records from primary storage. [2025-09-29T02:02:40.396735] [INFO ] [MAIN ] Update Progress: 1144/2371 symbols completed. JBND took 0.9s. Estimated remaining: 5m 42s. Rate: 215.2 symbols/min [2025-09-29T02:02:40.407232] [INFO ] [MAIN ] JBL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:40.475921] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:40.531807] [DEBUG] [LOCAL ] JBTM: No existing data file found in primary storage. [2025-09-29T02:02:40.510278] [INFO ] [MAIN ] Update Progress: 1145/2371 symbols completed. JBL took 1.2s. Estimated remaining: 5m 42s. Rate: 215.3 symbols/min [2025-09-29T02:02:40.538389] [WARN ] [MAIN ] JBTM: No existing data found, performing full refresh instead. [2025-09-29T02:02:40.564830] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-09-29T02:02:40.602470] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-09-29T02:02:40.667141] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-09-29T02:02:40.667452] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-09-29T02:02:41.436213] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:41.580521] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:41.724805] [DEBUG] [LOCAL ] JCE: Loaded 6591 existing records from primary storage. [2025-09-29T02:02:41.725313] [INFO ] [MAIN ] JCE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:41.742802] [INFO ] [MAIN ] Update Progress: 1146/2371 symbols completed. JCE took 1.2s. Estimated remaining: 5m 42s. Rate: 214.7 symbols/min [2025-09-29T02:02:41.761428] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:02:41.786340] [INFO ] [REMOTE ] JBS: Fetching primary data for 2024-12. [2025-09-29T02:02:42.106756] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:42.136160] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:02:42.142941] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:02:42.160193] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2024-12. [2025-09-29T02:02:42.160354] [WARN ] [REMOTE ] JBS: No data returned for month 2024-12 [2025-09-29T02:02:42.161793] [FATAL] [REMOTE ] JBS: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:02:42.161902] [FATAL] [MAIN ] JBS: Failed to fetch primary data. [2025-09-29T02:02:42.161985] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:02:42.162051] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-09-29T02:02:42.162198] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-09-29T02:02:42.162670] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-09-29T02:02:42.164708] [DEBUG] [LOCAL ] JCI: Loaded 54327 existing records from primary storage. [2025-09-29T02:02:42.162802] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-09-29T02:02:42.165490] [INFO ] [MAIN ] Update Progress: 1147/2371 symbols completed. JBS took 2.5s. Estimated remaining: 5m 42s. Rate: 214.6 symbols/min [2025-09-29T02:02:42.165689] [INFO ] [MAIN ] JCI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:42.166571] [INFO ] [MAIN ] Update Progress: 1148/2371 symbols completed. JCI took 1.6s. Estimated remaining: 5m 42s. Rate: 214.8 symbols/min [2025-09-29T02:02:42.277588] [DEBUG] [REMOTE ] JBTM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:02:42.350238] [WARN ] [REMOTE ] JBTM: No data returned for month 2024-12 [2025-09-29T02:02:42.376006] [FATAL] [REMOTE ] JBTM: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:02:42.389565] [FATAL] [MAIN ] JBTM: Failed to fetch primary data. [2025-09-29T02:02:42.410532] [WARN ] [MAIN ] JBTM: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:02:42.446278] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-09-29T02:02:42.505519] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:42.528082] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-09-29T02:02:42.562608] [INFO ] [LOCAL ] JBTM: Starting deletion of derivative data. [2025-09-29T02:02:42.568262] [INFO ] [MAIN ] JEQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:42.568812] [DEBUG] [LOCAL ] JBTM: No derivative data file found to delete. [2025-09-29T02:02:42.569554] [INFO ] [MAIN ] Update Progress: 1149/2371 symbols completed. JBTM took 2.5s. Estimated remaining: 5m 41s. Rate: 214.7 symbols/min [2025-09-29T02:02:42.624771] [DEBUG] [LOCAL ] JEF: Loaded 50763 existing records from primary storage. [2025-09-29T02:02:42.674486] [INFO ] [MAIN ] JEF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:42.695817] [INFO ] [MAIN ] Update Progress: 1150/2371 symbols completed. JEF took 0.9s. Estimated remaining: 5m 41s. Rate: 214.8 symbols/min [2025-09-29T02:02:42.701982] [DEBUG] [LOCAL ] JEQ: Loaded 9336 existing records from primary storage. [2025-09-29T02:02:42.718562] [INFO ] [MAIN ] JEQ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:42.763710] [INFO ] [MAIN ] Update Progress: 1151/2371 symbols completed. JEQ took 0.6s. Estimated remaining: 5m 41s. Rate: 215.0 symbols/min [2025-09-29T02:02:43.068463] [DEBUG] [LOCAL ] JELD: Loaded 46791 existing records from primary storage. [2025-09-29T02:02:43.066756] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:43.090005] [INFO ] [MAIN ] JELD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:43.124016] [INFO ] [MAIN ] Update Progress: 1152/2371 symbols completed. JELD took 1.0s. Estimated remaining: 5m 40s. Rate: 214.9 symbols/min [2025-09-29T02:02:43.217608] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:43.337256] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:43.479315] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:43.479515] [DEBUG] [LOCAL ] JGH: Loaded 11064 existing records from primary storage. [2025-09-29T02:02:43.492372] [INFO ] [MAIN ] JGH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:43.493280] [DEBUG] [LOCAL ] JFR: Loaded 30975 existing records from primary storage. [2025-09-29T02:02:43.493921] [INFO ] [MAIN ] JFR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:43.493552] [INFO ] [MAIN ] Update Progress: 1153/2371 symbols completed. JGH took 0.8s. Estimated remaining: 5m 40s. Rate: 214.8 symbols/min [2025-09-29T02:02:43.500409] [INFO ] [MAIN ] Update Progress: 1154/2371 symbols completed. JFR took 0.9s. Estimated remaining: 5m 40s. Rate: 215.0 symbols/min [2025-09-29T02:02:43.601397] [DEBUG] [LOCAL ] JHI: Loaded 3641 existing records from primary storage. [2025-09-29T02:02:43.664317] [INFO ] [MAIN ] JHI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:43.732573] [INFO ] [MAIN ] Update Progress: 1155/2371 symbols completed. JHI took 0.6s. Estimated remaining: 5m 39s. Rate: 215.1 symbols/min [2025-09-29T02:02:43.920031] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:43.965241] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:43.880317] [DEBUG] [LOCAL ] JHG: Loaded 48497 existing records from primary storage. [2025-09-29T02:02:44.005513] [INFO ] [MAIN ] JHG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:44.017928] [INFO ] [MAIN ] Update Progress: 1156/2371 symbols completed. JHG took 1.2s. Estimated remaining: 5m 39s. Rate: 215.0 symbols/min [2025-09-29T02:02:44.049752] [DEBUG] [LOCAL ] JHS: Loaded 2878 existing records from primary storage. [2025-09-29T02:02:44.139824] [INFO ] [MAIN ] JHS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:44.202835] [INFO ] [MAIN ] Update Progress: 1157/2371 symbols completed. JHS took 0.7s. Estimated remaining: 5m 39s. Rate: 215.1 symbols/min [2025-09-29T02:02:44.232514] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:44.336603] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:44.359484] [DEBUG] [LOCAL ] JHX: Loaded 51216 existing records from primary storage. [2025-09-29T02:02:44.359983] [INFO ] [MAIN ] JHX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:44.360457] [INFO ] [MAIN ] Update Progress: 1158/2371 symbols completed. JHX took 0.9s. Estimated remaining: 5m 38s. Rate: 215.2 symbols/min [2025-09-29T02:02:44.368416] [DEBUG] [LOCAL ] JILL: Loaded 16931 existing records from primary storage. [2025-09-29T02:02:44.368999] [INFO ] [MAIN ] JILL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:44.369186] [INFO ] [MAIN ] Update Progress: 1159/2371 symbols completed. JILL took 0.6s. Estimated remaining: 5m 38s. Rate: 215.4 symbols/min [2025-09-29T02:02:44.410377] [DEBUG] [LOCAL ] JKS: Loaded 40672 existing records from primary storage. [2025-09-29T02:02:44.410808] [INFO ] [MAIN ] JKS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:44.410913] [INFO ] [MAIN ] Update Progress: 1160/2371 symbols completed. JKS took 0.4s. Estimated remaining: 5m 37s. Rate: 215.5 symbols/min [2025-09-29T02:02:45.073595] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:45.126060] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-09-29T02:02:45.095601] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:45.182182] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-09-29T02:02:45.183186] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:45.207265] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:45.207709] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-09-29T02:02:45.208388] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-09-29T02:02:45.208494] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-09-29T02:02:45.208579] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-09-29T02:02:45.278008] [DEBUG] [LOCAL ] JLS: Loaded 4142 existing records from primary storage. [2025-09-29T02:02:45.306406] [INFO ] [MAIN ] JLS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:45.337861] [INFO ] [MAIN ] Update Progress: 1161/2371 symbols completed. JLS took 0.9s. Estimated remaining: 5m 38s. Rate: 215.1 symbols/min [2025-09-29T02:02:45.415534] [DEBUG] [LOCAL ] JLL: Loaded 32458 existing records from primary storage. [2025-09-29T02:02:45.476164] [INFO ] [MAIN ] JLL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:45.540473] [INFO ] [MAIN ] Update Progress: 1162/2371 symbols completed. JLL took 1.1s. Estimated remaining: 5m 37s. Rate: 215.1 symbols/min [2025-09-29T02:02:45.751763] [DEBUG] [LOCAL ] JMIA: Loaded 51279 existing records from primary storage. [2025-09-29T02:02:45.807770] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:45.803312] [INFO ] [MAIN ] JMIA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:45.891580] [INFO ] [MAIN ] Update Progress: 1163/2371 symbols completed. JMIA took 1.5s. Estimated remaining: 5m 37s. Rate: 215.1 symbols/min [2025-09-29T02:02:46.063741] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:46.220487] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:02:46.221178] [INFO ] [REMOTE ] JMM: Fetching primary data for 2024-12. [2025-09-29T02:02:46.305089] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:46.372826] [DEBUG] [LOCAL ] JNJ: Loaded 54533 existing records from primary storage. [2025-09-29T02:02:46.384368] [INFO ] [MAIN ] JNJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:46.399567] [DEBUG] [LOCAL ] JOE: Loaded 24860 existing records from primary storage. [2025-09-29T02:02:46.402788] [INFO ] [MAIN ] JOE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:46.402022] [INFO ] [MAIN ] Update Progress: 1164/2371 symbols completed. JNJ took 1.0s. Estimated remaining: 5m 37s. Rate: 214.9 symbols/min [2025-09-29T02:02:46.426923] [DEBUG] [LOCAL ] JOBY: Loaded 54579 existing records from primary storage. [2025-09-29T02:02:46.420306] [INFO ] [MAIN ] Update Progress: 1165/2371 symbols completed. JOE took 0.5s. Estimated remaining: 5m 36s. Rate: 215.1 symbols/min [2025-09-29T02:02:46.464484] [INFO ] [MAIN ] JOBY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:46.480725] [INFO ] [MAIN ] Update Progress: 1166/2371 symbols completed. JOBY took 0.9s. Estimated remaining: 5m 36s. Rate: 215.3 symbols/min [2025-09-29T02:02:46.625004] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-29T02:02:46.694205] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-09-29T02:02:46.951292] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:46.987520] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:47.025891] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-29T02:02:47.046769] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-09-29T02:02:47.070356] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:47.076742] [DEBUG] [LOCAL ] JOF: Loaded 7177 existing records from primary storage. [2025-09-29T02:02:47.077187] [INFO ] [MAIN ] JOF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:47.077317] [INFO ] [MAIN ] Update Progress: 1167/2371 symbols completed. JOF took 0.7s. Estimated remaining: 5m 36s. Rate: 215.1 symbols/min [2025-09-29T02:02:47.287077] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:47.318247] [DEBUG] [LOCAL ] JPM: Loaded 54574 existing records from primary storage. [2025-09-29T02:02:47.318847] [INFO ] [MAIN ] JPM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:47.319277] [INFO ] [MAIN ] Update Progress: 1168/2371 symbols completed. JPM took 0.8s. Estimated remaining: 5m 36s. Rate: 215.1 symbols/min [2025-09-29T02:02:47.444066] [DEBUG] [LOCAL ] JPC: Loaded 37620 existing records from primary storage. [2025-09-29T02:02:47.464041] [INFO ] [MAIN ] JPC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:47.444380] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-29T02:02:47.469745] [INFO ] [MAIN ] Update Progress: 1169/2371 symbols completed. JPC took 1.0s. Estimated remaining: 5m 35s. Rate: 215.2 symbols/min [2025-09-29T02:02:47.486998] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-09-29T02:02:47.633625] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:47.670543] [DEBUG] [LOCAL ] JQC: Loaded 34194 existing records from primary storage. [2025-09-29T02:02:47.694821] [INFO ] [MAIN ] JQC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:47.699221] [INFO ] [MAIN ] Update Progress: 1170/2371 symbols completed. JQC took 0.6s. Estimated remaining: 5m 35s. Rate: 215.2 symbols/min [2025-09-29T02:02:47.827830] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:47.869962] [DEBUG] [LOCAL ] JRI: Loaded 15068 existing records from primary storage. [2025-09-29T02:02:47.894086] [INFO ] [MAIN ] JRI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:47.893935] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-29T02:02:47.904804] [INFO ] [MAIN ] Update Progress: 1171/2371 symbols completed. JRI took 0.6s. Estimated remaining: 5m 35s. Rate: 215.2 symbols/min [2025-09-29T02:02:47.911042] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-09-29T02:02:48.124033] [DEBUG] [LOCAL ] JRS: Loaded 11250 existing records from primary storage. [2025-09-29T02:02:48.123387] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:48.137988] [INFO ] [MAIN ] JRS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:48.138597] [INFO ] [MAIN ] Update Progress: 1172/2371 symbols completed. JRS took 0.6s. Estimated remaining: 5m 34s. Rate: 215.3 symbols/min [2025-09-29T02:02:48.314775] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-29T02:02:48.326510] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:48.338931] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-09-29T02:02:48.446684] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:48.466496] [DEBUG] [LOCAL ] JXN: Loaded 46558 existing records from primary storage. [2025-09-29T02:02:48.467884] [INFO ] [MAIN ] JXN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:48.468627] [INFO ] [MAIN ] Update Progress: 1173/2371 symbols completed. JXN took 0.7s. Estimated remaining: 5m 34s. Rate: 215.2 symbols/min [2025-09-29T02:02:48.610864] [DEBUG] [LOCAL ] KAI: Loaded 13729 existing records from primary storage. [2025-09-29T02:02:48.611425] [INFO ] [MAIN ] KAI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:48.622811] [INFO ] [MAIN ] Update Progress: 1174/2371 symbols completed. KAI took 0.5s. Estimated remaining: 5m 34s. Rate: 215.3 symbols/min [2025-09-29T02:02:48.708943] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-29T02:02:48.762353] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:48.760417] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-09-29T02:02:48.822840] [DEBUG] [LOCAL ] K: Loaded 50637 existing records from primary storage. [2025-09-29T02:02:48.840017] [INFO ] [MAIN ] K: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:48.851308] [INFO ] [MAIN ] Update Progress: 1175/2371 symbols completed. K took 0.9s. Estimated remaining: 5m 33s. Rate: 215.4 symbols/min [2025-09-29T02:02:48.972818] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:49.125443] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-29T02:02:49.121457] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:49.132799] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-09-29T02:02:49.150348] [DEBUG] [LOCAL ] KAR: Loaded 40411 existing records from primary storage. [2025-09-29T02:02:49.151251] [INFO ] [MAIN ] KAR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:49.151365] [INFO ] [MAIN ] Update Progress: 1176/2371 symbols completed. KAR took 0.7s. Estimated remaining: 5m 33s. Rate: 215.3 symbols/min [2025-09-29T02:02:49.234717] [DEBUG] [LOCAL ] KB: Loaded 24453 existing records from primary storage. [2025-09-29T02:02:49.269249] [INFO ] [MAIN ] KB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:49.292161] [INFO ] [MAIN ] Update Progress: 1177/2371 symbols completed. KB took 0.7s. Estimated remaining: 5m 33s. Rate: 215.4 symbols/min [2025-09-29T02:02:49.362611] [DEBUG] [LOCAL ] KBDC: Loaded 21252 existing records from primary storage. [2025-09-29T02:02:49.438426] [INFO ] [MAIN ] KBDC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:49.432625] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:49.463721] [INFO ] [MAIN ] Update Progress: 1178/2371 symbols completed. KBDC took 0.6s. Estimated remaining: 5m 32s. Rate: 215.5 symbols/min [2025-09-29T02:02:49.501704] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-29T02:02:49.558294] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-09-29T02:02:49.709281] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:49.802888] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:49.822580] [DEBUG] [LOCAL ] KBH: Loaded 49678 existing records from primary storage. [2025-09-29T02:02:49.823359] [INFO ] [MAIN ] KBH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:49.823924] [INFO ] [MAIN ] Update Progress: 1179/2371 symbols completed. KBH took 0.7s. Estimated remaining: 5m 32s. Rate: 215.4 symbols/min [2025-09-29T02:02:49.961027] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-29T02:02:49.967958] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-09-29T02:02:50.064613] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:50.082523] [DEBUG] [LOCAL ] KBR: Loaded 48899 existing records from primary storage. [2025-09-29T02:02:50.083425] [INFO ] [MAIN ] KBR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:50.083883] [INFO ] [MAIN ] Update Progress: 1180/2371 symbols completed. KBR took 0.8s. Estimated remaining: 5m 32s. Rate: 215.5 symbols/min [2025-09-29T02:02:50.192950] [DEBUG] [LOCAL ] KEN: Loaded 4784 existing records from primary storage. [2025-09-29T02:02:50.211260] [INFO ] [MAIN ] KEN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:50.224041] [DEBUG] [LOCAL ] KD: Loaded 53068 existing records from primary storage. [2025-09-29T02:02:50.224472] [INFO ] [MAIN ] KD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:50.224224] [INFO ] [MAIN ] Update Progress: 1181/2371 symbols completed. KEN took 0.4s. Estimated remaining: 5m 31s. Rate: 215.5 symbols/min [2025-09-29T02:02:50.230407] [INFO ] [MAIN ] Update Progress: 1182/2371 symbols completed. KD took 0.8s. Estimated remaining: 5m 31s. Rate: 215.7 symbols/min [2025-09-29T02:02:50.341302] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-29T02:02:50.469488] [INFO ] [REMOTE ] JMM: Full fetch complete (2292 records). [2025-09-29T02:02:50.506608] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:50.522305] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-09-29T02:02:50.751346] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:50.869132] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:50.902774] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-09-29T02:02:50.924752] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-09-29T02:02:50.926341] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-09-29T02:02:50.969138] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-09-29T02:02:50.970239] [DEBUG] [LOCAL ] KEP: Loaded 31169 existing records from primary storage. [2025-09-29T02:02:50.970484] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-09-29T02:02:50.966316] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-09-29T02:02:50.971086] [INFO ] [MAIN ] KEP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:50.971912] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:02:50.971619] [INFO ] [MAIN ] Update Progress: 1183/2371 symbols completed. KEP took 0.9s. Estimated remaining: 5m 31s. Rate: 215.4 symbols/min [2025-09-29T02:02:50.971323] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-09-29T02:02:50.977693] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:02:50.988766] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-09-29T02:02:51.022954] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-09-29T02:02:51.047185] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-09-29T02:02:51.084244] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-09-29T02:02:51.122249] [INFO ] [MAIN ] Update Progress: 1184/2371 symbols completed. JMM took 6.7s. Estimated remaining: 5m 30s. Rate: 215.5 symbols/min [2025-09-29T02:02:51.337108] [DEBUG] [LOCAL ] KEX: Loaded 38712 existing records from primary storage. [2025-09-29T02:02:51.414062] [INFO ] [MAIN ] KEX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:51.489074] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:51.516166] [INFO ] [MAIN ] Update Progress: 1185/2371 symbols completed. KEX took 1.3s. Estimated remaining: 5m 30s. Rate: 215.4 symbols/min [2025-09-29T02:02:51.846678] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:52.062984] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:52.066433] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:02:52.070440] [INFO ] [REMOTE ] KEY: Fetching primary data for 2024-12. [2025-09-29T02:02:52.069910] [DEBUG] [LOCAL ] KF: Loaded 2486 existing records from primary storage. [2025-09-29T02:02:52.071085] [INFO ] [MAIN ] KF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:52.072695] [DEBUG] [LOCAL ] KEYS: Loaded 43955 existing records from primary storage. [2025-09-29T02:02:52.074035] [INFO ] [MAIN ] KEYS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:52.074670] [INFO ] [MAIN ] Update Progress: 1186/2371 symbols completed. KEYS took 1.1s. Estimated remaining: 5m 30s. Rate: 215.3 symbols/min [2025-09-29T02:02:52.080630] [INFO ] [MAIN ] Update Progress: 1187/2371 symbols completed. KF took 0.9s. Estimated remaining: 5m 30s. Rate: 215.4 symbols/min [2025-09-29T02:02:52.389086] [DEBUG] [LOCAL ] KFRC: Loaded 19766 existing records from primary storage. [2025-09-29T02:02:52.419285] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:52.436708] [INFO ] [MAIN ] KFRC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:52.442401] [INFO ] [MAIN ] Update Progress: 1188/2371 symbols completed. KFRC took 0.9s. Estimated remaining: 5m 30s. Rate: 215.4 symbols/min [2025-09-29T02:02:52.573025] [DEBUG] [LOCAL ] KFS: Loaded 8471 existing records from primary storage. [2025-09-29T02:02:52.607926] [INFO ] [MAIN ] KFS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:52.612606] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:52.640540] [INFO ] [MAIN ] Update Progress: 1189/2371 symbols completed. KFS took 0.6s. Estimated remaining: 5m 29s. Rate: 215.4 symbols/min [2025-09-29T02:02:52.758374] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:52.896285] [DEBUG] [LOCAL ] KFY: Loaded 31057 existing records from primary storage. [2025-09-29T02:02:52.923447] [INFO ] [MAIN ] KFY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:52.968106] [INFO ] [MAIN ] Update Progress: 1190/2371 symbols completed. KFY took 0.9s. Estimated remaining: 5m 29s. Rate: 215.4 symbols/min [2025-09-29T02:02:53.110800] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:53.210067] [DEBUG] [LOCAL ] KGC: Loaded 54479 existing records from primary storage. [2025-09-29T02:02:53.235732] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-29T02:02:53.234508] [INFO ] [MAIN ] KGC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:53.247275] [INFO ] [MAIN ] Update Progress: 1191/2371 symbols completed. KGC took 0.8s. Estimated remaining: 5m 29s. Rate: 215.4 symbols/min [2025-09-29T02:02:53.295167] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-09-29T02:02:53.322421] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:53.538420] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:53.554897] [DEBUG] [LOCAL ] KGS: Loaded 46487 existing records from primary storage. [2025-09-29T02:02:53.555909] [INFO ] [MAIN ] KGS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:53.556389] [INFO ] [MAIN ] Update Progress: 1192/2371 symbols completed. KGS took 0.9s. Estimated remaining: 5m 28s. Rate: 215.4 symbols/min [2025-09-29T02:02:53.710954] [DEBUG] [LOCAL ] KIO: Loaded 21625 existing records from primary storage. [2025-09-29T02:02:53.744148] [INFO ] [MAIN ] KIO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:53.806280] [DEBUG] [LOCAL ] KIM: Loaded 53831 existing records from primary storage. [2025-09-29T02:02:53.772008] [INFO ] [MAIN ] Update Progress: 1193/2371 symbols completed. KIO took 0.5s. Estimated remaining: 5m 28s. Rate: 215.4 symbols/min [2025-09-29T02:02:53.810628] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:53.810867] [INFO ] [MAIN ] KIM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:53.850016] [INFO ] [MAIN ] Update Progress: 1194/2371 symbols completed. KIM took 0.9s. Estimated remaining: 5m 28s. Rate: 215.5 symbols/min [2025-09-29T02:02:54.148053] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:54.268945] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:54.271880] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-09-29T02:02:54.288270] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-09-29T02:02:54.288932] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-09-29T02:02:54.289097] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-09-29T02:02:54.289493] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-09-29T02:02:54.289750] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-09-29T02:02:54.321115] [DEBUG] [LOCAL ] KKR: Loaded 54281 existing records from primary storage. [2025-09-29T02:02:54.350495] [INFO ] [MAIN ] KKR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:54.409872] [INFO ] [MAIN ] Update Progress: 1195/2371 symbols completed. KKR took 0.9s. Estimated remaining: 5m 28s. Rate: 215.4 symbols/min [2025-09-29T02:02:54.410410] [DEBUG] [LOCAL ] KKRS: Loaded 5801 existing records from primary storage. [2025-09-29T02:02:54.442083] [INFO ] [MAIN ] KKRS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:54.514260] [INFO ] [MAIN ] Update Progress: 1196/2371 symbols completed. KKRS took 0.7s. Estimated remaining: 5m 27s. Rate: 215.5 symbols/min [2025-09-29T02:02:54.506636] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-29T02:02:54.621907] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-09-29T02:02:54.930508] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:54.957918] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-09-29T02:02:54.981362] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-09-29T02:02:54.991958] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-09-29T02:02:55.063281] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:02:55.014280] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-09-29T02:02:55.069180] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-09-29T02:02:55.069618] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-09-29T02:02:55.255105] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:02:55.295951] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2024-12. [2025-09-29T02:02:55.469371] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:02:55.471251] [DEBUG] [LOCAL ] KLC: Loaded 37107 existing records from primary storage. [2025-09-29T02:02:55.493085] [INFO ] [MAIN ] KLC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:02:55.503810] [WARN ] [REMOTE ] KKRT: No data returned for month 2024-12 [2025-09-29T02:02:55.504471] [INFO ] [MAIN ] Update Progress: 1197/2371 symbols completed. KLC took 1.0s. Estimated remaining: 5m 28s. Rate: 215.0 symbols/min [2025-09-29T02:02:55.520399] [FATAL] [REMOTE ] KKRT: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:02:55.527602] [FATAL] [MAIN ] KKRT: Failed to fetch primary data. [2025-09-29T02:02:55.553980] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:02:55.582807] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-09-29T02:02:55.618479] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:02:55.619127] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2024-12. [2025-09-29T02:02:55.618823] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-09-29T02:02:55.620269] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-09-29T02:02:55.620507] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-09-29T02:02:55.620730] [INFO ] [MAIN ] Update Progress: 1198/2371 symbols completed. KKRT took 1.8s. Estimated remaining: 5m 27s. Rate: 215.1 symbols/min [2025-09-29T02:02:55.650036] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-29T02:02:55.660988] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-09-29T02:02:55.756503] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:02:55.756937] [WARN ] [REMOTE ] KLAR: No data returned for month 2024-12 [2025-09-29T02:02:55.757031] [FATAL] [REMOTE ] KLAR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:02:55.757154] [FATAL] [MAIN ] KLAR: Failed to fetch primary data. [2025-09-29T02:02:55.757228] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:02:55.757323] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-09-29T02:02:55.757426] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-09-29T02:02:55.757507] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-09-29T02:02:55.757633] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-09-29T02:02:55.757750] [INFO ] [MAIN ] Update Progress: 1199/2371 symbols completed. KLAR took 1.3s. Estimated remaining: 5m 27s. Rate: 215.2 symbols/min [2025-09-29T02:02:56.455995] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-29T02:02:56.468475] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-09-29T02:02:56.893840] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-29T02:02:56.905743] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-09-29T02:02:57.743763] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-29T02:02:57.756391] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-09-29T02:02:58.282286] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-29T02:02:58.294084] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-09-29T02:02:59.121508] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-29T02:02:59.134303] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-09-29T02:03:00.006262] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-29T02:03:00.018433] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-09-29T02:03:00.980303] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-29T02:03:00.992705] [INFO ] [REMOTE ] KEY: Full fetch complete (77256 records). [2025-09-29T02:03:00.992924] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-09-29T02:03:01.202385] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-29T02:03:01.203593] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:03:01.203708] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:03:01.203789] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-09-29T02:03:01.203929] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-09-29T02:03:01.204019] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-09-29T02:03:01.204174] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-09-29T02:03:01.204712] [INFO ] [MAIN ] Update Progress: 1200/2371 symbols completed. KEY took 11.0s. Estimated remaining: 5m 32s. Rate: 211.9 symbols/min [2025-09-29T02:03:01.762127] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:01.840113] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:01.948797] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:02.042453] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:02.047342] [DEBUG] [LOCAL ] KMPB: Loaded 3646 existing records from primary storage. [2025-09-29T02:03:02.051870] [INFO ] [MAIN ] KMPB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:02.052137] [INFO ] [MAIN ] Update Progress: 1201/2371 symbols completed. KMPB took 0.8s. Estimated remaining: 5m 32s. Rate: 211.6 symbols/min [2025-09-29T02:03:02.261834] [DEBUG] [LOCAL ] KMI: Loaded 54473 existing records from primary storage. [2025-09-29T02:03:02.299536] [INFO ] [MAIN ] KMI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:02.341195] [INFO ] [MAIN ] Update Progress: 1202/2371 symbols completed. KMI took 1.1s. Estimated remaining: 5m 31s. Rate: 211.6 symbols/min [2025-09-29T02:03:02.338403] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:02.391011] [DEBUG] [LOCAL ] KMT: Loaded 43687 existing records from primary storage. [2025-09-29T02:03:02.374139] [DEBUG] [LOCAL ] KMPR: Loaded 39117 existing records from primary storage. [2025-09-29T02:03:02.411727] [INFO ] [MAIN ] KMT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:02.412097] [INFO ] [MAIN ] KMPR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:02.412847] [INFO ] [MAIN ] Update Progress: 1203/2371 symbols completed. KMPR took 1.1s. Estimated remaining: 5m 31s. Rate: 211.7 symbols/min [2025-09-29T02:03:02.423547] [INFO ] [MAIN ] Update Progress: 1204/2371 symbols completed. KMT took 1.2s. Estimated remaining: 5m 30s. Rate: 211.9 symbols/min [2025-09-29T02:03:02.825851] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:02.920919] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:03.019244] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:03.021285] [DEBUG] [LOCAL ] KMX: Loaded 53897 existing records from primary storage. [2025-09-29T02:03:03.022902] [INFO ] [MAIN ] KMX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:03.023169] [INFO ] [MAIN ] Update Progress: 1205/2371 symbols completed. KMX took 1.0s. Estimated remaining: 5m 30s. Rate: 211.7 symbols/min [2025-09-29T02:03:03.159977] [DEBUG] [LOCAL ] KNOP: Loaded 10274 existing records from primary storage. [2025-09-29T02:03:03.182526] [DEBUG] [LOCAL ] KN: Loaded 39393 existing records from primary storage. [2025-09-29T02:03:03.190666] [INFO ] [MAIN ] KNOP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:03.199253] [INFO ] [MAIN ] Update Progress: 1206/2371 symbols completed. KNOP took 0.8s. Estimated remaining: 5m 30s. Rate: 211.8 symbols/min [2025-09-29T02:03:03.196575] [INFO ] [MAIN ] KN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:03.215931] [INFO ] [MAIN ] Update Progress: 1207/2371 symbols completed. KN took 0.9s. Estimated remaining: 5m 30s. Rate: 211.9 symbols/min [2025-09-29T02:03:03.438389] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:03.450248] [DEBUG] [LOCAL ] KNF: Loaded 36435 existing records from primary storage. [2025-09-29T02:03:03.489582] [INFO ] [MAIN ] KNF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:03.520915] [INFO ] [MAIN ] Update Progress: 1208/2371 symbols completed. KNF took 1.1s. Estimated remaining: 5m 29s. Rate: 211.9 symbols/min [2025-09-29T02:03:03.811756] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:03.944191] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:03.975663] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:03.975982] [DEBUG] [LOCAL ] KNSL: Loaded 18372 existing records from primary storage. [2025-09-29T02:03:03.976633] [DEBUG] [LOCAL ] KO: No existing data file found in primary storage. [2025-09-29T02:03:03.976737] [WARN ] [MAIN ] KO: No existing data found, performing full refresh instead. [2025-09-29T02:03:03.977242] [INFO ] [MAIN ] KNSL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:03.978120] [INFO ] [MAIN ] Update Progress: 1209/2371 symbols completed. KNSL took 1.0s. Estimated remaining: 5m 29s. Rate: 211.8 symbols/min [2025-09-29T02:03:03.978246] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-09-29T02:03:03.986569] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-09-29T02:03:04.000476] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-09-29T02:03:04.007604] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-09-29T02:03:04.361592] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:04.385925] [DEBUG] [LOCAL ] KNTK: Loaded 46794 existing records from primary storage. [2025-09-29T02:03:04.467160] [DEBUG] [LOCAL ] KNX: Loaded 53363 existing records from primary storage. [2025-09-29T02:03:04.465927] [INFO ] [MAIN ] KNTK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:04.474833] [INFO ] [MAIN ] Update Progress: 1210/2371 symbols completed. KNTK took 1.3s. Estimated remaining: 5m 29s. Rate: 211.7 symbols/min [2025-09-29T02:03:04.485029] [INFO ] [MAIN ] KNX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:04.522689] [INFO ] [MAIN ] Update Progress: 1211/2371 symbols completed. KNX took 1.2s. Estimated remaining: 5m 29s. Rate: 211.8 symbols/min [2025-09-29T02:03:04.952363] [DEBUG] [LOCAL ] KODK: Loaded 44025 existing records from primary storage. [2025-09-29T02:03:04.999903] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:03:05.049357] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:05.067859] [INFO ] [REMOTE ] KO: Fetching primary data for 2024-12. [2025-09-29T02:03:05.068289] [INFO ] [MAIN ] KODK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:05.087442] [INFO ] [MAIN ] Update Progress: 1212/2371 symbols completed. KODK took 1.1s. Estimated remaining: 5m 29s. Rate: 211.6 symbols/min [2025-09-29T02:03:05.110867] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:05.295518] [DEBUG] [LOCAL ] KOP: Loaded 18066 existing records from primary storage. [2025-09-29T02:03:05.303801] [INFO ] [MAIN ] KOP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:05.338853] [INFO ] [MAIN ] Update Progress: 1213/2371 symbols completed. KOP took 0.7s. Estimated remaining: 5m 28s. Rate: 211.7 symbols/min [2025-09-29T02:03:05.356333] [DEBUG] [LOCAL ] KOF: Loaded 26219 existing records from primary storage. [2025-09-29T02:03:05.343249] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:05.380145] [INFO ] [MAIN ] KOF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:05.424361] [INFO ] [MAIN ] Update Progress: 1214/2371 symbols completed. KOF took 0.9s. Estimated remaining: 5m 28s. Rate: 211.8 symbols/min [2025-09-29T02:03:05.460919] [DEBUG] [LOCAL ] KORE: Loaded 2010 existing records from primary storage. [2025-09-29T02:03:05.501321] [INFO ] [MAIN ] KORE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:05.507094] [INFO ] [MAIN ] Update Progress: 1215/2371 symbols completed. KORE took 0.4s. Estimated remaining: 5m 27s. Rate: 211.9 symbols/min [2025-09-29T02:03:05.798469] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:05.942255] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:05.943441] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:06.002298] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-29T02:03:06.016203] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-09-29T02:03:06.037603] [DEBUG] [LOCAL ] KOS: Loaded 53828 existing records from primary storage. [2025-09-29T02:03:06.038271] [INFO ] [MAIN ] KOS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:06.051552] [INFO ] [MAIN ] Update Progress: 1216/2371 symbols completed. KOS took 0.7s. Estimated remaining: 5m 27s. Rate: 211.7 symbols/min [2025-09-29T02:03:06.200327] [DEBUG] [LOCAL ] KRC: Loaded 49114 existing records from primary storage. [2025-09-29T02:03:06.252260] [INFO ] [MAIN ] KRC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:06.269612] [INFO ] [MAIN ] Update Progress: 1217/2371 symbols completed. KRC took 0.8s. Estimated remaining: 5m 27s. Rate: 211.8 symbols/min [2025-09-29T02:03:06.306590] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:06.308488] [DEBUG] [LOCAL ] KR: Loaded 54461 existing records from primary storage. [2025-09-29T02:03:06.309432] [INFO ] [MAIN ] KR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:06.309609] [INFO ] [MAIN ] Update Progress: 1218/2371 symbols completed. KR took 0.9s. Estimated remaining: 5m 26s. Rate: 211.9 symbols/min [2025-09-29T02:03:06.742507] [DEBUG] [LOCAL ] KREF: Loaded 37767 existing records from primary storage. [2025-09-29T02:03:06.740701] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:06.744070] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:06.744558] [INFO ] [MAIN ] KREF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:06.745517] [INFO ] [MAIN ] Update Progress: 1219/2371 symbols completed. KREF took 0.7s. Estimated remaining: 5m 26s. Rate: 211.8 symbols/min [2025-09-29T02:03:06.745674] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-09-29T02:03:06.758425] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-09-29T02:03:06.770198] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-09-29T02:03:06.796737] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-09-29T02:03:06.815923] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-09-29T02:03:06.836840] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-09-29T02:03:07.043885] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:07.192937] [DEBUG] [LOCAL ] KRG: Loaded 49859 existing records from primary storage. [2025-09-29T02:03:07.272736] [INFO ] [MAIN ] KRG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:07.297620] [INFO ] [MAIN ] Update Progress: 1220/2371 symbols completed. KRG took 1.0s. Estimated remaining: 5m 26s. Rate: 211.7 symbols/min [2025-09-29T02:03:07.344264] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-29T02:03:07.309829] [DEBUG] [LOCAL ] KRO: Loaded 26448 existing records from primary storage. [2025-09-29T02:03:07.385715] [INFO ] [MAIN ] KRO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:07.417976] [INFO ] [MAIN ] Update Progress: 1221/2371 symbols completed. KRO took 0.7s. Estimated remaining: 5m 26s. Rate: 211.8 symbols/min [2025-09-29T02:03:07.455725] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-09-29T02:03:07.658822] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:03:07.680308] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2024-12. [2025-09-29T02:03:07.821423] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:07.852442] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:07.881796] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:03:07.882135] [WARN ] [REMOTE ] KRMN: No data returned for month 2024-12 [2025-09-29T02:03:07.882237] [FATAL] [REMOTE ] KRMN: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:03:07.882312] [FATAL] [MAIN ] KRMN: Failed to fetch primary data. [2025-09-29T02:03:07.882398] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:03:07.882788] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-09-29T02:03:07.882891] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-09-29T02:03:07.882976] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-09-29T02:03:07.883074] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-09-29T02:03:07.883164] [INFO ] [MAIN ] Update Progress: 1222/2371 symbols completed. KRMN took 1.6s. Estimated remaining: 5m 26s. Rate: 211.7 symbols/min [2025-09-29T02:03:08.025867] [DEBUG] [LOCAL ] KRP: Loaded 37947 existing records from primary storage. [2025-09-29T02:03:08.027059] [INFO ] [MAIN ] KRP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:08.048286] [INFO ] [MAIN ] Update Progress: 1223/2371 symbols completed. KRP took 0.7s. Estimated remaining: 5m 25s. Rate: 211.7 symbols/min [2025-09-29T02:03:08.163725] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:08.186213] [DEBUG] [LOCAL ] KSS: Loaded 54385 existing records from primary storage. [2025-09-29T02:03:08.191027] [INFO ] [MAIN ] KSS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:08.207684] [INFO ] [MAIN ] Update Progress: 1224/2371 symbols completed. KSS took 0.8s. Estimated remaining: 5m 25s. Rate: 211.8 symbols/min [2025-09-29T02:03:08.450397] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:08.545998] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:08.593420] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-29T02:03:08.591077] [DEBUG] [LOCAL ] KT: Loaded 46336 existing records from primary storage. [2025-09-29T02:03:08.604120] [INFO ] [MAIN ] KT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:08.608367] [INFO ] [MAIN ] Update Progress: 1225/2371 symbols completed. KT took 0.7s. Estimated remaining: 5m 25s. Rate: 211.7 symbols/min [2025-09-29T02:03:08.627451] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-09-29T02:03:08.672043] [DEBUG] [LOCAL ] KTF: Loaded 13065 existing records from primary storage. [2025-09-29T02:03:08.716216] [INFO ] [MAIN ] KTF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:08.755504] [INFO ] [MAIN ] Update Progress: 1226/2371 symbols completed. KTF took 0.5s. Estimated remaining: 5m 24s. Rate: 211.8 symbols/min [2025-09-29T02:03:08.933099] [INFO ] [MAIN ] KUKE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:08.961749] [DEBUG] [LOCAL ] KUKE: No existing data file found in primary storage. [2025-09-29T02:03:08.968990] [DEBUG] [LOCAL ] KTB: Loaded 41738 existing records from primary storage. [2025-09-29T02:03:08.991092] [INFO ] [MAIN ] KTB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:08.990794] [WARN ] [MAIN ] KUKE: No existing data found, performing full refresh instead. [2025-09-29T02:03:08.991262] [INFO ] [MAIN ] Update Progress: 1227/2371 symbols completed. KTB took 0.9s. Estimated remaining: 5m 24s. Rate: 211.9 symbols/min [2025-09-29T02:03:09.046240] [INFO ] [MAIN ] KUKE: Wiping existing primary data before full refresh. [2025-09-29T02:03:09.082814] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-09-29T02:03:09.145570] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:09.163492] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-09-29T02:03:09.179906] [INFO ] [MAIN ] KUKE: Starting full primary refresh. [2025-09-29T02:03:09.389226] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:09.666495] [DEBUG] [LOCAL ] KVUE: Loaded 54447 existing records from primary storage. [2025-09-29T02:03:09.678216] [INFO ] [MAIN ] KVUE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:09.694286] [INFO ] [MAIN ] Update Progress: 1228/2371 symbols completed. KVUE took 0.9s. Estimated remaining: 5m 24s. Rate: 211.6 symbols/min [2025-09-29T02:03:09.780424] [INFO ] [REMOTE ] KUKE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:03:09.826134] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2024-12. [2025-09-29T02:03:09.877605] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-29T02:03:09.875957] [DEBUG] [LOCAL ] KVYO: Loaded 50696 existing records from primary storage. [2025-09-29T02:03:09.922169] [INFO ] [MAIN ] KVYO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:09.955323] [INFO ] [MAIN ] Update Progress: 1229/2371 symbols completed. KVYO took 1.0s. Estimated remaining: 5m 24s. Rate: 211.6 symbols/min [2025-09-29T02:03:09.967863] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-09-29T02:03:10.128835] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:10.240554] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:10.286201] [DEBUG] [LOCAL ] KWR: Loaded 16931 existing records from primary storage. [2025-09-29T02:03:10.287348] [DEBUG] [LOCAL ] KW: Loaded 41236 existing records from primary storage. [2025-09-29T02:03:10.287744] [INFO ] [MAIN ] KWR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:10.287976] [INFO ] [MAIN ] Update Progress: 1230/2371 symbols completed. KWR took 0.3s. Estimated remaining: 5m 24s. Rate: 211.6 symbols/min [2025-09-29T02:03:10.301216] [INFO ] [MAIN ] KW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:10.301904] [INFO ] [MAIN ] Update Progress: 1231/2371 symbols completed. KW took 0.6s. Estimated remaining: 5m 23s. Rate: 211.7 symbols/min [2025-09-29T02:03:10.364035] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-29T02:03:10.396527] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-01. [2025-09-29T02:03:10.689468] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:10.709711] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:10.758557] [DEBUG] [LOCAL ] KYN: Loaded 30432 existing records from primary storage. [2025-09-29T02:03:10.759020] [INFO ] [MAIN ] KYN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:10.759635] [INFO ] [MAIN ] Update Progress: 1232/2371 symbols completed. KYN took 0.5s. Estimated remaining: 5m 23s. Rate: 211.6 symbols/min [2025-09-29T02:03:10.882608] [DEBUG] [LOCAL ] L: Loaded 41562 existing records from primary storage. [2025-09-29T02:03:10.888493] [INFO ] [MAIN ] L: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:10.888739] [INFO ] [MAIN ] Update Progress: 1233/2371 symbols completed. L took 0.6s. Estimated remaining: 5m 22s. Rate: 211.7 symbols/min [2025-09-29T02:03:11.051877] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:11.105472] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-29T02:03:11.181243] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:11.181825] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-02. [2025-09-29T02:03:11.227075] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-29T02:03:11.256894] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-09-29T02:03:11.278783] [DEBUG] [LOCAL ] LAD: Loaded 24089 existing records from primary storage. [2025-09-29T02:03:11.293299] [INFO ] [MAIN ] LAD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:11.294944] [INFO ] [MAIN ] Update Progress: 1234/2371 symbols completed. LAD took 0.4s. Estimated remaining: 5m 22s. Rate: 211.7 symbols/min [2025-09-29T02:03:11.323117] [DEBUG] [LOCAL ] LAC: Loaded 53091 existing records from primary storage. [2025-09-29T02:03:11.379934] [INFO ] [MAIN ] LAC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:11.420320] [INFO ] [MAIN ] Update Progress: 1235/2371 symbols completed. LAC took 0.7s. Estimated remaining: 5m 22s. Rate: 211.8 symbols/min [2025-09-29T02:03:11.563988] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:11.677672] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-29T02:03:11.687366] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-03. [2025-09-29T02:03:11.760260] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:11.782004] [DEBUG] [LOCAL ] LANV: Loaded 2851 existing records from primary storage. [2025-09-29T02:03:11.782327] [INFO ] [MAIN ] LANV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:11.783352] [DEBUG] [LOCAL ] LADR: Loaded 39204 existing records from primary storage. [2025-09-29T02:03:11.783828] [INFO ] [MAIN ] Update Progress: 1236/2371 symbols completed. LANV took 0.4s. Estimated remaining: 5m 22s. Rate: 211.7 symbols/min [2025-09-29T02:03:11.783988] [INFO ] [MAIN ] LADR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:11.789628] [INFO ] [MAIN ] Update Progress: 1237/2371 symbols completed. LADR took 0.5s. Estimated remaining: 5m 21s. Rate: 211.9 symbols/min [2025-09-29T02:03:11.985258] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:11.985889] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-09-29T02:03:11.986234] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-09-29T02:03:11.986683] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-09-29T02:03:11.986845] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-09-29T02:03:11.987072] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-09-29T02:03:11.987194] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-09-29T02:03:12.312724] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-29T02:03:12.322673] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-04. [2025-09-29T02:03:12.439166] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:03:12.441477] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-29T02:03:12.441828] [INFO ] [REMOTE ] LAR: Fetching primary data for 2024-12. [2025-09-29T02:03:12.454836] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-09-29T02:03:12.573178] [DEBUG] [REMOTE ] LAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:03:12.573545] [WARN ] [REMOTE ] LAR: No data returned for month 2024-12 [2025-09-29T02:03:12.573637] [FATAL] [REMOTE ] LAR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:03:12.573744] [FATAL] [MAIN ] LAR: Failed to fetch primary data. [2025-09-29T02:03:12.573813] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:03:12.573887] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-09-29T02:03:12.573984] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-09-29T02:03:12.574058] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-09-29T02:03:12.574154] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-09-29T02:03:12.574259] [INFO ] [MAIN ] Update Progress: 1238/2371 symbols completed. LAR took 0.8s. Estimated remaining: 5m 21s. Rate: 211.6 symbols/min [2025-09-29T02:03:12.792402] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-29T02:03:12.794127] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-05. [2025-09-29T02:03:12.924283] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-05 (0.13 seconds). [2025-09-29T02:03:12.925834] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-06. [2025-09-29T02:03:13.053636] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-06 (0.13 seconds). [2025-09-29T02:03:13.055720] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-07. [2025-09-29T02:03:13.180918] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-29T02:03:13.196428] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-09-29T02:03:13.196555] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-07 (0.14 seconds). [2025-09-29T02:03:13.199230] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-08. [2025-09-29T02:03:13.719165] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-29T02:03:13.721950] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-09. [2025-09-29T02:03:14.005886] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-29T02:03:14.018785] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-09-29T02:03:14.093027] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-29T02:03:14.094924] [INFO ] [REMOTE ] KUKE: Full fetch complete (8120 records). [2025-09-29T02:03:14.095040] [DEBUG] [VALIDATOR ] KUKE: Validating primary data. [2025-09-29T02:03:14.295156] [WARN ] [VALIDATOR ] KUKE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-29T02:03:14.295426] [FATAL] [MAIN ] KUKE: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:03:14.295526] [WARN ] [MAIN ] KUKE: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:03:14.295662] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-09-29T02:03:14.295783] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-09-29T02:03:14.295864] [INFO ] [LOCAL ] KUKE: Starting deletion of derivative data. [2025-09-29T02:03:14.295981] [DEBUG] [LOCAL ] KUKE: No derivative data file found to delete. [2025-09-29T02:03:14.296130] [INFO ] [MAIN ] Update Progress: 1239/2371 symbols completed. KUKE took 5.7s. Estimated remaining: 5m 22s. Rate: 210.7 symbols/min [2025-09-29T02:03:14.840107] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-29T02:03:14.852154] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-09-29T02:03:15.603426] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-29T02:03:15.614800] [INFO ] [REMOTE ] KO: Full fetch complete (77214 records). [2025-09-29T02:03:15.615038] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-09-29T02:03:15.837965] [WARN ] [VALIDATOR ] KO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-29T02:03:15.838880] [FATAL] [MAIN ] KO: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:03:15.838978] [WARN ] [MAIN ] KO: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:03:15.839094] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-09-29T02:03:15.839243] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-09-29T02:03:15.839360] [INFO ] [LOCAL ] KO: Starting deletion of derivative data. [2025-09-29T02:03:15.839482] [DEBUG] [LOCAL ] KO: No derivative data file found to delete. [2025-09-29T02:03:15.840511] [INFO ] [MAIN ] Update Progress: 1240/2371 symbols completed. KO took 12.3s. Estimated remaining: 5m 23s. Rate: 210.0 symbols/min [2025-09-29T02:03:16.469860] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:16.622752] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:16.645002] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:16.651891] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:16.674336] [DEBUG] [LOCAL ] LAW: Loaded 14171 existing records from primary storage. [2025-09-29T02:03:16.674893] [INFO ] [MAIN ] LAW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:16.675043] [INFO ] [MAIN ] Update Progress: 1241/2371 symbols completed. LAW took 0.8s. Estimated remaining: 5m 23s. Rate: 209.6 symbols/min [2025-09-29T02:03:16.985661] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:16.906189] [DEBUG] [LOCAL ] LB: Loaded 38116 existing records from primary storage. [2025-09-29T02:03:16.987600] [DEBUG] [LOCAL ] LAZ: Loaded 45784 existing records from primary storage. [2025-09-29T02:03:17.001763] [INFO ] [MAIN ] LB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:17.004888] [INFO ] [MAIN ] Update Progress: 1242/2371 symbols completed. LB took 1.2s. Estimated remaining: 5m 23s. Rate: 209.6 symbols/min [2025-09-29T02:03:17.004717] [INFO ] [MAIN ] LAZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:17.011908] [DEBUG] [LOCAL ] LBRT: Loaded 53695 existing records from primary storage. [2025-09-29T02:03:17.010691] [INFO ] [MAIN ] Update Progress: 1243/2371 symbols completed. LAZ took 1.1s. Estimated remaining: 5m 23s. Rate: 209.8 symbols/min [2025-09-29T02:03:17.018565] [INFO ] [MAIN ] LBRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:17.035513] [INFO ] [MAIN ] Update Progress: 1244/2371 symbols completed. LBRT took 1.2s. Estimated remaining: 5m 22s. Rate: 209.9 symbols/min [2025-09-29T02:03:17.578602] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:17.626774] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:17.634032] [DEBUG] [LOCAL ] LC: Loaded 48605 existing records from primary storage. [2025-09-29T02:03:17.655551] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:17.656286] [INFO ] [MAIN ] LC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:17.657096] [INFO ] [MAIN ] Update Progress: 1245/2371 symbols completed. LC took 1.0s. Estimated remaining: 5m 22s. Rate: 209.7 symbols/min [2025-09-29T02:03:17.866109] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:17.898282] [DEBUG] [LOCAL ] LCII: Loaded 28900 existing records from primary storage. [2025-09-29T02:03:17.898698] [INFO ] [MAIN ] LCII: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:17.898887] [INFO ] [MAIN ] Update Progress: 1246/2371 symbols completed. LCII took 0.9s. Estimated remaining: 5m 22s. Rate: 209.8 symbols/min [2025-09-29T02:03:18.035078] [DEBUG] [LOCAL ] LDP: Loaded 13128 existing records from primary storage. [2025-09-29T02:03:18.046469] [DEBUG] [LOCAL ] LDOS: Loaded 46407 existing records from primary storage. [2025-09-29T02:03:18.053940] [DEBUG] [LOCAL ] LDI: Loaded 44776 existing records from primary storage. [2025-09-29T02:03:18.059896] [INFO ] [MAIN ] LDP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:18.059412] [INFO ] [MAIN ] LDOS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:18.060686] [INFO ] [MAIN ] Update Progress: 1247/2371 symbols completed. LDOS took 1.0s. Estimated remaining: 5m 21s. Rate: 209.8 symbols/min [2025-09-29T02:03:18.060233] [INFO ] [MAIN ] LDI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:18.061408] [INFO ] [MAIN ] Update Progress: 1248/2371 symbols completed. LDI took 1.0s. Estimated remaining: 5m 21s. Rate: 210.0 symbols/min [2025-09-29T02:03:18.115486] [INFO ] [MAIN ] Update Progress: 1249/2371 symbols completed. LDP took 0.4s. Estimated remaining: 5m 20s. Rate: 210.1 symbols/min [2025-09-29T02:03:18.394070] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:18.614864] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:18.718439] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:18.747237] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:18.768777] [DEBUG] [LOCAL ] LEA: Loaded 42464 existing records from primary storage. [2025-09-29T02:03:18.769762] [INFO ] [MAIN ] LEA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:18.769916] [INFO ] [MAIN ] Update Progress: 1250/2371 symbols completed. LEA took 0.9s. Estimated remaining: 5m 20s. Rate: 209.9 symbols/min [2025-09-29T02:03:18.889154] [DEBUG] [LOCAL ] LEO: Loaded 17785 existing records from primary storage. [2025-09-29T02:03:18.929219] [INFO ] [MAIN ] LEO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:18.929536] [INFO ] [MAIN ] Update Progress: 1251/2371 symbols completed. LEO took 0.8s. Estimated remaining: 5m 20s. Rate: 210.0 symbols/min [2025-09-29T02:03:18.942600] [DEBUG] [LOCAL ] LEG: Loaded 51130 existing records from primary storage. [2025-09-29T02:03:19.053588] [INFO ] [MAIN ] LEG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:19.158017] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:19.158241] [INFO ] [MAIN ] Update Progress: 1252/2371 symbols completed. LEG took 1.1s. Estimated remaining: 5m 20s. Rate: 210.0 symbols/min [2025-09-29T02:03:19.185858] [DEBUG] [LOCAL ] LEN: Loaded 53967 existing records from primary storage. [2025-09-29T02:03:19.208688] [INFO ] [MAIN ] LEN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:19.253782] [INFO ] [MAIN ] Update Progress: 1253/2371 symbols completed. LEN took 1.1s. Estimated remaining: 5m 19s. Rate: 210.1 symbols/min [2025-09-29T02:03:19.461685] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:19.683871] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:19.689577] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:19.693291] [DEBUG] [LOCAL ] LFT: Loaded 18286 existing records from primary storage. [2025-09-29T02:03:19.709934] [INFO ] [MAIN ] LFT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:19.710217] [INFO ] [MAIN ] Update Progress: 1254/2371 symbols completed. LFT took 0.8s. Estimated remaining: 5m 19s. Rate: 210.0 symbols/min [2025-09-29T02:03:19.711317] [DEBUG] [LOCAL ] LEVI: Loaded 52306 existing records from primary storage. [2025-09-29T02:03:19.729187] [INFO ] [MAIN ] LEVI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:19.765752] [INFO ] [MAIN ] Update Progress: 1255/2371 symbols completed. LEVI took 1.0s. Estimated remaining: 5m 19s. Rate: 210.2 symbols/min [2025-09-29T02:03:19.861164] [DEBUG] [LOCAL ] LGI: Loaded 10137 existing records from primary storage. [2025-09-29T02:03:19.908120] [INFO ] [MAIN ] LGI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:19.934321] [INFO ] [MAIN ] Update Progress: 1256/2371 symbols completed. LGI took 0.8s. Estimated remaining: 5m 18s. Rate: 210.2 symbols/min [2025-09-29T02:03:20.172677] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:20.251268] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:20.230565] [DEBUG] [LOCAL ] LH: Loaded 38660 existing records from primary storage. [2025-09-29T02:03:20.268420] [INFO ] [MAIN ] LH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:20.269565] [INFO ] [MAIN ] Update Progress: 1257/2371 symbols completed. LH took 1.0s. Estimated remaining: 5m 18s. Rate: 210.2 symbols/min [2025-09-29T02:03:20.440036] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:20.548884] [DEBUG] [LOCAL ] LII: Loaded 28648 existing records from primary storage. [2025-09-29T02:03:20.594830] [INFO ] [MAIN ] LII: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:20.594450] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:20.595346] [INFO ] [MAIN ] Update Progress: 1258/2371 symbols completed. LII took 0.8s. Estimated remaining: 5m 18s. Rate: 210.2 symbols/min [2025-09-29T02:03:20.613678] [DEBUG] [LOCAL ] LHX: Loaded 49413 existing records from primary storage. [2025-09-29T02:03:20.681146] [INFO ] [MAIN ] LHX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:20.692698] [INFO ] [MAIN ] Update Progress: 1259/2371 symbols completed. LHX took 1.0s. Estimated remaining: 5m 17s. Rate: 210.3 symbols/min [2025-09-29T02:03:20.750491] [DEBUG] [LOCAL ] LITB: Loaded 4436 existing records from primary storage. [2025-09-29T02:03:20.834406] [INFO ] [MAIN ] LITB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:20.940372] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:20.901052] [INFO ] [MAIN ] Update Progress: 1260/2371 symbols completed. LITB took 0.6s. Estimated remaining: 5m 17s. Rate: 210.3 symbols/min [2025-09-29T02:03:20.946705] [DEBUG] [LOCAL ] LION: Loaded 43950 existing records from primary storage. [2025-09-29T02:03:21.003068] [INFO ] [MAIN ] LION: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:21.040128] [INFO ] [MAIN ] Update Progress: 1261/2371 symbols completed. LION took 1.1s. Estimated remaining: 5m 17s. Rate: 210.4 symbols/min [2025-09-29T02:03:21.179985] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:21.356912] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:21.461366] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:21.503357] [DEBUG] [LOCAL ] LMND: Loaded 52647 existing records from primary storage. [2025-09-29T02:03:21.520273] [INFO ] [MAIN ] LMND: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:21.520516] [INFO ] [MAIN ] Update Progress: 1262/2371 symbols completed. LMND took 0.8s. Estimated remaining: 5m 16s. Rate: 210.3 symbols/min [2025-09-29T02:03:21.538379] [DEBUG] [LOCAL ] LLY: Loaded 54064 existing records from primary storage. [2025-09-29T02:03:21.580821] [INFO ] [MAIN ] LLY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:21.592455] [INFO ] [MAIN ] Update Progress: 1263/2371 symbols completed. LLY took 1.0s. Estimated remaining: 5m 16s. Rate: 210.4 symbols/min [2025-09-29T02:03:21.817813] [DEBUG] [LOCAL ] LMT: Loaded 50608 existing records from primary storage. [2025-09-29T02:03:21.882703] [INFO ] [MAIN ] LMT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:21.901605] [DEBUG] [LOCAL ] LNC: Loaded 52369 existing records from primary storage. [2025-09-29T02:03:21.976635] [INFO ] [MAIN ] LNC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:22.008427] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:21.969862] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:21.964509] [INFO ] [MAIN ] Update Progress: 1264/2371 symbols completed. LMT took 1.0s. Estimated remaining: 5m 16s. Rate: 210.4 symbols/min [2025-09-29T02:03:22.047936] [INFO ] [MAIN ] Update Progress: 1265/2371 symbols completed. LNC took 1.0s. Estimated remaining: 5m 15s. Rate: 210.5 symbols/min [2025-09-29T02:03:22.174075] [DEBUG] [LOCAL ] LND: Loaded 5013 existing records from primary storage. [2025-09-29T02:03:22.289944] [INFO ] [MAIN ] LND: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:22.327181] [INFO ] [MAIN ] Update Progress: 1266/2371 symbols completed. LND took 0.8s. Estimated remaining: 5m 15s. Rate: 210.5 symbols/min [2025-09-29T02:03:22.326512] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:22.572597] [DEBUG] [LOCAL ] LNN: Loaded 11404 existing records from primary storage. [2025-09-29T02:03:22.591205] [DEBUG] [LOCAL ] LNG: Loaded 52224 existing records from primary storage. [2025-09-29T02:03:22.594020] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:22.615406] [INFO ] [MAIN ] LNG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:22.620913] [INFO ] [MAIN ] Update Progress: 1267/2371 symbols completed. LNG took 1.0s. Estimated remaining: 5m 15s. Rate: 210.5 symbols/min [2025-09-29T02:03:22.621069] [INFO ] [MAIN ] LNN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:22.699319] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:22.660246] [INFO ] [MAIN ] Update Progress: 1268/2371 symbols completed. LNN took 0.7s. Estimated remaining: 5m 14s. Rate: 210.6 symbols/min [2025-09-29T02:03:23.113745] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:23.109528] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:23.115289] [DEBUG] [LOCAL ] LOB: Loaded 27886 existing records from primary storage. [2025-09-29T02:03:23.117367] [DEBUG] [LOCAL ] LOAR: Loaded 42150 existing records from primary storage. [2025-09-29T02:03:23.118200] [INFO ] [MAIN ] LOAR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:23.118301] [INFO ] [MAIN ] LOB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:23.118786] [INFO ] [MAIN ] Update Progress: 1269/2371 symbols completed. LOAR took 1.0s. Estimated remaining: 5m 14s. Rate: 210.5 symbols/min [2025-09-29T02:03:23.130180] [INFO ] [MAIN ] Update Progress: 1270/2371 symbols completed. LOB took 0.8s. Estimated remaining: 5m 14s. Rate: 210.7 symbols/min [2025-09-29T02:03:23.259554] [DEBUG] [LOCAL ] LOCL: Loaded 3644 existing records from primary storage. [2025-09-29T02:03:23.302221] [INFO ] [MAIN ] LOCL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:23.368463] [INFO ] [MAIN ] Update Progress: 1271/2371 symbols completed. LOCL took 0.7s. Estimated remaining: 5m 13s. Rate: 210.7 symbols/min [2025-09-29T02:03:23.435266] [DEBUG] [LOCAL ] LOMA: Loaded 32576 existing records from primary storage. [2025-09-29T02:03:23.507302] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:23.528361] [INFO ] [MAIN ] LOMA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:23.564960] [INFO ] [MAIN ] Update Progress: 1272/2371 symbols completed. LOMA took 0.8s. Estimated remaining: 5m 13s. Rate: 210.8 symbols/min [2025-09-29T02:03:23.750454] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:23.868448] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:23.953686] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:24.011460] [DEBUG] [LOCAL ] LPL: Loaded 26305 existing records from primary storage. [2025-09-29T02:03:24.012180] [INFO ] [MAIN ] LPL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:24.012357] [INFO ] [MAIN ] Update Progress: 1273/2371 symbols completed. LPL took 0.6s. Estimated remaining: 5m 13s. Rate: 210.7 symbols/min [2025-09-29T02:03:24.152980] [DEBUG] [LOCAL ] LOW: Loaded 53721 existing records from primary storage. [2025-09-29T02:03:24.159048] [DEBUG] [LOCAL ] LPG: Loaded 40536 existing records from primary storage. [2025-09-29T02:03:24.169888] [INFO ] [MAIN ] LPG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:24.186142] [INFO ] [MAIN ] LOW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:24.186348] [INFO ] [MAIN ] Update Progress: 1274/2371 symbols completed. LOW took 1.1s. Estimated remaining: 5m 12s. Rate: 210.8 symbols/min [2025-09-29T02:03:24.187011] [INFO ] [MAIN ] Update Progress: 1275/2371 symbols completed. LPG took 1.0s. Estimated remaining: 5m 12s. Rate: 210.9 symbols/min [2025-09-29T02:03:24.215334] [DEBUG] [LOCAL ] LPX: Loaded 40311 existing records from primary storage. [2025-09-29T02:03:24.280241] [INFO ] [MAIN ] LPX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:24.426295] [INFO ] [MAIN ] Update Progress: 1276/2371 symbols completed. LPX took 0.8s. Estimated remaining: 5m 11s. Rate: 210.9 symbols/min [2025-09-29T02:03:24.421027] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:24.744236] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:24.788934] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:24.883966] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:24.910928] [DEBUG] [LOCAL ] LRN: Loaded 40503 existing records from primary storage. [2025-09-29T02:03:24.922571] [INFO ] [MAIN ] LRN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:24.922719] [INFO ] [MAIN ] Update Progress: 1277/2371 symbols completed. LRN took 0.9s. Estimated remaining: 5m 11s. Rate: 210.8 symbols/min [2025-09-29T02:03:24.935361] [DEBUG] [LOCAL ] LTC: Loaded 30478 existing records from primary storage. [2025-09-29T02:03:24.935943] [INFO ] [MAIN ] LTC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:24.936062] [INFO ] [MAIN ] Update Progress: 1278/2371 symbols completed. LTC took 0.7s. Estimated remaining: 5m 11s. Rate: 211.0 symbols/min [2025-09-29T02:03:24.961771] [DEBUG] [LOCAL ] LSPD: Loaded 43782 existing records from primary storage. [2025-09-29T02:03:24.962369] [INFO ] [MAIN ] LSPD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:24.962513] [INFO ] [MAIN ] Update Progress: 1279/2371 symbols completed. LSPD took 0.8s. Estimated remaining: 5m 10s. Rate: 211.1 symbols/min [2025-09-29T02:03:24.999581] [DEBUG] [LOCAL ] LTH: Loaded 52563 existing records from primary storage. [2025-09-29T02:03:25.000011] [INFO ] [MAIN ] LTH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:25.000143] [INFO ] [MAIN ] Update Progress: 1280/2371 symbols completed. LTH took 0.5s. Estimated remaining: 5m 10s. Rate: 211.3 symbols/min [2025-09-29T02:03:25.747440] [INFO ] [MAIN ] LUCK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:25.816807] [INFO ] [MAIN ] LTM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:25.810250] [INFO ] [MAIN ] LU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:25.816933] [DEBUG] [LOCAL ] LUCK: No existing data file found in primary storage. [2025-09-29T02:03:25.838617] [INFO ] [MAIN ] LUMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:25.840077] [WARN ] [MAIN ] LUCK: No existing data found, performing full refresh instead. [2025-09-29T02:03:25.840817] [INFO ] [MAIN ] LUCK: Wiping existing primary data before full refresh. [2025-09-29T02:03:25.841094] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-09-29T02:03:25.841420] [DEBUG] [LOCAL ] LUCK: No primary data file found to delete. [2025-09-29T02:03:25.841557] [INFO ] [MAIN ] LUCK: Starting full primary refresh. [2025-09-29T02:03:26.070511] [DEBUG] [LOCAL ] LTM: Loaded 37076 existing records from primary storage. [2025-09-29T02:03:26.115141] [INFO ] [MAIN ] LTM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:26.123549] [INFO ] [MAIN ] Update Progress: 1281/2371 symbols completed. LTM took 1.1s. Estimated remaining: 5m 10s. Rate: 210.8 symbols/min [2025-09-29T02:03:26.318858] [DEBUG] [LOCAL ] LU: Loaded 49679 existing records from primary storage. [2025-09-29T02:03:26.389269] [INFO ] [MAIN ] LU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:26.407543] [INFO ] [MAIN ] Update Progress: 1282/2371 symbols completed. LU took 1.4s. Estimated remaining: 5m 10s. Rate: 210.8 symbols/min [2025-09-29T02:03:26.407357] [DEBUG] [LOCAL ] LUMN: Loaded 54414 existing records from primary storage. [2025-09-29T02:03:26.436571] [INFO ] [MAIN ] LUMN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:26.463715] [INFO ] [MAIN ] Update Progress: 1283/2371 symbols completed. LUMN took 1.5s. Estimated remaining: 5m 10s. Rate: 210.9 symbols/min [2025-09-29T02:03:26.822772] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:03:26.862241] [INFO ] [MAIN ] LUV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:26.862673] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2024-12. [2025-09-29T02:03:27.056279] [INFO ] [MAIN ] LUXE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:27.057913] [INFO ] [MAIN ] LVS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:27.058274] [DEBUG] [LOCAL ] LUXE: No existing data file found in primary storage. [2025-09-29T02:03:27.058907] [WARN ] [MAIN ] LUXE: No existing data found, performing full refresh instead. [2025-09-29T02:03:27.059220] [INFO ] [MAIN ] LUXE: Wiping existing primary data before full refresh. [2025-09-29T02:03:27.059369] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-09-29T02:03:27.059553] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-09-29T02:03:27.059726] [INFO ] [MAIN ] LUXE: Starting full primary refresh. [2025-09-29T02:03:27.410017] [DEBUG] [LOCAL ] LUV: Loaded 54469 existing records from primary storage. [2025-09-29T02:03:27.445826] [DEBUG] [LOCAL ] LVS: Loaded 54342 existing records from primary storage. [2025-09-29T02:03:27.445992] [INFO ] [MAIN ] LUV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:27.466630] [INFO ] [MAIN ] LVS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:27.477359] [INFO ] [MAIN ] Update Progress: 1284/2371 symbols completed. LUV took 1.3s. Estimated remaining: 5m 10s. Rate: 210.5 symbols/min [2025-09-29T02:03:27.505172] [INFO ] [MAIN ] Update Progress: 1285/2371 symbols completed. LVS took 1.0s. Estimated remaining: 5m 9s. Rate: 210.6 symbols/min [2025-09-29T02:03:27.632120] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:03:27.668766] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2024-12. [2025-09-29T02:03:27.883269] [INFO ] [MAIN ] LVWR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:27.893090] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:03:27.948630] [INFO ] [MAIN ] LW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:27.950091] [WARN ] [REMOTE ] LUXE: No data returned for month 2024-12 [2025-09-29T02:03:27.950828] [FATAL] [REMOTE ] LUXE: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:03:27.949438] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-29T02:03:27.951142] [FATAL] [MAIN ] LUXE: Failed to fetch primary data. [2025-09-29T02:03:27.956306] [WARN ] [MAIN ] LUXE: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:03:27.956509] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-09-29T02:03:27.957798] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-09-29T02:03:27.957515] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-01. [2025-09-29T02:03:27.957887] [INFO ] [LOCAL ] LUXE: Starting deletion of derivative data. [2025-09-29T02:03:27.958958] [DEBUG] [LOCAL ] LUXE: No derivative data file found to delete. [2025-09-29T02:03:27.959320] [INFO ] [MAIN ] Update Progress: 1286/2371 symbols completed. LUXE took 1.6s. Estimated remaining: 5m 9s. Rate: 210.5 symbols/min [2025-09-29T02:03:28.086916] [DEBUG] [LOCAL ] LVWR: Loaded 17668 existing records from primary storage. [2025-09-29T02:03:28.087675] [INFO ] [MAIN ] LVWR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:28.088213] [INFO ] [MAIN ] Update Progress: 1287/2371 symbols completed. LVWR took 0.6s. Estimated remaining: 5m 9s. Rate: 210.6 symbols/min [2025-09-29T02:03:28.262582] [INFO ] [MAIN ] LXFR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:28.339581] [DEBUG] [LOCAL ] LW: Loaded 51915 existing records from primary storage. [2025-09-29T02:03:28.373034] [INFO ] [MAIN ] LW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:28.391365] [INFO ] [MAIN ] Update Progress: 1288/2371 symbols completed. LW took 0.8s. Estimated remaining: 5m 9s. Rate: 210.6 symbols/min [2025-09-29T02:03:28.429191] [INFO ] [MAIN ] LXP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:28.495601] [DEBUG] [LOCAL ] LXFR: Loaded 17259 existing records from primary storage. [2025-09-29T02:03:28.519885] [INFO ] [MAIN ] LXFR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:28.520275] [INFO ] [MAIN ] Update Progress: 1289/2371 symbols completed. LXFR took 0.6s. Estimated remaining: 5m 8s. Rate: 210.7 symbols/min [2025-09-29T02:03:28.730439] [INFO ] [MAIN ] LXU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:28.833233] [INFO ] [MAIN ] LYB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:28.865858] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-29T02:03:28.891023] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-09-29T02:03:28.893256] [DEBUG] [LOCAL ] LXP: Loaded 51361 existing records from primary storage. [2025-09-29T02:03:28.895026] [INFO ] [MAIN ] LXP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:28.896532] [INFO ] [MAIN ] Update Progress: 1290/2371 symbols completed. LXP took 0.8s. Estimated remaining: 5m 8s. Rate: 210.7 symbols/min [2025-09-29T02:03:28.957958] [DEBUG] [LOCAL ] LXU: Loaded 32354 existing records from primary storage. [2025-09-29T02:03:28.977262] [INFO ] [MAIN ] LXU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:28.983072] [INFO ] [MAIN ] Update Progress: 1291/2371 symbols completed. LXU took 0.6s. Estimated remaining: 5m 7s. Rate: 210.8 symbols/min [2025-09-29T02:03:29.281723] [DEBUG] [LOCAL ] LYB: Loaded 54379 existing records from primary storage. [2025-09-29T02:03:29.288073] [INFO ] [MAIN ] LYG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:29.344938] [INFO ] [MAIN ] LYV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:29.346599] [INFO ] [MAIN ] LYB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:29.346827] [INFO ] [MAIN ] Update Progress: 1292/2371 symbols completed. LYB took 0.8s. Estimated remaining: 5m 7s. Rate: 210.7 symbols/min [2025-09-29T02:03:29.583520] [INFO ] [MAIN ] LZB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:29.602050] [DEBUG] [LOCAL ] LYG: Loaded 53606 existing records from primary storage. [2025-09-29T02:03:29.602845] [INFO ] [MAIN ] LYG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:29.603318] [INFO ] [MAIN ] Update Progress: 1293/2371 symbols completed. LYG took 0.7s. Estimated remaining: 5m 7s. Rate: 210.7 symbols/min [2025-09-29T02:03:29.712552] [DEBUG] [LOCAL ] LYV: Loaded 51906 existing records from primary storage. [2025-09-29T02:03:29.739949] [INFO ] [MAIN ] LYV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:29.762436] [INFO ] [MAIN ] Update Progress: 1294/2371 symbols completed. LYV took 0.8s. Estimated remaining: 5m 7s. Rate: 210.8 symbols/min [2025-09-29T02:03:29.838026] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-29T02:03:29.872741] [INFO ] [MAIN ] LZM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:29.909000] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-09-29T02:03:29.991684] [DEBUG] [LOCAL ] LZB: Loaded 36113 existing records from primary storage. [2025-09-29T02:03:30.001436] [INFO ] [MAIN ] LZB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:30.002037] [INFO ] [MAIN ] Update Progress: 1295/2371 symbols completed. LZB took 0.7s. Estimated remaining: 5m 6s. Rate: 210.8 symbols/min [2025-09-29T02:03:30.093171] [DEBUG] [LOCAL ] LZM: Loaded 13905 existing records from primary storage. [2025-09-29T02:03:30.117165] [INFO ] [MAIN ] LZM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:30.157580] [INFO ] [MAIN ] Update Progress: 1296/2371 symbols completed. LZM took 0.6s. Estimated remaining: 5m 6s. Rate: 210.9 symbols/min [2025-09-29T02:03:30.236256] [INFO ] [MAIN ] M: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:30.385689] [INFO ] [MAIN ] MA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:30.494622] [INFO ] [MAIN ] MAA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:30.557788] [DEBUG] [LOCAL ] M: Loaded 54315 existing records from primary storage. [2025-09-29T02:03:30.560090] [INFO ] [MAIN ] M: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:30.560840] [INFO ] [MAIN ] Update Progress: 1297/2371 symbols completed. M took 0.8s. Estimated remaining: 5m 6s. Rate: 210.8 symbols/min [2025-09-29T02:03:30.589767] [DEBUG] [LOCAL ] MA: Loaded 53329 existing records from primary storage. [2025-09-29T02:03:30.623284] [INFO ] [MAIN ] MA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:30.655538] [INFO ] [MAIN ] Update Progress: 1298/2371 symbols completed. MA took 0.6s. Estimated remaining: 5m 5s. Rate: 211.0 symbols/min [2025-09-29T02:03:30.775764] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-29T02:03:30.889457] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-09-29T02:03:30.924167] [DEBUG] [LOCAL ] MAA: Loaded 43354 existing records from primary storage. [2025-09-29T02:03:30.974178] [INFO ] [MAIN ] MAA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:30.968573] [INFO ] [MAIN ] MAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:30.990743] [INFO ] [MAIN ] Update Progress: 1299/2371 symbols completed. MAA took 0.8s. Estimated remaining: 5m 5s. Rate: 210.9 symbols/min [2025-09-29T02:03:31.032209] [INFO ] [MAIN ] MAGN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:31.253075] [INFO ] [MAIN ] MAIN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:31.287432] [DEBUG] [LOCAL ] MAGN: Loaded 35466 existing records from primary storage. [2025-09-29T02:03:31.288329] [INFO ] [MAIN ] MAGN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:31.288511] [INFO ] [MAIN ] Update Progress: 1300/2371 symbols completed. MAGN took 0.6s. Estimated remaining: 5m 5s. Rate: 210.9 symbols/min [2025-09-29T02:03:31.432752] [DEBUG] [LOCAL ] MAC: Loaded 50469 existing records from primary storage. [2025-09-29T02:03:31.474846] [INFO ] [MAIN ] MAC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:31.515375] [INFO ] [MAIN ] Update Progress: 1301/2371 symbols completed. MAC took 0.9s. Estimated remaining: 5m 4s. Rate: 211.0 symbols/min [2025-09-29T02:03:31.521909] [INFO ] [MAIN ] MAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:31.640173] [DEBUG] [LOCAL ] MAIN: Loaded 41929 existing records from primary storage. [2025-09-29T02:03:31.663003] [INFO ] [MAIN ] MAIN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:31.673474] [INFO ] [MAIN ] Update Progress: 1302/2371 symbols completed. MAIN took 0.6s. Estimated remaining: 5m 4s. Rate: 211.0 symbols/min [2025-09-29T02:03:31.872639] [INFO ] [MAIN ] MANU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:31.922209] [DEBUG] [LOCAL ] MAN: Loaded 44216 existing records from primary storage. [2025-09-29T02:03:31.949807] [INFO ] [MAIN ] MAN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:31.973432] [INFO ] [MAIN ] Update Progress: 1303/2371 symbols completed. MAN took 0.7s. Estimated remaining: 5m 4s. Rate: 211.0 symbols/min [2025-09-29T02:03:32.038080] [INFO ] [MAIN ] MAS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:32.095138] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-29T02:03:32.149469] [DEBUG] [LOCAL ] MANU: Loaded 27544 existing records from primary storage. [2025-09-29T02:03:32.175174] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-09-29T02:03:32.174087] [INFO ] [MAIN ] MANU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:32.193102] [INFO ] [MAIN ] Update Progress: 1304/2371 symbols completed. MANU took 0.7s. Estimated remaining: 5m 3s. Rate: 211.1 symbols/min [2025-09-29T02:03:32.334084] [INFO ] [MAIN ] MATV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:32.509144] [INFO ] [MAIN ] MATX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:32.529387] [DEBUG] [LOCAL ] MAS: Loaded 53102 existing records from primary storage. [2025-09-29T02:03:32.530562] [INFO ] [MAIN ] MAS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:32.530753] [INFO ] [MAIN ] Update Progress: 1305/2371 symbols completed. MAS took 0.9s. Estimated remaining: 5m 3s. Rate: 211.0 symbols/min [2025-09-29T02:03:32.675334] [DEBUG] [LOCAL ] MATV: Loaded 37964 existing records from primary storage. [2025-09-29T02:03:32.697316] [INFO ] [MAIN ] MATV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:32.735089] [INFO ] [MAIN ] Update Progress: 1306/2371 symbols completed. MATV took 0.8s. Estimated remaining: 5m 3s. Rate: 211.1 symbols/min [2025-09-29T02:03:32.777481] [INFO ] [MAIN ] MAX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:32.900309] [DEBUG] [LOCAL ] MATX: Loaded 31851 existing records from primary storage. [2025-09-29T02:03:32.941617] [INFO ] [MAIN ] MATX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:32.974942] [INFO ] [MAIN ] Update Progress: 1307/2371 symbols completed. MATX took 0.7s. Estimated remaining: 5m 2s. Rate: 211.1 symbols/min [2025-09-29T02:03:33.099527] [INFO ] [MAIN ] MBC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:33.176205] [DEBUG] [LOCAL ] MAX: Loaded 31209 existing records from primary storage. [2025-09-29T02:03:33.177833] [INFO ] [MAIN ] MAX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:33.189440] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-29T02:03:33.190147] [INFO ] [MAIN ] Update Progress: 1308/2371 symbols completed. MAX took 0.7s. Estimated remaining: 5m 2s. Rate: 211.1 symbols/min [2025-09-29T02:03:33.247556] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-09-29T02:03:33.653106] [INFO ] [MAIN ] MBI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:33.661831] [DEBUG] [LOCAL ] MBC: Loaded 43803 existing records from primary storage. [2025-09-29T02:03:33.689968] [INFO ] [MAIN ] MBC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:33.702774] [INFO ] [MAIN ] Update Progress: 1309/2371 symbols completed. MBC took 0.9s. Estimated remaining: 5m 2s. Rate: 211.0 symbols/min [2025-09-29T02:03:33.802954] [INFO ] [MAIN ] MC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:33.909317] [DEBUG] [LOCAL ] MBI: Loaded 24930 existing records from primary storage. [2025-09-29T02:03:33.939204] [INFO ] [MAIN ] MBI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:33.939824] [INFO ] [MAIN ] Update Progress: 1310/2371 symbols completed. MBI took 0.9s. Estimated remaining: 5m 2s. Rate: 211.0 symbols/min [2025-09-29T02:03:34.078128] [INFO ] [MAIN ] MCB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:34.302004] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-29T02:03:34.255829] [DEBUG] [LOCAL ] MCB: Loaded 11834 existing records from primary storage. [2025-09-29T02:03:34.303080] [INFO ] [MAIN ] MCD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:34.310871] [INFO ] [MAIN ] MCB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:34.313375] [DEBUG] [LOCAL ] MC: Loaded 44878 existing records from primary storage. [2025-09-29T02:03:34.313622] [INFO ] [MAIN ] Update Progress: 1311/2371 symbols completed. MCB took 0.6s. Estimated remaining: 5m 1s. Rate: 211.0 symbols/min [2025-09-29T02:03:34.314197] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-09-29T02:03:34.319524] [DEBUG] [LOCAL ] MCD: No existing data file found in primary storage. [2025-09-29T02:03:34.326628] [INFO ] [MAIN ] MC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:34.344898] [INFO ] [MAIN ] Update Progress: 1312/2371 symbols completed. MC took 1.1s. Estimated remaining: 5m 1s. Rate: 211.1 symbols/min [2025-09-29T02:03:34.333270] [WARN ] [MAIN ] MCD: No existing data found, performing full refresh instead. [2025-09-29T02:03:34.406536] [INFO ] [MAIN ] MCD: Wiping existing primary data before full refresh. [2025-09-29T02:03:34.496961] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-09-29T02:03:34.549799] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-09-29T02:03:34.631485] [INFO ] [MAIN ] MCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:34.626983] [INFO ] [MAIN ] MCD: Starting full primary refresh. [2025-09-29T02:03:34.775268] [INFO ] [MAIN ] MCK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:34.808701] [DEBUG] [LOCAL ] MCI: Loaded 6477 existing records from primary storage. [2025-09-29T02:03:34.820135] [INFO ] [MAIN ] MCI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:34.848754] [INFO ] [MAIN ] Update Progress: 1313/2371 symbols completed. MCI took 0.5s. Estimated remaining: 5m 1s. Rate: 211.0 symbols/min [2025-09-29T02:03:35.246810] [INFO ] [MAIN ] MCN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:35.237019] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-29T02:03:35.291274] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-09-29T02:03:35.393182] [DEBUG] [LOCAL ] MCN: Loaded 8231 existing records from primary storage. [2025-09-29T02:03:35.437981] [DEBUG] [LOCAL ] MCK: Loaded 39985 existing records from primary storage. [2025-09-29T02:03:35.445909] [INFO ] [REMOTE ] MCD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:03:35.438291] [INFO ] [MAIN ] MCN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:35.446668] [INFO ] [MAIN ] Update Progress: 1314/2371 symbols completed. MCN took 0.6s. Estimated remaining: 5m 1s. Rate: 210.8 symbols/min [2025-09-29T02:03:35.447000] [INFO ] [REMOTE ] MCD: Fetching primary data for 2024-12. [2025-09-29T02:03:35.446495] [INFO ] [MAIN ] MCK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:35.453884] [INFO ] [MAIN ] Update Progress: 1315/2371 symbols completed. MCK took 1.1s. Estimated remaining: 5m 0s. Rate: 211.0 symbols/min [2025-09-29T02:03:35.799993] [INFO ] [MAIN ] MCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:35.858356] [INFO ] [MAIN ] MCR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:35.875103] [DEBUG] [LOCAL ] MCR: Loaded 8858 existing records from primary storage. [2025-09-29T02:03:35.875498] [INFO ] [MAIN ] MCR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:35.875630] [INFO ] [MAIN ] Update Progress: 1316/2371 symbols completed. MCR took 0.4s. Estimated remaining: 5m 0s. Rate: 210.9 symbols/min [2025-09-29T02:03:36.017197] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-29T02:03:36.077191] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-09-29T02:03:36.106533] [DEBUG] [LOCAL ] MCO: Loaded 40102 existing records from primary storage. [2025-09-29T02:03:36.117685] [INFO ] [MAIN ] MCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:36.117288] [INFO ] [MAIN ] MCS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:36.117917] [INFO ] [MAIN ] Update Progress: 1317/2371 symbols completed. MCO took 0.7s. Estimated remaining: 4m 60s. Rate: 210.9 symbols/min [2025-09-29T02:03:36.143182] [DEBUG] [LOCAL ] MCS: Loaded 21454 existing records from primary storage. [2025-09-29T02:03:36.143685] [INFO ] [MAIN ] MCS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:36.143829] [INFO ] [MAIN ] Update Progress: 1318/2371 symbols completed. MCS took 0.3s. Estimated remaining: 4m 59s. Rate: 211.1 symbols/min [2025-09-29T02:03:36.311113] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-29T02:03:36.322464] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-01. [2025-09-29T02:03:36.744031] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-29T02:03:36.749528] [INFO ] [REMOTE ] LUCK: Full fetch complete (40658 records). [2025-09-29T02:03:36.749709] [DEBUG] [VALIDATOR ] LUCK: Validating primary data. [2025-09-29T02:03:36.962080] [WARN ] [VALIDATOR ] LUCK: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-29T02:03:36.962731] [FATAL] [MAIN ] LUCK: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:03:36.963027] [WARN ] [MAIN ] LUCK: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:03:36.963117] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-09-29T02:03:36.963236] [DEBUG] [LOCAL ] LUCK: No primary data file found to delete. [2025-09-29T02:03:36.963403] [INFO ] [LOCAL ] LUCK: Starting deletion of derivative data. [2025-09-29T02:03:36.963592] [DEBUG] [LOCAL ] LUCK: No derivative data file found to delete. [2025-09-29T02:03:36.963862] [INFO ] [MAIN ] Update Progress: 1319/2371 symbols completed. LUCK took 12.0s. Estimated remaining: 4m 59s. Rate: 210.8 symbols/min [2025-09-29T02:03:37.133881] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-29T02:03:37.145259] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-02. [2025-09-29T02:03:37.880628] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-29T02:03:37.891455] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-03. [2025-09-29T02:03:38.282295] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-29T02:03:38.298203] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-04. [2025-09-29T02:03:39.073110] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-29T02:03:39.084954] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-05. [2025-09-29T02:03:40.066872] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-29T02:03:40.078548] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-06. [2025-09-29T02:03:40.902565] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-29T02:03:40.913913] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-07. [2025-09-29T02:03:41.759618] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-29T02:03:41.771969] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-08. [2025-09-29T02:03:42.533806] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-29T02:03:42.546306] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-09. [2025-09-29T02:03:43.356263] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-29T02:03:43.368936] [INFO ] [REMOTE ] MCD: Full fetch complete (77031 records). [2025-09-29T02:03:43.369130] [DEBUG] [VALIDATOR ] MCD: Validating primary data. [2025-09-29T02:03:43.600356] [WARN ] [VALIDATOR ] MCD: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-29T02:03:43.601323] [FATAL] [MAIN ] MCD: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:03:43.601418] [WARN ] [MAIN ] MCD: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:03:43.601522] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-09-29T02:03:43.601632] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-09-29T02:03:43.601733] [INFO ] [LOCAL ] MCD: Starting deletion of derivative data. [2025-09-29T02:03:43.601829] [DEBUG] [LOCAL ] MCD: No derivative data file found to delete. [2025-09-29T02:03:43.603034] [INFO ] [MAIN ] Update Progress: 1320/2371 symbols completed. MCD took 9.7s. Estimated remaining: 5m 4s. Rate: 207.3 symbols/min [2025-09-29T02:03:44.335635] [INFO ] [MAIN ] MDT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:44.336547] [INFO ] [MAIN ] MD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:44.338205] [INFO ] [MAIN ] MDST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:44.412695] [INFO ] [MAIN ] MCY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:44.421920] [DEBUG] [LOCAL ] MDST: Loaded 5688 existing records from primary storage. [2025-09-29T02:03:44.423067] [INFO ] [MAIN ] MDST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:44.423718] [INFO ] [MAIN ] Update Progress: 1321/2371 symbols completed. MDST took 0.8s. Estimated remaining: 5m 4s. Rate: 207.0 symbols/min [2025-09-29T02:03:44.628853] [DEBUG] [LOCAL ] MCY: Loaded 25345 existing records from primary storage. [2025-09-29T02:03:44.627968] [DEBUG] [LOCAL ] MD: Loaded 39064 existing records from primary storage. [2025-09-29T02:03:44.663876] [INFO ] [MAIN ] MD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:44.669864] [INFO ] [MAIN ] Update Progress: 1322/2371 symbols completed. MD took 1.0s. Estimated remaining: 5m 4s. Rate: 207.0 symbols/min [2025-09-29T02:03:44.669401] [INFO ] [MAIN ] MDU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:44.670094] [INFO ] [MAIN ] MCY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:44.671129] [INFO ] [MAIN ] Update Progress: 1323/2371 symbols completed. MCY took 1.1s. Estimated remaining: 5m 4s. Rate: 207.2 symbols/min [2025-09-29T02:03:44.963707] [DEBUG] [LOCAL ] MDT: Loaded 54458 existing records from primary storage. [2025-09-29T02:03:45.027755] [INFO ] [MAIN ] MDT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:45.079770] [INFO ] [MAIN ] MDV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:45.105095] [INFO ] [MAIN ] Update Progress: 1324/2371 symbols completed. MDT took 1.5s. Estimated remaining: 5m 3s. Rate: 207.1 symbols/min [2025-09-29T02:03:45.107780] [INFO ] [MAIN ] MEC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:45.211367] [DEBUG] [LOCAL ] MDV: Loaded 8733 existing records from primary storage. [2025-09-29T02:03:45.250013] [INFO ] [MAIN ] MDV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:45.268497] [INFO ] [MAIN ] Update Progress: 1325/2371 symbols completed. MDV took 0.6s. Estimated remaining: 5m 3s. Rate: 207.1 symbols/min [2025-09-29T02:03:45.257589] [DEBUG] [LOCAL ] MDU: Loaded 48643 existing records from primary storage. [2025-09-29T02:03:45.306766] [INFO ] [MAIN ] MDU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:45.338363] [INFO ] [MAIN ] Update Progress: 1326/2371 symbols completed. MDU took 0.9s. Estimated remaining: 5m 3s. Rate: 207.3 symbols/min [2025-09-29T02:03:45.485506] [INFO ] [MAIN ] MED: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:45.491548] [DEBUG] [LOCAL ] MEC: Loaded 16695 existing records from primary storage. [2025-09-29T02:03:45.532766] [INFO ] [MAIN ] MEC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:45.539050] [INFO ] [MAIN ] Update Progress: 1327/2371 symbols completed. MEC took 0.8s. Estimated remaining: 5m 2s. Rate: 207.3 symbols/min [2025-09-29T02:03:45.784522] [INFO ] [MAIN ] MEG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:45.915433] [INFO ] [MAIN ] MEGI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:45.949683] [DEBUG] [LOCAL ] MED: Loaded 22043 existing records from primary storage. [2025-09-29T02:03:45.982913] [INFO ] [MAIN ] MEI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:45.958250] [INFO ] [MAIN ] MED: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:45.984627] [INFO ] [MAIN ] Update Progress: 1328/2371 symbols completed. MED took 0.9s. Estimated remaining: 5m 2s. Rate: 207.2 symbols/min [2025-09-29T02:03:46.136294] [DEBUG] [LOCAL ] MEG: Loaded 32426 existing records from primary storage. [2025-09-29T02:03:46.212155] [DEBUG] [LOCAL ] MEGI: Loaded 20630 existing records from primary storage. [2025-09-29T02:03:46.168052] [INFO ] [MAIN ] MEG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:46.216907] [INFO ] [MAIN ] MEGI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:46.213209] [INFO ] [MAIN ] Update Progress: 1329/2371 symbols completed. MEG took 0.9s. Estimated remaining: 5m 2s. Rate: 207.3 symbols/min [2025-09-29T02:03:46.218390] [INFO ] [MAIN ] Update Progress: 1330/2371 symbols completed. MEGI took 0.9s. Estimated remaining: 5m 1s. Rate: 207.4 symbols/min [2025-09-29T02:03:46.379620] [DEBUG] [LOCAL ] MEI: Loaded 32933 existing records from primary storage. [2025-09-29T02:03:46.283698] [INFO ] [MAIN ] MET: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:46.413826] [INFO ] [MAIN ] MEI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:46.455555] [INFO ] [MAIN ] Update Progress: 1331/2371 symbols completed. MEI took 0.9s. Estimated remaining: 5m 1s. Rate: 207.4 symbols/min [2025-09-29T02:03:46.640436] [INFO ] [MAIN ] MFA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:46.791382] [INFO ] [MAIN ] MFAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:46.879222] [INFO ] [MAIN ] MFAO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:46.898963] [DEBUG] [LOCAL ] MFAN: Loaded 4331 existing records from primary storage. [2025-09-29T02:03:46.918543] [INFO ] [MAIN ] MFAN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:46.920192] [INFO ] [MAIN ] Update Progress: 1332/2371 symbols completed. MFAN took 0.6s. Estimated remaining: 5m 1s. Rate: 207.3 symbols/min [2025-09-29T02:03:46.957913] [DEBUG] [LOCAL ] MET: Loaded 54089 existing records from primary storage. [2025-09-29T02:03:47.004344] [INFO ] [MAIN ] MET: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:47.004115] [DEBUG] [LOCAL ] MFAO: Loaded 3853 existing records from primary storage. [2025-09-29T02:03:47.021721] [DEBUG] [LOCAL ] MFA: Loaded 46019 existing records from primary storage. [2025-09-29T02:03:47.042578] [INFO ] [MAIN ] Update Progress: 1333/2371 symbols completed. MET took 1.1s. Estimated remaining: 5m 0s. Rate: 207.4 symbols/min [2025-09-29T02:03:47.042921] [INFO ] [MAIN ] MFAO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:47.067478] [INFO ] [MAIN ] Update Progress: 1334/2371 symbols completed. MFAO took 0.6s. Estimated remaining: 4m 60s. Rate: 207.6 symbols/min [2025-09-29T02:03:47.067123] [INFO ] [MAIN ] MFA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:47.100629] [INFO ] [MAIN ] Update Progress: 1335/2371 symbols completed. MFA took 0.9s. Estimated remaining: 4m 59s. Rate: 207.7 symbols/min [2025-09-29T02:03:47.312171] [INFO ] [MAIN ] MFC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:47.661357] [INFO ] [MAIN ] MFG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:47.764224] [INFO ] [MAIN ] MFM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:47.802487] [INFO ] [MAIN ] MFSB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:47.804264] [DEBUG] [LOCAL ] MFSB: No existing data file found in primary storage. [2025-09-29T02:03:47.804424] [WARN ] [MAIN ] MFSB: No existing data found, performing full refresh instead. [2025-09-29T02:03:47.804548] [INFO ] [MAIN ] MFSB: Wiping existing primary data before full refresh. [2025-09-29T02:03:47.804659] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-09-29T02:03:47.804738] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-09-29T02:03:47.804817] [INFO ] [MAIN ] MFSB: Starting full primary refresh. [2025-09-29T02:03:47.936149] [DEBUG] [LOCAL ] MFC: Loaded 52000 existing records from primary storage. [2025-09-29T02:03:47.948017] [DEBUG] [LOCAL ] MFM: Loaded 14390 existing records from primary storage. [2025-09-29T02:03:47.970271] [INFO ] [MAIN ] MFM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:47.970905] [INFO ] [MAIN ] Update Progress: 1336/2371 symbols completed. MFM took 0.9s. Estimated remaining: 4m 59s. Rate: 207.4 symbols/min [2025-09-29T02:03:47.982155] [INFO ] [MAIN ] MFC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:48.044176] [INFO ] [MAIN ] Update Progress: 1337/2371 symbols completed. MFC took 1.1s. Estimated remaining: 4m 59s. Rate: 207.5 symbols/min [2025-09-29T02:03:48.399433] [DEBUG] [LOCAL ] MFG: Loaded 49748 existing records from primary storage. [2025-09-29T02:03:48.421353] [INFO ] [MAIN ] MFG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:48.475617] [INFO ] [MAIN ] Update Progress: 1338/2371 symbols completed. MFG took 1.4s. Estimated remaining: 4m 59s. Rate: 207.4 symbols/min [2025-09-29T02:03:48.665057] [INFO ] [MAIN ] MFSG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:48.726960] [INFO ] [REMOTE ] MFSB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:03:48.806715] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2024-12. [2025-09-29T02:03:48.821002] [INFO ] [MAIN ] MFSI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:48.889014] [DEBUG] [LOCAL ] MFSG: Loaded 5267 existing records from primary storage. [2025-09-29T02:03:48.900474] [INFO ] [MAIN ] MFSG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:48.908624] [INFO ] [MAIN ] Update Progress: 1339/2371 symbols completed. MFSG took 0.9s. Estimated remaining: 4m 59s. Rate: 207.4 symbols/min [2025-09-29T02:03:49.010013] [INFO ] [MAIN ] MFSV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:49.016410] [DEBUG] [LOCAL ] MFSI: Loaded 11358 existing records from primary storage. [2025-09-29T02:03:49.062446] [INFO ] [MAIN ] MFSI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:49.068249] [INFO ] [MAIN ] Update Progress: 1340/2371 symbols completed. MFSI took 1.0s. Estimated remaining: 4m 58s. Rate: 207.4 symbols/min [2025-09-29T02:03:49.092436] [DEBUG] [LOCAL ] MFSV: Loaded 2514 existing records from primary storage. [2025-09-29T02:03:49.142313] [INFO ] [MAIN ] MFSV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:49.200572] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-09-29T02:03:49.211873] [INFO ] [MAIN ] Update Progress: 1341/2371 symbols completed. MFSV took 0.6s. Estimated remaining: 4m 58s. Rate: 207.5 symbols/min [2025-09-29T02:03:49.213615] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-01. [2025-09-29T02:03:49.257167] [INFO ] [MAIN ] MG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:49.525727] [INFO ] [MAIN ] MGA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:49.542728] [DEBUG] [LOCAL ] MG: Loaded 16832 existing records from primary storage. [2025-09-29T02:03:49.559220] [INFO ] [MAIN ] MG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:49.569029] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-29T02:03:49.573767] [INFO ] [MAIN ] Update Progress: 1342/2371 symbols completed. MG took 0.6s. Estimated remaining: 4m 58s. Rate: 207.5 symbols/min [2025-09-29T02:03:49.599897] [INFO ] [MAIN ] MGF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:49.601184] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-02. [2025-09-29T02:03:49.719193] [DEBUG] [LOCAL ] MGF: Loaded 4186 existing records from primary storage. [2025-09-29T02:03:49.723193] [INFO ] [MAIN ] MGF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:49.723314] [INFO ] [MAIN ] Update Progress: 1343/2371 symbols completed. MGF took 0.5s. Estimated remaining: 4m 57s. Rate: 207.6 symbols/min [2025-09-29T02:03:49.836959] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-09-29T02:03:49.901608] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-03. [2025-09-29T02:03:49.926765] [INFO ] [MAIN ] MGM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:49.960453] [DEBUG] [LOCAL ] MGA: Loaded 51414 existing records from primary storage. [2025-09-29T02:03:49.961519] [INFO ] [MAIN ] MGA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:49.972553] [INFO ] [MAIN ] Update Progress: 1344/2371 symbols completed. MGA took 0.9s. Estimated remaining: 4m 57s. Rate: 207.6 symbols/min [2025-09-29T02:03:50.121887] [INFO ] [MAIN ] MGR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:50.164344] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-09-29T02:03:50.165440] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-04. [2025-09-29T02:03:50.263238] [INFO ] [MAIN ] MGRB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:50.268369] [DEBUG] [LOCAL ] MGR: Loaded 5675 existing records from primary storage. [2025-09-29T02:03:50.272873] [DEBUG] [LOCAL ] MGRB: Loaded 4102 existing records from primary storage. [2025-09-29T02:03:50.274896] [INFO ] [MAIN ] MGR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:50.290826] [INFO ] [MAIN ] MGRB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:50.291503] [INFO ] [MAIN ] Update Progress: 1345/2371 symbols completed. MGR took 0.6s. Estimated remaining: 4m 57s. Rate: 207.6 symbols/min [2025-09-29T02:03:50.293211] [DEBUG] [LOCAL ] MGM: Loaded 54388 existing records from primary storage. [2025-09-29T02:03:50.293424] [INFO ] [MAIN ] Update Progress: 1346/2371 symbols completed. MGRB took 0.3s. Estimated remaining: 4m 56s. Rate: 207.7 symbols/min [2025-09-29T02:03:50.310460] [INFO ] [MAIN ] MGM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:50.328482] [INFO ] [MAIN ] Update Progress: 1347/2371 symbols completed. MGM took 0.7s. Estimated remaining: 4m 56s. Rate: 207.8 symbols/min [2025-09-29T02:03:50.485989] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-09-29T02:03:50.570295] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-05. [2025-09-29T02:03:50.776601] [INFO ] [MAIN ] MGRD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:50.841026] [INFO ] [MAIN ] MGRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:50.924751] [INFO ] [MAIN ] MGY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:50.930147] [DEBUG] [LOCAL ] MGRD: Loaded 2231 existing records from primary storage. [2025-09-29T02:03:50.931003] [INFO ] [MAIN ] MGRD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:50.931130] [INFO ] [MAIN ] Update Progress: 1348/2371 symbols completed. MGRD took 0.6s. Estimated remaining: 4m 56s. Rate: 207.7 symbols/min [2025-09-29T02:03:50.958149] [DEBUG] [LOCAL ] MGRE: Loaded 6684 existing records from primary storage. [2025-09-29T02:03:51.000403] [INFO ] [MAIN ] MGRE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:51.027753] [INFO ] [MAIN ] Update Progress: 1349/2371 symbols completed. MGRE took 0.7s. Estimated remaining: 4m 55s. Rate: 207.8 symbols/min [2025-09-29T02:03:51.011189] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-29T02:03:51.061693] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-06. [2025-09-29T02:03:51.285662] [INFO ] [MAIN ] MH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:51.297435] [DEBUG] [LOCAL ] MH: No existing data file found in primary storage. [2025-09-29T02:03:51.336351] [WARN ] [MAIN ] MH: No existing data found, performing full refresh instead. [2025-09-29T02:03:51.387629] [INFO ] [MAIN ] MHD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:51.387984] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-29T02:03:51.388289] [INFO ] [MAIN ] MH: Wiping existing primary data before full refresh. [2025-09-29T02:03:51.389412] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-09-29T02:03:51.392919] [DEBUG] [LOCAL ] MGY: Loaded 53195 existing records from primary storage. [2025-09-29T02:03:51.389596] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-09-29T02:03:51.390996] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-07. [2025-09-29T02:03:51.394089] [INFO ] [MAIN ] MGY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:51.395491] [INFO ] [MAIN ] MH: Starting full primary refresh. [2025-09-29T02:03:51.395624] [INFO ] [MAIN ] Update Progress: 1350/2371 symbols completed. MGY took 1.1s. Estimated remaining: 4m 55s. Rate: 207.7 symbols/min [2025-09-29T02:03:51.610170] [DEBUG] [LOCAL ] MHD: Loaded 12297 existing records from primary storage. [2025-09-29T02:03:51.648475] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-09-29T02:03:51.681897] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-08. [2025-09-29T02:03:51.664802] [INFO ] [MAIN ] MHD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:51.688782] [INFO ] [MAIN ] Update Progress: 1351/2371 symbols completed. MHD took 0.6s. Estimated remaining: 4m 55s. Rate: 207.7 symbols/min [2025-09-29T02:03:51.790621] [INFO ] [MAIN ] MHF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:52.032869] [DEBUG] [LOCAL ] MHF: Loaded 8713 existing records from primary storage. [2025-09-29T02:03:52.057785] [INFO ] [MAIN ] MHF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:52.074102] [INFO ] [MAIN ] Update Progress: 1352/2371 symbols completed. MHF took 0.7s. Estimated remaining: 4m 54s. Rate: 207.7 symbols/min [2025-09-29T02:03:52.165776] [INFO ] [MAIN ] MHK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:52.214488] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-29T02:03:52.274014] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-09. [2025-09-29T02:03:52.310197] [INFO ] [REMOTE ] MH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:03:52.332783] [INFO ] [REMOTE ] MH: Fetching primary data for 2024-12. [2025-09-29T02:03:52.439588] [INFO ] [MAIN ] MHLA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:52.450462] [DEBUG] [LOCAL ] MHLA: No existing data file found in primary storage. [2025-09-29T02:03:52.450574] [WARN ] [MAIN ] MHLA: No existing data found, performing full refresh instead. [2025-09-29T02:03:52.450746] [INFO ] [MAIN ] MHLA: Wiping existing primary data before full refresh. [2025-09-29T02:03:52.450824] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-09-29T02:03:52.450955] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-09-29T02:03:52.451025] [INFO ] [MAIN ] MHLA: Starting full primary refresh. [2025-09-29T02:03:52.498626] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:03:52.538250] [WARN ] [REMOTE ] MH: No data returned for month 2024-12 [2025-09-29T02:03:52.571624] [FATAL] [REMOTE ] MH: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:03:52.584848] [FATAL] [MAIN ] MH: Failed to fetch primary data. [2025-09-29T02:03:52.610841] [WARN ] [MAIN ] MH: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:03:52.617504] [DEBUG] [LOCAL ] MHK: Loaded 43076 existing records from primary storage. [2025-09-29T02:03:52.610981] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-09-29T02:03:52.642560] [INFO ] [MAIN ] MHK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:52.655820] [INFO ] [MAIN ] Update Progress: 1353/2371 symbols completed. MHK took 0.9s. Estimated remaining: 4m 54s. Rate: 207.5 symbols/min [2025-09-29T02:03:52.653994] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-09-29T02:03:52.692118] [INFO ] [LOCAL ] MH: Starting deletion of derivative data. [2025-09-29T02:03:52.778059] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-29T02:03:52.772586] [DEBUG] [LOCAL ] MH: No derivative data file found to delete. [2025-09-29T02:03:52.815384] [INFO ] [MAIN ] Update Progress: 1354/2371 symbols completed. MH took 1.9s. Estimated remaining: 4m 54s. Rate: 207.6 symbols/min [2025-09-29T02:03:52.827275] [INFO ] [REMOTE ] MFSB: Full fetch complete (1610 records). [2025-09-29T02:03:52.895197] [DEBUG] [VALIDATOR ] MFSB: Validating primary data. [2025-09-29T02:03:53.308752] [INFO ] [MAIN ] MHN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:53.351046] [INFO ] [REMOTE ] MHLA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:03:53.351617] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2024-12. [2025-09-29T02:03:53.519210] [WARN ] [VALIDATOR ] MFSB: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-09-29T02:03:53.527800] [DEBUG] [LOCAL ] MHN: Loaded 7867 existing records from primary storage. [2025-09-29T02:03:53.549280] [INFO ] [MAIN ] MHN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:53.549504] [FATAL] [MAIN ] MFSB: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:03:53.549717] [INFO ] [MAIN ] Update Progress: 1355/2371 symbols completed. MHN took 0.8s. Estimated remaining: 4m 54s. Rate: 207.4 symbols/min [2025-09-29T02:03:53.548790] [INFO ] [MAIN ] MHO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:53.550815] [WARN ] [MAIN ] MFSB: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:03:53.550940] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-09-29T02:03:53.556508] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-09-29T02:03:53.575240] [INFO ] [LOCAL ] MFSB: Starting deletion of derivative data. [2025-09-29T02:03:53.602320] [DEBUG] [LOCAL ] MFSB: No derivative data file found to delete. [2025-09-29T02:03:53.608786] [INFO ] [MAIN ] Update Progress: 1356/2371 symbols completed. MFSB took 6.5s. Estimated remaining: 4m 54s. Rate: 207.5 symbols/min [2025-09-29T02:03:53.756279] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-29T02:03:53.800960] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-01. [2025-09-29T02:03:53.830285] [DEBUG] [LOCAL ] MHO: Loaded 24650 existing records from primary storage. [2025-09-29T02:03:53.902738] [INFO ] [MAIN ] MHO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:53.907382] [INFO ] [MAIN ] MIAX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:53.957491] [INFO ] [MAIN ] Update Progress: 1357/2371 symbols completed. MHO took 1.1s. Estimated remaining: 4m 53s. Rate: 207.5 symbols/min [2025-09-29T02:03:53.965313] [DEBUG] [LOCAL ] MIAX: No existing data file found in primary storage. [2025-09-29T02:03:53.989841] [INFO ] [MAIN ] MIN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:53.990708] [WARN ] [MAIN ] MIAX: No existing data found, performing full refresh instead. [2025-09-29T02:03:53.991307] [INFO ] [MAIN ] MIAX: Wiping existing primary data before full refresh. [2025-09-29T02:03:53.991391] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-09-29T02:03:53.991483] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-09-29T02:03:53.991557] [INFO ] [MAIN ] MIAX: Starting full primary refresh. [2025-09-29T02:03:54.099878] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-09-29T02:03:54.126071] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-02. [2025-09-29T02:03:54.147241] [DEBUG] [LOCAL ] MIN: Loaded 13224 existing records from primary storage. [2025-09-29T02:03:54.187220] [INFO ] [MAIN ] MIN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:54.225718] [INFO ] [MAIN ] Update Progress: 1358/2371 symbols completed. MIN took 0.6s. Estimated remaining: 4m 53s. Rate: 207.5 symbols/min [2025-09-29T02:03:54.429024] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-29T02:03:54.442213] [INFO ] [REMOTE ] MIAX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:03:54.442586] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2024-12. [2025-09-29T02:03:54.443546] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-03. [2025-09-29T02:03:54.637243] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-03 (0.19 seconds). [2025-09-29T02:03:54.638458] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-04. [2025-09-29T02:03:54.639080] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:03:54.640044] [WARN ] [REMOTE ] MIAX: No data returned for month 2024-12 [2025-09-29T02:03:54.640135] [FATAL] [REMOTE ] MIAX: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:03:54.640211] [FATAL] [MAIN ] MIAX: Failed to fetch primary data. [2025-09-29T02:03:54.640279] [WARN ] [MAIN ] MIAX: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:03:54.640355] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-09-29T02:03:54.640444] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-09-29T02:03:54.640517] [INFO ] [LOCAL ] MIAX: Starting deletion of derivative data. [2025-09-29T02:03:54.640606] [DEBUG] [LOCAL ] MIAX: No derivative data file found to delete. [2025-09-29T02:03:54.640748] [INFO ] [MAIN ] Update Progress: 1359/2371 symbols completed. MIAX took 1.1s. Estimated remaining: 4m 53s. Rate: 207.4 symbols/min [2025-09-29T02:03:54.919729] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-09-29T02:03:54.920967] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-05. [2025-09-29T02:03:55.269493] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-29T02:03:55.271254] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-06. [2025-09-29T02:03:55.470304] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-06 (0.20 seconds). [2025-09-29T02:03:55.471579] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-07. [2025-09-29T02:03:55.602073] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-07 (0.13 seconds). [2025-09-29T02:03:55.603070] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-08. [2025-09-29T02:03:55.736766] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-08 (0.13 seconds). [2025-09-29T02:03:55.738106] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-09. [2025-09-29T02:03:55.937326] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-09 (0.20 seconds). [2025-09-29T02:03:55.938207] [INFO ] [REMOTE ] MHLA: Full fetch complete (1547 records). [2025-09-29T02:03:55.938303] [DEBUG] [VALIDATOR ] MHLA: Validating primary data. [2025-09-29T02:03:56.125082] [WARN ] [VALIDATOR ] MHLA: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-29T02:03:56.125298] [FATAL] [MAIN ] MHLA: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:03:56.125379] [WARN ] [MAIN ] MHLA: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:03:56.125458] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-09-29T02:03:56.125553] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-09-29T02:03:56.125634] [INFO ] [LOCAL ] MHLA: Starting deletion of derivative data. [2025-09-29T02:03:56.125753] [DEBUG] [LOCAL ] MHLA: No derivative data file found to delete. [2025-09-29T02:03:56.125849] [INFO ] [MAIN ] Update Progress: 1360/2371 symbols completed. MHLA took 4.0s. Estimated remaining: 4m 53s. Rate: 206.8 symbols/min [2025-09-29T02:03:56.790255] [INFO ] [MAIN ] MITT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:56.793712] [INFO ] [MAIN ] MITN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:56.845114] [INFO ] [MAIN ] MIR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:56.884566] [DEBUG] [LOCAL ] MITN: No existing data file found in primary storage. [2025-09-29T02:03:56.908942] [WARN ] [MAIN ] MITN: No existing data found, performing full refresh instead. [2025-09-29T02:03:56.908572] [INFO ] [MAIN ] MITP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:56.909505] [INFO ] [MAIN ] MITN: Wiping existing primary data before full refresh. [2025-09-29T02:03:56.910109] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-09-29T02:03:56.910208] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-09-29T02:03:56.910282] [INFO ] [MAIN ] MITN: Starting full primary refresh. [2025-09-29T02:03:56.969035] [DEBUG] [LOCAL ] MITP: Loaded 2467 existing records from primary storage. [2025-09-29T02:03:56.980565] [INFO ] [MAIN ] MITP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:57.033252] [INFO ] [MAIN ] Update Progress: 1361/2371 symbols completed. MITP took 0.9s. Estimated remaining: 4m 54s. Rate: 206.4 symbols/min [2025-09-29T02:03:57.048535] [DEBUG] [LOCAL ] MITT: Loaded 23379 existing records from primary storage. [2025-09-29T02:03:57.086280] [INFO ] [MAIN ] MITT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:57.159245] [INFO ] [MAIN ] Update Progress: 1362/2371 symbols completed. MITT took 1.0s. Estimated remaining: 4m 53s. Rate: 206.5 symbols/min [2025-09-29T02:03:57.462743] [DEBUG] [LOCAL ] MIR: Loaded 51622 existing records from primary storage. [2025-09-29T02:03:57.575051] [INFO ] [MAIN ] MIR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:57.605517] [INFO ] [MAIN ] Update Progress: 1363/2371 symbols completed. MIR took 1.5s. Estimated remaining: 4m 53s. Rate: 206.5 symbols/min [2025-09-29T02:03:57.695521] [INFO ] [MAIN ] MIY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:57.820012] [INFO ] [MAIN ] MKC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:57.931545] [DEBUG] [LOCAL ] MIY: Loaded 6084 existing records from primary storage. [2025-09-29T02:03:57.937991] [INFO ] [MAIN ] MIY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:57.938145] [INFO ] [MAIN ] Update Progress: 1364/2371 symbols completed. MIY took 0.9s. Estimated remaining: 4m 53s. Rate: 206.4 symbols/min [2025-09-29T02:03:57.912805] [INFO ] [REMOTE ] MITN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:03:57.967355] [INFO ] [REMOTE ] MITN: Fetching primary data for 2024-12. [2025-09-29T02:03:58.121470] [INFO ] [MAIN ] MKL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:58.269601] [INFO ] [MAIN ] MLI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:58.270577] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2024-12 (0.30 seconds). [2025-09-29T02:03:58.273613] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-01. [2025-09-29T02:03:58.294380] [DEBUG] [LOCAL ] MKC: Loaded 53204 existing records from primary storage. [2025-09-29T02:03:58.305002] [INFO ] [MAIN ] MKC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:58.305633] [INFO ] [MAIN ] Update Progress: 1365/2371 symbols completed. MKC took 1.1s. Estimated remaining: 4m 52s. Rate: 206.4 symbols/min [2025-09-29T02:03:58.454829] [DEBUG] [LOCAL ] MKL: Loaded 34588 existing records from primary storage. [2025-09-29T02:03:58.455847] [INFO ] [MAIN ] MKL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:58.467111] [INFO ] [MAIN ] Update Progress: 1366/2371 symbols completed. MKL took 0.8s. Estimated remaining: 4m 52s. Rate: 206.5 symbols/min [2025-09-29T02:03:58.569660] [INFO ] [MAIN ] MLM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:58.576116] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-09-29T02:03:58.589172] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-02. [2025-09-29T02:03:58.678675] [DEBUG] [LOCAL ] MLI: Loaded 44447 existing records from primary storage. [2025-09-29T02:03:58.680618] [INFO ] [MAIN ] MLI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:58.709265] [INFO ] [MAIN ] Update Progress: 1367/2371 symbols completed. MLI took 0.8s. Estimated remaining: 4m 52s. Rate: 206.5 symbols/min [2025-09-29T02:03:58.825506] [INFO ] [MAIN ] MLNK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:58.958787] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-29T02:03:58.959992] [DEBUG] [LOCAL ] MLM: Loaded 31068 existing records from primary storage. [2025-09-29T02:03:58.988035] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-03. [2025-09-29T02:03:59.000772] [INFO ] [MAIN ] MLP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:59.002352] [INFO ] [MAIN ] MLM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:59.002933] [INFO ] [MAIN ] Update Progress: 1368/2371 symbols completed. MLM took 0.7s. Estimated remaining: 4m 51s. Rate: 206.5 symbols/min [2025-09-29T02:03:59.086283] [DEBUG] [LOCAL ] MLNK: Loaded 25921 existing records from primary storage. [2025-09-29T02:03:59.101500] [INFO ] [MAIN ] MLNK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:59.101678] [INFO ] [MAIN ] Update Progress: 1369/2371 symbols completed. MLNK took 0.6s. Estimated remaining: 4m 51s. Rate: 206.6 symbols/min [2025-09-29T02:03:59.154045] [DEBUG] [LOCAL ] MLP: Loaded 3120 existing records from primary storage. [2025-09-29T02:03:59.189217] [INFO ] [MAIN ] MLP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:59.228564] [INFO ] [MAIN ] Update Progress: 1370/2371 symbols completed. MLP took 0.5s. Estimated remaining: 4m 51s. Rate: 206.7 symbols/min [2025-09-29T02:03:59.333527] [INFO ] [MAIN ] MLR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:59.500273] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-29T02:03:59.544803] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-04. [2025-09-29T02:03:59.550735] [DEBUG] [LOCAL ] MLR: Loaded 12982 existing records from primary storage. [2025-09-29T02:03:59.561673] [INFO ] [MAIN ] MMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:59.609681] [INFO ] [MAIN ] MLR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:59.618244] [INFO ] [MAIN ] Update Progress: 1371/2371 symbols completed. MLR took 0.6s. Estimated remaining: 4m 50s. Rate: 206.6 symbols/min [2025-09-29T02:03:59.676616] [INFO ] [MAIN ] MMD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:59.828447] [DEBUG] [LOCAL ] MMD: Loaded 11435 existing records from primary storage. [2025-09-29T02:03:59.850889] [INFO ] [MAIN ] MMD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:03:59.870512] [INFO ] [MAIN ] MMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:03:59.871129] [INFO ] [MAIN ] Update Progress: 1372/2371 symbols completed. MMD took 0.6s. Estimated remaining: 4m 50s. Rate: 206.6 symbols/min [2025-09-29T02:04:00.015055] [DEBUG] [LOCAL ] MMC: Loaded 52551 existing records from primary storage. [2025-09-29T02:04:00.027963] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-29T02:04:00.049979] [DEBUG] [LOCAL ] MMI: Loaded 15452 existing records from primary storage. [2025-09-29T02:04:00.033850] [INFO ] [MAIN ] MMC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:00.075888] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-05. [2025-09-29T02:04:00.073885] [INFO ] [MAIN ] MMI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:00.083681] [INFO ] [MAIN ] Update Progress: 1373/2371 symbols completed. MMC took 1.0s. Estimated remaining: 4m 50s. Rate: 206.7 symbols/min [2025-09-29T02:04:00.108618] [INFO ] [MAIN ] MMID: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:00.114149] [INFO ] [MAIN ] Update Progress: 1374/2371 symbols completed. MMI took 0.5s. Estimated remaining: 4m 49s. Rate: 206.8 symbols/min [2025-09-29T02:04:00.141232] [DEBUG] [LOCAL ] MMID: No existing data file found in primary storage. [2025-09-29T02:04:00.169426] [WARN ] [MAIN ] MMID: No existing data found, performing full refresh instead. [2025-09-29T02:04:00.224397] [INFO ] [MAIN ] MMID: Wiping existing primary data before full refresh. [2025-09-29T02:04:00.301723] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-09-29T02:04:00.326544] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-09-29T02:04:00.351517] [INFO ] [MAIN ] MMID: Starting full primary refresh. [2025-09-29T02:04:00.522885] [INFO ] [MAIN ] MMKT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:00.545587] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-29T02:04:00.571404] [INFO ] [MAIN ] MMM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:00.593676] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-06. [2025-09-29T02:04:00.571637] [DEBUG] [LOCAL ] MMKT: No existing data file found in primary storage. [2025-09-29T02:04:00.615271] [WARN ] [MAIN ] MMKT: No existing data found, performing full refresh instead. [2025-09-29T02:04:00.633496] [INFO ] [MAIN ] MMKT: Wiping existing primary data before full refresh. [2025-09-29T02:04:00.654872] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-09-29T02:04:00.677179] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-09-29T02:04:00.677349] [INFO ] [MAIN ] MMKT: Starting full primary refresh. [2025-09-29T02:04:00.876114] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-09-29T02:04:00.944249] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-07. [2025-09-29T02:04:01.156091] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-07 (0.21 seconds). [2025-09-29T02:04:01.224364] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-08. [2025-09-29T02:04:01.246914] [INFO ] [REMOTE ] MMID: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:04:01.272298] [DEBUG] [LOCAL ] MMM: Loaded 53995 existing records from primary storage. [2025-09-29T02:04:01.283579] [INFO ] [REMOTE ] MMID: Fetching primary data for 2024-12. [2025-09-29T02:04:01.305414] [INFO ] [MAIN ] MMM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:01.330399] [INFO ] [MAIN ] Update Progress: 1375/2371 symbols completed. MMM took 1.2s. Estimated remaining: 4m 50s. Rate: 206.3 symbols/min [2025-09-29T02:04:01.517960] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-09-29T02:04:01.518226] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:04:01.531834] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-09. [2025-09-29T02:04:01.548085] [WARN ] [REMOTE ] MMID: No data returned for month 2024-12 [2025-09-29T02:04:01.557827] [FATAL] [REMOTE ] MMID: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:04:01.568793] [INFO ] [REMOTE ] MMKT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:04:01.558024] [FATAL] [MAIN ] MMID: Failed to fetch primary data. [2025-09-29T02:04:01.590368] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2024-12. [2025-09-29T02:04:01.618957] [WARN ] [MAIN ] MMID: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:04:01.644794] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-09-29T02:04:01.663259] [INFO ] [MAIN ] MMS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:01.663615] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-09-29T02:04:01.663926] [INFO ] [LOCAL ] MMID: Starting deletion of derivative data. [2025-09-29T02:04:01.664343] [DEBUG] [LOCAL ] MMID: No derivative data file found to delete. [2025-09-29T02:04:01.664458] [INFO ] [MAIN ] Update Progress: 1376/2371 symbols completed. MMID took 1.8s. Estimated remaining: 4m 49s. Rate: 206.3 symbols/min [2025-09-29T02:04:01.800910] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-09-29T02:04:01.820163] [INFO ] [REMOTE ] MITN: Full fetch complete (2309 records). [2025-09-29T02:04:01.820772] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2024-12 (0.23 seconds). [2025-09-29T02:04:01.826958] [DEBUG] [VALIDATOR ] MITN: Validating primary data. [2025-09-29T02:04:01.878202] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-01. [2025-09-29T02:04:01.933140] [INFO ] [MAIN ] MMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:01.986691] [DEBUG] [LOCAL ] MMS: Loaded 34398 existing records from primary storage. [2025-09-29T02:04:02.021889] [INFO ] [MAIN ] MMS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:02.054486] [INFO ] [MAIN ] Update Progress: 1377/2371 symbols completed. MMS took 0.7s. Estimated remaining: 4m 49s. Rate: 206.3 symbols/min [2025-09-29T02:04:02.141168] [DEBUG] [LOCAL ] MMT: Loaded 10987 existing records from primary storage. [2025-09-29T02:04:02.160943] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-01 (0.28 seconds). [2025-09-29T02:04:02.178002] [INFO ] [MAIN ] MMT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:02.200698] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-02. [2025-09-29T02:04:02.231352] [INFO ] [MAIN ] Update Progress: 1378/2371 symbols completed. MMT took 0.6s. Estimated remaining: 4m 49s. Rate: 206.3 symbols/min [2025-09-29T02:04:02.292512] [WARN ] [VALIDATOR ] MITN: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-29T02:04:02.328749] [FATAL] [MAIN ] MITN: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:04:02.346108] [WARN ] [MAIN ] MITN: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:04:02.380603] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-09-29T02:04:02.434329] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-09-29T02:04:02.481635] [INFO ] [LOCAL ] MITN: Starting deletion of derivative data. [2025-09-29T02:04:02.542628] [DEBUG] [LOCAL ] MITN: No derivative data file found to delete. [2025-09-29T02:04:02.573799] [INFO ] [MAIN ] MNR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:02.597991] [INFO ] [MAIN ] MMU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:02.577217] [INFO ] [MAIN ] Update Progress: 1379/2371 symbols completed. MITN took 6.5s. Estimated remaining: 4m 49s. Rate: 206.3 symbols/min [2025-09-29T02:04:02.602473] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-29T02:04:02.617872] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-03. [2025-09-29T02:04:02.756987] [DEBUG] [LOCAL ] MMU: Loaded 17156 existing records from primary storage. [2025-09-29T02:04:02.800225] [INFO ] [MAIN ] MMU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:02.810723] [INFO ] [MAIN ] Update Progress: 1380/2371 symbols completed. MMU took 0.8s. Estimated remaining: 4m 48s. Rate: 206.3 symbols/min [2025-09-29T02:04:02.853053] [INFO ] [MAIN ] MNSO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:02.901036] [DEBUG] [LOCAL ] MNR: Loaded 24918 existing records from primary storage. [2025-09-29T02:04:02.920338] [INFO ] [MAIN ] MNR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:02.940828] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-29T02:04:02.959251] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-04. [2025-09-29T02:04:02.946216] [INFO ] [MAIN ] Update Progress: 1381/2371 symbols completed. MNR took 0.7s. Estimated remaining: 4m 48s. Rate: 206.4 symbols/min [2025-09-29T02:04:03.205678] [INFO ] [MAIN ] MNTN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:03.261815] [INFO ] [MAIN ] MO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:03.263608] [DEBUG] [LOCAL ] MO: No existing data file found in primary storage. [2025-09-29T02:04:03.261997] [DEBUG] [LOCAL ] MNTN: No existing data file found in primary storage. [2025-09-29T02:04:03.278474] [WARN ] [MAIN ] MNTN: No existing data found, performing full refresh instead. [2025-09-29T02:04:03.278595] [WARN ] [MAIN ] MO: No existing data found, performing full refresh instead. [2025-09-29T02:04:03.278920] [INFO ] [MAIN ] MNTN: Wiping existing primary data before full refresh. [2025-09-29T02:04:03.279112] [INFO ] [MAIN ] MO: Wiping existing primary data before full refresh. [2025-09-29T02:04:03.279238] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-09-29T02:04:03.279329] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-09-29T02:04:03.279503] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-09-29T02:04:03.280782] [DEBUG] [LOCAL ] MNSO: Loaded 45049 existing records from primary storage. [2025-09-29T02:04:03.280970] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-09-29T02:04:03.279680] [INFO ] [MAIN ] MO: Starting full primary refresh. [2025-09-29T02:04:03.281350] [INFO ] [MAIN ] MNSO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:03.281464] [INFO ] [MAIN ] MNTN: Starting full primary refresh. [2025-09-29T02:04:03.283969] [INFO ] [MAIN ] Update Progress: 1382/2371 symbols completed. MNSO took 0.7s. Estimated remaining: 4m 48s. Rate: 206.4 symbols/min [2025-09-29T02:04:03.511169] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-29T02:04:03.633164] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-05. [2025-09-29T02:04:03.917391] [INFO ] [MAIN ] MOD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:04.041221] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-29T02:04:04.113206] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-06. [2025-09-29T02:04:04.289596] [INFO ] [REMOTE ] MO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:04:04.299145] [INFO ] [REMOTE ] MO: Fetching primary data for 2024-12. [2025-09-29T02:04:04.342847] [INFO ] [REMOTE ] MNTN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:04:04.343972] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2024-12. [2025-09-29T02:04:04.362560] [DEBUG] [LOCAL ] MOD: Loaded 46169 existing records from primary storage. [2025-09-29T02:04:04.362968] [INFO ] [MAIN ] MOD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:04.363074] [INFO ] [MAIN ] Update Progress: 1383/2371 symbols completed. MOD took 1.0s. Estimated remaining: 4m 48s. Rate: 206.0 symbols/min [2025-09-29T02:04:04.482042] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-29T02:04:04.483593] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-07. [2025-09-29T02:04:04.534739] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:04:04.564608] [INFO ] [MAIN ] MODG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:04.565569] [WARN ] [REMOTE ] MNTN: No data returned for month 2024-12 [2025-09-29T02:04:04.565782] [FATAL] [REMOTE ] MNTN: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:04:04.566186] [FATAL] [MAIN ] MNTN: Failed to fetch primary data. [2025-09-29T02:04:04.566267] [WARN ] [MAIN ] MNTN: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:04:04.566350] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-09-29T02:04:04.566454] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-09-29T02:04:04.566530] [INFO ] [LOCAL ] MNTN: Starting deletion of derivative data. [2025-09-29T02:04:04.566636] [DEBUG] [LOCAL ] MNTN: No derivative data file found to delete. [2025-09-29T02:04:04.566757] [INFO ] [MAIN ] Update Progress: 1384/2371 symbols completed. MNTN took 1.7s. Estimated remaining: 4m 47s. Rate: 206.0 symbols/min [2025-09-29T02:04:04.778852] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-09-29T02:04:04.804246] [INFO ] [MAIN ] MOH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:04.806283] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-08. [2025-09-29T02:04:04.831420] [DEBUG] [LOCAL ] MODG: Loaded 52353 existing records from primary storage. [2025-09-29T02:04:04.831972] [INFO ] [MAIN ] MODG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:04.832081] [INFO ] [MAIN ] Update Progress: 1385/2371 symbols completed. MODG took 0.5s. Estimated remaining: 4m 47s. Rate: 206.0 symbols/min [2025-09-29T02:04:05.038493] [INFO ] [MAIN ] MOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:05.052972] [DEBUG] [LOCAL ] MOH: Loaded 42444 existing records from primary storage. [2025-09-29T02:04:05.056103] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-09-29T02:04:05.058616] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-09. [2025-09-29T02:04:05.056735] [INFO ] [MAIN ] MOH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:05.059968] [INFO ] [MAIN ] Update Progress: 1386/2371 symbols completed. MOH took 0.5s. Estimated remaining: 4m 47s. Rate: 206.1 symbols/min [2025-09-29T02:04:05.275571] [INFO ] [MAIN ] MOV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:05.299151] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-09-29T02:04:05.300977] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-29T02:04:05.303786] [INFO ] [REMOTE ] MMKT: Full fetch complete (2099 records). [2025-09-29T02:04:05.316558] [DEBUG] [VALIDATOR ] MMKT: Validating primary data. [2025-09-29T02:04:05.317276] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-01. [2025-09-29T02:04:05.387498] [DEBUG] [LOCAL ] MOS: Loaded 54284 existing records from primary storage. [2025-09-29T02:04:05.421348] [INFO ] [MAIN ] MOS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:05.422500] [INFO ] [MAIN ] Update Progress: 1387/2371 symbols completed. MOS took 0.6s. Estimated remaining: 4m 47s. Rate: 206.0 symbols/min [2025-09-29T02:04:05.574452] [DEBUG] [LOCAL ] MOV: Loaded 22417 existing records from primary storage. [2025-09-29T02:04:05.661344] [INFO ] [MAIN ] MOV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:05.668680] [WARN ] [VALIDATOR ] MMKT: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-29T02:04:05.674525] [FATAL] [MAIN ] MMKT: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:04:05.685012] [INFO ] [MAIN ] Update Progress: 1388/2371 symbols completed. MOV took 0.6s. Estimated remaining: 4m 46s. Rate: 206.0 symbols/min [2025-09-29T02:04:05.679770] [WARN ] [MAIN ] MMKT: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:04:05.695886] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-09-29T02:04:05.723733] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-09-29T02:04:05.753265] [INFO ] [LOCAL ] MMKT: Starting deletion of derivative data. [2025-09-29T02:04:05.761923] [INFO ] [MAIN ] MP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:05.794828] [DEBUG] [LOCAL ] MMKT: No derivative data file found to delete. [2025-09-29T02:04:05.809830] [INFO ] [MAIN ] Update Progress: 1389/2371 symbols completed. MMKT took 5.7s. Estimated remaining: 4m 46s. Rate: 206.1 symbols/min [2025-09-29T02:04:06.081052] [INFO ] [MAIN ] MPA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:06.185909] [INFO ] [MAIN ] MPC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:06.188763] [DEBUG] [LOCAL ] MP: Loaded 54444 existing records from primary storage. [2025-09-29T02:04:06.195004] [INFO ] [MAIN ] MP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:06.194431] [DEBUG] [LOCAL ] MPA: Loaded 5268 existing records from primary storage. [2025-09-29T02:04:06.195418] [INFO ] [MAIN ] Update Progress: 1390/2371 symbols completed. MP took 0.8s. Estimated remaining: 4m 46s. Rate: 206.1 symbols/min [2025-09-29T02:04:06.195816] [INFO ] [MAIN ] MPA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:06.219286] [INFO ] [MAIN ] Update Progress: 1391/2371 symbols completed. MPA took 0.5s. Estimated remaining: 4m 45s. Rate: 206.2 symbols/min [2025-09-29T02:04:06.573269] [INFO ] [MAIN ] MPLX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:06.662930] [INFO ] [MAIN ] MPV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:06.684344] [DEBUG] [LOCAL ] MPC: Loaded 52889 existing records from primary storage. [2025-09-29T02:04:06.682169] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-29T02:04:06.695510] [INFO ] [MAIN ] MPC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:06.695831] [INFO ] [MAIN ] Update Progress: 1392/2371 symbols completed. MPC took 0.9s. Estimated remaining: 4m 45s. Rate: 206.1 symbols/min [2025-09-29T02:04:06.711199] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-02. [2025-09-29T02:04:06.754766] [DEBUG] [LOCAL ] MPV: Loaded 5098 existing records from primary storage. [2025-09-29T02:04:06.783568] [INFO ] [MAIN ] MPV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:06.812097] [INFO ] [MAIN ] Update Progress: 1393/2371 symbols completed. MPV took 0.6s. Estimated remaining: 4m 45s. Rate: 206.2 symbols/min [2025-09-29T02:04:07.007429] [INFO ] [MAIN ] MPW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:07.069607] [DEBUG] [LOCAL ] MPLX: Loaded 51491 existing records from primary storage. [2025-09-29T02:04:07.082579] [INFO ] [MAIN ] MPLX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:07.115402] [INFO ] [MAIN ] Update Progress: 1394/2371 symbols completed. MPLX took 0.9s. Estimated remaining: 4m 44s. Rate: 206.2 symbols/min [2025-09-29T02:04:07.179140] [INFO ] [MAIN ] MPX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:07.301446] [DEBUG] [LOCAL ] MPX: Loaded 4213 existing records from primary storage. [2025-09-29T02:04:07.301880] [INFO ] [MAIN ] MPX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:07.307775] [INFO ] [MAIN ] Update Progress: 1395/2371 symbols completed. MPX took 0.5s. Estimated remaining: 4m 44s. Rate: 206.2 symbols/min [2025-09-29T02:04:07.439157] [INFO ] [MAIN ] MQT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:07.499745] [DEBUG] [LOCAL ] MPW: Loaded 54275 existing records from primary storage. [2025-09-29T02:04:07.528267] [INFO ] [MAIN ] MPW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:07.528862] [INFO ] [MAIN ] Update Progress: 1396/2371 symbols completed. MPW took 0.8s. Estimated remaining: 4m 44s. Rate: 206.3 symbols/min [2025-09-29T02:04:07.652714] [INFO ] [MAIN ] MQY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:07.674575] [DEBUG] [LOCAL ] MQT: Loaded 8523 existing records from primary storage. [2025-09-29T02:04:07.704364] [INFO ] [MAIN ] MQT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:07.720324] [INFO ] [MAIN ] Update Progress: 1397/2371 symbols completed. MQT took 0.6s. Estimated remaining: 4m 43s. Rate: 206.3 symbols/min [2025-09-29T02:04:07.837949] [INFO ] [MAIN ] MRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:07.845230] [DEBUG] [LOCAL ] MQY: Loaded 16979 existing records from primary storage. [2025-09-29T02:04:07.846425] [INFO ] [MAIN ] MQY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:07.871748] [INFO ] [MAIN ] Update Progress: 1398/2371 symbols completed. MQY took 0.5s. Estimated remaining: 4m 43s. Rate: 206.4 symbols/min [2025-09-29T02:04:07.878308] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-29T02:04:07.889854] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-03. [2025-09-29T02:04:07.930354] [DEBUG] [LOCAL ] MRC: Loaded 38128 existing records from primary storage. [2025-09-29T02:04:07.930768] [INFO ] [MAIN ] MRC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:07.930947] [INFO ] [MAIN ] Update Progress: 1399/2371 symbols completed. MRC took 0.3s. Estimated remaining: 4m 42s. Rate: 206.5 symbols/min [2025-09-29T02:04:08.644110] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-29T02:04:08.657134] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-04. [2025-09-29T02:04:09.472031] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-29T02:04:09.483895] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-05. [2025-09-29T02:04:10.256279] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-29T02:04:10.268421] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-06. [2025-09-29T02:04:11.013985] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-29T02:04:11.026164] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-07. [2025-09-29T02:04:11.788185] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-29T02:04:11.804866] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-08. [2025-09-29T02:04:12.631924] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-29T02:04:12.644320] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-09. [2025-09-29T02:04:13.376775] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-29T02:04:13.387028] [INFO ] [REMOTE ] MO: Full fetch complete (77495 records). [2025-09-29T02:04:13.387228] [DEBUG] [VALIDATOR ] MO: Validating primary data. [2025-09-29T02:04:13.600411] [WARN ] [VALIDATOR ] MO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-29T02:04:13.602052] [FATAL] [MAIN ] MO: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:04:13.602173] [WARN ] [MAIN ] MO: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:04:13.602267] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-09-29T02:04:13.602381] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-09-29T02:04:13.602466] [INFO ] [LOCAL ] MO: Starting deletion of derivative data. [2025-09-29T02:04:13.602594] [DEBUG] [LOCAL ] MO: No derivative data file found to delete. [2025-09-29T02:04:13.603068] [INFO ] [MAIN ] Update Progress: 1400/2371 symbols completed. MO took 10.6s. Estimated remaining: 4m 46s. Rate: 203.8 symbols/min [2025-09-29T02:04:14.414818] [INFO ] [MAIN ] MSA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:14.360617] [INFO ] [MAIN ] MRK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:14.419116] [INFO ] [MAIN ] MS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:14.442104] [INFO ] [MAIN ] MRP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:14.442726] [DEBUG] [LOCAL ] MRP: No existing data file found in primary storage. [2025-09-29T02:04:14.442843] [WARN ] [MAIN ] MRP: No existing data found, performing full refresh instead. [2025-09-29T02:04:14.443563] [INFO ] [MAIN ] MRP: Wiping existing primary data before full refresh. [2025-09-29T02:04:14.443671] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-09-29T02:04:14.443759] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-09-29T02:04:14.443862] [INFO ] [MAIN ] MRP: Starting full primary refresh. [2025-09-29T02:04:14.673611] [DEBUG] [LOCAL ] MSA: Loaded 18988 existing records from primary storage. [2025-09-29T02:04:14.730555] [INFO ] [MAIN ] MSA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:14.745849] [INFO ] [MAIN ] Update Progress: 1401/2371 symbols completed. MSA took 1.1s. Estimated remaining: 4m 46s. Rate: 203.4 symbols/min [2025-09-29T02:04:14.948145] [DEBUG] [LOCAL ] MRK: Loaded 54569 existing records from primary storage. [2025-09-29T02:04:14.985921] [DEBUG] [LOCAL ] MS: Loaded 54472 existing records from primary storage. [2025-09-29T02:04:14.992081] [INFO ] [MAIN ] MRK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:15.029374] [INFO ] [MAIN ] Update Progress: 1402/2371 symbols completed. MRK took 1.4s. Estimated remaining: 4m 46s. Rate: 203.4 symbols/min [2025-09-29T02:04:15.018610] [INFO ] [MAIN ] MS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:15.086334] [INFO ] [MAIN ] Update Progress: 1403/2371 symbols completed. MS took 1.5s. Estimated remaining: 4m 45s. Rate: 203.5 symbols/min [2025-09-29T02:04:15.196429] [INFO ] [REMOTE ] MRP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:04:15.209927] [INFO ] [MAIN ] MSB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:15.258794] [INFO ] [REMOTE ] MRP: Fetching primary data for 2024-12. [2025-09-29T02:04:15.423835] [DEBUG] [LOCAL ] MSB: Loaded 7895 existing records from primary storage. [2025-09-29T02:04:15.461953] [INFO ] [MAIN ] MSB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:15.485511] [INFO ] [MAIN ] Update Progress: 1404/2371 symbols completed. MSB took 0.7s. Estimated remaining: 4m 45s. Rate: 203.5 symbols/min [2025-09-29T02:04:15.538988] [INFO ] [MAIN ] MSCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:15.584098] [DEBUG] [REMOTE ] MRP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:04:15.631991] [WARN ] [REMOTE ] MRP: No data returned for month 2024-12 [2025-09-29T02:04:15.644460] [INFO ] [MAIN ] MSC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:15.670869] [FATAL] [REMOTE ] MRP: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:04:15.687777] [FATAL] [MAIN ] MRP: Failed to fetch primary data. [2025-09-29T02:04:15.693595] [WARN ] [MAIN ] MRP: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:04:15.687936] [DEBUG] [LOCAL ] MSC: No existing data file found in primary storage. [2025-09-29T02:04:15.713404] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-09-29T02:04:15.724895] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-09-29T02:04:15.713546] [WARN ] [MAIN ] MSC: No existing data found, performing full refresh instead. [2025-09-29T02:04:15.725271] [INFO ] [LOCAL ] MRP: Starting deletion of derivative data. [2025-09-29T02:04:15.725749] [DEBUG] [LOCAL ] MRP: No derivative data file found to delete. [2025-09-29T02:04:15.736887] [INFO ] [MAIN ] MSC: Wiping existing primary data before full refresh. [2025-09-29T02:04:15.759002] [INFO ] [MAIN ] Update Progress: 1405/2371 symbols completed. MRP took 2.1s. Estimated remaining: 4m 45s. Rate: 203.5 symbols/min [2025-09-29T02:04:15.789098] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-09-29T02:04:15.832805] [INFO ] [MAIN ] MSD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:15.838419] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-09-29T02:04:15.845571] [INFO ] [MAIN ] MSC: Starting full primary refresh. [2025-09-29T02:04:16.006115] [DEBUG] [LOCAL ] MSCI: Loaded 35351 existing records from primary storage. [2025-09-29T02:04:16.073856] [DEBUG] [LOCAL ] MSD: Loaded 15775 existing records from primary storage. [2025-09-29T02:04:16.084632] [INFO ] [MAIN ] MSCI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:16.111106] [INFO ] [MAIN ] MSD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:16.129175] [INFO ] [MAIN ] Update Progress: 1406/2371 symbols completed. MSCI took 1.0s. Estimated remaining: 4m 45s. Rate: 203.5 symbols/min [2025-09-29T02:04:16.232228] [INFO ] [MAIN ] Update Progress: 1407/2371 symbols completed. MSD took 0.6s. Estimated remaining: 4m 44s. Rate: 203.5 symbols/min [2025-09-29T02:04:16.383298] [INFO ] [MAIN ] MSDL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:16.734873] [INFO ] [REMOTE ] MSC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:04:16.751867] [INFO ] [REMOTE ] MSC: Fetching primary data for 2024-12. [2025-09-29T02:04:16.821330] [INFO ] [MAIN ] MSGE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:16.902441] [INFO ] [MAIN ] MSGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:16.917572] [DEBUG] [LOCAL ] MSDL: Loaded 38645 existing records from primary storage. [2025-09-29T02:04:16.918092] [INFO ] [MAIN ] MSDL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:16.918198] [INFO ] [MAIN ] Update Progress: 1408/2371 symbols completed. MSDL took 1.1s. Estimated remaining: 4m 44s. Rate: 203.4 symbols/min [2025-09-29T02:04:17.069013] [DEBUG] [LOCAL ] MSGS: Loaded 17318 existing records from primary storage. [2025-09-29T02:04:17.127478] [INFO ] [MAIN ] MSGS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:17.163367] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-29T02:04:17.160485] [INFO ] [MAIN ] MSI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:17.160719] [INFO ] [MAIN ] Update Progress: 1409/2371 symbols completed. MSGS took 0.8s. Estimated remaining: 4m 44s. Rate: 203.4 symbols/min [2025-09-29T02:04:17.165784] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-01. [2025-09-29T02:04:17.164493] [DEBUG] [LOCAL ] MSGE: Loaded 27513 existing records from primary storage. [2025-09-29T02:04:17.167394] [INFO ] [MAIN ] MSGE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:17.173103] [INFO ] [MAIN ] Update Progress: 1410/2371 symbols completed. MSGE took 1.0s. Estimated remaining: 4m 43s. Rate: 203.5 symbols/min [2025-09-29T02:04:17.522799] [INFO ] [MAIN ] MSIF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:17.583366] [DEBUG] [LOCAL ] MSIF: No existing data file found in primary storage. [2025-09-29T02:04:17.587919] [WARN ] [MAIN ] MSIF: No existing data found, performing full refresh instead. [2025-09-29T02:04:17.608973] [DEBUG] [LOCAL ] MSI: Loaded 41128 existing records from primary storage. [2025-09-29T02:04:17.602475] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-29T02:04:17.614066] [INFO ] [MAIN ] MSI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:17.614222] [INFO ] [MAIN ] MSIF: Wiping existing primary data before full refresh. [2025-09-29T02:04:17.614637] [INFO ] [MAIN ] Update Progress: 1411/2371 symbols completed. MSI took 0.7s. Estimated remaining: 4m 43s. Rate: 203.4 symbols/min [2025-09-29T02:04:17.613903] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-02. [2025-09-29T02:04:17.611396] [INFO ] [MAIN ] MSM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:17.614972] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-09-29T02:04:17.651551] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-09-29T02:04:17.671009] [INFO ] [MAIN ] MSIF: Starting full primary refresh. [2025-09-29T02:04:17.963214] [INFO ] [MAIN ] MT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:18.021281] [DEBUG] [LOCAL ] MSM: Loaded 36004 existing records from primary storage. [2025-09-29T02:04:18.033435] [INFO ] [MAIN ] MSM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:18.045001] [INFO ] [MAIN ] Update Progress: 1412/2371 symbols completed. MSM took 0.8s. Estimated remaining: 4m 43s. Rate: 203.4 symbols/min [2025-09-29T02:04:18.111861] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-29T02:04:18.173469] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-03. [2025-09-29T02:04:18.463635] [INFO ] [MAIN ] MTAL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:18.547344] [DEBUG] [LOCAL ] MT: Loaded 51417 existing records from primary storage. [2025-09-29T02:04:18.561344] [INFO ] [MAIN ] MT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:18.561852] [INFO ] [MAIN ] Update Progress: 1413/2371 symbols completed. MT took 0.9s. Estimated remaining: 4m 43s. Rate: 203.3 symbols/min [2025-09-29T02:04:18.566233] [INFO ] [REMOTE ] MSIF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:04:18.575155] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2024-12. [2025-09-29T02:04:18.575295] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-29T02:04:18.614383] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-04. [2025-09-29T02:04:18.757969] [DEBUG] [REMOTE ] MSIF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:04:18.791519] [WARN ] [REMOTE ] MSIF: No data returned for month 2024-12 [2025-09-29T02:04:18.808094] [FATAL] [REMOTE ] MSIF: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:04:18.796360] [INFO ] [MAIN ] MTB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:18.809967] [FATAL] [MAIN ] MSIF: Failed to fetch primary data. [2025-09-29T02:04:18.810070] [WARN ] [MAIN ] MSIF: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:04:18.810222] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-09-29T02:04:18.811035] [DEBUG] [LOCAL ] MTAL: Loaded 37002 existing records from primary storage. [2025-09-29T02:04:18.811770] [INFO ] [MAIN ] MTAL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:18.811591] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-09-29T02:04:18.812471] [INFO ] [MAIN ] Update Progress: 1414/2371 symbols completed. MTAL took 0.8s. Estimated remaining: 4m 42s. Rate: 203.3 symbols/min [2025-09-29T02:04:18.812664] [INFO ] [LOCAL ] MSIF: Starting deletion of derivative data. [2025-09-29T02:04:18.825757] [DEBUG] [LOCAL ] MSIF: No derivative data file found to delete. [2025-09-29T02:04:18.849454] [INFO ] [MAIN ] Update Progress: 1415/2371 symbols completed. MSIF took 1.7s. Estimated remaining: 4m 42s. Rate: 203.4 symbols/min [2025-09-29T02:04:18.885122] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-04 (0.27 seconds). [2025-09-29T02:04:18.936097] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-05. [2025-09-29T02:04:19.220617] [INFO ] [MAIN ] MTD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:19.243942] [INFO ] [MAIN ] MTDR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:19.263181] [DEBUG] [LOCAL ] MTB: Loaded 47562 existing records from primary storage. [2025-09-29T02:04:19.263827] [INFO ] [MAIN ] MTB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:19.264077] [INFO ] [MAIN ] Update Progress: 1416/2371 symbols completed. MTB took 0.7s. Estimated remaining: 4m 42s. Rate: 203.4 symbols/min [2025-09-29T02:04:19.408519] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-29T02:04:19.410532] [DEBUG] [LOCAL ] MTD: Loaded 15342 existing records from primary storage. [2025-09-29T02:04:19.412361] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-06. [2025-09-29T02:04:19.418627] [INFO ] [MAIN ] MTD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:19.420096] [INFO ] [MAIN ] Update Progress: 1417/2371 symbols completed. MTD took 0.6s. Estimated remaining: 4m 41s. Rate: 203.4 symbols/min [2025-09-29T02:04:19.618363] [INFO ] [MAIN ] MTG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:19.662032] [DEBUG] [LOCAL ] MTDR: Loaded 52316 existing records from primary storage. [2025-09-29T02:04:19.684154] [INFO ] [MAIN ] MTDR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:19.724900] [INFO ] [MAIN ] Update Progress: 1418/2371 symbols completed. MTDR took 0.8s. Estimated remaining: 4m 41s. Rate: 203.4 symbols/min [2025-09-29T02:04:19.747719] [INFO ] [MAIN ] MTH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:19.748137] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-29T02:04:19.755766] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-07. [2025-09-29T02:04:19.959500] [INFO ] [MAIN ] MTN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:20.011387] [DEBUG] [LOCAL ] MTG: Loaded 52091 existing records from primary storage. [2025-09-29T02:04:20.012025] [INFO ] [MAIN ] MTG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:20.012136] [INFO ] [MAIN ] Update Progress: 1419/2371 symbols completed. MTG took 0.7s. Estimated remaining: 4m 41s. Rate: 203.4 symbols/min [2025-09-29T02:04:20.048166] [DEBUG] [LOCAL ] MTH: Loaded 44547 existing records from primary storage. [2025-09-29T02:04:20.088921] [INFO ] [MAIN ] MTH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:20.102796] [INFO ] [MAIN ] Update Progress: 1420/2371 symbols completed. MTH took 0.7s. Estimated remaining: 4m 40s. Rate: 203.5 symbols/min [2025-09-29T02:04:20.116427] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-29T02:04:20.160984] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-08. [2025-09-29T02:04:20.370224] [INFO ] [MAIN ] MTR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:20.381001] [DEBUG] [LOCAL ] MTR: No existing data file found in primary storage. [2025-09-29T02:04:20.383126] [DEBUG] [LOCAL ] MTN: Loaded 39607 existing records from primary storage. [2025-09-29T02:04:20.393766] [WARN ] [MAIN ] MTR: No existing data found, performing full refresh instead. [2025-09-29T02:04:20.434092] [INFO ] [MAIN ] MTN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:20.435684] [INFO ] [MAIN ] Update Progress: 1421/2371 symbols completed. MTN took 0.7s. Estimated remaining: 4m 40s. Rate: 203.5 symbols/min [2025-09-29T02:04:20.432349] [INFO ] [MAIN ] MTR: Wiping existing primary data before full refresh. [2025-09-29T02:04:20.459399] [INFO ] [MAIN ] MTRN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:20.474730] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-09-29T02:04:20.528121] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-09-29T02:04:20.529007] [INFO ] [MAIN ] MTR: Starting full primary refresh. [2025-09-29T02:04:20.579431] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-29T02:04:20.645423] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-09. [2025-09-29T02:04:20.791965] [DEBUG] [LOCAL ] MTRN: Loaded 18303 existing records from primary storage. [2025-09-29T02:04:20.846524] [INFO ] [MAIN ] MTUS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:20.846772] [INFO ] [MAIN ] MTRN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:20.890806] [INFO ] [MAIN ] Update Progress: 1422/2371 symbols completed. MTRN took 0.8s. Estimated remaining: 4m 40s. Rate: 203.4 symbols/min [2025-09-29T02:04:21.148700] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-29T02:04:21.221557] [INFO ] [REMOTE ] MSC: Full fetch complete (2509 records). [2025-09-29T02:04:21.250964] [DEBUG] [VALIDATOR ] MSC: Validating primary data. [2025-09-29T02:04:21.239776] [DEBUG] [LOCAL ] MTUS: Loaded 28984 existing records from primary storage. [2025-09-29T02:04:21.334135] [INFO ] [MAIN ] MTUS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:21.415865] [INFO ] [MAIN ] Update Progress: 1423/2371 symbols completed. MTUS took 1.0s. Estimated remaining: 4m 40s. Rate: 203.3 symbols/min [2025-09-29T02:04:21.427519] [INFO ] [MAIN ] MTW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:21.469358] [INFO ] [REMOTE ] MTR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:04:21.496687] [INFO ] [REMOTE ] MTR: Fetching primary data for 2024-12. [2025-09-29T02:04:21.732638] [WARN ] [VALIDATOR ] MSC: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-09-29T02:04:21.761305] [DEBUG] [LOCAL ] MTW: Loaded 26888 existing records from primary storage. [2025-09-29T02:04:21.762132] [INFO ] [MAIN ] MTW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:21.761962] [FATAL] [MAIN ] MSC: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:04:21.767444] [INFO ] [MAIN ] Update Progress: 1424/2371 symbols completed. MTW took 0.9s. Estimated remaining: 4m 40s. Rate: 203.3 symbols/min [2025-09-29T02:04:21.779799] [WARN ] [MAIN ] MSC: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:04:21.795673] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-09-29T02:04:21.845895] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-09-29T02:04:21.872285] [INFO ] [MAIN ] MTX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:21.873703] [INFO ] [LOCAL ] MSC: Starting deletion of derivative data. [2025-09-29T02:04:21.889327] [DEBUG] [LOCAL ] MSC: No derivative data file found to delete. [2025-09-29T02:04:21.917370] [INFO ] [MAIN ] Update Progress: 1425/2371 symbols completed. MSC took 6.8s. Estimated remaining: 4m 39s. Rate: 203.4 symbols/min [2025-09-29T02:04:22.088689] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-29T02:04:22.109969] [INFO ] [MAIN ] MTZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:22.122031] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-01. [2025-09-29T02:04:22.175386] [DEBUG] [LOCAL ] MTX: Loaded 23150 existing records from primary storage. [2025-09-29T02:04:22.223411] [INFO ] [MAIN ] MTX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:22.250927] [INFO ] [MAIN ] MUA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:22.251054] [INFO ] [MAIN ] Update Progress: 1426/2371 symbols completed. MTX took 0.8s. Estimated remaining: 4m 39s. Rate: 203.3 symbols/min [2025-09-29T02:04:22.386076] [DEBUG] [LOCAL ] MUA: Loaded 12391 existing records from primary storage. [2025-09-29T02:04:22.416680] [DEBUG] [LOCAL ] MTZ: Loaded 43922 existing records from primary storage. [2025-09-29T02:04:22.417203] [INFO ] [MAIN ] MTZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:22.422522] [INFO ] [MAIN ] Update Progress: 1427/2371 symbols completed. MTZ took 0.6s. Estimated remaining: 4m 38s. Rate: 203.4 symbols/min [2025-09-29T02:04:22.417059] [INFO ] [MAIN ] MUA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:22.450025] [INFO ] [MAIN ] Update Progress: 1428/2371 symbols completed. MUA took 0.5s. Estimated remaining: 4m 38s. Rate: 203.5 symbols/min [2025-09-29T02:04:22.511213] [INFO ] [MAIN ] MUC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:22.596126] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-29T02:04:22.624856] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-02. [2025-09-29T02:04:22.819854] [INFO ] [MAIN ] MUE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:22.873586] [DEBUG] [LOCAL ] MUC: Loaded 20721 existing records from primary storage. [2025-09-29T02:04:22.906376] [INFO ] [MAIN ] MUC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:22.909035] [INFO ] [MAIN ] MUFG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:22.912090] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-09-29T02:04:22.913839] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-03. [2025-09-29T02:04:22.914242] [INFO ] [MAIN ] Update Progress: 1429/2371 symbols completed. MUC took 0.7s. Estimated remaining: 4m 38s. Rate: 203.4 symbols/min [2025-09-29T02:04:23.053923] [DEBUG] [LOCAL ] MUE: Loaded 12092 existing records from primary storage. [2025-09-29T02:04:23.081050] [INFO ] [MAIN ] MUE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:23.097398] [INFO ] [MAIN ] Update Progress: 1430/2371 symbols completed. MUE took 0.7s. Estimated remaining: 4m 37s. Rate: 203.5 symbols/min [2025-09-29T02:04:23.185929] [INFO ] [MAIN ] MUJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:23.227252] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-29T02:04:23.265724] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-04. [2025-09-29T02:04:23.318020] [DEBUG] [LOCAL ] MUFG: Loaded 53341 existing records from primary storage. [2025-09-29T02:04:23.388455] [INFO ] [MAIN ] MUR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:23.394610] [DEBUG] [LOCAL ] MUJ: Loaded 13473 existing records from primary storage. [2025-09-29T02:04:23.388598] [INFO ] [MAIN ] MUFG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:23.395202] [INFO ] [MAIN ] MUJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:23.395284] [INFO ] [MAIN ] Update Progress: 1431/2371 symbols completed. MUFG took 0.9s. Estimated remaining: 4m 37s. Rate: 203.5 symbols/min [2025-09-29T02:04:23.395570] [INFO ] [MAIN ] Update Progress: 1432/2371 symbols completed. MUJ took 0.5s. Estimated remaining: 4m 37s. Rate: 203.6 symbols/min [2025-09-29T02:04:23.641075] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-29T02:04:23.646608] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-05. [2025-09-29T02:04:23.773571] [INFO ] [MAIN ] MUSE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:23.810476] [INFO ] [MAIN ] MUSA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:23.825666] [DEBUG] [LOCAL ] MUSE: No existing data file found in primary storage. [2025-09-29T02:04:23.825864] [WARN ] [MAIN ] MUSE: No existing data found, performing full refresh instead. [2025-09-29T02:04:23.826371] [INFO ] [MAIN ] MUSE: Wiping existing primary data before full refresh. [2025-09-29T02:04:23.826451] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-09-29T02:04:23.826527] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-09-29T02:04:23.826596] [INFO ] [MAIN ] MUSE: Starting full primary refresh. [2025-09-29T02:04:23.959229] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-29T02:04:23.990344] [DEBUG] [LOCAL ] MUR: Loaded 53705 existing records from primary storage. [2025-09-29T02:04:24.002288] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-06. [2025-09-29T02:04:24.038721] [INFO ] [MAIN ] MUR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:24.096752] [INFO ] [MAIN ] Update Progress: 1433/2371 symbols completed. MUR took 1.0s. Estimated remaining: 4m 37s. Rate: 203.4 symbols/min [2025-09-29T02:04:24.125513] [DEBUG] [LOCAL ] MUSA: Loaded 25221 existing records from primary storage. [2025-09-29T02:04:24.190109] [INFO ] [MAIN ] MUSA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:24.237099] [INFO ] [MAIN ] Update Progress: 1434/2371 symbols completed. MUSA took 0.8s. Estimated remaining: 4m 36s. Rate: 203.5 symbols/min [2025-09-29T02:04:24.468717] [INFO ] [REMOTE ] MUSE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:04:24.536535] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2024-12. [2025-09-29T02:04:24.617769] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-29T02:04:24.636038] [INFO ] [MAIN ] MUX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:24.642318] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-07. [2025-09-29T02:04:24.726803] [INFO ] [MAIN ] MVF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:24.754136] [DEBUG] [LOCAL ] MVF: Loaded 12921 existing records from primary storage. [2025-09-29T02:04:24.754483] [INFO ] [MAIN ] MVF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:24.754601] [INFO ] [MAIN ] Update Progress: 1435/2371 symbols completed. MVF took 0.4s. Estimated remaining: 4m 36s. Rate: 203.4 symbols/min [2025-09-29T02:04:24.798254] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2024-12 (0.26 seconds). [2025-09-29T02:04:24.807876] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-01. [2025-09-29T02:04:24.863081] [DEBUG] [LOCAL ] MUX: Loaded 43253 existing records from primary storage. [2025-09-29T02:04:24.894292] [INFO ] [MAIN ] MUX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:24.905713] [INFO ] [MAIN ] Update Progress: 1436/2371 symbols completed. MUX took 0.7s. Estimated remaining: 4m 36s. Rate: 203.5 symbols/min [2025-09-29T02:04:24.997218] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:04:24.997033] [INFO ] [MAIN ] MVO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:25.002918] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-01 [2025-09-29T02:04:25.011093] [FATAL] [REMOTE ] MUSE: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:04:25.011030] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-29T02:04:25.024635] [FATAL] [MAIN ] MUSE: Failed to fetch primary data. [2025-09-29T02:04:25.024200] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-08. [2025-09-29T02:04:25.040531] [WARN ] [MAIN ] MUSE: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:04:25.062063] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-09-29T02:04:25.086378] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-09-29T02:04:25.110101] [DEBUG] [LOCAL ] MVO: Loaded 9140 existing records from primary storage. [2025-09-29T02:04:25.100276] [INFO ] [LOCAL ] MUSE: Starting deletion of derivative data. [2025-09-29T02:04:25.120734] [INFO ] [MAIN ] MVO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:25.125992] [DEBUG] [LOCAL ] MUSE: No derivative data file found to delete. [2025-09-29T02:04:25.153486] [INFO ] [MAIN ] Update Progress: 1437/2371 symbols completed. MUSE took 1.8s. Estimated remaining: 4m 35s. Rate: 203.5 symbols/min [2025-09-29T02:04:25.182488] [INFO ] [MAIN ] MVT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:25.182716] [INFO ] [MAIN ] Update Progress: 1438/2371 symbols completed. MVO took 0.4s. Estimated remaining: 4m 35s. Rate: 203.6 symbols/min [2025-09-29T02:04:25.197918] [DEBUG] [LOCAL ] MVT: Loaded 10355 existing records from primary storage. [2025-09-29T02:04:25.198238] [INFO ] [MAIN ] MVT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:25.198339] [INFO ] [MAIN ] Update Progress: 1439/2371 symbols completed. MVT took 0.3s. Estimated remaining: 4m 34s. Rate: 203.8 symbols/min [2025-09-29T02:04:25.265779] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-09-29T02:04:25.267493] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-09. [2025-09-29T02:04:25.395586] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-09 (0.13 seconds). [2025-09-29T02:04:25.397279] [INFO ] [REMOTE ] MTR: Full fetch complete (2549 records). [2025-09-29T02:04:25.397443] [DEBUG] [VALIDATOR ] MTR: Validating primary data. [2025-09-29T02:04:25.643189] [WARN ] [VALIDATOR ] MTR: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-29T02:04:25.643432] [FATAL] [MAIN ] MTR: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:04:25.643543] [WARN ] [MAIN ] MTR: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:04:25.643675] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-09-29T02:04:25.643821] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-09-29T02:04:25.643924] [INFO ] [LOCAL ] MTR: Starting deletion of derivative data. [2025-09-29T02:04:25.644061] [DEBUG] [LOCAL ] MTR: No derivative data file found to delete. [2025-09-29T02:04:25.644179] [INFO ] [MAIN ] Update Progress: 1440/2371 symbols completed. MTR took 5.6s. Estimated remaining: 4m 34s. Rate: 203.7 symbols/min [2025-09-29T02:04:26.607354] [INFO ] [MAIN ] MXE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:26.578339] [INFO ] [MAIN ] MX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:26.633962] [DEBUG] [LOCAL ] MXE: No existing data file found in primary storage. [2025-09-29T02:04:26.639603] [WARN ] [MAIN ] MXE: No existing data found, performing full refresh instead. [2025-09-29T02:04:26.686144] [INFO ] [MAIN ] MWA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:26.686529] [INFO ] [MAIN ] MXE: Wiping existing primary data before full refresh. [2025-09-29T02:04:26.663225] [INFO ] [MAIN ] MXF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:26.687307] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-09-29T02:04:26.687746] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-09-29T02:04:26.687835] [INFO ] [MAIN ] MXE: Starting full primary refresh. [2025-09-29T02:04:26.816609] [DEBUG] [LOCAL ] MXF: Loaded 5984 existing records from primary storage. [2025-09-29T02:04:26.822266] [INFO ] [MAIN ] MXF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:26.877932] [INFO ] [MAIN ] Update Progress: 1441/2371 symbols completed. MXF took 1.2s. Estimated remaining: 4m 35s. Rate: 203.2 symbols/min [2025-09-29T02:04:26.879227] [DEBUG] [LOCAL ] MX: Loaded 23379 existing records from primary storage. [2025-09-29T02:04:26.890892] [INFO ] [MAIN ] MX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:26.891187] [INFO ] [MAIN ] Update Progress: 1442/2371 symbols completed. MX took 1.2s. Estimated remaining: 4m 34s. Rate: 203.4 symbols/min [2025-09-29T02:04:27.333978] [DEBUG] [LOCAL ] MWA: Loaded 47633 existing records from primary storage. [2025-09-29T02:04:27.465731] [INFO ] [MAIN ] MYD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:27.466066] [INFO ] [MAIN ] MWA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:27.511346] [INFO ] [MAIN ] Update Progress: 1443/2371 symbols completed. MWA took 1.9s. Estimated remaining: 4m 34s. Rate: 203.2 symbols/min [2025-09-29T02:04:27.504965] [INFO ] [MAIN ] MYE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:27.701000] [INFO ] [REMOTE ] MXE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:04:27.727115] [DEBUG] [LOCAL ] MYD: Loaded 13946 existing records from primary storage. [2025-09-29T02:04:27.715709] [INFO ] [REMOTE ] MXE: Fetching primary data for 2024-12. [2025-09-29T02:04:27.744999] [INFO ] [MAIN ] MYD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:27.757535] [INFO ] [MAIN ] Update Progress: 1444/2371 symbols completed. MYD took 0.9s. Estimated remaining: 4m 34s. Rate: 203.2 symbols/min [2025-09-29T02:04:27.961368] [INFO ] [MAIN ] MYI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:27.956749] [DEBUG] [LOCAL ] MYE: Loaded 25346 existing records from primary storage. [2025-09-29T02:04:28.001633] [INFO ] [MAIN ] MYE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:28.012981] [INFO ] [MAIN ] Update Progress: 1445/2371 symbols completed. MYE took 1.1s. Estimated remaining: 4m 33s. Rate: 203.3 symbols/min [2025-09-29T02:04:28.108814] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-09-29T02:04:28.146372] [INFO ] [MAIN ] MYN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:28.157274] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-01. [2025-09-29T02:04:28.250850] [DEBUG] [LOCAL ] MYI: Loaded 19636 existing records from primary storage. [2025-09-29T02:04:28.245012] [DEBUG] [LOCAL ] MYN: Loaded 10324 existing records from primary storage. [2025-09-29T02:04:28.305931] [INFO ] [MAIN ] MYN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:28.310969] [INFO ] [MAIN ] NABL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:28.311752] [INFO ] [MAIN ] Update Progress: 1446/2371 symbols completed. MYN took 0.5s. Estimated remaining: 4m 33s. Rate: 203.3 symbols/min [2025-09-29T02:04:28.306074] [INFO ] [MAIN ] MYI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:28.324212] [INFO ] [MAIN ] Update Progress: 1447/2371 symbols completed. MYI took 0.8s. Estimated remaining: 4m 33s. Rate: 203.4 symbols/min [2025-09-29T02:04:28.576360] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-29T02:04:28.590253] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-02. [2025-09-29T02:04:28.744156] [DEBUG] [LOCAL ] NABL: Loaded 40294 existing records from primary storage. [2025-09-29T02:04:28.769013] [INFO ] [MAIN ] NABL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:28.748670] [INFO ] [MAIN ] NAD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:28.769199] [INFO ] [MAIN ] Update Progress: 1448/2371 symbols completed. NABL took 0.8s. Estimated remaining: 4m 32s. Rate: 203.3 symbols/min [2025-09-29T02:04:28.768340] [INFO ] [MAIN ] NAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:29.010000] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-29T02:04:29.006858] [INFO ] [MAIN ] NAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:29.023773] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-03. [2025-09-29T02:04:29.011235] [DEBUG] [LOCAL ] NAC: Loaded 25076 existing records from primary storage. [2025-09-29T02:04:29.026138] [DEBUG] [LOCAL ] NAD: Loaded 34318 existing records from primary storage. [2025-09-29T02:04:29.030594] [INFO ] [MAIN ] NAC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:29.031223] [INFO ] [MAIN ] Update Progress: 1449/2371 symbols completed. NAC took 0.7s. Estimated remaining: 4m 32s. Rate: 203.3 symbols/min [2025-09-29T02:04:29.030885] [INFO ] [MAIN ] NAD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:29.057819] [INFO ] [MAIN ] Update Progress: 1450/2371 symbols completed. NAD took 0.7s. Estimated remaining: 4m 32s. Rate: 203.5 symbols/min [2025-09-29T02:04:29.251443] [DEBUG] [LOCAL ] NAN: Loaded 9084 existing records from primary storage. [2025-09-29T02:04:29.379541] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-29T02:04:29.396365] [INFO ] [MAIN ] NAT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:29.348439] [INFO ] [MAIN ] NAN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:29.413891] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-04. [2025-09-29T02:04:29.407289] [INFO ] [MAIN ] Update Progress: 1451/2371 symbols completed. NAN took 0.6s. Estimated remaining: 4m 31s. Rate: 203.4 symbols/min [2025-09-29T02:04:29.551357] [INFO ] [MAIN ] NATL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:29.707970] [INFO ] [MAIN ] NAZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:29.736683] [DEBUG] [LOCAL ] NAZ: Loaded 2703 existing records from primary storage. [2025-09-29T02:04:29.764478] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-29T02:04:29.765822] [INFO ] [MAIN ] NAZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:29.768440] [DEBUG] [LOCAL ] NAT: Loaded 49859 existing records from primary storage. [2025-09-29T02:04:29.767362] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-05. [2025-09-29T02:04:29.770261] [INFO ] [MAIN ] NAT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:29.768896] [INFO ] [MAIN ] Update Progress: 1452/2371 symbols completed. NAZ took 0.3s. Estimated remaining: 4m 31s. Rate: 203.4 symbols/min [2025-09-29T02:04:29.771494] [DEBUG] [LOCAL ] NATL: Loaded 33367 existing records from primary storage. [2025-09-29T02:04:29.777087] [INFO ] [MAIN ] Update Progress: 1453/2371 symbols completed. NAT took 0.7s. Estimated remaining: 4m 31s. Rate: 203.6 symbols/min [2025-09-29T02:04:29.783733] [INFO ] [MAIN ] NATL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:29.863226] [INFO ] [MAIN ] Update Progress: 1454/2371 symbols completed. NATL took 0.8s. Estimated remaining: 4m 30s. Rate: 203.7 symbols/min [2025-09-29T02:04:30.040837] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-09-29T02:04:30.096567] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-06. [2025-09-29T02:04:30.280907] [INFO ] [MAIN ] NBB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:30.278579] [INFO ] [MAIN ] NBHC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:30.367418] [INFO ] [MAIN ] NBR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:30.372901] [DEBUG] [LOCAL ] NBB: Loaded 8967 existing records from primary storage. [2025-09-29T02:04:30.373733] [INFO ] [MAIN ] NBB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:30.373886] [INFO ] [MAIN ] Update Progress: 1455/2371 symbols completed. NBB took 0.6s. Estimated remaining: 4m 30s. Rate: 203.5 symbols/min [2025-09-29T02:04:30.526984] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-29T02:04:30.541796] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-07. [2025-09-29T02:04:30.564074] [DEBUG] [LOCAL ] NBHC: Loaded 23530 existing records from primary storage. [2025-09-29T02:04:30.567509] [INFO ] [MAIN ] NBHC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:30.569468] [INFO ] [MAIN ] Update Progress: 1456/2371 symbols completed. NBHC took 0.8s. Estimated remaining: 4m 30s. Rate: 203.6 symbols/min [2025-09-29T02:04:30.713754] [DEBUG] [LOCAL ] NBR: Loaded 35286 existing records from primary storage. [2025-09-29T02:04:30.758364] [INFO ] [MAIN ] NBXG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:30.789721] [INFO ] [MAIN ] NBR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:30.801434] [INFO ] [MAIN ] Update Progress: 1457/2371 symbols completed. NBR took 0.9s. Estimated remaining: 4m 29s. Rate: 203.6 symbols/min [2025-09-29T02:04:30.935171] [INFO ] [MAIN ] NC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:30.987355] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-29T02:04:31.033352] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-08. [2025-09-29T02:04:31.025161] [DEBUG] [LOCAL ] NC: Loaded 1933 existing records from primary storage. [2025-09-29T02:04:31.047114] [INFO ] [MAIN ] NC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:31.041730] [DEBUG] [LOCAL ] NBXG: Loaded 22794 existing records from primary storage. [2025-09-29T02:04:31.079705] [INFO ] [MAIN ] Update Progress: 1458/2371 symbols completed. NC took 0.5s. Estimated remaining: 4m 29s. Rate: 203.6 symbols/min [2025-09-29T02:04:31.123896] [INFO ] [MAIN ] NBXG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:31.162069] [INFO ] [MAIN ] Update Progress: 1459/2371 symbols completed. NBXG took 0.8s. Estimated remaining: 4m 29s. Rate: 203.7 symbols/min [2025-09-29T02:04:31.146541] [INFO ] [MAIN ] NCA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:31.439564] [DEBUG] [LOCAL ] NCA: Loaded 10178 existing records from primary storage. [2025-09-29T02:04:31.459197] [INFO ] [MAIN ] NCDL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:31.475742] [INFO ] [MAIN ] NCA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:31.488947] [INFO ] [MAIN ] Update Progress: 1460/2371 symbols completed. NCA took 0.7s. Estimated remaining: 4m 28s. Rate: 203.7 symbols/min [2025-09-29T02:04:31.527238] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-29T02:04:31.531588] [INFO ] [MAIN ] NCLH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:31.533842] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-09. [2025-09-29T02:04:31.670550] [DEBUG] [LOCAL ] NCDL: Loaded 21828 existing records from primary storage. [2025-09-29T02:04:31.671057] [INFO ] [MAIN ] NCDL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:31.671970] [INFO ] [MAIN ] Update Progress: 1461/2371 symbols completed. NCDL took 0.6s. Estimated remaining: 4m 28s. Rate: 203.8 symbols/min [2025-09-29T02:04:31.810884] [INFO ] [MAIN ] NCV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:31.830446] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-09-29T02:04:31.875858] [INFO ] [REMOTE ] MXE: Full fetch complete (2667 records). [2025-09-29T02:04:31.917281] [DEBUG] [VALIDATOR ] MXE: Validating primary data. [2025-09-29T02:04:31.930517] [DEBUG] [LOCAL ] NCLH: Loaded 54533 existing records from primary storage. [2025-09-29T02:04:31.984509] [INFO ] [MAIN ] NCLH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:32.011512] [INFO ] [MAIN ] Update Progress: 1462/2371 symbols completed. NCLH took 0.8s. Estimated remaining: 4m 28s. Rate: 203.7 symbols/min [2025-09-29T02:04:32.102023] [DEBUG] [LOCAL ] NCV: Loaded 13602 existing records from primary storage. [2025-09-29T02:04:32.184575] [INFO ] [MAIN ] NCZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:32.214926] [INFO ] [MAIN ] NCV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:32.238636] [INFO ] [MAIN ] Update Progress: 1463/2371 symbols completed. NCV took 0.7s. Estimated remaining: 4m 27s. Rate: 203.8 symbols/min [2025-09-29T02:04:32.486004] [DEBUG] [LOCAL ] NCZ: Loaded 11998 existing records from primary storage. [2025-09-29T02:04:32.506038] [WARN ] [VALIDATOR ] MXE: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-29T02:04:32.546290] [INFO ] [MAIN ] NDMO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:32.558301] [INFO ] [MAIN ] NCZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:32.579580] [INFO ] [MAIN ] Update Progress: 1464/2371 symbols completed. NCZ took 0.9s. Estimated remaining: 4m 27s. Rate: 203.8 symbols/min [2025-09-29T02:04:32.574082] [FATAL] [MAIN ] MXE: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:04:32.602441] [WARN ] [MAIN ] MXE: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:04:32.675195] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-09-29T02:04:32.725314] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-09-29T02:04:32.804272] [INFO ] [LOCAL ] MXE: Starting deletion of derivative data. [2025-09-29T02:04:32.805143] [DEBUG] [LOCAL ] NDMO: Loaded 16978 existing records from primary storage. [2025-09-29T02:04:32.837434] [DEBUG] [LOCAL ] MXE: No derivative data file found to delete. [2025-09-29T02:04:32.837919] [INFO ] [MAIN ] NDMO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:32.816100] [INFO ] [MAIN ] NE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:32.838033] [INFO ] [MAIN ] Update Progress: 1465/2371 symbols completed. MXE took 7.2s. Estimated remaining: 4m 27s. Rate: 203.8 symbols/min [2025-09-29T02:04:32.849751] [INFO ] [MAIN ] Update Progress: 1466/2371 symbols completed. NDMO took 0.8s. Estimated remaining: 4m 26s. Rate: 203.9 symbols/min [2025-09-29T02:04:33.020380] [INFO ] [MAIN ] NEA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:33.390731] [DEBUG] [LOCAL ] NE: Loaded 53157 existing records from primary storage. [2025-09-29T02:04:33.401037] [INFO ] [MAIN ] NEE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:33.398588] [INFO ] [MAIN ] NEM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:33.401638] [INFO ] [MAIN ] NE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:33.402746] [INFO ] [MAIN ] Update Progress: 1467/2371 symbols completed. NE took 1.1s. Estimated remaining: 4m 26s. Rate: 203.8 symbols/min [2025-09-29T02:04:33.409276] [DEBUG] [LOCAL ] NEA: Loaded 35808 existing records from primary storage. [2025-09-29T02:04:33.427509] [INFO ] [MAIN ] NEA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:33.448816] [INFO ] [MAIN ] Update Progress: 1468/2371 symbols completed. NEA took 0.9s. Estimated remaining: 4m 26s. Rate: 203.9 symbols/min [2025-09-29T02:04:33.744548] [INFO ] [MAIN ] NET: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:33.862072] [INFO ] [MAIN ] NEU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:33.866494] [DEBUG] [LOCAL ] NEE: Loaded 54487 existing records from primary storage. [2025-09-29T02:04:33.868693] [INFO ] [MAIN ] NEE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:33.868900] [INFO ] [MAIN ] Update Progress: 1469/2371 symbols completed. NEE took 1.0s. Estimated remaining: 4m 25s. Rate: 203.8 symbols/min [2025-09-29T02:04:33.908534] [DEBUG] [LOCAL ] NEM: Loaded 54488 existing records from primary storage. [2025-09-29T02:04:33.953004] [INFO ] [MAIN ] NEM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:33.972225] [DEBUG] [LOCAL ] NEU: Loaded 8259 existing records from primary storage. [2025-09-29T02:04:33.988184] [INFO ] [MAIN ] Update Progress: 1470/2371 symbols completed. NEM took 1.1s. Estimated remaining: 4m 25s. Rate: 203.9 symbols/min [2025-09-29T02:04:34.022321] [INFO ] [MAIN ] NEU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:34.061585] [INFO ] [MAIN ] Update Progress: 1471/2371 symbols completed. NEU took 0.6s. Estimated remaining: 4m 25s. Rate: 204.0 symbols/min [2025-09-29T02:04:34.313206] [DEBUG] [LOCAL ] NET: Loaded 53808 existing records from primary storage. [2025-09-29T02:04:34.356398] [INFO ] [MAIN ] NEUE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:34.403191] [INFO ] [MAIN ] NET: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:34.409989] [INFO ] [MAIN ] Update Progress: 1472/2371 symbols completed. NET took 1.0s. Estimated remaining: 4m 24s. Rate: 204.0 symbols/min [2025-09-29T02:04:34.495965] [DEBUG] [LOCAL ] NEUE: Loaded 2271 existing records from primary storage. [2025-09-29T02:04:34.449878] [INFO ] [MAIN ] NEXA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:34.541008] [INFO ] [MAIN ] NFG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:34.561584] [INFO ] [MAIN ] NEUE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:34.588479] [INFO ] [MAIN ] Update Progress: 1473/2371 symbols completed. NEUE took 0.7s. Estimated remaining: 4m 24s. Rate: 204.1 symbols/min [2025-09-29T02:04:34.681397] [DEBUG] [LOCAL ] NEXA: Loaded 4307 existing records from primary storage. [2025-09-29T02:04:34.733441] [INFO ] [MAIN ] NEXA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:34.773350] [INFO ] [MAIN ] Update Progress: 1474/2371 symbols completed. NEXA took 0.8s. Estimated remaining: 4m 24s. Rate: 204.1 symbols/min [2025-09-29T02:04:34.846460] [INFO ] [MAIN ] NFJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:35.029879] [DEBUG] [LOCAL ] NFG: Loaded 39084 existing records from primary storage. [2025-09-29T02:04:35.078627] [INFO ] [MAIN ] NFG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:35.082492] [INFO ] [MAIN ] NGG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:35.083346] [INFO ] [MAIN ] Update Progress: 1475/2371 symbols completed. NFG took 1.0s. Estimated remaining: 4m 23s. Rate: 204.1 symbols/min [2025-09-29T02:04:35.196214] [INFO ] [MAIN ] NGL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:35.221323] [DEBUG] [LOCAL ] NFJ: Loaded 20592 existing records from primary storage. [2025-09-29T02:04:35.265403] [INFO ] [MAIN ] NFJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:35.283571] [INFO ] [MAIN ] Update Progress: 1476/2371 symbols completed. NFJ took 0.8s. Estimated remaining: 4m 23s. Rate: 204.1 symbols/min [2025-09-29T02:04:35.475521] [INFO ] [MAIN ] NGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:35.533111] [DEBUG] [LOCAL ] NGG: Loaded 46809 existing records from primary storage. [2025-09-29T02:04:35.596072] [INFO ] [MAIN ] NGG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:35.625433] [INFO ] [MAIN ] Update Progress: 1477/2371 symbols completed. NGG took 1.0s. Estimated remaining: 4m 23s. Rate: 204.1 symbols/min [2025-09-29T02:04:35.627369] [DEBUG] [LOCAL ] NGL: Loaded 30754 existing records from primary storage. [2025-09-29T02:04:35.626383] [INFO ] [MAIN ] NGVC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:35.633432] [INFO ] [MAIN ] NGL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:35.633172] [DEBUG] [LOCAL ] NGS: Loaded 11682 existing records from primary storage. [2025-09-29T02:04:35.634078] [INFO ] [MAIN ] Update Progress: 1478/2371 symbols completed. NGL took 0.8s. Estimated remaining: 4m 22s. Rate: 204.3 symbols/min [2025-09-29T02:04:35.634805] [INFO ] [MAIN ] NGS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:35.634900] [INFO ] [MAIN ] Update Progress: 1479/2371 symbols completed. NGS took 0.5s. Estimated remaining: 4m 22s. Rate: 204.4 symbols/min [2025-09-29T02:04:35.659775] [DEBUG] [LOCAL ] NGVC: Loaded 22650 existing records from primary storage. [2025-09-29T02:04:35.660120] [INFO ] [MAIN ] NGVC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:35.660252] [INFO ] [MAIN ] Update Progress: 1480/2371 symbols completed. NGVC took 0.4s. Estimated remaining: 4m 21s. Rate: 204.5 symbols/min [2025-09-29T02:04:36.191358] [INFO ] [MAIN ] NIC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:36.361805] [INFO ] [MAIN ] NI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:36.396451] [INFO ] [MAIN ] NGVT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:36.423736] [INFO ] [MAIN ] NHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:36.430403] [DEBUG] [LOCAL ] NIC: Loaded 9026 existing records from primary storage. [2025-09-29T02:04:36.430971] [INFO ] [MAIN ] NIC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:36.431077] [INFO ] [MAIN ] Update Progress: 1481/2371 symbols completed. NIC took 0.8s. Estimated remaining: 4m 21s. Rate: 204.3 symbols/min [2025-09-29T02:04:36.601939] [DEBUG] [LOCAL ] NHI: Loaded 22283 existing records from primary storage. [2025-09-29T02:04:36.647541] [INFO ] [MAIN ] NHI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:36.654320] [DEBUG] [LOCAL ] NGVT: Loaded 24631 existing records from primary storage. [2025-09-29T02:04:36.668251] [INFO ] [MAIN ] Update Progress: 1482/2371 symbols completed. NHI took 1.0s. Estimated remaining: 4m 21s. Rate: 204.3 symbols/min [2025-09-29T02:04:36.669128] [INFO ] [MAIN ] NGVT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:36.671399] [INFO ] [MAIN ] Update Progress: 1483/2371 symbols completed. NGVT took 1.0s. Estimated remaining: 4m 21s. Rate: 204.5 symbols/min [2025-09-29T02:04:36.751618] [INFO ] [MAIN ] NIE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:36.783321] [DEBUG] [LOCAL ] NI: Loaded 54201 existing records from primary storage. [2025-09-29T02:04:36.848672] [INFO ] [MAIN ] NI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:36.865307] [INFO ] [MAIN ] Update Progress: 1484/2371 symbols completed. NI took 1.2s. Estimated remaining: 4m 20s. Rate: 204.5 symbols/min [2025-09-29T02:04:37.035240] [DEBUG] [LOCAL ] NIE: Loaded 11869 existing records from primary storage. [2025-09-29T02:04:37.083334] [INFO ] [MAIN ] NIE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:37.200104] [INFO ] [MAIN ] Update Progress: 1485/2371 symbols completed. NIE took 0.8s. Estimated remaining: 4m 20s. Rate: 204.5 symbols/min [2025-09-29T02:04:37.199321] [INFO ] [MAIN ] NIM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:37.355247] [INFO ] [MAIN ] NINE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:37.418561] [DEBUG] [LOCAL ] NIM: Loaded 4149 existing records from primary storage. [2025-09-29T02:04:37.399525] [INFO ] [MAIN ] NIO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:37.434506] [INFO ] [MAIN ] NIM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:37.465458] [INFO ] [MAIN ] Update Progress: 1486/2371 symbols completed. NIM took 0.8s. Estimated remaining: 4m 20s. Rate: 204.5 symbols/min [2025-09-29T02:04:37.629603] [INFO ] [MAIN ] NIQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:37.672058] [DEBUG] [LOCAL ] NIQ: No existing data file found in primary storage. [2025-09-29T02:04:37.690715] [WARN ] [MAIN ] NIQ: No existing data found, performing full refresh instead. [2025-09-29T02:04:37.697680] [INFO ] [MAIN ] NIQ: Wiping existing primary data before full refresh. [2025-09-29T02:04:37.692143] [DEBUG] [LOCAL ] NINE: Loaded 28624 existing records from primary storage. [2025-09-29T02:04:37.713861] [INFO ] [MAIN ] NINE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:37.708319] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-09-29T02:04:37.768613] [INFO ] [MAIN ] NJR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:37.768846] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-09-29T02:04:37.769170] [INFO ] [MAIN ] NIQ: Starting full primary refresh. [2025-09-29T02:04:37.764231] [INFO ] [MAIN ] Update Progress: 1487/2371 symbols completed. NINE took 1.0s. Estimated remaining: 4m 19s. Rate: 204.5 symbols/min [2025-09-29T02:04:38.138569] [DEBUG] [LOCAL ] NIO: Loaded 54582 existing records from primary storage. [2025-09-29T02:04:38.196543] [INFO ] [MAIN ] NIO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:38.238545] [INFO ] [MAIN ] Update Progress: 1488/2371 symbols completed. NIO took 1.4s. Estimated remaining: 4m 19s. Rate: 204.4 symbols/min [2025-09-29T02:04:38.285380] [DEBUG] [LOCAL ] NJR: Loaded 38739 existing records from primary storage. [2025-09-29T02:04:38.279448] [INFO ] [MAIN ] NKE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:38.336571] [INFO ] [MAIN ] NJR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:38.360403] [INFO ] [MAIN ] Update Progress: 1489/2371 symbols completed. NJR took 0.9s. Estimated remaining: 4m 19s. Rate: 204.5 symbols/min [2025-09-29T02:04:38.347197] [DEBUG] [LOCAL ] NKE: No existing data file found in primary storage. [2025-09-29T02:04:38.398184] [WARN ] [MAIN ] NKE: No existing data found, performing full refresh instead. [2025-09-29T02:04:38.439904] [INFO ] [MAIN ] NKE: Wiping existing primary data before full refresh. [2025-09-29T02:04:38.459534] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-09-29T02:04:38.517530] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-09-29T02:04:38.684238] [INFO ] [MAIN ] NKE: Starting full primary refresh. [2025-09-29T02:04:38.739702] [INFO ] [REMOTE ] NIQ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:04:38.829754] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2024-12. [2025-09-29T02:04:38.905605] [INFO ] [MAIN ] NKX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:38.971489] [INFO ] [MAIN ] NL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:38.992724] [DEBUG] [LOCAL ] NL: No existing data file found in primary storage. [2025-09-29T02:04:39.013494] [WARN ] [MAIN ] NL: No existing data found, performing full refresh instead. [2025-09-29T02:04:39.041000] [INFO ] [MAIN ] NL: Wiping existing primary data before full refresh. [2025-09-29T02:04:39.090733] [DEBUG] [LOCAL ] NKX: Loaded 13801 existing records from primary storage. [2025-09-29T02:04:39.090908] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-09-29T02:04:39.137246] [INFO ] [MAIN ] NKX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:39.116713] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-09-29T02:04:39.126233] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:04:39.169419] [INFO ] [MAIN ] NL: Starting full primary refresh. [2025-09-29T02:04:39.190739] [WARN ] [REMOTE ] NIQ: No data returned for month 2024-12 [2025-09-29T02:04:39.164016] [INFO ] [MAIN ] Update Progress: 1490/2371 symbols completed. NKX took 0.9s. Estimated remaining: 4m 19s. Rate: 204.3 symbols/min [2025-09-29T02:04:39.208051] [FATAL] [REMOTE ] NIQ: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:04:39.230851] [FATAL] [MAIN ] NIQ: Failed to fetch primary data. [2025-09-29T02:04:39.278347] [WARN ] [MAIN ] NIQ: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:04:39.329959] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-09-29T02:04:39.379454] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-09-29T02:04:39.441977] [INFO ] [LOCAL ] NIQ: Starting deletion of derivative data. [2025-09-29T02:04:39.476140] [DEBUG] [LOCAL ] NIQ: No derivative data file found to delete. [2025-09-29T02:04:39.539223] [INFO ] [MAIN ] Update Progress: 1491/2371 symbols completed. NIQ took 2.3s. Estimated remaining: 4m 19s. Rate: 204.2 symbols/min [2025-09-29T02:04:39.542731] [INFO ] [REMOTE ] NKE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:04:39.665136] [INFO ] [REMOTE ] NKE: Fetching primary data for 2024-12. [2025-09-29T02:04:39.755614] [INFO ] [MAIN ] NLOP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:40.032050] [DEBUG] [LOCAL ] NLOP: Loaded 11997 existing records from primary storage. [2025-09-29T02:04:40.020837] [INFO ] [MAIN ] NLY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:40.037720] [INFO ] [MAIN ] NLOP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:40.043384] [INFO ] [MAIN ] Update Progress: 1492/2371 symbols completed. NLOP took 0.8s. Estimated remaining: 4m 18s. Rate: 204.1 symbols/min [2025-09-29T02:04:40.133019] [INFO ] [REMOTE ] NL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:04:40.163162] [INFO ] [REMOTE ] NL: Fetching primary data for 2024-12. [2025-09-29T02:04:40.329149] [INFO ] [MAIN ] NMAI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:40.350127] [DEBUG] [LOCAL ] NLY: Loaded 54358 existing records from primary storage. [2025-09-29T02:04:40.350602] [INFO ] [MAIN ] NLY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:40.350747] [INFO ] [MAIN ] Update Progress: 1493/2371 symbols completed. NLY took 0.8s. Estimated remaining: 4m 18s. Rate: 204.1 symbols/min [2025-09-29T02:04:40.434451] [DEBUG] [LOCAL ] NMAI: Loaded 13181 existing records from primary storage. [2025-09-29T02:04:40.475001] [INFO ] [MAIN ] NMAI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:40.524703] [INFO ] [MAIN ] Update Progress: 1494/2371 symbols completed. NMAI took 0.5s. Estimated remaining: 4m 18s. Rate: 204.2 symbols/min [2025-09-29T02:04:40.555699] [INFO ] [MAIN ] NMAX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:40.556384] [DEBUG] [LOCAL ] NMAX: No existing data file found in primary storage. [2025-09-29T02:04:40.568199] [WARN ] [MAIN ] NMAX: No existing data found, performing full refresh instead. [2025-09-29T02:04:40.616993] [INFO ] [MAIN ] NMAX: Wiping existing primary data before full refresh. [2025-09-29T02:04:40.617295] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-29T02:04:40.651731] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-09-29T02:04:40.664341] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-01. [2025-09-29T02:04:40.681257] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-09-29T02:04:40.701874] [INFO ] [MAIN ] NMAX: Starting full primary refresh. [2025-09-29T02:04:40.828294] [INFO ] [MAIN ] NMCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:40.941327] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-29T02:04:40.964298] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-01. [2025-09-29T02:04:41.116979] [DEBUG] [LOCAL ] NMCO: Loaded 16803 existing records from primary storage. [2025-09-29T02:04:41.155811] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-29T02:04:41.178695] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-02. [2025-09-29T02:04:41.164427] [INFO ] [MAIN ] NMCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:41.180287] [INFO ] [MAIN ] Update Progress: 1495/2371 symbols completed. NMCO took 0.6s. Estimated remaining: 4m 18s. Rate: 204.0 symbols/min [2025-09-29T02:04:41.390156] [INFO ] [REMOTE ] NMAX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:04:41.417140] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2024-12. [2025-09-29T02:04:41.473327] [INFO ] [MAIN ] NMG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:41.484908] [DEBUG] [LOCAL ] NMG: Loaded 7913 existing records from primary storage. [2025-09-29T02:04:41.485191] [INFO ] [MAIN ] NMG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:41.485291] [INFO ] [MAIN ] Update Progress: 1496/2371 symbols completed. NMG took 0.3s. Estimated remaining: 4m 17s. Rate: 204.0 symbols/min [2025-09-29T02:04:41.599576] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:04:41.600367] [WARN ] [REMOTE ] NMAX: No data returned for month 2024-12 [2025-09-29T02:04:41.605994] [FATAL] [REMOTE ] NMAX: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:04:41.621777] [FATAL] [MAIN ] NMAX: Failed to fetch primary data. [2025-09-29T02:04:41.627112] [WARN ] [MAIN ] NMAX: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:04:41.681308] [INFO ] [MAIN ] NMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:41.681486] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-09-29T02:04:41.682571] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-09-29T02:04:41.682803] [INFO ] [LOCAL ] NMAX: Starting deletion of derivative data. [2025-09-29T02:04:41.682914] [DEBUG] [LOCAL ] NMAX: No derivative data file found to delete. [2025-09-29T02:04:41.683039] [INFO ] [MAIN ] Update Progress: 1497/2371 symbols completed. NMAX took 1.3s. Estimated remaining: 4m 17s. Rate: 204.0 symbols/min [2025-09-29T02:04:41.799997] [DEBUG] [LOCAL ] NMI: Loaded 4091 existing records from primary storage. [2025-09-29T02:04:41.820621] [INFO ] [MAIN ] NMI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:41.821101] [INFO ] [MAIN ] Update Progress: 1498/2371 symbols completed. NMI took 0.3s. Estimated remaining: 4m 17s. Rate: 204.1 symbols/min [2025-09-29T02:04:41.822016] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-29T02:04:41.952876] [INFO ] [MAIN ] NMM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:41.920458] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-03. [2025-09-29T02:04:42.084815] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-29T02:04:42.141118] [DEBUG] [LOCAL ] NMM: Loaded 14470 existing records from primary storage. [2025-09-29T02:04:42.157948] [INFO ] [MAIN ] NMM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:42.162495] [INFO ] [MAIN ] NMR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:42.163063] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-02. [2025-09-29T02:04:42.163235] [INFO ] [MAIN ] Update Progress: 1499/2371 symbols completed. NMM took 0.5s. Estimated remaining: 4m 16s. Rate: 204.1 symbols/min [2025-09-29T02:04:42.379285] [INFO ] [MAIN ] NMS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:42.380798] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-29T02:04:42.383154] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-04. [2025-09-29T02:04:42.397001] [DEBUG] [LOCAL ] NMR: Loaded 35569 existing records from primary storage. [2025-09-29T02:04:42.398664] [INFO ] [MAIN ] NMR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:42.398820] [INFO ] [MAIN ] Update Progress: 1500/2371 symbols completed. NMR took 0.6s. Estimated remaining: 4m 16s. Rate: 204.1 symbols/min [2025-09-29T02:04:42.414003] [DEBUG] [LOCAL ] NMS: Loaded 2893 existing records from primary storage. [2025-09-29T02:04:42.425243] [INFO ] [MAIN ] NMS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:42.442555] [INFO ] [MAIN ] Update Progress: 1501/2371 symbols completed. NMS took 0.3s. Estimated remaining: 4m 16s. Rate: 204.2 symbols/min [2025-09-29T02:04:42.705005] [INFO ] [MAIN ] NMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:42.783672] [INFO ] [MAIN ] NMZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:42.790786] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-29T02:04:42.795348] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-05. [2025-09-29T02:04:42.799940] [DEBUG] [LOCAL ] NMT: Loaded 2884 existing records from primary storage. [2025-09-29T02:04:42.800332] [INFO ] [MAIN ] NMT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:42.800670] [INFO ] [MAIN ] Update Progress: 1502/2371 symbols completed. NMT took 0.4s. Estimated remaining: 4m 15s. Rate: 204.2 symbols/min [2025-09-29T02:04:42.944559] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-29T02:04:42.942827] [DEBUG] [LOCAL ] NMZ: Loaded 21872 existing records from primary storage. [2025-09-29T02:04:42.977343] [INFO ] [MAIN ] NMZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:42.977582] [INFO ] [MAIN ] Update Progress: 1503/2371 symbols completed. NMZ took 0.5s. Estimated remaining: 4m 15s. Rate: 204.3 symbols/min [2025-09-29T02:04:42.991087] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-03. [2025-09-29T02:04:43.168969] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-29T02:04:43.190169] [INFO ] [MAIN ] NNI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:43.214080] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-06. [2025-09-29T02:04:43.277561] [INFO ] [MAIN ] NNN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:43.290359] [DEBUG] [LOCAL ] NNI: Loaded 10159 existing records from primary storage. [2025-09-29T02:04:43.290702] [INFO ] [MAIN ] NNI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:43.290809] [INFO ] [MAIN ] Update Progress: 1504/2371 symbols completed. NNI took 0.5s. Estimated remaining: 4m 15s. Rate: 204.3 symbols/min [2025-09-29T02:04:43.494432] [INFO ] [MAIN ] NNY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:43.510729] [DEBUG] [LOCAL ] NNN: Loaded 49151 existing records from primary storage. [2025-09-29T02:04:43.511279] [INFO ] [MAIN ] NNN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:43.511388] [INFO ] [MAIN ] Update Progress: 1505/2371 symbols completed. NNN took 0.5s. Estimated remaining: 4m 14s. Rate: 204.3 symbols/min [2025-09-29T02:04:43.604017] [DEBUG] [LOCAL ] NNY: Loaded 5750 existing records from primary storage. [2025-09-29T02:04:43.631926] [INFO ] [MAIN ] NNY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:43.636794] [INFO ] [MAIN ] Update Progress: 1506/2371 symbols completed. NNY took 0.3s. Estimated remaining: 4m 14s. Rate: 204.4 symbols/min [2025-09-29T02:04:43.795224] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-29T02:04:43.846355] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-07. [2025-09-29T02:04:43.830873] [INFO ] [MAIN ] NOA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:43.958098] [INFO ] [MAIN ] NOAH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:43.973700] [DEBUG] [LOCAL ] NOA: Loaded 16497 existing records from primary storage. [2025-09-29T02:04:43.974448] [INFO ] [MAIN ] NOA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:43.975101] [INFO ] [MAIN ] Update Progress: 1507/2371 symbols completed. NOA took 0.5s. Estimated remaining: 4m 14s. Rate: 204.3 symbols/min [2025-09-29T02:04:44.129137] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-29T02:04:44.130185] [DEBUG] [LOCAL ] NOAH: Loaded 20358 existing records from primary storage. [2025-09-29T02:04:44.177253] [INFO ] [MAIN ] NOAH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:44.189041] [INFO ] [MAIN ] Update Progress: 1508/2371 symbols completed. NOAH took 0.6s. Estimated remaining: 4m 13s. Rate: 204.4 symbols/min [2025-09-29T02:04:44.188559] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-04. [2025-09-29T02:04:44.176973] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-29T02:04:44.282493] [INFO ] [MAIN ] NOC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:44.294346] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-08. [2025-09-29T02:04:44.446127] [INFO ] [MAIN ] NOG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:44.477341] [DEBUG] [LOCAL ] NOC: Loaded 43141 existing records from primary storage. [2025-09-29T02:04:44.477867] [INFO ] [MAIN ] NOC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:44.477992] [INFO ] [MAIN ] Update Progress: 1509/2371 symbols completed. NOC took 0.5s. Estimated remaining: 4m 13s. Rate: 204.4 symbols/min [2025-09-29T02:04:44.688612] [INFO ] [MAIN ] NOK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:44.706011] [DEBUG] [LOCAL ] NOG: Loaded 51932 existing records from primary storage. [2025-09-29T02:04:44.706451] [INFO ] [MAIN ] NOG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:44.706557] [INFO ] [MAIN ] Update Progress: 1510/2371 symbols completed. NOG took 0.5s. Estimated remaining: 4m 13s. Rate: 204.4 symbols/min [2025-09-29T02:04:44.820750] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-29T02:04:44.828021] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-09. [2025-09-29T02:04:44.908302] [INFO ] [MAIN ] NOM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:44.909044] [DEBUG] [LOCAL ] NOM: No existing data file found in primary storage. [2025-09-29T02:04:44.909206] [WARN ] [MAIN ] NOM: No existing data found, performing full refresh instead. [2025-09-29T02:04:44.909480] [INFO ] [MAIN ] NOM: Wiping existing primary data before full refresh. [2025-09-29T02:04:44.909574] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-09-29T02:04:44.909723] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-09-29T02:04:44.909796] [INFO ] [MAIN ] NOM: Starting full primary refresh. [2025-09-29T02:04:45.081968] [DEBUG] [LOCAL ] NOK: Loaded 54401 existing records from primary storage. [2025-09-29T02:04:45.135935] [INFO ] [MAIN ] NOK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:45.174882] [INFO ] [MAIN ] Update Progress: 1511/2371 symbols completed. NOK took 0.7s. Estimated remaining: 4m 13s. Rate: 204.3 symbols/min [2025-09-29T02:04:45.281339] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-29T02:04:45.356268] [INFO ] [REMOTE ] NL: Full fetch complete (6922 records). [2025-09-29T02:04:45.452804] [DEBUG] [VALIDATOR ] NL: Validating primary data. [2025-09-29T02:04:45.576261] [INFO ] [REMOTE ] NOM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:04:45.605914] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-29T02:04:45.645802] [INFO ] [MAIN ] NOMD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:45.687433] [INFO ] [REMOTE ] NOM: Fetching primary data for 2024-12. [2025-09-29T02:04:45.723571] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-05. [2025-09-29T02:04:45.811920] [WARN ] [VALIDATOR ] NL: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-29T02:04:45.812882] [FATAL] [MAIN ] NL: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:04:45.812969] [WARN ] [MAIN ] NL: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:04:45.813056] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-09-29T02:04:45.813157] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-09-29T02:04:45.813236] [INFO ] [LOCAL ] NL: Starting deletion of derivative data. [2025-09-29T02:04:45.813328] [DEBUG] [LOCAL ] NL: No derivative data file found to delete. [2025-09-29T02:04:45.813429] [INFO ] [MAIN ] Update Progress: 1512/2371 symbols completed. NL took 7.4s. Estimated remaining: 4m 12s. Rate: 204.2 symbols/min [2025-09-29T02:04:46.029411] [INFO ] [MAIN ] NOTE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:46.030819] [DEBUG] [LOCAL ] NOMD: Loaded 42016 existing records from primary storage. [2025-09-29T02:04:46.031708] [INFO ] [MAIN ] NOMD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:46.031964] [INFO ] [MAIN ] Update Progress: 1513/2371 symbols completed. NOMD took 0.8s. Estimated remaining: 4m 12s. Rate: 204.2 symbols/min [2025-09-29T02:04:46.077285] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-09-29T02:04:46.101329] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-01. [2025-09-29T02:04:46.256791] [INFO ] [MAIN ] NOV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:46.271428] [DEBUG] [LOCAL ] NOTE: Loaded 43143 existing records from primary storage. [2025-09-29T02:04:46.271834] [INFO ] [MAIN ] NOTE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:46.271940] [INFO ] [MAIN ] Update Progress: 1514/2371 symbols completed. NOTE took 0.5s. Estimated remaining: 4m 12s. Rate: 204.2 symbols/min [2025-09-29T02:04:46.359606] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-09-29T02:04:46.387836] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-02. [2025-09-29T02:04:46.471804] [INFO ] [MAIN ] NOW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:46.517555] [DEBUG] [LOCAL ] NOV: Loaded 53961 existing records from primary storage. [2025-09-29T02:04:46.518097] [INFO ] [MAIN ] NOV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:46.518341] [INFO ] [MAIN ] Update Progress: 1515/2371 symbols completed. NOV took 0.5s. Estimated remaining: 4m 11s. Rate: 204.3 symbols/min [2025-09-29T02:04:46.670971] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-09-29T02:04:46.679043] [DEBUG] [LOCAL ] NOW: Loaded 49444 existing records from primary storage. [2025-09-29T02:04:46.680853] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-03. [2025-09-29T02:04:46.708938] [INFO ] [MAIN ] NOW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:46.766464] [INFO ] [MAIN ] NPB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:46.766741] [DEBUG] [LOCAL ] NPB: No existing data file found in primary storage. [2025-09-29T02:04:46.761324] [INFO ] [MAIN ] Update Progress: 1516/2371 symbols completed. NOW took 0.5s. Estimated remaining: 4m 11s. Rate: 204.3 symbols/min [2025-09-29T02:04:46.778249] [WARN ] [MAIN ] NPB: No existing data found, performing full refresh instead. [2025-09-29T02:04:46.802746] [INFO ] [MAIN ] NPB: Wiping existing primary data before full refresh. [2025-09-29T02:04:46.808237] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-09-29T02:04:46.816695] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-09-29T02:04:46.841277] [INFO ] [MAIN ] NPB: Starting full primary refresh. [2025-09-29T02:04:46.956332] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-09-29T02:04:47.007446] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-04. [2025-09-29T02:04:47.030131] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-29T02:04:47.140251] [INFO ] [MAIN ] NPCT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:47.147081] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-06. [2025-09-29T02:04:47.355963] [DEBUG] [LOCAL ] NPCT: Loaded 17114 existing records from primary storage. [2025-09-29T02:04:47.362178] [INFO ] [MAIN ] NPCT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:47.386387] [INFO ] [MAIN ] Update Progress: 1517/2371 symbols completed. NPCT took 0.6s. Estimated remaining: 4m 11s. Rate: 204.1 symbols/min [2025-09-29T02:04:47.386147] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-29T02:04:47.447246] [INFO ] [REMOTE ] NPB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:04:47.448936] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-05. [2025-09-29T02:04:47.449333] [INFO ] [REMOTE ] NPB: Fetching primary data for 2024-12. [2025-09-29T02:04:47.648248] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-05 (0.20 seconds). [2025-09-29T02:04:47.648466] [DEBUG] [REMOTE ] NPB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:04:47.649837] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-06. [2025-09-29T02:04:47.650202] [WARN ] [REMOTE ] NPB: No data returned for month 2024-12 [2025-09-29T02:04:47.651152] [FATAL] [REMOTE ] NPB: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:04:47.651266] [FATAL] [MAIN ] NPB: Failed to fetch primary data. [2025-09-29T02:04:47.651339] [WARN ] [MAIN ] NPB: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:04:47.651418] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-09-29T02:04:47.651525] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-09-29T02:04:47.651602] [INFO ] [LOCAL ] NPB: Starting deletion of derivative data. [2025-09-29T02:04:47.651727] [DEBUG] [LOCAL ] NPB: No derivative data file found to delete. [2025-09-29T02:04:47.651906] [INFO ] [MAIN ] Update Progress: 1518/2371 symbols completed. NPB took 1.1s. Estimated remaining: 4m 11s. Rate: 204.1 symbols/min [2025-09-29T02:04:47.852185] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-06 (0.20 seconds). [2025-09-29T02:04:47.853187] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-07. [2025-09-29T02:04:48.123113] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-09-29T02:04:48.124394] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-08. [2025-09-29T02:04:48.230035] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-29T02:04:48.242119] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-07. [2025-09-29T02:04:48.397734] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-09-29T02:04:48.398918] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-09. [2025-09-29T02:04:48.595505] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-09 (0.20 seconds). [2025-09-29T02:04:48.596671] [INFO ] [REMOTE ] NOM: Full fetch complete (1626 records). [2025-09-29T02:04:48.596771] [DEBUG] [VALIDATOR ] NOM: Validating primary data. [2025-09-29T02:04:48.798711] [WARN ] [VALIDATOR ] NOM: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-09-29T02:04:48.798962] [FATAL] [MAIN ] NOM: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:04:48.799036] [WARN ] [MAIN ] NOM: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:04:48.799117] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-09-29T02:04:48.799215] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-09-29T02:04:48.799290] [INFO ] [LOCAL ] NOM: Starting deletion of derivative data. [2025-09-29T02:04:48.799372] [DEBUG] [LOCAL ] NOM: No derivative data file found to delete. [2025-09-29T02:04:48.799471] [INFO ] [MAIN ] Update Progress: 1519/2371 symbols completed. NOM took 4.1s. Estimated remaining: 4m 11s. Rate: 203.7 symbols/min [2025-09-29T02:04:49.163890] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-29T02:04:49.176466] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-08. [2025-09-29T02:04:49.951346] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-29T02:04:49.963146] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-09. [2025-09-29T02:04:50.313756] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-29T02:04:50.324560] [INFO ] [REMOTE ] NKE: Full fetch complete (77197 records). [2025-09-29T02:04:50.324795] [DEBUG] [VALIDATOR ] NKE: Validating primary data. [2025-09-29T02:04:50.555326] [WARN ] [VALIDATOR ] NKE: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-29T02:04:50.556165] [FATAL] [MAIN ] NKE: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:04:50.556246] [WARN ] [MAIN ] NKE: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:04:50.556328] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-09-29T02:04:50.556434] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-09-29T02:04:50.556531] [INFO ] [LOCAL ] NKE: Starting deletion of derivative data. [2025-09-29T02:04:50.556621] [DEBUG] [LOCAL ] NKE: No derivative data file found to delete. [2025-09-29T02:04:50.557364] [INFO ] [MAIN ] Update Progress: 1520/2371 symbols completed. NKE took 12.8s. Estimated remaining: 4m 11s. Rate: 203.1 symbols/min [2025-09-29T02:04:51.196428] [INFO ] [MAIN ] NPFD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:51.225417] [INFO ] [MAIN ] NPO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:51.346799] [INFO ] [MAIN ] NPK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:51.375137] [INFO ] [MAIN ] NPKI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:51.382821] [DEBUG] [LOCAL ] NPFD: Loaded 9814 existing records from primary storage. [2025-09-29T02:04:51.382994] [DEBUG] [LOCAL ] NPKI: No existing data file found in primary storage. [2025-09-29T02:04:51.383243] [INFO ] [MAIN ] NPFD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:51.383528] [INFO ] [MAIN ] Update Progress: 1521/2371 symbols completed. NPFD took 0.8s. Estimated remaining: 4m 11s. Rate: 202.8 symbols/min [2025-09-29T02:04:51.394321] [WARN ] [MAIN ] NPKI: No existing data found, performing full refresh instead. [2025-09-29T02:04:51.433836] [DEBUG] [LOCAL ] NPK: Loaded 8120 existing records from primary storage. [2025-09-29T02:04:51.439129] [INFO ] [MAIN ] NPKI: Wiping existing primary data before full refresh. [2025-09-29T02:04:51.502343] [INFO ] [MAIN ] NPK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:51.508712] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-09-29T02:04:51.514102] [DEBUG] [LOCAL ] NPO: Loaded 13019 existing records from primary storage. [2025-09-29T02:04:51.514506] [INFO ] [MAIN ] Update Progress: 1522/2371 symbols completed. NPK took 1.0s. Estimated remaining: 4m 11s. Rate: 202.9 symbols/min [2025-09-29T02:04:51.532610] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-09-29T02:04:51.532469] [INFO ] [MAIN ] NPO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:51.580706] [INFO ] [MAIN ] NPKI: Starting full primary refresh. [2025-09-29T02:04:51.602399] [INFO ] [MAIN ] Update Progress: 1523/2371 symbols completed. NPO took 1.0s. Estimated remaining: 4m 11s. Rate: 203.0 symbols/min [2025-09-29T02:04:51.710471] [INFO ] [MAIN ] NPV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:52.128753] [DEBUG] [LOCAL ] NPV: Loaded 5070 existing records from primary storage. [2025-09-29T02:04:52.180742] [INFO ] [MAIN ] NPWR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:52.186589] [INFO ] [MAIN ] NPV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:52.185287] [INFO ] [MAIN ] NQP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:52.202701] [INFO ] [MAIN ] Update Progress: 1524/2371 symbols completed. NPV took 0.8s. Estimated remaining: 4m 10s. Rate: 202.9 symbols/min [2025-09-29T02:04:52.458045] [DEBUG] [LOCAL ] NQP: Loaded 9406 existing records from primary storage. [2025-09-29T02:04:52.504666] [INFO ] [MAIN ] NQP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:52.592003] [INFO ] [MAIN ] Update Progress: 1525/2371 symbols completed. NQP took 1.0s. Estimated remaining: 4m 10s. Rate: 202.8 symbols/min [2025-09-29T02:04:52.637197] [DEBUG] [LOCAL ] NPWR: Loaded 43857 existing records from primary storage. [2025-09-29T02:04:52.685204] [INFO ] [MAIN ] NRDY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:52.695458] [INFO ] [MAIN ] NPWR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:52.711455] [INFO ] [MAIN ] Update Progress: 1526/2371 symbols completed. NPWR took 1.2s. Estimated remaining: 4m 10s. Rate: 202.9 symbols/min [2025-09-29T02:04:52.721073] [INFO ] [REMOTE ] NPKI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:04:52.730304] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2024-12. [2025-09-29T02:04:53.099267] [INFO ] [MAIN ] NREF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:53.117110] [DEBUG] [LOCAL ] NRDY: Loaded 33402 existing records from primary storage. [2025-09-29T02:04:53.137591] [INFO ] [MAIN ] NRG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:53.138497] [INFO ] [MAIN ] NRDY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:53.139204] [INFO ] [MAIN ] Update Progress: 1527/2371 symbols completed. NRDY took 0.9s. Estimated remaining: 4m 10s. Rate: 202.9 symbols/min [2025-09-29T02:04:53.238374] [DEBUG] [LOCAL ] NREF: Loaded 7957 existing records from primary storage. [2025-09-29T02:04:53.249597] [INFO ] [MAIN ] NREF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:53.260352] [INFO ] [MAIN ] Update Progress: 1528/2371 symbols completed. NREF took 0.6s. Estimated remaining: 4m 9s. Rate: 202.9 symbols/min [2025-09-29T02:04:53.446176] [INFO ] [MAIN ] NRGV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:53.485975] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-29T02:04:53.548940] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-01. [2025-09-29T02:04:53.579542] [INFO ] [MAIN ] NRK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:53.601489] [DEBUG] [LOCAL ] NRG: Loaded 53697 existing records from primary storage. [2025-09-29T02:04:53.602472] [INFO ] [MAIN ] NRG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:53.602633] [INFO ] [MAIN ] Update Progress: 1529/2371 symbols completed. NRG took 0.8s. Estimated remaining: 4m 9s. Rate: 202.9 symbols/min [2025-09-29T02:04:53.783849] [DEBUG] [LOCAL ] NRGV: Loaded 43716 existing records from primary storage. [2025-09-29T02:04:53.807412] [DEBUG] [LOCAL ] NRK: Loaded 19991 existing records from primary storage. [2025-09-29T02:04:53.821419] [INFO ] [MAIN ] NRGV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:53.845152] [INFO ] [MAIN ] NRP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:53.845532] [INFO ] [MAIN ] NRK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:53.845820] [INFO ] [MAIN ] Update Progress: 1530/2371 symbols completed. NRGV took 0.7s. Estimated remaining: 4m 9s. Rate: 202.9 symbols/min [2025-09-29T02:04:53.860628] [INFO ] [MAIN ] Update Progress: 1531/2371 symbols completed. NRK took 0.6s. Estimated remaining: 4m 8s. Rate: 203.1 symbols/min [2025-09-29T02:04:53.926411] [DEBUG] [LOCAL ] NRP: Loaded 4114 existing records from primary storage. [2025-09-29T02:04:53.957505] [INFO ] [MAIN ] NRP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:53.973233] [INFO ] [MAIN ] Update Progress: 1532/2371 symbols completed. NRP took 0.4s. Estimated remaining: 4m 8s. Rate: 203.1 symbols/min [2025-09-29T02:04:54.372033] [INFO ] [MAIN ] NRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:54.431106] [INFO ] [MAIN ] NSA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:54.468958] [INFO ] [MAIN ] NRUC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:54.472701] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-29T02:04:54.477785] [DEBUG] [LOCAL ] NRT: Loaded 4994 existing records from primary storage. [2025-09-29T02:04:54.486535] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-02. [2025-09-29T02:04:54.487142] [INFO ] [MAIN ] NRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:54.488513] [INFO ] [MAIN ] Update Progress: 1533/2371 symbols completed. NRT took 0.6s. Estimated remaining: 4m 8s. Rate: 203.0 symbols/min [2025-09-29T02:04:54.496745] [DEBUG] [LOCAL ] NRUC: Loaded 3136 existing records from primary storage. [2025-09-29T02:04:54.505394] [INFO ] [MAIN ] NRUC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:54.517360] [INFO ] [MAIN ] Update Progress: 1534/2371 symbols completed. NRUC took 0.6s. Estimated remaining: 4m 7s. Rate: 203.2 symbols/min [2025-09-29T02:04:54.866403] [INFO ] [MAIN ] NSC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:54.888347] [INFO ] [MAIN ] NSP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:54.905802] [DEBUG] [LOCAL ] NSA: Loaded 45528 existing records from primary storage. [2025-09-29T02:04:54.906485] [INFO ] [MAIN ] NSA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:54.906612] [INFO ] [MAIN ] Update Progress: 1535/2371 symbols completed. NSA took 0.9s. Estimated remaining: 4m 7s. Rate: 203.1 symbols/min [2025-09-29T02:04:55.112697] [INFO ] [MAIN ] NTB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:55.127126] [DEBUG] [LOCAL ] NSP: Loaded 35480 existing records from primary storage. [2025-09-29T02:04:55.127949] [INFO ] [MAIN ] NSP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:55.128075] [INFO ] [MAIN ] Update Progress: 1536/2371 symbols completed. NSP took 0.6s. Estimated remaining: 4m 7s. Rate: 203.2 symbols/min [2025-09-29T02:04:55.294765] [DEBUG] [LOCAL ] NSC: Loaded 49879 existing records from primary storage. [2025-09-29T02:04:55.296223] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-29T02:04:55.296894] [INFO ] [MAIN ] NSC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:55.325853] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-03. [2025-09-29T02:04:55.326307] [INFO ] [MAIN ] Update Progress: 1537/2371 symbols completed. NSC took 0.8s. Estimated remaining: 4m 6s. Rate: 203.2 symbols/min [2025-09-29T02:04:55.406211] [INFO ] [MAIN ] NTEST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:55.411991] [DEBUG] [LOCAL ] NTB: Loaded 20927 existing records from primary storage. [2025-09-29T02:04:55.412202] [DEBUG] [LOCAL ] NTEST: No existing data file found in primary storage. [2025-09-29T02:04:55.438897] [INFO ] [MAIN ] NTB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:55.451372] [INFO ] [MAIN ] Update Progress: 1538/2371 symbols completed. NTB took 0.5s. Estimated remaining: 4m 6s. Rate: 203.3 symbols/min [2025-09-29T02:04:55.433014] [WARN ] [MAIN ] NTEST: No existing data found, performing full refresh instead. [2025-09-29T02:04:55.504861] [INFO ] [MAIN ] NTEST: Wiping existing primary data before full refresh. [2025-09-29T02:04:55.554822] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-09-29T02:04:55.582558] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-09-29T02:04:55.587911] [INFO ] [MAIN ] NTEST: Starting full primary refresh. [2025-09-29T02:04:55.752584] [INFO ] [MAIN ] NTR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:55.907308] [INFO ] [MAIN ] NTST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:56.217823] [DEBUG] [LOCAL ] NTR: Loaded 53356 existing records from primary storage. [2025-09-29T02:04:56.230791] [INFO ] [MAIN ] NTR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:56.231261] [INFO ] [MAIN ] Update Progress: 1539/2371 symbols completed. NTR took 0.9s. Estimated remaining: 4m 6s. Rate: 203.1 symbols/min [2025-09-29T02:04:56.277774] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-29T02:04:56.326137] [INFO ] [REMOTE ] NTEST: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:04:56.337339] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2024-12. [2025-09-29T02:04:56.348481] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-04. [2025-09-29T02:04:56.434363] [DEBUG] [LOCAL ] NTST: Loaded 44211 existing records from primary storage. [2025-09-29T02:04:56.456209] [INFO ] [MAIN ] NTST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:56.490507] [INFO ] [MAIN ] Update Progress: 1540/2371 symbols completed. NTST took 1.0s. Estimated remaining: 4m 6s. Rate: 203.1 symbols/min [2025-09-29T02:04:56.515068] [INFO ] [MAIN ] NU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:56.588383] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2024-12 (0.25 seconds). [2025-09-29T02:04:56.603548] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-01. [2025-09-29T02:04:56.715927] [INFO ] [MAIN ] NUE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:56.716325] [DEBUG] [LOCAL ] NUE: No existing data file found in primary storage. [2025-09-29T02:04:56.716402] [WARN ] [MAIN ] NUE: No existing data found, performing full refresh instead. [2025-09-29T02:04:56.716505] [INFO ] [MAIN ] NUE: Wiping existing primary data before full refresh. [2025-09-29T02:04:56.716583] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-09-29T02:04:56.716701] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-09-29T02:04:56.716775] [INFO ] [MAIN ] NUE: Starting full primary refresh. [2025-09-29T02:04:56.906290] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-09-29T02:04:56.945786] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-02. [2025-09-29T02:04:56.979011] [DEBUG] [LOCAL ] NU: Loaded 54526 existing records from primary storage. [2025-09-29T02:04:57.024242] [INFO ] [MAIN ] NU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:57.033162] [INFO ] [MAIN ] Update Progress: 1541/2371 symbols completed. NU took 0.8s. Estimated remaining: 4m 5s. Rate: 203.0 symbols/min [2025-09-29T02:04:57.244481] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-29T02:04:57.314086] [INFO ] [REMOTE ] NUE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:04:57.296548] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-03. [2025-09-29T02:04:57.353322] [INFO ] [REMOTE ] NUE: Fetching primary data for 2024-12. [2025-09-29T02:04:57.393152] [INFO ] [MAIN ] NUS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:57.397043] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-29T02:04:57.409029] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-05. [2025-09-29T02:04:57.446312] [DEBUG] [LOCAL ] NUS: Loaded 37005 existing records from primary storage. [2025-09-29T02:04:57.446765] [INFO ] [MAIN ] NUS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:57.447192] [INFO ] [MAIN ] Update Progress: 1542/2371 symbols completed. NUS took 0.4s. Estimated remaining: 4m 5s. Rate: 202.9 symbols/min [2025-09-29T02:04:57.557554] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-09-29T02:04:57.565007] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-04. [2025-09-29T02:04:57.638724] [INFO ] [MAIN ] NUV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:57.664462] [DEBUG] [LOCAL ] NUV: Loaded 23576 existing records from primary storage. [2025-09-29T02:04:57.664803] [INFO ] [MAIN ] NUV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:57.664907] [INFO ] [MAIN ] Update Progress: 1543/2371 symbols completed. NUV took 0.2s. Estimated remaining: 4m 5s. Rate: 202.9 symbols/min [2025-09-29T02:04:57.777222] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-04 (0.21 seconds). [2025-09-29T02:04:57.799695] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-05. [2025-09-29T02:04:57.862982] [INFO ] [MAIN ] NUVB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:57.923200] [DEBUG] [LOCAL ] NUVB: Loaded 51998 existing records from primary storage. [2025-09-29T02:04:57.923608] [INFO ] [MAIN ] NUVB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:57.923743] [INFO ] [MAIN ] Update Progress: 1544/2371 symbols completed. NUVB took 0.3s. Estimated remaining: 4m 4s. Rate: 203.0 symbols/min [2025-09-29T02:04:58.122685] [INFO ] [MAIN ] NUW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:58.152523] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-29T02:04:58.167026] [DEBUG] [LOCAL ] NUW: Loaded 7512 existing records from primary storage. [2025-09-29T02:04:58.167454] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-06. [2025-09-29T02:04:58.167905] [INFO ] [MAIN ] NUW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:58.169187] [INFO ] [MAIN ] Update Progress: 1545/2371 symbols completed. NUW took 0.2s. Estimated remaining: 4m 4s. Rate: 203.0 symbols/min [2025-09-29T02:04:58.289394] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-29T02:04:58.342367] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-06. [2025-09-29T02:04:58.380284] [INFO ] [MAIN ] NVG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:58.418759] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-29T02:04:58.430063] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-01. [2025-09-29T02:04:58.461314] [DEBUG] [LOCAL ] NVG: Loaded 27703 existing records from primary storage. [2025-09-29T02:04:58.461682] [INFO ] [MAIN ] NVG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:58.461790] [INFO ] [MAIN ] Update Progress: 1546/2371 symbols completed. NVG took 0.3s. Estimated remaining: 4m 4s. Rate: 203.0 symbols/min [2025-09-29T02:04:58.648368] [INFO ] [MAIN ] NVGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:58.687274] [DEBUG] [LOCAL ] NVGS: Loaded 31403 existing records from primary storage. [2025-09-29T02:04:58.687599] [INFO ] [MAIN ] NVGS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:58.687746] [INFO ] [MAIN ] Update Progress: 1547/2371 symbols completed. NVGS took 0.2s. Estimated remaining: 4m 4s. Rate: 203.0 symbols/min [2025-09-29T02:04:58.892667] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-29T02:04:58.892492] [INFO ] [MAIN ] NVO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:58.894609] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-07. [2025-09-29T02:04:58.921914] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-29T02:04:58.931458] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-07. [2025-09-29T02:04:58.990709] [DEBUG] [LOCAL ] NVO: Loaded 54564 existing records from primary storage. [2025-09-29T02:04:58.991257] [INFO ] [MAIN ] NVO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:58.991421] [INFO ] [MAIN ] Update Progress: 1548/2371 symbols completed. NVO took 0.3s. Estimated remaining: 4m 3s. Rate: 203.0 symbols/min [2025-09-29T02:04:59.187690] [INFO ] [MAIN ] NVR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:59.218300] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-29T02:04:59.223046] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-08. [2025-09-29T02:04:59.226706] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-29T02:04:59.245160] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-02. [2025-09-29T02:04:59.255989] [DEBUG] [LOCAL ] NVR: Loaded 19323 existing records from primary storage. [2025-09-29T02:04:59.256346] [INFO ] [MAIN ] NVR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:59.256900] [INFO ] [MAIN ] Update Progress: 1549/2371 symbols completed. NVR took 0.3s. Estimated remaining: 4m 3s. Rate: 203.0 symbols/min [2025-09-29T02:04:59.463423] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-09-29T02:04:59.463040] [INFO ] [MAIN ] NVRI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:59.465220] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-09. [2025-09-29T02:04:59.508853] [DEBUG] [LOCAL ] NVRI: Loaded 39367 existing records from primary storage. [2025-09-29T02:04:59.509227] [INFO ] [MAIN ] NVRI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:59.509336] [INFO ] [MAIN ] Update Progress: 1550/2371 symbols completed. NVRI took 0.3s. Estimated remaining: 4m 3s. Rate: 203.0 symbols/min [2025-09-29T02:04:59.705983] [INFO ] [MAIN ] NVS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:04:59.732216] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-29T02:04:59.748846] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-08. [2025-09-29T02:04:59.805940] [DEBUG] [LOCAL ] NVS: Loaded 52338 existing records from primary storage. [2025-09-29T02:04:59.806446] [INFO ] [MAIN ] NVS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:04:59.806567] [INFO ] [MAIN ] Update Progress: 1551/2371 symbols completed. NVS took 0.3s. Estimated remaining: 4m 2s. Rate: 203.0 symbols/min [2025-09-29T02:04:59.992416] [INFO ] [MAIN ] NVST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:00.001776] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-29T02:05:00.003100] [INFO ] [REMOTE ] NTEST: Full fetch complete (1986 records). [2025-09-29T02:05:00.003542] [DEBUG] [VALIDATOR ] NTEST: Validating primary data. [2025-09-29T02:05:00.333124] [WARN ] [VALIDATOR ] NTEST: Validation failed - insufficient historical data. Have 168 unique days, need 200 days [2025-09-29T02:05:00.334184] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-29T02:05:00.337008] [FATAL] [MAIN ] NTEST: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:05:00.336673] [DEBUG] [LOCAL ] NVST: Loaded 52381 existing records from primary storage. [2025-09-29T02:05:00.348693] [INFO ] [MAIN ] NVST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:00.349378] [INFO ] [MAIN ] Update Progress: 1552/2371 symbols completed. NVST took 0.5s. Estimated remaining: 4m 2s. Rate: 202.9 symbols/min [2025-09-29T02:05:00.347875] [WARN ] [MAIN ] NTEST: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:05:00.349876] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-03. [2025-09-29T02:05:00.350043] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-09-29T02:05:00.405921] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-09-29T02:05:00.447686] [INFO ] [LOCAL ] NTEST: Starting deletion of derivative data. [2025-09-29T02:05:00.458771] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-29T02:05:00.472548] [DEBUG] [LOCAL ] NTEST: No derivative data file found to delete. [2025-09-29T02:05:00.485240] [INFO ] [MAIN ] Update Progress: 1553/2371 symbols completed. NTEST took 5.4s. Estimated remaining: 4m 2s. Rate: 203.0 symbols/min [2025-09-29T02:05:00.534334] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-09. [2025-09-29T02:05:00.696926] [INFO ] [MAIN ] NVT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:00.795845] [INFO ] [MAIN ] NWG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:00.838165] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-29T02:05:00.869314] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-04. [2025-09-29T02:05:00.895079] [DEBUG] [LOCAL ] NVT: Loaded 52330 existing records from primary storage. [2025-09-29T02:05:00.895667] [INFO ] [MAIN ] NVT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:00.896205] [INFO ] [MAIN ] Update Progress: 1554/2371 symbols completed. NVT took 0.5s. Estimated remaining: 4m 2s. Rate: 203.0 symbols/min [2025-09-29T02:05:01.068989] [DEBUG] [LOCAL ] NWG: Loaded 52318 existing records from primary storage. [2025-09-29T02:05:01.102857] [INFO ] [MAIN ] NWG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:01.103069] [INFO ] [MAIN ] Update Progress: 1555/2371 symbols completed. NWG took 0.6s. Estimated remaining: 4m 1s. Rate: 203.0 symbols/min [2025-09-29T02:05:01.123154] [INFO ] [MAIN ] NWN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:01.196150] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-29T02:05:01.270778] [INFO ] [REMOTE ] NPKI: Full fetch complete (53554 records). [2025-09-29T02:05:01.271464] [DEBUG] [VALIDATOR ] NPKI: Validating primary data. [2025-09-29T02:05:01.421758] [INFO ] [MAIN ] NX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:01.439006] [DEBUG] [LOCAL ] NWN: Loaded 27222 existing records from primary storage. [2025-09-29T02:05:01.459049] [INFO ] [MAIN ] NWN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:01.483669] [INFO ] [MAIN ] Update Progress: 1556/2371 symbols completed. NWN took 0.6s. Estimated remaining: 4m 1s. Rate: 203.0 symbols/min [2025-09-29T02:05:01.751884] [WARN ] [VALIDATOR ] NPKI: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-29T02:05:01.774892] [FATAL] [MAIN ] NPKI: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:05:01.807879] [WARN ] [MAIN ] NPKI: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:05:01.807714] [DEBUG] [LOCAL ] NX: Loaded 33894 existing records from primary storage. [2025-09-29T02:05:01.813286] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-09-29T02:05:01.839932] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-09-29T02:05:01.845287] [INFO ] [MAIN ] NX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:01.891221] [INFO ] [LOCAL ] NPKI: Starting deletion of derivative data. [2025-09-29T02:05:01.891775] [INFO ] [MAIN ] Update Progress: 1557/2371 symbols completed. NX took 0.8s. Estimated remaining: 4m 1s. Rate: 202.9 symbols/min [2025-09-29T02:05:01.897400] [DEBUG] [LOCAL ] NPKI: No derivative data file found to delete. [2025-09-29T02:05:01.897046] [INFO ] [MAIN ] NXC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:01.898472] [INFO ] [MAIN ] Update Progress: 1558/2371 symbols completed. NPKI took 11.3s. Estimated remaining: 4m 0s. Rate: 203.0 symbols/min [2025-09-29T02:05:01.937551] [DEBUG] [LOCAL ] NXC: Loaded 4313 existing records from primary storage. [2025-09-29T02:05:01.940474] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-29T02:05:01.940756] [INFO ] [MAIN ] NXC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:01.946792] [INFO ] [MAIN ] Update Progress: 1559/2371 symbols completed. NXC took 0.4s. Estimated remaining: 3m 60s. Rate: 203.1 symbols/min [2025-09-29T02:05:01.956960] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-05. [2025-09-29T02:05:02.810771] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-29T02:05:02.822074] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-06. [2025-09-29T02:05:03.720761] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-29T02:05:03.732319] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-07. [2025-09-29T02:05:04.317305] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-29T02:05:04.329867] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-08. [2025-09-29T02:05:05.134497] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-29T02:05:05.146796] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-09. [2025-09-29T02:05:05.941036] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-29T02:05:05.951074] [INFO ] [REMOTE ] NUE: Full fetch complete (74902 records). [2025-09-29T02:05:05.951298] [DEBUG] [VALIDATOR ] NUE: Validating primary data. [2025-09-29T02:05:06.176714] [WARN ] [VALIDATOR ] NUE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-29T02:05:06.177491] [FATAL] [MAIN ] NUE: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:05:06.177569] [WARN ] [MAIN ] NUE: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:05:06.177680] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-09-29T02:05:06.177804] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-09-29T02:05:06.177886] [INFO ] [LOCAL ] NUE: Starting deletion of derivative data. [2025-09-29T02:05:06.177982] [DEBUG] [LOCAL ] NUE: No derivative data file found to delete. [2025-09-29T02:05:06.178195] [INFO ] [MAIN ] Update Progress: 1560/2371 symbols completed. NUE took 9.7s. Estimated remaining: 4m 2s. Rate: 201.4 symbols/min [2025-09-29T02:05:06.872204] [INFO ] [MAIN ] NXG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:06.887355] [INFO ] [MAIN ] NXDT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:06.957019] [INFO ] [MAIN ] NXE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:06.958419] [INFO ] [MAIN ] NXDR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:06.960113] [DEBUG] [LOCAL ] NXDR: No existing data file found in primary storage. [2025-09-29T02:05:06.960205] [WARN ] [MAIN ] NXDR: No existing data found, performing full refresh instead. [2025-09-29T02:05:06.960310] [INFO ] [MAIN ] NXDR: Wiping existing primary data before full refresh. [2025-09-29T02:05:06.960381] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-09-29T02:05:06.960466] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-09-29T02:05:06.960540] [INFO ] [MAIN ] NXDR: Starting full primary refresh. [2025-09-29T02:05:07.083465] [DEBUG] [LOCAL ] NXG: Loaded 10647 existing records from primary storage. [2025-09-29T02:05:07.091856] [DEBUG] [LOCAL ] NXDT: Loaded 16531 existing records from primary storage. [2025-09-29T02:05:07.096483] [INFO ] [MAIN ] NXG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:07.097358] [INFO ] [MAIN ] NXDT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:07.102874] [INFO ] [MAIN ] Update Progress: 1561/2371 symbols completed. NXG took 0.9s. Estimated remaining: 4m 2s. Rate: 201.2 symbols/min [2025-09-29T02:05:07.136304] [INFO ] [MAIN ] Update Progress: 1562/2371 symbols completed. NXDT took 0.9s. Estimated remaining: 4m 1s. Rate: 201.3 symbols/min [2025-09-29T02:05:07.564130] [DEBUG] [LOCAL ] NXE: Loaded 53762 existing records from primary storage. [2025-09-29T02:05:07.616342] [INFO ] [MAIN ] NXE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:07.724714] [INFO ] [MAIN ] Update Progress: 1563/2371 symbols completed. NXE took 1.5s. Estimated remaining: 4m 1s. Rate: 201.1 symbols/min [2025-09-29T02:05:07.848075] [INFO ] [MAIN ] NXN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:07.820473] [INFO ] [MAIN ] NXJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:08.040268] [DEBUG] [LOCAL ] NXN: Loaded 2376 existing records from primary storage. [2025-09-29T02:05:08.044037] [INFO ] [REMOTE ] NXDR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:05:08.066469] [INFO ] [MAIN ] NXN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:08.071687] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2024-12. [2025-09-29T02:05:08.072087] [INFO ] [MAIN ] Update Progress: 1564/2371 symbols completed. NXN took 0.9s. Estimated remaining: 4m 1s. Rate: 201.1 symbols/min [2025-09-29T02:05:08.167386] [DEBUG] [LOCAL ] NXJ: Loaded 15066 existing records from primary storage. [2025-09-29T02:05:08.274473] [INFO ] [MAIN ] NXP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:08.275492] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:05:08.268730] [INFO ] [MAIN ] NXJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:08.277403] [WARN ] [REMOTE ] NXDR: No data returned for month 2024-12 [2025-09-29T02:05:08.277297] [INFO ] [MAIN ] Update Progress: 1565/2371 symbols completed. NXJ took 1.2s. Estimated remaining: 4m 0s. Rate: 201.2 symbols/min [2025-09-29T02:05:08.284156] [FATAL] [REMOTE ] NXDR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:05:08.371008] [FATAL] [MAIN ] NXDR: Failed to fetch primary data. [2025-09-29T02:05:08.396434] [WARN ] [MAIN ] NXDR: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:05:08.415895] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-09-29T02:05:08.447226] [INFO ] [MAIN ] NXRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:08.447455] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-09-29T02:05:08.464196] [DEBUG] [LOCAL ] NXP: Loaded 12465 existing records from primary storage. [2025-09-29T02:05:08.469771] [INFO ] [LOCAL ] NXDR: Starting deletion of derivative data. [2025-09-29T02:05:08.481634] [INFO ] [MAIN ] NXP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:08.502016] [INFO ] [MAIN ] Update Progress: 1566/2371 symbols completed. NXP took 0.7s. Estimated remaining: 4m 0s. Rate: 201.2 symbols/min [2025-09-29T02:05:08.502326] [DEBUG] [LOCAL ] NXDR: No derivative data file found to delete. [2025-09-29T02:05:08.583153] [INFO ] [MAIN ] Update Progress: 1567/2371 symbols completed. NXDR took 2.4s. Estimated remaining: 3m 60s. Rate: 201.3 symbols/min [2025-09-29T02:05:08.687209] [INFO ] [MAIN ] NYC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:08.736629] [DEBUG] [LOCAL ] NXRT: Loaded 19307 existing records from primary storage. [2025-09-29T02:05:08.747095] [DEBUG] [LOCAL ] NYC: No existing data file found in primary storage. [2025-09-29T02:05:08.780334] [INFO ] [MAIN ] NXRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:08.770584] [WARN ] [MAIN ] NYC: No existing data found, performing full refresh instead. [2025-09-29T02:05:08.785872] [INFO ] [MAIN ] NYC: Wiping existing primary data before full refresh. [2025-09-29T02:05:08.785991] [INFO ] [MAIN ] Update Progress: 1568/2371 symbols completed. NXRT took 0.7s. Estimated remaining: 3m 59s. Rate: 201.3 symbols/min [2025-09-29T02:05:08.786177] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-09-29T02:05:08.890437] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-09-29T02:05:08.930165] [INFO ] [MAIN ] NYC: Starting full primary refresh. [2025-09-29T02:05:09.035698] [INFO ] [MAIN ] NYT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:09.243837] [INFO ] [MAIN ] NZF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:09.370091] [INFO ] [MAIN ] O: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:09.370531] [DEBUG] [LOCAL ] O: No existing data file found in primary storage. [2025-09-29T02:05:09.370607] [WARN ] [MAIN ] O: No existing data found, performing full refresh instead. [2025-09-29T02:05:09.370792] [INFO ] [MAIN ] O: Wiping existing primary data before full refresh. [2025-09-29T02:05:09.370872] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-09-29T02:05:09.370980] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-09-29T02:05:09.371057] [INFO ] [MAIN ] O: Starting full primary refresh. [2025-09-29T02:05:09.693056] [DEBUG] [LOCAL ] NYT: Loaded 50645 existing records from primary storage. [2025-09-29T02:05:09.744347] [INFO ] [MAIN ] NYT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:09.810087] [DEBUG] [LOCAL ] NZF: Loaded 29361 existing records from primary storage. [2025-09-29T02:05:09.841474] [INFO ] [MAIN ] Update Progress: 1569/2371 symbols completed. NYT took 1.3s. Estimated remaining: 3m 59s. Rate: 201.0 symbols/min [2025-09-29T02:05:09.842909] [INFO ] [MAIN ] NZF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:09.874201] [INFO ] [REMOTE ] NYC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:05:09.905628] [INFO ] [MAIN ] Update Progress: 1570/2371 symbols completed. NZF took 1.3s. Estimated remaining: 3m 59s. Rate: 201.1 symbols/min [2025-09-29T02:05:09.991323] [INFO ] [REMOTE ] NYC: Fetching primary data for 2024-12. [2025-09-29T02:05:10.408685] [INFO ] [MAIN ] OBDC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:10.480093] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-29T02:05:10.479782] [INFO ] [REMOTE ] O: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:05:10.481294] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-01. [2025-09-29T02:05:10.473481] [INFO ] [MAIN ] OBK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:10.482404] [INFO ] [REMOTE ] O: Fetching primary data for 2024-12. [2025-09-29T02:05:10.504032] [DEBUG] [LOCAL ] OBK: Loaded 16512 existing records from primary storage. [2025-09-29T02:05:10.504410] [INFO ] [MAIN ] OBK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:10.504664] [INFO ] [MAIN ] Update Progress: 1571/2371 symbols completed. OBK took 0.5s. Estimated remaining: 3m 59s. Rate: 201.0 symbols/min [2025-09-29T02:05:10.733268] [INFO ] [MAIN ] OC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:10.735401] [DEBUG] [LOCAL ] OBDC: Loaded 52426 existing records from primary storage. [2025-09-29T02:05:10.736194] [INFO ] [MAIN ] OBDC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:10.736954] [INFO ] [MAIN ] Update Progress: 1572/2371 symbols completed. OBDC took 0.9s. Estimated remaining: 3m 59s. Rate: 201.0 symbols/min [2025-09-29T02:05:10.818331] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-29T02:05:10.836220] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-02. [2025-09-29T02:05:10.949625] [INFO ] [MAIN ] OCFT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:10.976096] [DEBUG] [LOCAL ] OCFT: Loaded 8916 existing records from primary storage. [2025-09-29T02:05:10.988145] [INFO ] [MAIN ] OCFT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:10.988453] [INFO ] [MAIN ] Update Progress: 1573/2371 symbols completed. OCFT took 0.3s. Estimated remaining: 3m 58s. Rate: 201.0 symbols/min [2025-09-29T02:05:11.066566] [DEBUG] [LOCAL ] OC: Loaded 45369 existing records from primary storage. [2025-09-29T02:05:11.079204] [INFO ] [MAIN ] OC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:11.079505] [INFO ] [MAIN ] Update Progress: 1574/2371 symbols completed. OC took 0.6s. Estimated remaining: 3m 58s. Rate: 201.1 symbols/min [2025-09-29T02:05:11.304355] [INFO ] [MAIN ] ODC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:11.318474] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-29T02:05:11.336252] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-03. [2025-09-29T02:05:11.386123] [INFO ] [MAIN ] ODV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:11.395666] [DEBUG] [LOCAL ] ODC: Loaded 8633 existing records from primary storage. [2025-09-29T02:05:11.396178] [INFO ] [MAIN ] ODC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:11.396356] [INFO ] [MAIN ] Update Progress: 1575/2371 symbols completed. ODC took 0.4s. Estimated remaining: 3m 57s. Rate: 201.1 symbols/min [2025-09-29T02:05:11.563696] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-09-29T02:05:11.559813] [INFO ] [REMOTE ] O: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-29T02:05:11.571493] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-04. [2025-09-29T02:05:11.631689] [INFO ] [REMOTE ] O: Fetching primary data for 2025-01. [2025-09-29T02:05:11.670139] [INFO ] [MAIN ] OEC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:11.680994] [DEBUG] [LOCAL ] ODV: Loaded 26258 existing records from primary storage. [2025-09-29T02:05:11.681571] [INFO ] [MAIN ] ODV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:11.681716] [INFO ] [MAIN ] Update Progress: 1576/2371 symbols completed. ODV took 0.6s. Estimated remaining: 3m 57s. Rate: 201.1 symbols/min [2025-09-29T02:05:11.933901] [INFO ] [MAIN ] OFG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:11.939456] [DEBUG] [LOCAL ] OEC: Loaded 37689 existing records from primary storage. [2025-09-29T02:05:11.939886] [INFO ] [MAIN ] OEC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:11.940099] [INFO ] [MAIN ] Update Progress: 1577/2371 symbols completed. OEC took 0.5s. Estimated remaining: 3m 57s. Rate: 201.1 symbols/min [2025-09-29T02:05:12.017638] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-29T02:05:12.047670] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-05. [2025-09-29T02:05:12.159753] [DEBUG] [LOCAL ] OFG: Loaded 22393 existing records from primary storage. [2025-09-29T02:05:12.158605] [INFO ] [MAIN ] OGE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:12.160748] [INFO ] [MAIN ] OFG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:12.160932] [INFO ] [MAIN ] Update Progress: 1578/2371 symbols completed. OFG took 0.5s. Estimated remaining: 3m 57s. Rate: 201.2 symbols/min [2025-09-29T02:05:12.326297] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-09-29T02:05:12.380441] [INFO ] [MAIN ] OGN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:12.411218] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-06. [2025-09-29T02:05:12.439032] [DEBUG] [LOCAL ] OGE: Loaded 47046 existing records from primary storage. [2025-09-29T02:05:12.440364] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-29T02:05:12.441274] [INFO ] [MAIN ] OGE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:12.452470] [INFO ] [MAIN ] Update Progress: 1579/2371 symbols completed. OGE took 0.5s. Estimated remaining: 3m 56s. Rate: 201.2 symbols/min [2025-09-29T02:05:12.586369] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-06 (0.18 seconds). [2025-09-29T02:05:12.726698] [DEBUG] [LOCAL ] OGN: Loaded 53882 existing records from primary storage. [2025-09-29T02:05:12.728003] [INFO ] [MAIN ] OGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:12.728534] [INFO ] [MAIN ] OGN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:12.728753] [INFO ] [MAIN ] Update Progress: 1580/2371 symbols completed. OGN took 0.6s. Estimated remaining: 3m 56s. Rate: 201.2 symbols/min [2025-09-29T02:05:12.936148] [INFO ] [MAIN ] OHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:12.951273] [DEBUG] [LOCAL ] OGS: Loaded 34591 existing records from primary storage. [2025-09-29T02:05:12.951882] [INFO ] [MAIN ] OGS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:12.951990] [INFO ] [MAIN ] Update Progress: 1581/2371 symbols completed. OGS took 0.5s. Estimated remaining: 3m 56s. Rate: 201.2 symbols/min [2025-09-29T02:05:13.166108] [INFO ] [MAIN ] OI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:13.187595] [DEBUG] [LOCAL ] OHI: Loaded 52824 existing records from primary storage. [2025-09-29T02:05:13.188038] [INFO ] [MAIN ] OHI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:13.188181] [INFO ] [MAIN ] Update Progress: 1582/2371 symbols completed. OHI took 0.5s. Estimated remaining: 3m 55s. Rate: 201.2 symbols/min [2025-09-29T02:05:13.205254] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-07. [2025-09-29T02:05:13.421830] [INFO ] [MAIN ] OIA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:13.422199] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-07 (0.22 seconds). [2025-09-29T02:05:13.430016] [DEBUG] [LOCAL ] OI: Loaded 48011 existing records from primary storage. [2025-09-29T02:05:13.430705] [INFO ] [MAIN ] OI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:13.430829] [INFO ] [MAIN ] Update Progress: 1583/2371 symbols completed. OI took 0.5s. Estimated remaining: 3m 55s. Rate: 201.3 symbols/min [2025-09-29T02:05:13.582724] [DEBUG] [LOCAL ] OIA: Loaded 14218 existing records from primary storage. [2025-09-29T02:05:13.603709] [INFO ] [MAIN ] OIA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:13.627465] [INFO ] [MAIN ] Update Progress: 1584/2371 symbols completed. OIA took 0.4s. Estimated remaining: 3m 55s. Rate: 201.3 symbols/min [2025-09-29T02:05:13.682415] [INFO ] [MAIN ] OII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:13.849291] [INFO ] [MAIN ] OIS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:13.884462] [DEBUG] [LOCAL ] OII: Loaded 43406 existing records from primary storage. [2025-09-29T02:05:13.884868] [INFO ] [MAIN ] OII: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:13.885304] [INFO ] [MAIN ] Update Progress: 1585/2371 symbols completed. OII took 0.5s. Estimated remaining: 3m 54s. Rate: 201.3 symbols/min [2025-09-29T02:05:14.001754] [INFO ] [REMOTE ] O: Fetching primary data for 2025-02. [2025-09-29T02:05:14.111956] [INFO ] [MAIN ] OKE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:14.114410] [DEBUG] [LOCAL ] OIS: Loaded 41135 existing records from primary storage. [2025-09-29T02:05:14.115089] [INFO ] [MAIN ] OIS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:14.115209] [INFO ] [MAIN ] Update Progress: 1586/2371 symbols completed. OIS took 0.5s. Estimated remaining: 3m 54s. Rate: 201.3 symbols/min [2025-09-29T02:05:14.313635] [INFO ] [MAIN ] OKLO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:14.362089] [DEBUG] [LOCAL ] OKE: Loaded 54316 existing records from primary storage. [2025-09-29T02:05:14.362755] [INFO ] [MAIN ] OKE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:14.362895] [INFO ] [MAIN ] Update Progress: 1587/2371 symbols completed. OKE took 0.5s. Estimated remaining: 3m 54s. Rate: 201.4 symbols/min [2025-09-29T02:05:14.572330] [INFO ] [MAIN ] OLN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:14.597490] [DEBUG] [LOCAL ] OKLO: Loaded 54599 existing records from primary storage. [2025-09-29T02:05:14.598026] [INFO ] [MAIN ] OKLO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:14.598134] [INFO ] [MAIN ] Update Progress: 1588/2371 symbols completed. OKLO took 0.5s. Estimated remaining: 3m 53s. Rate: 201.4 symbols/min [2025-09-29T02:05:14.805071] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-08. [2025-09-29T02:05:14.810634] [INFO ] [MAIN ] OLP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:14.841004] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-29T02:05:14.877427] [DEBUG] [LOCAL ] OLN: Loaded 52512 existing records from primary storage. [2025-09-29T02:05:14.883065] [DEBUG] [LOCAL ] OLP: Loaded 9963 existing records from primary storage. [2025-09-29T02:05:14.883396] [INFO ] [MAIN ] OLN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:14.883487] [INFO ] [MAIN ] OLP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:14.884064] [INFO ] [MAIN ] Update Progress: 1589/2371 symbols completed. OLN took 0.5s. Estimated remaining: 3m 53s. Rate: 201.4 symbols/min [2025-09-29T02:05:14.890490] [INFO ] [MAIN ] Update Progress: 1590/2371 symbols completed. OLP took 0.3s. Estimated remaining: 3m 53s. Rate: 201.5 symbols/min [2025-09-29T02:05:15.063460] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-09-29T02:05:15.273585] [INFO ] [MAIN ] OMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:15.295323] [INFO ] [MAIN ] OMF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:15.384512] [DEBUG] [LOCAL ] OMF: Loaded 46898 existing records from primary storage. [2025-09-29T02:05:15.386385] [DEBUG] [LOCAL ] OMC: Loaded 54068 existing records from primary storage. [2025-09-29T02:05:15.386875] [INFO ] [MAIN ] OMF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:15.386999] [INFO ] [MAIN ] OMC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:15.387151] [INFO ] [MAIN ] Update Progress: 1591/2371 symbols completed. OMF took 0.4s. Estimated remaining: 3m 52s. Rate: 201.4 symbols/min [2025-09-29T02:05:15.413198] [INFO ] [MAIN ] Update Progress: 1592/2371 symbols completed. OMC took 0.5s. Estimated remaining: 3m 52s. Rate: 201.5 symbols/min [2025-09-29T02:05:15.603996] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-09. [2025-09-29T02:05:15.789483] [INFO ] [MAIN ] ONIT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:15.793367] [INFO ] [MAIN ] OMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:15.805166] [DEBUG] [LOCAL ] ONIT: Loaded 7871 existing records from primary storage. [2025-09-29T02:05:15.805450] [INFO ] [MAIN ] ONIT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:15.805868] [INFO ] [MAIN ] Update Progress: 1593/2371 symbols completed. ONIT took 0.4s. Estimated remaining: 3m 52s. Rate: 201.5 symbols/min [2025-09-29T02:05:16.016396] [INFO ] [MAIN ] ONL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:16.035783] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-29T02:05:16.038323] [DEBUG] [LOCAL ] OMI: Loaded 46583 existing records from primary storage. [2025-09-29T02:05:16.039968] [INFO ] [REMOTE ] NYC: Full fetch complete (1919 records). [2025-09-29T02:05:16.040612] [DEBUG] [VALIDATOR ] NYC: Validating primary data. [2025-09-29T02:05:16.040459] [INFO ] [MAIN ] OMI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:16.064244] [INFO ] [MAIN ] Update Progress: 1594/2371 symbols completed. OMI took 0.7s. Estimated remaining: 3m 51s. Rate: 201.5 symbols/min [2025-09-29T02:05:16.338286] [DEBUG] [LOCAL ] ONL: Loaded 31806 existing records from primary storage. [2025-09-29T02:05:16.416408] [INFO ] [REMOTE ] O: Fetching primary data for 2025-03. [2025-09-29T02:05:16.392875] [INFO ] [MAIN ] ONL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:16.462937] [INFO ] [MAIN ] ONON: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:16.477905] [INFO ] [MAIN ] Update Progress: 1595/2371 symbols completed. ONL took 0.7s. Estimated remaining: 3m 51s. Rate: 201.5 symbols/min [2025-09-29T02:05:16.485660] [WARN ] [VALIDATOR ] NYC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-29T02:05:16.510120] [FATAL] [MAIN ] NYC: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:05:16.547961] [WARN ] [MAIN ] NYC: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:05:16.592543] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-09-29T02:05:16.606415] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-09-29T02:05:16.622666] [INFO ] [LOCAL ] NYC: Starting deletion of derivative data. [2025-09-29T02:05:16.633259] [DEBUG] [LOCAL ] NYC: No derivative data file found to delete. [2025-09-29T02:05:16.663064] [INFO ] [MAIN ] Update Progress: 1596/2371 symbols completed. NYC took 8.4s. Estimated remaining: 3m 51s. Rate: 201.5 symbols/min [2025-09-29T02:05:16.687537] [INFO ] [MAIN ] ONTF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:16.854519] [DEBUG] [LOCAL ] ONON: Loaded 54392 existing records from primary storage. [2025-09-29T02:05:16.865859] [INFO ] [MAIN ] ONON: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:16.881590] [INFO ] [MAIN ] Update Progress: 1597/2371 symbols completed. ONON took 0.8s. Estimated remaining: 3m 50s. Rate: 201.6 symbols/min [2025-09-29T02:05:16.950451] [INFO ] [MAIN ] ONTO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:16.959487] [DEBUG] [LOCAL ] ONTF: Loaded 23187 existing records from primary storage. [2025-09-29T02:05:16.959954] [INFO ] [MAIN ] ONTF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:16.960063] [INFO ] [MAIN ] Update Progress: 1598/2371 symbols completed. ONTF took 0.5s. Estimated remaining: 3m 50s. Rate: 201.7 symbols/min [2025-09-29T02:05:17.012808] [DEBUG] [LOCAL ] ONTO: Loaded 47339 existing records from primary storage. [2025-09-29T02:05:17.013184] [INFO ] [MAIN ] ONTO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:17.013289] [INFO ] [MAIN ] Update Progress: 1599/2371 symbols completed. ONTO took 0.3s. Estimated remaining: 3m 50s. Rate: 201.8 symbols/min [2025-09-29T02:05:17.304077] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-29T02:05:17.315615] [INFO ] [REMOTE ] O: Fetching primary data for 2025-04. [2025-09-29T02:05:18.197456] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-29T02:05:18.217138] [INFO ] [REMOTE ] O: Fetching primary data for 2025-05. [2025-09-29T02:05:18.812366] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-29T02:05:18.825445] [INFO ] [REMOTE ] O: Fetching primary data for 2025-06. [2025-09-29T02:05:19.559350] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-29T02:05:19.600142] [INFO ] [REMOTE ] O: Fetching primary data for 2025-07. [2025-09-29T02:05:20.260753] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-29T02:05:20.400074] [INFO ] [REMOTE ] O: Fetching primary data for 2025-08. [2025-09-29T02:05:21.227534] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-29T02:05:21.239861] [INFO ] [REMOTE ] O: Fetching primary data for 2025-09. [2025-09-29T02:05:22.030531] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-29T02:05:22.041178] [INFO ] [REMOTE ] O: Full fetch complete (77559 records). [2025-09-29T02:05:22.041377] [DEBUG] [VALIDATOR ] O: Validating primary data. [2025-09-29T02:05:22.266480] [WARN ] [VALIDATOR ] O: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-29T02:05:22.267288] [FATAL] [MAIN ] O: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:05:22.267367] [WARN ] [MAIN ] O: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:05:22.267453] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-09-29T02:05:22.267592] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-09-29T02:05:22.267692] [INFO ] [LOCAL ] O: Starting deletion of derivative data. [2025-09-29T02:05:22.267793] [DEBUG] [LOCAL ] O: No derivative data file found to delete. [2025-09-29T02:05:22.268204] [INFO ] [MAIN ] Update Progress: 1600/2371 symbols completed. O took 13.5s. Estimated remaining: 3m 52s. Rate: 199.7 symbols/min [2025-09-29T02:05:22.952354] [INFO ] [MAIN ] OPAD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:23.097743] [INFO ] [MAIN ] OPFI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:23.096422] [INFO ] [MAIN ] OPP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:23.118849] [INFO ] [MAIN ] OOMA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:23.152934] [DEBUG] [LOCAL ] OPP: Loaded 11678 existing records from primary storage. [2025-09-29T02:05:23.153350] [INFO ] [MAIN ] OPP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:23.153515] [INFO ] [MAIN ] Update Progress: 1601/2371 symbols completed. OPP took 0.9s. Estimated remaining: 3m 52s. Rate: 199.4 symbols/min [2025-09-29T02:05:23.248931] [DEBUG] [LOCAL ] OPAD: Loaded 20793 existing records from primary storage. [2025-09-29T02:05:23.270161] [INFO ] [MAIN ] OPAD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:23.276793] [DEBUG] [LOCAL ] OOMA: Loaded 19260 existing records from primary storage. [2025-09-29T02:05:23.305897] [INFO ] [MAIN ] OOMA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:23.305721] [INFO ] [MAIN ] Update Progress: 1602/2371 symbols completed. OPAD took 1.0s. Estimated remaining: 3m 51s. Rate: 199.5 symbols/min [2025-09-29T02:05:23.312205] [INFO ] [MAIN ] Update Progress: 1603/2371 symbols completed. OOMA took 1.0s. Estimated remaining: 3m 51s. Rate: 199.6 symbols/min [2025-09-29T02:05:23.529955] [INFO ] [MAIN ] OPY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:23.618454] [DEBUG] [LOCAL ] OPY: No existing data file found in primary storage. [2025-09-29T02:05:23.595150] [DEBUG] [LOCAL ] OPFI: Loaded 47258 existing records from primary storage. [2025-09-29T02:05:23.649758] [WARN ] [MAIN ] OPY: No existing data found, performing full refresh instead. [2025-09-29T02:05:23.671450] [INFO ] [MAIN ] OPY: Wiping existing primary data before full refresh. [2025-09-29T02:05:23.670739] [INFO ] [MAIN ] OPFI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:23.676941] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-09-29T02:05:23.720321] [INFO ] [MAIN ] Update Progress: 1604/2371 symbols completed. OPFI took 1.4s. Estimated remaining: 3m 51s. Rate: 199.6 symbols/min [2025-09-29T02:05:23.738999] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-09-29T02:05:23.771291] [INFO ] [MAIN ] OPY: Starting full primary refresh. [2025-09-29T02:05:23.851712] [INFO ] [MAIN ] ORA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:23.882273] [INFO ] [MAIN ] OR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:24.165158] [INFO ] [MAIN ] ORC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:24.366804] [DEBUG] [LOCAL ] ORA: Loaded 33001 existing records from primary storage. [2025-09-29T02:05:24.405626] [INFO ] [MAIN ] ORA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:24.407933] [DEBUG] [LOCAL ] OR: Loaded 46786 existing records from primary storage. [2025-09-29T02:05:24.419088] [INFO ] [MAIN ] OR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:24.418856] [INFO ] [MAIN ] Update Progress: 1605/2371 symbols completed. ORA took 1.1s. Estimated remaining: 3m 50s. Rate: 199.4 symbols/min [2025-09-29T02:05:24.500846] [INFO ] [MAIN ] Update Progress: 1606/2371 symbols completed. OR took 1.2s. Estimated remaining: 3m 50s. Rate: 199.5 symbols/min [2025-09-29T02:05:24.556994] [INFO ] [REMOTE ] OPY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:05:24.585928] [INFO ] [REMOTE ] OPY: Fetching primary data for 2024-12. [2025-09-29T02:05:24.761332] [DEBUG] [LOCAL ] ORC: Loaded 53083 existing records from primary storage. [2025-09-29T02:05:24.803067] [INFO ] [MAIN ] ORC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:24.809051] [INFO ] [MAIN ] Update Progress: 1607/2371 symbols completed. ORC took 1.1s. Estimated remaining: 3m 50s. Rate: 199.5 symbols/min [2025-09-29T02:05:24.950314] [INFO ] [MAIN ] ORI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:25.021476] [DEBUG] [LOCAL ] ORI: No existing data file found in primary storage. [2025-09-29T02:05:25.049330] [INFO ] [MAIN ] ORCL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:25.056873] [DEBUG] [LOCAL ] ORCL: No existing data file found in primary storage. [2025-09-29T02:05:25.056698] [WARN ] [MAIN ] ORI: No existing data found, performing full refresh instead. [2025-09-29T02:05:25.062089] [WARN ] [MAIN ] ORCL: No existing data found, performing full refresh instead. [2025-09-29T02:05:25.064792] [INFO ] [MAIN ] ORCL: Wiping existing primary data before full refresh. [2025-09-29T02:05:25.076273] [INFO ] [MAIN ] ORI: Wiping existing primary data before full refresh. [2025-09-29T02:05:25.076509] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-09-29T02:05:25.076546] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-09-29T02:05:25.089529] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-09-29T02:05:25.089810] [INFO ] [MAIN ] ORCL: Starting full primary refresh. [2025-09-29T02:05:25.090228] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-09-29T02:05:25.122679] [INFO ] [MAIN ] ORI: Starting full primary refresh. [2025-09-29T02:05:25.275371] [INFO ] [MAIN ] ORN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:25.345205] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-29T02:05:25.392870] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-01. [2025-09-29T02:05:25.651009] [DEBUG] [LOCAL ] ORN: Loaded 31979 existing records from primary storage. [2025-09-29T02:05:25.713381] [INFO ] [MAIN ] ORN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:25.783873] [INFO ] [MAIN ] Update Progress: 1608/2371 symbols completed. ORN took 1.0s. Estimated remaining: 3m 50s. Rate: 199.2 symbols/min [2025-09-29T02:05:25.894330] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-29T02:05:26.021298] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-02. [2025-09-29T02:05:26.113098] [INFO ] [REMOTE ] ORCL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:05:26.143619] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2024-12. [2025-09-29T02:05:26.180825] [INFO ] [REMOTE ] ORI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:05:26.203518] [INFO ] [REMOTE ] ORI: Fetching primary data for 2024-12. [2025-09-29T02:05:26.263261] [INFO ] [MAIN ] OSCR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:26.325934] [DEBUG] [LOCAL ] OSCR: Loaded 54502 existing records from primary storage. [2025-09-29T02:05:26.326330] [INFO ] [MAIN ] OSCR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:26.326437] [INFO ] [MAIN ] Update Progress: 1609/2371 symbols completed. OSCR took 0.5s. Estimated remaining: 3m 50s. Rate: 199.1 symbols/min [2025-09-29T02:05:26.514380] [INFO ] [MAIN ] OSK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:26.515142] [DEBUG] [LOCAL ] OSK: No existing data file found in primary storage. [2025-09-29T02:05:26.515240] [WARN ] [MAIN ] OSK: No existing data found, performing full refresh instead. [2025-09-29T02:05:26.515355] [INFO ] [MAIN ] OSK: Wiping existing primary data before full refresh. [2025-09-29T02:05:26.515430] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-09-29T02:05:26.515515] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-09-29T02:05:26.515587] [INFO ] [MAIN ] OSK: Starting full primary refresh. [2025-09-29T02:05:26.623142] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-29T02:05:26.637865] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-03. [2025-09-29T02:05:26.844911] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-03 (0.21 seconds). [2025-09-29T02:05:26.857607] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-04. [2025-09-29T02:05:26.937389] [INFO ] [REMOTE ] OSK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:05:26.982588] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-29T02:05:27.077820] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-04 (0.22 seconds). [2025-09-29T02:05:27.112103] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-29T02:05:27.600131] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-05. [2025-09-29T02:05:28.057239] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-29T02:05:28.400077] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-01. [2025-09-29T02:05:29.175099] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-29T02:05:29.200087] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-06. [2025-09-29T02:05:29.667297] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-29T02:05:30.000068] [INFO ] [REMOTE ] OSK: Fetching primary data for 2024-12. [2025-09-29T02:05:30.300862] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2024-12 (0.30 seconds). [2025-09-29T02:05:30.800072] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-01. [2025-09-29T02:05:31.524861] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-29T02:05:31.600080] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-07. [2025-09-29T02:05:32.069126] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-29T02:05:32.400069] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-02. [2025-09-29T02:05:33.100408] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-29T02:05:33.200045] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-02. [2025-09-29T02:05:33.562491] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-29T02:05:34.000080] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-01. [2025-09-29T02:05:34.750678] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-29T02:05:34.800064] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-03. [2025-09-29T02:05:35.508432] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-29T02:05:35.600057] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-03. [2025-09-29T02:05:36.330463] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-29T02:05:36.400041] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-04. [2025-09-29T02:05:37.160063] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-29T02:05:37.200058] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-05. [2025-09-29T02:05:37.997563] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-29T02:05:38.007014] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-02. [2025-09-29T02:05:38.800065] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-06. [2025-09-29T02:05:38.871514] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-29T02:05:39.542896] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-29T02:05:39.600063] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-07. [2025-09-29T02:05:40.352575] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-29T02:05:40.400034] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-08. [2025-09-29T02:05:41.126802] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-29T02:05:41.200068] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-09. [2025-09-29T02:05:42.000043] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-04. [2025-09-29T02:05:42.093424] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-29T02:05:42.103751] [INFO ] [REMOTE ] ORI: Full fetch complete (70200 records). [2025-09-29T02:05:42.103962] [DEBUG] [VALIDATOR ] ORI: Validating primary data. [2025-09-29T02:05:42.331945] [WARN ] [VALIDATOR ] ORI: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-29T02:05:42.332793] [FATAL] [MAIN ] ORI: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:05:42.332871] [WARN ] [MAIN ] ORI: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:05:42.332951] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-09-29T02:05:42.333056] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-09-29T02:05:42.333131] [INFO ] [LOCAL ] ORI: Starting deletion of derivative data. [2025-09-29T02:05:42.333218] [DEBUG] [LOCAL ] ORI: No derivative data file found to delete. [2025-09-29T02:05:42.334132] [INFO ] [MAIN ] Update Progress: 1610/2371 symbols completed. ORI took 17.8s. Estimated remaining: 3m 57s. Rate: 192.9 symbols/min [2025-09-29T02:05:42.534372] [INFO ] [MAIN ] OTF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:42.534792] [DEBUG] [LOCAL ] OTF: No existing data file found in primary storage. [2025-09-29T02:05:42.535048] [WARN ] [MAIN ] OTF: No existing data found, performing full refresh instead. [2025-09-29T02:05:42.535221] [INFO ] [MAIN ] OTF: Wiping existing primary data before full refresh. [2025-09-29T02:05:42.535310] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-09-29T02:05:42.535427] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-09-29T02:05:42.535518] [INFO ] [MAIN ] OTF: Starting full primary refresh. [2025-09-29T02:05:42.804068] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-08. [2025-09-29T02:05:42.948238] [INFO ] [REMOTE ] OTF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:05:42.968142] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-29T02:05:43.006426] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-08 (0.20 seconds). [2025-09-29T02:05:43.600065] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-05. [2025-09-29T02:05:44.394518] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-29T02:05:44.403066] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-09. [2025-09-29T02:05:44.852678] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-29T02:05:44.855202] [INFO ] [REMOTE ] OPY: Full fetch complete (10014 records). [2025-09-29T02:05:44.855314] [DEBUG] [VALIDATOR ] OPY: Validating primary data. [2025-09-29T02:05:45.062158] [WARN ] [VALIDATOR ] OPY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-29T02:05:45.062435] [FATAL] [MAIN ] OPY: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:05:45.062510] [WARN ] [MAIN ] OPY: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:05:45.062589] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-09-29T02:05:45.062717] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-09-29T02:05:45.062794] [INFO ] [LOCAL ] OPY: Starting deletion of derivative data. [2025-09-29T02:05:45.062878] [DEBUG] [LOCAL ] OPY: No derivative data file found to delete. [2025-09-29T02:05:45.062980] [INFO ] [MAIN ] Update Progress: 1611/2371 symbols completed. OPY took 21.9s. Estimated remaining: 3m 58s. Rate: 191.9 symbols/min [2025-09-29T02:05:45.205246] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-06. [2025-09-29T02:05:45.255731] [INFO ] [MAIN ] OTIS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:45.320039] [DEBUG] [LOCAL ] OTIS: Loaded 53481 existing records from primary storage. [2025-09-29T02:05:45.320446] [INFO ] [MAIN ] OTIS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:45.320814] [INFO ] [MAIN ] Update Progress: 1612/2371 symbols completed. OTIS took 0.3s. Estimated remaining: 3m 57s. Rate: 192.0 symbols/min [2025-09-29T02:05:45.512277] [INFO ] [MAIN ] OUT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:45.570178] [DEBUG] [LOCAL ] OUT: Loaded 48630 existing records from primary storage. [2025-09-29T02:05:45.570579] [INFO ] [MAIN ] OUT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:45.570723] [INFO ] [MAIN ] Update Progress: 1613/2371 symbols completed. OUT took 0.2s. Estimated remaining: 3m 57s. Rate: 192.0 symbols/min [2025-09-29T02:05:45.759865] [INFO ] [MAIN ] OVV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:45.813112] [DEBUG] [LOCAL ] OVV: Loaded 54295 existing records from primary storage. [2025-09-29T02:05:45.813536] [INFO ] [MAIN ] OVV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:45.814011] [INFO ] [MAIN ] Update Progress: 1614/2371 symbols completed. OVV took 0.2s. Estimated remaining: 3m 57s. Rate: 192.0 symbols/min [2025-09-29T02:05:46.002397] [INFO ] [REMOTE ] OTF: Fetching primary data for 2024-12. [2025-09-29T02:05:46.007251] [INFO ] [MAIN ] OWL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:46.042778] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-29T02:05:46.107703] [DEBUG] [LOCAL ] OWL: Loaded 54335 existing records from primary storage. [2025-09-29T02:05:46.108106] [INFO ] [MAIN ] OWL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:46.108211] [INFO ] [MAIN ] Update Progress: 1615/2371 symbols completed. OWL took 0.3s. Estimated remaining: 3m 56s. Rate: 192.0 symbols/min [2025-09-29T02:05:46.156591] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:05:46.195369] [WARN ] [REMOTE ] OTF: No data returned for month 2024-12 [2025-09-29T02:05:46.208692] [FATAL] [REMOTE ] OTF: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:05:46.229786] [FATAL] [MAIN ] OTF: Failed to fetch primary data. [2025-09-29T02:05:46.246701] [WARN ] [MAIN ] OTF: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:05:46.258687] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-09-29T02:05:46.264755] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-09-29T02:05:46.283745] [INFO ] [LOCAL ] OTF: Starting deletion of derivative data. [2025-09-29T02:05:46.283836] [DEBUG] [LOCAL ] OTF: No derivative data file found to delete. [2025-09-29T02:05:46.283900] [INFO ] [MAIN ] Update Progress: 1616/2371 symbols completed. OTF took 3.9s. Estimated remaining: 3m 56s. Rate: 192.1 symbols/min [2025-09-29T02:05:46.414982] [INFO ] [MAIN ] OWLT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:46.522311] [INFO ] [MAIN ] OXM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:46.522777] [DEBUG] [LOCAL ] OWLT: Loaded 9099 existing records from primary storage. [2025-09-29T02:05:46.523297] [INFO ] [MAIN ] OWLT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:46.523830] [INFO ] [MAIN ] Update Progress: 1617/2371 symbols completed. OWLT took 0.4s. Estimated remaining: 3m 55s. Rate: 192.1 symbols/min [2025-09-29T02:05:46.743742] [INFO ] [MAIN ] OXY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:46.754919] [DEBUG] [LOCAL ] OXY: No existing data file found in primary storage. [2025-09-29T02:05:46.755223] [WARN ] [MAIN ] OXY: No existing data found, performing full refresh instead. [2025-09-29T02:05:46.755555] [INFO ] [MAIN ] OXY: Wiping existing primary data before full refresh. [2025-09-29T02:05:46.755789] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-09-29T02:05:46.756009] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-09-29T02:05:46.756238] [INFO ] [MAIN ] OXY: Starting full primary refresh. [2025-09-29T02:05:46.801725] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-07. [2025-09-29T02:05:46.792090] [DEBUG] [LOCAL ] OXM: Loaded 33928 existing records from primary storage. [2025-09-29T02:05:46.823779] [INFO ] [MAIN ] OXM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:46.824118] [INFO ] [MAIN ] Update Progress: 1618/2371 symbols completed. OXM took 0.5s. Estimated remaining: 3m 55s. Rate: 192.1 symbols/min [2025-09-29T02:05:47.211370] [INFO ] [MAIN ] PAAS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:47.442492] [INFO ] [REMOTE ] OXY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:05:47.484620] [DEBUG] [LOCAL ] PAAS: Loaded 54383 existing records from primary storage. [2025-09-29T02:05:47.485165] [INFO ] [MAIN ] PAAS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:47.485274] [INFO ] [MAIN ] Update Progress: 1619/2371 symbols completed. PAAS took 0.7s. Estimated remaining: 3m 55s. Rate: 192.0 symbols/min [2025-09-29T02:05:47.609222] [INFO ] [REMOTE ] OXY: Fetching primary data for 2024-12. [2025-09-29T02:05:47.676911] [INFO ] [MAIN ] PAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:47.706192] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-29T02:05:47.724729] [DEBUG] [LOCAL ] PAC: Loaded 11725 existing records from primary storage. [2025-09-29T02:05:47.725013] [INFO ] [MAIN ] PAC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:47.725410] [INFO ] [MAIN ] Update Progress: 1620/2371 symbols completed. PAC took 0.2s. Estimated remaining: 3m 55s. Rate: 192.0 symbols/min [2025-09-29T02:05:47.906093] [INFO ] [MAIN ] PACK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:47.940389] [DEBUG] [LOCAL ] PACK: Loaded 32471 existing records from primary storage. [2025-09-29T02:05:47.940743] [INFO ] [MAIN ] PACK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:47.940845] [INFO ] [MAIN ] Update Progress: 1621/2371 symbols completed. PACK took 0.2s. Estimated remaining: 3m 54s. Rate: 192.0 symbols/min [2025-09-29T02:05:48.127223] [INFO ] [MAIN ] PACS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:48.167944] [DEBUG] [LOCAL ] PACS: Loaded 34761 existing records from primary storage. [2025-09-29T02:05:48.168400] [INFO ] [MAIN ] PACS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:48.168544] [INFO ] [MAIN ] Update Progress: 1622/2371 symbols completed. PACS took 0.2s. Estimated remaining: 3m 54s. Rate: 192.1 symbols/min [2025-09-29T02:05:48.396555] [INFO ] [MAIN ] PAG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:48.400034] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-08. [2025-09-29T02:05:48.435093] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-29T02:05:48.465292] [DEBUG] [LOCAL ] PAG: Loaded 22217 existing records from primary storage. [2025-09-29T02:05:48.465698] [INFO ] [MAIN ] PAG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:48.465900] [INFO ] [MAIN ] Update Progress: 1623/2371 symbols completed. PAG took 0.3s. Estimated remaining: 3m 54s. Rate: 192.1 symbols/min [2025-09-29T02:05:48.667449] [INFO ] [MAIN ] PAGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:48.724274] [DEBUG] [LOCAL ] PAGS: Loaded 53447 existing records from primary storage. [2025-09-29T02:05:48.724753] [INFO ] [MAIN ] PAGS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:48.724858] [INFO ] [MAIN ] Update Progress: 1624/2371 symbols completed. PAGS took 0.3s. Estimated remaining: 3m 53s. Rate: 192.1 symbols/min [2025-09-29T02:05:48.916289] [INFO ] [MAIN ] PAI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:48.921305] [DEBUG] [LOCAL ] PAI: Loaded 2758 existing records from primary storage. [2025-09-29T02:05:48.921500] [INFO ] [MAIN ] PAI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:48.921906] [INFO ] [MAIN ] Update Progress: 1625/2371 symbols completed. PAI took 0.2s. Estimated remaining: 3m 53s. Rate: 192.1 symbols/min [2025-09-29T02:05:49.114599] [INFO ] [MAIN ] PAII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:49.115115] [DEBUG] [LOCAL ] PAII: No existing data file found in primary storage. [2025-09-29T02:05:49.115194] [WARN ] [MAIN ] PAII: No existing data found, performing full refresh instead. [2025-09-29T02:05:49.115441] [INFO ] [MAIN ] PAII: Wiping existing primary data before full refresh. [2025-09-29T02:05:49.115517] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-09-29T02:05:49.115602] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-09-29T02:05:49.115699] [INFO ] [MAIN ] PAII: Starting full primary refresh. [2025-09-29T02:05:49.200978] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-01. [2025-09-29T02:05:49.312925] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-29T02:05:49.561301] [INFO ] [REMOTE ] PAII: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:05:50.000102] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-03. [2025-09-29T02:05:50.041116] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-29T02:05:50.800063] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-09. [2025-09-29T02:05:50.848254] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-29T02:05:51.558473] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-29T02:05:51.568682] [INFO ] [REMOTE ] OSK: Full fetch complete (61451 records). [2025-09-29T02:05:51.568897] [DEBUG] [VALIDATOR ] OSK: Validating primary data. [2025-09-29T02:05:51.605210] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-02. [2025-09-29T02:05:51.802101] [WARN ] [VALIDATOR ] OSK: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-29T02:05:51.802860] [FATAL] [MAIN ] OSK: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:05:51.802949] [WARN ] [MAIN ] OSK: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:05:51.803044] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-09-29T02:05:51.803160] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-09-29T02:05:51.803251] [INFO ] [LOCAL ] OSK: Starting deletion of derivative data. [2025-09-29T02:05:51.803351] [DEBUG] [LOCAL ] OSK: No derivative data file found to delete. [2025-09-29T02:05:51.803517] [INFO ] [MAIN ] Update Progress: 1626/2371 symbols completed. OSK took 25.5s. Estimated remaining: 3m 54s. Rate: 191.2 symbols/min [2025-09-29T02:05:51.989243] [INFO ] [MAIN ] PAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:52.022156] [DEBUG] [LOCAL ] PAM: Loaded 28420 existing records from primary storage. [2025-09-29T02:05:52.022543] [INFO ] [MAIN ] PAM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:52.022692] [INFO ] [MAIN ] Update Progress: 1627/2371 symbols completed. PAM took 0.2s. Estimated remaining: 3m 53s. Rate: 191.2 symbols/min [2025-09-29T02:05:52.226580] [INFO ] [MAIN ] PAR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:52.275970] [DEBUG] [LOCAL ] PAR: Loaded 33188 existing records from primary storage. [2025-09-29T02:05:52.276453] [INFO ] [MAIN ] PAR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:52.276582] [INFO ] [MAIN ] Update Progress: 1628/2371 symbols completed. PAR took 0.3s. Estimated remaining: 3m 53s. Rate: 191.2 symbols/min [2025-09-29T02:05:52.404026] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-04. [2025-09-29T02:05:52.476095] [INFO ] [MAIN ] PARR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:52.508705] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-29T02:05:52.563332] [DEBUG] [LOCAL ] PARR: Loaded 49062 existing records from primary storage. [2025-09-29T02:05:52.563740] [INFO ] [MAIN ] PARR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:52.563845] [INFO ] [MAIN ] Update Progress: 1629/2371 symbols completed. PARR took 0.3s. Estimated remaining: 3m 53s. Rate: 191.2 symbols/min [2025-09-29T02:05:52.741459] [INFO ] [MAIN ] PATH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:52.801341] [DEBUG] [LOCAL ] PATH: Loaded 54457 existing records from primary storage. [2025-09-29T02:05:52.801800] [INFO ] [MAIN ] PATH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:52.801933] [INFO ] [MAIN ] Update Progress: 1630/2371 symbols completed. PATH took 0.2s. Estimated remaining: 3m 52s. Rate: 191.3 symbols/min [2025-09-29T02:05:52.988794] [INFO ] [MAIN ] PAXS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:53.014282] [DEBUG] [LOCAL ] PAXS: Loaded 21210 existing records from primary storage. [2025-09-29T02:05:53.014587] [INFO ] [MAIN ] PAXS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:53.014714] [INFO ] [MAIN ] Update Progress: 1631/2371 symbols completed. PAXS took 0.2s. Estimated remaining: 3m 52s. Rate: 191.3 symbols/min [2025-09-29T02:05:53.215536] [INFO ] [REMOTE ] PAII: Fetching primary data for 2024-12. [2025-09-29T02:05:53.224580] [INFO ] [MAIN ] PAY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:53.265945] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-29T02:05:53.314307] [DEBUG] [LOCAL ] PAY: Loaded 38892 existing records from primary storage. [2025-09-29T02:05:53.314741] [INFO ] [MAIN ] PAY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:53.314856] [INFO ] [MAIN ] Update Progress: 1632/2371 symbols completed. PAY took 0.3s. Estimated remaining: 3m 52s. Rate: 191.3 symbols/min [2025-09-29T02:05:53.378915] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:05:53.409473] [WARN ] [REMOTE ] PAII: No data returned for month 2024-12 [2025-09-29T02:05:53.419271] [FATAL] [REMOTE ] PAII: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:05:53.440817] [FATAL] [MAIN ] PAII: Failed to fetch primary data. [2025-09-29T02:05:53.446737] [WARN ] [MAIN ] PAII: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:05:53.446892] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-09-29T02:05:53.472803] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-09-29T02:05:53.501983] [INFO ] [LOCAL ] PAII: Starting deletion of derivative data. [2025-09-29T02:05:53.525896] [INFO ] [MAIN ] PAYC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:53.526560] [DEBUG] [LOCAL ] PAII: No derivative data file found to delete. [2025-09-29T02:05:53.526770] [INFO ] [MAIN ] Update Progress: 1633/2371 symbols completed. PAII took 4.6s. Estimated remaining: 3m 51s. Rate: 191.4 symbols/min [2025-09-29T02:05:53.732506] [INFO ] [MAIN ] PB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:53.748830] [DEBUG] [LOCAL ] PAYC: Loaded 36903 existing records from primary storage. [2025-09-29T02:05:53.749352] [INFO ] [MAIN ] PAYC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:53.749459] [INFO ] [MAIN ] Update Progress: 1634/2371 symbols completed. PAYC took 0.4s. Estimated remaining: 3m 51s. Rate: 191.4 symbols/min [2025-09-29T02:05:53.971021] [INFO ] [MAIN ] PBA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:53.986603] [DEBUG] [LOCAL ] PB: Loaded 42025 existing records from primary storage. [2025-09-29T02:05:53.987091] [INFO ] [MAIN ] PB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:53.987305] [INFO ] [MAIN ] Update Progress: 1635/2371 symbols completed. PB took 0.5s. Estimated remaining: 3m 51s. Rate: 191.4 symbols/min [2025-09-29T02:05:54.009011] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-05. [2025-09-29T02:05:54.220639] [INFO ] [MAIN ] PBF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:54.240698] [DEBUG] [LOCAL ] PBA: Loaded 49665 existing records from primary storage. [2025-09-29T02:05:54.241157] [INFO ] [MAIN ] PBA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:54.241264] [INFO ] [MAIN ] Update Progress: 1636/2371 symbols completed. PBA took 0.5s. Estimated remaining: 3m 50s. Rate: 191.4 symbols/min [2025-09-29T02:05:54.455499] [INFO ] [MAIN ] PBH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:05:54.488388] [DEBUG] [LOCAL ] PBF: Loaded 53866 existing records from primary storage. [2025-09-29T02:05:54.489035] [INFO ] [MAIN ] PBF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:54.489183] [INFO ] [MAIN ] Update Progress: 1637/2371 symbols completed. PBF took 0.5s. Estimated remaining: 3m 50s. Rate: 191.5 symbols/min [2025-09-29T02:05:54.517544] [DEBUG] [LOCAL ] PBH: Loaded 32156 existing records from primary storage. [2025-09-29T02:05:54.517922] [INFO ] [MAIN ] PBH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:05:54.518025] [INFO ] [MAIN ] Update Progress: 1638/2371 symbols completed. PBH took 0.3s. Estimated remaining: 3m 50s. Rate: 191.6 symbols/min [2025-09-29T02:05:54.800089] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-03. [2025-09-29T02:05:55.068201] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-29T02:05:55.570997] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-29T02:05:55.600030] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-04. [2025-09-29T02:05:56.362043] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-29T02:05:56.400028] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-05. [2025-09-29T02:05:57.206128] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-06. [2025-09-29T02:05:57.209048] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-29T02:05:58.009254] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-06. [2025-09-29T02:05:58.030152] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-29T02:05:58.793705] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-29T02:05:58.804119] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-07. [2025-09-29T02:05:59.218070] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-29T02:05:59.600070] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-07. [2025-09-29T02:06:00.004093] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-29T02:06:00.400069] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-08. [2025-09-29T02:06:01.200088] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-08. [2025-09-29T02:06:01.288140] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-29T02:06:01.914337] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-29T02:06:02.000161] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-09. [2025-09-29T02:06:02.447592] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-29T02:06:02.458705] [INFO ] [REMOTE ] ORCL: Full fetch complete (77532 records). [2025-09-29T02:06:02.458917] [DEBUG] [VALIDATOR ] ORCL: Validating primary data. [2025-09-29T02:06:02.673082] [WARN ] [VALIDATOR ] ORCL: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-29T02:06:02.673919] [FATAL] [MAIN ] ORCL: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:06:02.674018] [WARN ] [MAIN ] ORCL: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:06:02.674127] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-09-29T02:06:02.674251] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-09-29T02:06:02.674346] [INFO ] [LOCAL ] ORCL: Starting deletion of derivative data. [2025-09-29T02:06:02.674456] [DEBUG] [LOCAL ] ORCL: No derivative data file found to delete. [2025-09-29T02:06:02.674949] [INFO ] [MAIN ] Update Progress: 1639/2371 symbols completed. ORCL took 38.2s. Estimated remaining: 3m 53s. Rate: 188.7 symbols/min [2025-09-29T02:06:02.800087] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-09. [2025-09-29T02:06:03.572469] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-29T02:06:03.582718] [INFO ] [REMOTE ] OXY: Full fetch complete (77570 records). [2025-09-29T02:06:03.582925] [DEBUG] [VALIDATOR ] OXY: Validating primary data. [2025-09-29T02:06:03.802078] [WARN ] [VALIDATOR ] OXY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-29T02:06:03.802950] [FATAL] [MAIN ] OXY: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:06:03.803048] [WARN ] [MAIN ] OXY: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:06:03.803145] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-09-29T02:06:03.803263] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-09-29T02:06:03.803353] [INFO ] [LOCAL ] OXY: Starting deletion of derivative data. [2025-09-29T02:06:03.803450] [DEBUG] [LOCAL ] OXY: No derivative data file found to delete. [2025-09-29T02:06:03.803756] [INFO ] [MAIN ] Update Progress: 1640/2371 symbols completed. OXY took 17.3s. Estimated remaining: 3m 53s. Rate: 188.4 symbols/min [2025-09-29T02:06:04.566067] [INFO ] [MAIN ] PBI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:04.571903] [INFO ] [MAIN ] PCF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:04.573504] [INFO ] [MAIN ] PBT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:04.645849] [INFO ] [MAIN ] PBR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:04.663940] [DEBUG] [LOCAL ] PCF: Loaded 8720 existing records from primary storage. [2025-09-29T02:06:04.664458] [INFO ] [MAIN ] PCF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:04.664598] [INFO ] [MAIN ] Update Progress: 1641/2371 symbols completed. PCF took 0.9s. Estimated remaining: 3m 53s. Rate: 188.2 symbols/min [2025-09-29T02:06:04.728875] [DEBUG] [LOCAL ] PBT: Loaded 17533 existing records from primary storage. [2025-09-29T02:06:04.782439] [INFO ] [MAIN ] PBT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:04.824051] [INFO ] [MAIN ] Update Progress: 1642/2371 symbols completed. PBT took 1.0s. Estimated remaining: 3m 52s. Rate: 188.3 symbols/min [2025-09-29T02:06:04.843122] [DEBUG] [LOCAL ] PBI: Loaded 50788 existing records from primary storage. [2025-09-29T02:06:04.904802] [INFO ] [MAIN ] PBI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:04.925807] [INFO ] [MAIN ] Update Progress: 1643/2371 symbols completed. PBI took 1.1s. Estimated remaining: 3m 52s. Rate: 188.3 symbols/min [2025-09-29T02:06:05.065879] [INFO ] [MAIN ] PCG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:05.304730] [DEBUG] [LOCAL ] PBR: Loaded 54492 existing records from primary storage. [2025-09-29T02:06:05.314313] [INFO ] [MAIN ] PCM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:05.334992] [INFO ] [MAIN ] PBR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:05.334518] [INFO ] [MAIN ] PCN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:05.336038] [INFO ] [MAIN ] Update Progress: 1644/2371 symbols completed. PBR took 1.5s. Estimated remaining: 3m 52s. Rate: 188.3 symbols/min [2025-09-29T02:06:05.463831] [DEBUG] [LOCAL ] PCM: Loaded 6857 existing records from primary storage. [2025-09-29T02:06:05.470801] [INFO ] [MAIN ] PCM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:05.475361] [INFO ] [MAIN ] Update Progress: 1645/2371 symbols completed. PCM took 0.6s. Estimated remaining: 3m 51s. Rate: 188.4 symbols/min [2025-09-29T02:06:05.687781] [INFO ] [MAIN ] PCOR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:05.693917] [DEBUG] [LOCAL ] PCN: Loaded 24709 existing records from primary storage. [2025-09-29T02:06:05.659178] [DEBUG] [LOCAL ] PCG: Loaded 54498 existing records from primary storage. [2025-09-29T02:06:05.717179] [INFO ] [MAIN ] PCN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:05.717352] [INFO ] [MAIN ] PCG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:05.724547] [INFO ] [MAIN ] Update Progress: 1646/2371 symbols completed. PCG took 1.1s. Estimated remaining: 3m 51s. Rate: 188.4 symbols/min [2025-09-29T02:06:05.778158] [INFO ] [MAIN ] Update Progress: 1647/2371 symbols completed. PCN took 0.8s. Estimated remaining: 3m 50s. Rate: 188.5 symbols/min [2025-09-29T02:06:05.887864] [INFO ] [MAIN ] PCQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:06.173721] [DEBUG] [LOCAL ] PCQ: Loaded 12298 existing records from primary storage. [2025-09-29T02:06:06.240279] [INFO ] [MAIN ] PDCC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:06.220276] [INFO ] [MAIN ] PCQ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:06.242050] [DEBUG] [LOCAL ] PCOR: Loaded 48849 existing records from primary storage. [2025-09-29T02:06:06.257822] [DEBUG] [LOCAL ] PDCC: No existing data file found in primary storage. [2025-09-29T02:06:06.263480] [INFO ] [MAIN ] PD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:06.258013] [INFO ] [MAIN ] Update Progress: 1648/2371 symbols completed. PCQ took 0.8s. Estimated remaining: 3m 50s. Rate: 188.4 symbols/min [2025-09-29T02:06:06.263909] [WARN ] [MAIN ] PDCC: No existing data found, performing full refresh instead. [2025-09-29T02:06:06.264564] [INFO ] [MAIN ] PDCC: Wiping existing primary data before full refresh. [2025-09-29T02:06:06.276357] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-09-29T02:06:06.286763] [INFO ] [MAIN ] PCOR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:06.307612] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-09-29T02:06:06.332262] [INFO ] [MAIN ] Update Progress: 1649/2371 symbols completed. PCOR took 1.0s. Estimated remaining: 3m 50s. Rate: 188.5 symbols/min [2025-09-29T02:06:06.350850] [INFO ] [MAIN ] PDCC: Starting full primary refresh. [2025-09-29T02:06:06.756454] [INFO ] [MAIN ] PDI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:06.826269] [INFO ] [MAIN ] PDM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:06.873097] [DEBUG] [LOCAL ] PD: Loaded 48580 existing records from primary storage. [2025-09-29T02:06:06.902299] [INFO ] [MAIN ] PD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:06.921779] [INFO ] [MAIN ] Update Progress: 1650/2371 symbols completed. PD took 1.2s. Estimated remaining: 3m 50s. Rate: 188.4 symbols/min [2025-09-29T02:06:07.278814] [INFO ] [REMOTE ] PDCC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:06:07.380936] [DEBUG] [LOCAL ] PDI: Loaded 50909 existing records from primary storage. [2025-09-29T02:06:07.352053] [DEBUG] [LOCAL ] PDM: Loaded 40354 existing records from primary storage. [2025-09-29T02:06:07.379758] [INFO ] [MAIN ] PDO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:07.346475] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2024-12. [2025-09-29T02:06:07.383167] [INFO ] [MAIN ] PDI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:07.383297] [INFO ] [MAIN ] Update Progress: 1651/2371 symbols completed. PDI took 1.1s. Estimated remaining: 3m 49s. Rate: 188.4 symbols/min [2025-09-29T02:06:07.389103] [INFO ] [MAIN ] PDM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:07.401926] [INFO ] [MAIN ] Update Progress: 1652/2371 symbols completed. PDM took 1.0s. Estimated remaining: 3m 49s. Rate: 188.5 symbols/min [2025-09-29T02:06:07.593155] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2024-12 (0.25 seconds). [2025-09-29T02:06:07.707583] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-01. [2025-09-29T02:06:07.714188] [INFO ] [MAIN ] PDS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:07.747221] [DEBUG] [LOCAL ] PDO: Loaded 32146 existing records from primary storage. [2025-09-29T02:06:07.763720] [INFO ] [MAIN ] PDO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:07.798266] [INFO ] [MAIN ] Update Progress: 1653/2371 symbols completed. PDO took 0.9s. Estimated remaining: 3m 49s. Rate: 188.4 symbols/min [2025-09-29T02:06:07.820023] [INFO ] [MAIN ] PDT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:07.981539] [DEBUG] [LOCAL ] PDS: Loaded 18297 existing records from primary storage. [2025-09-29T02:06:08.039983] [DEBUG] [LOCAL ] PDT: Loaded 17549 existing records from primary storage. [2025-09-29T02:06:08.040429] [INFO ] [MAIN ] PDS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:08.060994] [INFO ] [MAIN ] Update Progress: 1654/2371 symbols completed. PDS took 0.7s. Estimated remaining: 3m 48s. Rate: 188.5 symbols/min [2025-09-29T02:06:08.060104] [INFO ] [MAIN ] PDT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:08.059683] [INFO ] [MAIN ] PDX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:08.067011] [INFO ] [MAIN ] Update Progress: 1655/2371 symbols completed. PDT took 0.6s. Estimated remaining: 3m 48s. Rate: 188.6 symbols/min [2025-09-29T02:06:08.191607] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-29T02:06:08.271228] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-02. [2025-09-29T02:06:08.282455] [DEBUG] [LOCAL ] PDX: Loaded 14514 existing records from primary storage. [2025-09-29T02:06:08.319709] [INFO ] [MAIN ] PDX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:08.330492] [INFO ] [MAIN ] Update Progress: 1656/2371 symbols completed. PDX took 0.5s. Estimated remaining: 3m 47s. Rate: 188.6 symbols/min [2025-09-29T02:06:08.505909] [INFO ] [MAIN ] PEG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:08.519082] [INFO ] [MAIN ] PEB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:08.684981] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-29T02:06:08.684837] [INFO ] [MAIN ] PEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:08.686759] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-03. [2025-09-29T02:06:08.779783] [DEBUG] [LOCAL ] PEB: Loaded 51448 existing records from primary storage. [2025-09-29T02:06:08.781179] [DEBUG] [LOCAL ] PEG: Loaded 53893 existing records from primary storage. [2025-09-29T02:06:08.781618] [INFO ] [MAIN ] PEG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:08.781807] [INFO ] [MAIN ] Update Progress: 1657/2371 symbols completed. PEG took 0.7s. Estimated remaining: 3m 47s. Rate: 188.5 symbols/min [2025-09-29T02:06:08.781956] [INFO ] [MAIN ] PEB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:08.795878] [INFO ] [MAIN ] Update Progress: 1658/2371 symbols completed. PEB took 0.7s. Estimated remaining: 3m 47s. Rate: 188.7 symbols/min [2025-09-29T02:06:08.873085] [DEBUG] [LOCAL ] PEN: Loaded 30842 existing records from primary storage. [2025-09-29T02:06:08.944432] [INFO ] [MAIN ] PEN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:08.983806] [INFO ] [MAIN ] Update Progress: 1659/2371 symbols completed. PEN took 0.6s. Estimated remaining: 3m 46s. Rate: 188.7 symbols/min [2025-09-29T02:06:08.994602] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-29T02:06:09.017100] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-04. [2025-09-29T02:06:09.189231] [INFO ] [MAIN ] PEO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:09.331051] [INFO ] [MAIN ] PERF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:09.428547] [DEBUG] [LOCAL ] PEO: Loaded 10999 existing records from primary storage. [2025-09-29T02:06:09.423948] [INFO ] [MAIN ] PEW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:09.429186] [INFO ] [MAIN ] PEO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:09.429020] [DEBUG] [LOCAL ] PEW: No existing data file found in primary storage. [2025-09-29T02:06:09.429758] [INFO ] [MAIN ] Update Progress: 1660/2371 symbols completed. PEO took 0.6s. Estimated remaining: 3m 46s. Rate: 188.7 symbols/min [2025-09-29T02:06:09.429899] [WARN ] [MAIN ] PEW: No existing data found, performing full refresh instead. [2025-09-29T02:06:09.479229] [INFO ] [MAIN ] PEW: Wiping existing primary data before full refresh. [2025-09-29T02:06:09.479512] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-09-29T02:06:09.495877] [DEBUG] [LOCAL ] PERF: Loaded 14231 existing records from primary storage. [2025-09-29T02:06:09.514089] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-09-29T02:06:09.519460] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-29T02:06:09.546745] [INFO ] [MAIN ] PERF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:09.546904] [INFO ] [MAIN ] PEW: Starting full primary refresh. [2025-09-29T02:06:09.578241] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-05. [2025-09-29T02:06:09.588751] [INFO ] [MAIN ] Update Progress: 1661/2371 symbols completed. PERF took 0.7s. Estimated remaining: 3m 46s. Rate: 188.7 symbols/min [2025-09-29T02:06:09.681208] [INFO ] [MAIN ] PFD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:09.938060] [DEBUG] [LOCAL ] PFD: Loaded 5199 existing records from primary storage. [2025-09-29T02:06:09.954857] [INFO ] [MAIN ] PFD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:09.955517] [INFO ] [MAIN ] Update Progress: 1662/2371 symbols completed. PFD took 0.5s. Estimated remaining: 3m 45s. Rate: 188.7 symbols/min [2025-09-29T02:06:10.007075] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-29T02:06:10.112574] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-06. [2025-09-29T02:06:10.297734] [INFO ] [MAIN ] PFE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:10.440209] [INFO ] [REMOTE ] PEW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:06:10.455044] [INFO ] [REMOTE ] PEW: Fetching primary data for 2024-12. [2025-09-29T02:06:10.494968] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-29T02:06:10.496425] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-07. [2025-09-29T02:06:10.519892] [INFO ] [MAIN ] PFGC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:10.568228] [DEBUG] [LOCAL ] PFE: Loaded 54593 existing records from primary storage. [2025-09-29T02:06:10.568776] [INFO ] [MAIN ] PFE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:10.569630] [INFO ] [MAIN ] Update Progress: 1663/2371 symbols completed. PFE took 0.9s. Estimated remaining: 3m 45s. Rate: 188.6 symbols/min [2025-09-29T02:06:10.644195] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:06:10.672460] [WARN ] [REMOTE ] PEW: No data returned for month 2024-12 [2025-09-29T02:06:10.707942] [FATAL] [REMOTE ] PEW: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:06:10.714716] [FATAL] [MAIN ] PEW: Failed to fetch primary data. [2025-09-29T02:06:10.714851] [WARN ] [MAIN ] PEW: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:06:10.714975] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-09-29T02:06:10.721039] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-09-29T02:06:10.738738] [DEBUG] [LOCAL ] PFGC: Loaded 47650 existing records from primary storage. [2025-09-29T02:06:10.721165] [INFO ] [LOCAL ] PEW: Starting deletion of derivative data. [2025-09-29T02:06:10.749833] [DEBUG] [LOCAL ] PEW: No derivative data file found to delete. [2025-09-29T02:06:10.784248] [INFO ] [MAIN ] PFGC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:10.777020] [INFO ] [MAIN ] Update Progress: 1664/2371 symbols completed. PEW took 1.7s. Estimated remaining: 3m 45s. Rate: 188.6 symbols/min [2025-09-29T02:06:10.777340] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-09-29T02:06:10.804774] [INFO ] [MAIN ] PFH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:10.812350] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-08. [2025-09-29T02:06:10.805825] [INFO ] [MAIN ] Update Progress: 1665/2371 symbols completed. PFGC took 0.8s. Estimated remaining: 3m 44s. Rate: 188.7 symbols/min [2025-09-29T02:06:11.047789] [DEBUG] [LOCAL ] PFH: Loaded 6911 existing records from primary storage. [2025-09-29T02:06:11.083822] [INFO ] [MAIN ] PFH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:11.056239] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-09-29T02:06:11.133538] [INFO ] [MAIN ] Update Progress: 1666/2371 symbols completed. PFH took 0.6s. Estimated remaining: 3m 44s. Rate: 188.7 symbols/min [2025-09-29T02:06:11.196080] [INFO ] [MAIN ] PFL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:11.334319] [INFO ] [MAIN ] PFLT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:11.459689] [INFO ] [MAIN ] PFN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:11.460715] [DEBUG] [LOCAL ] PFL: Loaded 13959 existing records from primary storage. [2025-09-29T02:06:11.462703] [INFO ] [MAIN ] PFL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:11.463272] [INFO ] [MAIN ] Update Progress: 1667/2371 symbols completed. PFL took 0.7s. Estimated remaining: 3m 44s. Rate: 188.7 symbols/min [2025-09-29T02:06:11.602901] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-09. [2025-09-29T02:06:11.637053] [DEBUG] [LOCAL ] PFLT: Loaded 44333 existing records from primary storage. [2025-09-29T02:06:11.664591] [INFO ] [MAIN ] PFLT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:11.711435] [INFO ] [MAIN ] PFO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:11.712538] [DEBUG] [LOCAL ] PFN: Loaded 21992 existing records from primary storage. [2025-09-29T02:06:11.711634] [INFO ] [MAIN ] Update Progress: 1668/2371 symbols completed. PFLT took 0.9s. Estimated remaining: 3m 43s. Rate: 188.7 symbols/min [2025-09-29T02:06:11.713089] [INFO ] [MAIN ] PFN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:11.726617] [INFO ] [MAIN ] Update Progress: 1669/2371 symbols completed. PFN took 0.5s. Estimated remaining: 3m 43s. Rate: 188.9 symbols/min [2025-09-29T02:06:11.899814] [DEBUG] [LOCAL ] PFO: Loaded 5948 existing records from primary storage. [2025-09-29T02:06:11.945553] [INFO ] [MAIN ] PFO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:11.939714] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-29T02:06:11.999744] [INFO ] [REMOTE ] PDCC: Full fetch complete (1345 records). [2025-09-29T02:06:11.993216] [INFO ] [MAIN ] Update Progress: 1670/2371 symbols completed. PFO took 0.5s. Estimated remaining: 3m 43s. Rate: 188.9 symbols/min [2025-09-29T02:06:12.009387] [DEBUG] [VALIDATOR ] PDCC: Validating primary data. [2025-09-29T02:06:12.205800] [INFO ] [MAIN ] PFS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:12.363047] [INFO ] [MAIN ] PFSI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:12.547415] [WARN ] [VALIDATOR ] PDCC: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-09-29T02:06:12.551183] [INFO ] [MAIN ] PG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:12.552336] [FATAL] [MAIN ] PDCC: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:06:12.552409] [WARN ] [MAIN ] PDCC: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:06:12.552457] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-09-29T02:06:12.552543] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-09-29T02:06:12.552598] [INFO ] [LOCAL ] PDCC: Starting deletion of derivative data. [2025-09-29T02:06:12.552691] [DEBUG] [LOCAL ] PDCC: No derivative data file found to delete. [2025-09-29T02:06:12.552791] [INFO ] [MAIN ] Update Progress: 1671/2371 symbols completed. PDCC took 6.7s. Estimated remaining: 3m 42s. Rate: 188.8 symbols/min [2025-09-29T02:06:12.733171] [DEBUG] [LOCAL ] PFSI: Loaded 29259 existing records from primary storage. [2025-09-29T02:06:12.778913] [DEBUG] [LOCAL ] PFS: Loaded 36188 existing records from primary storage. [2025-09-29T02:06:12.801548] [INFO ] [MAIN ] PFS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:12.801833] [INFO ] [MAIN ] Update Progress: 1672/2371 symbols completed. PFS took 1.1s. Estimated remaining: 3m 42s. Rate: 188.8 symbols/min [2025-09-29T02:06:12.801133] [INFO ] [MAIN ] PGP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:12.801740] [INFO ] [MAIN ] PFSI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:12.824365] [INFO ] [MAIN ] Update Progress: 1673/2371 symbols completed. PFSI took 1.1s. Estimated remaining: 3m 42s. Rate: 188.9 symbols/min [2025-09-29T02:06:13.028406] [DEBUG] [LOCAL ] PGP: Loaded 5515 existing records from primary storage. [2025-09-29T02:06:13.078917] [INFO ] [MAIN ] PGP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:13.121487] [INFO ] [MAIN ] Update Progress: 1674/2371 symbols completed. PGP took 0.6s. Estimated remaining: 3m 41s. Rate: 188.9 symbols/min [2025-09-29T02:06:13.095974] [DEBUG] [LOCAL ] PG: Loaded 54532 existing records from primary storage. [2025-09-29T02:06:13.269861] [INFO ] [MAIN ] PG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:13.360132] [INFO ] [MAIN ] PGR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:13.360298] [INFO ] [MAIN ] Update Progress: 1675/2371 symbols completed. PG took 1.3s. Estimated remaining: 3m 41s. Rate: 189.0 symbols/min [2025-09-29T02:06:13.382780] [INFO ] [MAIN ] PGRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:13.573670] [INFO ] [MAIN ] PGZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:13.725883] [DEBUG] [LOCAL ] PGZ: Loaded 5440 existing records from primary storage. [2025-09-29T02:06:13.730261] [INFO ] [MAIN ] PH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:13.745553] [INFO ] [MAIN ] PGZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:13.746090] [INFO ] [MAIN ] Update Progress: 1676/2371 symbols completed. PGZ took 0.6s. Estimated remaining: 3m 41s. Rate: 188.9 symbols/min [2025-09-29T02:06:13.900967] [DEBUG] [LOCAL ] PGRE: Loaded 47177 existing records from primary storage. [2025-09-29T02:06:13.902046] [DEBUG] [LOCAL ] PGR: Loaded 53757 existing records from primary storage. [2025-09-29T02:06:13.907555] [INFO ] [MAIN ] PGR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:13.907764] [INFO ] [MAIN ] Update Progress: 1677/2371 symbols completed. PGR took 1.1s. Estimated remaining: 3m 40s. Rate: 189.0 symbols/min [2025-09-29T02:06:13.907338] [INFO ] [MAIN ] PGRE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:13.908188] [INFO ] [MAIN ] Update Progress: 1678/2371 symbols completed. PGRE took 1.0s. Estimated remaining: 3m 40s. Rate: 189.1 symbols/min [2025-09-29T02:06:13.998884] [INFO ] [MAIN ] PHD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:14.014803] [DEBUG] [LOCAL ] PH: Loaded 39166 existing records from primary storage. [2025-09-29T02:06:14.015199] [INFO ] [MAIN ] PH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:14.015306] [INFO ] [MAIN ] Update Progress: 1679/2371 symbols completed. PH took 0.6s. Estimated remaining: 3m 39s. Rate: 189.2 symbols/min [2025-09-29T02:06:14.025505] [DEBUG] [LOCAL ] PHD: Loaded 10098 existing records from primary storage. [2025-09-29T02:06:14.025854] [INFO ] [MAIN ] PHD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:14.025993] [INFO ] [MAIN ] Update Progress: 1680/2371 symbols completed. PHD took 0.3s. Estimated remaining: 3m 39s. Rate: 189.3 symbols/min [2025-09-29T02:06:14.780377] [INFO ] [MAIN ] PHK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:14.769736] [INFO ] [MAIN ] PHIN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:14.830856] [INFO ] [MAIN ] PHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:14.853610] [INFO ] [MAIN ] PHG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:14.873864] [DEBUG] [LOCAL ] PHI: Loaded 15230 existing records from primary storage. [2025-09-29T02:06:14.874366] [INFO ] [MAIN ] PHI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:14.874581] [INFO ] [MAIN ] Update Progress: 1681/2371 symbols completed. PHI took 0.8s. Estimated remaining: 3m 39s. Rate: 189.1 symbols/min [2025-09-29T02:06:15.036631] [DEBUG] [LOCAL ] PHIN: Loaded 33541 existing records from primary storage. [2025-09-29T02:06:15.049717] [DEBUG] [LOCAL ] PHK: Loaded 26792 existing records from primary storage. [2025-09-29T02:06:15.060825] [INFO ] [MAIN ] PHIN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:15.061253] [INFO ] [MAIN ] PHK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:15.083234] [INFO ] [MAIN ] Update Progress: 1682/2371 symbols completed. PHIN took 1.1s. Estimated remaining: 3m 39s. Rate: 189.1 symbols/min [2025-09-29T02:06:15.105767] [INFO ] [MAIN ] Update Progress: 1683/2371 symbols completed. PHK took 1.1s. Estimated remaining: 3m 38s. Rate: 189.2 symbols/min [2025-09-29T02:06:15.223569] [INFO ] [MAIN ] PHM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:15.251123] [DEBUG] [LOCAL ] PHG: Loaded 46835 existing records from primary storage. [2025-09-29T02:06:15.269572] [INFO ] [MAIN ] PHG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:15.342690] [INFO ] [MAIN ] Update Progress: 1684/2371 symbols completed. PHG took 1.3s. Estimated remaining: 3m 38s. Rate: 189.3 symbols/min [2025-09-29T02:06:15.600792] [INFO ] [MAIN ] PHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:15.696086] [INFO ] [MAIN ] PII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:15.783390] [DEBUG] [LOCAL ] PHM: Loaded 52386 existing records from primary storage. [2025-09-29T02:06:15.804360] [INFO ] [MAIN ] PIM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:15.814802] [INFO ] [MAIN ] PHM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:15.815081] [INFO ] [MAIN ] Update Progress: 1685/2371 symbols completed. PHM took 0.9s. Estimated remaining: 3m 38s. Rate: 189.2 symbols/min [2025-09-29T02:06:15.889837] [DEBUG] [LOCAL ] PIM: Loaded 4814 existing records from primary storage. [2025-09-29T02:06:15.917900] [INFO ] [MAIN ] PIM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:15.924261] [DEBUG] [LOCAL ] PHR: Loaded 38045 existing records from primary storage. [2025-09-29T02:06:15.940083] [INFO ] [MAIN ] Update Progress: 1686/2371 symbols completed. PIM took 0.5s. Estimated remaining: 3m 37s. Rate: 189.3 symbols/min [2025-09-29T02:06:15.960782] [INFO ] [MAIN ] PHR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:15.978405] [INFO ] [MAIN ] Update Progress: 1687/2371 symbols completed. PHR took 0.9s. Estimated remaining: 3m 37s. Rate: 189.4 symbols/min [2025-09-29T02:06:16.253033] [INFO ] [MAIN ] PINE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:16.279577] [DEBUG] [LOCAL ] PII: Loaded 49815 existing records from primary storage. [2025-09-29T02:06:16.346946] [INFO ] [MAIN ] PII: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:16.415753] [INFO ] [MAIN ] PIPR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:16.415920] [INFO ] [MAIN ] Update Progress: 1688/2371 symbols completed. PII took 1.3s. Estimated remaining: 3m 36s. Rate: 189.3 symbols/min [2025-09-29T02:06:16.469587] [INFO ] [MAIN ] PINS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:16.535291] [DEBUG] [LOCAL ] PINE: Loaded 14365 existing records from primary storage. [2025-09-29T02:06:16.593591] [INFO ] [MAIN ] PINE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:16.609930] [INFO ] [MAIN ] Update Progress: 1689/2371 symbols completed. PINE took 0.8s. Estimated remaining: 3m 36s. Rate: 189.4 symbols/min [2025-09-29T02:06:16.610540] [DEBUG] [LOCAL ] PIPR: Loaded 15331 existing records from primary storage. [2025-09-29T02:06:16.638283] [INFO ] [MAIN ] PIPR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:16.726745] [INFO ] [MAIN ] Update Progress: 1690/2371 symbols completed. PIPR took 0.7s. Estimated remaining: 3m 36s. Rate: 189.4 symbols/min [2025-09-29T02:06:16.749953] [INFO ] [MAIN ] PJT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:17.065067] [DEBUG] [LOCAL ] PINS: Loaded 54473 existing records from primary storage. [2025-09-29T02:06:17.093292] [INFO ] [MAIN ] PK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:17.119872] [DEBUG] [LOCAL ] PJT: Loaded 22579 existing records from primary storage. [2025-09-29T02:06:17.136287] [INFO ] [MAIN ] PINS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:17.141226] [INFO ] [MAIN ] PKE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:17.142919] [INFO ] [MAIN ] Update Progress: 1691/2371 symbols completed. PINS took 1.2s. Estimated remaining: 3m 35s. Rate: 189.4 symbols/min [2025-09-29T02:06:17.141950] [INFO ] [MAIN ] PJT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:17.150489] [INFO ] [MAIN ] Update Progress: 1692/2371 symbols completed. PJT took 0.7s. Estimated remaining: 3m 35s. Rate: 189.5 symbols/min [2025-09-29T02:06:17.403286] [DEBUG] [LOCAL ] PKE: Loaded 12775 existing records from primary storage. [2025-09-29T02:06:17.454441] [INFO ] [MAIN ] PKE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:17.554722] [INFO ] [MAIN ] Update Progress: 1693/2371 symbols completed. PKE took 0.8s. Estimated remaining: 3m 35s. Rate: 189.5 symbols/min [2025-09-29T02:06:17.609618] [INFO ] [MAIN ] PKST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:17.586297] [INFO ] [MAIN ] PKG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:17.676957] [DEBUG] [LOCAL ] PK: Loaded 53626 existing records from primary storage. [2025-09-29T02:06:17.705250] [INFO ] [MAIN ] PK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:17.725002] [INFO ] [MAIN ] Update Progress: 1694/2371 symbols completed. PK took 1.1s. Estimated remaining: 3m 34s. Rate: 189.5 symbols/min [2025-09-29T02:06:17.817423] [INFO ] [MAIN ] PKX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:17.935489] [DEBUG] [LOCAL ] PKST: Loaded 19461 existing records from primary storage. [2025-09-29T02:06:17.961200] [INFO ] [MAIN ] PKST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:17.982592] [INFO ] [MAIN ] Update Progress: 1695/2371 symbols completed. PKST took 0.8s. Estimated remaining: 3m 34s. Rate: 189.6 symbols/min [2025-09-29T02:06:18.050057] [DEBUG] [LOCAL ] PKG: Loaded 39785 existing records from primary storage. [2025-09-29T02:06:18.078192] [INFO ] [MAIN ] PL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:18.078329] [INFO ] [MAIN ] PKG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:18.151764] [INFO ] [MAIN ] Update Progress: 1696/2371 symbols completed. PKG took 1.0s. Estimated remaining: 3m 34s. Rate: 189.6 symbols/min [2025-09-29T02:06:18.181220] [DEBUG] [LOCAL ] PKX: Loaded 25141 existing records from primary storage. [2025-09-29T02:06:18.214309] [INFO ] [MAIN ] PKX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:18.256606] [INFO ] [MAIN ] Update Progress: 1697/2371 symbols completed. PKX took 0.7s. Estimated remaining: 3m 33s. Rate: 189.7 symbols/min [2025-09-29T02:06:18.362769] [INFO ] [MAIN ] PLD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:18.614518] [INFO ] [MAIN ] PLNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:18.671026] [DEBUG] [LOCAL ] PL: Loaded 53894 existing records from primary storage. [2025-09-29T02:06:18.707707] [INFO ] [MAIN ] PLOW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:18.709856] [INFO ] [MAIN ] PL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:18.712994] [INFO ] [MAIN ] Update Progress: 1698/2371 symbols completed. PL took 0.9s. Estimated remaining: 3m 33s. Rate: 189.6 symbols/min [2025-09-29T02:06:18.886490] [DEBUG] [LOCAL ] PLOW: Loaded 20792 existing records from primary storage. [2025-09-29T02:06:18.955862] [INFO ] [MAIN ] PLOW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:18.968139] [DEBUG] [LOCAL ] PLD: Loaded 54226 existing records from primary storage. [2025-09-29T02:06:18.984796] [INFO ] [MAIN ] Update Progress: 1699/2371 symbols completed. PLOW took 0.6s. Estimated remaining: 3m 33s. Rate: 189.7 symbols/min [2025-09-29T02:06:18.990618] [INFO ] [MAIN ] PLYM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:18.991432] [INFO ] [MAIN ] PLD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:19.017251] [INFO ] [MAIN ] Update Progress: 1700/2371 symbols completed. PLD took 1.0s. Estimated remaining: 3m 32s. Rate: 189.8 symbols/min [2025-09-29T02:06:19.164414] [DEBUG] [LOCAL ] PLNT: Loaded 49144 existing records from primary storage. [2025-09-29T02:06:19.197528] [INFO ] [MAIN ] PLNT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:19.208054] [INFO ] [MAIN ] Update Progress: 1701/2371 symbols completed. PLNT took 1.0s. Estimated remaining: 3m 32s. Rate: 189.8 symbols/min [2025-09-29T02:06:19.455592] [INFO ] [MAIN ] PM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:19.533611] [DEBUG] [LOCAL ] PLYM: Loaded 33884 existing records from primary storage. [2025-09-29T02:06:19.597167] [INFO ] [MAIN ] PML: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:19.598474] [INFO ] [MAIN ] PLYM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:19.620491] [INFO ] [MAIN ] Update Progress: 1702/2371 symbols completed. PLYM took 0.9s. Estimated remaining: 3m 32s. Rate: 189.8 symbols/min [2025-09-29T02:06:19.691736] [INFO ] [MAIN ] PMM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:19.809114] [DEBUG] [LOCAL ] PML: Loaded 20999 existing records from primary storage. [2025-09-29T02:06:19.820435] [INFO ] [MAIN ] PML: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:19.821154] [INFO ] [MAIN ] Update Progress: 1703/2371 symbols completed. PML took 0.8s. Estimated remaining: 3m 31s. Rate: 189.8 symbols/min [2025-09-29T02:06:19.966201] [DEBUG] [LOCAL ] PMM: Loaded 10760 existing records from primary storage. [2025-09-29T02:06:20.028637] [INFO ] [MAIN ] PMM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:20.011964] [INFO ] [MAIN ] PMO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:20.063204] [INFO ] [MAIN ] Update Progress: 1704/2371 symbols completed. PMM took 0.8s. Estimated remaining: 3m 31s. Rate: 189.8 symbols/min [2025-09-29T02:06:20.109384] [DEBUG] [LOCAL ] PM: Loaded 54445 existing records from primary storage. [2025-09-29T02:06:20.144455] [INFO ] [MAIN ] PM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:20.194083] [INFO ] [MAIN ] Update Progress: 1705/2371 symbols completed. PM took 1.2s. Estimated remaining: 3m 30s. Rate: 189.9 symbols/min [2025-09-29T02:06:20.290397] [DEBUG] [LOCAL ] PMO: Loaded 10547 existing records from primary storage. [2025-09-29T02:06:20.284310] [INFO ] [MAIN ] PMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:20.297143] [INFO ] [MAIN ] PMO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:20.310126] [INFO ] [MAIN ] Update Progress: 1706/2371 symbols completed. PMO took 0.6s. Estimated remaining: 3m 30s. Rate: 190.0 symbols/min [2025-09-29T02:06:20.614203] [INFO ] [MAIN ] PMTU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:20.743737] [DEBUG] [LOCAL ] PMTU: No existing data file found in primary storage. [2025-09-29T02:06:20.778533] [WARN ] [MAIN ] PMTU: No existing data found, performing full refresh instead. [2025-09-29T02:06:20.809674] [INFO ] [MAIN ] PMTW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:20.809898] [DEBUG] [LOCAL ] PMTW: No existing data file found in primary storage. [2025-09-29T02:06:20.807794] [INFO ] [MAIN ] PMTU: Wiping existing primary data before full refresh. [2025-09-29T02:06:20.811776] [INFO ] [MAIN ] PMTV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:20.826155] [WARN ] [MAIN ] PMTW: No existing data found, performing full refresh instead. [2025-09-29T02:06:20.826682] [DEBUG] [LOCAL ] PMTV: No existing data file found in primary storage. [2025-09-29T02:06:20.826289] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-09-29T02:06:20.827084] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-09-29T02:06:20.826923] [INFO ] [MAIN ] PMTW: Wiping existing primary data before full refresh. [2025-09-29T02:06:20.827398] [WARN ] [MAIN ] PMTV: No existing data found, performing full refresh instead. [2025-09-29T02:06:20.827359] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-09-29T02:06:20.829470] [DEBUG] [LOCAL ] PMT: Loaded 40798 existing records from primary storage. [2025-09-29T02:06:20.829571] [INFO ] [MAIN ] PMTU: Starting full primary refresh. [2025-09-29T02:06:20.830337] [INFO ] [MAIN ] PMT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:20.829814] [INFO ] [MAIN ] PMTV: Wiping existing primary data before full refresh. [2025-09-29T02:06:20.830546] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-09-29T02:06:20.842235] [INFO ] [MAIN ] Update Progress: 1707/2371 symbols completed. PMT took 1.0s. Estimated remaining: 3m 30s. Rate: 189.9 symbols/min [2025-09-29T02:06:20.842716] [INFO ] [MAIN ] PMTW: Starting full primary refresh. [2025-09-29T02:06:20.842455] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-09-29T02:06:20.937456] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-09-29T02:06:20.996142] [INFO ] [MAIN ] PMTV: Starting full primary refresh. [2025-09-29T02:06:21.635915] [INFO ] [MAIN ] PNC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:22.195043] [INFO ] [REMOTE ] PMTW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:06:22.201102] [INFO ] [REMOTE ] PMTU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:06:22.254603] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2024-12. [2025-09-29T02:06:22.284469] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2024-12. [2025-09-29T02:06:22.292922] [INFO ] [REMOTE ] PMTV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:06:22.295294] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2024-12. [2025-09-29T02:06:22.312680] [DEBUG] [LOCAL ] PNC: Loaded 53000 existing records from primary storage. [2025-09-29T02:06:22.313902] [INFO ] [MAIN ] PNC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:22.314007] [INFO ] [MAIN ] Update Progress: 1708/2371 symbols completed. PNC took 1.5s. Estimated remaining: 3m 30s. Rate: 189.5 symbols/min [2025-09-29T02:06:22.454081] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:06:22.477938] [WARN ] [REMOTE ] PMTW: No data returned for month 2024-12 [2025-09-29T02:06:22.508236] [FATAL] [REMOTE ] PMTW: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:06:22.510179] [FATAL] [MAIN ] PMTW: Failed to fetch primary data. [2025-09-29T02:06:22.508117] [DEBUG] [REMOTE ] PMTV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:06:22.510392] [WARN ] [MAIN ] PMTW: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:06:22.509776] [INFO ] [MAIN ] PNI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:22.513573] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2024-12 (0.23 seconds). [2025-09-29T02:06:22.513740] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-09-29T02:06:22.515973] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-01. [2025-09-29T02:06:22.514049] [WARN ] [REMOTE ] PMTV: No data returned for month 2024-12 [2025-09-29T02:06:22.517515] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-09-29T02:06:22.517790] [INFO ] [LOCAL ] PMTW: Starting deletion of derivative data. [2025-09-29T02:06:22.517899] [DEBUG] [LOCAL ] PMTW: No derivative data file found to delete. [2025-09-29T02:06:22.518006] [INFO ] [MAIN ] Update Progress: 1709/2371 symbols completed. PMTW took 2.2s. Estimated remaining: 3m 30s. Rate: 189.5 symbols/min [2025-09-29T02:06:22.516257] [FATAL] [REMOTE ] PMTV: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:06:22.536976] [FATAL] [MAIN ] PMTV: Failed to fetch primary data. [2025-09-29T02:06:22.564974] [WARN ] [MAIN ] PMTV: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:06:22.590704] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-09-29T02:06:22.604828] [DEBUG] [LOCAL ] PNI: Loaded 6782 existing records from primary storage. [2025-09-29T02:06:22.610179] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-09-29T02:06:22.628316] [INFO ] [MAIN ] PNI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:22.643907] [INFO ] [MAIN ] Update Progress: 1710/2371 symbols completed. PNI took 0.3s. Estimated remaining: 3m 29s. Rate: 189.6 symbols/min [2025-09-29T02:06:22.647855] [INFO ] [LOCAL ] PMTV: Starting deletion of derivative data. [2025-09-29T02:06:22.711187] [DEBUG] [LOCAL ] PMTV: No derivative data file found to delete. [2025-09-29T02:06:22.730909] [INFO ] [MAIN ] Update Progress: 1711/2371 symbols completed. PMTV took 2.5s. Estimated remaining: 3m 29s. Rate: 189.7 symbols/min [2025-09-29T02:06:22.781905] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-09-29T02:06:22.854736] [INFO ] [MAIN ] PNNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:22.842887] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-02. [2025-09-29T02:06:23.053180] [INFO ] [MAIN ] PNR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:23.134897] [INFO ] [MAIN ] PNW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:23.151380] [DEBUG] [LOCAL ] PNNT: Loaded 33337 existing records from primary storage. [2025-09-29T02:06:23.152061] [INFO ] [MAIN ] PNNT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:23.152176] [INFO ] [MAIN ] Update Progress: 1712/2371 symbols completed. PNNT took 0.6s. Estimated remaining: 3m 29s. Rate: 189.6 symbols/min [2025-09-29T02:06:23.228038] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-29T02:06:23.263200] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-03. [2025-09-29T02:06:23.384359] [INFO ] [MAIN ] POR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:23.405701] [DEBUG] [LOCAL ] PNR: Loaded 48589 existing records from primary storage. [2025-09-29T02:06:23.420262] [INFO ] [MAIN ] PNR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:23.420469] [INFO ] [MAIN ] Update Progress: 1713/2371 symbols completed. PNR took 0.8s. Estimated remaining: 3m 28s. Rate: 189.7 symbols/min [2025-09-29T02:06:23.421709] [DEBUG] [LOCAL ] PNW: Loaded 46531 existing records from primary storage. [2025-09-29T02:06:23.458254] [INFO ] [MAIN ] PNW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:23.486971] [INFO ] [MAIN ] Update Progress: 1714/2371 symbols completed. PNW took 0.7s. Estimated remaining: 3m 28s. Rate: 189.7 symbols/min [2025-09-29T02:06:23.507258] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-09-29T02:06:23.531209] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-04. [2025-09-29T02:06:23.785094] [INFO ] [MAIN ] POST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:23.871872] [INFO ] [MAIN ] PPG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:23.875825] [DEBUG] [LOCAL ] POR: Loaded 47706 existing records from primary storage. [2025-09-29T02:06:23.877530] [INFO ] [MAIN ] POR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:23.878054] [INFO ] [MAIN ] Update Progress: 1715/2371 symbols completed. POR took 0.7s. Estimated remaining: 3m 27s. Rate: 189.7 symbols/min [2025-09-29T02:06:23.963989] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-29T02:06:23.982380] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-05. [2025-09-29T02:06:24.138661] [INFO ] [MAIN ] PPL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:24.141233] [DEBUG] [LOCAL ] POST: Loaded 39494 existing records from primary storage. [2025-09-29T02:06:24.157380] [DEBUG] [LOCAL ] PPG: Loaded 51455 existing records from primary storage. [2025-09-29T02:06:24.157777] [INFO ] [MAIN ] POST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:24.158280] [INFO ] [MAIN ] Update Progress: 1716/2371 symbols completed. POST took 0.7s. Estimated remaining: 3m 27s. Rate: 189.7 symbols/min [2025-09-29T02:06:24.158504] [INFO ] [MAIN ] PPG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:24.173617] [INFO ] [MAIN ] Update Progress: 1717/2371 symbols completed. PPG took 0.7s. Estimated remaining: 3m 27s. Rate: 189.8 symbols/min [2025-09-29T02:06:24.280733] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-09-29T02:06:24.291362] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-06. [2025-09-29T02:06:24.400434] [INFO ] [MAIN ] PPT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:24.425493] [DEBUG] [LOCAL ] PPL: Loaded 54285 existing records from primary storage. [2025-09-29T02:06:24.426120] [INFO ] [MAIN ] PPL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:24.426239] [INFO ] [MAIN ] Update Progress: 1718/2371 symbols completed. PPL took 0.5s. Estimated remaining: 3m 26s. Rate: 189.9 symbols/min [2025-09-29T02:06:24.442876] [DEBUG] [LOCAL ] PPT: Loaded 20342 existing records from primary storage. [2025-09-29T02:06:24.443202] [INFO ] [MAIN ] PPT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:24.443305] [INFO ] [MAIN ] Update Progress: 1719/2371 symbols completed. PPT took 0.3s. Estimated remaining: 3m 26s. Rate: 190.0 symbols/min [2025-09-29T02:06:24.512665] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-06 (0.22 seconds). [2025-09-29T02:06:24.513745] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-07. [2025-09-29T02:06:24.708071] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-07 (0.19 seconds). [2025-09-29T02:06:24.709194] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-08. [2025-09-29T02:06:24.832048] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-08 (0.12 seconds). [2025-09-29T02:06:24.833229] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-09. [2025-09-29T02:06:25.031040] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-09 (0.20 seconds). [2025-09-29T02:06:25.031927] [INFO ] [REMOTE ] PMTU: Full fetch complete (1236 records). [2025-09-29T02:06:25.032024] [DEBUG] [VALIDATOR ] PMTU: Validating primary data. [2025-09-29T02:06:25.222010] [WARN ] [VALIDATOR ] PMTU: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-29T02:06:25.222270] [FATAL] [MAIN ] PMTU: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:06:25.222358] [WARN ] [MAIN ] PMTU: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:06:25.222465] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-09-29T02:06:25.222574] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-09-29T02:06:25.222672] [INFO ] [LOCAL ] PMTU: Starting deletion of derivative data. [2025-09-29T02:06:25.222771] [DEBUG] [LOCAL ] PMTU: No derivative data file found to delete. [2025-09-29T02:06:25.222869] [INFO ] [MAIN ] Update Progress: 1720/2371 symbols completed. PMTU took 5.2s. Estimated remaining: 3m 26s. Rate: 189.8 symbols/min [2025-09-29T02:06:25.928322] [INFO ] [MAIN ] PRCS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:25.899038] [INFO ] [MAIN ] PR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:25.982960] [INFO ] [MAIN ] PRA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:25.984496] [INFO ] [MAIN ] PRG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:25.981992] [DEBUG] [LOCAL ] PRCS: No existing data file found in primary storage. [2025-09-29T02:06:25.985165] [WARN ] [MAIN ] PRCS: No existing data found, performing full refresh instead. [2025-09-29T02:06:25.985471] [INFO ] [MAIN ] PRCS: Wiping existing primary data before full refresh. [2025-09-29T02:06:25.985880] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-09-29T02:06:25.986071] [DEBUG] [LOCAL ] PRCS: No primary data file found to delete. [2025-09-29T02:06:25.986192] [INFO ] [MAIN ] PRCS: Starting full primary refresh. [2025-09-29T02:06:26.228495] [DEBUG] [LOCAL ] PRG: Loaded 30420 existing records from primary storage. [2025-09-29T02:06:26.288119] [INFO ] [MAIN ] PRG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:26.331692] [INFO ] [MAIN ] Update Progress: 1721/2371 symbols completed. PRG took 1.1s. Estimated remaining: 3m 26s. Rate: 189.5 symbols/min [2025-09-29T02:06:26.360548] [DEBUG] [LOCAL ] PRA: Loaded 35243 existing records from primary storage. [2025-09-29T02:06:26.396718] [INFO ] [MAIN ] PRA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:26.495425] [INFO ] [MAIN ] Update Progress: 1722/2371 symbols completed. PRA took 1.3s. Estimated remaining: 3m 25s. Rate: 189.6 symbols/min [2025-09-29T02:06:26.547089] [INFO ] [REMOTE ] PRCS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:06:26.510448] [DEBUG] [LOCAL ] PR: Loaded 54389 existing records from primary storage. [2025-09-29T02:06:26.602883] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2024-12. [2025-09-29T02:06:26.620490] [INFO ] [MAIN ] PR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:26.664062] [INFO ] [MAIN ] Update Progress: 1723/2371 symbols completed. PR took 1.4s. Estimated remaining: 3m 25s. Rate: 189.6 symbols/min [2025-09-29T02:06:26.772867] [INFO ] [MAIN ] PRGO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:27.002889] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-29T02:06:27.002689] [INFO ] [MAIN ] PRH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:27.056221] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-01. [2025-09-29T02:06:27.090558] [INFO ] [MAIN ] PRI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:27.107974] [DEBUG] [LOCAL ] PRH: Loaded 4908 existing records from primary storage. [2025-09-29T02:06:27.108524] [INFO ] [MAIN ] PRH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:27.108707] [INFO ] [MAIN ] Update Progress: 1724/2371 symbols completed. PRH took 0.5s. Estimated remaining: 3m 25s. Rate: 189.6 symbols/min [2025-09-29T02:06:27.249858] [DEBUG] [LOCAL ] PRI: Loaded 18636 existing records from primary storage. [2025-09-29T02:06:27.251560] [DEBUG] [LOCAL ] PRGO: Loaded 47634 existing records from primary storage. [2025-09-29T02:06:27.252196] [INFO ] [MAIN ] PRGO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:27.263317] [INFO ] [MAIN ] Update Progress: 1725/2371 symbols completed. PRGO took 0.9s. Estimated remaining: 3m 24s. Rate: 189.6 symbols/min [2025-09-29T02:06:27.252291] [INFO ] [MAIN ] PRI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:27.279110] [INFO ] [MAIN ] Update Progress: 1726/2371 symbols completed. PRI took 0.5s. Estimated remaining: 3m 24s. Rate: 189.7 symbols/min [2025-09-29T02:06:27.409738] [INFO ] [MAIN ] PRIM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:27.487923] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-29T02:06:27.516043] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-02. [2025-09-29T02:06:27.758005] [INFO ] [MAIN ] PRKS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:27.760112] [INFO ] [MAIN ] PRLB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:27.804586] [DEBUG] [LOCAL ] PRIM: Loaded 45072 existing records from primary storage. [2025-09-29T02:06:27.805192] [INFO ] [MAIN ] PRIM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:27.805370] [INFO ] [MAIN ] Update Progress: 1727/2371 symbols completed. PRIM took 0.7s. Estimated remaining: 3m 24s. Rate: 189.7 symbols/min [2025-09-29T02:06:27.853525] [DEBUG] [LOCAL ] PRLB: Loaded 20919 existing records from primary storage. [2025-09-29T02:06:27.889064] [INFO ] [MAIN ] PRLB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:27.889734] [INFO ] [MAIN ] Update Progress: 1728/2371 symbols completed. PRLB took 0.6s. Estimated remaining: 3m 23s. Rate: 189.7 symbols/min [2025-09-29T02:06:27.923375] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-29T02:06:27.937953] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-03. [2025-09-29T02:06:28.053554] [DEBUG] [LOCAL ] PRKS: Loaded 43308 existing records from primary storage. [2025-09-29T02:06:28.074344] [INFO ] [MAIN ] PRKS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:28.103867] [INFO ] [MAIN ] Update Progress: 1729/2371 symbols completed. PRKS took 0.8s. Estimated remaining: 3m 23s. Rate: 189.8 symbols/min [2025-09-29T02:06:28.299399] [INFO ] [MAIN ] PRM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:28.358831] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-29T02:06:28.361237] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-04. [2025-09-29T02:06:28.512276] [INFO ] [MAIN ] PRMB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:28.656901] [INFO ] [MAIN ] PRO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:28.678364] [DEBUG] [LOCAL ] PRM: Loaded 45298 existing records from primary storage. [2025-09-29T02:06:28.679109] [INFO ] [MAIN ] PRM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:28.679496] [INFO ] [MAIN ] Update Progress: 1730/2371 symbols completed. PRM took 0.9s. Estimated remaining: 3m 23s. Rate: 189.7 symbols/min [2025-09-29T02:06:28.885179] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-29T02:06:28.887142] [DEBUG] [LOCAL ] PRMB: Loaded 53928 existing records from primary storage. [2025-09-29T02:06:28.935993] [INFO ] [MAIN ] PRMB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:28.925821] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-05. [2025-09-29T02:06:28.945169] [INFO ] [MAIN ] Update Progress: 1731/2371 symbols completed. PRMB took 1.0s. Estimated remaining: 3m 22s. Rate: 189.7 symbols/min [2025-09-29T02:06:28.975451] [DEBUG] [LOCAL ] PRO: Loaded 38444 existing records from primary storage. [2025-09-29T02:06:29.011678] [INFO ] [MAIN ] PRO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:28.990508] [INFO ] [MAIN ] PRSU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:29.032400] [INFO ] [MAIN ] Update Progress: 1732/2371 symbols completed. PRO took 0.9s. Estimated remaining: 3m 22s. Rate: 189.8 symbols/min [2025-09-29T02:06:29.061553] [DEBUG] [LOCAL ] PRSU: No existing data file found in primary storage. [2025-09-29T02:06:29.095285] [WARN ] [MAIN ] PRSU: No existing data found, performing full refresh instead. [2025-09-29T02:06:29.157591] [INFO ] [MAIN ] PRSU: Wiping existing primary data before full refresh. [2025-09-29T02:06:29.208494] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-09-29T02:06:29.265768] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-09-29T02:06:29.295766] [INFO ] [MAIN ] PRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:29.320768] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-29T02:06:29.320430] [INFO ] [MAIN ] PRSU: Starting full primary refresh. [2025-09-29T02:06:29.327893] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-06. [2025-09-29T02:06:29.427109] [INFO ] [MAIN ] PRU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:29.503373] [DEBUG] [LOCAL ] PRT: Loaded 5402 existing records from primary storage. [2025-09-29T02:06:29.507878] [INFO ] [MAIN ] PRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:29.508563] [INFO ] [MAIN ] Update Progress: 1733/2371 symbols completed. PRT took 0.6s. Estimated remaining: 3m 22s. Rate: 189.7 symbols/min [2025-09-29T02:06:29.829715] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-29T02:06:29.848310] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-07. [2025-09-29T02:06:29.980767] [DEBUG] [LOCAL ] PRU: Loaded 52204 existing records from primary storage. [2025-09-29T02:06:30.010354] [INFO ] [MAIN ] PRVS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:30.021333] [INFO ] [MAIN ] PRU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:30.037238] [DEBUG] [LOCAL ] PRVS: No existing data file found in primary storage. [2025-09-29T02:06:30.049711] [WARN ] [MAIN ] PRVS: No existing data found, performing full refresh instead. [2025-09-29T02:06:30.037516] [INFO ] [MAIN ] Update Progress: 1734/2371 symbols completed. PRU took 1.0s. Estimated remaining: 3m 22s. Rate: 189.7 symbols/min [2025-09-29T02:06:30.070764] [INFO ] [MAIN ] PRVS: Wiping existing primary data before full refresh. [2025-09-29T02:06:30.145311] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-09-29T02:06:30.166535] [INFO ] [REMOTE ] PRSU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:06:30.177806] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-09-29T02:06:30.192111] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2024-12. [2025-09-29T02:06:30.216511] [INFO ] [MAIN ] PRVS: Starting full primary refresh. [2025-09-29T02:06:30.216905] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-29T02:06:30.240914] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-08. [2025-09-29T02:06:30.428815] [INFO ] [MAIN ] PSA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:30.453386] [DEBUG] [REMOTE ] PRSU: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:06:30.497703] [WARN ] [REMOTE ] PRSU: No data returned for month 2024-12 [2025-09-29T02:06:30.545445] [FATAL] [REMOTE ] PRSU: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:06:30.579400] [FATAL] [MAIN ] PRSU: Failed to fetch primary data. [2025-09-29T02:06:30.621748] [WARN ] [MAIN ] PRSU: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:06:30.653111] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-09-29T02:06:30.682808] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-09-29T02:06:30.698218] [INFO ] [LOCAL ] PRSU: Starting deletion of derivative data. [2025-09-29T02:06:30.672186] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-29T02:06:30.703864] [DEBUG] [LOCAL ] PRSU: No derivative data file found to delete. [2025-09-29T02:06:30.710155] [INFO ] [MAIN ] Update Progress: 1735/2371 symbols completed. PRSU took 2.0s. Estimated remaining: 3m 21s. Rate: 189.5 symbols/min [2025-09-29T02:06:30.711876] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-09. [2025-09-29T02:06:30.796226] [INFO ] [REMOTE ] PRVS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:06:30.863742] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2024-12. [2025-09-29T02:06:30.891403] [DEBUG] [LOCAL ] PSA: Loaded 42474 existing records from primary storage. [2025-09-29T02:06:30.897356] [INFO ] [MAIN ] PSA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:30.946551] [INFO ] [MAIN ] Update Progress: 1736/2371 symbols completed. PSA took 0.9s. Estimated remaining: 3m 21s. Rate: 189.6 symbols/min [2025-09-29T02:06:31.012240] [INFO ] [MAIN ] PSBD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:31.058915] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-29T02:06:31.079123] [INFO ] [REMOTE ] PRCS: Full fetch complete (3804 records). [2025-09-29T02:06:31.098930] [DEBUG] [VALIDATOR ] PRCS: Validating primary data. [2025-09-29T02:06:31.189742] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-09-29T02:06:31.223476] [DEBUG] [LOCAL ] PSBD: Loaded 7130 existing records from primary storage. [2025-09-29T02:06:31.284355] [INFO ] [MAIN ] PSF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:31.284584] [INFO ] [MAIN ] PSBD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:31.306741] [INFO ] [MAIN ] Update Progress: 1737/2371 symbols completed. PSBD took 0.6s. Estimated remaining: 3m 21s. Rate: 189.6 symbols/min [2025-09-29T02:06:31.467391] [DEBUG] [LOCAL ] PSF: Loaded 6990 existing records from primary storage. [2025-09-29T02:06:31.486145] [WARN ] [VALIDATOR ] PRCS: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-29T02:06:31.486724] [INFO ] [MAIN ] PSF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:31.497387] [INFO ] [MAIN ] Update Progress: 1738/2371 symbols completed. PSF took 0.5s. Estimated remaining: 3m 20s. Rate: 189.6 symbols/min [2025-09-29T02:06:31.505921] [FATAL] [MAIN ] PRCS: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:06:31.518251] [WARN ] [MAIN ] PRCS: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:06:31.572208] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-09-29T02:06:31.610335] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-01. [2025-09-29T02:06:31.694571] [INFO ] [MAIN ] PSFE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:31.705987] [DEBUG] [LOCAL ] PRCS: No primary data file found to delete. [2025-09-29T02:06:31.723882] [INFO ] [LOCAL ] PRCS: Starting deletion of derivative data. [2025-09-29T02:06:31.728950] [DEBUG] [LOCAL ] PRCS: No derivative data file found to delete. [2025-09-29T02:06:31.729114] [INFO ] [MAIN ] Update Progress: 1739/2371 symbols completed. PRCS took 6.5s. Estimated remaining: 3m 20s. Rate: 189.6 symbols/min [2025-09-29T02:06:31.925124] [INFO ] [MAIN ] PSN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:32.012065] [INFO ] [MAIN ] PSO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:32.024555] [DEBUG] [LOCAL ] PSFE: Loaded 30702 existing records from primary storage. [2025-09-29T02:06:32.025397] [INFO ] [MAIN ] PSFE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:32.025507] [INFO ] [MAIN ] Update Progress: 1740/2371 symbols completed. PSFE took 0.7s. Estimated remaining: 3m 20s. Rate: 189.6 symbols/min [2025-09-29T02:06:32.103780] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-29T02:06:32.240280] [INFO ] [MAIN ] PSQH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:32.266386] [DEBUG] [LOCAL ] PSN: Loaded 46808 existing records from primary storage. [2025-09-29T02:06:32.267072] [INFO ] [MAIN ] PSN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:32.267246] [INFO ] [MAIN ] Update Progress: 1741/2371 symbols completed. PSN took 0.7s. Estimated remaining: 3m 19s. Rate: 189.7 symbols/min [2025-09-29T02:06:32.399505] [DEBUG] [LOCAL ] PSO: Loaded 37751 existing records from primary storage. [2025-09-29T02:06:32.400276] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-02. [2025-09-29T02:06:32.416347] [INFO ] [MAIN ] PSO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:32.460394] [INFO ] [MAIN ] Update Progress: 1742/2371 symbols completed. PSO took 0.7s. Estimated remaining: 3m 19s. Rate: 189.7 symbols/min [2025-09-29T02:06:32.519265] [INFO ] [MAIN ] PSTG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:32.664854] [DEBUG] [LOCAL ] PSQH: Loaded 35426 existing records from primary storage. [2025-09-29T02:06:32.676000] [INFO ] [MAIN ] PSQH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:32.686546] [INFO ] [MAIN ] Update Progress: 1743/2371 symbols completed. PSQH took 0.7s. Estimated remaining: 3m 19s. Rate: 189.7 symbols/min [2025-09-29T02:06:32.748702] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-29T02:06:32.839442] [INFO ] [MAIN ] PSTL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:32.932568] [DEBUG] [LOCAL ] PSTG: Loaded 53626 existing records from primary storage. [2025-09-29T02:06:32.957042] [INFO ] [MAIN ] PSTG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:32.995965] [INFO ] [MAIN ] PSX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:32.996205] [INFO ] [MAIN ] Update Progress: 1744/2371 symbols completed. PSTG took 0.7s. Estimated remaining: 3m 18s. Rate: 189.7 symbols/min [2025-09-29T02:06:33.065056] [DEBUG] [LOCAL ] PSTL: Loaded 20585 existing records from primary storage. [2025-09-29T02:06:33.104614] [INFO ] [MAIN ] PSTL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:33.116421] [INFO ] [MAIN ] Update Progress: 1745/2371 symbols completed. PSTL took 0.6s. Estimated remaining: 3m 18s. Rate: 189.8 symbols/min [2025-09-29T02:06:33.238407] [INFO ] [MAIN ] PTA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:33.210224] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-03. [2025-09-29T02:06:33.416583] [INFO ] [MAIN ] PTY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:33.439906] [DEBUG] [LOCAL ] PTA: Loaded 15299 existing records from primary storage. [2025-09-29T02:06:33.440387] [INFO ] [MAIN ] PTA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:33.440816] [INFO ] [MAIN ] Update Progress: 1746/2371 symbols completed. PTA took 0.4s. Estimated remaining: 3m 18s. Rate: 189.8 symbols/min [2025-09-29T02:06:33.465400] [DEBUG] [LOCAL ] PSX: Loaded 53912 existing records from primary storage. [2025-09-29T02:06:33.503139] [INFO ] [MAIN ] PSX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:33.512607] [INFO ] [MAIN ] Update Progress: 1747/2371 symbols completed. PSX took 0.8s. Estimated remaining: 3m 17s. Rate: 189.9 symbols/min [2025-09-29T02:06:33.575358] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-29T02:06:33.701616] [INFO ] [MAIN ] PUK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:33.804793] [DEBUG] [LOCAL ] PTY: Loaded 37902 existing records from primary storage. [2025-09-29T02:06:33.841130] [INFO ] [MAIN ] PTY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:33.871473] [INFO ] [MAIN ] PUMP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:33.871805] [INFO ] [MAIN ] Update Progress: 1748/2371 symbols completed. PTY took 0.8s. Estimated remaining: 3m 17s. Rate: 189.9 symbols/min [2025-09-29T02:06:34.002232] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-04. [2025-09-29T02:06:34.068711] [DEBUG] [LOCAL ] PUK: Loaded 45565 existing records from primary storage. [2025-09-29T02:06:34.115827] [INFO ] [MAIN ] PVH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:34.116390] [INFO ] [MAIN ] PUK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:34.117094] [INFO ] [MAIN ] Update Progress: 1749/2371 symbols completed. PUK took 0.7s. Estimated remaining: 3m 17s. Rate: 189.9 symbols/min [2025-09-29T02:06:34.256287] [DEBUG] [LOCAL ] PUMP: Loaded 50160 existing records from primary storage. [2025-09-29T02:06:34.273251] [INFO ] [MAIN ] PUMP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:34.289454] [INFO ] [MAIN ] Update Progress: 1750/2371 symbols completed. PUMP took 0.7s. Estimated remaining: 3m 16s. Rate: 189.9 symbols/min [2025-09-29T02:06:34.369901] [INFO ] [MAIN ] PVL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:34.370213] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-29T02:06:34.518469] [DEBUG] [LOCAL ] PVL: Loaded 4819 existing records from primary storage. [2025-09-29T02:06:34.530692] [DEBUG] [LOCAL ] PVH: Loaded 51137 existing records from primary storage. [2025-09-29T02:06:34.531038] [INFO ] [MAIN ] PVL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:34.566322] [INFO ] [MAIN ] Update Progress: 1751/2371 symbols completed. PVL took 0.4s. Estimated remaining: 3m 16s. Rate: 190.0 symbols/min [2025-09-29T02:06:34.583106] [INFO ] [MAIN ] PVH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:34.606439] [INFO ] [MAIN ] PWR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:34.625096] [INFO ] [MAIN ] Update Progress: 1752/2371 symbols completed. PVH took 0.8s. Estimated remaining: 3m 15s. Rate: 190.0 symbols/min [2025-09-29T02:06:34.809788] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-05. [2025-09-29T02:06:34.968345] [INFO ] [MAIN ] PX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:35.062338] [INFO ] [MAIN ] QBTS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:35.082530] [DEBUG] [LOCAL ] PWR: Loaded 48047 existing records from primary storage. [2025-09-29T02:06:35.083275] [INFO ] [MAIN ] PWR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:35.083593] [INFO ] [MAIN ] Update Progress: 1753/2371 symbols completed. PWR took 0.8s. Estimated remaining: 3m 15s. Rate: 190.0 symbols/min [2025-09-29T02:06:35.109913] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-09-29T02:06:35.233445] [DEBUG] [LOCAL ] PX: Loaded 35085 existing records from primary storage. [2025-09-29T02:06:35.239981] [INFO ] [MAIN ] PX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:35.240163] [INFO ] [MAIN ] Update Progress: 1754/2371 symbols completed. PX took 0.6s. Estimated remaining: 3m 15s. Rate: 190.0 symbols/min [2025-09-29T02:06:35.384692] [INFO ] [MAIN ] QD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:35.494511] [DEBUG] [LOCAL ] QBTS: Loaded 54526 existing records from primary storage. [2025-09-29T02:06:35.537044] [INFO ] [MAIN ] QBTS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:35.548072] [INFO ] [MAIN ] Update Progress: 1755/2371 symbols completed. QBTS took 0.9s. Estimated remaining: 3m 14s. Rate: 190.0 symbols/min [2025-09-29T02:06:35.589877] [INFO ] [MAIN ] QGEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:35.605466] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-06. [2025-09-29T02:06:35.662075] [DEBUG] [LOCAL ] QD: Loaded 28475 existing records from primary storage. [2025-09-29T02:06:35.700839] [INFO ] [MAIN ] QD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:35.701304] [INFO ] [MAIN ] Update Progress: 1756/2371 symbols completed. QD took 0.6s. Estimated remaining: 3m 14s. Rate: 190.1 symbols/min [2025-09-29T02:06:35.927484] [INFO ] [MAIN ] QS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:35.927758] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-29T02:06:36.013907] [INFO ] [MAIN ] QSR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:36.033784] [DEBUG] [LOCAL ] QGEN: Loaded 49874 existing records from primary storage. [2025-09-29T02:06:36.034913] [INFO ] [MAIN ] QGEN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:36.035093] [INFO ] [MAIN ] Update Progress: 1757/2371 symbols completed. QGEN took 0.8s. Estimated remaining: 3m 14s. Rate: 190.1 symbols/min [2025-09-29T02:06:36.119792] [DEBUG] [LOCAL ] QS: Loaded 54522 existing records from primary storage. [2025-09-29T02:06:36.121564] [INFO ] [MAIN ] QS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:36.122510] [DEBUG] [LOCAL ] QSR: Loaded 53178 existing records from primary storage. [2025-09-29T02:06:36.123285] [INFO ] [MAIN ] Update Progress: 1758/2371 symbols completed. QS took 0.6s. Estimated remaining: 3m 13s. Rate: 190.2 symbols/min [2025-09-29T02:06:36.123679] [INFO ] [MAIN ] QSR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:36.123890] [INFO ] [MAIN ] Update Progress: 1759/2371 symbols completed. QSR took 0.4s. Estimated remaining: 3m 13s. Rate: 190.3 symbols/min [2025-09-29T02:06:36.400060] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-07. [2025-09-29T02:06:36.603251] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-07 (0.20 seconds). [2025-09-29T02:06:37.200066] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-08. [2025-09-29T02:06:37.404188] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-08 (0.20 seconds). [2025-09-29T02:06:38.000060] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-09. [2025-09-29T02:06:38.202394] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-09 (0.20 seconds). [2025-09-29T02:06:38.203463] [INFO ] [REMOTE ] PRVS: Full fetch complete (1271 records). [2025-09-29T02:06:38.203596] [DEBUG] [VALIDATOR ] PRVS: Validating primary data. [2025-09-29T02:06:38.398741] [WARN ] [VALIDATOR ] PRVS: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-09-29T02:06:38.399028] [FATAL] [MAIN ] PRVS: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:06:38.399105] [WARN ] [MAIN ] PRVS: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:06:38.399187] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-09-29T02:06:38.399294] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-09-29T02:06:38.399372] [INFO ] [LOCAL ] PRVS: Starting deletion of derivative data. [2025-09-29T02:06:38.399432] [DEBUG] [LOCAL ] PRVS: No derivative data file found to delete. [2025-09-29T02:06:38.399534] [INFO ] [MAIN ] Update Progress: 1760/2371 symbols completed. PRVS took 8.9s. Estimated remaining: 3m 13s. Rate: 189.6 symbols/min [2025-09-29T02:06:39.233861] [INFO ] [MAIN ] QVCC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:39.186892] [INFO ] [MAIN ] QVCD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:39.232071] [INFO ] [MAIN ] QUAD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:39.191502] [INFO ] [MAIN ] QTWO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:39.249048] [DEBUG] [LOCAL ] QVCD: Loaded 4542 existing records from primary storage. [2025-09-29T02:06:39.249585] [INFO ] [MAIN ] QVCD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:39.249817] [INFO ] [MAIN ] Update Progress: 1761/2371 symbols completed. QVCD took 0.8s. Estimated remaining: 3m 13s. Rate: 189.4 symbols/min [2025-09-29T02:06:39.337969] [DEBUG] [LOCAL ] QVCC: Loaded 9018 existing records from primary storage. [2025-09-29T02:06:39.392074] [INFO ] [MAIN ] QVCC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:39.460009] [DEBUG] [LOCAL ] QUAD: Loaded 23938 existing records from primary storage. [2025-09-29T02:06:39.440364] [INFO ] [MAIN ] Update Progress: 1762/2371 symbols completed. QVCC took 1.0s. Estimated remaining: 3m 13s. Rate: 189.5 symbols/min [2025-09-29T02:06:39.514492] [INFO ] [MAIN ] QUAD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:39.521390] [DEBUG] [LOCAL ] QTWO: Loaded 39754 existing records from primary storage. [2025-09-29T02:06:39.502271] [INFO ] [MAIN ] QXO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:39.531249] [INFO ] [MAIN ] Update Progress: 1763/2371 symbols completed. QUAD took 1.1s. Estimated remaining: 3m 12s. Rate: 189.6 symbols/min [2025-09-29T02:06:39.551218] [INFO ] [MAIN ] QTWO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:39.588691] [INFO ] [MAIN ] Update Progress: 1764/2371 symbols completed. QTWO took 1.2s. Estimated remaining: 3m 12s. Rate: 189.6 symbols/min [2025-09-29T02:06:39.943364] [INFO ] [MAIN ] R: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:40.105801] [INFO ] [MAIN ] RACE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:40.127462] [INFO ] [MAIN ] RA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:40.155361] [DEBUG] [LOCAL ] QXO: Loaded 53964 existing records from primary storage. [2025-09-29T02:06:40.156343] [INFO ] [MAIN ] QXO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:40.156490] [INFO ] [MAIN ] Update Progress: 1765/2371 symbols completed. QXO took 0.9s. Estimated remaining: 3m 12s. Rate: 189.6 symbols/min [2025-09-29T02:06:40.250867] [DEBUG] [LOCAL ] R: Loaded 29775 existing records from primary storage. [2025-09-29T02:06:40.293896] [INFO ] [MAIN ] R: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:40.304563] [INFO ] [MAIN ] Update Progress: 1766/2371 symbols completed. R took 0.8s. Estimated remaining: 3m 11s. Rate: 189.6 symbols/min [2025-09-29T02:06:40.398535] [DEBUG] [LOCAL ] RA: Loaded 22045 existing records from primary storage. [2025-09-29T02:06:40.453439] [DEBUG] [LOCAL ] RACE: Loaded 33300 existing records from primary storage. [2025-09-29T02:06:40.461935] [INFO ] [MAIN ] RA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:40.452230] [INFO ] [MAIN ] RAMP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:40.476625] [INFO ] [MAIN ] RACE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:40.487501] [INFO ] [MAIN ] Update Progress: 1767/2371 symbols completed. RACE took 0.9s. Estimated remaining: 3m 11s. Rate: 189.7 symbols/min [2025-09-29T02:06:40.504936] [INFO ] [MAIN ] Update Progress: 1768/2371 symbols completed. RA took 1.0s. Estimated remaining: 3m 11s. Rate: 189.8 symbols/min [2025-09-29T02:06:40.832277] [INFO ] [MAIN ] RBA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:40.941110] [INFO ] [MAIN ] RBC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:41.021917] [INFO ] [MAIN ] RBLX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:41.023968] [DEBUG] [LOCAL ] RAMP: Loaded 38208 existing records from primary storage. [2025-09-29T02:06:41.024600] [INFO ] [MAIN ] RAMP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:41.025168] [INFO ] [MAIN ] Update Progress: 1769/2371 symbols completed. RAMP took 0.9s. Estimated remaining: 3m 10s. Rate: 189.7 symbols/min [2025-09-29T02:06:41.184186] [DEBUG] [LOCAL ] RBC: Loaded 15326 existing records from primary storage. [2025-09-29T02:06:41.217196] [INFO ] [MAIN ] RBC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:41.267619] [INFO ] [MAIN ] Update Progress: 1770/2371 symbols completed. RBC took 0.8s. Estimated remaining: 3m 10s. Rate: 189.7 symbols/min [2025-09-29T02:06:41.300174] [DEBUG] [LOCAL ] RBA: Loaded 46598 existing records from primary storage. [2025-09-29T02:06:41.334588] [INFO ] [MAIN ] RBA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:41.335185] [INFO ] [MAIN ] Update Progress: 1771/2371 symbols completed. RBA took 1.0s. Estimated remaining: 3m 10s. Rate: 189.8 symbols/min [2025-09-29T02:06:41.323536] [INFO ] [MAIN ] RBOT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:41.468450] [DEBUG] [LOCAL ] RBLX: Loaded 54496 existing records from primary storage. [2025-09-29T02:06:41.490214] [INFO ] [MAIN ] RBLX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:41.517110] [INFO ] [MAIN ] Update Progress: 1772/2371 symbols completed. RBLX took 1.0s. Estimated remaining: 3m 9s. Rate: 189.8 symbols/min [2025-09-29T02:06:41.530982] [DEBUG] [LOCAL ] RBOT: Loaded 5223 existing records from primary storage. [2025-09-29T02:06:41.600212] [INFO ] [MAIN ] RBOT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:41.673273] [INFO ] [MAIN ] Update Progress: 1773/2371 symbols completed. RBOT took 0.6s. Estimated remaining: 3m 9s. Rate: 189.9 symbols/min [2025-09-29T02:06:41.987883] [INFO ] [MAIN ] RBRK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:41.998919] [INFO ] [MAIN ] RC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:42.166423] [INFO ] [MAIN ] RCB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:42.234690] [INFO ] [MAIN ] RCD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:42.234963] [DEBUG] [LOCAL ] RCB: No existing data file found in primary storage. [2025-09-29T02:06:42.235373] [DEBUG] [LOCAL ] RCD: No existing data file found in primary storage. [2025-09-29T02:06:42.235707] [WARN ] [MAIN ] RCD: No existing data found, performing full refresh instead. [2025-09-29T02:06:42.235594] [WARN ] [MAIN ] RCB: No existing data found, performing full refresh instead. [2025-09-29T02:06:42.236054] [INFO ] [MAIN ] RCD: Wiping existing primary data before full refresh. [2025-09-29T02:06:42.236171] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-09-29T02:06:42.236471] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-09-29T02:06:42.236705] [INFO ] [MAIN ] RCB: Wiping existing primary data before full refresh. [2025-09-29T02:06:42.236789] [INFO ] [MAIN ] RCD: Starting full primary refresh. [2025-09-29T02:06:42.236982] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-09-29T02:06:42.242425] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-09-29T02:06:42.274104] [INFO ] [MAIN ] RCB: Starting full primary refresh. [2025-09-29T02:06:42.574555] [DEBUG] [LOCAL ] RBRK: Loaded 53892 existing records from primary storage. [2025-09-29T02:06:42.658268] [DEBUG] [LOCAL ] RC: Loaded 49676 existing records from primary storage. [2025-09-29T02:06:42.658496] [INFO ] [MAIN ] RBRK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:42.706956] [INFO ] [MAIN ] Update Progress: 1774/2371 symbols completed. RBRK took 1.4s. Estimated remaining: 3m 9s. Rate: 189.7 symbols/min [2025-09-29T02:06:42.716611] [INFO ] [MAIN ] RC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:42.799888] [INFO ] [MAIN ] Update Progress: 1775/2371 symbols completed. RC took 1.5s. Estimated remaining: 3m 8s. Rate: 189.7 symbols/min [2025-09-29T02:06:43.342544] [INFO ] [REMOTE ] RCD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:06:43.462726] [INFO ] [REMOTE ] RCD: Fetching primary data for 2024-12. [2025-09-29T02:06:43.472999] [INFO ] [REMOTE ] RCB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:06:43.459253] [INFO ] [MAIN ] RCL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:43.490899] [INFO ] [REMOTE ] RCB: Fetching primary data for 2024-12. [2025-09-29T02:06:43.559508] [INFO ] [MAIN ] RCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:43.625084] [DEBUG] [LOCAL ] RCL: Loaded 52876 existing records from primary storage. [2025-09-29T02:06:43.638119] [INFO ] [MAIN ] RCL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:43.639398] [INFO ] [MAIN ] Update Progress: 1776/2371 symbols completed. RCL took 0.8s. Estimated remaining: 3m 8s. Rate: 189.6 symbols/min [2025-09-29T02:06:43.645542] [DEBUG] [LOCAL ] RCI: Loaded 49383 existing records from primary storage. [2025-09-29T02:06:43.673751] [INFO ] [MAIN ] RCI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:43.719418] [INFO ] [MAIN ] Update Progress: 1777/2371 symbols completed. RCI took 0.9s. Estimated remaining: 3m 8s. Rate: 189.6 symbols/min [2025-09-29T02:06:43.806513] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-09-29T02:06:43.891433] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-01. [2025-09-29T02:06:43.964533] [INFO ] [MAIN ] RCS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:43.999776] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-29T02:06:44.028765] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-01. [2025-09-29T02:06:44.071203] [INFO ] [MAIN ] RCUS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:44.078279] [DEBUG] [LOCAL ] RCS: Loaded 11593 existing records from primary storage. [2025-09-29T02:06:44.078634] [INFO ] [MAIN ] RCS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:44.078760] [INFO ] [MAIN ] Update Progress: 1778/2371 symbols completed. RCS took 0.4s. Estimated remaining: 3m 8s. Rate: 189.6 symbols/min [2025-09-29T02:06:44.302692] [INFO ] [MAIN ] RDDT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:44.308074] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-29T02:06:44.309915] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-02. [2025-09-29T02:06:44.336927] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-09-29T02:06:44.339759] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-02. [2025-09-29T02:06:44.342768] [DEBUG] [LOCAL ] RCUS: Loaded 43206 existing records from primary storage. [2025-09-29T02:06:44.343485] [INFO ] [MAIN ] RCUS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:44.343678] [INFO ] [MAIN ] Update Progress: 1779/2371 symbols completed. RCUS took 0.6s. Estimated remaining: 3m 7s. Rate: 189.6 symbols/min [2025-09-29T02:06:44.564356] [INFO ] [MAIN ] RDN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:44.598199] [DEBUG] [LOCAL ] RDDT: Loaded 54563 existing records from primary storage. [2025-09-29T02:06:44.598780] [INFO ] [MAIN ] RDDT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:44.599945] [INFO ] [MAIN ] Update Progress: 1780/2371 symbols completed. RDDT took 0.5s. Estimated remaining: 3m 7s. Rate: 189.7 symbols/min [2025-09-29T02:06:44.726334] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-29T02:06:44.744846] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-03. [2025-09-29T02:06:44.829129] [INFO ] [MAIN ] RDW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:44.829363] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-29T02:06:44.832703] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-03. [2025-09-29T02:06:44.859283] [DEBUG] [LOCAL ] RDN: Loaded 45976 existing records from primary storage. [2025-09-29T02:06:44.859908] [INFO ] [MAIN ] RDN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:44.860030] [INFO ] [MAIN ] Update Progress: 1781/2371 symbols completed. RDN took 0.5s. Estimated remaining: 3m 7s. Rate: 189.7 symbols/min [2025-09-29T02:06:45.081501] [INFO ] [MAIN ] RDY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:45.088356] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-29T02:06:45.112275] [DEBUG] [LOCAL ] RDW: Loaded 52794 existing records from primary storage. [2025-09-29T02:06:45.112842] [INFO ] [MAIN ] RDW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:45.113022] [INFO ] [MAIN ] Update Progress: 1782/2371 symbols completed. RDW took 0.5s. Estimated remaining: 3m 6s. Rate: 189.7 symbols/min [2025-09-29T02:06:45.200994] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-04. [2025-09-29T02:06:45.370696] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-29T02:06:45.376569] [INFO ] [MAIN ] RELX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:45.381670] [DEBUG] [LOCAL ] RDY: Loaded 47418 existing records from primary storage. [2025-09-29T02:06:45.382527] [INFO ] [MAIN ] RDY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:45.382667] [INFO ] [MAIN ] Update Progress: 1783/2371 symbols completed. RDY took 0.5s. Estimated remaining: 3m 6s. Rate: 189.7 symbols/min [2025-09-29T02:06:45.573254] [INFO ] [MAIN ] RERE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:45.608396] [DEBUG] [LOCAL ] RELX: Loaded 48567 existing records from primary storage. [2025-09-29T02:06:45.608873] [INFO ] [MAIN ] RELX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:45.609341] [INFO ] [MAIN ] Update Progress: 1784/2371 symbols completed. RELX took 0.5s. Estimated remaining: 3m 6s. Rate: 189.7 symbols/min [2025-09-29T02:06:45.718963] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-29T02:06:45.808144] [DEBUG] [LOCAL ] RERE: Loaded 41690 existing records from primary storage. [2025-09-29T02:06:45.845211] [INFO ] [MAIN ] RES: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:45.845699] [INFO ] [MAIN ] RERE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:45.846276] [INFO ] [MAIN ] Update Progress: 1785/2371 symbols completed. RERE took 0.5s. Estimated remaining: 3m 5s. Rate: 189.8 symbols/min [2025-09-29T02:06:46.007409] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-04. [2025-09-29T02:06:46.058890] [INFO ] [MAIN ] REVG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:46.080697] [DEBUG] [LOCAL ] RES: Loaded 48190 existing records from primary storage. [2025-09-29T02:06:46.081168] [INFO ] [MAIN ] RES: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:46.081292] [INFO ] [MAIN ] Update Progress: 1786/2371 symbols completed. RES took 0.5s. Estimated remaining: 3m 5s. Rate: 189.8 symbols/min [2025-09-29T02:06:46.299807] [INFO ] [MAIN ] REX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:46.302414] [DEBUG] [LOCAL ] REVG: Loaded 41461 existing records from primary storage. [2025-09-29T02:06:46.302855] [INFO ] [MAIN ] REVG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:46.303017] [INFO ] [MAIN ] Update Progress: 1787/2371 symbols completed. REVG took 0.5s. Estimated remaining: 3m 5s. Rate: 189.8 symbols/min [2025-09-29T02:06:46.436459] [DEBUG] [LOCAL ] REX: Loaded 14221 existing records from primary storage. [2025-09-29T02:06:46.473296] [INFO ] [MAIN ] REX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:46.482693] [INFO ] [MAIN ] Update Progress: 1788/2371 symbols completed. REX took 0.4s. Estimated remaining: 3m 4s. Rate: 189.9 symbols/min [2025-09-29T02:06:46.482346] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-29T02:06:46.529316] [INFO ] [MAIN ] REXR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:46.695267] [INFO ] [MAIN ] REZI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:46.739729] [DEBUG] [LOCAL ] REXR: Loaded 52852 existing records from primary storage. [2025-09-29T02:06:46.740249] [INFO ] [MAIN ] REXR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:46.740354] [INFO ] [MAIN ] Update Progress: 1789/2371 symbols completed. REXR took 0.4s. Estimated remaining: 3m 4s. Rate: 189.9 symbols/min [2025-09-29T02:06:46.802460] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-05. [2025-09-29T02:06:46.933750] [DEBUG] [LOCAL ] REZI: Loaded 47576 existing records from primary storage. [2025-09-29T02:06:46.962083] [INFO ] [MAIN ] RF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:46.962329] [INFO ] [MAIN ] REZI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:46.962713] [INFO ] [MAIN ] Update Progress: 1790/2371 symbols completed. REZI took 0.5s. Estimated remaining: 3m 4s. Rate: 189.9 symbols/min [2025-09-29T02:06:47.158915] [INFO ] [MAIN ] RFI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:47.200455] [DEBUG] [LOCAL ] RF: Loaded 54410 existing records from primary storage. [2025-09-29T02:06:47.205751] [DEBUG] [LOCAL ] RFI: Loaded 10550 existing records from primary storage. [2025-09-29T02:06:47.206024] [INFO ] [MAIN ] RF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:47.206332] [INFO ] [MAIN ] RFI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:47.206592] [INFO ] [MAIN ] Update Progress: 1791/2371 symbols completed. RF took 0.5s. Estimated remaining: 3m 3s. Rate: 190.0 symbols/min [2025-09-29T02:06:47.207270] [INFO ] [MAIN ] Update Progress: 1792/2371 symbols completed. RFI took 0.2s. Estimated remaining: 3m 3s. Rate: 190.1 symbols/min [2025-09-29T02:06:47.248044] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-29T02:06:47.593195] [INFO ] [MAIN ] RFM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:47.597255] [INFO ] [MAIN ] RFL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:47.600045] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-05. [2025-09-29T02:06:47.606175] [DEBUG] [LOCAL ] RFM: Loaded 4196 existing records from primary storage. [2025-09-29T02:06:47.606632] [INFO ] [MAIN ] RFM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:47.607096] [INFO ] [MAIN ] Update Progress: 1793/2371 symbols completed. RFM took 0.4s. Estimated remaining: 3m 2s. Rate: 190.0 symbols/min [2025-09-29T02:06:47.721483] [DEBUG] [LOCAL ] RFL: Loaded 11051 existing records from primary storage. [2025-09-29T02:06:47.733703] [INFO ] [MAIN ] RFL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:47.733903] [INFO ] [MAIN ] Update Progress: 1794/2371 symbols completed. RFL took 0.5s. Estimated remaining: 3m 2s. Rate: 190.1 symbols/min [2025-09-29T02:06:47.912188] [INFO ] [MAIN ] RFMZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:47.981991] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-29T02:06:48.023302] [INFO ] [MAIN ] RGA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:48.027987] [DEBUG] [LOCAL ] RFMZ: Loaded 8822 existing records from primary storage. [2025-09-29T02:06:48.028785] [INFO ] [MAIN ] RFMZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:48.028896] [INFO ] [MAIN ] Update Progress: 1795/2371 symbols completed. RFMZ took 0.4s. Estimated remaining: 3m 2s. Rate: 190.1 symbols/min [2025-09-29T02:06:48.250239] [DEBUG] [LOCAL ] RGA: Loaded 30535 existing records from primary storage. [2025-09-29T02:06:48.249264] [INFO ] [MAIN ] RGR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:48.251074] [INFO ] [MAIN ] RGA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:48.251520] [INFO ] [MAIN ] Update Progress: 1796/2371 symbols completed. RGA took 0.5s. Estimated remaining: 3m 1s. Rate: 190.1 symbols/min [2025-09-29T02:06:48.418747] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-06. [2025-09-29T02:06:48.434558] [DEBUG] [LOCAL ] RGR: Loaded 20706 existing records from primary storage. [2025-09-29T02:06:48.460181] [INFO ] [MAIN ] RGT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:48.460695] [INFO ] [MAIN ] RGR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:48.461397] [INFO ] [MAIN ] Update Progress: 1797/2371 symbols completed. RGR took 0.4s. Estimated remaining: 3m 1s. Rate: 190.2 symbols/min [2025-09-29T02:06:48.467496] [DEBUG] [LOCAL ] RGT: Loaded 2885 existing records from primary storage. [2025-09-29T02:06:48.467828] [INFO ] [MAIN ] RGT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:48.468127] [INFO ] [MAIN ] Update Progress: 1798/2371 symbols completed. RGT took 0.2s. Estimated remaining: 3m 1s. Rate: 190.3 symbols/min [2025-09-29T02:06:48.810300] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-29T02:06:49.200078] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-06. [2025-09-29T02:06:49.480037] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-09-29T02:06:50.000070] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-07. [2025-09-29T02:06:50.205557] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-07 (0.21 seconds). [2025-09-29T02:06:50.800105] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-07. [2025-09-29T02:06:51.160772] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-29T02:06:51.600070] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-08. [2025-09-29T02:06:51.959689] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-29T02:06:52.400086] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-09. [2025-09-29T02:06:52.759151] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-29T02:06:52.760770] [INFO ] [REMOTE ] RCD: Full fetch complete (6867 records). [2025-09-29T02:06:52.760988] [DEBUG] [VALIDATOR ] RCD: Validating primary data. [2025-09-29T02:06:52.959718] [WARN ] [VALIDATOR ] RCD: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-29T02:06:52.959978] [FATAL] [MAIN ] RCD: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:06:52.960053] [WARN ] [MAIN ] RCD: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:06:52.960213] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-09-29T02:06:52.960310] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-09-29T02:06:52.960406] [INFO ] [LOCAL ] RCD: Starting deletion of derivative data. [2025-09-29T02:06:52.960545] [DEBUG] [LOCAL ] RCD: No derivative data file found to delete. [2025-09-29T02:06:52.960668] [INFO ] [MAIN ] Update Progress: 1799/2371 symbols completed. RCD took 11.2s. Estimated remaining: 3m 2s. Rate: 188.9 symbols/min [2025-09-29T02:06:53.200120] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-08. [2025-09-29T02:06:53.407297] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-08 (0.21 seconds). [2025-09-29T02:06:54.000089] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-09. [2025-09-29T02:06:54.215909] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-09 (0.22 seconds). [2025-09-29T02:06:54.222041] [INFO ] [REMOTE ] RCB: Full fetch complete (3747 records). [2025-09-29T02:06:54.222187] [DEBUG] [VALIDATOR ] RCB: Validating primary data. [2025-09-29T02:06:54.421944] [WARN ] [VALIDATOR ] RCB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-29T02:06:54.422185] [FATAL] [MAIN ] RCB: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:06:54.422264] [WARN ] [MAIN ] RCB: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:06:54.422339] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-09-29T02:06:54.422434] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-09-29T02:06:54.422508] [INFO ] [LOCAL ] RCB: Starting deletion of derivative data. [2025-09-29T02:06:54.422627] [DEBUG] [LOCAL ] RCB: No derivative data file found to delete. [2025-09-29T02:06:54.422824] [INFO ] [MAIN ] Update Progress: 1800/2371 symbols completed. RCB took 12.9s. Estimated remaining: 3m 2s. Rate: 188.5 symbols/min [2025-09-29T02:06:55.033784] [INFO ] [MAIN ] RHLD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:55.199774] [INFO ] [MAIN ] RH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:55.178424] [DEBUG] [LOCAL ] RHLD: No existing data file found in primary storage. [2025-09-29T02:06:55.163629] [INFO ] [MAIN ] RHP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:55.229355] [INFO ] [MAIN ] RHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:55.227136] [WARN ] [MAIN ] RHLD: No existing data found, performing full refresh instead. [2025-09-29T02:06:55.229965] [INFO ] [MAIN ] RHLD: Wiping existing primary data before full refresh. [2025-09-29T02:06:55.230957] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-09-29T02:06:55.231164] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-09-29T02:06:55.231233] [INFO ] [MAIN ] RHLD: Starting full primary refresh. [2025-09-29T02:06:55.628534] [DEBUG] [LOCAL ] RH: Loaded 48340 existing records from primary storage. [2025-09-29T02:06:55.629911] [DEBUG] [LOCAL ] RHI: Loaded 49995 existing records from primary storage. [2025-09-29T02:06:55.631766] [DEBUG] [LOCAL ] RHP: Loaded 42305 existing records from primary storage. [2025-09-29T02:06:55.637465] [INFO ] [MAIN ] RHI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:55.637369] [INFO ] [MAIN ] RH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:55.674462] [INFO ] [MAIN ] RHP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:55.731396] [INFO ] [MAIN ] Update Progress: 1801/2371 symbols completed. RH took 1.3s. Estimated remaining: 3m 2s. Rate: 188.2 symbols/min [2025-09-29T02:06:55.761169] [INFO ] [REMOTE ] RHLD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:06:55.771813] [INFO ] [MAIN ] Update Progress: 1802/2371 symbols completed. RHI took 1.3s. Estimated remaining: 3m 1s. Rate: 188.3 symbols/min [2025-09-29T02:06:55.815478] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2024-12. [2025-09-29T02:06:55.843672] [INFO ] [MAIN ] Update Progress: 1803/2371 symbols completed. RHP took 1.3s. Estimated remaining: 3m 1s. Rate: 188.3 symbols/min [2025-09-29T02:06:56.068049] [DEBUG] [REMOTE ] RHLD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:06:56.152995] [WARN ] [REMOTE ] RHLD: No data returned for month 2024-12 [2025-09-29T02:06:56.183977] [FATAL] [REMOTE ] RHLD: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:06:56.200960] [FATAL] [MAIN ] RHLD: Failed to fetch primary data. [2025-09-29T02:06:56.178718] [INFO ] [MAIN ] RIG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:56.223134] [WARN ] [MAIN ] RHLD: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:06:56.229981] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-09-29T02:06:56.235310] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-09-29T02:06:56.235437] [INFO ] [LOCAL ] RHLD: Starting deletion of derivative data. [2025-09-29T02:06:56.335377] [INFO ] [MAIN ] RIO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:56.335562] [DEBUG] [LOCAL ] RHLD: No derivative data file found to delete. [2025-09-29T02:06:56.346904] [INFO ] [MAIN ] Update Progress: 1804/2371 symbols completed. RHLD took 1.9s. Estimated remaining: 3m 1s. Rate: 188.3 symbols/min [2025-09-29T02:06:56.399714] [INFO ] [MAIN ] RITM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:56.637144] [INFO ] [MAIN ] RIV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:56.656571] [DEBUG] [LOCAL ] RIG: Loaded 54449 existing records from primary storage. [2025-09-29T02:06:56.657733] [INFO ] [MAIN ] RIG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:56.658795] [INFO ] [MAIN ] Update Progress: 1805/2371 symbols completed. RIG took 0.9s. Estimated remaining: 3m 0s. Rate: 188.3 symbols/min [2025-09-29T02:06:56.828110] [DEBUG] [LOCAL ] RIO: Loaded 54173 existing records from primary storage. [2025-09-29T02:06:56.826791] [DEBUG] [LOCAL ] RIV: Loaded 12193 existing records from primary storage. [2025-09-29T02:06:56.850877] [INFO ] [MAIN ] RIO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:56.851304] [INFO ] [MAIN ] Update Progress: 1806/2371 symbols completed. RIO took 1.0s. Estimated remaining: 3m 0s. Rate: 188.3 symbols/min [2025-09-29T02:06:56.867867] [INFO ] [MAIN ] RIV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:56.873437] [INFO ] [MAIN ] Update Progress: 1807/2371 symbols completed. RIV took 0.5s. Estimated remaining: 2m 60s. Rate: 188.4 symbols/min [2025-09-29T02:06:56.976490] [DEBUG] [LOCAL ] RITM: Loaded 53589 existing records from primary storage. [2025-09-29T02:06:57.005297] [INFO ] [MAIN ] RITM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:57.074297] [INFO ] [MAIN ] RJF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:57.053807] [INFO ] [MAIN ] Update Progress: 1808/2371 symbols completed. RITM took 1.2s. Estimated remaining: 2m 59s. Rate: 188.5 symbols/min [2025-09-29T02:06:57.493921] [INFO ] [MAIN ] RKT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:57.469117] [INFO ] [MAIN ] RL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:57.616869] [INFO ] [MAIN ] RLI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:57.639578] [DEBUG] [LOCAL ] RJF: Loaded 47804 existing records from primary storage. [2025-09-29T02:06:57.640482] [INFO ] [MAIN ] RJF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:57.640630] [INFO ] [MAIN ] Update Progress: 1809/2371 symbols completed. RJF took 1.0s. Estimated remaining: 2m 59s. Rate: 188.4 symbols/min [2025-09-29T02:06:57.880742] [DEBUG] [LOCAL ] RL: Loaded 41998 existing records from primary storage. [2025-09-29T02:06:57.886571] [DEBUG] [LOCAL ] RLI: Loaded 33794 existing records from primary storage. [2025-09-29T02:06:57.897778] [INFO ] [MAIN ] RLI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:57.911979] [INFO ] [MAIN ] Update Progress: 1810/2371 symbols completed. RLI took 0.8s. Estimated remaining: 2m 59s. Rate: 188.4 symbols/min [2025-09-29T02:06:57.897977] [INFO ] [MAIN ] RL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:57.911507] [DEBUG] [LOCAL ] RKT: Loaded 54501 existing records from primary storage. [2025-09-29T02:06:57.980526] [INFO ] [MAIN ] RKT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:57.958207] [INFO ] [MAIN ] Update Progress: 1811/2371 symbols completed. RL took 1.1s. Estimated remaining: 2m 58s. Rate: 188.5 symbols/min [2025-09-29T02:06:58.006374] [INFO ] [MAIN ] Update Progress: 1812/2371 symbols completed. RKT took 1.1s. Estimated remaining: 2m 58s. Rate: 188.6 symbols/min [2025-09-29T02:06:57.984793] [INFO ] [MAIN ] RLJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:58.473893] [INFO ] [MAIN ] RLTY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:58.453901] [INFO ] [MAIN ] RLX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:58.551040] [INFO ] [MAIN ] RM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:58.575506] [DEBUG] [LOCAL ] RLJ: Loaded 48922 existing records from primary storage. [2025-09-29T02:06:58.576230] [INFO ] [MAIN ] RLJ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:58.581695] [INFO ] [MAIN ] Update Progress: 1813/2371 symbols completed. RLJ took 0.9s. Estimated remaining: 2m 58s. Rate: 188.5 symbols/min [2025-09-29T02:06:58.584495] [DEBUG] [LOCAL ] RLTY: Loaded 11255 existing records from primary storage. [2025-09-29T02:06:58.629194] [INFO ] [MAIN ] RLTY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:58.629854] [DEBUG] [LOCAL ] RM: Loaded 7734 existing records from primary storage. [2025-09-29T02:06:58.651723] [INFO ] [MAIN ] RM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:58.666183] [INFO ] [MAIN ] Update Progress: 1814/2371 symbols completed. RM took 0.7s. Estimated remaining: 2m 57s. Rate: 188.6 symbols/min [2025-09-29T02:06:58.699845] [INFO ] [MAIN ] Update Progress: 1815/2371 symbols completed. RLTY took 0.8s. Estimated remaining: 2m 57s. Rate: 188.7 symbols/min [2025-09-29T02:06:59.050591] [INFO ] [MAIN ] RMAX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:59.039058] [DEBUG] [LOCAL ] RLX: Loaded 48987 existing records from primary storage. [2025-09-29T02:06:59.109593] [INFO ] [MAIN ] RLX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:59.125516] [INFO ] [MAIN ] Update Progress: 1816/2371 symbols completed. RLX took 1.1s. Estimated remaining: 2m 57s. Rate: 188.6 symbols/min [2025-09-29T02:06:59.166536] [INFO ] [MAIN ] RMD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:59.260425] [INFO ] [MAIN ] RMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:59.356969] [DEBUG] [LOCAL ] RMI: Loaded 4716 existing records from primary storage. [2025-09-29T02:06:59.384278] [DEBUG] [LOCAL ] RMAX: Loaded 22121 existing records from primary storage. [2025-09-29T02:06:59.400974] [INFO ] [MAIN ] RMAX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:59.378170] [INFO ] [MAIN ] RMI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:59.407693] [INFO ] [MAIN ] Update Progress: 1817/2371 symbols completed. RMI took 0.7s. Estimated remaining: 2m 56s. Rate: 188.6 symbols/min [2025-09-29T02:06:59.434772] [INFO ] [MAIN ] Update Progress: 1818/2371 symbols completed. RMAX took 0.9s. Estimated remaining: 2m 56s. Rate: 188.7 symbols/min [2025-09-29T02:06:59.451218] [INFO ] [MAIN ] RMM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:59.770255] [DEBUG] [LOCAL ] RMM: Loaded 10624 existing records from primary storage. [2025-09-29T02:06:59.766067] [DEBUG] [LOCAL ] RMD: Loaded 42855 existing records from primary storage. [2025-09-29T02:06:59.801578] [INFO ] [MAIN ] RMMZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:59.802007] [INFO ] [MAIN ] RMM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:59.831416] [INFO ] [MAIN ] RMD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:06:59.831798] [INFO ] [MAIN ] Update Progress: 1819/2371 symbols completed. RMM took 0.7s. Estimated remaining: 2m 56s. Rate: 188.7 symbols/min [2025-09-29T02:06:59.862758] [INFO ] [MAIN ] RMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:06:59.868582] [INFO ] [MAIN ] Update Progress: 1820/2371 symbols completed. RMD took 1.2s. Estimated remaining: 2m 55s. Rate: 188.8 symbols/min [2025-09-29T02:06:59.944008] [DEBUG] [LOCAL ] RMMZ: Loaded 4875 existing records from primary storage. [2025-09-29T02:06:59.986873] [INFO ] [MAIN ] RMMZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:00.063596] [INFO ] [MAIN ] Update Progress: 1821/2371 symbols completed. RMMZ took 0.6s. Estimated remaining: 2m 55s. Rate: 188.8 symbols/min [2025-09-29T02:07:00.137885] [DEBUG] [LOCAL ] RMT: Loaded 17682 existing records from primary storage. [2025-09-29T02:07:00.216667] [INFO ] [MAIN ] RMT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:00.363881] [INFO ] [MAIN ] RNG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:00.395013] [INFO ] [MAIN ] RNGR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:00.373536] [INFO ] [MAIN ] Update Progress: 1822/2371 symbols completed. RMT took 0.9s. Estimated remaining: 2m 54s. Rate: 188.8 symbols/min [2025-09-29T02:07:00.611922] [INFO ] [MAIN ] RNP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:00.636241] [DEBUG] [LOCAL ] RNGR: Loaded 20653 existing records from primary storage. [2025-09-29T02:07:00.664876] [INFO ] [MAIN ] RNGR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:00.665153] [INFO ] [MAIN ] Update Progress: 1823/2371 symbols completed. RNGR took 0.8s. Estimated remaining: 2m 54s. Rate: 188.9 symbols/min [2025-09-29T02:07:00.724930] [INFO ] [MAIN ] RNR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:00.839970] [DEBUG] [LOCAL ] RNP: Loaded 15940 existing records from primary storage. [2025-09-29T02:07:00.851873] [INFO ] [MAIN ] RNP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:00.883630] [INFO ] [MAIN ] Update Progress: 1824/2371 symbols completed. RNP took 0.8s. Estimated remaining: 2m 54s. Rate: 188.9 symbols/min [2025-09-29T02:07:00.928985] [DEBUG] [LOCAL ] RNG: Loaded 48830 existing records from primary storage. [2025-09-29T02:07:00.954392] [INFO ] [MAIN ] RNST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:00.997577] [INFO ] [MAIN ] RNG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:01.003193] [INFO ] [MAIN ] Update Progress: 1825/2371 symbols completed. RNG took 1.1s. Estimated remaining: 2m 53s. Rate: 188.9 symbols/min [2025-09-29T02:07:01.218078] [DEBUG] [LOCAL ] RNR: Loaded 34623 existing records from primary storage. [2025-09-29T02:07:01.288304] [INFO ] [MAIN ] RNR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:01.288137] [INFO ] [MAIN ] ROG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:01.292530] [INFO ] [MAIN ] Update Progress: 1826/2371 symbols completed. RNR took 0.9s. Estimated remaining: 2m 53s. Rate: 189.0 symbols/min [2025-09-29T02:07:01.470252] [INFO ] [MAIN ] ROK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:01.580091] [DEBUG] [LOCAL ] RNST: Loaded 37619 existing records from primary storage. [2025-09-29T02:07:01.592504] [DEBUG] [LOCAL ] ROG: Loaded 23367 existing records from primary storage. [2025-09-29T02:07:01.621494] [INFO ] [MAIN ] ROL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:01.621900] [INFO ] [MAIN ] ROG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:01.622421] [INFO ] [MAIN ] Update Progress: 1827/2371 symbols completed. ROG took 0.7s. Estimated remaining: 2m 53s. Rate: 189.0 symbols/min [2025-09-29T02:07:01.598242] [INFO ] [MAIN ] RNST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:01.634569] [INFO ] [MAIN ] Update Progress: 1828/2371 symbols completed. RNST took 1.0s. Estimated remaining: 2m 52s. Rate: 189.1 symbols/min [2025-09-29T02:07:02.056881] [INFO ] [MAIN ] RPM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:02.073098] [DEBUG] [LOCAL ] ROK: Loaded 44522 existing records from primary storage. [2025-09-29T02:07:02.071384] [INFO ] [MAIN ] RPT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:02.089476] [DEBUG] [LOCAL ] ROL: Loaded 51031 existing records from primary storage. [2025-09-29T02:07:02.088312] [INFO ] [MAIN ] ROK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:02.090883] [INFO ] [MAIN ] Update Progress: 1829/2371 symbols completed. ROK took 1.1s. Estimated remaining: 2m 52s. Rate: 189.0 symbols/min [2025-09-29T02:07:02.096482] [INFO ] [MAIN ] ROL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:02.134702] [INFO ] [MAIN ] Update Progress: 1830/2371 symbols completed. ROL took 0.8s. Estimated remaining: 2m 52s. Rate: 189.1 symbols/min [2025-09-29T02:07:02.297443] [DEBUG] [LOCAL ] RPT: Loaded 19767 existing records from primary storage. [2025-09-29T02:07:02.407544] [INFO ] [MAIN ] RPT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:02.422361] [INFO ] [MAIN ] RQI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:02.433930] [INFO ] [MAIN ] Update Progress: 1831/2371 symbols completed. RPT took 0.8s. Estimated remaining: 2m 51s. Rate: 189.1 symbols/min [2025-09-29T02:07:02.457519] [DEBUG] [LOCAL ] RPM: Loaded 41763 existing records from primary storage. [2025-09-29T02:07:02.547860] [INFO ] [MAIN ] RRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:02.489042] [INFO ] [MAIN ] RPM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:02.565715] [INFO ] [MAIN ] Update Progress: 1832/2371 symbols completed. RPM took 0.9s. Estimated remaining: 2m 51s. Rate: 189.2 symbols/min [2025-09-29T02:07:02.975612] [INFO ] [MAIN ] RS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:02.979975] [INFO ] [MAIN ] RRX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:02.981228] [DEBUG] [LOCAL ] RQI: Loaded 29573 existing records from primary storage. [2025-09-29T02:07:03.003681] [INFO ] [MAIN ] RQI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:03.006004] [INFO ] [MAIN ] Update Progress: 1833/2371 symbols completed. RQI took 0.9s. Estimated remaining: 2m 51s. Rate: 189.1 symbols/min [2025-09-29T02:07:03.007333] [DEBUG] [LOCAL ] RRC: Loaded 53554 existing records from primary storage. [2025-09-29T02:07:03.037194] [INFO ] [MAIN ] RRC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:03.055383] [INFO ] [MAIN ] Update Progress: 1834/2371 symbols completed. RRC took 0.9s. Estimated remaining: 2m 50s. Rate: 189.2 symbols/min [2025-09-29T02:07:03.161983] [DEBUG] [LOCAL ] RS: Loaded 25864 existing records from primary storage. [2025-09-29T02:07:03.191868] [INFO ] [MAIN ] RS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:03.246609] [INFO ] [MAIN ] Update Progress: 1835/2371 symbols completed. RS took 0.7s. Estimated remaining: 2m 50s. Rate: 189.3 symbols/min [2025-09-29T02:07:03.393816] [INFO ] [MAIN ] RSF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:03.418427] [DEBUG] [LOCAL ] RRX: Loaded 41752 existing records from primary storage. [2025-09-29T02:07:03.468637] [INFO ] [MAIN ] RRX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:03.551987] [INFO ] [MAIN ] Update Progress: 1836/2371 symbols completed. RRX took 1.1s. Estimated remaining: 2m 50s. Rate: 189.3 symbols/min [2025-09-29T02:07:03.555605] [DEBUG] [LOCAL ] RSF: Loaded 4192 existing records from primary storage. [2025-09-29T02:07:03.615563] [INFO ] [MAIN ] RSG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:03.651983] [INFO ] [MAIN ] RSF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:03.688503] [INFO ] [MAIN ] RSI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:03.701062] [INFO ] [MAIN ] Update Progress: 1837/2371 symbols completed. RSF took 0.7s. Estimated remaining: 2m 49s. Rate: 189.3 symbols/min [2025-09-29T02:07:03.863718] [INFO ] [MAIN ] RSKD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:03.925299] [DEBUG] [LOCAL ] RSG: Loaded 48173 existing records from primary storage. [2025-09-29T02:07:03.934538] [DEBUG] [LOCAL ] RSI: Loaded 47695 existing records from primary storage. [2025-09-29T02:07:03.935054] [INFO ] [MAIN ] RSG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:03.935329] [INFO ] [MAIN ] Update Progress: 1838/2371 symbols completed. RSG took 0.8s. Estimated remaining: 2m 49s. Rate: 189.3 symbols/min [2025-09-29T02:07:03.936042] [INFO ] [MAIN ] RSI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:03.936234] [INFO ] [MAIN ] Update Progress: 1839/2371 symbols completed. RSI took 0.6s. Estimated remaining: 2m 48s. Rate: 189.4 symbols/min [2025-09-29T02:07:03.949608] [DEBUG] [LOCAL ] RSKD: Loaded 34254 existing records from primary storage. [2025-09-29T02:07:03.949972] [INFO ] [MAIN ] RSKD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:03.950074] [INFO ] [MAIN ] Update Progress: 1840/2371 symbols completed. RSKD took 0.4s. Estimated remaining: 2m 48s. Rate: 189.5 symbols/min [2025-09-29T02:07:04.644704] [INFO ] [MAIN ] RTO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:04.690465] [INFO ] [MAIN ] RVT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:04.744699] [INFO ] [MAIN ] RVLV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:04.766531] [INFO ] [MAIN ] RTX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:04.812372] [DEBUG] [LOCAL ] RVT: Loaded 27362 existing records from primary storage. [2025-09-29T02:07:04.813151] [INFO ] [MAIN ] RVT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:04.813560] [INFO ] [MAIN ] Update Progress: 1841/2371 symbols completed. RVT took 0.9s. Estimated remaining: 2m 48s. Rate: 189.4 symbols/min [2025-09-29T02:07:04.964168] [DEBUG] [LOCAL ] RTO: Loaded 40847 existing records from primary storage. [2025-09-29T02:07:05.006907] [INFO ] [MAIN ] RTO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:05.008479] [INFO ] [MAIN ] Update Progress: 1842/2371 symbols completed. RTO took 1.1s. Estimated remaining: 2m 48s. Rate: 189.4 symbols/min [2025-09-29T02:07:05.009597] [DEBUG] [LOCAL ] RTX: Loaded 54488 existing records from primary storage. [2025-09-29T02:07:05.038554] [DEBUG] [LOCAL ] RVLV: Loaded 48453 existing records from primary storage. [2025-09-29T02:07:05.038733] [INFO ] [MAIN ] RTX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:05.156113] [INFO ] [MAIN ] RVTY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:05.130049] [INFO ] [MAIN ] Update Progress: 1843/2371 symbols completed. RTX took 1.2s. Estimated remaining: 2m 47s. Rate: 189.5 symbols/min [2025-09-29T02:07:05.085735] [INFO ] [MAIN ] RVLV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:05.204994] [INFO ] [MAIN ] Update Progress: 1844/2371 symbols completed. RVLV took 1.2s. Estimated remaining: 2m 47s. Rate: 189.5 symbols/min [2025-09-29T02:07:05.522988] [INFO ] [MAIN ] RWT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:05.677603] [INFO ] [MAIN ] RWTO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:05.695789] [DEBUG] [LOCAL ] RWTO: No existing data file found in primary storage. [2025-09-29T02:07:05.699479] [INFO ] [MAIN ] RWTN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:05.700136] [DEBUG] [LOCAL ] RWTN: No existing data file found in primary storage. [2025-09-29T02:07:05.700223] [WARN ] [MAIN ] RWTN: No existing data found, performing full refresh instead. [2025-09-29T02:07:05.699693] [WARN ] [MAIN ] RWTO: No existing data found, performing full refresh instead. [2025-09-29T02:07:05.700466] [INFO ] [MAIN ] RWTO: Wiping existing primary data before full refresh. [2025-09-29T02:07:05.700706] [INFO ] [MAIN ] RWTN: Wiping existing primary data before full refresh. [2025-09-29T02:07:05.700792] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-09-29T02:07:05.700897] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-09-29T02:07:05.700988] [INFO ] [MAIN ] RWTN: Starting full primary refresh. [2025-09-29T02:07:05.700569] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-09-29T02:07:05.720901] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-09-29T02:07:05.731896] [INFO ] [MAIN ] RWTO: Starting full primary refresh. [2025-09-29T02:07:05.818033] [DEBUG] [LOCAL ] RVTY: Loaded 48199 existing records from primary storage. [2025-09-29T02:07:05.900975] [INFO ] [MAIN ] RVTY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:05.931431] [INFO ] [MAIN ] Update Progress: 1845/2371 symbols completed. RVTY took 1.1s. Estimated remaining: 2m 47s. Rate: 189.4 symbols/min [2025-09-29T02:07:06.032972] [DEBUG] [LOCAL ] RWT: Loaded 41352 existing records from primary storage. [2025-09-29T02:07:06.112345] [INFO ] [MAIN ] RWT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:06.154125] [INFO ] [MAIN ] Update Progress: 1846/2371 symbols completed. RWT took 1.1s. Estimated remaining: 2m 46s. Rate: 189.4 symbols/min [2025-09-29T02:07:06.684871] [INFO ] [MAIN ] RWTP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:06.751440] [DEBUG] [LOCAL ] RWTP: No existing data file found in primary storage. [2025-09-29T02:07:06.764094] [WARN ] [MAIN ] RWTP: No existing data found, performing full refresh instead. [2025-09-29T02:07:06.803798] [INFO ] [MAIN ] RWTP: Wiping existing primary data before full refresh. [2025-09-29T02:07:06.838922] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-09-29T02:07:06.878989] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-09-29T02:07:06.979156] [INFO ] [MAIN ] RXO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:06.960596] [INFO ] [MAIN ] RWTP: Starting full primary refresh. [2025-09-29T02:07:06.960460] [INFO ] [REMOTE ] RWTN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:07:06.980020] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2024-12. [2025-09-29T02:07:07.095605] [INFO ] [REMOTE ] RWTO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:07:07.133530] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2024-12. [2025-09-29T02:07:07.403442] [DEBUG] [LOCAL ] RXO: Loaded 48520 existing records from primary storage. [2025-09-29T02:07:07.397833] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-29T02:07:07.421407] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-01. [2025-09-29T02:07:07.452799] [INFO ] [MAIN ] RXO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:07.460178] [INFO ] [MAIN ] Update Progress: 1847/2371 symbols completed. RXO took 1.2s. Estimated remaining: 2m 46s. Rate: 189.1 symbols/min [2025-09-29T02:07:07.475465] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-09-29T02:07:07.531129] [INFO ] [REMOTE ] RWTP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:07:07.548242] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2024-12. [2025-09-29T02:07:07.524317] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-01. [2025-09-29T02:07:07.705557] [INFO ] [MAIN ] RY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:07.739060] [DEBUG] [REMOTE ] RWTP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:07:07.739759] [WARN ] [REMOTE ] RWTP: No data returned for month 2024-12 [2025-09-29T02:07:07.740002] [FATAL] [REMOTE ] RWTP: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:07:07.740150] [FATAL] [MAIN ] RWTP: Failed to fetch primary data. [2025-09-29T02:07:07.740224] [WARN ] [MAIN ] RWTP: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:07:07.740301] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-09-29T02:07:07.740452] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-09-29T02:07:07.740533] [INFO ] [LOCAL ] RWTP: Starting deletion of derivative data. [2025-09-29T02:07:07.740675] [DEBUG] [LOCAL ] RWTP: No derivative data file found to delete. [2025-09-29T02:07:07.740778] [INFO ] [MAIN ] Update Progress: 1848/2371 symbols completed. RWTP took 1.8s. Estimated remaining: 2m 46s. Rate: 189.1 symbols/min [2025-09-29T02:07:07.855473] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-29T02:07:07.875401] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-02. [2025-09-29T02:07:07.904285] [DEBUG] [LOCAL ] RY: Loaded 48606 existing records from primary storage. [2025-09-29T02:07:07.938005] [INFO ] [MAIN ] RY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:07.940590] [INFO ] [MAIN ] Update Progress: 1849/2371 symbols completed. RY took 0.5s. Estimated remaining: 2m 46s. Rate: 189.2 symbols/min [2025-09-29T02:07:07.961185] [INFO ] [MAIN ] RYAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:08.054500] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-29T02:07:08.083771] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-02. [2025-09-29T02:07:08.171280] [INFO ] [MAIN ] RYAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:08.185808] [DEBUG] [LOCAL ] RYAM: Loaded 35709 existing records from primary storage. [2025-09-29T02:07:08.186263] [INFO ] [MAIN ] RYAM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:08.186371] [INFO ] [MAIN ] Update Progress: 1850/2371 symbols completed. RYAM took 0.4s. Estimated remaining: 2m 45s. Rate: 189.2 symbols/min [2025-09-29T02:07:08.296205] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-29T02:07:08.311082] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-03. [2025-09-29T02:07:08.344008] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-09-29T02:07:08.390297] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-03. [2025-09-29T02:07:08.411844] [INFO ] [MAIN ] RYI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:08.430584] [DEBUG] [LOCAL ] RYAN: Loaded 44960 existing records from primary storage. [2025-09-29T02:07:08.431141] [INFO ] [MAIN ] RYAN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:08.431920] [INFO ] [MAIN ] Update Progress: 1851/2371 symbols completed. RYAN took 0.5s. Estimated remaining: 2m 45s. Rate: 189.2 symbols/min [2025-09-29T02:07:08.579882] [DEBUG] [LOCAL ] RYI: Loaded 21835 existing records from primary storage. [2025-09-29T02:07:08.619077] [INFO ] [MAIN ] RYI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:08.639444] [INFO ] [MAIN ] RYN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:08.639542] [INFO ] [MAIN ] Update Progress: 1852/2371 symbols completed. RYI took 0.5s. Estimated remaining: 2m 45s. Rate: 189.3 symbols/min [2025-09-29T02:07:08.697208] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-29T02:07:08.720195] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-04. [2025-09-29T02:07:08.773445] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-29T02:07:08.781980] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-04. [2025-09-29T02:07:08.856275] [INFO ] [MAIN ] RZB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:08.877818] [DEBUG] [LOCAL ] RZB: Loaded 6291 existing records from primary storage. [2025-09-29T02:07:08.879384] [INFO ] [MAIN ] RZB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:08.893129] [INFO ] [MAIN ] Update Progress: 1853/2371 symbols completed. RZB took 0.3s. Estimated remaining: 2m 44s. Rate: 189.3 symbols/min [2025-09-29T02:07:08.894846] [DEBUG] [LOCAL ] RYN: Loaded 46335 existing records from primary storage. [2025-09-29T02:07:08.959909] [INFO ] [MAIN ] RYN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:08.988242] [INFO ] [MAIN ] Update Progress: 1854/2371 symbols completed. RYN took 0.6s. Estimated remaining: 2m 44s. Rate: 189.3 symbols/min [2025-09-29T02:07:09.080377] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-29T02:07:09.186032] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-29T02:07:09.185850] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-05. [2025-09-29T02:07:09.217138] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-05. [2025-09-29T02:07:09.220511] [INFO ] [MAIN ] RZC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:09.306424] [INFO ] [MAIN ] S: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:09.310756] [DEBUG] [LOCAL ] RZC: Loaded 6838 existing records from primary storage. [2025-09-29T02:07:09.311004] [INFO ] [MAIN ] RZC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:09.311107] [INFO ] [MAIN ] Update Progress: 1855/2371 symbols completed. RZC took 0.4s. Estimated remaining: 2m 44s. Rate: 189.3 symbols/min [2025-09-29T02:07:09.512842] [INFO ] [MAIN ] SA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:09.536707] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-29T02:07:09.538509] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-06. [2025-09-29T02:07:09.539317] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-29T02:07:09.542282] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-06. [2025-09-29T02:07:09.566902] [DEBUG] [LOCAL ] S: Loaded 54315 existing records from primary storage. [2025-09-29T02:07:09.567373] [INFO ] [MAIN ] S: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:09.567561] [INFO ] [MAIN ] Update Progress: 1856/2371 symbols completed. S took 0.6s. Estimated remaining: 2m 43s. Rate: 189.4 symbols/min [2025-09-29T02:07:09.773924] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-09-29T02:07:09.773736] [INFO ] [MAIN ] SABA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:09.788415] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-07. [2025-09-29T02:07:09.790537] [DEBUG] [LOCAL ] SA: Loaded 43820 existing records from primary storage. [2025-09-29T02:07:09.791232] [INFO ] [MAIN ] SA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:09.791377] [INFO ] [MAIN ] Update Progress: 1857/2371 symbols completed. SA took 0.5s. Estimated remaining: 2m 43s. Rate: 189.4 symbols/min [2025-09-29T02:07:09.879790] [DEBUG] [LOCAL ] SABA: Loaded 9306 existing records from primary storage. [2025-09-29T02:07:09.901090] [INFO ] [MAIN ] SABA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:09.906440] [INFO ] [MAIN ] Update Progress: 1858/2371 symbols completed. SABA took 0.3s. Estimated remaining: 2m 42s. Rate: 189.5 symbols/min [2025-09-29T02:07:09.885245] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-29T02:07:09.922782] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-07. [2025-09-29T02:07:10.089895] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-09-29T02:07:10.110380] [INFO ] [MAIN ] SAFE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:10.117067] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-08. [2025-09-29T02:07:10.218280] [INFO ] [MAIN ] SAH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:10.246238] [DEBUG] [LOCAL ] SAFE: Loaded 30819 existing records from primary storage. [2025-09-29T02:07:10.246578] [INFO ] [MAIN ] SAFE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:10.246713] [INFO ] [MAIN ] Update Progress: 1859/2371 symbols completed. SAFE took 0.5s. Estimated remaining: 2m 42s. Rate: 189.4 symbols/min [2025-09-29T02:07:10.419033] [DEBUG] [LOCAL ] SAH: Loaded 22368 existing records from primary storage. [2025-09-29T02:07:10.455335] [INFO ] [MAIN ] SAH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:10.455064] [INFO ] [MAIN ] SAJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:10.455918] [DEBUG] [LOCAL ] SAJ: No existing data file found in primary storage. [2025-09-29T02:07:10.456018] [INFO ] [MAIN ] Update Progress: 1860/2371 symbols completed. SAH took 0.5s. Estimated remaining: 2m 42s. Rate: 189.5 symbols/min [2025-09-29T02:07:10.456205] [WARN ] [MAIN ] SAJ: No existing data found, performing full refresh instead. [2025-09-29T02:07:10.473957] [INFO ] [MAIN ] SAJ: Wiping existing primary data before full refresh. [2025-09-29T02:07:10.497116] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-29T02:07:10.502354] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-09-29T02:07:10.534769] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-09. [2025-09-29T02:07:10.540272] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-09-29T02:07:10.562110] [INFO ] [MAIN ] SAJ: Starting full primary refresh. [2025-09-29T02:07:10.575425] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-29T02:07:10.790839] [INFO ] [MAIN ] SAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:10.801273] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-08. [2025-09-29T02:07:10.881545] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-29T02:07:10.925867] [INFO ] [REMOTE ] RWTN: Full fetch complete (3130 records). [2025-09-29T02:07:10.939135] [DEBUG] [VALIDATOR ] RWTN: Validating primary data. [2025-09-29T02:07:11.077952] [DEBUG] [LOCAL ] SAM: Loaded 21766 existing records from primary storage. [2025-09-29T02:07:11.088205] [INFO ] [MAIN ] SAM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:11.088389] [INFO ] [MAIN ] Update Progress: 1861/2371 symbols completed. SAM took 0.6s. Estimated remaining: 2m 42s. Rate: 189.4 symbols/min [2025-09-29T02:07:11.267460] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-29T02:07:11.362632] [INFO ] [REMOTE ] SAJ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:07:11.525946] [INFO ] [MAIN ] SAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:11.523796] [WARN ] [VALIDATOR ] RWTN: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-29T02:07:11.526358] [FATAL] [MAIN ] RWTN: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:07:11.526543] [WARN ] [MAIN ] RWTN: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:07:11.527016] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-09-29T02:07:11.527123] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-09-29T02:07:11.527200] [INFO ] [LOCAL ] RWTN: Starting deletion of derivative data. [2025-09-29T02:07:11.527287] [DEBUG] [LOCAL ] RWTN: No derivative data file found to delete. [2025-09-29T02:07:11.527394] [INFO ] [MAIN ] Update Progress: 1862/2371 symbols completed. RWTN took 6.3s. Estimated remaining: 2m 41s. Rate: 189.3 symbols/min [2025-09-29T02:07:11.603110] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-09. [2025-09-29T02:07:11.737304] [INFO ] [MAIN ] SAND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:11.777374] [DEBUG] [LOCAL ] SAN: Loaded 53774 existing records from primary storage. [2025-09-29T02:07:11.778113] [INFO ] [MAIN ] SAN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:11.778297] [INFO ] [MAIN ] Update Progress: 1863/2371 symbols completed. SAN took 0.7s. Estimated remaining: 2m 41s. Rate: 189.4 symbols/min [2025-09-29T02:07:11.983526] [INFO ] [MAIN ] SAP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:12.002956] [DEBUG] [LOCAL ] SAND: Loaded 52527 existing records from primary storage. [2025-09-29T02:07:12.003477] [INFO ] [MAIN ] SAND: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:12.005744] [INFO ] [MAIN ] Update Progress: 1864/2371 symbols completed. SAND took 0.5s. Estimated remaining: 2m 41s. Rate: 189.4 symbols/min [2025-09-29T02:07:12.073815] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-29T02:07:12.100280] [INFO ] [REMOTE ] RWTO: Full fetch complete (4801 records). [2025-09-29T02:07:12.130932] [DEBUG] [VALIDATOR ] RWTO: Validating primary data. [2025-09-29T02:07:12.299244] [INFO ] [MAIN ] SAR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:12.403768] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2024-12. [2025-09-29T02:07:12.436169] [DEBUG] [LOCAL ] SAP: Loaded 50800 existing records from primary storage. [2025-09-29T02:07:12.521013] [INFO ] [MAIN ] SAP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:12.515465] [DEBUG] [LOCAL ] SAR: Loaded 16382 existing records from primary storage. [2025-09-29T02:07:12.520426] [WARN ] [VALIDATOR ] RWTO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-29T02:07:12.521261] [INFO ] [MAIN ] Update Progress: 1865/2371 symbols completed. SAP took 0.7s. Estimated remaining: 2m 40s. Rate: 189.3 symbols/min [2025-09-29T02:07:12.527400] [INFO ] [MAIN ] SAR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:12.527071] [FATAL] [MAIN ] RWTO: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:07:12.545159] [INFO ] [MAIN ] Update Progress: 1866/2371 symbols completed. SAR took 0.5s. Estimated remaining: 2m 40s. Rate: 189.4 symbols/min [2025-09-29T02:07:12.545006] [WARN ] [MAIN ] RWTO: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:07:12.578111] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-09-29T02:07:12.650718] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-09-29T02:07:12.686320] [INFO ] [LOCAL ] RWTO: Starting deletion of derivative data. [2025-09-29T02:07:12.747177] [DEBUG] [LOCAL ] RWTO: No derivative data file found to delete. [2025-09-29T02:07:12.747915] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-09-29T02:07:12.784633] [INFO ] [MAIN ] Update Progress: 1867/2371 symbols completed. RWTO took 7.5s. Estimated remaining: 2m 40s. Rate: 189.4 symbols/min [2025-09-29T02:07:12.976044] [INFO ] [MAIN ] SAT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:12.971529] [INFO ] [MAIN ] SARO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:13.005449] [DEBUG] [LOCAL ] SAT: No existing data file found in primary storage. [2025-09-29T02:07:13.024751] [WARN ] [MAIN ] SAT: No existing data found, performing full refresh instead. [2025-09-29T02:07:13.048833] [INFO ] [MAIN ] SAT: Wiping existing primary data before full refresh. [2025-09-29T02:07:13.080272] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-09-29T02:07:13.086211] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-09-29T02:07:13.086411] [INFO ] [MAIN ] SAT: Starting full primary refresh. [2025-09-29T02:07:13.222790] [INFO ] [MAIN ] SAY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:13.242230] [DEBUG] [LOCAL ] SAY: No existing data file found in primary storage. [2025-09-29T02:07:13.242352] [WARN ] [MAIN ] SAY: No existing data found, performing full refresh instead. [2025-09-29T02:07:13.242018] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-01. [2025-09-29T02:07:13.247715] [INFO ] [MAIN ] SAY: Wiping existing primary data before full refresh. [2025-09-29T02:07:13.288427] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-09-29T02:07:13.294731] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-09-29T02:07:13.294993] [INFO ] [MAIN ] SAY: Starting full primary refresh. [2025-09-29T02:07:13.515260] [DEBUG] [LOCAL ] SARO: Loaded 49425 existing records from primary storage. [2025-09-29T02:07:13.562262] [INFO ] [MAIN ] SARO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:13.581169] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-29T02:07:13.598073] [INFO ] [MAIN ] Update Progress: 1868/2371 symbols completed. SARO took 1.1s. Estimated remaining: 2m 39s. Rate: 189.3 symbols/min [2025-09-29T02:07:14.034262] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-02. [2025-09-29T02:07:14.150386] [INFO ] [REMOTE ] SAT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:07:14.311410] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-09-29T02:07:14.317601] [INFO ] [MAIN ] SAZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:14.324733] [INFO ] [REMOTE ] SAY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:07:14.325395] [DEBUG] [LOCAL ] SAZ: No existing data file found in primary storage. [2025-09-29T02:07:14.325491] [WARN ] [MAIN ] SAZ: No existing data found, performing full refresh instead. [2025-09-29T02:07:14.325617] [INFO ] [MAIN ] SAZ: Wiping existing primary data before full refresh. [2025-09-29T02:07:14.325729] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-09-29T02:07:14.325847] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-09-29T02:07:14.325920] [INFO ] [MAIN ] SAZ: Starting full primary refresh. [2025-09-29T02:07:14.720239] [INFO ] [REMOTE ] SAZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:07:14.800059] [INFO ] [REMOTE ] SAY: Fetching primary data for 2024-12. [2025-09-29T02:07:15.087247] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2024-12 (0.29 seconds). [2025-09-29T02:07:15.600062] [INFO ] [REMOTE ] SAT: Fetching primary data for 2024-12. [2025-09-29T02:07:15.874873] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2024-12 (0.27 seconds). [2025-09-29T02:07:16.400064] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2024-12. [2025-09-29T02:07:16.604691] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2024-12 (0.20 seconds). [2025-09-29T02:07:17.200063] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-01. [2025-09-29T02:07:17.406859] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-01 (0.21 seconds). [2025-09-29T02:07:18.000079] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-01. [2025-09-29T02:07:18.203913] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-01 (0.20 seconds). [2025-09-29T02:07:18.800051] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-02. [2025-09-29T02:07:19.008469] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-02 (0.21 seconds). [2025-09-29T02:07:19.600060] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-03. [2025-09-29T02:07:19.801757] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-03 (0.20 seconds). [2025-09-29T02:07:20.400089] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-04. [2025-09-29T02:07:20.610099] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-04 (0.21 seconds). [2025-09-29T02:07:21.200123] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-05. [2025-09-29T02:07:21.409718] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-05 (0.21 seconds). [2025-09-29T02:07:22.000092] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-01. [2025-09-29T02:07:22.201373] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-01 (0.20 seconds). [2025-09-29T02:07:22.800075] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-02. [2025-09-29T02:07:23.005582] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-02 (0.21 seconds). [2025-09-29T02:07:23.600082] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-03. [2025-09-29T02:07:23.885254] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-09-29T02:07:24.400061] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-03. [2025-09-29T02:07:24.689173] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-09-29T02:07:25.200064] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-02. [2025-09-29T02:07:25.402361] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-02 (0.20 seconds). [2025-09-29T02:07:26.000067] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-04. [2025-09-29T02:07:26.277686] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-09-29T02:07:26.800072] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-04. [2025-09-29T02:07:27.078098] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-09-29T02:07:27.600066] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-03. [2025-09-29T02:07:27.801025] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-03 (0.20 seconds). [2025-09-29T02:07:28.400070] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-05. [2025-09-29T02:07:28.685445] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-09-29T02:07:29.200077] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-06. [2025-09-29T02:07:29.406931] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-06 (0.21 seconds). [2025-09-29T02:07:30.000091] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-04. [2025-09-29T02:07:30.206779] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-04 (0.21 seconds). [2025-09-29T02:07:30.800063] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-06. [2025-09-29T02:07:31.002926] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-06 (0.20 seconds). [2025-09-29T02:07:31.600084] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-05. [2025-09-29T02:07:31.806962] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-05 (0.21 seconds). [2025-09-29T02:07:32.400075] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-07. [2025-09-29T02:07:32.595421] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-07 (0.20 seconds). [2025-09-29T02:07:33.200058] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-08. [2025-09-29T02:07:33.405251] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-08 (0.21 seconds). [2025-09-29T02:07:34.000063] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-09. [2025-09-29T02:07:34.200938] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-09 (0.20 seconds). [2025-09-29T02:07:34.201898] [INFO ] [REMOTE ] SAZ: Full fetch complete (1809 records). [2025-09-29T02:07:34.201993] [DEBUG] [VALIDATOR ] SAZ: Validating primary data. [2025-09-29T02:07:34.405306] [WARN ] [VALIDATOR ] SAZ: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-29T02:07:34.405593] [FATAL] [MAIN ] SAZ: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:07:34.405710] [WARN ] [MAIN ] SAZ: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:07:34.405832] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-09-29T02:07:34.405935] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-09-29T02:07:34.406031] [INFO ] [LOCAL ] SAZ: Starting deletion of derivative data. [2025-09-29T02:07:34.406142] [DEBUG] [LOCAL ] SAZ: No derivative data file found to delete. [2025-09-29T02:07:34.406253] [INFO ] [MAIN ] Update Progress: 1869/2371 symbols completed. SAZ took 20.7s. Estimated remaining: 2m 45s. Rate: 183.0 symbols/min [2025-09-29T02:07:34.588292] [INFO ] [MAIN ] SB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:34.626472] [DEBUG] [LOCAL ] SB: Loaded 33735 existing records from primary storage. [2025-09-29T02:07:34.626902] [INFO ] [MAIN ] SB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:34.627014] [INFO ] [MAIN ] Update Progress: 1870/2371 symbols completed. SB took 0.2s. Estimated remaining: 2m 44s. Rate: 183.0 symbols/min [2025-09-29T02:07:34.809270] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-06. [2025-09-29T02:07:34.814694] [INFO ] [MAIN ] SBDS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:34.815837] [DEBUG] [LOCAL ] SBDS: No existing data file found in primary storage. [2025-09-29T02:07:34.815978] [WARN ] [MAIN ] SBDS: No existing data found, performing full refresh instead. [2025-09-29T02:07:34.816132] [INFO ] [MAIN ] SBDS: Wiping existing primary data before full refresh. [2025-09-29T02:07:34.816208] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-09-29T02:07:34.816296] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-09-29T02:07:34.816375] [INFO ] [MAIN ] SBDS: Starting full primary refresh. [2025-09-29T02:07:35.116460] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-29T02:07:35.201584] [INFO ] [REMOTE ] SBDS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:07:35.600065] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-05. [2025-09-29T02:07:35.808222] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-05 (0.21 seconds). [2025-09-29T02:07:36.400063] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-07. [2025-09-29T02:07:36.605708] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-07 (0.21 seconds). [2025-09-29T02:07:37.200087] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-06. [2025-09-29T02:07:37.404546] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-06 (0.20 seconds). [2025-09-29T02:07:38.000058] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2024-12. [2025-09-29T02:07:38.116352] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:07:38.116706] [WARN ] [REMOTE ] SBDS: No data returned for month 2024-12 [2025-09-29T02:07:38.116805] [FATAL] [REMOTE ] SBDS: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:07:38.116912] [FATAL] [MAIN ] SBDS: Failed to fetch primary data. [2025-09-29T02:07:38.116983] [WARN ] [MAIN ] SBDS: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:07:38.117062] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-09-29T02:07:38.117216] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-09-29T02:07:38.117311] [INFO ] [LOCAL ] SBDS: Starting deletion of derivative data. [2025-09-29T02:07:38.117398] [DEBUG] [LOCAL ] SBDS: No derivative data file found to delete. [2025-09-29T02:07:38.117501] [INFO ] [MAIN ] Update Progress: 1871/2371 symbols completed. SBDS took 3.5s. Estimated remaining: 2m 45s. Rate: 182.1 symbols/min [2025-09-29T02:07:38.318051] [INFO ] [MAIN ] SBH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:38.371459] [DEBUG] [LOCAL ] SBH: Loaded 50565 existing records from primary storage. [2025-09-29T02:07:38.371899] [INFO ] [MAIN ] SBH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:38.372002] [INFO ] [MAIN ] Update Progress: 1872/2371 symbols completed. SBH took 0.3s. Estimated remaining: 2m 44s. Rate: 182.1 symbols/min [2025-09-29T02:07:38.557143] [INFO ] [MAIN ] SBI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:38.567503] [DEBUG] [LOCAL ] SBI: Loaded 7848 existing records from primary storage. [2025-09-29T02:07:38.567828] [INFO ] [MAIN ] SBI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:38.568117] [INFO ] [MAIN ] Update Progress: 1873/2371 symbols completed. SBI took 0.2s. Estimated remaining: 2m 44s. Rate: 182.1 symbols/min [2025-09-29T02:07:38.763552] [INFO ] [MAIN ] SBR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:38.775193] [DEBUG] [LOCAL ] SBR: Loaded 7350 existing records from primary storage. [2025-09-29T02:07:38.775524] [INFO ] [MAIN ] SBR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:38.775628] [INFO ] [MAIN ] Update Progress: 1874/2371 symbols completed. SBR took 0.2s. Estimated remaining: 2m 44s. Rate: 182.2 symbols/min [2025-09-29T02:07:38.805215] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-07. [2025-09-29T02:07:38.979102] [INFO ] [MAIN ] SBS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:39.031494] [DEBUG] [LOCAL ] SBS: Loaded 50166 existing records from primary storage. [2025-09-29T02:07:39.031940] [INFO ] [MAIN ] SBS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:39.032044] [INFO ] [MAIN ] Update Progress: 1875/2371 symbols completed. SBS took 0.3s. Estimated remaining: 2m 43s. Rate: 182.2 symbols/min [2025-09-29T02:07:39.099436] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-09-29T02:07:39.230629] [INFO ] [MAIN ] SBSI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:39.249027] [DEBUG] [LOCAL ] SBSI: Loaded 14974 existing records from primary storage. [2025-09-29T02:07:39.249361] [INFO ] [MAIN ] SBSI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:39.249604] [INFO ] [MAIN ] Update Progress: 1876/2371 symbols completed. SBSI took 0.2s. Estimated remaining: 2m 43s. Rate: 182.2 symbols/min [2025-09-29T02:07:39.441142] [INFO ] [MAIN ] SBSW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:39.499566] [DEBUG] [LOCAL ] SBSW: Loaded 53745 existing records from primary storage. [2025-09-29T02:07:39.500086] [INFO ] [MAIN ] SBSW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:39.500203] [INFO ] [MAIN ] Update Progress: 1877/2371 symbols completed. SBSW took 0.3s. Estimated remaining: 2m 43s. Rate: 182.2 symbols/min [2025-09-29T02:07:39.600059] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-08. [2025-09-29T02:07:39.806844] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-08 (0.21 seconds). [2025-09-29T02:07:40.400083] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-09. [2025-09-29T02:07:40.597953] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-09 (0.20 seconds). [2025-09-29T02:07:40.598851] [INFO ] [REMOTE ] SAJ: Full fetch complete (924 records). [2025-09-29T02:07:40.598975] [DEBUG] [VALIDATOR ] SAJ: Validating primary data. [2025-09-29T02:07:40.599423] [FATAL] [VALIDATOR ] SAJ: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-29T02:07:40.599509] [FATAL] [MAIN ] SAJ: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:07:40.599597] [WARN ] [MAIN ] SAJ: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:07:40.599701] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-09-29T02:07:40.599851] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-09-29T02:07:40.599943] [INFO ] [LOCAL ] SAJ: Starting deletion of derivative data. [2025-09-29T02:07:40.600057] [DEBUG] [LOCAL ] SAJ: No derivative data file found to delete. [2025-09-29T02:07:40.600157] [INFO ] [MAIN ] Update Progress: 1878/2371 symbols completed. SAJ took 30.4s. Estimated remaining: 2m 43s. Rate: 182.0 symbols/min [2025-09-29T02:07:41.200069] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-08. [2025-09-29T02:07:41.402884] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-08 (0.20 seconds). [2025-09-29T02:07:42.000071] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-09. [2025-09-29T02:07:42.200850] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-09 (0.20 seconds). [2025-09-29T02:07:42.201874] [INFO ] [REMOTE ] SAT: Full fetch complete (1599 records). [2025-09-29T02:07:42.201976] [DEBUG] [VALIDATOR ] SAT: Validating primary data. [2025-09-29T02:07:42.411412] [WARN ] [VALIDATOR ] SAT: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-29T02:07:42.411629] [FATAL] [MAIN ] SAT: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:07:42.411724] [WARN ] [MAIN ] SAT: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:07:42.411812] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-09-29T02:07:42.411957] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-09-29T02:07:42.412035] [INFO ] [LOCAL ] SAT: Starting deletion of derivative data. [2025-09-29T02:07:42.412141] [DEBUG] [LOCAL ] SAT: No derivative data file found to delete. [2025-09-29T02:07:42.412258] [INFO ] [MAIN ] Update Progress: 1879/2371 symbols completed. SAT took 29.9s. Estimated remaining: 2m 43s. Rate: 181.6 symbols/min [2025-09-29T02:07:42.800088] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-07. [2025-09-29T02:07:42.996471] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-07 (0.20 seconds). [2025-09-29T02:07:43.600072] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-08. [2025-09-29T02:07:43.824289] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-09-29T02:07:44.400071] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-09. [2025-09-29T02:07:44.611487] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-09 (0.21 seconds). [2025-09-29T02:07:44.612368] [INFO ] [REMOTE ] SAY: Full fetch complete (1412 records). [2025-09-29T02:07:44.612475] [DEBUG] [VALIDATOR ] SAY: Validating primary data. [2025-09-29T02:07:44.816983] [WARN ] [VALIDATOR ] SAY: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-09-29T02:07:44.817221] [FATAL] [MAIN ] SAY: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:07:44.817311] [WARN ] [MAIN ] SAY: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:07:44.817403] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-09-29T02:07:44.817520] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-09-29T02:07:44.817606] [INFO ] [LOCAL ] SAY: Starting deletion of derivative data. [2025-09-29T02:07:44.817744] [DEBUG] [LOCAL ] SAY: No derivative data file found to delete. [2025-09-29T02:07:44.817893] [INFO ] [MAIN ] Update Progress: 1880/2371 symbols completed. SAY took 32.0s. Estimated remaining: 2m 43s. Rate: 181.0 symbols/min [2025-09-29T02:07:45.530407] [INFO ] [MAIN ] SCD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:45.560297] [INFO ] [MAIN ] SBXD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:45.597483] [INFO ] [MAIN ] SCCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:45.597878] [DEBUG] [LOCAL ] SBXD: No existing data file found in primary storage. [2025-09-29T02:07:45.626137] [INFO ] [MAIN ] SCHW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:45.628606] [WARN ] [MAIN ] SBXD: No existing data found, performing full refresh instead. [2025-09-29T02:07:45.629188] [INFO ] [MAIN ] SBXD: Wiping existing primary data before full refresh. [2025-09-29T02:07:45.629588] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-09-29T02:07:45.629956] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-09-29T02:07:45.630157] [INFO ] [MAIN ] SBXD: Starting full primary refresh. [2025-09-29T02:07:45.721828] [DEBUG] [LOCAL ] SCD: Loaded 12749 existing records from primary storage. [2025-09-29T02:07:45.727953] [INFO ] [MAIN ] SCD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:45.744984] [INFO ] [MAIN ] Update Progress: 1881/2371 symbols completed. SCD took 0.9s. Estimated remaining: 2m 43s. Rate: 180.8 symbols/min [2025-09-29T02:07:46.182518] [DEBUG] [LOCAL ] SCCO: Loaded 50148 existing records from primary storage. [2025-09-29T02:07:46.241943] [DEBUG] [LOCAL ] SCHW: Loaded 54465 existing records from primary storage. [2025-09-29T02:07:46.242166] [INFO ] [MAIN ] SCCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:46.258349] [INFO ] [MAIN ] SCHW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:46.240089] [INFO ] [MAIN ] SCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:46.269059] [INFO ] [MAIN ] Update Progress: 1882/2371 symbols completed. SCCO took 1.5s. Estimated remaining: 2m 42s. Rate: 180.7 symbols/min [2025-09-29T02:07:46.290691] [INFO ] [MAIN ] Update Progress: 1883/2371 symbols completed. SCHW took 1.5s. Estimated remaining: 2m 42s. Rate: 180.8 symbols/min [2025-09-29T02:07:46.371482] [INFO ] [REMOTE ] SBXD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:07:46.430456] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2024-12. [2025-09-29T02:07:46.686083] [INFO ] [MAIN ] SCM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:46.726513] [INFO ] [MAIN ] SCL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:46.725339] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2024-12 (0.29 seconds). [2025-09-29T02:07:46.728355] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-01. [2025-09-29T02:07:46.748287] [DEBUG] [LOCAL ] SCI: Loaded 47257 existing records from primary storage. [2025-09-29T02:07:46.748989] [INFO ] [MAIN ] SCI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:46.752672] [INFO ] [MAIN ] Update Progress: 1884/2371 symbols completed. SCI took 1.0s. Estimated remaining: 2m 42s. Rate: 180.8 symbols/min [2025-09-29T02:07:46.841029] [DEBUG] [LOCAL ] SCL: Loaded 15113 existing records from primary storage. [2025-09-29T02:07:46.886719] [DEBUG] [LOCAL ] SCM: Loaded 20163 existing records from primary storage. [2025-09-29T02:07:46.873203] [INFO ] [MAIN ] SCL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:46.892237] [INFO ] [MAIN ] Update Progress: 1885/2371 symbols completed. SCL took 0.6s. Estimated remaining: 2m 41s. Rate: 180.8 symbols/min [2025-09-29T02:07:46.892002] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-01 (0.16 seconds). [2025-09-29T02:07:46.915921] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-02. [2025-09-29T02:07:46.898230] [INFO ] [MAIN ] SCM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:46.966474] [INFO ] [MAIN ] Update Progress: 1886/2371 symbols completed. SCM took 0.6s. Estimated remaining: 2m 41s. Rate: 180.9 symbols/min [2025-09-29T02:07:47.015045] [INFO ] [MAIN ] SCS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:47.223900] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-29T02:07:47.313524] [INFO ] [MAIN ] SD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:47.387305] [INFO ] [MAIN ] SDHC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:47.419688] [DEBUG] [LOCAL ] SCS: Loaded 43834 existing records from primary storage. [2025-09-29T02:07:47.420239] [INFO ] [MAIN ] SCS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:47.420463] [INFO ] [MAIN ] Update Progress: 1887/2371 symbols completed. SCS took 0.7s. Estimated remaining: 2m 41s. Rate: 180.9 symbols/min [2025-09-29T02:07:47.499119] [DEBUG] [LOCAL ] SDHC: Loaded 10686 existing records from primary storage. [2025-09-29T02:07:47.541838] [INFO ] [MAIN ] SDHC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:47.556564] [DEBUG] [LOCAL ] SD: Loaded 29368 existing records from primary storage. [2025-09-29T02:07:47.567558] [INFO ] [MAIN ] Update Progress: 1888/2371 symbols completed. SDHC took 0.5s. Estimated remaining: 2m 40s. Rate: 180.9 symbols/min [2025-09-29T02:07:47.572973] [INFO ] [MAIN ] SD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:47.604973] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-03. [2025-09-29T02:07:47.675088] [INFO ] [MAIN ] SDHY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:47.685773] [INFO ] [MAIN ] Update Progress: 1889/2371 symbols completed. SD took 0.8s. Estimated remaining: 2m 40s. Rate: 181.0 symbols/min [2025-09-29T02:07:47.859351] [DEBUG] [LOCAL ] SDHY: Loaded 10710 existing records from primary storage. [2025-09-29T02:07:47.907072] [INFO ] [MAIN ] SDHY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:47.918690] [INFO ] [MAIN ] Update Progress: 1890/2371 symbols completed. SDHY took 0.5s. Estimated remaining: 2m 39s. Rate: 181.0 symbols/min [2025-09-29T02:07:47.974934] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-29T02:07:48.012277] [INFO ] [MAIN ] SDRL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:48.112427] [INFO ] [MAIN ] SE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:48.238787] [INFO ] [MAIN ] SEE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:48.272545] [DEBUG] [LOCAL ] SDRL: Loaded 42459 existing records from primary storage. [2025-09-29T02:07:48.272976] [INFO ] [MAIN ] SDRL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:48.273094] [INFO ] [MAIN ] Update Progress: 1891/2371 symbols completed. SDRL took 0.7s. Estimated remaining: 2m 39s. Rate: 181.0 symbols/min [2025-09-29T02:07:48.415433] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-04. [2025-09-29T02:07:48.489608] [DEBUG] [LOCAL ] SE: Loaded 54140 existing records from primary storage. [2025-09-29T02:07:48.506259] [INFO ] [MAIN ] SE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:48.506629] [INFO ] [MAIN ] Update Progress: 1892/2371 symbols completed. SE took 0.8s. Estimated remaining: 2m 39s. Rate: 181.0 symbols/min [2025-09-29T02:07:48.554044] [INFO ] [MAIN ] SEG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:48.590116] [DEBUG] [LOCAL ] SEE: Loaded 49069 existing records from primary storage. [2025-09-29T02:07:48.620889] [INFO ] [MAIN ] SEE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:48.621023] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-04 (0.21 seconds). [2025-09-29T02:07:48.660778] [INFO ] [MAIN ] Update Progress: 1893/2371 symbols completed. SEE took 0.7s. Estimated remaining: 2m 38s. Rate: 181.1 symbols/min [2025-09-29T02:07:48.707538] [DEBUG] [LOCAL ] SEG: Loaded 13887 existing records from primary storage. [2025-09-29T02:07:48.758321] [INFO ] [MAIN ] SEG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:48.813851] [INFO ] [MAIN ] Update Progress: 1894/2371 symbols completed. SEG took 0.5s. Estimated remaining: 2m 38s. Rate: 181.1 symbols/min [2025-09-29T02:07:48.803501] [INFO ] [MAIN ] SEI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:49.049848] [INFO ] [MAIN ] SEM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:49.146454] [INFO ] [MAIN ] SEMR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:49.191293] [DEBUG] [LOCAL ] SEI: Loaded 50411 existing records from primary storage. [2025-09-29T02:07:49.191949] [INFO ] [MAIN ] SEI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:49.192090] [INFO ] [MAIN ] Update Progress: 1895/2371 symbols completed. SEI took 0.7s. Estimated remaining: 2m 38s. Rate: 181.1 symbols/min [2025-09-29T02:07:49.203839] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-05. [2025-09-29T02:07:49.336857] [DEBUG] [LOCAL ] SEM: Loaded 43533 existing records from primary storage. [2025-09-29T02:07:49.343400] [INFO ] [MAIN ] SEM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:49.358323] [INFO ] [MAIN ] Update Progress: 1896/2371 symbols completed. SEM took 0.7s. Estimated remaining: 2m 37s. Rate: 181.2 symbols/min [2025-09-29T02:07:49.412789] [DEBUG] [LOCAL ] SEMR: Loaded 42184 existing records from primary storage. [2025-09-29T02:07:49.452380] [INFO ] [MAIN ] SEMR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:49.460292] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-09-29T02:07:49.490358] [INFO ] [MAIN ] Update Progress: 1897/2371 symbols completed. SEMR took 0.7s. Estimated remaining: 2m 37s. Rate: 181.2 symbols/min [2025-09-29T02:07:49.508134] [INFO ] [MAIN ] SES: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:49.765915] [INFO ] [MAIN ] SF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:49.851007] [INFO ] [MAIN ] SFB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:49.873834] [DEBUG] [LOCAL ] SFB: Loaded 4046 existing records from primary storage. [2025-09-29T02:07:49.874484] [INFO ] [MAIN ] SFB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:49.874679] [INFO ] [MAIN ] Update Progress: 1898/2371 symbols completed. SFB took 0.4s. Estimated remaining: 2m 37s. Rate: 181.2 symbols/min [2025-09-29T02:07:50.006533] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-06. [2025-09-29T02:07:50.018725] [DEBUG] [LOCAL ] SES: Loaded 52331 existing records from primary storage. [2025-09-29T02:07:50.070799] [INFO ] [MAIN ] SES: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:50.081461] [INFO ] [MAIN ] Update Progress: 1899/2371 symbols completed. SES took 0.9s. Estimated remaining: 2m 36s. Rate: 181.3 symbols/min [2025-09-29T02:07:50.138558] [INFO ] [MAIN ] SFBS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:50.178717] [DEBUG] [LOCAL ] SF: Loaded 42360 existing records from primary storage. [2025-09-29T02:07:50.206877] [INFO ] [MAIN ] SF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:50.218412] [INFO ] [MAIN ] Update Progress: 1900/2371 symbols completed. SF took 0.8s. Estimated remaining: 2m 36s. Rate: 181.3 symbols/min [2025-09-29T02:07:50.441964] [INFO ] [MAIN ] SFL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:50.437345] [DEBUG] [LOCAL ] SFBS: Loaded 21483 existing records from primary storage. [2025-09-29T02:07:50.443089] [INFO ] [MAIN ] SFBS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:50.454222] [INFO ] [MAIN ] Update Progress: 1901/2371 symbols completed. SFBS took 0.6s. Estimated remaining: 2m 36s. Rate: 181.3 symbols/min [2025-09-29T02:07:50.593802] [INFO ] [MAIN ] SG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:50.659726] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-29T02:07:50.760363] [INFO ] [MAIN ] SGHC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:50.778191] [DEBUG] [LOCAL ] SFL: Loaded 46026 existing records from primary storage. [2025-09-29T02:07:50.778840] [INFO ] [MAIN ] SFL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:50.779086] [INFO ] [MAIN ] Update Progress: 1902/2371 symbols completed. SFL took 0.7s. Estimated remaining: 2m 35s. Rate: 181.3 symbols/min [2025-09-29T02:07:50.802095] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-07. [2025-09-29T02:07:50.991565] [DEBUG] [LOCAL ] SG: Loaded 54227 existing records from primary storage. [2025-09-29T02:07:51.030526] [INFO ] [MAIN ] SGI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:51.045138] [DEBUG] [LOCAL ] SGI: No existing data file found in primary storage. [2025-09-29T02:07:51.045430] [WARN ] [MAIN ] SGI: No existing data found, performing full refresh instead. [2025-09-29T02:07:51.030813] [INFO ] [MAIN ] SG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:51.045917] [INFO ] [MAIN ] SGI: Wiping existing primary data before full refresh. [2025-09-29T02:07:51.045704] [INFO ] [MAIN ] Update Progress: 1903/2371 symbols completed. SG took 0.8s. Estimated remaining: 2m 35s. Rate: 181.4 symbols/min [2025-09-29T02:07:51.046835] [DEBUG] [LOCAL ] SGHC: Loaded 46435 existing records from primary storage. [2025-09-29T02:07:51.064984] [INFO ] [MAIN ] SGHC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:51.082968] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-09-29T02:07:51.088469] [INFO ] [MAIN ] Update Progress: 1904/2371 symbols completed. SGHC took 0.6s. Estimated remaining: 2m 34s. Rate: 181.4 symbols/min [2025-09-29T02:07:51.097121] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-09-29T02:07:51.152375] [INFO ] [MAIN ] SGI: Starting full primary refresh. [2025-09-29T02:07:51.429601] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-29T02:07:51.507911] [INFO ] [MAIN ] SGU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:51.601687] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-08. [2025-09-29T02:07:51.601592] [INFO ] [MAIN ] SHAK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:51.710117] [DEBUG] [LOCAL ] SGU: Loaded 6765 existing records from primary storage. [2025-09-29T02:07:51.710784] [INFO ] [MAIN ] SGU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:51.729080] [INFO ] [MAIN ] Update Progress: 1905/2371 symbols completed. SGU took 0.7s. Estimated remaining: 2m 34s. Rate: 181.4 symbols/min [2025-09-29T02:07:52.041125] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-29T02:07:52.090899] [DEBUG] [LOCAL ] SHAK: Loaded 49831 existing records from primary storage. [2025-09-29T02:07:52.132192] [INFO ] [REMOTE ] SGI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:07:52.134894] [INFO ] [MAIN ] SHAK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:52.136933] [INFO ] [MAIN ] SHCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:52.137730] [INFO ] [MAIN ] Update Progress: 1906/2371 symbols completed. SHAK took 1.0s. Estimated remaining: 2m 34s. Rate: 181.3 symbols/min [2025-09-29T02:07:52.343724] [DEBUG] [LOCAL ] SHCO: Loaded 26427 existing records from primary storage. [2025-09-29T02:07:52.347860] [INFO ] [MAIN ] SHEL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:52.348345] [INFO ] [MAIN ] SHCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:52.349159] [INFO ] [MAIN ] Update Progress: 1907/2371 symbols completed. SHCO took 0.6s. Estimated remaining: 2m 33s. Rate: 181.4 symbols/min [2025-09-29T02:07:52.405227] [INFO ] [REMOTE ] SGI: Fetching primary data for 2024-12. [2025-09-29T02:07:52.538509] [INFO ] [MAIN ] SHG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:52.587184] [DEBUG] [LOCAL ] SHEL: Loaded 54451 existing records from primary storage. [2025-09-29T02:07:52.587677] [INFO ] [MAIN ] SHEL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:52.588349] [INFO ] [MAIN ] Update Progress: 1908/2371 symbols completed. SHEL took 0.5s. Estimated remaining: 2m 33s. Rate: 181.4 symbols/min [2025-09-29T02:07:52.622946] [DEBUG] [REMOTE ] SGI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:07:52.643407] [WARN ] [REMOTE ] SGI: No data returned for month 2024-12 [2025-09-29T02:07:52.649105] [DEBUG] [LOCAL ] SHG: Loaded 27307 existing records from primary storage. [2025-09-29T02:07:52.680596] [INFO ] [MAIN ] SHG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:52.680735] [FATAL] [REMOTE ] SGI: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:07:52.691299] [FATAL] [MAIN ] SGI: Failed to fetch primary data. [2025-09-29T02:07:52.686048] [INFO ] [MAIN ] Update Progress: 1909/2371 symbols completed. SHG took 0.3s. Estimated remaining: 2m 33s. Rate: 181.5 symbols/min [2025-09-29T02:07:52.698987] [WARN ] [MAIN ] SGI: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:07:52.745171] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-09-29T02:07:52.803202] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-09-29T02:07:52.876546] [INFO ] [MAIN ] SHO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:52.888922] [INFO ] [LOCAL ] SGI: Starting deletion of derivative data. [2025-09-29T02:07:52.889809] [DEBUG] [LOCAL ] SGI: No derivative data file found to delete. [2025-09-29T02:07:52.895376] [INFO ] [MAIN ] Update Progress: 1910/2371 symbols completed. SGI took 2.1s. Estimated remaining: 2m 32s. Rate: 181.5 symbols/min [2025-09-29T02:07:53.116137] [INFO ] [MAIN ] SHOC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:53.220465] [INFO ] [MAIN ] SHW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:53.214900] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-09. [2025-09-29T02:07:53.243776] [DEBUG] [LOCAL ] SHO: Loaded 50552 existing records from primary storage. [2025-09-29T02:07:53.247315] [DEBUG] [LOCAL ] SHOC: Loaded 3747 existing records from primary storage. [2025-09-29T02:07:53.247742] [INFO ] [MAIN ] SHOC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:53.247834] [INFO ] [MAIN ] SHO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:53.248503] [INFO ] [MAIN ] Update Progress: 1911/2371 symbols completed. SHOC took 0.5s. Estimated remaining: 2m 32s. Rate: 181.5 symbols/min [2025-09-29T02:07:53.249166] [INFO ] [MAIN ] Update Progress: 1912/2371 symbols completed. SHO took 0.7s. Estimated remaining: 2m 32s. Rate: 181.6 symbols/min [2025-09-29T02:07:53.630904] [INFO ] [MAIN ] SI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:53.541086] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-29T02:07:53.652604] [DEBUG] [LOCAL ] SI: No existing data file found in primary storage. [2025-09-29T02:07:53.653933] [INFO ] [REMOTE ] SBXD: Full fetch complete (3078 records). [2025-09-29T02:07:53.655452] [INFO ] [MAIN ] SID: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:53.657624] [WARN ] [MAIN ] SI: No existing data found, performing full refresh instead. [2025-09-29T02:07:53.655584] [DEBUG] [VALIDATOR ] SBXD: Validating primary data. [2025-09-29T02:07:53.659009] [FATAL] [VALIDATOR ] SBXD: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-29T02:07:53.659309] [INFO ] [MAIN ] SI: Wiping existing primary data before full refresh. [2025-09-29T02:07:53.674593] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-09-29T02:07:53.673288] [FATAL] [MAIN ] SBXD: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:07:53.675242] [WARN ] [MAIN ] SBXD: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:07:53.675325] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-09-29T02:07:53.675559] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-09-29T02:07:53.675195] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-09-29T02:07:53.675794] [INFO ] [MAIN ] SI: Starting full primary refresh. [2025-09-29T02:07:53.682827] [DEBUG] [LOCAL ] SHW: Loaded 51174 existing records from primary storage. [2025-09-29T02:07:53.675852] [INFO ] [LOCAL ] SBXD: Starting deletion of derivative data. [2025-09-29T02:07:53.700931] [INFO ] [MAIN ] SHW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:53.701723] [INFO ] [MAIN ] Update Progress: 1913/2371 symbols completed. SHW took 0.8s. Estimated remaining: 2m 31s. Rate: 181.6 symbols/min [2025-09-29T02:07:53.708439] [DEBUG] [LOCAL ] SBXD: No derivative data file found to delete. [2025-09-29T02:07:53.744302] [INFO ] [MAIN ] Update Progress: 1914/2371 symbols completed. SBXD took 8.9s. Estimated remaining: 2m 31s. Rate: 181.6 symbols/min [2025-09-29T02:07:54.112823] [DEBUG] [LOCAL ] SID: Loaded 42834 existing records from primary storage. [2025-09-29T02:07:54.156373] [INFO ] [MAIN ] SID: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:54.230292] [INFO ] [MAIN ] Update Progress: 1915/2371 symbols completed. SID took 0.9s. Estimated remaining: 2m 31s. Rate: 181.6 symbols/min [2025-09-29T02:07:54.281044] [INFO ] [MAIN ] SIG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:54.530637] [INFO ] [MAIN ] SII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:54.837034] [INFO ] [REMOTE ] SI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:07:54.842228] [INFO ] [MAIN ] SILA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:54.861495] [INFO ] [REMOTE ] SI: Fetching primary data for 2024-12. [2025-09-29T02:07:54.862563] [DEBUG] [LOCAL ] SII: Loaded 23644 existing records from primary storage. [2025-09-29T02:07:54.864622] [INFO ] [MAIN ] SII: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:54.866339] [INFO ] [MAIN ] Update Progress: 1916/2371 symbols completed. SII took 1.1s. Estimated remaining: 2m 30s. Rate: 181.5 symbols/min [2025-09-29T02:07:54.998729] [DEBUG] [LOCAL ] SIG: Loaded 47111 existing records from primary storage. [2025-09-29T02:07:55.021589] [INFO ] [MAIN ] SIG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:55.039400] [INFO ] [MAIN ] Update Progress: 1917/2371 symbols completed. SIG took 1.3s. Estimated remaining: 2m 30s. Rate: 181.5 symbols/min [2025-09-29T02:07:55.111291] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:07:55.116508] [INFO ] [MAIN ] SITC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:55.117593] [WARN ] [REMOTE ] SI: No data returned for month 2024-12 [2025-09-29T02:07:55.119856] [FATAL] [REMOTE ] SI: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:07:55.120003] [FATAL] [MAIN ] SI: Failed to fetch primary data. [2025-09-29T02:07:55.119358] [DEBUG] [LOCAL ] SILA: Loaded 31635 existing records from primary storage. [2025-09-29T02:07:55.120105] [WARN ] [MAIN ] SI: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:07:55.120459] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-09-29T02:07:55.120622] [INFO ] [MAIN ] SILA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:55.121174] [INFO ] [MAIN ] Update Progress: 1918/2371 symbols completed. SILA took 0.8s. Estimated remaining: 2m 30s. Rate: 181.6 symbols/min [2025-09-29T02:07:55.121059] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-09-29T02:07:55.121385] [INFO ] [LOCAL ] SI: Starting deletion of derivative data. [2025-09-29T02:07:55.121667] [DEBUG] [LOCAL ] SI: No derivative data file found to delete. [2025-09-29T02:07:55.121758] [INFO ] [MAIN ] Update Progress: 1919/2371 symbols completed. SI took 1.9s. Estimated remaining: 2m 29s. Rate: 181.7 symbols/min [2025-09-29T02:07:55.162890] [DEBUG] [LOCAL ] SITC: Loaded 42233 existing records from primary storage. [2025-09-29T02:07:55.163326] [INFO ] [MAIN ] SITC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:55.163436] [INFO ] [MAIN ] Update Progress: 1920/2371 symbols completed. SITC took 0.3s. Estimated remaining: 2m 29s. Rate: 181.8 symbols/min [2025-09-29T02:07:55.885541] [INFO ] [MAIN ] SKE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:55.887269] [INFO ] [MAIN ] SJT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:55.980638] [INFO ] [MAIN ] SITE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:56.000954] [INFO ] [MAIN ] SJM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:56.049962] [DEBUG] [LOCAL ] SJT: Loaded 22419 existing records from primary storage. [2025-09-29T02:07:56.050278] [INFO ] [MAIN ] SJT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:56.050366] [INFO ] [MAIN ] Update Progress: 1921/2371 symbols completed. SJT took 0.9s. Estimated remaining: 2m 29s. Rate: 181.6 symbols/min [2025-09-29T02:07:56.167594] [DEBUG] [LOCAL ] SKE: Loaded 36252 existing records from primary storage. [2025-09-29T02:07:56.178721] [INFO ] [MAIN ] SKE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:56.186915] [INFO ] [MAIN ] Update Progress: 1922/2371 symbols completed. SKE took 1.0s. Estimated remaining: 2m 28s. Rate: 181.7 symbols/min [2025-09-29T02:07:56.212409] [DEBUG] [LOCAL ] SITE: Loaded 35513 existing records from primary storage. [2025-09-29T02:07:56.231005] [INFO ] [MAIN ] SITE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:56.267215] [DEBUG] [LOCAL ] SJM: Loaded 50877 existing records from primary storage. [2025-09-29T02:07:56.272527] [INFO ] [MAIN ] Update Progress: 1923/2371 symbols completed. SITE took 1.1s. Estimated remaining: 2m 28s. Rate: 181.8 symbols/min [2025-09-29T02:07:56.314990] [INFO ] [MAIN ] SJM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:56.345768] [INFO ] [MAIN ] Update Progress: 1924/2371 symbols completed. SJM took 1.2s. Estimated remaining: 2m 27s. Rate: 181.8 symbols/min [2025-09-29T02:07:56.615579] [INFO ] [MAIN ] SKIL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:56.904321] [INFO ] [MAIN ] SKLZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:56.908783] [INFO ] [MAIN ] SKM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:56.915930] [DEBUG] [LOCAL ] SKIL: Loaded 6395 existing records from primary storage. [2025-09-29T02:07:56.935893] [INFO ] [MAIN ] SKT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:56.936208] [INFO ] [MAIN ] SKIL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:56.937209] [INFO ] [MAIN ] Update Progress: 1925/2371 symbols completed. SKIL took 0.9s. Estimated remaining: 2m 27s. Rate: 181.8 symbols/min [2025-09-29T02:07:57.043062] [DEBUG] [LOCAL ] SKLZ: Loaded 12122 existing records from primary storage. [2025-09-29T02:07:57.061092] [INFO ] [MAIN ] SKLZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:57.087887] [INFO ] [MAIN ] Update Progress: 1926/2371 symbols completed. SKLZ took 0.9s. Estimated remaining: 2m 27s. Rate: 181.8 symbols/min [2025-09-29T02:07:57.282474] [DEBUG] [LOCAL ] SKM: Loaded 35557 existing records from primary storage. [2025-09-29T02:07:57.270535] [INFO ] [MAIN ] SKY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:57.304675] [INFO ] [MAIN ] SKM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:57.316254] [INFO ] [MAIN ] Update Progress: 1927/2371 symbols completed. SKM took 1.0s. Estimated remaining: 2m 27s. Rate: 181.8 symbols/min [2025-09-29T02:07:57.384277] [DEBUG] [LOCAL ] SKT: Loaded 43227 existing records from primary storage. [2025-09-29T02:07:57.448859] [INFO ] [MAIN ] SKT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:57.503743] [INFO ] [MAIN ] Update Progress: 1928/2371 symbols completed. SKT took 1.1s. Estimated remaining: 2m 26s. Rate: 181.9 symbols/min [2025-09-29T02:07:57.552951] [INFO ] [MAIN ] SKYH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:57.706637] [INFO ] [MAIN ] SLB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:57.818361] [DEBUG] [LOCAL ] SKYH: Loaded 16851 existing records from primary storage. [2025-09-29T02:07:57.819768] [DEBUG] [LOCAL ] SKY: Loaded 38305 existing records from primary storage. [2025-09-29T02:07:57.827473] [INFO ] [MAIN ] SKY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:57.830230] [INFO ] [MAIN ] Update Progress: 1929/2371 symbols completed. SKY took 0.9s. Estimated remaining: 2m 26s. Rate: 181.9 symbols/min [2025-09-29T02:07:57.836085] [INFO ] [MAIN ] SKYH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:57.836499] [INFO ] [MAIN ] Update Progress: 1930/2371 symbols completed. SKYH took 0.7s. Estimated remaining: 2m 25s. Rate: 182.0 symbols/min [2025-09-29T02:07:57.913178] [INFO ] [MAIN ] SLF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:58.260474] [INFO ] [MAIN ] SLGN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:58.239056] [INFO ] [MAIN ] SLG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:58.296107] [DEBUG] [LOCAL ] SLB: Loaded 54477 existing records from primary storage. [2025-09-29T02:07:58.310046] [INFO ] [MAIN ] SLB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:58.310355] [INFO ] [MAIN ] Update Progress: 1931/2371 symbols completed. SLB took 1.0s. Estimated remaining: 2m 25s. Rate: 181.9 symbols/min [2025-09-29T02:07:58.311367] [DEBUG] [LOCAL ] SLF: Loaded 39426 existing records from primary storage. [2025-09-29T02:07:58.346533] [INFO ] [MAIN ] SLF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:58.374671] [INFO ] [MAIN ] Update Progress: 1932/2371 symbols completed. SLF took 0.8s. Estimated remaining: 2m 25s. Rate: 182.0 symbols/min [2025-09-29T02:07:58.665783] [INFO ] [MAIN ] SLNZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:58.691271] [DEBUG] [LOCAL ] SLGN: Loaded 41039 existing records from primary storage. [2025-09-29T02:07:58.691392] [DEBUG] [LOCAL ] SLNZ: No existing data file found in primary storage. [2025-09-29T02:07:58.692352] [DEBUG] [LOCAL ] SLG: Loaded 46130 existing records from primary storage. [2025-09-29T02:07:58.713793] [INFO ] [MAIN ] SLG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:58.725713] [INFO ] [MAIN ] Update Progress: 1933/2371 symbols completed. SLG took 0.9s. Estimated remaining: 2m 24s. Rate: 182.0 symbols/min [2025-09-29T02:07:58.697802] [WARN ] [MAIN ] SLNZ: No existing data found, performing full refresh instead. [2025-09-29T02:07:58.708393] [INFO ] [MAIN ] SLGN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:58.735845] [INFO ] [MAIN ] SLNZ: Wiping existing primary data before full refresh. [2025-09-29T02:07:58.741252] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-09-29T02:07:58.746605] [INFO ] [MAIN ] Update Progress: 1934/2371 symbols completed. SLGN took 0.9s. Estimated remaining: 2m 24s. Rate: 182.1 symbols/min [2025-09-29T02:07:58.749279] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-09-29T02:07:58.801850] [INFO ] [MAIN ] SLQT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:58.840936] [INFO ] [MAIN ] SLNZ: Starting full primary refresh. [2025-09-29T02:07:59.352472] [INFO ] [MAIN ] SLVM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:59.394151] [INFO ] [MAIN ] SM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:07:59.456100] [DEBUG] [LOCAL ] SLQT: Loaded 44370 existing records from primary storage. [2025-09-29T02:07:59.479541] [INFO ] [MAIN ] SLQT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:59.511148] [INFO ] [MAIN ] Update Progress: 1935/2371 symbols completed. SLQT took 1.1s. Estimated remaining: 2m 24s. Rate: 182.0 symbols/min [2025-09-29T02:07:59.682583] [DEBUG] [LOCAL ] SLVM: Loaded 28332 existing records from primary storage. [2025-09-29T02:07:59.746006] [INFO ] [MAIN ] SLVM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:07:59.810496] [INFO ] [REMOTE ] SLNZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:07:59.821505] [INFO ] [MAIN ] Update Progress: 1936/2371 symbols completed. SLVM took 1.1s. Estimated remaining: 2m 23s. Rate: 182.0 symbols/min [2025-09-29T02:07:59.822169] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2024-12. [2025-09-29T02:07:59.982435] [INFO ] [MAIN ] SMA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:00.003576] [DEBUG] [LOCAL ] SM: Loaded 53080 existing records from primary storage. [2025-09-29T02:08:00.024380] [DEBUG] [LOCAL ] SMA: No existing data file found in primary storage. [2025-09-29T02:08:00.024744] [INFO ] [MAIN ] SM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:00.025206] [INFO ] [MAIN ] Update Progress: 1937/2371 symbols completed. SM took 1.3s. Estimated remaining: 2m 23s. Rate: 182.0 symbols/min [2025-09-29T02:08:00.025767] [WARN ] [MAIN ] SMA: No existing data found, performing full refresh instead. [2025-09-29T02:08:00.121903] [INFO ] [MAIN ] SMA: Wiping existing primary data before full refresh. [2025-09-29T02:08:00.159728] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-09-29T02:08:00.190969] [INFO ] [MAIN ] SMBK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:00.196435] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-09-29T02:08:00.209247] [INFO ] [MAIN ] SMA: Starting full primary refresh. [2025-09-29T02:08:00.209509] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-09-29T02:08:00.288354] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-01. [2025-09-29T02:08:00.439793] [INFO ] [MAIN ] SMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:00.440267] [DEBUG] [LOCAL ] SMBK: Loaded 8332 existing records from primary storage. [2025-09-29T02:08:00.468052] [INFO ] [MAIN ] SMBK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:00.497764] [INFO ] [MAIN ] Update Progress: 1938/2371 symbols completed. SMBK took 0.7s. Estimated remaining: 2m 23s. Rate: 182.0 symbols/min [2025-09-29T02:08:00.670907] [DEBUG] [LOCAL ] SMC: Loaded 11630 existing records from primary storage. [2025-09-29T02:08:00.664612] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-29T02:08:00.694184] [INFO ] [MAIN ] SMC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:00.727350] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-02. [2025-09-29T02:08:00.732801] [INFO ] [MAIN ] Update Progress: 1939/2371 symbols completed. SMC took 0.7s. Estimated remaining: 2m 22s. Rate: 182.0 symbols/min [2025-09-29T02:08:01.019939] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-09-29T02:08:01.050151] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-03. [2025-09-29T02:08:01.091001] [INFO ] [MAIN ] SMFG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:01.078507] [INFO ] [REMOTE ] SMA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:08:01.106781] [INFO ] [REMOTE ] SMA: Fetching primary data for 2024-12. [2025-09-29T02:08:01.189425] [INFO ] [MAIN ] SMG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:01.234713] [DEBUG] [LOCAL ] SMFG: Loaded 48771 existing records from primary storage. [2025-09-29T02:08:01.249956] [INFO ] [MAIN ] SMFG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:01.250097] [INFO ] [MAIN ] Update Progress: 1940/2371 symbols completed. SMFG took 0.7s. Estimated remaining: 2m 22s. Rate: 181.9 symbols/min [2025-09-29T02:08:01.286809] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:08:01.316313] [WARN ] [REMOTE ] SMA: No data returned for month 2024-12 [2025-09-29T02:08:01.341323] [FATAL] [REMOTE ] SMA: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:08:01.358661] [FATAL] [MAIN ] SMA: Failed to fetch primary data. [2025-09-29T02:08:01.383004] [WARN ] [MAIN ] SMA: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:08:01.389297] [DEBUG] [LOCAL ] SMG: Loaded 44546 existing records from primary storage. [2025-09-29T02:08:01.387467] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-09-29T02:08:01.403776] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-29T02:08:01.427462] [INFO ] [MAIN ] SMG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:01.429288] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-04. [2025-09-29T02:08:01.421871] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-09-29T02:08:01.434745] [INFO ] [MAIN ] Update Progress: 1941/2371 symbols completed. SMG took 0.6s. Estimated remaining: 2m 22s. Rate: 182.0 symbols/min [2025-09-29T02:08:01.463895] [INFO ] [LOCAL ] SMA: Starting deletion of derivative data. [2025-09-29T02:08:01.580428] [DEBUG] [LOCAL ] SMA: No derivative data file found to delete. [2025-09-29T02:08:01.519054] [INFO ] [MAIN ] SMHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:01.597831] [INFO ] [MAIN ] Update Progress: 1942/2371 symbols completed. SMA took 2.1s. Estimated remaining: 2m 21s. Rate: 182.0 symbols/min [2025-09-29T02:08:01.826248] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-29T02:08:01.821540] [INFO ] [MAIN ] SMP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:01.826043] [DEBUG] [LOCAL ] SMHI: Loaded 13885 existing records from primary storage. [2025-09-29T02:08:01.843304] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-05. [2025-09-29T02:08:01.873243] [INFO ] [MAIN ] SMHI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:01.913971] [INFO ] [MAIN ] Update Progress: 1943/2371 symbols completed. SMHI took 0.7s. Estimated remaining: 2m 21s. Rate: 182.0 symbols/min [2025-09-29T02:08:01.952816] [INFO ] [MAIN ] SMR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:02.080915] [DEBUG] [LOCAL ] SMP: Loaded 19999 existing records from primary storage. [2025-09-29T02:08:02.086621] [INFO ] [MAIN ] SMP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:02.092280] [INFO ] [MAIN ] Update Progress: 1944/2371 symbols completed. SMP took 0.6s. Estimated remaining: 2m 21s. Rate: 182.1 symbols/min [2025-09-29T02:08:02.151255] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-29T02:08:02.177227] [INFO ] [MAIN ] SMRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:02.179180] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-06. [2025-09-29T02:08:02.405432] [DEBUG] [LOCAL ] SMR: Loaded 54577 existing records from primary storage. [2025-09-29T02:08:02.449575] [INFO ] [MAIN ] SMWB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:02.450032] [INFO ] [MAIN ] SMR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:02.450161] [INFO ] [MAIN ] Update Progress: 1945/2371 symbols completed. SMR took 0.8s. Estimated remaining: 2m 20s. Rate: 182.1 symbols/min [2025-09-29T02:08:02.495738] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-29T02:08:02.503245] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-07. [2025-09-29T02:08:02.593576] [DEBUG] [LOCAL ] SMRT: Loaded 44707 existing records from primary storage. [2025-09-29T02:08:02.609116] [INFO ] [MAIN ] SMRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:02.614938] [INFO ] [MAIN ] Update Progress: 1946/2371 symbols completed. SMRT took 0.7s. Estimated remaining: 2m 20s. Rate: 182.1 symbols/min [2025-09-29T02:08:02.705036] [DEBUG] [LOCAL ] SMWB: Loaded 33137 existing records from primary storage. [2025-09-29T02:08:02.719606] [INFO ] [MAIN ] SMWB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:02.771253] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-09-29T02:08:02.792011] [INFO ] [MAIN ] Update Progress: 1947/2371 symbols completed. SMWB took 0.6s. Estimated remaining: 2m 20s. Rate: 182.2 symbols/min [2025-09-29T02:08:02.776141] [INFO ] [MAIN ] SN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:02.793726] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-08. [2025-09-29T02:08:03.006119] [INFO ] [MAIN ] SNA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:03.126278] [INFO ] [MAIN ] SNAP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:03.128505] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-29T02:08:03.129764] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-09. [2025-09-29T02:08:03.172286] [DEBUG] [LOCAL ] SNA: Loaded 26608 existing records from primary storage. [2025-09-29T02:08:03.173875] [DEBUG] [LOCAL ] SN: Loaded 50487 existing records from primary storage. [2025-09-29T02:08:03.174413] [INFO ] [MAIN ] SNA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:03.174883] [INFO ] [MAIN ] Update Progress: 1948/2371 symbols completed. SNA took 0.6s. Estimated remaining: 2m 19s. Rate: 182.1 symbols/min [2025-09-29T02:08:03.175051] [INFO ] [MAIN ] SN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:03.180906] [INFO ] [MAIN ] Update Progress: 1949/2371 symbols completed. SN took 0.7s. Estimated remaining: 2m 19s. Rate: 182.2 symbols/min [2025-09-29T02:08:03.429138] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-09-29T02:08:03.480676] [INFO ] [REMOTE ] SLNZ: Full fetch complete (1060 records). [2025-09-29T02:08:03.514186] [DEBUG] [LOCAL ] SNAP: Loaded 54576 existing records from primary storage. [2025-09-29T02:08:03.549136] [DEBUG] [VALIDATOR ] SLNZ: Validating primary data. [2025-09-29T02:08:03.592504] [INFO ] [MAIN ] SNDR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:03.632891] [INFO ] [MAIN ] SNDA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:03.639041] [INFO ] [MAIN ] SNAP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:03.667237] [INFO ] [MAIN ] Update Progress: 1950/2371 symbols completed. SNAP took 0.9s. Estimated remaining: 2m 19s. Rate: 182.2 symbols/min [2025-09-29T02:08:03.827066] [DEBUG] [LOCAL ] SNDA: Loaded 4732 existing records from primary storage. [2025-09-29T02:08:03.833160] [INFO ] [MAIN ] SNDA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:03.885994] [INFO ] [MAIN ] Update Progress: 1951/2371 symbols completed. SNDA took 0.7s. Estimated remaining: 2m 18s. Rate: 182.2 symbols/min [2025-09-29T02:08:03.998447] [WARN ] [VALIDATOR ] SLNZ: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-29T02:08:04.039408] [FATAL] [MAIN ] SLNZ: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:08:04.080580] [DEBUG] [LOCAL ] SNDR: Loaded 41368 existing records from primary storage. [2025-09-29T02:08:04.123894] [WARN ] [MAIN ] SLNZ: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:08:04.141201] [INFO ] [MAIN ] SNDR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:04.168022] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-09-29T02:08:04.195453] [INFO ] [MAIN ] Update Progress: 1952/2371 symbols completed. SNDR took 1.0s. Estimated remaining: 2m 18s. Rate: 182.2 symbols/min [2025-09-29T02:08:04.200266] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-09-29T02:08:04.200189] [INFO ] [MAIN ] SNN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:04.206060] [INFO ] [LOCAL ] SLNZ: Starting deletion of derivative data. [2025-09-29T02:08:04.212765] [DEBUG] [LOCAL ] SLNZ: No derivative data file found to delete. [2025-09-29T02:08:04.218277] [INFO ] [MAIN ] Update Progress: 1953/2371 symbols completed. SLNZ took 5.9s. Estimated remaining: 2m 18s. Rate: 182.3 symbols/min [2025-09-29T02:08:04.378503] [INFO ] [MAIN ] SNOW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:04.699482] [INFO ] [MAIN ] SNV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:04.756193] [DEBUG] [LOCAL ] SNN: Loaded 45037 existing records from primary storage. [2025-09-29T02:08:04.802620] [INFO ] [MAIN ] SNX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:04.803157] [INFO ] [MAIN ] SNN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:04.804128] [INFO ] [MAIN ] Update Progress: 1954/2371 symbols completed. SNN took 1.1s. Estimated remaining: 2m 17s. Rate: 182.2 symbols/min [2025-09-29T02:08:04.937320] [DEBUG] [LOCAL ] SNOW: Loaded 54371 existing records from primary storage. [2025-09-29T02:08:04.951702] [INFO ] [MAIN ] SNOW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:04.967876] [INFO ] [MAIN ] Update Progress: 1955/2371 symbols completed. SNOW took 1.1s. Estimated remaining: 2m 17s. Rate: 182.3 symbols/min [2025-09-29T02:08:05.067947] [INFO ] [MAIN ] SO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:05.182294] [DEBUG] [LOCAL ] SNX: Loaded 40540 existing records from primary storage. [2025-09-29T02:08:05.207734] [INFO ] [MAIN ] SNX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:05.219798] [INFO ] [MAIN ] Update Progress: 1956/2371 symbols completed. SNX took 0.9s. Estimated remaining: 2m 17s. Rate: 182.3 symbols/min [2025-09-29T02:08:05.214168] [DEBUG] [LOCAL ] SNV: Loaded 49633 existing records from primary storage. [2025-09-29T02:08:05.318702] [INFO ] [MAIN ] SOBO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:05.303567] [INFO ] [MAIN ] SNV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:05.334704] [INFO ] [MAIN ] Update Progress: 1957/2371 symbols completed. SNV took 1.1s. Estimated remaining: 2m 16s. Rate: 182.4 symbols/min [2025-09-29T02:08:05.501552] [INFO ] [MAIN ] SOC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:05.522286] [DEBUG] [LOCAL ] SO: Loaded 54383 existing records from primary storage. [2025-09-29T02:08:05.523170] [INFO ] [MAIN ] SO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:05.523312] [INFO ] [MAIN ] Update Progress: 1958/2371 symbols completed. SO took 0.7s. Estimated remaining: 2m 16s. Rate: 182.4 symbols/min [2025-09-29T02:08:05.552730] [DEBUG] [LOCAL ] SOBO: Loaded 40211 existing records from primary storage. [2025-09-29T02:08:05.553193] [INFO ] [MAIN ] SOBO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:05.553909] [INFO ] [MAIN ] Update Progress: 1959/2371 symbols completed. SOBO took 0.5s. Estimated remaining: 2m 15s. Rate: 182.5 symbols/min [2025-09-29T02:08:05.596519] [DEBUG] [LOCAL ] SOC: Loaded 51041 existing records from primary storage. [2025-09-29T02:08:05.597011] [INFO ] [MAIN ] SOC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:05.597118] [INFO ] [MAIN ] Update Progress: 1960/2371 symbols completed. SOC took 0.4s. Estimated remaining: 2m 15s. Rate: 182.6 symbols/min [2025-09-29T02:08:06.244137] [INFO ] [MAIN ] SOJD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:06.324837] [INFO ] [MAIN ] SOJC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:06.387887] [INFO ] [MAIN ] SOJF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:06.395567] [INFO ] [MAIN ] SOJE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:06.395968] [DEBUG] [LOCAL ] SOJF: No existing data file found in primary storage. [2025-09-29T02:08:06.396321] [WARN ] [MAIN ] SOJF: No existing data found, performing full refresh instead. [2025-09-29T02:08:06.396448] [INFO ] [MAIN ] SOJF: Wiping existing primary data before full refresh. [2025-09-29T02:08:06.396521] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-09-29T02:08:06.396694] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-09-29T02:08:06.396858] [INFO ] [MAIN ] SOJF: Starting full primary refresh. [2025-09-29T02:08:06.423835] [DEBUG] [LOCAL ] SOJC: Loaded 5120 existing records from primary storage. [2025-09-29T02:08:06.449772] [INFO ] [MAIN ] SOJC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:06.494423] [INFO ] [MAIN ] Update Progress: 1961/2371 symbols completed. SOJC took 0.9s. Estimated remaining: 2m 15s. Rate: 182.4 symbols/min [2025-09-29T02:08:06.506083] [DEBUG] [LOCAL ] SOJD: Loaded 13180 existing records from primary storage. [2025-09-29T02:08:06.534060] [DEBUG] [LOCAL ] SOJE: Loaded 9408 existing records from primary storage. [2025-09-29T02:08:06.552125] [INFO ] [MAIN ] SOJE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:06.546676] [INFO ] [MAIN ] SOJD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:06.578295] [INFO ] [MAIN ] Update Progress: 1962/2371 symbols completed. SOJD took 1.0s. Estimated remaining: 2m 14s. Rate: 182.5 symbols/min [2025-09-29T02:08:06.615750] [INFO ] [MAIN ] Update Progress: 1963/2371 symbols completed. SOJE took 1.0s. Estimated remaining: 2m 14s. Rate: 182.6 symbols/min [2025-09-29T02:08:07.200340] [INFO ] [MAIN ] SOL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:07.261779] [INFO ] [MAIN ] SOLV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:07.407893] [INFO ] [REMOTE ] SOJF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:08:07.414226] [DEBUG] [LOCAL ] SOL: Loaded 13694 existing records from primary storage. [2025-09-29T02:08:07.439811] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2024-12. [2025-09-29T02:08:07.439176] [INFO ] [MAIN ] SON: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:07.441417] [INFO ] [MAIN ] SOL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:07.441513] [INFO ] [MAIN ] Update Progress: 1964/2371 symbols completed. SOL took 0.9s. Estimated remaining: 2m 14s. Rate: 182.4 symbols/min [2025-09-29T02:08:07.621591] [DEBUG] [LOCAL ] SOLV: Loaded 44791 existing records from primary storage. [2025-09-29T02:08:07.627700] [DEBUG] [REMOTE ] SOJF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:08:07.633761] [INFO ] [MAIN ] SOLV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:07.657105] [WARN ] [REMOTE ] SOJF: No data returned for month 2024-12 [2025-09-29T02:08:07.673027] [INFO ] [MAIN ] Update Progress: 1965/2371 symbols completed. SOLV took 1.1s. Estimated remaining: 2m 14s. Rate: 182.5 symbols/min [2025-09-29T02:08:07.673145] [FATAL] [REMOTE ] SOJF: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:08:07.676429] [FATAL] [MAIN ] SOJF: Failed to fetch primary data. [2025-09-29T02:08:07.676722] [WARN ] [MAIN ] SOJF: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:08:07.680456] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-09-29T02:08:07.715894] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-09-29T02:08:07.706379] [INFO ] [MAIN ] SONY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:07.768422] [INFO ] [LOCAL ] SOJF: Starting deletion of derivative data. [2025-09-29T02:08:07.770194] [DEBUG] [LOCAL ] SON: Loaded 43596 existing records from primary storage. [2025-09-29T02:08:07.816734] [DEBUG] [LOCAL ] SOJF: No derivative data file found to delete. [2025-09-29T02:08:07.811309] [INFO ] [MAIN ] SON: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:07.838844] [INFO ] [MAIN ] Update Progress: 1966/2371 symbols completed. SOJF took 2.2s. Estimated remaining: 2m 13s. Rate: 182.5 symbols/min [2025-09-29T02:08:07.916084] [INFO ] [MAIN ] Update Progress: 1967/2371 symbols completed. SON took 1.2s. Estimated remaining: 2m 13s. Rate: 182.6 symbols/min [2025-09-29T02:08:07.931233] [INFO ] [MAIN ] SOR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:08.122485] [DEBUG] [LOCAL ] SOR: Loaded 2947 existing records from primary storage. [2025-09-29T02:08:08.189902] [INFO ] [MAIN ] SOR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:08.232912] [INFO ] [MAIN ] Update Progress: 1968/2371 symbols completed. SOR took 0.5s. Estimated remaining: 2m 12s. Rate: 182.6 symbols/min [2025-09-29T02:08:08.366894] [DEBUG] [LOCAL ] SONY: Loaded 54136 existing records from primary storage. [2025-09-29T02:08:08.377829] [INFO ] [MAIN ] SOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:08.421615] [INFO ] [MAIN ] SPB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:08.438701] [INFO ] [MAIN ] SONY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:08.463441] [INFO ] [MAIN ] Update Progress: 1969/2371 symbols completed. SONY took 1.0s. Estimated remaining: 2m 12s. Rate: 182.6 symbols/min [2025-09-29T02:08:08.550749] [DEBUG] [LOCAL ] SOS: Loaded 8266 existing records from primary storage. [2025-09-29T02:08:08.619265] [INFO ] [MAIN ] SOS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:08.668796] [INFO ] [MAIN ] Update Progress: 1970/2371 symbols completed. SOS took 0.8s. Estimated remaining: 2m 12s. Rate: 182.6 symbols/min [2025-09-29T02:08:08.784894] [INFO ] [MAIN ] SPCE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:08.940602] [DEBUG] [LOCAL ] SPB: Loaded 34677 existing records from primary storage. [2025-09-29T02:08:08.923285] [INFO ] [MAIN ] SPE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:08.948244] [INFO ] [MAIN ] SPB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:08.953048] [INFO ] [MAIN ] Update Progress: 1971/2371 symbols completed. SPB took 1.0s. Estimated remaining: 2m 11s. Rate: 182.6 symbols/min [2025-09-29T02:08:09.125580] [DEBUG] [LOCAL ] SPE: Loaded 6441 existing records from primary storage. [2025-09-29T02:08:09.132837] [INFO ] [MAIN ] SPG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:09.148987] [INFO ] [MAIN ] SPE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:09.165380] [INFO ] [MAIN ] Update Progress: 1972/2371 symbols completed. SPE took 0.7s. Estimated remaining: 2m 11s. Rate: 182.7 symbols/min [2025-09-29T02:08:09.324994] [INFO ] [MAIN ] SPGI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:09.361610] [DEBUG] [LOCAL ] SPCE: Loaded 50615 existing records from primary storage. [2025-09-29T02:08:09.389500] [INFO ] [MAIN ] SPCE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:09.405978] [INFO ] [MAIN ] Update Progress: 1973/2371 symbols completed. SPCE took 1.1s. Estimated remaining: 2m 11s. Rate: 182.7 symbols/min [2025-09-29T02:08:09.619954] [INFO ] [MAIN ] SPH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:09.738943] [INFO ] [MAIN ] SPHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:09.757952] [DEBUG] [LOCAL ] SPGI: Loaded 46562 existing records from primary storage. [2025-09-29T02:08:09.760661] [DEBUG] [LOCAL ] SPG: Loaded 51134 existing records from primary storage. [2025-09-29T02:08:09.761936] [INFO ] [MAIN ] SPG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:09.761523] [INFO ] [MAIN ] SPGI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:09.762304] [INFO ] [MAIN ] Update Progress: 1974/2371 symbols completed. SPG took 1.1s. Estimated remaining: 2m 10s. Rate: 182.7 symbols/min [2025-09-29T02:08:09.762744] [INFO ] [MAIN ] Update Progress: 1975/2371 symbols completed. SPGI took 0.8s. Estimated remaining: 2m 10s. Rate: 182.8 symbols/min [2025-09-29T02:08:09.830910] [DEBUG] [LOCAL ] SPH: Loaded 18213 existing records from primary storage. [2025-09-29T02:08:09.888571] [INFO ] [MAIN ] SPH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:09.959298] [INFO ] [MAIN ] Update Progress: 1976/2371 symbols completed. SPH took 0.8s. Estimated remaining: 2m 10s. Rate: 182.8 symbols/min [2025-09-29T02:08:10.193199] [INFO ] [MAIN ] SPIR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:10.308466] [INFO ] [MAIN ] SPMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:10.339541] [DEBUG] [LOCAL ] SPHR: Loaded 40745 existing records from primary storage. [2025-09-29T02:08:10.369824] [INFO ] [MAIN ] SPHR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:10.376180] [INFO ] [MAIN ] Update Progress: 1977/2371 symbols completed. SPHR took 1.0s. Estimated remaining: 2m 9s. Rate: 182.8 symbols/min [2025-09-29T02:08:10.482098] [DEBUG] [LOCAL ] SPMC: Loaded 5613 existing records from primary storage. [2025-09-29T02:08:10.508239] [INFO ] [MAIN ] SPME: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:10.514799] [DEBUG] [LOCAL ] SPME: No existing data file found in primary storage. [2025-09-29T02:08:10.504367] [INFO ] [MAIN ] SPMC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:10.540717] [WARN ] [MAIN ] SPME: No existing data found, performing full refresh instead. [2025-09-29T02:08:10.546246] [INFO ] [MAIN ] SPME: Wiping existing primary data before full refresh. [2025-09-29T02:08:10.551554] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-09-29T02:08:10.546051] [INFO ] [MAIN ] Update Progress: 1978/2371 symbols completed. SPMC took 0.7s. Estimated remaining: 2m 9s. Rate: 182.8 symbols/min [2025-09-29T02:08:10.564039] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-09-29T02:08:10.599407] [INFO ] [MAIN ] SPME: Starting full primary refresh. [2025-09-29T02:08:10.666872] [DEBUG] [LOCAL ] SPIR: Loaded 37871 existing records from primary storage. [2025-09-29T02:08:10.815308] [INFO ] [MAIN ] SPIR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:10.905494] [INFO ] [MAIN ] SPNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:10.902885] [INFO ] [MAIN ] Update Progress: 1979/2371 symbols completed. SPIR took 1.1s. Estimated remaining: 2m 9s. Rate: 182.8 symbols/min [2025-09-29T02:08:11.294269] [INFO ] [MAIN ] SPOT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:11.502798] [DEBUG] [LOCAL ] SPNT: Loaded 35342 existing records from primary storage. [2025-09-29T02:08:11.495827] [INFO ] [MAIN ] SPR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:11.538516] [INFO ] [REMOTE ] SPME: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:08:11.523001] [INFO ] [MAIN ] SPNT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:11.539733] [INFO ] [REMOTE ] SPME: Fetching primary data for 2024-12. [2025-09-29T02:08:11.539429] [INFO ] [MAIN ] Update Progress: 1980/2371 symbols completed. SPNT took 1.2s. Estimated remaining: 2m 8s. Rate: 182.8 symbols/min [2025-09-29T02:08:11.681506] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:08:11.713566] [DEBUG] [LOCAL ] SPOT: Loaded 51481 existing records from primary storage. [2025-09-29T02:08:11.735306] [INFO ] [MAIN ] SPOT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:11.734907] [WARN ] [REMOTE ] SPME: No data returned for month 2024-12 [2025-09-29T02:08:11.770452] [FATAL] [REMOTE ] SPME: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:08:11.771405] [FATAL] [MAIN ] SPME: Failed to fetch primary data. [2025-09-29T02:08:11.769998] [INFO ] [MAIN ] Update Progress: 1981/2371 symbols completed. SPOT took 1.2s. Estimated remaining: 2m 8s. Rate: 182.8 symbols/min [2025-09-29T02:08:11.782585] [WARN ] [MAIN ] SPME: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:08:11.785535] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-09-29T02:08:11.823292] [INFO ] [MAIN ] SPRU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:11.828850] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-09-29T02:08:11.851544] [DEBUG] [LOCAL ] SPR: Loaded 41867 existing records from primary storage. [2025-09-29T02:08:11.867506] [INFO ] [LOCAL ] SPME: Starting deletion of derivative data. [2025-09-29T02:08:11.877335] [INFO ] [MAIN ] SPR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:11.902677] [INFO ] [MAIN ] Update Progress: 1982/2371 symbols completed. SPR took 1.0s. Estimated remaining: 2m 8s. Rate: 182.8 symbols/min [2025-09-29T02:08:11.884424] [DEBUG] [LOCAL ] SPME: No derivative data file found to delete. [2025-09-29T02:08:11.924471] [INFO ] [MAIN ] Update Progress: 1983/2371 symbols completed. SPME took 1.8s. Estimated remaining: 2m 7s. Rate: 182.9 symbols/min [2025-09-29T02:08:11.968520] [DEBUG] [LOCAL ] SPRU: Loaded 8714 existing records from primary storage. [2025-09-29T02:08:12.071944] [INFO ] [MAIN ] SPRU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:12.133323] [INFO ] [MAIN ] Update Progress: 1984/2371 symbols completed. SPRU took 0.6s. Estimated remaining: 2m 7s. Rate: 183.0 symbols/min [2025-09-29T02:08:12.204486] [INFO ] [MAIN ] SPXC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:12.508805] [INFO ] [MAIN ] SQM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:12.546888] [INFO ] [MAIN ] SPXX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:12.614331] [INFO ] [MAIN ] SQNS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:12.629669] [DEBUG] [LOCAL ] SPXC: Loaded 23666 existing records from primary storage. [2025-09-29T02:08:12.633168] [INFO ] [MAIN ] SPXC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:12.633699] [INFO ] [MAIN ] Update Progress: 1985/2371 symbols completed. SPXC took 0.8s. Estimated remaining: 2m 7s. Rate: 182.9 symbols/min [2025-09-29T02:08:12.703699] [DEBUG] [LOCAL ] SPXX: Loaded 9166 existing records from primary storage. [2025-09-29T02:08:12.753133] [INFO ] [MAIN ] SPXX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:12.772788] [INFO ] [MAIN ] Update Progress: 1986/2371 symbols completed. SPXX took 0.9s. Estimated remaining: 2m 6s. Rate: 183.0 symbols/min [2025-09-29T02:08:12.778829] [DEBUG] [LOCAL ] SQNS: Loaded 26307 existing records from primary storage. [2025-09-29T02:08:12.825959] [INFO ] [MAIN ] SQNS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:12.856677] [INFO ] [MAIN ] Update Progress: 1987/2371 symbols completed. SQNS took 0.7s. Estimated remaining: 2m 6s. Rate: 183.0 symbols/min [2025-09-29T02:08:12.910233] [DEBUG] [LOCAL ] SQM: Loaded 49278 existing records from primary storage. [2025-09-29T02:08:12.996468] [INFO ] [MAIN ] SQM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:13.037127] [INFO ] [MAIN ] SR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:13.051226] [INFO ] [MAIN ] Update Progress: 1988/2371 symbols completed. SQM took 1.1s. Estimated remaining: 2m 6s. Rate: 183.1 symbols/min [2025-09-29T02:08:13.405480] [INFO ] [MAIN ] SRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:13.476280] [INFO ] [MAIN ] SREA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:13.590621] [INFO ] [MAIN ] SRFM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:13.593350] [DEBUG] [LOCAL ] SR: Loaded 33411 existing records from primary storage. [2025-09-29T02:08:13.595068] [INFO ] [MAIN ] SR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:13.595271] [INFO ] [MAIN ] Update Progress: 1989/2371 symbols completed. SR took 1.0s. Estimated remaining: 2m 5s. Rate: 183.0 symbols/min [2025-09-29T02:08:13.670432] [DEBUG] [LOCAL ] SREA: Loaded 10561 existing records from primary storage. [2025-09-29T02:08:13.671059] [INFO ] [MAIN ] SREA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:13.708518] [INFO ] [MAIN ] Update Progress: 1990/2371 symbols completed. SREA took 0.8s. Estimated remaining: 2m 5s. Rate: 183.1 symbols/min [2025-09-29T02:08:14.006357] [DEBUG] [LOCAL ] SRFM: Loaded 36431 existing records from primary storage. [2025-09-29T02:08:14.060847] [DEBUG] [LOCAL ] SRE: Loaded 54202 existing records from primary storage. [2025-09-29T02:08:14.097212] [INFO ] [MAIN ] SRFM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:14.145194] [INFO ] [MAIN ] Update Progress: 1991/2371 symbols completed. SRFM took 1.0s. Estimated remaining: 2m 5s. Rate: 183.0 symbols/min [2025-09-29T02:08:14.145458] [INFO ] [MAIN ] SRE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:14.208880] [INFO ] [MAIN ] SRG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:14.220484] [INFO ] [MAIN ] Update Progress: 1992/2371 symbols completed. SRE took 1.4s. Estimated remaining: 2m 4s. Rate: 183.1 symbols/min [2025-09-29T02:08:14.445414] [INFO ] [MAIN ] SRI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:14.600455] [DEBUG] [LOCAL ] SRG: Loaded 15859 existing records from primary storage. [2025-09-29T02:08:14.647795] [INFO ] [MAIN ] SRG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:14.756781] [INFO ] [MAIN ] SRV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:14.755536] [INFO ] [MAIN ] Update Progress: 1993/2371 symbols completed. SRG took 1.2s. Estimated remaining: 2m 4s. Rate: 183.0 symbols/min [2025-09-29T02:08:14.760779] [INFO ] [MAIN ] SRL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:14.783361] [DEBUG] [LOCAL ] SRL: No existing data file found in primary storage. [2025-09-29T02:08:14.857153] [WARN ] [MAIN ] SRL: No existing data found, performing full refresh instead. [2025-09-29T02:08:14.884209] [DEBUG] [LOCAL ] SRI: Loaded 27810 existing records from primary storage. [2025-09-29T02:08:14.888289] [INFO ] [MAIN ] SRL: Wiping existing primary data before full refresh. [2025-09-29T02:08:14.888941] [INFO ] [MAIN ] SRI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:14.889109] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-09-29T02:08:14.901604] [INFO ] [MAIN ] Update Progress: 1994/2371 symbols completed. SRI took 1.2s. Estimated remaining: 2m 4s. Rate: 183.1 symbols/min [2025-09-29T02:08:14.912234] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-09-29T02:08:14.933471] [INFO ] [MAIN ] SRL: Starting full primary refresh. [2025-09-29T02:08:15.011240] [DEBUG] [LOCAL ] SRV: Loaded 7631 existing records from primary storage. [2025-09-29T02:08:15.065999] [INFO ] [MAIN ] SSB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:15.132869] [INFO ] [MAIN ] SRV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:15.153690] [INFO ] [MAIN ] Update Progress: 1995/2371 symbols completed. SRV took 0.9s. Estimated remaining: 2m 3s. Rate: 183.1 symbols/min [2025-09-29T02:08:15.364135] [INFO ] [MAIN ] SSD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:15.626257] [INFO ] [MAIN ] SSL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:15.745038] [DEBUG] [LOCAL ] SSD: Loaded 22631 existing records from primary storage. [2025-09-29T02:08:15.784531] [INFO ] [MAIN ] SSD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:15.794397] [INFO ] [MAIN ] Update Progress: 1996/2371 symbols completed. SSD took 0.9s. Estimated remaining: 2m 3s. Rate: 183.0 symbols/min [2025-09-29T02:08:15.773405] [DEBUG] [LOCAL ] SSB: Loaded 43377 existing records from primary storage. [2025-09-29T02:08:15.832550] [INFO ] [REMOTE ] SRL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:08:15.821844] [INFO ] [MAIN ] SSB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:15.843840] [INFO ] [REMOTE ] SRL: Fetching primary data for 2024-12. [2025-09-29T02:08:15.843990] [INFO ] [MAIN ] Update Progress: 1997/2371 symbols completed. SSB took 1.1s. Estimated remaining: 2m 3s. Rate: 183.1 symbols/min [2025-09-29T02:08:16.024786] [INFO ] [MAIN ] SST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:16.039904] [DEBUG] [LOCAL ] SSL: Loaded 41830 existing records from primary storage. [2025-09-29T02:08:16.040346] [INFO ] [MAIN ] SSL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:16.040458] [INFO ] [MAIN ] Update Progress: 1998/2371 symbols completed. SSL took 0.9s. Estimated remaining: 2m 2s. Rate: 183.1 symbols/min [2025-09-29T02:08:16.053696] [DEBUG] [LOCAL ] SST: Loaded 12166 existing records from primary storage. [2025-09-29T02:08:16.054037] [INFO ] [MAIN ] SST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:16.054159] [INFO ] [MAIN ] Update Progress: 1999/2371 symbols completed. SST took 0.2s. Estimated remaining: 2m 2s. Rate: 183.2 symbols/min [2025-09-29T02:08:16.224311] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-09-29T02:08:16.225874] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-01. [2025-09-29T02:08:16.500494] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-09-29T02:08:16.501844] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-02. [2025-09-29T02:08:16.699198] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-02 (0.20 seconds). [2025-09-29T02:08:16.700297] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-03. [2025-09-29T02:08:16.900582] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-03 (0.20 seconds). [2025-09-29T02:08:16.901788] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-04. [2025-09-29T02:08:17.099172] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-04 (0.20 seconds). [2025-09-29T02:08:17.100468] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-05. [2025-09-29T02:08:17.222733] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-05 (0.12 seconds). [2025-09-29T02:08:17.223875] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-06. [2025-09-29T02:08:17.600844] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-29T02:08:17.602167] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-07. [2025-09-29T02:08:17.803846] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-07 (0.20 seconds). [2025-09-29T02:08:17.804992] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-08. [2025-09-29T02:08:18.004411] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-08 (0.20 seconds). [2025-09-29T02:08:18.005530] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-09. [2025-09-29T02:08:18.199479] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-09 (0.19 seconds). [2025-09-29T02:08:18.200385] [INFO ] [REMOTE ] SRL: Full fetch complete (1966 records). [2025-09-29T02:08:18.200482] [DEBUG] [VALIDATOR ] SRL: Validating primary data. [2025-09-29T02:08:18.404076] [WARN ] [VALIDATOR ] SRL: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-29T02:08:18.404314] [FATAL] [MAIN ] SRL: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:08:18.404391] [WARN ] [MAIN ] SRL: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:08:18.404468] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-09-29T02:08:18.404566] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-09-29T02:08:18.404672] [INFO ] [LOCAL ] SRL: Starting deletion of derivative data. [2025-09-29T02:08:18.404781] [DEBUG] [LOCAL ] SRL: No derivative data file found to delete. [2025-09-29T02:08:18.404878] [INFO ] [MAIN ] Update Progress: 2000/2371 symbols completed. SRL took 4.2s. Estimated remaining: 2m 2s. Rate: 182.7 symbols/min [2025-09-29T02:08:19.128402] [INFO ] [MAIN ] STAG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:19.155256] [INFO ] [MAIN ] ST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:19.241710] [INFO ] [MAIN ] SSTK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:19.235920] [INFO ] [MAIN ] STC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:19.272565] [DEBUG] [LOCAL ] STC: Loaded 17878 existing records from primary storage. [2025-09-29T02:08:19.287923] [INFO ] [MAIN ] STC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:19.288108] [INFO ] [MAIN ] Update Progress: 2001/2371 symbols completed. STC took 0.9s. Estimated remaining: 2m 2s. Rate: 182.5 symbols/min [2025-09-29T02:08:19.345117] [DEBUG] [LOCAL ] SSTK: Loaded 26762 existing records from primary storage. [2025-09-29T02:08:19.372878] [INFO ] [MAIN ] SSTK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:19.407086] [INFO ] [MAIN ] Update Progress: 2002/2371 symbols completed. SSTK took 1.0s. Estimated remaining: 2m 1s. Rate: 182.6 symbols/min [2025-09-29T02:08:19.503011] [DEBUG] [LOCAL ] STAG: Loaded 50799 existing records from primary storage. [2025-09-29T02:08:19.554020] [DEBUG] [LOCAL ] ST: Loaded 50505 existing records from primary storage. [2025-09-29T02:08:19.588790] [INFO ] [MAIN ] STAG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:19.630567] [INFO ] [MAIN ] Update Progress: 2003/2371 symbols completed. STAG took 1.2s. Estimated remaining: 2m 1s. Rate: 182.6 symbols/min [2025-09-29T02:08:19.675968] [INFO ] [MAIN ] STE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:19.645801] [INFO ] [MAIN ] ST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:19.714213] [INFO ] [MAIN ] Update Progress: 2004/2371 symbols completed. ST took 1.3s. Estimated remaining: 2m 1s. Rate: 182.7 symbols/min [2025-09-29T02:08:19.890695] [INFO ] [MAIN ] STEL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:20.113693] [INFO ] [MAIN ] STEM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:20.208416] [INFO ] [MAIN ] STEW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:20.210129] [DEBUG] [LOCAL ] STE: Loaded 35822 existing records from primary storage. [2025-09-29T02:08:20.211149] [INFO ] [MAIN ] STE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:20.211281] [INFO ] [MAIN ] Update Progress: 2005/2371 symbols completed. STE took 0.9s. Estimated remaining: 2m 0s. Rate: 182.6 symbols/min [2025-09-29T02:08:20.259133] [DEBUG] [LOCAL ] STEL: Loaded 23823 existing records from primary storage. [2025-09-29T02:08:20.283994] [INFO ] [MAIN ] STEL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:20.294379] [INFO ] [MAIN ] Update Progress: 2006/2371 symbols completed. STEL took 0.9s. Estimated remaining: 1m 60s. Rate: 182.7 symbols/min [2025-09-29T02:08:20.462147] [DEBUG] [LOCAL ] STEW: Loaded 16354 existing records from primary storage. [2025-09-29T02:08:20.517216] [INFO ] [MAIN ] STEW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:20.549751] [INFO ] [MAIN ] Update Progress: 2007/2371 symbols completed. STEW took 0.7s. Estimated remaining: 1m 60s. Rate: 182.7 symbols/min [2025-09-29T02:08:20.569246] [INFO ] [MAIN ] STG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:20.570802] [DEBUG] [LOCAL ] STEM: Loaded 40374 existing records from primary storage. [2025-09-29T02:08:20.593209] [DEBUG] [LOCAL ] STG: No existing data file found in primary storage. [2025-09-29T02:08:20.599279] [INFO ] [MAIN ] STEM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:20.604689] [WARN ] [MAIN ] STG: No existing data found, performing full refresh instead. [2025-09-29T02:08:20.604893] [INFO ] [MAIN ] STG: Wiping existing primary data before full refresh. [2025-09-29T02:08:20.605006] [INFO ] [MAIN ] Update Progress: 2008/2371 symbols completed. STEM took 0.9s. Estimated remaining: 1m 59s. Rate: 182.8 symbols/min [2025-09-29T02:08:20.615713] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-09-29T02:08:20.641638] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-09-29T02:08:20.703840] [INFO ] [MAIN ] STG: Starting full primary refresh. [2025-09-29T02:08:20.810838] [INFO ] [MAIN ] STK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:21.052210] [DEBUG] [LOCAL ] STK: Loaded 9550 existing records from primary storage. [2025-09-29T02:08:21.122127] [INFO ] [MAIN ] STK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:21.170918] [INFO ] [MAIN ] STLA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:21.223577] [INFO ] [MAIN ] Update Progress: 2009/2371 symbols completed. STK took 0.9s. Estimated remaining: 1m 59s. Rate: 182.7 symbols/min [2025-09-29T02:08:21.242508] [INFO ] [MAIN ] STM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:21.712589] [INFO ] [REMOTE ] STG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:08:21.752358] [INFO ] [MAIN ] STN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:21.755183] [DEBUG] [LOCAL ] STLA: Loaded 54322 existing records from primary storage. [2025-09-29T02:08:21.753174] [INFO ] [REMOTE ] STG: Fetching primary data for 2024-12. [2025-09-29T02:08:21.756695] [INFO ] [MAIN ] STLA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:21.757007] [INFO ] [MAIN ] Update Progress: 2010/2371 symbols completed. STLA took 1.2s. Estimated remaining: 1m 59s. Rate: 182.7 symbols/min [2025-09-29T02:08:21.858177] [DEBUG] [LOCAL ] STM: Loaded 54362 existing records from primary storage. [2025-09-29T02:08:21.892679] [INFO ] [MAIN ] STM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:21.913803] [INFO ] [MAIN ] Update Progress: 2011/2371 symbols completed. STM took 1.3s. Estimated remaining: 1m 58s. Rate: 182.7 symbols/min [2025-09-29T02:08:21.994942] [DEBUG] [LOCAL ] STN: Loaded 23436 existing records from primary storage. [2025-09-29T02:08:22.042408] [INFO ] [MAIN ] STN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:22.055390] [INFO ] [MAIN ] STNG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:22.067458] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2024-12 (0.31 seconds). [2025-09-29T02:08:22.067702] [INFO ] [MAIN ] Update Progress: 2012/2371 symbols completed. STN took 0.8s. Estimated remaining: 1m 58s. Rate: 182.7 symbols/min [2025-09-29T02:08:22.079329] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-01. [2025-09-29T02:08:22.329457] [INFO ] [MAIN ] STRV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:22.399530] [INFO ] [MAIN ] STT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:22.440395] [DEBUG] [LOCAL ] STRV: Loaded 11754 existing records from primary storage. [2025-09-29T02:08:22.435916] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-29T02:08:22.443110] [DEBUG] [LOCAL ] STNG: Loaded 44620 existing records from primary storage. [2025-09-29T02:08:22.443408] [INFO ] [MAIN ] STRV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:22.445729] [INFO ] [MAIN ] STNG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:22.445181] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-02. [2025-09-29T02:08:22.445964] [INFO ] [MAIN ] Update Progress: 2013/2371 symbols completed. STRV took 0.5s. Estimated remaining: 1m 58s. Rate: 182.7 symbols/min [2025-09-29T02:08:22.447528] [INFO ] [MAIN ] Update Progress: 2014/2371 symbols completed. STNG took 0.7s. Estimated remaining: 1m 57s. Rate: 182.8 symbols/min [2025-09-29T02:08:22.767168] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-29T02:08:22.847493] [INFO ] [MAIN ] STVN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:22.848557] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-03. [2025-09-29T02:08:22.868939] [INFO ] [MAIN ] STUB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:22.885427] [DEBUG] [LOCAL ] STUB: No existing data file found in primary storage. [2025-09-29T02:08:22.887397] [WARN ] [MAIN ] STUB: No existing data found, performing full refresh instead. [2025-09-29T02:08:22.887088] [DEBUG] [LOCAL ] STT: Loaded 51793 existing records from primary storage. [2025-09-29T02:08:22.887964] [INFO ] [MAIN ] STUB: Wiping existing primary data before full refresh. [2025-09-29T02:08:22.888104] [INFO ] [MAIN ] STT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:22.888342] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-09-29T02:08:22.888517] [INFO ] [MAIN ] Update Progress: 2015/2371 symbols completed. STT took 0.8s. Estimated remaining: 1m 57s. Rate: 182.8 symbols/min [2025-09-29T02:08:22.923169] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-09-29T02:08:22.966620] [INFO ] [MAIN ] STUB: Starting full primary refresh. [2025-09-29T02:08:23.192695] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-29T02:08:23.197183] [INFO ] [MAIN ] STWD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:23.226069] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-04. [2025-09-29T02:08:23.214090] [DEBUG] [LOCAL ] STVN: Loaded 26677 existing records from primary storage. [2025-09-29T02:08:23.228681] [INFO ] [MAIN ] STVN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:23.245223] [INFO ] [MAIN ] Update Progress: 2016/2371 symbols completed. STVN took 0.8s. Estimated remaining: 1m 57s. Rate: 182.8 symbols/min [2025-09-29T02:08:23.525415] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-09-29T02:08:23.583406] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-05. [2025-09-29T02:08:23.687102] [INFO ] [MAIN ] STXD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:23.781670] [INFO ] [REMOTE ] STUB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:08:23.782437] [INFO ] [REMOTE ] STUB: Fetching primary data for 2024-12. [2025-09-29T02:08:23.784766] [DEBUG] [LOCAL ] STWD: Loaded 52643 existing records from primary storage. [2025-09-29T02:08:23.786267] [INFO ] [MAIN ] STWD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:23.788361] [DEBUG] [LOCAL ] STXD: Loaded 1341 existing records from primary storage. [2025-09-29T02:08:23.788850] [INFO ] [MAIN ] STXD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:23.788993] [INFO ] [MAIN ] Update Progress: 2017/2371 symbols completed. STWD took 0.9s. Estimated remaining: 1m 56s. Rate: 182.7 symbols/min [2025-09-29T02:08:23.794518] [INFO ] [MAIN ] Update Progress: 2018/2371 symbols completed. STXD took 0.5s. Estimated remaining: 1m 56s. Rate: 182.8 symbols/min [2025-09-29T02:08:23.969973] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:08:24.004768] [WARN ] [REMOTE ] STUB: No data returned for month 2024-12 [2025-09-29T02:08:24.031594] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-29T02:08:24.052916] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-06. [2025-09-29T02:08:24.053146] [FATAL] [REMOTE ] STUB: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:08:24.053338] [FATAL] [MAIN ] STUB: Failed to fetch primary data. [2025-09-29T02:08:24.065106] [WARN ] [MAIN ] STUB: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:08:24.124782] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-09-29T02:08:24.221033] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-09-29T02:08:24.221336] [INFO ] [LOCAL ] STUB: Starting deletion of derivative data. [2025-09-29T02:08:24.220802] [INFO ] [MAIN ] STXE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:24.188121] [INFO ] [MAIN ] STXG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:24.221530] [DEBUG] [LOCAL ] STUB: No derivative data file found to delete. [2025-09-29T02:08:24.222772] [INFO ] [MAIN ] Update Progress: 2019/2371 symbols completed. STUB took 1.8s. Estimated remaining: 1m 56s. Rate: 182.8 symbols/min [2025-09-29T02:08:24.284055] [DEBUG] [LOCAL ] STXG: Loaded 2612 existing records from primary storage. [2025-09-29T02:08:24.305177] [DEBUG] [LOCAL ] STXE: Loaded 2234 existing records from primary storage. [2025-09-29T02:08:24.323735] [INFO ] [MAIN ] STXG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:24.323939] [INFO ] [MAIN ] STXE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:24.362247] [INFO ] [MAIN ] Update Progress: 2020/2371 symbols completed. STXE took 0.6s. Estimated remaining: 1m 55s. Rate: 182.8 symbols/min [2025-09-29T02:08:24.366201] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-29T02:08:24.382818] [INFO ] [MAIN ] Update Progress: 2021/2371 symbols completed. STXG took 0.6s. Estimated remaining: 1m 55s. Rate: 182.9 symbols/min [2025-09-29T02:08:24.412761] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-07. [2025-09-29T02:08:24.645447] [INFO ] [MAIN ] STXK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:24.814375] [INFO ] [MAIN ] STXM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:24.818091] [DEBUG] [LOCAL ] STXK: Loaded 1535 existing records from primary storage. [2025-09-29T02:08:24.818524] [INFO ] [MAIN ] STXK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:24.818930] [INFO ] [MAIN ] Update Progress: 2022/2371 symbols completed. STXK took 0.6s. Estimated remaining: 1m 54s. Rate: 182.9 symbols/min [2025-09-29T02:08:24.818767] [DEBUG] [LOCAL ] STXM: No existing data file found in primary storage. [2025-09-29T02:08:24.864884] [WARN ] [MAIN ] STXM: No existing data found, performing full refresh instead. [2025-09-29T02:08:24.927403] [INFO ] [MAIN ] STXM: Wiping existing primary data before full refresh. [2025-09-29T02:08:25.007478] [INFO ] [MAIN ] STXT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:25.004971] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-09-29T02:08:25.026605] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-09-29T02:08:25.033914] [INFO ] [MAIN ] STXM: Starting full primary refresh. [2025-09-29T02:08:25.145462] [DEBUG] [LOCAL ] STXT: Loaded 2592 existing records from primary storage. [2025-09-29T02:08:25.177046] [INFO ] [MAIN ] STXT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:25.226250] [INFO ] [MAIN ] Update Progress: 2023/2371 symbols completed. STXT took 0.8s. Estimated remaining: 1m 54s. Rate: 182.9 symbols/min [2025-09-29T02:08:25.234979] [INFO ] [MAIN ] STXV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:25.266235] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-29T02:08:25.347866] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-08. [2025-09-29T02:08:25.391244] [DEBUG] [LOCAL ] STXV: Loaded 1648 existing records from primary storage. [2025-09-29T02:08:25.512065] [INFO ] [MAIN ] STXV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:25.546398] [INFO ] [MAIN ] Update Progress: 2024/2371 symbols completed. STXV took 0.7s. Estimated remaining: 1m 54s. Rate: 182.9 symbols/min [2025-09-29T02:08:25.799081] [INFO ] [MAIN ] STZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:25.847699] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-29T02:08:25.909305] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-09. [2025-09-29T02:08:25.941751] [INFO ] [REMOTE ] STXM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:08:25.982171] [INFO ] [REMOTE ] STXM: Fetching primary data for 2024-12. [2025-09-29T02:08:26.011367] [INFO ] [MAIN ] SU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:26.074311] [DEBUG] [LOCAL ] STZ: Loaded 53035 existing records from primary storage. [2025-09-29T02:08:26.074774] [INFO ] [MAIN ] STZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:26.074909] [INFO ] [MAIN ] Update Progress: 2025/2371 symbols completed. STZ took 0.8s. Estimated remaining: 1m 54s. Rate: 182.8 symbols/min [2025-09-29T02:08:26.271405] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-29T02:08:26.293896] [INFO ] [MAIN ] SUI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:26.310084] [INFO ] [REMOTE ] STG: Full fetch complete (2496 records). [2025-09-29T02:08:26.312420] [DEBUG] [VALIDATOR ] STG: Validating primary data. [2025-09-29T02:08:26.328537] [DEBUG] [LOCAL ] SU: Loaded 54234 existing records from primary storage. [2025-09-29T02:08:26.334281] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-29T02:08:26.356476] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-01. [2025-09-29T02:08:26.334513] [INFO ] [MAIN ] SU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:26.356888] [INFO ] [MAIN ] Update Progress: 2026/2371 symbols completed. SU took 0.8s. Estimated remaining: 1m 53s. Rate: 182.8 symbols/min [2025-09-29T02:08:26.760505] [WARN ] [VALIDATOR ] STG: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-09-29T02:08:26.768242] [INFO ] [MAIN ] SUN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:26.782934] [FATAL] [MAIN ] STG: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:08:26.768502] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-29T02:08:26.784669] [WARN ] [MAIN ] STG: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:08:26.784796] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-09-29T02:08:26.785982] [DEBUG] [LOCAL ] SUI: Loaded 42505 existing records from primary storage. [2025-09-29T02:08:26.787730] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-02. [2025-09-29T02:08:26.788116] [INFO ] [MAIN ] SUI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:26.789315] [INFO ] [MAIN ] Update Progress: 2027/2371 symbols completed. SUI took 0.7s. Estimated remaining: 1m 53s. Rate: 182.8 symbols/min [2025-09-29T02:08:26.789403] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-09-29T02:08:26.789524] [INFO ] [LOCAL ] STG: Starting deletion of derivative data. [2025-09-29T02:08:26.806780] [DEBUG] [LOCAL ] STG: No derivative data file found to delete. [2025-09-29T02:08:26.851582] [INFO ] [MAIN ] Update Progress: 2028/2371 symbols completed. STG took 6.6s. Estimated remaining: 1m 53s. Rate: 182.9 symbols/min [2025-09-29T02:08:27.080680] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-09-29T02:08:27.151909] [DEBUG] [LOCAL ] SUN: Loaded 37928 existing records from primary storage. [2025-09-29T02:08:27.145332] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-03. [2025-09-29T02:08:27.156907] [INFO ] [MAIN ] SUPV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:27.158438] [INFO ] [MAIN ] SUN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:27.165202] [INFO ] [MAIN ] Update Progress: 2029/2371 symbols completed. SUN took 0.8s. Estimated remaining: 1m 52s. Rate: 182.9 symbols/min [2025-09-29T02:08:27.275882] [INFO ] [MAIN ] SUZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:27.422598] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-09-29T02:08:27.457636] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-04. [2025-09-29T02:08:27.480590] [INFO ] [MAIN ] SVV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:27.513447] [DEBUG] [LOCAL ] SUPV: Loaded 47961 existing records from primary storage. [2025-09-29T02:08:27.514694] [INFO ] [MAIN ] SUPV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:27.514806] [INFO ] [MAIN ] Update Progress: 2030/2371 symbols completed. SUPV took 0.7s. Estimated remaining: 1m 52s. Rate: 182.9 symbols/min [2025-09-29T02:08:27.658973] [DEBUG] [LOCAL ] SUZ: Loaded 46428 existing records from primary storage. [2025-09-29T02:08:27.665159] [INFO ] [MAIN ] SUZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:27.697200] [INFO ] [MAIN ] Update Progress: 2031/2371 symbols completed. SUZ took 0.8s. Estimated remaining: 1m 52s. Rate: 182.9 symbols/min [2025-09-29T02:08:27.789703] [INFO ] [MAIN ] SW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:27.848301] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-29T02:08:27.900110] [DEBUG] [LOCAL ] SVV: Loaded 40221 existing records from primary storage. [2025-09-29T02:08:27.882285] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-05. [2025-09-29T02:08:27.906786] [INFO ] [MAIN ] SVV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:27.918328] [INFO ] [MAIN ] Update Progress: 2032/2371 symbols completed. SVV took 0.7s. Estimated remaining: 1m 51s. Rate: 182.9 symbols/min [2025-09-29T02:08:28.032332] [INFO ] [MAIN ] SWK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:28.213743] [INFO ] [MAIN ] SWX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:28.217362] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-29T02:08:28.219408] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-06. [2025-09-29T02:08:28.241617] [DEBUG] [LOCAL ] SW: Loaded 53939 existing records from primary storage. [2025-09-29T02:08:28.242599] [INFO ] [MAIN ] SW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:28.242751] [INFO ] [MAIN ] Update Progress: 2033/2371 symbols completed. SW took 0.7s. Estimated remaining: 1m 51s. Rate: 182.9 symbols/min [2025-09-29T02:08:28.493454] [INFO ] [MAIN ] SWZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:28.495956] [DEBUG] [LOCAL ] SWX: Loaded 31735 existing records from primary storage. [2025-09-29T02:08:28.498557] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-09-29T02:08:28.502299] [DEBUG] [LOCAL ] SWK: Loaded 53178 existing records from primary storage. [2025-09-29T02:08:28.499251] [INFO ] [MAIN ] SWX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:28.500442] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-07. [2025-09-29T02:08:28.502850] [INFO ] [MAIN ] Update Progress: 2034/2371 symbols completed. SWX took 0.6s. Estimated remaining: 1m 51s. Rate: 183.0 symbols/min [2025-09-29T02:08:28.503856] [INFO ] [MAIN ] SWK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:28.515486] [INFO ] [MAIN ] Update Progress: 2035/2371 symbols completed. SWK took 0.8s. Estimated remaining: 1m 50s. Rate: 183.0 symbols/min [2025-09-29T02:08:28.634572] [DEBUG] [LOCAL ] SWZ: Loaded 6074 existing records from primary storage. [2025-09-29T02:08:28.703708] [INFO ] [MAIN ] SWZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:28.743703] [INFO ] [MAIN ] Update Progress: 2036/2371 symbols completed. SWZ took 0.5s. Estimated remaining: 1m 50s. Rate: 183.1 symbols/min [2025-09-29T02:08:28.810720] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-29T02:08:28.893830] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-08. [2025-09-29T02:08:28.892508] [INFO ] [MAIN ] SXC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:29.057698] [INFO ] [MAIN ] SXI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:29.183154] [INFO ] [MAIN ] SXT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:29.199615] [DEBUG] [LOCAL ] SXI: Loaded 11685 existing records from primary storage. [2025-09-29T02:08:29.200597] [INFO ] [MAIN ] SXI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:29.201023] [INFO ] [MAIN ] Update Progress: 2037/2371 symbols completed. SXI took 0.7s. Estimated remaining: 1m 49s. Rate: 183.0 symbols/min [2025-09-29T02:08:29.218806] [DEBUG] [LOCAL ] SXC: Loaded 42142 existing records from primary storage. [2025-09-29T02:08:29.219153] [INFO ] [MAIN ] SXC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:29.219255] [INFO ] [MAIN ] Update Progress: 2038/2371 symbols completed. SXC took 0.7s. Estimated remaining: 1m 49s. Rate: 183.1 symbols/min [2025-09-29T02:08:29.243293] [DEBUG] [LOCAL ] SXT: Loaded 29557 existing records from primary storage. [2025-09-29T02:08:29.243683] [INFO ] [MAIN ] SXT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:29.243791] [INFO ] [MAIN ] Update Progress: 2039/2371 symbols completed. SXT took 0.4s. Estimated remaining: 1m 49s. Rate: 183.2 symbols/min [2025-09-29T02:08:29.269269] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-29T02:08:29.270395] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-09. [2025-09-29T02:08:29.464432] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-09 (0.19 seconds). [2025-09-29T02:08:29.465399] [INFO ] [REMOTE ] STXM: Full fetch complete (1431 records). [2025-09-29T02:08:29.465498] [DEBUG] [VALIDATOR ] STXM: Validating primary data. [2025-09-29T02:08:29.661538] [WARN ] [VALIDATOR ] STXM: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-29T02:08:29.661821] [FATAL] [MAIN ] STXM: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:08:29.661911] [WARN ] [MAIN ] STXM: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:08:29.662003] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-09-29T02:08:29.662177] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-09-29T02:08:29.662276] [INFO ] [LOCAL ] STXM: Starting deletion of derivative data. [2025-09-29T02:08:29.662413] [DEBUG] [LOCAL ] STXM: No derivative data file found to delete. [2025-09-29T02:08:29.662536] [INFO ] [MAIN ] Update Progress: 2040/2371 symbols completed. STXM took 5.3s. Estimated remaining: 1m 48s. Rate: 183.2 symbols/min [2025-09-29T02:08:30.307416] [INFO ] [MAIN ] SYF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:30.455552] [INFO ] [MAIN ] T: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:30.456853] [INFO ] [MAIN ] SYK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:30.493355] [INFO ] [MAIN ] SYY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:30.565993] [DEBUG] [LOCAL ] SYF: Loaded 54222 existing records from primary storage. [2025-09-29T02:08:30.585545] [INFO ] [MAIN ] SYF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:30.615970] [INFO ] [MAIN ] Update Progress: 2041/2371 symbols completed. SYF took 1.0s. Estimated remaining: 1m 48s. Rate: 183.0 symbols/min [2025-09-29T02:08:30.628991] [DEBUG] [LOCAL ] SYK: Loaded 47699 existing records from primary storage. [2025-09-29T02:08:30.671093] [INFO ] [MAIN ] SYK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:30.694712] [INFO ] [MAIN ] Update Progress: 2042/2371 symbols completed. SYK took 1.0s. Estimated remaining: 1m 48s. Rate: 183.1 symbols/min [2025-09-29T02:08:30.743786] [DEBUG] [LOCAL ] T: Loaded 54578 existing records from primary storage. [2025-09-29T02:08:30.767612] [DEBUG] [LOCAL ] SYY: Loaded 54009 existing records from primary storage. [2025-09-29T02:08:30.795565] [INFO ] [MAIN ] T: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:30.813471] [INFO ] [MAIN ] Update Progress: 2043/2371 symbols completed. T took 1.1s. Estimated remaining: 1m 47s. Rate: 183.1 symbols/min [2025-09-29T02:08:30.801887] [INFO ] [MAIN ] SYY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:30.845035] [INFO ] [MAIN ] Update Progress: 2044/2371 symbols completed. SYY took 1.2s. Estimated remaining: 1m 47s. Rate: 183.2 symbols/min [2025-09-29T02:08:31.243512] [INFO ] [MAIN ] TAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:31.447065] [INFO ] [MAIN ] TAL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:31.477065] [INFO ] [MAIN ] TALO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:31.479146] [INFO ] [MAIN ] TAK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:31.523923] [DEBUG] [LOCAL ] TAC: Loaded 43441 existing records from primary storage. [2025-09-29T02:08:31.541308] [INFO ] [MAIN ] TAC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:31.541448] [INFO ] [MAIN ] Update Progress: 2045/2371 symbols completed. TAC took 0.9s. Estimated remaining: 1m 47s. Rate: 183.1 symbols/min [2025-09-29T02:08:31.707449] [DEBUG] [LOCAL ] TALO: Loaded 51575 existing records from primary storage. [2025-09-29T02:08:31.785229] [DEBUG] [LOCAL ] TAK: Loaded 50538 existing records from primary storage. [2025-09-29T02:08:31.792395] [INFO ] [MAIN ] TALO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:31.805406] [DEBUG] [LOCAL ] TAL: Loaded 52783 existing records from primary storage. [2025-09-29T02:08:31.827728] [INFO ] [MAIN ] Update Progress: 2046/2371 symbols completed. TALO took 1.0s. Estimated remaining: 1m 46s. Rate: 183.1 symbols/min [2025-09-29T02:08:31.828097] [INFO ] [MAIN ] TAK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:31.827271] [INFO ] [MAIN ] TAP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:31.834554] [INFO ] [MAIN ] Update Progress: 2047/2371 symbols completed. TAK took 1.1s. Estimated remaining: 1m 46s. Rate: 183.2 symbols/min [2025-09-29T02:08:31.828934] [INFO ] [MAIN ] TAL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:31.841094] [INFO ] [MAIN ] Update Progress: 2048/2371 symbols completed. TAL took 1.0s. Estimated remaining: 1m 46s. Rate: 183.3 symbols/min [2025-09-29T02:08:32.330987] [INFO ] [MAIN ] TBBB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:32.397578] [INFO ] [MAIN ] TBB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:32.448592] [INFO ] [MAIN ] TBI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:32.478502] [DEBUG] [LOCAL ] TAP: Loaded 53648 existing records from primary storage. [2025-09-29T02:08:32.482542] [INFO ] [MAIN ] TAP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:32.482832] [INFO ] [MAIN ] Update Progress: 2049/2371 symbols completed. TAP took 0.9s. Estimated remaining: 1m 45s. Rate: 183.2 symbols/min [2025-09-29T02:08:32.528992] [DEBUG] [LOCAL ] TBB: Loaded 11828 existing records from primary storage. [2025-09-29T02:08:32.589790] [INFO ] [MAIN ] TBB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:32.616787] [INFO ] [MAIN ] Update Progress: 2050/2371 symbols completed. TBB took 0.8s. Estimated remaining: 1m 45s. Rate: 183.3 symbols/min [2025-09-29T02:08:32.611538] [DEBUG] [LOCAL ] TBI: Loaded 22937 existing records from primary storage. [2025-09-29T02:08:32.664304] [INFO ] [MAIN ] TBI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:32.737124] [INFO ] [MAIN ] Update Progress: 2051/2371 symbols completed. TBI took 0.9s. Estimated remaining: 1m 45s. Rate: 183.3 symbols/min [2025-09-29T02:08:32.800535] [DEBUG] [LOCAL ] TBBB: Loaded 36262 existing records from primary storage. [2025-09-29T02:08:32.843846] [INFO ] [MAIN ] TBLU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:32.842859] [INFO ] [MAIN ] TBBB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:32.865177] [DEBUG] [LOCAL ] TBLU: No existing data file found in primary storage. [2025-09-29T02:08:32.865422] [INFO ] [MAIN ] Update Progress: 2052/2371 symbols completed. TBBB took 1.0s. Estimated remaining: 1m 44s. Rate: 183.4 symbols/min [2025-09-29T02:08:32.877591] [WARN ] [MAIN ] TBLU: No existing data found, performing full refresh instead. [2025-09-29T02:08:33.054720] [INFO ] [MAIN ] TBN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:33.065189] [INFO ] [MAIN ] TBLU: Wiping existing primary data before full refresh. [2025-09-29T02:08:33.089930] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-09-29T02:08:33.116793] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-09-29T02:08:33.139347] [INFO ] [MAIN ] TBLU: Starting full primary refresh. [2025-09-29T02:08:33.240396] [DEBUG] [LOCAL ] TBN: Loaded 3044 existing records from primary storage. [2025-09-29T02:08:33.294344] [INFO ] [MAIN ] TCAI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:33.304917] [INFO ] [MAIN ] TBN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:33.328572] [INFO ] [MAIN ] Update Progress: 2053/2371 symbols completed. TBN took 0.7s. Estimated remaining: 1m 44s. Rate: 183.3 symbols/min [2025-09-29T02:08:33.382795] [DEBUG] [LOCAL ] TCAI: No existing data file found in primary storage. [2025-09-29T02:08:33.458917] [WARN ] [MAIN ] TCAI: No existing data found, performing full refresh instead. [2025-09-29T02:08:33.506752] [INFO ] [MAIN ] TCAI: Wiping existing primary data before full refresh. [2025-09-29T02:08:33.636220] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-09-29T02:08:33.640703] [INFO ] [MAIN ] TD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:33.672862] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-09-29T02:08:33.684489] [INFO ] [MAIN ] TCAI: Starting full primary refresh. [2025-09-29T02:08:33.789012] [INFO ] [MAIN ] TDC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:34.259258] [DEBUG] [LOCAL ] TD: Loaded 53036 existing records from primary storage. [2025-09-29T02:08:34.350842] [INFO ] [MAIN ] TD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:34.330832] [INFO ] [REMOTE ] TBLU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:08:34.378928] [INFO ] [MAIN ] Update Progress: 2054/2371 symbols completed. TD took 1.5s. Estimated remaining: 1m 44s. Rate: 183.1 symbols/min [2025-09-29T02:08:34.385145] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2024-12. [2025-09-29T02:08:34.397411] [DEBUG] [LOCAL ] TDC: Loaded 47501 existing records from primary storage. [2025-09-29T02:08:34.469296] [INFO ] [MAIN ] TDC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:34.485019] [INFO ] [MAIN ] Update Progress: 2055/2371 symbols completed. TDC took 1.1s. Estimated remaining: 1m 43s. Rate: 183.2 symbols/min [2025-09-29T02:08:34.640946] [INFO ] [REMOTE ] TCAI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:08:34.655213] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2024-12. [2025-09-29T02:08:34.794339] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-29T02:08:34.846416] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-01. [2025-09-29T02:08:34.849859] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:08:34.875928] [WARN ] [REMOTE ] TCAI: No data returned for month 2024-12 [2025-09-29T02:08:34.861356] [INFO ] [MAIN ] TDF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:34.885137] [FATAL] [REMOTE ] TCAI: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:08:34.888695] [INFO ] [MAIN ] TDG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:34.889760] [FATAL] [MAIN ] TCAI: Failed to fetch primary data. [2025-09-29T02:08:34.889835] [WARN ] [MAIN ] TCAI: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:08:34.890081] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-09-29T02:08:34.890321] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-09-29T02:08:34.890464] [INFO ] [LOCAL ] TCAI: Starting deletion of derivative data. [2025-09-29T02:08:34.890670] [DEBUG] [LOCAL ] TCAI: No derivative data file found to delete. [2025-09-29T02:08:34.891892] [INFO ] [MAIN ] Update Progress: 2056/2371 symbols completed. TCAI took 2.0s. Estimated remaining: 1m 43s. Rate: 183.2 symbols/min [2025-09-29T02:08:34.963552] [DEBUG] [LOCAL ] TDF: Loaded 6595 existing records from primary storage. [2025-09-29T02:08:35.003838] [INFO ] [MAIN ] TDF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:35.023733] [INFO ] [MAIN ] Update Progress: 2057/2371 symbols completed. TDF took 0.6s. Estimated remaining: 1m 43s. Rate: 183.2 symbols/min [2025-09-29T02:08:35.129097] [DEBUG] [LOCAL ] TDG: Loaded 22314 existing records from primary storage. [2025-09-29T02:08:35.203806] [INFO ] [MAIN ] TDOC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:35.183626] [INFO ] [MAIN ] TDG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:35.216549] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-09-29T02:08:35.222143] [INFO ] [MAIN ] Update Progress: 2058/2371 symbols completed. TDG took 0.7s. Estimated remaining: 1m 42s. Rate: 183.3 symbols/min [2025-09-29T02:08:35.230462] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-02. [2025-09-29T02:08:35.431140] [INFO ] [MAIN ] TDS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:35.531195] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-29T02:08:35.564078] [INFO ] [MAIN ] TDW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:35.540486] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-03. [2025-09-29T02:08:35.589722] [DEBUG] [LOCAL ] TDOC: Loaded 54125 existing records from primary storage. [2025-09-29T02:08:35.590334] [INFO ] [MAIN ] TDOC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:35.590563] [INFO ] [MAIN ] Update Progress: 2059/2371 symbols completed. TDOC took 0.7s. Estimated remaining: 1m 42s. Rate: 183.3 symbols/min [2025-09-29T02:08:35.773529] [DEBUG] [LOCAL ] TDS: Loaded 43435 existing records from primary storage. [2025-09-29T02:08:35.818154] [INFO ] [MAIN ] TDS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:35.788145] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-09-29T02:08:35.820942] [INFO ] [MAIN ] Update Progress: 2060/2371 symbols completed. TDS took 0.8s. Estimated remaining: 1m 42s. Rate: 183.3 symbols/min [2025-09-29T02:08:35.854139] [INFO ] [MAIN ] TDY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:35.861770] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-04. [2025-09-29T02:08:35.895906] [DEBUG] [LOCAL ] TDW: Loaded 46091 existing records from primary storage. [2025-09-29T02:08:35.906834] [INFO ] [MAIN ] TDW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:35.913137] [INFO ] [MAIN ] Update Progress: 2061/2371 symbols completed. TDW took 0.7s. Estimated remaining: 1m 41s. Rate: 183.4 symbols/min [2025-09-29T02:08:36.185046] [DEBUG] [LOCAL ] TDY: Loaded 22979 existing records from primary storage. [2025-09-29T02:08:36.203779] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-29T02:08:36.193156] [INFO ] [MAIN ] TE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:36.238538] [INFO ] [MAIN ] TDY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:36.226497] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-05. [2025-09-29T02:08:36.245280] [DEBUG] [LOCAL ] TE: No existing data file found in primary storage. [2025-09-29T02:08:36.254934] [INFO ] [MAIN ] Update Progress: 2062/2371 symbols completed. TDY took 0.7s. Estimated remaining: 1m 41s. Rate: 183.4 symbols/min [2025-09-29T02:08:36.286362] [WARN ] [MAIN ] TE: No existing data found, performing full refresh instead. [2025-09-29T02:08:36.286182] [INFO ] [MAIN ] TEAF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:36.305791] [INFO ] [MAIN ] TE: Wiping existing primary data before full refresh. [2025-09-29T02:08:36.354715] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-09-29T02:08:36.380976] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-09-29T02:08:36.412995] [DEBUG] [LOCAL ] TEAF: Loaded 7529 existing records from primary storage. [2025-09-29T02:08:36.418079] [INFO ] [MAIN ] TE: Starting full primary refresh. [2025-09-29T02:08:36.418540] [INFO ] [MAIN ] TEAF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:36.447216] [INFO ] [MAIN ] Update Progress: 2063/2371 symbols completed. TEAF took 0.5s. Estimated remaining: 1m 41s. Rate: 183.4 symbols/min [2025-09-29T02:08:36.629700] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-29T02:08:36.675897] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-06. [2025-09-29T02:08:36.653244] [INFO ] [MAIN ] TECK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:36.978046] [INFO ] [MAIN ] TEF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:36.986432] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-29T02:08:36.987915] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-07. [2025-09-29T02:08:37.177200] [INFO ] [REMOTE ] TE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:08:37.202419] [INFO ] [REMOTE ] TE: Fetching primary data for 2024-12. [2025-09-29T02:08:37.206181] [DEBUG] [LOCAL ] TECK: Loaded 54216 existing records from primary storage. [2025-09-29T02:08:37.206791] [INFO ] [MAIN ] TECK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:37.206942] [INFO ] [MAIN ] Update Progress: 2064/2371 symbols completed. TECK took 0.9s. Estimated remaining: 1m 41s. Rate: 183.3 symbols/min [2025-09-29T02:08:37.266575] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-09-29T02:08:37.350753] [DEBUG] [LOCAL ] TEF: Loaded 37944 existing records from primary storage. [2025-09-29T02:08:37.372004] [INFO ] [MAIN ] TEF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:37.405744] [INFO ] [MAIN ] Update Progress: 2065/2371 symbols completed. TEF took 0.9s. Estimated remaining: 1m 40s. Rate: 183.3 symbols/min [2025-09-29T02:08:37.429118] [INFO ] [MAIN ] TEI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:37.484575] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:08:37.522494] [WARN ] [REMOTE ] TE: No data returned for month 2024-12 [2025-09-29T02:08:37.556890] [FATAL] [REMOTE ] TE: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:08:37.557061] [FATAL] [MAIN ] TE: Failed to fetch primary data. [2025-09-29T02:08:37.562761] [WARN ] [MAIN ] TE: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:08:37.578317] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-09-29T02:08:37.642799] [INFO ] [MAIN ] TEL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:37.643077] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-09-29T02:08:37.643573] [INFO ] [LOCAL ] TE: Starting deletion of derivative data. [2025-09-29T02:08:37.643720] [DEBUG] [LOCAL ] TE: No derivative data file found to delete. [2025-09-29T02:08:37.643829] [INFO ] [MAIN ] Update Progress: 2066/2371 symbols completed. TE took 1.8s. Estimated remaining: 1m 40s. Rate: 183.3 symbols/min [2025-09-29T02:08:37.717692] [DEBUG] [LOCAL ] TEI: Loaded 20910 existing records from primary storage. [2025-09-29T02:08:37.769877] [INFO ] [MAIN ] TEI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:37.770562] [INFO ] [MAIN ] Update Progress: 2067/2371 symbols completed. TEI took 0.6s. Estimated remaining: 1m 39s. Rate: 183.4 symbols/min [2025-09-29T02:08:37.904365] [INFO ] [MAIN ] TEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:38.001230] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-08. [2025-09-29T02:08:38.065757] [INFO ] [MAIN ] TEO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:38.085332] [DEBUG] [LOCAL ] TEL: Loaded 51898 existing records from primary storage. [2025-09-29T02:08:38.086253] [INFO ] [MAIN ] TEL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:38.086388] [INFO ] [MAIN ] Update Progress: 2068/2371 symbols completed. TEL took 0.7s. Estimated remaining: 1m 39s. Rate: 183.4 symbols/min [2025-09-29T02:08:38.241151] [DEBUG] [LOCAL ] TEN: Loaded 31383 existing records from primary storage. [2025-09-29T02:08:38.247563] [DEBUG] [LOCAL ] TEO: Loaded 22345 existing records from primary storage. [2025-09-29T02:08:38.263299] [INFO ] [MAIN ] TEN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:38.328281] [INFO ] [MAIN ] TEVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:38.331034] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-29T02:08:38.308760] [INFO ] [MAIN ] TEO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:38.328604] [INFO ] [MAIN ] Update Progress: 2069/2371 symbols completed. TEN took 0.7s. Estimated remaining: 1m 39s. Rate: 183.4 symbols/min [2025-09-29T02:08:38.344688] [INFO ] [MAIN ] Update Progress: 2070/2371 symbols completed. TEO took 0.6s. Estimated remaining: 1m 38s. Rate: 183.5 symbols/min [2025-09-29T02:08:38.703365] [INFO ] [MAIN ] TEX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:38.759978] [INFO ] [MAIN ] TFC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:38.780674] [DEBUG] [LOCAL ] TEVA: Loaded 54413 existing records from primary storage. [2025-09-29T02:08:38.781330] [INFO ] [MAIN ] TEVA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:38.781725] [INFO ] [MAIN ] Update Progress: 2071/2371 symbols completed. TEVA took 0.7s. Estimated remaining: 1m 38s. Rate: 183.5 symbols/min [2025-09-29T02:08:38.807167] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-09. [2025-09-29T02:08:39.030310] [INFO ] [MAIN ] TFII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:39.050373] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-09-29T02:08:39.052744] [DEBUG] [LOCAL ] TEX: Loaded 45170 existing records from primary storage. [2025-09-29T02:08:39.054706] [INFO ] [REMOTE ] TBLU: Full fetch complete (1172 records). [2025-09-29T02:08:39.055317] [DEBUG] [VALIDATOR ] TBLU: Validating primary data. [2025-09-29T02:08:39.061248] [INFO ] [MAIN ] TEX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:39.076251] [INFO ] [MAIN ] Update Progress: 2072/2371 symbols completed. TEX took 0.7s. Estimated remaining: 1m 38s. Rate: 183.5 symbols/min [2025-09-29T02:08:39.116105] [DEBUG] [LOCAL ] TFC: Loaded 54447 existing records from primary storage. [2025-09-29T02:08:39.150635] [INFO ] [MAIN ] TFC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:39.186246] [INFO ] [MAIN ] Update Progress: 2073/2371 symbols completed. TFC took 0.8s. Estimated remaining: 1m 37s. Rate: 183.5 symbols/min [2025-09-29T02:08:39.516216] [DEBUG] [LOCAL ] TFII: Loaded 34733 existing records from primary storage. [2025-09-29T02:08:39.579779] [INFO ] [MAIN ] TFII: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:39.539941] [WARN ] [VALIDATOR ] TBLU: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-29T02:08:39.607675] [INFO ] [MAIN ] Update Progress: 2074/2371 symbols completed. TFII took 0.8s. Estimated remaining: 1m 37s. Rate: 183.5 symbols/min [2025-09-29T02:08:39.661751] [INFO ] [MAIN ] TFIN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:39.607512] [FATAL] [MAIN ] TBLU: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:08:39.711254] [WARN ] [MAIN ] TBLU: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:08:39.735711] [INFO ] [MAIN ] TFPM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:39.751621] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-09-29T02:08:39.783049] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-09-29T02:08:39.828198] [INFO ] [LOCAL ] TBLU: Starting deletion of derivative data. [2025-09-29T02:08:39.834251] [DEBUG] [LOCAL ] TBLU: No derivative data file found to delete. [2025-09-29T02:08:39.851030] [INFO ] [MAIN ] Update Progress: 2075/2371 symbols completed. TBLU took 7.4s. Estimated remaining: 1m 37s. Rate: 183.5 symbols/min [2025-09-29T02:08:39.946319] [INFO ] [MAIN ] TFX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:40.000093] [DEBUG] [LOCAL ] TFIN: Loaded 23896 existing records from primary storage. [2025-09-29T02:08:40.040761] [INFO ] [MAIN ] TFIN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:40.067787] [INFO ] [MAIN ] Update Progress: 2076/2371 symbols completed. TFIN took 1.0s. Estimated remaining: 1m 36s. Rate: 183.6 symbols/min [2025-09-29T02:08:40.163842] [DEBUG] [LOCAL ] TFPM: Loaded 37997 existing records from primary storage. [2025-09-29T02:08:40.234892] [INFO ] [MAIN ] TG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:40.261208] [INFO ] [MAIN ] TFPM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:40.287728] [INFO ] [MAIN ] Update Progress: 2077/2371 symbols completed. TFPM took 1.1s. Estimated remaining: 1m 36s. Rate: 183.6 symbols/min [2025-09-29T02:08:40.379709] [INFO ] [MAIN ] TGE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:40.392731] [DEBUG] [LOCAL ] TG: Loaded 10581 existing records from primary storage. [2025-09-29T02:08:40.394316] [DEBUG] [LOCAL ] TFX: Loaded 37936 existing records from primary storage. [2025-09-29T02:08:40.393200] [DEBUG] [LOCAL ] TGE: No existing data file found in primary storage. [2025-09-29T02:08:40.394745] [INFO ] [MAIN ] TFX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:40.394919] [INFO ] [MAIN ] Update Progress: 2078/2371 symbols completed. TFX took 0.8s. Estimated remaining: 1m 36s. Rate: 183.6 symbols/min [2025-09-29T02:08:40.394966] [WARN ] [MAIN ] TGE: No existing data found, performing full refresh instead. [2025-09-29T02:08:40.395571] [INFO ] [MAIN ] TGE: Wiping existing primary data before full refresh. [2025-09-29T02:08:40.395192] [INFO ] [MAIN ] TG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:40.395706] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-09-29T02:08:40.395851] [INFO ] [MAIN ] Update Progress: 2079/2371 symbols completed. TG took 0.5s. Estimated remaining: 1m 35s. Rate: 183.7 symbols/min [2025-09-29T02:08:40.395915] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-09-29T02:08:40.396125] [INFO ] [MAIN ] TGE: Starting full primary refresh. [2025-09-29T02:08:40.786521] [INFO ] [REMOTE ] TGE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:08:40.787044] [INFO ] [REMOTE ] TGE: Fetching primary data for 2024-12. [2025-09-29T02:08:40.912291] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:08:40.912624] [WARN ] [REMOTE ] TGE: No data returned for month 2024-12 [2025-09-29T02:08:40.912745] [FATAL] [REMOTE ] TGE: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:08:40.912822] [FATAL] [MAIN ] TGE: Failed to fetch primary data. [2025-09-29T02:08:40.912891] [WARN ] [MAIN ] TGE: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:08:40.912979] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-09-29T02:08:40.913070] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-09-29T02:08:40.913138] [INFO ] [LOCAL ] TGE: Starting deletion of derivative data. [2025-09-29T02:08:40.913249] [DEBUG] [LOCAL ] TGE: No derivative data file found to delete. [2025-09-29T02:08:40.913356] [INFO ] [MAIN ] Update Progress: 2080/2371 symbols completed. TGE took 0.8s. Estimated remaining: 1m 35s. Rate: 183.7 symbols/min [2025-09-29T02:08:41.594045] [INFO ] [MAIN ] TGNA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:41.698830] [INFO ] [MAIN ] TGLS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:41.697817] [INFO ] [MAIN ] TGT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:41.700313] [INFO ] [MAIN ] TGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:41.733543] [DEBUG] [LOCAL ] TGLS: Loaded 28709 existing records from primary storage. [2025-09-29T02:08:41.733993] [INFO ] [MAIN ] TGLS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:41.734436] [INFO ] [MAIN ] Update Progress: 2081/2371 symbols completed. TGLS took 0.8s. Estimated remaining: 1m 35s. Rate: 183.5 symbols/min [2025-09-29T02:08:41.929897] [DEBUG] [LOCAL ] TGS: Loaded 33072 existing records from primary storage. [2025-09-29T02:08:41.982089] [INFO ] [MAIN ] THC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:41.977515] [INFO ] [MAIN ] TGS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:41.996804] [INFO ] [MAIN ] Update Progress: 2082/2371 symbols completed. TGS took 1.1s. Estimated remaining: 1m 34s. Rate: 183.6 symbols/min [2025-09-29T02:08:41.997968] [DEBUG] [LOCAL ] TGNA: Loaded 49444 existing records from primary storage. [2025-09-29T02:08:42.034639] [INFO ] [MAIN ] TGNA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:42.062681] [INFO ] [MAIN ] Update Progress: 2083/2371 symbols completed. TGNA took 1.1s. Estimated remaining: 1m 34s. Rate: 183.6 symbols/min [2025-09-29T02:08:42.127581] [DEBUG] [LOCAL ] TGT: Loaded 54558 existing records from primary storage. [2025-09-29T02:08:42.187523] [INFO ] [MAIN ] TGT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:42.229792] [INFO ] [MAIN ] Update Progress: 2084/2371 symbols completed. TGT took 1.3s. Estimated remaining: 1m 34s. Rate: 183.7 symbols/min [2025-09-29T02:08:42.354057] [INFO ] [MAIN ] THG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:42.580613] [INFO ] [MAIN ] THIR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:42.623408] [DEBUG] [LOCAL ] THC: Loaded 48617 existing records from primary storage. [2025-09-29T02:08:42.669184] [INFO ] [MAIN ] THLV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:42.666986] [INFO ] [MAIN ] THC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:42.670937] [INFO ] [MAIN ] Update Progress: 2085/2371 symbols completed. THC took 0.9s. Estimated remaining: 1m 33s. Rate: 183.6 symbols/min [2025-09-29T02:08:42.692554] [DEBUG] [LOCAL ] THIR: Loaded 2238 existing records from primary storage. [2025-09-29T02:08:42.728498] [INFO ] [MAIN ] THIR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:42.726926] [DEBUG] [LOCAL ] THLV: Loaded 1614 existing records from primary storage. [2025-09-29T02:08:42.800369] [INFO ] [MAIN ] THLV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:42.781798] [DEBUG] [LOCAL ] THG: Loaded 22081 existing records from primary storage. [2025-09-29T02:08:42.781976] [INFO ] [MAIN ] Update Progress: 2086/2371 symbols completed. THIR took 0.6s. Estimated remaining: 1m 33s. Rate: 183.7 symbols/min [2025-09-29T02:08:42.815535] [INFO ] [MAIN ] Update Progress: 2087/2371 symbols completed. THLV took 0.5s. Estimated remaining: 1m 33s. Rate: 183.8 symbols/min [2025-09-29T02:08:42.838255] [INFO ] [MAIN ] THG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:42.866353] [INFO ] [MAIN ] Update Progress: 2088/2371 symbols completed. THG took 0.9s. Estimated remaining: 1m 32s. Rate: 183.9 symbols/min [2025-09-29T02:08:43.178371] [INFO ] [MAIN ] THO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:43.387372] [INFO ] [MAIN ] THR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:43.470690] [INFO ] [MAIN ] THQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:43.500900] [INFO ] [MAIN ] THS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:43.533500] [DEBUG] [LOCAL ] THR: Loaded 20218 existing records from primary storage. [2025-09-29T02:08:43.534527] [INFO ] [MAIN ] THR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:43.540829] [INFO ] [MAIN ] Update Progress: 2089/2371 symbols completed. THR took 0.7s. Estimated remaining: 1m 32s. Rate: 183.8 symbols/min [2025-09-29T02:08:43.606532] [DEBUG] [LOCAL ] THO: Loaded 42957 existing records from primary storage. [2025-09-29T02:08:43.625823] [DEBUG] [LOCAL ] THQ: Loaded 24879 existing records from primary storage. [2025-09-29T02:08:43.635262] [INFO ] [MAIN ] THO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:43.635977] [INFO ] [MAIN ] Update Progress: 2090/2371 symbols completed. THO took 1.0s. Estimated remaining: 1m 32s. Rate: 183.8 symbols/min [2025-09-29T02:08:43.689843] [INFO ] [MAIN ] THQ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:43.716343] [INFO ] [MAIN ] Update Progress: 2091/2371 symbols completed. THQ took 0.9s. Estimated remaining: 1m 31s. Rate: 183.9 symbols/min [2025-09-29T02:08:43.822975] [DEBUG] [LOCAL ] THS: Loaded 38565 existing records from primary storage. [2025-09-29T02:08:43.948800] [INFO ] [MAIN ] THS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:44.023698] [INFO ] [MAIN ] THW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:44.065998] [INFO ] [MAIN ] Update Progress: 2092/2371 symbols completed. THS took 1.1s. Estimated remaining: 1m 31s. Rate: 183.9 symbols/min [2025-09-29T02:08:44.155576] [INFO ] [MAIN ] TIC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:44.211147] [DEBUG] [LOCAL ] TIC: No existing data file found in primary storage. [2025-09-29T02:08:44.253587] [WARN ] [MAIN ] TIC: No existing data found, performing full refresh instead. [2025-09-29T02:08:44.309352] [INFO ] [MAIN ] TIMB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:44.309958] [INFO ] [MAIN ] TIC: Wiping existing primary data before full refresh. [2025-09-29T02:08:44.311204] [DEBUG] [LOCAL ] THW: Loaded 19392 existing records from primary storage. [2025-09-29T02:08:44.316547] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-09-29T02:08:44.337626] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-09-29T02:08:44.362078] [INFO ] [MAIN ] THW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:44.392308] [INFO ] [MAIN ] TIC: Starting full primary refresh. [2025-09-29T02:08:44.392552] [INFO ] [MAIN ] Update Progress: 2093/2371 symbols completed. THW took 0.9s. Estimated remaining: 1m 31s. Rate: 183.9 symbols/min [2025-09-29T02:08:44.399204] [INFO ] [MAIN ] TISI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:44.673323] [DEBUG] [LOCAL ] TISI: Loaded 3805 existing records from primary storage. [2025-09-29T02:08:44.684464] [INFO ] [MAIN ] TISI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:44.742554] [INFO ] [MAIN ] Update Progress: 2094/2371 symbols completed. TISI took 0.7s. Estimated remaining: 1m 30s. Rate: 183.9 symbols/min [2025-09-29T02:08:44.852486] [INFO ] [MAIN ] TIXT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:44.922838] [DEBUG] [LOCAL ] TIMB: Loaded 36983 existing records from primary storage. [2025-09-29T02:08:45.003121] [INFO ] [MAIN ] TIMB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:45.067913] [INFO ] [MAIN ] Update Progress: 2095/2371 symbols completed. TIMB took 1.3s. Estimated remaining: 1m 30s. Rate: 183.9 symbols/min [2025-09-29T02:08:45.246447] [INFO ] [MAIN ] TJX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:45.367356] [DEBUG] [LOCAL ] TIXT: Loaded 31824 existing records from primary storage. [2025-09-29T02:08:45.398274] [INFO ] [MAIN ] TIXT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:45.430186] [INFO ] [MAIN ] Update Progress: 2096/2371 symbols completed. TIXT took 1.0s. Estimated remaining: 1m 30s. Rate: 183.9 symbols/min [2025-09-29T02:08:45.520395] [INFO ] [REMOTE ] TIC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:08:45.531198] [INFO ] [MAIN ] TK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:45.565443] [INFO ] [REMOTE ] TIC: Fetching primary data for 2024-12. [2025-09-29T02:08:45.757857] [DEBUG] [REMOTE ] TIC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:08:45.784678] [WARN ] [REMOTE ] TIC: No data returned for month 2024-12 [2025-09-29T02:08:45.784934] [FATAL] [REMOTE ] TIC: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:08:45.776194] [DEBUG] [LOCAL ] TJX: Loaded 54449 existing records from primary storage. [2025-09-29T02:08:45.785046] [FATAL] [MAIN ] TIC: Failed to fetch primary data. [2025-09-29T02:08:45.800571] [INFO ] [MAIN ] TJX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:45.802256] [WARN ] [MAIN ] TIC: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:08:45.802061] [INFO ] [MAIN ] TKC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:45.802712] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-09-29T02:08:45.802823] [INFO ] [MAIN ] Update Progress: 2097/2371 symbols completed. TJX took 1.0s. Estimated remaining: 1m 29s. Rate: 183.9 symbols/min [2025-09-29T02:08:45.815893] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-09-29T02:08:45.816478] [INFO ] [LOCAL ] TIC: Starting deletion of derivative data. [2025-09-29T02:08:45.830803] [DEBUG] [LOCAL ] TK: Loaded 40151 existing records from primary storage. [2025-09-29T02:08:45.822007] [DEBUG] [LOCAL ] TIC: No derivative data file found to delete. [2025-09-29T02:08:45.843110] [INFO ] [MAIN ] TK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:45.861617] [INFO ] [MAIN ] Update Progress: 2098/2371 symbols completed. TK took 0.7s. Estimated remaining: 1m 29s. Rate: 183.9 symbols/min [2025-09-29T02:08:45.889964] [INFO ] [MAIN ] Update Progress: 2099/2371 symbols completed. TIC took 2.2s. Estimated remaining: 1m 29s. Rate: 184.0 symbols/min [2025-09-29T02:08:46.239538] [DEBUG] [LOCAL ] TKC: Loaded 39062 existing records from primary storage. [2025-09-29T02:08:46.298339] [INFO ] [MAIN ] TKC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:46.325017] [INFO ] [MAIN ] TKO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:46.346114] [INFO ] [MAIN ] Update Progress: 2100/2371 symbols completed. TKC took 0.9s. Estimated remaining: 1m 28s. Rate: 184.0 symbols/min [2025-09-29T02:08:46.420923] [INFO ] [MAIN ] TLK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:46.517551] [INFO ] [MAIN ] TKR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:46.729063] [INFO ] [MAIN ] TLYS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:46.730762] [DEBUG] [LOCAL ] TKO: Loaded 44814 existing records from primary storage. [2025-09-29T02:08:46.731936] [INFO ] [MAIN ] TKO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:46.732061] [INFO ] [MAIN ] Update Progress: 2101/2371 symbols completed. TKO took 0.9s. Estimated remaining: 1m 28s. Rate: 184.0 symbols/min [2025-09-29T02:08:46.869862] [DEBUG] [LOCAL ] TKR: Loaded 40832 existing records from primary storage. [2025-09-29T02:08:46.863528] [DEBUG] [LOCAL ] TLK: Loaded 39925 existing records from primary storage. [2025-09-29T02:08:46.898371] [INFO ] [MAIN ] TKR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:46.905307] [DEBUG] [LOCAL ] TLYS: Loaded 17064 existing records from primary storage. [2025-09-29T02:08:46.911002] [INFO ] [MAIN ] TLK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:46.911333] [INFO ] [MAIN ] TLYS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:46.916597] [INFO ] [MAIN ] Update Progress: 2102/2371 symbols completed. TKR took 1.0s. Estimated remaining: 1m 28s. Rate: 184.0 symbols/min [2025-09-29T02:08:46.943688] [INFO ] [MAIN ] Update Progress: 2103/2371 symbols completed. TLK took 0.9s. Estimated remaining: 1m 27s. Rate: 184.1 symbols/min [2025-09-29T02:08:46.950610] [INFO ] [MAIN ] Update Progress: 2104/2371 symbols completed. TLYS took 0.6s. Estimated remaining: 1m 27s. Rate: 184.2 symbols/min [2025-09-29T02:08:47.084110] [INFO ] [MAIN ] TM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:47.492127] [INFO ] [MAIN ] TME: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:47.544506] [INFO ] [MAIN ] TMHC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:47.564618] [INFO ] [MAIN ] TMO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:47.597212] [DEBUG] [LOCAL ] TM: Loaded 36992 existing records from primary storage. [2025-09-29T02:08:47.599113] [INFO ] [MAIN ] TM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:47.599256] [INFO ] [MAIN ] Update Progress: 2105/2371 symbols completed. TM took 0.9s. Estimated remaining: 1m 27s. Rate: 184.1 symbols/min [2025-09-29T02:08:47.848818] [DEBUG] [LOCAL ] TMHC: Loaded 46274 existing records from primary storage. [2025-09-29T02:08:47.873227] [INFO ] [MAIN ] TNC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:47.888920] [INFO ] [MAIN ] TMHC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:47.904561] [DEBUG] [LOCAL ] TME: Loaded 53979 existing records from primary storage. [2025-09-29T02:08:47.904754] [INFO ] [MAIN ] Update Progress: 2106/2371 symbols completed. TMHC took 1.0s. Estimated remaining: 1m 26s. Rate: 184.1 symbols/min [2025-09-29T02:08:47.905693] [INFO ] [MAIN ] TME: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:47.918236] [INFO ] [MAIN ] Update Progress: 2107/2371 symbols completed. TME took 1.0s. Estimated remaining: 1m 26s. Rate: 184.2 symbols/min [2025-09-29T02:08:47.906632] [DEBUG] [LOCAL ] TMO: Loaded 53089 existing records from primary storage. [2025-09-29T02:08:47.984478] [INFO ] [MAIN ] TMO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:48.042573] [INFO ] [MAIN ] Update Progress: 2108/2371 symbols completed. TMO took 1.0s. Estimated remaining: 1m 26s. Rate: 184.2 symbols/min [2025-09-29T02:08:48.128850] [DEBUG] [LOCAL ] TNC: Loaded 15334 existing records from primary storage. [2025-09-29T02:08:48.179378] [INFO ] [MAIN ] TNC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:48.222327] [INFO ] [MAIN ] Update Progress: 2109/2371 symbols completed. TNC took 0.6s. Estimated remaining: 1m 25s. Rate: 184.3 symbols/min [2025-09-29T02:08:48.342362] [INFO ] [MAIN ] TNET: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:48.539743] [INFO ] [MAIN ] TNGY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:48.619303] [DEBUG] [LOCAL ] TNGY: No existing data file found in primary storage. [2025-09-29T02:08:48.622986] [WARN ] [MAIN ] TNGY: No existing data found, performing full refresh instead. [2025-09-29T02:08:48.651245] [INFO ] [MAIN ] TNGY: Wiping existing primary data before full refresh. [2025-09-29T02:08:48.660435] [INFO ] [MAIN ] TNK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:48.666439] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-09-29T02:08:48.688065] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-09-29T02:08:48.716918] [INFO ] [MAIN ] TNGY: Starting full primary refresh. [2025-09-29T02:08:48.817580] [INFO ] [MAIN ] TNL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:48.819339] [DEBUG] [LOCAL ] TNET: Loaded 29247 existing records from primary storage. [2025-09-29T02:08:48.843671] [INFO ] [MAIN ] TNET: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:48.861784] [INFO ] [MAIN ] Update Progress: 2110/2371 symbols completed. TNET took 1.0s. Estimated remaining: 1m 25s. Rate: 184.2 symbols/min [2025-09-29T02:08:49.347354] [DEBUG] [LOCAL ] TNK: Loaded 35701 existing records from primary storage. [2025-09-29T02:08:49.379986] [INFO ] [MAIN ] TNK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:49.368760] [INFO ] [MAIN ] TOL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:49.425777] [INFO ] [MAIN ] Update Progress: 2111/2371 symbols completed. TNK took 1.3s. Estimated remaining: 1m 25s. Rate: 184.1 symbols/min [2025-09-29T02:08:49.450904] [DEBUG] [LOCAL ] TNL: Loaded 42474 existing records from primary storage. [2025-09-29T02:08:49.499295] [INFO ] [REMOTE ] TNGY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:08:49.511788] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2024-12. [2025-09-29T02:08:49.523695] [INFO ] [MAIN ] TNL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:49.531512] [INFO ] [MAIN ] Update Progress: 2112/2371 symbols completed. TNL took 1.3s. Estimated remaining: 1m 24s. Rate: 184.2 symbols/min [2025-09-29T02:08:49.735677] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:08:49.831710] [WARN ] [REMOTE ] TNGY: No data returned for month 2024-12 [2025-09-29T02:08:49.877180] [FATAL] [REMOTE ] TNGY: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:08:49.872896] [INFO ] [MAIN ] TPB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:49.877009] [INFO ] [MAIN ] TOST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:49.892719] [FATAL] [MAIN ] TNGY: Failed to fetch primary data. [2025-09-29T02:08:49.893302] [WARN ] [MAIN ] TNGY: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:08:49.893391] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-09-29T02:08:49.893558] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-09-29T02:08:49.893771] [INFO ] [LOCAL ] TNGY: Starting deletion of derivative data. [2025-09-29T02:08:49.893996] [DEBUG] [LOCAL ] TNGY: No derivative data file found to delete. [2025-09-29T02:08:49.894214] [INFO ] [MAIN ] Update Progress: 2113/2371 symbols completed. TNGY took 1.9s. Estimated remaining: 1m 24s. Rate: 184.2 symbols/min [2025-09-29T02:08:50.047608] [DEBUG] [LOCAL ] TOL: Loaded 51738 existing records from primary storage. [2025-09-29T02:08:50.085469] [INFO ] [MAIN ] TOL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:50.109801] [DEBUG] [LOCAL ] TPB: Loaded 25409 existing records from primary storage. [2025-09-29T02:08:50.109947] [INFO ] [MAIN ] Update Progress: 2114/2371 symbols completed. TOL took 1.2s. Estimated remaining: 1m 24s. Rate: 184.2 symbols/min [2025-09-29T02:08:50.158261] [INFO ] [MAIN ] TPB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:50.157846] [INFO ] [MAIN ] TPC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:50.181928] [INFO ] [MAIN ] Update Progress: 2115/2371 symbols completed. TPB took 0.6s. Estimated remaining: 1m 23s. Rate: 184.3 symbols/min [2025-09-29T02:08:50.396463] [DEBUG] [LOCAL ] TOST: Loaded 54461 existing records from primary storage. [2025-09-29T02:08:50.434213] [INFO ] [MAIN ] TOST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:50.521360] [INFO ] [MAIN ] Update Progress: 2116/2371 symbols completed. TOST took 1.1s. Estimated remaining: 1m 23s. Rate: 184.3 symbols/min [2025-09-29T02:08:50.521171] [INFO ] [MAIN ] TPH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:50.546236] [DEBUG] [LOCAL ] TPC: Loaded 39311 existing records from primary storage. [2025-09-29T02:08:50.674350] [INFO ] [MAIN ] TPC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:50.705086] [INFO ] [MAIN ] Update Progress: 2117/2371 symbols completed. TPC took 0.8s. Estimated remaining: 1m 23s. Rate: 184.3 symbols/min [2025-09-29T02:08:50.704903] [INFO ] [MAIN ] TPL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:50.855045] [INFO ] [MAIN ] TPR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:50.877350] [DEBUG] [LOCAL ] TPL: Loaded 12533 existing records from primary storage. [2025-09-29T02:08:50.877795] [INFO ] [MAIN ] TPL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:50.877902] [INFO ] [MAIN ] Update Progress: 2118/2371 symbols completed. TPL took 0.7s. Estimated remaining: 1m 22s. Rate: 184.3 symbols/min [2025-09-29T02:08:50.879409] [DEBUG] [LOCAL ] TPH: Loaded 45821 existing records from primary storage. [2025-09-29T02:08:50.879900] [INFO ] [MAIN ] TPH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:50.880526] [INFO ] [MAIN ] Update Progress: 2119/2371 symbols completed. TPH took 0.7s. Estimated remaining: 1m 22s. Rate: 184.4 symbols/min [2025-09-29T02:08:50.938191] [DEBUG] [LOCAL ] TPR: Loaded 54252 existing records from primary storage. [2025-09-29T02:08:50.938631] [INFO ] [MAIN ] TPR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:50.938768] [INFO ] [MAIN ] Update Progress: 2120/2371 symbols completed. TPR took 0.4s. Estimated remaining: 1m 22s. Rate: 184.5 symbols/min [2025-09-29T02:08:51.655963] [INFO ] [MAIN ] TPVG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:51.670389] [INFO ] [MAIN ] TPYP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:51.668783] [INFO ] [MAIN ] TR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:51.706481] [INFO ] [MAIN ] TPZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:51.725508] [DEBUG] [LOCAL ] TPZ: Loaded 5095 existing records from primary storage. [2025-09-29T02:08:51.726232] [INFO ] [MAIN ] TPZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:51.731183] [DEBUG] [LOCAL ] TPYP: Loaded 8039 existing records from primary storage. [2025-09-29T02:08:51.731316] [INFO ] [MAIN ] Update Progress: 2121/2371 symbols completed. TPZ took 0.7s. Estimated remaining: 1m 21s. Rate: 184.4 symbols/min [2025-09-29T02:08:51.731684] [INFO ] [MAIN ] TPYP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:51.787461] [INFO ] [MAIN ] Update Progress: 2122/2371 symbols completed. TPYP took 0.8s. Estimated remaining: 1m 21s. Rate: 184.4 symbols/min [2025-09-29T02:08:51.812554] [DEBUG] [LOCAL ] TR: Loaded 18494 existing records from primary storage. [2025-09-29T02:08:51.851853] [INFO ] [MAIN ] TR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:51.956000] [DEBUG] [LOCAL ] TPVG: Loaded 27400 existing records from primary storage. [2025-09-29T02:08:51.954999] [INFO ] [MAIN ] Update Progress: 2123/2371 symbols completed. TR took 1.0s. Estimated remaining: 1m 21s. Rate: 184.5 symbols/min [2025-09-29T02:08:52.053766] [INFO ] [MAIN ] TPVG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:52.114721] [INFO ] [MAIN ] TRAK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:52.114999] [INFO ] [MAIN ] Update Progress: 2124/2371 symbols completed. TPVG took 1.2s. Estimated remaining: 1m 20s. Rate: 184.5 symbols/min [2025-09-29T02:08:52.331740] [DEBUG] [LOCAL ] TRAK: Loaded 9383 existing records from primary storage. [2025-09-29T02:08:52.374180] [INFO ] [MAIN ] TRAK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:52.373405] [INFO ] [MAIN ] TRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:52.390287] [INFO ] [MAIN ] Update Progress: 2125/2371 symbols completed. TRAK took 0.7s. Estimated remaining: 1m 20s. Rate: 184.5 symbols/min [2025-09-29T02:08:52.554993] [INFO ] [MAIN ] TREX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:52.642559] [INFO ] [MAIN ] TRGP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:52.691740] [DEBUG] [LOCAL ] TRC: Loaded 16189 existing records from primary storage. [2025-09-29T02:08:52.692259] [INFO ] [MAIN ] TRC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:52.692924] [INFO ] [MAIN ] Update Progress: 2126/2371 symbols completed. TRC took 0.9s. Estimated remaining: 1m 20s. Rate: 184.5 symbols/min [2025-09-29T02:08:52.838451] [INFO ] [MAIN ] TRN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:53.032765] [DEBUG] [LOCAL ] TREX: Loaded 50733 existing records from primary storage. [2025-09-29T02:08:53.035688] [INFO ] [MAIN ] TRNO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:53.037355] [INFO ] [MAIN ] TREX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:53.039088] [INFO ] [MAIN ] Update Progress: 2127/2371 symbols completed. TREX took 1.1s. Estimated remaining: 1m 19s. Rate: 184.5 symbols/min [2025-09-29T02:08:53.092178] [DEBUG] [LOCAL ] TRGP: Loaded 51504 existing records from primary storage. [2025-09-29T02:08:53.153849] [INFO ] [MAIN ] TRGP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:53.178597] [INFO ] [MAIN ] Update Progress: 2128/2371 symbols completed. TRGP took 1.0s. Estimated remaining: 1m 19s. Rate: 184.6 symbols/min [2025-09-29T02:08:53.210412] [DEBUG] [LOCAL ] TRN: Loaded 37786 existing records from primary storage. [2025-09-29T02:08:53.289283] [INFO ] [MAIN ] TRN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:53.335102] [INFO ] [MAIN ] Update Progress: 2129/2371 symbols completed. TRN took 0.9s. Estimated remaining: 1m 19s. Rate: 184.6 symbols/min [2025-09-29T02:08:53.440701] [INFO ] [MAIN ] TROX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:53.614275] [DEBUG] [LOCAL ] TRNO: Loaded 44598 existing records from primary storage. [2025-09-29T02:08:53.648565] [INFO ] [MAIN ] TRP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:53.655579] [INFO ] [MAIN ] TRNO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:53.688168] [INFO ] [MAIN ] Update Progress: 2130/2371 symbols completed. TRNO took 1.0s. Estimated remaining: 1m 18s. Rate: 184.6 symbols/min [2025-09-29T02:08:53.784071] [INFO ] [MAIN ] TRTX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:53.942839] [DEBUG] [LOCAL ] TROX: Loaded 52550 existing records from primary storage. [2025-09-29T02:08:54.006874] [INFO ] [MAIN ] TROX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:54.036844] [INFO ] [MAIN ] TRU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:54.037419] [INFO ] [MAIN ] Update Progress: 2131/2371 symbols completed. TROX took 1.0s. Estimated remaining: 1m 18s. Rate: 184.6 symbols/min [2025-09-29T02:08:54.190403] [DEBUG] [LOCAL ] TRP: Loaded 52891 existing records from primary storage. [2025-09-29T02:08:54.191181] [DEBUG] [LOCAL ] TRTX: Loaded 38058 existing records from primary storage. [2025-09-29T02:08:54.218168] [INFO ] [MAIN ] TRTX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:54.243564] [INFO ] [MAIN ] TRP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:54.236737] [INFO ] [MAIN ] Update Progress: 2132/2371 symbols completed. TRTX took 0.9s. Estimated remaining: 1m 18s. Rate: 184.7 symbols/min [2025-09-29T02:08:54.284890] [INFO ] [MAIN ] TRV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:54.296673] [INFO ] [MAIN ] Update Progress: 2133/2371 symbols completed. TRP took 1.1s. Estimated remaining: 1m 17s. Rate: 184.7 symbols/min [2025-09-29T02:08:54.561735] [DEBUG] [LOCAL ] TRU: Loaded 51965 existing records from primary storage. [2025-09-29T02:08:54.607806] [INFO ] [MAIN ] TRU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:54.644988] [INFO ] [MAIN ] Update Progress: 2134/2371 symbols completed. TRU took 0.9s. Estimated remaining: 1m 17s. Rate: 184.7 symbols/min [2025-09-29T02:08:54.660914] [INFO ] [MAIN ] TS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:54.753824] [INFO ] [MAIN ] TSE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:54.887161] [DEBUG] [LOCAL ] TRV: Loaded 48744 existing records from primary storage. [2025-09-29T02:08:54.899308] [INFO ] [MAIN ] TRV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:54.915129] [INFO ] [MAIN ] Update Progress: 2135/2371 symbols completed. TRV took 0.9s. Estimated remaining: 1m 17s. Rate: 184.7 symbols/min [2025-09-29T02:08:55.049282] [INFO ] [MAIN ] TSI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:55.145703] [DEBUG] [LOCAL ] TS: Loaded 52425 existing records from primary storage. [2025-09-29T02:08:55.151074] [INFO ] [MAIN ] TS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:55.196968] [DEBUG] [LOCAL ] TSE: Loaded 29074 existing records from primary storage. [2025-09-29T02:08:55.233769] [INFO ] [MAIN ] TSLX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:55.234523] [INFO ] [MAIN ] TSE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:55.229120] [INFO ] [MAIN ] Update Progress: 2136/2371 symbols completed. TS took 1.0s. Estimated remaining: 1m 16s. Rate: 184.7 symbols/min [2025-09-29T02:08:55.240318] [INFO ] [MAIN ] Update Progress: 2137/2371 symbols completed. TSE took 0.9s. Estimated remaining: 1m 16s. Rate: 184.8 symbols/min [2025-09-29T02:08:55.251384] [DEBUG] [LOCAL ] TSI: Loaded 8090 existing records from primary storage. [2025-09-29T02:08:55.298093] [INFO ] [MAIN ] TSI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:55.330076] [INFO ] [MAIN ] Update Progress: 2138/2371 symbols completed. TSI took 0.7s. Estimated remaining: 1m 16s. Rate: 184.9 symbols/min [2025-09-29T02:08:55.782258] [INFO ] [MAIN ] TSN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:55.838441] [DEBUG] [LOCAL ] TSLX: Loaded 35752 existing records from primary storage. [2025-09-29T02:08:55.857404] [INFO ] [MAIN ] TSM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:55.861903] [INFO ] [MAIN ] TSLX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:55.862460] [INFO ] [MAIN ] Update Progress: 2139/2371 symbols completed. TSLX took 0.9s. Estimated remaining: 1m 15s. Rate: 184.8 symbols/min [2025-09-29T02:08:55.861215] [INFO ] [MAIN ] TSQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:56.032808] [DEBUG] [LOCAL ] TSQ: Loaded 12195 existing records from primary storage. [2025-09-29T02:08:56.069058] [INFO ] [MAIN ] TT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:56.064590] [INFO ] [MAIN ] TSQ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:56.069742] [INFO ] [MAIN ] Update Progress: 2140/2371 symbols completed. TSQ took 0.7s. Estimated remaining: 1m 15s. Rate: 184.9 symbols/min [2025-09-29T02:08:56.288261] [DEBUG] [LOCAL ] TSN: Loaded 53638 existing records from primary storage. [2025-09-29T02:08:56.300315] [INFO ] [MAIN ] TSN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:56.315933] [INFO ] [MAIN ] Update Progress: 2141/2371 symbols completed. TSN took 1.1s. Estimated remaining: 1m 15s. Rate: 184.9 symbols/min [2025-09-29T02:08:56.320537] [INFO ] [MAIN ] TTAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:56.354129] [DEBUG] [LOCAL ] TTAM: No existing data file found in primary storage. [2025-09-29T02:08:56.389604] [DEBUG] [LOCAL ] TSM: Loaded 54599 existing records from primary storage. [2025-09-29T02:08:56.395153] [WARN ] [MAIN ] TTAM: No existing data found, performing full refresh instead. [2025-09-29T02:08:56.437371] [INFO ] [MAIN ] TSM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:56.453793] [INFO ] [MAIN ] Update Progress: 2142/2371 symbols completed. TSM took 1.2s. Estimated remaining: 1m 14s. Rate: 184.9 symbols/min [2025-09-29T02:08:56.437218] [INFO ] [MAIN ] TTAM: Wiping existing primary data before full refresh. [2025-09-29T02:08:56.493578] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-09-29T02:08:56.597389] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-09-29T02:08:56.637008] [DEBUG] [LOCAL ] TT: Loaded 48538 existing records from primary storage. [2025-09-29T02:08:56.669981] [INFO ] [MAIN ] TT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:56.652695] [INFO ] [MAIN ] TTAM: Starting full primary refresh. [2025-09-29T02:08:56.695192] [INFO ] [MAIN ] TTC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:56.695364] [INFO ] [MAIN ] Update Progress: 2143/2371 symbols completed. TT took 0.8s. Estimated remaining: 1m 14s. Rate: 185.0 symbols/min [2025-09-29T02:08:57.013438] [INFO ] [MAIN ] TTE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:57.195678] [INFO ] [MAIN ] TTI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:57.256467] [DEBUG] [LOCAL ] TTC: Loaded 43005 existing records from primary storage. [2025-09-29T02:08:57.287333] [INFO ] [MAIN ] TTC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:57.305390] [INFO ] [MAIN ] Update Progress: 2144/2371 symbols completed. TTC took 1.0s. Estimated remaining: 1m 14s. Rate: 184.9 symbols/min [2025-09-29T02:08:57.595749] [DEBUG] [LOCAL ] TTE: Loaded 52395 existing records from primary storage. [2025-09-29T02:08:57.607148] [INFO ] [REMOTE ] TTAM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:08:57.607995] [INFO ] [MAIN ] TTE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:57.607791] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2024-12. [2025-09-29T02:08:57.614435] [DEBUG] [LOCAL ] TTI: Loaded 46112 existing records from primary storage. [2025-09-29T02:08:57.613441] [INFO ] [MAIN ] Update Progress: 2145/2371 symbols completed. TTE took 1.2s. Estimated remaining: 1m 13s. Rate: 184.9 symbols/min [2025-09-29T02:08:57.653967] [INFO ] [MAIN ] TTI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:57.709835] [INFO ] [MAIN ] Update Progress: 2146/2371 symbols completed. TTI took 1.0s. Estimated remaining: 1m 13s. Rate: 184.9 symbols/min [2025-09-29T02:08:57.733791] [INFO ] [MAIN ] TU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:57.866159] [DEBUG] [REMOTE ] TTAM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:08:57.945082] [WARN ] [REMOTE ] TTAM: No data returned for month 2024-12 [2025-09-29T02:08:57.980435] [FATAL] [REMOTE ] TTAM: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:08:58.001021] [INFO ] [MAIN ] TUYA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:58.001827] [FATAL] [MAIN ] TTAM: Failed to fetch primary data. [2025-09-29T02:08:58.018063] [WARN ] [MAIN ] TTAM: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:08:58.028803] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-09-29T02:08:58.062597] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-09-29T02:08:58.084486] [INFO ] [MAIN ] TV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:58.084746] [INFO ] [LOCAL ] TTAM: Starting deletion of derivative data. [2025-09-29T02:08:58.085407] [DEBUG] [LOCAL ] TTAM: No derivative data file found to delete. [2025-09-29T02:08:58.085499] [INFO ] [MAIN ] Update Progress: 2147/2371 symbols completed. TTAM took 2.0s. Estimated remaining: 1m 13s. Rate: 184.9 symbols/min [2025-09-29T02:08:58.304265] [DEBUG] [LOCAL ] TU: Loaded 50606 existing records from primary storage. [2025-09-29T02:08:58.333102] [INFO ] [MAIN ] TU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:58.345600] [DEBUG] [LOCAL ] TUYA: Loaded 47185 existing records from primary storage. [2025-09-29T02:08:58.367493] [INFO ] [MAIN ] TVC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:58.345888] [INFO ] [MAIN ] Update Progress: 2148/2371 symbols completed. TU took 1.0s. Estimated remaining: 1m 12s. Rate: 184.9 symbols/min [2025-09-29T02:08:58.368138] [INFO ] [MAIN ] TUYA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:58.374073] [INFO ] [MAIN ] Update Progress: 2149/2371 symbols completed. TUYA took 0.7s. Estimated remaining: 1m 12s. Rate: 185.0 symbols/min [2025-09-29T02:08:58.516405] [DEBUG] [LOCAL ] TVC: Loaded 3466 existing records from primary storage. [2025-09-29T02:08:58.568859] [INFO ] [MAIN ] TVC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:58.546430] [DEBUG] [LOCAL ] TV: Loaded 43514 existing records from primary storage. [2025-09-29T02:08:58.605245] [INFO ] [MAIN ] Update Progress: 2150/2371 symbols completed. TVC took 0.5s. Estimated remaining: 1m 12s. Rate: 185.0 symbols/min [2025-09-29T02:08:58.708019] [INFO ] [MAIN ] TVE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:58.723915] [INFO ] [MAIN ] TV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:58.802864] [INFO ] [MAIN ] Update Progress: 2151/2371 symbols completed. TV took 1.0s. Estimated remaining: 1m 11s. Rate: 185.1 symbols/min [2025-09-29T02:08:58.917365] [DEBUG] [LOCAL ] TVE: Loaded 2795 existing records from primary storage. [2025-09-29T02:08:58.974483] [INFO ] [MAIN ] TWI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:58.990520] [INFO ] [MAIN ] TVE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:59.017221] [INFO ] [MAIN ] Update Progress: 2152/2371 symbols completed. TVE took 0.6s. Estimated remaining: 1m 11s. Rate: 185.1 symbols/min [2025-09-29T02:08:59.151705] [INFO ] [MAIN ] TWLO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:59.312565] [INFO ] [MAIN ] TWN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:59.389927] [DEBUG] [LOCAL ] TWN: Loaded 3250 existing records from primary storage. [2025-09-29T02:08:59.426343] [INFO ] [MAIN ] TWO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:59.436624] [INFO ] [MAIN ] TWN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:59.438814] [INFO ] [MAIN ] Update Progress: 2153/2371 symbols completed. TWN took 0.6s. Estimated remaining: 1m 11s. Rate: 185.1 symbols/min [2025-09-29T02:08:59.439577] [DEBUG] [LOCAL ] TWI: Loaded 34981 existing records from primary storage. [2025-09-29T02:08:59.480787] [INFO ] [MAIN ] TWI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:59.487214] [INFO ] [MAIN ] Update Progress: 2154/2371 symbols completed. TWI took 1.1s. Estimated remaining: 1m 10s. Rate: 185.2 symbols/min [2025-09-29T02:08:59.849112] [INFO ] [MAIN ] TWOD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:59.864581] [DEBUG] [LOCAL ] TWLO: Loaded 53501 existing records from primary storage. [2025-09-29T02:08:59.895583] [DEBUG] [LOCAL ] TWOD: No existing data file found in primary storage. [2025-09-29T02:08:59.937987] [WARN ] [MAIN ] TWOD: No existing data found, performing full refresh instead. [2025-09-29T02:08:59.937878] [INFO ] [MAIN ] TWLO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:59.940790] [DEBUG] [LOCAL ] TWO: Loaded 49002 existing records from primary storage. [2025-09-29T02:08:59.939549] [INFO ] [MAIN ] TX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:08:59.940987] [INFO ] [MAIN ] Update Progress: 2155/2371 symbols completed. TWLO took 1.2s. Estimated remaining: 1m 10s. Rate: 185.1 symbols/min [2025-09-29T02:08:59.941245] [INFO ] [MAIN ] TWO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:08:59.941390] [INFO ] [MAIN ] TWOD: Wiping existing primary data before full refresh. [2025-09-29T02:08:59.947342] [INFO ] [MAIN ] Update Progress: 2156/2371 symbols completed. TWO took 0.9s. Estimated remaining: 1m 10s. Rate: 185.2 symbols/min [2025-09-29T02:08:59.947189] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-09-29T02:08:59.996567] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-09-29T02:09:00.019325] [INFO ] [MAIN ] TWOD: Starting full primary refresh. [2025-09-29T02:09:00.385385] [DEBUG] [LOCAL ] TX: Loaded 23932 existing records from primary storage. [2025-09-29T02:09:00.496866] [INFO ] [MAIN ] TX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:00.531581] [INFO ] [MAIN ] TXO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:00.491523] [INFO ] [MAIN ] TXNM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:00.531947] [INFO ] [MAIN ] Update Progress: 2157/2371 symbols completed. TX took 1.0s. Estimated remaining: 1m 9s. Rate: 185.1 symbols/min [2025-09-29T02:09:00.711173] [DEBUG] [LOCAL ] TXO: Loaded 19060 existing records from primary storage. [2025-09-29T02:09:00.749226] [INFO ] [MAIN ] TXO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:00.781695] [INFO ] [MAIN ] Update Progress: 2158/2371 symbols completed. TXO took 0.8s. Estimated remaining: 1m 9s. Rate: 185.2 symbols/min [2025-09-29T02:09:00.788045] [INFO ] [REMOTE ] TWOD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:09:00.800388] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2024-12. [2025-09-29T02:09:00.821030] [DEBUG] [LOCAL ] TXNM: Loaded 44463 existing records from primary storage. [2025-09-29T02:09:00.821445] [INFO ] [MAIN ] TXNM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:00.821909] [INFO ] [MAIN ] Update Progress: 2159/2371 symbols completed. TXNM took 0.9s. Estimated remaining: 1m 9s. Rate: 185.2 symbols/min [2025-09-29T02:09:00.922326] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:09:00.922722] [WARN ] [REMOTE ] TWOD: No data returned for month 2024-12 [2025-09-29T02:09:00.922810] [FATAL] [REMOTE ] TWOD: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:09:00.922884] [FATAL] [MAIN ] TWOD: Failed to fetch primary data. [2025-09-29T02:09:00.922953] [WARN ] [MAIN ] TWOD: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:09:00.923032] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-09-29T02:09:00.923156] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-09-29T02:09:00.923230] [INFO ] [LOCAL ] TWOD: Starting deletion of derivative data. [2025-09-29T02:09:00.923321] [DEBUG] [LOCAL ] TWOD: No derivative data file found to delete. [2025-09-29T02:09:00.923406] [INFO ] [MAIN ] Update Progress: 2160/2371 symbols completed. TWOD took 1.5s. Estimated remaining: 1m 8s. Rate: 185.3 symbols/min [2025-09-29T02:09:01.618388] [INFO ] [MAIN ] TXT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:01.716625] [INFO ] [MAIN ] TYL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:01.777318] [INFO ] [MAIN ] TY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:01.779166] [INFO ] [MAIN ] TYG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:01.819058] [DEBUG] [LOCAL ] TY: Loaded 7756 existing records from primary storage. [2025-09-29T02:09:01.821308] [DEBUG] [LOCAL ] TYG: Loaded 14410 existing records from primary storage. [2025-09-29T02:09:01.821609] [INFO ] [MAIN ] TY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:01.822170] [INFO ] [MAIN ] Update Progress: 2161/2371 symbols completed. TY took 0.9s. Estimated remaining: 1m 8s. Rate: 185.1 symbols/min [2025-09-29T02:09:01.822283] [INFO ] [MAIN ] TYG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:01.845425] [INFO ] [MAIN ] Update Progress: 2162/2371 symbols completed. TYG took 0.9s. Estimated remaining: 1m 8s. Rate: 185.2 symbols/min [2025-09-29T02:09:02.063890] [DEBUG] [LOCAL ] TYL: Loaded 22582 existing records from primary storage. [2025-09-29T02:09:02.177999] [INFO ] [MAIN ] U: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:02.128400] [INFO ] [MAIN ] TYL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:02.196945] [INFO ] [MAIN ] Update Progress: 2163/2371 symbols completed. TYL took 1.3s. Estimated remaining: 1m 7s. Rate: 185.2 symbols/min [2025-09-29T02:09:02.258584] [DEBUG] [LOCAL ] TXT: Loaded 50470 existing records from primary storage. [2025-09-29T02:09:02.325198] [INFO ] [MAIN ] UA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:02.356196] [INFO ] [MAIN ] TXT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:02.377713] [INFO ] [MAIN ] Update Progress: 2164/2371 symbols completed. TXT took 1.5s. Estimated remaining: 1m 7s. Rate: 185.2 symbols/min [2025-09-29T02:09:02.606553] [INFO ] [MAIN ] UAA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:02.731236] [INFO ] [MAIN ] UAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:02.749738] [DEBUG] [LOCAL ] U: Loaded 54579 existing records from primary storage. [2025-09-29T02:09:02.752193] [INFO ] [MAIN ] U: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:02.765150] [INFO ] [MAIN ] Update Progress: 2165/2371 symbols completed. U took 0.9s. Estimated remaining: 1m 7s. Rate: 185.2 symbols/min [2025-09-29T02:09:02.790908] [DEBUG] [LOCAL ] UA: Loaded 51189 existing records from primary storage. [2025-09-29T02:09:02.817975] [INFO ] [MAIN ] UA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:02.843694] [DEBUG] [LOCAL ] UAN: Loaded 5507 existing records from primary storage. [2025-09-29T02:09:02.843971] [INFO ] [MAIN ] Update Progress: 2166/2371 symbols completed. UA took 1.0s. Estimated remaining: 1m 6s. Rate: 185.3 symbols/min [2025-09-29T02:09:02.844206] [INFO ] [MAIN ] UAN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:02.904455] [INFO ] [MAIN ] Update Progress: 2167/2371 symbols completed. UAN took 0.5s. Estimated remaining: 1m 6s. Rate: 185.4 symbols/min [2025-09-29T02:09:03.173076] [INFO ] [MAIN ] UBER: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:03.284184] [DEBUG] [LOCAL ] UAA: Loaded 54287 existing records from primary storage. [2025-09-29T02:09:03.343423] [INFO ] [MAIN ] UAA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:03.381457] [INFO ] [MAIN ] Update Progress: 2168/2371 symbols completed. UAA took 1.2s. Estimated remaining: 1m 6s. Rate: 185.3 symbols/min [2025-09-29T02:09:03.413976] [INFO ] [MAIN ] UBS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:03.451178] [INFO ] [MAIN ] UCB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:03.679985] [INFO ] [MAIN ] UDR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:03.718546] [DEBUG] [LOCAL ] UBER: Loaded 54586 existing records from primary storage. [2025-09-29T02:09:03.732261] [INFO ] [MAIN ] UBER: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:03.733774] [DEBUG] [LOCAL ] UCB: Loaded 38555 existing records from primary storage. [2025-09-29T02:09:03.735052] [INFO ] [MAIN ] Update Progress: 2169/2371 symbols completed. UBER took 1.0s. Estimated remaining: 1m 5s. Rate: 185.3 symbols/min [2025-09-29T02:09:03.736934] [INFO ] [MAIN ] UCB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:03.769968] [INFO ] [MAIN ] Update Progress: 2170/2371 symbols completed. UCB took 0.8s. Estimated remaining: 1m 5s. Rate: 185.4 symbols/min [2025-09-29T02:09:03.827736] [DEBUG] [LOCAL ] UBS: Loaded 53187 existing records from primary storage. [2025-09-29T02:09:03.885912] [INFO ] [MAIN ] UBS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:03.914973] [INFO ] [MAIN ] Update Progress: 2171/2371 symbols completed. UBS took 1.1s. Estimated remaining: 1m 5s. Rate: 185.4 symbols/min [2025-09-29T02:09:04.176586] [INFO ] [MAIN ] UE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:04.313984] [INFO ] [MAIN ] UFI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:04.332274] [DEBUG] [LOCAL ] UDR: Loaded 52555 existing records from primary storage. [2025-09-29T02:09:04.344599] [INFO ] [MAIN ] UDR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:04.368471] [INFO ] [MAIN ] Update Progress: 2172/2371 symbols completed. UDR took 1.0s. Estimated remaining: 1m 4s. Rate: 185.4 symbols/min [2025-09-29T02:09:04.475464] [DEBUG] [LOCAL ] UFI: Loaded 8229 existing records from primary storage. [2025-09-29T02:09:04.481360] [INFO ] [MAIN ] UFI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:04.483449] [INFO ] [MAIN ] UGI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:04.501429] [INFO ] [MAIN ] Update Progress: 2173/2371 symbols completed. UFI took 0.7s. Estimated remaining: 1m 4s. Rate: 185.5 symbols/min [2025-09-29T02:09:04.623532] [DEBUG] [LOCAL ] UE: Loaded 43513 existing records from primary storage. [2025-09-29T02:09:04.673285] [INFO ] [MAIN ] UE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:04.737258] [INFO ] [MAIN ] Update Progress: 2174/2371 symbols completed. UE took 1.0s. Estimated remaining: 1m 4s. Rate: 185.5 symbols/min [2025-09-29T02:09:04.763364] [INFO ] [MAIN ] UGP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:05.007871] [INFO ] [MAIN ] UHAL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:05.081103] [DEBUG] [LOCAL ] UGI: Loaded 51290 existing records from primary storage. [2025-09-29T02:09:05.115668] [INFO ] [MAIN ] UGI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:05.102782] [INFO ] [MAIN ] UHS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:05.116136] [INFO ] [MAIN ] Update Progress: 2175/2371 symbols completed. UGI took 1.2s. Estimated remaining: 1m 3s. Rate: 185.5 symbols/min [2025-09-29T02:09:05.122932] [DEBUG] [LOCAL ] UGP: Loaded 43319 existing records from primary storage. [2025-09-29T02:09:05.155430] [INFO ] [MAIN ] UGP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:05.196308] [INFO ] [MAIN ] Update Progress: 2176/2371 symbols completed. UGP took 0.8s. Estimated remaining: 1m 3s. Rate: 185.5 symbols/min [2025-09-29T02:09:05.292311] [DEBUG] [LOCAL ] UHAL: Loaded 16817 existing records from primary storage. [2025-09-29T02:09:05.403120] [INFO ] [MAIN ] UHAL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:05.456156] [INFO ] [MAIN ] UHT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:05.477031] [INFO ] [MAIN ] Update Progress: 2177/2371 symbols completed. UHAL took 0.9s. Estimated remaining: 1m 3s. Rate: 185.5 symbols/min [2025-09-29T02:09:05.664716] [INFO ] [MAIN ] UI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:05.683195] [DEBUG] [LOCAL ] UHS: Loaded 41674 existing records from primary storage. [2025-09-29T02:09:05.713780] [INFO ] [MAIN ] UHS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:05.713493] [DEBUG] [LOCAL ] UHT: Loaded 10131 existing records from primary storage. [2025-09-29T02:09:05.726023] [INFO ] [MAIN ] UHT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:05.725136] [INFO ] [MAIN ] Update Progress: 2178/2371 symbols completed. UHS took 1.0s. Estimated remaining: 1m 2s. Rate: 185.6 symbols/min [2025-09-29T02:09:05.765310] [INFO ] [MAIN ] Update Progress: 2179/2371 symbols completed. UHT took 0.6s. Estimated remaining: 1m 2s. Rate: 185.6 symbols/min [2025-09-29T02:09:05.961393] [DEBUG] [LOCAL ] UI: Loaded 13008 existing records from primary storage. [2025-09-29T02:09:06.057541] [INFO ] [MAIN ] UI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:06.093444] [INFO ] [MAIN ] Update Progress: 2180/2371 symbols completed. UI took 0.9s. Estimated remaining: 1m 2s. Rate: 185.6 symbols/min [2025-09-29T02:09:06.131256] [INFO ] [MAIN ] UIS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:06.454498] [INFO ] [MAIN ] UL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:06.614829] [INFO ] [MAIN ] ULS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:06.710831] [DEBUG] [LOCAL ] UIS: Loaded 37552 existing records from primary storage. [2025-09-29T02:09:06.711930] [INFO ] [MAIN ] UIS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:06.744868] [INFO ] [MAIN ] Update Progress: 2181/2371 symbols completed. UIS took 1.3s. Estimated remaining: 1m 1s. Rate: 185.5 symbols/min [2025-09-29T02:09:06.744425] [INFO ] [MAIN ] UMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:06.991051] [DEBUG] [LOCAL ] UL: Loaded 53843 existing records from primary storage. [2025-09-29T02:09:07.034874] [DEBUG] [LOCAL ] ULS: Loaded 39769 existing records from primary storage. [2025-09-29T02:09:07.035131] [INFO ] [MAIN ] UL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:07.040495] [INFO ] [MAIN ] Update Progress: 2182/2371 symbols completed. UL took 1.3s. Estimated remaining: 1m 1s. Rate: 185.6 symbols/min [2025-09-29T02:09:07.039901] [INFO ] [MAIN ] UMH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:07.046580] [INFO ] [MAIN ] ULS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:07.090808] [INFO ] [MAIN ] Update Progress: 2183/2371 symbols completed. ULS took 1.3s. Estimated remaining: 1m 1s. Rate: 185.6 symbols/min [2025-09-29T02:09:07.213697] [DEBUG] [LOCAL ] UMC: Loaded 53490 existing records from primary storage. [2025-09-29T02:09:07.259628] [INFO ] [MAIN ] UMC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:07.359164] [INFO ] [MAIN ] Update Progress: 2184/2371 symbols completed. UMC took 1.2s. Estimated remaining: 1m 0s. Rate: 185.6 symbols/min [2025-09-29T02:09:07.436662] [INFO ] [MAIN ] UNF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:07.475189] [DEBUG] [LOCAL ] UMH: Loaded 34078 existing records from primary storage. [2025-09-29T02:09:07.535454] [INFO ] [MAIN ] UMH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:07.581574] [INFO ] [MAIN ] UNFI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:07.586904] [INFO ] [MAIN ] Update Progress: 2185/2371 symbols completed. UMH took 0.8s. Estimated remaining: 1m 0s. Rate: 185.7 symbols/min [2025-09-29T02:09:07.782431] [INFO ] [MAIN ] UNH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:07.806022] [DEBUG] [LOCAL ] UNF: Loaded 12048 existing records from primary storage. [2025-09-29T02:09:07.820107] [INFO ] [MAIN ] UNF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:07.825064] [INFO ] [MAIN ] Update Progress: 2186/2371 symbols completed. UNF took 0.8s. Estimated remaining: 59.8s. Rate: 185.7 symbols/min [2025-09-29T02:09:07.952787] [INFO ] [MAIN ] UNM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:08.055308] [DEBUG] [LOCAL ] UNFI: Loaded 42528 existing records from primary storage. [2025-09-29T02:09:08.114586] [INFO ] [MAIN ] UNFI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:08.152828] [INFO ] [MAIN ] UNMA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:08.152996] [INFO ] [MAIN ] Update Progress: 2187/2371 symbols completed. UNFI took 1.0s. Estimated remaining: 59.5s. Rate: 185.7 symbols/min [2025-09-29T02:09:08.247078] [DEBUG] [LOCAL ] UNMA: Loaded 3627 existing records from primary storage. [2025-09-29T02:09:08.292836] [INFO ] [MAIN ] UNMA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:08.307879] [INFO ] [MAIN ] Update Progress: 2188/2371 symbols completed. UNMA took 0.5s. Estimated remaining: 59.1s. Rate: 185.7 symbols/min [2025-09-29T02:09:08.351974] [DEBUG] [LOCAL ] UNM: Loaded 49368 existing records from primary storage. [2025-09-29T02:09:08.328920] [DEBUG] [LOCAL ] UNH: Loaded 54574 existing records from primary storage. [2025-09-29T02:09:08.439835] [INFO ] [MAIN ] UNP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:08.418852] [INFO ] [MAIN ] UNM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:08.445534] [INFO ] [MAIN ] UNH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:08.450897] [INFO ] [MAIN ] Update Progress: 2189/2371 symbols completed. UNH took 1.1s. Estimated remaining: 58.8s. Rate: 185.8 symbols/min [2025-09-29T02:09:08.473978] [INFO ] [MAIN ] Update Progress: 2190/2371 symbols completed. UNM took 0.8s. Estimated remaining: 58.4s. Rate: 185.9 symbols/min [2025-09-29T02:09:08.879053] [INFO ] [MAIN ] UP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:08.984574] [INFO ] [MAIN ] URI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:09.037501] [INFO ] [MAIN ] UPS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:09.061746] [DEBUG] [LOCAL ] UNP: Loaded 54030 existing records from primary storage. [2025-09-29T02:09:09.062584] [INFO ] [MAIN ] UNP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:09.062762] [INFO ] [MAIN ] Update Progress: 2191/2371 symbols completed. UNP took 0.9s. Estimated remaining: 58.1s. Rate: 185.8 symbols/min [2025-09-29T02:09:09.312888] [INFO ] [MAIN ] USA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:09.328738] [DEBUG] [LOCAL ] UP: Loaded 43857 existing records from primary storage. [2025-09-29T02:09:09.330112] [DEBUG] [LOCAL ] URI: Loaded 36669 existing records from primary storage. [2025-09-29T02:09:09.347227] [INFO ] [MAIN ] UP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:09.347419] [INFO ] [MAIN ] Update Progress: 2192/2371 symbols completed. UP took 1.0s. Estimated remaining: 57.8s. Rate: 185.8 symbols/min [2025-09-29T02:09:09.347831] [INFO ] [MAIN ] URI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:09.373455] [INFO ] [MAIN ] Update Progress: 2193/2371 symbols completed. URI took 0.8s. Estimated remaining: 57.5s. Rate: 185.9 symbols/min [2025-09-29T02:09:09.521145] [DEBUG] [LOCAL ] UPS: Loaded 54490 existing records from primary storage. [2025-09-29T02:09:09.601610] [INFO ] [MAIN ] UPS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:09.665399] [INFO ] [MAIN ] Update Progress: 2194/2371 symbols completed. UPS took 1.2s. Estimated remaining: 57.1s. Rate: 185.9 symbols/min [2025-09-29T02:09:09.757881] [DEBUG] [LOCAL ] USA: Loaded 36524 existing records from primary storage. [2025-09-29T02:09:09.750199] [INFO ] [MAIN ] USAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:09.790760] [INFO ] [MAIN ] USA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:09.796460] [INFO ] [MAIN ] Update Progress: 2195/2371 symbols completed. USA took 0.7s. Estimated remaining: 56.8s. Rate: 185.9 symbols/min [2025-09-29T02:09:09.945134] [INFO ] [MAIN ] USB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:10.221841] [DEBUG] [LOCAL ] USAC: Loaded 23060 existing records from primary storage. [2025-09-29T02:09:10.230096] [INFO ] [MAIN ] USFD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:10.255667] [INFO ] [MAIN ] USNA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:10.256171] [INFO ] [MAIN ] USAC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:10.258214] [INFO ] [MAIN ] Update Progress: 2196/2371 symbols completed. USAC took 0.9s. Estimated remaining: 56.5s. Rate: 185.9 symbols/min [2025-09-29T02:09:10.474472] [DEBUG] [LOCAL ] USNA: Loaded 18368 existing records from primary storage. [2025-09-29T02:09:10.511485] [INFO ] [MAIN ] USPH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:10.512753] [INFO ] [MAIN ] USNA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:10.513977] [DEBUG] [LOCAL ] USB: Loaded 54468 existing records from primary storage. [2025-09-29T02:09:10.515116] [INFO ] [MAIN ] Update Progress: 2197/2371 symbols completed. USNA took 0.7s. Estimated remaining: 56.2s. Rate: 185.9 symbols/min [2025-09-29T02:09:10.533052] [INFO ] [MAIN ] USB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:10.533874] [INFO ] [MAIN ] Update Progress: 2198/2371 symbols completed. USB took 1.2s. Estimated remaining: 55.8s. Rate: 186.0 symbols/min [2025-09-29T02:09:10.551363] [DEBUG] [LOCAL ] USPH: Loaded 16827 existing records from primary storage. [2025-09-29T02:09:10.551910] [INFO ] [MAIN ] USPH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:10.552092] [INFO ] [MAIN ] Update Progress: 2199/2371 symbols completed. USPH took 0.3s. Estimated remaining: 55.5s. Rate: 186.1 symbols/min [2025-09-29T02:09:10.568328] [DEBUG] [LOCAL ] USFD: Loaded 51959 existing records from primary storage. [2025-09-29T02:09:10.568832] [INFO ] [MAIN ] USFD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:10.569638] [INFO ] [MAIN ] Update Progress: 2200/2371 symbols completed. USFD took 0.9s. Estimated remaining: 55.1s. Rate: 186.2 symbols/min [2025-09-29T02:09:11.167716] [INFO ] [MAIN ] UTL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:11.321124] [INFO ] [MAIN ] UTZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:11.360101] [INFO ] [MAIN ] UTF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:11.365499] [INFO ] [MAIN ] UTI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:11.380004] [DEBUG] [LOCAL ] UTL: Loaded 11273 existing records from primary storage. [2025-09-29T02:09:11.380386] [INFO ] [MAIN ] UTL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:11.381325] [INFO ] [MAIN ] Update Progress: 2201/2371 symbols completed. UTL took 0.8s. Estimated remaining: 54.8s. Rate: 186.0 symbols/min [2025-09-29T02:09:11.562366] [DEBUG] [LOCAL ] UTF: Loaded 29200 existing records from primary storage. [2025-09-29T02:09:11.563036] [INFO ] [MAIN ] UTF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:11.563462] [INFO ] [MAIN ] Update Progress: 2202/2371 symbols completed. UTF took 1.0s. Estimated remaining: 54.5s. Rate: 186.1 symbols/min [2025-09-29T02:09:11.706754] [DEBUG] [LOCAL ] UTZ: Loaded 45341 existing records from primary storage. [2025-09-29T02:09:11.700365] [INFO ] [MAIN ] UVE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:11.713544] [DEBUG] [LOCAL ] UTI: Loaded 41146 existing records from primary storage. [2025-09-29T02:09:11.712545] [INFO ] [MAIN ] UTZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:11.731945] [INFO ] [MAIN ] UTI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:11.732137] [INFO ] [MAIN ] Update Progress: 2203/2371 symbols completed. UTZ took 1.2s. Estimated remaining: 54.2s. Rate: 186.1 symbols/min [2025-09-29T02:09:11.753856] [INFO ] [MAIN ] Update Progress: 2204/2371 symbols completed. UTI took 1.2s. Estimated remaining: 53.8s. Rate: 186.2 symbols/min [2025-09-29T02:09:12.083893] [DEBUG] [LOCAL ] UVE: Loaded 22124 existing records from primary storage. [2025-09-29T02:09:12.110004] [INFO ] [MAIN ] UVE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:12.111078] [INFO ] [MAIN ] UVV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:12.121931] [INFO ] [MAIN ] Update Progress: 2205/2371 symbols completed. UVE took 0.7s. Estimated remaining: 53.5s. Rate: 186.2 symbols/min [2025-09-29T02:09:12.290088] [INFO ] [MAIN ] UWMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:12.309250] [INFO ] [MAIN ] UZD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:12.441553] [DEBUG] [LOCAL ] UVV: Loaded 22660 existing records from primary storage. [2025-09-29T02:09:12.442095] [DEBUG] [LOCAL ] UZD: Loaded 6455 existing records from primary storage. [2025-09-29T02:09:12.502189] [INFO ] [MAIN ] UZE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:12.502623] [INFO ] [MAIN ] UZD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:12.503154] [INFO ] [MAIN ] Update Progress: 2206/2371 symbols completed. UZD took 0.7s. Estimated remaining: 53.2s. Rate: 186.2 symbols/min [2025-09-29T02:09:12.504314] [INFO ] [MAIN ] UVV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:12.555433] [INFO ] [MAIN ] Update Progress: 2207/2371 symbols completed. UVV took 1.0s. Estimated remaining: 52.8s. Rate: 186.2 symbols/min [2025-09-29T02:09:12.711820] [DEBUG] [LOCAL ] UZE: Loaded 7528 existing records from primary storage. [2025-09-29T02:09:12.768795] [DEBUG] [LOCAL ] UWMC: Loaded 53516 existing records from primary storage. [2025-09-29T02:09:12.766911] [INFO ] [MAIN ] UZE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:12.821474] [INFO ] [MAIN ] UWMC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:12.815758] [INFO ] [MAIN ] Update Progress: 2208/2371 symbols completed. UZE took 0.6s. Estimated remaining: 52.5s. Rate: 186.2 symbols/min [2025-09-29T02:09:12.837197] [INFO ] [MAIN ] Update Progress: 2209/2371 symbols completed. UWMC took 1.1s. Estimated remaining: 52.2s. Rate: 186.3 symbols/min [2025-09-29T02:09:13.100630] [INFO ] [MAIN ] V: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:13.016559] [INFO ] [MAIN ] UZF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:13.324774] [INFO ] [MAIN ] VAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:13.344336] [DEBUG] [LOCAL ] UZF: Loaded 6574 existing records from primary storage. [2025-09-29T02:09:13.370999] [INFO ] [MAIN ] UZF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:13.371210] [INFO ] [MAIN ] Update Progress: 2210/2371 symbols completed. UZF took 0.9s. Estimated remaining: 51.9s. Rate: 186.3 symbols/min [2025-09-29T02:09:13.444850] [INFO ] [MAIN ] VAL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:13.663212] [INFO ] [MAIN ] VALE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:13.665295] [DEBUG] [LOCAL ] V: Loaded 54535 existing records from primary storage. [2025-09-29T02:09:13.675307] [INFO ] [MAIN ] V: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:13.677380] [INFO ] [MAIN ] Update Progress: 2211/2371 symbols completed. V took 1.1s. Estimated remaining: 51.5s. Rate: 186.3 symbols/min [2025-09-29T02:09:13.678381] [DEBUG] [LOCAL ] VAC: Loaded 35026 existing records from primary storage. [2025-09-29T02:09:13.684535] [INFO ] [MAIN ] VAC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:13.709083] [INFO ] [MAIN ] Update Progress: 2212/2371 symbols completed. VAC took 0.9s. Estimated remaining: 51.2s. Rate: 186.3 symbols/min [2025-09-29T02:09:13.946752] [DEBUG] [LOCAL ] VAL: Loaded 51142 existing records from primary storage. [2025-09-29T02:09:13.991214] [INFO ] [MAIN ] VAL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:14.002775] [INFO ] [MAIN ] Update Progress: 2213/2371 symbols completed. VAL took 1.1s. Estimated remaining: 50.9s. Rate: 186.4 symbols/min [2025-09-29T02:09:14.126871] [INFO ] [MAIN ] VATE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:14.237479] [INFO ] [MAIN ] VBF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:14.256202] [DEBUG] [LOCAL ] VALE: Loaded 54474 existing records from primary storage. [2025-09-29T02:09:14.296108] [DEBUG] [LOCAL ] VATE: Loaded 5658 existing records from primary storage. [2025-09-29T02:09:14.291627] [INFO ] [MAIN ] VALE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:14.296672] [INFO ] [MAIN ] Update Progress: 2214/2371 symbols completed. VALE took 0.9s. Estimated remaining: 50.5s. Rate: 186.4 symbols/min [2025-09-29T02:09:14.296903] [INFO ] [MAIN ] VATE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:14.334729] [INFO ] [MAIN ] Update Progress: 2215/2371 symbols completed. VATE took 0.7s. Estimated remaining: 50.2s. Rate: 186.4 symbols/min [2025-09-29T02:09:14.420575] [INFO ] [MAIN ] VCV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:14.544995] [DEBUG] [LOCAL ] VBF: Loaded 7206 existing records from primary storage. [2025-09-29T02:09:14.552968] [INFO ] [MAIN ] VBF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:14.563513] [INFO ] [MAIN ] Update Progress: 2216/2371 symbols completed. VBF took 0.8s. Estimated remaining: 49.9s. Rate: 186.5 symbols/min [2025-09-29T02:09:14.676901] [DEBUG] [LOCAL ] VCV: Loaded 13766 existing records from primary storage. [2025-09-29T02:09:14.752494] [INFO ] [MAIN ] VEEV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:14.768696] [INFO ] [MAIN ] VCV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:14.815694] [INFO ] [MAIN ] Update Progress: 2217/2371 symbols completed. VCV took 0.8s. Estimated remaining: 49.6s. Rate: 186.5 symbols/min [2025-09-29T02:09:15.019312] [INFO ] [MAIN ] VEL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:15.109867] [INFO ] [MAIN ] VET: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:15.216786] [INFO ] [MAIN ] VFC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:15.223904] [DEBUG] [LOCAL ] VEL: Loaded 13299 existing records from primary storage. [2025-09-29T02:09:15.225042] [INFO ] [MAIN ] VEL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:15.225357] [INFO ] [MAIN ] Update Progress: 2218/2371 symbols completed. VEL took 0.8s. Estimated remaining: 49.2s. Rate: 186.5 symbols/min [2025-09-29T02:09:15.372464] [DEBUG] [LOCAL ] VEEV: Loaded 47821 existing records from primary storage. [2025-09-29T02:09:15.435827] [INFO ] [MAIN ] VEEV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:15.482791] [DEBUG] [LOCAL ] VET: Loaded 44749 existing records from primary storage. [2025-09-29T02:09:15.482467] [INFO ] [MAIN ] VG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:15.482881] [INFO ] [MAIN ] Update Progress: 2219/2371 symbols completed. VEEV took 1.2s. Estimated remaining: 48.9s. Rate: 186.5 symbols/min [2025-09-29T02:09:15.495839] [DEBUG] [LOCAL ] VG: No existing data file found in primary storage. [2025-09-29T02:09:15.495707] [INFO ] [MAIN ] VET: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:15.517612] [WARN ] [MAIN ] VG: No existing data found, performing full refresh instead. [2025-09-29T02:09:15.533247] [INFO ] [MAIN ] Update Progress: 2220/2371 symbols completed. VET took 0.9s. Estimated remaining: 48.6s. Rate: 186.5 symbols/min [2025-09-29T02:09:15.557994] [INFO ] [MAIN ] VG: Wiping existing primary data before full refresh. [2025-09-29T02:09:15.580155] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-09-29T02:09:15.618980] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-09-29T02:09:15.671472] [INFO ] [MAIN ] VG: Starting full primary refresh. [2025-09-29T02:09:15.666063] [DEBUG] [LOCAL ] VFC: Loaded 54390 existing records from primary storage. [2025-09-29T02:09:15.790732] [INFO ] [MAIN ] VFC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:15.834601] [INFO ] [MAIN ] Update Progress: 2221/2371 symbols completed. VFC took 0.9s. Estimated remaining: 48.2s. Rate: 186.5 symbols/min [2025-09-29T02:09:16.049496] [INFO ] [MAIN ] VGI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:16.243708] [DEBUG] [LOCAL ] VGI: Loaded 5237 existing records from primary storage. [2025-09-29T02:09:16.248062] [INFO ] [MAIN ] VGM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:16.317963] [INFO ] [MAIN ] VGI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:16.341249] [INFO ] [MAIN ] Update Progress: 2222/2371 symbols completed. VGI took 0.9s. Estimated remaining: 47.9s. Rate: 186.5 symbols/min [2025-09-29T02:09:16.503512] [INFO ] [MAIN ] VHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:16.532165] [DEBUG] [LOCAL ] VGM: Loaded 18384 existing records from primary storage. [2025-09-29T02:09:16.587317] [INFO ] [MAIN ] VGM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:16.636780] [INFO ] [MAIN ] Update Progress: 2223/2371 symbols completed. VGM took 1.1s. Estimated remaining: 47.6s. Rate: 186.5 symbols/min [2025-09-29T02:09:16.736732] [DEBUG] [LOCAL ] VHI: Loaded 2905 existing records from primary storage. [2025-09-29T02:09:16.803810] [INFO ] [REMOTE ] VG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:09:16.816474] [INFO ] [MAIN ] VHI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:16.866569] [INFO ] [MAIN ] VIA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:16.877480] [INFO ] [REMOTE ] VG: Fetching primary data for 2024-12. [2025-09-29T02:09:16.888787] [INFO ] [MAIN ] Update Progress: 2224/2371 symbols completed. VHI took 1.0s. Estimated remaining: 47.3s. Rate: 186.5 symbols/min [2025-09-29T02:09:16.888944] [DEBUG] [LOCAL ] VIA: No existing data file found in primary storage. [2025-09-29T02:09:16.917075] [WARN ] [MAIN ] VIA: No existing data found, performing full refresh instead. [2025-09-29T02:09:16.971447] [INFO ] [MAIN ] VIA: Wiping existing primary data before full refresh. [2025-09-29T02:09:16.995687] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-09-29T02:09:17.047354] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-09-29T02:09:17.117470] [INFO ] [MAIN ] VICI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:17.074144] [INFO ] [MAIN ] VIA: Starting full primary refresh. [2025-09-29T02:09:17.060150] [DEBUG] [REMOTE ] VG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:09:17.175851] [WARN ] [REMOTE ] VG: No data returned for month 2024-12 [2025-09-29T02:09:17.278810] [FATAL] [REMOTE ] VG: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:09:17.268296] [INFO ] [MAIN ] VIK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:17.308277] [FATAL] [MAIN ] VG: Failed to fetch primary data. [2025-09-29T02:09:17.314418] [WARN ] [MAIN ] VG: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:09:17.336472] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-09-29T02:09:17.415170] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-09-29T02:09:17.448205] [INFO ] [LOCAL ] VG: Starting deletion of derivative data. [2025-09-29T02:09:17.507855] [DEBUG] [LOCAL ] VG: No derivative data file found to delete. [2025-09-29T02:09:17.541232] [INFO ] [MAIN ] Update Progress: 2225/2371 symbols completed. VG took 2.3s. Estimated remaining: 47.0s. Rate: 186.4 symbols/min [2025-09-29T02:09:17.747388] [INFO ] [REMOTE ] VIA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:09:17.773112] [INFO ] [REMOTE ] VIA: Fetching primary data for 2024-12. [2025-09-29T02:09:17.803294] [DEBUG] [LOCAL ] VICI: Loaded 54427 existing records from primary storage. [2025-09-29T02:09:17.805476] [DEBUG] [LOCAL ] VIK: Loaded 53250 existing records from primary storage. [2025-09-29T02:09:17.806413] [INFO ] [MAIN ] VICI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:17.832705] [INFO ] [MAIN ] Update Progress: 2226/2371 symbols completed. VICI took 1.2s. Estimated remaining: 46.7s. Rate: 186.4 symbols/min [2025-09-29T02:09:17.811796] [INFO ] [MAIN ] VIK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:17.893090] [INFO ] [MAIN ] Update Progress: 2227/2371 symbols completed. VIK took 1.0s. Estimated remaining: 46.3s. Rate: 186.5 symbols/min [2025-09-29T02:09:17.908211] [INFO ] [MAIN ] VIPS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:17.957030] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:09:18.023195] [WARN ] [REMOTE ] VIA: No data returned for month 2024-12 [2025-09-29T02:09:18.087175] [FATAL] [REMOTE ] VIA: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:09:18.138782] [FATAL] [MAIN ] VIA: Failed to fetch primary data. [2025-09-29T02:09:18.226184] [WARN ] [MAIN ] VIA: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:09:18.242599] [INFO ] [MAIN ] VIRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:18.252110] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-09-29T02:09:18.277014] [INFO ] [MAIN ] VIST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:18.278200] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-09-29T02:09:18.278515] [INFO ] [LOCAL ] VIA: Starting deletion of derivative data. [2025-09-29T02:09:18.278672] [DEBUG] [LOCAL ] VIA: No derivative data file found to delete. [2025-09-29T02:09:18.278898] [INFO ] [MAIN ] Update Progress: 2228/2371 symbols completed. VIA took 1.9s. Estimated remaining: 46.0s. Rate: 186.5 symbols/min [2025-09-29T02:09:18.484585] [DEBUG] [LOCAL ] VIPS: Loaded 52093 existing records from primary storage. [2025-09-29T02:09:18.533305] [INFO ] [MAIN ] VIV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:18.533574] [INFO ] [MAIN ] VIPS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:18.534373] [INFO ] [MAIN ] Update Progress: 2229/2371 symbols completed. VIPS took 1.0s. Estimated remaining: 45.7s. Rate: 186.5 symbols/min [2025-09-29T02:09:18.711238] [DEBUG] [LOCAL ] VIRT: Loaded 47448 existing records from primary storage. [2025-09-29T02:09:18.712853] [DEBUG] [LOCAL ] VIST: Loaded 46722 existing records from primary storage. [2025-09-29T02:09:18.731455] [INFO ] [MAIN ] VIST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:18.741920] [INFO ] [MAIN ] Update Progress: 2230/2371 symbols completed. VIST took 0.8s. Estimated remaining: 45.4s. Rate: 186.5 symbols/min [2025-09-29T02:09:18.742247] [INFO ] [MAIN ] VIRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:18.777907] [INFO ] [MAIN ] Update Progress: 2231/2371 symbols completed. VIRT took 0.9s. Estimated remaining: 45.0s. Rate: 186.6 symbols/min [2025-09-29T02:09:18.959381] [DEBUG] [LOCAL ] VIV: Loaded 45667 existing records from primary storage. [2025-09-29T02:09:19.011779] [INFO ] [MAIN ] VKQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:19.060331] [INFO ] [MAIN ] VIV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:19.082834] [INFO ] [MAIN ] Update Progress: 2232/2371 symbols completed. VIV took 0.8s. Estimated remaining: 44.7s. Rate: 186.6 symbols/min [2025-09-29T02:09:19.158156] [INFO ] [MAIN ] VLN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:19.313069] [INFO ] [MAIN ] VLO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:19.379139] [DEBUG] [LOCAL ] VKQ: Loaded 17552 existing records from primary storage. [2025-09-29T02:09:19.411963] [INFO ] [MAIN ] VKQ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:19.412637] [INFO ] [MAIN ] Update Progress: 2233/2371 symbols completed. VKQ took 0.9s. Estimated remaining: 44.4s. Rate: 186.6 symbols/min [2025-09-29T02:09:19.478497] [INFO ] [MAIN ] VLRS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:19.468422] [DEBUG] [LOCAL ] VLN: Loaded 29056 existing records from primary storage. [2025-09-29T02:09:19.517604] [INFO ] [MAIN ] VLN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:19.535359] [INFO ] [MAIN ] Update Progress: 2234/2371 symbols completed. VLN took 0.8s. Estimated remaining: 44.0s. Rate: 186.7 symbols/min [2025-09-29T02:09:19.835424] [INFO ] [MAIN ] VLT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:19.859396] [DEBUG] [LOCAL ] VLO: Loaded 53865 existing records from primary storage. [2025-09-29T02:09:19.870456] [DEBUG] [LOCAL ] VLRS: Loaded 41188 existing records from primary storage. [2025-09-29T02:09:19.881381] [INFO ] [MAIN ] VLO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:19.908837] [INFO ] [MAIN ] VLRS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:19.899922] [INFO ] [MAIN ] Update Progress: 2235/2371 symbols completed. VLO took 1.1s. Estimated remaining: 43.7s. Rate: 186.7 symbols/min [2025-09-29T02:09:19.936570] [INFO ] [MAIN ] Update Progress: 2236/2371 symbols completed. VLRS took 0.8s. Estimated remaining: 43.4s. Rate: 186.7 symbols/min [2025-09-29T02:09:19.936131] [INFO ] [MAIN ] VLTO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:19.951009] [DEBUG] [LOCAL ] VLT: Loaded 4615 existing records from primary storage. [2025-09-29T02:09:19.956417] [INFO ] [MAIN ] VLT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:20.023243] [INFO ] [MAIN ] Update Progress: 2237/2371 symbols completed. VLT took 0.6s. Estimated remaining: 43.0s. Rate: 186.8 symbols/min [2025-09-29T02:09:20.272210] [INFO ] [MAIN ] VMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:20.333748] [INFO ] [MAIN ] VMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:20.365501] [DEBUG] [LOCAL ] VMI: Loaded 15711 existing records from primary storage. [2025-09-29T02:09:20.380994] [INFO ] [MAIN ] VMI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:20.381432] [INFO ] [MAIN ] Update Progress: 2238/2371 symbols completed. VMI took 0.4s. Estimated remaining: 42.7s. Rate: 186.8 symbols/min [2025-09-29T02:09:20.382473] [DEBUG] [LOCAL ] VLTO: Loaded 46710 existing records from primary storage. [2025-09-29T02:09:20.382957] [INFO ] [MAIN ] VLTO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:20.383053] [INFO ] [MAIN ] Update Progress: 2239/2371 symbols completed. VLTO took 0.8s. Estimated remaining: 42.4s. Rate: 186.9 symbols/min [2025-09-29T02:09:20.415314] [DEBUG] [LOCAL ] VMC: Loaded 44263 existing records from primary storage. [2025-09-29T02:09:20.415701] [INFO ] [MAIN ] VMC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:20.415805] [INFO ] [MAIN ] Update Progress: 2240/2371 symbols completed. VMC took 0.5s. Estimated remaining: 42.0s. Rate: 186.9 symbols/min [2025-09-29T02:09:21.070292] [INFO ] [MAIN ] VNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:21.138176] [INFO ] [MAIN ] VMO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:21.144176] [INFO ] [MAIN ] VNCE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:21.200638] [INFO ] [MAIN ] VNO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:21.212302] [DEBUG] [LOCAL ] VNCE: Loaded 7593 existing records from primary storage. [2025-09-29T02:09:21.213034] [INFO ] [MAIN ] VNCE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:21.213718] [INFO ] [MAIN ] Update Progress: 2241/2371 symbols completed. VNCE took 0.8s. Estimated remaining: 41.8s. Rate: 186.8 symbols/min [2025-09-29T02:09:21.380102] [DEBUG] [LOCAL ] VMO: Loaded 21297 existing records from primary storage. [2025-09-29T02:09:21.413785] [INFO ] [MAIN ] VMO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:21.422791] [INFO ] [MAIN ] Update Progress: 2242/2371 symbols completed. VMO took 1.0s. Estimated remaining: 41.4s. Rate: 186.8 symbols/min [2025-09-29T02:09:21.453374] [INFO ] [MAIN ] VOC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:21.524592] [DEBUG] [LOCAL ] VNT: Loaded 44451 existing records from primary storage. [2025-09-29T02:09:21.557472] [INFO ] [MAIN ] VNT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:21.563157] [INFO ] [MAIN ] Update Progress: 2243/2371 symbols completed. VNT took 1.1s. Estimated remaining: 41.1s. Rate: 186.9 symbols/min [2025-09-29T02:09:21.659186] [DEBUG] [LOCAL ] VNO: Loaded 49668 existing records from primary storage. [2025-09-29T02:09:21.670284] [INFO ] [MAIN ] VNO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:21.670982] [DEBUG] [LOCAL ] VOC: Loaded 9021 existing records from primary storage. [2025-09-29T02:09:21.671314] [INFO ] [MAIN ] Update Progress: 2244/2371 symbols completed. VNO took 1.2s. Estimated remaining: 40.8s. Rate: 187.0 symbols/min [2025-09-29T02:09:21.787449] [INFO ] [MAIN ] VOC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:21.864338] [INFO ] [MAIN ] Update Progress: 2245/2371 symbols completed. VOC took 0.7s. Estimated remaining: 40.4s. Rate: 187.0 symbols/min [2025-09-29T02:09:21.846597] [INFO ] [MAIN ] VOYA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:22.119470] [INFO ] [MAIN ] VOYG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:22.149327] [DEBUG] [LOCAL ] VOYG: No existing data file found in primary storage. [2025-09-29T02:09:22.149558] [WARN ] [MAIN ] VOYG: No existing data found, performing full refresh instead. [2025-09-29T02:09:22.223615] [INFO ] [MAIN ] VOYG: Wiping existing primary data before full refresh. [2025-09-29T02:09:22.232993] [INFO ] [MAIN ] VPG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:22.233860] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-09-29T02:09:22.234460] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-09-29T02:09:22.240060] [INFO ] [MAIN ] VOYG: Starting full primary refresh. [2025-09-29T02:09:22.408718] [DEBUG] [LOCAL ] VPG: Loaded 17373 existing records from primary storage. [2025-09-29T02:09:22.390921] [INFO ] [MAIN ] VPV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:22.433051] [INFO ] [MAIN ] VPG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:22.433463] [INFO ] [MAIN ] Update Progress: 2246/2371 symbols completed. VPG took 0.7s. Estimated remaining: 40.1s. Rate: 186.9 symbols/min [2025-09-29T02:09:22.491339] [DEBUG] [LOCAL ] VOYA: Loaded 43377 existing records from primary storage. [2025-09-29T02:09:22.549032] [DEBUG] [LOCAL ] VPV: Loaded 5429 existing records from primary storage. [2025-09-29T02:09:22.554484] [INFO ] [MAIN ] VOYA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:22.591865] [INFO ] [MAIN ] Update Progress: 2247/2371 symbols completed. VOYA took 1.1s. Estimated remaining: 39.8s. Rate: 187.0 symbols/min [2025-09-29T02:09:22.637088] [INFO ] [MAIN ] VPV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:22.705314] [INFO ] [MAIN ] Update Progress: 2248/2371 symbols completed. VPV took 0.8s. Estimated remaining: 39.5s. Rate: 187.0 symbols/min [2025-09-29T02:09:23.015295] [INFO ] [MAIN ] VRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:23.245081] [INFO ] [MAIN ] VRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:23.340639] [INFO ] [REMOTE ] VOYG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:09:23.387875] [INFO ] [MAIN ] VRTS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:23.388627] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2024-12. [2025-09-29T02:09:23.410024] [DEBUG] [LOCAL ] VRE: Loaded 35345 existing records from primary storage. [2025-09-29T02:09:23.410717] [INFO ] [MAIN ] VRE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:23.411041] [INFO ] [MAIN ] Update Progress: 2249/2371 symbols completed. VRE took 1.0s. Estimated remaining: 39.2s. Rate: 186.9 symbols/min [2025-09-29T02:09:23.455302] [DEBUG] [LOCAL ] VRTS: Loaded 9287 existing records from primary storage. [2025-09-29T02:09:23.496575] [INFO ] [MAIN ] VRTS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:23.522718] [INFO ] [MAIN ] Update Progress: 2250/2371 symbols completed. VRTS took 0.7s. Estimated remaining: 38.8s. Rate: 187.0 symbols/min [2025-09-29T02:09:23.540241] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:09:23.616185] [WARN ] [REMOTE ] VOYG: No data returned for month 2024-12 [2025-09-29T02:09:23.719422] [INFO ] [MAIN ] VSCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:23.736228] [FATAL] [REMOTE ] VOYG: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:09:23.741729] [FATAL] [MAIN ] VOYG: Failed to fetch primary data. [2025-09-29T02:09:23.780389] [WARN ] [MAIN ] VOYG: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:09:23.808734] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-09-29T02:09:23.847625] [INFO ] [MAIN ] VSH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:23.847770] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-09-29T02:09:23.850185] [DEBUG] [LOCAL ] VRT: Loaded 54533 existing records from primary storage. [2025-09-29T02:09:23.850825] [INFO ] [LOCAL ] VOYG: Starting deletion of derivative data. [2025-09-29T02:09:23.850976] [INFO ] [MAIN ] VRT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:23.851616] [INFO ] [MAIN ] Update Progress: 2251/2371 symbols completed. VRT took 1.2s. Estimated remaining: 38.5s. Rate: 187.0 symbols/min [2025-09-29T02:09:23.851221] [DEBUG] [LOCAL ] VOYG: No derivative data file found to delete. [2025-09-29T02:09:23.851987] [INFO ] [MAIN ] Update Progress: 2252/2371 symbols completed. VOYG took 2.3s. Estimated remaining: 38.2s. Rate: 187.1 symbols/min [2025-09-29T02:09:24.254455] [INFO ] [MAIN ] VST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:24.303941] [DEBUG] [LOCAL ] VSCO: Loaded 53556 existing records from primary storage. [2025-09-29T02:09:24.305580] [DEBUG] [LOCAL ] VSH: Loaded 49188 existing records from primary storage. [2025-09-29T02:09:24.305863] [INFO ] [MAIN ] VSCO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:24.329706] [INFO ] [MAIN ] VSH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:24.336165] [INFO ] [MAIN ] VSTS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:24.336477] [INFO ] [MAIN ] Update Progress: 2253/2371 symbols completed. VSCO took 0.9s. Estimated remaining: 37.9s. Rate: 187.0 symbols/min [2025-09-29T02:09:24.338127] [INFO ] [MAIN ] Update Progress: 2254/2371 symbols completed. VSH took 0.8s. Estimated remaining: 37.5s. Rate: 187.1 symbols/min [2025-09-29T02:09:24.816461] [DEBUG] [LOCAL ] VSTS: Loaded 49773 existing records from primary storage. [2025-09-29T02:09:24.869887] [DEBUG] [LOCAL ] VST: Loaded 54498 existing records from primary storage. [2025-09-29T02:09:24.875608] [INFO ] [MAIN ] VTLE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:24.877214] [INFO ] [MAIN ] VSTS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:24.876932] [INFO ] [MAIN ] VTEX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:24.878030] [INFO ] [MAIN ] VST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:24.878978] [INFO ] [MAIN ] Update Progress: 2255/2371 symbols completed. VSTS took 1.0s. Estimated remaining: 37.2s. Rate: 187.0 symbols/min [2025-09-29T02:09:24.886170] [INFO ] [MAIN ] Update Progress: 2256/2371 symbols completed. VST took 1.0s. Estimated remaining: 36.9s. Rate: 187.1 symbols/min [2025-09-29T02:09:25.325828] [INFO ] [MAIN ] VTMX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:25.330535] [DEBUG] [LOCAL ] VTEX: Loaded 43948 existing records from primary storage. [2025-09-29T02:09:25.328076] [DEBUG] [LOCAL ] VTLE: Loaded 49337 existing records from primary storage. [2025-09-29T02:09:25.359052] [INFO ] [MAIN ] VTEX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:25.359897] [INFO ] [MAIN ] Update Progress: 2257/2371 symbols completed. VTEX took 1.0s. Estimated remaining: 36.6s. Rate: 187.1 symbols/min [2025-09-29T02:09:25.357796] [INFO ] [MAIN ] VTLE: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:25.358917] [INFO ] [MAIN ] VTN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:25.365659] [INFO ] [MAIN ] Update Progress: 2258/2371 symbols completed. VTLE took 1.0s. Estimated remaining: 36.2s. Rate: 187.2 symbols/min [2025-09-29T02:09:25.604800] [DEBUG] [LOCAL ] VTN: Loaded 7293 existing records from primary storage. [2025-09-29T02:09:25.584841] [DEBUG] [LOCAL ] VTMX: Loaded 17811 existing records from primary storage. [2025-09-29T02:09:25.678317] [INFO ] [MAIN ] VTN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:25.707793] [INFO ] [MAIN ] Update Progress: 2259/2371 symbols completed. VTN took 0.8s. Estimated remaining: 35.9s. Rate: 187.2 symbols/min [2025-09-29T02:09:25.712259] [INFO ] [MAIN ] VTOL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:25.696550] [INFO ] [MAIN ] VTMX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:25.723614] [INFO ] [MAIN ] Update Progress: 2260/2371 symbols completed. VTMX took 0.8s. Estimated remaining: 35.6s. Rate: 187.2 symbols/min [2025-09-29T02:09:25.945390] [INFO ] [MAIN ] VTR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:26.043992] [DEBUG] [LOCAL ] VTOL: Loaded 19915 existing records from primary storage. [2025-09-29T02:09:26.138823] [INFO ] [MAIN ] VTOL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:26.166162] [INFO ] [MAIN ] VTS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:26.197520] [INFO ] [MAIN ] VVR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:26.198380] [INFO ] [MAIN ] Update Progress: 2261/2371 symbols completed. VTOL took 0.8s. Estimated remaining: 35.3s. Rate: 187.2 symbols/min [2025-09-29T02:09:26.441080] [DEBUG] [LOCAL ] VTS: Loaded 30992 existing records from primary storage. [2025-09-29T02:09:26.458496] [DEBUG] [LOCAL ] VVR: Loaded 31251 existing records from primary storage. [2025-09-29T02:09:26.478466] [INFO ] [MAIN ] VVV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:26.474256] [INFO ] [MAIN ] VTS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:26.480839] [INFO ] [MAIN ] VVR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:26.480400] [DEBUG] [LOCAL ] VTR: Loaded 53620 existing records from primary storage. [2025-09-29T02:09:26.480950] [INFO ] [MAIN ] Update Progress: 2262/2371 symbols completed. VTS took 0.8s. Estimated remaining: 34.9s. Rate: 187.2 symbols/min [2025-09-29T02:09:26.481804] [INFO ] [MAIN ] VTR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:26.487782] [INFO ] [MAIN ] Update Progress: 2263/2371 symbols completed. VTR took 1.1s. Estimated remaining: 34.6s. Rate: 187.3 symbols/min [2025-09-29T02:09:26.499118] [INFO ] [MAIN ] Update Progress: 2264/2371 symbols completed. VVR took 0.7s. Estimated remaining: 34.3s. Rate: 187.4 symbols/min [2025-09-29T02:09:26.992781] [INFO ] [MAIN ] VYX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:27.092810] [INFO ] [MAIN ] VVX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:27.093888] [INFO ] [MAIN ] VZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:27.119065] [DEBUG] [LOCAL ] VVV: Loaded 50933 existing records from primary storage. [2025-09-29T02:09:27.119578] [INFO ] [MAIN ] VVV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:27.119821] [INFO ] [MAIN ] Update Progress: 2265/2371 symbols completed. VVV took 0.9s. Estimated remaining: 34.0s. Rate: 187.3 symbols/min [2025-09-29T02:09:27.190572] [DEBUG] [LOCAL ] VVX: Loaded 23664 existing records from primary storage. [2025-09-29T02:09:27.225728] [INFO ] [MAIN ] VVX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:27.257558] [INFO ] [MAIN ] Update Progress: 2266/2371 symbols completed. VVX took 0.8s. Estimated remaining: 33.6s. Rate: 187.3 symbols/min [2025-09-29T02:09:27.440463] [INFO ] [MAIN ] W: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:27.484294] [DEBUG] [LOCAL ] VZ: Loaded 54571 existing records from primary storage. [2025-09-29T02:09:27.507072] [DEBUG] [LOCAL ] VYX: Loaded 49624 existing records from primary storage. [2025-09-29T02:09:27.507292] [INFO ] [MAIN ] VZ: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:27.527169] [INFO ] [MAIN ] Update Progress: 2267/2371 symbols completed. VZ took 1.0s. Estimated remaining: 33.3s. Rate: 187.3 symbols/min [2025-09-29T02:09:27.537838] [INFO ] [MAIN ] VYX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:27.555508] [INFO ] [MAIN ] Update Progress: 2268/2371 symbols completed. VYX took 1.1s. Estimated remaining: 33.0s. Rate: 187.4 symbols/min [2025-09-29T02:09:27.697881] [INFO ] [MAIN ] WAB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:27.973589] [INFO ] [MAIN ] WAL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:27.987700] [DEBUG] [LOCAL ] W: Loaded 54266 existing records from primary storage. [2025-09-29T02:09:28.004600] [INFO ] [MAIN ] W: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:28.062199] [INFO ] [MAIN ] Update Progress: 2269/2371 symbols completed. W took 0.9s. Estimated remaining: 32.7s. Rate: 187.4 symbols/min [2025-09-29T02:09:28.061568] [INFO ] [MAIN ] WAT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:28.257578] [DEBUG] [LOCAL ] WAB: Loaded 44872 existing records from primary storage. [2025-09-29T02:09:28.345130] [DEBUG] [LOCAL ] WAT: Loaded 35620 existing records from primary storage. [2025-09-29T02:09:28.328352] [DEBUG] [LOCAL ] WAL: Loaded 46040 existing records from primary storage. [2025-09-29T02:09:28.325306] [INFO ] [MAIN ] WAB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:28.348856] [INFO ] [MAIN ] WAT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:28.350175] [INFO ] [MAIN ] WBI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:28.350405] [INFO ] [MAIN ] Update Progress: 2270/2371 symbols completed. WAB took 1.1s. Estimated remaining: 32.3s. Rate: 187.4 symbols/min [2025-09-29T02:09:28.351309] [INFO ] [MAIN ] WAL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:28.351494] [DEBUG] [LOCAL ] WBI: No existing data file found in primary storage. [2025-09-29T02:09:28.351586] [WARN ] [MAIN ] WBI: No existing data found, performing full refresh instead. [2025-09-29T02:09:28.351765] [INFO ] [MAIN ] WBI: Wiping existing primary data before full refresh. [2025-09-29T02:09:28.351853] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-09-29T02:09:28.351939] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-09-29T02:09:28.352014] [INFO ] [MAIN ] WBI: Starting full primary refresh. [2025-09-29T02:09:28.413337] [INFO ] [MAIN ] Update Progress: 2271/2371 symbols completed. WAT took 0.7s. Estimated remaining: 32.0s. Rate: 187.4 symbols/min [2025-09-29T02:09:28.498082] [INFO ] [MAIN ] Update Progress: 2272/2371 symbols completed. WAL took 0.8s. Estimated remaining: 31.7s. Rate: 187.5 symbols/min [2025-09-29T02:09:28.956040] [INFO ] [MAIN ] WBS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:29.176615] [INFO ] [MAIN ] WBX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:29.402941] [INFO ] [MAIN ] WCC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:29.433781] [INFO ] [REMOTE ] WBI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:09:29.434991] [DEBUG] [LOCAL ] WBX: Loaded 12558 existing records from primary storage. [2025-09-29T02:09:29.436907] [INFO ] [REMOTE ] WBI: Fetching primary data for 2024-12. [2025-09-29T02:09:29.450114] [INFO ] [MAIN ] WBX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:29.450972] [INFO ] [MAIN ] Update Progress: 2273/2371 symbols completed. WBX took 1.0s. Estimated remaining: 31.4s. Rate: 187.3 symbols/min [2025-09-29T02:09:29.473392] [DEBUG] [LOCAL ] WBS: Loaded 49471 existing records from primary storage. [2025-09-29T02:09:29.505727] [INFO ] [MAIN ] WBS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:29.529500] [INFO ] [MAIN ] Update Progress: 2274/2371 symbols completed. WBS took 1.1s. Estimated remaining: 31.1s. Rate: 187.4 symbols/min [2025-09-29T02:09:29.594240] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:09:29.642795] [WARN ] [REMOTE ] WBI: No data returned for month 2024-12 [2025-09-29T02:09:29.705744] [FATAL] [REMOTE ] WBI: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:09:29.785626] [INFO ] [MAIN ] WCN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:29.803637] [FATAL] [MAIN ] WBI: Failed to fetch primary data. [2025-09-29T02:09:29.820496] [WARN ] [MAIN ] WBI: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:09:29.847270] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-09-29T02:09:29.855289] [DEBUG] [LOCAL ] WCC: Loaded 40567 existing records from primary storage. [2025-09-29T02:09:29.886192] [INFO ] [MAIN ] WD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:29.886325] [INFO ] [MAIN ] WCC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:29.886415] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-09-29T02:09:29.887379] [INFO ] [LOCAL ] WBI: Starting deletion of derivative data. [2025-09-29T02:09:29.887604] [INFO ] [MAIN ] Update Progress: 2275/2371 symbols completed. WCC took 1.2s. Estimated remaining: 30.7s. Rate: 187.4 symbols/min [2025-09-29T02:09:29.893215] [DEBUG] [LOCAL ] WBI: No derivative data file found to delete. [2025-09-29T02:09:29.900396] [INFO ] [MAIN ] Update Progress: 2276/2371 symbols completed. WBI took 1.8s. Estimated remaining: 30.4s. Rate: 187.5 symbols/min [2025-09-29T02:09:30.186897] [DEBUG] [LOCAL ] WD: Loaded 23747 existing records from primary storage. [2025-09-29T02:09:30.198590] [INFO ] [MAIN ] WD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:30.270689] [INFO ] [MAIN ] Update Progress: 2277/2371 symbols completed. WD took 0.7s. Estimated remaining: 30.1s. Rate: 187.5 symbols/min [2025-09-29T02:09:30.345906] [INFO ] [MAIN ] WDH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:30.368514] [INFO ] [MAIN ] WDI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:30.370846] [DEBUG] [LOCAL ] WCN: Loaded 48708 existing records from primary storage. [2025-09-29T02:09:30.373489] [INFO ] [MAIN ] WCN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:30.373611] [INFO ] [MAIN ] Update Progress: 2278/2371 symbols completed. WCN took 0.9s. Estimated remaining: 29.8s. Rate: 187.5 symbols/min [2025-09-29T02:09:30.418677] [DEBUG] [LOCAL ] WDI: Loaded 21314 existing records from primary storage. [2025-09-29T02:09:30.419093] [DEBUG] [LOCAL ] WDH: Loaded 17597 existing records from primary storage. [2025-09-29T02:09:30.419511] [INFO ] [MAIN ] WDH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:30.419596] [INFO ] [MAIN ] WDI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:30.419820] [INFO ] [MAIN ] Update Progress: 2279/2371 symbols completed. WDH took 0.5s. Estimated remaining: 29.4s. Rate: 187.6 symbols/min [2025-09-29T02:09:30.420060] [INFO ] [MAIN ] Update Progress: 2280/2371 symbols completed. WDI took 0.5s. Estimated remaining: 29.1s. Rate: 187.7 symbols/min [2025-09-29T02:09:31.098728] [INFO ] [MAIN ] WEC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:31.192073] [INFO ] [MAIN ] WEAV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:31.281181] [INFO ] [MAIN ] WDS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:31.286127] [INFO ] [MAIN ] WEA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:31.317503] [DEBUG] [LOCAL ] WEA: Loaded 7379 existing records from primary storage. [2025-09-29T02:09:31.318186] [INFO ] [MAIN ] WEA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:31.318515] [INFO ] [MAIN ] Update Progress: 2281/2371 symbols completed. WEA took 0.9s. Estimated remaining: 28.8s. Rate: 187.5 symbols/min [2025-09-29T02:09:31.492477] [DEBUG] [LOCAL ] WEAV: Loaded 42562 existing records from primary storage. [2025-09-29T02:09:31.509450] [INFO ] [MAIN ] WEAV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:31.557735] [DEBUG] [LOCAL ] WEC: Loaded 52958 existing records from primary storage. [2025-09-29T02:09:31.540598] [INFO ] [MAIN ] Update Progress: 2282/2371 symbols completed. WEAV took 1.1s. Estimated remaining: 28.5s. Rate: 187.5 symbols/min [2025-09-29T02:09:31.616536] [DEBUG] [LOCAL ] WDS: Loaded 44259 existing records from primary storage. [2025-09-29T02:09:31.626102] [INFO ] [MAIN ] WDS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:31.646004] [INFO ] [MAIN ] WEC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:31.657440] [INFO ] [MAIN ] WELL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:31.665147] [INFO ] [MAIN ] Update Progress: 2283/2371 symbols completed. WDS took 1.2s. Estimated remaining: 28.1s. Rate: 187.6 symbols/min [2025-09-29T02:09:31.702878] [INFO ] [MAIN ] Update Progress: 2284/2371 symbols completed. WEC took 1.3s. Estimated remaining: 27.8s. Rate: 187.7 symbols/min [2025-09-29T02:09:32.112876] [INFO ] [MAIN ] WES: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:32.216896] [INFO ] [MAIN ] WF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:32.285486] [INFO ] [MAIN ] WEX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:32.304736] [DEBUG] [LOCAL ] WELL: Loaded 53132 existing records from primary storage. [2025-09-29T02:09:32.305507] [INFO ] [MAIN ] WELL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:32.305603] [INFO ] [MAIN ] Update Progress: 2285/2371 symbols completed. WELL took 1.0s. Estimated remaining: 27.5s. Rate: 187.6 symbols/min [2025-09-29T02:09:32.449548] [DEBUG] [LOCAL ] WF: Loaded 10903 existing records from primary storage. [2025-09-29T02:09:32.450027] [INFO ] [MAIN ] WF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:32.501871] [INFO ] [MAIN ] Update Progress: 2286/2371 symbols completed. WF took 0.8s. Estimated remaining: 27.2s. Rate: 187.6 symbols/min [2025-09-29T02:09:32.571527] [INFO ] [MAIN ] WFC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:32.656110] [DEBUG] [LOCAL ] WEX: Loaded 35697 existing records from primary storage. [2025-09-29T02:09:32.668017] [DEBUG] [LOCAL ] WES: Loaded 48689 existing records from primary storage. [2025-09-29T02:09:32.696965] [INFO ] [MAIN ] WES: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:32.697090] [INFO ] [MAIN ] WEX: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:32.702970] [INFO ] [MAIN ] Update Progress: 2287/2371 symbols completed. WES took 1.1s. Estimated remaining: 26.9s. Rate: 187.7 symbols/min [2025-09-29T02:09:32.715477] [INFO ] [MAIN ] Update Progress: 2288/2371 symbols completed. WEX took 1.0s. Estimated remaining: 26.5s. Rate: 187.7 symbols/min [2025-09-29T02:09:32.839975] [INFO ] [MAIN ] WFG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:33.183046] [INFO ] [MAIN ] WGO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:33.187260] [INFO ] [MAIN ] WH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:33.217014] [DEBUG] [LOCAL ] WFC: Loaded 54528 existing records from primary storage. [2025-09-29T02:09:33.218381] [INFO ] [MAIN ] WFC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:33.219489] [INFO ] [MAIN ] Update Progress: 2289/2371 symbols completed. WFC took 0.9s. Estimated remaining: 26.2s. Rate: 187.7 symbols/min [2025-09-29T02:09:33.218140] [DEBUG] [LOCAL ] WFG: Loaded 25211 existing records from primary storage. [2025-09-29T02:09:33.220240] [INFO ] [MAIN ] WFG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:33.232220] [INFO ] [MAIN ] Update Progress: 2290/2371 symbols completed. WFG took 0.7s. Estimated remaining: 25.9s. Rate: 187.8 symbols/min [2025-09-29T02:09:33.677841] [INFO ] [MAIN ] WHD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:33.682297] [INFO ] [MAIN ] WHG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:33.684079] [DEBUG] [LOCAL ] WH: Loaded 46339 existing records from primary storage. [2025-09-29T02:09:33.685969] [DEBUG] [LOCAL ] WGO: Loaded 39823 existing records from primary storage. [2025-09-29T02:09:33.687133] [INFO ] [MAIN ] WH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:33.687323] [INFO ] [MAIN ] Update Progress: 2291/2371 symbols completed. WH took 0.9s. Estimated remaining: 25.6s. Rate: 187.7 symbols/min [2025-09-29T02:09:33.688713] [INFO ] [MAIN ] WGO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:33.728402] [INFO ] [MAIN ] Update Progress: 2292/2371 symbols completed. WGO took 1.0s. Estimated remaining: 25.2s. Rate: 187.8 symbols/min [2025-09-29T02:09:33.844081] [DEBUG] [LOCAL ] WHG: Loaded 3416 existing records from primary storage. [2025-09-29T02:09:33.899671] [INFO ] [MAIN ] WHG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:33.941086] [INFO ] [MAIN ] Update Progress: 2293/2371 symbols completed. WHG took 0.7s. Estimated remaining: 24.9s. Rate: 187.8 symbols/min [2025-09-29T02:09:34.128532] [DEBUG] [LOCAL ] WHD: Loaded 41130 existing records from primary storage. [2025-09-29T02:09:34.208929] [INFO ] [MAIN ] WHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:34.237772] [INFO ] [MAIN ] WHD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:34.270052] [INFO ] [MAIN ] WIA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:34.276386] [INFO ] [MAIN ] Update Progress: 2294/2371 symbols completed. WHD took 1.1s. Estimated remaining: 24.6s. Rate: 187.8 symbols/min [2025-09-29T02:09:34.462428] [DEBUG] [LOCAL ] WIA: Loaded 4937 existing records from primary storage. [2025-09-29T02:09:34.509690] [INFO ] [MAIN ] WINN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:34.511320] [INFO ] [MAIN ] WIA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:34.517462] [INFO ] [MAIN ] Update Progress: 2295/2371 symbols completed. WIA took 0.8s. Estimated remaining: 24.3s. Rate: 187.8 symbols/min [2025-09-29T02:09:34.723542] [INFO ] [MAIN ] WIT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:34.782983] [DEBUG] [LOCAL ] WINN: Loaded 11944 existing records from primary storage. [2025-09-29T02:09:34.783788] [INFO ] [MAIN ] WINN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:34.800524] [INFO ] [MAIN ] Update Progress: 2296/2371 symbols completed. WINN took 0.8s. Estimated remaining: 24.0s. Rate: 187.9 symbols/min [2025-09-29T02:09:34.836708] [DEBUG] [LOCAL ] WHR: Loaded 48846 existing records from primary storage. [2025-09-29T02:09:34.884853] [INFO ] [MAIN ] WHR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:34.980628] [INFO ] [MAIN ] WIW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:34.991873] [INFO ] [MAIN ] Update Progress: 2297/2371 symbols completed. WHR took 1.3s. Estimated remaining: 23.6s. Rate: 187.9 symbols/min [2025-09-29T02:09:35.250606] [INFO ] [MAIN ] WK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:35.362362] [INFO ] [MAIN ] WKC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:35.363001] [DEBUG] [LOCAL ] WIW: Loaded 20756 existing records from primary storage. [2025-09-29T02:09:35.364877] [DEBUG] [LOCAL ] WIT: Loaded 53070 existing records from primary storage. [2025-09-29T02:09:35.366045] [INFO ] [MAIN ] WIT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:35.365959] [INFO ] [MAIN ] WIW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:35.366618] [INFO ] [MAIN ] Update Progress: 2298/2371 symbols completed. WIT took 1.1s. Estimated remaining: 23.3s. Rate: 187.9 symbols/min [2025-09-29T02:09:35.367239] [INFO ] [MAIN ] Update Progress: 2299/2371 symbols completed. WIW took 0.8s. Estimated remaining: 23.0s. Rate: 188.0 symbols/min [2025-09-29T02:09:35.725965] [DEBUG] [LOCAL ] WK: Loaded 37342 existing records from primary storage. [2025-09-29T02:09:35.720222] [INFO ] [MAIN ] WLK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:35.737066] [INFO ] [MAIN ] WK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:35.738507] [DEBUG] [LOCAL ] WKC: Loaded 35538 existing records from primary storage. [2025-09-29T02:09:35.739412] [INFO ] [MAIN ] Update Progress: 2300/2371 symbols completed. WK took 0.9s. Estimated remaining: 22.7s. Rate: 187.9 symbols/min [2025-09-29T02:09:35.750362] [INFO ] [MAIN ] WKC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:35.808743] [INFO ] [MAIN ] Update Progress: 2301/2371 symbols completed. WKC took 0.8s. Estimated remaining: 22.3s. Rate: 188.0 symbols/min [2025-09-29T02:09:35.845179] [INFO ] [MAIN ] WLKP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:36.113407] [DEBUG] [LOCAL ] WLKP: Loaded 6800 existing records from primary storage. [2025-09-29T02:09:36.146327] [INFO ] [MAIN ] WLKP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:36.239500] [INFO ] [MAIN ] WLY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:36.214613] [INFO ] [MAIN ] Update Progress: 2302/2371 symbols completed. WLKP took 0.8s. Estimated remaining: 22.0s. Rate: 188.0 symbols/min [2025-09-29T02:09:36.313899] [INFO ] [MAIN ] WLTG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:36.345083] [DEBUG] [LOCAL ] WLK: Loaded 46113 existing records from primary storage. [2025-09-29T02:09:36.350430] [DEBUG] [LOCAL ] WLTG: No existing data file found in primary storage. [2025-09-29T02:09:36.375566] [WARN ] [MAIN ] WLTG: No existing data found, performing full refresh instead. [2025-09-29T02:09:36.375950] [INFO ] [MAIN ] WLK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:36.410559] [INFO ] [MAIN ] Update Progress: 2303/2371 symbols completed. WLK took 1.0s. Estimated remaining: 21.7s. Rate: 188.0 symbols/min [2025-09-29T02:09:36.415696] [INFO ] [MAIN ] WLTG: Wiping existing primary data before full refresh. [2025-09-29T02:09:36.416018] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-09-29T02:09:36.427374] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-09-29T02:09:36.427767] [INFO ] [MAIN ] WLTG: Starting full primary refresh. [2025-09-29T02:09:36.721340] [DEBUG] [LOCAL ] WLY: Loaded 30414 existing records from primary storage. [2025-09-29T02:09:36.761858] [INFO ] [MAIN ] WM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:36.762107] [INFO ] [MAIN ] WLY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:36.764563] [INFO ] [MAIN ] Update Progress: 2304/2371 symbols completed. WLY took 0.9s. Estimated remaining: 21.4s. Rate: 188.0 symbols/min [2025-09-29T02:09:37.024696] [INFO ] [MAIN ] WMB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:37.305907] [INFO ] [MAIN ] WMK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:37.395862] [INFO ] [REMOTE ] WLTG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:09:37.414891] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2024-12. [2025-09-29T02:09:37.422316] [DEBUG] [LOCAL ] WM: Loaded 51697 existing records from primary storage. [2025-09-29T02:09:37.422920] [INFO ] [MAIN ] WM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:37.429633] [INFO ] [MAIN ] Update Progress: 2305/2371 symbols completed. WM took 1.1s. Estimated remaining: 21.1s. Rate: 187.9 symbols/min [2025-09-29T02:09:37.430352] [DEBUG] [LOCAL ] WMK: Loaded 14753 existing records from primary storage. [2025-09-29T02:09:37.443159] [INFO ] [MAIN ] WMK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:37.484551] [INFO ] [MAIN ] Update Progress: 2306/2371 symbols completed. WMK took 0.6s. Estimated remaining: 20.7s. Rate: 188.0 symbols/min [2025-09-29T02:09:37.675086] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2024-12 (0.26 seconds). [2025-09-29T02:09:37.697524] [DEBUG] [LOCAL ] WMB: Loaded 54451 existing records from primary storage. [2025-09-29T02:09:37.709201] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-01. [2025-09-29T02:09:37.734591] [INFO ] [MAIN ] WMB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:37.735090] [INFO ] [MAIN ] Update Progress: 2307/2371 symbols completed. WMB took 1.3s. Estimated remaining: 20.4s. Rate: 188.0 symbols/min [2025-09-29T02:09:37.935947] [INFO ] [MAIN ] WMS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:37.951501] [INFO ] [MAIN ] WMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:37.966458] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-09-29T02:09:37.989531] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-02. [2025-09-29T02:09:38.116061] [INFO ] [MAIN ] WNC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:38.166601] [DEBUG] [LOCAL ] WMS: Loaded 40249 existing records from primary storage. [2025-09-29T02:09:38.167437] [INFO ] [MAIN ] WMS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:38.167598] [INFO ] [MAIN ] Update Progress: 2308/2371 symbols completed. WMS took 0.7s. Estimated remaining: 20.1s. Rate: 188.0 symbols/min [2025-09-29T02:09:38.294278] [DEBUG] [LOCAL ] WMT: Loaded 54580 existing records from primary storage. [2025-09-29T02:09:38.299717] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-29T02:09:38.317606] [INFO ] [MAIN ] WMT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:38.319262] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-03. [2025-09-29T02:09:38.319965] [INFO ] [MAIN ] Update Progress: 2309/2371 symbols completed. WMT took 0.8s. Estimated remaining: 19.8s. Rate: 188.0 symbols/min [2025-09-29T02:09:38.450891] [DEBUG] [LOCAL ] WNC: Loaded 40452 existing records from primary storage. [2025-09-29T02:09:38.495864] [INFO ] [MAIN ] WNS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:38.514799] [INFO ] [MAIN ] WNC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:38.535613] [INFO ] [MAIN ] Update Progress: 2310/2371 symbols completed. WNC took 0.7s. Estimated remaining: 19.5s. Rate: 188.0 symbols/min [2025-09-29T02:09:38.684843] [INFO ] [MAIN ] WOLF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:38.840428] [INFO ] [MAIN ] WOR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:38.845727] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-29T02:09:38.847021] [DEBUG] [LOCAL ] WNS: Loaded 40539 existing records from primary storage. [2025-09-29T02:09:38.849109] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-04. [2025-09-29T02:09:38.851884] [INFO ] [MAIN ] WNS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:38.853081] [INFO ] [MAIN ] Update Progress: 2311/2371 symbols completed. WNS took 0.7s. Estimated remaining: 19.1s. Rate: 188.0 symbols/min [2025-09-29T02:09:39.117355] [DEBUG] [LOCAL ] WOR: Loaded 25288 existing records from primary storage. [2025-09-29T02:09:39.078898] [DEBUG] [LOCAL ] WOLF: Loaded 54312 existing records from primary storage. [2025-09-29T02:09:39.118137] [INFO ] [MAIN ] WOR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:39.118384] [INFO ] [MAIN ] Update Progress: 2312/2371 symbols completed. WOR took 0.6s. Estimated remaining: 18.8s. Rate: 188.1 symbols/min [2025-09-29T02:09:39.123413] [INFO ] [MAIN ] WOLF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:39.123211] [INFO ] [MAIN ] WOW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:39.141849] [INFO ] [MAIN ] Update Progress: 2313/2371 symbols completed. WOLF took 0.8s. Estimated remaining: 18.5s. Rate: 188.1 symbols/min [2025-09-29T02:09:39.201000] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-29T02:09:39.223567] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-05. [2025-09-29T02:09:39.526989] [INFO ] [MAIN ] WPC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:39.562704] [DEBUG] [LOCAL ] WOW: Loaded 30769 existing records from primary storage. [2025-09-29T02:09:39.568483] [INFO ] [MAIN ] WPM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:39.569551] [INFO ] [MAIN ] WOW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:39.573004] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-29T02:09:39.573451] [INFO ] [MAIN ] Update Progress: 2314/2371 symbols completed. WOW took 0.7s. Estimated remaining: 18.2s. Rate: 188.1 symbols/min [2025-09-29T02:09:39.577480] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-06. [2025-09-29T02:09:39.816794] [INFO ] [MAIN ] WPP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:39.820300] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-09-29T02:09:39.837827] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-07. [2025-09-29T02:09:39.840492] [DEBUG] [LOCAL ] WPC: Loaded 49217 existing records from primary storage. [2025-09-29T02:09:39.856403] [INFO ] [MAIN ] WPC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:39.858610] [INFO ] [MAIN ] Update Progress: 2315/2371 symbols completed. WPC took 0.7s. Estimated remaining: 17.9s. Rate: 188.1 symbols/min [2025-09-29T02:09:39.872123] [DEBUG] [LOCAL ] WPM: Loaded 53504 existing records from primary storage. [2025-09-29T02:09:39.912941] [INFO ] [MAIN ] WPM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:39.958372] [INFO ] [MAIN ] Update Progress: 2316/2371 symbols completed. WPM took 0.8s. Estimated remaining: 17.5s. Rate: 188.2 symbols/min [2025-09-29T02:09:40.116500] [DEBUG] [LOCAL ] WPP: Loaded 34282 existing records from primary storage. [2025-09-29T02:09:40.161615] [INFO ] [MAIN ] WPP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:40.163637] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-29T02:09:40.202503] [INFO ] [MAIN ] WRB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:40.203927] [INFO ] [MAIN ] Update Progress: 2317/2371 symbols completed. WPP took 0.6s. Estimated remaining: 17.2s. Rate: 188.2 symbols/min [2025-09-29T02:09:40.205551] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-08. [2025-09-29T02:09:40.291010] [INFO ] [MAIN ] WRBY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:40.356000] [DEBUG] [LOCAL ] WRB: Loaded 51313 existing records from primary storage. [2025-09-29T02:09:40.356666] [INFO ] [MAIN ] WRB: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:40.357216] [INFO ] [MAIN ] Update Progress: 2318/2371 symbols completed. WRB took 0.5s. Estimated remaining: 16.9s. Rate: 188.2 symbols/min [2025-09-29T02:09:40.383638] [DEBUG] [LOCAL ] WRBY: Loaded 51609 existing records from primary storage. [2025-09-29T02:09:40.384179] [INFO ] [MAIN ] WRBY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:40.384932] [INFO ] [MAIN ] Update Progress: 2319/2371 symbols completed. WRBY took 0.4s. Estimated remaining: 16.6s. Rate: 188.3 symbols/min [2025-09-29T02:09:40.525606] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-29T02:09:40.526883] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-09. [2025-09-29T02:09:40.737085] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-09 (0.21 seconds). [2025-09-29T02:09:40.738042] [INFO ] [REMOTE ] WLTG: Full fetch complete (1661 records). [2025-09-29T02:09:40.738158] [DEBUG] [VALIDATOR ] WLTG: Validating primary data. [2025-09-29T02:09:40.926975] [WARN ] [VALIDATOR ] WLTG: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-29T02:09:40.927235] [FATAL] [MAIN ] WLTG: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:09:40.927328] [WARN ] [MAIN ] WLTG: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:09:40.927426] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-09-29T02:09:40.927559] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-09-29T02:09:40.927679] [INFO ] [LOCAL ] WLTG: Starting deletion of derivative data. [2025-09-29T02:09:40.927785] [DEBUG] [LOCAL ] WLTG: No derivative data file found to delete. [2025-09-29T02:09:40.927875] [INFO ] [MAIN ] Update Progress: 2320/2371 symbols completed. WLTG took 5.2s. Estimated remaining: 16.3s. Rate: 188.2 symbols/min [2025-09-29T02:09:41.529684] [INFO ] [MAIN ] WSO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:41.619952] [INFO ] [MAIN ] WS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:41.640837] [INFO ] [MAIN ] WSR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:41.724550] [INFO ] [MAIN ] WSM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:41.758195] [DEBUG] [LOCAL ] WSO: Loaded 25059 existing records from primary storage. [2025-09-29T02:09:41.768590] [INFO ] [MAIN ] WSO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:41.768804] [INFO ] [MAIN ] Update Progress: 2321/2371 symbols completed. WSO took 0.8s. Estimated remaining: 15.9s. Rate: 188.1 symbols/min [2025-09-29T02:09:41.769454] [DEBUG] [LOCAL ] WS: Loaded 24434 existing records from primary storage. [2025-09-29T02:09:41.771091] [INFO ] [MAIN ] WS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:41.796787] [INFO ] [MAIN ] Update Progress: 2322/2371 symbols completed. WS took 0.9s. Estimated remaining: 15.6s. Rate: 188.2 symbols/min [2025-09-29T02:09:41.803423] [DEBUG] [LOCAL ] WSR: Loaded 23550 existing records from primary storage. [2025-09-29T02:09:41.816845] [INFO ] [MAIN ] WSR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:41.891369] [INFO ] [MAIN ] Update Progress: 2323/2371 symbols completed. WSR took 0.9s. Estimated remaining: 15.3s. Rate: 188.2 symbols/min [2025-09-29T02:09:42.228475] [INFO ] [MAIN ] WST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:42.268255] [DEBUG] [LOCAL ] WSM: Loaded 50533 existing records from primary storage. [2025-09-29T02:09:42.312366] [INFO ] [MAIN ] WSM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:42.326391] [INFO ] [MAIN ] Update Progress: 2324/2371 symbols completed. WSM took 1.4s. Estimated remaining: 15.0s. Rate: 188.2 symbols/min [2025-09-29T02:09:42.411322] [INFO ] [MAIN ] WT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:42.432288] [INFO ] [MAIN ] WTI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:42.598212] [DEBUG] [LOCAL ] WST: Loaded 38092 existing records from primary storage. [2025-09-29T02:09:42.652359] [INFO ] [MAIN ] WTM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:42.647712] [INFO ] [MAIN ] WST: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:42.663382] [INFO ] [MAIN ] Update Progress: 2325/2371 symbols completed. WST took 0.9s. Estimated remaining: 14.7s. Rate: 188.2 symbols/min [2025-09-29T02:09:42.678489] [DEBUG] [LOCAL ] WTM: No existing data file found in primary storage. [2025-09-29T02:09:42.705250] [WARN ] [MAIN ] WTM: No existing data found, performing full refresh instead. [2025-09-29T02:09:42.716779] [INFO ] [MAIN ] WTM: Wiping existing primary data before full refresh. [2025-09-29T02:09:42.732570] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-09-29T02:09:42.777249] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-09-29T02:09:42.822242] [DEBUG] [LOCAL ] WT: Loaded 48354 existing records from primary storage. [2025-09-29T02:09:42.849233] [INFO ] [MAIN ] WTM: Starting full primary refresh. [2025-09-29T02:09:42.843918] [DEBUG] [LOCAL ] WTI: Loaded 44472 existing records from primary storage. [2025-09-29T02:09:42.921468] [INFO ] [MAIN ] WT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:42.878221] [INFO ] [MAIN ] WTI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:42.942460] [INFO ] [MAIN ] Update Progress: 2326/2371 symbols completed. WT took 1.1s. Estimated remaining: 14.3s. Rate: 188.2 symbols/min [2025-09-29T02:09:42.952304] [INFO ] [MAIN ] WTRG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:42.982316] [INFO ] [MAIN ] Update Progress: 2327/2371 symbols completed. WTI took 1.0s. Estimated remaining: 14.0s. Rate: 188.3 symbols/min [2025-09-29T02:09:43.445766] [INFO ] [MAIN ] WTS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:43.591633] [INFO ] [MAIN ] WTTR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:43.729878] [INFO ] [REMOTE ] WTM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:09:43.731775] [DEBUG] [LOCAL ] WTRG: Loaded 51656 existing records from primary storage. [2025-09-29T02:09:43.732570] [INFO ] [REMOTE ] WTM: Fetching primary data for 2024-12. [2025-09-29T02:09:43.734133] [INFO ] [MAIN ] WTRG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:43.734268] [INFO ] [MAIN ] Update Progress: 2328/2371 symbols completed. WTRG took 1.1s. Estimated remaining: 13.7s. Rate: 188.2 symbols/min [2025-09-29T02:09:43.790026] [DEBUG] [LOCAL ] WTS: Loaded 18597 existing records from primary storage. [2025-09-29T02:09:43.796136] [INFO ] [MAIN ] WTS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:43.816256] [INFO ] [MAIN ] Update Progress: 2329/2371 symbols completed. WTS took 0.8s. Estimated remaining: 13.4s. Rate: 188.2 symbols/min [2025-09-29T02:09:44.077079] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-09-29T02:09:43.952333] [DEBUG] [LOCAL ] WTTR: Loaded 45735 existing records from primary storage. [2025-09-29T02:09:44.056128] [INFO ] [MAIN ] WU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:44.094134] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-01. [2025-09-29T02:09:44.106520] [INFO ] [MAIN ] WTTR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:44.131056] [INFO ] [MAIN ] Update Progress: 2330/2371 symbols completed. WTTR took 1.1s. Estimated remaining: 13.1s. Rate: 188.2 symbols/min [2025-09-29T02:09:44.274772] [INFO ] [MAIN ] WWW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:44.441538] [INFO ] [MAIN ] WY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:44.463560] [DEBUG] [LOCAL ] WU: Loaded 54232 existing records from primary storage. [2025-09-29T02:09:44.464223] [INFO ] [MAIN ] WU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:44.464677] [INFO ] [MAIN ] Update Progress: 2331/2371 symbols completed. WU took 0.7s. Estimated remaining: 12.7s. Rate: 188.2 symbols/min [2025-09-29T02:09:44.556055] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-29T02:09:44.596007] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-02. [2025-09-29T02:09:44.633112] [DEBUG] [LOCAL ] WWW: Loaded 49906 existing records from primary storage. [2025-09-29T02:09:44.662061] [INFO ] [MAIN ] WWW: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:44.676472] [INFO ] [MAIN ] Update Progress: 2332/2371 symbols completed. WWW took 0.8s. Estimated remaining: 12.4s. Rate: 188.3 symbols/min [2025-09-29T02:09:44.719201] [INFO ] [MAIN ] XFLT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:44.855249] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-09-29T02:09:44.864296] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-03. [2025-09-29T02:09:44.857031] [DEBUG] [LOCAL ] WY: Loaded 53899 existing records from primary storage. [2025-09-29T02:09:44.869890] [INFO ] [MAIN ] WY: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:44.876673] [INFO ] [MAIN ] Update Progress: 2333/2371 symbols completed. WY took 0.7s. Estimated remaining: 12.1s. Rate: 188.3 symbols/min [2025-09-29T02:09:45.001768] [INFO ] [MAIN ] XHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:45.103853] [DEBUG] [LOCAL ] XFLT: Loaded 30306 existing records from primary storage. [2025-09-29T02:09:45.164614] [INFO ] [MAIN ] XFLT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:45.169299] [INFO ] [MAIN ] XIFR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:45.173305] [INFO ] [MAIN ] Update Progress: 2334/2371 symbols completed. XFLT took 0.7s. Estimated remaining: 11.8s. Rate: 188.3 symbols/min [2025-09-29T02:09:45.173439] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-29T02:09:45.173684] [DEBUG] [LOCAL ] XIFR: No existing data file found in primary storage. [2025-09-29T02:09:45.174188] [WARN ] [MAIN ] XIFR: No existing data found, performing full refresh instead. [2025-09-29T02:09:45.181269] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-04. [2025-09-29T02:09:45.217190] [INFO ] [MAIN ] XIFR: Wiping existing primary data before full refresh. [2025-09-29T02:09:45.241735] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-09-29T02:09:45.289744] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-09-29T02:09:45.296542] [INFO ] [MAIN ] XIFR: Starting full primary refresh. [2025-09-29T02:09:45.517545] [INFO ] [MAIN ] XOM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:45.519258] [DEBUG] [LOCAL ] XHR: Loaded 44680 existing records from primary storage. [2025-09-29T02:09:45.522973] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-29T02:09:45.544527] [INFO ] [MAIN ] XHR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:45.551345] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-05. [2025-09-29T02:09:45.574576] [INFO ] [MAIN ] Update Progress: 2335/2371 symbols completed. XHR took 0.9s. Estimated remaining: 11.5s. Rate: 188.3 symbols/min [2025-09-29T02:09:45.855369] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-09-29T02:09:45.894627] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-06. [2025-09-29T02:09:46.025638] [INFO ] [MAIN ] XPER: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:46.052226] [INFO ] [REMOTE ] XIFR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:09:46.053172] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2024-12. [2025-09-29T02:09:46.073778] [DEBUG] [LOCAL ] XOM: Loaded 54573 existing records from primary storage. [2025-09-29T02:09:46.074409] [INFO ] [MAIN ] XOM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:46.074519] [INFO ] [MAIN ] Update Progress: 2336/2371 symbols completed. XOM took 0.9s. Estimated remaining: 11.2s. Rate: 188.2 symbols/min [2025-09-29T02:09:46.216624] [DEBUG] [REMOTE ] XIFR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:09:46.250363] [WARN ] [REMOTE ] XIFR: No data returned for month 2024-12 [2025-09-29T02:09:46.243984] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-29T02:09:46.267493] [FATAL] [REMOTE ] XIFR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:09:46.267371] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-07. [2025-09-29T02:09:46.267636] [FATAL] [MAIN ] XIFR: Failed to fetch primary data. [2025-09-29T02:09:46.345779] [WARN ] [MAIN ] XIFR: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:09:46.344333] [DEBUG] [LOCAL ] XPER: Loaded 30181 existing records from primary storage. [2025-09-29T02:09:46.345616] [INFO ] [MAIN ] XPEV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:46.345934] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-09-29T02:09:46.347761] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-09-29T02:09:46.347862] [INFO ] [LOCAL ] XIFR: Starting deletion of derivative data. [2025-09-29T02:09:46.347978] [DEBUG] [LOCAL ] XIFR: No derivative data file found to delete. [2025-09-29T02:09:46.348167] [INFO ] [MAIN ] Update Progress: 2337/2371 symbols completed. XIFR took 1.4s. Estimated remaining: 10.8s. Rate: 188.2 symbols/min [2025-09-29T02:09:46.346488] [INFO ] [MAIN ] XPER: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:46.397277] [INFO ] [MAIN ] Update Progress: 2338/2371 symbols completed. XPER took 0.8s. Estimated remaining: 10.5s. Rate: 188.3 symbols/min [2025-09-29T02:09:46.691890] [INFO ] [MAIN ] XPO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:46.711431] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-29T02:09:46.767900] [INFO ] [MAIN ] XPOF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:46.770449] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-08. [2025-09-29T02:09:46.792256] [DEBUG] [LOCAL ] XPEV: Loaded 54419 existing records from primary storage. [2025-09-29T02:09:46.793679] [INFO ] [MAIN ] XPEV: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:46.794326] [INFO ] [MAIN ] Update Progress: 2339/2371 symbols completed. XPEV took 0.7s. Estimated remaining: 10.2s. Rate: 188.3 symbols/min [2025-09-29T02:09:47.046229] [INFO ] [MAIN ] XPRO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:47.047958] [DEBUG] [LOCAL ] XPO: Loaded 48656 existing records from primary storage. [2025-09-29T02:09:47.048789] [DEBUG] [LOCAL ] XPOF: Loaded 39243 existing records from primary storage. [2025-09-29T02:09:47.049572] [INFO ] [MAIN ] XPOF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:47.049807] [INFO ] [MAIN ] Update Progress: 2340/2371 symbols completed. XPOF took 0.6s. Estimated remaining: 9.9s. Rate: 188.3 symbols/min [2025-09-29T02:09:47.049951] [INFO ] [MAIN ] XPO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:47.056046] [INFO ] [MAIN ] Update Progress: 2341/2371 symbols completed. XPO took 0.7s. Estimated remaining: 9.6s. Rate: 188.4 symbols/min [2025-09-29T02:09:47.092692] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-29T02:09:47.150512] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-09. [2025-09-29T02:09:47.474343] [INFO ] [MAIN ] XYL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:47.478588] [INFO ] [MAIN ] XYF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:47.482783] [DEBUG] [LOCAL ] XPRO: Loaded 46617 existing records from primary storage. [2025-09-29T02:09:47.483517] [INFO ] [MAIN ] XPRO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:47.483668] [INFO ] [MAIN ] Update Progress: 2342/2371 symbols completed. XPRO took 0.7s. Estimated remaining: 9.2s. Rate: 188.4 symbols/min [2025-09-29T02:09:47.675378] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-29T02:09:47.694430] [DEBUG] [LOCAL ] XYF: Loaded 28464 existing records from primary storage. [2025-09-29T02:09:47.716842] [INFO ] [MAIN ] XYZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:47.733472] [INFO ] [REMOTE ] WTM: Full fetch complete (2277 records). [2025-09-29T02:09:47.733579] [DEBUG] [LOCAL ] XYZ: No existing data file found in primary storage. [2025-09-29T02:09:47.733861] [INFO ] [MAIN ] XYF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:47.734563] [INFO ] [MAIN ] Update Progress: 2343/2371 symbols completed. XYF took 0.7s. Estimated remaining: 8.9s. Rate: 188.4 symbols/min [2025-09-29T02:09:47.734110] [DEBUG] [VALIDATOR ] WTM: Validating primary data. [2025-09-29T02:09:47.735346] [WARN ] [MAIN ] XYZ: No existing data found, performing full refresh instead. [2025-09-29T02:09:47.746319] [INFO ] [MAIN ] XYZ: Wiping existing primary data before full refresh. [2025-09-29T02:09:47.824733] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-09-29T02:09:47.912595] [DEBUG] [LOCAL ] XYL: Loaded 48777 existing records from primary storage. [2025-09-29T02:09:47.912706] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-09-29T02:09:47.987888] [INFO ] [MAIN ] XYZ: Starting full primary refresh. [2025-09-29T02:09:47.973937] [INFO ] [MAIN ] XYL: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:48.019219] [INFO ] [MAIN ] Update Progress: 2344/2371 symbols completed. XYL took 0.9s. Estimated remaining: 8.6s. Rate: 188.4 symbols/min [2025-09-29T02:09:48.294887] [WARN ] [VALIDATOR ] WTM: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-29T02:09:48.371733] [FATAL] [MAIN ] WTM: Fetched primary data is invalid. Refusing to save it. [2025-09-29T02:09:48.378985] [WARN ] [MAIN ] WTM: Deleting existing primary and derivative data due to validation failure. [2025-09-29T02:09:48.378785] [INFO ] [MAIN ] YALA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:48.407560] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-09-29T02:09:48.413378] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-09-29T02:09:48.464719] [INFO ] [LOCAL ] WTM: Starting deletion of derivative data. [2025-09-29T02:09:48.498476] [DEBUG] [LOCAL ] WTM: No derivative data file found to delete. [2025-09-29T02:09:48.499009] [INFO ] [MAIN ] Update Progress: 2345/2371 symbols completed. WTM took 6.1s. Estimated remaining: 8.3s. Rate: 188.3 symbols/min [2025-09-29T02:09:48.634006] [INFO ] [MAIN ] YELP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:48.864520] [DEBUG] [LOCAL ] YALA: Loaded 37892 existing records from primary storage. [2025-09-29T02:09:48.904813] [INFO ] [MAIN ] YALA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:48.905026] [INFO ] [MAIN ] Update Progress: 2346/2371 symbols completed. YALA took 1.2s. Estimated remaining: 8.0s. Rate: 188.3 symbols/min [2025-09-29T02:09:49.118830] [INFO ] [REMOTE ] XYZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-29T02:09:49.070933] [INFO ] [MAIN ] YETI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:49.129507] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2024-12. [2025-09-29T02:09:49.182072] [DEBUG] [LOCAL ] YELP: Loaded 45909 existing records from primary storage. [2025-09-29T02:09:49.201372] [INFO ] [MAIN ] YELP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:49.239799] [INFO ] [MAIN ] Update Progress: 2347/2371 symbols completed. YELP took 1.2s. Estimated remaining: 7.6s. Rate: 188.3 symbols/min [2025-09-29T02:09:49.293696] [INFO ] [MAIN ] YEXT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:49.300949] [DEBUG] [REMOTE ] XYZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T02:09:49.324708] [WARN ] [REMOTE ] XYZ: No data returned for month 2024-12 [2025-09-29T02:09:49.340135] [FATAL] [REMOTE ] XYZ: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T02:09:49.361415] [FATAL] [MAIN ] XYZ: Failed to fetch primary data. [2025-09-29T02:09:49.367048] [WARN ] [MAIN ] XYZ: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T02:09:49.391579] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-09-29T02:09:49.397255] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-09-29T02:09:49.413281] [INFO ] [LOCAL ] XYZ: Starting deletion of derivative data. [2025-09-29T02:09:49.464297] [DEBUG] [LOCAL ] XYZ: No derivative data file found to delete. [2025-09-29T02:09:49.491079] [INFO ] [MAIN ] Update Progress: 2348/2371 symbols completed. XYZ took 2.0s. Estimated remaining: 7.3s. Rate: 188.3 symbols/min [2025-09-29T02:09:49.496865] [INFO ] [MAIN ] YMM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:49.639739] [DEBUG] [LOCAL ] YETI: Loaded 53216 existing records from primary storage. [2025-09-29T02:09:49.660074] [DEBUG] [LOCAL ] YEXT: Loaded 43863 existing records from primary storage. [2025-09-29T02:09:49.660850] [INFO ] [MAIN ] YETI: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:49.677431] [INFO ] [MAIN ] YEXT: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:49.688887] [INFO ] [MAIN ] Update Progress: 2349/2371 symbols completed. YETI took 1.1s. Estimated remaining: 7.0s. Rate: 188.4 symbols/min [2025-09-29T02:09:49.743986] [INFO ] [MAIN ] Update Progress: 2350/2371 symbols completed. YEXT took 0.8s. Estimated remaining: 6.7s. Rate: 188.4 symbols/min [2025-09-29T02:09:49.749464] [INFO ] [MAIN ] YOU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:50.124691] [INFO ] [MAIN ] YRD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:50.099710] [DEBUG] [LOCAL ] YMM: Loaded 53425 existing records from primary storage. [2025-09-29T02:09:50.167296] [INFO ] [MAIN ] YMM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:50.206624] [INFO ] [MAIN ] YPF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:50.207381] [INFO ] [MAIN ] Update Progress: 2351/2371 symbols completed. YMM took 1.0s. Estimated remaining: 6.4s. Rate: 188.4 symbols/min [2025-09-29T02:09:50.347118] [DEBUG] [LOCAL ] YOU: Loaded 50504 existing records from primary storage. [2025-09-29T02:09:50.376084] [INFO ] [MAIN ] YOU: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:50.365537] [DEBUG] [LOCAL ] YRD: Loaded 12726 existing records from primary storage. [2025-09-29T02:09:50.404557] [INFO ] [MAIN ] Update Progress: 2352/2371 symbols completed. YOU took 0.9s. Estimated remaining: 6.0s. Rate: 188.4 symbols/min [2025-09-29T02:09:50.415091] [INFO ] [MAIN ] YRD: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:50.471130] [INFO ] [MAIN ] Update Progress: 2353/2371 symbols completed. YRD took 0.7s. Estimated remaining: 5.7s. Rate: 188.5 symbols/min [2025-09-29T02:09:50.501741] [INFO ] [MAIN ] YSG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:50.606417] [DEBUG] [LOCAL ] YPF: Loaded 51252 existing records from primary storage. [2025-09-29T02:09:50.672990] [INFO ] [MAIN ] YPF: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:50.695531] [INFO ] [MAIN ] Update Progress: 2354/2371 symbols completed. YPF took 1.0s. Estimated remaining: 5.4s. Rate: 188.5 symbols/min [2025-09-29T02:09:50.873312] [INFO ] [MAIN ] YUM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:51.000010] [INFO ] [MAIN ] YUMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:51.103877] [DEBUG] [LOCAL ] YSG: Loaded 25485 existing records from primary storage. [2025-09-29T02:09:51.128676] [INFO ] [MAIN ] YSG: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:51.129408] [INFO ] [MAIN ] Update Progress: 2355/2371 symbols completed. YSG took 0.9s. Estimated remaining: 5.1s. Rate: 188.5 symbols/min [2025-09-29T02:09:51.128315] [INFO ] [MAIN ] ZBH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:51.385393] [INFO ] [MAIN ] ZEPP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:51.405468] [DEBUG] [LOCAL ] YUMC: Loaded 53455 existing records from primary storage. [2025-09-29T02:09:51.407977] [DEBUG] [LOCAL ] YUM: Loaded 51931 existing records from primary storage. [2025-09-29T02:09:51.408263] [INFO ] [MAIN ] YUMC: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:51.408890] [INFO ] [MAIN ] YUM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:51.409117] [INFO ] [MAIN ] Update Progress: 2356/2371 symbols completed. YUM took 1.0s. Estimated remaining: 4.8s. Rate: 188.5 symbols/min [2025-09-29T02:09:51.421981] [INFO ] [MAIN ] Update Progress: 2357/2371 symbols completed. YUMC took 0.8s. Estimated remaining: 4.5s. Rate: 188.6 symbols/min [2025-09-29T02:09:51.553068] [DEBUG] [LOCAL ] ZEPP: Loaded 17335 existing records from primary storage. [2025-09-29T02:09:51.591916] [INFO ] [MAIN ] ZEPP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:51.602628] [INFO ] [MAIN ] Update Progress: 2358/2371 symbols completed. ZEPP took 0.5s. Estimated remaining: 4.1s. Rate: 188.6 symbols/min [2025-09-29T02:09:51.659390] [INFO ] [MAIN ] ZETA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:51.627586] [DEBUG] [LOCAL ] ZBH: Loaded 51948 existing records from primary storage. [2025-09-29T02:09:51.660919] [INFO ] [MAIN ] ZBH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:51.661674] [INFO ] [MAIN ] Update Progress: 2359/2371 symbols completed. ZBH took 0.9s. Estimated remaining: 3.8s. Rate: 188.7 symbols/min [2025-09-29T02:09:51.722906] [DEBUG] [LOCAL ] ZETA: Loaded 54375 existing records from primary storage. [2025-09-29T02:09:51.723429] [INFO ] [MAIN ] ZETA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:51.723535] [INFO ] [MAIN ] Update Progress: 2360/2371 symbols completed. ZETA took 0.3s. Estimated remaining: 3.5s. Rate: 188.7 symbols/min [2025-09-29T02:09:52.440557] [INFO ] [MAIN ] ZGN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:52.483869] [INFO ] [MAIN ] ZH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:52.509344] [INFO ] [MAIN ] ZIM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:52.533448] [INFO ] [MAIN ] ZIP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:52.579059] [DEBUG] [LOCAL ] ZH: Loaded 27298 existing records from primary storage. [2025-09-29T02:09:52.581052] [INFO ] [MAIN ] ZH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:52.593363] [INFO ] [MAIN ] Update Progress: 2361/2371 symbols completed. ZH took 0.9s. Estimated remaining: 3.2s. Rate: 188.6 symbols/min [2025-09-29T02:09:52.611563] [DEBUG] [LOCAL ] ZGN: Loaded 41333 existing records from primary storage. [2025-09-29T02:09:52.666479] [INFO ] [MAIN ] ZGN: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:52.710183] [INFO ] [MAIN ] Update Progress: 2362/2371 symbols completed. ZGN took 1.0s. Estimated remaining: 2.9s. Rate: 188.7 symbols/min [2025-09-29T02:09:52.843156] [DEBUG] [LOCAL ] ZIP: Loaded 44952 existing records from primary storage. [2025-09-29T02:09:52.845162] [DEBUG] [LOCAL ] ZIM: Loaded 54298 existing records from primary storage. [2025-09-29T02:09:52.880235] [INFO ] [MAIN ] ZIP: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:52.880733] [INFO ] [MAIN ] ZIM: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:52.880564] [INFO ] [MAIN ] Update Progress: 2363/2371 symbols completed. ZIP took 1.2s. Estimated remaining: 2.5s. Rate: 188.7 symbols/min [2025-09-29T02:09:52.913035] [INFO ] [MAIN ] Update Progress: 2364/2371 symbols completed. ZIM took 1.1s. Estimated remaining: 2.2s. Rate: 188.8 symbols/min [2025-09-29T02:09:53.111284] [INFO ] [MAIN ] ZK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:53.251837] [INFO ] [MAIN ] ZKH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:53.409391] [INFO ] [MAIN ] ZTO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:53.437717] [DEBUG] [LOCAL ] ZKH: Loaded 8119 existing records from primary storage. [2025-09-29T02:09:53.460723] [INFO ] [MAIN ] ZKH: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:53.483974] [INFO ] [MAIN ] ZTR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:53.484621] [INFO ] [MAIN ] Update Progress: 2365/2371 symbols completed. ZKH took 0.8s. Estimated remaining: 1.9s. Rate: 188.7 symbols/min [2025-09-29T02:09:53.574952] [DEBUG] [LOCAL ] ZK: Loaded 40504 existing records from primary storage. [2025-09-29T02:09:53.611283] [INFO ] [MAIN ] ZK: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:53.647842] [INFO ] [MAIN ] Update Progress: 2366/2371 symbols completed. ZK took 1.1s. Estimated remaining: 1.6s. Rate: 188.7 symbols/min [2025-09-29T02:09:53.670092] [DEBUG] [LOCAL ] ZTR: Loaded 16911 existing records from primary storage. [2025-09-29T02:09:53.697334] [INFO ] [MAIN ] ZTR: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:53.765771] [INFO ] [MAIN ] Update Progress: 2367/2371 symbols completed. ZTR took 0.8s. Estimated remaining: 1.3s. Rate: 188.8 symbols/min [2025-09-29T02:09:53.798715] [INFO ] [MAIN ] ZTS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:53.910035] [DEBUG] [LOCAL ] ZTO: Loaded 50751 existing records from primary storage. [2025-09-29T02:09:53.952488] [INFO ] [MAIN ] ZTO: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:53.952635] [INFO ] [MAIN ] Update Progress: 2368/2371 symbols completed. ZTO took 1.0s. Estimated remaining: 1.0s. Rate: 188.8 symbols/min [2025-09-29T02:09:54.089563] [INFO ] [MAIN ] ZVIA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:54.184808] [INFO ] [MAIN ] ZWS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-29T02:09:54.217981] [DEBUG] [LOCAL ] ZTS: Loaded 53775 existing records from primary storage. [2025-09-29T02:09:54.218766] [INFO ] [MAIN ] ZTS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:54.218975] [INFO ] [MAIN ] Update Progress: 2369/2371 symbols completed. ZTS took 0.7s. Estimated remaining: 0.6s. Rate: 188.8 symbols/min [2025-09-29T02:09:54.231905] [DEBUG] [LOCAL ] ZVIA: Loaded 35966 existing records from primary storage. [2025-09-29T02:09:54.232321] [INFO ] [MAIN ] ZVIA: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:54.232788] [INFO ] [MAIN ] Update Progress: 2370/2371 symbols completed. ZVIA took 0.6s. Estimated remaining: 0.3s. Rate: 188.9 symbols/min [2025-09-29T02:09:54.267819] [DEBUG] [LOCAL ] ZWS: Loaded 43134 existing records from primary storage. [2025-09-29T02:09:54.268227] [INFO ] [MAIN ] ZWS: Data is already up-to-date (last day: 2025-09-26). Skipping. [2025-09-29T02:09:54.268383] [INFO ] [MAIN ] Update Progress: 2371/2371 symbols completed. ZWS took 0.4s. Estimated remaining: 0.0s. Rate: 189.0 symbols/min [2025-09-29T02:09:54.269613] [INFO ] [MAIN ] Parallel update completed in 12m 33s [2025-09-29T02:09:54.269852] [WARN ] [MAIN ] Failed symbols (160): AAMI, AAUC, AAM, AD, AEXA, AHL, AII, AKA, AMBQ, AMRZ... [2025-09-29T02:09:54.269933] [INFO ] [MAIN ] Update success rate: 93.3% (2211/2371 symbols) [2025-09-29T02:09:54.844447] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Primary Update Completed (2211/2371 @ 93.25%)' [2025-09-29T02:09:54.845110] [INFO ] [MAIN ] Primary update successful. Now generating derivatives... [2025-09-29T02:09:54.845220] [INFO ] [MAIN ] Refreshing symbols list before derivative generation... [2025-09-29T02:09:54.845312] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-09-29T02:09:54.845481] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-09-29T02:09:54.845561] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-09-29T02:09:56.395234] [DEBUG] [SYMBOL ] Found 2423 valid NYSE symbols. [2025-09-29T02:09:56.395446] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-09-29T02:09:56.395815] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-09-29T02:09:56.397012] [INFO ] [LOCAL ] Symbols cache updated with 2371 symbols. [2025-09-29T02:09:56.397117] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-09-29T02:09:56.397235] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-09-29T02:09:56.397408] [INFO ] [MAIN ] Pruning stale symbols... [2025-09-29T02:09:56.397497] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-09-29T02:09:56.397596] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-29T02:09:56.398244] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-09-29T02:09:56.398341] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-29T02:09:56.398638] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-09-29T02:09:56.398766] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2371 valid symbols. [2025-09-29T02:09:56.398874] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-09-29T02:09:56.398964] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-09-29T02:09:56.429173] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-09-29T02:09:56.460009] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-09-29T02:09:56.460216] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-09-29T02:09:56.460305] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-09-29T02:09:56.460394] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-09-29T02:09:56.460506] [INFO ] [MAIN ] Running derivative generation in parallel mode [2025-09-29T02:09:56.460590] [INFO ] [MAIN ] Wiping all existing derivative data before regeneration. [2025-09-29T02:09:56.460730] [INFO ] [LOCAL ] Starting deletion of all local derivative data. [2025-09-29T02:09:56.462765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CINT.csv [2025-09-29T02:09:56.463117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMC.csv [2025-09-29T02:09:56.463489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FF.csv [2025-09-29T02:09:56.463887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLOW.csv [2025-09-29T02:09:56.464258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTN.csv [2025-09-29T02:09:56.464583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBR.csv [2025-09-29T02:09:56.464863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTI.csv [2025-09-29T02:09:56.465170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TX.csv [2025-09-29T02:09:56.465440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTZ.csv [2025-09-29T02:09:56.465750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSF.csv [2025-09-29T02:09:56.466107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTZ.csv [2025-09-29T02:09:56.466423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERO.csv [2025-09-29T02:09:56.466731] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPP.csv [2025-09-29T02:09:56.467024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OBDC.csv [2025-09-29T02:09:56.467307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLL.csv [2025-09-29T02:09:56.467571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HII.csv [2025-09-29T02:09:56.467889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MX.csv [2025-09-29T02:09:56.468267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSI.csv [2025-09-29T02:09:56.468532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGD.csv [2025-09-29T02:09:56.468742] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMWL.csv [2025-09-29T02:09:56.469036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDST.csv [2025-09-29T02:09:56.469300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEN.csv [2025-09-29T02:09:56.469575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGO.csv [2025-09-29T02:09:56.469858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRK.csv [2025-09-29T02:09:56.470123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRL.csv [2025-09-29T02:09:56.470375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXYZ.csv [2025-09-29T02:09:56.470629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPFD.csv [2025-09-29T02:09:56.470817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMX.csv [2025-09-29T02:09:56.470996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BV.csv [2025-09-29T02:09:56.471259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYN.csv [2025-09-29T02:09:56.471533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHE.csv [2025-09-29T02:09:56.471887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/D.csv [2025-09-29T02:09:56.472173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACV.csv [2025-09-29T02:09:56.472465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZC.csv [2025-09-29T02:09:56.472715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NABL.csv [2025-09-29T02:09:56.472963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SII.csv [2025-09-29T02:09:56.473234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCV.csv [2025-09-29T02:09:56.473477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNK.csv [2025-09-29T02:09:56.473683] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADM.csv [2025-09-29T02:09:56.473886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIN.csv [2025-09-29T02:09:56.474291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNX.csv [2025-09-29T02:09:56.474583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TREX.csv [2025-09-29T02:09:56.474880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTST.csv [2025-09-29T02:09:56.475114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKM.csv [2025-09-29T02:09:56.475402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCF.csv [2025-09-29T02:09:56.475627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITC.csv [2025-09-29T02:09:56.475899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLGN.csv [2025-09-29T02:09:56.476154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MRK.csv [2025-09-29T02:09:56.476429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVN.csv [2025-09-29T02:09:56.476680] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGI.csv [2025-09-29T02:09:56.476943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEPU.csv [2025-09-29T02:09:56.477115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPX.csv [2025-09-29T02:09:56.477329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTB.csv [2025-09-29T02:09:56.477484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AAT.csv [2025-09-29T02:09:56.477690] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEN.csv [2025-09-29T02:09:56.477959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMS.csv [2025-09-29T02:09:56.478287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSV.csv [2025-09-29T02:09:56.478561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VKQ.csv [2025-09-29T02:09:56.478801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNNE.csv [2025-09-29T02:09:56.479074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVX.csv [2025-09-29T02:09:56.479339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLNK.csv [2025-09-29T02:09:56.479616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINV.csv [2025-09-29T02:09:56.479988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/S.csv [2025-09-29T02:09:56.480251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSS.csv [2025-09-29T02:09:56.480533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JELD.csv [2025-09-29T02:09:56.480806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JKS.csv [2025-09-29T02:09:56.481123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOS.csv [2025-09-29T02:09:56.481374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCA.csv [2025-09-29T02:09:56.481664] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAT.csv [2025-09-29T02:09:56.481901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QUAD.csv [2025-09-29T02:09:56.482147] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUR.csv [2025-09-29T02:09:56.482446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNB.csv [2025-09-29T02:09:56.482725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRMB.csv [2025-09-29T02:09:56.482896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTE.csv [2025-09-29T02:09:56.483081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPI.csv [2025-09-29T02:09:56.483329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAZ.csv [2025-09-29T02:09:56.483589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDS.csv [2025-09-29T02:09:56.483925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YPF.csv [2025-09-29T02:09:56.484385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTL.csv [2025-09-29T02:09:56.484713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UFI.csv [2025-09-29T02:09:56.485001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFC.csv [2025-09-29T02:09:56.485312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEO.csv [2025-09-29T02:09:56.485560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTHY.csv [2025-09-29T02:09:56.485846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPHR.csv [2025-09-29T02:09:56.486093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCV.csv [2025-09-29T02:09:56.486402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNW.csv [2025-09-29T02:09:56.486636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BP.csv [2025-09-29T02:09:56.490400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRC.csv [2025-09-29T02:09:56.490627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BB.csv [2025-09-29T02:09:56.490972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDOT.csv [2025-09-29T02:09:56.491288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVS.csv [2025-09-29T02:09:56.491540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVR.csv [2025-09-29T02:09:56.491785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNST.csv [2025-09-29T02:09:56.492035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OSCR.csv [2025-09-29T02:09:56.492288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVGS.csv [2025-09-29T02:09:56.492536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMF.csv [2025-09-29T02:09:56.492716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALL.csv [2025-09-29T02:09:56.492913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVB.csv [2025-09-29T02:09:56.493170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OR.csv [2025-09-29T02:09:56.493445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIPR.csv [2025-09-29T02:09:56.493599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMR.csv [2025-09-29T02:09:56.493891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVH.csv [2025-09-29T02:09:56.494141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLCO.csv [2025-09-29T02:09:56.494379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVI.csv [2025-09-29T02:09:56.494692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WY.csv [2025-09-29T02:09:56.494884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BR.csv [2025-09-29T02:09:56.495151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGLS.csv [2025-09-29T02:09:56.495399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TD.csv [2025-09-29T02:09:56.495833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAG.csv [2025-09-29T02:09:56.496136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMU.csv [2025-09-29T02:09:56.496404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYL.csv [2025-09-29T02:09:56.496630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUMN.csv [2025-09-29T02:09:56.496953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIX.csv [2025-09-29T02:09:56.497234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMA.csv [2025-09-29T02:09:56.497440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPFI.csv [2025-09-29T02:09:56.497678] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGR.csv [2025-09-29T02:09:56.497844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGD.csv [2025-09-29T02:09:56.498061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHF.csv [2025-09-29T02:09:56.498313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBX.csv [2025-09-29T02:09:56.498516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENO.csv [2025-09-29T02:09:56.498787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPB.csv [2025-09-29T02:09:56.499032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DECK.csv [2025-09-29T02:09:56.499160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBC.csv [2025-09-29T02:09:56.499421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTY.csv [2025-09-29T02:09:56.499691] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPG.csv [2025-09-29T02:09:56.499927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUZ.csv [2025-09-29T02:09:56.500172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRX.csv [2025-09-29T02:09:56.500418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIPO.csv [2025-09-29T02:09:56.500635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPI.csv [2025-09-29T02:09:56.500917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/H.csv [2025-09-29T02:09:56.501140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNQ.csv [2025-09-29T02:09:56.501375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAY.csv [2025-09-29T02:09:56.501607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEQ.csv [2025-09-29T02:09:56.501854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSM.csv [2025-09-29T02:09:56.502251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIT.csv [2025-09-29T02:09:56.502475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTRG.csv [2025-09-29T02:09:56.502742] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGP.csv [2025-09-29T02:09:56.502972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPOR.csv [2025-09-29T02:09:56.503141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVTR.csv [2025-09-29T02:09:56.503360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRH.csv [2025-09-29T02:09:56.503732] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCPT.csv [2025-09-29T02:09:56.503966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFN.csv [2025-09-29T02:09:56.504199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAE.csv [2025-09-29T02:09:56.504448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOL.csv [2025-09-29T02:09:56.504726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYB.csv [2025-09-29T02:09:56.504971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNF.csv [2025-09-29T02:09:56.505190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOR.csv [2025-09-29T02:09:56.505429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IMAX.csv [2025-09-29T02:09:56.505624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PG.csv [2025-09-29T02:09:56.505803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZN.csv [2025-09-29T02:09:56.506035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WS.csv [2025-09-29T02:09:56.506255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAL.csv [2025-09-29T02:09:56.506478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLR.csv [2025-09-29T02:09:56.506672] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BK.csv [2025-09-29T02:09:56.506942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIM.csv [2025-09-29T02:09:56.507145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCN.csv [2025-09-29T02:09:56.507390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNY.csv [2025-09-29T02:09:56.507603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLO.csv [2025-09-29T02:09:56.507888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGVT.csv [2025-09-29T02:09:56.508131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOV.csv [2025-09-29T02:09:56.508337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPR.csv [2025-09-29T02:09:56.508562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTL.csv [2025-09-29T02:09:56.508809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KWR.csv [2025-09-29T02:09:56.508981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AORT.csv [2025-09-29T02:09:56.509144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWNB.csv [2025-09-29T02:09:56.509391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAN.csv [2025-09-29T02:09:56.509665] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGN.csv [2025-09-29T02:09:56.509951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAPL.csv [2025-09-29T02:09:56.510146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USB.csv [2025-09-29T02:09:56.510370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGT.csv [2025-09-29T02:09:56.510555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMY.csv [2025-09-29T02:09:56.510800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLO.csv [2025-09-29T02:09:56.511029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCS.csv [2025-09-29T02:09:56.511351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YSG.csv [2025-09-29T02:09:56.511577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATO.csv [2025-09-29T02:09:56.511909] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSL.csv [2025-09-29T02:09:56.512115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NREF.csv [2025-09-29T02:09:56.512275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFG.csv [2025-09-29T02:09:56.512488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIVI.csv [2025-09-29T02:09:56.512741] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNT.csv [2025-09-29T02:09:56.512944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIM.csv [2025-09-29T02:09:56.513111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRT.csv [2025-09-29T02:09:56.513271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAI.csv [2025-09-29T02:09:56.513498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMO.csv [2025-09-29T02:09:56.513723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRB.csv [2025-09-29T02:09:56.513936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTH.csv [2025-09-29T02:09:56.514092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRO.csv [2025-09-29T02:09:56.514337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCN.csv [2025-09-29T02:09:56.514516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDT.csv [2025-09-29T02:09:56.514743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFSI.csv [2025-09-29T02:09:56.515183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNG.csv [2025-09-29T02:09:56.515415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXU.csv [2025-09-29T02:09:56.515630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRGP.csv [2025-09-29T02:09:56.515819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMEZ.csv [2025-09-29T02:09:56.516066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHAL.csv [2025-09-29T02:09:56.516279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOB.csv [2025-09-29T02:09:56.516500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPER.csv [2025-09-29T02:09:56.516726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPH.csv [2025-09-29T02:09:56.516961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WST.csv [2025-09-29T02:09:56.517191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPK.csv [2025-09-29T02:09:56.517417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GL.csv [2025-09-29T02:09:56.517637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRS.csv [2025-09-29T02:09:56.517861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FR.csv [2025-09-29T02:09:56.518073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIM.csv [2025-09-29T02:09:56.518306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTR.csv [2025-09-29T02:09:56.518550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MD.csv [2025-09-29T02:09:56.518818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NFJ.csv [2025-09-29T02:09:56.519073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHI.csv [2025-09-29T02:09:56.519334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRG.csv [2025-09-29T02:09:56.519540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHW.csv [2025-09-29T02:09:56.519884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACM.csv [2025-09-29T02:09:56.520102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKE.csv [2025-09-29T02:09:56.520347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWAN.csv [2025-09-29T02:09:56.520575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPA.csv [2025-09-29T02:09:56.520756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEE.csv [2025-09-29T02:09:56.520986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTR.csv [2025-09-29T02:09:56.521196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFA.csv [2025-09-29T02:09:56.521401] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNV.csv [2025-09-29T02:09:56.521669] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNOW.csv [2025-09-29T02:09:56.521932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBZ.csv [2025-09-29T02:09:56.522134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPMC.csv [2025-09-29T02:09:56.522309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIO.csv [2025-09-29T02:09:56.522453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWA.csv [2025-09-29T02:09:56.522716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYE.csv [2025-09-29T02:09:56.522942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRI.csv [2025-09-29T02:09:56.523115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNY.csv [2025-09-29T02:09:56.523369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGG.csv [2025-09-29T02:09:56.523560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARR.csv [2025-09-29T02:09:56.523874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYT.csv [2025-09-29T02:09:56.524128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPC.csv [2025-09-29T02:09:56.524380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUT.csv [2025-09-29T02:09:56.524633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSD.csv [2025-09-29T02:09:56.525020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHC.csv [2025-09-29T02:09:56.525260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLB.csv [2025-09-29T02:09:56.525431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNED.csv [2025-09-29T02:09:56.525673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXC.csv [2025-09-29T02:09:56.525835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWLP.csv [2025-09-29T02:09:56.526117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNA.csv [2025-09-29T02:09:56.526361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFG.csv [2025-09-29T02:09:56.526586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NU.csv [2025-09-29T02:09:56.526870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXNM.csv [2025-09-29T02:09:56.527058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGI.csv [2025-09-29T02:09:56.527297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ULS.csv [2025-09-29T02:09:56.527573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNI.csv [2025-09-29T02:09:56.527856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFS.csv [2025-09-29T02:09:56.528064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BC.csv [2025-09-29T02:09:56.528366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSD.csv [2025-09-29T02:09:56.528583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSG.csv [2025-09-29T02:09:56.528858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYL.csv [2025-09-29T02:09:56.529105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIMB.csv [2025-09-29T02:09:56.529341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EE.csv [2025-09-29T02:09:56.529582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPS.csv [2025-09-29T02:09:56.529850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRK.csv [2025-09-29T02:09:56.530045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZ.csv [2025-09-29T02:09:56.530341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAC.csv [2025-09-29T02:09:56.530564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVEO.csv [2025-09-29T02:09:56.530864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HI.csv [2025-09-29T02:09:56.531131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSCI.csv [2025-09-29T02:09:56.531412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNG.csv [2025-09-29T02:09:56.531627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLNG.csv [2025-09-29T02:09:56.531892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRD.csv [2025-09-29T02:09:56.532150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNN.csv [2025-09-29T02:09:56.532344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABEV.csv [2025-09-29T02:09:56.532530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAC.csv [2025-09-29T02:09:56.532827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRBR.csv [2025-09-29T02:09:56.533112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONTO.csv [2025-09-29T02:09:56.533428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SF.csv [2025-09-29T02:09:56.533708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMI.csv [2025-09-29T02:09:56.533963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHN.csv [2025-09-29T02:09:56.534200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGZ.csv [2025-09-29T02:09:56.534493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAN.csv [2025-09-29T02:09:56.534823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMBT.csv [2025-09-29T02:09:56.535245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QD.csv [2025-09-29T02:09:56.535486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VICI.csv [2025-09-29T02:09:56.535695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACI.csv [2025-09-29T02:09:56.535949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHG.csv [2025-09-29T02:09:56.536239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRDY.csv [2025-09-29T02:09:56.536439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDN.csv [2025-09-29T02:09:56.536599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AX.csv [2025-09-29T02:09:56.536810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHK.csv [2025-09-29T02:09:56.537090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPC.csv [2025-09-29T02:09:56.537253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRX.csv [2025-09-29T02:09:56.537471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRC.csv [2025-09-29T02:09:56.537768] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAM.csv [2025-09-29T02:09:56.537950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHE.csv [2025-09-29T02:09:56.538174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBER.csv [2025-09-29T02:09:56.538434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEO.csv [2025-09-29T02:09:56.538693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEI.csv [2025-09-29T02:09:56.538953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RXO.csv [2025-09-29T02:09:56.539104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AJG.csv [2025-09-29T02:09:56.539356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTN.csv [2025-09-29T02:09:56.539548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTT.csv [2025-09-29T02:09:56.539746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFB.csv [2025-09-29T02:09:56.540025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFLY.csv [2025-09-29T02:09:56.540275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBU.csv [2025-09-29T02:09:56.540518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHY.csv [2025-09-29T02:09:56.540799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BH.csv [2025-09-29T02:09:56.541078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITGR.csv [2025-09-29T02:09:56.541369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBD.csv [2025-09-29T02:09:56.541606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRV.csv [2025-09-29T02:09:56.541866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MRC.csv [2025-09-29T02:09:56.542112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOR.csv [2025-09-29T02:09:56.542322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGL.csv [2025-09-29T02:09:56.542560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWT.csv [2025-09-29T02:09:56.542815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUS.csv [2025-09-29T02:09:56.543038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFZ.csv [2025-09-29T02:09:56.543277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLK.csv [2025-09-29T02:09:56.543555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WD.csv [2025-09-29T02:09:56.544003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BVN.csv [2025-09-29T02:09:56.544318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEAV.csv [2025-09-29T02:09:56.544531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHN.csv [2025-09-29T02:09:56.544788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WK.csv [2025-09-29T02:09:56.545098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHWY.csv [2025-09-29T02:09:56.545325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSL.csv [2025-09-29T02:09:56.545615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMR.csv [2025-09-29T02:09:56.545991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLY.csv [2025-09-29T02:09:56.546234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGF.csv [2025-09-29T02:09:56.546464] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEL.csv [2025-09-29T02:09:56.546728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCG.csv [2025-09-29T02:09:56.547022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRBK.csv [2025-09-29T02:09:56.547252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOLV.csv [2025-09-29T02:09:56.547498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIXT.csv [2025-09-29T02:09:56.547797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBRK.csv [2025-09-29T02:09:56.548014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOG.csv [2025-09-29T02:09:56.548258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COMP.csv [2025-09-29T02:09:56.548550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LRN.csv [2025-09-29T02:09:56.548839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGA.csv [2025-09-29T02:09:56.549097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXC.csv [2025-09-29T02:09:56.549324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUN.csv [2025-09-29T02:09:56.549542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHI.csv [2025-09-29T02:09:56.549822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEG.csv [2025-09-29T02:09:56.550102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMT.csv [2025-09-29T02:09:56.550380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LC.csv [2025-09-29T02:09:56.550609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ES.csv [2025-09-29T02:09:56.550911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BARK.csv [2025-09-29T02:09:56.551172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYTR.csv [2025-09-29T02:09:56.551407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHG.csv [2025-09-29T02:09:56.551672] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OKE.csv [2025-09-29T02:09:56.551911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HESM.csv [2025-09-29T02:09:56.552141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XHR.csv [2025-09-29T02:09:56.552416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TROX.csv [2025-09-29T02:09:56.552737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNW.csv [2025-09-29T02:09:56.552969] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDV.csv [2025-09-29T02:09:56.553144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BILL.csv [2025-09-29T02:09:56.553376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFD.csv [2025-09-29T02:09:56.553606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHX.csv [2025-09-29T02:09:56.553858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRBY.csv [2025-09-29T02:09:56.554187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REZI.csv [2025-09-29T02:09:56.554402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STC.csv [2025-09-29T02:09:56.554666] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQI.csv [2025-09-29T02:09:56.554911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCI.csv [2025-09-29T02:09:56.555090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCX.csv [2025-09-29T02:09:56.555340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOC.csv [2025-09-29T02:09:56.555557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIC.csv [2025-09-29T02:09:56.555745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATGE.csv [2025-09-29T02:09:56.555897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPC.csv [2025-09-29T02:09:56.556058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALUR.csv [2025-09-29T02:09:56.556321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRI.csv [2025-09-29T02:09:56.556561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEE.csv [2025-09-29T02:09:56.556853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHK.csv [2025-09-29T02:09:56.557066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIMN.csv [2025-09-29T02:09:56.557292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLD.csv [2025-09-29T02:09:56.557499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKE.csv [2025-09-29T02:09:56.557800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLXR.csv [2025-09-29T02:09:56.558047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPM.csv [2025-09-29T02:09:56.558279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTS.csv [2025-09-29T02:09:56.558499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDI.csv [2025-09-29T02:09:56.558710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APTV.csv [2025-09-29T02:09:56.559162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLI.csv [2025-09-29T02:09:56.559404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QSR.csv [2025-09-29T02:09:56.559605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSV.csv [2025-09-29T02:09:56.559829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAA.csv [2025-09-29T02:09:56.560052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THS.csv [2025-09-29T02:09:56.560287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDIV.csv [2025-09-29T02:09:56.560473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BALL.csv [2025-09-29T02:09:56.560772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IR.csv [2025-09-29T02:09:56.561002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODV.csv [2025-09-29T02:09:56.561246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDL.csv [2025-09-29T02:09:56.561458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVLG.csv [2025-09-29T02:09:56.561748] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMI.csv [2025-09-29T02:09:56.561976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNF.csv [2025-09-29T02:09:56.562259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CW.csv [2025-09-29T02:09:56.562494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBCI.csv [2025-09-29T02:09:56.562746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRDN.csv [2025-09-29T02:09:56.562974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYI.csv [2025-09-29T02:09:56.563217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PACK.csv [2025-09-29T02:09:56.563446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COP.csv [2025-09-29T02:09:56.563686] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMT.csv [2025-09-29T02:09:56.563949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLYM.csv [2025-09-29T02:09:56.564201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DINO.csv [2025-09-29T02:09:56.564437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAC.csv [2025-09-29T02:09:56.564736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMG.csv [2025-09-29T02:09:56.564912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AU.csv [2025-09-29T02:09:56.565075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AKR.csv [2025-09-29T02:09:56.565342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPG.csv [2025-09-29T02:09:56.565548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMM.csv [2025-09-29T02:09:56.565824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHF.csv [2025-09-29T02:09:56.565992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPH.csv [2025-09-29T02:09:56.566166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADT.csv [2025-09-29T02:09:56.566374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLDR.csv [2025-09-29T02:09:56.566533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIT.csv [2025-09-29T02:09:56.566809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTS.csv [2025-09-29T02:09:56.567082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBF.csv [2025-09-29T02:09:56.567263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARCO.csv [2025-09-29T02:09:56.567525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBHC.csv [2025-09-29T02:09:56.567754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNC.csv [2025-09-29T02:09:56.568020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHC.csv [2025-09-29T02:09:56.568279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SG.csv [2025-09-29T02:09:56.568533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPT.csv [2025-09-29T02:09:56.568898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THLV.csv [2025-09-29T02:09:56.569105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXTA.csv [2025-09-29T02:09:56.569322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDDT.csv [2025-09-29T02:09:56.569564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MA.csv [2025-09-29T02:09:56.569839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APAM.csv [2025-09-29T02:09:56.569999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADC.csv [2025-09-29T02:09:56.570329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIRT.csv [2025-09-29T02:09:56.570583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAR.csv [2025-09-29T02:09:56.570841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIG.csv [2025-09-29T02:09:56.571063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTG.csv [2025-09-29T02:09:56.571266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BW.csv [2025-09-29T02:09:56.571510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRA.csv [2025-09-29T02:09:56.571740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATUS.csv [2025-09-29T02:09:56.571959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MODG.csv [2025-09-29T02:09:56.572178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AQNB.csv [2025-09-29T02:09:56.572457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STK.csv [2025-09-29T02:09:56.572887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWZ.csv [2025-09-29T02:09:56.573053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABR.csv [2025-09-29T02:09:56.573333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARIS.csv [2025-09-29T02:09:56.573709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATR.csv [2025-09-29T02:09:56.573935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFXT.csv [2025-09-29T02:09:56.574127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CF.csv [2025-09-29T02:09:56.574340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTBB.csv [2025-09-29T02:09:56.574500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GROV.csv [2025-09-29T02:09:56.574717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLX.csv [2025-09-29T02:09:56.574912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRGY.csv [2025-09-29T02:09:56.575178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLVT.csv [2025-09-29T02:09:56.575371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HHH.csv [2025-09-29T02:09:56.575564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTO.csv [2025-09-29T02:09:56.575861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEA.csv [2025-09-29T02:09:56.576073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OXM.csv [2025-09-29T02:09:56.576201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUD.csv [2025-09-29T02:09:56.576380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRAK.csv [2025-09-29T02:09:56.576607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPG.csv [2025-09-29T02:09:56.576871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIG.csv [2025-09-29T02:09:56.577019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDC.csv [2025-09-29T02:09:56.577217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVV.csv [2025-09-29T02:09:56.577406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPC.csv [2025-09-29T02:09:56.577572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IH.csv [2025-09-29T02:09:56.577847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VZ.csv [2025-09-29T02:09:56.578059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECL.csv [2025-09-29T02:09:56.578272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTH.csv [2025-09-29T02:09:56.578466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUM.csv [2025-09-29T02:09:56.578718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTVA.csv [2025-09-29T02:09:56.578952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXT.csv [2025-09-29T02:09:56.579102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSTS.csv [2025-09-29T02:09:56.579303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESS.csv [2025-09-29T02:09:56.579427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALK.csv [2025-09-29T02:09:56.579592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FICO.csv [2025-09-29T02:09:56.579805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USA.csv [2025-09-29T02:09:56.580264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNC.csv [2025-09-29T02:09:56.580419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSB.csv [2025-09-29T02:09:56.580668] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSCO.csv [2025-09-29T02:09:56.580861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KF.csv [2025-09-29T02:09:56.581137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DVA.csv [2025-09-29T02:09:56.581362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPRU.csv [2025-09-29T02:09:56.581573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFN.csv [2025-09-29T02:09:56.581922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPB.csv [2025-09-29T02:09:56.582143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXK.csv [2025-09-29T02:09:56.582290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKKT.csv [2025-09-29T02:09:56.582514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHGG.csv [2025-09-29T02:09:56.582725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIS.csv [2025-09-29T02:09:56.582919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHOC.csv [2025-09-29T02:09:56.583145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBGS.csv [2025-09-29T02:09:56.583292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKV.csv [2025-09-29T02:09:56.583422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVD.csv [2025-09-29T02:09:56.583634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KLC.csv [2025-09-29T02:09:56.583813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLQT.csv [2025-09-29T02:09:56.584172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVRR.csv [2025-09-29T02:09:56.584381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMB.csv [2025-09-29T02:09:56.584544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASBA.csv [2025-09-29T02:09:56.584742] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVNA.csv [2025-09-29T02:09:56.584934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGR.csv [2025-09-29T02:09:56.585174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBXG.csv [2025-09-29T02:09:56.585393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BZH.csv [2025-09-29T02:09:56.585536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACA.csv [2025-09-29T02:09:56.585757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRA.csv [2025-09-29T02:09:56.585977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPP.csv [2025-09-29T02:09:56.586319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGR.csv [2025-09-29T02:09:56.586565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEI.csv [2025-09-29T02:09:56.586795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KB.csv [2025-09-29T02:09:56.586955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGL.csv [2025-09-29T02:09:56.587078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEFC.csv [2025-09-29T02:09:56.587317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUI.csv [2025-09-29T02:09:56.587500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAI.csv [2025-09-29T02:09:56.587702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CULP.csv [2025-09-29T02:09:56.587900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHEL.csv [2025-09-29T02:09:56.588116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNT.csv [2025-09-29T02:09:56.588350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETV.csv [2025-09-29T02:09:56.588560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WM.csv [2025-09-29T02:09:56.588783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CURV.csv [2025-09-29T02:09:56.589071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDW.csv [2025-09-29T02:09:56.589257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COLD.csv [2025-09-29T02:09:56.589485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYH.csv [2025-09-29T02:09:56.589698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BJ.csv [2025-09-29T02:09:56.589924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THW.csv [2025-09-29T02:09:56.590155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAGS.csv [2025-09-29T02:09:56.590335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNO.csv [2025-09-29T02:09:56.590563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXG.csv [2025-09-29T02:09:56.591244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COUR.csv [2025-09-29T02:09:56.591535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CP.csv [2025-09-29T02:09:56.591794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCK.csv [2025-09-29T02:09:56.592108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVT.csv [2025-09-29T02:09:56.592239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHR.csv [2025-09-29T02:09:56.592459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDN.csv [2025-09-29T02:09:56.592743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPRO.csv [2025-09-29T02:09:56.592949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSA.csv [2025-09-29T02:09:56.593175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHC.csv [2025-09-29T02:09:56.593344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTU.csv [2025-09-29T02:09:56.593754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLTO.csv [2025-09-29T02:09:56.593969] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEI.csv [2025-09-29T02:09:56.594172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBM.csv [2025-09-29T02:09:56.594289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXR.csv [2025-09-29T02:09:56.594507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAT.csv [2025-09-29T02:09:56.594763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LION.csv [2025-09-29T02:09:56.594957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXC.csv [2025-09-29T02:09:56.595218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVX.csv [2025-09-29T02:09:56.595372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGR.csv [2025-09-29T02:09:56.595557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPOT.csv [2025-09-29T02:09:56.595796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEM.csv [2025-09-29T02:09:56.595945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWP.csv [2025-09-29T02:09:56.596256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLTY.csv [2025-09-29T02:09:56.596478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBAN.csv [2025-09-29T02:09:56.596722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RHI.csv [2025-09-29T02:09:56.597067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HXL.csv [2025-09-29T02:09:56.597273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHT.csv [2025-09-29T02:09:56.597407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AQN.csv [2025-09-29T02:09:56.597606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROG.csv [2025-09-29T02:09:56.597841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VALE.csv [2025-09-29T02:09:56.598101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRM.csv [2025-09-29T02:09:56.598304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CION.csv [2025-09-29T02:09:56.598514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMS.csv [2025-09-29T02:09:56.598661] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWR.csv [2025-09-29T02:09:56.598852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFR.csv [2025-09-29T02:09:56.599052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFC.csv [2025-09-29T02:09:56.599279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRT.csv [2025-09-29T02:09:56.599502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GENI.csv [2025-09-29T02:09:56.599704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VFC.csv [2025-09-29T02:09:56.599978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMFG.csv [2025-09-29T02:09:56.600193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECC.csv [2025-09-29T02:09:56.600441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGTY.csv [2025-09-29T02:09:56.600754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DCI.csv [2025-09-29T02:09:56.600967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NJR.csv [2025-09-29T02:09:56.601227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CR.csv [2025-09-29T02:09:56.601430] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENFY.csv [2025-09-29T02:09:56.601716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFI.csv [2025-09-29T02:09:56.602024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OC.csv [2025-09-29T02:09:56.602226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SM.csv [2025-09-29T02:09:56.602446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHD.csv [2025-09-29T02:09:56.602666] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CB.csv [2025-09-29T02:09:56.602859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGG.csv [2025-09-29T02:09:56.603004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APO.csv [2025-09-29T02:09:56.603206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDT.csv [2025-09-29T02:09:56.603402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTM.csv [2025-09-29T02:09:56.603596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TJX.csv [2025-09-29T02:09:56.603755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMN.csv [2025-09-29T02:09:56.603898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHH.csv [2025-09-29T02:09:56.604089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYI.csv [2025-09-29T02:09:56.604329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBDC.csv [2025-09-29T02:09:56.604507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOAH.csv [2025-09-29T02:09:56.604704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPR.csv [2025-09-29T02:09:56.604918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTG.csv [2025-09-29T02:09:56.605049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARI.csv [2025-09-29T02:09:56.605488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOS.csv [2025-09-29T02:09:56.605686] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GETY.csv [2025-09-29T02:09:56.605839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKH.csv [2025-09-29T02:09:56.606030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRH.csv [2025-09-29T02:09:56.606197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HKD.csv [2025-09-29T02:09:56.606367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAB.csv [2025-09-29T02:09:56.606602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REVG.csv [2025-09-29T02:09:56.606801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SIG.csv [2025-09-29T02:09:56.606982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZZ.csv [2025-09-29T02:09:56.607155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRT.csv [2025-09-29T02:09:56.607375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITUB.csv [2025-09-29T02:09:56.607496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXP.csv [2025-09-29T02:09:56.607678] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HASI.csv [2025-09-29T02:09:56.607807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNS.csv [2025-09-29T02:09:56.607995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SILA.csv [2025-09-29T02:09:56.608173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIW.csv [2025-09-29T02:09:56.608374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NX.csv [2025-09-29T02:09:56.608546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGRE.csv [2025-09-29T02:09:56.608749] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNC.csv [2025-09-29T02:09:56.608961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCDL.csv [2025-09-29T02:09:56.609175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HR.csv [2025-09-29T02:09:56.609353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBE.csv [2025-09-29T02:09:56.609544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRND.csv [2025-09-29T02:09:56.609796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCTS.csv [2025-09-29T02:09:56.609968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNX.csv [2025-09-29T02:09:56.610161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBX.csv [2025-09-29T02:09:56.610283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACCO.csv [2025-09-29T02:09:56.610458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTEX.csv [2025-09-29T02:09:56.610580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AL.csv [2025-09-29T02:09:56.610866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEX.csv [2025-09-29T02:09:56.611052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NC.csv [2025-09-29T02:09:56.611269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNL.csv [2025-09-29T02:09:56.611439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VATE.csv [2025-09-29T02:09:56.611617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFS.csv [2025-09-29T02:09:56.611841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDS.csv [2025-09-29T02:09:56.611970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWK.csv [2025-09-29T02:09:56.612168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EARN.csv [2025-09-29T02:09:56.612417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNP.csv [2025-09-29T02:09:56.612611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRI.csv [2025-09-29T02:09:56.612838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOI.csv [2025-09-29T02:09:56.613031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSB.csv [2025-09-29T02:09:56.613225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FG.csv [2025-09-29T02:09:56.613466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKT.csv [2025-09-29T02:09:56.613681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVE.csv [2025-09-29T02:09:56.613877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNR.csv [2025-09-29T02:09:56.614083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUV.csv [2025-09-29T02:09:56.614326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RL.csv [2025-09-29T02:09:56.614533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXT.csv [2025-09-29T02:09:56.614751] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLE.csv [2025-09-29T02:09:56.614935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHMI.csv [2025-09-29T02:09:56.615157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LW.csv [2025-09-29T02:09:56.615324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTWO.csv [2025-09-29T02:09:56.615518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/J.csv [2025-09-29T02:09:56.615744] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAE.csv [2025-09-29T02:09:56.615887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXS.csv [2025-09-29T02:09:56.616095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONON.csv [2025-09-29T02:09:56.616301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFY.csv [2025-09-29T02:09:56.616498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSN.csv [2025-09-29T02:09:56.616720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLYS.csv [2025-09-29T02:09:56.616916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBRE.csv [2025-09-29T02:09:56.617225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWO.csv [2025-09-29T02:09:56.617442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFB.csv [2025-09-29T02:09:56.617801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSA.csv [2025-09-29T02:09:56.618013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDY.csv [2025-09-29T02:09:56.618213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLG.csv [2025-09-29T02:09:56.618420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIA.csv [2025-09-29T02:09:56.618806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNGR.csv [2025-09-29T02:09:56.619004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNET.csv [2025-09-29T02:09:56.619241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEM.csv [2025-09-29T02:09:56.619461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNL.csv [2025-09-29T02:09:56.619636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBND.csv [2025-09-29T02:09:56.619884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTB.csv [2025-09-29T02:09:56.620100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBI.csv [2025-09-29T02:09:56.620294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESAB.csv [2025-09-29T02:09:56.620446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDJ.csv [2025-09-29T02:09:56.620671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SONY.csv [2025-09-29T02:09:56.620871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOC.csv [2025-09-29T02:09:56.621075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPL.csv [2025-09-29T02:09:56.621272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAC.csv [2025-09-29T02:09:56.621475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PD.csv [2025-09-29T02:09:56.621717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JXN.csv [2025-09-29T02:09:56.621893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOT.csv [2025-09-29T02:09:56.622076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDI.csv [2025-09-29T02:09:56.622211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABM.csv [2025-09-29T02:09:56.622421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCUS.csv [2025-09-29T02:09:56.622625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNRC.csv [2025-09-29T02:09:56.622859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIY.csv [2025-09-29T02:09:56.623044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIA.csv [2025-09-29T02:09:56.623234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITP.csv [2025-09-29T02:09:56.623433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DG.csv [2025-09-29T02:09:56.623671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MANU.csv [2025-09-29T02:09:56.623869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHD.csv [2025-09-29T02:09:56.624092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXE.csv [2025-09-29T02:09:56.624322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELME.csv [2025-09-29T02:09:56.624745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XOM.csv [2025-09-29T02:09:56.626504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIPS.csv [2025-09-29T02:09:56.626700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOL.csv [2025-09-29T02:09:56.626942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPO.csv [2025-09-29T02:09:56.627124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GD.csv [2025-09-29T02:09:56.627318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPYP.csv [2025-09-29T02:09:56.627495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRGV.csv [2025-09-29T02:09:56.627703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTF.csv [2025-09-29T02:09:56.627887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVRI.csv [2025-09-29T02:09:56.628066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDP.csv [2025-09-29T02:09:56.628262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RERE.csv [2025-09-29T02:09:56.628391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBU.csv [2025-09-29T02:09:56.628595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMO.csv [2025-09-29T02:09:56.628800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STNG.csv [2025-09-29T02:09:56.628974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHT.csv [2025-09-29T02:09:56.629155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPAC.csv [2025-09-29T02:09:56.629343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VYX.csv [2025-09-29T02:09:56.629516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNI.csv [2025-09-29T02:09:56.629750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETO.csv [2025-09-29T02:09:56.629940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCO.csv [2025-09-29T02:09:56.630108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUK.csv [2025-09-29T02:09:56.630296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVS.csv [2025-09-29T02:09:56.630484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JFR.csv [2025-09-29T02:09:56.630679] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RELX.csv [2025-09-29T02:09:56.630850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IEX.csv [2025-09-29T02:09:56.631051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MET.csv [2025-09-29T02:09:56.631229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OLN.csv [2025-09-29T02:09:56.631397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBS.csv [2025-09-29T02:09:56.631584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAI.csv [2025-09-29T02:09:56.631807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQNS.csv [2025-09-29T02:09:56.632013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETN.csv [2025-09-29T02:09:56.632189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVYO.csv [2025-09-29T02:09:56.632364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVR.csv [2025-09-29T02:09:56.632550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMI.csv [2025-09-29T02:09:56.632756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECVT.csv [2025-09-29T02:09:56.632945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VET.csv [2025-09-29T02:09:56.633112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENIC.csv [2025-09-29T02:09:56.633307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBS.csv [2025-09-29T02:09:56.633519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTV.csv [2025-09-29T02:09:56.633842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STM.csv [2025-09-29T02:09:56.634024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CII.csv [2025-09-29T02:09:56.634331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDI.csv [2025-09-29T02:09:56.634465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALTG.csv [2025-09-29T02:09:56.634661] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOCL.csv [2025-09-29T02:09:56.634840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBC.csv [2025-09-29T02:09:56.635006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSE.csv [2025-09-29T02:09:56.635133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIT.csv [2025-09-29T02:09:56.635361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAL.csv [2025-09-29T02:09:56.635554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHH.csv [2025-09-29T02:09:56.635735] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXC.csv [2025-09-29T02:09:56.635896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DUKB.csv [2025-09-29T02:09:56.636113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ED.csv [2025-09-29T02:09:56.636304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JGH.csv [2025-09-29T02:09:56.636475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMT.csv [2025-09-29T02:09:56.636708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RWT.csv [2025-09-29T02:09:56.636906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QGEN.csv [2025-09-29T02:09:56.637107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MC.csv [2025-09-29T02:09:56.637308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBTA.csv [2025-09-29T02:09:56.637521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APH.csv [2025-09-29T02:09:56.637819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NI.csv [2025-09-29T02:09:56.637981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWI.csv [2025-09-29T02:09:56.638143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAO.csv [2025-09-29T02:09:56.638346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UWMC.csv [2025-09-29T02:09:56.638575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFY.csv [2025-09-29T02:09:56.638802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEEV.csv [2025-09-29T02:09:56.638938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOC.csv [2025-09-29T02:09:56.639136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WES.csv [2025-09-29T02:09:56.639312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRS.csv [2025-09-29T02:09:56.639480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIPR.csv [2025-09-29T02:09:56.639899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMHI.csv [2025-09-29T02:09:56.640090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDD.csv [2025-09-29T02:09:56.640279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEM.csv [2025-09-29T02:09:56.640482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YETI.csv [2025-09-29T02:09:56.640685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/U.csv [2025-09-29T02:09:56.640877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAC.csv [2025-09-29T02:09:56.641058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KR.csv [2025-09-29T02:09:56.641368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCE.csv [2025-09-29T02:09:56.641604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBRT.csv [2025-09-29T02:09:56.641755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALEX.csv [2025-09-29T02:09:56.642000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNP.csv [2025-09-29T02:09:56.642205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOW.csv [2025-09-29T02:09:56.642390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBP.csv [2025-09-29T02:09:56.642600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEN.csv [2025-09-29T02:09:56.642879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAA.csv [2025-09-29T02:09:56.643079] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXRT.csv [2025-09-29T02:09:56.643241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKD.csv [2025-09-29T02:09:56.643449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUA.csv [2025-09-29T02:09:56.643699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SO.csv [2025-09-29T02:09:56.643903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JNJ.csv [2025-09-29T02:09:56.644194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGY.csv [2025-09-29T02:09:56.644406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LH.csv [2025-09-29T02:09:56.644670] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGR.csv [2025-09-29T02:09:56.644884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGS.csv [2025-09-29T02:09:56.645069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOOT.csv [2025-09-29T02:09:56.645184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AESI.csv [2025-09-29T02:09:56.645307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHS.csv [2025-09-29T02:09:56.645502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNA.csv [2025-09-29T02:09:56.645730] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSTM.csv [2025-09-29T02:09:56.645917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PUMP.csv [2025-09-29T02:09:56.646053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPH.csv [2025-09-29T02:09:56.646249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLX.csv [2025-09-29T02:09:56.646414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGE.csv [2025-09-29T02:09:56.646749] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAC.csv [2025-09-29T02:09:56.646979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVO.csv [2025-09-29T02:09:56.647150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTZ.csv [2025-09-29T02:09:56.647349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENVA.csv [2025-09-29T02:09:56.647530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAG.csv [2025-09-29T02:09:56.647700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWF.csv [2025-09-29T02:09:56.647920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYY.csv [2025-09-29T02:09:56.648048] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AP.csv [2025-09-29T02:09:56.648259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVR.csv [2025-09-29T02:09:56.648521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDP.csv [2025-09-29T02:09:56.648713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAN.csv [2025-09-29T02:09:56.648869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMN.csv [2025-09-29T02:09:56.649089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZH.csv [2025-09-29T02:09:56.649299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMAI.csv [2025-09-29T02:09:56.649484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMP.csv [2025-09-29T02:09:56.649731] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLF.csv [2025-09-29T02:09:56.649928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SD.csv [2025-09-29T02:09:56.650108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKLZ.csv [2025-09-29T02:09:56.650324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINS.csv [2025-09-29T02:09:56.650783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LANV.csv [2025-09-29T02:09:56.650937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALX.csv [2025-09-29T02:09:56.651136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBN.csv [2025-09-29T02:09:56.651346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFA.csv [2025-09-29T02:09:56.651565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDO.csv [2025-09-29T02:09:56.651991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYN.csv [2025-09-29T02:09:56.652192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKR.csv [2025-09-29T02:09:56.652393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CURB.csv [2025-09-29T02:09:56.652678] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HP.csv [2025-09-29T02:09:56.653007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCQ.csv [2025-09-29T02:09:56.653198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPR.csv [2025-09-29T02:09:56.653403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVT.csv [2025-09-29T02:09:56.653544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPJ.csv [2025-09-29T02:09:56.653748] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDL.csv [2025-09-29T02:09:56.653971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRIM.csv [2025-09-29T02:09:56.654163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIC.csv [2025-09-29T02:09:56.654355] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBH.csv [2025-09-29T02:09:56.654580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWK.csv [2025-09-29T02:09:56.654816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGP.csv [2025-09-29T02:09:56.655019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAM.csv [2025-09-29T02:09:56.655234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHC.csv [2025-09-29T02:09:56.655450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTI.csv [2025-09-29T02:09:56.655630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOLE.csv [2025-09-29T02:09:56.655848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHD.csv [2025-09-29T02:09:56.656060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMCM.csv [2025-09-29T02:09:56.656315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMO.csv [2025-09-29T02:09:56.656499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WWW.csv [2025-09-29T02:09:56.656662] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AI.csv [2025-09-29T02:09:56.656856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIO.csv [2025-09-29T02:09:56.657286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHM.csv [2025-09-29T02:09:56.657510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFP.csv [2025-09-29T02:09:56.657725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USFD.csv [2025-09-29T02:09:56.657945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOV.csv [2025-09-29T02:09:56.658185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVO.csv [2025-09-29T02:09:56.658413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDP.csv [2025-09-29T02:09:56.658632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSDL.csv [2025-09-29T02:09:56.658860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIGS.csv [2025-09-29T02:09:56.659077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTW.csv [2025-09-29T02:09:56.659251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MG.csv [2025-09-29T02:09:56.659413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODC.csv [2025-09-29T02:09:56.659609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOBY.csv [2025-09-29T02:09:56.659819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKR.csv [2025-09-29T02:09:56.659995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONL.csv [2025-09-29T02:09:56.660162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRI.csv [2025-09-29T02:09:56.660319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSL.csv [2025-09-29T02:09:56.660464] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGSF.csv [2025-09-29T02:09:56.660662] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNK.csv [2025-09-29T02:09:56.660848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/M.csv [2025-09-29T02:09:56.660989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCS.csv [2025-09-29T02:09:56.661117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGX.csv [2025-09-29T02:09:56.661286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIST.csv [2025-09-29T02:09:56.661504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMAX.csv [2025-09-29T02:09:56.661758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDC.csv [2025-09-29T02:09:56.662200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STE.csv [2025-09-29T02:09:56.662452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUPV.csv [2025-09-29T02:09:56.662705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAF.csv [2025-09-29T02:09:56.662909] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAP.csv [2025-09-29T02:09:56.663113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPR.csv [2025-09-29T02:09:56.663251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AYI.csv [2025-09-29T02:09:56.663436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LU.csv [2025-09-29T02:09:56.663687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPQ.csv [2025-09-29T02:09:56.663828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALV.csv [2025-09-29T02:09:56.664041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAXS.csv [2025-09-29T02:09:56.664242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMT.csv [2025-09-29T02:09:56.664439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEF.csv [2025-09-29T02:09:56.664666] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PVL.csv [2025-09-29T02:09:56.664808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBP.csv [2025-09-29T02:09:56.665004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHT.csv [2025-09-29T02:09:56.665198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGD.csv [2025-09-29T02:09:56.665381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LITB.csv [2025-09-29T02:09:56.665579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUN.csv [2025-09-29T02:09:56.665816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSKD.csv [2025-09-29T02:09:56.666052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UL.csv [2025-09-29T02:09:56.666256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXG.csv [2025-09-29T02:09:56.666477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATV.csv [2025-09-29T02:09:56.666711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOUR.csv [2025-09-29T02:09:56.666958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAZ.csv [2025-09-29T02:09:56.667131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AB.csv [2025-09-29T02:09:56.667372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBI.csv [2025-09-29T02:09:56.667598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUL.csv [2025-09-29T02:09:56.667826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLS.csv [2025-09-29T02:09:56.668031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELP.csv [2025-09-29T02:09:56.668239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DQ.csv [2025-09-29T02:09:56.668473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMG.csv [2025-09-29T02:09:56.668696] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHG.csv [2025-09-29T02:09:56.668927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPNG.csv [2025-09-29T02:09:56.669122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NDMO.csv [2025-09-29T02:09:56.669268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZO.csv [2025-09-29T02:09:56.669497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COOK.csv [2025-09-29T02:09:56.669721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHR.csv [2025-09-29T02:09:56.669958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUMC.csv [2025-09-29T02:09:56.670185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSBD.csv [2025-09-29T02:09:56.670391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOC.csv [2025-09-29T02:09:56.670574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKO.csv [2025-09-29T02:09:56.670808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSC.csv [2025-09-29T02:09:56.671060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGHC.csv [2025-09-29T02:09:56.671297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DX.csv [2025-09-29T02:09:56.671495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTW.csv [2025-09-29T02:09:56.671721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMK.csv [2025-09-29T02:09:56.671903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SID.csv [2025-09-29T02:09:56.672117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFPM.csv [2025-09-29T02:09:56.672311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDF.csv [2025-09-29T02:09:56.672520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPIR.csv [2025-09-29T02:09:56.672802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOF.csv [2025-09-29T02:09:56.672977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GYLD.csv [2025-09-29T02:09:56.673187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NYT.csv [2025-09-29T02:09:56.673380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMM.csv [2025-09-29T02:09:56.673496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMP.csv [2025-09-29T02:09:56.673720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DPG.csv [2025-09-29T02:09:56.673955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMO.csv [2025-09-29T02:09:56.674202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HE.csv [2025-09-29T02:09:56.674374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOD.csv [2025-09-29T02:09:56.674512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBW.csv [2025-09-29T02:09:56.674715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMO.csv [2025-09-29T02:09:56.674900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTRN.csv [2025-09-29T02:09:56.675140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WKC.csv [2025-09-29T02:09:56.675298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOS.csv [2025-09-29T02:09:56.675514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOF.csv [2025-09-29T02:09:56.675723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETR.csv [2025-09-29T02:09:56.675959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMT.csv [2025-09-29T02:09:56.676212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAL.csv [2025-09-29T02:09:56.676412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZVIA.csv [2025-09-29T02:09:56.676689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEVA.csv [2025-09-29T02:09:56.676897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOMD.csv [2025-09-29T02:09:56.677103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVS.csv [2025-09-29T02:09:56.677308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CL.csv [2025-09-29T02:09:56.677508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNF.csv [2025-09-29T02:09:56.677948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRW.csv [2025-09-29T02:09:56.678132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SST.csv [2025-09-29T02:09:56.678311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNCE.csv [2025-09-29T02:09:56.678528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNS.csv [2025-09-29T02:09:56.678745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUZ.csv [2025-09-29T02:09:56.678933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGV.csv [2025-09-29T02:09:56.679139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WT.csv [2025-09-29T02:09:56.679403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBI.csv [2025-09-29T02:09:56.679610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELAN.csv [2025-09-29T02:09:56.679942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCAT.csv [2025-09-29T02:09:56.680166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMS.csv [2025-09-29T02:09:56.680386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOP.csv [2025-09-29T02:09:56.680590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CX.csv [2025-09-29T02:09:56.680834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRB.csv [2025-09-29T02:09:56.681026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTB.csv [2025-09-29T02:09:56.681211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RH.csv [2025-09-29T02:09:56.681337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BROS.csv [2025-09-29T02:09:56.681514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNNT.csv [2025-09-29T02:09:56.681738] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSN.csv [2025-09-29T02:09:56.681944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXT.csv [2025-09-29T02:09:56.682133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTES.csv [2025-09-29T02:09:56.682324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPRK.csv [2025-09-29T02:09:56.682531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVF.csv [2025-09-29T02:09:56.682735] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMN.csv [2025-09-29T02:09:56.682950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OTIS.csv [2025-09-29T02:09:56.683074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCO.csv [2025-09-29T02:09:56.683280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTS.csv [2025-09-29T02:09:56.683444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRD.csv [2025-09-29T02:09:56.683629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRC.csv [2025-09-29T02:09:56.683944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRN.csv [2025-09-29T02:09:56.684299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFR.csv [2025-09-29T02:09:56.684484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DK.csv [2025-09-29T02:09:56.684680] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPN.csv [2025-09-29T02:09:56.684851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BURL.csv [2025-09-29T02:09:56.685081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTD.csv [2025-09-29T02:09:56.685290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHG.csv [2025-09-29T02:09:56.685484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LLY.csv [2025-09-29T02:09:56.685667] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMA.csv [2025-09-29T02:09:56.685865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CALX.csv [2025-09-29T02:09:56.686052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DVN.csv [2025-09-29T02:09:56.686246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIW.csv [2025-09-29T02:09:56.686426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCO.csv [2025-09-29T02:09:56.686693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SREA.csv [2025-09-29T02:09:56.686914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDG.csv [2025-09-29T02:09:56.687129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBR.csv [2025-09-29T02:09:56.687514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEA.csv [2025-09-29T02:09:56.687724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSR.csv [2025-09-29T02:09:56.687904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATEN.csv [2025-09-29T02:09:56.688093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STLA.csv [2025-09-29T02:09:56.688288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMC.csv [2025-09-29T02:09:56.688472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXV.csv [2025-09-29T02:09:56.688745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLOB.csv [2025-09-29T02:09:56.688948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMG.csv [2025-09-29T02:09:56.689106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVA.csv [2025-09-29T02:09:56.689320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YMM.csv [2025-09-29T02:09:56.689495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YALA.csv [2025-09-29T02:09:56.689719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IP.csv [2025-09-29T02:09:56.689863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVY.csv [2025-09-29T02:09:56.690049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNO.csv [2025-09-29T02:09:56.690253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEXA.csv [2025-09-29T02:09:56.690444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMHC.csv [2025-09-29T02:09:56.690706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPC.csv [2025-09-29T02:09:56.690889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/K.csv [2025-09-29T02:09:56.691072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HDB.csv [2025-09-29T02:09:56.691290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAFE.csv [2025-09-29T02:09:56.691424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHM.csv [2025-09-29T02:09:56.691669] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QTWO.csv [2025-09-29T02:09:56.691892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOK.csv [2025-09-29T02:09:56.692074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPCE.csv [2025-09-29T02:09:56.692273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOAR.csv [2025-09-29T02:09:56.692814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPF.csv [2025-09-29T02:09:56.693098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFX.csv [2025-09-29T02:09:56.693295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLIO.csv [2025-09-29T02:09:56.693502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDR.csv [2025-09-29T02:09:56.693719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMX.csv [2025-09-29T02:09:56.693887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RTO.csv [2025-09-29T02:09:56.694343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTO.csv [2025-09-29T02:09:56.694524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOA.csv [2025-09-29T02:09:56.694725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLS.csv [2025-09-29T02:09:56.694923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TM.csv [2025-09-29T02:09:56.695098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERJ.csv [2025-09-29T02:09:56.695266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNC.csv [2025-09-29T02:09:56.695585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPLX.csv [2025-09-29T02:09:56.695800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PX.csv [2025-09-29T02:09:56.695992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MED.csv [2025-09-29T02:09:56.696198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPE.csv [2025-09-29T02:09:56.696390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIK.csv [2025-09-29T02:09:56.696602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGR.csv [2025-09-29T02:09:56.696842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFWM.csv [2025-09-29T02:09:56.697032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPF.csv [2025-09-29T02:09:56.697249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSI.csv [2025-09-29T02:09:56.697434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDU.csv [2025-09-29T02:09:56.697661] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTMX.csv [2025-09-29T02:09:56.697855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBM.csv [2025-09-29T02:09:56.698005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUR.csv [2025-09-29T02:09:56.698178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECG.csv [2025-09-29T02:09:56.698366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFT.csv [2025-09-29T02:09:56.698559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CANG.csv [2025-09-29T02:09:56.698799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTI.csv [2025-09-29T02:09:56.698995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UIS.csv [2025-09-29T02:09:56.699194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RC.csv [2025-09-29T02:09:56.699374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/C.csv [2025-09-29T02:09:56.699598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LII.csv [2025-09-29T02:09:56.699808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVH.csv [2025-09-29T02:09:56.700016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPRT.csv [2025-09-29T02:09:56.700211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCI.csv [2025-09-29T02:09:56.700372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIO.csv [2025-09-29T02:09:56.700589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOTE.csv [2025-09-29T02:09:56.700854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SABA.csv [2025-09-29T02:09:56.701040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSH.csv [2025-09-29T02:09:56.701215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCOR.csv [2025-09-29T02:09:56.701351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVK.csv [2025-09-29T02:09:56.701547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHLD.csv [2025-09-29T02:09:56.701765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDD.csv [2025-09-29T02:09:56.701960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESE.csv [2025-09-29T02:09:56.702140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GF.csv [2025-09-29T02:09:56.702320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GE.csv [2025-09-29T02:09:56.702489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSI.csv [2025-09-29T02:09:56.702741] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEN.csv [2025-09-29T02:09:56.702918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGV.csv [2025-09-29T02:09:56.703139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGC.csv [2025-09-29T02:09:56.703338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FT.csv [2025-09-29T02:09:56.703503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQY.csv [2025-09-29T02:09:56.703712] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOOS.csv [2025-09-29T02:09:56.703891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNMA.csv [2025-09-29T02:09:56.704040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSAC.csv [2025-09-29T02:09:56.704219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAR.csv [2025-09-29T02:09:56.704360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIP.csv [2025-09-29T02:09:56.704551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EB.csv [2025-09-29T02:09:56.704767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKIL.csv [2025-09-29T02:09:56.704955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSM.csv [2025-09-29T02:09:56.705120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFH.csv [2025-09-29T02:09:56.705328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIV.csv [2025-09-29T02:09:56.705521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTOL.csv [2025-09-29T02:09:56.705754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATMU.csv [2025-09-29T02:09:56.705935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXL.csv [2025-09-29T02:09:56.706327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLI.csv [2025-09-29T02:09:56.706541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUC.csv [2025-09-29T02:09:56.706982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEE.csv [2025-09-29T02:09:56.707353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENS.csv [2025-09-29T02:09:56.707473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AA.csv [2025-09-29T02:09:56.707774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWRE.csv [2025-09-29T02:09:56.707984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFL.csv [2025-09-29T02:09:56.708166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WINN.csv [2025-09-29T02:09:56.708360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UE.csv [2025-09-29T02:09:56.708549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBAB.csv [2025-09-29T02:09:56.708764] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEB.csv [2025-09-29T02:09:56.708882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIV.csv [2025-09-29T02:09:56.709093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEL.csv [2025-09-29T02:09:56.709295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QS.csv [2025-09-29T02:09:56.709500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHI.csv [2025-09-29T02:09:56.709731] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGM.csv [2025-09-29T02:09:56.709912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTD.csv [2025-09-29T02:09:56.710051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASX.csv [2025-09-29T02:09:56.710232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOLF.csv [2025-09-29T02:09:56.710423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELC.csv [2025-09-29T02:09:56.710632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWH.csv [2025-09-29T02:09:56.710941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNN.csv [2025-09-29T02:09:56.711164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVST.csv [2025-09-29T02:09:56.711554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LCII.csv [2025-09-29T02:09:56.711754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOS.csv [2025-09-29T02:09:56.711946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNOP.csv [2025-09-29T02:09:56.712165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIM.csv [2025-09-29T02:09:56.712348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBC.csv [2025-09-29T02:09:56.712534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLF.csv [2025-09-29T02:09:56.712728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMI.csv [2025-09-29T02:09:56.712918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAIN.csv [2025-09-29T02:09:56.713115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAK.csv [2025-09-29T02:09:56.713551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLG.csv [2025-09-29T02:09:56.713959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEAF.csv [2025-09-29T02:09:56.714158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSM.csv [2025-09-29T02:09:56.714340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVR.csv [2025-09-29T02:09:56.714535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EME.csv [2025-09-29T02:09:56.714758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELS.csv [2025-09-29T02:09:56.714963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WH.csv [2025-09-29T02:09:56.715148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPV.csv [2025-09-29T02:09:56.715373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGNA.csv [2025-09-29T02:09:56.715545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CC.csv [2025-09-29T02:09:56.715768] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAM.csv [2025-09-29T02:09:56.715966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COTY.csv [2025-09-29T02:09:56.716160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFH.csv [2025-09-29T02:09:56.716563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAY.csv [2025-09-29T02:09:56.716777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMWB.csv [2025-09-29T02:09:56.717008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBF.csv [2025-09-29T02:09:56.717215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOUS.csv [2025-09-29T02:09:56.717403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRO.csv [2025-09-29T02:09:56.717601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOG.csv [2025-09-29T02:09:56.717809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHIN.csv [2025-09-29T02:09:56.718006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPRI.csv [2025-09-29T02:09:56.718211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPL.csv [2025-09-29T02:09:56.718385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDN.csv [2025-09-29T02:09:56.718595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOTU.csv [2025-09-29T02:09:56.718818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAD.csv [2025-09-29T02:09:56.719000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYD.csv [2025-09-29T02:09:56.719140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSTZ.csv [2025-09-29T02:09:56.719278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOX.csv [2025-09-29T02:09:56.719448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEW.csv [2025-09-29T02:09:56.719673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIN.csv [2025-09-29T02:09:56.719861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOF.csv [2025-09-29T02:09:56.720038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMC.csv [2025-09-29T02:09:56.720221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THR.csv [2025-09-29T02:09:56.720452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NE.csv [2025-09-29T02:09:56.720661] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHR.csv [2025-09-29T02:09:56.720857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSX.csv [2025-09-29T02:09:56.721056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSTG.csv [2025-09-29T02:09:56.721233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCM.csv [2025-09-29T02:09:56.721379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AM.csv [2025-09-29T02:09:56.721560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEG.csv [2025-09-29T02:09:56.721739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASA.csv [2025-09-29T02:09:56.721979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNSO.csv [2025-09-29T02:09:56.722174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLI.csv [2025-09-29T02:09:56.722289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARW.csv [2025-09-29T02:09:56.722524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHM.csv [2025-09-29T02:09:56.722756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EW.csv [2025-09-29T02:09:56.722944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPWR.csv [2025-09-29T02:09:56.723132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FGN.csv [2025-09-29T02:09:56.723260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTO.csv [2025-09-29T02:09:56.723466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PH.csv [2025-09-29T02:09:56.723581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APOS.csv [2025-09-29T02:09:56.723879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DD.csv [2025-09-29T02:09:56.724086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWEN.csv [2025-09-29T02:09:56.724310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWLO.csv [2025-09-29T02:09:56.724486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRNO.csv [2025-09-29T02:09:56.724718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSO.csv [2025-09-29T02:09:56.724883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBT.csv [2025-09-29T02:09:56.725060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UDR.csv [2025-09-29T02:09:56.725266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETG.csv [2025-09-29T02:09:56.725456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTGC.csv [2025-09-29T02:09:56.725833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAAP.csv [2025-09-29T02:09:56.726018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSL.csv [2025-09-29T02:09:56.726132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPY.csv [2025-09-29T02:09:56.726365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ISD.csv [2025-09-29T02:09:56.726554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THG.csv [2025-09-29T02:09:56.726800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETB.csv [2025-09-29T02:09:56.726956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AROC.csv [2025-09-29T02:09:56.727169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNK.csv [2025-09-29T02:09:56.727366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOV.csv [2025-09-29T02:09:56.727722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRE.csv [2025-09-29T02:09:56.727908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYI.csv [2025-09-29T02:09:56.728091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FE.csv [2025-09-29T02:09:56.728268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXK.csv [2025-09-29T02:09:56.728496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDY.csv [2025-09-29T02:09:56.728716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFF.csv [2025-09-29T02:09:56.728862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGM.csv [2025-09-29T02:09:56.729030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTI.csv [2025-09-29T02:09:56.729322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMP.csv [2025-09-29T02:09:56.729507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRG.csv [2025-09-29T02:09:56.729734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCS.csv [2025-09-29T02:09:56.729924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCS.csv [2025-09-29T02:09:56.730166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAM.csv [2025-09-29T02:09:56.730357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCC.csv [2025-09-29T02:09:56.730480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNT.csv [2025-09-29T02:09:56.730701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSI.csv [2025-09-29T02:09:56.730906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COF.csv [2025-09-29T02:09:56.731120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIV.csv [2025-09-29T02:09:56.731321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNH.csv [2025-09-29T02:09:56.731492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXM.csv [2025-09-29T02:09:56.731694] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRL.csv [2025-09-29T02:09:56.731895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGT.csv [2025-09-29T02:09:56.732122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CACI.csv [2025-09-29T02:09:56.732338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJM.csv [2025-09-29T02:09:56.732507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SN.csv [2025-09-29T02:09:56.732694] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PERF.csv [2025-09-29T02:09:56.732857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DV.csv [2025-09-29T02:09:56.733071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BG.csv [2025-09-29T02:09:56.733223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGC.csv [2025-09-29T02:09:56.733384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPCT.csv [2025-09-29T02:09:56.733592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHAK.csv [2025-09-29T02:09:56.733749] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALSN.csv [2025-09-29T02:09:56.733937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UPS.csv [2025-09-29T02:09:56.734126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNC.csv [2025-09-29T02:09:56.734372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQV.csv [2025-09-29T02:09:56.735053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESI.csv [2025-09-29T02:09:56.735288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCJ.csv [2025-09-29T02:09:56.735470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TG.csv [2025-09-29T02:09:56.735615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSM.csv [2025-09-29T02:09:56.735828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDH.csv [2025-09-29T02:09:56.735994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBNA.csv [2025-09-29T02:09:56.736173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REXR.csv [2025-09-29T02:09:56.736390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RKT.csv [2025-09-29T02:09:56.736558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/G.csv [2025-09-29T02:09:56.736773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRT.csv [2025-09-29T02:09:56.736984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VCV.csv [2025-09-29T02:09:56.737153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESNT.csv [2025-09-29T02:09:56.737297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNH.csv [2025-09-29T02:09:56.737449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOE.csv [2025-09-29T02:09:56.737623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSU.csv [2025-09-29T02:09:56.737824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRNT.csv [2025-09-29T02:09:56.738006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETW.csv [2025-09-29T02:09:56.738171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSW.csv [2025-09-29T02:09:56.738311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATS.csv [2025-09-29T02:09:56.738455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGY.csv [2025-09-29T02:09:56.738660] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEL.csv [2025-09-29T02:09:56.738830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KT.csv [2025-09-29T02:09:56.739021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GS.csv [2025-09-29T02:09:56.739209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARS.csv [2025-09-29T02:09:56.739345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEO.csv [2025-09-29T02:09:56.739528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPG.csv [2025-09-29T02:09:56.739798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPC.csv [2025-09-29T02:09:56.739976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LFT.csv [2025-09-29T02:09:56.740211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPI.csv [2025-09-29T02:09:56.740393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPJA.csv [2025-09-29T02:09:56.740582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKU.csv [2025-09-29T02:09:56.740787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIIN.csv [2025-09-29T02:09:56.740983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAC.csv [2025-09-29T02:09:56.741188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTE.csv [2025-09-29T02:09:56.741370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TK.csv [2025-09-29T02:09:56.741569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQH.csv [2025-09-29T02:09:56.741769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEO.csv [2025-09-29T02:09:56.741947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RHP.csv [2025-09-29T02:09:56.742083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLD.csv [2025-09-29T02:09:56.742265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLP.csv [2025-09-29T02:09:56.742461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBH.csv [2025-09-29T02:09:56.742661] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USAC.csv [2025-09-29T02:09:56.742845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYM.csv [2025-09-29T02:09:56.743093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLT.csv [2025-09-29T02:09:56.743289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDT.csv [2025-09-29T02:09:56.743473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSM.csv [2025-09-29T02:09:56.743670] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDO.csv [2025-09-29T02:09:56.743804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLY.csv [2025-09-29T02:09:56.744019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAVA.csv [2025-09-29T02:09:56.744231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBR.csv [2025-09-29T02:09:56.744419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOG.csv [2025-09-29T02:09:56.744595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZKH.csv [2025-09-29T02:09:56.744871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RQI.csv [2025-09-29T02:09:56.745056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/T.csv [2025-09-29T02:09:56.745265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSG.csv [2025-09-29T02:09:56.745459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OBK.csv [2025-09-29T02:09:56.745680] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HZO.csv [2025-09-29T02:09:56.745891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STRV.csv [2025-09-29T02:09:56.746103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLX.csv [2025-09-29T02:09:56.746259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FXED.csv [2025-09-29T02:09:56.746433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THQ.csv [2025-09-29T02:09:56.746661] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCU.csv [2025-09-29T02:09:56.746884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWH.csv [2025-09-29T02:09:56.747091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMD.csv [2025-09-29T02:09:56.747637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMR.csv [2025-09-29T02:09:56.747870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOUG.csv [2025-09-29T02:09:56.748080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEGI.csv [2025-09-29T02:09:56.748307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CE.csv [2025-09-29T02:09:56.748501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMND.csv [2025-09-29T02:09:56.748755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNN.csv [2025-09-29T02:09:56.748957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHI.csv [2025-09-29T02:09:56.749108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMG.csv [2025-09-29T02:09:56.749302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PML.csv [2025-09-29T02:09:56.749432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIG.csv [2025-09-29T02:09:56.749629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OUT.csv [2025-09-29T02:09:56.749900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUE.csv [2025-09-29T02:09:56.750100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCCO.csv [2025-09-29T02:09:56.750283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFC.csv [2025-09-29T02:09:56.750507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPK.csv [2025-09-29T02:09:56.750711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEX.csv [2025-09-29T02:09:56.750851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASB.csv [2025-09-29T02:09:56.751102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PTA.csv [2025-09-29T02:09:56.751310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMC.csv [2025-09-29T02:09:56.751541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGA.csv [2025-09-29T02:09:56.751743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SES.csv [2025-09-29T02:09:56.751894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVAL.csv [2025-09-29T02:09:56.752075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGS.csv [2025-09-29T02:09:56.752221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFL.csv [2025-09-29T02:09:56.752385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWX.csv [2025-09-29T02:09:56.752577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSBD.csv [2025-09-29T02:09:56.752784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEE.csv [2025-09-29T02:09:56.752981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXE.csv [2025-09-29T02:09:56.753185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCL.csv [2025-09-29T02:09:56.753360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEP.csv [2025-09-29T02:09:56.753528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDOS.csv [2025-09-29T02:09:56.753763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFMZ.csv [2025-09-29T02:09:56.753970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EC.csv [2025-09-29T02:09:56.754136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPX.csv [2025-09-29T02:09:56.754309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOBO.csv [2025-09-29T02:09:56.754494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/POR.csv [2025-09-29T02:09:56.754692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEC.csv [2025-09-29T02:09:56.754898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CI.csv [2025-09-29T02:09:56.755146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOYA.csv [2025-09-29T02:09:56.755350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEU.csv [2025-09-29T02:09:56.755577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXP.csv [2025-09-29T02:09:56.755800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NFG.csv [2025-09-29T02:09:56.756009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENR.csv [2025-09-29T02:09:56.756219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMX.csv [2025-09-29T02:09:56.756386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VST.csv [2025-09-29T02:09:56.756580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRO.csv [2025-09-29T02:09:56.756915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZK.csv [2025-09-29T02:09:56.757091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNFI.csv [2025-09-29T02:09:56.757275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/E.csv [2025-09-29T02:09:56.757485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NET.csv [2025-09-29T02:09:56.757681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRC.csv [2025-09-29T02:09:56.757879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBWI.csv [2025-09-29T02:09:56.758092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TR.csv [2025-09-29T02:09:56.758289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RM.csv [2025-09-29T02:09:56.758479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGER.csv [2025-09-29T02:09:56.758724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NSC.csv [2025-09-29T02:09:56.758907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEL.csv [2025-09-29T02:09:56.759323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEX.csv [2025-09-29T02:09:56.759449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKT.csv [2025-09-29T02:09:56.759681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ING.csv [2025-09-29T02:09:56.759823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARMK.csv [2025-09-29T02:09:56.760005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPE.csv [2025-09-29T02:09:56.760189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFE.csv [2025-09-29T02:09:56.760387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGU.csv [2025-09-29T02:09:56.760588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTUS.csv [2025-09-29T02:09:56.760790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEG.csv [2025-09-29T02:09:56.760972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OWLT.csv [2025-09-29T02:09:56.761118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARE.csv [2025-09-29T02:09:56.761267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGB.csv [2025-09-29T02:09:56.761504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMX.csv [2025-09-29T02:09:56.761723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTTR.csv [2025-09-29T02:09:56.761935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRTS.csv [2025-09-29T02:09:56.762132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAN.csv [2025-09-29T02:09:56.762279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOW.csv [2025-09-29T02:09:56.762448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFRC.csv [2025-09-29T02:09:56.762607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSF.csv [2025-09-29T02:09:56.762814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GME.csv [2025-09-29T02:09:56.763002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCC.csv [2025-09-29T02:09:56.763192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLNT.csv [2025-09-29T02:09:56.763317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGB.csv [2025-09-29T02:09:56.763453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGI.csv [2025-09-29T02:09:56.763630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UCB.csv [2025-09-29T02:09:56.763816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLT.csv [2025-09-29T02:09:56.763984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRE.csv [2025-09-29T02:09:56.764194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMI.csv [2025-09-29T02:09:56.764399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USPH.csv [2025-09-29T02:09:56.764578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTC.csv [2025-09-29T02:09:56.764786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCL.csv [2025-09-29T02:09:56.764971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DKS.csv [2025-09-29T02:09:56.765110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUI.csv [2025-09-29T02:09:56.765316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFH.csv [2025-09-29T02:09:56.765490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETX.csv [2025-09-29T02:09:56.765737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRT.csv [2025-09-29T02:09:56.765894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACN.csv [2025-09-29T02:09:56.766062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVTY.csv [2025-09-29T02:09:56.766310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMPO.csv [2025-09-29T02:09:56.766467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPJ.csv [2025-09-29T02:09:56.766686] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHD.csv [2025-09-29T02:09:56.766898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KD.csv [2025-09-29T02:09:56.767034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNJ.csv [2025-09-29T02:09:56.767210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOLF.csv [2025-09-29T02:09:56.767409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPGI.csv [2025-09-29T02:09:56.767833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIR.csv [2025-09-29T02:09:56.768041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NATL.csv [2025-09-29T02:09:56.768235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSW.csv [2025-09-29T02:09:56.768424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOW.csv [2025-09-29T02:09:56.768598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITE.csv [2025-09-29T02:09:56.768766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AG.csv [2025-09-29T02:09:56.768962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAH.csv [2025-09-29T02:09:56.769140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIF.csv [2025-09-29T02:09:56.769335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRG.csv [2025-09-29T02:09:56.769514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEO.csv [2025-09-29T02:09:56.769700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIO.csv [2025-09-29T02:09:56.769879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KN.csv [2025-09-29T02:09:56.770078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COHR.csv [2025-09-29T02:09:56.770320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCT.csv [2025-09-29T02:09:56.770528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RRC.csv [2025-09-29T02:09:56.770715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GATX.csv [2025-09-29T02:09:56.770911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJC.csv [2025-09-29T02:09:56.771116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEC.csv [2025-09-29T02:09:56.771293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PARR.csv [2025-09-29T02:09:56.771491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HD.csv [2025-09-29T02:09:56.771713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAN.csv [2025-09-29T02:09:56.771953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WGO.csv [2025-09-29T02:09:56.772187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARR.csv [2025-09-29T02:09:56.772364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHX.csv [2025-09-29T02:09:56.772558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GKOS.csv [2025-09-29T02:09:56.772766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCD.csv [2025-09-29T02:09:56.772921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKE.csv [2025-09-29T02:09:56.773181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSD.csv [2025-09-29T02:09:56.773373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMD.csv [2025-09-29T02:09:56.773571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICL.csv [2025-09-29T02:09:56.773848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSR.csv [2025-09-29T02:09:56.774048] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DB.csv [2025-09-29T02:09:56.774184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADNT.csv [2025-09-29T02:09:56.774436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQT.csv [2025-09-29T02:09:56.774606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTR.csv [2025-09-29T02:09:56.774806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGM.csv [2025-09-29T02:09:56.775015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCO.csv [2025-09-29T02:09:56.775193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLW.csv [2025-09-29T02:09:56.775400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITT.csv [2025-09-29T02:09:56.775794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQT.csv [2025-09-29T02:09:56.775931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALE.csv [2025-09-29T02:09:56.776142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOD.csv [2025-09-29T02:09:56.776319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBI.csv [2025-09-29T02:09:56.776501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIE.csv [2025-09-29T02:09:56.776881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPS.csv [2025-09-29T02:09:56.777070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LB.csv [2025-09-29T02:09:56.777281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPL.csv [2025-09-29T02:09:56.777445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNSL.csv [2025-09-29T02:09:56.777619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STVN.csv [2025-09-29T02:09:56.777826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CON.csv [2025-09-29T02:09:56.778007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAL.csv [2025-09-29T02:09:56.778213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROK.csv [2025-09-29T02:09:56.778380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTA.csv [2025-09-29T02:09:56.778551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LND.csv [2025-09-29T02:09:56.778775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFF.csv [2025-09-29T02:09:56.778984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMTG.csv [2025-09-29T02:09:56.779159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JILL.csv [2025-09-29T02:09:56.779349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRU.csv [2025-09-29T02:09:56.779513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SB.csv [2025-09-29T02:09:56.779745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RF.csv [2025-09-29T02:09:56.779939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JMIA.csv [2025-09-29T02:09:56.780132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIC.csv [2025-09-29T02:09:56.780345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMC.csv [2025-09-29T02:09:56.780515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONIT.csv [2025-09-29T02:09:56.780709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGS.csv [2025-09-29T02:09:56.780933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TU.csv [2025-09-29T02:09:56.781129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIO.csv [2025-09-29T02:09:56.781297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBD.csv [2025-09-29T02:09:56.781477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGI.csv [2025-09-29T02:09:56.781620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASPN.csv [2025-09-29T02:09:56.781951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NWG.csv [2025-09-29T02:09:56.782169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RJF.csv [2025-09-29T02:09:56.782337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRI.csv [2025-09-29T02:09:56.782530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMY.csv [2025-09-29T02:09:56.782758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TV.csv [2025-09-29T02:09:56.782936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBB.csv [2025-09-29T02:09:56.783069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCH.csv [2025-09-29T02:09:56.783237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDA.csv [2025-09-29T02:09:56.783420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCK.csv [2025-09-29T02:09:56.783816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAH.csv [2025-09-29T02:09:56.784024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HL.csv [2025-09-29T02:09:56.784225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FND.csv [2025-09-29T02:09:56.784406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRT.csv [2025-09-29T02:09:56.784573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TISI.csv [2025-09-29T02:09:56.784811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRFM.csv [2025-09-29T02:09:56.784967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMO.csv [2025-09-29T02:09:56.785147] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCN.csv [2025-09-29T02:09:56.785345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKST.csv [2025-09-29T02:09:56.785488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMH.csv [2025-09-29T02:09:56.785678] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNTK.csv [2025-09-29T02:09:56.785831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATI.csv [2025-09-29T02:09:56.785994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STT.csv [2025-09-29T02:09:56.786178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPC.csv [2025-09-29T02:09:56.786374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNM.csv [2025-09-29T02:09:56.786561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDA.csv [2025-09-29T02:09:56.786789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNI.csv [2025-09-29T02:09:56.787017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETD.csv [2025-09-29T02:09:56.787200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHK.csv [2025-09-29T02:09:56.787400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEI.csv [2025-09-29T02:09:56.787599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SE.csv [2025-09-29T02:09:56.787852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMS.csv [2025-09-29T02:09:56.788092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TALO.csv [2025-09-29T02:09:56.788268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMT.csv [2025-09-29T02:09:56.788479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDLR.csv [2025-09-29T02:09:56.788609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADCT.csv [2025-09-29T02:09:56.788848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKC.csv [2025-09-29T02:09:56.788979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRSP.csv [2025-09-29T02:09:56.789182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKYH.csv [2025-09-29T02:09:56.789363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MXF.csv [2025-09-29T02:09:56.789565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIHL.csv [2025-09-29T02:09:56.789796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DKL.csv [2025-09-29T02:09:56.789982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVT.csv [2025-09-29T02:09:56.790115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHR.csv [2025-09-29T02:09:56.790297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDF.csv [2025-09-29T02:09:56.790499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIP.csv [2025-09-29T02:09:56.790703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAAS.csv [2025-09-29T02:09:56.790879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHCO.csv [2025-09-29T02:09:56.791059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HY.csv [2025-09-29T02:09:56.791531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSGS.csv [2025-09-29T02:09:56.791839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOST.csv [2025-09-29T02:09:56.791985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOND.csv [2025-09-29T02:09:56.792158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPG.csv [2025-09-29T02:09:56.792289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AON.csv [2025-09-29T02:09:56.792528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXW.csv [2025-09-29T02:09:56.792754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NLOP.csv [2025-09-29T02:09:56.792949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDW.csv [2025-09-29T02:09:56.793139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RPT.csv [2025-09-29T02:09:56.793326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KSS.csv [2025-09-29T02:09:56.793525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEF.csv [2025-09-29T02:09:56.793726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEC.csv [2025-09-29T02:09:56.793928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NQP.csv [2025-09-29T02:09:56.794155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNV.csv [2025-09-29T02:09:56.794365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBY.csv [2025-09-29T02:09:56.794568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRE.csv [2025-09-29T02:09:56.794780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTM.csv [2025-09-29T02:09:56.794941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBA.csv [2025-09-29T02:09:56.795149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LBRT.csv [2025-09-29T02:09:56.795353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGT.csv [2025-09-29T02:09:56.795481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAK.csv [2025-09-29T02:09:56.795701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMI.csv [2025-09-29T02:09:56.795893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDX.csv [2025-09-29T02:09:56.796078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VHI.csv [2025-09-29T02:09:56.796291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNOW.csv [2025-09-29T02:09:56.796491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FI.csv [2025-09-29T02:09:56.796748] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAO.csv [2025-09-29T02:09:56.796962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YOU.csv [2025-09-29T02:09:56.797193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHAB.csv [2025-09-29T02:09:56.797409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONTF.csv [2025-09-29T02:09:56.797538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAR.csv [2025-09-29T02:09:56.797729] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNTY.csv [2025-09-29T02:09:56.797924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENOV.csv [2025-09-29T02:09:56.798083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KORE.csv [2025-09-29T02:09:56.798265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBS.csv [2025-09-29T02:09:56.798453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVV.csv [2025-09-29T02:09:56.798635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSFE.csv [2025-09-29T02:09:56.798863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEN.csv [2025-09-29T02:09:56.799043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YEXT.csv [2025-09-29T02:09:56.799214] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HNI.csv [2025-09-29T02:09:56.799371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMI.csv [2025-09-29T02:09:56.799534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHCT.csv [2025-09-29T02:09:56.799722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTB.csv [2025-09-29T02:09:56.800157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIF.csv [2025-09-29T02:09:56.800307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUB.csv [2025-09-29T02:09:56.800477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVEX.csv [2025-09-29T02:09:56.800628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACVA.csv [2025-09-29T02:09:56.800814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PACS.csv [2025-09-29T02:09:56.800973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAN.csv [2025-09-29T02:09:56.801142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMMZ.csv [2025-09-29T02:09:56.801343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PINE.csv [2025-09-29T02:09:56.801537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GXO.csv [2025-09-29T02:09:56.801783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMF.csv [2025-09-29T02:09:56.801963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXD.csv [2025-09-29T02:09:56.802089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BA.csv [2025-09-29T02:09:56.802252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUM.csv [2025-09-29T02:09:56.802430] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLN.csv [2025-09-29T02:09:56.802593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQM.csv [2025-09-29T02:09:56.802817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIX.csv [2025-09-29T02:09:56.803026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PINS.csv [2025-09-29T02:09:56.803201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLNG.csv [2025-09-29T02:09:56.803409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLY.csv [2025-09-29T02:09:56.803577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PII.csv [2025-09-29T02:09:56.803757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFL.csv [2025-09-29T02:09:56.803961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOS.csv [2025-09-29T02:09:56.804156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNX.csv [2025-09-29T02:09:56.804330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSLY.csv [2025-09-29T02:09:56.804499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWW.csv [2025-09-29T02:09:56.804726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVG.csv [2025-09-29T02:09:56.804902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNA.csv [2025-09-29T02:09:56.805094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XFLT.csv [2025-09-29T02:09:56.805279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DUK.csv [2025-09-29T02:09:56.805454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIB.csv [2025-09-29T02:09:56.805660] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTH.csv [2025-09-29T02:09:56.805831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAL.csv [2025-09-29T02:09:56.806022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USNA.csv [2025-09-29T02:09:56.806198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRV.csv [2025-09-29T02:09:56.806390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYK.csv [2025-09-29T02:09:56.806568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNP.csv [2025-09-29T02:09:56.806856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FET.csv [2025-09-29T02:09:56.807048] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMN.csv [2025-09-29T02:09:56.807198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMCR.csv [2025-09-29T02:09:56.807348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADX.csv [2025-09-29T02:09:56.807545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFG.csv [2025-09-29T02:09:56.807728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THIR.csv [2025-09-29T02:09:56.807933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPAD.csv [2025-09-29T02:09:56.808082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCE.csv [2025-09-29T02:09:56.808216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACP.csv [2025-09-29T02:09:56.808417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSHP.csv [2025-09-29T02:09:56.808578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRP.csv [2025-09-29T02:09:56.808789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYG.csv [2025-09-29T02:09:56.808948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOH.csv [2025-09-29T02:09:56.809176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKL.csv [2025-09-29T02:09:56.809372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDT.csv [2025-09-29T02:09:56.809572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/W.csv [2025-09-29T02:09:56.809777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WU.csv [2025-09-29T02:09:56.809910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASAN.csv [2025-09-29T02:09:56.810309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NSP.csv [2025-09-29T02:09:56.810547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCN.csv [2025-09-29T02:09:56.810812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXT.csv [2025-09-29T02:09:56.811016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLH.csv [2025-09-29T02:09:56.811197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMP.csv [2025-09-29T02:09:56.811474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLJ.csv [2025-09-29T02:09:56.811675] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASC.csv [2025-09-29T02:09:56.811849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTCM.csv [2025-09-29T02:09:56.812054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTS.csv [2025-09-29T02:09:56.812187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCC.csv [2025-09-29T02:09:56.812369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBB.csv [2025-09-29T02:09:56.812532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TUYA.csv [2025-09-29T02:09:56.812773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PUK.csv [2025-09-29T02:09:56.812931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSBR.csv [2025-09-29T02:09:56.813127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSGE.csv [2025-09-29T02:09:56.813348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCI.csv [2025-09-29T02:09:56.813524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FAF.csv [2025-09-29T02:09:56.813708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAR.csv [2025-09-29T02:09:56.813891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGLB.csv [2025-09-29T02:09:56.814073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMC.csv [2025-09-29T02:09:56.814249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAP.csv [2025-09-29T02:09:56.814414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFAM.csv [2025-09-29T02:09:56.814618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGE.csv [2025-09-29T02:09:56.814867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/F.csv [2025-09-29T02:09:56.815039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSQH.csv [2025-09-29T02:09:56.815226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVE.csv [2025-09-29T02:09:56.815417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EEX.csv [2025-09-29T02:09:56.815597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRM.csv [2025-09-29T02:09:56.815863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRTG.csv [2025-09-29T02:09:56.816055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEYS.csv [2025-09-29T02:09:56.816240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRI.csv [2025-09-29T02:09:56.816443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXI.csv [2025-09-29T02:09:56.816668] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OKLO.csv [2025-09-29T02:09:56.816939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOH.csv [2025-09-29T02:09:56.817125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBT.csv [2025-09-29T02:09:56.817342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PM.csv [2025-09-29T02:09:56.817525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSK.csv [2025-09-29T02:09:56.817691] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNT.csv [2025-09-29T02:09:56.817904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HWM.csv [2025-09-29T02:09:56.818491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSY.csv [2025-09-29T02:09:56.818713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHI.csv [2025-09-29T02:09:56.818923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PTY.csv [2025-09-29T02:09:56.819100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSA.csv [2025-09-29T02:09:56.819313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSI.csv [2025-09-29T02:09:56.819487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ST.csv [2025-09-29T02:09:56.819662] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALG.csv [2025-09-29T02:09:56.819815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWG.csv [2025-09-29T02:09:56.819984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPI.csv [2025-09-29T02:09:56.820148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRT.csv [2025-09-29T02:09:56.820354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOW.csv [2025-09-29T02:09:56.820558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/V.csv [2025-09-29T02:09:56.820755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTDR.csv [2025-09-29T02:09:56.820944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLPR.csv [2025-09-29T02:09:56.821131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHY.csv [2025-09-29T02:09:56.821308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBI.csv [2025-09-29T02:09:56.821496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TY.csv [2025-09-29T02:09:56.821699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOMB.csv [2025-09-29T02:09:56.821879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEA.csv [2025-09-29T02:09:56.822026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLW.csv [2025-09-29T02:09:56.822515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KYN.csv [2025-09-29T02:09:56.822772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCS.csv [2025-09-29T02:09:56.822927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPI.csv [2025-09-29T02:09:56.823155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYV.csv [2025-09-29T02:09:56.823335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXX.csv [2025-09-29T02:09:56.823518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMCO.csv [2025-09-29T02:09:56.823808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRGE.csv [2025-09-29T02:09:56.824006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPEV.csv [2025-09-29T02:09:56.824189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YRD.csv [2025-09-29T02:09:56.824363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESRT.csv [2025-09-29T02:09:56.824547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KW.csv [2025-09-29T02:09:56.824772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMM.csv [2025-09-29T02:09:56.824979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENB.csv [2025-09-29T02:09:56.825189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITW.csv [2025-09-29T02:09:56.825349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SVV.csv [2025-09-29T02:09:56.825558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLF.csv [2025-09-29T02:09:56.825872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPV.csv [2025-09-29T02:09:56.826052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTX.csv [2025-09-29T02:09:56.826254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLB.csv [2025-09-29T02:09:56.826446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSM.csv [2025-09-29T02:09:56.826709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNR.csv [2025-09-29T02:09:56.826920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANF.csv [2025-09-29T02:09:56.827125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCHW.csv [2025-09-29T02:09:56.827291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGM.csv [2025-09-29T02:09:56.827474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANET.csv [2025-09-29T02:09:56.827799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQV.csv [2025-09-29T02:09:56.827978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THC.csv [2025-09-29T02:09:56.828143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUXX.csv [2025-09-29T02:09:56.828312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLN.csv [2025-09-29T02:09:56.828501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBS.csv [2025-09-29T02:09:56.828709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZEPP.csv [2025-09-29T02:09:56.828896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIA.csv [2025-09-29T02:09:56.829078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNM.csv [2025-09-29T02:09:56.829258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PK.csv [2025-09-29T02:09:56.829421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLRS.csv [2025-09-29T02:09:56.829634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OEC.csv [2025-09-29T02:09:56.830185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IT.csv [2025-09-29T02:09:56.830377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBRG.csv [2025-09-29T02:09:56.830621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTC.csv [2025-09-29T02:09:56.830835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVE.csv [2025-09-29T02:09:56.831029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFIN.csv [2025-09-29T02:09:56.831204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCI.csv [2025-09-29T02:09:56.831383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CATO.csv [2025-09-29T02:09:56.831544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGX.csv [2025-09-29T02:09:56.831895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IX.csv [2025-09-29T02:09:56.832091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/L.csv [2025-09-29T02:09:56.832267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGY.csv [2025-09-29T02:09:56.832438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSX.csv [2025-09-29T02:09:56.832611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAX.csv [2025-09-29T02:09:56.832835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYD.csv [2025-09-29T02:09:56.833063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDS.csv [2025-09-29T02:09:56.833207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AR.csv [2025-09-29T02:09:56.833390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCL.csv [2025-09-29T02:09:56.833611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBR.csv [2025-09-29T02:09:56.833844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPAY.csv [2025-09-29T02:09:56.834067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEG.csv [2025-09-29T02:09:56.834284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIEN.csv [2025-09-29T02:09:56.834433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBD.csv [2025-09-29T02:09:56.834603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWMX.csv [2025-09-29T02:09:56.834813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RTX.csv [2025-09-29T02:09:56.834960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AER.csv [2025-09-29T02:09:56.835112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRCC.csv [2025-09-29T02:09:56.835331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SU.csv [2025-09-29T02:09:56.835478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWI.csv [2025-09-29T02:09:56.835633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMC.csv [2025-09-29T02:09:56.835827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMU.csv [2025-09-29T02:09:56.835966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGH.csv [2025-09-29T02:09:56.836145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEF.csv [2025-09-29T02:09:56.836275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNS.csv [2025-09-29T02:09:56.836473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAYC.csv [2025-09-29T02:09:56.836690] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNR.csv [2025-09-29T02:09:56.836940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMRE.csv [2025-09-29T02:09:56.837215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLR.csv [2025-09-29T02:09:56.837470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GM.csv [2025-09-29T02:09:56.837730] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCI.csv [2025-09-29T02:09:56.837927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFL.csv [2025-09-29T02:09:56.838118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKY.csv [2025-09-29T02:09:56.838324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXG.csv [2025-09-29T02:09:56.838476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIO.csv [2025-09-29T02:09:56.838694] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAYW.csv [2025-09-29T02:09:56.838891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MP.csv [2025-09-29T02:09:56.839104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGP.csv [2025-09-29T02:09:56.839317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORA.csv [2025-09-29T02:09:56.839501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLUT.csv [2025-09-29T02:09:56.839819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUFG.csv [2025-09-29T02:09:56.839997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEO.csv [2025-09-29T02:09:56.840182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLVM.csv [2025-09-29T02:09:56.840357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/A.csv [2025-09-29T02:09:56.840578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPT.csv [2025-09-29T02:09:56.841180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZE.csv [2025-09-29T02:09:56.841353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXH.csv [2025-09-29T02:09:56.841576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIS.csv [2025-09-29T02:09:56.841802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRP.csv [2025-09-29T02:09:56.841980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEA.csv [2025-09-29T02:09:56.842175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAS.csv [2025-09-29T02:09:56.842376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVWR.csv [2025-09-29T02:09:56.842579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSP.csv [2025-09-29T02:09:56.842786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEP.csv [2025-09-29T02:09:56.842970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUVB.csv [2025-09-29T02:09:56.843148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTS.csv [2025-09-29T02:09:56.843354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCI.csv [2025-09-29T02:09:56.843522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PWR.csv [2025-09-29T02:09:56.843813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBTG.csv [2025-09-29T02:09:56.844012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWN.csv [2025-09-29T02:09:56.844188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGAU.csv [2025-09-29T02:09:56.844357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SR.csv [2025-09-29T02:09:56.844532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNH.csv [2025-09-29T02:09:56.844724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHS.csv [2025-09-29T02:09:56.844909] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLK.csv [2025-09-29T02:09:56.845071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPOF.csv [2025-09-29T02:09:56.845258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BME.csv [2025-09-29T02:09:56.845411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDT.csv [2025-09-29T02:09:56.845588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTLS.csv [2025-09-29T02:09:56.845829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYD.csv [2025-09-29T02:09:56.846033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PL.csv [2025-09-29T02:09:56.846207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDS.csv [2025-09-29T02:09:56.846423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSCO.csv [2025-09-29T02:09:56.846722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NZF.csv [2025-09-29T02:09:56.846900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLX.csv [2025-09-29T02:09:56.847106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OWL.csv [2025-09-29T02:09:56.847280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKSY.csv [2025-09-29T02:09:56.847503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GES.csv [2025-09-29T02:09:56.847819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAX.csv [2025-09-29T02:09:56.847992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OLP.csv [2025-09-29T02:09:56.848184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLP.csv [2025-09-29T02:09:56.848388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTB.csv [2025-09-29T02:09:56.848572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INN.csv [2025-09-29T02:09:56.848779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHR.csv [2025-09-29T02:09:56.848995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCZ.csv [2025-09-29T02:09:56.849201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCA.csv [2025-09-29T02:09:56.849378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXC.csv [2025-09-29T02:09:56.849540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSK.csv [2025-09-29T02:09:56.849765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CQP.csv [2025-09-29T02:09:56.849948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STWD.csv [2025-09-29T02:09:56.850108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGRO.csv [2025-09-29T02:09:56.850267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACR.csv [2025-09-29T02:09:56.850451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDRE.csv [2025-09-29T02:09:56.850638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LSPD.csv [2025-09-29T02:09:56.850845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LGI.csv [2025-09-29T02:09:56.851003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIM.csv [2025-09-29T02:09:56.851189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHN.csv [2025-09-29T02:09:56.851365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEMR.csv [2025-09-29T02:09:56.851549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOE.csv [2025-09-29T02:09:56.851774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSTL.csv [2025-09-29T02:09:56.851976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFR.csv [2025-09-29T02:09:56.852391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NSA.csv [2025-09-29T02:09:56.852566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/URI.csv [2025-09-29T02:09:56.852735] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHP.csv [2025-09-29T02:09:56.852928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGI.csv [2025-09-29T02:09:56.853166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBN.csv [2025-09-29T02:09:56.853353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZWS.csv [2025-09-29T02:09:56.853536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAD.csv [2025-09-29T02:09:56.853742] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RS.csv [2025-09-29T02:09:56.853922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DGX.csv [2025-09-29T02:09:56.854098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBIN.csv [2025-09-29T02:09:56.854289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLLY.csv [2025-09-29T02:09:56.854469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFL.csv [2025-09-29T02:09:56.854724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBA.csv [2025-09-29T02:09:56.854864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABG.csv [2025-09-29T02:09:56.855025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YELP.csv [2025-09-29T02:09:56.855211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UI.csv [2025-09-29T02:09:56.855436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTR.csv [2025-09-29T02:09:56.855626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITT.csv [2025-09-29T02:09:56.855862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EG.csv [2025-09-29T02:09:56.856027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PATH.csv [2025-09-29T02:09:56.856180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLK.csv [2025-09-29T02:09:56.856373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQL.csv [2025-09-29T02:09:56.856545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPA.csv [2025-09-29T02:09:56.856751] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJE.csv [2025-09-29T02:09:56.856906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGCO.csv [2025-09-29T02:09:56.857104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXP.csv [2025-09-29T02:09:56.857264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFIN.csv [2025-09-29T02:09:56.857424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUYA.csv [2025-09-29T02:09:56.857614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATX.csv [2025-09-29T02:09:56.857831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PB.csv [2025-09-29T02:09:56.858021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRTX.csv [2025-09-29T02:09:56.858146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWSN.csv [2025-09-29T02:09:56.858367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBR.csv [2025-09-29T02:09:56.858586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPK.csv [2025-09-29T02:09:56.858786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSMC.csv [2025-09-29T02:09:56.858948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMY.csv [2025-09-29T02:09:56.859092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AN.csv [2025-09-29T02:09:56.859280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COR.csv [2025-09-29T02:09:56.859404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEG.csv [2025-09-29T02:09:56.859571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZD.csv [2025-09-29T02:09:56.859899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LADR.csv [2025-09-29T02:09:56.860092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBS.csv [2025-09-29T02:09:56.860260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMRT.csv [2025-09-29T02:09:56.860388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APG.csv [2025-09-29T02:09:56.860551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESTC.csv [2025-09-29T02:09:56.860884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OVV.csv [2025-09-29T02:09:56.861071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLM.csv [2025-09-29T02:09:56.861213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARLO.csv [2025-09-29T02:09:56.861401] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNAP.csv [2025-09-29T02:09:56.861588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHS.csv [2025-09-29T02:09:56.861827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCR.csv [2025-09-29T02:09:56.862030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSAN.csv [2025-09-29T02:09:56.862253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXE.csv [2025-09-29T02:09:56.862454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCRD.csv [2025-09-29T02:09:56.862679] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RAMP.csv [2025-09-29T02:09:56.862818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHT.csv [2025-09-29T02:09:56.863029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIG.csv [2025-09-29T02:09:56.863208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OOMA.csv [2025-09-29T02:09:56.863347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGO.csv [2025-09-29T02:09:56.863566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RA.csv [2025-09-29T02:09:56.863820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DT.csv [2025-09-29T02:09:56.863998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSBC.csv [2025-09-29T02:09:56.864211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAW.csv [2025-09-29T02:09:56.864389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SW.csv [2025-09-29T02:09:56.864565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELF.csv [2025-09-29T02:09:56.864788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRS.csv [2025-09-29T02:09:56.865002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TME.csv [2025-09-29T02:09:56.865206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYG.csv [2025-09-29T02:09:56.865356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AES.csv [2025-09-29T02:09:56.865559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAI.csv [2025-09-29T02:09:56.865759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXPD.csv [2025-09-29T02:09:56.865963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBI.csv [2025-09-29T02:09:56.866297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UA.csv [2025-09-29T02:09:56.866472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTOS.csv [2025-09-29T02:09:56.866726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDE.csv [2025-09-29T02:09:56.866952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NKX.csv [2025-09-29T02:09:56.867130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVC.csv [2025-09-29T02:09:56.867315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOW.csv [2025-09-29T02:09:56.867480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUW.csv [2025-09-29T02:09:56.867758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPX.csv [2025-09-29T02:09:56.867902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFS.csv [2025-09-29T02:09:56.868083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFBS.csv [2025-09-29T02:09:56.868247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXP.csv [2025-09-29T02:09:56.868431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSL.csv [2025-09-29T02:09:56.868596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFK.csv [2025-09-29T02:09:56.868807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRG.csv [2025-09-29T02:09:56.869011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HVT.csv [2025-09-29T02:09:56.869191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRE.csv [2025-09-29T02:09:56.869381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DELL.csv [2025-09-29T02:09:56.869553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THO.csv [2025-09-29T02:09:56.869753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAP.csv [2025-09-29T02:09:56.869935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGVC.csv [2025-09-29T02:09:56.870100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFLT.csv [2025-09-29T02:09:56.870264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEUE.csv [2025-09-29T02:09:56.870433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQBK.csv [2025-09-29T02:09:56.870596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLB.csv [2025-09-29T02:09:56.870766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLE.csv [2025-09-29T02:09:56.870919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLCO.csv [2025-09-29T02:09:56.871108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMH.csv [2025-09-29T02:09:56.871301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROL.csv [2025-09-29T02:09:56.871800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBL.csv [2025-09-29T02:09:56.872013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCS.csv [2025-09-29T02:09:56.872263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUN.csv [2025-09-29T02:09:56.872424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BN.csv [2025-09-29T02:09:56.872709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQNR.csv [2025-09-29T02:09:56.872894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAE.csv [2025-09-29T02:09:56.873084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHO.csv [2025-09-29T02:09:56.873297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPW.csv [2025-09-29T02:09:56.873461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOMR.csv [2025-09-29T02:09:56.873673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMBK.csv [2025-09-29T02:09:56.873870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAGN.csv [2025-09-29T02:09:56.874081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPH.csv [2025-09-29T02:09:56.874291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOA.csv [2025-09-29T02:09:56.874501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVC.csv [2025-09-29T02:09:56.874744] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFGC.csv [2025-09-29T02:09:56.874946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMN.csv [2025-09-29T02:09:56.875127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSO.csv [2025-09-29T02:09:56.875296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STZ.csv [2025-09-29T02:09:56.875478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIO.csv [2025-09-29T02:09:56.875740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVX.csv [2025-09-29T02:09:56.875920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDE.csv [2025-09-29T02:09:56.876123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDS.csv [2025-09-29T02:09:56.876349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FERG.csv [2025-09-29T02:09:56.876532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBK.csv [2025-09-29T02:09:56.876695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASIX.csv [2025-09-29T02:09:56.876889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOR.csv [2025-09-29T02:09:56.877110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOD.csv [2025-09-29T02:09:56.877295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPC.csv [2025-09-29T02:09:56.877479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYF.csv [2025-09-29T02:09:56.877710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBI.csv [2025-09-29T02:09:56.877946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TECK.csv [2025-09-29T02:09:56.878167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCB.csv [2025-09-29T02:09:56.878366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFM.csv [2025-09-29T02:09:56.878568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKC.csv [2025-09-29T02:09:56.878824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLX.csv [2025-09-29T02:09:56.879007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVZ.csv [2025-09-29T02:09:56.879201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/R.csv [2025-09-29T02:09:56.879406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMC.csv [2025-09-29T02:09:56.879572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDX.csv [2025-09-29T02:09:56.879816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCN.csv [2025-09-29T02:09:56.879984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LHX.csv [2025-09-29T02:09:56.880136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDC.csv [2025-09-29T02:09:56.880342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WF.csv [2025-09-29T02:09:56.880524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMRE.csv [2025-09-29T02:09:56.880753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AS.csv [2025-09-29T02:09:56.880963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUV.csv [2025-09-29T02:09:56.881142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTN.csv [2025-09-29T02:09:56.881374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWXT.csv [2025-09-29T02:09:56.881572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RPM.csv [2025-09-29T02:09:56.881804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANRO.csv [2025-09-29T02:09:56.881936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACEL.csv [2025-09-29T02:09:56.882117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPVG.csv [2025-09-29T02:09:56.882299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFC.csv [2025-09-29T02:09:56.882465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNE.csv [2025-09-29T02:09:56.882696] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPV.csv [2025-09-29T02:09:56.882899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SARO.csv [2025-09-29T02:09:56.883090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NWN.csv [2025-09-29T02:09:56.883284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIG.csv [2025-09-29T02:09:56.883837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVF.csv [2025-09-29T02:09:56.883988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLND.csv [2025-09-29T02:09:56.884191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QBTS.csv [2025-09-29T02:09:56.884350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNF.csv [2025-09-29T02:09:56.884535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLR.csv [2025-09-29T02:09:56.884719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NHI.csv [2025-09-29T02:09:56.884928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPAM.csv [2025-09-29T02:09:56.885104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPZ.csv [2025-09-29T02:09:56.885294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRLL.csv [2025-09-29T02:09:56.885476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEM.csv [2025-09-29T02:09:56.885674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBN.csv [2025-09-29T02:09:56.885927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCF.csv [2025-09-29T02:09:56.886136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHD.csv [2025-09-29T02:09:56.886359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETY.csv [2025-09-29T02:09:56.886529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZETA.csv [2025-09-29T02:09:56.886739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBLX.csv [2025-09-29T02:09:56.886984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFC.csv [2025-09-29T02:09:56.887197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UP.csv [2025-09-29T02:09:56.887387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLS.csv [2025-09-29T02:09:56.887518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACHR.csv [2025-09-29T02:09:56.887719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STAG.csv [2025-09-29T02:09:56.887895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCIF.csv [2025-09-29T02:09:56.888115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KODK.csv [2025-09-29T02:09:56.888285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALB.csv [2025-09-29T02:09:56.888449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLDT.csv [2025-09-29T02:09:56.888598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARES.csv [2025-09-29T02:09:56.888817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PJT.csv [2025-09-29T02:09:56.889019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCI.csv [2025-09-29T02:09:56.889221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NLY.csv [2025-09-29T02:09:56.889435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VBF.csv [2025-09-29T02:09:56.889673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RY.csv [2025-09-29T02:09:56.889902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDRL.csv [2025-09-29T02:09:56.890091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATKR.csv [2025-09-29T02:09:56.890295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BX.csv [2025-09-29T02:09:56.890545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MWA.csv [2025-09-29T02:09:56.890778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GVA.csv [2025-09-29T02:09:56.891009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBP.csv [2025-09-29T02:09:56.891206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OFG.csv [2025-09-29T02:09:56.891404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIRK.csv [2025-09-29T02:09:56.891617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MS.csv [2025-09-29T02:09:56.891872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMM.csv [2025-09-29T02:09:56.892076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOMA.csv [2025-09-29T02:09:56.892267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BST.csv [2025-09-29T02:09:56.892473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNP.csv [2025-09-29T02:09:56.892778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNS.csv [2025-09-29T02:09:56.893033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQR.csv [2025-09-29T02:09:56.893262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECO.csv [2025-09-29T02:09:56.893468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBI.csv [2025-09-29T02:09:56.894105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRB.csv [2025-09-29T02:09:56.894314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRI.csv [2025-09-29T02:09:56.894524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBOT.csv [2025-09-29T02:09:56.894743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEV.csv [2025-09-29T02:09:56.894956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAB.csv [2025-09-29T02:09:56.895134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALC.csv [2025-09-29T02:09:56.895298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMRC.csv [2025-09-29T02:09:56.895520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQH.csv [2025-09-29T02:09:56.895766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNMD.csv [2025-09-29T02:09:56.895979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QXO.csv [2025-09-29T02:09:56.896190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DY.csv [2025-09-29T02:09:56.896349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMA.csv [2025-09-29T02:09:56.896543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HFRO.csv [2025-09-29T02:09:56.896788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBB.csv [2025-09-29T02:09:56.896976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALIT.csv [2025-09-29T02:09:56.897188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAN.csv [2025-09-29T02:09:56.897421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRM.csv [2025-09-29T02:09:56.897577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AME.csv [2025-09-29T02:09:56.897845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZB.csv [2025-09-29T02:09:56.898063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CABO.csv [2025-09-29T02:09:56.898262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKRS.csv [2025-09-29T02:09:56.898455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXN.csv [2025-09-29T02:09:56.898724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJD.csv [2025-09-29T02:09:56.898920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBB.csv [2025-09-29T02:09:56.899121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDM.csv [2025-09-29T02:09:56.899328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRC.csv [2025-09-29T02:09:56.899574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGA.csv [2025-09-29T02:09:56.899771] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BE.csv [2025-09-29T02:09:56.899969] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EICC.csv [2025-09-29T02:09:56.900181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRA.csv [2025-09-29T02:09:56.900364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASG.csv [2025-09-29T02:09:56.900619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OII.csv [2025-09-29T02:09:56.900849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OCFT.csv [2025-09-29T02:09:56.901060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGB.csv [2025-09-29T02:09:56.901259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTM.csv [2025-09-29T02:09:56.901428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BANC.csv [2025-09-29T02:09:56.901658] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSTK.csv [2025-09-29T02:09:56.901891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FC.csv [2025-09-29T02:09:56.902089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CADE.csv [2025-09-29T02:09:56.902302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECAT.csv [2025-09-29T02:09:56.902556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMED.csv [2025-09-29T02:09:56.902777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EL.csv [2025-09-29T02:09:56.902945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBVA.csv [2025-09-29T02:09:56.903163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJT.csv [2025-09-29T02:09:56.903417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEI.csv [2025-09-29T02:09:56.903618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXDT.csv [2025-09-29T02:09:56.903855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEKE.csv [2025-09-29T02:09:56.904018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGS.csv [2025-09-29T02:09:56.904237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUSA.csv [2025-09-29T02:09:56.904404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGN.csv [2025-09-29T02:09:56.904636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OHI.csv [2025-09-29T02:09:56.904992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTI.csv [2025-09-29T02:09:56.905190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTLE.csv [2025-09-29T02:09:56.905415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELV.csv [2025-09-29T02:09:56.905566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAH.csv [2025-09-29T02:09:56.905808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSQ.csv [2025-09-29T02:09:56.906018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIAX.csv [2025-09-29T02:09:56.906181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDC.csv [2025-09-29T02:09:56.906374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRUC.csv [2025-09-29T02:09:56.906558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIL.csv [2025-09-29T02:09:56.906743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHVN.csv [2025-09-29T02:09:56.906968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHS.csv [2025-09-29T02:09:56.907146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSX.csv [2025-09-29T02:09:56.907350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTE.csv [2025-09-29T02:09:56.907590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAG.csv [2025-09-29T02:09:56.907821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHG.csv [2025-09-29T02:09:56.908007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PVH.csv [2025-09-29T02:09:56.908146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASR.csv [2025-09-29T02:09:56.908284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABCB.csv [2025-09-29T02:09:56.908924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFS.csv [2025-09-29T02:09:56.909075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APD.csv [2025-09-29T02:09:56.909269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOV.csv [2025-09-29T02:09:56.909448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BORR.csv [2025-09-29T02:09:56.909661] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BY.csv [2025-09-29T02:09:56.909843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IONQ.csv [2025-09-29T02:09:56.910017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBBB.csv [2025-09-29T02:09:56.910207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEQ.csv [2025-09-29T02:09:56.910382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZF.csv [2025-09-29T02:09:56.910549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPH.csv [2025-09-29T02:09:56.910734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REX.csv [2025-09-29T02:09:56.910900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFII.csv [2025-09-29T02:09:56.911060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHO.csv [2025-09-29T02:09:56.911251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIM.csv [2025-09-29T02:09:56.911395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPO.csv [2025-09-29T02:09:56.911569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZB.csv [2025-09-29T02:09:56.911822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXFR.csv [2025-09-29T02:09:56.912023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBL.csv [2025-09-29T02:09:56.912165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCSF.csv [2025-09-29T02:09:56.912307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKN.csv [2025-09-29T02:09:56.912486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFG.csv [2025-09-29T02:09:56.912666] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOC.csv [2025-09-29T02:09:56.912853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSLX.csv [2025-09-29T02:09:56.912977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUNA.csv [2025-09-29T02:09:56.913145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVG.csv [2025-09-29T02:09:56.913321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHG.csv [2025-09-29T02:09:56.913465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFO.csv [2025-09-29T02:09:56.913610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVR.csv [2025-09-29T02:09:56.913835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPD.csv [2025-09-29T02:09:56.914014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANVS.csv [2025-09-29T02:09:56.914197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUBO.csv [2025-09-29T02:09:56.914366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IOT.csv [2025-09-29T02:09:56.914547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXJ.csv [2025-09-29T02:09:56.914732] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLW.csv [2025-09-29T02:09:56.914939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAC.csv [2025-09-29T02:09:56.915092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBH.csv [2025-09-29T02:09:56.915256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHPT.csv [2025-09-29T02:09:56.915425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORN.csv [2025-09-29T02:09:56.915583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGS.csv [2025-09-29T02:09:56.915756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOF.csv [2025-09-29T02:09:56.915926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORC.csv [2025-09-29T02:09:56.916107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAL.csv [2025-09-29T02:09:56.916259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMR.csv [2025-09-29T02:09:56.916440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHI.csv [2025-09-29T02:09:56.917102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIS.csv [2025-09-29T02:09:56.917304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUX.csv [2025-09-29T02:09:56.917485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TS.csv [2025-09-29T02:09:56.917684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVT.csv [2025-09-29T02:09:56.917836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICE.csv [2025-09-29T02:09:56.917986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPNT.csv [2025-09-29T02:09:56.918143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CODI.csv [2025-09-29T02:09:56.918321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRLB.csv [2025-09-29T02:09:56.918523] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKG.csv [2025-09-29T02:09:56.918785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZM.csv [2025-09-29T02:09:56.918985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAT.csv [2025-09-29T02:09:56.919160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAFN.csv [2025-09-29T02:09:56.919369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMZ.csv [2025-09-29T02:09:56.919548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAND.csv [2025-09-29T02:09:56.919769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAF.csv [2025-09-29T02:09:56.919936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRH.csv [2025-09-29T02:09:56.920051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABT.csv [2025-09-29T02:09:56.920216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBG.csv [2025-09-29T02:09:56.920375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRMN.csv [2025-09-29T02:09:56.920531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIB.csv [2025-09-29T02:09:56.920773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCLH.csv [2025-09-29T02:09:56.920925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPB.csv [2025-09-29T02:09:56.921084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JQC.csv [2025-09-29T02:09:56.921264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDDY.csv [2025-09-29T02:09:56.921483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCY.csv [2025-09-29T02:09:56.921671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMT.csv [2025-09-29T02:09:56.921829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DE.csv [2025-09-29T02:09:56.922000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FN.csv [2025-09-29T02:09:56.922166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFM.csv [2025-09-29T02:09:56.922334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFA.csv [2025-09-29T02:09:56.922587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RACE.csv [2025-09-29T02:09:56.922755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAM.csv [2025-09-29T02:09:56.922905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIN.csv [2025-09-29T02:09:56.923106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIX.csv [2025-09-29T02:09:56.923223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABBV.csv [2025-09-29T02:09:56.923373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFX.csv [2025-09-29T02:09:56.923529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMS.csv [2025-09-29T02:09:56.923700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFI.csv [2025-09-29T02:09:56.923841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDO.csv [2025-09-29T02:09:56.924041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCM.csv [2025-09-29T02:09:56.924206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDOC.csv [2025-09-29T02:09:56.924374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMT.csv [2025-09-29T02:09:56.924541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKX.csv [2025-09-29T02:09:56.924714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDU.csv [2025-09-29T02:09:56.924890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXSL.csv [2025-09-29T02:09:56.925089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPM.csv [2025-09-29T02:09:56.925338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZGN.csv [2025-09-29T02:09:56.925544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/POST.csv [2025-09-29T02:09:56.925711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIR.csv [2025-09-29T02:09:56.925883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAVA.csv [2025-09-29T02:09:56.926046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETJ.csv [2025-09-29T02:09:56.926200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLC.csv [2025-09-29T02:09:56.926357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NINE.csv [2025-09-29T02:09:56.926537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEVI.csv [2025-09-29T02:09:56.926778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAT.csv [2025-09-29T02:09:56.926966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBUC.csv [2025-09-29T02:09:56.927197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMB.csv [2025-09-29T02:09:56.927458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTK.csv [2025-09-29T02:09:56.927597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BABA.csv [2025-09-29T02:09:56.928044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGZ.csv [2025-09-29T02:09:56.928224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ET.csv [2025-09-29T02:09:56.928393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTF.csv [2025-09-29T02:09:56.928533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMT.csv [2025-09-29T02:09:56.928816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZBH.csv [2025-09-29T02:09:56.928975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STN.csv [2025-09-29T02:09:56.929153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUG.csv [2025-09-29T02:09:56.929295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGT.csv [2025-09-29T02:09:56.929488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPP.csv [2025-09-29T02:09:56.929740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTD.csv [2025-09-29T02:09:56.929890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OI.csv [2025-09-29T02:09:56.930043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTAL.csv [2025-09-29T02:09:56.930233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDV.csv [2025-09-29T02:09:56.930421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPI.csv [2025-09-29T02:09:56.930598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WELL.csv [2025-09-29T02:09:56.930791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMC.csv [2025-09-29T02:09:56.930917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASH.csv [2025-09-29T02:09:56.931095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVLV.csv [2025-09-29T02:09:56.931266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVT.csv [2025-09-29T02:09:56.931380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACRE.csv [2025-09-29T02:09:56.931554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TT.csv [2025-09-29T02:09:56.931766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYF.csv [2025-09-29T02:09:56.931930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PR.csv [2025-09-29T02:09:56.932079] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAR.csv [2025-09-29T02:09:56.932235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBL.csv [2025-09-29T02:09:56.932489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MT.csv [2025-09-29T02:09:56.932707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCC.csv [2025-09-29T02:09:56.932887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIS.csv [2025-09-29T02:09:56.933046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RES.csv [2025-09-29T02:09:56.933160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDX.csv [2025-09-29T02:09:56.933362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KREF.csv [2025-09-29T02:09:56.933532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUJ.csv [2025-09-29T02:09:56.933876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRGO.csv [2025-09-29T02:09:56.934061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRO.csv [2025-09-29T02:09:56.934203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AAP.csv [2025-09-29T02:09:56.934607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCX.csv [2025-09-29T02:09:56.934784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMI.csv [2025-09-29T02:09:56.934996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPMT.csv [2025-09-29T02:09:56.935180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SON.csv [2025-09-29T02:09:56.935375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXP.csv [2025-09-29T02:09:56.935556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPF.csv [2025-09-29T02:09:56.935774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAP.csv [2025-09-29T02:09:56.935946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLKP.csv [2025-09-29T02:09:56.936123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCD.csv [2025-09-29T02:09:56.936279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DCO.csv [2025-09-29T02:09:56.936473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRP.csv [2025-09-29T02:09:56.936698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTC.csv [2025-09-29T02:09:56.936880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RITM.csv [2025-09-29T02:09:56.937039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMD.csv [2025-09-29T02:09:56.937152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APLE.csv [2025-09-29T02:09:56.937868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVUE.csv [2025-09-29T02:09:56.938037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWK.csv [2025-09-29T02:09:56.938236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXR.csv [2025-09-29T02:09:56.938386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRKS.csv [2025-09-29T02:09:56.938567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTDD.csv [2025-09-29T02:09:56.938786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SA.csv [2025-09-29T02:09:56.938952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNL.csv [2025-09-29T02:09:56.939144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXO.csv [2025-09-29T02:09:56.939304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RRX.csv [2025-09-29T02:09:56.939504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRU.csv [2025-09-29T02:09:56.939709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIMS.csv [2025-09-29T02:09:56.939950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CM.csv [2025-09-29T02:09:56.940115] [INFO ] [LOCAL ] Deleted 2211 derivative data files. [2025-09-29T02:09:56.940189] [INFO ] [LOCAL ] Scanning primary storage for available symbols. [2025-09-29T02:09:56.942815] [INFO ] [LOCAL ] Found 2211 symbols with primary data. [2025-09-29T02:09:56.943509] [INFO ] [MAIN ] Starting parallel derivative generation with 3 worker threads for 2211 symbols [2025-09-29T02:09:56.944521] [INFO ] [MAIN ] A: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:09:56.945147] [INFO ] [MAIN ] AA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:09:56.945469] [INFO ] [MAIN ] AAP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:09:57.043490] [DEBUG] [LOCAL ] AAP: Loaded 52789 existing records from primary storage. [2025-09-29T02:09:57.045993] [INFO ] [MAIN ] AAP: Loaded 52789 primary data records. [2025-09-29T02:09:57.134275] [DEBUG] [LOCAL ] AA: Loaded 54394 existing records from primary storage. [2025-09-29T02:09:57.138824] [INFO ] [MAIN ] AA: Loaded 54394 primary data records. [2025-09-29T02:09:57.176804] [DEBUG] [LOCAL ] A: Loaded 51487 existing records from primary storage. [2025-09-29T02:09:57.209937] [INFO ] [MAIN ] A: Loaded 51487 primary data records. [2025-09-29T02:09:58.196624] [DEBUG] [MAIN ] AAP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:09:58.198467] [INFO ] [MAIN ] AAP: Generated 1820 derivative records from 52789 primary records. [2025-09-29T02:09:58.198768] [DEBUG] [LOCAL ] AAP: Saving derivative data. [2025-09-29T02:09:58.217701] [DEBUG] [MAIN ] AA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:09:58.232535] [INFO ] [MAIN ] AA: Generated 1820 derivative records from 54394 primary records. [2025-09-29T02:09:58.234105] [DEBUG] [LOCAL ] AA: Saving derivative data. [2025-09-29T02:09:58.252790] [DEBUG] [LOCAL ] AA: Derivative data saved (1820 records). [2025-09-29T02:09:58.253527] [INFO ] [MAIN ] AA: Successfully saved derivative data. [2025-09-29T02:09:58.258758] [INFO ] [MAIN ] Derivative Progress: 1/2211 symbols completed. AA took 1.3s. Estimated remaining: 48m 28s. Rate: 45.6 symbols/min [2025-09-29T02:09:58.261863] [INFO ] [MAIN ] AAT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:09:58.262615] [DEBUG] [LOCAL ] AAP: Derivative data saved (1820 records). [2025-09-29T02:09:58.263303] [INFO ] [MAIN ] AAP: Successfully saved derivative data. [2025-09-29T02:09:58.265879] [INFO ] [MAIN ] Derivative Progress: 2/2211 symbols completed. AAP took 1.3s. Estimated remaining: 24m 21s. Rate: 90.7 symbols/min [2025-09-29T02:09:58.266183] [INFO ] [MAIN ] AB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:09:58.282092] [DEBUG] [MAIN ] A: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:09:58.282940] [INFO ] [MAIN ] A: Generated 1820 derivative records from 51487 primary records. [2025-09-29T02:09:58.283034] [DEBUG] [LOCAL ] A: Saving derivative data. [2025-09-29T02:09:58.309559] [DEBUG] [LOCAL ] A: Derivative data saved (1820 records). [2025-09-29T02:09:58.309753] [INFO ] [MAIN ] A: Successfully saved derivative data. [2025-09-29T02:09:58.312915] [INFO ] [MAIN ] Derivative Progress: 3/2211 symbols completed. A took 1.4s. Estimated remaining: 16m 48s. Rate: 131.4 symbols/min [2025-09-29T02:09:58.313274] [INFO ] [MAIN ] ABBV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:09:58.336435] [DEBUG] [LOCAL ] AAT: Loaded 31069 existing records from primary storage. [2025-09-29T02:09:58.345206] [INFO ] [MAIN ] AAT: Loaded 31069 primary data records. [2025-09-29T02:09:58.346065] [DEBUG] [LOCAL ] AB: Loaded 28642 existing records from primary storage. [2025-09-29T02:09:58.358662] [INFO ] [MAIN ] AB: Loaded 28642 primary data records. [2025-09-29T02:09:59.081894] [DEBUG] [LOCAL ] ABBV: Loaded 54465 existing records from primary storage. [2025-09-29T02:09:59.084467] [INFO ] [MAIN ] ABBV: Loaded 54465 primary data records. [2025-09-29T02:09:59.451492] [DEBUG] [MAIN ] AAT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:09:59.465505] [INFO ] [MAIN ] AAT: Generated 1820 derivative records from 31069 primary records. [2025-09-29T02:09:59.465990] [DEBUG] [LOCAL ] AAT: Saving derivative data. [2025-09-29T02:09:59.466474] [DEBUG] [MAIN ] AB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:09:59.468091] [INFO ] [MAIN ] AB: Generated 1820 derivative records from 28642 primary records. [2025-09-29T02:09:59.469060] [DEBUG] [LOCAL ] AB: Saving derivative data. [2025-09-29T02:09:59.499918] [DEBUG] [LOCAL ] AAT: Derivative data saved (1820 records). [2025-09-29T02:09:59.504919] [DEBUG] [LOCAL ] AB: Derivative data saved (1820 records). [2025-09-29T02:09:59.505152] [INFO ] [MAIN ] AAT: Successfully saved derivative data. [2025-09-29T02:09:59.507611] [INFO ] [MAIN ] Derivative Progress: 4/2211 symbols completed. AAT took 1.2s. Estimated remaining: 23m 35s. Rate: 93.6 symbols/min [2025-09-29T02:09:59.508040] [INFO ] [MAIN ] ABCB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:09:59.508288] [INFO ] [MAIN ] AB: Successfully saved derivative data. [2025-09-29T02:09:59.511698] [INFO ] [MAIN ] Derivative Progress: 5/2211 symbols completed. AB took 1.2s. Estimated remaining: 18m 53s. Rate: 116.8 symbols/min [2025-09-29T02:09:59.512413] [INFO ] [MAIN ] ABEV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:09:59.534836] [DEBUG] [MAIN ] ABBV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:09:59.535936] [INFO ] [MAIN ] ABBV: Generated 1820 derivative records from 54465 primary records. [2025-09-29T02:09:59.536220] [DEBUG] [LOCAL ] ABBV: Saving derivative data. [2025-09-29T02:09:59.563828] [DEBUG] [LOCAL ] ABBV: Derivative data saved (1820 records). [2025-09-29T02:09:59.565262] [INFO ] [MAIN ] ABBV: Successfully saved derivative data. [2025-09-29T02:09:59.577917] [INFO ] [MAIN ] Derivative Progress: 6/2211 symbols completed. ABBV took 1.3s. Estimated remaining: 16m 8s. Rate: 136.6 symbols/min [2025-09-29T02:09:59.579144] [DEBUG] [LOCAL ] ABCB: Loaded 31144 existing records from primary storage. [2025-09-29T02:09:59.579729] [INFO ] [MAIN ] ABG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:09:59.579829] [INFO ] [MAIN ] ABCB: Loaded 31144 primary data records. [2025-09-29T02:09:59.773473] [DEBUG] [LOCAL ] ABEV: Loaded 54055 existing records from primary storage. [2025-09-29T02:09:59.799747] [INFO ] [MAIN ] ABEV: Loaded 54055 primary data records. [2025-09-29T02:09:59.800506] [DEBUG] [LOCAL ] ABG: Loaded 19034 existing records from primary storage. [2025-09-29T02:09:59.810398] [INFO ] [MAIN ] ABG: Loaded 19034 primary data records. [2025-09-29T02:10:00.731924] [DEBUG] [MAIN ] ABCB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:00.734171] [INFO ] [MAIN ] ABCB: Generated 1820 derivative records from 31144 primary records. [2025-09-29T02:10:00.734447] [DEBUG] [LOCAL ] ABCB: Saving derivative data. [2025-09-29T02:10:00.757688] [DEBUG] [LOCAL ] ABCB: Derivative data saved (1820 records). [2025-09-29T02:10:00.758299] [INFO ] [MAIN ] ABCB: Successfully saved derivative data. [2025-09-29T02:10:00.761176] [INFO ] [MAIN ] Derivative Progress: 7/2211 symbols completed. ABCB took 1.3s. Estimated remaining: 20m 2s. Rate: 110.0 symbols/min [2025-09-29T02:10:00.761782] [INFO ] [MAIN ] ABM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:00.798179] [DEBUG] [MAIN ] ABG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:00.799989] [INFO ] [MAIN ] ABG: Generated 1820 derivative records from 19034 primary records. [2025-09-29T02:10:00.798552] [DEBUG] [MAIN ] ABEV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:00.800352] [DEBUG] [LOCAL ] ABG: Saving derivative data. [2025-09-29T02:10:00.801244] [INFO ] [MAIN ] ABEV: Generated 1820 derivative records from 54055 primary records. [2025-09-29T02:10:00.801574] [DEBUG] [LOCAL ] ABEV: Saving derivative data. [2025-09-29T02:10:00.847953] [DEBUG] [LOCAL ] ABEV: Derivative data saved (1820 records). [2025-09-29T02:10:00.848728] [INFO ] [MAIN ] ABEV: Successfully saved derivative data. [2025-09-29T02:10:00.851525] [INFO ] [MAIN ] Derivative Progress: 8/2211 symbols completed. ABEV took 1.3s. Estimated remaining: 17m 56s. Rate: 122.8 symbols/min [2025-09-29T02:10:00.852733] [INFO ] [MAIN ] ABR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:00.856173] [DEBUG] [LOCAL ] ABG: Derivative data saved (1820 records). [2025-09-29T02:10:00.856368] [INFO ] [MAIN ] ABG: Successfully saved derivative data. [2025-09-29T02:10:00.860136] [INFO ] [MAIN ] Derivative Progress: 9/2211 symbols completed. ABG took 1.3s. Estimated remaining: 15m 58s. Rate: 137.9 symbols/min [2025-09-29T02:10:00.860583] [INFO ] [MAIN ] ABT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:00.877392] [DEBUG] [LOCAL ] ABM: Loaded 32915 existing records from primary storage. [2025-09-29T02:10:00.877684] [INFO ] [MAIN ] ABM: Loaded 32915 primary data records. [2025-09-29T02:10:01.270000] [DEBUG] [LOCAL ] ABR: Loaded 52817 existing records from primary storage. [2025-09-29T02:10:01.271114] [INFO ] [MAIN ] ABR: Loaded 52817 primary data records. [2025-09-29T02:10:01.398462] [DEBUG] [LOCAL ] ABT: Loaded 54400 existing records from primary storage. [2025-09-29T02:10:01.417701] [INFO ] [MAIN ] ABT: Loaded 54400 primary data records. [2025-09-29T02:10:01.860451] [DEBUG] [MAIN ] ABM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:01.897217] [INFO ] [MAIN ] ABM: Generated 1820 derivative records from 32915 primary records. [2025-09-29T02:10:02.035723] [DEBUG] [LOCAL ] ABM: Saving derivative data. [2025-09-29T02:10:02.059052] [DEBUG] [LOCAL ] ABM: Derivative data saved (1820 records). [2025-09-29T02:10:02.060507] [INFO ] [MAIN ] ABM: Successfully saved derivative data. [2025-09-29T02:10:02.063388] [INFO ] [MAIN ] Derivative Progress: 10/2211 symbols completed. ABM took 1.3s. Estimated remaining: 18m 47s. Rate: 117.2 symbols/min [2025-09-29T02:10:02.064203] [INFO ] [MAIN ] ACA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:02.086479] [DEBUG] [MAIN ] ABR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:02.087749] [INFO ] [MAIN ] ABR: Generated 1820 derivative records from 52817 primary records. [2025-09-29T02:10:02.088212] [DEBUG] [LOCAL ] ABR: Saving derivative data. [2025-09-29T02:10:02.114342] [DEBUG] [LOCAL ] ABR: Derivative data saved (1820 records). [2025-09-29T02:10:02.116668] [INFO ] [MAIN ] ABR: Successfully saved derivative data. [2025-09-29T02:10:02.118828] [INFO ] [MAIN ] Derivative Progress: 11/2211 symbols completed. ABR took 1.3s. Estimated remaining: 17m 15s. Rate: 127.5 symbols/min [2025-09-29T02:10:02.120231] [INFO ] [MAIN ] ACCO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:02.142491] [DEBUG] [LOCAL ] ACA: Loaded 24034 existing records from primary storage. [2025-09-29T02:10:02.143054] [INFO ] [MAIN ] ACA: Loaded 24034 primary data records. [2025-09-29T02:10:02.142913] [DEBUG] [MAIN ] ABT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:02.156024] [INFO ] [MAIN ] ABT: Generated 1820 derivative records from 54400 primary records. [2025-09-29T02:10:02.191342] [DEBUG] [LOCAL ] ABT: Saving derivative data. [2025-09-29T02:10:02.524499] [DEBUG] [LOCAL ] ABT: Derivative data saved (1820 records). [2025-09-29T02:10:02.527185] [INFO ] [MAIN ] ABT: Successfully saved derivative data. [2025-09-29T02:10:02.529065] [DEBUG] [LOCAL ] ACCO: Loaded 38214 existing records from primary storage. [2025-09-29T02:10:02.535579] [INFO ] [MAIN ] ACCO: Loaded 38214 primary data records. [2025-09-29T02:10:02.533947] [INFO ] [MAIN ] Derivative Progress: 12/2211 symbols completed. ABT took 1.7s. Estimated remaining: 17m 5s. Rate: 128.8 symbols/min [2025-09-29T02:10:02.537138] [INFO ] [MAIN ] ACEL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:02.951899] [DEBUG] [LOCAL ] ACEL: Loaded 27405 existing records from primary storage. [2025-09-29T02:10:02.952722] [INFO ] [MAIN ] ACEL: Loaded 27405 primary data records. [2025-09-29T02:10:03.003956] [DEBUG] [MAIN ] ACA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:03.028551] [INFO ] [MAIN ] ACA: Generated 1820 derivative records from 24034 primary records. [2025-09-29T02:10:03.029185] [DEBUG] [LOCAL ] ACA: Saving derivative data. [2025-09-29T02:10:03.110213] [DEBUG] [LOCAL ] ACA: Derivative data saved (1820 records). [2025-09-29T02:10:03.111094] [INFO ] [MAIN ] ACA: Successfully saved derivative data. [2025-09-29T02:10:03.135750] [INFO ] [MAIN ] Derivative Progress: 13/2211 symbols completed. ACA took 1.1s. Estimated remaining: 17m 27s. Rate: 126.0 symbols/min [2025-09-29T02:10:03.351230] [DEBUG] [MAIN ] ACCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:03.352875] [INFO ] [MAIN ] ACCO: Generated 1820 derivative records from 38214 primary records. [2025-09-29T02:10:03.353152] [DEBUG] [LOCAL ] ACCO: Saving derivative data. [2025-09-29T02:10:03.370495] [DEBUG] [LOCAL ] ACCO: Derivative data saved (1820 records). [2025-09-29T02:10:03.370730] [INFO ] [MAIN ] ACCO: Successfully saved derivative data. [2025-09-29T02:10:03.373227] [INFO ] [MAIN ] Derivative Progress: 14/2211 symbols completed. ACCO took 1.3s. Estimated remaining: 16m 49s. Rate: 130.6 symbols/min [2025-09-29T02:10:03.393112] [DEBUG] [MAIN ] ACEL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:03.393965] [INFO ] [MAIN ] ACEL: Generated 1820 derivative records from 27405 primary records. [2025-09-29T02:10:03.394051] [DEBUG] [LOCAL ] ACEL: Saving derivative data. [2025-09-29T02:10:03.409752] [DEBUG] [LOCAL ] ACEL: Derivative data saved (1820 records). [2025-09-29T02:10:03.409862] [INFO ] [MAIN ] ACEL: Successfully saved derivative data. [2025-09-29T02:10:03.413071] [INFO ] [MAIN ] Derivative Progress: 15/2211 symbols completed. ACEL took 0.9s. Estimated remaining: 15m 47s. Rate: 139.1 symbols/min [2025-09-29T02:10:03.413505] [INFO ] [MAIN ] ACHR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:03.413634] [INFO ] [MAIN ] ACI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:03.413578] [INFO ] [MAIN ] ACM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:03.520000] [DEBUG] [LOCAL ] ACM: Loaded 43767 existing records from primary storage. [2025-09-29T02:10:03.540385] [INFO ] [MAIN ] ACM: Loaded 43767 primary data records. [2025-09-29T02:10:03.521089] [DEBUG] [LOCAL ] ACHR: Loaded 54598 existing records from primary storage. [2025-09-29T02:10:03.541058] [INFO ] [MAIN ] ACHR: Loaded 54598 primary data records. [2025-09-29T02:10:03.568064] [DEBUG] [LOCAL ] ACI: Loaded 54044 existing records from primary storage. [2025-09-29T02:10:03.568346] [INFO ] [MAIN ] ACI: Loaded 54044 primary data records. [2025-09-29T02:10:04.600077] [DEBUG] [MAIN ] ACM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:04.601607] [INFO ] [MAIN ] ACM: Generated 1820 derivative records from 43767 primary records. [2025-09-29T02:10:04.602118] [DEBUG] [LOCAL ] ACM: Saving derivative data. [2025-09-29T02:10:04.621463] [DEBUG] [LOCAL ] ACM: Derivative data saved (1820 records). [2025-09-29T02:10:04.624683] [INFO ] [MAIN ] ACM: Successfully saved derivative data. [2025-09-29T02:10:04.629532] [INFO ] [MAIN ] Derivative Progress: 16/2211 symbols completed. ACM took 1.2s. Estimated remaining: 17m 35s. Rate: 124.9 symbols/min [2025-09-29T02:10:04.631070] [INFO ] [MAIN ] ACN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:04.658349] [DEBUG] [MAIN ] ACHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:04.658928] [DEBUG] [MAIN ] ACI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:04.661322] [INFO ] [MAIN ] ACI: Generated 1820 derivative records from 54044 primary records. [2025-09-29T02:10:04.660312] [INFO ] [MAIN ] ACHR: Generated 1820 derivative records from 54598 primary records. [2025-09-29T02:10:04.661450] [DEBUG] [LOCAL ] ACI: Saving derivative data. [2025-09-29T02:10:04.661785] [DEBUG] [LOCAL ] ACHR: Saving derivative data. [2025-09-29T02:10:04.703580] [DEBUG] [LOCAL ] ACHR: Derivative data saved (1820 records). [2025-09-29T02:10:04.709591] [INFO ] [MAIN ] ACHR: Successfully saved derivative data. [2025-09-29T02:10:04.710723] [DEBUG] [LOCAL ] ACI: Derivative data saved (1820 records). [2025-09-29T02:10:04.715158] [INFO ] [MAIN ] Derivative Progress: 17/2211 symbols completed. ACHR took 1.3s. Estimated remaining: 16m 43s. Rate: 131.2 symbols/min [2025-09-29T02:10:04.715689] [INFO ] [MAIN ] ACI: Successfully saved derivative data. [2025-09-29T02:10:04.715875] [INFO ] [MAIN ] ACP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:04.720158] [INFO ] [MAIN ] Derivative Progress: 18/2211 symbols completed. ACI took 1.3s. Estimated remaining: 15m 48s. Rate: 138.9 symbols/min [2025-09-29T02:10:04.720914] [INFO ] [MAIN ] ACR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:04.751009] [DEBUG] [LOCAL ] ACR: Loaded 6352 existing records from primary storage. [2025-09-29T02:10:04.751230] [INFO ] [MAIN ] ACR: Loaded 6352 primary data records. [2025-09-29T02:10:04.896051] [DEBUG] [LOCAL ] ACN: Loaded 54204 existing records from primary storage. [2025-09-29T02:10:04.912736] [INFO ] [MAIN ] ACN: Loaded 54204 primary data records. [2025-09-29T02:10:05.265087] [DEBUG] [LOCAL ] ACP: Loaded 31428 existing records from primary storage. [2025-09-29T02:10:05.270244] [INFO ] [MAIN ] ACP: Loaded 31428 primary data records. [2025-09-29T02:10:05.850966] [DEBUG] [MAIN ] ACR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:05.853111] [INFO ] [MAIN ] ACR: Generated 1820 derivative records from 6352 primary records. [2025-09-29T02:10:05.855406] [DEBUG] [LOCAL ] ACR: Saving derivative data. [2025-09-29T02:10:05.879341] [DEBUG] [MAIN ] ACN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:05.884842] [INFO ] [MAIN ] ACN: Generated 1820 derivative records from 54204 primary records. [2025-09-29T02:10:05.888493] [DEBUG] [LOCAL ] ACN: Saving derivative data. [2025-09-29T02:10:05.890773] [DEBUG] [LOCAL ] ACR: Derivative data saved (1820 records). [2025-09-29T02:10:05.891970] [INFO ] [MAIN ] ACR: Successfully saved derivative data. [2025-09-29T02:10:05.906056] [INFO ] [MAIN ] Derivative Progress: 19/2211 symbols completed. ACR took 1.2s. Estimated remaining: 17m 14s. Rate: 127.2 symbols/min [2025-09-29T02:10:05.909950] [INFO ] [MAIN ] ACRE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:05.912467] [DEBUG] [LOCAL ] ACN: Derivative data saved (1820 records). [2025-09-29T02:10:05.913251] [INFO ] [MAIN ] ACN: Successfully saved derivative data. [2025-09-29T02:10:05.917689] [INFO ] [MAIN ] Derivative Progress: 20/2211 symbols completed. ACN took 1.3s. Estimated remaining: 16m 23s. Rate: 133.7 symbols/min [2025-09-29T02:10:05.918861] [INFO ] [MAIN ] ACV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:05.936916] [DEBUG] [MAIN ] ACP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:05.937914] [INFO ] [MAIN ] ACP: Generated 1820 derivative records from 31428 primary records. [2025-09-29T02:10:05.938144] [DEBUG] [LOCAL ] ACP: Saving derivative data. [2025-09-29T02:10:05.957450] [DEBUG] [LOCAL ] ACP: Derivative data saved (1820 records). [2025-09-29T02:10:05.957785] [INFO ] [MAIN ] ACP: Successfully saved derivative data. [2025-09-29T02:10:05.961032] [INFO ] [MAIN ] Derivative Progress: 21/2211 symbols completed. ACP took 1.2s. Estimated remaining: 15m 40s. Rate: 139.7 symbols/min [2025-09-29T02:10:05.961405] [INFO ] [MAIN ] ACVA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:05.965846] [DEBUG] [LOCAL ] ACV: Loaded 7095 existing records from primary storage. [2025-09-29T02:10:05.966561] [INFO ] [MAIN ] ACV: Loaded 7095 primary data records. [2025-09-29T02:10:06.114720] [DEBUG] [LOCAL ] ACRE: Loaded 34027 existing records from primary storage. [2025-09-29T02:10:06.131388] [INFO ] [MAIN ] ACRE: Loaded 34027 primary data records. [2025-09-29T02:10:06.502284] [DEBUG] [LOCAL ] ACVA: Loaded 50072 existing records from primary storage. [2025-09-29T02:10:06.536954] [INFO ] [MAIN ] ACVA: Loaded 50072 primary data records. [2025-09-29T02:10:07.110517] [DEBUG] [MAIN ] ACV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:07.114142] [INFO ] [MAIN ] ACV: Generated 1820 derivative records from 7095 primary records. [2025-09-29T02:10:07.127823] [DEBUG] [MAIN ] ACRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:07.129140] [INFO ] [MAIN ] ACRE: Generated 1820 derivative records from 34027 primary records. [2025-09-29T02:10:07.130214] [DEBUG] [LOCAL ] ACRE: Saving derivative data. [2025-09-29T02:10:07.130445] [DEBUG] [LOCAL ] ACV: Saving derivative data. [2025-09-29T02:10:07.168439] [DEBUG] [LOCAL ] ACRE: Derivative data saved (1820 records). [2025-09-29T02:10:07.173578] [INFO ] [MAIN ] ACRE: Successfully saved derivative data. [2025-09-29T02:10:07.176414] [INFO ] [MAIN ] Derivative Progress: 22/2211 symbols completed. ACRE took 1.3s. Estimated remaining: 16m 58s. Rate: 129.0 symbols/min [2025-09-29T02:10:07.173468] [DEBUG] [LOCAL ] ACV: Derivative data saved (1820 records). [2025-09-29T02:10:07.177486] [INFO ] [MAIN ] ADC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:07.177625] [INFO ] [MAIN ] ACV: Successfully saved derivative data. [2025-09-29T02:10:07.181077] [INFO ] [MAIN ] Derivative Progress: 23/2211 symbols completed. ACV took 1.3s. Estimated remaining: 16m 14s. Rate: 134.8 symbols/min [2025-09-29T02:10:07.181764] [INFO ] [MAIN ] ADCT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:07.201740] [DEBUG] [MAIN ] ACVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:07.202837] [INFO ] [MAIN ] ACVA: Generated 1820 derivative records from 50072 primary records. [2025-09-29T02:10:07.202982] [DEBUG] [LOCAL ] ACVA: Saving derivative data. [2025-09-29T02:10:07.233356] [DEBUG] [LOCAL ] ACVA: Derivative data saved (1820 records). [2025-09-29T02:10:07.233565] [INFO ] [MAIN ] ACVA: Successfully saved derivative data. [2025-09-29T02:10:07.236288] [INFO ] [MAIN ] Derivative Progress: 24/2211 symbols completed. ACVA took 1.3s. Estimated remaining: 15m 38s. Rate: 139.9 symbols/min [2025-09-29T02:10:07.236738] [INFO ] [MAIN ] ADM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:07.251500] [DEBUG] [LOCAL ] ADCT: Loaded 34670 existing records from primary storage. [2025-09-29T02:10:07.265113] [INFO ] [MAIN ] ADCT: Loaded 34670 primary data records. [2025-09-29T02:10:07.419546] [DEBUG] [LOCAL ] ADC: Loaded 46934 existing records from primary storage. [2025-09-29T02:10:07.466253] [INFO ] [MAIN ] ADC: Loaded 46934 primary data records. [2025-09-29T02:10:07.791739] [DEBUG] [LOCAL ] ADM: Loaded 54175 existing records from primary storage. [2025-09-29T02:10:07.840723] [INFO ] [MAIN ] ADM: Loaded 54175 primary data records. [2025-09-29T02:10:08.337512] [DEBUG] [MAIN ] ADCT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:08.353437] [INFO ] [MAIN ] ADCT: Generated 1820 derivative records from 34670 primary records. [2025-09-29T02:10:08.354100] [DEBUG] [LOCAL ] ADCT: Saving derivative data. [2025-09-29T02:10:08.373677] [DEBUG] [LOCAL ] ADCT: Derivative data saved (1820 records). [2025-09-29T02:10:08.374524] [INFO ] [MAIN ] ADCT: Successfully saved derivative data. [2025-09-29T02:10:08.378631] [INFO ] [MAIN ] Derivative Progress: 25/2211 symbols completed. ADCT took 1.2s. Estimated remaining: 16m 40s. Rate: 131.2 symbols/min [2025-09-29T02:10:08.379428] [INFO ] [MAIN ] ADNT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:08.399683] [DEBUG] [MAIN ] ADC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:08.400559] [INFO ] [MAIN ] ADC: Generated 1820 derivative records from 46934 primary records. [2025-09-29T02:10:08.401055] [DEBUG] [LOCAL ] ADC: Saving derivative data. [2025-09-29T02:10:08.420117] [DEBUG] [LOCAL ] ADC: Derivative data saved (1820 records). [2025-09-29T02:10:08.420604] [INFO ] [MAIN ] ADC: Successfully saved derivative data. [2025-09-29T02:10:08.423576] [INFO ] [MAIN ] Derivative Progress: 26/2211 symbols completed. ADC took 1.2s. Estimated remaining: 16m 5s. Rate: 135.9 symbols/min [2025-09-29T02:10:08.424078] [INFO ] [MAIN ] ADT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:08.449575] [DEBUG] [MAIN ] ADM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:08.451265] [INFO ] [MAIN ] ADM: Generated 1820 derivative records from 54175 primary records. [2025-09-29T02:10:08.451727] [DEBUG] [LOCAL ] ADM: Saving derivative data. [2025-09-29T02:10:08.470307] [DEBUG] [LOCAL ] ADM: Derivative data saved (1820 records). [2025-09-29T02:10:08.481512] [INFO ] [MAIN ] ADM: Successfully saved derivative data. [2025-09-29T02:10:08.485105] [INFO ] [MAIN ] Derivative Progress: 27/2211 symbols completed. ADM took 1.2s. Estimated remaining: 15m 34s. Rate: 140.4 symbols/min [2025-09-29T02:10:08.485825] [INFO ] [MAIN ] ADX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:08.528981] [DEBUG] [LOCAL ] ADNT: Loaded 48095 existing records from primary storage. [2025-09-29T02:10:08.529495] [INFO ] [MAIN ] ADNT: Loaded 48095 primary data records. [2025-09-29T02:10:08.640709] [DEBUG] [LOCAL ] ADT: Loaded 54253 existing records from primary storage. [2025-09-29T02:10:08.656800] [INFO ] [MAIN ] ADT: Loaded 54253 primary data records. [2025-09-29T02:10:08.705346] [DEBUG] [LOCAL ] ADX: Loaded 28180 existing records from primary storage. [2025-09-29T02:10:08.767963] [INFO ] [MAIN ] ADX: Loaded 28180 primary data records. [2025-09-29T02:10:09.724112] [DEBUG] [MAIN ] ADNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:09.739248] [INFO ] [MAIN ] ADNT: Generated 1820 derivative records from 48095 primary records. [2025-09-29T02:10:09.740445] [DEBUG] [LOCAL ] ADNT: Saving derivative data. [2025-09-29T02:10:09.740943] [DEBUG] [MAIN ] ADT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:09.743099] [INFO ] [MAIN ] ADT: Generated 1820 derivative records from 54253 primary records. [2025-09-29T02:10:09.752581] [DEBUG] [LOCAL ] ADT: Saving derivative data. [2025-09-29T02:10:09.769089] [DEBUG] [LOCAL ] ADNT: Derivative data saved (1820 records). [2025-09-29T02:10:09.774769] [INFO ] [MAIN ] ADNT: Successfully saved derivative data. [2025-09-29T02:10:09.777536] [INFO ] [MAIN ] Derivative Progress: 28/2211 symbols completed. ADNT took 1.4s. Estimated remaining: 16m 41s. Rate: 130.9 symbols/min [2025-09-29T02:10:09.780741] [DEBUG] [LOCAL ] ADT: Derivative data saved (1820 records). [2025-09-29T02:10:09.780891] [INFO ] [MAIN ] ADT: Successfully saved derivative data. [2025-09-29T02:10:09.785495] [INFO ] [MAIN ] Derivative Progress: 29/2211 symbols completed. ADT took 1.4s. Estimated remaining: 16m 6s. Rate: 135.5 symbols/min [2025-09-29T02:10:09.800208] [DEBUG] [MAIN ] ADX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:09.801007] [INFO ] [MAIN ] ADX: Generated 1820 derivative records from 28180 primary records. [2025-09-29T02:10:09.801097] [DEBUG] [LOCAL ] ADX: Saving derivative data. [2025-09-29T02:10:09.818377] [DEBUG] [LOCAL ] ADX: Derivative data saved (1820 records). [2025-09-29T02:10:09.818483] [INFO ] [MAIN ] ADX: Successfully saved derivative data. [2025-09-29T02:10:09.821371] [INFO ] [MAIN ] Derivative Progress: 30/2211 symbols completed. ADX took 1.3s. Estimated remaining: 15m 36s. Rate: 139.8 symbols/min [2025-09-29T02:10:09.821982] [INFO ] [MAIN ] AEE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:09.822407] [INFO ] [MAIN ] AEG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:09.822706] [INFO ] [MAIN ] AEFC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:09.841715] [DEBUG] [LOCAL ] AEFC: Loaded 8643 existing records from primary storage. [2025-09-29T02:10:09.842098] [INFO ] [MAIN ] AEFC: Loaded 8643 primary data records. [2025-09-29T02:10:10.233801] [DEBUG] [LOCAL ] AEE: Loaded 50875 existing records from primary storage. [2025-09-29T02:10:10.235440] [DEBUG] [LOCAL ] AEG: Loaded 50307 existing records from primary storage. [2025-09-29T02:10:10.234123] [INFO ] [MAIN ] AEE: Loaded 50875 primary data records. [2025-09-29T02:10:10.235944] [INFO ] [MAIN ] AEG: Loaded 50307 primary data records. [2025-09-29T02:10:10.913088] [DEBUG] [MAIN ] AEFC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:10.915361] [INFO ] [MAIN ] AEFC: Generated 1820 derivative records from 8643 primary records. [2025-09-29T02:10:10.915637] [DEBUG] [LOCAL ] AEFC: Saving derivative data. [2025-09-29T02:10:10.935979] [DEBUG] [LOCAL ] AEFC: Derivative data saved (1820 records). [2025-09-29T02:10:10.936596] [INFO ] [MAIN ] AEFC: Successfully saved derivative data. [2025-09-29T02:10:10.939003] [INFO ] [MAIN ] Derivative Progress: 31/2211 symbols completed. AEFC took 1.1s. Estimated remaining: 16m 24s. Rate: 132.9 symbols/min [2025-09-29T02:10:10.939741] [INFO ] [MAIN ] AEM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:10.963670] [DEBUG] [MAIN ] AEE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:10.977459] [INFO ] [MAIN ] AEE: Generated 1820 derivative records from 50875 primary records. [2025-09-29T02:10:10.978156] [DEBUG] [MAIN ] AEG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:10.978308] [DEBUG] [LOCAL ] AEE: Saving derivative data. [2025-09-29T02:10:10.979985] [INFO ] [MAIN ] AEG: Generated 1820 derivative records from 50307 primary records. [2025-09-29T02:10:10.980386] [DEBUG] [LOCAL ] AEG: Saving derivative data. [2025-09-29T02:10:11.012184] [DEBUG] [LOCAL ] AEE: Derivative data saved (1820 records). [2025-09-29T02:10:11.014010] [INFO ] [MAIN ] AEE: Successfully saved derivative data. [2025-09-29T02:10:11.015212] [DEBUG] [LOCAL ] AEG: Derivative data saved (1820 records). [2025-09-29T02:10:11.015418] [INFO ] [MAIN ] AEG: Successfully saved derivative data. [2025-09-29T02:10:11.018558] [INFO ] [MAIN ] Derivative Progress: 32/2211 symbols completed. AEE took 1.2s. Estimated remaining: 15m 58s. Rate: 136.4 symbols/min [2025-09-29T02:10:11.022026] [INFO ] [MAIN ] AEO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:11.022097] [INFO ] [MAIN ] Derivative Progress: 33/2211 symbols completed. AEG took 1.2s. Estimated remaining: 15m 29s. Rate: 140.6 symbols/min [2025-09-29T02:10:11.022792] [INFO ] [MAIN ] AER: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:11.076735] [DEBUG] [LOCAL ] AEM: Loaded 54243 existing records from primary storage. [2025-09-29T02:10:11.077251] [INFO ] [MAIN ] AEM: Loaded 54243 primary data records. [2025-09-29T02:10:11.333188] [DEBUG] [LOCAL ] AER: Loaded 49271 existing records from primary storage. [2025-09-29T02:10:11.314975] [DEBUG] [LOCAL ] AEO: Loaded 54336 existing records from primary storage. [2025-09-29T02:10:11.337546] [INFO ] [MAIN ] AEO: Loaded 54336 primary data records. [2025-09-29T02:10:11.337603] [INFO ] [MAIN ] AER: Loaded 49271 primary data records. [2025-09-29T02:10:12.227418] [DEBUG] [MAIN ] AEM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:12.229602] [INFO ] [MAIN ] AEM: Generated 1820 derivative records from 54243 primary records. [2025-09-29T02:10:12.229738] [DEBUG] [LOCAL ] AEM: Saving derivative data. [2025-09-29T02:10:12.252180] [DEBUG] [LOCAL ] AEM: Derivative data saved (1820 records). [2025-09-29T02:10:12.253716] [INFO ] [MAIN ] AEM: Successfully saved derivative data. [2025-09-29T02:10:12.256105] [INFO ] [MAIN ] Derivative Progress: 34/2211 symbols completed. AEM took 1.3s. Estimated remaining: 16m 20s. Rate: 133.2 symbols/min [2025-09-29T02:10:12.256454] [INFO ] [MAIN ] AES: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:12.278060] [DEBUG] [MAIN ] AEO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:12.279316] [INFO ] [MAIN ] AEO: Generated 1820 derivative records from 54336 primary records. [2025-09-29T02:10:12.286970] [DEBUG] [LOCAL ] AEO: Saving derivative data. [2025-09-29T02:10:12.292750] [DEBUG] [MAIN ] AER: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:12.294019] [INFO ] [MAIN ] AER: Generated 1820 derivative records from 49271 primary records. [2025-09-29T02:10:12.294315] [DEBUG] [LOCAL ] AER: Saving derivative data. [2025-09-29T02:10:12.325176] [DEBUG] [LOCAL ] AEO: Derivative data saved (1820 records). [2025-09-29T02:10:12.326552] [DEBUG] [LOCAL ] AER: Derivative data saved (1820 records). [2025-09-29T02:10:12.326740] [INFO ] [MAIN ] AER: Successfully saved derivative data. [2025-09-29T02:10:12.329841] [INFO ] [MAIN ] Derivative Progress: 35/2211 symbols completed. AER took 1.3s. Estimated remaining: 15m 57s. Rate: 136.5 symbols/min [2025-09-29T02:10:12.326838] [INFO ] [MAIN ] AEO: Successfully saved derivative data. [2025-09-29T02:10:12.330213] [INFO ] [MAIN ] AESI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:12.333592] [INFO ] [MAIN ] Derivative Progress: 36/2211 symbols completed. AEO took 1.3s. Estimated remaining: 15m 30s. Rate: 140.3 symbols/min [2025-09-29T02:10:12.334180] [INFO ] [MAIN ] AFB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:12.370434] [DEBUG] [LOCAL ] AFB: Loaded 11422 existing records from primary storage. [2025-09-29T02:10:12.370898] [INFO ] [MAIN ] AFB: Loaded 11422 primary data records. [2025-09-29T02:10:12.412837] [DEBUG] [LOCAL ] AES: Loaded 54450 existing records from primary storage. [2025-09-29T02:10:12.438342] [INFO ] [MAIN ] AES: Loaded 54450 primary data records. [2025-09-29T02:10:12.646672] [DEBUG] [LOCAL ] AESI: Loaded 50213 existing records from primary storage. [2025-09-29T02:10:12.743719] [INFO ] [MAIN ] AESI: Loaded 50213 primary data records. [2025-09-29T02:10:13.467756] [DEBUG] [MAIN ] AFB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:13.469337] [INFO ] [MAIN ] AFB: Generated 1820 derivative records from 11422 primary records. [2025-09-29T02:10:13.469800] [DEBUG] [LOCAL ] AFB: Saving derivative data. [2025-09-29T02:10:13.485171] [DEBUG] [MAIN ] AES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:13.488609] [INFO ] [MAIN ] AES: Generated 1820 derivative records from 54450 primary records. [2025-09-29T02:10:13.501554] [DEBUG] [LOCAL ] AES: Saving derivative data. [2025-09-29T02:10:13.508466] [DEBUG] [LOCAL ] AFB: Derivative data saved (1820 records). [2025-09-29T02:10:13.521333] [INFO ] [MAIN ] AFB: Successfully saved derivative data. [2025-09-29T02:10:13.526513] [INFO ] [MAIN ] Derivative Progress: 37/2211 symbols completed. AFB took 1.2s. Estimated remaining: 16m 14s. Rate: 133.9 symbols/min [2025-09-29T02:10:13.527789] [INFO ] [MAIN ] AFG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:13.532595] [DEBUG] [LOCAL ] AES: Derivative data saved (1820 records). [2025-09-29T02:10:13.534908] [INFO ] [MAIN ] AES: Successfully saved derivative data. [2025-09-29T02:10:13.538165] [INFO ] [MAIN ] Derivative Progress: 38/2211 symbols completed. AES took 1.3s. Estimated remaining: 15m 49s. Rate: 137.4 symbols/min [2025-09-29T02:10:13.539392] [INFO ] [MAIN ] AFGB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:13.555504] [DEBUG] [MAIN ] AESI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:13.556736] [INFO ] [MAIN ] AESI: Generated 1820 derivative records from 50213 primary records. [2025-09-29T02:10:13.557178] [DEBUG] [LOCAL ] AESI: Saving derivative data. [2025-09-29T02:10:13.578800] [DEBUG] [LOCAL ] AFGB: Loaded 2404 existing records from primary storage. [2025-09-29T02:10:13.581479] [DEBUG] [LOCAL ] AESI: Derivative data saved (1820 records). [2025-09-29T02:10:13.581814] [INFO ] [MAIN ] AFGB: Loaded 2404 primary data records. [2025-09-29T02:10:13.581946] [INFO ] [MAIN ] AESI: Successfully saved derivative data. [2025-09-29T02:10:13.600355] [INFO ] [MAIN ] Derivative Progress: 39/2211 symbols completed. AESI took 1.3s. Estimated remaining: 15m 28s. Rate: 140.5 symbols/min [2025-09-29T02:10:13.632205] [INFO ] [MAIN ] AFGC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:13.744259] [DEBUG] [LOCAL ] AFGC: Loaded 2602 existing records from primary storage. [2025-09-29T02:10:13.749548] [INFO ] [MAIN ] AFGC: Loaded 2602 primary data records. [2025-09-29T02:10:13.731056] [DEBUG] [LOCAL ] AFG: Loaded 33021 existing records from primary storage. [2025-09-29T02:10:13.760090] [INFO ] [MAIN ] AFG: Loaded 33021 primary data records. [2025-09-29T02:10:14.707579] [DEBUG] [MAIN ] AFGB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:14.708943] [INFO ] [MAIN ] AFGB: Generated 1820 derivative records from 2404 primary records. [2025-09-29T02:10:14.709250] [DEBUG] [LOCAL ] AFGB: Saving derivative data. [2025-09-29T02:10:14.731995] [DEBUG] [LOCAL ] AFGB: Derivative data saved (1820 records). [2025-09-29T02:10:14.745733] [INFO ] [MAIN ] AFGB: Successfully saved derivative data. [2025-09-29T02:10:14.748367] [INFO ] [MAIN ] Derivative Progress: 40/2211 symbols completed. AFGB took 1.2s. Estimated remaining: 16m 6s. Rate: 134.8 symbols/min [2025-09-29T02:10:14.746123] [DEBUG] [MAIN ] AFGC: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:10:14.748584] [INFO ] [MAIN ] AFGD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:14.751348] [INFO ] [MAIN ] AFGC: Generated 1819 derivative records from 2602 primary records. [2025-09-29T02:10:14.751539] [DEBUG] [LOCAL ] AFGC: Saving derivative data. [2025-09-29T02:10:14.757639] [DEBUG] [LOCAL ] AFGD: Loaded 1859 existing records from primary storage. [2025-09-29T02:10:14.778044] [INFO ] [MAIN ] AFGD: Loaded 1859 primary data records. [2025-09-29T02:10:14.797355] [DEBUG] [MAIN ] AFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:14.835504] [INFO ] [MAIN ] AFG: Generated 1820 derivative records from 33021 primary records. [2025-09-29T02:10:14.797453] [DEBUG] [LOCAL ] AFGC: Derivative data saved (1819 records). [2025-09-29T02:10:14.841151] [INFO ] [MAIN ] AFGC: Successfully saved derivative data. [2025-09-29T02:10:14.841300] [DEBUG] [LOCAL ] AFG: Saving derivative data. [2025-09-29T02:10:14.869490] [INFO ] [MAIN ] Derivative Progress: 41/2211 symbols completed. AFGC took 1.2s. Estimated remaining: 15m 49s. Rate: 137.2 symbols/min [2025-09-29T02:10:14.905467] [INFO ] [MAIN ] AFGE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:14.980516] [DEBUG] [LOCAL ] AFG: Derivative data saved (1820 records). [2025-09-29T02:10:15.017634] [DEBUG] [LOCAL ] AFGE: Loaded 2512 existing records from primary storage. [2025-09-29T02:10:15.135183] [INFO ] [MAIN ] AFGE: Loaded 2512 primary data records. [2025-09-29T02:10:15.144232] [INFO ] [MAIN ] AFG: Successfully saved derivative data. [2025-09-29T02:10:15.148145] [INFO ] [MAIN ] Derivative Progress: 42/2211 symbols completed. AFG took 1.6s. Estimated remaining: 15m 40s. Rate: 138.4 symbols/min [2025-09-29T02:10:15.148559] [INFO ] [MAIN ] AFL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:15.532046] [DEBUG] [MAIN ] AFGD: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-09-29T02:10:15.533175] [INFO ] [MAIN ] AFGD: Generated 1818 derivative records from 1859 primary records. [2025-09-29T02:10:15.534556] [DEBUG] [LOCAL ] AFGD: Saving derivative data. [2025-09-29T02:10:15.569002] [DEBUG] [LOCAL ] AFGD: Derivative data saved (1818 records). [2025-09-29T02:10:15.570587] [DEBUG] [LOCAL ] AFL: Loaded 53915 existing records from primary storage. [2025-09-29T02:10:15.570860] [INFO ] [MAIN ] AFL: Loaded 53915 primary data records. [2025-09-29T02:10:15.570959] [INFO ] [MAIN ] AFGD: Successfully saved derivative data. [2025-09-29T02:10:15.612493] [INFO ] [MAIN ] Derivative Progress: 43/2211 symbols completed. AFGD took 0.9s. Estimated remaining: 15m 41s. Rate: 138.2 symbols/min [2025-09-29T02:10:15.715169] [DEBUG] [MAIN ] AFGE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:15.747087] [INFO ] [MAIN ] AFGE: Generated 1820 derivative records from 2512 primary records. [2025-09-29T02:10:15.764695] [DEBUG] [LOCAL ] AFGE: Saving derivative data. [2025-09-29T02:10:15.990393] [DEBUG] [LOCAL ] AFGE: Derivative data saved (1820 records). [2025-09-29T02:10:15.991443] [INFO ] [MAIN ] AFGE: Successfully saved derivative data. [2025-09-29T02:10:15.993826] [INFO ] [MAIN ] Derivative Progress: 44/2211 symbols completed. AFGE took 1.1s. Estimated remaining: 15m 38s. Rate: 138.6 symbols/min [2025-09-29T02:10:16.016102] [DEBUG] [MAIN ] AFL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:16.017036] [INFO ] [MAIN ] AFL: Generated 1820 derivative records from 53915 primary records. [2025-09-29T02:10:16.017128] [DEBUG] [LOCAL ] AFL: Saving derivative data. [2025-09-29T02:10:16.034010] [DEBUG] [LOCAL ] AFL: Derivative data saved (1820 records). [2025-09-29T02:10:16.034174] [INFO ] [MAIN ] AFL: Successfully saved derivative data. [2025-09-29T02:10:16.037411] [INFO ] [MAIN ] Derivative Progress: 45/2211 symbols completed. AFL took 0.9s. Estimated remaining: 15m 19s. Rate: 141.4 symbols/min [2025-09-29T02:10:16.038129] [INFO ] [MAIN ] AG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:16.038339] [INFO ] [MAIN ] AGCO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:16.038815] [INFO ] [MAIN ] AGD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:16.069119] [DEBUG] [LOCAL ] AGD: Loaded 17937 existing records from primary storage. [2025-09-29T02:10:16.069403] [INFO ] [MAIN ] AGD: Loaded 17937 primary data records. [2025-09-29T02:10:16.254468] [DEBUG] [LOCAL ] AGCO: Loaded 43086 existing records from primary storage. [2025-09-29T02:10:16.294381] [INFO ] [MAIN ] AGCO: Loaded 43086 primary data records. [2025-09-29T02:10:16.321936] [DEBUG] [LOCAL ] AG: Loaded 54423 existing records from primary storage. [2025-09-29T02:10:16.560525] [INFO ] [MAIN ] AG: Loaded 54423 primary data records. [2025-09-29T02:10:17.445130] [DEBUG] [MAIN ] AGD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:17.448680] [INFO ] [MAIN ] AGD: Generated 1820 derivative records from 17937 primary records. [2025-09-29T02:10:17.450123] [DEBUG] [LOCAL ] AGD: Saving derivative data. [2025-09-29T02:10:17.482776] [DEBUG] [LOCAL ] AGD: Derivative data saved (1820 records). [2025-09-29T02:10:17.483244] [INFO ] [MAIN ] AGD: Successfully saved derivative data. [2025-09-29T02:10:17.486626] [INFO ] [MAIN ] Derivative Progress: 46/2211 symbols completed. AGD took 1.4s. Estimated remaining: 16m 7s. Rate: 134.3 symbols/min [2025-09-29T02:10:17.486988] [INFO ] [MAIN ] AGI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:17.505862] [DEBUG] [MAIN ] AGCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:17.508174] [INFO ] [MAIN ] AGCO: Generated 1820 derivative records from 43086 primary records. [2025-09-29T02:10:17.508862] [DEBUG] [LOCAL ] AGCO: Saving derivative data. [2025-09-29T02:10:17.533812] [DEBUG] [LOCAL ] AGCO: Derivative data saved (1820 records). [2025-09-29T02:10:17.535372] [INFO ] [MAIN ] AGCO: Successfully saved derivative data. [2025-09-29T02:10:17.538523] [INFO ] [MAIN ] Derivative Progress: 47/2211 symbols completed. AGCO took 1.5s. Estimated remaining: 15m 48s. Rate: 136.9 symbols/min [2025-09-29T02:10:17.539079] [INFO ] [MAIN ] AGL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:17.555999] [DEBUG] [MAIN ] AG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:17.557064] [INFO ] [MAIN ] AG: Generated 1820 derivative records from 54423 primary records. [2025-09-29T02:10:17.557155] [DEBUG] [LOCAL ] AG: Saving derivative data. [2025-09-29T02:10:17.578549] [DEBUG] [LOCAL ] AG: Derivative data saved (1820 records). [2025-09-29T02:10:17.578853] [INFO ] [MAIN ] AG: Successfully saved derivative data. [2025-09-29T02:10:17.582634] [INFO ] [MAIN ] Derivative Progress: 48/2211 symbols completed. AG took 1.5s. Estimated remaining: 15m 30s. Rate: 139.5 symbols/min [2025-09-29T02:10:17.583244] [INFO ] [MAIN ] AGM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:17.647573] [DEBUG] [LOCAL ] AGI: Loaded 54195 existing records from primary storage. [2025-09-29T02:10:17.648016] [INFO ] [MAIN ] AGI: Loaded 54195 primary data records. [2025-09-29T02:10:17.666808] [DEBUG] [LOCAL ] AGM: Loaded 10125 existing records from primary storage. [2025-09-29T02:10:17.717457] [INFO ] [MAIN ] AGM: Loaded 10125 primary data records. [2025-09-29T02:10:17.764933] [DEBUG] [LOCAL ] AGL: Loaded 53191 existing records from primary storage. [2025-09-29T02:10:17.873142] [INFO ] [MAIN ] AGL: Loaded 53191 primary data records. [2025-09-29T02:10:18.780616] [DEBUG] [MAIN ] AGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:18.786104] [INFO ] [MAIN ] AGI: Generated 1820 derivative records from 54195 primary records. [2025-09-29T02:10:18.800184] [DEBUG] [LOCAL ] AGI: Saving derivative data. [2025-09-29T02:10:18.802502] [DEBUG] [MAIN ] AGM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:18.821403] [DEBUG] [LOCAL ] AGI: Derivative data saved (1820 records). [2025-09-29T02:10:18.819513] [INFO ] [MAIN ] AGM: Generated 1820 derivative records from 10125 primary records. [2025-09-29T02:10:18.822950] [INFO ] [MAIN ] AGI: Successfully saved derivative data. [2025-09-29T02:10:18.825598] [INFO ] [MAIN ] Derivative Progress: 49/2211 symbols completed. AGI took 1.3s. Estimated remaining: 16m 6s. Rate: 134.4 symbols/min [2025-09-29T02:10:18.827381] [INFO ] [MAIN ] AGO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:18.825693] [DEBUG] [LOCAL ] AGM: Saving derivative data. [2025-09-29T02:10:18.853261] [DEBUG] [MAIN ] AGL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:18.862395] [DEBUG] [LOCAL ] AGM: Derivative data saved (1820 records). [2025-09-29T02:10:18.858840] [INFO ] [MAIN ] AGL: Generated 1820 derivative records from 53191 primary records. [2025-09-29T02:10:18.862684] [INFO ] [MAIN ] AGM: Successfully saved derivative data. [2025-09-29T02:10:18.862765] [DEBUG] [LOCAL ] AGL: Saving derivative data. [2025-09-29T02:10:18.865236] [INFO ] [MAIN ] Derivative Progress: 50/2211 symbols completed. AGM took 1.3s. Estimated remaining: 15m 47s. Rate: 136.8 symbols/min [2025-09-29T02:10:18.865767] [INFO ] [MAIN ] AGRO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:18.894454] [DEBUG] [LOCAL ] AGL: Derivative data saved (1820 records). [2025-09-29T02:10:18.905148] [INFO ] [MAIN ] AGL: Successfully saved derivative data. [2025-09-29T02:10:18.909127] [INFO ] [MAIN ] Derivative Progress: 51/2211 symbols completed. AGL took 1.4s. Estimated remaining: 15m 30s. Rate: 139.3 symbols/min [2025-09-29T02:10:18.910707] [DEBUG] [LOCAL ] AGO: Loaded 28356 existing records from primary storage. [2025-09-29T02:10:18.910873] [INFO ] [MAIN ] AGX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:18.911425] [INFO ] [MAIN ] AGO: Loaded 28356 primary data records. [2025-09-29T02:10:19.065213] [DEBUG] [LOCAL ] AGRO: Loaded 34097 existing records from primary storage. [2025-09-29T02:10:19.070827] [INFO ] [MAIN ] AGRO: Loaded 34097 primary data records. [2025-09-29T02:10:19.396551] [DEBUG] [LOCAL ] AGX: Loaded 33823 existing records from primary storage. [2025-09-29T02:10:19.427699] [INFO ] [MAIN ] AGX: Loaded 33823 primary data records. [2025-09-29T02:10:20.001588] [DEBUG] [MAIN ] AGO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:20.003617] [INFO ] [MAIN ] AGO: Generated 1820 derivative records from 28356 primary records. [2025-09-29T02:10:20.003981] [DEBUG] [LOCAL ] AGO: Saving derivative data. [2025-09-29T02:10:20.026403] [DEBUG] [LOCAL ] AGO: Derivative data saved (1820 records). [2025-09-29T02:10:20.027810] [INFO ] [MAIN ] AGO: Successfully saved derivative data. [2025-09-29T02:10:20.030220] [INFO ] [MAIN ] Derivative Progress: 52/2211 symbols completed. AGO took 1.2s. Estimated remaining: 15m 59s. Rate: 135.1 symbols/min [2025-09-29T02:10:20.031015] [INFO ] [MAIN ] AHH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:20.046031] [DEBUG] [MAIN ] AGRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:20.047074] [INFO ] [MAIN ] AGRO: Generated 1820 derivative records from 34097 primary records. [2025-09-29T02:10:20.047304] [DEBUG] [LOCAL ] AGRO: Saving derivative data. [2025-09-29T02:10:20.065094] [DEBUG] [LOCAL ] AGRO: Derivative data saved (1820 records). [2025-09-29T02:10:20.065580] [INFO ] [MAIN ] AGRO: Successfully saved derivative data. [2025-09-29T02:10:20.067991] [INFO ] [MAIN ] Derivative Progress: 53/2211 symbols completed. AGRO took 1.2s. Estimated remaining: 15m 42s. Rate: 137.5 symbols/min [2025-09-29T02:10:20.068492] [INFO ] [MAIN ] AHR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:20.086011] [DEBUG] [MAIN ] AGX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:20.087742] [INFO ] [MAIN ] AGX: Generated 1820 derivative records from 33823 primary records. [2025-09-29T02:10:20.087973] [DEBUG] [LOCAL ] AGX: Saving derivative data. [2025-09-29T02:10:20.115920] [DEBUG] [LOCAL ] AGX: Derivative data saved (1820 records). [2025-09-29T02:10:20.116278] [INFO ] [MAIN ] AGX: Successfully saved derivative data. [2025-09-29T02:10:20.120354] [INFO ] [MAIN ] Derivative Progress: 54/2211 symbols completed. AGX took 1.2s. Estimated remaining: 15m 26s. Rate: 139.8 symbols/min [2025-09-29T02:10:20.120823] [INFO ] [MAIN ] AHT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:20.144174] [DEBUG] [LOCAL ] AHH: Loaded 41885 existing records from primary storage. [2025-09-29T02:10:20.154963] [INFO ] [MAIN ] AHH: Loaded 41885 primary data records. [2025-09-29T02:10:20.159332] [DEBUG] [LOCAL ] AHT: Loaded 6181 existing records from primary storage. [2025-09-29T02:10:20.172477] [INFO ] [MAIN ] AHT: Loaded 6181 primary data records. [2025-09-29T02:10:20.336160] [DEBUG] [LOCAL ] AHR: Loaded 49946 existing records from primary storage. [2025-09-29T02:10:20.342232] [INFO ] [MAIN ] AHR: Loaded 49946 primary data records. [2025-09-29T02:10:21.301495] [DEBUG] [MAIN ] AHH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:21.303166] [INFO ] [MAIN ] AHH: Generated 1820 derivative records from 41885 primary records. [2025-09-29T02:10:21.303567] [DEBUG] [LOCAL ] AHH: Saving derivative data. [2025-09-29T02:10:21.324832] [DEBUG] [LOCAL ] AHH: Derivative data saved (1820 records). [2025-09-29T02:10:21.333536] [INFO ] [MAIN ] AHH: Successfully saved derivative data. [2025-09-29T02:10:21.341184] [INFO ] [MAIN ] Derivative Progress: 55/2211 symbols completed. AHH took 1.3s. Estimated remaining: 15m 56s. Rate: 135.3 symbols/min [2025-09-29T02:10:21.343353] [INFO ] [MAIN ] AI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:21.343916] [DEBUG] [MAIN ] AHT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:21.346500] [INFO ] [MAIN ] AHT: Generated 1820 derivative records from 6181 primary records. [2025-09-29T02:10:21.347679] [DEBUG] [LOCAL ] AHT: Saving derivative data. [2025-09-29T02:10:21.375221] [DEBUG] [MAIN ] AHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:21.377565] [INFO ] [MAIN ] AHR: Generated 1820 derivative records from 49946 primary records. [2025-09-29T02:10:21.378317] [DEBUG] [LOCAL ] AHR: Saving derivative data. [2025-09-29T02:10:21.395052] [DEBUG] [LOCAL ] AHT: Derivative data saved (1820 records). [2025-09-29T02:10:21.396854] [INFO ] [MAIN ] AHT: Successfully saved derivative data. [2025-09-29T02:10:21.399265] [INFO ] [MAIN ] Derivative Progress: 56/2211 symbols completed. AHT took 1.3s. Estimated remaining: 15m 41s. Rate: 137.4 symbols/min [2025-09-29T02:10:21.400059] [INFO ] [MAIN ] AIG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:21.403765] [DEBUG] [LOCAL ] AHR: Derivative data saved (1820 records). [2025-09-29T02:10:21.404154] [INFO ] [MAIN ] AHR: Successfully saved derivative data. [2025-09-29T02:10:21.407119] [INFO ] [MAIN ] Derivative Progress: 57/2211 symbols completed. AHR took 1.3s. Estimated remaining: 15m 24s. Rate: 139.8 symbols/min [2025-09-29T02:10:21.407404] [INFO ] [MAIN ] AIN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:21.456148] [DEBUG] [LOCAL ] AI: Loaded 54529 existing records from primary storage. [2025-09-29T02:10:21.464574] [INFO ] [MAIN ] AI: Loaded 54529 primary data records. [2025-09-29T02:10:21.465184] [DEBUG] [LOCAL ] AIN: Loaded 24906 existing records from primary storage. [2025-09-29T02:10:21.470927] [INFO ] [MAIN ] AIN: Loaded 24906 primary data records. [2025-09-29T02:10:21.762970] [DEBUG] [LOCAL ] AIG: Loaded 54254 existing records from primary storage. [2025-09-29T02:10:21.827676] [INFO ] [MAIN ] AIG: Loaded 54254 primary data records. [2025-09-29T02:10:22.550451] [DEBUG] [MAIN ] AI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:22.552222] [INFO ] [MAIN ] AI: Generated 1820 derivative records from 54529 primary records. [2025-09-29T02:10:22.552929] [DEBUG] [LOCAL ] AI: Saving derivative data. [2025-09-29T02:10:22.583305] [DEBUG] [MAIN ] AIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:22.586662] [INFO ] [MAIN ] AIN: Generated 1820 derivative records from 24906 primary records. [2025-09-29T02:10:22.589634] [DEBUG] [LOCAL ] AIN: Saving derivative data. [2025-09-29T02:10:22.594248] [DEBUG] [LOCAL ] AI: Derivative data saved (1820 records). [2025-09-29T02:10:22.607627] [INFO ] [MAIN ] AI: Successfully saved derivative data. [2025-09-29T02:10:22.612134] [DEBUG] [LOCAL ] AIN: Derivative data saved (1820 records). [2025-09-29T02:10:22.616691] [INFO ] [MAIN ] Derivative Progress: 58/2211 symbols completed. AI took 1.3s. Estimated remaining: 15m 53s. Rate: 135.5 symbols/min [2025-09-29T02:10:22.612340] [INFO ] [MAIN ] AIN: Successfully saved derivative data. [2025-09-29T02:10:22.621425] [INFO ] [MAIN ] Derivative Progress: 59/2211 symbols completed. AIN took 1.2s. Estimated remaining: 15m 37s. Rate: 137.9 symbols/min [2025-09-29T02:10:22.635483] [DEBUG] [MAIN ] AIG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:22.636267] [INFO ] [MAIN ] AIG: Generated 1820 derivative records from 54254 primary records. [2025-09-29T02:10:22.636357] [DEBUG] [LOCAL ] AIG: Saving derivative data. [2025-09-29T02:10:22.652460] [DEBUG] [LOCAL ] AIG: Derivative data saved (1820 records). [2025-09-29T02:10:22.652587] [INFO ] [MAIN ] AIG: Successfully saved derivative data. [2025-09-29T02:10:22.656468] [INFO ] [MAIN ] Derivative Progress: 60/2211 symbols completed. AIG took 1.3s. Estimated remaining: 15m 22s. Rate: 140.0 symbols/min [2025-09-29T02:10:22.657238] [INFO ] [MAIN ] AIT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:22.657399] [INFO ] [MAIN ] AIR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:22.657158] [INFO ] [MAIN ] AIO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:22.677710] [DEBUG] [LOCAL ] AIO: Loaded 13477 existing records from primary storage. [2025-09-29T02:10:22.678021] [INFO ] [MAIN ] AIO: Loaded 13477 primary data records. [2025-09-29T02:10:22.844793] [DEBUG] [LOCAL ] AIR: Loaded 28152 existing records from primary storage. [2025-09-29T02:10:22.846245] [DEBUG] [LOCAL ] AIT: Loaded 28208 existing records from primary storage. [2025-09-29T02:10:22.851466] [INFO ] [MAIN ] AIR: Loaded 28152 primary data records. [2025-09-29T02:10:22.852400] [INFO ] [MAIN ] AIT: Loaded 28208 primary data records. [2025-09-29T02:10:23.820860] [DEBUG] [MAIN ] AIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:23.822319] [INFO ] [MAIN ] AIO: Generated 1820 derivative records from 13477 primary records. [2025-09-29T02:10:23.822451] [DEBUG] [LOCAL ] AIO: Saving derivative data. [2025-09-29T02:10:23.843918] [DEBUG] [LOCAL ] AIO: Derivative data saved (1820 records). [2025-09-29T02:10:23.844233] [INFO ] [MAIN ] AIO: Successfully saved derivative data. [2025-09-29T02:10:23.846599] [INFO ] [MAIN ] Derivative Progress: 61/2211 symbols completed. AIO took 1.2s. Estimated remaining: 15m 48s. Rate: 136.0 symbols/min [2025-09-29T02:10:23.847348] [INFO ] [MAIN ] AIV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:23.860410] [DEBUG] [MAIN ] AIR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:23.861272] [INFO ] [MAIN ] AIR: Generated 1820 derivative records from 28152 primary records. [2025-09-29T02:10:23.861713] [DEBUG] [LOCAL ] AIR: Saving derivative data. [2025-09-29T02:10:23.882586] [DEBUG] [LOCAL ] AIR: Derivative data saved (1820 records). [2025-09-29T02:10:23.882985] [INFO ] [MAIN ] AIR: Successfully saved derivative data. [2025-09-29T02:10:23.893522] [INFO ] [MAIN ] Derivative Progress: 62/2211 symbols completed. AIR took 1.2s. Estimated remaining: 15m 34s. Rate: 138.0 symbols/min [2025-09-29T02:10:23.899036] [DEBUG] [MAIN ] AIT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:23.900076] [INFO ] [MAIN ] AIT: Generated 1820 derivative records from 28208 primary records. [2025-09-29T02:10:23.899195] [INFO ] [MAIN ] AIZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:23.900291] [DEBUG] [LOCAL ] AIT: Saving derivative data. [2025-09-29T02:10:23.930687] [DEBUG] [LOCAL ] AIT: Derivative data saved (1820 records). [2025-09-29T02:10:23.930840] [INFO ] [MAIN ] AIT: Successfully saved derivative data. [2025-09-29T02:10:23.933709] [INFO ] [MAIN ] Derivative Progress: 63/2211 symbols completed. AIT took 1.3s. Estimated remaining: 15m 20s. Rate: 140.0 symbols/min [2025-09-29T02:10:23.934257] [INFO ] [MAIN ] AIZN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:23.960122] [DEBUG] [LOCAL ] AIV: Loaded 40950 existing records from primary storage. [2025-09-29T02:10:23.963966] [DEBUG] [LOCAL ] AIZN: Loaded 3935 existing records from primary storage. [2025-09-29T02:10:23.964223] [INFO ] [MAIN ] AIV: Loaded 40950 primary data records. [2025-09-29T02:10:23.964490] [INFO ] [MAIN ] AIZN: Loaded 3935 primary data records. [2025-09-29T02:10:24.138725] [DEBUG] [LOCAL ] AIZ: Loaded 30543 existing records from primary storage. [2025-09-29T02:10:24.194466] [INFO ] [MAIN ] AIZ: Loaded 30543 primary data records. [2025-09-29T02:10:25.087789] [DEBUG] [MAIN ] AIZN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:25.094689] [INFO ] [MAIN ] AIZN: Generated 1820 derivative records from 3935 primary records. [2025-09-29T02:10:25.094850] [DEBUG] [LOCAL ] AIZN: Saving derivative data. [2025-09-29T02:10:25.095388] [DEBUG] [MAIN ] AIV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:25.097538] [INFO ] [MAIN ] AIV: Generated 1820 derivative records from 40950 primary records. [2025-09-29T02:10:25.098433] [DEBUG] [LOCAL ] AIV: Saving derivative data. [2025-09-29T02:10:25.123752] [DEBUG] [LOCAL ] AIZN: Derivative data saved (1820 records). [2025-09-29T02:10:25.131464] [INFO ] [MAIN ] AIZN: Successfully saved derivative data. [2025-09-29T02:10:25.131538] [DEBUG] [LOCAL ] AIV: Derivative data saved (1820 records). [2025-09-29T02:10:25.134358] [INFO ] [MAIN ] Derivative Progress: 64/2211 symbols completed. AIZN took 1.2s. Estimated remaining: 15m 46s. Rate: 136.2 symbols/min [2025-09-29T02:10:25.134715] [INFO ] [MAIN ] AIV: Successfully saved derivative data. [2025-09-29T02:10:25.135191] [INFO ] [MAIN ] AJG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:25.138696] [INFO ] [MAIN ] Derivative Progress: 65/2211 symbols completed. AIV took 1.3s. Estimated remaining: 15m 31s. Rate: 138.3 symbols/min [2025-09-29T02:10:25.139249] [INFO ] [MAIN ] AKR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:25.157377] [DEBUG] [MAIN ] AIZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:25.158348] [INFO ] [MAIN ] AIZ: Generated 1820 derivative records from 30543 primary records. [2025-09-29T02:10:25.158676] [DEBUG] [LOCAL ] AIZ: Saving derivative data. [2025-09-29T02:10:25.183054] [DEBUG] [LOCAL ] AIZ: Derivative data saved (1820 records). [2025-09-29T02:10:25.183301] [INFO ] [MAIN ] AIZ: Successfully saved derivative data. [2025-09-29T02:10:25.186552] [INFO ] [MAIN ] Derivative Progress: 66/2211 symbols completed. AIZ took 1.3s. Estimated remaining: 15m 18s. Rate: 140.2 symbols/min [2025-09-29T02:10:25.187088] [INFO ] [MAIN ] AL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:25.247485] [DEBUG] [LOCAL ] AJG: Loaded 47710 existing records from primary storage. [2025-09-29T02:10:25.249324] [INFO ] [MAIN ] AJG: Loaded 47710 primary data records. [2025-09-29T02:10:25.292133] [DEBUG] [LOCAL ] AKR: Loaded 46481 existing records from primary storage. [2025-09-29T02:10:25.292403] [INFO ] [MAIN ] AKR: Loaded 46481 primary data records. [2025-09-29T02:10:25.526786] [DEBUG] [LOCAL ] AL: Loaded 44831 existing records from primary storage. [2025-09-29T02:10:25.580792] [INFO ] [MAIN ] AL: Loaded 44831 primary data records. [2025-09-29T02:10:26.363291] [DEBUG] [MAIN ] AKR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:26.362847] [DEBUG] [MAIN ] AJG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:26.364390] [INFO ] [MAIN ] AKR: Generated 1820 derivative records from 46481 primary records. [2025-09-29T02:10:26.365764] [INFO ] [MAIN ] AJG: Generated 1820 derivative records from 47710 primary records. [2025-09-29T02:10:26.365831] [DEBUG] [LOCAL ] AKR: Saving derivative data. [2025-09-29T02:10:26.367554] [DEBUG] [LOCAL ] AJG: Saving derivative data. [2025-09-29T02:10:26.400503] [DEBUG] [LOCAL ] AJG: Derivative data saved (1820 records). [2025-09-29T02:10:26.401773] [DEBUG] [LOCAL ] AKR: Derivative data saved (1820 records). [2025-09-29T02:10:26.402282] [INFO ] [MAIN ] AKR: Successfully saved derivative data. [2025-09-29T02:10:26.405239] [INFO ] [MAIN ] Derivative Progress: 67/2211 symbols completed. AKR took 1.3s. Estimated remaining: 15m 43s. Rate: 136.4 symbols/min [2025-09-29T02:10:26.402187] [INFO ] [MAIN ] AJG: Successfully saved derivative data. [2025-09-29T02:10:26.408039] [INFO ] [MAIN ] ALB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:26.408454] [INFO ] [MAIN ] Derivative Progress: 68/2211 symbols completed. AJG took 1.3s. Estimated remaining: 15m 29s. Rate: 138.5 symbols/min [2025-09-29T02:10:26.409211] [INFO ] [MAIN ] ALC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:26.429170] [DEBUG] [MAIN ] AL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:26.430701] [INFO ] [MAIN ] AL: Generated 1820 derivative records from 44831 primary records. [2025-09-29T02:10:26.430916] [DEBUG] [LOCAL ] AL: Saving derivative data. [2025-09-29T02:10:26.449382] [DEBUG] [LOCAL ] AL: Derivative data saved (1820 records). [2025-09-29T02:10:26.449549] [INFO ] [MAIN ] AL: Successfully saved derivative data. [2025-09-29T02:10:26.452802] [INFO ] [MAIN ] Derivative Progress: 69/2211 symbols completed. AL took 1.3s. Estimated remaining: 15m 16s. Rate: 140.3 symbols/min [2025-09-29T02:10:26.453106] [INFO ] [MAIN ] ALE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:26.510471] [DEBUG] [LOCAL ] ALC: Loaded 51537 existing records from primary storage. [2025-09-29T02:10:26.512624] [INFO ] [MAIN ] ALC: Loaded 51537 primary data records. [2025-09-29T02:10:26.622726] [DEBUG] [LOCAL ] ALB: Loaded 54000 existing records from primary storage. [2025-09-29T02:10:26.645962] [INFO ] [MAIN ] ALB: Loaded 54000 primary data records. [2025-09-29T02:10:26.655352] [DEBUG] [LOCAL ] ALE: Loaded 30788 existing records from primary storage. [2025-09-29T02:10:26.701937] [INFO ] [MAIN ] ALE: Loaded 30788 primary data records. [2025-09-29T02:10:27.629523] [DEBUG] [MAIN ] ALC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:27.631995] [INFO ] [MAIN ] ALC: Generated 1820 derivative records from 51537 primary records. [2025-09-29T02:10:27.634159] [DEBUG] [LOCAL ] ALC: Saving derivative data. [2025-09-29T02:10:27.662208] [DEBUG] [LOCAL ] ALC: Derivative data saved (1820 records). [2025-09-29T02:10:27.668019] [INFO ] [MAIN ] ALC: Successfully saved derivative data. [2025-09-29T02:10:27.670629] [INFO ] [MAIN ] Derivative Progress: 70/2211 symbols completed. ALC took 1.3s. Estimated remaining: 15m 40s. Rate: 136.7 symbols/min [2025-09-29T02:10:27.672287] [INFO ] [MAIN ] ALEX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:27.671843] [DEBUG] [MAIN ] ALB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:27.673935] [INFO ] [MAIN ] ALB: Generated 1820 derivative records from 54000 primary records. [2025-09-29T02:10:27.674451] [DEBUG] [LOCAL ] ALB: Saving derivative data. [2025-09-29T02:10:27.703170] [DEBUG] [LOCAL ] ALB: Derivative data saved (1820 records). [2025-09-29T02:10:27.708581] [INFO ] [MAIN ] ALB: Successfully saved derivative data. [2025-09-29T02:10:27.708916] [DEBUG] [MAIN ] ALE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:27.709813] [INFO ] [MAIN ] ALE: Generated 1820 derivative records from 30788 primary records. [2025-09-29T02:10:27.712965] [INFO ] [MAIN ] Derivative Progress: 71/2211 symbols completed. ALB took 1.3s. Estimated remaining: 15m 27s. Rate: 138.4 symbols/min [2025-09-29T02:10:27.709916] [DEBUG] [LOCAL ] ALE: Saving derivative data. [2025-09-29T02:10:27.713179] [INFO ] [MAIN ] ALG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:27.740979] [DEBUG] [LOCAL ] ALE: Derivative data saved (1820 records). [2025-09-29T02:10:27.753343] [INFO ] [MAIN ] ALE: Successfully saved derivative data. [2025-09-29T02:10:27.756256] [INFO ] [MAIN ] Derivative Progress: 72/2211 symbols completed. ALE took 1.3s. Estimated remaining: 15m 15s. Rate: 140.2 symbols/min [2025-09-29T02:10:27.757771] [DEBUG] [LOCAL ] ALEX: Loaded 31769 existing records from primary storage. [2025-09-29T02:10:27.756517] [INFO ] [MAIN ] ALIT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:27.758166] [INFO ] [MAIN ] ALEX: Loaded 31769 primary data records. [2025-09-29T02:10:27.787969] [DEBUG] [LOCAL ] ALG: Loaded 10562 existing records from primary storage. [2025-09-29T02:10:27.818070] [INFO ] [MAIN ] ALG: Loaded 10562 primary data records. [2025-09-29T02:10:28.455330] [DEBUG] [LOCAL ] ALIT: Loaded 53534 existing records from primary storage. [2025-09-29T02:10:28.456669] [INFO ] [MAIN ] ALIT: Loaded 53534 primary data records. [2025-09-29T02:10:28.811524] [DEBUG] [MAIN ] ALEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:28.815534] [INFO ] [MAIN ] ALEX: Generated 1820 derivative records from 31769 primary records. [2025-09-29T02:10:28.829538] [DEBUG] [MAIN ] ALG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:28.830369] [INFO ] [MAIN ] ALG: Generated 1820 derivative records from 10562 primary records. [2025-09-29T02:10:28.829094] [DEBUG] [LOCAL ] ALEX: Saving derivative data. [2025-09-29T02:10:28.830480] [DEBUG] [LOCAL ] ALG: Saving derivative data. [2025-09-29T02:10:28.865104] [DEBUG] [LOCAL ] ALEX: Derivative data saved (1820 records). [2025-09-29T02:10:28.867975] [DEBUG] [LOCAL ] ALG: Derivative data saved (1820 records). [2025-09-29T02:10:28.868236] [INFO ] [MAIN ] ALEX: Successfully saved derivative data. [2025-09-29T02:10:28.870976] [INFO ] [MAIN ] Derivative Progress: 73/2211 symbols completed. ALEX took 1.2s. Estimated remaining: 15m 35s. Rate: 137.2 symbols/min [2025-09-29T02:10:28.868456] [INFO ] [MAIN ] ALG: Successfully saved derivative data. [2025-09-29T02:10:28.874437] [INFO ] [MAIN ] Derivative Progress: 74/2211 symbols completed. ALG took 1.2s. Estimated remaining: 15m 22s. Rate: 139.0 symbols/min [2025-09-29T02:10:28.891355] [DEBUG] [MAIN ] ALIT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:28.892130] [INFO ] [MAIN ] ALIT: Generated 1820 derivative records from 53534 primary records. [2025-09-29T02:10:28.892217] [DEBUG] [LOCAL ] ALIT: Saving derivative data. [2025-09-29T02:10:28.908306] [DEBUG] [LOCAL ] ALIT: Derivative data saved (1820 records). [2025-09-29T02:10:28.908403] [INFO ] [MAIN ] ALIT: Successfully saved derivative data. [2025-09-29T02:10:28.911512] [INFO ] [MAIN ] Derivative Progress: 75/2211 symbols completed. ALIT took 1.2s. Estimated remaining: 15m 10s. Rate: 140.8 symbols/min [2025-09-29T02:10:28.912049] [INFO ] [MAIN ] ALK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:28.912636] [INFO ] [MAIN ] ALLE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:28.912214] [INFO ] [MAIN ] ALL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:29.015040] [DEBUG] [LOCAL ] ALK: Loaded 53840 existing records from primary storage. [2025-09-29T02:10:29.015521] [INFO ] [MAIN ] ALK: Loaded 53840 primary data records. [2025-09-29T02:10:29.016538] [DEBUG] [LOCAL ] ALLE: Loaded 45637 existing records from primary storage. [2025-09-29T02:10:29.041268] [INFO ] [MAIN ] ALLE: Loaded 45637 primary data records. [2025-09-29T02:10:29.212996] [DEBUG] [LOCAL ] ALL: Loaded 50903 existing records from primary storage. [2025-09-29T02:10:29.264168] [INFO ] [MAIN ] ALL: Loaded 50903 primary data records. [2025-09-29T02:10:30.080894] [DEBUG] [MAIN ] ALK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:30.081967] [INFO ] [MAIN ] ALK: Generated 1820 derivative records from 53840 primary records. [2025-09-29T02:10:30.094818] [DEBUG] [LOCAL ] ALK: Saving derivative data. [2025-09-29T02:10:30.095456] [DEBUG] [MAIN ] ALLE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:30.097561] [INFO ] [MAIN ] ALLE: Generated 1820 derivative records from 45637 primary records. [2025-09-29T02:10:30.097922] [DEBUG] [LOCAL ] ALLE: Saving derivative data. [2025-09-29T02:10:30.131629] [DEBUG] [LOCAL ] ALLE: Derivative data saved (1820 records). [2025-09-29T02:10:30.134341] [INFO ] [MAIN ] ALLE: Successfully saved derivative data. [2025-09-29T02:10:30.137984] [INFO ] [MAIN ] Derivative Progress: 76/2211 symbols completed. ALLE took 1.2s. Estimated remaining: 15m 33s. Rate: 137.4 symbols/min [2025-09-29T02:10:30.139223] [DEBUG] [LOCAL ] ALK: Derivative data saved (1820 records). [2025-09-29T02:10:30.138730] [INFO ] [MAIN ] ALLY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:30.139459] [INFO ] [MAIN ] ALK: Successfully saved derivative data. [2025-09-29T02:10:30.142279] [INFO ] [MAIN ] Derivative Progress: 77/2211 symbols completed. ALK took 1.2s. Estimated remaining: 15m 20s. Rate: 139.2 symbols/min [2025-09-29T02:10:30.155414] [INFO ] [MAIN ] ALSN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:30.155820] [DEBUG] [MAIN ] ALL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:30.156840] [INFO ] [MAIN ] ALL: Generated 1820 derivative records from 50903 primary records. [2025-09-29T02:10:30.157275] [DEBUG] [LOCAL ] ALL: Saving derivative data. [2025-09-29T02:10:30.175383] [DEBUG] [LOCAL ] ALL: Derivative data saved (1820 records). [2025-09-29T02:10:30.175728] [INFO ] [MAIN ] ALL: Successfully saved derivative data. [2025-09-29T02:10:30.179725] [INFO ] [MAIN ] Derivative Progress: 78/2211 symbols completed. ALL took 1.3s. Estimated remaining: 15m 9s. Rate: 140.8 symbols/min [2025-09-29T02:10:30.180222] [INFO ] [MAIN ] ALTG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:30.234284] [DEBUG] [LOCAL ] ALTG: Loaded 24161 existing records from primary storage. [2025-09-29T02:10:30.234464] [INFO ] [MAIN ] ALTG: Loaded 24161 primary data records. [2025-09-29T02:10:30.334783] [DEBUG] [LOCAL ] ALSN: Loaded 43953 existing records from primary storage. [2025-09-29T02:10:30.394411] [DEBUG] [LOCAL ] ALLY: Loaded 53997 existing records from primary storage. [2025-09-29T02:10:30.394597] [INFO ] [MAIN ] ALSN: Loaded 43953 primary data records. [2025-09-29T02:10:30.410330] [INFO ] [MAIN ] ALLY: Loaded 53997 primary data records. [2025-09-29T02:10:31.308083] [DEBUG] [MAIN ] ALTG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:31.310181] [INFO ] [MAIN ] ALTG: Generated 1820 derivative records from 24161 primary records. [2025-09-29T02:10:31.310594] [DEBUG] [LOCAL ] ALTG: Saving derivative data. [2025-09-29T02:10:31.329005] [DEBUG] [LOCAL ] ALTG: Derivative data saved (1820 records). [2025-09-29T02:10:31.329240] [INFO ] [MAIN ] ALTG: Successfully saved derivative data. [2025-09-29T02:10:31.331634] [INFO ] [MAIN ] Derivative Progress: 79/2211 symbols completed. ALTG took 1.2s. Estimated remaining: 15m 28s. Rate: 137.8 symbols/min [2025-09-29T02:10:31.332484] [INFO ] [MAIN ] ALUR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:31.369561] [DEBUG] [MAIN ] ALLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:31.370257] [DEBUG] [MAIN ] ALSN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:31.371463] [INFO ] [MAIN ] ALLY: Generated 1820 derivative records from 53997 primary records. [2025-09-29T02:10:31.376483] [DEBUG] [LOCAL ] ALLY: Saving derivative data. [2025-09-29T02:10:31.377400] [INFO ] [MAIN ] ALSN: Generated 1820 derivative records from 43953 primary records. [2025-09-29T02:10:31.377955] [DEBUG] [LOCAL ] ALUR: Loaded 10950 existing records from primary storage. [2025-09-29T02:10:31.379209] [INFO ] [MAIN ] ALUR: Loaded 10950 primary data records. [2025-09-29T02:10:31.379118] [DEBUG] [LOCAL ] ALSN: Saving derivative data. [2025-09-29T02:10:31.464941] [DEBUG] [LOCAL ] ALLY: Derivative data saved (1820 records). [2025-09-29T02:10:31.470964] [INFO ] [MAIN ] ALLY: Successfully saved derivative data. [2025-09-29T02:10:31.474436] [INFO ] [MAIN ] Derivative Progress: 80/2211 symbols completed. ALLY took 1.3s. Estimated remaining: 15m 20s. Rate: 139.0 symbols/min [2025-09-29T02:10:31.482184] [INFO ] [MAIN ] ALV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:31.532851] [DEBUG] [LOCAL ] ALSN: Derivative data saved (1820 records). [2025-09-29T02:10:31.576432] [INFO ] [MAIN ] ALSN: Successfully saved derivative data. [2025-09-29T02:10:31.591030] [INFO ] [MAIN ] Derivative Progress: 81/2211 symbols completed. ALSN took 1.4s. Estimated remaining: 15m 11s. Rate: 140.3 symbols/min [2025-09-29T02:10:31.613756] [INFO ] [MAIN ] ALX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:31.831687] [DEBUG] [LOCAL ] ALX: Loaded 6121 existing records from primary storage. [2025-09-29T02:10:31.831902] [INFO ] [MAIN ] ALX: Loaded 6121 primary data records. [2025-09-29T02:10:32.061932] [DEBUG] [LOCAL ] ALV: Loaded 43217 existing records from primary storage. [2025-09-29T02:10:32.184632] [INFO ] [MAIN ] ALV: Loaded 43217 primary data records. [2025-09-29T02:10:32.511876] [DEBUG] [MAIN ] ALUR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:32.528825] [INFO ] [MAIN ] ALUR: Generated 1820 derivative records from 10950 primary records. [2025-09-29T02:10:32.529292] [DEBUG] [LOCAL ] ALUR: Saving derivative data. [2025-09-29T02:10:32.549184] [DEBUG] [LOCAL ] ALUR: Derivative data saved (1820 records). [2025-09-29T02:10:32.549855] [INFO ] [MAIN ] ALUR: Successfully saved derivative data. [2025-09-29T02:10:32.556293] [INFO ] [MAIN ] Derivative Progress: 82/2211 symbols completed. ALUR took 1.2s. Estimated remaining: 15m 25s. Rate: 138.2 symbols/min [2025-09-29T02:10:32.557515] [INFO ] [MAIN ] AM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:32.571706] [DEBUG] [MAIN ] ALX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:32.573529] [INFO ] [MAIN ] ALX: Generated 1820 derivative records from 6121 primary records. [2025-09-29T02:10:32.573665] [DEBUG] [LOCAL ] ALX: Saving derivative data. [2025-09-29T02:10:32.592455] [DEBUG] [LOCAL ] ALX: Derivative data saved (1820 records). [2025-09-29T02:10:32.592985] [INFO ] [MAIN ] ALX: Successfully saved derivative data. [2025-09-29T02:10:32.595841] [INFO ] [MAIN ] Derivative Progress: 83/2211 symbols completed. ALX took 1.0s. Estimated remaining: 15m 14s. Rate: 139.7 symbols/min [2025-09-29T02:10:32.596535] [INFO ] [MAIN ] AMBC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:32.616439] [DEBUG] [MAIN ] ALV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:32.617458] [INFO ] [MAIN ] ALV: Generated 1820 derivative records from 43217 primary records. [2025-09-29T02:10:32.617689] [DEBUG] [LOCAL ] ALV: Saving derivative data. [2025-09-29T02:10:32.635142] [DEBUG] [LOCAL ] ALV: Derivative data saved (1820 records). [2025-09-29T02:10:32.635329] [INFO ] [MAIN ] ALV: Successfully saved derivative data. [2025-09-29T02:10:32.638401] [INFO ] [MAIN ] Derivative Progress: 84/2211 symbols completed. ALV took 1.2s. Estimated remaining: 15m 4s. Rate: 141.2 symbols/min [2025-09-29T02:10:32.638753] [INFO ] [MAIN ] AMBP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:32.680600] [DEBUG] [LOCAL ] AMBC: Loaded 37453 existing records from primary storage. [2025-09-29T02:10:32.696283] [INFO ] [MAIN ] AMBC: Loaded 37453 primary data records. [2025-09-29T02:10:32.711085] [DEBUG] [LOCAL ] AM: Loaded 52887 existing records from primary storage. [2025-09-29T02:10:32.743802] [INFO ] [MAIN ] AM: Loaded 52887 primary data records. [2025-09-29T02:10:33.416419] [DEBUG] [LOCAL ] AMBP: Loaded 45863 existing records from primary storage. [2025-09-29T02:10:33.418234] [INFO ] [MAIN ] AMBP: Loaded 45863 primary data records. [2025-09-29T02:10:33.839810] [DEBUG] [MAIN ] AMBC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:33.842675] [INFO ] [MAIN ] AMBC: Generated 1820 derivative records from 37453 primary records. [2025-09-29T02:10:33.843283] [DEBUG] [LOCAL ] AMBC: Saving derivative data. [2025-09-29T02:10:33.871397] [DEBUG] [MAIN ] AM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:33.877538] [DEBUG] [LOCAL ] AMBC: Derivative data saved (1820 records). [2025-09-29T02:10:33.873690] [INFO ] [MAIN ] AM: Generated 1820 derivative records from 52887 primary records. [2025-09-29T02:10:33.877854] [INFO ] [MAIN ] AMBC: Successfully saved derivative data. [2025-09-29T02:10:33.880540] [INFO ] [MAIN ] Derivative Progress: 85/2211 symbols completed. AMBC took 1.3s. Estimated remaining: 15m 24s. Rate: 138.1 symbols/min [2025-09-29T02:10:33.880820] [INFO ] [MAIN ] AMC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:33.881498] [DEBUG] [LOCAL ] AM: Saving derivative data. [2025-09-29T02:10:33.900887] [DEBUG] [LOCAL ] AM: Derivative data saved (1820 records). [2025-09-29T02:10:33.901154] [INFO ] [MAIN ] AM: Successfully saved derivative data. [2025-09-29T02:10:33.904320] [INFO ] [MAIN ] Derivative Progress: 86/2211 symbols completed. AM took 1.3s. Estimated remaining: 15m 13s. Rate: 139.6 symbols/min [2025-09-29T02:10:33.904845] [INFO ] [MAIN ] AMCR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:33.925295] [DEBUG] [MAIN ] AMBP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:33.926213] [INFO ] [MAIN ] AMBP: Generated 1820 derivative records from 45863 primary records. [2025-09-29T02:10:33.926300] [DEBUG] [LOCAL ] AMBP: Saving derivative data. [2025-09-29T02:10:33.942708] [DEBUG] [LOCAL ] AMBP: Derivative data saved (1820 records). [2025-09-29T02:10:33.943002] [INFO ] [MAIN ] AMBP: Successfully saved derivative data. [2025-09-29T02:10:33.945738] [INFO ] [MAIN ] Derivative Progress: 87/2211 symbols completed. AMBP took 1.3s. Estimated remaining: 15m 3s. Rate: 141.1 symbols/min [2025-09-29T02:10:33.946231] [INFO ] [MAIN ] AME: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:34.004529] [DEBUG] [LOCAL ] AMC: Loaded 54539 existing records from primary storage. [2025-09-29T02:10:34.005019] [INFO ] [MAIN ] AMC: Loaded 54539 primary data records. [2025-09-29T02:10:34.146077] [DEBUG] [LOCAL ] AMCR: Loaded 54449 existing records from primary storage. [2025-09-29T02:10:34.157360] [INFO ] [MAIN ] AMCR: Loaded 54449 primary data records. [2025-09-29T02:10:34.475585] [DEBUG] [LOCAL ] AME: Loaded 49252 existing records from primary storage. [2025-09-29T02:10:34.503475] [INFO ] [MAIN ] AME: Loaded 49252 primary data records. [2025-09-29T02:10:35.089478] [DEBUG] [MAIN ] AMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:35.091099] [INFO ] [MAIN ] AMC: Generated 1820 derivative records from 54539 primary records. [2025-09-29T02:10:35.092031] [DEBUG] [LOCAL ] AMC: Saving derivative data. [2025-09-29T02:10:35.130113] [DEBUG] [LOCAL ] AMC: Derivative data saved (1820 records). [2025-09-29T02:10:35.131075] [DEBUG] [MAIN ] AMCR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:35.130679] [INFO ] [MAIN ] AMC: Successfully saved derivative data. [2025-09-29T02:10:35.132191] [INFO ] [MAIN ] AMCR: Generated 1820 derivative records from 54449 primary records. [2025-09-29T02:10:35.136198] [DEBUG] [LOCAL ] AMCR: Saving derivative data. [2025-09-29T02:10:35.135804] [INFO ] [MAIN ] Derivative Progress: 88/2211 symbols completed. AMC took 1.3s. Estimated remaining: 15m 21s. Rate: 138.2 symbols/min [2025-09-29T02:10:35.157059] [DEBUG] [LOCAL ] AMCR: Derivative data saved (1820 records). [2025-09-29T02:10:35.157291] [INFO ] [MAIN ] AMCR: Successfully saved derivative data. [2025-09-29T02:10:35.172503] [INFO ] [MAIN ] Derivative Progress: 89/2211 symbols completed. AMCR took 1.3s. Estimated remaining: 15m 11s. Rate: 139.7 symbols/min [2025-09-29T02:10:35.172923] [DEBUG] [MAIN ] AME: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:35.173964] [INFO ] [MAIN ] AME: Generated 1820 derivative records from 49252 primary records. [2025-09-29T02:10:35.174060] [DEBUG] [LOCAL ] AME: Saving derivative data. [2025-09-29T02:10:35.190798] [DEBUG] [LOCAL ] AME: Derivative data saved (1820 records). [2025-09-29T02:10:35.190894] [INFO ] [MAIN ] AME: Successfully saved derivative data. [2025-09-29T02:10:35.193818] [INFO ] [MAIN ] Derivative Progress: 90/2211 symbols completed. AME took 1.2s. Estimated remaining: 15m 1s. Rate: 141.2 symbols/min [2025-09-29T02:10:35.194552] [INFO ] [MAIN ] AMH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:35.194462] [INFO ] [MAIN ] AMN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:35.194349] [INFO ] [MAIN ] AMG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:35.229915] [DEBUG] [LOCAL ] AMG: Loaded 21046 existing records from primary storage. [2025-09-29T02:10:35.241098] [INFO ] [MAIN ] AMG: Loaded 21046 primary data records. [2025-09-29T02:10:35.405955] [DEBUG] [LOCAL ] AMN: Loaded 42588 existing records from primary storage. [2025-09-29T02:10:35.442419] [INFO ] [MAIN ] AMN: Loaded 42588 primary data records. [2025-09-29T02:10:35.443401] [DEBUG] [LOCAL ] AMH: Loaded 52467 existing records from primary storage. [2025-09-29T02:10:35.474792] [INFO ] [MAIN ] AMH: Loaded 52467 primary data records. [2025-09-29T02:10:36.365635] [DEBUG] [MAIN ] AMG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:36.367039] [INFO ] [MAIN ] AMG: Generated 1820 derivative records from 21046 primary records. [2025-09-29T02:10:36.367718] [DEBUG] [LOCAL ] AMG: Saving derivative data. [2025-09-29T02:10:36.389818] [DEBUG] [LOCAL ] AMG: Derivative data saved (1820 records). [2025-09-29T02:10:36.390511] [INFO ] [MAIN ] AMG: Successfully saved derivative data. [2025-09-29T02:10:36.392862] [INFO ] [MAIN ] Derivative Progress: 91/2211 symbols completed. AMG took 1.2s. Estimated remaining: 15m 19s. Rate: 138.4 symbols/min [2025-09-29T02:10:36.406062] [INFO ] [MAIN ] AMP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:36.407424] [DEBUG] [MAIN ] AMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:36.408421] [INFO ] [MAIN ] AMN: Generated 1820 derivative records from 42588 primary records. [2025-09-29T02:10:36.408624] [DEBUG] [LOCAL ] AMN: Saving derivative data. [2025-09-29T02:10:36.429235] [DEBUG] [LOCAL ] AMN: Derivative data saved (1820 records). [2025-09-29T02:10:36.429583] [INFO ] [MAIN ] AMN: Successfully saved derivative data. [2025-09-29T02:10:36.432558] [INFO ] [MAIN ] Derivative Progress: 92/2211 symbols completed. AMN took 1.2s. Estimated remaining: 15m 10s. Rate: 139.8 symbols/min [2025-09-29T02:10:36.440749] [INFO ] [MAIN ] AMPX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:36.446665] [DEBUG] [MAIN ] AMH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:36.447532] [INFO ] [MAIN ] AMH: Generated 1820 derivative records from 52467 primary records. [2025-09-29T02:10:36.449233] [DEBUG] [LOCAL ] AMH: Saving derivative data. [2025-09-29T02:10:36.475589] [DEBUG] [LOCAL ] AMH: Derivative data saved (1820 records). [2025-09-29T02:10:36.475799] [INFO ] [MAIN ] AMH: Successfully saved derivative data. [2025-09-29T02:10:36.478342] [INFO ] [MAIN ] Derivative Progress: 93/2211 symbols completed. AMH took 1.3s. Estimated remaining: 15m 0s. Rate: 141.1 symbols/min [2025-09-29T02:10:36.478754] [INFO ] [MAIN ] AMPY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:36.493120] [DEBUG] [LOCAL ] AMP: Loaded 32959 existing records from primary storage. [2025-09-29T02:10:36.493572] [INFO ] [MAIN ] AMP: Loaded 32959 primary data records. [2025-09-29T02:10:36.730282] [DEBUG] [LOCAL ] AMPX: Loaded 52949 existing records from primary storage. [2025-09-29T02:10:36.766172] [INFO ] [MAIN ] AMPX: Loaded 52949 primary data records. [2025-09-29T02:10:36.767222] [DEBUG] [LOCAL ] AMPY: Loaded 38164 existing records from primary storage. [2025-09-29T02:10:36.912268] [INFO ] [MAIN ] AMPY: Loaded 38164 primary data records. [2025-09-29T02:10:37.595111] [DEBUG] [MAIN ] AMP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:37.596429] [INFO ] [MAIN ] AMP: Generated 1820 derivative records from 32959 primary records. [2025-09-29T02:10:37.596898] [DEBUG] [LOCAL ] AMP: Saving derivative data. [2025-09-29T02:10:37.627676] [DEBUG] [LOCAL ] AMP: Derivative data saved (1820 records). [2025-09-29T02:10:37.633718] [DEBUG] [MAIN ] AMPX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:37.633954] [INFO ] [MAIN ] AMP: Successfully saved derivative data. [2025-09-29T02:10:37.636972] [INFO ] [MAIN ] Derivative Progress: 94/2211 symbols completed. AMP took 1.2s. Estimated remaining: 15m 16s. Rate: 138.6 symbols/min [2025-09-29T02:10:37.638298] [INFO ] [MAIN ] AMPX: Generated 1820 derivative records from 52949 primary records. [2025-09-29T02:10:37.639119] [INFO ] [MAIN ] AMR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:37.639414] [DEBUG] [LOCAL ] AMPX: Saving derivative data. [2025-09-29T02:10:37.661156] [DEBUG] [LOCAL ] AMPX: Derivative data saved (1820 records). [2025-09-29T02:10:37.661583] [INFO ] [MAIN ] AMPX: Successfully saved derivative data. [2025-09-29T02:10:37.664767] [INFO ] [MAIN ] Derivative Progress: 95/2211 symbols completed. AMPX took 1.2s. Estimated remaining: 15m 7s. Rate: 140.0 symbols/min [2025-09-29T02:10:37.665149] [INFO ] [MAIN ] AMRC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:37.679030] [DEBUG] [MAIN ] AMPY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:37.680131] [INFO ] [MAIN ] AMPY: Generated 1820 derivative records from 38164 primary records. [2025-09-29T02:10:37.680231] [DEBUG] [LOCAL ] AMPY: Saving derivative data. [2025-09-29T02:10:37.706517] [DEBUG] [LOCAL ] AMPY: Derivative data saved (1820 records). [2025-09-29T02:10:37.706861] [INFO ] [MAIN ] AMPY: Successfully saved derivative data. [2025-09-29T02:10:37.710039] [INFO ] [MAIN ] Derivative Progress: 96/2211 symbols completed. AMPY took 1.2s. Estimated remaining: 14m 58s. Rate: 141.3 symbols/min [2025-09-29T02:10:37.710530] [INFO ] [MAIN ] AMT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:37.725019] [DEBUG] [LOCAL ] AMR: Loaded 29441 existing records from primary storage. [2025-09-29T02:10:37.725213] [INFO ] [MAIN ] AMR: Loaded 29441 primary data records. [2025-09-29T02:10:37.913343] [DEBUG] [LOCAL ] AMRC: Loaded 38981 existing records from primary storage. [2025-09-29T02:10:37.956126] [INFO ] [MAIN ] AMRC: Loaded 38981 primary data records. [2025-09-29T02:10:38.270360] [DEBUG] [LOCAL ] AMT: Loaded 53212 existing records from primary storage. [2025-09-29T02:10:38.270599] [INFO ] [MAIN ] AMT: Loaded 53212 primary data records. [2025-09-29T02:10:38.728002] [DEBUG] [MAIN ] AMR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:38.860013] [INFO ] [MAIN ] AMR: Generated 1820 derivative records from 29441 primary records. [2025-09-29T02:10:38.861310] [DEBUG] [LOCAL ] AMR: Saving derivative data. [2025-09-29T02:10:38.883036] [DEBUG] [LOCAL ] AMR: Derivative data saved (1820 records). [2025-09-29T02:10:38.884705] [INFO ] [MAIN ] AMR: Successfully saved derivative data. [2025-09-29T02:10:38.887424] [INFO ] [MAIN ] Derivative Progress: 97/2211 symbols completed. AMR took 1.2s. Estimated remaining: 15m 14s. Rate: 138.8 symbols/min [2025-09-29T02:10:38.888490] [INFO ] [MAIN ] AMTB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:38.909976] [DEBUG] [MAIN ] AMRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:38.911044] [INFO ] [MAIN ] AMRC: Generated 1820 derivative records from 38981 primary records. [2025-09-29T02:10:38.911460] [DEBUG] [LOCAL ] AMRC: Saving derivative data. [2025-09-29T02:10:38.943272] [DEBUG] [LOCAL ] AMRC: Derivative data saved (1820 records). [2025-09-29T02:10:38.954588] [DEBUG] [LOCAL ] AMTB: Loaded 20599 existing records from primary storage. [2025-09-29T02:10:38.955770] [INFO ] [MAIN ] AMTB: Loaded 20599 primary data records. [2025-09-29T02:10:38.955919] [INFO ] [MAIN ] AMRC: Successfully saved derivative data. [2025-09-29T02:10:38.958948] [INFO ] [MAIN ] Derivative Progress: 98/2211 symbols completed. AMRC took 1.3s. Estimated remaining: 15m 6s. Rate: 139.9 symbols/min [2025-09-29T02:10:38.990072] [INFO ] [MAIN ] AMTD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:39.027458] [DEBUG] [MAIN ] AMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:39.060058] [INFO ] [MAIN ] AMT: Generated 1820 derivative records from 53212 primary records. [2025-09-29T02:10:39.110791] [DEBUG] [LOCAL ] AMT: Saving derivative data. [2025-09-29T02:10:39.121212] [DEBUG] [LOCAL ] AMTD: Loaded 3622 existing records from primary storage. [2025-09-29T02:10:39.151936] [INFO ] [MAIN ] AMTD: Loaded 3622 primary data records. [2025-09-29T02:10:39.182985] [DEBUG] [LOCAL ] AMT: Derivative data saved (1820 records). [2025-09-29T02:10:39.195111] [INFO ] [MAIN ] AMT: Successfully saved derivative data. [2025-09-29T02:10:39.215049] [INFO ] [MAIN ] Derivative Progress: 99/2211 symbols completed. AMT took 1.5s. Estimated remaining: 15m 2s. Rate: 140.5 symbols/min [2025-09-29T02:10:39.409027] [INFO ] [MAIN ] AMTM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:39.716945] [DEBUG] [MAIN ] AMTB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:39.718999] [INFO ] [MAIN ] AMTB: Generated 1820 derivative records from 20599 primary records. [2025-09-29T02:10:39.719564] [DEBUG] [LOCAL ] AMTB: Saving derivative data. [2025-09-29T02:10:39.755755] [DEBUG] [LOCAL ] AMTB: Derivative data saved (1820 records). [2025-09-29T02:10:39.758926] [DEBUG] [LOCAL ] AMTM: Loaded 51451 existing records from primary storage. [2025-09-29T02:10:39.759785] [INFO ] [MAIN ] AMTB: Successfully saved derivative data. [2025-09-29T02:10:39.760016] [INFO ] [MAIN ] AMTM: Loaded 51451 primary data records. [2025-09-29T02:10:39.762777] [INFO ] [MAIN ] Derivative Progress: 100/2211 symbols completed. AMTB took 0.9s. Estimated remaining: 15m 4s. Rate: 140.1 symbols/min [2025-09-29T02:10:39.768775] [INFO ] [MAIN ] AMWL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:39.823602] [DEBUG] [MAIN ] AMTD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:39.854001] [INFO ] [MAIN ] AMTD: Generated 1820 derivative records from 3622 primary records. [2025-09-29T02:10:39.890328] [DEBUG] [LOCAL ] AMTD: Saving derivative data. [2025-09-29T02:10:39.922312] [DEBUG] [LOCAL ] AMWL: Loaded 8830 existing records from primary storage. [2025-09-29T02:10:39.926502] [INFO ] [MAIN ] AMWL: Loaded 8830 primary data records. [2025-09-29T02:10:40.208967] [DEBUG] [LOCAL ] AMTD: Derivative data saved (1820 records). [2025-09-29T02:10:40.227526] [INFO ] [MAIN ] AMTD: Successfully saved derivative data. [2025-09-29T02:10:40.230225] [INFO ] [MAIN ] Derivative Progress: 101/2211 symbols completed. AMTD took 1.2s. Estimated remaining: 15m 4s. Rate: 140.0 symbols/min [2025-09-29T02:10:40.239415] [INFO ] [MAIN ] AMX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:40.549906] [DEBUG] [MAIN ] AMTM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:40.551129] [INFO ] [MAIN ] AMTM: Generated 1820 derivative records from 51451 primary records. [2025-09-29T02:10:40.551945] [DEBUG] [LOCAL ] AMTM: Saving derivative data. [2025-09-29T02:10:40.589374] [DEBUG] [LOCAL ] AMTM: Derivative data saved (1820 records). [2025-09-29T02:10:40.591235] [DEBUG] [LOCAL ] AMX: Loaded 49855 existing records from primary storage. [2025-09-29T02:10:40.591397] [INFO ] [MAIN ] AMTM: Successfully saved derivative data. [2025-09-29T02:10:40.594715] [INFO ] [MAIN ] Derivative Progress: 102/2211 symbols completed. AMTM took 1.2s. Estimated remaining: 15m 3s. Rate: 140.2 symbols/min [2025-09-29T02:10:40.591753] [INFO ] [MAIN ] AMX: Loaded 49855 primary data records. [2025-09-29T02:10:40.594951] [INFO ] [MAIN ] AN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:40.763044] [DEBUG] [MAIN ] AMWL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:40.805050] [INFO ] [MAIN ] AMWL: Generated 1820 derivative records from 8830 primary records. [2025-09-29T02:10:40.942392] [DEBUG] [LOCAL ] AMWL: Saving derivative data. [2025-09-29T02:10:40.969971] [DEBUG] [LOCAL ] AN: Loaded 32842 existing records from primary storage. [2025-09-29T02:10:40.976993] [INFO ] [MAIN ] AN: Loaded 32842 primary data records. [2025-09-29T02:10:41.025831] [DEBUG] [LOCAL ] AMWL: Derivative data saved (1820 records). [2025-09-29T02:10:41.044543] [INFO ] [MAIN ] AMWL: Successfully saved derivative data. [2025-09-29T02:10:41.056614] [INFO ] [MAIN ] Derivative Progress: 103/2211 symbols completed. AMWL took 1.3s. Estimated remaining: 15m 3s. Rate: 140.1 symbols/min [2025-09-29T02:10:41.349101] [DEBUG] [MAIN ] AMX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:41.351724] [INFO ] [MAIN ] AMX: Generated 1820 derivative records from 49855 primary records. [2025-09-29T02:10:41.352091] [DEBUG] [LOCAL ] AMX: Saving derivative data. [2025-09-29T02:10:41.370308] [DEBUG] [LOCAL ] AMX: Derivative data saved (1820 records). [2025-09-29T02:10:41.370544] [INFO ] [MAIN ] AMX: Successfully saved derivative data. [2025-09-29T02:10:41.373236] [INFO ] [MAIN ] Derivative Progress: 104/2211 symbols completed. AMX took 1.1s. Estimated remaining: 15m 0s. Rate: 140.4 symbols/min [2025-09-29T02:10:41.393686] [DEBUG] [MAIN ] AN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:41.394494] [INFO ] [MAIN ] AN: Generated 1820 derivative records from 32842 primary records. [2025-09-29T02:10:41.394586] [DEBUG] [LOCAL ] AN: Saving derivative data. [2025-09-29T02:10:41.411777] [DEBUG] [LOCAL ] AN: Derivative data saved (1820 records). [2025-09-29T02:10:41.412025] [INFO ] [MAIN ] AN: Successfully saved derivative data. [2025-09-29T02:10:41.415030] [INFO ] [MAIN ] Derivative Progress: 105/2211 symbols completed. AN took 0.8s. Estimated remaining: 14m 52s. Rate: 141.7 symbols/min [2025-09-29T02:10:41.415711] [INFO ] [MAIN ] ANET: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:41.416025] [INFO ] [MAIN ] ANF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:41.415861] [INFO ] [MAIN ] ANRO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:41.439542] [DEBUG] [LOCAL ] ANRO: Loaded 19387 existing records from primary storage. [2025-09-29T02:10:41.439760] [INFO ] [MAIN ] ANRO: Loaded 19387 primary data records. [2025-09-29T02:10:41.850008] [DEBUG] [LOCAL ] ANF: Loaded 52967 existing records from primary storage. [2025-09-29T02:10:41.875674] [INFO ] [MAIN ] ANF: Loaded 52967 primary data records. [2025-09-29T02:10:41.882305] [DEBUG] [LOCAL ] ANET: Loaded 54546 existing records from primary storage. [2025-09-29T02:10:41.892405] [INFO ] [MAIN ] ANET: Loaded 54546 primary data records. [2025-09-29T02:10:42.672052] [DEBUG] [MAIN ] ANRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:42.673128] [INFO ] [MAIN ] ANRO: Generated 1820 derivative records from 19387 primary records. [2025-09-29T02:10:42.674425] [DEBUG] [LOCAL ] ANRO: Saving derivative data. [2025-09-29T02:10:42.694058] [DEBUG] [LOCAL ] ANRO: Derivative data saved (1820 records). [2025-09-29T02:10:42.694853] [INFO ] [MAIN ] ANRO: Successfully saved derivative data. [2025-09-29T02:10:42.698089] [INFO ] [MAIN ] Derivative Progress: 106/2211 symbols completed. ANRO took 1.3s. Estimated remaining: 15m 9s. Rate: 139.0 symbols/min [2025-09-29T02:10:42.698975] [INFO ] [MAIN ] ANVS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:42.722079] [DEBUG] [MAIN ] ANF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:42.723453] [INFO ] [MAIN ] ANF: Generated 1820 derivative records from 52967 primary records. [2025-09-29T02:10:42.723710] [DEBUG] [LOCAL ] ANF: Saving derivative data. [2025-09-29T02:10:42.763347] [DEBUG] [MAIN ] ANET: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:42.764259] [DEBUG] [LOCAL ] ANF: Derivative data saved (1820 records). [2025-09-29T02:10:42.765198] [INFO ] [MAIN ] ANET: Generated 1820 derivative records from 54546 primary records. [2025-09-29T02:10:42.773972] [DEBUG] [LOCAL ] ANET: Saving derivative data. [2025-09-29T02:10:42.764409] [INFO ] [MAIN ] ANF: Successfully saved derivative data. [2025-09-29T02:10:42.777395] [INFO ] [MAIN ] Derivative Progress: 107/2211 symbols completed. ANF took 1.4s. Estimated remaining: 15m 1s. Rate: 140.1 symbols/min [2025-09-29T02:10:42.778559] [INFO ] [MAIN ] AOD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:42.774707] [DEBUG] [LOCAL ] ANVS: Loaded 23508 existing records from primary storage. [2025-09-29T02:10:42.779262] [INFO ] [MAIN ] ANVS: Loaded 23508 primary data records. [2025-09-29T02:10:42.865542] [DEBUG] [LOCAL ] ANET: Derivative data saved (1820 records). [2025-09-29T02:10:42.913940] [INFO ] [MAIN ] ANET: Successfully saved derivative data. [2025-09-29T02:10:42.921477] [INFO ] [MAIN ] Derivative Progress: 108/2211 symbols completed. ANET took 1.5s. Estimated remaining: 14m 55s. Rate: 140.9 symbols/min [2025-09-29T02:10:42.927418] [INFO ] [MAIN ] AOMR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:42.988554] [DEBUG] [LOCAL ] AOD: Loaded 30414 existing records from primary storage. [2025-09-29T02:10:43.018048] [INFO ] [MAIN ] AOD: Loaded 30414 primary data records. [2025-09-29T02:10:43.264446] [DEBUG] [LOCAL ] AOMR: Loaded 16852 existing records from primary storage. [2025-09-29T02:10:43.265091] [INFO ] [MAIN ] AOMR: Loaded 16852 primary data records. [2025-09-29T02:10:43.873664] [DEBUG] [MAIN ] ANVS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:43.875123] [INFO ] [MAIN ] ANVS: Generated 1820 derivative records from 23508 primary records. [2025-09-29T02:10:43.875251] [DEBUG] [LOCAL ] ANVS: Saving derivative data. [2025-09-29T02:10:43.897257] [DEBUG] [LOCAL ] ANVS: Derivative data saved (1820 records). [2025-09-29T02:10:43.897480] [INFO ] [MAIN ] ANVS: Successfully saved derivative data. [2025-09-29T02:10:43.900274] [INFO ] [MAIN ] Derivative Progress: 109/2211 symbols completed. ANVS took 1.2s. Estimated remaining: 15m 6s. Rate: 139.3 symbols/min [2025-09-29T02:10:43.900986] [INFO ] [MAIN ] AON: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:43.925391] [DEBUG] [MAIN ] AOD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:43.926892] [INFO ] [MAIN ] AOD: Generated 1820 derivative records from 30414 primary records. [2025-09-29T02:10:43.928343] [DEBUG] [LOCAL ] AOD: Saving derivative data. [2025-09-29T02:10:43.953776] [DEBUG] [LOCAL ] AOD: Derivative data saved (1820 records). [2025-09-29T02:10:43.955588] [INFO ] [MAIN ] AOD: Successfully saved derivative data. [2025-09-29T02:10:43.958854] [INFO ] [MAIN ] Derivative Progress: 110/2211 symbols completed. AOD took 1.2s. Estimated remaining: 14m 58s. Rate: 140.4 symbols/min [2025-09-29T02:10:43.959387] [INFO ] [MAIN ] AORT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:43.973958] [DEBUG] [MAIN ] AOMR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:43.975343] [INFO ] [MAIN ] AOMR: Generated 1820 derivative records from 16852 primary records. [2025-09-29T02:10:43.987788] [DEBUG] [LOCAL ] AOMR: Saving derivative data. [2025-09-29T02:10:44.007053] [DEBUG] [LOCAL ] AOMR: Derivative data saved (1820 records). [2025-09-29T02:10:44.008180] [INFO ] [MAIN ] AOMR: Successfully saved derivative data. [2025-09-29T02:10:44.024301] [INFO ] [MAIN ] Derivative Progress: 111/2211 symbols completed. AOMR took 1.1s. Estimated remaining: 14m 51s. Rate: 141.5 symbols/min [2025-09-29T02:10:44.024776] [INFO ] [MAIN ] AOS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:44.026952] [DEBUG] [LOCAL ] AON: Loaded 46248 existing records from primary storage. [2025-09-29T02:10:44.027283] [INFO ] [MAIN ] AON: Loaded 46248 primary data records. [2025-09-29T02:10:44.171087] [DEBUG] [LOCAL ] AORT: Loaded 30087 existing records from primary storage. [2025-09-29T02:10:44.192579] [INFO ] [MAIN ] AORT: Loaded 30087 primary data records. [2025-09-29T02:10:44.567014] [DEBUG] [LOCAL ] AOS: Loaded 49769 existing records from primary storage. [2025-09-29T02:10:44.616280] [INFO ] [MAIN ] AOS: Loaded 49769 primary data records. [2025-09-29T02:10:45.184621] [DEBUG] [MAIN ] AON: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:45.187542] [INFO ] [MAIN ] AON: Generated 1820 derivative records from 46248 primary records. [2025-09-29T02:10:45.188367] [DEBUG] [LOCAL ] AON: Saving derivative data. [2025-09-29T02:10:45.211023] [DEBUG] [LOCAL ] AON: Derivative data saved (1820 records). [2025-09-29T02:10:45.212025] [INFO ] [MAIN ] AON: Successfully saved derivative data. [2025-09-29T02:10:45.215301] [INFO ] [MAIN ] Derivative Progress: 112/2211 symbols completed. AON took 1.3s. Estimated remaining: 15m 5s. Rate: 139.2 symbols/min [2025-09-29T02:10:45.216060] [INFO ] [MAIN ] AP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:45.230323] [DEBUG] [MAIN ] AORT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:45.231846] [INFO ] [MAIN ] AORT: Generated 1820 derivative records from 30087 primary records. [2025-09-29T02:10:45.232242] [DEBUG] [LOCAL ] AORT: Saving derivative data. [2025-09-29T02:10:45.259138] [DEBUG] [LOCAL ] AORT: Derivative data saved (1820 records). [2025-09-29T02:10:45.259304] [INFO ] [MAIN ] AORT: Successfully saved derivative data. [2025-09-29T02:10:45.262728] [INFO ] [MAIN ] Derivative Progress: 113/2211 symbols completed. AORT took 1.3s. Estimated remaining: 14m 57s. Rate: 140.3 symbols/min [2025-09-29T02:10:45.268549] [INFO ] [MAIN ] APAM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:45.269529] [DEBUG] [LOCAL ] AP: Loaded 7236 existing records from primary storage. [2025-09-29T02:10:45.271450] [INFO ] [MAIN ] AP: Loaded 7236 primary data records. [2025-09-29T02:10:45.345970] [DEBUG] [MAIN ] AOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:45.370229] [INFO ] [MAIN ] AOS: Generated 1820 derivative records from 49769 primary records. [2025-09-29T02:10:45.381802] [DEBUG] [LOCAL ] AOS: Saving derivative data. [2025-09-29T02:10:45.653402] [DEBUG] [LOCAL ] AOS: Derivative data saved (1820 records). [2025-09-29T02:10:45.666132] [INFO ] [MAIN ] AOS: Successfully saved derivative data. [2025-09-29T02:10:45.669955] [INFO ] [MAIN ] Derivative Progress: 114/2211 symbols completed. AOS took 1.6s. Estimated remaining: 14m 56s. Rate: 140.4 symbols/min [2025-09-29T02:10:45.670777] [INFO ] [MAIN ] APD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:45.673134] [DEBUG] [LOCAL ] APAM: Loaded 36969 existing records from primary storage. [2025-09-29T02:10:45.673954] [INFO ] [MAIN ] APAM: Loaded 36969 primary data records. [2025-09-29T02:10:46.098416] [DEBUG] [LOCAL ] APD: Loaded 46087 existing records from primary storage. [2025-09-29T02:10:46.099837] [INFO ] [MAIN ] APD: Loaded 46087 primary data records. [2025-09-29T02:10:46.164618] [DEBUG] [MAIN ] AP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:46.208830] [INFO ] [MAIN ] AP: Generated 1820 derivative records from 7236 primary records. [2025-09-29T02:10:46.231264] [DEBUG] [LOCAL ] AP: Saving derivative data. [2025-09-29T02:10:46.476416] [DEBUG] [LOCAL ] AP: Derivative data saved (1820 records). [2025-09-29T02:10:46.477300] [INFO ] [MAIN ] AP: Successfully saved derivative data. [2025-09-29T02:10:46.480813] [INFO ] [MAIN ] Derivative Progress: 115/2211 symbols completed. AP took 1.3s. Estimated remaining: 15m 3s. Rate: 139.3 symbols/min [2025-09-29T02:10:46.481330] [INFO ] [MAIN ] APG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:46.515967] [DEBUG] [MAIN ] APAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:46.517215] [INFO ] [MAIN ] APAM: Generated 1820 derivative records from 36969 primary records. [2025-09-29T02:10:46.517377] [DEBUG] [LOCAL ] APAM: Saving derivative data. [2025-09-29T02:10:46.547193] [DEBUG] [LOCAL ] APAM: Derivative data saved (1820 records). [2025-09-29T02:10:46.547458] [INFO ] [MAIN ] APAM: Successfully saved derivative data. [2025-09-29T02:10:46.551416] [INFO ] [MAIN ] Derivative Progress: 116/2211 symbols completed. APAM took 1.3s. Estimated remaining: 14m 56s. Rate: 140.3 symbols/min [2025-09-29T02:10:46.551687] [INFO ] [MAIN ] APH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:46.586244] [DEBUG] [MAIN ] APD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:46.587223] [INFO ] [MAIN ] APD: Generated 1820 derivative records from 46087 primary records. [2025-09-29T02:10:46.587365] [DEBUG] [LOCAL ] APD: Saving derivative data. [2025-09-29T02:10:46.624191] [DEBUG] [LOCAL ] APD: Derivative data saved (1820 records). [2025-09-29T02:10:46.625991] [DEBUG] [LOCAL ] APG: Loaded 50931 existing records from primary storage. [2025-09-29T02:10:46.626154] [INFO ] [MAIN ] APD: Successfully saved derivative data. [2025-09-29T02:10:46.626400] [INFO ] [MAIN ] APG: Loaded 50931 primary data records. [2025-09-29T02:10:46.629615] [INFO ] [MAIN ] Derivative Progress: 117/2211 symbols completed. APD took 1.0s. Estimated remaining: 14m 49s. Rate: 141.3 symbols/min [2025-09-29T02:10:46.635077] [INFO ] [MAIN ] APLE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:46.825891] [DEBUG] [LOCAL ] APH: Loaded 54471 existing records from primary storage. [2025-09-29T02:10:46.886723] [INFO ] [MAIN ] APH: Loaded 54471 primary data records. [2025-09-29T02:10:47.208038] [DEBUG] [LOCAL ] APLE: Loaded 52769 existing records from primary storage. [2025-09-29T02:10:47.267272] [INFO ] [MAIN ] APLE: Loaded 52769 primary data records. [2025-09-29T02:10:47.753037] [DEBUG] [MAIN ] APG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:47.754281] [INFO ] [MAIN ] APG: Generated 1820 derivative records from 50931 primary records. [2025-09-29T02:10:47.754671] [DEBUG] [LOCAL ] APG: Saving derivative data. [2025-09-29T02:10:47.790968] [DEBUG] [MAIN ] APH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:47.791763] [DEBUG] [LOCAL ] APG: Derivative data saved (1820 records). [2025-09-29T02:10:47.792883] [INFO ] [MAIN ] APH: Generated 1820 derivative records from 54471 primary records. [2025-09-29T02:10:47.794152] [INFO ] [MAIN ] APG: Successfully saved derivative data. [2025-09-29T02:10:47.798127] [INFO ] [MAIN ] Derivative Progress: 118/2211 symbols completed. APG took 1.3s. Estimated remaining: 15m 2s. Rate: 139.2 symbols/min [2025-09-29T02:10:47.794409] [DEBUG] [LOCAL ] APH: Saving derivative data. [2025-09-29T02:10:47.817323] [DEBUG] [LOCAL ] APH: Derivative data saved (1820 records). [2025-09-29T02:10:47.817482] [INFO ] [MAIN ] APH: Successfully saved derivative data. [2025-09-29T02:10:47.819986] [INFO ] [MAIN ] Derivative Progress: 119/2211 symbols completed. APH took 1.3s. Estimated remaining: 14m 54s. Rate: 140.3 symbols/min [2025-09-29T02:10:47.836511] [DEBUG] [MAIN ] APLE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:47.837212] [INFO ] [MAIN ] APLE: Generated 1820 derivative records from 52769 primary records. [2025-09-29T02:10:47.837300] [DEBUG] [LOCAL ] APLE: Saving derivative data. [2025-09-29T02:10:47.853252] [DEBUG] [LOCAL ] APLE: Derivative data saved (1820 records). [2025-09-29T02:10:47.853356] [INFO ] [MAIN ] APLE: Successfully saved derivative data. [2025-09-29T02:10:47.856526] [INFO ] [MAIN ] Derivative Progress: 120/2211 symbols completed. APLE took 1.2s. Estimated remaining: 14m 47s. Rate: 141.4 symbols/min [2025-09-29T02:10:47.857145] [INFO ] [MAIN ] APTV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:47.857239] [INFO ] [MAIN ] APOS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:47.857098] [INFO ] [MAIN ] APO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:47.872584] [DEBUG] [LOCAL ] APOS: Loaded 7568 existing records from primary storage. [2025-09-29T02:10:47.872893] [INFO ] [MAIN ] APOS: Loaded 7568 primary data records. [2025-09-29T02:10:48.252151] [DEBUG] [LOCAL ] APTV: Loaded 52964 existing records from primary storage. [2025-09-29T02:10:48.252466] [INFO ] [MAIN ] APTV: Loaded 52964 primary data records. [2025-09-29T02:10:48.373270] [DEBUG] [LOCAL ] APO: Loaded 54162 existing records from primary storage. [2025-09-29T02:10:48.386128] [INFO ] [MAIN ] APO: Loaded 54162 primary data records. [2025-09-29T02:10:48.971506] [DEBUG] [MAIN ] APOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:48.973362] [INFO ] [MAIN ] APOS: Generated 1820 derivative records from 7568 primary records. [2025-09-29T02:10:48.974170] [DEBUG] [LOCAL ] APOS: Saving derivative data. [2025-09-29T02:10:48.996243] [DEBUG] [LOCAL ] APOS: Derivative data saved (1820 records). [2025-09-29T02:10:48.997797] [INFO ] [MAIN ] APOS: Successfully saved derivative data. [2025-09-29T02:10:49.000697] [INFO ] [MAIN ] Derivative Progress: 121/2211 symbols completed. APOS took 1.1s. Estimated remaining: 14m 59s. Rate: 139.5 symbols/min [2025-09-29T02:10:49.002002] [INFO ] [MAIN ] AQN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:49.020915] [DEBUG] [MAIN ] APTV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:49.022827] [INFO ] [MAIN ] APTV: Generated 1820 derivative records from 52964 primary records. [2025-09-29T02:10:49.023410] [DEBUG] [LOCAL ] APTV: Saving derivative data. [2025-09-29T02:10:49.048272] [DEBUG] [LOCAL ] APTV: Derivative data saved (1820 records). [2025-09-29T02:10:49.049949] [INFO ] [MAIN ] APTV: Successfully saved derivative data. [2025-09-29T02:10:49.052826] [INFO ] [MAIN ] Derivative Progress: 122/2211 symbols completed. APTV took 1.2s. Estimated remaining: 14m 52s. Rate: 140.5 symbols/min [2025-09-29T02:10:49.053392] [INFO ] [MAIN ] AQNB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:49.067460] [DEBUG] [MAIN ] APO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:49.069288] [INFO ] [MAIN ] APO: Generated 1820 derivative records from 54162 primary records. [2025-09-29T02:10:49.069448] [DEBUG] [LOCAL ] APO: Saving derivative data. [2025-09-29T02:10:49.090108] [DEBUG] [LOCAL ] AQNB: Loaded 4228 existing records from primary storage. [2025-09-29T02:10:49.105084] [INFO ] [MAIN ] AQNB: Loaded 4228 primary data records. [2025-09-29T02:10:49.247853] [DEBUG] [LOCAL ] AQN: Loaded 52684 existing records from primary storage. [2025-09-29T02:10:49.248725] [DEBUG] [LOCAL ] APO: Derivative data saved (1820 records). [2025-09-29T02:10:49.265059] [INFO ] [MAIN ] APO: Successfully saved derivative data. [2025-09-29T02:10:49.248144] [INFO ] [MAIN ] AQN: Loaded 52684 primary data records. [2025-09-29T02:10:49.273551] [INFO ] [MAIN ] Derivative Progress: 123/2211 symbols completed. APO took 1.4s. Estimated remaining: 14m 48s. Rate: 141.0 symbols/min [2025-09-29T02:10:49.331248] [INFO ] [MAIN ] AR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:49.922894] [DEBUG] [LOCAL ] AR: Loaded 54364 existing records from primary storage. [2025-09-29T02:10:49.921016] [DEBUG] [MAIN ] AQNB: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:10:49.924073] [INFO ] [MAIN ] AQNB: Generated 1819 derivative records from 4228 primary records. [2025-09-29T02:10:49.925567] [INFO ] [MAIN ] AR: Loaded 54364 primary data records. [2025-09-29T02:10:49.926157] [DEBUG] [LOCAL ] AQNB: Saving derivative data. [2025-09-29T02:10:49.970949] [DEBUG] [LOCAL ] AQNB: Derivative data saved (1819 records). [2025-09-29T02:10:49.978570] [INFO ] [MAIN ] AQNB: Successfully saved derivative data. [2025-09-29T02:10:50.012069] [INFO ] [MAIN ] Derivative Progress: 124/2211 symbols completed. AQNB took 1.0s. Estimated remaining: 14m 53s. Rate: 140.2 symbols/min [2025-09-29T02:10:50.026339] [INFO ] [MAIN ] ARCO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:50.309949] [DEBUG] [MAIN ] AQN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:50.312103] [INFO ] [MAIN ] AQN: Generated 1820 derivative records from 52684 primary records. [2025-09-29T02:10:50.312319] [DEBUG] [LOCAL ] AQN: Saving derivative data. [2025-09-29T02:10:50.343871] [DEBUG] [LOCAL ] AQN: Derivative data saved (1820 records). [2025-09-29T02:10:50.345172] [INFO ] [MAIN ] AQN: Successfully saved derivative data. [2025-09-29T02:10:50.348409] [INFO ] [MAIN ] Derivative Progress: 125/2211 symbols completed. AQN took 1.3s. Estimated remaining: 14m 51s. Rate: 140.4 symbols/min [2025-09-29T02:10:50.348709] [INFO ] [MAIN ] ARDC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:50.368379] [DEBUG] [LOCAL ] ARCO: Loaded 45249 existing records from primary storage. [2025-09-29T02:10:50.376114] [INFO ] [MAIN ] ARCO: Loaded 45249 primary data records. [2025-09-29T02:10:50.443812] [DEBUG] [MAIN ] AR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:50.508038] [DEBUG] [LOCAL ] ARDC: Loaded 14821 existing records from primary storage. [2025-09-29T02:10:50.491201] [INFO ] [MAIN ] AR: Generated 1820 derivative records from 54364 primary records. [2025-09-29T02:10:50.513004] [DEBUG] [LOCAL ] AR: Saving derivative data. [2025-09-29T02:10:50.513094] [INFO ] [MAIN ] ARDC: Loaded 14821 primary data records. [2025-09-29T02:10:50.836357] [DEBUG] [LOCAL ] AR: Derivative data saved (1820 records). [2025-09-29T02:10:50.869782] [INFO ] [MAIN ] AR: Successfully saved derivative data. [2025-09-29T02:10:50.879531] [INFO ] [MAIN ] Derivative Progress: 126/2211 symbols completed. AR took 1.5s. Estimated remaining: 14m 53s. Rate: 140.2 symbols/min [2025-09-29T02:10:50.891456] [INFO ] [MAIN ] ARDT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:51.145117] [DEBUG] [MAIN ] ARCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:51.146219] [DEBUG] [LOCAL ] ARDT: Loaded 28513 existing records from primary storage. [2025-09-29T02:10:51.146498] [INFO ] [MAIN ] ARDT: Loaded 28513 primary data records. [2025-09-29T02:10:51.153000] [INFO ] [MAIN ] ARCO: Generated 1820 derivative records from 45249 primary records. [2025-09-29T02:10:51.197347] [DEBUG] [LOCAL ] ARCO: Saving derivative data. [2025-09-29T02:10:51.297606] [DEBUG] [LOCAL ] ARCO: Derivative data saved (1820 records). [2025-09-29T02:10:51.319026] [DEBUG] [MAIN ] ARDC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:51.308368] [INFO ] [MAIN ] ARCO: Successfully saved derivative data. [2025-09-29T02:10:51.342103] [INFO ] [MAIN ] ARDC: Generated 1820 derivative records from 14821 primary records. [2025-09-29T02:10:51.363730] [INFO ] [MAIN ] Derivative Progress: 127/2211 symbols completed. ARCO took 1.3s. Estimated remaining: 14m 53s. Rate: 140.0 symbols/min [2025-09-29T02:10:51.363881] [DEBUG] [LOCAL ] ARDC: Saving derivative data. [2025-09-29T02:10:51.390055] [INFO ] [MAIN ] ARE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:51.573249] [DEBUG] [LOCAL ] ARDC: Derivative data saved (1820 records). [2025-09-29T02:10:51.573467] [INFO ] [MAIN ] ARDC: Successfully saved derivative data. [2025-09-29T02:10:51.576269] [INFO ] [MAIN ] Derivative Progress: 128/2211 symbols completed. ARDC took 1.2s. Estimated remaining: 14m 49s. Rate: 140.6 symbols/min [2025-09-29T02:10:51.576637] [INFO ] [MAIN ] ARES: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:51.622137] [DEBUG] [MAIN ] ARDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:51.623125] [INFO ] [MAIN ] ARDT: Generated 1820 derivative records from 28513 primary records. [2025-09-29T02:10:51.623234] [DEBUG] [LOCAL ] ARDT: Saving derivative data. [2025-09-29T02:10:51.641821] [DEBUG] [LOCAL ] ARDT: Derivative data saved (1820 records). [2025-09-29T02:10:51.668301] [INFO ] [MAIN ] ARDT: Successfully saved derivative data. [2025-09-29T02:10:51.670241] [DEBUG] [LOCAL ] ARE: Loaded 51319 existing records from primary storage. [2025-09-29T02:10:51.670604] [INFO ] [MAIN ] ARE: Loaded 51319 primary data records. [2025-09-29T02:10:51.673362] [INFO ] [MAIN ] Derivative Progress: 129/2211 symbols completed. ARDT took 0.8s. Estimated remaining: 14m 43s. Rate: 141.4 symbols/min [2025-09-29T02:10:51.673852] [INFO ] [MAIN ] ARI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:51.817413] [DEBUG] [LOCAL ] ARES: Loaded 50322 existing records from primary storage. [2025-09-29T02:10:51.828622] [INFO ] [MAIN ] ARES: Loaded 50322 primary data records. [2025-09-29T02:10:52.226993] [DEBUG] [LOCAL ] ARI: Loaded 44009 existing records from primary storage. [2025-09-29T02:10:52.248598] [INFO ] [MAIN ] ARI: Loaded 44009 primary data records. [2025-09-29T02:10:52.770528] [DEBUG] [MAIN ] ARE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:52.773438] [INFO ] [MAIN ] ARE: Generated 1820 derivative records from 51319 primary records. [2025-09-29T02:10:52.773913] [DEBUG] [LOCAL ] ARE: Saving derivative data. [2025-09-29T02:10:52.793448] [DEBUG] [MAIN ] ARES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:52.794473] [INFO ] [MAIN ] ARES: Generated 1820 derivative records from 50322 primary records. [2025-09-29T02:10:52.804302] [DEBUG] [LOCAL ] ARES: Saving derivative data. [2025-09-29T02:10:52.829509] [DEBUG] [LOCAL ] ARES: Derivative data saved (1820 records). [2025-09-29T02:10:52.831114] [INFO ] [MAIN ] ARES: Successfully saved derivative data. [2025-09-29T02:10:52.833991] [INFO ] [MAIN ] Derivative Progress: 130/2211 symbols completed. ARES took 1.3s. Estimated remaining: 14m 55s. Rate: 139.6 symbols/min [2025-09-29T02:10:52.835624] [INFO ] [MAIN ] ARIS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:52.836940] [DEBUG] [LOCAL ] ARE: Derivative data saved (1820 records). [2025-09-29T02:10:52.837213] [INFO ] [MAIN ] ARE: Successfully saved derivative data. [2025-09-29T02:10:52.841964] [INFO ] [MAIN ] Derivative Progress: 131/2211 symbols completed. ARE took 1.5s. Estimated remaining: 14m 48s. Rate: 140.6 symbols/min [2025-09-29T02:10:52.842292] [INFO ] [MAIN ] ARLO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:52.857450] [DEBUG] [MAIN ] ARI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:52.858356] [INFO ] [MAIN ] ARI: Generated 1820 derivative records from 44009 primary records. [2025-09-29T02:10:52.858591] [DEBUG] [LOCAL ] ARI: Saving derivative data. [2025-09-29T02:10:52.875232] [DEBUG] [LOCAL ] ARI: Derivative data saved (1820 records). [2025-09-29T02:10:52.875481] [INFO ] [MAIN ] ARI: Successfully saved derivative data. [2025-09-29T02:10:52.879198] [INFO ] [MAIN ] Derivative Progress: 132/2211 symbols completed. ARI took 1.2s. Estimated remaining: 14m 41s. Rate: 141.6 symbols/min [2025-09-29T02:10:52.879582] [INFO ] [MAIN ] ARMK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:52.943431] [DEBUG] [LOCAL ] ARLO: Loaded 44493 existing records from primary storage. [2025-09-29T02:10:52.944208] [DEBUG] [LOCAL ] ARIS: Loaded 42624 existing records from primary storage. [2025-09-29T02:10:52.944739] [INFO ] [MAIN ] ARIS: Loaded 42624 primary data records. [2025-09-29T02:10:52.944671] [INFO ] [MAIN ] ARLO: Loaded 44493 primary data records. [2025-09-29T02:10:53.312155] [DEBUG] [LOCAL ] ARMK: Loaded 51112 existing records from primary storage. [2025-09-29T02:10:53.353273] [INFO ] [MAIN ] ARMK: Loaded 51112 primary data records. [2025-09-29T02:10:54.078227] [DEBUG] [MAIN ] ARLO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:54.079912] [INFO ] [MAIN ] ARLO: Generated 1820 derivative records from 44493 primary records. [2025-09-29T02:10:54.082059] [DEBUG] [LOCAL ] ARLO: Saving derivative data. [2025-09-29T02:10:54.103490] [DEBUG] [LOCAL ] ARLO: Derivative data saved (1820 records). [2025-09-29T02:10:54.103871] [INFO ] [MAIN ] ARLO: Successfully saved derivative data. [2025-09-29T02:10:54.122358] [DEBUG] [MAIN ] ARIS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:54.127315] [INFO ] [MAIN ] ARIS: Generated 1820 derivative records from 42624 primary records. [2025-09-29T02:10:54.125207] [INFO ] [MAIN ] Derivative Progress: 133/2211 symbols completed. ARLO took 1.3s. Estimated remaining: 14m 53s. Rate: 139.6 symbols/min [2025-09-29T02:10:54.127786] [DEBUG] [LOCAL ] ARIS: Saving derivative data. [2025-09-29T02:10:54.150351] [DEBUG] [LOCAL ] ARIS: Derivative data saved (1820 records). [2025-09-29T02:10:54.150537] [INFO ] [MAIN ] ARIS: Successfully saved derivative data. [2025-09-29T02:10:54.153426] [INFO ] [MAIN ] Derivative Progress: 134/2211 symbols completed. ARIS took 1.3s. Estimated remaining: 14m 47s. Rate: 140.5 symbols/min [2025-09-29T02:10:54.166904] [DEBUG] [MAIN ] ARMK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:54.167732] [INFO ] [MAIN ] ARMK: Generated 1820 derivative records from 51112 primary records. [2025-09-29T02:10:54.167849] [DEBUG] [LOCAL ] ARMK: Saving derivative data. [2025-09-29T02:10:54.184024] [DEBUG] [LOCAL ] ARMK: Derivative data saved (1820 records). [2025-09-29T02:10:54.184139] [INFO ] [MAIN ] ARMK: Successfully saved derivative data. [2025-09-29T02:10:54.187381] [INFO ] [MAIN ] Derivative Progress: 135/2211 symbols completed. ARMK took 1.3s. Estimated remaining: 14m 40s. Rate: 141.5 symbols/min [2025-09-29T02:10:54.187988] [INFO ] [MAIN ] AROC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:54.188089] [INFO ] [MAIN ] ARW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:54.188162] [INFO ] [MAIN ] ARR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:54.260630] [DEBUG] [LOCAL ] ARW: Loaded 33660 existing records from primary storage. [2025-09-29T02:10:54.261190] [INFO ] [MAIN ] ARW: Loaded 33660 primary data records. [2025-09-29T02:10:54.427681] [DEBUG] [LOCAL ] AROC: Loaded 49733 existing records from primary storage. [2025-09-29T02:10:54.415615] [DEBUG] [LOCAL ] ARR: Loaded 52809 existing records from primary storage. [2025-09-29T02:10:54.433058] [INFO ] [MAIN ] AROC: Loaded 49733 primary data records. [2025-09-29T02:10:54.438480] [INFO ] [MAIN ] ARR: Loaded 52809 primary data records. [2025-09-29T02:10:55.342218] [DEBUG] [MAIN ] ARW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:55.344526] [INFO ] [MAIN ] ARW: Generated 1820 derivative records from 33660 primary records. [2025-09-29T02:10:55.344782] [DEBUG] [LOCAL ] ARW: Saving derivative data. [2025-09-29T02:10:55.367193] [DEBUG] [LOCAL ] ARW: Derivative data saved (1820 records). [2025-09-29T02:10:55.370417] [INFO ] [MAIN ] ARW: Successfully saved derivative data. [2025-09-29T02:10:55.373138] [INFO ] [MAIN ] Derivative Progress: 136/2211 symbols completed. ARW took 1.2s. Estimated remaining: 14m 51s. Rate: 139.7 symbols/min [2025-09-29T02:10:55.373549] [INFO ] [MAIN ] AS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:55.390129] [DEBUG] [MAIN ] AROC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:55.391935] [INFO ] [MAIN ] AROC: Generated 1820 derivative records from 49733 primary records. [2025-09-29T02:10:55.400065] [DEBUG] [LOCAL ] AROC: Saving derivative data. [2025-09-29T02:10:55.405725] [DEBUG] [MAIN ] ARR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:55.407229] [INFO ] [MAIN ] ARR: Generated 1820 derivative records from 52809 primary records. [2025-09-29T02:10:55.414759] [DEBUG] [LOCAL ] ARR: Saving derivative data. [2025-09-29T02:10:55.431551] [DEBUG] [LOCAL ] AROC: Derivative data saved (1820 records). [2025-09-29T02:10:55.435147] [INFO ] [MAIN ] AROC: Successfully saved derivative data. [2025-09-29T02:10:55.441060] [INFO ] [MAIN ] Derivative Progress: 137/2211 symbols completed. AROC took 1.3s. Estimated remaining: 14m 46s. Rate: 140.5 symbols/min [2025-09-29T02:10:55.442555] [DEBUG] [LOCAL ] ARR: Derivative data saved (1820 records). [2025-09-29T02:10:55.442750] [INFO ] [MAIN ] ASA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:55.443098] [INFO ] [MAIN ] ARR: Successfully saved derivative data. [2025-09-29T02:10:55.446576] [INFO ] [MAIN ] Derivative Progress: 138/2211 symbols completed. ARR took 1.3s. Estimated remaining: 14m 39s. Rate: 141.5 symbols/min [2025-09-29T02:10:55.447746] [INFO ] [MAIN ] ASAN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:55.502214] [DEBUG] [LOCAL ] ASA: Loaded 14109 existing records from primary storage. [2025-09-29T02:10:55.502494] [INFO ] [MAIN ] ASA: Loaded 14109 primary data records. [2025-09-29T02:10:55.503684] [DEBUG] [LOCAL ] AS: Loaded 53854 existing records from primary storage. [2025-09-29T02:10:55.509398] [INFO ] [MAIN ] AS: Loaded 53854 primary data records. [2025-09-29T02:10:55.887482] [DEBUG] [LOCAL ] ASAN: Loaded 53512 existing records from primary storage. [2025-09-29T02:10:55.965281] [INFO ] [MAIN ] ASAN: Loaded 53512 primary data records. [2025-09-29T02:10:56.713481] [DEBUG] [MAIN ] ASA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:56.715256] [INFO ] [MAIN ] ASA: Generated 1820 derivative records from 14109 primary records. [2025-09-29T02:10:56.713241] [DEBUG] [MAIN ] AS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:56.716502] [INFO ] [MAIN ] AS: Generated 1820 derivative records from 53854 primary records. [2025-09-29T02:10:56.722558] [DEBUG] [LOCAL ] AS: Saving derivative data. [2025-09-29T02:10:56.722712] [DEBUG] [LOCAL ] ASA: Saving derivative data. [2025-09-29T02:10:56.757109] [DEBUG] [LOCAL ] AS: Derivative data saved (1820 records). [2025-09-29T02:10:56.760255] [DEBUG] [LOCAL ] ASA: Derivative data saved (1820 records). [2025-09-29T02:10:56.760559] [INFO ] [MAIN ] AS: Successfully saved derivative data. [2025-09-29T02:10:56.764251] [INFO ] [MAIN ] Derivative Progress: 139/2211 symbols completed. AS took 1.4s. Estimated remaining: 14m 52s. Rate: 139.4 symbols/min [2025-09-29T02:10:56.760634] [INFO ] [MAIN ] ASA: Successfully saved derivative data. [2025-09-29T02:10:56.764936] [INFO ] [MAIN ] ASB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:56.767856] [INFO ] [MAIN ] Derivative Progress: 140/2211 symbols completed. ASA took 1.3s. Estimated remaining: 14m 45s. Rate: 140.4 symbols/min [2025-09-29T02:10:56.768201] [INFO ] [MAIN ] ASBA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:56.789569] [DEBUG] [LOCAL ] ASBA: Loaded 3458 existing records from primary storage. [2025-09-29T02:10:56.790342] [INFO ] [MAIN ] ASBA: Loaded 3458 primary data records. [2025-09-29T02:10:56.790222] [DEBUG] [MAIN ] ASAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:56.808182] [INFO ] [MAIN ] ASAN: Generated 1820 derivative records from 53512 primary records. [2025-09-29T02:10:56.829518] [DEBUG] [LOCAL ] ASAN: Saving derivative data. [2025-09-29T02:10:57.027704] [DEBUG] [LOCAL ] ASAN: Derivative data saved (1820 records). [2025-09-29T02:10:57.154589] [INFO ] [MAIN ] ASAN: Successfully saved derivative data. [2025-09-29T02:10:57.159242] [INFO ] [MAIN ] Derivative Progress: 141/2211 symbols completed. ASAN took 1.7s. Estimated remaining: 14m 44s. Rate: 140.5 symbols/min [2025-09-29T02:10:57.174750] [INFO ] [MAIN ] ASC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:57.176309] [DEBUG] [LOCAL ] ASB: Loaded 50299 existing records from primary storage. [2025-09-29T02:10:57.177018] [INFO ] [MAIN ] ASB: Loaded 50299 primary data records. [2025-09-29T02:10:57.540439] [DEBUG] [LOCAL ] ASC: Loaded 38153 existing records from primary storage. [2025-09-29T02:10:57.542069] [INFO ] [MAIN ] ASC: Loaded 38153 primary data records. [2025-09-29T02:10:57.606777] [DEBUG] [MAIN ] ASBA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:57.625453] [INFO ] [MAIN ] ASBA: Generated 1820 derivative records from 3458 primary records. [2025-09-29T02:10:57.664365] [DEBUG] [LOCAL ] ASBA: Saving derivative data. [2025-09-29T02:10:57.750160] [DEBUG] [LOCAL ] ASBA: Derivative data saved (1820 records). [2025-09-29T02:10:57.777901] [INFO ] [MAIN ] ASBA: Successfully saved derivative data. [2025-09-29T02:10:57.787747] [INFO ] [MAIN ] Derivative Progress: 142/2211 symbols completed. ASBA took 1.0s. Estimated remaining: 14m 47s. Rate: 140.0 symbols/min [2025-09-29T02:10:57.910883] [INFO ] [MAIN ] ASG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:57.931961] [DEBUG] [MAIN ] ASB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:57.934132] [INFO ] [MAIN ] ASB: Generated 1820 derivative records from 50299 primary records. [2025-09-29T02:10:57.934415] [DEBUG] [LOCAL ] ASB: Saving derivative data. [2025-09-29T02:10:57.958868] [DEBUG] [LOCAL ] ASB: Derivative data saved (1820 records). [2025-09-29T02:10:57.959265] [INFO ] [MAIN ] ASB: Successfully saved derivative data. [2025-09-29T02:10:57.961833] [INFO ] [MAIN ] Derivative Progress: 143/2211 symbols completed. ASB took 1.2s. Estimated remaining: 14m 42s. Rate: 140.6 symbols/min [2025-09-29T02:10:57.962247] [INFO ] [MAIN ] ASGI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:57.972983] [DEBUG] [LOCAL ] ASG: Loaded 20695 existing records from primary storage. [2025-09-29T02:10:57.973388] [INFO ] [MAIN ] ASG: Loaded 20695 primary data records. [2025-09-29T02:10:58.124822] [DEBUG] [MAIN ] ASC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:58.179841] [DEBUG] [LOCAL ] ASGI: Loaded 22711 existing records from primary storage. [2025-09-29T02:10:58.209933] [INFO ] [MAIN ] ASGI: Loaded 22711 primary data records. [2025-09-29T02:10:58.227695] [INFO ] [MAIN ] ASC: Generated 1820 derivative records from 38153 primary records. [2025-09-29T02:10:58.259352] [DEBUG] [LOCAL ] ASC: Saving derivative data. [2025-09-29T02:10:58.490989] [DEBUG] [LOCAL ] ASC: Derivative data saved (1820 records). [2025-09-29T02:10:58.514942] [INFO ] [MAIN ] ASC: Successfully saved derivative data. [2025-09-29T02:10:58.517798] [INFO ] [MAIN ] Derivative Progress: 144/2211 symbols completed. ASC took 1.3s. Estimated remaining: 14m 44s. Rate: 140.3 symbols/min [2025-09-29T02:10:58.528747] [INFO ] [MAIN ] ASGN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:58.773104] [DEBUG] [MAIN ] ASG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:58.774324] [INFO ] [MAIN ] ASG: Generated 1820 derivative records from 20695 primary records. [2025-09-29T02:10:58.776257] [DEBUG] [LOCAL ] ASG: Saving derivative data. [2025-09-29T02:10:58.812472] [DEBUG] [LOCAL ] ASG: Derivative data saved (1820 records). [2025-09-29T02:10:58.805388] [DEBUG] [LOCAL ] ASGN: Loaded 36554 existing records from primary storage. [2025-09-29T02:10:58.812682] [INFO ] [MAIN ] ASGN: Loaded 36554 primary data records. [2025-09-29T02:10:58.812879] [INFO ] [MAIN ] ASG: Successfully saved derivative data. [2025-09-29T02:10:58.815552] [INFO ] [MAIN ] Derivative Progress: 145/2211 symbols completed. ASG took 0.9s. Estimated remaining: 14m 42s. Rate: 140.6 symbols/min [2025-09-29T02:10:58.815890] [INFO ] [MAIN ] ASH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:58.877987] [DEBUG] [MAIN ] ASGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:58.901942] [INFO ] [MAIN ] ASGI: Generated 1820 derivative records from 22711 primary records. [2025-09-29T02:10:58.941839] [DEBUG] [LOCAL ] ASGI: Saving derivative data. [2025-09-29T02:10:59.198248] [DEBUG] [LOCAL ] ASGI: Derivative data saved (1820 records). [2025-09-29T02:10:59.199125] [INFO ] [MAIN ] ASGI: Successfully saved derivative data. [2025-09-29T02:10:59.202349] [INFO ] [MAIN ] Derivative Progress: 146/2211 symbols completed. ASGI took 1.2s. Estimated remaining: 14m 41s. Rate: 140.7 symbols/min [2025-09-29T02:10:59.204543] [INFO ] [MAIN ] ASIX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:59.222551] [DEBUG] [LOCAL ] ASH: Loaded 38339 existing records from primary storage. [2025-09-29T02:10:59.224001] [INFO ] [MAIN ] ASH: Loaded 38339 primary data records. [2025-09-29T02:10:59.410634] [DEBUG] [LOCAL ] ASIX: Loaded 22834 existing records from primary storage. [2025-09-29T02:10:59.446054] [INFO ] [MAIN ] ASIX: Loaded 22834 primary data records. [2025-09-29T02:10:59.725786] [DEBUG] [MAIN ] ASGN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:59.738145] [INFO ] [MAIN ] ASGN: Generated 1820 derivative records from 36554 primary records. [2025-09-29T02:10:59.759874] [DEBUG] [LOCAL ] ASGN: Saving derivative data. [2025-09-29T02:10:59.948620] [DEBUG] [LOCAL ] ASGN: Derivative data saved (1820 records). [2025-09-29T02:10:59.952150] [INFO ] [MAIN ] ASGN: Successfully saved derivative data. [2025-09-29T02:10:59.955402] [INFO ] [MAIN ] Derivative Progress: 147/2211 symbols completed. ASGN took 1.4s. Estimated remaining: 14m 45s. Rate: 140.0 symbols/min [2025-09-29T02:10:59.956234] [INFO ] [MAIN ] ASPN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:10:59.969865] [DEBUG] [MAIN ] ASH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:10:59.972697] [INFO ] [MAIN ] ASH: Generated 1820 derivative records from 38339 primary records. [2025-09-29T02:10:59.972912] [DEBUG] [LOCAL ] ASH: Saving derivative data. [2025-09-29T02:10:59.991139] [DEBUG] [LOCAL ] ASH: Derivative data saved (1820 records). [2025-09-29T02:10:59.991287] [INFO ] [MAIN ] ASH: Successfully saved derivative data. [2025-09-29T02:10:59.994234] [INFO ] [MAIN ] Derivative Progress: 148/2211 symbols completed. ASH took 1.2s. Estimated remaining: 14m 39s. Rate: 140.8 symbols/min [2025-09-29T02:11:00.011865] [DEBUG] [MAIN ] ASIX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:00.012623] [INFO ] [MAIN ] ASIX: Generated 1820 derivative records from 22834 primary records. [2025-09-29T02:11:00.012780] [DEBUG] [LOCAL ] ASIX: Saving derivative data. [2025-09-29T02:11:00.029965] [DEBUG] [LOCAL ] ASIX: Derivative data saved (1820 records). [2025-09-29T02:11:00.040891] [INFO ] [MAIN ] ASIX: Successfully saved derivative data. [2025-09-29T02:11:00.043904] [INFO ] [MAIN ] Derivative Progress: 149/2211 symbols completed. ASIX took 0.8s. Estimated remaining: 14m 33s. Rate: 141.7 symbols/min [2025-09-29T02:11:00.069296] [DEBUG] [LOCAL ] ASPN: Loaded 50293 existing records from primary storage. [2025-09-29T02:11:00.069478] [INFO ] [MAIN ] ASPN: Loaded 50293 primary data records. [2025-09-29T02:11:00.439146] [DEBUG] [MAIN ] ASPN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:00.439901] [INFO ] [MAIN ] ASPN: Generated 1820 derivative records from 50293 primary records. [2025-09-29T02:11:00.440020] [DEBUG] [LOCAL ] ASPN: Saving derivative data. [2025-09-29T02:11:00.455599] [DEBUG] [LOCAL ] ASPN: Derivative data saved (1820 records). [2025-09-29T02:11:00.455742] [INFO ] [MAIN ] ASPN: Successfully saved derivative data. [2025-09-29T02:11:00.458427] [INFO ] [MAIN ] Derivative Progress: 150/2211 symbols completed. ASPN took 0.5s. Estimated remaining: 14m 33s. Rate: 141.7 symbols/min [2025-09-29T02:11:00.459358] [INFO ] [MAIN ] ATEN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:00.459539] [INFO ] [MAIN ] ASX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:00.459207] [INFO ] [MAIN ] ASR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:00.475524] [DEBUG] [LOCAL ] ASR: Loaded 9381 existing records from primary storage. [2025-09-29T02:11:00.476010] [INFO ] [MAIN ] ASR: Loaded 9381 primary data records. [2025-09-29T02:11:00.848970] [DEBUG] [LOCAL ] ATEN: Loaded 40398 existing records from primary storage. [2025-09-29T02:11:00.865058] [INFO ] [MAIN ] ATEN: Loaded 40398 primary data records. [2025-09-29T02:11:00.866269] [DEBUG] [LOCAL ] ASX: Loaded 53639 existing records from primary storage. [2025-09-29T02:11:00.867692] [INFO ] [MAIN ] ASX: Loaded 53639 primary data records. [2025-09-29T02:11:01.555429] [DEBUG] [MAIN ] ASR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:01.557021] [INFO ] [MAIN ] ASR: Generated 1820 derivative records from 9381 primary records. [2025-09-29T02:11:01.557590] [DEBUG] [LOCAL ] ASR: Saving derivative data. [2025-09-29T02:11:01.579267] [DEBUG] [LOCAL ] ASR: Derivative data saved (1820 records). [2025-09-29T02:11:01.579892] [INFO ] [MAIN ] ASR: Successfully saved derivative data. [2025-09-29T02:11:01.583053] [INFO ] [MAIN ] Derivative Progress: 151/2211 symbols completed. ASR took 1.1s. Estimated remaining: 14m 42s. Rate: 140.2 symbols/min [2025-09-29T02:11:01.583875] [INFO ] [MAIN ] ATGE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:01.606989] [DEBUG] [MAIN ] ASX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:01.608905] [INFO ] [MAIN ] ASX: Generated 1820 derivative records from 53639 primary records. [2025-09-29T02:11:01.609218] [DEBUG] [LOCAL ] ASX: Saving derivative data. [2025-09-29T02:11:01.624552] [DEBUG] [MAIN ] ATEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:01.651524] [INFO ] [MAIN ] ATEN: Generated 1820 derivative records from 40398 primary records. [2025-09-29T02:11:01.653158] [DEBUG] [LOCAL ] ASX: Derivative data saved (1820 records). [2025-09-29T02:11:01.653482] [DEBUG] [LOCAL ] ATEN: Saving derivative data. [2025-09-29T02:11:01.653555] [INFO ] [MAIN ] ASX: Successfully saved derivative data. [2025-09-29T02:11:01.655931] [INFO ] [MAIN ] Derivative Progress: 152/2211 symbols completed. ASX took 1.2s. Estimated remaining: 14m 37s. Rate: 140.9 symbols/min [2025-09-29T02:11:01.656190] [INFO ] [MAIN ] ATHM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:01.688318] [DEBUG] [LOCAL ] ATGE: Loaded 32251 existing records from primary storage. [2025-09-29T02:11:01.691308] [INFO ] [MAIN ] ATGE: Loaded 32251 primary data records. [2025-09-29T02:11:01.690937] [DEBUG] [LOCAL ] ATEN: Derivative data saved (1820 records). [2025-09-29T02:11:01.696997] [INFO ] [MAIN ] ATEN: Successfully saved derivative data. [2025-09-29T02:11:01.708377] [INFO ] [MAIN ] Derivative Progress: 153/2211 symbols completed. ATEN took 1.2s. Estimated remaining: 14m 31s. Rate: 141.7 symbols/min [2025-09-29T02:11:01.758087] [INFO ] [MAIN ] ATHS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:01.869559] [DEBUG] [LOCAL ] ATHM: Loaded 33015 existing records from primary storage. [2025-09-29T02:11:01.898822] [INFO ] [MAIN ] ATHM: Loaded 33015 primary data records. [2025-09-29T02:11:01.999999] [DEBUG] [LOCAL ] ATHS: Loaded 7145 existing records from primary storage. [2025-09-29T02:11:02.152180] [INFO ] [MAIN ] ATHS: Loaded 7145 primary data records. [2025-09-29T02:11:02.829474] [DEBUG] [MAIN ] ATGE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:02.830543] [INFO ] [MAIN ] ATGE: Generated 1820 derivative records from 32251 primary records. [2025-09-29T02:11:02.831964] [DEBUG] [LOCAL ] ATGE: Saving derivative data. [2025-09-29T02:11:02.851921] [DEBUG] [LOCAL ] ATGE: Derivative data saved (1820 records). [2025-09-29T02:11:02.852361] [INFO ] [MAIN ] ATGE: Successfully saved derivative data. [2025-09-29T02:11:02.868142] [INFO ] [MAIN ] Derivative Progress: 154/2211 symbols completed. ATGE took 1.3s. Estimated remaining: 14m 41s. Rate: 140.2 symbols/min [2025-09-29T02:11:02.869039] [DEBUG] [MAIN ] ATHM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:02.869333] [INFO ] [MAIN ] ATI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:02.870105] [INFO ] [MAIN ] ATHM: Generated 1820 derivative records from 33015 primary records. [2025-09-29T02:11:02.870885] [DEBUG] [LOCAL ] ATHM: Saving derivative data. [2025-09-29T02:11:02.891328] [DEBUG] [LOCAL ] ATHM: Derivative data saved (1820 records). [2025-09-29T02:11:02.891680] [INFO ] [MAIN ] ATHM: Successfully saved derivative data. [2025-09-29T02:11:02.894023] [INFO ] [MAIN ] Derivative Progress: 155/2211 symbols completed. ATHM took 1.2s. Estimated remaining: 14m 35s. Rate: 141.0 symbols/min [2025-09-29T02:11:02.907735] [DEBUG] [MAIN ] ATHS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:02.908597] [INFO ] [MAIN ] ATHS: Generated 1820 derivative records from 7145 primary records. [2025-09-29T02:11:02.907207] [INFO ] [MAIN ] ATKR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:02.908752] [DEBUG] [LOCAL ] ATHS: Saving derivative data. [2025-09-29T02:11:02.927347] [DEBUG] [LOCAL ] ATHS: Derivative data saved (1820 records). [2025-09-29T02:11:02.927567] [INFO ] [MAIN ] ATHS: Successfully saved derivative data. [2025-09-29T02:11:02.930633] [INFO ] [MAIN ] Derivative Progress: 156/2211 symbols completed. ATHS took 1.2s. Estimated remaining: 14m 29s. Rate: 141.8 symbols/min [2025-09-29T02:11:02.930974] [INFO ] [MAIN ] ATMU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:02.983482] [DEBUG] [LOCAL ] ATI: Loaded 52283 existing records from primary storage. [2025-09-29T02:11:02.984483] [INFO ] [MAIN ] ATI: Loaded 52283 primary data records. [2025-09-29T02:11:03.104194] [DEBUG] [LOCAL ] ATKR: Loaded 36196 existing records from primary storage. [2025-09-29T02:11:03.126427] [INFO ] [MAIN ] ATKR: Loaded 36196 primary data records. [2025-09-29T02:11:03.314750] [DEBUG] [LOCAL ] ATMU: Loaded 40274 existing records from primary storage. [2025-09-29T02:11:03.448783] [INFO ] [MAIN ] ATMU: Loaded 40274 primary data records. [2025-09-29T02:11:04.086240] [DEBUG] [MAIN ] ATI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:04.087825] [INFO ] [MAIN ] ATI: Generated 1820 derivative records from 52283 primary records. [2025-09-29T02:11:04.088748] [DEBUG] [LOCAL ] ATI: Saving derivative data. [2025-09-29T02:11:04.128688] [DEBUG] [MAIN ] ATKR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:04.127987] [DEBUG] [LOCAL ] ATI: Derivative data saved (1820 records). [2025-09-29T02:11:04.129952] [INFO ] [MAIN ] ATKR: Generated 1820 derivative records from 36196 primary records. [2025-09-29T02:11:04.130298] [DEBUG] [LOCAL ] ATKR: Saving derivative data. [2025-09-29T02:11:04.130034] [INFO ] [MAIN ] ATI: Successfully saved derivative data. [2025-09-29T02:11:04.135003] [INFO ] [MAIN ] Derivative Progress: 157/2211 symbols completed. ATI took 1.3s. Estimated remaining: 14m 39s. Rate: 140.2 symbols/min [2025-09-29T02:11:04.135818] [INFO ] [MAIN ] ATO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:04.155197] [DEBUG] [LOCAL ] ATKR: Derivative data saved (1820 records). [2025-09-29T02:11:04.156363] [INFO ] [MAIN ] ATKR: Successfully saved derivative data. [2025-09-29T02:11:04.159316] [INFO ] [MAIN ] Derivative Progress: 158/2211 symbols completed. ATKR took 1.3s. Estimated remaining: 14m 33s. Rate: 141.0 symbols/min [2025-09-29T02:11:04.159601] [INFO ] [MAIN ] ATR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:04.174953] [DEBUG] [MAIN ] ATMU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:04.175884] [INFO ] [MAIN ] ATMU: Generated 1820 derivative records from 40274 primary records. [2025-09-29T02:11:04.176019] [DEBUG] [LOCAL ] ATMU: Saving derivative data. [2025-09-29T02:11:04.196026] [DEBUG] [LOCAL ] ATMU: Derivative data saved (1820 records). [2025-09-29T02:11:04.196195] [INFO ] [MAIN ] ATMU: Successfully saved derivative data. [2025-09-29T02:11:04.199419] [INFO ] [MAIN ] Derivative Progress: 159/2211 symbols completed. ATMU took 1.3s. Estimated remaining: 14m 28s. Rate: 141.8 symbols/min [2025-09-29T02:11:04.199769] [INFO ] [MAIN ] ATS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:04.242256] [DEBUG] [LOCAL ] ATO: Loaded 42489 existing records from primary storage. [2025-09-29T02:11:04.247861] [INFO ] [MAIN ] ATO: Loaded 42489 primary data records. [2025-09-29T02:11:04.263260] [DEBUG] [LOCAL ] ATR: Loaded 30839 existing records from primary storage. [2025-09-29T02:11:04.276524] [INFO ] [MAIN ] ATR: Loaded 30839 primary data records. [2025-09-29T02:11:04.343785] [DEBUG] [LOCAL ] ATS: Loaded 18145 existing records from primary storage. [2025-09-29T02:11:04.396413] [INFO ] [MAIN ] ATS: Loaded 18145 primary data records. [2025-09-29T02:11:05.403086] [DEBUG] [MAIN ] ATO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:05.417683] [DEBUG] [MAIN ] ATR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:05.418787] [INFO ] [MAIN ] ATO: Generated 1820 derivative records from 42489 primary records. [2025-09-29T02:11:05.419908] [INFO ] [MAIN ] ATR: Generated 1820 derivative records from 30839 primary records. [2025-09-29T02:11:05.419997] [DEBUG] [LOCAL ] ATO: Saving derivative data. [2025-09-29T02:11:05.420330] [DEBUG] [LOCAL ] ATR: Saving derivative data. [2025-09-29T02:11:05.462863] [DEBUG] [LOCAL ] ATO: Derivative data saved (1820 records). [2025-09-29T02:11:05.468705] [INFO ] [MAIN ] ATO: Successfully saved derivative data. [2025-09-29T02:11:05.471510] [INFO ] [MAIN ] Derivative Progress: 160/2211 symbols completed. ATO took 1.3s. Estimated remaining: 14m 38s. Rate: 140.1 symbols/min [2025-09-29T02:11:05.472036] [DEBUG] [MAIN ] ATS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:05.474365] [INFO ] [MAIN ] ATS: Generated 1820 derivative records from 18145 primary records. [2025-09-29T02:11:05.475031] [DEBUG] [LOCAL ] ATS: Saving derivative data. [2025-09-29T02:11:05.474581] [INFO ] [MAIN ] ATUS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:05.478485] [DEBUG] [LOCAL ] ATR: Derivative data saved (1820 records). [2025-09-29T02:11:05.479022] [INFO ] [MAIN ] ATR: Successfully saved derivative data. [2025-09-29T02:11:05.494188] [INFO ] [MAIN ] Derivative Progress: 161/2211 symbols completed. ATR took 1.3s. Estimated remaining: 14m 33s. Rate: 140.9 symbols/min [2025-09-29T02:11:05.497509] [INFO ] [MAIN ] AU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:05.498917] [DEBUG] [LOCAL ] ATS: Derivative data saved (1820 records). [2025-09-29T02:11:05.499451] [INFO ] [MAIN ] ATS: Successfully saved derivative data. [2025-09-29T02:11:05.502346] [INFO ] [MAIN ] Derivative Progress: 162/2211 symbols completed. ATS took 1.3s. Estimated remaining: 14m 27s. Rate: 141.8 symbols/min [2025-09-29T02:11:05.502742] [INFO ] [MAIN ] AUB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:05.570181] [DEBUG] [LOCAL ] ATUS: Loaded 49958 existing records from primary storage. [2025-09-29T02:11:05.570506] [INFO ] [MAIN ] ATUS: Loaded 49958 primary data records. [2025-09-29T02:11:05.689994] [DEBUG] [LOCAL ] AUB: Loaded 47072 existing records from primary storage. [2025-09-29T02:11:05.730202] [INFO ] [MAIN ] AUB: Loaded 47072 primary data records. [2025-09-29T02:11:05.750686] [DEBUG] [LOCAL ] AU: Loaded 53715 existing records from primary storage. [2025-09-29T02:11:05.834081] [INFO ] [MAIN ] AU: Loaded 53715 primary data records. [2025-09-29T02:11:06.660313] [DEBUG] [MAIN ] ATUS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:06.662709] [INFO ] [MAIN ] ATUS: Generated 1820 derivative records from 49958 primary records. [2025-09-29T02:11:06.663177] [DEBUG] [LOCAL ] ATUS: Saving derivative data. [2025-09-29T02:11:06.684795] [DEBUG] [LOCAL ] ATUS: Derivative data saved (1820 records). [2025-09-29T02:11:06.685344] [INFO ] [MAIN ] ATUS: Successfully saved derivative data. [2025-09-29T02:11:06.694502] [INFO ] [MAIN ] Derivative Progress: 163/2211 symbols completed. ATUS took 1.2s. Estimated remaining: 14m 36s. Rate: 140.2 symbols/min [2025-09-29T02:11:06.711828] [DEBUG] [MAIN ] AUB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:06.712844] [INFO ] [MAIN ] AUB: Generated 1820 derivative records from 47072 primary records. [2025-09-29T02:11:06.713112] [DEBUG] [LOCAL ] AUB: Saving derivative data. [2025-09-29T02:11:06.730367] [DEBUG] [LOCAL ] AUB: Derivative data saved (1820 records). [2025-09-29T02:11:06.731418] [INFO ] [MAIN ] AUB: Successfully saved derivative data. [2025-09-29T02:11:06.735919] [INFO ] [MAIN ] Derivative Progress: 164/2211 symbols completed. AUB took 1.2s. Estimated remaining: 14m 31s. Rate: 141.0 symbols/min [2025-09-29T02:11:06.750418] [DEBUG] [MAIN ] AU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:06.751101] [INFO ] [MAIN ] AU: Generated 1820 derivative records from 53715 primary records. [2025-09-29T02:11:06.751187] [DEBUG] [LOCAL ] AU: Saving derivative data. [2025-09-29T02:11:06.766914] [DEBUG] [LOCAL ] AU: Derivative data saved (1820 records). [2025-09-29T02:11:06.767009] [INFO ] [MAIN ] AU: Successfully saved derivative data. [2025-09-29T02:11:06.771058] [INFO ] [MAIN ] Derivative Progress: 165/2211 symbols completed. AU took 1.3s. Estimated remaining: 14m 26s. Rate: 141.8 symbols/min [2025-09-29T02:11:06.771749] [INFO ] [MAIN ] AVAL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:06.771610] [INFO ] [MAIN ] AUNA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:06.771824] [INFO ] [MAIN ] AVA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:06.782344] [DEBUG] [LOCAL ] AUNA: Loaded 4966 existing records from primary storage. [2025-09-29T02:11:06.782712] [INFO ] [MAIN ] AUNA: Loaded 4966 primary data records. [2025-09-29T02:11:06.855999] [DEBUG] [LOCAL ] AVAL: Loaded 9040 existing records from primary storage. [2025-09-29T02:11:06.873336] [INFO ] [MAIN ] AVAL: Loaded 9040 primary data records. [2025-09-29T02:11:07.364797] [DEBUG] [LOCAL ] AVA: Loaded 40183 existing records from primary storage. [2025-09-29T02:11:07.389214] [INFO ] [MAIN ] AVA: Loaded 40183 primary data records. [2025-09-29T02:11:07.886183] [DEBUG] [MAIN ] AUNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:07.888419] [INFO ] [MAIN ] AUNA: Generated 1820 derivative records from 4966 primary records. [2025-09-29T02:11:07.888821] [DEBUG] [LOCAL ] AUNA: Saving derivative data. [2025-09-29T02:11:07.910107] [DEBUG] [LOCAL ] AUNA: Derivative data saved (1820 records). [2025-09-29T02:11:07.910461] [INFO ] [MAIN ] AUNA: Successfully saved derivative data. [2025-09-29T02:11:07.921437] [INFO ] [MAIN ] Derivative Progress: 166/2211 symbols completed. AUNA took 1.1s. Estimated remaining: 14m 34s. Rate: 140.3 symbols/min [2025-09-29T02:11:07.927080] [DEBUG] [MAIN ] AVAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:07.927225] [INFO ] [MAIN ] AVB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:07.928290] [INFO ] [MAIN ] AVAL: Generated 1820 derivative records from 9040 primary records. [2025-09-29T02:11:07.928394] [DEBUG] [LOCAL ] AVAL: Saving derivative data. [2025-09-29T02:11:07.945285] [DEBUG] [LOCAL ] AVAL: Derivative data saved (1820 records). [2025-09-29T02:11:07.945854] [INFO ] [MAIN ] AVAL: Successfully saved derivative data. [2025-09-29T02:11:07.948664] [INFO ] [MAIN ] Derivative Progress: 167/2211 symbols completed. AVAL took 1.2s. Estimated remaining: 14m 29s. Rate: 141.1 symbols/min [2025-09-29T02:11:07.949126] [INFO ] [MAIN ] AVD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:07.967461] [DEBUG] [MAIN ] AVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:07.968345] [INFO ] [MAIN ] AVA: Generated 1820 derivative records from 40183 primary records. [2025-09-29T02:11:07.968553] [DEBUG] [LOCAL ] AVA: Saving derivative data. [2025-09-29T02:11:08.002281] [DEBUG] [LOCAL ] AVA: Derivative data saved (1820 records). [2025-09-29T02:11:08.002680] [INFO ] [MAIN ] AVA: Successfully saved derivative data. [2025-09-29T02:11:08.005859] [INFO ] [MAIN ] Derivative Progress: 168/2211 symbols completed. AVA took 1.2s. Estimated remaining: 14m 24s. Rate: 141.8 symbols/min [2025-09-29T02:11:08.006287] [INFO ] [MAIN ] AVK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:08.031081] [DEBUG] [LOCAL ] AVD: Loaded 23030 existing records from primary storage. [2025-09-29T02:11:08.032130] [DEBUG] [LOCAL ] AVB: Loaded 42457 existing records from primary storage. [2025-09-29T02:11:08.031294] [INFO ] [MAIN ] AVD: Loaded 23030 primary data records. [2025-09-29T02:11:08.032303] [INFO ] [MAIN ] AVB: Loaded 42457 primary data records. [2025-09-29T02:11:08.260243] [DEBUG] [LOCAL ] AVK: Loaded 18064 existing records from primary storage. [2025-09-29T02:11:08.299400] [INFO ] [MAIN ] AVK: Loaded 18064 primary data records. [2025-09-29T02:11:09.311952] [DEBUG] [MAIN ] AVB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:09.314562] [INFO ] [MAIN ] AVB: Generated 1820 derivative records from 42457 primary records. [2025-09-29T02:11:09.333327] [DEBUG] [MAIN ] AVD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:09.338350] [INFO ] [MAIN ] AVD: Generated 1820 derivative records from 23030 primary records. [2025-09-29T02:11:09.333065] [DEBUG] [LOCAL ] AVB: Saving derivative data. [2025-09-29T02:11:09.338757] [DEBUG] [LOCAL ] AVD: Saving derivative data. [2025-09-29T02:11:09.396298] [DEBUG] [LOCAL ] AVD: Derivative data saved (1820 records). [2025-09-29T02:11:09.396528] [INFO ] [MAIN ] AVD: Successfully saved derivative data. [2025-09-29T02:11:09.400814] [INFO ] [MAIN ] Derivative Progress: 169/2211 symbols completed. AVD took 1.5s. Estimated remaining: 14m 35s. Rate: 139.9 symbols/min [2025-09-29T02:11:09.393987] [DEBUG] [LOCAL ] AVB: Derivative data saved (1820 records). [2025-09-29T02:11:09.402995] [INFO ] [MAIN ] AVB: Successfully saved derivative data. [2025-09-29T02:11:09.403182] [INFO ] [MAIN ] AVNS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:09.407017] [INFO ] [MAIN ] Derivative Progress: 170/2211 symbols completed. AVB took 1.5s. Estimated remaining: 14m 30s. Rate: 140.8 symbols/min [2025-09-29T02:11:09.410697] [INFO ] [MAIN ] AVNT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:09.435072] [DEBUG] [MAIN ] AVK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:09.436366] [INFO ] [MAIN ] AVK: Generated 1820 derivative records from 18064 primary records. [2025-09-29T02:11:09.436507] [DEBUG] [LOCAL ] AVK: Saving derivative data. [2025-09-29T02:11:09.468055] [DEBUG] [LOCAL ] AVK: Derivative data saved (1820 records). [2025-09-29T02:11:09.468594] [INFO ] [MAIN ] AVK: Successfully saved derivative data. [2025-09-29T02:11:09.471769] [INFO ] [MAIN ] Derivative Progress: 171/2211 symbols completed. AVK took 1.5s. Estimated remaining: 14m 25s. Rate: 141.5 symbols/min [2025-09-29T02:11:09.472390] [INFO ] [MAIN ] AVTR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:09.519970] [DEBUG] [LOCAL ] AVNS: Loaded 34132 existing records from primary storage. [2025-09-29T02:11:09.520329] [INFO ] [MAIN ] AVNS: Loaded 34132 primary data records. [2025-09-29T02:11:09.651177] [DEBUG] [LOCAL ] AVNT: Loaded 39887 existing records from primary storage. [2025-09-29T02:11:09.679521] [INFO ] [MAIN ] AVNT: Loaded 39887 primary data records. [2025-09-29T02:11:09.942725] [DEBUG] [LOCAL ] AVTR: Loaded 54345 existing records from primary storage. [2025-09-29T02:11:10.114909] [INFO ] [MAIN ] AVTR: Loaded 54345 primary data records. [2025-09-29T02:11:10.713129] [DEBUG] [MAIN ] AVNS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:10.715251] [INFO ] [MAIN ] AVNS: Generated 1820 derivative records from 34132 primary records. [2025-09-29T02:11:10.716118] [DEBUG] [LOCAL ] AVNS: Saving derivative data. [2025-09-29T02:11:10.739587] [DEBUG] [LOCAL ] AVNS: Derivative data saved (1820 records). [2025-09-29T02:11:10.740131] [INFO ] [MAIN ] AVNS: Successfully saved derivative data. [2025-09-29T02:11:10.751309] [INFO ] [MAIN ] Derivative Progress: 172/2211 symbols completed. AVNS took 1.3s. Estimated remaining: 14m 35s. Rate: 139.8 symbols/min [2025-09-29T02:11:10.757254] [DEBUG] [MAIN ] AVNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:10.757529] [INFO ] [MAIN ] AVY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:10.758801] [INFO ] [MAIN ] AVNT: Generated 1820 derivative records from 39887 primary records. [2025-09-29T02:11:10.759616] [DEBUG] [LOCAL ] AVNT: Saving derivative data. [2025-09-29T02:11:10.801830] [DEBUG] [MAIN ] AVTR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:10.803720] [INFO ] [MAIN ] AVTR: Generated 1820 derivative records from 54345 primary records. [2025-09-29T02:11:10.805061] [DEBUG] [LOCAL ] AVTR: Saving derivative data. [2025-09-29T02:11:10.804854] [DEBUG] [LOCAL ] AVNT: Derivative data saved (1820 records). [2025-09-29T02:11:10.805666] [INFO ] [MAIN ] AVNT: Successfully saved derivative data. [2025-09-29T02:11:10.809164] [INFO ] [MAIN ] Derivative Progress: 173/2211 symbols completed. AVNT took 1.4s. Estimated remaining: 14m 30s. Rate: 140.5 symbols/min [2025-09-29T02:11:10.809730] [INFO ] [MAIN ] AWF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:10.838228] [DEBUG] [LOCAL ] AVTR: Derivative data saved (1820 records). [2025-09-29T02:11:10.838528] [INFO ] [MAIN ] AVTR: Successfully saved derivative data. [2025-09-29T02:11:10.842011] [INFO ] [MAIN ] Derivative Progress: 174/2211 symbols completed. AVTR took 1.4s. Estimated remaining: 14m 25s. Rate: 141.3 symbols/min [2025-09-29T02:11:10.842325] [INFO ] [MAIN ] AWI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:10.873007] [DEBUG] [LOCAL ] AWF: Loaded 24608 existing records from primary storage. [2025-09-29T02:11:10.874497] [INFO ] [MAIN ] AWF: Loaded 24608 primary data records. [2025-09-29T02:11:10.874310] [DEBUG] [LOCAL ] AVY: Loaded 38102 existing records from primary storage. [2025-09-29T02:11:10.886762] [INFO ] [MAIN ] AVY: Loaded 38102 primary data records. [2025-09-29T02:11:11.138186] [DEBUG] [LOCAL ] AWI: Loaded 26185 existing records from primary storage. [2025-09-29T02:11:11.236516] [INFO ] [MAIN ] AWI: Loaded 26185 primary data records. [2025-09-29T02:11:11.979346] [DEBUG] [MAIN ] AWF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:11.981214] [INFO ] [MAIN ] AWF: Generated 1820 derivative records from 24608 primary records. [2025-09-29T02:11:11.981744] [DEBUG] [LOCAL ] AWF: Saving derivative data. [2025-09-29T02:11:12.015546] [DEBUG] [MAIN ] AVY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:12.017818] [INFO ] [MAIN ] AVY: Generated 1820 derivative records from 38102 primary records. [2025-09-29T02:11:12.018224] [DEBUG] [LOCAL ] AVY: Saving derivative data. [2025-09-29T02:11:12.028375] [DEBUG] [LOCAL ] AWF: Derivative data saved (1820 records). [2025-09-29T02:11:12.034513] [INFO ] [MAIN ] AWF: Successfully saved derivative data. [2025-09-29T02:11:12.038126] [INFO ] [MAIN ] Derivative Progress: 175/2211 symbols completed. AWF took 1.2s. Estimated remaining: 14m 34s. Rate: 139.8 symbols/min [2025-09-29T02:11:12.038366] [INFO ] [MAIN ] AWK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:12.041187] [DEBUG] [LOCAL ] AVY: Derivative data saved (1820 records). [2025-09-29T02:11:12.041558] [INFO ] [MAIN ] AVY: Successfully saved derivative data. [2025-09-29T02:11:12.044806] [INFO ] [MAIN ] Derivative Progress: 176/2211 symbols completed. AVY took 1.3s. Estimated remaining: 14m 28s. Rate: 140.6 symbols/min [2025-09-29T02:11:12.045512] [INFO ] [MAIN ] AWP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:12.064238] [DEBUG] [MAIN ] AWI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:12.065269] [INFO ] [MAIN ] AWI: Generated 1820 derivative records from 26185 primary records. [2025-09-29T02:11:12.065517] [DEBUG] [LOCAL ] AWI: Saving derivative data. [2025-09-29T02:11:12.089430] [DEBUG] [LOCAL ] AWI: Derivative data saved (1820 records). [2025-09-29T02:11:12.089676] [INFO ] [MAIN ] AWI: Successfully saved derivative data. [2025-09-29T02:11:12.092614] [INFO ] [MAIN ] Derivative Progress: 177/2211 symbols completed. AWI took 1.3s. Estimated remaining: 14m 24s. Rate: 141.3 symbols/min [2025-09-29T02:11:12.100335] [INFO ] [MAIN ] AWR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:12.102360] [DEBUG] [LOCAL ] AWP: Loaded 21835 existing records from primary storage. [2025-09-29T02:11:12.102911] [INFO ] [MAIN ] AWP: Loaded 21835 primary data records. [2025-09-29T02:11:12.319441] [DEBUG] [LOCAL ] AWR: Loaded 22993 existing records from primary storage. [2025-09-29T02:11:12.320924] [DEBUG] [LOCAL ] AWK: Loaded 49489 existing records from primary storage. [2025-09-29T02:11:12.348971] [INFO ] [MAIN ] AWK: Loaded 49489 primary data records. [2025-09-29T02:11:12.349127] [INFO ] [MAIN ] AWR: Loaded 22993 primary data records. [2025-09-29T02:11:13.200785] [DEBUG] [MAIN ] AWP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:13.203345] [INFO ] [MAIN ] AWP: Generated 1820 derivative records from 21835 primary records. [2025-09-29T02:11:13.203742] [DEBUG] [LOCAL ] AWP: Saving derivative data. [2025-09-29T02:11:13.227777] [DEBUG] [LOCAL ] AWP: Derivative data saved (1820 records). [2025-09-29T02:11:13.229393] [INFO ] [MAIN ] AWP: Successfully saved derivative data. [2025-09-29T02:11:13.232294] [INFO ] [MAIN ] Derivative Progress: 178/2211 symbols completed. AWP took 1.2s. Estimated remaining: 14m 31s. Rate: 140.0 symbols/min [2025-09-29T02:11:13.247757] [DEBUG] [MAIN ] AWK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:13.248837] [INFO ] [MAIN ] AWK: Generated 1820 derivative records from 49489 primary records. [2025-09-29T02:11:13.250806] [DEBUG] [LOCAL ] AWK: Saving derivative data. [2025-09-29T02:11:13.279463] [DEBUG] [MAIN ] AWR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:13.281585] [INFO ] [MAIN ] AWR: Generated 1820 derivative records from 22993 primary records. [2025-09-29T02:11:13.282713] [DEBUG] [LOCAL ] AWR: Saving derivative data. [2025-09-29T02:11:13.284135] [DEBUG] [LOCAL ] AWK: Derivative data saved (1820 records). [2025-09-29T02:11:13.285354] [INFO ] [MAIN ] AWK: Successfully saved derivative data. [2025-09-29T02:11:13.288707] [INFO ] [MAIN ] Derivative Progress: 179/2211 symbols completed. AWK took 1.3s. Estimated remaining: 14m 27s. Rate: 140.7 symbols/min [2025-09-29T02:11:13.304665] [DEBUG] [LOCAL ] AWR: Derivative data saved (1820 records). [2025-09-29T02:11:13.304813] [INFO ] [MAIN ] AWR: Successfully saved derivative data. [2025-09-29T02:11:13.307981] [INFO ] [MAIN ] Derivative Progress: 180/2211 symbols completed. AWR took 1.2s. Estimated remaining: 14m 22s. Rate: 141.4 symbols/min [2025-09-29T02:11:13.308483] [INFO ] [MAIN ] AX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:13.308688] [INFO ] [MAIN ] AXP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:13.308849] [INFO ] [MAIN ] AXL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:13.362484] [DEBUG] [LOCAL ] AX: Loaded 28929 existing records from primary storage. [2025-09-29T02:11:13.362753] [INFO ] [MAIN ] AX: Loaded 28929 primary data records. [2025-09-29T02:11:13.493937] [DEBUG] [LOCAL ] AXL: Loaded 51239 existing records from primary storage. [2025-09-29T02:11:13.508125] [INFO ] [MAIN ] AXL: Loaded 51239 primary data records. [2025-09-29T02:11:13.858611] [DEBUG] [LOCAL ] AXP: Loaded 53999 existing records from primary storage. [2025-09-29T02:11:13.885092] [INFO ] [MAIN ] AXP: Loaded 53999 primary data records. [2025-09-29T02:11:14.485571] [DEBUG] [MAIN ] AX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:14.488678] [INFO ] [MAIN ] AX: Generated 1820 derivative records from 28929 primary records. [2025-09-29T02:11:14.490192] [DEBUG] [LOCAL ] AX: Saving derivative data. [2025-09-29T02:11:14.515195] [DEBUG] [LOCAL ] AX: Derivative data saved (1820 records). [2025-09-29T02:11:14.515482] [INFO ] [MAIN ] AX: Successfully saved derivative data. [2025-09-29T02:11:14.518886] [INFO ] [MAIN ] Derivative Progress: 181/2211 symbols completed. AX took 1.2s. Estimated remaining: 14m 30s. Rate: 140.0 symbols/min [2025-09-29T02:11:14.527701] [INFO ] [MAIN ] AXR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:14.535565] [DEBUG] [MAIN ] AXL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:14.538016] [INFO ] [MAIN ] AXL: Generated 1820 derivative records from 51239 primary records. [2025-09-29T02:11:14.539825] [DEBUG] [LOCAL ] AXL: Saving derivative data. [2025-09-29T02:11:14.544098] [DEBUG] [LOCAL ] AXR: Loaded 3220 existing records from primary storage. [2025-09-29T02:11:14.544548] [INFO ] [MAIN ] AXR: Loaded 3220 primary data records. [2025-09-29T02:11:14.615764] [DEBUG] [LOCAL ] AXL: Derivative data saved (1820 records). [2025-09-29T02:11:14.649800] [INFO ] [MAIN ] AXL: Successfully saved derivative data. [2025-09-29T02:11:14.659187] [INFO ] [MAIN ] Derivative Progress: 182/2211 symbols completed. AXL took 1.4s. Estimated remaining: 14m 26s. Rate: 140.5 symbols/min [2025-09-29T02:11:14.659505] [INFO ] [MAIN ] AXS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:14.650270] [DEBUG] [MAIN ] AXP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:14.689733] [INFO ] [MAIN ] AXP: Generated 1820 derivative records from 53999 primary records. [2025-09-29T02:11:14.703673] [DEBUG] [LOCAL ] AXP: Saving derivative data. [2025-09-29T02:11:14.924384] [DEBUG] [LOCAL ] AXP: Derivative data saved (1820 records). [2025-09-29T02:11:14.936124] [INFO ] [MAIN ] AXP: Successfully saved derivative data. [2025-09-29T02:11:14.939788] [INFO ] [MAIN ] Derivative Progress: 183/2211 symbols completed. AXP took 1.6s. Estimated remaining: 14m 24s. Rate: 140.8 symbols/min [2025-09-29T02:11:14.940384] [INFO ] [MAIN ] AXTA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:14.977336] [DEBUG] [LOCAL ] AXS: Loaded 38920 existing records from primary storage. [2025-09-29T02:11:14.978314] [INFO ] [MAIN ] AXS: Loaded 38920 primary data records. [2025-09-29T02:11:15.220610] [DEBUG] [MAIN ] AXR: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-09-29T02:11:15.357439] [INFO ] [MAIN ] AXR: Generated 1818 derivative records from 3220 primary records. [2025-09-29T02:11:15.367946] [DEBUG] [LOCAL ] AXR: Saving derivative data. [2025-09-29T02:11:15.369389] [DEBUG] [LOCAL ] AXTA: Loaded 52835 existing records from primary storage. [2025-09-29T02:11:15.369905] [INFO ] [MAIN ] AXTA: Loaded 52835 primary data records. [2025-09-29T02:11:15.475006] [DEBUG] [LOCAL ] AXR: Derivative data saved (1818 records). [2025-09-29T02:11:15.499059] [INFO ] [MAIN ] AXR: Successfully saved derivative data. [2025-09-29T02:11:15.501940] [INFO ] [MAIN ] Derivative Progress: 184/2211 symbols completed. AXR took 1.0s. Estimated remaining: 14m 25s. Rate: 140.5 symbols/min [2025-09-29T02:11:15.508059] [INFO ] [MAIN ] AYI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:15.746527] [DEBUG] [MAIN ] AXS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:15.747529] [INFO ] [MAIN ] AXS: Generated 1820 derivative records from 38920 primary records. [2025-09-29T02:11:15.749261] [DEBUG] [LOCAL ] AXS: Saving derivative data. [2025-09-29T02:11:15.760990] [DEBUG] [LOCAL ] AYI: Loaded 25446 existing records from primary storage. [2025-09-29T02:11:15.772344] [INFO ] [MAIN ] AYI: Loaded 25446 primary data records. [2025-09-29T02:11:15.799255] [DEBUG] [LOCAL ] AXS: Derivative data saved (1820 records). [2025-09-29T02:11:15.824834] [INFO ] [MAIN ] AXS: Successfully saved derivative data. [2025-09-29T02:11:15.849477] [INFO ] [MAIN ] Derivative Progress: 185/2211 symbols completed. AXS took 1.2s. Estimated remaining: 14m 24s. Rate: 140.7 symbols/min [2025-09-29T02:11:15.880928] [INFO ] [MAIN ] AZO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:16.154212] [DEBUG] [LOCAL ] AZO: Loaded 11687 existing records from primary storage. [2025-09-29T02:11:16.162508] [INFO ] [MAIN ] AZO: Loaded 11687 primary data records. [2025-09-29T02:11:16.194094] [DEBUG] [MAIN ] AXTA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:16.220012] [INFO ] [MAIN ] AXTA: Generated 1820 derivative records from 52835 primary records. [2025-09-29T02:11:16.220442] [DEBUG] [LOCAL ] AXTA: Saving derivative data. [2025-09-29T02:11:16.323574] [DEBUG] [LOCAL ] AXTA: Derivative data saved (1820 records). [2025-09-29T02:11:16.355902] [INFO ] [MAIN ] AXTA: Successfully saved derivative data. [2025-09-29T02:11:16.371848] [INFO ] [MAIN ] Derivative Progress: 186/2211 symbols completed. AXTA took 1.4s. Estimated remaining: 14m 25s. Rate: 140.5 symbols/min [2025-09-29T02:11:16.442310] [INFO ] [MAIN ] AZZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:16.564145] [DEBUG] [MAIN ] AYI: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:11:16.565625] [INFO ] [MAIN ] AYI: Generated 1819 derivative records from 25446 primary records. [2025-09-29T02:11:16.565773] [DEBUG] [LOCAL ] AYI: Saving derivative data. [2025-09-29T02:11:16.599372] [DEBUG] [LOCAL ] AYI: Derivative data saved (1819 records). [2025-09-29T02:11:16.600638] [DEBUG] [LOCAL ] AZZ: Loaded 22359 existing records from primary storage. [2025-09-29T02:11:16.601244] [INFO ] [MAIN ] AZZ: Loaded 22359 primary data records. [2025-09-29T02:11:16.601516] [INFO ] [MAIN ] AYI: Successfully saved derivative data. [2025-09-29T02:11:16.632573] [INFO ] [MAIN ] Derivative Progress: 187/2211 symbols completed. AYI took 1.1s. Estimated remaining: 14m 23s. Rate: 140.8 symbols/min [2025-09-29T02:11:16.646564] [INFO ] [MAIN ] BA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:16.770352] [DEBUG] [MAIN ] AZO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:16.834141] [INFO ] [MAIN ] AZO: Generated 1820 derivative records from 11687 primary records. [2025-09-29T02:11:16.973594] [DEBUG] [LOCAL ] AZO: Saving derivative data. [2025-09-29T02:11:17.010379] [DEBUG] [LOCAL ] AZO: Derivative data saved (1820 records). [2025-09-29T02:11:17.011369] [INFO ] [MAIN ] AZO: Successfully saved derivative data. [2025-09-29T02:11:17.014105] [INFO ] [MAIN ] Derivative Progress: 188/2211 symbols completed. AZO took 1.1s. Estimated remaining: 14m 22s. Rate: 140.9 symbols/min [2025-09-29T02:11:17.014425] [INFO ] [MAIN ] BABA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:17.038133] [DEBUG] [LOCAL ] BA: Loaded 54571 existing records from primary storage. [2025-09-29T02:11:17.038949] [INFO ] [MAIN ] BA: Loaded 54571 primary data records. [2025-09-29T02:11:17.400741] [DEBUG] [MAIN ] AZZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:17.432124] [INFO ] [MAIN ] AZZ: Generated 1820 derivative records from 22359 primary records. [2025-09-29T02:11:17.434914] [DEBUG] [LOCAL ] AZZ: Saving derivative data. [2025-09-29T02:11:17.436134] [DEBUG] [LOCAL ] BABA: Loaded 54600 existing records from primary storage. [2025-09-29T02:11:17.437927] [INFO ] [MAIN ] BABA: Loaded 54600 primary data records. [2025-09-29T02:11:17.541391] [DEBUG] [LOCAL ] AZZ: Derivative data saved (1820 records). [2025-09-29T02:11:17.550981] [INFO ] [MAIN ] AZZ: Successfully saved derivative data. [2025-09-29T02:11:17.587043] [INFO ] [MAIN ] Derivative Progress: 189/2211 symbols completed. AZZ took 1.1s. Estimated remaining: 14m 23s. Rate: 140.6 symbols/min [2025-09-29T02:11:17.593969] [INFO ] [MAIN ] BAC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:17.829960] [DEBUG] [MAIN ] BA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:17.831726] [INFO ] [MAIN ] BA: Generated 1820 derivative records from 54571 primary records. [2025-09-29T02:11:17.832078] [DEBUG] [LOCAL ] BA: Saving derivative data. [2025-09-29T02:11:17.852232] [DEBUG] [LOCAL ] BA: Derivative data saved (1820 records). [2025-09-29T02:11:17.853469] [INFO ] [MAIN ] BA: Successfully saved derivative data. [2025-09-29T02:11:17.857380] [INFO ] [MAIN ] Derivative Progress: 190/2211 symbols completed. BA took 1.2s. Estimated remaining: 14m 21s. Rate: 140.9 symbols/min [2025-09-29T02:11:17.878183] [INFO ] [MAIN ] BAH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:17.922278] [DEBUG] [MAIN ] BABA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:17.924501] [DEBUG] [LOCAL ] BAC: Loaded 54588 existing records from primary storage. [2025-09-29T02:11:17.926368] [INFO ] [MAIN ] BAC: Loaded 54588 primary data records. [2025-09-29T02:11:17.926124] [INFO ] [MAIN ] BABA: Generated 1820 derivative records from 54600 primary records. [2025-09-29T02:11:17.926768] [DEBUG] [LOCAL ] BABA: Saving derivative data. [2025-09-29T02:11:18.076013] [DEBUG] [LOCAL ] BABA: Derivative data saved (1820 records). [2025-09-29T02:11:18.112220] [INFO ] [MAIN ] BABA: Successfully saved derivative data. [2025-09-29T02:11:18.175037] [INFO ] [MAIN ] Derivative Progress: 191/2211 symbols completed. BABA took 1.2s. Estimated remaining: 14m 19s. Rate: 141.1 symbols/min [2025-09-29T02:11:18.252147] [INFO ] [MAIN ] BAK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:18.367107] [DEBUG] [LOCAL ] BAH: Loaded 52477 existing records from primary storage. [2025-09-29T02:11:18.368015] [INFO ] [MAIN ] BAH: Loaded 52477 primary data records. [2025-09-29T02:11:18.733884] [DEBUG] [LOCAL ] BAK: Loaded 39413 existing records from primary storage. [2025-09-29T02:11:18.734378] [INFO ] [MAIN ] BAK: Loaded 39413 primary data records. [2025-09-29T02:11:18.994634] [DEBUG] [MAIN ] BAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:19.089689] [INFO ] [MAIN ] BAC: Generated 1820 derivative records from 54588 primary records. [2025-09-29T02:11:19.090038] [DEBUG] [LOCAL ] BAC: Saving derivative data. [2025-09-29T02:11:19.111329] [DEBUG] [LOCAL ] BAC: Derivative data saved (1820 records). [2025-09-29T02:11:19.112492] [INFO ] [MAIN ] BAC: Successfully saved derivative data. [2025-09-29T02:11:19.115374] [INFO ] [MAIN ] Derivative Progress: 192/2211 symbols completed. BAC took 1.5s. Estimated remaining: 14m 24s. Rate: 140.2 symbols/min [2025-09-29T02:11:19.115602] [INFO ] [MAIN ] BALL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:19.135941] [DEBUG] [MAIN ] BAH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:19.141213] [INFO ] [MAIN ] BAH: Generated 1820 derivative records from 52477 primary records. [2025-09-29T02:11:19.141878] [DEBUG] [LOCAL ] BAH: Saving derivative data. [2025-09-29T02:11:19.162171] [DEBUG] [LOCAL ] BAH: Derivative data saved (1820 records). [2025-09-29T02:11:19.165770] [INFO ] [MAIN ] BAH: Successfully saved derivative data. [2025-09-29T02:11:19.169874] [INFO ] [MAIN ] Derivative Progress: 193/2211 symbols completed. BAH took 1.3s. Estimated remaining: 14m 20s. Rate: 140.8 symbols/min [2025-09-29T02:11:19.183792] [DEBUG] [MAIN ] BAK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:19.184851] [INFO ] [MAIN ] BAK: Generated 1820 derivative records from 39413 primary records. [2025-09-29T02:11:19.184946] [DEBUG] [LOCAL ] BAK: Saving derivative data. [2025-09-29T02:11:19.216998] [DEBUG] [LOCAL ] BAK: Derivative data saved (1820 records). [2025-09-29T02:11:19.217159] [INFO ] [MAIN ] BAK: Successfully saved derivative data. [2025-09-29T02:11:19.220689] [INFO ] [MAIN ] Derivative Progress: 194/2211 symbols completed. BAK took 1.0s. Estimated remaining: 14m 15s. Rate: 141.5 symbols/min [2025-09-29T02:11:19.244469] [DEBUG] [LOCAL ] BALL: Loaded 52583 existing records from primary storage. [2025-09-29T02:11:19.244709] [INFO ] [MAIN ] BALL: Loaded 52583 primary data records. [2025-09-29T02:11:19.583203] [DEBUG] [MAIN ] BALL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:19.584021] [INFO ] [MAIN ] BALL: Generated 1820 derivative records from 52583 primary records. [2025-09-29T02:11:19.584112] [DEBUG] [LOCAL ] BALL: Saving derivative data. [2025-09-29T02:11:19.600318] [DEBUG] [LOCAL ] BALL: Derivative data saved (1820 records). [2025-09-29T02:11:19.600421] [INFO ] [MAIN ] BALL: Successfully saved derivative data. [2025-09-29T02:11:19.603155] [INFO ] [MAIN ] Derivative Progress: 195/2211 symbols completed. BALL took 0.5s. Estimated remaining: 14m 15s. Rate: 141.5 symbols/min [2025-09-29T02:11:19.603940] [INFO ] [MAIN ] BAP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:19.604115] [INFO ] [MAIN ] BANC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:19.603801] [INFO ] [MAIN ] BAM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:19.638285] [DEBUG] [LOCAL ] BAP: Loaded 26635 existing records from primary storage. [2025-09-29T02:11:19.638453] [INFO ] [MAIN ] BAP: Loaded 26635 primary data records. [2025-09-29T02:11:19.903425] [DEBUG] [LOCAL ] BANC: Loaded 52019 existing records from primary storage. [2025-09-29T02:11:20.025870] [INFO ] [MAIN ] BANC: Loaded 52019 primary data records. [2025-09-29T02:11:20.050117] [DEBUG] [LOCAL ] BAM: Loaded 52779 existing records from primary storage. [2025-09-29T02:11:20.086872] [INFO ] [MAIN ] BAM: Loaded 52779 primary data records. [2025-09-29T02:11:20.769989] [DEBUG] [MAIN ] BAP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:20.772834] [INFO ] [MAIN ] BAP: Generated 1820 derivative records from 26635 primary records. [2025-09-29T02:11:20.773765] [DEBUG] [LOCAL ] BAP: Saving derivative data. [2025-09-29T02:11:20.791616] [DEBUG] [LOCAL ] BAP: Derivative data saved (1820 records). [2025-09-29T02:11:20.792404] [INFO ] [MAIN ] BAP: Successfully saved derivative data. [2025-09-29T02:11:20.796411] [INFO ] [MAIN ] Derivative Progress: 196/2211 symbols completed. BAP took 1.2s. Estimated remaining: 14m 22s. Rate: 140.2 symbols/min [2025-09-29T02:11:20.798091] [INFO ] [MAIN ] BARK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:20.818095] [DEBUG] [MAIN ] BANC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:20.819021] [INFO ] [MAIN ] BANC: Generated 1820 derivative records from 52019 primary records. [2025-09-29T02:11:20.819339] [DEBUG] [LOCAL ] BANC: Saving derivative data. [2025-09-29T02:11:20.849598] [DEBUG] [LOCAL ] BANC: Derivative data saved (1820 records). [2025-09-29T02:11:20.854978] [INFO ] [MAIN ] BANC: Successfully saved derivative data. [2025-09-29T02:11:20.857881] [INFO ] [MAIN ] Derivative Progress: 197/2211 symbols completed. BANC took 1.3s. Estimated remaining: 14m 18s. Rate: 140.9 symbols/min [2025-09-29T02:11:20.858374] [DEBUG] [MAIN ] BAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:20.870297] [INFO ] [MAIN ] BAM: Generated 1820 derivative records from 52779 primary records. [2025-09-29T02:11:20.868890] [INFO ] [MAIN ] BAX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:20.870501] [DEBUG] [LOCAL ] BAM: Saving derivative data. [2025-09-29T02:11:20.889305] [DEBUG] [LOCAL ] BAM: Derivative data saved (1820 records). [2025-09-29T02:11:20.889471] [INFO ] [MAIN ] BAM: Successfully saved derivative data. [2025-09-29T02:11:20.892694] [INFO ] [MAIN ] Derivative Progress: 198/2211 symbols completed. BAM took 1.3s. Estimated remaining: 14m 13s. Rate: 141.5 symbols/min [2025-09-29T02:11:20.892933] [INFO ] [MAIN ] BB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:20.910311] [DEBUG] [LOCAL ] BARK: Loaded 38893 existing records from primary storage. [2025-09-29T02:11:20.910513] [INFO ] [MAIN ] BARK: Loaded 38893 primary data records. [2025-09-29T02:11:21.330571] [DEBUG] [LOCAL ] BAX: Loaded 54273 existing records from primary storage. [2025-09-29T02:11:21.332419] [INFO ] [MAIN ] BAX: Loaded 54273 primary data records. [2025-09-29T02:11:21.356813] [DEBUG] [LOCAL ] BB: Loaded 53701 existing records from primary storage. [2025-09-29T02:11:21.395479] [INFO ] [MAIN ] BB: Loaded 53701 primary data records. [2025-09-29T02:11:22.009742] [DEBUG] [MAIN ] BARK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:22.011118] [INFO ] [MAIN ] BARK: Generated 1820 derivative records from 38893 primary records. [2025-09-29T02:11:22.011448] [DEBUG] [LOCAL ] BARK: Saving derivative data. [2025-09-29T02:11:22.032187] [DEBUG] [LOCAL ] BARK: Derivative data saved (1820 records). [2025-09-29T02:11:22.033029] [INFO ] [MAIN ] BARK: Successfully saved derivative data. [2025-09-29T02:11:22.036574] [INFO ] [MAIN ] Derivative Progress: 199/2211 symbols completed. BARK took 1.2s. Estimated remaining: 14m 20s. Rate: 140.3 symbols/min [2025-09-29T02:11:22.036930] [INFO ] [MAIN ] BBAI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:22.061799] [DEBUG] [MAIN ] BAX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:22.062986] [INFO ] [MAIN ] BAX: Generated 1820 derivative records from 54273 primary records. [2025-09-29T02:11:22.063261] [DEBUG] [LOCAL ] BAX: Saving derivative data. [2025-09-29T02:11:22.097795] [DEBUG] [LOCAL ] BAX: Derivative data saved (1820 records). [2025-09-29T02:11:22.098063] [INFO ] [MAIN ] BAX: Successfully saved derivative data. [2025-09-29T02:11:22.095128] [DEBUG] [MAIN ] BB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:22.101581] [INFO ] [MAIN ] BB: Generated 1820 derivative records from 53701 primary records. [2025-09-29T02:11:22.101812] [DEBUG] [LOCAL ] BB: Saving derivative data. [2025-09-29T02:11:22.101427] [INFO ] [MAIN ] Derivative Progress: 200/2211 symbols completed. BAX took 1.2s. Estimated remaining: 14m 16s. Rate: 140.9 symbols/min [2025-09-29T02:11:22.103050] [INFO ] [MAIN ] BBAR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:22.137760] [DEBUG] [LOCAL ] BB: Derivative data saved (1820 records). [2025-09-29T02:11:22.138123] [INFO ] [MAIN ] BB: Successfully saved derivative data. [2025-09-29T02:11:22.142098] [INFO ] [MAIN ] Derivative Progress: 201/2211 symbols completed. BB took 1.2s. Estimated remaining: 14m 12s. Rate: 141.6 symbols/min [2025-09-29T02:11:22.142670] [INFO ] [MAIN ] BBD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:22.171147] [DEBUG] [LOCAL ] BBAI: Loaded 54600 existing records from primary storage. [2025-09-29T02:11:22.171692] [INFO ] [MAIN ] BBAI: Loaded 54600 primary data records. [2025-09-29T02:11:22.424236] [DEBUG] [LOCAL ] BBAR: Loaded 41988 existing records from primary storage. [2025-09-29T02:11:22.615167] [INFO ] [MAIN ] BBAR: Loaded 41988 primary data records. [2025-09-29T02:11:22.616455] [DEBUG] [LOCAL ] BBD: Loaded 53959 existing records from primary storage. [2025-09-29T02:11:22.622181] [INFO ] [MAIN ] BBD: Loaded 53959 primary data records. [2025-09-29T02:11:23.302917] [DEBUG] [MAIN ] BBAI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:23.304288] [INFO ] [MAIN ] BBAI: Generated 1820 derivative records from 54600 primary records. [2025-09-29T02:11:23.304636] [DEBUG] [LOCAL ] BBAI: Saving derivative data. [2025-09-29T02:11:23.341305] [DEBUG] [LOCAL ] BBAI: Derivative data saved (1820 records). [2025-09-29T02:11:23.340593] [DEBUG] [MAIN ] BBAR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:23.341736] [INFO ] [MAIN ] BBAI: Successfully saved derivative data. [2025-09-29T02:11:23.342519] [INFO ] [MAIN ] BBAR: Generated 1820 derivative records from 41988 primary records. [2025-09-29T02:11:23.348269] [INFO ] [MAIN ] Derivative Progress: 202/2211 symbols completed. BBAI took 1.3s. Estimated remaining: 14m 19s. Rate: 140.3 symbols/min [2025-09-29T02:11:23.348636] [INFO ] [MAIN ] BBDC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:23.348765] [DEBUG] [LOCAL ] BBAR: Saving derivative data. [2025-09-29T02:11:23.380490] [DEBUG] [MAIN ] BBD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:23.382629] [INFO ] [MAIN ] BBD: Generated 1820 derivative records from 53959 primary records. [2025-09-29T02:11:23.382847] [DEBUG] [LOCAL ] BBD: Saving derivative data. [2025-09-29T02:11:23.394428] [DEBUG] [LOCAL ] BBAR: Derivative data saved (1820 records). [2025-09-29T02:11:23.397195] [INFO ] [MAIN ] BBAR: Successfully saved derivative data. [2025-09-29T02:11:23.400271] [INFO ] [MAIN ] Derivative Progress: 203/2211 symbols completed. BBAR took 1.3s. Estimated remaining: 14m 15s. Rate: 140.9 symbols/min [2025-09-29T02:11:23.410384] [INFO ] [MAIN ] BBDO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:23.428338] [DEBUG] [LOCAL ] BBD: Derivative data saved (1820 records). [2025-09-29T02:11:23.430873] [DEBUG] [LOCAL ] BBDC: Loaded 33756 existing records from primary storage. [2025-09-29T02:11:23.431033] [INFO ] [MAIN ] BBDC: Loaded 33756 primary data records. [2025-09-29T02:11:23.431453] [INFO ] [MAIN ] BBD: Successfully saved derivative data. [2025-09-29T02:11:23.463483] [INFO ] [MAIN ] Derivative Progress: 204/2211 symbols completed. BBD took 1.3s. Estimated remaining: 14m 11s. Rate: 141.5 symbols/min [2025-09-29T02:11:23.463961] [DEBUG] [LOCAL ] BBDO: Loaded 5051 existing records from primary storage. [2025-09-29T02:11:23.532327] [INFO ] [MAIN ] BBN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:23.504199] [INFO ] [MAIN ] BBDO: Loaded 5051 primary data records. [2025-09-29T02:11:23.906906] [DEBUG] [LOCAL ] BBN: Loaded 18193 existing records from primary storage. [2025-09-29T02:11:23.926675] [INFO ] [MAIN ] BBN: Loaded 18193 primary data records. [2025-09-29T02:11:24.501989] [DEBUG] [MAIN ] BBDC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:24.505478] [INFO ] [MAIN ] BBDC: Generated 1820 derivative records from 33756 primary records. [2025-09-29T02:11:24.506277] [DEBUG] [LOCAL ] BBDC: Saving derivative data. [2025-09-29T02:11:24.532588] [DEBUG] [MAIN ] BBDO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:24.538374] [INFO ] [MAIN ] BBDO: Generated 1820 derivative records from 5051 primary records. [2025-09-29T02:11:24.538498] [DEBUG] [LOCAL ] BBDO: Saving derivative data. [2025-09-29T02:11:24.540673] [DEBUG] [LOCAL ] BBDC: Derivative data saved (1820 records). [2025-09-29T02:11:24.553950] [INFO ] [MAIN ] BBDC: Successfully saved derivative data. [2025-09-29T02:11:24.557249] [INFO ] [MAIN ] Derivative Progress: 205/2211 symbols completed. BBDC took 1.2s. Estimated remaining: 14m 17s. Rate: 140.4 symbols/min [2025-09-29T02:11:24.558888] [INFO ] [MAIN ] BBU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:24.561682] [DEBUG] [LOCAL ] BBDO: Derivative data saved (1820 records). [2025-09-29T02:11:24.562556] [INFO ] [MAIN ] BBDO: Successfully saved derivative data. [2025-09-29T02:11:24.565526] [INFO ] [MAIN ] Derivative Progress: 206/2211 symbols completed. BBDO took 1.2s. Estimated remaining: 14m 13s. Rate: 141.1 symbols/min [2025-09-29T02:11:24.565867] [INFO ] [MAIN ] BBUC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:24.575496] [DEBUG] [LOCAL ] BBU: Loaded 4478 existing records from primary storage. [2025-09-29T02:11:24.588960] [DEBUG] [MAIN ] BBN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:24.589234] [INFO ] [MAIN ] BBU: Loaded 4478 primary data records. [2025-09-29T02:11:24.595606] [INFO ] [MAIN ] BBN: Generated 1820 derivative records from 18193 primary records. [2025-09-29T02:11:24.638763] [DEBUG] [LOCAL ] BBN: Saving derivative data. [2025-09-29T02:11:24.733000] [DEBUG] [LOCAL ] BBUC: Loaded 13503 existing records from primary storage. [2025-09-29T02:11:24.746427] [INFO ] [MAIN ] BBUC: Loaded 13503 primary data records. [2025-09-29T02:11:24.752773] [DEBUG] [LOCAL ] BBN: Derivative data saved (1820 records). [2025-09-29T02:11:24.780782] [INFO ] [MAIN ] BBN: Successfully saved derivative data. [2025-09-29T02:11:24.853072] [INFO ] [MAIN ] Derivative Progress: 207/2211 symbols completed. BBN took 1.3s. Estimated remaining: 14m 11s. Rate: 141.3 symbols/min [2025-09-29T02:11:24.902116] [INFO ] [MAIN ] BBVA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:25.376147] [DEBUG] [MAIN ] BBU: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:11:25.379355] [INFO ] [MAIN ] BBU: Generated 1819 derivative records from 4478 primary records. [2025-09-29T02:11:25.379617] [DEBUG] [LOCAL ] BBU: Saving derivative data. [2025-09-29T02:11:25.382480] [DEBUG] [LOCAL ] BBVA: Loaded 50167 existing records from primary storage. [2025-09-29T02:11:25.385771] [INFO ] [MAIN ] BBVA: Loaded 50167 primary data records. [2025-09-29T02:11:25.471585] [DEBUG] [MAIN ] BBUC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:25.495812] [INFO ] [MAIN ] BBUC: Generated 1820 derivative records from 13503 primary records. [2025-09-29T02:11:25.507157] [DEBUG] [LOCAL ] BBUC: Saving derivative data. [2025-09-29T02:11:25.530504] [DEBUG] [LOCAL ] BBU: Derivative data saved (1819 records). [2025-09-29T02:11:25.545313] [INFO ] [MAIN ] BBU: Successfully saved derivative data. [2025-09-29T02:11:25.547928] [INFO ] [MAIN ] Derivative Progress: 208/2211 symbols completed. BBU took 1.0s. Estimated remaining: 14m 13s. Rate: 140.8 symbols/min [2025-09-29T02:11:25.575573] [DEBUG] [LOCAL ] BBUC: Derivative data saved (1820 records). [2025-09-29T02:11:25.600560] [INFO ] [MAIN ] BBUC: Successfully saved derivative data. [2025-09-29T02:11:25.623353] [INFO ] [MAIN ] Derivative Progress: 209/2211 symbols completed. BBUC took 1.1s. Estimated remaining: 14m 9s. Rate: 141.4 symbols/min [2025-09-29T02:11:25.812535] [DEBUG] [MAIN ] BBVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:25.813270] [INFO ] [MAIN ] BBVA: Generated 1820 derivative records from 50167 primary records. [2025-09-29T02:11:25.813357] [DEBUG] [LOCAL ] BBVA: Saving derivative data. [2025-09-29T02:11:25.829431] [DEBUG] [LOCAL ] BBVA: Derivative data saved (1820 records). [2025-09-29T02:11:25.829539] [INFO ] [MAIN ] BBVA: Successfully saved derivative data. [2025-09-29T02:11:25.832360] [INFO ] [MAIN ] Derivative Progress: 210/2211 symbols completed. BBVA took 0.9s. Estimated remaining: 14m 7s. Rate: 141.7 symbols/min [2025-09-29T02:11:25.833003] [INFO ] [MAIN ] BBW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:25.833108] [INFO ] [MAIN ] BBY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:25.833302] [INFO ] [MAIN ] BBWI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:25.869199] [DEBUG] [LOCAL ] BBW: Loaded 27177 existing records from primary storage. [2025-09-29T02:11:25.869425] [INFO ] [MAIN ] BBW: Loaded 27177 primary data records. [2025-09-29T02:11:26.240554] [DEBUG] [LOCAL ] BBWI: Loaded 54360 existing records from primary storage. [2025-09-29T02:11:26.240915] [INFO ] [MAIN ] BBWI: Loaded 54360 primary data records. [2025-09-29T02:11:26.347365] [DEBUG] [LOCAL ] BBY: Loaded 54253 existing records from primary storage. [2025-09-29T02:11:26.379154] [INFO ] [MAIN ] BBY: Loaded 54253 primary data records. [2025-09-29T02:11:27.020481] [DEBUG] [MAIN ] BBW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:27.023373] [INFO ] [MAIN ] BBW: Generated 1820 derivative records from 27177 primary records. [2025-09-29T02:11:27.023538] [DEBUG] [LOCAL ] BBW: Saving derivative data. [2025-09-29T02:11:27.045309] [DEBUG] [LOCAL ] BBW: Derivative data saved (1820 records). [2025-09-29T02:11:27.047046] [INFO ] [MAIN ] BBW: Successfully saved derivative data. [2025-09-29T02:11:27.056543] [INFO ] [MAIN ] Derivative Progress: 211/2211 symbols completed. BBW took 1.2s. Estimated remaining: 14m 14s. Rate: 140.5 symbols/min [2025-09-29T02:11:27.058021] [INFO ] [MAIN ] BC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:27.077482] [DEBUG] [MAIN ] BBWI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:27.078758] [INFO ] [MAIN ] BBWI: Generated 1820 derivative records from 54360 primary records. [2025-09-29T02:11:27.079175] [DEBUG] [LOCAL ] BBWI: Saving derivative data. [2025-09-29T02:11:27.099528] [DEBUG] [LOCAL ] BBWI: Derivative data saved (1820 records). [2025-09-29T02:11:27.100024] [INFO ] [MAIN ] BBWI: Successfully saved derivative data. [2025-09-29T02:11:27.103422] [INFO ] [MAIN ] Derivative Progress: 212/2211 symbols completed. BBWI took 1.3s. Estimated remaining: 14m 10s. Rate: 141.1 symbols/min [2025-09-29T02:11:27.117332] [INFO ] [MAIN ] BCAT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:27.117917] [DEBUG] [MAIN ] BBY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:27.118838] [INFO ] [MAIN ] BBY: Generated 1820 derivative records from 54253 primary records. [2025-09-29T02:11:27.119129] [DEBUG] [LOCAL ] BBY: Saving derivative data. [2025-09-29T02:11:27.160687] [DEBUG] [LOCAL ] BBY: Derivative data saved (1820 records). [2025-09-29T02:11:27.162113] [INFO ] [MAIN ] BBY: Successfully saved derivative data. [2025-09-29T02:11:27.165377] [INFO ] [MAIN ] Derivative Progress: 213/2211 symbols completed. BBY took 1.3s. Estimated remaining: 14m 6s. Rate: 141.6 symbols/min [2025-09-29T02:11:27.165742] [INFO ] [MAIN ] BCC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:27.169439] [DEBUG] [LOCAL ] BC: Loaded 45020 existing records from primary storage. [2025-09-29T02:11:27.169775] [INFO ] [MAIN ] BC: Loaded 45020 primary data records. [2025-09-29T02:11:27.317366] [DEBUG] [LOCAL ] BCAT: Loaded 34910 existing records from primary storage. [2025-09-29T02:11:27.338122] [INFO ] [MAIN ] BCAT: Loaded 34910 primary data records. [2025-09-29T02:11:27.658102] [DEBUG] [LOCAL ] BCC: Loaded 28735 existing records from primary storage. [2025-09-29T02:11:27.662441] [INFO ] [MAIN ] BCC: Loaded 28735 primary data records. [2025-09-29T02:11:28.242822] [DEBUG] [MAIN ] BC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:28.245387] [INFO ] [MAIN ] BC: Generated 1820 derivative records from 45020 primary records. [2025-09-29T02:11:28.245912] [DEBUG] [LOCAL ] BC: Saving derivative data. [2025-09-29T02:11:28.265225] [DEBUG] [LOCAL ] BC: Derivative data saved (1820 records). [2025-09-29T02:11:28.268633] [INFO ] [MAIN ] BC: Successfully saved derivative data. [2025-09-29T02:11:28.272015] [INFO ] [MAIN ] Derivative Progress: 214/2211 symbols completed. BC took 1.2s. Estimated remaining: 14m 12s. Rate: 140.6 symbols/min [2025-09-29T02:11:28.274228] [INFO ] [MAIN ] BCE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:28.289734] [DEBUG] [MAIN ] BCAT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:28.290968] [INFO ] [MAIN ] BCAT: Generated 1820 derivative records from 34910 primary records. [2025-09-29T02:11:28.304845] [DEBUG] [MAIN ] BCC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:28.305775] [INFO ] [MAIN ] BCC: Generated 1820 derivative records from 28735 primary records. [2025-09-29T02:11:28.305956] [DEBUG] [LOCAL ] BCC: Saving derivative data. [2025-09-29T02:11:28.306047] [DEBUG] [LOCAL ] BCAT: Saving derivative data. [2025-09-29T02:11:28.345346] [DEBUG] [LOCAL ] BCAT: Derivative data saved (1820 records). [2025-09-29T02:11:28.344069] [DEBUG] [LOCAL ] BCC: Derivative data saved (1820 records). [2025-09-29T02:11:28.345836] [INFO ] [MAIN ] BCAT: Successfully saved derivative data. [2025-09-29T02:11:28.349113] [INFO ] [MAIN ] Derivative Progress: 215/2211 symbols completed. BCAT took 1.2s. Estimated remaining: 14m 9s. Rate: 141.1 symbols/min [2025-09-29T02:11:28.349418] [INFO ] [MAIN ] BCH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:28.346008] [INFO ] [MAIN ] BCC: Successfully saved derivative data. [2025-09-29T02:11:28.352802] [INFO ] [MAIN ] Derivative Progress: 216/2211 symbols completed. BCC took 1.2s. Estimated remaining: 14m 4s. Rate: 141.8 symbols/min [2025-09-29T02:11:28.353166] [INFO ] [MAIN ] BCO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:28.437380] [DEBUG] [LOCAL ] BCE: Loaded 53072 existing records from primary storage. [2025-09-29T02:11:28.439025] [DEBUG] [LOCAL ] BCH: Loaded 30039 existing records from primary storage. [2025-09-29T02:11:28.439291] [INFO ] [MAIN ] BCE: Loaded 53072 primary data records. [2025-09-29T02:11:28.438370] [DEBUG] [LOCAL ] BCO: Loaded 26740 existing records from primary storage. [2025-09-29T02:11:28.439442] [INFO ] [MAIN ] BCH: Loaded 30039 primary data records. [2025-09-29T02:11:28.439945] [INFO ] [MAIN ] BCO: Loaded 26740 primary data records. [2025-09-29T02:11:29.541361] [DEBUG] [MAIN ] BCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:29.566947] [DEBUG] [MAIN ] BCH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:29.567389] [DEBUG] [MAIN ] BCE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:29.568261] [INFO ] [MAIN ] BCH: Generated 1820 derivative records from 30039 primary records. [2025-09-29T02:11:29.568395] [DEBUG] [LOCAL ] BCH: Saving derivative data. [2025-09-29T02:11:29.569104] [INFO ] [MAIN ] BCO: Generated 1820 derivative records from 26740 primary records. [2025-09-29T02:11:29.570539] [INFO ] [MAIN ] BCE: Generated 1820 derivative records from 53072 primary records. [2025-09-29T02:11:29.570677] [DEBUG] [LOCAL ] BCE: Saving derivative data. [2025-09-29T02:11:29.570999] [DEBUG] [LOCAL ] BCO: Saving derivative data. [2025-09-29T02:11:29.587829] [DEBUG] [LOCAL ] BCH: Derivative data saved (1820 records). [2025-09-29T02:11:29.616786] [INFO ] [MAIN ] BCH: Successfully saved derivative data. [2025-09-29T02:11:29.614600] [DEBUG] [LOCAL ] BCE: Derivative data saved (1820 records). [2025-09-29T02:11:29.617721] [INFO ] [MAIN ] BCE: Successfully saved derivative data. [2025-09-29T02:11:29.622384] [INFO ] [MAIN ] Derivative Progress: 217/2211 symbols completed. BCE took 1.3s. Estimated remaining: 14m 12s. Rate: 140.5 symbols/min [2025-09-29T02:11:29.619281] [DEBUG] [LOCAL ] BCO: Derivative data saved (1820 records). [2025-09-29T02:11:29.625634] [INFO ] [MAIN ] BCS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:29.625807] [INFO ] [MAIN ] Derivative Progress: 218/2211 symbols completed. BCH took 1.3s. Estimated remaining: 14m 7s. Rate: 141.1 symbols/min [2025-09-29T02:11:29.626265] [INFO ] [MAIN ] BCO: Successfully saved derivative data. [2025-09-29T02:11:29.628999] [INFO ] [MAIN ] Derivative Progress: 219/2211 symbols completed. BCO took 1.3s. Estimated remaining: 14m 3s. Rate: 141.8 symbols/min [2025-09-29T02:11:29.626585] [INFO ] [MAIN ] BCSF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:29.629389] [INFO ] [MAIN ] BCX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:29.665762] [DEBUG] [LOCAL ] BCX: Loaded 21920 existing records from primary storage. [2025-09-29T02:11:29.666028] [INFO ] [MAIN ] BCX: Loaded 21920 primary data records. [2025-09-29T02:11:29.832048] [DEBUG] [LOCAL ] BCSF: Loaded 28231 existing records from primary storage. [2025-09-29T02:11:29.892736] [INFO ] [MAIN ] BCSF: Loaded 28231 primary data records. [2025-09-29T02:11:29.892553] [DEBUG] [LOCAL ] BCS: Loaded 54242 existing records from primary storage. [2025-09-29T02:11:29.927391] [INFO ] [MAIN ] BCS: Loaded 54242 primary data records. [2025-09-29T02:11:30.773674] [DEBUG] [MAIN ] BCX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:30.774700] [INFO ] [MAIN ] BCX: Generated 1820 derivative records from 21920 primary records. [2025-09-29T02:11:30.774909] [DEBUG] [LOCAL ] BCX: Saving derivative data. [2025-09-29T02:11:30.796187] [DEBUG] [LOCAL ] BCX: Derivative data saved (1820 records). [2025-09-29T02:11:30.796803] [INFO ] [MAIN ] BCX: Successfully saved derivative data. [2025-09-29T02:11:30.799084] [INFO ] [MAIN ] Derivative Progress: 220/2211 symbols completed. BCX took 1.2s. Estimated remaining: 14m 9s. Rate: 140.6 symbols/min [2025-09-29T02:11:30.799548] [INFO ] [MAIN ] BDC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:30.813057] [DEBUG] [MAIN ] BCS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:30.813991] [INFO ] [MAIN ] BCS: Generated 1820 derivative records from 54242 primary records. [2025-09-29T02:11:30.814237] [DEBUG] [LOCAL ] BCS: Saving derivative data. [2025-09-29T02:11:30.843037] [DEBUG] [LOCAL ] BCS: Derivative data saved (1820 records). [2025-09-29T02:11:30.848979] [INFO ] [MAIN ] BCS: Successfully saved derivative data. [2025-09-29T02:11:30.852255] [INFO ] [MAIN ] Derivative Progress: 221/2211 symbols completed. BCS took 1.2s. Estimated remaining: 14m 6s. Rate: 141.2 symbols/min [2025-09-29T02:11:30.852468] [INFO ] [MAIN ] BDJ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:30.848877] [DEBUG] [MAIN ] BCSF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:30.854160] [INFO ] [MAIN ] BCSF: Generated 1820 derivative records from 28231 primary records. [2025-09-29T02:11:30.854432] [DEBUG] [LOCAL ] BCSF: Saving derivative data. [2025-09-29T02:11:30.880137] [DEBUG] [LOCAL ] BCSF: Derivative data saved (1820 records). [2025-09-29T02:11:30.880339] [INFO ] [MAIN ] BCSF: Successfully saved derivative data. [2025-09-29T02:11:30.883136] [INFO ] [MAIN ] Derivative Progress: 222/2211 symbols completed. BCSF took 1.3s. Estimated remaining: 14m 2s. Rate: 141.8 symbols/min [2025-09-29T02:11:30.883426] [INFO ] [MAIN ] BDN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:30.896188] [DEBUG] [LOCAL ] BDC: Loaded 25073 existing records from primary storage. [2025-09-29T02:11:30.905909] [INFO ] [MAIN ] BDC: Loaded 25073 primary data records. [2025-09-29T02:11:31.030247] [DEBUG] [LOCAL ] BDJ: Loaded 29325 existing records from primary storage. [2025-09-29T02:11:31.034186] [INFO ] [MAIN ] BDJ: Loaded 29325 primary data records. [2025-09-29T02:11:31.464389] [DEBUG] [LOCAL ] BDN: Loaded 48230 existing records from primary storage. [2025-09-29T02:11:31.484595] [INFO ] [MAIN ] BDN: Loaded 48230 primary data records. [2025-09-29T02:11:31.991634] [DEBUG] [MAIN ] BDC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:31.993194] [INFO ] [MAIN ] BDC: Generated 1820 derivative records from 25073 primary records. [2025-09-29T02:11:31.994837] [DEBUG] [LOCAL ] BDC: Saving derivative data. [2025-09-29T02:11:32.017802] [DEBUG] [LOCAL ] BDC: Derivative data saved (1820 records). [2025-09-29T02:11:32.018692] [INFO ] [MAIN ] BDC: Successfully saved derivative data. [2025-09-29T02:11:32.021798] [INFO ] [MAIN ] Derivative Progress: 223/2211 symbols completed. BDC took 1.2s. Estimated remaining: 14m 8s. Rate: 140.7 symbols/min [2025-09-29T02:11:32.036541] [DEBUG] [MAIN ] BDJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:32.037528] [INFO ] [MAIN ] BDJ: Generated 1820 derivative records from 29325 primary records. [2025-09-29T02:11:32.038857] [DEBUG] [LOCAL ] BDJ: Saving derivative data. [2025-09-29T02:11:32.060346] [DEBUG] [LOCAL ] BDJ: Derivative data saved (1820 records). [2025-09-29T02:11:32.060778] [INFO ] [MAIN ] BDJ: Successfully saved derivative data. [2025-09-29T02:11:32.064613] [INFO ] [MAIN ] Derivative Progress: 224/2211 symbols completed. BDJ took 1.2s. Estimated remaining: 14m 4s. Rate: 141.3 symbols/min [2025-09-29T02:11:32.082203] [DEBUG] [MAIN ] BDN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:32.082940] [INFO ] [MAIN ] BDN: Generated 1820 derivative records from 48230 primary records. [2025-09-29T02:11:32.083029] [DEBUG] [LOCAL ] BDN: Saving derivative data. [2025-09-29T02:11:32.098759] [DEBUG] [LOCAL ] BDN: Derivative data saved (1820 records). [2025-09-29T02:11:32.098852] [INFO ] [MAIN ] BDN: Successfully saved derivative data. [2025-09-29T02:11:32.101798] [INFO ] [MAIN ] Derivative Progress: 225/2211 symbols completed. BDN took 1.2s. Estimated remaining: 13m 60s. Rate: 141.9 symbols/min [2025-09-29T02:11:32.102206] [INFO ] [MAIN ] BDX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:32.102389] [INFO ] [MAIN ] BE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:32.102606] [INFO ] [MAIN ] BEKE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:32.198017] [DEBUG] [LOCAL ] BEKE: Loaded 54025 existing records from primary storage. [2025-09-29T02:11:32.198294] [INFO ] [MAIN ] BEKE: Loaded 54025 primary data records. [2025-09-29T02:11:32.370755] [DEBUG] [LOCAL ] BDX: Loaded 53191 existing records from primary storage. [2025-09-29T02:11:32.383204] [INFO ] [MAIN ] BDX: Loaded 53191 primary data records. [2025-09-29T02:11:32.390234] [DEBUG] [LOCAL ] BE: Loaded 54433 existing records from primary storage. [2025-09-29T02:11:32.395913] [INFO ] [MAIN ] BE: Loaded 54433 primary data records. [2025-09-29T02:11:33.279827] [DEBUG] [MAIN ] BEKE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:33.281204] [INFO ] [MAIN ] BEKE: Generated 1820 derivative records from 54025 primary records. [2025-09-29T02:11:33.281487] [DEBUG] [LOCAL ] BEKE: Saving derivative data. [2025-09-29T02:11:33.300927] [DEBUG] [LOCAL ] BEKE: Derivative data saved (1820 records). [2025-09-29T02:11:33.303151] [INFO ] [MAIN ] BEKE: Successfully saved derivative data. [2025-09-29T02:11:33.308992] [INFO ] [MAIN ] Derivative Progress: 226/2211 symbols completed. BEKE took 1.2s. Estimated remaining: 14m 6s. Rate: 140.7 symbols/min [2025-09-29T02:11:33.309348] [INFO ] [MAIN ] BEN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:33.324014] [DEBUG] [MAIN ] BE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:33.333087] [INFO ] [MAIN ] BE: Generated 1820 derivative records from 54433 primary records. [2025-09-29T02:11:33.338306] [DEBUG] [LOCAL ] BE: Saving derivative data. [2025-09-29T02:11:33.339080] [DEBUG] [MAIN ] BDX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:33.340056] [INFO ] [MAIN ] BDX: Generated 1820 derivative records from 53191 primary records. [2025-09-29T02:11:33.340408] [DEBUG] [LOCAL ] BDX: Saving derivative data. [2025-09-29T02:11:33.370281] [DEBUG] [LOCAL ] BE: Derivative data saved (1820 records). [2025-09-29T02:11:33.371681] [INFO ] [MAIN ] BE: Successfully saved derivative data. [2025-09-29T02:11:33.377133] [INFO ] [MAIN ] Derivative Progress: 227/2211 symbols completed. BE took 1.3s. Estimated remaining: 14m 3s. Rate: 141.2 symbols/min [2025-09-29T02:11:33.378277] [INFO ] [MAIN ] BEP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:33.380100] [DEBUG] [LOCAL ] BDX: Derivative data saved (1820 records). [2025-09-29T02:11:33.380595] [INFO ] [MAIN ] BDX: Successfully saved derivative data. [2025-09-29T02:11:33.384119] [INFO ] [MAIN ] Derivative Progress: 228/2211 symbols completed. BDX took 1.3s. Estimated remaining: 13m 59s. Rate: 141.8 symbols/min [2025-09-29T02:11:33.384421] [INFO ] [MAIN ] BEPC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:33.460792] [DEBUG] [LOCAL ] BEN: Loaded 53833 existing records from primary storage. [2025-09-29T02:11:33.461006] [INFO ] [MAIN ] BEN: Loaded 53833 primary data records. [2025-09-29T02:11:33.496485] [DEBUG] [LOCAL ] BEP: Loaded 39244 existing records from primary storage. [2025-09-29T02:11:33.529074] [INFO ] [MAIN ] BEP: Loaded 39244 primary data records. [2025-09-29T02:11:33.706470] [DEBUG] [LOCAL ] BEPC: Loaded 47209 existing records from primary storage. [2025-09-29T02:11:33.753046] [INFO ] [MAIN ] BEPC: Loaded 47209 primary data records. [2025-09-29T02:11:34.587494] [DEBUG] [MAIN ] BEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:34.589078] [INFO ] [MAIN ] BEN: Generated 1820 derivative records from 53833 primary records. [2025-09-29T02:11:34.589410] [DEBUG] [LOCAL ] BEN: Saving derivative data. [2025-09-29T02:11:34.605061] [DEBUG] [MAIN ] BEP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:34.613903] [INFO ] [MAIN ] BEP: Generated 1820 derivative records from 39244 primary records. [2025-09-29T02:11:34.618160] [DEBUG] [LOCAL ] BEP: Saving derivative data. [2025-09-29T02:11:34.624408] [DEBUG] [LOCAL ] BEN: Derivative data saved (1820 records). [2025-09-29T02:11:34.632189] [INFO ] [MAIN ] BEN: Successfully saved derivative data. [2025-09-29T02:11:34.638523] [INFO ] [MAIN ] Derivative Progress: 229/2211 symbols completed. BEN took 1.3s. Estimated remaining: 14m 6s. Rate: 140.6 symbols/min [2025-09-29T02:11:34.639631] [INFO ] [MAIN ] BEPH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:34.645799] [DEBUG] [LOCAL ] BEP: Derivative data saved (1820 records). [2025-09-29T02:11:34.646200] [INFO ] [MAIN ] BEP: Successfully saved derivative data. [2025-09-29T02:11:34.649047] [INFO ] [MAIN ] Derivative Progress: 230/2211 symbols completed. BEP took 1.3s. Estimated remaining: 14m 2s. Rate: 141.2 symbols/min [2025-09-29T02:11:34.651889] [INFO ] [MAIN ] BEPI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:34.671498] [DEBUG] [LOCAL ] BEPH: Loaded 5208 existing records from primary storage. [2025-09-29T02:11:34.673126] [INFO ] [MAIN ] BEPH: Loaded 5208 primary data records. [2025-09-29T02:11:34.671873] [DEBUG] [MAIN ] BEPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:34.706971] [INFO ] [MAIN ] BEPC: Generated 1820 derivative records from 47209 primary records. [2025-09-29T02:11:34.722504] [DEBUG] [LOCAL ] BEPI: Loaded 3487 existing records from primary storage. [2025-09-29T02:11:34.727827] [DEBUG] [LOCAL ] BEPC: Saving derivative data. [2025-09-29T02:11:34.762869] [INFO ] [MAIN ] BEPI: Loaded 3487 primary data records. [2025-09-29T02:11:34.976881] [DEBUG] [LOCAL ] BEPC: Derivative data saved (1820 records). [2025-09-29T02:11:35.128297] [INFO ] [MAIN ] BEPC: Successfully saved derivative data. [2025-09-29T02:11:35.136470] [INFO ] [MAIN ] Derivative Progress: 231/2211 symbols completed. BEPC took 1.8s. Estimated remaining: 14m 2s. Rate: 141.1 symbols/min [2025-09-29T02:11:35.154043] [INFO ] [MAIN ] BEPJ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:35.353988] [DEBUG] [LOCAL ] BEPJ: Loaded 3268 existing records from primary storage. [2025-09-29T02:11:35.356512] [INFO ] [MAIN ] BEPJ: Loaded 3268 primary data records. [2025-09-29T02:11:35.764365] [DEBUG] [MAIN ] BEPH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:35.765538] [INFO ] [MAIN ] BEPH: Generated 1820 derivative records from 5208 primary records. [2025-09-29T02:11:35.766924] [DEBUG] [LOCAL ] BEPH: Saving derivative data. [2025-09-29T02:11:35.800796] [DEBUG] [LOCAL ] BEPH: Derivative data saved (1820 records). [2025-09-29T02:11:35.801717] [DEBUG] [MAIN ] BEPI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:35.802608] [INFO ] [MAIN ] BEPI: Generated 1820 derivative records from 3487 primary records. [2025-09-29T02:11:35.802793] [INFO ] [MAIN ] BEPH: Successfully saved derivative data. [2025-09-29T02:11:35.802896] [DEBUG] [LOCAL ] BEPI: Saving derivative data. [2025-09-29T02:11:35.807399] [INFO ] [MAIN ] Derivative Progress: 232/2211 symbols completed. BEPH took 1.2s. Estimated remaining: 14m 3s. Rate: 140.8 symbols/min [2025-09-29T02:11:35.818152] [INFO ] [MAIN ] BFAM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:35.822267] [DEBUG] [LOCAL ] BEPI: Derivative data saved (1820 records). [2025-09-29T02:11:35.822548] [INFO ] [MAIN ] BEPI: Successfully saved derivative data. [2025-09-29T02:11:35.825715] [INFO ] [MAIN ] Derivative Progress: 233/2211 symbols completed. BEPI took 1.2s. Estimated remaining: 13m 59s. Rate: 141.4 symbols/min [2025-09-29T02:11:35.826954] [INFO ] [MAIN ] BFH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:35.849098] [DEBUG] [MAIN ] BEPJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:35.849956] [INFO ] [MAIN ] BEPJ: Generated 1820 derivative records from 3268 primary records. [2025-09-29T02:11:35.850075] [DEBUG] [LOCAL ] BEPJ: Saving derivative data. [2025-09-29T02:11:35.864920] [DEBUG] [LOCAL ] BEPJ: Derivative data saved (1820 records). [2025-09-29T02:11:35.865108] [INFO ] [MAIN ] BEPJ: Successfully saved derivative data. [2025-09-29T02:11:35.868102] [INFO ] [MAIN ] Derivative Progress: 234/2211 symbols completed. BEPJ took 0.7s. Estimated remaining: 13m 56s. Rate: 141.9 symbols/min [2025-09-29T02:11:35.868380] [INFO ] [MAIN ] BFK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:35.920582] [DEBUG] [LOCAL ] BFAM: Loaded 33519 existing records from primary storage. [2025-09-29T02:11:35.921085] [INFO ] [MAIN ] BFAM: Loaded 33519 primary data records. [2025-09-29T02:11:35.936269] [DEBUG] [LOCAL ] BFH: Loaded 42308 existing records from primary storage. [2025-09-29T02:11:35.942071] [INFO ] [MAIN ] BFH: Loaded 42308 primary data records. [2025-09-29T02:11:35.979011] [DEBUG] [LOCAL ] BFK: Loaded 14145 existing records from primary storage. [2025-09-29T02:11:36.009782] [INFO ] [MAIN ] BFK: Loaded 14145 primary data records. [2025-09-29T02:11:36.992541] [DEBUG] [MAIN ] BFAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:36.996448] [INFO ] [MAIN ] BFAM: Generated 1820 derivative records from 33519 primary records. [2025-09-29T02:11:36.996970] [DEBUG] [LOCAL ] BFAM: Saving derivative data. [2025-09-29T02:11:37.027466] [DEBUG] [LOCAL ] BFAM: Derivative data saved (1820 records). [2025-09-29T02:11:37.029913] [INFO ] [MAIN ] BFAM: Successfully saved derivative data. [2025-09-29T02:11:37.033942] [INFO ] [MAIN ] Derivative Progress: 235/2211 symbols completed. BFAM took 1.2s. Estimated remaining: 14m 2s. Rate: 140.9 symbols/min [2025-09-29T02:11:37.034366] [INFO ] [MAIN ] BFLY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:37.027748] [DEBUG] [MAIN ] BFH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:37.035304] [INFO ] [MAIN ] BFH: Generated 1820 derivative records from 42308 primary records. [2025-09-29T02:11:37.049070] [DEBUG] [MAIN ] BFK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:37.049800] [INFO ] [MAIN ] BFK: Generated 1820 derivative records from 14145 primary records. [2025-09-29T02:11:37.048785] [DEBUG] [LOCAL ] BFH: Saving derivative data. [2025-09-29T02:11:37.049926] [DEBUG] [LOCAL ] BFK: Saving derivative data. [2025-09-29T02:11:37.084096] [DEBUG] [LOCAL ] BFH: Derivative data saved (1820 records). [2025-09-29T02:11:37.079510] [DEBUG] [LOCAL ] BFK: Derivative data saved (1820 records). [2025-09-29T02:11:37.084334] [INFO ] [MAIN ] BFK: Successfully saved derivative data. [2025-09-29T02:11:37.087424] [INFO ] [MAIN ] Derivative Progress: 236/2211 symbols completed. BFK took 1.2s. Estimated remaining: 13m 58s. Rate: 141.4 symbols/min [2025-09-29T02:11:37.087715] [INFO ] [MAIN ] BFS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:37.088663] [INFO ] [MAIN ] BFH: Successfully saved derivative data. [2025-09-29T02:11:37.091706] [INFO ] [MAIN ] Derivative Progress: 237/2211 symbols completed. BFH took 1.3s. Estimated remaining: 13m 54s. Rate: 142.0 symbols/min [2025-09-29T02:11:37.092332] [INFO ] [MAIN ] BFZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:37.104741] [DEBUG] [LOCAL ] BFS: Loaded 9240 existing records from primary storage. [2025-09-29T02:11:37.104932] [INFO ] [MAIN ] BFS: Loaded 9240 primary data records. [2025-09-29T02:11:37.250084] [DEBUG] [LOCAL ] BFZ: Loaded 12223 existing records from primary storage. [2025-09-29T02:11:37.272635] [INFO ] [MAIN ] BFZ: Loaded 12223 primary data records. [2025-09-29T02:11:37.287197] [DEBUG] [LOCAL ] BFLY: Loaded 52590 existing records from primary storage. [2025-09-29T02:11:37.320231] [INFO ] [MAIN ] BFLY: Loaded 52590 primary data records. [2025-09-29T02:11:38.233131] [DEBUG] [MAIN ] BFS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:38.234217] [INFO ] [MAIN ] BFS: Generated 1820 derivative records from 9240 primary records. [2025-09-29T02:11:38.234445] [DEBUG] [LOCAL ] BFS: Saving derivative data. [2025-09-29T02:11:38.255201] [DEBUG] [LOCAL ] BFS: Derivative data saved (1820 records). [2025-09-29T02:11:38.269412] [INFO ] [MAIN ] BFS: Successfully saved derivative data. [2025-09-29T02:11:38.272325] [INFO ] [MAIN ] Derivative Progress: 238/2211 symbols completed. BFS took 1.2s. Estimated remaining: 14m 0s. Rate: 140.9 symbols/min [2025-09-29T02:11:38.273020] [DEBUG] [MAIN ] BFLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:38.275964] [INFO ] [MAIN ] BFLY: Generated 1820 derivative records from 52590 primary records. [2025-09-29T02:11:38.276217] [DEBUG] [LOCAL ] BFLY: Saving derivative data. [2025-09-29T02:11:38.289944] [DEBUG] [MAIN ] BFZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:38.290929] [INFO ] [MAIN ] BFZ: Generated 1820 derivative records from 12223 primary records. [2025-09-29T02:11:38.299217] [DEBUG] [LOCAL ] BFZ: Saving derivative data. [2025-09-29T02:11:38.307508] [DEBUG] [LOCAL ] BFLY: Derivative data saved (1820 records). [2025-09-29T02:11:38.314848] [INFO ] [MAIN ] BFLY: Successfully saved derivative data. [2025-09-29T02:11:38.318038] [INFO ] [MAIN ] Derivative Progress: 239/2211 symbols completed. BFLY took 1.3s. Estimated remaining: 13m 56s. Rate: 141.5 symbols/min [2025-09-29T02:11:38.326483] [DEBUG] [LOCAL ] BFZ: Derivative data saved (1820 records). [2025-09-29T02:11:38.326681] [INFO ] [MAIN ] BFZ: Successfully saved derivative data. [2025-09-29T02:11:38.329962] [INFO ] [MAIN ] Derivative Progress: 240/2211 symbols completed. BFZ took 1.2s. Estimated remaining: 13m 53s. Rate: 142.0 symbols/min [2025-09-29T02:11:38.330669] [INFO ] [MAIN ] BG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:38.330731] [INFO ] [MAIN ] BGB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:38.330792] [INFO ] [MAIN ] BGH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:38.361196] [DEBUG] [LOCAL ] BGH: Loaded 16728 existing records from primary storage. [2025-09-29T02:11:38.361425] [INFO ] [MAIN ] BGH: Loaded 16728 primary data records. [2025-09-29T02:11:38.402851] [DEBUG] [LOCAL ] BGB: Loaded 17621 existing records from primary storage. [2025-09-29T02:11:38.421237] [INFO ] [MAIN ] BGB: Loaded 17621 primary data records. [2025-09-29T02:11:38.894576] [DEBUG] [LOCAL ] BG: Loaded 51118 existing records from primary storage. [2025-09-29T02:11:38.905423] [INFO ] [MAIN ] BG: Loaded 51118 primary data records. [2025-09-29T02:11:39.466866] [DEBUG] [MAIN ] BGH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:39.471553] [INFO ] [MAIN ] BGH: Generated 1820 derivative records from 16728 primary records. [2025-09-29T02:11:39.472458] [DEBUG] [LOCAL ] BGH: Saving derivative data. [2025-09-29T02:11:39.496000] [DEBUG] [MAIN ] BGB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:39.497876] [INFO ] [MAIN ] BGB: Generated 1820 derivative records from 17621 primary records. [2025-09-29T02:11:39.498107] [DEBUG] [LOCAL ] BGB: Saving derivative data. [2025-09-29T02:11:39.523222] [DEBUG] [LOCAL ] BGH: Derivative data saved (1820 records). [2025-09-29T02:11:39.524813] [DEBUG] [LOCAL ] BGB: Derivative data saved (1820 records). [2025-09-29T02:11:39.525356] [INFO ] [MAIN ] BGB: Successfully saved derivative data. [2025-09-29T02:11:39.525282] [INFO ] [MAIN ] BGH: Successfully saved derivative data. [2025-09-29T02:11:39.529239] [INFO ] [MAIN ] Derivative Progress: 241/2211 symbols completed. BGH took 1.2s. Estimated remaining: 13m 59s. Rate: 141.0 symbols/min [2025-09-29T02:11:39.532874] [INFO ] [MAIN ] Derivative Progress: 242/2211 symbols completed. BGB took 1.2s. Estimated remaining: 13m 55s. Rate: 141.5 symbols/min [2025-09-29T02:11:39.532743] [INFO ] [MAIN ] BGR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:39.533532] [INFO ] [MAIN ] BGS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:39.554791] [DEBUG] [MAIN ] BG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:39.555967] [INFO ] [MAIN ] BG: Generated 1820 derivative records from 51118 primary records. [2025-09-29T02:11:39.556091] [DEBUG] [LOCAL ] BG: Saving derivative data. [2025-09-29T02:11:39.577310] [DEBUG] [LOCAL ] BG: Derivative data saved (1820 records). [2025-09-29T02:11:39.577698] [INFO ] [MAIN ] BG: Successfully saved derivative data. [2025-09-29T02:11:39.580626] [INFO ] [MAIN ] Derivative Progress: 243/2211 symbols completed. BG took 1.2s. Estimated remaining: 13m 51s. Rate: 142.1 symbols/min [2025-09-29T02:11:39.588860] [DEBUG] [LOCAL ] BGR: Loaded 13658 existing records from primary storage. [2025-09-29T02:11:39.589180] [INFO ] [MAIN ] BGR: Loaded 13658 primary data records. [2025-09-29T02:11:39.589329] [INFO ] [MAIN ] BGSF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:39.734909] [DEBUG] [LOCAL ] BGSF: Loaded 7050 existing records from primary storage. [2025-09-29T02:11:39.767093] [INFO ] [MAIN ] BGSF: Loaded 7050 primary data records. [2025-09-29T02:11:40.034835] [DEBUG] [LOCAL ] BGS: Loaded 51183 existing records from primary storage. [2025-09-29T02:11:40.051931] [INFO ] [MAIN ] BGS: Loaded 51183 primary data records. [2025-09-29T02:11:40.711602] [DEBUG] [MAIN ] BGR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:40.713016] [INFO ] [MAIN ] BGR: Generated 1820 derivative records from 13658 primary records. [2025-09-29T02:11:40.715237] [DEBUG] [LOCAL ] BGR: Saving derivative data. [2025-09-29T02:11:40.734899] [DEBUG] [LOCAL ] BGR: Derivative data saved (1820 records). [2025-09-29T02:11:40.735254] [INFO ] [MAIN ] BGR: Successfully saved derivative data. [2025-09-29T02:11:40.739558] [INFO ] [MAIN ] Derivative Progress: 244/2211 symbols completed. BGR took 1.2s. Estimated remaining: 13m 57s. Rate: 141.0 symbols/min [2025-09-29T02:11:40.741455] [INFO ] [MAIN ] BGT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:40.758471] [DEBUG] [MAIN ] BGSF: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-09-29T02:11:40.759386] [INFO ] [MAIN ] BGSF: Generated 1818 derivative records from 7050 primary records. [2025-09-29T02:11:40.759493] [DEBUG] [LOCAL ] BGSF: Saving derivative data. [2025-09-29T02:11:40.784331] [DEBUG] [LOCAL ] BGSF: Derivative data saved (1818 records). [2025-09-29T02:11:40.790444] [INFO ] [MAIN ] BGSF: Successfully saved derivative data. [2025-09-29T02:11:40.791843] [DEBUG] [LOCAL ] BGT: Loaded 16793 existing records from primary storage. [2025-09-29T02:11:40.792152] [INFO ] [MAIN ] BGT: Loaded 16793 primary data records. [2025-09-29T02:11:40.796869] [INFO ] [MAIN ] Derivative Progress: 245/2211 symbols completed. BGSF took 1.2s. Estimated remaining: 13m 53s. Rate: 141.5 symbols/min [2025-09-29T02:11:40.858117] [INFO ] [MAIN ] BGX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:40.888814] [DEBUG] [MAIN ] BGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:40.911158] [INFO ] [MAIN ] BGS: Generated 1820 derivative records from 51183 primary records. [2025-09-29T02:11:40.933053] [DEBUG] [LOCAL ] BGS: Saving derivative data. [2025-09-29T02:11:41.044193] [DEBUG] [LOCAL ] BGX: Loaded 10900 existing records from primary storage. [2025-09-29T02:11:41.045003] [DEBUG] [LOCAL ] BGS: Derivative data saved (1820 records). [2025-09-29T02:11:41.045188] [INFO ] [MAIN ] BGX: Loaded 10900 primary data records. [2025-09-29T02:11:41.052529] [INFO ] [MAIN ] BGS: Successfully saved derivative data. [2025-09-29T02:11:41.056127] [INFO ] [MAIN ] Derivative Progress: 246/2211 symbols completed. BGS took 1.5s. Estimated remaining: 13m 52s. Rate: 141.8 symbols/min [2025-09-29T02:11:41.061494] [INFO ] [MAIN ] BGY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:41.549169] [DEBUG] [LOCAL ] BGY: Loaded 22790 existing records from primary storage. [2025-09-29T02:11:41.550240] [INFO ] [MAIN ] BGY: Loaded 22790 primary data records. [2025-09-29T02:11:41.887452] [DEBUG] [MAIN ] BGT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:41.898479] [INFO ] [MAIN ] BGT: Generated 1820 derivative records from 16793 primary records. [2025-09-29T02:11:41.898949] [DEBUG] [LOCAL ] BGT: Saving derivative data. [2025-09-29T02:11:41.922467] [DEBUG] [LOCAL ] BGT: Derivative data saved (1820 records). [2025-09-29T02:11:41.936471] [INFO ] [MAIN ] BGT: Successfully saved derivative data. [2025-09-29T02:11:41.936266] [DEBUG] [MAIN ] BGX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:41.938054] [INFO ] [MAIN ] BGX: Generated 1820 derivative records from 10900 primary records. [2025-09-29T02:11:41.938169] [DEBUG] [LOCAL ] BGX: Saving derivative data. [2025-09-29T02:11:41.941090] [INFO ] [MAIN ] Derivative Progress: 247/2211 symbols completed. BGT took 1.2s. Estimated remaining: 13m 55s. Rate: 141.1 symbols/min [2025-09-29T02:11:41.942678] [INFO ] [MAIN ] BH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:41.961638] [DEBUG] [LOCAL ] BGX: Derivative data saved (1820 records). [2025-09-29T02:11:41.961843] [INFO ] [MAIN ] BGX: Successfully saved derivative data. [2025-09-29T02:11:41.964547] [INFO ] [MAIN ] Derivative Progress: 248/2211 symbols completed. BGX took 1.1s. Estimated remaining: 13m 51s. Rate: 141.7 symbols/min [2025-09-29T02:11:41.964931] [INFO ] [MAIN ] BHC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:41.989559] [DEBUG] [MAIN ] BGY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:41.990343] [INFO ] [MAIN ] BGY: Generated 1820 derivative records from 22790 primary records. [2025-09-29T02:11:41.990538] [DEBUG] [LOCAL ] BGY: Saving derivative data. [2025-09-29T02:11:42.010503] [DEBUG] [LOCAL ] BH: Loaded 15938 existing records from primary storage. [2025-09-29T02:11:42.012292] [INFO ] [MAIN ] BH: Loaded 15938 primary data records. [2025-09-29T02:11:42.061672] [DEBUG] [LOCAL ] BGY: Derivative data saved (1820 records). [2025-09-29T02:11:42.078542] [INFO ] [MAIN ] BGY: Successfully saved derivative data. [2025-09-29T02:11:42.134755] [INFO ] [MAIN ] Derivative Progress: 249/2211 symbols completed. BGY took 1.1s. Estimated remaining: 13m 49s. Rate: 142.0 symbols/min [2025-09-29T02:11:42.149452] [INFO ] [MAIN ] BHE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:42.292690] [DEBUG] [LOCAL ] BHC: Loaded 47495 existing records from primary storage. [2025-09-29T02:11:42.450293] [INFO ] [MAIN ] BHC: Loaded 47495 primary data records. [2025-09-29T02:11:42.517864] [DEBUG] [LOCAL ] BHE: Loaded 25353 existing records from primary storage. [2025-09-29T02:11:42.532752] [INFO ] [MAIN ] BHE: Loaded 25353 primary data records. [2025-09-29T02:11:43.158561] [DEBUG] [MAIN ] BH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:43.160403] [INFO ] [MAIN ] BH: Generated 1820 derivative records from 15938 primary records. [2025-09-29T02:11:43.160966] [DEBUG] [LOCAL ] BH: Saving derivative data. [2025-09-29T02:11:43.184499] [DEBUG] [LOCAL ] BH: Derivative data saved (1820 records). [2025-09-29T02:11:43.193383] [INFO ] [MAIN ] BH: Successfully saved derivative data. [2025-09-29T02:11:43.202562] [DEBUG] [MAIN ] BHC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:43.203506] [INFO ] [MAIN ] BHC: Generated 1820 derivative records from 47495 primary records. [2025-09-29T02:11:43.203628] [DEBUG] [LOCAL ] BHC: Saving derivative data. [2025-09-29T02:11:43.202100] [INFO ] [MAIN ] Derivative Progress: 250/2211 symbols completed. BH took 1.3s. Estimated remaining: 13m 53s. Rate: 141.2 symbols/min [2025-09-29T02:11:43.204145] [INFO ] [MAIN ] BHK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:43.236393] [DEBUG] [MAIN ] BHE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:43.238591] [INFO ] [MAIN ] BHE: Generated 1820 derivative records from 25353 primary records. [2025-09-29T02:11:43.239903] [DEBUG] [LOCAL ] BHE: Saving derivative data. [2025-09-29T02:11:43.241617] [DEBUG] [LOCAL ] BHC: Derivative data saved (1820 records). [2025-09-29T02:11:43.242425] [INFO ] [MAIN ] BHC: Successfully saved derivative data. [2025-09-29T02:11:43.245437] [INFO ] [MAIN ] Derivative Progress: 251/2211 symbols completed. BHC took 1.3s. Estimated remaining: 13m 50s. Rate: 141.7 symbols/min [2025-09-29T02:11:43.259106] [INFO ] [MAIN ] BHP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:43.277591] [DEBUG] [LOCAL ] BHE: Derivative data saved (1820 records). [2025-09-29T02:11:43.277982] [INFO ] [MAIN ] BHE: Successfully saved derivative data. [2025-09-29T02:11:43.278847] [DEBUG] [LOCAL ] BHK: Loaded 22922 existing records from primary storage. [2025-09-29T02:11:43.282099] [INFO ] [MAIN ] Derivative Progress: 252/2211 symbols completed. BHE took 1.1s. Estimated remaining: 13m 47s. Rate: 142.2 symbols/min [2025-09-29T02:11:43.282544] [INFO ] [MAIN ] BHK: Loaded 22922 primary data records. [2025-09-29T02:11:43.282682] [INFO ] [MAIN ] BHR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:43.479601] [DEBUG] [LOCAL ] BHR: Loaded 21771 existing records from primary storage. [2025-09-29T02:11:43.487602] [INFO ] [MAIN ] BHR: Loaded 21771 primary data records. [2025-09-29T02:11:43.771001] [DEBUG] [LOCAL ] BHP: Loaded 54153 existing records from primary storage. [2025-09-29T02:11:43.783389] [INFO ] [MAIN ] BHP: Loaded 54153 primary data records. [2025-09-29T02:11:44.410923] [DEBUG] [MAIN ] BHK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:44.413335] [INFO ] [MAIN ] BHK: Generated 1820 derivative records from 22922 primary records. [2025-09-29T02:11:44.413940] [DEBUG] [LOCAL ] BHK: Saving derivative data. [2025-09-29T02:11:44.433719] [DEBUG] [LOCAL ] BHK: Derivative data saved (1820 records). [2025-09-29T02:11:44.434317] [INFO ] [MAIN ] BHK: Successfully saved derivative data. [2025-09-29T02:11:44.437831] [INFO ] [MAIN ] Derivative Progress: 253/2211 symbols completed. BHK took 1.2s. Estimated remaining: 13m 52s. Rate: 141.2 symbols/min [2025-09-29T02:11:44.455775] [DEBUG] [MAIN ] BHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:44.456908] [INFO ] [MAIN ] BHR: Generated 1820 derivative records from 21771 primary records. [2025-09-29T02:11:44.457246] [DEBUG] [LOCAL ] BHR: Saving derivative data. [2025-09-29T02:11:44.475695] [DEBUG] [LOCAL ] BHR: Derivative data saved (1820 records). [2025-09-29T02:11:44.477508] [INFO ] [MAIN ] BHR: Successfully saved derivative data. [2025-09-29T02:11:44.481082] [INFO ] [MAIN ] Derivative Progress: 254/2211 symbols completed. BHR took 1.2s. Estimated remaining: 13m 49s. Rate: 141.7 symbols/min [2025-09-29T02:11:44.493746] [DEBUG] [MAIN ] BHP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:44.494424] [INFO ] [MAIN ] BHP: Generated 1820 derivative records from 54153 primary records. [2025-09-29T02:11:44.494508] [DEBUG] [LOCAL ] BHP: Saving derivative data. [2025-09-29T02:11:44.514495] [DEBUG] [LOCAL ] BHP: Derivative data saved (1820 records). [2025-09-29T02:11:44.514587] [INFO ] [MAIN ] BHP: Successfully saved derivative data. [2025-09-29T02:11:44.517808] [INFO ] [MAIN ] Derivative Progress: 255/2211 symbols completed. BHP took 1.3s. Estimated remaining: 13m 45s. Rate: 142.2 symbols/min [2025-09-29T02:11:44.518372] [INFO ] [MAIN ] BIO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:44.518529] [INFO ] [MAIN ] BILL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:44.518264] [INFO ] [MAIN ] BHVN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:44.564761] [DEBUG] [LOCAL ] BIO: Loaded 25533 existing records from primary storage. [2025-09-29T02:11:44.565163] [INFO ] [MAIN ] BIO: Loaded 25533 primary data records. [2025-09-29T02:11:44.741373] [DEBUG] [LOCAL ] BHVN: Loaded 50401 existing records from primary storage. [2025-09-29T02:11:44.788372] [INFO ] [MAIN ] BHVN: Loaded 50401 primary data records. [2025-09-29T02:11:44.808402] [DEBUG] [LOCAL ] BILL: Loaded 53105 existing records from primary storage. [2025-09-29T02:11:44.937477] [INFO ] [MAIN ] BILL: Loaded 53105 primary data records. [2025-09-29T02:11:45.637242] [DEBUG] [MAIN ] BIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:45.639479] [INFO ] [MAIN ] BIO: Generated 1820 derivative records from 25533 primary records. [2025-09-29T02:11:45.639977] [DEBUG] [LOCAL ] BIO: Saving derivative data. [2025-09-29T02:11:45.658105] [DEBUG] [LOCAL ] BIO: Derivative data saved (1820 records). [2025-09-29T02:11:45.658903] [INFO ] [MAIN ] BIO: Successfully saved derivative data. [2025-09-29T02:11:45.661558] [INFO ] [MAIN ] Derivative Progress: 256/2211 symbols completed. BIO took 1.1s. Estimated remaining: 13m 50s. Rate: 141.3 symbols/min [2025-09-29T02:11:45.662743] [INFO ] [MAIN ] BIP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:45.683426] [DEBUG] [MAIN ] BHVN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:45.697416] [DEBUG] [MAIN ] BILL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:45.697152] [INFO ] [MAIN ] BHVN: Generated 1820 derivative records from 50401 primary records. [2025-09-29T02:11:45.699236] [DEBUG] [LOCAL ] BHVN: Saving derivative data. [2025-09-29T02:11:45.699081] [INFO ] [MAIN ] BILL: Generated 1820 derivative records from 53105 primary records. [2025-09-29T02:11:45.700487] [DEBUG] [LOCAL ] BILL: Saving derivative data. [2025-09-29T02:11:45.730895] [DEBUG] [LOCAL ] BHVN: Derivative data saved (1820 records). [2025-09-29T02:11:45.734626] [DEBUG] [LOCAL ] BILL: Derivative data saved (1820 records). [2025-09-29T02:11:45.733362] [INFO ] [MAIN ] BHVN: Successfully saved derivative data. [2025-09-29T02:11:45.738301] [INFO ] [MAIN ] Derivative Progress: 257/2211 symbols completed. BHVN took 1.2s. Estimated remaining: 13m 47s. Rate: 141.7 symbols/min [2025-09-29T02:11:45.734801] [INFO ] [MAIN ] BILL: Successfully saved derivative data. [2025-09-29T02:11:45.738668] [INFO ] [MAIN ] BIPC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:45.742150] [INFO ] [MAIN ] Derivative Progress: 258/2211 symbols completed. BILL took 1.2s. Estimated remaining: 13m 44s. Rate: 142.3 symbols/min [2025-09-29T02:11:45.742997] [INFO ] [MAIN ] BIPH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:45.758533] [DEBUG] [LOCAL ] BIPH: Loaded 2632 existing records from primary storage. [2025-09-29T02:11:45.758765] [INFO ] [MAIN ] BIPH: Loaded 2632 primary data records. [2025-09-29T02:11:45.896917] [DEBUG] [LOCAL ] BIP: Loaded 40240 existing records from primary storage. [2025-09-29T02:11:45.919047] [INFO ] [MAIN ] BIP: Loaded 40240 primary data records. [2025-09-29T02:11:46.299816] [DEBUG] [LOCAL ] BIPC: Loaded 42317 existing records from primary storage. [2025-09-29T02:11:46.336594] [INFO ] [MAIN ] BIPC: Loaded 42317 primary data records. [2025-09-29T02:11:46.896175] [DEBUG] [MAIN ] BIPH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:46.897903] [INFO ] [MAIN ] BIPH: Generated 1820 derivative records from 2632 primary records. [2025-09-29T02:11:46.898145] [DEBUG] [LOCAL ] BIPH: Saving derivative data. [2025-09-29T02:11:46.927800] [DEBUG] [LOCAL ] BIPH: Derivative data saved (1820 records). [2025-09-29T02:11:46.933865] [DEBUG] [MAIN ] BIP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:46.933317] [INFO ] [MAIN ] BIPH: Successfully saved derivative data. [2025-09-29T02:11:46.934725] [INFO ] [MAIN ] BIP: Generated 1820 derivative records from 40240 primary records. [2025-09-29T02:11:46.937150] [INFO ] [MAIN ] Derivative Progress: 259/2211 symbols completed. BIPH took 1.2s. Estimated remaining: 13m 49s. Rate: 141.3 symbols/min [2025-09-29T02:11:46.937427] [INFO ] [MAIN ] BIPI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:46.937618] [DEBUG] [LOCAL ] BIP: Saving derivative data. [2025-09-29T02:11:46.958095] [DEBUG] [LOCAL ] BIP: Derivative data saved (1820 records). [2025-09-29T02:11:46.961092] [INFO ] [MAIN ] BIP: Successfully saved derivative data. [2025-09-29T02:11:46.964809] [INFO ] [MAIN ] Derivative Progress: 260/2211 symbols completed. BIP took 1.3s. Estimated remaining: 13m 46s. Rate: 141.8 symbols/min [2025-09-29T02:11:46.965387] [INFO ] [MAIN ] BIPJ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:46.961334] [DEBUG] [LOCAL ] BIPI: Loaded 3282 existing records from primary storage. [2025-09-29T02:11:46.966474] [INFO ] [MAIN ] BIPI: Loaded 3282 primary data records. [2025-09-29T02:11:47.056965] [DEBUG] [LOCAL ] BIPJ: Loaded 3026 existing records from primary storage. [2025-09-29T02:11:47.072760] [INFO ] [MAIN ] BIPJ: Loaded 3026 primary data records. [2025-09-29T02:11:47.138269] [DEBUG] [MAIN ] BIPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:47.161961] [INFO ] [MAIN ] BIPC: Generated 1820 derivative records from 42317 primary records. [2025-09-29T02:11:47.162130] [DEBUG] [LOCAL ] BIPC: Saving derivative data. [2025-09-29T02:11:47.268179] [DEBUG] [LOCAL ] BIPC: Derivative data saved (1820 records). [2025-09-29T02:11:47.477820] [INFO ] [MAIN ] BIPC: Successfully saved derivative data. [2025-09-29T02:11:47.487296] [INFO ] [MAIN ] Derivative Progress: 261/2211 symbols completed. BIPC took 1.7s. Estimated remaining: 13m 46s. Rate: 141.7 symbols/min [2025-09-29T02:11:47.519975] [INFO ] [MAIN ] BIRK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:47.726747] [DEBUG] [MAIN ] BIPI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:47.727685] [INFO ] [MAIN ] BIPI: Generated 1820 derivative records from 3282 primary records. [2025-09-29T02:11:47.727841] [DEBUG] [LOCAL ] BIPI: Saving derivative data. [2025-09-29T02:11:47.744502] [DEBUG] [LOCAL ] BIPI: Derivative data saved (1820 records). [2025-09-29T02:11:47.759531] [INFO ] [MAIN ] BIPI: Successfully saved derivative data. [2025-09-29T02:11:47.762119] [INFO ] [MAIN ] Derivative Progress: 262/2211 symbols completed. BIPI took 0.8s. Estimated remaining: 13m 44s. Rate: 141.9 symbols/min [2025-09-29T02:11:47.762772] [INFO ] [MAIN ] BIT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:47.798195] [DEBUG] [MAIN ] BIPJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:47.799133] [INFO ] [MAIN ] BIPJ: Generated 1820 derivative records from 3026 primary records. [2025-09-29T02:11:47.800618] [DEBUG] [LOCAL ] BIRK: Loaded 51674 existing records from primary storage. [2025-09-29T02:11:47.801075] [DEBUG] [LOCAL ] BIPJ: Saving derivative data. [2025-09-29T02:11:47.801315] [INFO ] [MAIN ] BIRK: Loaded 51674 primary data records. [2025-09-29T02:11:47.910121] [DEBUG] [LOCAL ] BIT: Loaded 22765 existing records from primary storage. [2025-09-29T02:11:47.929734] [DEBUG] [LOCAL ] BIPJ: Derivative data saved (1820 records). [2025-09-29T02:11:47.935018] [INFO ] [MAIN ] BIT: Loaded 22765 primary data records. [2025-09-29T02:11:47.961388] [INFO ] [MAIN ] BIPJ: Successfully saved derivative data. [2025-09-29T02:11:48.014088] [INFO ] [MAIN ] Derivative Progress: 263/2211 symbols completed. BIPJ took 1.0s. Estimated remaining: 13m 43s. Rate: 142.1 symbols/min [2025-09-29T02:11:48.079054] [INFO ] [MAIN ] BJ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:48.543616] [DEBUG] [MAIN ] BIRK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:48.545024] [INFO ] [MAIN ] BIRK: Generated 1820 derivative records from 51674 primary records. [2025-09-29T02:11:48.545315] [DEBUG] [LOCAL ] BIRK: Saving derivative data. [2025-09-29T02:11:48.578788] [DEBUG] [MAIN ] BIT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:48.596267] [DEBUG] [LOCAL ] BIRK: Derivative data saved (1820 records). [2025-09-29T02:11:48.599456] [INFO ] [MAIN ] BIT: Generated 1820 derivative records from 22765 primary records. [2025-09-29T02:11:48.599906] [DEBUG] [LOCAL ] BIT: Saving derivative data. [2025-09-29T02:11:48.600016] [INFO ] [MAIN ] BIRK: Successfully saved derivative data. [2025-09-29T02:11:48.604173] [INFO ] [MAIN ] Derivative Progress: 264/2211 symbols completed. BIRK took 1.1s. Estimated remaining: 13m 44s. Rate: 141.9 symbols/min [2025-09-29T02:11:48.604414] [INFO ] [MAIN ] BK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:48.607143] [DEBUG] [LOCAL ] BJ: Loaded 52156 existing records from primary storage. [2025-09-29T02:11:48.614770] [INFO ] [MAIN ] BJ: Loaded 52156 primary data records. [2025-09-29T02:11:48.744263] [DEBUG] [LOCAL ] BIT: Derivative data saved (1820 records). [2025-09-29T02:11:48.768548] [INFO ] [MAIN ] BIT: Successfully saved derivative data. [2025-09-29T02:11:48.771202] [INFO ] [MAIN ] Derivative Progress: 265/2211 symbols completed. BIT took 1.0s. Estimated remaining: 13m 41s. Rate: 142.2 symbols/min [2025-09-29T02:11:48.771424] [INFO ] [MAIN ] BKD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:49.062307] [DEBUG] [LOCAL ] BK: Loaded 54319 existing records from primary storage. [2025-09-29T02:11:49.063509] [INFO ] [MAIN ] BK: Loaded 54319 primary data records. [2025-09-29T02:11:49.420395] [DEBUG] [LOCAL ] BKD: Loaded 50889 existing records from primary storage. [2025-09-29T02:11:49.435738] [INFO ] [MAIN ] BKD: Loaded 50889 primary data records. [2025-09-29T02:11:49.779007] [DEBUG] [MAIN ] BJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:49.796353] [INFO ] [MAIN ] BJ: Generated 1820 derivative records from 52156 primary records. [2025-09-29T02:11:49.796742] [DEBUG] [LOCAL ] BJ: Saving derivative data. [2025-09-29T02:11:49.820717] [DEBUG] [LOCAL ] BJ: Derivative data saved (1820 records). [2025-09-29T02:11:49.821227] [INFO ] [MAIN ] BJ: Successfully saved derivative data. [2025-09-29T02:11:49.825226] [INFO ] [MAIN ] Derivative Progress: 266/2211 symbols completed. BJ took 1.7s. Estimated remaining: 13m 45s. Rate: 141.4 symbols/min [2025-09-29T02:11:49.825968] [INFO ] [MAIN ] BKE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:49.840391] [DEBUG] [MAIN ] BK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:49.841450] [INFO ] [MAIN ] BK: Generated 1820 derivative records from 54319 primary records. [2025-09-29T02:11:49.842025] [DEBUG] [LOCAL ] BK: Saving derivative data. [2025-09-29T02:11:49.864040] [DEBUG] [LOCAL ] BK: Derivative data saved (1820 records). [2025-09-29T02:11:49.865878] [INFO ] [MAIN ] BK: Successfully saved derivative data. [2025-09-29T02:11:49.869014] [INFO ] [MAIN ] Derivative Progress: 267/2211 symbols completed. BK took 1.3s. Estimated remaining: 13m 42s. Rate: 141.9 symbols/min [2025-09-29T02:11:49.869320] [INFO ] [MAIN ] BKH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:49.884454] [DEBUG] [MAIN ] BKD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:49.885405] [INFO ] [MAIN ] BKD: Generated 1820 derivative records from 50889 primary records. [2025-09-29T02:11:49.894687] [DEBUG] [LOCAL ] BKD: Saving derivative data. [2025-09-29T02:11:49.923379] [DEBUG] [LOCAL ] BKE: Loaded 35206 existing records from primary storage. [2025-09-29T02:11:49.924448] [INFO ] [MAIN ] BKE: Loaded 35206 primary data records. [2025-09-29T02:11:49.930461] [DEBUG] [LOCAL ] BKD: Derivative data saved (1820 records). [2025-09-29T02:11:49.973232] [INFO ] [MAIN ] BKD: Successfully saved derivative data. [2025-09-29T02:11:50.017791] [INFO ] [MAIN ] Derivative Progress: 268/2211 symbols completed. BKD took 1.2s. Estimated remaining: 13m 40s. Rate: 142.2 symbols/min [2025-09-29T02:11:50.094673] [DEBUG] [LOCAL ] BKH: Loaded 37133 existing records from primary storage. [2025-09-29T02:11:50.110282] [INFO ] [MAIN ] BKH: Loaded 37133 primary data records. [2025-09-29T02:11:50.656039] [DEBUG] [MAIN ] BKE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:50.657487] [INFO ] [MAIN ] BKE: Generated 1820 derivative records from 35206 primary records. [2025-09-29T02:11:50.657585] [DEBUG] [LOCAL ] BKE: Saving derivative data. [2025-09-29T02:11:50.677364] [DEBUG] [LOCAL ] BKE: Derivative data saved (1820 records). [2025-09-29T02:11:50.677787] [INFO ] [MAIN ] BKE: Successfully saved derivative data. [2025-09-29T02:11:50.680762] [INFO ] [MAIN ] Derivative Progress: 269/2211 symbols completed. BKE took 0.9s. Estimated remaining: 13m 41s. Rate: 141.9 symbols/min [2025-09-29T02:11:50.697391] [DEBUG] [MAIN ] BKH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:50.698139] [INFO ] [MAIN ] BKH: Generated 1820 derivative records from 37133 primary records. [2025-09-29T02:11:50.698243] [DEBUG] [LOCAL ] BKH: Saving derivative data. [2025-09-29T02:11:50.713908] [DEBUG] [LOCAL ] BKH: Derivative data saved (1820 records). [2025-09-29T02:11:50.713996] [INFO ] [MAIN ] BKH: Successfully saved derivative data. [2025-09-29T02:11:50.717076] [INFO ] [MAIN ] Derivative Progress: 270/2211 symbols completed. BKH took 0.8s. Estimated remaining: 13m 38s. Rate: 142.4 symbols/min [2025-09-29T02:11:50.717813] [INFO ] [MAIN ] BKKT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:50.717930] [INFO ] [MAIN ] BKN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:50.718119] [INFO ] [MAIN ] BKSY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:50.733503] [DEBUG] [LOCAL ] BKN: Loaded 7853 existing records from primary storage. [2025-09-29T02:11:50.733876] [INFO ] [MAIN ] BKN: Loaded 7853 primary data records. [2025-09-29T02:11:50.947998] [DEBUG] [LOCAL ] BKKT: Loaded 35164 existing records from primary storage. [2025-09-29T02:11:51.036069] [INFO ] [MAIN ] BKKT: Loaded 35164 primary data records. [2025-09-29T02:11:51.149390] [DEBUG] [LOCAL ] BKSY: Loaded 48993 existing records from primary storage. [2025-09-29T02:11:51.160864] [INFO ] [MAIN ] BKSY: Loaded 48993 primary data records. [2025-09-29T02:11:51.847265] [DEBUG] [MAIN ] BKN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:51.849364] [INFO ] [MAIN ] BKN: Generated 1820 derivative records from 7853 primary records. [2025-09-29T02:11:51.849526] [DEBUG] [LOCAL ] BKN: Saving derivative data. [2025-09-29T02:11:51.869330] [DEBUG] [LOCAL ] BKN: Derivative data saved (1820 records). [2025-09-29T02:11:51.869755] [INFO ] [MAIN ] BKN: Successfully saved derivative data. [2025-09-29T02:11:51.873863] [INFO ] [MAIN ] Derivative Progress: 271/2211 symbols completed. BKN took 1.2s. Estimated remaining: 13m 43s. Rate: 141.5 symbols/min [2025-09-29T02:11:51.874794] [INFO ] [MAIN ] BKT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:51.901194] [DEBUG] [MAIN ] BKKT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:51.919712] [DEBUG] [LOCAL ] BKT: Loaded 11125 existing records from primary storage. [2025-09-29T02:11:51.920759] [INFO ] [MAIN ] BKKT: Generated 1820 derivative records from 35164 primary records. [2025-09-29T02:11:51.921387] [INFO ] [MAIN ] BKT: Loaded 11125 primary data records. [2025-09-29T02:11:51.921157] [DEBUG] [MAIN ] BKSY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:51.946093] [INFO ] [MAIN ] BKSY: Generated 1820 derivative records from 48993 primary records. [2025-09-29T02:11:51.933499] [DEBUG] [LOCAL ] BKKT: Saving derivative data. [2025-09-29T02:11:51.957976] [DEBUG] [LOCAL ] BKSY: Saving derivative data. [2025-09-29T02:11:52.078844] [DEBUG] [LOCAL ] BKSY: Derivative data saved (1820 records). [2025-09-29T02:11:52.079321] [INFO ] [MAIN ] BKSY: Successfully saved derivative data. [2025-09-29T02:11:52.078946] [DEBUG] [LOCAL ] BKKT: Derivative data saved (1820 records). [2025-09-29T02:11:52.082854] [INFO ] [MAIN ] Derivative Progress: 272/2211 symbols completed. BKSY took 1.4s. Estimated remaining: 13m 41s. Rate: 141.7 symbols/min [2025-09-29T02:11:52.088324] [INFO ] [MAIN ] BKU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:52.093696] [INFO ] [MAIN ] BKKT: Successfully saved derivative data. [2025-09-29T02:11:52.117865] [INFO ] [MAIN ] Derivative Progress: 273/2211 symbols completed. BKKT took 1.4s. Estimated remaining: 13m 38s. Rate: 142.2 symbols/min [2025-09-29T02:11:52.141355] [INFO ] [MAIN ] BKV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:52.338259] [DEBUG] [LOCAL ] BKV: Loaded 30278 existing records from primary storage. [2025-09-29T02:11:52.338786] [INFO ] [MAIN ] BKV: Loaded 30278 primary data records. [2025-09-29T02:11:52.469025] [DEBUG] [LOCAL ] BKU: Loaded 42412 existing records from primary storage. [2025-09-29T02:11:52.470940] [INFO ] [MAIN ] BKU: Loaded 42412 primary data records. [2025-09-29T02:11:52.555901] [DEBUG] [MAIN ] BKT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:52.625840] [INFO ] [MAIN ] BKT: Generated 1820 derivative records from 11125 primary records. [2025-09-29T02:11:52.733189] [DEBUG] [LOCAL ] BKT: Saving derivative data. [2025-09-29T02:11:52.945715] [DEBUG] [LOCAL ] BKT: Derivative data saved (1820 records). [2025-09-29T02:11:53.110022] [INFO ] [MAIN ] BKT: Successfully saved derivative data. [2025-09-29T02:11:53.114011] [INFO ] [MAIN ] Derivative Progress: 274/2211 symbols completed. BKT took 1.2s. Estimated remaining: 13m 41s. Rate: 141.5 symbols/min [2025-09-29T02:11:53.116148] [INFO ] [MAIN ] BLCO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:53.142878] [DEBUG] [MAIN ] BKV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:53.144544] [INFO ] [MAIN ] BKV: Generated 1820 derivative records from 30278 primary records. [2025-09-29T02:11:53.144917] [DEBUG] [LOCAL ] BKV: Saving derivative data. [2025-09-29T02:11:53.171241] [DEBUG] [LOCAL ] BKV: Derivative data saved (1820 records). [2025-09-29T02:11:53.171588] [INFO ] [MAIN ] BKV: Successfully saved derivative data. [2025-09-29T02:11:53.176786] [INFO ] [MAIN ] Derivative Progress: 275/2211 symbols completed. BKV took 1.0s. Estimated remaining: 13m 38s. Rate: 142.0 symbols/min [2025-09-29T02:11:53.178107] [INFO ] [MAIN ] BLD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:53.193009] [DEBUG] [MAIN ] BKU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:53.204273] [INFO ] [MAIN ] BKU: Generated 1820 derivative records from 42412 primary records. [2025-09-29T02:11:53.204416] [DEBUG] [LOCAL ] BKU: Saving derivative data. [2025-09-29T02:11:53.215015] [DEBUG] [LOCAL ] BLCO: Loaded 36110 existing records from primary storage. [2025-09-29T02:11:53.215309] [INFO ] [MAIN ] BLCO: Loaded 36110 primary data records. [2025-09-29T02:11:53.236362] [DEBUG] [LOCAL ] BKU: Derivative data saved (1820 records). [2025-09-29T02:11:53.267673] [INFO ] [MAIN ] BKU: Successfully saved derivative data. [2025-09-29T02:11:53.283912] [INFO ] [MAIN ] Derivative Progress: 276/2211 symbols completed. BKU took 1.2s. Estimated remaining: 13m 36s. Rate: 142.3 symbols/min [2025-09-29T02:11:53.312532] [INFO ] [MAIN ] BLDR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:53.362973] [DEBUG] [LOCAL ] BLD: Loaded 28408 existing records from primary storage. [2025-09-29T02:11:53.363146] [INFO ] [MAIN ] BLD: Loaded 28408 primary data records. [2025-09-29T02:11:53.958315] [DEBUG] [LOCAL ] BLDR: Loaded 52403 existing records from primary storage. [2025-09-29T02:11:53.960533] [INFO ] [MAIN ] BLDR: Loaded 52403 primary data records. [2025-09-29T02:11:54.121213] [DEBUG] [MAIN ] BLCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:54.148921] [INFO ] [MAIN ] BLCO: Generated 1820 derivative records from 36110 primary records. [2025-09-29T02:11:54.308614] [DEBUG] [LOCAL ] BLCO: Saving derivative data. [2025-09-29T02:11:54.351017] [DEBUG] [MAIN ] BLD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:54.354417] [DEBUG] [LOCAL ] BLCO: Derivative data saved (1820 records). [2025-09-29T02:11:54.355926] [INFO ] [MAIN ] BLD: Generated 1820 derivative records from 28408 primary records. [2025-09-29T02:11:54.356047] [INFO ] [MAIN ] BLCO: Successfully saved derivative data. [2025-09-29T02:11:54.359375] [INFO ] [MAIN ] Derivative Progress: 277/2211 symbols completed. BLCO took 1.2s. Estimated remaining: 13m 40s. Rate: 141.5 symbols/min [2025-09-29T02:11:54.359586] [DEBUG] [LOCAL ] BLD: Saving derivative data. [2025-09-29T02:11:54.360416] [INFO ] [MAIN ] BLE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:54.379072] [DEBUG] [LOCAL ] BLD: Derivative data saved (1820 records). [2025-09-29T02:11:54.379717] [INFO ] [MAIN ] BLD: Successfully saved derivative data. [2025-09-29T02:11:54.382547] [INFO ] [MAIN ] Derivative Progress: 278/2211 symbols completed. BLD took 1.2s. Estimated remaining: 13m 37s. Rate: 142.0 symbols/min [2025-09-29T02:11:54.383192] [INFO ] [MAIN ] BLK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:54.416468] [DEBUG] [LOCAL ] BLE: Loaded 14718 existing records from primary storage. [2025-09-29T02:11:54.417237] [INFO ] [MAIN ] BLE: Loaded 14718 primary data records. [2025-09-29T02:11:54.416917] [DEBUG] [MAIN ] BLDR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:54.430428] [INFO ] [MAIN ] BLDR: Generated 1820 derivative records from 52403 primary records. [2025-09-29T02:11:54.465541] [DEBUG] [LOCAL ] BLDR: Saving derivative data. [2025-09-29T02:11:54.777442] [DEBUG] [LOCAL ] BLK: Loaded 35240 existing records from primary storage. [2025-09-29T02:11:54.793177] [INFO ] [MAIN ] BLK: Loaded 35240 primary data records. [2025-09-29T02:11:54.794219] [DEBUG] [LOCAL ] BLDR: Derivative data saved (1820 records). [2025-09-29T02:11:54.807974] [INFO ] [MAIN ] BLDR: Successfully saved derivative data. [2025-09-29T02:11:54.840991] [INFO ] [MAIN ] Derivative Progress: 279/2211 symbols completed. BLDR took 1.5s. Estimated remaining: 13m 36s. Rate: 142.0 symbols/min [2025-09-29T02:11:54.856129] [INFO ] [MAIN ] BLND: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:55.214351] [DEBUG] [MAIN ] BLE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:55.229462] [INFO ] [MAIN ] BLE: Generated 1820 derivative records from 14718 primary records. [2025-09-29T02:11:55.229706] [DEBUG] [LOCAL ] BLE: Saving derivative data. [2025-09-29T02:11:55.246569] [DEBUG] [LOCAL ] BLND: Loaded 50107 existing records from primary storage. [2025-09-29T02:11:55.247365] [INFO ] [MAIN ] BLND: Loaded 50107 primary data records. [2025-09-29T02:11:55.265420] [DEBUG] [LOCAL ] BLE: Derivative data saved (1820 records). [2025-09-29T02:11:55.288130] [INFO ] [MAIN ] BLE: Successfully saved derivative data. [2025-09-29T02:11:55.330426] [INFO ] [MAIN ] Derivative Progress: 280/2211 symbols completed. BLE took 1.0s. Estimated remaining: 13m 36s. Rate: 141.9 symbols/min [2025-09-29T02:11:55.363004] [INFO ] [MAIN ] BLW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:55.486679] [DEBUG] [MAIN ] BLK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:55.617934] [INFO ] [MAIN ] BLK: Generated 1820 derivative records from 35240 primary records. [2025-09-29T02:11:55.618326] [DEBUG] [LOCAL ] BLW: Loaded 13044 existing records from primary storage. [2025-09-29T02:11:55.618683] [INFO ] [MAIN ] BLW: Loaded 13044 primary data records. [2025-09-29T02:11:55.618606] [DEBUG] [LOCAL ] BLK: Saving derivative data. [2025-09-29T02:11:55.726242] [DEBUG] [LOCAL ] BLK: Derivative data saved (1820 records). [2025-09-29T02:11:55.739732] [INFO ] [MAIN ] BLK: Successfully saved derivative data. [2025-09-29T02:11:55.755530] [INFO ] [MAIN ] Derivative Progress: 281/2211 symbols completed. BLK took 1.4s. Estimated remaining: 13m 36s. Rate: 141.9 symbols/min [2025-09-29T02:11:55.798913] [INFO ] [MAIN ] BLX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:55.991985] [DEBUG] [LOCAL ] BLX: Loaded 15880 existing records from primary storage. [2025-09-29T02:11:56.005480] [INFO ] [MAIN ] BLX: Loaded 15880 primary data records. [2025-09-29T02:11:56.011362] [DEBUG] [MAIN ] BLND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:56.029934] [INFO ] [MAIN ] BLND: Generated 1820 derivative records from 50107 primary records. [2025-09-29T02:11:56.060442] [DEBUG] [LOCAL ] BLND: Saving derivative data. [2025-09-29T02:11:56.163047] [DEBUG] [LOCAL ] BLND: Derivative data saved (1820 records). [2025-09-29T02:11:56.213618] [INFO ] [MAIN ] BLND: Successfully saved derivative data. [2025-09-29T02:11:56.329340] [INFO ] [MAIN ] Derivative Progress: 282/2211 symbols completed. BLND took 1.5s. Estimated remaining: 13m 37s. Rate: 141.7 symbols/min [2025-09-29T02:11:56.349734] [INFO ] [MAIN ] BMA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:56.370434] [DEBUG] [MAIN ] BLW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:56.371318] [INFO ] [MAIN ] BLW: Generated 1820 derivative records from 13044 primary records. [2025-09-29T02:11:56.371958] [DEBUG] [LOCAL ] BLW: Saving derivative data. [2025-09-29T02:11:56.410448] [DEBUG] [LOCAL ] BLW: Derivative data saved (1820 records). [2025-09-29T02:11:56.410834] [INFO ] [MAIN ] BLW: Successfully saved derivative data. [2025-09-29T02:11:56.414786] [INFO ] [MAIN ] Derivative Progress: 283/2211 symbols completed. BLW took 1.1s. Estimated remaining: 13m 34s. Rate: 142.1 symbols/min [2025-09-29T02:11:56.431357] [DEBUG] [LOCAL ] BMA: Loaded 35645 existing records from primary storage. [2025-09-29T02:11:56.444961] [INFO ] [MAIN ] BMA: Loaded 35645 primary data records. [2025-09-29T02:11:56.444682] [DEBUG] [MAIN ] BLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:56.451255] [INFO ] [MAIN ] BLX: Generated 1820 derivative records from 15880 primary records. [2025-09-29T02:11:56.492777] [DEBUG] [LOCAL ] BLX: Saving derivative data. [2025-09-29T02:11:56.601715] [DEBUG] [LOCAL ] BLX: Derivative data saved (1820 records). [2025-09-29T02:11:56.628878] [INFO ] [MAIN ] BLX: Successfully saved derivative data. [2025-09-29T02:11:56.642480] [INFO ] [MAIN ] Derivative Progress: 284/2211 symbols completed. BLX took 0.8s. Estimated remaining: 13m 32s. Rate: 142.4 symbols/min [2025-09-29T02:11:56.816440] [DEBUG] [MAIN ] BMA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:56.817250] [INFO ] [MAIN ] BMA: Generated 1820 derivative records from 35645 primary records. [2025-09-29T02:11:56.817340] [DEBUG] [LOCAL ] BMA: Saving derivative data. [2025-09-29T02:11:56.833090] [DEBUG] [LOCAL ] BMA: Derivative data saved (1820 records). [2025-09-29T02:11:56.833198] [INFO ] [MAIN ] BMA: Successfully saved derivative data. [2025-09-29T02:11:56.835951] [INFO ] [MAIN ] Derivative Progress: 285/2211 symbols completed. BMA took 0.5s. Estimated remaining: 13m 30s. Rate: 142.6 symbols/min [2025-09-29T02:11:56.836571] [INFO ] [MAIN ] BME: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:56.836744] [INFO ] [MAIN ] BMI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:56.836684] [INFO ] [MAIN ] BMEZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:56.865778] [DEBUG] [LOCAL ] BME: Loaded 10968 existing records from primary storage. [2025-09-29T02:11:56.866105] [INFO ] [MAIN ] BME: Loaded 10968 primary data records. [2025-09-29T02:11:56.982226] [DEBUG] [LOCAL ] BMI: Loaded 24611 existing records from primary storage. [2025-09-29T02:11:56.996697] [INFO ] [MAIN ] BMI: Loaded 24611 primary data records. [2025-09-29T02:11:56.988341] [DEBUG] [LOCAL ] BMEZ: Loaded 26421 existing records from primary storage. [2025-09-29T02:11:57.021781] [INFO ] [MAIN ] BMEZ: Loaded 26421 primary data records. [2025-09-29T02:11:57.955416] [DEBUG] [MAIN ] BME: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:57.957170] [INFO ] [MAIN ] BME: Generated 1820 derivative records from 10968 primary records. [2025-09-29T02:11:57.957802] [DEBUG] [LOCAL ] BME: Saving derivative data. [2025-09-29T02:11:57.981040] [DEBUG] [LOCAL ] BME: Derivative data saved (1820 records). [2025-09-29T02:11:57.983044] [INFO ] [MAIN ] BME: Successfully saved derivative data. [2025-09-29T02:11:57.986446] [INFO ] [MAIN ] Derivative Progress: 286/2211 symbols completed. BME took 1.1s. Estimated remaining: 13m 35s. Rate: 141.8 symbols/min [2025-09-29T02:11:58.000333] [INFO ] [MAIN ] BMN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:58.001144] [DEBUG] [MAIN ] BMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:58.016051] [DEBUG] [MAIN ] BMEZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:58.018223] [INFO ] [MAIN ] BMEZ: Generated 1820 derivative records from 26421 primary records. [2025-09-29T02:11:58.016960] [INFO ] [MAIN ] BMI: Generated 1820 derivative records from 24611 primary records. [2025-09-29T02:11:58.018500] [DEBUG] [LOCAL ] BMEZ: Saving derivative data. [2025-09-29T02:11:58.019515] [DEBUG] [LOCAL ] BMI: Saving derivative data. [2025-09-29T02:11:58.043275] [DEBUG] [LOCAL ] BMN: Loaded 2548 existing records from primary storage. [2025-09-29T02:11:58.047874] [DEBUG] [LOCAL ] BMEZ: Derivative data saved (1820 records). [2025-09-29T02:11:58.052502] [INFO ] [MAIN ] BMN: Loaded 2548 primary data records. [2025-09-29T02:11:58.077890] [INFO ] [MAIN ] BMEZ: Successfully saved derivative data. [2025-09-29T02:11:58.081551] [INFO ] [MAIN ] Derivative Progress: 287/2211 symbols completed. BMEZ took 1.2s. Estimated remaining: 13m 32s. Rate: 142.2 symbols/min [2025-09-29T02:11:58.107978] [INFO ] [MAIN ] BMO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:58.114260] [DEBUG] [LOCAL ] BMI: Derivative data saved (1820 records). [2025-09-29T02:11:58.144738] [INFO ] [MAIN ] BMI: Successfully saved derivative data. [2025-09-29T02:11:58.153119] [INFO ] [MAIN ] Derivative Progress: 288/2211 symbols completed. BMI took 1.3s. Estimated remaining: 13m 29s. Rate: 142.6 symbols/min [2025-09-29T02:11:58.177228] [INFO ] [MAIN ] BMY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:58.422512] [DEBUG] [LOCAL ] BMO: Loaded 41940 existing records from primary storage. [2025-09-29T02:11:58.440165] [INFO ] [MAIN ] BMO: Loaded 41940 primary data records. [2025-09-29T02:11:58.597908] [DEBUG] [MAIN ] BMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:58.591156] [DEBUG] [LOCAL ] BMY: Loaded 54537 existing records from primary storage. [2025-09-29T02:11:58.619600] [INFO ] [MAIN ] BMN: Generated 1820 derivative records from 2548 primary records. [2025-09-29T02:11:58.644408] [INFO ] [MAIN ] BMY: Loaded 54537 primary data records. [2025-09-29T02:11:58.673122] [DEBUG] [LOCAL ] BMN: Saving derivative data. [2025-09-29T02:11:58.880687] [DEBUG] [LOCAL ] BMN: Derivative data saved (1820 records). [2025-09-29T02:11:58.919589] [INFO ] [MAIN ] BMN: Successfully saved derivative data. [2025-09-29T02:11:58.947827] [INFO ] [MAIN ] Derivative Progress: 289/2211 symbols completed. BMN took 0.9s. Estimated remaining: 13m 31s. Rate: 142.1 symbols/min [2025-09-29T02:11:58.976675] [INFO ] [MAIN ] BN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:59.209396] [DEBUG] [MAIN ] BMO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:59.210982] [INFO ] [MAIN ] BMO: Generated 1820 derivative records from 41940 primary records. [2025-09-29T02:11:59.211165] [DEBUG] [LOCAL ] BMO: Saving derivative data. [2025-09-29T02:11:59.230969] [DEBUG] [LOCAL ] BMO: Derivative data saved (1820 records). [2025-09-29T02:11:59.231369] [INFO ] [MAIN ] BMO: Successfully saved derivative data. [2025-09-29T02:11:59.234294] [INFO ] [MAIN ] Derivative Progress: 290/2211 symbols completed. BMO took 1.1s. Estimated remaining: 13m 30s. Rate: 142.3 symbols/min [2025-09-29T02:11:59.249876] [INFO ] [MAIN ] BNED: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:59.271242] [DEBUG] [MAIN ] BMY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:11:59.273162] [INFO ] [MAIN ] BMY: Generated 1820 derivative records from 54537 primary records. [2025-09-29T02:11:59.288325] [DEBUG] [LOCAL ] BMY: Saving derivative data. [2025-09-29T02:11:59.291795] [DEBUG] [LOCAL ] BN: Loaded 53774 existing records from primary storage. [2025-09-29T02:11:59.299772] [INFO ] [MAIN ] BN: Loaded 53774 primary data records. [2025-09-29T02:11:59.320840] [DEBUG] [LOCAL ] BMY: Derivative data saved (1820 records). [2025-09-29T02:11:59.353428] [INFO ] [MAIN ] BMY: Successfully saved derivative data. [2025-09-29T02:11:59.383711] [INFO ] [MAIN ] Derivative Progress: 291/2211 symbols completed. BMY took 1.2s. Estimated remaining: 13m 28s. Rate: 142.6 symbols/min [2025-09-29T02:11:59.413769] [INFO ] [MAIN ] BNH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:11:59.463991] [DEBUG] [LOCAL ] BNED: Loaded 30226 existing records from primary storage. [2025-09-29T02:11:59.469517] [INFO ] [MAIN ] BNED: Loaded 30226 primary data records. [2025-09-29T02:11:59.608219] [DEBUG] [LOCAL ] BNH: Loaded 4926 existing records from primary storage. [2025-09-29T02:11:59.788340] [INFO ] [MAIN ] BNH: Loaded 4926 primary data records. [2025-09-29T02:12:00.400581] [DEBUG] [MAIN ] BN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:00.401675] [INFO ] [MAIN ] BN: Generated 1820 derivative records from 53774 primary records. [2025-09-29T02:12:00.402457] [DEBUG] [LOCAL ] BN: Saving derivative data. [2025-09-29T02:12:00.424127] [DEBUG] [LOCAL ] BN: Derivative data saved (1820 records). [2025-09-29T02:12:00.427427] [INFO ] [MAIN ] BN: Successfully saved derivative data. [2025-09-29T02:12:00.431291] [INFO ] [MAIN ] Derivative Progress: 292/2211 symbols completed. BN took 1.5s. Estimated remaining: 13m 32s. Rate: 141.9 symbols/min [2025-09-29T02:12:00.431932] [INFO ] [MAIN ] BNJ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:00.445514] [DEBUG] [MAIN ] BNED: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:00.448445] [INFO ] [MAIN ] BNED: Generated 1820 derivative records from 30226 primary records. [2025-09-29T02:12:00.449718] [DEBUG] [LOCAL ] BNED: Saving derivative data. [2025-09-29T02:12:00.464916] [DEBUG] [MAIN ] BNH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:00.478776] [INFO ] [MAIN ] BNH: Generated 1820 derivative records from 4926 primary records. [2025-09-29T02:12:00.479063] [DEBUG] [LOCAL ] BNH: Saving derivative data. [2025-09-29T02:12:00.481685] [DEBUG] [LOCAL ] BNJ: Loaded 2631 existing records from primary storage. [2025-09-29T02:12:00.482080] [INFO ] [MAIN ] BNJ: Loaded 2631 primary data records. [2025-09-29T02:12:00.573553] [DEBUG] [LOCAL ] BNH: Derivative data saved (1820 records). [2025-09-29T02:12:00.591865] [DEBUG] [LOCAL ] BNED: Derivative data saved (1820 records). [2025-09-29T02:12:00.592131] [INFO ] [MAIN ] BNH: Successfully saved derivative data. [2025-09-29T02:12:00.592280] [INFO ] [MAIN ] BNED: Successfully saved derivative data. [2025-09-29T02:12:00.607637] [INFO ] [MAIN ] Derivative Progress: 293/2211 symbols completed. BNH took 1.2s. Estimated remaining: 13m 30s. Rate: 142.2 symbols/min [2025-09-29T02:12:00.623802] [INFO ] [MAIN ] BNL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:00.624541] [INFO ] [MAIN ] Derivative Progress: 294/2211 symbols completed. BNED took 1.4s. Estimated remaining: 13m 26s. Rate: 142.6 symbols/min [2025-09-29T02:12:00.640794] [INFO ] [MAIN ] BNS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:00.877596] [DEBUG] [MAIN ] BNJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:00.880498] [INFO ] [MAIN ] BNJ: Generated 1820 derivative records from 2631 primary records. [2025-09-29T02:12:00.912438] [DEBUG] [LOCAL ] BNL: Loaded 47577 existing records from primary storage. [2025-09-29T02:12:00.912681] [DEBUG] [LOCAL ] BNJ: Saving derivative data. [2025-09-29T02:12:00.912866] [INFO ] [MAIN ] BNL: Loaded 47577 primary data records. [2025-09-29T02:12:01.049970] [DEBUG] [LOCAL ] BNS: Loaded 52212 existing records from primary storage. [2025-09-29T02:12:01.077196] [DEBUG] [LOCAL ] BNJ: Derivative data saved (1820 records). [2025-09-29T02:12:01.077482] [INFO ] [MAIN ] BNS: Loaded 52212 primary data records. [2025-09-29T02:12:01.077873] [INFO ] [MAIN ] BNJ: Successfully saved derivative data. [2025-09-29T02:12:01.116272] [INFO ] [MAIN ] Derivative Progress: 295/2211 symbols completed. BNJ took 0.7s. Estimated remaining: 13m 26s. Rate: 142.5 symbols/min [2025-09-29T02:12:01.151065] [INFO ] [MAIN ] BNT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:01.503913] [DEBUG] [LOCAL ] BNT: Loaded 3473 existing records from primary storage. [2025-09-29T02:12:01.530973] [INFO ] [MAIN ] BNT: Loaded 3473 primary data records. [2025-09-29T02:12:01.770268] [DEBUG] [MAIN ] BNL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:01.771401] [INFO ] [MAIN ] BNL: Generated 1820 derivative records from 47577 primary records. [2025-09-29T02:12:01.771512] [DEBUG] [LOCAL ] BNL: Saving derivative data. [2025-09-29T02:12:01.838076] [DEBUG] [LOCAL ] BNL: Derivative data saved (1820 records). [2025-09-29T02:12:01.846748] [INFO ] [MAIN ] BNL: Successfully saved derivative data. [2025-09-29T02:12:01.852095] [INFO ] [MAIN ] Derivative Progress: 296/2211 symbols completed. BNL took 1.2s. Estimated remaining: 13m 28s. Rate: 142.2 symbols/min [2025-09-29T02:12:01.857863] [INFO ] [MAIN ] BNY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:02.182768] [DEBUG] [LOCAL ] BNY: Loaded 7446 existing records from primary storage. [2025-09-29T02:12:02.208225] [INFO ] [MAIN ] BNY: Loaded 7446 primary data records. [2025-09-29T02:12:02.785103] [DEBUG] [MAIN ] BNS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:02.788033] [INFO ] [MAIN ] BNS: Generated 1820 derivative records from 52212 primary records. [2025-09-29T02:12:02.788581] [DEBUG] [LOCAL ] BNS: Saving derivative data. [2025-09-29T02:12:02.820131] [DEBUG] [MAIN ] BNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:02.824040] [INFO ] [MAIN ] BNT: Generated 1820 derivative records from 3473 primary records. [2025-09-29T02:12:02.825233] [DEBUG] [LOCAL ] BNT: Saving derivative data. [2025-09-29T02:12:02.826748] [DEBUG] [LOCAL ] BNS: Derivative data saved (1820 records). [2025-09-29T02:12:02.828170] [INFO ] [MAIN ] BNS: Successfully saved derivative data. [2025-09-29T02:12:02.830971] [INFO ] [MAIN ] Derivative Progress: 297/2211 symbols completed. BNS took 2.2s. Estimated remaining: 13m 31s. Rate: 141.6 symbols/min [2025-09-29T02:12:02.831317] [INFO ] [MAIN ] BOC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:02.847375] [DEBUG] [LOCAL ] BNT: Derivative data saved (1820 records). [2025-09-29T02:12:02.847616] [INFO ] [MAIN ] BNT: Successfully saved derivative data. [2025-09-29T02:12:02.851869] [INFO ] [MAIN ] Derivative Progress: 298/2211 symbols completed. BNT took 1.7s. Estimated remaining: 13m 28s. Rate: 142.0 symbols/min [2025-09-29T02:12:02.867148] [DEBUG] [MAIN ] BNY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:02.867969] [INFO ] [MAIN ] BNY: Generated 1820 derivative records from 7446 primary records. [2025-09-29T02:12:02.868059] [DEBUG] [LOCAL ] BNY: Saving derivative data. [2025-09-29T02:12:02.890929] [DEBUG] [LOCAL ] BNY: Derivative data saved (1820 records). [2025-09-29T02:12:02.891173] [INFO ] [MAIN ] BNY: Successfully saved derivative data. [2025-09-29T02:12:02.893896] [INFO ] [MAIN ] Derivative Progress: 299/2211 symbols completed. BNY took 1.0s. Estimated remaining: 13m 25s. Rate: 142.4 symbols/min [2025-09-29T02:12:02.901827] [DEBUG] [LOCAL ] BOC: Loaded 18626 existing records from primary storage. [2025-09-29T02:12:02.901992] [INFO ] [MAIN ] BOC: Loaded 18626 primary data records. [2025-09-29T02:12:03.239112] [DEBUG] [MAIN ] BOC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:03.239901] [INFO ] [MAIN ] BOC: Generated 1820 derivative records from 18626 primary records. [2025-09-29T02:12:03.239989] [DEBUG] [LOCAL ] BOC: Saving derivative data. [2025-09-29T02:12:03.256300] [DEBUG] [LOCAL ] BOC: Derivative data saved (1820 records). [2025-09-29T02:12:03.256450] [INFO ] [MAIN ] BOC: Successfully saved derivative data. [2025-09-29T02:12:03.259190] [INFO ] [MAIN ] Derivative Progress: 300/2211 symbols completed. BOC took 0.4s. Estimated remaining: 13m 25s. Rate: 142.5 symbols/min [2025-09-29T02:12:03.260014] [INFO ] [MAIN ] BOND: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:03.259874] [INFO ] [MAIN ] BOE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:03.260682] [INFO ] [MAIN ] BOH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:03.292796] [DEBUG] [LOCAL ] BOE: Loaded 17816 existing records from primary storage. [2025-09-29T02:12:03.293157] [INFO ] [MAIN ] BOE: Loaded 17816 primary data records. [2025-09-29T02:12:03.399792] [DEBUG] [LOCAL ] BOND: Loaded 32554 existing records from primary storage. [2025-09-29T02:12:03.436426] [INFO ] [MAIN ] BOND: Loaded 32554 primary data records. [2025-09-29T02:12:03.443421] [DEBUG] [LOCAL ] BOH: Loaded 31676 existing records from primary storage. [2025-09-29T02:12:03.477072] [INFO ] [MAIN ] BOH: Loaded 31676 primary data records. [2025-09-29T02:12:04.445103] [DEBUG] [MAIN ] BOE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:04.447721] [INFO ] [MAIN ] BOE: Generated 1820 derivative records from 17816 primary records. [2025-09-29T02:12:04.449573] [DEBUG] [LOCAL ] BOE: Saving derivative data. [2025-09-29T02:12:04.482506] [DEBUG] [MAIN ] BOND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:04.483432] [INFO ] [MAIN ] BOND: Generated 1820 derivative records from 32554 primary records. [2025-09-29T02:12:04.481911] [DEBUG] [LOCAL ] BOE: Derivative data saved (1820 records). [2025-09-29T02:12:04.483591] [INFO ] [MAIN ] BOE: Successfully saved derivative data. [2025-09-29T02:12:04.483722] [DEBUG] [LOCAL ] BOND: Saving derivative data. [2025-09-29T02:12:04.486928] [INFO ] [MAIN ] Derivative Progress: 301/2211 symbols completed. BOE took 1.2s. Estimated remaining: 13m 29s. Rate: 141.6 symbols/min [2025-09-29T02:12:04.487184] [INFO ] [MAIN ] BOOT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:04.519277] [DEBUG] [MAIN ] BOH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:04.521568] [INFO ] [MAIN ] BOH: Generated 1820 derivative records from 31676 primary records. [2025-09-29T02:12:04.522494] [DEBUG] [LOCAL ] BOH: Saving derivative data. [2025-09-29T02:12:04.536899] [DEBUG] [LOCAL ] BOND: Derivative data saved (1820 records). [2025-09-29T02:12:04.540211] [INFO ] [MAIN ] BOND: Successfully saved derivative data. [2025-09-29T02:12:04.543858] [INFO ] [MAIN ] Derivative Progress: 302/2211 symbols completed. BOND took 1.3s. Estimated remaining: 13m 27s. Rate: 142.0 symbols/min [2025-09-29T02:12:04.544946] [DEBUG] [LOCAL ] BOH: Derivative data saved (1820 records). [2025-09-29T02:12:04.544840] [INFO ] [MAIN ] BORR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:04.545203] [INFO ] [MAIN ] BOH: Successfully saved derivative data. [2025-09-29T02:12:04.549252] [INFO ] [MAIN ] Derivative Progress: 303/2211 symbols completed. BOH took 1.3s. Estimated remaining: 13m 24s. Rate: 142.5 symbols/min [2025-09-29T02:12:04.549771] [INFO ] [MAIN ] BOW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:04.583700] [DEBUG] [LOCAL ] BOOT: Loaded 41409 existing records from primary storage. [2025-09-29T02:12:04.584142] [INFO ] [MAIN ] BOOT: Loaded 41409 primary data records. [2025-09-29T02:12:04.739553] [DEBUG] [LOCAL ] BOW: Loaded 23974 existing records from primary storage. [2025-09-29T02:12:04.750512] [INFO ] [MAIN ] BOW: Loaded 23974 primary data records. [2025-09-29T02:12:05.060139] [DEBUG] [LOCAL ] BORR: Loaded 51902 existing records from primary storage. [2025-09-29T02:12:05.078068] [INFO ] [MAIN ] BORR: Loaded 51902 primary data records. [2025-09-29T02:12:05.678362] [DEBUG] [MAIN ] BOOT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:05.679768] [INFO ] [MAIN ] BOOT: Generated 1820 derivative records from 41409 primary records. [2025-09-29T02:12:05.680040] [DEBUG] [LOCAL ] BOOT: Saving derivative data. [2025-09-29T02:12:05.700394] [DEBUG] [LOCAL ] BOOT: Derivative data saved (1820 records). [2025-09-29T02:12:05.700975] [INFO ] [MAIN ] BOOT: Successfully saved derivative data. [2025-09-29T02:12:05.705063] [INFO ] [MAIN ] Derivative Progress: 304/2211 symbols completed. BOOT took 1.2s. Estimated remaining: 13m 28s. Rate: 141.7 symbols/min [2025-09-29T02:12:05.705548] [INFO ] [MAIN ] BOX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:05.725863] [DEBUG] [MAIN ] BOW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:05.727564] [INFO ] [MAIN ] BOW: Generated 1820 derivative records from 23974 primary records. [2025-09-29T02:12:05.728690] [DEBUG] [LOCAL ] BOW: Saving derivative data. [2025-09-29T02:12:05.753525] [DEBUG] [MAIN ] BORR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:05.759342] [INFO ] [MAIN ] BORR: Generated 1820 derivative records from 51902 primary records. [2025-09-29T02:12:05.763027] [DEBUG] [LOCAL ] BOW: Derivative data saved (1820 records). [2025-09-29T02:12:05.763265] [DEBUG] [LOCAL ] BORR: Saving derivative data. [2025-09-29T02:12:05.764312] [INFO ] [MAIN ] BOW: Successfully saved derivative data. [2025-09-29T02:12:05.767163] [INFO ] [MAIN ] Derivative Progress: 305/2211 symbols completed. BOW took 1.2s. Estimated remaining: 13m 25s. Rate: 142.1 symbols/min [2025-09-29T02:12:05.780744] [INFO ] [MAIN ] BP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:05.785265] [DEBUG] [LOCAL ] BORR: Derivative data saved (1820 records). [2025-09-29T02:12:05.785584] [INFO ] [MAIN ] BORR: Successfully saved derivative data. [2025-09-29T02:12:05.788894] [INFO ] [MAIN ] Derivative Progress: 306/2211 symbols completed. BORR took 1.2s. Estimated remaining: 13m 22s. Rate: 142.5 symbols/min [2025-09-29T02:12:05.789378] [INFO ] [MAIN ] BR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:05.832406] [DEBUG] [LOCAL ] BOX: Loaded 51017 existing records from primary storage. [2025-09-29T02:12:05.832674] [INFO ] [MAIN ] BOX: Loaded 51017 primary data records. [2025-09-29T02:12:06.049819] [DEBUG] [LOCAL ] BR: Loaded 35251 existing records from primary storage. [2025-09-29T02:12:06.076955] [INFO ] [MAIN ] BR: Loaded 35251 primary data records. [2025-09-29T02:12:06.364485] [DEBUG] [LOCAL ] BP: Loaded 54491 existing records from primary storage. [2025-09-29T02:12:06.378161] [INFO ] [MAIN ] BP: Loaded 54491 primary data records. [2025-09-29T02:12:06.955930] [DEBUG] [MAIN ] BOX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:06.957169] [INFO ] [MAIN ] BOX: Generated 1820 derivative records from 51017 primary records. [2025-09-29T02:12:06.958613] [DEBUG] [LOCAL ] BOX: Saving derivative data. [2025-09-29T02:12:06.981683] [DEBUG] [LOCAL ] BOX: Derivative data saved (1820 records). [2025-09-29T02:12:06.994419] [INFO ] [MAIN ] BOX: Successfully saved derivative data. [2025-09-29T02:12:06.997958] [INFO ] [MAIN ] Derivative Progress: 307/2211 symbols completed. BOX took 1.3s. Estimated remaining: 13m 27s. Rate: 141.6 symbols/min [2025-09-29T02:12:06.998260] [INFO ] [MAIN ] BRBR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:07.000016] [DEBUG] [MAIN ] BR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:07.001379] [INFO ] [MAIN ] BR: Generated 1820 derivative records from 35251 primary records. [2025-09-29T02:12:07.001634] [DEBUG] [LOCAL ] BR: Saving derivative data. [2025-09-29T02:12:07.019926] [DEBUG] [LOCAL ] BR: Derivative data saved (1820 records). [2025-09-29T02:12:07.020127] [INFO ] [MAIN ] BR: Successfully saved derivative data. [2025-09-29T02:12:07.023208] [INFO ] [MAIN ] Derivative Progress: 308/2211 symbols completed. BR took 1.2s. Estimated remaining: 13m 24s. Rate: 142.1 symbols/min [2025-09-29T02:12:07.023514] [INFO ] [MAIN ] BRC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:07.040212] [DEBUG] [MAIN ] BP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:07.041033] [INFO ] [MAIN ] BP: Generated 1820 derivative records from 54491 primary records. [2025-09-29T02:12:07.041208] [DEBUG] [LOCAL ] BP: Saving derivative data. [2025-09-29T02:12:07.063946] [DEBUG] [LOCAL ] BP: Derivative data saved (1820 records). [2025-09-29T02:12:07.064116] [INFO ] [MAIN ] BP: Successfully saved derivative data. [2025-09-29T02:12:07.068269] [INFO ] [MAIN ] Derivative Progress: 309/2211 symbols completed. BP took 1.3s. Estimated remaining: 13m 21s. Rate: 142.5 symbols/min [2025-09-29T02:12:07.068556] [INFO ] [MAIN ] BRCC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:07.091718] [DEBUG] [LOCAL ] BRC: Loaded 19567 existing records from primary storage. [2025-09-29T02:12:07.091996] [INFO ] [MAIN ] BRC: Loaded 19567 primary data records. [2025-09-29T02:12:07.261487] [DEBUG] [LOCAL ] BRBR: Loaded 51987 existing records from primary storage. [2025-09-29T02:12:07.314619] [INFO ] [MAIN ] BRBR: Loaded 51987 primary data records. [2025-09-29T02:12:07.458951] [DEBUG] [LOCAL ] BRCC: Loaded 40896 existing records from primary storage. [2025-09-29T02:12:07.496399] [INFO ] [MAIN ] BRCC: Loaded 40896 primary data records. [2025-09-29T02:12:08.144081] [DEBUG] [MAIN ] BRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:08.145395] [INFO ] [MAIN ] BRC: Generated 1820 derivative records from 19567 primary records. [2025-09-29T02:12:08.146292] [DEBUG] [LOCAL ] BRC: Saving derivative data. [2025-09-29T02:12:08.165332] [DEBUG] [LOCAL ] BRC: Derivative data saved (1820 records). [2025-09-29T02:12:08.166927] [INFO ] [MAIN ] BRC: Successfully saved derivative data. [2025-09-29T02:12:08.169981] [INFO ] [MAIN ] Derivative Progress: 310/2211 symbols completed. BRC took 1.1s. Estimated remaining: 13m 25s. Rate: 141.7 symbols/min [2025-09-29T02:12:08.170354] [INFO ] [MAIN ] BRO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:08.191253] [DEBUG] [MAIN ] BRBR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:08.194130] [INFO ] [MAIN ] BRBR: Generated 1820 derivative records from 51987 primary records. [2025-09-29T02:12:08.195249] [DEBUG] [LOCAL ] BRBR: Saving derivative data. [2025-09-29T02:12:08.217876] [DEBUG] [MAIN ] BRCC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:08.222767] [INFO ] [MAIN ] BRCC: Generated 1820 derivative records from 40896 primary records. [2025-09-29T02:12:08.222928] [DEBUG] [LOCAL ] BRCC: Saving derivative data. [2025-09-29T02:12:08.240274] [DEBUG] [LOCAL ] BRBR: Derivative data saved (1820 records). [2025-09-29T02:12:08.241834] [INFO ] [MAIN ] BRBR: Successfully saved derivative data. [2025-09-29T02:12:08.244448] [DEBUG] [LOCAL ] BRCC: Derivative data saved (1820 records). [2025-09-29T02:12:08.247447] [INFO ] [MAIN ] BRCC: Successfully saved derivative data. [2025-09-29T02:12:08.247313] [INFO ] [MAIN ] Derivative Progress: 311/2211 symbols completed. BRBR took 1.2s. Estimated remaining: 13m 22s. Rate: 142.1 symbols/min [2025-09-29T02:12:08.251178] [INFO ] [MAIN ] Derivative Progress: 312/2211 symbols completed. BRCC took 1.2s. Estimated remaining: 13m 19s. Rate: 142.6 symbols/min [2025-09-29T02:12:08.251081] [INFO ] [MAIN ] BROS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:08.251626] [INFO ] [MAIN ] BRSP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:08.307481] [DEBUG] [LOCAL ] BRO: Loaded 52664 existing records from primary storage. [2025-09-29T02:12:08.308042] [INFO ] [MAIN ] BRO: Loaded 52664 primary data records. [2025-09-29T02:12:08.481199] [DEBUG] [LOCAL ] BRSP: Loaded 37442 existing records from primary storage. [2025-09-29T02:12:08.486536] [INFO ] [MAIN ] BRSP: Loaded 37442 primary data records. [2025-09-29T02:12:08.590549] [DEBUG] [LOCAL ] BROS: Loaded 54067 existing records from primary storage. [2025-09-29T02:12:08.808503] [INFO ] [MAIN ] BROS: Loaded 54067 primary data records. [2025-09-29T02:12:09.419946] [DEBUG] [MAIN ] BRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:09.421343] [INFO ] [MAIN ] BRO: Generated 1820 derivative records from 52664 primary records. [2025-09-29T02:12:09.422508] [DEBUG] [LOCAL ] BRO: Saving derivative data. [2025-09-29T02:12:09.453948] [DEBUG] [MAIN ] BRSP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:09.455606] [INFO ] [MAIN ] BRSP: Generated 1820 derivative records from 37442 primary records. [2025-09-29T02:12:09.455787] [DEBUG] [LOCAL ] BRSP: Saving derivative data. [2025-09-29T02:12:09.458457] [DEBUG] [LOCAL ] BRO: Derivative data saved (1820 records). [2025-09-29T02:12:09.459718] [INFO ] [MAIN ] BRO: Successfully saved derivative data. [2025-09-29T02:12:09.463771] [INFO ] [MAIN ] Derivative Progress: 313/2211 symbols completed. BRO took 1.3s. Estimated remaining: 13m 24s. Rate: 141.7 symbols/min [2025-09-29T02:12:09.483005] [DEBUG] [LOCAL ] BRSP: Derivative data saved (1820 records). [2025-09-29T02:12:09.483208] [INFO ] [MAIN ] BRSP: Successfully saved derivative data. [2025-09-29T02:12:09.486218] [INFO ] [MAIN ] Derivative Progress: 314/2211 symbols completed. BRSP took 1.2s. Estimated remaining: 13m 21s. Rate: 142.1 symbols/min [2025-09-29T02:12:09.499911] [DEBUG] [MAIN ] BROS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:09.500680] [INFO ] [MAIN ] BROS: Generated 1820 derivative records from 54067 primary records. [2025-09-29T02:12:09.500769] [DEBUG] [LOCAL ] BROS: Saving derivative data. [2025-09-29T02:12:09.516752] [DEBUG] [LOCAL ] BROS: Derivative data saved (1820 records). [2025-09-29T02:12:09.516866] [INFO ] [MAIN ] BROS: Successfully saved derivative data. [2025-09-29T02:12:09.520238] [INFO ] [MAIN ] Derivative Progress: 315/2211 symbols completed. BROS took 1.3s. Estimated remaining: 13m 18s. Rate: 142.6 symbols/min [2025-09-29T02:12:09.520910] [INFO ] [MAIN ] BRT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:09.520991] [INFO ] [MAIN ] BRX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:09.521361] [INFO ] [MAIN ] BRW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:09.533914] [DEBUG] [LOCAL ] BRT: Loaded 5034 existing records from primary storage. [2025-09-29T02:12:09.534113] [INFO ] [MAIN ] BRT: Loaded 5034 primary data records. [2025-09-29T02:12:09.654353] [DEBUG] [LOCAL ] BRW: Loaded 19862 existing records from primary storage. [2025-09-29T02:12:09.667173] [INFO ] [MAIN ] BRW: Loaded 19862 primary data records. [2025-09-29T02:12:10.060882] [DEBUG] [LOCAL ] BRX: Loaded 52462 existing records from primary storage. [2025-09-29T02:12:10.095871] [INFO ] [MAIN ] BRX: Loaded 52462 primary data records. [2025-09-29T02:12:10.715011] [DEBUG] [MAIN ] BRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:10.714140] [DEBUG] [MAIN ] BRW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:10.717602] [INFO ] [MAIN ] BRT: Generated 1820 derivative records from 5034 primary records. [2025-09-29T02:12:10.718587] [INFO ] [MAIN ] BRW: Generated 1820 derivative records from 19862 primary records. [2025-09-29T02:12:10.718959] [DEBUG] [LOCAL ] BRT: Saving derivative data. [2025-09-29T02:12:10.719504] [DEBUG] [LOCAL ] BRW: Saving derivative data. [2025-09-29T02:12:10.752983] [DEBUG] [LOCAL ] BRT: Derivative data saved (1820 records). [2025-09-29T02:12:10.754970] [DEBUG] [LOCAL ] BRW: Derivative data saved (1820 records). [2025-09-29T02:12:10.755476] [INFO ] [MAIN ] BRT: Successfully saved derivative data. [2025-09-29T02:12:10.755685] [INFO ] [MAIN ] BRW: Successfully saved derivative data. [2025-09-29T02:12:10.758783] [INFO ] [MAIN ] Derivative Progress: 316/2211 symbols completed. BRW took 1.2s. Estimated remaining: 13m 22s. Rate: 141.7 symbols/min [2025-09-29T02:12:10.762323] [INFO ] [MAIN ] Derivative Progress: 317/2211 symbols completed. BRT took 1.2s. Estimated remaining: 13m 20s. Rate: 142.1 symbols/min [2025-09-29T02:12:10.759225] [INFO ] [MAIN ] BSAC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:10.762972] [INFO ] [MAIN ] BSBR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:10.780878] [DEBUG] [MAIN ] BRX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:10.781694] [INFO ] [MAIN ] BRX: Generated 1820 derivative records from 52462 primary records. [2025-09-29T02:12:10.781814] [DEBUG] [LOCAL ] BRX: Saving derivative data. [2025-09-29T02:12:10.799421] [DEBUG] [LOCAL ] BRX: Derivative data saved (1820 records). [2025-09-29T02:12:10.799774] [INFO ] [MAIN ] BRX: Successfully saved derivative data. [2025-09-29T02:12:10.802891] [INFO ] [MAIN ] Derivative Progress: 318/2211 symbols completed. BRX took 1.3s. Estimated remaining: 13m 17s. Rate: 142.5 symbols/min [2025-09-29T02:12:10.811983] [INFO ] [MAIN ] BSL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:10.855299] [DEBUG] [LOCAL ] BSBR: Loaded 35731 existing records from primary storage. [2025-09-29T02:12:10.862066] [INFO ] [MAIN ] BSBR: Loaded 35731 primary data records. [2025-09-29T02:12:10.861951] [DEBUG] [LOCAL ] BSL: Loaded 8196 existing records from primary storage. [2025-09-29T02:12:10.861450] [DEBUG] [LOCAL ] BSAC: Loaded 33389 existing records from primary storage. [2025-09-29T02:12:10.862442] [INFO ] [MAIN ] BSL: Loaded 8196 primary data records. [2025-09-29T02:12:10.862715] [INFO ] [MAIN ] BSAC: Loaded 33389 primary data records. [2025-09-29T02:12:11.903339] [DEBUG] [MAIN ] BSL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:11.931409] [DEBUG] [MAIN ] BSBR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:11.930478] [INFO ] [MAIN ] BSL: Generated 1820 derivative records from 8196 primary records. [2025-09-29T02:12:11.932244] [DEBUG] [LOCAL ] BSL: Saving derivative data. [2025-09-29T02:12:11.933242] [INFO ] [MAIN ] BSBR: Generated 1820 derivative records from 35731 primary records. [2025-09-29T02:12:11.932112] [DEBUG] [MAIN ] BSAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:11.934202] [INFO ] [MAIN ] BSAC: Generated 1820 derivative records from 33389 primary records. [2025-09-29T02:12:11.934279] [DEBUG] [LOCAL ] BSBR: Saving derivative data. [2025-09-29T02:12:11.934395] [DEBUG] [LOCAL ] BSAC: Saving derivative data. [2025-09-29T02:12:11.985410] [DEBUG] [LOCAL ] BSL: Derivative data saved (1820 records). [2025-09-29T02:12:11.986155] [DEBUG] [LOCAL ] BSBR: Derivative data saved (1820 records). [2025-09-29T02:12:11.987735] [INFO ] [MAIN ] BSL: Successfully saved derivative data. [2025-09-29T02:12:11.988274] [INFO ] [MAIN ] BSBR: Successfully saved derivative data. [2025-09-29T02:12:11.987609] [DEBUG] [LOCAL ] BSAC: Derivative data saved (1820 records). [2025-09-29T02:12:11.991088] [INFO ] [MAIN ] BSAC: Successfully saved derivative data. [2025-09-29T02:12:11.990885] [INFO ] [MAIN ] Derivative Progress: 319/2211 symbols completed. BSBR took 1.2s. Estimated remaining: 13m 21s. Rate: 141.7 symbols/min [2025-09-29T02:12:11.997905] [INFO ] [MAIN ] BSM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:11.998171] [INFO ] [MAIN ] Derivative Progress: 320/2211 symbols completed. BSL took 1.2s. Estimated remaining: 13m 18s. Rate: 142.2 symbols/min [2025-09-29T02:12:11.998738] [INFO ] [MAIN ] BST: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:11.998978] [INFO ] [MAIN ] Derivative Progress: 321/2211 symbols completed. BSAC took 1.2s. Estimated remaining: 13m 15s. Rate: 142.6 symbols/min [2025-09-29T02:12:11.999525] [INFO ] [MAIN ] BSTZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:12.035491] [DEBUG] [LOCAL ] BST: Loaded 19385 existing records from primary storage. [2025-09-29T02:12:12.045240] [INFO ] [MAIN ] BST: Loaded 19385 primary data records. [2025-09-29T02:12:12.067261] [DEBUG] [LOCAL ] BSTZ: Loaded 25188 existing records from primary storage. [2025-09-29T02:12:12.096620] [INFO ] [MAIN ] BSTZ: Loaded 25188 primary data records. [2025-09-29T02:12:12.218737] [DEBUG] [LOCAL ] BSM: Loaded 32809 existing records from primary storage. [2025-09-29T02:12:12.248247] [INFO ] [MAIN ] BSM: Loaded 32809 primary data records. [2025-09-29T02:12:13.165978] [DEBUG] [MAIN ] BST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:13.167317] [INFO ] [MAIN ] BST: Generated 1820 derivative records from 19385 primary records. [2025-09-29T02:12:13.167626] [DEBUG] [LOCAL ] BST: Saving derivative data. [2025-09-29T02:12:13.188540] [DEBUG] [LOCAL ] BST: Derivative data saved (1820 records). [2025-09-29T02:12:13.190831] [INFO ] [MAIN ] BST: Successfully saved derivative data. [2025-09-29T02:12:13.195292] [INFO ] [MAIN ] Derivative Progress: 322/2211 symbols completed. BST took 1.2s. Estimated remaining: 13m 19s. Rate: 141.8 symbols/min [2025-09-29T02:12:13.196040] [INFO ] [MAIN ] BSX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:13.210671] [DEBUG] [MAIN ] BSTZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:13.213587] [INFO ] [MAIN ] BSTZ: Generated 1820 derivative records from 25188 primary records. [2025-09-29T02:12:13.215488] [DEBUG] [LOCAL ] BSTZ: Saving derivative data. [2025-09-29T02:12:13.237798] [DEBUG] [MAIN ] BSM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:13.244254] [INFO ] [MAIN ] BSM: Generated 1820 derivative records from 32809 primary records. [2025-09-29T02:12:13.245235] [DEBUG] [LOCAL ] BSM: Saving derivative data. [2025-09-29T02:12:13.262915] [DEBUG] [LOCAL ] BSTZ: Derivative data saved (1820 records). [2025-09-29T02:12:13.263821] [INFO ] [MAIN ] BSTZ: Successfully saved derivative data. [2025-09-29T02:12:13.268625] [INFO ] [MAIN ] Derivative Progress: 323/2211 symbols completed. BSTZ took 1.3s. Estimated remaining: 13m 17s. Rate: 142.2 symbols/min [2025-09-29T02:12:13.269170] [INFO ] [MAIN ] BTA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:13.273487] [DEBUG] [LOCAL ] BSM: Derivative data saved (1820 records). [2025-09-29T02:12:13.274016] [INFO ] [MAIN ] BSM: Successfully saved derivative data. [2025-09-29T02:12:13.277208] [INFO ] [MAIN ] Derivative Progress: 324/2211 symbols completed. BSM took 1.3s. Estimated remaining: 13m 14s. Rate: 142.6 symbols/min [2025-09-29T02:12:13.277484] [INFO ] [MAIN ] BTCM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:13.298973] [DEBUG] [LOCAL ] BTA: Loaded 5464 existing records from primary storage. [2025-09-29T02:12:13.299176] [INFO ] [MAIN ] BTA: Loaded 5464 primary data records. [2025-09-29T02:12:13.440726] [DEBUG] [LOCAL ] BSX: Loaded 54468 existing records from primary storage. [2025-09-29T02:12:13.457821] [INFO ] [MAIN ] BSX: Loaded 54468 primary data records. [2025-09-29T02:12:13.500439] [DEBUG] [LOCAL ] BTCM: Loaded 15122 existing records from primary storage. [2025-09-29T02:12:13.556098] [INFO ] [MAIN ] BTCM: Loaded 15122 primary data records. [2025-09-29T02:12:14.370194] [DEBUG] [MAIN ] BTA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:14.371992] [INFO ] [MAIN ] BTA: Generated 1820 derivative records from 5464 primary records. [2025-09-29T02:12:14.372423] [DEBUG] [LOCAL ] BTA: Saving derivative data. [2025-09-29T02:12:14.394871] [DEBUG] [LOCAL ] BTA: Derivative data saved (1820 records). [2025-09-29T02:12:14.397082] [INFO ] [MAIN ] BTA: Successfully saved derivative data. [2025-09-29T02:12:14.401270] [INFO ] [MAIN ] Derivative Progress: 325/2211 symbols completed. BTA took 1.1s. Estimated remaining: 13m 18s. Rate: 141.9 symbols/min [2025-09-29T02:12:14.415267] [INFO ] [MAIN ] BTE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:14.415786] [DEBUG] [MAIN ] BSX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:14.417405] [INFO ] [MAIN ] BSX: Generated 1820 derivative records from 54468 primary records. [2025-09-29T02:12:14.417800] [DEBUG] [LOCAL ] BSX: Saving derivative data. [2025-09-29T02:12:14.456128] [DEBUG] [MAIN ] BTCM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:14.456333] [DEBUG] [LOCAL ] BSX: Derivative data saved (1820 records). [2025-09-29T02:12:14.456714] [INFO ] [MAIN ] BSX: Successfully saved derivative data. [2025-09-29T02:12:14.460729] [INFO ] [MAIN ] Derivative Progress: 326/2211 symbols completed. BSX took 1.3s. Estimated remaining: 13m 15s. Rate: 142.2 symbols/min [2025-09-29T02:12:14.461734] [INFO ] [MAIN ] BTCM: Generated 1820 derivative records from 15122 primary records. [2025-09-29T02:12:14.461920] [INFO ] [MAIN ] BTI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:14.462133] [DEBUG] [LOCAL ] BTCM: Saving derivative data. [2025-09-29T02:12:14.479373] [DEBUG] [LOCAL ] BTCM: Derivative data saved (1820 records). [2025-09-29T02:12:14.479578] [INFO ] [MAIN ] BTCM: Successfully saved derivative data. [2025-09-29T02:12:14.482831] [INFO ] [MAIN ] Derivative Progress: 327/2211 symbols completed. BTCM took 1.2s. Estimated remaining: 13m 12s. Rate: 142.6 symbols/min [2025-09-29T02:12:14.483599] [INFO ] [MAIN ] BTO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:14.513783] [DEBUG] [LOCAL ] BTO: Loaded 8982 existing records from primary storage. [2025-09-29T02:12:14.517975] [INFO ] [MAIN ] BTO: Loaded 8982 primary data records. [2025-09-29T02:12:14.585796] [DEBUG] [LOCAL ] BTE: Loaded 53505 existing records from primary storage. [2025-09-29T02:12:14.591295] [INFO ] [MAIN ] BTE: Loaded 53505 primary data records. [2025-09-29T02:12:14.810495] [DEBUG] [LOCAL ] BTI: Loaded 54335 existing records from primary storage. [2025-09-29T02:12:14.874697] [INFO ] [MAIN ] BTI: Loaded 54335 primary data records. [2025-09-29T02:12:15.682065] [DEBUG] [MAIN ] BTO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:15.684239] [INFO ] [MAIN ] BTO: Generated 1820 derivative records from 8982 primary records. [2025-09-29T02:12:15.686352] [DEBUG] [LOCAL ] BTO: Saving derivative data. [2025-09-29T02:12:15.715912] [DEBUG] [MAIN ] BTE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:15.729182] [INFO ] [MAIN ] BTE: Generated 1820 derivative records from 53505 primary records. [2025-09-29T02:12:15.727497] [DEBUG] [LOCAL ] BTO: Derivative data saved (1820 records). [2025-09-29T02:12:15.730774] [DEBUG] [LOCAL ] BTE: Saving derivative data. [2025-09-29T02:12:15.730933] [INFO ] [MAIN ] BTO: Successfully saved derivative data. [2025-09-29T02:12:15.735405] [INFO ] [MAIN ] Derivative Progress: 328/2211 symbols completed. BTO took 1.3s. Estimated remaining: 13m 17s. Rate: 141.8 symbols/min [2025-09-29T02:12:15.769692] [DEBUG] [MAIN ] BTI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:15.771328] [INFO ] [MAIN ] BTI: Generated 1820 derivative records from 54335 primary records. [2025-09-29T02:12:15.773203] [DEBUG] [LOCAL ] BTI: Saving derivative data. [2025-09-29T02:12:15.786615] [DEBUG] [LOCAL ] BTE: Derivative data saved (1820 records). [2025-09-29T02:12:15.789623] [INFO ] [MAIN ] BTE: Successfully saved derivative data. [2025-09-29T02:12:15.794165] [INFO ] [MAIN ] Derivative Progress: 329/2211 symbols completed. BTE took 1.4s. Estimated remaining: 13m 14s. Rate: 142.2 symbols/min [2025-09-29T02:12:15.798425] [DEBUG] [LOCAL ] BTI: Derivative data saved (1820 records). [2025-09-29T02:12:15.798515] [INFO ] [MAIN ] BTI: Successfully saved derivative data. [2025-09-29T02:12:15.802357] [INFO ] [MAIN ] Derivative Progress: 330/2211 symbols completed. BTI took 1.3s. Estimated remaining: 13m 11s. Rate: 142.6 symbols/min [2025-09-29T02:12:15.802903] [INFO ] [MAIN ] BTT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:15.802984] [INFO ] [MAIN ] BTZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:15.803035] [INFO ] [MAIN ] BTU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:15.824379] [DEBUG] [LOCAL ] BTT: Loaded 16126 existing records from primary storage. [2025-09-29T02:12:15.824799] [INFO ] [MAIN ] BTT: Loaded 16126 primary data records. [2025-09-29T02:12:15.978362] [DEBUG] [LOCAL ] BTZ: Loaded 23002 existing records from primary storage. [2025-09-29T02:12:15.989670] [INFO ] [MAIN ] BTZ: Loaded 23002 primary data records. [2025-09-29T02:12:16.259003] [DEBUG] [LOCAL ] BTU: Loaded 54082 existing records from primary storage. [2025-09-29T02:12:16.273835] [INFO ] [MAIN ] BTU: Loaded 54082 primary data records. [2025-09-29T02:12:16.911525] [DEBUG] [MAIN ] BTT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:16.913262] [INFO ] [MAIN ] BTT: Generated 1820 derivative records from 16126 primary records. [2025-09-29T02:12:16.913673] [DEBUG] [LOCAL ] BTT: Saving derivative data. [2025-09-29T02:12:16.933226] [DEBUG] [LOCAL ] BTT: Derivative data saved (1820 records). [2025-09-29T02:12:16.934582] [INFO ] [MAIN ] BTT: Successfully saved derivative data. [2025-09-29T02:12:16.939117] [INFO ] [MAIN ] Derivative Progress: 331/2211 symbols completed. BTT took 1.1s. Estimated remaining: 13m 15s. Rate: 141.9 symbols/min [2025-09-29T02:12:16.939959] [INFO ] [MAIN ] BUD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:16.954534] [DEBUG] [MAIN ] BTZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:16.955593] [INFO ] [MAIN ] BTZ: Generated 1820 derivative records from 23002 primary records. [2025-09-29T02:12:16.955888] [DEBUG] [LOCAL ] BTZ: Saving derivative data. [2025-09-29T02:12:16.987096] [DEBUG] [MAIN ] BTU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:16.990197] [DEBUG] [LOCAL ] BTZ: Derivative data saved (1820 records). [2025-09-29T02:12:16.991306] [INFO ] [MAIN ] BTU: Generated 1820 derivative records from 54082 primary records. [2025-09-29T02:12:16.991421] [DEBUG] [LOCAL ] BTU: Saving derivative data. [2025-09-29T02:12:16.991457] [INFO ] [MAIN ] BTZ: Successfully saved derivative data. [2025-09-29T02:12:16.995260] [INFO ] [MAIN ] Derivative Progress: 332/2211 symbols completed. BTZ took 1.2s. Estimated remaining: 13m 13s. Rate: 142.2 symbols/min [2025-09-29T02:12:17.003339] [INFO ] [MAIN ] BUI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:17.012920] [DEBUG] [LOCAL ] BTU: Derivative data saved (1820 records). [2025-09-29T02:12:17.013049] [INFO ] [MAIN ] BTU: Successfully saved derivative data. [2025-09-29T02:12:17.016022] [INFO ] [MAIN ] Derivative Progress: 333/2211 symbols completed. BTU took 1.2s. Estimated remaining: 13m 10s. Rate: 142.6 symbols/min [2025-09-29T02:12:17.016277] [INFO ] [MAIN ] BUR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:17.044502] [DEBUG] [LOCAL ] BUI: Loaded 11615 existing records from primary storage. [2025-09-29T02:12:17.044701] [INFO ] [MAIN ] BUI: Loaded 11615 primary data records. [2025-09-29T02:12:17.186031] [DEBUG] [LOCAL ] BUD: Loaded 53504 existing records from primary storage. [2025-09-29T02:12:17.191218] [INFO ] [MAIN ] BUD: Loaded 53504 primary data records. [2025-09-29T02:12:17.576807] [DEBUG] [LOCAL ] BUR: Loaded 45700 existing records from primary storage. [2025-09-29T02:12:17.594151] [INFO ] [MAIN ] BUR: Loaded 45700 primary data records. [2025-09-29T02:12:18.153178] [DEBUG] [MAIN ] BUI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:18.154360] [INFO ] [MAIN ] BUI: Generated 1820 derivative records from 11615 primary records. [2025-09-29T02:12:18.154621] [DEBUG] [LOCAL ] BUI: Saving derivative data. [2025-09-29T02:12:18.174145] [DEBUG] [LOCAL ] BUI: Derivative data saved (1820 records). [2025-09-29T02:12:18.178385] [INFO ] [MAIN ] BUI: Successfully saved derivative data. [2025-09-29T02:12:18.181832] [INFO ] [MAIN ] Derivative Progress: 334/2211 symbols completed. BUI took 1.2s. Estimated remaining: 13m 14s. Rate: 141.9 symbols/min [2025-09-29T02:12:18.182388] [INFO ] [MAIN ] BURL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:18.197783] [DEBUG] [MAIN ] BUD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:18.198902] [INFO ] [MAIN ] BUD: Generated 1820 derivative records from 53504 primary records. [2025-09-29T02:12:18.199298] [DEBUG] [LOCAL ] BUD: Saving derivative data. [2025-09-29T02:12:18.221093] [DEBUG] [LOCAL ] BUD: Derivative data saved (1820 records). [2025-09-29T02:12:18.221376] [INFO ] [MAIN ] BUD: Successfully saved derivative data. [2025-09-29T02:12:18.225584] [INFO ] [MAIN ] Derivative Progress: 335/2211 symbols completed. BUD took 1.3s. Estimated remaining: 13m 11s. Rate: 142.3 symbols/min [2025-09-29T02:12:18.239026] [INFO ] [MAIN ] BUXX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:18.239347] [DEBUG] [MAIN ] BUR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:18.240967] [INFO ] [MAIN ] BUR: Generated 1820 derivative records from 45700 primary records. [2025-09-29T02:12:18.241191] [DEBUG] [LOCAL ] BUR: Saving derivative data. [2025-09-29T02:12:18.270391] [DEBUG] [LOCAL ] BUR: Derivative data saved (1820 records). [2025-09-29T02:12:18.270802] [INFO ] [MAIN ] BUR: Successfully saved derivative data. [2025-09-29T02:12:18.274866] [INFO ] [MAIN ] Derivative Progress: 336/2211 symbols completed. BUR took 1.3s. Estimated remaining: 13m 9s. Rate: 142.6 symbols/min [2025-09-29T02:12:18.279022] [INFO ] [MAIN ] BV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:18.289412] [DEBUG] [LOCAL ] BUXX: Loaded 15364 existing records from primary storage. [2025-09-29T02:12:18.302026] [INFO ] [MAIN ] BUXX: Loaded 15364 primary data records. [2025-09-29T02:12:18.328687] [DEBUG] [LOCAL ] BURL: Loaded 46896 existing records from primary storage. [2025-09-29T02:12:18.352413] [INFO ] [MAIN ] BURL: Loaded 46896 primary data records. [2025-09-29T02:12:18.687459] [DEBUG] [LOCAL ] BV: Loaded 39048 existing records from primary storage. [2025-09-29T02:12:18.856515] [INFO ] [MAIN ] BV: Loaded 39048 primary data records. [2025-09-29T02:12:19.442320] [DEBUG] [MAIN ] BURL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:19.442001] [DEBUG] [MAIN ] BUXX: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:12:19.445518] [INFO ] [MAIN ] BURL: Generated 1820 derivative records from 46896 primary records. [2025-09-29T02:12:19.445986] [DEBUG] [LOCAL ] BURL: Saving derivative data. [2025-09-29T02:12:19.444457] [INFO ] [MAIN ] BUXX: Generated 1819 derivative records from 15364 primary records. [2025-09-29T02:12:19.447248] [DEBUG] [LOCAL ] BUXX: Saving derivative data. [2025-09-29T02:12:19.477774] [DEBUG] [LOCAL ] BUXX: Derivative data saved (1819 records). [2025-09-29T02:12:19.481594] [INFO ] [MAIN ] BUXX: Successfully saved derivative data. [2025-09-29T02:12:19.483370] [DEBUG] [LOCAL ] BURL: Derivative data saved (1820 records). [2025-09-29T02:12:19.483559] [INFO ] [MAIN ] BURL: Successfully saved derivative data. [2025-09-29T02:12:19.486942] [INFO ] [MAIN ] Derivative Progress: 337/2211 symbols completed. BUXX took 1.2s. Estimated remaining: 13m 13s. Rate: 141.9 symbols/min [2025-09-29T02:12:19.487392] [INFO ] [MAIN ] BVN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:19.491953] [INFO ] [MAIN ] Derivative Progress: 338/2211 symbols completed. BURL took 1.3s. Estimated remaining: 13m 10s. Rate: 142.3 symbols/min [2025-09-29T02:12:19.492338] [INFO ] [MAIN ] BW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:19.510629] [DEBUG] [MAIN ] BV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:19.511666] [INFO ] [MAIN ] BV: Generated 1820 derivative records from 39048 primary records. [2025-09-29T02:12:19.511772] [DEBUG] [LOCAL ] BV: Saving derivative data. [2025-09-29T02:12:19.535505] [DEBUG] [LOCAL ] BV: Derivative data saved (1820 records). [2025-09-29T02:12:19.535767] [INFO ] [MAIN ] BV: Successfully saved derivative data. [2025-09-29T02:12:19.539489] [INFO ] [MAIN ] Derivative Progress: 339/2211 symbols completed. BV took 1.3s. Estimated remaining: 13m 7s. Rate: 142.6 symbols/min [2025-09-29T02:12:19.539914] [INFO ] [MAIN ] BWA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:19.600188] [DEBUG] [LOCAL ] BVN: Loaded 44520 existing records from primary storage. [2025-09-29T02:12:19.601687] [INFO ] [MAIN ] BVN: Loaded 44520 primary data records. [2025-09-29T02:12:19.601357] [DEBUG] [LOCAL ] BW: Loaded 40297 existing records from primary storage. [2025-09-29T02:12:19.601852] [INFO ] [MAIN ] BW: Loaded 40297 primary data records. [2025-09-29T02:12:19.835274] [DEBUG] [LOCAL ] BWA: Loaded 52976 existing records from primary storage. [2025-09-29T02:12:19.905310] [INFO ] [MAIN ] BWA: Loaded 52976 primary data records. [2025-09-29T02:12:20.698334] [DEBUG] [MAIN ] BVN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:20.712034] [DEBUG] [MAIN ] BW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:20.713115] [INFO ] [MAIN ] BVN: Generated 1820 derivative records from 44520 primary records. [2025-09-29T02:12:20.713415] [DEBUG] [LOCAL ] BVN: Saving derivative data. [2025-09-29T02:12:20.715210] [INFO ] [MAIN ] BW: Generated 1820 derivative records from 40297 primary records. [2025-09-29T02:12:20.715414] [DEBUG] [LOCAL ] BW: Saving derivative data. [2025-09-29T02:12:20.750140] [DEBUG] [LOCAL ] BW: Derivative data saved (1820 records). [2025-09-29T02:12:20.751562] [DEBUG] [LOCAL ] BVN: Derivative data saved (1820 records). [2025-09-29T02:12:20.765349] [DEBUG] [MAIN ] BWA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:20.764574] [INFO ] [MAIN ] BW: Successfully saved derivative data. [2025-09-29T02:12:20.766709] [INFO ] [MAIN ] BWA: Generated 1820 derivative records from 52976 primary records. [2025-09-29T02:12:20.765705] [INFO ] [MAIN ] BVN: Successfully saved derivative data. [2025-09-29T02:12:20.769832] [INFO ] [MAIN ] Derivative Progress: 340/2211 symbols completed. BW took 1.3s. Estimated remaining: 13m 11s. Rate: 141.8 symbols/min [2025-09-29T02:12:20.770371] [INFO ] [MAIN ] BWG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:20.773591] [INFO ] [MAIN ] Derivative Progress: 341/2211 symbols completed. BVN took 1.3s. Estimated remaining: 13m 9s. Rate: 142.3 symbols/min [2025-09-29T02:12:20.770123] [DEBUG] [LOCAL ] BWA: Saving derivative data. [2025-09-29T02:12:20.774008] [INFO ] [MAIN ] BWLP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:20.794665] [DEBUG] [LOCAL ] BWA: Derivative data saved (1820 records). [2025-09-29T02:12:20.794978] [INFO ] [MAIN ] BWA: Successfully saved derivative data. [2025-09-29T02:12:20.798639] [INFO ] [MAIN ] Derivative Progress: 342/2211 symbols completed. BWA took 1.3s. Estimated remaining: 13m 6s. Rate: 142.6 symbols/min [2025-09-29T02:12:20.799053] [INFO ] [MAIN ] BWMX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:20.811323] [DEBUG] [LOCAL ] BWG: Loaded 12478 existing records from primary storage. [2025-09-29T02:12:20.811730] [INFO ] [MAIN ] BWG: Loaded 12478 primary data records. [2025-09-29T02:12:20.888167] [DEBUG] [LOCAL ] BWMX: Loaded 7676 existing records from primary storage. [2025-09-29T02:12:20.924307] [INFO ] [MAIN ] BWMX: Loaded 7676 primary data records. [2025-09-29T02:12:20.977582] [DEBUG] [LOCAL ] BWLP: Loaded 33185 existing records from primary storage. [2025-09-29T02:12:21.017369] [INFO ] [MAIN ] BWLP: Loaded 33185 primary data records. [2025-09-29T02:12:21.952822] [DEBUG] [MAIN ] BWG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:21.954514] [INFO ] [MAIN ] BWG: Generated 1820 derivative records from 12478 primary records. [2025-09-29T02:12:21.963071] [DEBUG] [LOCAL ] BWG: Saving derivative data. [2025-09-29T02:12:21.969564] [DEBUG] [MAIN ] BWMX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:21.978499] [INFO ] [MAIN ] BWMX: Generated 1820 derivative records from 7676 primary records. [2025-09-29T02:12:21.984913] [DEBUG] [LOCAL ] BWMX: Saving derivative data. [2025-09-29T02:12:21.988989] [DEBUG] [LOCAL ] BWG: Derivative data saved (1820 records). [2025-09-29T02:12:21.989507] [INFO ] [MAIN ] BWG: Successfully saved derivative data. [2025-09-29T02:12:22.001422] [INFO ] [MAIN ] Derivative Progress: 343/2211 symbols completed. BWG took 1.2s. Estimated remaining: 13m 10s. Rate: 141.9 symbols/min [2025-09-29T02:12:22.024035] [DEBUG] [LOCAL ] BWMX: Derivative data saved (1820 records). [2025-09-29T02:12:22.024948] [INFO ] [MAIN ] BWMX: Successfully saved derivative data. [2025-09-29T02:12:22.024858] [DEBUG] [MAIN ] BWLP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:22.028033] [INFO ] [MAIN ] Derivative Progress: 344/2211 symbols completed. BWMX took 1.2s. Estimated remaining: 13m 7s. Rate: 142.3 symbols/min [2025-09-29T02:12:22.029015] [INFO ] [MAIN ] BWLP: Generated 1820 derivative records from 33185 primary records. [2025-09-29T02:12:22.029115] [DEBUG] [LOCAL ] BWLP: Saving derivative data. [2025-09-29T02:12:22.045529] [DEBUG] [LOCAL ] BWLP: Derivative data saved (1820 records). [2025-09-29T02:12:22.045682] [INFO ] [MAIN ] BWLP: Successfully saved derivative data. [2025-09-29T02:12:22.048946] [INFO ] [MAIN ] Derivative Progress: 345/2211 symbols completed. BWLP took 1.3s. Estimated remaining: 13m 5s. Rate: 142.7 symbols/min [2025-09-29T02:12:22.049497] [INFO ] [MAIN ] BWNB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:22.049608] [INFO ] [MAIN ] BWXT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:22.049690] [INFO ] [MAIN ] BWSN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:22.065203] [DEBUG] [LOCAL ] BWNB: Loaded 4468 existing records from primary storage. [2025-09-29T02:12:22.068290] [DEBUG] [LOCAL ] BWSN: Loaded 5130 existing records from primary storage. [2025-09-29T02:12:22.068627] [INFO ] [MAIN ] BWSN: Loaded 5130 primary data records. [2025-09-29T02:12:22.068539] [INFO ] [MAIN ] BWNB: Loaded 4468 primary data records. [2025-09-29T02:12:22.736552] [DEBUG] [LOCAL ] BWXT: Loaded 47442 existing records from primary storage. [2025-09-29T02:12:22.737173] [INFO ] [MAIN ] BWXT: Loaded 47442 primary data records. [2025-09-29T02:12:23.097896] [DEBUG] [MAIN ] BWNB: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:12:23.099445] [INFO ] [MAIN ] BWNB: Generated 1819 derivative records from 4468 primary records. [2025-09-29T02:12:23.099963] [DEBUG] [LOCAL ] BWNB: Saving derivative data. [2025-09-29T02:12:23.127377] [DEBUG] [MAIN ] BWSN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:23.132293] [INFO ] [MAIN ] BWSN: Generated 1820 derivative records from 5130 primary records. [2025-09-29T02:12:23.131189] [DEBUG] [LOCAL ] BWNB: Derivative data saved (1819 records). [2025-09-29T02:12:23.132863] [DEBUG] [LOCAL ] BWSN: Saving derivative data. [2025-09-29T02:12:23.132972] [INFO ] [MAIN ] BWNB: Successfully saved derivative data. [2025-09-29T02:12:23.136949] [INFO ] [MAIN ] Derivative Progress: 346/2211 symbols completed. BWNB took 1.1s. Estimated remaining: 13m 8s. Rate: 142.0 symbols/min [2025-09-29T02:12:23.137962] [INFO ] [MAIN ] BX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:23.153156] [DEBUG] [LOCAL ] BWSN: Derivative data saved (1820 records). [2025-09-29T02:12:23.153408] [INFO ] [MAIN ] BWSN: Successfully saved derivative data. [2025-09-29T02:12:23.157814] [INFO ] [MAIN ] Derivative Progress: 347/2211 symbols completed. BWSN took 1.1s. Estimated remaining: 13m 5s. Rate: 142.4 symbols/min [2025-09-29T02:12:23.158396] [INFO ] [MAIN ] BXC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:23.176637] [DEBUG] [MAIN ] BWXT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:23.181693] [INFO ] [MAIN ] BWXT: Generated 1820 derivative records from 47442 primary records. [2025-09-29T02:12:23.181804] [DEBUG] [LOCAL ] BWXT: Saving derivative data. [2025-09-29T02:12:23.206689] [DEBUG] [LOCAL ] BXC: Loaded 13880 existing records from primary storage. [2025-09-29T02:12:23.206850] [DEBUG] [LOCAL ] BWXT: Derivative data saved (1820 records). [2025-09-29T02:12:23.207213] [INFO ] [MAIN ] BWXT: Successfully saved derivative data. [2025-09-29T02:12:23.207118] [INFO ] [MAIN ] BXC: Loaded 13880 primary data records. [2025-09-29T02:12:23.210675] [INFO ] [MAIN ] Derivative Progress: 348/2211 symbols completed. BWXT took 1.2s. Estimated remaining: 13m 3s. Rate: 142.8 symbols/min [2025-09-29T02:12:23.211109] [INFO ] [MAIN ] BXMT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:23.496940] [DEBUG] [LOCAL ] BX: Loaded 54270 existing records from primary storage. [2025-09-29T02:12:23.627091] [INFO ] [MAIN ] BX: Loaded 54270 primary data records. [2025-09-29T02:12:23.806639] [DEBUG] [LOCAL ] BXMT: Loaded 47994 existing records from primary storage. [2025-09-29T02:12:23.807570] [INFO ] [MAIN ] BXMT: Loaded 47994 primary data records. [2025-09-29T02:12:24.233496] [DEBUG] [MAIN ] BXC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:24.373596] [INFO ] [MAIN ] BXC: Generated 1820 derivative records from 13880 primary records. [2025-09-29T02:12:24.374258] [DEBUG] [LOCAL ] BXC: Saving derivative data. [2025-09-29T02:12:24.397638] [DEBUG] [LOCAL ] BXC: Derivative data saved (1820 records). [2025-09-29T02:12:24.398547] [INFO ] [MAIN ] BXC: Successfully saved derivative data. [2025-09-29T02:12:24.401217] [INFO ] [MAIN ] Derivative Progress: 349/2211 symbols completed. BXC took 1.2s. Estimated remaining: 13m 7s. Rate: 142.0 symbols/min [2025-09-29T02:12:24.401751] [INFO ] [MAIN ] BXMX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:24.421003] [DEBUG] [MAIN ] BX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:24.422256] [INFO ] [MAIN ] BX: Generated 1820 derivative records from 54270 primary records. [2025-09-29T02:12:24.422383] [DEBUG] [LOCAL ] BX: Saving derivative data. [2025-09-29T02:12:24.445443] [DEBUG] [LOCAL ] BX: Derivative data saved (1820 records). [2025-09-29T02:12:24.445982] [INFO ] [MAIN ] BX: Successfully saved derivative data. [2025-09-29T02:12:24.449183] [INFO ] [MAIN ] Derivative Progress: 350/2211 symbols completed. BX took 1.3s. Estimated remaining: 13m 4s. Rate: 142.4 symbols/min [2025-09-29T02:12:24.449910] [INFO ] [MAIN ] BXP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:24.461611] [DEBUG] [LOCAL ] BXMX: Loaded 19855 existing records from primary storage. [2025-09-29T02:12:24.462187] [INFO ] [MAIN ] BXMX: Loaded 19855 primary data records. [2025-09-29T02:12:24.510193] [DEBUG] [MAIN ] BXMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:24.537352] [INFO ] [MAIN ] BXMT: Generated 1820 derivative records from 47994 primary records. [2025-09-29T02:12:24.565821] [DEBUG] [LOCAL ] BXMT: Saving derivative data. [2025-09-29T02:12:24.841939] [DEBUG] [LOCAL ] BXMT: Derivative data saved (1820 records). [2025-09-29T02:12:24.842451] [INFO ] [MAIN ] BXMT: Successfully saved derivative data. [2025-09-29T02:12:24.845789] [INFO ] [MAIN ] Derivative Progress: 351/2211 symbols completed. BXMT took 1.6s. Estimated remaining: 13m 4s. Rate: 142.4 symbols/min [2025-09-29T02:12:24.846121] [INFO ] [MAIN ] BXSL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:24.868198] [DEBUG] [LOCAL ] BXP: Loaded 50577 existing records from primary storage. [2025-09-29T02:12:24.868909] [INFO ] [MAIN ] BXP: Loaded 50577 primary data records. [2025-09-29T02:12:25.239406] [DEBUG] [LOCAL ] BXSL: Loaded 48276 existing records from primary storage. [2025-09-29T02:12:25.239982] [INFO ] [MAIN ] BXSL: Loaded 48276 primary data records. [2025-09-29T02:12:25.315591] [DEBUG] [MAIN ] BXMX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:25.339010] [INFO ] [MAIN ] BXMX: Generated 1820 derivative records from 19855 primary records. [2025-09-29T02:12:25.365139] [DEBUG] [LOCAL ] BXMX: Saving derivative data. [2025-09-29T02:12:25.477332] [DEBUG] [LOCAL ] BXMX: Derivative data saved (1820 records). [2025-09-29T02:12:25.590995] [INFO ] [MAIN ] BXMX: Successfully saved derivative data. [2025-09-29T02:12:25.604438] [INFO ] [MAIN ] Derivative Progress: 352/2211 symbols completed. BXMX took 1.2s. Estimated remaining: 13m 5s. Rate: 142.1 symbols/min [2025-09-29T02:12:25.605219] [INFO ] [MAIN ] BY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:25.627457] [DEBUG] [MAIN ] BXP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:25.629235] [INFO ] [MAIN ] BXP: Generated 1820 derivative records from 50577 primary records. [2025-09-29T02:12:25.629669] [DEBUG] [LOCAL ] BXP: Saving derivative data. [2025-09-29T02:12:25.671064] [DEBUG] [LOCAL ] BY: Loaded 21895 existing records from primary storage. [2025-09-29T02:12:25.672103] [INFO ] [MAIN ] BY: Loaded 21895 primary data records. [2025-09-29T02:12:25.674805] [DEBUG] [LOCAL ] BXP: Derivative data saved (1820 records). [2025-09-29T02:12:25.703227] [INFO ] [MAIN ] BXP: Successfully saved derivative data. [2025-09-29T02:12:25.727807] [INFO ] [MAIN ] Derivative Progress: 353/2211 symbols completed. BXP took 1.3s. Estimated remaining: 13m 3s. Rate: 142.4 symbols/min [2025-09-29T02:12:25.748700] [INFO ] [MAIN ] BYD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:25.844984] [DEBUG] [MAIN ] BXSL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:25.908755] [INFO ] [MAIN ] BXSL: Generated 1820 derivative records from 48276 primary records. [2025-09-29T02:12:26.081967] [DEBUG] [LOCAL ] BXSL: Saving derivative data. [2025-09-29T02:12:26.109676] [DEBUG] [LOCAL ] BXSL: Derivative data saved (1820 records). [2025-09-29T02:12:26.110564] [INFO ] [MAIN ] BXSL: Successfully saved derivative data. [2025-09-29T02:12:26.114077] [INFO ] [MAIN ] Derivative Progress: 354/2211 symbols completed. BXSL took 1.3s. Estimated remaining: 13m 3s. Rate: 142.4 symbols/min [2025-09-29T02:12:26.115201] [INFO ] [MAIN ] BYM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:26.168602] [DEBUG] [LOCAL ] BYD: Loaded 45804 existing records from primary storage. [2025-09-29T02:12:26.174489] [INFO ] [MAIN ] BYD: Loaded 45804 primary data records. [2025-09-29T02:12:26.174935] [DEBUG] [MAIN ] BY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:26.175611] [DEBUG] [LOCAL ] BYM: Loaded 12225 existing records from primary storage. [2025-09-29T02:12:26.176869] [INFO ] [MAIN ] BY: Generated 1820 derivative records from 21895 primary records. [2025-09-29T02:12:26.177135] [DEBUG] [LOCAL ] BY: Saving derivative data. [2025-09-29T02:12:26.177197] [INFO ] [MAIN ] BYM: Loaded 12225 primary data records. [2025-09-29T02:12:26.464693] [DEBUG] [LOCAL ] BY: Derivative data saved (1820 records). [2025-09-29T02:12:26.505100] [INFO ] [MAIN ] BY: Successfully saved derivative data. [2025-09-29T02:12:26.739889] [INFO ] [MAIN ] Derivative Progress: 355/2211 symbols completed. BY took 1.1s. Estimated remaining: 13m 3s. Rate: 142.2 symbols/min [2025-09-29T02:12:26.757336] [INFO ] [MAIN ] BZH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:26.952289] [DEBUG] [LOCAL ] BZH: Loaded 33088 existing records from primary storage. [2025-09-29T02:12:26.946262] [DEBUG] [MAIN ] BYD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:26.953013] [INFO ] [MAIN ] BZH: Loaded 33088 primary data records. [2025-09-29T02:12:26.952959] [DEBUG] [MAIN ] BYM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:26.953859] [INFO ] [MAIN ] BYD: Generated 1820 derivative records from 45804 primary records. [2025-09-29T02:12:26.965588] [DEBUG] [LOCAL ] BYD: Saving derivative data. [2025-09-29T02:12:26.971523] [INFO ] [MAIN ] BYM: Generated 1820 derivative records from 12225 primary records. [2025-09-29T02:12:26.991206] [DEBUG] [LOCAL ] BYM: Saving derivative data. [2025-09-29T02:12:27.125751] [DEBUG] [LOCAL ] BYD: Derivative data saved (1820 records). [2025-09-29T02:12:27.142110] [DEBUG] [LOCAL ] BYM: Derivative data saved (1820 records). [2025-09-29T02:12:27.171174] [INFO ] [MAIN ] BYM: Successfully saved derivative data. [2025-09-29T02:12:27.167039] [INFO ] [MAIN ] BYD: Successfully saved derivative data. [2025-09-29T02:12:27.318554] [INFO ] [MAIN ] Derivative Progress: 356/2211 symbols completed. BYM took 1.2s. Estimated remaining: 13m 4s. Rate: 142.0 symbols/min [2025-09-29T02:12:27.338381] [INFO ] [MAIN ] C: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:27.338502] [INFO ] [MAIN ] Derivative Progress: 357/2211 symbols completed. BYD took 1.6s. Estimated remaining: 13m 1s. Rate: 142.4 symbols/min [2025-09-29T02:12:27.338976] [INFO ] [MAIN ] CAAP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:27.371442] [DEBUG] [LOCAL ] CAAP: Loaded 20021 existing records from primary storage. [2025-09-29T02:12:27.372128] [INFO ] [MAIN ] CAAP: Loaded 20021 primary data records. [2025-09-29T02:12:27.542464] [DEBUG] [MAIN ] BZH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:27.613463] [INFO ] [MAIN ] BZH: Generated 1820 derivative records from 33088 primary records. [2025-09-29T02:12:27.754012] [DEBUG] [LOCAL ] C: Loaded 54521 existing records from primary storage. [2025-09-29T02:12:27.743284] [DEBUG] [LOCAL ] BZH: Saving derivative data. [2025-09-29T02:12:27.755082] [INFO ] [MAIN ] C: Loaded 54521 primary data records. [2025-09-29T02:12:27.867961] [DEBUG] [LOCAL ] BZH: Derivative data saved (1820 records). [2025-09-29T02:12:27.888174] [INFO ] [MAIN ] BZH: Successfully saved derivative data. [2025-09-29T02:12:27.891855] [INFO ] [MAIN ] Derivative Progress: 358/2211 symbols completed. BZH took 1.1s. Estimated remaining: 13m 1s. Rate: 142.3 symbols/min [2025-09-29T02:12:28.166696] [DEBUG] [MAIN ] CAAP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:28.172168] [INFO ] [MAIN ] CAAP: Generated 1820 derivative records from 20021 primary records. [2025-09-29T02:12:28.172319] [DEBUG] [LOCAL ] CAAP: Saving derivative data. [2025-09-29T02:12:28.194417] [DEBUG] [LOCAL ] CAAP: Derivative data saved (1820 records). [2025-09-29T02:12:28.194635] [INFO ] [MAIN ] CAAP: Successfully saved derivative data. [2025-09-29T02:12:28.198296] [INFO ] [MAIN ] Derivative Progress: 359/2211 symbols completed. CAAP took 0.9s. Estimated remaining: 13m 0s. Rate: 142.4 symbols/min [2025-09-29T02:12:28.219158] [DEBUG] [MAIN ] C: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:28.219952] [INFO ] [MAIN ] C: Generated 1820 derivative records from 54521 primary records. [2025-09-29T02:12:28.220056] [DEBUG] [LOCAL ] C: Saving derivative data. [2025-09-29T02:12:28.235866] [DEBUG] [LOCAL ] C: Derivative data saved (1820 records). [2025-09-29T02:12:28.235987] [INFO ] [MAIN ] C: Successfully saved derivative data. [2025-09-29T02:12:28.239943] [INFO ] [MAIN ] Derivative Progress: 360/2211 symbols completed. C took 0.9s. Estimated remaining: 12m 58s. Rate: 142.8 symbols/min [2025-09-29T02:12:28.240550] [INFO ] [MAIN ] CADE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:28.240762] [INFO ] [MAIN ] CACI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:28.240462] [INFO ] [MAIN ] CABO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:28.282194] [DEBUG] [LOCAL ] CABO: Loaded 17549 existing records from primary storage. [2025-09-29T02:12:28.292429] [INFO ] [MAIN ] CABO: Loaded 17549 primary data records. [2025-09-29T02:12:28.435804] [DEBUG] [LOCAL ] CADE: Loaded 49496 existing records from primary storage. [2025-09-29T02:12:28.420251] [DEBUG] [LOCAL ] CACI: Loaded 25384 existing records from primary storage. [2025-09-29T02:12:28.436184] [INFO ] [MAIN ] CADE: Loaded 49496 primary data records. [2025-09-29T02:12:28.436322] [INFO ] [MAIN ] CACI: Loaded 25384 primary data records. [2025-09-29T02:12:29.382331] [DEBUG] [MAIN ] CABO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:29.384445] [INFO ] [MAIN ] CABO: Generated 1820 derivative records from 17549 primary records. [2025-09-29T02:12:29.384815] [DEBUG] [LOCAL ] CABO: Saving derivative data. [2025-09-29T02:12:29.422018] [DEBUG] [LOCAL ] CABO: Derivative data saved (1820 records). [2025-09-29T02:12:29.422526] [DEBUG] [MAIN ] CADE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:29.424992] [INFO ] [MAIN ] CADE: Generated 1820 derivative records from 49496 primary records. [2025-09-29T02:12:29.425141] [DEBUG] [LOCAL ] CADE: Saving derivative data. [2025-09-29T02:12:29.423956] [INFO ] [MAIN ] CABO: Successfully saved derivative data. [2025-09-29T02:12:29.442233] [INFO ] [MAIN ] Derivative Progress: 361/2211 symbols completed. CABO took 1.2s. Estimated remaining: 13m 2s. Rate: 142.0 symbols/min [2025-09-29T02:12:29.442874] [DEBUG] [MAIN ] CACI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:29.452422] [INFO ] [MAIN ] CACI: Generated 1820 derivative records from 25384 primary records. [2025-09-29T02:12:29.443383] [INFO ] [MAIN ] CAE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:29.457387] [DEBUG] [LOCAL ] CACI: Saving derivative data. [2025-09-29T02:12:29.479977] [DEBUG] [LOCAL ] CADE: Derivative data saved (1820 records). [2025-09-29T02:12:29.479794] [DEBUG] [LOCAL ] CACI: Derivative data saved (1820 records). [2025-09-29T02:12:29.480299] [INFO ] [MAIN ] CADE: Successfully saved derivative data. [2025-09-29T02:12:29.480380] [INFO ] [MAIN ] CACI: Successfully saved derivative data. [2025-09-29T02:12:29.483667] [INFO ] [MAIN ] Derivative Progress: 362/2211 symbols completed. CADE took 1.2s. Estimated remaining: 12m 59s. Rate: 142.4 symbols/min [2025-09-29T02:12:29.487767] [INFO ] [MAIN ] CAF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:29.487977] [INFO ] [MAIN ] Derivative Progress: 363/2211 symbols completed. CACI took 1.2s. Estimated remaining: 12m 57s. Rate: 142.8 symbols/min [2025-09-29T02:12:29.488787] [INFO ] [MAIN ] CAG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:29.496574] [DEBUG] [LOCAL ] CAF: Loaded 3471 existing records from primary storage. [2025-09-29T02:12:29.497067] [INFO ] [MAIN ] CAF: Loaded 3471 primary data records. [2025-09-29T02:12:29.662095] [DEBUG] [LOCAL ] CAE: Loaded 39622 existing records from primary storage. [2025-09-29T02:12:29.672762] [INFO ] [MAIN ] CAE: Loaded 39622 primary data records. [2025-09-29T02:12:30.045512] [DEBUG] [LOCAL ] CAG: Loaded 54439 existing records from primary storage. [2025-09-29T02:12:30.079860] [INFO ] [MAIN ] CAG: Loaded 54439 primary data records. [2025-09-29T02:12:30.667955] [DEBUG] [MAIN ] CAF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:30.669973] [INFO ] [MAIN ] CAF: Generated 1820 derivative records from 3471 primary records. [2025-09-29T02:12:30.670721] [DEBUG] [LOCAL ] CAF: Saving derivative data. [2025-09-29T02:12:30.688587] [DEBUG] [LOCAL ] CAF: Derivative data saved (1820 records). [2025-09-29T02:12:30.688825] [INFO ] [MAIN ] CAF: Successfully saved derivative data. [2025-09-29T02:12:30.691498] [INFO ] [MAIN ] Derivative Progress: 364/2211 symbols completed. CAF took 1.2s. Estimated remaining: 13m 0s. Rate: 142.1 symbols/min [2025-09-29T02:12:30.691960] [INFO ] [MAIN ] CAH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:30.714224] [DEBUG] [MAIN ] CAE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:30.715897] [INFO ] [MAIN ] CAE: Generated 1820 derivative records from 39622 primary records. [2025-09-29T02:12:30.716299] [DEBUG] [LOCAL ] CAE: Saving derivative data. [2025-09-29T02:12:30.736846] [DEBUG] [LOCAL ] CAE: Derivative data saved (1820 records). [2025-09-29T02:12:30.737025] [INFO ] [MAIN ] CAE: Successfully saved derivative data. [2025-09-29T02:12:30.740055] [INFO ] [MAIN ] Derivative Progress: 365/2211 symbols completed. CAE took 1.3s. Estimated remaining: 12m 58s. Rate: 142.4 symbols/min [2025-09-29T02:12:30.748512] [INFO ] [MAIN ] CAL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:30.754509] [DEBUG] [MAIN ] CAG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:30.755859] [INFO ] [MAIN ] CAG: Generated 1820 derivative records from 54439 primary records. [2025-09-29T02:12:30.756141] [DEBUG] [LOCAL ] CAG: Saving derivative data. [2025-09-29T02:12:30.774008] [DEBUG] [LOCAL ] CAG: Derivative data saved (1820 records). [2025-09-29T02:12:30.788279] [INFO ] [MAIN ] CAG: Successfully saved derivative data. [2025-09-29T02:12:30.791386] [INFO ] [MAIN ] Derivative Progress: 366/2211 symbols completed. CAG took 1.3s. Estimated remaining: 12m 56s. Rate: 142.7 symbols/min [2025-09-29T02:12:30.791919] [INFO ] [MAIN ] CALX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:30.817821] [DEBUG] [LOCAL ] CAH: Loaded 52209 existing records from primary storage. [2025-09-29T02:12:30.818196] [INFO ] [MAIN ] CAH: Loaded 52209 primary data records. [2025-09-29T02:12:31.042920] [DEBUG] [LOCAL ] CALX: Loaded 38931 existing records from primary storage. [2025-09-29T02:12:31.072801] [DEBUG] [LOCAL ] CAL: Loaded 43833 existing records from primary storage. [2025-09-29T02:12:31.078955] [INFO ] [MAIN ] CAL: Loaded 43833 primary data records. [2025-09-29T02:12:31.193213] [INFO ] [MAIN ] CALX: Loaded 38931 primary data records. [2025-09-29T02:12:31.901298] [DEBUG] [MAIN ] CAH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:31.903712] [INFO ] [MAIN ] CAH: Generated 1820 derivative records from 52209 primary records. [2025-09-29T02:12:31.904220] [DEBUG] [LOCAL ] CAH: Saving derivative data. [2025-09-29T02:12:31.928621] [DEBUG] [LOCAL ] CAH: Derivative data saved (1820 records). [2025-09-29T02:12:31.930039] [INFO ] [MAIN ] CAH: Successfully saved derivative data. [2025-09-29T02:12:31.933334] [INFO ] [MAIN ] Derivative Progress: 367/2211 symbols completed. CAH took 1.2s. Estimated remaining: 12m 59s. Rate: 142.1 symbols/min [2025-09-29T02:12:31.934085] [INFO ] [MAIN ] CANG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:31.957352] [DEBUG] [MAIN ] CAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:31.958715] [INFO ] [MAIN ] CAL: Generated 1820 derivative records from 43833 primary records. [2025-09-29T02:12:31.959038] [DEBUG] [LOCAL ] CAL: Saving derivative data. [2025-09-29T02:12:31.981827] [DEBUG] [MAIN ] CALX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:31.987909] [INFO ] [MAIN ] CALX: Generated 1820 derivative records from 38931 primary records. [2025-09-29T02:12:31.998178] [DEBUG] [LOCAL ] CALX: Saving derivative data. [2025-09-29T02:12:32.033712] [DEBUG] [LOCAL ] CALX: Derivative data saved (1820 records). [2025-09-29T02:12:32.034693] [DEBUG] [LOCAL ] CAL: Derivative data saved (1820 records). [2025-09-29T02:12:32.036321] [DEBUG] [LOCAL ] CANG: Loaded 27132 existing records from primary storage. [2025-09-29T02:12:32.036548] [INFO ] [MAIN ] CAL: Successfully saved derivative data. [2025-09-29T02:12:32.036801] [INFO ] [MAIN ] CALX: Successfully saved derivative data. [2025-09-29T02:12:32.040855] [INFO ] [MAIN ] Derivative Progress: 368/2211 symbols completed. CAL took 1.3s. Estimated remaining: 12m 57s. Rate: 142.4 symbols/min [2025-09-29T02:12:32.036670] [INFO ] [MAIN ] CANG: Loaded 27132 primary data records. [2025-09-29T02:12:32.044897] [INFO ] [MAIN ] CAPL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:32.050422] [INFO ] [MAIN ] Derivative Progress: 369/2211 symbols completed. CALX took 1.3s. Estimated remaining: 12m 54s. Rate: 142.7 symbols/min [2025-09-29T02:12:32.065903] [INFO ] [MAIN ] CARR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:32.162136] [DEBUG] [LOCAL ] CAPL: Loaded 5930 existing records from primary storage. [2025-09-29T02:12:32.190054] [INFO ] [MAIN ] CAPL: Loaded 5930 primary data records. [2025-09-29T02:12:32.691502] [DEBUG] [LOCAL ] CARR: Loaded 54374 existing records from primary storage. [2025-09-29T02:12:32.699250] [INFO ] [MAIN ] CARR: Loaded 54374 primary data records. [2025-09-29T02:12:33.197890] [DEBUG] [MAIN ] CANG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:33.199437] [INFO ] [MAIN ] CANG: Generated 1820 derivative records from 27132 primary records. [2025-09-29T02:12:33.199778] [DEBUG] [LOCAL ] CANG: Saving derivative data. [2025-09-29T02:12:33.223431] [DEBUG] [LOCAL ] CANG: Derivative data saved (1820 records). [2025-09-29T02:12:33.238027] [INFO ] [MAIN ] CANG: Successfully saved derivative data. [2025-09-29T02:12:33.238965] [DEBUG] [MAIN ] CAPL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:33.243461] [INFO ] [MAIN ] Derivative Progress: 370/2211 symbols completed. CANG took 1.3s. Estimated remaining: 12m 58s. Rate: 142.0 symbols/min [2025-09-29T02:12:33.244088] [INFO ] [MAIN ] CARS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:33.245203] [INFO ] [MAIN ] CAPL: Generated 1820 derivative records from 5930 primary records. [2025-09-29T02:12:33.247866] [DEBUG] [LOCAL ] CAPL: Saving derivative data. [2025-09-29T02:12:33.267742] [DEBUG] [LOCAL ] CAPL: Derivative data saved (1820 records). [2025-09-29T02:12:33.268288] [INFO ] [MAIN ] CAPL: Successfully saved derivative data. [2025-09-29T02:12:33.271721] [INFO ] [MAIN ] Derivative Progress: 371/2211 symbols completed. CAPL took 1.2s. Estimated remaining: 12m 55s. Rate: 142.4 symbols/min [2025-09-29T02:12:33.271970] [INFO ] [MAIN ] CAT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:33.290585] [DEBUG] [MAIN ] CARR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:33.291454] [INFO ] [MAIN ] CARR: Generated 1820 derivative records from 54374 primary records. [2025-09-29T02:12:33.291612] [DEBUG] [LOCAL ] CARR: Saving derivative data. [2025-09-29T02:12:33.318396] [DEBUG] [LOCAL ] CARR: Derivative data saved (1820 records). [2025-09-29T02:12:33.318692] [INFO ] [MAIN ] CARR: Successfully saved derivative data. [2025-09-29T02:12:33.322372] [INFO ] [MAIN ] Derivative Progress: 372/2211 symbols completed. CARR took 1.3s. Estimated remaining: 12m 53s. Rate: 142.7 symbols/min [2025-09-29T02:12:33.322974] [INFO ] [MAIN ] CATO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:33.339115] [DEBUG] [LOCAL ] CARS: Loaded 40616 existing records from primary storage. [2025-09-29T02:12:33.339370] [INFO ] [MAIN ] CARS: Loaded 40616 primary data records. [2025-09-29T02:12:33.437086] [DEBUG] [LOCAL ] CATO: Loaded 7286 existing records from primary storage. [2025-09-29T02:12:33.444903] [INFO ] [MAIN ] CATO: Loaded 7286 primary data records. [2025-09-29T02:12:33.660443] [DEBUG] [LOCAL ] CAT: Loaded 53693 existing records from primary storage. [2025-09-29T02:12:33.822777] [INFO ] [MAIN ] CAT: Loaded 53693 primary data records. [2025-09-29T02:12:34.490952] [DEBUG] [MAIN ] CARS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:34.491840] [DEBUG] [MAIN ] CATO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:34.493609] [INFO ] [MAIN ] CARS: Generated 1820 derivative records from 40616 primary records. [2025-09-29T02:12:34.495492] [DEBUG] [LOCAL ] CARS: Saving derivative data. [2025-09-29T02:12:34.494844] [INFO ] [MAIN ] CATO: Generated 1820 derivative records from 7286 primary records. [2025-09-29T02:12:34.508338] [DEBUG] [LOCAL ] CATO: Saving derivative data. [2025-09-29T02:12:34.539413] [DEBUG] [LOCAL ] CARS: Derivative data saved (1820 records). [2025-09-29T02:12:34.541754] [DEBUG] [LOCAL ] CATO: Derivative data saved (1820 records). [2025-09-29T02:12:34.542338] [INFO ] [MAIN ] CARS: Successfully saved derivative data. [2025-09-29T02:12:34.542053] [INFO ] [MAIN ] CATO: Successfully saved derivative data. [2025-09-29T02:12:34.546086] [INFO ] [MAIN ] Derivative Progress: 373/2211 symbols completed. CARS took 1.3s. Estimated remaining: 12m 57s. Rate: 142.0 symbols/min [2025-09-29T02:12:34.562108] [INFO ] [MAIN ] Derivative Progress: 374/2211 symbols completed. CATO took 1.2s. Estimated remaining: 12m 54s. Rate: 142.4 symbols/min [2025-09-29T02:12:34.569729] [DEBUG] [MAIN ] CAT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:34.570564] [INFO ] [MAIN ] CAT: Generated 1820 derivative records from 53693 primary records. [2025-09-29T02:12:34.570692] [DEBUG] [LOCAL ] CAT: Saving derivative data. [2025-09-29T02:12:34.587582] [DEBUG] [LOCAL ] CAT: Derivative data saved (1820 records). [2025-09-29T02:12:34.587805] [INFO ] [MAIN ] CAT: Successfully saved derivative data. [2025-09-29T02:12:34.591708] [INFO ] [MAIN ] Derivative Progress: 375/2211 symbols completed. CAT took 1.3s. Estimated remaining: 12m 52s. Rate: 142.7 symbols/min [2025-09-29T02:12:34.592186] [INFO ] [MAIN ] CBAN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:34.592313] [INFO ] [MAIN ] CB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:34.592709] [INFO ] [MAIN ] CAVA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:34.611777] [DEBUG] [LOCAL ] CBAN: Loaded 11141 existing records from primary storage. [2025-09-29T02:12:34.611939] [INFO ] [MAIN ] CBAN: Loaded 11141 primary data records. [2025-09-29T02:12:35.053125] [DEBUG] [LOCAL ] CAVA: Loaded 54330 existing records from primary storage. [2025-09-29T02:12:35.051413] [DEBUG] [LOCAL ] CB: Loaded 50773 existing records from primary storage. [2025-09-29T02:12:35.054974] [INFO ] [MAIN ] CB: Loaded 50773 primary data records. [2025-09-29T02:12:35.055388] [INFO ] [MAIN ] CAVA: Loaded 54330 primary data records. [2025-09-29T02:12:35.740524] [DEBUG] [MAIN ] CBAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:35.742116] [INFO ] [MAIN ] CBAN: Generated 1820 derivative records from 11141 primary records. [2025-09-29T02:12:35.743403] [DEBUG] [LOCAL ] CBAN: Saving derivative data. [2025-09-29T02:12:35.763916] [DEBUG] [LOCAL ] CBAN: Derivative data saved (1820 records). [2025-09-29T02:12:35.764674] [INFO ] [MAIN ] CBAN: Successfully saved derivative data. [2025-09-29T02:12:35.768367] [INFO ] [MAIN ] Derivative Progress: 376/2211 symbols completed. CBAN took 1.2s. Estimated remaining: 12m 55s. Rate: 142.0 symbols/min [2025-09-29T02:12:35.769111] [INFO ] [MAIN ] CBL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:35.791916] [DEBUG] [MAIN ] CAVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:35.798336] [INFO ] [MAIN ] CAVA: Generated 1820 derivative records from 54330 primary records. [2025-09-29T02:12:35.799569] [DEBUG] [LOCAL ] CAVA: Saving derivative data. [2025-09-29T02:12:35.820225] [DEBUG] [LOCAL ] CBL: Loaded 16862 existing records from primary storage. [2025-09-29T02:12:35.828759] [INFO ] [MAIN ] CBL: Loaded 16862 primary data records. [2025-09-29T02:12:35.859101] [DEBUG] [MAIN ] CB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:35.878449] [INFO ] [MAIN ] CB: Generated 1820 derivative records from 50773 primary records. [2025-09-29T02:12:35.904106] [DEBUG] [LOCAL ] CAVA: Derivative data saved (1820 records). [2025-09-29T02:12:35.919556] [DEBUG] [LOCAL ] CB: Saving derivative data. [2025-09-29T02:12:35.962726] [INFO ] [MAIN ] CAVA: Successfully saved derivative data. [2025-09-29T02:12:35.966909] [INFO ] [MAIN ] Derivative Progress: 377/2211 symbols completed. CAVA took 1.4s. Estimated remaining: 12m 54s. Rate: 142.2 symbols/min [2025-09-29T02:12:35.979468] [INFO ] [MAIN ] CBNA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:36.082725] [DEBUG] [LOCAL ] CBNA: Loaded 2923 existing records from primary storage. [2025-09-29T02:12:36.066308] [DEBUG] [LOCAL ] CB: Derivative data saved (1820 records). [2025-09-29T02:12:36.188918] [INFO ] [MAIN ] CB: Successfully saved derivative data. [2025-09-29T02:12:36.202107] [INFO ] [MAIN ] Derivative Progress: 378/2211 symbols completed. CB took 1.6s. Estimated remaining: 12m 52s. Rate: 142.4 symbols/min [2025-09-29T02:12:36.197602] [INFO ] [MAIN ] CBNA: Loaded 2923 primary data records. [2025-09-29T02:12:36.202481] [INFO ] [MAIN ] CBRE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:36.607423] [DEBUG] [MAIN ] CBL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:36.611385] [INFO ] [MAIN ] CBL: Generated 1820 derivative records from 16862 primary records. [2025-09-29T02:12:36.625534] [DEBUG] [LOCAL ] CBL: Saving derivative data. [2025-09-29T02:12:36.630589] [DEBUG] [LOCAL ] CBRE: Loaded 51366 existing records from primary storage. [2025-09-29T02:12:36.631014] [INFO ] [MAIN ] CBRE: Loaded 51366 primary data records. [2025-09-29T02:12:36.708472] [DEBUG] [LOCAL ] CBL: Derivative data saved (1820 records). [2025-09-29T02:12:36.723782] [INFO ] [MAIN ] CBL: Successfully saved derivative data. [2025-09-29T02:12:36.761545] [INFO ] [MAIN ] Derivative Progress: 379/2211 symbols completed. CBL took 1.0s. Estimated remaining: 12m 53s. Rate: 142.3 symbols/min [2025-09-29T02:12:36.766051] [INFO ] [MAIN ] CBT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:37.066801] [DEBUG] [MAIN ] CBNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:37.067904] [INFO ] [MAIN ] CBNA: Generated 1820 derivative records from 2923 primary records. [2025-09-29T02:12:37.068247] [DEBUG] [LOCAL ] CBNA: Saving derivative data. [2025-09-29T02:12:37.094825] [DEBUG] [LOCAL ] CBT: Loaded 31567 existing records from primary storage. [2025-09-29T02:12:37.098331] [DEBUG] [LOCAL ] CBNA: Derivative data saved (1820 records). [2025-09-29T02:12:37.098585] [INFO ] [MAIN ] CBT: Loaded 31567 primary data records. [2025-09-29T02:12:37.099097] [INFO ] [MAIN ] CBNA: Successfully saved derivative data. [2025-09-29T02:12:37.116092] [INFO ] [MAIN ] Derivative Progress: 380/2211 symbols completed. CBNA took 1.1s. Estimated remaining: 12m 52s. Rate: 142.3 symbols/min [2025-09-29T02:12:37.141240] [INFO ] [MAIN ] CBU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:37.370004] [DEBUG] [LOCAL ] CBU: Loaded 23130 existing records from primary storage. [2025-09-29T02:12:37.375378] [INFO ] [MAIN ] CBU: Loaded 23130 primary data records. [2025-09-29T02:12:37.388633] [DEBUG] [MAIN ] CBRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:37.544054] [INFO ] [MAIN ] CBRE: Generated 1820 derivative records from 51366 primary records. [2025-09-29T02:12:37.564585] [DEBUG] [LOCAL ] CBRE: Saving derivative data. [2025-09-29T02:12:37.871261] [DEBUG] [LOCAL ] CBRE: Derivative data saved (1820 records). [2025-09-29T02:12:37.899744] [INFO ] [MAIN ] CBRE: Successfully saved derivative data. [2025-09-29T02:12:37.904128] [INFO ] [MAIN ] Derivative Progress: 381/2211 symbols completed. CBRE took 1.7s. Estimated remaining: 12m 53s. Rate: 142.0 symbols/min [2025-09-29T02:12:37.904806] [INFO ] [MAIN ] CBZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:37.930260] [DEBUG] [MAIN ] CBT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:37.931634] [INFO ] [MAIN ] CBT: Generated 1820 derivative records from 31567 primary records. [2025-09-29T02:12:37.932258] [DEBUG] [LOCAL ] CBT: Saving derivative data. [2025-09-29T02:12:37.962467] [DEBUG] [LOCAL ] CBT: Derivative data saved (1820 records). [2025-09-29T02:12:37.962839] [INFO ] [MAIN ] CBT: Successfully saved derivative data. [2025-09-29T02:12:37.967847] [INFO ] [MAIN ] Derivative Progress: 382/2211 symbols completed. CBT took 1.2s. Estimated remaining: 12m 51s. Rate: 142.3 symbols/min [2025-09-29T02:12:37.968420] [INFO ] [MAIN ] CC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:37.997260] [DEBUG] [MAIN ] CBU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:37.998128] [DEBUG] [LOCAL ] CBZ: Loaded 34130 existing records from primary storage. [2025-09-29T02:12:37.999136] [INFO ] [MAIN ] CBZ: Loaded 34130 primary data records. [2025-09-29T02:12:37.998970] [INFO ] [MAIN ] CBU: Generated 1820 derivative records from 23130 primary records. [2025-09-29T02:12:38.004732] [DEBUG] [LOCAL ] CBU: Saving derivative data. [2025-09-29T02:12:38.148897] [DEBUG] [LOCAL ] CBU: Derivative data saved (1820 records). [2025-09-29T02:12:38.165117] [INFO ] [MAIN ] CBU: Successfully saved derivative data. [2025-09-29T02:12:38.169215] [INFO ] [MAIN ] Derivative Progress: 383/2211 symbols completed. CBU took 1.0s. Estimated remaining: 12m 50s. Rate: 142.5 symbols/min [2025-09-29T02:12:38.169400] [INFO ] [MAIN ] CCI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:38.397126] [DEBUG] [LOCAL ] CC: Loaded 53801 existing records from primary storage. [2025-09-29T02:12:38.398559] [INFO ] [MAIN ] CC: Loaded 53801 primary data records. [2025-09-29T02:12:38.770307] [DEBUG] [LOCAL ] CCI: Loaded 53922 existing records from primary storage. [2025-09-29T02:12:38.771368] [INFO ] [MAIN ] CCI: Loaded 53922 primary data records. [2025-09-29T02:12:38.884515] [DEBUG] [MAIN ] CBZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:38.910375] [INFO ] [MAIN ] CBZ: Generated 1820 derivative records from 34130 primary records. [2025-09-29T02:12:38.942745] [DEBUG] [LOCAL ] CBZ: Saving derivative data. [2025-09-29T02:12:39.212176] [DEBUG] [LOCAL ] CBZ: Derivative data saved (1820 records). [2025-09-29T02:12:39.212947] [INFO ] [MAIN ] CBZ: Successfully saved derivative data. [2025-09-29T02:12:39.216804] [INFO ] [MAIN ] Derivative Progress: 384/2211 symbols completed. CBZ took 1.3s. Estimated remaining: 12m 52s. Rate: 142.0 symbols/min [2025-09-29T02:12:39.217089] [INFO ] [MAIN ] CCIF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:39.233296] [DEBUG] [MAIN ] CC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:39.234768] [INFO ] [MAIN ] CC: Generated 1820 derivative records from 53801 primary records. [2025-09-29T02:12:39.235204] [DEBUG] [LOCAL ] CC: Saving derivative data. [2025-09-29T02:12:39.268592] [DEBUG] [LOCAL ] CC: Derivative data saved (1820 records). [2025-09-29T02:12:39.269806] [DEBUG] [LOCAL ] CCIF: Loaded 15698 existing records from primary storage. [2025-09-29T02:12:39.278163] [INFO ] [MAIN ] CCIF: Loaded 15698 primary data records. [2025-09-29T02:12:39.270515] [INFO ] [MAIN ] CC: Successfully saved derivative data. [2025-09-29T02:12:39.325739] [INFO ] [MAIN ] Derivative Progress: 385/2211 symbols completed. CC took 1.3s. Estimated remaining: 12m 50s. Rate: 142.3 symbols/min [2025-09-29T02:12:39.331197] [INFO ] [MAIN ] CCJ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:39.313355] [DEBUG] [MAIN ] CCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:39.363120] [INFO ] [MAIN ] CCI: Generated 1820 derivative records from 53922 primary records. [2025-09-29T02:12:39.386410] [DEBUG] [LOCAL ] CCI: Saving derivative data. [2025-09-29T02:12:39.651713] [DEBUG] [LOCAL ] CCI: Derivative data saved (1820 records). [2025-09-29T02:12:39.652462] [INFO ] [MAIN ] CCI: Successfully saved derivative data. [2025-09-29T02:12:39.656357] [INFO ] [MAIN ] Derivative Progress: 386/2211 symbols completed. CCI took 1.5s. Estimated remaining: 12m 49s. Rate: 142.3 symbols/min [2025-09-29T02:12:39.673866] [INFO ] [MAIN ] CCK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:39.707688] [DEBUG] [LOCAL ] CCJ: Loaded 54453 existing records from primary storage. [2025-09-29T02:12:39.708332] [INFO ] [MAIN ] CCJ: Loaded 54453 primary data records. [2025-09-29T02:12:39.857118] [DEBUG] [MAIN ] CCIF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:39.900569] [INFO ] [MAIN ] CCIF: Generated 1820 derivative records from 15698 primary records. [2025-09-29T02:12:39.943404] [DEBUG] [LOCAL ] CCIF: Saving derivative data. [2025-09-29T02:12:40.098933] [DEBUG] [LOCAL ] CCK: Loaded 47083 existing records from primary storage. [2025-09-29T02:12:40.101441] [INFO ] [MAIN ] CCK: Loaded 47083 primary data records. [2025-09-29T02:12:40.118732] [DEBUG] [LOCAL ] CCIF: Derivative data saved (1820 records). [2025-09-29T02:12:40.142208] [INFO ] [MAIN ] CCIF: Successfully saved derivative data. [2025-09-29T02:12:40.165135] [INFO ] [MAIN ] Derivative Progress: 387/2211 symbols completed. CCIF took 0.9s. Estimated remaining: 12m 49s. Rate: 142.3 symbols/min [2025-09-29T02:12:40.165516] [INFO ] [MAIN ] CCL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:40.461086] [DEBUG] [MAIN ] CCJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:40.478834] [INFO ] [MAIN ] CCJ: Generated 1820 derivative records from 54453 primary records. [2025-09-29T02:12:40.479780] [DEBUG] [LOCAL ] CCJ: Saving derivative data. [2025-09-29T02:12:40.498232] [DEBUG] [LOCAL ] CCJ: Derivative data saved (1820 records). [2025-09-29T02:12:40.498427] [INFO ] [MAIN ] CCJ: Successfully saved derivative data. [2025-09-29T02:12:40.501668] [INFO ] [MAIN ] Derivative Progress: 388/2211 symbols completed. CCJ took 1.2s. Estimated remaining: 12m 48s. Rate: 142.3 symbols/min [2025-09-29T02:12:40.528267] [DEBUG] [LOCAL ] CCL: Loaded 54580 existing records from primary storage. [2025-09-29T02:12:40.529237] [INFO ] [MAIN ] CCL: Loaded 54580 primary data records. [2025-09-29T02:12:40.619434] [DEBUG] [MAIN ] CCK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:40.646974] [INFO ] [MAIN ] CCK: Generated 1820 derivative records from 47083 primary records. [2025-09-29T02:12:40.659505] [DEBUG] [LOCAL ] CCK: Saving derivative data. [2025-09-29T02:12:40.708519] [DEBUG] [LOCAL ] CCK: Derivative data saved (1820 records). [2025-09-29T02:12:40.731680] [INFO ] [MAIN ] CCK: Successfully saved derivative data. [2025-09-29T02:12:40.746220] [INFO ] [MAIN ] Derivative Progress: 389/2211 symbols completed. CCK took 1.1s. Estimated remaining: 12m 47s. Rate: 142.5 symbols/min [2025-09-29T02:12:40.916542] [DEBUG] [MAIN ] CCL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:40.917386] [INFO ] [MAIN ] CCL: Generated 1820 derivative records from 54580 primary records. [2025-09-29T02:12:40.917475] [DEBUG] [LOCAL ] CCL: Saving derivative data. [2025-09-29T02:12:40.933343] [DEBUG] [LOCAL ] CCL: Derivative data saved (1820 records). [2025-09-29T02:12:40.933479] [INFO ] [MAIN ] CCL: Successfully saved derivative data. [2025-09-29T02:12:40.937667] [INFO ] [MAIN ] Derivative Progress: 390/2211 symbols completed. CCL took 0.8s. Estimated remaining: 12m 46s. Rate: 142.7 symbols/min [2025-09-29T02:12:40.938323] [INFO ] [MAIN ] CCO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:40.938468] [INFO ] [MAIN ] CCS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:40.938711] [INFO ] [MAIN ] CCRD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:40.956405] [DEBUG] [LOCAL ] CCRD: Loaded 9100 existing records from primary storage. [2025-09-29T02:12:40.956632] [INFO ] [MAIN ] CCRD: Loaded 9100 primary data records. [2025-09-29T02:12:41.372965] [DEBUG] [LOCAL ] CCS: Loaded 31155 existing records from primary storage. [2025-09-29T02:12:41.373392] [INFO ] [MAIN ] CCS: Loaded 31155 primary data records. [2025-09-29T02:12:41.400808] [DEBUG] [LOCAL ] CCO: Loaded 48387 existing records from primary storage. [2025-09-29T02:12:41.432444] [INFO ] [MAIN ] CCO: Loaded 48387 primary data records. [2025-09-29T02:12:42.062746] [DEBUG] [MAIN ] CCRD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:42.064326] [INFO ] [MAIN ] CCRD: Generated 1820 derivative records from 9100 primary records. [2025-09-29T02:12:42.065000] [DEBUG] [LOCAL ] CCRD: Saving derivative data. [2025-09-29T02:12:42.084205] [DEBUG] [LOCAL ] CCRD: Derivative data saved (1820 records). [2025-09-29T02:12:42.084442] [INFO ] [MAIN ] CCRD: Successfully saved derivative data. [2025-09-29T02:12:42.087416] [INFO ] [MAIN ] Derivative Progress: 391/2211 symbols completed. CCRD took 1.1s. Estimated remaining: 12m 49s. Rate: 142.1 symbols/min [2025-09-29T02:12:42.087978] [INFO ] [MAIN ] CCU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:42.115943] [DEBUG] [MAIN ] CCS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:42.117561] [INFO ] [MAIN ] CCS: Generated 1820 derivative records from 31155 primary records. [2025-09-29T02:12:42.117933] [DEBUG] [LOCAL ] CCS: Saving derivative data. [2025-09-29T02:12:42.154968] [DEBUG] [MAIN ] CCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:42.157270] [INFO ] [MAIN ] CCO: Generated 1820 derivative records from 48387 primary records. [2025-09-29T02:12:42.157704] [DEBUG] [LOCAL ] CCO: Saving derivative data. [2025-09-29T02:12:42.173610] [DEBUG] [LOCAL ] CCS: Derivative data saved (1820 records). [2025-09-29T02:12:42.186075] [INFO ] [MAIN ] CCS: Successfully saved derivative data. [2025-09-29T02:12:42.189197] [DEBUG] [LOCAL ] CCU: Loaded 23800 existing records from primary storage. [2025-09-29T02:12:42.190880] [INFO ] [MAIN ] CCU: Loaded 23800 primary data records. [2025-09-29T02:12:42.193699] [INFO ] [MAIN ] Derivative Progress: 392/2211 symbols completed. CCS took 1.3s. Estimated remaining: 12m 47s. Rate: 142.3 symbols/min [2025-09-29T02:12:42.211974] [INFO ] [MAIN ] CDE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:42.232850] [DEBUG] [LOCAL ] CCO: Derivative data saved (1820 records). [2025-09-29T02:12:42.242058] [INFO ] [MAIN ] CCO: Successfully saved derivative data. [2025-09-29T02:12:42.250724] [INFO ] [MAIN ] Derivative Progress: 393/2211 symbols completed. CCO took 1.3s. Estimated remaining: 12m 45s. Rate: 142.6 symbols/min [2025-09-29T02:12:42.268025] [INFO ] [MAIN ] CDLR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:42.415482] [DEBUG] [LOCAL ] CDLR: Loaded 9966 existing records from primary storage. [2025-09-29T02:12:42.446889] [INFO ] [MAIN ] CDLR: Loaded 9966 primary data records. [2025-09-29T02:12:42.752209] [DEBUG] [LOCAL ] CDE: Loaded 54421 existing records from primary storage. [2025-09-29T02:12:42.762967] [INFO ] [MAIN ] CDE: Loaded 54421 primary data records. [2025-09-29T02:12:43.325160] [DEBUG] [MAIN ] CCU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:43.326483] [INFO ] [MAIN ] CCU: Generated 1820 derivative records from 23800 primary records. [2025-09-29T02:12:43.326798] [DEBUG] [LOCAL ] CCU: Saving derivative data. [2025-09-29T02:12:43.347903] [DEBUG] [LOCAL ] CCU: Derivative data saved (1820 records). [2025-09-29T02:12:43.348297] [INFO ] [MAIN ] CCU: Successfully saved derivative data. [2025-09-29T02:12:43.351158] [INFO ] [MAIN ] Derivative Progress: 394/2211 symbols completed. CCU took 1.3s. Estimated remaining: 12m 47s. Rate: 142.1 symbols/min [2025-09-29T02:12:43.353611] [INFO ] [MAIN ] CDP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:43.371137] [DEBUG] [MAIN ] CDLR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:43.373105] [INFO ] [MAIN ] CDLR: Generated 1820 derivative records from 9966 primary records. [2025-09-29T02:12:43.373476] [DEBUG] [LOCAL ] CDLR: Saving derivative data. [2025-09-29T02:12:43.392949] [DEBUG] [LOCAL ] CDLR: Derivative data saved (1820 records). [2025-09-29T02:12:43.395250] [INFO ] [MAIN ] CDLR: Successfully saved derivative data. [2025-09-29T02:12:43.398716] [INFO ] [MAIN ] Derivative Progress: 395/2211 symbols completed. CDLR took 1.1s. Estimated remaining: 12m 45s. Rate: 142.4 symbols/min [2025-09-29T02:12:43.398999] [INFO ] [MAIN ] CDRE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:43.413900] [DEBUG] [MAIN ] CDE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:43.427092] [INFO ] [MAIN ] CDE: Generated 1820 derivative records from 54421 primary records. [2025-09-29T02:12:43.427375] [DEBUG] [LOCAL ] CDE: Saving derivative data. [2025-09-29T02:12:43.445195] [DEBUG] [LOCAL ] CDE: Derivative data saved (1820 records). [2025-09-29T02:12:43.447037] [INFO ] [MAIN ] CDE: Successfully saved derivative data. [2025-09-29T02:12:43.463762] [INFO ] [MAIN ] Derivative Progress: 396/2211 symbols completed. CDE took 1.3s. Estimated remaining: 12m 43s. Rate: 142.7 symbols/min [2025-09-29T02:12:43.471783] [DEBUG] [LOCAL ] CDP: Loaded 43357 existing records from primary storage. [2025-09-29T02:12:43.472248] [INFO ] [MAIN ] CDP: Loaded 43357 primary data records. [2025-09-29T02:12:43.472043] [INFO ] [MAIN ] CE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:43.583744] [DEBUG] [LOCAL ] CDRE: Loaded 25747 existing records from primary storage. [2025-09-29T02:12:43.597618] [INFO ] [MAIN ] CDRE: Loaded 25747 primary data records. [2025-09-29T02:12:44.179619] [DEBUG] [LOCAL ] CE: Loaded 52316 existing records from primary storage. [2025-09-29T02:12:44.203324] [INFO ] [MAIN ] CE: Loaded 52316 primary data records. [2025-09-29T02:12:44.599438] [DEBUG] [MAIN ] CDP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:44.601149] [INFO ] [MAIN ] CDP: Generated 1820 derivative records from 43357 primary records. [2025-09-29T02:12:44.602006] [DEBUG] [LOCAL ] CDP: Saving derivative data. [2025-09-29T02:12:44.624888] [DEBUG] [LOCAL ] CDP: Derivative data saved (1820 records). [2025-09-29T02:12:44.626690] [INFO ] [MAIN ] CDP: Successfully saved derivative data. [2025-09-29T02:12:44.629854] [INFO ] [MAIN ] Derivative Progress: 397/2211 symbols completed. CDP took 1.3s. Estimated remaining: 12m 46s. Rate: 142.1 symbols/min [2025-09-29T02:12:44.645227] [INFO ] [MAIN ] CEE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:44.645672] [DEBUG] [MAIN ] CDRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:44.646924] [INFO ] [MAIN ] CDRE: Generated 1820 derivative records from 25747 primary records. [2025-09-29T02:12:44.647176] [DEBUG] [LOCAL ] CDRE: Saving derivative data. [2025-09-29T02:12:44.670986] [DEBUG] [LOCAL ] CEE: Loaded 6697 existing records from primary storage. [2025-09-29T02:12:44.671849] [INFO ] [MAIN ] CEE: Loaded 6697 primary data records. [2025-09-29T02:12:44.697312] [DEBUG] [LOCAL ] CDRE: Derivative data saved (1820 records). [2025-09-29T02:12:44.735990] [INFO ] [MAIN ] CDRE: Successfully saved derivative data. [2025-09-29T02:12:44.780319] [INFO ] [MAIN ] Derivative Progress: 398/2211 symbols completed. CDRE took 1.4s. Estimated remaining: 12m 45s. Rate: 142.3 symbols/min [2025-09-29T02:12:44.799316] [INFO ] [MAIN ] CEPU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:44.837101] [DEBUG] [MAIN ] CE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:44.866557] [INFO ] [MAIN ] CE: Generated 1820 derivative records from 52316 primary records. [2025-09-29T02:12:44.866780] [DEBUG] [LOCAL ] CE: Saving derivative data. [2025-09-29T02:12:45.063203] [DEBUG] [LOCAL ] CE: Derivative data saved (1820 records). [2025-09-29T02:12:45.064223] [DEBUG] [LOCAL ] CEPU: Loaded 26454 existing records from primary storage. [2025-09-29T02:12:45.065738] [INFO ] [MAIN ] CE: Successfully saved derivative data. [2025-09-29T02:12:45.065949] [INFO ] [MAIN ] CEPU: Loaded 26454 primary data records. [2025-09-29T02:12:45.069281] [INFO ] [MAIN ] Derivative Progress: 399/2211 symbols completed. CE took 1.6s. Estimated remaining: 12m 44s. Rate: 142.4 symbols/min [2025-09-29T02:12:45.069461] [INFO ] [MAIN ] CF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:45.317143] [DEBUG] [MAIN ] CEE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:45.445709] [INFO ] [MAIN ] CEE: Generated 1820 derivative records from 6697 primary records. [2025-09-29T02:12:45.445934] [DEBUG] [LOCAL ] CEE: Saving derivative data. [2025-09-29T02:12:45.481369] [DEBUG] [LOCAL ] CEE: Derivative data saved (1820 records). [2025-09-29T02:12:45.484744] [INFO ] [MAIN ] CEE: Successfully saved derivative data. [2025-09-29T02:12:45.484392] [DEBUG] [LOCAL ] CF: Loaded 52983 existing records from primary storage. [2025-09-29T02:12:45.488605] [INFO ] [MAIN ] CF: Loaded 52983 primary data records. [2025-09-29T02:12:45.488070] [INFO ] [MAIN ] Derivative Progress: 400/2211 symbols completed. CEE took 0.8s. Estimated remaining: 12m 43s. Rate: 142.4 symbols/min [2025-09-29T02:12:45.489163] [INFO ] [MAIN ] CFG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:45.876400] [DEBUG] [MAIN ] CEPU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:45.877460] [INFO ] [MAIN ] CEPU: Generated 1820 derivative records from 26454 primary records. [2025-09-29T02:12:45.877875] [DEBUG] [LOCAL ] CEPU: Saving derivative data. [2025-09-29T02:12:45.912968] [DEBUG] [LOCAL ] CEPU: Derivative data saved (1820 records). [2025-09-29T02:12:45.913698] [INFO ] [MAIN ] CEPU: Successfully saved derivative data. [2025-09-29T02:12:45.917496] [INFO ] [MAIN ] Derivative Progress: 401/2211 symbols completed. CEPU took 1.1s. Estimated remaining: 12m 43s. Rate: 142.4 symbols/min [2025-09-29T02:12:45.917877] [INFO ] [MAIN ] CFR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:45.940751] [DEBUG] [LOCAL ] CFG: Loaded 54404 existing records from primary storage. [2025-09-29T02:12:45.941420] [INFO ] [MAIN ] CFG: Loaded 54404 primary data records. [2025-09-29T02:12:46.122391] [DEBUG] [MAIN ] CF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:46.155864] [DEBUG] [LOCAL ] CFR: Loaded 33971 existing records from primary storage. [2025-09-29T02:12:46.175591] [INFO ] [MAIN ] CFR: Loaded 33971 primary data records. [2025-09-29T02:12:46.176794] [INFO ] [MAIN ] CF: Generated 1820 derivative records from 52983 primary records. [2025-09-29T02:12:46.307171] [DEBUG] [LOCAL ] CF: Saving derivative data. [2025-09-29T02:12:46.429108] [DEBUG] [LOCAL ] CF: Derivative data saved (1820 records). [2025-09-29T02:12:46.441749] [INFO ] [MAIN ] CF: Successfully saved derivative data. [2025-09-29T02:12:46.445790] [INFO ] [MAIN ] Derivative Progress: 402/2211 symbols completed. CF took 1.4s. Estimated remaining: 12m 43s. Rate: 142.3 symbols/min [2025-09-29T02:12:46.462502] [INFO ] [MAIN ] CGAU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:46.675990] [DEBUG] [MAIN ] CFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:46.677781] [INFO ] [MAIN ] CFG: Generated 1820 derivative records from 54404 primary records. [2025-09-29T02:12:46.678282] [DEBUG] [LOCAL ] CFG: Saving derivative data. [2025-09-29T02:12:46.697928] [DEBUG] [LOCAL ] CFG: Derivative data saved (1820 records). [2025-09-29T02:12:46.708286] [INFO ] [MAIN ] CFG: Successfully saved derivative data. [2025-09-29T02:12:46.711301] [INFO ] [MAIN ] Derivative Progress: 403/2211 symbols completed. CFG took 1.2s. Estimated remaining: 12m 42s. Rate: 142.4 symbols/min [2025-09-29T02:12:46.732023] [DEBUG] [LOCAL ] CGAU: Loaded 43406 existing records from primary storage. [2025-09-29T02:12:46.732382] [INFO ] [MAIN ] CGAU: Loaded 43406 primary data records. [2025-09-29T02:12:46.779083] [DEBUG] [MAIN ] CFR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:46.819530] [INFO ] [MAIN ] CFR: Generated 1820 derivative records from 33971 primary records. [2025-09-29T02:12:46.830729] [DEBUG] [LOCAL ] CFR: Saving derivative data. [2025-09-29T02:12:46.952959] [DEBUG] [LOCAL ] CFR: Derivative data saved (1820 records). [2025-09-29T02:12:47.071687] [INFO ] [MAIN ] CFR: Successfully saved derivative data. [2025-09-29T02:12:47.084053] [INFO ] [MAIN ] Derivative Progress: 404/2211 symbols completed. CFR took 1.2s. Estimated remaining: 12m 41s. Rate: 142.5 symbols/min [2025-09-29T02:12:47.110518] [DEBUG] [MAIN ] CGAU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:47.111325] [INFO ] [MAIN ] CGAU: Generated 1820 derivative records from 43406 primary records. [2025-09-29T02:12:47.111412] [DEBUG] [LOCAL ] CGAU: Saving derivative data. [2025-09-29T02:12:47.127061] [DEBUG] [LOCAL ] CGAU: Derivative data saved (1820 records). [2025-09-29T02:12:47.127149] [INFO ] [MAIN ] CGAU: Successfully saved derivative data. [2025-09-29T02:12:47.129883] [INFO ] [MAIN ] Derivative Progress: 405/2211 symbols completed. CGAU took 0.7s. Estimated remaining: 12m 39s. Rate: 142.8 symbols/min [2025-09-29T02:12:47.130488] [INFO ] [MAIN ] CGV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:47.130572] [INFO ] [MAIN ] CHD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:47.130762] [INFO ] [MAIN ] CHCT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:47.135521] [DEBUG] [LOCAL ] CGV: Loaded 1431 existing records from primary storage. [2025-09-29T02:12:47.135900] [INFO ] [MAIN ] CGV: Loaded 1431 primary data records. [2025-09-29T02:12:47.310441] [DEBUG] [LOCAL ] CHCT: Loaded 24309 existing records from primary storage. [2025-09-29T02:12:47.356861] [INFO ] [MAIN ] CHCT: Loaded 24309 primary data records. [2025-09-29T02:12:47.640184] [DEBUG] [LOCAL ] CHD: Loaded 52767 existing records from primary storage. [2025-09-29T02:12:47.641207] [INFO ] [MAIN ] CHD: Loaded 52767 primary data records. [2025-09-29T02:12:48.259888] [DEBUG] [MAIN ] CGV: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:12:48.262671] [INFO ] [MAIN ] CGV: Generated 1819 derivative records from 1431 primary records. [2025-09-29T02:12:48.263664] [DEBUG] [LOCAL ] CGV: Saving derivative data. [2025-09-29T02:12:48.281447] [DEBUG] [LOCAL ] CGV: Derivative data saved (1819 records). [2025-09-29T02:12:48.281687] [INFO ] [MAIN ] CGV: Successfully saved derivative data. [2025-09-29T02:12:48.284354] [INFO ] [MAIN ] Derivative Progress: 406/2211 symbols completed. CGV took 1.2s. Estimated remaining: 12m 42s. Rate: 142.2 symbols/min [2025-09-29T02:12:48.284837] [INFO ] [MAIN ] CHE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:48.303595] [DEBUG] [MAIN ] CHCT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:48.305162] [INFO ] [MAIN ] CHCT: Generated 1820 derivative records from 24309 primary records. [2025-09-29T02:12:48.305305] [DEBUG] [LOCAL ] CHCT: Saving derivative data. [2025-09-29T02:12:48.328497] [DEBUG] [LOCAL ] CHCT: Derivative data saved (1820 records). [2025-09-29T02:12:48.337507] [INFO ] [MAIN ] CHCT: Successfully saved derivative data. [2025-09-29T02:12:48.341526] [INFO ] [MAIN ] Derivative Progress: 407/2211 symbols completed. CHCT took 1.2s. Estimated remaining: 12m 40s. Rate: 142.5 symbols/min [2025-09-29T02:12:48.342252] [DEBUG] [LOCAL ] CHE: Loaded 14983 existing records from primary storage. [2025-09-29T02:12:48.342836] [INFO ] [MAIN ] CHGG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:48.342936] [INFO ] [MAIN ] CHE: Loaded 14983 primary data records. [2025-09-29T02:12:48.397446] [DEBUG] [MAIN ] CHD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:48.430698] [INFO ] [MAIN ] CHD: Generated 1820 derivative records from 52767 primary records. [2025-09-29T02:12:48.462611] [DEBUG] [LOCAL ] CHD: Saving derivative data. [2025-09-29T02:12:48.691781] [DEBUG] [LOCAL ] CHD: Derivative data saved (1820 records). [2025-09-29T02:12:48.711836] [INFO ] [MAIN ] CHD: Successfully saved derivative data. [2025-09-29T02:12:48.715567] [INFO ] [MAIN ] Derivative Progress: 408/2211 symbols completed. CHD took 1.6s. Estimated remaining: 12m 39s. Rate: 142.5 symbols/min [2025-09-29T02:12:48.716100] [INFO ] [MAIN ] CHH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:48.745048] [DEBUG] [LOCAL ] CHGG: Loaded 48434 existing records from primary storage. [2025-09-29T02:12:48.745620] [INFO ] [MAIN ] CHGG: Loaded 48434 primary data records. [2025-09-29T02:12:48.882026] [DEBUG] [LOCAL ] CHH: Loaded 32744 existing records from primary storage. [2025-09-29T02:12:48.888778] [INFO ] [MAIN ] CHH: Loaded 32744 primary data records. [2025-09-29T02:12:49.203451] [DEBUG] [MAIN ] CHE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:49.233947] [INFO ] [MAIN ] CHE: Generated 1820 derivative records from 14983 primary records. [2025-09-29T02:12:49.239265] [DEBUG] [LOCAL ] CHE: Saving derivative data. [2025-09-29T02:12:49.454585] [DEBUG] [LOCAL ] CHE: Derivative data saved (1820 records). [2025-09-29T02:12:49.469305] [INFO ] [MAIN ] CHE: Successfully saved derivative data. [2025-09-29T02:12:49.474619] [INFO ] [MAIN ] Derivative Progress: 409/2211 symbols completed. CHE took 1.2s. Estimated remaining: 12m 40s. Rate: 142.2 symbols/min [2025-09-29T02:12:49.475362] [INFO ] [MAIN ] CHMI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:49.507144] [DEBUG] [MAIN ] CHGG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:49.510208] [INFO ] [MAIN ] CHGG: Generated 1820 derivative records from 48434 primary records. [2025-09-29T02:12:49.510488] [DEBUG] [LOCAL ] CHGG: Saving derivative data. [2025-09-29T02:12:49.536622] [DEBUG] [LOCAL ] CHMI: Loaded 22359 existing records from primary storage. [2025-09-29T02:12:49.538426] [INFO ] [MAIN ] CHMI: Loaded 22359 primary data records. [2025-09-29T02:12:49.539677] [DEBUG] [LOCAL ] CHGG: Derivative data saved (1820 records). [2025-09-29T02:12:49.539892] [INFO ] [MAIN ] CHGG: Successfully saved derivative data. [2025-09-29T02:12:49.565127] [INFO ] [MAIN ] Derivative Progress: 410/2211 symbols completed. CHGG took 1.2s. Estimated remaining: 12m 38s. Rate: 142.5 symbols/min [2025-09-29T02:12:49.565584] [INFO ] [MAIN ] CHN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:49.664315] [DEBUG] [LOCAL ] CHN: Loaded 4900 existing records from primary storage. [2025-09-29T02:12:49.665275] [INFO ] [MAIN ] CHN: Loaded 4900 primary data records. [2025-09-29T02:12:49.809885] [DEBUG] [MAIN ] CHH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:49.982263] [INFO ] [MAIN ] CHH: Generated 1820 derivative records from 32744 primary records. [2025-09-29T02:12:50.051797] [DEBUG] [LOCAL ] CHH: Saving derivative data. [2025-09-29T02:12:50.142870] [DEBUG] [LOCAL ] CHH: Derivative data saved (1820 records). [2025-09-29T02:12:50.165915] [INFO ] [MAIN ] CHH: Successfully saved derivative data. [2025-09-29T02:12:50.171367] [INFO ] [MAIN ] Derivative Progress: 411/2211 symbols completed. CHH took 1.5s. Estimated remaining: 12m 39s. Rate: 142.4 symbols/min [2025-09-29T02:12:50.305985] [INFO ] [MAIN ] CHPT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:50.348569] [DEBUG] [MAIN ] CHMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:50.349606] [INFO ] [MAIN ] CHMI: Generated 1820 derivative records from 22359 primary records. [2025-09-29T02:12:50.349894] [DEBUG] [LOCAL ] CHMI: Saving derivative data. [2025-09-29T02:12:50.368299] [DEBUG] [LOCAL ] CHMI: Derivative data saved (1820 records). [2025-09-29T02:12:50.368512] [INFO ] [MAIN ] CHMI: Successfully saved derivative data. [2025-09-29T02:12:50.371426] [INFO ] [MAIN ] Derivative Progress: 412/2211 symbols completed. CHMI took 0.9s. Estimated remaining: 12m 37s. Rate: 142.5 symbols/min [2025-09-29T02:12:50.372089] [INFO ] [MAIN ] CHT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:50.401985] [DEBUG] [MAIN ] CHN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:50.402847] [INFO ] [MAIN ] CHN: Generated 1820 derivative records from 4900 primary records. [2025-09-29T02:12:50.403070] [DEBUG] [LOCAL ] CHN: Saving derivative data. [2025-09-29T02:12:50.437232] [DEBUG] [LOCAL ] CHN: Derivative data saved (1820 records). [2025-09-29T02:12:50.443963] [INFO ] [MAIN ] CHN: Successfully saved derivative data. [2025-09-29T02:12:50.447673] [INFO ] [MAIN ] Derivative Progress: 413/2211 symbols completed. CHN took 0.9s. Estimated remaining: 12m 35s. Rate: 142.8 symbols/min [2025-09-29T02:12:50.448326] [DEBUG] [LOCAL ] CHT: Loaded 19816 existing records from primary storage. [2025-09-29T02:12:50.449711] [DEBUG] [LOCAL ] CHPT: Loaded 49765 existing records from primary storage. [2025-09-29T02:12:50.449890] [INFO ] [MAIN ] CHWY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:50.450228] [INFO ] [MAIN ] CHPT: Loaded 49765 primary data records. [2025-09-29T02:12:50.450136] [INFO ] [MAIN ] CHT: Loaded 19816 primary data records. [2025-09-29T02:12:51.128762] [DEBUG] [LOCAL ] CHWY: Loaded 54434 existing records from primary storage. [2025-09-29T02:12:51.130624] [INFO ] [MAIN ] CHWY: Loaded 54434 primary data records. [2025-09-29T02:12:51.494915] [DEBUG] [MAIN ] CHT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:51.496454] [DEBUG] [MAIN ] CHPT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:51.496103] [INFO ] [MAIN ] CHT: Generated 1820 derivative records from 19816 primary records. [2025-09-29T02:12:51.497620] [DEBUG] [LOCAL ] CHT: Saving derivative data. [2025-09-29T02:12:51.498399] [INFO ] [MAIN ] CHPT: Generated 1820 derivative records from 49765 primary records. [2025-09-29T02:12:51.499465] [DEBUG] [LOCAL ] CHPT: Saving derivative data. [2025-09-29T02:12:51.529142] [DEBUG] [LOCAL ] CHPT: Derivative data saved (1820 records). [2025-09-29T02:12:51.530446] [INFO ] [MAIN ] CHPT: Successfully saved derivative data. [2025-09-29T02:12:51.534282] [INFO ] [MAIN ] Derivative Progress: 414/2211 symbols completed. CHPT took 1.2s. Estimated remaining: 12m 38s. Rate: 142.3 symbols/min [2025-09-29T02:12:51.535662] [INFO ] [MAIN ] CI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:51.538258] [DEBUG] [LOCAL ] CHT: Derivative data saved (1820 records). [2025-09-29T02:12:51.540227] [INFO ] [MAIN ] CHT: Successfully saved derivative data. [2025-09-29T02:12:51.543179] [INFO ] [MAIN ] Derivative Progress: 415/2211 symbols completed. CHT took 1.2s. Estimated remaining: 12m 36s. Rate: 142.6 symbols/min [2025-09-29T02:12:51.543400] [INFO ] [MAIN ] CIA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:51.561772] [DEBUG] [MAIN ] CHWY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:51.562719] [INFO ] [MAIN ] CHWY: Generated 1820 derivative records from 54434 primary records. [2025-09-29T02:12:51.562851] [DEBUG] [LOCAL ] CHWY: Saving derivative data. [2025-09-29T02:12:51.584589] [DEBUG] [LOCAL ] CHWY: Derivative data saved (1820 records). [2025-09-29T02:12:51.591836] [INFO ] [MAIN ] CHWY: Successfully saved derivative data. [2025-09-29T02:12:51.594956] [INFO ] [MAIN ] Derivative Progress: 416/2211 symbols completed. CHWY took 1.1s. Estimated remaining: 12m 34s. Rate: 142.9 symbols/min [2025-09-29T02:12:51.595485] [DEBUG] [LOCAL ] CIA: Loaded 17213 existing records from primary storage. [2025-09-29T02:12:51.596122] [INFO ] [MAIN ] CIA: Loaded 17213 primary data records. [2025-09-29T02:12:51.596029] [INFO ] [MAIN ] CIB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:51.960066] [DEBUG] [LOCAL ] CI: Loaded 50561 existing records from primary storage. [2025-09-29T02:12:51.962136] [INFO ] [MAIN ] CI: Loaded 50561 primary data records. [2025-09-29T02:12:51.985526] [DEBUG] [LOCAL ] CIB: Loaded 31435 existing records from primary storage. [2025-09-29T02:12:51.991772] [INFO ] [MAIN ] CIB: Loaded 31435 primary data records. [2025-09-29T02:12:52.701462] [DEBUG] [MAIN ] CIA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:52.703774] [INFO ] [MAIN ] CIA: Generated 1820 derivative records from 17213 primary records. [2025-09-29T02:12:52.704885] [DEBUG] [LOCAL ] CIA: Saving derivative data. [2025-09-29T02:12:52.725079] [DEBUG] [LOCAL ] CIA: Derivative data saved (1820 records). [2025-09-29T02:12:52.725360] [INFO ] [MAIN ] CIA: Successfully saved derivative data. [2025-09-29T02:12:52.728590] [INFO ] [MAIN ] Derivative Progress: 417/2211 symbols completed. CIA took 1.2s. Estimated remaining: 12m 36s. Rate: 142.3 symbols/min [2025-09-29T02:12:52.729344] [INFO ] [MAIN ] CIEN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:52.769002] [DEBUG] [MAIN ] CIB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:52.768396] [DEBUG] [MAIN ] CI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:52.770122] [INFO ] [MAIN ] CIB: Generated 1820 derivative records from 31435 primary records. [2025-09-29T02:12:52.770917] [INFO ] [MAIN ] CI: Generated 1820 derivative records from 50561 primary records. [2025-09-29T02:12:52.771177] [DEBUG] [LOCAL ] CI: Saving derivative data. [2025-09-29T02:12:52.771245] [DEBUG] [LOCAL ] CIB: Saving derivative data. [2025-09-29T02:12:52.802981] [DEBUG] [LOCAL ] CI: Derivative data saved (1820 records). [2025-09-29T02:12:52.820610] [DEBUG] [LOCAL ] CIB: Derivative data saved (1820 records). [2025-09-29T02:12:52.820735] [INFO ] [MAIN ] CI: Successfully saved derivative data. [2025-09-29T02:12:52.821000] [INFO ] [MAIN ] CIB: Successfully saved derivative data. [2025-09-29T02:12:52.823793] [INFO ] [MAIN ] Derivative Progress: 418/2211 symbols completed. CI took 1.3s. Estimated remaining: 12m 34s. Rate: 142.6 symbols/min [2025-09-29T02:12:52.827556] [INFO ] [MAIN ] Derivative Progress: 419/2211 symbols completed. CIB took 1.2s. Estimated remaining: 12m 32s. Rate: 142.9 symbols/min [2025-09-29T02:12:52.847715] [DEBUG] [LOCAL ] CIEN: Loaded 52854 existing records from primary storage. [2025-09-29T02:12:52.847916] [INFO ] [MAIN ] CIEN: Loaded 52854 primary data records. [2025-09-29T02:12:53.192777] [DEBUG] [MAIN ] CIEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:53.193539] [INFO ] [MAIN ] CIEN: Generated 1820 derivative records from 52854 primary records. [2025-09-29T02:12:53.193629] [DEBUG] [LOCAL ] CIEN: Saving derivative data. [2025-09-29T02:12:53.210050] [DEBUG] [LOCAL ] CIEN: Derivative data saved (1820 records). [2025-09-29T02:12:53.210140] [INFO ] [MAIN ] CIEN: Successfully saved derivative data. [2025-09-29T02:12:53.213080] [INFO ] [MAIN ] Derivative Progress: 420/2211 symbols completed. CIEN took 0.5s. Estimated remaining: 12m 32s. Rate: 143.0 symbols/min [2025-09-29T02:12:53.213702] [INFO ] [MAIN ] CIF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:53.213868] [INFO ] [MAIN ] CIG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:53.213996] [INFO ] [MAIN ] CII: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:53.224690] [DEBUG] [LOCAL ] CIF: Loaded 4396 existing records from primary storage. [2025-09-29T02:12:53.225301] [INFO ] [MAIN ] CIF: Loaded 4396 primary data records. [2025-09-29T02:12:53.363939] [DEBUG] [LOCAL ] CII: Loaded 15638 existing records from primary storage. [2025-09-29T02:12:53.364627] [INFO ] [MAIN ] CII: Loaded 15638 primary data records. [2025-09-29T02:12:53.739333] [DEBUG] [LOCAL ] CIG: Loaded 44447 existing records from primary storage. [2025-09-29T02:12:53.761573] [INFO ] [MAIN ] CIG: Loaded 44447 primary data records. [2025-09-29T02:12:54.400726] [DEBUG] [MAIN ] CIF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:54.403245] [INFO ] [MAIN ] CIF: Generated 1820 derivative records from 4396 primary records. [2025-09-29T02:12:54.403794] [DEBUG] [LOCAL ] CIF: Saving derivative data. [2025-09-29T02:12:54.428488] [DEBUG] [LOCAL ] CIF: Derivative data saved (1820 records). [2025-09-29T02:12:54.443383] [INFO ] [MAIN ] CIF: Successfully saved derivative data. [2025-09-29T02:12:54.443804] [DEBUG] [MAIN ] CII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:54.447952] [INFO ] [MAIN ] Derivative Progress: 421/2211 symbols completed. CIF took 1.2s. Estimated remaining: 12m 35s. Rate: 142.3 symbols/min [2025-09-29T02:12:54.449472] [INFO ] [MAIN ] CII: Generated 1820 derivative records from 15638 primary records. [2025-09-29T02:12:54.449599] [DEBUG] [LOCAL ] CII: Saving derivative data. [2025-09-29T02:12:54.449775] [INFO ] [MAIN ] CIM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:54.471044] [DEBUG] [LOCAL ] CII: Derivative data saved (1820 records). [2025-09-29T02:12:54.471793] [INFO ] [MAIN ] CII: Successfully saved derivative data. [2025-09-29T02:12:54.475685] [INFO ] [MAIN ] Derivative Progress: 422/2211 symbols completed. CII took 1.3s. Estimated remaining: 12m 33s. Rate: 142.6 symbols/min [2025-09-29T02:12:54.476772] [INFO ] [MAIN ] CIMN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:54.495265] [DEBUG] [LOCAL ] CIMN: Loaded 2697 existing records from primary storage. [2025-09-29T02:12:54.503341] [DEBUG] [MAIN ] CIG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:54.503479] [INFO ] [MAIN ] CIMN: Loaded 2697 primary data records. [2025-09-29T02:12:54.521663] [INFO ] [MAIN ] CIG: Generated 1820 derivative records from 44447 primary records. [2025-09-29T02:12:54.522191] [DEBUG] [LOCAL ] CIG: Saving derivative data. [2025-09-29T02:12:54.743073] [DEBUG] [LOCAL ] CIM: Loaded 37858 existing records from primary storage. [2025-09-29T02:12:54.740808] [DEBUG] [LOCAL ] CIG: Derivative data saved (1820 records). [2025-09-29T02:12:54.756351] [INFO ] [MAIN ] CIM: Loaded 37858 primary data records. [2025-09-29T02:12:54.761965] [INFO ] [MAIN ] CIG: Successfully saved derivative data. [2025-09-29T02:12:54.883870] [INFO ] [MAIN ] Derivative Progress: 423/2211 symbols completed. CIG took 1.6s. Estimated remaining: 12m 32s. Rate: 142.6 symbols/min [2025-09-29T02:12:54.889592] [INFO ] [MAIN ] CINT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:55.246021] [DEBUG] [LOCAL ] CINT: Loaded 18868 existing records from primary storage. [2025-09-29T02:12:55.268760] [INFO ] [MAIN ] CINT: Loaded 18868 primary data records. [2025-09-29T02:12:55.859508] [DEBUG] [MAIN ] CIMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:55.861804] [INFO ] [MAIN ] CIMN: Generated 1820 derivative records from 2697 primary records. [2025-09-29T02:12:55.862353] [DEBUG] [LOCAL ] CIMN: Saving derivative data. [2025-09-29T02:12:55.882045] [DEBUG] [LOCAL ] CIMN: Derivative data saved (1820 records). [2025-09-29T02:12:55.882402] [INFO ] [MAIN ] CIMN: Successfully saved derivative data. [2025-09-29T02:12:55.885487] [INFO ] [MAIN ] Derivative Progress: 424/2211 symbols completed. CIMN took 1.4s. Estimated remaining: 12m 34s. Rate: 142.2 symbols/min [2025-09-29T02:12:55.887026] [INFO ] [MAIN ] CIO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:55.905610] [DEBUG] [MAIN ] CIM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:55.906973] [INFO ] [MAIN ] CIM: Generated 1820 derivative records from 37858 primary records. [2025-09-29T02:12:55.907271] [DEBUG] [LOCAL ] CIM: Saving derivative data. [2025-09-29T02:12:55.931784] [DEBUG] [LOCAL ] CIM: Derivative data saved (1820 records). [2025-09-29T02:12:55.933938] [INFO ] [MAIN ] CIM: Successfully saved derivative data. [2025-09-29T02:12:55.952460] [INFO ] [MAIN ] Derivative Progress: 425/2211 symbols completed. CIM took 1.5s. Estimated remaining: 12m 32s. Rate: 142.5 symbols/min [2025-09-29T02:12:55.957989] [INFO ] [MAIN ] CION: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:55.959420] [DEBUG] [LOCAL ] CIO: Loaded 20406 existing records from primary storage. [2025-09-29T02:12:55.960152] [INFO ] [MAIN ] CIO: Loaded 20406 primary data records. [2025-09-29T02:12:55.960035] [DEBUG] [MAIN ] CINT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:55.973226] [INFO ] [MAIN ] CINT: Generated 1820 derivative records from 18868 primary records. [2025-09-29T02:12:55.995742] [DEBUG] [LOCAL ] CINT: Saving derivative data. [2025-09-29T02:12:56.097207] [DEBUG] [LOCAL ] CINT: Derivative data saved (1820 records). [2025-09-29T02:12:56.098068] [INFO ] [MAIN ] CINT: Successfully saved derivative data. [2025-09-29T02:12:56.107520] [INFO ] [MAIN ] Derivative Progress: 426/2211 symbols completed. CINT took 1.2s. Estimated remaining: 12m 31s. Rate: 142.7 symbols/min [2025-09-29T02:12:56.118109] [INFO ] [MAIN ] CIVI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:56.351389] [DEBUG] [LOCAL ] CION: Loaded 29661 existing records from primary storage. [2025-09-29T02:12:56.352482] [INFO ] [MAIN ] CION: Loaded 29661 primary data records. [2025-09-29T02:12:56.771937] [DEBUG] [LOCAL ] CIVI: Loaded 53363 existing records from primary storage. [2025-09-29T02:12:56.773017] [INFO ] [MAIN ] CIVI: Loaded 53363 primary data records. [2025-09-29T02:12:56.940105] [DEBUG] [MAIN ] CIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:56.957187] [INFO ] [MAIN ] CIO: Generated 1820 derivative records from 20406 primary records. [2025-09-29T02:12:56.963334] [DEBUG] [LOCAL ] CIO: Saving derivative data. [2025-09-29T02:12:57.169067] [DEBUG] [LOCAL ] CIO: Derivative data saved (1820 records). [2025-09-29T02:12:57.169393] [INFO ] [MAIN ] CIO: Successfully saved derivative data. [2025-09-29T02:12:57.172609] [INFO ] [MAIN ] Derivative Progress: 427/2211 symbols completed. CIO took 1.3s. Estimated remaining: 12m 33s. Rate: 142.2 symbols/min [2025-09-29T02:12:57.173260] [INFO ] [MAIN ] CL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:57.195769] [DEBUG] [MAIN ] CION: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:57.197088] [INFO ] [MAIN ] CION: Generated 1820 derivative records from 29661 primary records. [2025-09-29T02:12:57.197280] [DEBUG] [LOCAL ] CION: Saving derivative data. [2025-09-29T02:12:57.216665] [DEBUG] [LOCAL ] CION: Derivative data saved (1820 records). [2025-09-29T02:12:57.217502] [INFO ] [MAIN ] CION: Successfully saved derivative data. [2025-09-29T02:12:57.220673] [INFO ] [MAIN ] Derivative Progress: 428/2211 symbols completed. CION took 1.3s. Estimated remaining: 12m 31s. Rate: 142.4 symbols/min [2025-09-29T02:12:57.221240] [INFO ] [MAIN ] CLB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:57.255681] [DEBUG] [MAIN ] CIVI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:57.256458] [INFO ] [MAIN ] CIVI: Generated 1820 derivative records from 53363 primary records. [2025-09-29T02:12:57.256660] [DEBUG] [LOCAL ] CIVI: Saving derivative data. [2025-09-29T02:12:57.290558] [DEBUG] [LOCAL ] CIVI: Derivative data saved (1820 records). [2025-09-29T02:12:57.291072] [INFO ] [MAIN ] CIVI: Successfully saved derivative data. [2025-09-29T02:12:57.295087] [INFO ] [MAIN ] Derivative Progress: 429/2211 symbols completed. CIVI took 1.2s. Estimated remaining: 12m 29s. Rate: 142.7 symbols/min [2025-09-29T02:12:57.297792] [DEBUG] [LOCAL ] CL: Loaded 54424 existing records from primary storage. [2025-09-29T02:12:57.295387] [INFO ] [MAIN ] CLCO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:57.298319] [INFO ] [MAIN ] CL: Loaded 54424 primary data records. [2025-09-29T02:12:57.422762] [DEBUG] [LOCAL ] CLB: Loaded 33475 existing records from primary storage. [2025-09-29T02:12:57.447608] [INFO ] [MAIN ] CLB: Loaded 33475 primary data records. [2025-09-29T02:12:57.488801] [DEBUG] [LOCAL ] CLCO: Loaded 13189 existing records from primary storage. [2025-09-29T02:12:57.528038] [INFO ] [MAIN ] CLCO: Loaded 13189 primary data records. [2025-09-29T02:12:58.384166] [DEBUG] [MAIN ] CL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:58.385376] [INFO ] [MAIN ] CL: Generated 1820 derivative records from 54424 primary records. [2025-09-29T02:12:58.388845] [DEBUG] [LOCAL ] CL: Saving derivative data. [2025-09-29T02:12:58.422928] [DEBUG] [MAIN ] CLB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:58.423036] [DEBUG] [LOCAL ] CL: Derivative data saved (1820 records). [2025-09-29T02:12:58.423417] [INFO ] [MAIN ] CL: Successfully saved derivative data. [2025-09-29T02:12:58.427289] [INFO ] [MAIN ] Derivative Progress: 430/2211 symbols completed. CL took 1.3s. Estimated remaining: 12m 32s. Rate: 142.2 symbols/min [2025-09-29T02:12:58.424225] [INFO ] [MAIN ] CLB: Generated 1820 derivative records from 33475 primary records. [2025-09-29T02:12:58.427819] [DEBUG] [LOCAL ] CLB: Saving derivative data. [2025-09-29T02:12:58.428022] [INFO ] [MAIN ] CLDT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:58.450095] [DEBUG] [LOCAL ] CLB: Derivative data saved (1820 records). [2025-09-29T02:12:58.450262] [INFO ] [MAIN ] CLB: Successfully saved derivative data. [2025-09-29T02:12:58.453746] [INFO ] [MAIN ] Derivative Progress: 431/2211 symbols completed. CLB took 1.2s. Estimated remaining: 12m 30s. Rate: 142.5 symbols/min [2025-09-29T02:12:58.454251] [INFO ] [MAIN ] CLF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:58.468403] [DEBUG] [MAIN ] CLCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:58.469230] [INFO ] [MAIN ] CLCO: Generated 1820 derivative records from 13189 primary records. [2025-09-29T02:12:58.469375] [DEBUG] [LOCAL ] CLCO: Saving derivative data. [2025-09-29T02:12:58.503524] [DEBUG] [LOCAL ] CLDT: Loaded 26082 existing records from primary storage. [2025-09-29T02:12:58.504562] [INFO ] [MAIN ] CLDT: Loaded 26082 primary data records. [2025-09-29T02:12:58.524628] [DEBUG] [LOCAL ] CLCO: Derivative data saved (1820 records). [2025-09-29T02:12:58.556381] [INFO ] [MAIN ] CLCO: Successfully saved derivative data. [2025-09-29T02:12:58.584809] [INFO ] [MAIN ] Derivative Progress: 432/2211 symbols completed. CLCO took 1.3s. Estimated remaining: 12m 28s. Rate: 142.7 symbols/min [2025-09-29T02:12:58.599364] [INFO ] [MAIN ] CLH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:58.895849] [DEBUG] [LOCAL ] CLF: Loaded 54521 existing records from primary storage. [2025-09-29T02:12:58.896455] [INFO ] [MAIN ] CLF: Loaded 54521 primary data records. [2025-09-29T02:12:59.025597] [DEBUG] [LOCAL ] CLH: Loaded 28493 existing records from primary storage. [2025-09-29T02:12:59.060163] [INFO ] [MAIN ] CLH: Loaded 28493 primary data records. [2025-09-29T02:12:59.648416] [DEBUG] [MAIN ] CLDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:59.649625] [INFO ] [MAIN ] CLDT: Generated 1820 derivative records from 26082 primary records. [2025-09-29T02:12:59.650030] [DEBUG] [LOCAL ] CLDT: Saving derivative data. [2025-09-29T02:12:59.670391] [DEBUG] [LOCAL ] CLDT: Derivative data saved (1820 records). [2025-09-29T02:12:59.671544] [INFO ] [MAIN ] CLDT: Successfully saved derivative data. [2025-09-29T02:12:59.674456] [INFO ] [MAIN ] Derivative Progress: 433/2211 symbols completed. CLDT took 1.2s. Estimated remaining: 12m 30s. Rate: 142.2 symbols/min [2025-09-29T02:12:59.695858] [DEBUG] [MAIN ] CLF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:59.696629] [INFO ] [MAIN ] CLF: Generated 1820 derivative records from 54521 primary records. [2025-09-29T02:12:59.696744] [DEBUG] [LOCAL ] CLF: Saving derivative data. [2025-09-29T02:12:59.728364] [DEBUG] [MAIN ] CLH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:12:59.729612] [DEBUG] [LOCAL ] CLF: Derivative data saved (1820 records). [2025-09-29T02:12:59.730483] [INFO ] [MAIN ] CLH: Generated 1820 derivative records from 28493 primary records. [2025-09-29T02:12:59.730668] [DEBUG] [LOCAL ] CLH: Saving derivative data. [2025-09-29T02:12:59.730585] [INFO ] [MAIN ] CLF: Successfully saved derivative data. [2025-09-29T02:12:59.734576] [INFO ] [MAIN ] Derivative Progress: 434/2211 symbols completed. CLF took 1.3s. Estimated remaining: 12m 28s. Rate: 142.5 symbols/min [2025-09-29T02:12:59.751406] [DEBUG] [LOCAL ] CLH: Derivative data saved (1820 records). [2025-09-29T02:12:59.751543] [INFO ] [MAIN ] CLH: Successfully saved derivative data. [2025-09-29T02:12:59.754816] [INFO ] [MAIN ] Derivative Progress: 435/2211 symbols completed. CLH took 1.2s. Estimated remaining: 12m 26s. Rate: 142.8 symbols/min [2025-09-29T02:12:59.755415] [INFO ] [MAIN ] CLPR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:59.755568] [INFO ] [MAIN ] CLVT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:59.755511] [INFO ] [MAIN ] CLS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:12:59.773187] [DEBUG] [LOCAL ] CLPR: Loaded 11615 existing records from primary storage. [2025-09-29T02:12:59.773419] [INFO ] [MAIN ] CLPR: Loaded 11615 primary data records. [2025-09-29T02:13:00.153192] [DEBUG] [LOCAL ] CLVT: Loaded 52713 existing records from primary storage. [2025-09-29T02:13:00.153766] [INFO ] [MAIN ] CLVT: Loaded 52713 primary data records. [2025-09-29T02:13:00.298039] [DEBUG] [LOCAL ] CLS: Loaded 54412 existing records from primary storage. [2025-09-29T02:13:00.314402] [INFO ] [MAIN ] CLS: Loaded 54412 primary data records. [2025-09-29T02:13:00.885452] [DEBUG] [MAIN ] CLPR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:00.886876] [INFO ] [MAIN ] CLPR: Generated 1820 derivative records from 11615 primary records. [2025-09-29T02:13:00.888336] [DEBUG] [LOCAL ] CLPR: Saving derivative data. [2025-09-29T02:13:00.909746] [DEBUG] [LOCAL ] CLPR: Derivative data saved (1820 records). [2025-09-29T02:13:00.918510] [INFO ] [MAIN ] CLPR: Successfully saved derivative data. [2025-09-29T02:13:00.926272] [INFO ] [MAIN ] Derivative Progress: 436/2211 symbols completed. CLPR took 1.2s. Estimated remaining: 12m 29s. Rate: 142.2 symbols/min [2025-09-29T02:13:00.926715] [INFO ] [MAIN ] CLW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:00.927434] [DEBUG] [MAIN ] CLVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:00.930325] [INFO ] [MAIN ] CLVT: Generated 1820 derivative records from 52713 primary records. [2025-09-29T02:13:00.930813] [DEBUG] [LOCAL ] CLVT: Saving derivative data. [2025-09-29T02:13:00.948979] [DEBUG] [LOCAL ] CLVT: Derivative data saved (1820 records). [2025-09-29T02:13:00.949335] [INFO ] [MAIN ] CLVT: Successfully saved derivative data. [2025-09-29T02:13:00.953313] [INFO ] [MAIN ] Derivative Progress: 437/2211 symbols completed. CLVT took 1.2s. Estimated remaining: 12m 27s. Rate: 142.5 symbols/min [2025-09-29T02:13:00.954131] [INFO ] [MAIN ] CLX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:00.979664] [DEBUG] [MAIN ] CLS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:00.980537] [INFO ] [MAIN ] CLS: Generated 1820 derivative records from 54412 primary records. [2025-09-29T02:13:00.980731] [DEBUG] [LOCAL ] CLS: Saving derivative data. [2025-09-29T02:13:01.005532] [DEBUG] [LOCAL ] CLW: Loaded 22226 existing records from primary storage. [2025-09-29T02:13:01.006308] [INFO ] [MAIN ] CLW: Loaded 22226 primary data records. [2025-09-29T02:13:01.060942] [DEBUG] [LOCAL ] CLS: Derivative data saved (1820 records). [2025-09-29T02:13:01.097224] [INFO ] [MAIN ] CLS: Successfully saved derivative data. [2025-09-29T02:13:01.100745] [INFO ] [MAIN ] Derivative Progress: 438/2211 symbols completed. CLS took 1.3s. Estimated remaining: 12m 25s. Rate: 142.7 symbols/min [2025-09-29T02:13:01.111298] [INFO ] [MAIN ] CM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:01.409461] [DEBUG] [LOCAL ] CLX: Loaded 52189 existing records from primary storage. [2025-09-29T02:13:01.409802] [INFO ] [MAIN ] CLX: Loaded 52189 primary data records. [2025-09-29T02:13:01.599783] [DEBUG] [LOCAL ] CM: Loaded 49317 existing records from primary storage. [2025-09-29T02:13:01.600077] [INFO ] [MAIN ] CM: Loaded 49317 primary data records. [2025-09-29T02:13:02.130574] [DEBUG] [MAIN ] CLW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:02.131835] [INFO ] [MAIN ] CLW: Generated 1820 derivative records from 22226 primary records. [2025-09-29T02:13:02.132322] [DEBUG] [LOCAL ] CLW: Saving derivative data. [2025-09-29T02:13:02.152385] [DEBUG] [LOCAL ] CLW: Derivative data saved (1820 records). [2025-09-29T02:13:02.153347] [INFO ] [MAIN ] CLW: Successfully saved derivative data. [2025-09-29T02:13:02.156230] [INFO ] [MAIN ] Derivative Progress: 439/2211 symbols completed. CLW took 1.2s. Estimated remaining: 12m 28s. Rate: 142.2 symbols/min [2025-09-29T02:13:02.157592] [INFO ] [MAIN ] CMA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:02.177606] [DEBUG] [MAIN ] CLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:02.178552] [INFO ] [MAIN ] CLX: Generated 1820 derivative records from 52189 primary records. [2025-09-29T02:13:02.178845] [DEBUG] [LOCAL ] CLX: Saving derivative data. [2025-09-29T02:13:02.199702] [DEBUG] [LOCAL ] CLX: Derivative data saved (1820 records). [2025-09-29T02:13:02.200013] [INFO ] [MAIN ] CLX: Successfully saved derivative data. [2025-09-29T02:13:02.202691] [INFO ] [MAIN ] Derivative Progress: 440/2211 symbols completed. CLX took 1.2s. Estimated remaining: 12m 26s. Rate: 142.5 symbols/min [2025-09-29T02:13:02.203200] [INFO ] [MAIN ] CMBT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:02.224096] [DEBUG] [MAIN ] CM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:02.225150] [INFO ] [MAIN ] CM: Generated 1820 derivative records from 49317 primary records. [2025-09-29T02:13:02.225354] [DEBUG] [LOCAL ] CM: Saving derivative data. [2025-09-29T02:13:02.258589] [DEBUG] [LOCAL ] CM: Derivative data saved (1820 records). [2025-09-29T02:13:02.259015] [INFO ] [MAIN ] CM: Successfully saved derivative data. [2025-09-29T02:13:02.262238] [INFO ] [MAIN ] Derivative Progress: 441/2211 symbols completed. CM took 1.2s. Estimated remaining: 12m 24s. Rate: 142.8 symbols/min [2025-09-29T02:13:02.262520] [INFO ] [MAIN ] CMC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:02.296991] [DEBUG] [LOCAL ] CMA: Loaded 50721 existing records from primary storage. [2025-09-29T02:13:02.297326] [INFO ] [MAIN ] CMA: Loaded 50721 primary data records. [2025-09-29T02:13:02.298193] [DEBUG] [LOCAL ] CMBT: Loaded 22911 existing records from primary storage. [2025-09-29T02:13:02.321709] [INFO ] [MAIN ] CMBT: Loaded 22911 primary data records. [2025-09-29T02:13:02.759072] [DEBUG] [LOCAL ] CMC: Loaded 46311 existing records from primary storage. [2025-09-29T02:13:02.811415] [INFO ] [MAIN ] CMC: Loaded 46311 primary data records. [2025-09-29T02:13:03.405500] [DEBUG] [MAIN ] CMA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:03.406866] [INFO ] [MAIN ] CMA: Generated 1820 derivative records from 50721 primary records. [2025-09-29T02:13:03.407098] [DEBUG] [LOCAL ] CMA: Saving derivative data. [2025-09-29T02:13:03.426855] [DEBUG] [LOCAL ] CMA: Derivative data saved (1820 records). [2025-09-29T02:13:03.435293] [INFO ] [MAIN ] CMA: Successfully saved derivative data. [2025-09-29T02:13:03.444389] [DEBUG] [MAIN ] CMBT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:03.445567] [INFO ] [MAIN ] CMBT: Generated 1820 derivative records from 22911 primary records. [2025-09-29T02:13:03.443860] [INFO ] [MAIN ] Derivative Progress: 442/2211 symbols completed. CMA took 1.3s. Estimated remaining: 12m 26s. Rate: 142.2 symbols/min [2025-09-29T02:13:03.446043] [INFO ] [MAIN ] CMCM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:03.445888] [DEBUG] [LOCAL ] CMBT: Saving derivative data. [2025-09-29T02:13:03.472832] [DEBUG] [MAIN ] CMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:03.477996] [INFO ] [MAIN ] CMC: Generated 1820 derivative records from 46311 primary records. [2025-09-29T02:13:03.478690] [DEBUG] [LOCAL ] CMC: Saving derivative data. [2025-09-29T02:13:03.484047] [DEBUG] [LOCAL ] CMBT: Derivative data saved (1820 records). [2025-09-29T02:13:03.487522] [DEBUG] [LOCAL ] CMCM: Loaded 4834 existing records from primary storage. [2025-09-29T02:13:03.487228] [INFO ] [MAIN ] CMBT: Successfully saved derivative data. [2025-09-29T02:13:03.487958] [INFO ] [MAIN ] CMCM: Loaded 4834 primary data records. [2025-09-29T02:13:03.496709] [INFO ] [MAIN ] Derivative Progress: 443/2211 symbols completed. CMBT took 1.3s. Estimated remaining: 12m 25s. Rate: 142.5 symbols/min [2025-09-29T02:13:03.496996] [INFO ] [MAIN ] CMG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:03.574886] [DEBUG] [LOCAL ] CMC: Derivative data saved (1820 records). [2025-09-29T02:13:03.610883] [INFO ] [MAIN ] CMC: Successfully saved derivative data. [2025-09-29T02:13:03.636395] [INFO ] [MAIN ] Derivative Progress: 444/2211 symbols completed. CMC took 1.4s. Estimated remaining: 12m 23s. Rate: 142.7 symbols/min [2025-09-29T02:13:03.637301] [INFO ] [MAIN ] CMI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:03.899325] [DEBUG] [LOCAL ] CMG: Loaded 54501 existing records from primary storage. [2025-09-29T02:13:03.899763] [INFO ] [MAIN ] CMG: Loaded 54501 primary data records. [2025-09-29T02:13:04.078503] [DEBUG] [LOCAL ] CMI: Loaded 42484 existing records from primary storage. [2025-09-29T02:13:04.130679] [INFO ] [MAIN ] CMI: Loaded 42484 primary data records. [2025-09-29T02:13:04.358283] [DEBUG] [MAIN ] CMCM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:04.394619] [INFO ] [MAIN ] CMCM: Generated 1820 derivative records from 4834 primary records. [2025-09-29T02:13:04.400624] [DEBUG] [LOCAL ] CMCM: Saving derivative data. [2025-09-29T02:13:04.633872] [DEBUG] [LOCAL ] CMCM: Derivative data saved (1820 records). [2025-09-29T02:13:04.634277] [INFO ] [MAIN ] CMCM: Successfully saved derivative data. [2025-09-29T02:13:04.637030] [INFO ] [MAIN ] Derivative Progress: 445/2211 symbols completed. CMCM took 1.2s. Estimated remaining: 12m 25s. Rate: 142.3 symbols/min [2025-09-29T02:13:04.637752] [INFO ] [MAIN ] CMP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:04.661975] [DEBUG] [MAIN ] CMG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:04.662972] [INFO ] [MAIN ] CMG: Generated 1820 derivative records from 54501 primary records. [2025-09-29T02:13:04.663211] [DEBUG] [LOCAL ] CMG: Saving derivative data. [2025-09-29T02:13:04.692093] [DEBUG] [LOCAL ] CMG: Derivative data saved (1820 records). [2025-09-29T02:13:04.692336] [INFO ] [MAIN ] CMG: Successfully saved derivative data. [2025-09-29T02:13:04.695269] [INFO ] [MAIN ] Derivative Progress: 446/2211 symbols completed. CMG took 1.2s. Estimated remaining: 12m 23s. Rate: 142.5 symbols/min [2025-09-29T02:13:04.695801] [INFO ] [MAIN ] CMPO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:04.714424] [DEBUG] [LOCAL ] CMP: Loaded 36848 existing records from primary storage. [2025-09-29T02:13:04.728472] [DEBUG] [MAIN ] CMI: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:13:04.728042] [INFO ] [MAIN ] CMP: Loaded 36848 primary data records. [2025-09-29T02:13:04.729398] [INFO ] [MAIN ] CMI: Generated 1819 derivative records from 42484 primary records. [2025-09-29T02:13:04.746626] [DEBUG] [LOCAL ] CMI: Saving derivative data. [2025-09-29T02:13:04.859361] [DEBUG] [LOCAL ] CMI: Derivative data saved (1819 records). [2025-09-29T02:13:04.881088] [INFO ] [MAIN ] CMI: Successfully saved derivative data. [2025-09-29T02:13:04.901533] [INFO ] [MAIN ] Derivative Progress: 447/2211 symbols completed. CMI took 1.3s. Estimated remaining: 12m 22s. Rate: 142.7 symbols/min [2025-09-29T02:13:04.927734] [INFO ] [MAIN ] CMRE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:04.955201] [DEBUG] [LOCAL ] CMPO: Loaded 40071 existing records from primary storage. [2025-09-29T02:13:04.987115] [INFO ] [MAIN ] CMPO: Loaded 40071 primary data records. [2025-09-29T02:13:05.534210] [DEBUG] [LOCAL ] CMRE: Loaded 36068 existing records from primary storage. [2025-09-29T02:13:05.535058] [INFO ] [MAIN ] CMRE: Loaded 36068 primary data records. [2025-09-29T02:13:05.808067] [DEBUG] [MAIN ] CMP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:05.891279] [INFO ] [MAIN ] CMP: Generated 1820 derivative records from 36848 primary records. [2025-09-29T02:13:05.892202] [DEBUG] [LOCAL ] CMP: Saving derivative data. [2025-09-29T02:13:05.912921] [DEBUG] [LOCAL ] CMP: Derivative data saved (1820 records). [2025-09-29T02:13:05.913553] [INFO ] [MAIN ] CMP: Successfully saved derivative data. [2025-09-29T02:13:05.916900] [INFO ] [MAIN ] Derivative Progress: 448/2211 symbols completed. CMP took 1.3s. Estimated remaining: 12m 24s. Rate: 142.2 symbols/min [2025-09-29T02:13:05.936155] [DEBUG] [MAIN ] CMPO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:05.937335] [INFO ] [MAIN ] CMPO: Generated 1820 derivative records from 40071 primary records. [2025-09-29T02:13:05.937578] [DEBUG] [LOCAL ] CMPO: Saving derivative data. [2025-09-29T02:13:05.954932] [DEBUG] [LOCAL ] CMPO: Derivative data saved (1820 records). [2025-09-29T02:13:05.955100] [INFO ] [MAIN ] CMPO: Successfully saved derivative data. [2025-09-29T02:13:05.958271] [INFO ] [MAIN ] Derivative Progress: 449/2211 symbols completed. CMPO took 1.3s. Estimated remaining: 12m 22s. Rate: 142.5 symbols/min [2025-09-29T02:13:05.974944] [DEBUG] [MAIN ] CMRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:05.975726] [INFO ] [MAIN ] CMRE: Generated 1820 derivative records from 36068 primary records. [2025-09-29T02:13:05.975823] [DEBUG] [LOCAL ] CMRE: Saving derivative data. [2025-09-29T02:13:05.992172] [DEBUG] [LOCAL ] CMRE: Derivative data saved (1820 records). [2025-09-29T02:13:05.992259] [INFO ] [MAIN ] CMRE: Successfully saved derivative data. [2025-09-29T02:13:05.995674] [INFO ] [MAIN ] Derivative Progress: 450/2211 symbols completed. CMRE took 1.1s. Estimated remaining: 12m 20s. Rate: 142.8 symbols/min [2025-09-29T02:13:05.996348] [INFO ] [MAIN ] CMSC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:05.996248] [INFO ] [MAIN ] CMS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:05.996630] [INFO ] [MAIN ] CMSA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:06.007907] [DEBUG] [LOCAL ] CMSA: Loaded 3421 existing records from primary storage. [2025-09-29T02:13:06.008301] [INFO ] [MAIN ] CMSA: Loaded 3421 primary data records. [2025-09-29T02:13:06.046584] [DEBUG] [LOCAL ] CMSC: Loaded 5131 existing records from primary storage. [2025-09-29T02:13:06.087525] [INFO ] [MAIN ] CMSC: Loaded 5131 primary data records. [2025-09-29T02:13:06.698280] [DEBUG] [LOCAL ] CMS: Loaded 53371 existing records from primary storage. [2025-09-29T02:13:06.700737] [INFO ] [MAIN ] CMS: Loaded 53371 primary data records. [2025-09-29T02:13:07.048914] [DEBUG] [MAIN ] CMSA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:07.054056] [INFO ] [MAIN ] CMSA: Generated 1820 derivative records from 3421 primary records. [2025-09-29T02:13:07.054973] [DEBUG] [LOCAL ] CMSA: Saving derivative data. [2025-09-29T02:13:07.068021] [DEBUG] [MAIN ] CMSC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:07.069678] [INFO ] [MAIN ] CMSC: Generated 1820 derivative records from 5131 primary records. [2025-09-29T02:13:07.070076] [DEBUG] [LOCAL ] CMSC: Saving derivative data. [2025-09-29T02:13:07.086187] [DEBUG] [LOCAL ] CMSA: Derivative data saved (1820 records). [2025-09-29T02:13:07.094214] [INFO ] [MAIN ] CMSA: Successfully saved derivative data. [2025-09-29T02:13:07.102949] [INFO ] [MAIN ] Derivative Progress: 451/2211 symbols completed. CMSA took 1.1s. Estimated remaining: 12m 22s. Rate: 142.3 symbols/min [2025-09-29T02:13:07.103852] [INFO ] [MAIN ] CMSD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:07.105669] [DEBUG] [LOCAL ] CMSC: Derivative data saved (1820 records). [2025-09-29T02:13:07.105961] [INFO ] [MAIN ] CMSC: Successfully saved derivative data. [2025-09-29T02:13:07.109708] [INFO ] [MAIN ] Derivative Progress: 452/2211 symbols completed. CMSC took 1.1s. Estimated remaining: 12m 20s. Rate: 142.6 symbols/min [2025-09-29T02:13:07.110379] [INFO ] [MAIN ] CMTG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:07.130739] [DEBUG] [MAIN ] CMS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:07.134515] [DEBUG] [LOCAL ] CMSD: Loaded 8184 existing records from primary storage. [2025-09-29T02:13:07.135556] [INFO ] [MAIN ] CMS: Generated 1820 derivative records from 53371 primary records. [2025-09-29T02:13:07.135715] [INFO ] [MAIN ] CMSD: Loaded 8184 primary data records. [2025-09-29T02:13:07.157547] [DEBUG] [LOCAL ] CMS: Saving derivative data. [2025-09-29T02:13:07.274788] [DEBUG] [LOCAL ] CMS: Derivative data saved (1820 records). [2025-09-29T02:13:07.327211] [INFO ] [MAIN ] CMS: Successfully saved derivative data. [2025-09-29T02:13:07.362875] [INFO ] [MAIN ] Derivative Progress: 453/2211 symbols completed. CMS took 1.4s. Estimated remaining: 12m 19s. Rate: 142.7 symbols/min [2025-09-29T02:13:07.533375] [INFO ] [MAIN ] CMU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:07.551727] [DEBUG] [LOCAL ] CMTG: Loaded 37931 existing records from primary storage. [2025-09-29T02:13:07.552436] [INFO ] [MAIN ] CMTG: Loaded 37931 primary data records. [2025-09-29T02:13:07.658745] [DEBUG] [LOCAL ] CMU: Loaded 7303 existing records from primary storage. [2025-09-29T02:13:07.680973] [INFO ] [MAIN ] CMU: Loaded 7303 primary data records. [2025-09-29T02:13:08.259495] [DEBUG] [MAIN ] CMSD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:08.262860] [INFO ] [MAIN ] CMSD: Generated 1820 derivative records from 8184 primary records. [2025-09-29T02:13:08.263665] [DEBUG] [LOCAL ] CMSD: Saving derivative data. [2025-09-29T02:13:08.283083] [DEBUG] [LOCAL ] CMSD: Derivative data saved (1820 records). [2025-09-29T02:13:08.284073] [INFO ] [MAIN ] CMSD: Successfully saved derivative data. [2025-09-29T02:13:08.286997] [INFO ] [MAIN ] Derivative Progress: 454/2211 symbols completed. CMSD took 1.2s. Estimated remaining: 12m 21s. Rate: 142.4 symbols/min [2025-09-29T02:13:08.287392] [INFO ] [MAIN ] CNA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:08.325635] [DEBUG] [MAIN ] CMU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:08.325316] [DEBUG] [MAIN ] CMTG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:08.326497] [INFO ] [MAIN ] CMU: Generated 1820 derivative records from 7303 primary records. [2025-09-29T02:13:08.327170] [INFO ] [MAIN ] CMTG: Generated 1820 derivative records from 37931 primary records. [2025-09-29T02:13:08.327596] [DEBUG] [LOCAL ] CMTG: Saving derivative data. [2025-09-29T02:13:08.337021] [DEBUG] [LOCAL ] CMU: Saving derivative data. [2025-09-29T02:13:08.365896] [DEBUG] [LOCAL ] CMTG: Derivative data saved (1820 records). [2025-09-29T02:13:08.366143] [INFO ] [MAIN ] CMTG: Successfully saved derivative data. [2025-09-29T02:13:08.372693] [INFO ] [MAIN ] Derivative Progress: 455/2211 symbols completed. CMTG took 1.3s. Estimated remaining: 12m 19s. Rate: 142.6 symbols/min [2025-09-29T02:13:08.374078] [DEBUG] [LOCAL ] CMU: Derivative data saved (1820 records). [2025-09-29T02:13:08.374257] [INFO ] [MAIN ] CNC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:08.374697] [INFO ] [MAIN ] CMU: Successfully saved derivative data. [2025-09-29T02:13:08.378245] [INFO ] [MAIN ] Derivative Progress: 456/2211 symbols completed. CMU took 0.8s. Estimated remaining: 12m 17s. Rate: 142.9 symbols/min [2025-09-29T02:13:08.389047] [INFO ] [MAIN ] CNF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:08.395422] [DEBUG] [LOCAL ] CNA: Loaded 33235 existing records from primary storage. [2025-09-29T02:13:08.396062] [INFO ] [MAIN ] CNA: Loaded 33235 primary data records. [2025-09-29T02:13:08.498589] [DEBUG] [LOCAL ] CNF: Loaded 11166 existing records from primary storage. [2025-09-29T02:13:08.517706] [INFO ] [MAIN ] CNF: Loaded 11166 primary data records. [2025-09-29T02:13:08.970630] [DEBUG] [LOCAL ] CNC: Loaded 54518 existing records from primary storage. [2025-09-29T02:13:08.971598] [INFO ] [MAIN ] CNC: Loaded 54518 primary data records. [2025-09-29T02:13:09.462407] [DEBUG] [MAIN ] CNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:09.464733] [INFO ] [MAIN ] CNA: Generated 1820 derivative records from 33235 primary records. [2025-09-29T02:13:09.465127] [DEBUG] [LOCAL ] CNA: Saving derivative data. [2025-09-29T02:13:09.487124] [DEBUG] [LOCAL ] CNA: Derivative data saved (1820 records). [2025-09-29T02:13:09.499964] [INFO ] [MAIN ] CNA: Successfully saved derivative data. [2025-09-29T02:13:09.503075] [INFO ] [MAIN ] Derivative Progress: 457/2211 symbols completed. CNA took 1.2s. Estimated remaining: 12m 19s. Rate: 142.4 symbols/min [2025-09-29T02:13:09.503404] [INFO ] [MAIN ] CNH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:09.503986] [DEBUG] [MAIN ] CNF: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:13:09.505434] [INFO ] [MAIN ] CNF: Generated 1819 derivative records from 11166 primary records. [2025-09-29T02:13:09.505783] [DEBUG] [LOCAL ] CNF: Saving derivative data. [2025-09-29T02:13:09.526023] [DEBUG] [LOCAL ] CNF: Derivative data saved (1819 records). [2025-09-29T02:13:09.526483] [INFO ] [MAIN ] CNF: Successfully saved derivative data. [2025-09-29T02:13:09.529670] [INFO ] [MAIN ] Derivative Progress: 458/2211 symbols completed. CNF took 1.1s. Estimated remaining: 12m 17s. Rate: 142.7 symbols/min [2025-09-29T02:13:09.544753] [DEBUG] [MAIN ] CNC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:09.530288] [INFO ] [MAIN ] CNI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:09.545692] [INFO ] [MAIN ] CNC: Generated 1820 derivative records from 54518 primary records. [2025-09-29T02:13:09.546300] [DEBUG] [LOCAL ] CNC: Saving derivative data. [2025-09-29T02:13:09.563871] [DEBUG] [LOCAL ] CNC: Derivative data saved (1820 records). [2025-09-29T02:13:09.564341] [INFO ] [MAIN ] CNC: Successfully saved derivative data. [2025-09-29T02:13:09.568138] [INFO ] [MAIN ] Derivative Progress: 459/2211 symbols completed. CNC took 1.2s. Estimated remaining: 12m 15s. Rate: 143.0 symbols/min [2025-09-29T02:13:09.568449] [INFO ] [MAIN ] CNK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:09.627359] [DEBUG] [LOCAL ] CNH: Loaded 54337 existing records from primary storage. [2025-09-29T02:13:09.627759] [INFO ] [MAIN ] CNH: Loaded 54337 primary data records. [2025-09-29T02:13:09.754462] [DEBUG] [LOCAL ] CNI: Loaded 52419 existing records from primary storage. [2025-09-29T02:13:09.762459] [INFO ] [MAIN ] CNI: Loaded 52419 primary data records. [2025-09-29T02:13:09.983615] [DEBUG] [LOCAL ] CNK: Loaded 53658 existing records from primary storage. [2025-09-29T02:13:10.045277] [INFO ] [MAIN ] CNK: Loaded 53658 primary data records. [2025-09-29T02:13:10.745908] [DEBUG] [MAIN ] CNH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:10.748549] [INFO ] [MAIN ] CNH: Generated 1820 derivative records from 54337 primary records. [2025-09-29T02:13:10.749109] [DEBUG] [LOCAL ] CNH: Saving derivative data. [2025-09-29T02:13:10.767438] [DEBUG] [LOCAL ] CNH: Derivative data saved (1820 records). [2025-09-29T02:13:10.767844] [INFO ] [MAIN ] CNH: Successfully saved derivative data. [2025-09-29T02:13:10.770951] [INFO ] [MAIN ] Derivative Progress: 460/2211 symbols completed. CNH took 1.3s. Estimated remaining: 12m 18s. Rate: 142.4 symbols/min [2025-09-29T02:13:10.771308] [INFO ] [MAIN ] CNM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:10.789537] [DEBUG] [MAIN ] CNI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:10.791885] [INFO ] [MAIN ] CNI: Generated 1820 derivative records from 52419 primary records. [2025-09-29T02:13:10.792184] [DEBUG] [LOCAL ] CNI: Saving derivative data. [2025-09-29T02:13:10.806450] [DEBUG] [MAIN ] CNK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:10.807616] [INFO ] [MAIN ] CNK: Generated 1820 derivative records from 53658 primary records. [2025-09-29T02:13:10.808061] [DEBUG] [LOCAL ] CNK: Saving derivative data. [2025-09-29T02:13:10.838511] [DEBUG] [LOCAL ] CNI: Derivative data saved (1820 records). [2025-09-29T02:13:10.841253] [INFO ] [MAIN ] CNI: Successfully saved derivative data. [2025-09-29T02:13:10.842522] [DEBUG] [LOCAL ] CNK: Derivative data saved (1820 records). [2025-09-29T02:13:10.845937] [INFO ] [MAIN ] CNK: Successfully saved derivative data. [2025-09-29T02:13:10.845677] [INFO ] [MAIN ] Derivative Progress: 461/2211 symbols completed. CNI took 1.3s. Estimated remaining: 12m 16s. Rate: 142.6 symbols/min [2025-09-29T02:13:10.849873] [INFO ] [MAIN ] CNMD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:10.849952] [INFO ] [MAIN ] Derivative Progress: 462/2211 symbols completed. CNK took 1.3s. Estimated remaining: 12m 14s. Rate: 143.0 symbols/min [2025-09-29T02:13:10.850674] [INFO ] [MAIN ] CNNE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:10.894966] [DEBUG] [LOCAL ] CNM: Loaded 51747 existing records from primary storage. [2025-09-29T02:13:10.895233] [INFO ] [MAIN ] CNM: Loaded 51747 primary data records. [2025-09-29T02:13:11.094967] [DEBUG] [LOCAL ] CNNE: Loaded 37257 existing records from primary storage. [2025-09-29T02:13:11.134189] [DEBUG] [LOCAL ] CNMD: Loaded 32884 existing records from primary storage. [2025-09-29T02:13:11.140978] [INFO ] [MAIN ] CNNE: Loaded 37257 primary data records. [2025-09-29T02:13:11.141263] [INFO ] [MAIN ] CNMD: Loaded 32884 primary data records. [2025-09-29T02:13:12.006220] [DEBUG] [MAIN ] CNM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:12.007943] [INFO ] [MAIN ] CNM: Generated 1820 derivative records from 51747 primary records. [2025-09-29T02:13:12.008088] [DEBUG] [LOCAL ] CNM: Saving derivative data. [2025-09-29T02:13:12.027604] [DEBUG] [LOCAL ] CNM: Derivative data saved (1820 records). [2025-09-29T02:13:12.028114] [INFO ] [MAIN ] CNM: Successfully saved derivative data. [2025-09-29T02:13:12.030705] [INFO ] [MAIN ] Derivative Progress: 463/2211 symbols completed. CNM took 1.3s. Estimated remaining: 12m 17s. Rate: 142.4 symbols/min [2025-09-29T02:13:12.063897] [DEBUG] [MAIN ] CNMD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:12.064242] [DEBUG] [MAIN ] CNNE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:12.065248] [INFO ] [MAIN ] CNMD: Generated 1820 derivative records from 32884 primary records. [2025-09-29T02:13:12.066082] [INFO ] [MAIN ] CNNE: Generated 1820 derivative records from 37257 primary records. [2025-09-29T02:13:12.066280] [DEBUG] [LOCAL ] CNMD: Saving derivative data. [2025-09-29T02:13:12.066426] [DEBUG] [LOCAL ] CNNE: Saving derivative data. [2025-09-29T02:13:12.100494] [DEBUG] [LOCAL ] CNNE: Derivative data saved (1820 records). [2025-09-29T02:13:12.099193] [DEBUG] [LOCAL ] CNMD: Derivative data saved (1820 records). [2025-09-29T02:13:12.100809] [INFO ] [MAIN ] CNNE: Successfully saved derivative data. [2025-09-29T02:13:12.100728] [INFO ] [MAIN ] CNMD: Successfully saved derivative data. [2025-09-29T02:13:12.104277] [INFO ] [MAIN ] Derivative Progress: 464/2211 symbols completed. CNMD took 1.3s. Estimated remaining: 12m 15s. Rate: 142.7 symbols/min [2025-09-29T02:13:12.107448] [INFO ] [MAIN ] Derivative Progress: 465/2211 symbols completed. CNNE took 1.3s. Estimated remaining: 12m 13s. Rate: 143.0 symbols/min [2025-09-29T02:13:12.107865] [INFO ] [MAIN ] CNO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:12.108093] [INFO ] [MAIN ] CNQ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:12.107970] [INFO ] [MAIN ] CNP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:12.209925] [DEBUG] [LOCAL ] CNO: Loaded 41901 existing records from primary storage. [2025-09-29T02:13:12.210327] [INFO ] [MAIN ] CNO: Loaded 41901 primary data records. [2025-09-29T02:13:12.211510] [DEBUG] [LOCAL ] CNQ: Loaded 54361 existing records from primary storage. [2025-09-29T02:13:12.236606] [INFO ] [MAIN ] CNQ: Loaded 54361 primary data records. [2025-09-29T02:13:12.382693] [DEBUG] [LOCAL ] CNP: Loaded 54249 existing records from primary storage. [2025-09-29T02:13:12.438125] [INFO ] [MAIN ] CNP: Loaded 54249 primary data records. [2025-09-29T02:13:13.264797] [DEBUG] [MAIN ] CNO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:13.266579] [INFO ] [MAIN ] CNO: Generated 1820 derivative records from 41901 primary records. [2025-09-29T02:13:13.267239] [DEBUG] [LOCAL ] CNO: Saving derivative data. [2025-09-29T02:13:13.281717] [DEBUG] [MAIN ] CNQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:13.282713] [INFO ] [MAIN ] CNQ: Generated 1820 derivative records from 54361 primary records. [2025-09-29T02:13:13.290748] [DEBUG] [LOCAL ] CNQ: Saving derivative data. [2025-09-29T02:13:13.319692] [DEBUG] [LOCAL ] CNO: Derivative data saved (1820 records). [2025-09-29T02:13:13.318100] [DEBUG] [LOCAL ] CNQ: Derivative data saved (1820 records). [2025-09-29T02:13:13.320245] [INFO ] [MAIN ] CNO: Successfully saved derivative data. [2025-09-29T02:13:13.320305] [INFO ] [MAIN ] CNQ: Successfully saved derivative data. [2025-09-29T02:13:13.322968] [INFO ] [MAIN ] Derivative Progress: 466/2211 symbols completed. CNO took 1.2s. Estimated remaining: 12m 15s. Rate: 142.4 symbols/min [2025-09-29T02:13:13.323362] [INFO ] [MAIN ] CNS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:13.341234] [DEBUG] [MAIN ] CNP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:13.340531] [INFO ] [MAIN ] Derivative Progress: 467/2211 symbols completed. CNQ took 1.2s. Estimated remaining: 12m 13s. Rate: 142.7 symbols/min [2025-09-29T02:13:13.342615] [INFO ] [MAIN ] CNP: Generated 1820 derivative records from 54249 primary records. [2025-09-29T02:13:13.343367] [INFO ] [MAIN ] CNX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:13.343680] [DEBUG] [LOCAL ] CNP: Saving derivative data. [2025-09-29T02:13:13.362368] [DEBUG] [LOCAL ] CNP: Derivative data saved (1820 records). [2025-09-29T02:13:13.362767] [INFO ] [MAIN ] CNP: Successfully saved derivative data. [2025-09-29T02:13:13.366528] [INFO ] [MAIN ] Derivative Progress: 468/2211 symbols completed. CNP took 1.3s. Estimated remaining: 12m 12s. Rate: 143.0 symbols/min [2025-09-29T02:13:13.366811] [INFO ] [MAIN ] CODI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:13.384187] [DEBUG] [LOCAL ] CNS: Loaded 21245 existing records from primary storage. [2025-09-29T02:13:13.384411] [INFO ] [MAIN ] CNS: Loaded 21245 primary data records. [2025-09-29T02:13:13.765686] [DEBUG] [LOCAL ] CNX: Loaded 52150 existing records from primary storage. [2025-09-29T02:13:13.784959] [INFO ] [MAIN ] CNX: Loaded 52150 primary data records. [2025-09-29T02:13:13.792089] [DEBUG] [LOCAL ] CODI: Loaded 40312 existing records from primary storage. [2025-09-29T02:13:13.800260] [INFO ] [MAIN ] CODI: Loaded 40312 primary data records. [2025-09-29T02:13:14.506188] [DEBUG] [MAIN ] CNS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:14.507299] [INFO ] [MAIN ] CNS: Generated 1820 derivative records from 21245 primary records. [2025-09-29T02:13:14.509617] [DEBUG] [LOCAL ] CNS: Saving derivative data. [2025-09-29T02:13:14.528771] [DEBUG] [LOCAL ] CNS: Derivative data saved (1820 records). [2025-09-29T02:13:14.529933] [INFO ] [MAIN ] CNS: Successfully saved derivative data. [2025-09-29T02:13:14.532755] [INFO ] [MAIN ] Derivative Progress: 469/2211 symbols completed. CNS took 1.2s. Estimated remaining: 12m 14s. Rate: 142.4 symbols/min [2025-09-29T02:13:14.534225] [INFO ] [MAIN ] COF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:14.557078] [DEBUG] [MAIN ] CNX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:14.558235] [INFO ] [MAIN ] CNX: Generated 1820 derivative records from 52150 primary records. [2025-09-29T02:13:14.558487] [DEBUG] [LOCAL ] CNX: Saving derivative data. [2025-09-29T02:13:14.581386] [DEBUG] [LOCAL ] CNX: Derivative data saved (1820 records). [2025-09-29T02:13:14.590218] [INFO ] [MAIN ] CNX: Successfully saved derivative data. [2025-09-29T02:13:14.595874] [DEBUG] [MAIN ] CODI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:14.599545] [INFO ] [MAIN ] Derivative Progress: 470/2211 symbols completed. CNX took 1.3s. Estimated remaining: 12m 12s. Rate: 142.7 symbols/min [2025-09-29T02:13:14.600950] [INFO ] [MAIN ] CODI: Generated 1820 derivative records from 40312 primary records. [2025-09-29T02:13:14.616267] [INFO ] [MAIN ] COHR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:14.616468] [DEBUG] [LOCAL ] CODI: Saving derivative data. [2025-09-29T02:13:14.639370] [DEBUG] [LOCAL ] CODI: Derivative data saved (1820 records). [2025-09-29T02:13:14.639690] [INFO ] [MAIN ] CODI: Successfully saved derivative data. [2025-09-29T02:13:14.658552] [INFO ] [MAIN ] Derivative Progress: 471/2211 symbols completed. CODI took 1.3s. Estimated remaining: 12m 10s. Rate: 142.9 symbols/min [2025-09-29T02:13:14.659184] [INFO ] [MAIN ] COLD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:14.661956] [DEBUG] [LOCAL ] COF: Loaded 54389 existing records from primary storage. [2025-09-29T02:13:14.662141] [INFO ] [MAIN ] COF: Loaded 54389 primary data records. [2025-09-29T02:13:15.037322] [DEBUG] [LOCAL ] COHR: Loaded 54144 existing records from primary storage. [2025-09-29T02:13:15.054827] [INFO ] [MAIN ] COHR: Loaded 54144 primary data records. [2025-09-29T02:13:15.205131] [DEBUG] [LOCAL ] COLD: Loaded 52785 existing records from primary storage. [2025-09-29T02:13:15.233731] [INFO ] [MAIN ] COLD: Loaded 52785 primary data records. [2025-09-29T02:13:15.656801] [DEBUG] [MAIN ] COF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:15.793278] [INFO ] [MAIN ] COF: Generated 1820 derivative records from 54389 primary records. [2025-09-29T02:13:15.794571] [DEBUG] [LOCAL ] COF: Saving derivative data. [2025-09-29T02:13:15.815427] [DEBUG] [LOCAL ] COF: Derivative data saved (1820 records). [2025-09-29T02:13:15.815999] [INFO ] [MAIN ] COF: Successfully saved derivative data. [2025-09-29T02:13:15.819253] [INFO ] [MAIN ] Derivative Progress: 472/2211 symbols completed. COF took 1.3s. Estimated remaining: 12m 13s. Rate: 142.4 symbols/min [2025-09-29T02:13:15.820268] [INFO ] [MAIN ] COMP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:15.840025] [DEBUG] [MAIN ] COHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:15.842229] [INFO ] [MAIN ] COHR: Generated 1820 derivative records from 54144 primary records. [2025-09-29T02:13:15.842431] [DEBUG] [LOCAL ] COHR: Saving derivative data. [2025-09-29T02:13:15.861422] [DEBUG] [LOCAL ] COHR: Derivative data saved (1820 records). [2025-09-29T02:13:15.861792] [INFO ] [MAIN ] COHR: Successfully saved derivative data. [2025-09-29T02:13:15.864914] [INFO ] [MAIN ] Derivative Progress: 473/2211 symbols completed. COHR took 1.2s. Estimated remaining: 12m 11s. Rate: 142.7 symbols/min [2025-09-29T02:13:15.865546] [INFO ] [MAIN ] CON: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:15.882596] [DEBUG] [MAIN ] COLD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:15.883442] [INFO ] [MAIN ] COLD: Generated 1820 derivative records from 52785 primary records. [2025-09-29T02:13:15.883559] [DEBUG] [LOCAL ] COLD: Saving derivative data. [2025-09-29T02:13:15.915509] [DEBUG] [LOCAL ] COLD: Derivative data saved (1820 records). [2025-09-29T02:13:15.915886] [INFO ] [MAIN ] COLD: Successfully saved derivative data. [2025-09-29T02:13:15.919082] [INFO ] [MAIN ] Derivative Progress: 474/2211 symbols completed. COLD took 1.3s. Estimated remaining: 12m 9s. Rate: 142.9 symbols/min [2025-09-29T02:13:15.919546] [INFO ] [MAIN ] COOK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:15.941763] [DEBUG] [LOCAL ] COMP: Loaded 54166 existing records from primary storage. [2025-09-29T02:13:15.942100] [INFO ] [MAIN ] COMP: Loaded 54166 primary data records. [2025-09-29T02:13:16.126229] [DEBUG] [LOCAL ] CON: Loaded 39289 existing records from primary storage. [2025-09-29T02:13:16.114599] [DEBUG] [LOCAL ] COOK: Loaded 24850 existing records from primary storage. [2025-09-29T02:13:16.335734] [INFO ] [MAIN ] CON: Loaded 39289 primary data records. [2025-09-29T02:13:16.344815] [INFO ] [MAIN ] COOK: Loaded 24850 primary data records. [2025-09-29T02:13:17.045264] [DEBUG] [MAIN ] COMP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:17.046759] [INFO ] [MAIN ] COMP: Generated 1820 derivative records from 54166 primary records. [2025-09-29T02:13:17.047147] [DEBUG] [LOCAL ] COMP: Saving derivative data. [2025-09-29T02:13:17.067615] [DEBUG] [LOCAL ] COMP: Derivative data saved (1820 records). [2025-09-29T02:13:17.070965] [INFO ] [MAIN ] COMP: Successfully saved derivative data. [2025-09-29T02:13:17.074288] [INFO ] [MAIN ] Derivative Progress: 475/2211 symbols completed. COMP took 1.3s. Estimated remaining: 12m 11s. Rate: 142.4 symbols/min [2025-09-29T02:13:17.074719] [INFO ] [MAIN ] COP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:17.093026] [DEBUG] [MAIN ] COOK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:17.106554] [DEBUG] [MAIN ] CON: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:17.108976] [INFO ] [MAIN ] CON: Generated 1820 derivative records from 39289 primary records. [2025-09-29T02:13:17.109292] [DEBUG] [LOCAL ] CON: Saving derivative data. [2025-09-29T02:13:17.107845] [INFO ] [MAIN ] COOK: Generated 1820 derivative records from 24850 primary records. [2025-09-29T02:13:17.110157] [DEBUG] [LOCAL ] COOK: Saving derivative data. [2025-09-29T02:13:17.139845] [DEBUG] [LOCAL ] CON: Derivative data saved (1820 records). [2025-09-29T02:13:17.141468] [INFO ] [MAIN ] CON: Successfully saved derivative data. [2025-09-29T02:13:17.147764] [INFO ] [MAIN ] Derivative Progress: 476/2211 symbols completed. CON took 1.3s. Estimated remaining: 12m 10s. Rate: 142.7 symbols/min [2025-09-29T02:13:17.148071] [INFO ] [MAIN ] COR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:17.144805] [DEBUG] [LOCAL ] COOK: Derivative data saved (1820 records). [2025-09-29T02:13:17.148404] [INFO ] [MAIN ] COOK: Successfully saved derivative data. [2025-09-29T02:13:17.151912] [INFO ] [MAIN ] Derivative Progress: 477/2211 symbols completed. COOK took 1.2s. Estimated remaining: 12m 8s. Rate: 143.0 symbols/min [2025-09-29T02:13:17.152370] [INFO ] [MAIN ] COTY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:17.198910] [DEBUG] [LOCAL ] COP: Loaded 54507 existing records from primary storage. [2025-09-29T02:13:17.199243] [INFO ] [MAIN ] COP: Loaded 54507 primary data records. [2025-09-29T02:13:17.587693] [DEBUG] [LOCAL ] COTY: Loaded 54014 existing records from primary storage. [2025-09-29T02:13:17.585538] [DEBUG] [LOCAL ] COR: Loaded 47937 existing records from primary storage. [2025-09-29T02:13:17.587996] [INFO ] [MAIN ] COTY: Loaded 54014 primary data records. [2025-09-29T02:13:17.588239] [INFO ] [MAIN ] COR: Loaded 47937 primary data records. [2025-09-29T02:13:18.287430] [DEBUG] [MAIN ] COP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:18.288633] [INFO ] [MAIN ] COP: Generated 1820 derivative records from 54507 primary records. [2025-09-29T02:13:18.288988] [DEBUG] [LOCAL ] COP: Saving derivative data. [2025-09-29T02:13:18.308676] [DEBUG] [LOCAL ] COP: Derivative data saved (1820 records). [2025-09-29T02:13:18.309813] [INFO ] [MAIN ] COP: Successfully saved derivative data. [2025-09-29T02:13:18.312597] [INFO ] [MAIN ] Derivative Progress: 478/2211 symbols completed. COP took 1.2s. Estimated remaining: 12m 10s. Rate: 142.4 symbols/min [2025-09-29T02:13:18.330091] [DEBUG] [MAIN ] COR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:18.333194] [INFO ] [MAIN ] COR: Generated 1820 derivative records from 47937 primary records. [2025-09-29T02:13:18.334189] [DEBUG] [LOCAL ] COR: Saving derivative data. [2025-09-29T02:13:18.360117] [DEBUG] [MAIN ] COTY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:18.364433] [DEBUG] [LOCAL ] COR: Derivative data saved (1820 records). [2025-09-29T02:13:18.365548] [INFO ] [MAIN ] COR: Successfully saved derivative data. [2025-09-29T02:13:18.365473] [INFO ] [MAIN ] COTY: Generated 1820 derivative records from 54014 primary records. [2025-09-29T02:13:18.368576] [INFO ] [MAIN ] Derivative Progress: 479/2211 symbols completed. COR took 1.2s. Estimated remaining: 12m 8s. Rate: 142.7 symbols/min [2025-09-29T02:13:18.365770] [DEBUG] [LOCAL ] COTY: Saving derivative data. [2025-09-29T02:13:18.384929] [DEBUG] [LOCAL ] COTY: Derivative data saved (1820 records). [2025-09-29T02:13:18.385029] [INFO ] [MAIN ] COTY: Successfully saved derivative data. [2025-09-29T02:13:18.387804] [INFO ] [MAIN ] Derivative Progress: 480/2211 symbols completed. COTY took 1.2s. Estimated remaining: 12m 6s. Rate: 143.0 symbols/min [2025-09-29T02:13:18.388373] [INFO ] [MAIN ] CPA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:18.388275] [INFO ] [MAIN ] COUR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:18.388475] [INFO ] [MAIN ] CP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:18.428045] [DEBUG] [LOCAL ] CPA: Loaded 29208 existing records from primary storage. [2025-09-29T02:13:18.428224] [INFO ] [MAIN ] CPA: Loaded 29208 primary data records. [2025-09-29T02:13:18.637147] [DEBUG] [LOCAL ] COUR: Loaded 49636 existing records from primary storage. [2025-09-29T02:13:18.663427] [INFO ] [MAIN ] COUR: Loaded 49636 primary data records. [2025-09-29T02:13:18.676156] [DEBUG] [LOCAL ] CP: Loaded 54051 existing records from primary storage. [2025-09-29T02:13:18.859680] [INFO ] [MAIN ] CP: Loaded 54051 primary data records. [2025-09-29T02:13:19.545987] [DEBUG] [MAIN ] CPA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:19.547265] [INFO ] [MAIN ] CPA: Generated 1820 derivative records from 29208 primary records. [2025-09-29T02:13:19.547495] [DEBUG] [LOCAL ] CPA: Saving derivative data. [2025-09-29T02:13:19.571949] [DEBUG] [LOCAL ] CPA: Derivative data saved (1820 records). [2025-09-29T02:13:19.572212] [INFO ] [MAIN ] CPA: Successfully saved derivative data. [2025-09-29T02:13:19.576256] [INFO ] [MAIN ] Derivative Progress: 481/2211 symbols completed. CPA took 1.2s. Estimated remaining: 12m 9s. Rate: 142.4 symbols/min [2025-09-29T02:13:19.579129] [INFO ] [MAIN ] CPAY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:19.593882] [DEBUG] [MAIN ] COUR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:19.595241] [INFO ] [MAIN ] COUR: Generated 1820 derivative records from 49636 primary records. [2025-09-29T02:13:19.597452] [DEBUG] [LOCAL ] COUR: Saving derivative data. [2025-09-29T02:13:19.626526] [DEBUG] [MAIN ] CP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:19.638926] [INFO ] [MAIN ] CP: Generated 1820 derivative records from 54051 primary records. [2025-09-29T02:13:19.641230] [DEBUG] [LOCAL ] COUR: Derivative data saved (1820 records). [2025-09-29T02:13:19.641568] [INFO ] [MAIN ] COUR: Successfully saved derivative data. [2025-09-29T02:13:19.644917] [INFO ] [MAIN ] Derivative Progress: 482/2211 symbols completed. COUR took 1.3s. Estimated remaining: 12m 7s. Rate: 142.7 symbols/min [2025-09-29T02:13:19.641433] [DEBUG] [LOCAL ] CP: Saving derivative data. [2025-09-29T02:13:19.645257] [INFO ] [MAIN ] CPF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:19.674702] [DEBUG] [LOCAL ] CP: Derivative data saved (1820 records). [2025-09-29T02:13:19.676426] [INFO ] [MAIN ] CP: Successfully saved derivative data. [2025-09-29T02:13:19.679380] [INFO ] [MAIN ] Derivative Progress: 483/2211 symbols completed. CP took 1.3s. Estimated remaining: 12m 5s. Rate: 142.9 symbols/min [2025-09-29T02:13:19.679682] [INFO ] [MAIN ] CPK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:19.685713] [DEBUG] [LOCAL ] CPAY: Loaded 31286 existing records from primary storage. [2025-09-29T02:13:19.686134] [INFO ] [MAIN ] CPAY: Loaded 31286 primary data records. [2025-09-29T02:13:19.739235] [DEBUG] [LOCAL ] CPF: Loaded 15618 existing records from primary storage. [2025-09-29T02:13:19.786074] [INFO ] [MAIN ] CPF: Loaded 15618 primary data records. [2025-09-29T02:13:19.940983] [DEBUG] [LOCAL ] CPK: Loaded 13588 existing records from primary storage. [2025-09-29T02:13:19.960922] [INFO ] [MAIN ] CPK: Loaded 13588 primary data records. [2025-09-29T02:13:20.866613] [DEBUG] [MAIN ] CPAY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:20.868791] [INFO ] [MAIN ] CPAY: Generated 1820 derivative records from 31286 primary records. [2025-09-29T02:13:20.869092] [DEBUG] [LOCAL ] CPAY: Saving derivative data. [2025-09-29T02:13:20.893255] [DEBUG] [MAIN ] CPF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:20.902680] [DEBUG] [LOCAL ] CPAY: Derivative data saved (1820 records). [2025-09-29T02:13:20.902945] [INFO ] [MAIN ] CPAY: Successfully saved derivative data. [2025-09-29T02:13:20.906083] [INFO ] [MAIN ] Derivative Progress: 484/2211 symbols completed. CPAY took 1.3s. Estimated remaining: 12m 8s. Rate: 142.4 symbols/min [2025-09-29T02:13:20.906999] [INFO ] [MAIN ] CPF: Generated 1820 derivative records from 15618 primary records. [2025-09-29T02:13:20.908083] [INFO ] [MAIN ] CPNG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:20.908297] [DEBUG] [LOCAL ] CPF: Saving derivative data. [2025-09-29T02:13:20.936754] [DEBUG] [MAIN ] CPK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:20.942374] [INFO ] [MAIN ] CPK: Generated 1820 derivative records from 13588 primary records. [2025-09-29T02:13:20.942695] [DEBUG] [LOCAL ] CPF: Derivative data saved (1820 records). [2025-09-29T02:13:20.942998] [INFO ] [MAIN ] CPF: Successfully saved derivative data. [2025-09-29T02:13:20.945832] [INFO ] [MAIN ] Derivative Progress: 485/2211 symbols completed. CPF took 1.3s. Estimated remaining: 12m 6s. Rate: 142.6 symbols/min [2025-09-29T02:13:20.942904] [DEBUG] [LOCAL ] CPK: Saving derivative data. [2025-09-29T02:13:20.946071] [INFO ] [MAIN ] CPRI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:20.969552] [DEBUG] [LOCAL ] CPK: Derivative data saved (1820 records). [2025-09-29T02:13:20.969773] [INFO ] [MAIN ] CPK: Successfully saved derivative data. [2025-09-29T02:13:20.972675] [INFO ] [MAIN ] Derivative Progress: 486/2211 symbols completed. CPK took 1.3s. Estimated remaining: 12m 4s. Rate: 142.9 symbols/min [2025-09-29T02:13:20.972951] [INFO ] [MAIN ] CPS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:21.050035] [DEBUG] [LOCAL ] CPS: Loaded 26476 existing records from primary storage. [2025-09-29T02:13:21.050480] [INFO ] [MAIN ] CPS: Loaded 26476 primary data records. [2025-09-29T02:13:21.065124] [DEBUG] [LOCAL ] CPNG: Loaded 54450 existing records from primary storage. [2025-09-29T02:13:21.093581] [INFO ] [MAIN ] CPNG: Loaded 54450 primary data records. [2025-09-29T02:13:21.274075] [DEBUG] [LOCAL ] CPRI: Loaded 53326 existing records from primary storage. [2025-09-29T02:13:21.328720] [INFO ] [MAIN ] CPRI: Loaded 53326 primary data records. [2025-09-29T02:13:22.088603] [DEBUG] [MAIN ] CPS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:22.090639] [INFO ] [MAIN ] CPS: Generated 1820 derivative records from 26476 primary records. [2025-09-29T02:13:22.090889] [DEBUG] [LOCAL ] CPS: Saving derivative data. [2025-09-29T02:13:22.119812] [DEBUG] [LOCAL ] CPS: Derivative data saved (1820 records). [2025-09-29T02:13:22.125543] [DEBUG] [MAIN ] CPNG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:22.125601] [INFO ] [MAIN ] CPS: Successfully saved derivative data. [2025-09-29T02:13:22.126689] [INFO ] [MAIN ] CPNG: Generated 1820 derivative records from 54450 primary records. [2025-09-29T02:13:22.130211] [INFO ] [MAIN ] Derivative Progress: 487/2211 symbols completed. CPS took 1.2s. Estimated remaining: 12m 6s. Rate: 142.4 symbols/min [2025-09-29T02:13:22.132298] [INFO ] [MAIN ] CPT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:22.132691] [DEBUG] [LOCAL ] CPNG: Saving derivative data. [2025-09-29T02:13:22.159788] [DEBUG] [MAIN ] CPRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:22.161250] [INFO ] [MAIN ] CPRI: Generated 1820 derivative records from 53326 primary records. [2025-09-29T02:13:22.161383] [DEBUG] [LOCAL ] CPRI: Saving derivative data. [2025-09-29T02:13:22.181070] [DEBUG] [LOCAL ] CPNG: Derivative data saved (1820 records). [2025-09-29T02:13:22.181888] [INFO ] [MAIN ] CPNG: Successfully saved derivative data. [2025-09-29T02:13:22.186596] [INFO ] [MAIN ] Derivative Progress: 488/2211 symbols completed. CPNG took 1.3s. Estimated remaining: 12m 5s. Rate: 142.7 symbols/min [2025-09-29T02:13:22.188348] [DEBUG] [LOCAL ] CPRI: Derivative data saved (1820 records). [2025-09-29T02:13:22.188479] [INFO ] [MAIN ] CQP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:22.188605] [INFO ] [MAIN ] CPRI: Successfully saved derivative data. [2025-09-29T02:13:22.192783] [INFO ] [MAIN ] Derivative Progress: 489/2211 symbols completed. CPRI took 1.2s. Estimated remaining: 12m 3s. Rate: 142.9 symbols/min [2025-09-29T02:13:22.193138] [INFO ] [MAIN ] CR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:22.243935] [DEBUG] [LOCAL ] CQP: Loaded 20033 existing records from primary storage. [2025-09-29T02:13:22.245326] [DEBUG] [LOCAL ] CPT: Loaded 45034 existing records from primary storage. [2025-09-29T02:13:22.245583] [INFO ] [MAIN ] CQP: Loaded 20033 primary data records. [2025-09-29T02:13:22.245696] [INFO ] [MAIN ] CPT: Loaded 45034 primary data records. [2025-09-29T02:13:22.357918] [DEBUG] [LOCAL ] CR: Loaded 25019 existing records from primary storage. [2025-09-29T02:13:22.441317] [INFO ] [MAIN ] CR: Loaded 25019 primary data records. [2025-09-29T02:13:23.338501] [DEBUG] [MAIN ] CQP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:23.337979] [DEBUG] [MAIN ] CPT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:23.340222] [INFO ] [MAIN ] CPT: Generated 1820 derivative records from 45034 primary records. [2025-09-29T02:13:23.339420] [INFO ] [MAIN ] CQP: Generated 1820 derivative records from 20033 primary records. [2025-09-29T02:13:23.340392] [DEBUG] [LOCAL ] CPT: Saving derivative data. [2025-09-29T02:13:23.340790] [DEBUG] [LOCAL ] CQP: Saving derivative data. [2025-09-29T02:13:23.370771] [DEBUG] [LOCAL ] CQP: Derivative data saved (1820 records). [2025-09-29T02:13:23.376453] [DEBUG] [LOCAL ] CPT: Derivative data saved (1820 records). [2025-09-29T02:13:23.376729] [INFO ] [MAIN ] CQP: Successfully saved derivative data. [2025-09-29T02:13:23.377143] [INFO ] [MAIN ] CPT: Successfully saved derivative data. [2025-09-29T02:13:23.379632] [INFO ] [MAIN ] Derivative Progress: 490/2211 symbols completed. CQP took 1.2s. Estimated remaining: 12m 5s. Rate: 142.4 symbols/min [2025-09-29T02:13:23.383211] [INFO ] [MAIN ] CRBD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:23.383574] [INFO ] [MAIN ] Derivative Progress: 491/2211 symbols completed. CPT took 1.3s. Estimated remaining: 12m 3s. Rate: 142.7 symbols/min [2025-09-29T02:13:23.392177] [INFO ] [MAIN ] CRBG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:23.398499] [DEBUG] [MAIN ] CR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:23.399804] [INFO ] [MAIN ] CR: Generated 1820 derivative records from 25019 primary records. [2025-09-29T02:13:23.400073] [DEBUG] [LOCAL ] CR: Saving derivative data. [2025-09-29T02:13:23.421291] [DEBUG] [LOCAL ] CR: Derivative data saved (1820 records). [2025-09-29T02:13:23.421562] [INFO ] [MAIN ] CR: Successfully saved derivative data. [2025-09-29T02:13:23.424611] [INFO ] [MAIN ] Derivative Progress: 492/2211 symbols completed. CR took 1.2s. Estimated remaining: 12m 1s. Rate: 143.0 symbols/min [2025-09-29T02:13:23.431021] [INFO ] [MAIN ] CRC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:23.431633] [DEBUG] [LOCAL ] CRBD: Loaded 9131 existing records from primary storage. [2025-09-29T02:13:23.433811] [INFO ] [MAIN ] CRBD: Loaded 9131 primary data records. [2025-09-29T02:13:23.825557] [DEBUG] [LOCAL ] CRC: Loaded 44946 existing records from primary storage. [2025-09-29T02:13:23.824127] [DEBUG] [LOCAL ] CRBG: Loaded 53110 existing records from primary storage. [2025-09-29T02:13:23.825912] [INFO ] [MAIN ] CRC: Loaded 44946 primary data records. [2025-09-29T02:13:23.826239] [INFO ] [MAIN ] CRBG: Loaded 53110 primary data records. [2025-09-29T02:13:24.537136] [DEBUG] [MAIN ] CRBD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:24.538990] [INFO ] [MAIN ] CRBD: Generated 1820 derivative records from 9131 primary records. [2025-09-29T02:13:24.539601] [DEBUG] [LOCAL ] CRBD: Saving derivative data. [2025-09-29T02:13:24.559400] [DEBUG] [LOCAL ] CRBD: Derivative data saved (1820 records). [2025-09-29T02:13:24.559820] [INFO ] [MAIN ] CRBD: Successfully saved derivative data. [2025-09-29T02:13:24.562632] [INFO ] [MAIN ] Derivative Progress: 493/2211 symbols completed. CRBD took 1.2s. Estimated remaining: 12m 4s. Rate: 142.5 symbols/min [2025-09-29T02:13:24.583079] [DEBUG] [MAIN ] CRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:24.586477] [INFO ] [MAIN ] CRC: Generated 1820 derivative records from 44946 primary records. [2025-09-29T02:13:24.586746] [DEBUG] [LOCAL ] CRC: Saving derivative data. [2025-09-29T02:13:24.608937] [DEBUG] [MAIN ] CRBG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:24.614954] [INFO ] [MAIN ] CRBG: Generated 1820 derivative records from 53110 primary records. [2025-09-29T02:13:24.617206] [DEBUG] [LOCAL ] CRBG: Saving derivative data. [2025-09-29T02:13:24.619004] [DEBUG] [LOCAL ] CRC: Derivative data saved (1820 records). [2025-09-29T02:13:24.619101] [INFO ] [MAIN ] CRC: Successfully saved derivative data. [2025-09-29T02:13:24.622056] [INFO ] [MAIN ] Derivative Progress: 494/2211 symbols completed. CRC took 1.2s. Estimated remaining: 12m 2s. Rate: 142.7 symbols/min [2025-09-29T02:13:24.637475] [DEBUG] [LOCAL ] CRBG: Derivative data saved (1820 records). [2025-09-29T02:13:24.637634] [INFO ] [MAIN ] CRBG: Successfully saved derivative data. [2025-09-29T02:13:24.641098] [INFO ] [MAIN ] Derivative Progress: 495/2211 symbols completed. CRBG took 1.2s. Estimated remaining: 12m 0s. Rate: 143.0 symbols/min [2025-09-29T02:13:24.641635] [INFO ] [MAIN ] CRGY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:24.641762] [INFO ] [MAIN ] CRH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:24.641852] [INFO ] [MAIN ] CRI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:24.772036] [DEBUG] [LOCAL ] CRGY: Loaded 53290 existing records from primary storage. [2025-09-29T02:13:24.773168] [DEBUG] [LOCAL ] CRI: Loaded 50713 existing records from primary storage. [2025-09-29T02:13:24.774172] [DEBUG] [LOCAL ] CRH: Loaded 54243 existing records from primary storage. [2025-09-29T02:13:24.774489] [INFO ] [MAIN ] CRGY: Loaded 53290 primary data records. [2025-09-29T02:13:24.774666] [INFO ] [MAIN ] CRI: Loaded 50713 primary data records. [2025-09-29T02:13:24.774988] [INFO ] [MAIN ] CRH: Loaded 54243 primary data records. [2025-09-29T02:13:25.845590] [DEBUG] [MAIN ] CRH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:25.855055] [INFO ] [MAIN ] CRH: Generated 1820 derivative records from 54243 primary records. [2025-09-29T02:13:25.872942] [DEBUG] [LOCAL ] CRH: Saving derivative data. [2025-09-29T02:13:25.873348] [DEBUG] [MAIN ] CRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:25.872595] [DEBUG] [MAIN ] CRGY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:25.874797] [INFO ] [MAIN ] CRI: Generated 1820 derivative records from 50713 primary records. [2025-09-29T02:13:25.876096] [DEBUG] [LOCAL ] CRI: Saving derivative data. [2025-09-29T02:13:25.875805] [INFO ] [MAIN ] CRGY: Generated 1820 derivative records from 53290 primary records. [2025-09-29T02:13:25.884163] [DEBUG] [LOCAL ] CRGY: Saving derivative data. [2025-09-29T02:13:25.926614] [DEBUG] [LOCAL ] CRH: Derivative data saved (1820 records). [2025-09-29T02:13:25.926866] [INFO ] [MAIN ] CRH: Successfully saved derivative data. [2025-09-29T02:13:25.923200] [DEBUG] [LOCAL ] CRI: Derivative data saved (1820 records). [2025-09-29T02:13:25.927258] [INFO ] [MAIN ] CRI: Successfully saved derivative data. [2025-09-29T02:13:25.930316] [INFO ] [MAIN ] Derivative Progress: 496/2211 symbols completed. CRI took 1.3s. Estimated remaining: 12m 3s. Rate: 142.4 symbols/min [2025-09-29T02:13:25.934327] [INFO ] [MAIN ] CRK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:25.935042] [DEBUG] [LOCAL ] CRGY: Derivative data saved (1820 records). [2025-09-29T02:13:25.935195] [INFO ] [MAIN ] Derivative Progress: 497/2211 symbols completed. CRH took 1.3s. Estimated remaining: 12m 1s. Rate: 142.7 symbols/min [2025-09-29T02:13:25.935803] [INFO ] [MAIN ] CRGY: Successfully saved derivative data. [2025-09-29T02:13:25.938489] [INFO ] [MAIN ] Derivative Progress: 498/2211 symbols completed. CRGY took 1.3s. Estimated remaining: 11m 59s. Rate: 143.0 symbols/min [2025-09-29T02:13:25.938946] [INFO ] [MAIN ] CRM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:25.935901] [INFO ] [MAIN ] CRL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:26.042459] [DEBUG] [LOCAL ] CRK: Loaded 52891 existing records from primary storage. [2025-09-29T02:13:26.043272] [DEBUG] [LOCAL ] CRL: Loaded 43853 existing records from primary storage. [2025-09-29T02:13:26.058281] [INFO ] [MAIN ] CRL: Loaded 43853 primary data records. [2025-09-29T02:13:26.058401] [INFO ] [MAIN ] CRK: Loaded 52891 primary data records. [2025-09-29T02:13:26.071718] [DEBUG] [LOCAL ] CRM: Loaded 54550 existing records from primary storage. [2025-09-29T02:13:26.213716] [INFO ] [MAIN ] CRM: Loaded 54550 primary data records. [2025-09-29T02:13:27.083981] [DEBUG] [MAIN ] CRL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:27.084958] [INFO ] [MAIN ] CRL: Generated 1820 derivative records from 43853 primary records. [2025-09-29T02:13:27.085202] [DEBUG] [LOCAL ] CRL: Saving derivative data. [2025-09-29T02:13:27.105937] [DEBUG] [LOCAL ] CRL: Derivative data saved (1820 records). [2025-09-29T02:13:27.119429] [INFO ] [MAIN ] CRL: Successfully saved derivative data. [2025-09-29T02:13:27.122485] [DEBUG] [MAIN ] CRK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:27.121982] [INFO ] [MAIN ] Derivative Progress: 499/2211 symbols completed. CRL took 1.2s. Estimated remaining: 12m 1s. Rate: 142.4 symbols/min [2025-09-29T02:13:27.125299] [INFO ] [MAIN ] CRS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:27.125168] [INFO ] [MAIN ] CRK: Generated 1820 derivative records from 52891 primary records. [2025-09-29T02:13:27.125635] [DEBUG] [LOCAL ] CRK: Saving derivative data. [2025-09-29T02:13:27.158519] [DEBUG] [MAIN ] CRM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:27.157977] [DEBUG] [LOCAL ] CRK: Derivative data saved (1820 records). [2025-09-29T02:13:27.159309] [INFO ] [MAIN ] CRM: Generated 1820 derivative records from 54550 primary records. [2025-09-29T02:13:27.159476] [INFO ] [MAIN ] CRK: Successfully saved derivative data. [2025-09-29T02:13:27.162511] [INFO ] [MAIN ] Derivative Progress: 500/2211 symbols completed. CRK took 1.2s. Estimated remaining: 11m 59s. Rate: 142.7 symbols/min [2025-09-29T02:13:27.162829] [INFO ] [MAIN ] CRT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:27.162961] [DEBUG] [LOCAL ] CRM: Saving derivative data. [2025-09-29T02:13:27.187463] [DEBUG] [LOCAL ] CRT: Loaded 5018 existing records from primary storage. [2025-09-29T02:13:27.183804] [DEBUG] [LOCAL ] CRM: Derivative data saved (1820 records). [2025-09-29T02:13:27.196898] [INFO ] [MAIN ] CRT: Loaded 5018 primary data records. [2025-09-29T02:13:27.202688] [INFO ] [MAIN ] CRM: Successfully saved derivative data. [2025-09-29T02:13:27.236432] [INFO ] [MAIN ] Derivative Progress: 501/2211 symbols completed. CRM took 1.3s. Estimated remaining: 11m 58s. Rate: 142.9 symbols/min [2025-09-29T02:13:27.281691] [INFO ] [MAIN ] CSAN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:27.378102] [DEBUG] [LOCAL ] CRS: Loaded 43928 existing records from primary storage. [2025-09-29T02:13:27.408945] [INFO ] [MAIN ] CRS: Loaded 43928 primary data records. [2025-09-29T02:13:27.933268] [DEBUG] [LOCAL ] CSAN: Loaded 42951 existing records from primary storage. [2025-09-29T02:13:27.933989] [INFO ] [MAIN ] CSAN: Loaded 42951 primary data records. [2025-09-29T02:13:28.280952] [DEBUG] [MAIN ] CRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:28.282075] [INFO ] [MAIN ] CRT: Generated 1820 derivative records from 5018 primary records. [2025-09-29T02:13:28.283165] [DEBUG] [LOCAL ] CRT: Saving derivative data. [2025-09-29T02:13:28.305179] [DEBUG] [LOCAL ] CRT: Derivative data saved (1820 records). [2025-09-29T02:13:28.314805] [INFO ] [MAIN ] CRT: Successfully saved derivative data. [2025-09-29T02:13:28.322115] [INFO ] [MAIN ] Derivative Progress: 502/2211 symbols completed. CRT took 1.2s. Estimated remaining: 11m 60s. Rate: 142.5 symbols/min [2025-09-29T02:13:28.322336] [INFO ] [MAIN ] CSL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:28.323131] [DEBUG] [MAIN ] CRS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:28.324808] [INFO ] [MAIN ] CRS: Generated 1820 derivative records from 43928 primary records. [2025-09-29T02:13:28.325934] [DEBUG] [LOCAL ] CRS: Saving derivative data. [2025-09-29T02:13:28.344432] [DEBUG] [LOCAL ] CRS: Derivative data saved (1820 records). [2025-09-29T02:13:28.344608] [INFO ] [MAIN ] CRS: Successfully saved derivative data. [2025-09-29T02:13:28.347842] [INFO ] [MAIN ] Derivative Progress: 503/2211 symbols completed. CRS took 1.2s. Estimated remaining: 11m 58s. Rate: 142.8 symbols/min [2025-09-29T02:13:28.348159] [INFO ] [MAIN ] CSR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:28.366753] [DEBUG] [MAIN ] CSAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:28.379427] [INFO ] [MAIN ] CSAN: Generated 1820 derivative records from 42951 primary records. [2025-09-29T02:13:28.379752] [DEBUG] [LOCAL ] CSAN: Saving derivative data. [2025-09-29T02:13:28.413186] [DEBUG] [LOCAL ] CSAN: Derivative data saved (1820 records). [2025-09-29T02:13:28.413439] [INFO ] [MAIN ] CSAN: Successfully saved derivative data. [2025-09-29T02:13:28.416978] [INFO ] [MAIN ] Derivative Progress: 504/2211 symbols completed. CSAN took 1.1s. Estimated remaining: 11m 56s. Rate: 143.0 symbols/min [2025-09-29T02:13:28.399503] [DEBUG] [LOCAL ] CSR: Loaded 12808 existing records from primary storage. [2025-09-29T02:13:28.417224] [INFO ] [MAIN ] CSTM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:28.418854] [DEBUG] [LOCAL ] CSL: Loaded 32100 existing records from primary storage. [2025-09-29T02:13:28.419094] [INFO ] [MAIN ] CSL: Loaded 32100 primary data records. [2025-09-29T02:13:28.417349] [INFO ] [MAIN ] CSR: Loaded 12808 primary data records. [2025-09-29T02:13:29.030347] [DEBUG] [LOCAL ] CSTM: Loaded 48360 existing records from primary storage. [2025-09-29T02:13:29.145821] [INFO ] [MAIN ] CSTM: Loaded 48360 primary data records. [2025-09-29T02:13:29.559253] [DEBUG] [MAIN ] CSR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:29.561497] [INFO ] [MAIN ] CSR: Generated 1820 derivative records from 12808 primary records. [2025-09-29T02:13:29.561672] [DEBUG] [LOCAL ] CSR: Saving derivative data. [2025-09-29T02:13:29.592257] [DEBUG] [MAIN ] CSL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:29.594048] [INFO ] [MAIN ] CSL: Generated 1820 derivative records from 32100 primary records. [2025-09-29T02:13:29.597948] [DEBUG] [LOCAL ] CSR: Derivative data saved (1820 records). [2025-09-29T02:13:29.596814] [DEBUG] [LOCAL ] CSL: Saving derivative data. [2025-09-29T02:13:29.598085] [INFO ] [MAIN ] CSR: Successfully saved derivative data. [2025-09-29T02:13:29.601207] [INFO ] [MAIN ] Derivative Progress: 505/2211 symbols completed. CSR took 1.3s. Estimated remaining: 11m 58s. Rate: 142.5 symbols/min [2025-09-29T02:13:29.602065] [INFO ] [MAIN ] CSV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:29.620830] [DEBUG] [LOCAL ] CSL: Derivative data saved (1820 records). [2025-09-29T02:13:29.621442] [INFO ] [MAIN ] CSL: Successfully saved derivative data. [2025-09-29T02:13:29.624909] [INFO ] [MAIN ] Derivative Progress: 506/2211 symbols completed. CSL took 1.3s. Estimated remaining: 11m 57s. Rate: 142.7 symbols/min [2025-09-29T02:13:29.625818] [INFO ] [MAIN ] CTBB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:29.645707] [DEBUG] [MAIN ] CSTM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:29.653998] [INFO ] [MAIN ] CSTM: Generated 1820 derivative records from 48360 primary records. [2025-09-29T02:13:29.654492] [DEBUG] [LOCAL ] CSV: Loaded 13198 existing records from primary storage. [2025-09-29T02:13:29.654789] [INFO ] [MAIN ] CSV: Loaded 13198 primary data records. [2025-09-29T02:13:29.654889] [DEBUG] [LOCAL ] CSTM: Saving derivative data. [2025-09-29T02:13:29.691522] [DEBUG] [LOCAL ] CTBB: Loaded 7168 existing records from primary storage. [2025-09-29T02:13:29.731359] [INFO ] [MAIN ] CTBB: Loaded 7168 primary data records. [2025-09-29T02:13:29.823417] [DEBUG] [LOCAL ] CSTM: Derivative data saved (1820 records). [2025-09-29T02:13:29.876774] [INFO ] [MAIN ] CSTM: Successfully saved derivative data. [2025-09-29T02:13:29.979209] [INFO ] [MAIN ] Derivative Progress: 507/2211 symbols completed. CSTM took 1.6s. Estimated remaining: 11m 56s. Rate: 142.8 symbols/min [2025-09-29T02:13:29.991271] [INFO ] [MAIN ] CTDD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:30.343505] [DEBUG] [LOCAL ] CTDD: Loaded 5947 existing records from primary storage. [2025-09-29T02:13:30.344074] [INFO ] [MAIN ] CTDD: Loaded 5947 primary data records. [2025-09-29T02:13:30.705844] [DEBUG] [MAIN ] CSV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:30.707181] [INFO ] [MAIN ] CSV: Generated 1820 derivative records from 13198 primary records. [2025-09-29T02:13:30.708435] [DEBUG] [LOCAL ] CSV: Saving derivative data. [2025-09-29T02:13:30.740636] [DEBUG] [MAIN ] CTBB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:30.744844] [INFO ] [MAIN ] CTBB: Generated 1820 derivative records from 7168 primary records. [2025-09-29T02:13:30.746191] [DEBUG] [LOCAL ] CSV: Derivative data saved (1820 records). [2025-09-29T02:13:30.746373] [DEBUG] [LOCAL ] CTBB: Saving derivative data. [2025-09-29T02:13:30.746305] [INFO ] [MAIN ] CSV: Successfully saved derivative data. [2025-09-29T02:13:30.750567] [INFO ] [MAIN ] Derivative Progress: 508/2211 symbols completed. CSV took 1.1s. Estimated remaining: 11m 57s. Rate: 142.6 symbols/min [2025-09-29T02:13:30.766197] [DEBUG] [LOCAL ] CTBB: Derivative data saved (1820 records). [2025-09-29T02:13:30.767556] [INFO ] [MAIN ] CTBB: Successfully saved derivative data. [2025-09-29T02:13:30.770166] [INFO ] [MAIN ] Derivative Progress: 509/2211 symbols completed. CTBB took 1.1s. Estimated remaining: 11m 55s. Rate: 142.8 symbols/min [2025-09-29T02:13:30.790352] [DEBUG] [MAIN ] CTDD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:30.791192] [INFO ] [MAIN ] CTDD: Generated 1820 derivative records from 5947 primary records. [2025-09-29T02:13:30.791280] [DEBUG] [LOCAL ] CTDD: Saving derivative data. [2025-09-29T02:13:30.807110] [DEBUG] [LOCAL ] CTDD: Derivative data saved (1820 records). [2025-09-29T02:13:30.807261] [INFO ] [MAIN ] CTDD: Successfully saved derivative data. [2025-09-29T02:13:30.810495] [INFO ] [MAIN ] Derivative Progress: 510/2211 symbols completed. CTDD took 0.8s. Estimated remaining: 11m 53s. Rate: 143.1 symbols/min [2025-09-29T02:13:30.811146] [INFO ] [MAIN ] CTO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:30.811263] [INFO ] [MAIN ] CTRA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:30.811339] [INFO ] [MAIN ] CTOS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:30.883400] [DEBUG] [LOCAL ] CTO: Loaded 28661 existing records from primary storage. [2025-09-29T02:13:30.885037] [INFO ] [MAIN ] CTO: Loaded 28661 primary data records. [2025-09-29T02:13:30.891530] [DEBUG] [LOCAL ] CTOS: Loaded 37246 existing records from primary storage. [2025-09-29T02:13:30.927755] [INFO ] [MAIN ] CTOS: Loaded 37246 primary data records. [2025-09-29T02:13:31.053231] [DEBUG] [LOCAL ] CTRA: Loaded 54428 existing records from primary storage. [2025-09-29T02:13:31.105693] [INFO ] [MAIN ] CTRA: Loaded 54428 primary data records. [2025-09-29T02:13:32.035085] [DEBUG] [MAIN ] CTO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:32.036414] [INFO ] [MAIN ] CTO: Generated 1820 derivative records from 28661 primary records. [2025-09-29T02:13:32.037939] [DEBUG] [LOCAL ] CTO: Saving derivative data. [2025-09-29T02:13:32.057367] [DEBUG] [LOCAL ] CTO: Derivative data saved (1820 records). [2025-09-29T02:13:32.071489] [DEBUG] [MAIN ] CTOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:32.071584] [INFO ] [MAIN ] CTO: Successfully saved derivative data. [2025-09-29T02:13:32.074556] [INFO ] [MAIN ] Derivative Progress: 511/2211 symbols completed. CTO took 1.3s. Estimated remaining: 11m 56s. Rate: 142.5 symbols/min [2025-09-29T02:13:32.074787] [INFO ] [MAIN ] CTRE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:32.077285] [INFO ] [MAIN ] CTOS: Generated 1820 derivative records from 37246 primary records. [2025-09-29T02:13:32.078583] [DEBUG] [LOCAL ] CTOS: Saving derivative data. [2025-09-29T02:13:32.117803] [DEBUG] [MAIN ] CTRA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:32.119275] [INFO ] [MAIN ] CTRA: Generated 1820 derivative records from 54428 primary records. [2025-09-29T02:13:32.117881] [DEBUG] [LOCAL ] CTOS: Derivative data saved (1820 records). [2025-09-29T02:13:32.119457] [INFO ] [MAIN ] CTOS: Successfully saved derivative data. [2025-09-29T02:13:32.122585] [INFO ] [MAIN ] Derivative Progress: 512/2211 symbols completed. CTOS took 1.3s. Estimated remaining: 11m 54s. Rate: 142.8 symbols/min [2025-09-29T02:13:32.122816] [DEBUG] [LOCAL ] CTRA: Saving derivative data. [2025-09-29T02:13:32.122912] [INFO ] [MAIN ] CTRI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:32.151686] [DEBUG] [LOCAL ] CTRA: Derivative data saved (1820 records). [2025-09-29T02:13:32.151971] [INFO ] [MAIN ] CTRA: Successfully saved derivative data. [2025-09-29T02:13:32.156312] [INFO ] [MAIN ] Derivative Progress: 513/2211 symbols completed. CTRA took 1.3s. Estimated remaining: 11m 52s. Rate: 143.0 symbols/min [2025-09-29T02:13:32.156574] [INFO ] [MAIN ] CTS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:32.212108] [DEBUG] [LOCAL ] CTRE: Loaded 49964 existing records from primary storage. [2025-09-29T02:13:32.224404] [INFO ] [MAIN ] CTRE: Loaded 49964 primary data records. [2025-09-29T02:13:32.248064] [DEBUG] [LOCAL ] CTRI: Loaded 38571 existing records from primary storage. [2025-09-29T02:13:32.293267] [DEBUG] [LOCAL ] CTS: Loaded 19637 existing records from primary storage. [2025-09-29T02:13:32.317352] [INFO ] [MAIN ] CTRI: Loaded 38571 primary data records. [2025-09-29T02:13:32.347344] [INFO ] [MAIN ] CTS: Loaded 19637 primary data records. [2025-09-29T02:13:33.298634] [DEBUG] [MAIN ] CTRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:33.299739] [INFO ] [MAIN ] CTRE: Generated 1820 derivative records from 49964 primary records. [2025-09-29T02:13:33.299853] [DEBUG] [LOCAL ] CTRE: Saving derivative data. [2025-09-29T02:13:33.325958] [DEBUG] [LOCAL ] CTRE: Derivative data saved (1820 records). [2025-09-29T02:13:33.349494] [INFO ] [MAIN ] CTRE: Successfully saved derivative data. [2025-09-29T02:13:33.355773] [DEBUG] [MAIN ] CTRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:33.358523] [INFO ] [MAIN ] Derivative Progress: 514/2211 symbols completed. CTRE took 1.3s. Estimated remaining: 11m 55s. Rate: 142.5 symbols/min [2025-09-29T02:13:33.359733] [INFO ] [MAIN ] CTRI: Generated 1820 derivative records from 38571 primary records. [2025-09-29T02:13:33.360584] [DEBUG] [MAIN ] CTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:33.360055] [INFO ] [MAIN ] CTVA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:33.361728] [INFO ] [MAIN ] CTS: Generated 1820 derivative records from 19637 primary records. [2025-09-29T02:13:33.362206] [DEBUG] [LOCAL ] CTRI: Saving derivative data. [2025-09-29T02:13:33.362281] [DEBUG] [LOCAL ] CTS: Saving derivative data. [2025-09-29T02:13:33.399757] [DEBUG] [LOCAL ] CTS: Derivative data saved (1820 records). [2025-09-29T02:13:33.400031] [INFO ] [MAIN ] CTS: Successfully saved derivative data. [2025-09-29T02:13:33.397529] [DEBUG] [LOCAL ] CTRI: Derivative data saved (1820 records). [2025-09-29T02:13:33.402933] [INFO ] [MAIN ] Derivative Progress: 515/2211 symbols completed. CTS took 1.2s. Estimated remaining: 11m 53s. Rate: 142.8 symbols/min [2025-09-29T02:13:33.403197] [INFO ] [MAIN ] CTRI: Successfully saved derivative data. [2025-09-29T02:13:33.405960] [INFO ] [MAIN ] Derivative Progress: 516/2211 symbols completed. CTRI took 1.3s. Estimated remaining: 11m 51s. Rate: 143.0 symbols/min [2025-09-29T02:13:33.405839] [INFO ] [MAIN ] CUBE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:33.406231] [INFO ] [MAIN ] CUBI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:33.455450] [DEBUG] [LOCAL ] CUBI: Loaded 27667 existing records from primary storage. [2025-09-29T02:13:33.455609] [INFO ] [MAIN ] CUBI: Loaded 27667 primary data records. [2025-09-29T02:13:33.635832] [DEBUG] [LOCAL ] CTVA: Loaded 54002 existing records from primary storage. [2025-09-29T02:13:33.648409] [DEBUG] [LOCAL ] CUBE: Loaded 51391 existing records from primary storage. [2025-09-29T02:13:33.653760] [INFO ] [MAIN ] CTVA: Loaded 54002 primary data records. [2025-09-29T02:13:33.653945] [INFO ] [MAIN ] CUBE: Loaded 51391 primary data records. [2025-09-29T02:13:34.606890] [DEBUG] [MAIN ] CUBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:34.607923] [INFO ] [MAIN ] CUBI: Generated 1820 derivative records from 27667 primary records. [2025-09-29T02:13:34.608519] [DEBUG] [LOCAL ] CUBI: Saving derivative data. [2025-09-29T02:13:34.627229] [DEBUG] [LOCAL ] CUBI: Derivative data saved (1820 records). [2025-09-29T02:13:34.627747] [INFO ] [MAIN ] CUBI: Successfully saved derivative data. [2025-09-29T02:13:34.632463] [INFO ] [MAIN ] Derivative Progress: 517/2211 symbols completed. CUBI took 1.2s. Estimated remaining: 11m 53s. Rate: 142.5 symbols/min [2025-09-29T02:13:34.633855] [INFO ] [MAIN ] CUK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:34.649853] [DEBUG] [MAIN ] CUBE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:34.651683] [INFO ] [MAIN ] CUBE: Generated 1820 derivative records from 51391 primary records. [2025-09-29T02:13:34.652130] [DEBUG] [LOCAL ] CUBE: Saving derivative data. [2025-09-29T02:13:34.680244] [DEBUG] [MAIN ] CTVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:34.684871] [DEBUG] [LOCAL ] CUBE: Derivative data saved (1820 records). [2025-09-29T02:13:34.685830] [INFO ] [MAIN ] CTVA: Generated 1820 derivative records from 54002 primary records. [2025-09-29T02:13:34.686076] [INFO ] [MAIN ] CUBE: Successfully saved derivative data. [2025-09-29T02:13:34.689128] [DEBUG] [LOCAL ] CTVA: Saving derivative data. [2025-09-29T02:13:34.688901] [INFO ] [MAIN ] Derivative Progress: 518/2211 symbols completed. CUBE took 1.3s. Estimated remaining: 11m 52s. Rate: 142.7 symbols/min [2025-09-29T02:13:34.689419] [INFO ] [MAIN ] CULP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:34.723429] [DEBUG] [LOCAL ] CTVA: Derivative data saved (1820 records). [2025-09-29T02:13:34.726746] [DEBUG] [LOCAL ] CULP: Loaded 3111 existing records from primary storage. [2025-09-29T02:13:34.726841] [INFO ] [MAIN ] CTVA: Successfully saved derivative data. [2025-09-29T02:13:34.730382] [INFO ] [MAIN ] Derivative Progress: 519/2211 symbols completed. CTVA took 1.4s. Estimated remaining: 11m 50s. Rate: 143.0 symbols/min [2025-09-29T02:13:34.730845] [INFO ] [MAIN ] CURB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:34.730632] [INFO ] [MAIN ] CULP: Loaded 3111 primary data records. [2025-09-29T02:13:34.854065] [DEBUG] [LOCAL ] CUK: Loaded 51762 existing records from primary storage. [2025-09-29T02:13:34.877868] [INFO ] [MAIN ] CUK: Loaded 51762 primary data records. [2025-09-29T02:13:35.088862] [DEBUG] [LOCAL ] CURB: Loaded 33350 existing records from primary storage. [2025-09-29T02:13:35.239072] [INFO ] [MAIN ] CURB: Loaded 33350 primary data records. [2025-09-29T02:13:35.896186] [DEBUG] [MAIN ] CULP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:35.899349] [INFO ] [MAIN ] CULP: Generated 1820 derivative records from 3111 primary records. [2025-09-29T02:13:35.899727] [DEBUG] [LOCAL ] CULP: Saving derivative data. [2025-09-29T02:13:35.936299] [DEBUG] [MAIN ] CUK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:35.935638] [DEBUG] [LOCAL ] CULP: Derivative data saved (1820 records). [2025-09-29T02:13:35.937621] [INFO ] [MAIN ] CULP: Successfully saved derivative data. [2025-09-29T02:13:35.938486] [INFO ] [MAIN ] CUK: Generated 1820 derivative records from 51762 primary records. [2025-09-29T02:13:35.940796] [INFO ] [MAIN ] Derivative Progress: 520/2211 symbols completed. CULP took 1.3s. Estimated remaining: 11m 52s. Rate: 142.5 symbols/min [2025-09-29T02:13:35.941156] [INFO ] [MAIN ] CURV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:35.941303] [DEBUG] [LOCAL ] CUK: Saving derivative data. [2025-09-29T02:13:35.968820] [DEBUG] [LOCAL ] CUK: Derivative data saved (1820 records). [2025-09-29T02:13:35.969219] [INFO ] [MAIN ] CUK: Successfully saved derivative data. [2025-09-29T02:13:35.972773] [INFO ] [MAIN ] Derivative Progress: 521/2211 symbols completed. CUK took 1.3s. Estimated remaining: 11m 50s. Rate: 142.7 symbols/min [2025-09-29T02:13:35.974165] [INFO ] [MAIN ] CUZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:36.003525] [DEBUG] [MAIN ] CURB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:36.004733] [INFO ] [MAIN ] CURB: Generated 1820 derivative records from 33350 primary records. [2025-09-29T02:13:36.004846] [DEBUG] [LOCAL ] CURB: Saving derivative data. [2025-09-29T02:13:36.035070] [DEBUG] [LOCAL ] CURV: Loaded 26933 existing records from primary storage. [2025-09-29T02:13:36.037626] [INFO ] [MAIN ] CURV: Loaded 26933 primary data records. [2025-09-29T02:13:36.062144] [DEBUG] [LOCAL ] CURB: Derivative data saved (1820 records). [2025-09-29T02:13:36.101134] [INFO ] [MAIN ] CURB: Successfully saved derivative data. [2025-09-29T02:13:36.149792] [INFO ] [MAIN ] Derivative Progress: 522/2211 symbols completed. CURB took 1.4s. Estimated remaining: 11m 49s. Rate: 142.9 symbols/min [2025-09-29T02:13:36.173074] [INFO ] [MAIN ] CVE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:36.441364] [DEBUG] [LOCAL ] CUZ: Loaded 50140 existing records from primary storage. [2025-09-29T02:13:36.456309] [INFO ] [MAIN ] CUZ: Loaded 50140 primary data records. [2025-09-29T02:13:36.852559] [DEBUG] [LOCAL ] CVE: Loaded 54336 existing records from primary storage. [2025-09-29T02:13:36.852917] [INFO ] [MAIN ] CVE: Loaded 54336 primary data records. [2025-09-29T02:13:37.066317] [DEBUG] [MAIN ] CURV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:37.207779] [INFO ] [MAIN ] CURV: Generated 1820 derivative records from 26933 primary records. [2025-09-29T02:13:37.218328] [DEBUG] [LOCAL ] CURV: Saving derivative data. [2025-09-29T02:13:37.241016] [DEBUG] [LOCAL ] CURV: Derivative data saved (1820 records). [2025-09-29T02:13:37.242228] [INFO ] [MAIN ] CURV: Successfully saved derivative data. [2025-09-29T02:13:37.253986] [INFO ] [MAIN ] Derivative Progress: 523/2211 symbols completed. CURV took 1.3s. Estimated remaining: 11m 51s. Rate: 142.4 symbols/min [2025-09-29T02:13:37.260074] [DEBUG] [MAIN ] CUZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:37.261112] [INFO ] [MAIN ] CUZ: Generated 1820 derivative records from 50140 primary records. [2025-09-29T02:13:37.261293] [DEBUG] [LOCAL ] CUZ: Saving derivative data. [2025-09-29T02:13:37.279067] [DEBUG] [LOCAL ] CUZ: Derivative data saved (1820 records). [2025-09-29T02:13:37.279222] [INFO ] [MAIN ] CUZ: Successfully saved derivative data. [2025-09-29T02:13:37.282101] [INFO ] [MAIN ] Derivative Progress: 524/2211 symbols completed. CUZ took 1.3s. Estimated remaining: 11m 49s. Rate: 142.7 symbols/min [2025-09-29T02:13:37.300230] [DEBUG] [MAIN ] CVE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:37.301010] [INFO ] [MAIN ] CVE: Generated 1820 derivative records from 54336 primary records. [2025-09-29T02:13:37.301097] [DEBUG] [LOCAL ] CVE: Saving derivative data. [2025-09-29T02:13:37.317112] [DEBUG] [LOCAL ] CVE: Derivative data saved (1820 records). [2025-09-29T02:13:37.317210] [INFO ] [MAIN ] CVE: Successfully saved derivative data. [2025-09-29T02:13:37.320516] [INFO ] [MAIN ] Derivative Progress: 525/2211 symbols completed. CVE took 1.1s. Estimated remaining: 11m 48s. Rate: 142.9 symbols/min [2025-09-29T02:13:37.321179] [INFO ] [MAIN ] CVEO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:37.321327] [INFO ] [MAIN ] CVI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:37.321459] [INFO ] [MAIN ] CVLG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:37.348630] [DEBUG] [LOCAL ] CVLG: Loaded 15730 existing records from primary storage. [2025-09-29T02:13:37.348880] [INFO ] [MAIN ] CVLG: Loaded 15730 primary data records. [2025-09-29T02:13:37.426890] [DEBUG] [LOCAL ] CVEO: Loaded 15402 existing records from primary storage. [2025-09-29T02:13:37.444454] [INFO ] [MAIN ] CVEO: Loaded 15402 primary data records. [2025-09-29T02:13:37.886968] [DEBUG] [LOCAL ] CVI: Loaded 47160 existing records from primary storage. [2025-09-29T02:13:37.943789] [INFO ] [MAIN ] CVI: Loaded 47160 primary data records. [2025-09-29T02:13:38.521361] [DEBUG] [MAIN ] CVLG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:38.523180] [INFO ] [MAIN ] CVLG: Generated 1820 derivative records from 15730 primary records. [2025-09-29T02:13:38.523402] [DEBUG] [LOCAL ] CVLG: Saving derivative data. [2025-09-29T02:13:38.553161] [DEBUG] [MAIN ] CVEO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:38.554772] [INFO ] [MAIN ] CVEO: Generated 1820 derivative records from 15402 primary records. [2025-09-29T02:13:38.554996] [DEBUG] [LOCAL ] CVEO: Saving derivative data. [2025-09-29T02:13:38.560194] [DEBUG] [LOCAL ] CVLG: Derivative data saved (1820 records). [2025-09-29T02:13:38.571224] [INFO ] [MAIN ] CVLG: Successfully saved derivative data. [2025-09-29T02:13:38.576504] [INFO ] [MAIN ] Derivative Progress: 526/2211 symbols completed. CVLG took 1.3s. Estimated remaining: 11m 50s. Rate: 142.4 symbols/min [2025-09-29T02:13:38.577124] [INFO ] [MAIN ] CVNA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:38.579463] [DEBUG] [LOCAL ] CVEO: Derivative data saved (1820 records). [2025-09-29T02:13:38.579870] [INFO ] [MAIN ] CVEO: Successfully saved derivative data. [2025-09-29T02:13:38.582947] [INFO ] [MAIN ] Derivative Progress: 527/2211 symbols completed. CVEO took 1.3s. Estimated remaining: 11m 48s. Rate: 142.7 symbols/min [2025-09-29T02:13:38.583331] [INFO ] [MAIN ] CVS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:38.602343] [DEBUG] [MAIN ] CVI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:38.603321] [INFO ] [MAIN ] CVI: Generated 1820 derivative records from 47160 primary records. [2025-09-29T02:13:38.603421] [DEBUG] [LOCAL ] CVI: Saving derivative data. [2025-09-29T02:13:38.621439] [DEBUG] [LOCAL ] CVI: Derivative data saved (1820 records). [2025-09-29T02:13:38.621729] [INFO ] [MAIN ] CVI: Successfully saved derivative data. [2025-09-29T02:13:38.625059] [INFO ] [MAIN ] Derivative Progress: 528/2211 symbols completed. CVI took 1.3s. Estimated remaining: 11m 47s. Rate: 142.9 symbols/min [2025-09-29T02:13:38.625537] [INFO ] [MAIN ] CVX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:38.694702] [DEBUG] [LOCAL ] CVNA: Loaded 53766 existing records from primary storage. [2025-09-29T02:13:38.696615] [INFO ] [MAIN ] CVNA: Loaded 53766 primary data records. [2025-09-29T02:13:38.807919] [DEBUG] [LOCAL ] CVS: Loaded 54476 existing records from primary storage. [2025-09-29T02:13:38.821149] [INFO ] [MAIN ] CVS: Loaded 54476 primary data records. [2025-09-29T02:13:39.017976] [DEBUG] [LOCAL ] CVX: Loaded 54540 existing records from primary storage. [2025-09-29T02:13:39.191378] [INFO ] [MAIN ] CVX: Loaded 54540 primary data records. [2025-09-29T02:13:39.793402] [DEBUG] [MAIN ] CVNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:39.795182] [INFO ] [MAIN ] CVNA: Generated 1820 derivative records from 53766 primary records. [2025-09-29T02:13:39.795572] [DEBUG] [LOCAL ] CVNA: Saving derivative data. [2025-09-29T02:13:39.829529] [DEBUG] [LOCAL ] CVNA: Derivative data saved (1820 records). [2025-09-29T02:13:39.830465] [INFO ] [MAIN ] CVNA: Successfully saved derivative data. [2025-09-29T02:13:39.833029] [INFO ] [MAIN ] Derivative Progress: 529/2211 symbols completed. CVNA took 1.3s. Estimated remaining: 11m 49s. Rate: 142.4 symbols/min [2025-09-29T02:13:39.830372] [DEBUG] [MAIN ] CVS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:39.833461] [INFO ] [MAIN ] CW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:39.834972] [INFO ] [MAIN ] CVS: Generated 1820 derivative records from 54476 primary records. [2025-09-29T02:13:39.835541] [DEBUG] [LOCAL ] CVS: Saving derivative data. [2025-09-29T02:13:39.853060] [DEBUG] [LOCAL ] CVS: Derivative data saved (1820 records). [2025-09-29T02:13:39.853281] [INFO ] [MAIN ] CVS: Successfully saved derivative data. [2025-09-29T02:13:39.855606] [INFO ] [MAIN ] Derivative Progress: 530/2211 symbols completed. CVS took 1.3s. Estimated remaining: 11m 47s. Rate: 142.7 symbols/min [2025-09-29T02:13:39.856898] [INFO ] [MAIN ] CWAN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:39.879095] [DEBUG] [MAIN ] CVX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:39.880051] [INFO ] [MAIN ] CVX: Generated 1820 derivative records from 54540 primary records. [2025-09-29T02:13:39.880249] [DEBUG] [LOCAL ] CVX: Saving derivative data. [2025-09-29T02:13:39.889580] [DEBUG] [LOCAL ] CW: Loaded 22705 existing records from primary storage. [2025-09-29T02:13:39.901292] [INFO ] [MAIN ] CW: Loaded 22705 primary data records. [2025-09-29T02:13:39.905826] [DEBUG] [LOCAL ] CVX: Derivative data saved (1820 records). [2025-09-29T02:13:39.929091] [INFO ] [MAIN ] CVX: Successfully saved derivative data. [2025-09-29T02:13:39.943970] [INFO ] [MAIN ] Derivative Progress: 531/2211 symbols completed. CVX took 1.3s. Estimated remaining: 11m 46s. Rate: 142.9 symbols/min [2025-09-29T02:13:39.944226] [INFO ] [MAIN ] CWEN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:40.268442] [DEBUG] [LOCAL ] CWAN: Loaded 53154 existing records from primary storage. [2025-09-29T02:13:40.280630] [INFO ] [MAIN ] CWAN: Loaded 53154 primary data records. [2025-09-29T02:13:40.411586] [DEBUG] [LOCAL ] CWEN: Loaded 45717 existing records from primary storage. [2025-09-29T02:13:40.415959] [INFO ] [MAIN ] CWEN: Loaded 45717 primary data records. [2025-09-29T02:13:41.049021] [DEBUG] [MAIN ] CW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:41.051330] [INFO ] [MAIN ] CW: Generated 1820 derivative records from 22705 primary records. [2025-09-29T02:13:41.051777] [DEBUG] [LOCAL ] CW: Saving derivative data. [2025-09-29T02:13:41.073385] [DEBUG] [LOCAL ] CW: Derivative data saved (1820 records). [2025-09-29T02:13:41.074412] [INFO ] [MAIN ] CW: Successfully saved derivative data. [2025-09-29T02:13:41.077249] [INFO ] [MAIN ] Derivative Progress: 532/2211 symbols completed. CW took 1.2s. Estimated remaining: 11m 47s. Rate: 142.4 symbols/min [2025-09-29T02:13:41.077920] [INFO ] [MAIN ] CWH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:41.096614] [DEBUG] [MAIN ] CWAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:41.097879] [INFO ] [MAIN ] CWAN: Generated 1820 derivative records from 53154 primary records. [2025-09-29T02:13:41.098287] [DEBUG] [LOCAL ] CWAN: Saving derivative data. [2025-09-29T02:13:41.117108] [DEBUG] [LOCAL ] CWAN: Derivative data saved (1820 records). [2025-09-29T02:13:41.118940] [INFO ] [MAIN ] CWAN: Successfully saved derivative data. [2025-09-29T02:13:41.121861] [INFO ] [MAIN ] Derivative Progress: 533/2211 symbols completed. CWAN took 1.3s. Estimated remaining: 11m 46s. Rate: 142.7 symbols/min [2025-09-29T02:13:41.122218] [INFO ] [MAIN ] CWK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:41.136055] [DEBUG] [MAIN ] CWEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:41.137280] [INFO ] [MAIN ] CWEN: Generated 1820 derivative records from 45717 primary records. [2025-09-29T02:13:41.137547] [DEBUG] [LOCAL ] CWEN: Saving derivative data. [2025-09-29T02:13:41.154399] [DEBUG] [LOCAL ] CWEN: Derivative data saved (1820 records). [2025-09-29T02:13:41.154795] [INFO ] [MAIN ] CWEN: Successfully saved derivative data. [2025-09-29T02:13:41.158619] [INFO ] [MAIN ] Derivative Progress: 534/2211 symbols completed. CWEN took 1.2s. Estimated remaining: 11m 44s. Rate: 142.9 symbols/min [2025-09-29T02:13:41.158940] [INFO ] [MAIN ] CWT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:41.202139] [DEBUG] [LOCAL ] CWH: Loaded 52151 existing records from primary storage. [2025-09-29T02:13:41.202496] [INFO ] [MAIN ] CWH: Loaded 52151 primary data records. [2025-09-29T02:13:41.348134] [DEBUG] [LOCAL ] CWT: Loaded 28294 existing records from primary storage. [2025-09-29T02:13:41.354257] [INFO ] [MAIN ] CWT: Loaded 28294 primary data records. [2025-09-29T02:13:41.481963] [DEBUG] [LOCAL ] CWK: Loaded 50158 existing records from primary storage. [2025-09-29T02:13:41.646362] [INFO ] [MAIN ] CWK: Loaded 50158 primary data records. [2025-09-29T02:13:42.282541] [DEBUG] [MAIN ] CWH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:42.283832] [INFO ] [MAIN ] CWH: Generated 1820 derivative records from 52151 primary records. [2025-09-29T02:13:42.284614] [DEBUG] [LOCAL ] CWH: Saving derivative data. [2025-09-29T02:13:42.304491] [DEBUG] [LOCAL ] CWH: Derivative data saved (1820 records). [2025-09-29T02:13:42.306341] [INFO ] [MAIN ] CWH: Successfully saved derivative data. [2025-09-29T02:13:42.310420] [INFO ] [MAIN ] Derivative Progress: 535/2211 symbols completed. CWH took 1.2s. Estimated remaining: 11m 46s. Rate: 142.4 symbols/min [2025-09-29T02:13:42.311150] [INFO ] [MAIN ] CX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:42.328337] [DEBUG] [MAIN ] CWT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:42.330057] [INFO ] [MAIN ] CWT: Generated 1820 derivative records from 28294 primary records. [2025-09-29T02:13:42.342807] [DEBUG] [LOCAL ] CWT: Saving derivative data. [2025-09-29T02:13:42.343229] [DEBUG] [MAIN ] CWK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:42.344687] [INFO ] [MAIN ] CWK: Generated 1820 derivative records from 50158 primary records. [2025-09-29T02:13:42.344836] [DEBUG] [LOCAL ] CWK: Saving derivative data. [2025-09-29T02:13:42.378408] [DEBUG] [LOCAL ] CWK: Derivative data saved (1820 records). [2025-09-29T02:13:42.378591] [DEBUG] [LOCAL ] CWT: Derivative data saved (1820 records). [2025-09-29T02:13:42.378807] [INFO ] [MAIN ] CWK: Successfully saved derivative data. [2025-09-29T02:13:42.381843] [INFO ] [MAIN ] Derivative Progress: 536/2211 symbols completed. CWK took 1.3s. Estimated remaining: 11m 44s. Rate: 142.7 symbols/min [2025-09-29T02:13:42.378742] [INFO ] [MAIN ] CWT: Successfully saved derivative data. [2025-09-29T02:13:42.384710] [INFO ] [MAIN ] Derivative Progress: 537/2211 symbols completed. CWT took 1.2s. Estimated remaining: 11m 43s. Rate: 142.9 symbols/min [2025-09-29T02:13:42.384876] [INFO ] [MAIN ] CXH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:42.382020] [INFO ] [MAIN ] CXE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:42.400216] [DEBUG] [LOCAL ] CXE: Loaded 7247 existing records from primary storage. [2025-09-29T02:13:42.396592] [DEBUG] [LOCAL ] CXH: Loaded 4436 existing records from primary storage. [2025-09-29T02:13:42.400455] [INFO ] [MAIN ] CXH: Loaded 4436 primary data records. [2025-09-29T02:13:42.400516] [INFO ] [MAIN ] CXE: Loaded 7247 primary data records. [2025-09-29T02:13:42.808622] [DEBUG] [LOCAL ] CX: Loaded 53603 existing records from primary storage. [2025-09-29T02:13:43.009415] [INFO ] [MAIN ] CX: Loaded 53603 primary data records. [2025-09-29T02:13:43.523333] [DEBUG] [MAIN ] CXH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:43.525135] [INFO ] [MAIN ] CXH: Generated 1820 derivative records from 4436 primary records. [2025-09-29T02:13:43.525263] [DEBUG] [LOCAL ] CXH: Saving derivative data. [2025-09-29T02:13:43.550183] [DEBUG] [MAIN ] CXE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:43.557245] [INFO ] [MAIN ] CXE: Generated 1820 derivative records from 7247 primary records. [2025-09-29T02:13:43.557421] [DEBUG] [LOCAL ] CXE: Saving derivative data. [2025-09-29T02:13:43.561078] [DEBUG] [LOCAL ] CXH: Derivative data saved (1820 records). [2025-09-29T02:13:43.572354] [INFO ] [MAIN ] CXH: Successfully saved derivative data. [2025-09-29T02:13:43.575366] [INFO ] [MAIN ] Derivative Progress: 538/2211 symbols completed. CXH took 1.2s. Estimated remaining: 11m 45s. Rate: 142.4 symbols/min [2025-09-29T02:13:43.579948] [DEBUG] [LOCAL ] CXE: Derivative data saved (1820 records). [2025-09-29T02:13:43.580182] [INFO ] [MAIN ] CXE: Successfully saved derivative data. [2025-09-29T02:13:43.582746] [INFO ] [MAIN ] Derivative Progress: 539/2211 symbols completed. CXE took 1.2s. Estimated remaining: 11m 43s. Rate: 142.7 symbols/min [2025-09-29T02:13:43.599940] [DEBUG] [MAIN ] CX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:43.600720] [INFO ] [MAIN ] CX: Generated 1820 derivative records from 53603 primary records. [2025-09-29T02:13:43.600813] [DEBUG] [LOCAL ] CX: Saving derivative data. [2025-09-29T02:13:43.617114] [DEBUG] [LOCAL ] CX: Derivative data saved (1820 records). [2025-09-29T02:13:43.617214] [INFO ] [MAIN ] CX: Successfully saved derivative data. [2025-09-29T02:13:43.620537] [INFO ] [MAIN ] Derivative Progress: 540/2211 symbols completed. CX took 1.3s. Estimated remaining: 11m 41s. Rate: 142.9 symbols/min [2025-09-29T02:13:43.621426] [INFO ] [MAIN ] CXT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:43.621289] [INFO ] [MAIN ] CXM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:43.621600] [INFO ] [MAIN ] CXW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:43.683544] [DEBUG] [LOCAL ] CXT: Loaded 31611 existing records from primary storage. [2025-09-29T02:13:43.683923] [INFO ] [MAIN ] CXT: Loaded 31611 primary data records. [2025-09-29T02:13:43.807440] [DEBUG] [LOCAL ] CXW: Loaded 44899 existing records from primary storage. [2025-09-29T02:13:43.833495] [INFO ] [MAIN ] CXW: Loaded 44899 primary data records. [2025-09-29T02:13:43.834720] [DEBUG] [LOCAL ] CXM: Loaded 48607 existing records from primary storage. [2025-09-29T02:13:43.860861] [INFO ] [MAIN ] CXM: Loaded 48607 primary data records. [2025-09-29T02:13:44.771822] [DEBUG] [MAIN ] CXT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:44.772849] [INFO ] [MAIN ] CXT: Generated 1820 derivative records from 31611 primary records. [2025-09-29T02:13:44.772967] [DEBUG] [LOCAL ] CXT: Saving derivative data. [2025-09-29T02:13:44.795041] [DEBUG] [LOCAL ] CXT: Derivative data saved (1820 records). [2025-09-29T02:13:44.795789] [INFO ] [MAIN ] CXT: Successfully saved derivative data. [2025-09-29T02:13:44.808257] [INFO ] [MAIN ] Derivative Progress: 541/2211 symbols completed. CXT took 1.2s. Estimated remaining: 11m 43s. Rate: 142.5 symbols/min [2025-09-29T02:13:44.817294] [DEBUG] [MAIN ] CXW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:44.817460] [INFO ] [MAIN ] CYD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:44.818680] [INFO ] [MAIN ] CXW: Generated 1820 derivative records from 44899 primary records. [2025-09-29T02:13:44.819332] [DEBUG] [LOCAL ] CXW: Saving derivative data. [2025-09-29T02:13:44.862454] [DEBUG] [MAIN ] CXM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:44.863840] [DEBUG] [LOCAL ] CXW: Derivative data saved (1820 records). [2025-09-29T02:13:44.865290] [INFO ] [MAIN ] CXW: Successfully saved derivative data. [2025-09-29T02:13:44.864988] [INFO ] [MAIN ] CXM: Generated 1820 derivative records from 48607 primary records. [2025-09-29T02:13:44.865472] [DEBUG] [LOCAL ] CXM: Saving derivative data. [2025-09-29T02:13:44.867955] [INFO ] [MAIN ] Derivative Progress: 542/2211 symbols completed. CXW took 1.2s. Estimated remaining: 11m 42s. Rate: 142.7 symbols/min [2025-09-29T02:13:44.884270] [INFO ] [MAIN ] CYH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:44.892809] [DEBUG] [LOCAL ] CXM: Derivative data saved (1820 records). [2025-09-29T02:13:44.893338] [INFO ] [MAIN ] CXM: Successfully saved derivative data. [2025-09-29T02:13:44.896373] [INFO ] [MAIN ] Derivative Progress: 543/2211 symbols completed. CXM took 1.3s. Estimated remaining: 11m 40s. Rate: 142.9 symbols/min [2025-09-29T02:13:44.897825] [INFO ] [MAIN ] D: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:44.908987] [DEBUG] [LOCAL ] CYD: Loaded 27145 existing records from primary storage. [2025-09-29T02:13:44.909273] [INFO ] [MAIN ] CYD: Loaded 27145 primary data records. [2025-09-29T02:13:45.330232] [DEBUG] [LOCAL ] D: Loaded 54426 existing records from primary storage. [2025-09-29T02:13:45.332274] [DEBUG] [LOCAL ] CYH: Loaded 48352 existing records from primary storage. [2025-09-29T02:13:45.332404] [INFO ] [MAIN ] D: Loaded 54426 primary data records. [2025-09-29T02:13:45.332612] [INFO ] [MAIN ] CYH: Loaded 48352 primary data records. [2025-09-29T02:13:46.021747] [DEBUG] [MAIN ] CYD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:46.023847] [INFO ] [MAIN ] CYD: Generated 1820 derivative records from 27145 primary records. [2025-09-29T02:13:46.024330] [DEBUG] [LOCAL ] CYD: Saving derivative data. [2025-09-29T02:13:46.043635] [DEBUG] [LOCAL ] CYD: Derivative data saved (1820 records). [2025-09-29T02:13:46.044113] [INFO ] [MAIN ] CYD: Successfully saved derivative data. [2025-09-29T02:13:46.047324] [INFO ] [MAIN ] Derivative Progress: 544/2211 symbols completed. CYD took 1.2s. Estimated remaining: 11m 42s. Rate: 142.5 symbols/min [2025-09-29T02:13:46.047523] [INFO ] [MAIN ] DAC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:46.067767] [DEBUG] [MAIN ] CYH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:46.074132] [INFO ] [MAIN ] CYH: Generated 1820 derivative records from 48352 primary records. [2025-09-29T02:13:46.075390] [DEBUG] [LOCAL ] CYH: Saving derivative data. [2025-09-29T02:13:46.098443] [DEBUG] [LOCAL ] DAC: Loaded 12769 existing records from primary storage. [2025-09-29T02:13:46.103812] [INFO ] [MAIN ] DAC: Loaded 12769 primary data records. [2025-09-29T02:13:46.104103] [DEBUG] [MAIN ] D: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:46.111895] [DEBUG] [LOCAL ] CYH: Derivative data saved (1820 records). [2025-09-29T02:13:46.118462] [INFO ] [MAIN ] D: Generated 1820 derivative records from 54426 primary records. [2025-09-29T02:13:46.136066] [INFO ] [MAIN ] CYH: Successfully saved derivative data. [2025-09-29T02:13:46.165455] [DEBUG] [LOCAL ] D: Saving derivative data. [2025-09-29T02:13:46.168130] [INFO ] [MAIN ] Derivative Progress: 545/2211 symbols completed. CYH took 1.3s. Estimated remaining: 11m 41s. Rate: 142.7 symbols/min [2025-09-29T02:13:46.212373] [INFO ] [MAIN ] DAL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:46.251725] [DEBUG] [LOCAL ] D: Derivative data saved (1820 records). [2025-09-29T02:13:46.273175] [INFO ] [MAIN ] D: Successfully saved derivative data. [2025-09-29T02:13:46.315330] [INFO ] [MAIN ] Derivative Progress: 546/2211 symbols completed. D took 1.4s. Estimated remaining: 11m 39s. Rate: 142.8 symbols/min [2025-09-29T02:13:46.340676] [INFO ] [MAIN ] DAN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:46.533832] [DEBUG] [MAIN ] DAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:46.537094] [INFO ] [MAIN ] DAC: Generated 1820 derivative records from 12769 primary records. [2025-09-29T02:13:46.536164] [DEBUG] [LOCAL ] DAL: Loaded 54533 existing records from primary storage. [2025-09-29T02:13:46.537428] [DEBUG] [LOCAL ] DAC: Saving derivative data. [2025-09-29T02:13:46.548691] [INFO ] [MAIN ] DAL: Loaded 54533 primary data records. [2025-09-29T02:13:46.605541] [DEBUG] [LOCAL ] DAC: Derivative data saved (1820 records). [2025-09-29T02:13:46.629696] [INFO ] [MAIN ] DAC: Successfully saved derivative data. [2025-09-29T02:13:46.641679] [INFO ] [MAIN ] Derivative Progress: 547/2211 symbols completed. DAC took 0.6s. Estimated remaining: 11m 39s. Rate: 142.9 symbols/min [2025-09-29T02:13:46.703753] [DEBUG] [LOCAL ] DAN: Loaded 49753 existing records from primary storage. [2025-09-29T02:13:46.701428] [INFO ] [MAIN ] DAO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:46.704403] [INFO ] [MAIN ] DAN: Loaded 49753 primary data records. [2025-09-29T02:13:47.102919] [DEBUG] [LOCAL ] DAO: Loaded 21546 existing records from primary storage. [2025-09-29T02:13:47.269891] [INFO ] [MAIN ] DAO: Loaded 21546 primary data records. [2025-09-29T02:13:47.635771] [DEBUG] [MAIN ] DAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:47.637167] [INFO ] [MAIN ] DAL: Generated 1820 derivative records from 54533 primary records. [2025-09-29T02:13:47.637408] [DEBUG] [LOCAL ] DAL: Saving derivative data. [2025-09-29T02:13:47.678193] [DEBUG] [LOCAL ] DAL: Derivative data saved (1820 records). [2025-09-29T02:13:47.679376] [INFO ] [MAIN ] DAL: Successfully saved derivative data. [2025-09-29T02:13:47.679748] [DEBUG] [MAIN ] DAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:47.682737] [INFO ] [MAIN ] Derivative Progress: 548/2211 symbols completed. DAL took 1.5s. Estimated remaining: 11m 40s. Rate: 142.5 symbols/min [2025-09-29T02:13:47.683819] [INFO ] [MAIN ] DAN: Generated 1820 derivative records from 49753 primary records. [2025-09-29T02:13:47.684145] [INFO ] [MAIN ] DAR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:47.684473] [DEBUG] [LOCAL ] DAN: Saving derivative data. [2025-09-29T02:13:47.703027] [DEBUG] [LOCAL ] DAN: Derivative data saved (1820 records). [2025-09-29T02:13:47.706035] [INFO ] [MAIN ] DAN: Successfully saved derivative data. [2025-09-29T02:13:47.710059] [INFO ] [MAIN ] Derivative Progress: 549/2211 symbols completed. DAN took 1.4s. Estimated remaining: 11m 39s. Rate: 142.7 symbols/min [2025-09-29T02:13:47.710507] [INFO ] [MAIN ] DAVA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:47.725378] [DEBUG] [MAIN ] DAO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:47.726181] [INFO ] [MAIN ] DAO: Generated 1820 derivative records from 21546 primary records. [2025-09-29T02:13:47.726284] [DEBUG] [LOCAL ] DAO: Saving derivative data. [2025-09-29T02:13:47.744621] [DEBUG] [LOCAL ] DAO: Derivative data saved (1820 records). [2025-09-29T02:13:47.744834] [INFO ] [MAIN ] DAO: Successfully saved derivative data. [2025-09-29T02:13:47.748575] [INFO ] [MAIN ] Derivative Progress: 550/2211 symbols completed. DAO took 1.0s. Estimated remaining: 11m 37s. Rate: 143.0 symbols/min [2025-09-29T02:13:47.748984] [INFO ] [MAIN ] DAY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:47.799874] [DEBUG] [LOCAL ] DAR: Loaded 52603 existing records from primary storage. [2025-09-29T02:13:47.800174] [INFO ] [MAIN ] DAR: Loaded 52603 primary data records. [2025-09-29T02:13:47.950165] [DEBUG] [LOCAL ] DAVA: Loaded 41308 existing records from primary storage. [2025-09-29T02:13:47.978486] [INFO ] [MAIN ] DAVA: Loaded 41308 primary data records. [2025-09-29T02:13:48.177182] [DEBUG] [LOCAL ] DAY: Loaded 50491 existing records from primary storage. [2025-09-29T02:13:48.216882] [INFO ] [MAIN ] DAY: Loaded 50491 primary data records. [2025-09-29T02:13:48.869965] [DEBUG] [MAIN ] DAR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:48.871750] [INFO ] [MAIN ] DAR: Generated 1820 derivative records from 52603 primary records. [2025-09-29T02:13:48.872039] [DEBUG] [LOCAL ] DAR: Saving derivative data. [2025-09-29T02:13:48.903109] [DEBUG] [LOCAL ] DAR: Derivative data saved (1820 records). [2025-09-29T02:13:48.909356] [DEBUG] [MAIN ] DAVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:48.908947] [INFO ] [MAIN ] DAR: Successfully saved derivative data. [2025-09-29T02:13:48.910353] [INFO ] [MAIN ] DAVA: Generated 1820 derivative records from 41308 primary records. [2025-09-29T02:13:48.913877] [DEBUG] [LOCAL ] DAVA: Saving derivative data. [2025-09-29T02:13:48.913566] [INFO ] [MAIN ] Derivative Progress: 551/2211 symbols completed. DAR took 1.2s. Estimated remaining: 11m 39s. Rate: 142.5 symbols/min [2025-09-29T02:13:48.915832] [INFO ] [MAIN ] DB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:48.937810] [DEBUG] [LOCAL ] DAVA: Derivative data saved (1820 records). [2025-09-29T02:13:48.951101] [DEBUG] [MAIN ] DAY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:48.951959] [INFO ] [MAIN ] DAY: Generated 1820 derivative records from 50491 primary records. [2025-09-29T02:13:48.950624] [INFO ] [MAIN ] DAVA: Successfully saved derivative data. [2025-09-29T02:13:48.954749] [INFO ] [MAIN ] Derivative Progress: 552/2211 symbols completed. DAVA took 1.2s. Estimated remaining: 11m 37s. Rate: 142.8 symbols/min [2025-09-29T02:13:48.955030] [DEBUG] [LOCAL ] DAY: Saving derivative data. [2025-09-29T02:13:48.955152] [INFO ] [MAIN ] DBD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:48.973437] [DEBUG] [LOCAL ] DAY: Derivative data saved (1820 records). [2025-09-29T02:13:48.973603] [INFO ] [MAIN ] DAY: Successfully saved derivative data. [2025-09-29T02:13:48.977703] [INFO ] [MAIN ] Derivative Progress: 553/2211 symbols completed. DAY took 1.2s. Estimated remaining: 11m 36s. Rate: 143.0 symbols/min [2025-09-29T02:13:48.998112] [DEBUG] [LOCAL ] DBD: Loaded 24109 existing records from primary storage. [2025-09-29T02:13:49.013355] [INFO ] [MAIN ] DBD: Loaded 24109 primary data records. [2025-09-29T02:13:49.168632] [DEBUG] [LOCAL ] DB: Loaded 53377 existing records from primary storage. [2025-09-29T02:13:49.201533] [INFO ] [MAIN ] DB: Loaded 53377 primary data records. [2025-09-29T02:13:49.734974] [DEBUG] [MAIN ] DBD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:49.736117] [INFO ] [MAIN ] DBD: Generated 1820 derivative records from 24109 primary records. [2025-09-29T02:13:49.736448] [DEBUG] [LOCAL ] DBD: Saving derivative data. [2025-09-29T02:13:49.762802] [DEBUG] [LOCAL ] DBD: Derivative data saved (1820 records). [2025-09-29T02:13:49.764794] [INFO ] [MAIN ] DBD: Successfully saved derivative data. [2025-09-29T02:13:49.768046] [INFO ] [MAIN ] Derivative Progress: 554/2211 symbols completed. DBD took 0.8s. Estimated remaining: 11m 36s. Rate: 142.8 symbols/min [2025-09-29T02:13:49.781968] [DEBUG] [MAIN ] DB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:49.782691] [INFO ] [MAIN ] DB: Generated 1820 derivative records from 53377 primary records. [2025-09-29T02:13:49.782777] [DEBUG] [LOCAL ] DB: Saving derivative data. [2025-09-29T02:13:49.798442] [DEBUG] [LOCAL ] DB: Derivative data saved (1820 records). [2025-09-29T02:13:49.798545] [INFO ] [MAIN ] DB: Successfully saved derivative data. [2025-09-29T02:13:49.801552] [INFO ] [MAIN ] Derivative Progress: 555/2211 symbols completed. DB took 0.9s. Estimated remaining: 11m 35s. Rate: 143.0 symbols/min [2025-09-29T02:13:49.802234] [INFO ] [MAIN ] DBI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:49.802387] [INFO ] [MAIN ] DBRG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:49.802324] [INFO ] [MAIN ] DBL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:49.817993] [DEBUG] [LOCAL ] DBL: Loaded 9259 existing records from primary storage. [2025-09-29T02:13:49.818153] [INFO ] [MAIN ] DBL: Loaded 9259 primary data records. [2025-09-29T02:13:50.055518] [DEBUG] [LOCAL ] DBI: Loaded 45524 existing records from primary storage. [2025-09-29T02:13:50.060334] [INFO ] [MAIN ] DBI: Loaded 45524 primary data records. [2025-09-29T02:13:50.225710] [DEBUG] [LOCAL ] DBRG: Loaded 50526 existing records from primary storage. [2025-09-29T02:13:50.257396] [INFO ] [MAIN ] DBRG: Loaded 50526 primary data records. [2025-09-29T02:13:50.901253] [DEBUG] [MAIN ] DBL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:50.902878] [INFO ] [MAIN ] DBL: Generated 1820 derivative records from 9259 primary records. [2025-09-29T02:13:50.904319] [DEBUG] [LOCAL ] DBL: Saving derivative data. [2025-09-29T02:13:50.924262] [DEBUG] [LOCAL ] DBL: Derivative data saved (1820 records). [2025-09-29T02:13:50.924443] [INFO ] [MAIN ] DBL: Successfully saved derivative data. [2025-09-29T02:13:50.927213] [INFO ] [MAIN ] Derivative Progress: 556/2211 symbols completed. DBL took 1.1s. Estimated remaining: 11m 36s. Rate: 142.6 symbols/min [2025-09-29T02:13:50.927799] [INFO ] [MAIN ] DCI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:50.949062] [DEBUG] [MAIN ] DBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:50.951339] [INFO ] [MAIN ] DBI: Generated 1820 derivative records from 45524 primary records. [2025-09-29T02:13:50.952672] [DEBUG] [LOCAL ] DBI: Saving derivative data. [2025-09-29T02:13:50.980483] [DEBUG] [MAIN ] DBRG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:50.985563] [DEBUG] [LOCAL ] DBI: Derivative data saved (1820 records). [2025-09-29T02:13:50.985806] [INFO ] [MAIN ] DBI: Successfully saved derivative data. [2025-09-29T02:13:50.999163] [INFO ] [MAIN ] Derivative Progress: 557/2211 symbols completed. DBI took 1.2s. Estimated remaining: 11m 35s. Rate: 142.8 symbols/min [2025-09-29T02:13:50.986635] [INFO ] [MAIN ] DBRG: Generated 1820 derivative records from 50526 primary records. [2025-09-29T02:13:50.999603] [INFO ] [MAIN ] DCO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:50.999780] [DEBUG] [LOCAL ] DBRG: Saving derivative data. [2025-09-29T02:13:51.032401] [DEBUG] [LOCAL ] DBRG: Derivative data saved (1820 records). [2025-09-29T02:13:51.031378] [DEBUG] [LOCAL ] DCI: Loaded 38065 existing records from primary storage. [2025-09-29T02:13:51.036015] [INFO ] [MAIN ] DBRG: Successfully saved derivative data. [2025-09-29T02:13:51.039323] [INFO ] [MAIN ] Derivative Progress: 558/2211 symbols completed. DBRG took 1.2s. Estimated remaining: 11m 33s. Rate: 143.0 symbols/min [2025-09-29T02:13:51.036219] [INFO ] [MAIN ] DCI: Loaded 38065 primary data records. [2025-09-29T02:13:51.039686] [INFO ] [MAIN ] DD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:51.068069] [DEBUG] [LOCAL ] DCO: Loaded 14003 existing records from primary storage. [2025-09-29T02:13:51.085017] [INFO ] [MAIN ] DCO: Loaded 14003 primary data records. [2025-09-29T02:13:51.773159] [DEBUG] [LOCAL ] DD: Loaded 53595 existing records from primary storage. [2025-09-29T02:13:51.774411] [INFO ] [MAIN ] DD: Loaded 53595 primary data records. [2025-09-29T02:13:52.142704] [DEBUG] [MAIN ] DCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:52.144408] [INFO ] [MAIN ] DCI: Generated 1820 derivative records from 38065 primary records. [2025-09-29T02:13:52.144941] [DEBUG] [LOCAL ] DCI: Saving derivative data. [2025-09-29T02:13:52.159601] [DEBUG] [MAIN ] DCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:52.178597] [DEBUG] [LOCAL ] DCI: Derivative data saved (1820 records). [2025-09-29T02:13:52.178765] [INFO ] [MAIN ] DCI: Successfully saved derivative data. [2025-09-29T02:13:52.173613] [INFO ] [MAIN ] DCO: Generated 1820 derivative records from 14003 primary records. [2025-09-29T02:13:52.181708] [INFO ] [MAIN ] Derivative Progress: 559/2211 symbols completed. DCI took 1.3s. Estimated remaining: 11m 35s. Rate: 142.6 symbols/min [2025-09-29T02:13:52.182274] [INFO ] [MAIN ] DDD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:52.182800] [DEBUG] [LOCAL ] DCO: Saving derivative data. [2025-09-29T02:13:52.203367] [DEBUG] [LOCAL ] DCO: Derivative data saved (1820 records). [2025-09-29T02:13:52.203714] [INFO ] [MAIN ] DCO: Successfully saved derivative data. [2025-09-29T02:13:52.207697] [INFO ] [MAIN ] Derivative Progress: 560/2211 symbols completed. DCO took 1.2s. Estimated remaining: 11m 34s. Rate: 142.8 symbols/min [2025-09-29T02:13:52.209715] [INFO ] [MAIN ] DDL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:52.223861] [DEBUG] [MAIN ] DD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:52.224848] [INFO ] [MAIN ] DD: Generated 1820 derivative records from 53595 primary records. [2025-09-29T02:13:52.225014] [DEBUG] [LOCAL ] DD: Saving derivative data. [2025-09-29T02:13:52.244384] [DEBUG] [LOCAL ] DD: Derivative data saved (1820 records). [2025-09-29T02:13:52.244845] [INFO ] [MAIN ] DD: Successfully saved derivative data. [2025-09-29T02:13:52.248488] [INFO ] [MAIN ] Derivative Progress: 561/2211 symbols completed. DD took 1.2s. Estimated remaining: 11m 32s. Rate: 143.0 symbols/min [2025-09-29T02:13:52.248872] [INFO ] [MAIN ] DDS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:52.291318] [DEBUG] [LOCAL ] DDL: Loaded 37016 existing records from primary storage. [2025-09-29T02:13:52.299106] [INFO ] [MAIN ] DDL: Loaded 37016 primary data records. [2025-09-29T02:13:52.299480] [DEBUG] [LOCAL ] DDS: Loaded 13374 existing records from primary storage. [2025-09-29T02:13:52.331269] [INFO ] [MAIN ] DDS: Loaded 13374 primary data records. [2025-09-29T02:13:52.385097] [DEBUG] [LOCAL ] DDD: Loaded 51647 existing records from primary storage. [2025-09-29T02:13:52.443844] [INFO ] [MAIN ] DDD: Loaded 51647 primary data records. [2025-09-29T02:13:53.362877] [DEBUG] [MAIN ] DDL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:53.372326] [INFO ] [MAIN ] DDL: Generated 1820 derivative records from 37016 primary records. [2025-09-29T02:13:53.377211] [DEBUG] [LOCAL ] DDL: Saving derivative data. [2025-09-29T02:13:53.378729] [DEBUG] [MAIN ] DDS: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:13:53.381289] [INFO ] [MAIN ] DDS: Generated 1819 derivative records from 13374 primary records. [2025-09-29T02:13:53.391504] [DEBUG] [LOCAL ] DDS: Saving derivative data. [2025-09-29T02:13:53.400318] [DEBUG] [LOCAL ] DDL: Derivative data saved (1820 records). [2025-09-29T02:13:53.408028] [INFO ] [MAIN ] DDL: Successfully saved derivative data. [2025-09-29T02:13:53.429035] [DEBUG] [MAIN ] DDD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:53.432053] [INFO ] [MAIN ] DDD: Generated 1820 derivative records from 51647 primary records. [2025-09-29T02:13:53.428027] [INFO ] [MAIN ] Derivative Progress: 562/2211 symbols completed. DDL took 1.2s. Estimated remaining: 11m 34s. Rate: 142.6 symbols/min [2025-09-29T02:13:53.432578] [INFO ] [MAIN ] DDT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:53.434586] [DEBUG] [LOCAL ] DDS: Derivative data saved (1819 records). [2025-09-29T02:13:53.435220] [INFO ] [MAIN ] DDS: Successfully saved derivative data. [2025-09-29T02:13:53.432660] [DEBUG] [LOCAL ] DDD: Saving derivative data. [2025-09-29T02:13:53.439085] [INFO ] [MAIN ] Derivative Progress: 563/2211 symbols completed. DDS took 1.2s. Estimated remaining: 11m 32s. Rate: 142.8 symbols/min [2025-09-29T02:13:53.439512] [INFO ] [MAIN ] DE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:53.460789] [DEBUG] [LOCAL ] DDD: Derivative data saved (1820 records). [2025-09-29T02:13:53.460325] [DEBUG] [LOCAL ] DDT: Loaded 2117 existing records from primary storage. [2025-09-29T02:13:53.461053] [INFO ] [MAIN ] DDD: Successfully saved derivative data. [2025-09-29T02:13:53.464593] [INFO ] [MAIN ] Derivative Progress: 564/2211 symbols completed. DDD took 1.3s. Estimated remaining: 11m 31s. Rate: 143.1 symbols/min [2025-09-29T02:13:53.464846] [INFO ] [MAIN ] DEA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:53.461153] [INFO ] [MAIN ] DDT: Loaded 2117 primary data records. [2025-09-29T02:13:53.914125] [DEBUG] [LOCAL ] DEA: Loaded 41860 existing records from primary storage. [2025-09-29T02:13:53.914403] [INFO ] [MAIN ] DEA: Loaded 41860 primary data records. [2025-09-29T02:13:53.921187] [DEBUG] [LOCAL ] DE: Loaded 48397 existing records from primary storage. [2025-09-29T02:13:53.938236] [INFO ] [MAIN ] DE: Loaded 48397 primary data records. [2025-09-29T02:13:54.618691] [DEBUG] [MAIN ] DDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:54.620599] [INFO ] [MAIN ] DDT: Generated 1820 derivative records from 2117 primary records. [2025-09-29T02:13:54.621958] [DEBUG] [LOCAL ] DDT: Saving derivative data. [2025-09-29T02:13:54.640170] [DEBUG] [LOCAL ] DDT: Derivative data saved (1820 records). [2025-09-29T02:13:54.641015] [INFO ] [MAIN ] DDT: Successfully saved derivative data. [2025-09-29T02:13:54.643686] [INFO ] [MAIN ] Derivative Progress: 565/2211 symbols completed. DDT took 1.2s. Estimated remaining: 11m 32s. Rate: 142.6 symbols/min [2025-09-29T02:13:54.644290] [INFO ] [MAIN ] DEC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:54.664255] [DEBUG] [MAIN ] DEA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:54.666203] [INFO ] [MAIN ] DEA: Generated 1820 derivative records from 41860 primary records. [2025-09-29T02:13:54.666349] [DEBUG] [LOCAL ] DEA: Saving derivative data. [2025-09-29T02:13:54.692356] [DEBUG] [MAIN ] DE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:54.698112] [DEBUG] [LOCAL ] DEA: Derivative data saved (1820 records). [2025-09-29T02:13:54.694977] [INFO ] [MAIN ] DE: Generated 1820 derivative records from 48397 primary records. [2025-09-29T02:13:54.698458] [DEBUG] [LOCAL ] DE: Saving derivative data. [2025-09-29T02:13:54.698391] [INFO ] [MAIN ] DEA: Successfully saved derivative data. [2025-09-29T02:13:54.702275] [INFO ] [MAIN ] Derivative Progress: 566/2211 symbols completed. DEA took 1.2s. Estimated remaining: 11m 31s. Rate: 142.8 symbols/min [2025-09-29T02:13:54.718755] [INFO ] [MAIN ] DECK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:54.728112] [DEBUG] [LOCAL ] DE: Derivative data saved (1820 records). [2025-09-29T02:13:54.728283] [INFO ] [MAIN ] DE: Successfully saved derivative data. [2025-09-29T02:13:54.731229] [INFO ] [MAIN ] Derivative Progress: 567/2211 symbols completed. DE took 1.3s. Estimated remaining: 11m 29s. Rate: 143.1 symbols/min [2025-09-29T02:13:54.732518] [INFO ] [MAIN ] DEI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:54.743854] [DEBUG] [LOCAL ] DEC: Loaded 31121 existing records from primary storage. [2025-09-29T02:13:54.743985] [INFO ] [MAIN ] DEC: Loaded 31121 primary data records. [2025-09-29T02:13:55.239499] [DEBUG] [LOCAL ] DECK: Loaded 54078 existing records from primary storage. [2025-09-29T02:13:55.240090] [INFO ] [MAIN ] DECK: Loaded 54078 primary data records. [2025-09-29T02:13:55.241201] [DEBUG] [LOCAL ] DEI: Loaded 49204 existing records from primary storage. [2025-09-29T02:13:55.247681] [INFO ] [MAIN ] DEI: Loaded 49204 primary data records. [2025-09-29T02:13:56.020621] [DEBUG] [MAIN ] DEC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:56.021732] [INFO ] [MAIN ] DEC: Generated 1820 derivative records from 31121 primary records. [2025-09-29T02:13:56.023689] [DEBUG] [LOCAL ] DEC: Saving derivative data. [2025-09-29T02:13:56.048083] [DEBUG] [LOCAL ] DEC: Derivative data saved (1820 records). [2025-09-29T02:13:56.048610] [INFO ] [MAIN ] DEC: Successfully saved derivative data. [2025-09-29T02:13:56.053550] [INFO ] [MAIN ] Derivative Progress: 568/2211 symbols completed. DEC took 1.4s. Estimated remaining: 11m 32s. Rate: 142.5 symbols/min [2025-09-29T02:13:56.072630] [DEBUG] [MAIN ] DEI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:56.073721] [INFO ] [MAIN ] DEI: Generated 1820 derivative records from 49204 primary records. [2025-09-29T02:13:56.073915] [DEBUG] [LOCAL ] DEI: Saving derivative data. [2025-09-29T02:13:56.095581] [DEBUG] [MAIN ] DECK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:56.100332] [INFO ] [MAIN ] DECK: Generated 1820 derivative records from 54078 primary records. [2025-09-29T02:13:56.103506] [DEBUG] [LOCAL ] DECK: Saving derivative data. [2025-09-29T02:13:56.104686] [DEBUG] [LOCAL ] DEI: Derivative data saved (1820 records). [2025-09-29T02:13:56.105587] [INFO ] [MAIN ] DEI: Successfully saved derivative data. [2025-09-29T02:13:56.108505] [INFO ] [MAIN ] Derivative Progress: 569/2211 symbols completed. DEI took 1.4s. Estimated remaining: 11m 30s. Rate: 142.7 symbols/min [2025-09-29T02:13:56.124370] [DEBUG] [LOCAL ] DECK: Derivative data saved (1820 records). [2025-09-29T02:13:56.124486] [INFO ] [MAIN ] DECK: Successfully saved derivative data. [2025-09-29T02:13:56.127734] [INFO ] [MAIN ] Derivative Progress: 570/2211 symbols completed. DECK took 1.4s. Estimated remaining: 11m 29s. Rate: 143.0 symbols/min [2025-09-29T02:13:56.128278] [INFO ] [MAIN ] DELL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:56.128346] [INFO ] [MAIN ] DEO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:56.128402] [INFO ] [MAIN ] DFH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:56.186100] [DEBUG] [LOCAL ] DFH: Loaded 33106 existing records from primary storage. [2025-09-29T02:13:56.187758] [INFO ] [MAIN ] DFH: Loaded 33106 primary data records. [2025-09-29T02:13:56.266256] [DEBUG] [LOCAL ] DEO: Loaded 49777 existing records from primary storage. [2025-09-29T02:13:56.302976] [INFO ] [MAIN ] DEO: Loaded 49777 primary data records. [2025-09-29T02:13:56.437355] [DEBUG] [LOCAL ] DELL: Loaded 54515 existing records from primary storage. [2025-09-29T02:13:56.646721] [INFO ] [MAIN ] DELL: Loaded 54515 primary data records. [2025-09-29T02:13:57.257217] [DEBUG] [MAIN ] DFH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:57.258942] [INFO ] [MAIN ] DFH: Generated 1820 derivative records from 33106 primary records. [2025-09-29T02:13:57.259242] [DEBUG] [LOCAL ] DFH: Saving derivative data. [2025-09-29T02:13:57.279511] [DEBUG] [LOCAL ] DFH: Derivative data saved (1820 records). [2025-09-29T02:13:57.281471] [INFO ] [MAIN ] DFH: Successfully saved derivative data. [2025-09-29T02:13:57.284179] [INFO ] [MAIN ] Derivative Progress: 571/2211 symbols completed. DFH took 1.2s. Estimated remaining: 11m 30s. Rate: 142.5 symbols/min [2025-09-29T02:13:57.285073] [INFO ] [MAIN ] DFIN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:57.299967] [DEBUG] [MAIN ] DEO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:57.300835] [INFO ] [MAIN ] DEO: Generated 1820 derivative records from 49777 primary records. [2025-09-29T02:13:57.301856] [DEBUG] [LOCAL ] DEO: Saving derivative data. [2025-09-29T02:13:57.323455] [DEBUG] [LOCAL ] DEO: Derivative data saved (1820 records). [2025-09-29T02:13:57.324022] [INFO ] [MAIN ] DEO: Successfully saved derivative data. [2025-09-29T02:13:57.335120] [INFO ] [MAIN ] Derivative Progress: 572/2211 symbols completed. DEO took 1.2s. Estimated remaining: 11m 29s. Rate: 142.8 symbols/min [2025-09-29T02:13:57.340442] [INFO ] [MAIN ] DFP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:57.341460] [DEBUG] [MAIN ] DELL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:57.348486] [INFO ] [MAIN ] DELL: Generated 1820 derivative records from 54515 primary records. [2025-09-29T02:13:57.348756] [DEBUG] [LOCAL ] DELL: Saving derivative data. [2025-09-29T02:13:57.377392] [DEBUG] [LOCAL ] DELL: Derivative data saved (1820 records). [2025-09-29T02:13:57.381297] [DEBUG] [LOCAL ] DFIN: Loaded 23650 existing records from primary storage. [2025-09-29T02:13:57.380453] [INFO ] [MAIN ] DELL: Successfully saved derivative data. [2025-09-29T02:13:57.381683] [INFO ] [MAIN ] DFIN: Loaded 23650 primary data records. [2025-09-29T02:13:57.385937] [INFO ] [MAIN ] Derivative Progress: 573/2211 symbols completed. DELL took 1.3s. Estimated remaining: 11m 27s. Rate: 143.0 symbols/min [2025-09-29T02:13:57.391682] [INFO ] [MAIN ] DG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:57.441222] [DEBUG] [LOCAL ] DFP: Loaded 11771 existing records from primary storage. [2025-09-29T02:13:57.463567] [INFO ] [MAIN ] DFP: Loaded 11771 primary data records. [2025-09-29T02:13:58.136574] [DEBUG] [LOCAL ] DG: Loaded 54068 existing records from primary storage. [2025-09-29T02:13:58.137268] [INFO ] [MAIN ] DG: Loaded 54068 primary data records. [2025-09-29T02:13:58.531618] [DEBUG] [MAIN ] DFIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:58.533453] [INFO ] [MAIN ] DFIN: Generated 1820 derivative records from 23650 primary records. [2025-09-29T02:13:58.533569] [DEBUG] [LOCAL ] DFIN: Saving derivative data. [2025-09-29T02:13:58.548303] [DEBUG] [MAIN ] DFP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:58.550113] [INFO ] [MAIN ] DFP: Generated 1820 derivative records from 11771 primary records. [2025-09-29T02:13:58.550542] [DEBUG] [LOCAL ] DFP: Saving derivative data. [2025-09-29T02:13:58.569680] [DEBUG] [LOCAL ] DFIN: Derivative data saved (1820 records). [2025-09-29T02:13:58.570454] [INFO ] [MAIN ] DFIN: Successfully saved derivative data. [2025-09-29T02:13:58.581550] [INFO ] [MAIN ] Derivative Progress: 574/2211 symbols completed. DFIN took 1.3s. Estimated remaining: 11m 29s. Rate: 142.5 symbols/min [2025-09-29T02:13:58.584805] [INFO ] [MAIN ] DGX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:58.592454] [DEBUG] [LOCAL ] DFP: Derivative data saved (1820 records). [2025-09-29T02:13:58.593034] [INFO ] [MAIN ] DFP: Successfully saved derivative data. [2025-09-29T02:13:58.596258] [INFO ] [MAIN ] Derivative Progress: 575/2211 symbols completed. DFP took 1.3s. Estimated remaining: 11m 28s. Rate: 142.8 symbols/min [2025-09-29T02:13:58.597274] [INFO ] [MAIN ] DHF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:58.620422] [DEBUG] [MAIN ] DG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:58.621531] [INFO ] [MAIN ] DG: Generated 1820 derivative records from 54068 primary records. [2025-09-29T02:13:58.621786] [DEBUG] [LOCAL ] DG: Saving derivative data. [2025-09-29T02:13:58.644559] [DEBUG] [LOCAL ] DG: Derivative data saved (1820 records). [2025-09-29T02:13:58.644830] [INFO ] [MAIN ] DG: Successfully saved derivative data. [2025-09-29T02:13:58.647985] [INFO ] [MAIN ] Derivative Progress: 576/2211 symbols completed. DG took 1.3s. Estimated remaining: 11m 26s. Rate: 143.0 symbols/min [2025-09-29T02:13:58.648318] [INFO ] [MAIN ] DHI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:58.666721] [DEBUG] [LOCAL ] DHF: Loaded 20835 existing records from primary storage. [2025-09-29T02:13:58.667265] [INFO ] [MAIN ] DHF: Loaded 20835 primary data records. [2025-09-29T02:13:58.797576] [DEBUG] [LOCAL ] DGX: Loaded 45736 existing records from primary storage. [2025-09-29T02:13:58.808819] [INFO ] [MAIN ] DGX: Loaded 45736 primary data records. [2025-09-29T02:13:59.386784] [DEBUG] [LOCAL ] DHI: Loaded 54147 existing records from primary storage. [2025-09-29T02:13:59.389469] [INFO ] [MAIN ] DHI: Loaded 54147 primary data records. [2025-09-29T02:13:59.786297] [DEBUG] [MAIN ] DHF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:59.787400] [INFO ] [MAIN ] DHF: Generated 1820 derivative records from 20835 primary records. [2025-09-29T02:13:59.787727] [DEBUG] [LOCAL ] DHF: Saving derivative data. [2025-09-29T02:13:59.825818] [DEBUG] [LOCAL ] DHF: Derivative data saved (1820 records). [2025-09-29T02:13:59.826264] [DEBUG] [MAIN ] DGX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:59.826682] [INFO ] [MAIN ] DHF: Successfully saved derivative data. [2025-09-29T02:13:59.829922] [INFO ] [MAIN ] Derivative Progress: 577/2211 symbols completed. DHF took 1.2s. Estimated remaining: 11m 28s. Rate: 142.5 symbols/min [2025-09-29T02:13:59.831157] [INFO ] [MAIN ] DGX: Generated 1820 derivative records from 45736 primary records. [2025-09-29T02:13:59.831388] [DEBUG] [LOCAL ] DGX: Saving derivative data. [2025-09-29T02:13:59.831592] [INFO ] [MAIN ] DHR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:59.855331] [DEBUG] [LOCAL ] DGX: Derivative data saved (1820 records). [2025-09-29T02:13:59.855520] [INFO ] [MAIN ] DGX: Successfully saved derivative data. [2025-09-29T02:13:59.858784] [INFO ] [MAIN ] Derivative Progress: 578/2211 symbols completed. DGX took 1.3s. Estimated remaining: 11m 26s. Rate: 142.8 symbols/min [2025-09-29T02:13:59.859491] [INFO ] [MAIN ] DHT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:59.878701] [DEBUG] [MAIN ] DHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:13:59.879789] [INFO ] [MAIN ] DHI: Generated 1820 derivative records from 54147 primary records. [2025-09-29T02:13:59.879917] [DEBUG] [LOCAL ] DHI: Saving derivative data. [2025-09-29T02:13:59.898495] [DEBUG] [LOCAL ] DHI: Derivative data saved (1820 records). [2025-09-29T02:13:59.898813] [INFO ] [MAIN ] DHI: Successfully saved derivative data. [2025-09-29T02:13:59.901751] [INFO ] [MAIN ] Derivative Progress: 579/2211 symbols completed. DHI took 1.3s. Estimated remaining: 11m 25s. Rate: 143.0 symbols/min [2025-09-29T02:13:59.902208] [INFO ] [MAIN ] DHX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:13:59.948402] [DEBUG] [LOCAL ] DHX: Loaded 13404 existing records from primary storage. [2025-09-29T02:13:59.948627] [INFO ] [MAIN ] DHX: Loaded 13404 primary data records. [2025-09-29T02:14:00.076896] [DEBUG] [LOCAL ] DHR: Loaded 54139 existing records from primary storage. [2025-09-29T02:14:00.107000] [DEBUG] [LOCAL ] DHT: Loaded 48583 existing records from primary storage. [2025-09-29T02:14:00.107525] [INFO ] [MAIN ] DHT: Loaded 48583 primary data records. [2025-09-29T02:14:00.107165] [INFO ] [MAIN ] DHR: Loaded 54139 primary data records. [2025-09-29T02:14:01.105838] [DEBUG] [MAIN ] DHX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:01.107259] [INFO ] [MAIN ] DHX: Generated 1820 derivative records from 13404 primary records. [2025-09-29T02:14:01.107486] [DEBUG] [LOCAL ] DHX: Saving derivative data. [2025-09-29T02:14:01.128850] [DEBUG] [LOCAL ] DHX: Derivative data saved (1820 records). [2025-09-29T02:14:01.129124] [INFO ] [MAIN ] DHX: Successfully saved derivative data. [2025-09-29T02:14:01.131111] [INFO ] [MAIN ] Derivative Progress: 580/2211 symbols completed. DHX took 1.2s. Estimated remaining: 11m 27s. Rate: 142.5 symbols/min [2025-09-29T02:14:01.139896] [INFO ] [MAIN ] DIAX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:01.148250] [DEBUG] [MAIN ] DHT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:01.150843] [INFO ] [MAIN ] DHT: Generated 1820 derivative records from 48583 primary records. [2025-09-29T02:14:01.151132] [DEBUG] [LOCAL ] DHT: Saving derivative data. [2025-09-29T02:14:01.165692] [DEBUG] [MAIN ] DHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:01.175581] [INFO ] [MAIN ] DHR: Generated 1820 derivative records from 54139 primary records. [2025-09-29T02:14:01.184151] [DEBUG] [LOCAL ] DHR: Saving derivative data. [2025-09-29T02:14:01.188008] [DEBUG] [LOCAL ] DHT: Derivative data saved (1820 records). [2025-09-29T02:14:01.188634] [INFO ] [MAIN ] DHT: Successfully saved derivative data. [2025-09-29T02:14:01.200737] [INFO ] [MAIN ] Derivative Progress: 581/2211 symbols completed. DHT took 1.3s. Estimated remaining: 11m 25s. Rate: 142.7 symbols/min [2025-09-29T02:14:01.213460] [INFO ] [MAIN ] DIN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:01.216434] [DEBUG] [LOCAL ] DHR: Derivative data saved (1820 records). [2025-09-29T02:14:01.217763] [INFO ] [MAIN ] DHR: Successfully saved derivative data. [2025-09-29T02:14:01.221121] [INFO ] [MAIN ] Derivative Progress: 582/2211 symbols completed. DHR took 1.4s. Estimated remaining: 11m 24s. Rate: 143.0 symbols/min [2025-09-29T02:14:01.217040] [DEBUG] [LOCAL ] DIAX: Loaded 12780 existing records from primary storage. [2025-09-29T02:14:01.221598] [INFO ] [MAIN ] DINO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:01.221829] [INFO ] [MAIN ] DIAX: Loaded 12780 primary data records. [2025-09-29T02:14:01.614899] [DEBUG] [LOCAL ] DIN: Loaded 37823 existing records from primary storage. [2025-09-29T02:14:01.615302] [INFO ] [MAIN ] DIN: Loaded 37823 primary data records. [2025-09-29T02:14:01.726275] [DEBUG] [LOCAL ] DINO: Loaded 53729 existing records from primary storage. [2025-09-29T02:14:01.744532] [INFO ] [MAIN ] DINO: Loaded 53729 primary data records. [2025-09-29T02:14:02.215973] [DEBUG] [MAIN ] DIAX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:02.343559] [INFO ] [MAIN ] DIAX: Generated 1820 derivative records from 12780 primary records. [2025-09-29T02:14:02.345032] [DEBUG] [LOCAL ] DIAX: Saving derivative data. [2025-09-29T02:14:02.365562] [DEBUG] [LOCAL ] DIAX: Derivative data saved (1820 records). [2025-09-29T02:14:02.367018] [INFO ] [MAIN ] DIAX: Successfully saved derivative data. [2025-09-29T02:14:02.370054] [INFO ] [MAIN ] Derivative Progress: 583/2211 symbols completed. DIAX took 1.2s. Estimated remaining: 11m 25s. Rate: 142.5 symbols/min [2025-09-29T02:14:02.389602] [DEBUG] [MAIN ] DIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:02.390585] [INFO ] [MAIN ] DIN: Generated 1820 derivative records from 37823 primary records. [2025-09-29T02:14:02.390883] [DEBUG] [LOCAL ] DIN: Saving derivative data. [2025-09-29T02:14:02.410712] [DEBUG] [LOCAL ] DIN: Derivative data saved (1820 records). [2025-09-29T02:14:02.423899] [DEBUG] [MAIN ] DINO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:02.423964] [INFO ] [MAIN ] DIN: Successfully saved derivative data. [2025-09-29T02:14:02.424916] [INFO ] [MAIN ] DINO: Generated 1820 derivative records from 53729 primary records. [2025-09-29T02:14:02.427463] [INFO ] [MAIN ] Derivative Progress: 584/2211 symbols completed. DIN took 1.2s. Estimated remaining: 11m 24s. Rate: 142.7 symbols/min [2025-09-29T02:14:02.427575] [DEBUG] [LOCAL ] DINO: Saving derivative data. [2025-09-29T02:14:02.443852] [DEBUG] [LOCAL ] DINO: Derivative data saved (1820 records). [2025-09-29T02:14:02.443942] [INFO ] [MAIN ] DINO: Successfully saved derivative data. [2025-09-29T02:14:02.446987] [INFO ] [MAIN ] Derivative Progress: 585/2211 symbols completed. DINO took 1.2s. Estimated remaining: 11m 22s. Rate: 143.0 symbols/min [2025-09-29T02:14:02.447518] [INFO ] [MAIN ] DKL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:02.447443] [INFO ] [MAIN ] DIS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:02.447723] [INFO ] [MAIN ] DK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:02.472477] [DEBUG] [LOCAL ] DKL: Loaded 19229 existing records from primary storage. [2025-09-29T02:14:02.472706] [INFO ] [MAIN ] DKL: Loaded 19229 primary data records. [2025-09-29T02:14:02.887531] [DEBUG] [LOCAL ] DK: Loaded 50093 existing records from primary storage. [2025-09-29T02:14:02.887949] [INFO ] [MAIN ] DK: Loaded 50093 primary data records. [2025-09-29T02:14:02.913247] [DEBUG] [LOCAL ] DIS: Loaded 54568 existing records from primary storage. [2025-09-29T02:14:02.925923] [INFO ] [MAIN ] DIS: Loaded 54568 primary data records. [2025-09-29T02:14:03.573769] [DEBUG] [MAIN ] DKL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:03.575227] [INFO ] [MAIN ] DKL: Generated 1820 derivative records from 19229 primary records. [2025-09-29T02:14:03.577017] [DEBUG] [LOCAL ] DKL: Saving derivative data. [2025-09-29T02:14:03.595991] [DEBUG] [LOCAL ] DKL: Derivative data saved (1820 records). [2025-09-29T02:14:03.596576] [INFO ] [MAIN ] DKL: Successfully saved derivative data. [2025-09-29T02:14:03.599370] [INFO ] [MAIN ] Derivative Progress: 586/2211 symbols completed. DKL took 1.2s. Estimated remaining: 11m 24s. Rate: 142.5 symbols/min [2025-09-29T02:14:03.600148] [INFO ] [MAIN ] DKS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:03.619988] [DEBUG] [MAIN ] DK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:03.634076] [INFO ] [MAIN ] DK: Generated 1820 derivative records from 50093 primary records. [2025-09-29T02:14:03.634739] [DEBUG] [LOCAL ] DK: Saving derivative data. [2025-09-29T02:14:03.634474] [DEBUG] [MAIN ] DIS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:03.636415] [INFO ] [MAIN ] DIS: Generated 1820 derivative records from 54568 primary records. [2025-09-29T02:14:03.636869] [DEBUG] [LOCAL ] DIS: Saving derivative data. [2025-09-29T02:14:03.672573] [DEBUG] [LOCAL ] DIS: Derivative data saved (1820 records). [2025-09-29T02:14:03.673490] [INFO ] [MAIN ] DIS: Successfully saved derivative data. [2025-09-29T02:14:03.677850] [INFO ] [MAIN ] Derivative Progress: 587/2211 symbols completed. DIS took 1.2s. Estimated remaining: 11m 23s. Rate: 142.7 symbols/min [2025-09-29T02:14:03.678611] [INFO ] [MAIN ] DLB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:03.680666] [DEBUG] [LOCAL ] DK: Derivative data saved (1820 records). [2025-09-29T02:14:03.680886] [INFO ] [MAIN ] DK: Successfully saved derivative data. [2025-09-29T02:14:03.683480] [INFO ] [MAIN ] Derivative Progress: 588/2211 symbols completed. DK took 1.2s. Estimated remaining: 11m 21s. Rate: 143.0 symbols/min [2025-09-29T02:14:03.683946] [INFO ] [MAIN ] DLNG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:03.707820] [DEBUG] [LOCAL ] DLNG: Loaded 6276 existing records from primary storage. [2025-09-29T02:14:03.708069] [INFO ] [MAIN ] DLNG: Loaded 6276 primary data records. [2025-09-29T02:14:03.850867] [DEBUG] [LOCAL ] DKS: Loaded 50579 existing records from primary storage. [2025-09-29T02:14:03.852737] [INFO ] [MAIN ] DKS: Loaded 50579 primary data records. [2025-09-29T02:14:03.908471] [DEBUG] [LOCAL ] DLB: Loaded 32601 existing records from primary storage. [2025-09-29T02:14:04.029053] [INFO ] [MAIN ] DLB: Loaded 32601 primary data records. [2025-09-29T02:14:04.956702] [DEBUG] [MAIN ] DLNG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:04.958279] [INFO ] [MAIN ] DLNG: Generated 1820 derivative records from 6276 primary records. [2025-09-29T02:14:04.960199] [DEBUG] [LOCAL ] DLNG: Saving derivative data. [2025-09-29T02:14:04.999668] [DEBUG] [LOCAL ] DLNG: Derivative data saved (1820 records). [2025-09-29T02:14:05.008733] [INFO ] [MAIN ] DLNG: Successfully saved derivative data. [2025-09-29T02:14:05.011787] [INFO ] [MAIN ] Derivative Progress: 589/2211 symbols completed. DLNG took 1.3s. Estimated remaining: 11m 23s. Rate: 142.5 symbols/min [2025-09-29T02:14:05.021123] [DEBUG] [MAIN ] DKS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:05.022579] [INFO ] [MAIN ] DLR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:05.022365] [INFO ] [MAIN ] DKS: Generated 1820 derivative records from 50579 primary records. [2025-09-29T02:14:05.023879] [DEBUG] [LOCAL ] DKS: Saving derivative data. [2025-09-29T02:14:05.053873] [DEBUG] [LOCAL ] DKS: Derivative data saved (1820 records). [2025-09-29T02:14:05.063987] [INFO ] [MAIN ] DKS: Successfully saved derivative data. [2025-09-29T02:14:05.067314] [INFO ] [MAIN ] Derivative Progress: 590/2211 symbols completed. DKS took 1.5s. Estimated remaining: 11m 22s. Rate: 142.7 symbols/min [2025-09-29T02:14:05.074421] [INFO ] [MAIN ] DLX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:05.078209] [DEBUG] [MAIN ] DLB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:05.079328] [INFO ] [MAIN ] DLB: Generated 1820 derivative records from 32601 primary records. [2025-09-29T02:14:05.079585] [DEBUG] [LOCAL ] DLB: Saving derivative data. [2025-09-29T02:14:05.105391] [DEBUG] [LOCAL ] DLB: Derivative data saved (1820 records). [2025-09-29T02:14:05.105809] [INFO ] [MAIN ] DLB: Successfully saved derivative data. [2025-09-29T02:14:05.109899] [INFO ] [MAIN ] Derivative Progress: 591/2211 symbols completed. DLB took 1.4s. Estimated remaining: 11m 20s. Rate: 142.9 symbols/min [2025-09-29T02:14:05.110284] [INFO ] [MAIN ] DLY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:05.163775] [DEBUG] [LOCAL ] DLX: Loaded 29284 existing records from primary storage. [2025-09-29T02:14:05.170385] [INFO ] [MAIN ] DLX: Loaded 29284 primary data records. [2025-09-29T02:14:05.253251] [DEBUG] [LOCAL ] DLY: Loaded 19800 existing records from primary storage. [2025-09-29T02:14:05.269980] [DEBUG] [LOCAL ] DLR: Loaded 51825 existing records from primary storage. [2025-09-29T02:14:05.284209] [INFO ] [MAIN ] DLY: Loaded 19800 primary data records. [2025-09-29T02:14:05.284399] [INFO ] [MAIN ] DLR: Loaded 51825 primary data records. [2025-09-29T02:14:06.312627] [DEBUG] [MAIN ] DLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:06.314131] [INFO ] [MAIN ] DLX: Generated 1820 derivative records from 29284 primary records. [2025-09-29T02:14:06.314497] [DEBUG] [LOCAL ] DLX: Saving derivative data. [2025-09-29T02:14:06.336049] [DEBUG] [LOCAL ] DLX: Derivative data saved (1820 records). [2025-09-29T02:14:06.337204] [INFO ] [MAIN ] DLX: Successfully saved derivative data. [2025-09-29T02:14:06.353277] [DEBUG] [MAIN ] DLR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:06.352812] [INFO ] [MAIN ] Derivative Progress: 592/2211 symbols completed. DLX took 1.3s. Estimated remaining: 11m 22s. Rate: 142.4 symbols/min [2025-09-29T02:14:06.367697] [INFO ] [MAIN ] DLR: Generated 1820 derivative records from 51825 primary records. [2025-09-29T02:14:06.368223] [DEBUG] [LOCAL ] DLR: Saving derivative data. [2025-09-29T02:14:06.368044] [DEBUG] [MAIN ] DLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:06.368341] [INFO ] [MAIN ] DMA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:06.370046] [INFO ] [MAIN ] DLY: Generated 1820 derivative records from 19800 primary records. [2025-09-29T02:14:06.384893] [DEBUG] [LOCAL ] DLY: Saving derivative data. [2025-09-29T02:14:06.389019] [DEBUG] [LOCAL ] DLR: Derivative data saved (1820 records). [2025-09-29T02:14:06.389849] [INFO ] [MAIN ] DLR: Successfully saved derivative data. [2025-09-29T02:14:06.399967] [INFO ] [MAIN ] Derivative Progress: 593/2211 symbols completed. DLR took 1.4s. Estimated remaining: 11m 21s. Rate: 142.6 symbols/min [2025-09-29T02:14:06.410909] [INFO ] [MAIN ] DMB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:06.411748] [DEBUG] [LOCAL ] DMA: Loaded 4604 existing records from primary storage. [2025-09-29T02:14:06.412242] [INFO ] [MAIN ] DMA: Loaded 4604 primary data records. [2025-09-29T02:14:06.425971] [DEBUG] [LOCAL ] DLY: Derivative data saved (1820 records). [2025-09-29T02:14:06.461072] [INFO ] [MAIN ] DLY: Successfully saved derivative data. [2025-09-29T02:14:06.493099] [INFO ] [MAIN ] Derivative Progress: 594/2211 symbols completed. DLY took 1.4s. Estimated remaining: 11m 19s. Rate: 142.8 symbols/min [2025-09-29T02:14:06.514232] [INFO ] [MAIN ] DMO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:06.597129] [DEBUG] [LOCAL ] DMB: Loaded 10254 existing records from primary storage. [2025-09-29T02:14:06.625386] [INFO ] [MAIN ] DMB: Loaded 10254 primary data records. [2025-09-29T02:14:06.764255] [DEBUG] [LOCAL ] DMO: Loaded 9981 existing records from primary storage. [2025-09-29T02:14:06.777420] [INFO ] [MAIN ] DMO: Loaded 9981 primary data records. [2025-09-29T02:14:07.509891] [DEBUG] [MAIN ] DMA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:07.512125] [INFO ] [MAIN ] DMA: Generated 1820 derivative records from 4604 primary records. [2025-09-29T02:14:07.512816] [DEBUG] [LOCAL ] DMA: Saving derivative data. [2025-09-29T02:14:07.532584] [DEBUG] [LOCAL ] DMA: Derivative data saved (1820 records). [2025-09-29T02:14:07.534966] [INFO ] [MAIN ] DMA: Successfully saved derivative data. [2025-09-29T02:14:07.538031] [INFO ] [MAIN ] Derivative Progress: 595/2211 symbols completed. DMA took 1.2s. Estimated remaining: 11m 21s. Rate: 142.5 symbols/min [2025-09-29T02:14:07.538869] [INFO ] [MAIN ] DNA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:07.553333] [DEBUG] [MAIN ] DMB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:07.554195] [INFO ] [MAIN ] DMB: Generated 1820 derivative records from 10254 primary records. [2025-09-29T02:14:07.554400] [DEBUG] [LOCAL ] DMB: Saving derivative data. [2025-09-29T02:14:07.571809] [DEBUG] [LOCAL ] DMB: Derivative data saved (1820 records). [2025-09-29T02:14:07.574243] [INFO ] [MAIN ] DMB: Successfully saved derivative data. [2025-09-29T02:14:07.577405] [INFO ] [MAIN ] Derivative Progress: 596/2211 symbols completed. DMB took 1.2s. Estimated remaining: 11m 19s. Rate: 142.7 symbols/min [2025-09-29T02:14:07.577684] [INFO ] [MAIN ] DNOW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:07.592090] [DEBUG] [MAIN ] DMO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:07.593312] [INFO ] [MAIN ] DMO: Generated 1820 derivative records from 9981 primary records. [2025-09-29T02:14:07.593560] [DEBUG] [LOCAL ] DMO: Saving derivative data. [2025-09-29T02:14:07.621068] [DEBUG] [LOCAL ] DMO: Derivative data saved (1820 records). [2025-09-29T02:14:07.621308] [INFO ] [MAIN ] DMO: Successfully saved derivative data. [2025-09-29T02:14:07.624490] [INFO ] [MAIN ] Derivative Progress: 597/2211 symbols completed. DMO took 1.1s. Estimated remaining: 11m 18s. Rate: 142.9 symbols/min [2025-09-29T02:14:07.636380] [INFO ] [MAIN ] DNP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:07.670324] [DEBUG] [LOCAL ] DNA: Loaded 48990 existing records from primary storage. [2025-09-29T02:14:07.670629] [INFO ] [MAIN ] DNA: Loaded 48990 primary data records. [2025-09-29T02:14:07.829838] [DEBUG] [LOCAL ] DNOW: Loaded 44205 existing records from primary storage. [2025-09-29T02:14:07.862810] [INFO ] [MAIN ] DNOW: Loaded 44205 primary data records. [2025-09-29T02:14:07.842077] [DEBUG] [LOCAL ] DNP: Loaded 33786 existing records from primary storage. [2025-09-29T02:14:07.896288] [INFO ] [MAIN ] DNP: Loaded 33786 primary data records. [2025-09-29T02:14:08.763553] [DEBUG] [MAIN ] DNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:08.768112] [INFO ] [MAIN ] DNA: Generated 1820 derivative records from 48990 primary records. [2025-09-29T02:14:08.769265] [DEBUG] [LOCAL ] DNA: Saving derivative data. [2025-09-29T02:14:08.789101] [DEBUG] [LOCAL ] DNA: Derivative data saved (1820 records). [2025-09-29T02:14:08.790005] [INFO ] [MAIN ] DNA: Successfully saved derivative data. [2025-09-29T02:14:08.792991] [INFO ] [MAIN ] Derivative Progress: 598/2211 symbols completed. DNA took 1.3s. Estimated remaining: 11m 19s. Rate: 142.5 symbols/min [2025-09-29T02:14:08.824719] [DEBUG] [MAIN ] DNOW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:08.823969] [DEBUG] [MAIN ] DNP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:08.826298] [INFO ] [MAIN ] DNOW: Generated 1820 derivative records from 44205 primary records. [2025-09-29T02:14:08.825568] [INFO ] [MAIN ] DNP: Generated 1820 derivative records from 33786 primary records. [2025-09-29T02:14:08.826416] [DEBUG] [LOCAL ] DNOW: Saving derivative data. [2025-09-29T02:14:08.826514] [DEBUG] [LOCAL ] DNP: Saving derivative data. [2025-09-29T02:14:08.859095] [DEBUG] [LOCAL ] DNP: Derivative data saved (1820 records). [2025-09-29T02:14:08.859175] [DEBUG] [LOCAL ] DNOW: Derivative data saved (1820 records). [2025-09-29T02:14:08.859386] [INFO ] [MAIN ] DNOW: Successfully saved derivative data. [2025-09-29T02:14:08.859488] [INFO ] [MAIN ] DNP: Successfully saved derivative data. [2025-09-29T02:14:08.862439] [INFO ] [MAIN ] Derivative Progress: 599/2211 symbols completed. DNOW took 1.3s. Estimated remaining: 11m 18s. Rate: 142.7 symbols/min [2025-09-29T02:14:08.865783] [INFO ] [MAIN ] Derivative Progress: 600/2211 symbols completed. DNP took 1.2s. Estimated remaining: 11m 16s. Rate: 142.9 symbols/min [2025-09-29T02:14:08.866339] [INFO ] [MAIN ] DOCN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:08.866291] [INFO ] [MAIN ] DOC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:08.866390] [INFO ] [MAIN ] DOCS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:08.974823] [DEBUG] [LOCAL ] DOCN: Loaded 51245 existing records from primary storage. [2025-09-29T02:14:08.977862] [INFO ] [MAIN ] DOCN: Loaded 51245 primary data records. [2025-09-29T02:14:09.006245] [DEBUG] [LOCAL ] DOCS: Loaded 51956 existing records from primary storage. [2025-09-29T02:14:09.073151] [DEBUG] [LOCAL ] DOC: Loaded 54317 existing records from primary storage. [2025-09-29T02:14:09.057087] [INFO ] [MAIN ] DOCS: Loaded 51956 primary data records. [2025-09-29T02:14:09.087317] [INFO ] [MAIN ] DOC: Loaded 54317 primary data records. [2025-09-29T02:14:10.109574] [DEBUG] [MAIN ] DOCS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:10.117285] [DEBUG] [MAIN ] DOC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:10.117012] [DEBUG] [MAIN ] DOCN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:10.116107] [INFO ] [MAIN ] DOCS: Generated 1820 derivative records from 51956 primary records. [2025-09-29T02:14:10.117730] [DEBUG] [LOCAL ] DOCS: Saving derivative data. [2025-09-29T02:14:10.118458] [INFO ] [MAIN ] DOC: Generated 1820 derivative records from 54317 primary records. [2025-09-29T02:14:10.119630] [INFO ] [MAIN ] DOCN: Generated 1820 derivative records from 51245 primary records. [2025-09-29T02:14:10.119886] [DEBUG] [LOCAL ] DOC: Saving derivative data. [2025-09-29T02:14:10.119959] [DEBUG] [LOCAL ] DOCN: Saving derivative data. [2025-09-29T02:14:10.161243] [DEBUG] [LOCAL ] DOCS: Derivative data saved (1820 records). [2025-09-29T02:14:10.161412] [INFO ] [MAIN ] DOCS: Successfully saved derivative data. [2025-09-29T02:14:10.171378] [INFO ] [MAIN ] Derivative Progress: 601/2211 symbols completed. DOCS took 1.3s. Estimated remaining: 11m 18s. Rate: 142.4 symbols/min [2025-09-29T02:14:10.172619] [DEBUG] [LOCAL ] DOC: Derivative data saved (1820 records). [2025-09-29T02:14:10.177215] [INFO ] [MAIN ] DOLE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:10.174017] [INFO ] [MAIN ] DOC: Successfully saved derivative data. [2025-09-29T02:14:10.178691] [DEBUG] [LOCAL ] DOCN: Derivative data saved (1820 records). [2025-09-29T02:14:10.179404] [INFO ] [MAIN ] DOCN: Successfully saved derivative data. [2025-09-29T02:14:10.182731] [INFO ] [MAIN ] Derivative Progress: 602/2211 symbols completed. DOC took 1.3s. Estimated remaining: 11m 17s. Rate: 142.6 symbols/min [2025-09-29T02:14:10.185955] [INFO ] [MAIN ] Derivative Progress: 603/2211 symbols completed. DOCN took 1.3s. Estimated remaining: 11m 15s. Rate: 142.9 symbols/min [2025-09-29T02:14:10.183119] [INFO ] [MAIN ] DOUG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:10.186972] [INFO ] [MAIN ] DOV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:10.263898] [DEBUG] [LOCAL ] DOUG: Loaded 35254 existing records from primary storage. [2025-09-29T02:14:10.265473] [INFO ] [MAIN ] DOUG: Loaded 35254 primary data records. [2025-09-29T02:14:10.266618] [DEBUG] [LOCAL ] DOLE: Loaded 38568 existing records from primary storage. [2025-09-29T02:14:10.338115] [INFO ] [MAIN ] DOLE: Loaded 38568 primary data records. [2025-09-29T02:14:10.423126] [DEBUG] [LOCAL ] DOV: Loaded 46376 existing records from primary storage. [2025-09-29T02:14:10.448192] [INFO ] [MAIN ] DOV: Loaded 46376 primary data records. [2025-09-29T02:14:11.335873] [DEBUG] [MAIN ] DOUG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:11.337513] [INFO ] [MAIN ] DOUG: Generated 1820 derivative records from 35254 primary records. [2025-09-29T02:14:11.338270] [DEBUG] [LOCAL ] DOUG: Saving derivative data. [2025-09-29T02:14:11.370976] [DEBUG] [LOCAL ] DOUG: Derivative data saved (1820 records). [2025-09-29T02:14:11.371939] [DEBUG] [MAIN ] DOLE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:11.371605] [INFO ] [MAIN ] DOUG: Successfully saved derivative data. [2025-09-29T02:14:11.375259] [INFO ] [MAIN ] Derivative Progress: 604/2211 symbols completed. DOUG took 1.2s. Estimated remaining: 11m 17s. Rate: 142.4 symbols/min [2025-09-29T02:14:11.376284] [INFO ] [MAIN ] DOLE: Generated 1820 derivative records from 38568 primary records. [2025-09-29T02:14:11.376503] [DEBUG] [LOCAL ] DOLE: Saving derivative data. [2025-09-29T02:14:11.376709] [INFO ] [MAIN ] DOW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:11.398056] [DEBUG] [LOCAL ] DOLE: Derivative data saved (1820 records). [2025-09-29T02:14:11.406335] [INFO ] [MAIN ] DOLE: Successfully saved derivative data. [2025-09-29T02:14:11.414764] [INFO ] [MAIN ] Derivative Progress: 605/2211 symbols completed. DOLE took 1.2s. Estimated remaining: 11m 16s. Rate: 142.6 symbols/min [2025-09-29T02:14:11.415312] [DEBUG] [MAIN ] DOV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:11.415509] [INFO ] [MAIN ] DPG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:11.416430] [INFO ] [MAIN ] DOV: Generated 1820 derivative records from 46376 primary records. [2025-09-29T02:14:11.417318] [DEBUG] [LOCAL ] DOV: Saving derivative data. [2025-09-29T02:14:11.438813] [DEBUG] [LOCAL ] DOV: Derivative data saved (1820 records). [2025-09-29T02:14:11.438959] [INFO ] [MAIN ] DOV: Successfully saved derivative data. [2025-09-29T02:14:11.442023] [INFO ] [MAIN ] Derivative Progress: 606/2211 symbols completed. DOV took 1.3s. Estimated remaining: 11m 14s. Rate: 142.9 symbols/min [2025-09-29T02:14:11.442326] [INFO ] [MAIN ] DQ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:11.449968] [DEBUG] [LOCAL ] DPG: Loaded 13683 existing records from primary storage. [2025-09-29T02:14:11.450135] [INFO ] [MAIN ] DPG: Loaded 13683 primary data records. [2025-09-29T02:14:11.854820] [DEBUG] [LOCAL ] DOW: Loaded 54513 existing records from primary storage. [2025-09-29T02:14:11.856207] [INFO ] [MAIN ] DOW: Loaded 54513 primary data records. [2025-09-29T02:14:11.923081] [DEBUG] [LOCAL ] DQ: Loaded 43880 existing records from primary storage. [2025-09-29T02:14:11.959806] [INFO ] [MAIN ] DQ: Loaded 43880 primary data records. [2025-09-29T02:14:12.449738] [DEBUG] [MAIN ] DPG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:12.562578] [INFO ] [MAIN ] DPG: Generated 1820 derivative records from 13683 primary records. [2025-09-29T02:14:12.578786] [DEBUG] [LOCAL ] DPG: Saving derivative data. [2025-09-29T02:14:12.601019] [DEBUG] [LOCAL ] DPG: Derivative data saved (1820 records). [2025-09-29T02:14:12.602072] [INFO ] [MAIN ] DPG: Successfully saved derivative data. [2025-09-29T02:14:12.605442] [INFO ] [MAIN ] Derivative Progress: 607/2211 symbols completed. DPG took 1.2s. Estimated remaining: 11m 16s. Rate: 142.5 symbols/min [2025-09-29T02:14:12.606343] [INFO ] [MAIN ] DRD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:12.627149] [DEBUG] [MAIN ] DOW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:12.628017] [INFO ] [MAIN ] DOW: Generated 1820 derivative records from 54513 primary records. [2025-09-29T02:14:12.628224] [DEBUG] [LOCAL ] DOW: Saving derivative data. [2025-09-29T02:14:12.647129] [DEBUG] [LOCAL ] DOW: Derivative data saved (1820 records). [2025-09-29T02:14:12.649026] [INFO ] [MAIN ] DOW: Successfully saved derivative data. [2025-09-29T02:14:12.651580] [INFO ] [MAIN ] Derivative Progress: 608/2211 symbols completed. DOW took 1.3s. Estimated remaining: 11m 14s. Rate: 142.7 symbols/min [2025-09-29T02:14:12.652682] [INFO ] [MAIN ] DRH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:12.666686] [DEBUG] [MAIN ] DQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:12.667595] [INFO ] [MAIN ] DQ: Generated 1820 derivative records from 43880 primary records. [2025-09-29T02:14:12.667924] [DEBUG] [LOCAL ] DQ: Saving derivative data. [2025-09-29T02:14:12.695277] [DEBUG] [LOCAL ] DQ: Derivative data saved (1820 records). [2025-09-29T02:14:12.695678] [INFO ] [MAIN ] DQ: Successfully saved derivative data. [2025-09-29T02:14:12.698794] [INFO ] [MAIN ] Derivative Progress: 609/2211 symbols completed. DQ took 1.3s. Estimated remaining: 11m 13s. Rate: 142.9 symbols/min [2025-09-29T02:14:12.700359] [INFO ] [MAIN ] DRI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:12.719453] [DEBUG] [LOCAL ] DRD: Loaded 37397 existing records from primary storage. [2025-09-29T02:14:12.719848] [INFO ] [MAIN ] DRD: Loaded 37397 primary data records. [2025-09-29T02:14:13.108007] [DEBUG] [LOCAL ] DRH: Loaded 51205 existing records from primary storage. [2025-09-29T02:14:13.108345] [INFO ] [MAIN ] DRH: Loaded 51205 primary data records. [2025-09-29T02:14:13.240684] [DEBUG] [LOCAL ] DRI: Loaded 48554 existing records from primary storage. [2025-09-29T02:14:13.245502] [INFO ] [MAIN ] DRI: Loaded 48554 primary data records. [2025-09-29T02:14:13.875910] [DEBUG] [MAIN ] DRD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:13.878052] [INFO ] [MAIN ] DRD: Generated 1820 derivative records from 37397 primary records. [2025-09-29T02:14:13.879353] [DEBUG] [LOCAL ] DRD: Saving derivative data. [2025-09-29T02:14:13.899690] [DEBUG] [LOCAL ] DRD: Derivative data saved (1820 records). [2025-09-29T02:14:13.901403] [INFO ] [MAIN ] DRD: Successfully saved derivative data. [2025-09-29T02:14:13.904344] [INFO ] [MAIN ] Derivative Progress: 610/2211 symbols completed. DRD took 1.3s. Estimated remaining: 11m 14s. Rate: 142.4 symbols/min [2025-09-29T02:14:13.906334] [INFO ] [MAIN ] DRLL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:13.922918] [DEBUG] [MAIN ] DRH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:13.923886] [INFO ] [MAIN ] DRH: Generated 1820 derivative records from 51205 primary records. [2025-09-29T02:14:13.924182] [DEBUG] [LOCAL ] DRH: Saving derivative data. [2025-09-29T02:14:13.946529] [DEBUG] [LOCAL ] DRH: Derivative data saved (1820 records). [2025-09-29T02:14:13.951316] [DEBUG] [LOCAL ] DRLL: Loaded 9737 existing records from primary storage. [2025-09-29T02:14:13.964755] [DEBUG] [MAIN ] DRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:13.965095] [INFO ] [MAIN ] DRLL: Loaded 9737 primary data records. [2025-09-29T02:14:13.964933] [INFO ] [MAIN ] DRH: Successfully saved derivative data. [2025-09-29T02:14:13.968255] [INFO ] [MAIN ] Derivative Progress: 611/2211 symbols completed. DRH took 1.3s. Estimated remaining: 11m 13s. Rate: 142.6 symbols/min [2025-09-29T02:14:13.969219] [INFO ] [MAIN ] DRI: Generated 1820 derivative records from 48554 primary records. [2025-09-29T02:14:13.974501] [INFO ] [MAIN ] DSL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:13.974779] [DEBUG] [LOCAL ] DRI: Saving derivative data. [2025-09-29T02:14:14.062681] [DEBUG] [LOCAL ] DRI: Derivative data saved (1820 records). [2025-09-29T02:14:14.081716] [INFO ] [MAIN ] DRI: Successfully saved derivative data. [2025-09-29T02:14:14.108522] [INFO ] [MAIN ] Derivative Progress: 612/2211 symbols completed. DRI took 1.4s. Estimated remaining: 11m 12s. Rate: 142.8 symbols/min [2025-09-29T02:14:14.113345] [INFO ] [MAIN ] DSM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:14.198736] [DEBUG] [LOCAL ] DSL: Loaded 28651 existing records from primary storage. [2025-09-29T02:14:14.346685] [INFO ] [MAIN ] DSL: Loaded 28651 primary data records. [2025-09-29T02:14:14.411087] [DEBUG] [LOCAL ] DSM: Loaded 15895 existing records from primary storage. [2025-09-29T02:14:14.440804] [INFO ] [MAIN ] DSM: Loaded 15895 primary data records. [2025-09-29T02:14:15.088351] [DEBUG] [MAIN ] DRLL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:15.090169] [INFO ] [MAIN ] DRLL: Generated 1820 derivative records from 9737 primary records. [2025-09-29T02:14:15.091309] [DEBUG] [LOCAL ] DRLL: Saving derivative data. [2025-09-29T02:14:15.111030] [DEBUG] [LOCAL ] DRLL: Derivative data saved (1820 records). [2025-09-29T02:14:15.113900] [INFO ] [MAIN ] DRLL: Successfully saved derivative data. [2025-09-29T02:14:15.117235] [INFO ] [MAIN ] Derivative Progress: 613/2211 symbols completed. DRLL took 1.2s. Estimated remaining: 11m 13s. Rate: 142.5 symbols/min [2025-09-29T02:14:15.132527] [DEBUG] [MAIN ] DSL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:15.133712] [INFO ] [MAIN ] DSL: Generated 1820 derivative records from 28651 primary records. [2025-09-29T02:14:15.133983] [DEBUG] [LOCAL ] DSL: Saving derivative data. [2025-09-29T02:14:15.165262] [DEBUG] [MAIN ] DSM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:15.167324] [INFO ] [MAIN ] DSM: Generated 1820 derivative records from 15895 primary records. [2025-09-29T02:14:15.167957] [DEBUG] [LOCAL ] DSM: Saving derivative data. [2025-09-29T02:14:15.171131] [DEBUG] [LOCAL ] DSL: Derivative data saved (1820 records). [2025-09-29T02:14:15.178820] [INFO ] [MAIN ] DSL: Successfully saved derivative data. [2025-09-29T02:14:15.184670] [INFO ] [MAIN ] Derivative Progress: 614/2211 symbols completed. DSL took 1.2s. Estimated remaining: 11m 12s. Rate: 142.7 symbols/min [2025-09-29T02:14:15.189216] [DEBUG] [LOCAL ] DSM: Derivative data saved (1820 records). [2025-09-29T02:14:15.189304] [INFO ] [MAIN ] DSM: Successfully saved derivative data. [2025-09-29T02:14:15.191884] [INFO ] [MAIN ] Derivative Progress: 615/2211 symbols completed. DSM took 1.1s. Estimated remaining: 11m 10s. Rate: 142.9 symbols/min [2025-09-29T02:14:15.192492] [INFO ] [MAIN ] DSX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:15.192359] [INFO ] [MAIN ] DSMC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:15.192552] [INFO ] [MAIN ] DSU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:15.198312] [DEBUG] [LOCAL ] DSMC: Loaded 1974 existing records from primary storage. [2025-09-29T02:14:15.198719] [INFO ] [MAIN ] DSMC: Loaded 1974 primary data records. [2025-09-29T02:14:15.440118] [DEBUG] [LOCAL ] DSU: Loaded 22684 existing records from primary storage. [2025-09-29T02:14:15.438495] [DEBUG] [LOCAL ] DSX: Loaded 24642 existing records from primary storage. [2025-09-29T02:14:15.550607] [INFO ] [MAIN ] DSU: Loaded 22684 primary data records. [2025-09-29T02:14:15.555998] [INFO ] [MAIN ] DSX: Loaded 24642 primary data records. [2025-09-29T02:14:16.334217] [DEBUG] [MAIN ] DSMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:16.335468] [INFO ] [MAIN ] DSMC: Generated 1820 derivative records from 1974 primary records. [2025-09-29T02:14:16.336243] [DEBUG] [LOCAL ] DSMC: Saving derivative data. [2025-09-29T02:14:16.355090] [DEBUG] [LOCAL ] DSMC: Derivative data saved (1820 records). [2025-09-29T02:14:16.355542] [INFO ] [MAIN ] DSMC: Successfully saved derivative data. [2025-09-29T02:14:16.358356] [INFO ] [MAIN ] Derivative Progress: 616/2211 symbols completed. DSMC took 1.2s. Estimated remaining: 11m 12s. Rate: 142.5 symbols/min [2025-09-29T02:14:16.358917] [INFO ] [MAIN ] DT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:16.380002] [DEBUG] [MAIN ] DSX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:16.382488] [INFO ] [MAIN ] DSX: Generated 1820 derivative records from 24642 primary records. [2025-09-29T02:14:16.382899] [DEBUG] [LOCAL ] DSX: Saving derivative data. [2025-09-29T02:14:16.396539] [DEBUG] [MAIN ] DSU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:16.397597] [INFO ] [MAIN ] DSU: Generated 1820 derivative records from 22684 primary records. [2025-09-29T02:14:16.397999] [DEBUG] [LOCAL ] DSU: Saving derivative data. [2025-09-29T02:14:16.428269] [DEBUG] [LOCAL ] DSX: Derivative data saved (1820 records). [2025-09-29T02:14:16.430683] [INFO ] [MAIN ] DSX: Successfully saved derivative data. [2025-09-29T02:14:16.434685] [INFO ] [MAIN ] Derivative Progress: 617/2211 symbols completed. DSX took 1.2s. Estimated remaining: 11m 10s. Rate: 142.7 symbols/min [2025-09-29T02:14:16.431622] [DEBUG] [LOCAL ] DSU: Derivative data saved (1820 records). [2025-09-29T02:14:16.434913] [INFO ] [MAIN ] DTB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:16.435568] [INFO ] [MAIN ] DSU: Successfully saved derivative data. [2025-09-29T02:14:16.438335] [INFO ] [MAIN ] Derivative Progress: 618/2211 symbols completed. DSU took 1.2s. Estimated remaining: 11m 9s. Rate: 142.9 symbols/min [2025-09-29T02:14:16.453398] [INFO ] [MAIN ] DTE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:16.461870] [DEBUG] [LOCAL ] DTB: Loaded 4817 existing records from primary storage. [2025-09-29T02:14:16.462186] [INFO ] [MAIN ] DTB: Loaded 4817 primary data records. [2025-09-29T02:14:16.602564] [DEBUG] [LOCAL ] DT: Loaded 53708 existing records from primary storage. [2025-09-29T02:14:16.602804] [INFO ] [MAIN ] DT: Loaded 53708 primary data records. [2025-09-29T02:14:17.156259] [DEBUG] [LOCAL ] DTE: Loaded 48557 existing records from primary storage. [2025-09-29T02:14:17.173427] [INFO ] [MAIN ] DTE: Loaded 48557 primary data records. [2025-09-29T02:14:17.536382] [DEBUG] [MAIN ] DTB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:17.538793] [INFO ] [MAIN ] DTB: Generated 1820 derivative records from 4817 primary records. [2025-09-29T02:14:17.539314] [DEBUG] [LOCAL ] DTB: Saving derivative data. [2025-09-29T02:14:17.559366] [DEBUG] [LOCAL ] DTB: Derivative data saved (1820 records). [2025-09-29T02:14:17.560115] [INFO ] [MAIN ] DTB: Successfully saved derivative data. [2025-09-29T02:14:17.570319] [INFO ] [MAIN ] Derivative Progress: 619/2211 symbols completed. DTB took 1.1s. Estimated remaining: 11m 10s. Rate: 142.5 symbols/min [2025-09-29T02:14:17.577019] [INFO ] [MAIN ] DTG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:17.577294] [DEBUG] [MAIN ] DT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:17.579338] [INFO ] [MAIN ] DT: Generated 1820 derivative records from 53708 primary records. [2025-09-29T02:14:17.579929] [DEBUG] [LOCAL ] DT: Saving derivative data. [2025-09-29T02:14:17.603868] [DEBUG] [LOCAL ] DT: Derivative data saved (1820 records). [2025-09-29T02:14:17.604762] [INFO ] [MAIN ] DT: Successfully saved derivative data. [2025-09-29T02:14:17.608264] [INFO ] [MAIN ] Derivative Progress: 620/2211 symbols completed. DT took 1.2s. Estimated remaining: 11m 9s. Rate: 142.7 symbols/min [2025-09-29T02:14:17.612717] [INFO ] [MAIN ] DTM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:17.613208] [DEBUG] [LOCAL ] DTG: Loaded 5952 existing records from primary storage. [2025-09-29T02:14:17.614134] [INFO ] [MAIN ] DTG: Loaded 5952 primary data records. [2025-09-29T02:14:17.755162] [DEBUG] [MAIN ] DTE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:17.796692] [INFO ] [MAIN ] DTE: Generated 1820 derivative records from 48557 primary records. [2025-09-29T02:14:17.831752] [DEBUG] [LOCAL ] DTE: Saving derivative data. [2025-09-29T02:14:18.041408] [DEBUG] [LOCAL ] DTE: Derivative data saved (1820 records). [2025-09-29T02:14:18.059970] [INFO ] [MAIN ] DTE: Successfully saved derivative data. [2025-09-29T02:14:18.063298] [INFO ] [MAIN ] Derivative Progress: 621/2211 symbols completed. DTE took 1.6s. Estimated remaining: 11m 9s. Rate: 142.7 symbols/min [2025-09-29T02:14:18.065810] [INFO ] [MAIN ] DTW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:18.068797] [DEBUG] [LOCAL ] DTM: Loaded 45043 existing records from primary storage. [2025-09-29T02:14:18.069165] [INFO ] [MAIN ] DTM: Loaded 45043 primary data records. [2025-09-29T02:14:18.153301] [DEBUG] [LOCAL ] DTW: Loaded 4923 existing records from primary storage. [2025-09-29T02:14:18.172320] [INFO ] [MAIN ] DTW: Loaded 4923 primary data records. [2025-09-29T02:14:18.421017] [DEBUG] [MAIN ] DTG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:18.427382] [INFO ] [MAIN ] DTG: Generated 1820 derivative records from 5952 primary records. [2025-09-29T02:14:18.562636] [DEBUG] [LOCAL ] DTG: Saving derivative data. [2025-09-29T02:14:18.797547] [DEBUG] [LOCAL ] DTG: Derivative data saved (1820 records). [2025-09-29T02:14:18.798116] [INFO ] [MAIN ] DTG: Successfully saved derivative data. [2025-09-29T02:14:18.800433] [INFO ] [MAIN ] Derivative Progress: 622/2211 symbols completed. DTG took 1.2s. Estimated remaining: 11m 9s. Rate: 142.5 symbols/min [2025-09-29T02:14:18.800757] [INFO ] [MAIN ] DUK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:18.833157] [DEBUG] [MAIN ] DTM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:18.835761] [INFO ] [MAIN ] DTM: Generated 1820 derivative records from 45043 primary records. [2025-09-29T02:14:18.836538] [DEBUG] [LOCAL ] DTM: Saving derivative data. [2025-09-29T02:14:18.859817] [DEBUG] [LOCAL ] DTM: Derivative data saved (1820 records). [2025-09-29T02:14:18.860557] [INFO ] [MAIN ] DTM: Successfully saved derivative data. [2025-09-29T02:14:18.864047] [INFO ] [MAIN ] Derivative Progress: 623/2211 symbols completed. DTM took 1.3s. Estimated remaining: 11m 8s. Rate: 142.7 symbols/min [2025-09-29T02:14:18.878816] [INFO ] [MAIN ] DUKB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:18.879957] [DEBUG] [MAIN ] DTW: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:14:18.882221] [INFO ] [MAIN ] DTW: Generated 1819 derivative records from 4923 primary records. [2025-09-29T02:14:18.882573] [DEBUG] [LOCAL ] DTW: Saving derivative data. [2025-09-29T02:14:18.906032] [DEBUG] [LOCAL ] DTW: Derivative data saved (1819 records). [2025-09-29T02:14:18.921336] [INFO ] [MAIN ] DTW: Successfully saved derivative data. [2025-09-29T02:14:18.926773] [DEBUG] [LOCAL ] DUKB: Loaded 6414 existing records from primary storage. [2025-09-29T02:14:18.931148] [INFO ] [MAIN ] Derivative Progress: 624/2211 symbols completed. DTW took 0.9s. Estimated remaining: 11m 6s. Rate: 142.9 symbols/min [2025-09-29T02:14:18.931565] [INFO ] [MAIN ] DUKB: Loaded 6414 primary data records. [2025-09-29T02:14:18.937302] [INFO ] [MAIN ] DV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:19.065995] [DEBUG] [LOCAL ] DUK: Loaded 54238 existing records from primary storage. [2025-09-29T02:14:19.072631] [INFO ] [MAIN ] DUK: Loaded 54238 primary data records. [2025-09-29T02:14:19.654939] [DEBUG] [LOCAL ] DV: Loaded 52038 existing records from primary storage. [2025-09-29T02:14:19.670911] [INFO ] [MAIN ] DV: Loaded 52038 primary data records. [2025-09-29T02:14:20.016302] [DEBUG] [MAIN ] DUKB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:20.033560] [INFO ] [MAIN ] DUKB: Generated 1820 derivative records from 6414 primary records. [2025-09-29T02:14:20.033993] [DEBUG] [LOCAL ] DUKB: Saving derivative data. [2025-09-29T02:14:20.053458] [DEBUG] [LOCAL ] DUKB: Derivative data saved (1820 records). [2025-09-29T02:14:20.055616] [INFO ] [MAIN ] DUKB: Successfully saved derivative data. [2025-09-29T02:14:20.060119] [INFO ] [MAIN ] Derivative Progress: 625/2211 symbols completed. DUKB took 1.2s. Estimated remaining: 11m 8s. Rate: 142.5 symbols/min [2025-09-29T02:14:20.060564] [INFO ] [MAIN ] DVA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:20.075348] [DEBUG] [MAIN ] DUK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:20.076195] [INFO ] [MAIN ] DUK: Generated 1820 derivative records from 54238 primary records. [2025-09-29T02:14:20.076935] [DEBUG] [LOCAL ] DUK: Saving derivative data. [2025-09-29T02:14:20.095585] [DEBUG] [LOCAL ] DUK: Derivative data saved (1820 records). [2025-09-29T02:14:20.096026] [INFO ] [MAIN ] DUK: Successfully saved derivative data. [2025-09-29T02:14:20.099181] [INFO ] [MAIN ] Derivative Progress: 626/2211 symbols completed. DUK took 1.3s. Estimated remaining: 11m 6s. Rate: 142.7 symbols/min [2025-09-29T02:14:20.099820] [INFO ] [MAIN ] DVN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:20.119548] [DEBUG] [MAIN ] DV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:20.120701] [INFO ] [MAIN ] DV: Generated 1820 derivative records from 52038 primary records. [2025-09-29T02:14:20.120798] [DEBUG] [LOCAL ] DV: Saving derivative data. [2025-09-29T02:14:20.148499] [DEBUG] [LOCAL ] DV: Derivative data saved (1820 records). [2025-09-29T02:14:20.148902] [INFO ] [MAIN ] DV: Successfully saved derivative data. [2025-09-29T02:14:20.152471] [INFO ] [MAIN ] Derivative Progress: 627/2211 symbols completed. DV took 1.2s. Estimated remaining: 11m 5s. Rate: 142.9 symbols/min [2025-09-29T02:14:20.152937] [INFO ] [MAIN ] DX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:20.176736] [DEBUG] [LOCAL ] DVA: Loaded 41877 existing records from primary storage. [2025-09-29T02:14:20.177216] [INFO ] [MAIN ] DVA: Loaded 41877 primary data records. [2025-09-29T02:14:20.373499] [DEBUG] [LOCAL ] DVN: Loaded 54479 existing records from primary storage. [2025-09-29T02:14:20.433618] [INFO ] [MAIN ] DVN: Loaded 54479 primary data records. [2025-09-29T02:14:20.725795] [DEBUG] [LOCAL ] DX: Loaded 53228 existing records from primary storage. [2025-09-29T02:14:20.742703] [INFO ] [MAIN ] DX: Loaded 53228 primary data records. [2025-09-29T02:14:21.197158] [DEBUG] [MAIN ] DVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:21.326330] [INFO ] [MAIN ] DVA: Generated 1820 derivative records from 41877 primary records. [2025-09-29T02:14:21.327879] [DEBUG] [LOCAL ] DVA: Saving derivative data. [2025-09-29T02:14:21.347875] [DEBUG] [LOCAL ] DVA: Derivative data saved (1820 records). [2025-09-29T02:14:21.351067] [INFO ] [MAIN ] DVA: Successfully saved derivative data. [2025-09-29T02:14:21.354331] [INFO ] [MAIN ] Derivative Progress: 628/2211 symbols completed. DVA took 1.3s. Estimated remaining: 11m 7s. Rate: 142.5 symbols/min [2025-09-29T02:14:21.369630] [DEBUG] [MAIN ] DVN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:21.370596] [INFO ] [MAIN ] DVN: Generated 1820 derivative records from 54479 primary records. [2025-09-29T02:14:21.370734] [DEBUG] [LOCAL ] DVN: Saving derivative data. [2025-09-29T02:14:21.388761] [DEBUG] [LOCAL ] DVN: Derivative data saved (1820 records). [2025-09-29T02:14:21.389148] [INFO ] [MAIN ] DVN: Successfully saved derivative data. [2025-09-29T02:14:21.391982] [INFO ] [MAIN ] Derivative Progress: 629/2211 symbols completed. DVN took 1.3s. Estimated remaining: 11m 5s. Rate: 142.7 symbols/min [2025-09-29T02:14:21.409579] [DEBUG] [MAIN ] DX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:21.410429] [INFO ] [MAIN ] DX: Generated 1820 derivative records from 53228 primary records. [2025-09-29T02:14:21.410518] [DEBUG] [LOCAL ] DX: Saving derivative data. [2025-09-29T02:14:21.426749] [DEBUG] [LOCAL ] DX: Derivative data saved (1820 records). [2025-09-29T02:14:21.426870] [INFO ] [MAIN ] DX: Successfully saved derivative data. [2025-09-29T02:14:21.430547] [INFO ] [MAIN ] Derivative Progress: 630/2211 symbols completed. DX took 1.3s. Estimated remaining: 11m 4s. Rate: 142.9 symbols/min [2025-09-29T02:14:21.431144] [INFO ] [MAIN ] DXC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:21.431279] [INFO ] [MAIN ] DY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:21.431631] [INFO ] [MAIN ] DXYZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:21.474457] [DEBUG] [LOCAL ] DY: Loaded 30160 existing records from primary storage. [2025-09-29T02:14:21.486898] [INFO ] [MAIN ] DY: Loaded 30160 primary data records. [2025-09-29T02:14:21.648392] [DEBUG] [LOCAL ] DXYZ: Loaded 37246 existing records from primary storage. [2025-09-29T02:14:21.666207] [DEBUG] [LOCAL ] DXC: Loaded 50456 existing records from primary storage. [2025-09-29T02:14:21.676929] [INFO ] [MAIN ] DXC: Loaded 50456 primary data records. [2025-09-29T02:14:21.666401] [INFO ] [MAIN ] DXYZ: Loaded 37246 primary data records. [2025-09-29T02:14:22.704732] [DEBUG] [MAIN ] DY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:22.707233] [INFO ] [MAIN ] DY: Generated 1820 derivative records from 30160 primary records. [2025-09-29T02:14:22.708024] [DEBUG] [LOCAL ] DY: Saving derivative data. [2025-09-29T02:14:22.736350] [DEBUG] [LOCAL ] DY: Derivative data saved (1820 records). [2025-09-29T02:14:22.738281] [INFO ] [MAIN ] DY: Successfully saved derivative data. [2025-09-29T02:14:22.741386] [INFO ] [MAIN ] Derivative Progress: 631/2211 symbols completed. DY took 1.3s. Estimated remaining: 11m 6s. Rate: 142.4 symbols/min [2025-09-29T02:14:22.741940] [INFO ] [MAIN ] E: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:22.781390] [DEBUG] [MAIN ] DXYZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:22.783274] [INFO ] [MAIN ] DXYZ: Generated 1820 derivative records from 37246 primary records. [2025-09-29T02:14:22.782033] [DEBUG] [MAIN ] DXC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:22.784690] [DEBUG] [LOCAL ] DXYZ: Saving derivative data. [2025-09-29T02:14:22.784580] [INFO ] [MAIN ] DXC: Generated 1820 derivative records from 50456 primary records. [2025-09-29T02:14:22.785015] [DEBUG] [LOCAL ] DXC: Saving derivative data. [2025-09-29T02:14:22.819515] [DEBUG] [LOCAL ] DXYZ: Derivative data saved (1820 records). [2025-09-29T02:14:22.819902] [INFO ] [MAIN ] DXYZ: Successfully saved derivative data. [2025-09-29T02:14:22.830572] [DEBUG] [LOCAL ] DXC: Derivative data saved (1820 records). [2025-09-29T02:14:22.831062] [INFO ] [MAIN ] DXC: Successfully saved derivative data. [2025-09-29T02:14:22.834185] [INFO ] [MAIN ] Derivative Progress: 632/2211 symbols completed. DXYZ took 1.4s. Estimated remaining: 11m 4s. Rate: 142.6 symbols/min [2025-09-29T02:14:22.837818] [INFO ] [MAIN ] EAF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:22.837912] [INFO ] [MAIN ] Derivative Progress: 633/2211 symbols completed. DXC took 1.4s. Estimated remaining: 11m 3s. Rate: 142.8 symbols/min [2025-09-29T02:14:22.838391] [INFO ] [MAIN ] EAI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:22.860907] [DEBUG] [LOCAL ] EAI: Loaded 4008 existing records from primary storage. [2025-09-29T02:14:22.861209] [INFO ] [MAIN ] EAI: Loaded 4008 primary data records. [2025-09-29T02:14:22.867865] [DEBUG] [LOCAL ] E: Loaded 33848 existing records from primary storage. [2025-09-29T02:14:22.888117] [INFO ] [MAIN ] E: Loaded 33848 primary data records. [2025-09-29T02:14:23.266882] [DEBUG] [LOCAL ] EAF: Loaded 44158 existing records from primary storage. [2025-09-29T02:14:23.412125] [INFO ] [MAIN ] EAF: Loaded 44158 primary data records. [2025-09-29T02:14:23.916313] [DEBUG] [MAIN ] EAI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:23.920711] [INFO ] [MAIN ] EAI: Generated 1820 derivative records from 4008 primary records. [2025-09-29T02:14:23.922014] [DEBUG] [LOCAL ] EAI: Saving derivative data. [2025-09-29T02:14:23.945537] [DEBUG] [MAIN ] E: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:23.955326] [DEBUG] [LOCAL ] EAI: Derivative data saved (1820 records). [2025-09-29T02:14:23.956159] [INFO ] [MAIN ] EAI: Successfully saved derivative data. [2025-09-29T02:14:23.950945] [INFO ] [MAIN ] E: Generated 1820 derivative records from 33848 primary records. [2025-09-29T02:14:23.956322] [DEBUG] [LOCAL ] E: Saving derivative data. [2025-09-29T02:14:23.958571] [INFO ] [MAIN ] Derivative Progress: 634/2211 symbols completed. EAI took 1.1s. Estimated remaining: 11m 4s. Rate: 142.5 symbols/min [2025-09-29T02:14:23.961941] [INFO ] [MAIN ] EARN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:23.982869] [DEBUG] [LOCAL ] E: Derivative data saved (1820 records). [2025-09-29T02:14:23.984130] [INFO ] [MAIN ] E: Successfully saved derivative data. [2025-09-29T02:14:23.989047] [INFO ] [MAIN ] Derivative Progress: 635/2211 symbols completed. E took 1.2s. Estimated remaining: 11m 3s. Rate: 142.7 symbols/min [2025-09-29T02:14:23.990304] [INFO ] [MAIN ] EAT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:24.007736] [DEBUG] [MAIN ] EAF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:24.008561] [INFO ] [MAIN ] EAF: Generated 1820 derivative records from 44158 primary records. [2025-09-29T02:14:24.008797] [DEBUG] [LOCAL ] EAF: Saving derivative data. [2025-09-29T02:14:24.034956] [DEBUG] [LOCAL ] EAF: Derivative data saved (1820 records). [2025-09-29T02:14:24.035171] [INFO ] [MAIN ] EAF: Successfully saved derivative data. [2025-09-29T02:14:24.038086] [INFO ] [MAIN ] Derivative Progress: 636/2211 symbols completed. EAF took 1.2s. Estimated remaining: 11m 1s. Rate: 142.9 symbols/min [2025-09-29T02:14:24.038427] [INFO ] [MAIN ] EB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:24.052248] [DEBUG] [LOCAL ] EARN: Loaded 30576 existing records from primary storage. [2025-09-29T02:14:24.052434] [INFO ] [MAIN ] EARN: Loaded 30576 primary data records. [2025-09-29T02:14:24.272388] [DEBUG] [LOCAL ] EAT: Loaded 50542 existing records from primary storage. [2025-09-29T02:14:24.307432] [INFO ] [MAIN ] EAT: Loaded 50542 primary data records. [2025-09-29T02:14:24.320596] [DEBUG] [LOCAL ] EB: Loaded 38017 existing records from primary storage. [2025-09-29T02:14:24.470617] [INFO ] [MAIN ] EB: Loaded 38017 primary data records. [2025-09-29T02:14:25.172048] [DEBUG] [MAIN ] EARN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:25.174784] [INFO ] [MAIN ] EARN: Generated 1820 derivative records from 30576 primary records. [2025-09-29T02:14:25.175127] [DEBUG] [LOCAL ] EARN: Saving derivative data. [2025-09-29T02:14:25.196103] [DEBUG] [LOCAL ] EARN: Derivative data saved (1820 records). [2025-09-29T02:14:25.196325] [INFO ] [MAIN ] EARN: Successfully saved derivative data. [2025-09-29T02:14:25.199258] [INFO ] [MAIN ] Derivative Progress: 637/2211 symbols completed. EARN took 1.2s. Estimated remaining: 11m 3s. Rate: 142.5 symbols/min [2025-09-29T02:14:25.200032] [INFO ] [MAIN ] EBF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:25.215298] [DEBUG] [MAIN ] EAT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:25.216539] [INFO ] [MAIN ] EAT: Generated 1820 derivative records from 50542 primary records. [2025-09-29T02:14:25.216794] [DEBUG] [LOCAL ] EAT: Saving derivative data. [2025-09-29T02:14:25.252882] [DEBUG] [LOCAL ] EAT: Derivative data saved (1820 records). [2025-09-29T02:14:25.253296] [DEBUG] [MAIN ] EB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:25.258060] [INFO ] [MAIN ] EAT: Successfully saved derivative data. [2025-09-29T02:14:25.261714] [INFO ] [MAIN ] Derivative Progress: 638/2211 symbols completed. EAT took 1.3s. Estimated remaining: 11m 2s. Rate: 142.7 symbols/min [2025-09-29T02:14:25.262056] [INFO ] [MAIN ] EBR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:25.263174] [INFO ] [MAIN ] EB: Generated 1820 derivative records from 38017 primary records. [2025-09-29T02:14:25.264037] [DEBUG] [LOCAL ] EB: Saving derivative data. [2025-09-29T02:14:25.282016] [DEBUG] [LOCAL ] EBF: Loaded 19635 existing records from primary storage. [2025-09-29T02:14:25.287174] [INFO ] [MAIN ] EBF: Loaded 19635 primary data records. [2025-09-29T02:14:25.340982] [DEBUG] [LOCAL ] EB: Derivative data saved (1820 records). [2025-09-29T02:14:25.365504] [INFO ] [MAIN ] EB: Successfully saved derivative data. [2025-09-29T02:14:25.387905] [INFO ] [MAIN ] Derivative Progress: 639/2211 symbols completed. EB took 1.3s. Estimated remaining: 11m 0s. Rate: 142.8 symbols/min [2025-09-29T02:14:25.394668] [INFO ] [MAIN ] EBS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:25.672095] [DEBUG] [LOCAL ] EBR: Loaded 43731 existing records from primary storage. [2025-09-29T02:14:25.672781] [INFO ] [MAIN ] EBR: Loaded 43731 primary data records. [2025-09-29T02:14:25.864492] [DEBUG] [LOCAL ] EBS: Loaded 47455 existing records from primary storage. [2025-09-29T02:14:25.920693] [INFO ] [MAIN ] EBS: Loaded 47455 primary data records. [2025-09-29T02:14:26.201716] [DEBUG] [MAIN ] EBF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:26.224226] [INFO ] [MAIN ] EBF: Generated 1820 derivative records from 19635 primary records. [2025-09-29T02:14:26.236218] [DEBUG] [LOCAL ] EBF: Saving derivative data. [2025-09-29T02:14:26.423790] [DEBUG] [LOCAL ] EBF: Derivative data saved (1820 records). [2025-09-29T02:14:26.426868] [INFO ] [MAIN ] EBF: Successfully saved derivative data. [2025-09-29T02:14:26.430415] [INFO ] [MAIN ] Derivative Progress: 640/2211 symbols completed. EBF took 1.2s. Estimated remaining: 11m 2s. Rate: 142.5 symbols/min [2025-09-29T02:14:26.431309] [INFO ] [MAIN ] EC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:26.446517] [DEBUG] [MAIN ] EBR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:26.449926] [INFO ] [MAIN ] EBR: Generated 1820 derivative records from 43731 primary records. [2025-09-29T02:14:26.450150] [DEBUG] [LOCAL ] EBR: Saving derivative data. [2025-09-29T02:14:26.471243] [DEBUG] [LOCAL ] EBR: Derivative data saved (1820 records). [2025-09-29T02:14:26.471574] [INFO ] [MAIN ] EBR: Successfully saved derivative data. [2025-09-29T02:14:26.474626] [INFO ] [MAIN ] Derivative Progress: 641/2211 symbols completed. EBR took 1.2s. Estimated remaining: 11m 0s. Rate: 142.7 symbols/min [2025-09-29T02:14:26.475401] [INFO ] [MAIN ] ECAT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:26.494846] [DEBUG] [MAIN ] EBS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:26.495723] [INFO ] [MAIN ] EBS: Generated 1820 derivative records from 47455 primary records. [2025-09-29T02:14:26.495851] [DEBUG] [LOCAL ] EBS: Saving derivative data. [2025-09-29T02:14:26.524990] [DEBUG] [LOCAL ] EBS: Derivative data saved (1820 records). [2025-09-29T02:14:26.525150] [INFO ] [MAIN ] EBS: Successfully saved derivative data. [2025-09-29T02:14:26.528876] [INFO ] [MAIN ] Derivative Progress: 642/2211 symbols completed. EBS took 1.1s. Estimated remaining: 10m 59s. Rate: 142.9 symbols/min [2025-09-29T02:14:26.536949] [INFO ] [MAIN ] ECC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:26.574031] [DEBUG] [LOCAL ] EC: Loaded 50056 existing records from primary storage. [2025-09-29T02:14:26.575066] [DEBUG] [LOCAL ] ECAT: Loaded 30092 existing records from primary storage. [2025-09-29T02:14:26.575434] [INFO ] [MAIN ] ECAT: Loaded 30092 primary data records. [2025-09-29T02:14:26.575515] [INFO ] [MAIN ] EC: Loaded 50056 primary data records. [2025-09-29T02:14:27.291072] [DEBUG] [LOCAL ] ECC: Loaded 44025 existing records from primary storage. [2025-09-29T02:14:27.305411] [INFO ] [MAIN ] ECC: Loaded 44025 primary data records. [2025-09-29T02:14:27.666902] [DEBUG] [MAIN ] ECAT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:27.681858] [DEBUG] [MAIN ] EC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:27.682815] [INFO ] [MAIN ] ECAT: Generated 1820 derivative records from 30092 primary records. [2025-09-29T02:14:27.683075] [DEBUG] [LOCAL ] ECAT: Saving derivative data. [2025-09-29T02:14:27.683714] [INFO ] [MAIN ] EC: Generated 1820 derivative records from 50056 primary records. [2025-09-29T02:14:27.683991] [DEBUG] [LOCAL ] EC: Saving derivative data. [2025-09-29T02:14:27.717059] [DEBUG] [LOCAL ] ECAT: Derivative data saved (1820 records). [2025-09-29T02:14:27.719537] [DEBUG] [LOCAL ] EC: Derivative data saved (1820 records). [2025-09-29T02:14:27.719867] [INFO ] [MAIN ] ECAT: Successfully saved derivative data. [2025-09-29T02:14:27.719994] [INFO ] [MAIN ] EC: Successfully saved derivative data. [2025-09-29T02:14:27.722759] [INFO ] [MAIN ] Derivative Progress: 643/2211 symbols completed. ECAT took 1.2s. Estimated remaining: 11m 0s. Rate: 142.5 symbols/min [2025-09-29T02:14:27.726995] [INFO ] [MAIN ] Derivative Progress: 644/2211 symbols completed. EC took 1.3s. Estimated remaining: 10m 59s. Rate: 142.7 symbols/min [2025-09-29T02:14:27.745348] [DEBUG] [MAIN ] ECC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:27.746147] [INFO ] [MAIN ] ECC: Generated 1820 derivative records from 44025 primary records. [2025-09-29T02:14:27.746239] [DEBUG] [LOCAL ] ECC: Saving derivative data. [2025-09-29T02:14:27.761790] [DEBUG] [LOCAL ] ECC: Derivative data saved (1820 records). [2025-09-29T02:14:27.761884] [INFO ] [MAIN ] ECC: Successfully saved derivative data. [2025-09-29T02:14:27.764536] [INFO ] [MAIN ] Derivative Progress: 645/2211 symbols completed. ECC took 1.2s. Estimated remaining: 10m 58s. Rate: 142.9 symbols/min [2025-09-29T02:14:27.765215] [INFO ] [MAIN ] ECG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:27.765346] [INFO ] [MAIN ] ECL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:27.765721] [INFO ] [MAIN ] ECO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:27.800559] [DEBUG] [LOCAL ] ECO: Loaded 18768 existing records from primary storage. [2025-09-29T02:14:27.800952] [INFO ] [MAIN ] ECO: Loaded 18768 primary data records. [2025-09-29T02:14:27.934542] [DEBUG] [LOCAL ] ECG: Loaded 34619 existing records from primary storage. [2025-09-29T02:14:27.966575] [INFO ] [MAIN ] ECG: Loaded 34619 primary data records. [2025-09-29T02:14:28.281162] [DEBUG] [LOCAL ] ECL: Loaded 47489 existing records from primary storage. [2025-09-29T02:14:28.286870] [INFO ] [MAIN ] ECL: Loaded 47489 primary data records. [2025-09-29T02:14:28.891664] [DEBUG] [MAIN ] ECO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:28.894583] [INFO ] [MAIN ] ECO: Generated 1820 derivative records from 18768 primary records. [2025-09-29T02:14:28.895312] [DEBUG] [LOCAL ] ECO: Saving derivative data. [2025-09-29T02:14:28.914268] [DEBUG] [LOCAL ] ECO: Derivative data saved (1820 records). [2025-09-29T02:14:28.914469] [INFO ] [MAIN ] ECO: Successfully saved derivative data. [2025-09-29T02:14:28.917333] [INFO ] [MAIN ] Derivative Progress: 646/2211 symbols completed. ECO took 1.2s. Estimated remaining: 10m 59s. Rate: 142.5 symbols/min [2025-09-29T02:14:28.918533] [INFO ] [MAIN ] ECVT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:28.942073] [DEBUG] [MAIN ] ECG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:28.963754] [INFO ] [MAIN ] ECG: Generated 1820 derivative records from 34619 primary records. [2025-09-29T02:14:28.964873] [DEBUG] [LOCAL ] ECG: Saving derivative data. [2025-09-29T02:14:28.965153] [DEBUG] [MAIN ] ECL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:28.966455] [INFO ] [MAIN ] ECL: Generated 1820 derivative records from 47489 primary records. [2025-09-29T02:14:28.967473] [DEBUG] [LOCAL ] ECL: Saving derivative data. [2025-09-29T02:14:29.005875] [DEBUG] [LOCAL ] ECG: Derivative data saved (1820 records). [2025-09-29T02:14:29.021421] [DEBUG] [LOCAL ] ECL: Derivative data saved (1820 records). [2025-09-29T02:14:29.021871] [INFO ] [MAIN ] ECL: Successfully saved derivative data. [2025-09-29T02:14:29.021512] [INFO ] [MAIN ] ECG: Successfully saved derivative data. [2025-09-29T02:14:29.024950] [INFO ] [MAIN ] Derivative Progress: 647/2211 symbols completed. ECL took 1.3s. Estimated remaining: 10m 58s. Rate: 142.7 symbols/min [2025-09-29T02:14:29.028874] [INFO ] [MAIN ] ED: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:29.029128] [INFO ] [MAIN ] Derivative Progress: 648/2211 symbols completed. ECG took 1.3s. Estimated remaining: 10m 56s. Rate: 142.9 symbols/min [2025-09-29T02:14:29.029681] [INFO ] [MAIN ] EDD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:29.047103] [DEBUG] [LOCAL ] ECVT: Loaded 43587 existing records from primary storage. [2025-09-29T02:14:29.047395] [INFO ] [MAIN ] ECVT: Loaded 43587 primary data records. [2025-09-29T02:14:29.234909] [DEBUG] [LOCAL ] EDD: Loaded 27470 existing records from primary storage. [2025-09-29T02:14:29.267146] [INFO ] [MAIN ] EDD: Loaded 27470 primary data records. [2025-09-29T02:14:29.561346] [DEBUG] [LOCAL ] ED: Loaded 53539 existing records from primary storage. [2025-09-29T02:14:29.578482] [INFO ] [MAIN ] ED: Loaded 53539 primary data records. [2025-09-29T02:14:30.172128] [DEBUG] [MAIN ] ECVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:30.173354] [INFO ] [MAIN ] ECVT: Generated 1820 derivative records from 43587 primary records. [2025-09-29T02:14:30.173853] [DEBUG] [LOCAL ] ECVT: Saving derivative data. [2025-09-29T02:14:30.194548] [DEBUG] [LOCAL ] ECVT: Derivative data saved (1820 records). [2025-09-29T02:14:30.194913] [INFO ] [MAIN ] ECVT: Successfully saved derivative data. [2025-09-29T02:14:30.199018] [INFO ] [MAIN ] Derivative Progress: 649/2211 symbols completed. ECVT took 1.3s. Estimated remaining: 10m 58s. Rate: 142.5 symbols/min [2025-09-29T02:14:30.199820] [INFO ] [MAIN ] EDF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:30.221002] [DEBUG] [MAIN ] EDD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:30.222464] [INFO ] [MAIN ] EDD: Generated 1820 derivative records from 27470 primary records. [2025-09-29T02:14:30.222772] [DEBUG] [LOCAL ] EDD: Saving derivative data. [2025-09-29T02:14:30.247022] [DEBUG] [LOCAL ] EDD: Derivative data saved (1820 records). [2025-09-29T02:14:30.247704] [INFO ] [MAIN ] EDD: Successfully saved derivative data. [2025-09-29T02:14:30.251225] [INFO ] [MAIN ] Derivative Progress: 650/2211 symbols completed. EDD took 1.2s. Estimated remaining: 10m 56s. Rate: 142.7 symbols/min [2025-09-29T02:14:30.251504] [INFO ] [MAIN ] EDN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:30.272448] [DEBUG] [LOCAL ] EDF: Loaded 13627 existing records from primary storage. [2025-09-29T02:14:30.273548] [INFO ] [MAIN ] EDF: Loaded 13627 primary data records. [2025-09-29T02:14:30.273317] [DEBUG] [MAIN ] ED: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:30.274676] [INFO ] [MAIN ] ED: Generated 1820 derivative records from 53539 primary records. [2025-09-29T02:14:30.296736] [DEBUG] [LOCAL ] ED: Saving derivative data. [2025-09-29T02:14:30.414963] [DEBUG] [LOCAL ] ED: Derivative data saved (1820 records). [2025-09-29T02:14:30.465413] [INFO ] [MAIN ] ED: Successfully saved derivative data. [2025-09-29T02:14:30.475924] [DEBUG] [LOCAL ] EDN: Loaded 18501 existing records from primary storage. [2025-09-29T02:14:30.507944] [INFO ] [MAIN ] EDN: Loaded 18501 primary data records. [2025-09-29T02:14:30.483932] [INFO ] [MAIN ] Derivative Progress: 651/2211 symbols completed. ED took 1.5s. Estimated remaining: 10m 55s. Rate: 142.8 symbols/min [2025-09-29T02:14:30.519633] [INFO ] [MAIN ] EDU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:31.028224] [DEBUG] [MAIN ] EDF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:31.029718] [INFO ] [MAIN ] EDF: Generated 1820 derivative records from 13627 primary records. [2025-09-29T02:14:31.031200] [DEBUG] [LOCAL ] EDF: Saving derivative data. [2025-09-29T02:14:31.030778] [DEBUG] [LOCAL ] EDU: Loaded 45666 existing records from primary storage. [2025-09-29T02:14:31.031522] [INFO ] [MAIN ] EDU: Loaded 45666 primary data records. [2025-09-29T02:14:31.101924] [DEBUG] [LOCAL ] EDF: Derivative data saved (1820 records). [2025-09-29T02:14:31.138169] [INFO ] [MAIN ] EDF: Successfully saved derivative data. [2025-09-29T02:14:31.168592] [INFO ] [MAIN ] Derivative Progress: 652/2211 symbols completed. EDF took 1.0s. Estimated remaining: 10m 56s. Rate: 142.7 symbols/min [2025-09-29T02:14:31.185196] [INFO ] [MAIN ] EE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:31.244038] [DEBUG] [MAIN ] EDN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:31.270500] [INFO ] [MAIN ] EDN: Generated 1820 derivative records from 18501 primary records. [2025-09-29T02:14:31.270878] [DEBUG] [LOCAL ] EDN: Saving derivative data. [2025-09-29T02:14:31.456761] [DEBUG] [LOCAL ] EDN: Derivative data saved (1820 records). [2025-09-29T02:14:31.457951] [INFO ] [MAIN ] EDN: Successfully saved derivative data. [2025-09-29T02:14:31.460869] [INFO ] [MAIN ] Derivative Progress: 653/2211 symbols completed. EDN took 1.2s. Estimated remaining: 10m 55s. Rate: 142.7 symbols/min [2025-09-29T02:14:31.461581] [INFO ] [MAIN ] EEX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:31.498087] [DEBUG] [LOCAL ] EEX: Loaded 12042 existing records from primary storage. [2025-09-29T02:14:31.499090] [DEBUG] [LOCAL ] EE: Loaded 32973 existing records from primary storage. [2025-09-29T02:14:31.499378] [INFO ] [MAIN ] EEX: Loaded 12042 primary data records. [2025-09-29T02:14:31.499742] [INFO ] [MAIN ] EE: Loaded 32973 primary data records. [2025-09-29T02:14:31.536198] [DEBUG] [MAIN ] EDU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:31.584421] [INFO ] [MAIN ] EDU: Generated 1820 derivative records from 45666 primary records. [2025-09-29T02:14:31.684319] [DEBUG] [LOCAL ] EDU: Saving derivative data. [2025-09-29T02:14:32.178325] [DEBUG] [LOCAL ] EDU: Derivative data saved (1820 records). [2025-09-29T02:14:32.193779] [INFO ] [MAIN ] EDU: Successfully saved derivative data. [2025-09-29T02:14:32.197401] [INFO ] [MAIN ] Derivative Progress: 654/2211 symbols completed. EDU took 1.7s. Estimated remaining: 10m 55s. Rate: 142.6 symbols/min [2025-09-29T02:14:32.198263] [INFO ] [MAIN ] EFC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:32.224484] [DEBUG] [MAIN ] EE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:32.225718] [INFO ] [MAIN ] EE: Generated 1820 derivative records from 32973 primary records. [2025-09-29T02:14:32.225815] [DEBUG] [LOCAL ] EE: Saving derivative data. [2025-09-29T02:14:32.246544] [DEBUG] [LOCAL ] EE: Derivative data saved (1820 records). [2025-09-29T02:14:32.248781] [INFO ] [MAIN ] EE: Successfully saved derivative data. [2025-09-29T02:14:32.251747] [INFO ] [MAIN ] Derivative Progress: 655/2211 symbols completed. EE took 1.1s. Estimated remaining: 10m 54s. Rate: 142.7 symbols/min [2025-09-29T02:14:32.251968] [INFO ] [MAIN ] EFR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:32.267403] [DEBUG] [MAIN ] EEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:32.268929] [INFO ] [MAIN ] EEX: Generated 1820 derivative records from 12042 primary records. [2025-09-29T02:14:32.269184] [DEBUG] [LOCAL ] EEX: Saving derivative data. [2025-09-29T02:14:32.308757] [DEBUG] [LOCAL ] EFR: Loaded 14474 existing records from primary storage. [2025-09-29T02:14:32.310552] [DEBUG] [LOCAL ] EEX: Derivative data saved (1820 records). [2025-09-29T02:14:32.310612] [INFO ] [MAIN ] EFR: Loaded 14474 primary data records. [2025-09-29T02:14:32.310936] [INFO ] [MAIN ] EEX: Successfully saved derivative data. [2025-09-29T02:14:32.367343] [INFO ] [MAIN ] Derivative Progress: 656/2211 symbols completed. EEX took 0.9s. Estimated remaining: 10m 53s. Rate: 142.9 symbols/min [2025-09-29T02:14:32.440957] [INFO ] [MAIN ] EFT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:32.442239] [DEBUG] [LOCAL ] EFC: Loaded 46944 existing records from primary storage. [2025-09-29T02:14:32.448785] [INFO ] [MAIN ] EFC: Loaded 46944 primary data records. [2025-09-29T02:14:32.783781] [DEBUG] [LOCAL ] EFT: Loaded 12857 existing records from primary storage. [2025-09-29T02:14:32.784312] [INFO ] [MAIN ] EFT: Loaded 12857 primary data records. [2025-09-29T02:14:33.404714] [DEBUG] [MAIN ] EFR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:33.406553] [INFO ] [MAIN ] EFR: Generated 1820 derivative records from 14474 primary records. [2025-09-29T02:14:33.406850] [DEBUG] [LOCAL ] EFR: Saving derivative data. [2025-09-29T02:14:33.442096] [DEBUG] [LOCAL ] EFR: Derivative data saved (1820 records). [2025-09-29T02:14:33.442969] [INFO ] [MAIN ] EFR: Successfully saved derivative data. [2025-09-29T02:14:33.442446] [DEBUG] [MAIN ] EFC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:33.446727] [INFO ] [MAIN ] EFC: Generated 1820 derivative records from 46944 primary records. [2025-09-29T02:14:33.446871] [DEBUG] [LOCAL ] EFC: Saving derivative data. [2025-09-29T02:14:33.445661] [INFO ] [MAIN ] Derivative Progress: 657/2211 symbols completed. EFR took 1.2s. Estimated remaining: 10m 54s. Rate: 142.6 symbols/min [2025-09-29T02:14:33.447882] [INFO ] [MAIN ] EFX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:33.466076] [DEBUG] [LOCAL ] EFC: Derivative data saved (1820 records). [2025-09-29T02:14:33.466501] [INFO ] [MAIN ] EFC: Successfully saved derivative data. [2025-09-29T02:14:33.471743] [INFO ] [MAIN ] Derivative Progress: 658/2211 symbols completed. EFC took 1.3s. Estimated remaining: 10m 53s. Rate: 142.8 symbols/min [2025-09-29T02:14:33.486898] [DEBUG] [MAIN ] EFT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:33.487878] [INFO ] [MAIN ] EFT: Generated 1820 derivative records from 12857 primary records. [2025-09-29T02:14:33.487970] [DEBUG] [LOCAL ] EFT: Saving derivative data. [2025-09-29T02:14:33.506259] [DEBUG] [LOCAL ] EFT: Derivative data saved (1820 records). [2025-09-29T02:14:33.506436] [INFO ] [MAIN ] EFT: Successfully saved derivative data. [2025-09-29T02:14:33.509898] [INFO ] [MAIN ] Derivative Progress: 659/2211 symbols completed. EFT took 1.1s. Estimated remaining: 10m 51s. Rate: 143.0 symbols/min [2025-09-29T02:14:33.545997] [DEBUG] [LOCAL ] EFX: Loaded 45419 existing records from primary storage. [2025-09-29T02:14:33.546176] [INFO ] [MAIN ] EFX: Loaded 45419 primary data records. [2025-09-29T02:14:33.894941] [DEBUG] [MAIN ] EFX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:33.895805] [INFO ] [MAIN ] EFX: Generated 1820 derivative records from 45419 primary records. [2025-09-29T02:14:33.895899] [DEBUG] [LOCAL ] EFX: Saving derivative data. [2025-09-29T02:14:33.912594] [DEBUG] [LOCAL ] EFX: Derivative data saved (1820 records). [2025-09-29T02:14:33.912790] [INFO ] [MAIN ] EFX: Successfully saved derivative data. [2025-09-29T02:14:33.915282] [INFO ] [MAIN ] Derivative Progress: 660/2211 symbols completed. EFX took 0.5s. Estimated remaining: 10m 51s. Rate: 143.0 symbols/min [2025-09-29T02:14:33.915910] [INFO ] [MAIN ] EFXT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:33.916043] [INFO ] [MAIN ] EGO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:33.916266] [INFO ] [MAIN ] EG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:33.976148] [DEBUG] [LOCAL ] EFXT: Loaded 29755 existing records from primary storage. [2025-09-29T02:14:33.977131] [DEBUG] [LOCAL ] EG: Loaded 29024 existing records from primary storage. [2025-09-29T02:14:33.992798] [INFO ] [MAIN ] EFXT: Loaded 29755 primary data records. [2025-09-29T02:14:33.992727] [INFO ] [MAIN ] EG: Loaded 29024 primary data records. [2025-09-29T02:14:34.274286] [DEBUG] [LOCAL ] EGO: Loaded 52295 existing records from primary storage. [2025-09-29T02:14:34.356266] [INFO ] [MAIN ] EGO: Loaded 52295 primary data records. [2025-09-29T02:14:35.078046] [DEBUG] [MAIN ] EFXT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:35.081721] [INFO ] [MAIN ] EFXT: Generated 1820 derivative records from 29755 primary records. [2025-09-29T02:14:35.082179] [DEBUG] [LOCAL ] EFXT: Saving derivative data. [2025-09-29T02:14:35.105342] [DEBUG] [MAIN ] EG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:35.114361] [INFO ] [MAIN ] EG: Generated 1820 derivative records from 29024 primary records. [2025-09-29T02:14:35.115581] [DEBUG] [LOCAL ] EFXT: Derivative data saved (1820 records). [2025-09-29T02:14:35.115848] [DEBUG] [LOCAL ] EG: Saving derivative data. [2025-09-29T02:14:35.116164] [INFO ] [MAIN ] EFXT: Successfully saved derivative data. [2025-09-29T02:14:35.120015] [INFO ] [MAIN ] Derivative Progress: 661/2211 symbols completed. EFXT took 1.2s. Estimated remaining: 10m 52s. Rate: 142.6 symbols/min [2025-09-29T02:14:35.121050] [INFO ] [MAIN ] EGP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:35.141320] [DEBUG] [LOCAL ] EG: Derivative data saved (1820 records). [2025-09-29T02:14:35.141734] [INFO ] [MAIN ] EG: Successfully saved derivative data. [2025-09-29T02:14:35.145174] [INFO ] [MAIN ] Derivative Progress: 662/2211 symbols completed. EG took 1.2s. Estimated remaining: 10m 51s. Rate: 142.8 symbols/min [2025-09-29T02:14:35.145585] [INFO ] [MAIN ] EGY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:35.160801] [DEBUG] [MAIN ] EGO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:35.162259] [INFO ] [MAIN ] EGO: Generated 1820 derivative records from 52295 primary records. [2025-09-29T02:14:35.162622] [DEBUG] [LOCAL ] EGO: Saving derivative data. [2025-09-29T02:14:35.182995] [DEBUG] [LOCAL ] EGO: Derivative data saved (1820 records). [2025-09-29T02:14:35.183156] [INFO ] [MAIN ] EGO: Successfully saved derivative data. [2025-09-29T02:14:35.187102] [INFO ] [MAIN ] Derivative Progress: 663/2211 symbols completed. EGO took 1.3s. Estimated remaining: 10m 50s. Rate: 143.0 symbols/min [2025-09-29T02:14:35.196708] [INFO ] [MAIN ] EHAB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:35.212366] [DEBUG] [LOCAL ] EGP: Loaded 31536 existing records from primary storage. [2025-09-29T02:14:35.212542] [INFO ] [MAIN ] EGP: Loaded 31536 primary data records. [2025-09-29T02:14:35.416491] [DEBUG] [LOCAL ] EGY: Loaded 42824 existing records from primary storage. [2025-09-29T02:14:35.449699] [INFO ] [MAIN ] EGY: Loaded 42824 primary data records. [2025-09-29T02:14:35.669986] [DEBUG] [LOCAL ] EHAB: Loaded 30257 existing records from primary storage. [2025-09-29T02:14:35.702412] [INFO ] [MAIN ] EHAB: Loaded 30257 primary data records. [2025-09-29T02:14:36.306865] [DEBUG] [MAIN ] EGP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:36.309275] [INFO ] [MAIN ] EGP: Generated 1820 derivative records from 31536 primary records. [2025-09-29T02:14:36.309614] [DEBUG] [LOCAL ] EGP: Saving derivative data. [2025-09-29T02:14:36.330943] [DEBUG] [LOCAL ] EGP: Derivative data saved (1820 records). [2025-09-29T02:14:36.331321] [INFO ] [MAIN ] EGP: Successfully saved derivative data. [2025-09-29T02:14:36.334859] [INFO ] [MAIN ] Derivative Progress: 664/2211 symbols completed. EGP took 1.2s. Estimated remaining: 10m 51s. Rate: 142.6 symbols/min [2025-09-29T02:14:36.335204] [INFO ] [MAIN ] EHC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:36.354179] [DEBUG] [MAIN ] EGY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:36.355081] [INFO ] [MAIN ] EGY: Generated 1820 derivative records from 42824 primary records. [2025-09-29T02:14:36.355360] [DEBUG] [LOCAL ] EGY: Saving derivative data. [2025-09-29T02:14:36.375569] [DEBUG] [LOCAL ] EGY: Derivative data saved (1820 records). [2025-09-29T02:14:36.379566] [INFO ] [MAIN ] EGY: Successfully saved derivative data. [2025-09-29T02:14:36.383153] [INFO ] [MAIN ] Derivative Progress: 665/2211 symbols completed. EGY took 1.2s. Estimated remaining: 10m 50s. Rate: 142.8 symbols/min [2025-09-29T02:14:36.383819] [INFO ] [MAIN ] EHI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:36.403826] [DEBUG] [MAIN ] EHAB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:36.415721] [INFO ] [MAIN ] EHAB: Generated 1820 derivative records from 30257 primary records. [2025-09-29T02:14:36.415863] [DEBUG] [LOCAL ] EHAB: Saving derivative data. [2025-09-29T02:14:36.435856] [DEBUG] [LOCAL ] EHAB: Derivative data saved (1820 records). [2025-09-29T02:14:36.436972] [INFO ] [MAIN ] EHAB: Successfully saved derivative data. [2025-09-29T02:14:36.454149] [INFO ] [MAIN ] Derivative Progress: 666/2211 symbols completed. EHAB took 1.3s. Estimated remaining: 10m 48s. Rate: 143.0 symbols/min [2025-09-29T02:14:36.461209] [DEBUG] [LOCAL ] EHC: Loaded 41849 existing records from primary storage. [2025-09-29T02:14:36.461383] [INFO ] [MAIN ] EIC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:36.459898] [DEBUG] [LOCAL ] EHI: Loaded 10472 existing records from primary storage. [2025-09-29T02:14:36.462181] [INFO ] [MAIN ] EHI: Loaded 10472 primary data records. [2025-09-29T02:14:36.462074] [INFO ] [MAIN ] EHC: Loaded 41849 primary data records. [2025-09-29T02:14:36.997145] [DEBUG] [LOCAL ] EIC: Loaded 24238 existing records from primary storage. [2025-09-29T02:14:37.140265] [INFO ] [MAIN ] EIC: Loaded 24238 primary data records. [2025-09-29T02:14:37.501772] [DEBUG] [MAIN ] EHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:37.503024] [INFO ] [MAIN ] EHI: Generated 1820 derivative records from 10472 primary records. [2025-09-29T02:14:37.503226] [DEBUG] [LOCAL ] EHI: Saving derivative data. [2025-09-29T02:14:37.528669] [DEBUG] [MAIN ] EHC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:37.535363] [INFO ] [MAIN ] EHC: Generated 1820 derivative records from 41849 primary records. [2025-09-29T02:14:37.535562] [DEBUG] [LOCAL ] EHI: Derivative data saved (1820 records). [2025-09-29T02:14:37.536033] [INFO ] [MAIN ] EHI: Successfully saved derivative data. [2025-09-29T02:14:37.538705] [DEBUG] [LOCAL ] EHC: Saving derivative data. [2025-09-29T02:14:37.538576] [INFO ] [MAIN ] Derivative Progress: 667/2211 symbols completed. EHI took 1.2s. Estimated remaining: 10m 50s. Rate: 142.6 symbols/min [2025-09-29T02:14:37.540230] [INFO ] [MAIN ] EICC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:37.560208] [DEBUG] [LOCAL ] EHC: Derivative data saved (1820 records). [2025-09-29T02:14:37.560673] [INFO ] [MAIN ] EHC: Successfully saved derivative data. [2025-09-29T02:14:37.564488] [DEBUG] [LOCAL ] EICC: Loaded 6245 existing records from primary storage. [2025-09-29T02:14:37.568714] [INFO ] [MAIN ] EICC: Loaded 6245 primary data records. [2025-09-29T02:14:37.568547] [INFO ] [MAIN ] Derivative Progress: 668/2211 symbols completed. EHC took 1.2s. Estimated remaining: 10m 48s. Rate: 142.8 symbols/min [2025-09-29T02:14:37.569379] [INFO ] [MAIN ] EIG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:37.702883] [DEBUG] [MAIN ] EIC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:37.708756] [INFO ] [MAIN ] EIC: Generated 1820 derivative records from 24238 primary records. [2025-09-29T02:14:37.708932] [DEBUG] [LOCAL ] EIC: Saving derivative data. [2025-09-29T02:14:37.817814] [DEBUG] [LOCAL ] EIG: Loaded 20519 existing records from primary storage. [2025-09-29T02:14:37.819803] [DEBUG] [LOCAL ] EIC: Derivative data saved (1820 records). [2025-09-29T02:14:37.990517] [INFO ] [MAIN ] EIC: Successfully saved derivative data. [2025-09-29T02:14:37.993922] [INFO ] [MAIN ] Derivative Progress: 669/2211 symbols completed. EIC took 1.5s. Estimated remaining: 10m 48s. Rate: 142.8 symbols/min [2025-09-29T02:14:37.990628] [INFO ] [MAIN ] EIG: Loaded 20519 primary data records. [2025-09-29T02:14:37.994466] [INFO ] [MAIN ] EIX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:38.368791] [DEBUG] [MAIN ] EICC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:38.370247] [INFO ] [MAIN ] EICC: Generated 1820 derivative records from 6245 primary records. [2025-09-29T02:14:38.385805] [DEBUG] [LOCAL ] EICC: Saving derivative data. [2025-09-29T02:14:38.389043] [DEBUG] [LOCAL ] EIX: Loaded 54113 existing records from primary storage. [2025-09-29T02:14:38.389233] [INFO ] [MAIN ] EIX: Loaded 54113 primary data records. [2025-09-29T02:14:38.460253] [DEBUG] [LOCAL ] EICC: Derivative data saved (1820 records). [2025-09-29T02:14:38.485171] [INFO ] [MAIN ] EICC: Successfully saved derivative data. [2025-09-29T02:14:38.513238] [INFO ] [MAIN ] Derivative Progress: 670/2211 symbols completed. EICC took 1.0s. Estimated remaining: 10m 48s. Rate: 142.8 symbols/min [2025-09-29T02:14:38.525681] [INFO ] [MAIN ] EL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:38.760333] [DEBUG] [MAIN ] EIG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:38.762677] [INFO ] [MAIN ] EIG: Generated 1820 derivative records from 20519 primary records. [2025-09-29T02:14:38.763222] [DEBUG] [LOCAL ] EIG: Saving derivative data. [2025-09-29T02:14:38.783061] [DEBUG] [LOCAL ] EIG: Derivative data saved (1820 records). [2025-09-29T02:14:38.783497] [INFO ] [MAIN ] EIG: Successfully saved derivative data. [2025-09-29T02:14:38.787058] [INFO ] [MAIN ] Derivative Progress: 671/2211 symbols completed. EIG took 1.2s. Estimated remaining: 10m 47s. Rate: 142.8 symbols/min [2025-09-29T02:14:38.787493] [INFO ] [MAIN ] ELAN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:38.824286] [DEBUG] [MAIN ] EIX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:38.825097] [INFO ] [MAIN ] EIX: Generated 1820 derivative records from 54113 primary records. [2025-09-29T02:14:38.825246] [DEBUG] [LOCAL ] EIX: Saving derivative data. [2025-09-29T02:14:38.862131] [DEBUG] [LOCAL ] EIX: Derivative data saved (1820 records). [2025-09-29T02:14:38.863881] [DEBUG] [LOCAL ] EL: Loaded 54177 existing records from primary storage. [2025-09-29T02:14:38.864258] [INFO ] [MAIN ] EIX: Successfully saved derivative data. [2025-09-29T02:14:38.864476] [INFO ] [MAIN ] EL: Loaded 54177 primary data records. [2025-09-29T02:14:38.868460] [INFO ] [MAIN ] Derivative Progress: 672/2211 symbols completed. EIX took 0.9s. Estimated remaining: 10m 46s. Rate: 143.0 symbols/min [2025-09-29T02:14:38.892447] [INFO ] [MAIN ] ELC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:39.003488] [DEBUG] [LOCAL ] ELC: Loaded 3512 existing records from primary storage. [2025-09-29T02:14:39.008738] [INFO ] [MAIN ] ELC: Loaded 3512 primary data records. [2025-09-29T02:14:39.229183] [DEBUG] [LOCAL ] ELAN: Loaded 53985 existing records from primary storage. [2025-09-29T02:14:39.365906] [INFO ] [MAIN ] ELAN: Loaded 53985 primary data records. [2025-09-29T02:14:39.995271] [DEBUG] [MAIN ] EL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:39.998706] [INFO ] [MAIN ] EL: Generated 1820 derivative records from 54177 primary records. [2025-09-29T02:14:39.999766] [DEBUG] [LOCAL ] EL: Saving derivative data. [2025-09-29T02:14:40.029096] [DEBUG] [MAIN ] ELC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:40.034701] [DEBUG] [LOCAL ] EL: Derivative data saved (1820 records). [2025-09-29T02:14:40.035137] [INFO ] [MAIN ] EL: Successfully saved derivative data. [2025-09-29T02:14:40.036541] [INFO ] [MAIN ] ELC: Generated 1820 derivative records from 3512 primary records. [2025-09-29T02:14:40.039904] [INFO ] [MAIN ] Derivative Progress: 673/2211 symbols completed. EL took 1.5s. Estimated remaining: 10m 47s. Rate: 142.6 symbols/min [2025-09-29T02:14:40.040861] [DEBUG] [LOCAL ] ELC: Saving derivative data. [2025-09-29T02:14:40.059092] [DEBUG] [LOCAL ] ELC: Derivative data saved (1820 records). [2025-09-29T02:14:40.061448] [INFO ] [MAIN ] ELC: Successfully saved derivative data. [2025-09-29T02:14:40.065080] [INFO ] [MAIN ] Derivative Progress: 674/2211 symbols completed. ELC took 1.2s. Estimated remaining: 10m 46s. Rate: 142.8 symbols/min [2025-09-29T02:14:40.078566] [DEBUG] [MAIN ] ELAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:40.079302] [INFO ] [MAIN ] ELAN: Generated 1820 derivative records from 53985 primary records. [2025-09-29T02:14:40.079390] [DEBUG] [LOCAL ] ELAN: Saving derivative data. [2025-09-29T02:14:40.095462] [DEBUG] [LOCAL ] ELAN: Derivative data saved (1820 records). [2025-09-29T02:14:40.095557] [INFO ] [MAIN ] ELAN: Successfully saved derivative data. [2025-09-29T02:14:40.099334] [INFO ] [MAIN ] Derivative Progress: 675/2211 symbols completed. ELAN took 1.3s. Estimated remaining: 10m 44s. Rate: 143.0 symbols/min [2025-09-29T02:14:40.099960] [INFO ] [MAIN ] ELP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:40.099856] [INFO ] [MAIN ] ELF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:40.100105] [INFO ] [MAIN ] ELME: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:40.132634] [DEBUG] [LOCAL ] ELP: Loaded 26107 existing records from primary storage. [2025-09-29T02:14:40.132838] [INFO ] [MAIN ] ELP: Loaded 26107 primary data records. [2025-09-29T02:14:40.288664] [DEBUG] [LOCAL ] ELME: Loaded 39817 existing records from primary storage. [2025-09-29T02:14:40.348085] [INFO ] [MAIN ] ELME: Loaded 39817 primary data records. [2025-09-29T02:14:40.534189] [DEBUG] [LOCAL ] ELF: Loaded 53037 existing records from primary storage. [2025-09-29T02:14:40.566033] [INFO ] [MAIN ] ELF: Loaded 53037 primary data records. [2025-09-29T02:14:41.236308] [DEBUG] [MAIN ] ELP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:41.237584] [INFO ] [MAIN ] ELP: Generated 1820 derivative records from 26107 primary records. [2025-09-29T02:14:41.237830] [DEBUG] [LOCAL ] ELP: Saving derivative data. [2025-09-29T02:14:41.259158] [DEBUG] [LOCAL ] ELP: Derivative data saved (1820 records). [2025-09-29T02:14:41.260140] [INFO ] [MAIN ] ELP: Successfully saved derivative data. [2025-09-29T02:14:41.263301] [INFO ] [MAIN ] Derivative Progress: 676/2211 symbols completed. ELP took 1.2s. Estimated remaining: 10m 46s. Rate: 142.7 symbols/min [2025-09-29T02:14:41.264252] [INFO ] [MAIN ] ELS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:41.290197] [DEBUG] [MAIN ] ELF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:41.291303] [INFO ] [MAIN ] ELF: Generated 1820 derivative records from 53037 primary records. [2025-09-29T02:14:41.291406] [DEBUG] [LOCAL ] ELF: Saving derivative data. [2025-09-29T02:14:41.307430] [DEBUG] [MAIN ] ELME: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:41.320477] [INFO ] [MAIN ] ELME: Generated 1820 derivative records from 39817 primary records. [2025-09-29T02:14:41.321977] [DEBUG] [LOCAL ] ELME: Saving derivative data. [2025-09-29T02:14:41.326024] [DEBUG] [LOCAL ] ELF: Derivative data saved (1820 records). [2025-09-29T02:14:41.326434] [INFO ] [MAIN ] ELF: Successfully saved derivative data. [2025-09-29T02:14:41.337254] [INFO ] [MAIN ] Derivative Progress: 677/2211 symbols completed. ELF took 1.2s. Estimated remaining: 10m 44s. Rate: 142.8 symbols/min [2025-09-29T02:14:41.342851] [INFO ] [MAIN ] ELV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:41.347340] [DEBUG] [LOCAL ] ELME: Derivative data saved (1820 records). [2025-09-29T02:14:41.348004] [INFO ] [MAIN ] ELME: Successfully saved derivative data. [2025-09-29T02:14:41.350847] [INFO ] [MAIN ] Derivative Progress: 678/2211 symbols completed. ELME took 1.3s. Estimated remaining: 10m 43s. Rate: 143.0 symbols/min [2025-09-29T02:14:41.351308] [INFO ] [MAIN ] EMD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:41.390618] [DEBUG] [LOCAL ] ELS: Loaded 50110 existing records from primary storage. [2025-09-29T02:14:41.391121] [INFO ] [MAIN ] ELS: Loaded 50110 primary data records. [2025-09-29T02:14:41.524530] [DEBUG] [LOCAL ] EMD: Loaded 21338 existing records from primary storage. [2025-09-29T02:14:41.540503] [INFO ] [MAIN ] EMD: Loaded 21338 primary data records. [2025-09-29T02:14:41.759909] [DEBUG] [LOCAL ] ELV: Loaded 51334 existing records from primary storage. [2025-09-29T02:14:41.774450] [INFO ] [MAIN ] ELV: Loaded 51334 primary data records. [2025-09-29T02:14:42.554583] [DEBUG] [MAIN ] ELS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:42.556104] [INFO ] [MAIN ] ELS: Generated 1820 derivative records from 50110 primary records. [2025-09-29T02:14:42.564309] [DEBUG] [LOCAL ] ELS: Saving derivative data. [2025-09-29T02:14:42.571668] [DEBUG] [MAIN ] EMD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:42.581002] [INFO ] [MAIN ] EMD: Generated 1820 derivative records from 21338 primary records. [2025-09-29T02:14:42.589719] [DEBUG] [LOCAL ] EMD: Saving derivative data. [2025-09-29T02:14:42.590503] [DEBUG] [LOCAL ] ELS: Derivative data saved (1820 records). [2025-09-29T02:14:42.592374] [INFO ] [MAIN ] ELS: Successfully saved derivative data. [2025-09-29T02:14:42.603019] [INFO ] [MAIN ] Derivative Progress: 679/2211 symbols completed. ELS took 1.3s. Estimated remaining: 10m 45s. Rate: 142.6 symbols/min [2025-09-29T02:14:42.608508] [INFO ] [MAIN ] EME: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:42.617455] [DEBUG] [LOCAL ] EMD: Derivative data saved (1820 records). [2025-09-29T02:14:42.617802] [INFO ] [MAIN ] EMD: Successfully saved derivative data. [2025-09-29T02:14:42.634798] [DEBUG] [MAIN ] ELV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:42.629096] [INFO ] [MAIN ] Derivative Progress: 680/2211 symbols completed. EMD took 1.3s. Estimated remaining: 10m 43s. Rate: 142.8 symbols/min [2025-09-29T02:14:42.635030] [INFO ] [MAIN ] EMF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:42.635919] [INFO ] [MAIN ] ELV: Generated 1820 derivative records from 51334 primary records. [2025-09-29T02:14:42.636197] [DEBUG] [LOCAL ] ELV: Saving derivative data. [2025-09-29T02:14:42.656155] [DEBUG] [LOCAL ] ELV: Derivative data saved (1820 records). [2025-09-29T02:14:42.656564] [INFO ] [MAIN ] ELV: Successfully saved derivative data. [2025-09-29T02:14:42.660122] [INFO ] [MAIN ] Derivative Progress: 681/2211 symbols completed. ELV took 1.3s. Estimated remaining: 10m 42s. Rate: 143.0 symbols/min [2025-09-29T02:14:42.663684] [INFO ] [MAIN ] EMN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:42.664037] [DEBUG] [LOCAL ] EMF: Loaded 3575 existing records from primary storage. [2025-09-29T02:14:42.665080] [INFO ] [MAIN ] EMF: Loaded 3575 primary data records. [2025-09-29T02:14:42.807569] [DEBUG] [LOCAL ] EME: Loaded 32035 existing records from primary storage. [2025-09-29T02:14:42.807890] [INFO ] [MAIN ] EME: Loaded 32035 primary data records. [2025-09-29T02:14:43.273063] [DEBUG] [LOCAL ] EMN: Loaded 51117 existing records from primary storage. [2025-09-29T02:14:43.273888] [INFO ] [MAIN ] EMN: Loaded 51117 primary data records. [2025-09-29T02:14:43.762473] [DEBUG] [MAIN ] EMF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:43.765213] [INFO ] [MAIN ] EMF: Generated 1820 derivative records from 3575 primary records. [2025-09-29T02:14:43.766297] [DEBUG] [LOCAL ] EMF: Saving derivative data. [2025-09-29T02:14:43.781968] [DEBUG] [MAIN ] EME: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:43.783314] [INFO ] [MAIN ] EME: Generated 1820 derivative records from 32035 primary records. [2025-09-29T02:14:43.784095] [DEBUG] [LOCAL ] EME: Saving derivative data. [2025-09-29T02:14:43.807891] [DEBUG] [LOCAL ] EMF: Derivative data saved (1820 records). [2025-09-29T02:14:43.810952] [INFO ] [MAIN ] EMF: Successfully saved derivative data. [2025-09-29T02:14:43.818813] [DEBUG] [LOCAL ] EME: Derivative data saved (1820 records). [2025-09-29T02:14:43.819008] [INFO ] [MAIN ] EME: Successfully saved derivative data. [2025-09-29T02:14:43.817981] [INFO ] [MAIN ] Derivative Progress: 682/2211 symbols completed. EMF took 1.2s. Estimated remaining: 10m 43s. Rate: 142.6 symbols/min [2025-09-29T02:14:43.819308] [INFO ] [MAIN ] EMO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:43.822784] [INFO ] [MAIN ] Derivative Progress: 683/2211 symbols completed. EME took 1.2s. Estimated remaining: 10m 42s. Rate: 142.8 symbols/min [2025-09-29T02:14:43.823463] [INFO ] [MAIN ] EMP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:43.833046] [DEBUG] [LOCAL ] EMP: Loaded 3062 existing records from primary storage. [2025-09-29T02:14:43.846272] [INFO ] [MAIN ] EMP: Loaded 3062 primary data records. [2025-09-29T02:14:43.888368] [DEBUG] [MAIN ] EMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:43.930727] [INFO ] [MAIN ] EMN: Generated 1820 derivative records from 51117 primary records. [2025-09-29T02:14:43.953279] [DEBUG] [LOCAL ] EMO: Loaded 12656 existing records from primary storage. [2025-09-29T02:14:43.953383] [DEBUG] [LOCAL ] EMN: Saving derivative data. [2025-09-29T02:14:43.966229] [INFO ] [MAIN ] EMO: Loaded 12656 primary data records. [2025-09-29T02:14:44.154380] [DEBUG] [LOCAL ] EMN: Derivative data saved (1820 records). [2025-09-29T02:14:44.339500] [INFO ] [MAIN ] EMN: Successfully saved derivative data. [2025-09-29T02:14:44.360484] [INFO ] [MAIN ] Derivative Progress: 684/2211 symbols completed. EMN took 1.7s. Estimated remaining: 10m 42s. Rate: 142.8 symbols/min [2025-09-29T02:14:44.382032] [INFO ] [MAIN ] EMR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:44.621745] [DEBUG] [MAIN ] EMP: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:14:44.638297] [INFO ] [MAIN ] EMP: Generated 1819 derivative records from 3062 primary records. [2025-09-29T02:14:44.638525] [DEBUG] [LOCAL ] EMP: Saving derivative data. [2025-09-29T02:14:44.655826] [DEBUG] [LOCAL ] EMP: Derivative data saved (1819 records). [2025-09-29T02:14:44.657965] [INFO ] [MAIN ] EMP: Successfully saved derivative data. [2025-09-29T02:14:44.660668] [INFO ] [MAIN ] Derivative Progress: 685/2211 symbols completed. EMP took 0.8s. Estimated remaining: 10m 41s. Rate: 142.8 symbols/min [2025-09-29T02:14:44.662801] [INFO ] [MAIN ] ENB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:44.691898] [DEBUG] [MAIN ] EMO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:44.694361] [INFO ] [MAIN ] EMO: Generated 1820 derivative records from 12656 primary records. [2025-09-29T02:14:44.694716] [DEBUG] [LOCAL ] EMO: Saving derivative data. [2025-09-29T02:14:44.697289] [DEBUG] [LOCAL ] EMR: Loaded 54027 existing records from primary storage. [2025-09-29T02:14:44.697874] [INFO ] [MAIN ] EMR: Loaded 54027 primary data records. [2025-09-29T02:14:44.762460] [DEBUG] [LOCAL ] EMO: Derivative data saved (1820 records). [2025-09-29T02:14:44.785760] [INFO ] [MAIN ] EMO: Successfully saved derivative data. [2025-09-29T02:14:44.795111] [INFO ] [MAIN ] Derivative Progress: 686/2211 symbols completed. EMO took 1.0s. Estimated remaining: 10m 40s. Rate: 143.0 symbols/min [2025-09-29T02:14:44.808283] [INFO ] [MAIN ] ENFY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:44.860915] [DEBUG] [LOCAL ] ENFY: Loaded 3106 existing records from primary storage. [2025-09-29T02:14:44.902113] [INFO ] [MAIN ] ENFY: Loaded 3106 primary data records. [2025-09-29T02:14:45.223773] [DEBUG] [LOCAL ] ENB: Loaded 54295 existing records from primary storage. [2025-09-29T02:14:45.246222] [INFO ] [MAIN ] ENB: Loaded 54295 primary data records. [2025-09-29T02:14:45.801132] [DEBUG] [MAIN ] EMR: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:14:45.804075] [INFO ] [MAIN ] EMR: Generated 1819 derivative records from 54027 primary records. [2025-09-29T02:14:45.804556] [DEBUG] [LOCAL ] EMR: Saving derivative data. [2025-09-29T02:14:45.824192] [DEBUG] [LOCAL ] EMR: Derivative data saved (1819 records). [2025-09-29T02:14:45.827095] [INFO ] [MAIN ] EMR: Successfully saved derivative data. [2025-09-29T02:14:45.832506] [INFO ] [MAIN ] Derivative Progress: 687/2211 symbols completed. EMR took 1.5s. Estimated remaining: 10m 41s. Rate: 142.7 symbols/min [2025-09-29T02:14:45.833307] [INFO ] [MAIN ] ENIC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:45.848395] [DEBUG] [MAIN ] ENFY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:45.850428] [INFO ] [MAIN ] ENFY: Generated 1820 derivative records from 3106 primary records. [2025-09-29T02:14:45.850765] [DEBUG] [LOCAL ] ENFY: Saving derivative data. [2025-09-29T02:14:45.868986] [DEBUG] [LOCAL ] ENFY: Derivative data saved (1820 records). [2025-09-29T02:14:45.869151] [INFO ] [MAIN ] ENFY: Successfully saved derivative data. [2025-09-29T02:14:45.871312] [INFO ] [MAIN ] Derivative Progress: 688/2211 symbols completed. ENFY took 1.1s. Estimated remaining: 10m 40s. Rate: 142.9 symbols/min [2025-09-29T02:14:45.885803] [DEBUG] [MAIN ] ENB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:45.886677] [INFO ] [MAIN ] ENB: Generated 1820 derivative records from 54295 primary records. [2025-09-29T02:14:45.886767] [DEBUG] [LOCAL ] ENB: Saving derivative data. [2025-09-29T02:14:45.913515] [DEBUG] [LOCAL ] ENB: Derivative data saved (1820 records). [2025-09-29T02:14:45.924276] [INFO ] [MAIN ] ENB: Successfully saved derivative data. [2025-09-29T02:14:45.928174] [INFO ] [MAIN ] Derivative Progress: 689/2211 symbols completed. ENB took 1.3s. Estimated remaining: 10m 38s. Rate: 143.1 symbols/min [2025-09-29T02:14:45.929611] [DEBUG] [LOCAL ] ENIC: Loaded 36910 existing records from primary storage. [2025-09-29T02:14:45.929806] [INFO ] [MAIN ] ENIC: Loaded 36910 primary data records. [2025-09-29T02:14:46.282409] [DEBUG] [MAIN ] ENIC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:46.283208] [INFO ] [MAIN ] ENIC: Generated 1820 derivative records from 36910 primary records. [2025-09-29T02:14:46.283310] [DEBUG] [LOCAL ] ENIC: Saving derivative data. [2025-09-29T02:14:46.299615] [DEBUG] [LOCAL ] ENIC: Derivative data saved (1820 records). [2025-09-29T02:14:46.299792] [INFO ] [MAIN ] ENIC: Successfully saved derivative data. [2025-09-29T02:14:46.302598] [INFO ] [MAIN ] Derivative Progress: 690/2211 symbols completed. ENIC took 0.5s. Estimated remaining: 10m 38s. Rate: 143.1 symbols/min [2025-09-29T02:14:46.303414] [INFO ] [MAIN ] ENR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:46.303294] [INFO ] [MAIN ] ENOV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:46.303580] [INFO ] [MAIN ] ENO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:46.309532] [DEBUG] [LOCAL ] ENO: Loaded 1952 existing records from primary storage. [2025-09-29T02:14:46.309796] [INFO ] [MAIN ] ENO: Loaded 1952 primary data records. [2025-09-29T02:14:46.754187] [DEBUG] [LOCAL ] ENR: Loaded 43336 existing records from primary storage. [2025-09-29T02:14:46.788567] [INFO ] [MAIN ] ENR: Loaded 43336 primary data records. [2025-09-29T02:14:46.826256] [DEBUG] [LOCAL ] ENOV: Loaded 45799 existing records from primary storage. [2025-09-29T02:14:46.841102] [INFO ] [MAIN ] ENOV: Loaded 45799 primary data records. [2025-09-29T02:14:47.508446] [DEBUG] [MAIN ] ENO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:47.510488] [INFO ] [MAIN ] ENO: Generated 1820 derivative records from 1952 primary records. [2025-09-29T02:14:47.511242] [DEBUG] [LOCAL ] ENO: Saving derivative data. [2025-09-29T02:14:47.530180] [DEBUG] [LOCAL ] ENO: Derivative data saved (1820 records). [2025-09-29T02:14:47.530377] [INFO ] [MAIN ] ENO: Successfully saved derivative data. [2025-09-29T02:14:47.533550] [INFO ] [MAIN ] Derivative Progress: 691/2211 symbols completed. ENO took 1.2s. Estimated remaining: 10m 39s. Rate: 142.7 symbols/min [2025-09-29T02:14:47.534527] [INFO ] [MAIN ] ENS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:47.553527] [DEBUG] [MAIN ] ENR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:47.555743] [INFO ] [MAIN ] ENR: Generated 1820 derivative records from 43336 primary records. [2025-09-29T02:14:47.556005] [DEBUG] [LOCAL ] ENR: Saving derivative data. [2025-09-29T02:14:47.594882] [DEBUG] [LOCAL ] ENR: Derivative data saved (1820 records). [2025-09-29T02:14:47.600473] [INFO ] [MAIN ] ENR: Successfully saved derivative data. [2025-09-29T02:14:47.602801] [INFO ] [MAIN ] Derivative Progress: 692/2211 symbols completed. ENR took 1.3s. Estimated remaining: 10m 38s. Rate: 142.8 symbols/min [2025-09-29T02:14:47.603279] [INFO ] [MAIN ] ENVA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:47.603093] [DEBUG] [MAIN ] ENOV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:47.604778] [INFO ] [MAIN ] ENOV: Generated 1820 derivative records from 45799 primary records. [2025-09-29T02:14:47.605316] [DEBUG] [LOCAL ] ENOV: Saving derivative data. [2025-09-29T02:14:47.633793] [DEBUG] [LOCAL ] ENOV: Derivative data saved (1820 records). [2025-09-29T02:14:47.634767] [INFO ] [MAIN ] ENOV: Successfully saved derivative data. [2025-09-29T02:14:47.637497] [INFO ] [MAIN ] Derivative Progress: 693/2211 symbols completed. ENOV took 1.3s. Estimated remaining: 10m 37s. Rate: 143.0 symbols/min [2025-09-29T02:14:47.634438] [DEBUG] [LOCAL ] ENS: Loaded 29869 existing records from primary storage. [2025-09-29T02:14:47.637991] [INFO ] [MAIN ] ENS: Loaded 29869 primary data records. [2025-09-29T02:14:47.638108] [INFO ] [MAIN ] EOD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:47.787162] [DEBUG] [LOCAL ] EOD: Loaded 14232 existing records from primary storage. [2025-09-29T02:14:47.787493] [INFO ] [MAIN ] EOD: Loaded 14232 primary data records. [2025-09-29T02:14:47.788882] [DEBUG] [LOCAL ] ENVA: Loaded 25914 existing records from primary storage. [2025-09-29T02:14:47.789192] [INFO ] [MAIN ] ENVA: Loaded 25914 primary data records. [2025-09-29T02:14:48.782687] [DEBUG] [MAIN ] ENS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:48.785335] [INFO ] [MAIN ] ENS: Generated 1820 derivative records from 29869 primary records. [2025-09-29T02:14:48.786009] [DEBUG] [LOCAL ] ENS: Saving derivative data. [2025-09-29T02:14:48.808044] [DEBUG] [LOCAL ] ENS: Derivative data saved (1820 records). [2025-09-29T02:14:48.809947] [INFO ] [MAIN ] ENS: Successfully saved derivative data. [2025-09-29T02:14:48.814602] [INFO ] [MAIN ] Derivative Progress: 694/2211 symbols completed. ENS took 1.3s. Estimated remaining: 10m 38s. Rate: 142.7 symbols/min [2025-09-29T02:14:48.825383] [INFO ] [MAIN ] EOG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:48.831833] [DEBUG] [MAIN ] EOD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:48.846406] [INFO ] [MAIN ] EOD: Generated 1820 derivative records from 14232 primary records. [2025-09-29T02:14:48.847525] [DEBUG] [MAIN ] ENVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:48.848686] [INFO ] [MAIN ] ENVA: Generated 1820 derivative records from 25914 primary records. [2025-09-29T02:14:48.848808] [DEBUG] [LOCAL ] ENVA: Saving derivative data. [2025-09-29T02:14:48.847617] [DEBUG] [LOCAL ] EOD: Saving derivative data. [2025-09-29T02:14:48.884249] [DEBUG] [LOCAL ] ENVA: Derivative data saved (1820 records). [2025-09-29T02:14:48.884796] [INFO ] [MAIN ] ENVA: Successfully saved derivative data. [2025-09-29T02:14:48.888020] [DEBUG] [LOCAL ] EOD: Derivative data saved (1820 records). [2025-09-29T02:14:48.891369] [INFO ] [MAIN ] EOD: Successfully saved derivative data. [2025-09-29T02:14:48.891022] [INFO ] [MAIN ] Derivative Progress: 695/2211 symbols completed. ENVA took 1.3s. Estimated remaining: 10m 37s. Rate: 142.8 symbols/min [2025-09-29T02:14:48.894244] [INFO ] [MAIN ] Derivative Progress: 696/2211 symbols completed. EOD took 1.3s. Estimated remaining: 10m 35s. Rate: 143.0 symbols/min [2025-09-29T02:14:48.894169] [INFO ] [MAIN ] EOI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:48.894918] [INFO ] [MAIN ] EOS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:48.915662] [DEBUG] [LOCAL ] EOI: Loaded 10783 existing records from primary storage. [2025-09-29T02:14:48.915988] [INFO ] [MAIN ] EOI: Loaded 10783 primary data records. [2025-09-29T02:14:48.997240] [DEBUG] [LOCAL ] EOS: Loaded 15589 existing records from primary storage. [2025-09-29T02:14:49.030137] [INFO ] [MAIN ] EOS: Loaded 15589 primary data records. [2025-09-29T02:14:49.137104] [DEBUG] [LOCAL ] EOG: Loaded 54121 existing records from primary storage. [2025-09-29T02:14:49.177940] [INFO ] [MAIN ] EOG: Loaded 54121 primary data records. [2025-09-29T02:14:50.075932] [DEBUG] [MAIN ] EOI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:50.077968] [INFO ] [MAIN ] EOI: Generated 1820 derivative records from 10783 primary records. [2025-09-29T02:14:50.078341] [DEBUG] [LOCAL ] EOI: Saving derivative data. [2025-09-29T02:14:50.113509] [DEBUG] [LOCAL ] EOI: Derivative data saved (1820 records). [2025-09-29T02:14:50.114576] [INFO ] [MAIN ] EOI: Successfully saved derivative data. [2025-09-29T02:14:50.118044] [INFO ] [MAIN ] Derivative Progress: 697/2211 symbols completed. EOI took 1.2s. Estimated remaining: 10m 37s. Rate: 142.6 symbols/min [2025-09-29T02:14:50.119294] [INFO ] [MAIN ] EOT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:50.118719] [DEBUG] [MAIN ] EOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:50.120886] [INFO ] [MAIN ] EOS: Generated 1820 derivative records from 15589 primary records. [2025-09-29T02:14:50.121756] [DEBUG] [LOCAL ] EOS: Saving derivative data. [2025-09-29T02:14:50.143693] [DEBUG] [LOCAL ] EOS: Derivative data saved (1820 records). [2025-09-29T02:14:50.145689] [INFO ] [MAIN ] EOS: Successfully saved derivative data. [2025-09-29T02:14:50.153089] [INFO ] [MAIN ] Derivative Progress: 698/2211 symbols completed. EOS took 1.3s. Estimated remaining: 10m 36s. Rate: 142.8 symbols/min [2025-09-29T02:14:50.153310] [DEBUG] [LOCAL ] EOT: Loaded 6916 existing records from primary storage. [2025-09-29T02:14:50.167032] [INFO ] [MAIN ] EPAC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:50.167609] [DEBUG] [MAIN ] EOG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:50.168105] [INFO ] [MAIN ] EOT: Loaded 6916 primary data records. [2025-09-29T02:14:50.175014] [INFO ] [MAIN ] EOG: Generated 1820 derivative records from 54121 primary records. [2025-09-29T02:14:50.203760] [DEBUG] [LOCAL ] EOG: Saving derivative data. [2025-09-29T02:14:50.324571] [DEBUG] [LOCAL ] EOG: Derivative data saved (1820 records). [2025-09-29T02:14:50.392633] [INFO ] [MAIN ] EOG: Successfully saved derivative data. [2025-09-29T02:14:50.406357] [DEBUG] [LOCAL ] EPAC: Loaded 27416 existing records from primary storage. [2025-09-29T02:14:50.405376] [INFO ] [MAIN ] Derivative Progress: 699/2211 symbols completed. EOG took 1.6s. Estimated remaining: 10m 35s. Rate: 142.9 symbols/min [2025-09-29T02:14:50.529154] [INFO ] [MAIN ] EPAM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:50.529323] [INFO ] [MAIN ] EPAC: Loaded 27416 primary data records. [2025-09-29T02:14:50.932933] [DEBUG] [LOCAL ] EPAM: Loaded 40450 existing records from primary storage. [2025-09-29T02:14:50.934874] [INFO ] [MAIN ] EPAM: Loaded 40450 primary data records. [2025-09-29T02:14:50.973226] [DEBUG] [MAIN ] EOT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:51.043463] [INFO ] [MAIN ] EOT: Generated 1820 derivative records from 6916 primary records. [2025-09-29T02:14:51.069121] [DEBUG] [LOCAL ] EOT: Saving derivative data. [2025-09-29T02:14:51.173900] [DEBUG] [LOCAL ] EOT: Derivative data saved (1820 records). [2025-09-29T02:14:51.298519] [INFO ] [MAIN ] EOT: Successfully saved derivative data. [2025-09-29T02:14:51.302683] [INFO ] [MAIN ] Derivative Progress: 700/2211 symbols completed. EOT took 1.2s. Estimated remaining: 10m 35s. Rate: 142.7 symbols/min [2025-09-29T02:14:51.303295] [INFO ] [MAIN ] EPC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:51.325535] [DEBUG] [MAIN ] EPAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:51.327242] [INFO ] [MAIN ] EPAC: Generated 1820 derivative records from 27416 primary records. [2025-09-29T02:14:51.327454] [DEBUG] [LOCAL ] EPAC: Saving derivative data. [2025-09-29T02:14:51.347418] [DEBUG] [LOCAL ] EPAC: Derivative data saved (1820 records). [2025-09-29T02:14:51.347766] [INFO ] [MAIN ] EPAC: Successfully saved derivative data. [2025-09-29T02:14:51.351296] [INFO ] [MAIN ] Derivative Progress: 701/2211 symbols completed. EPAC took 1.2s. Estimated remaining: 10m 34s. Rate: 142.9 symbols/min [2025-09-29T02:14:51.352063] [INFO ] [MAIN ] EPD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:51.383377] [DEBUG] [MAIN ] EPAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:51.384333] [INFO ] [MAIN ] EPAM: Generated 1820 derivative records from 40450 primary records. [2025-09-29T02:14:51.396700] [DEBUG] [LOCAL ] EPAM: Saving derivative data. [2025-09-29T02:14:51.399306] [DEBUG] [LOCAL ] EPC: Loaded 40383 existing records from primary storage. [2025-09-29T02:14:51.399816] [INFO ] [MAIN ] EPC: Loaded 40383 primary data records. [2025-09-29T02:14:51.562609] [DEBUG] [LOCAL ] EPAM: Derivative data saved (1820 records). [2025-09-29T02:14:51.588912] [INFO ] [MAIN ] EPAM: Successfully saved derivative data. [2025-09-29T02:14:51.624945] [INFO ] [MAIN ] Derivative Progress: 702/2211 symbols completed. EPAM took 1.1s. Estimated remaining: 10m 33s. Rate: 142.9 symbols/min [2025-09-29T02:14:51.667372] [INFO ] [MAIN ] EPR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:51.802145] [DEBUG] [LOCAL ] EPD: Loaded 54389 existing records from primary storage. [2025-09-29T02:14:51.802574] [INFO ] [MAIN ] EPD: Loaded 54389 primary data records. [2025-09-29T02:14:52.192218] [DEBUG] [LOCAL ] EPR: Loaded 44722 existing records from primary storage. [2025-09-29T02:14:52.208543] [INFO ] [MAIN ] EPR: Loaded 44722 primary data records. [2025-09-29T02:14:52.209120] [DEBUG] [MAIN ] EPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:52.252266] [INFO ] [MAIN ] EPC: Generated 1820 derivative records from 40383 primary records. [2025-09-29T02:14:52.286149] [DEBUG] [LOCAL ] EPC: Saving derivative data. [2025-09-29T02:14:52.435949] [DEBUG] [LOCAL ] EPC: Derivative data saved (1820 records). [2025-09-29T02:14:52.571623] [INFO ] [MAIN ] EPC: Successfully saved derivative data. [2025-09-29T02:14:52.575702] [INFO ] [MAIN ] Derivative Progress: 703/2211 symbols completed. EPC took 1.3s. Estimated remaining: 10m 34s. Rate: 142.7 symbols/min [2025-09-29T02:14:52.589575] [DEBUG] [MAIN ] EPD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:52.591280] [INFO ] [MAIN ] EPD: Generated 1820 derivative records from 54389 primary records. [2025-09-29T02:14:52.591372] [DEBUG] [LOCAL ] EPD: Saving derivative data. [2025-09-29T02:14:52.611051] [DEBUG] [LOCAL ] EPD: Derivative data saved (1820 records). [2025-09-29T02:14:52.611213] [INFO ] [MAIN ] EPD: Successfully saved derivative data. [2025-09-29T02:14:52.615166] [INFO ] [MAIN ] Derivative Progress: 704/2211 symbols completed. EPD took 1.3s. Estimated remaining: 10m 33s. Rate: 142.9 symbols/min [2025-09-29T02:14:52.635330] [DEBUG] [MAIN ] EPR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:52.636073] [INFO ] [MAIN ] EPR: Generated 1820 derivative records from 44722 primary records. [2025-09-29T02:14:52.636177] [DEBUG] [LOCAL ] EPR: Saving derivative data. [2025-09-29T02:14:52.651759] [DEBUG] [LOCAL ] EPR: Derivative data saved (1820 records). [2025-09-29T02:14:52.651910] [INFO ] [MAIN ] EPR: Successfully saved derivative data. [2025-09-29T02:14:52.654768] [INFO ] [MAIN ] Derivative Progress: 705/2211 symbols completed. EPR took 1.0s. Estimated remaining: 10m 32s. Rate: 143.0 symbols/min [2025-09-29T02:14:52.655239] [INFO ] [MAIN ] EPRT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:52.655372] [INFO ] [MAIN ] EQBK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:52.655957] [INFO ] [MAIN ] EQH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:52.672379] [DEBUG] [LOCAL ] EQBK: Loaded 11050 existing records from primary storage. [2025-09-29T02:14:52.673369] [INFO ] [MAIN ] EQBK: Loaded 11050 primary data records. [2025-09-29T02:14:53.114383] [DEBUG] [LOCAL ] EPRT: Loaded 49306 existing records from primary storage. [2025-09-29T02:14:53.114606] [INFO ] [MAIN ] EPRT: Loaded 49306 primary data records. [2025-09-29T02:14:53.115631] [DEBUG] [LOCAL ] EQH: Loaded 53435 existing records from primary storage. [2025-09-29T02:14:53.117029] [INFO ] [MAIN ] EQH: Loaded 53435 primary data records. [2025-09-29T02:14:53.815566] [DEBUG] [MAIN ] EQBK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:53.817530] [INFO ] [MAIN ] EQBK: Generated 1820 derivative records from 11050 primary records. [2025-09-29T02:14:53.819455] [DEBUG] [LOCAL ] EQBK: Saving derivative data. [2025-09-29T02:14:53.836900] [DEBUG] [LOCAL ] EQBK: Derivative data saved (1820 records). [2025-09-29T02:14:53.838741] [INFO ] [MAIN ] EQBK: Successfully saved derivative data. [2025-09-29T02:14:53.842105] [INFO ] [MAIN ] Derivative Progress: 706/2211 symbols completed. EQBK took 1.2s. Estimated remaining: 10m 33s. Rate: 142.7 symbols/min [2025-09-29T02:14:53.842563] [INFO ] [MAIN ] EQNR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:53.861659] [DEBUG] [MAIN ] EPRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:53.865526] [INFO ] [MAIN ] EPRT: Generated 1820 derivative records from 49306 primary records. [2025-09-29T02:14:53.865948] [DEBUG] [LOCAL ] EPRT: Saving derivative data. [2025-09-29T02:14:53.896021] [DEBUG] [LOCAL ] EPRT: Derivative data saved (1820 records). [2025-09-29T02:14:53.896267] [DEBUG] [MAIN ] EQH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:53.896700] [INFO ] [MAIN ] EPRT: Successfully saved derivative data. [2025-09-29T02:14:53.897867] [INFO ] [MAIN ] EQH: Generated 1820 derivative records from 53435 primary records. [2025-09-29T02:14:53.901489] [INFO ] [MAIN ] Derivative Progress: 707/2211 symbols completed. EPRT took 1.2s. Estimated remaining: 10m 32s. Rate: 142.8 symbols/min [2025-09-29T02:14:53.901734] [DEBUG] [LOCAL ] EQH: Saving derivative data. [2025-09-29T02:14:53.901909] [INFO ] [MAIN ] EQR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:53.924505] [DEBUG] [LOCAL ] EQH: Derivative data saved (1820 records). [2025-09-29T02:14:53.924725] [INFO ] [MAIN ] EQH: Successfully saved derivative data. [2025-09-29T02:14:53.927996] [INFO ] [MAIN ] Derivative Progress: 708/2211 symbols completed. EQH took 1.3s. Estimated remaining: 10m 30s. Rate: 143.0 symbols/min [2025-09-29T02:14:53.928329] [INFO ] [MAIN ] EQT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:54.009421] [DEBUG] [LOCAL ] EQNR: Loaded 53809 existing records from primary storage. [2025-09-29T02:14:54.010129] [INFO ] [MAIN ] EQNR: Loaded 53809 primary data records. [2025-09-29T02:14:54.030698] [DEBUG] [LOCAL ] EQR: Loaded 52190 existing records from primary storage. [2025-09-29T02:14:54.042418] [INFO ] [MAIN ] EQR: Loaded 52190 primary data records. [2025-09-29T02:14:54.307171] [DEBUG] [LOCAL ] EQT: Loaded 54462 existing records from primary storage. [2025-09-29T02:14:54.346195] [INFO ] [MAIN ] EQT: Loaded 54462 primary data records. [2025-09-29T02:14:55.096038] [DEBUG] [MAIN ] EQNR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:55.097856] [INFO ] [MAIN ] EQNR: Generated 1820 derivative records from 53809 primary records. [2025-09-29T02:14:55.098128] [DEBUG] [LOCAL ] EQNR: Saving derivative data. [2025-09-29T02:14:55.121137] [DEBUG] [MAIN ] EQR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:55.126697] [INFO ] [MAIN ] EQR: Generated 1820 derivative records from 52190 primary records. [2025-09-29T02:14:55.131343] [DEBUG] [LOCAL ] EQR: Saving derivative data. [2025-09-29T02:14:55.131494] [DEBUG] [LOCAL ] EQNR: Derivative data saved (1820 records). [2025-09-29T02:14:55.133010] [INFO ] [MAIN ] EQNR: Successfully saved derivative data. [2025-09-29T02:14:55.135974] [INFO ] [MAIN ] Derivative Progress: 709/2211 symbols completed. EQNR took 1.3s. Estimated remaining: 10m 32s. Rate: 142.7 symbols/min [2025-09-29T02:14:55.136265] [INFO ] [MAIN ] EQV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:55.163170] [DEBUG] [LOCAL ] EQV: Loaded 2840 existing records from primary storage. [2025-09-29T02:14:55.166097] [DEBUG] [LOCAL ] EQR: Derivative data saved (1820 records). [2025-09-29T02:14:55.166690] [INFO ] [MAIN ] EQR: Successfully saved derivative data. [2025-09-29T02:14:55.166471] [INFO ] [MAIN ] EQV: Loaded 2840 primary data records. [2025-09-29T02:14:55.170275] [INFO ] [MAIN ] Derivative Progress: 710/2211 symbols completed. EQR took 1.3s. Estimated remaining: 10m 30s. Rate: 142.8 symbols/min [2025-09-29T02:14:55.190677] [INFO ] [MAIN ] ERJ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:55.236401] [DEBUG] [MAIN ] EQT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:55.268260] [INFO ] [MAIN ] EQT: Generated 1820 derivative records from 54462 primary records. [2025-09-29T02:14:55.286675] [DEBUG] [LOCAL ] EQT: Saving derivative data. [2025-09-29T02:14:55.380070] [DEBUG] [LOCAL ] EQT: Derivative data saved (1820 records). [2025-09-29T02:14:55.551202] [INFO ] [MAIN ] EQT: Successfully saved derivative data. [2025-09-29T02:14:55.563960] [INFO ] [MAIN ] Derivative Progress: 711/2211 symbols completed. EQT took 1.6s. Estimated remaining: 10m 30s. Rate: 142.9 symbols/min [2025-09-29T02:14:55.564773] [INFO ] [MAIN ] ERO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:55.642956] [DEBUG] [MAIN ] EQV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:55.643314] [DEBUG] [LOCAL ] ERJ: Loaded 51477 existing records from primary storage. [2025-09-29T02:14:55.644421] [INFO ] [MAIN ] EQV: Generated 1820 derivative records from 2840 primary records. [2025-09-29T02:14:55.644737] [INFO ] [MAIN ] ERJ: Loaded 51477 primary data records. [2025-09-29T02:14:55.644980] [DEBUG] [LOCAL ] EQV: Saving derivative data. [2025-09-29T02:14:55.771782] [DEBUG] [LOCAL ] EQV: Derivative data saved (1820 records). [2025-09-29T02:14:55.790765] [DEBUG] [LOCAL ] ERO: Loaded 41901 existing records from primary storage. [2025-09-29T02:14:55.801720] [INFO ] [MAIN ] EQV: Successfully saved derivative data. [2025-09-29T02:14:55.809952] [INFO ] [MAIN ] Derivative Progress: 712/2211 symbols completed. EQV took 0.7s. Estimated remaining: 10m 29s. Rate: 142.9 symbols/min [2025-09-29T02:14:55.810125] [INFO ] [MAIN ] ERO: Loaded 41901 primary data records. [2025-09-29T02:14:55.830905] [INFO ] [MAIN ] ES: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:56.401206] [DEBUG] [LOCAL ] ES: Loaded 53309 existing records from primary storage. [2025-09-29T02:14:56.402148] [INFO ] [MAIN ] ES: Loaded 53309 primary data records. [2025-09-29T02:14:56.570519] [DEBUG] [MAIN ] ERJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:56.622042] [INFO ] [MAIN ] ERJ: Generated 1820 derivative records from 51477 primary records. [2025-09-29T02:14:56.628500] [DEBUG] [LOCAL ] ERJ: Saving derivative data. [2025-09-29T02:14:56.791951] [DEBUG] [MAIN ] ERO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:56.792812] [INFO ] [MAIN ] ERO: Generated 1820 derivative records from 41901 primary records. [2025-09-29T02:14:56.793112] [DEBUG] [LOCAL ] ERO: Saving derivative data. [2025-09-29T02:14:56.791082] [DEBUG] [LOCAL ] ERJ: Derivative data saved (1820 records). [2025-09-29T02:14:56.794040] [INFO ] [MAIN ] ERJ: Successfully saved derivative data. [2025-09-29T02:14:56.797329] [INFO ] [MAIN ] Derivative Progress: 713/2211 symbols completed. ERJ took 1.6s. Estimated remaining: 10m 30s. Rate: 142.7 symbols/min [2025-09-29T02:14:56.799060] [INFO ] [MAIN ] ESAB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:56.817450] [DEBUG] [LOCAL ] ERO: Derivative data saved (1820 records). [2025-09-29T02:14:56.817783] [INFO ] [MAIN ] ERO: Successfully saved derivative data. [2025-09-29T02:14:56.820439] [INFO ] [MAIN ] Derivative Progress: 714/2211 symbols completed. ERO took 1.3s. Estimated remaining: 10m 29s. Rate: 142.9 symbols/min [2025-09-29T02:14:56.820896] [INFO ] [MAIN ] ESE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:56.850250] [DEBUG] [MAIN ] ES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:56.851174] [INFO ] [MAIN ] ES: Generated 1820 derivative records from 53309 primary records. [2025-09-29T02:14:56.855265] [DEBUG] [LOCAL ] ES: Saving derivative data. [2025-09-29T02:14:56.874082] [DEBUG] [LOCAL ] ESAB: Loaded 26683 existing records from primary storage. [2025-09-29T02:14:56.885903] [INFO ] [MAIN ] ESAB: Loaded 26683 primary data records. [2025-09-29T02:14:56.885796] [DEBUG] [LOCAL ] ESE: Loaded 16878 existing records from primary storage. [2025-09-29T02:14:56.898988] [INFO ] [MAIN ] ESE: Loaded 16878 primary data records. [2025-09-29T02:14:57.020761] [DEBUG] [LOCAL ] ES: Derivative data saved (1820 records). [2025-09-29T02:14:57.098163] [INFO ] [MAIN ] ES: Successfully saved derivative data. [2025-09-29T02:14:57.150118] [INFO ] [MAIN ] Derivative Progress: 715/2211 symbols completed. ES took 1.3s. Estimated remaining: 10m 28s. Rate: 142.9 symbols/min [2025-09-29T02:14:57.167188] [INFO ] [MAIN ] ESI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:57.834438] [DEBUG] [MAIN ] ESAB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:57.835900] [INFO ] [MAIN ] ESAB: Generated 1820 derivative records from 26683 primary records. [2025-09-29T02:14:57.836129] [DEBUG] [LOCAL ] ESAB: Saving derivative data. [2025-09-29T02:14:57.887771] [DEBUG] [LOCAL ] ESI: Loaded 51566 existing records from primary storage. [2025-09-29T02:14:57.890163] [INFO ] [MAIN ] ESI: Loaded 51566 primary data records. [2025-09-29T02:14:57.892623] [DEBUG] [LOCAL ] ESAB: Derivative data saved (1820 records). [2025-09-29T02:14:57.893011] [INFO ] [MAIN ] ESAB: Successfully saved derivative data. [2025-09-29T02:14:57.897023] [INFO ] [MAIN ] Derivative Progress: 716/2211 symbols completed. ESAB took 1.1s. Estimated remaining: 10m 28s. Rate: 142.7 symbols/min [2025-09-29T02:14:57.939118] [INFO ] [MAIN ] ESNT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:57.983509] [DEBUG] [MAIN ] ESE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:58.032820] [INFO ] [MAIN ] ESE: Generated 1820 derivative records from 16878 primary records. [2025-09-29T02:14:58.064364] [DEBUG] [LOCAL ] ESE: Saving derivative data. [2025-09-29T02:14:58.229524] [DEBUG] [LOCAL ] ESE: Derivative data saved (1820 records). [2025-09-29T02:14:58.347392] [INFO ] [MAIN ] ESE: Successfully saved derivative data. [2025-09-29T02:14:58.350564] [INFO ] [MAIN ] Derivative Progress: 717/2211 symbols completed. ESE took 1.5s. Estimated remaining: 10m 28s. Rate: 142.7 symbols/min [2025-09-29T02:14:58.351074] [INFO ] [MAIN ] ESRT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:58.376128] [DEBUG] [LOCAL ] ESNT: Loaded 39065 existing records from primary storage. [2025-09-29T02:14:58.376798] [INFO ] [MAIN ] ESNT: Loaded 39065 primary data records. [2025-09-29T02:14:58.775557] [DEBUG] [LOCAL ] ESRT: Loaded 47104 existing records from primary storage. [2025-09-29T02:14:58.773714] [DEBUG] [MAIN ] ESI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:58.776853] [INFO ] [MAIN ] ESI: Generated 1820 derivative records from 51566 primary records. [2025-09-29T02:14:58.776970] [INFO ] [MAIN ] ESRT: Loaded 47104 primary data records. [2025-09-29T02:14:58.777322] [DEBUG] [LOCAL ] ESI: Saving derivative data. [2025-09-29T02:14:58.910622] [DEBUG] [LOCAL ] ESI: Derivative data saved (1820 records). [2025-09-29T02:14:58.922140] [INFO ] [MAIN ] ESI: Successfully saved derivative data. [2025-09-29T02:14:58.941343] [INFO ] [MAIN ] Derivative Progress: 718/2211 symbols completed. ESI took 1.8s. Estimated remaining: 10m 28s. Rate: 142.6 symbols/min [2025-09-29T02:14:59.152848] [DEBUG] [MAIN ] ESNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:59.154384] [INFO ] [MAIN ] ESNT: Generated 1820 derivative records from 39065 primary records. [2025-09-29T02:14:59.154872] [DEBUG] [LOCAL ] ESNT: Saving derivative data. [2025-09-29T02:14:59.174207] [DEBUG] [LOCAL ] ESNT: Derivative data saved (1820 records). [2025-09-29T02:14:59.174526] [INFO ] [MAIN ] ESNT: Successfully saved derivative data. [2025-09-29T02:14:59.178003] [INFO ] [MAIN ] Derivative Progress: 719/2211 symbols completed. ESNT took 1.2s. Estimated remaining: 10m 27s. Rate: 142.7 symbols/min [2025-09-29T02:14:59.195481] [DEBUG] [MAIN ] ESRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:14:59.196297] [INFO ] [MAIN ] ESRT: Generated 1820 derivative records from 47104 primary records. [2025-09-29T02:14:59.196383] [DEBUG] [LOCAL ] ESRT: Saving derivative data. [2025-09-29T02:14:59.212339] [DEBUG] [LOCAL ] ESRT: Derivative data saved (1820 records). [2025-09-29T02:14:59.212435] [INFO ] [MAIN ] ESRT: Successfully saved derivative data. [2025-09-29T02:14:59.215145] [INFO ] [MAIN ] Derivative Progress: 720/2211 symbols completed. ESRT took 0.9s. Estimated remaining: 10m 26s. Rate: 142.9 symbols/min [2025-09-29T02:14:59.215626] [INFO ] [MAIN ] ESS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:59.215711] [INFO ] [MAIN ] ESTC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:59.215774] [INFO ] [MAIN ] ET: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:14:59.269734] [DEBUG] [LOCAL ] ESS: Loaded 30441 existing records from primary storage. [2025-09-29T02:14:59.270180] [INFO ] [MAIN ] ESS: Loaded 30441 primary data records. [2025-09-29T02:14:59.454550] [DEBUG] [LOCAL ] ESTC: Loaded 50744 existing records from primary storage. [2025-09-29T02:14:59.461044] [DEBUG] [LOCAL ] ET: Loaded 54569 existing records from primary storage. [2025-09-29T02:14:59.523539] [INFO ] [MAIN ] ESTC: Loaded 50744 primary data records. [2025-09-29T02:14:59.528074] [INFO ] [MAIN ] ET: Loaded 54569 primary data records. [2025-09-29T02:15:00.469910] [DEBUG] [MAIN ] ESS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:00.470945] [INFO ] [MAIN ] ESS: Generated 1820 derivative records from 30441 primary records. [2025-09-29T02:15:00.471219] [DEBUG] [LOCAL ] ESS: Saving derivative data. [2025-09-29T02:15:00.492693] [DEBUG] [LOCAL ] ESS: Derivative data saved (1820 records). [2025-09-29T02:15:00.493496] [INFO ] [MAIN ] ESS: Successfully saved derivative data. [2025-09-29T02:15:00.496138] [INFO ] [MAIN ] Derivative Progress: 721/2211 symbols completed. ESS took 1.3s. Estimated remaining: 10m 27s. Rate: 142.5 symbols/min [2025-09-29T02:15:00.497905] [INFO ] [MAIN ] ETB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:00.523845] [DEBUG] [MAIN ] ET: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:00.525086] [INFO ] [MAIN ] ET: Generated 1820 derivative records from 54569 primary records. [2025-09-29T02:15:00.542169] [DEBUG] [MAIN ] ESTC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:00.543192] [INFO ] [MAIN ] ESTC: Generated 1820 derivative records from 50744 primary records. [2025-09-29T02:15:00.541821] [DEBUG] [LOCAL ] ET: Saving derivative data. [2025-09-29T02:15:00.543907] [DEBUG] [LOCAL ] ESTC: Saving derivative data. [2025-09-29T02:15:00.580912] [DEBUG] [LOCAL ] ETB: Loaded 12181 existing records from primary storage. [2025-09-29T02:15:00.579514] [DEBUG] [LOCAL ] ET: Derivative data saved (1820 records). [2025-09-29T02:15:00.581191] [INFO ] [MAIN ] ETB: Loaded 12181 primary data records. [2025-09-29T02:15:00.582166] [INFO ] [MAIN ] ET: Successfully saved derivative data. [2025-09-29T02:15:00.611705] [INFO ] [MAIN ] Derivative Progress: 722/2211 symbols completed. ET took 1.4s. Estimated remaining: 10m 26s. Rate: 142.7 symbols/min [2025-09-29T02:15:00.628315] [INFO ] [MAIN ] ETD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:00.634202] [DEBUG] [LOCAL ] ESTC: Derivative data saved (1820 records). [2025-09-29T02:15:00.651770] [INFO ] [MAIN ] ESTC: Successfully saved derivative data. [2025-09-29T02:15:00.654830] [INFO ] [MAIN ] Derivative Progress: 723/2211 symbols completed. ESTC took 1.4s. Estimated remaining: 10m 25s. Rate: 142.8 symbols/min [2025-09-29T02:15:00.696299] [INFO ] [MAIN ] ETG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:00.956730] [DEBUG] [LOCAL ] ETG: Loaded 16710 existing records from primary storage. [2025-09-29T02:15:00.957589] [INFO ] [MAIN ] ETG: Loaded 16710 primary data records. [2025-09-29T02:15:00.958714] [DEBUG] [LOCAL ] ETD: Loaded 27661 existing records from primary storage. [2025-09-29T02:15:00.959223] [INFO ] [MAIN ] ETD: Loaded 27661 primary data records. [2025-09-29T02:15:01.675735] [DEBUG] [MAIN ] ETB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:01.677338] [INFO ] [MAIN ] ETB: Generated 1820 derivative records from 12181 primary records. [2025-09-29T02:15:01.677508] [DEBUG] [LOCAL ] ETB: Saving derivative data. [2025-09-29T02:15:01.698357] [DEBUG] [LOCAL ] ETB: Derivative data saved (1820 records). [2025-09-29T02:15:01.699462] [INFO ] [MAIN ] ETB: Successfully saved derivative data. [2025-09-29T02:15:01.702075] [INFO ] [MAIN ] Derivative Progress: 724/2211 symbols completed. ETB took 1.2s. Estimated remaining: 10m 26s. Rate: 142.5 symbols/min [2025-09-29T02:15:01.702738] [INFO ] [MAIN ] ETJ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:01.728449] [DEBUG] [MAIN ] ETG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:01.742828] [INFO ] [MAIN ] ETG: Generated 1820 derivative records from 16710 primary records. [2025-09-29T02:15:01.748013] [DEBUG] [MAIN ] ETD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:01.748260] [DEBUG] [LOCAL ] ETG: Saving derivative data. [2025-09-29T02:15:01.751082] [INFO ] [MAIN ] ETD: Generated 1820 derivative records from 27661 primary records. [2025-09-29T02:15:01.752803] [DEBUG] [LOCAL ] ETD: Saving derivative data. [2025-09-29T02:15:01.781624] [DEBUG] [LOCAL ] ETJ: Loaded 16938 existing records from primary storage. [2025-09-29T02:15:01.787198] [INFO ] [MAIN ] ETJ: Loaded 16938 primary data records. [2025-09-29T02:15:01.824190] [DEBUG] [LOCAL ] ETG: Derivative data saved (1820 records). [2025-09-29T02:15:01.869735] [INFO ] [MAIN ] ETG: Successfully saved derivative data. [2025-09-29T02:15:01.906897] [DEBUG] [LOCAL ] ETD: Derivative data saved (1820 records). [2025-09-29T02:15:01.909781] [INFO ] [MAIN ] Derivative Progress: 725/2211 symbols completed. ETG took 1.2s. Estimated remaining: 10m 25s. Rate: 142.6 symbols/min [2025-09-29T02:15:01.940133] [INFO ] [MAIN ] ETN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:01.926366] [INFO ] [MAIN ] ETD: Successfully saved derivative data. [2025-09-29T02:15:01.943373] [INFO ] [MAIN ] Derivative Progress: 726/2211 symbols completed. ETD took 1.3s. Estimated remaining: 10m 24s. Rate: 142.8 symbols/min [2025-09-29T02:15:01.960275] [INFO ] [MAIN ] ETO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:02.232495] [DEBUG] [LOCAL ] ETO: Loaded 6600 existing records from primary storage. [2025-09-29T02:15:02.234807] [INFO ] [MAIN ] ETO: Loaded 6600 primary data records. [2025-09-29T02:15:02.627211] [DEBUG] [LOCAL ] ETN: Loaded 53593 existing records from primary storage. [2025-09-29T02:15:02.628113] [INFO ] [MAIN ] ETN: Loaded 53593 primary data records. [2025-09-29T02:15:02.705236] [DEBUG] [MAIN ] ETJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:02.739944] [INFO ] [MAIN ] ETJ: Generated 1820 derivative records from 16938 primary records. [2025-09-29T02:15:02.761735] [DEBUG] [LOCAL ] ETJ: Saving derivative data. [2025-09-29T02:15:03.010236] [DEBUG] [LOCAL ] ETJ: Derivative data saved (1820 records). [2025-09-29T02:15:03.012100] [INFO ] [MAIN ] ETJ: Successfully saved derivative data. [2025-09-29T02:15:03.014308] [INFO ] [MAIN ] Derivative Progress: 727/2211 symbols completed. ETJ took 1.3s. Estimated remaining: 10m 25s. Rate: 142.5 symbols/min [2025-09-29T02:15:03.014567] [INFO ] [MAIN ] ETR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:03.042635] [DEBUG] [MAIN ] ETO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:03.043908] [INFO ] [MAIN ] ETO: Generated 1820 derivative records from 6600 primary records. [2025-09-29T02:15:03.044275] [DEBUG] [LOCAL ] ETO: Saving derivative data. [2025-09-29T02:15:03.063006] [DEBUG] [LOCAL ] ETO: Derivative data saved (1820 records). [2025-09-29T02:15:03.063547] [INFO ] [MAIN ] ETO: Successfully saved derivative data. [2025-09-29T02:15:03.066117] [INFO ] [MAIN ] Derivative Progress: 728/2211 symbols completed. ETO took 1.1s. Estimated remaining: 10m 24s. Rate: 142.7 symbols/min [2025-09-29T02:15:03.066542] [INFO ] [MAIN ] ETV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:03.088817] [DEBUG] [MAIN ] ETN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:03.089813] [INFO ] [MAIN ] ETN: Generated 1820 derivative records from 53593 primary records. [2025-09-29T02:15:03.089968] [DEBUG] [LOCAL ] ETN: Saving derivative data. [2025-09-29T02:15:03.131413] [DEBUG] [LOCAL ] ETN: Derivative data saved (1820 records). [2025-09-29T02:15:03.139688] [INFO ] [MAIN ] ETN: Successfully saved derivative data. [2025-09-29T02:15:03.161966] [INFO ] [MAIN ] Derivative Progress: 729/2211 symbols completed. ETN took 1.2s. Estimated remaining: 10m 23s. Rate: 142.8 symbols/min [2025-09-29T02:15:03.158463] [DEBUG] [LOCAL ] ETV: Loaded 21729 existing records from primary storage. [2025-09-29T02:15:03.164198] [DEBUG] [LOCAL ] ETR: Loaded 54001 existing records from primary storage. [2025-09-29T02:15:03.164570] [INFO ] [MAIN ] ETW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:03.165127] [INFO ] [MAIN ] ETR: Loaded 54001 primary data records. [2025-09-29T02:15:03.165020] [INFO ] [MAIN ] ETV: Loaded 21729 primary data records. [2025-09-29T02:15:03.438711] [DEBUG] [LOCAL ] ETW: Loaded 25463 existing records from primary storage. [2025-09-29T02:15:03.455242] [INFO ] [MAIN ] ETW: Loaded 25463 primary data records. [2025-09-29T02:15:04.360473] [DEBUG] [MAIN ] ETV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:04.361801] [DEBUG] [MAIN ] ETR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:04.364173] [INFO ] [MAIN ] ETR: Generated 1820 derivative records from 54001 primary records. [2025-09-29T02:15:04.363318] [INFO ] [MAIN ] ETV: Generated 1820 derivative records from 21729 primary records. [2025-09-29T02:15:04.364557] [DEBUG] [LOCAL ] ETV: Saving derivative data. [2025-09-29T02:15:04.364443] [DEBUG] [LOCAL ] ETR: Saving derivative data. [2025-09-29T02:15:04.403165] [DEBUG] [LOCAL ] ETV: Derivative data saved (1820 records). [2025-09-29T02:15:04.403857] [INFO ] [MAIN ] ETV: Successfully saved derivative data. [2025-09-29T02:15:04.409182] [INFO ] [MAIN ] Derivative Progress: 730/2211 symbols completed. ETV took 1.3s. Estimated remaining: 10m 24s. Rate: 142.5 symbols/min [2025-09-29T02:15:04.409512] [INFO ] [MAIN ] ETX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:04.426716] [DEBUG] [MAIN ] ETW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:04.428150] [DEBUG] [LOCAL ] ETR: Derivative data saved (1820 records). [2025-09-29T02:15:04.430277] [INFO ] [MAIN ] ETW: Generated 1820 derivative records from 25463 primary records. [2025-09-29T02:15:04.430466] [DEBUG] [LOCAL ] ETW: Saving derivative data. [2025-09-29T02:15:04.428371] [INFO ] [MAIN ] ETR: Successfully saved derivative data. [2025-09-29T02:15:04.434417] [INFO ] [MAIN ] Derivative Progress: 731/2211 symbols completed. ETR took 1.4s. Estimated remaining: 10m 23s. Rate: 142.6 symbols/min [2025-09-29T02:15:04.438294] [DEBUG] [LOCAL ] ETX: Loaded 5028 existing records from primary storage. [2025-09-29T02:15:04.438747] [INFO ] [MAIN ] ETY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:04.446181] [INFO ] [MAIN ] ETX: Loaded 5028 primary data records. [2025-09-29T02:15:04.475700] [DEBUG] [LOCAL ] ETW: Derivative data saved (1820 records). [2025-09-29T02:15:04.512832] [INFO ] [MAIN ] ETW: Successfully saved derivative data. [2025-09-29T02:15:04.543260] [INFO ] [MAIN ] Derivative Progress: 732/2211 symbols completed. ETW took 1.4s. Estimated remaining: 10m 22s. Rate: 142.8 symbols/min [2025-09-29T02:15:04.568505] [INFO ] [MAIN ] EVC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:04.676250] [DEBUG] [LOCAL ] ETY: Loaded 23078 existing records from primary storage. [2025-09-29T02:15:04.684094] [INFO ] [MAIN ] ETY: Loaded 23078 primary data records. [2025-09-29T02:15:04.881324] [DEBUG] [LOCAL ] EVC: Loaded 19415 existing records from primary storage. [2025-09-29T02:15:04.919355] [INFO ] [MAIN ] EVC: Loaded 19415 primary data records. [2025-09-29T02:15:05.567445] [DEBUG] [MAIN ] ETX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:05.568999] [INFO ] [MAIN ] ETX: Generated 1820 derivative records from 5028 primary records. [2025-09-29T02:15:05.570115] [DEBUG] [LOCAL ] ETX: Saving derivative data. [2025-09-29T02:15:05.610892] [DEBUG] [MAIN ] ETY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:05.612219] [INFO ] [MAIN ] ETY: Generated 1820 derivative records from 23078 primary records. [2025-09-29T02:15:05.610969] [DEBUG] [LOCAL ] ETX: Derivative data saved (1820 records). [2025-09-29T02:15:05.612475] [DEBUG] [LOCAL ] ETY: Saving derivative data. [2025-09-29T02:15:05.613008] [INFO ] [MAIN ] ETX: Successfully saved derivative data. [2025-09-29T02:15:05.617976] [INFO ] [MAIN ] Derivative Progress: 733/2211 symbols completed. ETX took 1.2s. Estimated remaining: 10m 22s. Rate: 142.5 symbols/min [2025-09-29T02:15:05.649895] [DEBUG] [MAIN ] EVC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:05.649614] [DEBUG] [LOCAL ] ETY: Derivative data saved (1820 records). [2025-09-29T02:15:05.650109] [INFO ] [MAIN ] ETY: Successfully saved derivative data. [2025-09-29T02:15:05.650836] [INFO ] [MAIN ] EVC: Generated 1820 derivative records from 19415 primary records. [2025-09-29T02:15:05.653729] [DEBUG] [LOCAL ] EVC: Saving derivative data. [2025-09-29T02:15:05.653530] [INFO ] [MAIN ] Derivative Progress: 734/2211 symbols completed. ETY took 1.2s. Estimated remaining: 10m 21s. Rate: 142.7 symbols/min [2025-09-29T02:15:05.669816] [DEBUG] [LOCAL ] EVC: Derivative data saved (1820 records). [2025-09-29T02:15:05.669911] [INFO ] [MAIN ] EVC: Successfully saved derivative data. [2025-09-29T02:15:05.673240] [INFO ] [MAIN ] Derivative Progress: 735/2211 symbols completed. EVC took 1.1s. Estimated remaining: 10m 20s. Rate: 142.8 symbols/min [2025-09-29T02:15:05.674057] [INFO ] [MAIN ] EVG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:05.674169] [INFO ] [MAIN ] EVF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:05.673957] [INFO ] [MAIN ] EVEX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:05.693682] [DEBUG] [LOCAL ] EVF: Loaded 9501 existing records from primary storage. [2025-09-29T02:15:05.694108] [DEBUG] [LOCAL ] EVG: Loaded 5862 existing records from primary storage. [2025-09-29T02:15:05.694471] [INFO ] [MAIN ] EVF: Loaded 9501 primary data records. [2025-09-29T02:15:05.694592] [INFO ] [MAIN ] EVG: Loaded 5862 primary data records. [2025-09-29T02:15:05.997829] [DEBUG] [LOCAL ] EVEX: Loaded 30549 existing records from primary storage. [2025-09-29T02:15:06.049705] [INFO ] [MAIN ] EVEX: Loaded 30549 primary data records. [2025-09-29T02:15:06.817437] [DEBUG] [MAIN ] EVG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:06.820941] [INFO ] [MAIN ] EVG: Generated 1820 derivative records from 5862 primary records. [2025-09-29T02:15:06.821314] [DEBUG] [LOCAL ] EVG: Saving derivative data. [2025-09-29T02:15:06.836891] [DEBUG] [MAIN ] EVF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:06.849491] [INFO ] [MAIN ] EVF: Generated 1820 derivative records from 9501 primary records. [2025-09-29T02:15:06.853330] [DEBUG] [LOCAL ] EVF: Saving derivative data. [2025-09-29T02:15:06.853400] [DEBUG] [LOCAL ] EVG: Derivative data saved (1820 records). [2025-09-29T02:15:06.854394] [INFO ] [MAIN ] EVG: Successfully saved derivative data. [2025-09-29T02:15:06.857154] [INFO ] [MAIN ] Derivative Progress: 736/2211 symbols completed. EVG took 1.2s. Estimated remaining: 10m 21s. Rate: 142.5 symbols/min [2025-09-29T02:15:06.857877] [INFO ] [MAIN ] EVH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:06.877329] [DEBUG] [LOCAL ] EVF: Derivative data saved (1820 records). [2025-09-29T02:15:06.877692] [INFO ] [MAIN ] EVF: Successfully saved derivative data. [2025-09-29T02:15:06.880365] [INFO ] [MAIN ] Derivative Progress: 737/2211 symbols completed. EVF took 1.2s. Estimated remaining: 10m 20s. Rate: 142.7 symbols/min [2025-09-29T02:15:06.880901] [INFO ] [MAIN ] EVN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:06.897326] [DEBUG] [MAIN ] EVEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:06.898223] [INFO ] [MAIN ] EVEX: Generated 1820 derivative records from 30549 primary records. [2025-09-29T02:15:06.898396] [DEBUG] [LOCAL ] EVEX: Saving derivative data. [2025-09-29T02:15:06.922673] [DEBUG] [LOCAL ] EVEX: Derivative data saved (1820 records). [2025-09-29T02:15:06.922987] [INFO ] [MAIN ] EVEX: Successfully saved derivative data. [2025-09-29T02:15:06.926167] [INFO ] [MAIN ] Derivative Progress: 738/2211 symbols completed. EVEX took 1.3s. Estimated remaining: 10m 19s. Rate: 142.8 symbols/min [2025-09-29T02:15:06.926717] [INFO ] [MAIN ] EVR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:06.933544] [DEBUG] [LOCAL ] EVN: Loaded 11217 existing records from primary storage. [2025-09-29T02:15:06.933732] [INFO ] [MAIN ] EVN: Loaded 11217 primary data records. [2025-09-29T02:15:07.141790] [DEBUG] [LOCAL ] EVH: Loaded 50111 existing records from primary storage. [2025-09-29T02:15:07.178736] [INFO ] [MAIN ] EVH: Loaded 50111 primary data records. [2025-09-29T02:15:07.403766] [DEBUG] [LOCAL ] EVR: Loaded 35882 existing records from primary storage. [2025-09-29T02:15:07.445302] [INFO ] [MAIN ] EVR: Loaded 35882 primary data records. [2025-09-29T02:15:08.036424] [DEBUG] [MAIN ] EVN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:08.039209] [INFO ] [MAIN ] EVN: Generated 1820 derivative records from 11217 primary records. [2025-09-29T02:15:08.039692] [DEBUG] [LOCAL ] EVN: Saving derivative data. [2025-09-29T02:15:08.065174] [DEBUG] [LOCAL ] EVN: Derivative data saved (1820 records). [2025-09-29T02:15:08.073527] [INFO ] [MAIN ] EVN: Successfully saved derivative data. [2025-09-29T02:15:08.082834] [INFO ] [MAIN ] Derivative Progress: 739/2211 symbols completed. EVN took 1.2s. Estimated remaining: 10m 20s. Rate: 142.5 symbols/min [2025-09-29T02:15:08.083680] [INFO ] [MAIN ] EVT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:08.084181] [DEBUG] [MAIN ] EVH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:08.085516] [INFO ] [MAIN ] EVH: Generated 1820 derivative records from 50111 primary records. [2025-09-29T02:15:08.085708] [DEBUG] [LOCAL ] EVH: Saving derivative data. [2025-09-29T02:15:08.105753] [DEBUG] [LOCAL ] EVH: Derivative data saved (1820 records). [2025-09-29T02:15:08.106289] [INFO ] [MAIN ] EVH: Successfully saved derivative data. [2025-09-29T02:15:08.118262] [INFO ] [MAIN ] Derivative Progress: 740/2211 symbols completed. EVH took 1.3s. Estimated remaining: 10m 19s. Rate: 142.7 symbols/min [2025-09-29T02:15:08.125021] [DEBUG] [MAIN ] EVR: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:15:08.124394] [INFO ] [MAIN ] EVTC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:08.126638] [INFO ] [MAIN ] EVR: Generated 1819 derivative records from 35882 primary records. [2025-09-29T02:15:08.127214] [DEBUG] [LOCAL ] EVR: Saving derivative data. [2025-09-29T02:15:08.156512] [DEBUG] [LOCAL ] EVT: Loaded 17270 existing records from primary storage. [2025-09-29T02:15:08.156769] [INFO ] [MAIN ] EVT: Loaded 17270 primary data records. [2025-09-29T02:15:08.155031] [DEBUG] [LOCAL ] EVR: Derivative data saved (1819 records). [2025-09-29T02:15:08.162141] [INFO ] [MAIN ] EVR: Successfully saved derivative data. [2025-09-29T02:15:08.195470] [INFO ] [MAIN ] Derivative Progress: 741/2211 symbols completed. EVR took 1.3s. Estimated remaining: 10m 17s. Rate: 142.8 symbols/min [2025-09-29T02:15:08.200887] [INFO ] [MAIN ] EVTL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:08.301170] [DEBUG] [LOCAL ] EVTC: Loaded 26745 existing records from primary storage. [2025-09-29T02:15:08.341808] [INFO ] [MAIN ] EVTC: Loaded 26745 primary data records. [2025-09-29T02:15:08.679415] [DEBUG] [LOCAL ] EVTL: Loaded 38140 existing records from primary storage. [2025-09-29T02:15:08.821233] [INFO ] [MAIN ] EVTL: Loaded 38140 primary data records. [2025-09-29T02:15:09.293411] [DEBUG] [MAIN ] EVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:09.310462] [INFO ] [MAIN ] EVT: Generated 1820 derivative records from 17270 primary records. [2025-09-29T02:15:09.311298] [DEBUG] [LOCAL ] EVT: Saving derivative data. [2025-09-29T02:15:09.333137] [DEBUG] [LOCAL ] EVT: Derivative data saved (1820 records). [2025-09-29T02:15:09.335904] [INFO ] [MAIN ] EVT: Successfully saved derivative data. [2025-09-29T02:15:09.339738] [INFO ] [MAIN ] Derivative Progress: 742/2211 symbols completed. EVT took 1.3s. Estimated remaining: 10m 18s. Rate: 142.5 symbols/min [2025-09-29T02:15:09.340243] [INFO ] [MAIN ] EVTR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:09.356378] [DEBUG] [MAIN ] EVTC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:09.358062] [INFO ] [MAIN ] EVTC: Generated 1820 derivative records from 26745 primary records. [2025-09-29T02:15:09.358201] [DEBUG] [LOCAL ] EVTC: Saving derivative data. [2025-09-29T02:15:09.377688] [DEBUG] [LOCAL ] EVTC: Derivative data saved (1820 records). [2025-09-29T02:15:09.378102] [INFO ] [MAIN ] EVTC: Successfully saved derivative data. [2025-09-29T02:15:09.381271] [INFO ] [MAIN ] Derivative Progress: 743/2211 symbols completed. EVTC took 1.3s. Estimated remaining: 10m 17s. Rate: 142.7 symbols/min [2025-09-29T02:15:09.381721] [INFO ] [MAIN ] EW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:09.409320] [DEBUG] [MAIN ] EVTL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:09.410425] [INFO ] [MAIN ] EVTL: Generated 1820 derivative records from 38140 primary records. [2025-09-29T02:15:09.410810] [DEBUG] [LOCAL ] EVTL: Saving derivative data. [2025-09-29T02:15:09.438038] [DEBUG] [LOCAL ] EVTR: Loaded 23675 existing records from primary storage. [2025-09-29T02:15:09.439806] [INFO ] [MAIN ] EVTR: Loaded 23675 primary data records. [2025-09-29T02:15:09.503626] [DEBUG] [LOCAL ] EVTL: Derivative data saved (1820 records). [2025-09-29T02:15:09.547899] [INFO ] [MAIN ] EVTL: Successfully saved derivative data. [2025-09-29T02:15:09.579447] [INFO ] [MAIN ] Derivative Progress: 744/2211 symbols completed. EVTL took 1.4s. Estimated remaining: 10m 16s. Rate: 142.8 symbols/min [2025-09-29T02:15:09.622881] [INFO ] [MAIN ] EXG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:09.642767] [DEBUG] [LOCAL ] EW: Loaded 54176 existing records from primary storage. [2025-09-29T02:15:09.683633] [INFO ] [MAIN ] EW: Loaded 54176 primary data records. [2025-09-29T02:15:10.066799] [DEBUG] [LOCAL ] EXG: Loaded 34725 existing records from primary storage. [2025-09-29T02:15:10.202472] [INFO ] [MAIN ] EXG: Loaded 34725 primary data records. [2025-09-29T02:15:10.368283] [DEBUG] [MAIN ] EVTR: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:15:10.394111] [INFO ] [MAIN ] EVTR: Generated 1819 derivative records from 23675 primary records. [2025-09-29T02:15:10.431827] [DEBUG] [LOCAL ] EVTR: Saving derivative data. [2025-09-29T02:15:10.586199] [DEBUG] [LOCAL ] EVTR: Derivative data saved (1819 records). [2025-09-29T02:15:10.588203] [INFO ] [MAIN ] EVTR: Successfully saved derivative data. [2025-09-29T02:15:10.591888] [INFO ] [MAIN ] Derivative Progress: 745/2211 symbols completed. EVTR took 1.3s. Estimated remaining: 10m 17s. Rate: 142.5 symbols/min [2025-09-29T02:15:10.592760] [INFO ] [MAIN ] EXK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:10.613149] [DEBUG] [MAIN ] EW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:10.615076] [INFO ] [MAIN ] EW: Generated 1820 derivative records from 54176 primary records. [2025-09-29T02:15:10.615387] [DEBUG] [LOCAL ] EW: Saving derivative data. [2025-09-29T02:15:10.644363] [DEBUG] [LOCAL ] EW: Derivative data saved (1820 records). [2025-09-29T02:15:10.645097] [INFO ] [MAIN ] EW: Successfully saved derivative data. [2025-09-29T02:15:10.649888] [INFO ] [MAIN ] Derivative Progress: 746/2211 symbols completed. EW took 1.3s. Estimated remaining: 10m 16s. Rate: 142.7 symbols/min [2025-09-29T02:15:10.650575] [INFO ] [MAIN ] EXP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:10.670976] [DEBUG] [MAIN ] EXG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:10.671949] [INFO ] [MAIN ] EXG: Generated 1820 derivative records from 34725 primary records. [2025-09-29T02:15:10.672101] [DEBUG] [LOCAL ] EXG: Saving derivative data. [2025-09-29T02:15:10.703605] [DEBUG] [LOCAL ] EXG: Derivative data saved (1820 records). [2025-09-29T02:15:10.703847] [INFO ] [MAIN ] EXG: Successfully saved derivative data. [2025-09-29T02:15:10.706585] [INFO ] [MAIN ] Derivative Progress: 747/2211 symbols completed. EXG took 1.1s. Estimated remaining: 10m 15s. Rate: 142.8 symbols/min [2025-09-29T02:15:10.706966] [INFO ] [MAIN ] EXPD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:10.737098] [DEBUG] [LOCAL ] EXK: Loaded 53904 existing records from primary storage. [2025-09-29T02:15:10.737298] [INFO ] [MAIN ] EXK: Loaded 53904 primary data records. [2025-09-29T02:15:10.856601] [DEBUG] [LOCAL ] EXP: Loaded 30275 existing records from primary storage. [2025-09-29T02:15:10.861426] [INFO ] [MAIN ] EXP: Loaded 30275 primary data records. [2025-09-29T02:15:11.471949] [DEBUG] [LOCAL ] EXPD: Loaded 48786 existing records from primary storage. [2025-09-29T02:15:11.487347] [INFO ] [MAIN ] EXPD: Loaded 48786 primary data records. [2025-09-29T02:15:11.851634] [DEBUG] [MAIN ] EXK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:11.862316] [INFO ] [MAIN ] EXK: Generated 1820 derivative records from 53904 primary records. [2025-09-29T02:15:11.868438] [DEBUG] [MAIN ] EXP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:11.870756] [INFO ] [MAIN ] EXP: Generated 1820 derivative records from 30275 primary records. [2025-09-29T02:15:11.868112] [DEBUG] [LOCAL ] EXK: Saving derivative data. [2025-09-29T02:15:11.871093] [DEBUG] [LOCAL ] EXP: Saving derivative data. [2025-09-29T02:15:11.902748] [DEBUG] [LOCAL ] EXK: Derivative data saved (1820 records). [2025-09-29T02:15:11.903221] [INFO ] [MAIN ] EXK: Successfully saved derivative data. [2025-09-29T02:15:11.908079] [INFO ] [MAIN ] Derivative Progress: 748/2211 symbols completed. EXK took 1.3s. Estimated remaining: 10m 16s. Rate: 142.5 symbols/min [2025-09-29T02:15:11.911986] [DEBUG] [LOCAL ] EXP: Derivative data saved (1820 records). [2025-09-29T02:15:11.912101] [INFO ] [MAIN ] EXP: Successfully saved derivative data. [2025-09-29T02:15:11.915685] [INFO ] [MAIN ] Derivative Progress: 749/2211 symbols completed. EXP took 1.3s. Estimated remaining: 10m 15s. Rate: 142.7 symbols/min [2025-09-29T02:15:11.932180] [DEBUG] [MAIN ] EXPD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:11.932976] [INFO ] [MAIN ] EXPD: Generated 1820 derivative records from 48786 primary records. [2025-09-29T02:15:11.933062] [DEBUG] [LOCAL ] EXPD: Saving derivative data. [2025-09-29T02:15:11.949489] [DEBUG] [LOCAL ] EXPD: Derivative data saved (1820 records). [2025-09-29T02:15:11.949686] [INFO ] [MAIN ] EXPD: Successfully saved derivative data. [2025-09-29T02:15:11.953158] [INFO ] [MAIN ] Derivative Progress: 750/2211 symbols completed. EXPD took 1.2s. Estimated remaining: 10m 14s. Rate: 142.9 symbols/min [2025-09-29T02:15:11.953830] [INFO ] [MAIN ] EXR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:11.953943] [INFO ] [MAIN ] F: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:11.953880] [INFO ] [MAIN ] FAF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:12.032063] [DEBUG] [LOCAL ] FAF: Loaded 42474 existing records from primary storage. [2025-09-29T02:15:12.033811] [INFO ] [MAIN ] FAF: Loaded 42474 primary data records. [2025-09-29T02:15:12.096999] [DEBUG] [LOCAL ] EXR: Loaded 46080 existing records from primary storage. [2025-09-29T02:15:12.167435] [INFO ] [MAIN ] EXR: Loaded 46080 primary data records. [2025-09-29T02:15:12.159687] [DEBUG] [LOCAL ] F: Loaded 54600 existing records from primary storage. [2025-09-29T02:15:12.167721] [INFO ] [MAIN ] F: Loaded 54600 primary data records. [2025-09-29T02:15:13.240476] [DEBUG] [MAIN ] EXR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:13.242262] [INFO ] [MAIN ] EXR: Generated 1820 derivative records from 46080 primary records. [2025-09-29T02:15:13.242402] [DEBUG] [LOCAL ] EXR: Saving derivative data. [2025-09-29T02:15:13.240980] [DEBUG] [MAIN ] FAF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:13.244252] [INFO ] [MAIN ] FAF: Generated 1820 derivative records from 42474 primary records. [2025-09-29T02:15:13.244706] [DEBUG] [LOCAL ] FAF: Saving derivative data. [2025-09-29T02:15:13.277737] [DEBUG] [LOCAL ] FAF: Derivative data saved (1820 records). [2025-09-29T02:15:13.279633] [INFO ] [MAIN ] FAF: Successfully saved derivative data. [2025-09-29T02:15:13.294348] [DEBUG] [MAIN ] F: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:13.295778] [INFO ] [MAIN ] F: Generated 1820 derivative records from 54600 primary records. [2025-09-29T02:15:13.298109] [INFO ] [MAIN ] Derivative Progress: 751/2211 symbols completed. FAF took 1.3s. Estimated remaining: 10m 15s. Rate: 142.4 symbols/min [2025-09-29T02:15:13.299532] [DEBUG] [LOCAL ] EXR: Derivative data saved (1820 records). [2025-09-29T02:15:13.300037] [INFO ] [MAIN ] EXR: Successfully saved derivative data. [2025-09-29T02:15:13.299605] [DEBUG] [LOCAL ] F: Saving derivative data. [2025-09-29T02:15:13.299902] [INFO ] [MAIN ] FBIN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:13.303974] [INFO ] [MAIN ] Derivative Progress: 752/2211 symbols completed. EXR took 1.4s. Estimated remaining: 10m 14s. Rate: 142.6 symbols/min [2025-09-29T02:15:13.317186] [INFO ] [MAIN ] FBK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:13.321505] [DEBUG] [LOCAL ] F: Derivative data saved (1820 records). [2025-09-29T02:15:13.322289] [INFO ] [MAIN ] F: Successfully saved derivative data. [2025-09-29T02:15:13.326152] [INFO ] [MAIN ] Derivative Progress: 753/2211 symbols completed. F took 1.4s. Estimated remaining: 10m 13s. Rate: 142.8 symbols/min [2025-09-29T02:15:13.326673] [INFO ] [MAIN ] FBP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:13.364508] [DEBUG] [LOCAL ] FBK: Loaded 26066 existing records from primary storage. [2025-09-29T02:15:13.364727] [INFO ] [MAIN ] FBK: Loaded 26066 primary data records. [2025-09-29T02:15:13.547791] [DEBUG] [LOCAL ] FBP: Loaded 46874 existing records from primary storage. [2025-09-29T02:15:13.642402] [DEBUG] [LOCAL ] FBIN: Loaded 51061 existing records from primary storage. [2025-09-29T02:15:13.617587] [INFO ] [MAIN ] FBP: Loaded 46874 primary data records. [2025-09-29T02:15:13.649722] [INFO ] [MAIN ] FBIN: Loaded 51061 primary data records. [2025-09-29T02:15:14.502674] [DEBUG] [MAIN ] FBK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:14.504302] [INFO ] [MAIN ] FBK: Generated 1820 derivative records from 26066 primary records. [2025-09-29T02:15:14.507208] [DEBUG] [LOCAL ] FBK: Saving derivative data. [2025-09-29T02:15:14.537927] [DEBUG] [LOCAL ] FBK: Derivative data saved (1820 records). [2025-09-29T02:15:14.538198] [INFO ] [MAIN ] FBK: Successfully saved derivative data. [2025-09-29T02:15:14.541162] [INFO ] [MAIN ] Derivative Progress: 754/2211 symbols completed. FBK took 1.2s. Estimated remaining: 10m 14s. Rate: 142.4 symbols/min [2025-09-29T02:15:14.542491] [INFO ] [MAIN ] FBRT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:14.567352] [DEBUG] [MAIN ] FBP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:14.569217] [INFO ] [MAIN ] FBP: Generated 1820 derivative records from 46874 primary records. [2025-09-29T02:15:14.569742] [DEBUG] [LOCAL ] FBP: Saving derivative data. [2025-09-29T02:15:14.585510] [DEBUG] [MAIN ] FBIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:14.596512] [INFO ] [MAIN ] FBIN: Generated 1820 derivative records from 51061 primary records. [2025-09-29T02:15:14.605430] [DEBUG] [LOCAL ] FBP: Derivative data saved (1820 records). [2025-09-29T02:15:14.605576] [DEBUG] [LOCAL ] FBIN: Saving derivative data. [2025-09-29T02:15:14.606070] [INFO ] [MAIN ] FBP: Successfully saved derivative data. [2025-09-29T02:15:14.614466] [INFO ] [MAIN ] Derivative Progress: 755/2211 symbols completed. FBP took 1.3s. Estimated remaining: 10m 13s. Rate: 142.6 symbols/min [2025-09-29T02:15:14.615459] [INFO ] [MAIN ] FC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:14.647570] [DEBUG] [LOCAL ] FBIN: Derivative data saved (1820 records). [2025-09-29T02:15:14.647795] [INFO ] [MAIN ] FBIN: Successfully saved derivative data. [2025-09-29T02:15:14.651405] [INFO ] [MAIN ] Derivative Progress: 756/2211 symbols completed. FBIN took 1.4s. Estimated remaining: 10m 11s. Rate: 142.8 symbols/min [2025-09-29T02:15:14.653093] [INFO ] [MAIN ] FCF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:14.667688] [DEBUG] [LOCAL ] FBRT: Loaded 34985 existing records from primary storage. [2025-09-29T02:15:14.668244] [INFO ] [MAIN ] FBRT: Loaded 34985 primary data records. [2025-09-29T02:15:14.814894] [DEBUG] [LOCAL ] FC: Loaded 15634 existing records from primary storage. [2025-09-29T02:15:14.842326] [INFO ] [MAIN ] FC: Loaded 15634 primary data records. [2025-09-29T02:15:15.193267] [DEBUG] [LOCAL ] FCF: Loaded 40237 existing records from primary storage. [2025-09-29T02:15:15.198150] [INFO ] [MAIN ] FCF: Loaded 40237 primary data records. [2025-09-29T02:15:15.900943] [DEBUG] [MAIN ] FBRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:15.902404] [INFO ] [MAIN ] FBRT: Generated 1820 derivative records from 34985 primary records. [2025-09-29T02:15:15.902892] [DEBUG] [LOCAL ] FBRT: Saving derivative data. [2025-09-29T02:15:15.926033] [DEBUG] [LOCAL ] FBRT: Derivative data saved (1820 records). [2025-09-29T02:15:15.939801] [INFO ] [MAIN ] FBRT: Successfully saved derivative data. [2025-09-29T02:15:15.940778] [DEBUG] [MAIN ] FC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:15.943218] [INFO ] [MAIN ] Derivative Progress: 757/2211 symbols completed. FBRT took 1.4s. Estimated remaining: 10m 13s. Rate: 142.4 symbols/min [2025-09-29T02:15:15.944719] [INFO ] [MAIN ] FC: Generated 1820 derivative records from 15634 primary records. [2025-09-29T02:15:15.945072] [DEBUG] [LOCAL ] FC: Saving derivative data. [2025-09-29T02:15:15.945797] [INFO ] [MAIN ] FCN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:15.966867] [DEBUG] [LOCAL ] FC: Derivative data saved (1820 records). [2025-09-29T02:15:15.967265] [INFO ] [MAIN ] FC: Successfully saved derivative data. [2025-09-29T02:15:15.970005] [INFO ] [MAIN ] Derivative Progress: 758/2211 symbols completed. FC took 1.4s. Estimated remaining: 10m 12s. Rate: 142.6 symbols/min [2025-09-29T02:15:15.978318] [INFO ] [MAIN ] FCPT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:15.984034] [DEBUG] [MAIN ] FCF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:15.985179] [INFO ] [MAIN ] FCF: Generated 1820 derivative records from 40237 primary records. [2025-09-29T02:15:15.985314] [DEBUG] [LOCAL ] FCF: Saving derivative data. [2025-09-29T02:15:16.012142] [DEBUG] [LOCAL ] FCF: Derivative data saved (1820 records). [2025-09-29T02:15:16.012447] [INFO ] [MAIN ] FCF: Successfully saved derivative data. [2025-09-29T02:15:16.015403] [INFO ] [MAIN ] Derivative Progress: 759/2211 symbols completed. FCF took 1.4s. Estimated remaining: 10m 10s. Rate: 142.7 symbols/min [2025-09-29T02:15:16.016730] [INFO ] [MAIN ] FCT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:16.026813] [DEBUG] [LOCAL ] FCN: Loaded 26559 existing records from primary storage. [2025-09-29T02:15:16.027802] [INFO ] [MAIN ] FCN: Loaded 26559 primary data records. [2025-09-29T02:15:16.184034] [DEBUG] [LOCAL ] FCT: Loaded 14613 existing records from primary storage. [2025-09-29T02:15:16.205993] [DEBUG] [LOCAL ] FCPT: Loaded 37955 existing records from primary storage. [2025-09-29T02:15:16.206189] [INFO ] [MAIN ] FCPT: Loaded 37955 primary data records. [2025-09-29T02:15:16.206286] [INFO ] [MAIN ] FCT: Loaded 14613 primary data records. [2025-09-29T02:15:17.086040] [DEBUG] [MAIN ] FCN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:17.087353] [INFO ] [MAIN ] FCN: Generated 1820 derivative records from 26559 primary records. [2025-09-29T02:15:17.087738] [DEBUG] [LOCAL ] FCN: Saving derivative data. [2025-09-29T02:15:17.124984] [DEBUG] [MAIN ] FCT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:17.123929] [DEBUG] [LOCAL ] FCN: Derivative data saved (1820 records). [2025-09-29T02:15:17.128245] [INFO ] [MAIN ] FCT: Generated 1820 derivative records from 14613 primary records. [2025-09-29T02:15:17.127192] [INFO ] [MAIN ] FCN: Successfully saved derivative data. [2025-09-29T02:15:17.128503] [DEBUG] [LOCAL ] FCT: Saving derivative data. [2025-09-29T02:15:17.139895] [INFO ] [MAIN ] Derivative Progress: 760/2211 symbols completed. FCN took 1.2s. Estimated remaining: 10m 11s. Rate: 142.4 symbols/min [2025-09-29T02:15:17.145843] [DEBUG] [MAIN ] FCPT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:17.147618] [INFO ] [MAIN ] FCPT: Generated 1820 derivative records from 37955 primary records. [2025-09-29T02:15:17.147769] [DEBUG] [LOCAL ] FCPT: Saving derivative data. [2025-09-29T02:15:17.146045] [INFO ] [MAIN ] FCX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:17.180313] [DEBUG] [LOCAL ] FCPT: Derivative data saved (1820 records). [2025-09-29T02:15:17.183041] [INFO ] [MAIN ] FCPT: Successfully saved derivative data. [2025-09-29T02:15:17.187760] [INFO ] [MAIN ] Derivative Progress: 761/2211 symbols completed. FCPT took 1.2s. Estimated remaining: 10m 10s. Rate: 142.6 symbols/min [2025-09-29T02:15:17.184467] [DEBUG] [LOCAL ] FCT: Derivative data saved (1820 records). [2025-09-29T02:15:17.188044] [INFO ] [MAIN ] FDP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:17.188243] [INFO ] [MAIN ] FCT: Successfully saved derivative data. [2025-09-29T02:15:17.192139] [INFO ] [MAIN ] Derivative Progress: 762/2211 symbols completed. FCT took 1.2s. Estimated remaining: 10m 9s. Rate: 142.8 symbols/min [2025-09-29T02:15:17.192417] [INFO ] [MAIN ] FDS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:17.237301] [DEBUG] [LOCAL ] FDP: Loaded 30760 existing records from primary storage. [2025-09-29T02:15:17.237694] [INFO ] [MAIN ] FDP: Loaded 30760 primary data records. [2025-09-29T02:15:17.348289] [DEBUG] [LOCAL ] FDS: Loaded 26759 existing records from primary storage. [2025-09-29T02:15:17.380991] [INFO ] [MAIN ] FDS: Loaded 26759 primary data records. [2025-09-29T02:15:17.462531] [DEBUG] [LOCAL ] FCX: Loaded 54480 existing records from primary storage. [2025-09-29T02:15:17.666014] [INFO ] [MAIN ] FCX: Loaded 54480 primary data records. [2025-09-29T02:15:18.413533] [DEBUG] [MAIN ] FDP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:18.414971] [INFO ] [MAIN ] FDP: Generated 1820 derivative records from 30760 primary records. [2025-09-29T02:15:18.415729] [DEBUG] [LOCAL ] FDP: Saving derivative data. [2025-09-29T02:15:18.436198] [DEBUG] [LOCAL ] FDP: Derivative data saved (1820 records). [2025-09-29T02:15:18.436493] [INFO ] [MAIN ] FDP: Successfully saved derivative data. [2025-09-29T02:15:18.439233] [INFO ] [MAIN ] Derivative Progress: 763/2211 symbols completed. FDP took 1.3s. Estimated remaining: 10m 10s. Rate: 142.4 symbols/min [2025-09-29T02:15:18.460198] [DEBUG] [MAIN ] FDS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:18.461679] [INFO ] [MAIN ] FDS: Generated 1820 derivative records from 26759 primary records. [2025-09-29T02:15:18.462126] [DEBUG] [LOCAL ] FDS: Saving derivative data. [2025-09-29T02:15:18.483443] [DEBUG] [LOCAL ] FDS: Derivative data saved (1820 records). [2025-09-29T02:15:18.496736] [INFO ] [MAIN ] FDS: Successfully saved derivative data. [2025-09-29T02:15:18.496495] [DEBUG] [MAIN ] FCX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:18.500031] [INFO ] [MAIN ] Derivative Progress: 764/2211 symbols completed. FDS took 1.3s. Estimated remaining: 10m 9s. Rate: 142.6 symbols/min [2025-09-29T02:15:18.500977] [INFO ] [MAIN ] FCX: Generated 1820 derivative records from 54480 primary records. [2025-09-29T02:15:18.501293] [DEBUG] [LOCAL ] FCX: Saving derivative data. [2025-09-29T02:15:18.518222] [DEBUG] [LOCAL ] FCX: Derivative data saved (1820 records). [2025-09-29T02:15:18.518376] [INFO ] [MAIN ] FCX: Successfully saved derivative data. [2025-09-29T02:15:18.521820] [INFO ] [MAIN ] Derivative Progress: 765/2211 symbols completed. FCX took 1.4s. Estimated remaining: 10m 8s. Rate: 142.7 symbols/min [2025-09-29T02:15:18.522393] [INFO ] [MAIN ] FERG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:18.522346] [INFO ] [MAIN ] FDX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:18.522512] [INFO ] [MAIN ] FE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:18.649032] [DEBUG] [LOCAL ] FE: Loaded 54208 existing records from primary storage. [2025-09-29T02:15:18.650601] [DEBUG] [LOCAL ] FERG: Loaded 49691 existing records from primary storage. [2025-09-29T02:15:18.650852] [INFO ] [MAIN ] FE: Loaded 54208 primary data records. [2025-09-29T02:15:18.669950] [DEBUG] [LOCAL ] FDX: Loaded 52362 existing records from primary storage. [2025-09-29T02:15:18.670213] [INFO ] [MAIN ] FDX: Loaded 52362 primary data records. [2025-09-29T02:15:18.651122] [INFO ] [MAIN ] FERG: Loaded 49691 primary data records. [2025-09-29T02:15:19.747546] [DEBUG] [MAIN ] FDX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:19.748114] [DEBUG] [MAIN ] FE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:19.749241] [INFO ] [MAIN ] FE: Generated 1820 derivative records from 54208 primary records. [2025-09-29T02:15:19.749440] [DEBUG] [LOCAL ] FE: Saving derivative data. [2025-09-29T02:15:19.758039] [INFO ] [MAIN ] FDX: Generated 1820 derivative records from 52362 primary records. [2025-09-29T02:15:19.759356] [DEBUG] [LOCAL ] FDX: Saving derivative data. [2025-09-29T02:15:19.766321] [DEBUG] [MAIN ] FERG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:19.791386] [INFO ] [MAIN ] FERG: Generated 1820 derivative records from 49691 primary records. [2025-09-29T02:15:19.795992] [DEBUG] [LOCAL ] FERG: Saving derivative data. [2025-09-29T02:15:19.797951] [DEBUG] [LOCAL ] FE: Derivative data saved (1820 records). [2025-09-29T02:15:19.801753] [INFO ] [MAIN ] FE: Successfully saved derivative data. [2025-09-29T02:15:19.802725] [DEBUG] [LOCAL ] FDX: Derivative data saved (1820 records). [2025-09-29T02:15:19.819276] [INFO ] [MAIN ] Derivative Progress: 766/2211 symbols completed. FE took 1.3s. Estimated remaining: 10m 9s. Rate: 142.3 symbols/min [2025-09-29T02:15:19.820154] [INFO ] [MAIN ] FET: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:19.822762] [INFO ] [MAIN ] FDX: Successfully saved derivative data. [2025-09-29T02:15:19.828495] [DEBUG] [LOCAL ] FERG: Derivative data saved (1820 records). [2025-09-29T02:15:19.827756] [INFO ] [MAIN ] Derivative Progress: 767/2211 symbols completed. FDX took 1.3s. Estimated remaining: 10m 8s. Rate: 142.5 symbols/min [2025-09-29T02:15:19.828966] [INFO ] [MAIN ] FF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:19.828824] [INFO ] [MAIN ] FERG: Successfully saved derivative data. [2025-09-29T02:15:19.832501] [INFO ] [MAIN ] Derivative Progress: 768/2211 symbols completed. FERG took 1.3s. Estimated remaining: 10m 7s. Rate: 142.7 symbols/min [2025-09-29T02:15:19.832995] [INFO ] [MAIN ] FFA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:19.856234] [DEBUG] [LOCAL ] FFA: Loaded 5800 existing records from primary storage. [2025-09-29T02:15:19.862031] [INFO ] [MAIN ] FFA: Loaded 5800 primary data records. [2025-09-29T02:15:19.862516] [DEBUG] [LOCAL ] FET: Loaded 12984 existing records from primary storage. [2025-09-29T02:15:19.880421] [INFO ] [MAIN ] FET: Loaded 12984 primary data records. [2025-09-29T02:15:20.068797] [DEBUG] [LOCAL ] FF: Loaded 25768 existing records from primary storage. [2025-09-29T02:15:20.087610] [INFO ] [MAIN ] FF: Loaded 25768 primary data records. [2025-09-29T02:15:20.982941] [DEBUG] [MAIN ] FFA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:20.986732] [INFO ] [MAIN ] FFA: Generated 1820 derivative records from 5800 primary records. [2025-09-29T02:15:20.994960] [DEBUG] [LOCAL ] FFA: Saving derivative data. [2025-09-29T02:15:21.001122] [DEBUG] [MAIN ] FET: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:21.016109] [INFO ] [MAIN ] FET: Generated 1820 derivative records from 12984 primary records. [2025-09-29T02:15:21.017958] [DEBUG] [LOCAL ] FET: Saving derivative data. [2025-09-29T02:15:21.020035] [DEBUG] [LOCAL ] FFA: Derivative data saved (1820 records). [2025-09-29T02:15:21.020152] [INFO ] [MAIN ] FFA: Successfully saved derivative data. [2025-09-29T02:15:21.023173] [INFO ] [MAIN ] Derivative Progress: 769/2211 symbols completed. FFA took 1.2s. Estimated remaining: 10m 8s. Rate: 142.4 symbols/min [2025-09-29T02:15:21.023971] [INFO ] [MAIN ] FFC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:21.044177] [DEBUG] [MAIN ] FF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:21.045342] [INFO ] [MAIN ] FF: Generated 1820 derivative records from 25768 primary records. [2025-09-29T02:15:21.050216] [DEBUG] [LOCAL ] FF: Saving derivative data. [2025-09-29T02:15:21.054608] [DEBUG] [LOCAL ] FET: Derivative data saved (1820 records). [2025-09-29T02:15:21.056151] [INFO ] [MAIN ] FET: Successfully saved derivative data. [2025-09-29T02:15:21.070200] [INFO ] [MAIN ] Derivative Progress: 770/2211 symbols completed. FET took 1.3s. Estimated remaining: 10m 7s. Rate: 142.5 symbols/min [2025-09-29T02:15:21.073826] [INFO ] [MAIN ] FFWM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:21.075897] [DEBUG] [LOCAL ] FF: Derivative data saved (1820 records). [2025-09-29T02:15:21.076133] [INFO ] [MAIN ] FF: Successfully saved derivative data. [2025-09-29T02:15:21.079521] [INFO ] [MAIN ] Derivative Progress: 771/2211 symbols completed. FF took 1.3s. Estimated remaining: 10m 5s. Rate: 142.7 symbols/min [2025-09-29T02:15:21.079961] [INFO ] [MAIN ] FG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:21.096516] [DEBUG] [LOCAL ] FFC: Loaded 16899 existing records from primary storage. [2025-09-29T02:15:21.096704] [INFO ] [MAIN ] FFC: Loaded 16899 primary data records. [2025-09-29T02:15:21.282204] [DEBUG] [LOCAL ] FG: Loaded 22819 existing records from primary storage. [2025-09-29T02:15:21.283563] [DEBUG] [LOCAL ] FFWM: Loaded 36532 existing records from primary storage. [2025-09-29T02:15:21.313783] [INFO ] [MAIN ] FG: Loaded 22819 primary data records. [2025-09-29T02:15:21.451206] [INFO ] [MAIN ] FFWM: Loaded 36532 primary data records. [2025-09-29T02:15:22.240338] [DEBUG] [MAIN ] FFC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:22.242785] [INFO ] [MAIN ] FFC: Generated 1820 derivative records from 16899 primary records. [2025-09-29T02:15:22.243579] [DEBUG] [LOCAL ] FFC: Saving derivative data. [2025-09-29T02:15:22.265306] [DEBUG] [LOCAL ] FFC: Derivative data saved (1820 records). [2025-09-29T02:15:22.265863] [INFO ] [MAIN ] FFC: Successfully saved derivative data. [2025-09-29T02:15:22.268468] [INFO ] [MAIN ] Derivative Progress: 772/2211 symbols completed. FFC took 1.2s. Estimated remaining: 10m 6s. Rate: 142.4 symbols/min [2025-09-29T02:15:22.269079] [INFO ] [MAIN ] FGN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:22.281879] [DEBUG] [LOCAL ] FGN: Loaded 3915 existing records from primary storage. [2025-09-29T02:15:22.297258] [DEBUG] [MAIN ] FG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:22.291678] [INFO ] [MAIN ] FGN: Loaded 3915 primary data records. [2025-09-29T02:15:22.303447] [INFO ] [MAIN ] FG: Generated 1820 derivative records from 22819 primary records. [2025-09-29T02:15:22.360769] [DEBUG] [LOCAL ] FG: Saving derivative data. [2025-09-29T02:15:22.352411] [DEBUG] [MAIN ] FFWM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:22.406947] [INFO ] [MAIN ] FFWM: Generated 1820 derivative records from 36532 primary records. [2025-09-29T02:15:22.442446] [DEBUG] [LOCAL ] FFWM: Saving derivative data. [2025-09-29T02:15:22.481946] [DEBUG] [LOCAL ] FG: Derivative data saved (1820 records). [2025-09-29T02:15:22.489556] [DEBUG] [LOCAL ] FFWM: Derivative data saved (1820 records). [2025-09-29T02:15:22.494980] [INFO ] [MAIN ] FFWM: Successfully saved derivative data. [2025-09-29T02:15:22.494871] [INFO ] [MAIN ] FG: Successfully saved derivative data. [2025-09-29T02:15:22.498208] [INFO ] [MAIN ] Derivative Progress: 773/2211 symbols completed. FFWM took 1.4s. Estimated remaining: 10m 6s. Rate: 142.5 symbols/min [2025-09-29T02:15:22.501364] [INFO ] [MAIN ] FHI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:22.501520] [INFO ] [MAIN ] Derivative Progress: 774/2211 symbols completed. FG took 1.4s. Estimated remaining: 10m 4s. Rate: 142.6 symbols/min [2025-09-29T02:15:22.676685] [INFO ] [MAIN ] FHN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:22.738286] [DEBUG] [MAIN ] FGN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:22.739105] [INFO ] [MAIN ] FGN: Generated 1820 derivative records from 3915 primary records. [2025-09-29T02:15:22.739285] [DEBUG] [LOCAL ] FGN: Saving derivative data. [2025-09-29T02:15:22.771775] [DEBUG] [LOCAL ] FGN: Derivative data saved (1820 records). [2025-09-29T02:15:22.773274] [DEBUG] [LOCAL ] FHI: Loaded 41203 existing records from primary storage. [2025-09-29T02:15:22.773532] [INFO ] [MAIN ] FGN: Successfully saved derivative data. [2025-09-29T02:15:22.773738] [INFO ] [MAIN ] FHI: Loaded 41203 primary data records. [2025-09-29T02:15:22.777204] [INFO ] [MAIN ] Derivative Progress: 775/2211 symbols completed. FGN took 0.5s. Estimated remaining: 10m 4s. Rate: 142.7 symbols/min [2025-09-29T02:15:22.793170] [INFO ] [MAIN ] FI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:22.958506] [DEBUG] [LOCAL ] FHN: Loaded 54148 existing records from primary storage. [2025-09-29T02:15:22.974433] [INFO ] [MAIN ] FHN: Loaded 54148 primary data records. [2025-09-29T02:15:23.546255] [DEBUG] [LOCAL ] FI: Loaded 54281 existing records from primary storage. [2025-09-29T02:15:23.546766] [INFO ] [MAIN ] FI: Loaded 54281 primary data records. [2025-09-29T02:15:23.843057] [DEBUG] [MAIN ] FHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:23.922087] [INFO ] [MAIN ] FHI: Generated 1820 derivative records from 41203 primary records. [2025-09-29T02:15:23.922800] [DEBUG] [LOCAL ] FHI: Saving derivative data. [2025-09-29T02:15:23.948548] [DEBUG] [LOCAL ] FHI: Derivative data saved (1820 records). [2025-09-29T02:15:23.949020] [INFO ] [MAIN ] FHI: Successfully saved derivative data. [2025-09-29T02:15:23.953406] [INFO ] [MAIN ] Derivative Progress: 776/2211 symbols completed. FHI took 1.5s. Estimated remaining: 10m 5s. Rate: 142.4 symbols/min [2025-09-29T02:15:23.968379] [INFO ] [MAIN ] FICO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:23.968826] [DEBUG] [MAIN ] FHN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:23.970962] [INFO ] [MAIN ] FHN: Generated 1820 derivative records from 54148 primary records. [2025-09-29T02:15:23.971318] [DEBUG] [LOCAL ] FHN: Saving derivative data. [2025-09-29T02:15:23.994085] [DEBUG] [LOCAL ] FHN: Derivative data saved (1820 records). [2025-09-29T02:15:23.994514] [INFO ] [MAIN ] FHN: Successfully saved derivative data. [2025-09-29T02:15:23.997867] [INFO ] [MAIN ] Derivative Progress: 777/2211 symbols completed. FHN took 1.3s. Estimated remaining: 10m 4s. Rate: 142.5 symbols/min [2025-09-29T02:15:24.004883] [INFO ] [MAIN ] FIGS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:24.022304] [DEBUG] [LOCAL ] FICO: Loaded 20674 existing records from primary storage. [2025-09-29T02:15:24.035379] [INFO ] [MAIN ] FICO: Loaded 20674 primary data records. [2025-09-29T02:15:24.035934] [DEBUG] [MAIN ] FI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:24.058192] [INFO ] [MAIN ] FI: Generated 1820 derivative records from 54281 primary records. [2025-09-29T02:15:24.109465] [DEBUG] [LOCAL ] FI: Saving derivative data. [2025-09-29T02:15:24.439995] [DEBUG] [LOCAL ] FI: Derivative data saved (1820 records). [2025-09-29T02:15:24.440434] [INFO ] [MAIN ] FI: Successfully saved derivative data. [2025-09-29T02:15:24.444802] [INFO ] [MAIN ] Derivative Progress: 778/2211 symbols completed. FI took 1.7s. Estimated remaining: 10m 3s. Rate: 142.5 symbols/min [2025-09-29T02:15:24.446447] [DEBUG] [LOCAL ] FIGS: Loaded 49651 existing records from primary storage. [2025-09-29T02:15:24.446624] [INFO ] [MAIN ] FIGS: Loaded 49651 primary data records. [2025-09-29T02:15:24.851098] [DEBUG] [MAIN ] FICO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:24.852339] [INFO ] [MAIN ] FICO: Generated 1820 derivative records from 20674 primary records. [2025-09-29T02:15:24.852568] [DEBUG] [LOCAL ] FICO: Saving derivative data. [2025-09-29T02:15:24.870376] [DEBUG] [LOCAL ] FICO: Derivative data saved (1820 records). [2025-09-29T02:15:24.870632] [INFO ] [MAIN ] FICO: Successfully saved derivative data. [2025-09-29T02:15:24.873039] [INFO ] [MAIN ] Derivative Progress: 779/2211 symbols completed. FICO took 0.9s. Estimated remaining: 10m 3s. Rate: 142.5 symbols/min [2025-09-29T02:15:24.890088] [DEBUG] [MAIN ] FIGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:24.890806] [INFO ] [MAIN ] FIGS: Generated 1820 derivative records from 49651 primary records. [2025-09-29T02:15:24.890897] [DEBUG] [LOCAL ] FIGS: Saving derivative data. [2025-09-29T02:15:24.906662] [DEBUG] [LOCAL ] FIGS: Derivative data saved (1820 records). [2025-09-29T02:15:24.906755] [INFO ] [MAIN ] FIGS: Successfully saved derivative data. [2025-09-29T02:15:24.909906] [INFO ] [MAIN ] Derivative Progress: 780/2211 symbols completed. FIGS took 0.9s. Estimated remaining: 10m 2s. Rate: 142.7 symbols/min [2025-09-29T02:15:24.910331] [INFO ] [MAIN ] FIHL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:24.910409] [INFO ] [MAIN ] FINV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:24.910573] [INFO ] [MAIN ] FINS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:24.930411] [DEBUG] [LOCAL ] FINS: Loaded 8309 existing records from primary storage. [2025-09-29T02:15:24.930620] [INFO ] [MAIN ] FINS: Loaded 8309 primary data records. [2025-09-29T02:15:25.331566] [DEBUG] [LOCAL ] FIHL: Loaded 40851 existing records from primary storage. [2025-09-29T02:15:25.331954] [INFO ] [MAIN ] FIHL: Loaded 40851 primary data records. [2025-09-29T02:15:25.346952] [DEBUG] [LOCAL ] FINV: Loaded 45772 existing records from primary storage. [2025-09-29T02:15:25.385211] [INFO ] [MAIN ] FINV: Loaded 45772 primary data records. [2025-09-29T02:15:26.034819] [DEBUG] [MAIN ] FINS: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:15:26.037170] [INFO ] [MAIN ] FINS: Generated 1819 derivative records from 8309 primary records. [2025-09-29T02:15:26.038785] [DEBUG] [LOCAL ] FINS: Saving derivative data. [2025-09-29T02:15:26.059898] [DEBUG] [LOCAL ] FINS: Derivative data saved (1819 records). [2025-09-29T02:15:26.060275] [INFO ] [MAIN ] FINS: Successfully saved derivative data. [2025-09-29T02:15:26.063118] [INFO ] [MAIN ] Derivative Progress: 781/2211 symbols completed. FINS took 1.2s. Estimated remaining: 10m 3s. Rate: 142.4 symbols/min [2025-09-29T02:15:26.065120] [INFO ] [MAIN ] FIS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:26.091359] [DEBUG] [MAIN ] FIHL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:26.094898] [INFO ] [MAIN ] FIHL: Generated 1820 derivative records from 40851 primary records. [2025-09-29T02:15:26.095077] [DEBUG] [LOCAL ] FIHL: Saving derivative data. [2025-09-29T02:15:26.129588] [DEBUG] [MAIN ] FINV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:26.133454] [INFO ] [MAIN ] FINV: Generated 1820 derivative records from 45772 primary records. [2025-09-29T02:15:26.134120] [DEBUG] [LOCAL ] FINV: Saving derivative data. [2025-09-29T02:15:26.137314] [DEBUG] [LOCAL ] FIHL: Derivative data saved (1820 records). [2025-09-29T02:15:26.137835] [INFO ] [MAIN ] FIHL: Successfully saved derivative data. [2025-09-29T02:15:26.141276] [INFO ] [MAIN ] Derivative Progress: 782/2211 symbols completed. FIHL took 1.2s. Estimated remaining: 10m 2s. Rate: 142.5 symbols/min [2025-09-29T02:15:26.153687] [INFO ] [MAIN ] FIX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:26.158947] [DEBUG] [LOCAL ] FINV: Derivative data saved (1820 records). [2025-09-29T02:15:26.159341] [INFO ] [MAIN ] FINV: Successfully saved derivative data. [2025-09-29T02:15:26.162615] [INFO ] [MAIN ] Derivative Progress: 783/2211 symbols completed. FINV took 1.3s. Estimated remaining: 10m 0s. Rate: 142.7 symbols/min [2025-09-29T02:15:26.163255] [INFO ] [MAIN ] FLC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:26.189725] [DEBUG] [LOCAL ] FLC: Loaded 5559 existing records from primary storage. [2025-09-29T02:15:26.190088] [INFO ] [MAIN ] FLC: Loaded 5559 primary data records. [2025-09-29T02:15:26.328384] [DEBUG] [LOCAL ] FIS: Loaded 54144 existing records from primary storage. [2025-09-29T02:15:26.328735] [INFO ] [MAIN ] FIS: Loaded 54144 primary data records. [2025-09-29T02:15:26.469105] [DEBUG] [LOCAL ] FIX: Loaded 30763 existing records from primary storage. [2025-09-29T02:15:26.505548] [INFO ] [MAIN ] FIX: Loaded 30763 primary data records. [2025-09-29T02:15:27.350844] [DEBUG] [MAIN ] FLC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:27.352222] [INFO ] [MAIN ] FLC: Generated 1820 derivative records from 5559 primary records. [2025-09-29T02:15:27.355101] [DEBUG] [LOCAL ] FLC: Saving derivative data. [2025-09-29T02:15:27.384199] [DEBUG] [LOCAL ] FLC: Derivative data saved (1820 records). [2025-09-29T02:15:27.398685] [INFO ] [MAIN ] FLC: Successfully saved derivative data. [2025-09-29T02:15:27.401400] [INFO ] [MAIN ] Derivative Progress: 784/2211 symbols completed. FLC took 1.2s. Estimated remaining: 10m 1s. Rate: 142.3 symbols/min [2025-09-29T02:15:27.402071] [DEBUG] [MAIN ] FIS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:27.402334] [INFO ] [MAIN ] FLG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:27.403855] [INFO ] [MAIN ] FIS: Generated 1820 derivative records from 54144 primary records. [2025-09-29T02:15:27.407690] [DEBUG] [LOCAL ] FIS: Saving derivative data. [2025-09-29T02:15:27.444177] [DEBUG] [MAIN ] FIX: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:15:27.448016] [INFO ] [MAIN ] FIX: Generated 1819 derivative records from 30763 primary records. [2025-09-29T02:15:27.448924] [DEBUG] [LOCAL ] FIX: Saving derivative data. [2025-09-29T02:15:27.451026] [DEBUG] [LOCAL ] FIS: Derivative data saved (1820 records). [2025-09-29T02:15:27.459296] [INFO ] [MAIN ] FIS: Successfully saved derivative data. [2025-09-29T02:15:27.470424] [INFO ] [MAIN ] Derivative Progress: 785/2211 symbols completed. FIS took 1.4s. Estimated remaining: 10m 0s. Rate: 142.5 symbols/min [2025-09-29T02:15:27.473669] [DEBUG] [LOCAL ] FIX: Derivative data saved (1819 records). [2025-09-29T02:15:27.474171] [INFO ] [MAIN ] FLNG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:27.474387] [INFO ] [MAIN ] FIX: Successfully saved derivative data. [2025-09-29T02:15:27.478592] [INFO ] [MAIN ] Derivative Progress: 786/2211 symbols completed. FIX took 1.3s. Estimated remaining: 9m 59s. Rate: 142.7 symbols/min [2025-09-29T02:15:27.479060] [INFO ] [MAIN ] FLO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:27.530499] [DEBUG] [LOCAL ] FLG: Loaded 54105 existing records from primary storage. [2025-09-29T02:15:27.541153] [INFO ] [MAIN ] FLG: Loaded 54105 primary data records. [2025-09-29T02:15:27.705094] [DEBUG] [LOCAL ] FLNG: Loaded 34431 existing records from primary storage. [2025-09-29T02:15:27.718585] [INFO ] [MAIN ] FLNG: Loaded 34431 primary data records. [2025-09-29T02:15:27.826301] [DEBUG] [LOCAL ] FLO: Loaded 52656 existing records from primary storage. [2025-09-29T02:15:28.024054] [INFO ] [MAIN ] FLO: Loaded 52656 primary data records. [2025-09-29T02:15:28.667981] [DEBUG] [MAIN ] FLG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:28.669963] [INFO ] [MAIN ] FLG: Generated 1820 derivative records from 54105 primary records. [2025-09-29T02:15:28.673033] [DEBUG] [LOCAL ] FLG: Saving derivative data. [2025-09-29T02:15:28.704372] [DEBUG] [MAIN ] FLNG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:28.707600] [INFO ] [MAIN ] FLNG: Generated 1820 derivative records from 34431 primary records. [2025-09-29T02:15:28.708844] [DEBUG] [LOCAL ] FLNG: Saving derivative data. [2025-09-29T02:15:28.726974] [DEBUG] [LOCAL ] FLG: Derivative data saved (1820 records). [2025-09-29T02:15:28.730359] [INFO ] [MAIN ] FLG: Successfully saved derivative data. [2025-09-29T02:15:28.739354] [INFO ] [MAIN ] Derivative Progress: 787/2211 symbols completed. FLG took 1.3s. Estimated remaining: 10m 0s. Rate: 142.3 symbols/min [2025-09-29T02:15:28.740360] [INFO ] [MAIN ] FLR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:28.752291] [DEBUG] [LOCAL ] FLNG: Derivative data saved (1820 records). [2025-09-29T02:15:28.757815] [INFO ] [MAIN ] FLNG: Successfully saved derivative data. [2025-09-29T02:15:28.758159] [DEBUG] [MAIN ] FLO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:28.763087] [INFO ] [MAIN ] FLO: Generated 1820 derivative records from 52656 primary records. [2025-09-29T02:15:28.761948] [INFO ] [MAIN ] Derivative Progress: 788/2211 symbols completed. FLNG took 1.3s. Estimated remaining: 9m 59s. Rate: 142.5 symbols/min [2025-09-29T02:15:28.763422] [INFO ] [MAIN ] FLS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:28.763668] [DEBUG] [LOCAL ] FLO: Saving derivative data. [2025-09-29T02:15:28.783546] [DEBUG] [LOCAL ] FLO: Derivative data saved (1820 records). [2025-09-29T02:15:28.783953] [INFO ] [MAIN ] FLO: Successfully saved derivative data. [2025-09-29T02:15:28.789239] [INFO ] [MAIN ] Derivative Progress: 789/2211 symbols completed. FLO took 1.3s. Estimated remaining: 9m 58s. Rate: 142.7 symbols/min [2025-09-29T02:15:28.789820] [INFO ] [MAIN ] FLUT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:28.891366] [DEBUG] [LOCAL ] FLR: Loaded 53892 existing records from primary storage. [2025-09-29T02:15:28.892072] [INFO ] [MAIN ] FLR: Loaded 53892 primary data records. [2025-09-29T02:15:28.940448] [DEBUG] [LOCAL ] FLS: Loaded 50934 existing records from primary storage. [2025-09-29T02:15:28.970070] [INFO ] [MAIN ] FLS: Loaded 50934 primary data records. [2025-09-29T02:15:29.118492] [DEBUG] [LOCAL ] FLUT: Loaded 51580 existing records from primary storage. [2025-09-29T02:15:29.164535] [INFO ] [MAIN ] FLUT: Loaded 51580 primary data records. [2025-09-29T02:15:30.010443] [DEBUG] [MAIN ] FLR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:30.012041] [INFO ] [MAIN ] FLR: Generated 1820 derivative records from 53892 primary records. [2025-09-29T02:15:30.012698] [DEBUG] [LOCAL ] FLR: Saving derivative data. [2025-09-29T02:15:30.035767] [DEBUG] [LOCAL ] FLR: Derivative data saved (1820 records). [2025-09-29T02:15:30.049811] [DEBUG] [MAIN ] FLS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:30.049438] [INFO ] [MAIN ] FLR: Successfully saved derivative data. [2025-09-29T02:15:30.065358] [INFO ] [MAIN ] Derivative Progress: 790/2211 symbols completed. FLR took 1.3s. Estimated remaining: 9m 59s. Rate: 142.3 symbols/min [2025-09-29T02:15:30.067322] [INFO ] [MAIN ] FLS: Generated 1820 derivative records from 50934 primary records. [2025-09-29T02:15:30.067995] [INFO ] [MAIN ] FLXR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:30.067753] [DEBUG] [MAIN ] FLUT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:30.068549] [DEBUG] [LOCAL ] FLS: Saving derivative data. [2025-09-29T02:15:30.071164] [INFO ] [MAIN ] FLUT: Generated 1820 derivative records from 51580 primary records. [2025-09-29T02:15:30.079363] [DEBUG] [LOCAL ] FLUT: Saving derivative data. [2025-09-29T02:15:30.089327] [DEBUG] [LOCAL ] FLS: Derivative data saved (1820 records). [2025-09-29T02:15:30.089827] [INFO ] [MAIN ] FLS: Successfully saved derivative data. [2025-09-29T02:15:30.102630] [INFO ] [MAIN ] Derivative Progress: 791/2211 symbols completed. FLS took 1.3s. Estimated remaining: 9m 58s. Rate: 142.5 symbols/min [2025-09-29T02:15:30.102969] [INFO ] [MAIN ] FMC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:30.117837] [DEBUG] [LOCAL ] FLUT: Derivative data saved (1820 records). [2025-09-29T02:15:30.118249] [INFO ] [MAIN ] FLUT: Successfully saved derivative data. [2025-09-29T02:15:30.121924] [INFO ] [MAIN ] Derivative Progress: 792/2211 symbols completed. FLUT took 1.3s. Estimated remaining: 9m 57s. Rate: 142.6 symbols/min [2025-09-29T02:15:30.122235] [INFO ] [MAIN ] FMN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:30.132865] [DEBUG] [LOCAL ] FLXR: Loaded 20315 existing records from primary storage. [2025-09-29T02:15:30.133150] [INFO ] [MAIN ] FLXR: Loaded 20315 primary data records. [2025-09-29T02:15:30.227132] [DEBUG] [LOCAL ] FMN: Loaded 6097 existing records from primary storage. [2025-09-29T02:15:30.253276] [INFO ] [MAIN ] FMN: Loaded 6097 primary data records. [2025-09-29T02:15:30.712713] [DEBUG] [LOCAL ] FMC: Loaded 52560 existing records from primary storage. [2025-09-29T02:15:30.841030] [INFO ] [MAIN ] FMC: Loaded 52560 primary data records. [2025-09-29T02:15:31.229321] [DEBUG] [MAIN ] FLXR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:31.232377] [INFO ] [MAIN ] FLXR: Generated 1820 derivative records from 20315 primary records. [2025-09-29T02:15:31.247463] [DEBUG] [LOCAL ] FLXR: Saving derivative data. [2025-09-29T02:15:31.247855] [DEBUG] [MAIN ] FMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:31.249726] [INFO ] [MAIN ] FMN: Generated 1820 derivative records from 6097 primary records. [2025-09-29T02:15:31.250044] [DEBUG] [LOCAL ] FMN: Saving derivative data. [2025-09-29T02:15:31.282326] [DEBUG] [LOCAL ] FLXR: Derivative data saved (1820 records). [2025-09-29T02:15:31.284983] [DEBUG] [LOCAL ] FMN: Derivative data saved (1820 records). [2025-09-29T02:15:31.285283] [INFO ] [MAIN ] FLXR: Successfully saved derivative data. [2025-09-29T02:15:31.285596] [INFO ] [MAIN ] FMN: Successfully saved derivative data. [2025-09-29T02:15:31.288539] [INFO ] [MAIN ] Derivative Progress: 793/2211 symbols completed. FLXR took 1.2s. Estimated remaining: 9m 58s. Rate: 142.3 symbols/min [2025-09-29T02:15:31.292220] [INFO ] [MAIN ] Derivative Progress: 794/2211 symbols completed. FMN took 1.2s. Estimated remaining: 9m 57s. Rate: 142.5 symbols/min [2025-09-29T02:15:31.311626] [DEBUG] [MAIN ] FMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:31.312440] [INFO ] [MAIN ] FMC: Generated 1820 derivative records from 52560 primary records. [2025-09-29T02:15:31.312527] [DEBUG] [LOCAL ] FMC: Saving derivative data. [2025-09-29T02:15:31.330004] [DEBUG] [LOCAL ] FMC: Derivative data saved (1820 records). [2025-09-29T02:15:31.330125] [INFO ] [MAIN ] FMC: Successfully saved derivative data. [2025-09-29T02:15:31.334725] [INFO ] [MAIN ] Derivative Progress: 795/2211 symbols completed. FMC took 1.2s. Estimated remaining: 9m 56s. Rate: 142.6 symbols/min [2025-09-29T02:15:31.335230] [INFO ] [MAIN ] FMS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:31.335478] [INFO ] [MAIN ] FMX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:31.335603] [INFO ] [MAIN ] FMY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:31.343178] [DEBUG] [LOCAL ] FMY: Loaded 1400 existing records from primary storage. [2025-09-29T02:15:31.343538] [INFO ] [MAIN ] FMY: Loaded 1400 primary data records. [2025-09-29T02:15:31.753998] [DEBUG] [LOCAL ] FMS: Loaded 30771 existing records from primary storage. [2025-09-29T02:15:31.755068] [DEBUG] [LOCAL ] FMX: Loaded 41276 existing records from primary storage. [2025-09-29T02:15:31.756334] [INFO ] [MAIN ] FMX: Loaded 41276 primary data records. [2025-09-29T02:15:31.756238] [INFO ] [MAIN ] FMS: Loaded 30771 primary data records. [2025-09-29T02:15:32.486082] [DEBUG] [MAIN ] FMY: Filtered 7001 bins outside market hours, 7805 incomplete bins [2025-09-29T02:15:32.489561] [INFO ] [MAIN ] FMY: Generated 1809 derivative records from 1400 primary records. [2025-09-29T02:15:32.490357] [DEBUG] [LOCAL ] FMY: Saving derivative data. [2025-09-29T02:15:32.514271] [DEBUG] [LOCAL ] FMY: Derivative data saved (1809 records). [2025-09-29T02:15:32.515360] [INFO ] [MAIN ] FMY: Successfully saved derivative data. [2025-09-29T02:15:32.518808] [INFO ] [MAIN ] Derivative Progress: 796/2211 symbols completed. FMY took 1.2s. Estimated remaining: 9m 57s. Rate: 142.3 symbols/min [2025-09-29T02:15:32.519544] [INFO ] [MAIN ] FN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:32.543572] [DEBUG] [MAIN ] FMS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:32.545891] [INFO ] [MAIN ] FMS: Generated 1820 derivative records from 30771 primary records. [2025-09-29T02:15:32.546168] [DEBUG] [LOCAL ] FMS: Saving derivative data. [2025-09-29T02:15:32.559681] [DEBUG] [MAIN ] FMX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:32.561388] [INFO ] [MAIN ] FMX: Generated 1820 derivative records from 41276 primary records. [2025-09-29T02:15:32.562231] [DEBUG] [LOCAL ] FMX: Saving derivative data. [2025-09-29T02:15:32.593822] [DEBUG] [LOCAL ] FMS: Derivative data saved (1820 records). [2025-09-29T02:15:32.595436] [INFO ] [MAIN ] FMS: Successfully saved derivative data. [2025-09-29T02:15:32.599772] [DEBUG] [LOCAL ] FMX: Derivative data saved (1820 records). [2025-09-29T02:15:32.603285] [INFO ] [MAIN ] Derivative Progress: 797/2211 symbols completed. FMS took 1.3s. Estimated remaining: 9m 56s. Rate: 142.5 symbols/min [2025-09-29T02:15:32.603767] [INFO ] [MAIN ] FNB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:32.603603] [INFO ] [MAIN ] FMX: Successfully saved derivative data. [2025-09-29T02:15:32.619189] [INFO ] [MAIN ] Derivative Progress: 798/2211 symbols completed. FMX took 1.3s. Estimated remaining: 9m 54s. Rate: 142.6 symbols/min [2025-09-29T02:15:32.619602] [INFO ] [MAIN ] FND: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:32.641296] [DEBUG] [LOCAL ] FN: Loaded 39795 existing records from primary storage. [2025-09-29T02:15:32.641843] [INFO ] [MAIN ] FN: Loaded 39795 primary data records. [2025-09-29T02:15:33.050866] [DEBUG] [LOCAL ] FNB: Loaded 53226 existing records from primary storage. [2025-09-29T02:15:33.051235] [INFO ] [MAIN ] FNB: Loaded 53226 primary data records. [2025-09-29T02:15:33.077741] [DEBUG] [LOCAL ] FND: Loaded 52871 existing records from primary storage. [2025-09-29T02:15:33.084043] [INFO ] [MAIN ] FND: Loaded 52871 primary data records. [2025-09-29T02:15:33.803107] [DEBUG] [MAIN ] FN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:33.804439] [INFO ] [MAIN ] FN: Generated 1820 derivative records from 39795 primary records. [2025-09-29T02:15:33.804917] [DEBUG] [LOCAL ] FN: Saving derivative data. [2025-09-29T02:15:33.825884] [DEBUG] [LOCAL ] FN: Derivative data saved (1820 records). [2025-09-29T02:15:33.826742] [INFO ] [MAIN ] FN: Successfully saved derivative data. [2025-09-29T02:15:33.829674] [INFO ] [MAIN ] Derivative Progress: 799/2211 symbols completed. FN took 1.3s. Estimated remaining: 9m 55s. Rate: 142.3 symbols/min [2025-09-29T02:15:33.830053] [INFO ] [MAIN ] FNF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:33.848773] [DEBUG] [MAIN ] FNB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:33.849828] [INFO ] [MAIN ] FNB: Generated 1820 derivative records from 53226 primary records. [2025-09-29T02:15:33.850936] [DEBUG] [LOCAL ] FNB: Saving derivative data. [2025-09-29T02:15:33.883766] [DEBUG] [MAIN ] FND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:33.884914] [DEBUG] [LOCAL ] FNB: Derivative data saved (1820 records). [2025-09-29T02:15:33.885984] [INFO ] [MAIN ] FND: Generated 1820 derivative records from 52871 primary records. [2025-09-29T02:15:33.886117] [INFO ] [MAIN ] FNB: Successfully saved derivative data. [2025-09-29T02:15:33.889460] [INFO ] [MAIN ] Derivative Progress: 800/2211 symbols completed. FNB took 1.3s. Estimated remaining: 9m 54s. Rate: 142.5 symbols/min [2025-09-29T02:15:33.889834] [INFO ] [MAIN ] FNV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:33.889725] [DEBUG] [LOCAL ] FND: Saving derivative data. [2025-09-29T02:15:33.910169] [DEBUG] [LOCAL ] FND: Derivative data saved (1820 records). [2025-09-29T02:15:33.922459] [INFO ] [MAIN ] FND: Successfully saved derivative data. [2025-09-29T02:15:33.925988] [INFO ] [MAIN ] Derivative Progress: 801/2211 symbols completed. FND took 1.3s. Estimated remaining: 9m 53s. Rate: 142.6 symbols/min [2025-09-29T02:15:33.926345] [INFO ] [MAIN ] FOA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:33.950826] [DEBUG] [LOCAL ] FNF: Loaded 49871 existing records from primary storage. [2025-09-29T02:15:33.955574] [INFO ] [MAIN ] FNF: Loaded 49871 primary data records. [2025-09-29T02:15:34.061178] [DEBUG] [LOCAL ] FOA: Loaded 13484 existing records from primary storage. [2025-09-29T02:15:34.089551] [INFO ] [MAIN ] FOA: Loaded 13484 primary data records. [2025-09-29T02:15:34.273627] [DEBUG] [LOCAL ] FNV: Loaded 47028 existing records from primary storage. [2025-09-29T02:15:34.429923] [INFO ] [MAIN ] FNV: Loaded 47028 primary data records. [2025-09-29T02:15:35.065666] [DEBUG] [MAIN ] FNF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:35.069635] [INFO ] [MAIN ] FNF: Generated 1820 derivative records from 49871 primary records. [2025-09-29T02:15:35.070087] [DEBUG] [LOCAL ] FNF: Saving derivative data. [2025-09-29T02:15:35.084793] [DEBUG] [MAIN ] FOA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:35.088849] [INFO ] [MAIN ] FOA: Generated 1820 derivative records from 13484 primary records. [2025-09-29T02:15:35.100972] [DEBUG] [LOCAL ] FOA: Saving derivative data. [2025-09-29T02:15:35.107715] [DEBUG] [LOCAL ] FNF: Derivative data saved (1820 records). [2025-09-29T02:15:35.108489] [INFO ] [MAIN ] FNF: Successfully saved derivative data. [2025-09-29T02:15:35.132909] [INFO ] [MAIN ] Derivative Progress: 802/2211 symbols completed. FNF took 1.3s. Estimated remaining: 9m 54s. Rate: 142.3 symbols/min [2025-09-29T02:15:35.133499] [INFO ] [MAIN ] FOF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:35.138802] [DEBUG] [MAIN ] FNV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:35.146171] [DEBUG] [LOCAL ] FOA: Derivative data saved (1820 records). [2025-09-29T02:15:35.144986] [INFO ] [MAIN ] FNV: Generated 1820 derivative records from 47028 primary records. [2025-09-29T02:15:35.146526] [INFO ] [MAIN ] FOA: Successfully saved derivative data. [2025-09-29T02:15:35.149766] [INFO ] [MAIN ] Derivative Progress: 803/2211 symbols completed. FOA took 1.2s. Estimated remaining: 9m 53s. Rate: 142.5 symbols/min [2025-09-29T02:15:35.150026] [INFO ] [MAIN ] FOR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:35.146850] [DEBUG] [LOCAL ] FNV: Saving derivative data. [2025-09-29T02:15:35.177557] [DEBUG] [LOCAL ] FNV: Derivative data saved (1820 records). [2025-09-29T02:15:35.178343] [DEBUG] [LOCAL ] FOF: Loaded 8510 existing records from primary storage. [2025-09-29T02:15:35.178445] [INFO ] [MAIN ] FNV: Successfully saved derivative data. [2025-09-29T02:15:35.178578] [INFO ] [MAIN ] FOF: Loaded 8510 primary data records. [2025-09-29T02:15:35.181629] [INFO ] [MAIN ] Derivative Progress: 804/2211 symbols completed. FNV took 1.3s. Estimated remaining: 9m 52s. Rate: 142.6 symbols/min [2025-09-29T02:15:35.200768] [INFO ] [MAIN ] FOUR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:35.295494] [DEBUG] [LOCAL ] FOR: Loaded 20362 existing records from primary storage. [2025-09-29T02:15:35.328758] [INFO ] [MAIN ] FOR: Loaded 20362 primary data records. [2025-09-29T02:15:35.980058] [DEBUG] [LOCAL ] FOUR: Loaded 50306 existing records from primary storage. [2025-09-29T02:15:35.994728] [INFO ] [MAIN ] FOUR: Loaded 50306 primary data records. [2025-09-29T02:15:36.374744] [DEBUG] [MAIN ] FOF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:36.376395] [INFO ] [MAIN ] FOF: Generated 1820 derivative records from 8510 primary records. [2025-09-29T02:15:36.376670] [DEBUG] [LOCAL ] FOF: Saving derivative data. [2025-09-29T02:15:36.399534] [DEBUG] [LOCAL ] FOF: Derivative data saved (1820 records). [2025-09-29T02:15:36.413330] [INFO ] [MAIN ] FOF: Successfully saved derivative data. [2025-09-29T02:15:36.413892] [DEBUG] [MAIN ] FOR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:36.418249] [INFO ] [MAIN ] FOR: Generated 1820 derivative records from 20362 primary records. [2025-09-29T02:15:36.416685] [INFO ] [MAIN ] Derivative Progress: 805/2211 symbols completed. FOF took 1.3s. Estimated remaining: 9m 53s. Rate: 142.3 symbols/min [2025-09-29T02:15:36.418667] [DEBUG] [LOCAL ] FOR: Saving derivative data. [2025-09-29T02:15:36.418864] [INFO ] [MAIN ] FPF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:36.439467] [DEBUG] [LOCAL ] FOR: Derivative data saved (1820 records). [2025-09-29T02:15:36.439931] [INFO ] [MAIN ] FOR: Successfully saved derivative data. [2025-09-29T02:15:36.443094] [INFO ] [MAIN ] Derivative Progress: 806/2211 symbols completed. FOR took 1.3s. Estimated remaining: 9m 52s. Rate: 142.4 symbols/min [2025-09-29T02:15:36.443337] [INFO ] [MAIN ] FPH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:36.483154] [DEBUG] [LOCAL ] FPF: Loaded 17998 existing records from primary storage. [2025-09-29T02:15:36.483396] [INFO ] [MAIN ] FPF: Loaded 17998 primary data records. [2025-09-29T02:15:36.489531] [DEBUG] [MAIN ] FOUR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:36.546118] [DEBUG] [LOCAL ] FPH: Loaded 19890 existing records from primary storage. [2025-09-29T02:15:36.547631] [INFO ] [MAIN ] FOUR: Generated 1820 derivative records from 50306 primary records. [2025-09-29T02:15:36.547959] [INFO ] [MAIN ] FPH: Loaded 19890 primary data records. [2025-09-29T02:15:36.581136] [DEBUG] [LOCAL ] FOUR: Saving derivative data. [2025-09-29T02:15:36.846601] [DEBUG] [LOCAL ] FOUR: Derivative data saved (1820 records). [2025-09-29T02:15:36.866552] [INFO ] [MAIN ] FOUR: Successfully saved derivative data. [2025-09-29T02:15:36.870080] [INFO ] [MAIN ] Derivative Progress: 807/2211 symbols completed. FOUR took 1.7s. Estimated remaining: 9m 51s. Rate: 142.4 symbols/min [2025-09-29T02:15:37.024595] [INFO ] [MAIN ] FPI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:37.262523] [DEBUG] [LOCAL ] FPI: Loaded 31525 existing records from primary storage. [2025-09-29T02:15:37.262988] [DEBUG] [MAIN ] FPF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:37.276253] [INFO ] [MAIN ] FPI: Loaded 31525 primary data records. [2025-09-29T02:15:37.277229] [INFO ] [MAIN ] FPF: Generated 1820 derivative records from 17998 primary records. [2025-09-29T02:15:37.278126] [DEBUG] [MAIN ] FPH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:37.278353] [DEBUG] [LOCAL ] FPF: Saving derivative data. [2025-09-29T02:15:37.284361] [INFO ] [MAIN ] FPH: Generated 1820 derivative records from 19890 primary records. [2025-09-29T02:15:37.297472] [DEBUG] [LOCAL ] FPH: Saving derivative data. [2025-09-29T02:15:37.372911] [DEBUG] [LOCAL ] FPF: Derivative data saved (1820 records). [2025-09-29T02:15:37.390744] [INFO ] [MAIN ] FPF: Successfully saved derivative data. [2025-09-29T02:15:37.408106] [INFO ] [MAIN ] Derivative Progress: 808/2211 symbols completed. FPF took 1.0s. Estimated remaining: 9m 51s. Rate: 142.4 symbols/min [2025-09-29T02:15:37.404974] [DEBUG] [LOCAL ] FPH: Derivative data saved (1820 records). [2025-09-29T02:15:37.422614] [INFO ] [MAIN ] FPH: Successfully saved derivative data. [2025-09-29T02:15:37.435610] [INFO ] [MAIN ] Derivative Progress: 809/2211 symbols completed. FPH took 1.0s. Estimated remaining: 9m 50s. Rate: 142.6 symbols/min [2025-09-29T02:15:37.669912] [DEBUG] [MAIN ] FPI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:37.670689] [INFO ] [MAIN ] FPI: Generated 1820 derivative records from 31525 primary records. [2025-09-29T02:15:37.670777] [DEBUG] [LOCAL ] FPI: Saving derivative data. [2025-09-29T02:15:37.687199] [DEBUG] [LOCAL ] FPI: Derivative data saved (1820 records). [2025-09-29T02:15:37.687371] [INFO ] [MAIN ] FPI: Successfully saved derivative data. [2025-09-29T02:15:37.690281] [INFO ] [MAIN ] Derivative Progress: 810/2211 symbols completed. FPI took 0.7s. Estimated remaining: 9m 49s. Rate: 142.6 symbols/min [2025-09-29T02:15:37.690929] [INFO ] [MAIN ] FRGE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:37.691009] [INFO ] [MAIN ] FRA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:37.690858] [INFO ] [MAIN ] FR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:37.723051] [DEBUG] [LOCAL ] FRA: Loaded 14717 existing records from primary storage. [2025-09-29T02:15:37.730368] [INFO ] [MAIN ] FRA: Loaded 14717 primary data records. [2025-09-29T02:15:37.730820] [DEBUG] [LOCAL ] FRGE: Loaded 18571 existing records from primary storage. [2025-09-29T02:15:37.742686] [INFO ] [MAIN ] FRGE: Loaded 18571 primary data records. [2025-09-29T02:15:38.062156] [DEBUG] [LOCAL ] FR: Loaded 47174 existing records from primary storage. [2025-09-29T02:15:38.135205] [INFO ] [MAIN ] FR: Loaded 47174 primary data records. [2025-09-29T02:15:38.892455] [DEBUG] [MAIN ] FRGE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:38.907385] [INFO ] [MAIN ] FRGE: Generated 1820 derivative records from 18571 primary records. [2025-09-29T02:15:38.908631] [DEBUG] [MAIN ] FRA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:38.909501] [INFO ] [MAIN ] FRA: Generated 1820 derivative records from 14717 primary records. [2025-09-29T02:15:38.908258] [DEBUG] [LOCAL ] FRGE: Saving derivative data. [2025-09-29T02:15:38.909619] [DEBUG] [LOCAL ] FRA: Saving derivative data. [2025-09-29T02:15:38.946206] [DEBUG] [LOCAL ] FRA: Derivative data saved (1820 records). [2025-09-29T02:15:38.948459] [DEBUG] [LOCAL ] FRGE: Derivative data saved (1820 records). [2025-09-29T02:15:38.948923] [INFO ] [MAIN ] FRGE: Successfully saved derivative data. [2025-09-29T02:15:38.948794] [INFO ] [MAIN ] FRA: Successfully saved derivative data. [2025-09-29T02:15:38.952097] [INFO ] [MAIN ] Derivative Progress: 811/2211 symbols completed. FRGE took 1.3s. Estimated remaining: 9m 50s. Rate: 142.3 symbols/min [2025-09-29T02:15:38.954912] [INFO ] [MAIN ] FRO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:38.955020] [INFO ] [MAIN ] Derivative Progress: 812/2211 symbols completed. FRA took 1.3s. Estimated remaining: 9m 49s. Rate: 142.5 symbols/min [2025-09-29T02:15:38.955602] [INFO ] [MAIN ] FRT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:38.974692] [DEBUG] [MAIN ] FR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:38.975397] [INFO ] [MAIN ] FR: Generated 1820 derivative records from 47174 primary records. [2025-09-29T02:15:38.975482] [DEBUG] [LOCAL ] FR: Saving derivative data. [2025-09-29T02:15:38.992537] [DEBUG] [LOCAL ] FR: Derivative data saved (1820 records). [2025-09-29T02:15:38.992828] [INFO ] [MAIN ] FR: Successfully saved derivative data. [2025-09-29T02:15:38.996132] [INFO ] [MAIN ] Derivative Progress: 813/2211 symbols completed. FR took 1.3s. Estimated remaining: 9m 48s. Rate: 142.6 symbols/min [2025-09-29T02:15:38.996421] [INFO ] [MAIN ] FSCO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:39.056911] [DEBUG] [LOCAL ] FRT: Loaded 42808 existing records from primary storage. [2025-09-29T02:15:39.068810] [INFO ] [MAIN ] FRT: Loaded 42808 primary data records. [2025-09-29T02:15:39.134502] [DEBUG] [LOCAL ] FRO: Loaded 52603 existing records from primary storage. [2025-09-29T02:15:39.186870] [INFO ] [MAIN ] FRO: Loaded 52603 primary data records. [2025-09-29T02:15:39.270332] [DEBUG] [LOCAL ] FSCO: Loaded 37725 existing records from primary storage. [2025-09-29T02:15:39.307694] [INFO ] [MAIN ] FSCO: Loaded 37725 primary data records. [2025-09-29T02:15:40.198934] [DEBUG] [MAIN ] FRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:40.213845] [INFO ] [MAIN ] FRT: Generated 1820 derivative records from 42808 primary records. [2025-09-29T02:15:40.212625] [DEBUG] [MAIN ] FRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:40.217196] [INFO ] [MAIN ] FRO: Generated 1820 derivative records from 52603 primary records. [2025-09-29T02:15:40.215362] [DEBUG] [LOCAL ] FRT: Saving derivative data. [2025-09-29T02:15:40.217306] [DEBUG] [LOCAL ] FRO: Saving derivative data. [2025-09-29T02:15:40.261885] [DEBUG] [LOCAL ] FRT: Derivative data saved (1820 records). [2025-09-29T02:15:40.267465] [DEBUG] [MAIN ] FSCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:40.267759] [INFO ] [MAIN ] FRT: Successfully saved derivative data. [2025-09-29T02:15:40.267017] [DEBUG] [LOCAL ] FRO: Derivative data saved (1820 records). [2025-09-29T02:15:40.270865] [INFO ] [MAIN ] Derivative Progress: 814/2211 symbols completed. FRT took 1.3s. Estimated remaining: 9m 49s. Rate: 142.3 symbols/min [2025-09-29T02:15:40.272019] [INFO ] [MAIN ] FRO: Successfully saved derivative data. [2025-09-29T02:15:40.272127] [INFO ] [MAIN ] FSK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:40.272330] [INFO ] [MAIN ] FSCO: Generated 1820 derivative records from 37725 primary records. [2025-09-29T02:15:40.276192] [INFO ] [MAIN ] Derivative Progress: 815/2211 symbols completed. FRO took 1.3s. Estimated remaining: 9m 48s. Rate: 142.4 symbols/min [2025-09-29T02:15:40.277166] [INFO ] [MAIN ] FSLY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:40.277034] [DEBUG] [LOCAL ] FSCO: Saving derivative data. [2025-09-29T02:15:40.296187] [DEBUG] [LOCAL ] FSCO: Derivative data saved (1820 records). [2025-09-29T02:15:40.296331] [INFO ] [MAIN ] FSCO: Successfully saved derivative data. [2025-09-29T02:15:40.299590] [INFO ] [MAIN ] Derivative Progress: 816/2211 symbols completed. FSCO took 1.3s. Estimated remaining: 9m 47s. Rate: 142.6 symbols/min [2025-09-29T02:15:40.300235] [INFO ] [MAIN ] FSM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:40.396854] [DEBUG] [LOCAL ] FSK: Loaded 50173 existing records from primary storage. [2025-09-29T02:15:40.397812] [DEBUG] [LOCAL ] FSLY: Loaded 51989 existing records from primary storage. [2025-09-29T02:15:40.399818] [INFO ] [MAIN ] FSK: Loaded 50173 primary data records. [2025-09-29T02:15:40.399890] [INFO ] [MAIN ] FSLY: Loaded 51989 primary data records. [2025-09-29T02:15:40.462168] [DEBUG] [LOCAL ] FSM: Loaded 54065 existing records from primary storage. [2025-09-29T02:15:40.553219] [INFO ] [MAIN ] FSM: Loaded 54065 primary data records. [2025-09-29T02:15:41.497399] [DEBUG] [MAIN ] FSK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:41.501962] [INFO ] [MAIN ] FSK: Generated 1820 derivative records from 50173 primary records. [2025-09-29T02:15:41.502821] [DEBUG] [LOCAL ] FSK: Saving derivative data. [2025-09-29T02:15:41.517637] [DEBUG] [MAIN ] FSLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:41.519418] [INFO ] [MAIN ] FSLY: Generated 1820 derivative records from 51989 primary records. [2025-09-29T02:15:41.519922] [DEBUG] [LOCAL ] FSLY: Saving derivative data. [2025-09-29T02:15:41.550337] [DEBUG] [LOCAL ] FSK: Derivative data saved (1820 records). [2025-09-29T02:15:41.552319] [INFO ] [MAIN ] FSK: Successfully saved derivative data. [2025-09-29T02:15:41.560182] [DEBUG] [LOCAL ] FSLY: Derivative data saved (1820 records). [2025-09-29T02:15:41.561347] [INFO ] [MAIN ] FSLY: Successfully saved derivative data. [2025-09-29T02:15:41.557961] [INFO ] [MAIN ] Derivative Progress: 817/2211 symbols completed. FSK took 1.3s. Estimated remaining: 9m 48s. Rate: 142.2 symbols/min [2025-09-29T02:15:41.562047] [INFO ] [MAIN ] FSS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:41.565966] [INFO ] [MAIN ] Derivative Progress: 818/2211 symbols completed. FSLY took 1.3s. Estimated remaining: 9m 47s. Rate: 142.4 symbols/min [2025-09-29T02:15:41.567093] [INFO ] [MAIN ] FT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:41.589242] [DEBUG] [MAIN ] FSM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:41.590216] [INFO ] [MAIN ] FSM: Generated 1820 derivative records from 54065 primary records. [2025-09-29T02:15:41.590386] [DEBUG] [LOCAL ] FSM: Saving derivative data. [2025-09-29T02:15:41.615310] [DEBUG] [LOCAL ] FSM: Derivative data saved (1820 records). [2025-09-29T02:15:41.615901] [INFO ] [MAIN ] FSM: Successfully saved derivative data. [2025-09-29T02:15:41.624463] [INFO ] [MAIN ] Derivative Progress: 819/2211 symbols completed. FSM took 1.3s. Estimated remaining: 9m 46s. Rate: 142.6 symbols/min [2025-09-29T02:15:41.624901] [DEBUG] [LOCAL ] FT: Loaded 6432 existing records from primary storage. [2025-09-29T02:15:41.625375] [INFO ] [MAIN ] FTHY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:41.625834] [INFO ] [MAIN ] FT: Loaded 6432 primary data records. [2025-09-29T02:15:41.784575] [DEBUG] [LOCAL ] FTHY: Loaded 11947 existing records from primary storage. [2025-09-29T02:15:41.796388] [DEBUG] [LOCAL ] FSS: Loaded 34888 existing records from primary storage. [2025-09-29T02:15:41.812137] [INFO ] [MAIN ] FTHY: Loaded 11947 primary data records. [2025-09-29T02:15:41.845260] [INFO ] [MAIN ] FSS: Loaded 34888 primary data records. [2025-09-29T02:15:42.769556] [DEBUG] [MAIN ] FT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:42.771558] [INFO ] [MAIN ] FT: Generated 1820 derivative records from 6432 primary records. [2025-09-29T02:15:42.771735] [DEBUG] [LOCAL ] FT: Saving derivative data. [2025-09-29T02:15:42.791785] [DEBUG] [LOCAL ] FT: Derivative data saved (1820 records). [2025-09-29T02:15:42.791982] [INFO ] [MAIN ] FT: Successfully saved derivative data. [2025-09-29T02:15:42.794041] [INFO ] [MAIN ] Derivative Progress: 820/2211 symbols completed. FT took 1.2s. Estimated remaining: 9m 47s. Rate: 142.3 symbols/min [2025-09-29T02:15:42.797826] [INFO ] [MAIN ] FTI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:42.815440] [DEBUG] [MAIN ] FTHY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:42.817053] [INFO ] [MAIN ] FTHY: Generated 1820 derivative records from 11947 primary records. [2025-09-29T02:15:42.817185] [DEBUG] [LOCAL ] FTHY: Saving derivative data. [2025-09-29T02:15:42.836727] [DEBUG] [LOCAL ] FTHY: Derivative data saved (1820 records). [2025-09-29T02:15:42.836924] [INFO ] [MAIN ] FTHY: Successfully saved derivative data. [2025-09-29T02:15:42.840852] [INFO ] [MAIN ] Derivative Progress: 821/2211 symbols completed. FTHY took 1.2s. Estimated remaining: 9m 46s. Rate: 142.4 symbols/min [2025-09-29T02:15:42.841273] [INFO ] [MAIN ] FTK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:42.857769] [DEBUG] [MAIN ] FSS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:42.858707] [INFO ] [MAIN ] FSS: Generated 1820 derivative records from 34888 primary records. [2025-09-29T02:15:42.858871] [DEBUG] [LOCAL ] FSS: Saving derivative data. [2025-09-29T02:15:42.879236] [DEBUG] [LOCAL ] FSS: Derivative data saved (1820 records). [2025-09-29T02:15:42.879471] [INFO ] [MAIN ] FSS: Successfully saved derivative data. [2025-09-29T02:15:42.883942] [INFO ] [MAIN ] Derivative Progress: 822/2211 symbols completed. FSS took 1.3s. Estimated remaining: 9m 45s. Rate: 142.6 symbols/min [2025-09-29T02:15:42.884218] [INFO ] [MAIN ] FTS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:42.931309] [DEBUG] [LOCAL ] FTK: Loaded 32755 existing records from primary storage. [2025-09-29T02:15:42.947226] [INFO ] [MAIN ] FTK: Loaded 32755 primary data records. [2025-09-29T02:15:42.960844] [DEBUG] [LOCAL ] FTI: Loaded 54078 existing records from primary storage. [2025-09-29T02:15:42.988051] [INFO ] [MAIN ] FTI: Loaded 54078 primary data records. [2025-09-29T02:15:43.332800] [DEBUG] [LOCAL ] FTS: Loaded 42695 existing records from primary storage. [2025-09-29T02:15:43.474996] [INFO ] [MAIN ] FTS: Loaded 42695 primary data records. [2025-09-29T02:15:44.075744] [DEBUG] [MAIN ] FTK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:44.077438] [INFO ] [MAIN ] FTK: Generated 1820 derivative records from 32755 primary records. [2025-09-29T02:15:44.078624] [DEBUG] [LOCAL ] FTK: Saving derivative data. [2025-09-29T02:15:44.095038] [DEBUG] [MAIN ] FTI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:44.112709] [DEBUG] [LOCAL ] FTK: Derivative data saved (1820 records). [2025-09-29T02:15:44.108377] [INFO ] [MAIN ] FTI: Generated 1820 derivative records from 54078 primary records. [2025-09-29T02:15:44.113103] [INFO ] [MAIN ] FTK: Successfully saved derivative data. [2025-09-29T02:15:44.113245] [DEBUG] [LOCAL ] FTI: Saving derivative data. [2025-09-29T02:15:44.116903] [INFO ] [MAIN ] Derivative Progress: 823/2211 symbols completed. FTK took 1.3s. Estimated remaining: 9m 46s. Rate: 142.2 symbols/min [2025-09-29T02:15:44.135551] [DEBUG] [LOCAL ] FTI: Derivative data saved (1820 records). [2025-09-29T02:15:44.135851] [INFO ] [MAIN ] FTI: Successfully saved derivative data. [2025-09-29T02:15:44.139884] [INFO ] [MAIN ] Derivative Progress: 824/2211 symbols completed. FTI took 1.3s. Estimated remaining: 9m 44s. Rate: 142.4 symbols/min [2025-09-29T02:15:44.160031] [DEBUG] [MAIN ] FTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:44.160831] [INFO ] [MAIN ] FTS: Generated 1820 derivative records from 42695 primary records. [2025-09-29T02:15:44.160931] [DEBUG] [LOCAL ] FTS: Saving derivative data. [2025-09-29T02:15:44.177028] [DEBUG] [LOCAL ] FTS: Derivative data saved (1820 records). [2025-09-29T02:15:44.177181] [INFO ] [MAIN ] FTS: Successfully saved derivative data. [2025-09-29T02:15:44.181437] [INFO ] [MAIN ] Derivative Progress: 825/2211 symbols completed. FTS took 1.3s. Estimated remaining: 9m 43s. Rate: 142.6 symbols/min [2025-09-29T02:15:44.182168] [INFO ] [MAIN ] FTWO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:44.181974] [INFO ] [MAIN ] FTV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:44.182062] [INFO ] [MAIN ] FUBO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:44.189029] [DEBUG] [LOCAL ] FTWO: Loaded 1837 existing records from primary storage. [2025-09-29T02:15:44.189408] [INFO ] [MAIN ] FTWO: Loaded 1837 primary data records. [2025-09-29T02:15:44.591128] [DEBUG] [LOCAL ] FUBO: Loaded 54476 existing records from primary storage. [2025-09-29T02:15:44.591693] [INFO ] [MAIN ] FUBO: Loaded 54476 primary data records. [2025-09-29T02:15:44.737214] [DEBUG] [LOCAL ] FTV: Loaded 53686 existing records from primary storage. [2025-09-29T02:15:44.750600] [INFO ] [MAIN ] FTV: Loaded 53686 primary data records. [2025-09-29T02:15:45.364943] [DEBUG] [MAIN ] FTWO: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:15:45.366130] [INFO ] [MAIN ] FTWO: Generated 1819 derivative records from 1837 primary records. [2025-09-29T02:15:45.366267] [DEBUG] [LOCAL ] FTWO: Saving derivative data. [2025-09-29T02:15:45.383895] [DEBUG] [LOCAL ] FTWO: Derivative data saved (1819 records). [2025-09-29T02:15:45.384401] [INFO ] [MAIN ] FTWO: Successfully saved derivative data. [2025-09-29T02:15:45.387287] [INFO ] [MAIN ] Derivative Progress: 826/2211 symbols completed. FTWO took 1.2s. Estimated remaining: 9m 44s. Rate: 142.2 symbols/min [2025-09-29T02:15:45.387972] [INFO ] [MAIN ] FUL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:45.420025] [DEBUG] [MAIN ] FUBO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:45.421239] [INFO ] [MAIN ] FUBO: Generated 1820 derivative records from 54476 primary records. [2025-09-29T02:15:45.443361] [DEBUG] [MAIN ] FTV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:45.434184] [DEBUG] [LOCAL ] FUBO: Saving derivative data. [2025-09-29T02:15:45.444407] [INFO ] [MAIN ] FTV: Generated 1820 derivative records from 53686 primary records. [2025-09-29T02:15:45.445481] [DEBUG] [LOCAL ] FTV: Saving derivative data. [2025-09-29T02:15:45.486372] [DEBUG] [LOCAL ] FUL: Loaded 33570 existing records from primary storage. [2025-09-29T02:15:45.486845] [INFO ] [MAIN ] FUL: Loaded 33570 primary data records. [2025-09-29T02:15:45.487950] [DEBUG] [LOCAL ] FTV: Derivative data saved (1820 records). [2025-09-29T02:15:45.525687] [INFO ] [MAIN ] FTV: Successfully saved derivative data. [2025-09-29T02:15:45.525545] [DEBUG] [LOCAL ] FUBO: Derivative data saved (1820 records). [2025-09-29T02:15:45.592112] [INFO ] [MAIN ] FUBO: Successfully saved derivative data. [2025-09-29T02:15:45.607494] [INFO ] [MAIN ] Derivative Progress: 827/2211 symbols completed. FTV took 1.4s. Estimated remaining: 9m 43s. Rate: 142.3 symbols/min [2025-09-29T02:15:45.621922] [INFO ] [MAIN ] FUN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:45.622088] [INFO ] [MAIN ] Derivative Progress: 828/2211 symbols completed. FUBO took 1.4s. Estimated remaining: 9m 42s. Rate: 142.5 symbols/min [2025-09-29T02:15:45.633154] [INFO ] [MAIN ] FVR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:45.864507] [DEBUG] [LOCAL ] FVR: Loaded 22328 existing records from primary storage. [2025-09-29T02:15:45.879786] [INFO ] [MAIN ] FVR: Loaded 22328 primary data records. [2025-09-29T02:15:46.021928] [DEBUG] [LOCAL ] FUN: Loaded 52349 existing records from primary storage. [2025-09-29T02:15:46.038807] [INFO ] [MAIN ] FUN: Loaded 52349 primary data records. [2025-09-29T02:15:46.296551] [DEBUG] [MAIN ] FUL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:46.343619] [INFO ] [MAIN ] FUL: Generated 1820 derivative records from 33570 primary records. [2025-09-29T02:15:46.357569] [DEBUG] [LOCAL ] FUL: Saving derivative data. [2025-09-29T02:15:46.453768] [DEBUG] [LOCAL ] FUL: Derivative data saved (1820 records). [2025-09-29T02:15:46.495554] [INFO ] [MAIN ] FUL: Successfully saved derivative data. [2025-09-29T02:15:46.610522] [INFO ] [MAIN ] Derivative Progress: 829/2211 symbols completed. FUL took 1.2s. Estimated remaining: 9m 43s. Rate: 142.2 symbols/min [2025-09-29T02:15:46.626719] [INFO ] [MAIN ] FVRR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:46.654431] [DEBUG] [MAIN ] FVR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:46.656444] [INFO ] [MAIN ] FVR: Generated 1820 derivative records from 22328 primary records. [2025-09-29T02:15:46.656878] [DEBUG] [LOCAL ] FVR: Saving derivative data. [2025-09-29T02:15:46.687356] [DEBUG] [LOCAL ] FVR: Derivative data saved (1820 records). [2025-09-29T02:15:46.687847] [INFO ] [MAIN ] FVR: Successfully saved derivative data. [2025-09-29T02:15:46.690706] [INFO ] [MAIN ] Derivative Progress: 830/2211 symbols completed. FVR took 1.1s. Estimated remaining: 9m 42s. Rate: 142.4 symbols/min [2025-09-29T02:15:46.691337] [INFO ] [MAIN ] FXED: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:46.724775] [DEBUG] [MAIN ] FUN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:46.727422] [DEBUG] [LOCAL ] FXED: Loaded 1259 existing records from primary storage. [2025-09-29T02:15:46.729155] [INFO ] [MAIN ] FUN: Generated 1820 derivative records from 52349 primary records. [2025-09-29T02:15:46.729380] [INFO ] [MAIN ] FXED: Loaded 1259 primary data records. [2025-09-29T02:15:46.729614] [DEBUG] [LOCAL ] FUN: Saving derivative data. [2025-09-29T02:15:46.745713] [DEBUG] [LOCAL ] FVRR: Loaded 40749 existing records from primary storage. [2025-09-29T02:15:46.768707] [INFO ] [MAIN ] FVRR: Loaded 40749 primary data records. [2025-09-29T02:15:46.909585] [DEBUG] [LOCAL ] FUN: Derivative data saved (1820 records). [2025-09-29T02:15:46.932619] [INFO ] [MAIN ] FUN: Successfully saved derivative data. [2025-09-29T02:15:46.973029] [INFO ] [MAIN ] Derivative Progress: 831/2211 symbols completed. FUN took 1.4s. Estimated remaining: 9m 41s. Rate: 142.4 symbols/min [2025-09-29T02:15:47.026545] [INFO ] [MAIN ] G: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:47.548976] [DEBUG] [MAIN ] FXED: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:15:47.550141] [INFO ] [MAIN ] FXED: Generated 1819 derivative records from 1259 primary records. [2025-09-29T02:15:47.553216] [DEBUG] [LOCAL ] FXED: Saving derivative data. [2025-09-29T02:15:47.586244] [DEBUG] [LOCAL ] G: Loaded 50547 existing records from primary storage. [2025-09-29T02:15:47.587269] [INFO ] [MAIN ] G: Loaded 50547 primary data records. [2025-09-29T02:15:47.589610] [DEBUG] [LOCAL ] FXED: Derivative data saved (1819 records). [2025-09-29T02:15:47.613385] [INFO ] [MAIN ] FXED: Successfully saved derivative data. [2025-09-29T02:15:47.677931] [INFO ] [MAIN ] Derivative Progress: 832/2211 symbols completed. FXED took 1.0s. Estimated remaining: 9m 41s. Rate: 142.3 symbols/min [2025-09-29T02:15:47.710568] [INFO ] [MAIN ] GAB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:47.780633] [DEBUG] [MAIN ] FVRR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:47.816946] [INFO ] [MAIN ] FVRR: Generated 1820 derivative records from 40749 primary records. [2025-09-29T02:15:47.945718] [DEBUG] [LOCAL ] FVRR: Saving derivative data. [2025-09-29T02:15:47.978966] [DEBUG] [LOCAL ] FVRR: Derivative data saved (1820 records). [2025-09-29T02:15:47.989436] [INFO ] [MAIN ] FVRR: Successfully saved derivative data. [2025-09-29T02:15:47.993839] [DEBUG] [LOCAL ] GAB: Loaded 28493 existing records from primary storage. [2025-09-29T02:15:47.994051] [INFO ] [MAIN ] GAB: Loaded 28493 primary data records. [2025-09-29T02:15:47.992451] [INFO ] [MAIN ] Derivative Progress: 833/2211 symbols completed. FVRR took 1.4s. Estimated remaining: 9m 41s. Rate: 142.4 symbols/min [2025-09-29T02:15:47.994517] [INFO ] [MAIN ] GAM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:48.137915] [DEBUG] [LOCAL ] GAM: Loaded 4174 existing records from primary storage. [2025-09-29T02:15:48.181191] [INFO ] [MAIN ] GAM: Loaded 4174 primary data records. [2025-09-29T02:15:48.485543] [DEBUG] [MAIN ] G: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:48.506185] [INFO ] [MAIN ] G: Generated 1820 derivative records from 50547 primary records. [2025-09-29T02:15:48.513287] [DEBUG] [LOCAL ] G: Saving derivative data. [2025-09-29T02:15:48.650953] [DEBUG] [LOCAL ] G: Derivative data saved (1820 records). [2025-09-29T02:15:48.745076] [INFO ] [MAIN ] G: Successfully saved derivative data. [2025-09-29T02:15:48.749069] [INFO ] [MAIN ] Derivative Progress: 834/2211 symbols completed. G took 1.7s. Estimated remaining: 9m 41s. Rate: 142.2 symbols/min [2025-09-29T02:15:48.749413] [INFO ] [MAIN ] GAP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:48.773123] [DEBUG] [MAIN ] GAB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:48.775169] [INFO ] [MAIN ] GAB: Generated 1820 derivative records from 28493 primary records. [2025-09-29T02:15:48.775311] [DEBUG] [LOCAL ] GAB: Saving derivative data. [2025-09-29T02:15:48.795521] [DEBUG] [LOCAL ] GAB: Derivative data saved (1820 records). [2025-09-29T02:15:48.795717] [INFO ] [MAIN ] GAB: Successfully saved derivative data. [2025-09-29T02:15:48.798454] [INFO ] [MAIN ] Derivative Progress: 835/2211 symbols completed. GAB took 1.1s. Estimated remaining: 9m 40s. Rate: 142.4 symbols/min [2025-09-29T02:15:48.799050] [INFO ] [MAIN ] GATX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:48.823214] [DEBUG] [MAIN ] GAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:48.841203] [INFO ] [MAIN ] GAM: Generated 1820 derivative records from 4174 primary records. [2025-09-29T02:15:48.841699] [DEBUG] [LOCAL ] GAM: Saving derivative data. [2025-09-29T02:15:48.864457] [DEBUG] [LOCAL ] GAM: Derivative data saved (1820 records). [2025-09-29T02:15:48.872323] [DEBUG] [LOCAL ] GATX: Loaded 18437 existing records from primary storage. [2025-09-29T02:15:48.889691] [INFO ] [MAIN ] GAM: Successfully saved derivative data. [2025-09-29T02:15:48.893128] [INFO ] [MAIN ] Derivative Progress: 836/2211 symbols completed. GAM took 0.9s. Estimated remaining: 9m 39s. Rate: 142.5 symbols/min [2025-09-29T02:15:48.894839] [DEBUG] [LOCAL ] GAP: Loaded 54435 existing records from primary storage. [2025-09-29T02:15:48.895054] [INFO ] [MAIN ] GAP: Loaded 54435 primary data records. [2025-09-29T02:15:48.895380] [INFO ] [MAIN ] GBAB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:48.895173] [INFO ] [MAIN ] GATX: Loaded 18437 primary data records. [2025-09-29T02:15:49.131022] [DEBUG] [LOCAL ] GBAB: Loaded 13142 existing records from primary storage. [2025-09-29T02:15:49.153243] [INFO ] [MAIN ] GBAB: Loaded 13142 primary data records. [2025-09-29T02:15:50.009673] [DEBUG] [MAIN ] GATX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:50.013456] [INFO ] [MAIN ] GATX: Generated 1820 derivative records from 18437 primary records. [2025-09-29T02:15:50.013860] [DEBUG] [LOCAL ] GATX: Saving derivative data. [2025-09-29T02:15:50.029497] [DEBUG] [MAIN ] GAP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:50.039563] [INFO ] [MAIN ] GAP: Generated 1820 derivative records from 54435 primary records. [2025-09-29T02:15:50.050790] [DEBUG] [LOCAL ] GATX: Derivative data saved (1820 records). [2025-09-29T02:15:50.051326] [INFO ] [MAIN ] GATX: Successfully saved derivative data. [2025-09-29T02:15:50.051537] [DEBUG] [LOCAL ] GAP: Saving derivative data. [2025-09-29T02:15:50.054440] [INFO ] [MAIN ] Derivative Progress: 837/2211 symbols completed. GATX took 1.3s. Estimated remaining: 9m 40s. Rate: 142.2 symbols/min [2025-09-29T02:15:50.077683] [DEBUG] [MAIN ] GBAB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:50.069224] [INFO ] [MAIN ] GBCI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:50.086241] [INFO ] [MAIN ] GBAB: Generated 1820 derivative records from 13142 primary records. [2025-09-29T02:15:50.086500] [DEBUG] [LOCAL ] GBAB: Saving derivative data. [2025-09-29T02:15:50.090033] [DEBUG] [LOCAL ] GAP: Derivative data saved (1820 records). [2025-09-29T02:15:50.099186] [INFO ] [MAIN ] GAP: Successfully saved derivative data. [2025-09-29T02:15:50.102009] [INFO ] [MAIN ] Derivative Progress: 838/2211 symbols completed. GAP took 1.4s. Estimated remaining: 9m 39s. Rate: 142.4 symbols/min [2025-09-29T02:15:50.111691] [DEBUG] [LOCAL ] GBAB: Derivative data saved (1820 records). [2025-09-29T02:15:50.111869] [INFO ] [MAIN ] GBAB: Successfully saved derivative data. [2025-09-29T02:15:50.115183] [INFO ] [MAIN ] Derivative Progress: 839/2211 symbols completed. GBAB took 1.2s. Estimated remaining: 9m 38s. Rate: 142.5 symbols/min [2025-09-29T02:15:50.155220] [DEBUG] [LOCAL ] GBCI: Loaded 40720 existing records from primary storage. [2025-09-29T02:15:50.155413] [INFO ] [MAIN ] GBCI: Loaded 40720 primary data records. [2025-09-29T02:15:50.500892] [DEBUG] [MAIN ] GBCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:50.501712] [INFO ] [MAIN ] GBCI: Generated 1820 derivative records from 40720 primary records. [2025-09-29T02:15:50.501799] [DEBUG] [LOCAL ] GBCI: Saving derivative data. [2025-09-29T02:15:50.517397] [DEBUG] [LOCAL ] GBCI: Derivative data saved (1820 records). [2025-09-29T02:15:50.517487] [INFO ] [MAIN ] GBCI: Successfully saved derivative data. [2025-09-29T02:15:50.520264] [INFO ] [MAIN ] Derivative Progress: 840/2211 symbols completed. GBCI took 0.5s. Estimated remaining: 9m 37s. Rate: 142.5 symbols/min [2025-09-29T02:15:50.520740] [INFO ] [MAIN ] GBTG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:50.520865] [INFO ] [MAIN ] GCI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:50.521016] [INFO ] [MAIN ] GBX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:50.578542] [DEBUG] [LOCAL ] GBX: Loaded 29497 existing records from primary storage. [2025-09-29T02:15:50.580423] [INFO ] [MAIN ] GBX: Loaded 29497 primary data records. [2025-09-29T02:15:50.644275] [DEBUG] [LOCAL ] GBTG: Loaded 40807 existing records from primary storage. [2025-09-29T02:15:50.691430] [DEBUG] [LOCAL ] GCI: Loaded 44828 existing records from primary storage. [2025-09-29T02:15:50.722071] [INFO ] [MAIN ] GBTG: Loaded 40807 primary data records. [2025-09-29T02:15:50.722180] [INFO ] [MAIN ] GCI: Loaded 44828 primary data records. [2025-09-29T02:15:51.698954] [DEBUG] [MAIN ] GBX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:51.700149] [INFO ] [MAIN ] GBX: Generated 1820 derivative records from 29497 primary records. [2025-09-29T02:15:51.700434] [DEBUG] [LOCAL ] GBX: Saving derivative data. [2025-09-29T02:15:51.735203] [DEBUG] [LOCAL ] GBX: Derivative data saved (1820 records). [2025-09-29T02:15:51.735955] [DEBUG] [MAIN ] GCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:51.736085] [INFO ] [MAIN ] GBX: Successfully saved derivative data. [2025-09-29T02:15:51.737474] [INFO ] [MAIN ] GCI: Generated 1820 derivative records from 44828 primary records. [2025-09-29T02:15:51.741336] [DEBUG] [LOCAL ] GCI: Saving derivative data. [2025-09-29T02:15:51.741060] [INFO ] [MAIN ] Derivative Progress: 841/2211 symbols completed. GBX took 1.2s. Estimated remaining: 9m 38s. Rate: 142.2 symbols/min [2025-09-29T02:15:51.742920] [INFO ] [MAIN ] GCO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:51.768276] [DEBUG] [LOCAL ] GCI: Derivative data saved (1820 records). [2025-09-29T02:15:51.768688] [INFO ] [MAIN ] GCI: Successfully saved derivative data. [2025-09-29T02:15:51.771748] [INFO ] [MAIN ] Derivative Progress: 842/2211 symbols completed. GCI took 1.3s. Estimated remaining: 9m 37s. Rate: 142.4 symbols/min [2025-09-29T02:15:51.785370] [DEBUG] [MAIN ] GBTG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:51.786339] [INFO ] [MAIN ] GBTG: Generated 1820 derivative records from 40807 primary records. [2025-09-29T02:15:51.786526] [DEBUG] [LOCAL ] GBTG: Saving derivative data. [2025-09-29T02:15:51.785539] [INFO ] [MAIN ] GCTS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:51.811559] [DEBUG] [LOCAL ] GBTG: Derivative data saved (1820 records). [2025-09-29T02:15:51.811937] [INFO ] [MAIN ] GBTG: Successfully saved derivative data. [2025-09-29T02:15:51.815759] [INFO ] [MAIN ] Derivative Progress: 843/2211 symbols completed. GBTG took 1.3s. Estimated remaining: 9m 36s. Rate: 142.5 symbols/min [2025-09-29T02:15:51.816033] [INFO ] [MAIN ] GCV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:51.833469] [DEBUG] [LOCAL ] GCO: Loaded 25686 existing records from primary storage. [2025-09-29T02:15:51.834071] [INFO ] [MAIN ] GCO: Loaded 25686 primary data records. [2025-09-29T02:15:51.900067] [DEBUG] [LOCAL ] GCV: Loaded 7333 existing records from primary storage. [2025-09-29T02:15:51.923099] [INFO ] [MAIN ] GCV: Loaded 7333 primary data records. [2025-09-29T02:15:51.931213] [DEBUG] [LOCAL ] GCTS: Loaded 20060 existing records from primary storage. [2025-09-29T02:15:51.968230] [INFO ] [MAIN ] GCTS: Loaded 20060 primary data records. [2025-09-29T02:15:52.860962] [DEBUG] [MAIN ] GCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:52.862325] [INFO ] [MAIN ] GCO: Generated 1820 derivative records from 25686 primary records. [2025-09-29T02:15:52.863257] [DEBUG] [LOCAL ] GCO: Saving derivative data. [2025-09-29T02:15:52.882513] [DEBUG] [LOCAL ] GCO: Derivative data saved (1820 records). [2025-09-29T02:15:52.882986] [INFO ] [MAIN ] GCO: Successfully saved derivative data. [2025-09-29T02:15:52.885875] [INFO ] [MAIN ] Derivative Progress: 844/2211 symbols completed. GCO took 1.1s. Estimated remaining: 9m 37s. Rate: 142.3 symbols/min [2025-09-29T02:15:52.887312] [INFO ] [MAIN ] GD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:52.920244] [DEBUG] [MAIN ] GCV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:52.919792] [DEBUG] [MAIN ] GCTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:52.921886] [INFO ] [MAIN ] GCTS: Generated 1820 derivative records from 20060 primary records. [2025-09-29T02:15:52.921163] [INFO ] [MAIN ] GCV: Generated 1820 derivative records from 7333 primary records. [2025-09-29T02:15:52.922022] [DEBUG] [LOCAL ] GCTS: Saving derivative data. [2025-09-29T02:15:52.922115] [DEBUG] [LOCAL ] GCV: Saving derivative data. [2025-09-29T02:15:52.950685] [DEBUG] [LOCAL ] GCTS: Derivative data saved (1820 records). [2025-09-29T02:15:52.954842] [DEBUG] [LOCAL ] GCV: Derivative data saved (1820 records). [2025-09-29T02:15:52.955121] [INFO ] [MAIN ] GCTS: Successfully saved derivative data. [2025-09-29T02:15:52.954957] [INFO ] [MAIN ] GCV: Successfully saved derivative data. [2025-09-29T02:15:52.958335] [INFO ] [MAIN ] Derivative Progress: 845/2211 symbols completed. GCTS took 1.2s. Estimated remaining: 9m 36s. Rate: 142.4 symbols/min [2025-09-29T02:15:52.961481] [INFO ] [MAIN ] Derivative Progress: 846/2211 symbols completed. GCV took 1.1s. Estimated remaining: 9m 34s. Rate: 142.6 symbols/min [2025-09-29T02:15:52.961711] [INFO ] [MAIN ] GDIV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:52.958714] [INFO ] [MAIN ] GDDY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:52.970578] [DEBUG] [LOCAL ] GDIV: Loaded 3724 existing records from primary storage. [2025-09-29T02:15:52.970805] [INFO ] [MAIN ] GDIV: Loaded 3724 primary data records. [2025-09-29T02:15:53.388780] [DEBUG] [LOCAL ] GD: Loaded 47940 existing records from primary storage. [2025-09-29T02:15:53.400855] [INFO ] [MAIN ] GD: Loaded 47940 primary data records. [2025-09-29T02:15:53.534310] [DEBUG] [LOCAL ] GDDY: Loaded 50449 existing records from primary storage. [2025-09-29T02:15:53.592728] [INFO ] [MAIN ] GDDY: Loaded 50449 primary data records. [2025-09-29T02:15:53.888461] [DEBUG] [MAIN ] GDIV: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:15:53.889585] [INFO ] [MAIN ] GDIV: Generated 1819 derivative records from 3724 primary records. [2025-09-29T02:15:53.889719] [DEBUG] [LOCAL ] GDIV: Saving derivative data. [2025-09-29T02:15:54.201936] [DEBUG] [LOCAL ] GDIV: Derivative data saved (1819 records). [2025-09-29T02:15:54.231632] [INFO ] [MAIN ] GDIV: Successfully saved derivative data. [2025-09-29T02:15:54.250994] [INFO ] [MAIN ] Derivative Progress: 847/2211 symbols completed. GDIV took 1.3s. Estimated remaining: 9m 35s. Rate: 142.2 symbols/min [2025-09-29T02:15:54.274844] [INFO ] [MAIN ] GDL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:54.470565] [DEBUG] [LOCAL ] GDL: Loaded 2572 existing records from primary storage. [2025-09-29T02:15:54.471555] [INFO ] [MAIN ] GDL: Loaded 2572 primary data records. [2025-09-29T02:15:54.677020] [DEBUG] [MAIN ] GD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:54.820854] [INFO ] [MAIN ] GD: Generated 1820 derivative records from 47940 primary records. [2025-09-29T02:15:54.835984] [DEBUG] [LOCAL ] GD: Saving derivative data. [2025-09-29T02:15:54.858171] [DEBUG] [LOCAL ] GD: Derivative data saved (1820 records). [2025-09-29T02:15:54.859067] [INFO ] [MAIN ] GD: Successfully saved derivative data. [2025-09-29T02:15:54.864189] [INFO ] [MAIN ] Derivative Progress: 848/2211 symbols completed. GD took 2.0s. Estimated remaining: 9m 35s. Rate: 142.2 symbols/min [2025-09-29T02:15:54.866097] [INFO ] [MAIN ] GDO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:54.882410] [DEBUG] [MAIN ] GDDY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:54.883439] [INFO ] [MAIN ] GDDY: Generated 1820 derivative records from 50449 primary records. [2025-09-29T02:15:54.883958] [DEBUG] [LOCAL ] GDDY: Saving derivative data. [2025-09-29T02:15:54.902956] [DEBUG] [LOCAL ] GDO: Loaded 6076 existing records from primary storage. [2025-09-29T02:15:54.903785] [INFO ] [MAIN ] GDO: Loaded 6076 primary data records. [2025-09-29T02:15:55.016347] [DEBUG] [LOCAL ] GDDY: Derivative data saved (1820 records). [2025-09-29T02:15:55.037110] [INFO ] [MAIN ] GDDY: Successfully saved derivative data. [2025-09-29T02:15:55.033008] [DEBUG] [MAIN ] GDL: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:15:55.040768] [INFO ] [MAIN ] Derivative Progress: 849/2211 symbols completed. GDDY took 2.1s. Estimated remaining: 9m 34s. Rate: 142.3 symbols/min [2025-09-29T02:15:55.041006] [INFO ] [MAIN ] GDOT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:55.042226] [INFO ] [MAIN ] GDL: Generated 1819 derivative records from 2572 primary records. [2025-09-29T02:15:55.043299] [DEBUG] [LOCAL ] GDL: Saving derivative data. [2025-09-29T02:15:55.281183] [DEBUG] [LOCAL ] GDL: Derivative data saved (1819 records). [2025-09-29T02:15:55.281531] [INFO ] [MAIN ] GDL: Successfully saved derivative data. [2025-09-29T02:15:55.285005] [INFO ] [MAIN ] Derivative Progress: 850/2211 symbols completed. GDL took 1.0s. Estimated remaining: 9m 34s. Rate: 142.3 symbols/min [2025-09-29T02:15:55.285525] [INFO ] [MAIN ] GDV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:55.327575] [DEBUG] [LOCAL ] GDV: Loaded 19971 existing records from primary storage. [2025-09-29T02:15:55.339367] [INFO ] [MAIN ] GDV: Loaded 19971 primary data records. [2025-09-29T02:15:55.360757] [DEBUG] [LOCAL ] GDOT: Loaded 39279 existing records from primary storage. [2025-09-29T02:15:55.406904] [INFO ] [MAIN ] GDOT: Loaded 39279 primary data records. [2025-09-29T02:15:55.682260] [DEBUG] [MAIN ] GDO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:55.835224] [INFO ] [MAIN ] GDO: Generated 1820 derivative records from 6076 primary records. [2025-09-29T02:15:55.853833] [DEBUG] [LOCAL ] GDO: Saving derivative data. [2025-09-29T02:15:56.114915] [DEBUG] [LOCAL ] GDO: Derivative data saved (1820 records). [2025-09-29T02:15:56.115128] [INFO ] [MAIN ] GDO: Successfully saved derivative data. [2025-09-29T02:15:56.117422] [INFO ] [MAIN ] Derivative Progress: 851/2211 symbols completed. GDO took 1.3s. Estimated remaining: 9m 34s. Rate: 142.2 symbols/min [2025-09-29T02:15:56.117835] [INFO ] [MAIN ] GE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:56.152698] [DEBUG] [MAIN ] GDV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:56.154859] [INFO ] [MAIN ] GDV: Generated 1820 derivative records from 19971 primary records. [2025-09-29T02:15:56.155242] [DEBUG] [LOCAL ] GDV: Saving derivative data. [2025-09-29T02:15:56.173789] [DEBUG] [LOCAL ] GDV: Derivative data saved (1820 records). [2025-09-29T02:15:56.174215] [INFO ] [MAIN ] GDV: Successfully saved derivative data. [2025-09-29T02:15:56.177429] [INFO ] [MAIN ] Derivative Progress: 852/2211 symbols completed. GDV took 0.9s. Estimated remaining: 9m 33s. Rate: 142.3 symbols/min [2025-09-29T02:15:56.178081] [INFO ] [MAIN ] GEF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:56.212631] [DEBUG] [MAIN ] GDOT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:56.214909] [INFO ] [MAIN ] GDOT: Generated 1820 derivative records from 39279 primary records. [2025-09-29T02:15:56.215085] [DEBUG] [LOCAL ] GDOT: Saving derivative data. [2025-09-29T02:15:56.240997] [DEBUG] [LOCAL ] GDOT: Derivative data saved (1820 records). [2025-09-29T02:15:56.257835] [INFO ] [MAIN ] GDOT: Successfully saved derivative data. [2025-09-29T02:15:56.261735] [INFO ] [MAIN ] Derivative Progress: 853/2211 symbols completed. GDOT took 1.2s. Estimated remaining: 9m 32s. Rate: 142.4 symbols/min [2025-09-29T02:15:56.277086] [DEBUG] [LOCAL ] GE: Loaded 54493 existing records from primary storage. [2025-09-29T02:15:56.277953] [DEBUG] [LOCAL ] GEF: Loaded 20965 existing records from primary storage. [2025-09-29T02:15:56.278106] [INFO ] [MAIN ] GE: Loaded 54493 primary data records. [2025-09-29T02:15:56.278340] [INFO ] [MAIN ] GEF: Loaded 20965 primary data records. [2025-09-29T02:15:56.987860] [DEBUG] [MAIN ] GEF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:56.988522] [DEBUG] [MAIN ] GE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:56.989399] [INFO ] [MAIN ] GE: Generated 1820 derivative records from 54493 primary records. [2025-09-29T02:15:56.989504] [DEBUG] [LOCAL ] GE: Saving derivative data. [2025-09-29T02:15:56.990204] [INFO ] [MAIN ] GEF: Generated 1820 derivative records from 20965 primary records. [2025-09-29T02:15:56.990312] [DEBUG] [LOCAL ] GEF: Saving derivative data. [2025-09-29T02:15:57.028387] [DEBUG] [LOCAL ] GEF: Derivative data saved (1820 records). [2025-09-29T02:15:57.030722] [INFO ] [MAIN ] GEF: Successfully saved derivative data. [2025-09-29T02:15:57.030543] [DEBUG] [LOCAL ] GE: Derivative data saved (1820 records). [2025-09-29T02:15:57.033818] [INFO ] [MAIN ] Derivative Progress: 854/2211 symbols completed. GEF took 0.9s. Estimated remaining: 9m 32s. Rate: 142.3 symbols/min [2025-09-29T02:15:57.034236] [INFO ] [MAIN ] GE: Successfully saved derivative data. [2025-09-29T02:15:57.038689] [INFO ] [MAIN ] Derivative Progress: 855/2211 symbols completed. GE took 0.9s. Estimated remaining: 9m 31s. Rate: 142.5 symbols/min [2025-09-29T02:15:57.039203] [INFO ] [MAIN ] GEL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:57.039339] [INFO ] [MAIN ] GENI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:57.039814] [INFO ] [MAIN ] GEO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:57.106082] [DEBUG] [LOCAL ] GEL: Loaded 34252 existing records from primary storage. [2025-09-29T02:15:57.106498] [INFO ] [MAIN ] GEL: Loaded 34252 primary data records. [2025-09-29T02:15:57.360438] [DEBUG] [LOCAL ] GENI: Loaded 53679 existing records from primary storage. [2025-09-29T02:15:57.502955] [INFO ] [MAIN ] GENI: Loaded 53679 primary data records. [2025-09-29T02:15:57.502843] [DEBUG] [LOCAL ] GEO: Loaded 52812 existing records from primary storage. [2025-09-29T02:15:57.513741] [INFO ] [MAIN ] GEO: Loaded 52812 primary data records. [2025-09-29T02:15:58.362005] [DEBUG] [MAIN ] GEL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:58.364001] [INFO ] [MAIN ] GEL: Generated 1820 derivative records from 34252 primary records. [2025-09-29T02:15:58.364327] [DEBUG] [LOCAL ] GEL: Saving derivative data. [2025-09-29T02:15:58.384203] [DEBUG] [LOCAL ] GEL: Derivative data saved (1820 records). [2025-09-29T02:15:58.384761] [INFO ] [MAIN ] GEL: Successfully saved derivative data. [2025-09-29T02:15:58.387750] [INFO ] [MAIN ] Derivative Progress: 856/2211 symbols completed. GEL took 1.3s. Estimated remaining: 9m 32s. Rate: 142.1 symbols/min [2025-09-29T02:15:58.388381] [INFO ] [MAIN ] GES: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:58.427705] [DEBUG] [MAIN ] GENI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:58.428936] [INFO ] [MAIN ] GENI: Generated 1820 derivative records from 53679 primary records. [2025-09-29T02:15:58.428062] [DEBUG] [MAIN ] GEO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:58.430443] [DEBUG] [LOCAL ] GENI: Saving derivative data. [2025-09-29T02:15:58.430324] [INFO ] [MAIN ] GEO: Generated 1820 derivative records from 52812 primary records. [2025-09-29T02:15:58.431675] [DEBUG] [LOCAL ] GEO: Saving derivative data. [2025-09-29T02:15:58.467289] [DEBUG] [LOCAL ] GENI: Derivative data saved (1820 records). [2025-09-29T02:15:58.468879] [DEBUG] [LOCAL ] GEO: Derivative data saved (1820 records). [2025-09-29T02:15:58.478025] [INFO ] [MAIN ] GENI: Successfully saved derivative data. [2025-09-29T02:15:58.481296] [INFO ] [MAIN ] Derivative Progress: 857/2211 symbols completed. GENI took 1.4s. Estimated remaining: 9m 31s. Rate: 142.2 symbols/min [2025-09-29T02:15:58.477884] [INFO ] [MAIN ] GEO: Successfully saved derivative data. [2025-09-29T02:15:58.485108] [INFO ] [MAIN ] GETY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:58.485400] [INFO ] [MAIN ] Derivative Progress: 858/2211 symbols completed. GEO took 1.4s. Estimated remaining: 9m 30s. Rate: 142.4 symbols/min [2025-09-29T02:15:58.486010] [INFO ] [MAIN ] GEV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:58.511923] [DEBUG] [LOCAL ] GES: Loaded 40424 existing records from primary storage. [2025-09-29T02:15:58.512335] [INFO ] [MAIN ] GES: Loaded 40424 primary data records. [2025-09-29T02:15:58.755688] [DEBUG] [LOCAL ] GETY: Loaded 36378 existing records from primary storage. [2025-09-29T02:15:58.894850] [INFO ] [MAIN ] GETY: Loaded 36378 primary data records. [2025-09-29T02:15:59.018753] [DEBUG] [LOCAL ] GEV: Loaded 53878 existing records from primary storage. [2025-09-29T02:15:59.038884] [INFO ] [MAIN ] GEV: Loaded 53878 primary data records. [2025-09-29T02:15:59.643523] [DEBUG] [MAIN ] GES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:59.646404] [INFO ] [MAIN ] GES: Generated 1820 derivative records from 40424 primary records. [2025-09-29T02:15:59.650883] [DEBUG] [LOCAL ] GES: Saving derivative data. [2025-09-29T02:15:59.672728] [DEBUG] [LOCAL ] GES: Derivative data saved (1820 records). [2025-09-29T02:15:59.673911] [INFO ] [MAIN ] GES: Successfully saved derivative data. [2025-09-29T02:15:59.678030] [INFO ] [MAIN ] Derivative Progress: 859/2211 symbols completed. GES took 1.3s. Estimated remaining: 9m 31s. Rate: 142.1 symbols/min [2025-09-29T02:15:59.678309] [INFO ] [MAIN ] GF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:15:59.689877] [DEBUG] [LOCAL ] GF: Loaded 3220 existing records from primary storage. [2025-09-29T02:15:59.704626] [INFO ] [MAIN ] GF: Loaded 3220 primary data records. [2025-09-29T02:15:59.705169] [DEBUG] [MAIN ] GETY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:59.719122] [INFO ] [MAIN ] GETY: Generated 1820 derivative records from 36378 primary records. [2025-09-29T02:15:59.755365] [DEBUG] [LOCAL ] GETY: Saving derivative data. [2025-09-29T02:15:59.915745] [DEBUG] [LOCAL ] GETY: Derivative data saved (1820 records). [2025-09-29T02:15:59.927767] [DEBUG] [MAIN ] GEV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:15:59.963755] [INFO ] [MAIN ] GEV: Generated 1820 derivative records from 53878 primary records. [2025-09-29T02:15:59.964155] [DEBUG] [LOCAL ] GEV: Saving derivative data. [2025-09-29T02:15:59.955038] [INFO ] [MAIN ] GETY: Successfully saved derivative data. [2025-09-29T02:15:59.967315] [INFO ] [MAIN ] Derivative Progress: 860/2211 symbols completed. GETY took 1.5s. Estimated remaining: 9m 30s. Rate: 142.1 symbols/min [2025-09-29T02:15:59.997718] [INFO ] [MAIN ] GFF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:00.230691] [DEBUG] [LOCAL ] GEV: Derivative data saved (1820 records). [2025-09-29T02:16:00.233567] [INFO ] [MAIN ] GEV: Successfully saved derivative data. [2025-09-29T02:16:00.236487] [INFO ] [MAIN ] Derivative Progress: 861/2211 symbols completed. GEV took 1.8s. Estimated remaining: 9m 30s. Rate: 142.2 symbols/min [2025-09-29T02:16:00.236989] [INFO ] [MAIN ] GFI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:00.277602] [DEBUG] [LOCAL ] GFF: Loaded 31088 existing records from primary storage. [2025-09-29T02:16:00.278389] [INFO ] [MAIN ] GFF: Loaded 31088 primary data records. [2025-09-29T02:16:00.298029] [DEBUG] [MAIN ] GF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:00.338258] [INFO ] [MAIN ] GF: Generated 1820 derivative records from 3220 primary records. [2025-09-29T02:16:00.421869] [DEBUG] [LOCAL ] GF: Saving derivative data. [2025-09-29T02:16:00.570732] [DEBUG] [LOCAL ] GFI: Loaded 53887 existing records from primary storage. [2025-09-29T02:16:00.607023] [INFO ] [MAIN ] GFI: Loaded 53887 primary data records. [2025-09-29T02:16:00.719197] [DEBUG] [LOCAL ] GF: Derivative data saved (1820 records). [2025-09-29T02:16:00.725029] [INFO ] [MAIN ] GF: Successfully saved derivative data. [2025-09-29T02:16:00.761119] [INFO ] [MAIN ] Derivative Progress: 862/2211 symbols completed. GF took 1.1s. Estimated remaining: 9m 29s. Rate: 142.2 symbols/min [2025-09-29T02:16:00.802257] [INFO ] [MAIN ] GFL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:01.168549] [DEBUG] [MAIN ] GFF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:01.184952] [INFO ] [MAIN ] GFF: Generated 1820 derivative records from 31088 primary records. [2025-09-29T02:16:01.187188] [DEBUG] [LOCAL ] GFF: Saving derivative data. [2025-09-29T02:16:01.189205] [DEBUG] [LOCAL ] GFL: Loaded 48755 existing records from primary storage. [2025-09-29T02:16:01.199473] [INFO ] [MAIN ] GFL: Loaded 48755 primary data records. [2025-09-29T02:16:01.209230] [DEBUG] [LOCAL ] GFF: Derivative data saved (1820 records). [2025-09-29T02:16:01.241201] [INFO ] [MAIN ] GFF: Successfully saved derivative data. [2025-09-29T02:16:01.292710] [INFO ] [MAIN ] Derivative Progress: 863/2211 symbols completed. GFF took 1.3s. Estimated remaining: 9m 29s. Rate: 142.1 symbols/min [2025-09-29T02:16:01.318365] [INFO ] [MAIN ] GFR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:01.450739] [DEBUG] [LOCAL ] GFR: Loaded 8572 existing records from primary storage. [2025-09-29T02:16:01.611833] [INFO ] [MAIN ] GFR: Loaded 8572 primary data records. [2025-09-29T02:16:01.625408] [DEBUG] [MAIN ] GFI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:01.634533] [INFO ] [MAIN ] GFI: Generated 1820 derivative records from 53887 primary records. [2025-09-29T02:16:01.689730] [DEBUG] [LOCAL ] GFI: Saving derivative data. [2025-09-29T02:16:02.009289] [DEBUG] [LOCAL ] GFI: Derivative data saved (1820 records). [2025-09-29T02:16:02.009589] [INFO ] [MAIN ] GFI: Successfully saved derivative data. [2025-09-29T02:16:02.015347] [INFO ] [MAIN ] Derivative Progress: 864/2211 symbols completed. GFI took 1.8s. Estimated remaining: 9m 29s. Rate: 142.0 symbols/min [2025-09-29T02:16:02.016124] [INFO ] [MAIN ] GGB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:02.039527] [DEBUG] [MAIN ] GFL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:02.040987] [INFO ] [MAIN ] GFL: Generated 1820 derivative records from 48755 primary records. [2025-09-29T02:16:02.041250] [DEBUG] [LOCAL ] GFL: Saving derivative data. [2025-09-29T02:16:02.064781] [DEBUG] [LOCAL ] GFL: Derivative data saved (1820 records). [2025-09-29T02:16:02.065157] [INFO ] [MAIN ] GFL: Successfully saved derivative data. [2025-09-29T02:16:02.068442] [INFO ] [MAIN ] Derivative Progress: 865/2211 symbols completed. GFL took 1.3s. Estimated remaining: 9m 28s. Rate: 142.1 symbols/min [2025-09-29T02:16:02.068733] [INFO ] [MAIN ] GGG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:02.089028] [DEBUG] [MAIN ] GFR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:02.090271] [INFO ] [MAIN ] GFR: Generated 1820 derivative records from 8572 primary records. [2025-09-29T02:16:02.107486] [DEBUG] [LOCAL ] GFR: Saving derivative data. [2025-09-29T02:16:02.128220] [DEBUG] [LOCAL ] GFR: Derivative data saved (1820 records). [2025-09-29T02:16:02.145423] [INFO ] [MAIN ] GFR: Successfully saved derivative data. [2025-09-29T02:16:02.148808] [INFO ] [MAIN ] Derivative Progress: 866/2211 symbols completed. GFR took 0.8s. Estimated remaining: 9m 27s. Rate: 142.3 symbols/min [2025-09-29T02:16:02.150504] [DEBUG] [LOCAL ] GGB: Loaded 51813 existing records from primary storage. [2025-09-29T02:16:02.150952] [INFO ] [MAIN ] GGT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:02.151034] [INFO ] [MAIN ] GGB: Loaded 51813 primary data records. [2025-09-29T02:16:02.287220] [DEBUG] [LOCAL ] GGG: Loaded 41580 existing records from primary storage. [2025-09-29T02:16:02.287569] [INFO ] [MAIN ] GGG: Loaded 41580 primary data records. [2025-09-29T02:16:02.293374] [DEBUG] [LOCAL ] GGT: Loaded 14309 existing records from primary storage. [2025-09-29T02:16:02.341447] [INFO ] [MAIN ] GGT: Loaded 14309 primary data records. [2025-09-29T02:16:03.445051] [DEBUG] [MAIN ] GGG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:03.446165] [INFO ] [MAIN ] GGG: Generated 1820 derivative records from 41580 primary records. [2025-09-29T02:16:03.446729] [DEBUG] [LOCAL ] GGG: Saving derivative data. [2025-09-29T02:16:03.477893] [DEBUG] [LOCAL ] GGG: Derivative data saved (1820 records). [2025-09-29T02:16:03.492548] [INFO ] [MAIN ] GGG: Successfully saved derivative data. [2025-09-29T02:16:03.506798] [DEBUG] [MAIN ] GGT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:03.509667] [INFO ] [MAIN ] Derivative Progress: 867/2211 symbols completed. GGG took 1.4s. Estimated remaining: 9m 28s. Rate: 141.9 symbols/min [2025-09-29T02:16:03.506429] [DEBUG] [MAIN ] GGB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:03.510856] [INFO ] [MAIN ] GGB: Generated 1820 derivative records from 51813 primary records. [2025-09-29T02:16:03.509880] [INFO ] [MAIN ] GGZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:03.511343] [DEBUG] [LOCAL ] GGB: Saving derivative data. [2025-09-29T02:16:03.512521] [INFO ] [MAIN ] GGT: Generated 1820 derivative records from 14309 primary records. [2025-09-29T02:16:03.514339] [DEBUG] [LOCAL ] GGT: Saving derivative data. [2025-09-29T02:16:03.545209] [DEBUG] [LOCAL ] GGZ: Loaded 2465 existing records from primary storage. [2025-09-29T02:16:03.552086] [INFO ] [MAIN ] GGZ: Loaded 2465 primary data records. [2025-09-29T02:16:03.541085] [DEBUG] [LOCAL ] GGB: Derivative data saved (1820 records). [2025-09-29T02:16:03.565316] [INFO ] [MAIN ] GGB: Successfully saved derivative data. [2025-09-29T02:16:03.571213] [DEBUG] [LOCAL ] GGT: Derivative data saved (1820 records). [2025-09-29T02:16:03.593284] [INFO ] [MAIN ] Derivative Progress: 868/2211 symbols completed. GGB took 1.6s. Estimated remaining: 9m 27s. Rate: 142.0 symbols/min [2025-09-29T02:16:03.593620] [INFO ] [MAIN ] GGT: Successfully saved derivative data. [2025-09-29T02:16:03.597085] [INFO ] [MAIN ] Derivative Progress: 869/2211 symbols completed. GGT took 1.4s. Estimated remaining: 9m 26s. Rate: 142.2 symbols/min [2025-09-29T02:16:03.915105] [DEBUG] [MAIN ] GGZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:03.915920] [INFO ] [MAIN ] GGZ: Generated 1820 derivative records from 2465 primary records. [2025-09-29T02:16:03.916055] [DEBUG] [LOCAL ] GGZ: Saving derivative data. [2025-09-29T02:16:03.930104] [DEBUG] [LOCAL ] GGZ: Derivative data saved (1820 records). [2025-09-29T02:16:03.930260] [INFO ] [MAIN ] GGZ: Successfully saved derivative data. [2025-09-29T02:16:03.932618] [INFO ] [MAIN ] Derivative Progress: 870/2211 symbols completed. GGZ took 0.4s. Estimated remaining: 9m 26s. Rate: 142.2 symbols/min [2025-09-29T02:16:03.933212] [INFO ] [MAIN ] GHC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:03.933291] [INFO ] [MAIN ] GHG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:03.933341] [INFO ] [MAIN ] GHI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:03.940944] [DEBUG] [LOCAL ] GHC: Loaded 2664 existing records from primary storage. [2025-09-29T02:16:03.941565] [INFO ] [MAIN ] GHC: Loaded 2664 primary data records. [2025-09-29T02:16:03.943795] [DEBUG] [LOCAL ] GHG: Loaded 3226 existing records from primary storage. [2025-09-29T02:16:03.980625] [INFO ] [MAIN ] GHG: Loaded 3226 primary data records. [2025-09-29T02:16:04.071638] [DEBUG] [LOCAL ] GHI: Loaded 6963 existing records from primary storage. [2025-09-29T02:16:04.102796] [INFO ] [MAIN ] GHI: Loaded 6963 primary data records. [2025-09-29T02:16:05.006169] [DEBUG] [MAIN ] GHC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:05.007504] [INFO ] [MAIN ] GHC: Generated 1820 derivative records from 2664 primary records. [2025-09-29T02:16:05.010745] [DEBUG] [LOCAL ] GHC: Saving derivative data. [2025-09-29T02:16:05.041501] [DEBUG] [MAIN ] GHG: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:16:05.042199] [DEBUG] [LOCAL ] GHC: Derivative data saved (1820 records). [2025-09-29T02:16:05.044042] [INFO ] [MAIN ] GHC: Successfully saved derivative data. [2025-09-29T02:16:05.044847] [INFO ] [MAIN ] GHG: Generated 1819 derivative records from 3226 primary records. [2025-09-29T02:16:05.047292] [DEBUG] [LOCAL ] GHG: Saving derivative data. [2025-09-29T02:16:05.047201] [INFO ] [MAIN ] Derivative Progress: 871/2211 symbols completed. GHC took 1.1s. Estimated remaining: 9m 26s. Rate: 142.0 symbols/min [2025-09-29T02:16:05.047570] [INFO ] [MAIN ] GHLD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:05.073985] [DEBUG] [MAIN ] GHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:05.077828] [INFO ] [MAIN ] GHI: Generated 1820 derivative records from 6963 primary records. [2025-09-29T02:16:05.078250] [DEBUG] [LOCAL ] GHI: Saving derivative data. [2025-09-29T02:16:05.083109] [DEBUG] [LOCAL ] GHLD: Loaded 4168 existing records from primary storage. [2025-09-29T02:16:05.083257] [INFO ] [MAIN ] GHLD: Loaded 4168 primary data records. [2025-09-29T02:16:05.089447] [DEBUG] [LOCAL ] GHG: Derivative data saved (1819 records). [2025-09-29T02:16:05.114506] [INFO ] [MAIN ] GHG: Successfully saved derivative data. [2025-09-29T02:16:05.151264] [INFO ] [MAIN ] Derivative Progress: 872/2211 symbols completed. GHG took 1.2s. Estimated remaining: 9m 25s. Rate: 142.1 symbols/min [2025-09-29T02:16:05.162485] [INFO ] [MAIN ] GHM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:05.200989] [DEBUG] [LOCAL ] GHI: Derivative data saved (1820 records). [2025-09-29T02:16:05.223109] [INFO ] [MAIN ] GHI: Successfully saved derivative data. [2025-09-29T02:16:05.225971] [INFO ] [MAIN ] Derivative Progress: 873/2211 symbols completed. GHI took 1.3s. Estimated remaining: 9m 24s. Rate: 142.2 symbols/min [2025-09-29T02:16:05.243534] [INFO ] [MAIN ] GHY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:05.480001] [DEBUG] [LOCAL ] GHM: Loaded 14350 existing records from primary storage. [2025-09-29T02:16:05.492292] [INFO ] [MAIN ] GHM: Loaded 14350 primary data records. [2025-09-29T02:16:05.624171] [DEBUG] [LOCAL ] GHY: Loaded 21190 existing records from primary storage. [2025-09-29T02:16:05.638157] [INFO ] [MAIN ] GHY: Loaded 21190 primary data records. [2025-09-29T02:16:06.236934] [DEBUG] [MAIN ] GHLD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:06.238679] [INFO ] [MAIN ] GHLD: Generated 1820 derivative records from 4168 primary records. [2025-09-29T02:16:06.238795] [DEBUG] [LOCAL ] GHLD: Saving derivative data. [2025-09-29T02:16:06.258672] [DEBUG] [LOCAL ] GHLD: Derivative data saved (1820 records). [2025-09-29T02:16:06.259228] [INFO ] [MAIN ] GHLD: Successfully saved derivative data. [2025-09-29T02:16:06.261743] [INFO ] [MAIN ] Derivative Progress: 874/2211 symbols completed. GHLD took 1.2s. Estimated remaining: 9m 25s. Rate: 142.0 symbols/min [2025-09-29T02:16:06.262195] [INFO ] [MAIN ] GIB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:06.282343] [DEBUG] [MAIN ] GHM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:06.283911] [INFO ] [MAIN ] GHM: Generated 1820 derivative records from 14350 primary records. [2025-09-29T02:16:06.284245] [DEBUG] [LOCAL ] GHM: Saving derivative data. [2025-09-29T02:16:06.320629] [DEBUG] [LOCAL ] GHM: Derivative data saved (1820 records). [2025-09-29T02:16:06.330267] [INFO ] [MAIN ] GHM: Successfully saved derivative data. [2025-09-29T02:16:06.333747] [INFO ] [MAIN ] Derivative Progress: 875/2211 symbols completed. GHM took 1.2s. Estimated remaining: 9m 24s. Rate: 142.1 symbols/min [2025-09-29T02:16:06.330159] [DEBUG] [MAIN ] GHY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:06.334206] [INFO ] [MAIN ] GIC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:06.335522] [INFO ] [MAIN ] GHY: Generated 1820 derivative records from 21190 primary records. [2025-09-29T02:16:06.335933] [DEBUG] [LOCAL ] GHY: Saving derivative data. [2025-09-29T02:16:06.364251] [DEBUG] [LOCAL ] GIB: Loaded 32653 existing records from primary storage. [2025-09-29T02:16:06.369540] [INFO ] [MAIN ] GIB: Loaded 32653 primary data records. [2025-09-29T02:16:06.370308] [DEBUG] [LOCAL ] GHY: Derivative data saved (1820 records). [2025-09-29T02:16:06.383968] [INFO ] [MAIN ] GHY: Successfully saved derivative data. [2025-09-29T02:16:06.416553] [INFO ] [MAIN ] Derivative Progress: 876/2211 symbols completed. GHY took 1.2s. Estimated remaining: 9m 23s. Rate: 142.3 symbols/min [2025-09-29T02:16:06.424200] [INFO ] [MAIN ] GIL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:06.493254] [DEBUG] [LOCAL ] GIC: Loaded 13796 existing records from primary storage. [2025-09-29T02:16:06.497854] [INFO ] [MAIN ] GIC: Loaded 13796 primary data records. [2025-09-29T02:16:07.143125] [DEBUG] [LOCAL ] GIL: Loaded 43906 existing records from primary storage. [2025-09-29T02:16:07.144427] [INFO ] [MAIN ] GIL: Loaded 43906 primary data records. [2025-09-29T02:16:07.485890] [DEBUG] [MAIN ] GIB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:07.497447] [INFO ] [MAIN ] GIB: Generated 1820 derivative records from 32653 primary records. [2025-09-29T02:16:07.498166] [DEBUG] [LOCAL ] GIB: Saving derivative data. [2025-09-29T02:16:07.520879] [DEBUG] [LOCAL ] GIB: Derivative data saved (1820 records). [2025-09-29T02:16:07.521962] [INFO ] [MAIN ] GIB: Successfully saved derivative data. [2025-09-29T02:16:07.533550] [INFO ] [MAIN ] Derivative Progress: 877/2211 symbols completed. GIB took 1.3s. Estimated remaining: 9m 24s. Rate: 142.0 symbols/min [2025-09-29T02:16:07.540341] [INFO ] [MAIN ] GIS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:07.540044] [DEBUG] [MAIN ] GIC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:07.541837] [INFO ] [MAIN ] GIC: Generated 1820 derivative records from 13796 primary records. [2025-09-29T02:16:07.543263] [DEBUG] [LOCAL ] GIC: Saving derivative data. [2025-09-29T02:16:07.560234] [DEBUG] [LOCAL ] GIC: Derivative data saved (1820 records). [2025-09-29T02:16:07.560757] [INFO ] [MAIN ] GIC: Successfully saved derivative data. [2025-09-29T02:16:07.564071] [INFO ] [MAIN ] Derivative Progress: 878/2211 symbols completed. GIC took 1.2s. Estimated remaining: 9m 23s. Rate: 142.1 symbols/min [2025-09-29T02:16:07.564393] [INFO ] [MAIN ] GKOS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:07.585055] [DEBUG] [MAIN ] GIL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:07.586731] [INFO ] [MAIN ] GIL: Generated 1820 derivative records from 43906 primary records. [2025-09-29T02:16:07.586933] [DEBUG] [LOCAL ] GIL: Saving derivative data. [2025-09-29T02:16:07.608177] [DEBUG] [LOCAL ] GIL: Derivative data saved (1820 records). [2025-09-29T02:16:07.608364] [INFO ] [MAIN ] GIL: Successfully saved derivative data. [2025-09-29T02:16:07.611693] [INFO ] [MAIN ] Derivative Progress: 879/2211 symbols completed. GIL took 1.2s. Estimated remaining: 9m 22s. Rate: 142.3 symbols/min [2025-09-29T02:16:07.611995] [INFO ] [MAIN ] GL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:07.662758] [DEBUG] [LOCAL ] GKOS: Loaded 43585 existing records from primary storage. [2025-09-29T02:16:07.663350] [INFO ] [MAIN ] GKOS: Loaded 43585 primary data records. [2025-09-29T02:16:07.814806] [DEBUG] [LOCAL ] GIS: Loaded 54455 existing records from primary storage. [2025-09-29T02:16:07.816762] [INFO ] [MAIN ] GIS: Loaded 54455 primary data records. [2025-09-29T02:16:07.933282] [DEBUG] [LOCAL ] GL: Loaded 38382 existing records from primary storage. [2025-09-29T02:16:08.034865] [INFO ] [MAIN ] GL: Loaded 38382 primary data records. [2025-09-29T02:16:08.866567] [DEBUG] [MAIN ] GKOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:08.873266] [DEBUG] [MAIN ] GIS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:08.874282] [INFO ] [MAIN ] GKOS: Generated 1820 derivative records from 43585 primary records. [2025-09-29T02:16:08.875564] [INFO ] [MAIN ] GIS: Generated 1820 derivative records from 54455 primary records. [2025-09-29T02:16:08.875741] [DEBUG] [LOCAL ] GIS: Saving derivative data. [2025-09-29T02:16:08.875803] [DEBUG] [LOCAL ] GKOS: Saving derivative data. [2025-09-29T02:16:08.913548] [DEBUG] [LOCAL ] GKOS: Derivative data saved (1820 records). [2025-09-29T02:16:08.912383] [DEBUG] [LOCAL ] GIS: Derivative data saved (1820 records). [2025-09-29T02:16:08.913890] [INFO ] [MAIN ] GKOS: Successfully saved derivative data. [2025-09-29T02:16:08.916774] [INFO ] [MAIN ] Derivative Progress: 880/2211 symbols completed. GKOS took 1.4s. Estimated remaining: 9m 23s. Rate: 141.9 symbols/min [2025-09-29T02:16:08.914013] [INFO ] [MAIN ] GIS: Successfully saved derivative data. [2025-09-29T02:16:08.921003] [INFO ] [MAIN ] GLOB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:08.921094] [INFO ] [MAIN ] Derivative Progress: 881/2211 symbols completed. GIS took 1.4s. Estimated remaining: 9m 22s. Rate: 142.1 symbols/min [2025-09-29T02:16:08.922829] [INFO ] [MAIN ] GLP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:08.940973] [DEBUG] [MAIN ] GL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:08.942012] [INFO ] [MAIN ] GL: Generated 1820 derivative records from 38382 primary records. [2025-09-29T02:16:08.942164] [DEBUG] [LOCAL ] GL: Saving derivative data. [2025-09-29T02:16:08.970688] [DEBUG] [LOCAL ] GLP: Loaded 9585 existing records from primary storage. [2025-09-29T02:16:08.971299] [INFO ] [MAIN ] GLP: Loaded 9585 primary data records. [2025-09-29T02:16:08.971792] [DEBUG] [LOCAL ] GL: Derivative data saved (1820 records). [2025-09-29T02:16:08.985284] [INFO ] [MAIN ] GL: Successfully saved derivative data. [2025-09-29T02:16:09.017737] [INFO ] [MAIN ] Derivative Progress: 882/2211 symbols completed. GL took 1.4s. Estimated remaining: 9m 21s. Rate: 142.2 symbols/min [2025-09-29T02:16:09.031938] [INFO ] [MAIN ] GLW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:09.190857] [DEBUG] [LOCAL ] GLOB: Loaded 48111 existing records from primary storage. [2025-09-29T02:16:09.240724] [INFO ] [MAIN ] GLOB: Loaded 48111 primary data records. [2025-09-29T02:16:09.739687] [DEBUG] [LOCAL ] GLW: Loaded 54415 existing records from primary storage. [2025-09-29T02:16:09.750226] [INFO ] [MAIN ] GLW: Loaded 54415 primary data records. [2025-09-29T02:16:09.949572] [DEBUG] [MAIN ] GLP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:09.983507] [INFO ] [MAIN ] GLP: Generated 1820 derivative records from 9585 primary records. [2025-09-29T02:16:10.153241] [DEBUG] [LOCAL ] GLP: Saving derivative data. [2025-09-29T02:16:10.186976] [DEBUG] [LOCAL ] GLP: Derivative data saved (1820 records). [2025-09-29T02:16:10.187784] [INFO ] [MAIN ] GLP: Successfully saved derivative data. [2025-09-29T02:16:10.190209] [INFO ] [MAIN ] Derivative Progress: 883/2211 symbols completed. GLP took 1.3s. Estimated remaining: 9m 21s. Rate: 141.9 symbols/min [2025-09-29T02:16:10.205006] [DEBUG] [MAIN ] GLOB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:10.206235] [INFO ] [MAIN ] GLOB: Generated 1820 derivative records from 48111 primary records. [2025-09-29T02:16:10.206340] [DEBUG] [LOCAL ] GLOB: Saving derivative data. [2025-09-29T02:16:10.224845] [DEBUG] [LOCAL ] GLOB: Derivative data saved (1820 records). [2025-09-29T02:16:10.225003] [INFO ] [MAIN ] GLOB: Successfully saved derivative data. [2025-09-29T02:16:10.228109] [INFO ] [MAIN ] Derivative Progress: 884/2211 symbols completed. GLOB took 1.3s. Estimated remaining: 9m 20s. Rate: 142.1 symbols/min [2025-09-29T02:16:10.246277] [DEBUG] [MAIN ] GLW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:10.247094] [INFO ] [MAIN ] GLW: Generated 1820 derivative records from 54415 primary records. [2025-09-29T02:16:10.247183] [DEBUG] [LOCAL ] GLW: Saving derivative data. [2025-09-29T02:16:10.263451] [DEBUG] [LOCAL ] GLW: Derivative data saved (1820 records). [2025-09-29T02:16:10.263547] [INFO ] [MAIN ] GLW: Successfully saved derivative data. [2025-09-29T02:16:10.267708] [INFO ] [MAIN ] Derivative Progress: 885/2211 symbols completed. GLW took 1.2s. Estimated remaining: 9m 19s. Rate: 142.2 symbols/min [2025-09-29T02:16:10.268342] [INFO ] [MAIN ] GMED: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:10.268242] [INFO ] [MAIN ] GM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:10.268469] [INFO ] [MAIN ] GME: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:10.391207] [DEBUG] [LOCAL ] GMED: Loaded 49096 existing records from primary storage. [2025-09-29T02:16:10.392490] [DEBUG] [LOCAL ] GME: Loaded 54540 existing records from primary storage. [2025-09-29T02:16:10.392839] [INFO ] [MAIN ] GME: Loaded 54540 primary data records. [2025-09-29T02:16:10.392627] [INFO ] [MAIN ] GMED: Loaded 49096 primary data records. [2025-09-29T02:16:10.394149] [DEBUG] [LOCAL ] GM: Loaded 54508 existing records from primary storage. [2025-09-29T02:16:10.399613] [INFO ] [MAIN ] GM: Loaded 54508 primary data records. [2025-09-29T02:16:11.466559] [DEBUG] [MAIN ] GME: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:11.493823] [INFO ] [MAIN ] GME: Generated 1820 derivative records from 54540 primary records. [2025-09-29T02:16:11.492923] [DEBUG] [MAIN ] GMED: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:11.494068] [DEBUG] [LOCAL ] GME: Saving derivative data. [2025-09-29T02:16:11.494674] [DEBUG] [MAIN ] GM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:11.495391] [INFO ] [MAIN ] GM: Generated 1820 derivative records from 54508 primary records. [2025-09-29T02:16:11.497119] [DEBUG] [LOCAL ] GM: Saving derivative data. [2025-09-29T02:16:11.497045] [INFO ] [MAIN ] GMED: Generated 1820 derivative records from 49096 primary records. [2025-09-29T02:16:11.497276] [DEBUG] [LOCAL ] GMED: Saving derivative data. [2025-09-29T02:16:11.554742] [DEBUG] [LOCAL ] GMED: Derivative data saved (1820 records). [2025-09-29T02:16:11.554913] [INFO ] [MAIN ] GMED: Successfully saved derivative data. [2025-09-29T02:16:11.559338] [INFO ] [MAIN ] Derivative Progress: 886/2211 symbols completed. GMED took 1.3s. Estimated remaining: 9m 20s. Rate: 141.9 symbols/min [2025-09-29T02:16:11.551404] [DEBUG] [LOCAL ] GME: Derivative data saved (1820 records). [2025-09-29T02:16:11.559611] [INFO ] [MAIN ] GMRE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:11.560283] [INFO ] [MAIN ] GME: Successfully saved derivative data. [2025-09-29T02:16:11.564270] [INFO ] [MAIN ] Derivative Progress: 887/2211 symbols completed. GME took 1.3s. Estimated remaining: 9m 19s. Rate: 142.1 symbols/min [2025-09-29T02:16:11.564582] [INFO ] [MAIN ] GNE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:11.560958] [DEBUG] [LOCAL ] GM: Derivative data saved (1820 records). [2025-09-29T02:16:11.565177] [INFO ] [MAIN ] GM: Successfully saved derivative data. [2025-09-29T02:16:11.568971] [INFO ] [MAIN ] Derivative Progress: 888/2211 symbols completed. GM took 1.3s. Estimated remaining: 9m 18s. Rate: 142.2 symbols/min [2025-09-29T02:16:11.569326] [INFO ] [MAIN ] GNK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:11.594985] [DEBUG] [LOCAL ] GNE: Loaded 17940 existing records from primary storage. [2025-09-29T02:16:11.595181] [INFO ] [MAIN ] GNE: Loaded 17940 primary data records. [2025-09-29T02:16:11.763154] [DEBUG] [LOCAL ] GMRE: Loaded 38133 existing records from primary storage. [2025-09-29T02:16:11.779208] [INFO ] [MAIN ] GMRE: Loaded 38133 primary data records. [2025-09-29T02:16:11.786043] [DEBUG] [LOCAL ] GNK: Loaded 41039 existing records from primary storage. [2025-09-29T02:16:11.870973] [INFO ] [MAIN ] GNK: Loaded 41039 primary data records. [2025-09-29T02:16:12.769051] [DEBUG] [MAIN ] GNE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:12.771139] [INFO ] [MAIN ] GNE: Generated 1820 derivative records from 17940 primary records. [2025-09-29T02:16:12.771670] [DEBUG] [LOCAL ] GNE: Saving derivative data. [2025-09-29T02:16:12.791224] [DEBUG] [LOCAL ] GNE: Derivative data saved (1820 records). [2025-09-29T02:16:12.792421] [INFO ] [MAIN ] GNE: Successfully saved derivative data. [2025-09-29T02:16:12.795058] [INFO ] [MAIN ] Derivative Progress: 889/2211 symbols completed. GNE took 1.2s. Estimated remaining: 9m 19s. Rate: 141.9 symbols/min [2025-09-29T02:16:12.797049] [INFO ] [MAIN ] GNL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:12.814540] [DEBUG] [MAIN ] GMRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:12.815589] [INFO ] [MAIN ] GMRE: Generated 1820 derivative records from 38133 primary records. [2025-09-29T02:16:12.816214] [DEBUG] [LOCAL ] GMRE: Saving derivative data. [2025-09-29T02:16:12.852707] [DEBUG] [LOCAL ] GMRE: Derivative data saved (1820 records). [2025-09-29T02:16:12.852977] [DEBUG] [MAIN ] GNK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:12.853379] [INFO ] [MAIN ] GMRE: Successfully saved derivative data. [2025-09-29T02:16:12.854159] [INFO ] [MAIN ] GNK: Generated 1820 derivative records from 41039 primary records. [2025-09-29T02:16:12.858165] [DEBUG] [LOCAL ] GNK: Saving derivative data. [2025-09-29T02:16:12.857929] [INFO ] [MAIN ] Derivative Progress: 890/2211 symbols completed. GMRE took 1.3s. Estimated remaining: 9m 18s. Rate: 142.1 symbols/min [2025-09-29T02:16:12.859633] [INFO ] [MAIN ] GNRC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:12.878390] [DEBUG] [LOCAL ] GNK: Derivative data saved (1820 records). [2025-09-29T02:16:12.878768] [INFO ] [MAIN ] GNK: Successfully saved derivative data. [2025-09-29T02:16:12.882570] [INFO ] [MAIN ] Derivative Progress: 891/2211 symbols completed. GNK took 1.3s. Estimated remaining: 9m 17s. Rate: 142.2 symbols/min [2025-09-29T02:16:12.882912] [INFO ] [MAIN ] GNT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:12.911123] [DEBUG] [LOCAL ] GNT: Loaded 8177 existing records from primary storage. [2025-09-29T02:16:12.911369] [INFO ] [MAIN ] GNT: Loaded 8177 primary data records. [2025-09-29T02:16:13.099802] [DEBUG] [LOCAL ] GNL: Loaded 47785 existing records from primary storage. [2025-09-29T02:16:13.101440] [DEBUG] [LOCAL ] GNRC: Loaded 45886 existing records from primary storage. [2025-09-29T02:16:13.112047] [INFO ] [MAIN ] GNL: Loaded 47785 primary data records. [2025-09-29T02:16:13.117385] [INFO ] [MAIN ] GNRC: Loaded 45886 primary data records. [2025-09-29T02:16:14.027506] [DEBUG] [MAIN ] GNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:14.030246] [INFO ] [MAIN ] GNT: Generated 1820 derivative records from 8177 primary records. [2025-09-29T02:16:14.030786] [DEBUG] [LOCAL ] GNT: Saving derivative data. [2025-09-29T02:16:14.051047] [DEBUG] [LOCAL ] GNT: Derivative data saved (1820 records). [2025-09-29T02:16:14.051940] [INFO ] [MAIN ] GNT: Successfully saved derivative data. [2025-09-29T02:16:14.054760] [INFO ] [MAIN ] Derivative Progress: 892/2211 symbols completed. GNT took 1.2s. Estimated remaining: 9m 18s. Rate: 141.9 symbols/min [2025-09-29T02:16:14.055339] [INFO ] [MAIN ] GNTY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:14.080507] [DEBUG] [MAIN ] GNRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:14.098909] [DEBUG] [LOCAL ] GNTY: Loaded 7353 existing records from primary storage. [2025-09-29T02:16:14.100259] [INFO ] [MAIN ] GNRC: Generated 1820 derivative records from 45886 primary records. [2025-09-29T02:16:14.101127] [INFO ] [MAIN ] GNTY: Loaded 7353 primary data records. [2025-09-29T02:16:14.101037] [DEBUG] [MAIN ] GNL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:14.101465] [DEBUG] [LOCAL ] GNRC: Saving derivative data. [2025-09-29T02:16:14.107938] [INFO ] [MAIN ] GNL: Generated 1820 derivative records from 47785 primary records. [2025-09-29T02:16:14.151074] [DEBUG] [LOCAL ] GNL: Saving derivative data. [2025-09-29T02:16:14.220351] [DEBUG] [LOCAL ] GNRC: Derivative data saved (1820 records). [2025-09-29T02:16:14.246439] [INFO ] [MAIN ] GNRC: Successfully saved derivative data. [2025-09-29T02:16:14.255184] [INFO ] [MAIN ] Derivative Progress: 893/2211 symbols completed. GNRC took 1.4s. Estimated remaining: 9m 17s. Rate: 142.0 symbols/min [2025-09-29T02:16:14.256438] [INFO ] [MAIN ] GNW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:14.278544] [DEBUG] [LOCAL ] GNL: Derivative data saved (1820 records). [2025-09-29T02:16:14.319232] [INFO ] [MAIN ] GNL: Successfully saved derivative data. [2025-09-29T02:16:14.342744] [INFO ] [MAIN ] Derivative Progress: 894/2211 symbols completed. GNL took 1.5s. Estimated remaining: 9m 16s. Rate: 142.1 symbols/min [2025-09-29T02:16:14.500085] [INFO ] [MAIN ] GOF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:14.584606] [DEBUG] [MAIN ] GNTY: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:16:14.597583] [INFO ] [MAIN ] GNTY: Generated 1819 derivative records from 7353 primary records. [2025-09-29T02:16:14.597983] [DEBUG] [LOCAL ] GNTY: Saving derivative data. [2025-09-29T02:16:14.600908] [DEBUG] [LOCAL ] GNW: Loaded 52086 existing records from primary storage. [2025-09-29T02:16:14.608551] [INFO ] [MAIN ] GNW: Loaded 52086 primary data records. [2025-09-29T02:16:14.674328] [DEBUG] [LOCAL ] GOF: Loaded 43374 existing records from primary storage. [2025-09-29T02:16:14.660336] [DEBUG] [LOCAL ] GNTY: Derivative data saved (1819 records). [2025-09-29T02:16:14.711252] [INFO ] [MAIN ] GOF: Loaded 43374 primary data records. [2025-09-29T02:16:14.711426] [INFO ] [MAIN ] GNTY: Successfully saved derivative data. [2025-09-29T02:16:14.741934] [INFO ] [MAIN ] Derivative Progress: 895/2211 symbols completed. GNTY took 0.7s. Estimated remaining: 9m 16s. Rate: 142.1 symbols/min [2025-09-29T02:16:14.808837] [INFO ] [MAIN ] GOLF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:15.354489] [DEBUG] [LOCAL ] GOLF: Loaded 32049 existing records from primary storage. [2025-09-29T02:16:15.356134] [INFO ] [MAIN ] GOLF: Loaded 32049 primary data records. [2025-09-29T02:16:15.532345] [DEBUG] [MAIN ] GNW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:15.568212] [INFO ] [MAIN ] GNW: Generated 1820 derivative records from 52086 primary records. [2025-09-29T02:16:15.593785] [DEBUG] [LOCAL ] GNW: Saving derivative data. [2025-09-29T02:16:15.758290] [DEBUG] [MAIN ] GOF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:15.761327] [INFO ] [MAIN ] GOF: Generated 1820 derivative records from 43374 primary records. [2025-09-29T02:16:15.760395] [DEBUG] [LOCAL ] GNW: Derivative data saved (1820 records). [2025-09-29T02:16:15.761718] [DEBUG] [LOCAL ] GOF: Saving derivative data. [2025-09-29T02:16:15.762555] [INFO ] [MAIN ] GNW: Successfully saved derivative data. [2025-09-29T02:16:15.767126] [INFO ] [MAIN ] Derivative Progress: 896/2211 symbols completed. GNW took 1.5s. Estimated remaining: 9m 16s. Rate: 141.9 symbols/min [2025-09-29T02:16:15.775490] [INFO ] [MAIN ] GOOS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:15.787815] [DEBUG] [LOCAL ] GOF: Derivative data saved (1820 records). [2025-09-29T02:16:15.787975] [INFO ] [MAIN ] GOF: Successfully saved derivative data. [2025-09-29T02:16:15.791193] [INFO ] [MAIN ] Derivative Progress: 897/2211 symbols completed. GOF took 1.3s. Estimated remaining: 9m 15s. Rate: 142.1 symbols/min [2025-09-29T02:16:15.791767] [INFO ] [MAIN ] GOTU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:15.813312] [DEBUG] [MAIN ] GOLF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:15.814244] [INFO ] [MAIN ] GOLF: Generated 1820 derivative records from 32049 primary records. [2025-09-29T02:16:15.814380] [DEBUG] [LOCAL ] GOLF: Saving derivative data. [2025-09-29T02:16:15.842447] [DEBUG] [LOCAL ] GOLF: Derivative data saved (1820 records). [2025-09-29T02:16:15.850955] [INFO ] [MAIN ] GOLF: Successfully saved derivative data. [2025-09-29T02:16:15.854145] [INFO ] [MAIN ] Derivative Progress: 898/2211 symbols completed. GOLF took 1.0s. Estimated remaining: 9m 14s. Rate: 142.2 symbols/min [2025-09-29T02:16:15.887187] [DEBUG] [LOCAL ] GOTU: Loaded 39533 existing records from primary storage. [2025-09-29T02:16:15.888456] [DEBUG] [LOCAL ] GOOS: Loaded 46008 existing records from primary storage. [2025-09-29T02:16:15.888712] [INFO ] [MAIN ] GOTU: Loaded 39533 primary data records. [2025-09-29T02:16:15.888775] [INFO ] [MAIN ] GOOS: Loaded 46008 primary data records. [2025-09-29T02:16:16.662906] [DEBUG] [MAIN ] GOOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:16.664151] [INFO ] [MAIN ] GOOS: Generated 1820 derivative records from 46008 primary records. [2025-09-29T02:16:16.664373] [DEBUG] [LOCAL ] GOOS: Saving derivative data. [2025-09-29T02:16:16.696144] [DEBUG] [MAIN ] GOTU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:16.698284] [INFO ] [MAIN ] GOTU: Generated 1820 derivative records from 39533 primary records. [2025-09-29T02:16:16.700060] [DEBUG] [LOCAL ] GOTU: Saving derivative data. [2025-09-29T02:16:16.701438] [DEBUG] [LOCAL ] GOOS: Derivative data saved (1820 records). [2025-09-29T02:16:16.701804] [INFO ] [MAIN ] GOOS: Successfully saved derivative data. [2025-09-29T02:16:16.705304] [INFO ] [MAIN ] Derivative Progress: 899/2211 symbols completed. GOOS took 0.9s. Estimated remaining: 9m 14s. Rate: 142.0 symbols/min [2025-09-29T02:16:16.721374] [DEBUG] [LOCAL ] GOTU: Derivative data saved (1820 records). [2025-09-29T02:16:16.721533] [INFO ] [MAIN ] GOTU: Successfully saved derivative data. [2025-09-29T02:16:16.724999] [INFO ] [MAIN ] Derivative Progress: 900/2211 symbols completed. GOTU took 0.9s. Estimated remaining: 9m 13s. Rate: 142.2 symbols/min [2025-09-29T02:16:16.725967] [INFO ] [MAIN ] GPC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:16.726144] [INFO ] [MAIN ] GPJA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:16.726207] [INFO ] [MAIN ] GPI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:16.735334] [DEBUG] [LOCAL ] GPJA: Loaded 4140 existing records from primary storage. [2025-09-29T02:16:16.735705] [INFO ] [MAIN ] GPJA: Loaded 4140 primary data records. [2025-09-29T02:16:16.876105] [DEBUG] [LOCAL ] GPI: Loaded 15126 existing records from primary storage. [2025-09-29T02:16:16.897840] [INFO ] [MAIN ] GPI: Loaded 15126 primary data records. [2025-09-29T02:16:17.357713] [DEBUG] [LOCAL ] GPC: Loaded 47289 existing records from primary storage. [2025-09-29T02:16:17.367811] [INFO ] [MAIN ] GPC: Loaded 47289 primary data records. [2025-09-29T02:16:17.916707] [DEBUG] [MAIN ] GPJA: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-09-29T02:16:17.923408] [INFO ] [MAIN ] GPJA: Generated 1818 derivative records from 4140 primary records. [2025-09-29T02:16:17.923862] [DEBUG] [LOCAL ] GPJA: Saving derivative data. [2025-09-29T02:16:17.948350] [DEBUG] [LOCAL ] GPJA: Derivative data saved (1818 records). [2025-09-29T02:16:17.961821] [INFO ] [MAIN ] GPJA: Successfully saved derivative data. [2025-09-29T02:16:17.966504] [DEBUG] [MAIN ] GPI: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:16:17.965726] [INFO ] [MAIN ] Derivative Progress: 901/2211 symbols completed. GPJA took 1.2s. Estimated remaining: 9m 14s. Rate: 141.9 symbols/min [2025-09-29T02:16:17.968194] [INFO ] [MAIN ] GPI: Generated 1819 derivative records from 15126 primary records. [2025-09-29T02:16:17.968507] [DEBUG] [LOCAL ] GPI: Saving derivative data. [2025-09-29T02:16:17.968920] [INFO ] [MAIN ] GPK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:17.989232] [DEBUG] [LOCAL ] GPI: Derivative data saved (1819 records). [2025-09-29T02:16:17.989718] [INFO ] [MAIN ] GPI: Successfully saved derivative data. [2025-09-29T02:16:17.992597] [INFO ] [MAIN ] Derivative Progress: 902/2211 symbols completed. GPI took 1.3s. Estimated remaining: 9m 13s. Rate: 142.0 symbols/min [2025-09-29T02:16:17.993215] [INFO ] [MAIN ] GPMT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:18.012427] [DEBUG] [MAIN ] GPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:18.013473] [INFO ] [MAIN ] GPC: Generated 1820 derivative records from 47289 primary records. [2025-09-29T02:16:18.013685] [DEBUG] [LOCAL ] GPC: Saving derivative data. [2025-09-29T02:16:18.032764] [DEBUG] [LOCAL ] GPC: Derivative data saved (1820 records). [2025-09-29T02:16:18.032952] [INFO ] [MAIN ] GPC: Successfully saved derivative data. [2025-09-29T02:16:18.036746] [INFO ] [MAIN ] Derivative Progress: 903/2211 symbols completed. GPC took 1.3s. Estimated remaining: 9m 12s. Rate: 142.2 symbols/min [2025-09-29T02:16:18.044503] [INFO ] [MAIN ] GPN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:18.072586] [DEBUG] [LOCAL ] GPMT: Loaded 26788 existing records from primary storage. [2025-09-29T02:16:18.072805] [INFO ] [MAIN ] GPMT: Loaded 26788 primary data records. [2025-09-29T02:16:18.207979] [DEBUG] [LOCAL ] GPK: Loaded 53441 existing records from primary storage. [2025-09-29T02:16:18.212552] [INFO ] [MAIN ] GPK: Loaded 53441 primary data records. [2025-09-29T02:16:18.612713] [DEBUG] [LOCAL ] GPN: Loaded 52822 existing records from primary storage. [2025-09-29T02:16:18.629678] [INFO ] [MAIN ] GPN: Loaded 52822 primary data records. [2025-09-29T02:16:19.280050] [DEBUG] [MAIN ] GPMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:19.280950] [INFO ] [MAIN ] GPMT: Generated 1820 derivative records from 26788 primary records. [2025-09-29T02:16:19.281163] [DEBUG] [LOCAL ] GPMT: Saving derivative data. [2025-09-29T02:16:19.318705] [DEBUG] [MAIN ] GPK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:19.319382] [DEBUG] [LOCAL ] GPMT: Derivative data saved (1820 records). [2025-09-29T02:16:19.320286] [INFO ] [MAIN ] GPK: Generated 1820 derivative records from 53441 primary records. [2025-09-29T02:16:19.320398] [INFO ] [MAIN ] GPMT: Successfully saved derivative data. [2025-09-29T02:16:19.320638] [DEBUG] [LOCAL ] GPK: Saving derivative data. [2025-09-29T02:16:19.324282] [INFO ] [MAIN ] Derivative Progress: 904/2211 symbols completed. GPMT took 1.3s. Estimated remaining: 9m 13s. Rate: 141.8 symbols/min [2025-09-29T02:16:19.325072] [INFO ] [MAIN ] GPOR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:19.344368] [DEBUG] [LOCAL ] GPK: Derivative data saved (1820 records). [2025-09-29T02:16:19.347188] [INFO ] [MAIN ] GPK: Successfully saved derivative data. [2025-09-29T02:16:19.349888] [INFO ] [MAIN ] Derivative Progress: 905/2211 symbols completed. GPK took 1.4s. Estimated remaining: 9m 12s. Rate: 142.0 symbols/min [2025-09-29T02:16:19.350341] [INFO ] [MAIN ] GPRK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:19.370467] [DEBUG] [MAIN ] GPN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:19.371406] [INFO ] [MAIN ] GPN: Generated 1820 derivative records from 52822 primary records. [2025-09-29T02:16:19.371529] [DEBUG] [LOCAL ] GPN: Saving derivative data. [2025-09-29T02:16:19.397932] [DEBUG] [LOCAL ] GPOR: Loaded 23328 existing records from primary storage. [2025-09-29T02:16:19.399816] [INFO ] [MAIN ] GPOR: Loaded 23328 primary data records. [2025-09-29T02:16:19.399867] [DEBUG] [LOCAL ] GPN: Derivative data saved (1820 records). [2025-09-29T02:16:19.400234] [INFO ] [MAIN ] GPN: Successfully saved derivative data. [2025-09-29T02:16:19.442874] [INFO ] [MAIN ] Derivative Progress: 906/2211 symbols completed. GPN took 1.4s. Estimated remaining: 9m 11s. Rate: 142.1 symbols/min [2025-09-29T02:16:19.457061] [INFO ] [MAIN ] GRBK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:19.629768] [DEBUG] [LOCAL ] GPRK: Loaded 39841 existing records from primary storage. [2025-09-29T02:16:19.759200] [INFO ] [MAIN ] GPRK: Loaded 39841 primary data records. [2025-09-29T02:16:19.863081] [DEBUG] [LOCAL ] GRBK: Loaded 27375 existing records from primary storage. [2025-09-29T02:16:19.884022] [INFO ] [MAIN ] GRBK: Loaded 27375 primary data records. [2025-09-29T02:16:20.512343] [DEBUG] [MAIN ] GPOR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:20.513424] [INFO ] [MAIN ] GPOR: Generated 1820 derivative records from 23328 primary records. [2025-09-29T02:16:20.513504] [DEBUG] [LOCAL ] GPOR: Saving derivative data. [2025-09-29T02:16:20.543525] [DEBUG] [LOCAL ] GPOR: Derivative data saved (1820 records). [2025-09-29T02:16:20.544270] [INFO ] [MAIN ] GPOR: Successfully saved derivative data. [2025-09-29T02:16:20.547783] [INFO ] [MAIN ] Derivative Progress: 907/2211 symbols completed. GPOR took 1.2s. Estimated remaining: 9m 12s. Rate: 141.9 symbols/min [2025-09-29T02:16:20.548357] [INFO ] [MAIN ] GRC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:20.572363] [DEBUG] [MAIN ] GPRK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:20.574151] [INFO ] [MAIN ] GPRK: Generated 1820 derivative records from 39841 primary records. [2025-09-29T02:16:20.578563] [DEBUG] [LOCAL ] GRC: Loaded 9061 existing records from primary storage. [2025-09-29T02:16:20.578804] [INFO ] [MAIN ] GRC: Loaded 9061 primary data records. [2025-09-29T02:16:20.578677] [DEBUG] [LOCAL ] GPRK: Saving derivative data. [2025-09-29T02:16:20.693892] [DEBUG] [LOCAL ] GPRK: Derivative data saved (1820 records). [2025-09-29T02:16:20.714865] [INFO ] [MAIN ] GPRK: Successfully saved derivative data. [2025-09-29T02:16:20.733192] [DEBUG] [MAIN ] GRBK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:20.737994] [INFO ] [MAIN ] Derivative Progress: 908/2211 symbols completed. GPRK took 1.4s. Estimated remaining: 9m 11s. Rate: 142.0 symbols/min [2025-09-29T02:16:20.750294] [INFO ] [MAIN ] GRBK: Generated 1820 derivative records from 27375 primary records. [2025-09-29T02:16:20.766209] [DEBUG] [LOCAL ] GRBK: Saving derivative data. [2025-09-29T02:16:20.771637] [INFO ] [MAIN ] GRDN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:20.984350] [DEBUG] [LOCAL ] GRBK: Derivative data saved (1820 records). [2025-09-29T02:16:20.984728] [INFO ] [MAIN ] GRBK: Successfully saved derivative data. [2025-09-29T02:16:20.989053] [INFO ] [MAIN ] Derivative Progress: 909/2211 symbols completed. GRBK took 1.5s. Estimated remaining: 9m 10s. Rate: 142.0 symbols/min [2025-09-29T02:16:20.989316] [INFO ] [MAIN ] GRMN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:21.011122] [DEBUG] [LOCAL ] GRDN: Loaded 20178 existing records from primary storage. [2025-09-29T02:16:21.012927] [INFO ] [MAIN ] GRDN: Loaded 20178 primary data records. [2025-09-29T02:16:21.424431] [DEBUG] [MAIN ] GRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:21.437280] [INFO ] [MAIN ] GRC: Generated 1820 derivative records from 9061 primary records. [2025-09-29T02:16:21.437414] [DEBUG] [LOCAL ] GRC: Saving derivative data. [2025-09-29T02:16:21.440367] [DEBUG] [LOCAL ] GRMN: Loaded 41798 existing records from primary storage. [2025-09-29T02:16:21.441017] [INFO ] [MAIN ] GRMN: Loaded 41798 primary data records. [2025-09-29T02:16:21.586805] [DEBUG] [LOCAL ] GRC: Derivative data saved (1820 records). [2025-09-29T02:16:21.598236] [INFO ] [MAIN ] GRC: Successfully saved derivative data. [2025-09-29T02:16:21.632382] [INFO ] [MAIN ] Derivative Progress: 910/2211 symbols completed. GRC took 1.1s. Estimated remaining: 9m 10s. Rate: 141.9 symbols/min [2025-09-29T02:16:21.654767] [INFO ] [MAIN ] GRND: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:21.828620] [DEBUG] [MAIN ] GRDN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:21.829536] [INFO ] [MAIN ] GRDN: Generated 1820 derivative records from 20178 primary records. [2025-09-29T02:16:21.829696] [DEBUG] [LOCAL ] GRDN: Saving derivative data. [2025-09-29T02:16:21.852296] [DEBUG] [LOCAL ] GRDN: Derivative data saved (1820 records). [2025-09-29T02:16:21.853072] [INFO ] [MAIN ] GRDN: Successfully saved derivative data. [2025-09-29T02:16:21.871075] [INFO ] [MAIN ] Derivative Progress: 911/2211 symbols completed. GRDN took 1.1s. Estimated remaining: 9m 9s. Rate: 142.0 symbols/min [2025-09-29T02:16:21.871500] [INFO ] [MAIN ] GRNT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:21.912438] [DEBUG] [LOCAL ] GRND: Loaded 50744 existing records from primary storage. [2025-09-29T02:16:21.918304] [DEBUG] [MAIN ] GRMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:21.918382] [INFO ] [MAIN ] GRND: Loaded 50744 primary data records. [2025-09-29T02:16:21.919363] [INFO ] [MAIN ] GRMN: Generated 1820 derivative records from 41798 primary records. [2025-09-29T02:16:21.942873] [DEBUG] [LOCAL ] GRMN: Saving derivative data. [2025-09-29T02:16:22.064954] [DEBUG] [LOCAL ] GRMN: Derivative data saved (1820 records). [2025-09-29T02:16:22.108350] [INFO ] [MAIN ] GRMN: Successfully saved derivative data. [2025-09-29T02:16:22.162132] [DEBUG] [LOCAL ] GRNT: Loaded 34235 existing records from primary storage. [2025-09-29T02:16:22.166478] [INFO ] [MAIN ] Derivative Progress: 912/2211 symbols completed. GRMN took 1.2s. Estimated remaining: 9m 9s. Rate: 142.0 symbols/min [2025-09-29T02:16:22.172296] [INFO ] [MAIN ] GROV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:22.289782] [INFO ] [MAIN ] GRNT: Loaded 34235 primary data records. [2025-09-29T02:16:22.403455] [DEBUG] [LOCAL ] GROV: Loaded 9240 existing records from primary storage. [2025-09-29T02:16:22.417042] [INFO ] [MAIN ] GROV: Loaded 9240 primary data records. [2025-09-29T02:16:23.009306] [DEBUG] [MAIN ] GRND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:23.010526] [INFO ] [MAIN ] GRND: Generated 1820 derivative records from 50744 primary records. [2025-09-29T02:16:23.012041] [DEBUG] [LOCAL ] GRND: Saving derivative data. [2025-09-29T02:16:23.033005] [DEBUG] [LOCAL ] GRND: Derivative data saved (1820 records). [2025-09-29T02:16:23.034483] [INFO ] [MAIN ] GRND: Successfully saved derivative data. [2025-09-29T02:16:23.038429] [INFO ] [MAIN ] Derivative Progress: 913/2211 symbols completed. GRND took 1.4s. Estimated remaining: 9m 9s. Rate: 141.9 symbols/min [2025-09-29T02:16:23.057492] [DEBUG] [MAIN ] GRNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:23.058383] [INFO ] [MAIN ] GRNT: Generated 1820 derivative records from 34235 primary records. [2025-09-29T02:16:23.058686] [DEBUG] [LOCAL ] GRNT: Saving derivative data. [2025-09-29T02:16:23.076211] [DEBUG] [LOCAL ] GRNT: Derivative data saved (1820 records). [2025-09-29T02:16:23.077512] [INFO ] [MAIN ] GRNT: Successfully saved derivative data. [2025-09-29T02:16:23.081364] [INFO ] [MAIN ] Derivative Progress: 914/2211 symbols completed. GRNT took 1.2s. Estimated remaining: 9m 8s. Rate: 142.0 symbols/min [2025-09-29T02:16:23.096002] [DEBUG] [MAIN ] GROV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:23.096731] [INFO ] [MAIN ] GROV: Generated 1820 derivative records from 9240 primary records. [2025-09-29T02:16:23.096850] [DEBUG] [LOCAL ] GROV: Saving derivative data. [2025-09-29T02:16:23.114023] [DEBUG] [LOCAL ] GROV: Derivative data saved (1820 records). [2025-09-29T02:16:23.114160] [INFO ] [MAIN ] GROV: Successfully saved derivative data. [2025-09-29T02:16:23.116753] [INFO ] [MAIN ] Derivative Progress: 915/2211 symbols completed. GROV took 0.9s. Estimated remaining: 9m 7s. Rate: 142.2 symbols/min [2025-09-29T02:16:23.117536] [INFO ] [MAIN ] GSBD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:23.117437] [INFO ] [MAIN ] GRX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:23.117702] [INFO ] [MAIN ] GS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:23.132437] [DEBUG] [LOCAL ] GRX: Loaded 4547 existing records from primary storage. [2025-09-29T02:16:23.132818] [INFO ] [MAIN ] GRX: Loaded 4547 primary data records. [2025-09-29T02:16:23.396623] [DEBUG] [LOCAL ] GSBD: Loaded 39756 existing records from primary storage. [2025-09-29T02:16:23.605757] [INFO ] [MAIN ] GSBD: Loaded 39756 primary data records. [2025-09-29T02:16:23.623991] [DEBUG] [LOCAL ] GS: Loaded 52736 existing records from primary storage. [2025-09-29T02:16:23.656183] [INFO ] [MAIN ] GS: Loaded 52736 primary data records. [2025-09-29T02:16:24.367470] [DEBUG] [MAIN ] GRX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:24.370759] [INFO ] [MAIN ] GRX: Generated 1820 derivative records from 4547 primary records. [2025-09-29T02:16:24.371242] [DEBUG] [LOCAL ] GRX: Saving derivative data. [2025-09-29T02:16:24.390241] [DEBUG] [LOCAL ] GRX: Derivative data saved (1820 records). [2025-09-29T02:16:24.390749] [INFO ] [MAIN ] GRX: Successfully saved derivative data. [2025-09-29T02:16:24.398173] [INFO ] [MAIN ] Derivative Progress: 916/2211 symbols completed. GRX took 1.3s. Estimated remaining: 9m 8s. Rate: 141.8 symbols/min [2025-09-29T02:16:24.398684] [INFO ] [MAIN ] GSK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:24.414155] [DEBUG] [MAIN ] GSBD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:24.415351] [INFO ] [MAIN ] GSBD: Generated 1820 derivative records from 39756 primary records. [2025-09-29T02:16:24.416082] [DEBUG] [LOCAL ] GSBD: Saving derivative data. [2025-09-29T02:16:24.439333] [DEBUG] [LOCAL ] GSBD: Derivative data saved (1820 records). [2025-09-29T02:16:24.453915] [INFO ] [MAIN ] GSBD: Successfully saved derivative data. [2025-09-29T02:16:24.458539] [INFO ] [MAIN ] Derivative Progress: 917/2211 symbols completed. GSBD took 1.3s. Estimated remaining: 9m 7s. Rate: 142.0 symbols/min [2025-09-29T02:16:24.454569] [DEBUG] [MAIN ] GS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:24.458804] [INFO ] [MAIN ] GSL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:24.460080] [INFO ] [MAIN ] GS: Generated 1820 derivative records from 52736 primary records. [2025-09-29T02:16:24.460953] [DEBUG] [LOCAL ] GS: Saving derivative data. [2025-09-29T02:16:24.483486] [DEBUG] [LOCAL ] GS: Derivative data saved (1820 records). [2025-09-29T02:16:24.483949] [INFO ] [MAIN ] GS: Successfully saved derivative data. [2025-09-29T02:16:24.487445] [INFO ] [MAIN ] Derivative Progress: 918/2211 symbols completed. GS took 1.4s. Estimated remaining: 9m 6s. Rate: 142.1 symbols/min [2025-09-29T02:16:24.487863] [INFO ] [MAIN ] GTES: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:24.567637] [DEBUG] [LOCAL ] GSL: Loaded 33824 existing records from primary storage. [2025-09-29T02:16:24.570399] [INFO ] [MAIN ] GSL: Loaded 33824 primary data records. [2025-09-29T02:16:24.570191] [DEBUG] [LOCAL ] GSK: Loaded 54272 existing records from primary storage. [2025-09-29T02:16:24.571212] [INFO ] [MAIN ] GSK: Loaded 54272 primary data records. [2025-09-29T02:16:24.870905] [DEBUG] [LOCAL ] GTES: Loaded 51399 existing records from primary storage. [2025-09-29T02:16:24.928538] [INFO ] [MAIN ] GTES: Loaded 51399 primary data records. [2025-09-29T02:16:25.765039] [DEBUG] [MAIN ] GSL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:25.765768] [DEBUG] [MAIN ] GSK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:25.767923] [INFO ] [MAIN ] GSK: Generated 1820 derivative records from 54272 primary records. [2025-09-29T02:16:25.767042] [INFO ] [MAIN ] GSL: Generated 1820 derivative records from 33824 primary records. [2025-09-29T02:16:25.768179] [DEBUG] [LOCAL ] GSK: Saving derivative data. [2025-09-29T02:16:25.769431] [DEBUG] [LOCAL ] GSL: Saving derivative data. [2025-09-29T02:16:25.811917] [DEBUG] [LOCAL ] GSL: Derivative data saved (1820 records). [2025-09-29T02:16:25.826123] [DEBUG] [MAIN ] GTES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:25.828413] [INFO ] [MAIN ] GTES: Generated 1820 derivative records from 51399 primary records. [2025-09-29T02:16:25.826682] [INFO ] [MAIN ] GSL: Successfully saved derivative data. [2025-09-29T02:16:25.828608] [DEBUG] [LOCAL ] GTES: Saving derivative data. [2025-09-29T02:16:25.828529] [DEBUG] [LOCAL ] GSK: Derivative data saved (1820 records). [2025-09-29T02:16:25.832014] [INFO ] [MAIN ] Derivative Progress: 919/2211 symbols completed. GSL took 1.4s. Estimated remaining: 9m 7s. Rate: 141.8 symbols/min [2025-09-29T02:16:25.832136] [INFO ] [MAIN ] GSK: Successfully saved derivative data. [2025-09-29T02:16:25.836863] [INFO ] [MAIN ] Derivative Progress: 920/2211 symbols completed. GSK took 1.4s. Estimated remaining: 9m 6s. Rate: 141.9 symbols/min [2025-09-29T02:16:25.832365] [INFO ] [MAIN ] GTLS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:25.837411] [INFO ] [MAIN ] GTN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:25.856380] [DEBUG] [LOCAL ] GTES: Derivative data saved (1820 records). [2025-09-29T02:16:25.856718] [INFO ] [MAIN ] GTES: Successfully saved derivative data. [2025-09-29T02:16:25.860187] [INFO ] [MAIN ] Derivative Progress: 921/2211 symbols completed. GTES took 1.4s. Estimated remaining: 9m 5s. Rate: 142.1 symbols/min [2025-09-29T02:16:25.860405] [INFO ] [MAIN ] GTY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:25.940878] [DEBUG] [LOCAL ] GTN: Loaded 46301 existing records from primary storage. [2025-09-29T02:16:25.941168] [INFO ] [MAIN ] GTN: Loaded 46301 primary data records. [2025-09-29T02:16:25.942519] [DEBUG] [LOCAL ] GTLS: Loaded 43461 existing records from primary storage. [2025-09-29T02:16:25.942817] [INFO ] [MAIN ] GTLS: Loaded 43461 primary data records. [2025-09-29T02:16:26.160005] [DEBUG] [LOCAL ] GTY: Loaded 30796 existing records from primary storage. [2025-09-29T02:16:26.216904] [INFO ] [MAIN ] GTY: Loaded 30796 primary data records. [2025-09-29T02:16:26.970221] [DEBUG] [MAIN ] GTN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:26.972153] [INFO ] [MAIN ] GTN: Generated 1820 derivative records from 46301 primary records. [2025-09-29T02:16:26.972449] [DEBUG] [LOCAL ] GTN: Saving derivative data. [2025-09-29T02:16:27.003012] [DEBUG] [MAIN ] GTLS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:27.006476] [INFO ] [MAIN ] GTLS: Generated 1820 derivative records from 43461 primary records. [2025-09-29T02:16:27.007403] [DEBUG] [LOCAL ] GTN: Derivative data saved (1820 records). [2025-09-29T02:16:27.007872] [DEBUG] [LOCAL ] GTLS: Saving derivative data. [2025-09-29T02:16:27.007953] [INFO ] [MAIN ] GTN: Successfully saved derivative data. [2025-09-29T02:16:27.011002] [INFO ] [MAIN ] Derivative Progress: 922/2211 symbols completed. GTN took 1.2s. Estimated remaining: 9m 5s. Rate: 141.8 symbols/min [2025-09-29T02:16:27.013629] [INFO ] [MAIN ] GUG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:27.041598] [DEBUG] [LOCAL ] GTLS: Derivative data saved (1820 records). [2025-09-29T02:16:27.047404] [INFO ] [MAIN ] GTLS: Successfully saved derivative data. [2025-09-29T02:16:27.050520] [INFO ] [MAIN ] Derivative Progress: 923/2211 symbols completed. GTLS took 1.2s. Estimated remaining: 9m 4s. Rate: 142.0 symbols/min [2025-09-29T02:16:27.047604] [DEBUG] [MAIN ] GTY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:27.050900] [INFO ] [MAIN ] GUT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:27.052231] [INFO ] [MAIN ] GTY: Generated 1820 derivative records from 30796 primary records. [2025-09-29T02:16:27.056510] [DEBUG] [LOCAL ] GTY: Saving derivative data. [2025-09-29T02:16:27.076045] [DEBUG] [LOCAL ] GUG: Loaded 12138 existing records from primary storage. [2025-09-29T02:16:27.077035] [INFO ] [MAIN ] GUG: Loaded 12138 primary data records. [2025-09-29T02:16:27.113174] [DEBUG] [LOCAL ] GTY: Derivative data saved (1820 records). [2025-09-29T02:16:27.151458] [INFO ] [MAIN ] GTY: Successfully saved derivative data. [2025-09-29T02:16:27.177249] [INFO ] [MAIN ] Derivative Progress: 924/2211 symbols completed. GTY took 1.3s. Estimated remaining: 9m 4s. Rate: 142.1 symbols/min [2025-09-29T02:16:27.202703] [INFO ] [MAIN ] GVA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:27.203393] [DEBUG] [LOCAL ] GUT: Loaded 15560 existing records from primary storage. [2025-09-29T02:16:27.203694] [INFO ] [MAIN ] GUT: Loaded 15560 primary data records. [2025-09-29T02:16:27.782766] [DEBUG] [LOCAL ] GVA: Loaded 34030 existing records from primary storage. [2025-09-29T02:16:27.784272] [INFO ] [MAIN ] GVA: Loaded 34030 primary data records. [2025-09-29T02:16:28.177749] [DEBUG] [MAIN ] GUG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:28.178979] [INFO ] [MAIN ] GUG: Generated 1820 derivative records from 12138 primary records. [2025-09-29T02:16:28.179697] [DEBUG] [LOCAL ] GUG: Saving derivative data. [2025-09-29T02:16:28.211989] [DEBUG] [LOCAL ] GUG: Derivative data saved (1820 records). [2025-09-29T02:16:28.218232] [DEBUG] [MAIN ] GUT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:28.217811] [INFO ] [MAIN ] GUG: Successfully saved derivative data. [2025-09-29T02:16:28.219081] [INFO ] [MAIN ] GUT: Generated 1820 derivative records from 15560 primary records. [2025-09-29T02:16:28.222928] [DEBUG] [LOCAL ] GUT: Saving derivative data. [2025-09-29T02:16:28.221359] [INFO ] [MAIN ] Derivative Progress: 925/2211 symbols completed. GUG took 1.2s. Estimated remaining: 9m 4s. Rate: 141.8 symbols/min [2025-09-29T02:16:28.224299] [INFO ] [MAIN ] GWH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:28.242794] [DEBUG] [LOCAL ] GUT: Derivative data saved (1820 records). [2025-09-29T02:16:28.243243] [INFO ] [MAIN ] GUT: Successfully saved derivative data. [2025-09-29T02:16:28.246253] [INFO ] [MAIN ] Derivative Progress: 926/2211 symbols completed. GUT took 1.2s. Estimated remaining: 9m 3s. Rate: 142.0 symbols/min [2025-09-29T02:16:28.247966] [INFO ] [MAIN ] GWRE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:28.268719] [DEBUG] [MAIN ] GVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:28.276371] [INFO ] [MAIN ] GVA: Generated 1820 derivative records from 34030 primary records. [2025-09-29T02:16:28.276262] [DEBUG] [LOCAL ] GWH: Loaded 15825 existing records from primary storage. [2025-09-29T02:16:28.276603] [INFO ] [MAIN ] GWH: Loaded 15825 primary data records. [2025-09-29T02:16:28.276680] [DEBUG] [LOCAL ] GVA: Saving derivative data. [2025-09-29T02:16:28.441925] [DEBUG] [LOCAL ] GVA: Derivative data saved (1820 records). [2025-09-29T02:16:28.475177] [INFO ] [MAIN ] GVA: Successfully saved derivative data. [2025-09-29T02:16:28.642995] [INFO ] [MAIN ] Derivative Progress: 927/2211 symbols completed. GVA took 1.4s. Estimated remaining: 9m 3s. Rate: 142.0 symbols/min [2025-09-29T02:16:28.654543] [INFO ] [MAIN ] GWW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:28.684607] [DEBUG] [LOCAL ] GWRE: Loaded 41564 existing records from primary storage. [2025-09-29T02:16:28.685221] [INFO ] [MAIN ] GWRE: Loaded 41564 primary data records. [2025-09-29T02:16:28.880139] [DEBUG] [LOCAL ] GWW: Loaded 20108 existing records from primary storage. [2025-09-29T02:16:29.030546] [INFO ] [MAIN ] GWW: Loaded 20108 primary data records. [2025-09-29T02:16:29.205101] [DEBUG] [MAIN ] GWH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:29.239365] [INFO ] [MAIN ] GWH: Generated 1820 derivative records from 15825 primary records. [2025-09-29T02:16:29.268488] [DEBUG] [LOCAL ] GWH: Saving derivative data. [2025-09-29T02:16:29.426165] [DEBUG] [LOCAL ] GWH: Derivative data saved (1820 records). [2025-09-29T02:16:29.427981] [INFO ] [MAIN ] GWH: Successfully saved derivative data. [2025-09-29T02:16:29.433096] [INFO ] [MAIN ] Derivative Progress: 928/2211 symbols completed. GWH took 1.2s. Estimated remaining: 9m 3s. Rate: 141.9 symbols/min [2025-09-29T02:16:29.447742] [DEBUG] [MAIN ] GWRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:29.448667] [INFO ] [MAIN ] GWRE: Generated 1820 derivative records from 41564 primary records. [2025-09-29T02:16:29.448773] [DEBUG] [LOCAL ] GWRE: Saving derivative data. [2025-09-29T02:16:29.467968] [DEBUG] [LOCAL ] GWRE: Derivative data saved (1820 records). [2025-09-29T02:16:29.468366] [INFO ] [MAIN ] GWRE: Successfully saved derivative data. [2025-09-29T02:16:29.472479] [INFO ] [MAIN ] Derivative Progress: 929/2211 symbols completed. GWRE took 1.2s. Estimated remaining: 9m 2s. Rate: 142.0 symbols/min [2025-09-29T02:16:29.489004] [DEBUG] [MAIN ] GWW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:29.489776] [INFO ] [MAIN ] GWW: Generated 1820 derivative records from 20108 primary records. [2025-09-29T02:16:29.489882] [DEBUG] [LOCAL ] GWW: Saving derivative data. [2025-09-29T02:16:29.506416] [DEBUG] [LOCAL ] GWW: Derivative data saved (1820 records). [2025-09-29T02:16:29.506572] [INFO ] [MAIN ] GWW: Successfully saved derivative data. [2025-09-29T02:16:29.510884] [INFO ] [MAIN ] Derivative Progress: 930/2211 symbols completed. GWW took 0.9s. Estimated remaining: 9m 1s. Rate: 142.1 symbols/min [2025-09-29T02:16:29.511496] [INFO ] [MAIN ] H: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:29.511355] [INFO ] [MAIN ] GXO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:29.511750] [INFO ] [MAIN ] GYLD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:29.518880] [DEBUG] [LOCAL ] GYLD: Loaded 1569 existing records from primary storage. [2025-09-29T02:16:29.519146] [INFO ] [MAIN ] GYLD: Loaded 1569 primary data records. [2025-09-29T02:16:29.904374] [DEBUG] [LOCAL ] GXO: Loaded 48260 existing records from primary storage. [2025-09-29T02:16:29.907330] [INFO ] [MAIN ] GXO: Loaded 48260 primary data records. [2025-09-29T02:16:29.964972] [DEBUG] [LOCAL ] H: Loaded 45492 existing records from primary storage. [2025-09-29T02:16:29.996979] [INFO ] [MAIN ] H: Loaded 45492 primary data records. [2025-09-29T02:16:30.664750] [DEBUG] [MAIN ] GYLD: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-09-29T02:16:30.665954] [INFO ] [MAIN ] GYLD: Generated 1818 derivative records from 1569 primary records. [2025-09-29T02:16:30.666114] [DEBUG] [LOCAL ] GYLD: Saving derivative data. [2025-09-29T02:16:30.688937] [DEBUG] [LOCAL ] GYLD: Derivative data saved (1818 records). [2025-09-29T02:16:30.689778] [INFO ] [MAIN ] GYLD: Successfully saved derivative data. [2025-09-29T02:16:30.692670] [INFO ] [MAIN ] Derivative Progress: 931/2211 symbols completed. GYLD took 1.2s. Estimated remaining: 9m 1s. Rate: 141.9 symbols/min [2025-09-29T02:16:30.693146] [INFO ] [MAIN ] HAE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:30.711824] [DEBUG] [MAIN ] GXO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:30.712735] [INFO ] [MAIN ] GXO: Generated 1820 derivative records from 48260 primary records. [2025-09-29T02:16:30.712908] [DEBUG] [LOCAL ] GXO: Saving derivative data. [2025-09-29T02:16:30.732900] [DEBUG] [LOCAL ] GXO: Derivative data saved (1820 records). [2025-09-29T02:16:30.733303] [INFO ] [MAIN ] GXO: Successfully saved derivative data. [2025-09-29T02:16:30.750163] [INFO ] [MAIN ] Derivative Progress: 932/2211 symbols completed. GXO took 1.2s. Estimated remaining: 9m 0s. Rate: 142.0 symbols/min [2025-09-29T02:16:30.751250] [DEBUG] [MAIN ] H: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:30.751405] [INFO ] [MAIN ] HAFN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:30.752543] [INFO ] [MAIN ] H: Generated 1820 derivative records from 45492 primary records. [2025-09-29T02:16:30.753006] [DEBUG] [LOCAL ] H: Saving derivative data. [2025-09-29T02:16:30.781921] [DEBUG] [LOCAL ] H: Derivative data saved (1820 records). [2025-09-29T02:16:30.782257] [INFO ] [MAIN ] H: Successfully saved derivative data. [2025-09-29T02:16:30.785168] [INFO ] [MAIN ] Derivative Progress: 933/2211 symbols completed. H took 1.3s. Estimated remaining: 8m 59s. Rate: 142.1 symbols/min [2025-09-29T02:16:30.785399] [INFO ] [MAIN ] HAL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:30.804887] [DEBUG] [LOCAL ] HAE: Loaded 40176 existing records from primary storage. [2025-09-29T02:16:30.805110] [INFO ] [MAIN ] HAE: Loaded 40176 primary data records. [2025-09-29T02:16:30.990765] [DEBUG] [LOCAL ] HAFN: Loaded 44189 existing records from primary storage. [2025-09-29T02:16:31.035572] [INFO ] [MAIN ] HAFN: Loaded 44189 primary data records. [2025-09-29T02:16:31.313615] [DEBUG] [LOCAL ] HAL: Loaded 54498 existing records from primary storage. [2025-09-29T02:16:31.329757] [INFO ] [MAIN ] HAL: Loaded 54498 primary data records. [2025-09-29T02:16:31.893127] [DEBUG] [MAIN ] HAE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:31.895401] [INFO ] [MAIN ] HAE: Generated 1820 derivative records from 40176 primary records. [2025-09-29T02:16:31.895776] [DEBUG] [LOCAL ] HAE: Saving derivative data. [2025-09-29T02:16:31.917232] [DEBUG] [LOCAL ] HAE: Derivative data saved (1820 records). [2025-09-29T02:16:31.917898] [INFO ] [MAIN ] HAE: Successfully saved derivative data. [2025-09-29T02:16:31.923543] [INFO ] [MAIN ] Derivative Progress: 934/2211 symbols completed. HAE took 1.2s. Estimated remaining: 9m 0s. Rate: 141.9 symbols/min [2025-09-29T02:16:31.928071] [INFO ] [MAIN ] HASI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:31.950615] [DEBUG] [MAIN ] HAFN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:31.951716] [INFO ] [MAIN ] HAFN: Generated 1820 derivative records from 44189 primary records. [2025-09-29T02:16:31.952067] [DEBUG] [LOCAL ] HAFN: Saving derivative data. [2025-09-29T02:16:31.985876] [DEBUG] [LOCAL ] HAFN: Derivative data saved (1820 records). [2025-09-29T02:16:31.984823] [DEBUG] [MAIN ] HAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:31.986122] [INFO ] [MAIN ] HAFN: Successfully saved derivative data. [2025-09-29T02:16:31.987083] [INFO ] [MAIN ] HAL: Generated 1820 derivative records from 54498 primary records. [2025-09-29T02:16:31.987185] [DEBUG] [LOCAL ] HAL: Saving derivative data. [2025-09-29T02:16:31.991184] [INFO ] [MAIN ] Derivative Progress: 935/2211 symbols completed. HAFN took 1.2s. Estimated remaining: 8m 59s. Rate: 142.0 symbols/min [2025-09-29T02:16:31.991527] [INFO ] [MAIN ] HAYW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:32.022903] [DEBUG] [LOCAL ] HAL: Derivative data saved (1820 records). [2025-09-29T02:16:32.023252] [INFO ] [MAIN ] HAL: Successfully saved derivative data. [2025-09-29T02:16:32.027946] [INFO ] [MAIN ] Derivative Progress: 936/2211 symbols completed. HAL took 1.2s. Estimated remaining: 8m 58s. Rate: 142.1 symbols/min [2025-09-29T02:16:32.028436] [INFO ] [MAIN ] HBB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:32.055228] [DEBUG] [LOCAL ] HASI: Loaded 47868 existing records from primary storage. [2025-09-29T02:16:32.059378] [INFO ] [MAIN ] HASI: Loaded 47868 primary data records. [2025-09-29T02:16:32.059164] [DEBUG] [LOCAL ] HBB: Loaded 6912 existing records from primary storage. [2025-09-29T02:16:32.059589] [INFO ] [MAIN ] HBB: Loaded 6912 primary data records. [2025-09-29T02:16:32.377794] [DEBUG] [LOCAL ] HAYW: Loaded 49444 existing records from primary storage. [2025-09-29T02:16:32.493713] [INFO ] [MAIN ] HAYW: Loaded 49444 primary data records. [2025-09-29T02:16:33.153498] [DEBUG] [MAIN ] HASI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:33.153937] [DEBUG] [MAIN ] HBB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:33.155076] [INFO ] [MAIN ] HBB: Generated 1820 derivative records from 6912 primary records. [2025-09-29T02:16:33.156189] [INFO ] [MAIN ] HASI: Generated 1820 derivative records from 47868 primary records. [2025-09-29T02:16:33.157243] [DEBUG] [LOCAL ] HBB: Saving derivative data. [2025-09-29T02:16:33.157096] [DEBUG] [LOCAL ] HASI: Saving derivative data. [2025-09-29T02:16:33.186848] [DEBUG] [LOCAL ] HBB: Derivative data saved (1820 records). [2025-09-29T02:16:33.188421] [INFO ] [MAIN ] HBB: Successfully saved derivative data. [2025-09-29T02:16:33.191274] [INFO ] [MAIN ] Derivative Progress: 937/2211 symbols completed. HBB took 1.2s. Estimated remaining: 8m 59s. Rate: 141.9 symbols/min [2025-09-29T02:16:33.192104] [INFO ] [MAIN ] HBI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:33.202302] [DEBUG] [LOCAL ] HASI: Derivative data saved (1820 records). [2025-09-29T02:16:33.210232] [INFO ] [MAIN ] HASI: Successfully saved derivative data. [2025-09-29T02:16:33.214443] [INFO ] [MAIN ] Derivative Progress: 938/2211 symbols completed. HASI took 1.3s. Estimated remaining: 8m 58s. Rate: 142.0 symbols/min [2025-09-29T02:16:33.220141] [DEBUG] [MAIN ] HAYW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:33.220264] [INFO ] [MAIN ] HBM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:33.221232] [INFO ] [MAIN ] HAYW: Generated 1820 derivative records from 49444 primary records. [2025-09-29T02:16:33.221334] [DEBUG] [LOCAL ] HAYW: Saving derivative data. [2025-09-29T02:16:33.238992] [DEBUG] [LOCAL ] HAYW: Derivative data saved (1820 records). [2025-09-29T02:16:33.239152] [INFO ] [MAIN ] HAYW: Successfully saved derivative data. [2025-09-29T02:16:33.243149] [INFO ] [MAIN ] Derivative Progress: 939/2211 symbols completed. HAYW took 1.3s. Estimated remaining: 8m 57s. Rate: 142.2 symbols/min [2025-09-29T02:16:33.243424] [INFO ] [MAIN ] HCA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:33.308710] [DEBUG] [LOCAL ] HBI: Loaded 53769 existing records from primary storage. [2025-09-29T02:16:33.309231] [INFO ] [MAIN ] HBI: Loaded 53769 primary data records. [2025-09-29T02:16:33.468433] [DEBUG] [LOCAL ] HBM: Loaded 53683 existing records from primary storage. [2025-09-29T02:16:33.488260] [INFO ] [MAIN ] HBM: Loaded 53683 primary data records. [2025-09-29T02:16:33.539304] [DEBUG] [LOCAL ] HCA: Loaded 47781 existing records from primary storage. [2025-09-29T02:16:33.575986] [INFO ] [MAIN ] HCA: Loaded 47781 primary data records. [2025-09-29T02:16:34.487559] [DEBUG] [MAIN ] HBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:34.489123] [INFO ] [MAIN ] HBI: Generated 1820 derivative records from 53769 primary records. [2025-09-29T02:16:34.489430] [DEBUG] [LOCAL ] HBI: Saving derivative data. [2025-09-29T02:16:34.509800] [DEBUG] [LOCAL ] HBI: Derivative data saved (1820 records). [2025-09-29T02:16:34.510447] [INFO ] [MAIN ] HBI: Successfully saved derivative data. [2025-09-29T02:16:34.514266] [INFO ] [MAIN ] Derivative Progress: 940/2211 symbols completed. HBI took 1.3s. Estimated remaining: 8m 58s. Rate: 141.9 symbols/min [2025-09-29T02:16:34.515555] [INFO ] [MAIN ] HCC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:34.535423] [DEBUG] [MAIN ] HBM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:34.537402] [INFO ] [MAIN ] HBM: Generated 1820 derivative records from 53683 primary records. [2025-09-29T02:16:34.538117] [DEBUG] [LOCAL ] HBM: Saving derivative data. [2025-09-29T02:16:34.560294] [DEBUG] [LOCAL ] HBM: Derivative data saved (1820 records). [2025-09-29T02:16:34.560780] [INFO ] [MAIN ] HBM: Successfully saved derivative data. [2025-09-29T02:16:34.564493] [INFO ] [MAIN ] Derivative Progress: 941/2211 symbols completed. HBM took 1.3s. Estimated remaining: 8m 57s. Rate: 142.0 symbols/min [2025-09-29T02:16:34.564743] [INFO ] [MAIN ] HCI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:34.580415] [DEBUG] [MAIN ] HCA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:34.581458] [INFO ] [MAIN ] HCA: Generated 1820 derivative records from 47781 primary records. [2025-09-29T02:16:34.581671] [DEBUG] [LOCAL ] HCA: Saving derivative data. [2025-09-29T02:16:34.620029] [DEBUG] [LOCAL ] HCI: Loaded 14126 existing records from primary storage. [2025-09-29T02:16:34.622578] [INFO ] [MAIN ] HCI: Loaded 14126 primary data records. [2025-09-29T02:16:34.676324] [DEBUG] [LOCAL ] HCA: Derivative data saved (1820 records). [2025-09-29T02:16:34.697028] [INFO ] [MAIN ] HCA: Successfully saved derivative data. [2025-09-29T02:16:34.701098] [INFO ] [MAIN ] Derivative Progress: 942/2211 symbols completed. HCA took 1.5s. Estimated remaining: 8m 56s. Rate: 142.1 symbols/min [2025-09-29T02:16:34.696793] [DEBUG] [LOCAL ] HCC: Loaded 46057 existing records from primary storage. [2025-09-29T02:16:34.710008] [INFO ] [MAIN ] HCC: Loaded 46057 primary data records. [2025-09-29T02:16:34.709877] [INFO ] [MAIN ] HD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:35.379514] [DEBUG] [LOCAL ] HD: Loaded 54283 existing records from primary storage. [2025-09-29T02:16:35.381639] [INFO ] [MAIN ] HD: Loaded 54283 primary data records. [2025-09-29T02:16:35.533025] [DEBUG] [MAIN ] HCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:35.549926] [INFO ] [MAIN ] HCI: Generated 1820 derivative records from 14126 primary records. [2025-09-29T02:16:35.608908] [DEBUG] [LOCAL ] HCI: Saving derivative data. [2025-09-29T02:16:35.771179] [DEBUG] [LOCAL ] HCI: Derivative data saved (1820 records). [2025-09-29T02:16:35.771861] [INFO ] [MAIN ] HCI: Successfully saved derivative data. [2025-09-29T02:16:35.768047] [DEBUG] [MAIN ] HCC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:35.774400] [INFO ] [MAIN ] Derivative Progress: 943/2211 symbols completed. HCI took 1.2s. Estimated remaining: 8m 56s. Rate: 141.9 symbols/min [2025-09-29T02:16:35.776116] [INFO ] [MAIN ] HCC: Generated 1820 derivative records from 46057 primary records. [2025-09-29T02:16:35.777106] [DEBUG] [LOCAL ] HCC: Saving derivative data. [2025-09-29T02:16:35.794925] [DEBUG] [LOCAL ] HCC: Derivative data saved (1820 records). [2025-09-29T02:16:35.795825] [INFO ] [MAIN ] HCC: Successfully saved derivative data. [2025-09-29T02:16:35.799913] [INFO ] [MAIN ] Derivative Progress: 944/2211 symbols completed. HCC took 1.3s. Estimated remaining: 8m 55s. Rate: 142.0 symbols/min [2025-09-29T02:16:35.818310] [DEBUG] [MAIN ] HD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:35.819047] [INFO ] [MAIN ] HD: Generated 1820 derivative records from 54283 primary records. [2025-09-29T02:16:35.819134] [DEBUG] [LOCAL ] HD: Saving derivative data. [2025-09-29T02:16:35.835024] [DEBUG] [LOCAL ] HD: Derivative data saved (1820 records). [2025-09-29T02:16:35.835128] [INFO ] [MAIN ] HD: Successfully saved derivative data. [2025-09-29T02:16:35.838312] [INFO ] [MAIN ] Derivative Progress: 945/2211 symbols completed. HD took 1.1s. Estimated remaining: 8m 54s. Rate: 142.1 symbols/min [2025-09-29T02:16:35.838925] [INFO ] [MAIN ] HEI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:35.838849] [INFO ] [MAIN ] HDB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:35.839065] [INFO ] [MAIN ] HE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:35.889974] [DEBUG] [LOCAL ] HEI: Loaded 32846 existing records from primary storage. [2025-09-29T02:16:35.890424] [INFO ] [MAIN ] HEI: Loaded 32846 primary data records. [2025-09-29T02:16:36.080018] [DEBUG] [LOCAL ] HDB: Loaded 52695 existing records from primary storage. [2025-09-29T02:16:36.102582] [DEBUG] [LOCAL ] HE: Loaded 49870 existing records from primary storage. [2025-09-29T02:16:36.146440] [INFO ] [MAIN ] HDB: Loaded 52695 primary data records. [2025-09-29T02:16:36.274183] [INFO ] [MAIN ] HE: Loaded 49870 primary data records. [2025-09-29T02:16:37.020397] [DEBUG] [MAIN ] HEI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:37.023185] [INFO ] [MAIN ] HEI: Generated 1820 derivative records from 32846 primary records. [2025-09-29T02:16:37.024221] [DEBUG] [LOCAL ] HEI: Saving derivative data. [2025-09-29T02:16:37.046310] [DEBUG] [LOCAL ] HEI: Derivative data saved (1820 records). [2025-09-29T02:16:37.047089] [INFO ] [MAIN ] HEI: Successfully saved derivative data. [2025-09-29T02:16:37.049584] [INFO ] [MAIN ] Derivative Progress: 946/2211 symbols completed. HEI took 1.2s. Estimated remaining: 8m 55s. Rate: 141.9 symbols/min [2025-09-29T02:16:37.050030] [INFO ] [MAIN ] HEQ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:37.086258] [DEBUG] [LOCAL ] HEQ: Loaded 6236 existing records from primary storage. [2025-09-29T02:16:37.092098] [DEBUG] [MAIN ] HDB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:37.092376] [DEBUG] [MAIN ] HE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:37.093323] [INFO ] [MAIN ] HDB: Generated 1820 derivative records from 52695 primary records. [2025-09-29T02:16:37.093478] [DEBUG] [LOCAL ] HDB: Saving derivative data. [2025-09-29T02:16:37.094123] [INFO ] [MAIN ] HEQ: Loaded 6236 primary data records. [2025-09-29T02:16:37.095253] [INFO ] [MAIN ] HE: Generated 1820 derivative records from 49870 primary records. [2025-09-29T02:16:37.101073] [DEBUG] [LOCAL ] HE: Saving derivative data. [2025-09-29T02:16:37.174486] [DEBUG] [LOCAL ] HDB: Derivative data saved (1820 records). [2025-09-29T02:16:37.240914] [INFO ] [MAIN ] HDB: Successfully saved derivative data. [2025-09-29T02:16:37.247417] [DEBUG] [LOCAL ] HE: Derivative data saved (1820 records). [2025-09-29T02:16:37.247531] [INFO ] [MAIN ] HE: Successfully saved derivative data. [2025-09-29T02:16:37.252135] [INFO ] [MAIN ] Derivative Progress: 947/2211 symbols completed. HDB took 1.4s. Estimated remaining: 8m 54s. Rate: 141.9 symbols/min [2025-09-29T02:16:37.278245] [INFO ] [MAIN ] HESM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:37.278349] [INFO ] [MAIN ] Derivative Progress: 948/2211 symbols completed. HE took 1.4s. Estimated remaining: 8m 53s. Rate: 142.1 symbols/min [2025-09-29T02:16:37.297753] [INFO ] [MAIN ] HFRO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:37.511822] [DEBUG] [LOCAL ] HFRO: Loaded 17798 existing records from primary storage. [2025-09-29T02:16:37.512451] [INFO ] [MAIN ] HFRO: Loaded 17798 primary data records. [2025-09-29T02:16:37.673588] [DEBUG] [LOCAL ] HESM: Loaded 48879 existing records from primary storage. [2025-09-29T02:16:37.739611] [INFO ] [MAIN ] HESM: Loaded 48879 primary data records. [2025-09-29T02:16:37.941710] [DEBUG] [MAIN ] HEQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:37.989202] [INFO ] [MAIN ] HEQ: Generated 1820 derivative records from 6236 primary records. [2025-09-29T02:16:38.016758] [DEBUG] [LOCAL ] HEQ: Saving derivative data. [2025-09-29T02:16:38.091487] [DEBUG] [LOCAL ] HEQ: Derivative data saved (1820 records). [2025-09-29T02:16:38.126128] [INFO ] [MAIN ] HEQ: Successfully saved derivative data. [2025-09-29T02:16:38.136568] [INFO ] [MAIN ] Derivative Progress: 949/2211 symbols completed. HEQ took 1.1s. Estimated remaining: 8m 54s. Rate: 141.9 symbols/min [2025-09-29T02:16:38.262094] [INFO ] [MAIN ] HGER: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:38.288961] [DEBUG] [MAIN ] HFRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:38.289970] [INFO ] [MAIN ] HFRO: Generated 1820 derivative records from 17798 primary records. [2025-09-29T02:16:38.290268] [DEBUG] [LOCAL ] HFRO: Saving derivative data. [2025-09-29T02:16:38.310798] [DEBUG] [LOCAL ] HGER: Loaded 13428 existing records from primary storage. [2025-09-29T02:16:38.312144] [INFO ] [MAIN ] HGER: Loaded 13428 primary data records. [2025-09-29T02:16:38.349580] [DEBUG] [LOCAL ] HFRO: Derivative data saved (1820 records). [2025-09-29T02:16:38.355481] [INFO ] [MAIN ] HFRO: Successfully saved derivative data. [2025-09-29T02:16:38.371051] [INFO ] [MAIN ] Derivative Progress: 950/2211 symbols completed. HFRO took 1.1s. Estimated remaining: 8m 53s. Rate: 142.0 symbols/min [2025-09-29T02:16:38.401512] [INFO ] [MAIN ] HGLB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:38.506048] [DEBUG] [MAIN ] HESM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:38.543158] [INFO ] [MAIN ] HESM: Generated 1820 derivative records from 48879 primary records. [2025-09-29T02:16:38.543399] [DEBUG] [LOCAL ] HESM: Saving derivative data. [2025-09-29T02:16:38.683048] [DEBUG] [LOCAL ] HGLB: Loaded 9836 existing records from primary storage. [2025-09-29T02:16:38.684180] [INFO ] [MAIN ] HGLB: Loaded 9836 primary data records. [2025-09-29T02:16:38.738309] [DEBUG] [LOCAL ] HESM: Derivative data saved (1820 records). [2025-09-29T02:16:38.766173] [INFO ] [MAIN ] HESM: Successfully saved derivative data. [2025-09-29T02:16:38.792051] [INFO ] [MAIN ] Derivative Progress: 951/2211 symbols completed. HESM took 1.5s. Estimated remaining: 8m 52s. Rate: 142.0 symbols/min [2025-09-29T02:16:38.819840] [INFO ] [MAIN ] HGTY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:39.107241] [DEBUG] [LOCAL ] HGTY: Loaded 13290 existing records from primary storage. [2025-09-29T02:16:39.126189] [INFO ] [MAIN ] HGTY: Loaded 13290 primary data records. [2025-09-29T02:16:39.221717] [DEBUG] [MAIN ] HGER: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:39.247098] [INFO ] [MAIN ] HGER: Generated 1820 derivative records from 13428 primary records. [2025-09-29T02:16:39.269076] [DEBUG] [LOCAL ] HGER: Saving derivative data. [2025-09-29T02:16:39.497737] [DEBUG] [LOCAL ] HGER: Derivative data saved (1820 records). [2025-09-29T02:16:39.508158] [INFO ] [MAIN ] HGER: Successfully saved derivative data. [2025-09-29T02:16:39.510859] [INFO ] [MAIN ] Derivative Progress: 952/2211 symbols completed. HGER took 1.2s. Estimated remaining: 8m 52s. Rate: 141.9 symbols/min [2025-09-29T02:16:39.511384] [INFO ] [MAIN ] HGV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:39.535877] [DEBUG] [MAIN ] HGLB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:39.537597] [INFO ] [MAIN ] HGLB: Generated 1820 derivative records from 9836 primary records. [2025-09-29T02:16:39.538770] [DEBUG] [LOCAL ] HGLB: Saving derivative data. [2025-09-29T02:16:39.558460] [DEBUG] [LOCAL ] HGLB: Derivative data saved (1820 records). [2025-09-29T02:16:39.559128] [INFO ] [MAIN ] HGLB: Successfully saved derivative data. [2025-09-29T02:16:39.561910] [INFO ] [MAIN ] Derivative Progress: 953/2211 symbols completed. HGLB took 1.2s. Estimated remaining: 8m 51s. Rate: 142.0 symbols/min [2025-09-29T02:16:39.562824] [INFO ] [MAIN ] HHH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:39.592743] [DEBUG] [MAIN ] HGTY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:39.593701] [INFO ] [MAIN ] HGTY: Generated 1820 derivative records from 13290 primary records. [2025-09-29T02:16:39.593877] [DEBUG] [LOCAL ] HGTY: Saving derivative data. [2025-09-29T02:16:39.611911] [DEBUG] [LOCAL ] HGTY: Derivative data saved (1820 records). [2025-09-29T02:16:39.626031] [INFO ] [MAIN ] HGTY: Successfully saved derivative data. [2025-09-29T02:16:39.629076] [INFO ] [MAIN ] Derivative Progress: 954/2211 symbols completed. HGTY took 0.8s. Estimated remaining: 8m 51s. Rate: 142.1 symbols/min [2025-09-29T02:16:39.630266] [DEBUG] [LOCAL ] HGV: Loaded 47426 existing records from primary storage. [2025-09-29T02:16:39.630611] [INFO ] [MAIN ] HGV: Loaded 47426 primary data records. [2025-09-29T02:16:39.630863] [INFO ] [MAIN ] HI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:39.797051] [DEBUG] [LOCAL ] HHH: Loaded 33042 existing records from primary storage. [2025-09-29T02:16:39.807741] [INFO ] [MAIN ] HHH: Loaded 33042 primary data records. [2025-09-29T02:16:40.090987] [DEBUG] [LOCAL ] HI: Loaded 35713 existing records from primary storage. [2025-09-29T02:16:40.115779] [INFO ] [MAIN ] HI: Loaded 35713 primary data records. [2025-09-29T02:16:40.703281] [DEBUG] [MAIN ] HGV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:40.705275] [INFO ] [MAIN ] HGV: Generated 1820 derivative records from 47426 primary records. [2025-09-29T02:16:40.706086] [DEBUG] [LOCAL ] HGV: Saving derivative data. [2025-09-29T02:16:40.734469] [DEBUG] [LOCAL ] HGV: Derivative data saved (1820 records). [2025-09-29T02:16:40.735076] [INFO ] [MAIN ] HGV: Successfully saved derivative data. [2025-09-29T02:16:40.739601] [INFO ] [MAIN ] Derivative Progress: 955/2211 symbols completed. HGV took 1.2s. Estimated remaining: 8m 51s. Rate: 141.9 symbols/min [2025-09-29T02:16:40.740057] [INFO ] [MAIN ] HIG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:40.758900] [DEBUG] [MAIN ] HHH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:40.760596] [INFO ] [MAIN ] HHH: Generated 1820 derivative records from 33042 primary records. [2025-09-29T02:16:40.761533] [DEBUG] [LOCAL ] HHH: Saving derivative data. [2025-09-29T02:16:40.793220] [DEBUG] [MAIN ] HI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:40.796064] [INFO ] [MAIN ] HI: Generated 1820 derivative records from 35713 primary records. [2025-09-29T02:16:40.798638] [DEBUG] [LOCAL ] HHH: Derivative data saved (1820 records). [2025-09-29T02:16:40.797989] [DEBUG] [LOCAL ] HI: Saving derivative data. [2025-09-29T02:16:40.799118] [INFO ] [MAIN ] HHH: Successfully saved derivative data. [2025-09-29T02:16:40.803618] [INFO ] [MAIN ] Derivative Progress: 956/2211 symbols completed. HHH took 1.2s. Estimated remaining: 8m 50s. Rate: 142.0 symbols/min [2025-09-29T02:16:40.803932] [INFO ] [MAIN ] HII: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:40.823812] [DEBUG] [LOCAL ] HI: Derivative data saved (1820 records). [2025-09-29T02:16:40.824260] [INFO ] [MAIN ] HI: Successfully saved derivative data. [2025-09-29T02:16:40.827704] [INFO ] [MAIN ] Derivative Progress: 957/2211 symbols completed. HI took 1.2s. Estimated remaining: 8m 49s. Rate: 142.2 symbols/min [2025-09-29T02:16:40.827971] [INFO ] [MAIN ] HIMS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:40.893796] [DEBUG] [LOCAL ] HII: Loaded 35728 existing records from primary storage. [2025-09-29T02:16:40.894398] [INFO ] [MAIN ] HII: Loaded 35728 primary data records. [2025-09-29T02:16:40.901319] [DEBUG] [LOCAL ] HIG: Loaded 51962 existing records from primary storage. [2025-09-29T02:16:40.922234] [INFO ] [MAIN ] HIG: Loaded 51962 primary data records. [2025-09-29T02:16:41.327630] [DEBUG] [LOCAL ] HIMS: Loaded 54597 existing records from primary storage. [2025-09-29T02:16:41.448503] [INFO ] [MAIN ] HIMS: Loaded 54597 primary data records. [2025-09-29T02:16:42.024000] [DEBUG] [MAIN ] HIG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:42.024504] [DEBUG] [MAIN ] HII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:42.025551] [INFO ] [MAIN ] HIG: Generated 1820 derivative records from 51962 primary records. [2025-09-29T02:16:42.026409] [INFO ] [MAIN ] HII: Generated 1820 derivative records from 35728 primary records. [2025-09-29T02:16:42.026665] [DEBUG] [LOCAL ] HIG: Saving derivative data. [2025-09-29T02:16:42.027156] [DEBUG] [LOCAL ] HII: Saving derivative data. [2025-09-29T02:16:42.054839] [DEBUG] [LOCAL ] HIG: Derivative data saved (1820 records). [2025-09-29T02:16:42.062338] [DEBUG] [LOCAL ] HII: Derivative data saved (1820 records). [2025-09-29T02:16:42.062804] [INFO ] [MAIN ] HIG: Successfully saved derivative data. [2025-09-29T02:16:42.066189] [INFO ] [MAIN ] Derivative Progress: 958/2211 symbols completed. HIG took 1.3s. Estimated remaining: 8m 50s. Rate: 141.9 symbols/min [2025-09-29T02:16:42.066688] [INFO ] [MAIN ] HII: Successfully saved derivative data. [2025-09-29T02:16:42.069543] [INFO ] [MAIN ] Derivative Progress: 959/2211 symbols completed. HII took 1.3s. Estimated remaining: 8m 49s. Rate: 142.0 symbols/min [2025-09-29T02:16:42.086607] [DEBUG] [MAIN ] HIMS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:42.087595] [INFO ] [MAIN ] HIMS: Generated 1820 derivative records from 54597 primary records. [2025-09-29T02:16:42.087770] [DEBUG] [LOCAL ] HIMS: Saving derivative data. [2025-09-29T02:16:42.104249] [DEBUG] [LOCAL ] HIMS: Derivative data saved (1820 records). [2025-09-29T02:16:42.104412] [INFO ] [MAIN ] HIMS: Successfully saved derivative data. [2025-09-29T02:16:42.107688] [INFO ] [MAIN ] Derivative Progress: 960/2211 symbols completed. HIMS took 1.3s. Estimated remaining: 8m 48s. Rate: 142.2 symbols/min [2025-09-29T02:16:42.108158] [INFO ] [MAIN ] HIO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:42.108343] [INFO ] [MAIN ] HIPO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:42.108207] [INFO ] [MAIN ] HIW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:42.146574] [DEBUG] [LOCAL ] HIO: Loaded 24107 existing records from primary storage. [2025-09-29T02:16:42.146866] [INFO ] [MAIN ] HIO: Loaded 24107 primary data records. [2025-09-29T02:16:42.257340] [DEBUG] [LOCAL ] HIPO: Loaded 22774 existing records from primary storage. [2025-09-29T02:16:42.278618] [INFO ] [MAIN ] HIPO: Loaded 22774 primary data records. [2025-09-29T02:16:42.379251] [DEBUG] [LOCAL ] HIW: Loaded 45329 existing records from primary storage. [2025-09-29T02:16:42.495103] [INFO ] [MAIN ] HIW: Loaded 45329 primary data records. [2025-09-29T02:16:43.370687] [DEBUG] [MAIN ] HIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:43.372998] [INFO ] [MAIN ] HIO: Generated 1820 derivative records from 24107 primary records. [2025-09-29T02:16:43.373955] [DEBUG] [LOCAL ] HIO: Saving derivative data. [2025-09-29T02:16:43.388607] [DEBUG] [MAIN ] HIPO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:43.401446] [INFO ] [MAIN ] HIPO: Generated 1820 derivative records from 22774 primary records. [2025-09-29T02:16:43.405394] [DEBUG] [LOCAL ] HIPO: Saving derivative data. [2025-09-29T02:16:43.407232] [DEBUG] [LOCAL ] HIO: Derivative data saved (1820 records). [2025-09-29T02:16:43.407599] [INFO ] [MAIN ] HIO: Successfully saved derivative data. [2025-09-29T02:16:43.412029] [INFO ] [MAIN ] Derivative Progress: 961/2211 symbols completed. HIO took 1.3s. Estimated remaining: 8m 49s. Rate: 141.9 symbols/min [2025-09-29T02:16:43.412625] [INFO ] [MAIN ] HIX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:43.431169] [DEBUG] [LOCAL ] HIPO: Derivative data saved (1820 records). [2025-09-29T02:16:43.431614] [INFO ] [MAIN ] HIPO: Successfully saved derivative data. [2025-09-29T02:16:43.435836] [INFO ] [MAIN ] Derivative Progress: 962/2211 symbols completed. HIPO took 1.3s. Estimated remaining: 8m 48s. Rate: 142.0 symbols/min [2025-09-29T02:16:43.436384] [INFO ] [MAIN ] HKD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:43.460887] [DEBUG] [MAIN ] HIW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:43.463106] [INFO ] [MAIN ] HIW: Generated 1820 derivative records from 45329 primary records. [2025-09-29T02:16:43.463319] [DEBUG] [LOCAL ] HIW: Saving derivative data. [2025-09-29T02:16:43.490153] [DEBUG] [LOCAL ] HIW: Derivative data saved (1820 records). [2025-09-29T02:16:43.490327] [INFO ] [MAIN ] HIW: Successfully saved derivative data. [2025-09-29T02:16:43.494196] [INFO ] [MAIN ] Derivative Progress: 963/2211 symbols completed. HIW took 1.4s. Estimated remaining: 8m 47s. Rate: 142.1 symbols/min [2025-09-29T02:16:43.494441] [INFO ] [MAIN ] HL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:43.513061] [DEBUG] [LOCAL ] HIX: Loaded 20714 existing records from primary storage. [2025-09-29T02:16:43.513677] [DEBUG] [LOCAL ] HKD: Loaded 18654 existing records from primary storage. [2025-09-29T02:16:43.514060] [INFO ] [MAIN ] HIX: Loaded 20714 primary data records. [2025-09-29T02:16:43.514281] [INFO ] [MAIN ] HKD: Loaded 18654 primary data records. [2025-09-29T02:16:44.086268] [DEBUG] [LOCAL ] HL: Loaded 54451 existing records from primary storage. [2025-09-29T02:16:44.093513] [INFO ] [MAIN ] HL: Loaded 54451 primary data records. [2025-09-29T02:16:44.610392] [DEBUG] [MAIN ] HIX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:44.613596] [INFO ] [MAIN ] HIX: Generated 1820 derivative records from 20714 primary records. [2025-09-29T02:16:44.613887] [DEBUG] [LOCAL ] HIX: Saving derivative data. [2025-09-29T02:16:44.643052] [DEBUG] [MAIN ] HKD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:44.646740] [DEBUG] [LOCAL ] HIX: Derivative data saved (1820 records). [2025-09-29T02:16:44.647811] [INFO ] [MAIN ] HKD: Generated 1820 derivative records from 18654 primary records. [2025-09-29T02:16:44.646950] [INFO ] [MAIN ] HIX: Successfully saved derivative data. [2025-09-29T02:16:44.651767] [INFO ] [MAIN ] Derivative Progress: 964/2211 symbols completed. HIX took 1.2s. Estimated remaining: 8m 47s. Rate: 141.9 symbols/min [2025-09-29T02:16:44.653266] [INFO ] [MAIN ] HLF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:44.653112] [DEBUG] [LOCAL ] HKD: Saving derivative data. [2025-09-29T02:16:44.672543] [DEBUG] [LOCAL ] HKD: Derivative data saved (1820 records). [2025-09-29T02:16:44.673722] [INFO ] [MAIN ] HKD: Successfully saved derivative data. [2025-09-29T02:16:44.677585] [INFO ] [MAIN ] Derivative Progress: 965/2211 symbols completed. HKD took 1.2s. Estimated remaining: 8m 46s. Rate: 142.0 symbols/min [2025-09-29T02:16:44.678109] [INFO ] [MAIN ] HLI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:44.698314] [DEBUG] [MAIN ] HL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:44.699198] [INFO ] [MAIN ] HL: Generated 1820 derivative records from 54451 primary records. [2025-09-29T02:16:44.699475] [DEBUG] [LOCAL ] HL: Saving derivative data. [2025-09-29T02:16:44.718602] [DEBUG] [LOCAL ] HL: Derivative data saved (1820 records). [2025-09-29T02:16:44.718828] [INFO ] [MAIN ] HL: Successfully saved derivative data. [2025-09-29T02:16:44.723560] [INFO ] [MAIN ] Derivative Progress: 966/2211 symbols completed. HL took 1.2s. Estimated remaining: 8m 46s. Rate: 142.1 symbols/min [2025-09-29T02:16:44.736272] [INFO ] [MAIN ] HLIO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:44.769890] [DEBUG] [LOCAL ] HLF: Loaded 49357 existing records from primary storage. [2025-09-29T02:16:44.770443] [INFO ] [MAIN ] HLF: Loaded 49357 primary data records. [2025-09-29T02:16:44.917042] [DEBUG] [LOCAL ] HLI: Loaded 31573 existing records from primary storage. [2025-09-29T02:16:44.918435] [INFO ] [MAIN ] HLI: Loaded 31573 primary data records. [2025-09-29T02:16:44.918231] [DEBUG] [LOCAL ] HLIO: Loaded 28490 existing records from primary storage. [2025-09-29T02:16:44.979932] [INFO ] [MAIN ] HLIO: Loaded 28490 primary data records. [2025-09-29T02:16:45.953780] [DEBUG] [MAIN ] HLF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:45.955074] [INFO ] [MAIN ] HLF: Generated 1820 derivative records from 49357 primary records. [2025-09-29T02:16:45.956949] [DEBUG] [LOCAL ] HLF: Saving derivative data. [2025-09-29T02:16:45.984922] [DEBUG] [LOCAL ] HLF: Derivative data saved (1820 records). [2025-09-29T02:16:45.985194] [INFO ] [MAIN ] HLF: Successfully saved derivative data. [2025-09-29T02:16:45.988955] [INFO ] [MAIN ] Derivative Progress: 967/2211 symbols completed. HLF took 1.3s. Estimated remaining: 8m 46s. Rate: 141.8 symbols/min [2025-09-29T02:16:45.990078] [INFO ] [MAIN ] HLLY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:46.039393] [DEBUG] [MAIN ] HLIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:46.042493] [INFO ] [MAIN ] HLIO: Generated 1820 derivative records from 28490 primary records. [2025-09-29T02:16:46.043290] [DEBUG] [LOCAL ] HLIO: Saving derivative data. [2025-09-29T02:16:46.043854] [DEBUG] [MAIN ] HLI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:46.046364] [INFO ] [MAIN ] HLI: Generated 1820 derivative records from 31573 primary records. [2025-09-29T02:16:46.056984] [DEBUG] [LOCAL ] HLI: Saving derivative data. [2025-09-29T02:16:46.078317] [DEBUG] [LOCAL ] HLIO: Derivative data saved (1820 records). [2025-09-29T02:16:46.091735] [INFO ] [MAIN ] HLIO: Successfully saved derivative data. [2025-09-29T02:16:46.104711] [INFO ] [MAIN ] Derivative Progress: 968/2211 symbols completed. HLIO took 1.4s. Estimated remaining: 8m 45s. Rate: 141.9 symbols/min [2025-09-29T02:16:46.110789] [INFO ] [MAIN ] HLN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:46.123147] [DEBUG] [LOCAL ] HLI: Derivative data saved (1820 records). [2025-09-29T02:16:46.125081] [INFO ] [MAIN ] HLI: Successfully saved derivative data. [2025-09-29T02:16:46.124977] [DEBUG] [LOCAL ] HLLY: Loaded 33911 existing records from primary storage. [2025-09-29T02:16:46.130325] [INFO ] [MAIN ] Derivative Progress: 969/2211 symbols completed. HLI took 1.5s. Estimated remaining: 8m 44s. Rate: 142.1 symbols/min [2025-09-29T02:16:46.130822] [INFO ] [MAIN ] HLLY: Loaded 33911 primary data records. [2025-09-29T02:16:46.130980] [INFO ] [MAIN ] HLT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:46.481528] [DEBUG] [LOCAL ] HLN: Loaded 53861 existing records from primary storage. [2025-09-29T02:16:46.557724] [DEBUG] [LOCAL ] HLT: Loaded 51450 existing records from primary storage. [2025-09-29T02:16:46.551951] [INFO ] [MAIN ] HLN: Loaded 53861 primary data records. [2025-09-29T02:16:46.749585] [INFO ] [MAIN ] HLT: Loaded 51450 primary data records. [2025-09-29T02:16:47.565841] [DEBUG] [MAIN ] HLLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:47.568907] [INFO ] [MAIN ] HLLY: Generated 1820 derivative records from 33911 primary records. [2025-09-29T02:16:47.569529] [DEBUG] [LOCAL ] HLLY: Saving derivative data. [2025-09-29T02:16:47.591472] [DEBUG] [LOCAL ] HLLY: Derivative data saved (1820 records). [2025-09-29T02:16:47.592591] [INFO ] [MAIN ] HLLY: Successfully saved derivative data. [2025-09-29T02:16:47.595477] [INFO ] [MAIN ] Derivative Progress: 970/2211 symbols completed. HLLY took 1.6s. Estimated remaining: 8m 45s. Rate: 141.7 symbols/min [2025-09-29T02:16:47.596067] [INFO ] [MAIN ] HLX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:47.633978] [DEBUG] [MAIN ] HLN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:47.635180] [DEBUG] [MAIN ] HLT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:47.635965] [INFO ] [MAIN ] HLN: Generated 1820 derivative records from 53861 primary records. [2025-09-29T02:16:47.636772] [INFO ] [MAIN ] HLT: Generated 1820 derivative records from 51450 primary records. [2025-09-29T02:16:47.637077] [DEBUG] [LOCAL ] HLT: Saving derivative data. [2025-09-29T02:16:47.636962] [DEBUG] [LOCAL ] HLN: Saving derivative data. [2025-09-29T02:16:47.669614] [DEBUG] [LOCAL ] HLT: Derivative data saved (1820 records). [2025-09-29T02:16:47.670967] [INFO ] [MAIN ] HLT: Successfully saved derivative data. [2025-09-29T02:16:47.678137] [INFO ] [MAIN ] Derivative Progress: 971/2211 symbols completed. HLT took 1.5s. Estimated remaining: 8m 45s. Rate: 141.8 symbols/min [2025-09-29T02:16:47.678852] [INFO ] [MAIN ] HMC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:47.680575] [DEBUG] [LOCAL ] HLN: Derivative data saved (1820 records). [2025-09-29T02:16:47.692986] [INFO ] [MAIN ] HLN: Successfully saved derivative data. [2025-09-29T02:16:47.696779] [INFO ] [MAIN ] Derivative Progress: 972/2211 symbols completed. HLN took 1.6s. Estimated remaining: 8m 44s. Rate: 142.0 symbols/min [2025-09-29T02:16:47.697081] [INFO ] [MAIN ] HMN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:47.723687] [DEBUG] [LOCAL ] HLX: Loaded 48650 existing records from primary storage. [2025-09-29T02:16:47.724122] [INFO ] [MAIN ] HLX: Loaded 48650 primary data records. [2025-09-29T02:16:47.873629] [DEBUG] [LOCAL ] HMN: Loaded 23671 existing records from primary storage. [2025-09-29T02:16:47.889530] [INFO ] [MAIN ] HMN: Loaded 23671 primary data records. [2025-09-29T02:16:48.183936] [DEBUG] [LOCAL ] HMC: Loaded 47500 existing records from primary storage. [2025-09-29T02:16:48.221056] [INFO ] [MAIN ] HMC: Loaded 47500 primary data records. [2025-09-29T02:16:48.840307] [DEBUG] [MAIN ] HLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:48.842567] [INFO ] [MAIN ] HLX: Generated 1820 derivative records from 48650 primary records. [2025-09-29T02:16:48.842776] [DEBUG] [LOCAL ] HLX: Saving derivative data. [2025-09-29T02:16:48.864195] [DEBUG] [LOCAL ] HLX: Derivative data saved (1820 records). [2025-09-29T02:16:48.864952] [INFO ] [MAIN ] HLX: Successfully saved derivative data. [2025-09-29T02:16:48.868829] [INFO ] [MAIN ] Derivative Progress: 973/2211 symbols completed. HLX took 1.3s. Estimated remaining: 8m 44s. Rate: 141.7 symbols/min [2025-09-29T02:16:48.886460] [DEBUG] [MAIN ] HMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:48.887497] [INFO ] [MAIN ] HMN: Generated 1820 derivative records from 23671 primary records. [2025-09-29T02:16:48.887756] [DEBUG] [LOCAL ] HMN: Saving derivative data. [2025-09-29T02:16:48.907564] [DEBUG] [LOCAL ] HMN: Derivative data saved (1820 records). [2025-09-29T02:16:48.907792] [INFO ] [MAIN ] HMN: Successfully saved derivative data. [2025-09-29T02:16:48.911508] [INFO ] [MAIN ] Derivative Progress: 974/2211 symbols completed. HMN took 1.2s. Estimated remaining: 8m 43s. Rate: 141.9 symbols/min [2025-09-29T02:16:48.924896] [DEBUG] [MAIN ] HMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:48.925610] [INFO ] [MAIN ] HMC: Generated 1820 derivative records from 47500 primary records. [2025-09-29T02:16:48.925714] [DEBUG] [LOCAL ] HMC: Saving derivative data. [2025-09-29T02:16:48.941960] [DEBUG] [LOCAL ] HMC: Derivative data saved (1820 records). [2025-09-29T02:16:48.942111] [INFO ] [MAIN ] HMC: Successfully saved derivative data. [2025-09-29T02:16:48.945216] [INFO ] [MAIN ] Derivative Progress: 975/2211 symbols completed. HMC took 1.3s. Estimated remaining: 8m 42s. Rate: 142.0 symbols/min [2025-09-29T02:16:48.945857] [INFO ] [MAIN ] HOG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:48.946100] [INFO ] [MAIN ] HMY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:48.945985] [INFO ] [MAIN ] HNI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:48.986094] [DEBUG] [LOCAL ] HNI: Loaded 29386 existing records from primary storage. [2025-09-29T02:16:48.986342] [INFO ] [MAIN ] HNI: Loaded 29386 primary data records. [2025-09-29T02:16:49.165283] [DEBUG] [LOCAL ] HOG: Loaded 51958 existing records from primary storage. [2025-09-29T02:16:49.199934] [INFO ] [MAIN ] HOG: Loaded 51958 primary data records. [2025-09-29T02:16:49.424163] [DEBUG] [LOCAL ] HMY: Loaded 53914 existing records from primary storage. [2025-09-29T02:16:49.457102] [INFO ] [MAIN ] HMY: Loaded 53914 primary data records. [2025-09-29T02:16:50.112716] [DEBUG] [MAIN ] HNI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:50.113625] [INFO ] [MAIN ] HNI: Generated 1820 derivative records from 29386 primary records. [2025-09-29T02:16:50.114227] [DEBUG] [LOCAL ] HNI: Saving derivative data. [2025-09-29T02:16:50.134542] [DEBUG] [LOCAL ] HNI: Derivative data saved (1820 records). [2025-09-29T02:16:50.136370] [INFO ] [MAIN ] HNI: Successfully saved derivative data. [2025-09-29T02:16:50.140593] [INFO ] [MAIN ] Derivative Progress: 976/2211 symbols completed. HNI took 1.2s. Estimated remaining: 8m 43s. Rate: 141.7 symbols/min [2025-09-29T02:16:50.141199] [INFO ] [MAIN ] HOMB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:50.161508] [DEBUG] [MAIN ] HOG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:50.163062] [INFO ] [MAIN ] HOG: Generated 1820 derivative records from 51958 primary records. [2025-09-29T02:16:50.164177] [DEBUG] [LOCAL ] HOG: Saving derivative data. [2025-09-29T02:16:50.186185] [DEBUG] [LOCAL ] HOG: Derivative data saved (1820 records). [2025-09-29T02:16:50.195062] [INFO ] [MAIN ] HOG: Successfully saved derivative data. [2025-09-29T02:16:50.203155] [INFO ] [MAIN ] Derivative Progress: 977/2211 symbols completed. HOG took 1.3s. Estimated remaining: 8m 42s. Rate: 141.8 symbols/min [2025-09-29T02:16:50.204435] [DEBUG] [MAIN ] HMY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:50.204552] [INFO ] [MAIN ] HOUS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:50.206600] [INFO ] [MAIN ] HMY: Generated 1820 derivative records from 53914 primary records. [2025-09-29T02:16:50.206782] [DEBUG] [LOCAL ] HMY: Saving derivative data. [2025-09-29T02:16:50.234860] [DEBUG] [LOCAL ] HMY: Derivative data saved (1820 records). [2025-09-29T02:16:50.235203] [INFO ] [MAIN ] HMY: Successfully saved derivative data. [2025-09-29T02:16:50.239532] [INFO ] [MAIN ] Derivative Progress: 978/2211 symbols completed. HMY took 1.3s. Estimated remaining: 8m 41s. Rate: 142.0 symbols/min [2025-09-29T02:16:50.239908] [INFO ] [MAIN ] HOV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:50.263006] [DEBUG] [LOCAL ] HOMB: Loaded 44272 existing records from primary storage. [2025-09-29T02:16:50.267561] [INFO ] [MAIN ] HOMB: Loaded 44272 primary data records. [2025-09-29T02:16:50.373496] [DEBUG] [LOCAL ] HOV: Loaded 13975 existing records from primary storage. [2025-09-29T02:16:50.402426] [INFO ] [MAIN ] HOV: Loaded 13975 primary data records. [2025-09-29T02:16:50.469722] [DEBUG] [LOCAL ] HOUS: Loaded 44903 existing records from primary storage. [2025-09-29T02:16:50.526033] [INFO ] [MAIN ] HOUS: Loaded 44903 primary data records. [2025-09-29T02:16:51.375962] [DEBUG] [MAIN ] HOMB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:51.389448] [DEBUG] [MAIN ] HOV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:51.390453] [INFO ] [MAIN ] HOMB: Generated 1820 derivative records from 44272 primary records. [2025-09-29T02:16:51.392683] [INFO ] [MAIN ] HOV: Generated 1820 derivative records from 13975 primary records. [2025-09-29T02:16:51.391843] [DEBUG] [LOCAL ] HOMB: Saving derivative data. [2025-09-29T02:16:51.392805] [DEBUG] [LOCAL ] HOV: Saving derivative data. [2025-09-29T02:16:51.426750] [DEBUG] [LOCAL ] HOMB: Derivative data saved (1820 records). [2025-09-29T02:16:51.426842] [DEBUG] [LOCAL ] HOV: Derivative data saved (1820 records). [2025-09-29T02:16:51.427166] [INFO ] [MAIN ] HOMB: Successfully saved derivative data. [2025-09-29T02:16:51.431320] [INFO ] [MAIN ] Derivative Progress: 979/2211 symbols completed. HOMB took 1.3s. Estimated remaining: 8m 42s. Rate: 141.7 symbols/min [2025-09-29T02:16:51.427336] [INFO ] [MAIN ] HOV: Successfully saved derivative data. [2025-09-29T02:16:51.434717] [INFO ] [MAIN ] HP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:51.434781] [INFO ] [MAIN ] Derivative Progress: 980/2211 symbols completed. HOV took 1.2s. Estimated remaining: 8m 41s. Rate: 141.9 symbols/min [2025-09-29T02:16:51.435342] [INFO ] [MAIN ] HPE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:51.453920] [DEBUG] [MAIN ] HOUS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:51.455099] [INFO ] [MAIN ] HOUS: Generated 1820 derivative records from 44903 primary records. [2025-09-29T02:16:51.455332] [DEBUG] [LOCAL ] HOUS: Saving derivative data. [2025-09-29T02:16:51.478216] [DEBUG] [LOCAL ] HOUS: Derivative data saved (1820 records). [2025-09-29T02:16:51.478400] [INFO ] [MAIN ] HOUS: Successfully saved derivative data. [2025-09-29T02:16:51.482291] [INFO ] [MAIN ] Derivative Progress: 981/2211 symbols completed. HOUS took 1.3s. Estimated remaining: 8m 40s. Rate: 142.0 symbols/min [2025-09-29T02:16:51.482707] [INFO ] [MAIN ] HPF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:51.510639] [DEBUG] [LOCAL ] HPF: Loaded 7388 existing records from primary storage. [2025-09-29T02:16:51.510961] [INFO ] [MAIN ] HPF: Loaded 7388 primary data records. [2025-09-29T02:16:51.692624] [DEBUG] [LOCAL ] HP: Loaded 52313 existing records from primary storage. [2025-09-29T02:16:51.703467] [INFO ] [MAIN ] HP: Loaded 52313 primary data records. [2025-09-29T02:16:51.715198] [DEBUG] [LOCAL ] HPE: Loaded 54477 existing records from primary storage. [2025-09-29T02:16:51.785394] [INFO ] [MAIN ] HPE: Loaded 54477 primary data records. [2025-09-29T02:16:52.666093] [DEBUG] [MAIN ] HPF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:52.668373] [INFO ] [MAIN ] HPF: Generated 1820 derivative records from 7388 primary records. [2025-09-29T02:16:52.668630] [DEBUG] [LOCAL ] HPF: Saving derivative data. [2025-09-29T02:16:52.687451] [DEBUG] [LOCAL ] HPF: Derivative data saved (1820 records). [2025-09-29T02:16:52.688348] [INFO ] [MAIN ] HPF: Successfully saved derivative data. [2025-09-29T02:16:52.690546] [INFO ] [MAIN ] Derivative Progress: 982/2211 symbols completed. HPF took 1.2s. Estimated remaining: 8m 40s. Rate: 141.7 symbols/min [2025-09-29T02:16:52.691162] [INFO ] [MAIN ] HPI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:52.709326] [DEBUG] [MAIN ] HP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:52.710810] [INFO ] [MAIN ] HP: Generated 1820 derivative records from 52313 primary records. [2025-09-29T02:16:52.711169] [DEBUG] [LOCAL ] HP: Saving derivative data. [2025-09-29T02:16:52.736873] [DEBUG] [LOCAL ] HPI: Loaded 10339 existing records from primary storage. [2025-09-29T02:16:52.752830] [INFO ] [MAIN ] HPI: Loaded 10339 primary data records. [2025-09-29T02:16:52.755153] [DEBUG] [MAIN ] HPE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:52.756116] [INFO ] [MAIN ] HPE: Generated 1820 derivative records from 54477 primary records. [2025-09-29T02:16:52.761659] [DEBUG] [LOCAL ] HPE: Saving derivative data. [2025-09-29T02:16:52.768971] [DEBUG] [LOCAL ] HP: Derivative data saved (1820 records). [2025-09-29T02:16:52.769085] [INFO ] [MAIN ] HP: Successfully saved derivative data. [2025-09-29T02:16:52.788954] [INFO ] [MAIN ] Derivative Progress: 983/2211 symbols completed. HP took 1.4s. Estimated remaining: 8m 39s. Rate: 141.8 symbols/min [2025-09-29T02:16:52.818170] [INFO ] [MAIN ] HPP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:52.897672] [DEBUG] [LOCAL ] HPE: Derivative data saved (1820 records). [2025-09-29T02:16:52.951211] [INFO ] [MAIN ] HPE: Successfully saved derivative data. [2025-09-29T02:16:52.991483] [INFO ] [MAIN ] Derivative Progress: 984/2211 symbols completed. HPE took 1.6s. Estimated remaining: 8m 39s. Rate: 141.9 symbols/min [2025-09-29T02:16:53.114840] [INFO ] [MAIN ] HPQ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:53.159275] [DEBUG] [LOCAL ] HPP: Loaded 51595 existing records from primary storage. [2025-09-29T02:16:53.159673] [INFO ] [MAIN ] HPP: Loaded 51595 primary data records. [2025-09-29T02:16:53.359602] [DEBUG] [MAIN ] HPI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:53.509489] [INFO ] [MAIN ] HPI: Generated 1820 derivative records from 10339 primary records. [2025-09-29T02:16:53.521601] [DEBUG] [LOCAL ] HPI: Saving derivative data. [2025-09-29T02:16:53.555685] [DEBUG] [LOCAL ] HPQ: Loaded 54448 existing records from primary storage. [2025-09-29T02:16:53.556602] [INFO ] [MAIN ] HPQ: Loaded 54448 primary data records. [2025-09-29T02:16:53.603609] [DEBUG] [LOCAL ] HPI: Derivative data saved (1820 records). [2025-09-29T02:16:53.618675] [INFO ] [MAIN ] HPI: Successfully saved derivative data. [2025-09-29T02:16:53.681859] [INFO ] [MAIN ] Derivative Progress: 985/2211 symbols completed. HPI took 1.0s. Estimated remaining: 8m 39s. Rate: 141.8 symbols/min [2025-09-29T02:16:53.687010] [INFO ] [MAIN ] HPS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:53.905127] [DEBUG] [LOCAL ] HPS: Loaded 10277 existing records from primary storage. [2025-09-29T02:16:53.916394] [INFO ] [MAIN ] HPS: Loaded 10277 primary data records. [2025-09-29T02:16:54.009100] [DEBUG] [MAIN ] HPP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:54.035255] [INFO ] [MAIN ] HPP: Generated 1820 derivative records from 51595 primary records. [2025-09-29T02:16:54.055922] [DEBUG] [LOCAL ] HPP: Saving derivative data. [2025-09-29T02:16:54.287199] [DEBUG] [LOCAL ] HPP: Derivative data saved (1820 records). [2025-09-29T02:16:54.289003] [INFO ] [MAIN ] HPP: Successfully saved derivative data. [2025-09-29T02:16:54.292307] [INFO ] [MAIN ] Derivative Progress: 986/2211 symbols completed. HPP took 1.5s. Estimated remaining: 8m 39s. Rate: 141.8 symbols/min [2025-09-29T02:16:54.293038] [INFO ] [MAIN ] HQH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:54.314437] [DEBUG] [MAIN ] HPQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:54.315327] [INFO ] [MAIN ] HPQ: Generated 1820 derivative records from 54448 primary records. [2025-09-29T02:16:54.315527] [DEBUG] [LOCAL ] HPQ: Saving derivative data. [2025-09-29T02:16:54.342688] [DEBUG] [LOCAL ] HPQ: Derivative data saved (1820 records). [2025-09-29T02:16:54.343147] [INFO ] [MAIN ] HPQ: Successfully saved derivative data. [2025-09-29T02:16:54.346037] [INFO ] [MAIN ] Derivative Progress: 987/2211 symbols completed. HPQ took 1.2s. Estimated remaining: 8m 38s. Rate: 141.9 symbols/min [2025-09-29T02:16:54.346738] [INFO ] [MAIN ] HQL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:54.375028] [DEBUG] [LOCAL ] HQH: Loaded 25387 existing records from primary storage. [2025-09-29T02:16:54.375463] [DEBUG] [MAIN ] HPS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:54.375728] [INFO ] [MAIN ] HQH: Loaded 25387 primary data records. [2025-09-29T02:16:54.376417] [INFO ] [MAIN ] HPS: Generated 1820 derivative records from 10277 primary records. [2025-09-29T02:16:54.376699] [DEBUG] [LOCAL ] HPS: Saving derivative data. [2025-09-29T02:16:54.520827] [DEBUG] [LOCAL ] HQL: Loaded 16206 existing records from primary storage. [2025-09-29T02:16:54.521444] [DEBUG] [LOCAL ] HPS: Derivative data saved (1820 records). [2025-09-29T02:16:54.526849] [INFO ] [MAIN ] HQL: Loaded 16206 primary data records. [2025-09-29T02:16:54.526975] [INFO ] [MAIN ] HPS: Successfully saved derivative data. [2025-09-29T02:16:54.540695] [INFO ] [MAIN ] Derivative Progress: 988/2211 symbols completed. HPS took 0.9s. Estimated remaining: 8m 37s. Rate: 142.0 symbols/min [2025-09-29T02:16:55.143852] [DEBUG] [MAIN ] HQH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:55.144662] [INFO ] [MAIN ] HQH: Generated 1820 derivative records from 25387 primary records. [2025-09-29T02:16:55.144901] [DEBUG] [LOCAL ] HQH: Saving derivative data. [2025-09-29T02:16:55.162693] [DEBUG] [LOCAL ] HQH: Derivative data saved (1820 records). [2025-09-29T02:16:55.162879] [INFO ] [MAIN ] HQH: Successfully saved derivative data. [2025-09-29T02:16:55.165465] [INFO ] [MAIN ] Derivative Progress: 989/2211 symbols completed. HQH took 0.9s. Estimated remaining: 8m 37s. Rate: 141.9 symbols/min [2025-09-29T02:16:55.182158] [DEBUG] [MAIN ] HQL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:55.182980] [INFO ] [MAIN ] HQL: Generated 1820 derivative records from 16206 primary records. [2025-09-29T02:16:55.183087] [DEBUG] [LOCAL ] HQL: Saving derivative data. [2025-09-29T02:16:55.199183] [DEBUG] [LOCAL ] HQL: Derivative data saved (1820 records). [2025-09-29T02:16:55.199325] [INFO ] [MAIN ] HQL: Successfully saved derivative data. [2025-09-29T02:16:55.202195] [INFO ] [MAIN ] Derivative Progress: 990/2211 symbols completed. HQL took 0.9s. Estimated remaining: 8m 36s. Rate: 142.0 symbols/min [2025-09-29T02:16:55.202632] [INFO ] [MAIN ] HR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:55.202748] [INFO ] [MAIN ] HRI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:55.202890] [INFO ] [MAIN ] HRB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:55.286536] [DEBUG] [LOCAL ] HRI: Loaded 33507 existing records from primary storage. [2025-09-29T02:16:55.287078] [INFO ] [MAIN ] HRI: Loaded 33507 primary data records. [2025-09-29T02:16:55.455323] [DEBUG] [LOCAL ] HR: Loaded 52716 existing records from primary storage. [2025-09-29T02:16:55.460839] [INFO ] [MAIN ] HR: Loaded 52716 primary data records. [2025-09-29T02:16:55.491591] [DEBUG] [LOCAL ] HRB: Loaded 49275 existing records from primary storage. [2025-09-29T02:16:55.585821] [INFO ] [MAIN ] HRB: Loaded 49275 primary data records. [2025-09-29T02:16:56.403797] [DEBUG] [MAIN ] HRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:56.405151] [INFO ] [MAIN ] HRI: Generated 1820 derivative records from 33507 primary records. [2025-09-29T02:16:56.405404] [DEBUG] [LOCAL ] HRI: Saving derivative data. [2025-09-29T02:16:56.424077] [DEBUG] [LOCAL ] HRI: Derivative data saved (1820 records). [2025-09-29T02:16:56.424924] [INFO ] [MAIN ] HRI: Successfully saved derivative data. [2025-09-29T02:16:56.427800] [INFO ] [MAIN ] Derivative Progress: 991/2211 symbols completed. HRI took 1.2s. Estimated remaining: 8m 36s. Rate: 141.7 symbols/min [2025-09-29T02:16:56.428241] [INFO ] [MAIN ] HRL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:56.458881] [DEBUG] [MAIN ] HRB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:56.464437] [DEBUG] [MAIN ] HR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:56.466167] [INFO ] [MAIN ] HRB: Generated 1820 derivative records from 49275 primary records. [2025-09-29T02:16:56.467069] [INFO ] [MAIN ] HR: Generated 1820 derivative records from 52716 primary records. [2025-09-29T02:16:56.467160] [DEBUG] [LOCAL ] HRB: Saving derivative data. [2025-09-29T02:16:56.467981] [DEBUG] [LOCAL ] HR: Saving derivative data. [2025-09-29T02:16:56.503587] [DEBUG] [LOCAL ] HRB: Derivative data saved (1820 records). [2025-09-29T02:16:56.503390] [DEBUG] [LOCAL ] HR: Derivative data saved (1820 records). [2025-09-29T02:16:56.503822] [INFO ] [MAIN ] HRB: Successfully saved derivative data. [2025-09-29T02:16:56.507683] [INFO ] [MAIN ] Derivative Progress: 992/2211 symbols completed. HRB took 1.3s. Estimated remaining: 8m 36s. Rate: 141.9 symbols/min [2025-09-29T02:16:56.507960] [INFO ] [MAIN ] HRTG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:56.503989] [INFO ] [MAIN ] HR: Successfully saved derivative data. [2025-09-29T02:16:56.510978] [INFO ] [MAIN ] Derivative Progress: 993/2211 symbols completed. HR took 1.3s. Estimated remaining: 8m 35s. Rate: 142.0 symbols/min [2025-09-29T02:16:56.511484] [INFO ] [MAIN ] HSBC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:56.570796] [DEBUG] [LOCAL ] HRL: Loaded 53855 existing records from primary storage. [2025-09-29T02:16:56.571332] [INFO ] [MAIN ] HRL: Loaded 53855 primary data records. [2025-09-29T02:16:56.637789] [DEBUG] [LOCAL ] HRTG: Loaded 33658 existing records from primary storage. [2025-09-29T02:16:56.662183] [INFO ] [MAIN ] HRTG: Loaded 33658 primary data records. [2025-09-29T02:16:57.110305] [DEBUG] [LOCAL ] HSBC: Loaded 51868 existing records from primary storage. [2025-09-29T02:16:57.147984] [INFO ] [MAIN ] HSBC: Loaded 51868 primary data records. [2025-09-29T02:16:57.700293] [DEBUG] [MAIN ] HRL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:57.701977] [INFO ] [MAIN ] HRL: Generated 1820 derivative records from 53855 primary records. [2025-09-29T02:16:57.705476] [DEBUG] [LOCAL ] HRL: Saving derivative data. [2025-09-29T02:16:57.727612] [DEBUG] [LOCAL ] HRL: Derivative data saved (1820 records). [2025-09-29T02:16:57.730866] [INFO ] [MAIN ] HRL: Successfully saved derivative data. [2025-09-29T02:16:57.734059] [INFO ] [MAIN ] Derivative Progress: 994/2211 symbols completed. HRL took 1.3s. Estimated remaining: 8m 35s. Rate: 141.7 symbols/min [2025-09-29T02:16:57.735601] [INFO ] [MAIN ] HSHP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:57.750486] [DEBUG] [MAIN ] HRTG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:57.752388] [INFO ] [MAIN ] HRTG: Generated 1820 derivative records from 33658 primary records. [2025-09-29T02:16:57.752867] [DEBUG] [LOCAL ] HRTG: Saving derivative data. [2025-09-29T02:16:57.778233] [DEBUG] [LOCAL ] HRTG: Derivative data saved (1820 records). [2025-09-29T02:16:57.778791] [INFO ] [MAIN ] HRTG: Successfully saved derivative data. [2025-09-29T02:16:57.781994] [INFO ] [MAIN ] Derivative Progress: 995/2211 symbols completed. HRTG took 1.3s. Estimated remaining: 8m 34s. Rate: 141.9 symbols/min [2025-09-29T02:16:57.782330] [INFO ] [MAIN ] HSY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:57.791166] [DEBUG] [LOCAL ] HSHP: Loaded 15773 existing records from primary storage. [2025-09-29T02:16:57.791579] [INFO ] [MAIN ] HSHP: Loaded 15773 primary data records. [2025-09-29T02:16:57.816804] [DEBUG] [MAIN ] HSBC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:57.863911] [INFO ] [MAIN ] HSBC: Generated 1820 derivative records from 51868 primary records. [2025-09-29T02:16:57.895842] [DEBUG] [LOCAL ] HSBC: Saving derivative data. [2025-09-29T02:16:58.181762] [DEBUG] [LOCAL ] HSBC: Derivative data saved (1820 records). [2025-09-29T02:16:58.181965] [INFO ] [MAIN ] HSBC: Successfully saved derivative data. [2025-09-29T02:16:58.185872] [INFO ] [MAIN ] Derivative Progress: 996/2211 symbols completed. HSBC took 1.7s. Estimated remaining: 8m 34s. Rate: 141.9 symbols/min [2025-09-29T02:16:58.187044] [INFO ] [MAIN ] HTD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:58.212008] [DEBUG] [LOCAL ] HSY: Loaded 51161 existing records from primary storage. [2025-09-29T02:16:58.212964] [INFO ] [MAIN ] HSY: Loaded 51161 primary data records. [2025-09-29T02:16:58.329240] [DEBUG] [LOCAL ] HTD: Loaded 13754 existing records from primary storage. [2025-09-29T02:16:58.395773] [DEBUG] [MAIN ] HSHP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:58.412753] [INFO ] [MAIN ] HTD: Loaded 13754 primary data records. [2025-09-29T02:16:58.450077] [INFO ] [MAIN ] HSHP: Generated 1820 derivative records from 15773 primary records. [2025-09-29T02:16:58.583117] [DEBUG] [LOCAL ] HSHP: Saving derivative data. [2025-09-29T02:16:58.728154] [DEBUG] [LOCAL ] HSHP: Derivative data saved (1820 records). [2025-09-29T02:16:58.797250] [INFO ] [MAIN ] HSHP: Successfully saved derivative data. [2025-09-29T02:16:58.922090] [INFO ] [MAIN ] Derivative Progress: 997/2211 symbols completed. HSHP took 1.2s. Estimated remaining: 8m 34s. Rate: 141.8 symbols/min [2025-09-29T02:16:58.938604] [INFO ] [MAIN ] HTGC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:58.968893] [DEBUG] [MAIN ] HSY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:58.969943] [INFO ] [MAIN ] HSY: Generated 1820 derivative records from 51161 primary records. [2025-09-29T02:16:58.970071] [DEBUG] [LOCAL ] HSY: Saving derivative data. [2025-09-29T02:16:58.993622] [DEBUG] [LOCAL ] HSY: Derivative data saved (1820 records). [2025-09-29T02:16:58.994211] [INFO ] [MAIN ] HSY: Successfully saved derivative data. [2025-09-29T02:16:58.998162] [INFO ] [MAIN ] Derivative Progress: 998/2211 symbols completed. HSY took 1.2s. Estimated remaining: 8m 33s. Rate: 141.9 symbols/min [2025-09-29T02:16:58.999759] [INFO ] [MAIN ] HTH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:59.029198] [DEBUG] [MAIN ] HTD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:16:59.030117] [INFO ] [MAIN ] HTD: Generated 1820 derivative records from 13754 primary records. [2025-09-29T02:16:59.030263] [DEBUG] [LOCAL ] HTD: Saving derivative data. [2025-09-29T02:16:59.071393] [DEBUG] [LOCAL ] HTD: Derivative data saved (1820 records). [2025-09-29T02:16:59.071806] [INFO ] [MAIN ] HTD: Successfully saved derivative data. [2025-09-29T02:16:59.072868] [DEBUG] [LOCAL ] HTGC: Loaded 48222 existing records from primary storage. [2025-09-29T02:16:59.076253] [INFO ] [MAIN ] Derivative Progress: 999/2211 symbols completed. HTD took 0.9s. Estimated remaining: 8m 32s. Rate: 142.0 symbols/min [2025-09-29T02:16:59.076580] [INFO ] [MAIN ] HUBB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:16:59.076661] [INFO ] [MAIN ] HTGC: Loaded 48222 primary data records. [2025-09-29T02:16:59.177686] [DEBUG] [LOCAL ] HTH: Loaded 32696 existing records from primary storage. [2025-09-29T02:16:59.207852] [INFO ] [MAIN ] HTH: Loaded 32696 primary data records. [2025-09-29T02:16:59.636244] [DEBUG] [LOCAL ] HUBB: Loaded 37650 existing records from primary storage. [2025-09-29T02:16:59.676625] [INFO ] [MAIN ] HUBB: Loaded 37650 primary data records. [2025-09-29T02:17:00.224391] [DEBUG] [MAIN ] HTH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:00.225304] [DEBUG] [MAIN ] HTGC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:00.227178] [INFO ] [MAIN ] HTH: Generated 1820 derivative records from 32696 primary records. [2025-09-29T02:17:00.228069] [INFO ] [MAIN ] HTGC: Generated 1820 derivative records from 48222 primary records. [2025-09-29T02:17:00.228257] [DEBUG] [LOCAL ] HTGC: Saving derivative data. [2025-09-29T02:17:00.228822] [DEBUG] [LOCAL ] HTH: Saving derivative data. [2025-09-29T02:17:00.263586] [DEBUG] [LOCAL ] HTGC: Derivative data saved (1820 records). [2025-09-29T02:17:00.264921] [INFO ] [MAIN ] HTGC: Successfully saved derivative data. [2025-09-29T02:17:00.268557] [INFO ] [MAIN ] Derivative Progress: 1000/2211 symbols completed. HTGC took 1.3s. Estimated remaining: 8m 33s. Rate: 141.7 symbols/min [2025-09-29T02:17:00.270297] [DEBUG] [LOCAL ] HTH: Derivative data saved (1820 records). [2025-09-29T02:17:00.270482] [INFO ] [MAIN ] HUBS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:00.271318] [INFO ] [MAIN ] HTH: Successfully saved derivative data. [2025-09-29T02:17:00.277682] [INFO ] [MAIN ] Derivative Progress: 1001/2211 symbols completed. HTH took 1.3s. Estimated remaining: 8m 32s. Rate: 141.9 symbols/min [2025-09-29T02:17:00.278493] [INFO ] [MAIN ] HUM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:00.298467] [DEBUG] [MAIN ] HUBB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:00.299969] [INFO ] [MAIN ] HUBB: Generated 1820 derivative records from 37650 primary records. [2025-09-29T02:17:00.300148] [DEBUG] [LOCAL ] HUBB: Saving derivative data. [2025-09-29T02:17:00.335881] [DEBUG] [LOCAL ] HUBB: Derivative data saved (1820 records). [2025-09-29T02:17:00.336086] [INFO ] [MAIN ] HUBB: Successfully saved derivative data. [2025-09-29T02:17:00.341170] [INFO ] [MAIN ] Derivative Progress: 1002/2211 symbols completed. HUBB took 1.3s. Estimated remaining: 8m 31s. Rate: 142.0 symbols/min [2025-09-29T02:17:00.341775] [INFO ] [MAIN ] HUN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:00.361172] [DEBUG] [LOCAL ] HUBS: Loaded 39953 existing records from primary storage. [2025-09-29T02:17:00.374584] [INFO ] [MAIN ] HUBS: Loaded 39953 primary data records. [2025-09-29T02:17:00.516110] [DEBUG] [LOCAL ] HUM: Loaded 49568 existing records from primary storage. [2025-09-29T02:17:00.516461] [INFO ] [MAIN ] HUM: Loaded 49568 primary data records. [2025-09-29T02:17:00.991777] [DEBUG] [LOCAL ] HUN: Loaded 53976 existing records from primary storage. [2025-09-29T02:17:00.992308] [INFO ] [MAIN ] HUN: Loaded 53976 primary data records. [2025-09-29T02:17:01.572155] [DEBUG] [MAIN ] HUBS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:01.576129] [INFO ] [MAIN ] HUBS: Generated 1820 derivative records from 39953 primary records. [2025-09-29T02:17:01.576593] [DEBUG] [LOCAL ] HUBS: Saving derivative data. [2025-09-29T02:17:01.599091] [DEBUG] [LOCAL ] HUBS: Derivative data saved (1820 records). [2025-09-29T02:17:01.617552] [INFO ] [MAIN ] HUBS: Successfully saved derivative data. [2025-09-29T02:17:01.622440] [DEBUG] [MAIN ] HUM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:01.621544] [INFO ] [MAIN ] Derivative Progress: 1003/2211 symbols completed. HUBS took 1.4s. Estimated remaining: 8m 31s. Rate: 141.7 symbols/min [2025-09-29T02:17:01.623452] [INFO ] [MAIN ] HUM: Generated 1820 derivative records from 49568 primary records. [2025-09-29T02:17:01.623572] [DEBUG] [LOCAL ] HUM: Saving derivative data. [2025-09-29T02:17:01.644300] [DEBUG] [LOCAL ] HUM: Derivative data saved (1820 records). [2025-09-29T02:17:01.644766] [INFO ] [MAIN ] HUM: Successfully saved derivative data. [2025-09-29T02:17:01.648107] [INFO ] [MAIN ] Derivative Progress: 1004/2211 symbols completed. HUM took 1.4s. Estimated remaining: 8m 31s. Rate: 141.8 symbols/min [2025-09-29T02:17:01.668278] [DEBUG] [MAIN ] HUN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:01.669048] [INFO ] [MAIN ] HUN: Generated 1820 derivative records from 53976 primary records. [2025-09-29T02:17:01.669133] [DEBUG] [LOCAL ] HUN: Saving derivative data. [2025-09-29T02:17:01.685536] [DEBUG] [LOCAL ] HUN: Derivative data saved (1820 records). [2025-09-29T02:17:01.685718] [INFO ] [MAIN ] HUN: Successfully saved derivative data. [2025-09-29T02:17:01.689294] [INFO ] [MAIN ] Derivative Progress: 1005/2211 symbols completed. HUN took 1.3s. Estimated remaining: 8m 30s. Rate: 142.0 symbols/min [2025-09-29T02:17:01.690119] [INFO ] [MAIN ] HWM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:01.689971] [INFO ] [MAIN ] HUYA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:01.690219] [INFO ] [MAIN ] HVT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:01.718716] [DEBUG] [LOCAL ] HVT: Loaded 16133 existing records from primary storage. [2025-09-29T02:17:01.718891] [INFO ] [MAIN ] HVT: Loaded 16133 primary data records. [2025-09-29T02:17:01.999747] [DEBUG] [LOCAL ] HWM: Loaded 53767 existing records from primary storage. [2025-09-29T02:17:02.164467] [DEBUG] [LOCAL ] HUYA: Loaded 44956 existing records from primary storage. [2025-09-29T02:17:02.164906] [INFO ] [MAIN ] HUYA: Loaded 44956 primary data records. [2025-09-29T02:17:02.162586] [INFO ] [MAIN ] HWM: Loaded 53767 primary data records. [2025-09-29T02:17:02.922183] [DEBUG] [MAIN ] HVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:02.924046] [INFO ] [MAIN ] HVT: Generated 1820 derivative records from 16133 primary records. [2025-09-29T02:17:02.925305] [DEBUG] [LOCAL ] HVT: Saving derivative data. [2025-09-29T02:17:02.947268] [DEBUG] [LOCAL ] HVT: Derivative data saved (1820 records). [2025-09-29T02:17:02.948262] [INFO ] [MAIN ] HVT: Successfully saved derivative data. [2025-09-29T02:17:02.952123] [INFO ] [MAIN ] Derivative Progress: 1006/2211 symbols completed. HVT took 1.3s. Estimated remaining: 8m 30s. Rate: 141.7 symbols/min [2025-09-29T02:17:02.952881] [INFO ] [MAIN ] HXL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:02.982629] [DEBUG] [MAIN ] HUYA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:02.988435] [INFO ] [MAIN ] HUYA: Generated 1820 derivative records from 44956 primary records. [2025-09-29T02:17:02.989065] [DEBUG] [LOCAL ] HUYA: Saving derivative data. [2025-09-29T02:17:02.988810] [DEBUG] [MAIN ] HWM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:02.989955] [INFO ] [MAIN ] HWM: Generated 1820 derivative records from 53767 primary records. [2025-09-29T02:17:02.991107] [DEBUG] [LOCAL ] HWM: Saving derivative data. [2025-09-29T02:17:03.017415] [DEBUG] [LOCAL ] HUYA: Derivative data saved (1820 records). [2025-09-29T02:17:03.021365] [INFO ] [MAIN ] HUYA: Successfully saved derivative data. [2025-09-29T02:17:03.025912] [INFO ] [MAIN ] Derivative Progress: 1007/2211 symbols completed. HUYA took 1.3s. Estimated remaining: 8m 29s. Rate: 141.8 symbols/min [2025-09-29T02:17:03.027858] [INFO ] [MAIN ] HY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:03.042436] [DEBUG] [LOCAL ] HWM: Derivative data saved (1820 records). [2025-09-29T02:17:03.042600] [INFO ] [MAIN ] HWM: Successfully saved derivative data. [2025-09-29T02:17:03.046301] [INFO ] [MAIN ] Derivative Progress: 1008/2211 symbols completed. HWM took 1.4s. Estimated remaining: 8m 29s. Rate: 141.9 symbols/min [2025-09-29T02:17:03.046741] [INFO ] [MAIN ] HYI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:03.074827] [DEBUG] [LOCAL ] HXL: Loaded 46661 existing records from primary storage. [2025-09-29T02:17:03.075096] [INFO ] [MAIN ] HXL: Loaded 46661 primary data records. [2025-09-29T02:17:03.118385] [DEBUG] [LOCAL ] HY: Loaded 10192 existing records from primary storage. [2025-09-29T02:17:03.153305] [DEBUG] [LOCAL ] HYI: Loaded 9254 existing records from primary storage. [2025-09-29T02:17:03.136145] [INFO ] [MAIN ] HY: Loaded 10192 primary data records. [2025-09-29T02:17:03.171076] [INFO ] [MAIN ] HYI: Loaded 9254 primary data records. [2025-09-29T02:17:04.169394] [DEBUG] [MAIN ] HXL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:04.176300] [DEBUG] [MAIN ] HY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:04.177999] [INFO ] [MAIN ] HXL: Generated 1820 derivative records from 46661 primary records. [2025-09-29T02:17:04.179058] [DEBUG] [LOCAL ] HXL: Saving derivative data. [2025-09-29T02:17:04.178905] [INFO ] [MAIN ] HY: Generated 1820 derivative records from 10192 primary records. [2025-09-29T02:17:04.196982] [DEBUG] [LOCAL ] HY: Saving derivative data. [2025-09-29T02:17:04.208180] [DEBUG] [MAIN ] HYI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:04.209993] [INFO ] [MAIN ] HYI: Generated 1820 derivative records from 9254 primary records. [2025-09-29T02:17:04.211412] [DEBUG] [LOCAL ] HYI: Saving derivative data. [2025-09-29T02:17:04.211314] [DEBUG] [LOCAL ] HXL: Derivative data saved (1820 records). [2025-09-29T02:17:04.212265] [INFO ] [MAIN ] HXL: Successfully saved derivative data. [2025-09-29T02:17:04.215186] [INFO ] [MAIN ] Derivative Progress: 1009/2211 symbols completed. HXL took 1.3s. Estimated remaining: 8m 29s. Rate: 141.7 symbols/min [2025-09-29T02:17:04.231048] [INFO ] [MAIN ] HYT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:04.247347] [DEBUG] [LOCAL ] HY: Derivative data saved (1820 records). [2025-09-29T02:17:04.247715] [INFO ] [MAIN ] HY: Successfully saved derivative data. [2025-09-29T02:17:04.250297] [INFO ] [MAIN ] Derivative Progress: 1010/2211 symbols completed. HY took 1.2s. Estimated remaining: 8m 28s. Rate: 141.8 symbols/min [2025-09-29T02:17:04.250524] [INFO ] [MAIN ] HYTR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:04.247422] [DEBUG] [LOCAL ] HYI: Derivative data saved (1820 records). [2025-09-29T02:17:04.250900] [INFO ] [MAIN ] HYI: Successfully saved derivative data. [2025-09-29T02:17:04.253905] [INFO ] [MAIN ] Derivative Progress: 1011/2211 symbols completed. HYI took 1.2s. Estimated remaining: 8m 27s. Rate: 142.0 symbols/min [2025-09-29T02:17:04.254122] [INFO ] [MAIN ] HZO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:04.262715] [DEBUG] [LOCAL ] HYTR: Loaded 3208 existing records from primary storage. [2025-09-29T02:17:04.262921] [INFO ] [MAIN ] HYTR: Loaded 3208 primary data records. [2025-09-29T02:17:04.452113] [DEBUG] [LOCAL ] HZO: Loaded 29733 existing records from primary storage. [2025-09-29T02:17:04.486722] [DEBUG] [LOCAL ] HYT: Loaded 33853 existing records from primary storage. [2025-09-29T02:17:04.486963] [INFO ] [MAIN ] HZO: Loaded 29733 primary data records. [2025-09-29T02:17:04.493935] [INFO ] [MAIN ] HYT: Loaded 33853 primary data records. [2025-09-29T02:17:05.369151] [DEBUG] [MAIN ] HYTR: Filtered 7001 bins outside market hours, 7801 incomplete bins [2025-09-29T02:17:05.371008] [INFO ] [MAIN ] HYTR: Generated 1813 derivative records from 3208 primary records. [2025-09-29T02:17:05.372018] [DEBUG] [LOCAL ] HYTR: Saving derivative data. [2025-09-29T02:17:05.389913] [DEBUG] [LOCAL ] HYTR: Derivative data saved (1813 records). [2025-09-29T02:17:05.390707] [INFO ] [MAIN ] HYTR: Successfully saved derivative data. [2025-09-29T02:17:05.393600] [INFO ] [MAIN ] Derivative Progress: 1012/2211 symbols completed. HYTR took 1.1s. Estimated remaining: 8m 28s. Rate: 141.7 symbols/min [2025-09-29T02:17:05.394351] [INFO ] [MAIN ] IAE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:05.408475] [DEBUG] [LOCAL ] IAE: Loaded 6104 existing records from primary storage. [2025-09-29T02:17:05.434759] [INFO ] [MAIN ] IAE: Loaded 6104 primary data records. [2025-09-29T02:17:05.435518] [DEBUG] [MAIN ] HYT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:05.447440] [DEBUG] [MAIN ] HZO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:05.474260] [INFO ] [MAIN ] HYT: Generated 1820 derivative records from 33853 primary records. [2025-09-29T02:17:05.483398] [INFO ] [MAIN ] HZO: Generated 1820 derivative records from 29733 primary records. [2025-09-29T02:17:05.548012] [DEBUG] [LOCAL ] HZO: Saving derivative data. [2025-09-29T02:17:05.518758] [DEBUG] [LOCAL ] HYT: Saving derivative data. [2025-09-29T02:17:05.794220] [DEBUG] [LOCAL ] HYT: Derivative data saved (1820 records). [2025-09-29T02:17:05.794324] [DEBUG] [LOCAL ] HZO: Derivative data saved (1820 records). [2025-09-29T02:17:05.794788] [INFO ] [MAIN ] HZO: Successfully saved derivative data. [2025-09-29T02:17:05.794719] [INFO ] [MAIN ] HYT: Successfully saved derivative data. [2025-09-29T02:17:05.797842] [INFO ] [MAIN ] Derivative Progress: 1013/2211 symbols completed. HYT took 1.6s. Estimated remaining: 8m 27s. Rate: 141.7 symbols/min [2025-09-29T02:17:05.801043] [INFO ] [MAIN ] IAG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:05.801150] [INFO ] [MAIN ] Derivative Progress: 1014/2211 symbols completed. HZO took 1.5s. Estimated remaining: 8m 26s. Rate: 141.9 symbols/min [2025-09-29T02:17:05.802327] [INFO ] [MAIN ] IBM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:05.834704] [DEBUG] [MAIN ] IAE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:05.835746] [INFO ] [MAIN ] IAE: Generated 1820 derivative records from 6104 primary records. [2025-09-29T02:17:05.835911] [DEBUG] [LOCAL ] IAE: Saving derivative data. [2025-09-29T02:17:05.854514] [DEBUG] [LOCAL ] IAE: Derivative data saved (1820 records). [2025-09-29T02:17:05.854727] [INFO ] [MAIN ] IAE: Successfully saved derivative data. [2025-09-29T02:17:05.857488] [INFO ] [MAIN ] Derivative Progress: 1015/2211 symbols completed. IAE took 0.5s. Estimated remaining: 8m 25s. Rate: 142.0 symbols/min [2025-09-29T02:17:05.857907] [INFO ] [MAIN ] IBN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:05.937412] [DEBUG] [LOCAL ] IBM: Loaded 54416 existing records from primary storage. [2025-09-29T02:17:05.939301] [INFO ] [MAIN ] IBM: Loaded 54416 primary data records. [2025-09-29T02:17:05.953347] [DEBUG] [LOCAL ] IAG: Loaded 54225 existing records from primary storage. [2025-09-29T02:17:05.982087] [INFO ] [MAIN ] IAG: Loaded 54225 primary data records. [2025-09-29T02:17:06.305173] [DEBUG] [LOCAL ] IBN: Loaded 53654 existing records from primary storage. [2025-09-29T02:17:06.315672] [INFO ] [MAIN ] IBN: Loaded 53654 primary data records. [2025-09-29T02:17:07.046080] [DEBUG] [MAIN ] IBM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:07.049178] [INFO ] [MAIN ] IBM: Generated 1820 derivative records from 54416 primary records. [2025-09-29T02:17:07.049458] [DEBUG] [LOCAL ] IBM: Saving derivative data. [2025-09-29T02:17:07.083008] [DEBUG] [MAIN ] IAG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:07.081989] [DEBUG] [LOCAL ] IBM: Derivative data saved (1820 records). [2025-09-29T02:17:07.083904] [INFO ] [MAIN ] IAG: Generated 1820 derivative records from 54225 primary records. [2025-09-29T02:17:07.084048] [INFO ] [MAIN ] IBM: Successfully saved derivative data. [2025-09-29T02:17:07.087181] [INFO ] [MAIN ] Derivative Progress: 1016/2211 symbols completed. IBM took 1.3s. Estimated remaining: 8m 26s. Rate: 141.7 symbols/min [2025-09-29T02:17:07.087371] [INFO ] [MAIN ] IBP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:07.087494] [DEBUG] [LOCAL ] IAG: Saving derivative data. [2025-09-29T02:17:07.111063] [DEBUG] [LOCAL ] IAG: Derivative data saved (1820 records). [2025-09-29T02:17:07.111710] [INFO ] [MAIN ] IAG: Successfully saved derivative data. [2025-09-29T02:17:07.116088] [INFO ] [MAIN ] Derivative Progress: 1017/2211 symbols completed. IAG took 1.3s. Estimated remaining: 8m 25s. Rate: 141.8 symbols/min [2025-09-29T02:17:07.122330] [INFO ] [MAIN ] IBTA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:07.138273] [DEBUG] [MAIN ] IBN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:07.139804] [INFO ] [MAIN ] IBN: Generated 1820 derivative records from 53654 primary records. [2025-09-29T02:17:07.140194] [DEBUG] [LOCAL ] IBN: Saving derivative data. [2025-09-29T02:17:07.172158] [DEBUG] [LOCAL ] IBN: Derivative data saved (1820 records). [2025-09-29T02:17:07.172341] [INFO ] [MAIN ] IBN: Successfully saved derivative data. [2025-09-29T02:17:07.176735] [INFO ] [MAIN ] Derivative Progress: 1018/2211 symbols completed. IBN took 1.3s. Estimated remaining: 8m 24s. Rate: 142.0 symbols/min [2025-09-29T02:17:07.190991] [DEBUG] [LOCAL ] IBP: Loaded 29584 existing records from primary storage. [2025-09-29T02:17:07.192195] [INFO ] [MAIN ] IBP: Loaded 29584 primary data records. [2025-09-29T02:17:07.370940] [DEBUG] [LOCAL ] IBTA: Loaded 38445 existing records from primary storage. [2025-09-29T02:17:07.406157] [INFO ] [MAIN ] IBTA: Loaded 38445 primary data records. [2025-09-29T02:17:07.911177] [DEBUG] [MAIN ] IBP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:07.912155] [INFO ] [MAIN ] IBP: Generated 1820 derivative records from 29584 primary records. [2025-09-29T02:17:07.912255] [DEBUG] [LOCAL ] IBP: Saving derivative data. [2025-09-29T02:17:07.931857] [DEBUG] [LOCAL ] IBP: Derivative data saved (1820 records). [2025-09-29T02:17:07.932079] [INFO ] [MAIN ] IBP: Successfully saved derivative data. [2025-09-29T02:17:07.934898] [INFO ] [MAIN ] Derivative Progress: 1019/2211 symbols completed. IBP took 0.8s. Estimated remaining: 8m 24s. Rate: 141.9 symbols/min [2025-09-29T02:17:07.953011] [DEBUG] [MAIN ] IBTA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:07.953821] [INFO ] [MAIN ] IBTA: Generated 1820 derivative records from 38445 primary records. [2025-09-29T02:17:07.953909] [DEBUG] [LOCAL ] IBTA: Saving derivative data. [2025-09-29T02:17:07.970675] [DEBUG] [LOCAL ] IBTA: Derivative data saved (1820 records). [2025-09-29T02:17:07.970806] [INFO ] [MAIN ] IBTA: Successfully saved derivative data. [2025-09-29T02:17:07.973865] [INFO ] [MAIN ] Derivative Progress: 1020/2211 symbols completed. IBTA took 0.9s. Estimated remaining: 8m 23s. Rate: 142.0 symbols/min [2025-09-29T02:17:07.974456] [INFO ] [MAIN ] ICE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:07.974582] [INFO ] [MAIN ] ICL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:07.974715] [INFO ] [MAIN ] IDA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:08.029226] [DEBUG] [LOCAL ] ICL: Loaded 39135 existing records from primary storage. [2025-09-29T02:17:08.040667] [INFO ] [MAIN ] ICL: Loaded 39135 primary data records. [2025-09-29T02:17:08.091639] [DEBUG] [LOCAL ] IDA: Loaded 32398 existing records from primary storage. [2025-09-29T02:17:08.108766] [INFO ] [MAIN ] IDA: Loaded 32398 primary data records. [2025-09-29T02:17:08.303109] [DEBUG] [LOCAL ] ICE: Loaded 53800 existing records from primary storage. [2025-09-29T02:17:08.309001] [INFO ] [MAIN ] ICE: Loaded 53800 primary data records. [2025-09-29T02:17:09.228478] [DEBUG] [MAIN ] ICL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:09.230247] [INFO ] [MAIN ] ICL: Generated 1820 derivative records from 39135 primary records. [2025-09-29T02:17:09.243450] [DEBUG] [LOCAL ] ICL: Saving derivative data. [2025-09-29T02:17:09.244012] [DEBUG] [MAIN ] IDA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:09.246389] [INFO ] [MAIN ] IDA: Generated 1820 derivative records from 32398 primary records. [2025-09-29T02:17:09.256382] [DEBUG] [LOCAL ] IDA: Saving derivative data. [2025-09-29T02:17:09.274721] [DEBUG] [LOCAL ] ICL: Derivative data saved (1820 records). [2025-09-29T02:17:09.279190] [INFO ] [MAIN ] ICL: Successfully saved derivative data. [2025-09-29T02:17:09.285673] [INFO ] [MAIN ] Derivative Progress: 1021/2211 symbols completed. ICL took 1.3s. Estimated remaining: 8m 24s. Rate: 141.7 symbols/min [2025-09-29T02:17:09.286346] [INFO ] [MAIN ] IDE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:09.288430] [DEBUG] [LOCAL ] IDA: Derivative data saved (1820 records). [2025-09-29T02:17:09.296235] [INFO ] [MAIN ] IDA: Successfully saved derivative data. [2025-09-29T02:17:09.301815] [DEBUG] [MAIN ] ICE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:09.306026] [INFO ] [MAIN ] Derivative Progress: 1022/2211 symbols completed. IDA took 1.3s. Estimated remaining: 8m 23s. Rate: 141.8 symbols/min [2025-09-29T02:17:09.307328] [INFO ] [MAIN ] ICE: Generated 1820 derivative records from 53800 primary records. [2025-09-29T02:17:09.307527] [INFO ] [MAIN ] IDT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:09.307750] [DEBUG] [LOCAL ] ICE: Saving derivative data. [2025-09-29T02:17:09.331590] [DEBUG] [LOCAL ] IDE: Loaded 8755 existing records from primary storage. [2025-09-29T02:17:09.332421] [INFO ] [MAIN ] IDE: Loaded 8755 primary data records. [2025-09-29T02:17:09.332832] [DEBUG] [LOCAL ] ICE: Derivative data saved (1820 records). [2025-09-29T02:17:09.351371] [INFO ] [MAIN ] ICE: Successfully saved derivative data. [2025-09-29T02:17:09.397832] [INFO ] [MAIN ] Derivative Progress: 1023/2211 symbols completed. ICE took 1.4s. Estimated remaining: 8m 22s. Rate: 141.9 symbols/min [2025-09-29T02:17:09.437386] [INFO ] [MAIN ] IEX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:09.460423] [DEBUG] [LOCAL ] IDT: Loaded 17885 existing records from primary storage. [2025-09-29T02:17:09.479496] [INFO ] [MAIN ] IDT: Loaded 17885 primary data records. [2025-09-29T02:17:10.088849] [DEBUG] [LOCAL ] IEX: Loaded 38978 existing records from primary storage. [2025-09-29T02:17:10.091232] [INFO ] [MAIN ] IEX: Loaded 38978 primary data records. [2025-09-29T02:17:10.347842] [DEBUG] [MAIN ] IDE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:10.348766] [INFO ] [MAIN ] IDE: Generated 1820 derivative records from 8755 primary records. [2025-09-29T02:17:10.515961] [DEBUG] [LOCAL ] IDE: Saving derivative data. [2025-09-29T02:17:10.535978] [DEBUG] [LOCAL ] IDE: Derivative data saved (1820 records). [2025-09-29T02:17:10.539773] [INFO ] [MAIN ] IDE: Successfully saved derivative data. [2025-09-29T02:17:10.542525] [INFO ] [MAIN ] Derivative Progress: 1024/2211 symbols completed. IDE took 1.3s. Estimated remaining: 8m 23s. Rate: 141.7 symbols/min [2025-09-29T02:17:10.543360] [INFO ] [MAIN ] IFF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:10.558026] [DEBUG] [MAIN ] IDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:10.560159] [INFO ] [MAIN ] IDT: Generated 1820 derivative records from 17885 primary records. [2025-09-29T02:17:10.560367] [DEBUG] [LOCAL ] IDT: Saving derivative data. [2025-09-29T02:17:10.581327] [DEBUG] [LOCAL ] IDT: Derivative data saved (1820 records). [2025-09-29T02:17:10.581748] [INFO ] [MAIN ] IDT: Successfully saved derivative data. [2025-09-29T02:17:10.584744] [INFO ] [MAIN ] Derivative Progress: 1025/2211 symbols completed. IDT took 1.3s. Estimated remaining: 8m 22s. Rate: 141.8 symbols/min [2025-09-29T02:17:10.585225] [INFO ] [MAIN ] IFN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:10.603175] [DEBUG] [MAIN ] IEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:10.604533] [INFO ] [MAIN ] IEX: Generated 1820 derivative records from 38978 primary records. [2025-09-29T02:17:10.604828] [DEBUG] [LOCAL ] IEX: Saving derivative data. [2025-09-29T02:17:10.627268] [DEBUG] [LOCAL ] IEX: Derivative data saved (1820 records). [2025-09-29T02:17:10.627630] [INFO ] [MAIN ] IEX: Successfully saved derivative data. [2025-09-29T02:17:10.645354] [INFO ] [MAIN ] Derivative Progress: 1026/2211 symbols completed. IEX took 1.2s. Estimated remaining: 8m 21s. Rate: 141.9 symbols/min [2025-09-29T02:17:10.645839] [INFO ] [MAIN ] IFS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:10.654158] [DEBUG] [LOCAL ] IFN: Loaded 18475 existing records from primary storage. [2025-09-29T02:17:10.654309] [INFO ] [MAIN ] IFN: Loaded 18475 primary data records. [2025-09-29T02:17:10.804568] [DEBUG] [LOCAL ] IFF: Loaded 51727 existing records from primary storage. [2025-09-29T02:17:10.836938] [INFO ] [MAIN ] IFF: Loaded 51727 primary data records. [2025-09-29T02:17:10.956336] [DEBUG] [LOCAL ] IFS: Loaded 23359 existing records from primary storage. [2025-09-29T02:17:11.115032] [INFO ] [MAIN ] IFS: Loaded 23359 primary data records. [2025-09-29T02:17:11.757399] [DEBUG] [MAIN ] IFN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:11.758859] [INFO ] [MAIN ] IFN: Generated 1820 derivative records from 18475 primary records. [2025-09-29T02:17:11.759065] [DEBUG] [LOCAL ] IFN: Saving derivative data. [2025-09-29T02:17:11.783196] [DEBUG] [LOCAL ] IFN: Derivative data saved (1820 records). [2025-09-29T02:17:11.784211] [INFO ] [MAIN ] IFN: Successfully saved derivative data. [2025-09-29T02:17:11.786553] [INFO ] [MAIN ] Derivative Progress: 1027/2211 symbols completed. IFN took 1.2s. Estimated remaining: 8m 21s. Rate: 141.7 symbols/min [2025-09-29T02:17:11.787044] [INFO ] [MAIN ] IGA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:11.804592] [DEBUG] [MAIN ] IFF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:11.819321] [INFO ] [MAIN ] IFF: Generated 1820 derivative records from 51727 primary records. [2025-09-29T02:17:11.819848] [DEBUG] [MAIN ] IFS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:11.820964] [INFO ] [MAIN ] IFS: Generated 1820 derivative records from 23359 primary records. [2025-09-29T02:17:11.821280] [DEBUG] [LOCAL ] IFS: Saving derivative data. [2025-09-29T02:17:11.821200] [DEBUG] [LOCAL ] IFF: Saving derivative data. [2025-09-29T02:17:11.860142] [DEBUG] [LOCAL ] IGA: Loaded 9779 existing records from primary storage. [2025-09-29T02:17:11.861864] [INFO ] [MAIN ] IGA: Loaded 9779 primary data records. [2025-09-29T02:17:11.862626] [DEBUG] [LOCAL ] IFS: Derivative data saved (1820 records). [2025-09-29T02:17:11.882202] [INFO ] [MAIN ] IFS: Successfully saved derivative data. [2025-09-29T02:17:11.917636] [DEBUG] [LOCAL ] IFF: Derivative data saved (1820 records). [2025-09-29T02:17:11.920805] [INFO ] [MAIN ] Derivative Progress: 1028/2211 symbols completed. IFS took 1.3s. Estimated remaining: 8m 21s. Rate: 141.8 symbols/min [2025-09-29T02:17:11.926333] [INFO ] [MAIN ] IFF: Successfully saved derivative data. [2025-09-29T02:17:11.926521] [INFO ] [MAIN ] IGD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:11.939153] [INFO ] [MAIN ] Derivative Progress: 1029/2211 symbols completed. IFF took 1.4s. Estimated remaining: 8m 20s. Rate: 141.9 symbols/min [2025-09-29T02:17:11.978432] [INFO ] [MAIN ] IGI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:12.095369] [DEBUG] [LOCAL ] IGI: Loaded 3756 existing records from primary storage. [2025-09-29T02:17:12.211096] [INFO ] [MAIN ] IGI: Loaded 3756 primary data records. [2025-09-29T02:17:12.261768] [DEBUG] [LOCAL ] IGD: Loaded 19170 existing records from primary storage. [2025-09-29T02:17:12.310370] [INFO ] [MAIN ] IGD: Loaded 19170 primary data records. [2025-09-29T02:17:13.039533] [DEBUG] [MAIN ] IGA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:13.042407] [INFO ] [MAIN ] IGA: Generated 1820 derivative records from 9779 primary records. [2025-09-29T02:17:13.042546] [DEBUG] [LOCAL ] IGA: Saving derivative data. [2025-09-29T02:17:13.061570] [DEBUG] [LOCAL ] IGA: Derivative data saved (1820 records). [2025-09-29T02:17:13.062849] [INFO ] [MAIN ] IGA: Successfully saved derivative data. [2025-09-29T02:17:13.065138] [INFO ] [MAIN ] Derivative Progress: 1030/2211 symbols completed. IGA took 1.3s. Estimated remaining: 8m 20s. Rate: 141.7 symbols/min [2025-09-29T02:17:13.068215] [INFO ] [MAIN ] IGR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:13.083830] [DEBUG] [MAIN ] IGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:13.085075] [INFO ] [MAIN ] IGI: Generated 1820 derivative records from 3756 primary records. [2025-09-29T02:17:13.085573] [DEBUG] [LOCAL ] IGI: Saving derivative data. [2025-09-29T02:17:13.102292] [DEBUG] [LOCAL ] IGI: Derivative data saved (1820 records). [2025-09-29T02:17:13.103503] [INFO ] [MAIN ] IGI: Successfully saved derivative data. [2025-09-29T02:17:13.107342] [INFO ] [MAIN ] Derivative Progress: 1031/2211 symbols completed. IGI took 1.1s. Estimated remaining: 8m 19s. Rate: 141.8 symbols/min [2025-09-29T02:17:13.107662] [INFO ] [MAIN ] IH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:13.131106] [DEBUG] [MAIN ] IGD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:13.132111] [INFO ] [MAIN ] IGD: Generated 1820 derivative records from 19170 primary records. [2025-09-29T02:17:13.133333] [DEBUG] [LOCAL ] IGD: Saving derivative data. [2025-09-29T02:17:13.146563] [DEBUG] [LOCAL ] IH: Loaded 3450 existing records from primary storage. [2025-09-29T02:17:13.160764] [INFO ] [MAIN ] IH: Loaded 3450 primary data records. [2025-09-29T02:17:13.162437] [DEBUG] [LOCAL ] IGR: Loaded 30882 existing records from primary storage. [2025-09-29T02:17:13.164179] [INFO ] [MAIN ] IGR: Loaded 30882 primary data records. [2025-09-29T02:17:13.164928] [DEBUG] [LOCAL ] IGD: Derivative data saved (1820 records). [2025-09-29T02:17:13.271409] [INFO ] [MAIN ] IGD: Successfully saved derivative data. [2025-09-29T02:17:13.339486] [INFO ] [MAIN ] Derivative Progress: 1032/2211 symbols completed. IGD took 1.4s. Estimated remaining: 8m 19s. Rate: 141.9 symbols/min [2025-09-29T02:17:13.411509] [INFO ] [MAIN ] IHD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:13.854576] [DEBUG] [LOCAL ] IHD: Loaded 7225 existing records from primary storage. [2025-09-29T02:17:13.854775] [INFO ] [MAIN ] IHD: Loaded 7225 primary data records. [2025-09-29T02:17:14.227783] [DEBUG] [MAIN ] IGR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:14.229176] [INFO ] [MAIN ] IGR: Generated 1820 derivative records from 30882 primary records. [2025-09-29T02:17:14.228081] [DEBUG] [MAIN ] IH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:14.230306] [INFO ] [MAIN ] IH: Generated 1820 derivative records from 3450 primary records. [2025-09-29T02:17:14.230408] [DEBUG] [LOCAL ] IGR: Saving derivative data. [2025-09-29T02:17:14.230567] [DEBUG] [LOCAL ] IH: Saving derivative data. [2025-09-29T02:17:14.265464] [DEBUG] [LOCAL ] IGR: Derivative data saved (1820 records). [2025-09-29T02:17:14.265621] [INFO ] [MAIN ] IGR: Successfully saved derivative data. [2025-09-29T02:17:14.269178] [INFO ] [MAIN ] Derivative Progress: 1033/2211 symbols completed. IGR took 1.2s. Estimated remaining: 8m 19s. Rate: 141.7 symbols/min [2025-09-29T02:17:14.263156] [DEBUG] [LOCAL ] IH: Derivative data saved (1820 records). [2025-09-29T02:17:14.269808] [INFO ] [MAIN ] IH: Successfully saved derivative data. [2025-09-29T02:17:14.272589] [INFO ] [MAIN ] Derivative Progress: 1034/2211 symbols completed. IH took 1.2s. Estimated remaining: 8m 18s. Rate: 141.9 symbols/min [2025-09-29T02:17:14.292194] [DEBUG] [MAIN ] IHD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:14.293042] [INFO ] [MAIN ] IHD: Generated 1820 derivative records from 7225 primary records. [2025-09-29T02:17:14.293139] [DEBUG] [LOCAL ] IHD: Saving derivative data. [2025-09-29T02:17:14.309620] [DEBUG] [LOCAL ] IHD: Derivative data saved (1820 records). [2025-09-29T02:17:14.309812] [INFO ] [MAIN ] IHD: Successfully saved derivative data. [2025-09-29T02:17:14.312993] [INFO ] [MAIN ] Derivative Progress: 1035/2211 symbols completed. IHD took 0.9s. Estimated remaining: 8m 17s. Rate: 142.0 symbols/min [2025-09-29T02:17:14.313775] [INFO ] [MAIN ] IIF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:14.313674] [INFO ] [MAIN ] IHG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:14.313862] [INFO ] [MAIN ] IHS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:14.324806] [DEBUG] [LOCAL ] IIF: Loaded 5787 existing records from primary storage. [2025-09-29T02:17:14.325258] [INFO ] [MAIN ] IIF: Loaded 5787 primary data records. [2025-09-29T02:17:14.527765] [DEBUG] [LOCAL ] IHG: Loaded 24977 existing records from primary storage. [2025-09-29T02:17:14.686604] [INFO ] [MAIN ] IHG: Loaded 24977 primary data records. [2025-09-29T02:17:14.708670] [DEBUG] [LOCAL ] IHS: Loaded 39400 existing records from primary storage. [2025-09-29T02:17:14.757730] [INFO ] [MAIN ] IHS: Loaded 39400 primary data records. [2025-09-29T02:17:15.449745] [DEBUG] [MAIN ] IIF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:15.452887] [INFO ] [MAIN ] IIF: Generated 1820 derivative records from 5787 primary records. [2025-09-29T02:17:15.453048] [DEBUG] [LOCAL ] IIF: Saving derivative data. [2025-09-29T02:17:15.474476] [DEBUG] [LOCAL ] IIF: Derivative data saved (1820 records). [2025-09-29T02:17:15.476136] [INFO ] [MAIN ] IIF: Successfully saved derivative data. [2025-09-29T02:17:15.478866] [INFO ] [MAIN ] Derivative Progress: 1036/2211 symbols completed. IIF took 1.2s. Estimated remaining: 8m 17s. Rate: 141.7 symbols/min [2025-09-29T02:17:15.479242] [INFO ] [MAIN ] IIIN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:15.500771] [DEBUG] [MAIN ] IHG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:15.509853] [INFO ] [MAIN ] IHG: Generated 1820 derivative records from 24977 primary records. [2025-09-29T02:17:15.510387] [DEBUG] [LOCAL ] IHG: Saving derivative data. [2025-09-29T02:17:15.531735] [DEBUG] [MAIN ] IHS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:15.542753] [INFO ] [MAIN ] IHS: Generated 1820 derivative records from 39400 primary records. [2025-09-29T02:17:15.532883] [DEBUG] [LOCAL ] IIIN: Loaded 16828 existing records from primary storage. [2025-09-29T02:17:15.547075] [DEBUG] [LOCAL ] IHS: Saving derivative data. [2025-09-29T02:17:15.550680] [INFO ] [MAIN ] IIIN: Loaded 16828 primary data records. [2025-09-29T02:17:15.554450] [DEBUG] [LOCAL ] IHG: Derivative data saved (1820 records). [2025-09-29T02:17:15.570051] [INFO ] [MAIN ] IHG: Successfully saved derivative data. [2025-09-29T02:17:15.603417] [INFO ] [MAIN ] Derivative Progress: 1037/2211 symbols completed. IHG took 1.3s. Estimated remaining: 8m 17s. Rate: 141.8 symbols/min [2025-09-29T02:17:15.641719] [INFO ] [MAIN ] IIM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:15.649738] [DEBUG] [LOCAL ] IHS: Derivative data saved (1820 records). [2025-09-29T02:17:15.676124] [INFO ] [MAIN ] IHS: Successfully saved derivative data. [2025-09-29T02:17:15.700968] [INFO ] [MAIN ] Derivative Progress: 1038/2211 symbols completed. IHS took 1.4s. Estimated remaining: 8m 16s. Rate: 141.9 symbols/min [2025-09-29T02:17:15.707055] [INFO ] [MAIN ] IIPR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:15.935259] [DEBUG] [LOCAL ] IIM: Loaded 16102 existing records from primary storage. [2025-09-29T02:17:15.935442] [INFO ] [MAIN ] IIM: Loaded 16102 primary data records. [2025-09-29T02:17:16.092040] [DEBUG] [LOCAL ] IIPR: Loaded 30052 existing records from primary storage. [2025-09-29T02:17:16.106751] [INFO ] [MAIN ] IIPR: Loaded 30052 primary data records. [2025-09-29T02:17:16.554986] [DEBUG] [MAIN ] IIIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:16.695841] [INFO ] [MAIN ] IIIN: Generated 1820 derivative records from 16828 primary records. [2025-09-29T02:17:16.701512] [DEBUG] [LOCAL ] IIIN: Saving derivative data. [2025-09-29T02:17:16.736531] [DEBUG] [LOCAL ] IIIN: Derivative data saved (1820 records). [2025-09-29T02:17:16.737959] [INFO ] [MAIN ] IIIN: Successfully saved derivative data. [2025-09-29T02:17:16.742736] [INFO ] [MAIN ] Derivative Progress: 1039/2211 symbols completed. IIIN took 1.3s. Estimated remaining: 8m 16s. Rate: 141.7 symbols/min [2025-09-29T02:17:16.742996] [INFO ] [MAIN ] IMAX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:16.765461] [DEBUG] [MAIN ] IIM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:16.767841] [INFO ] [MAIN ] IIM: Generated 1820 derivative records from 16102 primary records. [2025-09-29T02:17:16.768190] [DEBUG] [LOCAL ] IIM: Saving derivative data. [2025-09-29T02:17:16.790920] [DEBUG] [LOCAL ] IIM: Derivative data saved (1820 records). [2025-09-29T02:17:16.805422] [INFO ] [MAIN ] IIM: Successfully saved derivative data. [2025-09-29T02:17:16.805308] [DEBUG] [MAIN ] IIPR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:16.808917] [INFO ] [MAIN ] Derivative Progress: 1040/2211 symbols completed. IIM took 1.2s. Estimated remaining: 8m 15s. Rate: 141.9 symbols/min [2025-09-29T02:17:16.810304] [INFO ] [MAIN ] IIPR: Generated 1820 derivative records from 30052 primary records. [2025-09-29T02:17:16.821159] [DEBUG] [LOCAL ] IIPR: Saving derivative data. [2025-09-29T02:17:16.820550] [INFO ] [MAIN ] INFA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:16.852991] [DEBUG] [LOCAL ] IIPR: Derivative data saved (1820 records). [2025-09-29T02:17:16.853294] [INFO ] [MAIN ] IIPR: Successfully saved derivative data. [2025-09-29T02:17:16.856436] [INFO ] [MAIN ] Derivative Progress: 1041/2211 symbols completed. IIPR took 1.1s. Estimated remaining: 8m 14s. Rate: 142.0 symbols/min [2025-09-29T02:17:16.856921] [INFO ] [MAIN ] INFY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:16.858774] [DEBUG] [LOCAL ] IMAX: Loaded 43382 existing records from primary storage. [2025-09-29T02:17:16.859243] [INFO ] [MAIN ] IMAX: Loaded 43382 primary data records. [2025-09-29T02:17:17.267924] [DEBUG] [LOCAL ] INFA: Loaded 50602 existing records from primary storage. [2025-09-29T02:17:17.269330] [INFO ] [MAIN ] INFA: Loaded 50602 primary data records. [2025-09-29T02:17:17.402966] [DEBUG] [LOCAL ] INFY: Loaded 54378 existing records from primary storage. [2025-09-29T02:17:17.409279] [INFO ] [MAIN ] INFY: Loaded 54378 primary data records. [2025-09-29T02:17:17.968867] [DEBUG] [MAIN ] IMAX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:17.969813] [INFO ] [MAIN ] IMAX: Generated 1820 derivative records from 43382 primary records. [2025-09-29T02:17:17.971261] [DEBUG] [LOCAL ] IMAX: Saving derivative data. [2025-09-29T02:17:17.994870] [DEBUG] [LOCAL ] IMAX: Derivative data saved (1820 records). [2025-09-29T02:17:17.997979] [INFO ] [MAIN ] IMAX: Successfully saved derivative data. [2025-09-29T02:17:18.001703] [INFO ] [MAIN ] Derivative Progress: 1042/2211 symbols completed. IMAX took 1.3s. Estimated remaining: 8m 15s. Rate: 141.7 symbols/min [2025-09-29T02:17:18.002091] [INFO ] [MAIN ] ING: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:18.017946] [DEBUG] [MAIN ] INFA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:18.019429] [INFO ] [MAIN ] INFA: Generated 1820 derivative records from 50602 primary records. [2025-09-29T02:17:18.019824] [DEBUG] [LOCAL ] INFA: Saving derivative data. [2025-09-29T02:17:18.039969] [DEBUG] [LOCAL ] INFA: Derivative data saved (1820 records). [2025-09-29T02:17:18.040787] [INFO ] [MAIN ] INFA: Successfully saved derivative data. [2025-09-29T02:17:18.045034] [INFO ] [MAIN ] Derivative Progress: 1043/2211 symbols completed. INFA took 1.2s. Estimated remaining: 8m 14s. Rate: 141.9 symbols/min [2025-09-29T02:17:18.046737] [INFO ] [MAIN ] INGM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:18.063897] [DEBUG] [MAIN ] INFY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:18.065311] [INFO ] [MAIN ] INFY: Generated 1820 derivative records from 54378 primary records. [2025-09-29T02:17:18.065662] [DEBUG] [LOCAL ] INFY: Saving derivative data. [2025-09-29T02:17:18.083556] [DEBUG] [LOCAL ] INFY: Derivative data saved (1820 records). [2025-09-29T02:17:18.083825] [INFO ] [MAIN ] INFY: Successfully saved derivative data. [2025-09-29T02:17:18.087093] [INFO ] [MAIN ] Derivative Progress: 1044/2211 symbols completed. INFY took 1.2s. Estimated remaining: 8m 13s. Rate: 142.0 symbols/min [2025-09-29T02:17:18.102018] [INFO ] [MAIN ] INGR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:18.143232] [DEBUG] [LOCAL ] INGM: Loaded 29224 existing records from primary storage. [2025-09-29T02:17:18.143587] [INFO ] [MAIN ] INGM: Loaded 29224 primary data records. [2025-09-29T02:17:18.170448] [DEBUG] [LOCAL ] ING: Loaded 51537 existing records from primary storage. [2025-09-29T02:17:18.202801] [INFO ] [MAIN ] ING: Loaded 51537 primary data records. [2025-09-29T02:17:18.426977] [DEBUG] [LOCAL ] INGR: Loaded 33913 existing records from primary storage. [2025-09-29T02:17:18.482954] [INFO ] [MAIN ] INGR: Loaded 33913 primary data records. [2025-09-29T02:17:19.302362] [DEBUG] [MAIN ] INGM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:19.309206] [DEBUG] [MAIN ] ING: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:19.310235] [INFO ] [MAIN ] INGM: Generated 1820 derivative records from 29224 primary records. [2025-09-29T02:17:19.311609] [INFO ] [MAIN ] ING: Generated 1820 derivative records from 51537 primary records. [2025-09-29T02:17:19.311857] [DEBUG] [LOCAL ] INGM: Saving derivative data. [2025-09-29T02:17:19.312279] [DEBUG] [LOCAL ] ING: Saving derivative data. [2025-09-29T02:17:19.340848] [DEBUG] [LOCAL ] INGM: Derivative data saved (1820 records). [2025-09-29T02:17:19.344050] [INFO ] [MAIN ] INGM: Successfully saved derivative data. [2025-09-29T02:17:19.351819] [INFO ] [MAIN ] Derivative Progress: 1045/2211 symbols completed. INGM took 1.3s. Estimated remaining: 8m 14s. Rate: 141.7 symbols/min [2025-09-29T02:17:19.354620] [DEBUG] [LOCAL ] ING: Derivative data saved (1820 records). [2025-09-29T02:17:19.354958] [INFO ] [MAIN ] ING: Successfully saved derivative data. [2025-09-29T02:17:19.359743] [INFO ] [MAIN ] INN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:19.361235] [INFO ] [MAIN ] Derivative Progress: 1046/2211 symbols completed. ING took 1.4s. Estimated remaining: 8m 13s. Rate: 141.9 symbols/min [2025-09-29T02:17:19.363684] [INFO ] [MAIN ] INSP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:19.379925] [DEBUG] [MAIN ] INGR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:19.380977] [INFO ] [MAIN ] INGR: Generated 1820 derivative records from 33913 primary records. [2025-09-29T02:17:19.381220] [DEBUG] [LOCAL ] INGR: Saving derivative data. [2025-09-29T02:17:19.399453] [DEBUG] [LOCAL ] INGR: Derivative data saved (1820 records). [2025-09-29T02:17:19.399809] [INFO ] [MAIN ] INGR: Successfully saved derivative data. [2025-09-29T02:17:19.403128] [INFO ] [MAIN ] Derivative Progress: 1047/2211 symbols completed. INGR took 1.3s. Estimated remaining: 8m 12s. Rate: 142.0 symbols/min [2025-09-29T02:17:19.403562] [INFO ] [MAIN ] INSW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:19.450301] [DEBUG] [LOCAL ] INSP: Loaded 37492 existing records from primary storage. [2025-09-29T02:17:19.451363] [INFO ] [MAIN ] INSP: Loaded 37492 primary data records. [2025-09-29T02:17:19.573452] [DEBUG] [LOCAL ] INN: Loaded 42433 existing records from primary storage. [2025-09-29T02:17:19.596810] [INFO ] [MAIN ] INN: Loaded 42433 primary data records. [2025-09-29T02:17:19.656531] [DEBUG] [LOCAL ] INSW: Loaded 40831 existing records from primary storage. [2025-09-29T02:17:19.726516] [INFO ] [MAIN ] INSW: Loaded 40831 primary data records. [2025-09-29T02:17:20.525518] [DEBUG] [MAIN ] INSP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:20.526793] [INFO ] [MAIN ] INSP: Generated 1820 derivative records from 37492 primary records. [2025-09-29T02:17:20.527960] [DEBUG] [LOCAL ] INSP: Saving derivative data. [2025-09-29T02:17:20.548605] [DEBUG] [LOCAL ] INSP: Derivative data saved (1820 records). [2025-09-29T02:17:20.548826] [INFO ] [MAIN ] INSP: Successfully saved derivative data. [2025-09-29T02:17:20.551408] [INFO ] [MAIN ] Derivative Progress: 1048/2211 symbols completed. INSP took 1.2s. Estimated remaining: 8m 12s. Rate: 141.7 symbols/min [2025-09-29T02:17:20.565149] [DEBUG] [MAIN ] INN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:20.566021] [INFO ] [MAIN ] INN: Generated 1820 derivative records from 42433 primary records. [2025-09-29T02:17:20.566308] [DEBUG] [LOCAL ] INN: Saving derivative data. [2025-09-29T02:17:20.584551] [DEBUG] [LOCAL ] INN: Derivative data saved (1820 records). [2025-09-29T02:17:20.597179] [DEBUG] [MAIN ] INSW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:20.597337] [INFO ] [MAIN ] INN: Successfully saved derivative data. [2025-09-29T02:17:20.598087] [INFO ] [MAIN ] INSW: Generated 1820 derivative records from 40831 primary records. [2025-09-29T02:17:20.598180] [DEBUG] [LOCAL ] INSW: Saving derivative data. [2025-09-29T02:17:20.602385] [INFO ] [MAIN ] Derivative Progress: 1049/2211 symbols completed. INN took 1.2s. Estimated remaining: 8m 11s. Rate: 141.9 symbols/min [2025-09-29T02:17:20.622088] [DEBUG] [LOCAL ] INSW: Derivative data saved (1820 records). [2025-09-29T02:17:20.622230] [INFO ] [MAIN ] INSW: Successfully saved derivative data. [2025-09-29T02:17:20.625922] [INFO ] [MAIN ] Derivative Progress: 1050/2211 symbols completed. INSW took 1.2s. Estimated remaining: 8m 11s. Rate: 142.0 symbols/min [2025-09-29T02:17:20.626557] [INFO ] [MAIN ] INVH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:20.626607] [INFO ] [MAIN ] IONQ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:20.626680] [INFO ] [MAIN ] INVX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:20.666383] [DEBUG] [LOCAL ] INVX: Loaded 29366 existing records from primary storage. [2025-09-29T02:17:20.666581] [INFO ] [MAIN ] INVX: Loaded 29366 primary data records. [2025-09-29T02:17:20.844819] [DEBUG] [LOCAL ] IONQ: Loaded 54568 existing records from primary storage. [2025-09-29T02:17:20.869699] [INFO ] [MAIN ] IONQ: Loaded 54568 primary data records. [2025-09-29T02:17:20.931617] [DEBUG] [LOCAL ] INVH: Loaded 53918 existing records from primary storage. [2025-09-29T02:17:21.078764] [INFO ] [MAIN ] INVH: Loaded 53918 primary data records. [2025-09-29T02:17:21.810471] [DEBUG] [MAIN ] INVX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:21.811976] [INFO ] [MAIN ] INVX: Generated 1820 derivative records from 29366 primary records. [2025-09-29T02:17:21.814081] [DEBUG] [LOCAL ] INVX: Saving derivative data. [2025-09-29T02:17:21.836020] [DEBUG] [LOCAL ] INVX: Derivative data saved (1820 records). [2025-09-29T02:17:21.836348] [INFO ] [MAIN ] INVX: Successfully saved derivative data. [2025-09-29T02:17:21.839714] [INFO ] [MAIN ] Derivative Progress: 1051/2211 symbols completed. INVX took 1.2s. Estimated remaining: 8m 11s. Rate: 141.7 symbols/min [2025-09-29T02:17:21.840731] [INFO ] [MAIN ] IOT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:21.865128] [DEBUG] [MAIN ] IONQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:21.866428] [INFO ] [MAIN ] IONQ: Generated 1820 derivative records from 54568 primary records. [2025-09-29T02:17:21.866693] [DEBUG] [LOCAL ] IONQ: Saving derivative data. [2025-09-29T02:17:21.886211] [DEBUG] [LOCAL ] IONQ: Derivative data saved (1820 records). [2025-09-29T02:17:21.890249] [INFO ] [MAIN ] IONQ: Successfully saved derivative data. [2025-09-29T02:17:21.894399] [INFO ] [MAIN ] Derivative Progress: 1052/2211 symbols completed. IONQ took 1.3s. Estimated remaining: 8m 10s. Rate: 141.9 symbols/min [2025-09-29T02:17:21.894898] [INFO ] [MAIN ] IP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:21.910342] [DEBUG] [MAIN ] INVH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:21.911290] [INFO ] [MAIN ] INVH: Generated 1820 derivative records from 53918 primary records. [2025-09-29T02:17:21.911515] [DEBUG] [LOCAL ] INVH: Saving derivative data. [2025-09-29T02:17:21.949134] [DEBUG] [LOCAL ] INVH: Derivative data saved (1820 records). [2025-09-29T02:17:21.949565] [INFO ] [MAIN ] INVH: Successfully saved derivative data. [2025-09-29T02:17:21.953720] [INFO ] [MAIN ] Derivative Progress: 1053/2211 symbols completed. INVH took 1.3s. Estimated remaining: 8m 9s. Rate: 142.0 symbols/min [2025-09-29T02:17:21.954060] [INFO ] [MAIN ] IPG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:21.977256] [DEBUG] [LOCAL ] IOT: Loaded 54249 existing records from primary storage. [2025-09-29T02:17:21.977566] [INFO ] [MAIN ] IOT: Loaded 54249 primary data records. [2025-09-29T02:17:22.155744] [DEBUG] [LOCAL ] IP: Loaded 54093 existing records from primary storage. [2025-09-29T02:17:22.234978] [INFO ] [MAIN ] IP: Loaded 54093 primary data records. [2025-09-29T02:17:22.499088] [DEBUG] [LOCAL ] IPG: Loaded 54110 existing records from primary storage. [2025-09-29T02:17:22.505511] [INFO ] [MAIN ] IPG: Loaded 54110 primary data records. [2025-09-29T02:17:23.073927] [DEBUG] [MAIN ] IOT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:23.074947] [INFO ] [MAIN ] IOT: Generated 1820 derivative records from 54249 primary records. [2025-09-29T02:17:23.075583] [DEBUG] [LOCAL ] IOT: Saving derivative data. [2025-09-29T02:17:23.096481] [DEBUG] [LOCAL ] IOT: Derivative data saved (1820 records). [2025-09-29T02:17:23.098161] [INFO ] [MAIN ] IOT: Successfully saved derivative data. [2025-09-29T02:17:23.102230] [INFO ] [MAIN ] Derivative Progress: 1054/2211 symbols completed. IOT took 1.3s. Estimated remaining: 8m 10s. Rate: 141.7 symbols/min [2025-09-29T02:17:23.102585] [INFO ] [MAIN ] IPI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:23.122545] [DEBUG] [MAIN ] IP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:23.124150] [INFO ] [MAIN ] IP: Generated 1820 derivative records from 54093 primary records. [2025-09-29T02:17:23.124472] [DEBUG] [LOCAL ] IP: Saving derivative data. [2025-09-29T02:17:23.148245] [DEBUG] [LOCAL ] IP: Derivative data saved (1820 records). [2025-09-29T02:17:23.157064] [DEBUG] [LOCAL ] IPI: Loaded 21704 existing records from primary storage. [2025-09-29T02:17:23.159266] [INFO ] [MAIN ] IPI: Loaded 21704 primary data records. [2025-09-29T02:17:23.157154] [INFO ] [MAIN ] IP: Successfully saved derivative data. [2025-09-29T02:17:23.175203] [INFO ] [MAIN ] Derivative Progress: 1055/2211 symbols completed. IP took 1.3s. Estimated remaining: 8m 9s. Rate: 141.9 symbols/min [2025-09-29T02:17:23.199348] [DEBUG] [MAIN ] IPG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:23.217803] [INFO ] [MAIN ] IPG: Generated 1820 derivative records from 54110 primary records. [2025-09-29T02:17:23.211581] [INFO ] [MAIN ] IQI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:23.218036] [DEBUG] [LOCAL ] IPG: Saving derivative data. [2025-09-29T02:17:23.309960] [DEBUG] [LOCAL ] IPG: Derivative data saved (1820 records). [2025-09-29T02:17:23.320957] [INFO ] [MAIN ] IPG: Successfully saved derivative data. [2025-09-29T02:17:23.323859] [INFO ] [MAIN ] Derivative Progress: 1056/2211 symbols completed. IPG took 1.4s. Estimated remaining: 8m 8s. Rate: 141.9 symbols/min [2025-09-29T02:17:23.368900] [INFO ] [MAIN ] IQV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:23.397776] [DEBUG] [LOCAL ] IQI: Loaded 18161 existing records from primary storage. [2025-09-29T02:17:23.399207] [INFO ] [MAIN ] IQI: Loaded 18161 primary data records. [2025-09-29T02:17:23.993379] [DEBUG] [LOCAL ] IQV: Loaded 50895 existing records from primary storage. [2025-09-29T02:17:23.994458] [INFO ] [MAIN ] IQV: Loaded 50895 primary data records. [2025-09-29T02:17:24.171386] [DEBUG] [MAIN ] IPI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:24.218032] [INFO ] [MAIN ] IPI: Generated 1820 derivative records from 21704 primary records. [2025-09-29T02:17:24.351613] [DEBUG] [LOCAL ] IPI: Saving derivative data. [2025-09-29T02:17:24.379251] [DEBUG] [LOCAL ] IPI: Derivative data saved (1820 records). [2025-09-29T02:17:24.393204] [INFO ] [MAIN ] IPI: Successfully saved derivative data. [2025-09-29T02:17:24.396481] [INFO ] [MAIN ] Derivative Progress: 1057/2211 symbols completed. IPI took 1.3s. Estimated remaining: 8m 9s. Rate: 141.7 symbols/min [2025-09-29T02:17:24.397967] [INFO ] [MAIN ] IR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:24.397633] [DEBUG] [MAIN ] IQI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:24.399303] [INFO ] [MAIN ] IQI: Generated 1820 derivative records from 18161 primary records. [2025-09-29T02:17:24.399616] [DEBUG] [LOCAL ] IQI: Saving derivative data. [2025-09-29T02:17:24.418777] [DEBUG] [LOCAL ] IQI: Derivative data saved (1820 records). [2025-09-29T02:17:24.419112] [INFO ] [MAIN ] IQI: Successfully saved derivative data. [2025-09-29T02:17:24.422367] [INFO ] [MAIN ] Derivative Progress: 1058/2211 symbols completed. IQI took 1.2s. Estimated remaining: 8m 8s. Rate: 141.9 symbols/min [2025-09-29T02:17:24.422854] [INFO ] [MAIN ] IRM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:24.443014] [DEBUG] [MAIN ] IQV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:24.444000] [INFO ] [MAIN ] IQV: Generated 1820 derivative records from 50895 primary records. [2025-09-29T02:17:24.444166] [DEBUG] [LOCAL ] IQV: Saving derivative data. [2025-09-29T02:17:24.463919] [DEBUG] [LOCAL ] IQV: Derivative data saved (1820 records). [2025-09-29T02:17:24.464030] [INFO ] [MAIN ] IQV: Successfully saved derivative data. [2025-09-29T02:17:24.467254] [INFO ] [MAIN ] Derivative Progress: 1059/2211 symbols completed. IQV took 1.1s. Estimated remaining: 8m 7s. Rate: 142.0 symbols/min [2025-09-29T02:17:24.467621] [INFO ] [MAIN ] IRS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:24.526947] [DEBUG] [LOCAL ] IR: Loaded 53470 existing records from primary storage. [2025-09-29T02:17:24.528726] [INFO ] [MAIN ] IR: Loaded 53470 primary data records. [2025-09-29T02:17:24.607206] [DEBUG] [LOCAL ] IRS: Loaded 22136 existing records from primary storage. [2025-09-29T02:17:24.608056] [DEBUG] [LOCAL ] IRM: Loaded 50159 existing records from primary storage. [2025-09-29T02:17:24.649432] [INFO ] [MAIN ] IRS: Loaded 22136 primary data records. [2025-09-29T02:17:24.660327] [INFO ] [MAIN ] IRM: Loaded 50159 primary data records. [2025-09-29T02:17:25.609177] [DEBUG] [MAIN ] IR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:25.610810] [INFO ] [MAIN ] IR: Generated 1820 derivative records from 53470 primary records. [2025-09-29T02:17:25.611065] [DEBUG] [LOCAL ] IR: Saving derivative data. [2025-09-29T02:17:25.630937] [DEBUG] [LOCAL ] IR: Derivative data saved (1820 records). [2025-09-29T02:17:25.631044] [INFO ] [MAIN ] IR: Successfully saved derivative data. [2025-09-29T02:17:25.633822] [INFO ] [MAIN ] Derivative Progress: 1060/2211 symbols completed. IR took 1.2s. Estimated remaining: 8m 7s. Rate: 141.7 symbols/min [2025-09-29T02:17:25.634041] [INFO ] [MAIN ] IRT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:25.668169] [DEBUG] [MAIN ] IRS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:25.668996] [DEBUG] [MAIN ] IRM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:25.670775] [INFO ] [MAIN ] IRM: Generated 1820 derivative records from 50159 primary records. [2025-09-29T02:17:25.670879] [DEBUG] [LOCAL ] IRM: Saving derivative data. [2025-09-29T02:17:25.669941] [INFO ] [MAIN ] IRS: Generated 1820 derivative records from 22136 primary records. [2025-09-29T02:17:25.671921] [DEBUG] [LOCAL ] IRS: Saving derivative data. [2025-09-29T02:17:25.705725] [DEBUG] [LOCAL ] IRS: Derivative data saved (1820 records). [2025-09-29T02:17:25.705963] [INFO ] [MAIN ] IRS: Successfully saved derivative data. [2025-09-29T02:17:25.709077] [INFO ] [MAIN ] Derivative Progress: 1061/2211 symbols completed. IRS took 1.2s. Estimated remaining: 8m 6s. Rate: 141.9 symbols/min [2025-09-29T02:17:25.709304] [INFO ] [MAIN ] ISD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:25.703916] [DEBUG] [LOCAL ] IRM: Derivative data saved (1820 records). [2025-09-29T02:17:25.709664] [INFO ] [MAIN ] IRM: Successfully saved derivative data. [2025-09-29T02:17:25.713089] [INFO ] [MAIN ] Derivative Progress: 1062/2211 symbols completed. IRM took 1.3s. Estimated remaining: 8m 6s. Rate: 142.0 symbols/min [2025-09-29T02:17:25.713452] [INFO ] [MAIN ] IT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:25.748712] [DEBUG] [LOCAL ] ISD: Loaded 15803 existing records from primary storage. [2025-09-29T02:17:25.763792] [INFO ] [MAIN ] ISD: Loaded 15803 primary data records. [2025-09-29T02:17:25.764961] [DEBUG] [LOCAL ] IRT: Loaded 51146 existing records from primary storage. [2025-09-29T02:17:25.815265] [INFO ] [MAIN ] IRT: Loaded 51146 primary data records. [2025-09-29T02:17:25.990739] [DEBUG] [LOCAL ] IT: Loaded 42234 existing records from primary storage. [2025-09-29T02:17:26.042425] [INFO ] [MAIN ] IT: Loaded 42234 primary data records. [2025-09-29T02:17:26.840960] [DEBUG] [MAIN ] ISD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:26.854935] [DEBUG] [MAIN ] IRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:26.856093] [INFO ] [MAIN ] ISD: Generated 1820 derivative records from 15803 primary records. [2025-09-29T02:17:26.857260] [INFO ] [MAIN ] IRT: Generated 1820 derivative records from 51146 primary records. [2025-09-29T02:17:26.857448] [DEBUG] [LOCAL ] IRT: Saving derivative data. [2025-09-29T02:17:26.857671] [DEBUG] [LOCAL ] ISD: Saving derivative data. [2025-09-29T02:17:26.896495] [DEBUG] [LOCAL ] IRT: Derivative data saved (1820 records). [2025-09-29T02:17:26.899039] [INFO ] [MAIN ] IRT: Successfully saved derivative data. [2025-09-29T02:17:26.902003] [INFO ] [MAIN ] Derivative Progress: 1063/2211 symbols completed. IRT took 1.3s. Estimated remaining: 8m 6s. Rate: 141.7 symbols/min [2025-09-29T02:17:26.904922] [DEBUG] [LOCAL ] ISD: Derivative data saved (1820 records). [2025-09-29T02:17:26.905193] [INFO ] [MAIN ] ISD: Successfully saved derivative data. [2025-09-29T02:17:26.908405] [INFO ] [MAIN ] Derivative Progress: 1064/2211 symbols completed. ISD took 1.2s. Estimated remaining: 8m 5s. Rate: 141.9 symbols/min [2025-09-29T02:17:26.924739] [DEBUG] [MAIN ] IT: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:17:26.925727] [INFO ] [MAIN ] IT: Generated 1819 derivative records from 42234 primary records. [2025-09-29T02:17:26.925840] [DEBUG] [LOCAL ] IT: Saving derivative data. [2025-09-29T02:17:26.942460] [DEBUG] [LOCAL ] IT: Derivative data saved (1819 records). [2025-09-29T02:17:26.942562] [INFO ] [MAIN ] IT: Successfully saved derivative data. [2025-09-29T02:17:26.946916] [INFO ] [MAIN ] Derivative Progress: 1065/2211 symbols completed. IT took 1.2s. Estimated remaining: 8m 4s. Rate: 142.0 symbols/min [2025-09-29T02:17:26.947697] [INFO ] [MAIN ] ITGR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:26.947854] [INFO ] [MAIN ] ITUB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:26.948155] [INFO ] [MAIN ] ITT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:26.997365] [DEBUG] [LOCAL ] ITGR: Loaded 31996 existing records from primary storage. [2025-09-29T02:17:27.011230] [INFO ] [MAIN ] ITGR: Loaded 31996 primary data records. [2025-09-29T02:17:27.103998] [DEBUG] [LOCAL ] ITT: Loaded 33511 existing records from primary storage. [2025-09-29T02:17:27.116627] [INFO ] [MAIN ] ITT: Loaded 33511 primary data records. [2025-09-29T02:17:27.210095] [DEBUG] [LOCAL ] ITUB: Loaded 54084 existing records from primary storage. [2025-09-29T02:17:27.255600] [INFO ] [MAIN ] ITUB: Loaded 54084 primary data records. [2025-09-29T02:17:28.133267] [DEBUG] [MAIN ] ITGR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:28.134409] [INFO ] [MAIN ] ITGR: Generated 1820 derivative records from 31996 primary records. [2025-09-29T02:17:28.134535] [DEBUG] [LOCAL ] ITGR: Saving derivative data. [2025-09-29T02:17:28.156963] [DEBUG] [LOCAL ] ITGR: Derivative data saved (1820 records). [2025-09-29T02:17:28.165587] [INFO ] [MAIN ] ITGR: Successfully saved derivative data. [2025-09-29T02:17:28.173965] [INFO ] [MAIN ] Derivative Progress: 1066/2211 symbols completed. ITGR took 1.2s. Estimated remaining: 8m 5s. Rate: 141.7 symbols/min [2025-09-29T02:17:28.175584] [DEBUG] [MAIN ] ITT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:28.175829] [INFO ] [MAIN ] ITW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:28.177780] [INFO ] [MAIN ] ITT: Generated 1820 derivative records from 33511 primary records. [2025-09-29T02:17:28.179344] [DEBUG] [LOCAL ] ITT: Saving derivative data. [2025-09-29T02:17:28.201388] [DEBUG] [MAIN ] ITUB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:28.209816] [DEBUG] [LOCAL ] ITT: Derivative data saved (1820 records). [2025-09-29T02:17:28.210898] [INFO ] [MAIN ] ITUB: Generated 1820 derivative records from 54084 primary records. [2025-09-29T02:17:28.211145] [DEBUG] [LOCAL ] ITUB: Saving derivative data. [2025-09-29T02:17:28.211289] [INFO ] [MAIN ] ITT: Successfully saved derivative data. [2025-09-29T02:17:28.214880] [INFO ] [MAIN ] Derivative Progress: 1067/2211 symbols completed. ITT took 1.3s. Estimated remaining: 8m 4s. Rate: 141.9 symbols/min [2025-09-29T02:17:28.215744] [INFO ] [MAIN ] IVR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:28.233166] [DEBUG] [LOCAL ] ITUB: Derivative data saved (1820 records). [2025-09-29T02:17:28.233446] [INFO ] [MAIN ] ITUB: Successfully saved derivative data. [2025-09-29T02:17:28.236145] [INFO ] [MAIN ] Derivative Progress: 1068/2211 symbols completed. ITUB took 1.3s. Estimated remaining: 8m 3s. Rate: 142.0 symbols/min [2025-09-29T02:17:28.236508] [INFO ] [MAIN ] IVT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:28.294993] [DEBUG] [LOCAL ] IVT: Loaded 31325 existing records from primary storage. [2025-09-29T02:17:28.309887] [INFO ] [MAIN ] IVT: Loaded 31325 primary data records. [2025-09-29T02:17:28.317730] [DEBUG] [LOCAL ] ITW: Loaded 46782 existing records from primary storage. [2025-09-29T02:17:28.374601] [INFO ] [MAIN ] ITW: Loaded 46782 primary data records. [2025-09-29T02:17:28.399050] [DEBUG] [LOCAL ] IVR: Loaded 48557 existing records from primary storage. [2025-09-29T02:17:28.483999] [INFO ] [MAIN ] IVR: Loaded 48557 primary data records. [2025-09-29T02:17:29.360448] [DEBUG] [MAIN ] IVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:29.362832] [INFO ] [MAIN ] IVT: Generated 1820 derivative records from 31325 primary records. [2025-09-29T02:17:29.363231] [DEBUG] [LOCAL ] IVT: Saving derivative data. [2025-09-29T02:17:29.382335] [DEBUG] [LOCAL ] IVT: Derivative data saved (1820 records). [2025-09-29T02:17:29.382996] [INFO ] [MAIN ] IVT: Successfully saved derivative data. [2025-09-29T02:17:29.386981] [INFO ] [MAIN ] Derivative Progress: 1069/2211 symbols completed. IVT took 1.2s. Estimated remaining: 8m 3s. Rate: 141.8 symbols/min [2025-09-29T02:17:29.388152] [INFO ] [MAIN ] IVZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:29.406407] [DEBUG] [MAIN ] ITW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:29.407909] [INFO ] [MAIN ] ITW: Generated 1820 derivative records from 46782 primary records. [2025-09-29T02:17:29.408220] [DEBUG] [LOCAL ] ITW: Saving derivative data. [2025-09-29T02:17:29.422312] [DEBUG] [MAIN ] IVR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:29.433009] [INFO ] [MAIN ] IVR: Generated 1820 derivative records from 48557 primary records. [2025-09-29T02:17:29.439090] [DEBUG] [LOCAL ] IVR: Saving derivative data. [2025-09-29T02:17:29.441942] [DEBUG] [LOCAL ] ITW: Derivative data saved (1820 records). [2025-09-29T02:17:29.443007] [INFO ] [MAIN ] ITW: Successfully saved derivative data. [2025-09-29T02:17:29.446882] [INFO ] [MAIN ] Derivative Progress: 1070/2211 symbols completed. ITW took 1.3s. Estimated remaining: 8m 3s. Rate: 141.9 symbols/min [2025-09-29T02:17:29.447083] [INFO ] [MAIN ] IX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:29.464354] [DEBUG] [LOCAL ] IVR: Derivative data saved (1820 records). [2025-09-29T02:17:29.464868] [INFO ] [MAIN ] IVR: Successfully saved derivative data. [2025-09-29T02:17:29.468066] [INFO ] [MAIN ] Derivative Progress: 1071/2211 symbols completed. IVR took 1.3s. Estimated remaining: 8m 2s. Rate: 142.0 symbols/min [2025-09-29T02:17:29.468330] [INFO ] [MAIN ] J: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:29.508011] [DEBUG] [LOCAL ] IX: Loaded 22926 existing records from primary storage. [2025-09-29T02:17:29.508740] [INFO ] [MAIN ] IX: Loaded 22926 primary data records. [2025-09-29T02:17:29.660506] [DEBUG] [LOCAL ] IVZ: Loaded 53908 existing records from primary storage. [2025-09-29T02:17:29.662680] [INFO ] [MAIN ] IVZ: Loaded 53908 primary data records. [2025-09-29T02:17:29.765335] [DEBUG] [LOCAL ] J: Loaded 40873 existing records from primary storage. [2025-09-29T02:17:30.002759] [INFO ] [MAIN ] J: Loaded 40873 primary data records. [2025-09-29T02:17:30.651836] [DEBUG] [MAIN ] IX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:30.653073] [INFO ] [MAIN ] IX: Generated 1820 derivative records from 22926 primary records. [2025-09-29T02:17:30.653265] [DEBUG] [LOCAL ] IX: Saving derivative data. [2025-09-29T02:17:30.675004] [DEBUG] [LOCAL ] IX: Derivative data saved (1820 records). [2025-09-29T02:17:30.675611] [INFO ] [MAIN ] IX: Successfully saved derivative data. [2025-09-29T02:17:30.690905] [INFO ] [MAIN ] Derivative Progress: 1072/2211 symbols completed. IX took 1.2s. Estimated remaining: 8m 2s. Rate: 141.8 symbols/min [2025-09-29T02:17:30.691904] [DEBUG] [MAIN ] IVZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:30.691458] [INFO ] [MAIN ] JBGS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:30.693249] [INFO ] [MAIN ] IVZ: Generated 1820 derivative records from 53908 primary records. [2025-09-29T02:17:30.693527] [DEBUG] [LOCAL ] IVZ: Saving derivative data. [2025-09-29T02:17:30.729167] [DEBUG] [LOCAL ] IVZ: Derivative data saved (1820 records). [2025-09-29T02:17:30.729574] [DEBUG] [MAIN ] J: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:30.729792] [INFO ] [MAIN ] IVZ: Successfully saved derivative data. [2025-09-29T02:17:30.730599] [INFO ] [MAIN ] J: Generated 1820 derivative records from 40873 primary records. [2025-09-29T02:17:30.734220] [INFO ] [MAIN ] Derivative Progress: 1073/2211 symbols completed. IVZ took 1.3s. Estimated remaining: 8m 1s. Rate: 141.9 symbols/min [2025-09-29T02:17:30.734384] [INFO ] [MAIN ] JBI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:30.734637] [DEBUG] [LOCAL ] J: Saving derivative data. [2025-09-29T02:17:30.754464] [DEBUG] [LOCAL ] J: Derivative data saved (1820 records). [2025-09-29T02:17:30.764251] [INFO ] [MAIN ] J: Successfully saved derivative data. [2025-09-29T02:17:30.767309] [INFO ] [MAIN ] Derivative Progress: 1074/2211 symbols completed. J took 1.3s. Estimated remaining: 8m 0s. Rate: 142.0 symbols/min [2025-09-29T02:17:30.767791] [INFO ] [MAIN ] JBL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:30.790864] [DEBUG] [LOCAL ] JBGS: Loaded 43089 existing records from primary storage. [2025-09-29T02:17:30.791156] [INFO ] [MAIN ] JBGS: Loaded 43089 primary data records. [2025-09-29T02:17:30.973697] [DEBUG] [LOCAL ] JBI: Loaded 44362 existing records from primary storage. [2025-09-29T02:17:31.028264] [INFO ] [MAIN ] JBI: Loaded 44362 primary data records. [2025-09-29T02:17:31.252386] [DEBUG] [LOCAL ] JBL: Loaded 49145 existing records from primary storage. [2025-09-29T02:17:31.275023] [INFO ] [MAIN ] JBL: Loaded 49145 primary data records. [2025-09-29T02:17:31.878682] [DEBUG] [MAIN ] JBGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:31.880042] [INFO ] [MAIN ] JBGS: Generated 1820 derivative records from 43089 primary records. [2025-09-29T02:17:31.880309] [DEBUG] [LOCAL ] JBGS: Saving derivative data. [2025-09-29T02:17:31.900925] [DEBUG] [LOCAL ] JBGS: Derivative data saved (1820 records). [2025-09-29T02:17:31.901916] [INFO ] [MAIN ] JBGS: Successfully saved derivative data. [2025-09-29T02:17:31.905207] [INFO ] [MAIN ] Derivative Progress: 1075/2211 symbols completed. JBGS took 1.2s. Estimated remaining: 8m 1s. Rate: 141.8 symbols/min [2025-09-29T02:17:31.908007] [INFO ] [MAIN ] JBND: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:31.924279] [DEBUG] [MAIN ] JBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:31.925414] [INFO ] [MAIN ] JBI: Generated 1820 derivative records from 44362 primary records. [2025-09-29T02:17:31.927598] [DEBUG] [LOCAL ] JBI: Saving derivative data. [2025-09-29T02:17:31.953538] [DEBUG] [LOCAL ] JBI: Derivative data saved (1820 records). [2025-09-29T02:17:31.966379] [INFO ] [MAIN ] JBI: Successfully saved derivative data. [2025-09-29T02:17:31.967519] [DEBUG] [MAIN ] JBL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:31.970039] [INFO ] [MAIN ] Derivative Progress: 1076/2211 symbols completed. JBI took 1.2s. Estimated remaining: 7m 60s. Rate: 141.9 symbols/min [2025-09-29T02:17:31.970362] [INFO ] [MAIN ] JCE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:31.971478] [INFO ] [MAIN ] JBL: Generated 1820 derivative records from 49145 primary records. [2025-09-29T02:17:31.971638] [DEBUG] [LOCAL ] JBL: Saving derivative data. [2025-09-29T02:17:32.000909] [DEBUG] [LOCAL ] JBL: Derivative data saved (1820 records). [2025-09-29T02:17:32.001899] [DEBUG] [LOCAL ] JBND: Loaded 26051 existing records from primary storage. [2025-09-29T02:17:32.002173] [INFO ] [MAIN ] JBL: Successfully saved derivative data. [2025-09-29T02:17:32.002593] [INFO ] [MAIN ] JBND: Loaded 26051 primary data records. [2025-09-29T02:17:32.004892] [INFO ] [MAIN ] Derivative Progress: 1077/2211 symbols completed. JBL took 1.2s. Estimated remaining: 7m 59s. Rate: 142.0 symbols/min [2025-09-29T02:17:32.014962] [DEBUG] [LOCAL ] JCE: Loaded 6591 existing records from primary storage. [2025-09-29T02:17:32.015254] [INFO ] [MAIN ] JCI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:32.015460] [INFO ] [MAIN ] JCE: Loaded 6591 primary data records. [2025-09-29T02:17:32.793874] [DEBUG] [LOCAL ] JCI: Loaded 54327 existing records from primary storage. [2025-09-29T02:17:32.796620] [INFO ] [MAIN ] JCI: Loaded 54327 primary data records. [2025-09-29T02:17:33.154613] [DEBUG] [MAIN ] JBND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:33.169959] [DEBUG] [MAIN ] JCE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:33.169568] [INFO ] [MAIN ] JBND: Generated 1820 derivative records from 26051 primary records. [2025-09-29T02:17:33.170859] [INFO ] [MAIN ] JCE: Generated 1820 derivative records from 6591 primary records. [2025-09-29T02:17:33.171025] [DEBUG] [LOCAL ] JCE: Saving derivative data. [2025-09-29T02:17:33.171105] [DEBUG] [LOCAL ] JBND: Saving derivative data. [2025-09-29T02:17:33.203257] [DEBUG] [LOCAL ] JBND: Derivative data saved (1820 records). [2025-09-29T02:17:33.206009] [INFO ] [MAIN ] JBND: Successfully saved derivative data. [2025-09-29T02:17:33.211557] [DEBUG] [LOCAL ] JCE: Derivative data saved (1820 records). [2025-09-29T02:17:33.209287] [INFO ] [MAIN ] Derivative Progress: 1078/2211 symbols completed. JBND took 1.3s. Estimated remaining: 7m 60s. Rate: 141.8 symbols/min [2025-09-29T02:17:33.212260] [INFO ] [MAIN ] JCE: Successfully saved derivative data. [2025-09-29T02:17:33.215873] [INFO ] [MAIN ] Derivative Progress: 1079/2211 symbols completed. JCE took 1.2s. Estimated remaining: 7m 59s. Rate: 141.9 symbols/min [2025-09-29T02:17:33.234232] [DEBUG] [MAIN ] JCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:33.235090] [INFO ] [MAIN ] JCI: Generated 1820 derivative records from 54327 primary records. [2025-09-29T02:17:33.235179] [DEBUG] [LOCAL ] JCI: Saving derivative data. [2025-09-29T02:17:33.251396] [DEBUG] [LOCAL ] JCI: Derivative data saved (1820 records). [2025-09-29T02:17:33.251516] [INFO ] [MAIN ] JCI: Successfully saved derivative data. [2025-09-29T02:17:33.255398] [INFO ] [MAIN ] Derivative Progress: 1080/2211 symbols completed. JCI took 1.2s. Estimated remaining: 7m 58s. Rate: 142.0 symbols/min [2025-09-29T02:17:33.256258] [INFO ] [MAIN ] JEQ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:33.256147] [INFO ] [MAIN ] JEF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:33.256426] [INFO ] [MAIN ] JELD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:33.278614] [DEBUG] [LOCAL ] JEQ: Loaded 9336 existing records from primary storage. [2025-09-29T02:17:33.278980] [INFO ] [MAIN ] JEQ: Loaded 9336 primary data records. [2025-09-29T02:17:33.516186] [DEBUG] [LOCAL ] JELD: Loaded 46791 existing records from primary storage. [2025-09-29T02:17:33.544674] [INFO ] [MAIN ] JELD: Loaded 46791 primary data records. [2025-09-29T02:17:33.697762] [DEBUG] [LOCAL ] JEF: Loaded 50763 existing records from primary storage. [2025-09-29T02:17:33.740762] [INFO ] [MAIN ] JEF: Loaded 50763 primary data records. [2025-09-29T02:17:34.376953] [DEBUG] [MAIN ] JEQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:34.378572] [INFO ] [MAIN ] JEQ: Generated 1820 derivative records from 9336 primary records. [2025-09-29T02:17:34.379448] [DEBUG] [LOCAL ] JEQ: Saving derivative data. [2025-09-29T02:17:34.397011] [DEBUG] [LOCAL ] JEQ: Derivative data saved (1820 records). [2025-09-29T02:17:34.397853] [INFO ] [MAIN ] JEQ: Successfully saved derivative data. [2025-09-29T02:17:34.400414] [INFO ] [MAIN ] Derivative Progress: 1081/2211 symbols completed. JEQ took 1.1s. Estimated remaining: 7m 58s. Rate: 141.8 symbols/min [2025-09-29T02:17:34.400822] [INFO ] [MAIN ] JFR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:34.421684] [DEBUG] [MAIN ] JELD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:34.422543] [INFO ] [MAIN ] JELD: Generated 1820 derivative records from 46791 primary records. [2025-09-29T02:17:34.422931] [DEBUG] [LOCAL ] JELD: Saving derivative data. [2025-09-29T02:17:34.443089] [DEBUG] [LOCAL ] JELD: Derivative data saved (1820 records). [2025-09-29T02:17:34.443563] [INFO ] [MAIN ] JELD: Successfully saved derivative data. [2025-09-29T02:17:34.447684] [INFO ] [MAIN ] Derivative Progress: 1082/2211 symbols completed. JELD took 1.2s. Estimated remaining: 7m 57s. Rate: 141.9 symbols/min [2025-09-29T02:17:34.460744] [INFO ] [MAIN ] JGH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:34.469928] [DEBUG] [MAIN ] JEF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:34.470881] [INFO ] [MAIN ] JEF: Generated 1820 derivative records from 50763 primary records. [2025-09-29T02:17:34.470996] [DEBUG] [LOCAL ] JEF: Saving derivative data. [2025-09-29T02:17:34.501116] [DEBUG] [LOCAL ] JFR: Loaded 30975 existing records from primary storage. [2025-09-29T02:17:34.500318] [DEBUG] [LOCAL ] JEF: Derivative data saved (1820 records). [2025-09-29T02:17:34.501627] [INFO ] [MAIN ] JFR: Loaded 30975 primary data records. [2025-09-29T02:17:34.501505] [INFO ] [MAIN ] JEF: Successfully saved derivative data. [2025-09-29T02:17:34.505382] [INFO ] [MAIN ] Derivative Progress: 1083/2211 symbols completed. JEF took 1.2s. Estimated remaining: 7m 57s. Rate: 142.0 symbols/min [2025-09-29T02:17:34.526077] [INFO ] [MAIN ] JHG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:34.632912] [DEBUG] [LOCAL ] JGH: Loaded 11064 existing records from primary storage. [2025-09-29T02:17:34.637248] [INFO ] [MAIN ] JGH: Loaded 11064 primary data records. [2025-09-29T02:17:35.262917] [DEBUG] [LOCAL ] JHG: Loaded 48497 existing records from primary storage. [2025-09-29T02:17:35.263598] [INFO ] [MAIN ] JHG: Loaded 48497 primary data records. [2025-09-29T02:17:35.622588] [DEBUG] [MAIN ] JFR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:35.624426] [INFO ] [MAIN ] JFR: Generated 1820 derivative records from 30975 primary records. [2025-09-29T02:17:35.626420] [DEBUG] [LOCAL ] JFR: Saving derivative data. [2025-09-29T02:17:35.656448] [DEBUG] [LOCAL ] JFR: Derivative data saved (1820 records). [2025-09-29T02:17:35.657895] [INFO ] [MAIN ] JFR: Successfully saved derivative data. [2025-09-29T02:17:35.674959] [INFO ] [MAIN ] Derivative Progress: 1084/2211 symbols completed. JFR took 1.3s. Estimated remaining: 7m 57s. Rate: 141.8 symbols/min [2025-09-29T02:17:35.676349] [INFO ] [MAIN ] JHI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:35.676064] [DEBUG] [MAIN ] JGH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:35.678348] [INFO ] [MAIN ] JGH: Generated 1820 derivative records from 11064 primary records. [2025-09-29T02:17:35.678869] [DEBUG] [LOCAL ] JGH: Saving derivative data. [2025-09-29T02:17:35.703599] [DEBUG] [LOCAL ] JGH: Derivative data saved (1820 records). [2025-09-29T02:17:35.708533] [INFO ] [MAIN ] JGH: Successfully saved derivative data. [2025-09-29T02:17:35.708932] [DEBUG] [LOCAL ] JHI: Loaded 3641 existing records from primary storage. [2025-09-29T02:17:35.712362] [INFO ] [MAIN ] Derivative Progress: 1085/2211 symbols completed. JGH took 1.3s. Estimated remaining: 7m 56s. Rate: 141.9 symbols/min [2025-09-29T02:17:35.712843] [INFO ] [MAIN ] JHI: Loaded 3641 primary data records. [2025-09-29T02:17:35.738275] [INFO ] [MAIN ] JHS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:35.755638] [DEBUG] [MAIN ] JHG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:35.801276] [INFO ] [MAIN ] JHG: Generated 1820 derivative records from 48497 primary records. [2025-09-29T02:17:35.832343] [DEBUG] [LOCAL ] JHG: Saving derivative data. [2025-09-29T02:17:35.873113] [DEBUG] [LOCAL ] JHS: Loaded 2878 existing records from primary storage. [2025-09-29T02:17:35.908693] [DEBUG] [LOCAL ] JHG: Derivative data saved (1820 records). [2025-09-29T02:17:35.948713] [INFO ] [MAIN ] JHG: Successfully saved derivative data. [2025-09-29T02:17:36.069131] [INFO ] [MAIN ] Derivative Progress: 1086/2211 symbols completed. JHG took 1.5s. Estimated remaining: 7m 56s. Rate: 141.9 symbols/min [2025-09-29T02:17:35.948873] [INFO ] [MAIN ] JHS: Loaded 2878 primary data records. [2025-09-29T02:17:36.082960] [INFO ] [MAIN ] JHX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:36.509344] [DEBUG] [LOCAL ] JHX: Loaded 51216 existing records from primary storage. [2025-09-29T02:17:36.515754] [INFO ] [MAIN ] JHX: Loaded 51216 primary data records. [2025-09-29T02:17:36.515550] [DEBUG] [MAIN ] JHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:36.517750] [INFO ] [MAIN ] JHI: Generated 1820 derivative records from 3641 primary records. [2025-09-29T02:17:36.535206] [DEBUG] [LOCAL ] JHI: Saving derivative data. [2025-09-29T02:17:36.630905] [DEBUG] [LOCAL ] JHI: Derivative data saved (1820 records). [2025-09-29T02:17:36.652250] [INFO ] [MAIN ] JHI: Successfully saved derivative data. [2025-09-29T02:17:36.665791] [INFO ] [MAIN ] Derivative Progress: 1087/2211 symbols completed. JHI took 1.0s. Estimated remaining: 7m 55s. Rate: 141.9 symbols/min [2025-09-29T02:17:36.713633] [INFO ] [MAIN ] JILL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:36.938687] [DEBUG] [MAIN ] JHS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:36.939803] [INFO ] [MAIN ] JHS: Generated 1820 derivative records from 2878 primary records. [2025-09-29T02:17:36.940156] [DEBUG] [LOCAL ] JHS: Saving derivative data. [2025-09-29T02:17:36.968373] [DEBUG] [LOCAL ] JILL: Loaded 16931 existing records from primary storage. [2025-09-29T02:17:36.970375] [INFO ] [MAIN ] JILL: Loaded 16931 primary data records. [2025-09-29T02:17:36.970740] [DEBUG] [LOCAL ] JHS: Derivative data saved (1820 records). [2025-09-29T02:17:37.001640] [INFO ] [MAIN ] JHS: Successfully saved derivative data. [2025-09-29T02:17:37.041915] [INFO ] [MAIN ] Derivative Progress: 1088/2211 symbols completed. JHS took 1.3s. Estimated remaining: 7m 55s. Rate: 141.9 symbols/min [2025-09-29T02:17:37.072043] [INFO ] [MAIN ] JKS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:37.333593] [DEBUG] [MAIN ] JHX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:37.335679] [INFO ] [MAIN ] JHX: Generated 1820 derivative records from 51216 primary records. [2025-09-29T02:17:37.335850] [DEBUG] [LOCAL ] JHX: Saving derivative data. [2025-09-29T02:17:37.368056] [DEBUG] [LOCAL ] JHX: Derivative data saved (1820 records). [2025-09-29T02:17:37.368241] [INFO ] [MAIN ] JHX: Successfully saved derivative data. [2025-09-29T02:17:37.372308] [INFO ] [MAIN ] Derivative Progress: 1089/2211 symbols completed. JHX took 1.3s. Estimated remaining: 7m 54s. Rate: 141.9 symbols/min [2025-09-29T02:17:37.373166] [INFO ] [MAIN ] JLL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:37.395858] [DEBUG] [LOCAL ] JKS: Loaded 40672 existing records from primary storage. [2025-09-29T02:17:37.396184] [INFO ] [MAIN ] JKS: Loaded 40672 primary data records. [2025-09-29T02:17:37.556342] [DEBUG] [MAIN ] JILL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:37.601584] [DEBUG] [LOCAL ] JLL: Loaded 32458 existing records from primary storage. [2025-09-29T02:17:37.611605] [INFO ] [MAIN ] JILL: Generated 1820 derivative records from 16931 primary records. [2025-09-29T02:17:37.644734] [INFO ] [MAIN ] JLL: Loaded 32458 primary data records. [2025-09-29T02:17:37.644963] [DEBUG] [LOCAL ] JILL: Saving derivative data. [2025-09-29T02:17:37.877348] [DEBUG] [LOCAL ] JILL: Derivative data saved (1820 records). [2025-09-29T02:17:37.903936] [INFO ] [MAIN ] JILL: Successfully saved derivative data. [2025-09-29T02:17:37.919027] [INFO ] [MAIN ] Derivative Progress: 1090/2211 symbols completed. JILL took 1.2s. Estimated remaining: 7m 54s. Rate: 141.9 symbols/min [2025-09-29T02:17:37.950809] [INFO ] [MAIN ] JLS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:38.145916] [DEBUG] [LOCAL ] JLS: Loaded 4142 existing records from primary storage. [2025-09-29T02:17:38.146463] [INFO ] [MAIN ] JLS: Loaded 4142 primary data records. [2025-09-29T02:17:38.344841] [DEBUG] [MAIN ] JKS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:38.393459] [INFO ] [MAIN ] JKS: Generated 1820 derivative records from 40672 primary records. [2025-09-29T02:17:38.508138] [DEBUG] [LOCAL ] JKS: Saving derivative data. [2025-09-29T02:17:38.549914] [DEBUG] [LOCAL ] JKS: Derivative data saved (1820 records). [2025-09-29T02:17:38.550835] [INFO ] [MAIN ] JKS: Successfully saved derivative data. [2025-09-29T02:17:38.563453] [INFO ] [MAIN ] Derivative Progress: 1091/2211 symbols completed. JKS took 1.5s. Estimated remaining: 7m 54s. Rate: 141.8 symbols/min [2025-09-29T02:17:38.569869] [INFO ] [MAIN ] JMIA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:38.570211] [DEBUG] [MAIN ] JLL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:38.571818] [INFO ] [MAIN ] JLL: Generated 1820 derivative records from 32458 primary records. [2025-09-29T02:17:38.572588] [DEBUG] [LOCAL ] JLL: Saving derivative data. [2025-09-29T02:17:38.592027] [DEBUG] [LOCAL ] JLL: Derivative data saved (1820 records). [2025-09-29T02:17:38.592505] [INFO ] [MAIN ] JLL: Successfully saved derivative data. [2025-09-29T02:17:38.596025] [INFO ] [MAIN ] Derivative Progress: 1092/2211 symbols completed. JLL took 1.2s. Estimated remaining: 7m 53s. Rate: 141.9 symbols/min [2025-09-29T02:17:38.596792] [INFO ] [MAIN ] JNJ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:38.616170] [DEBUG] [MAIN ] JLS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:38.617106] [INFO ] [MAIN ] JLS: Generated 1820 derivative records from 4142 primary records. [2025-09-29T02:17:38.617237] [DEBUG] [LOCAL ] JLS: Saving derivative data. [2025-09-29T02:17:38.647862] [DEBUG] [LOCAL ] JLS: Derivative data saved (1820 records). [2025-09-29T02:17:38.648034] [INFO ] [MAIN ] JLS: Successfully saved derivative data. [2025-09-29T02:17:38.651490] [INFO ] [MAIN ] Derivative Progress: 1093/2211 symbols completed. JLS took 0.7s. Estimated remaining: 7m 52s. Rate: 142.0 symbols/min [2025-09-29T02:17:38.674007] [DEBUG] [LOCAL ] JMIA: Loaded 51279 existing records from primary storage. [2025-09-29T02:17:38.674230] [INFO ] [MAIN ] JMIA: Loaded 51279 primary data records. [2025-09-29T02:17:38.919531] [DEBUG] [LOCAL ] JNJ: Loaded 54533 existing records from primary storage. [2025-09-29T02:17:39.034581] [INFO ] [MAIN ] JNJ: Loaded 54533 primary data records. [2025-09-29T02:17:39.452142] [DEBUG] [MAIN ] JMIA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:39.453632] [INFO ] [MAIN ] JMIA: Generated 1820 derivative records from 51279 primary records. [2025-09-29T02:17:39.454124] [DEBUG] [LOCAL ] JMIA: Saving derivative data. [2025-09-29T02:17:39.473928] [DEBUG] [LOCAL ] JMIA: Derivative data saved (1820 records). [2025-09-29T02:17:39.474109] [INFO ] [MAIN ] JMIA: Successfully saved derivative data. [2025-09-29T02:17:39.477171] [INFO ] [MAIN ] Derivative Progress: 1094/2211 symbols completed. JMIA took 0.9s. Estimated remaining: 7m 52s. Rate: 141.9 symbols/min [2025-09-29T02:17:39.497569] [DEBUG] [MAIN ] JNJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:39.498397] [INFO ] [MAIN ] JNJ: Generated 1820 derivative records from 54533 primary records. [2025-09-29T02:17:39.498500] [DEBUG] [LOCAL ] JNJ: Saving derivative data. [2025-09-29T02:17:39.515202] [DEBUG] [LOCAL ] JNJ: Derivative data saved (1820 records). [2025-09-29T02:17:39.515421] [INFO ] [MAIN ] JNJ: Successfully saved derivative data. [2025-09-29T02:17:39.519019] [INFO ] [MAIN ] Derivative Progress: 1095/2211 symbols completed. JNJ took 0.9s. Estimated remaining: 7m 51s. Rate: 142.0 symbols/min [2025-09-29T02:17:39.519675] [INFO ] [MAIN ] JOE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:39.520046] [INFO ] [MAIN ] JOF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:39.519574] [INFO ] [MAIN ] JOBY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:39.534181] [DEBUG] [LOCAL ] JOF: Loaded 7177 existing records from primary storage. [2025-09-29T02:17:39.534714] [INFO ] [MAIN ] JOF: Loaded 7177 primary data records. [2025-09-29T02:17:39.674949] [DEBUG] [LOCAL ] JOE: Loaded 24860 existing records from primary storage. [2025-09-29T02:17:39.691160] [INFO ] [MAIN ] JOE: Loaded 24860 primary data records. [2025-09-29T02:17:40.054395] [DEBUG] [LOCAL ] JOBY: Loaded 54579 existing records from primary storage. [2025-09-29T02:17:40.065433] [INFO ] [MAIN ] JOBY: Loaded 54579 primary data records. [2025-09-29T02:17:40.651889] [DEBUG] [MAIN ] JOF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:40.654153] [INFO ] [MAIN ] JOF: Generated 1820 derivative records from 7177 primary records. [2025-09-29T02:17:40.654743] [DEBUG] [LOCAL ] JOF: Saving derivative data. [2025-09-29T02:17:40.674847] [DEBUG] [LOCAL ] JOF: Derivative data saved (1820 records). [2025-09-29T02:17:40.675579] [INFO ] [MAIN ] JOF: Successfully saved derivative data. [2025-09-29T02:17:40.679072] [INFO ] [MAIN ] Derivative Progress: 1096/2211 symbols completed. JOF took 1.2s. Estimated remaining: 7m 52s. Rate: 141.8 symbols/min [2025-09-29T02:17:40.682264] [INFO ] [MAIN ] JPC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:40.700483] [DEBUG] [MAIN ] JOE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:40.701759] [INFO ] [MAIN ] JOE: Generated 1820 derivative records from 24860 primary records. [2025-09-29T02:17:40.702156] [DEBUG] [LOCAL ] JOE: Saving derivative data. [2025-09-29T02:17:40.720758] [DEBUG] [LOCAL ] JOE: Derivative data saved (1820 records). [2025-09-29T02:17:40.721020] [INFO ] [MAIN ] JOE: Successfully saved derivative data. [2025-09-29T02:17:40.724219] [INFO ] [MAIN ] Derivative Progress: 1097/2211 symbols completed. JOE took 1.2s. Estimated remaining: 7m 51s. Rate: 141.9 symbols/min [2025-09-29T02:17:40.726846] [INFO ] [MAIN ] JPM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:40.741806] [DEBUG] [MAIN ] JOBY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:40.742594] [INFO ] [MAIN ] JOBY: Generated 1820 derivative records from 54579 primary records. [2025-09-29T02:17:40.742883] [DEBUG] [LOCAL ] JOBY: Saving derivative data. [2025-09-29T02:17:40.773569] [DEBUG] [LOCAL ] JOBY: Derivative data saved (1820 records). [2025-09-29T02:17:40.773811] [INFO ] [MAIN ] JOBY: Successfully saved derivative data. [2025-09-29T02:17:40.777229] [INFO ] [MAIN ] Derivative Progress: 1098/2211 symbols completed. JOBY took 1.3s. Estimated remaining: 7m 50s. Rate: 142.0 symbols/min [2025-09-29T02:17:40.778538] [INFO ] [MAIN ] JQC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:40.793560] [DEBUG] [LOCAL ] JPC: Loaded 37620 existing records from primary storage. [2025-09-29T02:17:40.793825] [INFO ] [MAIN ] JPC: Loaded 37620 primary data records. [2025-09-29T02:17:41.195346] [DEBUG] [LOCAL ] JQC: Loaded 34194 existing records from primary storage. [2025-09-29T02:17:41.195543] [INFO ] [MAIN ] JQC: Loaded 34194 primary data records. [2025-09-29T02:17:41.226586] [DEBUG] [LOCAL ] JPM: Loaded 54574 existing records from primary storage. [2025-09-29T02:17:41.247691] [INFO ] [MAIN ] JPM: Loaded 54574 primary data records. [2025-09-29T02:17:41.963331] [DEBUG] [MAIN ] JPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:41.966894] [INFO ] [MAIN ] JPC: Generated 1820 derivative records from 37620 primary records. [2025-09-29T02:17:41.968073] [DEBUG] [LOCAL ] JPC: Saving derivative data. [2025-09-29T02:17:42.000578] [DEBUG] [LOCAL ] JPC: Derivative data saved (1820 records). [2025-09-29T02:17:42.001412] [INFO ] [MAIN ] JPC: Successfully saved derivative data. [2025-09-29T02:17:42.005681] [INFO ] [MAIN ] Derivative Progress: 1099/2211 symbols completed. JPC took 1.3s. Estimated remaining: 7m 51s. Rate: 141.8 symbols/min [2025-09-29T02:17:42.006196] [INFO ] [MAIN ] JRI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:42.025394] [DEBUG] [MAIN ] JPM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:42.029111] [INFO ] [MAIN ] JPM: Generated 1820 derivative records from 54574 primary records. [2025-09-29T02:17:42.029373] [DEBUG] [LOCAL ] JPM: Saving derivative data. [2025-09-29T02:17:42.049514] [DEBUG] [MAIN ] JQC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:42.059465] [INFO ] [MAIN ] JQC: Generated 1820 derivative records from 34194 primary records. [2025-09-29T02:17:42.062439] [DEBUG] [LOCAL ] JQC: Saving derivative data. [2025-09-29T02:17:42.092777] [DEBUG] [LOCAL ] JRI: Loaded 15068 existing records from primary storage. [2025-09-29T02:17:42.100839] [INFO ] [MAIN ] JRI: Loaded 15068 primary data records. [2025-09-29T02:17:42.100763] [DEBUG] [LOCAL ] JPM: Derivative data saved (1820 records). [2025-09-29T02:17:42.105115] [DEBUG] [LOCAL ] JQC: Derivative data saved (1820 records). [2025-09-29T02:17:42.105246] [INFO ] [MAIN ] JQC: Successfully saved derivative data. [2025-09-29T02:17:42.105476] [INFO ] [MAIN ] JPM: Successfully saved derivative data. [2025-09-29T02:17:42.114415] [INFO ] [MAIN ] Derivative Progress: 1100/2211 symbols completed. JPM took 1.4s. Estimated remaining: 7m 50s. Rate: 141.9 symbols/min [2025-09-29T02:17:42.154872] [INFO ] [MAIN ] Derivative Progress: 1101/2211 symbols completed. JQC took 1.3s. Estimated remaining: 7m 49s. Rate: 142.0 symbols/min [2025-09-29T02:17:42.149678] [INFO ] [MAIN ] JRS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:42.185845] [INFO ] [MAIN ] JXN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:42.333193] [DEBUG] [LOCAL ] JRS: Loaded 11250 existing records from primary storage. [2025-09-29T02:17:42.449543] [INFO ] [MAIN ] JRS: Loaded 11250 primary data records. [2025-09-29T02:17:42.687413] [DEBUG] [LOCAL ] JXN: Loaded 46558 existing records from primary storage. [2025-09-29T02:17:42.723380] [INFO ] [MAIN ] JXN: Loaded 46558 primary data records. [2025-09-29T02:17:43.190391] [DEBUG] [MAIN ] JRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:43.204050] [INFO ] [MAIN ] JRI: Generated 1820 derivative records from 15068 primary records. [2025-09-29T02:17:43.214476] [DEBUG] [LOCAL ] JRI: Saving derivative data. [2025-09-29T02:17:43.235902] [DEBUG] [LOCAL ] JRI: Derivative data saved (1820 records). [2025-09-29T02:17:43.237542] [INFO ] [MAIN ] JRI: Successfully saved derivative data. [2025-09-29T02:17:43.239998] [INFO ] [MAIN ] Derivative Progress: 1102/2211 symbols completed. JRI took 1.2s. Estimated remaining: 7m 49s. Rate: 141.8 symbols/min [2025-09-29T02:17:43.240622] [INFO ] [MAIN ] K: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:43.255553] [DEBUG] [MAIN ] JRS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:43.256681] [INFO ] [MAIN ] JRS: Generated 1820 derivative records from 11250 primary records. [2025-09-29T02:17:43.257263] [DEBUG] [LOCAL ] JRS: Saving derivative data. [2025-09-29T02:17:43.275903] [DEBUG] [LOCAL ] JRS: Derivative data saved (1820 records). [2025-09-29T02:17:43.276545] [INFO ] [MAIN ] JRS: Successfully saved derivative data. [2025-09-29T02:17:43.279288] [INFO ] [MAIN ] Derivative Progress: 1103/2211 symbols completed. JRS took 1.1s. Estimated remaining: 7m 48s. Rate: 141.9 symbols/min [2025-09-29T02:17:43.279501] [INFO ] [MAIN ] KAI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:43.302485] [DEBUG] [MAIN ] JXN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:43.307189] [INFO ] [MAIN ] JXN: Generated 1820 derivative records from 46558 primary records. [2025-09-29T02:17:43.307467] [DEBUG] [LOCAL ] JXN: Saving derivative data. [2025-09-29T02:17:43.342592] [DEBUG] [LOCAL ] KAI: Loaded 13729 existing records from primary storage. [2025-09-29T02:17:43.343869] [INFO ] [MAIN ] KAI: Loaded 13729 primary data records. [2025-09-29T02:17:43.358306] [DEBUG] [LOCAL ] JXN: Derivative data saved (1820 records). [2025-09-29T02:17:43.384603] [INFO ] [MAIN ] JXN: Successfully saved derivative data. [2025-09-29T02:17:43.438181] [INFO ] [MAIN ] Derivative Progress: 1104/2211 symbols completed. JXN took 1.3s. Estimated remaining: 7m 48s. Rate: 142.0 symbols/min [2025-09-29T02:17:43.491404] [INFO ] [MAIN ] KAR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:43.475396] [DEBUG] [LOCAL ] K: Loaded 50637 existing records from primary storage. [2025-09-29T02:17:43.491698] [INFO ] [MAIN ] K: Loaded 50637 primary data records. [2025-09-29T02:17:44.071301] [DEBUG] [LOCAL ] KAR: Loaded 40411 existing records from primary storage. [2025-09-29T02:17:44.072016] [INFO ] [MAIN ] KAR: Loaded 40411 primary data records. [2025-09-29T02:17:44.214769] [DEBUG] [MAIN ] KAI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:44.295380] [INFO ] [MAIN ] KAI: Generated 1820 derivative records from 13729 primary records. [2025-09-29T02:17:44.295926] [DEBUG] [LOCAL ] KAI: Saving derivative data. [2025-09-29T02:17:44.433708] [DEBUG] [MAIN ] K: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:44.435110] [INFO ] [MAIN ] K: Generated 1820 derivative records from 50637 primary records. [2025-09-29T02:17:44.435472] [DEBUG] [LOCAL ] K: Saving derivative data. [2025-09-29T02:17:44.469840] [DEBUG] [LOCAL ] KAI: Derivative data saved (1820 records). [2025-09-29T02:17:44.471473] [INFO ] [MAIN ] KAI: Successfully saved derivative data. [2025-09-29T02:17:44.471899] [DEBUG] [LOCAL ] K: Derivative data saved (1820 records). [2025-09-29T02:17:44.478508] [INFO ] [MAIN ] Derivative Progress: 1105/2211 symbols completed. KAI took 1.2s. Estimated remaining: 7m 48s. Rate: 141.8 symbols/min [2025-09-29T02:17:44.479067] [INFO ] [MAIN ] KB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:44.478661] [INFO ] [MAIN ] K: Successfully saved derivative data. [2025-09-29T02:17:44.485017] [INFO ] [MAIN ] Derivative Progress: 1106/2211 symbols completed. K took 1.2s. Estimated remaining: 7m 47s. Rate: 141.9 symbols/min [2025-09-29T02:17:44.485723] [INFO ] [MAIN ] KBDC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:44.515763] [DEBUG] [MAIN ] KAR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:44.516777] [INFO ] [MAIN ] KAR: Generated 1820 derivative records from 40411 primary records. [2025-09-29T02:17:44.516939] [DEBUG] [LOCAL ] KAR: Saving derivative data. [2025-09-29T02:17:44.544290] [DEBUG] [LOCAL ] KBDC: Loaded 21252 existing records from primary storage. [2025-09-29T02:17:44.545028] [INFO ] [MAIN ] KBDC: Loaded 21252 primary data records. [2025-09-29T02:17:44.651039] [DEBUG] [LOCAL ] KB: Loaded 24453 existing records from primary storage. [2025-09-29T02:17:44.627001] [DEBUG] [LOCAL ] KAR: Derivative data saved (1820 records). [2025-09-29T02:17:44.651271] [INFO ] [MAIN ] KAR: Successfully saved derivative data. [2025-09-29T02:17:44.662966] [INFO ] [MAIN ] Derivative Progress: 1107/2211 symbols completed. KAR took 1.2s. Estimated remaining: 7m 46s. Rate: 142.0 symbols/min [2025-09-29T02:17:44.663223] [INFO ] [MAIN ] KBH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:44.651401] [INFO ] [MAIN ] KB: Loaded 24453 primary data records. [2025-09-29T02:17:45.260445] [DEBUG] [LOCAL ] KBH: Loaded 49678 existing records from primary storage. [2025-09-29T02:17:45.261996] [INFO ] [MAIN ] KBH: Loaded 49678 primary data records. [2025-09-29T02:17:45.599385] [DEBUG] [MAIN ] KBDC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:45.667278] [INFO ] [MAIN ] KBDC: Generated 1820 derivative records from 21252 primary records. [2025-09-29T02:17:45.670091] [DEBUG] [LOCAL ] KBDC: Saving derivative data. [2025-09-29T02:17:45.696356] [DEBUG] [MAIN ] KB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:45.701424] [INFO ] [MAIN ] KB: Generated 1820 derivative records from 24453 primary records. [2025-09-29T02:17:45.703780] [DEBUG] [LOCAL ] KB: Saving derivative data. [2025-09-29T02:17:45.708166] [DEBUG] [LOCAL ] KBDC: Derivative data saved (1820 records). [2025-09-29T02:17:45.708533] [INFO ] [MAIN ] KBDC: Successfully saved derivative data. [2025-09-29T02:17:45.723601] [INFO ] [MAIN ] Derivative Progress: 1108/2211 symbols completed. KBDC took 1.2s. Estimated remaining: 7m 47s. Rate: 141.8 symbols/min [2025-09-29T02:17:45.728844] [DEBUG] [LOCAL ] KB: Derivative data saved (1820 records). [2025-09-29T02:17:45.728996] [INFO ] [MAIN ] KB: Successfully saved derivative data. [2025-09-29T02:17:45.732743] [INFO ] [MAIN ] Derivative Progress: 1109/2211 symbols completed. KB took 1.3s. Estimated remaining: 7m 46s. Rate: 141.9 symbols/min [2025-09-29T02:17:45.752437] [DEBUG] [MAIN ] KBH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:45.753296] [INFO ] [MAIN ] KBH: Generated 1820 derivative records from 49678 primary records. [2025-09-29T02:17:45.753390] [DEBUG] [LOCAL ] KBH: Saving derivative data. [2025-09-29T02:17:45.769378] [DEBUG] [LOCAL ] KBH: Derivative data saved (1820 records). [2025-09-29T02:17:45.769564] [INFO ] [MAIN ] KBH: Successfully saved derivative data. [2025-09-29T02:17:45.772943] [INFO ] [MAIN ] Derivative Progress: 1110/2211 symbols completed. KBH took 1.1s. Estimated remaining: 7m 45s. Rate: 142.1 symbols/min [2025-09-29T02:17:45.773679] [INFO ] [MAIN ] KEN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:45.773476] [INFO ] [MAIN ] KBR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:45.773599] [INFO ] [MAIN ] KD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:45.784776] [DEBUG] [LOCAL ] KEN: Loaded 4784 existing records from primary storage. [2025-09-29T02:17:45.785020] [INFO ] [MAIN ] KEN: Loaded 4784 primary data records. [2025-09-29T02:17:46.171328] [DEBUG] [LOCAL ] KBR: Loaded 48899 existing records from primary storage. [2025-09-29T02:17:46.186636] [INFO ] [MAIN ] KBR: Loaded 48899 primary data records. [2025-09-29T02:17:46.193341] [DEBUG] [LOCAL ] KD: Loaded 53068 existing records from primary storage. [2025-09-29T02:17:46.206726] [INFO ] [MAIN ] KD: Loaded 53068 primary data records. [2025-09-29T02:17:46.899467] [DEBUG] [MAIN ] KEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:46.901871] [INFO ] [MAIN ] KEN: Generated 1820 derivative records from 4784 primary records. [2025-09-29T02:17:46.902728] [DEBUG] [LOCAL ] KEN: Saving derivative data. [2025-09-29T02:17:46.923232] [DEBUG] [LOCAL ] KEN: Derivative data saved (1820 records). [2025-09-29T02:17:46.923415] [INFO ] [MAIN ] KEN: Successfully saved derivative data. [2025-09-29T02:17:46.926078] [INFO ] [MAIN ] Derivative Progress: 1111/2211 symbols completed. KEN took 1.2s. Estimated remaining: 7m 45s. Rate: 141.8 symbols/min [2025-09-29T02:17:46.926442] [INFO ] [MAIN ] KEP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:46.948608] [DEBUG] [MAIN ] KBR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:46.951408] [INFO ] [MAIN ] KBR: Generated 1820 derivative records from 48899 primary records. [2025-09-29T02:17:46.951906] [DEBUG] [LOCAL ] KBR: Saving derivative data. [2025-09-29T02:17:46.978955] [DEBUG] [MAIN ] KD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:46.993033] [INFO ] [MAIN ] KD: Generated 1820 derivative records from 53068 primary records. [2025-09-29T02:17:46.993461] [DEBUG] [LOCAL ] KD: Saving derivative data. [2025-09-29T02:17:46.993177] [DEBUG] [LOCAL ] KBR: Derivative data saved (1820 records). [2025-09-29T02:17:46.994860] [INFO ] [MAIN ] KBR: Successfully saved derivative data. [2025-09-29T02:17:46.997987] [INFO ] [MAIN ] Derivative Progress: 1112/2211 symbols completed. KBR took 1.2s. Estimated remaining: 7m 45s. Rate: 141.9 symbols/min [2025-09-29T02:17:47.005869] [INFO ] [MAIN ] KEX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:47.026851] [DEBUG] [LOCAL ] KD: Derivative data saved (1820 records). [2025-09-29T02:17:47.027090] [INFO ] [MAIN ] KD: Successfully saved derivative data. [2025-09-29T02:17:47.032100] [INFO ] [MAIN ] Derivative Progress: 1113/2211 symbols completed. KD took 1.3s. Estimated remaining: 7m 44s. Rate: 142.1 symbols/min [2025-09-29T02:17:47.027890] [DEBUG] [LOCAL ] KEP: Loaded 31169 existing records from primary storage. [2025-09-29T02:17:47.032443] [INFO ] [MAIN ] KEYS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:47.032575] [INFO ] [MAIN ] KEP: Loaded 31169 primary data records. [2025-09-29T02:17:47.401178] [DEBUG] [LOCAL ] KEX: Loaded 38712 existing records from primary storage. [2025-09-29T02:17:47.401547] [INFO ] [MAIN ] KEX: Loaded 38712 primary data records. [2025-09-29T02:17:47.530893] [DEBUG] [LOCAL ] KEYS: Loaded 43955 existing records from primary storage. [2025-09-29T02:17:47.553322] [INFO ] [MAIN ] KEYS: Loaded 43955 primary data records. [2025-09-29T02:17:48.140536] [DEBUG] [MAIN ] KEP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:48.156268] [INFO ] [MAIN ] KEP: Generated 1820 derivative records from 31169 primary records. [2025-09-29T02:17:48.156854] [DEBUG] [LOCAL ] KEP: Saving derivative data. [2025-09-29T02:17:48.176658] [DEBUG] [LOCAL ] KEP: Derivative data saved (1820 records). [2025-09-29T02:17:48.178507] [INFO ] [MAIN ] KEP: Successfully saved derivative data. [2025-09-29T02:17:48.181521] [INFO ] [MAIN ] Derivative Progress: 1114/2211 symbols completed. KEP took 1.3s. Estimated remaining: 7m 44s. Rate: 141.8 symbols/min [2025-09-29T02:17:48.182533] [INFO ] [MAIN ] KF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:48.195526] [DEBUG] [LOCAL ] KF: Loaded 2486 existing records from primary storage. [2025-09-29T02:17:48.210575] [DEBUG] [MAIN ] KEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:48.210920] [INFO ] [MAIN ] KF: Loaded 2486 primary data records. [2025-09-29T02:17:48.212347] [INFO ] [MAIN ] KEX: Generated 1820 derivative records from 38712 primary records. [2025-09-29T02:17:48.218181] [DEBUG] [LOCAL ] KEX: Saving derivative data. [2025-09-29T02:17:48.343470] [DEBUG] [LOCAL ] KEX: Derivative data saved (1820 records). [2025-09-29T02:17:48.345291] [INFO ] [MAIN ] KEX: Successfully saved derivative data. [2025-09-29T02:17:48.358481] [INFO ] [MAIN ] Derivative Progress: 1115/2211 symbols completed. KEX took 1.4s. Estimated remaining: 7m 43s. Rate: 141.9 symbols/min [2025-09-29T02:17:48.371888] [INFO ] [MAIN ] KFRC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:48.404107] [DEBUG] [MAIN ] KEYS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:48.447102] [INFO ] [MAIN ] KEYS: Generated 1820 derivative records from 43955 primary records. [2025-09-29T02:17:48.447442] [DEBUG] [LOCAL ] KEYS: Saving derivative data. [2025-09-29T02:17:48.598501] [DEBUG] [LOCAL ] KEYS: Derivative data saved (1820 records). [2025-09-29T02:17:48.606403] [DEBUG] [LOCAL ] KFRC: Loaded 19766 existing records from primary storage. [2025-09-29T02:17:48.605912] [INFO ] [MAIN ] KEYS: Successfully saved derivative data. [2025-09-29T02:17:48.607216] [INFO ] [MAIN ] KFRC: Loaded 19766 primary data records. [2025-09-29T02:17:48.610071] [INFO ] [MAIN ] Derivative Progress: 1116/2211 symbols completed. KEYS took 1.6s. Estimated remaining: 7m 43s. Rate: 142.0 symbols/min [2025-09-29T02:17:48.655930] [INFO ] [MAIN ] KFS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:48.772477] [DEBUG] [LOCAL ] KFS: Loaded 8471 existing records from primary storage. [2025-09-29T02:17:48.822817] [INFO ] [MAIN ] KFS: Loaded 8471 primary data records. [2025-09-29T02:17:49.068048] [DEBUG] [MAIN ] KF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:49.103351] [INFO ] [MAIN ] KF: Generated 1820 derivative records from 2486 primary records. [2025-09-29T02:17:49.104527] [DEBUG] [LOCAL ] KF: Saving derivative data. [2025-09-29T02:17:49.338812] [DEBUG] [LOCAL ] KF: Derivative data saved (1820 records). [2025-09-29T02:17:49.339154] [INFO ] [MAIN ] KF: Successfully saved derivative data. [2025-09-29T02:17:49.341476] [INFO ] [MAIN ] Derivative Progress: 1117/2211 symbols completed. KF took 1.2s. Estimated remaining: 7m 43s. Rate: 141.9 symbols/min [2025-09-29T02:17:49.342231] [INFO ] [MAIN ] KFY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:49.362225] [DEBUG] [MAIN ] KFRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:49.363267] [INFO ] [MAIN ] KFRC: Generated 1820 derivative records from 19766 primary records. [2025-09-29T02:17:49.363370] [DEBUG] [LOCAL ] KFRC: Saving derivative data. [2025-09-29T02:17:49.381421] [DEBUG] [LOCAL ] KFRC: Derivative data saved (1820 records). [2025-09-29T02:17:49.381929] [INFO ] [MAIN ] KFRC: Successfully saved derivative data. [2025-09-29T02:17:49.384616] [INFO ] [MAIN ] Derivative Progress: 1118/2211 symbols completed. KFRC took 1.0s. Estimated remaining: 7m 42s. Rate: 142.0 symbols/min [2025-09-29T02:17:49.385178] [INFO ] [MAIN ] KGC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:49.412147] [DEBUG] [LOCAL ] KFY: Loaded 31057 existing records from primary storage. [2025-09-29T02:17:49.425610] [INFO ] [MAIN ] KFY: Loaded 31057 primary data records. [2025-09-29T02:17:49.426363] [DEBUG] [MAIN ] KFS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:49.468105] [INFO ] [MAIN ] KFS: Generated 1820 derivative records from 8471 primary records. [2025-09-29T02:17:49.501972] [DEBUG] [LOCAL ] KFS: Saving derivative data. [2025-09-29T02:17:49.789317] [DEBUG] [LOCAL ] KFS: Derivative data saved (1820 records). [2025-09-29T02:17:49.804255] [INFO ] [MAIN ] KFS: Successfully saved derivative data. [2025-09-29T02:17:49.809960] [INFO ] [MAIN ] Derivative Progress: 1119/2211 symbols completed. KFS took 1.2s. Estimated remaining: 7m 41s. Rate: 142.0 symbols/min [2025-09-29T02:17:49.810568] [INFO ] [MAIN ] KGS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:49.813163] [DEBUG] [LOCAL ] KGC: Loaded 54479 existing records from primary storage. [2025-09-29T02:17:49.814225] [INFO ] [MAIN ] KGC: Loaded 54479 primary data records. [2025-09-29T02:17:50.213578] [DEBUG] [LOCAL ] KGS: Loaded 46487 existing records from primary storage. [2025-09-29T02:17:50.216211] [INFO ] [MAIN ] KGS: Loaded 46487 primary data records. [2025-09-29T02:17:50.309161] [DEBUG] [MAIN ] KFY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:50.343772] [INFO ] [MAIN ] KFY: Generated 1820 derivative records from 31057 primary records. [2025-09-29T02:17:50.349217] [DEBUG] [LOCAL ] KFY: Saving derivative data. [2025-09-29T02:17:50.579039] [DEBUG] [LOCAL ] KFY: Derivative data saved (1820 records). [2025-09-29T02:17:50.579422] [INFO ] [MAIN ] KFY: Successfully saved derivative data. [2025-09-29T02:17:50.583021] [INFO ] [MAIN ] Derivative Progress: 1120/2211 symbols completed. KFY took 1.2s. Estimated remaining: 7m 41s. Rate: 141.9 symbols/min [2025-09-29T02:17:50.583455] [INFO ] [MAIN ] KIM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:50.605540] [DEBUG] [MAIN ] KGC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:50.608337] [INFO ] [MAIN ] KGC: Generated 1820 derivative records from 54479 primary records. [2025-09-29T02:17:50.609130] [DEBUG] [LOCAL ] KGC: Saving derivative data. [2025-09-29T02:17:50.630266] [DEBUG] [LOCAL ] KGC: Derivative data saved (1820 records). [2025-09-29T02:17:50.630688] [INFO ] [MAIN ] KGC: Successfully saved derivative data. [2025-09-29T02:17:50.633996] [INFO ] [MAIN ] Derivative Progress: 1121/2211 symbols completed. KGC took 1.2s. Estimated remaining: 7m 41s. Rate: 142.0 symbols/min [2025-09-29T02:17:50.634500] [INFO ] [MAIN ] KIO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:50.656109] [DEBUG] [MAIN ] KGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:50.657184] [INFO ] [MAIN ] KGS: Generated 1820 derivative records from 46487 primary records. [2025-09-29T02:17:50.672757] [DEBUG] [LOCAL ] KGS: Saving derivative data. [2025-09-29T02:17:50.689574] [DEBUG] [LOCAL ] KGS: Derivative data saved (1820 records). [2025-09-29T02:17:50.695095] [INFO ] [MAIN ] KGS: Successfully saved derivative data. [2025-09-29T02:17:50.701462] [INFO ] [MAIN ] Derivative Progress: 1122/2211 symbols completed. KGS took 0.9s. Estimated remaining: 7m 40s. Rate: 142.1 symbols/min [2025-09-29T02:17:50.716079] [INFO ] [MAIN ] KKR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:50.719990] [DEBUG] [LOCAL ] KIM: Loaded 53831 existing records from primary storage. [2025-09-29T02:17:50.720434] [INFO ] [MAIN ] KIM: Loaded 53831 primary data records. [2025-09-29T02:17:50.798633] [DEBUG] [LOCAL ] KIO: Loaded 21625 existing records from primary storage. [2025-09-29T02:17:50.823103] [INFO ] [MAIN ] KIO: Loaded 21625 primary data records. [2025-09-29T02:17:51.424520] [DEBUG] [LOCAL ] KKR: Loaded 54281 existing records from primary storage. [2025-09-29T02:17:51.427455] [INFO ] [MAIN ] KKR: Loaded 54281 primary data records. [2025-09-29T02:17:51.652554] [DEBUG] [MAIN ] KIM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:51.791173] [INFO ] [MAIN ] KIM: Generated 1820 derivative records from 53831 primary records. [2025-09-29T02:17:51.792684] [DEBUG] [LOCAL ] KIM: Saving derivative data. [2025-09-29T02:17:51.814089] [DEBUG] [LOCAL ] KIM: Derivative data saved (1820 records). [2025-09-29T02:17:51.817227] [INFO ] [MAIN ] KIM: Successfully saved derivative data. [2025-09-29T02:17:51.821389] [INFO ] [MAIN ] Derivative Progress: 1123/2211 symbols completed. KIM took 1.2s. Estimated remaining: 7m 40s. Rate: 141.9 symbols/min [2025-09-29T02:17:51.839572] [DEBUG] [MAIN ] KIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:51.840523] [INFO ] [MAIN ] KIO: Generated 1820 derivative records from 21625 primary records. [2025-09-29T02:17:51.840721] [DEBUG] [LOCAL ] KIO: Saving derivative data. [2025-09-29T02:17:51.860240] [DEBUG] [LOCAL ] KIO: Derivative data saved (1820 records). [2025-09-29T02:17:51.860555] [INFO ] [MAIN ] KIO: Successfully saved derivative data. [2025-09-29T02:17:51.863691] [INFO ] [MAIN ] Derivative Progress: 1124/2211 symbols completed. KIO took 1.2s. Estimated remaining: 7m 39s. Rate: 142.0 symbols/min [2025-09-29T02:17:51.880152] [DEBUG] [MAIN ] KKR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:51.880938] [INFO ] [MAIN ] KKR: Generated 1820 derivative records from 54281 primary records. [2025-09-29T02:17:51.881045] [DEBUG] [LOCAL ] KKR: Saving derivative data. [2025-09-29T02:17:51.897468] [DEBUG] [LOCAL ] KKR: Derivative data saved (1820 records). [2025-09-29T02:17:51.897574] [INFO ] [MAIN ] KKR: Successfully saved derivative data. [2025-09-29T02:17:51.900308] [INFO ] [MAIN ] Derivative Progress: 1125/2211 symbols completed. KKR took 1.2s. Estimated remaining: 7m 38s. Rate: 142.1 symbols/min [2025-09-29T02:17:51.900835] [INFO ] [MAIN ] KKRS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:51.900957] [INFO ] [MAIN ] KMI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:51.901064] [INFO ] [MAIN ] KLC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:51.912558] [DEBUG] [LOCAL ] KKRS: Loaded 5801 existing records from primary storage. [2025-09-29T02:17:51.912929] [INFO ] [MAIN ] KKRS: Loaded 5801 primary data records. [2025-09-29T02:17:52.140266] [DEBUG] [LOCAL ] KLC: Loaded 37107 existing records from primary storage. [2025-09-29T02:17:52.147228] [INFO ] [MAIN ] KLC: Loaded 37107 primary data records. [2025-09-29T02:17:52.497696] [DEBUG] [LOCAL ] KMI: Loaded 54473 existing records from primary storage. [2025-09-29T02:17:52.516706] [INFO ] [MAIN ] KMI: Loaded 54473 primary data records. [2025-09-29T02:17:53.057827] [DEBUG] [MAIN ] KKRS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:53.058824] [INFO ] [MAIN ] KKRS: Generated 1820 derivative records from 5801 primary records. [2025-09-29T02:17:53.059314] [DEBUG] [LOCAL ] KKRS: Saving derivative data. [2025-09-29T02:17:53.078966] [DEBUG] [LOCAL ] KKRS: Derivative data saved (1820 records). [2025-09-29T02:17:53.079990] [INFO ] [MAIN ] KKRS: Successfully saved derivative data. [2025-09-29T02:17:53.082294] [INFO ] [MAIN ] Derivative Progress: 1126/2211 symbols completed. KKRS took 1.2s. Estimated remaining: 7m 39s. Rate: 141.9 symbols/min [2025-09-29T02:17:53.082898] [INFO ] [MAIN ] KMPB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:53.102963] [DEBUG] [MAIN ] KLC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:53.105492] [INFO ] [MAIN ] KLC: Generated 1820 derivative records from 37107 primary records. [2025-09-29T02:17:53.109537] [DEBUG] [LOCAL ] KMPB: Loaded 3646 existing records from primary storage. [2025-09-29T02:17:53.109785] [DEBUG] [LOCAL ] KLC: Saving derivative data. [2025-09-29T02:17:53.110225] [INFO ] [MAIN ] KMPB: Loaded 3646 primary data records. [2025-09-29T02:17:53.239504] [DEBUG] [LOCAL ] KLC: Derivative data saved (1820 records). [2025-09-29T02:17:53.249346] [INFO ] [MAIN ] KLC: Successfully saved derivative data. [2025-09-29T02:17:53.256926] [INFO ] [MAIN ] Derivative Progress: 1127/2211 symbols completed. KLC took 1.4s. Estimated remaining: 7m 38s. Rate: 142.0 symbols/min [2025-09-29T02:17:53.271275] [INFO ] [MAIN ] KMPR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:53.316487] [DEBUG] [MAIN ] KMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:53.339326] [INFO ] [MAIN ] KMI: Generated 1820 derivative records from 54473 primary records. [2025-09-29T02:17:53.355172] [DEBUG] [LOCAL ] KMI: Saving derivative data. [2025-09-29T02:17:53.537459] [DEBUG] [LOCAL ] KMI: Derivative data saved (1820 records). [2025-09-29T02:17:53.539580] [INFO ] [MAIN ] KMI: Successfully saved derivative data. [2025-09-29T02:17:53.543307] [INFO ] [MAIN ] Derivative Progress: 1128/2211 symbols completed. KMI took 1.6s. Estimated remaining: 7m 38s. Rate: 142.0 symbols/min [2025-09-29T02:17:53.556742] [INFO ] [MAIN ] KMT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:53.589621] [DEBUG] [LOCAL ] KMPR: Loaded 39117 existing records from primary storage. [2025-09-29T02:17:53.590141] [INFO ] [MAIN ] KMPR: Loaded 39117 primary data records. [2025-09-29T02:17:53.665617] [DEBUG] [MAIN ] KMPB: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:17:53.702866] [INFO ] [MAIN ] KMPB: Generated 1819 derivative records from 3646 primary records. [2025-09-29T02:17:53.714765] [DEBUG] [LOCAL ] KMPB: Saving derivative data. [2025-09-29T02:17:53.983176] [DEBUG] [LOCAL ] KMT: Loaded 43687 existing records from primary storage. [2025-09-29T02:17:53.901358] [DEBUG] [LOCAL ] KMPB: Derivative data saved (1819 records). [2025-09-29T02:17:53.993170] [INFO ] [MAIN ] KMT: Loaded 43687 primary data records. [2025-09-29T02:17:53.994281] [INFO ] [MAIN ] KMPB: Successfully saved derivative data. [2025-09-29T02:17:54.014486] [INFO ] [MAIN ] Derivative Progress: 1129/2211 symbols completed. KMPB took 0.9s. Estimated remaining: 7m 37s. Rate: 142.0 symbols/min [2025-09-29T02:17:54.021525] [INFO ] [MAIN ] KMX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:54.456611] [DEBUG] [LOCAL ] KMX: Loaded 53897 existing records from primary storage. [2025-09-29T02:17:54.457944] [INFO ] [MAIN ] KMX: Loaded 53897 primary data records. [2025-09-29T02:17:54.457411] [DEBUG] [MAIN ] KMPR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:54.477363] [INFO ] [MAIN ] KMPR: Generated 1820 derivative records from 39117 primary records. [2025-09-29T02:17:54.511033] [DEBUG] [LOCAL ] KMPR: Saving derivative data. [2025-09-29T02:17:54.818537] [DEBUG] [LOCAL ] KMPR: Derivative data saved (1820 records). [2025-09-29T02:17:54.823070] [INFO ] [MAIN ] KMPR: Successfully saved derivative data. [2025-09-29T02:17:54.826495] [INFO ] [MAIN ] Derivative Progress: 1130/2211 symbols completed. KMPR took 1.6s. Estimated remaining: 7m 37s. Rate: 141.9 symbols/min [2025-09-29T02:17:54.827419] [INFO ] [MAIN ] KN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:54.844519] [DEBUG] [MAIN ] KMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:54.845820] [INFO ] [MAIN ] KMT: Generated 1820 derivative records from 43687 primary records. [2025-09-29T02:17:54.846088] [DEBUG] [LOCAL ] KMT: Saving derivative data. [2025-09-29T02:17:54.865980] [DEBUG] [LOCAL ] KMT: Derivative data saved (1820 records). [2025-09-29T02:17:54.866533] [INFO ] [MAIN ] KMT: Successfully saved derivative data. [2025-09-29T02:17:54.870060] [INFO ] [MAIN ] Derivative Progress: 1131/2211 symbols completed. KMT took 1.3s. Estimated remaining: 7m 36s. Rate: 142.0 symbols/min [2025-09-29T02:17:54.870421] [INFO ] [MAIN ] KNF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:54.903823] [DEBUG] [MAIN ] KMX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:54.904774] [INFO ] [MAIN ] KMX: Generated 1820 derivative records from 53897 primary records. [2025-09-29T02:17:54.904947] [DEBUG] [LOCAL ] KMX: Saving derivative data. [2025-09-29T02:17:54.923225] [DEBUG] [LOCAL ] KMX: Derivative data saved (1820 records). [2025-09-29T02:17:54.943527] [INFO ] [MAIN ] KMX: Successfully saved derivative data. [2025-09-29T02:17:54.946198] [INFO ] [MAIN ] Derivative Progress: 1132/2211 symbols completed. KMX took 0.9s. Estimated remaining: 7m 36s. Rate: 142.1 symbols/min [2025-09-29T02:17:54.946631] [INFO ] [MAIN ] KNOP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:54.947866] [DEBUG] [LOCAL ] KN: Loaded 39393 existing records from primary storage. [2025-09-29T02:17:54.948152] [INFO ] [MAIN ] KN: Loaded 39393 primary data records. [2025-09-29T02:17:54.979323] [DEBUG] [LOCAL ] KNF: Loaded 36435 existing records from primary storage. [2025-09-29T02:17:55.009313] [INFO ] [MAIN ] KNF: Loaded 36435 primary data records. [2025-09-29T02:17:55.175159] [DEBUG] [LOCAL ] KNOP: Loaded 10274 existing records from primary storage. [2025-09-29T02:17:55.206052] [INFO ] [MAIN ] KNOP: Loaded 10274 primary data records. [2025-09-29T02:17:56.010022] [DEBUG] [MAIN ] KNF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:56.009259] [DEBUG] [MAIN ] KN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:56.012534] [INFO ] [MAIN ] KN: Generated 1820 derivative records from 39393 primary records. [2025-09-29T02:17:56.011381] [INFO ] [MAIN ] KNF: Generated 1820 derivative records from 36435 primary records. [2025-09-29T02:17:56.012883] [DEBUG] [LOCAL ] KN: Saving derivative data. [2025-09-29T02:17:56.013290] [DEBUG] [LOCAL ] KNF: Saving derivative data. [2025-09-29T02:17:56.039401] [DEBUG] [LOCAL ] KN: Derivative data saved (1820 records). [2025-09-29T02:17:56.044359] [INFO ] [MAIN ] KN: Successfully saved derivative data. [2025-09-29T02:17:56.049184] [INFO ] [MAIN ] Derivative Progress: 1133/2211 symbols completed. KN took 1.2s. Estimated remaining: 7m 36s. Rate: 141.9 symbols/min [2025-09-29T02:17:56.050340] [INFO ] [MAIN ] KNSL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:56.052840] [DEBUG] [LOCAL ] KNF: Derivative data saved (1820 records). [2025-09-29T02:17:56.053201] [INFO ] [MAIN ] KNF: Successfully saved derivative data. [2025-09-29T02:17:56.057084] [INFO ] [MAIN ] Derivative Progress: 1134/2211 symbols completed. KNF took 1.2s. Estimated remaining: 7m 35s. Rate: 142.0 symbols/min [2025-09-29T02:17:56.059231] [INFO ] [MAIN ] KNTK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:56.075256] [DEBUG] [MAIN ] KNOP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:56.076091] [INFO ] [MAIN ] KNOP: Generated 1820 derivative records from 10274 primary records. [2025-09-29T02:17:56.076450] [DEBUG] [LOCAL ] KNOP: Saving derivative data. [2025-09-29T02:17:56.097713] [DEBUG] [LOCAL ] KNOP: Derivative data saved (1820 records). [2025-09-29T02:17:56.105250] [INFO ] [MAIN ] KNOP: Successfully saved derivative data. [2025-09-29T02:17:56.106434] [DEBUG] [LOCAL ] KNSL: Loaded 18372 existing records from primary storage. [2025-09-29T02:17:56.109911] [INFO ] [MAIN ] KNSL: Loaded 18372 primary data records. [2025-09-29T02:17:56.109613] [INFO ] [MAIN ] Derivative Progress: 1135/2211 symbols completed. KNOP took 1.2s. Estimated remaining: 7m 34s. Rate: 142.1 symbols/min [2025-09-29T02:17:56.115465] [INFO ] [MAIN ] KNX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:56.348683] [DEBUG] [LOCAL ] KNTK: Loaded 46794 existing records from primary storage. [2025-09-29T02:17:56.489684] [INFO ] [MAIN ] KNTK: Loaded 46794 primary data records. [2025-09-29T02:17:56.704224] [DEBUG] [LOCAL ] KNX: Loaded 53363 existing records from primary storage. [2025-09-29T02:17:56.705581] [INFO ] [MAIN ] KNX: Loaded 53363 primary data records. [2025-09-29T02:17:57.273556] [DEBUG] [MAIN ] KNSL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:57.275001] [INFO ] [MAIN ] KNSL: Generated 1820 derivative records from 18372 primary records. [2025-09-29T02:17:57.275125] [DEBUG] [LOCAL ] KNSL: Saving derivative data. [2025-09-29T02:17:57.294555] [DEBUG] [LOCAL ] KNSL: Derivative data saved (1820 records). [2025-09-29T02:17:57.295006] [INFO ] [MAIN ] KNSL: Successfully saved derivative data. [2025-09-29T02:17:57.297594] [INFO ] [MAIN ] Derivative Progress: 1136/2211 symbols completed. KNSL took 1.2s. Estimated remaining: 7m 35s. Rate: 141.9 symbols/min [2025-09-29T02:17:57.298226] [INFO ] [MAIN ] KODK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:57.319850] [DEBUG] [MAIN ] KNTK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:57.321636] [INFO ] [MAIN ] KNTK: Generated 1820 derivative records from 46794 primary records. [2025-09-29T02:17:57.322032] [DEBUG] [LOCAL ] KNTK: Saving derivative data. [2025-09-29T02:17:57.336519] [DEBUG] [MAIN ] KNX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:57.352677] [DEBUG] [LOCAL ] KNTK: Derivative data saved (1820 records). [2025-09-29T02:17:57.352903] [INFO ] [MAIN ] KNTK: Successfully saved derivative data. [2025-09-29T02:17:57.351728] [INFO ] [MAIN ] KNX: Generated 1820 derivative records from 53363 primary records. [2025-09-29T02:17:57.355976] [INFO ] [MAIN ] Derivative Progress: 1137/2211 symbols completed. KNTK took 1.3s. Estimated remaining: 7m 34s. Rate: 142.0 symbols/min [2025-09-29T02:17:57.356272] [INFO ] [MAIN ] KOF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:57.356452] [DEBUG] [LOCAL ] KNX: Saving derivative data. [2025-09-29T02:17:57.384996] [DEBUG] [LOCAL ] KNX: Derivative data saved (1820 records). [2025-09-29T02:17:57.385222] [INFO ] [MAIN ] KNX: Successfully saved derivative data. [2025-09-29T02:17:57.388333] [INFO ] [MAIN ] Derivative Progress: 1138/2211 symbols completed. KNX took 1.3s. Estimated remaining: 7m 33s. Rate: 142.1 symbols/min [2025-09-29T02:17:57.413296] [DEBUG] [LOCAL ] KODK: Loaded 44025 existing records from primary storage. [2025-09-29T02:17:57.413528] [INFO ] [MAIN ] KODK: Loaded 44025 primary data records. [2025-09-29T02:17:57.527534] [DEBUG] [LOCAL ] KOF: Loaded 26219 existing records from primary storage. [2025-09-29T02:17:57.530593] [INFO ] [MAIN ] KOF: Loaded 26219 primary data records. [2025-09-29T02:17:58.104984] [DEBUG] [MAIN ] KODK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:58.106043] [INFO ] [MAIN ] KODK: Generated 1820 derivative records from 44025 primary records. [2025-09-29T02:17:58.106410] [DEBUG] [LOCAL ] KODK: Saving derivative data. [2025-09-29T02:17:58.128612] [DEBUG] [LOCAL ] KODK: Derivative data saved (1820 records). [2025-09-29T02:17:58.129259] [INFO ] [MAIN ] KODK: Successfully saved derivative data. [2025-09-29T02:17:58.132199] [INFO ] [MAIN ] Derivative Progress: 1139/2211 symbols completed. KODK took 0.8s. Estimated remaining: 7m 33s. Rate: 142.0 symbols/min [2025-09-29T02:17:58.146234] [DEBUG] [MAIN ] KOF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:58.147197] [INFO ] [MAIN ] KOF: Generated 1820 derivative records from 26219 primary records. [2025-09-29T02:17:58.147284] [DEBUG] [LOCAL ] KOF: Saving derivative data. [2025-09-29T02:17:58.165024] [DEBUG] [LOCAL ] KOF: Derivative data saved (1820 records). [2025-09-29T02:17:58.165199] [INFO ] [MAIN ] KOF: Successfully saved derivative data. [2025-09-29T02:17:58.168426] [INFO ] [MAIN ] Derivative Progress: 1140/2211 symbols completed. KOF took 0.8s. Estimated remaining: 7m 32s. Rate: 142.1 symbols/min [2025-09-29T02:17:58.169299] [INFO ] [MAIN ] KORE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:58.170000] [INFO ] [MAIN ] KOS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:58.169220] [INFO ] [MAIN ] KOP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:58.176695] [DEBUG] [LOCAL ] KORE: Loaded 2010 existing records from primary storage. [2025-09-29T02:17:58.177146] [INFO ] [MAIN ] KORE: Loaded 2010 primary data records. [2025-09-29T02:17:58.324145] [DEBUG] [LOCAL ] KOP: Loaded 18066 existing records from primary storage. [2025-09-29T02:17:58.330548] [INFO ] [MAIN ] KOP: Loaded 18066 primary data records. [2025-09-29T02:17:58.722864] [DEBUG] [LOCAL ] KOS: Loaded 53828 existing records from primary storage. [2025-09-29T02:17:58.762597] [INFO ] [MAIN ] KOS: Loaded 53828 primary data records. [2025-09-29T02:17:59.571892] [DEBUG] [MAIN ] KORE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:59.574457] [INFO ] [MAIN ] KORE: Generated 1820 derivative records from 2010 primary records. [2025-09-29T02:17:59.575534] [DEBUG] [LOCAL ] KORE: Saving derivative data. [2025-09-29T02:17:59.595123] [DEBUG] [LOCAL ] KORE: Derivative data saved (1820 records). [2025-09-29T02:17:59.595698] [INFO ] [MAIN ] KORE: Successfully saved derivative data. [2025-09-29T02:17:59.599142] [INFO ] [MAIN ] Derivative Progress: 1141/2211 symbols completed. KORE took 1.4s. Estimated remaining: 7m 33s. Rate: 141.8 symbols/min [2025-09-29T02:17:59.599633] [INFO ] [MAIN ] KR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:59.616938] [DEBUG] [MAIN ] KOP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:59.618456] [INFO ] [MAIN ] KOP: Generated 1820 derivative records from 18066 primary records. [2025-09-29T02:17:59.618941] [DEBUG] [LOCAL ] KOP: Saving derivative data. [2025-09-29T02:17:59.639569] [DEBUG] [LOCAL ] KOP: Derivative data saved (1820 records). [2025-09-29T02:17:59.653244] [INFO ] [MAIN ] KOP: Successfully saved derivative data. [2025-09-29T02:17:59.656163] [INFO ] [MAIN ] Derivative Progress: 1142/2211 symbols completed. KOP took 1.5s. Estimated remaining: 7m 32s. Rate: 141.9 symbols/min [2025-09-29T02:17:59.653157] [DEBUG] [MAIN ] KOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:17:59.656411] [INFO ] [MAIN ] KRC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:59.657826] [INFO ] [MAIN ] KOS: Generated 1820 derivative records from 53828 primary records. [2025-09-29T02:17:59.658372] [DEBUG] [LOCAL ] KOS: Saving derivative data. [2025-09-29T02:17:59.678774] [DEBUG] [LOCAL ] KOS: Derivative data saved (1820 records). [2025-09-29T02:17:59.679211] [INFO ] [MAIN ] KOS: Successfully saved derivative data. [2025-09-29T02:17:59.683081] [INFO ] [MAIN ] Derivative Progress: 1143/2211 symbols completed. KOS took 1.5s. Estimated remaining: 7m 31s. Rate: 142.1 symbols/min [2025-09-29T02:17:59.683457] [INFO ] [MAIN ] KREF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:17:59.758326] [DEBUG] [LOCAL ] KR: Loaded 54461 existing records from primary storage. [2025-09-29T02:17:59.761034] [DEBUG] [LOCAL ] KRC: Loaded 49114 existing records from primary storage. [2025-09-29T02:17:59.760117] [INFO ] [MAIN ] KR: Loaded 54461 primary data records. [2025-09-29T02:17:59.761406] [INFO ] [MAIN ] KRC: Loaded 49114 primary data records. [2025-09-29T02:18:00.022464] [DEBUG] [LOCAL ] KREF: Loaded 37767 existing records from primary storage. [2025-09-29T02:18:00.092931] [INFO ] [MAIN ] KREF: Loaded 37767 primary data records. [2025-09-29T02:18:00.844018] [DEBUG] [MAIN ] KRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:00.845299] [INFO ] [MAIN ] KRC: Generated 1820 derivative records from 49114 primary records. [2025-09-29T02:18:00.845417] [DEBUG] [LOCAL ] KRC: Saving derivative data. [2025-09-29T02:18:00.864121] [DEBUG] [MAIN ] KR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:00.865535] [INFO ] [MAIN ] KR: Generated 1820 derivative records from 54461 primary records. [2025-09-29T02:18:00.873106] [DEBUG] [LOCAL ] KR: Saving derivative data. [2025-09-29T02:18:00.883659] [DEBUG] [LOCAL ] KRC: Derivative data saved (1820 records). [2025-09-29T02:18:00.896892] [INFO ] [MAIN ] KRC: Successfully saved derivative data. [2025-09-29T02:18:00.904348] [INFO ] [MAIN ] Derivative Progress: 1144/2211 symbols completed. KRC took 1.2s. Estimated remaining: 7m 31s. Rate: 141.8 symbols/min [2025-09-29T02:18:00.907405] [DEBUG] [LOCAL ] KR: Derivative data saved (1820 records). [2025-09-29T02:18:00.907574] [INFO ] [MAIN ] KR: Successfully saved derivative data. [2025-09-29T02:18:00.908567] [INFO ] [MAIN ] KRG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:00.911409] [INFO ] [MAIN ] Derivative Progress: 1145/2211 symbols completed. KR took 1.3s. Estimated remaining: 7m 31s. Rate: 142.0 symbols/min [2025-09-29T02:18:00.912906] [INFO ] [MAIN ] KRO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:00.929177] [DEBUG] [MAIN ] KREF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:00.930098] [INFO ] [MAIN ] KREF: Generated 1820 derivative records from 37767 primary records. [2025-09-29T02:18:00.930356] [DEBUG] [LOCAL ] KREF: Saving derivative data. [2025-09-29T02:18:00.950564] [DEBUG] [LOCAL ] KREF: Derivative data saved (1820 records). [2025-09-29T02:18:00.951081] [INFO ] [MAIN ] KREF: Successfully saved derivative data. [2025-09-29T02:18:00.954155] [INFO ] [MAIN ] Derivative Progress: 1146/2211 symbols completed. KREF took 1.3s. Estimated remaining: 7m 30s. Rate: 142.1 symbols/min [2025-09-29T02:18:00.954454] [INFO ] [MAIN ] KRP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:00.977985] [DEBUG] [LOCAL ] KRO: Loaded 26448 existing records from primary storage. [2025-09-29T02:18:00.978193] [INFO ] [MAIN ] KRO: Loaded 26448 primary data records. [2025-09-29T02:18:01.226527] [DEBUG] [LOCAL ] KRP: Loaded 37947 existing records from primary storage. [2025-09-29T02:18:01.400710] [DEBUG] [LOCAL ] KRG: Loaded 49859 existing records from primary storage. [2025-09-29T02:18:01.419142] [INFO ] [MAIN ] KRP: Loaded 37947 primary data records. [2025-09-29T02:18:01.419241] [INFO ] [MAIN ] KRG: Loaded 49859 primary data records. [2025-09-29T02:18:02.135791] [DEBUG] [MAIN ] KRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:02.137989] [INFO ] [MAIN ] KRO: Generated 1820 derivative records from 26448 primary records. [2025-09-29T02:18:02.138283] [DEBUG] [LOCAL ] KRO: Saving derivative data. [2025-09-29T02:18:02.159081] [DEBUG] [LOCAL ] KRO: Derivative data saved (1820 records). [2025-09-29T02:18:02.159600] [INFO ] [MAIN ] KRO: Successfully saved derivative data. [2025-09-29T02:18:02.162260] [INFO ] [MAIN ] Derivative Progress: 1147/2211 symbols completed. KRO took 1.2s. Estimated remaining: 7m 30s. Rate: 141.8 symbols/min [2025-09-29T02:18:02.162818] [INFO ] [MAIN ] KSS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:02.183885] [DEBUG] [MAIN ] KRP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:02.186422] [INFO ] [MAIN ] KRP: Generated 1820 derivative records from 37947 primary records. [2025-09-29T02:18:02.186537] [DEBUG] [LOCAL ] KRP: Saving derivative data. [2025-09-29T02:18:02.215393] [DEBUG] [MAIN ] KRG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:02.218915] [DEBUG] [LOCAL ] KRP: Derivative data saved (1820 records). [2025-09-29T02:18:02.220026] [INFO ] [MAIN ] KRG: Generated 1820 derivative records from 49859 primary records. [2025-09-29T02:18:02.220218] [INFO ] [MAIN ] KRP: Successfully saved derivative data. [2025-09-29T02:18:02.220142] [DEBUG] [LOCAL ] KRG: Saving derivative data. [2025-09-29T02:18:02.223986] [INFO ] [MAIN ] Derivative Progress: 1148/2211 symbols completed. KRP took 1.3s. Estimated remaining: 7m 29s. Rate: 141.9 symbols/min [2025-09-29T02:18:02.224601] [INFO ] [MAIN ] KT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:02.241030] [DEBUG] [LOCAL ] KRG: Derivative data saved (1820 records). [2025-09-29T02:18:02.241267] [INFO ] [MAIN ] KRG: Successfully saved derivative data. [2025-09-29T02:18:02.244498] [INFO ] [MAIN ] Derivative Progress: 1149/2211 symbols completed. KRG took 1.3s. Estimated remaining: 7m 29s. Rate: 142.1 symbols/min [2025-09-29T02:18:02.244888] [INFO ] [MAIN ] KTB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:02.286309] [DEBUG] [LOCAL ] KSS: Loaded 54385 existing records from primary storage. [2025-09-29T02:18:02.286701] [INFO ] [MAIN ] KSS: Loaded 54385 primary data records. [2025-09-29T02:18:02.452596] [DEBUG] [LOCAL ] KT: Loaded 46336 existing records from primary storage. [2025-09-29T02:18:02.523712] [INFO ] [MAIN ] KT: Loaded 46336 primary data records. [2025-09-29T02:18:02.741038] [DEBUG] [LOCAL ] KTB: Loaded 41738 existing records from primary storage. [2025-09-29T02:18:02.760622] [INFO ] [MAIN ] KTB: Loaded 41738 primary data records. [2025-09-29T02:18:03.445079] [DEBUG] [MAIN ] KSS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:03.446544] [INFO ] [MAIN ] KSS: Generated 1820 derivative records from 54385 primary records. [2025-09-29T02:18:03.446698] [DEBUG] [LOCAL ] KSS: Saving derivative data. [2025-09-29T02:18:03.470017] [DEBUG] [LOCAL ] KSS: Derivative data saved (1820 records). [2025-09-29T02:18:03.471498] [INFO ] [MAIN ] KSS: Successfully saved derivative data. [2025-09-29T02:18:03.477053] [INFO ] [MAIN ] Derivative Progress: 1150/2211 symbols completed. KSS took 1.3s. Estimated remaining: 7m 29s. Rate: 141.8 symbols/min [2025-09-29T02:18:03.477500] [INFO ] [MAIN ] KTF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:03.494308] [DEBUG] [MAIN ] KT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:03.496948] [INFO ] [MAIN ] KT: Generated 1820 derivative records from 46336 primary records. [2025-09-29T02:18:03.497256] [DEBUG] [LOCAL ] KT: Saving derivative data. [2025-09-29T02:18:03.522956] [DEBUG] [MAIN ] KTB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:03.534331] [DEBUG] [LOCAL ] KTF: Loaded 13065 existing records from primary storage. [2025-09-29T02:18:03.533189] [INFO ] [MAIN ] KTB: Generated 1820 derivative records from 41738 primary records. [2025-09-29T02:18:03.534519] [DEBUG] [LOCAL ] KTB: Saving derivative data. [2025-09-29T02:18:03.534584] [INFO ] [MAIN ] KTF: Loaded 13065 primary data records. [2025-09-29T02:18:03.639516] [DEBUG] [LOCAL ] KTB: Derivative data saved (1820 records). [2025-09-29T02:18:03.646196] [DEBUG] [LOCAL ] KT: Derivative data saved (1820 records). [2025-09-29T02:18:03.646282] [INFO ] [MAIN ] KTB: Successfully saved derivative data. [2025-09-29T02:18:03.651554] [INFO ] [MAIN ] KT: Successfully saved derivative data. [2025-09-29T02:18:03.659619] [INFO ] [MAIN ] Derivative Progress: 1151/2211 symbols completed. KT took 1.4s. Estimated remaining: 7m 28s. Rate: 141.9 symbols/min [2025-09-29T02:18:03.685714] [INFO ] [MAIN ] KVUE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:03.685798] [INFO ] [MAIN ] Derivative Progress: 1152/2211 symbols completed. KTB took 1.4s. Estimated remaining: 7m 27s. Rate: 142.0 symbols/min [2025-09-29T02:18:03.691987] [INFO ] [MAIN ] KVYO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:03.954879] [DEBUG] [MAIN ] KTF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:03.955687] [INFO ] [MAIN ] KTF: Generated 1820 derivative records from 13065 primary records. [2025-09-29T02:18:03.955782] [DEBUG] [LOCAL ] KTF: Saving derivative data. [2025-09-29T02:18:03.990240] [DEBUG] [LOCAL ] KTF: Derivative data saved (1820 records). [2025-09-29T02:18:04.004608] [INFO ] [MAIN ] KTF: Successfully saved derivative data. [2025-09-29T02:18:04.009298] [INFO ] [MAIN ] Derivative Progress: 1153/2211 symbols completed. KTF took 0.5s. Estimated remaining: 7m 27s. Rate: 142.0 symbols/min [2025-09-29T02:18:04.012137] [DEBUG] [LOCAL ] KVYO: Loaded 50696 existing records from primary storage. [2025-09-29T02:18:04.014258] [INFO ] [MAIN ] KVYO: Loaded 50696 primary data records. [2025-09-29T02:18:04.111754] [DEBUG] [LOCAL ] KVUE: Loaded 54447 existing records from primary storage. [2025-09-29T02:18:04.141716] [INFO ] [MAIN ] KVUE: Loaded 54447 primary data records. [2025-09-29T02:18:04.735711] [DEBUG] [MAIN ] KVYO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:04.736606] [INFO ] [MAIN ] KVYO: Generated 1820 derivative records from 50696 primary records. [2025-09-29T02:18:04.736939] [DEBUG] [LOCAL ] KVYO: Saving derivative data. [2025-09-29T02:18:04.756855] [DEBUG] [LOCAL ] KVYO: Derivative data saved (1820 records). [2025-09-29T02:18:04.772165] [INFO ] [MAIN ] KVYO: Successfully saved derivative data. [2025-09-29T02:18:04.775419] [INFO ] [MAIN ] Derivative Progress: 1154/2211 symbols completed. KVYO took 1.1s. Estimated remaining: 7m 27s. Rate: 141.9 symbols/min [2025-09-29T02:18:04.775979] [DEBUG] [MAIN ] KVUE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:04.777101] [INFO ] [MAIN ] KVUE: Generated 1820 derivative records from 54447 primary records. [2025-09-29T02:18:04.777261] [DEBUG] [LOCAL ] KVUE: Saving derivative data. [2025-09-29T02:18:04.793901] [DEBUG] [LOCAL ] KVUE: Derivative data saved (1820 records). [2025-09-29T02:18:04.794040] [INFO ] [MAIN ] KVUE: Successfully saved derivative data. [2025-09-29T02:18:04.796361] [INFO ] [MAIN ] Derivative Progress: 1155/2211 symbols completed. KVUE took 1.1s. Estimated remaining: 7m 26s. Rate: 142.1 symbols/min [2025-09-29T02:18:04.796871] [INFO ] [MAIN ] KW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:04.797035] [INFO ] [MAIN ] KYN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:04.797087] [INFO ] [MAIN ] KWR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:04.847468] [DEBUG] [LOCAL ] KWR: Loaded 16931 existing records from primary storage. [2025-09-29T02:18:04.847713] [INFO ] [MAIN ] KWR: Loaded 16931 primary data records. [2025-09-29T02:18:04.967309] [DEBUG] [LOCAL ] KW: Loaded 41236 existing records from primary storage. [2025-09-29T02:18:04.980327] [DEBUG] [LOCAL ] KYN: Loaded 30432 existing records from primary storage. [2025-09-29T02:18:04.993719] [INFO ] [MAIN ] KW: Loaded 41236 primary data records. [2025-09-29T02:18:04.993613] [INFO ] [MAIN ] KYN: Loaded 30432 primary data records. [2025-09-29T02:18:05.978390] [DEBUG] [MAIN ] KWR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:05.979868] [INFO ] [MAIN ] KWR: Generated 1820 derivative records from 16931 primary records. [2025-09-29T02:18:05.983062] [DEBUG] [LOCAL ] KWR: Saving derivative data. [2025-09-29T02:18:06.015980] [DEBUG] [LOCAL ] KWR: Derivative data saved (1820 records). [2025-09-29T02:18:06.017087] [INFO ] [MAIN ] KWR: Successfully saved derivative data. [2025-09-29T02:18:06.017003] [DEBUG] [MAIN ] KYN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:06.018193] [INFO ] [MAIN ] KYN: Generated 1820 derivative records from 30432 primary records. [2025-09-29T02:18:06.020618] [INFO ] [MAIN ] Derivative Progress: 1156/2211 symbols completed. KWR took 1.2s. Estimated remaining: 7m 26s. Rate: 141.8 symbols/min [2025-09-29T02:18:06.020935] [INFO ] [MAIN ] L: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:06.021206] [DEBUG] [LOCAL ] KYN: Saving derivative data. [2025-09-29T02:18:06.043069] [DEBUG] [LOCAL ] KYN: Derivative data saved (1820 records). [2025-09-29T02:18:06.045184] [INFO ] [MAIN ] KYN: Successfully saved derivative data. [2025-09-29T02:18:06.048350] [INFO ] [MAIN ] Derivative Progress: 1157/2211 symbols completed. KYN took 1.3s. Estimated remaining: 7m 26s. Rate: 141.9 symbols/min [2025-09-29T02:18:06.048725] [INFO ] [MAIN ] LAC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:06.063231] [DEBUG] [MAIN ] KW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:06.064051] [INFO ] [MAIN ] KW: Generated 1820 derivative records from 41236 primary records. [2025-09-29T02:18:06.064272] [DEBUG] [LOCAL ] KW: Saving derivative data. [2025-09-29T02:18:06.082480] [DEBUG] [LOCAL ] KW: Derivative data saved (1820 records). [2025-09-29T02:18:06.082856] [INFO ] [MAIN ] KW: Successfully saved derivative data. [2025-09-29T02:18:06.085511] [INFO ] [MAIN ] Derivative Progress: 1158/2211 symbols completed. KW took 1.3s. Estimated remaining: 7m 25s. Rate: 142.0 symbols/min [2025-09-29T02:18:06.096414] [INFO ] [MAIN ] LAD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:06.120121] [DEBUG] [LOCAL ] L: Loaded 41562 existing records from primary storage. [2025-09-29T02:18:06.120504] [INFO ] [MAIN ] L: Loaded 41562 primary data records. [2025-09-29T02:18:06.265172] [DEBUG] [LOCAL ] LAD: Loaded 24089 existing records from primary storage. [2025-09-29T02:18:06.292079] [INFO ] [MAIN ] LAD: Loaded 24089 primary data records. [2025-09-29T02:18:06.334709] [DEBUG] [LOCAL ] LAC: Loaded 53091 existing records from primary storage. [2025-09-29T02:18:06.501414] [INFO ] [MAIN ] LAC: Loaded 53091 primary data records. [2025-09-29T02:18:07.241811] [DEBUG] [MAIN ] L: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:07.244245] [INFO ] [MAIN ] L: Generated 1820 derivative records from 41562 primary records. [2025-09-29T02:18:07.244958] [DEBUG] [LOCAL ] L: Saving derivative data. [2025-09-29T02:18:07.275448] [DEBUG] [LOCAL ] L: Derivative data saved (1820 records). [2025-09-29T02:18:07.280772] [INFO ] [MAIN ] L: Successfully saved derivative data. [2025-09-29T02:18:07.285072] [INFO ] [MAIN ] Derivative Progress: 1159/2211 symbols completed. L took 1.3s. Estimated remaining: 7m 25s. Rate: 141.8 symbols/min [2025-09-29T02:18:07.285464] [INFO ] [MAIN ] LADR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:07.300866] [DEBUG] [MAIN ] LAD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:07.302233] [INFO ] [MAIN ] LAD: Generated 1820 derivative records from 24089 primary records. [2025-09-29T02:18:07.302453] [DEBUG] [LOCAL ] LAD: Saving derivative data. [2025-09-29T02:18:07.325206] [DEBUG] [LOCAL ] LAD: Derivative data saved (1820 records). [2025-09-29T02:18:07.325704] [INFO ] [MAIN ] LAD: Successfully saved derivative data. [2025-09-29T02:18:07.343056] [INFO ] [MAIN ] Derivative Progress: 1160/2211 symbols completed. LAD took 1.2s. Estimated remaining: 7m 24s. Rate: 141.9 symbols/min [2025-09-29T02:18:07.344296] [DEBUG] [MAIN ] LAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:07.344489] [INFO ] [MAIN ] LANV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:07.345728] [INFO ] [MAIN ] LAC: Generated 1820 derivative records from 53091 primary records. [2025-09-29T02:18:07.346134] [DEBUG] [LOCAL ] LAC: Saving derivative data. [2025-09-29T02:18:07.365517] [DEBUG] [LOCAL ] LAC: Derivative data saved (1820 records). [2025-09-29T02:18:07.377291] [DEBUG] [LOCAL ] LANV: Loaded 2851 existing records from primary storage. [2025-09-29T02:18:07.377106] [INFO ] [MAIN ] LAC: Successfully saved derivative data. [2025-09-29T02:18:07.380787] [INFO ] [MAIN ] Derivative Progress: 1161/2211 symbols completed. LAC took 1.3s. Estimated remaining: 7m 24s. Rate: 142.0 symbols/min [2025-09-29T02:18:07.377459] [INFO ] [MAIN ] LANV: Loaded 2851 primary data records. [2025-09-29T02:18:07.381103] [INFO ] [MAIN ] LAW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:07.502561] [DEBUG] [LOCAL ] LADR: Loaded 39204 existing records from primary storage. [2025-09-29T02:18:07.531589] [INFO ] [MAIN ] LADR: Loaded 39204 primary data records. [2025-09-29T02:18:07.576395] [DEBUG] [LOCAL ] LAW: Loaded 14171 existing records from primary storage. [2025-09-29T02:18:07.631849] [INFO ] [MAIN ] LAW: Loaded 14171 primary data records. [2025-09-29T02:18:08.535028] [DEBUG] [MAIN ] LANV: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-09-29T02:18:08.536452] [INFO ] [MAIN ] LANV: Generated 1818 derivative records from 2851 primary records. [2025-09-29T02:18:08.536967] [DEBUG] [LOCAL ] LANV: Saving derivative data. [2025-09-29T02:18:08.552485] [DEBUG] [LOCAL ] LANV: Derivative data saved (1818 records). [2025-09-29T02:18:08.552871] [INFO ] [MAIN ] LANV: Successfully saved derivative data. [2025-09-29T02:18:08.555199] [INFO ] [MAIN ] Derivative Progress: 1162/2211 symbols completed. LANV took 1.2s. Estimated remaining: 7m 24s. Rate: 141.8 symbols/min [2025-09-29T02:18:08.555920] [INFO ] [MAIN ] LAZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:08.588332] [DEBUG] [MAIN ] LADR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:08.588630] [DEBUG] [MAIN ] LAW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:08.589749] [INFO ] [MAIN ] LAW: Generated 1820 derivative records from 14171 primary records. [2025-09-29T02:18:08.590636] [DEBUG] [LOCAL ] LAW: Saving derivative data. [2025-09-29T02:18:08.590512] [INFO ] [MAIN ] LADR: Generated 1820 derivative records from 39204 primary records. [2025-09-29T02:18:08.591584] [DEBUG] [LOCAL ] LADR: Saving derivative data. [2025-09-29T02:18:08.608850] [DEBUG] [LOCAL ] LAW: Derivative data saved (1820 records). [2025-09-29T02:18:08.609257] [INFO ] [MAIN ] LAW: Successfully saved derivative data. [2025-09-29T02:18:08.619498] [INFO ] [MAIN ] Derivative Progress: 1163/2211 symbols completed. LAW took 1.2s. Estimated remaining: 7m 23s. Rate: 141.9 symbols/min [2025-09-29T02:18:08.624606] [INFO ] [MAIN ] LB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:08.629008] [DEBUG] [LOCAL ] LADR: Derivative data saved (1820 records). [2025-09-29T02:18:08.629544] [INFO ] [MAIN ] LADR: Successfully saved derivative data. [2025-09-29T02:18:08.632348] [INFO ] [MAIN ] Derivative Progress: 1164/2211 symbols completed. LADR took 1.3s. Estimated remaining: 7m 22s. Rate: 142.0 symbols/min [2025-09-29T02:18:08.633923] [INFO ] [MAIN ] LBRT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:08.670321] [DEBUG] [LOCAL ] LAZ: Loaded 45784 existing records from primary storage. [2025-09-29T02:18:08.670568] [INFO ] [MAIN ] LAZ: Loaded 45784 primary data records. [2025-09-29T02:18:09.086295] [DEBUG] [LOCAL ] LB: Loaded 38116 existing records from primary storage. [2025-09-29T02:18:09.088889] [INFO ] [MAIN ] LB: Loaded 38116 primary data records. [2025-09-29T02:18:09.130861] [DEBUG] [LOCAL ] LBRT: Loaded 53695 existing records from primary storage. [2025-09-29T02:18:09.180927] [INFO ] [MAIN ] LBRT: Loaded 53695 primary data records. [2025-09-29T02:18:09.805411] [DEBUG] [MAIN ] LAZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:09.816462] [INFO ] [MAIN ] LAZ: Generated 1820 derivative records from 45784 primary records. [2025-09-29T02:18:09.817048] [DEBUG] [LOCAL ] LAZ: Saving derivative data. [2025-09-29T02:18:09.839103] [DEBUG] [LOCAL ] LAZ: Derivative data saved (1820 records). [2025-09-29T02:18:09.839798] [INFO ] [MAIN ] LAZ: Successfully saved derivative data. [2025-09-29T02:18:09.843387] [INFO ] [MAIN ] Derivative Progress: 1165/2211 symbols completed. LAZ took 1.3s. Estimated remaining: 7m 23s. Rate: 141.8 symbols/min [2025-09-29T02:18:09.843596] [INFO ] [MAIN ] LC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:09.866938] [DEBUG] [MAIN ] LB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:09.868592] [INFO ] [MAIN ] LB: Generated 1820 derivative records from 38116 primary records. [2025-09-29T02:18:09.868926] [DEBUG] [LOCAL ] LB: Saving derivative data. [2025-09-29T02:18:09.889135] [DEBUG] [LOCAL ] LB: Derivative data saved (1820 records). [2025-09-29T02:18:09.891355] [INFO ] [MAIN ] LB: Successfully saved derivative data. [2025-09-29T02:18:09.893907] [INFO ] [MAIN ] Derivative Progress: 1166/2211 symbols completed. LB took 1.3s. Estimated remaining: 7m 22s. Rate: 141.9 symbols/min [2025-09-29T02:18:09.894355] [INFO ] [MAIN ] LCII: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:09.910341] [DEBUG] [MAIN ] LBRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:09.923044] [INFO ] [MAIN ] LBRT: Generated 1820 derivative records from 53695 primary records. [2025-09-29T02:18:09.923195] [DEBUG] [LOCAL ] LBRT: Saving derivative data. [2025-09-29T02:18:09.944154] [DEBUG] [LOCAL ] LBRT: Derivative data saved (1820 records). [2025-09-29T02:18:09.958126] [INFO ] [MAIN ] LBRT: Successfully saved derivative data. [2025-09-29T02:18:09.962982] [INFO ] [MAIN ] Derivative Progress: 1167/2211 symbols completed. LBRT took 1.3s. Estimated remaining: 7m 21s. Rate: 142.0 symbols/min [2025-09-29T02:18:09.972131] [INFO ] [MAIN ] LDI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:09.971588] [DEBUG] [LOCAL ] LC: Loaded 48605 existing records from primary storage. [2025-09-29T02:18:09.972956] [INFO ] [MAIN ] LC: Loaded 48605 primary data records. [2025-09-29T02:18:10.075975] [DEBUG] [LOCAL ] LCII: Loaded 28900 existing records from primary storage. [2025-09-29T02:18:10.094937] [INFO ] [MAIN ] LCII: Loaded 28900 primary data records. [2025-09-29T02:18:10.317285] [DEBUG] [LOCAL ] LDI: Loaded 44776 existing records from primary storage. [2025-09-29T02:18:10.344357] [INFO ] [MAIN ] LDI: Loaded 44776 primary data records. [2025-09-29T02:18:11.159413] [DEBUG] [MAIN ] LC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:11.160823] [INFO ] [MAIN ] LC: Generated 1820 derivative records from 48605 primary records. [2025-09-29T02:18:11.161965] [DEBUG] [LOCAL ] LC: Saving derivative data. [2025-09-29T02:18:11.196800] [DEBUG] [LOCAL ] LC: Derivative data saved (1820 records). [2025-09-29T02:18:11.197882] [INFO ] [MAIN ] LC: Successfully saved derivative data. [2025-09-29T02:18:11.196138] [DEBUG] [MAIN ] LCII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:11.198827] [INFO ] [MAIN ] LCII: Generated 1820 derivative records from 28900 primary records. [2025-09-29T02:18:11.202243] [INFO ] [MAIN ] Derivative Progress: 1168/2211 symbols completed. LC took 1.4s. Estimated remaining: 7m 21s. Rate: 141.8 symbols/min [2025-09-29T02:18:11.202576] [DEBUG] [LOCAL ] LCII: Saving derivative data. [2025-09-29T02:18:11.224351] [DEBUG] [MAIN ] LDI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:11.230331] [INFO ] [MAIN ] LDI: Generated 1820 derivative records from 44776 primary records. [2025-09-29T02:18:11.230447] [DEBUG] [LOCAL ] LDI: Saving derivative data. [2025-09-29T02:18:11.234094] [DEBUG] [LOCAL ] LCII: Derivative data saved (1820 records). [2025-09-29T02:18:11.234433] [INFO ] [MAIN ] LCII: Successfully saved derivative data. [2025-09-29T02:18:11.237884] [INFO ] [MAIN ] Derivative Progress: 1169/2211 symbols completed. LCII took 1.3s. Estimated remaining: 7m 21s. Rate: 141.9 symbols/min [2025-09-29T02:18:11.254112] [DEBUG] [LOCAL ] LDI: Derivative data saved (1820 records). [2025-09-29T02:18:11.254264] [INFO ] [MAIN ] LDI: Successfully saved derivative data. [2025-09-29T02:18:11.257888] [INFO ] [MAIN ] Derivative Progress: 1170/2211 symbols completed. LDI took 1.3s. Estimated remaining: 7m 20s. Rate: 142.0 symbols/min [2025-09-29T02:18:11.258318] [INFO ] [MAIN ] LDOS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:11.258437] [INFO ] [MAIN ] LEA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:11.258580] [INFO ] [MAIN ] LDP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:11.281219] [DEBUG] [LOCAL ] LDP: Loaded 13128 existing records from primary storage. [2025-09-29T02:18:11.281581] [INFO ] [MAIN ] LDP: Loaded 13128 primary data records. [2025-09-29T02:18:11.479133] [DEBUG] [LOCAL ] LDOS: Loaded 46407 existing records from primary storage. [2025-09-29T02:18:11.541379] [INFO ] [MAIN ] LDOS: Loaded 46407 primary data records. [2025-09-29T02:18:11.666187] [DEBUG] [LOCAL ] LEA: Loaded 42464 existing records from primary storage. [2025-09-29T02:18:11.671846] [INFO ] [MAIN ] LEA: Loaded 42464 primary data records. [2025-09-29T02:18:12.398471] [DEBUG] [MAIN ] LDP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:12.400592] [INFO ] [MAIN ] LDP: Generated 1820 derivative records from 13128 primary records. [2025-09-29T02:18:12.401775] [DEBUG] [LOCAL ] LDP: Saving derivative data. [2025-09-29T02:18:12.430765] [DEBUG] [LOCAL ] LDP: Derivative data saved (1820 records). [2025-09-29T02:18:12.431828] [INFO ] [MAIN ] LDP: Successfully saved derivative data. [2025-09-29T02:18:12.435550] [INFO ] [MAIN ] Derivative Progress: 1171/2211 symbols completed. LDP took 1.2s. Estimated remaining: 7m 20s. Rate: 141.8 symbols/min [2025-09-29T02:18:12.436773] [INFO ] [MAIN ] LEG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:12.473456] [DEBUG] [MAIN ] LDOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:12.473757] [DEBUG] [MAIN ] LEA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:12.475924] [INFO ] [MAIN ] LEA: Generated 1820 derivative records from 42464 primary records. [2025-09-29T02:18:12.475764] [INFO ] [MAIN ] LDOS: Generated 1820 derivative records from 46407 primary records. [2025-09-29T02:18:12.476139] [DEBUG] [LOCAL ] LDOS: Saving derivative data. [2025-09-29T02:18:12.476603] [DEBUG] [LOCAL ] LEA: Saving derivative data. [2025-09-29T02:18:12.508451] [DEBUG] [LOCAL ] LEA: Derivative data saved (1820 records). [2025-09-29T02:18:12.512225] [INFO ] [MAIN ] LEA: Successfully saved derivative data. [2025-09-29T02:18:12.512682] [DEBUG] [LOCAL ] LDOS: Derivative data saved (1820 records). [2025-09-29T02:18:12.516389] [INFO ] [MAIN ] Derivative Progress: 1172/2211 symbols completed. LEA took 1.3s. Estimated remaining: 7m 19s. Rate: 141.9 symbols/min [2025-09-29T02:18:12.517067] [INFO ] [MAIN ] LEN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:12.516882] [INFO ] [MAIN ] LDOS: Successfully saved derivative data. [2025-09-29T02:18:12.521513] [INFO ] [MAIN ] Derivative Progress: 1173/2211 symbols completed. LDOS took 1.3s. Estimated remaining: 7m 19s. Rate: 142.0 symbols/min [2025-09-29T02:18:12.522098] [INFO ] [MAIN ] LEO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:12.561928] [DEBUG] [LOCAL ] LEO: Loaded 17785 existing records from primary storage. [2025-09-29T02:18:12.563599] [INFO ] [MAIN ] LEO: Loaded 17785 primary data records. [2025-09-29T02:18:12.651207] [DEBUG] [LOCAL ] LEG: Loaded 51130 existing records from primary storage. [2025-09-29T02:18:12.710211] [INFO ] [MAIN ] LEG: Loaded 51130 primary data records. [2025-09-29T02:18:12.987538] [DEBUG] [LOCAL ] LEN: Loaded 53967 existing records from primary storage. [2025-09-29T02:18:13.048045] [INFO ] [MAIN ] LEN: Loaded 53967 primary data records. [2025-09-29T02:18:13.638538] [DEBUG] [MAIN ] LEO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:13.640170] [INFO ] [MAIN ] LEO: Generated 1820 derivative records from 17785 primary records. [2025-09-29T02:18:13.641286] [DEBUG] [LOCAL ] LEO: Saving derivative data. [2025-09-29T02:18:13.663099] [DEBUG] [LOCAL ] LEO: Derivative data saved (1820 records). [2025-09-29T02:18:13.664020] [INFO ] [MAIN ] LEO: Successfully saved derivative data. [2025-09-29T02:18:13.666892] [INFO ] [MAIN ] Derivative Progress: 1174/2211 symbols completed. LEO took 1.1s. Estimated remaining: 7m 19s. Rate: 141.8 symbols/min [2025-09-29T02:18:13.667623] [INFO ] [MAIN ] LEVI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:13.688298] [DEBUG] [MAIN ] LEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:13.690413] [INFO ] [MAIN ] LEN: Generated 1820 derivative records from 53967 primary records. [2025-09-29T02:18:13.691427] [DEBUG] [LOCAL ] LEN: Saving derivative data. [2025-09-29T02:18:13.719545] [DEBUG] [MAIN ] LEG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:13.723066] [INFO ] [MAIN ] LEG: Generated 1820 derivative records from 51130 primary records. [2025-09-29T02:18:13.724543] [DEBUG] [LOCAL ] LEN: Derivative data saved (1820 records). [2025-09-29T02:18:13.724673] [DEBUG] [LOCAL ] LEG: Saving derivative data. [2025-09-29T02:18:13.724953] [INFO ] [MAIN ] LEN: Successfully saved derivative data. [2025-09-29T02:18:13.730144] [INFO ] [MAIN ] Derivative Progress: 1175/2211 symbols completed. LEN took 1.2s. Estimated remaining: 7m 18s. Rate: 141.9 symbols/min [2025-09-29T02:18:13.738891] [INFO ] [MAIN ] LFT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:13.748508] [DEBUG] [LOCAL ] LEG: Derivative data saved (1820 records). [2025-09-29T02:18:13.748903] [INFO ] [MAIN ] LEG: Successfully saved derivative data. [2025-09-29T02:18:13.754096] [INFO ] [MAIN ] Derivative Progress: 1176/2211 symbols completed. LEG took 1.3s. Estimated remaining: 7m 17s. Rate: 142.0 symbols/min [2025-09-29T02:18:13.754794] [INFO ] [MAIN ] LGI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:13.790796] [DEBUG] [LOCAL ] LGI: Loaded 10137 existing records from primary storage. [2025-09-29T02:18:13.791123] [INFO ] [MAIN ] LGI: Loaded 10137 primary data records. [2025-09-29T02:18:13.869203] [DEBUG] [LOCAL ] LFT: Loaded 18286 existing records from primary storage. [2025-09-29T02:18:13.863473] [DEBUG] [LOCAL ] LEVI: Loaded 52306 existing records from primary storage. [2025-09-29T02:18:13.894921] [INFO ] [MAIN ] LEVI: Loaded 52306 primary data records. [2025-09-29T02:18:13.894725] [INFO ] [MAIN ] LFT: Loaded 18286 primary data records. [2025-09-29T02:18:14.909306] [DEBUG] [MAIN ] LGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:14.910360] [INFO ] [MAIN ] LGI: Generated 1820 derivative records from 10137 primary records. [2025-09-29T02:18:14.911162] [DEBUG] [LOCAL ] LGI: Saving derivative data. [2025-09-29T02:18:14.930373] [DEBUG] [LOCAL ] LGI: Derivative data saved (1820 records). [2025-09-29T02:18:14.930961] [INFO ] [MAIN ] LGI: Successfully saved derivative data. [2025-09-29T02:18:14.935499] [INFO ] [MAIN ] Derivative Progress: 1177/2211 symbols completed. LGI took 1.2s. Estimated remaining: 7m 17s. Rate: 141.8 symbols/min [2025-09-29T02:18:14.937708] [INFO ] [MAIN ] LH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:14.955825] [DEBUG] [MAIN ] LFT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:14.979291] [INFO ] [MAIN ] LFT: Generated 1820 derivative records from 18286 primary records. [2025-09-29T02:18:14.979730] [DEBUG] [MAIN ] LEVI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:14.979994] [DEBUG] [LOCAL ] LFT: Saving derivative data. [2025-09-29T02:18:14.981238] [INFO ] [MAIN ] LEVI: Generated 1820 derivative records from 52306 primary records. [2025-09-29T02:18:14.982685] [DEBUG] [LOCAL ] LEVI: Saving derivative data. [2025-09-29T02:18:15.016424] [DEBUG] [LOCAL ] LEVI: Derivative data saved (1820 records). [2025-09-29T02:18:15.016733] [INFO ] [MAIN ] LEVI: Successfully saved derivative data. [2025-09-29T02:18:15.019992] [INFO ] [MAIN ] Derivative Progress: 1178/2211 symbols completed. LEVI took 1.4s. Estimated remaining: 7m 17s. Rate: 141.9 symbols/min [2025-09-29T02:18:15.016560] [DEBUG] [LOCAL ] LFT: Derivative data saved (1820 records). [2025-09-29T02:18:15.020276] [INFO ] [MAIN ] LHX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:15.020571] [INFO ] [MAIN ] LFT: Successfully saved derivative data. [2025-09-29T02:18:15.024521] [INFO ] [MAIN ] Derivative Progress: 1179/2211 symbols completed. LFT took 1.3s. Estimated remaining: 7m 16s. Rate: 142.0 symbols/min [2025-09-29T02:18:15.026468] [INFO ] [MAIN ] LII: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:15.065684] [DEBUG] [LOCAL ] LH: Loaded 38660 existing records from primary storage. [2025-09-29T02:18:15.066136] [INFO ] [MAIN ] LH: Loaded 38660 primary data records. [2025-09-29T02:18:15.213027] [DEBUG] [LOCAL ] LII: Loaded 28648 existing records from primary storage. [2025-09-29T02:18:15.219039] [INFO ] [MAIN ] LII: Loaded 28648 primary data records. [2025-09-29T02:18:15.535442] [DEBUG] [LOCAL ] LHX: Loaded 49413 existing records from primary storage. [2025-09-29T02:18:15.565392] [INFO ] [MAIN ] LHX: Loaded 49413 primary data records. [2025-09-29T02:18:16.170832] [DEBUG] [MAIN ] LH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:16.172364] [INFO ] [MAIN ] LH: Generated 1820 derivative records from 38660 primary records. [2025-09-29T02:18:16.173220] [DEBUG] [LOCAL ] LH: Saving derivative data. [2025-09-29T02:18:16.197431] [DEBUG] [LOCAL ] LH: Derivative data saved (1820 records). [2025-09-29T02:18:16.211868] [INFO ] [MAIN ] LH: Successfully saved derivative data. [2025-09-29T02:18:16.212761] [DEBUG] [MAIN ] LII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:16.216164] [INFO ] [MAIN ] Derivative Progress: 1180/2211 symbols completed. LH took 1.3s. Estimated remaining: 7m 16s. Rate: 141.8 symbols/min [2025-09-29T02:18:16.218680] [INFO ] [MAIN ] LION: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:16.218490] [INFO ] [MAIN ] LII: Generated 1820 derivative records from 28648 primary records. [2025-09-29T02:18:16.220346] [DEBUG] [LOCAL ] LII: Saving derivative data. [2025-09-29T02:18:16.253822] [DEBUG] [MAIN ] LHX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:16.253459] [DEBUG] [LOCAL ] LII: Derivative data saved (1820 records). [2025-09-29T02:18:16.254723] [INFO ] [MAIN ] LHX: Generated 1820 derivative records from 49413 primary records. [2025-09-29T02:18:16.254878] [INFO ] [MAIN ] LII: Successfully saved derivative data. [2025-09-29T02:18:16.258298] [INFO ] [MAIN ] Derivative Progress: 1181/2211 symbols completed. LII took 1.2s. Estimated remaining: 7m 15s. Rate: 141.9 symbols/min [2025-09-29T02:18:16.258601] [INFO ] [MAIN ] LITB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:16.254975] [DEBUG] [LOCAL ] LHX: Saving derivative data. [2025-09-29T02:18:16.279341] [DEBUG] [LOCAL ] LHX: Derivative data saved (1820 records). [2025-09-29T02:18:16.282888] [DEBUG] [LOCAL ] LITB: Loaded 4436 existing records from primary storage. [2025-09-29T02:18:16.283248] [INFO ] [MAIN ] LHX: Successfully saved derivative data. [2025-09-29T02:18:16.286398] [INFO ] [MAIN ] LITB: Loaded 4436 primary data records. [2025-09-29T02:18:16.286270] [INFO ] [MAIN ] Derivative Progress: 1182/2211 symbols completed. LHX took 1.3s. Estimated remaining: 7m 15s. Rate: 142.0 symbols/min [2025-09-29T02:18:16.305207] [INFO ] [MAIN ] LLY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:16.452501] [DEBUG] [LOCAL ] LION: Loaded 43950 existing records from primary storage. [2025-09-29T02:18:16.496048] [INFO ] [MAIN ] LION: Loaded 43950 primary data records. [2025-09-29T02:18:16.936398] [DEBUG] [LOCAL ] LLY: Loaded 54064 existing records from primary storage. [2025-09-29T02:18:17.075211] [INFO ] [MAIN ] LLY: Loaded 54064 primary data records. [2025-09-29T02:18:17.375040] [DEBUG] [MAIN ] LITB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:17.433814] [INFO ] [MAIN ] LITB: Generated 1820 derivative records from 4436 primary records. [2025-09-29T02:18:17.434702] [DEBUG] [LOCAL ] LITB: Saving derivative data. [2025-09-29T02:18:17.466297] [DEBUG] [LOCAL ] LITB: Derivative data saved (1820 records). [2025-09-29T02:18:17.472337] [DEBUG] [MAIN ] LION: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:17.472560] [INFO ] [MAIN ] LITB: Successfully saved derivative data. [2025-09-29T02:18:17.475961] [INFO ] [MAIN ] Derivative Progress: 1183/2211 symbols completed. LITB took 1.2s. Estimated remaining: 7m 15s. Rate: 141.8 symbols/min [2025-09-29T02:18:17.473416] [INFO ] [MAIN ] LION: Generated 1820 derivative records from 43950 primary records. [2025-09-29T02:18:17.476747] [DEBUG] [LOCAL ] LION: Saving derivative data. [2025-09-29T02:18:17.494283] [DEBUG] [LOCAL ] LION: Derivative data saved (1820 records). [2025-09-29T02:18:17.494534] [INFO ] [MAIN ] LION: Successfully saved derivative data. [2025-09-29T02:18:17.498441] [INFO ] [MAIN ] Derivative Progress: 1184/2211 symbols completed. LION took 1.3s. Estimated remaining: 7m 14s. Rate: 141.9 symbols/min [2025-09-29T02:18:17.515237] [DEBUG] [MAIN ] LLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:17.515931] [INFO ] [MAIN ] LLY: Generated 1820 derivative records from 54064 primary records. [2025-09-29T02:18:17.516015] [DEBUG] [LOCAL ] LLY: Saving derivative data. [2025-09-29T02:18:17.532612] [DEBUG] [LOCAL ] LLY: Derivative data saved (1820 records). [2025-09-29T02:18:17.532732] [INFO ] [MAIN ] LLY: Successfully saved derivative data. [2025-09-29T02:18:17.536455] [INFO ] [MAIN ] Derivative Progress: 1185/2211 symbols completed. LLY took 1.2s. Estimated remaining: 7m 13s. Rate: 142.0 symbols/min [2025-09-29T02:18:17.537128] [INFO ] [MAIN ] LMT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:17.537208] [INFO ] [MAIN ] LNC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:17.537036] [INFO ] [MAIN ] LMND: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:17.640944] [DEBUG] [LOCAL ] LMT: Loaded 50608 existing records from primary storage. [2025-09-29T02:18:17.642601] [DEBUG] [LOCAL ] LNC: Loaded 52369 existing records from primary storage. [2025-09-29T02:18:17.642885] [INFO ] [MAIN ] LMT: Loaded 50608 primary data records. [2025-09-29T02:18:17.643096] [INFO ] [MAIN ] LNC: Loaded 52369 primary data records. [2025-09-29T02:18:17.894067] [DEBUG] [LOCAL ] LMND: Loaded 52647 existing records from primary storage. [2025-09-29T02:18:17.920405] [INFO ] [MAIN ] LMND: Loaded 52647 primary data records. [2025-09-29T02:18:18.725684] [DEBUG] [MAIN ] LNC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:18.727553] [INFO ] [MAIN ] LNC: Generated 1820 derivative records from 52369 primary records. [2025-09-29T02:18:18.727924] [DEBUG] [LOCAL ] LNC: Saving derivative data. [2025-09-29T02:18:18.726514] [DEBUG] [MAIN ] LMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:18.728874] [INFO ] [MAIN ] LMT: Generated 1820 derivative records from 50608 primary records. [2025-09-29T02:18:18.729811] [DEBUG] [LOCAL ] LMT: Saving derivative data. [2025-09-29T02:18:18.759337] [DEBUG] [LOCAL ] LNC: Derivative data saved (1820 records). [2025-09-29T02:18:18.764396] [INFO ] [MAIN ] LNC: Successfully saved derivative data. [2025-09-29T02:18:18.768549] [DEBUG] [LOCAL ] LMT: Derivative data saved (1820 records). [2025-09-29T02:18:18.767476] [INFO ] [MAIN ] Derivative Progress: 1186/2211 symbols completed. LNC took 1.2s. Estimated remaining: 7m 14s. Rate: 141.8 symbols/min [2025-09-29T02:18:18.769922] [INFO ] [MAIN ] LND: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:18.771671] [INFO ] [MAIN ] LMT: Successfully saved derivative data. [2025-09-29T02:18:18.776126] [INFO ] [MAIN ] Derivative Progress: 1187/2211 symbols completed. LMT took 1.2s. Estimated remaining: 7m 13s. Rate: 141.9 symbols/min [2025-09-29T02:18:18.791282] [INFO ] [MAIN ] LNG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:18.791775] [DEBUG] [MAIN ] LMND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:18.796376] [DEBUG] [LOCAL ] LND: Loaded 5013 existing records from primary storage. [2025-09-29T02:18:18.797289] [INFO ] [MAIN ] LMND: Generated 1820 derivative records from 52647 primary records. [2025-09-29T02:18:18.797623] [INFO ] [MAIN ] LND: Loaded 5013 primary data records. [2025-09-29T02:18:18.803136] [DEBUG] [LOCAL ] LMND: Saving derivative data. [2025-09-29T02:18:18.923333] [DEBUG] [LOCAL ] LMND: Derivative data saved (1820 records). [2025-09-29T02:18:18.927345] [INFO ] [MAIN ] LMND: Successfully saved derivative data. [2025-09-29T02:18:18.947348] [INFO ] [MAIN ] Derivative Progress: 1188/2211 symbols completed. LMND took 1.4s. Estimated remaining: 7m 12s. Rate: 142.0 symbols/min [2025-09-29T02:18:18.985603] [INFO ] [MAIN ] LNN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:19.204390] [DEBUG] [LOCAL ] LNG: Loaded 52224 existing records from primary storage. [2025-09-29T02:18:19.208777] [INFO ] [MAIN ] LNG: Loaded 52224 primary data records. [2025-09-29T02:18:19.264707] [DEBUG] [LOCAL ] LNN: Loaded 11404 existing records from primary storage. [2025-09-29T02:18:19.294078] [INFO ] [MAIN ] LNN: Loaded 11404 primary data records. [2025-09-29T02:18:19.906894] [DEBUG] [MAIN ] LND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:19.908404] [INFO ] [MAIN ] LND: Generated 1820 derivative records from 5013 primary records. [2025-09-29T02:18:19.908553] [DEBUG] [LOCAL ] LND: Saving derivative data. [2025-09-29T02:18:19.928238] [DEBUG] [LOCAL ] LND: Derivative data saved (1820 records). [2025-09-29T02:18:19.928694] [INFO ] [MAIN ] LND: Successfully saved derivative data. [2025-09-29T02:18:19.931044] [INFO ] [MAIN ] Derivative Progress: 1189/2211 symbols completed. LND took 1.2s. Estimated remaining: 7m 12s. Rate: 141.8 symbols/min [2025-09-29T02:18:19.931347] [INFO ] [MAIN ] LOAR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:19.953507] [DEBUG] [MAIN ] LNG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:19.956052] [INFO ] [MAIN ] LNG: Generated 1820 derivative records from 52224 primary records. [2025-09-29T02:18:19.958279] [DEBUG] [LOCAL ] LNG: Saving derivative data. [2025-09-29T02:18:19.990109] [DEBUG] [LOCAL ] LNG: Derivative data saved (1820 records). [2025-09-29T02:18:19.990265] [INFO ] [MAIN ] LNG: Successfully saved derivative data. [2025-09-29T02:18:19.985551] [DEBUG] [MAIN ] LNN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:19.993981] [INFO ] [MAIN ] Derivative Progress: 1190/2211 symbols completed. LNG took 1.2s. Estimated remaining: 7m 12s. Rate: 141.9 symbols/min [2025-09-29T02:18:19.994404] [INFO ] [MAIN ] LOB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:19.995346] [INFO ] [MAIN ] LNN: Generated 1820 derivative records from 11404 primary records. [2025-09-29T02:18:19.995591] [DEBUG] [LOCAL ] LNN: Saving derivative data. [2025-09-29T02:18:20.027250] [DEBUG] [LOCAL ] LNN: Derivative data saved (1820 records). [2025-09-29T02:18:20.027602] [INFO ] [MAIN ] LNN: Successfully saved derivative data. [2025-09-29T02:18:20.032925] [INFO ] [MAIN ] Derivative Progress: 1191/2211 symbols completed. LNN took 1.0s. Estimated remaining: 7m 11s. Rate: 142.0 symbols/min [2025-09-29T02:18:20.033318] [INFO ] [MAIN ] LOCL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:20.054094] [DEBUG] [LOCAL ] LOCL: Loaded 3644 existing records from primary storage. [2025-09-29T02:18:20.055477] [DEBUG] [LOCAL ] LOAR: Loaded 42150 existing records from primary storage. [2025-09-29T02:18:20.064335] [INFO ] [MAIN ] LOAR: Loaded 42150 primary data records. [2025-09-29T02:18:20.064697] [INFO ] [MAIN ] LOCL: Loaded 3644 primary data records. [2025-09-29T02:18:20.243083] [DEBUG] [LOCAL ] LOB: Loaded 27886 existing records from primary storage. [2025-09-29T02:18:20.300444] [INFO ] [MAIN ] LOB: Loaded 27886 primary data records. [2025-09-29T02:18:21.197804] [DEBUG] [MAIN ] LOCL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:21.212803] [INFO ] [MAIN ] LOCL: Generated 1820 derivative records from 3644 primary records. [2025-09-29T02:18:21.213223] [DEBUG] [MAIN ] LOAR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:21.214371] [INFO ] [MAIN ] LOAR: Generated 1820 derivative records from 42150 primary records. [2025-09-29T02:18:21.213390] [DEBUG] [LOCAL ] LOCL: Saving derivative data. [2025-09-29T02:18:21.214878] [DEBUG] [LOCAL ] LOAR: Saving derivative data. [2025-09-29T02:18:21.249757] [DEBUG] [LOCAL ] LOAR: Derivative data saved (1820 records). [2025-09-29T02:18:21.250980] [DEBUG] [LOCAL ] LOCL: Derivative data saved (1820 records). [2025-09-29T02:18:21.263963] [INFO ] [MAIN ] LOCL: Successfully saved derivative data. [2025-09-29T02:18:21.267507] [INFO ] [MAIN ] Derivative Progress: 1192/2211 symbols completed. LOCL took 1.2s. Estimated remaining: 7m 11s. Rate: 141.8 symbols/min [2025-09-29T02:18:21.268329] [INFO ] [MAIN ] LOMA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:21.268067] [DEBUG] [MAIN ] LOB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:21.269474] [INFO ] [MAIN ] LOB: Generated 1820 derivative records from 27886 primary records. [2025-09-29T02:18:21.264080] [INFO ] [MAIN ] LOAR: Successfully saved derivative data. [2025-09-29T02:18:21.272662] [INFO ] [MAIN ] Derivative Progress: 1193/2211 symbols completed. LOAR took 1.3s. Estimated remaining: 7m 10s. Rate: 141.9 symbols/min [2025-09-29T02:18:21.270016] [DEBUG] [LOCAL ] LOB: Saving derivative data. [2025-09-29T02:18:21.273533] [INFO ] [MAIN ] LOW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:21.290407] [DEBUG] [LOCAL ] LOB: Derivative data saved (1820 records). [2025-09-29T02:18:21.290530] [INFO ] [MAIN ] LOB: Successfully saved derivative data. [2025-09-29T02:18:21.294429] [INFO ] [MAIN ] Derivative Progress: 1194/2211 symbols completed. LOB took 1.3s. Estimated remaining: 7m 10s. Rate: 142.0 symbols/min [2025-09-29T02:18:21.294755] [INFO ] [MAIN ] LPG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:21.342309] [DEBUG] [LOCAL ] LOMA: Loaded 32576 existing records from primary storage. [2025-09-29T02:18:21.342791] [INFO ] [MAIN ] LOMA: Loaded 32576 primary data records. [2025-09-29T02:18:21.481085] [DEBUG] [LOCAL ] LPG: Loaded 40536 existing records from primary storage. [2025-09-29T02:18:21.513319] [INFO ] [MAIN ] LPG: Loaded 40536 primary data records. [2025-09-29T02:18:21.531189] [DEBUG] [LOCAL ] LOW: Loaded 53721 existing records from primary storage. [2025-09-29T02:18:21.571986] [INFO ] [MAIN ] LOW: Loaded 53721 primary data records. [2025-09-29T02:18:22.448340] [DEBUG] [MAIN ] LOMA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:22.450570] [INFO ] [MAIN ] LOMA: Generated 1820 derivative records from 32576 primary records. [2025-09-29T02:18:22.450853] [DEBUG] [LOCAL ] LOMA: Saving derivative data. [2025-09-29T02:18:22.468686] [DEBUG] [LOCAL ] LOMA: Derivative data saved (1820 records). [2025-09-29T02:18:22.468945] [INFO ] [MAIN ] LOMA: Successfully saved derivative data. [2025-09-29T02:18:22.472354] [INFO ] [MAIN ] Derivative Progress: 1195/2211 symbols completed. LOMA took 1.2s. Estimated remaining: 7m 10s. Rate: 141.8 symbols/min [2025-09-29T02:18:22.473057] [INFO ] [MAIN ] LPL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:22.495578] [DEBUG] [MAIN ] LPG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:22.509402] [INFO ] [MAIN ] LPG: Generated 1820 derivative records from 40536 primary records. [2025-09-29T02:18:22.509747] [DEBUG] [LOCAL ] LPG: Saving derivative data. [2025-09-29T02:18:22.510173] [DEBUG] [MAIN ] LOW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:22.512021] [INFO ] [MAIN ] LOW: Generated 1820 derivative records from 53721 primary records. [2025-09-29T02:18:22.519605] [DEBUG] [LOCAL ] LOW: Saving derivative data. [2025-09-29T02:18:22.561334] [DEBUG] [LOCAL ] LPL: Loaded 26305 existing records from primary storage. [2025-09-29T02:18:22.562913] [INFO ] [MAIN ] LPL: Loaded 26305 primary data records. [2025-09-29T02:18:22.562817] [DEBUG] [LOCAL ] LPG: Derivative data saved (1820 records). [2025-09-29T02:18:22.563155] [INFO ] [MAIN ] LPG: Successfully saved derivative data. [2025-09-29T02:18:22.566048] [INFO ] [MAIN ] Derivative Progress: 1196/2211 symbols completed. LPG took 1.3s. Estimated remaining: 7m 9s. Rate: 141.9 symbols/min [2025-09-29T02:18:22.562982] [DEBUG] [LOCAL ] LOW: Derivative data saved (1820 records). [2025-09-29T02:18:22.571458] [INFO ] [MAIN ] LPX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:22.615459] [INFO ] [MAIN ] LOW: Successfully saved derivative data. [2025-09-29T02:18:22.650181] [INFO ] [MAIN ] Derivative Progress: 1197/2211 symbols completed. LOW took 1.4s. Estimated remaining: 7m 8s. Rate: 142.0 symbols/min [2025-09-29T02:18:22.691511] [INFO ] [MAIN ] LRN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:22.945954] [DEBUG] [LOCAL ] LPX: Loaded 40311 existing records from primary storage. [2025-09-29T02:18:22.946226] [INFO ] [MAIN ] LPX: Loaded 40311 primary data records. [2025-09-29T02:18:23.074705] [DEBUG] [LOCAL ] LRN: Loaded 40503 existing records from primary storage. [2025-09-29T02:18:23.075620] [INFO ] [MAIN ] LRN: Loaded 40503 primary data records. [2025-09-29T02:18:23.671746] [DEBUG] [MAIN ] LPL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:23.688068] [INFO ] [MAIN ] LPL: Generated 1820 derivative records from 26305 primary records. [2025-09-29T02:18:23.688945] [DEBUG] [LOCAL ] LPL: Saving derivative data. [2025-09-29T02:18:23.708023] [DEBUG] [LOCAL ] LPL: Derivative data saved (1820 records). [2025-09-29T02:18:23.708682] [INFO ] [MAIN ] LPL: Successfully saved derivative data. [2025-09-29T02:18:23.711287] [INFO ] [MAIN ] Derivative Progress: 1198/2211 symbols completed. LPL took 1.2s. Estimated remaining: 7m 9s. Rate: 141.8 symbols/min [2025-09-29T02:18:23.733581] [DEBUG] [MAIN ] LPX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:23.734414] [INFO ] [MAIN ] LPX: Generated 1820 derivative records from 40311 primary records. [2025-09-29T02:18:23.734606] [DEBUG] [LOCAL ] LPX: Saving derivative data. [2025-09-29T02:18:23.753405] [DEBUG] [LOCAL ] LPX: Derivative data saved (1820 records). [2025-09-29T02:18:23.754325] [INFO ] [MAIN ] LPX: Successfully saved derivative data. [2025-09-29T02:18:23.757460] [INFO ] [MAIN ] Derivative Progress: 1199/2211 symbols completed. LPX took 1.2s. Estimated remaining: 7m 8s. Rate: 141.9 symbols/min [2025-09-29T02:18:23.770255] [DEBUG] [MAIN ] LRN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:23.770925] [INFO ] [MAIN ] LRN: Generated 1820 derivative records from 40503 primary records. [2025-09-29T02:18:23.771008] [DEBUG] [LOCAL ] LRN: Saving derivative data. [2025-09-29T02:18:23.787120] [DEBUG] [LOCAL ] LRN: Derivative data saved (1820 records). [2025-09-29T02:18:23.787249] [INFO ] [MAIN ] LRN: Successfully saved derivative data. [2025-09-29T02:18:23.790357] [INFO ] [MAIN ] Derivative Progress: 1200/2211 symbols completed. LRN took 1.1s. Estimated remaining: 7m 7s. Rate: 142.1 symbols/min [2025-09-29T02:18:23.790874] [INFO ] [MAIN ] LSPD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:23.791021] [INFO ] [MAIN ] LTH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:23.791174] [INFO ] [MAIN ] LTC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:23.831337] [DEBUG] [LOCAL ] LTC: Loaded 30478 existing records from primary storage. [2025-09-29T02:18:23.840874] [INFO ] [MAIN ] LTC: Loaded 30478 primary data records. [2025-09-29T02:18:24.003991] [DEBUG] [LOCAL ] LSPD: Loaded 43782 existing records from primary storage. [2025-09-29T02:18:24.016639] [INFO ] [MAIN ] LSPD: Loaded 43782 primary data records. [2025-09-29T02:18:24.065530] [DEBUG] [LOCAL ] LTH: Loaded 52563 existing records from primary storage. [2025-09-29T02:18:24.149476] [INFO ] [MAIN ] LTH: Loaded 52563 primary data records. [2025-09-29T02:18:24.920408] [DEBUG] [MAIN ] LTC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:24.922357] [INFO ] [MAIN ] LTC: Generated 1820 derivative records from 30478 primary records. [2025-09-29T02:18:24.922616] [DEBUG] [LOCAL ] LTC: Saving derivative data. [2025-09-29T02:18:24.943953] [DEBUG] [LOCAL ] LTC: Derivative data saved (1820 records). [2025-09-29T02:18:24.945080] [INFO ] [MAIN ] LTC: Successfully saved derivative data. [2025-09-29T02:18:24.947607] [INFO ] [MAIN ] Derivative Progress: 1201/2211 symbols completed. LTC took 1.2s. Estimated remaining: 7m 7s. Rate: 141.8 symbols/min [2025-09-29T02:18:24.948366] [INFO ] [MAIN ] LTM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:24.963034] [DEBUG] [MAIN ] LSPD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:24.964614] [INFO ] [MAIN ] LSPD: Generated 1820 derivative records from 43782 primary records. [2025-09-29T02:18:24.964782] [DEBUG] [LOCAL ] LSPD: Saving derivative data. [2025-09-29T02:18:24.998910] [DEBUG] [LOCAL ] LSPD: Derivative data saved (1820 records). [2025-09-29T02:18:24.999666] [DEBUG] [MAIN ] LTH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:25.000530] [INFO ] [MAIN ] LTH: Generated 1820 derivative records from 52563 primary records. [2025-09-29T02:18:25.000704] [INFO ] [MAIN ] LSPD: Successfully saved derivative data. [2025-09-29T02:18:25.000822] [DEBUG] [LOCAL ] LTH: Saving derivative data. [2025-09-29T02:18:25.004782] [INFO ] [MAIN ] Derivative Progress: 1202/2211 symbols completed. LSPD took 1.2s. Estimated remaining: 7m 6s. Rate: 142.0 symbols/min [2025-09-29T02:18:25.005413] [INFO ] [MAIN ] LU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:25.033911] [DEBUG] [LOCAL ] LTH: Derivative data saved (1820 records). [2025-09-29T02:18:25.034172] [INFO ] [MAIN ] LTH: Successfully saved derivative data. [2025-09-29T02:18:25.037088] [INFO ] [MAIN ] Derivative Progress: 1203/2211 symbols completed. LTH took 1.2s. Estimated remaining: 7m 6s. Rate: 142.1 symbols/min [2025-09-29T02:18:25.037524] [INFO ] [MAIN ] LUMN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:25.054810] [DEBUG] [LOCAL ] LTM: Loaded 37076 existing records from primary storage. [2025-09-29T02:18:25.055304] [INFO ] [MAIN ] LTM: Loaded 37076 primary data records. [2025-09-29T02:18:25.455553] [DEBUG] [LOCAL ] LU: Loaded 49679 existing records from primary storage. [2025-09-29T02:18:25.456316] [INFO ] [MAIN ] LU: Loaded 49679 primary data records. [2025-09-29T02:18:25.484851] [DEBUG] [LOCAL ] LUMN: Loaded 54414 existing records from primary storage. [2025-09-29T02:18:25.510935] [INFO ] [MAIN ] LUMN: Loaded 54414 primary data records. [2025-09-29T02:18:26.231472] [DEBUG] [MAIN ] LTM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:26.233714] [INFO ] [MAIN ] LTM: Generated 1820 derivative records from 37076 primary records. [2025-09-29T02:18:26.233924] [DEBUG] [LOCAL ] LTM: Saving derivative data. [2025-09-29T02:18:26.264543] [DEBUG] [LOCAL ] LTM: Derivative data saved (1820 records). [2025-09-29T02:18:26.266977] [INFO ] [MAIN ] LTM: Successfully saved derivative data. [2025-09-29T02:18:26.276735] [INFO ] [MAIN ] Derivative Progress: 1204/2211 symbols completed. LTM took 1.3s. Estimated remaining: 7m 6s. Rate: 141.8 symbols/min [2025-09-29T02:18:26.277477] [INFO ] [MAIN ] LUV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:26.310342] [DEBUG] [MAIN ] LU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:26.313283] [INFO ] [MAIN ] LU: Generated 1820 derivative records from 49679 primary records. [2025-09-29T02:18:26.313623] [DEBUG] [LOCAL ] LU: Saving derivative data. [2025-09-29T02:18:26.331101] [DEBUG] [MAIN ] LUMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:26.345065] [INFO ] [MAIN ] LUMN: Generated 1820 derivative records from 54414 primary records. [2025-09-29T02:18:26.349163] [DEBUG] [LOCAL ] LU: Derivative data saved (1820 records). [2025-09-29T02:18:26.349390] [INFO ] [MAIN ] LU: Successfully saved derivative data. [2025-09-29T02:18:26.349542] [DEBUG] [LOCAL ] LUMN: Saving derivative data. [2025-09-29T02:18:26.356503] [INFO ] [MAIN ] Derivative Progress: 1205/2211 symbols completed. LU took 1.4s. Estimated remaining: 7m 5s. Rate: 141.9 symbols/min [2025-09-29T02:18:26.358109] [INFO ] [MAIN ] LVS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:26.376282] [DEBUG] [LOCAL ] LUMN: Derivative data saved (1820 records). [2025-09-29T02:18:26.376464] [INFO ] [MAIN ] LUMN: Successfully saved derivative data. [2025-09-29T02:18:26.381768] [INFO ] [MAIN ] Derivative Progress: 1206/2211 symbols completed. LUMN took 1.3s. Estimated remaining: 7m 5s. Rate: 142.0 symbols/min [2025-09-29T02:18:26.382253] [INFO ] [MAIN ] LVWR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:26.437186] [DEBUG] [LOCAL ] LUV: Loaded 54469 existing records from primary storage. [2025-09-29T02:18:26.437694] [INFO ] [MAIN ] LUV: Loaded 54469 primary data records. [2025-09-29T02:18:26.513542] [DEBUG] [LOCAL ] LVWR: Loaded 17668 existing records from primary storage. [2025-09-29T02:18:26.538278] [INFO ] [MAIN ] LVWR: Loaded 17668 primary data records. [2025-09-29T02:18:26.941617] [DEBUG] [LOCAL ] LVS: Loaded 54342 existing records from primary storage. [2025-09-29T02:18:26.953562] [INFO ] [MAIN ] LVS: Loaded 54342 primary data records. [2025-09-29T02:18:27.519768] [DEBUG] [MAIN ] LUV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:27.520839] [INFO ] [MAIN ] LUV: Generated 1820 derivative records from 54469 primary records. [2025-09-29T02:18:27.521232] [DEBUG] [LOCAL ] LUV: Saving derivative data. [2025-09-29T02:18:27.558143] [DEBUG] [MAIN ] LVWR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:27.560341] [DEBUG] [LOCAL ] LUV: Derivative data saved (1820 records). [2025-09-29T02:18:27.561735] [INFO ] [MAIN ] LVWR: Generated 1820 derivative records from 17668 primary records. [2025-09-29T02:18:27.562684] [INFO ] [MAIN ] LUV: Successfully saved derivative data. [2025-09-29T02:18:27.563012] [DEBUG] [LOCAL ] LVWR: Saving derivative data. [2025-09-29T02:18:27.566590] [INFO ] [MAIN ] Derivative Progress: 1207/2211 symbols completed. LUV took 1.3s. Estimated remaining: 7m 5s. Rate: 141.8 symbols/min [2025-09-29T02:18:27.567367] [INFO ] [MAIN ] LW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:27.586606] [DEBUG] [LOCAL ] LVWR: Derivative data saved (1820 records). [2025-09-29T02:18:27.586878] [INFO ] [MAIN ] LVWR: Successfully saved derivative data. [2025-09-29T02:18:27.589540] [INFO ] [MAIN ] Derivative Progress: 1208/2211 symbols completed. LVWR took 1.2s. Estimated remaining: 7m 4s. Rate: 141.9 symbols/min [2025-09-29T02:18:27.590211] [INFO ] [MAIN ] LXFR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:27.608011] [DEBUG] [MAIN ] LVS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:27.609228] [INFO ] [MAIN ] LVS: Generated 1820 derivative records from 54342 primary records. [2025-09-29T02:18:27.609416] [DEBUG] [LOCAL ] LVS: Saving derivative data. [2025-09-29T02:18:27.638024] [DEBUG] [LOCAL ] LVS: Derivative data saved (1820 records). [2025-09-29T02:18:27.638332] [INFO ] [MAIN ] LVS: Successfully saved derivative data. [2025-09-29T02:18:27.641944] [INFO ] [MAIN ] Derivative Progress: 1209/2211 symbols completed. LVS took 1.3s. Estimated remaining: 7m 3s. Rate: 142.0 symbols/min [2025-09-29T02:18:27.643014] [INFO ] [MAIN ] LXP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:27.650745] [DEBUG] [LOCAL ] LXFR: Loaded 17259 existing records from primary storage. [2025-09-29T02:18:27.650934] [INFO ] [MAIN ] LXFR: Loaded 17259 primary data records. [2025-09-29T02:18:28.010088] [DEBUG] [LOCAL ] LW: Loaded 51915 existing records from primary storage. [2025-09-29T02:18:28.071419] [INFO ] [MAIN ] LW: Loaded 51915 primary data records. [2025-09-29T02:18:28.210094] [DEBUG] [LOCAL ] LXP: Loaded 51361 existing records from primary storage. [2025-09-29T02:18:28.210856] [INFO ] [MAIN ] LXP: Loaded 51361 primary data records. [2025-09-29T02:18:28.762474] [DEBUG] [MAIN ] LXFR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:28.765189] [INFO ] [MAIN ] LXFR: Generated 1820 derivative records from 17259 primary records. [2025-09-29T02:18:28.766612] [DEBUG] [LOCAL ] LXFR: Saving derivative data. [2025-09-29T02:18:28.789261] [DEBUG] [LOCAL ] LXFR: Derivative data saved (1820 records). [2025-09-29T02:18:28.789916] [INFO ] [MAIN ] LXFR: Successfully saved derivative data. [2025-09-29T02:18:28.793396] [INFO ] [MAIN ] Derivative Progress: 1210/2211 symbols completed. LXFR took 1.2s. Estimated remaining: 7m 3s. Rate: 141.8 symbols/min [2025-09-29T02:18:28.794061] [INFO ] [MAIN ] LXU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:28.814839] [DEBUG] [MAIN ] LW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:28.816324] [INFO ] [MAIN ] LW: Generated 1820 derivative records from 51915 primary records. [2025-09-29T02:18:28.816557] [DEBUG] [LOCAL ] LW: Saving derivative data. [2025-09-29T02:18:28.861817] [DEBUG] [LOCAL ] LW: Derivative data saved (1820 records). [2025-09-29T02:18:28.860998] [DEBUG] [MAIN ] LXP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:28.862751] [INFO ] [MAIN ] LXP: Generated 1820 derivative records from 51361 primary records. [2025-09-29T02:18:28.862873] [INFO ] [MAIN ] LW: Successfully saved derivative data. [2025-09-29T02:18:28.875890] [INFO ] [MAIN ] Derivative Progress: 1211/2211 symbols completed. LW took 1.3s. Estimated remaining: 7m 3s. Rate: 141.9 symbols/min [2025-09-29T02:18:28.873322] [DEBUG] [LOCAL ] LXP: Saving derivative data. [2025-09-29T02:18:28.876339] [INFO ] [MAIN ] LYB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:28.887243] [DEBUG] [LOCAL ] LXU: Loaded 32354 existing records from primary storage. [2025-09-29T02:18:28.891820] [INFO ] [MAIN ] LXU: Loaded 32354 primary data records. [2025-09-29T02:18:28.908002] [DEBUG] [LOCAL ] LXP: Derivative data saved (1820 records). [2025-09-29T02:18:28.936275] [INFO ] [MAIN ] LXP: Successfully saved derivative data. [2025-09-29T02:18:28.990889] [INFO ] [MAIN ] Derivative Progress: 1212/2211 symbols completed. LXP took 1.3s. Estimated remaining: 7m 2s. Rate: 142.0 symbols/min [2025-09-29T02:18:29.011314] [INFO ] [MAIN ] LYG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:29.287053] [DEBUG] [LOCAL ] LYB: Loaded 54379 existing records from primary storage. [2025-09-29T02:18:29.289030] [INFO ] [MAIN ] LYB: Loaded 54379 primary data records. [2025-09-29T02:18:29.667558] [DEBUG] [LOCAL ] LYG: Loaded 53606 existing records from primary storage. [2025-09-29T02:18:29.668579] [INFO ] [MAIN ] LYG: Loaded 53606 primary data records. [2025-09-29T02:18:29.802100] [DEBUG] [MAIN ] LXU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:29.835613] [INFO ] [MAIN ] LXU: Generated 1820 derivative records from 32354 primary records. [2025-09-29T02:18:29.893975] [DEBUG] [LOCAL ] LXU: Saving derivative data. [2025-09-29T02:18:30.101290] [DEBUG] [LOCAL ] LXU: Derivative data saved (1820 records). [2025-09-29T02:18:30.102329] [INFO ] [MAIN ] LXU: Successfully saved derivative data. [2025-09-29T02:18:30.105450] [INFO ] [MAIN ] Derivative Progress: 1213/2211 symbols completed. LXU took 1.3s. Estimated remaining: 7m 2s. Rate: 141.8 symbols/min [2025-09-29T02:18:30.120001] [DEBUG] [MAIN ] LYB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:30.120728] [INFO ] [MAIN ] LYB: Generated 1820 derivative records from 54379 primary records. [2025-09-29T02:18:30.120817] [DEBUG] [LOCAL ] LYB: Saving derivative data. [2025-09-29T02:18:30.142701] [DEBUG] [LOCAL ] LYB: Derivative data saved (1820 records). [2025-09-29T02:18:30.143235] [INFO ] [MAIN ] LYB: Successfully saved derivative data. [2025-09-29T02:18:30.147130] [INFO ] [MAIN ] Derivative Progress: 1214/2211 symbols completed. LYB took 1.3s. Estimated remaining: 7m 1s. Rate: 141.9 symbols/min [2025-09-29T02:18:30.164898] [DEBUG] [MAIN ] LYG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:30.165689] [INFO ] [MAIN ] LYG: Generated 1820 derivative records from 53606 primary records. [2025-09-29T02:18:30.165774] [DEBUG] [LOCAL ] LYG: Saving derivative data. [2025-09-29T02:18:30.181474] [DEBUG] [LOCAL ] LYG: Derivative data saved (1820 records). [2025-09-29T02:18:30.181576] [INFO ] [MAIN ] LYG: Successfully saved derivative data. [2025-09-29T02:18:30.185479] [INFO ] [MAIN ] Derivative Progress: 1215/2211 symbols completed. LYG took 1.2s. Estimated remaining: 7m 1s. Rate: 142.0 symbols/min [2025-09-29T02:18:30.186408] [INFO ] [MAIN ] LYV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:30.186495] [INFO ] [MAIN ] LZM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:30.186453] [INFO ] [MAIN ] LZB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:30.211100] [DEBUG] [LOCAL ] LZM: Loaded 13905 existing records from primary storage. [2025-09-29T02:18:30.211263] [INFO ] [MAIN ] LZM: Loaded 13905 primary data records. [2025-09-29T02:18:30.555060] [DEBUG] [LOCAL ] LZB: Loaded 36113 existing records from primary storage. [2025-09-29T02:18:30.560764] [INFO ] [MAIN ] LZB: Loaded 36113 primary data records. [2025-09-29T02:18:30.683850] [DEBUG] [LOCAL ] LYV: Loaded 51906 existing records from primary storage. [2025-09-29T02:18:30.710034] [INFO ] [MAIN ] LYV: Loaded 51906 primary data records. [2025-09-29T02:18:31.282419] [DEBUG] [MAIN ] LZM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:31.283313] [INFO ] [MAIN ] LZM: Generated 1820 derivative records from 13905 primary records. [2025-09-29T02:18:31.283576] [DEBUG] [LOCAL ] LZM: Saving derivative data. [2025-09-29T02:18:31.305117] [DEBUG] [LOCAL ] LZM: Derivative data saved (1820 records). [2025-09-29T02:18:31.305281] [INFO ] [MAIN ] LZM: Successfully saved derivative data. [2025-09-29T02:18:31.309765] [INFO ] [MAIN ] Derivative Progress: 1216/2211 symbols completed. LZM took 1.1s. Estimated remaining: 7m 1s. Rate: 141.8 symbols/min [2025-09-29T02:18:31.311667] [INFO ] [MAIN ] M: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:31.329020] [DEBUG] [MAIN ] LZB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:31.329917] [INFO ] [MAIN ] LZB: Generated 1820 derivative records from 36113 primary records. [2025-09-29T02:18:31.330194] [DEBUG] [LOCAL ] LZB: Saving derivative data. [2025-09-29T02:18:31.351864] [DEBUG] [LOCAL ] LZB: Derivative data saved (1820 records). [2025-09-29T02:18:31.352218] [INFO ] [MAIN ] LZB: Successfully saved derivative data. [2025-09-29T02:18:31.355749] [INFO ] [MAIN ] Derivative Progress: 1217/2211 symbols completed. LZB took 1.2s. Estimated remaining: 7m 0s. Rate: 141.9 symbols/min [2025-09-29T02:18:31.373044] [INFO ] [MAIN ] MA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:31.373501] [DEBUG] [MAIN ] LYV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:31.374828] [INFO ] [MAIN ] LYV: Generated 1820 derivative records from 51906 primary records. [2025-09-29T02:18:31.375013] [DEBUG] [LOCAL ] LYV: Saving derivative data. [2025-09-29T02:18:31.417579] [DEBUG] [LOCAL ] LYV: Derivative data saved (1820 records). [2025-09-29T02:18:31.418163] [INFO ] [MAIN ] LYV: Successfully saved derivative data. [2025-09-29T02:18:31.423386] [INFO ] [MAIN ] Derivative Progress: 1218/2211 symbols completed. LYV took 1.2s. Estimated remaining: 6m 59s. Rate: 142.0 symbols/min [2025-09-29T02:18:31.423905] [INFO ] [MAIN ] MAA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:31.453062] [DEBUG] [LOCAL ] M: Loaded 54315 existing records from primary storage. [2025-09-29T02:18:31.453427] [INFO ] [MAIN ] M: Loaded 54315 primary data records. [2025-09-29T02:18:31.826245] [DEBUG] [LOCAL ] MA: Loaded 53329 existing records from primary storage. [2025-09-29T02:18:31.854681] [INFO ] [MAIN ] MA: Loaded 53329 primary data records. [2025-09-29T02:18:31.879819] [DEBUG] [LOCAL ] MAA: Loaded 43354 existing records from primary storage. [2025-09-29T02:18:31.905406] [INFO ] [MAIN ] MAA: Loaded 43354 primary data records. [2025-09-29T02:18:32.615485] [DEBUG] [MAIN ] M: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:32.616466] [INFO ] [MAIN ] M: Generated 1820 derivative records from 54315 primary records. [2025-09-29T02:18:32.616572] [DEBUG] [LOCAL ] M: Saving derivative data. [2025-09-29T02:18:32.638480] [DEBUG] [LOCAL ] M: Derivative data saved (1820 records). [2025-09-29T02:18:32.639789] [INFO ] [MAIN ] M: Successfully saved derivative data. [2025-09-29T02:18:32.642846] [INFO ] [MAIN ] Derivative Progress: 1219/2211 symbols completed. M took 1.3s. Estimated remaining: 6m 60s. Rate: 141.8 symbols/min [2025-09-29T02:18:32.643428] [INFO ] [MAIN ] MAC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:32.666524] [DEBUG] [MAIN ] MA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:32.668262] [INFO ] [MAIN ] MA: Generated 1820 derivative records from 53329 primary records. [2025-09-29T02:18:32.669251] [DEBUG] [LOCAL ] MA: Saving derivative data. [2025-09-29T02:18:32.688538] [DEBUG] [LOCAL ] MA: Derivative data saved (1820 records). [2025-09-29T02:18:32.690807] [INFO ] [MAIN ] MA: Successfully saved derivative data. [2025-09-29T02:18:32.695055] [INFO ] [MAIN ] Derivative Progress: 1220/2211 symbols completed. MA took 1.3s. Estimated remaining: 6m 59s. Rate: 141.9 symbols/min [2025-09-29T02:18:32.695868] [INFO ] [MAIN ] MAGN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:32.716782] [DEBUG] [MAIN ] MAA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:32.718054] [INFO ] [MAIN ] MAA: Generated 1820 derivative records from 43354 primary records. [2025-09-29T02:18:32.718280] [DEBUG] [LOCAL ] MAA: Saving derivative data. [2025-09-29T02:18:32.756289] [DEBUG] [LOCAL ] MAA: Derivative data saved (1820 records). [2025-09-29T02:18:32.756511] [INFO ] [MAIN ] MAA: Successfully saved derivative data. [2025-09-29T02:18:32.760575] [INFO ] [MAIN ] Derivative Progress: 1221/2211 symbols completed. MAA took 1.3s. Estimated remaining: 6m 58s. Rate: 142.0 symbols/min [2025-09-29T02:18:32.762203] [INFO ] [MAIN ] MAIN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:32.778427] [DEBUG] [LOCAL ] MAC: Loaded 50469 existing records from primary storage. [2025-09-29T02:18:32.778819] [INFO ] [MAIN ] MAC: Loaded 50469 primary data records. [2025-09-29T02:18:32.930016] [DEBUG] [LOCAL ] MAGN: Loaded 35466 existing records from primary storage. [2025-09-29T02:18:32.974946] [INFO ] [MAIN ] MAGN: Loaded 35466 primary data records. [2025-09-29T02:18:33.272568] [DEBUG] [LOCAL ] MAIN: Loaded 41929 existing records from primary storage. [2025-09-29T02:18:33.325833] [INFO ] [MAIN ] MAIN: Loaded 41929 primary data records. [2025-09-29T02:18:33.843925] [DEBUG] [MAIN ] MAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:33.845495] [INFO ] [MAIN ] MAC: Generated 1820 derivative records from 50469 primary records. [2025-09-29T02:18:33.846002] [DEBUG] [LOCAL ] MAC: Saving derivative data. [2025-09-29T02:18:33.869447] [DEBUG] [LOCAL ] MAC: Derivative data saved (1820 records). [2025-09-29T02:18:33.870833] [INFO ] [MAIN ] MAC: Successfully saved derivative data. [2025-09-29T02:18:33.876813] [INFO ] [MAIN ] Derivative Progress: 1222/2211 symbols completed. MAC took 1.2s. Estimated remaining: 6m 58s. Rate: 141.8 symbols/min [2025-09-29T02:18:33.877287] [INFO ] [MAIN ] MAN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:33.891279] [DEBUG] [MAIN ] MAGN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:33.892012] [INFO ] [MAIN ] MAGN: Generated 1820 derivative records from 35466 primary records. [2025-09-29T02:18:33.892224] [DEBUG] [LOCAL ] MAGN: Saving derivative data. [2025-09-29T02:18:33.910778] [DEBUG] [LOCAL ] MAGN: Derivative data saved (1820 records). [2025-09-29T02:18:33.911237] [INFO ] [MAIN ] MAGN: Successfully saved derivative data. [2025-09-29T02:18:33.915565] [INFO ] [MAIN ] Derivative Progress: 1223/2211 symbols completed. MAGN took 1.2s. Estimated remaining: 6m 58s. Rate: 141.9 symbols/min [2025-09-29T02:18:33.917835] [INFO ] [MAIN ] MANU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:33.932785] [DEBUG] [MAIN ] MAIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:33.933575] [INFO ] [MAIN ] MAIN: Generated 1820 derivative records from 41929 primary records. [2025-09-29T02:18:33.933695] [DEBUG] [LOCAL ] MAIN: Saving derivative data. [2025-09-29T02:18:33.962185] [DEBUG] [LOCAL ] MAIN: Derivative data saved (1820 records). [2025-09-29T02:18:33.962549] [INFO ] [MAIN ] MAIN: Successfully saved derivative data. [2025-09-29T02:18:33.965787] [INFO ] [MAIN ] Derivative Progress: 1224/2211 symbols completed. MAIN took 1.2s. Estimated remaining: 6m 57s. Rate: 142.0 symbols/min [2025-09-29T02:18:33.966151] [INFO ] [MAIN ] MAS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:33.993447] [DEBUG] [LOCAL ] MAN: Loaded 44216 existing records from primary storage. [2025-09-29T02:18:33.993746] [INFO ] [MAIN ] MAN: Loaded 44216 primary data records. [2025-09-29T02:18:34.096369] [DEBUG] [LOCAL ] MANU: Loaded 27544 existing records from primary storage. [2025-09-29T02:18:34.121049] [INFO ] [MAIN ] MANU: Loaded 27544 primary data records. [2025-09-29T02:18:34.589548] [DEBUG] [LOCAL ] MAS: Loaded 53102 existing records from primary storage. [2025-09-29T02:18:34.627522] [INFO ] [MAIN ] MAS: Loaded 53102 primary data records. [2025-09-29T02:18:35.111109] [DEBUG] [MAIN ] MAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:35.113305] [INFO ] [MAIN ] MAN: Generated 1820 derivative records from 44216 primary records. [2025-09-29T02:18:35.113753] [DEBUG] [LOCAL ] MAN: Saving derivative data. [2025-09-29T02:18:35.135297] [DEBUG] [LOCAL ] MAN: Derivative data saved (1820 records). [2025-09-29T02:18:35.135887] [INFO ] [MAIN ] MAN: Successfully saved derivative data. [2025-09-29T02:18:35.139151] [INFO ] [MAIN ] Derivative Progress: 1225/2211 symbols completed. MAN took 1.3s. Estimated remaining: 6m 57s. Rate: 141.8 symbols/min [2025-09-29T02:18:35.139460] [INFO ] [MAIN ] MATV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:35.154036] [DEBUG] [MAIN ] MANU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:35.155177] [INFO ] [MAIN ] MANU: Generated 1820 derivative records from 27544 primary records. [2025-09-29T02:18:35.155443] [DEBUG] [LOCAL ] MANU: Saving derivative data. [2025-09-29T02:18:35.173629] [DEBUG] [LOCAL ] MANU: Derivative data saved (1820 records). [2025-09-29T02:18:35.173820] [INFO ] [MAIN ] MANU: Successfully saved derivative data. [2025-09-29T02:18:35.177711] [INFO ] [MAIN ] Derivative Progress: 1226/2211 symbols completed. MANU took 1.3s. Estimated remaining: 6m 56s. Rate: 141.9 symbols/min [2025-09-29T02:18:35.178839] [INFO ] [MAIN ] MATX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:35.193999] [DEBUG] [MAIN ] MAS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:35.195020] [INFO ] [MAIN ] MAS: Generated 1820 derivative records from 53102 primary records. [2025-09-29T02:18:35.195311] [DEBUG] [LOCAL ] MAS: Saving derivative data. [2025-09-29T02:18:35.227344] [DEBUG] [LOCAL ] MAS: Derivative data saved (1820 records). [2025-09-29T02:18:35.228362] [INFO ] [MAIN ] MAS: Successfully saved derivative data. [2025-09-29T02:18:35.231512] [INFO ] [MAIN ] Derivative Progress: 1227/2211 symbols completed. MAS took 1.3s. Estimated remaining: 6m 56s. Rate: 142.0 symbols/min [2025-09-29T02:18:35.231829] [INFO ] [MAIN ] MAX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:35.254252] [DEBUG] [LOCAL ] MATV: Loaded 37964 existing records from primary storage. [2025-09-29T02:18:35.254424] [INFO ] [MAIN ] MATV: Loaded 37964 primary data records. [2025-09-29T02:18:35.377725] [DEBUG] [LOCAL ] MATX: Loaded 31851 existing records from primary storage. [2025-09-29T02:18:35.392219] [INFO ] [MAIN ] MATX: Loaded 31851 primary data records. [2025-09-29T02:18:35.684737] [DEBUG] [LOCAL ] MAX: Loaded 31209 existing records from primary storage. [2025-09-29T02:18:35.723206] [INFO ] [MAIN ] MAX: Loaded 31209 primary data records. [2025-09-29T02:18:36.356807] [DEBUG] [MAIN ] MATV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:36.358493] [INFO ] [MAIN ] MATV: Generated 1820 derivative records from 37964 primary records. [2025-09-29T02:18:36.359182] [DEBUG] [LOCAL ] MATV: Saving derivative data. [2025-09-29T02:18:36.384523] [DEBUG] [LOCAL ] MATV: Derivative data saved (1820 records). [2025-09-29T02:18:36.385027] [INFO ] [MAIN ] MATV: Successfully saved derivative data. [2025-09-29T02:18:36.388286] [INFO ] [MAIN ] Derivative Progress: 1228/2211 symbols completed. MATV took 1.2s. Estimated remaining: 6m 56s. Rate: 141.8 symbols/min [2025-09-29T02:18:36.403128] [DEBUG] [MAIN ] MATX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:36.404141] [INFO ] [MAIN ] MATX: Generated 1820 derivative records from 31851 primary records. [2025-09-29T02:18:36.404497] [DEBUG] [LOCAL ] MATX: Saving derivative data. [2025-09-29T02:18:36.424246] [DEBUG] [LOCAL ] MATX: Derivative data saved (1820 records). [2025-09-29T02:18:36.426423] [INFO ] [MAIN ] MATX: Successfully saved derivative data. [2025-09-29T02:18:36.430105] [INFO ] [MAIN ] Derivative Progress: 1229/2211 symbols completed. MATX took 1.3s. Estimated remaining: 6m 55s. Rate: 141.9 symbols/min [2025-09-29T02:18:36.443567] [DEBUG] [MAIN ] MAX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:36.444328] [INFO ] [MAIN ] MAX: Generated 1820 derivative records from 31209 primary records. [2025-09-29T02:18:36.444417] [DEBUG] [LOCAL ] MAX: Saving derivative data. [2025-09-29T02:18:36.461228] [DEBUG] [LOCAL ] MAX: Derivative data saved (1820 records). [2025-09-29T02:18:36.461366] [INFO ] [MAIN ] MAX: Successfully saved derivative data. [2025-09-29T02:18:36.464378] [INFO ] [MAIN ] Derivative Progress: 1230/2211 symbols completed. MAX took 1.2s. Estimated remaining: 6m 54s. Rate: 142.1 symbols/min [2025-09-29T02:18:36.465072] [INFO ] [MAIN ] MC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:36.465024] [INFO ] [MAIN ] MBC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:36.465193] [INFO ] [MAIN ] MBI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:36.521863] [DEBUG] [LOCAL ] MBI: Loaded 24930 existing records from primary storage. [2025-09-29T02:18:36.522224] [INFO ] [MAIN ] MBI: Loaded 24930 primary data records. [2025-09-29T02:18:36.670715] [DEBUG] [LOCAL ] MBC: Loaded 43803 existing records from primary storage. [2025-09-29T02:18:36.671286] [INFO ] [MAIN ] MBC: Loaded 43803 primary data records. [2025-09-29T02:18:36.673127] [DEBUG] [LOCAL ] MC: Loaded 44878 existing records from primary storage. [2025-09-29T02:18:36.673376] [INFO ] [MAIN ] MC: Loaded 44878 primary data records. [2025-09-29T02:18:37.623375] [DEBUG] [MAIN ] MBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:37.624452] [INFO ] [MAIN ] MBI: Generated 1820 derivative records from 24930 primary records. [2025-09-29T02:18:37.624842] [DEBUG] [LOCAL ] MBI: Saving derivative data. [2025-09-29T02:18:37.643017] [DEBUG] [LOCAL ] MBI: Derivative data saved (1820 records). [2025-09-29T02:18:37.643433] [INFO ] [MAIN ] MBI: Successfully saved derivative data. [2025-09-29T02:18:37.646248] [INFO ] [MAIN ] Derivative Progress: 1231/2211 symbols completed. MBI took 1.2s. Estimated remaining: 6m 55s. Rate: 141.8 symbols/min [2025-09-29T02:18:37.646487] [INFO ] [MAIN ] MCB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:37.667011] [DEBUG] [MAIN ] MBC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:37.668040] [INFO ] [MAIN ] MBC: Generated 1820 derivative records from 43803 primary records. [2025-09-29T02:18:37.668286] [DEBUG] [LOCAL ] MBC: Saving derivative data. [2025-09-29T02:18:37.689821] [DEBUG] [MAIN ] MC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:37.694511] [INFO ] [MAIN ] MC: Generated 1820 derivative records from 44878 primary records. [2025-09-29T02:18:37.700417] [DEBUG] [LOCAL ] MC: Saving derivative data. [2025-09-29T02:18:37.703105] [DEBUG] [LOCAL ] MBC: Derivative data saved (1820 records). [2025-09-29T02:18:37.703271] [INFO ] [MAIN ] MBC: Successfully saved derivative data. [2025-09-29T02:18:37.706024] [INFO ] [MAIN ] Derivative Progress: 1232/2211 symbols completed. MBC took 1.2s. Estimated remaining: 6m 54s. Rate: 141.9 symbols/min [2025-09-29T02:18:37.719544] [INFO ] [MAIN ] MCI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:37.723985] [DEBUG] [LOCAL ] MCB: Loaded 11834 existing records from primary storage. [2025-09-29T02:18:37.724904] [INFO ] [MAIN ] MCB: Loaded 11834 primary data records. [2025-09-29T02:18:37.773856] [DEBUG] [LOCAL ] MC: Derivative data saved (1820 records). [2025-09-29T02:18:37.807066] [INFO ] [MAIN ] MC: Successfully saved derivative data. [2025-09-29T02:18:37.833417] [INFO ] [MAIN ] Derivative Progress: 1233/2211 symbols completed. MC took 1.4s. Estimated remaining: 6m 53s. Rate: 142.0 symbols/min [2025-09-29T02:18:37.856085] [DEBUG] [LOCAL ] MCI: Loaded 6477 existing records from primary storage. [2025-09-29T02:18:37.861223] [INFO ] [MAIN ] MCI: Loaded 6477 primary data records. [2025-09-29T02:18:37.861344] [INFO ] [MAIN ] MCK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:38.495372] [DEBUG] [LOCAL ] MCK: Loaded 39985 existing records from primary storage. [2025-09-29T02:18:38.498257] [INFO ] [MAIN ] MCK: Loaded 39985 primary data records. [2025-09-29T02:18:38.542671] [DEBUG] [MAIN ] MCB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:38.580594] [INFO ] [MAIN ] MCB: Generated 1820 derivative records from 11834 primary records. [2025-09-29T02:18:38.635369] [DEBUG] [LOCAL ] MCB: Saving derivative data. [2025-09-29T02:18:38.752853] [DEBUG] [MAIN ] MCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:38.753974] [DEBUG] [LOCAL ] MCB: Derivative data saved (1820 records). [2025-09-29T02:18:38.755152] [INFO ] [MAIN ] MCB: Successfully saved derivative data. [2025-09-29T02:18:38.758544] [INFO ] [MAIN ] Derivative Progress: 1234/2211 symbols completed. MCB took 1.1s. Estimated remaining: 6m 53s. Rate: 141.9 symbols/min [2025-09-29T02:18:38.760558] [INFO ] [MAIN ] MCI: Generated 1820 derivative records from 6477 primary records. [2025-09-29T02:18:38.777805] [INFO ] [MAIN ] MCN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:38.878129] [DEBUG] [LOCAL ] MCI: Saving derivative data. [2025-09-29T02:18:38.991018] [DEBUG] [LOCAL ] MCN: Loaded 8231 existing records from primary storage. [2025-09-29T02:18:38.991249] [INFO ] [MAIN ] MCN: Loaded 8231 primary data records. [2025-09-29T02:18:38.986288] [DEBUG] [LOCAL ] MCI: Derivative data saved (1820 records). [2025-09-29T02:18:39.003529] [INFO ] [MAIN ] MCI: Successfully saved derivative data. [2025-09-29T02:18:39.060635] [INFO ] [MAIN ] Derivative Progress: 1235/2211 symbols completed. MCI took 1.3s. Estimated remaining: 6m 53s. Rate: 141.9 symbols/min [2025-09-29T02:18:39.100734] [INFO ] [MAIN ] MCO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:39.350948] [DEBUG] [MAIN ] MCK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:39.352443] [INFO ] [MAIN ] MCK: Generated 1820 derivative records from 39985 primary records. [2025-09-29T02:18:39.353078] [DEBUG] [LOCAL ] MCK: Saving derivative data. [2025-09-29T02:18:39.380894] [DEBUG] [LOCAL ] MCK: Derivative data saved (1820 records). [2025-09-29T02:18:39.381242] [INFO ] [MAIN ] MCK: Successfully saved derivative data. [2025-09-29T02:18:39.383830] [INFO ] [MAIN ] Derivative Progress: 1236/2211 symbols completed. MCK took 1.5s. Estimated remaining: 6m 52s. Rate: 141.9 symbols/min [2025-09-29T02:18:39.385663] [INFO ] [MAIN ] MCR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:39.401199] [DEBUG] [LOCAL ] MCO: Loaded 40102 existing records from primary storage. [2025-09-29T02:18:39.401916] [INFO ] [MAIN ] MCO: Loaded 40102 primary data records. [2025-09-29T02:18:39.504197] [DEBUG] [LOCAL ] MCR: Loaded 8858 existing records from primary storage. [2025-09-29T02:18:39.538531] [INFO ] [MAIN ] MCR: Loaded 8858 primary data records. [2025-09-29T02:18:39.611833] [DEBUG] [MAIN ] MCN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:39.643423] [INFO ] [MAIN ] MCN: Generated 1820 derivative records from 8231 primary records. [2025-09-29T02:18:39.713553] [DEBUG] [LOCAL ] MCN: Saving derivative data. [2025-09-29T02:18:39.989240] [DEBUG] [LOCAL ] MCN: Derivative data saved (1820 records). [2025-09-29T02:18:39.997732] [INFO ] [MAIN ] MCN: Successfully saved derivative data. [2025-09-29T02:18:40.117909] [INFO ] [MAIN ] Derivative Progress: 1237/2211 symbols completed. MCN took 1.3s. Estimated remaining: 6m 52s. Rate: 141.9 symbols/min [2025-09-29T02:18:40.129898] [INFO ] [MAIN ] MCS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:40.157774] [DEBUG] [MAIN ] MCO: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:18:40.159148] [INFO ] [MAIN ] MCO: Generated 1819 derivative records from 40102 primary records. [2025-09-29T02:18:40.165729] [DEBUG] [LOCAL ] MCO: Saving derivative data. [2025-09-29T02:18:40.193475] [DEBUG] [LOCAL ] MCO: Derivative data saved (1819 records). [2025-09-29T02:18:40.193665] [INFO ] [MAIN ] MCO: Successfully saved derivative data. [2025-09-29T02:18:40.197732] [DEBUG] [LOCAL ] MCS: Loaded 21454 existing records from primary storage. [2025-09-29T02:18:40.196616] [INFO ] [MAIN ] Derivative Progress: 1238/2211 symbols completed. MCO took 1.1s. Estimated remaining: 6m 51s. Rate: 142.0 symbols/min [2025-09-29T02:18:40.198231] [INFO ] [MAIN ] MCS: Loaded 21454 primary data records. [2025-09-29T02:18:40.198104] [INFO ] [MAIN ] MCY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:40.310052] [DEBUG] [MAIN ] MCR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:40.353707] [INFO ] [MAIN ] MCR: Generated 1820 derivative records from 8858 primary records. [2025-09-29T02:18:40.354057] [DEBUG] [LOCAL ] MCR: Saving derivative data. [2025-09-29T02:18:40.411836] [DEBUG] [LOCAL ] MCR: Derivative data saved (1820 records). [2025-09-29T02:18:40.438621] [DEBUG] [LOCAL ] MCY: Loaded 25345 existing records from primary storage. [2025-09-29T02:18:40.447186] [INFO ] [MAIN ] MCR: Successfully saved derivative data. [2025-09-29T02:18:40.586802] [INFO ] [MAIN ] MCY: Loaded 25345 primary data records. [2025-09-29T02:18:40.589418] [INFO ] [MAIN ] Derivative Progress: 1239/2211 symbols completed. MCR took 1.2s. Estimated remaining: 6m 51s. Rate: 142.0 symbols/min [2025-09-29T02:18:40.629822] [INFO ] [MAIN ] MD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:41.033156] [DEBUG] [MAIN ] MCS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:41.034449] [DEBUG] [LOCAL ] MD: Loaded 39064 existing records from primary storage. [2025-09-29T02:18:41.034791] [INFO ] [MAIN ] MD: Loaded 39064 primary data records. [2025-09-29T02:18:41.048399] [INFO ] [MAIN ] MCS: Generated 1820 derivative records from 21454 primary records. [2025-09-29T02:18:41.073282] [DEBUG] [LOCAL ] MCS: Saving derivative data. [2025-09-29T02:18:41.177132] [DEBUG] [LOCAL ] MCS: Derivative data saved (1820 records). [2025-09-29T02:18:41.178051] [INFO ] [MAIN ] MCS: Successfully saved derivative data. [2025-09-29T02:18:41.181081] [INFO ] [MAIN ] Derivative Progress: 1240/2211 symbols completed. MCS took 1.1s. Estimated remaining: 6m 51s. Rate: 141.9 symbols/min [2025-09-29T02:18:41.186925] [INFO ] [MAIN ] MDST: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:41.278517] [DEBUG] [MAIN ] MCY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:41.287930] [INFO ] [MAIN ] MCY: Generated 1820 derivative records from 25345 primary records. [2025-09-29T02:18:41.415633] [DEBUG] [LOCAL ] MCY: Saving derivative data. [2025-09-29T02:18:41.433813] [DEBUG] [LOCAL ] MDST: Loaded 5688 existing records from primary storage. [2025-09-29T02:18:41.437790] [INFO ] [MAIN ] MDST: Loaded 5688 primary data records. [2025-09-29T02:18:41.463387] [DEBUG] [LOCAL ] MCY: Derivative data saved (1820 records). [2025-09-29T02:18:41.484693] [INFO ] [MAIN ] MCY: Successfully saved derivative data. [2025-09-29T02:18:41.515555] [INFO ] [MAIN ] Derivative Progress: 1241/2211 symbols completed. MCY took 1.3s. Estimated remaining: 6m 50s. Rate: 141.9 symbols/min [2025-09-29T02:18:41.571262] [INFO ] [MAIN ] MDT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:41.827562] [DEBUG] [MAIN ] MD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:41.828489] [INFO ] [MAIN ] MD: Generated 1820 derivative records from 39064 primary records. [2025-09-29T02:18:41.828585] [DEBUG] [LOCAL ] MD: Saving derivative data. [2025-09-29T02:18:41.861696] [DEBUG] [LOCAL ] MD: Derivative data saved (1820 records). [2025-09-29T02:18:41.862239] [INFO ] [MAIN ] MD: Successfully saved derivative data. [2025-09-29T02:18:41.865805] [INFO ] [MAIN ] Derivative Progress: 1242/2211 symbols completed. MD took 1.2s. Estimated remaining: 6m 50s. Rate: 142.0 symbols/min [2025-09-29T02:18:41.866100] [INFO ] [MAIN ] MDU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:41.890279] [DEBUG] [LOCAL ] MDT: Loaded 54458 existing records from primary storage. [2025-09-29T02:18:41.890814] [INFO ] [MAIN ] MDT: Loaded 54458 primary data records. [2025-09-29T02:18:42.279191] [DEBUG] [MAIN ] MDST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:42.278772] [DEBUG] [LOCAL ] MDU: Loaded 48643 existing records from primary storage. [2025-09-29T02:18:42.280210] [INFO ] [MAIN ] MDST: Generated 1820 derivative records from 5688 primary records. [2025-09-29T02:18:42.281179] [DEBUG] [LOCAL ] MDST: Saving derivative data. [2025-09-29T02:18:42.280298] [INFO ] [MAIN ] MDU: Loaded 48643 primary data records. [2025-09-29T02:18:42.447003] [DEBUG] [LOCAL ] MDST: Derivative data saved (1820 records). [2025-09-29T02:18:42.506869] [INFO ] [MAIN ] MDST: Successfully saved derivative data. [2025-09-29T02:18:42.513725] [INFO ] [MAIN ] Derivative Progress: 1243/2211 symbols completed. MDST took 1.3s. Estimated remaining: 6m 49s. Rate: 141.9 symbols/min [2025-09-29T02:18:42.672746] [DEBUG] [MAIN ] MDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:42.674222] [INFO ] [MAIN ] MDT: Generated 1820 derivative records from 54458 primary records. [2025-09-29T02:18:42.674339] [DEBUG] [LOCAL ] MDT: Saving derivative data. [2025-09-29T02:18:42.700858] [DEBUG] [LOCAL ] MDT: Derivative data saved (1820 records). [2025-09-29T02:18:42.701222] [INFO ] [MAIN ] MDT: Successfully saved derivative data. [2025-09-29T02:18:42.705232] [INFO ] [MAIN ] Derivative Progress: 1244/2211 symbols completed. MDT took 1.1s. Estimated remaining: 6m 49s. Rate: 142.0 symbols/min [2025-09-29T02:18:42.721816] [DEBUG] [MAIN ] MDU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:42.722461] [INFO ] [MAIN ] MDU: Generated 1820 derivative records from 48643 primary records. [2025-09-29T02:18:42.722548] [DEBUG] [LOCAL ] MDU: Saving derivative data. [2025-09-29T02:18:42.738588] [DEBUG] [LOCAL ] MDU: Derivative data saved (1820 records). [2025-09-29T02:18:42.738712] [INFO ] [MAIN ] MDU: Successfully saved derivative data. [2025-09-29T02:18:42.741498] [INFO ] [MAIN ] Derivative Progress: 1245/2211 symbols completed. MDU took 0.9s. Estimated remaining: 6m 48s. Rate: 142.1 symbols/min [2025-09-29T02:18:42.742118] [INFO ] [MAIN ] MDV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:42.742550] [INFO ] [MAIN ] MEC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:42.742310] [INFO ] [MAIN ] MED: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:42.766598] [DEBUG] [LOCAL ] MDV: Loaded 8733 existing records from primary storage. [2025-09-29T02:18:42.766842] [INFO ] [MAIN ] MDV: Loaded 8733 primary data records. [2025-09-29T02:18:42.833963] [DEBUG] [LOCAL ] MED: Loaded 22043 existing records from primary storage. [2025-09-29T02:18:42.863541] [INFO ] [MAIN ] MED: Loaded 22043 primary data records. [2025-09-29T02:18:42.930079] [DEBUG] [LOCAL ] MEC: Loaded 16695 existing records from primary storage. [2025-09-29T02:18:42.948083] [INFO ] [MAIN ] MEC: Loaded 16695 primary data records. [2025-09-29T02:18:43.851837] [DEBUG] [MAIN ] MDV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:43.852733] [INFO ] [MAIN ] MDV: Generated 1820 derivative records from 8733 primary records. [2025-09-29T02:18:43.852946] [DEBUG] [LOCAL ] MDV: Saving derivative data. [2025-09-29T02:18:43.873850] [DEBUG] [LOCAL ] MDV: Derivative data saved (1820 records). [2025-09-29T02:18:43.874762] [INFO ] [MAIN ] MDV: Successfully saved derivative data. [2025-09-29T02:18:43.877865] [INFO ] [MAIN ] Derivative Progress: 1246/2211 symbols completed. MDV took 1.1s. Estimated remaining: 6m 48s. Rate: 141.9 symbols/min [2025-09-29T02:18:43.887311] [INFO ] [MAIN ] MEG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:43.894992] [DEBUG] [MAIN ] MED: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:43.896223] [INFO ] [MAIN ] MED: Generated 1820 derivative records from 22043 primary records. [2025-09-29T02:18:43.904570] [DEBUG] [LOCAL ] MED: Saving derivative data. [2025-09-29T02:18:43.911093] [DEBUG] [MAIN ] MEC: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:18:43.920120] [INFO ] [MAIN ] MEC: Generated 1819 derivative records from 16695 primary records. [2025-09-29T02:18:43.920264] [DEBUG] [LOCAL ] MEC: Saving derivative data. [2025-09-29T02:18:43.929468] [DEBUG] [LOCAL ] MED: Derivative data saved (1820 records). [2025-09-29T02:18:43.929942] [INFO ] [MAIN ] MED: Successfully saved derivative data. [2025-09-29T02:18:43.939627] [INFO ] [MAIN ] Derivative Progress: 1247/2211 symbols completed. MED took 1.2s. Estimated remaining: 6m 47s. Rate: 142.0 symbols/min [2025-09-29T02:18:43.939950] [INFO ] [MAIN ] MEGI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:43.958136] [DEBUG] [LOCAL ] MEC: Derivative data saved (1819 records). [2025-09-29T02:18:43.958480] [INFO ] [MAIN ] MEC: Successfully saved derivative data. [2025-09-29T02:18:43.962417] [INFO ] [MAIN ] Derivative Progress: 1248/2211 symbols completed. MEC took 1.2s. Estimated remaining: 6m 47s. Rate: 142.1 symbols/min [2025-09-29T02:18:43.962759] [INFO ] [MAIN ] MEI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:43.982524] [DEBUG] [LOCAL ] MEG: Loaded 32426 existing records from primary storage. [2025-09-29T02:18:43.982831] [INFO ] [MAIN ] MEG: Loaded 32426 primary data records. [2025-09-29T02:18:44.087983] [DEBUG] [LOCAL ] MEGI: Loaded 20630 existing records from primary storage. [2025-09-29T02:18:44.088353] [INFO ] [MAIN ] MEGI: Loaded 20630 primary data records. [2025-09-29T02:18:44.289343] [DEBUG] [LOCAL ] MEI: Loaded 32933 existing records from primary storage. [2025-09-29T02:18:44.306725] [INFO ] [MAIN ] MEI: Loaded 32933 primary data records. [2025-09-29T02:18:45.059768] [DEBUG] [MAIN ] MEG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:45.069987] [INFO ] [MAIN ] MEG: Generated 1820 derivative records from 32426 primary records. [2025-09-29T02:18:45.075833] [DEBUG] [LOCAL ] MEG: Saving derivative data. [2025-09-29T02:18:45.076384] [DEBUG] [MAIN ] MEGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:45.079190] [INFO ] [MAIN ] MEGI: Generated 1820 derivative records from 20630 primary records. [2025-09-29T02:18:45.093254] [DEBUG] [LOCAL ] MEGI: Saving derivative data. [2025-09-29T02:18:45.094800] [DEBUG] [LOCAL ] MEG: Derivative data saved (1820 records). [2025-09-29T02:18:45.096429] [INFO ] [MAIN ] MEG: Successfully saved derivative data. [2025-09-29T02:18:45.099211] [INFO ] [MAIN ] Derivative Progress: 1249/2211 symbols completed. MEG took 1.2s. Estimated remaining: 6m 47s. Rate: 141.9 symbols/min [2025-09-29T02:18:45.109433] [INFO ] [MAIN ] MET: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:45.120033] [DEBUG] [LOCAL ] MEGI: Derivative data saved (1820 records). [2025-09-29T02:18:45.120731] [INFO ] [MAIN ] MEGI: Successfully saved derivative data. [2025-09-29T02:18:45.125394] [INFO ] [MAIN ] Derivative Progress: 1250/2211 symbols completed. MEGI took 1.2s. Estimated remaining: 6m 46s. Rate: 142.0 symbols/min [2025-09-29T02:18:45.126033] [INFO ] [MAIN ] MFA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:45.145627] [DEBUG] [MAIN ] MEI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:45.146894] [INFO ] [MAIN ] MEI: Generated 1820 derivative records from 32933 primary records. [2025-09-29T02:18:45.147242] [DEBUG] [LOCAL ] MEI: Saving derivative data. [2025-09-29T02:18:45.167796] [DEBUG] [LOCAL ] MEI: Derivative data saved (1820 records). [2025-09-29T02:18:45.168090] [INFO ] [MAIN ] MEI: Successfully saved derivative data. [2025-09-29T02:18:45.171325] [INFO ] [MAIN ] Derivative Progress: 1251/2211 symbols completed. MEI took 1.2s. Estimated remaining: 6m 45s. Rate: 142.1 symbols/min [2025-09-29T02:18:45.171701] [INFO ] [MAIN ] MFAN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:45.197257] [DEBUG] [LOCAL ] MFAN: Loaded 4331 existing records from primary storage. [2025-09-29T02:18:45.207968] [INFO ] [MAIN ] MFAN: Loaded 4331 primary data records. [2025-09-29T02:18:45.313689] [DEBUG] [LOCAL ] MET: Loaded 54089 existing records from primary storage. [2025-09-29T02:18:45.346539] [INFO ] [MAIN ] MET: Loaded 54089 primary data records. [2025-09-29T02:18:45.365500] [DEBUG] [LOCAL ] MFA: Loaded 46019 existing records from primary storage. [2025-09-29T02:18:45.470822] [INFO ] [MAIN ] MFA: Loaded 46019 primary data records. [2025-09-29T02:18:46.279467] [DEBUG] [MAIN ] MFAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:46.280978] [INFO ] [MAIN ] MFAN: Generated 1820 derivative records from 4331 primary records. [2025-09-29T02:18:46.281257] [DEBUG] [LOCAL ] MFAN: Saving derivative data. [2025-09-29T02:18:46.299750] [DEBUG] [LOCAL ] MFAN: Derivative data saved (1820 records). [2025-09-29T02:18:46.313438] [INFO ] [MAIN ] MFAN: Successfully saved derivative data. [2025-09-29T02:18:46.315886] [INFO ] [MAIN ] Derivative Progress: 1252/2211 symbols completed. MFAN took 1.1s. Estimated remaining: 6m 45s. Rate: 141.9 symbols/min [2025-09-29T02:18:46.313323] [DEBUG] [MAIN ] MET: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:46.316114] [INFO ] [MAIN ] MFAO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:46.317982] [INFO ] [MAIN ] MET: Generated 1820 derivative records from 54089 primary records. [2025-09-29T02:18:46.318218] [DEBUG] [LOCAL ] MET: Saving derivative data. [2025-09-29T02:18:46.340101] [DEBUG] [LOCAL ] MFAO: Loaded 3853 existing records from primary storage. [2025-09-29T02:18:46.342422] [DEBUG] [LOCAL ] MET: Derivative data saved (1820 records). [2025-09-29T02:18:46.343297] [INFO ] [MAIN ] MFAO: Loaded 3853 primary data records. [2025-09-29T02:18:46.343524] [INFO ] [MAIN ] MET: Successfully saved derivative data. [2025-09-29T02:18:46.399562] [INFO ] [MAIN ] Derivative Progress: 1253/2211 symbols completed. MET took 1.3s. Estimated remaining: 6m 45s. Rate: 142.0 symbols/min [2025-09-29T02:18:46.415319] [DEBUG] [MAIN ] MFA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:46.430201] [INFO ] [MAIN ] MFC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:46.454210] [INFO ] [MAIN ] MFA: Generated 1820 derivative records from 46019 primary records. [2025-09-29T02:18:46.486042] [DEBUG] [LOCAL ] MFA: Saving derivative data. [2025-09-29T02:18:46.724467] [DEBUG] [LOCAL ] MFA: Derivative data saved (1820 records). [2025-09-29T02:18:46.726988] [INFO ] [MAIN ] MFA: Successfully saved derivative data. [2025-09-29T02:18:46.732223] [INFO ] [MAIN ] Derivative Progress: 1254/2211 symbols completed. MFA took 1.6s. Estimated remaining: 6m 44s. Rate: 142.0 symbols/min [2025-09-29T02:18:46.733827] [INFO ] [MAIN ] MFG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:46.759472] [DEBUG] [MAIN ] MFAO: Filtered 7001 bins outside market hours, 7797 incomplete bins [2025-09-29T02:18:46.760486] [INFO ] [MAIN ] MFAO: Generated 1817 derivative records from 3853 primary records. [2025-09-29T02:18:46.760600] [DEBUG] [LOCAL ] MFAO: Saving derivative data. [2025-09-29T02:18:46.793182] [DEBUG] [LOCAL ] MFAO: Derivative data saved (1817 records). [2025-09-29T02:18:46.793468] [INFO ] [MAIN ] MFAO: Successfully saved derivative data. [2025-09-29T02:18:46.796144] [INFO ] [MAIN ] Derivative Progress: 1255/2211 symbols completed. MFAO took 0.5s. Estimated remaining: 6m 44s. Rate: 142.1 symbols/min [2025-09-29T02:18:46.796574] [INFO ] [MAIN ] MFM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:46.834637] [DEBUG] [LOCAL ] MFC: Loaded 52000 existing records from primary storage. [2025-09-29T02:18:46.835051] [INFO ] [MAIN ] MFC: Loaded 52000 primary data records. [2025-09-29T02:18:46.901428] [DEBUG] [LOCAL ] MFM: Loaded 14390 existing records from primary storage. [2025-09-29T02:18:46.963836] [DEBUG] [LOCAL ] MFG: Loaded 49748 existing records from primary storage. [2025-09-29T02:18:46.964107] [INFO ] [MAIN ] MFM: Loaded 14390 primary data records. [2025-09-29T02:18:46.978720] [INFO ] [MAIN ] MFG: Loaded 49748 primary data records. [2025-09-29T02:18:47.982748] [DEBUG] [MAIN ] MFC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:47.984258] [INFO ] [MAIN ] MFC: Generated 1820 derivative records from 52000 primary records. [2025-09-29T02:18:47.984684] [DEBUG] [LOCAL ] MFC: Saving derivative data. [2025-09-29T02:18:48.010419] [DEBUG] [LOCAL ] MFC: Derivative data saved (1820 records). [2025-09-29T02:18:48.025109] [DEBUG] [MAIN ] MFM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:48.039349] [DEBUG] [MAIN ] MFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:48.039448] [INFO ] [MAIN ] MFC: Successfully saved derivative data. [2025-09-29T02:18:48.040735] [INFO ] [MAIN ] MFG: Generated 1820 derivative records from 49748 primary records. [2025-09-29T02:18:48.042157] [DEBUG] [LOCAL ] MFG: Saving derivative data. [2025-09-29T02:18:48.041785] [INFO ] [MAIN ] MFM: Generated 1820 derivative records from 14390 primary records. [2025-09-29T02:18:48.045341] [INFO ] [MAIN ] Derivative Progress: 1256/2211 symbols completed. MFC took 1.6s. Estimated remaining: 6m 44s. Rate: 141.9 symbols/min [2025-09-29T02:18:48.045779] [INFO ] [MAIN ] MFSG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:48.047236] [DEBUG] [LOCAL ] MFM: Saving derivative data. [2025-09-29T02:18:48.082587] [DEBUG] [LOCAL ] MFM: Derivative data saved (1820 records). [2025-09-29T02:18:48.077982] [DEBUG] [LOCAL ] MFG: Derivative data saved (1820 records). [2025-09-29T02:18:48.083049] [INFO ] [MAIN ] MFM: Successfully saved derivative data. [2025-09-29T02:18:48.086308] [INFO ] [MAIN ] MFG: Successfully saved derivative data. [2025-09-29T02:18:48.086154] [INFO ] [MAIN ] Derivative Progress: 1257/2211 symbols completed. MFM took 1.3s. Estimated remaining: 6m 43s. Rate: 142.0 symbols/min [2025-09-29T02:18:48.086740] [INFO ] [MAIN ] MFSI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:48.090013] [INFO ] [MAIN ] Derivative Progress: 1258/2211 symbols completed. MFG took 1.4s. Estimated remaining: 6m 42s. Rate: 142.1 symbols/min [2025-09-29T02:18:48.094214] [DEBUG] [LOCAL ] MFSG: Loaded 5267 existing records from primary storage. [2025-09-29T02:18:48.094997] [INFO ] [MAIN ] MFSG: Loaded 5267 primary data records. [2025-09-29T02:18:48.229364] [DEBUG] [LOCAL ] MFSI: Loaded 11358 existing records from primary storage. [2025-09-29T02:18:48.255359] [INFO ] [MAIN ] MFSI: Loaded 11358 primary data records. [2025-09-29T02:18:48.787233] [DEBUG] [MAIN ] MFSG: Filtered 7001 bins outside market hours, 7800 incomplete bins [2025-09-29T02:18:48.789305] [INFO ] [MAIN ] MFSG: Generated 1814 derivative records from 5267 primary records. [2025-09-29T02:18:48.789440] [DEBUG] [LOCAL ] MFSG: Saving derivative data. [2025-09-29T02:18:48.807369] [DEBUG] [LOCAL ] MFSG: Derivative data saved (1814 records). [2025-09-29T02:18:48.807826] [INFO ] [MAIN ] MFSG: Successfully saved derivative data. [2025-09-29T02:18:48.810155] [INFO ] [MAIN ] Derivative Progress: 1259/2211 symbols completed. MFSG took 0.8s. Estimated remaining: 6m 42s. Rate: 142.0 symbols/min [2025-09-29T02:18:48.826975] [DEBUG] [MAIN ] MFSI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:48.827769] [INFO ] [MAIN ] MFSI: Generated 1820 derivative records from 11358 primary records. [2025-09-29T02:18:48.827859] [DEBUG] [LOCAL ] MFSI: Saving derivative data. [2025-09-29T02:18:48.843713] [DEBUG] [LOCAL ] MFSI: Derivative data saved (1820 records). [2025-09-29T02:18:48.843815] [INFO ] [MAIN ] MFSI: Successfully saved derivative data. [2025-09-29T02:18:48.846525] [INFO ] [MAIN ] Derivative Progress: 1260/2211 symbols completed. MFSI took 0.8s. Estimated remaining: 6m 41s. Rate: 142.1 symbols/min [2025-09-29T02:18:48.847259] [INFO ] [MAIN ] MGA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:48.847403] [INFO ] [MAIN ] MG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:48.847130] [INFO ] [MAIN ] MFSV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:48.853254] [DEBUG] [LOCAL ] MFSV: Loaded 2514 existing records from primary storage. [2025-09-29T02:18:48.853797] [INFO ] [MAIN ] MFSV: Loaded 2514 primary data records. [2025-09-29T02:18:48.987063] [DEBUG] [LOCAL ] MG: Loaded 16832 existing records from primary storage. [2025-09-29T02:18:48.998612] [INFO ] [MAIN ] MG: Loaded 16832 primary data records. [2025-09-29T02:18:49.381539] [DEBUG] [LOCAL ] MGA: Loaded 51414 existing records from primary storage. [2025-09-29T02:18:49.433865] [INFO ] [MAIN ] MGA: Loaded 51414 primary data records. [2025-09-29T02:18:49.976875] [DEBUG] [MAIN ] MFSV: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:18:49.978076] [INFO ] [MAIN ] MFSV: Generated 1819 derivative records from 2514 primary records. [2025-09-29T02:18:49.979050] [DEBUG] [LOCAL ] MFSV: Saving derivative data. [2025-09-29T02:18:50.001300] [DEBUG] [LOCAL ] MFSV: Derivative data saved (1819 records). [2025-09-29T02:18:50.001879] [INFO ] [MAIN ] MFSV: Successfully saved derivative data. [2025-09-29T02:18:50.018955] [INFO ] [MAIN ] Derivative Progress: 1261/2211 symbols completed. MFSV took 1.2s. Estimated remaining: 6m 42s. Rate: 141.9 symbols/min [2025-09-29T02:18:50.020516] [INFO ] [MAIN ] MGF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:50.020983] [DEBUG] [MAIN ] MG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:50.022582] [INFO ] [MAIN ] MG: Generated 1820 derivative records from 16832 primary records. [2025-09-29T02:18:50.022798] [DEBUG] [LOCAL ] MG: Saving derivative data. [2025-09-29T02:18:50.046072] [DEBUG] [LOCAL ] MGF: Loaded 4186 existing records from primary storage. [2025-09-29T02:18:50.045764] [DEBUG] [LOCAL ] MG: Derivative data saved (1820 records). [2025-09-29T02:18:50.046967] [INFO ] [MAIN ] MGF: Loaded 4186 primary data records. [2025-09-29T02:18:50.046843] [INFO ] [MAIN ] MG: Successfully saved derivative data. [2025-09-29T02:18:50.062307] [INFO ] [MAIN ] Derivative Progress: 1262/2211 symbols completed. MG took 1.2s. Estimated remaining: 6m 41s. Rate: 142.0 symbols/min [2025-09-29T02:18:50.062742] [INFO ] [MAIN ] MGM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:50.202208] [DEBUG] [MAIN ] MGA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:50.266503] [INFO ] [MAIN ] MGA: Generated 1820 derivative records from 51414 primary records. [2025-09-29T02:18:50.385689] [DEBUG] [LOCAL ] MGA: Saving derivative data. [2025-09-29T02:18:50.429559] [DEBUG] [LOCAL ] MGA: Derivative data saved (1820 records). [2025-09-29T02:18:50.430546] [INFO ] [MAIN ] MGA: Successfully saved derivative data. [2025-09-29T02:18:50.434199] [INFO ] [MAIN ] Derivative Progress: 1263/2211 symbols completed. MGA took 1.6s. Estimated remaining: 6m 40s. Rate: 142.0 symbols/min [2025-09-29T02:18:50.434755] [INFO ] [MAIN ] MGR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:50.462981] [DEBUG] [LOCAL ] MGR: Loaded 5675 existing records from primary storage. [2025-09-29T02:18:50.465321] [INFO ] [MAIN ] MGR: Loaded 5675 primary data records. [2025-09-29T02:18:50.464882] [DEBUG] [LOCAL ] MGM: Loaded 54388 existing records from primary storage. [2025-09-29T02:18:50.489069] [INFO ] [MAIN ] MGM: Loaded 54388 primary data records. [2025-09-29T02:18:50.712015] [DEBUG] [MAIN ] MGF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:50.738496] [INFO ] [MAIN ] MGF: Generated 1820 derivative records from 4186 primary records. [2025-09-29T02:18:50.800998] [DEBUG] [LOCAL ] MGF: Saving derivative data. [2025-09-29T02:18:51.199328] [DEBUG] [LOCAL ] MGF: Derivative data saved (1820 records). [2025-09-29T02:18:51.200061] [INFO ] [MAIN ] MGF: Successfully saved derivative data. [2025-09-29T02:18:51.202901] [INFO ] [MAIN ] Derivative Progress: 1264/2211 symbols completed. MGF took 1.2s. Estimated remaining: 6m 40s. Rate: 142.0 symbols/min [2025-09-29T02:18:51.204276] [INFO ] [MAIN ] MGRB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:51.215739] [DEBUG] [LOCAL ] MGRB: Loaded 4102 existing records from primary storage. [2025-09-29T02:18:51.217050] [INFO ] [MAIN ] MGRB: Loaded 4102 primary data records. [2025-09-29T02:18:51.402122] [DEBUG] [MAIN ] MGR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:51.432331] [INFO ] [MAIN ] MGR: Generated 1820 derivative records from 5675 primary records. [2025-09-29T02:18:51.461173] [DEBUG] [LOCAL ] MGR: Saving derivative data. [2025-09-29T02:18:51.499203] [DEBUG] [MAIN ] MGM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:51.609458] [INFO ] [MAIN ] MGM: Generated 1820 derivative records from 54388 primary records. [2025-09-29T02:18:51.667974] [DEBUG] [LOCAL ] MGM: Saving derivative data. [2025-09-29T02:18:51.789103] [DEBUG] [LOCAL ] MGR: Derivative data saved (1820 records). [2025-09-29T02:18:51.792423] [INFO ] [MAIN ] MGR: Successfully saved derivative data. [2025-09-29T02:18:51.798122] [INFO ] [MAIN ] Derivative Progress: 1265/2211 symbols completed. MGR took 1.4s. Estimated remaining: 6m 40s. Rate: 141.9 symbols/min [2025-09-29T02:18:51.834441] [DEBUG] [LOCAL ] MGM: Derivative data saved (1820 records). [2025-09-29T02:18:51.836319] [INFO ] [MAIN ] MGM: Successfully saved derivative data. [2025-09-29T02:18:51.841744] [INFO ] [MAIN ] Derivative Progress: 1266/2211 symbols completed. MGM took 1.8s. Estimated remaining: 6m 39s. Rate: 142.0 symbols/min [2025-09-29T02:18:51.842092] [INFO ] [MAIN ] MGRE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:51.834727] [INFO ] [MAIN ] MGRD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:51.851276] [DEBUG] [LOCAL ] MGRD: Loaded 2231 existing records from primary storage. [2025-09-29T02:18:51.867861] [INFO ] [MAIN ] MGRD: Loaded 2231 primary data records. [2025-09-29T02:18:51.910737] [DEBUG] [MAIN ] MGRB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:51.917173] [DEBUG] [LOCAL ] MGRE: Loaded 6684 existing records from primary storage. [2025-09-29T02:18:52.000719] [INFO ] [MAIN ] MGRE: Loaded 6684 primary data records. [2025-09-29T02:18:51.966141] [INFO ] [MAIN ] MGRB: Generated 1820 derivative records from 4102 primary records. [2025-09-29T02:18:52.081055] [DEBUG] [LOCAL ] MGRB: Saving derivative data. [2025-09-29T02:18:52.572229] [DEBUG] [LOCAL ] MGRB: Derivative data saved (1820 records). [2025-09-29T02:18:52.572418] [INFO ] [MAIN ] MGRB: Successfully saved derivative data. [2025-09-29T02:18:52.699026] [INFO ] [MAIN ] Derivative Progress: 1267/2211 symbols completed. MGRB took 1.5s. Estimated remaining: 6m 39s. Rate: 141.9 symbols/min [2025-09-29T02:18:52.700275] [INFO ] [MAIN ] MGY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:52.735797] [DEBUG] [MAIN ] MGRD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:52.745315] [INFO ] [MAIN ] MGRD: Generated 1820 derivative records from 2231 primary records. [2025-09-29T02:18:52.750916] [DEBUG] [LOCAL ] MGRD: Saving derivative data. [2025-09-29T02:18:52.750839] [DEBUG] [MAIN ] MGRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:52.753101] [INFO ] [MAIN ] MGRE: Generated 1820 derivative records from 6684 primary records. [2025-09-29T02:18:52.753313] [DEBUG] [LOCAL ] MGRE: Saving derivative data. [2025-09-29T02:18:52.795966] [DEBUG] [LOCAL ] MGRD: Derivative data saved (1820 records). [2025-09-29T02:18:52.797833] [INFO ] [MAIN ] MGRD: Successfully saved derivative data. [2025-09-29T02:18:52.797590] [DEBUG] [LOCAL ] MGRE: Derivative data saved (1820 records). [2025-09-29T02:18:52.800377] [INFO ] [MAIN ] Derivative Progress: 1268/2211 symbols completed. MGRD took 1.0s. Estimated remaining: 6m 39s. Rate: 142.0 symbols/min [2025-09-29T02:18:52.800891] [INFO ] [MAIN ] MHD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:52.800693] [INFO ] [MAIN ] MGRE: Successfully saved derivative data. [2025-09-29T02:18:52.804298] [INFO ] [MAIN ] Derivative Progress: 1269/2211 symbols completed. MGRE took 1.0s. Estimated remaining: 6m 38s. Rate: 142.1 symbols/min [2025-09-29T02:18:52.804806] [INFO ] [MAIN ] MHF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:52.824125] [DEBUG] [LOCAL ] MGY: Loaded 53195 existing records from primary storage. [2025-09-29T02:18:52.824600] [INFO ] [MAIN ] MGY: Loaded 53195 primary data records. [2025-09-29T02:18:52.943410] [DEBUG] [LOCAL ] MHF: Loaded 8713 existing records from primary storage. [2025-09-29T02:18:52.942638] [DEBUG] [LOCAL ] MHD: Loaded 12297 existing records from primary storage. [2025-09-29T02:18:52.956237] [INFO ] [MAIN ] MHF: Loaded 8713 primary data records. [2025-09-29T02:18:52.961826] [INFO ] [MAIN ] MHD: Loaded 12297 primary data records. [2025-09-29T02:18:53.868129] [DEBUG] [MAIN ] MGY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:53.869280] [INFO ] [MAIN ] MGY: Generated 1820 derivative records from 53195 primary records. [2025-09-29T02:18:53.869845] [DEBUG] [LOCAL ] MGY: Saving derivative data. [2025-09-29T02:18:53.890321] [DEBUG] [LOCAL ] MGY: Derivative data saved (1820 records). [2025-09-29T02:18:53.900970] [INFO ] [MAIN ] MGY: Successfully saved derivative data. [2025-09-29T02:18:53.909012] [INFO ] [MAIN ] Derivative Progress: 1270/2211 symbols completed. MGY took 1.2s. Estimated remaining: 6m 38s. Rate: 141.9 symbols/min [2025-09-29T02:18:53.906506] [DEBUG] [MAIN ] MHD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:53.909400] [INFO ] [MAIN ] MHK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:53.918598] [INFO ] [MAIN ] MHD: Generated 1820 derivative records from 12297 primary records. [2025-09-29T02:18:53.924012] [DEBUG] [LOCAL ] MHD: Saving derivative data. [2025-09-29T02:18:53.924551] [DEBUG] [MAIN ] MHF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:53.926221] [INFO ] [MAIN ] MHF: Generated 1820 derivative records from 8713 primary records. [2025-09-29T02:18:53.926632] [DEBUG] [LOCAL ] MHF: Saving derivative data. [2025-09-29T02:18:53.949454] [DEBUG] [LOCAL ] MHD: Derivative data saved (1820 records). [2025-09-29T02:18:53.953546] [INFO ] [MAIN ] MHD: Successfully saved derivative data. [2025-09-29T02:18:53.956467] [INFO ] [MAIN ] Derivative Progress: 1271/2211 symbols completed. MHD took 1.2s. Estimated remaining: 6m 37s. Rate: 142.0 symbols/min [2025-09-29T02:18:53.957074] [INFO ] [MAIN ] MHN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:53.966478] [DEBUG] [LOCAL ] MHF: Derivative data saved (1820 records). [2025-09-29T02:18:53.966762] [INFO ] [MAIN ] MHF: Successfully saved derivative data. [2025-09-29T02:18:53.969668] [INFO ] [MAIN ] Derivative Progress: 1272/2211 symbols completed. MHF took 1.2s. Estimated remaining: 6m 36s. Rate: 142.1 symbols/min [2025-09-29T02:18:53.972062] [INFO ] [MAIN ] MHO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:53.987863] [DEBUG] [LOCAL ] MHN: Loaded 7867 existing records from primary storage. [2025-09-29T02:18:53.988033] [INFO ] [MAIN ] MHN: Loaded 7867 primary data records. [2025-09-29T02:18:54.126489] [DEBUG] [LOCAL ] MHK: Loaded 43076 existing records from primary storage. [2025-09-29T02:18:54.137661] [INFO ] [MAIN ] MHK: Loaded 43076 primary data records. [2025-09-29T02:18:54.319829] [DEBUG] [LOCAL ] MHO: Loaded 24650 existing records from primary storage. [2025-09-29T02:18:54.514747] [INFO ] [MAIN ] MHO: Loaded 24650 primary data records. [2025-09-29T02:18:55.116563] [DEBUG] [MAIN ] MHN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:55.119898] [INFO ] [MAIN ] MHN: Generated 1820 derivative records from 7867 primary records. [2025-09-29T02:18:55.121126] [DEBUG] [LOCAL ] MHN: Saving derivative data. [2025-09-29T02:18:55.143249] [DEBUG] [MAIN ] MHK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:55.148315] [INFO ] [MAIN ] MHK: Generated 1820 derivative records from 43076 primary records. [2025-09-29T02:18:55.149055] [DEBUG] [LOCAL ] MHK: Saving derivative data. [2025-09-29T02:18:55.168420] [DEBUG] [LOCAL ] MHK: Derivative data saved (1820 records). [2025-09-29T02:18:55.170005] [INFO ] [MAIN ] MHK: Successfully saved derivative data. [2025-09-29T02:18:55.169482] [DEBUG] [LOCAL ] MHN: Derivative data saved (1820 records). [2025-09-29T02:18:55.173808] [INFO ] [MAIN ] MHN: Successfully saved derivative data. [2025-09-29T02:18:55.173633] [INFO ] [MAIN ] Derivative Progress: 1273/2211 symbols completed. MHK took 1.3s. Estimated remaining: 6m 37s. Rate: 141.9 symbols/min [2025-09-29T02:18:55.177315] [INFO ] [MAIN ] Derivative Progress: 1274/2211 symbols completed. MHN took 1.2s. Estimated remaining: 6m 36s. Rate: 142.0 symbols/min [2025-09-29T02:18:55.196077] [DEBUG] [MAIN ] MHO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:55.196878] [INFO ] [MAIN ] MHO: Generated 1820 derivative records from 24650 primary records. [2025-09-29T02:18:55.196965] [DEBUG] [LOCAL ] MHO: Saving derivative data. [2025-09-29T02:18:55.214488] [DEBUG] [LOCAL ] MHO: Derivative data saved (1820 records). [2025-09-29T02:18:55.214623] [INFO ] [MAIN ] MHO: Successfully saved derivative data. [2025-09-29T02:18:55.217868] [INFO ] [MAIN ] Derivative Progress: 1275/2211 symbols completed. MHO took 1.2s. Estimated remaining: 6m 35s. Rate: 142.1 symbols/min [2025-09-29T02:18:55.218586] [INFO ] [MAIN ] MITP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:55.218724] [INFO ] [MAIN ] MIR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:55.218448] [INFO ] [MAIN ] MIN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:55.226964] [DEBUG] [LOCAL ] MITP: Loaded 2467 existing records from primary storage. [2025-09-29T02:18:55.227261] [INFO ] [MAIN ] MITP: Loaded 2467 primary data records. [2025-09-29T02:18:55.330243] [DEBUG] [LOCAL ] MIN: Loaded 13224 existing records from primary storage. [2025-09-29T02:18:55.356030] [INFO ] [MAIN ] MIN: Loaded 13224 primary data records. [2025-09-29T02:18:55.764634] [DEBUG] [LOCAL ] MIR: Loaded 51622 existing records from primary storage. [2025-09-29T02:18:55.783695] [INFO ] [MAIN ] MIR: Loaded 51622 primary data records. [2025-09-29T02:18:56.352278] [DEBUG] [MAIN ] MITP: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-09-29T02:18:56.354521] [INFO ] [MAIN ] MITP: Generated 1818 derivative records from 2467 primary records. [2025-09-29T02:18:56.355518] [DEBUG] [LOCAL ] MITP: Saving derivative data. [2025-09-29T02:18:56.388002] [DEBUG] [MAIN ] MIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:56.391009] [DEBUG] [LOCAL ] MITP: Derivative data saved (1818 records). [2025-09-29T02:18:56.392180] [INFO ] [MAIN ] MITP: Successfully saved derivative data. [2025-09-29T02:18:56.391939] [INFO ] [MAIN ] MIN: Generated 1820 derivative records from 13224 primary records. [2025-09-29T02:18:56.395245] [INFO ] [MAIN ] Derivative Progress: 1276/2211 symbols completed. MITP took 1.2s. Estimated remaining: 6m 35s. Rate: 141.9 symbols/min [2025-09-29T02:18:56.396041] [INFO ] [MAIN ] MITT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:56.395723] [DEBUG] [LOCAL ] MIN: Saving derivative data. [2025-09-29T02:18:56.414728] [DEBUG] [LOCAL ] MIN: Derivative data saved (1820 records). [2025-09-29T02:18:56.414876] [INFO ] [MAIN ] MIN: Successfully saved derivative data. [2025-09-29T02:18:56.417937] [INFO ] [MAIN ] Derivative Progress: 1277/2211 symbols completed. MIN took 1.2s. Estimated remaining: 6m 35s. Rate: 142.0 symbols/min [2025-09-29T02:18:56.418585] [INFO ] [MAIN ] MIY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:56.447719] [DEBUG] [MAIN ] MIR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:56.449038] [INFO ] [MAIN ] MIR: Generated 1820 derivative records from 51622 primary records. [2025-09-29T02:18:56.449271] [DEBUG] [LOCAL ] MIR: Saving derivative data. [2025-09-29T02:18:56.454766] [DEBUG] [LOCAL ] MIY: Loaded 6084 existing records from primary storage. [2025-09-29T02:18:56.472426] [INFO ] [MAIN ] MIY: Loaded 6084 primary data records. [2025-09-29T02:18:56.477605] [DEBUG] [LOCAL ] MITT: Loaded 23379 existing records from primary storage. [2025-09-29T02:18:56.478313] [INFO ] [MAIN ] MITT: Loaded 23379 primary data records. [2025-09-29T02:18:56.650429] [DEBUG] [LOCAL ] MIR: Derivative data saved (1820 records). [2025-09-29T02:18:56.681613] [INFO ] [MAIN ] MIR: Successfully saved derivative data. [2025-09-29T02:18:56.707053] [INFO ] [MAIN ] Derivative Progress: 1278/2211 symbols completed. MIR took 1.5s. Estimated remaining: 6m 34s. Rate: 142.1 symbols/min [2025-09-29T02:18:56.730250] [INFO ] [MAIN ] MKC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:57.224234] [DEBUG] [MAIN ] MITT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:57.226486] [INFO ] [MAIN ] MITT: Generated 1820 derivative records from 23379 primary records. [2025-09-29T02:18:57.228082] [DEBUG] [LOCAL ] MITT: Saving derivative data. [2025-09-29T02:18:57.256159] [DEBUG] [MAIN ] MIY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:57.274410] [DEBUG] [LOCAL ] MITT: Derivative data saved (1820 records). [2025-09-29T02:18:57.274578] [INFO ] [MAIN ] MITT: Successfully saved derivative data. [2025-09-29T02:18:57.277543] [INFO ] [MAIN ] Derivative Progress: 1279/2211 symbols completed. MITT took 0.9s. Estimated remaining: 6m 34s. Rate: 142.0 symbols/min [2025-09-29T02:18:57.280218] [INFO ] [MAIN ] MKL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:57.278635] [INFO ] [MAIN ] MIY: Generated 1820 derivative records from 6084 primary records. [2025-09-29T02:18:57.281132] [DEBUG] [LOCAL ] MIY: Saving derivative data. [2025-09-29T02:18:57.283829] [DEBUG] [LOCAL ] MKC: Loaded 53204 existing records from primary storage. [2025-09-29T02:18:57.299310] [INFO ] [MAIN ] MKC: Loaded 53204 primary data records. [2025-09-29T02:18:57.303906] [DEBUG] [LOCAL ] MIY: Derivative data saved (1820 records). [2025-09-29T02:18:57.304459] [INFO ] [MAIN ] MIY: Successfully saved derivative data. [2025-09-29T02:18:57.331924] [INFO ] [MAIN ] Derivative Progress: 1280/2211 symbols completed. MIY took 0.9s. Estimated remaining: 6m 33s. Rate: 142.1 symbols/min [2025-09-29T02:18:57.349097] [INFO ] [MAIN ] MLI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:57.584860] [DEBUG] [LOCAL ] MKL: Loaded 34588 existing records from primary storage. [2025-09-29T02:18:57.654576] [INFO ] [MAIN ] MKL: Loaded 34588 primary data records. [2025-09-29T02:18:57.788304] [DEBUG] [LOCAL ] MLI: Loaded 44447 existing records from primary storage. [2025-09-29T02:18:57.802520] [INFO ] [MAIN ] MLI: Loaded 44447 primary data records. [2025-09-29T02:18:58.443040] [DEBUG] [MAIN ] MKC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:58.456566] [INFO ] [MAIN ] MKC: Generated 1820 derivative records from 53204 primary records. [2025-09-29T02:18:58.457208] [DEBUG] [LOCAL ] MKC: Saving derivative data. [2025-09-29T02:18:58.496301] [DEBUG] [MAIN ] MKL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:58.495465] [DEBUG] [LOCAL ] MKC: Derivative data saved (1820 records). [2025-09-29T02:18:58.498282] [INFO ] [MAIN ] MKL: Generated 1820 derivative records from 34588 primary records. [2025-09-29T02:18:58.497486] [INFO ] [MAIN ] MKC: Successfully saved derivative data. [2025-09-29T02:18:58.498389] [DEBUG] [LOCAL ] MKL: Saving derivative data. [2025-09-29T02:18:58.502278] [INFO ] [MAIN ] Derivative Progress: 1281/2211 symbols completed. MKC took 1.8s. Estimated remaining: 6m 33s. Rate: 141.9 symbols/min [2025-09-29T02:18:58.503269] [INFO ] [MAIN ] MLM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:58.527508] [DEBUG] [LOCAL ] MKL: Derivative data saved (1820 records). [2025-09-29T02:18:58.528094] [INFO ] [MAIN ] MKL: Successfully saved derivative data. [2025-09-29T02:18:58.532407] [INFO ] [MAIN ] Derivative Progress: 1282/2211 symbols completed. MKL took 1.3s. Estimated remaining: 6m 32s. Rate: 142.0 symbols/min [2025-09-29T02:18:58.540889] [INFO ] [MAIN ] MLNK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:58.547092] [DEBUG] [MAIN ] MLI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:58.548373] [INFO ] [MAIN ] MLI: Generated 1820 derivative records from 44447 primary records. [2025-09-29T02:18:58.548616] [DEBUG] [LOCAL ] MLI: Saving derivative data. [2025-09-29T02:18:58.575249] [DEBUG] [LOCAL ] MLI: Derivative data saved (1820 records). [2025-09-29T02:18:58.575541] [INFO ] [MAIN ] MLI: Successfully saved derivative data. [2025-09-29T02:18:58.578437] [INFO ] [MAIN ] Derivative Progress: 1283/2211 symbols completed. MLI took 1.2s. Estimated remaining: 6m 32s. Rate: 142.1 symbols/min [2025-09-29T02:18:58.578898] [INFO ] [MAIN ] MLP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:58.598405] [DEBUG] [LOCAL ] MLP: Loaded 3120 existing records from primary storage. [2025-09-29T02:18:58.595457] [DEBUG] [LOCAL ] MLM: Loaded 31068 existing records from primary storage. [2025-09-29T02:18:58.605800] [INFO ] [MAIN ] MLM: Loaded 31068 primary data records. [2025-09-29T02:18:58.606028] [INFO ] [MAIN ] MLP: Loaded 3120 primary data records. [2025-09-29T02:18:58.817876] [DEBUG] [LOCAL ] MLNK: Loaded 25921 existing records from primary storage. [2025-09-29T02:18:58.881730] [INFO ] [MAIN ] MLNK: Loaded 25921 primary data records. [2025-09-29T02:18:59.707458] [DEBUG] [MAIN ] MLM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:59.710858] [INFO ] [MAIN ] MLM: Generated 1820 derivative records from 31068 primary records. [2025-09-29T02:18:59.712717] [DEBUG] [LOCAL ] MLM: Saving derivative data. [2025-09-29T02:18:59.730435] [DEBUG] [MAIN ] MLP: Filtered 7001 bins outside market hours, 7797 incomplete bins [2025-09-29T02:18:59.749995] [INFO ] [MAIN ] MLP: Generated 1817 derivative records from 3120 primary records. [2025-09-29T02:18:59.750610] [DEBUG] [LOCAL ] MLM: Derivative data saved (1820 records). [2025-09-29T02:18:59.751858] [DEBUG] [LOCAL ] MLP: Saving derivative data. [2025-09-29T02:18:59.751947] [INFO ] [MAIN ] MLM: Successfully saved derivative data. [2025-09-29T02:18:59.756739] [INFO ] [MAIN ] Derivative Progress: 1284/2211 symbols completed. MLM took 1.3s. Estimated remaining: 6m 32s. Rate: 141.9 symbols/min [2025-09-29T02:18:59.757897] [INFO ] [MAIN ] MLR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:59.774458] [DEBUG] [LOCAL ] MLP: Derivative data saved (1817 records). [2025-09-29T02:18:59.776782] [INFO ] [MAIN ] MLP: Successfully saved derivative data. [2025-09-29T02:18:59.780743] [INFO ] [MAIN ] Derivative Progress: 1285/2211 symbols completed. MLP took 1.2s. Estimated remaining: 6m 31s. Rate: 142.0 symbols/min [2025-09-29T02:18:59.781168] [INFO ] [MAIN ] MMC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:59.795351] [DEBUG] [MAIN ] MLNK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:18:59.800565] [INFO ] [MAIN ] MLNK: Generated 1820 derivative records from 25921 primary records. [2025-09-29T02:18:59.800824] [DEBUG] [LOCAL ] MLNK: Saving derivative data. [2025-09-29T02:18:59.825928] [DEBUG] [LOCAL ] MLNK: Derivative data saved (1820 records). [2025-09-29T02:18:59.826470] [DEBUG] [LOCAL ] MLR: Loaded 12982 existing records from primary storage. [2025-09-29T02:18:59.826718] [INFO ] [MAIN ] MLNK: Successfully saved derivative data. [2025-09-29T02:18:59.831471] [INFO ] [MAIN ] Derivative Progress: 1286/2211 symbols completed. MLNK took 1.3s. Estimated remaining: 6m 30s. Rate: 142.1 symbols/min [2025-09-29T02:18:59.831730] [INFO ] [MAIN ] MLR: Loaded 12982 primary data records. [2025-09-29T02:18:59.831863] [INFO ] [MAIN ] MMD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:18:59.996889] [DEBUG] [LOCAL ] MMD: Loaded 11435 existing records from primary storage. [2025-09-29T02:19:00.060052] [INFO ] [MAIN ] MMD: Loaded 11435 primary data records. [2025-09-29T02:19:00.384055] [DEBUG] [LOCAL ] MMC: Loaded 52551 existing records from primary storage. [2025-09-29T02:19:00.396544] [INFO ] [MAIN ] MMC: Loaded 52551 primary data records. [2025-09-29T02:19:01.033338] [DEBUG] [MAIN ] MLR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:01.034977] [INFO ] [MAIN ] MLR: Generated 1820 derivative records from 12982 primary records. [2025-09-29T02:19:01.035550] [DEBUG] [LOCAL ] MLR: Saving derivative data. [2025-09-29T02:19:01.055679] [DEBUG] [LOCAL ] MLR: Derivative data saved (1820 records). [2025-09-29T02:19:01.055875] [INFO ] [MAIN ] MLR: Successfully saved derivative data. [2025-09-29T02:19:01.060425] [INFO ] [MAIN ] Derivative Progress: 1287/2211 symbols completed. MLR took 1.3s. Estimated remaining: 6m 31s. Rate: 141.9 symbols/min [2025-09-29T02:19:01.062085] [INFO ] [MAIN ] MMI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:01.081702] [DEBUG] [MAIN ] MMD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:01.082599] [INFO ] [MAIN ] MMD: Generated 1820 derivative records from 11435 primary records. [2025-09-29T02:19:01.082839] [DEBUG] [LOCAL ] MMD: Saving derivative data. [2025-09-29T02:19:01.105723] [DEBUG] [LOCAL ] MMD: Derivative data saved (1820 records). [2025-09-29T02:19:01.106298] [INFO ] [MAIN ] MMD: Successfully saved derivative data. [2025-09-29T02:19:01.108786] [INFO ] [MAIN ] Derivative Progress: 1288/2211 symbols completed. MMD took 1.3s. Estimated remaining: 6m 30s. Rate: 142.0 symbols/min [2025-09-29T02:19:01.119839] [DEBUG] [LOCAL ] MMI: Loaded 15452 existing records from primary storage. [2025-09-29T02:19:01.120785] [INFO ] [MAIN ] MMI: Loaded 15452 primary data records. [2025-09-29T02:19:01.220524] [DEBUG] [MAIN ] MMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:01.249485] [INFO ] [MAIN ] MMC: Generated 1820 derivative records from 52551 primary records. [2025-09-29T02:19:01.253166] [DEBUG] [LOCAL ] MMC: Saving derivative data. [2025-09-29T02:19:01.354307] [DEBUG] [LOCAL ] MMC: Derivative data saved (1820 records). [2025-09-29T02:19:01.480721] [INFO ] [MAIN ] MMC: Successfully saved derivative data. [2025-09-29T02:19:01.486161] [INFO ] [MAIN ] Derivative Progress: 1289/2211 symbols completed. MMC took 1.7s. Estimated remaining: 6m 30s. Rate: 142.0 symbols/min [2025-09-29T02:19:01.515097] [DEBUG] [MAIN ] MMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:01.515895] [INFO ] [MAIN ] MMI: Generated 1820 derivative records from 15452 primary records. [2025-09-29T02:19:01.515987] [DEBUG] [LOCAL ] MMI: Saving derivative data. [2025-09-29T02:19:01.532988] [DEBUG] [LOCAL ] MMI: Derivative data saved (1820 records). [2025-09-29T02:19:01.533198] [INFO ] [MAIN ] MMI: Successfully saved derivative data. [2025-09-29T02:19:01.536418] [INFO ] [MAIN ] Derivative Progress: 1290/2211 symbols completed. MMI took 0.5s. Estimated remaining: 6m 29s. Rate: 142.1 symbols/min [2025-09-29T02:19:01.537266] [INFO ] [MAIN ] MMS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:01.537414] [INFO ] [MAIN ] MMT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:01.537128] [INFO ] [MAIN ] MMM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:01.564695] [DEBUG] [LOCAL ] MMT: Loaded 10987 existing records from primary storage. [2025-09-29T02:19:01.565116] [INFO ] [MAIN ] MMT: Loaded 10987 primary data records. [2025-09-29T02:19:01.711937] [DEBUG] [LOCAL ] MMS: Loaded 34398 existing records from primary storage. [2025-09-29T02:19:01.741767] [INFO ] [MAIN ] MMS: Loaded 34398 primary data records. [2025-09-29T02:19:02.149544] [DEBUG] [LOCAL ] MMM: Loaded 53995 existing records from primary storage. [2025-09-29T02:19:02.168578] [INFO ] [MAIN ] MMM: Loaded 53995 primary data records. [2025-09-29T02:19:02.789118] [DEBUG] [MAIN ] MMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:02.790472] [INFO ] [MAIN ] MMT: Generated 1820 derivative records from 10987 primary records. [2025-09-29T02:19:02.790877] [DEBUG] [LOCAL ] MMT: Saving derivative data. [2025-09-29T02:19:02.809457] [DEBUG] [LOCAL ] MMT: Derivative data saved (1820 records). [2025-09-29T02:19:02.810753] [INFO ] [MAIN ] MMT: Successfully saved derivative data. [2025-09-29T02:19:02.814739] [INFO ] [MAIN ] Derivative Progress: 1291/2211 symbols completed. MMT took 1.3s. Estimated remaining: 6m 29s. Rate: 141.9 symbols/min [2025-09-29T02:19:02.815225] [INFO ] [MAIN ] MMU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:02.831006] [DEBUG] [MAIN ] MMS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:02.832884] [INFO ] [MAIN ] MMS: Generated 1820 derivative records from 34398 primary records. [2025-09-29T02:19:02.833353] [DEBUG] [LOCAL ] MMS: Saving derivative data. [2025-09-29T02:19:02.868009] [DEBUG] [MAIN ] MMM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:02.873268] [INFO ] [MAIN ] MMM: Generated 1820 derivative records from 53995 primary records. [2025-09-29T02:19:02.873582] [DEBUG] [LOCAL ] MMM: Saving derivative data. [2025-09-29T02:19:02.873415] [DEBUG] [LOCAL ] MMS: Derivative data saved (1820 records). [2025-09-29T02:19:02.874382] [INFO ] [MAIN ] MMS: Successfully saved derivative data. [2025-09-29T02:19:02.877591] [INFO ] [MAIN ] Derivative Progress: 1292/2211 symbols completed. MMS took 1.3s. Estimated remaining: 6m 28s. Rate: 142.0 symbols/min [2025-09-29T02:19:02.878082] [INFO ] [MAIN ] MNR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:02.900279] [DEBUG] [LOCAL ] MMU: Loaded 17156 existing records from primary storage. [2025-09-29T02:19:02.901420] [INFO ] [MAIN ] MMU: Loaded 17156 primary data records. [2025-09-29T02:19:02.915304] [DEBUG] [LOCAL ] MMM: Derivative data saved (1820 records). [2025-09-29T02:19:02.942315] [INFO ] [MAIN ] MMM: Successfully saved derivative data. [2025-09-29T02:19:02.953600] [INFO ] [MAIN ] Derivative Progress: 1293/2211 symbols completed. MMM took 1.4s. Estimated remaining: 6m 28s. Rate: 142.1 symbols/min [2025-09-29T02:19:02.984309] [INFO ] [MAIN ] MNSO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:03.120306] [DEBUG] [LOCAL ] MNR: Loaded 24918 existing records from primary storage. [2025-09-29T02:19:03.265174] [INFO ] [MAIN ] MNR: Loaded 24918 primary data records. [2025-09-29T02:19:03.447620] [DEBUG] [LOCAL ] MNSO: Loaded 45049 existing records from primary storage. [2025-09-29T02:19:03.449059] [INFO ] [MAIN ] MNSO: Loaded 45049 primary data records. [2025-09-29T02:19:03.889839] [DEBUG] [MAIN ] MMU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:04.019696] [INFO ] [MAIN ] MMU: Generated 1820 derivative records from 17156 primary records. [2025-09-29T02:19:04.020286] [DEBUG] [LOCAL ] MMU: Saving derivative data. [2025-09-29T02:19:04.045732] [DEBUG] [LOCAL ] MMU: Derivative data saved (1820 records). [2025-09-29T02:19:04.046250] [INFO ] [MAIN ] MMU: Successfully saved derivative data. [2025-09-29T02:19:04.049399] [INFO ] [MAIN ] Derivative Progress: 1294/2211 symbols completed. MMU took 1.2s. Estimated remaining: 6m 28s. Rate: 141.9 symbols/min [2025-09-29T02:19:04.050282] [INFO ] [MAIN ] MOD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:04.073238] [DEBUG] [MAIN ] MNR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:04.075056] [INFO ] [MAIN ] MNR: Generated 1820 derivative records from 24918 primary records. [2025-09-29T02:19:04.075527] [DEBUG] [LOCAL ] MNR: Saving derivative data. [2025-09-29T02:19:04.097430] [DEBUG] [LOCAL ] MNR: Derivative data saved (1820 records). [2025-09-29T02:19:04.111297] [INFO ] [MAIN ] MNR: Successfully saved derivative data. [2025-09-29T02:19:04.111216] [DEBUG] [MAIN ] MNSO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:04.115206] [INFO ] [MAIN ] Derivative Progress: 1295/2211 symbols completed. MNR took 1.2s. Estimated remaining: 6m 27s. Rate: 142.0 symbols/min [2025-09-29T02:19:04.115481] [INFO ] [MAIN ] MODG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:04.112318] [INFO ] [MAIN ] MNSO: Generated 1820 derivative records from 45049 primary records. [2025-09-29T02:19:04.116149] [DEBUG] [LOCAL ] MNSO: Saving derivative data. [2025-09-29T02:19:04.146402] [DEBUG] [LOCAL ] MNSO: Derivative data saved (1820 records). [2025-09-29T02:19:04.146905] [INFO ] [MAIN ] MNSO: Successfully saved derivative data. [2025-09-29T02:19:04.150265] [INFO ] [MAIN ] Derivative Progress: 1296/2211 symbols completed. MNSO took 1.2s. Estimated remaining: 6m 26s. Rate: 142.1 symbols/min [2025-09-29T02:19:04.150725] [INFO ] [MAIN ] MOH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:04.173178] [DEBUG] [LOCAL ] MOD: Loaded 46169 existing records from primary storage. [2025-09-29T02:19:04.173694] [INFO ] [MAIN ] MOD: Loaded 46169 primary data records. [2025-09-29T02:19:04.366307] [DEBUG] [LOCAL ] MODG: Loaded 52353 existing records from primary storage. [2025-09-29T02:19:04.377040] [INFO ] [MAIN ] MODG: Loaded 52353 primary data records. [2025-09-29T02:19:04.664041] [DEBUG] [LOCAL ] MOH: Loaded 42444 existing records from primary storage. [2025-09-29T02:19:04.698755] [INFO ] [MAIN ] MOH: Loaded 42444 primary data records. [2025-09-29T02:19:05.357354] [DEBUG] [MAIN ] MOD: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:19:05.361110] [INFO ] [MAIN ] MOD: Generated 1819 derivative records from 46169 primary records. [2025-09-29T02:19:05.361584] [DEBUG] [LOCAL ] MOD: Saving derivative data. [2025-09-29T02:19:05.380265] [DEBUG] [LOCAL ] MOD: Derivative data saved (1819 records). [2025-09-29T02:19:05.381593] [INFO ] [MAIN ] MOD: Successfully saved derivative data. [2025-09-29T02:19:05.384757] [INFO ] [MAIN ] Derivative Progress: 1297/2211 symbols completed. MOD took 1.3s. Estimated remaining: 6m 26s. Rate: 141.9 symbols/min [2025-09-29T02:19:05.386238] [INFO ] [MAIN ] MOS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:05.403576] [DEBUG] [MAIN ] MODG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:05.405576] [INFO ] [MAIN ] MODG: Generated 1820 derivative records from 52353 primary records. [2025-09-29T02:19:05.405968] [DEBUG] [LOCAL ] MODG: Saving derivative data. [2025-09-29T02:19:05.447098] [DEBUG] [MAIN ] MOH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:05.448960] [INFO ] [MAIN ] MOH: Generated 1820 derivative records from 42444 primary records. [2025-09-29T02:19:05.447862] [DEBUG] [LOCAL ] MODG: Derivative data saved (1820 records). [2025-09-29T02:19:05.449138] [DEBUG] [LOCAL ] MOH: Saving derivative data. [2025-09-29T02:19:05.449238] [INFO ] [MAIN ] MODG: Successfully saved derivative data. [2025-09-29T02:19:05.453758] [INFO ] [MAIN ] Derivative Progress: 1298/2211 symbols completed. MODG took 1.3s. Estimated remaining: 6m 26s. Rate: 142.0 symbols/min [2025-09-29T02:19:05.466226] [INFO ] [MAIN ] MOV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:05.470806] [DEBUG] [LOCAL ] MOH: Derivative data saved (1820 records). [2025-09-29T02:19:05.485499] [INFO ] [MAIN ] MOH: Successfully saved derivative data. [2025-09-29T02:19:05.488472] [INFO ] [MAIN ] Derivative Progress: 1299/2211 symbols completed. MOH took 1.3s. Estimated remaining: 6m 25s. Rate: 142.1 symbols/min [2025-09-29T02:19:05.488969] [INFO ] [MAIN ] MP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:05.514554] [DEBUG] [LOCAL ] MOS: Loaded 54284 existing records from primary storage. [2025-09-29T02:19:05.514978] [INFO ] [MAIN ] MOS: Loaded 54284 primary data records. [2025-09-29T02:19:05.652008] [DEBUG] [LOCAL ] MOV: Loaded 22417 existing records from primary storage. [2025-09-29T02:19:05.657827] [INFO ] [MAIN ] MOV: Loaded 22417 primary data records. [2025-09-29T02:19:06.028775] [DEBUG] [LOCAL ] MP: Loaded 54444 existing records from primary storage. [2025-09-29T02:19:06.040965] [INFO ] [MAIN ] MP: Loaded 54444 primary data records. [2025-09-29T02:19:06.614989] [DEBUG] [MAIN ] MOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:06.618926] [INFO ] [MAIN ] MOS: Generated 1820 derivative records from 54284 primary records. [2025-09-29T02:19:06.620198] [DEBUG] [LOCAL ] MOS: Saving derivative data. [2025-09-29T02:19:06.648898] [DEBUG] [MAIN ] MOV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:06.652639] [INFO ] [MAIN ] MOV: Generated 1820 derivative records from 22417 primary records. [2025-09-29T02:19:06.654432] [DEBUG] [LOCAL ] MOV: Saving derivative data. [2025-09-29T02:19:06.654289] [DEBUG] [LOCAL ] MOS: Derivative data saved (1820 records). [2025-09-29T02:19:06.656314] [INFO ] [MAIN ] MOS: Successfully saved derivative data. [2025-09-29T02:19:06.668459] [INFO ] [MAIN ] Derivative Progress: 1300/2211 symbols completed. MOS took 1.3s. Estimated remaining: 6m 25s. Rate: 141.9 symbols/min [2025-09-29T02:19:06.671889] [INFO ] [MAIN ] MPA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:06.678530] [DEBUG] [LOCAL ] MOV: Derivative data saved (1820 records). [2025-09-29T02:19:06.678910] [INFO ] [MAIN ] MOV: Successfully saved derivative data. [2025-09-29T02:19:06.681731] [INFO ] [MAIN ] Derivative Progress: 1301/2211 symbols completed. MOV took 1.2s. Estimated remaining: 6m 25s. Rate: 142.0 symbols/min [2025-09-29T02:19:06.682352] [INFO ] [MAIN ] MPC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:06.689175] [DEBUG] [LOCAL ] MPA: Loaded 5268 existing records from primary storage. [2025-09-29T02:19:06.692317] [INFO ] [MAIN ] MPA: Loaded 5268 primary data records. [2025-09-29T02:19:06.768092] [DEBUG] [MAIN ] MP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:06.779291] [INFO ] [MAIN ] MP: Generated 1820 derivative records from 54444 primary records. [2025-09-29T02:19:06.784586] [DEBUG] [LOCAL ] MP: Saving derivative data. [2025-09-29T02:19:06.886893] [DEBUG] [LOCAL ] MP: Derivative data saved (1820 records). [2025-09-29T02:19:06.887101] [INFO ] [MAIN ] MP: Successfully saved derivative data. [2025-09-29T02:19:06.890610] [INFO ] [MAIN ] Derivative Progress: 1302/2211 symbols completed. MP took 1.4s. Estimated remaining: 6m 24s. Rate: 142.0 symbols/min [2025-09-29T02:19:06.899974] [INFO ] [MAIN ] MPLX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:07.106778] [DEBUG] [LOCAL ] MPC: Loaded 52889 existing records from primary storage. [2025-09-29T02:19:07.107321] [INFO ] [MAIN ] MPC: Loaded 52889 primary data records. [2025-09-29T02:19:07.371611] [DEBUG] [LOCAL ] MPLX: Loaded 51491 existing records from primary storage. [2025-09-29T02:19:07.528123] [INFO ] [MAIN ] MPLX: Loaded 51491 primary data records. [2025-09-29T02:19:07.556323] [DEBUG] [MAIN ] MPA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:07.582397] [INFO ] [MAIN ] MPA: Generated 1820 derivative records from 5268 primary records. [2025-09-29T02:19:07.614366] [DEBUG] [LOCAL ] MPA: Saving derivative data. [2025-09-29T02:19:07.697407] [DEBUG] [LOCAL ] MPA: Derivative data saved (1820 records). [2025-09-29T02:19:07.697860] [INFO ] [MAIN ] MPA: Successfully saved derivative data. [2025-09-29T02:19:07.706850] [INFO ] [MAIN ] Derivative Progress: 1303/2211 symbols completed. MPA took 1.0s. Estimated remaining: 6m 24s. Rate: 141.9 symbols/min [2025-09-29T02:19:07.931259] [DEBUG] [MAIN ] MPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:07.933141] [INFO ] [MAIN ] MPC: Generated 1820 derivative records from 52889 primary records. [2025-09-29T02:19:07.933417] [DEBUG] [LOCAL ] MPC: Saving derivative data. [2025-09-29T02:19:07.953105] [DEBUG] [LOCAL ] MPC: Derivative data saved (1820 records). [2025-09-29T02:19:07.953305] [INFO ] [MAIN ] MPC: Successfully saved derivative data. [2025-09-29T02:19:07.956987] [INFO ] [MAIN ] Derivative Progress: 1304/2211 symbols completed. MPC took 1.3s. Estimated remaining: 6m 23s. Rate: 142.0 symbols/min [2025-09-29T02:19:07.975048] [DEBUG] [MAIN ] MPLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:07.975836] [INFO ] [MAIN ] MPLX: Generated 1820 derivative records from 51491 primary records. [2025-09-29T02:19:07.975926] [DEBUG] [LOCAL ] MPLX: Saving derivative data. [2025-09-29T02:19:07.991907] [DEBUG] [LOCAL ] MPLX: Derivative data saved (1820 records). [2025-09-29T02:19:07.992008] [INFO ] [MAIN ] MPLX: Successfully saved derivative data. [2025-09-29T02:19:07.995093] [INFO ] [MAIN ] Derivative Progress: 1305/2211 symbols completed. MPLX took 1.1s. Estimated remaining: 6m 23s. Rate: 142.1 symbols/min [2025-09-29T02:19:07.995628] [INFO ] [MAIN ] MPV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:07.995736] [INFO ] [MAIN ] MPX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:07.995856] [INFO ] [MAIN ] MPW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:08.007084] [DEBUG] [LOCAL ] MPX: Loaded 4213 existing records from primary storage. [2025-09-29T02:19:08.011017] [DEBUG] [LOCAL ] MPV: Loaded 5098 existing records from primary storage. [2025-09-29T02:19:08.010694] [INFO ] [MAIN ] MPX: Loaded 4213 primary data records. [2025-09-29T02:19:08.011200] [INFO ] [MAIN ] MPV: Loaded 5098 primary data records. [2025-09-29T02:19:08.709614] [DEBUG] [LOCAL ] MPW: Loaded 54275 existing records from primary storage. [2025-09-29T02:19:08.710360] [INFO ] [MAIN ] MPW: Loaded 54275 primary data records. [2025-09-29T02:19:09.101497] [DEBUG] [MAIN ] MPV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:09.103764] [INFO ] [MAIN ] MPV: Generated 1820 derivative records from 5098 primary records. [2025-09-29T02:19:09.104171] [DEBUG] [LOCAL ] MPV: Saving derivative data. [2025-09-29T02:19:09.117895] [DEBUG] [MAIN ] MPX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:09.132416] [INFO ] [MAIN ] MPX: Generated 1820 derivative records from 4213 primary records. [2025-09-29T02:19:09.132890] [DEBUG] [LOCAL ] MPX: Saving derivative data. [2025-09-29T02:19:09.138074] [DEBUG] [LOCAL ] MPV: Derivative data saved (1820 records). [2025-09-29T02:19:09.146065] [INFO ] [MAIN ] MPV: Successfully saved derivative data. [2025-09-29T02:19:09.148977] [INFO ] [MAIN ] Derivative Progress: 1306/2211 symbols completed. MPV took 1.2s. Estimated remaining: 6m 23s. Rate: 141.9 symbols/min [2025-09-29T02:19:09.155783] [DEBUG] [LOCAL ] MPX: Derivative data saved (1820 records). [2025-09-29T02:19:09.156313] [INFO ] [MAIN ] MQT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:09.157153] [INFO ] [MAIN ] MPX: Successfully saved derivative data. [2025-09-29T02:19:09.160116] [INFO ] [MAIN ] Derivative Progress: 1307/2211 symbols completed. MPX took 1.2s. Estimated remaining: 6m 22s. Rate: 142.0 symbols/min [2025-09-29T02:19:09.160482] [INFO ] [MAIN ] MQY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:09.177888] [DEBUG] [MAIN ] MPW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:09.178681] [INFO ] [MAIN ] MPW: Generated 1820 derivative records from 54275 primary records. [2025-09-29T02:19:09.180973] [DEBUG] [LOCAL ] MPW: Saving derivative data. [2025-09-29T02:19:09.203937] [DEBUG] [LOCAL ] MQT: Loaded 8523 existing records from primary storage. [2025-09-29T02:19:09.204924] [INFO ] [MAIN ] MQT: Loaded 8523 primary data records. [2025-09-29T02:19:09.254668] [DEBUG] [LOCAL ] MPW: Derivative data saved (1820 records). [2025-09-29T02:19:09.248384] [DEBUG] [LOCAL ] MQY: Loaded 16979 existing records from primary storage. [2025-09-29T02:19:09.262676] [INFO ] [MAIN ] MPW: Successfully saved derivative data. [2025-09-29T02:19:09.268345] [INFO ] [MAIN ] Derivative Progress: 1308/2211 symbols completed. MPW took 1.3s. Estimated remaining: 6m 21s. Rate: 142.1 symbols/min [2025-09-29T02:19:09.273751] [INFO ] [MAIN ] MRC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:09.291473] [INFO ] [MAIN ] MQY: Loaded 16979 primary data records. [2025-09-29T02:19:09.800055] [DEBUG] [LOCAL ] MRC: Loaded 38128 existing records from primary storage. [2025-09-29T02:19:09.916750] [INFO ] [MAIN ] MRC: Loaded 38128 primary data records. [2025-09-29T02:19:10.290179] [DEBUG] [MAIN ] MQT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:10.291365] [INFO ] [MAIN ] MQT: Generated 1820 derivative records from 8523 primary records. [2025-09-29T02:19:10.291969] [DEBUG] [LOCAL ] MQT: Saving derivative data. [2025-09-29T02:19:10.311305] [DEBUG] [LOCAL ] MQT: Derivative data saved (1820 records). [2025-09-29T02:19:10.313886] [INFO ] [MAIN ] MQT: Successfully saved derivative data. [2025-09-29T02:19:10.316454] [INFO ] [MAIN ] Derivative Progress: 1309/2211 symbols completed. MQT took 1.2s. Estimated remaining: 6m 21s. Rate: 141.9 symbols/min [2025-09-29T02:19:10.316803] [INFO ] [MAIN ] MRK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:10.332140] [DEBUG] [MAIN ] MQY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:10.333478] [INFO ] [MAIN ] MQY: Generated 1820 derivative records from 16979 primary records. [2025-09-29T02:19:10.333560] [DEBUG] [LOCAL ] MQY: Saving derivative data. [2025-09-29T02:19:10.354086] [DEBUG] [LOCAL ] MQY: Derivative data saved (1820 records). [2025-09-29T02:19:10.367218] [INFO ] [MAIN ] MQY: Successfully saved derivative data. [2025-09-29T02:19:10.367547] [DEBUG] [MAIN ] MRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:10.373329] [INFO ] [MAIN ] MRC: Generated 1820 derivative records from 38128 primary records. [2025-09-29T02:19:10.371967] [INFO ] [MAIN ] Derivative Progress: 1310/2211 symbols completed. MQY took 1.2s. Estimated remaining: 6m 21s. Rate: 142.0 symbols/min [2025-09-29T02:19:10.374191] [INFO ] [MAIN ] MS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:10.373995] [DEBUG] [LOCAL ] MRC: Saving derivative data. [2025-09-29T02:19:10.395734] [DEBUG] [LOCAL ] MRC: Derivative data saved (1820 records). [2025-09-29T02:19:10.396083] [INFO ] [MAIN ] MRC: Successfully saved derivative data. [2025-09-29T02:19:10.400136] [INFO ] [MAIN ] Derivative Progress: 1311/2211 symbols completed. MRC took 1.1s. Estimated remaining: 6m 20s. Rate: 142.1 symbols/min [2025-09-29T02:19:10.400454] [INFO ] [MAIN ] MSA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:10.440365] [DEBUG] [LOCAL ] MRK: Loaded 54569 existing records from primary storage. [2025-09-29T02:19:10.444493] [INFO ] [MAIN ] MRK: Loaded 54569 primary data records. [2025-09-29T02:19:10.556510] [DEBUG] [LOCAL ] MSA: Loaded 18988 existing records from primary storage. [2025-09-29T02:19:10.597493] [INFO ] [MAIN ] MSA: Loaded 18988 primary data records. [2025-09-29T02:19:10.785612] [DEBUG] [LOCAL ] MS: Loaded 54472 existing records from primary storage. [2025-09-29T02:19:10.951209] [INFO ] [MAIN ] MS: Loaded 54472 primary data records. [2025-09-29T02:19:11.544101] [DEBUG] [MAIN ] MRK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:11.546319] [INFO ] [MAIN ] MRK: Generated 1820 derivative records from 54569 primary records. [2025-09-29T02:19:11.546792] [DEBUG] [LOCAL ] MRK: Saving derivative data. [2025-09-29T02:19:11.570017] [DEBUG] [LOCAL ] MRK: Derivative data saved (1820 records). [2025-09-29T02:19:11.585104] [DEBUG] [MAIN ] MSA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:11.585531] [INFO ] [MAIN ] MRK: Successfully saved derivative data. [2025-09-29T02:19:11.586502] [INFO ] [MAIN ] MSA: Generated 1820 derivative records from 18988 primary records. [2025-09-29T02:19:11.590416] [DEBUG] [LOCAL ] MSA: Saving derivative data. [2025-09-29T02:19:11.589954] [INFO ] [MAIN ] Derivative Progress: 1312/2211 symbols completed. MRK took 1.3s. Estimated remaining: 6m 20s. Rate: 141.9 symbols/min [2025-09-29T02:19:11.591828] [INFO ] [MAIN ] MSB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:11.625247] [DEBUG] [LOCAL ] MSA: Derivative data saved (1820 records). [2025-09-29T02:19:11.630629] [DEBUG] [MAIN ] MS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:11.635317] [DEBUG] [LOCAL ] MSB: Loaded 7895 existing records from primary storage. [2025-09-29T02:19:11.636172] [INFO ] [MAIN ] MS: Generated 1820 derivative records from 54472 primary records. [2025-09-29T02:19:11.636472] [INFO ] [MAIN ] MSB: Loaded 7895 primary data records. [2025-09-29T02:19:11.636560] [DEBUG] [LOCAL ] MS: Saving derivative data. [2025-09-29T02:19:11.634942] [INFO ] [MAIN ] MSA: Successfully saved derivative data. [2025-09-29T02:19:11.686772] [INFO ] [MAIN ] Derivative Progress: 1313/2211 symbols completed. MSA took 1.3s. Estimated remaining: 6m 19s. Rate: 142.0 symbols/min [2025-09-29T02:19:11.739998] [INFO ] [MAIN ] MSCI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:11.814152] [DEBUG] [LOCAL ] MS: Derivative data saved (1820 records). [2025-09-29T02:19:11.860830] [INFO ] [MAIN ] MS: Successfully saved derivative data. [2025-09-29T02:19:11.910505] [INFO ] [MAIN ] Derivative Progress: 1314/2211 symbols completed. MS took 1.5s. Estimated remaining: 6m 19s. Rate: 142.1 symbols/min [2025-09-29T02:19:12.029540] [INFO ] [MAIN ] MSD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:12.072317] [DEBUG] [LOCAL ] MSD: Loaded 15775 existing records from primary storage. [2025-09-29T02:19:12.073882] [DEBUG] [LOCAL ] MSCI: Loaded 35351 existing records from primary storage. [2025-09-29T02:19:12.074157] [INFO ] [MAIN ] MSD: Loaded 15775 primary data records. [2025-09-29T02:19:12.074330] [INFO ] [MAIN ] MSCI: Loaded 35351 primary data records. [2025-09-29T02:19:12.369337] [DEBUG] [MAIN ] MSB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:12.485925] [INFO ] [MAIN ] MSB: Generated 1820 derivative records from 7895 primary records. [2025-09-29T02:19:12.737871] [DEBUG] [LOCAL ] MSB: Saving derivative data. [2025-09-29T02:19:12.759541] [DEBUG] [LOCAL ] MSB: Derivative data saved (1820 records). [2025-09-29T02:19:12.762136] [INFO ] [MAIN ] MSB: Successfully saved derivative data. [2025-09-29T02:19:12.764785] [INFO ] [MAIN ] Derivative Progress: 1315/2211 symbols completed. MSB took 1.2s. Estimated remaining: 6m 19s. Rate: 142.0 symbols/min [2025-09-29T02:19:12.765666] [INFO ] [MAIN ] MSDL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:12.795026] [DEBUG] [MAIN ] MSCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:12.808034] [DEBUG] [MAIN ] MSD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:12.808864] [INFO ] [MAIN ] MSCI: Generated 1820 derivative records from 35351 primary records. [2025-09-29T02:19:12.809593] [INFO ] [MAIN ] MSD: Generated 1820 derivative records from 15775 primary records. [2025-09-29T02:19:12.809675] [DEBUG] [LOCAL ] MSCI: Saving derivative data. [2025-09-29T02:19:12.809791] [DEBUG] [LOCAL ] MSD: Saving derivative data. [2025-09-29T02:19:12.839757] [DEBUG] [LOCAL ] MSCI: Derivative data saved (1820 records). [2025-09-29T02:19:12.850324] [DEBUG] [LOCAL ] MSD: Derivative data saved (1820 records). [2025-09-29T02:19:12.850398] [INFO ] [MAIN ] MSCI: Successfully saved derivative data. [2025-09-29T02:19:12.850524] [INFO ] [MAIN ] MSD: Successfully saved derivative data. [2025-09-29T02:19:12.853758] [INFO ] [MAIN ] Derivative Progress: 1316/2211 symbols completed. MSCI took 1.1s. Estimated remaining: 6m 18s. Rate: 142.0 symbols/min [2025-09-29T02:19:12.857840] [INFO ] [MAIN ] MSGE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:12.857904] [INFO ] [MAIN ] Derivative Progress: 1317/2211 symbols completed. MSD took 0.8s. Estimated remaining: 6m 17s. Rate: 142.1 symbols/min [2025-09-29T02:19:12.858215] [INFO ] [MAIN ] MSGS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:12.875128] [DEBUG] [LOCAL ] MSDL: Loaded 38645 existing records from primary storage. [2025-09-29T02:19:12.875488] [INFO ] [MAIN ] MSDL: Loaded 38645 primary data records. [2025-09-29T02:19:13.009413] [DEBUG] [LOCAL ] MSGS: Loaded 17318 existing records from primary storage. [2025-09-29T02:19:13.030790] [INFO ] [MAIN ] MSGS: Loaded 17318 primary data records. [2025-09-29T02:19:13.115598] [DEBUG] [LOCAL ] MSGE: Loaded 27513 existing records from primary storage. [2025-09-29T02:19:13.195053] [INFO ] [MAIN ] MSGE: Loaded 27513 primary data records. [2025-09-29T02:19:13.987066] [DEBUG] [MAIN ] MSDL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:13.988074] [INFO ] [MAIN ] MSDL: Generated 1820 derivative records from 38645 primary records. [2025-09-29T02:19:13.988201] [DEBUG] [LOCAL ] MSDL: Saving derivative data. [2025-09-29T02:19:14.009317] [DEBUG] [LOCAL ] MSDL: Derivative data saved (1820 records). [2025-09-29T02:19:14.012795] [INFO ] [MAIN ] MSDL: Successfully saved derivative data. [2025-09-29T02:19:14.015512] [INFO ] [MAIN ] Derivative Progress: 1318/2211 symbols completed. MSDL took 1.2s. Estimated remaining: 6m 17s. Rate: 142.0 symbols/min [2025-09-29T02:19:14.029800] [DEBUG] [MAIN ] MSGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:14.030669] [INFO ] [MAIN ] MSGS: Generated 1820 derivative records from 17318 primary records. [2025-09-29T02:19:14.030870] [DEBUG] [LOCAL ] MSGS: Saving derivative data. [2025-09-29T02:19:14.050342] [DEBUG] [LOCAL ] MSGS: Derivative data saved (1820 records). [2025-09-29T02:19:14.063422] [INFO ] [MAIN ] MSGS: Successfully saved derivative data. [2025-09-29T02:19:14.063816] [DEBUG] [MAIN ] MSGE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:14.067968] [INFO ] [MAIN ] Derivative Progress: 1319/2211 symbols completed. MSGS took 1.2s. Estimated remaining: 6m 17s. Rate: 142.1 symbols/min [2025-09-29T02:19:14.064575] [INFO ] [MAIN ] MSGE: Generated 1820 derivative records from 27513 primary records. [2025-09-29T02:19:14.068177] [DEBUG] [LOCAL ] MSGE: Saving derivative data. [2025-09-29T02:19:14.084380] [DEBUG] [LOCAL ] MSGE: Derivative data saved (1820 records). [2025-09-29T02:19:14.084493] [INFO ] [MAIN ] MSGE: Successfully saved derivative data. [2025-09-29T02:19:14.087516] [INFO ] [MAIN ] Derivative Progress: 1320/2211 symbols completed. MSGE took 1.2s. Estimated remaining: 6m 16s. Rate: 142.2 symbols/min [2025-09-29T02:19:14.087982] [INFO ] [MAIN ] MSI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:14.088057] [INFO ] [MAIN ] MT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:14.088122] [INFO ] [MAIN ] MSM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:14.175241] [DEBUG] [LOCAL ] MSM: Loaded 36004 existing records from primary storage. [2025-09-29T02:19:14.175745] [INFO ] [MAIN ] MSM: Loaded 36004 primary data records. [2025-09-29T02:19:14.191583] [DEBUG] [LOCAL ] MT: Loaded 51417 existing records from primary storage. [2025-09-29T02:19:14.256079] [INFO ] [MAIN ] MT: Loaded 51417 primary data records. [2025-09-29T02:19:14.273015] [DEBUG] [LOCAL ] MSI: Loaded 41128 existing records from primary storage. [2025-09-29T02:19:14.300486] [INFO ] [MAIN ] MSI: Loaded 41128 primary data records. [2025-09-29T02:19:15.214239] [DEBUG] [MAIN ] MSM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:15.216225] [INFO ] [MAIN ] MSM: Generated 1820 derivative records from 36004 primary records. [2025-09-29T02:19:15.218230] [DEBUG] [LOCAL ] MSM: Saving derivative data. [2025-09-29T02:19:15.244669] [DEBUG] [MAIN ] MSI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:15.247996] [INFO ] [MAIN ] MSI: Generated 1820 derivative records from 41128 primary records. [2025-09-29T02:19:15.249110] [DEBUG] [LOCAL ] MSI: Saving derivative data. [2025-09-29T02:19:15.250724] [DEBUG] [LOCAL ] MSM: Derivative data saved (1820 records). [2025-09-29T02:19:15.251051] [INFO ] [MAIN ] MSM: Successfully saved derivative data. [2025-09-29T02:19:15.253579] [INFO ] [MAIN ] Derivative Progress: 1321/2211 symbols completed. MSM took 1.2s. Estimated remaining: 6m 16s. Rate: 142.0 symbols/min [2025-09-29T02:19:15.265414] [INFO ] [MAIN ] MTAL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:15.286715] [DEBUG] [LOCAL ] MSI: Derivative data saved (1820 records). [2025-09-29T02:19:15.287258] [INFO ] [MAIN ] MSI: Successfully saved derivative data. [2025-09-29T02:19:15.290907] [DEBUG] [MAIN ] MT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:15.290461] [INFO ] [MAIN ] Derivative Progress: 1322/2211 symbols completed. MSI took 1.2s. Estimated remaining: 6m 15s. Rate: 142.1 symbols/min [2025-09-29T02:19:15.292036] [INFO ] [MAIN ] MTB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:15.291903] [INFO ] [MAIN ] MT: Generated 1820 derivative records from 51417 primary records. [2025-09-29T02:19:15.292354] [DEBUG] [LOCAL ] MT: Saving derivative data. [2025-09-29T02:19:15.314183] [DEBUG] [LOCAL ] MT: Derivative data saved (1820 records). [2025-09-29T02:19:15.314385] [INFO ] [MAIN ] MT: Successfully saved derivative data. [2025-09-29T02:19:15.318040] [INFO ] [MAIN ] Derivative Progress: 1323/2211 symbols completed. MT took 1.2s. Estimated remaining: 6m 15s. Rate: 142.2 symbols/min [2025-09-29T02:19:15.318355] [INFO ] [MAIN ] MTD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:15.360452] [DEBUG] [LOCAL ] MTD: Loaded 15342 existing records from primary storage. [2025-09-29T02:19:15.361887] [INFO ] [MAIN ] MTD: Loaded 15342 primary data records. [2025-09-29T02:19:15.362106] [DEBUG] [LOCAL ] MTAL: Loaded 37002 existing records from primary storage. [2025-09-29T02:19:15.385508] [INFO ] [MAIN ] MTAL: Loaded 37002 primary data records. [2025-09-29T02:19:15.652871] [DEBUG] [LOCAL ] MTB: Loaded 47562 existing records from primary storage. [2025-09-29T02:19:15.724748] [INFO ] [MAIN ] MTB: Loaded 47562 primary data records. [2025-09-29T02:19:16.473773] [DEBUG] [MAIN ] MTD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:16.474748] [INFO ] [MAIN ] MTD: Generated 1820 derivative records from 15342 primary records. [2025-09-29T02:19:16.476238] [DEBUG] [LOCAL ] MTD: Saving derivative data. [2025-09-29T02:19:16.509256] [DEBUG] [LOCAL ] MTD: Derivative data saved (1820 records). [2025-09-29T02:19:16.510270] [DEBUG] [MAIN ] MTAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:16.511462] [INFO ] [MAIN ] MTAL: Generated 1820 derivative records from 37002 primary records. [2025-09-29T02:19:16.510616] [INFO ] [MAIN ] MTD: Successfully saved derivative data. [2025-09-29T02:19:16.514189] [DEBUG] [LOCAL ] MTAL: Saving derivative data. [2025-09-29T02:19:16.513930] [INFO ] [MAIN ] Derivative Progress: 1324/2211 symbols completed. MTD took 1.2s. Estimated remaining: 6m 15s. Rate: 142.0 symbols/min [2025-09-29T02:19:16.524274] [INFO ] [MAIN ] MTDR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:16.535547] [DEBUG] [LOCAL ] MTAL: Derivative data saved (1820 records). [2025-09-29T02:19:16.536053] [INFO ] [MAIN ] MTAL: Successfully saved derivative data. [2025-09-29T02:19:16.539333] [INFO ] [MAIN ] Derivative Progress: 1325/2211 symbols completed. MTAL took 1.3s. Estimated remaining: 6m 14s. Rate: 142.1 symbols/min [2025-09-29T02:19:16.539756] [INFO ] [MAIN ] MTG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:16.559034] [DEBUG] [MAIN ] MTB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:16.559919] [INFO ] [MAIN ] MTB: Generated 1820 derivative records from 47562 primary records. [2025-09-29T02:19:16.560118] [DEBUG] [LOCAL ] MTB: Saving derivative data. [2025-09-29T02:19:16.577155] [DEBUG] [LOCAL ] MTB: Derivative data saved (1820 records). [2025-09-29T02:19:16.577668] [INFO ] [MAIN ] MTB: Successfully saved derivative data. [2025-09-29T02:19:16.581133] [INFO ] [MAIN ] Derivative Progress: 1326/2211 symbols completed. MTB took 1.3s. Estimated remaining: 6m 14s. Rate: 142.2 symbols/min [2025-09-29T02:19:16.581518] [INFO ] [MAIN ] MTH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:16.654154] [DEBUG] [LOCAL ] MTDR: Loaded 52316 existing records from primary storage. [2025-09-29T02:19:16.668831] [INFO ] [MAIN ] MTDR: Loaded 52316 primary data records. [2025-09-29T02:19:16.693299] [DEBUG] [LOCAL ] MTG: Loaded 52091 existing records from primary storage. [2025-09-29T02:19:16.733300] [INFO ] [MAIN ] MTG: Loaded 52091 primary data records. [2025-09-29T02:19:16.842415] [DEBUG] [LOCAL ] MTH: Loaded 44547 existing records from primary storage. [2025-09-29T02:19:16.913050] [INFO ] [MAIN ] MTH: Loaded 44547 primary data records. [2025-09-29T02:19:17.729190] [DEBUG] [MAIN ] MTDR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:17.732232] [INFO ] [MAIN ] MTDR: Generated 1820 derivative records from 52316 primary records. [2025-09-29T02:19:17.732503] [DEBUG] [LOCAL ] MTDR: Saving derivative data. [2025-09-29T02:19:17.757919] [DEBUG] [MAIN ] MTG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:17.762280] [INFO ] [MAIN ] MTG: Generated 1820 derivative records from 52091 primary records. [2025-09-29T02:19:17.762813] [DEBUG] [LOCAL ] MTG: Saving derivative data. [2025-09-29T02:19:17.783370] [DEBUG] [LOCAL ] MTDR: Derivative data saved (1820 records). [2025-09-29T02:19:17.785378] [INFO ] [MAIN ] MTDR: Successfully saved derivative data. [2025-09-29T02:19:17.789109] [INFO ] [MAIN ] Derivative Progress: 1327/2211 symbols completed. MTDR took 1.3s. Estimated remaining: 6m 14s. Rate: 142.0 symbols/min [2025-09-29T02:19:17.789293] [INFO ] [MAIN ] MTN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:17.791446] [DEBUG] [LOCAL ] MTG: Derivative data saved (1820 records). [2025-09-29T02:19:17.791572] [INFO ] [MAIN ] MTG: Successfully saved derivative data. [2025-09-29T02:19:17.795209] [INFO ] [MAIN ] Derivative Progress: 1328/2211 symbols completed. MTG took 1.3s. Estimated remaining: 6m 13s. Rate: 142.1 symbols/min [2025-09-29T02:19:17.796278] [INFO ] [MAIN ] MTRN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:17.810513] [DEBUG] [MAIN ] MTH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:17.811254] [INFO ] [MAIN ] MTH: Generated 1820 derivative records from 44547 primary records. [2025-09-29T02:19:17.811587] [DEBUG] [LOCAL ] MTH: Saving derivative data. [2025-09-29T02:19:17.830253] [DEBUG] [LOCAL ] MTH: Derivative data saved (1820 records). [2025-09-29T02:19:17.830408] [INFO ] [MAIN ] MTH: Successfully saved derivative data. [2025-09-29T02:19:17.832967] [INFO ] [MAIN ] Derivative Progress: 1329/2211 symbols completed. MTH took 1.3s. Estimated remaining: 6m 12s. Rate: 142.2 symbols/min [2025-09-29T02:19:17.833322] [INFO ] [MAIN ] MTUS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:17.849896] [DEBUG] [LOCAL ] MTRN: Loaded 18303 existing records from primary storage. [2025-09-29T02:19:17.850206] [INFO ] [MAIN ] MTRN: Loaded 18303 primary data records. [2025-09-29T02:19:18.053445] [DEBUG] [LOCAL ] MTN: Loaded 39607 existing records from primary storage. [2025-09-29T02:19:18.072733] [DEBUG] [LOCAL ] MTUS: Loaded 28984 existing records from primary storage. [2025-09-29T02:19:18.072814] [INFO ] [MAIN ] MTN: Loaded 39607 primary data records. [2025-09-29T02:19:18.097594] [INFO ] [MAIN ] MTUS: Loaded 28984 primary data records. [2025-09-29T02:19:18.972890] [DEBUG] [MAIN ] MTRN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:18.974303] [INFO ] [MAIN ] MTRN: Generated 1820 derivative records from 18303 primary records. [2025-09-29T02:19:18.975786] [DEBUG] [LOCAL ] MTRN: Saving derivative data. [2025-09-29T02:19:18.997007] [DEBUG] [LOCAL ] MTRN: Derivative data saved (1820 records). [2025-09-29T02:19:18.998019] [INFO ] [MAIN ] MTRN: Successfully saved derivative data. [2025-09-29T02:19:19.000670] [INFO ] [MAIN ] Derivative Progress: 1330/2211 symbols completed. MTRN took 1.2s. Estimated remaining: 6m 12s. Rate: 142.0 symbols/min [2025-09-29T02:19:19.001256] [INFO ] [MAIN ] MTW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:19.042079] [DEBUG] [MAIN ] MTN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:19.043359] [DEBUG] [MAIN ] MTUS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:19.046217] [INFO ] [MAIN ] MTUS: Generated 1820 derivative records from 28984 primary records. [2025-09-29T02:19:19.046363] [DEBUG] [LOCAL ] MTUS: Saving derivative data. [2025-09-29T02:19:19.045273] [INFO ] [MAIN ] MTN: Generated 1820 derivative records from 39607 primary records. [2025-09-29T02:19:19.047272] [DEBUG] [LOCAL ] MTN: Saving derivative data. [2025-09-29T02:19:19.093310] [DEBUG] [LOCAL ] MTN: Derivative data saved (1820 records). [2025-09-29T02:19:19.095883] [INFO ] [MAIN ] MTN: Successfully saved derivative data. [2025-09-29T02:19:19.100161] [INFO ] [MAIN ] Derivative Progress: 1331/2211 symbols completed. MTN took 1.3s. Estimated remaining: 6m 12s. Rate: 142.1 symbols/min [2025-09-29T02:19:19.101844] [DEBUG] [LOCAL ] MTUS: Derivative data saved (1820 records). [2025-09-29T02:19:19.110874] [INFO ] [MAIN ] MTX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:19.111899] [DEBUG] [LOCAL ] MTW: Loaded 26888 existing records from primary storage. [2025-09-29T02:19:19.111097] [INFO ] [MAIN ] MTUS: Successfully saved derivative data. [2025-09-29T02:19:19.116534] [INFO ] [MAIN ] MTW: Loaded 26888 primary data records. [2025-09-29T02:19:19.116409] [INFO ] [MAIN ] Derivative Progress: 1332/2211 symbols completed. MTUS took 1.3s. Estimated remaining: 6m 11s. Rate: 142.2 symbols/min [2025-09-29T02:19:19.122607] [INFO ] [MAIN ] MTZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:19.312789] [DEBUG] [LOCAL ] MTX: Loaded 23150 existing records from primary storage. [2025-09-29T02:19:19.348221] [INFO ] [MAIN ] MTX: Loaded 23150 primary data records. [2025-09-29T02:19:19.679043] [DEBUG] [LOCAL ] MTZ: Loaded 43922 existing records from primary storage. [2025-09-29T02:19:19.710686] [INFO ] [MAIN ] MTZ: Loaded 43922 primary data records. [2025-09-29T02:19:20.172623] [DEBUG] [MAIN ] MTW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:20.188456] [INFO ] [MAIN ] MTW: Generated 1820 derivative records from 26888 primary records. [2025-09-29T02:19:20.189012] [DEBUG] [LOCAL ] MTW: Saving derivative data. [2025-09-29T02:19:20.211513] [DEBUG] [LOCAL ] MTW: Derivative data saved (1820 records). [2025-09-29T02:19:20.213538] [INFO ] [MAIN ] MTW: Successfully saved derivative data. [2025-09-29T02:19:20.225577] [INFO ] [MAIN ] Derivative Progress: 1333/2211 symbols completed. MTW took 1.2s. Estimated remaining: 6m 11s. Rate: 142.0 symbols/min [2025-09-29T02:19:20.232493] [DEBUG] [MAIN ] MTX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:20.233754] [INFO ] [MAIN ] MTX: Generated 1820 derivative records from 23150 primary records. [2025-09-29T02:19:20.233855] [DEBUG] [LOCAL ] MTX: Saving derivative data. [2025-09-29T02:19:20.252004] [DEBUG] [LOCAL ] MTX: Derivative data saved (1820 records). [2025-09-29T02:19:20.252147] [INFO ] [MAIN ] MTX: Successfully saved derivative data. [2025-09-29T02:19:20.255107] [INFO ] [MAIN ] Derivative Progress: 1334/2211 symbols completed. MTX took 1.1s. Estimated remaining: 6m 10s. Rate: 142.1 symbols/min [2025-09-29T02:19:20.272782] [DEBUG] [MAIN ] MTZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:20.273521] [INFO ] [MAIN ] MTZ: Generated 1820 derivative records from 43922 primary records. [2025-09-29T02:19:20.273616] [DEBUG] [LOCAL ] MTZ: Saving derivative data. [2025-09-29T02:19:20.290678] [DEBUG] [LOCAL ] MTZ: Derivative data saved (1820 records). [2025-09-29T02:19:20.290782] [INFO ] [MAIN ] MTZ: Successfully saved derivative data. [2025-09-29T02:19:20.294080] [INFO ] [MAIN ] Derivative Progress: 1335/2211 symbols completed. MTZ took 1.2s. Estimated remaining: 6m 10s. Rate: 142.2 symbols/min [2025-09-29T02:19:20.294687] [INFO ] [MAIN ] MUA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:20.294976] [INFO ] [MAIN ] MUE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:20.294803] [INFO ] [MAIN ] MUC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:20.326069] [DEBUG] [LOCAL ] MUE: Loaded 12092 existing records from primary storage. [2025-09-29T02:19:20.333260] [INFO ] [MAIN ] MUE: Loaded 12092 primary data records. [2025-09-29T02:19:20.346440] [DEBUG] [LOCAL ] MUA: Loaded 12391 existing records from primary storage. [2025-09-29T02:19:20.376416] [INFO ] [MAIN ] MUA: Loaded 12391 primary data records. [2025-09-29T02:19:20.408536] [DEBUG] [LOCAL ] MUC: Loaded 20721 existing records from primary storage. [2025-09-29T02:19:20.408718] [INFO ] [MAIN ] MUC: Loaded 20721 primary data records. [2025-09-29T02:19:21.442296] [DEBUG] [MAIN ] MUC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:21.469226] [DEBUG] [MAIN ] MUA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:21.470618] [INFO ] [MAIN ] MUC: Generated 1820 derivative records from 20721 primary records. [2025-09-29T02:19:21.471024] [DEBUG] [MAIN ] MUE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:21.472204] [INFO ] [MAIN ] MUA: Generated 1820 derivative records from 12391 primary records. [2025-09-29T02:19:21.473380] [INFO ] [MAIN ] MUE: Generated 1820 derivative records from 12092 primary records. [2025-09-29T02:19:21.472395] [DEBUG] [LOCAL ] MUC: Saving derivative data. [2025-09-29T02:19:21.473894] [DEBUG] [LOCAL ] MUE: Saving derivative data. [2025-09-29T02:19:21.473582] [DEBUG] [LOCAL ] MUA: Saving derivative data. [2025-09-29T02:19:21.509159] [DEBUG] [LOCAL ] MUC: Derivative data saved (1820 records). [2025-09-29T02:19:21.516590] [INFO ] [MAIN ] MUC: Successfully saved derivative data. [2025-09-29T02:19:21.525039] [DEBUG] [LOCAL ] MUE: Derivative data saved (1820 records). [2025-09-29T02:19:21.528567] [INFO ] [MAIN ] Derivative Progress: 1336/2211 symbols completed. MUC took 1.2s. Estimated remaining: 6m 10s. Rate: 142.0 symbols/min [2025-09-29T02:19:21.530480] [INFO ] [MAIN ] MUFG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:21.530218] [INFO ] [MAIN ] MUE: Successfully saved derivative data. [2025-09-29T02:19:21.534815] [INFO ] [MAIN ] Derivative Progress: 1337/2211 symbols completed. MUE took 1.2s. Estimated remaining: 6m 9s. Rate: 142.1 symbols/min [2025-09-29T02:19:21.529869] [DEBUG] [LOCAL ] MUA: Derivative data saved (1820 records). [2025-09-29T02:19:21.535166] [INFO ] [MAIN ] MUJ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:21.535829] [INFO ] [MAIN ] MUA: Successfully saved derivative data. [2025-09-29T02:19:21.539896] [INFO ] [MAIN ] Derivative Progress: 1338/2211 symbols completed. MUA took 1.2s. Estimated remaining: 6m 8s. Rate: 142.2 symbols/min [2025-09-29T02:19:21.540262] [INFO ] [MAIN ] MUR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:21.561295] [DEBUG] [LOCAL ] MUJ: Loaded 13473 existing records from primary storage. [2025-09-29T02:19:21.561678] [INFO ] [MAIN ] MUJ: Loaded 13473 primary data records. [2025-09-29T02:19:21.947500] [DEBUG] [LOCAL ] MUR: Loaded 53705 existing records from primary storage. [2025-09-29T02:19:21.948569] [INFO ] [MAIN ] MUR: Loaded 53705 primary data records. [2025-09-29T02:19:21.974831] [DEBUG] [LOCAL ] MUFG: Loaded 53341 existing records from primary storage. [2025-09-29T02:19:21.975185] [INFO ] [MAIN ] MUFG: Loaded 53341 primary data records. [2025-09-29T02:19:22.696032] [DEBUG] [MAIN ] MUJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:22.699474] [INFO ] [MAIN ] MUJ: Generated 1820 derivative records from 13473 primary records. [2025-09-29T02:19:22.699688] [DEBUG] [LOCAL ] MUJ: Saving derivative data. [2025-09-29T02:19:22.729148] [DEBUG] [LOCAL ] MUJ: Derivative data saved (1820 records). [2025-09-29T02:19:22.730105] [INFO ] [MAIN ] MUJ: Successfully saved derivative data. [2025-09-29T02:19:22.734243] [INFO ] [MAIN ] Derivative Progress: 1339/2211 symbols completed. MUJ took 1.2s. Estimated remaining: 6m 8s. Rate: 142.0 symbols/min [2025-09-29T02:19:22.734721] [INFO ] [MAIN ] MUSA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:22.756089] [DEBUG] [MAIN ] MUR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:22.757206] [INFO ] [MAIN ] MUR: Generated 1820 derivative records from 53705 primary records. [2025-09-29T02:19:22.765901] [DEBUG] [LOCAL ] MUR: Saving derivative data. [2025-09-29T02:19:22.772811] [DEBUG] [MAIN ] MUFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:22.775122] [INFO ] [MAIN ] MUFG: Generated 1820 derivative records from 53341 primary records. [2025-09-29T02:19:22.787945] [DEBUG] [LOCAL ] MUFG: Saving derivative data. [2025-09-29T02:19:22.800287] [DEBUG] [LOCAL ] MUR: Derivative data saved (1820 records). [2025-09-29T02:19:22.800796] [INFO ] [MAIN ] MUR: Successfully saved derivative data. [2025-09-29T02:19:22.804103] [INFO ] [MAIN ] Derivative Progress: 1340/2211 symbols completed. MUR took 1.3s. Estimated remaining: 6m 8s. Rate: 142.1 symbols/min [2025-09-29T02:19:22.818958] [INFO ] [MAIN ] MUX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:22.831282] [DEBUG] [LOCAL ] MUSA: Loaded 25221 existing records from primary storage. [2025-09-29T02:19:22.830100] [DEBUG] [LOCAL ] MUFG: Derivative data saved (1820 records). [2025-09-29T02:19:22.831612] [INFO ] [MAIN ] MUSA: Loaded 25221 primary data records. [2025-09-29T02:19:22.831853] [INFO ] [MAIN ] MUFG: Successfully saved derivative data. [2025-09-29T02:19:22.841355] [INFO ] [MAIN ] Derivative Progress: 1341/2211 symbols completed. MUFG took 1.3s. Estimated remaining: 6m 7s. Rate: 142.2 symbols/min [2025-09-29T02:19:22.849188] [INFO ] [MAIN ] MVF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:22.983044] [DEBUG] [LOCAL ] MVF: Loaded 12921 existing records from primary storage. [2025-09-29T02:19:23.010478] [INFO ] [MAIN ] MVF: Loaded 12921 primary data records. [2025-09-29T02:19:23.322054] [DEBUG] [LOCAL ] MUX: Loaded 43253 existing records from primary storage. [2025-09-29T02:19:23.328554] [INFO ] [MAIN ] MUX: Loaded 43253 primary data records. [2025-09-29T02:19:23.903916] [DEBUG] [MAIN ] MUSA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:23.905411] [INFO ] [MAIN ] MUSA: Generated 1820 derivative records from 25221 primary records. [2025-09-29T02:19:23.905748] [DEBUG] [LOCAL ] MUSA: Saving derivative data. [2025-09-29T02:19:23.931225] [DEBUG] [LOCAL ] MUSA: Derivative data saved (1820 records). [2025-09-29T02:19:23.945818] [INFO ] [MAIN ] MUSA: Successfully saved derivative data. [2025-09-29T02:19:23.945757] [DEBUG] [MAIN ] MVF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:23.948880] [INFO ] [MAIN ] Derivative Progress: 1342/2211 symbols completed. MUSA took 1.2s. Estimated remaining: 6m 7s. Rate: 142.0 symbols/min [2025-09-29T02:19:23.950102] [INFO ] [MAIN ] MVF: Generated 1820 derivative records from 12921 primary records. [2025-09-29T02:19:23.950464] [DEBUG] [LOCAL ] MVF: Saving derivative data. [2025-09-29T02:19:23.950354] [INFO ] [MAIN ] MVO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:23.975265] [DEBUG] [LOCAL ] MVF: Derivative data saved (1820 records). [2025-09-29T02:19:23.975694] [INFO ] [MAIN ] MVF: Successfully saved derivative data. [2025-09-29T02:19:23.992670] [INFO ] [MAIN ] Derivative Progress: 1343/2211 symbols completed. MVF took 1.1s. Estimated remaining: 6m 6s. Rate: 142.1 symbols/min [2025-09-29T02:19:23.997371] [DEBUG] [MAIN ] MUX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:23.997636] [INFO ] [MAIN ] MVT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:23.999639] [DEBUG] [LOCAL ] MVO: Loaded 9140 existing records from primary storage. [2025-09-29T02:19:23.998893] [INFO ] [MAIN ] MUX: Generated 1820 derivative records from 43253 primary records. [2025-09-29T02:19:24.000045] [INFO ] [MAIN ] MVO: Loaded 9140 primary data records. [2025-09-29T02:19:24.000363] [DEBUG] [LOCAL ] MUX: Saving derivative data. [2025-09-29T02:19:24.140669] [DEBUG] [LOCAL ] MUX: Derivative data saved (1820 records). [2025-09-29T02:19:24.139532] [DEBUG] [LOCAL ] MVT: Loaded 10355 existing records from primary storage. [2025-09-29T02:19:24.141638] [INFO ] [MAIN ] MUX: Successfully saved derivative data. [2025-09-29T02:19:24.141172] [INFO ] [MAIN ] MVT: Loaded 10355 primary data records. [2025-09-29T02:19:24.161256] [INFO ] [MAIN ] Derivative Progress: 1344/2211 symbols completed. MUX took 1.3s. Estimated remaining: 6m 6s. Rate: 142.2 symbols/min [2025-09-29T02:19:24.242873] [INFO ] [MAIN ] MWA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:24.769139] [DEBUG] [MAIN ] MVO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:24.786307] [INFO ] [MAIN ] MVO: Generated 1820 derivative records from 9140 primary records. [2025-09-29T02:19:24.787390] [DEBUG] [LOCAL ] MVO: Saving derivative data. [2025-09-29T02:19:24.790567] [DEBUG] [LOCAL ] MWA: Loaded 47633 existing records from primary storage. [2025-09-29T02:19:24.803259] [INFO ] [MAIN ] MWA: Loaded 47633 primary data records. [2025-09-29T02:19:24.844414] [DEBUG] [LOCAL ] MVO: Derivative data saved (1820 records). [2025-09-29T02:19:24.881273] [INFO ] [MAIN ] MVO: Successfully saved derivative data. [2025-09-29T02:19:24.897740] [INFO ] [MAIN ] Derivative Progress: 1345/2211 symbols completed. MVO took 0.9s. Estimated remaining: 6m 6s. Rate: 142.1 symbols/min [2025-09-29T02:19:24.924677] [INFO ] [MAIN ] MX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:25.162009] [DEBUG] [MAIN ] MVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:25.162943] [INFO ] [MAIN ] MVT: Generated 1820 derivative records from 10355 primary records. [2025-09-29T02:19:25.163239] [DEBUG] [LOCAL ] MVT: Saving derivative data. [2025-09-29T02:19:25.190940] [DEBUG] [LOCAL ] MVT: Derivative data saved (1820 records). [2025-09-29T02:19:25.190476] [DEBUG] [LOCAL ] MX: Loaded 23379 existing records from primary storage. [2025-09-29T02:19:25.192184] [INFO ] [MAIN ] MVT: Successfully saved derivative data. [2025-09-29T02:19:25.192061] [INFO ] [MAIN ] MX: Loaded 23379 primary data records. [2025-09-29T02:19:25.195315] [INFO ] [MAIN ] Derivative Progress: 1346/2211 symbols completed. MVT took 1.2s. Estimated remaining: 6m 5s. Rate: 142.1 symbols/min [2025-09-29T02:19:25.195676] [INFO ] [MAIN ] MXF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:25.317724] [DEBUG] [LOCAL ] MXF: Loaded 5984 existing records from primary storage. [2025-09-29T02:19:25.318501] [INFO ] [MAIN ] MXF: Loaded 5984 primary data records. [2025-09-29T02:19:25.736842] [DEBUG] [MAIN ] MWA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:25.760628] [INFO ] [MAIN ] MWA: Generated 1820 derivative records from 47633 primary records. [2025-09-29T02:19:25.765043] [DEBUG] [LOCAL ] MWA: Saving derivative data. [2025-09-29T02:19:25.916912] [DEBUG] [LOCAL ] MWA: Derivative data saved (1820 records). [2025-09-29T02:19:25.917319] [INFO ] [MAIN ] MWA: Successfully saved derivative data. [2025-09-29T02:19:25.919894] [INFO ] [MAIN ] Derivative Progress: 1347/2211 symbols completed. MWA took 1.7s. Estimated remaining: 6m 5s. Rate: 142.0 symbols/min [2025-09-29T02:19:25.920402] [INFO ] [MAIN ] MYD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:25.940144] [DEBUG] [MAIN ] MX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:25.941493] [INFO ] [MAIN ] MX: Generated 1820 derivative records from 23379 primary records. [2025-09-29T02:19:25.941779] [DEBUG] [LOCAL ] MX: Saving derivative data. [2025-09-29T02:19:25.970526] [DEBUG] [LOCAL ] MX: Derivative data saved (1820 records). [2025-09-29T02:19:25.973603] [DEBUG] [LOCAL ] MYD: Loaded 13946 existing records from primary storage. [2025-09-29T02:19:25.973930] [INFO ] [MAIN ] MX: Successfully saved derivative data. [2025-09-29T02:19:25.979462] [INFO ] [MAIN ] Derivative Progress: 1348/2211 symbols completed. MX took 1.1s. Estimated remaining: 6m 4s. Rate: 142.1 symbols/min [2025-09-29T02:19:25.979768] [INFO ] [MAIN ] MYD: Loaded 13946 primary data records. [2025-09-29T02:19:26.056568] [DEBUG] [MAIN ] MXF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:26.086999] [INFO ] [MAIN ] MXF: Generated 1820 derivative records from 5984 primary records. [2025-09-29T02:19:26.119980] [DEBUG] [LOCAL ] MXF: Saving derivative data. [2025-09-29T02:19:26.192019] [DEBUG] [LOCAL ] MXF: Derivative data saved (1820 records). [2025-09-29T02:19:26.202551] [INFO ] [MAIN ] MXF: Successfully saved derivative data. [2025-09-29T02:19:26.205430] [INFO ] [MAIN ] Derivative Progress: 1349/2211 symbols completed. MXF took 1.0s. Estimated remaining: 6m 4s. Rate: 142.2 symbols/min [2025-09-29T02:19:26.379425] [DEBUG] [MAIN ] MYD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:26.380198] [INFO ] [MAIN ] MYD: Generated 1820 derivative records from 13946 primary records. [2025-09-29T02:19:26.380286] [DEBUG] [LOCAL ] MYD: Saving derivative data. [2025-09-29T02:19:26.396123] [DEBUG] [LOCAL ] MYD: Derivative data saved (1820 records). [2025-09-29T02:19:26.396220] [INFO ] [MAIN ] MYD: Successfully saved derivative data. [2025-09-29T02:19:26.398815] [INFO ] [MAIN ] Derivative Progress: 1350/2211 symbols completed. MYD took 0.5s. Estimated remaining: 6m 3s. Rate: 142.2 symbols/min [2025-09-29T02:19:26.399469] [INFO ] [MAIN ] MYE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:26.399713] [INFO ] [MAIN ] MYI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:26.400134] [INFO ] [MAIN ] MYN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:26.424492] [DEBUG] [LOCAL ] MYN: Loaded 10324 existing records from primary storage. [2025-09-29T02:19:26.424864] [INFO ] [MAIN ] MYN: Loaded 10324 primary data records. [2025-09-29T02:19:26.463921] [DEBUG] [LOCAL ] MYI: Loaded 19636 existing records from primary storage. [2025-09-29T02:19:26.501824] [INFO ] [MAIN ] MYI: Loaded 19636 primary data records. [2025-09-29T02:19:26.568985] [DEBUG] [LOCAL ] MYE: Loaded 25346 existing records from primary storage. [2025-09-29T02:19:26.599979] [INFO ] [MAIN ] MYE: Loaded 25346 primary data records. [2025-09-29T02:19:27.505423] [DEBUG] [MAIN ] MYN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:27.507634] [INFO ] [MAIN ] MYN: Generated 1820 derivative records from 10324 primary records. [2025-09-29T02:19:27.508429] [DEBUG] [LOCAL ] MYN: Saving derivative data. [2025-09-29T02:19:27.539098] [DEBUG] [MAIN ] MYI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:27.541623] [INFO ] [MAIN ] MYI: Generated 1820 derivative records from 19636 primary records. [2025-09-29T02:19:27.544075] [DEBUG] [LOCAL ] MYI: Saving derivative data. [2025-09-29T02:19:27.548371] [DEBUG] [LOCAL ] MYN: Derivative data saved (1820 records). [2025-09-29T02:19:27.549106] [INFO ] [MAIN ] MYN: Successfully saved derivative data. [2025-09-29T02:19:27.560544] [INFO ] [MAIN ] Derivative Progress: 1351/2211 symbols completed. MYN took 1.2s. Estimated remaining: 6m 3s. Rate: 142.1 symbols/min [2025-09-29T02:19:27.584305] [INFO ] [MAIN ] NABL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:27.587257] [DEBUG] [MAIN ] MYE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:27.591185] [INFO ] [MAIN ] MYE: Generated 1820 derivative records from 25346 primary records. [2025-09-29T02:19:27.593083] [DEBUG] [LOCAL ] MYI: Derivative data saved (1820 records). [2025-09-29T02:19:27.593374] [DEBUG] [LOCAL ] MYE: Saving derivative data. [2025-09-29T02:19:27.594077] [INFO ] [MAIN ] MYI: Successfully saved derivative data. [2025-09-29T02:19:27.598528] [INFO ] [MAIN ] Derivative Progress: 1352/2211 symbols completed. MYI took 1.2s. Estimated remaining: 6m 3s. Rate: 142.2 symbols/min [2025-09-29T02:19:27.599707] [INFO ] [MAIN ] NAC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:27.625885] [DEBUG] [LOCAL ] MYE: Derivative data saved (1820 records). [2025-09-29T02:19:27.626255] [INFO ] [MAIN ] MYE: Successfully saved derivative data. [2025-09-29T02:19:27.630592] [INFO ] [MAIN ] Derivative Progress: 1353/2211 symbols completed. MYE took 1.2s. Estimated remaining: 6m 2s. Rate: 142.2 symbols/min [2025-09-29T02:19:27.631052] [INFO ] [MAIN ] NAD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:27.674992] [DEBUG] [LOCAL ] NAC: Loaded 25076 existing records from primary storage. [2025-09-29T02:19:27.687829] [INFO ] [MAIN ] NAC: Loaded 25076 primary data records. [2025-09-29T02:19:27.733461] [DEBUG] [LOCAL ] NABL: Loaded 40294 existing records from primary storage. [2025-09-29T02:19:27.812506] [INFO ] [MAIN ] NABL: Loaded 40294 primary data records. [2025-09-29T02:19:27.834267] [DEBUG] [LOCAL ] NAD: Loaded 34318 existing records from primary storage. [2025-09-29T02:19:27.852414] [INFO ] [MAIN ] NAD: Loaded 34318 primary data records. [2025-09-29T02:19:28.779256] [DEBUG] [MAIN ] NAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:28.780458] [INFO ] [MAIN ] NAC: Generated 1820 derivative records from 25076 primary records. [2025-09-29T02:19:28.781912] [DEBUG] [LOCAL ] NAC: Saving derivative data. [2025-09-29T02:19:28.801404] [DEBUG] [LOCAL ] NAC: Derivative data saved (1820 records). [2025-09-29T02:19:28.801801] [INFO ] [MAIN ] NAC: Successfully saved derivative data. [2025-09-29T02:19:28.805076] [INFO ] [MAIN ] Derivative Progress: 1354/2211 symbols completed. NAC took 1.2s. Estimated remaining: 6m 2s. Rate: 142.1 symbols/min [2025-09-29T02:19:28.805802] [INFO ] [MAIN ] NAN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:28.841327] [DEBUG] [MAIN ] NAD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:28.842309] [INFO ] [MAIN ] NAD: Generated 1820 derivative records from 34318 primary records. [2025-09-29T02:19:28.842427] [DEBUG] [LOCAL ] NAD: Saving derivative data. [2025-09-29T02:19:28.842830] [DEBUG] [MAIN ] NABL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:28.844119] [INFO ] [MAIN ] NABL: Generated 1820 derivative records from 40294 primary records. [2025-09-29T02:19:28.849189] [DEBUG] [LOCAL ] NABL: Saving derivative data. [2025-09-29T02:19:28.849495] [DEBUG] [LOCAL ] NAN: Loaded 9084 existing records from primary storage. [2025-09-29T02:19:28.872200] [INFO ] [MAIN ] NAN: Loaded 9084 primary data records. [2025-09-29T02:19:28.878996] [DEBUG] [LOCAL ] NAD: Derivative data saved (1820 records). [2025-09-29T02:19:28.918148] [INFO ] [MAIN ] NAD: Successfully saved derivative data. [2025-09-29T02:19:28.949926] [INFO ] [MAIN ] Derivative Progress: 1355/2211 symbols completed. NAD took 1.3s. Estimated remaining: 6m 1s. Rate: 142.1 symbols/min [2025-09-29T02:19:28.950018] [DEBUG] [LOCAL ] NABL: Derivative data saved (1820 records). [2025-09-29T02:19:28.967114] [INFO ] [MAIN ] NAT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:28.967763] [INFO ] [MAIN ] NABL: Successfully saved derivative data. [2025-09-29T02:19:28.970855] [INFO ] [MAIN ] Derivative Progress: 1356/2211 symbols completed. NABL took 1.4s. Estimated remaining: 6m 1s. Rate: 142.2 symbols/min [2025-09-29T02:19:28.971055] [INFO ] [MAIN ] NATL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:29.293528] [DEBUG] [LOCAL ] NATL: Loaded 33367 existing records from primary storage. [2025-09-29T02:19:29.294802] [INFO ] [MAIN ] NATL: Loaded 33367 primary data records. [2025-09-29T02:19:29.438448] [DEBUG] [LOCAL ] NAT: Loaded 49859 existing records from primary storage. [2025-09-29T02:19:29.450438] [INFO ] [MAIN ] NAT: Loaded 49859 primary data records. [2025-09-29T02:19:29.844038] [DEBUG] [MAIN ] NAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:29.888092] [INFO ] [MAIN ] NAN: Generated 1820 derivative records from 9084 primary records. [2025-09-29T02:19:30.018368] [DEBUG] [LOCAL ] NAN: Saving derivative data. [2025-09-29T02:19:30.039912] [DEBUG] [LOCAL ] NAN: Derivative data saved (1820 records). [2025-09-29T02:19:30.040547] [INFO ] [MAIN ] NAN: Successfully saved derivative data. [2025-09-29T02:19:30.043524] [INFO ] [MAIN ] Derivative Progress: 1357/2211 symbols completed. NAN took 1.2s. Estimated remaining: 6m 1s. Rate: 142.1 symbols/min [2025-09-29T02:19:30.044001] [INFO ] [MAIN ] NAZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:30.052485] [DEBUG] [LOCAL ] NAZ: Loaded 2703 existing records from primary storage. [2025-09-29T02:19:30.052979] [INFO ] [MAIN ] NAZ: Loaded 2703 primary data records. [2025-09-29T02:19:30.203074] [DEBUG] [MAIN ] NATL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:30.229319] [INFO ] [MAIN ] NATL: Generated 1820 derivative records from 33367 primary records. [2025-09-29T02:19:30.383314] [DEBUG] [LOCAL ] NATL: Saving derivative data. [2025-09-29T02:19:30.439253] [DEBUG] [MAIN ] NAT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:30.438238] [DEBUG] [LOCAL ] NATL: Derivative data saved (1820 records). [2025-09-29T02:19:30.439773] [INFO ] [MAIN ] NATL: Successfully saved derivative data. [2025-09-29T02:19:30.440512] [INFO ] [MAIN ] NAT: Generated 1820 derivative records from 49859 primary records. [2025-09-29T02:19:30.443824] [INFO ] [MAIN ] Derivative Progress: 1358/2211 symbols completed. NATL took 1.5s. Estimated remaining: 6m 0s. Rate: 142.1 symbols/min [2025-09-29T02:19:30.444262] [INFO ] [MAIN ] NBB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:30.444564] [DEBUG] [LOCAL ] NAT: Saving derivative data. [2025-09-29T02:19:30.466636] [DEBUG] [LOCAL ] NAT: Derivative data saved (1820 records). [2025-09-29T02:19:30.466846] [INFO ] [MAIN ] NAT: Successfully saved derivative data. [2025-09-29T02:19:30.470523] [INFO ] [MAIN ] Derivative Progress: 1359/2211 symbols completed. NAT took 1.5s. Estimated remaining: 5m 60s. Rate: 142.2 symbols/min [2025-09-29T02:19:30.477171] [DEBUG] [LOCAL ] NBB: Loaded 8967 existing records from primary storage. [2025-09-29T02:19:30.478039] [INFO ] [MAIN ] NBB: Loaded 8967 primary data records. [2025-09-29T02:19:30.477365] [INFO ] [MAIN ] NBHC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:30.652515] [DEBUG] [MAIN ] NAZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:30.677399] [INFO ] [MAIN ] NAZ: Generated 1820 derivative records from 2703 primary records. [2025-09-29T02:19:30.688235] [DEBUG] [LOCAL ] NBHC: Loaded 23530 existing records from primary storage. [2025-09-29T02:19:30.688411] [INFO ] [MAIN ] NBHC: Loaded 23530 primary data records. [2025-09-29T02:19:30.706039] [DEBUG] [LOCAL ] NAZ: Saving derivative data. [2025-09-29T02:19:30.971210] [DEBUG] [LOCAL ] NAZ: Derivative data saved (1820 records). [2025-09-29T02:19:30.993733] [INFO ] [MAIN ] NAZ: Successfully saved derivative data. [2025-09-29T02:19:30.996735] [INFO ] [MAIN ] Derivative Progress: 1360/2211 symbols completed. NAZ took 1.0s. Estimated remaining: 5m 59s. Rate: 142.1 symbols/min [2025-09-29T02:19:31.002420] [INFO ] [MAIN ] NBR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:31.288838] [DEBUG] [MAIN ] NBB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:31.289716] [INFO ] [MAIN ] NBB: Generated 1820 derivative records from 8967 primary records. [2025-09-29T02:19:31.290777] [DEBUG] [LOCAL ] NBB: Saving derivative data. [2025-09-29T02:19:31.304498] [DEBUG] [LOCAL ] NBR: Loaded 35286 existing records from primary storage. [2025-09-29T02:19:31.305367] [INFO ] [MAIN ] NBR: Loaded 35286 primary data records. [2025-09-29T02:19:31.362832] [DEBUG] [LOCAL ] NBB: Derivative data saved (1820 records). [2025-09-29T02:19:31.427627] [INFO ] [MAIN ] NBB: Successfully saved derivative data. [2025-09-29T02:19:31.434967] [DEBUG] [MAIN ] NBHC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:31.470726] [INFO ] [MAIN ] NBHC: Generated 1820 derivative records from 23530 primary records. [2025-09-29T02:19:31.473255] [INFO ] [MAIN ] Derivative Progress: 1361/2211 symbols completed. NBB took 1.0s. Estimated remaining: 5m 59s. Rate: 142.1 symbols/min [2025-09-29T02:19:31.473481] [DEBUG] [LOCAL ] NBHC: Saving derivative data. [2025-09-29T02:19:31.538401] [INFO ] [MAIN ] NBXG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:31.706874] [DEBUG] [LOCAL ] NBHC: Derivative data saved (1820 records). [2025-09-29T02:19:31.707090] [INFO ] [MAIN ] NBHC: Successfully saved derivative data. [2025-09-29T02:19:31.709861] [INFO ] [MAIN ] Derivative Progress: 1362/2211 symbols completed. NBHC took 1.2s. Estimated remaining: 5m 58s. Rate: 142.2 symbols/min [2025-09-29T02:19:31.710337] [INFO ] [MAIN ] NC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:31.717331] [DEBUG] [LOCAL ] NC: Loaded 1933 existing records from primary storage. [2025-09-29T02:19:31.717590] [INFO ] [MAIN ] NC: Loaded 1933 primary data records. [2025-09-29T02:19:31.863535] [DEBUG] [LOCAL ] NBXG: Loaded 22794 existing records from primary storage. [2025-09-29T02:19:31.904919] [INFO ] [MAIN ] NBXG: Loaded 22794 primary data records. [2025-09-29T02:19:32.401736] [DEBUG] [MAIN ] NBR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:32.403317] [INFO ] [MAIN ] NBR: Generated 1820 derivative records from 35286 primary records. [2025-09-29T02:19:32.404086] [DEBUG] [LOCAL ] NBR: Saving derivative data. [2025-09-29T02:19:32.436281] [DEBUG] [LOCAL ] NBR: Derivative data saved (1820 records). [2025-09-29T02:19:32.437089] [INFO ] [MAIN ] NBR: Successfully saved derivative data. [2025-09-29T02:19:32.454550] [INFO ] [MAIN ] Derivative Progress: 1363/2211 symbols completed. NBR took 1.5s. Estimated remaining: 5m 58s. Rate: 142.1 symbols/min [2025-09-29T02:19:32.456813] [DEBUG] [MAIN ] NC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:32.457751] [INFO ] [MAIN ] NC: Generated 1820 derivative records from 1933 primary records. [2025-09-29T02:19:32.458107] [DEBUG] [LOCAL ] NC: Saving derivative data. [2025-09-29T02:19:32.474790] [DEBUG] [LOCAL ] NC: Derivative data saved (1820 records). [2025-09-29T02:19:32.475325] [INFO ] [MAIN ] NC: Successfully saved derivative data. [2025-09-29T02:19:32.478016] [INFO ] [MAIN ] Derivative Progress: 1364/2211 symbols completed. NC took 0.8s. Estimated remaining: 5m 57s. Rate: 142.2 symbols/min [2025-09-29T02:19:32.494473] [DEBUG] [MAIN ] NBXG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:32.495272] [INFO ] [MAIN ] NBXG: Generated 1820 derivative records from 22794 primary records. [2025-09-29T02:19:32.495362] [DEBUG] [LOCAL ] NBXG: Saving derivative data. [2025-09-29T02:19:32.512476] [DEBUG] [LOCAL ] NBXG: Derivative data saved (1820 records). [2025-09-29T02:19:32.512682] [INFO ] [MAIN ] NBXG: Successfully saved derivative data. [2025-09-29T02:19:32.516307] [INFO ] [MAIN ] Derivative Progress: 1365/2211 symbols completed. NBXG took 1.0s. Estimated remaining: 5m 57s. Rate: 142.3 symbols/min [2025-09-29T02:19:32.516959] [INFO ] [MAIN ] NCA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:32.517094] [INFO ] [MAIN ] NCDL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:32.517149] [INFO ] [MAIN ] NCLH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:32.547031] [DEBUG] [LOCAL ] NCA: Loaded 10178 existing records from primary storage. [2025-09-29T02:19:32.547250] [INFO ] [MAIN ] NCA: Loaded 10178 primary data records. [2025-09-29T02:19:32.641033] [DEBUG] [LOCAL ] NCDL: Loaded 21828 existing records from primary storage. [2025-09-29T02:19:32.701075] [INFO ] [MAIN ] NCDL: Loaded 21828 primary data records. [2025-09-29T02:19:32.923495] [DEBUG] [LOCAL ] NCLH: Loaded 54533 existing records from primary storage. [2025-09-29T02:19:33.049223] [INFO ] [MAIN ] NCLH: Loaded 54533 primary data records. [2025-09-29T02:19:33.690871] [DEBUG] [MAIN ] NCA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:33.692178] [INFO ] [MAIN ] NCA: Generated 1820 derivative records from 10178 primary records. [2025-09-29T02:19:33.692470] [DEBUG] [LOCAL ] NCA: Saving derivative data. [2025-09-29T02:19:33.711316] [DEBUG] [LOCAL ] NCA: Derivative data saved (1820 records). [2025-09-29T02:19:33.711982] [INFO ] [MAIN ] NCA: Successfully saved derivative data. [2025-09-29T02:19:33.715808] [INFO ] [MAIN ] Derivative Progress: 1366/2211 symbols completed. NCA took 1.2s. Estimated remaining: 5m 57s. Rate: 142.1 symbols/min [2025-09-29T02:19:33.718862] [INFO ] [MAIN ] NCV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:33.733511] [DEBUG] [MAIN ] NCDL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:33.734343] [INFO ] [MAIN ] NCDL: Generated 1820 derivative records from 21828 primary records. [2025-09-29T02:19:33.734456] [DEBUG] [LOCAL ] NCDL: Saving derivative data. [2025-09-29T02:19:33.759146] [DEBUG] [LOCAL ] NCDL: Derivative data saved (1820 records). [2025-09-29T02:19:33.759863] [INFO ] [MAIN ] NCDL: Successfully saved derivative data. [2025-09-29T02:19:33.762971] [INFO ] [MAIN ] Derivative Progress: 1367/2211 symbols completed. NCDL took 1.2s. Estimated remaining: 5m 56s. Rate: 142.2 symbols/min [2025-09-29T02:19:33.763265] [INFO ] [MAIN ] NCZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:33.773228] [DEBUG] [LOCAL ] NCV: Loaded 13602 existing records from primary storage. [2025-09-29T02:19:33.774034] [INFO ] [MAIN ] NCV: Loaded 13602 primary data records. [2025-09-29T02:19:33.893507] [DEBUG] [MAIN ] NCLH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:33.893979] [DEBUG] [LOCAL ] NCZ: Loaded 11998 existing records from primary storage. [2025-09-29T02:19:33.914446] [INFO ] [MAIN ] NCZ: Loaded 11998 primary data records. [2025-09-29T02:19:33.914322] [INFO ] [MAIN ] NCLH: Generated 1820 derivative records from 54533 primary records. [2025-09-29T02:19:33.919883] [DEBUG] [LOCAL ] NCLH: Saving derivative data. [2025-09-29T02:19:34.277476] [DEBUG] [LOCAL ] NCLH: Derivative data saved (1820 records). [2025-09-29T02:19:34.299235] [INFO ] [MAIN ] NCLH: Successfully saved derivative data. [2025-09-29T02:19:34.308831] [INFO ] [MAIN ] Derivative Progress: 1368/2211 symbols completed. NCLH took 1.8s. Estimated remaining: 5m 56s. Rate: 142.2 symbols/min [2025-09-29T02:19:34.314175] [INFO ] [MAIN ] NDMO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:34.521869] [DEBUG] [LOCAL ] NDMO: Loaded 16978 existing records from primary storage. [2025-09-29T02:19:34.522515] [INFO ] [MAIN ] NDMO: Loaded 16978 primary data records. [2025-09-29T02:19:34.692030] [DEBUG] [MAIN ] NCV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:34.733965] [INFO ] [MAIN ] NCV: Generated 1820 derivative records from 13602 primary records. [2025-09-29T02:19:34.907446] [DEBUG] [LOCAL ] NCV: Saving derivative data. [2025-09-29T02:19:34.908308] [DEBUG] [MAIN ] NCZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:34.909284] [INFO ] [MAIN ] NCZ: Generated 1820 derivative records from 11998 primary records. [2025-09-29T02:19:34.910210] [DEBUG] [LOCAL ] NCZ: Saving derivative data. [2025-09-29T02:19:34.945234] [DEBUG] [LOCAL ] NCV: Derivative data saved (1820 records). [2025-09-29T02:19:34.945719] [DEBUG] [LOCAL ] NCZ: Derivative data saved (1820 records). [2025-09-29T02:19:34.946523] [INFO ] [MAIN ] NCZ: Successfully saved derivative data. [2025-09-29T02:19:34.949729] [INFO ] [MAIN ] Derivative Progress: 1369/2211 symbols completed. NCZ took 1.2s. Estimated remaining: 5m 56s. Rate: 142.1 symbols/min [2025-09-29T02:19:34.949935] [INFO ] [MAIN ] NE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:34.946162] [INFO ] [MAIN ] NCV: Successfully saved derivative data. [2025-09-29T02:19:34.954128] [INFO ] [MAIN ] Derivative Progress: 1370/2211 symbols completed. NCV took 1.2s. Estimated remaining: 5m 55s. Rate: 142.2 symbols/min [2025-09-29T02:19:34.954528] [INFO ] [MAIN ] NEA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:34.979887] [DEBUG] [MAIN ] NDMO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:34.981508] [INFO ] [MAIN ] NDMO: Generated 1820 derivative records from 16978 primary records. [2025-09-29T02:19:34.981636] [DEBUG] [LOCAL ] NDMO: Saving derivative data. [2025-09-29T02:19:35.010298] [DEBUG] [LOCAL ] NDMO: Derivative data saved (1820 records). [2025-09-29T02:19:35.010469] [INFO ] [MAIN ] NDMO: Successfully saved derivative data. [2025-09-29T02:19:35.013588] [INFO ] [MAIN ] Derivative Progress: 1371/2211 symbols completed. NDMO took 0.7s. Estimated remaining: 5m 54s. Rate: 142.3 symbols/min [2025-09-29T02:19:35.015851] [INFO ] [MAIN ] NEE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:35.028292] [DEBUG] [LOCAL ] NEA: Loaded 35808 existing records from primary storage. [2025-09-29T02:19:35.044026] [INFO ] [MAIN ] NEA: Loaded 35808 primary data records. [2025-09-29T02:19:35.178698] [DEBUG] [LOCAL ] NE: Loaded 53157 existing records from primary storage. [2025-09-29T02:19:35.190131] [INFO ] [MAIN ] NE: Loaded 53157 primary data records. [2025-09-29T02:19:35.688897] [DEBUG] [LOCAL ] NEE: Loaded 54487 existing records from primary storage. [2025-09-29T02:19:35.724876] [INFO ] [MAIN ] NEE: Loaded 54487 primary data records. [2025-09-29T02:19:36.236148] [DEBUG] [MAIN ] NEA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:36.237164] [INFO ] [MAIN ] NEA: Generated 1820 derivative records from 35808 primary records. [2025-09-29T02:19:36.237520] [DEBUG] [LOCAL ] NEA: Saving derivative data. [2025-09-29T02:19:36.270401] [DEBUG] [MAIN ] NE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:36.272397] [INFO ] [MAIN ] NE: Generated 1820 derivative records from 53157 primary records. [2025-09-29T02:19:36.273875] [DEBUG] [LOCAL ] NE: Saving derivative data. [2025-09-29T02:19:36.275111] [DEBUG] [LOCAL ] NEA: Derivative data saved (1820 records). [2025-09-29T02:19:36.276039] [INFO ] [MAIN ] NEA: Successfully saved derivative data. [2025-09-29T02:19:36.279491] [INFO ] [MAIN ] Derivative Progress: 1372/2211 symbols completed. NEA took 1.3s. Estimated remaining: 5m 54s. Rate: 142.1 symbols/min [2025-09-29T02:19:36.287957] [INFO ] [MAIN ] NEM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:36.299108] [DEBUG] [LOCAL ] NE: Derivative data saved (1820 records). [2025-09-29T02:19:36.299565] [INFO ] [MAIN ] NE: Successfully saved derivative data. [2025-09-29T02:19:36.303198] [INFO ] [MAIN ] Derivative Progress: 1373/2211 symbols completed. NE took 1.4s. Estimated remaining: 5m 54s. Rate: 142.2 symbols/min [2025-09-29T02:19:36.303483] [INFO ] [MAIN ] NET: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:36.323178] [DEBUG] [MAIN ] NEE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:36.324613] [INFO ] [MAIN ] NEE: Generated 1820 derivative records from 54487 primary records. [2025-09-29T02:19:36.324891] [DEBUG] [LOCAL ] NEE: Saving derivative data. [2025-09-29T02:19:36.342395] [DEBUG] [LOCAL ] NEE: Derivative data saved (1820 records). [2025-09-29T02:19:36.343275] [INFO ] [MAIN ] NEE: Successfully saved derivative data. [2025-09-29T02:19:36.346739] [INFO ] [MAIN ] Derivative Progress: 1374/2211 symbols completed. NEE took 1.3s. Estimated remaining: 5m 53s. Rate: 142.3 symbols/min [2025-09-29T02:19:36.347035] [INFO ] [MAIN ] NEU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:36.406047] [DEBUG] [LOCAL ] NEM: Loaded 54488 existing records from primary storage. [2025-09-29T02:19:36.410357] [DEBUG] [LOCAL ] NEU: Loaded 8259 existing records from primary storage. [2025-09-29T02:19:36.410480] [INFO ] [MAIN ] NEM: Loaded 54488 primary data records. [2025-09-29T02:19:36.410832] [INFO ] [MAIN ] NEU: Loaded 8259 primary data records. [2025-09-29T02:19:36.583954] [DEBUG] [LOCAL ] NET: Loaded 53808 existing records from primary storage. [2025-09-29T02:19:36.637815] [INFO ] [MAIN ] NET: Loaded 53808 primary data records. [2025-09-29T02:19:37.489129] [DEBUG] [MAIN ] NEU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:37.490942] [INFO ] [MAIN ] NEU: Generated 1820 derivative records from 8259 primary records. [2025-09-29T02:19:37.491556] [DEBUG] [LOCAL ] NEU: Saving derivative data. [2025-09-29T02:19:37.511629] [DEBUG] [LOCAL ] NEU: Derivative data saved (1820 records). [2025-09-29T02:19:37.512378] [INFO ] [MAIN ] NEU: Successfully saved derivative data. [2025-09-29T02:19:37.514851] [INFO ] [MAIN ] Derivative Progress: 1375/2211 symbols completed. NEU took 1.2s. Estimated remaining: 5m 53s. Rate: 142.1 symbols/min [2025-09-29T02:19:37.527849] [INFO ] [MAIN ] NEUE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:37.530386] [DEBUG] [MAIN ] NEM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:37.531501] [INFO ] [MAIN ] NEM: Generated 1820 derivative records from 54488 primary records. [2025-09-29T02:19:37.531742] [DEBUG] [LOCAL ] NEM: Saving derivative data. [2025-09-29T02:19:37.537953] [DEBUG] [LOCAL ] NEUE: Loaded 2271 existing records from primary storage. [2025-09-29T02:19:37.567554] [DEBUG] [LOCAL ] NEM: Derivative data saved (1820 records). [2025-09-29T02:19:37.567038] [DEBUG] [MAIN ] NET: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:37.567454] [INFO ] [MAIN ] NEUE: Loaded 2271 primary data records. [2025-09-29T02:19:37.568734] [INFO ] [MAIN ] NET: Generated 1820 derivative records from 53808 primary records. [2025-09-29T02:19:37.568875] [INFO ] [MAIN ] NEM: Successfully saved derivative data. [2025-09-29T02:19:37.577260] [INFO ] [MAIN ] Derivative Progress: 1376/2211 symbols completed. NEM took 1.3s. Estimated remaining: 5m 52s. Rate: 142.2 symbols/min [2025-09-29T02:19:37.577605] [INFO ] [MAIN ] NEXA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:37.584712] [DEBUG] [LOCAL ] NET: Saving derivative data. [2025-09-29T02:19:37.688438] [DEBUG] [LOCAL ] NEXA: Loaded 4307 existing records from primary storage. [2025-09-29T02:19:37.705489] [INFO ] [MAIN ] NEXA: Loaded 4307 primary data records. [2025-09-29T02:19:37.815114] [DEBUG] [LOCAL ] NET: Derivative data saved (1820 records). [2025-09-29T02:19:37.869559] [INFO ] [MAIN ] NET: Successfully saved derivative data. [2025-09-29T02:19:38.076868] [INFO ] [MAIN ] Derivative Progress: 1377/2211 symbols completed. NET took 1.8s. Estimated remaining: 5m 52s. Rate: 142.2 symbols/min [2025-09-29T02:19:38.077910] [INFO ] [MAIN ] NFG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:38.321534] [DEBUG] [MAIN ] NEUE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:38.322631] [INFO ] [MAIN ] NEUE: Generated 1820 derivative records from 2271 primary records. [2025-09-29T02:19:38.323006] [DEBUG] [LOCAL ] NEUE: Saving derivative data. [2025-09-29T02:19:38.353228] [DEBUG] [LOCAL ] NEUE: Derivative data saved (1820 records). [2025-09-29T02:19:38.353575] [INFO ] [MAIN ] NEUE: Successfully saved derivative data. [2025-09-29T02:19:38.356768] [INFO ] [MAIN ] Derivative Progress: 1378/2211 symbols completed. NEUE took 0.8s. Estimated remaining: 5m 51s. Rate: 142.2 symbols/min [2025-09-29T02:19:38.373054] [DEBUG] [LOCAL ] NFG: Loaded 39084 existing records from primary storage. [2025-09-29T02:19:38.373575] [INFO ] [MAIN ] NFG: Loaded 39084 primary data records. [2025-09-29T02:19:38.373429] [DEBUG] [MAIN ] NEXA: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:19:38.379622] [INFO ] [MAIN ] NEXA: Generated 1819 derivative records from 4307 primary records. [2025-09-29T02:19:38.383486] [DEBUG] [LOCAL ] NEXA: Saving derivative data. [2025-09-29T02:19:38.509914] [DEBUG] [LOCAL ] NEXA: Derivative data saved (1819 records). [2025-09-29T02:19:38.513303] [INFO ] [MAIN ] NEXA: Successfully saved derivative data. [2025-09-29T02:19:38.521365] [INFO ] [MAIN ] Derivative Progress: 1379/2211 symbols completed. NEXA took 0.9s. Estimated remaining: 5m 51s. Rate: 142.3 symbols/min [2025-09-29T02:19:38.752197] [DEBUG] [MAIN ] NFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:38.752987] [INFO ] [MAIN ] NFG: Generated 1820 derivative records from 39084 primary records. [2025-09-29T02:19:38.753096] [DEBUG] [LOCAL ] NFG: Saving derivative data. [2025-09-29T02:19:38.769549] [DEBUG] [LOCAL ] NFG: Derivative data saved (1820 records). [2025-09-29T02:19:38.769679] [INFO ] [MAIN ] NFG: Successfully saved derivative data. [2025-09-29T02:19:38.772269] [INFO ] [MAIN ] Derivative Progress: 1380/2211 symbols completed. NFG took 0.7s. Estimated remaining: 5m 50s. Rate: 142.3 symbols/min [2025-09-29T02:19:38.772763] [INFO ] [MAIN ] NFJ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:38.772908] [INFO ] [MAIN ] NGG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:38.773012] [INFO ] [MAIN ] NGL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:38.813267] [DEBUG] [LOCAL ] NFJ: Loaded 20592 existing records from primary storage. [2025-09-29T02:19:38.822986] [INFO ] [MAIN ] NFJ: Loaded 20592 primary data records. [2025-09-29T02:19:38.836371] [DEBUG] [LOCAL ] NGL: Loaded 30754 existing records from primary storage. [2025-09-29T02:19:38.836536] [INFO ] [MAIN ] NGL: Loaded 30754 primary data records. [2025-09-29T02:19:39.140288] [DEBUG] [LOCAL ] NGG: Loaded 46809 existing records from primary storage. [2025-09-29T02:19:39.214188] [INFO ] [MAIN ] NGG: Loaded 46809 primary data records. [2025-09-29T02:19:39.943531] [DEBUG] [MAIN ] NFJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:39.958983] [INFO ] [MAIN ] NFJ: Generated 1820 derivative records from 20592 primary records. [2025-09-29T02:19:39.957897] [DEBUG] [MAIN ] NGL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:39.960629] [DEBUG] [LOCAL ] NFJ: Saving derivative data. [2025-09-29T02:19:39.962276] [INFO ] [MAIN ] NGL: Generated 1820 derivative records from 30754 primary records. [2025-09-29T02:19:39.964238] [DEBUG] [LOCAL ] NGL: Saving derivative data. [2025-09-29T02:19:40.003664] [DEBUG] [MAIN ] NGG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:39.995581] [DEBUG] [LOCAL ] NFJ: Derivative data saved (1820 records). [2025-09-29T02:19:40.004703] [INFO ] [MAIN ] NGG: Generated 1820 derivative records from 46809 primary records. [2025-09-29T02:19:40.008705] [DEBUG] [LOCAL ] NGG: Saving derivative data. [2025-09-29T02:19:40.003906] [INFO ] [MAIN ] NFJ: Successfully saved derivative data. [2025-09-29T02:19:40.012928] [DEBUG] [LOCAL ] NGL: Derivative data saved (1820 records). [2025-09-29T02:19:40.014006] [INFO ] [MAIN ] NGL: Successfully saved derivative data. [2025-09-29T02:19:40.016782] [INFO ] [MAIN ] Derivative Progress: 1381/2211 symbols completed. NFJ took 1.2s. Estimated remaining: 5m 50s. Rate: 142.1 symbols/min [2025-09-29T02:19:40.031471] [INFO ] [MAIN ] NGS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:40.032163] [INFO ] [MAIN ] Derivative Progress: 1382/2211 symbols completed. NGL took 1.3s. Estimated remaining: 5m 50s. Rate: 142.2 symbols/min [2025-09-29T02:19:40.032763] [INFO ] [MAIN ] NGVC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:40.039992] [DEBUG] [LOCAL ] NGG: Derivative data saved (1820 records). [2025-09-29T02:19:40.040267] [INFO ] [MAIN ] NGG: Successfully saved derivative data. [2025-09-29T02:19:40.043696] [INFO ] [MAIN ] Derivative Progress: 1383/2211 symbols completed. NGG took 1.3s. Estimated remaining: 5m 49s. Rate: 142.3 symbols/min [2025-09-29T02:19:40.044064] [INFO ] [MAIN ] NGVT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:40.059262] [DEBUG] [LOCAL ] NGS: Loaded 11682 existing records from primary storage. [2025-09-29T02:19:40.059724] [INFO ] [MAIN ] NGS: Loaded 11682 primary data records. [2025-09-29T02:19:40.171360] [DEBUG] [LOCAL ] NGVC: Loaded 22650 existing records from primary storage. [2025-09-29T02:19:40.191366] [INFO ] [MAIN ] NGVC: Loaded 22650 primary data records. [2025-09-29T02:19:40.200476] [DEBUG] [LOCAL ] NGVT: Loaded 24631 existing records from primary storage. [2025-09-29T02:19:40.226280] [INFO ] [MAIN ] NGVT: Loaded 24631 primary data records. [2025-09-29T02:19:41.128872] [DEBUG] [MAIN ] NGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:41.130226] [INFO ] [MAIN ] NGS: Generated 1820 derivative records from 11682 primary records. [2025-09-29T02:19:41.130563] [DEBUG] [LOCAL ] NGS: Saving derivative data. [2025-09-29T02:19:41.160097] [DEBUG] [LOCAL ] NGS: Derivative data saved (1820 records). [2025-09-29T02:19:41.165683] [INFO ] [MAIN ] NGS: Successfully saved derivative data. [2025-09-29T02:19:41.169202] [INFO ] [MAIN ] Derivative Progress: 1384/2211 symbols completed. NGS took 1.1s. Estimated remaining: 5m 49s. Rate: 142.1 symbols/min [2025-09-29T02:19:41.166061] [DEBUG] [MAIN ] NGVC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:41.170058] [INFO ] [MAIN ] NHI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:41.171663] [INFO ] [MAIN ] NGVC: Generated 1820 derivative records from 22650 primary records. [2025-09-29T02:19:41.172439] [DEBUG] [LOCAL ] NGVC: Saving derivative data. [2025-09-29T02:19:41.192177] [DEBUG] [LOCAL ] NGVC: Derivative data saved (1820 records). [2025-09-29T02:19:41.194633] [INFO ] [MAIN ] NGVC: Successfully saved derivative data. [2025-09-29T02:19:41.197784] [INFO ] [MAIN ] Derivative Progress: 1385/2211 symbols completed. NGVC took 1.2s. Estimated remaining: 5m 48s. Rate: 142.2 symbols/min [2025-09-29T02:19:41.198345] [INFO ] [MAIN ] NI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:41.214479] [DEBUG] [MAIN ] NGVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:41.215559] [INFO ] [MAIN ] NGVT: Generated 1820 derivative records from 24631 primary records. [2025-09-29T02:19:41.215691] [DEBUG] [LOCAL ] NGVT: Saving derivative data. [2025-09-29T02:19:41.241097] [DEBUG] [LOCAL ] NGVT: Derivative data saved (1820 records). [2025-09-29T02:19:41.241336] [INFO ] [MAIN ] NGVT: Successfully saved derivative data. [2025-09-29T02:19:41.244164] [INFO ] [MAIN ] Derivative Progress: 1386/2211 symbols completed. NGVT took 1.2s. Estimated remaining: 5m 48s. Rate: 142.3 symbols/min [2025-09-29T02:19:41.244465] [INFO ] [MAIN ] NIC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:41.254354] [DEBUG] [LOCAL ] NHI: Loaded 22283 existing records from primary storage. [2025-09-29T02:19:41.254697] [INFO ] [MAIN ] NHI: Loaded 22283 primary data records. [2025-09-29T02:19:41.381524] [DEBUG] [LOCAL ] NIC: Loaded 9026 existing records from primary storage. [2025-09-29T02:19:41.387174] [INFO ] [MAIN ] NIC: Loaded 9026 primary data records. [2025-09-29T02:19:41.786413] [DEBUG] [LOCAL ] NI: Loaded 54201 existing records from primary storage. [2025-09-29T02:19:41.829087] [INFO ] [MAIN ] NI: Loaded 54201 primary data records. [2025-09-29T02:19:42.455317] [DEBUG] [MAIN ] NHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:42.457243] [INFO ] [MAIN ] NHI: Generated 1820 derivative records from 22283 primary records. [2025-09-29T02:19:42.457581] [DEBUG] [LOCAL ] NHI: Saving derivative data. [2025-09-29T02:19:42.480008] [DEBUG] [LOCAL ] NHI: Derivative data saved (1820 records). [2025-09-29T02:19:42.481616] [INFO ] [MAIN ] NHI: Successfully saved derivative data. [2025-09-29T02:19:42.485580] [INFO ] [MAIN ] Derivative Progress: 1387/2211 symbols completed. NHI took 1.3s. Estimated remaining: 5m 48s. Rate: 142.1 symbols/min [2025-09-29T02:19:42.485986] [INFO ] [MAIN ] NIE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:42.501065] [DEBUG] [MAIN ] NIC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:42.502190] [INFO ] [MAIN ] NIC: Generated 1820 derivative records from 9026 primary records. [2025-09-29T02:19:42.502765] [DEBUG] [LOCAL ] NIC: Saving derivative data. [2025-09-29T02:19:42.524975] [DEBUG] [LOCAL ] NIC: Derivative data saved (1820 records). [2025-09-29T02:19:42.526690] [INFO ] [MAIN ] NIC: Successfully saved derivative data. [2025-09-29T02:19:42.531481] [INFO ] [MAIN ] Derivative Progress: 1388/2211 symbols completed. NIC took 1.3s. Estimated remaining: 5m 47s. Rate: 142.2 symbols/min [2025-09-29T02:19:42.532029] [INFO ] [MAIN ] NIM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:42.538701] [DEBUG] [LOCAL ] NIE: Loaded 11869 existing records from primary storage. [2025-09-29T02:19:42.539357] [INFO ] [MAIN ] NIE: Loaded 11869 primary data records. [2025-09-29T02:19:42.559098] [DEBUG] [MAIN ] NI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:42.615934] [DEBUG] [LOCAL ] NIM: Loaded 4149 existing records from primary storage. [2025-09-29T02:19:42.602157] [INFO ] [MAIN ] NI: Generated 1820 derivative records from 54201 primary records. [2025-09-29T02:19:42.628006] [DEBUG] [LOCAL ] NI: Saving derivative data. [2025-09-29T02:19:42.627849] [INFO ] [MAIN ] NIM: Loaded 4149 primary data records. [2025-09-29T02:19:42.815536] [DEBUG] [LOCAL ] NI: Derivative data saved (1820 records). [2025-09-29T02:19:42.916148] [INFO ] [MAIN ] NI: Successfully saved derivative data. [2025-09-29T02:19:42.919851] [INFO ] [MAIN ] Derivative Progress: 1389/2211 symbols completed. NI took 1.7s. Estimated remaining: 5m 47s. Rate: 142.2 symbols/min [2025-09-29T02:19:43.017995] [INFO ] [MAIN ] NINE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:43.291260] [DEBUG] [LOCAL ] NINE: Loaded 28624 existing records from primary storage. [2025-09-29T02:19:43.292182] [INFO ] [MAIN ] NINE: Loaded 28624 primary data records. [2025-09-29T02:19:43.404384] [DEBUG] [MAIN ] NIE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:43.431828] [INFO ] [MAIN ] NIE: Generated 1820 derivative records from 11869 primary records. [2025-09-29T02:19:43.442893] [DEBUG] [LOCAL ] NIE: Saving derivative data. [2025-09-29T02:19:43.489423] [DEBUG] [MAIN ] NIM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:43.546440] [INFO ] [MAIN ] NIM: Generated 1820 derivative records from 4149 primary records. [2025-09-29T02:19:43.549438] [DEBUG] [LOCAL ] NIE: Derivative data saved (1820 records). [2025-09-29T02:19:43.619508] [DEBUG] [LOCAL ] NIM: Saving derivative data. [2025-09-29T02:19:43.658596] [INFO ] [MAIN ] NIE: Successfully saved derivative data. [2025-09-29T02:19:43.676980] [INFO ] [MAIN ] Derivative Progress: 1390/2211 symbols completed. NIE took 1.2s. Estimated remaining: 5m 47s. Rate: 142.1 symbols/min [2025-09-29T02:19:43.677854] [INFO ] [MAIN ] NIO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:43.694855] [DEBUG] [LOCAL ] NIM: Derivative data saved (1820 records). [2025-09-29T02:19:43.695323] [INFO ] [MAIN ] NIM: Successfully saved derivative data. [2025-09-29T02:19:43.698234] [INFO ] [MAIN ] Derivative Progress: 1391/2211 symbols completed. NIM took 1.2s. Estimated remaining: 5m 46s. Rate: 142.2 symbols/min [2025-09-29T02:19:43.698958] [INFO ] [MAIN ] NJR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:43.725214] [DEBUG] [MAIN ] NINE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:43.726120] [INFO ] [MAIN ] NINE: Generated 1820 derivative records from 28624 primary records. [2025-09-29T02:19:43.726225] [DEBUG] [LOCAL ] NINE: Saving derivative data. [2025-09-29T02:19:43.746851] [DEBUG] [LOCAL ] NINE: Derivative data saved (1820 records). [2025-09-29T02:19:43.747027] [INFO ] [MAIN ] NINE: Successfully saved derivative data. [2025-09-29T02:19:43.749929] [INFO ] [MAIN ] Derivative Progress: 1392/2211 symbols completed. NINE took 0.7s. Estimated remaining: 5m 45s. Rate: 142.3 symbols/min [2025-09-29T02:19:43.750214] [INFO ] [MAIN ] NKX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:43.795820] [DEBUG] [LOCAL ] NJR: Loaded 38739 existing records from primary storage. [2025-09-29T02:19:43.803777] [DEBUG] [LOCAL ] NKX: Loaded 13801 existing records from primary storage. [2025-09-29T02:19:43.803389] [INFO ] [MAIN ] NJR: Loaded 38739 primary data records. [2025-09-29T02:19:43.804263] [INFO ] [MAIN ] NKX: Loaded 13801 primary data records. [2025-09-29T02:19:43.884423] [DEBUG] [LOCAL ] NIO: Loaded 54582 existing records from primary storage. [2025-09-29T02:19:43.986284] [INFO ] [MAIN ] NIO: Loaded 54582 primary data records. [2025-09-29T02:19:45.142945] [DEBUG] [MAIN ] NJR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:45.144783] [INFO ] [MAIN ] NJR: Generated 1820 derivative records from 38739 primary records. [2025-09-29T02:19:45.144994] [DEBUG] [LOCAL ] NJR: Saving derivative data. [2025-09-29T02:19:45.180811] [DEBUG] [MAIN ] NKX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:45.184450] [INFO ] [MAIN ] NKX: Generated 1820 derivative records from 13801 primary records. [2025-09-29T02:19:45.184621] [DEBUG] [LOCAL ] NKX: Saving derivative data. [2025-09-29T02:19:45.188193] [DEBUG] [LOCAL ] NJR: Derivative data saved (1820 records). [2025-09-29T02:19:45.188566] [INFO ] [MAIN ] NJR: Successfully saved derivative data. [2025-09-29T02:19:45.206048] [INFO ] [MAIN ] Derivative Progress: 1393/2211 symbols completed. NJR took 1.5s. Estimated remaining: 5m 45s. Rate: 142.1 symbols/min [2025-09-29T02:19:45.219011] [DEBUG] [LOCAL ] NKX: Derivative data saved (1820 records). [2025-09-29T02:19:45.219666] [INFO ] [MAIN ] NKX: Successfully saved derivative data. [2025-09-29T02:19:45.223488] [INFO ] [MAIN ] Derivative Progress: 1394/2211 symbols completed. NKX took 1.5s. Estimated remaining: 5m 45s. Rate: 142.2 symbols/min [2025-09-29T02:19:45.242905] [DEBUG] [MAIN ] NIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:45.243737] [INFO ] [MAIN ] NIO: Generated 1820 derivative records from 54582 primary records. [2025-09-29T02:19:45.243825] [DEBUG] [LOCAL ] NIO: Saving derivative data. [2025-09-29T02:19:45.260221] [DEBUG] [LOCAL ] NIO: Derivative data saved (1820 records). [2025-09-29T02:19:45.260380] [INFO ] [MAIN ] NIO: Successfully saved derivative data. [2025-09-29T02:19:45.264480] [INFO ] [MAIN ] Derivative Progress: 1395/2211 symbols completed. NIO took 1.6s. Estimated remaining: 5m 44s. Rate: 142.3 symbols/min [2025-09-29T02:19:45.265002] [INFO ] [MAIN ] NMAI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:45.265079] [INFO ] [MAIN ] NLY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:45.265818] [INFO ] [MAIN ] NLOP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:45.294752] [DEBUG] [LOCAL ] NMAI: Loaded 13181 existing records from primary storage. [2025-09-29T02:19:45.301525] [DEBUG] [LOCAL ] NLOP: Loaded 11997 existing records from primary storage. [2025-09-29T02:19:45.301819] [INFO ] [MAIN ] NMAI: Loaded 13181 primary data records. [2025-09-29T02:19:45.301972] [INFO ] [MAIN ] NLOP: Loaded 11997 primary data records. [2025-09-29T02:19:45.738696] [DEBUG] [LOCAL ] NLY: Loaded 54358 existing records from primary storage. [2025-09-29T02:19:46.037471] [INFO ] [MAIN ] NLY: Loaded 54358 primary data records. [2025-09-29T02:19:46.500513] [DEBUG] [MAIN ] NLOP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:46.514993] [DEBUG] [MAIN ] NMAI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:46.516159] [INFO ] [MAIN ] NLOP: Generated 1820 derivative records from 11997 primary records. [2025-09-29T02:19:46.516976] [INFO ] [MAIN ] NMAI: Generated 1820 derivative records from 13181 primary records. [2025-09-29T02:19:46.517235] [DEBUG] [LOCAL ] NLOP: Saving derivative data. [2025-09-29T02:19:46.517345] [DEBUG] [LOCAL ] NMAI: Saving derivative data. [2025-09-29T02:19:46.552679] [DEBUG] [LOCAL ] NMAI: Derivative data saved (1820 records). [2025-09-29T02:19:46.552756] [DEBUG] [LOCAL ] NLOP: Derivative data saved (1820 records). [2025-09-29T02:19:46.555412] [INFO ] [MAIN ] NLOP: Successfully saved derivative data. [2025-09-29T02:19:46.558705] [INFO ] [MAIN ] Derivative Progress: 1396/2211 symbols completed. NLOP took 1.3s. Estimated remaining: 5m 44s. Rate: 142.1 symbols/min [2025-09-29T02:19:46.559264] [INFO ] [MAIN ] NMCO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:46.559499] [INFO ] [MAIN ] NMAI: Successfully saved derivative data. [2025-09-29T02:19:46.575405] [INFO ] [MAIN ] Derivative Progress: 1397/2211 symbols completed. NMAI took 1.3s. Estimated remaining: 5m 44s. Rate: 142.2 symbols/min [2025-09-29T02:19:46.576157] [INFO ] [MAIN ] NMG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:46.576476] [DEBUG] [MAIN ] NLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:46.577965] [INFO ] [MAIN ] NLY: Generated 1820 derivative records from 54358 primary records. [2025-09-29T02:19:46.578240] [DEBUG] [LOCAL ] NLY: Saving derivative data. [2025-09-29T02:19:46.597969] [DEBUG] [LOCAL ] NLY: Derivative data saved (1820 records). [2025-09-29T02:19:46.602245] [INFO ] [MAIN ] NLY: Successfully saved derivative data. [2025-09-29T02:19:46.605237] [INFO ] [MAIN ] Derivative Progress: 1398/2211 symbols completed. NLY took 1.3s. Estimated remaining: 5m 43s. Rate: 142.3 symbols/min [2025-09-29T02:19:46.605561] [INFO ] [MAIN ] NMI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:46.610891] [DEBUG] [LOCAL ] NMG: Loaded 7913 existing records from primary storage. [2025-09-29T02:19:46.611220] [INFO ] [MAIN ] NMG: Loaded 7913 primary data records. [2025-09-29T02:19:46.663888] [DEBUG] [LOCAL ] NMCO: Loaded 16803 existing records from primary storage. [2025-09-29T02:19:46.718041] [INFO ] [MAIN ] NMCO: Loaded 16803 primary data records. [2025-09-29T02:19:46.732202] [DEBUG] [LOCAL ] NMI: Loaded 4091 existing records from primary storage. [2025-09-29T02:19:46.760750] [INFO ] [MAIN ] NMI: Loaded 4091 primary data records. [2025-09-29T02:19:47.701370] [DEBUG] [MAIN ] NMG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:47.705543] [INFO ] [MAIN ] NMG: Generated 1820 derivative records from 7913 primary records. [2025-09-29T02:19:47.707367] [DEBUG] [LOCAL ] NMG: Saving derivative data. [2025-09-29T02:19:47.743602] [DEBUG] [MAIN ] NMCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:47.753127] [INFO ] [MAIN ] NMCO: Generated 1820 derivative records from 16803 primary records. [2025-09-29T02:19:47.756483] [DEBUG] [LOCAL ] NMCO: Saving derivative data. [2025-09-29T02:19:47.756119] [DEBUG] [MAIN ] NMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:47.758458] [INFO ] [MAIN ] NMI: Generated 1820 derivative records from 4091 primary records. [2025-09-29T02:19:47.757329] [DEBUG] [LOCAL ] NMG: Derivative data saved (1820 records). [2025-09-29T02:19:47.760153] [INFO ] [MAIN ] NMG: Successfully saved derivative data. [2025-09-29T02:19:47.760289] [DEBUG] [LOCAL ] NMI: Saving derivative data. [2025-09-29T02:19:47.767706] [INFO ] [MAIN ] Derivative Progress: 1399/2211 symbols completed. NMG took 1.2s. Estimated remaining: 5m 43s. Rate: 142.1 symbols/min [2025-09-29T02:19:47.783785] [DEBUG] [LOCAL ] NMCO: Derivative data saved (1820 records). [2025-09-29T02:19:47.783962] [INFO ] [MAIN ] NMCO: Successfully saved derivative data. [2025-09-29T02:19:47.784216] [INFO ] [MAIN ] NMM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:47.801971] [INFO ] [MAIN ] Derivative Progress: 1400/2211 symbols completed. NMCO took 1.2s. Estimated remaining: 5m 42s. Rate: 142.2 symbols/min [2025-09-29T02:19:47.805398] [INFO ] [MAIN ] NMR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:47.807457] [DEBUG] [LOCAL ] NMI: Derivative data saved (1820 records). [2025-09-29T02:19:47.807558] [INFO ] [MAIN ] NMI: Successfully saved derivative data. [2025-09-29T02:19:47.810458] [INFO ] [MAIN ] Derivative Progress: 1401/2211 symbols completed. NMI took 1.2s. Estimated remaining: 5m 42s. Rate: 142.3 symbols/min [2025-09-29T02:19:47.810984] [INFO ] [MAIN ] NMS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:47.821231] [DEBUG] [LOCAL ] NMS: Loaded 2893 existing records from primary storage. [2025-09-29T02:19:47.821547] [INFO ] [MAIN ] NMS: Loaded 2893 primary data records. [2025-09-29T02:19:47.903757] [DEBUG] [LOCAL ] NMM: Loaded 14470 existing records from primary storage. [2025-09-29T02:19:47.949348] [INFO ] [MAIN ] NMM: Loaded 14470 primary data records. [2025-09-29T02:19:48.315948] [DEBUG] [LOCAL ] NMR: Loaded 35569 existing records from primary storage. [2025-09-29T02:19:48.340371] [INFO ] [MAIN ] NMR: Loaded 35569 primary data records. [2025-09-29T02:19:48.952846] [DEBUG] [MAIN ] NMS: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-09-29T02:19:48.954268] [INFO ] [MAIN ] NMS: Generated 1818 derivative records from 2893 primary records. [2025-09-29T02:19:48.954545] [DEBUG] [LOCAL ] NMS: Saving derivative data. [2025-09-29T02:19:48.977728] [DEBUG] [LOCAL ] NMS: Derivative data saved (1818 records). [2025-09-29T02:19:48.977963] [INFO ] [MAIN ] NMS: Successfully saved derivative data. [2025-09-29T02:19:48.982012] [INFO ] [MAIN ] Derivative Progress: 1402/2211 symbols completed. NMS took 1.2s. Estimated remaining: 5m 42s. Rate: 142.1 symbols/min [2025-09-29T02:19:48.985021] [INFO ] [MAIN ] NMT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:49.001453] [DEBUG] [MAIN ] NMM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:49.002666] [INFO ] [MAIN ] NMM: Generated 1820 derivative records from 14470 primary records. [2025-09-29T02:19:49.002922] [DEBUG] [LOCAL ] NMM: Saving derivative data. [2025-09-29T02:19:49.007192] [DEBUG] [LOCAL ] NMT: Loaded 2884 existing records from primary storage. [2025-09-29T02:19:49.007594] [INFO ] [MAIN ] NMT: Loaded 2884 primary data records. [2025-09-29T02:19:49.067672] [DEBUG] [LOCAL ] NMM: Derivative data saved (1820 records). [2025-09-29T02:19:49.081629] [INFO ] [MAIN ] NMM: Successfully saved derivative data. [2025-09-29T02:19:49.093127] [INFO ] [MAIN ] Derivative Progress: 1403/2211 symbols completed. NMM took 1.3s. Estimated remaining: 5m 41s. Rate: 142.2 symbols/min [2025-09-29T02:19:49.134726] [DEBUG] [MAIN ] NMR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:49.139959] [INFO ] [MAIN ] NMZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:49.160439] [INFO ] [MAIN ] NMR: Generated 1820 derivative records from 35569 primary records. [2025-09-29T02:19:49.160635] [DEBUG] [LOCAL ] NMR: Saving derivative data. [2025-09-29T02:19:49.394842] [DEBUG] [LOCAL ] NMR: Derivative data saved (1820 records). [2025-09-29T02:19:49.395247] [INFO ] [MAIN ] NMR: Successfully saved derivative data. [2025-09-29T02:19:49.399125] [INFO ] [MAIN ] Derivative Progress: 1404/2211 symbols completed. NMR took 1.6s. Estimated remaining: 5m 41s. Rate: 142.2 symbols/min [2025-09-29T02:19:49.399604] [INFO ] [MAIN ] NNI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:49.410670] [DEBUG] [LOCAL ] NMZ: Loaded 21872 existing records from primary storage. [2025-09-29T02:19:49.412282] [INFO ] [MAIN ] NMZ: Loaded 21872 primary data records. [2025-09-29T02:19:49.543003] [DEBUG] [LOCAL ] NNI: Loaded 10159 existing records from primary storage. [2025-09-29T02:19:49.553877] [INFO ] [MAIN ] NNI: Loaded 10159 primary data records. [2025-09-29T02:19:49.985073] [DEBUG] [MAIN ] NMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:50.124459] [INFO ] [MAIN ] NMT: Generated 1820 derivative records from 2884 primary records. [2025-09-29T02:19:50.129381] [DEBUG] [LOCAL ] NMT: Saving derivative data. [2025-09-29T02:19:50.152949] [DEBUG] [LOCAL ] NMT: Derivative data saved (1820 records). [2025-09-29T02:19:50.153979] [INFO ] [MAIN ] NMT: Successfully saved derivative data. [2025-09-29T02:19:50.157293] [INFO ] [MAIN ] Derivative Progress: 1405/2211 symbols completed. NMT took 1.2s. Estimated remaining: 5m 40s. Rate: 142.1 symbols/min [2025-09-29T02:19:50.157947] [INFO ] [MAIN ] NNN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:50.178894] [DEBUG] [MAIN ] NMZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:50.181093] [INFO ] [MAIN ] NMZ: Generated 1820 derivative records from 21872 primary records. [2025-09-29T02:19:50.181915] [DEBUG] [LOCAL ] NMZ: Saving derivative data. [2025-09-29T02:19:50.203746] [DEBUG] [LOCAL ] NMZ: Derivative data saved (1820 records). [2025-09-29T02:19:50.217267] [INFO ] [MAIN ] NMZ: Successfully saved derivative data. [2025-09-29T02:19:50.221033] [INFO ] [MAIN ] Derivative Progress: 1406/2211 symbols completed. NMZ took 1.1s. Estimated remaining: 5m 40s. Rate: 142.2 symbols/min [2025-09-29T02:19:50.221292] [INFO ] [MAIN ] NNY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:50.221831] [DEBUG] [MAIN ] NNI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:50.223185] [INFO ] [MAIN ] NNI: Generated 1820 derivative records from 10159 primary records. [2025-09-29T02:19:50.223431] [DEBUG] [LOCAL ] NNI: Saving derivative data. [2025-09-29T02:19:50.255299] [DEBUG] [LOCAL ] NNY: Loaded 5750 existing records from primary storage. [2025-09-29T02:19:50.256757] [INFO ] [MAIN ] NNY: Loaded 5750 primary data records. [2025-09-29T02:19:50.262702] [DEBUG] [LOCAL ] NNI: Derivative data saved (1820 records). [2025-09-29T02:19:50.319192] [INFO ] [MAIN ] NNI: Successfully saved derivative data. [2025-09-29T02:19:50.369567] [INFO ] [MAIN ] Derivative Progress: 1407/2211 symbols completed. NNI took 1.0s. Estimated remaining: 5m 39s. Rate: 142.3 symbols/min [2025-09-29T02:19:50.392853] [DEBUG] [LOCAL ] NNN: Loaded 49151 existing records from primary storage. [2025-09-29T02:19:50.393174] [INFO ] [MAIN ] NOA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:50.393486] [INFO ] [MAIN ] NNN: Loaded 49151 primary data records. [2025-09-29T02:19:50.760121] [DEBUG] [LOCAL ] NOA: Loaded 16497 existing records from primary storage. [2025-09-29T02:19:50.771704] [INFO ] [MAIN ] NOA: Loaded 16497 primary data records. [2025-09-29T02:19:51.392207] [DEBUG] [MAIN ] NNY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:51.395697] [INFO ] [MAIN ] NNY: Generated 1820 derivative records from 5750 primary records. [2025-09-29T02:19:51.396119] [DEBUG] [LOCAL ] NNY: Saving derivative data. [2025-09-29T02:19:51.413756] [DEBUG] [LOCAL ] NNY: Derivative data saved (1820 records). [2025-09-29T02:19:51.414371] [INFO ] [MAIN ] NNY: Successfully saved derivative data. [2025-09-29T02:19:51.416797] [INFO ] [MAIN ] Derivative Progress: 1408/2211 symbols completed. NNY took 1.2s. Estimated remaining: 5m 39s. Rate: 142.1 symbols/min [2025-09-29T02:19:51.435780] [DEBUG] [MAIN ] NNN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:51.436553] [INFO ] [MAIN ] NNN: Generated 1820 derivative records from 49151 primary records. [2025-09-29T02:19:51.437018] [DEBUG] [LOCAL ] NNN: Saving derivative data. [2025-09-29T02:19:51.456610] [DEBUG] [LOCAL ] NNN: Derivative data saved (1820 records). [2025-09-29T02:19:51.458050] [INFO ] [MAIN ] NNN: Successfully saved derivative data. [2025-09-29T02:19:51.462347] [INFO ] [MAIN ] Derivative Progress: 1409/2211 symbols completed. NNN took 1.3s. Estimated remaining: 5m 38s. Rate: 142.2 symbols/min [2025-09-29T02:19:51.477055] [DEBUG] [MAIN ] NOA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:51.477894] [INFO ] [MAIN ] NOA: Generated 1820 derivative records from 16497 primary records. [2025-09-29T02:19:51.477991] [DEBUG] [LOCAL ] NOA: Saving derivative data. [2025-09-29T02:19:51.494291] [DEBUG] [LOCAL ] NOA: Derivative data saved (1820 records). [2025-09-29T02:19:51.494403] [INFO ] [MAIN ] NOA: Successfully saved derivative data. [2025-09-29T02:19:51.497874] [INFO ] [MAIN ] Derivative Progress: 1410/2211 symbols completed. NOA took 1.1s. Estimated remaining: 5m 38s. Rate: 142.3 symbols/min [2025-09-29T02:19:51.498558] [INFO ] [MAIN ] NOAH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:51.498688] [INFO ] [MAIN ] NOG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:51.499008] [INFO ] [MAIN ] NOC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:51.532243] [DEBUG] [LOCAL ] NOAH: Loaded 20358 existing records from primary storage. [2025-09-29T02:19:51.532423] [INFO ] [MAIN ] NOAH: Loaded 20358 primary data records. [2025-09-29T02:19:51.935118] [DEBUG] [LOCAL ] NOG: Loaded 51932 existing records from primary storage. [2025-09-29T02:19:51.936398] [INFO ] [MAIN ] NOG: Loaded 51932 primary data records. [2025-09-29T02:19:51.942724] [DEBUG] [LOCAL ] NOC: Loaded 43141 existing records from primary storage. [2025-09-29T02:19:51.960864] [INFO ] [MAIN ] NOC: Loaded 43141 primary data records. [2025-09-29T02:19:52.650010] [DEBUG] [MAIN ] NOAH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:52.651560] [INFO ] [MAIN ] NOAH: Generated 1820 derivative records from 20358 primary records. [2025-09-29T02:19:52.652573] [DEBUG] [LOCAL ] NOAH: Saving derivative data. [2025-09-29T02:19:52.671671] [DEBUG] [LOCAL ] NOAH: Derivative data saved (1820 records). [2025-09-29T02:19:52.671926] [INFO ] [MAIN ] NOAH: Successfully saved derivative data. [2025-09-29T02:19:52.675317] [INFO ] [MAIN ] Derivative Progress: 1411/2211 symbols completed. NOAH took 1.2s. Estimated remaining: 5m 38s. Rate: 142.1 symbols/min [2025-09-29T02:19:52.676234] [INFO ] [MAIN ] NOK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:52.699574] [DEBUG] [MAIN ] NOG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:52.701626] [INFO ] [MAIN ] NOG: Generated 1820 derivative records from 51932 primary records. [2025-09-29T02:19:52.703012] [DEBUG] [LOCAL ] NOG: Saving derivative data. [2025-09-29T02:19:52.730100] [DEBUG] [MAIN ] NOC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:52.732625] [INFO ] [MAIN ] NOC: Generated 1820 derivative records from 43141 primary records. [2025-09-29T02:19:52.735886] [DEBUG] [LOCAL ] NOG: Derivative data saved (1820 records). [2025-09-29T02:19:52.736073] [DEBUG] [LOCAL ] NOC: Saving derivative data. [2025-09-29T02:19:52.736702] [INFO ] [MAIN ] NOG: Successfully saved derivative data. [2025-09-29T02:19:52.740027] [INFO ] [MAIN ] Derivative Progress: 1412/2211 symbols completed. NOG took 1.2s. Estimated remaining: 5m 37s. Rate: 142.2 symbols/min [2025-09-29T02:19:52.740232] [INFO ] [MAIN ] NOMD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:52.772023] [DEBUG] [LOCAL ] NOC: Derivative data saved (1820 records). [2025-09-29T02:19:52.772230] [INFO ] [MAIN ] NOC: Successfully saved derivative data. [2025-09-29T02:19:52.775556] [INFO ] [MAIN ] Derivative Progress: 1413/2211 symbols completed. NOC took 1.3s. Estimated remaining: 5m 36s. Rate: 142.3 symbols/min [2025-09-29T02:19:52.775905] [INFO ] [MAIN ] NOTE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:52.805265] [DEBUG] [LOCAL ] NOK: Loaded 54401 existing records from primary storage. [2025-09-29T02:19:52.805637] [INFO ] [MAIN ] NOK: Loaded 54401 primary data records. [2025-09-29T02:19:52.967937] [DEBUG] [LOCAL ] NOMD: Loaded 42016 existing records from primary storage. [2025-09-29T02:19:53.037238] [INFO ] [MAIN ] NOMD: Loaded 42016 primary data records. [2025-09-29T02:19:53.231238] [DEBUG] [LOCAL ] NOTE: Loaded 43143 existing records from primary storage. [2025-09-29T02:19:53.298322] [INFO ] [MAIN ] NOTE: Loaded 43143 primary data records. [2025-09-29T02:19:53.932381] [DEBUG] [MAIN ] NOK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:53.933627] [INFO ] [MAIN ] NOK: Generated 1820 derivative records from 54401 primary records. [2025-09-29T02:19:53.934188] [DEBUG] [LOCAL ] NOK: Saving derivative data. [2025-09-29T02:19:53.952911] [DEBUG] [LOCAL ] NOK: Derivative data saved (1820 records). [2025-09-29T02:19:53.953259] [INFO ] [MAIN ] NOK: Successfully saved derivative data. [2025-09-29T02:19:53.956602] [INFO ] [MAIN ] Derivative Progress: 1414/2211 symbols completed. NOK took 1.3s. Estimated remaining: 5m 37s. Rate: 142.1 symbols/min [2025-09-29T02:19:53.958564] [INFO ] [MAIN ] NOV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:53.977898] [DEBUG] [MAIN ] NOMD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:53.979293] [INFO ] [MAIN ] NOMD: Generated 1820 derivative records from 42016 primary records. [2025-09-29T02:19:53.979556] [DEBUG] [LOCAL ] NOMD: Saving derivative data. [2025-09-29T02:19:54.001597] [DEBUG] [LOCAL ] NOMD: Derivative data saved (1820 records). [2025-09-29T02:19:54.001868] [INFO ] [MAIN ] NOMD: Successfully saved derivative data. [2025-09-29T02:19:54.004936] [INFO ] [MAIN ] Derivative Progress: 1415/2211 symbols completed. NOMD took 1.3s. Estimated remaining: 5m 36s. Rate: 142.2 symbols/min [2025-09-29T02:19:54.005313] [INFO ] [MAIN ] NOW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:54.021333] [DEBUG] [MAIN ] NOTE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:54.022329] [INFO ] [MAIN ] NOTE: Generated 1820 derivative records from 43143 primary records. [2025-09-29T02:19:54.022438] [DEBUG] [LOCAL ] NOTE: Saving derivative data. [2025-09-29T02:19:54.039062] [DEBUG] [LOCAL ] NOTE: Derivative data saved (1820 records). [2025-09-29T02:19:54.039215] [INFO ] [MAIN ] NOTE: Successfully saved derivative data. [2025-09-29T02:19:54.044044] [INFO ] [MAIN ] Derivative Progress: 1416/2211 symbols completed. NOTE took 1.3s. Estimated remaining: 5m 35s. Rate: 142.3 symbols/min [2025-09-29T02:19:54.044431] [INFO ] [MAIN ] NPCT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:54.093956] [DEBUG] [LOCAL ] NOV: Loaded 53961 existing records from primary storage. [2025-09-29T02:19:54.094350] [INFO ] [MAIN ] NOV: Loaded 53961 primary data records. [2025-09-29T02:19:54.176226] [DEBUG] [LOCAL ] NPCT: Loaded 17114 existing records from primary storage. [2025-09-29T02:19:54.188124] [INFO ] [MAIN ] NPCT: Loaded 17114 primary data records. [2025-09-29T02:19:54.265127] [DEBUG] [LOCAL ] NOW: Loaded 49444 existing records from primary storage. [2025-09-29T02:19:54.293439] [INFO ] [MAIN ] NOW: Loaded 49444 primary data records. [2025-09-29T02:19:55.197017] [DEBUG] [MAIN ] NOV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:55.198531] [INFO ] [MAIN ] NOV: Generated 1820 derivative records from 53961 primary records. [2025-09-29T02:19:55.199097] [DEBUG] [LOCAL ] NOV: Saving derivative data. [2025-09-29T02:19:55.221493] [DEBUG] [LOCAL ] NOV: Derivative data saved (1820 records). [2025-09-29T02:19:55.237399] [DEBUG] [MAIN ] NOW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:55.236836] [INFO ] [MAIN ] NOV: Successfully saved derivative data. [2025-09-29T02:19:55.241916] [INFO ] [MAIN ] Derivative Progress: 1417/2211 symbols completed. NOV took 1.3s. Estimated remaining: 5m 35s. Rate: 142.1 symbols/min [2025-09-29T02:19:55.243501] [INFO ] [MAIN ] NPFD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:55.243306] [INFO ] [MAIN ] NOW: Generated 1820 derivative records from 49444 primary records. [2025-09-29T02:19:55.243923] [DEBUG] [LOCAL ] NOW: Saving derivative data. [2025-09-29T02:19:55.276056] [DEBUG] [MAIN ] NPCT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:55.282462] [DEBUG] [LOCAL ] NOW: Derivative data saved (1820 records). [2025-09-29T02:19:55.281074] [INFO ] [MAIN ] NPCT: Generated 1820 derivative records from 17114 primary records. [2025-09-29T02:19:55.282694] [INFO ] [MAIN ] NOW: Successfully saved derivative data. [2025-09-29T02:19:55.282794] [DEBUG] [LOCAL ] NPCT: Saving derivative data. [2025-09-29T02:19:55.291425] [DEBUG] [LOCAL ] NPFD: Loaded 9814 existing records from primary storage. [2025-09-29T02:19:55.286293] [INFO ] [MAIN ] Derivative Progress: 1418/2211 symbols completed. NOW took 1.3s. Estimated remaining: 5m 35s. Rate: 142.2 symbols/min [2025-09-29T02:19:55.292568] [INFO ] [MAIN ] NPFD: Loaded 9814 primary data records. [2025-09-29T02:19:55.292963] [INFO ] [MAIN ] NPK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:55.386315] [DEBUG] [LOCAL ] NPCT: Derivative data saved (1820 records). [2025-09-29T02:19:55.401428] [INFO ] [MAIN ] NPCT: Successfully saved derivative data. [2025-09-29T02:19:55.409915] [INFO ] [MAIN ] Derivative Progress: 1419/2211 symbols completed. NPCT took 1.4s. Estimated remaining: 5m 34s. Rate: 142.3 symbols/min [2025-09-29T02:19:55.418401] [INFO ] [MAIN ] NPO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:55.457040] [DEBUG] [LOCAL ] NPK: Loaded 8120 existing records from primary storage. [2025-09-29T02:19:55.514624] [INFO ] [MAIN ] NPK: Loaded 8120 primary data records. [2025-09-29T02:19:55.775027] [DEBUG] [LOCAL ] NPO: Loaded 13019 existing records from primary storage. [2025-09-29T02:19:55.784021] [INFO ] [MAIN ] NPO: Loaded 13019 primary data records. [2025-09-29T02:19:56.408482] [DEBUG] [MAIN ] NPFD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:56.409636] [INFO ] [MAIN ] NPFD: Generated 1820 derivative records from 9814 primary records. [2025-09-29T02:19:56.411192] [DEBUG] [LOCAL ] NPFD: Saving derivative data. [2025-09-29T02:19:56.432539] [DEBUG] [LOCAL ] NPFD: Derivative data saved (1820 records). [2025-09-29T02:19:56.432870] [INFO ] [MAIN ] NPFD: Successfully saved derivative data. [2025-09-29T02:19:56.436473] [INFO ] [MAIN ] Derivative Progress: 1420/2211 symbols completed. NPFD took 1.2s. Estimated remaining: 5m 34s. Rate: 142.1 symbols/min [2025-09-29T02:19:56.436942] [INFO ] [MAIN ] NPV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:56.459556] [DEBUG] [MAIN ] NPK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:56.460930] [INFO ] [MAIN ] NPK: Generated 1820 derivative records from 8120 primary records. [2025-09-29T02:19:56.461451] [DEBUG] [LOCAL ] NPK: Saving derivative data. [2025-09-29T02:19:56.467023] [DEBUG] [LOCAL ] NPV: Loaded 5070 existing records from primary storage. [2025-09-29T02:19:56.467247] [INFO ] [MAIN ] NPV: Loaded 5070 primary data records. [2025-09-29T02:19:56.546874] [DEBUG] [LOCAL ] NPK: Derivative data saved (1820 records). [2025-09-29T02:19:56.581081] [INFO ] [MAIN ] NPK: Successfully saved derivative data. [2025-09-29T02:19:56.599091] [INFO ] [MAIN ] Derivative Progress: 1421/2211 symbols completed. NPK took 1.3s. Estimated remaining: 5m 33s. Rate: 142.2 symbols/min [2025-09-29T02:19:56.605324] [INFO ] [MAIN ] NPWR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:56.655976] [DEBUG] [MAIN ] NPO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:56.682760] [INFO ] [MAIN ] NPO: Generated 1820 derivative records from 13019 primary records. [2025-09-29T02:19:56.715900] [DEBUG] [LOCAL ] NPO: Saving derivative data. [2025-09-29T02:19:56.865948] [DEBUG] [LOCAL ] NPO: Derivative data saved (1820 records). [2025-09-29T02:19:56.866201] [INFO ] [MAIN ] NPO: Successfully saved derivative data. [2025-09-29T02:19:56.870245] [INFO ] [MAIN ] Derivative Progress: 1422/2211 symbols completed. NPO took 1.5s. Estimated remaining: 5m 33s. Rate: 142.2 symbols/min [2025-09-29T02:19:56.870468] [INFO ] [MAIN ] NQP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:56.906980] [DEBUG] [LOCAL ] NPWR: Loaded 43857 existing records from primary storage. [2025-09-29T02:19:56.908687] [INFO ] [MAIN ] NPWR: Loaded 43857 primary data records. [2025-09-29T02:19:56.913099] [DEBUG] [LOCAL ] NQP: Loaded 9406 existing records from primary storage. [2025-09-29T02:19:56.923711] [INFO ] [MAIN ] NQP: Loaded 9406 primary data records. [2025-09-29T02:19:57.333972] [DEBUG] [MAIN ] NPV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:57.671105] [INFO ] [MAIN ] NPV: Generated 1820 derivative records from 5070 primary records. [2025-09-29T02:19:57.672225] [DEBUG] [LOCAL ] NPV: Saving derivative data. [2025-09-29T02:19:57.693820] [DEBUG] [LOCAL ] NPV: Derivative data saved (1820 records). [2025-09-29T02:19:57.694442] [INFO ] [MAIN ] NPV: Successfully saved derivative data. [2025-09-29T02:19:57.696806] [INFO ] [MAIN ] Derivative Progress: 1423/2211 symbols completed. NPV took 1.3s. Estimated remaining: 5m 33s. Rate: 142.1 symbols/min [2025-09-29T02:19:57.750368] [DEBUG] [MAIN ] NPWR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:57.750747] [DEBUG] [MAIN ] NQP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:57.752447] [INFO ] [MAIN ] NQP: Generated 1820 derivative records from 9406 primary records. [2025-09-29T02:19:57.751696] [INFO ] [MAIN ] NPWR: Generated 1820 derivative records from 43857 primary records. [2025-09-29T02:19:57.752971] [DEBUG] [LOCAL ] NQP: Saving derivative data. [2025-09-29T02:19:57.752850] [DEBUG] [LOCAL ] NPWR: Saving derivative data. [2025-09-29T02:19:57.791370] [DEBUG] [LOCAL ] NQP: Derivative data saved (1820 records). [2025-09-29T02:19:57.795907] [INFO ] [MAIN ] NQP: Successfully saved derivative data. [2025-09-29T02:19:57.795788] [DEBUG] [LOCAL ] NPWR: Derivative data saved (1820 records). [2025-09-29T02:19:57.799377] [INFO ] [MAIN ] Derivative Progress: 1424/2211 symbols completed. NQP took 0.9s. Estimated remaining: 5m 32s. Rate: 142.2 symbols/min [2025-09-29T02:19:57.799635] [INFO ] [MAIN ] NPWR: Successfully saved derivative data. [2025-09-29T02:19:57.803064] [INFO ] [MAIN ] Derivative Progress: 1425/2211 symbols completed. NPWR took 1.2s. Estimated remaining: 5m 31s. Rate: 142.3 symbols/min [2025-09-29T02:19:57.803678] [INFO ] [MAIN ] NRDY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:57.804213] [INFO ] [MAIN ] NREF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:57.803831] [INFO ] [MAIN ] NRG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:57.822164] [DEBUG] [LOCAL ] NREF: Loaded 7957 existing records from primary storage. [2025-09-29T02:19:57.822771] [INFO ] [MAIN ] NREF: Loaded 7957 primary data records. [2025-09-29T02:19:57.982124] [DEBUG] [LOCAL ] NRDY: Loaded 33402 existing records from primary storage. [2025-09-29T02:19:57.982537] [INFO ] [MAIN ] NRDY: Loaded 33402 primary data records. [2025-09-29T02:19:58.207043] [DEBUG] [LOCAL ] NRG: Loaded 53697 existing records from primary storage. [2025-09-29T02:19:58.250344] [INFO ] [MAIN ] NRG: Loaded 53697 primary data records. [2025-09-29T02:19:58.950924] [DEBUG] [MAIN ] NREF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:58.953203] [INFO ] [MAIN ] NREF: Generated 1820 derivative records from 7957 primary records. [2025-09-29T02:19:58.954139] [DEBUG] [LOCAL ] NREF: Saving derivative data. [2025-09-29T02:19:58.976592] [DEBUG] [LOCAL ] NREF: Derivative data saved (1820 records). [2025-09-29T02:19:58.989836] [INFO ] [MAIN ] NREF: Successfully saved derivative data. [2025-09-29T02:19:58.990263] [DEBUG] [MAIN ] NRDY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:58.993857] [INFO ] [MAIN ] Derivative Progress: 1426/2211 symbols completed. NREF took 1.2s. Estimated remaining: 5m 31s. Rate: 142.1 symbols/min [2025-09-29T02:19:58.991289] [INFO ] [MAIN ] NRDY: Generated 1820 derivative records from 33402 primary records. [2025-09-29T02:19:58.994193] [DEBUG] [LOCAL ] NRDY: Saving derivative data. [2025-09-29T02:19:58.995558] [INFO ] [MAIN ] NRGV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:59.012975] [DEBUG] [LOCAL ] NRDY: Derivative data saved (1820 records). [2025-09-29T02:19:59.013404] [INFO ] [MAIN ] NRDY: Successfully saved derivative data. [2025-09-29T02:19:59.017208] [INFO ] [MAIN ] Derivative Progress: 1427/2211 symbols completed. NRDY took 1.2s. Estimated remaining: 5m 31s. Rate: 142.2 symbols/min [2025-09-29T02:19:59.020374] [INFO ] [MAIN ] NRK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:59.034919] [DEBUG] [MAIN ] NRG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:19:59.035789] [INFO ] [MAIN ] NRG: Generated 1820 derivative records from 53697 primary records. [2025-09-29T02:19:59.035906] [DEBUG] [LOCAL ] NRG: Saving derivative data. [2025-09-29T02:19:59.067457] [DEBUG] [LOCAL ] NRG: Derivative data saved (1820 records). [2025-09-29T02:19:59.067675] [INFO ] [MAIN ] NRG: Successfully saved derivative data. [2025-09-29T02:19:59.070308] [INFO ] [MAIN ] Derivative Progress: 1428/2211 symbols completed. NRG took 1.3s. Estimated remaining: 5m 30s. Rate: 142.3 symbols/min [2025-09-29T02:19:59.070704] [INFO ] [MAIN ] NRP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:19:59.082723] [DEBUG] [LOCAL ] NRK: Loaded 19991 existing records from primary storage. [2025-09-29T02:19:59.082962] [INFO ] [MAIN ] NRK: Loaded 19991 primary data records. [2025-09-29T02:19:59.108886] [DEBUG] [LOCAL ] NRP: Loaded 4114 existing records from primary storage. [2025-09-29T02:19:59.151027] [INFO ] [MAIN ] NRP: Loaded 4114 primary data records. [2025-09-29T02:19:59.174495] [DEBUG] [LOCAL ] NRGV: Loaded 43716 existing records from primary storage. [2025-09-29T02:19:59.187831] [INFO ] [MAIN ] NRGV: Loaded 43716 primary data records. [2025-09-29T02:20:00.198711] [DEBUG] [MAIN ] NRK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:00.200340] [INFO ] [MAIN ] NRK: Generated 1820 derivative records from 19991 primary records. [2025-09-29T02:20:00.199000] [DEBUG] [MAIN ] NRP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:00.200702] [DEBUG] [LOCAL ] NRK: Saving derivative data. [2025-09-29T02:20:00.201364] [INFO ] [MAIN ] NRP: Generated 1820 derivative records from 4114 primary records. [2025-09-29T02:20:00.202569] [DEBUG] [LOCAL ] NRP: Saving derivative data. [2025-09-29T02:20:00.222157] [DEBUG] [LOCAL ] NRK: Derivative data saved (1820 records). [2025-09-29T02:20:00.222536] [INFO ] [MAIN ] NRK: Successfully saved derivative data. [2025-09-29T02:20:00.236325] [INFO ] [MAIN ] Derivative Progress: 1429/2211 symbols completed. NRK took 1.2s. Estimated remaining: 5m 30s. Rate: 142.1 symbols/min [2025-09-29T02:20:00.236946] [INFO ] [MAIN ] NRT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:00.255562] [DEBUG] [MAIN ] NRGV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:00.257800] [INFO ] [MAIN ] NRGV: Generated 1820 derivative records from 43716 primary records. [2025-09-29T02:20:00.256890] [DEBUG] [LOCAL ] NRP: Derivative data saved (1820 records). [2025-09-29T02:20:00.258137] [INFO ] [MAIN ] NRP: Successfully saved derivative data. [2025-09-29T02:20:00.258065] [DEBUG] [LOCAL ] NRGV: Saving derivative data. [2025-09-29T02:20:00.261265] [INFO ] [MAIN ] Derivative Progress: 1430/2211 symbols completed. NRP took 1.2s. Estimated remaining: 5m 30s. Rate: 142.2 symbols/min [2025-09-29T02:20:00.262382] [INFO ] [MAIN ] NRUC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:00.276133] [DEBUG] [LOCAL ] NRT: Loaded 4994 existing records from primary storage. [2025-09-29T02:20:00.276429] [INFO ] [MAIN ] NRT: Loaded 4994 primary data records. [2025-09-29T02:20:00.325994] [DEBUG] [LOCAL ] NRUC: Loaded 3136 existing records from primary storage. [2025-09-29T02:20:00.360285] [DEBUG] [LOCAL ] NRGV: Derivative data saved (1820 records). [2025-09-29T02:20:00.374596] [INFO ] [MAIN ] NRGV: Successfully saved derivative data. [2025-09-29T02:20:00.385078] [INFO ] [MAIN ] NRUC: Loaded 3136 primary data records. [2025-09-29T02:20:00.410931] [INFO ] [MAIN ] Derivative Progress: 1431/2211 symbols completed. NRGV took 1.4s. Estimated remaining: 5m 29s. Rate: 142.3 symbols/min [2025-09-29T02:20:00.496750] [INFO ] [MAIN ] NSA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:01.044704] [DEBUG] [MAIN ] NRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:01.047396] [INFO ] [MAIN ] NRT: Generated 1820 derivative records from 4994 primary records. [2025-09-29T02:20:01.047852] [DEBUG] [LOCAL ] NRT: Saving derivative data. [2025-09-29T02:20:01.058781] [DEBUG] [LOCAL ] NSA: Loaded 45528 existing records from primary storage. [2025-09-29T02:20:01.062919] [INFO ] [MAIN ] NSA: Loaded 45528 primary data records. [2025-09-29T02:20:01.071930] [DEBUG] [LOCAL ] NRT: Derivative data saved (1820 records). [2025-09-29T02:20:01.103618] [INFO ] [MAIN ] NRT: Successfully saved derivative data. [2025-09-29T02:20:01.148232] [INFO ] [MAIN ] Derivative Progress: 1432/2211 symbols completed. NRT took 0.9s. Estimated remaining: 5m 29s. Rate: 142.2 symbols/min [2025-09-29T02:20:01.175462] [INFO ] [MAIN ] NSC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:01.194615] [DEBUG] [MAIN ] NRUC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:01.209510] [INFO ] [MAIN ] NRUC: Generated 1820 derivative records from 3136 primary records. [2025-09-29T02:20:01.226697] [DEBUG] [LOCAL ] NRUC: Saving derivative data. [2025-09-29T02:20:01.457259] [DEBUG] [LOCAL ] NRUC: Derivative data saved (1820 records). [2025-09-29T02:20:01.457906] [INFO ] [MAIN ] NRUC: Successfully saved derivative data. [2025-09-29T02:20:01.461137] [INFO ] [MAIN ] Derivative Progress: 1433/2211 symbols completed. NRUC took 1.2s. Estimated remaining: 5m 28s. Rate: 142.2 symbols/min [2025-09-29T02:20:01.462471] [INFO ] [MAIN ] NSP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:01.512347] [DEBUG] [LOCAL ] NSC: Loaded 49879 existing records from primary storage. [2025-09-29T02:20:01.537197] [DEBUG] [MAIN ] NSA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:01.539001] [INFO ] [MAIN ] NSA: Generated 1820 derivative records from 45528 primary records. [2025-09-29T02:20:01.537515] [INFO ] [MAIN ] NSC: Loaded 49879 primary data records. [2025-09-29T02:20:01.539360] [DEBUG] [LOCAL ] NSA: Saving derivative data. [2025-09-29T02:20:01.657076] [DEBUG] [LOCAL ] NSA: Derivative data saved (1820 records). [2025-09-29T02:20:01.650571] [DEBUG] [LOCAL ] NSP: Loaded 35480 existing records from primary storage. [2025-09-29T02:20:01.686746] [INFO ] [MAIN ] NSA: Successfully saved derivative data. [2025-09-29T02:20:01.700739] [INFO ] [MAIN ] NSP: Loaded 35480 primary data records. [2025-09-29T02:20:01.704268] [INFO ] [MAIN ] Derivative Progress: 1434/2211 symbols completed. NSA took 1.2s. Estimated remaining: 5m 28s. Rate: 142.3 symbols/min [2025-09-29T02:20:01.720845] [INFO ] [MAIN ] NTB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:02.169464] [DEBUG] [LOCAL ] NTB: Loaded 20927 existing records from primary storage. [2025-09-29T02:20:02.323706] [INFO ] [MAIN ] NTB: Loaded 20927 primary data records. [2025-09-29T02:20:02.717739] [DEBUG] [MAIN ] NSC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:02.720463] [INFO ] [MAIN ] NSC: Generated 1820 derivative records from 49879 primary records. [2025-09-29T02:20:02.720773] [DEBUG] [LOCAL ] NSC: Saving derivative data. [2025-09-29T02:20:02.749920] [DEBUG] [MAIN ] NSP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:02.753457] [INFO ] [MAIN ] NSP: Generated 1820 derivative records from 35480 primary records. [2025-09-29T02:20:02.753841] [DEBUG] [LOCAL ] NSP: Saving derivative data. [2025-09-29T02:20:02.764543] [DEBUG] [LOCAL ] NSC: Derivative data saved (1820 records). [2025-09-29T02:20:02.773770] [INFO ] [MAIN ] NSC: Successfully saved derivative data. [2025-09-29T02:20:02.776682] [INFO ] [MAIN ] Derivative Progress: 1435/2211 symbols completed. NSC took 1.6s. Estimated remaining: 5m 28s. Rate: 142.1 symbols/min [2025-09-29T02:20:02.777171] [INFO ] [MAIN ] NTR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:02.773829] [DEBUG] [LOCAL ] NSP: Derivative data saved (1820 records). [2025-09-29T02:20:02.777741] [INFO ] [MAIN ] NSP: Successfully saved derivative data. [2025-09-29T02:20:02.781269] [INFO ] [MAIN ] Derivative Progress: 1436/2211 symbols completed. NSP took 1.3s. Estimated remaining: 5m 27s. Rate: 142.2 symbols/min [2025-09-29T02:20:02.781871] [INFO ] [MAIN ] NTST: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:02.803445] [DEBUG] [MAIN ] NTB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:02.804342] [INFO ] [MAIN ] NTB: Generated 1820 derivative records from 20927 primary records. [2025-09-29T02:20:02.804430] [DEBUG] [LOCAL ] NTB: Saving derivative data. [2025-09-29T02:20:02.821852] [DEBUG] [LOCAL ] NTB: Derivative data saved (1820 records). [2025-09-29T02:20:02.822028] [INFO ] [MAIN ] NTB: Successfully saved derivative data. [2025-09-29T02:20:02.825096] [INFO ] [MAIN ] Derivative Progress: 1437/2211 symbols completed. NTB took 1.1s. Estimated remaining: 5m 26s. Rate: 142.3 symbols/min [2025-09-29T02:20:02.825407] [INFO ] [MAIN ] NU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:02.894961] [DEBUG] [LOCAL ] NTR: Loaded 53356 existing records from primary storage. [2025-09-29T02:20:02.895523] [INFO ] [MAIN ] NTR: Loaded 53356 primary data records. [2025-09-29T02:20:02.914449] [DEBUG] [LOCAL ] NTST: Loaded 44211 existing records from primary storage. [2025-09-29T02:20:02.943528] [INFO ] [MAIN ] NTST: Loaded 44211 primary data records. [2025-09-29T02:20:03.313720] [DEBUG] [LOCAL ] NU: Loaded 54526 existing records from primary storage. [2025-09-29T02:20:03.437163] [INFO ] [MAIN ] NU: Loaded 54526 primary data records. [2025-09-29T02:20:03.985786] [DEBUG] [MAIN ] NTST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:03.999266] [INFO ] [MAIN ] NTST: Generated 1820 derivative records from 44211 primary records. [2025-09-29T02:20:04.000442] [DEBUG] [MAIN ] NTR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:04.002550] [DEBUG] [LOCAL ] NTST: Saving derivative data. [2025-09-29T02:20:04.002446] [INFO ] [MAIN ] NTR: Generated 1820 derivative records from 53356 primary records. [2025-09-29T02:20:04.002859] [DEBUG] [LOCAL ] NTR: Saving derivative data. [2025-09-29T02:20:04.042370] [DEBUG] [LOCAL ] NTST: Derivative data saved (1820 records). [2025-09-29T02:20:04.042842] [INFO ] [MAIN ] NTST: Successfully saved derivative data. [2025-09-29T02:20:04.041218] [DEBUG] [LOCAL ] NTR: Derivative data saved (1820 records). [2025-09-29T02:20:04.046489] [INFO ] [MAIN ] Derivative Progress: 1438/2211 symbols completed. NTST took 1.3s. Estimated remaining: 5m 26s. Rate: 142.1 symbols/min [2025-09-29T02:20:04.043167] [INFO ] [MAIN ] NTR: Successfully saved derivative data. [2025-09-29T02:20:04.050510] [INFO ] [MAIN ] Derivative Progress: 1439/2211 symbols completed. NTR took 1.3s. Estimated remaining: 5m 26s. Rate: 142.2 symbols/min [2025-09-29T02:20:04.069446] [DEBUG] [MAIN ] NU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:04.070533] [INFO ] [MAIN ] NU: Generated 1820 derivative records from 54526 primary records. [2025-09-29T02:20:04.070677] [DEBUG] [LOCAL ] NU: Saving derivative data. [2025-09-29T02:20:04.089177] [DEBUG] [LOCAL ] NU: Derivative data saved (1820 records). [2025-09-29T02:20:04.089348] [INFO ] [MAIN ] NU: Successfully saved derivative data. [2025-09-29T02:20:04.093253] [INFO ] [MAIN ] Derivative Progress: 1440/2211 symbols completed. NU took 1.3s. Estimated remaining: 5m 25s. Rate: 142.3 symbols/min [2025-09-29T02:20:04.094117] [INFO ] [MAIN ] NUVB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:04.093982] [INFO ] [MAIN ] NUS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:04.094250] [INFO ] [MAIN ] NUV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:04.153964] [DEBUG] [LOCAL ] NUV: Loaded 23576 existing records from primary storage. [2025-09-29T02:20:04.154351] [INFO ] [MAIN ] NUV: Loaded 23576 primary data records. [2025-09-29T02:20:04.279441] [DEBUG] [LOCAL ] NUS: Loaded 37005 existing records from primary storage. [2025-09-29T02:20:04.300506] [DEBUG] [LOCAL ] NUVB: Loaded 51998 existing records from primary storage. [2025-09-29T02:20:04.306777] [INFO ] [MAIN ] NUVB: Loaded 51998 primary data records. [2025-09-29T02:20:04.300946] [INFO ] [MAIN ] NUS: Loaded 37005 primary data records. [2025-09-29T02:20:05.261022] [DEBUG] [MAIN ] NUV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:05.262410] [INFO ] [MAIN ] NUV: Generated 1820 derivative records from 23576 primary records. [2025-09-29T02:20:05.262528] [DEBUG] [LOCAL ] NUV: Saving derivative data. [2025-09-29T02:20:05.307569] [DEBUG] [LOCAL ] NUV: Derivative data saved (1820 records). [2025-09-29T02:20:05.312887] [INFO ] [MAIN ] NUV: Successfully saved derivative data. [2025-09-29T02:20:05.307431] [DEBUG] [MAIN ] NUVB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:05.313690] [DEBUG] [MAIN ] NUS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:05.314709] [INFO ] [MAIN ] NUVB: Generated 1820 derivative records from 51998 primary records. [2025-09-29T02:20:05.318742] [INFO ] [MAIN ] NUS: Generated 1820 derivative records from 37005 primary records. [2025-09-29T02:20:05.318958] [DEBUG] [LOCAL ] NUVB: Saving derivative data. [2025-09-29T02:20:05.317572] [INFO ] [MAIN ] Derivative Progress: 1441/2211 symbols completed. NUV took 1.2s. Estimated remaining: 5m 25s. Rate: 142.1 symbols/min [2025-09-29T02:20:05.319700] [DEBUG] [LOCAL ] NUS: Saving derivative data. [2025-09-29T02:20:05.321144] [INFO ] [MAIN ] NUW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:05.355577] [DEBUG] [LOCAL ] NUS: Derivative data saved (1820 records). [2025-09-29T02:20:05.358081] [INFO ] [MAIN ] NUS: Successfully saved derivative data. [2025-09-29T02:20:05.365489] [INFO ] [MAIN ] Derivative Progress: 1442/2211 symbols completed. NUS took 1.3s. Estimated remaining: 5m 24s. Rate: 142.2 symbols/min [2025-09-29T02:20:05.357921] [DEBUG] [LOCAL ] NUVB: Derivative data saved (1820 records). [2025-09-29T02:20:05.366487] [INFO ] [MAIN ] NVG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:05.366729] [INFO ] [MAIN ] NUVB: Successfully saved derivative data. [2025-09-29T02:20:05.370913] [INFO ] [MAIN ] Derivative Progress: 1443/2211 symbols completed. NUVB took 1.3s. Estimated remaining: 5m 24s. Rate: 142.3 symbols/min [2025-09-29T02:20:05.366263] [DEBUG] [LOCAL ] NUW: Loaded 7512 existing records from primary storage. [2025-09-29T02:20:05.371401] [INFO ] [MAIN ] NVGS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:05.371543] [INFO ] [MAIN ] NUW: Loaded 7512 primary data records. [2025-09-29T02:20:05.719170] [DEBUG] [LOCAL ] NVG: Loaded 27703 existing records from primary storage. [2025-09-29T02:20:05.734907] [DEBUG] [LOCAL ] NVGS: Loaded 31403 existing records from primary storage. [2025-09-29T02:20:05.735369] [INFO ] [MAIN ] NVGS: Loaded 31403 primary data records. [2025-09-29T02:20:05.735217] [INFO ] [MAIN ] NVG: Loaded 27703 primary data records. [2025-09-29T02:20:06.505553] [DEBUG] [MAIN ] NUW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:06.508272] [INFO ] [MAIN ] NUW: Generated 1820 derivative records from 7512 primary records. [2025-09-29T02:20:06.509597] [DEBUG] [LOCAL ] NUW: Saving derivative data. [2025-09-29T02:20:06.530847] [DEBUG] [LOCAL ] NUW: Derivative data saved (1820 records). [2025-09-29T02:20:06.531249] [INFO ] [MAIN ] NUW: Successfully saved derivative data. [2025-09-29T02:20:06.535239] [INFO ] [MAIN ] Derivative Progress: 1444/2211 symbols completed. NUW took 1.2s. Estimated remaining: 5m 24s. Rate: 142.1 symbols/min [2025-09-29T02:20:06.535871] [INFO ] [MAIN ] NVO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:06.558969] [DEBUG] [MAIN ] NVGS: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:20:06.572339] [DEBUG] [MAIN ] NVG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:06.574132] [INFO ] [MAIN ] NVGS: Generated 1819 derivative records from 31403 primary records. [2025-09-29T02:20:06.574280] [DEBUG] [LOCAL ] NVGS: Saving derivative data. [2025-09-29T02:20:06.573282] [INFO ] [MAIN ] NVG: Generated 1820 derivative records from 27703 primary records. [2025-09-29T02:20:06.574829] [DEBUG] [LOCAL ] NVG: Saving derivative data. [2025-09-29T02:20:06.610703] [DEBUG] [LOCAL ] NVGS: Derivative data saved (1819 records). [2025-09-29T02:20:06.609249] [DEBUG] [LOCAL ] NVG: Derivative data saved (1820 records). [2025-09-29T02:20:06.611022] [INFO ] [MAIN ] NVG: Successfully saved derivative data. [2025-09-29T02:20:06.614288] [INFO ] [MAIN ] Derivative Progress: 1445/2211 symbols completed. NVG took 1.2s. Estimated remaining: 5m 23s. Rate: 142.2 symbols/min [2025-09-29T02:20:06.611088] [INFO ] [MAIN ] NVGS: Successfully saved derivative data. [2025-09-29T02:20:06.617590] [INFO ] [MAIN ] NVR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:06.617887] [INFO ] [MAIN ] Derivative Progress: 1446/2211 symbols completed. NVGS took 1.2s. Estimated remaining: 5m 23s. Rate: 142.3 symbols/min [2025-09-29T02:20:06.618463] [INFO ] [MAIN ] NVRI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:06.662970] [DEBUG] [LOCAL ] NVO: Loaded 54564 existing records from primary storage. [2025-09-29T02:20:06.671256] [DEBUG] [LOCAL ] NVR: Loaded 19323 existing records from primary storage. [2025-09-29T02:20:06.671516] [INFO ] [MAIN ] NVO: Loaded 54564 primary data records. [2025-09-29T02:20:06.680774] [INFO ] [MAIN ] NVR: Loaded 19323 primary data records. [2025-09-29T02:20:06.908615] [DEBUG] [LOCAL ] NVRI: Loaded 39367 existing records from primary storage. [2025-09-29T02:20:06.932030] [INFO ] [MAIN ] NVRI: Loaded 39367 primary data records. [2025-09-29T02:20:07.747461] [DEBUG] [MAIN ] NVR: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:20:07.763118] [DEBUG] [MAIN ] NVO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:07.762469] [INFO ] [MAIN ] NVR: Generated 1819 derivative records from 19323 primary records. [2025-09-29T02:20:07.764101] [DEBUG] [LOCAL ] NVR: Saving derivative data. [2025-09-29T02:20:07.764882] [INFO ] [MAIN ] NVO: Generated 1820 derivative records from 54564 primary records. [2025-09-29T02:20:07.766094] [DEBUG] [LOCAL ] NVO: Saving derivative data. [2025-09-29T02:20:07.802444] [DEBUG] [LOCAL ] NVR: Derivative data saved (1819 records). [2025-09-29T02:20:07.801294] [DEBUG] [LOCAL ] NVO: Derivative data saved (1820 records). [2025-09-29T02:20:07.802962] [INFO ] [MAIN ] NVR: Successfully saved derivative data. [2025-09-29T02:20:07.803055] [INFO ] [MAIN ] NVO: Successfully saved derivative data. [2025-09-29T02:20:07.806329] [INFO ] [MAIN ] Derivative Progress: 1447/2211 symbols completed. NVR took 1.2s. Estimated remaining: 5m 23s. Rate: 142.1 symbols/min [2025-09-29T02:20:07.811686] [INFO ] [MAIN ] Derivative Progress: 1448/2211 symbols completed. NVO took 1.3s. Estimated remaining: 5m 22s. Rate: 142.2 symbols/min [2025-09-29T02:20:07.811551] [INFO ] [MAIN ] NVS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:07.812298] [INFO ] [MAIN ] NVST: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:07.838325] [DEBUG] [MAIN ] NVRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:07.839536] [INFO ] [MAIN ] NVRI: Generated 1820 derivative records from 39367 primary records. [2025-09-29T02:20:07.839879] [DEBUG] [LOCAL ] NVRI: Saving derivative data. [2025-09-29T02:20:07.863299] [DEBUG] [LOCAL ] NVRI: Derivative data saved (1820 records). [2025-09-29T02:20:07.863524] [INFO ] [MAIN ] NVRI: Successfully saved derivative data. [2025-09-29T02:20:07.868001] [INFO ] [MAIN ] Derivative Progress: 1449/2211 symbols completed. NVRI took 1.2s. Estimated remaining: 5m 21s. Rate: 142.3 symbols/min [2025-09-29T02:20:07.868577] [INFO ] [MAIN ] NVT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:07.934319] [DEBUG] [LOCAL ] NVST: Loaded 52381 existing records from primary storage. [2025-09-29T02:20:07.934617] [INFO ] [MAIN ] NVST: Loaded 52381 primary data records. [2025-09-29T02:20:08.049830] [DEBUG] [LOCAL ] NVS: Loaded 52338 existing records from primary storage. [2025-09-29T02:20:08.088523] [INFO ] [MAIN ] NVS: Loaded 52338 primary data records. [2025-09-29T02:20:08.279685] [DEBUG] [LOCAL ] NVT: Loaded 52330 existing records from primary storage. [2025-09-29T02:20:08.280088] [INFO ] [MAIN ] NVT: Loaded 52330 primary data records. [2025-09-29T02:20:09.102319] [DEBUG] [MAIN ] NVST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:09.103957] [INFO ] [MAIN ] NVST: Generated 1820 derivative records from 52381 primary records. [2025-09-29T02:20:09.104423] [DEBUG] [LOCAL ] NVST: Saving derivative data. [2025-09-29T02:20:09.132792] [DEBUG] [LOCAL ] NVST: Derivative data saved (1820 records). [2025-09-29T02:20:09.158295] [DEBUG] [MAIN ] NVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:09.158403] [INFO ] [MAIN ] NVST: Successfully saved derivative data. [2025-09-29T02:20:09.162191] [INFO ] [MAIN ] Derivative Progress: 1450/2211 symbols completed. NVST took 1.3s. Estimated remaining: 5m 21s. Rate: 142.1 symbols/min [2025-09-29T02:20:09.162465] [INFO ] [MAIN ] NWG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:09.163533] [INFO ] [MAIN ] NVT: Generated 1820 derivative records from 52330 primary records. [2025-09-29T02:20:09.159092] [DEBUG] [MAIN ] NVS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:09.164843] [INFO ] [MAIN ] NVS: Generated 1820 derivative records from 52338 primary records. [2025-09-29T02:20:09.165010] [DEBUG] [LOCAL ] NVT: Saving derivative data. [2025-09-29T02:20:09.165472] [DEBUG] [LOCAL ] NVS: Saving derivative data. [2025-09-29T02:20:09.199123] [DEBUG] [LOCAL ] NVT: Derivative data saved (1820 records). [2025-09-29T02:20:09.198744] [DEBUG] [LOCAL ] NVS: Derivative data saved (1820 records). [2025-09-29T02:20:09.199406] [INFO ] [MAIN ] NVS: Successfully saved derivative data. [2025-09-29T02:20:09.202470] [INFO ] [MAIN ] Derivative Progress: 1451/2211 symbols completed. NVS took 1.4s. Estimated remaining: 5m 21s. Rate: 142.2 symbols/min [2025-09-29T02:20:09.199472] [INFO ] [MAIN ] NVT: Successfully saved derivative data. [2025-09-29T02:20:09.206547] [INFO ] [MAIN ] Derivative Progress: 1452/2211 symbols completed. NVT took 1.3s. Estimated remaining: 5m 20s. Rate: 142.3 symbols/min [2025-09-29T02:20:09.206290] [INFO ] [MAIN ] NWN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:09.206777] [INFO ] [MAIN ] NX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:09.263050] [DEBUG] [LOCAL ] NWN: Loaded 27222 existing records from primary storage. [2025-09-29T02:20:09.278375] [INFO ] [MAIN ] NWN: Loaded 27222 primary data records. [2025-09-29T02:20:09.281436] [DEBUG] [LOCAL ] NWG: Loaded 52318 existing records from primary storage. [2025-09-29T02:20:09.303407] [INFO ] [MAIN ] NWG: Loaded 52318 primary data records. [2025-09-29T02:20:09.345479] [DEBUG] [LOCAL ] NX: Loaded 33894 existing records from primary storage. [2025-09-29T02:20:09.374689] [INFO ] [MAIN ] NX: Loaded 33894 primary data records. [2025-09-29T02:20:10.325960] [DEBUG] [MAIN ] NWN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:10.334544] [INFO ] [MAIN ] NWN: Generated 1820 derivative records from 27222 primary records. [2025-09-29T02:20:10.340009] [DEBUG] [LOCAL ] NWN: Saving derivative data. [2025-09-29T02:20:10.340318] [DEBUG] [MAIN ] NWG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:10.341695] [INFO ] [MAIN ] NWG: Generated 1820 derivative records from 52318 primary records. [2025-09-29T02:20:10.341823] [DEBUG] [LOCAL ] NWG: Saving derivative data. [2025-09-29T02:20:10.375209] [DEBUG] [LOCAL ] NWN: Derivative data saved (1820 records). [2025-09-29T02:20:10.377947] [INFO ] [MAIN ] NWN: Successfully saved derivative data. [2025-09-29T02:20:10.378104] [DEBUG] [LOCAL ] NWG: Derivative data saved (1820 records). [2025-09-29T02:20:10.378371] [INFO ] [MAIN ] NWG: Successfully saved derivative data. [2025-09-29T02:20:10.381236] [INFO ] [MAIN ] Derivative Progress: 1453/2211 symbols completed. NWN took 1.2s. Estimated remaining: 5m 20s. Rate: 142.1 symbols/min [2025-09-29T02:20:10.385054] [INFO ] [MAIN ] Derivative Progress: 1454/2211 symbols completed. NWG took 1.2s. Estimated remaining: 5m 19s. Rate: 142.2 symbols/min [2025-09-29T02:20:10.400891] [DEBUG] [MAIN ] NX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:10.401579] [INFO ] [MAIN ] NX: Generated 1820 derivative records from 33894 primary records. [2025-09-29T02:20:10.401727] [DEBUG] [LOCAL ] NX: Saving derivative data. [2025-09-29T02:20:10.418446] [DEBUG] [LOCAL ] NX: Derivative data saved (1820 records). [2025-09-29T02:20:10.418632] [INFO ] [MAIN ] NX: Successfully saved derivative data. [2025-09-29T02:20:10.421955] [INFO ] [MAIN ] Derivative Progress: 1455/2211 symbols completed. NX took 1.2s. Estimated remaining: 5m 19s. Rate: 142.3 symbols/min [2025-09-29T02:20:10.422474] [INFO ] [MAIN ] NXDT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:10.422605] [INFO ] [MAIN ] NXE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:10.422733] [INFO ] [MAIN ] NXC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:10.441203] [DEBUG] [LOCAL ] NXC: Loaded 4313 existing records from primary storage. [2025-09-29T02:20:10.441557] [INFO ] [MAIN ] NXC: Loaded 4313 primary data records. [2025-09-29T02:20:10.542026] [DEBUG] [LOCAL ] NXDT: Loaded 16531 existing records from primary storage. [2025-09-29T02:20:10.567204] [INFO ] [MAIN ] NXDT: Loaded 16531 primary data records. [2025-09-29T02:20:10.987498] [DEBUG] [LOCAL ] NXE: Loaded 53762 existing records from primary storage. [2025-09-29T02:20:11.000232] [INFO ] [MAIN ] NXE: Loaded 53762 primary data records. [2025-09-29T02:20:11.597891] [DEBUG] [MAIN ] NXC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:11.599001] [INFO ] [MAIN ] NXC: Generated 1820 derivative records from 4313 primary records. [2025-09-29T02:20:11.599244] [DEBUG] [LOCAL ] NXC: Saving derivative data. [2025-09-29T02:20:11.620110] [DEBUG] [LOCAL ] NXC: Derivative data saved (1820 records). [2025-09-29T02:20:11.633882] [INFO ] [MAIN ] NXC: Successfully saved derivative data. [2025-09-29T02:20:11.636736] [INFO ] [MAIN ] Derivative Progress: 1456/2211 symbols completed. NXC took 1.2s. Estimated remaining: 5m 19s. Rate: 142.1 symbols/min [2025-09-29T02:20:11.637118] [DEBUG] [MAIN ] NXDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:11.637664] [INFO ] [MAIN ] NXG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:11.639289] [INFO ] [MAIN ] NXDT: Generated 1820 derivative records from 16531 primary records. [2025-09-29T02:20:11.639776] [DEBUG] [LOCAL ] NXDT: Saving derivative data. [2025-09-29T02:20:11.676262] [DEBUG] [MAIN ] NXE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:11.675577] [DEBUG] [LOCAL ] NXDT: Derivative data saved (1820 records). [2025-09-29T02:20:11.676603] [INFO ] [MAIN ] NXDT: Successfully saved derivative data. [2025-09-29T02:20:11.677546] [INFO ] [MAIN ] NXE: Generated 1820 derivative records from 53762 primary records. [2025-09-29T02:20:11.680433] [INFO ] [MAIN ] Derivative Progress: 1457/2211 symbols completed. NXDT took 1.3s. Estimated remaining: 5m 18s. Rate: 142.2 symbols/min [2025-09-29T02:20:11.680949] [INFO ] [MAIN ] NXJ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:11.680808] [DEBUG] [LOCAL ] NXE: Saving derivative data. [2025-09-29T02:20:11.688563] [DEBUG] [LOCAL ] NXG: Loaded 10647 existing records from primary storage. [2025-09-29T02:20:11.700598] [INFO ] [MAIN ] NXG: Loaded 10647 primary data records. [2025-09-29T02:20:11.769991] [DEBUG] [LOCAL ] NXE: Derivative data saved (1820 records). [2025-09-29T02:20:11.822568] [INFO ] [MAIN ] NXE: Successfully saved derivative data. [2025-09-29T02:20:11.839905] [DEBUG] [LOCAL ] NXJ: Loaded 15066 existing records from primary storage. [2025-09-29T02:20:11.840167] [INFO ] [MAIN ] NXJ: Loaded 15066 primary data records. [2025-09-29T02:20:11.844226] [INFO ] [MAIN ] Derivative Progress: 1458/2211 symbols completed. NXE took 1.4s. Estimated remaining: 5m 18s. Rate: 142.3 symbols/min [2025-09-29T02:20:11.866987] [INFO ] [MAIN ] NXN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:12.183730] [DEBUG] [LOCAL ] NXN: Loaded 2376 existing records from primary storage. [2025-09-29T02:20:12.230316] [INFO ] [MAIN ] NXN: Loaded 2376 primary data records. [2025-09-29T02:20:12.740332] [DEBUG] [MAIN ] NXG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:12.742906] [INFO ] [MAIN ] NXG: Generated 1820 derivative records from 10647 primary records. [2025-09-29T02:20:12.743432] [DEBUG] [LOCAL ] NXG: Saving derivative data. [2025-09-29T02:20:12.766517] [DEBUG] [LOCAL ] NXG: Derivative data saved (1820 records). [2025-09-29T02:20:12.781379] [INFO ] [MAIN ] NXG: Successfully saved derivative data. [2025-09-29T02:20:12.782113] [DEBUG] [MAIN ] NXJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:12.787215] [INFO ] [MAIN ] NXJ: Generated 1820 derivative records from 15066 primary records. [2025-09-29T02:20:12.785839] [INFO ] [MAIN ] Derivative Progress: 1459/2211 symbols completed. NXG took 1.1s. Estimated remaining: 5m 17s. Rate: 142.1 symbols/min [2025-09-29T02:20:12.787534] [INFO ] [MAIN ] NXP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:12.787620] [DEBUG] [LOCAL ] NXJ: Saving derivative data. [2025-09-29T02:20:12.807609] [DEBUG] [LOCAL ] NXJ: Derivative data saved (1820 records). [2025-09-29T02:20:12.808232] [INFO ] [MAIN ] NXJ: Successfully saved derivative data. [2025-09-29T02:20:12.811934] [INFO ] [MAIN ] Derivative Progress: 1460/2211 symbols completed. NXJ took 1.1s. Estimated remaining: 5m 17s. Rate: 142.2 symbols/min [2025-09-29T02:20:12.815987] [INFO ] [MAIN ] NXRT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:12.826154] [DEBUG] [LOCAL ] NXP: Loaded 12465 existing records from primary storage. [2025-09-29T02:20:12.839245] [INFO ] [MAIN ] NXP: Loaded 12465 primary data records. [2025-09-29T02:20:12.839772] [DEBUG] [MAIN ] NXN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:12.873677] [INFO ] [MAIN ] NXN: Generated 1820 derivative records from 2376 primary records. [2025-09-29T02:20:12.900978] [DEBUG] [LOCAL ] NXN: Saving derivative data. [2025-09-29T02:20:13.006098] [DEBUG] [LOCAL ] NXRT: Loaded 19307 existing records from primary storage. [2025-09-29T02:20:13.022725] [INFO ] [MAIN ] NXRT: Loaded 19307 primary data records. [2025-09-29T02:20:13.326910] [DEBUG] [LOCAL ] NXN: Derivative data saved (1820 records). [2025-09-29T02:20:13.379919] [INFO ] [MAIN ] NXN: Successfully saved derivative data. [2025-09-29T02:20:13.402894] [INFO ] [MAIN ] Derivative Progress: 1461/2211 symbols completed. NXN took 1.5s. Estimated remaining: 5m 16s. Rate: 142.2 symbols/min [2025-09-29T02:20:13.434221] [INFO ] [MAIN ] NYT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:13.658465] [DEBUG] [MAIN ] NXP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:13.660120] [INFO ] [MAIN ] NXP: Generated 1820 derivative records from 12465 primary records. [2025-09-29T02:20:13.660322] [DEBUG] [LOCAL ] NXP: Saving derivative data. [2025-09-29T02:20:13.684323] [DEBUG] [LOCAL ] NXP: Derivative data saved (1820 records). [2025-09-29T02:20:13.684771] [INFO ] [MAIN ] NXP: Successfully saved derivative data. [2025-09-29T02:20:13.687166] [INFO ] [MAIN ] Derivative Progress: 1462/2211 symbols completed. NXP took 0.9s. Estimated remaining: 5m 16s. Rate: 142.2 symbols/min [2025-09-29T02:20:13.687631] [INFO ] [MAIN ] NZF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:13.721756] [DEBUG] [MAIN ] NXRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:13.722846] [INFO ] [MAIN ] NXRT: Generated 1820 derivative records from 19307 primary records. [2025-09-29T02:20:13.723087] [DEBUG] [LOCAL ] NXRT: Saving derivative data. [2025-09-29T02:20:13.765232] [DEBUG] [LOCAL ] NYT: Loaded 50645 existing records from primary storage. [2025-09-29T02:20:13.765982] [INFO ] [MAIN ] NYT: Loaded 50645 primary data records. [2025-09-29T02:20:13.803165] [DEBUG] [LOCAL ] NXRT: Derivative data saved (1820 records). [2025-09-29T02:20:13.862075] [DEBUG] [LOCAL ] NZF: Loaded 29361 existing records from primary storage. [2025-09-29T02:20:13.853917] [INFO ] [MAIN ] NXRT: Successfully saved derivative data. [2025-09-29T02:20:13.870944] [INFO ] [MAIN ] Derivative Progress: 1463/2211 symbols completed. NXRT took 1.1s. Estimated remaining: 5m 15s. Rate: 142.3 symbols/min [2025-09-29T02:20:13.862284] [INFO ] [MAIN ] NZF: Loaded 29361 primary data records. [2025-09-29T02:20:13.876510] [INFO ] [MAIN ] OBDC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:14.502059] [DEBUG] [LOCAL ] OBDC: Loaded 52426 existing records from primary storage. [2025-09-29T02:20:14.504317] [INFO ] [MAIN ] OBDC: Loaded 52426 primary data records. [2025-09-29T02:20:14.671751] [DEBUG] [MAIN ] NYT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:14.683272] [INFO ] [MAIN ] NYT: Generated 1820 derivative records from 50645 primary records. [2025-09-29T02:20:14.699466] [DEBUG] [LOCAL ] NYT: Saving derivative data. [2025-09-29T02:20:14.895992] [DEBUG] [LOCAL ] NYT: Derivative data saved (1820 records). [2025-09-29T02:20:14.897307] [INFO ] [MAIN ] NYT: Successfully saved derivative data. [2025-09-29T02:20:14.903023] [INFO ] [MAIN ] Derivative Progress: 1464/2211 symbols completed. NYT took 1.5s. Estimated remaining: 5m 15s. Rate: 142.1 symbols/min [2025-09-29T02:20:14.904357] [INFO ] [MAIN ] OBK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:14.919742] [DEBUG] [MAIN ] NZF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:14.921256] [INFO ] [MAIN ] NZF: Generated 1820 derivative records from 29361 primary records. [2025-09-29T02:20:14.921768] [DEBUG] [LOCAL ] NZF: Saving derivative data. [2025-09-29T02:20:14.958355] [DEBUG] [LOCAL ] NZF: Derivative data saved (1820 records). [2025-09-29T02:20:14.958660] [INFO ] [MAIN ] NZF: Successfully saved derivative data. [2025-09-29T02:20:14.959918] [DEBUG] [LOCAL ] OBK: Loaded 16512 existing records from primary storage. [2025-09-29T02:20:14.966171] [INFO ] [MAIN ] OBK: Loaded 16512 primary data records. [2025-09-29T02:20:14.965810] [INFO ] [MAIN ] Derivative Progress: 1465/2211 symbols completed. NZF took 1.3s. Estimated remaining: 5m 15s. Rate: 142.2 symbols/min [2025-09-29T02:20:14.966660] [INFO ] [MAIN ] OC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:15.148549] [DEBUG] [MAIN ] OBDC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:15.193210] [INFO ] [MAIN ] OBDC: Generated 1820 derivative records from 52426 primary records. [2025-09-29T02:20:15.347820] [DEBUG] [LOCAL ] OBDC: Saving derivative data. [2025-09-29T02:20:15.394117] [DEBUG] [LOCAL ] OBDC: Derivative data saved (1820 records). [2025-09-29T02:20:15.410293] [INFO ] [MAIN ] OBDC: Successfully saved derivative data. [2025-09-29T02:20:15.415726] [INFO ] [MAIN ] Derivative Progress: 1466/2211 symbols completed. OBDC took 1.5s. Estimated remaining: 5m 14s. Rate: 142.2 symbols/min [2025-09-29T02:20:15.417517] [INFO ] [MAIN ] OCFT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:15.420320] [DEBUG] [LOCAL ] OC: Loaded 45369 existing records from primary storage. [2025-09-29T02:20:15.421686] [INFO ] [MAIN ] OC: Loaded 45369 primary data records. [2025-09-29T02:20:15.523072] [DEBUG] [LOCAL ] OCFT: Loaded 8916 existing records from primary storage. [2025-09-29T02:20:15.549605] [INFO ] [MAIN ] OCFT: Loaded 8916 primary data records. [2025-09-29T02:20:15.901168] [DEBUG] [MAIN ] OBK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:15.909305] [INFO ] [MAIN ] OBK: Generated 1820 derivative records from 16512 primary records. [2025-09-29T02:20:15.919749] [DEBUG] [LOCAL ] OBK: Saving derivative data. [2025-09-29T02:20:16.135968] [DEBUG] [LOCAL ] OBK: Derivative data saved (1820 records). [2025-09-29T02:20:16.136385] [INFO ] [MAIN ] OBK: Successfully saved derivative data. [2025-09-29T02:20:16.139703] [INFO ] [MAIN ] Derivative Progress: 1467/2211 symbols completed. OBK took 1.2s. Estimated remaining: 5m 14s. Rate: 142.2 symbols/min [2025-09-29T02:20:16.141066] [INFO ] [MAIN ] ODC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:16.160111] [DEBUG] [LOCAL ] ODC: Loaded 8633 existing records from primary storage. [2025-09-29T02:20:16.160633] [INFO ] [MAIN ] ODC: Loaded 8633 primary data records. [2025-09-29T02:20:16.223735] [DEBUG] [MAIN ] OC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:16.268480] [INFO ] [MAIN ] OC: Generated 1820 derivative records from 45369 primary records. [2025-09-29T02:20:16.302302] [DEBUG] [LOCAL ] OC: Saving derivative data. [2025-09-29T02:20:16.389432] [DEBUG] [MAIN ] OCFT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:16.422050] [INFO ] [MAIN ] OCFT: Generated 1820 derivative records from 8916 primary records. [2025-09-29T02:20:16.440859] [DEBUG] [LOCAL ] OCFT: Saving derivative data. [2025-09-29T02:20:16.553713] [DEBUG] [LOCAL ] OC: Derivative data saved (1820 records). [2025-09-29T02:20:16.555933] [INFO ] [MAIN ] OC: Successfully saved derivative data. [2025-09-29T02:20:16.564009] [INFO ] [MAIN ] Derivative Progress: 1468/2211 symbols completed. OC took 1.6s. Estimated remaining: 5m 14s. Rate: 142.2 symbols/min [2025-09-29T02:20:16.580717] [DEBUG] [LOCAL ] OCFT: Derivative data saved (1820 records). [2025-09-29T02:20:16.581038] [INFO ] [MAIN ] OCFT: Successfully saved derivative data. [2025-09-29T02:20:16.584698] [INFO ] [MAIN ] Derivative Progress: 1469/2211 symbols completed. OCFT took 1.2s. Estimated remaining: 5m 13s. Rate: 142.2 symbols/min [2025-09-29T02:20:16.606618] [DEBUG] [MAIN ] ODC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:16.607541] [INFO ] [MAIN ] ODC: Generated 1820 derivative records from 8633 primary records. [2025-09-29T02:20:16.607631] [DEBUG] [LOCAL ] ODC: Saving derivative data. [2025-09-29T02:20:16.624073] [DEBUG] [LOCAL ] ODC: Derivative data saved (1820 records). [2025-09-29T02:20:16.624212] [INFO ] [MAIN ] ODC: Successfully saved derivative data. [2025-09-29T02:20:16.627214] [INFO ] [MAIN ] Derivative Progress: 1470/2211 symbols completed. ODC took 0.5s. Estimated remaining: 5m 12s. Rate: 142.3 symbols/min [2025-09-29T02:20:16.627925] [INFO ] [MAIN ] ODV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:16.628103] [INFO ] [MAIN ] OEC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:16.628195] [INFO ] [MAIN ] OFG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:16.672480] [DEBUG] [LOCAL ] OFG: Loaded 22393 existing records from primary storage. [2025-09-29T02:20:16.674012] [INFO ] [MAIN ] OFG: Loaded 22393 primary data records. [2025-09-29T02:20:16.675058] [DEBUG] [LOCAL ] ODV: Loaded 26258 existing records from primary storage. [2025-09-29T02:20:16.707083] [INFO ] [MAIN ] ODV: Loaded 26258 primary data records. [2025-09-29T02:20:16.957372] [DEBUG] [LOCAL ] OEC: Loaded 37689 existing records from primary storage. [2025-09-29T02:20:16.994258] [INFO ] [MAIN ] OEC: Loaded 37689 primary data records. [2025-09-29T02:20:17.796045] [DEBUG] [MAIN ] OFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:17.797569] [INFO ] [MAIN ] OFG: Generated 1820 derivative records from 22393 primary records. [2025-09-29T02:20:17.810726] [DEBUG] [LOCAL ] OFG: Saving derivative data. [2025-09-29T02:20:17.812636] [DEBUG] [MAIN ] ODV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:17.814412] [INFO ] [MAIN ] ODV: Generated 1820 derivative records from 26258 primary records. [2025-09-29T02:20:17.831078] [DEBUG] [LOCAL ] ODV: Saving derivative data. [2025-09-29T02:20:17.832473] [DEBUG] [LOCAL ] OFG: Derivative data saved (1820 records). [2025-09-29T02:20:17.841528] [INFO ] [MAIN ] OFG: Successfully saved derivative data. [2025-09-29T02:20:17.847301] [DEBUG] [MAIN ] OEC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:17.864142] [INFO ] [MAIN ] OEC: Generated 1820 derivative records from 37689 primary records. [2025-09-29T02:20:17.862778] [INFO ] [MAIN ] Derivative Progress: 1471/2211 symbols completed. OFG took 1.2s. Estimated remaining: 5m 12s. Rate: 142.1 symbols/min [2025-09-29T02:20:17.865637] [DEBUG] [LOCAL ] OEC: Saving derivative data. [2025-09-29T02:20:17.865882] [INFO ] [MAIN ] OGE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:17.870308] [DEBUG] [LOCAL ] ODV: Derivative data saved (1820 records). [2025-09-29T02:20:17.871768] [INFO ] [MAIN ] ODV: Successfully saved derivative data. [2025-09-29T02:20:17.878084] [INFO ] [MAIN ] Derivative Progress: 1472/2211 symbols completed. ODV took 1.2s. Estimated remaining: 5m 12s. Rate: 142.2 symbols/min [2025-09-29T02:20:17.892704] [INFO ] [MAIN ] OGN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:17.894717] [DEBUG] [LOCAL ] OEC: Derivative data saved (1820 records). [2025-09-29T02:20:17.895265] [INFO ] [MAIN ] OEC: Successfully saved derivative data. [2025-09-29T02:20:17.898013] [INFO ] [MAIN ] Derivative Progress: 1473/2211 symbols completed. OEC took 1.3s. Estimated remaining: 5m 11s. Rate: 142.3 symbols/min [2025-09-29T02:20:17.898379] [INFO ] [MAIN ] OGS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:17.985300] [DEBUG] [LOCAL ] OGE: Loaded 47046 existing records from primary storage. [2025-09-29T02:20:17.985592] [INFO ] [MAIN ] OGE: Loaded 47046 primary data records. [2025-09-29T02:20:17.986724] [DEBUG] [LOCAL ] OGS: Loaded 34591 existing records from primary storage. [2025-09-29T02:20:18.000051] [INFO ] [MAIN ] OGS: Loaded 34591 primary data records. [2025-09-29T02:20:18.191967] [DEBUG] [LOCAL ] OGN: Loaded 53882 existing records from primary storage. [2025-09-29T02:20:18.244892] [INFO ] [MAIN ] OGN: Loaded 53882 primary data records. [2025-09-29T02:20:18.999800] [DEBUG] [MAIN ] OGE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:19.001235] [INFO ] [MAIN ] OGE: Generated 1820 derivative records from 47046 primary records. [2025-09-29T02:20:19.001507] [DEBUG] [LOCAL ] OGE: Saving derivative data. [2025-09-29T02:20:19.109610] [DEBUG] [LOCAL ] OGE: Derivative data saved (1820 records). [2025-09-29T02:20:19.112570] [INFO ] [MAIN ] OGE: Successfully saved derivative data. [2025-09-29T02:20:19.119922] [INFO ] [MAIN ] Derivative Progress: 1474/2211 symbols completed. OGE took 1.3s. Estimated remaining: 5m 11s. Rate: 142.1 symbols/min [2025-09-29T02:20:19.133061] [INFO ] [MAIN ] OHI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:19.134283] [DEBUG] [MAIN ] OGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:19.135823] [INFO ] [MAIN ] OGS: Generated 1820 derivative records from 34591 primary records. [2025-09-29T02:20:19.136063] [DEBUG] [LOCAL ] OGS: Saving derivative data. [2025-09-29T02:20:19.156073] [DEBUG] [LOCAL ] OGS: Derivative data saved (1820 records). [2025-09-29T02:20:19.156267] [INFO ] [MAIN ] OGS: Successfully saved derivative data. [2025-09-29T02:20:19.159562] [INFO ] [MAIN ] Derivative Progress: 1475/2211 symbols completed. OGS took 1.3s. Estimated remaining: 5m 10s. Rate: 142.2 symbols/min [2025-09-29T02:20:19.159882] [INFO ] [MAIN ] OI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:19.180462] [DEBUG] [MAIN ] OGN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:19.181390] [INFO ] [MAIN ] OGN: Generated 1820 derivative records from 53882 primary records. [2025-09-29T02:20:19.181500] [DEBUG] [LOCAL ] OGN: Saving derivative data. [2025-09-29T02:20:19.198912] [DEBUG] [LOCAL ] OGN: Derivative data saved (1820 records). [2025-09-29T02:20:19.199114] [INFO ] [MAIN ] OGN: Successfully saved derivative data. [2025-09-29T02:20:19.202325] [INFO ] [MAIN ] Derivative Progress: 1476/2211 symbols completed. OGN took 1.3s. Estimated remaining: 5m 10s. Rate: 142.3 symbols/min [2025-09-29T02:20:19.202537] [INFO ] [MAIN ] OIA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:19.254528] [DEBUG] [LOCAL ] OHI: Loaded 52824 existing records from primary storage. [2025-09-29T02:20:19.254883] [INFO ] [MAIN ] OHI: Loaded 52824 primary data records. [2025-09-29T02:20:19.333527] [DEBUG] [LOCAL ] OIA: Loaded 14218 existing records from primary storage. [2025-09-29T02:20:19.357178] [INFO ] [MAIN ] OIA: Loaded 14218 primary data records. [2025-09-29T02:20:19.456772] [DEBUG] [LOCAL ] OI: Loaded 48011 existing records from primary storage. [2025-09-29T02:20:19.515804] [INFO ] [MAIN ] OI: Loaded 48011 primary data records. [2025-09-29T02:20:20.353453] [DEBUG] [MAIN ] OHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:20.357309] [INFO ] [MAIN ] OHI: Generated 1820 derivative records from 52824 primary records. [2025-09-29T02:20:20.357986] [DEBUG] [LOCAL ] OHI: Saving derivative data. [2025-09-29T02:20:20.373270] [DEBUG] [MAIN ] OIA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:20.386052] [INFO ] [MAIN ] OIA: Generated 1820 derivative records from 14218 primary records. [2025-09-29T02:20:20.386395] [DEBUG] [LOCAL ] OIA: Saving derivative data. [2025-09-29T02:20:20.407180] [DEBUG] [LOCAL ] OIA: Derivative data saved (1820 records). [2025-09-29T02:20:20.405920] [DEBUG] [LOCAL ] OHI: Derivative data saved (1820 records). [2025-09-29T02:20:20.407711] [INFO ] [MAIN ] OIA: Successfully saved derivative data. [2025-09-29T02:20:20.407536] [INFO ] [MAIN ] OHI: Successfully saved derivative data. [2025-09-29T02:20:20.410268] [INFO ] [MAIN ] Derivative Progress: 1477/2211 symbols completed. OHI took 1.3s. Estimated remaining: 5m 10s. Rate: 142.1 symbols/min [2025-09-29T02:20:20.410631] [INFO ] [MAIN ] OII: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:20.413707] [INFO ] [MAIN ] Derivative Progress: 1478/2211 symbols completed. OIA took 1.2s. Estimated remaining: 5m 9s. Rate: 142.2 symbols/min [2025-09-29T02:20:20.414710] [INFO ] [MAIN ] OIS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:20.431441] [DEBUG] [MAIN ] OI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:20.432270] [INFO ] [MAIN ] OI: Generated 1820 derivative records from 48011 primary records. [2025-09-29T02:20:20.432510] [DEBUG] [LOCAL ] OI: Saving derivative data. [2025-09-29T02:20:20.450330] [DEBUG] [LOCAL ] OI: Derivative data saved (1820 records). [2025-09-29T02:20:20.450492] [INFO ] [MAIN ] OI: Successfully saved derivative data. [2025-09-29T02:20:20.455145] [INFO ] [MAIN ] Derivative Progress: 1479/2211 symbols completed. OI took 1.3s. Estimated remaining: 5m 9s. Rate: 142.3 symbols/min [2025-09-29T02:20:20.456525] [INFO ] [MAIN ] OKE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:20.513393] [DEBUG] [LOCAL ] OII: Loaded 43406 existing records from primary storage. [2025-09-29T02:20:20.513847] [INFO ] [MAIN ] OII: Loaded 43406 primary data records. [2025-09-29T02:20:20.537828] [DEBUG] [LOCAL ] OIS: Loaded 41135 existing records from primary storage. [2025-09-29T02:20:20.567593] [INFO ] [MAIN ] OIS: Loaded 41135 primary data records. [2025-09-29T02:20:20.914468] [DEBUG] [LOCAL ] OKE: Loaded 54316 existing records from primary storage. [2025-09-29T02:20:21.021703] [INFO ] [MAIN ] OKE: Loaded 54316 primary data records. [2025-09-29T02:20:21.591852] [DEBUG] [MAIN ] OII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:21.593823] [INFO ] [MAIN ] OII: Generated 1820 derivative records from 43406 primary records. [2025-09-29T02:20:21.594457] [DEBUG] [LOCAL ] OII: Saving derivative data. [2025-09-29T02:20:21.617312] [DEBUG] [LOCAL ] OII: Derivative data saved (1820 records). [2025-09-29T02:20:21.617710] [INFO ] [MAIN ] OII: Successfully saved derivative data. [2025-09-29T02:20:21.620277] [INFO ] [MAIN ] Derivative Progress: 1480/2211 symbols completed. OII took 1.2s. Estimated remaining: 5m 9s. Rate: 142.2 symbols/min [2025-09-29T02:20:21.620870] [INFO ] [MAIN ] OKLO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:21.636480] [DEBUG] [MAIN ] OIS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:21.637709] [INFO ] [MAIN ] OIS: Generated 1820 derivative records from 41135 primary records. [2025-09-29T02:20:21.638024] [DEBUG] [LOCAL ] OIS: Saving derivative data. [2025-09-29T02:20:21.658924] [DEBUG] [LOCAL ] OIS: Derivative data saved (1820 records). [2025-09-29T02:20:21.672167] [INFO ] [MAIN ] OIS: Successfully saved derivative data. [2025-09-29T02:20:21.675504] [DEBUG] [MAIN ] OKE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:21.674971] [INFO ] [MAIN ] Derivative Progress: 1481/2211 symbols completed. OIS took 1.3s. Estimated remaining: 5m 8s. Rate: 142.2 symbols/min [2025-09-29T02:20:21.675887] [INFO ] [MAIN ] OLN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:21.677075] [INFO ] [MAIN ] OKE: Generated 1820 derivative records from 54316 primary records. [2025-09-29T02:20:21.677257] [DEBUG] [LOCAL ] OKE: Saving derivative data. [2025-09-29T02:20:21.694681] [DEBUG] [LOCAL ] OKE: Derivative data saved (1820 records). [2025-09-29T02:20:21.694947] [INFO ] [MAIN ] OKE: Successfully saved derivative data. [2025-09-29T02:20:21.697685] [INFO ] [MAIN ] Derivative Progress: 1482/2211 symbols completed. OKE took 1.2s. Estimated remaining: 5m 7s. Rate: 142.3 symbols/min [2025-09-29T02:20:21.698097] [INFO ] [MAIN ] OLP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:21.730882] [DEBUG] [LOCAL ] OLP: Loaded 9963 existing records from primary storage. [2025-09-29T02:20:21.731187] [INFO ] [MAIN ] OLP: Loaded 9963 primary data records. [2025-09-29T02:20:21.882389] [DEBUG] [LOCAL ] OKLO: Loaded 54599 existing records from primary storage. [2025-09-29T02:20:21.888295] [INFO ] [MAIN ] OKLO: Loaded 54599 primary data records. [2025-09-29T02:20:22.087088] [DEBUG] [LOCAL ] OLN: Loaded 52512 existing records from primary storage. [2025-09-29T02:20:22.278003] [INFO ] [MAIN ] OLN: Loaded 52512 primary data records. [2025-09-29T02:20:22.838448] [DEBUG] [MAIN ] OLP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:22.840182] [INFO ] [MAIN ] OLP: Generated 1820 derivative records from 9963 primary records. [2025-09-29T02:20:22.840687] [DEBUG] [LOCAL ] OLP: Saving derivative data. [2025-09-29T02:20:22.862745] [DEBUG] [LOCAL ] OLP: Derivative data saved (1820 records). [2025-09-29T02:20:22.865355] [INFO ] [MAIN ] OLP: Successfully saved derivative data. [2025-09-29T02:20:22.869040] [INFO ] [MAIN ] Derivative Progress: 1483/2211 symbols completed. OLP took 1.2s. Estimated remaining: 5m 7s. Rate: 142.2 symbols/min [2025-09-29T02:20:22.889411] [DEBUG] [MAIN ] OKLO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:22.890999] [INFO ] [MAIN ] OKLO: Generated 1820 derivative records from 54599 primary records. [2025-09-29T02:20:22.891258] [DEBUG] [LOCAL ] OKLO: Saving derivative data. [2025-09-29T02:20:22.913941] [DEBUG] [LOCAL ] OKLO: Derivative data saved (1820 records). [2025-09-29T02:20:22.914334] [INFO ] [MAIN ] OKLO: Successfully saved derivative data. [2025-09-29T02:20:22.918063] [INFO ] [MAIN ] Derivative Progress: 1484/2211 symbols completed. OKLO took 1.3s. Estimated remaining: 5m 7s. Rate: 142.2 symbols/min [2025-09-29T02:20:22.931822] [DEBUG] [MAIN ] OLN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:22.932752] [INFO ] [MAIN ] OLN: Generated 1820 derivative records from 52512 primary records. [2025-09-29T02:20:22.932848] [DEBUG] [LOCAL ] OLN: Saving derivative data. [2025-09-29T02:20:22.949685] [DEBUG] [LOCAL ] OLN: Derivative data saved (1820 records). [2025-09-29T02:20:22.949849] [INFO ] [MAIN ] OLN: Successfully saved derivative data. [2025-09-29T02:20:22.953457] [INFO ] [MAIN ] Derivative Progress: 1485/2211 symbols completed. OLN took 1.3s. Estimated remaining: 5m 6s. Rate: 142.3 symbols/min [2025-09-29T02:20:22.954021] [INFO ] [MAIN ] OMC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:22.954150] [INFO ] [MAIN ] OMI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:22.954194] [INFO ] [MAIN ] OMF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:23.050328] [DEBUG] [LOCAL ] OMI: Loaded 46583 existing records from primary storage. [2025-09-29T02:20:23.051284] [DEBUG] [LOCAL ] OMF: Loaded 46898 existing records from primary storage. [2025-09-29T02:20:23.051480] [INFO ] [MAIN ] OMI: Loaded 46583 primary data records. [2025-09-29T02:20:23.051781] [INFO ] [MAIN ] OMF: Loaded 46898 primary data records. [2025-09-29T02:20:23.276724] [DEBUG] [LOCAL ] OMC: Loaded 54068 existing records from primary storage. [2025-09-29T02:20:23.293063] [INFO ] [MAIN ] OMC: Loaded 54068 primary data records. [2025-09-29T02:20:24.225976] [DEBUG] [MAIN ] OMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:24.227945] [INFO ] [MAIN ] OMI: Generated 1820 derivative records from 46583 primary records. [2025-09-29T02:20:24.228685] [DEBUG] [LOCAL ] OMI: Saving derivative data. [2025-09-29T02:20:24.245760] [DEBUG] [MAIN ] OMF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:24.258453] [INFO ] [MAIN ] OMF: Generated 1820 derivative records from 46898 primary records. [2025-09-29T02:20:24.263636] [DEBUG] [LOCAL ] OMI: Derivative data saved (1820 records). [2025-09-29T02:20:24.263791] [DEBUG] [LOCAL ] OMF: Saving derivative data. [2025-09-29T02:20:24.263867] [INFO ] [MAIN ] OMI: Successfully saved derivative data. [2025-09-29T02:20:24.266739] [INFO ] [MAIN ] Derivative Progress: 1486/2211 symbols completed. OMI took 1.3s. Estimated remaining: 5m 6s. Rate: 142.1 symbols/min [2025-09-29T02:20:24.267938] [INFO ] [MAIN ] ONIT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:24.292004] [DEBUG] [LOCAL ] OMF: Derivative data saved (1820 records). [2025-09-29T02:20:24.293560] [INFO ] [MAIN ] OMF: Successfully saved derivative data. [2025-09-29T02:20:24.296472] [INFO ] [MAIN ] Derivative Progress: 1487/2211 symbols completed. OMF took 1.3s. Estimated remaining: 5m 5s. Rate: 142.2 symbols/min [2025-09-29T02:20:24.311480] [DEBUG] [MAIN ] OMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:24.309559] [INFO ] [MAIN ] ONL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:24.316317] [DEBUG] [LOCAL ] ONIT: Loaded 7871 existing records from primary storage. [2025-09-29T02:20:24.317241] [INFO ] [MAIN ] OMC: Generated 1820 derivative records from 54068 primary records. [2025-09-29T02:20:24.317560] [INFO ] [MAIN ] ONIT: Loaded 7871 primary data records. [2025-09-29T02:20:24.317726] [DEBUG] [LOCAL ] OMC: Saving derivative data. [2025-09-29T02:20:24.540224] [DEBUG] [LOCAL ] OMC: Derivative data saved (1820 records). [2025-09-29T02:20:24.579943] [INFO ] [MAIN ] OMC: Successfully saved derivative data. [2025-09-29T02:20:24.582488] [DEBUG] [LOCAL ] ONL: Loaded 31806 existing records from primary storage. [2025-09-29T02:20:24.606806] [INFO ] [MAIN ] Derivative Progress: 1488/2211 symbols completed. OMC took 1.7s. Estimated remaining: 5m 5s. Rate: 142.2 symbols/min [2025-09-29T02:20:24.610559] [INFO ] [MAIN ] ONL: Loaded 31806 primary data records. [2025-09-29T02:20:24.610827] [INFO ] [MAIN ] ONON: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:25.118470] [DEBUG] [LOCAL ] ONON: Loaded 54392 existing records from primary storage. [2025-09-29T02:20:25.120179] [INFO ] [MAIN ] ONON: Loaded 54392 primary data records. [2025-09-29T02:20:25.262830] [DEBUG] [MAIN ] ONIT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:25.290390] [INFO ] [MAIN ] ONIT: Generated 1820 derivative records from 7871 primary records. [2025-09-29T02:20:25.325902] [DEBUG] [LOCAL ] ONIT: Saving derivative data. [2025-09-29T02:20:25.499926] [DEBUG] [LOCAL ] ONIT: Derivative data saved (1820 records). [2025-09-29T02:20:25.501302] [INFO ] [MAIN ] ONIT: Successfully saved derivative data. [2025-09-29T02:20:25.504381] [INFO ] [MAIN ] Derivative Progress: 1489/2211 symbols completed. ONIT took 1.2s. Estimated remaining: 5m 5s. Rate: 142.1 symbols/min [2025-09-29T02:20:25.505130] [INFO ] [MAIN ] ONTF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:25.529426] [DEBUG] [MAIN ] ONL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:25.530819] [INFO ] [MAIN ] ONL: Generated 1820 derivative records from 31806 primary records. [2025-09-29T02:20:25.531490] [DEBUG] [LOCAL ] ONL: Saving derivative data. [2025-09-29T02:20:25.562408] [DEBUG] [LOCAL ] ONL: Derivative data saved (1820 records). [2025-09-29T02:20:25.562924] [INFO ] [MAIN ] ONL: Successfully saved derivative data. [2025-09-29T02:20:25.565860] [INFO ] [MAIN ] Derivative Progress: 1490/2211 symbols completed. ONL took 1.3s. Estimated remaining: 5m 4s. Rate: 142.2 symbols/min [2025-09-29T02:20:25.566630] [INFO ] [MAIN ] ONTO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:25.583412] [DEBUG] [LOCAL ] ONTF: Loaded 23187 existing records from primary storage. [2025-09-29T02:20:25.584160] [INFO ] [MAIN ] ONTF: Loaded 23187 primary data records. [2025-09-29T02:20:25.612216] [DEBUG] [MAIN ] ONON: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:25.639191] [INFO ] [MAIN ] ONON: Generated 1820 derivative records from 54392 primary records. [2025-09-29T02:20:25.682269] [DEBUG] [LOCAL ] ONON: Saving derivative data. [2025-09-29T02:20:25.770524] [DEBUG] [LOCAL ] ONON: Derivative data saved (1820 records). [2025-09-29T02:20:25.820426] [INFO ] [MAIN ] ONON: Successfully saved derivative data. [2025-09-29T02:20:25.824344] [INFO ] [MAIN ] Derivative Progress: 1491/2211 symbols completed. ONON took 1.2s. Estimated remaining: 5m 4s. Rate: 142.3 symbols/min [2025-09-29T02:20:25.846763] [INFO ] [MAIN ] OOMA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:25.990550] [DEBUG] [LOCAL ] ONTO: Loaded 47339 existing records from primary storage. [2025-09-29T02:20:25.990924] [INFO ] [MAIN ] ONTO: Loaded 47339 primary data records. [2025-09-29T02:20:26.130561] [DEBUG] [LOCAL ] OOMA: Loaded 19260 existing records from primary storage. [2025-09-29T02:20:26.135813] [INFO ] [MAIN ] OOMA: Loaded 19260 primary data records. [2025-09-29T02:20:26.764853] [DEBUG] [MAIN ] ONTF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:26.766223] [INFO ] [MAIN ] ONTF: Generated 1820 derivative records from 23187 primary records. [2025-09-29T02:20:26.766533] [DEBUG] [LOCAL ] ONTF: Saving derivative data. [2025-09-29T02:20:26.788103] [DEBUG] [LOCAL ] ONTF: Derivative data saved (1820 records). [2025-09-29T02:20:26.788728] [INFO ] [MAIN ] ONTF: Successfully saved derivative data. [2025-09-29T02:20:26.791521] [INFO ] [MAIN ] Derivative Progress: 1492/2211 symbols completed. ONTF took 1.3s. Estimated remaining: 5m 4s. Rate: 142.1 symbols/min [2025-09-29T02:20:26.792493] [INFO ] [MAIN ] OPAD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:26.813767] [DEBUG] [MAIN ] ONTO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:26.815308] [INFO ] [MAIN ] ONTO: Generated 1820 derivative records from 47339 primary records. [2025-09-29T02:20:26.815471] [DEBUG] [LOCAL ] ONTO: Saving derivative data. [2025-09-29T02:20:26.839773] [DEBUG] [LOCAL ] ONTO: Derivative data saved (1820 records). [2025-09-29T02:20:26.843043] [INFO ] [MAIN ] ONTO: Successfully saved derivative data. [2025-09-29T02:20:26.845911] [INFO ] [MAIN ] Derivative Progress: 1493/2211 symbols completed. ONTO took 1.3s. Estimated remaining: 5m 3s. Rate: 142.2 symbols/min [2025-09-29T02:20:26.853679] [INFO ] [MAIN ] OPFI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:26.863961] [DEBUG] [LOCAL ] OPAD: Loaded 20793 existing records from primary storage. [2025-09-29T02:20:26.869964] [INFO ] [MAIN ] OPAD: Loaded 20793 primary data records. [2025-09-29T02:20:26.870333] [DEBUG] [MAIN ] OOMA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:26.895785] [INFO ] [MAIN ] OOMA: Generated 1820 derivative records from 19260 primary records. [2025-09-29T02:20:26.908197] [DEBUG] [LOCAL ] OOMA: Saving derivative data. [2025-09-29T02:20:27.075253] [DEBUG] [LOCAL ] OOMA: Derivative data saved (1820 records). [2025-09-29T02:20:27.122451] [INFO ] [MAIN ] OOMA: Successfully saved derivative data. [2025-09-29T02:20:27.236918] [INFO ] [MAIN ] Derivative Progress: 1494/2211 symbols completed. OOMA took 1.4s. Estimated remaining: 5m 2s. Rate: 142.2 symbols/min [2025-09-29T02:20:27.267635] [INFO ] [MAIN ] OPP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:27.271902] [DEBUG] [LOCAL ] OPFI: Loaded 47258 existing records from primary storage. [2025-09-29T02:20:27.272767] [INFO ] [MAIN ] OPFI: Loaded 47258 primary data records. [2025-09-29T02:20:27.382459] [DEBUG] [LOCAL ] OPP: Loaded 11678 existing records from primary storage. [2025-09-29T02:20:27.396121] [INFO ] [MAIN ] OPP: Loaded 11678 primary data records. [2025-09-29T02:20:27.989125] [DEBUG] [MAIN ] OPAD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:27.991324] [INFO ] [MAIN ] OPAD: Generated 1820 derivative records from 20793 primary records. [2025-09-29T02:20:27.991793] [DEBUG] [LOCAL ] OPAD: Saving derivative data. [2025-09-29T02:20:28.011049] [DEBUG] [LOCAL ] OPAD: Derivative data saved (1820 records). [2025-09-29T02:20:28.012589] [INFO ] [MAIN ] OPAD: Successfully saved derivative data. [2025-09-29T02:20:28.015214] [INFO ] [MAIN ] Derivative Progress: 1495/2211 symbols completed. OPAD took 1.2s. Estimated remaining: 5m 2s. Rate: 142.1 symbols/min [2025-09-29T02:20:28.015564] [INFO ] [MAIN ] OR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:28.037977] [DEBUG] [MAIN ] OPFI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:28.046606] [INFO ] [MAIN ] OPFI: Generated 1820 derivative records from 47258 primary records. [2025-09-29T02:20:28.051708] [DEBUG] [LOCAL ] OPFI: Saving derivative data. [2025-09-29T02:20:28.052052] [DEBUG] [MAIN ] OPP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:28.052899] [INFO ] [MAIN ] OPP: Generated 1820 derivative records from 11678 primary records. [2025-09-29T02:20:28.052995] [DEBUG] [LOCAL ] OPP: Saving derivative data. [2025-09-29T02:20:28.086892] [DEBUG] [LOCAL ] OPFI: Derivative data saved (1820 records). [2025-09-29T02:20:28.087127] [DEBUG] [LOCAL ] OPP: Derivative data saved (1820 records). [2025-09-29T02:20:28.087450] [INFO ] [MAIN ] OPP: Successfully saved derivative data. [2025-09-29T02:20:28.087348] [INFO ] [MAIN ] OPFI: Successfully saved derivative data. [2025-09-29T02:20:28.100340] [INFO ] [MAIN ] Derivative Progress: 1496/2211 symbols completed. OPP took 0.8s. Estimated remaining: 5m 2s. Rate: 142.2 symbols/min [2025-09-29T02:20:28.103893] [INFO ] [MAIN ] Derivative Progress: 1497/2211 symbols completed. OPFI took 1.2s. Estimated remaining: 5m 1s. Rate: 142.3 symbols/min [2025-09-29T02:20:28.103809] [INFO ] [MAIN ] ORA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:28.104224] [INFO ] [MAIN ] ORC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:28.128320] [DEBUG] [LOCAL ] OR: Loaded 46786 existing records from primary storage. [2025-09-29T02:20:28.128682] [INFO ] [MAIN ] OR: Loaded 46786 primary data records. [2025-09-29T02:20:28.347860] [DEBUG] [LOCAL ] ORA: Loaded 33001 existing records from primary storage. [2025-09-29T02:20:28.493372] [INFO ] [MAIN ] ORA: Loaded 33001 primary data records. [2025-09-29T02:20:28.587999] [DEBUG] [LOCAL ] ORC: Loaded 53083 existing records from primary storage. [2025-09-29T02:20:28.626940] [INFO ] [MAIN ] ORC: Loaded 53083 primary data records. [2025-09-29T02:20:29.281300] [DEBUG] [MAIN ] OR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:29.283537] [INFO ] [MAIN ] OR: Generated 1820 derivative records from 46786 primary records. [2025-09-29T02:20:29.283629] [DEBUG] [LOCAL ] OR: Saving derivative data. [2025-09-29T02:20:29.304321] [DEBUG] [LOCAL ] OR: Derivative data saved (1820 records). [2025-09-29T02:20:29.305613] [INFO ] [MAIN ] OR: Successfully saved derivative data. [2025-09-29T02:20:29.309455] [INFO ] [MAIN ] Derivative Progress: 1498/2211 symbols completed. OR took 1.3s. Estimated remaining: 5m 1s. Rate: 142.1 symbols/min [2025-09-29T02:20:29.330185] [DEBUG] [MAIN ] ORA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:29.331845] [INFO ] [MAIN ] ORA: Generated 1820 derivative records from 33001 primary records. [2025-09-29T02:20:29.332248] [DEBUG] [LOCAL ] ORA: Saving derivative data. [2025-09-29T02:20:29.350622] [DEBUG] [LOCAL ] ORA: Derivative data saved (1820 records). [2025-09-29T02:20:29.350945] [INFO ] [MAIN ] ORA: Successfully saved derivative data. [2025-09-29T02:20:29.354856] [INFO ] [MAIN ] Derivative Progress: 1499/2211 symbols completed. ORA took 1.3s. Estimated remaining: 5m 0s. Rate: 142.2 symbols/min [2025-09-29T02:20:29.370584] [DEBUG] [MAIN ] ORC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:29.371378] [INFO ] [MAIN ] ORC: Generated 1820 derivative records from 53083 primary records. [2025-09-29T02:20:29.371467] [DEBUG] [LOCAL ] ORC: Saving derivative data. [2025-09-29T02:20:29.387238] [DEBUG] [LOCAL ] ORC: Derivative data saved (1820 records). [2025-09-29T02:20:29.387353] [INFO ] [MAIN ] ORC: Successfully saved derivative data. [2025-09-29T02:20:29.391696] [INFO ] [MAIN ] Derivative Progress: 1500/2211 symbols completed. ORC took 1.3s. Estimated remaining: 4m 60s. Rate: 142.3 symbols/min [2025-09-29T02:20:29.392239] [INFO ] [MAIN ] ORN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:29.392355] [INFO ] [MAIN ] OTIS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:29.392438] [INFO ] [MAIN ] OSCR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:29.432600] [DEBUG] [LOCAL ] ORN: Loaded 31979 existing records from primary storage. [2025-09-29T02:20:29.432996] [INFO ] [MAIN ] ORN: Loaded 31979 primary data records. [2025-09-29T02:20:29.828213] [DEBUG] [LOCAL ] OTIS: Loaded 53481 existing records from primary storage. [2025-09-29T02:20:29.828568] [INFO ] [MAIN ] OTIS: Loaded 53481 primary data records. [2025-09-29T02:20:29.835155] [DEBUG] [LOCAL ] OSCR: Loaded 54502 existing records from primary storage. [2025-09-29T02:20:29.854995] [INFO ] [MAIN ] OSCR: Loaded 54502 primary data records. [2025-09-29T02:20:30.548800] [DEBUG] [MAIN ] ORN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:30.549782] [INFO ] [MAIN ] ORN: Generated 1820 derivative records from 31979 primary records. [2025-09-29T02:20:30.550522] [DEBUG] [LOCAL ] ORN: Saving derivative data. [2025-09-29T02:20:30.573491] [DEBUG] [LOCAL ] ORN: Derivative data saved (1820 records). [2025-09-29T02:20:30.574110] [INFO ] [MAIN ] ORN: Successfully saved derivative data. [2025-09-29T02:20:30.578560] [INFO ] [MAIN ] Derivative Progress: 1501/2211 symbols completed. ORN took 1.2s. Estimated remaining: 4m 60s. Rate: 142.1 symbols/min [2025-09-29T02:20:30.580675] [INFO ] [MAIN ] OUT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:30.602530] [DEBUG] [MAIN ] OTIS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:30.603486] [INFO ] [MAIN ] OTIS: Generated 1820 derivative records from 53481 primary records. [2025-09-29T02:20:30.603803] [DEBUG] [LOCAL ] OTIS: Saving derivative data. [2025-09-29T02:20:30.636668] [DEBUG] [MAIN ] OSCR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:30.641000] [INFO ] [MAIN ] OSCR: Generated 1820 derivative records from 54502 primary records. [2025-09-29T02:20:30.639637] [DEBUG] [LOCAL ] OTIS: Derivative data saved (1820 records). [2025-09-29T02:20:30.641216] [INFO ] [MAIN ] OTIS: Successfully saved derivative data. [2025-09-29T02:20:30.641317] [DEBUG] [LOCAL ] OSCR: Saving derivative data. [2025-09-29T02:20:30.645279] [INFO ] [MAIN ] Derivative Progress: 1502/2211 symbols completed. OTIS took 1.3s. Estimated remaining: 4m 59s. Rate: 142.2 symbols/min [2025-09-29T02:20:30.645726] [INFO ] [MAIN ] OVV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:30.678751] [DEBUG] [LOCAL ] OSCR: Derivative data saved (1820 records). [2025-09-29T02:20:30.678954] [INFO ] [MAIN ] OSCR: Successfully saved derivative data. [2025-09-29T02:20:30.683287] [INFO ] [MAIN ] Derivative Progress: 1503/2211 symbols completed. OSCR took 1.3s. Estimated remaining: 4m 59s. Rate: 142.3 symbols/min [2025-09-29T02:20:30.683705] [INFO ] [MAIN ] OWL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:30.709763] [DEBUG] [LOCAL ] OUT: Loaded 48630 existing records from primary storage. [2025-09-29T02:20:30.710788] [INFO ] [MAIN ] OUT: Loaded 48630 primary data records. [2025-09-29T02:20:31.152378] [DEBUG] [LOCAL ] OVV: Loaded 54295 existing records from primary storage. [2025-09-29T02:20:31.171629] [INFO ] [MAIN ] OVV: Loaded 54295 primary data records. [2025-09-29T02:20:31.224691] [DEBUG] [LOCAL ] OWL: Loaded 54335 existing records from primary storage. [2025-09-29T02:20:31.263368] [INFO ] [MAIN ] OWL: Loaded 54335 primary data records. [2025-09-29T02:20:31.909347] [DEBUG] [MAIN ] OUT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:31.911304] [INFO ] [MAIN ] OUT: Generated 1820 derivative records from 48630 primary records. [2025-09-29T02:20:31.911819] [DEBUG] [LOCAL ] OUT: Saving derivative data. [2025-09-29T02:20:31.934752] [DEBUG] [LOCAL ] OUT: Derivative data saved (1820 records). [2025-09-29T02:20:31.935190] [INFO ] [MAIN ] OUT: Successfully saved derivative data. [2025-09-29T02:20:31.938998] [INFO ] [MAIN ] Derivative Progress: 1504/2211 symbols completed. OUT took 1.4s. Estimated remaining: 4m 58s. Rate: 142.1 symbols/min [2025-09-29T02:20:31.939500] [INFO ] [MAIN ] OWLT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:31.961757] [DEBUG] [MAIN ] OVV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:31.965927] [INFO ] [MAIN ] OVV: Generated 1820 derivative records from 54295 primary records. [2025-09-29T02:20:31.966039] [DEBUG] [LOCAL ] OVV: Saving derivative data. [2025-09-29T02:20:31.984514] [DEBUG] [LOCAL ] OWLT: Loaded 9099 existing records from primary storage. [2025-09-29T02:20:31.990157] [DEBUG] [LOCAL ] OVV: Derivative data saved (1820 records). [2025-09-29T02:20:31.991279] [INFO ] [MAIN ] OWLT: Loaded 9099 primary data records. [2025-09-29T02:20:31.991506] [INFO ] [MAIN ] OVV: Successfully saved derivative data. [2025-09-29T02:20:31.999620] [INFO ] [MAIN ] Derivative Progress: 1505/2211 symbols completed. OVV took 1.4s. Estimated remaining: 4m 58s. Rate: 142.2 symbols/min [2025-09-29T02:20:32.020725] [INFO ] [MAIN ] OXM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:32.104779] [DEBUG] [MAIN ] OWL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:32.126359] [INFO ] [MAIN ] OWL: Generated 1820 derivative records from 54335 primary records. [2025-09-29T02:20:32.136369] [DEBUG] [LOCAL ] OWL: Saving derivative data. [2025-09-29T02:20:32.374111] [DEBUG] [LOCAL ] OWL: Derivative data saved (1820 records). [2025-09-29T02:20:32.374567] [INFO ] [MAIN ] OWL: Successfully saved derivative data. [2025-09-29T02:20:32.378055] [INFO ] [MAIN ] Derivative Progress: 1506/2211 symbols completed. OWL took 1.7s. Estimated remaining: 4m 57s. Rate: 142.2 symbols/min [2025-09-29T02:20:32.378534] [INFO ] [MAIN ] PAAS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:32.399367] [DEBUG] [LOCAL ] OXM: Loaded 33928 existing records from primary storage. [2025-09-29T02:20:32.400782] [INFO ] [MAIN ] OXM: Loaded 33928 primary data records. [2025-09-29T02:20:32.781139] [DEBUG] [MAIN ] OWLT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:32.794439] [DEBUG] [LOCAL ] PAAS: Loaded 54383 existing records from primary storage. [2025-09-29T02:20:32.796035] [INFO ] [MAIN ] OWLT: Generated 1820 derivative records from 9099 primary records. [2025-09-29T02:20:32.796421] [INFO ] [MAIN ] PAAS: Loaded 54383 primary data records. [2025-09-29T02:20:32.796869] [DEBUG] [LOCAL ] OWLT: Saving derivative data. [2025-09-29T02:20:32.931025] [DEBUG] [LOCAL ] OWLT: Derivative data saved (1820 records). [2025-09-29T02:20:32.946474] [INFO ] [MAIN ] OWLT: Successfully saved derivative data. [2025-09-29T02:20:32.964481] [INFO ] [MAIN ] Derivative Progress: 1507/2211 symbols completed. OWLT took 1.0s. Estimated remaining: 4m 57s. Rate: 142.2 symbols/min [2025-09-29T02:20:33.034638] [INFO ] [MAIN ] PAC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:33.236191] [DEBUG] [LOCAL ] PAC: Loaded 11725 existing records from primary storage. [2025-09-29T02:20:33.237726] [INFO ] [MAIN ] PAC: Loaded 11725 primary data records. [2025-09-29T02:20:33.302686] [DEBUG] [MAIN ] OXM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:33.341046] [INFO ] [MAIN ] OXM: Generated 1820 derivative records from 33928 primary records. [2025-09-29T02:20:33.379636] [DEBUG] [LOCAL ] OXM: Saving derivative data. [2025-09-29T02:20:33.520145] [DEBUG] [LOCAL ] OXM: Derivative data saved (1820 records). [2025-09-29T02:20:33.660508] [DEBUG] [MAIN ] PAAS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:33.659936] [INFO ] [MAIN ] OXM: Successfully saved derivative data. [2025-09-29T02:20:33.663633] [INFO ] [MAIN ] Derivative Progress: 1508/2211 symbols completed. OXM took 1.6s. Estimated remaining: 4m 57s. Rate: 142.1 symbols/min [2025-09-29T02:20:33.663859] [INFO ] [MAIN ] PACK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:33.665202] [INFO ] [MAIN ] PAAS: Generated 1820 derivative records from 54383 primary records. [2025-09-29T02:20:33.666214] [DEBUG] [LOCAL ] PAAS: Saving derivative data. [2025-09-29T02:20:33.686092] [DEBUG] [LOCAL ] PAAS: Derivative data saved (1820 records). [2025-09-29T02:20:33.687049] [INFO ] [MAIN ] PAAS: Successfully saved derivative data. [2025-09-29T02:20:33.690811] [INFO ] [MAIN ] Derivative Progress: 1509/2211 symbols completed. PAAS took 1.3s. Estimated remaining: 4m 56s. Rate: 142.2 symbols/min [2025-09-29T02:20:33.691156] [INFO ] [MAIN ] PACS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:33.725728] [DEBUG] [MAIN ] PAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:33.726755] [INFO ] [MAIN ] PAC: Generated 1820 derivative records from 11725 primary records. [2025-09-29T02:20:33.737131] [DEBUG] [LOCAL ] PAC: Saving derivative data. [2025-09-29T02:20:33.755897] [DEBUG] [LOCAL ] PACK: Loaded 32471 existing records from primary storage. [2025-09-29T02:20:33.760274] [INFO ] [MAIN ] PACK: Loaded 32471 primary data records. [2025-09-29T02:20:33.777432] [DEBUG] [LOCAL ] PAC: Derivative data saved (1820 records). [2025-09-29T02:20:33.818531] [INFO ] [MAIN ] PAC: Successfully saved derivative data. [2025-09-29T02:20:33.863070] [INFO ] [MAIN ] Derivative Progress: 1510/2211 symbols completed. PAC took 0.8s. Estimated remaining: 4m 56s. Rate: 142.2 symbols/min [2025-09-29T02:20:33.896546] [INFO ] [MAIN ] PAG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:33.874711] [DEBUG] [LOCAL ] PACS: Loaded 34761 existing records from primary storage. [2025-09-29T02:20:33.897348] [INFO ] [MAIN ] PACS: Loaded 34761 primary data records. [2025-09-29T02:20:34.366783] [DEBUG] [LOCAL ] PAG: Loaded 22217 existing records from primary storage. [2025-09-29T02:20:34.458458] [INFO ] [MAIN ] PAG: Loaded 22217 primary data records. [2025-09-29T02:20:34.831968] [DEBUG] [MAIN ] PACK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:34.835515] [INFO ] [MAIN ] PACK: Generated 1820 derivative records from 32471 primary records. [2025-09-29T02:20:34.843683] [DEBUG] [LOCAL ] PACK: Saving derivative data. [2025-09-29T02:20:34.850776] [DEBUG] [MAIN ] PACS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:34.863224] [INFO ] [MAIN ] PACS: Generated 1820 derivative records from 34761 primary records. [2025-09-29T02:20:34.868114] [DEBUG] [LOCAL ] PACS: Saving derivative data. [2025-09-29T02:20:34.871537] [DEBUG] [LOCAL ] PACK: Derivative data saved (1820 records). [2025-09-29T02:20:34.872709] [INFO ] [MAIN ] PACK: Successfully saved derivative data. [2025-09-29T02:20:34.875304] [INFO ] [MAIN ] Derivative Progress: 1511/2211 symbols completed. PACK took 1.2s. Estimated remaining: 4m 56s. Rate: 142.1 symbols/min [2025-09-29T02:20:34.875758] [INFO ] [MAIN ] PAGS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:34.898405] [DEBUG] [LOCAL ] PACS: Derivative data saved (1820 records). [2025-09-29T02:20:34.899795] [INFO ] [MAIN ] PACS: Successfully saved derivative data. [2025-09-29T02:20:34.903779] [INFO ] [MAIN ] Derivative Progress: 1512/2211 symbols completed. PACS took 1.2s. Estimated remaining: 4m 55s. Rate: 142.2 symbols/min [2025-09-29T02:20:34.917951] [INFO ] [MAIN ] PAI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:34.918628] [DEBUG] [MAIN ] PAG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:34.920503] [INFO ] [MAIN ] PAG: Generated 1820 derivative records from 22217 primary records. [2025-09-29T02:20:34.920890] [DEBUG] [LOCAL ] PAG: Saving derivative data. [2025-09-29T02:20:34.948193] [DEBUG] [LOCAL ] PAI: Loaded 2758 existing records from primary storage. [2025-09-29T02:20:34.949425] [DEBUG] [LOCAL ] PAG: Derivative data saved (1820 records). [2025-09-29T02:20:34.949987] [INFO ] [MAIN ] PAG: Successfully saved derivative data. [2025-09-29T02:20:34.952850] [INFO ] [MAIN ] Derivative Progress: 1513/2211 symbols completed. PAG took 1.1s. Estimated remaining: 4m 54s. Rate: 142.3 symbols/min [2025-09-29T02:20:34.949847] [INFO ] [MAIN ] PAI: Loaded 2758 primary data records. [2025-09-29T02:20:35.176438] [DEBUG] [LOCAL ] PAGS: Loaded 53447 existing records from primary storage. [2025-09-29T02:20:35.194429] [INFO ] [MAIN ] PAGS: Loaded 53447 primary data records. [2025-09-29T02:20:35.748829] [DEBUG] [MAIN ] PAI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:35.750610] [INFO ] [MAIN ] PAI: Generated 1820 derivative records from 2758 primary records. [2025-09-29T02:20:35.750749] [DEBUG] [LOCAL ] PAI: Saving derivative data. [2025-09-29T02:20:35.767630] [DEBUG] [LOCAL ] PAI: Derivative data saved (1820 records). [2025-09-29T02:20:35.768183] [INFO ] [MAIN ] PAI: Successfully saved derivative data. [2025-09-29T02:20:35.770355] [INFO ] [MAIN ] Derivative Progress: 1514/2211 symbols completed. PAI took 0.9s. Estimated remaining: 4m 54s. Rate: 142.2 symbols/min [2025-09-29T02:20:35.788522] [DEBUG] [MAIN ] PAGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:35.789307] [INFO ] [MAIN ] PAGS: Generated 1820 derivative records from 53447 primary records. [2025-09-29T02:20:35.789394] [DEBUG] [LOCAL ] PAGS: Saving derivative data. [2025-09-29T02:20:35.805380] [DEBUG] [LOCAL ] PAGS: Derivative data saved (1820 records). [2025-09-29T02:20:35.805522] [INFO ] [MAIN ] PAGS: Successfully saved derivative data. [2025-09-29T02:20:35.808618] [INFO ] [MAIN ] Derivative Progress: 1515/2211 symbols completed. PAGS took 0.9s. Estimated remaining: 4m 53s. Rate: 142.3 symbols/min [2025-09-29T02:20:35.809361] [INFO ] [MAIN ] PAM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:35.809464] [INFO ] [MAIN ] PAR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:35.809528] [INFO ] [MAIN ] PARR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:35.857598] [DEBUG] [LOCAL ] PAM: Loaded 28420 existing records from primary storage. [2025-09-29T02:20:35.858154] [INFO ] [MAIN ] PAM: Loaded 28420 primary data records. [2025-09-29T02:20:35.984609] [DEBUG] [LOCAL ] PAR: Loaded 33188 existing records from primary storage. [2025-09-29T02:20:36.013538] [INFO ] [MAIN ] PAR: Loaded 33188 primary data records. [2025-09-29T02:20:36.071505] [DEBUG] [LOCAL ] PARR: Loaded 49062 existing records from primary storage. [2025-09-29T02:20:36.163682] [INFO ] [MAIN ] PARR: Loaded 49062 primary data records. [2025-09-29T02:20:36.998170] [DEBUG] [MAIN ] PAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:36.999718] [INFO ] [MAIN ] PAM: Generated 1820 derivative records from 28420 primary records. [2025-09-29T02:20:37.000206] [DEBUG] [LOCAL ] PAM: Saving derivative data. [2025-09-29T02:20:37.037221] [DEBUG] [LOCAL ] PAM: Derivative data saved (1820 records). [2025-09-29T02:20:37.037421] [INFO ] [MAIN ] PAM: Successfully saved derivative data. [2025-09-29T02:20:37.035584] [DEBUG] [MAIN ] PAR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:37.038401] [INFO ] [MAIN ] PAR: Generated 1820 derivative records from 33188 primary records. [2025-09-29T02:20:37.041346] [INFO ] [MAIN ] Derivative Progress: 1516/2211 symbols completed. PAM took 1.2s. Estimated remaining: 4m 53s. Rate: 142.1 symbols/min [2025-09-29T02:20:37.041521] [DEBUG] [LOCAL ] PAR: Saving derivative data. [2025-09-29T02:20:37.042183] [INFO ] [MAIN ] PATH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:37.062239] [DEBUG] [LOCAL ] PAR: Derivative data saved (1820 records). [2025-09-29T02:20:37.062937] [INFO ] [MAIN ] PAR: Successfully saved derivative data. [2025-09-29T02:20:37.066209] [INFO ] [MAIN ] Derivative Progress: 1517/2211 symbols completed. PAR took 1.3s. Estimated remaining: 4m 53s. Rate: 142.2 symbols/min [2025-09-29T02:20:37.066813] [INFO ] [MAIN ] PAXS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:37.086032] [DEBUG] [MAIN ] PARR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:37.087105] [INFO ] [MAIN ] PARR: Generated 1820 derivative records from 49062 primary records. [2025-09-29T02:20:37.087218] [DEBUG] [LOCAL ] PARR: Saving derivative data. [2025-09-29T02:20:37.118267] [DEBUG] [LOCAL ] PARR: Derivative data saved (1820 records). [2025-09-29T02:20:37.118521] [INFO ] [MAIN ] PARR: Successfully saved derivative data. [2025-09-29T02:20:37.122192] [INFO ] [MAIN ] Derivative Progress: 1518/2211 symbols completed. PARR took 1.3s. Estimated remaining: 4m 52s. Rate: 142.3 symbols/min [2025-09-29T02:20:37.122712] [INFO ] [MAIN ] PAY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:37.137589] [DEBUG] [LOCAL ] PAXS: Loaded 21210 existing records from primary storage. [2025-09-29T02:20:37.137927] [INFO ] [MAIN ] PAXS: Loaded 21210 primary data records. [2025-09-29T02:20:37.345734] [DEBUG] [LOCAL ] PATH: Loaded 54457 existing records from primary storage. [2025-09-29T02:20:37.381215] [INFO ] [MAIN ] PATH: Loaded 54457 primary data records. [2025-09-29T02:20:37.447286] [DEBUG] [LOCAL ] PAY: Loaded 38892 existing records from primary storage. [2025-09-29T02:20:37.529760] [INFO ] [MAIN ] PAY: Loaded 38892 primary data records. [2025-09-29T02:20:38.554789] [DEBUG] [MAIN ] PAXS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:38.555673] [INFO ] [MAIN ] PAXS: Generated 1820 derivative records from 21210 primary records. [2025-09-29T02:20:38.555807] [DEBUG] [LOCAL ] PAXS: Saving derivative data. [2025-09-29T02:20:38.575262] [DEBUG] [LOCAL ] PAXS: Derivative data saved (1820 records). [2025-09-29T02:20:38.577502] [INFO ] [MAIN ] PAXS: Successfully saved derivative data. [2025-09-29T02:20:38.581744] [INFO ] [MAIN ] Derivative Progress: 1519/2211 symbols completed. PAXS took 1.5s. Estimated remaining: 4m 52s. Rate: 142.0 symbols/min [2025-09-29T02:20:38.584168] [INFO ] [MAIN ] PAYC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:38.597150] [DEBUG] [MAIN ] PAY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:38.598430] [INFO ] [MAIN ] PAY: Generated 1820 derivative records from 38892 primary records. [2025-09-29T02:20:38.598690] [DEBUG] [LOCAL ] PAY: Saving derivative data. [2025-09-29T02:20:38.612272] [DEBUG] [MAIN ] PATH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:38.613145] [INFO ] [MAIN ] PATH: Generated 1820 derivative records from 54457 primary records. [2025-09-29T02:20:38.613264] [DEBUG] [LOCAL ] PATH: Saving derivative data. [2025-09-29T02:20:38.653273] [DEBUG] [LOCAL ] PAY: Derivative data saved (1820 records). [2025-09-29T02:20:38.652766] [DEBUG] [LOCAL ] PATH: Derivative data saved (1820 records). [2025-09-29T02:20:38.653450] [INFO ] [MAIN ] PAY: Successfully saved derivative data. [2025-09-29T02:20:38.657093] [INFO ] [MAIN ] Derivative Progress: 1520/2211 symbols completed. PAY took 1.5s. Estimated remaining: 4m 52s. Rate: 142.1 symbols/min [2025-09-29T02:20:38.653615] [INFO ] [MAIN ] PATH: Successfully saved derivative data. [2025-09-29T02:20:38.657548] [INFO ] [MAIN ] PB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:38.661197] [INFO ] [MAIN ] Derivative Progress: 1521/2211 symbols completed. PATH took 1.6s. Estimated remaining: 4m 51s. Rate: 142.2 symbols/min [2025-09-29T02:20:38.661995] [INFO ] [MAIN ] PBA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:38.697151] [DEBUG] [LOCAL ] PAYC: Loaded 36903 existing records from primary storage. [2025-09-29T02:20:38.697390] [INFO ] [MAIN ] PAYC: Loaded 36903 primary data records. [2025-09-29T02:20:39.064046] [DEBUG] [LOCAL ] PB: Loaded 42025 existing records from primary storage. [2025-09-29T02:20:39.075837] [DEBUG] [LOCAL ] PBA: Loaded 49665 existing records from primary storage. [2025-09-29T02:20:39.074313] [INFO ] [MAIN ] PB: Loaded 42025 primary data records. [2025-09-29T02:20:39.076112] [INFO ] [MAIN ] PBA: Loaded 49665 primary data records. [2025-09-29T02:20:39.768965] [DEBUG] [MAIN ] PAYC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:39.771181] [INFO ] [MAIN ] PAYC: Generated 1820 derivative records from 36903 primary records. [2025-09-29T02:20:39.771476] [DEBUG] [LOCAL ] PAYC: Saving derivative data. [2025-09-29T02:20:39.793587] [DEBUG] [LOCAL ] PAYC: Derivative data saved (1820 records). [2025-09-29T02:20:39.794110] [INFO ] [MAIN ] PAYC: Successfully saved derivative data. [2025-09-29T02:20:39.797343] [INFO ] [MAIN ] Derivative Progress: 1522/2211 symbols completed. PAYC took 1.2s. Estimated remaining: 4m 51s. Rate: 142.1 symbols/min [2025-09-29T02:20:39.797891] [INFO ] [MAIN ] PBF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:39.821622] [DEBUG] [MAIN ] PB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:39.835987] [DEBUG] [MAIN ] PBA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:39.836560] [INFO ] [MAIN ] PB: Generated 1820 derivative records from 42025 primary records. [2025-09-29T02:20:39.837776] [INFO ] [MAIN ] PBA: Generated 1820 derivative records from 49665 primary records. [2025-09-29T02:20:39.838079] [DEBUG] [LOCAL ] PBA: Saving derivative data. [2025-09-29T02:20:39.837993] [DEBUG] [LOCAL ] PB: Saving derivative data. [2025-09-29T02:20:39.871432] [DEBUG] [LOCAL ] PBA: Derivative data saved (1820 records). [2025-09-29T02:20:39.872510] [DEBUG] [LOCAL ] PB: Derivative data saved (1820 records). [2025-09-29T02:20:39.873015] [INFO ] [MAIN ] PB: Successfully saved derivative data. [2025-09-29T02:20:39.872928] [INFO ] [MAIN ] PBA: Successfully saved derivative data. [2025-09-29T02:20:39.876242] [INFO ] [MAIN ] Derivative Progress: 1523/2211 symbols completed. PB took 1.2s. Estimated remaining: 4m 50s. Rate: 142.1 symbols/min [2025-09-29T02:20:39.879986] [INFO ] [MAIN ] PBH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:39.880107] [INFO ] [MAIN ] Derivative Progress: 1524/2211 symbols completed. PBA took 1.2s. Estimated remaining: 4m 50s. Rate: 142.2 symbols/min [2025-09-29T02:20:39.880584] [INFO ] [MAIN ] PBI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:39.924568] [DEBUG] [LOCAL ] PBF: Loaded 53866 existing records from primary storage. [2025-09-29T02:20:39.924958] [INFO ] [MAIN ] PBF: Loaded 53866 primary data records. [2025-09-29T02:20:40.047515] [DEBUG] [LOCAL ] PBH: Loaded 32156 existing records from primary storage. [2025-09-29T02:20:40.077548] [INFO ] [MAIN ] PBH: Loaded 32156 primary data records. [2025-09-29T02:20:40.300543] [DEBUG] [LOCAL ] PBI: Loaded 50788 existing records from primary storage. [2025-09-29T02:20:40.314826] [INFO ] [MAIN ] PBI: Loaded 50788 primary data records. [2025-09-29T02:20:41.077151] [DEBUG] [MAIN ] PBF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:41.078487] [INFO ] [MAIN ] PBF: Generated 1820 derivative records from 53866 primary records. [2025-09-29T02:20:41.078909] [DEBUG] [LOCAL ] PBF: Saving derivative data. [2025-09-29T02:20:41.097433] [DEBUG] [LOCAL ] PBF: Derivative data saved (1820 records). [2025-09-29T02:20:41.098036] [INFO ] [MAIN ] PBF: Successfully saved derivative data. [2025-09-29T02:20:41.100917] [INFO ] [MAIN ] Derivative Progress: 1525/2211 symbols completed. PBF took 1.3s. Estimated remaining: 4m 50s. Rate: 142.0 symbols/min [2025-09-29T02:20:41.101314] [INFO ] [MAIN ] PBR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:41.120944] [DEBUG] [MAIN ] PBH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:41.121871] [INFO ] [MAIN ] PBH: Generated 1820 derivative records from 32156 primary records. [2025-09-29T02:20:41.121972] [DEBUG] [LOCAL ] PBH: Saving derivative data. [2025-09-29T02:20:41.143165] [DEBUG] [LOCAL ] PBH: Derivative data saved (1820 records). [2025-09-29T02:20:41.143583] [INFO ] [MAIN ] PBH: Successfully saved derivative data. [2025-09-29T02:20:41.161002] [DEBUG] [MAIN ] PBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:41.160505] [INFO ] [MAIN ] Derivative Progress: 1526/2211 symbols completed. PBH took 1.3s. Estimated remaining: 4m 49s. Rate: 142.1 symbols/min [2025-09-29T02:20:41.162136] [INFO ] [MAIN ] PBI: Generated 1820 derivative records from 50788 primary records. [2025-09-29T02:20:41.162552] [DEBUG] [LOCAL ] PBI: Saving derivative data. [2025-09-29T02:20:41.162311] [INFO ] [MAIN ] PBT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:41.181900] [DEBUG] [LOCAL ] PBI: Derivative data saved (1820 records). [2025-09-29T02:20:41.182050] [INFO ] [MAIN ] PBI: Successfully saved derivative data. [2025-09-29T02:20:41.185011] [INFO ] [MAIN ] Derivative Progress: 1527/2211 symbols completed. PBI took 1.3s. Estimated remaining: 4m 49s. Rate: 142.2 symbols/min [2025-09-29T02:20:41.185271] [INFO ] [MAIN ] PCF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:41.205520] [DEBUG] [LOCAL ] PBT: Loaded 17533 existing records from primary storage. [2025-09-29T02:20:41.220026] [INFO ] [MAIN ] PBT: Loaded 17533 primary data records. [2025-09-29T02:20:41.252353] [DEBUG] [LOCAL ] PCF: Loaded 8720 existing records from primary storage. [2025-09-29T02:20:41.294864] [INFO ] [MAIN ] PCF: Loaded 8720 primary data records. [2025-09-29T02:20:41.449430] [DEBUG] [LOCAL ] PBR: Loaded 54492 existing records from primary storage. [2025-09-29T02:20:41.562409] [INFO ] [MAIN ] PBR: Loaded 54492 primary data records. [2025-09-29T02:20:42.385373] [DEBUG] [MAIN ] PBT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:42.388108] [INFO ] [MAIN ] PBT: Generated 1820 derivative records from 17533 primary records. [2025-09-29T02:20:42.388804] [DEBUG] [LOCAL ] PBT: Saving derivative data. [2025-09-29T02:20:42.403565] [DEBUG] [MAIN ] PCF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:42.416322] [INFO ] [MAIN ] PCF: Generated 1820 derivative records from 8720 primary records. [2025-09-29T02:20:42.416553] [DEBUG] [LOCAL ] PCF: Saving derivative data. [2025-09-29T02:20:42.422229] [DEBUG] [LOCAL ] PBT: Derivative data saved (1820 records). [2025-09-29T02:20:42.437920] [INFO ] [MAIN ] PBT: Successfully saved derivative data. [2025-09-29T02:20:42.438770] [DEBUG] [LOCAL ] PCF: Derivative data saved (1820 records). [2025-09-29T02:20:42.441826] [INFO ] [MAIN ] PCF: Successfully saved derivative data. [2025-09-29T02:20:42.441710] [INFO ] [MAIN ] Derivative Progress: 1528/2211 symbols completed. PBT took 1.3s. Estimated remaining: 4m 49s. Rate: 142.0 symbols/min [2025-09-29T02:20:42.444715] [INFO ] [MAIN ] Derivative Progress: 1529/2211 symbols completed. PCF took 1.3s. Estimated remaining: 4m 48s. Rate: 142.1 symbols/min [2025-09-29T02:20:42.457788] [DEBUG] [MAIN ] PBR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:42.458400] [INFO ] [MAIN ] PBR: Generated 1820 derivative records from 54492 primary records. [2025-09-29T02:20:42.458483] [DEBUG] [LOCAL ] PBR: Saving derivative data. [2025-09-29T02:20:42.474413] [DEBUG] [LOCAL ] PBR: Derivative data saved (1820 records). [2025-09-29T02:20:42.474500] [INFO ] [MAIN ] PBR: Successfully saved derivative data. [2025-09-29T02:20:42.477912] [INFO ] [MAIN ] Derivative Progress: 1530/2211 symbols completed. PBR took 1.4s. Estimated remaining: 4m 47s. Rate: 142.2 symbols/min [2025-09-29T02:20:42.478356] [INFO ] [MAIN ] PCG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:42.478425] [INFO ] [MAIN ] PCN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:42.478880] [INFO ] [MAIN ] PCM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:42.491266] [DEBUG] [LOCAL ] PCM: Loaded 6857 existing records from primary storage. [2025-09-29T02:20:42.491561] [INFO ] [MAIN ] PCM: Loaded 6857 primary data records. [2025-09-29T02:20:42.673491] [DEBUG] [LOCAL ] PCN: Loaded 24709 existing records from primary storage. [2025-09-29T02:20:42.722760] [INFO ] [MAIN ] PCN: Loaded 24709 primary data records. [2025-09-29T02:20:42.979467] [DEBUG] [LOCAL ] PCG: Loaded 54498 existing records from primary storage. [2025-09-29T02:20:43.029476] [INFO ] [MAIN ] PCG: Loaded 54498 primary data records. [2025-09-29T02:20:43.601858] [DEBUG] [MAIN ] PCM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:43.614552] [INFO ] [MAIN ] PCM: Generated 1820 derivative records from 6857 primary records. [2025-09-29T02:20:43.615002] [DEBUG] [LOCAL ] PCM: Saving derivative data. [2025-09-29T02:20:43.636895] [DEBUG] [LOCAL ] PCM: Derivative data saved (1820 records). [2025-09-29T02:20:43.637983] [INFO ] [MAIN ] PCM: Successfully saved derivative data. [2025-09-29T02:20:43.640555] [INFO ] [MAIN ] Derivative Progress: 1531/2211 symbols completed. PCM took 1.2s. Estimated remaining: 4m 47s. Rate: 142.0 symbols/min [2025-09-29T02:20:43.641285] [INFO ] [MAIN ] PCOR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:43.665483] [DEBUG] [MAIN ] PCN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:43.666410] [INFO ] [MAIN ] PCN: Generated 1820 derivative records from 24709 primary records. [2025-09-29T02:20:43.666812] [DEBUG] [LOCAL ] PCN: Saving derivative data. [2025-09-29T02:20:43.686276] [DEBUG] [LOCAL ] PCN: Derivative data saved (1820 records). [2025-09-29T02:20:43.687887] [INFO ] [MAIN ] PCN: Successfully saved derivative data. [2025-09-29T02:20:43.691438] [INFO ] [MAIN ] Derivative Progress: 1532/2211 symbols completed. PCN took 1.2s. Estimated remaining: 4m 47s. Rate: 142.1 symbols/min [2025-09-29T02:20:43.691716] [INFO ] [MAIN ] PCQ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:43.710365] [DEBUG] [MAIN ] PCG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:43.711251] [INFO ] [MAIN ] PCG: Generated 1820 derivative records from 54498 primary records. [2025-09-29T02:20:43.711594] [DEBUG] [LOCAL ] PCG: Saving derivative data. [2025-09-29T02:20:43.744452] [DEBUG] [LOCAL ] PCG: Derivative data saved (1820 records). [2025-09-29T02:20:43.744760] [INFO ] [MAIN ] PCG: Successfully saved derivative data. [2025-09-29T02:20:43.748271] [INFO ] [MAIN ] Derivative Progress: 1533/2211 symbols completed. PCG took 1.3s. Estimated remaining: 4m 46s. Rate: 142.2 symbols/min [2025-09-29T02:20:43.755899] [DEBUG] [LOCAL ] PCQ: Loaded 12298 existing records from primary storage. [2025-09-29T02:20:43.756263] [INFO ] [MAIN ] PD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:43.771312] [INFO ] [MAIN ] PCQ: Loaded 12298 primary data records. [2025-09-29T02:20:43.773082] [DEBUG] [LOCAL ] PCOR: Loaded 48849 existing records from primary storage. [2025-09-29T02:20:43.780707] [INFO ] [MAIN ] PCOR: Loaded 48849 primary data records. [2025-09-29T02:20:44.521576] [DEBUG] [LOCAL ] PD: Loaded 48580 existing records from primary storage. [2025-09-29T02:20:44.522051] [INFO ] [MAIN ] PD: Loaded 48580 primary data records. [2025-09-29T02:20:44.876926] [DEBUG] [MAIN ] PCOR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:44.882152] [INFO ] [MAIN ] PCOR: Generated 1820 derivative records from 48849 primary records. [2025-09-29T02:20:44.882805] [DEBUG] [LOCAL ] PCOR: Saving derivative data. [2025-09-29T02:20:44.897032] [DEBUG] [MAIN ] PCQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:44.900005] [INFO ] [MAIN ] PCQ: Generated 1820 derivative records from 12298 primary records. [2025-09-29T02:20:44.911690] [DEBUG] [LOCAL ] PCQ: Saving derivative data. [2025-09-29T02:20:44.916035] [DEBUG] [LOCAL ] PCOR: Derivative data saved (1820 records). [2025-09-29T02:20:44.918574] [INFO ] [MAIN ] PCOR: Successfully saved derivative data. [2025-09-29T02:20:44.922084] [INFO ] [MAIN ] Derivative Progress: 1534/2211 symbols completed. PCOR took 1.3s. Estimated remaining: 4m 46s. Rate: 142.0 symbols/min [2025-09-29T02:20:44.933830] [INFO ] [MAIN ] PDI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:44.939241] [DEBUG] [LOCAL ] PCQ: Derivative data saved (1820 records). [2025-09-29T02:20:44.939397] [INFO ] [MAIN ] PCQ: Successfully saved derivative data. [2025-09-29T02:20:44.942363] [INFO ] [MAIN ] Derivative Progress: 1535/2211 symbols completed. PCQ took 1.3s. Estimated remaining: 4m 45s. Rate: 142.1 symbols/min [2025-09-29T02:20:44.942776] [INFO ] [MAIN ] PDM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:44.969411] [DEBUG] [MAIN ] PD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:44.971707] [INFO ] [MAIN ] PD: Generated 1820 derivative records from 48580 primary records. [2025-09-29T02:20:44.971822] [DEBUG] [LOCAL ] PD: Saving derivative data. [2025-09-29T02:20:44.989371] [DEBUG] [LOCAL ] PD: Derivative data saved (1820 records). [2025-09-29T02:20:44.989790] [INFO ] [MAIN ] PD: Successfully saved derivative data. [2025-09-29T02:20:44.994082] [INFO ] [MAIN ] Derivative Progress: 1536/2211 symbols completed. PD took 1.2s. Estimated remaining: 4m 45s. Rate: 142.2 symbols/min [2025-09-29T02:20:44.994408] [INFO ] [MAIN ] PDO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:45.038881] [DEBUG] [LOCAL ] PDM: Loaded 40354 existing records from primary storage. [2025-09-29T02:20:45.039085] [INFO ] [MAIN ] PDM: Loaded 40354 primary data records. [2025-09-29T02:20:45.174576] [DEBUG] [LOCAL ] PDI: Loaded 50909 existing records from primary storage. [2025-09-29T02:20:45.201752] [INFO ] [MAIN ] PDI: Loaded 50909 primary data records. [2025-09-29T02:20:45.283221] [DEBUG] [LOCAL ] PDO: Loaded 32146 existing records from primary storage. [2025-09-29T02:20:45.308762] [INFO ] [MAIN ] PDO: Loaded 32146 primary data records. [2025-09-29T02:20:46.142144] [DEBUG] [MAIN ] PDM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:46.146115] [INFO ] [MAIN ] PDM: Generated 1820 derivative records from 40354 primary records. [2025-09-29T02:20:46.146712] [DEBUG] [LOCAL ] PDM: Saving derivative data. [2025-09-29T02:20:46.162172] [DEBUG] [MAIN ] PDI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:46.181408] [DEBUG] [LOCAL ] PDM: Derivative data saved (1820 records). [2025-09-29T02:20:46.180296] [INFO ] [MAIN ] PDI: Generated 1820 derivative records from 50909 primary records. [2025-09-29T02:20:46.181531] [INFO ] [MAIN ] PDM: Successfully saved derivative data. [2025-09-29T02:20:46.181979] [DEBUG] [LOCAL ] PDI: Saving derivative data. [2025-09-29T02:20:46.184635] [INFO ] [MAIN ] Derivative Progress: 1537/2211 symbols completed. PDM took 1.2s. Estimated remaining: 4m 45s. Rate: 142.0 symbols/min [2025-09-29T02:20:46.197728] [INFO ] [MAIN ] PDS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:46.199834] [DEBUG] [MAIN ] PDO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:46.213068] [INFO ] [MAIN ] PDO: Generated 1820 derivative records from 32146 primary records. [2025-09-29T02:20:46.218317] [DEBUG] [LOCAL ] PDO: Saving derivative data. [2025-09-29T02:20:46.218066] [DEBUG] [LOCAL ] PDI: Derivative data saved (1820 records). [2025-09-29T02:20:46.218497] [INFO ] [MAIN ] PDI: Successfully saved derivative data. [2025-09-29T02:20:46.222989] [INFO ] [MAIN ] Derivative Progress: 1538/2211 symbols completed. PDI took 1.3s. Estimated remaining: 4m 44s. Rate: 142.1 symbols/min [2025-09-29T02:20:46.223219] [INFO ] [MAIN ] PDT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:46.245562] [DEBUG] [LOCAL ] PDO: Derivative data saved (1820 records). [2025-09-29T02:20:46.245759] [INFO ] [MAIN ] PDO: Successfully saved derivative data. [2025-09-29T02:20:46.248937] [INFO ] [MAIN ] Derivative Progress: 1539/2211 symbols completed. PDO took 1.3s. Estimated remaining: 4m 44s. Rate: 142.2 symbols/min [2025-09-29T02:20:46.249368] [INFO ] [MAIN ] PDX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:46.263708] [DEBUG] [LOCAL ] PDS: Loaded 18297 existing records from primary storage. [2025-09-29T02:20:46.263988] [INFO ] [MAIN ] PDS: Loaded 18297 primary data records. [2025-09-29T02:20:46.387097] [DEBUG] [LOCAL ] PDT: Loaded 17549 existing records from primary storage. [2025-09-29T02:20:46.387290] [INFO ] [MAIN ] PDT: Loaded 17549 primary data records. [2025-09-29T02:20:46.400922] [DEBUG] [LOCAL ] PDX: Loaded 14514 existing records from primary storage. [2025-09-29T02:20:46.419954] [INFO ] [MAIN ] PDX: Loaded 14514 primary data records. [2025-09-29T02:20:47.400892] [DEBUG] [MAIN ] PDS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:47.402276] [INFO ] [MAIN ] PDS: Generated 1820 derivative records from 18297 primary records. [2025-09-29T02:20:47.402414] [DEBUG] [LOCAL ] PDS: Saving derivative data. [2025-09-29T02:20:47.416163] [DEBUG] [MAIN ] PDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:47.419517] [INFO ] [MAIN ] PDT: Generated 1820 derivative records from 17549 primary records. [2025-09-29T02:20:47.427921] [DEBUG] [LOCAL ] PDT: Saving derivative data. [2025-09-29T02:20:47.458357] [DEBUG] [LOCAL ] PDS: Derivative data saved (1820 records). [2025-09-29T02:20:47.456798] [DEBUG] [LOCAL ] PDT: Derivative data saved (1820 records). [2025-09-29T02:20:47.458958] [INFO ] [MAIN ] PDS: Successfully saved derivative data. [2025-09-29T02:20:47.461660] [INFO ] [MAIN ] Derivative Progress: 1540/2211 symbols completed. PDS took 1.3s. Estimated remaining: 4m 43s. Rate: 142.0 symbols/min [2025-09-29T02:20:47.462103] [INFO ] [MAIN ] PDT: Successfully saved derivative data. [2025-09-29T02:20:47.464941] [INFO ] [MAIN ] PEB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:47.465350] [INFO ] [MAIN ] Derivative Progress: 1541/2211 symbols completed. PDT took 1.2s. Estimated remaining: 4m 43s. Rate: 142.1 symbols/min [2025-09-29T02:20:47.466072] [INFO ] [MAIN ] PEG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:47.488524] [DEBUG] [MAIN ] PDX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:47.489458] [INFO ] [MAIN ] PDX: Generated 1820 derivative records from 14514 primary records. [2025-09-29T02:20:47.489621] [DEBUG] [LOCAL ] PDX: Saving derivative data. [2025-09-29T02:20:47.506766] [DEBUG] [LOCAL ] PDX: Derivative data saved (1820 records). [2025-09-29T02:20:47.506891] [INFO ] [MAIN ] PDX: Successfully saved derivative data. [2025-09-29T02:20:47.511113] [INFO ] [MAIN ] Derivative Progress: 1542/2211 symbols completed. PDX took 1.3s. Estimated remaining: 4m 42s. Rate: 142.2 symbols/min [2025-09-29T02:20:47.511413] [INFO ] [MAIN ] PEN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:47.592283] [DEBUG] [LOCAL ] PEG: Loaded 53893 existing records from primary storage. [2025-09-29T02:20:47.594162] [INFO ] [MAIN ] PEG: Loaded 53893 primary data records. [2025-09-29T02:20:47.600840] [DEBUG] [LOCAL ] PEB: Loaded 51448 existing records from primary storage. [2025-09-29T02:20:47.645803] [INFO ] [MAIN ] PEB: Loaded 51448 primary data records. [2025-09-29T02:20:47.695338] [DEBUG] [LOCAL ] PEN: Loaded 30842 existing records from primary storage. [2025-09-29T02:20:47.741248] [INFO ] [MAIN ] PEN: Loaded 30842 primary data records. [2025-09-29T02:20:48.667897] [DEBUG] [MAIN ] PEG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:48.669739] [INFO ] [MAIN ] PEG: Generated 1820 derivative records from 53893 primary records. [2025-09-29T02:20:48.669924] [DEBUG] [LOCAL ] PEG: Saving derivative data. [2025-09-29T02:20:48.706602] [DEBUG] [MAIN ] PEB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:48.708793] [INFO ] [MAIN ] PEB: Generated 1820 derivative records from 51448 primary records. [2025-09-29T02:20:48.707413] [DEBUG] [LOCAL ] PEG: Derivative data saved (1820 records). [2025-09-29T02:20:48.708943] [DEBUG] [LOCAL ] PEB: Saving derivative data. [2025-09-29T02:20:48.710076] [INFO ] [MAIN ] PEG: Successfully saved derivative data. [2025-09-29T02:20:48.713528] [INFO ] [MAIN ] Derivative Progress: 1543/2211 symbols completed. PEG took 1.2s. Estimated remaining: 4m 42s. Rate: 142.0 symbols/min [2025-09-29T02:20:48.733563] [DEBUG] [LOCAL ] PEB: Derivative data saved (1820 records). [2025-09-29T02:20:48.733885] [INFO ] [MAIN ] PEB: Successfully saved derivative data. [2025-09-29T02:20:48.738176] [INFO ] [MAIN ] Derivative Progress: 1544/2211 symbols completed. PEB took 1.3s. Estimated remaining: 4m 42s. Rate: 142.1 symbols/min [2025-09-29T02:20:48.751748] [DEBUG] [MAIN ] PEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:48.752632] [INFO ] [MAIN ] PEN: Generated 1820 derivative records from 30842 primary records. [2025-09-29T02:20:48.752755] [DEBUG] [LOCAL ] PEN: Saving derivative data. [2025-09-29T02:20:48.768530] [DEBUG] [LOCAL ] PEN: Derivative data saved (1820 records). [2025-09-29T02:20:48.768732] [INFO ] [MAIN ] PEN: Successfully saved derivative data. [2025-09-29T02:20:48.773092] [INFO ] [MAIN ] Derivative Progress: 1545/2211 symbols completed. PEN took 1.3s. Estimated remaining: 4m 41s. Rate: 142.2 symbols/min [2025-09-29T02:20:48.773738] [INFO ] [MAIN ] PFD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:48.773668] [INFO ] [MAIN ] PEO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:48.773843] [INFO ] [MAIN ] PERF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:48.786148] [DEBUG] [LOCAL ] PFD: Loaded 5199 existing records from primary storage. [2025-09-29T02:20:48.786515] [INFO ] [MAIN ] PFD: Loaded 5199 primary data records. [2025-09-29T02:20:48.893221] [DEBUG] [LOCAL ] PEO: Loaded 10999 existing records from primary storage. [2025-09-29T02:20:48.924600] [DEBUG] [LOCAL ] PERF: Loaded 14231 existing records from primary storage. [2025-09-29T02:20:48.924773] [INFO ] [MAIN ] PEO: Loaded 10999 primary data records. [2025-09-29T02:20:48.956397] [INFO ] [MAIN ] PERF: Loaded 14231 primary data records. [2025-09-29T02:20:49.912874] [DEBUG] [MAIN ] PFD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:49.916343] [INFO ] [MAIN ] PFD: Generated 1820 derivative records from 5199 primary records. [2025-09-29T02:20:49.917371] [DEBUG] [LOCAL ] PFD: Saving derivative data. [2025-09-29T02:20:49.939770] [DEBUG] [LOCAL ] PFD: Derivative data saved (1820 records). [2025-09-29T02:20:49.941610] [INFO ] [MAIN ] PFD: Successfully saved derivative data. [2025-09-29T02:20:49.944050] [INFO ] [MAIN ] Derivative Progress: 1546/2211 symbols completed. PFD took 1.2s. Estimated remaining: 4m 41s. Rate: 142.1 symbols/min [2025-09-29T02:20:49.944514] [INFO ] [MAIN ] PFE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:49.970863] [DEBUG] [MAIN ] PERF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:49.972021] [INFO ] [MAIN ] PERF: Generated 1820 derivative records from 14231 primary records. [2025-09-29T02:20:49.971098] [DEBUG] [MAIN ] PEO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:49.972143] [DEBUG] [LOCAL ] PERF: Saving derivative data. [2025-09-29T02:20:49.972834] [INFO ] [MAIN ] PEO: Generated 1820 derivative records from 10999 primary records. [2025-09-29T02:20:49.972968] [DEBUG] [LOCAL ] PEO: Saving derivative data. [2025-09-29T02:20:50.000949] [DEBUG] [LOCAL ] PEO: Derivative data saved (1820 records). [2025-09-29T02:20:50.004674] [INFO ] [MAIN ] PEO: Successfully saved derivative data. [2025-09-29T02:20:50.007384] [INFO ] [MAIN ] Derivative Progress: 1547/2211 symbols completed. PEO took 1.2s. Estimated remaining: 4m 40s. Rate: 142.1 symbols/min [2025-09-29T02:20:50.008451] [DEBUG] [LOCAL ] PERF: Derivative data saved (1820 records). [2025-09-29T02:20:50.007886] [INFO ] [MAIN ] PFGC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:50.008627] [INFO ] [MAIN ] PERF: Successfully saved derivative data. [2025-09-29T02:20:50.011723] [INFO ] [MAIN ] Derivative Progress: 1548/2211 symbols completed. PERF took 1.2s. Estimated remaining: 4m 40s. Rate: 142.2 symbols/min [2025-09-29T02:20:50.012250] [INFO ] [MAIN ] PFH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:50.028481] [DEBUG] [LOCAL ] PFH: Loaded 6911 existing records from primary storage. [2025-09-29T02:20:50.028991] [INFO ] [MAIN ] PFH: Loaded 6911 primary data records. [2025-09-29T02:20:50.299063] [DEBUG] [LOCAL ] PFE: Loaded 54593 existing records from primary storage. [2025-09-29T02:20:50.442276] [INFO ] [MAIN ] PFE: Loaded 54593 primary data records. [2025-09-29T02:20:50.455727] [DEBUG] [LOCAL ] PFGC: Loaded 47650 existing records from primary storage. [2025-09-29T02:20:50.488991] [INFO ] [MAIN ] PFGC: Loaded 47650 primary data records. [2025-09-29T02:20:51.213879] [DEBUG] [MAIN ] PFH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:51.215529] [INFO ] [MAIN ] PFH: Generated 1820 derivative records from 6911 primary records. [2025-09-29T02:20:51.215701] [DEBUG] [LOCAL ] PFH: Saving derivative data. [2025-09-29T02:20:51.236312] [DEBUG] [LOCAL ] PFH: Derivative data saved (1820 records). [2025-09-29T02:20:51.236744] [INFO ] [MAIN ] PFH: Successfully saved derivative data. [2025-09-29T02:20:51.239408] [INFO ] [MAIN ] Derivative Progress: 1549/2211 symbols completed. PFH took 1.2s. Estimated remaining: 4m 40s. Rate: 142.0 symbols/min [2025-09-29T02:20:51.240561] [INFO ] [MAIN ] PFL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:51.276104] [DEBUG] [MAIN ] PFE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:51.287783] [INFO ] [MAIN ] PFE: Generated 1820 derivative records from 54593 primary records. [2025-09-29T02:20:51.294364] [DEBUG] [LOCAL ] PFL: Loaded 13959 existing records from primary storage. [2025-09-29T02:20:51.294790] [DEBUG] [MAIN ] PFGC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:51.293933] [DEBUG] [LOCAL ] PFE: Saving derivative data. [2025-09-29T02:20:51.295807] [INFO ] [MAIN ] PFL: Loaded 13959 primary data records. [2025-09-29T02:20:51.296873] [INFO ] [MAIN ] PFGC: Generated 1820 derivative records from 47650 primary records. [2025-09-29T02:20:51.305889] [DEBUG] [LOCAL ] PFGC: Saving derivative data. [2025-09-29T02:20:51.351898] [DEBUG] [LOCAL ] PFE: Derivative data saved (1820 records). [2025-09-29T02:20:51.397491] [INFO ] [MAIN ] PFE: Successfully saved derivative data. [2025-09-29T02:20:51.423974] [DEBUG] [LOCAL ] PFGC: Derivative data saved (1820 records). [2025-09-29T02:20:51.427621] [INFO ] [MAIN ] Derivative Progress: 1550/2211 symbols completed. PFE took 1.5s. Estimated remaining: 4m 39s. Rate: 142.1 symbols/min [2025-09-29T02:20:51.463268] [INFO ] [MAIN ] PFGC: Successfully saved derivative data. [2025-09-29T02:20:51.463405] [INFO ] [MAIN ] PFLT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:51.477565] [INFO ] [MAIN ] Derivative Progress: 1551/2211 symbols completed. PFGC took 1.5s. Estimated remaining: 4m 39s. Rate: 142.2 symbols/min [2025-09-29T02:20:51.493860] [INFO ] [MAIN ] PFN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:51.714301] [DEBUG] [LOCAL ] PFN: Loaded 21992 existing records from primary storage. [2025-09-29T02:20:51.724740] [INFO ] [MAIN ] PFN: Loaded 21992 primary data records. [2025-09-29T02:20:51.870595] [DEBUG] [LOCAL ] PFLT: Loaded 44333 existing records from primary storage. [2025-09-29T02:20:51.881448] [INFO ] [MAIN ] PFLT: Loaded 44333 primary data records. [2025-09-29T02:20:51.880955] [DEBUG] [MAIN ] PFL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:51.893060] [INFO ] [MAIN ] PFL: Generated 1820 derivative records from 13959 primary records. [2025-09-29T02:20:51.949173] [DEBUG] [LOCAL ] PFL: Saving derivative data. [2025-09-29T02:20:52.250255] [DEBUG] [LOCAL ] PFL: Derivative data saved (1820 records). [2025-09-29T02:20:52.278415] [INFO ] [MAIN ] PFL: Successfully saved derivative data. [2025-09-29T02:20:52.292108] [INFO ] [MAIN ] Derivative Progress: 1552/2211 symbols completed. PFL took 1.1s. Estimated remaining: 4m 38s. Rate: 142.1 symbols/min [2025-09-29T02:20:52.321060] [INFO ] [MAIN ] PFO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:52.472552] [DEBUG] [LOCAL ] PFO: Loaded 5948 existing records from primary storage. [2025-09-29T02:20:52.473713] [INFO ] [MAIN ] PFO: Loaded 5948 primary data records. [2025-09-29T02:20:52.524006] [DEBUG] [MAIN ] PFN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:52.567878] [INFO ] [MAIN ] PFN: Generated 1820 derivative records from 21992 primary records. [2025-09-29T02:20:52.601745] [DEBUG] [LOCAL ] PFN: Saving derivative data. [2025-09-29T02:20:52.854221] [DEBUG] [LOCAL ] PFN: Derivative data saved (1820 records). [2025-09-29T02:20:52.860789] [INFO ] [MAIN ] PFN: Successfully saved derivative data. [2025-09-29T02:20:52.861323] [DEBUG] [MAIN ] PFLT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:52.865869] [INFO ] [MAIN ] PFLT: Generated 1820 derivative records from 44333 primary records. [2025-09-29T02:20:52.864209] [INFO ] [MAIN ] Derivative Progress: 1553/2211 symbols completed. PFN took 1.4s. Estimated remaining: 4m 38s. Rate: 142.1 symbols/min [2025-09-29T02:20:52.866247] [INFO ] [MAIN ] PFS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:52.866021] [DEBUG] [LOCAL ] PFLT: Saving derivative data. [2025-09-29T02:20:52.887692] [DEBUG] [LOCAL ] PFLT: Derivative data saved (1820 records). [2025-09-29T02:20:52.888381] [INFO ] [MAIN ] PFLT: Successfully saved derivative data. [2025-09-29T02:20:52.892546] [INFO ] [MAIN ] Derivative Progress: 1554/2211 symbols completed. PFLT took 1.4s. Estimated remaining: 4m 37s. Rate: 142.1 symbols/min [2025-09-29T02:20:52.893453] [INFO ] [MAIN ] PFSI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:52.914052] [DEBUG] [MAIN ] PFO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:52.915889] [INFO ] [MAIN ] PFO: Generated 1820 derivative records from 5948 primary records. [2025-09-29T02:20:52.925731] [DEBUG] [LOCAL ] PFO: Saving derivative data. [2025-09-29T02:20:52.944144] [DEBUG] [LOCAL ] PFO: Derivative data saved (1820 records). [2025-09-29T02:20:52.954882] [INFO ] [MAIN ] PFO: Successfully saved derivative data. [2025-09-29T02:20:52.966405] [INFO ] [MAIN ] Derivative Progress: 1555/2211 symbols completed. PFO took 0.6s. Estimated remaining: 4m 37s. Rate: 142.2 symbols/min [2025-09-29T02:20:52.968176] [DEBUG] [LOCAL ] PFS: Loaded 36188 existing records from primary storage. [2025-09-29T02:20:52.968570] [INFO ] [MAIN ] PG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:52.968675] [INFO ] [MAIN ] PFS: Loaded 36188 primary data records. [2025-09-29T02:20:53.052178] [DEBUG] [LOCAL ] PFSI: Loaded 29259 existing records from primary storage. [2025-09-29T02:20:53.076900] [INFO ] [MAIN ] PFSI: Loaded 29259 primary data records. [2025-09-29T02:20:53.618855] [DEBUG] [LOCAL ] PG: Loaded 54532 existing records from primary storage. [2025-09-29T02:20:53.739548] [INFO ] [MAIN ] PG: Loaded 54532 primary data records. [2025-09-29T02:20:54.123981] [DEBUG] [MAIN ] PFS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:54.125621] [INFO ] [MAIN ] PFS: Generated 1820 derivative records from 36188 primary records. [2025-09-29T02:20:54.126199] [DEBUG] [LOCAL ] PFS: Saving derivative data. [2025-09-29T02:20:54.141182] [DEBUG] [MAIN ] PFSI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:54.143774] [INFO ] [MAIN ] PFSI: Generated 1820 derivative records from 29259 primary records. [2025-09-29T02:20:54.153081] [DEBUG] [LOCAL ] PFSI: Saving derivative data. [2025-09-29T02:20:54.162281] [DEBUG] [LOCAL ] PFS: Derivative data saved (1820 records). [2025-09-29T02:20:54.162807] [INFO ] [MAIN ] PFS: Successfully saved derivative data. [2025-09-29T02:20:54.172874] [INFO ] [MAIN ] Derivative Progress: 1556/2211 symbols completed. PFS took 1.3s. Estimated remaining: 4m 37s. Rate: 142.1 symbols/min [2025-09-29T02:20:54.177630] [INFO ] [MAIN ] PGP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:54.185007] [DEBUG] [LOCAL ] PFSI: Derivative data saved (1820 records). [2025-09-29T02:20:54.187034] [INFO ] [MAIN ] PFSI: Successfully saved derivative data. [2025-09-29T02:20:54.190161] [INFO ] [MAIN ] Derivative Progress: 1557/2211 symbols completed. PFSI took 1.3s. Estimated remaining: 4m 36s. Rate: 142.1 symbols/min [2025-09-29T02:20:54.196779] [INFO ] [MAIN ] PGR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:54.197290] [DEBUG] [LOCAL ] PGP: Loaded 5515 existing records from primary storage. [2025-09-29T02:20:54.198206] [INFO ] [MAIN ] PGP: Loaded 5515 primary data records. [2025-09-29T02:20:54.276480] [DEBUG] [MAIN ] PG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:54.294049] [INFO ] [MAIN ] PG: Generated 1820 derivative records from 54532 primary records. [2025-09-29T02:20:54.314078] [DEBUG] [LOCAL ] PG: Saving derivative data. [2025-09-29T02:20:54.557691] [DEBUG] [LOCAL ] PG: Derivative data saved (1820 records). [2025-09-29T02:20:54.572857] [INFO ] [MAIN ] PG: Successfully saved derivative data. [2025-09-29T02:20:54.576467] [INFO ] [MAIN ] Derivative Progress: 1558/2211 symbols completed. PG took 1.6s. Estimated remaining: 4m 36s. Rate: 142.1 symbols/min [2025-09-29T02:20:54.623948] [DEBUG] [LOCAL ] PGR: Loaded 53757 existing records from primary storage. [2025-09-29T02:20:54.624576] [INFO ] [MAIN ] PGR: Loaded 53757 primary data records. [2025-09-29T02:20:54.771757] [DEBUG] [MAIN ] PGP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:54.788061] [INFO ] [MAIN ] PGP: Generated 1820 derivative records from 5515 primary records. [2025-09-29T02:20:54.813541] [DEBUG] [LOCAL ] PGP: Saving derivative data. [2025-09-29T02:20:54.993315] [DEBUG] [LOCAL ] PGP: Derivative data saved (1820 records). [2025-09-29T02:20:54.993495] [INFO ] [MAIN ] PGP: Successfully saved derivative data. [2025-09-29T02:20:54.996061] [INFO ] [MAIN ] Derivative Progress: 1559/2211 symbols completed. PGP took 0.8s. Estimated remaining: 4m 35s. Rate: 142.1 symbols/min [2025-09-29T02:20:55.018437] [DEBUG] [MAIN ] PGR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:55.019173] [INFO ] [MAIN ] PGR: Generated 1820 derivative records from 53757 primary records. [2025-09-29T02:20:55.019259] [DEBUG] [LOCAL ] PGR: Saving derivative data. [2025-09-29T02:20:55.035574] [DEBUG] [LOCAL ] PGR: Derivative data saved (1820 records). [2025-09-29T02:20:55.035697] [INFO ] [MAIN ] PGR: Successfully saved derivative data. [2025-09-29T02:20:55.038796] [INFO ] [MAIN ] Derivative Progress: 1560/2211 symbols completed. PGR took 0.8s. Estimated remaining: 4m 35s. Rate: 142.2 symbols/min [2025-09-29T02:20:55.039398] [INFO ] [MAIN ] PGRE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:55.039543] [INFO ] [MAIN ] PGZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:55.039478] [INFO ] [MAIN ] PH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:55.051095] [DEBUG] [LOCAL ] PGZ: Loaded 5440 existing records from primary storage. [2025-09-29T02:20:55.051280] [INFO ] [MAIN ] PGZ: Loaded 5440 primary data records. [2025-09-29T02:20:55.432144] [DEBUG] [LOCAL ] PH: Loaded 39166 existing records from primary storage. [2025-09-29T02:20:55.434580] [DEBUG] [LOCAL ] PGRE: Loaded 47177 existing records from primary storage. [2025-09-29T02:20:55.435070] [INFO ] [MAIN ] PH: Loaded 39166 primary data records. [2025-09-29T02:20:55.435011] [INFO ] [MAIN ] PGRE: Loaded 47177 primary data records. [2025-09-29T02:20:56.197768] [DEBUG] [MAIN ] PGZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:56.199492] [INFO ] [MAIN ] PGZ: Generated 1820 derivative records from 5440 primary records. [2025-09-29T02:20:56.200895] [DEBUG] [LOCAL ] PGZ: Saving derivative data. [2025-09-29T02:20:56.223939] [DEBUG] [LOCAL ] PGZ: Derivative data saved (1820 records). [2025-09-29T02:20:56.224361] [INFO ] [MAIN ] PGZ: Successfully saved derivative data. [2025-09-29T02:20:56.227144] [INFO ] [MAIN ] Derivative Progress: 1561/2211 symbols completed. PGZ took 1.2s. Estimated remaining: 4m 35s. Rate: 142.1 symbols/min [2025-09-29T02:20:56.229383] [INFO ] [MAIN ] PHD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:56.254342] [DEBUG] [MAIN ] PGRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:56.258380] [INFO ] [MAIN ] PGRE: Generated 1820 derivative records from 47177 primary records. [2025-09-29T02:20:56.276911] [DEBUG] [LOCAL ] PGRE: Saving derivative data. [2025-09-29T02:20:56.277849] [DEBUG] [MAIN ] PH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:56.278734] [INFO ] [MAIN ] PH: Generated 1820 derivative records from 39166 primary records. [2025-09-29T02:20:56.263779] [DEBUG] [LOCAL ] PHD: Loaded 10098 existing records from primary storage. [2025-09-29T02:20:56.279239] [DEBUG] [LOCAL ] PH: Saving derivative data. [2025-09-29T02:20:56.280252] [INFO ] [MAIN ] PHD: Loaded 10098 primary data records. [2025-09-29T02:20:56.392597] [DEBUG] [LOCAL ] PGRE: Derivative data saved (1820 records). [2025-09-29T02:20:56.413800] [INFO ] [MAIN ] PGRE: Successfully saved derivative data. [2025-09-29T02:20:56.442222] [INFO ] [MAIN ] Derivative Progress: 1562/2211 symbols completed. PGRE took 1.4s. Estimated remaining: 4m 34s. Rate: 142.1 symbols/min [2025-09-29T02:20:56.449894] [DEBUG] [LOCAL ] PH: Derivative data saved (1820 records). [2025-09-29T02:20:56.443078] [INFO ] [MAIN ] PHG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:56.455417] [INFO ] [MAIN ] PH: Successfully saved derivative data. [2025-09-29T02:20:56.497362] [INFO ] [MAIN ] Derivative Progress: 1563/2211 symbols completed. PH took 1.5s. Estimated remaining: 4m 33s. Rate: 142.2 symbols/min [2025-09-29T02:20:56.545956] [INFO ] [MAIN ] PHI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:56.714669] [DEBUG] [LOCAL ] PHI: Loaded 15230 existing records from primary storage. [2025-09-29T02:20:56.715510] [INFO ] [MAIN ] PHI: Loaded 15230 primary data records. [2025-09-29T02:20:56.889131] [DEBUG] [LOCAL ] PHG: Loaded 46835 existing records from primary storage. [2025-09-29T02:20:56.924626] [INFO ] [MAIN ] PHG: Loaded 46835 primary data records. [2025-09-29T02:20:56.948583] [DEBUG] [MAIN ] PHD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:57.037575] [INFO ] [MAIN ] PHD: Generated 1820 derivative records from 10098 primary records. [2025-09-29T02:20:57.206301] [DEBUG] [LOCAL ] PHD: Saving derivative data. [2025-09-29T02:20:57.288475] [DEBUG] [LOCAL ] PHD: Derivative data saved (1820 records). [2025-09-29T02:20:57.288994] [INFO ] [MAIN ] PHD: Successfully saved derivative data. [2025-09-29T02:20:57.303071] [INFO ] [MAIN ] Derivative Progress: 1564/2211 symbols completed. PHD took 1.1s. Estimated remaining: 4m 33s. Rate: 142.1 symbols/min [2025-09-29T02:20:57.313928] [INFO ] [MAIN ] PHIN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:57.550342] [DEBUG] [MAIN ] PHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:57.551371] [INFO ] [MAIN ] PHI: Generated 1820 derivative records from 15230 primary records. [2025-09-29T02:20:57.560958] [DEBUG] [LOCAL ] PHI: Saving derivative data. [2025-09-29T02:20:57.595422] [DEBUG] [LOCAL ] PHI: Derivative data saved (1820 records). [2025-09-29T02:20:57.597672] [DEBUG] [LOCAL ] PHIN: Loaded 33541 existing records from primary storage. [2025-09-29T02:20:57.597946] [INFO ] [MAIN ] PHI: Successfully saved derivative data. [2025-09-29T02:20:57.598584] [INFO ] [MAIN ] PHIN: Loaded 33541 primary data records. [2025-09-29T02:20:57.601990] [INFO ] [MAIN ] Derivative Progress: 1565/2211 symbols completed. PHI took 1.1s. Estimated remaining: 4m 33s. Rate: 142.1 symbols/min [2025-09-29T02:20:57.602697] [INFO ] [MAIN ] PHK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:57.781284] [DEBUG] [MAIN ] PHG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:57.825595] [INFO ] [MAIN ] PHG: Generated 1820 derivative records from 46835 primary records. [2025-09-29T02:20:57.843258] [DEBUG] [LOCAL ] PHK: Loaded 26792 existing records from primary storage. [2025-09-29T02:20:58.017602] [INFO ] [MAIN ] PHK: Loaded 26792 primary data records. [2025-09-29T02:20:57.860883] [DEBUG] [LOCAL ] PHG: Saving derivative data. [2025-09-29T02:20:58.173778] [DEBUG] [LOCAL ] PHG: Derivative data saved (1820 records). [2025-09-29T02:20:58.221778] [INFO ] [MAIN ] PHG: Successfully saved derivative data. [2025-09-29T02:20:58.282040] [INFO ] [MAIN ] Derivative Progress: 1566/2211 symbols completed. PHG took 1.8s. Estimated remaining: 4m 32s. Rate: 142.1 symbols/min [2025-09-29T02:20:58.386101] [INFO ] [MAIN ] PHM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:58.420099] [DEBUG] [MAIN ] PHIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:58.422869] [INFO ] [MAIN ] PHIN: Generated 1820 derivative records from 33541 primary records. [2025-09-29T02:20:58.423191] [DEBUG] [LOCAL ] PHIN: Saving derivative data. [2025-09-29T02:20:58.443112] [DEBUG] [LOCAL ] PHIN: Derivative data saved (1820 records). [2025-09-29T02:20:58.444594] [INFO ] [MAIN ] PHIN: Successfully saved derivative data. [2025-09-29T02:20:58.447816] [INFO ] [MAIN ] Derivative Progress: 1567/2211 symbols completed. PHIN took 1.1s. Estimated remaining: 4m 32s. Rate: 142.1 symbols/min [2025-09-29T02:20:58.448395] [INFO ] [MAIN ] PHR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:58.469967] [DEBUG] [MAIN ] PHK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:58.470915] [INFO ] [MAIN ] PHK: Generated 1820 derivative records from 26792 primary records. [2025-09-29T02:20:58.471181] [DEBUG] [LOCAL ] PHK: Saving derivative data. [2025-09-29T02:20:58.489400] [DEBUG] [LOCAL ] PHK: Derivative data saved (1820 records). [2025-09-29T02:20:58.511600] [INFO ] [MAIN ] PHK: Successfully saved derivative data. [2025-09-29T02:20:58.515288] [INFO ] [MAIN ] Derivative Progress: 1568/2211 symbols completed. PHK took 0.9s. Estimated remaining: 4m 31s. Rate: 142.2 symbols/min [2025-09-29T02:20:58.515770] [INFO ] [MAIN ] PII: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:58.535801] [DEBUG] [LOCAL ] PHR: Loaded 38045 existing records from primary storage. [2025-09-29T02:20:58.554497] [INFO ] [MAIN ] PHR: Loaded 38045 primary data records. [2025-09-29T02:20:58.567729] [DEBUG] [LOCAL ] PHM: Loaded 52386 existing records from primary storage. [2025-09-29T02:20:58.602915] [INFO ] [MAIN ] PHM: Loaded 52386 primary data records. [2025-09-29T02:20:59.132615] [DEBUG] [LOCAL ] PII: Loaded 49815 existing records from primary storage. [2025-09-29T02:20:59.261204] [INFO ] [MAIN ] PII: Loaded 49815 primary data records. [2025-09-29T02:20:59.637884] [DEBUG] [MAIN ] PHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:59.653508] [INFO ] [MAIN ] PHR: Generated 1820 derivative records from 38045 primary records. [2025-09-29T02:20:59.654237] [DEBUG] [MAIN ] PHM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:59.654420] [DEBUG] [LOCAL ] PHR: Saving derivative data. [2025-09-29T02:20:59.655883] [INFO ] [MAIN ] PHM: Generated 1820 derivative records from 52386 primary records. [2025-09-29T02:20:59.657218] [DEBUG] [LOCAL ] PHM: Saving derivative data. [2025-09-29T02:20:59.683821] [DEBUG] [LOCAL ] PHR: Derivative data saved (1820 records). [2025-09-29T02:20:59.693671] [INFO ] [MAIN ] PHR: Successfully saved derivative data. [2025-09-29T02:20:59.697083] [INFO ] [MAIN ] Derivative Progress: 1569/2211 symbols completed. PHR took 1.2s. Estimated remaining: 4m 31s. Rate: 142.0 symbols/min [2025-09-29T02:20:59.693347] [DEBUG] [LOCAL ] PHM: Derivative data saved (1820 records). [2025-09-29T02:20:59.697749] [INFO ] [MAIN ] PIM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:59.698039] [INFO ] [MAIN ] PHM: Successfully saved derivative data. [2025-09-29T02:20:59.701494] [INFO ] [MAIN ] Derivative Progress: 1570/2211 symbols completed. PHM took 1.3s. Estimated remaining: 4m 31s. Rate: 142.1 symbols/min [2025-09-29T02:20:59.702102] [INFO ] [MAIN ] PINE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:20:59.726166] [DEBUG] [LOCAL ] PIM: Loaded 4814 existing records from primary storage. [2025-09-29T02:20:59.730677] [INFO ] [MAIN ] PIM: Loaded 4814 primary data records. [2025-09-29T02:20:59.726472] [DEBUG] [MAIN ] PII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:20:59.737206] [INFO ] [MAIN ] PII: Generated 1820 derivative records from 49815 primary records. [2025-09-29T02:20:59.737398] [DEBUG] [LOCAL ] PII: Saving derivative data. [2025-09-29T02:20:59.827077] [DEBUG] [LOCAL ] PINE: Loaded 14365 existing records from primary storage. [2025-09-29T02:20:59.828002] [INFO ] [MAIN ] PINE: Loaded 14365 primary data records. [2025-09-29T02:20:59.869291] [DEBUG] [LOCAL ] PII: Derivative data saved (1820 records). [2025-09-29T02:20:59.891412] [INFO ] [MAIN ] PII: Successfully saved derivative data. [2025-09-29T02:20:59.938461] [INFO ] [MAIN ] Derivative Progress: 1571/2211 symbols completed. PII took 1.4s. Estimated remaining: 4m 30s. Rate: 142.2 symbols/min [2025-09-29T02:20:59.962224] [INFO ] [MAIN ] PINS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:00.540910] [DEBUG] [LOCAL ] PINS: Loaded 54473 existing records from primary storage. [2025-09-29T02:21:00.556063] [DEBUG] [MAIN ] PIM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:00.555592] [INFO ] [MAIN ] PINS: Loaded 54473 primary data records. [2025-09-29T02:21:00.557310] [INFO ] [MAIN ] PIM: Generated 1820 derivative records from 4814 primary records. [2025-09-29T02:21:00.557945] [DEBUG] [LOCAL ] PIM: Saving derivative data. [2025-09-29T02:21:00.655078] [DEBUG] [LOCAL ] PIM: Derivative data saved (1820 records). [2025-09-29T02:21:00.669179] [INFO ] [MAIN ] PIM: Successfully saved derivative data. [2025-09-29T02:21:00.701660] [INFO ] [MAIN ] Derivative Progress: 1572/2211 symbols completed. PIM took 1.0s. Estimated remaining: 4m 30s. Rate: 142.1 symbols/min [2025-09-29T02:21:00.702817] [INFO ] [MAIN ] PIPR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:00.773959] [DEBUG] [MAIN ] PINE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:00.809519] [INFO ] [MAIN ] PINE: Generated 1820 derivative records from 14365 primary records. [2025-09-29T02:21:00.934380] [DEBUG] [LOCAL ] PINE: Saving derivative data. [2025-09-29T02:21:00.959588] [DEBUG] [LOCAL ] PINE: Derivative data saved (1820 records). [2025-09-29T02:21:00.960316] [INFO ] [MAIN ] PINE: Successfully saved derivative data. [2025-09-29T02:21:00.962988] [INFO ] [MAIN ] Derivative Progress: 1573/2211 symbols completed. PINE took 1.3s. Estimated remaining: 4m 29s. Rate: 142.1 symbols/min [2025-09-29T02:21:00.970406] [DEBUG] [LOCAL ] PIPR: Loaded 15331 existing records from primary storage. [2025-09-29T02:21:00.970994] [INFO ] [MAIN ] PIPR: Loaded 15331 primary data records. [2025-09-29T02:21:01.314804] [DEBUG] [MAIN ] PINS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:01.315776] [INFO ] [MAIN ] PINS: Generated 1820 derivative records from 54473 primary records. [2025-09-29T02:21:01.316685] [DEBUG] [LOCAL ] PINS: Saving derivative data. [2025-09-29T02:21:01.335041] [DEBUG] [LOCAL ] PINS: Derivative data saved (1820 records). [2025-09-29T02:21:01.335809] [INFO ] [MAIN ] PINS: Successfully saved derivative data. [2025-09-29T02:21:01.339463] [INFO ] [MAIN ] Derivative Progress: 1574/2211 symbols completed. PINS took 1.4s. Estimated remaining: 4m 29s. Rate: 142.1 symbols/min [2025-09-29T02:21:01.361667] [DEBUG] [MAIN ] PIPR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:01.362550] [INFO ] [MAIN ] PIPR: Generated 1820 derivative records from 15331 primary records. [2025-09-29T02:21:01.362674] [DEBUG] [LOCAL ] PIPR: Saving derivative data. [2025-09-29T02:21:01.379036] [DEBUG] [LOCAL ] PIPR: Derivative data saved (1820 records). [2025-09-29T02:21:01.379237] [INFO ] [MAIN ] PIPR: Successfully saved derivative data. [2025-09-29T02:21:01.381759] [INFO ] [MAIN ] Derivative Progress: 1575/2211 symbols completed. PIPR took 0.7s. Estimated remaining: 4m 28s. Rate: 142.2 symbols/min [2025-09-29T02:21:01.382372] [INFO ] [MAIN ] PKE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:01.382299] [INFO ] [MAIN ] PJT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:01.382535] [INFO ] [MAIN ] PK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:01.403035] [DEBUG] [LOCAL ] PKE: Loaded 12775 existing records from primary storage. [2025-09-29T02:21:01.403484] [INFO ] [MAIN ] PKE: Loaded 12775 primary data records. [2025-09-29T02:21:01.560768] [DEBUG] [LOCAL ] PJT: Loaded 22579 existing records from primary storage. [2025-09-29T02:21:01.618561] [INFO ] [MAIN ] PJT: Loaded 22579 primary data records. [2025-09-29T02:21:01.805032] [DEBUG] [LOCAL ] PK: Loaded 53626 existing records from primary storage. [2025-09-29T02:21:01.831319] [INFO ] [MAIN ] PK: Loaded 53626 primary data records. [2025-09-29T02:21:02.571868] [DEBUG] [MAIN ] PKE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:02.574485] [INFO ] [MAIN ] PKE: Generated 1820 derivative records from 12775 primary records. [2025-09-29T02:21:02.576284] [DEBUG] [LOCAL ] PKE: Saving derivative data. [2025-09-29T02:21:02.596300] [DEBUG] [LOCAL ] PKE: Derivative data saved (1820 records). [2025-09-29T02:21:02.598442] [INFO ] [MAIN ] PKE: Successfully saved derivative data. [2025-09-29T02:21:02.601890] [INFO ] [MAIN ] Derivative Progress: 1576/2211 symbols completed. PKE took 1.2s. Estimated remaining: 4m 28s. Rate: 142.1 symbols/min [2025-09-29T02:21:02.602835] [INFO ] [MAIN ] PKG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:02.628406] [DEBUG] [MAIN ] PJT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:02.629988] [INFO ] [MAIN ] PJT: Generated 1820 derivative records from 22579 primary records. [2025-09-29T02:21:02.630250] [DEBUG] [LOCAL ] PJT: Saving derivative data. [2025-09-29T02:21:02.645291] [DEBUG] [MAIN ] PK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:02.659639] [INFO ] [MAIN ] PK: Generated 1820 derivative records from 53626 primary records. [2025-09-29T02:21:02.662558] [DEBUG] [LOCAL ] PK: Saving derivative data. [2025-09-29T02:21:02.666295] [DEBUG] [LOCAL ] PJT: Derivative data saved (1820 records). [2025-09-29T02:21:02.678249] [INFO ] [MAIN ] PJT: Successfully saved derivative data. [2025-09-29T02:21:02.682926] [DEBUG] [LOCAL ] PK: Derivative data saved (1820 records). [2025-09-29T02:21:02.685758] [INFO ] [MAIN ] Derivative Progress: 1577/2211 symbols completed. PJT took 1.3s. Estimated remaining: 4m 28s. Rate: 142.1 symbols/min [2025-09-29T02:21:02.695916] [INFO ] [MAIN ] PK: Successfully saved derivative data. [2025-09-29T02:21:02.699234] [INFO ] [MAIN ] Derivative Progress: 1578/2211 symbols completed. PK took 1.3s. Estimated remaining: 4m 27s. Rate: 142.2 symbols/min [2025-09-29T02:21:02.696121] [INFO ] [MAIN ] PKST: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:02.700016] [INFO ] [MAIN ] PKX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:02.722991] [DEBUG] [LOCAL ] PKG: Loaded 39785 existing records from primary storage. [2025-09-29T02:21:02.723257] [INFO ] [MAIN ] PKG: Loaded 39785 primary data records. [2025-09-29T02:21:02.844410] [DEBUG] [LOCAL ] PKST: Loaded 19461 existing records from primary storage. [2025-09-29T02:21:02.873968] [INFO ] [MAIN ] PKST: Loaded 19461 primary data records. [2025-09-29T02:21:02.904221] [DEBUG] [LOCAL ] PKX: Loaded 25141 existing records from primary storage. [2025-09-29T02:21:02.962941] [INFO ] [MAIN ] PKX: Loaded 25141 primary data records. [2025-09-29T02:21:03.887587] [DEBUG] [MAIN ] PKG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:03.895854] [DEBUG] [MAIN ] PKST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:03.895395] [INFO ] [MAIN ] PKG: Generated 1820 derivative records from 39785 primary records. [2025-09-29T02:21:03.897169] [DEBUG] [LOCAL ] PKG: Saving derivative data. [2025-09-29T02:21:03.897004] [INFO ] [MAIN ] PKST: Generated 1820 derivative records from 19461 primary records. [2025-09-29T02:21:03.899459] [DEBUG] [LOCAL ] PKST: Saving derivative data. [2025-09-29T02:21:03.945880] [DEBUG] [LOCAL ] PKG: Derivative data saved (1820 records). [2025-09-29T02:21:03.949966] [DEBUG] [LOCAL ] PKST: Derivative data saved (1820 records). [2025-09-29T02:21:03.947120] [DEBUG] [MAIN ] PKX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:03.949071] [INFO ] [MAIN ] PKG: Successfully saved derivative data. [2025-09-29T02:21:03.954995] [INFO ] [MAIN ] Derivative Progress: 1579/2211 symbols completed. PKG took 1.4s. Estimated remaining: 4m 27s. Rate: 142.0 symbols/min [2025-09-29T02:21:03.956797] [INFO ] [MAIN ] PKST: Successfully saved derivative data. [2025-09-29T02:21:03.956463] [INFO ] [MAIN ] PKX: Generated 1820 derivative records from 25141 primary records. [2025-09-29T02:21:03.964750] [INFO ] [MAIN ] PL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:03.965376] [DEBUG] [LOCAL ] PKX: Saving derivative data. [2025-09-29T02:21:03.964890] [INFO ] [MAIN ] Derivative Progress: 1580/2211 symbols completed. PKST took 1.3s. Estimated remaining: 4m 26s. Rate: 142.1 symbols/min [2025-09-29T02:21:03.967714] [INFO ] [MAIN ] PLD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:03.989462] [DEBUG] [LOCAL ] PKX: Derivative data saved (1820 records). [2025-09-29T02:21:03.989846] [INFO ] [MAIN ] PKX: Successfully saved derivative data. [2025-09-29T02:21:03.994352] [INFO ] [MAIN ] Derivative Progress: 1581/2211 symbols completed. PKX took 1.3s. Estimated remaining: 4m 26s. Rate: 142.2 symbols/min [2025-09-29T02:21:03.994789] [INFO ] [MAIN ] PLNT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:04.086619] [DEBUG] [LOCAL ] PL: Loaded 53894 existing records from primary storage. [2025-09-29T02:21:04.088933] [INFO ] [MAIN ] PL: Loaded 53894 primary data records. [2025-09-29T02:21:04.160597] [DEBUG] [LOCAL ] PLNT: Loaded 49144 existing records from primary storage. [2025-09-29T02:21:04.190911] [INFO ] [MAIN ] PLNT: Loaded 49144 primary data records. [2025-09-29T02:21:04.404679] [DEBUG] [LOCAL ] PLD: Loaded 54226 existing records from primary storage. [2025-09-29T02:21:04.465633] [INFO ] [MAIN ] PLD: Loaded 54226 primary data records. [2025-09-29T02:21:05.275789] [DEBUG] [MAIN ] PL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:05.278852] [INFO ] [MAIN ] PL: Generated 1820 derivative records from 53894 primary records. [2025-09-29T02:21:05.279427] [DEBUG] [LOCAL ] PL: Saving derivative data. [2025-09-29T02:21:05.304782] [DEBUG] [LOCAL ] PL: Derivative data saved (1820 records). [2025-09-29T02:21:05.305005] [INFO ] [MAIN ] PL: Successfully saved derivative data. [2025-09-29T02:21:05.309757] [INFO ] [MAIN ] Derivative Progress: 1582/2211 symbols completed. PL took 1.3s. Estimated remaining: 4m 26s. Rate: 142.0 symbols/min [2025-09-29T02:21:05.311974] [INFO ] [MAIN ] PLOW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:05.335006] [DEBUG] [MAIN ] PLNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:05.342356] [INFO ] [MAIN ] PLNT: Generated 1820 derivative records from 49144 primary records. [2025-09-29T02:21:05.341263] [DEBUG] [MAIN ] PLD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:05.342601] [DEBUG] [LOCAL ] PLNT: Saving derivative data. [2025-09-29T02:21:05.343881] [INFO ] [MAIN ] PLD: Generated 1820 derivative records from 54226 primary records. [2025-09-29T02:21:05.344586] [DEBUG] [LOCAL ] PLD: Saving derivative data. [2025-09-29T02:21:05.370388] [DEBUG] [LOCAL ] PLNT: Derivative data saved (1820 records). [2025-09-29T02:21:05.374928] [INFO ] [MAIN ] PLNT: Successfully saved derivative data. [2025-09-29T02:21:05.377830] [DEBUG] [LOCAL ] PLD: Derivative data saved (1820 records). [2025-09-29T02:21:05.387639] [INFO ] [MAIN ] PLD: Successfully saved derivative data. [2025-09-29T02:21:05.387473] [INFO ] [MAIN ] Derivative Progress: 1583/2211 symbols completed. PLNT took 1.4s. Estimated remaining: 4m 25s. Rate: 142.1 symbols/min [2025-09-29T02:21:05.391775] [INFO ] [MAIN ] Derivative Progress: 1584/2211 symbols completed. PLD took 1.4s. Estimated remaining: 4m 25s. Rate: 142.2 symbols/min [2025-09-29T02:21:05.391597] [INFO ] [MAIN ] PLYM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:05.392785] [INFO ] [MAIN ] PM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:05.406078] [DEBUG] [LOCAL ] PLOW: Loaded 20792 existing records from primary storage. [2025-09-29T02:21:05.406230] [INFO ] [MAIN ] PLOW: Loaded 20792 primary data records. [2025-09-29T02:21:05.800068] [DEBUG] [LOCAL ] PLYM: Loaded 33884 existing records from primary storage. [2025-09-29T02:21:05.802227] [INFO ] [MAIN ] PLYM: Loaded 33884 primary data records. [2025-09-29T02:21:05.874042] [DEBUG] [LOCAL ] PM: Loaded 54445 existing records from primary storage. [2025-09-29T02:21:05.904845] [INFO ] [MAIN ] PM: Loaded 54445 primary data records. [2025-09-29T02:21:06.553487] [DEBUG] [MAIN ] PLOW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:06.555466] [INFO ] [MAIN ] PLOW: Generated 1820 derivative records from 20792 primary records. [2025-09-29T02:21:06.555921] [DEBUG] [LOCAL ] PLOW: Saving derivative data. [2025-09-29T02:21:06.576448] [DEBUG] [LOCAL ] PLOW: Derivative data saved (1820 records). [2025-09-29T02:21:06.577347] [INFO ] [MAIN ] PLOW: Successfully saved derivative data. [2025-09-29T02:21:06.579837] [INFO ] [MAIN ] Derivative Progress: 1585/2211 symbols completed. PLOW took 1.3s. Estimated remaining: 4m 24s. Rate: 142.0 symbols/min [2025-09-29T02:21:06.581409] [INFO ] [MAIN ] PML: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:06.600567] [DEBUG] [MAIN ] PLYM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:06.601487] [INFO ] [MAIN ] PLYM: Generated 1820 derivative records from 33884 primary records. [2025-09-29T02:21:06.601639] [DEBUG] [LOCAL ] PLYM: Saving derivative data. [2025-09-29T02:21:06.621273] [DEBUG] [LOCAL ] PLYM: Derivative data saved (1820 records). [2025-09-29T02:21:06.628486] [INFO ] [MAIN ] PLYM: Successfully saved derivative data. [2025-09-29T02:21:06.639882] [INFO ] [MAIN ] Derivative Progress: 1586/2211 symbols completed. PLYM took 1.2s. Estimated remaining: 4m 24s. Rate: 142.1 symbols/min [2025-09-29T02:21:06.646184] [DEBUG] [MAIN ] PM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:06.646334] [INFO ] [MAIN ] PMM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:06.647435] [INFO ] [MAIN ] PM: Generated 1820 derivative records from 54445 primary records. [2025-09-29T02:21:06.647884] [DEBUG] [LOCAL ] PM: Saving derivative data. [2025-09-29T02:21:06.657097] [DEBUG] [LOCAL ] PML: Loaded 20999 existing records from primary storage. [2025-09-29T02:21:06.669706] [INFO ] [MAIN ] PML: Loaded 20999 primary data records. [2025-09-29T02:21:06.735984] [DEBUG] [LOCAL ] PM: Derivative data saved (1820 records). [2025-09-29T02:21:06.765766] [INFO ] [MAIN ] PM: Successfully saved derivative data. [2025-09-29T02:21:06.801631] [DEBUG] [LOCAL ] PMM: Loaded 10760 existing records from primary storage. [2025-09-29T02:21:06.805524] [INFO ] [MAIN ] Derivative Progress: 1587/2211 symbols completed. PM took 1.4s. Estimated remaining: 4m 23s. Rate: 142.1 symbols/min [2025-09-29T02:21:06.801941] [INFO ] [MAIN ] PMM: Loaded 10760 primary data records. [2025-09-29T02:21:06.821918] [INFO ] [MAIN ] PMO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:07.228940] [DEBUG] [LOCAL ] PMO: Loaded 10547 existing records from primary storage. [2025-09-29T02:21:07.286407] [INFO ] [MAIN ] PMO: Loaded 10547 primary data records. [2025-09-29T02:21:07.787580] [DEBUG] [MAIN ] PML: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:07.789775] [INFO ] [MAIN ] PML: Generated 1820 derivative records from 20999 primary records. [2025-09-29T02:21:07.790300] [DEBUG] [LOCAL ] PML: Saving derivative data. [2025-09-29T02:21:07.830976] [DEBUG] [MAIN ] PMM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:07.833283] [DEBUG] [LOCAL ] PML: Derivative data saved (1820 records). [2025-09-29T02:21:07.834475] [INFO ] [MAIN ] PMM: Generated 1820 derivative records from 10760 primary records. [2025-09-29T02:21:07.834857] [INFO ] [MAIN ] PML: Successfully saved derivative data. [2025-09-29T02:21:07.834790] [DEBUG] [LOCAL ] PMM: Saving derivative data. [2025-09-29T02:21:07.837815] [INFO ] [MAIN ] Derivative Progress: 1588/2211 symbols completed. PML took 1.3s. Estimated remaining: 4m 23s. Rate: 142.0 symbols/min [2025-09-29T02:21:07.857435] [DEBUG] [LOCAL ] PMM: Derivative data saved (1820 records). [2025-09-29T02:21:07.857678] [INFO ] [MAIN ] PMM: Successfully saved derivative data. [2025-09-29T02:21:07.860741] [INFO ] [MAIN ] Derivative Progress: 1589/2211 symbols completed. PMM took 1.2s. Estimated remaining: 4m 23s. Rate: 142.1 symbols/min [2025-09-29T02:21:07.874361] [DEBUG] [MAIN ] PMO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:07.875236] [INFO ] [MAIN ] PMO: Generated 1820 derivative records from 10547 primary records. [2025-09-29T02:21:07.875327] [DEBUG] [LOCAL ] PMO: Saving derivative data. [2025-09-29T02:21:07.890508] [DEBUG] [LOCAL ] PMO: Derivative data saved (1820 records). [2025-09-29T02:21:07.890629] [INFO ] [MAIN ] PMO: Successfully saved derivative data. [2025-09-29T02:21:07.893799] [INFO ] [MAIN ] Derivative Progress: 1590/2211 symbols completed. PMO took 1.1s. Estimated remaining: 4m 22s. Rate: 142.2 symbols/min [2025-09-29T02:21:07.894434] [INFO ] [MAIN ] PMT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:07.894708] [INFO ] [MAIN ] PNI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:07.894844] [INFO ] [MAIN ] PNC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:07.910528] [DEBUG] [LOCAL ] PNI: Loaded 6782 existing records from primary storage. [2025-09-29T02:21:07.910775] [INFO ] [MAIN ] PNI: Loaded 6782 primary data records. [2025-09-29T02:21:08.313400] [DEBUG] [LOCAL ] PMT: Loaded 40798 existing records from primary storage. [2025-09-29T02:21:08.328944] [INFO ] [MAIN ] PMT: Loaded 40798 primary data records. [2025-09-29T02:21:08.361428] [DEBUG] [LOCAL ] PNC: Loaded 53000 existing records from primary storage. [2025-09-29T02:21:08.412342] [INFO ] [MAIN ] PNC: Loaded 53000 primary data records. [2025-09-29T02:21:09.111563] [DEBUG] [MAIN ] PNI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:09.112668] [INFO ] [MAIN ] PNI: Generated 1820 derivative records from 6782 primary records. [2025-09-29T02:21:09.113026] [DEBUG] [LOCAL ] PNI: Saving derivative data. [2025-09-29T02:21:09.131745] [DEBUG] [LOCAL ] PNI: Derivative data saved (1820 records). [2025-09-29T02:21:09.132717] [INFO ] [MAIN ] PNI: Successfully saved derivative data. [2025-09-29T02:21:09.136021] [INFO ] [MAIN ] Derivative Progress: 1591/2211 symbols completed. PNI took 1.2s. Estimated remaining: 4m 22s. Rate: 142.0 symbols/min [2025-09-29T02:21:09.136217] [INFO ] [MAIN ] PNNT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:09.156112] [DEBUG] [MAIN ] PMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:09.157450] [INFO ] [MAIN ] PMT: Generated 1820 derivative records from 40798 primary records. [2025-09-29T02:21:09.157852] [DEBUG] [LOCAL ] PMT: Saving derivative data. [2025-09-29T02:21:09.176795] [DEBUG] [LOCAL ] PMT: Derivative data saved (1820 records). [2025-09-29T02:21:09.177555] [INFO ] [MAIN ] PMT: Successfully saved derivative data. [2025-09-29T02:21:09.180357] [INFO ] [MAIN ] Derivative Progress: 1592/2211 symbols completed. PMT took 1.3s. Estimated remaining: 4m 21s. Rate: 142.1 symbols/min [2025-09-29T02:21:09.181090] [INFO ] [MAIN ] PNR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:09.209596] [DEBUG] [MAIN ] PNC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:09.210753] [INFO ] [MAIN ] PNC: Generated 1820 derivative records from 53000 primary records. [2025-09-29T02:21:09.221119] [DEBUG] [LOCAL ] PNC: Saving derivative data. [2025-09-29T02:21:09.223619] [DEBUG] [LOCAL ] PNNT: Loaded 33337 existing records from primary storage. [2025-09-29T02:21:09.224361] [INFO ] [MAIN ] PNNT: Loaded 33337 primary data records. [2025-09-29T02:21:09.368316] [DEBUG] [LOCAL ] PNC: Derivative data saved (1820 records). [2025-09-29T02:21:09.412483] [INFO ] [MAIN ] PNC: Successfully saved derivative data. [2025-09-29T02:21:09.475057] [INFO ] [MAIN ] Derivative Progress: 1593/2211 symbols completed. PNC took 1.6s. Estimated remaining: 4m 21s. Rate: 142.1 symbols/min [2025-09-29T02:21:09.602169] [INFO ] [MAIN ] PNW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:09.605321] [DEBUG] [LOCAL ] PNR: Loaded 48589 existing records from primary storage. [2025-09-29T02:21:09.605639] [INFO ] [MAIN ] PNR: Loaded 48589 primary data records. [2025-09-29T02:21:09.987576] [DEBUG] [LOCAL ] PNW: Loaded 46531 existing records from primary storage. [2025-09-29T02:21:09.988129] [INFO ] [MAIN ] PNW: Loaded 46531 primary data records. [2025-09-29T02:21:10.027191] [DEBUG] [MAIN ] PNNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:10.078280] [INFO ] [MAIN ] PNNT: Generated 1820 derivative records from 33337 primary records. [2025-09-29T02:21:10.101826] [DEBUG] [LOCAL ] PNNT: Saving derivative data. [2025-09-29T02:21:10.349045] [DEBUG] [LOCAL ] PNNT: Derivative data saved (1820 records). [2025-09-29T02:21:10.349952] [INFO ] [MAIN ] PNNT: Successfully saved derivative data. [2025-09-29T02:21:10.353289] [INFO ] [MAIN ] Derivative Progress: 1594/2211 symbols completed. PNNT took 1.2s. Estimated remaining: 4m 21s. Rate: 142.0 symbols/min [2025-09-29T02:21:10.353898] [INFO ] [MAIN ] POR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:10.384767] [DEBUG] [MAIN ] PNR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:10.385974] [INFO ] [MAIN ] PNR: Generated 1820 derivative records from 48589 primary records. [2025-09-29T02:21:10.386105] [DEBUG] [LOCAL ] PNR: Saving derivative data. [2025-09-29T02:21:10.406521] [DEBUG] [LOCAL ] PNR: Derivative data saved (1820 records). [2025-09-29T02:21:10.406935] [INFO ] [MAIN ] PNR: Successfully saved derivative data. [2025-09-29T02:21:10.410171] [INFO ] [MAIN ] Derivative Progress: 1595/2211 symbols completed. PNR took 1.2s. Estimated remaining: 4m 20s. Rate: 142.1 symbols/min [2025-09-29T02:21:10.410777] [INFO ] [MAIN ] POST: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:10.429208] [DEBUG] [MAIN ] PNW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:10.430050] [INFO ] [MAIN ] PNW: Generated 1820 derivative records from 46531 primary records. [2025-09-29T02:21:10.430380] [DEBUG] [LOCAL ] PNW: Saving derivative data. [2025-09-29T02:21:10.458915] [DEBUG] [LOCAL ] PNW: Derivative data saved (1820 records). [2025-09-29T02:21:10.476551] [INFO ] [MAIN ] PNW: Successfully saved derivative data. [2025-09-29T02:21:10.480915] [INFO ] [MAIN ] Derivative Progress: 1596/2211 symbols completed. PNW took 0.9s. Estimated remaining: 4m 20s. Rate: 142.2 symbols/min [2025-09-29T02:21:10.492337] [INFO ] [MAIN ] PPG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:10.495423] [DEBUG] [LOCAL ] POR: Loaded 47706 existing records from primary storage. [2025-09-29T02:21:10.495915] [INFO ] [MAIN ] POR: Loaded 47706 primary data records. [2025-09-29T02:21:10.602317] [DEBUG] [LOCAL ] POST: Loaded 39494 existing records from primary storage. [2025-09-29T02:21:10.644871] [INFO ] [MAIN ] POST: Loaded 39494 primary data records. [2025-09-29T02:21:11.060236] [DEBUG] [LOCAL ] PPG: Loaded 51455 existing records from primary storage. [2025-09-29T02:21:11.091431] [INFO ] [MAIN ] PPG: Loaded 51455 primary data records. [2025-09-29T02:21:11.751289] [DEBUG] [MAIN ] POR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:11.754161] [INFO ] [MAIN ] POR: Generated 1820 derivative records from 47706 primary records. [2025-09-29T02:21:11.755110] [DEBUG] [LOCAL ] POR: Saving derivative data. [2025-09-29T02:21:11.788625] [DEBUG] [MAIN ] POST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:11.793135] [INFO ] [MAIN ] POST: Generated 1820 derivative records from 39494 primary records. [2025-09-29T02:21:11.793965] [DEBUG] [LOCAL ] POST: Saving derivative data. [2025-09-29T02:21:11.796856] [DEBUG] [LOCAL ] POR: Derivative data saved (1820 records). [2025-09-29T02:21:11.797140] [INFO ] [MAIN ] POR: Successfully saved derivative data. [2025-09-29T02:21:11.808470] [INFO ] [MAIN ] Derivative Progress: 1597/2211 symbols completed. POR took 1.5s. Estimated remaining: 4m 19s. Rate: 142.0 symbols/min [2025-09-29T02:21:11.815059] [INFO ] [MAIN ] PPL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:11.819852] [DEBUG] [LOCAL ] POST: Derivative data saved (1820 records). [2025-09-29T02:21:11.820206] [INFO ] [MAIN ] POST: Successfully saved derivative data. [2025-09-29T02:21:11.823214] [INFO ] [MAIN ] Derivative Progress: 1598/2211 symbols completed. POST took 1.4s. Estimated remaining: 4m 19s. Rate: 142.1 symbols/min [2025-09-29T02:21:11.823731] [INFO ] [MAIN ] PPT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:11.843945] [DEBUG] [MAIN ] PPG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:11.844963] [INFO ] [MAIN ] PPG: Generated 1820 derivative records from 51455 primary records. [2025-09-29T02:21:11.845221] [DEBUG] [LOCAL ] PPG: Saving derivative data. [2025-09-29T02:21:11.865577] [DEBUG] [LOCAL ] PPG: Derivative data saved (1820 records). [2025-09-29T02:21:11.871146] [INFO ] [MAIN ] PPG: Successfully saved derivative data. [2025-09-29T02:21:11.874148] [INFO ] [MAIN ] Derivative Progress: 1599/2211 symbols completed. PPG took 1.4s. Estimated remaining: 4m 18s. Rate: 142.1 symbols/min [2025-09-29T02:21:11.874534] [INFO ] [MAIN ] PR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:11.885456] [DEBUG] [LOCAL ] PPT: Loaded 20342 existing records from primary storage. [2025-09-29T02:21:11.885949] [INFO ] [MAIN ] PPT: Loaded 20342 primary data records. [2025-09-29T02:21:12.146730] [DEBUG] [LOCAL ] PPL: Loaded 54285 existing records from primary storage. [2025-09-29T02:21:12.298711] [INFO ] [MAIN ] PPL: Loaded 54285 primary data records. [2025-09-29T02:21:12.445423] [DEBUG] [LOCAL ] PR: Loaded 54389 existing records from primary storage. [2025-09-29T02:21:12.446482] [INFO ] [MAIN ] PR: Loaded 54389 primary data records. [2025-09-29T02:21:13.029247] [DEBUG] [MAIN ] PPT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:13.046171] [INFO ] [MAIN ] PPT: Generated 1820 derivative records from 20342 primary records. [2025-09-29T02:21:13.047566] [DEBUG] [LOCAL ] PPT: Saving derivative data. [2025-09-29T02:21:13.070617] [DEBUG] [LOCAL ] PPT: Derivative data saved (1820 records). [2025-09-29T02:21:13.071485] [INFO ] [MAIN ] PPT: Successfully saved derivative data. [2025-09-29T02:21:13.074252] [INFO ] [MAIN ] Derivative Progress: 1600/2211 symbols completed. PPT took 1.3s. Estimated remaining: 4m 18s. Rate: 142.0 symbols/min [2025-09-29T02:21:13.075041] [INFO ] [MAIN ] PRA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:13.096562] [DEBUG] [MAIN ] PPL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:13.097987] [INFO ] [MAIN ] PPL: Generated 1820 derivative records from 54285 primary records. [2025-09-29T02:21:13.098804] [DEBUG] [LOCAL ] PPL: Saving derivative data. [2025-09-29T02:21:13.123360] [DEBUG] [LOCAL ] PPL: Derivative data saved (1820 records). [2025-09-29T02:21:13.124038] [INFO ] [MAIN ] PPL: Successfully saved derivative data. [2025-09-29T02:21:13.130368] [INFO ] [MAIN ] Derivative Progress: 1601/2211 symbols completed. PPL took 1.3s. Estimated remaining: 4m 18s. Rate: 142.1 symbols/min [2025-09-29T02:21:13.131023] [INFO ] [MAIN ] PRG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:13.161201] [DEBUG] [MAIN ] PR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:13.162190] [INFO ] [MAIN ] PR: Generated 1820 derivative records from 54389 primary records. [2025-09-29T02:21:13.162353] [DEBUG] [LOCAL ] PR: Saving derivative data. [2025-09-29T02:21:13.181856] [DEBUG] [LOCAL ] PR: Derivative data saved (1820 records). [2025-09-29T02:21:13.194707] [INFO ] [MAIN ] PR: Successfully saved derivative data. [2025-09-29T02:21:13.198687] [INFO ] [MAIN ] Derivative Progress: 1602/2211 symbols completed. PR took 1.3s. Estimated remaining: 4m 17s. Rate: 142.1 symbols/min [2025-09-29T02:21:13.199043] [INFO ] [MAIN ] PRGO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:13.200158] [DEBUG] [LOCAL ] PRA: Loaded 35243 existing records from primary storage. [2025-09-29T02:21:13.200957] [INFO ] [MAIN ] PRA: Loaded 35243 primary data records. [2025-09-29T02:21:13.345063] [DEBUG] [LOCAL ] PRG: Loaded 30420 existing records from primary storage. [2025-09-29T02:21:13.365992] [INFO ] [MAIN ] PRG: Loaded 30420 primary data records. [2025-09-29T02:21:13.815067] [DEBUG] [LOCAL ] PRGO: Loaded 47634 existing records from primary storage. [2025-09-29T02:21:13.855708] [INFO ] [MAIN ] PRGO: Loaded 47634 primary data records. [2025-09-29T02:21:14.380286] [DEBUG] [MAIN ] PRA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:14.381332] [INFO ] [MAIN ] PRA: Generated 1820 derivative records from 35243 primary records. [2025-09-29T02:21:14.382185] [DEBUG] [LOCAL ] PRA: Saving derivative data. [2025-09-29T02:21:14.406472] [DEBUG] [LOCAL ] PRA: Derivative data saved (1820 records). [2025-09-29T02:21:14.406969] [INFO ] [MAIN ] PRA: Successfully saved derivative data. [2025-09-29T02:21:14.410024] [INFO ] [MAIN ] Derivative Progress: 1603/2211 symbols completed. PRA took 1.3s. Estimated remaining: 4m 17s. Rate: 142.0 symbols/min [2025-09-29T02:21:14.425830] [DEBUG] [MAIN ] PRG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:14.428136] [INFO ] [MAIN ] PRG: Generated 1820 derivative records from 30420 primary records. [2025-09-29T02:21:14.428614] [DEBUG] [LOCAL ] PRG: Saving derivative data. [2025-09-29T02:21:14.447781] [DEBUG] [LOCAL ] PRG: Derivative data saved (1820 records). [2025-09-29T02:21:14.448050] [INFO ] [MAIN ] PRG: Successfully saved derivative data. [2025-09-29T02:21:14.451964] [INFO ] [MAIN ] Derivative Progress: 1604/2211 symbols completed. PRG took 1.3s. Estimated remaining: 4m 16s. Rate: 142.0 symbols/min [2025-09-29T02:21:14.467607] [DEBUG] [MAIN ] PRGO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:14.468367] [INFO ] [MAIN ] PRGO: Generated 1820 derivative records from 47634 primary records. [2025-09-29T02:21:14.468457] [DEBUG] [LOCAL ] PRGO: Saving derivative data. [2025-09-29T02:21:14.484886] [DEBUG] [LOCAL ] PRGO: Derivative data saved (1820 records). [2025-09-29T02:21:14.485037] [INFO ] [MAIN ] PRGO: Successfully saved derivative data. [2025-09-29T02:21:14.488721] [INFO ] [MAIN ] Derivative Progress: 1605/2211 symbols completed. PRGO took 1.3s. Estimated remaining: 4m 16s. Rate: 142.1 symbols/min [2025-09-29T02:21:14.489522] [INFO ] [MAIN ] PRH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:14.489630] [INFO ] [MAIN ] PRIM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:14.489788] [INFO ] [MAIN ] PRI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:14.504414] [DEBUG] [LOCAL ] PRH: Loaded 4908 existing records from primary storage. [2025-09-29T02:21:14.504808] [INFO ] [MAIN ] PRH: Loaded 4908 primary data records. [2025-09-29T02:21:14.614764] [DEBUG] [LOCAL ] PRI: Loaded 18636 existing records from primary storage. [2025-09-29T02:21:14.656447] [INFO ] [MAIN ] PRI: Loaded 18636 primary data records. [2025-09-29T02:21:14.865331] [DEBUG] [LOCAL ] PRIM: Loaded 45072 existing records from primary storage. [2025-09-29T02:21:14.920387] [INFO ] [MAIN ] PRIM: Loaded 45072 primary data records. [2025-09-29T02:21:15.710168] [DEBUG] [MAIN ] PRH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:15.714156] [INFO ] [MAIN ] PRH: Generated 1820 derivative records from 4908 primary records. [2025-09-29T02:21:15.714579] [DEBUG] [LOCAL ] PRH: Saving derivative data. [2025-09-29T02:21:15.730363] [DEBUG] [MAIN ] PRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:15.738707] [INFO ] [MAIN ] PRI: Generated 1820 derivative records from 18636 primary records. [2025-09-29T02:21:15.747847] [DEBUG] [LOCAL ] PRH: Derivative data saved (1820 records). [2025-09-29T02:21:15.748046] [INFO ] [MAIN ] PRH: Successfully saved derivative data. [2025-09-29T02:21:15.747020] [DEBUG] [LOCAL ] PRI: Saving derivative data. [2025-09-29T02:21:15.751789] [INFO ] [MAIN ] Derivative Progress: 1606/2211 symbols completed. PRH took 1.3s. Estimated remaining: 4m 16s. Rate: 142.0 symbols/min [2025-09-29T02:21:15.752517] [INFO ] [MAIN ] PRKS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:15.776947] [DEBUG] [LOCAL ] PRI: Derivative data saved (1820 records). [2025-09-29T02:21:15.777473] [INFO ] [MAIN ] PRI: Successfully saved derivative data. [2025-09-29T02:21:15.780408] [INFO ] [MAIN ] Derivative Progress: 1607/2211 symbols completed. PRI took 1.3s. Estimated remaining: 4m 15s. Rate: 142.0 symbols/min [2025-09-29T02:21:15.780673] [INFO ] [MAIN ] PRLB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:15.796533] [DEBUG] [MAIN ] PRIM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:15.797484] [INFO ] [MAIN ] PRIM: Generated 1820 derivative records from 45072 primary records. [2025-09-29T02:21:15.797675] [DEBUG] [LOCAL ] PRIM: Saving derivative data. [2025-09-29T02:21:15.822591] [DEBUG] [LOCAL ] PRIM: Derivative data saved (1820 records). [2025-09-29T02:21:15.822912] [INFO ] [MAIN ] PRIM: Successfully saved derivative data. [2025-09-29T02:21:15.826330] [INFO ] [MAIN ] Derivative Progress: 1608/2211 symbols completed. PRIM took 1.3s. Estimated remaining: 4m 15s. Rate: 142.1 symbols/min [2025-09-29T02:21:15.826806] [INFO ] [MAIN ] PRM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:15.847374] [DEBUG] [LOCAL ] PRLB: Loaded 20919 existing records from primary storage. [2025-09-29T02:21:15.847610] [INFO ] [MAIN ] PRLB: Loaded 20919 primary data records. [2025-09-29T02:21:15.954332] [DEBUG] [LOCAL ] PRKS: Loaded 43308 existing records from primary storage. [2025-09-29T02:21:15.975020] [INFO ] [MAIN ] PRKS: Loaded 43308 primary data records. [2025-09-29T02:21:16.231634] [DEBUG] [LOCAL ] PRM: Loaded 45298 existing records from primary storage. [2025-09-29T02:21:16.403875] [INFO ] [MAIN ] PRM: Loaded 45298 primary data records. [2025-09-29T02:21:17.017116] [DEBUG] [MAIN ] PRLB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:17.018873] [INFO ] [MAIN ] PRLB: Generated 1820 derivative records from 20919 primary records. [2025-09-29T02:21:17.019976] [DEBUG] [LOCAL ] PRLB: Saving derivative data. [2025-09-29T02:21:17.055848] [DEBUG] [LOCAL ] PRLB: Derivative data saved (1820 records). [2025-09-29T02:21:17.057301] [INFO ] [MAIN ] PRLB: Successfully saved derivative data. [2025-09-29T02:21:17.056208] [DEBUG] [MAIN ] PRKS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:17.061011] [INFO ] [MAIN ] Derivative Progress: 1609/2211 symbols completed. PRLB took 1.3s. Estimated remaining: 4m 14s. Rate: 141.9 symbols/min [2025-09-29T02:21:17.062472] [INFO ] [MAIN ] PRMB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:17.062093] [INFO ] [MAIN ] PRKS: Generated 1820 derivative records from 43308 primary records. [2025-09-29T02:21:17.063195] [DEBUG] [LOCAL ] PRKS: Saving derivative data. [2025-09-29T02:21:17.082497] [DEBUG] [LOCAL ] PRKS: Derivative data saved (1820 records). [2025-09-29T02:21:17.084596] [INFO ] [MAIN ] PRKS: Successfully saved derivative data. [2025-09-29T02:21:17.088637] [INFO ] [MAIN ] Derivative Progress: 1610/2211 symbols completed. PRKS took 1.3s. Estimated remaining: 4m 14s. Rate: 142.0 symbols/min [2025-09-29T02:21:17.088949] [INFO ] [MAIN ] PRO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:17.103343] [DEBUG] [MAIN ] PRM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:17.104185] [INFO ] [MAIN ] PRM: Generated 1820 derivative records from 45298 primary records. [2025-09-29T02:21:17.104315] [DEBUG] [LOCAL ] PRM: Saving derivative data. [2025-09-29T02:21:17.121669] [DEBUG] [LOCAL ] PRM: Derivative data saved (1820 records). [2025-09-29T02:21:17.121802] [INFO ] [MAIN ] PRM: Successfully saved derivative data. [2025-09-29T02:21:17.124707] [INFO ] [MAIN ] Derivative Progress: 1611/2211 symbols completed. PRM took 1.3s. Estimated remaining: 4m 13s. Rate: 142.1 symbols/min [2025-09-29T02:21:17.125041] [INFO ] [MAIN ] PRT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:17.149513] [DEBUG] [LOCAL ] PRT: Loaded 5402 existing records from primary storage. [2025-09-29T02:21:17.150547] [INFO ] [MAIN ] PRT: Loaded 5402 primary data records. [2025-09-29T02:21:17.320881] [DEBUG] [LOCAL ] PRMB: Loaded 53928 existing records from primary storage. [2025-09-29T02:21:17.337393] [DEBUG] [LOCAL ] PRO: Loaded 38444 existing records from primary storage. [2025-09-29T02:21:17.337627] [INFO ] [MAIN ] PRMB: Loaded 53928 primary data records. [2025-09-29T02:21:17.364619] [INFO ] [MAIN ] PRO: Loaded 38444 primary data records. [2025-09-29T02:21:18.311032] [DEBUG] [MAIN ] PRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:18.312489] [INFO ] [MAIN ] PRT: Generated 1820 derivative records from 5402 primary records. [2025-09-29T02:21:18.313026] [DEBUG] [LOCAL ] PRT: Saving derivative data. [2025-09-29T02:21:18.335867] [DEBUG] [LOCAL ] PRT: Derivative data saved (1820 records). [2025-09-29T02:21:18.336692] [INFO ] [MAIN ] PRT: Successfully saved derivative data. [2025-09-29T02:21:18.339360] [INFO ] [MAIN ] Derivative Progress: 1612/2211 symbols completed. PRT took 1.2s. Estimated remaining: 4m 13s. Rate: 141.9 symbols/min [2025-09-29T02:21:18.357619] [DEBUG] [MAIN ] PRMB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:18.370441] [INFO ] [MAIN ] PRU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:18.372328] [DEBUG] [MAIN ] PRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:18.371910] [INFO ] [MAIN ] PRMB: Generated 1820 derivative records from 53928 primary records. [2025-09-29T02:21:18.373501] [INFO ] [MAIN ] PRO: Generated 1820 derivative records from 38444 primary records. [2025-09-29T02:21:18.373739] [DEBUG] [LOCAL ] PRMB: Saving derivative data. [2025-09-29T02:21:18.374611] [DEBUG] [LOCAL ] PRO: Saving derivative data. [2025-09-29T02:21:18.403296] [DEBUG] [LOCAL ] PRO: Derivative data saved (1820 records). [2025-09-29T02:21:18.404292] [INFO ] [MAIN ] PRO: Successfully saved derivative data. [2025-09-29T02:21:18.408340] [INFO ] [MAIN ] Derivative Progress: 1613/2211 symbols completed. PRO took 1.3s. Estimated remaining: 4m 13s. Rate: 142.0 symbols/min [2025-09-29T02:21:18.408949] [INFO ] [MAIN ] PSA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:18.414877] [DEBUG] [LOCAL ] PRMB: Derivative data saved (1820 records). [2025-09-29T02:21:18.415218] [INFO ] [MAIN ] PRMB: Successfully saved derivative data. [2025-09-29T02:21:18.419290] [INFO ] [MAIN ] Derivative Progress: 1614/2211 symbols completed. PRMB took 1.4s. Estimated remaining: 4m 12s. Rate: 142.1 symbols/min [2025-09-29T02:21:18.419634] [INFO ] [MAIN ] PSBD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:18.431907] [DEBUG] [LOCAL ] PSBD: Loaded 7130 existing records from primary storage. [2025-09-29T02:21:18.432194] [INFO ] [MAIN ] PSBD: Loaded 7130 primary data records. [2025-09-29T02:21:18.698280] [DEBUG] [LOCAL ] PSA: Loaded 42474 existing records from primary storage. [2025-09-29T02:21:18.702121] [INFO ] [MAIN ] PSA: Loaded 42474 primary data records. [2025-09-29T02:21:18.703569] [DEBUG] [LOCAL ] PRU: Loaded 52204 existing records from primary storage. [2025-09-29T02:21:18.856353] [INFO ] [MAIN ] PRU: Loaded 52204 primary data records. [2025-09-29T02:21:19.598006] [DEBUG] [MAIN ] PSBD: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:21:19.599705] [INFO ] [MAIN ] PSBD: Generated 1819 derivative records from 7130 primary records. [2025-09-29T02:21:19.600460] [DEBUG] [LOCAL ] PSBD: Saving derivative data. [2025-09-29T02:21:19.630594] [DEBUG] [LOCAL ] PSBD: Derivative data saved (1819 records). [2025-09-29T02:21:19.631438] [INFO ] [MAIN ] PSBD: Successfully saved derivative data. [2025-09-29T02:21:19.634573] [INFO ] [MAIN ] Derivative Progress: 1615/2211 symbols completed. PSBD took 1.2s. Estimated remaining: 4m 12s. Rate: 141.9 symbols/min [2025-09-29T02:21:19.636254] [INFO ] [MAIN ] PSF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:19.663694] [DEBUG] [MAIN ] PRU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:19.680522] [DEBUG] [MAIN ] PSA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:19.680109] [INFO ] [MAIN ] PRU: Generated 1820 derivative records from 52204 primary records. [2025-09-29T02:21:19.680923] [DEBUG] [LOCAL ] PRU: Saving derivative data. [2025-09-29T02:21:19.681769] [INFO ] [MAIN ] PSA: Generated 1820 derivative records from 42474 primary records. [2025-09-29T02:21:19.687151] [DEBUG] [LOCAL ] PSA: Saving derivative data. [2025-09-29T02:21:19.687499] [DEBUG] [LOCAL ] PSF: Loaded 6990 existing records from primary storage. [2025-09-29T02:21:19.696576] [INFO ] [MAIN ] PSF: Loaded 6990 primary data records. [2025-09-29T02:21:19.824164] [DEBUG] [LOCAL ] PRU: Derivative data saved (1820 records). [2025-09-29T02:21:19.811243] [DEBUG] [LOCAL ] PSA: Derivative data saved (1820 records). [2025-09-29T02:21:19.835749] [INFO ] [MAIN ] PSA: Successfully saved derivative data. [2025-09-29T02:21:19.838961] [INFO ] [MAIN ] Derivative Progress: 1616/2211 symbols completed. PSA took 1.4s. Estimated remaining: 4m 11s. Rate: 142.0 symbols/min [2025-09-29T02:21:19.844898] [INFO ] [MAIN ] PSFE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:19.835904] [INFO ] [MAIN ] PRU: Successfully saved derivative data. [2025-09-29T02:21:19.853711] [INFO ] [MAIN ] Derivative Progress: 1617/2211 symbols completed. PRU took 1.5s. Estimated remaining: 4m 11s. Rate: 142.1 symbols/min [2025-09-29T02:21:19.864729] [INFO ] [MAIN ] PSN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:20.086799] [DEBUG] [LOCAL ] PSFE: Loaded 30702 existing records from primary storage. [2025-09-29T02:21:20.087292] [INFO ] [MAIN ] PSFE: Loaded 30702 primary data records. [2025-09-29T02:21:20.305511] [DEBUG] [LOCAL ] PSN: Loaded 46808 existing records from primary storage. [2025-09-29T02:21:20.453762] [DEBUG] [MAIN ] PSF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:20.453885] [INFO ] [MAIN ] PSN: Loaded 46808 primary data records. [2025-09-29T02:21:20.512965] [INFO ] [MAIN ] PSF: Generated 1820 derivative records from 6990 primary records. [2025-09-29T02:21:20.513531] [DEBUG] [LOCAL ] PSF: Saving derivative data. [2025-09-29T02:21:20.663985] [DEBUG] [LOCAL ] PSF: Derivative data saved (1820 records). [2025-09-29T02:21:20.708687] [INFO ] [MAIN ] PSF: Successfully saved derivative data. [2025-09-29T02:21:20.756738] [INFO ] [MAIN ] Derivative Progress: 1618/2211 symbols completed. PSF took 1.1s. Estimated remaining: 4m 11s. Rate: 142.0 symbols/min [2025-09-29T02:21:20.923820] [DEBUG] [MAIN ] PSFE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:20.925158] [INFO ] [MAIN ] PSFE: Generated 1820 derivative records from 30702 primary records. [2025-09-29T02:21:20.925571] [DEBUG] [LOCAL ] PSFE: Saving derivative data. [2025-09-29T02:21:20.944620] [DEBUG] [LOCAL ] PSFE: Derivative data saved (1820 records). [2025-09-29T02:21:20.944827] [INFO ] [MAIN ] PSFE: Successfully saved derivative data. [2025-09-29T02:21:20.947668] [INFO ] [MAIN ] Derivative Progress: 1619/2211 symbols completed. PSFE took 1.1s. Estimated remaining: 4m 10s. Rate: 142.0 symbols/min [2025-09-29T02:21:20.963268] [DEBUG] [MAIN ] PSN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:20.964037] [INFO ] [MAIN ] PSN: Generated 1820 derivative records from 46808 primary records. [2025-09-29T02:21:20.964124] [DEBUG] [LOCAL ] PSN: Saving derivative data. [2025-09-29T02:21:20.986449] [DEBUG] [LOCAL ] PSN: Derivative data saved (1820 records). [2025-09-29T02:21:20.986569] [INFO ] [MAIN ] PSN: Successfully saved derivative data. [2025-09-29T02:21:20.989892] [INFO ] [MAIN ] Derivative Progress: 1620/2211 symbols completed. PSN took 1.1s. Estimated remaining: 4m 10s. Rate: 142.1 symbols/min [2025-09-29T02:21:20.990561] [INFO ] [MAIN ] PSQH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:20.990483] [INFO ] [MAIN ] PSO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:20.990615] [INFO ] [MAIN ] PSTG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:21.062800] [DEBUG] [LOCAL ] PSQH: Loaded 35426 existing records from primary storage. [2025-09-29T02:21:21.074181] [INFO ] [MAIN ] PSQH: Loaded 35426 primary data records. [2025-09-29T02:21:21.081746] [DEBUG] [LOCAL ] PSO: Loaded 37751 existing records from primary storage. [2025-09-29T02:21:21.089163] [INFO ] [MAIN ] PSO: Loaded 37751 primary data records. [2025-09-29T02:21:21.250272] [DEBUG] [LOCAL ] PSTG: Loaded 53626 existing records from primary storage. [2025-09-29T02:21:21.250541] [INFO ] [MAIN ] PSTG: Loaded 53626 primary data records. [2025-09-29T02:21:22.175912] [DEBUG] [MAIN ] PSQH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:22.176411] [DEBUG] [MAIN ] PSO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:22.178803] [INFO ] [MAIN ] PSO: Generated 1820 derivative records from 37751 primary records. [2025-09-29T02:21:22.178940] [DEBUG] [LOCAL ] PSO: Saving derivative data. [2025-09-29T02:21:22.177766] [INFO ] [MAIN ] PSQH: Generated 1820 derivative records from 35426 primary records. [2025-09-29T02:21:22.180839] [DEBUG] [LOCAL ] PSQH: Saving derivative data. [2025-09-29T02:21:22.208299] [DEBUG] [LOCAL ] PSO: Derivative data saved (1820 records). [2025-09-29T02:21:22.222991] [INFO ] [MAIN ] PSO: Successfully saved derivative data. [2025-09-29T02:21:22.230165] [DEBUG] [LOCAL ] PSQH: Derivative data saved (1820 records). [2025-09-29T02:21:22.232561] [INFO ] [MAIN ] Derivative Progress: 1621/2211 symbols completed. PSO took 1.2s. Estimated remaining: 4m 9s. Rate: 141.9 symbols/min [2025-09-29T02:21:22.233160] [DEBUG] [MAIN ] PSTG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:22.233508] [INFO ] [MAIN ] PSTL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:22.233349] [INFO ] [MAIN ] PSQH: Successfully saved derivative data. [2025-09-29T02:21:22.238117] [INFO ] [MAIN ] PSTG: Generated 1820 derivative records from 53626 primary records. [2025-09-29T02:21:22.238627] [DEBUG] [LOCAL ] PSTG: Saving derivative data. [2025-09-29T02:21:22.237022] [INFO ] [MAIN ] Derivative Progress: 1622/2211 symbols completed. PSQH took 1.2s. Estimated remaining: 4m 9s. Rate: 142.0 symbols/min [2025-09-29T02:21:22.239041] [INFO ] [MAIN ] PSX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:22.260024] [DEBUG] [LOCAL ] PSTG: Derivative data saved (1820 records). [2025-09-29T02:21:22.260209] [INFO ] [MAIN ] PSTG: Successfully saved derivative data. [2025-09-29T02:21:22.263870] [INFO ] [MAIN ] Derivative Progress: 1623/2211 symbols completed. PSTG took 1.3s. Estimated remaining: 4m 8s. Rate: 142.1 symbols/min [2025-09-29T02:21:22.265207] [INFO ] [MAIN ] PTA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:22.285254] [DEBUG] [LOCAL ] PSTL: Loaded 20585 existing records from primary storage. [2025-09-29T02:21:22.285453] [INFO ] [MAIN ] PSTL: Loaded 20585 primary data records. [2025-09-29T02:21:22.406873] [DEBUG] [LOCAL ] PTA: Loaded 15299 existing records from primary storage. [2025-09-29T02:21:22.420030] [INFO ] [MAIN ] PTA: Loaded 15299 primary data records. [2025-09-29T02:21:22.835397] [DEBUG] [LOCAL ] PSX: Loaded 53912 existing records from primary storage. [2025-09-29T02:21:22.854475] [INFO ] [MAIN ] PSX: Loaded 53912 primary data records. [2025-09-29T02:21:23.439224] [DEBUG] [MAIN ] PSTL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:23.440996] [INFO ] [MAIN ] PSTL: Generated 1820 derivative records from 20585 primary records. [2025-09-29T02:21:23.441495] [DEBUG] [LOCAL ] PSTL: Saving derivative data. [2025-09-29T02:21:23.462223] [DEBUG] [LOCAL ] PSTL: Derivative data saved (1820 records). [2025-09-29T02:21:23.464239] [INFO ] [MAIN ] PSTL: Successfully saved derivative data. [2025-09-29T02:21:23.466660] [INFO ] [MAIN ] Derivative Progress: 1624/2211 symbols completed. PSTL took 1.2s. Estimated remaining: 4m 8s. Rate: 141.9 symbols/min [2025-09-29T02:21:23.467447] [INFO ] [MAIN ] PTY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:23.481362] [DEBUG] [MAIN ] PTA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:23.482289] [INFO ] [MAIN ] PTA: Generated 1820 derivative records from 15299 primary records. [2025-09-29T02:21:23.482821] [DEBUG] [LOCAL ] PTA: Saving derivative data. [2025-09-29T02:21:23.505764] [DEBUG] [LOCAL ] PTA: Derivative data saved (1820 records). [2025-09-29T02:21:23.506130] [INFO ] [MAIN ] PTA: Successfully saved derivative data. [2025-09-29T02:21:23.509282] [INFO ] [MAIN ] Derivative Progress: 1625/2211 symbols completed. PTA took 1.2s. Estimated remaining: 4m 8s. Rate: 142.0 symbols/min [2025-09-29T02:21:23.523540] [INFO ] [MAIN ] PUK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:23.523973] [DEBUG] [MAIN ] PSX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:23.524974] [INFO ] [MAIN ] PSX: Generated 1820 derivative records from 53912 primary records. [2025-09-29T02:21:23.525154] [DEBUG] [LOCAL ] PSX: Saving derivative data. [2025-09-29T02:21:23.552766] [DEBUG] [LOCAL ] PSX: Derivative data saved (1820 records). [2025-09-29T02:21:23.553071] [INFO ] [MAIN ] PSX: Successfully saved derivative data. [2025-09-29T02:21:23.556570] [INFO ] [MAIN ] Derivative Progress: 1626/2211 symbols completed. PSX took 1.3s. Estimated remaining: 4m 7s. Rate: 142.1 symbols/min [2025-09-29T02:21:23.557066] [INFO ] [MAIN ] PUMP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:23.572258] [DEBUG] [LOCAL ] PTY: Loaded 37902 existing records from primary storage. [2025-09-29T02:21:23.572757] [INFO ] [MAIN ] PTY: Loaded 37902 primary data records. [2025-09-29T02:21:23.838321] [DEBUG] [LOCAL ] PUK: Loaded 45565 existing records from primary storage. [2025-09-29T02:21:23.957131] [INFO ] [MAIN ] PUK: Loaded 45565 primary data records. [2025-09-29T02:21:24.007299] [DEBUG] [LOCAL ] PUMP: Loaded 50160 existing records from primary storage. [2025-09-29T02:21:24.060557] [INFO ] [MAIN ] PUMP: Loaded 50160 primary data records. [2025-09-29T02:21:24.707017] [DEBUG] [MAIN ] PTY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:24.709825] [INFO ] [MAIN ] PTY: Generated 1820 derivative records from 37902 primary records. [2025-09-29T02:21:24.713278] [DEBUG] [LOCAL ] PTY: Saving derivative data. [2025-09-29T02:21:24.742910] [DEBUG] [LOCAL ] PTY: Derivative data saved (1820 records). [2025-09-29T02:21:24.743305] [INFO ] [MAIN ] PTY: Successfully saved derivative data. [2025-09-29T02:21:24.746580] [INFO ] [MAIN ] Derivative Progress: 1627/2211 symbols completed. PTY took 1.3s. Estimated remaining: 4m 7s. Rate: 141.9 symbols/min [2025-09-29T02:21:24.747283] [INFO ] [MAIN ] PVH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:24.769818] [DEBUG] [MAIN ] PUK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:24.772334] [INFO ] [MAIN ] PUK: Generated 1820 derivative records from 45565 primary records. [2025-09-29T02:21:24.772537] [DEBUG] [LOCAL ] PUK: Saving derivative data. [2025-09-29T02:21:24.800465] [DEBUG] [MAIN ] PUMP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:24.802172] [INFO ] [MAIN ] PUMP: Generated 1820 derivative records from 50160 primary records. [2025-09-29T02:21:24.806524] [DEBUG] [LOCAL ] PUMP: Saving derivative data. [2025-09-29T02:21:24.806412] [DEBUG] [LOCAL ] PUK: Derivative data saved (1820 records). [2025-09-29T02:21:24.807672] [INFO ] [MAIN ] PUK: Successfully saved derivative data. [2025-09-29T02:21:24.810758] [INFO ] [MAIN ] Derivative Progress: 1628/2211 symbols completed. PUK took 1.3s. Estimated remaining: 4m 6s. Rate: 142.0 symbols/min [2025-09-29T02:21:24.811213] [INFO ] [MAIN ] PVL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:24.831017] [DEBUG] [LOCAL ] PUMP: Derivative data saved (1820 records). [2025-09-29T02:21:24.832744] [INFO ] [MAIN ] PUMP: Successfully saved derivative data. [2025-09-29T02:21:24.836403] [INFO ] [MAIN ] Derivative Progress: 1629/2211 symbols completed. PUMP took 1.3s. Estimated remaining: 4m 6s. Rate: 142.1 symbols/min [2025-09-29T02:21:24.836758] [INFO ] [MAIN ] PWR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:24.841983] [DEBUG] [LOCAL ] PVL: Loaded 4819 existing records from primary storage. [2025-09-29T02:21:24.842159] [INFO ] [MAIN ] PVL: Loaded 4819 primary data records. [2025-09-29T02:21:25.071675] [DEBUG] [LOCAL ] PVH: Loaded 51137 existing records from primary storage. [2025-09-29T02:21:25.072144] [INFO ] [MAIN ] PVH: Loaded 51137 primary data records. [2025-09-29T02:21:25.396869] [DEBUG] [LOCAL ] PWR: Loaded 48047 existing records from primary storage. [2025-09-29T02:21:25.413607] [INFO ] [MAIN ] PWR: Loaded 48047 primary data records. [2025-09-29T02:21:25.984174] [DEBUG] [MAIN ] PVL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:25.985407] [INFO ] [MAIN ] PVL: Generated 1820 derivative records from 4819 primary records. [2025-09-29T02:21:25.988103] [DEBUG] [LOCAL ] PVL: Saving derivative data. [2025-09-29T02:21:26.008976] [DEBUG] [LOCAL ] PVL: Derivative data saved (1820 records). [2025-09-29T02:21:26.009204] [INFO ] [MAIN ] PVL: Successfully saved derivative data. [2025-09-29T02:21:26.012164] [INFO ] [MAIN ] Derivative Progress: 1630/2211 symbols completed. PVL took 1.2s. Estimated remaining: 4m 6s. Rate: 141.9 symbols/min [2025-09-29T02:21:26.012508] [INFO ] [MAIN ] PX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:26.034483] [DEBUG] [MAIN ] PVH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:26.035906] [INFO ] [MAIN ] PVH: Generated 1820 derivative records from 51137 primary records. [2025-09-29T02:21:26.036148] [DEBUG] [LOCAL ] PVH: Saving derivative data. [2025-09-29T02:21:26.068479] [DEBUG] [MAIN ] PWR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:26.071473] [INFO ] [MAIN ] PWR: Generated 1820 derivative records from 48047 primary records. [2025-09-29T02:21:26.072824] [DEBUG] [LOCAL ] PVH: Derivative data saved (1820 records). [2025-09-29T02:21:26.082470] [DEBUG] [LOCAL ] PWR: Saving derivative data. [2025-09-29T02:21:26.082617] [INFO ] [MAIN ] PVH: Successfully saved derivative data. [2025-09-29T02:21:26.086746] [INFO ] [MAIN ] Derivative Progress: 1631/2211 symbols completed. PVH took 1.3s. Estimated remaining: 4m 5s. Rate: 142.0 symbols/min [2025-09-29T02:21:26.087503] [INFO ] [MAIN ] QBTS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:26.103435] [DEBUG] [LOCAL ] PWR: Derivative data saved (1820 records). [2025-09-29T02:21:26.103841] [INFO ] [MAIN ] PWR: Successfully saved derivative data. [2025-09-29T02:21:26.107360] [INFO ] [MAIN ] Derivative Progress: 1632/2211 symbols completed. PWR took 1.3s. Estimated remaining: 4m 5s. Rate: 142.1 symbols/min [2025-09-29T02:21:26.109437] [INFO ] [MAIN ] QD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:26.122256] [DEBUG] [LOCAL ] PX: Loaded 35085 existing records from primary storage. [2025-09-29T02:21:26.122748] [INFO ] [MAIN ] PX: Loaded 35085 primary data records. [2025-09-29T02:21:26.477598] [DEBUG] [LOCAL ] QD: Loaded 28475 existing records from primary storage. [2025-09-29T02:21:26.478024] [INFO ] [MAIN ] QD: Loaded 28475 primary data records. [2025-09-29T02:21:26.612349] [DEBUG] [LOCAL ] QBTS: Loaded 54526 existing records from primary storage. [2025-09-29T02:21:26.635731] [INFO ] [MAIN ] QBTS: Loaded 54526 primary data records. [2025-09-29T02:21:27.241887] [DEBUG] [MAIN ] PX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:27.252460] [INFO ] [MAIN ] PX: Generated 1820 derivative records from 35085 primary records. [2025-09-29T02:21:27.253581] [DEBUG] [LOCAL ] PX: Saving derivative data. [2025-09-29T02:21:27.275463] [DEBUG] [LOCAL ] PX: Derivative data saved (1820 records). [2025-09-29T02:21:27.276457] [INFO ] [MAIN ] PX: Successfully saved derivative data. [2025-09-29T02:21:27.280098] [INFO ] [MAIN ] Derivative Progress: 1633/2211 symbols completed. PX took 1.3s. Estimated remaining: 4m 4s. Rate: 141.9 symbols/min [2025-09-29T02:21:27.297575] [DEBUG] [MAIN ] QD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:27.298732] [INFO ] [MAIN ] QD: Generated 1820 derivative records from 28475 primary records. [2025-09-29T02:21:27.298840] [DEBUG] [LOCAL ] QD: Saving derivative data. [2025-09-29T02:21:27.316358] [DEBUG] [LOCAL ] QD: Derivative data saved (1820 records). [2025-09-29T02:21:27.316628] [INFO ] [MAIN ] QD: Successfully saved derivative data. [2025-09-29T02:21:27.319816] [INFO ] [MAIN ] Derivative Progress: 1634/2211 symbols completed. QD took 1.2s. Estimated remaining: 4m 4s. Rate: 142.0 symbols/min [2025-09-29T02:21:27.334819] [DEBUG] [MAIN ] QBTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:27.335499] [INFO ] [MAIN ] QBTS: Generated 1820 derivative records from 54526 primary records. [2025-09-29T02:21:27.335585] [DEBUG] [LOCAL ] QBTS: Saving derivative data. [2025-09-29T02:21:27.352243] [DEBUG] [LOCAL ] QBTS: Derivative data saved (1820 records). [2025-09-29T02:21:27.352376] [INFO ] [MAIN ] QBTS: Successfully saved derivative data. [2025-09-29T02:21:27.355773] [INFO ] [MAIN ] Derivative Progress: 1635/2211 symbols completed. QBTS took 1.3s. Estimated remaining: 4m 3s. Rate: 142.1 symbols/min [2025-09-29T02:21:27.356374] [INFO ] [MAIN ] QGEN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:27.356458] [INFO ] [MAIN ] QSR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:27.356543] [INFO ] [MAIN ] QS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:27.442717] [DEBUG] [LOCAL ] QGEN: Loaded 49874 existing records from primary storage. [2025-09-29T02:21:27.457623] [INFO ] [MAIN ] QGEN: Loaded 49874 primary data records. [2025-09-29T02:21:27.473239] [DEBUG] [LOCAL ] QSR: Loaded 53178 existing records from primary storage. [2025-09-29T02:21:27.498260] [INFO ] [MAIN ] QSR: Loaded 53178 primary data records. [2025-09-29T02:21:27.504578] [DEBUG] [LOCAL ] QS: Loaded 54522 existing records from primary storage. [2025-09-29T02:21:27.590156] [INFO ] [MAIN ] QS: Loaded 54522 primary data records. [2025-09-29T02:21:28.543853] [DEBUG] [MAIN ] QGEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:28.546773] [INFO ] [MAIN ] QGEN: Generated 1820 derivative records from 49874 primary records. [2025-09-29T02:21:28.547896] [DEBUG] [LOCAL ] QGEN: Saving derivative data. [2025-09-29T02:21:28.575225] [DEBUG] [MAIN ] QSR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:28.578578] [INFO ] [MAIN ] QSR: Generated 1820 derivative records from 53178 primary records. [2025-09-29T02:21:28.579004] [DEBUG] [LOCAL ] QSR: Saving derivative data. [2025-09-29T02:21:28.583258] [DEBUG] [LOCAL ] QGEN: Derivative data saved (1820 records). [2025-09-29T02:21:28.585488] [INFO ] [MAIN ] QGEN: Successfully saved derivative data. [2025-09-29T02:21:28.600205] [INFO ] [MAIN ] Derivative Progress: 1636/2211 symbols completed. QGEN took 1.2s. Estimated remaining: 4m 3s. Rate: 141.9 symbols/min [2025-09-29T02:21:28.601087] [INFO ] [MAIN ] QTWO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:28.618475] [DEBUG] [LOCAL ] QSR: Derivative data saved (1820 records). [2025-09-29T02:21:28.619179] [INFO ] [MAIN ] QSR: Successfully saved derivative data. [2025-09-29T02:21:28.622430] [INFO ] [MAIN ] Derivative Progress: 1637/2211 symbols completed. QSR took 1.3s. Estimated remaining: 4m 3s. Rate: 142.0 symbols/min [2025-09-29T02:21:28.623255] [DEBUG] [MAIN ] QS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:28.623521] [INFO ] [MAIN ] QUAD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:28.625182] [INFO ] [MAIN ] QS: Generated 1820 derivative records from 54522 primary records. [2025-09-29T02:21:28.626015] [DEBUG] [LOCAL ] QS: Saving derivative data. [2025-09-29T02:21:28.646623] [DEBUG] [LOCAL ] QS: Derivative data saved (1820 records). [2025-09-29T02:21:28.646786] [INFO ] [MAIN ] QS: Successfully saved derivative data. [2025-09-29T02:21:28.650290] [INFO ] [MAIN ] Derivative Progress: 1638/2211 symbols completed. QS took 1.3s. Estimated remaining: 4m 2s. Rate: 142.1 symbols/min [2025-09-29T02:21:28.650634] [INFO ] [MAIN ] QVCC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:28.679512] [DEBUG] [LOCAL ] QVCC: Loaded 9018 existing records from primary storage. [2025-09-29T02:21:28.680720] [INFO ] [MAIN ] QVCC: Loaded 9018 primary data records. [2025-09-29T02:21:28.713241] [DEBUG] [LOCAL ] QUAD: Loaded 23938 existing records from primary storage. [2025-09-29T02:21:28.728254] [INFO ] [MAIN ] QUAD: Loaded 23938 primary data records. [2025-09-29T02:21:28.821481] [DEBUG] [LOCAL ] QTWO: Loaded 39754 existing records from primary storage. [2025-09-29T02:21:28.821891] [INFO ] [MAIN ] QTWO: Loaded 39754 primary data records. [2025-09-29T02:21:29.858200] [DEBUG] [MAIN ] QVCC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:29.859994] [INFO ] [MAIN ] QVCC: Generated 1820 derivative records from 9018 primary records. [2025-09-29T02:21:29.874230] [DEBUG] [LOCAL ] QVCC: Saving derivative data. [2025-09-29T02:21:29.874153] [DEBUG] [MAIN ] QUAD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:29.876792] [INFO ] [MAIN ] QUAD: Generated 1820 derivative records from 23938 primary records. [2025-09-29T02:21:29.877285] [DEBUG] [LOCAL ] QUAD: Saving derivative data. [2025-09-29T02:21:29.897284] [DEBUG] [LOCAL ] QVCC: Derivative data saved (1820 records). [2025-09-29T02:21:29.906286] [INFO ] [MAIN ] QVCC: Successfully saved derivative data. [2025-09-29T02:21:29.915743] [DEBUG] [LOCAL ] QUAD: Derivative data saved (1820 records). [2025-09-29T02:21:29.911469] [INFO ] [MAIN ] Derivative Progress: 1639/2211 symbols completed. QVCC took 1.3s. Estimated remaining: 4m 2s. Rate: 141.9 symbols/min [2025-09-29T02:21:29.916144] [INFO ] [MAIN ] QVCD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:29.928898] [INFO ] [MAIN ] QUAD: Successfully saved derivative data. [2025-09-29T02:21:29.931873] [INFO ] [MAIN ] Derivative Progress: 1640/2211 symbols completed. QUAD took 1.3s. Estimated remaining: 4m 1s. Rate: 142.0 symbols/min [2025-09-29T02:21:29.933068] [INFO ] [MAIN ] QXO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:29.933751] [DEBUG] [MAIN ] QTWO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:29.934862] [INFO ] [MAIN ] QTWO: Generated 1820 derivative records from 39754 primary records. [2025-09-29T02:21:29.935063] [DEBUG] [LOCAL ] QTWO: Saving derivative data. [2025-09-29T02:21:29.958387] [DEBUG] [LOCAL ] QTWO: Derivative data saved (1820 records). [2025-09-29T02:21:29.954608] [DEBUG] [LOCAL ] QVCD: Loaded 4542 existing records from primary storage. [2025-09-29T02:21:29.958810] [INFO ] [MAIN ] QVCD: Loaded 4542 primary data records. [2025-09-29T02:21:29.958635] [INFO ] [MAIN ] QTWO: Successfully saved derivative data. [2025-09-29T02:21:29.962230] [INFO ] [MAIN ] Derivative Progress: 1641/2211 symbols completed. QTWO took 1.4s. Estimated remaining: 4m 1s. Rate: 142.1 symbols/min [2025-09-29T02:21:29.962577] [INFO ] [MAIN ] R: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:30.310807] [DEBUG] [LOCAL ] R: Loaded 29775 existing records from primary storage. [2025-09-29T02:21:30.346885] [INFO ] [MAIN ] R: Loaded 29775 primary data records. [2025-09-29T02:21:30.361349] [DEBUG] [LOCAL ] QXO: Loaded 53964 existing records from primary storage. [2025-09-29T02:21:30.361825] [INFO ] [MAIN ] QXO: Loaded 53964 primary data records. [2025-09-29T02:21:31.064861] [DEBUG] [MAIN ] QVCD: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:21:31.066318] [INFO ] [MAIN ] QVCD: Generated 1819 derivative records from 4542 primary records. [2025-09-29T02:21:31.066515] [DEBUG] [LOCAL ] QVCD: Saving derivative data. [2025-09-29T02:21:31.087812] [DEBUG] [LOCAL ] QVCD: Derivative data saved (1819 records). [2025-09-29T02:21:31.088873] [INFO ] [MAIN ] QVCD: Successfully saved derivative data. [2025-09-29T02:21:31.092486] [INFO ] [MAIN ] Derivative Progress: 1642/2211 symbols completed. QVCD took 1.2s. Estimated remaining: 4m 1s. Rate: 141.9 symbols/min [2025-09-29T02:21:31.094751] [INFO ] [MAIN ] RA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:31.116596] [DEBUG] [MAIN ] R: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:31.119908] [INFO ] [MAIN ] R: Generated 1820 derivative records from 29775 primary records. [2025-09-29T02:21:31.126425] [DEBUG] [LOCAL ] R: Saving derivative data. [2025-09-29T02:21:31.141314] [DEBUG] [MAIN ] QXO: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:21:31.143740] [INFO ] [MAIN ] QXO: Generated 1819 derivative records from 53964 primary records. [2025-09-29T02:21:31.156070] [DEBUG] [LOCAL ] QXO: Saving derivative data. [2025-09-29T02:21:31.168184] [DEBUG] [LOCAL ] RA: Loaded 22045 existing records from primary storage. [2025-09-29T02:21:31.170781] [INFO ] [MAIN ] RA: Loaded 22045 primary data records. [2025-09-29T02:21:31.226511] [DEBUG] [LOCAL ] R: Derivative data saved (1820 records). [2025-09-29T02:21:31.269360] [DEBUG] [LOCAL ] QXO: Derivative data saved (1819 records). [2025-09-29T02:21:31.282776] [INFO ] [MAIN ] R: Successfully saved derivative data. [2025-09-29T02:21:31.295996] [INFO ] [MAIN ] QXO: Successfully saved derivative data. [2025-09-29T02:21:31.311915] [INFO ] [MAIN ] Derivative Progress: 1643/2211 symbols completed. R took 1.3s. Estimated remaining: 4m 0s. Rate: 142.0 symbols/min [2025-09-29T02:21:31.321113] [INFO ] [MAIN ] RACE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:31.321218] [INFO ] [MAIN ] Derivative Progress: 1644/2211 symbols completed. QXO took 1.4s. Estimated remaining: 3m 59s. Rate: 142.1 symbols/min [2025-09-29T02:21:31.337027] [INFO ] [MAIN ] RAMP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:31.629946] [DEBUG] [LOCAL ] RAMP: Loaded 38208 existing records from primary storage. [2025-09-29T02:21:31.630218] [INFO ] [MAIN ] RAMP: Loaded 38208 primary data records. [2025-09-29T02:21:31.645988] [DEBUG] [LOCAL ] RACE: Loaded 33300 existing records from primary storage. [2025-09-29T02:21:31.675784] [INFO ] [MAIN ] RACE: Loaded 33300 primary data records. [2025-09-29T02:21:31.976801] [DEBUG] [MAIN ] RA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:32.122120] [INFO ] [MAIN ] RA: Generated 1820 derivative records from 22045 primary records. [2025-09-29T02:21:32.158468] [DEBUG] [LOCAL ] RA: Saving derivative data. [2025-09-29T02:21:32.339189] [DEBUG] [LOCAL ] RA: Derivative data saved (1820 records). [2025-09-29T02:21:32.340805] [INFO ] [MAIN ] RA: Successfully saved derivative data. [2025-09-29T02:21:32.344468] [INFO ] [MAIN ] Derivative Progress: 1645/2211 symbols completed. RA took 1.2s. Estimated remaining: 3m 59s. Rate: 141.9 symbols/min [2025-09-29T02:21:32.346604] [INFO ] [MAIN ] RBA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:32.376126] [DEBUG] [MAIN ] RAMP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:32.377122] [INFO ] [MAIN ] RAMP: Generated 1820 derivative records from 38208 primary records. [2025-09-29T02:21:32.377394] [DEBUG] [LOCAL ] RAMP: Saving derivative data. [2025-09-29T02:21:32.397934] [DEBUG] [LOCAL ] RAMP: Derivative data saved (1820 records). [2025-09-29T02:21:32.406083] [INFO ] [MAIN ] RAMP: Successfully saved derivative data. [2025-09-29T02:21:32.413989] [INFO ] [MAIN ] Derivative Progress: 1646/2211 symbols completed. RAMP took 1.1s. Estimated remaining: 3m 59s. Rate: 142.0 symbols/min [2025-09-29T02:21:32.414748] [INFO ] [MAIN ] RBC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:32.426471] [DEBUG] [MAIN ] RACE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:32.428112] [INFO ] [MAIN ] RACE: Generated 1820 derivative records from 33300 primary records. [2025-09-29T02:21:32.428255] [DEBUG] [LOCAL ] RACE: Saving derivative data. [2025-09-29T02:21:32.460218] [DEBUG] [LOCAL ] RACE: Derivative data saved (1820 records). [2025-09-29T02:21:32.460480] [INFO ] [MAIN ] RACE: Successfully saved derivative data. [2025-09-29T02:21:32.464435] [INFO ] [MAIN ] Derivative Progress: 1647/2211 symbols completed. RACE took 1.1s. Estimated remaining: 3m 58s. Rate: 142.1 symbols/min [2025-09-29T02:21:32.464759] [INFO ] [MAIN ] RBLX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:32.470690] [DEBUG] [LOCAL ] RBA: Loaded 46598 existing records from primary storage. [2025-09-29T02:21:32.471142] [INFO ] [MAIN ] RBA: Loaded 46598 primary data records. [2025-09-29T02:21:32.501860] [DEBUG] [LOCAL ] RBC: Loaded 15326 existing records from primary storage. [2025-09-29T02:21:32.539221] [INFO ] [MAIN ] RBC: Loaded 15326 primary data records. [2025-09-29T02:21:33.184365] [DEBUG] [LOCAL ] RBLX: Loaded 54496 existing records from primary storage. [2025-09-29T02:21:33.185012] [INFO ] [MAIN ] RBLX: Loaded 54496 primary data records. [2025-09-29T02:21:33.557810] [DEBUG] [MAIN ] RBA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:33.560830] [INFO ] [MAIN ] RBA: Generated 1820 derivative records from 46598 primary records. [2025-09-29T02:21:33.562180] [DEBUG] [LOCAL ] RBA: Saving derivative data. [2025-09-29T02:21:33.577242] [DEBUG] [MAIN ] RBC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:33.587013] [INFO ] [MAIN ] RBC: Generated 1820 derivative records from 15326 primary records. [2025-09-29T02:21:33.587301] [DEBUG] [LOCAL ] RBC: Saving derivative data. [2025-09-29T02:21:33.608336] [DEBUG] [LOCAL ] RBA: Derivative data saved (1820 records). [2025-09-29T02:21:33.611036] [INFO ] [MAIN ] RBA: Successfully saved derivative data. [2025-09-29T02:21:33.612176] [DEBUG] [LOCAL ] RBC: Derivative data saved (1820 records). [2025-09-29T02:21:33.615370] [INFO ] [MAIN ] Derivative Progress: 1648/2211 symbols completed. RBA took 1.3s. Estimated remaining: 3m 58s. Rate: 141.9 symbols/min [2025-09-29T02:21:33.617692] [INFO ] [MAIN ] RBC: Successfully saved derivative data. [2025-09-29T02:21:33.621383] [INFO ] [MAIN ] Derivative Progress: 1649/2211 symbols completed. RBC took 1.2s. Estimated remaining: 3m 57s. Rate: 142.0 symbols/min [2025-09-29T02:21:33.635333] [DEBUG] [MAIN ] RBLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:33.636122] [INFO ] [MAIN ] RBLX: Generated 1820 derivative records from 54496 primary records. [2025-09-29T02:21:33.636226] [DEBUG] [LOCAL ] RBLX: Saving derivative data. [2025-09-29T02:21:33.652427] [DEBUG] [LOCAL ] RBLX: Derivative data saved (1820 records). [2025-09-29T02:21:33.652526] [INFO ] [MAIN ] RBLX: Successfully saved derivative data. [2025-09-29T02:21:33.655454] [INFO ] [MAIN ] Derivative Progress: 1650/2211 symbols completed. RBLX took 1.2s. Estimated remaining: 3m 57s. Rate: 142.1 symbols/min [2025-09-29T02:21:33.656016] [INFO ] [MAIN ] RBOT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:33.656068] [INFO ] [MAIN ] RC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:33.656127] [INFO ] [MAIN ] RBRK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:33.665287] [DEBUG] [LOCAL ] RBOT: Loaded 5223 existing records from primary storage. [2025-09-29T02:21:33.665624] [INFO ] [MAIN ] RBOT: Loaded 5223 primary data records. [2025-09-29T02:21:34.116737] [DEBUG] [LOCAL ] RBRK: Loaded 53892 existing records from primary storage. [2025-09-29T02:21:34.115731] [DEBUG] [LOCAL ] RC: Loaded 49676 existing records from primary storage. [2025-09-29T02:21:34.117861] [INFO ] [MAIN ] RBRK: Loaded 53892 primary data records. [2025-09-29T02:21:34.117955] [INFO ] [MAIN ] RC: Loaded 49676 primary data records. [2025-09-29T02:21:34.821610] [DEBUG] [MAIN ] RBOT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:34.825002] [INFO ] [MAIN ] RBOT: Generated 1820 derivative records from 5223 primary records. [2025-09-29T02:21:34.826536] [DEBUG] [LOCAL ] RBOT: Saving derivative data. [2025-09-29T02:21:34.844805] [DEBUG] [LOCAL ] RBOT: Derivative data saved (1820 records). [2025-09-29T02:21:34.845141] [INFO ] [MAIN ] RBOT: Successfully saved derivative data. [2025-09-29T02:21:34.848695] [INFO ] [MAIN ] Derivative Progress: 1651/2211 symbols completed. RBOT took 1.2s. Estimated remaining: 3m 57s. Rate: 141.9 symbols/min [2025-09-29T02:21:34.849602] [INFO ] [MAIN ] RCI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:34.874696] [DEBUG] [MAIN ] RBRK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:34.876264] [INFO ] [MAIN ] RBRK: Generated 1820 derivative records from 53892 primary records. [2025-09-29T02:21:34.884841] [DEBUG] [LOCAL ] RBRK: Saving derivative data. [2025-09-29T02:21:34.891831] [DEBUG] [MAIN ] RC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:34.907581] [INFO ] [MAIN ] RC: Generated 1820 derivative records from 49676 primary records. [2025-09-29T02:21:34.913304] [DEBUG] [LOCAL ] RC: Saving derivative data. [2025-09-29T02:21:34.914274] [DEBUG] [LOCAL ] RBRK: Derivative data saved (1820 records). [2025-09-29T02:21:34.914988] [INFO ] [MAIN ] RBRK: Successfully saved derivative data. [2025-09-29T02:21:34.918626] [INFO ] [MAIN ] Derivative Progress: 1652/2211 symbols completed. RBRK took 1.3s. Estimated remaining: 3m 56s. Rate: 142.0 symbols/min [2025-09-29T02:21:34.925983] [INFO ] [MAIN ] RCL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:34.935739] [DEBUG] [LOCAL ] RC: Derivative data saved (1820 records). [2025-09-29T02:21:34.936096] [INFO ] [MAIN ] RC: Successfully saved derivative data. [2025-09-29T02:21:34.938944] [INFO ] [MAIN ] Derivative Progress: 1653/2211 symbols completed. RC took 1.3s. Estimated remaining: 3m 56s. Rate: 142.1 symbols/min [2025-09-29T02:21:34.939338] [INFO ] [MAIN ] RCS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:34.963867] [DEBUG] [LOCAL ] RCS: Loaded 11593 existing records from primary storage. [2025-09-29T02:21:34.964039] [INFO ] [MAIN ] RCS: Loaded 11593 primary data records. [2025-09-29T02:21:35.087197] [DEBUG] [LOCAL ] RCI: Loaded 49383 existing records from primary storage. [2025-09-29T02:21:35.101197] [INFO ] [MAIN ] RCI: Loaded 49383 primary data records. [2025-09-29T02:21:35.469772] [DEBUG] [LOCAL ] RCL: Loaded 52876 existing records from primary storage. [2025-09-29T02:21:35.504432] [INFO ] [MAIN ] RCL: Loaded 52876 primary data records. [2025-09-29T02:21:36.098001] [DEBUG] [MAIN ] RCS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:36.099554] [INFO ] [MAIN ] RCS: Generated 1820 derivative records from 11593 primary records. [2025-09-29T02:21:36.100064] [DEBUG] [LOCAL ] RCS: Saving derivative data. [2025-09-29T02:21:36.119089] [DEBUG] [LOCAL ] RCS: Derivative data saved (1820 records). [2025-09-29T02:21:36.119811] [INFO ] [MAIN ] RCS: Successfully saved derivative data. [2025-09-29T02:21:36.124714] [INFO ] [MAIN ] Derivative Progress: 1654/2211 symbols completed. RCS took 1.2s. Estimated remaining: 3m 55s. Rate: 141.9 symbols/min [2025-09-29T02:21:36.126677] [INFO ] [MAIN ] RCUS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:36.142557] [DEBUG] [MAIN ] RCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:36.143956] [INFO ] [MAIN ] RCI: Generated 1820 derivative records from 49383 primary records. [2025-09-29T02:21:36.144496] [DEBUG] [LOCAL ] RCI: Saving derivative data. [2025-09-29T02:21:36.164637] [DEBUG] [LOCAL ] RCI: Derivative data saved (1820 records). [2025-09-29T02:21:36.164901] [INFO ] [MAIN ] RCI: Successfully saved derivative data. [2025-09-29T02:21:36.171147] [INFO ] [MAIN ] Derivative Progress: 1655/2211 symbols completed. RCI took 1.3s. Estimated remaining: 3m 55s. Rate: 142.0 symbols/min [2025-09-29T02:21:36.172581] [INFO ] [MAIN ] RDDT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:36.191534] [DEBUG] [MAIN ] RCL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:36.192365] [INFO ] [MAIN ] RCL: Generated 1820 derivative records from 52876 primary records. [2025-09-29T02:21:36.203124] [DEBUG] [LOCAL ] RCL: Saving derivative data. [2025-09-29T02:21:36.235400] [DEBUG] [LOCAL ] RCL: Derivative data saved (1820 records). [2025-09-29T02:21:36.235696] [INFO ] [MAIN ] RCL: Successfully saved derivative data. [2025-09-29T02:21:36.238778] [INFO ] [MAIN ] Derivative Progress: 1656/2211 symbols completed. RCL took 1.3s. Estimated remaining: 3m 54s. Rate: 142.1 symbols/min [2025-09-29T02:21:36.240839] [DEBUG] [LOCAL ] RCUS: Loaded 43206 existing records from primary storage. [2025-09-29T02:21:36.239279] [INFO ] [MAIN ] RDN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:36.241066] [INFO ] [MAIN ] RCUS: Loaded 43206 primary data records. [2025-09-29T02:21:36.632047] [DEBUG] [LOCAL ] RDDT: Loaded 54563 existing records from primary storage. [2025-09-29T02:21:36.632755] [INFO ] [MAIN ] RDDT: Loaded 54563 primary data records. [2025-09-29T02:21:36.780356] [DEBUG] [LOCAL ] RDN: Loaded 45976 existing records from primary storage. [2025-09-29T02:21:36.793731] [INFO ] [MAIN ] RDN: Loaded 45976 primary data records. [2025-09-29T02:21:37.366953] [DEBUG] [MAIN ] RCUS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:37.368018] [INFO ] [MAIN ] RCUS: Generated 1820 derivative records from 43206 primary records. [2025-09-29T02:21:37.369838] [DEBUG] [LOCAL ] RCUS: Saving derivative data. [2025-09-29T02:21:37.388246] [DEBUG] [LOCAL ] RCUS: Derivative data saved (1820 records). [2025-09-29T02:21:37.389353] [INFO ] [MAIN ] RCUS: Successfully saved derivative data. [2025-09-29T02:21:37.392489] [INFO ] [MAIN ] Derivative Progress: 1657/2211 symbols completed. RCUS took 1.3s. Estimated remaining: 3m 54s. Rate: 141.9 symbols/min [2025-09-29T02:21:37.392933] [INFO ] [MAIN ] RDW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:37.416368] [DEBUG] [MAIN ] RDDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:37.417578] [INFO ] [MAIN ] RDDT: Generated 1820 derivative records from 54563 primary records. [2025-09-29T02:21:37.417832] [DEBUG] [LOCAL ] RDDT: Saving derivative data. [2025-09-29T02:21:37.439884] [DEBUG] [LOCAL ] RDDT: Derivative data saved (1820 records). [2025-09-29T02:21:37.440314] [INFO ] [MAIN ] RDDT: Successfully saved derivative data. [2025-09-29T02:21:37.445679] [INFO ] [MAIN ] Derivative Progress: 1658/2211 symbols completed. RDDT took 1.3s. Estimated remaining: 3m 54s. Rate: 142.0 symbols/min [2025-09-29T02:21:37.447927] [INFO ] [MAIN ] RDY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:37.463733] [DEBUG] [MAIN ] RDN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:37.479689] [INFO ] [MAIN ] RDN: Generated 1820 derivative records from 45976 primary records. [2025-09-29T02:21:37.480146] [DEBUG] [LOCAL ] RDN: Saving derivative data. [2025-09-29T02:21:37.499908] [DEBUG] [LOCAL ] RDN: Derivative data saved (1820 records). [2025-09-29T02:21:37.500233] [INFO ] [MAIN ] RDN: Successfully saved derivative data. [2025-09-29T02:21:37.517104] [INFO ] [MAIN ] Derivative Progress: 1659/2211 symbols completed. RDN took 1.3s. Estimated remaining: 3m 53s. Rate: 142.1 symbols/min [2025-09-29T02:21:37.519572] [INFO ] [MAIN ] RELX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:37.523489] [DEBUG] [LOCAL ] RDW: Loaded 52794 existing records from primary storage. [2025-09-29T02:21:37.523968] [INFO ] [MAIN ] RDW: Loaded 52794 primary data records. [2025-09-29T02:21:37.913445] [DEBUG] [LOCAL ] RDY: Loaded 47418 existing records from primary storage. [2025-09-29T02:21:37.938503] [INFO ] [MAIN ] RDY: Loaded 47418 primary data records. [2025-09-29T02:21:37.939592] [DEBUG] [LOCAL ] RELX: Loaded 48567 existing records from primary storage. [2025-09-29T02:21:37.940125] [INFO ] [MAIN ] RELX: Loaded 48567 primary data records. [2025-09-29T02:21:38.711122] [DEBUG] [MAIN ] RDW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:38.713238] [INFO ] [MAIN ] RDW: Generated 1820 derivative records from 52794 primary records. [2025-09-29T02:21:38.713398] [DEBUG] [LOCAL ] RDW: Saving derivative data. [2025-09-29T02:21:38.733034] [DEBUG] [LOCAL ] RDW: Derivative data saved (1820 records). [2025-09-29T02:21:38.734010] [INFO ] [MAIN ] RDW: Successfully saved derivative data. [2025-09-29T02:21:38.737842] [INFO ] [MAIN ] Derivative Progress: 1660/2211 symbols completed. RDW took 1.3s. Estimated remaining: 3m 53s. Rate: 141.9 symbols/min [2025-09-29T02:21:38.738743] [INFO ] [MAIN ] RERE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:38.767117] [DEBUG] [MAIN ] RDY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:38.781363] [DEBUG] [MAIN ] RELX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:38.780968] [INFO ] [MAIN ] RDY: Generated 1820 derivative records from 47418 primary records. [2025-09-29T02:21:38.782539] [INFO ] [MAIN ] RELX: Generated 1820 derivative records from 48567 primary records. [2025-09-29T02:21:38.782735] [DEBUG] [LOCAL ] RDY: Saving derivative data. [2025-09-29T02:21:38.782838] [DEBUG] [LOCAL ] RELX: Saving derivative data. [2025-09-29T02:21:38.827932] [DEBUG] [LOCAL ] RDY: Derivative data saved (1820 records). [2025-09-29T02:21:38.829343] [DEBUG] [LOCAL ] RELX: Derivative data saved (1820 records). [2025-09-29T02:21:38.829420] [INFO ] [MAIN ] RDY: Successfully saved derivative data. [2025-09-29T02:21:38.829518] [INFO ] [MAIN ] RELX: Successfully saved derivative data. [2025-09-29T02:21:38.832550] [INFO ] [MAIN ] Derivative Progress: 1661/2211 symbols completed. RELX took 1.3s. Estimated remaining: 3m 52s. Rate: 142.0 symbols/min [2025-09-29T02:21:38.836482] [INFO ] [MAIN ] RES: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:38.836728] [INFO ] [MAIN ] Derivative Progress: 1662/2211 symbols completed. RDY took 1.4s. Estimated remaining: 3m 52s. Rate: 142.1 symbols/min [2025-09-29T02:21:38.849865] [INFO ] [MAIN ] REVG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:38.851425] [DEBUG] [LOCAL ] RERE: Loaded 41690 existing records from primary storage. [2025-09-29T02:21:38.851800] [INFO ] [MAIN ] RERE: Loaded 41690 primary data records. [2025-09-29T02:21:39.270422] [DEBUG] [LOCAL ] REVG: Loaded 41461 existing records from primary storage. [2025-09-29T02:21:39.272258] [DEBUG] [LOCAL ] RES: Loaded 48190 existing records from primary storage. [2025-09-29T02:21:39.272362] [INFO ] [MAIN ] REVG: Loaded 41461 primary data records. [2025-09-29T02:21:39.272951] [INFO ] [MAIN ] RES: Loaded 48190 primary data records. [2025-09-29T02:21:39.990799] [DEBUG] [MAIN ] RERE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:39.993505] [INFO ] [MAIN ] RERE: Generated 1820 derivative records from 41690 primary records. [2025-09-29T02:21:39.993951] [DEBUG] [LOCAL ] RERE: Saving derivative data. [2025-09-29T02:21:40.013590] [DEBUG] [LOCAL ] RERE: Derivative data saved (1820 records). [2025-09-29T02:21:40.015318] [INFO ] [MAIN ] RERE: Successfully saved derivative data. [2025-09-29T02:21:40.018239] [INFO ] [MAIN ] Derivative Progress: 1663/2211 symbols completed. RERE took 1.3s. Estimated remaining: 3m 52s. Rate: 141.9 symbols/min [2025-09-29T02:21:40.043486] [DEBUG] [MAIN ] RES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:40.046270] [INFO ] [MAIN ] RES: Generated 1820 derivative records from 48190 primary records. [2025-09-29T02:21:40.046393] [DEBUG] [LOCAL ] RES: Saving derivative data. [2025-09-29T02:21:40.086881] [DEBUG] [LOCAL ] RES: Derivative data saved (1820 records). [2025-09-29T02:21:40.087410] [INFO ] [MAIN ] RES: Successfully saved derivative data. [2025-09-29T02:21:40.091405] [INFO ] [MAIN ] Derivative Progress: 1664/2211 symbols completed. RES took 1.3s. Estimated remaining: 3m 51s. Rate: 142.0 symbols/min [2025-09-29T02:21:40.087960] [DEBUG] [MAIN ] REVG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:40.092899] [INFO ] [MAIN ] REVG: Generated 1820 derivative records from 41461 primary records. [2025-09-29T02:21:40.093028] [DEBUG] [LOCAL ] REVG: Saving derivative data. [2025-09-29T02:21:40.119582] [DEBUG] [LOCAL ] REVG: Derivative data saved (1820 records). [2025-09-29T02:21:40.119821] [INFO ] [MAIN ] REVG: Successfully saved derivative data. [2025-09-29T02:21:40.123340] [INFO ] [MAIN ] Derivative Progress: 1665/2211 symbols completed. REVG took 1.3s. Estimated remaining: 3m 51s. Rate: 142.1 symbols/min [2025-09-29T02:21:40.124073] [INFO ] [MAIN ] REXR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:40.123973] [INFO ] [MAIN ] REX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:40.124164] [INFO ] [MAIN ] REZI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:40.150639] [DEBUG] [LOCAL ] REX: Loaded 14221 existing records from primary storage. [2025-09-29T02:21:40.151413] [INFO ] [MAIN ] REX: Loaded 14221 primary data records. [2025-09-29T02:21:40.607736] [DEBUG] [LOCAL ] REZI: Loaded 47576 existing records from primary storage. [2025-09-29T02:21:40.605939] [DEBUG] [LOCAL ] REXR: Loaded 52852 existing records from primary storage. [2025-09-29T02:21:40.608263] [INFO ] [MAIN ] REZI: Loaded 47576 primary data records. [2025-09-29T02:21:40.608507] [INFO ] [MAIN ] REXR: Loaded 52852 primary data records. [2025-09-29T02:21:41.400458] [DEBUG] [MAIN ] REX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:41.401711] [INFO ] [MAIN ] REX: Generated 1820 derivative records from 14221 primary records. [2025-09-29T02:21:41.403200] [DEBUG] [LOCAL ] REX: Saving derivative data. [2025-09-29T02:21:41.424538] [DEBUG] [LOCAL ] REX: Derivative data saved (1820 records). [2025-09-29T02:21:41.425096] [INFO ] [MAIN ] REX: Successfully saved derivative data. [2025-09-29T02:21:41.427947] [INFO ] [MAIN ] Derivative Progress: 1666/2211 symbols completed. REX took 1.3s. Estimated remaining: 3m 50s. Rate: 141.9 symbols/min [2025-09-29T02:21:41.428294] [INFO ] [MAIN ] RF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:41.447034] [DEBUG] [MAIN ] REZI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:41.448335] [INFO ] [MAIN ] REZI: Generated 1820 derivative records from 47576 primary records. [2025-09-29T02:21:41.448786] [DEBUG] [LOCAL ] REZI: Saving derivative data. [2025-09-29T02:21:41.472297] [DEBUG] [LOCAL ] REZI: Derivative data saved (1820 records). [2025-09-29T02:21:41.486126] [INFO ] [MAIN ] REZI: Successfully saved derivative data. [2025-09-29T02:21:41.485960] [DEBUG] [MAIN ] REXR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:41.490017] [INFO ] [MAIN ] REXR: Generated 1820 derivative records from 52852 primary records. [2025-09-29T02:21:41.490234] [DEBUG] [LOCAL ] REXR: Saving derivative data. [2025-09-29T02:21:41.489110] [INFO ] [MAIN ] Derivative Progress: 1667/2211 symbols completed. REZI took 1.4s. Estimated remaining: 3m 50s. Rate: 142.0 symbols/min [2025-09-29T02:21:41.491521] [INFO ] [MAIN ] RFI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:41.510564] [DEBUG] [LOCAL ] REXR: Derivative data saved (1820 records). [2025-09-29T02:21:41.510713] [INFO ] [MAIN ] REXR: Successfully saved derivative data. [2025-09-29T02:21:41.513496] [INFO ] [MAIN ] Derivative Progress: 1668/2211 symbols completed. REXR took 1.4s. Estimated remaining: 3m 49s. Rate: 142.0 symbols/min [2025-09-29T02:21:41.513968] [INFO ] [MAIN ] RFL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:41.543461] [DEBUG] [LOCAL ] RFI: Loaded 10550 existing records from primary storage. [2025-09-29T02:21:41.545805] [INFO ] [MAIN ] RFI: Loaded 10550 primary data records. [2025-09-29T02:21:41.631523] [DEBUG] [LOCAL ] RF: Loaded 54410 existing records from primary storage. [2025-09-29T02:21:41.632026] [DEBUG] [LOCAL ] RFL: Loaded 11051 existing records from primary storage. [2025-09-29T02:21:41.671749] [INFO ] [MAIN ] RFL: Loaded 11051 primary data records. [2025-09-29T02:21:41.672055] [INFO ] [MAIN ] RF: Loaded 54410 primary data records. [2025-09-29T02:21:42.609479] [DEBUG] [MAIN ] RFI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:42.611008] [INFO ] [MAIN ] RFI: Generated 1820 derivative records from 10550 primary records. [2025-09-29T02:21:42.611454] [DEBUG] [LOCAL ] RFI: Saving derivative data. [2025-09-29T02:21:42.652731] [DEBUG] [LOCAL ] RFI: Derivative data saved (1820 records). [2025-09-29T02:21:42.653733] [INFO ] [MAIN ] RFI: Successfully saved derivative data. [2025-09-29T02:21:42.653329] [DEBUG] [MAIN ] RF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:42.655984] [INFO ] [MAIN ] Derivative Progress: 1669/2211 symbols completed. RFI took 1.2s. Estimated remaining: 3m 49s. Rate: 141.9 symbols/min [2025-09-29T02:21:42.656254] [INFO ] [MAIN ] RFM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:42.670722] [INFO ] [MAIN ] RF: Generated 1820 derivative records from 54410 primary records. [2025-09-29T02:21:42.671157] [DEBUG] [MAIN ] RFL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:42.671302] [DEBUG] [LOCAL ] RF: Saving derivative data. [2025-09-29T02:21:42.672612] [INFO ] [MAIN ] RFL: Generated 1820 derivative records from 11051 primary records. [2025-09-29T02:21:42.673778] [DEBUG] [LOCAL ] RFL: Saving derivative data. [2025-09-29T02:21:42.700660] [DEBUG] [LOCAL ] RFL: Derivative data saved (1820 records). [2025-09-29T02:21:42.705401] [INFO ] [MAIN ] RFL: Successfully saved derivative data. [2025-09-29T02:21:42.708208] [INFO ] [MAIN ] Derivative Progress: 1670/2211 symbols completed. RFL took 1.2s. Estimated remaining: 3m 49s. Rate: 142.0 symbols/min [2025-09-29T02:21:42.712198] [DEBUG] [LOCAL ] RFM: Loaded 4196 existing records from primary storage. [2025-09-29T02:21:42.711890] [INFO ] [MAIN ] RFMZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:42.715380] [DEBUG] [LOCAL ] RF: Derivative data saved (1820 records). [2025-09-29T02:21:42.715772] [INFO ] [MAIN ] RFM: Loaded 4196 primary data records. [2025-09-29T02:21:42.716424] [INFO ] [MAIN ] RF: Successfully saved derivative data. [2025-09-29T02:21:42.724605] [INFO ] [MAIN ] Derivative Progress: 1671/2211 symbols completed. RF took 1.3s. Estimated remaining: 3m 48s. Rate: 142.1 symbols/min [2025-09-29T02:21:42.742859] [INFO ] [MAIN ] RGA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:42.801093] [DEBUG] [LOCAL ] RFMZ: Loaded 8822 existing records from primary storage. [2025-09-29T02:21:42.826897] [INFO ] [MAIN ] RFMZ: Loaded 8822 primary data records. [2025-09-29T02:21:43.229148] [DEBUG] [LOCAL ] RGA: Loaded 30535 existing records from primary storage. [2025-09-29T02:21:43.292164] [INFO ] [MAIN ] RGA: Loaded 30535 primary data records. [2025-09-29T02:21:43.829174] [DEBUG] [MAIN ] RFM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:43.831521] [INFO ] [MAIN ] RFM: Generated 1820 derivative records from 4196 primary records. [2025-09-29T02:21:43.831901] [DEBUG] [LOCAL ] RFM: Saving derivative data. [2025-09-29T02:21:43.867108] [DEBUG] [MAIN ] RFMZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:43.868130] [DEBUG] [LOCAL ] RFM: Derivative data saved (1820 records). [2025-09-29T02:21:43.869698] [INFO ] [MAIN ] RFM: Successfully saved derivative data. [2025-09-29T02:21:43.872109] [INFO ] [MAIN ] Derivative Progress: 1672/2211 symbols completed. RFM took 1.2s. Estimated remaining: 3m 48s. Rate: 141.9 symbols/min [2025-09-29T02:21:43.869577] [INFO ] [MAIN ] RFMZ: Generated 1820 derivative records from 8822 primary records. [2025-09-29T02:21:43.872464] [INFO ] [MAIN ] RGR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:43.873240] [DEBUG] [LOCAL ] RFMZ: Saving derivative data. [2025-09-29T02:21:43.910690] [DEBUG] [LOCAL ] RFMZ: Derivative data saved (1820 records). [2025-09-29T02:21:43.911250] [DEBUG] [MAIN ] RGA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:43.912328] [INFO ] [MAIN ] RGA: Generated 1820 derivative records from 30535 primary records. [2025-09-29T02:21:43.911542] [INFO ] [MAIN ] RFMZ: Successfully saved derivative data. [2025-09-29T02:21:43.916068] [INFO ] [MAIN ] Derivative Progress: 1673/2211 symbols completed. RFMZ took 1.2s. Estimated remaining: 3m 47s. Rate: 142.0 symbols/min [2025-09-29T02:21:43.916304] [INFO ] [MAIN ] RGT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:43.912440] [DEBUG] [LOCAL ] RGA: Saving derivative data. [2025-09-29T02:21:43.940747] [DEBUG] [LOCAL ] RGA: Derivative data saved (1820 records). [2025-09-29T02:21:43.941373] [INFO ] [MAIN ] RGA: Successfully saved derivative data. [2025-09-29T02:21:43.944432] [INFO ] [MAIN ] Derivative Progress: 1674/2211 symbols completed. RGA took 1.2s. Estimated remaining: 3m 47s. Rate: 142.1 symbols/min [2025-09-29T02:21:43.947404] [DEBUG] [LOCAL ] RGT: Loaded 2885 existing records from primary storage. [2025-09-29T02:21:43.947551] [INFO ] [MAIN ] RH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:43.947855] [INFO ] [MAIN ] RGT: Loaded 2885 primary data records. [2025-09-29T02:21:43.975985] [DEBUG] [LOCAL ] RGR: Loaded 20706 existing records from primary storage. [2025-09-29T02:21:43.995142] [INFO ] [MAIN ] RGR: Loaded 20706 primary data records. [2025-09-29T02:21:44.655154] [DEBUG] [LOCAL ] RH: Loaded 48340 existing records from primary storage. [2025-09-29T02:21:44.656263] [INFO ] [MAIN ] RH: Loaded 48340 primary data records. [2025-09-29T02:21:45.063907] [DEBUG] [MAIN ] RGT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:45.064815] [INFO ] [MAIN ] RGT: Generated 1820 derivative records from 2885 primary records. [2025-09-29T02:21:45.066370] [DEBUG] [LOCAL ] RGT: Saving derivative data. [2025-09-29T02:21:45.086310] [DEBUG] [LOCAL ] RGT: Derivative data saved (1820 records). [2025-09-29T02:21:45.094763] [INFO ] [MAIN ] RGT: Successfully saved derivative data. [2025-09-29T02:21:45.097538] [INFO ] [MAIN ] Derivative Progress: 1675/2211 symbols completed. RGT took 1.2s. Estimated remaining: 3m 47s. Rate: 141.9 symbols/min [2025-09-29T02:21:45.097943] [INFO ] [MAIN ] RHI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:45.105454] [DEBUG] [MAIN ] RGR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:45.106575] [INFO ] [MAIN ] RGR: Generated 1820 derivative records from 20706 primary records. [2025-09-29T02:21:45.107174] [DEBUG] [LOCAL ] RGR: Saving derivative data. [2025-09-29T02:21:45.127339] [DEBUG] [LOCAL ] RGR: Derivative data saved (1820 records). [2025-09-29T02:21:45.129676] [INFO ] [MAIN ] RGR: Successfully saved derivative data. [2025-09-29T02:21:45.132900] [INFO ] [MAIN ] Derivative Progress: 1676/2211 symbols completed. RGR took 1.3s. Estimated remaining: 3m 46s. Rate: 142.0 symbols/min [2025-09-29T02:21:45.133418] [INFO ] [MAIN ] RHP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:45.148127] [DEBUG] [MAIN ] RH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:45.148978] [INFO ] [MAIN ] RH: Generated 1820 derivative records from 48340 primary records. [2025-09-29T02:21:45.149072] [DEBUG] [LOCAL ] RH: Saving derivative data. [2025-09-29T02:21:45.165921] [DEBUG] [LOCAL ] RH: Derivative data saved (1820 records). [2025-09-29T02:21:45.166172] [INFO ] [MAIN ] RH: Successfully saved derivative data. [2025-09-29T02:21:45.168798] [INFO ] [MAIN ] Derivative Progress: 1677/2211 symbols completed. RH took 1.2s. Estimated remaining: 3m 46s. Rate: 142.1 symbols/min [2025-09-29T02:21:45.169120] [INFO ] [MAIN ] RIG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:45.216219] [DEBUG] [LOCAL ] RHI: Loaded 49995 existing records from primary storage. [2025-09-29T02:21:45.216476] [INFO ] [MAIN ] RHI: Loaded 49995 primary data records. [2025-09-29T02:21:45.439115] [DEBUG] [LOCAL ] RHP: Loaded 42305 existing records from primary storage. [2025-09-29T02:21:45.460584] [INFO ] [MAIN ] RHP: Loaded 42305 primary data records. [2025-09-29T02:21:45.594730] [DEBUG] [LOCAL ] RIG: Loaded 54449 existing records from primary storage. [2025-09-29T02:21:45.611173] [INFO ] [MAIN ] RIG: Loaded 54449 primary data records. [2025-09-29T02:21:46.315838] [DEBUG] [MAIN ] RHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:46.316860] [INFO ] [MAIN ] RHI: Generated 1820 derivative records from 49995 primary records. [2025-09-29T02:21:46.317512] [DEBUG] [LOCAL ] RHI: Saving derivative data. [2025-09-29T02:21:46.336567] [DEBUG] [LOCAL ] RHI: Derivative data saved (1820 records). [2025-09-29T02:21:46.338890] [INFO ] [MAIN ] RHI: Successfully saved derivative data. [2025-09-29T02:21:46.342521] [INFO ] [MAIN ] Derivative Progress: 1678/2211 symbols completed. RHI took 1.2s. Estimated remaining: 3m 45s. Rate: 141.9 symbols/min [2025-09-29T02:21:46.357410] [DEBUG] [MAIN ] RHP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:46.359399] [INFO ] [MAIN ] RHP: Generated 1820 derivative records from 42305 primary records. [2025-09-29T02:21:46.360442] [DEBUG] [LOCAL ] RHP: Saving derivative data. [2025-09-29T02:21:46.383850] [DEBUG] [MAIN ] RIG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:46.389708] [INFO ] [MAIN ] RIG: Generated 1820 derivative records from 54449 primary records. [2025-09-29T02:21:46.392234] [DEBUG] [LOCAL ] RIG: Saving derivative data. [2025-09-29T02:21:46.394203] [DEBUG] [LOCAL ] RHP: Derivative data saved (1820 records). [2025-09-29T02:21:46.395186] [INFO ] [MAIN ] RHP: Successfully saved derivative data. [2025-09-29T02:21:46.398243] [INFO ] [MAIN ] Derivative Progress: 1679/2211 symbols completed. RHP took 1.3s. Estimated remaining: 3m 45s. Rate: 142.0 symbols/min [2025-09-29T02:21:46.413896] [DEBUG] [LOCAL ] RIG: Derivative data saved (1820 records). [2025-09-29T02:21:46.414021] [INFO ] [MAIN ] RIG: Successfully saved derivative data. [2025-09-29T02:21:46.417286] [INFO ] [MAIN ] Derivative Progress: 1680/2211 symbols completed. RIG took 1.2s. Estimated remaining: 3m 44s. Rate: 142.1 symbols/min [2025-09-29T02:21:46.417839] [INFO ] [MAIN ] RIV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:46.417791] [INFO ] [MAIN ] RIO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:46.417916] [INFO ] [MAIN ] RITM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:46.438552] [DEBUG] [LOCAL ] RIV: Loaded 12193 existing records from primary storage. [2025-09-29T02:21:46.438830] [INFO ] [MAIN ] RIV: Loaded 12193 primary data records. [2025-09-29T02:21:46.843487] [DEBUG] [LOCAL ] RIO: Loaded 54173 existing records from primary storage. [2025-09-29T02:21:46.846682] [DEBUG] [LOCAL ] RITM: Loaded 53589 existing records from primary storage. [2025-09-29T02:21:46.846986] [INFO ] [MAIN ] RITM: Loaded 53589 primary data records. [2025-09-29T02:21:46.847057] [INFO ] [MAIN ] RIO: Loaded 54173 primary data records. [2025-09-29T02:21:47.614780] [DEBUG] [MAIN ] RIV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:47.617141] [INFO ] [MAIN ] RIV: Generated 1820 derivative records from 12193 primary records. [2025-09-29T02:21:47.617482] [DEBUG] [LOCAL ] RIV: Saving derivative data. [2025-09-29T02:21:47.639530] [DEBUG] [LOCAL ] RIV: Derivative data saved (1820 records). [2025-09-29T02:21:47.639964] [INFO ] [MAIN ] RIV: Successfully saved derivative data. [2025-09-29T02:21:47.643429] [INFO ] [MAIN ] Derivative Progress: 1681/2211 symbols completed. RIV took 1.2s. Estimated remaining: 3m 44s. Rate: 141.9 symbols/min [2025-09-29T02:21:47.644303] [INFO ] [MAIN ] RJF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:47.667034] [DEBUG] [MAIN ] RIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:47.668873] [INFO ] [MAIN ] RIO: Generated 1820 derivative records from 54173 primary records. [2025-09-29T02:21:47.669064] [DEBUG] [LOCAL ] RIO: Saving derivative data. [2025-09-29T02:21:47.703404] [DEBUG] [MAIN ] RITM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:47.703517] [DEBUG] [LOCAL ] RIO: Derivative data saved (1820 records). [2025-09-29T02:21:47.703980] [INFO ] [MAIN ] RIO: Successfully saved derivative data. [2025-09-29T02:21:47.705117] [INFO ] [MAIN ] RITM: Generated 1820 derivative records from 53589 primary records. [2025-09-29T02:21:47.708508] [DEBUG] [LOCAL ] RITM: Saving derivative data. [2025-09-29T02:21:47.708160] [INFO ] [MAIN ] Derivative Progress: 1682/2211 symbols completed. RIO took 1.3s. Estimated remaining: 3m 44s. Rate: 142.0 symbols/min [2025-09-29T02:21:47.709698] [INFO ] [MAIN ] RKT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:47.729921] [DEBUG] [LOCAL ] RITM: Derivative data saved (1820 records). [2025-09-29T02:21:47.742376] [INFO ] [MAIN ] RITM: Successfully saved derivative data. [2025-09-29T02:21:47.744925] [INFO ] [MAIN ] Derivative Progress: 1683/2211 symbols completed. RITM took 1.3s. Estimated remaining: 3m 43s. Rate: 142.1 symbols/min [2025-09-29T02:21:47.745389] [INFO ] [MAIN ] RL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:47.771682] [DEBUG] [LOCAL ] RJF: Loaded 47804 existing records from primary storage. [2025-09-29T02:21:47.772131] [INFO ] [MAIN ] RJF: Loaded 47804 primary data records. [2025-09-29T02:21:48.178881] [DEBUG] [LOCAL ] RL: Loaded 41998 existing records from primary storage. [2025-09-29T02:21:48.176008] [DEBUG] [LOCAL ] RKT: Loaded 54501 existing records from primary storage. [2025-09-29T02:21:48.179519] [INFO ] [MAIN ] RL: Loaded 41998 primary data records. [2025-09-29T02:21:48.179820] [INFO ] [MAIN ] RKT: Loaded 54501 primary data records. [2025-09-29T02:21:49.093936] [DEBUG] [MAIN ] RJF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:49.121134] [INFO ] [MAIN ] RJF: Generated 1820 derivative records from 47804 primary records. [2025-09-29T02:21:49.123717] [DEBUG] [LOCAL ] RJF: Saving derivative data. [2025-09-29T02:21:49.153112] [DEBUG] [LOCAL ] RJF: Derivative data saved (1820 records). [2025-09-29T02:21:49.154321] [INFO ] [MAIN ] RJF: Successfully saved derivative data. [2025-09-29T02:21:49.159777] [INFO ] [MAIN ] Derivative Progress: 1684/2211 symbols completed. RJF took 1.5s. Estimated remaining: 3m 43s. Rate: 141.9 symbols/min [2025-09-29T02:21:49.161010] [INFO ] [MAIN ] RLI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:49.203202] [DEBUG] [MAIN ] RL: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:21:49.208994] [INFO ] [MAIN ] RL: Generated 1819 derivative records from 41998 primary records. [2025-09-29T02:21:49.209690] [DEBUG] [LOCAL ] RL: Saving derivative data. [2025-09-29T02:21:49.258626] [DEBUG] [MAIN ] RKT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:49.277591] [INFO ] [MAIN ] RKT: Generated 1820 derivative records from 54501 primary records. [2025-09-29T02:21:49.281185] [DEBUG] [LOCAL ] RL: Derivative data saved (1819 records). [2025-09-29T02:21:49.281702] [DEBUG] [LOCAL ] RKT: Saving derivative data. [2025-09-29T02:21:49.282229] [INFO ] [MAIN ] RL: Successfully saved derivative data. [2025-09-29T02:21:49.289108] [DEBUG] [LOCAL ] RLI: Loaded 33794 existing records from primary storage. [2025-09-29T02:21:49.289868] [INFO ] [MAIN ] RLI: Loaded 33794 primary data records. [2025-09-29T02:21:49.287494] [INFO ] [MAIN ] Derivative Progress: 1685/2211 symbols completed. RL took 1.5s. Estimated remaining: 3m 42s. Rate: 141.9 symbols/min [2025-09-29T02:21:49.290204] [INFO ] [MAIN ] RLJ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:49.440922] [DEBUG] [LOCAL ] RKT: Derivative data saved (1820 records). [2025-09-29T02:21:49.458047] [INFO ] [MAIN ] RKT: Successfully saved derivative data. [2025-09-29T02:21:49.494741] [INFO ] [MAIN ] Derivative Progress: 1686/2211 symbols completed. RKT took 1.8s. Estimated remaining: 3m 42s. Rate: 142.0 symbols/min [2025-09-29T02:21:49.561186] [INFO ] [MAIN ] RLTY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:49.746056] [DEBUG] [LOCAL ] RLJ: Loaded 48922 existing records from primary storage. [2025-09-29T02:21:49.749565] [INFO ] [MAIN ] RLJ: Loaded 48922 primary data records. [2025-09-29T02:21:49.803445] [DEBUG] [LOCAL ] RLTY: Loaded 11255 existing records from primary storage. [2025-09-29T02:21:49.828282] [INFO ] [MAIN ] RLTY: Loaded 11255 primary data records. [2025-09-29T02:21:50.448802] [DEBUG] [MAIN ] RLI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:50.451278] [INFO ] [MAIN ] RLI: Generated 1820 derivative records from 33794 primary records. [2025-09-29T02:21:50.451834] [DEBUG] [LOCAL ] RLI: Saving derivative data. [2025-09-29T02:21:50.470988] [DEBUG] [LOCAL ] RLI: Derivative data saved (1820 records). [2025-09-29T02:21:50.471239] [INFO ] [MAIN ] RLI: Successfully saved derivative data. [2025-09-29T02:21:50.473953] [INFO ] [MAIN ] Derivative Progress: 1687/2211 symbols completed. RLI took 1.3s. Estimated remaining: 3m 42s. Rate: 141.9 symbols/min [2025-09-29T02:21:50.475959] [INFO ] [MAIN ] RLX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:50.501583] [DEBUG] [MAIN ] RLJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:50.502997] [INFO ] [MAIN ] RLJ: Generated 1820 derivative records from 48922 primary records. [2025-09-29T02:21:50.503355] [DEBUG] [LOCAL ] RLJ: Saving derivative data. [2025-09-29T02:21:50.518339] [DEBUG] [MAIN ] RLTY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:50.519554] [INFO ] [MAIN ] RLTY: Generated 1820 derivative records from 11255 primary records. [2025-09-29T02:21:50.520042] [DEBUG] [LOCAL ] RLTY: Saving derivative data. [2025-09-29T02:21:50.550701] [DEBUG] [LOCAL ] RLJ: Derivative data saved (1820 records). [2025-09-29T02:21:50.566668] [DEBUG] [LOCAL ] RLTY: Derivative data saved (1820 records). [2025-09-29T02:21:50.566887] [INFO ] [MAIN ] RLTY: Successfully saved derivative data. [2025-09-29T02:21:50.567008] [INFO ] [MAIN ] RLJ: Successfully saved derivative data. [2025-09-29T02:21:50.570528] [INFO ] [MAIN ] Derivative Progress: 1688/2211 symbols completed. RLTY took 1.0s. Estimated remaining: 3m 41s. Rate: 141.9 symbols/min [2025-09-29T02:21:50.573825] [INFO ] [MAIN ] Derivative Progress: 1689/2211 symbols completed. RLJ took 1.3s. Estimated remaining: 3m 41s. Rate: 142.0 symbols/min [2025-09-29T02:21:50.573725] [INFO ] [MAIN ] RM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:50.574291] [INFO ] [MAIN ] RMAX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:50.598122] [DEBUG] [LOCAL ] RLX: Loaded 48987 existing records from primary storage. [2025-09-29T02:21:50.598710] [INFO ] [MAIN ] RLX: Loaded 48987 primary data records. [2025-09-29T02:21:50.699378] [DEBUG] [LOCAL ] RM: Loaded 7734 existing records from primary storage. [2025-09-29T02:21:50.719268] [INFO ] [MAIN ] RM: Loaded 7734 primary data records. [2025-09-29T02:21:50.742696] [DEBUG] [LOCAL ] RMAX: Loaded 22121 existing records from primary storage. [2025-09-29T02:21:50.743341] [INFO ] [MAIN ] RMAX: Loaded 22121 primary data records. [2025-09-29T02:21:51.683722] [DEBUG] [MAIN ] RLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:51.684810] [INFO ] [MAIN ] RLX: Generated 1820 derivative records from 48987 primary records. [2025-09-29T02:21:51.685404] [DEBUG] [LOCAL ] RLX: Saving derivative data. [2025-09-29T02:21:51.705193] [DEBUG] [MAIN ] RM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:51.708454] [INFO ] [MAIN ] RM: Generated 1820 derivative records from 7734 primary records. [2025-09-29T02:21:51.717617] [DEBUG] [LOCAL ] RM: Saving derivative data. [2025-09-29T02:21:51.757028] [DEBUG] [LOCAL ] RLX: Derivative data saved (1820 records). [2025-09-29T02:21:51.757973] [DEBUG] [LOCAL ] RM: Derivative data saved (1820 records). [2025-09-29T02:21:51.758180] [INFO ] [MAIN ] RM: Successfully saved derivative data. [2025-09-29T02:21:51.754246] [DEBUG] [MAIN ] RMAX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:51.758366] [INFO ] [MAIN ] RLX: Successfully saved derivative data. [2025-09-29T02:21:51.761952] [INFO ] [MAIN ] RMAX: Generated 1820 derivative records from 22121 primary records. [2025-09-29T02:21:51.760936] [INFO ] [MAIN ] Derivative Progress: 1690/2211 symbols completed. RM took 1.2s. Estimated remaining: 3m 40s. Rate: 141.9 symbols/min [2025-09-29T02:21:51.765155] [INFO ] [MAIN ] RMD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:51.765573] [INFO ] [MAIN ] Derivative Progress: 1691/2211 symbols completed. RLX took 1.3s. Estimated remaining: 3m 40s. Rate: 141.9 symbols/min [2025-09-29T02:21:51.765422] [DEBUG] [LOCAL ] RMAX: Saving derivative data. [2025-09-29T02:21:51.766303] [INFO ] [MAIN ] RMI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:51.785371] [DEBUG] [LOCAL ] RMAX: Derivative data saved (1820 records). [2025-09-29T02:21:51.787008] [INFO ] [MAIN ] RMAX: Successfully saved derivative data. [2025-09-29T02:21:51.790066] [INFO ] [MAIN ] Derivative Progress: 1692/2211 symbols completed. RMAX took 1.2s. Estimated remaining: 3m 39s. Rate: 142.0 symbols/min [2025-09-29T02:21:51.790317] [INFO ] [MAIN ] RMM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:51.794977] [DEBUG] [LOCAL ] RMI: Loaded 4716 existing records from primary storage. [2025-09-29T02:21:51.795154] [INFO ] [MAIN ] RMI: Loaded 4716 primary data records. [2025-09-29T02:21:51.913971] [DEBUG] [LOCAL ] RMM: Loaded 10624 existing records from primary storage. [2025-09-29T02:21:51.939814] [INFO ] [MAIN ] RMM: Loaded 10624 primary data records. [2025-09-29T02:21:52.060228] [DEBUG] [LOCAL ] RMD: Loaded 42855 existing records from primary storage. [2025-09-29T02:21:52.156692] [INFO ] [MAIN ] RMD: Loaded 42855 primary data records. [2025-09-29T02:21:52.943804] [DEBUG] [MAIN ] RMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:52.946089] [INFO ] [MAIN ] RMI: Generated 1820 derivative records from 4716 primary records. [2025-09-29T02:21:52.946941] [DEBUG] [LOCAL ] RMI: Saving derivative data. [2025-09-29T02:21:52.967530] [DEBUG] [LOCAL ] RMI: Derivative data saved (1820 records). [2025-09-29T02:21:52.969412] [INFO ] [MAIN ] RMI: Successfully saved derivative data. [2025-09-29T02:21:52.972044] [INFO ] [MAIN ] Derivative Progress: 1693/2211 symbols completed. RMI took 1.2s. Estimated remaining: 3m 39s. Rate: 141.9 symbols/min [2025-09-29T02:21:52.988141] [DEBUG] [MAIN ] RMM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:52.989187] [INFO ] [MAIN ] RMM: Generated 1820 derivative records from 10624 primary records. [2025-09-29T02:21:52.989425] [DEBUG] [LOCAL ] RMM: Saving derivative data. [2025-09-29T02:21:53.011444] [DEBUG] [LOCAL ] RMM: Derivative data saved (1820 records). [2025-09-29T02:21:53.011830] [INFO ] [MAIN ] RMM: Successfully saved derivative data. [2025-09-29T02:21:53.014677] [INFO ] [MAIN ] Derivative Progress: 1694/2211 symbols completed. RMM took 1.2s. Estimated remaining: 3m 39s. Rate: 141.9 symbols/min [2025-09-29T02:21:53.028257] [DEBUG] [MAIN ] RMD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:53.029027] [INFO ] [MAIN ] RMD: Generated 1820 derivative records from 42855 primary records. [2025-09-29T02:21:53.029121] [DEBUG] [LOCAL ] RMD: Saving derivative data. [2025-09-29T02:21:53.045860] [DEBUG] [LOCAL ] RMD: Derivative data saved (1820 records). [2025-09-29T02:21:53.046030] [INFO ] [MAIN ] RMD: Successfully saved derivative data. [2025-09-29T02:21:53.049458] [INFO ] [MAIN ] Derivative Progress: 1695/2211 symbols completed. RMD took 1.3s. Estimated remaining: 3m 38s. Rate: 142.0 symbols/min [2025-09-29T02:21:53.050023] [INFO ] [MAIN ] RMT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:53.050335] [INFO ] [MAIN ] RMMZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:53.050201] [INFO ] [MAIN ] RNG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:53.063724] [DEBUG] [LOCAL ] RMMZ: Loaded 4875 existing records from primary storage. [2025-09-29T02:21:53.064181] [INFO ] [MAIN ] RMMZ: Loaded 4875 primary data records. [2025-09-29T02:21:53.153363] [DEBUG] [LOCAL ] RMT: Loaded 17682 existing records from primary storage. [2025-09-29T02:21:53.174461] [INFO ] [MAIN ] RMT: Loaded 17682 primary data records. [2025-09-29T02:21:53.449206] [DEBUG] [LOCAL ] RNG: Loaded 48830 existing records from primary storage. [2025-09-29T02:21:53.510977] [INFO ] [MAIN ] RNG: Loaded 48830 primary data records. [2025-09-29T02:21:54.249032] [DEBUG] [MAIN ] RMMZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:54.253464] [INFO ] [MAIN ] RMMZ: Generated 1820 derivative records from 4875 primary records. [2025-09-29T02:21:54.267051] [DEBUG] [LOCAL ] RMMZ: Saving derivative data. [2025-09-29T02:21:54.267963] [DEBUG] [MAIN ] RMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:54.269471] [INFO ] [MAIN ] RMT: Generated 1820 derivative records from 17682 primary records. [2025-09-29T02:21:54.270535] [DEBUG] [LOCAL ] RMT: Saving derivative data. [2025-09-29T02:21:54.303984] [DEBUG] [LOCAL ] RMT: Derivative data saved (1820 records). [2025-09-29T02:21:54.305061] [DEBUG] [LOCAL ] RMMZ: Derivative data saved (1820 records). [2025-09-29T02:21:54.305916] [INFO ] [MAIN ] RMMZ: Successfully saved derivative data. [2025-09-29T02:21:54.305560] [INFO ] [MAIN ] RMT: Successfully saved derivative data. [2025-09-29T02:21:54.308800] [INFO ] [MAIN ] Derivative Progress: 1696/2211 symbols completed. RMT took 1.3s. Estimated remaining: 3m 38s. Rate: 141.9 symbols/min [2025-09-29T02:21:54.311738] [INFO ] [MAIN ] Derivative Progress: 1697/2211 symbols completed. RMMZ took 1.3s. Estimated remaining: 3m 37s. Rate: 141.9 symbols/min [2025-09-29T02:21:54.309166] [INFO ] [MAIN ] RNGR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:54.312930] [INFO ] [MAIN ] RNP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:54.331428] [DEBUG] [MAIN ] RNG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:54.332391] [INFO ] [MAIN ] RNG: Generated 1820 derivative records from 48830 primary records. [2025-09-29T02:21:54.332501] [DEBUG] [LOCAL ] RNG: Saving derivative data. [2025-09-29T02:21:54.360244] [DEBUG] [LOCAL ] RNG: Derivative data saved (1820 records). [2025-09-29T02:21:54.367170] [INFO ] [MAIN ] RNG: Successfully saved derivative data. [2025-09-29T02:21:54.371024] [DEBUG] [LOCAL ] RNP: Loaded 15940 existing records from primary storage. [2025-09-29T02:21:54.370210] [INFO ] [MAIN ] Derivative Progress: 1698/2211 symbols completed. RNG took 1.3s. Estimated remaining: 3m 37s. Rate: 142.0 symbols/min [2025-09-29T02:21:54.380722] [INFO ] [MAIN ] RNP: Loaded 15940 primary data records. [2025-09-29T02:21:54.381812] [DEBUG] [LOCAL ] RNGR: Loaded 20653 existing records from primary storage. [2025-09-29T02:21:54.380890] [INFO ] [MAIN ] RNR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:54.404589] [INFO ] [MAIN ] RNGR: Loaded 20653 primary data records. [2025-09-29T02:21:54.805193] [DEBUG] [LOCAL ] RNR: Loaded 34623 existing records from primary storage. [2025-09-29T02:21:54.955168] [INFO ] [MAIN ] RNR: Loaded 34623 primary data records. [2025-09-29T02:21:55.459605] [DEBUG] [MAIN ] RNP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:55.474201] [DEBUG] [MAIN ] RNGR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:55.476846] [INFO ] [MAIN ] RNGR: Generated 1820 derivative records from 20653 primary records. [2025-09-29T02:21:55.473982] [INFO ] [MAIN ] RNP: Generated 1820 derivative records from 15940 primary records. [2025-09-29T02:21:55.477082] [DEBUG] [LOCAL ] RNGR: Saving derivative data. [2025-09-29T02:21:55.478207] [DEBUG] [LOCAL ] RNP: Saving derivative data. [2025-09-29T02:21:55.511777] [DEBUG] [LOCAL ] RNGR: Derivative data saved (1820 records). [2025-09-29T02:21:55.516890] [DEBUG] [LOCAL ] RNP: Derivative data saved (1820 records). [2025-09-29T02:21:55.517211] [INFO ] [MAIN ] RNP: Successfully saved derivative data. [2025-09-29T02:21:55.517101] [INFO ] [MAIN ] RNGR: Successfully saved derivative data. [2025-09-29T02:21:55.520813] [INFO ] [MAIN ] Derivative Progress: 1699/2211 symbols completed. RNP took 1.2s. Estimated remaining: 3m 37s. Rate: 141.9 symbols/min [2025-09-29T02:21:55.525331] [INFO ] [MAIN ] RNST: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:55.525593] [INFO ] [MAIN ] Derivative Progress: 1700/2211 symbols completed. RNGR took 1.2s. Estimated remaining: 3m 36s. Rate: 141.9 symbols/min [2025-09-29T02:21:55.526479] [INFO ] [MAIN ] ROG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:55.546046] [DEBUG] [MAIN ] RNR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:55.548137] [INFO ] [MAIN ] RNR: Generated 1820 derivative records from 34623 primary records. [2025-09-29T02:21:55.548418] [DEBUG] [LOCAL ] RNR: Saving derivative data. [2025-09-29T02:21:55.575594] [DEBUG] [LOCAL ] RNR: Derivative data saved (1820 records). [2025-09-29T02:21:55.575858] [INFO ] [MAIN ] RNR: Successfully saved derivative data. [2025-09-29T02:21:55.579359] [INFO ] [MAIN ] Derivative Progress: 1701/2211 symbols completed. RNR took 1.2s. Estimated remaining: 3m 35s. Rate: 142.0 symbols/min [2025-09-29T02:21:55.579630] [INFO ] [MAIN ] ROK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:55.592630] [DEBUG] [LOCAL ] ROG: Loaded 23367 existing records from primary storage. [2025-09-29T02:21:55.593028] [INFO ] [MAIN ] ROG: Loaded 23367 primary data records. [2025-09-29T02:21:55.743688] [DEBUG] [LOCAL ] RNST: Loaded 37619 existing records from primary storage. [2025-09-29T02:21:55.743977] [INFO ] [MAIN ] RNST: Loaded 37619 primary data records. [2025-09-29T02:21:56.133681] [DEBUG] [LOCAL ] ROK: Loaded 44522 existing records from primary storage. [2025-09-29T02:21:56.140627] [INFO ] [MAIN ] ROK: Loaded 44522 primary data records. [2025-09-29T02:21:56.813093] [DEBUG] [MAIN ] ROG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:56.814486] [INFO ] [MAIN ] ROG: Generated 1820 derivative records from 23367 primary records. [2025-09-29T02:21:56.815090] [DEBUG] [LOCAL ] ROG: Saving derivative data. [2025-09-29T02:21:56.835024] [DEBUG] [LOCAL ] ROG: Derivative data saved (1820 records). [2025-09-29T02:21:56.836110] [INFO ] [MAIN ] ROG: Successfully saved derivative data. [2025-09-29T02:21:56.838953] [INFO ] [MAIN ] Derivative Progress: 1702/2211 symbols completed. ROG took 1.3s. Estimated remaining: 3m 35s. Rate: 141.9 symbols/min [2025-09-29T02:21:56.840453] [INFO ] [MAIN ] ROL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:56.864859] [DEBUG] [MAIN ] RNST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:56.865759] [INFO ] [MAIN ] RNST: Generated 1820 derivative records from 37619 primary records. [2025-09-29T02:21:56.865896] [DEBUG] [LOCAL ] RNST: Saving derivative data. [2025-09-29T02:21:56.882815] [DEBUG] [LOCAL ] RNST: Derivative data saved (1820 records). [2025-09-29T02:21:56.883037] [INFO ] [MAIN ] RNST: Successfully saved derivative data. [2025-09-29T02:21:56.887075] [INFO ] [MAIN ] Derivative Progress: 1703/2211 symbols completed. RNST took 1.4s. Estimated remaining: 3m 35s. Rate: 141.9 symbols/min [2025-09-29T02:21:56.887366] [INFO ] [MAIN ] RPM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:56.908124] [DEBUG] [MAIN ] ROK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:56.910068] [INFO ] [MAIN ] ROK: Generated 1820 derivative records from 44522 primary records. [2025-09-29T02:21:56.910517] [DEBUG] [LOCAL ] ROK: Saving derivative data. [2025-09-29T02:21:56.944309] [DEBUG] [LOCAL ] ROK: Derivative data saved (1820 records). [2025-09-29T02:21:56.944746] [INFO ] [MAIN ] ROK: Successfully saved derivative data. [2025-09-29T02:21:56.948705] [INFO ] [MAIN ] Derivative Progress: 1704/2211 symbols completed. ROK took 1.4s. Estimated remaining: 3m 34s. Rate: 142.0 symbols/min [2025-09-29T02:21:56.949067] [INFO ] [MAIN ] RPT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:56.971121] [DEBUG] [LOCAL ] ROL: Loaded 51031 existing records from primary storage. [2025-09-29T02:21:56.982711] [INFO ] [MAIN ] ROL: Loaded 51031 primary data records. [2025-09-29T02:21:57.122877] [DEBUG] [LOCAL ] RPT: Loaded 19767 existing records from primary storage. [2025-09-29T02:21:57.147268] [DEBUG] [LOCAL ] RPM: Loaded 41763 existing records from primary storage. [2025-09-29T02:21:57.158113] [INFO ] [MAIN ] RPM: Loaded 41763 primary data records. [2025-09-29T02:21:57.144833] [INFO ] [MAIN ] RPT: Loaded 19767 primary data records. [2025-09-29T02:21:58.166445] [DEBUG] [MAIN ] ROL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:58.168401] [INFO ] [MAIN ] ROL: Generated 1820 derivative records from 51031 primary records. [2025-09-29T02:21:58.169968] [DEBUG] [LOCAL ] ROL: Saving derivative data. [2025-09-29T02:21:58.200774] [DEBUG] [MAIN ] RPT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:58.203319] [INFO ] [MAIN ] RPT: Generated 1820 derivative records from 19767 primary records. [2025-09-29T02:21:58.204052] [DEBUG] [LOCAL ] RPT: Saving derivative data. [2025-09-29T02:21:58.226352] [DEBUG] [MAIN ] RPM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:58.239823] [INFO ] [MAIN ] RPM: Generated 1820 derivative records from 41763 primary records. [2025-09-29T02:21:58.244524] [DEBUG] [LOCAL ] RPT: Derivative data saved (1820 records). [2025-09-29T02:21:58.240983] [DEBUG] [LOCAL ] RPM: Saving derivative data. [2025-09-29T02:21:58.244708] [INFO ] [MAIN ] RPT: Successfully saved derivative data. [2025-09-29T02:21:58.248058] [INFO ] [MAIN ] Derivative Progress: 1705/2211 symbols completed. RPT took 1.3s. Estimated remaining: 3m 34s. Rate: 141.8 symbols/min [2025-09-29T02:21:58.248285] [INFO ] [MAIN ] RQI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:58.238233] [DEBUG] [LOCAL ] ROL: Derivative data saved (1820 records). [2025-09-29T02:21:58.249988] [INFO ] [MAIN ] ROL: Successfully saved derivative data. [2025-09-29T02:21:58.253598] [INFO ] [MAIN ] Derivative Progress: 1706/2211 symbols completed. ROL took 1.4s. Estimated remaining: 3m 34s. Rate: 141.9 symbols/min [2025-09-29T02:21:58.261811] [INFO ] [MAIN ] RRC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:58.271103] [DEBUG] [LOCAL ] RPM: Derivative data saved (1820 records). [2025-09-29T02:21:58.271343] [INFO ] [MAIN ] RPM: Successfully saved derivative data. [2025-09-29T02:21:58.275298] [INFO ] [MAIN ] Derivative Progress: 1707/2211 symbols completed. RPM took 1.4s. Estimated remaining: 3m 33s. Rate: 142.0 symbols/min [2025-09-29T02:21:58.277818] [INFO ] [MAIN ] RRX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:58.316179] [DEBUG] [LOCAL ] RQI: Loaded 29573 existing records from primary storage. [2025-09-29T02:21:58.316432] [INFO ] [MAIN ] RQI: Loaded 29573 primary data records. [2025-09-29T02:21:58.515255] [DEBUG] [LOCAL ] RRX: Loaded 41752 existing records from primary storage. [2025-09-29T02:21:58.544585] [DEBUG] [LOCAL ] RRC: Loaded 53554 existing records from primary storage. [2025-09-29T02:21:58.552696] [INFO ] [MAIN ] RRX: Loaded 41752 primary data records. [2025-09-29T02:21:58.554861] [INFO ] [MAIN ] RRC: Loaded 53554 primary data records. [2025-09-29T02:21:59.450085] [DEBUG] [MAIN ] RQI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:59.451603] [INFO ] [MAIN ] RQI: Generated 1820 derivative records from 29573 primary records. [2025-09-29T02:21:59.452125] [DEBUG] [LOCAL ] RQI: Saving derivative data. [2025-09-29T02:21:59.472676] [DEBUG] [LOCAL ] RQI: Derivative data saved (1820 records). [2025-09-29T02:21:59.473481] [INFO ] [MAIN ] RQI: Successfully saved derivative data. [2025-09-29T02:21:59.478744] [INFO ] [MAIN ] Derivative Progress: 1708/2211 symbols completed. RQI took 1.2s. Estimated remaining: 3m 33s. Rate: 141.8 symbols/min [2025-09-29T02:21:59.495176] [DEBUG] [MAIN ] RRX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:59.496331] [INFO ] [MAIN ] RRX: Generated 1820 derivative records from 41752 primary records. [2025-09-29T02:21:59.496553] [DEBUG] [LOCAL ] RRX: Saving derivative data. [2025-09-29T02:21:59.526459] [DEBUG] [MAIN ] RRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:21:59.528731] [INFO ] [MAIN ] RRC: Generated 1820 derivative records from 53554 primary records. [2025-09-29T02:21:59.529351] [DEBUG] [LOCAL ] RRC: Saving derivative data. [2025-09-29T02:21:59.540569] [DEBUG] [LOCAL ] RRX: Derivative data saved (1820 records). [2025-09-29T02:21:59.544230] [INFO ] [MAIN ] RRX: Successfully saved derivative data. [2025-09-29T02:21:59.550362] [INFO ] [MAIN ] Derivative Progress: 1709/2211 symbols completed. RRX took 1.3s. Estimated remaining: 3m 32s. Rate: 141.9 symbols/min [2025-09-29T02:21:59.551697] [DEBUG] [LOCAL ] RRC: Derivative data saved (1820 records). [2025-09-29T02:21:59.551871] [INFO ] [MAIN ] RRC: Successfully saved derivative data. [2025-09-29T02:21:59.555038] [INFO ] [MAIN ] Derivative Progress: 1710/2211 symbols completed. RRC took 1.3s. Estimated remaining: 3m 32s. Rate: 142.0 symbols/min [2025-09-29T02:21:59.555594] [INFO ] [MAIN ] RS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:59.555675] [INFO ] [MAIN ] RSF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:59.555824] [INFO ] [MAIN ] RSG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:21:59.567305] [DEBUG] [LOCAL ] RSF: Loaded 4192 existing records from primary storage. [2025-09-29T02:21:59.567503] [INFO ] [MAIN ] RSF: Loaded 4192 primary data records. [2025-09-29T02:21:59.787571] [DEBUG] [LOCAL ] RS: Loaded 25864 existing records from primary storage. [2025-09-29T02:21:59.936480] [INFO ] [MAIN ] RS: Loaded 25864 primary data records. [2025-09-29T02:22:00.049253] [DEBUG] [LOCAL ] RSG: Loaded 48173 existing records from primary storage. [2025-09-29T02:22:00.072494] [INFO ] [MAIN ] RSG: Loaded 48173 primary data records. [2025-09-29T02:22:00.641255] [DEBUG] [MAIN ] RSF: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:22:00.642984] [INFO ] [MAIN ] RSF: Generated 1819 derivative records from 4192 primary records. [2025-09-29T02:22:00.643701] [DEBUG] [LOCAL ] RSF: Saving derivative data. [2025-09-29T02:22:00.661483] [DEBUG] [LOCAL ] RSF: Derivative data saved (1819 records). [2025-09-29T02:22:00.662315] [INFO ] [MAIN ] RSF: Successfully saved derivative data. [2025-09-29T02:22:00.665058] [INFO ] [MAIN ] Derivative Progress: 1711/2211 symbols completed. RSF took 1.1s. Estimated remaining: 3m 31s. Rate: 141.9 symbols/min [2025-09-29T02:22:00.665575] [INFO ] [MAIN ] RSI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:00.686360] [DEBUG] [MAIN ] RS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:00.687382] [INFO ] [MAIN ] RS: Generated 1820 derivative records from 25864 primary records. [2025-09-29T02:22:00.687628] [DEBUG] [LOCAL ] RS: Saving derivative data. [2025-09-29T02:22:00.709858] [DEBUG] [LOCAL ] RS: Derivative data saved (1820 records). [2025-09-29T02:22:00.718152] [INFO ] [MAIN ] RS: Successfully saved derivative data. [2025-09-29T02:22:00.726576] [INFO ] [MAIN ] Derivative Progress: 1712/2211 symbols completed. RS took 1.2s. Estimated remaining: 3m 31s. Rate: 141.9 symbols/min [2025-09-29T02:22:00.727401] [INFO ] [MAIN ] RSKD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:00.727064] [DEBUG] [MAIN ] RSG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:00.728472] [INFO ] [MAIN ] RSG: Generated 1820 derivative records from 48173 primary records. [2025-09-29T02:22:00.728931] [DEBUG] [LOCAL ] RSG: Saving derivative data. [2025-09-29T02:22:00.761514] [DEBUG] [LOCAL ] RSG: Derivative data saved (1820 records). [2025-09-29T02:22:00.761734] [INFO ] [MAIN ] RSG: Successfully saved derivative data. [2025-09-29T02:22:00.765493] [INFO ] [MAIN ] Derivative Progress: 1713/2211 symbols completed. RSG took 1.2s. Estimated remaining: 3m 30s. Rate: 142.0 symbols/min [2025-09-29T02:22:00.767093] [INFO ] [MAIN ] RTO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:00.782980] [DEBUG] [LOCAL ] RSI: Loaded 47695 existing records from primary storage. [2025-09-29T02:22:00.783417] [INFO ] [MAIN ] RSI: Loaded 47695 primary data records. [2025-09-29T02:22:00.932392] [DEBUG] [LOCAL ] RSKD: Loaded 34254 existing records from primary storage. [2025-09-29T02:22:00.932710] [INFO ] [MAIN ] RSKD: Loaded 34254 primary data records. [2025-09-29T02:22:01.320725] [DEBUG] [LOCAL ] RTO: Loaded 40847 existing records from primary storage. [2025-09-29T02:22:01.326622] [INFO ] [MAIN ] RTO: Loaded 40847 primary data records. [2025-09-29T02:22:01.925682] [DEBUG] [MAIN ] RSI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:01.927007] [INFO ] [MAIN ] RSI: Generated 1820 derivative records from 47695 primary records. [2025-09-29T02:22:01.927418] [DEBUG] [LOCAL ] RSI: Saving derivative data. [2025-09-29T02:22:01.948408] [DEBUG] [LOCAL ] RSI: Derivative data saved (1820 records). [2025-09-29T02:22:01.948779] [INFO ] [MAIN ] RSI: Successfully saved derivative data. [2025-09-29T02:22:01.951575] [INFO ] [MAIN ] Derivative Progress: 1714/2211 symbols completed. RSI took 1.3s. Estimated remaining: 3m 30s. Rate: 141.8 symbols/min [2025-09-29T02:22:01.966570] [INFO ] [MAIN ] RTX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:01.967217] [DEBUG] [MAIN ] RSKD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:01.968919] [INFO ] [MAIN ] RSKD: Generated 1820 derivative records from 34254 primary records. [2025-09-29T02:22:01.969254] [DEBUG] [LOCAL ] RSKD: Saving derivative data. [2025-09-29T02:22:02.010370] [DEBUG] [LOCAL ] RSKD: Derivative data saved (1820 records). [2025-09-29T02:22:02.009059] [DEBUG] [MAIN ] RTO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:02.011322] [INFO ] [MAIN ] RTO: Generated 1820 derivative records from 40847 primary records. [2025-09-29T02:22:02.011495] [INFO ] [MAIN ] RSKD: Successfully saved derivative data. [2025-09-29T02:22:02.011578] [DEBUG] [LOCAL ] RTO: Saving derivative data. [2025-09-29T02:22:02.014923] [INFO ] [MAIN ] Derivative Progress: 1715/2211 symbols completed. RSKD took 1.3s. Estimated remaining: 3m 30s. Rate: 141.9 symbols/min [2025-09-29T02:22:02.015948] [INFO ] [MAIN ] RVLV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:02.034181] [DEBUG] [LOCAL ] RTO: Derivative data saved (1820 records). [2025-09-29T02:22:02.034345] [INFO ] [MAIN ] RTO: Successfully saved derivative data. [2025-09-29T02:22:02.037879] [INFO ] [MAIN ] Derivative Progress: 1716/2211 symbols completed. RTO took 1.3s. Estimated remaining: 3m 29s. Rate: 142.0 symbols/min [2025-09-29T02:22:02.038305] [INFO ] [MAIN ] RVT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:02.113110] [DEBUG] [LOCAL ] RVT: Loaded 27362 existing records from primary storage. [2025-09-29T02:22:02.115583] [INFO ] [MAIN ] RVT: Loaded 27362 primary data records. [2025-09-29T02:22:02.114974] [DEBUG] [LOCAL ] RTX: Loaded 54488 existing records from primary storage. [2025-09-29T02:22:02.115951] [INFO ] [MAIN ] RTX: Loaded 54488 primary data records. [2025-09-29T02:22:02.270951] [DEBUG] [LOCAL ] RVLV: Loaded 48453 existing records from primary storage. [2025-09-29T02:22:02.293756] [INFO ] [MAIN ] RVLV: Loaded 48453 primary data records. [2025-09-29T02:22:03.242738] [DEBUG] [MAIN ] RVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:03.243718] [INFO ] [MAIN ] RVT: Generated 1820 derivative records from 27362 primary records. [2025-09-29T02:22:03.244019] [DEBUG] [LOCAL ] RVT: Saving derivative data. [2025-09-29T02:22:03.258141] [DEBUG] [MAIN ] RTX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:03.260228] [INFO ] [MAIN ] RTX: Generated 1820 derivative records from 54488 primary records. [2025-09-29T02:22:03.267911] [DEBUG] [LOCAL ] RTX: Saving derivative data. [2025-09-29T02:22:03.293557] [DEBUG] [LOCAL ] RTX: Derivative data saved (1820 records). [2025-09-29T02:22:03.295181] [INFO ] [MAIN ] RTX: Successfully saved derivative data. [2025-09-29T02:22:03.295629] [DEBUG] [LOCAL ] RVT: Derivative data saved (1820 records). [2025-09-29T02:22:03.299240] [INFO ] [MAIN ] RVT: Successfully saved derivative data. [2025-09-29T02:22:03.299093] [INFO ] [MAIN ] Derivative Progress: 1717/2211 symbols completed. RTX took 1.3s. Estimated remaining: 3m 29s. Rate: 141.8 symbols/min [2025-09-29T02:22:03.302266] [INFO ] [MAIN ] RVTY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:03.302335] [INFO ] [MAIN ] Derivative Progress: 1718/2211 symbols completed. RVT took 1.3s. Estimated remaining: 3m 28s. Rate: 141.9 symbols/min [2025-09-29T02:22:03.302698] [INFO ] [MAIN ] RWT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:03.328088] [DEBUG] [MAIN ] RVLV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:03.329381] [INFO ] [MAIN ] RVLV: Generated 1820 derivative records from 48453 primary records. [2025-09-29T02:22:03.329569] [DEBUG] [LOCAL ] RVLV: Saving derivative data. [2025-09-29T02:22:03.367183] [DEBUG] [LOCAL ] RVLV: Derivative data saved (1820 records). [2025-09-29T02:22:03.367375] [INFO ] [MAIN ] RVLV: Successfully saved derivative data. [2025-09-29T02:22:03.372489] [INFO ] [MAIN ] Derivative Progress: 1719/2211 symbols completed. RVLV took 1.4s. Estimated remaining: 3m 28s. Rate: 142.0 symbols/min [2025-09-29T02:22:03.372978] [INFO ] [MAIN ] RXO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:03.420974] [DEBUG] [LOCAL ] RWT: Loaded 41352 existing records from primary storage. [2025-09-29T02:22:03.421868] [INFO ] [MAIN ] RWT: Loaded 41352 primary data records. [2025-09-29T02:22:03.575329] [DEBUG] [LOCAL ] RVTY: Loaded 48199 existing records from primary storage. [2025-09-29T02:22:03.575631] [INFO ] [MAIN ] RVTY: Loaded 48199 primary data records. [2025-09-29T02:22:03.895529] [DEBUG] [LOCAL ] RXO: Loaded 48520 existing records from primary storage. [2025-09-29T02:22:03.920207] [INFO ] [MAIN ] RXO: Loaded 48520 primary data records. [2025-09-29T02:22:04.596517] [DEBUG] [MAIN ] RWT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:04.601019] [INFO ] [MAIN ] RWT: Generated 1820 derivative records from 41352 primary records. [2025-09-29T02:22:04.602358] [DEBUG] [LOCAL ] RWT: Saving derivative data. [2025-09-29T02:22:04.625998] [DEBUG] [LOCAL ] RWT: Derivative data saved (1820 records). [2025-09-29T02:22:04.626341] [INFO ] [MAIN ] RWT: Successfully saved derivative data. [2025-09-29T02:22:04.632236] [INFO ] [MAIN ] Derivative Progress: 1720/2211 symbols completed. RWT took 1.3s. Estimated remaining: 3m 28s. Rate: 141.8 symbols/min [2025-09-29T02:22:04.633559] [INFO ] [MAIN ] RY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:04.649778] [DEBUG] [MAIN ] RVTY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:04.651405] [INFO ] [MAIN ] RVTY: Generated 1820 derivative records from 48199 primary records. [2025-09-29T02:22:04.651868] [DEBUG] [LOCAL ] RVTY: Saving derivative data. [2025-09-29T02:22:04.683907] [DEBUG] [MAIN ] RXO: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:22:04.687109] [INFO ] [MAIN ] RXO: Generated 1819 derivative records from 48520 primary records. [2025-09-29T02:22:04.687485] [DEBUG] [LOCAL ] RXO: Saving derivative data. [2025-09-29T02:22:04.687955] [DEBUG] [LOCAL ] RVTY: Derivative data saved (1820 records). [2025-09-29T02:22:04.688532] [INFO ] [MAIN ] RVTY: Successfully saved derivative data. [2025-09-29T02:22:04.691915] [INFO ] [MAIN ] Derivative Progress: 1721/2211 symbols completed. RVTY took 1.4s. Estimated remaining: 3m 27s. Rate: 141.9 symbols/min [2025-09-29T02:22:04.692273] [INFO ] [MAIN ] RYAM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:04.709796] [DEBUG] [LOCAL ] RXO: Derivative data saved (1819 records). [2025-09-29T02:22:04.710046] [INFO ] [MAIN ] RXO: Successfully saved derivative data. [2025-09-29T02:22:04.712986] [INFO ] [MAIN ] Derivative Progress: 1722/2211 symbols completed. RXO took 1.3s. Estimated remaining: 3m 27s. Rate: 142.0 symbols/min [2025-09-29T02:22:04.713240] [INFO ] [MAIN ] RYAN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:04.780050] [DEBUG] [LOCAL ] RYAM: Loaded 35709 existing records from primary storage. [2025-09-29T02:22:04.781762] [DEBUG] [LOCAL ] RY: Loaded 48606 existing records from primary storage. [2025-09-29T02:22:04.780394] [INFO ] [MAIN ] RYAM: Loaded 35709 primary data records. [2025-09-29T02:22:04.781963] [INFO ] [MAIN ] RY: Loaded 48606 primary data records. [2025-09-29T02:22:05.073082] [DEBUG] [LOCAL ] RYAN: Loaded 44960 existing records from primary storage. [2025-09-29T02:22:05.135359] [INFO ] [MAIN ] RYAN: Loaded 44960 primary data records. [2025-09-29T02:22:05.925190] [DEBUG] [MAIN ] RYAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:05.940111] [INFO ] [MAIN ] RYAM: Generated 1820 derivative records from 35709 primary records. [2025-09-29T02:22:05.939060] [DEBUG] [MAIN ] RY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:05.941379] [INFO ] [MAIN ] RY: Generated 1820 derivative records from 48606 primary records. [2025-09-29T02:22:05.941682] [DEBUG] [LOCAL ] RYAM: Saving derivative data. [2025-09-29T02:22:05.942087] [DEBUG] [LOCAL ] RY: Saving derivative data. [2025-09-29T02:22:05.969083] [DEBUG] [LOCAL ] RYAM: Derivative data saved (1820 records). [2025-09-29T02:22:05.975705] [INFO ] [MAIN ] RYAM: Successfully saved derivative data. [2025-09-29T02:22:05.981149] [INFO ] [MAIN ] Derivative Progress: 1723/2211 symbols completed. RYAM took 1.3s. Estimated remaining: 3m 26s. Rate: 141.8 symbols/min [2025-09-29T02:22:05.982737] [DEBUG] [LOCAL ] RY: Derivative data saved (1820 records). [2025-09-29T02:22:05.984965] [INFO ] [MAIN ] RY: Successfully saved derivative data. [2025-09-29T02:22:05.988250] [INFO ] [MAIN ] Derivative Progress: 1724/2211 symbols completed. RY took 1.4s. Estimated remaining: 3m 26s. Rate: 141.9 symbols/min [2025-09-29T02:22:06.007209] [DEBUG] [MAIN ] RYAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:06.008335] [INFO ] [MAIN ] RYAN: Generated 1820 derivative records from 44960 primary records. [2025-09-29T02:22:06.008434] [DEBUG] [LOCAL ] RYAN: Saving derivative data. [2025-09-29T02:22:06.025182] [DEBUG] [LOCAL ] RYAN: Derivative data saved (1820 records). [2025-09-29T02:22:06.025313] [INFO ] [MAIN ] RYAN: Successfully saved derivative data. [2025-09-29T02:22:06.028253] [INFO ] [MAIN ] Derivative Progress: 1725/2211 symbols completed. RYAN took 1.3s. Estimated remaining: 3m 25s. Rate: 142.0 symbols/min [2025-09-29T02:22:06.029306] [INFO ] [MAIN ] RYI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:06.029458] [INFO ] [MAIN ] RZB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:06.029550] [INFO ] [MAIN ] RYN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:06.043246] [DEBUG] [LOCAL ] RZB: Loaded 6291 existing records from primary storage. [2025-09-29T02:22:06.043546] [INFO ] [MAIN ] RZB: Loaded 6291 primary data records. [2025-09-29T02:22:06.195979] [DEBUG] [LOCAL ] RYI: Loaded 21835 existing records from primary storage. [2025-09-29T02:22:06.196966] [INFO ] [MAIN ] RYI: Loaded 21835 primary data records. [2025-09-29T02:22:06.553829] [DEBUG] [LOCAL ] RYN: Loaded 46335 existing records from primary storage. [2025-09-29T02:22:06.560493] [INFO ] [MAIN ] RYN: Loaded 46335 primary data records. [2025-09-29T02:22:07.167271] [DEBUG] [MAIN ] RZB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:07.170076] [INFO ] [MAIN ] RZB: Generated 1820 derivative records from 6291 primary records. [2025-09-29T02:22:07.171288] [DEBUG] [LOCAL ] RZB: Saving derivative data. [2025-09-29T02:22:07.193203] [DEBUG] [LOCAL ] RZB: Derivative data saved (1820 records). [2025-09-29T02:22:07.207367] [INFO ] [MAIN ] RZB: Successfully saved derivative data. [2025-09-29T02:22:07.210789] [INFO ] [MAIN ] Derivative Progress: 1726/2211 symbols completed. RZB took 1.2s. Estimated remaining: 3m 25s. Rate: 141.8 symbols/min [2025-09-29T02:22:07.211323] [DEBUG] [MAIN ] RYI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:07.211584] [INFO ] [MAIN ] RZC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:07.212601] [INFO ] [MAIN ] RYI: Generated 1820 derivative records from 21835 primary records. [2025-09-29T02:22:07.213934] [DEBUG] [LOCAL ] RYI: Saving derivative data. [2025-09-29T02:22:07.245004] [DEBUG] [LOCAL ] RYI: Derivative data saved (1820 records). [2025-09-29T02:22:07.245326] [DEBUG] [LOCAL ] RZC: Loaded 6838 existing records from primary storage. [2025-09-29T02:22:07.246103] [INFO ] [MAIN ] RYI: Successfully saved derivative data. [2025-09-29T02:22:07.246226] [INFO ] [MAIN ] RZC: Loaded 6838 primary data records. [2025-09-29T02:22:07.254416] [INFO ] [MAIN ] Derivative Progress: 1727/2211 symbols completed. RYI took 1.2s. Estimated remaining: 3m 25s. Rate: 141.9 symbols/min [2025-09-29T02:22:07.264528] [DEBUG] [MAIN ] RYN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:07.264745] [INFO ] [MAIN ] S: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:07.278406] [INFO ] [MAIN ] RYN: Generated 1820 derivative records from 46335 primary records. [2025-09-29T02:22:07.290739] [DEBUG] [LOCAL ] RYN: Saving derivative data. [2025-09-29T02:22:07.401600] [DEBUG] [LOCAL ] RYN: Derivative data saved (1820 records). [2025-09-29T02:22:07.417610] [INFO ] [MAIN ] RYN: Successfully saved derivative data. [2025-09-29T02:22:07.436994] [INFO ] [MAIN ] Derivative Progress: 1728/2211 symbols completed. RYN took 1.4s. Estimated remaining: 3m 24s. Rate: 141.9 symbols/min [2025-09-29T02:22:07.459972] [INFO ] [MAIN ] SA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:07.725478] [DEBUG] [LOCAL ] S: Loaded 54315 existing records from primary storage. [2025-09-29T02:22:07.726180] [INFO ] [MAIN ] S: Loaded 54315 primary data records. [2025-09-29T02:22:07.900116] [DEBUG] [LOCAL ] SA: Loaded 43820 existing records from primary storage. [2025-09-29T02:22:07.943605] [INFO ] [MAIN ] SA: Loaded 43820 primary data records. [2025-09-29T02:22:07.976894] [DEBUG] [MAIN ] RZC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:07.990710] [INFO ] [MAIN ] RZC: Generated 1820 derivative records from 6838 primary records. [2025-09-29T02:22:08.169986] [DEBUG] [LOCAL ] RZC: Saving derivative data. [2025-09-29T02:22:08.345353] [DEBUG] [LOCAL ] RZC: Derivative data saved (1820 records). [2025-09-29T02:22:08.469933] [INFO ] [MAIN ] RZC: Successfully saved derivative data. [2025-09-29T02:22:08.473313] [INFO ] [MAIN ] Derivative Progress: 1729/2211 symbols completed. RZC took 1.3s. Estimated remaining: 3m 24s. Rate: 141.8 symbols/min [2025-09-29T02:22:08.475089] [INFO ] [MAIN ] SABA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:08.493589] [DEBUG] [LOCAL ] SABA: Loaded 9306 existing records from primary storage. [2025-09-29T02:22:08.507285] [DEBUG] [MAIN ] S: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:08.507564] [INFO ] [MAIN ] SABA: Loaded 9306 primary data records. [2025-09-29T02:22:08.508976] [INFO ] [MAIN ] S: Generated 1820 derivative records from 54315 primary records. [2025-09-29T02:22:08.520940] [DEBUG] [LOCAL ] S: Saving derivative data. [2025-09-29T02:22:08.644090] [DEBUG] [LOCAL ] S: Derivative data saved (1820 records). [2025-09-29T02:22:08.655496] [INFO ] [MAIN ] S: Successfully saved derivative data. [2025-09-29T02:22:08.680234] [INFO ] [MAIN ] Derivative Progress: 1730/2211 symbols completed. S took 1.4s. Estimated remaining: 3m 23s. Rate: 141.9 symbols/min [2025-09-29T02:22:08.680864] [INFO ] [MAIN ] SAFE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:08.896775] [DEBUG] [MAIN ] SA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:08.899483] [INFO ] [MAIN ] SA: Generated 1820 derivative records from 43820 primary records. [2025-09-29T02:22:08.900188] [DEBUG] [LOCAL ] SA: Saving derivative data. [2025-09-29T02:22:08.948603] [DEBUG] [LOCAL ] SA: Derivative data saved (1820 records). [2025-09-29T02:22:08.950768] [INFO ] [MAIN ] SA: Successfully saved derivative data. [2025-09-29T02:22:08.954004] [INFO ] [MAIN ] Derivative Progress: 1731/2211 symbols completed. SA took 1.5s. Estimated remaining: 3m 23s. Rate: 141.9 symbols/min [2025-09-29T02:22:08.955080] [INFO ] [MAIN ] SAH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:08.956893] [DEBUG] [LOCAL ] SAFE: Loaded 30819 existing records from primary storage. [2025-09-29T02:22:08.957819] [INFO ] [MAIN ] SAFE: Loaded 30819 primary data records. [2025-09-29T02:22:09.114174] [DEBUG] [MAIN ] SABA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:09.182128] [INFO ] [MAIN ] SABA: Generated 1820 derivative records from 9306 primary records. [2025-09-29T02:22:09.205919] [DEBUG] [LOCAL ] SABA: Saving derivative data. [2025-09-29T02:22:09.316065] [DEBUG] [LOCAL ] SAH: Loaded 22368 existing records from primary storage. [2025-09-29T02:22:09.332302] [INFO ] [MAIN ] SAH: Loaded 22368 primary data records. [2025-09-29T02:22:09.402629] [DEBUG] [LOCAL ] SABA: Derivative data saved (1820 records). [2025-09-29T02:22:09.408491] [INFO ] [MAIN ] SABA: Successfully saved derivative data. [2025-09-29T02:22:09.411233] [INFO ] [MAIN ] Derivative Progress: 1732/2211 symbols completed. SABA took 0.9s. Estimated remaining: 3m 23s. Rate: 141.9 symbols/min [2025-09-29T02:22:09.411417] [INFO ] [MAIN ] SAM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:09.594875] [DEBUG] [LOCAL ] SAM: Loaded 21766 existing records from primary storage. [2025-09-29T02:22:09.716480] [INFO ] [MAIN ] SAM: Loaded 21766 primary data records. [2025-09-29T02:22:09.872060] [DEBUG] [MAIN ] SAFE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:09.895128] [INFO ] [MAIN ] SAFE: Generated 1820 derivative records from 30819 primary records. [2025-09-29T02:22:09.956439] [DEBUG] [LOCAL ] SAFE: Saving derivative data. [2025-09-29T02:22:10.155934] [DEBUG] [LOCAL ] SAFE: Derivative data saved (1820 records). [2025-09-29T02:22:10.157237] [INFO ] [MAIN ] SAFE: Successfully saved derivative data. [2025-09-29T02:22:10.161745] [INFO ] [MAIN ] Derivative Progress: 1733/2211 symbols completed. SAFE took 1.5s. Estimated remaining: 3m 22s. Rate: 141.8 symbols/min [2025-09-29T02:22:10.164388] [INFO ] [MAIN ] SAN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:10.185977] [DEBUG] [MAIN ] SAH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:10.186887] [INFO ] [MAIN ] SAH: Generated 1820 derivative records from 22368 primary records. [2025-09-29T02:22:10.187085] [DEBUG] [LOCAL ] SAH: Saving derivative data. [2025-09-29T02:22:10.205997] [DEBUG] [LOCAL ] SAH: Derivative data saved (1820 records). [2025-09-29T02:22:10.206508] [INFO ] [MAIN ] SAH: Successfully saved derivative data. [2025-09-29T02:22:10.208718] [INFO ] [MAIN ] Derivative Progress: 1734/2211 symbols completed. SAH took 1.3s. Estimated remaining: 3m 22s. Rate: 141.9 symbols/min [2025-09-29T02:22:10.209159] [INFO ] [MAIN ] SAND: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:10.228627] [DEBUG] [MAIN ] SAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:10.229500] [INFO ] [MAIN ] SAM: Generated 1820 derivative records from 21766 primary records. [2025-09-29T02:22:10.229633] [DEBUG] [LOCAL ] SAM: Saving derivative data. [2025-09-29T02:22:10.265191] [DEBUG] [LOCAL ] SAM: Derivative data saved (1820 records). [2025-09-29T02:22:10.265365] [INFO ] [MAIN ] SAM: Successfully saved derivative data. [2025-09-29T02:22:10.269105] [INFO ] [MAIN ] Derivative Progress: 1735/2211 symbols completed. SAM took 0.9s. Estimated remaining: 3m 21s. Rate: 142.0 symbols/min [2025-09-29T02:22:10.269454] [INFO ] [MAIN ] SAP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:10.309605] [DEBUG] [LOCAL ] SAN: Loaded 53774 existing records from primary storage. [2025-09-29T02:22:10.311128] [INFO ] [MAIN ] SAN: Loaded 53774 primary data records. [2025-09-29T02:22:10.375589] [DEBUG] [LOCAL ] SAND: Loaded 52527 existing records from primary storage. [2025-09-29T02:22:10.398808] [INFO ] [MAIN ] SAND: Loaded 52527 primary data records. [2025-09-29T02:22:10.812434] [DEBUG] [LOCAL ] SAP: Loaded 50800 existing records from primary storage. [2025-09-29T02:22:10.838935] [INFO ] [MAIN ] SAP: Loaded 50800 primary data records. [2025-09-29T02:22:11.383274] [DEBUG] [MAIN ] SAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:11.386228] [INFO ] [MAIN ] SAN: Generated 1820 derivative records from 53774 primary records. [2025-09-29T02:22:11.387222] [DEBUG] [LOCAL ] SAN: Saving derivative data. [2025-09-29T02:22:11.403475] [DEBUG] [MAIN ] SAND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:11.417606] [INFO ] [MAIN ] SAND: Generated 1820 derivative records from 52527 primary records. [2025-09-29T02:22:11.420194] [DEBUG] [LOCAL ] SAND: Saving derivative data. [2025-09-29T02:22:11.422675] [DEBUG] [LOCAL ] SAN: Derivative data saved (1820 records). [2025-09-29T02:22:11.423160] [INFO ] [MAIN ] SAN: Successfully saved derivative data. [2025-09-29T02:22:11.433620] [INFO ] [MAIN ] Derivative Progress: 1736/2211 symbols completed. SAN took 1.3s. Estimated remaining: 3m 21s. Rate: 141.8 symbols/min [2025-09-29T02:22:11.438716] [INFO ] [MAIN ] SAR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:11.445180] [DEBUG] [LOCAL ] SAND: Derivative data saved (1820 records). [2025-09-29T02:22:11.445674] [INFO ] [MAIN ] SAND: Successfully saved derivative data. [2025-09-29T02:22:11.447982] [INFO ] [MAIN ] Derivative Progress: 1737/2211 symbols completed. SAND took 1.2s. Estimated remaining: 3m 20s. Rate: 141.9 symbols/min [2025-09-29T02:22:11.448279] [INFO ] [MAIN ] SARO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:11.470345] [DEBUG] [MAIN ] SAP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:11.478306] [DEBUG] [LOCAL ] SAR: Loaded 16382 existing records from primary storage. [2025-09-29T02:22:11.478519] [INFO ] [MAIN ] SAR: Loaded 16382 primary data records. [2025-09-29T02:22:11.477735] [INFO ] [MAIN ] SAP: Generated 1820 derivative records from 50800 primary records. [2025-09-29T02:22:11.496164] [DEBUG] [LOCAL ] SAP: Saving derivative data. [2025-09-29T02:22:11.723674] [DEBUG] [LOCAL ] SAP: Derivative data saved (1820 records). [2025-09-29T02:22:11.831254] [DEBUG] [LOCAL ] SARO: Loaded 49425 existing records from primary storage. [2025-09-29T02:22:11.829823] [INFO ] [MAIN ] SAP: Successfully saved derivative data. [2025-09-29T02:22:11.869124] [INFO ] [MAIN ] SARO: Loaded 49425 primary data records. [2025-09-29T02:22:11.868703] [INFO ] [MAIN ] Derivative Progress: 1738/2211 symbols completed. SAP took 1.6s. Estimated remaining: 3m 20s. Rate: 141.9 symbols/min [2025-09-29T02:22:12.261542] [DEBUG] [MAIN ] SAR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:12.262478] [INFO ] [MAIN ] SAR: Generated 1820 derivative records from 16382 primary records. [2025-09-29T02:22:12.262990] [DEBUG] [LOCAL ] SAR: Saving derivative data. [2025-09-29T02:22:12.280950] [DEBUG] [LOCAL ] SAR: Derivative data saved (1820 records). [2025-09-29T02:22:12.281195] [INFO ] [MAIN ] SAR: Successfully saved derivative data. [2025-09-29T02:22:12.283677] [INFO ] [MAIN ] Derivative Progress: 1739/2211 symbols completed. SAR took 0.8s. Estimated remaining: 3m 20s. Rate: 141.9 symbols/min [2025-09-29T02:22:12.302229] [DEBUG] [MAIN ] SARO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:12.302977] [INFO ] [MAIN ] SARO: Generated 1820 derivative records from 49425 primary records. [2025-09-29T02:22:12.303066] [DEBUG] [LOCAL ] SARO: Saving derivative data. [2025-09-29T02:22:12.319709] [DEBUG] [LOCAL ] SARO: Derivative data saved (1820 records). [2025-09-29T02:22:12.319820] [INFO ] [MAIN ] SARO: Successfully saved derivative data. [2025-09-29T02:22:12.323440] [INFO ] [MAIN ] Derivative Progress: 1740/2211 symbols completed. SARO took 0.9s. Estimated remaining: 3m 19s. Rate: 142.0 symbols/min [2025-09-29T02:22:12.324249] [INFO ] [MAIN ] SBH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:12.324303] [INFO ] [MAIN ] SBI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:12.324139] [INFO ] [MAIN ] SB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:12.339768] [DEBUG] [LOCAL ] SBI: Loaded 7848 existing records from primary storage. [2025-09-29T02:22:12.340300] [INFO ] [MAIN ] SBI: Loaded 7848 primary data records. [2025-09-29T02:22:12.564749] [DEBUG] [LOCAL ] SB: Loaded 33735 existing records from primary storage. [2025-09-29T02:22:12.607749] [INFO ] [MAIN ] SB: Loaded 33735 primary data records. [2025-09-29T02:22:12.735625] [DEBUG] [LOCAL ] SBH: Loaded 50565 existing records from primary storage. [2025-09-29T02:22:12.750198] [INFO ] [MAIN ] SBH: Loaded 50565 primary data records. [2025-09-29T02:22:13.445299] [DEBUG] [MAIN ] SBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:13.447800] [INFO ] [MAIN ] SBI: Generated 1820 derivative records from 7848 primary records. [2025-09-29T02:22:13.448899] [DEBUG] [LOCAL ] SBI: Saving derivative data. [2025-09-29T02:22:13.468209] [DEBUG] [LOCAL ] SBI: Derivative data saved (1820 records). [2025-09-29T02:22:13.468420] [INFO ] [MAIN ] SBI: Successfully saved derivative data. [2025-09-29T02:22:13.470951] [INFO ] [MAIN ] Derivative Progress: 1741/2211 symbols completed. SBI took 1.1s. Estimated remaining: 3m 19s. Rate: 141.8 symbols/min [2025-09-29T02:22:13.471750] [INFO ] [MAIN ] SBR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:13.499905] [DEBUG] [MAIN ] SBH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:13.507681] [DEBUG] [MAIN ] SB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:13.508613] [INFO ] [MAIN ] SBH: Generated 1820 derivative records from 50565 primary records. [2025-09-29T02:22:13.509295] [INFO ] [MAIN ] SB: Generated 1820 derivative records from 33735 primary records. [2025-09-29T02:22:13.513498] [DEBUG] [LOCAL ] SBR: Loaded 7350 existing records from primary storage. [2025-09-29T02:22:13.513883] [INFO ] [MAIN ] SBR: Loaded 7350 primary data records. [2025-09-29T02:22:13.513581] [DEBUG] [LOCAL ] SBH: Saving derivative data. [2025-09-29T02:22:13.513823] [DEBUG] [LOCAL ] SB: Saving derivative data. [2025-09-29T02:22:13.651124] [DEBUG] [LOCAL ] SB: Derivative data saved (1820 records). [2025-09-29T02:22:13.677295] [INFO ] [MAIN ] SB: Successfully saved derivative data. [2025-09-29T02:22:13.707679] [DEBUG] [LOCAL ] SBH: Derivative data saved (1820 records). [2025-09-29T02:22:13.727785] [INFO ] [MAIN ] Derivative Progress: 1742/2211 symbols completed. SB took 1.4s. Estimated remaining: 3m 18s. Rate: 141.9 symbols/min [2025-09-29T02:22:13.727936] [INFO ] [MAIN ] SBH: Successfully saved derivative data. [2025-09-29T02:22:13.766862] [INFO ] [MAIN ] SBS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:13.889584] [INFO ] [MAIN ] Derivative Progress: 1743/2211 symbols completed. SBH took 1.6s. Estimated remaining: 3m 18s. Rate: 141.9 symbols/min [2025-09-29T02:22:13.900595] [INFO ] [MAIN ] SBSI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:13.951615] [DEBUG] [LOCAL ] SBSI: Loaded 14974 existing records from primary storage. [2025-09-29T02:22:13.951849] [INFO ] [MAIN ] SBSI: Loaded 14974 primary data records. [2025-09-29T02:22:13.952459] [DEBUG] [MAIN ] SBR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:13.954005] [INFO ] [MAIN ] SBR: Generated 1820 derivative records from 7350 primary records. [2025-09-29T02:22:13.954353] [DEBUG] [LOCAL ] SBR: Saving derivative data. [2025-09-29T02:22:14.153283] [DEBUG] [LOCAL ] SBS: Loaded 50166 existing records from primary storage. [2025-09-29T02:22:14.159391] [INFO ] [MAIN ] SBS: Loaded 50166 primary data records. [2025-09-29T02:22:14.159206] [DEBUG] [LOCAL ] SBR: Derivative data saved (1820 records). [2025-09-29T02:22:14.159618] [INFO ] [MAIN ] SBR: Successfully saved derivative data. [2025-09-29T02:22:14.191251] [INFO ] [MAIN ] Derivative Progress: 1744/2211 symbols completed. SBR took 0.7s. Estimated remaining: 3m 17s. Rate: 141.9 symbols/min [2025-09-29T02:22:14.217959] [INFO ] [MAIN ] SBSW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:14.799597] [DEBUG] [LOCAL ] SBSW: Loaded 53745 existing records from primary storage. [2025-09-29T02:22:14.800884] [INFO ] [MAIN ] SBSW: Loaded 53745 primary data records. [2025-09-29T02:22:14.814385] [DEBUG] [MAIN ] SBSI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:14.821109] [INFO ] [MAIN ] SBSI: Generated 1820 derivative records from 14974 primary records. [2025-09-29T02:22:14.890279] [DEBUG] [LOCAL ] SBSI: Saving derivative data. [2025-09-29T02:22:15.176044] [DEBUG] [LOCAL ] SBSI: Derivative data saved (1820 records). [2025-09-29T02:22:15.176464] [INFO ] [MAIN ] SBSI: Successfully saved derivative data. [2025-09-29T02:22:15.179720] [INFO ] [MAIN ] Derivative Progress: 1745/2211 symbols completed. SBSI took 1.3s. Estimated remaining: 3m 17s. Rate: 141.8 symbols/min [2025-09-29T02:22:15.180735] [INFO ] [MAIN ] SCCO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:15.195201] [DEBUG] [MAIN ] SBS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:15.196397] [INFO ] [MAIN ] SBS: Generated 1820 derivative records from 50166 primary records. [2025-09-29T02:22:15.196671] [DEBUG] [LOCAL ] SBS: Saving derivative data. [2025-09-29T02:22:15.217171] [DEBUG] [LOCAL ] SBS: Derivative data saved (1820 records). [2025-09-29T02:22:15.217399] [INFO ] [MAIN ] SBS: Successfully saved derivative data. [2025-09-29T02:22:15.219825] [INFO ] [MAIN ] Derivative Progress: 1746/2211 symbols completed. SBS took 1.5s. Estimated remaining: 3m 17s. Rate: 141.9 symbols/min [2025-09-29T02:22:15.221707] [INFO ] [MAIN ] SCD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:15.249063] [DEBUG] [MAIN ] SBSW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:15.254000] [DEBUG] [LOCAL ] SCD: Loaded 12749 existing records from primary storage. [2025-09-29T02:22:15.255153] [INFO ] [MAIN ] SBSW: Generated 1820 derivative records from 53745 primary records. [2025-09-29T02:22:15.254335] [INFO ] [MAIN ] SCD: Loaded 12749 primary data records. [2025-09-29T02:22:15.267227] [DEBUG] [LOCAL ] SBSW: Saving derivative data. [2025-09-29T02:22:15.404324] [DEBUG] [LOCAL ] SBSW: Derivative data saved (1820 records). [2025-09-29T02:22:15.432961] [INFO ] [MAIN ] SBSW: Successfully saved derivative data. [2025-09-29T02:22:15.456671] [DEBUG] [LOCAL ] SCCO: Loaded 50148 existing records from primary storage. [2025-09-29T02:22:15.460293] [INFO ] [MAIN ] Derivative Progress: 1747/2211 symbols completed. SBSW took 1.2s. Estimated remaining: 3m 16s. Rate: 141.9 symbols/min [2025-09-29T02:22:15.481301] [INFO ] [MAIN ] SCCO: Loaded 50148 primary data records. [2025-09-29T02:22:15.498599] [INFO ] [MAIN ] SCHW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:16.027222] [DEBUG] [MAIN ] SCD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:16.045360] [INFO ] [MAIN ] SCD: Generated 1820 derivative records from 12749 primary records. [2025-09-29T02:22:16.045597] [DEBUG] [LOCAL ] SCD: Saving derivative data. [2025-09-29T02:22:16.060933] [DEBUG] [LOCAL ] SCHW: Loaded 54465 existing records from primary storage. [2025-09-29T02:22:16.063888] [INFO ] [MAIN ] SCHW: Loaded 54465 primary data records. [2025-09-29T02:22:16.080162] [DEBUG] [LOCAL ] SCD: Derivative data saved (1820 records). [2025-09-29T02:22:16.093099] [INFO ] [MAIN ] SCD: Successfully saved derivative data. [2025-09-29T02:22:16.108980] [INFO ] [MAIN ] Derivative Progress: 1748/2211 symbols completed. SCD took 0.9s. Estimated remaining: 3m 16s. Rate: 141.9 symbols/min [2025-09-29T02:22:16.123400] [INFO ] [MAIN ] SCI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:16.424745] [DEBUG] [MAIN ] SCCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:16.440850] [INFO ] [MAIN ] SCCO: Generated 1820 derivative records from 50148 primary records. [2025-09-29T02:22:16.441187] [DEBUG] [LOCAL ] SCCO: Saving derivative data. [2025-09-29T02:22:16.459080] [DEBUG] [LOCAL ] SCCO: Derivative data saved (1820 records). [2025-09-29T02:22:16.469853] [INFO ] [MAIN ] SCCO: Successfully saved derivative data. [2025-09-29T02:22:16.473391] [INFO ] [MAIN ] Derivative Progress: 1749/2211 symbols completed. SCCO took 1.3s. Estimated remaining: 3m 15s. Rate: 141.9 symbols/min [2025-09-29T02:22:16.474195] [INFO ] [MAIN ] SCL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:16.498954] [DEBUG] [LOCAL ] SCI: Loaded 47257 existing records from primary storage. [2025-09-29T02:22:16.499285] [INFO ] [MAIN ] SCI: Loaded 47257 primary data records. [2025-09-29T02:22:16.606067] [DEBUG] [LOCAL ] SCL: Loaded 15113 existing records from primary storage. [2025-09-29T02:22:16.632737] [INFO ] [MAIN ] SCL: Loaded 15113 primary data records. [2025-09-29T02:22:16.812691] [DEBUG] [MAIN ] SCHW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:16.952561] [INFO ] [MAIN ] SCHW: Generated 1820 derivative records from 54465 primary records. [2025-09-29T02:22:16.993048] [DEBUG] [LOCAL ] SCHW: Saving derivative data. [2025-09-29T02:22:17.132196] [DEBUG] [LOCAL ] SCHW: Derivative data saved (1820 records). [2025-09-29T02:22:17.259072] [INFO ] [MAIN ] SCHW: Successfully saved derivative data. [2025-09-29T02:22:17.261824] [INFO ] [MAIN ] Derivative Progress: 1750/2211 symbols completed. SCHW took 1.8s. Estimated remaining: 3m 15s. Rate: 141.8 symbols/min [2025-09-29T02:22:17.262516] [INFO ] [MAIN ] SCM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:17.290874] [DEBUG] [MAIN ] SCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:17.297080] [INFO ] [MAIN ] SCI: Generated 1820 derivative records from 47257 primary records. [2025-09-29T02:22:17.297723] [DEBUG] [LOCAL ] SCI: Saving derivative data. [2025-09-29T02:22:17.323251] [DEBUG] [LOCAL ] SCM: Loaded 20163 existing records from primary storage. [2025-09-29T02:22:17.325685] [INFO ] [MAIN ] SCM: Loaded 20163 primary data records. [2025-09-29T02:22:17.326443] [DEBUG] [LOCAL ] SCI: Derivative data saved (1820 records). [2025-09-29T02:22:17.326805] [INFO ] [MAIN ] SCI: Successfully saved derivative data. [2025-09-29T02:22:17.383676] [INFO ] [MAIN ] Derivative Progress: 1751/2211 symbols completed. SCI took 1.3s. Estimated remaining: 3m 15s. Rate: 141.9 symbols/min [2025-09-29T02:22:17.407368] [INFO ] [MAIN ] SCS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:17.433758] [DEBUG] [MAIN ] SCL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:17.467303] [INFO ] [MAIN ] SCL: Generated 1820 derivative records from 15113 primary records. [2025-09-29T02:22:17.483461] [DEBUG] [LOCAL ] SCL: Saving derivative data. [2025-09-29T02:22:17.713258] [DEBUG] [LOCAL ] SCL: Derivative data saved (1820 records). [2025-09-29T02:22:17.714184] [INFO ] [MAIN ] SCL: Successfully saved derivative data. [2025-09-29T02:22:17.717377] [INFO ] [MAIN ] Derivative Progress: 1752/2211 symbols completed. SCL took 1.2s. Estimated remaining: 3m 14s. Rate: 141.9 symbols/min [2025-09-29T02:22:17.717622] [INFO ] [MAIN ] SD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:17.756421] [DEBUG] [MAIN ] SCM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:17.757341] [INFO ] [MAIN ] SCM: Generated 1820 derivative records from 20163 primary records. [2025-09-29T02:22:17.765621] [DEBUG] [LOCAL ] SCM: Saving derivative data. [2025-09-29T02:22:17.781737] [DEBUG] [LOCAL ] SCS: Loaded 43834 existing records from primary storage. [2025-09-29T02:22:17.781996] [INFO ] [MAIN ] SCS: Loaded 43834 primary data records. [2025-09-29T02:22:17.862401] [DEBUG] [LOCAL ] SCM: Derivative data saved (1820 records). [2025-09-29T02:22:17.863040] [DEBUG] [LOCAL ] SD: Loaded 29368 existing records from primary storage. [2025-09-29T02:22:17.881759] [INFO ] [MAIN ] SD: Loaded 29368 primary data records. [2025-09-29T02:22:17.881848] [INFO ] [MAIN ] SCM: Successfully saved derivative data. [2025-09-29T02:22:17.946186] [INFO ] [MAIN ] Derivative Progress: 1753/2211 symbols completed. SCM took 0.7s. Estimated remaining: 3m 14s. Rate: 141.9 symbols/min [2025-09-29T02:22:18.502241] [DEBUG] [MAIN ] SCS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:18.503281] [INFO ] [MAIN ] SCS: Generated 1820 derivative records from 43834 primary records. [2025-09-29T02:22:18.503486] [DEBUG] [LOCAL ] SCS: Saving derivative data. [2025-09-29T02:22:18.520830] [DEBUG] [LOCAL ] SCS: Derivative data saved (1820 records). [2025-09-29T02:22:18.522675] [INFO ] [MAIN ] SCS: Successfully saved derivative data. [2025-09-29T02:22:18.525765] [INFO ] [MAIN ] Derivative Progress: 1754/2211 symbols completed. SCS took 1.1s. Estimated remaining: 3m 13s. Rate: 141.9 symbols/min [2025-09-29T02:22:18.539051] [DEBUG] [MAIN ] SD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:18.539716] [INFO ] [MAIN ] SD: Generated 1820 derivative records from 29368 primary records. [2025-09-29T02:22:18.539803] [DEBUG] [LOCAL ] SD: Saving derivative data. [2025-09-29T02:22:18.555473] [DEBUG] [LOCAL ] SD: Derivative data saved (1820 records). [2025-09-29T02:22:18.555572] [INFO ] [MAIN ] SD: Successfully saved derivative data. [2025-09-29T02:22:18.558542] [INFO ] [MAIN ] Derivative Progress: 1755/2211 symbols completed. SD took 0.8s. Estimated remaining: 3m 13s. Rate: 142.0 symbols/min [2025-09-29T02:22:18.558989] [INFO ] [MAIN ] SDHC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:18.559109] [INFO ] [MAIN ] SDRL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:18.559276] [INFO ] [MAIN ] SDHY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:18.583529] [DEBUG] [LOCAL ] SDHY: Loaded 10710 existing records from primary storage. [2025-09-29T02:22:18.578341] [DEBUG] [LOCAL ] SDHC: Loaded 10686 existing records from primary storage. [2025-09-29T02:22:18.583945] [INFO ] [MAIN ] SDHC: Loaded 10686 primary data records. [2025-09-29T02:22:18.584060] [INFO ] [MAIN ] SDHY: Loaded 10710 primary data records. [2025-09-29T02:22:19.296317] [DEBUG] [LOCAL ] SDRL: Loaded 42459 existing records from primary storage. [2025-09-29T02:22:19.312040] [INFO ] [MAIN ] SDRL: Loaded 42459 primary data records. [2025-09-29T02:22:19.700178] [DEBUG] [MAIN ] SDHC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:19.717188] [DEBUG] [MAIN ] SDHY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:19.716430] [INFO ] [MAIN ] SDHC: Generated 1820 derivative records from 10686 primary records. [2025-09-29T02:22:19.717523] [DEBUG] [LOCAL ] SDHC: Saving derivative data. [2025-09-29T02:22:19.718201] [INFO ] [MAIN ] SDHY: Generated 1820 derivative records from 10710 primary records. [2025-09-29T02:22:19.719478] [DEBUG] [LOCAL ] SDHY: Saving derivative data. [2025-09-29T02:22:19.753537] [DEBUG] [LOCAL ] SDHY: Derivative data saved (1820 records). [2025-09-29T02:22:19.757525] [DEBUG] [LOCAL ] SDHC: Derivative data saved (1820 records). [2025-09-29T02:22:19.757792] [INFO ] [MAIN ] SDHY: Successfully saved derivative data. [2025-09-29T02:22:19.760736] [INFO ] [MAIN ] Derivative Progress: 1756/2211 symbols completed. SDHY took 1.2s. Estimated remaining: 3m 12s. Rate: 141.8 symbols/min [2025-09-29T02:22:19.761284] [INFO ] [MAIN ] SE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:19.757878] [INFO ] [MAIN ] SDHC: Successfully saved derivative data. [2025-09-29T02:22:19.764493] [INFO ] [MAIN ] Derivative Progress: 1757/2211 symbols completed. SDHC took 1.2s. Estimated remaining: 3m 12s. Rate: 141.9 symbols/min [2025-09-29T02:22:19.764879] [INFO ] [MAIN ] SEE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:19.782729] [DEBUG] [MAIN ] SDRL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:19.784546] [INFO ] [MAIN ] SDRL: Generated 1820 derivative records from 42459 primary records. [2025-09-29T02:22:19.784782] [DEBUG] [LOCAL ] SDRL: Saving derivative data. [2025-09-29T02:22:19.811289] [DEBUG] [LOCAL ] SDRL: Derivative data saved (1820 records). [2025-09-29T02:22:19.811528] [INFO ] [MAIN ] SDRL: Successfully saved derivative data. [2025-09-29T02:22:19.814603] [INFO ] [MAIN ] Derivative Progress: 1758/2211 symbols completed. SDRL took 1.3s. Estimated remaining: 3m 11s. Rate: 142.0 symbols/min [2025-09-29T02:22:19.815154] [INFO ] [MAIN ] SEG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:19.860922] [DEBUG] [LOCAL ] SEG: Loaded 13887 existing records from primary storage. [2025-09-29T02:22:19.877963] [INFO ] [MAIN ] SEG: Loaded 13887 primary data records. [2025-09-29T02:22:19.879630] [DEBUG] [LOCAL ] SEE: Loaded 49069 existing records from primary storage. [2025-09-29T02:22:19.895438] [INFO ] [MAIN ] SEE: Loaded 49069 primary data records. [2025-09-29T02:22:20.011943] [DEBUG] [LOCAL ] SE: Loaded 54140 existing records from primary storage. [2025-09-29T02:22:20.051320] [INFO ] [MAIN ] SE: Loaded 54140 primary data records. [2025-09-29T02:22:21.010731] [DEBUG] [MAIN ] SEE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:21.013323] [INFO ] [MAIN ] SEE: Generated 1820 derivative records from 49069 primary records. [2025-09-29T02:22:21.013683] [DEBUG] [LOCAL ] SEE: Saving derivative data. [2025-09-29T02:22:21.043842] [DEBUG] [MAIN ] SEG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:21.047237] [DEBUG] [LOCAL ] SEE: Derivative data saved (1820 records). [2025-09-29T02:22:21.047667] [INFO ] [MAIN ] SEE: Successfully saved derivative data. [2025-09-29T02:22:21.050015] [INFO ] [MAIN ] Derivative Progress: 1759/2211 symbols completed. SEE took 1.3s. Estimated remaining: 3m 11s. Rate: 141.8 symbols/min [2025-09-29T02:22:21.050242] [INFO ] [MAIN ] SEI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:21.045910] [INFO ] [MAIN ] SEG: Generated 1820 derivative records from 13887 primary records. [2025-09-29T02:22:21.050840] [DEBUG] [LOCAL ] SEG: Saving derivative data. [2025-09-29T02:22:21.071702] [DEBUG] [LOCAL ] SEG: Derivative data saved (1820 records). [2025-09-29T02:22:21.072326] [INFO ] [MAIN ] SEG: Successfully saved derivative data. [2025-09-29T02:22:21.085926] [DEBUG] [MAIN ] SE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:21.090047] [INFO ] [MAIN ] SE: Generated 1820 derivative records from 54140 primary records. [2025-09-29T02:22:21.090231] [DEBUG] [LOCAL ] SE: Saving derivative data. [2025-09-29T02:22:21.088788] [INFO ] [MAIN ] Derivative Progress: 1760/2211 symbols completed. SEG took 1.3s. Estimated remaining: 3m 11s. Rate: 141.9 symbols/min [2025-09-29T02:22:21.090926] [INFO ] [MAIN ] SEM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:21.109323] [DEBUG] [LOCAL ] SE: Derivative data saved (1820 records). [2025-09-29T02:22:21.109524] [INFO ] [MAIN ] SE: Successfully saved derivative data. [2025-09-29T02:22:21.113102] [INFO ] [MAIN ] Derivative Progress: 1761/2211 symbols completed. SE took 1.4s. Estimated remaining: 3m 10s. Rate: 142.0 symbols/min [2025-09-29T02:22:21.113350] [INFO ] [MAIN ] SEMR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:21.153910] [DEBUG] [LOCAL ] SEI: Loaded 50411 existing records from primary storage. [2025-09-29T02:22:21.155262] [INFO ] [MAIN ] SEI: Loaded 50411 primary data records. [2025-09-29T02:22:21.340372] [DEBUG] [LOCAL ] SEMR: Loaded 42184 existing records from primary storage. [2025-09-29T02:22:21.347865] [DEBUG] [LOCAL ] SEM: Loaded 43533 existing records from primary storage. [2025-09-29T02:22:21.365882] [INFO ] [MAIN ] SEMR: Loaded 42184 primary data records. [2025-09-29T02:22:21.383348] [INFO ] [MAIN ] SEM: Loaded 43533 primary data records. [2025-09-29T02:22:22.242662] [DEBUG] [MAIN ] SEI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:22.243806] [INFO ] [MAIN ] SEI: Generated 1820 derivative records from 50411 primary records. [2025-09-29T02:22:22.244180] [DEBUG] [LOCAL ] SEI: Saving derivative data. [2025-09-29T02:22:22.268463] [DEBUG] [LOCAL ] SEI: Derivative data saved (1820 records). [2025-09-29T02:22:22.269795] [INFO ] [MAIN ] SEI: Successfully saved derivative data. [2025-09-29T02:22:22.272953] [INFO ] [MAIN ] Derivative Progress: 1762/2211 symbols completed. SEI took 1.2s. Estimated remaining: 3m 10s. Rate: 141.8 symbols/min [2025-09-29T02:22:22.273782] [INFO ] [MAIN ] SES: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:22.296335] [DEBUG] [MAIN ] SEMR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:22.299224] [INFO ] [MAIN ] SEMR: Generated 1820 derivative records from 42184 primary records. [2025-09-29T02:22:22.300380] [DEBUG] [LOCAL ] SEMR: Saving derivative data. [2025-09-29T02:22:22.326958] [DEBUG] [MAIN ] SEM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:22.334850] [INFO ] [MAIN ] SEM: Generated 1820 derivative records from 43533 primary records. [2025-09-29T02:22:22.337752] [DEBUG] [LOCAL ] SEM: Saving derivative data. [2025-09-29T02:22:22.350954] [DEBUG] [LOCAL ] SEMR: Derivative data saved (1820 records). [2025-09-29T02:22:22.354674] [INFO ] [MAIN ] SEMR: Successfully saved derivative data. [2025-09-29T02:22:22.362840] [DEBUG] [LOCAL ] SEM: Derivative data saved (1820 records). [2025-09-29T02:22:22.362314] [INFO ] [MAIN ] Derivative Progress: 1763/2211 symbols completed. SEMR took 1.2s. Estimated remaining: 3m 9s. Rate: 141.9 symbols/min [2025-09-29T02:22:22.363256] [INFO ] [MAIN ] SEM: Successfully saved derivative data. [2025-09-29T02:22:22.363187] [INFO ] [MAIN ] SF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:22.366437] [INFO ] [MAIN ] Derivative Progress: 1764/2211 symbols completed. SEM took 1.3s. Estimated remaining: 3m 9s. Rate: 142.0 symbols/min [2025-09-29T02:22:22.367285] [INFO ] [MAIN ] SFB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:22.394577] [DEBUG] [LOCAL ] SFB: Loaded 4046 existing records from primary storage. [2025-09-29T02:22:22.394835] [INFO ] [MAIN ] SFB: Loaded 4046 primary data records. [2025-09-29T02:22:22.513786] [DEBUG] [LOCAL ] SES: Loaded 52331 existing records from primary storage. [2025-09-29T02:22:22.536324] [INFO ] [MAIN ] SES: Loaded 52331 primary data records. [2025-09-29T02:22:22.776348] [DEBUG] [LOCAL ] SF: Loaded 42360 existing records from primary storage. [2025-09-29T02:22:22.925272] [INFO ] [MAIN ] SF: Loaded 42360 primary data records. [2025-09-29T02:22:23.539264] [DEBUG] [MAIN ] SFB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:23.540470] [INFO ] [MAIN ] SFB: Generated 1820 derivative records from 4046 primary records. [2025-09-29T02:22:23.540840] [DEBUG] [LOCAL ] SFB: Saving derivative data. [2025-09-29T02:22:23.556083] [DEBUG] [MAIN ] SES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:23.566049] [INFO ] [MAIN ] SES: Generated 1820 derivative records from 52331 primary records. [2025-09-29T02:22:23.574000] [DEBUG] [LOCAL ] SFB: Derivative data saved (1820 records). [2025-09-29T02:22:23.574349] [INFO ] [MAIN ] SFB: Successfully saved derivative data. [2025-09-29T02:22:23.574155] [DEBUG] [LOCAL ] SES: Saving derivative data. [2025-09-29T02:22:23.577968] [INFO ] [MAIN ] Derivative Progress: 1765/2211 symbols completed. SFB took 1.2s. Estimated remaining: 3m 9s. Rate: 141.8 symbols/min [2025-09-29T02:22:23.595030] [INFO ] [MAIN ] SFBS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:23.599771] [DEBUG] [LOCAL ] SES: Derivative data saved (1820 records). [2025-09-29T02:22:23.601025] [INFO ] [MAIN ] SES: Successfully saved derivative data. [2025-09-29T02:22:23.604423] [INFO ] [MAIN ] Derivative Progress: 1766/2211 symbols completed. SES took 1.3s. Estimated remaining: 3m 8s. Rate: 141.9 symbols/min [2025-09-29T02:22:23.604987] [INFO ] [MAIN ] SFL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:23.623591] [DEBUG] [MAIN ] SF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:23.624442] [INFO ] [MAIN ] SF: Generated 1820 derivative records from 42360 primary records. [2025-09-29T02:22:23.624771] [DEBUG] [LOCAL ] SF: Saving derivative data. [2025-09-29T02:22:23.642760] [DEBUG] [LOCAL ] SF: Derivative data saved (1820 records). [2025-09-29T02:22:23.648296] [INFO ] [MAIN ] SF: Successfully saved derivative data. [2025-09-29T02:22:23.651142] [INFO ] [MAIN ] Derivative Progress: 1767/2211 symbols completed. SF took 1.3s. Estimated remaining: 3m 8s. Rate: 142.0 symbols/min [2025-09-29T02:22:23.651564] [INFO ] [MAIN ] SG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:23.664316] [DEBUG] [LOCAL ] SFBS: Loaded 21483 existing records from primary storage. [2025-09-29T02:22:23.664508] [INFO ] [MAIN ] SFBS: Loaded 21483 primary data records. [2025-09-29T02:22:23.837933] [DEBUG] [LOCAL ] SFL: Loaded 46026 existing records from primary storage. [2025-09-29T02:22:23.863947] [INFO ] [MAIN ] SFL: Loaded 46026 primary data records. [2025-09-29T02:22:24.199975] [DEBUG] [LOCAL ] SG: Loaded 54227 existing records from primary storage. [2025-09-29T02:22:24.218803] [INFO ] [MAIN ] SG: Loaded 54227 primary data records. [2025-09-29T02:22:24.861673] [DEBUG] [MAIN ] SFBS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:24.863423] [INFO ] [MAIN ] SFBS: Generated 1820 derivative records from 21483 primary records. [2025-09-29T02:22:24.864443] [DEBUG] [LOCAL ] SFBS: Saving derivative data. [2025-09-29T02:22:24.887357] [DEBUG] [LOCAL ] SFBS: Derivative data saved (1820 records). [2025-09-29T02:22:24.888702] [INFO ] [MAIN ] SFBS: Successfully saved derivative data. [2025-09-29T02:22:24.903435] [DEBUG] [MAIN ] SFL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:24.910415] [INFO ] [MAIN ] SFL: Generated 1820 derivative records from 46026 primary records. [2025-09-29T02:22:24.908668] [INFO ] [MAIN ] Derivative Progress: 1768/2211 symbols completed. SFBS took 1.3s. Estimated remaining: 3m 7s. Rate: 141.8 symbols/min [2025-09-29T02:22:24.911116] [DEBUG] [LOCAL ] SFL: Saving derivative data. [2025-09-29T02:22:24.933074] [DEBUG] [LOCAL ] SFL: Derivative data saved (1820 records). [2025-09-29T02:22:24.946346] [INFO ] [MAIN ] SFL: Successfully saved derivative data. [2025-09-29T02:22:24.946985] [DEBUG] [MAIN ] SG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:24.951530] [INFO ] [MAIN ] Derivative Progress: 1769/2211 symbols completed. SFL took 1.3s. Estimated remaining: 3m 7s. Rate: 141.9 symbols/min [2025-09-29T02:22:24.952709] [INFO ] [MAIN ] SG: Generated 1820 derivative records from 54227 primary records. [2025-09-29T02:22:24.952817] [DEBUG] [LOCAL ] SG: Saving derivative data. [2025-09-29T02:22:24.969214] [DEBUG] [LOCAL ] SG: Derivative data saved (1820 records). [2025-09-29T02:22:24.969329] [INFO ] [MAIN ] SG: Successfully saved derivative data. [2025-09-29T02:22:24.973047] [INFO ] [MAIN ] Derivative Progress: 1770/2211 symbols completed. SG took 1.3s. Estimated remaining: 3m 6s. Rate: 142.0 symbols/min [2025-09-29T02:22:24.974060] [INFO ] [MAIN ] SGHC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:24.974191] [INFO ] [MAIN ] SGU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:24.974383] [INFO ] [MAIN ] SHAK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:25.004265] [DEBUG] [LOCAL ] SGU: Loaded 6765 existing records from primary storage. [2025-09-29T02:22:25.004723] [INFO ] [MAIN ] SGU: Loaded 6765 primary data records. [2025-09-29T02:22:25.409849] [DEBUG] [LOCAL ] SGHC: Loaded 46435 existing records from primary storage. [2025-09-29T02:22:25.410467] [INFO ] [MAIN ] SGHC: Loaded 46435 primary data records. [2025-09-29T02:22:25.411778] [DEBUG] [LOCAL ] SHAK: Loaded 49831 existing records from primary storage. [2025-09-29T02:22:25.412207] [INFO ] [MAIN ] SHAK: Loaded 49831 primary data records. [2025-09-29T02:22:26.197302] [DEBUG] [MAIN ] SGU: Filtered 7001 bins outside market hours, 7799 incomplete bins [2025-09-29T02:22:26.199695] [INFO ] [MAIN ] SGU: Generated 1815 derivative records from 6765 primary records. [2025-09-29T02:22:26.200091] [DEBUG] [LOCAL ] SGU: Saving derivative data. [2025-09-29T02:22:26.218246] [DEBUG] [LOCAL ] SGU: Derivative data saved (1815 records). [2025-09-29T02:22:26.218589] [INFO ] [MAIN ] SGU: Successfully saved derivative data. [2025-09-29T02:22:26.221096] [INFO ] [MAIN ] Derivative Progress: 1771/2211 symbols completed. SGU took 1.2s. Estimated remaining: 3m 6s. Rate: 141.8 symbols/min [2025-09-29T02:22:26.221534] [INFO ] [MAIN ] SHCO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:26.243605] [DEBUG] [MAIN ] SHAK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:26.244517] [INFO ] [MAIN ] SHAK: Generated 1820 derivative records from 49831 primary records. [2025-09-29T02:22:26.244810] [DEBUG] [LOCAL ] SHAK: Saving derivative data. [2025-09-29T02:22:26.281050] [DEBUG] [MAIN ] SGHC: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:22:26.283897] [INFO ] [MAIN ] SGHC: Generated 1819 derivative records from 46435 primary records. [2025-09-29T02:22:26.284330] [DEBUG] [LOCAL ] SGHC: Saving derivative data. [2025-09-29T02:22:26.295756] [DEBUG] [LOCAL ] SHAK: Derivative data saved (1820 records). [2025-09-29T02:22:26.296170] [INFO ] [MAIN ] SHAK: Successfully saved derivative data. [2025-09-29T02:22:26.299030] [INFO ] [MAIN ] Derivative Progress: 1772/2211 symbols completed. SHAK took 1.3s. Estimated remaining: 3m 6s. Rate: 141.9 symbols/min [2025-09-29T02:22:26.299293] [INFO ] [MAIN ] SHEL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:26.300675] [DEBUG] [LOCAL ] SHCO: Loaded 26427 existing records from primary storage. [2025-09-29T02:22:26.301218] [INFO ] [MAIN ] SHCO: Loaded 26427 primary data records. [2025-09-29T02:22:26.450127] [DEBUG] [LOCAL ] SGHC: Derivative data saved (1819 records). [2025-09-29T02:22:26.450348] [INFO ] [MAIN ] SGHC: Successfully saved derivative data. [2025-09-29T02:22:26.453395] [INFO ] [MAIN ] Derivative Progress: 1773/2211 symbols completed. SGHC took 1.5s. Estimated remaining: 3m 5s. Rate: 141.9 symbols/min [2025-09-29T02:22:26.453693] [INFO ] [MAIN ] SHG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:26.735500] [DEBUG] [LOCAL ] SHEL: Loaded 54451 existing records from primary storage. [2025-09-29T02:22:26.746246] [INFO ] [MAIN ] SHEL: Loaded 54451 primary data records. [2025-09-29T02:22:26.747273] [DEBUG] [LOCAL ] SHG: Loaded 27307 existing records from primary storage. [2025-09-29T02:22:26.783420] [INFO ] [MAIN ] SHG: Loaded 27307 primary data records. [2025-09-29T02:22:27.439572] [DEBUG] [MAIN ] SHCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:27.442228] [INFO ] [MAIN ] SHCO: Generated 1820 derivative records from 26427 primary records. [2025-09-29T02:22:27.443760] [DEBUG] [LOCAL ] SHCO: Saving derivative data. [2025-09-29T02:22:27.468012] [DEBUG] [LOCAL ] SHCO: Derivative data saved (1820 records). [2025-09-29T02:22:27.468611] [INFO ] [MAIN ] SHCO: Successfully saved derivative data. [2025-09-29T02:22:27.471069] [INFO ] [MAIN ] Derivative Progress: 1774/2211 symbols completed. SHCO took 1.2s. Estimated remaining: 3m 5s. Rate: 141.8 symbols/min [2025-09-29T02:22:27.471696] [INFO ] [MAIN ] SHO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:27.491132] [DEBUG] [MAIN ] SHEL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:27.493904] [INFO ] [MAIN ] SHEL: Generated 1820 derivative records from 54451 primary records. [2025-09-29T02:22:27.494770] [DEBUG] [LOCAL ] SHEL: Saving derivative data. [2025-09-29T02:22:27.520584] [DEBUG] [MAIN ] SHG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:27.523751] [INFO ] [MAIN ] SHG: Generated 1820 derivative records from 27307 primary records. [2025-09-29T02:22:27.523898] [DEBUG] [LOCAL ] SHG: Saving derivative data. [2025-09-29T02:22:27.527604] [DEBUG] [LOCAL ] SHEL: Derivative data saved (1820 records). [2025-09-29T02:22:27.527729] [INFO ] [MAIN ] SHEL: Successfully saved derivative data. [2025-09-29T02:22:27.531016] [INFO ] [MAIN ] Derivative Progress: 1775/2211 symbols completed. SHEL took 1.2s. Estimated remaining: 3m 4s. Rate: 141.9 symbols/min [2025-09-29T02:22:27.542861] [INFO ] [MAIN ] SHOC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:27.563717] [DEBUG] [LOCAL ] SHG: Derivative data saved (1820 records). [2025-09-29T02:22:27.563881] [INFO ] [MAIN ] SHG: Successfully saved derivative data. [2025-09-29T02:22:27.567408] [INFO ] [MAIN ] Derivative Progress: 1776/2211 symbols completed. SHG took 1.1s. Estimated remaining: 3m 4s. Rate: 142.0 symbols/min [2025-09-29T02:22:27.567804] [INFO ] [MAIN ] SHW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:27.576596] [DEBUG] [LOCAL ] SHOC: Loaded 3747 existing records from primary storage. [2025-09-29T02:22:27.578236] [INFO ] [MAIN ] SHOC: Loaded 3747 primary data records. [2025-09-29T02:22:27.669503] [DEBUG] [LOCAL ] SHO: Loaded 50552 existing records from primary storage. [2025-09-29T02:22:27.694674] [INFO ] [MAIN ] SHO: Loaded 50552 primary data records. [2025-09-29T02:22:28.191798] [DEBUG] [LOCAL ] SHW: Loaded 51174 existing records from primary storage. [2025-09-29T02:22:28.342700] [INFO ] [MAIN ] SHW: Loaded 51174 primary data records. [2025-09-29T02:22:28.699011] [DEBUG] [MAIN ] SHOC: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:22:28.716229] [INFO ] [MAIN ] SHOC: Generated 1819 derivative records from 3747 primary records. [2025-09-29T02:22:28.717061] [DEBUG] [LOCAL ] SHOC: Saving derivative data. [2025-09-29T02:22:28.739978] [DEBUG] [LOCAL ] SHOC: Derivative data saved (1819 records). [2025-09-29T02:22:28.741053] [INFO ] [MAIN ] SHOC: Successfully saved derivative data. [2025-09-29T02:22:28.744020] [INFO ] [MAIN ] Derivative Progress: 1777/2211 symbols completed. SHOC took 1.2s. Estimated remaining: 3m 4s. Rate: 141.8 symbols/min [2025-09-29T02:22:28.757964] [INFO ] [MAIN ] SID: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:28.759275] [DEBUG] [MAIN ] SHO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:28.760520] [INFO ] [MAIN ] SHO: Generated 1820 derivative records from 50552 primary records. [2025-09-29T02:22:28.761616] [DEBUG] [LOCAL ] SHO: Saving derivative data. [2025-09-29T02:22:28.782457] [DEBUG] [LOCAL ] SHO: Derivative data saved (1820 records). [2025-09-29T02:22:28.783040] [INFO ] [MAIN ] SHO: Successfully saved derivative data. [2025-09-29T02:22:28.786213] [INFO ] [MAIN ] Derivative Progress: 1778/2211 symbols completed. SHO took 1.3s. Estimated remaining: 3m 3s. Rate: 141.9 symbols/min [2025-09-29T02:22:28.786844] [INFO ] [MAIN ] SIG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:28.817848] [DEBUG] [MAIN ] SHW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:28.818962] [INFO ] [MAIN ] SHW: Generated 1820 derivative records from 51174 primary records. [2025-09-29T02:22:28.819249] [DEBUG] [LOCAL ] SHW: Saving derivative data. [2025-09-29T02:22:28.837034] [DEBUG] [LOCAL ] SHW: Derivative data saved (1820 records). [2025-09-29T02:22:28.838290] [INFO ] [MAIN ] SHW: Successfully saved derivative data. [2025-09-29T02:22:28.841950] [INFO ] [MAIN ] Derivative Progress: 1779/2211 symbols completed. SHW took 1.3s. Estimated remaining: 3m 3s. Rate: 142.0 symbols/min [2025-09-29T02:22:28.855277] [INFO ] [MAIN ] SII: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:28.859383] [DEBUG] [LOCAL ] SID: Loaded 42834 existing records from primary storage. [2025-09-29T02:22:28.859860] [INFO ] [MAIN ] SID: Loaded 42834 primary data records. [2025-09-29T02:22:29.072984] [DEBUG] [LOCAL ] SII: Loaded 23644 existing records from primary storage. [2025-09-29T02:22:29.120514] [INFO ] [MAIN ] SII: Loaded 23644 primary data records. [2025-09-29T02:22:29.134369] [DEBUG] [LOCAL ] SIG: Loaded 47111 existing records from primary storage. [2025-09-29T02:22:29.267977] [INFO ] [MAIN ] SIG: Loaded 47111 primary data records. [2025-09-29T02:22:30.065010] [DEBUG] [MAIN ] SID: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:30.066489] [INFO ] [MAIN ] SID: Generated 1820 derivative records from 42834 primary records. [2025-09-29T02:22:30.066957] [DEBUG] [LOCAL ] SID: Saving derivative data. [2025-09-29T02:22:30.090986] [DEBUG] [LOCAL ] SID: Derivative data saved (1820 records). [2025-09-29T02:22:30.091169] [INFO ] [MAIN ] SID: Successfully saved derivative data. [2025-09-29T02:22:30.093613] [INFO ] [MAIN ] Derivative Progress: 1780/2211 symbols completed. SID took 1.3s. Estimated remaining: 3m 2s. Rate: 141.8 symbols/min [2025-09-29T02:22:30.094156] [INFO ] [MAIN ] SILA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:30.116430] [DEBUG] [MAIN ] SII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:30.117536] [INFO ] [MAIN ] SII: Generated 1820 derivative records from 23644 primary records. [2025-09-29T02:22:30.125331] [DEBUG] [LOCAL ] SII: Saving derivative data. [2025-09-29T02:22:30.131352] [DEBUG] [MAIN ] SIG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:30.132369] [INFO ] [MAIN ] SIG: Generated 1820 derivative records from 47111 primary records. [2025-09-29T02:22:30.140059] [DEBUG] [LOCAL ] SIG: Saving derivative data. [2025-09-29T02:22:30.172540] [DEBUG] [LOCAL ] SII: Derivative data saved (1820 records). [2025-09-29T02:22:30.174432] [INFO ] [MAIN ] SII: Successfully saved derivative data. [2025-09-29T02:22:30.177480] [INFO ] [MAIN ] Derivative Progress: 1781/2211 symbols completed. SII took 1.3s. Estimated remaining: 3m 2s. Rate: 141.9 symbols/min [2025-09-29T02:22:30.174916] [DEBUG] [LOCAL ] SIG: Derivative data saved (1820 records). [2025-09-29T02:22:30.177951] [INFO ] [MAIN ] SIG: Successfully saved derivative data. [2025-09-29T02:22:30.177869] [INFO ] [MAIN ] SITC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:30.181216] [INFO ] [MAIN ] Derivative Progress: 1782/2211 symbols completed. SIG took 1.4s. Estimated remaining: 3m 1s. Rate: 141.9 symbols/min [2025-09-29T02:22:30.181721] [INFO ] [MAIN ] SITE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:30.195514] [DEBUG] [LOCAL ] SILA: Loaded 31635 existing records from primary storage. [2025-09-29T02:22:30.195926] [INFO ] [MAIN ] SILA: Loaded 31635 primary data records. [2025-09-29T02:22:30.428925] [DEBUG] [LOCAL ] SITE: Loaded 35513 existing records from primary storage. [2025-09-29T02:22:30.481863] [INFO ] [MAIN ] SITE: Loaded 35513 primary data records. [2025-09-29T02:22:30.566454] [DEBUG] [LOCAL ] SITC: Loaded 42233 existing records from primary storage. [2025-09-29T02:22:30.615352] [INFO ] [MAIN ] SITC: Loaded 42233 primary data records. [2025-09-29T02:22:31.288298] [DEBUG] [MAIN ] SILA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:31.290293] [INFO ] [MAIN ] SILA: Generated 1820 derivative records from 31635 primary records. [2025-09-29T02:22:31.291141] [DEBUG] [LOCAL ] SILA: Saving derivative data. [2025-09-29T02:22:31.313116] [DEBUG] [LOCAL ] SILA: Derivative data saved (1820 records). [2025-09-29T02:22:31.313740] [INFO ] [MAIN ] SILA: Successfully saved derivative data. [2025-09-29T02:22:31.316523] [INFO ] [MAIN ] Derivative Progress: 1783/2211 symbols completed. SILA took 1.2s. Estimated remaining: 3m 1s. Rate: 141.8 symbols/min [2025-09-29T02:22:31.337785] [DEBUG] [MAIN ] SITE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:31.350748] [DEBUG] [MAIN ] SITC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:31.351520] [INFO ] [MAIN ] SITE: Generated 1820 derivative records from 35513 primary records. [2025-09-29T02:22:31.352195] [INFO ] [MAIN ] SITC: Generated 1820 derivative records from 42233 primary records. [2025-09-29T02:22:31.352355] [DEBUG] [LOCAL ] SITC: Saving derivative data. [2025-09-29T02:22:31.352730] [DEBUG] [LOCAL ] SITE: Saving derivative data. [2025-09-29T02:22:31.387784] [DEBUG] [LOCAL ] SITC: Derivative data saved (1820 records). [2025-09-29T02:22:31.389906] [INFO ] [MAIN ] SITC: Successfully saved derivative data. [2025-09-29T02:22:31.394016] [INFO ] [MAIN ] Derivative Progress: 1784/2211 symbols completed. SITC took 1.2s. Estimated remaining: 3m 1s. Rate: 141.9 symbols/min [2025-09-29T02:22:31.395821] [DEBUG] [LOCAL ] SITE: Derivative data saved (1820 records). [2025-09-29T02:22:31.395935] [INFO ] [MAIN ] SITE: Successfully saved derivative data. [2025-09-29T02:22:31.399025] [INFO ] [MAIN ] Derivative Progress: 1785/2211 symbols completed. SITE took 1.2s. Estimated remaining: 3m 0s. Rate: 142.0 symbols/min [2025-09-29T02:22:31.399639] [INFO ] [MAIN ] SJM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:31.399760] [INFO ] [MAIN ] SJT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:31.399828] [INFO ] [MAIN ] SKE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:31.436421] [DEBUG] [LOCAL ] SJT: Loaded 22419 existing records from primary storage. [2025-09-29T02:22:31.445488] [INFO ] [MAIN ] SJT: Loaded 22419 primary data records. [2025-09-29T02:22:31.596277] [DEBUG] [LOCAL ] SKE: Loaded 36252 existing records from primary storage. [2025-09-29T02:22:31.632358] [INFO ] [MAIN ] SKE: Loaded 36252 primary data records. [2025-09-29T02:22:31.780173] [DEBUG] [LOCAL ] SJM: Loaded 50877 existing records from primary storage. [2025-09-29T02:22:31.853136] [INFO ] [MAIN ] SJM: Loaded 50877 primary data records. [2025-09-29T02:22:32.645607] [DEBUG] [MAIN ] SJT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:32.647161] [INFO ] [MAIN ] SJT: Generated 1820 derivative records from 22419 primary records. [2025-09-29T02:22:32.659758] [DEBUG] [LOCAL ] SJT: Saving derivative data. [2025-09-29T02:22:32.660523] [DEBUG] [MAIN ] SKE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:32.662497] [INFO ] [MAIN ] SKE: Generated 1820 derivative records from 36252 primary records. [2025-09-29T02:22:32.663557] [DEBUG] [LOCAL ] SKE: Saving derivative data. [2025-09-29T02:22:32.692125] [DEBUG] [LOCAL ] SJT: Derivative data saved (1820 records). [2025-09-29T02:22:32.694568] [INFO ] [MAIN ] SJT: Successfully saved derivative data. [2025-09-29T02:22:32.697239] [INFO ] [MAIN ] Derivative Progress: 1786/2211 symbols completed. SJT took 1.3s. Estimated remaining: 2m 60s. Rate: 141.8 symbols/min [2025-09-29T02:22:32.700224] [DEBUG] [LOCAL ] SKE: Derivative data saved (1820 records). [2025-09-29T02:22:32.700349] [INFO ] [MAIN ] SKIL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:32.700543] [INFO ] [MAIN ] SKE: Successfully saved derivative data. [2025-09-29T02:22:32.704042] [INFO ] [MAIN ] Derivative Progress: 1787/2211 symbols completed. SKE took 1.3s. Estimated remaining: 2m 59s. Rate: 141.9 symbols/min [2025-09-29T02:22:32.704846] [INFO ] [MAIN ] SKLZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:32.727207] [DEBUG] [MAIN ] SJM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:32.731154] [INFO ] [MAIN ] SJM: Generated 1820 derivative records from 50877 primary records. [2025-09-29T02:22:32.731321] [DEBUG] [LOCAL ] SJM: Saving derivative data. [2025-09-29T02:22:32.736350] [DEBUG] [LOCAL ] SKIL: Loaded 6395 existing records from primary storage. [2025-09-29T02:22:32.749194] [INFO ] [MAIN ] SKIL: Loaded 6395 primary data records. [2025-09-29T02:22:32.749671] [DEBUG] [LOCAL ] SKLZ: Loaded 12122 existing records from primary storage. [2025-09-29T02:22:32.778998] [INFO ] [MAIN ] SKLZ: Loaded 12122 primary data records. [2025-09-29T02:22:32.851476] [DEBUG] [LOCAL ] SJM: Derivative data saved (1820 records). [2025-09-29T02:22:32.908262] [INFO ] [MAIN ] SJM: Successfully saved derivative data. [2025-09-29T02:22:32.957800] [INFO ] [MAIN ] Derivative Progress: 1788/2211 symbols completed. SJM took 1.6s. Estimated remaining: 2m 59s. Rate: 141.9 symbols/min [2025-09-29T02:22:32.994723] [INFO ] [MAIN ] SKM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:33.529638] [DEBUG] [LOCAL ] SKM: Loaded 35557 existing records from primary storage. [2025-09-29T02:22:33.528158] [DEBUG] [MAIN ] SKIL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:33.530160] [DEBUG] [MAIN ] SKLZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:33.530301] [INFO ] [MAIN ] SKM: Loaded 35557 primary data records. [2025-09-29T02:22:33.532194] [INFO ] [MAIN ] SKLZ: Generated 1820 derivative records from 12122 primary records. [2025-09-29T02:22:33.531259] [INFO ] [MAIN ] SKIL: Generated 1820 derivative records from 6395 primary records. [2025-09-29T02:22:33.557490] [DEBUG] [LOCAL ] SKLZ: Saving derivative data. [2025-09-29T02:22:33.569662] [DEBUG] [LOCAL ] SKIL: Saving derivative data. [2025-09-29T02:22:33.704825] [DEBUG] [LOCAL ] SKIL: Derivative data saved (1820 records). [2025-09-29T02:22:33.716034] [DEBUG] [LOCAL ] SKLZ: Derivative data saved (1820 records). [2025-09-29T02:22:33.743318] [INFO ] [MAIN ] SKLZ: Successfully saved derivative data. [2025-09-29T02:22:33.733471] [INFO ] [MAIN ] SKIL: Successfully saved derivative data. [2025-09-29T02:22:33.905153] [INFO ] [MAIN ] Derivative Progress: 1789/2211 symbols completed. SKIL took 1.2s. Estimated remaining: 2m 59s. Rate: 141.8 symbols/min [2025-09-29T02:22:33.908934] [INFO ] [MAIN ] SKT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:33.909034] [INFO ] [MAIN ] Derivative Progress: 1790/2211 symbols completed. SKLZ took 1.2s. Estimated remaining: 2m 58s. Rate: 141.9 symbols/min [2025-09-29T02:22:33.910177] [INFO ] [MAIN ] SKY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:33.954441] [DEBUG] [MAIN ] SKM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:33.955361] [INFO ] [MAIN ] SKM: Generated 1820 derivative records from 35557 primary records. [2025-09-29T02:22:33.955692] [DEBUG] [LOCAL ] SKM: Saving derivative data. [2025-09-29T02:22:33.997081] [DEBUG] [LOCAL ] SKM: Derivative data saved (1820 records). [2025-09-29T02:22:33.998962] [DEBUG] [LOCAL ] SKY: Loaded 38305 existing records from primary storage. [2025-09-29T02:22:33.999352] [INFO ] [MAIN ] SKM: Successfully saved derivative data. [2025-09-29T02:22:34.002683] [INFO ] [MAIN ] Derivative Progress: 1791/2211 symbols completed. SKM took 1.0s. Estimated remaining: 2m 58s. Rate: 141.9 symbols/min [2025-09-29T02:22:33.999504] [INFO ] [MAIN ] SKY: Loaded 38305 primary data records. [2025-09-29T02:22:34.003335] [INFO ] [MAIN ] SKYH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:34.103322] [DEBUG] [LOCAL ] SKT: Loaded 43227 existing records from primary storage. [2025-09-29T02:22:34.141631] [INFO ] [MAIN ] SKT: Loaded 43227 primary data records. [2025-09-29T02:22:34.437839] [DEBUG] [LOCAL ] SKYH: Loaded 16851 existing records from primary storage. [2025-09-29T02:22:34.495084] [INFO ] [MAIN ] SKYH: Loaded 16851 primary data records. [2025-09-29T02:22:35.228776] [DEBUG] [MAIN ] SKY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:35.231962] [INFO ] [MAIN ] SKY: Generated 1820 derivative records from 38305 primary records. [2025-09-29T02:22:35.233241] [DEBUG] [LOCAL ] SKY: Saving derivative data. [2025-09-29T02:22:35.252928] [DEBUG] [LOCAL ] SKY: Derivative data saved (1820 records). [2025-09-29T02:22:35.253157] [INFO ] [MAIN ] SKY: Successfully saved derivative data. [2025-09-29T02:22:35.255764] [INFO ] [MAIN ] Derivative Progress: 1792/2211 symbols completed. SKY took 1.3s. Estimated remaining: 2m 57s. Rate: 141.8 symbols/min [2025-09-29T02:22:35.256271] [INFO ] [MAIN ] SLB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:35.282677] [DEBUG] [MAIN ] SKT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:35.284835] [INFO ] [MAIN ] SKT: Generated 1820 derivative records from 43227 primary records. [2025-09-29T02:22:35.285464] [DEBUG] [LOCAL ] SKT: Saving derivative data. [2025-09-29T02:22:35.308136] [DEBUG] [LOCAL ] SKT: Derivative data saved (1820 records). [2025-09-29T02:22:35.308375] [INFO ] [MAIN ] SKT: Successfully saved derivative data. [2025-09-29T02:22:35.312360] [INFO ] [MAIN ] Derivative Progress: 1793/2211 symbols completed. SKT took 1.4s. Estimated remaining: 2m 57s. Rate: 141.9 symbols/min [2025-09-29T02:22:35.312914] [INFO ] [MAIN ] SLF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:35.327754] [DEBUG] [MAIN ] SKYH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:35.328622] [INFO ] [MAIN ] SKYH: Generated 1820 derivative records from 16851 primary records. [2025-09-29T02:22:35.328741] [DEBUG] [LOCAL ] SKYH: Saving derivative data. [2025-09-29T02:22:35.347312] [DEBUG] [LOCAL ] SKYH: Derivative data saved (1820 records). [2025-09-29T02:22:35.347531] [INFO ] [MAIN ] SKYH: Successfully saved derivative data. [2025-09-29T02:22:35.350986] [INFO ] [MAIN ] Derivative Progress: 1794/2211 symbols completed. SKYH took 1.3s. Estimated remaining: 2m 56s. Rate: 141.9 symbols/min [2025-09-29T02:22:35.351393] [INFO ] [MAIN ] SLG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:35.401694] [DEBUG] [LOCAL ] SLB: Loaded 54477 existing records from primary storage. [2025-09-29T02:22:35.415205] [INFO ] [MAIN ] SLB: Loaded 54477 primary data records. [2025-09-29T02:22:35.585810] [DEBUG] [LOCAL ] SLF: Loaded 39426 existing records from primary storage. [2025-09-29T02:22:35.587265] [INFO ] [MAIN ] SLF: Loaded 39426 primary data records. [2025-09-29T02:22:35.890331] [DEBUG] [LOCAL ] SLG: Loaded 46130 existing records from primary storage. [2025-09-29T02:22:35.931675] [INFO ] [MAIN ] SLG: Loaded 46130 primary data records. [2025-09-29T02:22:36.594246] [DEBUG] [MAIN ] SLB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:36.596998] [INFO ] [MAIN ] SLB: Generated 1820 derivative records from 54477 primary records. [2025-09-29T02:22:36.598358] [DEBUG] [LOCAL ] SLB: Saving derivative data. [2025-09-29T02:22:36.642407] [DEBUG] [MAIN ] SLF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:36.643612] [DEBUG] [LOCAL ] SLB: Derivative data saved (1820 records). [2025-09-29T02:22:36.645471] [INFO ] [MAIN ] SLF: Generated 1820 derivative records from 39426 primary records. [2025-09-29T02:22:36.645631] [DEBUG] [LOCAL ] SLF: Saving derivative data. [2025-09-29T02:22:36.645842] [INFO ] [MAIN ] SLB: Successfully saved derivative data. [2025-09-29T02:22:36.650890] [INFO ] [MAIN ] Derivative Progress: 1795/2211 symbols completed. SLB took 1.4s. Estimated remaining: 2m 56s. Rate: 141.8 symbols/min [2025-09-29T02:22:36.653567] [INFO ] [MAIN ] SLGN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:36.674085] [DEBUG] [LOCAL ] SLF: Derivative data saved (1820 records). [2025-09-29T02:22:36.691688] [INFO ] [MAIN ] SLF: Successfully saved derivative data. [2025-09-29T02:22:36.696380] [INFO ] [MAIN ] Derivative Progress: 1796/2211 symbols completed. SLF took 1.4s. Estimated remaining: 2m 56s. Rate: 141.8 symbols/min [2025-09-29T02:22:36.692217] [DEBUG] [MAIN ] SLG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:36.696838] [INFO ] [MAIN ] SLQT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:36.698692] [INFO ] [MAIN ] SLG: Generated 1820 derivative records from 46130 primary records. [2025-09-29T02:22:36.699279] [DEBUG] [LOCAL ] SLG: Saving derivative data. [2025-09-29T02:22:36.717792] [DEBUG] [LOCAL ] SLG: Derivative data saved (1820 records). [2025-09-29T02:22:36.717937] [INFO ] [MAIN ] SLG: Successfully saved derivative data. [2025-09-29T02:22:36.721997] [INFO ] [MAIN ] Derivative Progress: 1797/2211 symbols completed. SLG took 1.4s. Estimated remaining: 2m 55s. Rate: 141.9 symbols/min [2025-09-29T02:22:36.722397] [INFO ] [MAIN ] SLVM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:36.780708] [DEBUG] [LOCAL ] SLGN: Loaded 41039 existing records from primary storage. [2025-09-29T02:22:36.781018] [INFO ] [MAIN ] SLGN: Loaded 41039 primary data records. [2025-09-29T02:22:36.792536] [DEBUG] [LOCAL ] SLVM: Loaded 28332 existing records from primary storage. [2025-09-29T02:22:36.835591] [INFO ] [MAIN ] SLVM: Loaded 28332 primary data records. [2025-09-29T02:22:36.968833] [DEBUG] [LOCAL ] SLQT: Loaded 44370 existing records from primary storage. [2025-09-29T02:22:37.028622] [INFO ] [MAIN ] SLQT: Loaded 44370 primary data records. [2025-09-29T02:22:37.965222] [DEBUG] [MAIN ] SLGN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:37.967372] [INFO ] [MAIN ] SLGN: Generated 1820 derivative records from 41039 primary records. [2025-09-29T02:22:37.968184] [DEBUG] [LOCAL ] SLGN: Saving derivative data. [2025-09-29T02:22:37.992099] [DEBUG] [LOCAL ] SLGN: Derivative data saved (1820 records). [2025-09-29T02:22:38.010995] [INFO ] [MAIN ] SLGN: Successfully saved derivative data. [2025-09-29T02:22:38.011590] [DEBUG] [MAIN ] SLVM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:38.014975] [INFO ] [MAIN ] Derivative Progress: 1798/2211 symbols completed. SLGN took 1.4s. Estimated remaining: 2m 55s. Rate: 141.7 symbols/min [2025-09-29T02:22:38.017206] [INFO ] [MAIN ] SLVM: Generated 1820 derivative records from 28332 primary records. [2025-09-29T02:22:38.017612] [DEBUG] [LOCAL ] SLVM: Saving derivative data. [2025-09-29T02:22:38.037761] [DEBUG] [LOCAL ] SLVM: Derivative data saved (1820 records). [2025-09-29T02:22:38.038745] [INFO ] [MAIN ] SLVM: Successfully saved derivative data. [2025-09-29T02:22:38.043266] [INFO ] [MAIN ] Derivative Progress: 1799/2211 symbols completed. SLVM took 1.3s. Estimated remaining: 2m 54s. Rate: 141.8 symbols/min [2025-09-29T02:22:38.057080] [DEBUG] [MAIN ] SLQT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:38.057884] [INFO ] [MAIN ] SLQT: Generated 1820 derivative records from 44370 primary records. [2025-09-29T02:22:38.058004] [DEBUG] [LOCAL ] SLQT: Saving derivative data. [2025-09-29T02:22:38.074362] [DEBUG] [LOCAL ] SLQT: Derivative data saved (1820 records). [2025-09-29T02:22:38.074518] [INFO ] [MAIN ] SLQT: Successfully saved derivative data. [2025-09-29T02:22:38.078730] [INFO ] [MAIN ] Derivative Progress: 1800/2211 symbols completed. SLQT took 1.4s. Estimated remaining: 2m 54s. Rate: 141.9 symbols/min [2025-09-29T02:22:38.079235] [INFO ] [MAIN ] SM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:38.079285] [INFO ] [MAIN ] SMC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:38.079347] [INFO ] [MAIN ] SMBK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:38.099731] [DEBUG] [LOCAL ] SMBK: Loaded 8332 existing records from primary storage. [2025-09-29T02:22:38.100086] [INFO ] [MAIN ] SMBK: Loaded 8332 primary data records. [2025-09-29T02:22:38.129363] [DEBUG] [LOCAL ] SMC: Loaded 11630 existing records from primary storage. [2025-09-29T02:22:38.180617] [INFO ] [MAIN ] SMC: Loaded 11630 primary data records. [2025-09-29T02:22:38.685288] [DEBUG] [LOCAL ] SM: Loaded 53080 existing records from primary storage. [2025-09-29T02:22:38.831917] [INFO ] [MAIN ] SM: Loaded 53080 primary data records. [2025-09-29T02:22:39.290317] [DEBUG] [MAIN ] SMBK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:39.304359] [DEBUG] [MAIN ] SMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:39.306949] [INFO ] [MAIN ] SMC: Generated 1820 derivative records from 11630 primary records. [2025-09-29T02:22:39.307075] [DEBUG] [LOCAL ] SMC: Saving derivative data. [2025-09-29T02:22:39.305567] [INFO ] [MAIN ] SMBK: Generated 1820 derivative records from 8332 primary records. [2025-09-29T02:22:39.308205] [DEBUG] [LOCAL ] SMBK: Saving derivative data. [2025-09-29T02:22:39.336223] [DEBUG] [LOCAL ] SMC: Derivative data saved (1820 records). [2025-09-29T02:22:39.339468] [INFO ] [MAIN ] SMC: Successfully saved derivative data. [2025-09-29T02:22:39.345119] [INFO ] [MAIN ] Derivative Progress: 1801/2211 symbols completed. SMC took 1.3s. Estimated remaining: 2m 54s. Rate: 141.7 symbols/min [2025-09-29T02:22:39.345567] [INFO ] [MAIN ] SMFG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:39.348382] [DEBUG] [LOCAL ] SMBK: Derivative data saved (1820 records). [2025-09-29T02:22:39.348911] [INFO ] [MAIN ] SMBK: Successfully saved derivative data. [2025-09-29T02:22:39.351778] [INFO ] [MAIN ] Derivative Progress: 1802/2211 symbols completed. SMBK took 1.3s. Estimated remaining: 2m 53s. Rate: 141.8 symbols/min [2025-09-29T02:22:39.352208] [INFO ] [MAIN ] SMG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:39.373972] [DEBUG] [MAIN ] SM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:39.376263] [INFO ] [MAIN ] SM: Generated 1820 derivative records from 53080 primary records. [2025-09-29T02:22:39.376498] [DEBUG] [LOCAL ] SM: Saving derivative data. [2025-09-29T02:22:39.395914] [DEBUG] [LOCAL ] SM: Derivative data saved (1820 records). [2025-09-29T02:22:39.396111] [INFO ] [MAIN ] SM: Successfully saved derivative data. [2025-09-29T02:22:39.399775] [INFO ] [MAIN ] Derivative Progress: 1803/2211 symbols completed. SM took 1.3s. Estimated remaining: 2m 53s. Rate: 141.9 symbols/min [2025-09-29T02:22:39.400171] [INFO ] [MAIN ] SMHI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:39.442780] [DEBUG] [LOCAL ] SMHI: Loaded 13885 existing records from primary storage. [2025-09-29T02:22:39.456676] [INFO ] [MAIN ] SMHI: Loaded 13885 primary data records. [2025-09-29T02:22:39.489092] [DEBUG] [LOCAL ] SMFG: Loaded 48771 existing records from primary storage. [2025-09-29T02:22:39.488049] [DEBUG] [LOCAL ] SMG: Loaded 44546 existing records from primary storage. [2025-09-29T02:22:39.516501] [INFO ] [MAIN ] SMFG: Loaded 48771 primary data records. [2025-09-29T02:22:39.538396] [INFO ] [MAIN ] SMG: Loaded 44546 primary data records. [2025-09-29T02:22:40.531248] [DEBUG] [MAIN ] SMHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:40.533171] [INFO ] [MAIN ] SMHI: Generated 1820 derivative records from 13885 primary records. [2025-09-29T02:22:40.533522] [DEBUG] [LOCAL ] SMHI: Saving derivative data. [2025-09-29T02:22:40.570244] [DEBUG] [LOCAL ] SMHI: Derivative data saved (1820 records). [2025-09-29T02:22:40.594342] [INFO ] [MAIN ] SMHI: Successfully saved derivative data. [2025-09-29T02:22:40.594099] [DEBUG] [MAIN ] SMG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:40.597061] [INFO ] [MAIN ] Derivative Progress: 1804/2211 symbols completed. SMHI took 1.2s. Estimated remaining: 2m 52s. Rate: 141.7 symbols/min [2025-09-29T02:22:40.598445] [INFO ] [MAIN ] SMG: Generated 1820 derivative records from 44546 primary records. [2025-09-29T02:22:40.597549] [DEBUG] [MAIN ] SMFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:40.599490] [INFO ] [MAIN ] SMP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:40.599599] [INFO ] [MAIN ] SMFG: Generated 1820 derivative records from 48771 primary records. [2025-09-29T02:22:40.599720] [DEBUG] [LOCAL ] SMG: Saving derivative data. [2025-09-29T02:22:40.600407] [DEBUG] [LOCAL ] SMFG: Saving derivative data. [2025-09-29T02:22:40.636764] [DEBUG] [LOCAL ] SMFG: Derivative data saved (1820 records). [2025-09-29T02:22:40.641869] [INFO ] [MAIN ] SMFG: Successfully saved derivative data. [2025-09-29T02:22:40.641704] [DEBUG] [LOCAL ] SMG: Derivative data saved (1820 records). [2025-09-29T02:22:40.647457] [INFO ] [MAIN ] SMG: Successfully saved derivative data. [2025-09-29T02:22:40.647253] [INFO ] [MAIN ] Derivative Progress: 1805/2211 symbols completed. SMFG took 1.3s. Estimated remaining: 2m 52s. Rate: 141.8 symbols/min [2025-09-29T02:22:40.658174] [INFO ] [MAIN ] SMR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:40.658293] [INFO ] [MAIN ] Derivative Progress: 1806/2211 symbols completed. SMG took 1.3s. Estimated remaining: 2m 51s. Rate: 141.9 symbols/min [2025-09-29T02:22:40.658983] [INFO ] [MAIN ] SMRT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:40.675094] [DEBUG] [LOCAL ] SMP: Loaded 19999 existing records from primary storage. [2025-09-29T02:22:40.675616] [INFO ] [MAIN ] SMP: Loaded 19999 primary data records. [2025-09-29T02:22:41.103859] [DEBUG] [LOCAL ] SMR: Loaded 54577 existing records from primary storage. [2025-09-29T02:22:41.104210] [INFO ] [MAIN ] SMR: Loaded 54577 primary data records. [2025-09-29T02:22:41.105618] [DEBUG] [LOCAL ] SMRT: Loaded 44707 existing records from primary storage. [2025-09-29T02:22:41.111285] [INFO ] [MAIN ] SMRT: Loaded 44707 primary data records. [2025-09-29T02:22:41.919242] [DEBUG] [MAIN ] SMP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:41.922072] [INFO ] [MAIN ] SMP: Generated 1820 derivative records from 19999 primary records. [2025-09-29T02:22:41.922718] [DEBUG] [LOCAL ] SMP: Saving derivative data. [2025-09-29T02:22:41.944692] [DEBUG] [LOCAL ] SMP: Derivative data saved (1820 records). [2025-09-29T02:22:41.945090] [INFO ] [MAIN ] SMP: Successfully saved derivative data. [2025-09-29T02:22:41.948200] [INFO ] [MAIN ] Derivative Progress: 1807/2211 symbols completed. SMP took 1.3s. Estimated remaining: 2m 51s. Rate: 141.7 symbols/min [2025-09-29T02:22:41.949129] [INFO ] [MAIN ] SMWB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:41.981308] [DEBUG] [MAIN ] SMR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:41.989094] [INFO ] [MAIN ] SMR: Generated 1820 derivative records from 54577 primary records. [2025-09-29T02:22:41.999386] [DEBUG] [MAIN ] SMRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:42.000575] [INFO ] [MAIN ] SMRT: Generated 1820 derivative records from 44707 primary records. [2025-09-29T02:22:41.999715] [DEBUG] [LOCAL ] SMR: Saving derivative data. [2025-09-29T02:22:42.001720] [DEBUG] [LOCAL ] SMRT: Saving derivative data. [2025-09-29T02:22:42.040222] [DEBUG] [LOCAL ] SMR: Derivative data saved (1820 records). [2025-09-29T02:22:42.050018] [DEBUG] [LOCAL ] SMWB: Loaded 33137 existing records from primary storage. [2025-09-29T02:22:42.050133] [INFO ] [MAIN ] SMR: Successfully saved derivative data. [2025-09-29T02:22:42.050351] [INFO ] [MAIN ] SMWB: Loaded 33137 primary data records. [2025-09-29T02:22:42.053448] [INFO ] [MAIN ] Derivative Progress: 1808/2211 symbols completed. SMR took 1.4s. Estimated remaining: 2m 51s. Rate: 141.8 symbols/min [2025-09-29T02:22:42.048387] [DEBUG] [LOCAL ] SMRT: Derivative data saved (1820 records). [2025-09-29T02:22:42.053810] [INFO ] [MAIN ] SN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:42.054157] [INFO ] [MAIN ] SMRT: Successfully saved derivative data. [2025-09-29T02:22:42.094778] [INFO ] [MAIN ] Derivative Progress: 1809/2211 symbols completed. SMRT took 1.4s. Estimated remaining: 2m 50s. Rate: 141.9 symbols/min [2025-09-29T02:22:42.108473] [INFO ] [MAIN ] SNA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:42.419918] [DEBUG] [LOCAL ] SNA: Loaded 26608 existing records from primary storage. [2025-09-29T02:22:42.538763] [INFO ] [MAIN ] SNA: Loaded 26608 primary data records. [2025-09-29T02:22:42.673452] [DEBUG] [LOCAL ] SN: Loaded 50487 existing records from primary storage. [2025-09-29T02:22:42.686594] [INFO ] [MAIN ] SN: Loaded 50487 primary data records. [2025-09-29T02:22:42.872342] [DEBUG] [MAIN ] SMWB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:42.874198] [INFO ] [MAIN ] SMWB: Generated 1820 derivative records from 33137 primary records. [2025-09-29T02:22:42.950414] [DEBUG] [LOCAL ] SMWB: Saving derivative data. [2025-09-29T02:22:43.584975] [DEBUG] [LOCAL ] SMWB: Derivative data saved (1820 records). [2025-09-29T02:22:43.585624] [INFO ] [MAIN ] SMWB: Successfully saved derivative data. [2025-09-29T02:22:43.588599] [INFO ] [MAIN ] Derivative Progress: 1810/2211 symbols completed. SMWB took 1.6s. Estimated remaining: 2m 50s. Rate: 141.7 symbols/min [2025-09-29T02:22:43.591753] [INFO ] [MAIN ] SNAP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:43.627201] [DEBUG] [MAIN ] SNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:43.643764] [INFO ] [MAIN ] SNA: Generated 1820 derivative records from 26608 primary records. [2025-09-29T02:22:43.644270] [DEBUG] [MAIN ] SN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:43.644686] [DEBUG] [LOCAL ] SNA: Saving derivative data. [2025-09-29T02:22:43.646116] [INFO ] [MAIN ] SN: Generated 1820 derivative records from 50487 primary records. [2025-09-29T02:22:43.646525] [DEBUG] [LOCAL ] SN: Saving derivative data. [2025-09-29T02:22:43.694585] [DEBUG] [LOCAL ] SNA: Derivative data saved (1820 records). [2025-09-29T02:22:43.700851] [DEBUG] [LOCAL ] SN: Derivative data saved (1820 records). [2025-09-29T02:22:43.701057] [INFO ] [MAIN ] SNA: Successfully saved derivative data. [2025-09-29T02:22:43.719370] [INFO ] [MAIN ] SN: Successfully saved derivative data. [2025-09-29T02:22:43.722565] [INFO ] [MAIN ] Derivative Progress: 1811/2211 symbols completed. SNA took 1.6s. Estimated remaining: 2m 49s. Rate: 141.7 symbols/min [2025-09-29T02:22:43.724279] [DEBUG] [LOCAL ] SNAP: Loaded 54576 existing records from primary storage. [2025-09-29T02:22:43.727806] [INFO ] [MAIN ] SNDA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:43.728068] [INFO ] [MAIN ] Derivative Progress: 1812/2211 symbols completed. SN took 1.7s. Estimated remaining: 2m 49s. Rate: 141.8 symbols/min [2025-09-29T02:22:43.728304] [INFO ] [MAIN ] SNAP: Loaded 54576 primary data records. [2025-09-29T02:22:43.728924] [INFO ] [MAIN ] SNDR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:43.832363] [DEBUG] [LOCAL ] SNDA: Loaded 4732 existing records from primary storage. [2025-09-29T02:22:43.858604] [INFO ] [MAIN ] SNDA: Loaded 4732 primary data records. [2025-09-29T02:22:44.274614] [DEBUG] [LOCAL ] SNDR: Loaded 41368 existing records from primary storage. [2025-09-29T02:22:44.281062] [INFO ] [MAIN ] SNDR: Loaded 41368 primary data records. [2025-09-29T02:22:44.955116] [DEBUG] [MAIN ] SNAP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:44.957308] [INFO ] [MAIN ] SNAP: Generated 1820 derivative records from 54576 primary records. [2025-09-29T02:22:44.957789] [DEBUG] [LOCAL ] SNAP: Saving derivative data. [2025-09-29T02:22:44.981398] [DEBUG] [LOCAL ] SNAP: Derivative data saved (1820 records). [2025-09-29T02:22:44.994925] [INFO ] [MAIN ] SNAP: Successfully saved derivative data. [2025-09-29T02:22:45.000547] [DEBUG] [MAIN ] SNDA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:44.999790] [INFO ] [MAIN ] Derivative Progress: 1813/2211 symbols completed. SNAP took 1.4s. Estimated remaining: 2m 49s. Rate: 141.6 symbols/min [2025-09-29T02:22:45.002242] [INFO ] [MAIN ] SNDA: Generated 1820 derivative records from 4732 primary records. [2025-09-29T02:22:45.002674] [DEBUG] [LOCAL ] SNDA: Saving derivative data. [2025-09-29T02:22:45.021880] [DEBUG] [LOCAL ] SNDA: Derivative data saved (1820 records). [2025-09-29T02:22:45.022288] [INFO ] [MAIN ] SNDA: Successfully saved derivative data. [2025-09-29T02:22:45.038625] [DEBUG] [MAIN ] SNDR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:45.037952] [INFO ] [MAIN ] Derivative Progress: 1814/2211 symbols completed. SNDA took 1.3s. Estimated remaining: 2m 48s. Rate: 141.7 symbols/min [2025-09-29T02:22:45.039524] [INFO ] [MAIN ] SNDR: Generated 1820 derivative records from 41368 primary records. [2025-09-29T02:22:45.039736] [DEBUG] [LOCAL ] SNDR: Saving derivative data. [2025-09-29T02:22:45.057145] [DEBUG] [LOCAL ] SNDR: Derivative data saved (1820 records). [2025-09-29T02:22:45.057365] [INFO ] [MAIN ] SNDR: Successfully saved derivative data. [2025-09-29T02:22:45.061284] [INFO ] [MAIN ] Derivative Progress: 1815/2211 symbols completed. SNDR took 1.3s. Estimated remaining: 2m 48s. Rate: 141.8 symbols/min [2025-09-29T02:22:45.061808] [INFO ] [MAIN ] SNN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:45.062233] [INFO ] [MAIN ] SNV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:45.062498] [INFO ] [MAIN ] SNOW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:45.146161] [DEBUG] [LOCAL ] SNN: Loaded 45037 existing records from primary storage. [2025-09-29T02:22:45.163508] [INFO ] [MAIN ] SNN: Loaded 45037 primary data records. [2025-09-29T02:22:45.180566] [DEBUG] [LOCAL ] SNOW: Loaded 54371 existing records from primary storage. [2025-09-29T02:22:45.186715] [DEBUG] [LOCAL ] SNV: Loaded 49633 existing records from primary storage. [2025-09-29T02:22:45.231154] [INFO ] [MAIN ] SNOW: Loaded 54371 primary data records. [2025-09-29T02:22:45.240104] [INFO ] [MAIN ] SNV: Loaded 49633 primary data records. [2025-09-29T02:22:46.369228] [DEBUG] [MAIN ] SNN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:46.370688] [INFO ] [MAIN ] SNN: Generated 1820 derivative records from 45037 primary records. [2025-09-29T02:22:46.370906] [DEBUG] [LOCAL ] SNN: Saving derivative data. [2025-09-29T02:22:46.396413] [DEBUG] [MAIN ] SNOW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:46.405191] [DEBUG] [LOCAL ] SNN: Derivative data saved (1820 records). [2025-09-29T02:22:46.406243] [INFO ] [MAIN ] SNOW: Generated 1820 derivative records from 54371 primary records. [2025-09-29T02:22:46.420894] [DEBUG] [LOCAL ] SNOW: Saving derivative data. [2025-09-29T02:22:46.421302] [DEBUG] [MAIN ] SNV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:46.421399] [INFO ] [MAIN ] SNN: Successfully saved derivative data. [2025-09-29T02:22:46.426632] [INFO ] [MAIN ] Derivative Progress: 1816/2211 symbols completed. SNN took 1.4s. Estimated remaining: 2m 47s. Rate: 141.6 symbols/min [2025-09-29T02:22:46.426955] [INFO ] [MAIN ] SNX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:46.422353] [INFO ] [MAIN ] SNV: Generated 1820 derivative records from 49633 primary records. [2025-09-29T02:22:46.436847] [DEBUG] [LOCAL ] SNV: Saving derivative data. [2025-09-29T02:22:46.465433] [DEBUG] [LOCAL ] SNV: Derivative data saved (1820 records). [2025-09-29T02:22:46.461365] [DEBUG] [LOCAL ] SNOW: Derivative data saved (1820 records). [2025-09-29T02:22:46.465707] [INFO ] [MAIN ] SNV: Successfully saved derivative data. [2025-09-29T02:22:46.465842] [INFO ] [MAIN ] SNOW: Successfully saved derivative data. [2025-09-29T02:22:46.469176] [INFO ] [MAIN ] Derivative Progress: 1817/2211 symbols completed. SNV took 1.4s. Estimated remaining: 2m 47s. Rate: 141.7 symbols/min [2025-09-29T02:22:46.473003] [INFO ] [MAIN ] SO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:46.473092] [INFO ] [MAIN ] Derivative Progress: 1818/2211 symbols completed. SNOW took 1.4s. Estimated remaining: 2m 46s. Rate: 141.7 symbols/min [2025-09-29T02:22:46.473865] [INFO ] [MAIN ] SOBO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:46.538908] [DEBUG] [LOCAL ] SNX: Loaded 40540 existing records from primary storage. [2025-09-29T02:22:46.539422] [INFO ] [MAIN ] SNX: Loaded 40540 primary data records. [2025-09-29T02:22:46.688828] [DEBUG] [LOCAL ] SOBO: Loaded 40211 existing records from primary storage. [2025-09-29T02:22:46.709825] [INFO ] [MAIN ] SOBO: Loaded 40211 primary data records. [2025-09-29T02:22:46.734400] [DEBUG] [LOCAL ] SO: Loaded 54383 existing records from primary storage. [2025-09-29T02:22:46.760593] [INFO ] [MAIN ] SO: Loaded 54383 primary data records. [2025-09-29T02:22:47.706926] [DEBUG] [MAIN ] SNX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:47.708340] [INFO ] [MAIN ] SNX: Generated 1820 derivative records from 40540 primary records. [2025-09-29T02:22:47.708923] [DEBUG] [LOCAL ] SNX: Saving derivative data. [2025-09-29T02:22:47.731587] [DEBUG] [LOCAL ] SNX: Derivative data saved (1820 records). [2025-09-29T02:22:47.732086] [INFO ] [MAIN ] SNX: Successfully saved derivative data. [2025-09-29T02:22:47.734598] [INFO ] [MAIN ] Derivative Progress: 1819/2211 symbols completed. SNX took 1.3s. Estimated remaining: 2m 46s. Rate: 141.6 symbols/min [2025-09-29T02:22:47.735882] [INFO ] [MAIN ] SOC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:47.757168] [DEBUG] [MAIN ] SOBO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:47.760871] [INFO ] [MAIN ] SOBO: Generated 1820 derivative records from 40211 primary records. [2025-09-29T02:22:47.775143] [DEBUG] [LOCAL ] SOBO: Saving derivative data. [2025-09-29T02:22:47.775919] [DEBUG] [MAIN ] SO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:47.776844] [INFO ] [MAIN ] SO: Generated 1820 derivative records from 54383 primary records. [2025-09-29T02:22:47.777003] [DEBUG] [LOCAL ] SO: Saving derivative data. [2025-09-29T02:22:47.809278] [DEBUG] [LOCAL ] SOBO: Derivative data saved (1820 records). [2025-09-29T02:22:47.814697] [INFO ] [MAIN ] SOBO: Successfully saved derivative data. [2025-09-29T02:22:47.816315] [DEBUG] [LOCAL ] SO: Derivative data saved (1820 records). [2025-09-29T02:22:47.816536] [INFO ] [MAIN ] SO: Successfully saved derivative data. [2025-09-29T02:22:47.820871] [INFO ] [MAIN ] Derivative Progress: 1820/2211 symbols completed. SO took 1.3s. Estimated remaining: 2m 46s. Rate: 141.7 symbols/min [2025-09-29T02:22:47.821243] [INFO ] [MAIN ] SOJC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:47.825233] [INFO ] [MAIN ] Derivative Progress: 1821/2211 symbols completed. SOBO took 1.4s. Estimated remaining: 2m 45s. Rate: 141.7 symbols/min [2025-09-29T02:22:47.841906] [INFO ] [MAIN ] SOJD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:47.874707] [DEBUG] [LOCAL ] SOJC: Loaded 5120 existing records from primary storage. [2025-09-29T02:22:47.875061] [INFO ] [MAIN ] SOJC: Loaded 5120 primary data records. [2025-09-29T02:22:47.882677] [DEBUG] [LOCAL ] SOC: Loaded 51041 existing records from primary storage. [2025-09-29T02:22:47.926115] [INFO ] [MAIN ] SOC: Loaded 51041 primary data records. [2025-09-29T02:22:47.964116] [DEBUG] [LOCAL ] SOJD: Loaded 13180 existing records from primary storage. [2025-09-29T02:22:47.996150] [INFO ] [MAIN ] SOJD: Loaded 13180 primary data records. [2025-09-29T02:22:49.147685] [DEBUG] [MAIN ] SOJC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:49.150843] [INFO ] [MAIN ] SOJC: Generated 1820 derivative records from 5120 primary records. [2025-09-29T02:22:49.151225] [DEBUG] [LOCAL ] SOJC: Saving derivative data. [2025-09-29T02:22:49.168760] [DEBUG] [MAIN ] SOC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:49.171166] [INFO ] [MAIN ] SOC: Generated 1820 derivative records from 51041 primary records. [2025-09-29T02:22:49.188415] [DEBUG] [LOCAL ] SOJC: Derivative data saved (1820 records). [2025-09-29T02:22:49.184967] [DEBUG] [LOCAL ] SOC: Saving derivative data. [2025-09-29T02:22:49.189444] [INFO ] [MAIN ] SOJC: Successfully saved derivative data. [2025-09-29T02:22:49.192423] [INFO ] [MAIN ] Derivative Progress: 1822/2211 symbols completed. SOJC took 1.4s. Estimated remaining: 2m 45s. Rate: 141.6 symbols/min [2025-09-29T02:22:49.192776] [INFO ] [MAIN ] SOJE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:49.224897] [DEBUG] [MAIN ] SOJD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:49.229851] [INFO ] [MAIN ] SOJD: Generated 1820 derivative records from 13180 primary records. [2025-09-29T02:22:49.228798] [DEBUG] [LOCAL ] SOC: Derivative data saved (1820 records). [2025-09-29T02:22:49.230151] [DEBUG] [LOCAL ] SOJD: Saving derivative data. [2025-09-29T02:22:49.230242] [INFO ] [MAIN ] SOC: Successfully saved derivative data. [2025-09-29T02:22:49.234520] [INFO ] [MAIN ] Derivative Progress: 1823/2211 symbols completed. SOC took 1.5s. Estimated remaining: 2m 44s. Rate: 141.6 symbols/min [2025-09-29T02:22:49.238069] [INFO ] [MAIN ] SOL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:49.259595] [DEBUG] [LOCAL ] SOJE: Loaded 9408 existing records from primary storage. [2025-09-29T02:22:49.261989] [DEBUG] [LOCAL ] SOJD: Derivative data saved (1820 records). [2025-09-29T02:22:49.262267] [INFO ] [MAIN ] SOJE: Loaded 9408 primary data records. [2025-09-29T02:22:49.262375] [INFO ] [MAIN ] SOJD: Successfully saved derivative data. [2025-09-29T02:22:49.284983] [INFO ] [MAIN ] Derivative Progress: 1824/2211 symbols completed. SOJD took 1.4s. Estimated remaining: 2m 44s. Rate: 141.7 symbols/min [2025-09-29T02:22:49.304455] [INFO ] [MAIN ] SOLV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:49.402217] [DEBUG] [LOCAL ] SOL: Loaded 13694 existing records from primary storage. [2025-09-29T02:22:49.408601] [INFO ] [MAIN ] SOL: Loaded 13694 primary data records. [2025-09-29T02:22:49.849214] [DEBUG] [LOCAL ] SOLV: Loaded 44791 existing records from primary storage. [2025-09-29T02:22:49.884784] [INFO ] [MAIN ] SOLV: Loaded 44791 primary data records. [2025-09-29T02:22:50.397158] [DEBUG] [MAIN ] SOJE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:50.399018] [INFO ] [MAIN ] SOJE: Generated 1820 derivative records from 9408 primary records. [2025-09-29T02:22:50.399297] [DEBUG] [LOCAL ] SOJE: Saving derivative data. [2025-09-29T02:22:50.424736] [DEBUG] [LOCAL ] SOJE: Derivative data saved (1820 records). [2025-09-29T02:22:50.425410] [INFO ] [MAIN ] SOJE: Successfully saved derivative data. [2025-09-29T02:22:50.441376] [INFO ] [MAIN ] Derivative Progress: 1825/2211 symbols completed. SOJE took 1.2s. Estimated remaining: 2m 44s. Rate: 141.6 symbols/min [2025-09-29T02:22:50.443529] [INFO ] [MAIN ] SON: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:50.442322] [DEBUG] [MAIN ] SOL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:50.444896] [INFO ] [MAIN ] SOL: Generated 1820 derivative records from 13694 primary records. [2025-09-29T02:22:50.445455] [DEBUG] [LOCAL ] SOL: Saving derivative data. [2025-09-29T02:22:50.463822] [DEBUG] [LOCAL ] SOL: Derivative data saved (1820 records). [2025-09-29T02:22:50.464006] [INFO ] [MAIN ] SOL: Successfully saved derivative data. [2025-09-29T02:22:50.466370] [INFO ] [MAIN ] Derivative Progress: 1826/2211 symbols completed. SOL took 1.2s. Estimated remaining: 2m 43s. Rate: 141.6 symbols/min [2025-09-29T02:22:50.466962] [INFO ] [MAIN ] SONY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:50.486593] [DEBUG] [MAIN ] SOLV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:50.487834] [INFO ] [MAIN ] SOLV: Generated 1820 derivative records from 44791 primary records. [2025-09-29T02:22:50.487967] [DEBUG] [LOCAL ] SOLV: Saving derivative data. [2025-09-29T02:22:50.512703] [DEBUG] [LOCAL ] SOLV: Derivative data saved (1820 records). [2025-09-29T02:22:50.524172] [INFO ] [MAIN ] SOLV: Successfully saved derivative data. [2025-09-29T02:22:50.528725] [INFO ] [MAIN ] Derivative Progress: 1827/2211 symbols completed. SOLV took 1.2s. Estimated remaining: 2m 43s. Rate: 141.7 symbols/min [2025-09-29T02:22:50.529202] [INFO ] [MAIN ] SOR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:50.549346] [DEBUG] [LOCAL ] SOR: Loaded 2947 existing records from primary storage. [2025-09-29T02:22:50.549544] [INFO ] [MAIN ] SOR: Loaded 2947 primary data records. [2025-09-29T02:22:50.645117] [DEBUG] [LOCAL ] SON: Loaded 43596 existing records from primary storage. [2025-09-29T02:22:50.708137] [INFO ] [MAIN ] SON: Loaded 43596 primary data records. [2025-09-29T02:22:50.714466] [DEBUG] [LOCAL ] SONY: Loaded 54136 existing records from primary storage. [2025-09-29T02:22:50.725307] [INFO ] [MAIN ] SONY: Loaded 54136 primary data records. [2025-09-29T02:22:51.728146] [DEBUG] [MAIN ] SOR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:51.729390] [INFO ] [MAIN ] SOR: Generated 1820 derivative records from 2947 primary records. [2025-09-29T02:22:51.729686] [DEBUG] [LOCAL ] SOR: Saving derivative data. [2025-09-29T02:22:51.750879] [DEBUG] [LOCAL ] SOR: Derivative data saved (1820 records). [2025-09-29T02:22:51.751489] [INFO ] [MAIN ] SOR: Successfully saved derivative data. [2025-09-29T02:22:51.758103] [INFO ] [MAIN ] Derivative Progress: 1828/2211 symbols completed. SOR took 1.2s. Estimated remaining: 2m 42s. Rate: 141.6 symbols/min [2025-09-29T02:22:51.774146] [DEBUG] [MAIN ] SON: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:51.788685] [DEBUG] [MAIN ] SONY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:51.789450] [INFO ] [MAIN ] SON: Generated 1820 derivative records from 43596 primary records. [2025-09-29T02:22:51.790262] [INFO ] [MAIN ] SONY: Generated 1820 derivative records from 54136 primary records. [2025-09-29T02:22:51.789665] [DEBUG] [LOCAL ] SON: Saving derivative data. [2025-09-29T02:22:51.791070] [DEBUG] [LOCAL ] SONY: Saving derivative data. [2025-09-29T02:22:51.823979] [DEBUG] [LOCAL ] SON: Derivative data saved (1820 records). [2025-09-29T02:22:51.825725] [INFO ] [MAIN ] SON: Successfully saved derivative data. [2025-09-29T02:22:51.828893] [INFO ] [MAIN ] Derivative Progress: 1829/2211 symbols completed. SON took 1.4s. Estimated remaining: 2m 42s. Rate: 141.6 symbols/min [2025-09-29T02:22:51.829000] [DEBUG] [LOCAL ] SONY: Derivative data saved (1820 records). [2025-09-29T02:22:51.829242] [INFO ] [MAIN ] SONY: Successfully saved derivative data. [2025-09-29T02:22:51.832927] [INFO ] [MAIN ] Derivative Progress: 1830/2211 symbols completed. SONY took 1.4s. Estimated remaining: 2m 41s. Rate: 141.7 symbols/min [2025-09-29T02:22:51.833762] [INFO ] [MAIN ] SPCE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:51.833826] [INFO ] [MAIN ] SPB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:51.833614] [INFO ] [MAIN ] SOS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:51.849480] [DEBUG] [LOCAL ] SOS: Loaded 8266 existing records from primary storage. [2025-09-29T02:22:51.849814] [INFO ] [MAIN ] SOS: Loaded 8266 primary data records. [2025-09-29T02:22:52.101102] [DEBUG] [LOCAL ] SPB: Loaded 34677 existing records from primary storage. [2025-09-29T02:22:52.160791] [INFO ] [MAIN ] SPB: Loaded 34677 primary data records. [2025-09-29T02:22:52.245760] [DEBUG] [LOCAL ] SPCE: Loaded 50615 existing records from primary storage. [2025-09-29T02:22:52.251367] [INFO ] [MAIN ] SPCE: Loaded 50615 primary data records. [2025-09-29T02:22:52.997007] [DEBUG] [MAIN ] SOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:52.998803] [INFO ] [MAIN ] SOS: Generated 1820 derivative records from 8266 primary records. [2025-09-29T02:22:53.000145] [DEBUG] [LOCAL ] SOS: Saving derivative data. [2025-09-29T02:22:53.022590] [DEBUG] [LOCAL ] SOS: Derivative data saved (1820 records). [2025-09-29T02:22:53.022863] [INFO ] [MAIN ] SOS: Successfully saved derivative data. [2025-09-29T02:22:53.026316] [INFO ] [MAIN ] Derivative Progress: 1831/2211 symbols completed. SOS took 1.2s. Estimated remaining: 2m 41s. Rate: 141.6 symbols/min [2025-09-29T02:22:53.027161] [INFO ] [MAIN ] SPE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:53.051474] [DEBUG] [MAIN ] SPB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:53.052518] [INFO ] [MAIN ] SPB: Generated 1820 derivative records from 34677 primary records. [2025-09-29T02:22:53.056583] [DEBUG] [LOCAL ] SPE: Loaded 6441 existing records from primary storage. [2025-09-29T02:22:53.069149] [INFO ] [MAIN ] SPE: Loaded 6441 primary data records. [2025-09-29T02:22:53.074860] [DEBUG] [MAIN ] SPCE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:53.056180] [DEBUG] [LOCAL ] SPB: Saving derivative data. [2025-09-29T02:22:53.075768] [INFO ] [MAIN ] SPCE: Generated 1820 derivative records from 50615 primary records. [2025-09-29T02:22:53.075878] [DEBUG] [LOCAL ] SPCE: Saving derivative data. [2025-09-29T02:22:53.269200] [DEBUG] [LOCAL ] SPCE: Derivative data saved (1820 records). [2025-09-29T02:22:53.291072] [DEBUG] [LOCAL ] SPB: Derivative data saved (1820 records). [2025-09-29T02:22:53.429146] [INFO ] [MAIN ] SPCE: Successfully saved derivative data. [2025-09-29T02:22:53.438854] [INFO ] [MAIN ] SPB: Successfully saved derivative data. [2025-09-29T02:22:53.442775] [INFO ] [MAIN ] Derivative Progress: 1832/2211 symbols completed. SPCE took 1.6s. Estimated remaining: 2m 41s. Rate: 141.6 symbols/min [2025-09-29T02:22:53.445770] [INFO ] [MAIN ] SPG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:53.445922] [INFO ] [MAIN ] Derivative Progress: 1833/2211 symbols completed. SPB took 1.6s. Estimated remaining: 2m 40s. Rate: 141.6 symbols/min [2025-09-29T02:22:53.446140] [INFO ] [MAIN ] SPGI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:53.480948] [DEBUG] [MAIN ] SPE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:53.482046] [INFO ] [MAIN ] SPE: Generated 1820 derivative records from 6441 primary records. [2025-09-29T02:22:53.482142] [DEBUG] [LOCAL ] SPE: Saving derivative data. [2025-09-29T02:22:53.512550] [DEBUG] [LOCAL ] SPE: Derivative data saved (1820 records). [2025-09-29T02:22:53.525704] [INFO ] [MAIN ] SPE: Successfully saved derivative data. [2025-09-29T02:22:53.528786] [INFO ] [MAIN ] Derivative Progress: 1834/2211 symbols completed. SPE took 0.5s. Estimated remaining: 2m 40s. Rate: 141.7 symbols/min [2025-09-29T02:22:53.529246] [INFO ] [MAIN ] SPH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:53.568222] [DEBUG] [LOCAL ] SPGI: Loaded 46562 existing records from primary storage. [2025-09-29T02:22:53.568639] [INFO ] [MAIN ] SPGI: Loaded 46562 primary data records. [2025-09-29T02:22:53.606440] [DEBUG] [LOCAL ] SPG: Loaded 51134 existing records from primary storage. [2025-09-29T02:22:53.629687] [INFO ] [MAIN ] SPG: Loaded 51134 primary data records. [2025-09-29T02:22:53.733845] [DEBUG] [LOCAL ] SPH: Loaded 18213 existing records from primary storage. [2025-09-29T02:22:53.785908] [INFO ] [MAIN ] SPH: Loaded 18213 primary data records. [2025-09-29T02:22:54.737458] [DEBUG] [MAIN ] SPGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:54.739330] [INFO ] [MAIN ] SPGI: Generated 1820 derivative records from 46562 primary records. [2025-09-29T02:22:54.739895] [DEBUG] [LOCAL ] SPGI: Saving derivative data. [2025-09-29T02:22:54.758051] [DEBUG] [LOCAL ] SPGI: Derivative data saved (1820 records). [2025-09-29T02:22:54.758329] [INFO ] [MAIN ] SPGI: Successfully saved derivative data. [2025-09-29T02:22:54.762154] [INFO ] [MAIN ] Derivative Progress: 1835/2211 symbols completed. SPGI took 1.3s. Estimated remaining: 2m 39s. Rate: 141.5 symbols/min [2025-09-29T02:22:54.763715] [INFO ] [MAIN ] SPHR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:54.797829] [DEBUG] [MAIN ] SPH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:54.797484] [DEBUG] [MAIN ] SPG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:54.799003] [INFO ] [MAIN ] SPG: Generated 1820 derivative records from 51134 primary records. [2025-09-29T02:22:54.799876] [INFO ] [MAIN ] SPH: Generated 1820 derivative records from 18213 primary records. [2025-09-29T02:22:54.800112] [DEBUG] [LOCAL ] SPG: Saving derivative data. [2025-09-29T02:22:54.800179] [DEBUG] [LOCAL ] SPH: Saving derivative data. [2025-09-29T02:22:54.835132] [DEBUG] [LOCAL ] SPH: Derivative data saved (1820 records). [2025-09-29T02:22:54.836472] [INFO ] [MAIN ] SPH: Successfully saved derivative data. [2025-09-29T02:22:54.841442] [INFO ] [MAIN ] Derivative Progress: 1836/2211 symbols completed. SPH took 1.3s. Estimated remaining: 2m 39s. Rate: 141.6 symbols/min [2025-09-29T02:22:54.852228] [DEBUG] [LOCAL ] SPG: Derivative data saved (1820 records). [2025-09-29T02:22:54.852494] [INFO ] [MAIN ] SPG: Successfully saved derivative data. [2025-09-29T02:22:54.852379] [INFO ] [MAIN ] SPIR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:54.856005] [INFO ] [MAIN ] Derivative Progress: 1837/2211 symbols completed. SPG took 1.4s. Estimated remaining: 2m 38s. Rate: 141.7 symbols/min [2025-09-29T02:22:54.856783] [INFO ] [MAIN ] SPMC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:54.865945] [DEBUG] [LOCAL ] SPMC: Loaded 5613 existing records from primary storage. [2025-09-29T02:22:54.867479] [INFO ] [MAIN ] SPMC: Loaded 5613 primary data records. [2025-09-29T02:22:54.933832] [DEBUG] [LOCAL ] SPHR: Loaded 40745 existing records from primary storage. [2025-09-29T02:22:54.980517] [INFO ] [MAIN ] SPHR: Loaded 40745 primary data records. [2025-09-29T02:22:55.383562] [DEBUG] [LOCAL ] SPIR: Loaded 37871 existing records from primary storage. [2025-09-29T02:22:55.384483] [INFO ] [MAIN ] SPIR: Loaded 37871 primary data records. [2025-09-29T02:22:56.075985] [DEBUG] [MAIN ] SPMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:56.078087] [INFO ] [MAIN ] SPMC: Generated 1820 derivative records from 5613 primary records. [2025-09-29T02:22:56.078571] [DEBUG] [LOCAL ] SPMC: Saving derivative data. [2025-09-29T02:22:56.100347] [DEBUG] [LOCAL ] SPMC: Derivative data saved (1820 records). [2025-09-29T02:22:56.100908] [INFO ] [MAIN ] SPMC: Successfully saved derivative data. [2025-09-29T02:22:56.103467] [INFO ] [MAIN ] Derivative Progress: 1838/2211 symbols completed. SPMC took 1.2s. Estimated remaining: 2m 38s. Rate: 141.5 symbols/min [2025-09-29T02:22:56.118300] [DEBUG] [MAIN ] SPHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:56.117536] [INFO ] [MAIN ] SPNT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:56.120140] [INFO ] [MAIN ] SPHR: Generated 1820 derivative records from 40745 primary records. [2025-09-29T02:22:56.121009] [DEBUG] [LOCAL ] SPHR: Saving derivative data. [2025-09-29T02:22:56.143942] [DEBUG] [LOCAL ] SPHR: Derivative data saved (1820 records). [2025-09-29T02:22:56.144252] [INFO ] [MAIN ] SPHR: Successfully saved derivative data. [2025-09-29T02:22:56.162280] [INFO ] [MAIN ] Derivative Progress: 1839/2211 symbols completed. SPHR took 1.4s. Estimated remaining: 2m 38s. Rate: 141.6 symbols/min [2025-09-29T02:22:56.162710] [INFO ] [MAIN ] SPOT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:56.164176] [DEBUG] [MAIN ] SPIR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:56.165338] [INFO ] [MAIN ] SPIR: Generated 1820 derivative records from 37871 primary records. [2025-09-29T02:22:56.165431] [DEBUG] [LOCAL ] SPIR: Saving derivative data. [2025-09-29T02:22:56.195887] [DEBUG] [LOCAL ] SPIR: Derivative data saved (1820 records). [2025-09-29T02:22:56.207419] [INFO ] [MAIN ] SPIR: Successfully saved derivative data. [2025-09-29T02:22:56.210472] [INFO ] [MAIN ] Derivative Progress: 1840/2211 symbols completed. SPIR took 1.4s. Estimated remaining: 2m 37s. Rate: 141.7 symbols/min [2025-09-29T02:22:56.211337] [DEBUG] [LOCAL ] SPNT: Loaded 35342 existing records from primary storage. [2025-09-29T02:22:56.211916] [INFO ] [MAIN ] SPR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:56.212252] [INFO ] [MAIN ] SPNT: Loaded 35342 primary data records. [2025-09-29T02:22:56.637162] [DEBUG] [LOCAL ] SPOT: Loaded 51481 existing records from primary storage. [2025-09-29T02:22:56.638449] [DEBUG] [LOCAL ] SPR: Loaded 41867 existing records from primary storage. [2025-09-29T02:22:56.638593] [INFO ] [MAIN ] SPOT: Loaded 51481 primary data records. [2025-09-29T02:22:56.639063] [INFO ] [MAIN ] SPR: Loaded 41867 primary data records. [2025-09-29T02:22:57.413557] [DEBUG] [MAIN ] SPNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:57.416996] [INFO ] [MAIN ] SPNT: Generated 1820 derivative records from 35342 primary records. [2025-09-29T02:22:57.417886] [DEBUG] [LOCAL ] SPNT: Saving derivative data. [2025-09-29T02:22:57.437868] [DEBUG] [LOCAL ] SPNT: Derivative data saved (1820 records). [2025-09-29T02:22:57.440221] [INFO ] [MAIN ] SPNT: Successfully saved derivative data. [2025-09-29T02:22:57.446223] [INFO ] [MAIN ] Derivative Progress: 1841/2211 symbols completed. SPNT took 1.3s. Estimated remaining: 2m 37s. Rate: 141.5 symbols/min [2025-09-29T02:22:57.446708] [INFO ] [MAIN ] SPRU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:57.462746] [DEBUG] [MAIN ] SPR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:57.464023] [INFO ] [MAIN ] SPR: Generated 1820 derivative records from 41867 primary records. [2025-09-29T02:22:57.464461] [DEBUG] [LOCAL ] SPR: Saving derivative data. [2025-09-29T02:22:57.487092] [DEBUG] [LOCAL ] SPRU: Loaded 8714 existing records from primary storage. [2025-09-29T02:22:57.491261] [INFO ] [MAIN ] SPRU: Loaded 8714 primary data records. [2025-09-29T02:22:57.581054] [DEBUG] [LOCAL ] SPR: Derivative data saved (1820 records). [2025-09-29T02:22:57.598267] [DEBUG] [MAIN ] SPOT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:57.613411] [INFO ] [MAIN ] SPOT: Generated 1820 derivative records from 51481 primary records. [2025-09-29T02:22:57.607005] [INFO ] [MAIN ] SPR: Successfully saved derivative data. [2025-09-29T02:22:57.639328] [INFO ] [MAIN ] Derivative Progress: 1842/2211 symbols completed. SPR took 1.4s. Estimated remaining: 2m 36s. Rate: 141.6 symbols/min [2025-09-29T02:22:57.644182] [INFO ] [MAIN ] SPXC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:57.618835] [DEBUG] [LOCAL ] SPOT: Saving derivative data. [2025-09-29T02:22:57.729381] [DEBUG] [LOCAL ] SPOT: Derivative data saved (1820 records). [2025-09-29T02:22:57.755812] [INFO ] [MAIN ] SPOT: Successfully saved derivative data. [2025-09-29T02:22:57.759433] [INFO ] [MAIN ] Derivative Progress: 1843/2211 symbols completed. SPOT took 1.6s. Estimated remaining: 2m 36s. Rate: 141.6 symbols/min [2025-09-29T02:22:57.901889] [DEBUG] [LOCAL ] SPXC: Loaded 23666 existing records from primary storage. [2025-09-29T02:22:57.902129] [INFO ] [MAIN ] SPXC: Loaded 23666 primary data records. [2025-09-29T02:22:58.312410] [DEBUG] [MAIN ] SPRU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:58.314825] [INFO ] [MAIN ] SPRU: Generated 1820 derivative records from 8714 primary records. [2025-09-29T02:22:58.315185] [DEBUG] [LOCAL ] SPRU: Saving derivative data. [2025-09-29T02:22:58.332150] [DEBUG] [LOCAL ] SPRU: Derivative data saved (1820 records). [2025-09-29T02:22:58.332283] [INFO ] [MAIN ] SPRU: Successfully saved derivative data. [2025-09-29T02:22:58.334851] [INFO ] [MAIN ] Derivative Progress: 1844/2211 symbols completed. SPRU took 0.9s. Estimated remaining: 2m 36s. Rate: 141.6 symbols/min [2025-09-29T02:22:58.355682] [DEBUG] [MAIN ] SPXC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:58.356534] [INFO ] [MAIN ] SPXC: Generated 1820 derivative records from 23666 primary records. [2025-09-29T02:22:58.356626] [DEBUG] [LOCAL ] SPXC: Saving derivative data. [2025-09-29T02:22:58.372938] [DEBUG] [LOCAL ] SPXC: Derivative data saved (1820 records). [2025-09-29T02:22:58.373084] [INFO ] [MAIN ] SPXC: Successfully saved derivative data. [2025-09-29T02:22:58.377048] [INFO ] [MAIN ] Derivative Progress: 1845/2211 symbols completed. SPXC took 0.7s. Estimated remaining: 2m 35s. Rate: 141.7 symbols/min [2025-09-29T02:22:58.377630] [INFO ] [MAIN ] SPXX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:58.377979] [INFO ] [MAIN ] SQM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:58.377781] [INFO ] [MAIN ] SQNS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:58.397205] [DEBUG] [LOCAL ] SPXX: Loaded 9166 existing records from primary storage. [2025-09-29T02:22:58.397601] [INFO ] [MAIN ] SPXX: Loaded 9166 primary data records. [2025-09-29T02:22:58.565611] [DEBUG] [LOCAL ] SQNS: Loaded 26307 existing records from primary storage. [2025-09-29T02:22:58.571090] [INFO ] [MAIN ] SQNS: Loaded 26307 primary data records. [2025-09-29T02:22:58.704212] [DEBUG] [LOCAL ] SQM: Loaded 49278 existing records from primary storage. [2025-09-29T02:22:58.848568] [INFO ] [MAIN ] SQM: Loaded 49278 primary data records. [2025-09-29T02:22:59.495874] [DEBUG] [MAIN ] SPXX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:59.498672] [INFO ] [MAIN ] SPXX: Generated 1820 derivative records from 9166 primary records. [2025-09-29T02:22:59.499219] [DEBUG] [LOCAL ] SPXX: Saving derivative data. [2025-09-29T02:22:59.518571] [DEBUG] [LOCAL ] SPXX: Derivative data saved (1820 records). [2025-09-29T02:22:59.518740] [INFO ] [MAIN ] SPXX: Successfully saved derivative data. [2025-09-29T02:22:59.521393] [INFO ] [MAIN ] Derivative Progress: 1846/2211 symbols completed. SPXX took 1.1s. Estimated remaining: 2m 35s. Rate: 141.5 symbols/min [2025-09-29T02:22:59.523305] [INFO ] [MAIN ] SR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:59.562933] [DEBUG] [MAIN ] SQM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:59.564983] [INFO ] [MAIN ] SQM: Generated 1820 derivative records from 49278 primary records. [2025-09-29T02:22:59.565984] [DEBUG] [MAIN ] SQNS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:22:59.567016] [INFO ] [MAIN ] SQNS: Generated 1820 derivative records from 26307 primary records. [2025-09-29T02:22:59.566100] [DEBUG] [LOCAL ] SQM: Saving derivative data. [2025-09-29T02:22:59.567217] [DEBUG] [LOCAL ] SQNS: Saving derivative data. [2025-09-29T02:22:59.609260] [DEBUG] [LOCAL ] SQNS: Derivative data saved (1820 records). [2025-09-29T02:22:59.613235] [INFO ] [MAIN ] SQNS: Successfully saved derivative data. [2025-09-29T02:22:59.616619] [INFO ] [MAIN ] Derivative Progress: 1847/2211 symbols completed. SQNS took 1.2s. Estimated remaining: 2m 34s. Rate: 141.6 symbols/min [2025-09-29T02:22:59.616963] [INFO ] [MAIN ] SRE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:59.618397] [DEBUG] [LOCAL ] SQM: Derivative data saved (1820 records). [2025-09-29T02:22:59.618694] [INFO ] [MAIN ] SQM: Successfully saved derivative data. [2025-09-29T02:22:59.622287] [INFO ] [MAIN ] Derivative Progress: 1848/2211 symbols completed. SQM took 1.2s. Estimated remaining: 2m 34s. Rate: 141.7 symbols/min [2025-09-29T02:22:59.622639] [INFO ] [MAIN ] SREA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:22:59.637090] [DEBUG] [LOCAL ] SR: Loaded 33411 existing records from primary storage. [2025-09-29T02:22:59.637286] [INFO ] [MAIN ] SR: Loaded 33411 primary data records. [2025-09-29T02:22:59.743722] [DEBUG] [LOCAL ] SREA: Loaded 10561 existing records from primary storage. [2025-09-29T02:22:59.764308] [INFO ] [MAIN ] SREA: Loaded 10561 primary data records. [2025-09-29T02:23:00.195959] [DEBUG] [LOCAL ] SRE: Loaded 54202 existing records from primary storage. [2025-09-29T02:23:00.233782] [INFO ] [MAIN ] SRE: Loaded 54202 primary data records. [2025-09-29T02:23:00.779297] [DEBUG] [MAIN ] SR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:00.780294] [INFO ] [MAIN ] SR: Generated 1820 derivative records from 33411 primary records. [2025-09-29T02:23:00.780813] [DEBUG] [LOCAL ] SR: Saving derivative data. [2025-09-29T02:23:00.803739] [DEBUG] [LOCAL ] SR: Derivative data saved (1820 records). [2025-09-29T02:23:00.804798] [INFO ] [MAIN ] SR: Successfully saved derivative data. [2025-09-29T02:23:00.809786] [INFO ] [MAIN ] Derivative Progress: 1849/2211 symbols completed. SR took 1.3s. Estimated remaining: 2m 33s. Rate: 141.5 symbols/min [2025-09-29T02:23:00.810953] [INFO ] [MAIN ] SRFM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:00.827090] [DEBUG] [MAIN ] SREA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:00.828057] [INFO ] [MAIN ] SREA: Generated 1820 derivative records from 10561 primary records. [2025-09-29T02:23:00.828695] [DEBUG] [LOCAL ] SREA: Saving derivative data. [2025-09-29T02:23:00.847974] [DEBUG] [LOCAL ] SREA: Derivative data saved (1820 records). [2025-09-29T02:23:00.851443] [INFO ] [MAIN ] SREA: Successfully saved derivative data. [2025-09-29T02:23:00.854253] [INFO ] [MAIN ] Derivative Progress: 1850/2211 symbols completed. SREA took 1.2s. Estimated remaining: 2m 33s. Rate: 141.6 symbols/min [2025-09-29T02:23:00.854575] [INFO ] [MAIN ] SRG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:00.870466] [DEBUG] [MAIN ] SRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:00.871210] [INFO ] [MAIN ] SRE: Generated 1820 derivative records from 54202 primary records. [2025-09-29T02:23:00.871352] [DEBUG] [LOCAL ] SRE: Saving derivative data. [2025-09-29T02:23:00.920392] [DEBUG] [LOCAL ] SRG: Loaded 15859 existing records from primary storage. [2025-09-29T02:23:00.922517] [DEBUG] [LOCAL ] SRE: Derivative data saved (1820 records). [2025-09-29T02:23:00.921520] [DEBUG] [LOCAL ] SRFM: Loaded 36431 existing records from primary storage. [2025-09-29T02:23:00.922883] [INFO ] [MAIN ] SRG: Loaded 15859 primary data records. [2025-09-29T02:23:00.923010] [INFO ] [MAIN ] SRE: Successfully saved derivative data. [2025-09-29T02:23:00.926202] [INFO ] [MAIN ] Derivative Progress: 1851/2211 symbols completed. SRE took 1.3s. Estimated remaining: 2m 32s. Rate: 141.7 symbols/min [2025-09-29T02:23:00.923073] [INFO ] [MAIN ] SRFM: Loaded 36431 primary data records. [2025-09-29T02:23:00.939419] [INFO ] [MAIN ] SRI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:01.486781] [DEBUG] [LOCAL ] SRI: Loaded 27810 existing records from primary storage. [2025-09-29T02:23:01.604370] [INFO ] [MAIN ] SRI: Loaded 27810 primary data records. [2025-09-29T02:23:02.054065] [DEBUG] [MAIN ] SRFM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:02.058380] [INFO ] [MAIN ] SRFM: Generated 1820 derivative records from 36431 primary records. [2025-09-29T02:23:02.075225] [DEBUG] [MAIN ] SRG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:02.074696] [DEBUG] [LOCAL ] SRFM: Saving derivative data. [2025-09-29T02:23:02.076281] [INFO ] [MAIN ] SRG: Generated 1820 derivative records from 15859 primary records. [2025-09-29T02:23:02.076389] [DEBUG] [LOCAL ] SRG: Saving derivative data. [2025-09-29T02:23:02.112080] [DEBUG] [LOCAL ] SRG: Derivative data saved (1820 records). [2025-09-29T02:23:02.112211] [INFO ] [MAIN ] SRG: Successfully saved derivative data. [2025-09-29T02:23:02.108766] [DEBUG] [LOCAL ] SRFM: Derivative data saved (1820 records). [2025-09-29T02:23:02.115230] [INFO ] [MAIN ] Derivative Progress: 1852/2211 symbols completed. SRG took 1.3s. Estimated remaining: 2m 32s. Rate: 141.5 symbols/min [2025-09-29T02:23:02.115334] [INFO ] [MAIN ] SRFM: Successfully saved derivative data. [2025-09-29T02:23:02.116028] [INFO ] [MAIN ] SRV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:02.118712] [INFO ] [MAIN ] Derivative Progress: 1853/2211 symbols completed. SRFM took 1.3s. Estimated remaining: 2m 32s. Rate: 141.6 symbols/min [2025-09-29T02:23:02.120122] [INFO ] [MAIN ] SSB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:02.142428] [DEBUG] [MAIN ] SRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:02.144359] [INFO ] [MAIN ] SRI: Generated 1820 derivative records from 27810 primary records. [2025-09-29T02:23:02.148468] [DEBUG] [LOCAL ] SRI: Saving derivative data. [2025-09-29T02:23:02.148727] [DEBUG] [LOCAL ] SRV: Loaded 7631 existing records from primary storage. [2025-09-29T02:23:02.149769] [INFO ] [MAIN ] SRV: Loaded 7631 primary data records. [2025-09-29T02:23:02.254310] [DEBUG] [LOCAL ] SRI: Derivative data saved (1820 records). [2025-09-29T02:23:02.271556] [INFO ] [MAIN ] SRI: Successfully saved derivative data. [2025-09-29T02:23:02.281612] [INFO ] [MAIN ] Derivative Progress: 1854/2211 symbols completed. SRI took 1.3s. Estimated remaining: 2m 31s. Rate: 141.6 symbols/min [2025-09-29T02:23:02.304879] [INFO ] [MAIN ] SSD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:02.545908] [DEBUG] [LOCAL ] SSB: Loaded 43377 existing records from primary storage. [2025-09-29T02:23:02.563590] [INFO ] [MAIN ] SSB: Loaded 43377 primary data records. [2025-09-29T02:23:02.681709] [DEBUG] [LOCAL ] SSD: Loaded 22631 existing records from primary storage. [2025-09-29T02:23:02.696874] [INFO ] [MAIN ] SSD: Loaded 22631 primary data records. [2025-09-29T02:23:03.338031] [DEBUG] [MAIN ] SRV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:03.341114] [INFO ] [MAIN ] SRV: Generated 1820 derivative records from 7631 primary records. [2025-09-29T02:23:03.341717] [DEBUG] [LOCAL ] SRV: Saving derivative data. [2025-09-29T02:23:03.364453] [DEBUG] [LOCAL ] SRV: Derivative data saved (1820 records). [2025-09-29T02:23:03.382510] [INFO ] [MAIN ] SRV: Successfully saved derivative data. [2025-09-29T02:23:03.382965] [DEBUG] [MAIN ] SSB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:03.386336] [INFO ] [MAIN ] Derivative Progress: 1855/2211 symbols completed. SRV took 1.3s. Estimated remaining: 2m 31s. Rate: 141.5 symbols/min [2025-09-29T02:23:03.387353] [INFO ] [MAIN ] SSB: Generated 1820 derivative records from 43377 primary records. [2025-09-29T02:23:03.387947] [INFO ] [MAIN ] SSL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:03.388284] [DEBUG] [LOCAL ] SSB: Saving derivative data. [2025-09-29T02:23:03.406923] [DEBUG] [LOCAL ] SSB: Derivative data saved (1820 records). [2025-09-29T02:23:03.407077] [INFO ] [MAIN ] SSB: Successfully saved derivative data. [2025-09-29T02:23:03.409993] [INFO ] [MAIN ] Derivative Progress: 1856/2211 symbols completed. SSB took 1.3s. Estimated remaining: 2m 30s. Rate: 141.6 symbols/min [2025-09-29T02:23:03.410345] [INFO ] [MAIN ] SST: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:03.428514] [DEBUG] [MAIN ] SSD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:03.429565] [INFO ] [MAIN ] SSD: Generated 1820 derivative records from 22631 primary records. [2025-09-29T02:23:03.429811] [DEBUG] [LOCAL ] SSD: Saving derivative data. [2025-09-29T02:23:03.451718] [DEBUG] [LOCAL ] SSD: Derivative data saved (1820 records). [2025-09-29T02:23:03.468947] [DEBUG] [LOCAL ] SST: Loaded 12166 existing records from primary storage. [2025-09-29T02:23:03.468523] [INFO ] [MAIN ] SSD: Successfully saved derivative data. [2025-09-29T02:23:03.469106] [INFO ] [MAIN ] SST: Loaded 12166 primary data records. [2025-09-29T02:23:03.472483] [INFO ] [MAIN ] Derivative Progress: 1857/2211 symbols completed. SSD took 1.2s. Estimated remaining: 2m 30s. Rate: 141.7 symbols/min [2025-09-29T02:23:03.517719] [INFO ] [MAIN ] SSTK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:03.575590] [DEBUG] [LOCAL ] SSL: Loaded 41830 existing records from primary storage. [2025-09-29T02:23:03.604000] [INFO ] [MAIN ] SSL: Loaded 41830 primary data records. [2025-09-29T02:23:04.006899] [DEBUG] [LOCAL ] SSTK: Loaded 26762 existing records from primary storage. [2025-09-29T02:23:04.055188] [INFO ] [MAIN ] SSTK: Loaded 26762 primary data records. [2025-09-29T02:23:04.610987] [DEBUG] [MAIN ] SST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:04.612816] [INFO ] [MAIN ] SST: Generated 1820 derivative records from 12166 primary records. [2025-09-29T02:23:04.631857] [DEBUG] [LOCAL ] SST: Saving derivative data. [2025-09-29T02:23:04.633727] [DEBUG] [MAIN ] SSL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:04.648390] [INFO ] [MAIN ] SSL: Generated 1820 derivative records from 41830 primary records. [2025-09-29T02:23:04.654040] [DEBUG] [LOCAL ] SSL: Saving derivative data. [2025-09-29T02:23:04.672728] [DEBUG] [LOCAL ] SST: Derivative data saved (1820 records). [2025-09-29T02:23:04.677802] [DEBUG] [LOCAL ] SSL: Derivative data saved (1820 records). [2025-09-29T02:23:04.677884] [INFO ] [MAIN ] SST: Successfully saved derivative data. [2025-09-29T02:23:04.678264] [INFO ] [MAIN ] SSL: Successfully saved derivative data. [2025-09-29T02:23:04.681761] [INFO ] [MAIN ] Derivative Progress: 1858/2211 symbols completed. SSL took 1.3s. Estimated remaining: 2m 30s. Rate: 141.5 symbols/min [2025-09-29T02:23:04.685358] [INFO ] [MAIN ] Derivative Progress: 1859/2211 symbols completed. SST took 1.3s. Estimated remaining: 2m 29s. Rate: 141.6 symbols/min [2025-09-29T02:23:04.701939] [DEBUG] [MAIN ] SSTK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:04.702776] [INFO ] [MAIN ] SSTK: Generated 1820 derivative records from 26762 primary records. [2025-09-29T02:23:04.702866] [DEBUG] [LOCAL ] SSTK: Saving derivative data. [2025-09-29T02:23:04.719383] [DEBUG] [LOCAL ] SSTK: Derivative data saved (1820 records). [2025-09-29T02:23:04.719546] [INFO ] [MAIN ] SSTK: Successfully saved derivative data. [2025-09-29T02:23:04.723583] [INFO ] [MAIN ] Derivative Progress: 1860/2211 symbols completed. SSTK took 1.2s. Estimated remaining: 2m 29s. Rate: 141.7 symbols/min [2025-09-29T02:23:04.724368] [INFO ] [MAIN ] STAG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:04.724269] [INFO ] [MAIN ] ST: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:04.724438] [INFO ] [MAIN ] STC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:04.751146] [DEBUG] [LOCAL ] STC: Loaded 17878 existing records from primary storage. [2025-09-29T02:23:04.751493] [INFO ] [MAIN ] STC: Loaded 17878 primary data records. [2025-09-29T02:23:05.150015] [DEBUG] [LOCAL ] ST: Loaded 50505 existing records from primary storage. [2025-09-29T02:23:05.222377] [DEBUG] [LOCAL ] STAG: Loaded 50799 existing records from primary storage. [2025-09-29T02:23:05.222638] [INFO ] [MAIN ] ST: Loaded 50505 primary data records. [2025-09-29T02:23:05.223069] [INFO ] [MAIN ] STAG: Loaded 50799 primary data records. [2025-09-29T02:23:05.970538] [DEBUG] [MAIN ] STC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:05.972748] [INFO ] [MAIN ] STC: Generated 1820 derivative records from 17878 primary records. [2025-09-29T02:23:05.973972] [DEBUG] [LOCAL ] STC: Saving derivative data. [2025-09-29T02:23:05.997385] [DEBUG] [LOCAL ] STC: Derivative data saved (1820 records). [2025-09-29T02:23:05.997829] [INFO ] [MAIN ] STC: Successfully saved derivative data. [2025-09-29T02:23:06.001285] [INFO ] [MAIN ] Derivative Progress: 1861/2211 symbols completed. STC took 1.3s. Estimated remaining: 2m 28s. Rate: 141.5 symbols/min [2025-09-29T02:23:06.002639] [INFO ] [MAIN ] STE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:06.031982] [DEBUG] [MAIN ] ST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:06.041925] [INFO ] [MAIN ] ST: Generated 1820 derivative records from 50505 primary records. [2025-09-29T02:23:06.048629] [DEBUG] [MAIN ] STAG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:06.048792] [DEBUG] [LOCAL ] ST: Saving derivative data. [2025-09-29T02:23:06.051069] [INFO ] [MAIN ] STAG: Generated 1820 derivative records from 50799 primary records. [2025-09-29T02:23:06.051318] [DEBUG] [LOCAL ] STAG: Saving derivative data. [2025-09-29T02:23:06.092166] [DEBUG] [LOCAL ] ST: Derivative data saved (1820 records). [2025-09-29T02:23:06.093769] [INFO ] [MAIN ] ST: Successfully saved derivative data. [2025-09-29T02:23:06.097915] [INFO ] [MAIN ] Derivative Progress: 1862/2211 symbols completed. ST took 1.4s. Estimated remaining: 2m 28s. Rate: 141.6 symbols/min [2025-09-29T02:23:06.098436] [INFO ] [MAIN ] STEL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:06.101425] [DEBUG] [LOCAL ] STAG: Derivative data saved (1820 records). [2025-09-29T02:23:06.101742] [INFO ] [MAIN ] STAG: Successfully saved derivative data. [2025-09-29T02:23:06.105843] [INFO ] [MAIN ] Derivative Progress: 1863/2211 symbols completed. STAG took 1.4s. Estimated remaining: 2m 27s. Rate: 141.6 symbols/min [2025-09-29T02:23:06.107548] [INFO ] [MAIN ] STEM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:06.121278] [DEBUG] [LOCAL ] STE: Loaded 35822 existing records from primary storage. [2025-09-29T02:23:06.121626] [INFO ] [MAIN ] STE: Loaded 35822 primary data records. [2025-09-29T02:23:06.274216] [DEBUG] [LOCAL ] STEL: Loaded 23823 existing records from primary storage. [2025-09-29T02:23:06.291823] [INFO ] [MAIN ] STEL: Loaded 23823 primary data records. [2025-09-29T02:23:06.413933] [DEBUG] [LOCAL ] STEM: Loaded 40374 existing records from primary storage. [2025-09-29T02:23:06.477236] [INFO ] [MAIN ] STEM: Loaded 40374 primary data records. [2025-09-29T02:23:07.362105] [DEBUG] [MAIN ] STE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:07.363928] [INFO ] [MAIN ] STE: Generated 1820 derivative records from 35822 primary records. [2025-09-29T02:23:07.364338] [DEBUG] [LOCAL ] STE: Saving derivative data. [2025-09-29T02:23:07.386044] [DEBUG] [LOCAL ] STE: Derivative data saved (1820 records). [2025-09-29T02:23:07.386678] [INFO ] [MAIN ] STE: Successfully saved derivative data. [2025-09-29T02:23:07.389609] [INFO ] [MAIN ] Derivative Progress: 1864/2211 symbols completed. STE took 1.4s. Estimated remaining: 2m 27s. Rate: 141.5 symbols/min [2025-09-29T02:23:07.390189] [INFO ] [MAIN ] STEW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:07.410314] [DEBUG] [MAIN ] STEL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:07.412234] [INFO ] [MAIN ] STEL: Generated 1820 derivative records from 23823 primary records. [2025-09-29T02:23:07.426671] [DEBUG] [MAIN ] STEM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:07.427697] [INFO ] [MAIN ] STEM: Generated 1820 derivative records from 40374 primary records. [2025-09-29T02:23:07.427860] [DEBUG] [LOCAL ] STEM: Saving derivative data. [2025-09-29T02:23:07.426767] [DEBUG] [LOCAL ] STEL: Saving derivative data. [2025-09-29T02:23:07.465764] [DEBUG] [LOCAL ] STEL: Derivative data saved (1820 records). [2025-09-29T02:23:07.467468] [DEBUG] [LOCAL ] STEM: Derivative data saved (1820 records). [2025-09-29T02:23:07.467778] [INFO ] [MAIN ] STEM: Successfully saved derivative data. [2025-09-29T02:23:07.467896] [INFO ] [MAIN ] STEL: Successfully saved derivative data. [2025-09-29T02:23:07.471053] [INFO ] [MAIN ] Derivative Progress: 1865/2211 symbols completed. STEL took 1.4s. Estimated remaining: 2m 27s. Rate: 141.6 symbols/min [2025-09-29T02:23:07.481766] [INFO ] [MAIN ] Derivative Progress: 1866/2211 symbols completed. STEM took 1.4s. Estimated remaining: 2m 26s. Rate: 141.6 symbols/min [2025-09-29T02:23:07.481578] [INFO ] [MAIN ] STK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:07.482057] [INFO ] [MAIN ] STLA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:07.482943] [DEBUG] [LOCAL ] STEW: Loaded 16354 existing records from primary storage. [2025-09-29T02:23:07.483543] [INFO ] [MAIN ] STEW: Loaded 16354 primary data records. [2025-09-29T02:23:07.622561] [DEBUG] [LOCAL ] STK: Loaded 9550 existing records from primary storage. [2025-09-29T02:23:07.628619] [INFO ] [MAIN ] STK: Loaded 9550 primary data records. [2025-09-29T02:23:08.113109] [DEBUG] [LOCAL ] STLA: Loaded 54322 existing records from primary storage. [2025-09-29T02:23:08.227932] [INFO ] [MAIN ] STLA: Loaded 54322 primary data records. [2025-09-29T02:23:08.613823] [DEBUG] [MAIN ] STEW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:08.614699] [INFO ] [MAIN ] STEW: Generated 1820 derivative records from 16354 primary records. [2025-09-29T02:23:08.615020] [DEBUG] [LOCAL ] STEW: Saving derivative data. [2025-09-29T02:23:08.636596] [DEBUG] [LOCAL ] STEW: Derivative data saved (1820 records). [2025-09-29T02:23:08.637139] [INFO ] [MAIN ] STEW: Successfully saved derivative data. [2025-09-29T02:23:08.647594] [INFO ] [MAIN ] Derivative Progress: 1867/2211 symbols completed. STEW took 1.3s. Estimated remaining: 2m 26s. Rate: 141.5 symbols/min [2025-09-29T02:23:08.653748] [INFO ] [MAIN ] STM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:08.654986] [DEBUG] [MAIN ] STK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:08.655854] [INFO ] [MAIN ] STK: Generated 1820 derivative records from 9550 primary records. [2025-09-29T02:23:08.656112] [DEBUG] [LOCAL ] STK: Saving derivative data. [2025-09-29T02:23:08.675482] [DEBUG] [LOCAL ] STK: Derivative data saved (1820 records). [2025-09-29T02:23:08.676040] [INFO ] [MAIN ] STK: Successfully saved derivative data. [2025-09-29T02:23:08.678764] [INFO ] [MAIN ] Derivative Progress: 1868/2211 symbols completed. STK took 1.2s. Estimated remaining: 2m 25s. Rate: 141.6 symbols/min [2025-09-29T02:23:08.679405] [INFO ] [MAIN ] STN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:08.701552] [DEBUG] [MAIN ] STLA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:08.702753] [INFO ] [MAIN ] STLA: Generated 1820 derivative records from 54322 primary records. [2025-09-29T02:23:08.703166] [DEBUG] [LOCAL ] STLA: Saving derivative data. [2025-09-29T02:23:08.729425] [DEBUG] [LOCAL ] STLA: Derivative data saved (1820 records). [2025-09-29T02:23:08.729687] [INFO ] [MAIN ] STLA: Successfully saved derivative data. [2025-09-29T02:23:08.734270] [INFO ] [MAIN ] Derivative Progress: 1869/2211 symbols completed. STLA took 1.3s. Estimated remaining: 2m 25s. Rate: 141.6 symbols/min [2025-09-29T02:23:08.759027] [DEBUG] [LOCAL ] STN: Loaded 23436 existing records from primary storage. [2025-09-29T02:23:08.759313] [INFO ] [MAIN ] STNG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:08.759502] [INFO ] [MAIN ] STN: Loaded 23436 primary data records. [2025-09-29T02:23:08.901261] [DEBUG] [LOCAL ] STM: Loaded 54362 existing records from primary storage. [2025-09-29T02:23:08.928743] [INFO ] [MAIN ] STM: Loaded 54362 primary data records. [2025-09-29T02:23:09.260952] [DEBUG] [LOCAL ] STNG: Loaded 44620 existing records from primary storage. [2025-09-29T02:23:09.279573] [INFO ] [MAIN ] STNG: Loaded 44620 primary data records. [2025-09-29T02:23:09.959275] [DEBUG] [MAIN ] STN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:09.960278] [INFO ] [MAIN ] STN: Generated 1820 derivative records from 23436 primary records. [2025-09-29T02:23:09.961735] [DEBUG] [LOCAL ] STN: Saving derivative data. [2025-09-29T02:23:09.983744] [DEBUG] [LOCAL ] STN: Derivative data saved (1820 records). [2025-09-29T02:23:09.984061] [INFO ] [MAIN ] STN: Successfully saved derivative data. [2025-09-29T02:23:09.986301] [INFO ] [MAIN ] Derivative Progress: 1870/2211 symbols completed. STN took 1.3s. Estimated remaining: 2m 25s. Rate: 141.5 symbols/min [2025-09-29T02:23:09.987358] [INFO ] [MAIN ] STRV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:10.009369] [DEBUG] [MAIN ] STM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:10.010461] [INFO ] [MAIN ] STM: Generated 1820 derivative records from 54362 primary records. [2025-09-29T02:23:10.010626] [DEBUG] [LOCAL ] STM: Saving derivative data. [2025-09-29T02:23:10.036963] [DEBUG] [LOCAL ] STRV: Loaded 11754 existing records from primary storage. [2025-09-29T02:23:10.039687] [DEBUG] [LOCAL ] STM: Derivative data saved (1820 records). [2025-09-29T02:23:10.039872] [INFO ] [MAIN ] STM: Successfully saved derivative data. [2025-09-29T02:23:10.043928] [INFO ] [MAIN ] Derivative Progress: 1871/2211 symbols completed. STM took 1.4s. Estimated remaining: 2m 24s. Rate: 141.5 symbols/min [2025-09-29T02:23:10.045348] [INFO ] [MAIN ] STT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:10.039929] [INFO ] [MAIN ] STRV: Loaded 11754 primary data records. [2025-09-29T02:23:10.122325] [DEBUG] [MAIN ] STNG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:10.169166] [INFO ] [MAIN ] STNG: Generated 1820 derivative records from 44620 primary records. [2025-09-29T02:23:10.191789] [DEBUG] [LOCAL ] STNG: Saving derivative data. [2025-09-29T02:23:10.278521] [DEBUG] [LOCAL ] STNG: Derivative data saved (1820 records). [2025-09-29T02:23:10.302467] [INFO ] [MAIN ] STNG: Successfully saved derivative data. [2025-09-29T02:23:10.307007] [INFO ] [MAIN ] Derivative Progress: 1872/2211 symbols completed. STNG took 1.5s. Estimated remaining: 2m 24s. Rate: 141.6 symbols/min [2025-09-29T02:23:10.449704] [INFO ] [MAIN ] STVN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:10.478373] [DEBUG] [LOCAL ] STT: Loaded 51793 existing records from primary storage. [2025-09-29T02:23:10.478631] [INFO ] [MAIN ] STT: Loaded 51793 primary data records. [2025-09-29T02:23:10.654160] [DEBUG] [LOCAL ] STVN: Loaded 26677 existing records from primary storage. [2025-09-29T02:23:10.696810] [INFO ] [MAIN ] STVN: Loaded 26677 primary data records. [2025-09-29T02:23:10.970535] [DEBUG] [MAIN ] STRV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:10.995492] [INFO ] [MAIN ] STRV: Generated 1820 derivative records from 11754 primary records. [2025-09-29T02:23:11.000540] [DEBUG] [LOCAL ] STRV: Saving derivative data. [2025-09-29T02:23:11.104221] [DEBUG] [LOCAL ] STRV: Derivative data saved (1820 records). [2025-09-29T02:23:11.229422] [INFO ] [MAIN ] STRV: Successfully saved derivative data. [2025-09-29T02:23:11.243171] [INFO ] [MAIN ] Derivative Progress: 1873/2211 symbols completed. STRV took 1.3s. Estimated remaining: 2m 23s. Rate: 141.5 symbols/min [2025-09-29T02:23:11.264494] [DEBUG] [MAIN ] STT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:11.265840] [INFO ] [MAIN ] STT: Generated 1820 derivative records from 51793 primary records. [2025-09-29T02:23:11.265965] [DEBUG] [LOCAL ] STT: Saving derivative data. [2025-09-29T02:23:11.284908] [DEBUG] [LOCAL ] STT: Derivative data saved (1820 records). [2025-09-29T02:23:11.285311] [INFO ] [MAIN ] STT: Successfully saved derivative data. [2025-09-29T02:23:11.288453] [INFO ] [MAIN ] Derivative Progress: 1874/2211 symbols completed. STT took 1.2s. Estimated remaining: 2m 23s. Rate: 141.6 symbols/min [2025-09-29T02:23:11.306467] [DEBUG] [MAIN ] STVN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:11.307281] [INFO ] [MAIN ] STVN: Generated 1820 derivative records from 26677 primary records. [2025-09-29T02:23:11.307376] [DEBUG] [LOCAL ] STVN: Saving derivative data. [2025-09-29T02:23:11.326598] [DEBUG] [LOCAL ] STVN: Derivative data saved (1820 records). [2025-09-29T02:23:11.326746] [INFO ] [MAIN ] STVN: Successfully saved derivative data. [2025-09-29T02:23:11.329924] [INFO ] [MAIN ] Derivative Progress: 1875/2211 symbols completed. STVN took 0.9s. Estimated remaining: 2m 22s. Rate: 141.6 symbols/min [2025-09-29T02:23:11.330395] [INFO ] [MAIN ] STWD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:11.330520] [INFO ] [MAIN ] STXE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:11.330563] [INFO ] [MAIN ] STXD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:11.339455] [DEBUG] [LOCAL ] STXD: Loaded 1341 existing records from primary storage. [2025-09-29T02:23:11.339767] [DEBUG] [LOCAL ] STXE: Loaded 2234 existing records from primary storage. [2025-09-29T02:23:11.340039] [INFO ] [MAIN ] STXD: Loaded 1341 primary data records. [2025-09-29T02:23:11.340114] [INFO ] [MAIN ] STXE: Loaded 2234 primary data records. [2025-09-29T02:23:12.084978] [DEBUG] [LOCAL ] STWD: Loaded 52643 existing records from primary storage. [2025-09-29T02:23:12.103580] [INFO ] [MAIN ] STWD: Loaded 52643 primary data records. [2025-09-29T02:23:12.506635] [DEBUG] [MAIN ] STXD: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:23:12.521567] [DEBUG] [MAIN ] STXE: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:23:12.522514] [INFO ] [MAIN ] STXD: Generated 1819 derivative records from 1341 primary records. [2025-09-29T02:23:12.523548] [INFO ] [MAIN ] STXE: Generated 1819 derivative records from 2234 primary records. [2025-09-29T02:23:12.523884] [DEBUG] [LOCAL ] STXE: Saving derivative data. [2025-09-29T02:23:12.523813] [DEBUG] [LOCAL ] STXD: Saving derivative data. [2025-09-29T02:23:12.558499] [DEBUG] [LOCAL ] STXE: Derivative data saved (1819 records). [2025-09-29T02:23:12.560855] [DEBUG] [LOCAL ] STXD: Derivative data saved (1819 records). [2025-09-29T02:23:12.561029] [INFO ] [MAIN ] STXD: Successfully saved derivative data. [2025-09-29T02:23:12.563571] [INFO ] [MAIN ] Derivative Progress: 1876/2211 symbols completed. STXD took 1.2s. Estimated remaining: 2m 22s. Rate: 141.5 symbols/min [2025-09-29T02:23:12.558946] [INFO ] [MAIN ] STXE: Successfully saved derivative data. [2025-09-29T02:23:12.564548] [INFO ] [MAIN ] STXG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:12.568394] [INFO ] [MAIN ] Derivative Progress: 1877/2211 symbols completed. STXE took 1.2s. Estimated remaining: 2m 22s. Rate: 141.5 symbols/min [2025-09-29T02:23:12.569584] [INFO ] [MAIN ] STXK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:12.578933] [DEBUG] [LOCAL ] STXG: Loaded 2612 existing records from primary storage. [2025-09-29T02:23:12.579225] [INFO ] [MAIN ] STXG: Loaded 2612 primary data records. [2025-09-29T02:23:12.593796] [DEBUG] [MAIN ] STWD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:12.597524] [DEBUG] [LOCAL ] STXK: Loaded 1535 existing records from primary storage. [2025-09-29T02:23:12.637152] [INFO ] [MAIN ] STWD: Generated 1820 derivative records from 52643 primary records. [2025-09-29T02:23:12.655497] [DEBUG] [LOCAL ] STWD: Saving derivative data. [2025-09-29T02:23:12.664205] [INFO ] [MAIN ] STXK: Loaded 1535 primary data records. [2025-09-29T02:23:12.873093] [DEBUG] [LOCAL ] STWD: Derivative data saved (1820 records). [2025-09-29T02:23:12.957675] [INFO ] [MAIN ] STWD: Successfully saved derivative data. [2025-09-29T02:23:13.126937] [INFO ] [MAIN ] Derivative Progress: 1878/2211 symbols completed. STWD took 1.8s. Estimated remaining: 2m 21s. Rate: 141.5 symbols/min [2025-09-29T02:23:13.175626] [INFO ] [MAIN ] STXT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:13.346400] [DEBUG] [LOCAL ] STXT: Loaded 2592 existing records from primary storage. [2025-09-29T02:23:13.347628] [INFO ] [MAIN ] STXT: Loaded 2592 primary data records. [2025-09-29T02:23:13.552559] [DEBUG] [MAIN ] STXG: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:23:13.585304] [INFO ] [MAIN ] STXG: Generated 1819 derivative records from 2612 primary records. [2025-09-29T02:23:13.628508] [DEBUG] [LOCAL ] STXG: Saving derivative data. [2025-09-29T02:23:13.794866] [DEBUG] [MAIN ] STXK: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:23:13.797897] [INFO ] [MAIN ] STXK: Generated 1819 derivative records from 1535 primary records. [2025-09-29T02:23:13.798546] [DEBUG] [LOCAL ] STXK: Saving derivative data. [2025-09-29T02:23:13.796973] [DEBUG] [LOCAL ] STXG: Derivative data saved (1819 records). [2025-09-29T02:23:13.799275] [INFO ] [MAIN ] STXG: Successfully saved derivative data. [2025-09-29T02:23:13.802772] [INFO ] [MAIN ] Derivative Progress: 1879/2211 symbols completed. STXG took 1.2s. Estimated remaining: 2m 21s. Rate: 141.5 symbols/min [2025-09-29T02:23:13.803405] [INFO ] [MAIN ] STXV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:13.820922] [DEBUG] [LOCAL ] STXK: Derivative data saved (1819 records). [2025-09-29T02:23:13.821271] [INFO ] [MAIN ] STXK: Successfully saved derivative data. [2025-09-29T02:23:13.824140] [INFO ] [MAIN ] Derivative Progress: 1880/2211 symbols completed. STXK took 1.3s. Estimated remaining: 2m 20s. Rate: 141.6 symbols/min [2025-09-29T02:23:13.824562] [INFO ] [MAIN ] STZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:13.826923] [DEBUG] [LOCAL ] STXV: Loaded 1648 existing records from primary storage. [2025-09-29T02:23:13.827864] [INFO ] [MAIN ] STXV: Loaded 1648 primary data records. [2025-09-29T02:23:14.036598] [DEBUG] [MAIN ] STXT: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:23:14.151098] [INFO ] [MAIN ] STXT: Generated 1819 derivative records from 2592 primary records. [2025-09-29T02:23:14.234225] [DEBUG] [LOCAL ] STXT: Saving derivative data. [2025-09-29T02:23:14.262855] [DEBUG] [LOCAL ] STXT: Derivative data saved (1819 records). [2025-09-29T02:23:14.278569] [INFO ] [MAIN ] STXT: Successfully saved derivative data. [2025-09-29T02:23:14.283389] [INFO ] [MAIN ] Derivative Progress: 1881/2211 symbols completed. STXT took 1.1s. Estimated remaining: 2m 20s. Rate: 141.5 symbols/min [2025-09-29T02:23:14.286413] [DEBUG] [LOCAL ] STZ: Loaded 53035 existing records from primary storage. [2025-09-29T02:23:14.286988] [INFO ] [MAIN ] SU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:14.287074] [INFO ] [MAIN ] STZ: Loaded 53035 primary data records. [2025-09-29T02:23:14.651761] [DEBUG] [MAIN ] STXV: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:23:14.652958] [INFO ] [MAIN ] STXV: Generated 1819 derivative records from 1648 primary records. [2025-09-29T02:23:14.653793] [DEBUG] [LOCAL ] STXV: Saving derivative data. [2025-09-29T02:23:14.689060] [DEBUG] [LOCAL ] STXV: Derivative data saved (1819 records). [2025-09-29T02:23:14.689893] [INFO ] [MAIN ] STXV: Successfully saved derivative data. [2025-09-29T02:23:14.692481] [INFO ] [MAIN ] Derivative Progress: 1882/2211 symbols completed. STXV took 0.9s. Estimated remaining: 2m 19s. Rate: 141.5 symbols/min [2025-09-29T02:23:14.692726] [INFO ] [MAIN ] SUI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:14.694767] [DEBUG] [LOCAL ] SU: Loaded 54234 existing records from primary storage. [2025-09-29T02:23:14.696513] [INFO ] [MAIN ] SU: Loaded 54234 primary data records. [2025-09-29T02:23:15.088239] [DEBUG] [MAIN ] STZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:15.089904] [DEBUG] [LOCAL ] SUI: Loaded 42505 existing records from primary storage. [2025-09-29T02:23:15.090756] [INFO ] [MAIN ] SUI: Loaded 42505 primary data records. [2025-09-29T02:23:15.091696] [INFO ] [MAIN ] STZ: Generated 1820 derivative records from 53035 primary records. [2025-09-29T02:23:15.091977] [DEBUG] [LOCAL ] STZ: Saving derivative data. [2025-09-29T02:23:15.229949] [DEBUG] [LOCAL ] STZ: Derivative data saved (1820 records). [2025-09-29T02:23:15.230332] [INFO ] [MAIN ] STZ: Successfully saved derivative data. [2025-09-29T02:23:15.285873] [INFO ] [MAIN ] Derivative Progress: 1883/2211 symbols completed. STZ took 1.5s. Estimated remaining: 2m 19s. Rate: 141.5 symbols/min [2025-09-29T02:23:15.433999] [INFO ] [MAIN ] SUN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:15.474458] [DEBUG] [MAIN ] SU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:15.475794] [INFO ] [MAIN ] SU: Generated 1820 derivative records from 54234 primary records. [2025-09-29T02:23:15.476003] [DEBUG] [LOCAL ] SU: Saving derivative data. [2025-09-29T02:23:15.499036] [DEBUG] [LOCAL ] SU: Derivative data saved (1820 records). [2025-09-29T02:23:15.499541] [INFO ] [MAIN ] SU: Successfully saved derivative data. [2025-09-29T02:23:15.503218] [INFO ] [MAIN ] Derivative Progress: 1884/2211 symbols completed. SU took 1.2s. Estimated remaining: 2m 19s. Rate: 141.6 symbols/min [2025-09-29T02:23:15.503769] [INFO ] [MAIN ] SUPV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:15.544681] [DEBUG] [MAIN ] SUI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:15.546566] [INFO ] [MAIN ] SUI: Generated 1820 derivative records from 42505 primary records. [2025-09-29T02:23:15.546699] [DEBUG] [LOCAL ] SUI: Saving derivative data. [2025-09-29T02:23:15.547772] [DEBUG] [LOCAL ] SUN: Loaded 37928 existing records from primary storage. [2025-09-29T02:23:15.548049] [INFO ] [MAIN ] SUN: Loaded 37928 primary data records. [2025-09-29T02:23:15.650936] [DEBUG] [LOCAL ] SUI: Derivative data saved (1820 records). [2025-09-29T02:23:15.663108] [INFO ] [MAIN ] SUI: Successfully saved derivative data. [2025-09-29T02:23:15.688308] [INFO ] [MAIN ] Derivative Progress: 1885/2211 symbols completed. SUI took 1.0s. Estimated remaining: 2m 18s. Rate: 141.6 symbols/min [2025-09-29T02:23:15.711036] [INFO ] [MAIN ] SUZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:15.973445] [DEBUG] [LOCAL ] SUPV: Loaded 47961 existing records from primary storage. [2025-09-29T02:23:15.973989] [INFO ] [MAIN ] SUPV: Loaded 47961 primary data records. [2025-09-29T02:23:16.161631] [DEBUG] [LOCAL ] SUZ: Loaded 46428 existing records from primary storage. [2025-09-29T02:23:16.162372] [INFO ] [MAIN ] SUZ: Loaded 46428 primary data records. [2025-09-29T02:23:16.350331] [DEBUG] [MAIN ] SUN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:16.552776] [INFO ] [MAIN ] SUN: Generated 1820 derivative records from 37928 primary records. [2025-09-29T02:23:16.573160] [DEBUG] [LOCAL ] SUN: Saving derivative data. [2025-09-29T02:23:16.715407] [DEBUG] [LOCAL ] SUN: Derivative data saved (1820 records). [2025-09-29T02:23:16.807434] [INFO ] [MAIN ] SUN: Successfully saved derivative data. [2025-09-29T02:23:16.825494] [INFO ] [MAIN ] Derivative Progress: 1886/2211 symbols completed. SUN took 1.4s. Estimated remaining: 2m 18s. Rate: 141.5 symbols/min [2025-09-29T02:23:16.826702] [INFO ] [MAIN ] SVV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:16.854191] [DEBUG] [MAIN ] SUPV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:16.855082] [INFO ] [MAIN ] SUPV: Generated 1820 derivative records from 47961 primary records. [2025-09-29T02:23:16.855356] [DEBUG] [LOCAL ] SUPV: Saving derivative data. [2025-09-29T02:23:16.873463] [DEBUG] [LOCAL ] SUPV: Derivative data saved (1820 records). [2025-09-29T02:23:16.883376] [INFO ] [MAIN ] SUPV: Successfully saved derivative data. [2025-09-29T02:23:16.888435] [INFO ] [MAIN ] Derivative Progress: 1887/2211 symbols completed. SUPV took 1.4s. Estimated remaining: 2m 17s. Rate: 141.5 symbols/min [2025-09-29T02:23:16.889103] [INFO ] [MAIN ] SW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:16.907910] [DEBUG] [MAIN ] SUZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:16.920397] [INFO ] [MAIN ] SUZ: Generated 1820 derivative records from 46428 primary records. [2025-09-29T02:23:16.920701] [DEBUG] [LOCAL ] SUZ: Saving derivative data. [2025-09-29T02:23:16.932996] [DEBUG] [LOCAL ] SVV: Loaded 40221 existing records from primary storage. [2025-09-29T02:23:16.936859] [INFO ] [MAIN ] SVV: Loaded 40221 primary data records. [2025-09-29T02:23:16.998201] [DEBUG] [LOCAL ] SUZ: Derivative data saved (1820 records). [2025-09-29T02:23:17.030430] [INFO ] [MAIN ] SUZ: Successfully saved derivative data. [2025-09-29T02:23:17.060342] [INFO ] [MAIN ] Derivative Progress: 1888/2211 symbols completed. SUZ took 1.3s. Estimated remaining: 2m 17s. Rate: 141.6 symbols/min [2025-09-29T02:23:17.326749] [DEBUG] [LOCAL ] SW: Loaded 53939 existing records from primary storage. [2025-09-29T02:23:17.327007] [INFO ] [MAIN ] SW: Loaded 53939 primary data records. [2025-09-29T02:23:17.696514] [DEBUG] [MAIN ] SVV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:17.698003] [INFO ] [MAIN ] SVV: Generated 1820 derivative records from 40221 primary records. [2025-09-29T02:23:17.698335] [DEBUG] [LOCAL ] SVV: Saving derivative data. [2025-09-29T02:23:17.717022] [DEBUG] [LOCAL ] SVV: Derivative data saved (1820 records). [2025-09-29T02:23:17.717521] [INFO ] [MAIN ] SVV: Successfully saved derivative data. [2025-09-29T02:23:17.720630] [INFO ] [MAIN ] Derivative Progress: 1889/2211 symbols completed. SVV took 0.9s. Estimated remaining: 2m 17s. Rate: 141.5 symbols/min [2025-09-29T02:23:17.738470] [DEBUG] [MAIN ] SW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:17.739136] [INFO ] [MAIN ] SW: Generated 1820 derivative records from 53939 primary records. [2025-09-29T02:23:17.739221] [DEBUG] [LOCAL ] SW: Saving derivative data. [2025-09-29T02:23:17.754700] [DEBUG] [LOCAL ] SW: Derivative data saved (1820 records). [2025-09-29T02:23:17.754821] [INFO ] [MAIN ] SW: Successfully saved derivative data. [2025-09-29T02:23:17.757551] [INFO ] [MAIN ] Derivative Progress: 1890/2211 symbols completed. SW took 0.9s. Estimated remaining: 2m 16s. Rate: 141.6 symbols/min [2025-09-29T02:23:17.758676] [INFO ] [MAIN ] SWZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:17.758554] [INFO ] [MAIN ] SWK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:17.758759] [INFO ] [MAIN ] SWX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:17.770472] [DEBUG] [LOCAL ] SWZ: Loaded 6074 existing records from primary storage. [2025-09-29T02:23:17.770934] [INFO ] [MAIN ] SWZ: Loaded 6074 primary data records. [2025-09-29T02:23:18.015590] [DEBUG] [LOCAL ] SWX: Loaded 31735 existing records from primary storage. [2025-09-29T02:23:18.133217] [INFO ] [MAIN ] SWX: Loaded 31735 primary data records. [2025-09-29T02:23:18.255008] [DEBUG] [LOCAL ] SWK: Loaded 53178 existing records from primary storage. [2025-09-29T02:23:18.276613] [INFO ] [MAIN ] SWK: Loaded 53178 primary data records. [2025-09-29T02:23:18.947044] [DEBUG] [MAIN ] SWZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:18.949038] [INFO ] [MAIN ] SWZ: Generated 1820 derivative records from 6074 primary records. [2025-09-29T02:23:18.949963] [DEBUG] [LOCAL ] SWZ: Saving derivative data. [2025-09-29T02:23:18.968408] [DEBUG] [LOCAL ] SWZ: Derivative data saved (1820 records). [2025-09-29T02:23:18.974614] [INFO ] [MAIN ] SWZ: Successfully saved derivative data. [2025-09-29T02:23:18.991745] [INFO ] [MAIN ] Derivative Progress: 1891/2211 symbols completed. SWZ took 1.2s. Estimated remaining: 2m 16s. Rate: 141.5 symbols/min [2025-09-29T02:23:18.992350] [DEBUG] [MAIN ] SWX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:18.994064] [INFO ] [MAIN ] SWX: Generated 1820 derivative records from 31735 primary records. [2025-09-29T02:23:18.994219] [DEBUG] [LOCAL ] SWX: Saving derivative data. [2025-09-29T02:23:18.992879] [INFO ] [MAIN ] SXC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:19.015235] [DEBUG] [LOCAL ] SWX: Derivative data saved (1820 records). [2025-09-29T02:23:19.015609] [INFO ] [MAIN ] SWX: Successfully saved derivative data. [2025-09-29T02:23:19.018126] [INFO ] [MAIN ] Derivative Progress: 1892/2211 symbols completed. SWX took 1.3s. Estimated remaining: 2m 15s. Rate: 141.5 symbols/min [2025-09-29T02:23:19.019002] [INFO ] [MAIN ] SXI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:19.036488] [DEBUG] [MAIN ] SWK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:19.037547] [INFO ] [MAIN ] SWK: Generated 1820 derivative records from 53178 primary records. [2025-09-29T02:23:19.037888] [DEBUG] [LOCAL ] SWK: Saving derivative data. [2025-09-29T02:23:19.069371] [DEBUG] [LOCAL ] SWK: Derivative data saved (1820 records). [2025-09-29T02:23:19.075445] [DEBUG] [LOCAL ] SXI: Loaded 11685 existing records from primary storage. [2025-09-29T02:23:19.075765] [INFO ] [MAIN ] SWK: Successfully saved derivative data. [2025-09-29T02:23:19.075844] [INFO ] [MAIN ] SXI: Loaded 11685 primary data records. [2025-09-29T02:23:19.079254] [INFO ] [MAIN ] Derivative Progress: 1893/2211 symbols completed. SWK took 1.3s. Estimated remaining: 2m 15s. Rate: 141.6 symbols/min [2025-09-29T02:23:19.105970] [INFO ] [MAIN ] SXT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:19.172102] [DEBUG] [LOCAL ] SXC: Loaded 42142 existing records from primary storage. [2025-09-29T02:23:19.191362] [INFO ] [MAIN ] SXC: Loaded 42142 primary data records. [2025-09-29T02:23:19.643856] [DEBUG] [LOCAL ] SXT: Loaded 29557 existing records from primary storage. [2025-09-29T02:23:19.801399] [INFO ] [MAIN ] SXT: Loaded 29557 primary data records. [2025-09-29T02:23:20.176885] [DEBUG] [MAIN ] SXI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:20.179809] [INFO ] [MAIN ] SXI: Generated 1820 derivative records from 11685 primary records. [2025-09-29T02:23:20.180979] [DEBUG] [LOCAL ] SXI: Saving derivative data. [2025-09-29T02:23:20.195127] [DEBUG] [MAIN ] SXC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:20.196913] [INFO ] [MAIN ] SXC: Generated 1820 derivative records from 42142 primary records. [2025-09-29T02:23:20.211065] [DEBUG] [LOCAL ] SXC: Saving derivative data. [2025-09-29T02:23:20.236610] [DEBUG] [LOCAL ] SXC: Derivative data saved (1820 records). [2025-09-29T02:23:20.237308] [INFO ] [MAIN ] SXC: Successfully saved derivative data. [2025-09-29T02:23:20.235698] [DEBUG] [LOCAL ] SXI: Derivative data saved (1820 records). [2025-09-29T02:23:20.240250] [INFO ] [MAIN ] Derivative Progress: 1894/2211 symbols completed. SXC took 1.2s. Estimated remaining: 2m 14s. Rate: 141.5 symbols/min [2025-09-29T02:23:20.240985] [INFO ] [MAIN ] SYF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:20.240637] [INFO ] [MAIN ] SXI: Successfully saved derivative data. [2025-09-29T02:23:20.244061] [INFO ] [MAIN ] Derivative Progress: 1895/2211 symbols completed. SXI took 1.2s. Estimated remaining: 2m 14s. Rate: 141.5 symbols/min [2025-09-29T02:23:20.244905] [INFO ] [MAIN ] SYK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:20.266137] [DEBUG] [MAIN ] SXT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:20.267285] [INFO ] [MAIN ] SXT: Generated 1820 derivative records from 29557 primary records. [2025-09-29T02:23:20.267471] [DEBUG] [LOCAL ] SXT: Saving derivative data. [2025-09-29T02:23:20.291950] [DEBUG] [LOCAL ] SXT: Derivative data saved (1820 records). [2025-09-29T02:23:20.292253] [INFO ] [MAIN ] SXT: Successfully saved derivative data. [2025-09-29T02:23:20.295359] [INFO ] [MAIN ] Derivative Progress: 1896/2211 symbols completed. SXT took 1.2s. Estimated remaining: 2m 13s. Rate: 141.6 symbols/min [2025-09-29T02:23:20.295637] [INFO ] [MAIN ] SYY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:20.359740] [DEBUG] [LOCAL ] SYF: Loaded 54222 existing records from primary storage. [2025-09-29T02:23:20.361529] [INFO ] [MAIN ] SYF: Loaded 54222 primary data records. [2025-09-29T02:23:20.452349] [DEBUG] [LOCAL ] SYK: Loaded 47699 existing records from primary storage. [2025-09-29T02:23:20.491276] [INFO ] [MAIN ] SYK: Loaded 47699 primary data records. [2025-09-29T02:23:20.701373] [DEBUG] [LOCAL ] SYY: Loaded 54009 existing records from primary storage. [2025-09-29T02:23:20.728153] [INFO ] [MAIN ] SYY: Loaded 54009 primary data records. [2025-09-29T02:23:21.551323] [DEBUG] [MAIN ] SYF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:21.553589] [INFO ] [MAIN ] SYF: Generated 1820 derivative records from 54222 primary records. [2025-09-29T02:23:21.554697] [DEBUG] [LOCAL ] SYF: Saving derivative data. [2025-09-29T02:23:21.580768] [DEBUG] [LOCAL ] SYF: Derivative data saved (1820 records). [2025-09-29T02:23:21.595233] [DEBUG] [MAIN ] SYK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:21.589734] [INFO ] [MAIN ] SYF: Successfully saved derivative data. [2025-09-29T02:23:21.599321] [INFO ] [MAIN ] Derivative Progress: 1897/2211 symbols completed. SYF took 1.4s. Estimated remaining: 2m 13s. Rate: 141.5 symbols/min [2025-09-29T02:23:21.596148] [INFO ] [MAIN ] SYK: Generated 1820 derivative records from 47699 primary records. [2025-09-29T02:23:21.599829] [INFO ] [MAIN ] T: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:21.599945] [DEBUG] [LOCAL ] SYK: Saving derivative data. [2025-09-29T02:23:21.621666] [DEBUG] [LOCAL ] SYK: Derivative data saved (1820 records). [2025-09-29T02:23:21.623404] [INFO ] [MAIN ] SYK: Successfully saved derivative data. [2025-09-29T02:23:21.626924] [INFO ] [MAIN ] Derivative Progress: 1898/2211 symbols completed. SYK took 1.4s. Estimated remaining: 2m 13s. Rate: 141.5 symbols/min [2025-09-29T02:23:21.627302] [INFO ] [MAIN ] TAC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:21.641217] [DEBUG] [MAIN ] SYY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:21.642084] [INFO ] [MAIN ] SYY: Generated 1820 derivative records from 54009 primary records. [2025-09-29T02:23:21.642239] [DEBUG] [LOCAL ] SYY: Saving derivative data. [2025-09-29T02:23:21.662064] [DEBUG] [LOCAL ] SYY: Derivative data saved (1820 records). [2025-09-29T02:23:21.662442] [INFO ] [MAIN ] SYY: Successfully saved derivative data. [2025-09-29T02:23:21.666512] [INFO ] [MAIN ] Derivative Progress: 1899/2211 symbols completed. SYY took 1.4s. Estimated remaining: 2m 12s. Rate: 141.6 symbols/min [2025-09-29T02:23:21.666925] [INFO ] [MAIN ] TAK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:21.726630] [DEBUG] [LOCAL ] T: Loaded 54578 existing records from primary storage. [2025-09-29T02:23:21.728291] [INFO ] [MAIN ] T: Loaded 54578 primary data records. [2025-09-29T02:23:21.792450] [DEBUG] [LOCAL ] TAC: Loaded 43441 existing records from primary storage. [2025-09-29T02:23:21.850581] [INFO ] [MAIN ] TAC: Loaded 43441 primary data records. [2025-09-29T02:23:21.946486] [DEBUG] [LOCAL ] TAK: Loaded 50538 existing records from primary storage. [2025-09-29T02:23:21.981232] [INFO ] [MAIN ] TAK: Loaded 50538 primary data records. [2025-09-29T02:23:22.868961] [DEBUG] [MAIN ] T: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:22.871375] [INFO ] [MAIN ] T: Generated 1820 derivative records from 54578 primary records. [2025-09-29T02:23:22.871728] [DEBUG] [LOCAL ] T: Saving derivative data. [2025-09-29T02:23:22.916723] [DEBUG] [MAIN ] TAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:22.916869] [DEBUG] [LOCAL ] T: Derivative data saved (1820 records). [2025-09-29T02:23:22.918433] [INFO ] [MAIN ] T: Successfully saved derivative data. [2025-09-29T02:23:22.919787] [INFO ] [MAIN ] TAC: Generated 1820 derivative records from 43441 primary records. [2025-09-29T02:23:22.922446] [INFO ] [MAIN ] Derivative Progress: 1900/2211 symbols completed. T took 1.3s. Estimated remaining: 2m 12s. Rate: 141.4 symbols/min [2025-09-29T02:23:22.922869] [INFO ] [MAIN ] TAL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:22.923705] [DEBUG] [LOCAL ] TAC: Saving derivative data. [2025-09-29T02:23:22.939179] [DEBUG] [MAIN ] TAK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:22.963403] [DEBUG] [LOCAL ] TAC: Derivative data saved (1820 records). [2025-09-29T02:23:22.958752] [INFO ] [MAIN ] TAK: Generated 1820 derivative records from 50538 primary records. [2025-09-29T02:23:22.963671] [INFO ] [MAIN ] TAC: Successfully saved derivative data. [2025-09-29T02:23:22.966663] [INFO ] [MAIN ] Derivative Progress: 1901/2211 symbols completed. TAC took 1.3s. Estimated remaining: 2m 11s. Rate: 141.5 symbols/min [2025-09-29T02:23:22.966928] [INFO ] [MAIN ] TALO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:22.963775] [DEBUG] [LOCAL ] TAK: Saving derivative data. [2025-09-29T02:23:22.985902] [DEBUG] [LOCAL ] TAK: Derivative data saved (1820 records). [2025-09-29T02:23:22.986111] [INFO ] [MAIN ] TAK: Successfully saved derivative data. [2025-09-29T02:23:22.988956] [INFO ] [MAIN ] Derivative Progress: 1902/2211 symbols completed. TAK took 1.3s. Estimated remaining: 2m 11s. Rate: 141.6 symbols/min [2025-09-29T02:23:22.989308] [INFO ] [MAIN ] TAP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:23.056466] [DEBUG] [LOCAL ] TAL: Loaded 52783 existing records from primary storage. [2025-09-29T02:23:23.057047] [INFO ] [MAIN ] TAL: Loaded 52783 primary data records. [2025-09-29T02:23:23.226373] [DEBUG] [LOCAL ] TALO: Loaded 51575 existing records from primary storage. [2025-09-29T02:23:23.290984] [INFO ] [MAIN ] TALO: Loaded 51575 primary data records. [2025-09-29T02:23:23.327355] [DEBUG] [LOCAL ] TAP: Loaded 53648 existing records from primary storage. [2025-09-29T02:23:23.497606] [INFO ] [MAIN ] TAP: Loaded 53648 primary data records. [2025-09-29T02:23:24.286052] [DEBUG] [MAIN ] TAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:24.288093] [INFO ] [MAIN ] TAL: Generated 1820 derivative records from 52783 primary records. [2025-09-29T02:23:24.288211] [DEBUG] [LOCAL ] TAL: Saving derivative data. [2025-09-29T02:23:24.308176] [DEBUG] [LOCAL ] TAL: Derivative data saved (1820 records). [2025-09-29T02:23:24.308769] [INFO ] [MAIN ] TAL: Successfully saved derivative data. [2025-09-29T02:23:24.311510] [INFO ] [MAIN ] Derivative Progress: 1903/2211 symbols completed. TAL took 1.4s. Estimated remaining: 2m 11s. Rate: 141.4 symbols/min [2025-09-29T02:23:24.332899] [DEBUG] [MAIN ] TALO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:24.334424] [INFO ] [MAIN ] TALO: Generated 1820 derivative records from 51575 primary records. [2025-09-29T02:23:24.334527] [DEBUG] [LOCAL ] TALO: Saving derivative data. [2025-09-29T02:23:24.367315] [DEBUG] [LOCAL ] TALO: Derivative data saved (1820 records). [2025-09-29T02:23:24.367452] [INFO ] [MAIN ] TALO: Successfully saved derivative data. [2025-09-29T02:23:24.378764] [INFO ] [MAIN ] Derivative Progress: 1904/2211 symbols completed. TALO took 1.4s. Estimated remaining: 2m 10s. Rate: 141.5 symbols/min [2025-09-29T02:23:24.379600] [DEBUG] [MAIN ] TAP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:24.380581] [INFO ] [MAIN ] TAP: Generated 1820 derivative records from 53648 primary records. [2025-09-29T02:23:24.380694] [DEBUG] [LOCAL ] TAP: Saving derivative data. [2025-09-29T02:23:24.397427] [DEBUG] [LOCAL ] TAP: Derivative data saved (1820 records). [2025-09-29T02:23:24.397529] [INFO ] [MAIN ] TAP: Successfully saved derivative data. [2025-09-29T02:23:24.400494] [INFO ] [MAIN ] Derivative Progress: 1905/2211 symbols completed. TAP took 1.4s. Estimated remaining: 2m 10s. Rate: 141.6 symbols/min [2025-09-29T02:23:24.401039] [INFO ] [MAIN ] TBB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:24.401093] [INFO ] [MAIN ] TBI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:24.401154] [INFO ] [MAIN ] TBBB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:24.420399] [DEBUG] [LOCAL ] TBB: Loaded 11828 existing records from primary storage. [2025-09-29T02:23:24.425683] [INFO ] [MAIN ] TBB: Loaded 11828 primary data records. [2025-09-29T02:23:24.497588] [DEBUG] [LOCAL ] TBI: Loaded 22937 existing records from primary storage. [2025-09-29T02:23:24.536668] [INFO ] [MAIN ] TBI: Loaded 22937 primary data records. [2025-09-29T02:23:24.767545] [DEBUG] [LOCAL ] TBBB: Loaded 36262 existing records from primary storage. [2025-09-29T02:23:24.924581] [INFO ] [MAIN ] TBBB: Loaded 36262 primary data records. [2025-09-29T02:23:25.556784] [DEBUG] [MAIN ] TBB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:25.558779] [INFO ] [MAIN ] TBB: Generated 1820 derivative records from 11828 primary records. [2025-09-29T02:23:25.559084] [DEBUG] [LOCAL ] TBB: Saving derivative data. [2025-09-29T02:23:25.581683] [DEBUG] [LOCAL ] TBB: Derivative data saved (1820 records). [2025-09-29T02:23:25.595894] [INFO ] [MAIN ] TBB: Successfully saved derivative data. [2025-09-29T02:23:25.599034] [INFO ] [MAIN ] Derivative Progress: 1906/2211 symbols completed. TBB took 1.2s. Estimated remaining: 2m 9s. Rate: 141.4 symbols/min [2025-09-29T02:23:25.599860] [INFO ] [MAIN ] TBN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:25.599531] [DEBUG] [MAIN ] TBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:25.601504] [INFO ] [MAIN ] TBI: Generated 1820 derivative records from 22937 primary records. [2025-09-29T02:23:25.602111] [DEBUG] [LOCAL ] TBI: Saving derivative data. [2025-09-29T02:23:25.622786] [DEBUG] [LOCAL ] TBN: Loaded 3044 existing records from primary storage. [2025-09-29T02:23:25.624672] [INFO ] [MAIN ] TBN: Loaded 3044 primary data records. [2025-09-29T02:23:25.626712] [DEBUG] [LOCAL ] TBI: Derivative data saved (1820 records). [2025-09-29T02:23:25.644193] [INFO ] [MAIN ] TBI: Successfully saved derivative data. [2025-09-29T02:23:25.695223] [INFO ] [MAIN ] Derivative Progress: 1907/2211 symbols completed. TBI took 1.3s. Estimated remaining: 2m 9s. Rate: 141.5 symbols/min [2025-09-29T02:23:25.720880] [INFO ] [MAIN ] TD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:25.793022] [DEBUG] [MAIN ] TBBB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:25.811560] [INFO ] [MAIN ] TBBB: Generated 1820 derivative records from 36262 primary records. [2025-09-29T02:23:25.833564] [DEBUG] [LOCAL ] TBBB: Saving derivative data. [2025-09-29T02:23:26.006604] [DEBUG] [LOCAL ] TBBB: Derivative data saved (1820 records). [2025-09-29T02:23:26.007128] [INFO ] [MAIN ] TBBB: Successfully saved derivative data. [2025-09-29T02:23:26.010946] [INFO ] [MAIN ] Derivative Progress: 1908/2211 symbols completed. TBBB took 1.6s. Estimated remaining: 2m 8s. Rate: 141.5 symbols/min [2025-09-29T02:23:26.012292] [INFO ] [MAIN ] TDC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:26.061251] [DEBUG] [LOCAL ] TD: Loaded 53036 existing records from primary storage. [2025-09-29T02:23:26.061571] [INFO ] [MAIN ] TD: Loaded 53036 primary data records. [2025-09-29T02:23:26.113001] [DEBUG] [MAIN ] TBN: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-09-29T02:23:26.140699] [INFO ] [MAIN ] TBN: Generated 1818 derivative records from 3044 primary records. [2025-09-29T02:23:26.205034] [DEBUG] [LOCAL ] TBN: Saving derivative data. [2025-09-29T02:23:26.320784] [DEBUG] [LOCAL ] TDC: Loaded 47501 existing records from primary storage. [2025-09-29T02:23:26.447734] [INFO ] [MAIN ] TDC: Loaded 47501 primary data records. [2025-09-29T02:23:26.451491] [DEBUG] [LOCAL ] TBN: Derivative data saved (1818 records). [2025-09-29T02:23:26.451776] [INFO ] [MAIN ] TBN: Successfully saved derivative data. [2025-09-29T02:23:26.472502] [INFO ] [MAIN ] Derivative Progress: 1909/2211 symbols completed. TBN took 0.9s. Estimated remaining: 2m 8s. Rate: 141.5 symbols/min [2025-09-29T02:23:26.511202] [INFO ] [MAIN ] TDF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:26.814605] [DEBUG] [LOCAL ] TDF: Loaded 6595 existing records from primary storage. [2025-09-29T02:23:26.815722] [INFO ] [MAIN ] TDF: Loaded 6595 primary data records. [2025-09-29T02:23:27.170666] [DEBUG] [MAIN ] TD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:27.172012] [INFO ] [MAIN ] TD: Generated 1820 derivative records from 53036 primary records. [2025-09-29T02:23:27.172442] [DEBUG] [LOCAL ] TD: Saving derivative data. [2025-09-29T02:23:27.191382] [DEBUG] [LOCAL ] TD: Derivative data saved (1820 records). [2025-09-29T02:23:27.193039] [INFO ] [MAIN ] TD: Successfully saved derivative data. [2025-09-29T02:23:27.196435] [INFO ] [MAIN ] Derivative Progress: 1910/2211 symbols completed. TD took 1.5s. Estimated remaining: 2m 8s. Rate: 141.4 symbols/min [2025-09-29T02:23:27.196721] [INFO ] [MAIN ] TDG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:27.215311] [DEBUG] [MAIN ] TDC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:27.216448] [INFO ] [MAIN ] TDC: Generated 1820 derivative records from 47501 primary records. [2025-09-29T02:23:27.216775] [DEBUG] [LOCAL ] TDC: Saving derivative data. [2025-09-29T02:23:27.242155] [DEBUG] [LOCAL ] TDC: Derivative data saved (1820 records). [2025-09-29T02:23:27.242618] [INFO ] [MAIN ] TDC: Successfully saved derivative data. [2025-09-29T02:23:27.264036] [INFO ] [MAIN ] Derivative Progress: 1911/2211 symbols completed. TDC took 1.3s. Estimated remaining: 2m 7s. Rate: 141.5 symbols/min [2025-09-29T02:23:27.264508] [DEBUG] [MAIN ] TDF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:27.265590] [INFO ] [MAIN ] TDF: Generated 1820 derivative records from 6595 primary records. [2025-09-29T02:23:27.265770] [INFO ] [MAIN ] TDOC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:27.265904] [DEBUG] [LOCAL ] TDF: Saving derivative data. [2025-09-29T02:23:27.294336] [DEBUG] [LOCAL ] TDG: Loaded 22314 existing records from primary storage. [2025-09-29T02:23:27.294872] [INFO ] [MAIN ] TDG: Loaded 22314 primary data records. [2025-09-29T02:23:27.375885] [DEBUG] [LOCAL ] TDF: Derivative data saved (1820 records). [2025-09-29T02:23:27.395595] [INFO ] [MAIN ] TDF: Successfully saved derivative data. [2025-09-29T02:23:27.429632] [INFO ] [MAIN ] Derivative Progress: 1912/2211 symbols completed. TDF took 0.9s. Estimated remaining: 2m 7s. Rate: 141.5 symbols/min [2025-09-29T02:23:27.447070] [INFO ] [MAIN ] TDS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:27.671525] [DEBUG] [LOCAL ] TDOC: Loaded 54125 existing records from primary storage. [2025-09-29T02:23:27.672740] [INFO ] [MAIN ] TDOC: Loaded 54125 primary data records. [2025-09-29T02:23:28.088396] [DEBUG] [LOCAL ] TDS: Loaded 43435 existing records from primary storage. [2025-09-29T02:23:28.089041] [INFO ] [MAIN ] TDS: Loaded 43435 primary data records. [2025-09-29T02:23:28.281044] [DEBUG] [MAIN ] TDG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:28.316428] [INFO ] [MAIN ] TDG: Generated 1820 derivative records from 22314 primary records. [2025-09-29T02:23:28.316744] [DEBUG] [LOCAL ] TDG: Saving derivative data. [2025-09-29T02:23:28.470679] [DEBUG] [LOCAL ] TDG: Derivative data saved (1820 records). [2025-09-29T02:23:28.470992] [INFO ] [MAIN ] TDG: Successfully saved derivative data. [2025-09-29T02:23:28.474515] [INFO ] [MAIN ] Derivative Progress: 1913/2211 symbols completed. TDG took 1.3s. Estimated remaining: 2m 6s. Rate: 141.4 symbols/min [2025-09-29T02:23:28.476022] [INFO ] [MAIN ] TDW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:28.497633] [DEBUG] [MAIN ] TDOC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:28.500818] [INFO ] [MAIN ] TDOC: Generated 1820 derivative records from 54125 primary records. [2025-09-29T02:23:28.501278] [DEBUG] [LOCAL ] TDOC: Saving derivative data. [2025-09-29T02:23:28.518948] [DEBUG] [LOCAL ] TDOC: Derivative data saved (1820 records). [2025-09-29T02:23:28.519608] [INFO ] [MAIN ] TDOC: Successfully saved derivative data. [2025-09-29T02:23:28.522963] [INFO ] [MAIN ] Derivative Progress: 1914/2211 symbols completed. TDOC took 1.3s. Estimated remaining: 2m 6s. Rate: 141.5 symbols/min [2025-09-29T02:23:28.523410] [INFO ] [MAIN ] TDY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:28.541711] [DEBUG] [MAIN ] TDS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:28.542553] [INFO ] [MAIN ] TDS: Generated 1820 derivative records from 43435 primary records. [2025-09-29T02:23:28.542744] [DEBUG] [LOCAL ] TDS: Saving derivative data. [2025-09-29T02:23:28.578410] [DEBUG] [LOCAL ] TDS: Derivative data saved (1820 records). [2025-09-29T02:23:28.593151] [INFO ] [MAIN ] TDS: Successfully saved derivative data. [2025-09-29T02:23:28.597538] [INFO ] [MAIN ] Derivative Progress: 1915/2211 symbols completed. TDS took 1.2s. Estimated remaining: 2m 5s. Rate: 141.6 symbols/min [2025-09-29T02:23:28.598003] [INFO ] [MAIN ] TEAF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:28.601860] [DEBUG] [LOCAL ] TDW: Loaded 46091 existing records from primary storage. [2025-09-29T02:23:28.610869] [INFO ] [MAIN ] TDW: Loaded 46091 primary data records. [2025-09-29T02:23:28.617447] [DEBUG] [LOCAL ] TDY: Loaded 22979 existing records from primary storage. [2025-09-29T02:23:28.630583] [INFO ] [MAIN ] TDY: Loaded 22979 primary data records. [2025-09-29T02:23:28.821583] [DEBUG] [LOCAL ] TEAF: Loaded 7529 existing records from primary storage. [2025-09-29T02:23:28.849828] [INFO ] [MAIN ] TEAF: Loaded 7529 primary data records. [2025-09-29T02:23:29.694762] [DEBUG] [MAIN ] TDW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:29.696064] [INFO ] [MAIN ] TDW: Generated 1820 derivative records from 46091 primary records. [2025-09-29T02:23:29.696260] [DEBUG] [LOCAL ] TDW: Saving derivative data. [2025-09-29T02:23:29.695098] [DEBUG] [MAIN ] TDY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:29.710045] [INFO ] [MAIN ] TDY: Generated 1820 derivative records from 22979 primary records. [2025-09-29T02:23:29.711076] [DEBUG] [LOCAL ] TDY: Saving derivative data. [2025-09-29T02:23:29.710418] [DEBUG] [MAIN ] TEAF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:29.724570] [INFO ] [MAIN ] TEAF: Generated 1820 derivative records from 7529 primary records. [2025-09-29T02:23:29.732752] [DEBUG] [LOCAL ] TEAF: Saving derivative data. [2025-09-29T02:23:29.741974] [DEBUG] [LOCAL ] TDW: Derivative data saved (1820 records). [2025-09-29T02:23:29.746322] [DEBUG] [LOCAL ] TDY: Derivative data saved (1820 records). [2025-09-29T02:23:29.746699] [INFO ] [MAIN ] TDW: Successfully saved derivative data. [2025-09-29T02:23:29.750272] [INFO ] [MAIN ] Derivative Progress: 1916/2211 symbols completed. TDW took 1.3s. Estimated remaining: 2m 5s. Rate: 141.4 symbols/min [2025-09-29T02:23:29.757998] [INFO ] [MAIN ] TECK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:29.759267] [INFO ] [MAIN ] TDY: Successfully saved derivative data. [2025-09-29T02:23:29.765588] [INFO ] [MAIN ] Derivative Progress: 1917/2211 symbols completed. TDY took 1.2s. Estimated remaining: 2m 5s. Rate: 141.5 symbols/min [2025-09-29T02:23:29.767124] [INFO ] [MAIN ] TEF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:29.772373] [DEBUG] [LOCAL ] TEAF: Derivative data saved (1820 records). [2025-09-29T02:23:29.772776] [INFO ] [MAIN ] TEAF: Successfully saved derivative data. [2025-09-29T02:23:29.778331] [INFO ] [MAIN ] Derivative Progress: 1918/2211 symbols completed. TEAF took 1.2s. Estimated remaining: 2m 4s. Rate: 141.6 symbols/min [2025-09-29T02:23:29.822840] [DEBUG] [LOCAL ] TEF: Loaded 37944 existing records from primary storage. [2025-09-29T02:23:29.823066] [INFO ] [MAIN ] TEF: Loaded 37944 primary data records. [2025-09-29T02:23:30.025140] [DEBUG] [LOCAL ] TECK: Loaded 54216 existing records from primary storage. [2025-09-29T02:23:30.057367] [INFO ] [MAIN ] TECK: Loaded 54216 primary data records. [2025-09-29T02:23:30.580330] [DEBUG] [MAIN ] TEF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:30.581526] [INFO ] [MAIN ] TEF: Generated 1820 derivative records from 37944 primary records. [2025-09-29T02:23:30.581624] [DEBUG] [LOCAL ] TEF: Saving derivative data. [2025-09-29T02:23:30.599730] [DEBUG] [LOCAL ] TEF: Derivative data saved (1820 records). [2025-09-29T02:23:30.600091] [INFO ] [MAIN ] TEF: Successfully saved derivative data. [2025-09-29T02:23:30.603628] [INFO ] [MAIN ] Derivative Progress: 1919/2211 symbols completed. TEF took 0.8s. Estimated remaining: 2m 4s. Rate: 141.5 symbols/min [2025-09-29T02:23:30.621045] [DEBUG] [MAIN ] TECK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:30.621772] [INFO ] [MAIN ] TECK: Generated 1820 derivative records from 54216 primary records. [2025-09-29T02:23:30.621857] [DEBUG] [LOCAL ] TECK: Saving derivative data. [2025-09-29T02:23:30.638756] [DEBUG] [LOCAL ] TECK: Derivative data saved (1820 records). [2025-09-29T02:23:30.638848] [INFO ] [MAIN ] TECK: Successfully saved derivative data. [2025-09-29T02:23:30.642888] [INFO ] [MAIN ] Derivative Progress: 1920/2211 symbols completed. TECK took 0.9s. Estimated remaining: 2m 3s. Rate: 141.6 symbols/min [2025-09-29T02:23:30.643591] [INFO ] [MAIN ] TEN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:30.643543] [INFO ] [MAIN ] TEI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:30.643681] [INFO ] [MAIN ] TEL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:30.669799] [DEBUG] [LOCAL ] TEI: Loaded 20910 existing records from primary storage. [2025-09-29T02:23:30.670323] [INFO ] [MAIN ] TEI: Loaded 20910 primary data records. [2025-09-29T02:23:30.853317] [DEBUG] [LOCAL ] TEN: Loaded 31383 existing records from primary storage. [2025-09-29T02:23:30.920259] [INFO ] [MAIN ] TEN: Loaded 31383 primary data records. [2025-09-29T02:23:31.093491] [DEBUG] [LOCAL ] TEL: Loaded 51898 existing records from primary storage. [2025-09-29T02:23:31.117168] [INFO ] [MAIN ] TEL: Loaded 51898 primary data records. [2025-09-29T02:23:31.805386] [DEBUG] [MAIN ] TEI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:31.809124] [INFO ] [MAIN ] TEI: Generated 1820 derivative records from 20910 primary records. [2025-09-29T02:23:31.810103] [DEBUG] [LOCAL ] TEI: Saving derivative data. [2025-09-29T02:23:31.834956] [DEBUG] [LOCAL ] TEI: Derivative data saved (1820 records). [2025-09-29T02:23:31.836666] [INFO ] [MAIN ] TEI: Successfully saved derivative data. [2025-09-29T02:23:31.840609] [INFO ] [MAIN ] Derivative Progress: 1921/2211 symbols completed. TEI took 1.2s. Estimated remaining: 2m 3s. Rate: 141.4 symbols/min [2025-09-29T02:23:31.841060] [INFO ] [MAIN ] TEO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:31.858836] [DEBUG] [MAIN ] TEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:31.859896] [INFO ] [MAIN ] TEN: Generated 1820 derivative records from 31383 primary records. [2025-09-29T02:23:31.860076] [DEBUG] [LOCAL ] TEN: Saving derivative data. [2025-09-29T02:23:31.895533] [DEBUG] [LOCAL ] TEN: Derivative data saved (1820 records). [2025-09-29T02:23:31.901056] [INFO ] [MAIN ] TEN: Successfully saved derivative data. [2025-09-29T02:23:31.904271] [INFO ] [MAIN ] Derivative Progress: 1922/2211 symbols completed. TEN took 1.3s. Estimated remaining: 2m 3s. Rate: 141.5 symbols/min [2025-09-29T02:23:31.901492] [DEBUG] [MAIN ] TEL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:31.904683] [INFO ] [MAIN ] TEVA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:31.906143] [INFO ] [MAIN ] TEL: Generated 1820 derivative records from 51898 primary records. [2025-09-29T02:23:31.914502] [DEBUG] [LOCAL ] TEL: Saving derivative data. [2025-09-29T02:23:31.915299] [DEBUG] [LOCAL ] TEO: Loaded 22345 existing records from primary storage. [2025-09-29T02:23:31.917839] [INFO ] [MAIN ] TEO: Loaded 22345 primary data records. [2025-09-29T02:23:32.005509] [DEBUG] [LOCAL ] TEL: Derivative data saved (1820 records). [2025-09-29T02:23:32.044585] [INFO ] [MAIN ] TEL: Successfully saved derivative data. [2025-09-29T02:23:32.053719] [INFO ] [MAIN ] Derivative Progress: 1923/2211 symbols completed. TEL took 1.4s. Estimated remaining: 2m 2s. Rate: 141.6 symbols/min [2025-09-29T02:23:32.075272] [INFO ] [MAIN ] TEX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:32.361254] [DEBUG] [LOCAL ] TEVA: Loaded 54413 existing records from primary storage. [2025-09-29T02:23:32.362796] [INFO ] [MAIN ] TEVA: Loaded 54413 primary data records. [2025-09-29T02:23:32.591478] [DEBUG] [LOCAL ] TEX: Loaded 45170 existing records from primary storage. [2025-09-29T02:23:32.615274] [INFO ] [MAIN ] TEX: Loaded 45170 primary data records. [2025-09-29T02:23:32.832573] [DEBUG] [MAIN ] TEO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:32.863968] [INFO ] [MAIN ] TEO: Generated 1820 derivative records from 22345 primary records. [2025-09-29T02:23:32.894164] [DEBUG] [LOCAL ] TEO: Saving derivative data. [2025-09-29T02:23:33.183214] [DEBUG] [LOCAL ] TEO: Derivative data saved (1820 records). [2025-09-29T02:23:33.183700] [INFO ] [MAIN ] TEO: Successfully saved derivative data. [2025-09-29T02:23:33.189089] [INFO ] [MAIN ] Derivative Progress: 1924/2211 symbols completed. TEO took 1.3s. Estimated remaining: 2m 2s. Rate: 141.4 symbols/min [2025-09-29T02:23:33.193299] [INFO ] [MAIN ] TFC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:33.225797] [DEBUG] [MAIN ] TEVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:33.227732] [INFO ] [MAIN ] TEVA: Generated 1820 derivative records from 54413 primary records. [2025-09-29T02:23:33.228077] [DEBUG] [LOCAL ] TEVA: Saving derivative data. [2025-09-29T02:23:33.251294] [DEBUG] [LOCAL ] TEVA: Derivative data saved (1820 records). [2025-09-29T02:23:33.252694] [INFO ] [MAIN ] TEVA: Successfully saved derivative data. [2025-09-29T02:23:33.257433] [INFO ] [MAIN ] Derivative Progress: 1925/2211 symbols completed. TEVA took 1.4s. Estimated remaining: 2m 1s. Rate: 141.5 symbols/min [2025-09-29T02:23:33.258226] [INFO ] [MAIN ] TFII: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:33.289701] [DEBUG] [MAIN ] TEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:33.290838] [INFO ] [MAIN ] TEX: Generated 1820 derivative records from 45170 primary records. [2025-09-29T02:23:33.291289] [DEBUG] [LOCAL ] TEX: Saving derivative data. [2025-09-29T02:23:33.311061] [DEBUG] [LOCAL ] TEX: Derivative data saved (1820 records). [2025-09-29T02:23:33.312357] [INFO ] [MAIN ] TEX: Successfully saved derivative data. [2025-09-29T02:23:33.333228] [INFO ] [MAIN ] Derivative Progress: 1926/2211 symbols completed. TEX took 1.3s. Estimated remaining: 2m 1s. Rate: 141.5 symbols/min [2025-09-29T02:23:33.333715] [INFO ] [MAIN ] TFIN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:33.335487] [DEBUG] [LOCAL ] TFC: Loaded 54447 existing records from primary storage. [2025-09-29T02:23:33.335988] [INFO ] [MAIN ] TFC: Loaded 54447 primary data records. [2025-09-29T02:23:33.527011] [DEBUG] [LOCAL ] TFII: Loaded 34733 existing records from primary storage. [2025-09-29T02:23:33.555869] [INFO ] [MAIN ] TFII: Loaded 34733 primary data records. [2025-09-29T02:23:33.543429] [DEBUG] [LOCAL ] TFIN: Loaded 23896 existing records from primary storage. [2025-09-29T02:23:33.767195] [INFO ] [MAIN ] TFIN: Loaded 23896 primary data records. [2025-09-29T02:23:34.623984] [DEBUG] [MAIN ] TFC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:34.624988] [INFO ] [MAIN ] TFC: Generated 1820 derivative records from 54447 primary records. [2025-09-29T02:23:34.625121] [DEBUG] [LOCAL ] TFC: Saving derivative data. [2025-09-29T02:23:34.647166] [DEBUG] [LOCAL ] TFC: Derivative data saved (1820 records). [2025-09-29T02:23:34.648294] [INFO ] [MAIN ] TFC: Successfully saved derivative data. [2025-09-29T02:23:34.651556] [INFO ] [MAIN ] Derivative Progress: 1927/2211 symbols completed. TFC took 1.5s. Estimated remaining: 2m 1s. Rate: 141.4 symbols/min [2025-09-29T02:23:34.654776] [INFO ] [MAIN ] TFPM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:34.692895] [DEBUG] [MAIN ] TFII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:34.693326] [DEBUG] [MAIN ] TFIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:34.695536] [INFO ] [MAIN ] TFIN: Generated 1820 derivative records from 23896 primary records. [2025-09-29T02:23:34.695687] [DEBUG] [LOCAL ] TFIN: Saving derivative data. [2025-09-29T02:23:34.694775] [INFO ] [MAIN ] TFII: Generated 1820 derivative records from 34733 primary records. [2025-09-29T02:23:34.696252] [DEBUG] [LOCAL ] TFII: Saving derivative data. [2025-09-29T02:23:34.732184] [DEBUG] [LOCAL ] TFIN: Derivative data saved (1820 records). [2025-09-29T02:23:34.742140] [INFO ] [MAIN ] TFIN: Successfully saved derivative data. [2025-09-29T02:23:34.747150] [INFO ] [MAIN ] Derivative Progress: 1928/2211 symbols completed. TFIN took 1.4s. Estimated remaining: 2m 0s. Rate: 141.5 symbols/min [2025-09-29T02:23:34.744055] [DEBUG] [LOCAL ] TFII: Derivative data saved (1820 records). [2025-09-29T02:23:34.747606] [INFO ] [MAIN ] TFX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:34.747975] [INFO ] [MAIN ] TFII: Successfully saved derivative data. [2025-09-29T02:23:34.751923] [INFO ] [MAIN ] Derivative Progress: 1929/2211 symbols completed. TFII took 1.5s. Estimated remaining: 1m 60s. Rate: 141.5 symbols/min [2025-09-29T02:23:34.752490] [INFO ] [MAIN ] TG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:34.770430] [DEBUG] [LOCAL ] TFPM: Loaded 37997 existing records from primary storage. [2025-09-29T02:23:34.770861] [INFO ] [MAIN ] TFPM: Loaded 37997 primary data records. [2025-09-29T02:23:34.894491] [DEBUG] [LOCAL ] TG: Loaded 10581 existing records from primary storage. [2025-09-29T02:23:34.935446] [INFO ] [MAIN ] TG: Loaded 10581 primary data records. [2025-09-29T02:23:35.114604] [DEBUG] [LOCAL ] TFX: Loaded 37936 existing records from primary storage. [2025-09-29T02:23:35.207740] [INFO ] [MAIN ] TFX: Loaded 37936 primary data records. [2025-09-29T02:23:36.144262] [DEBUG] [MAIN ] TFPM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:36.145483] [INFO ] [MAIN ] TFPM: Generated 1820 derivative records from 37997 primary records. [2025-09-29T02:23:36.147194] [DEBUG] [LOCAL ] TFPM: Saving derivative data. [2025-09-29T02:23:36.183849] [DEBUG] [MAIN ] TG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:36.185847] [INFO ] [MAIN ] TG: Generated 1820 derivative records from 10581 primary records. [2025-09-29T02:23:36.186512] [DEBUG] [LOCAL ] TG: Saving derivative data. [2025-09-29T02:23:36.189789] [DEBUG] [LOCAL ] TFPM: Derivative data saved (1820 records). [2025-09-29T02:23:36.189900] [INFO ] [MAIN ] TFPM: Successfully saved derivative data. [2025-09-29T02:23:36.208362] [DEBUG] [LOCAL ] TG: Derivative data saved (1820 records). [2025-09-29T02:23:36.207040] [INFO ] [MAIN ] Derivative Progress: 1930/2211 symbols completed. TFPM took 1.6s. Estimated remaining: 1m 59s. Rate: 141.3 symbols/min [2025-09-29T02:23:36.208804] [INFO ] [MAIN ] TGLS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:36.208668] [INFO ] [MAIN ] TG: Successfully saved derivative data. [2025-09-29T02:23:36.211587] [INFO ] [MAIN ] Derivative Progress: 1931/2211 symbols completed. TG took 1.5s. Estimated remaining: 1m 59s. Rate: 141.4 symbols/min [2025-09-29T02:23:36.212765] [INFO ] [MAIN ] TGNA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:36.234858] [DEBUG] [MAIN ] TFX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:36.235588] [INFO ] [MAIN ] TFX: Generated 1820 derivative records from 37936 primary records. [2025-09-29T02:23:36.235700] [DEBUG] [LOCAL ] TFX: Saving derivative data. [2025-09-29T02:23:36.252934] [DEBUG] [LOCAL ] TFX: Derivative data saved (1820 records). [2025-09-29T02:23:36.253518] [INFO ] [MAIN ] TFX: Successfully saved derivative data. [2025-09-29T02:23:36.256803] [INFO ] [MAIN ] Derivative Progress: 1932/2211 symbols completed. TFX took 1.5s. Estimated remaining: 1m 58s. Rate: 141.5 symbols/min [2025-09-29T02:23:36.257236] [INFO ] [MAIN ] TGS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:36.281368] [DEBUG] [LOCAL ] TGLS: Loaded 28709 existing records from primary storage. [2025-09-29T02:23:36.281748] [INFO ] [MAIN ] TGLS: Loaded 28709 primary data records. [2025-09-29T02:23:36.518631] [DEBUG] [LOCAL ] TGNA: Loaded 49444 existing records from primary storage. [2025-09-29T02:23:36.530063] [DEBUG] [LOCAL ] TGS: Loaded 33072 existing records from primary storage. [2025-09-29T02:23:36.666260] [INFO ] [MAIN ] TGNA: Loaded 49444 primary data records. [2025-09-29T02:23:36.666097] [INFO ] [MAIN ] TGS: Loaded 33072 primary data records. [2025-09-29T02:23:37.443294] [DEBUG] [MAIN ] TGLS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:37.444774] [INFO ] [MAIN ] TGLS: Generated 1820 derivative records from 28709 primary records. [2025-09-29T02:23:37.445117] [DEBUG] [LOCAL ] TGLS: Saving derivative data. [2025-09-29T02:23:37.464579] [DEBUG] [LOCAL ] TGLS: Derivative data saved (1820 records). [2025-09-29T02:23:37.465311] [INFO ] [MAIN ] TGLS: Successfully saved derivative data. [2025-09-29T02:23:37.467761] [INFO ] [MAIN ] Derivative Progress: 1933/2211 symbols completed. TGLS took 1.3s. Estimated remaining: 1m 58s. Rate: 141.3 symbols/min [2025-09-29T02:23:37.491175] [DEBUG] [MAIN ] TGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:37.494869] [INFO ] [MAIN ] TGS: Generated 1820 derivative records from 33072 primary records. [2025-09-29T02:23:37.495455] [DEBUG] [LOCAL ] TGS: Saving derivative data. [2025-09-29T02:23:37.518521] [DEBUG] [MAIN ] TGNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:37.523512] [INFO ] [MAIN ] TGNA: Generated 1820 derivative records from 49444 primary records. [2025-09-29T02:23:37.528304] [DEBUG] [LOCAL ] TGNA: Saving derivative data. [2025-09-29T02:23:37.528437] [DEBUG] [LOCAL ] TGS: Derivative data saved (1820 records). [2025-09-29T02:23:37.529508] [INFO ] [MAIN ] TGS: Successfully saved derivative data. [2025-09-29T02:23:37.543016] [INFO ] [MAIN ] Derivative Progress: 1934/2211 symbols completed. TGS took 1.3s. Estimated remaining: 1m 58s. Rate: 141.4 symbols/min [2025-09-29T02:23:37.551922] [DEBUG] [LOCAL ] TGNA: Derivative data saved (1820 records). [2025-09-29T02:23:37.552121] [INFO ] [MAIN ] TGNA: Successfully saved derivative data. [2025-09-29T02:23:37.556430] [INFO ] [MAIN ] Derivative Progress: 1935/2211 symbols completed. TGNA took 1.3s. Estimated remaining: 1m 57s. Rate: 141.5 symbols/min [2025-09-29T02:23:37.557211] [INFO ] [MAIN ] TGT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:37.557379] [INFO ] [MAIN ] THG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:37.557571] [INFO ] [MAIN ] THC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:37.594278] [DEBUG] [LOCAL ] THG: Loaded 22081 existing records from primary storage. [2025-09-29T02:23:37.595540] [INFO ] [MAIN ] THG: Loaded 22081 primary data records. [2025-09-29T02:23:37.787494] [DEBUG] [LOCAL ] THC: Loaded 48617 existing records from primary storage. [2025-09-29T02:23:37.853925] [INFO ] [MAIN ] THC: Loaded 48617 primary data records. [2025-09-29T02:23:38.086408] [DEBUG] [LOCAL ] TGT: Loaded 54558 existing records from primary storage. [2025-09-29T02:23:38.118156] [INFO ] [MAIN ] TGT: Loaded 54558 primary data records. [2025-09-29T02:23:38.688048] [DEBUG] [MAIN ] THG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:38.689736] [INFO ] [MAIN ] THG: Generated 1820 derivative records from 22081 primary records. [2025-09-29T02:23:38.689986] [DEBUG] [LOCAL ] THG: Saving derivative data. [2025-09-29T02:23:38.711048] [DEBUG] [LOCAL ] THG: Derivative data saved (1820 records). [2025-09-29T02:23:38.711446] [INFO ] [MAIN ] THG: Successfully saved derivative data. [2025-09-29T02:23:38.716258] [INFO ] [MAIN ] Derivative Progress: 1936/2211 symbols completed. THG took 1.2s. Estimated remaining: 1m 57s. Rate: 141.4 symbols/min [2025-09-29T02:23:38.717976] [INFO ] [MAIN ] THIR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:38.736103] [DEBUG] [MAIN ] THC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:38.737333] [INFO ] [MAIN ] THC: Generated 1820 derivative records from 48617 primary records. [2025-09-29T02:23:38.737475] [DEBUG] [LOCAL ] THC: Saving derivative data. [2025-09-29T02:23:38.740425] [DEBUG] [LOCAL ] THIR: Loaded 2238 existing records from primary storage. [2025-09-29T02:23:38.742135] [INFO ] [MAIN ] THIR: Loaded 2238 primary data records. [2025-09-29T02:23:38.819985] [DEBUG] [LOCAL ] THC: Derivative data saved (1820 records). [2025-09-29T02:23:38.824904] [INFO ] [MAIN ] THC: Successfully saved derivative data. [2025-09-29T02:23:38.860613] [DEBUG] [MAIN ] TGT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:38.860041] [INFO ] [MAIN ] Derivative Progress: 1937/2211 symbols completed. THC took 1.3s. Estimated remaining: 1m 56s. Rate: 141.4 symbols/min [2025-09-29T02:23:38.861617] [INFO ] [MAIN ] TGT: Generated 1820 derivative records from 54558 primary records. [2025-09-29T02:23:38.861786] [INFO ] [MAIN ] THLV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:38.872239] [DEBUG] [LOCAL ] TGT: Saving derivative data. [2025-09-29T02:23:38.983022] [DEBUG] [LOCAL ] THLV: Loaded 1614 existing records from primary storage. [2025-09-29T02:23:39.144514] [DEBUG] [LOCAL ] TGT: Derivative data saved (1820 records). [2025-09-29T02:23:39.155351] [INFO ] [MAIN ] TGT: Successfully saved derivative data. [2025-09-29T02:23:39.155098] [INFO ] [MAIN ] THLV: Loaded 1614 primary data records. [2025-09-29T02:23:39.172315] [INFO ] [MAIN ] Derivative Progress: 1938/2211 symbols completed. TGT took 1.6s. Estimated remaining: 1m 56s. Rate: 141.4 symbols/min [2025-09-29T02:23:39.205090] [INFO ] [MAIN ] THO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:39.574281] [DEBUG] [MAIN ] THIR: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:23:39.586472] [INFO ] [MAIN ] THIR: Generated 1819 derivative records from 2238 primary records. [2025-09-29T02:23:39.587200] [DEBUG] [LOCAL ] THIR: Saving derivative data. [2025-09-29T02:23:39.605339] [DEBUG] [LOCAL ] THIR: Derivative data saved (1819 records). [2025-09-29T02:23:39.605766] [INFO ] [MAIN ] THIR: Successfully saved derivative data. [2025-09-29T02:23:39.620321] [INFO ] [MAIN ] Derivative Progress: 1939/2211 symbols completed. THIR took 0.9s. Estimated remaining: 1m 55s. Rate: 141.4 symbols/min [2025-09-29T02:23:39.622078] [DEBUG] [LOCAL ] THO: Loaded 42957 existing records from primary storage. [2025-09-29T02:23:39.622621] [INFO ] [MAIN ] THO: Loaded 42957 primary data records. [2025-09-29T02:23:39.620574] [INFO ] [MAIN ] THQ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:39.989903] [DEBUG] [MAIN ] THLV: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-09-29T02:23:39.991461] [DEBUG] [LOCAL ] THQ: Loaded 24879 existing records from primary storage. [2025-09-29T02:23:39.993251] [INFO ] [MAIN ] THQ: Loaded 24879 primary data records. [2025-09-29T02:23:39.993131] [INFO ] [MAIN ] THLV: Generated 1818 derivative records from 1614 primary records. [2025-09-29T02:23:39.999621] [DEBUG] [LOCAL ] THLV: Saving derivative data. [2025-09-29T02:23:40.104797] [DEBUG] [LOCAL ] THLV: Derivative data saved (1818 records). [2025-09-29T02:23:40.130980] [INFO ] [MAIN ] THLV: Successfully saved derivative data. [2025-09-29T02:23:40.135984] [INFO ] [MAIN ] Derivative Progress: 1940/2211 symbols completed. THLV took 1.3s. Estimated remaining: 1m 55s. Rate: 141.4 symbols/min [2025-09-29T02:23:40.141537] [INFO ] [MAIN ] THR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:40.369032] [DEBUG] [LOCAL ] THR: Loaded 20218 existing records from primary storage. [2025-09-29T02:23:40.369633] [INFO ] [MAIN ] THR: Loaded 20218 primary data records. [2025-09-29T02:23:40.448866] [DEBUG] [MAIN ] THO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:40.477681] [INFO ] [MAIN ] THO: Generated 1820 derivative records from 42957 primary records. [2025-09-29T02:23:40.490715] [DEBUG] [LOCAL ] THO: Saving derivative data. [2025-09-29T02:23:40.541987] [DEBUG] [LOCAL ] THO: Derivative data saved (1820 records). [2025-09-29T02:23:40.584325] [INFO ] [MAIN ] THO: Successfully saved derivative data. [2025-09-29T02:23:40.605321] [INFO ] [MAIN ] Derivative Progress: 1941/2211 symbols completed. THO took 1.4s. Estimated remaining: 1m 55s. Rate: 141.4 symbols/min [2025-09-29T02:23:40.739334] [INFO ] [MAIN ] THS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:40.761387] [DEBUG] [MAIN ] THQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:40.764144] [INFO ] [MAIN ] THQ: Generated 1820 derivative records from 24879 primary records. [2025-09-29T02:23:40.764595] [DEBUG] [LOCAL ] THQ: Saving derivative data. [2025-09-29T02:23:40.784816] [DEBUG] [LOCAL ] THQ: Derivative data saved (1820 records). [2025-09-29T02:23:40.785726] [INFO ] [MAIN ] THQ: Successfully saved derivative data. [2025-09-29T02:23:40.789113] [INFO ] [MAIN ] Derivative Progress: 1942/2211 symbols completed. THQ took 1.2s. Estimated remaining: 1m 54s. Rate: 141.4 symbols/min [2025-09-29T02:23:40.789530] [INFO ] [MAIN ] THW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:40.819859] [DEBUG] [MAIN ] THR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:40.834495] [INFO ] [MAIN ] THR: Generated 1820 derivative records from 20218 primary records. [2025-09-29T02:23:40.834764] [DEBUG] [LOCAL ] THR: Saving derivative data. [2025-09-29T02:23:40.836200] [DEBUG] [LOCAL ] THS: Loaded 38565 existing records from primary storage. [2025-09-29T02:23:40.842174] [INFO ] [MAIN ] THS: Loaded 38565 primary data records. [2025-09-29T02:23:40.943451] [DEBUG] [LOCAL ] THR: Derivative data saved (1820 records). [2025-09-29T02:23:40.949785] [DEBUG] [LOCAL ] THW: Loaded 19392 existing records from primary storage. [2025-09-29T02:23:40.968934] [INFO ] [MAIN ] THW: Loaded 19392 primary data records. [2025-09-29T02:23:40.958326] [INFO ] [MAIN ] THR: Successfully saved derivative data. [2025-09-29T02:23:41.028340] [INFO ] [MAIN ] Derivative Progress: 1943/2211 symbols completed. THR took 0.9s. Estimated remaining: 1m 54s. Rate: 141.5 symbols/min [2025-09-29T02:23:41.084887] [INFO ] [MAIN ] TIMB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:41.629416] [DEBUG] [LOCAL ] TIMB: Loaded 36983 existing records from primary storage. [2025-09-29T02:23:41.629883] [INFO ] [MAIN ] TIMB: Loaded 36983 primary data records. [2025-09-29T02:23:41.770976] [DEBUG] [MAIN ] THS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:41.783822] [INFO ] [MAIN ] THS: Generated 1820 derivative records from 38565 primary records. [2025-09-29T02:23:41.795107] [DEBUG] [LOCAL ] THS: Saving derivative data. [2025-09-29T02:23:42.042111] [DEBUG] [LOCAL ] THS: Derivative data saved (1820 records). [2025-09-29T02:23:42.042823] [INFO ] [MAIN ] THS: Successfully saved derivative data. [2025-09-29T02:23:42.046775] [INFO ] [MAIN ] Derivative Progress: 1944/2211 symbols completed. THS took 1.3s. Estimated remaining: 1m 53s. Rate: 141.4 symbols/min [2025-09-29T02:23:42.047279] [INFO ] [MAIN ] TISI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:42.040542] [DEBUG] [MAIN ] THW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:42.048373] [INFO ] [MAIN ] THW: Generated 1820 derivative records from 19392 primary records. [2025-09-29T02:23:42.050825] [DEBUG] [LOCAL ] THW: Saving derivative data. [2025-09-29T02:23:42.070008] [DEBUG] [LOCAL ] TISI: Loaded 3805 existing records from primary storage. [2025-09-29T02:23:42.072360] [DEBUG] [LOCAL ] THW: Derivative data saved (1820 records). [2025-09-29T02:23:42.072454] [INFO ] [MAIN ] TISI: Loaded 3805 primary data records. [2025-09-29T02:23:42.072583] [INFO ] [MAIN ] THW: Successfully saved derivative data. [2025-09-29T02:23:42.078297] [INFO ] [MAIN ] Derivative Progress: 1945/2211 symbols completed. THW took 1.3s. Estimated remaining: 1m 53s. Rate: 141.4 symbols/min [2025-09-29T02:23:42.101970] [INFO ] [MAIN ] TIXT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:42.433983] [DEBUG] [MAIN ] TIMB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:42.445336] [INFO ] [MAIN ] TIMB: Generated 1820 derivative records from 36983 primary records. [2025-09-29T02:23:42.446017] [DEBUG] [LOCAL ] TIMB: Saving derivative data. [2025-09-29T02:23:42.447828] [DEBUG] [LOCAL ] TIXT: Loaded 31824 existing records from primary storage. [2025-09-29T02:23:42.451306] [INFO ] [MAIN ] TIXT: Loaded 31824 primary data records. [2025-09-29T02:23:42.568341] [DEBUG] [LOCAL ] TIMB: Derivative data saved (1820 records). [2025-09-29T02:23:42.586682] [INFO ] [MAIN ] TIMB: Successfully saved derivative data. [2025-09-29T02:23:42.612817] [INFO ] [MAIN ] Derivative Progress: 1946/2211 symbols completed. TIMB took 1.5s. Estimated remaining: 1m 52s. Rate: 141.4 symbols/min [2025-09-29T02:23:42.676975] [INFO ] [MAIN ] TJX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:42.825458] [DEBUG] [MAIN ] TISI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:42.827364] [INFO ] [MAIN ] TISI: Generated 1820 derivative records from 3805 primary records. [2025-09-29T02:23:42.827709] [DEBUG] [LOCAL ] TISI: Saving derivative data. [2025-09-29T02:23:42.847899] [DEBUG] [LOCAL ] TISI: Derivative data saved (1820 records). [2025-09-29T02:23:42.848278] [INFO ] [MAIN ] TISI: Successfully saved derivative data. [2025-09-29T02:23:42.851063] [INFO ] [MAIN ] Derivative Progress: 1947/2211 symbols completed. TISI took 0.8s. Estimated remaining: 1m 52s. Rate: 141.4 symbols/min [2025-09-29T02:23:42.851312] [INFO ] [MAIN ] TK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:42.870135] [DEBUG] [MAIN ] TIXT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:42.870923] [INFO ] [MAIN ] TIXT: Generated 1820 derivative records from 31824 primary records. [2025-09-29T02:23:42.871042] [DEBUG] [LOCAL ] TIXT: Saving derivative data. [2025-09-29T02:23:42.903127] [DEBUG] [LOCAL ] TIXT: Derivative data saved (1820 records). [2025-09-29T02:23:42.903403] [INFO ] [MAIN ] TIXT: Successfully saved derivative data. [2025-09-29T02:23:42.906282] [INFO ] [MAIN ] Derivative Progress: 1948/2211 symbols completed. TIXT took 0.8s. Estimated remaining: 1m 52s. Rate: 141.5 symbols/min [2025-09-29T02:23:42.938517] [DEBUG] [LOCAL ] TJX: Loaded 54449 existing records from primary storage. [2025-09-29T02:23:42.938821] [INFO ] [MAIN ] TJX: Loaded 54449 primary data records. [2025-09-29T02:23:43.065201] [DEBUG] [LOCAL ] TK: Loaded 40151 existing records from primary storage. [2025-09-29T02:23:43.071134] [INFO ] [MAIN ] TK: Loaded 40151 primary data records. [2025-09-29T02:23:43.685858] [DEBUG] [MAIN ] TJX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:43.686872] [INFO ] [MAIN ] TJX: Generated 1820 derivative records from 54449 primary records. [2025-09-29T02:23:43.687076] [DEBUG] [LOCAL ] TJX: Saving derivative data. [2025-09-29T02:23:43.705261] [DEBUG] [LOCAL ] TJX: Derivative data saved (1820 records). [2025-09-29T02:23:43.705541] [INFO ] [MAIN ] TJX: Successfully saved derivative data. [2025-09-29T02:23:43.708277] [INFO ] [MAIN ] Derivative Progress: 1949/2211 symbols completed. TJX took 1.0s. Estimated remaining: 1m 51s. Rate: 141.4 symbols/min [2025-09-29T02:23:43.726515] [DEBUG] [MAIN ] TK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:43.727491] [INFO ] [MAIN ] TK: Generated 1820 derivative records from 40151 primary records. [2025-09-29T02:23:43.727611] [DEBUG] [LOCAL ] TK: Saving derivative data. [2025-09-29T02:23:43.743447] [DEBUG] [LOCAL ] TK: Derivative data saved (1820 records). [2025-09-29T02:23:43.743541] [INFO ] [MAIN ] TK: Successfully saved derivative data. [2025-09-29T02:23:43.746682] [INFO ] [MAIN ] Derivative Progress: 1950/2211 symbols completed. TK took 0.9s. Estimated remaining: 1m 51s. Rate: 141.5 symbols/min [2025-09-29T02:23:43.747208] [INFO ] [MAIN ] TKC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:43.747336] [INFO ] [MAIN ] TKR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:43.747999] [INFO ] [MAIN ] TKO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:43.802152] [DEBUG] [LOCAL ] TKC: Loaded 39062 existing records from primary storage. [2025-09-29T02:23:43.802532] [INFO ] [MAIN ] TKC: Loaded 39062 primary data records. [2025-09-29T02:23:43.950626] [DEBUG] [LOCAL ] TKR: Loaded 40832 existing records from primary storage. [2025-09-29T02:23:43.980315] [DEBUG] [LOCAL ] TKO: Loaded 44814 existing records from primary storage. [2025-09-29T02:23:44.038372] [INFO ] [MAIN ] TKR: Loaded 40832 primary data records. [2025-09-29T02:23:44.159256] [INFO ] [MAIN ] TKO: Loaded 44814 primary data records. [2025-09-29T02:23:44.875733] [DEBUG] [MAIN ] TKC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:44.877291] [INFO ] [MAIN ] TKC: Generated 1820 derivative records from 39062 primary records. [2025-09-29T02:23:44.878135] [DEBUG] [LOCAL ] TKC: Saving derivative data. [2025-09-29T02:23:44.895614] [DEBUG] [LOCAL ] TKC: Derivative data saved (1820 records). [2025-09-29T02:23:44.897010] [INFO ] [MAIN ] TKC: Successfully saved derivative data. [2025-09-29T02:23:44.901004] [INFO ] [MAIN ] Derivative Progress: 1951/2211 symbols completed. TKC took 1.2s. Estimated remaining: 1m 50s. Rate: 141.4 symbols/min [2025-09-29T02:23:44.902966] [INFO ] [MAIN ] TLK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:44.931319] [DEBUG] [MAIN ] TKO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:44.932177] [INFO ] [MAIN ] TKO: Generated 1820 derivative records from 44814 primary records. [2025-09-29T02:23:44.932356] [DEBUG] [LOCAL ] TKO: Saving derivative data. [2025-09-29T02:23:44.930966] [DEBUG] [MAIN ] TKR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:44.933069] [INFO ] [MAIN ] TKR: Generated 1820 derivative records from 40832 primary records. [2025-09-29T02:23:44.933267] [DEBUG] [LOCAL ] TKR: Saving derivative data. [2025-09-29T02:23:44.964813] [DEBUG] [LOCAL ] TKO: Derivative data saved (1820 records). [2025-09-29T02:23:44.969078] [DEBUG] [LOCAL ] TKR: Derivative data saved (1820 records). [2025-09-29T02:23:44.965845] [INFO ] [MAIN ] TKO: Successfully saved derivative data. [2025-09-29T02:23:44.972106] [INFO ] [MAIN ] TKR: Successfully saved derivative data. [2025-09-29T02:23:44.972005] [INFO ] [MAIN ] Derivative Progress: 1952/2211 symbols completed. TKO took 1.2s. Estimated remaining: 1m 50s. Rate: 141.4 symbols/min [2025-09-29T02:23:44.975351] [INFO ] [MAIN ] TLYS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:44.975520] [INFO ] [MAIN ] Derivative Progress: 1953/2211 symbols completed. TKR took 1.2s. Estimated remaining: 1m 49s. Rate: 141.5 symbols/min [2025-09-29T02:23:44.975924] [INFO ] [MAIN ] TM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:45.012515] [DEBUG] [LOCAL ] TLK: Loaded 39925 existing records from primary storage. [2025-09-29T02:23:45.013036] [INFO ] [MAIN ] TLK: Loaded 39925 primary data records. [2025-09-29T02:23:45.064863] [DEBUG] [LOCAL ] TLYS: Loaded 17064 existing records from primary storage. [2025-09-29T02:23:45.091621] [INFO ] [MAIN ] TLYS: Loaded 17064 primary data records. [2025-09-29T02:23:45.292249] [DEBUG] [LOCAL ] TM: Loaded 36992 existing records from primary storage. [2025-09-29T02:23:45.331721] [INFO ] [MAIN ] TM: Loaded 36992 primary data records. [2025-09-29T02:23:46.140012] [DEBUG] [MAIN ] TLK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:46.143075] [INFO ] [MAIN ] TLK: Generated 1820 derivative records from 39925 primary records. [2025-09-29T02:23:46.144121] [DEBUG] [LOCAL ] TLK: Saving derivative data. [2025-09-29T02:23:46.167758] [DEBUG] [MAIN ] TLYS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:46.176566] [INFO ] [MAIN ] TLYS: Generated 1820 derivative records from 17064 primary records. [2025-09-29T02:23:46.178224] [DEBUG] [LOCAL ] TLK: Derivative data saved (1820 records). [2025-09-29T02:23:46.178496] [INFO ] [MAIN ] TLK: Successfully saved derivative data. [2025-09-29T02:23:46.178708] [DEBUG] [LOCAL ] TLYS: Saving derivative data. [2025-09-29T02:23:46.181347] [INFO ] [MAIN ] Derivative Progress: 1954/2211 symbols completed. TLK took 1.3s. Estimated remaining: 1m 49s. Rate: 141.4 symbols/min [2025-09-29T02:23:46.182808] [INFO ] [MAIN ] TME: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:46.201086] [DEBUG] [LOCAL ] TLYS: Derivative data saved (1820 records). [2025-09-29T02:23:46.202958] [INFO ] [MAIN ] TLYS: Successfully saved derivative data. [2025-09-29T02:23:46.206149] [INFO ] [MAIN ] Derivative Progress: 1955/2211 symbols completed. TLYS took 1.2s. Estimated remaining: 1m 49s. Rate: 141.5 symbols/min [2025-09-29T02:23:46.206577] [INFO ] [MAIN ] TMHC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:46.221263] [DEBUG] [MAIN ] TM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:46.222464] [INFO ] [MAIN ] TM: Generated 1820 derivative records from 36992 primary records. [2025-09-29T02:23:46.222729] [DEBUG] [LOCAL ] TM: Saving derivative data. [2025-09-29T02:23:46.245928] [DEBUG] [LOCAL ] TM: Derivative data saved (1820 records). [2025-09-29T02:23:46.246125] [INFO ] [MAIN ] TM: Successfully saved derivative data. [2025-09-29T02:23:46.249861] [INFO ] [MAIN ] Derivative Progress: 1956/2211 symbols completed. TM took 1.3s. Estimated remaining: 1m 48s. Rate: 141.5 symbols/min [2025-09-29T02:23:46.250261] [INFO ] [MAIN ] TMO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:46.296515] [DEBUG] [LOCAL ] TME: Loaded 53979 existing records from primary storage. [2025-09-29T02:23:46.296867] [INFO ] [MAIN ] TME: Loaded 53979 primary data records. [2025-09-29T02:23:46.513314] [DEBUG] [LOCAL ] TMHC: Loaded 46274 existing records from primary storage. [2025-09-29T02:23:46.691120] [INFO ] [MAIN ] TMHC: Loaded 46274 primary data records. [2025-09-29T02:23:46.759799] [DEBUG] [LOCAL ] TMO: Loaded 53089 existing records from primary storage. [2025-09-29T02:23:46.799152] [INFO ] [MAIN ] TMO: Loaded 53089 primary data records. [2025-09-29T02:23:47.437712] [DEBUG] [MAIN ] TME: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:47.438896] [INFO ] [MAIN ] TME: Generated 1820 derivative records from 53979 primary records. [2025-09-29T02:23:47.440746] [DEBUG] [LOCAL ] TME: Saving derivative data. [2025-09-29T02:23:47.460966] [DEBUG] [LOCAL ] TME: Derivative data saved (1820 records). [2025-09-29T02:23:47.461603] [INFO ] [MAIN ] TME: Successfully saved derivative data. [2025-09-29T02:23:47.466992] [INFO ] [MAIN ] Derivative Progress: 1957/2211 symbols completed. TME took 1.3s. Estimated remaining: 1m 48s. Rate: 141.4 symbols/min [2025-09-29T02:23:47.467700] [INFO ] [MAIN ] TNC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:47.496318] [DEBUG] [MAIN ] TMHC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:47.497410] [INFO ] [MAIN ] TMHC: Generated 1820 derivative records from 46274 primary records. [2025-09-29T02:23:47.497531] [DEBUG] [LOCAL ] TMHC: Saving derivative data. [2025-09-29T02:23:47.523528] [DEBUG] [LOCAL ] TNC: Loaded 15334 existing records from primary storage. [2025-09-29T02:23:47.539193] [INFO ] [MAIN ] TNC: Loaded 15334 primary data records. [2025-09-29T02:23:47.546747] [DEBUG] [MAIN ] TMO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:47.540499] [DEBUG] [LOCAL ] TMHC: Derivative data saved (1820 records). [2025-09-29T02:23:47.565556] [INFO ] [MAIN ] TMO: Generated 1820 derivative records from 53089 primary records. [2025-09-29T02:23:47.578755] [INFO ] [MAIN ] TMHC: Successfully saved derivative data. [2025-09-29T02:23:47.607092] [DEBUG] [LOCAL ] TMO: Saving derivative data. [2025-09-29T02:23:47.619941] [INFO ] [MAIN ] Derivative Progress: 1958/2211 symbols completed. TMHC took 1.4s. Estimated remaining: 1m 47s. Rate: 141.4 symbols/min [2025-09-29T02:23:47.661675] [INFO ] [MAIN ] TNET: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:47.726124] [DEBUG] [LOCAL ] TMO: Derivative data saved (1820 records). [2025-09-29T02:23:47.769975] [INFO ] [MAIN ] TMO: Successfully saved derivative data. [2025-09-29T02:23:47.890539] [INFO ] [MAIN ] Derivative Progress: 1959/2211 symbols completed. TMO took 1.6s. Estimated remaining: 1m 47s. Rate: 141.5 symbols/min [2025-09-29T02:23:47.901602] [INFO ] [MAIN ] TNK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:47.952468] [DEBUG] [LOCAL ] TNET: Loaded 29247 existing records from primary storage. [2025-09-29T02:23:47.966328] [INFO ] [MAIN ] TNET: Loaded 29247 primary data records. [2025-09-29T02:23:47.966911] [DEBUG] [MAIN ] TNC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:47.984207] [INFO ] [MAIN ] TNC: Generated 1820 derivative records from 15334 primary records. [2025-09-29T02:23:47.997544] [DEBUG] [LOCAL ] TNC: Saving derivative data. [2025-09-29T02:23:48.089942] [DEBUG] [LOCAL ] TNK: Loaded 35701 existing records from primary storage. [2025-09-29T02:23:48.112704] [DEBUG] [LOCAL ] TNC: Derivative data saved (1820 records). [2025-09-29T02:23:48.113250] [INFO ] [MAIN ] TNC: Successfully saved derivative data. [2025-09-29T02:23:48.113128] [INFO ] [MAIN ] TNK: Loaded 35701 primary data records. [2025-09-29T02:23:48.120775] [INFO ] [MAIN ] Derivative Progress: 1960/2211 symbols completed. TNC took 0.7s. Estimated remaining: 1m 46s. Rate: 141.5 symbols/min [2025-09-29T02:23:48.133407] [INFO ] [MAIN ] TNL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:48.760330] [DEBUG] [LOCAL ] TNL: Loaded 42474 existing records from primary storage. [2025-09-29T02:23:48.761725] [INFO ] [MAIN ] TNL: Loaded 42474 primary data records. [2025-09-29T02:23:48.898453] [DEBUG] [MAIN ] TNET: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:48.899404] [INFO ] [MAIN ] TNET: Generated 1820 derivative records from 29247 primary records. [2025-09-29T02:23:48.899776] [DEBUG] [LOCAL ] TNET: Saving derivative data. [2025-09-29T02:23:49.131959] [DEBUG] [LOCAL ] TNET: Derivative data saved (1820 records). [2025-09-29T02:23:49.132587] [INFO ] [MAIN ] TNET: Successfully saved derivative data. [2025-09-29T02:23:49.150312] [INFO ] [MAIN ] Derivative Progress: 1961/2211 symbols completed. TNET took 1.5s. Estimated remaining: 1m 46s. Rate: 141.4 symbols/min [2025-09-29T02:23:49.151260] [INFO ] [MAIN ] TOL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:49.151092] [DEBUG] [MAIN ] TNK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:49.152346] [INFO ] [MAIN ] TNK: Generated 1820 derivative records from 35701 primary records. [2025-09-29T02:23:49.153046] [DEBUG] [LOCAL ] TNK: Saving derivative data. [2025-09-29T02:23:49.174069] [DEBUG] [LOCAL ] TNK: Derivative data saved (1820 records). [2025-09-29T02:23:49.174308] [INFO ] [MAIN ] TNK: Successfully saved derivative data. [2025-09-29T02:23:49.177549] [INFO ] [MAIN ] Derivative Progress: 1962/2211 symbols completed. TNK took 1.3s. Estimated remaining: 1m 46s. Rate: 141.5 symbols/min [2025-09-29T02:23:49.178026] [INFO ] [MAIN ] TOST: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:49.203833] [DEBUG] [MAIN ] TNL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:49.204851] [INFO ] [MAIN ] TNL: Generated 1820 derivative records from 42474 primary records. [2025-09-29T02:23:49.204942] [DEBUG] [LOCAL ] TNL: Saving derivative data. [2025-09-29T02:23:49.236884] [DEBUG] [LOCAL ] TNL: Derivative data saved (1820 records). [2025-09-29T02:23:49.237058] [INFO ] [MAIN ] TNL: Successfully saved derivative data. [2025-09-29T02:23:49.241126] [INFO ] [MAIN ] Derivative Progress: 1963/2211 symbols completed. TNL took 1.1s. Estimated remaining: 1m 45s. Rate: 141.5 symbols/min [2025-09-29T02:23:49.278971] [DEBUG] [LOCAL ] TOL: Loaded 51738 existing records from primary storage. [2025-09-29T02:23:49.295392] [INFO ] [MAIN ] TOL: Loaded 51738 primary data records. [2025-09-29T02:23:49.337028] [DEBUG] [LOCAL ] TOST: Loaded 54461 existing records from primary storage. [2025-09-29T02:23:49.377738] [INFO ] [MAIN ] TOST: Loaded 54461 primary data records. [2025-09-29T02:23:49.998117] [DEBUG] [MAIN ] TOL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:50.001358] [INFO ] [MAIN ] TOL: Generated 1820 derivative records from 51738 primary records. [2025-09-29T02:23:50.001735] [DEBUG] [LOCAL ] TOL: Saving derivative data. [2025-09-29T02:23:50.025195] [DEBUG] [MAIN ] TOST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:50.031425] [INFO ] [MAIN ] TOST: Generated 1820 derivative records from 54461 primary records. [2025-09-29T02:23:50.032713] [DEBUG] [LOCAL ] TOST: Saving derivative data. [2025-09-29T02:23:50.033671] [DEBUG] [LOCAL ] TOL: Derivative data saved (1820 records). [2025-09-29T02:23:50.034242] [INFO ] [MAIN ] TOL: Successfully saved derivative data. [2025-09-29T02:23:50.036843] [INFO ] [MAIN ] Derivative Progress: 1964/2211 symbols completed. TOL took 0.9s. Estimated remaining: 1m 45s. Rate: 141.4 symbols/min [2025-09-29T02:23:50.053101] [DEBUG] [LOCAL ] TOST: Derivative data saved (1820 records). [2025-09-29T02:23:50.053204] [INFO ] [MAIN ] TOST: Successfully saved derivative data. [2025-09-29T02:23:50.056486] [INFO ] [MAIN ] Derivative Progress: 1965/2211 symbols completed. TOST took 0.9s. Estimated remaining: 1m 44s. Rate: 141.5 symbols/min [2025-09-29T02:23:50.057158] [INFO ] [MAIN ] TPH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:50.057219] [INFO ] [MAIN ] TPC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:50.057066] [INFO ] [MAIN ] TPB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:50.091666] [DEBUG] [LOCAL ] TPB: Loaded 25409 existing records from primary storage. [2025-09-29T02:23:50.102047] [INFO ] [MAIN ] TPB: Loaded 25409 primary data records. [2025-09-29T02:23:50.242080] [DEBUG] [LOCAL ] TPC: Loaded 39311 existing records from primary storage. [2025-09-29T02:23:50.258917] [DEBUG] [LOCAL ] TPH: Loaded 45821 existing records from primary storage. [2025-09-29T02:23:50.263748] [INFO ] [MAIN ] TPC: Loaded 39311 primary data records. [2025-09-29T02:23:50.263609] [INFO ] [MAIN ] TPH: Loaded 45821 primary data records. [2025-09-29T02:23:51.267285] [DEBUG] [MAIN ] TPB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:51.270157] [INFO ] [MAIN ] TPB: Generated 1820 derivative records from 25409 primary records. [2025-09-29T02:23:51.270995] [DEBUG] [LOCAL ] TPB: Saving derivative data. [2025-09-29T02:23:51.291973] [DEBUG] [LOCAL ] TPB: Derivative data saved (1820 records). [2025-09-29T02:23:51.293055] [INFO ] [MAIN ] TPB: Successfully saved derivative data. [2025-09-29T02:23:51.309177] [DEBUG] [MAIN ] TPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:51.308246] [INFO ] [MAIN ] Derivative Progress: 1966/2211 symbols completed. TPB took 1.3s. Estimated remaining: 1m 44s. Rate: 141.4 symbols/min [2025-09-29T02:23:51.309595] [INFO ] [MAIN ] TPL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:51.310432] [INFO ] [MAIN ] TPC: Generated 1820 derivative records from 39311 primary records. [2025-09-29T02:23:51.311081] [DEBUG] [LOCAL ] TPC: Saving derivative data. [2025-09-29T02:23:51.330059] [DEBUG] [LOCAL ] TPC: Derivative data saved (1820 records). [2025-09-29T02:23:51.330598] [INFO ] [MAIN ] TPC: Successfully saved derivative data. [2025-09-29T02:23:51.334733] [INFO ] [MAIN ] Derivative Progress: 1967/2211 symbols completed. TPC took 1.3s. Estimated remaining: 1m 44s. Rate: 141.4 symbols/min [2025-09-29T02:23:51.335233] [INFO ] [MAIN ] TPR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:51.357461] [DEBUG] [LOCAL ] TPL: Loaded 12533 existing records from primary storage. [2025-09-29T02:23:51.363404] [DEBUG] [MAIN ] TPH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:51.363485] [INFO ] [MAIN ] TPL: Loaded 12533 primary data records. [2025-09-29T02:23:51.364326] [INFO ] [MAIN ] TPH: Generated 1820 derivative records from 45821 primary records. [2025-09-29T02:23:51.397908] [DEBUG] [LOCAL ] TPH: Saving derivative data. [2025-09-29T02:23:51.516982] [DEBUG] [LOCAL ] TPH: Derivative data saved (1820 records). [2025-09-29T02:23:51.548105] [INFO ] [MAIN ] TPH: Successfully saved derivative data. [2025-09-29T02:23:51.714205] [INFO ] [MAIN ] Derivative Progress: 1968/2211 symbols completed. TPH took 1.7s. Estimated remaining: 1m 43s. Rate: 141.5 symbols/min [2025-09-29T02:23:51.729282] [INFO ] [MAIN ] TPVG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:51.769628] [DEBUG] [LOCAL ] TPR: Loaded 54252 existing records from primary storage. [2025-09-29T02:23:51.771057] [INFO ] [MAIN ] TPR: Loaded 54252 primary data records. [2025-09-29T02:23:51.896990] [DEBUG] [LOCAL ] TPVG: Loaded 27400 existing records from primary storage. [2025-09-29T02:23:51.918033] [INFO ] [MAIN ] TPVG: Loaded 27400 primary data records. [2025-09-29T02:23:52.272831] [DEBUG] [MAIN ] TPL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:52.284496] [INFO ] [MAIN ] TPL: Generated 1820 derivative records from 12533 primary records. [2025-09-29T02:23:52.284920] [DEBUG] [LOCAL ] TPL: Saving derivative data. [2025-09-29T02:23:52.594074] [DEBUG] [LOCAL ] TPL: Derivative data saved (1820 records). [2025-09-29T02:23:52.594486] [INFO ] [MAIN ] TPL: Successfully saved derivative data. [2025-09-29T02:23:52.597490] [INFO ] [MAIN ] Derivative Progress: 1969/2211 symbols completed. TPL took 1.3s. Estimated remaining: 1m 43s. Rate: 141.4 symbols/min [2025-09-29T02:23:52.597705] [INFO ] [MAIN ] TPYP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:52.613466] [DEBUG] [LOCAL ] TPYP: Loaded 8039 existing records from primary storage. [2025-09-29T02:23:52.615339] [INFO ] [MAIN ] TPYP: Loaded 8039 primary data records. [2025-09-29T02:23:52.756352] [DEBUG] [MAIN ] TPR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:52.778089] [INFO ] [MAIN ] TPR: Generated 1820 derivative records from 54252 primary records. [2025-09-29T02:23:52.778587] [DEBUG] [LOCAL ] TPR: Saving derivative data. [2025-09-29T02:23:53.001502] [DEBUG] [MAIN ] TPVG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:53.004822] [INFO ] [MAIN ] TPVG: Generated 1820 derivative records from 27400 primary records. [2025-09-29T02:23:53.005837] [DEBUG] [LOCAL ] TPVG: Saving derivative data. [2025-09-29T02:23:53.011303] [DEBUG] [LOCAL ] TPR: Derivative data saved (1820 records). [2025-09-29T02:23:53.011673] [INFO ] [MAIN ] TPR: Successfully saved derivative data. [2025-09-29T02:23:53.015918] [INFO ] [MAIN ] Derivative Progress: 1970/2211 symbols completed. TPR took 1.7s. Estimated remaining: 1m 42s. Rate: 141.4 symbols/min [2025-09-29T02:23:53.016239] [INFO ] [MAIN ] TPZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:53.038868] [DEBUG] [LOCAL ] TPVG: Derivative data saved (1820 records). [2025-09-29T02:23:53.042927] [INFO ] [MAIN ] TPVG: Successfully saved derivative data. [2025-09-29T02:23:53.042691] [DEBUG] [LOCAL ] TPZ: Loaded 5095 existing records from primary storage. [2025-09-29T02:23:53.045946] [INFO ] [MAIN ] TPZ: Loaded 5095 primary data records. [2025-09-29T02:23:53.045876] [INFO ] [MAIN ] Derivative Progress: 1971/2211 symbols completed. TPVG took 1.3s. Estimated remaining: 1m 42s. Rate: 141.4 symbols/min [2025-09-29T02:23:53.070231] [INFO ] [MAIN ] TR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:53.410913] [DEBUG] [MAIN ] TPYP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:53.409967] [DEBUG] [LOCAL ] TR: Loaded 18494 existing records from primary storage. [2025-09-29T02:23:53.413362] [INFO ] [MAIN ] TPYP: Generated 1820 derivative records from 8039 primary records. [2025-09-29T02:23:53.413490] [INFO ] [MAIN ] TR: Loaded 18494 primary data records. [2025-09-29T02:23:53.413864] [DEBUG] [LOCAL ] TPYP: Saving derivative data. [2025-09-29T02:23:53.604990] [DEBUG] [LOCAL ] TPYP: Derivative data saved (1820 records). [2025-09-29T02:23:53.621515] [INFO ] [MAIN ] TPYP: Successfully saved derivative data. [2025-09-29T02:23:53.641912] [INFO ] [MAIN ] Derivative Progress: 1972/2211 symbols completed. TPYP took 1.0s. Estimated remaining: 1m 41s. Rate: 141.4 symbols/min [2025-09-29T02:23:53.679963] [INFO ] [MAIN ] TRAK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:53.837501] [DEBUG] [MAIN ] TPZ: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:23:53.838573] [INFO ] [MAIN ] TPZ: Generated 1819 derivative records from 5095 primary records. [2025-09-29T02:23:53.839334] [DEBUG] [LOCAL ] TPZ: Saving derivative data. [2025-09-29T02:23:53.844556] [DEBUG] [LOCAL ] TRAK: Loaded 9383 existing records from primary storage. [2025-09-29T02:23:53.847201] [INFO ] [MAIN ] TRAK: Loaded 9383 primary data records. [2025-09-29T02:23:53.916320] [DEBUG] [LOCAL ] TPZ: Derivative data saved (1819 records). [2025-09-29T02:23:53.977212] [INFO ] [MAIN ] TPZ: Successfully saved derivative data. [2025-09-29T02:23:53.984287] [INFO ] [MAIN ] Derivative Progress: 1973/2211 symbols completed. TPZ took 1.0s. Estimated remaining: 1m 41s. Rate: 141.4 symbols/min [2025-09-29T02:23:53.995366] [INFO ] [MAIN ] TRC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:54.225572] [DEBUG] [MAIN ] TR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:54.234853] [DEBUG] [LOCAL ] TRC: Loaded 16189 existing records from primary storage. [2025-09-29T02:23:54.236222] [INFO ] [MAIN ] TR: Generated 1820 derivative records from 18494 primary records. [2025-09-29T02:23:54.236779] [INFO ] [MAIN ] TRC: Loaded 16189 primary data records. [2025-09-29T02:23:54.237029] [DEBUG] [LOCAL ] TR: Saving derivative data. [2025-09-29T02:23:54.368548] [DEBUG] [LOCAL ] TR: Derivative data saved (1820 records). [2025-09-29T02:23:54.383892] [INFO ] [MAIN ] TR: Successfully saved derivative data. [2025-09-29T02:23:54.397961] [INFO ] [MAIN ] Derivative Progress: 1974/2211 symbols completed. TR took 1.3s. Estimated remaining: 1m 41s. Rate: 141.4 symbols/min [2025-09-29T02:23:54.403560] [INFO ] [MAIN ] TREX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:54.638740] [DEBUG] [MAIN ] TRAK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:54.639824] [INFO ] [MAIN ] TRAK: Generated 1820 derivative records from 9383 primary records. [2025-09-29T02:23:54.640018] [DEBUG] [LOCAL ] TRAK: Saving derivative data. [2025-09-29T02:23:54.660123] [DEBUG] [LOCAL ] TRAK: Derivative data saved (1820 records). [2025-09-29T02:23:54.660513] [INFO ] [MAIN ] TRAK: Successfully saved derivative data. [2025-09-29T02:23:54.663464] [INFO ] [MAIN ] Derivative Progress: 1975/2211 symbols completed. TRAK took 1.0s. Estimated remaining: 1m 40s. Rate: 141.5 symbols/min [2025-09-29T02:23:54.664113] [INFO ] [MAIN ] TRGP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:54.725472] [DEBUG] [MAIN ] TRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:54.725032] [DEBUG] [LOCAL ] TREX: Loaded 50733 existing records from primary storage. [2025-09-29T02:23:54.725817] [INFO ] [MAIN ] TREX: Loaded 50733 primary data records. [2025-09-29T02:23:54.726872] [INFO ] [MAIN ] TRC: Generated 1820 derivative records from 16189 primary records. [2025-09-29T02:23:54.739398] [DEBUG] [LOCAL ] TRC: Saving derivative data. [2025-09-29T02:23:54.945895] [DEBUG] [LOCAL ] TRC: Derivative data saved (1820 records). [2025-09-29T02:23:55.002686] [INFO ] [MAIN ] TRC: Successfully saved derivative data. [2025-09-29T02:23:55.028432] [DEBUG] [LOCAL ] TRGP: Loaded 51504 existing records from primary storage. [2025-09-29T02:23:55.147549] [INFO ] [MAIN ] TRGP: Loaded 51504 primary data records. [2025-09-29T02:23:55.150400] [INFO ] [MAIN ] Derivative Progress: 1976/2211 symbols completed. TRC took 1.2s. Estimated remaining: 1m 40s. Rate: 141.4 symbols/min [2025-09-29T02:23:55.167037] [INFO ] [MAIN ] TRN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:55.567376] [DEBUG] [LOCAL ] TRN: Loaded 37786 existing records from primary storage. [2025-09-29T02:23:55.568061] [INFO ] [MAIN ] TRN: Loaded 37786 primary data records. [2025-09-29T02:23:55.706429] [DEBUG] [MAIN ] TREX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:55.719018] [INFO ] [MAIN ] TREX: Generated 1820 derivative records from 50733 primary records. [2025-09-29T02:23:55.739897] [DEBUG] [LOCAL ] TREX: Saving derivative data. [2025-09-29T02:23:55.943722] [DEBUG] [LOCAL ] TREX: Derivative data saved (1820 records). [2025-09-29T02:23:55.944066] [INFO ] [MAIN ] TREX: Successfully saved derivative data. [2025-09-29T02:23:55.947503] [INFO ] [MAIN ] Derivative Progress: 1977/2211 symbols completed. TREX took 1.5s. Estimated remaining: 1m 39s. Rate: 141.4 symbols/min [2025-09-29T02:23:55.948001] [INFO ] [MAIN ] TRNO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:55.973301] [DEBUG] [MAIN ] TRGP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:55.974290] [INFO ] [MAIN ] TRGP: Generated 1820 derivative records from 51504 primary records. [2025-09-29T02:23:55.974545] [DEBUG] [LOCAL ] TRGP: Saving derivative data. [2025-09-29T02:23:55.995079] [DEBUG] [LOCAL ] TRGP: Derivative data saved (1820 records). [2025-09-29T02:23:56.006521] [INFO ] [MAIN ] TRGP: Successfully saved derivative data. [2025-09-29T02:23:56.010871] [INFO ] [MAIN ] Derivative Progress: 1978/2211 symbols completed. TRGP took 1.3s. Estimated remaining: 1m 39s. Rate: 141.4 symbols/min [2025-09-29T02:23:56.031191] [DEBUG] [MAIN ] TRN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:56.032211] [INFO ] [MAIN ] TRN: Generated 1820 derivative records from 37786 primary records. [2025-09-29T02:23:56.045109] [DEBUG] [LOCAL ] TRN: Saving derivative data. [2025-09-29T02:23:56.047046] [DEBUG] [LOCAL ] TRNO: Loaded 44598 existing records from primary storage. [2025-09-29T02:23:56.054825] [INFO ] [MAIN ] TRNO: Loaded 44598 primary data records. [2025-09-29T02:23:56.124755] [DEBUG] [LOCAL ] TRN: Derivative data saved (1820 records). [2025-09-29T02:23:56.158548] [INFO ] [MAIN ] TRN: Successfully saved derivative data. [2025-09-29T02:23:56.188287] [INFO ] [MAIN ] Derivative Progress: 1979/2211 symbols completed. TRN took 1.0s. Estimated remaining: 1m 38s. Rate: 141.5 symbols/min [2025-09-29T02:23:56.406054] [DEBUG] [MAIN ] TRNO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:56.406885] [INFO ] [MAIN ] TRNO: Generated 1820 derivative records from 44598 primary records. [2025-09-29T02:23:56.406976] [DEBUG] [LOCAL ] TRNO: Saving derivative data. [2025-09-29T02:23:56.422846] [DEBUG] [LOCAL ] TRNO: Derivative data saved (1820 records). [2025-09-29T02:23:56.422944] [INFO ] [MAIN ] TRNO: Successfully saved derivative data. [2025-09-29T02:23:56.425572] [INFO ] [MAIN ] Derivative Progress: 1980/2211 symbols completed. TRNO took 0.5s. Estimated remaining: 1m 38s. Rate: 141.5 symbols/min [2025-09-29T02:23:56.426059] [INFO ] [MAIN ] TROX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:56.426204] [INFO ] [MAIN ] TRTX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:56.426695] [INFO ] [MAIN ] TRP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:56.513298] [DEBUG] [LOCAL ] TRTX: Loaded 38058 existing records from primary storage. [2025-09-29T02:23:56.513726] [INFO ] [MAIN ] TRTX: Loaded 38058 primary data records. [2025-09-29T02:23:56.515402] [DEBUG] [LOCAL ] TROX: Loaded 52550 existing records from primary storage. [2025-09-29T02:23:56.528719] [INFO ] [MAIN ] TROX: Loaded 52550 primary data records. [2025-09-29T02:23:56.845583] [DEBUG] [LOCAL ] TRP: Loaded 52891 existing records from primary storage. [2025-09-29T02:23:56.875907] [INFO ] [MAIN ] TRP: Loaded 52891 primary data records. [2025-09-29T02:23:57.658404] [DEBUG] [MAIN ] TRTX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:57.660467] [INFO ] [MAIN ] TRTX: Generated 1820 derivative records from 38058 primary records. [2025-09-29T02:23:57.661090] [DEBUG] [LOCAL ] TRTX: Saving derivative data. [2025-09-29T02:23:57.690809] [DEBUG] [LOCAL ] TRTX: Derivative data saved (1820 records). [2025-09-29T02:23:57.697035] [DEBUG] [MAIN ] TROX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:57.698452] [INFO ] [MAIN ] TROX: Generated 1820 derivative records from 52550 primary records. [2025-09-29T02:23:57.697236] [INFO ] [MAIN ] TRTX: Successfully saved derivative data. [2025-09-29T02:23:57.701246] [INFO ] [MAIN ] Derivative Progress: 1981/2211 symbols completed. TRTX took 1.3s. Estimated remaining: 1m 38s. Rate: 141.4 symbols/min [2025-09-29T02:23:57.701467] [INFO ] [MAIN ] TRU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:57.701905] [DEBUG] [LOCAL ] TROX: Saving derivative data. [2025-09-29T02:23:57.720430] [DEBUG] [LOCAL ] TROX: Derivative data saved (1820 records). [2025-09-29T02:23:57.720610] [INFO ] [MAIN ] TROX: Successfully saved derivative data. [2025-09-29T02:23:57.723250] [INFO ] [MAIN ] Derivative Progress: 1982/2211 symbols completed. TROX took 1.3s. Estimated remaining: 1m 37s. Rate: 141.4 symbols/min [2025-09-29T02:23:57.723843] [INFO ] [MAIN ] TRV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:57.742376] [DEBUG] [MAIN ] TRP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:57.743585] [INFO ] [MAIN ] TRP: Generated 1820 derivative records from 52891 primary records. [2025-09-29T02:23:57.743843] [DEBUG] [LOCAL ] TRP: Saving derivative data. [2025-09-29T02:23:57.763365] [DEBUG] [LOCAL ] TRP: Derivative data saved (1820 records). [2025-09-29T02:23:57.763556] [INFO ] [MAIN ] TRP: Successfully saved derivative data. [2025-09-29T02:23:57.768114] [INFO ] [MAIN ] Derivative Progress: 1983/2211 symbols completed. TRP took 1.3s. Estimated remaining: 1m 37s. Rate: 141.5 symbols/min [2025-09-29T02:23:57.768633] [INFO ] [MAIN ] TS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:57.821548] [DEBUG] [LOCAL ] TRU: Loaded 51965 existing records from primary storage. [2025-09-29T02:23:57.823222] [INFO ] [MAIN ] TRU: Loaded 51965 primary data records. [2025-09-29T02:23:57.873602] [DEBUG] [LOCAL ] TRV: Loaded 48744 existing records from primary storage. [2025-09-29T02:23:57.886591] [INFO ] [MAIN ] TRV: Loaded 48744 primary data records. [2025-09-29T02:23:58.152762] [DEBUG] [LOCAL ] TS: Loaded 52425 existing records from primary storage. [2025-09-29T02:23:58.181404] [INFO ] [MAIN ] TS: Loaded 52425 primary data records. [2025-09-29T02:23:58.932762] [DEBUG] [MAIN ] TRV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:58.932481] [DEBUG] [MAIN ] TRU: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:23:58.933700] [INFO ] [MAIN ] TRV: Generated 1820 derivative records from 48744 primary records. [2025-09-29T02:23:58.934345] [INFO ] [MAIN ] TRU: Generated 1819 derivative records from 51965 primary records. [2025-09-29T02:23:58.935991] [DEBUG] [LOCAL ] TRU: Saving derivative data. [2025-09-29T02:23:58.934971] [DEBUG] [LOCAL ] TRV: Saving derivative data. [2025-09-29T02:23:58.967579] [DEBUG] [LOCAL ] TRU: Derivative data saved (1819 records). [2025-09-29T02:23:58.968969] [INFO ] [MAIN ] TRU: Successfully saved derivative data. [2025-09-29T02:23:58.971870] [INFO ] [MAIN ] Derivative Progress: 1984/2211 symbols completed. TRU took 1.3s. Estimated remaining: 1m 36s. Rate: 141.4 symbols/min [2025-09-29T02:23:58.976100] [DEBUG] [LOCAL ] TRV: Derivative data saved (1820 records). [2025-09-29T02:23:58.974886] [INFO ] [MAIN ] TSE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:58.976687] [INFO ] [MAIN ] TRV: Successfully saved derivative data. [2025-09-29T02:23:58.980882] [INFO ] [MAIN ] Derivative Progress: 1985/2211 symbols completed. TRV took 1.3s. Estimated remaining: 1m 36s. Rate: 141.4 symbols/min [2025-09-29T02:23:58.981390] [INFO ] [MAIN ] TSI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:58.999789] [DEBUG] [MAIN ] TS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:23:59.000674] [INFO ] [MAIN ] TS: Generated 1820 derivative records from 52425 primary records. [2025-09-29T02:23:59.000843] [DEBUG] [LOCAL ] TS: Saving derivative data. [2025-09-29T02:23:59.020156] [DEBUG] [LOCAL ] TS: Derivative data saved (1820 records). [2025-09-29T02:23:59.020421] [INFO ] [MAIN ] TS: Successfully saved derivative data. [2025-09-29T02:23:59.024564] [INFO ] [MAIN ] Derivative Progress: 1986/2211 symbols completed. TS took 1.3s. Estimated remaining: 1m 35s. Rate: 141.5 symbols/min [2025-09-29T02:23:59.037547] [INFO ] [MAIN ] TSLX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:23:59.038349] [DEBUG] [LOCAL ] TSI: Loaded 8090 existing records from primary storage. [2025-09-29T02:23:59.039555] [INFO ] [MAIN ] TSI: Loaded 8090 primary data records. [2025-09-29T02:23:59.171785] [DEBUG] [LOCAL ] TSE: Loaded 29074 existing records from primary storage. [2025-09-29T02:23:59.184551] [INFO ] [MAIN ] TSE: Loaded 29074 primary data records. [2025-09-29T02:23:59.560566] [DEBUG] [LOCAL ] TSLX: Loaded 35752 existing records from primary storage. [2025-09-29T02:23:59.588763] [INFO ] [MAIN ] TSLX: Loaded 35752 primary data records. [2025-09-29T02:24:00.142078] [DEBUG] [MAIN ] TSI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:00.144829] [INFO ] [MAIN ] TSI: Generated 1820 derivative records from 8090 primary records. [2025-09-29T02:24:00.145420] [DEBUG] [LOCAL ] TSI: Saving derivative data. [2025-09-29T02:24:00.167880] [DEBUG] [LOCAL ] TSI: Derivative data saved (1820 records). [2025-09-29T02:24:00.181830] [INFO ] [MAIN ] TSI: Successfully saved derivative data. [2025-09-29T02:24:00.185687] [INFO ] [MAIN ] Derivative Progress: 1987/2211 symbols completed. TSI took 1.2s. Estimated remaining: 1m 35s. Rate: 141.4 symbols/min [2025-09-29T02:24:00.186616] [DEBUG] [MAIN ] TSE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:00.188361] [INFO ] [MAIN ] TSE: Generated 1820 derivative records from 29074 primary records. [2025-09-29T02:24:00.187255] [INFO ] [MAIN ] TSM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:00.188855] [DEBUG] [LOCAL ] TSE: Saving derivative data. [2025-09-29T02:24:00.209099] [DEBUG] [LOCAL ] TSE: Derivative data saved (1820 records). [2025-09-29T02:24:00.211856] [INFO ] [MAIN ] TSE: Successfully saved derivative data. [2025-09-29T02:24:00.217586] [INFO ] [MAIN ] Derivative Progress: 1988/2211 symbols completed. TSE took 1.2s. Estimated remaining: 1m 35s. Rate: 141.4 symbols/min [2025-09-29T02:24:00.218172] [INFO ] [MAIN ] TSN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:00.235054] [DEBUG] [MAIN ] TSLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:00.236353] [INFO ] [MAIN ] TSLX: Generated 1820 derivative records from 35752 primary records. [2025-09-29T02:24:00.236694] [DEBUG] [LOCAL ] TSLX: Saving derivative data. [2025-09-29T02:24:00.254950] [DEBUG] [LOCAL ] TSLX: Derivative data saved (1820 records). [2025-09-29T02:24:00.255254] [INFO ] [MAIN ] TSLX: Successfully saved derivative data. [2025-09-29T02:24:00.259364] [INFO ] [MAIN ] Derivative Progress: 1989/2211 symbols completed. TSLX took 1.2s. Estimated remaining: 1m 34s. Rate: 141.5 symbols/min [2025-09-29T02:24:00.259777] [INFO ] [MAIN ] TSQ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:00.292599] [DEBUG] [LOCAL ] TSQ: Loaded 12195 existing records from primary storage. [2025-09-29T02:24:00.292956] [INFO ] [MAIN ] TSQ: Loaded 12195 primary data records. [2025-09-29T02:24:00.482285] [DEBUG] [LOCAL ] TSM: Loaded 54599 existing records from primary storage. [2025-09-29T02:24:00.489071] [INFO ] [MAIN ] TSM: Loaded 54599 primary data records. [2025-09-29T02:24:00.551286] [DEBUG] [LOCAL ] TSN: Loaded 53638 existing records from primary storage. [2025-09-29T02:24:00.712082] [INFO ] [MAIN ] TSN: Loaded 53638 primary data records. [2025-09-29T02:24:01.441514] [DEBUG] [MAIN ] TSQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:01.443423] [INFO ] [MAIN ] TSQ: Generated 1820 derivative records from 12195 primary records. [2025-09-29T02:24:01.443755] [DEBUG] [LOCAL ] TSQ: Saving derivative data. [2025-09-29T02:24:01.462508] [DEBUG] [LOCAL ] TSQ: Derivative data saved (1820 records). [2025-09-29T02:24:01.462985] [INFO ] [MAIN ] TSQ: Successfully saved derivative data. [2025-09-29T02:24:01.466364] [INFO ] [MAIN ] Derivative Progress: 1990/2211 symbols completed. TSQ took 1.2s. Estimated remaining: 1m 34s. Rate: 141.4 symbols/min [2025-09-29T02:24:01.466788] [INFO ] [MAIN ] TT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:01.485467] [DEBUG] [MAIN ] TSM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:01.486380] [INFO ] [MAIN ] TSM: Generated 1820 derivative records from 54599 primary records. [2025-09-29T02:24:01.486549] [DEBUG] [LOCAL ] TSM: Saving derivative data. [2025-09-29T02:24:01.519573] [DEBUG] [LOCAL ] TSM: Derivative data saved (1820 records). [2025-09-29T02:24:01.525276] [DEBUG] [MAIN ] TSN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:01.525687] [INFO ] [MAIN ] TSM: Successfully saved derivative data. [2025-09-29T02:24:01.531776] [INFO ] [MAIN ] Derivative Progress: 1991/2211 symbols completed. TSM took 1.3s. Estimated remaining: 1m 33s. Rate: 141.4 symbols/min [2025-09-29T02:24:01.527298] [INFO ] [MAIN ] TSN: Generated 1820 derivative records from 53638 primary records. [2025-09-29T02:24:01.532248] [INFO ] [MAIN ] TTC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:01.532965] [DEBUG] [LOCAL ] TSN: Saving derivative data. [2025-09-29T02:24:01.553621] [DEBUG] [LOCAL ] TSN: Derivative data saved (1820 records). [2025-09-29T02:24:01.553818] [INFO ] [MAIN ] TSN: Successfully saved derivative data. [2025-09-29T02:24:01.558621] [INFO ] [MAIN ] Derivative Progress: 1992/2211 symbols completed. TSN took 1.3s. Estimated remaining: 1m 33s. Rate: 141.5 symbols/min [2025-09-29T02:24:01.559248] [INFO ] [MAIN ] TTE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:01.616966] [DEBUG] [LOCAL ] TT: Loaded 48538 existing records from primary storage. [2025-09-29T02:24:01.617211] [INFO ] [MAIN ] TT: Loaded 48538 primary data records. [2025-09-29T02:24:01.761538] [DEBUG] [LOCAL ] TTC: Loaded 43005 existing records from primary storage. [2025-09-29T02:24:01.787937] [INFO ] [MAIN ] TTC: Loaded 43005 primary data records. [2025-09-29T02:24:01.888112] [DEBUG] [LOCAL ] TTE: Loaded 52395 existing records from primary storage. [2025-09-29T02:24:01.966736] [INFO ] [MAIN ] TTE: Loaded 52395 primary data records. [2025-09-29T02:24:02.804246] [DEBUG] [MAIN ] TT: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:24:02.805181] [INFO ] [MAIN ] TT: Generated 1819 derivative records from 48538 primary records. [2025-09-29T02:24:02.805294] [DEBUG] [LOCAL ] TT: Saving derivative data. [2025-09-29T02:24:02.825613] [DEBUG] [LOCAL ] TT: Derivative data saved (1819 records). [2025-09-29T02:24:02.827792] [INFO ] [MAIN ] TT: Successfully saved derivative data. [2025-09-29T02:24:02.832095] [INFO ] [MAIN ] Derivative Progress: 1993/2211 symbols completed. TT took 1.4s. Estimated remaining: 1m 33s. Rate: 141.4 symbols/min [2025-09-29T02:24:02.849454] [DEBUG] [MAIN ] TTC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:02.850451] [INFO ] [MAIN ] TTC: Generated 1820 derivative records from 43005 primary records. [2025-09-29T02:24:02.850775] [DEBUG] [LOCAL ] TTC: Saving derivative data. [2025-09-29T02:24:02.868051] [DEBUG] [LOCAL ] TTC: Derivative data saved (1820 records). [2025-09-29T02:24:02.868333] [INFO ] [MAIN ] TTC: Successfully saved derivative data. [2025-09-29T02:24:02.872083] [INFO ] [MAIN ] Derivative Progress: 1994/2211 symbols completed. TTC took 1.3s. Estimated remaining: 1m 32s. Rate: 141.4 symbols/min [2025-09-29T02:24:02.890475] [DEBUG] [MAIN ] TTE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:02.891719] [INFO ] [MAIN ] TTE: Generated 1820 derivative records from 52395 primary records. [2025-09-29T02:24:02.891812] [DEBUG] [LOCAL ] TTE: Saving derivative data. [2025-09-29T02:24:02.909286] [DEBUG] [LOCAL ] TTE: Derivative data saved (1820 records). [2025-09-29T02:24:02.909405] [INFO ] [MAIN ] TTE: Successfully saved derivative data. [2025-09-29T02:24:02.913701] [INFO ] [MAIN ] Derivative Progress: 1995/2211 symbols completed. TTE took 1.4s. Estimated remaining: 1m 32s. Rate: 141.5 symbols/min [2025-09-29T02:24:02.914234] [INFO ] [MAIN ] TTI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:02.914398] [INFO ] [MAIN ] TU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:02.914700] [INFO ] [MAIN ] TUYA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:02.998042] [DEBUG] [LOCAL ] TU: Loaded 50606 existing records from primary storage. [2025-09-29T02:24:03.025170] [INFO ] [MAIN ] TU: Loaded 50606 primary data records. [2025-09-29T02:24:03.066342] [DEBUG] [LOCAL ] TUYA: Loaded 47185 existing records from primary storage. [2025-09-29T02:24:03.087399] [INFO ] [MAIN ] TUYA: Loaded 47185 primary data records. [2025-09-29T02:24:03.074439] [DEBUG] [LOCAL ] TTI: Loaded 46112 existing records from primary storage. [2025-09-29T02:24:03.132339] [INFO ] [MAIN ] TTI: Loaded 46112 primary data records. [2025-09-29T02:24:04.172062] [DEBUG] [MAIN ] TU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:04.172903] [INFO ] [MAIN ] TU: Generated 1820 derivative records from 50606 primary records. [2025-09-29T02:24:04.173260] [DEBUG] [LOCAL ] TU: Saving derivative data. [2025-09-29T02:24:04.192947] [DEBUG] [LOCAL ] TU: Derivative data saved (1820 records). [2025-09-29T02:24:04.197130] [INFO ] [MAIN ] TU: Successfully saved derivative data. [2025-09-29T02:24:04.199669] [INFO ] [MAIN ] Derivative Progress: 1996/2211 symbols completed. TU took 1.3s. Estimated remaining: 1m 31s. Rate: 141.4 symbols/min [2025-09-29T02:24:04.213521] [INFO ] [MAIN ] TV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:04.216628] [DEBUG] [MAIN ] TUYA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:04.218050] [INFO ] [MAIN ] TUYA: Generated 1820 derivative records from 47185 primary records. [2025-09-29T02:24:04.231734] [DEBUG] [MAIN ] TTI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:04.231185] [DEBUG] [LOCAL ] TUYA: Saving derivative data. [2025-09-29T02:24:04.232563] [INFO ] [MAIN ] TTI: Generated 1820 derivative records from 46112 primary records. [2025-09-29T02:24:04.233140] [DEBUG] [LOCAL ] TTI: Saving derivative data. [2025-09-29T02:24:04.264872] [DEBUG] [LOCAL ] TTI: Derivative data saved (1820 records). [2025-09-29T02:24:04.266929] [INFO ] [MAIN ] TTI: Successfully saved derivative data. [2025-09-29T02:24:04.272836] [DEBUG] [LOCAL ] TUYA: Derivative data saved (1820 records). [2025-09-29T02:24:04.271355] [INFO ] [MAIN ] Derivative Progress: 1997/2211 symbols completed. TTI took 1.4s. Estimated remaining: 1m 31s. Rate: 141.4 symbols/min [2025-09-29T02:24:04.272969] [INFO ] [MAIN ] TUYA: Successfully saved derivative data. [2025-09-29T02:24:04.276355] [INFO ] [MAIN ] Derivative Progress: 1998/2211 symbols completed. TUYA took 1.4s. Estimated remaining: 1m 30s. Rate: 141.5 symbols/min [2025-09-29T02:24:04.273408] [INFO ] [MAIN ] TVC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:04.276999] [INFO ] [MAIN ] TVE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:04.295996] [DEBUG] [LOCAL ] TVE: Loaded 2795 existing records from primary storage. [2025-09-29T02:24:04.296328] [INFO ] [MAIN ] TVE: Loaded 2795 primary data records. [2025-09-29T02:24:04.311929] [DEBUG] [LOCAL ] TVC: Loaded 3466 existing records from primary storage. [2025-09-29T02:24:04.362713] [INFO ] [MAIN ] TVC: Loaded 3466 primary data records. [2025-09-29T02:24:04.424512] [DEBUG] [LOCAL ] TV: Loaded 43514 existing records from primary storage. [2025-09-29T02:24:04.531007] [INFO ] [MAIN ] TV: Loaded 43514 primary data records. [2025-09-29T02:24:05.406618] [DEBUG] [MAIN ] TVE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:05.411846] [INFO ] [MAIN ] TVE: Generated 1820 derivative records from 2795 primary records. [2025-09-29T02:24:05.425883] [DEBUG] [LOCAL ] TVE: Saving derivative data. [2025-09-29T02:24:05.426229] [DEBUG] [MAIN ] TVC: Filtered 7001 bins outside market hours, 7797 incomplete bins [2025-09-29T02:24:05.428038] [INFO ] [MAIN ] TVC: Generated 1817 derivative records from 3466 primary records. [2025-09-29T02:24:05.428836] [DEBUG] [LOCAL ] TVC: Saving derivative data. [2025-09-29T02:24:05.458215] [DEBUG] [LOCAL ] TVE: Derivative data saved (1820 records). [2025-09-29T02:24:05.461820] [INFO ] [MAIN ] TVE: Successfully saved derivative data. [2025-09-29T02:24:05.466351] [INFO ] [MAIN ] Derivative Progress: 1999/2211 symbols completed. TVE took 1.2s. Estimated remaining: 1m 30s. Rate: 141.4 symbols/min [2025-09-29T02:24:05.462754] [DEBUG] [LOCAL ] TVC: Derivative data saved (1817 records). [2025-09-29T02:24:05.466659] [INFO ] [MAIN ] TWI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:05.467389] [INFO ] [MAIN ] TVC: Successfully saved derivative data. [2025-09-29T02:24:05.471673] [INFO ] [MAIN ] Derivative Progress: 2000/2211 symbols completed. TVC took 1.2s. Estimated remaining: 1m 30s. Rate: 141.4 symbols/min [2025-09-29T02:24:05.473921] [INFO ] [MAIN ] TWLO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:05.493942] [DEBUG] [MAIN ] TV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:05.495508] [INFO ] [MAIN ] TV: Generated 1820 derivative records from 43514 primary records. [2025-09-29T02:24:05.495710] [DEBUG] [LOCAL ] TV: Saving derivative data. [2025-09-29T02:24:05.516765] [DEBUG] [LOCAL ] TV: Derivative data saved (1820 records). [2025-09-29T02:24:05.517030] [INFO ] [MAIN ] TV: Successfully saved derivative data. [2025-09-29T02:24:05.519815] [INFO ] [MAIN ] Derivative Progress: 2001/2211 symbols completed. TV took 1.3s. Estimated remaining: 1m 29s. Rate: 141.5 symbols/min [2025-09-29T02:24:05.530739] [INFO ] [MAIN ] TWN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:05.537115] [DEBUG] [LOCAL ] TWN: Loaded 3250 existing records from primary storage. [2025-09-29T02:24:05.537348] [INFO ] [MAIN ] TWN: Loaded 3250 primary data records. [2025-09-29T02:24:05.649497] [DEBUG] [LOCAL ] TWI: Loaded 34981 existing records from primary storage. [2025-09-29T02:24:05.677794] [INFO ] [MAIN ] TWI: Loaded 34981 primary data records. [2025-09-29T02:24:06.034239] [DEBUG] [LOCAL ] TWLO: Loaded 53501 existing records from primary storage. [2025-09-29T02:24:06.071091] [INFO ] [MAIN ] TWLO: Loaded 53501 primary data records. [2025-09-29T02:24:06.687790] [DEBUG] [MAIN ] TWN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:06.690057] [INFO ] [MAIN ] TWN: Generated 1820 derivative records from 3250 primary records. [2025-09-29T02:24:06.690759] [DEBUG] [LOCAL ] TWN: Saving derivative data. [2025-09-29T02:24:06.719721] [DEBUG] [LOCAL ] TWN: Derivative data saved (1820 records). [2025-09-29T02:24:06.734386] [DEBUG] [MAIN ] TWI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:06.734503] [INFO ] [MAIN ] TWN: Successfully saved derivative data. [2025-09-29T02:24:06.735496] [INFO ] [MAIN ] TWI: Generated 1820 derivative records from 34981 primary records. [2025-09-29T02:24:06.738743] [INFO ] [MAIN ] Derivative Progress: 2002/2211 symbols completed. TWN took 1.2s. Estimated remaining: 1m 29s. Rate: 141.4 symbols/min [2025-09-29T02:24:06.739368] [DEBUG] [LOCAL ] TWI: Saving derivative data. [2025-09-29T02:24:06.740323] [INFO ] [MAIN ] TWO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:06.763874] [DEBUG] [LOCAL ] TWI: Derivative data saved (1820 records). [2025-09-29T02:24:06.777234] [DEBUG] [MAIN ] TWLO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:06.777297] [INFO ] [MAIN ] TWI: Successfully saved derivative data. [2025-09-29T02:24:06.781135] [INFO ] [MAIN ] Derivative Progress: 2003/2211 symbols completed. TWI took 1.3s. Estimated remaining: 1m 28s. Rate: 141.4 symbols/min [2025-09-29T02:24:06.778239] [INFO ] [MAIN ] TWLO: Generated 1820 derivative records from 53501 primary records. [2025-09-29T02:24:06.781506] [DEBUG] [LOCAL ] TWLO: Saving derivative data. [2025-09-29T02:24:06.781605] [INFO ] [MAIN ] TX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:06.800325] [DEBUG] [LOCAL ] TWLO: Derivative data saved (1820 records). [2025-09-29T02:24:06.800491] [INFO ] [MAIN ] TWLO: Successfully saved derivative data. [2025-09-29T02:24:06.803920] [INFO ] [MAIN ] Derivative Progress: 2004/2211 symbols completed. TWLO took 1.3s. Estimated remaining: 1m 28s. Rate: 141.5 symbols/min [2025-09-29T02:24:06.804245] [INFO ] [MAIN ] TXNM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:06.835841] [DEBUG] [LOCAL ] TX: Loaded 23932 existing records from primary storage. [2025-09-29T02:24:06.836057] [INFO ] [MAIN ] TX: Loaded 23932 primary data records. [2025-09-29T02:24:06.947825] [DEBUG] [LOCAL ] TWO: Loaded 49002 existing records from primary storage. [2025-09-29T02:24:06.984633] [INFO ] [MAIN ] TWO: Loaded 49002 primary data records. [2025-09-29T02:24:07.192681] [DEBUG] [LOCAL ] TXNM: Loaded 44463 existing records from primary storage. [2025-09-29T02:24:07.343831] [INFO ] [MAIN ] TXNM: Loaded 44463 primary data records. [2025-09-29T02:24:07.956783] [DEBUG] [MAIN ] TX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:07.958342] [INFO ] [MAIN ] TX: Generated 1820 derivative records from 23932 primary records. [2025-09-29T02:24:07.958885] [DEBUG] [LOCAL ] TX: Saving derivative data. [2025-09-29T02:24:07.981987] [DEBUG] [LOCAL ] TX: Derivative data saved (1820 records). [2025-09-29T02:24:07.983074] [INFO ] [MAIN ] TX: Successfully saved derivative data. [2025-09-29T02:24:07.985427] [INFO ] [MAIN ] Derivative Progress: 2005/2211 symbols completed. TX took 1.2s. Estimated remaining: 1m 27s. Rate: 141.4 symbols/min [2025-09-29T02:24:07.985855] [INFO ] [MAIN ] TXO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:08.000469] [DEBUG] [MAIN ] TWO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:08.001638] [INFO ] [MAIN ] TWO: Generated 1820 derivative records from 49002 primary records. [2025-09-29T02:24:08.002015] [DEBUG] [LOCAL ] TWO: Saving derivative data. [2025-09-29T02:24:08.027937] [DEBUG] [LOCAL ] TWO: Derivative data saved (1820 records). [2025-09-29T02:24:08.028170] [INFO ] [MAIN ] TWO: Successfully saved derivative data. [2025-09-29T02:24:08.031108] [INFO ] [MAIN ] Derivative Progress: 2006/2211 symbols completed. TWO took 1.3s. Estimated remaining: 1m 27s. Rate: 141.4 symbols/min [2025-09-29T02:24:08.031558] [INFO ] [MAIN ] TXT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:08.054063] [DEBUG] [LOCAL ] TXO: Loaded 19060 existing records from primary storage. [2025-09-29T02:24:08.054767] [INFO ] [MAIN ] TXO: Loaded 19060 primary data records. [2025-09-29T02:24:08.054462] [DEBUG] [MAIN ] TXNM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:08.106515] [INFO ] [MAIN ] TXNM: Generated 1820 derivative records from 44463 primary records. [2025-09-29T02:24:08.121683] [DEBUG] [LOCAL ] TXNM: Saving derivative data. [2025-09-29T02:24:08.197385] [DEBUG] [LOCAL ] TXNM: Derivative data saved (1820 records). [2025-09-29T02:24:08.219085] [INFO ] [MAIN ] TXNM: Successfully saved derivative data. [2025-09-29T02:24:08.270638] [INFO ] [MAIN ] Derivative Progress: 2007/2211 symbols completed. TXNM took 1.5s. Estimated remaining: 1m 27s. Rate: 141.4 symbols/min [2025-09-29T02:24:08.280407] [INFO ] [MAIN ] TY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:08.486342] [DEBUG] [LOCAL ] TXT: Loaded 50470 existing records from primary storage. [2025-09-29T02:24:08.491337] [DEBUG] [LOCAL ] TY: Loaded 7756 existing records from primary storage. [2025-09-29T02:24:08.491585] [INFO ] [MAIN ] TXT: Loaded 50470 primary data records. [2025-09-29T02:24:08.491828] [INFO ] [MAIN ] TY: Loaded 7756 primary data records. [2025-09-29T02:24:09.223254] [DEBUG] [MAIN ] TXO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:09.224164] [INFO ] [MAIN ] TXO: Generated 1820 derivative records from 19060 primary records. [2025-09-29T02:24:09.225102] [DEBUG] [LOCAL ] TXO: Saving derivative data. [2025-09-29T02:24:09.247488] [DEBUG] [LOCAL ] TXO: Derivative data saved (1820 records). [2025-09-29T02:24:09.248997] [INFO ] [MAIN ] TXO: Successfully saved derivative data. [2025-09-29T02:24:09.251554] [INFO ] [MAIN ] Derivative Progress: 2008/2211 symbols completed. TXO took 1.3s. Estimated remaining: 1m 26s. Rate: 141.4 symbols/min [2025-09-29T02:24:09.289621] [DEBUG] [MAIN ] TY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:09.289272] [DEBUG] [MAIN ] TXT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:09.291076] [INFO ] [MAIN ] TXT: Generated 1820 derivative records from 50470 primary records. [2025-09-29T02:24:09.290460] [INFO ] [MAIN ] TY: Generated 1820 derivative records from 7756 primary records. [2025-09-29T02:24:09.291262] [DEBUG] [LOCAL ] TY: Saving derivative data. [2025-09-29T02:24:09.291290] [DEBUG] [LOCAL ] TXT: Saving derivative data. [2025-09-29T02:24:09.321484] [DEBUG] [LOCAL ] TXT: Derivative data saved (1820 records). [2025-09-29T02:24:09.322906] [DEBUG] [LOCAL ] TY: Derivative data saved (1820 records). [2025-09-29T02:24:09.323083] [INFO ] [MAIN ] TY: Successfully saved derivative data. [2025-09-29T02:24:09.325831] [INFO ] [MAIN ] Derivative Progress: 2009/2211 symbols completed. TY took 1.0s. Estimated remaining: 1m 26s. Rate: 141.4 symbols/min [2025-09-29T02:24:09.325955] [INFO ] [MAIN ] TXT: Successfully saved derivative data. [2025-09-29T02:24:09.330484] [INFO ] [MAIN ] Derivative Progress: 2010/2211 symbols completed. TXT took 1.3s. Estimated remaining: 1m 25s. Rate: 141.5 symbols/min [2025-09-29T02:24:09.331061] [INFO ] [MAIN ] TYG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:09.331156] [INFO ] [MAIN ] U: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:09.331221] [INFO ] [MAIN ] TYL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:09.359264] [DEBUG] [LOCAL ] TYG: Loaded 14410 existing records from primary storage. [2025-09-29T02:24:09.359466] [INFO ] [MAIN ] TYG: Loaded 14410 primary data records. [2025-09-29T02:24:09.420221] [DEBUG] [LOCAL ] TYL: Loaded 22582 existing records from primary storage. [2025-09-29T02:24:09.432934] [INFO ] [MAIN ] TYL: Loaded 22582 primary data records. [2025-09-29T02:24:09.749563] [DEBUG] [LOCAL ] U: Loaded 54579 existing records from primary storage. [2025-09-29T02:24:09.928816] [INFO ] [MAIN ] U: Loaded 54579 primary data records. [2025-09-29T02:24:10.534114] [DEBUG] [MAIN ] TYG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:10.535182] [INFO ] [MAIN ] TYG: Generated 1820 derivative records from 14410 primary records. [2025-09-29T02:24:10.535704] [DEBUG] [LOCAL ] TYG: Saving derivative data. [2025-09-29T02:24:10.565993] [DEBUG] [LOCAL ] TYG: Derivative data saved (1820 records). [2025-09-29T02:24:10.571495] [INFO ] [MAIN ] TYG: Successfully saved derivative data. [2025-09-29T02:24:10.574338] [INFO ] [MAIN ] Derivative Progress: 2011/2211 symbols completed. TYG took 1.2s. Estimated remaining: 1m 25s. Rate: 141.3 symbols/min [2025-09-29T02:24:10.575126] [INFO ] [MAIN ] UA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:10.571969] [DEBUG] [MAIN ] TYL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:10.577359] [INFO ] [MAIN ] TYL: Generated 1820 derivative records from 22582 primary records. [2025-09-29T02:24:10.577798] [DEBUG] [LOCAL ] TYL: Saving derivative data. [2025-09-29T02:24:10.597722] [DEBUG] [LOCAL ] TYL: Derivative data saved (1820 records). [2025-09-29T02:24:10.598011] [INFO ] [MAIN ] TYL: Successfully saved derivative data. [2025-09-29T02:24:10.602484] [INFO ] [MAIN ] Derivative Progress: 2012/2211 symbols completed. TYL took 1.3s. Estimated remaining: 1m 24s. Rate: 141.4 symbols/min [2025-09-29T02:24:10.603134] [INFO ] [MAIN ] UAA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:10.625376] [DEBUG] [MAIN ] U: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:10.627052] [INFO ] [MAIN ] U: Generated 1820 derivative records from 54579 primary records. [2025-09-29T02:24:10.627145] [DEBUG] [LOCAL ] U: Saving derivative data. [2025-09-29T02:24:10.645606] [DEBUG] [LOCAL ] U: Derivative data saved (1820 records). [2025-09-29T02:24:10.659996] [INFO ] [MAIN ] U: Successfully saved derivative data. [2025-09-29T02:24:10.664445] [INFO ] [MAIN ] Derivative Progress: 2013/2211 symbols completed. U took 1.3s. Estimated remaining: 1m 24s. Rate: 141.5 symbols/min [2025-09-29T02:24:10.664805] [INFO ] [MAIN ] UAN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:10.688061] [DEBUG] [LOCAL ] UA: Loaded 51189 existing records from primary storage. [2025-09-29T02:24:10.688284] [INFO ] [MAIN ] UA: Loaded 51189 primary data records. [2025-09-29T02:24:10.714527] [DEBUG] [LOCAL ] UAN: Loaded 5507 existing records from primary storage. [2025-09-29T02:24:10.775419] [INFO ] [MAIN ] UAN: Loaded 5507 primary data records. [2025-09-29T02:24:10.997246] [DEBUG] [LOCAL ] UAA: Loaded 54287 existing records from primary storage. [2025-09-29T02:24:11.045233] [INFO ] [MAIN ] UAA: Loaded 54287 primary data records. [2025-09-29T02:24:11.785270] [DEBUG] [MAIN ] UA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:11.787481] [INFO ] [MAIN ] UA: Generated 1820 derivative records from 51189 primary records. [2025-09-29T02:24:11.788037] [DEBUG] [LOCAL ] UA: Saving derivative data. [2025-09-29T02:24:11.813136] [DEBUG] [LOCAL ] UA: Derivative data saved (1820 records). [2025-09-29T02:24:11.813954] [INFO ] [MAIN ] UA: Successfully saved derivative data. [2025-09-29T02:24:11.817205] [INFO ] [MAIN ] Derivative Progress: 2014/2211 symbols completed. UA took 1.2s. Estimated remaining: 1m 24s. Rate: 141.4 symbols/min [2025-09-29T02:24:11.818325] [INFO ] [MAIN ] UBER: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:11.834507] [DEBUG] [MAIN ] UAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:11.835939] [INFO ] [MAIN ] UAN: Generated 1820 derivative records from 5507 primary records. [2025-09-29T02:24:11.836262] [DEBUG] [LOCAL ] UAN: Saving derivative data. [2025-09-29T02:24:11.855783] [DEBUG] [LOCAL ] UAN: Derivative data saved (1820 records). [2025-09-29T02:24:11.855966] [INFO ] [MAIN ] UAN: Successfully saved derivative data. [2025-09-29T02:24:11.861276] [INFO ] [MAIN ] Derivative Progress: 2015/2211 symbols completed. UAN took 1.2s. Estimated remaining: 1m 23s. Rate: 141.4 symbols/min [2025-09-29T02:24:11.862471] [INFO ] [MAIN ] UBS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:11.879010] [DEBUG] [MAIN ] UAA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:11.879953] [INFO ] [MAIN ] UAA: Generated 1820 derivative records from 54287 primary records. [2025-09-29T02:24:11.880089] [DEBUG] [LOCAL ] UAA: Saving derivative data. [2025-09-29T02:24:11.898524] [DEBUG] [LOCAL ] UAA: Derivative data saved (1820 records). [2025-09-29T02:24:11.898695] [INFO ] [MAIN ] UAA: Successfully saved derivative data. [2025-09-29T02:24:11.903627] [INFO ] [MAIN ] Derivative Progress: 2016/2211 symbols completed. UAA took 1.3s. Estimated remaining: 1m 23s. Rate: 141.5 symbols/min [2025-09-29T02:24:11.904023] [INFO ] [MAIN ] UCB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:11.951397] [DEBUG] [LOCAL ] UBER: Loaded 54586 existing records from primary storage. [2025-09-29T02:24:11.951933] [INFO ] [MAIN ] UBER: Loaded 54586 primary data records. [2025-09-29T02:24:12.147970] [DEBUG] [LOCAL ] UCB: Loaded 38555 existing records from primary storage. [2025-09-29T02:24:12.190261] [DEBUG] [LOCAL ] UBS: Loaded 53187 existing records from primary storage. [2025-09-29T02:24:12.193575] [INFO ] [MAIN ] UBS: Loaded 53187 primary data records. [2025-09-29T02:24:12.213368] [INFO ] [MAIN ] UCB: Loaded 38555 primary data records. [2025-09-29T02:24:13.148474] [DEBUG] [MAIN ] UBER: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:13.151630] [INFO ] [MAIN ] UBER: Generated 1820 derivative records from 54586 primary records. [2025-09-29T02:24:13.151813] [DEBUG] [LOCAL ] UBER: Saving derivative data. [2025-09-29T02:24:13.172856] [DEBUG] [LOCAL ] UBER: Derivative data saved (1820 records). [2025-09-29T02:24:13.174458] [INFO ] [MAIN ] UBER: Successfully saved derivative data. [2025-09-29T02:24:13.177429] [INFO ] [MAIN ] Derivative Progress: 2017/2211 symbols completed. UBER took 1.4s. Estimated remaining: 1m 22s. Rate: 141.3 symbols/min [2025-09-29T02:24:13.177826] [INFO ] [MAIN ] UDR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:13.199850] [DEBUG] [MAIN ] UBS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:13.203288] [INFO ] [MAIN ] UBS: Generated 1820 derivative records from 53187 primary records. [2025-09-29T02:24:13.203611] [DEBUG] [LOCAL ] UBS: Saving derivative data. [2025-09-29T02:24:13.218688] [DEBUG] [MAIN ] UCB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:13.219742] [INFO ] [MAIN ] UCB: Generated 1820 derivative records from 38555 primary records. [2025-09-29T02:24:13.219894] [DEBUG] [LOCAL ] UCB: Saving derivative data. [2025-09-29T02:24:13.255511] [DEBUG] [LOCAL ] UCB: Derivative data saved (1820 records). [2025-09-29T02:24:13.258118] [INFO ] [MAIN ] UCB: Successfully saved derivative data. [2025-09-29T02:24:13.261914] [INFO ] [MAIN ] Derivative Progress: 2018/2211 symbols completed. UCB took 1.4s. Estimated remaining: 1m 22s. Rate: 141.4 symbols/min [2025-09-29T02:24:13.257694] [DEBUG] [LOCAL ] UBS: Derivative data saved (1820 records). [2025-09-29T02:24:13.262315] [INFO ] [MAIN ] UE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:13.262679] [INFO ] [MAIN ] UBS: Successfully saved derivative data. [2025-09-29T02:24:13.267934] [INFO ] [MAIN ] Derivative Progress: 2019/2211 symbols completed. UBS took 1.4s. Estimated remaining: 1m 21s. Rate: 141.5 symbols/min [2025-09-29T02:24:13.268862] [INFO ] [MAIN ] UFI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:13.298863] [DEBUG] [LOCAL ] UFI: Loaded 8229 existing records from primary storage. [2025-09-29T02:24:13.299734] [INFO ] [MAIN ] UFI: Loaded 8229 primary data records. [2025-09-29T02:24:13.437983] [DEBUG] [LOCAL ] UDR: Loaded 52555 existing records from primary storage. [2025-09-29T02:24:13.443596] [INFO ] [MAIN ] UDR: Loaded 52555 primary data records. [2025-09-29T02:24:13.855827] [DEBUG] [LOCAL ] UE: Loaded 43513 existing records from primary storage. [2025-09-29T02:24:13.878785] [INFO ] [MAIN ] UE: Loaded 43513 primary data records. [2025-09-29T02:24:14.440545] [DEBUG] [MAIN ] UFI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:14.441907] [INFO ] [MAIN ] UFI: Generated 1820 derivative records from 8229 primary records. [2025-09-29T02:24:14.442014] [DEBUG] [LOCAL ] UFI: Saving derivative data. [2025-09-29T02:24:14.479976] [DEBUG] [MAIN ] UDR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:14.480117] [DEBUG] [LOCAL ] UFI: Derivative data saved (1820 records). [2025-09-29T02:24:14.481348] [INFO ] [MAIN ] UDR: Generated 1820 derivative records from 52555 primary records. [2025-09-29T02:24:14.481605] [DEBUG] [LOCAL ] UDR: Saving derivative data. [2025-09-29T02:24:14.482097] [INFO ] [MAIN ] UFI: Successfully saved derivative data. [2025-09-29T02:24:14.488181] [INFO ] [MAIN ] Derivative Progress: 2020/2211 symbols completed. UFI took 1.2s. Estimated remaining: 1m 21s. Rate: 141.3 symbols/min [2025-09-29T02:24:14.501254] [INFO ] [MAIN ] UGI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:14.506625] [DEBUG] [LOCAL ] UDR: Derivative data saved (1820 records). [2025-09-29T02:24:14.507908] [INFO ] [MAIN ] UDR: Successfully saved derivative data. [2025-09-29T02:24:14.513977] [INFO ] [MAIN ] Derivative Progress: 2021/2211 symbols completed. UDR took 1.3s. Estimated remaining: 1m 21s. Rate: 141.4 symbols/min [2025-09-29T02:24:14.514385] [INFO ] [MAIN ] UGP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:14.537156] [DEBUG] [MAIN ] UE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:14.538092] [INFO ] [MAIN ] UE: Generated 1820 derivative records from 43513 primary records. [2025-09-29T02:24:14.539178] [DEBUG] [LOCAL ] UE: Saving derivative data. [2025-09-29T02:24:14.559460] [DEBUG] [LOCAL ] UE: Derivative data saved (1820 records). [2025-09-29T02:24:14.559831] [INFO ] [MAIN ] UE: Successfully saved derivative data. [2025-09-29T02:24:14.564708] [INFO ] [MAIN ] Derivative Progress: 2022/2211 symbols completed. UE took 1.3s. Estimated remaining: 1m 20s. Rate: 141.5 symbols/min [2025-09-29T02:24:14.565162] [INFO ] [MAIN ] UHAL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:14.623709] [DEBUG] [LOCAL ] UGP: Loaded 43319 existing records from primary storage. [2025-09-29T02:24:14.624217] [INFO ] [MAIN ] UGP: Loaded 43319 primary data records. [2025-09-29T02:24:14.672463] [DEBUG] [LOCAL ] UHAL: Loaded 16817 existing records from primary storage. [2025-09-29T02:24:14.696432] [INFO ] [MAIN ] UHAL: Loaded 16817 primary data records. [2025-09-29T02:24:14.758838] [DEBUG] [LOCAL ] UGI: Loaded 51290 existing records from primary storage. [2025-09-29T02:24:14.805368] [INFO ] [MAIN ] UGI: Loaded 51290 primary data records. [2025-09-29T02:24:15.787033] [DEBUG] [MAIN ] UGP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:15.789276] [INFO ] [MAIN ] UGP: Generated 1820 derivative records from 43319 primary records. [2025-09-29T02:24:15.789911] [DEBUG] [LOCAL ] UGP: Saving derivative data. [2025-09-29T02:24:15.808278] [DEBUG] [LOCAL ] UGP: Derivative data saved (1820 records). [2025-09-29T02:24:15.809121] [INFO ] [MAIN ] UGP: Successfully saved derivative data. [2025-09-29T02:24:15.812330] [INFO ] [MAIN ] Derivative Progress: 2023/2211 symbols completed. UGP took 1.3s. Estimated remaining: 1m 20s. Rate: 141.3 symbols/min [2025-09-29T02:24:15.844509] [DEBUG] [MAIN ] UHAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:15.844811] [DEBUG] [MAIN ] UGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:15.845702] [INFO ] [MAIN ] UHAL: Generated 1820 derivative records from 16817 primary records. [2025-09-29T02:24:15.846282] [INFO ] [MAIN ] UGI: Generated 1820 derivative records from 51290 primary records. [2025-09-29T02:24:15.846430] [DEBUG] [LOCAL ] UGI: Saving derivative data. [2025-09-29T02:24:15.846854] [DEBUG] [LOCAL ] UHAL: Saving derivative data. [2025-09-29T02:24:15.876689] [DEBUG] [LOCAL ] UHAL: Derivative data saved (1820 records). [2025-09-29T02:24:15.879935] [DEBUG] [LOCAL ] UGI: Derivative data saved (1820 records). [2025-09-29T02:24:15.880062] [INFO ] [MAIN ] UHAL: Successfully saved derivative data. [2025-09-29T02:24:15.880279] [INFO ] [MAIN ] UGI: Successfully saved derivative data. [2025-09-29T02:24:15.884945] [INFO ] [MAIN ] Derivative Progress: 2024/2211 symbols completed. UHAL took 1.3s. Estimated remaining: 1m 19s. Rate: 141.4 symbols/min [2025-09-29T02:24:15.890173] [INFO ] [MAIN ] Derivative Progress: 2025/2211 symbols completed. UGI took 1.4s. Estimated remaining: 1m 19s. Rate: 141.5 symbols/min [2025-09-29T02:24:15.890979] [INFO ] [MAIN ] UI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:15.890914] [INFO ] [MAIN ] UHT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:15.890806] [INFO ] [MAIN ] UHS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:15.915340] [DEBUG] [LOCAL ] UHT: Loaded 10131 existing records from primary storage. [2025-09-29T02:24:15.921523] [INFO ] [MAIN ] UHT: Loaded 10131 primary data records. [2025-09-29T02:24:15.921366] [DEBUG] [LOCAL ] UI: Loaded 13008 existing records from primary storage. [2025-09-29T02:24:15.927048] [INFO ] [MAIN ] UI: Loaded 13008 primary data records. [2025-09-29T02:24:16.184419] [DEBUG] [LOCAL ] UHS: Loaded 41674 existing records from primary storage. [2025-09-29T02:24:16.222502] [INFO ] [MAIN ] UHS: Loaded 41674 primary data records. [2025-09-29T02:24:17.028720] [DEBUG] [MAIN ] UHT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:17.029743] [INFO ] [MAIN ] UHT: Generated 1820 derivative records from 10131 primary records. [2025-09-29T02:24:17.032189] [DEBUG] [LOCAL ] UHT: Saving derivative data. [2025-09-29T02:24:17.067682] [DEBUG] [LOCAL ] UHT: Derivative data saved (1820 records). [2025-09-29T02:24:17.068072] [INFO ] [MAIN ] UHT: Successfully saved derivative data. [2025-09-29T02:24:17.065313] [DEBUG] [MAIN ] UI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:17.070608] [INFO ] [MAIN ] Derivative Progress: 2026/2211 symbols completed. UHT took 1.2s. Estimated remaining: 1m 19s. Rate: 141.3 symbols/min [2025-09-29T02:24:17.072762] [INFO ] [MAIN ] UI: Generated 1820 derivative records from 13008 primary records. [2025-09-29T02:24:17.073055] [INFO ] [MAIN ] UIS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:17.073144] [DEBUG] [LOCAL ] UI: Saving derivative data. [2025-09-29T02:24:17.117534] [DEBUG] [LOCAL ] UI: Derivative data saved (1820 records). [2025-09-29T02:24:17.118466] [INFO ] [MAIN ] UI: Successfully saved derivative data. [2025-09-29T02:24:17.118123] [DEBUG] [MAIN ] UHS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:17.122288] [INFO ] [MAIN ] Derivative Progress: 2027/2211 symbols completed. UI took 1.2s. Estimated remaining: 1m 18s. Rate: 141.4 symbols/min [2025-09-29T02:24:17.123503] [INFO ] [MAIN ] UL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:17.123281] [INFO ] [MAIN ] UHS: Generated 1820 derivative records from 41674 primary records. [2025-09-29T02:24:17.124369] [DEBUG] [LOCAL ] UHS: Saving derivative data. [2025-09-29T02:24:17.159818] [DEBUG] [LOCAL ] UHS: Derivative data saved (1820 records). [2025-09-29T02:24:17.160120] [INFO ] [MAIN ] UHS: Successfully saved derivative data. [2025-09-29T02:24:17.163266] [INFO ] [MAIN ] Derivative Progress: 2028/2211 symbols completed. UHS took 1.3s. Estimated remaining: 1m 18s. Rate: 141.5 symbols/min [2025-09-29T02:24:17.164700] [INFO ] [MAIN ] ULS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:17.177896] [DEBUG] [LOCAL ] UIS: Loaded 37552 existing records from primary storage. [2025-09-29T02:24:17.178092] [INFO ] [MAIN ] UIS: Loaded 37552 primary data records. [2025-09-29T02:24:17.600924] [DEBUG] [LOCAL ] UL: Loaded 53843 existing records from primary storage. [2025-09-29T02:24:17.603143] [INFO ] [MAIN ] UL: Loaded 53843 primary data records. [2025-09-29T02:24:17.604393] [DEBUG] [LOCAL ] ULS: Loaded 39769 existing records from primary storage. [2025-09-29T02:24:17.645909] [INFO ] [MAIN ] ULS: Loaded 39769 primary data records. [2025-09-29T02:24:18.341209] [DEBUG] [MAIN ] UIS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:18.343087] [INFO ] [MAIN ] UIS: Generated 1820 derivative records from 37552 primary records. [2025-09-29T02:24:18.343672] [DEBUG] [LOCAL ] UIS: Saving derivative data. [2025-09-29T02:24:18.363149] [DEBUG] [LOCAL ] UIS: Derivative data saved (1820 records). [2025-09-29T02:24:18.363918] [INFO ] [MAIN ] UIS: Successfully saved derivative data. [2025-09-29T02:24:18.368248] [INFO ] [MAIN ] Derivative Progress: 2029/2211 symbols completed. UIS took 1.3s. Estimated remaining: 1m 17s. Rate: 141.3 symbols/min [2025-09-29T02:24:18.371550] [INFO ] [MAIN ] UMC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:18.388210] [DEBUG] [MAIN ] UL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:18.389060] [INFO ] [MAIN ] UL: Generated 1820 derivative records from 53843 primary records. [2025-09-29T02:24:18.389785] [DEBUG] [LOCAL ] UL: Saving derivative data. [2025-09-29T02:24:18.410319] [DEBUG] [LOCAL ] UL: Derivative data saved (1820 records). [2025-09-29T02:24:18.423897] [INFO ] [MAIN ] UL: Successfully saved derivative data. [2025-09-29T02:24:18.424179] [DEBUG] [MAIN ] ULS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:18.425812] [INFO ] [MAIN ] ULS: Generated 1820 derivative records from 39769 primary records. [2025-09-29T02:24:18.429049] [INFO ] [MAIN ] Derivative Progress: 2030/2211 symbols completed. UL took 1.3s. Estimated remaining: 1m 17s. Rate: 141.4 symbols/min [2025-09-29T02:24:18.429748] [INFO ] [MAIN ] UMH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:18.429906] [DEBUG] [LOCAL ] ULS: Saving derivative data. [2025-09-29T02:24:18.453848] [DEBUG] [LOCAL ] ULS: Derivative data saved (1820 records). [2025-09-29T02:24:18.454078] [INFO ] [MAIN ] ULS: Successfully saved derivative data. [2025-09-29T02:24:18.457208] [INFO ] [MAIN ] Derivative Progress: 2031/2211 symbols completed. ULS took 1.3s. Estimated remaining: 1m 16s. Rate: 141.4 symbols/min [2025-09-29T02:24:18.457787] [INFO ] [MAIN ] UNF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:18.494491] [DEBUG] [LOCAL ] UNF: Loaded 12048 existing records from primary storage. [2025-09-29T02:24:18.510088] [INFO ] [MAIN ] UNF: Loaded 12048 primary data records. [2025-09-29T02:24:18.532231] [DEBUG] [LOCAL ] UMC: Loaded 53490 existing records from primary storage. [2025-09-29T02:24:18.560769] [INFO ] [MAIN ] UMC: Loaded 53490 primary data records. [2025-09-29T02:24:18.709624] [DEBUG] [LOCAL ] UMH: Loaded 34078 existing records from primary storage. [2025-09-29T02:24:18.759713] [INFO ] [MAIN ] UMH: Loaded 34078 primary data records. [2025-09-29T02:24:19.647737] [DEBUG] [MAIN ] UNF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:19.649924] [INFO ] [MAIN ] UNF: Generated 1820 derivative records from 12048 primary records. [2025-09-29T02:24:19.650183] [DEBUG] [LOCAL ] UNF: Saving derivative data. [2025-09-29T02:24:19.687247] [DEBUG] [LOCAL ] UNF: Derivative data saved (1820 records). [2025-09-29T02:24:19.688035] [INFO ] [MAIN ] UNF: Successfully saved derivative data. [2025-09-29T02:24:19.687965] [DEBUG] [MAIN ] UMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:19.689416] [INFO ] [MAIN ] UMC: Generated 1820 derivative records from 53490 primary records. [2025-09-29T02:24:19.689693] [DEBUG] [LOCAL ] UMC: Saving derivative data. [2025-09-29T02:24:19.692497] [INFO ] [MAIN ] Derivative Progress: 2032/2211 symbols completed. UNF took 1.2s. Estimated remaining: 1m 16s. Rate: 141.3 symbols/min [2025-09-29T02:24:19.694152] [INFO ] [MAIN ] UNFI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:19.715270] [DEBUG] [LOCAL ] UMC: Derivative data saved (1820 records). [2025-09-29T02:24:19.728123] [INFO ] [MAIN ] UMC: Successfully saved derivative data. [2025-09-29T02:24:19.732398] [INFO ] [MAIN ] Derivative Progress: 2033/2211 symbols completed. UMC took 1.4s. Estimated remaining: 1m 16s. Rate: 141.4 symbols/min [2025-09-29T02:24:19.732897] [DEBUG] [MAIN ] UMH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:19.733152] [INFO ] [MAIN ] UNH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:19.734322] [INFO ] [MAIN ] UMH: Generated 1820 derivative records from 34078 primary records. [2025-09-29T02:24:19.734733] [DEBUG] [LOCAL ] UMH: Saving derivative data. [2025-09-29T02:24:19.754736] [DEBUG] [LOCAL ] UMH: Derivative data saved (1820 records). [2025-09-29T02:24:19.764872] [INFO ] [MAIN ] UMH: Successfully saved derivative data. [2025-09-29T02:24:19.767894] [INFO ] [MAIN ] Derivative Progress: 2034/2211 symbols completed. UMH took 1.3s. Estimated remaining: 1m 15s. Rate: 141.4 symbols/min [2025-09-29T02:24:19.768359] [INFO ] [MAIN ] UNM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:19.787516] [DEBUG] [LOCAL ] UNFI: Loaded 42528 existing records from primary storage. [2025-09-29T02:24:19.787954] [INFO ] [MAIN ] UNFI: Loaded 42528 primary data records. [2025-09-29T02:24:20.199580] [DEBUG] [LOCAL ] UNH: Loaded 54574 existing records from primary storage. [2025-09-29T02:24:20.200010] [INFO ] [MAIN ] UNH: Loaded 54574 primary data records. [2025-09-29T02:24:20.201324] [DEBUG] [LOCAL ] UNM: Loaded 49368 existing records from primary storage. [2025-09-29T02:24:20.215169] [INFO ] [MAIN ] UNM: Loaded 49368 primary data records. [2025-09-29T02:24:20.941950] [DEBUG] [MAIN ] UNFI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:20.943978] [INFO ] [MAIN ] UNFI: Generated 1820 derivative records from 42528 primary records. [2025-09-29T02:24:20.944615] [DEBUG] [LOCAL ] UNFI: Saving derivative data. [2025-09-29T02:24:20.966279] [DEBUG] [LOCAL ] UNFI: Derivative data saved (1820 records). [2025-09-29T02:24:20.966519] [INFO ] [MAIN ] UNFI: Successfully saved derivative data. [2025-09-29T02:24:20.969440] [INFO ] [MAIN ] Derivative Progress: 2035/2211 symbols completed. UNFI took 1.3s. Estimated remaining: 1m 15s. Rate: 141.3 symbols/min [2025-09-29T02:24:20.969914] [INFO ] [MAIN ] UNMA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:20.992897] [DEBUG] [LOCAL ] UNMA: Loaded 3627 existing records from primary storage. [2025-09-29T02:24:20.995250] [DEBUG] [MAIN ] UNH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:20.995325] [INFO ] [MAIN ] UNMA: Loaded 3627 primary data records. [2025-09-29T02:24:20.997125] [INFO ] [MAIN ] UNH: Generated 1820 derivative records from 54574 primary records. [2025-09-29T02:24:20.997387] [DEBUG] [LOCAL ] UNH: Saving derivative data. [2025-09-29T02:24:21.097389] [DEBUG] [MAIN ] UNM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:21.121948] [INFO ] [MAIN ] UNM: Generated 1820 derivative records from 49368 primary records. [2025-09-29T02:24:21.144525] [DEBUG] [LOCAL ] UNM: Saving derivative data. [2025-09-29T02:24:21.244372] [DEBUG] [LOCAL ] UNH: Derivative data saved (1820 records). [2025-09-29T02:24:21.278690] [INFO ] [MAIN ] UNH: Successfully saved derivative data. [2025-09-29T02:24:21.347672] [INFO ] [MAIN ] Derivative Progress: 2036/2211 symbols completed. UNH took 1.6s. Estimated remaining: 1m 14s. Rate: 141.3 symbols/min [2025-09-29T02:24:21.365508] [INFO ] [MAIN ] UNP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:21.382319] [DEBUG] [LOCAL ] UNM: Derivative data saved (1820 records). [2025-09-29T02:24:21.382481] [INFO ] [MAIN ] UNM: Successfully saved derivative data. [2025-09-29T02:24:21.385835] [INFO ] [MAIN ] Derivative Progress: 2037/2211 symbols completed. UNM took 1.6s. Estimated remaining: 1m 14s. Rate: 141.4 symbols/min [2025-09-29T02:24:21.386155] [INFO ] [MAIN ] UP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:21.416682] [DEBUG] [MAIN ] UNMA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:21.417711] [INFO ] [MAIN ] UNMA: Generated 1820 derivative records from 3627 primary records. [2025-09-29T02:24:21.417969] [DEBUG] [LOCAL ] UNMA: Saving derivative data. [2025-09-29T02:24:21.447523] [DEBUG] [LOCAL ] UNMA: Derivative data saved (1820 records). [2025-09-29T02:24:21.447793] [INFO ] [MAIN ] UNMA: Successfully saved derivative data. [2025-09-29T02:24:21.450374] [INFO ] [MAIN ] Derivative Progress: 2038/2211 symbols completed. UNMA took 0.5s. Estimated remaining: 1m 13s. Rate: 141.4 symbols/min [2025-09-29T02:24:21.481701] [DEBUG] [LOCAL ] UP: Loaded 43857 existing records from primary storage. [2025-09-29T02:24:21.481955] [INFO ] [MAIN ] UP: Loaded 43857 primary data records. [2025-09-29T02:24:21.629722] [DEBUG] [LOCAL ] UNP: Loaded 54030 existing records from primary storage. [2025-09-29T02:24:21.645296] [INFO ] [MAIN ] UNP: Loaded 54030 primary data records. [2025-09-29T02:24:22.217116] [DEBUG] [MAIN ] UP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:22.218094] [INFO ] [MAIN ] UP: Generated 1820 derivative records from 43857 primary records. [2025-09-29T02:24:22.218307] [DEBUG] [LOCAL ] UP: Saving derivative data. [2025-09-29T02:24:22.237967] [DEBUG] [LOCAL ] UP: Derivative data saved (1820 records). [2025-09-29T02:24:22.238337] [INFO ] [MAIN ] UP: Successfully saved derivative data. [2025-09-29T02:24:22.240696] [INFO ] [MAIN ] Derivative Progress: 2039/2211 symbols completed. UP took 0.9s. Estimated remaining: 1m 13s. Rate: 141.4 symbols/min [2025-09-29T02:24:22.253580] [DEBUG] [MAIN ] UNP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:22.254268] [INFO ] [MAIN ] UNP: Generated 1820 derivative records from 54030 primary records. [2025-09-29T02:24:22.254370] [DEBUG] [LOCAL ] UNP: Saving derivative data. [2025-09-29T02:24:22.270734] [DEBUG] [LOCAL ] UNP: Derivative data saved (1820 records). [2025-09-29T02:24:22.270849] [INFO ] [MAIN ] UNP: Successfully saved derivative data. [2025-09-29T02:24:22.274214] [INFO ] [MAIN ] Derivative Progress: 2040/2211 symbols completed. UNP took 0.9s. Estimated remaining: 1m 13s. Rate: 141.4 symbols/min [2025-09-29T02:24:22.274703] [INFO ] [MAIN ] UPS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:22.274791] [INFO ] [MAIN ] USA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:22.275033] [INFO ] [MAIN ] URI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:22.349481] [DEBUG] [LOCAL ] USA: Loaded 36524 existing records from primary storage. [2025-09-29T02:24:22.351226] [INFO ] [MAIN ] USA: Loaded 36524 primary data records. [2025-09-29T02:24:22.385130] [DEBUG] [LOCAL ] URI: Loaded 36669 existing records from primary storage. [2025-09-29T02:24:22.448181] [INFO ] [MAIN ] URI: Loaded 36669 primary data records. [2025-09-29T02:24:22.508355] [DEBUG] [LOCAL ] UPS: Loaded 54490 existing records from primary storage. [2025-09-29T02:24:22.531688] [INFO ] [MAIN ] UPS: Loaded 54490 primary data records. [2025-09-29T02:24:23.422907] [DEBUG] [MAIN ] USA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:23.423752] [INFO ] [MAIN ] USA: Generated 1820 derivative records from 36524 primary records. [2025-09-29T02:24:23.423967] [DEBUG] [LOCAL ] USA: Saving derivative data. [2025-09-29T02:24:23.446177] [DEBUG] [LOCAL ] USA: Derivative data saved (1820 records). [2025-09-29T02:24:23.446667] [INFO ] [MAIN ] USA: Successfully saved derivative data. [2025-09-29T02:24:23.462062] [INFO ] [MAIN ] Derivative Progress: 2041/2211 symbols completed. USA took 1.2s. Estimated remaining: 1m 12s. Rate: 141.3 symbols/min [2025-09-29T02:24:23.459828] [DEBUG] [MAIN ] URI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:23.475371] [INFO ] [MAIN ] URI: Generated 1820 derivative records from 36669 primary records. [2025-09-29T02:24:23.475887] [DEBUG] [MAIN ] UPS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:23.476020] [INFO ] [MAIN ] USAC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:23.476996] [INFO ] [MAIN ] UPS: Generated 1820 derivative records from 54490 primary records. [2025-09-29T02:24:23.476269] [DEBUG] [LOCAL ] URI: Saving derivative data. [2025-09-29T02:24:23.477435] [DEBUG] [LOCAL ] UPS: Saving derivative data. [2025-09-29T02:24:23.510381] [DEBUG] [LOCAL ] UPS: Derivative data saved (1820 records). [2025-09-29T02:24:23.511500] [DEBUG] [LOCAL ] URI: Derivative data saved (1820 records). [2025-09-29T02:24:23.511778] [INFO ] [MAIN ] UPS: Successfully saved derivative data. [2025-09-29T02:24:23.515290] [INFO ] [MAIN ] Derivative Progress: 2042/2211 symbols completed. UPS took 1.2s. Estimated remaining: 1m 12s. Rate: 141.4 symbols/min [2025-09-29T02:24:23.515568] [INFO ] [MAIN ] USB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:23.515782] [INFO ] [MAIN ] URI: Successfully saved derivative data. [2025-09-29T02:24:23.519544] [INFO ] [MAIN ] Derivative Progress: 2043/2211 symbols completed. URI took 1.2s. Estimated remaining: 1m 11s. Rate: 141.5 symbols/min [2025-09-29T02:24:23.520027] [INFO ] [MAIN ] USFD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:23.543130] [DEBUG] [LOCAL ] USAC: Loaded 23060 existing records from primary storage. [2025-09-29T02:24:23.543354] [INFO ] [MAIN ] USAC: Loaded 23060 primary data records. [2025-09-29T02:24:23.958371] [DEBUG] [LOCAL ] USFD: Loaded 51959 existing records from primary storage. [2025-09-29T02:24:23.959406] [INFO ] [MAIN ] USFD: Loaded 51959 primary data records. [2025-09-29T02:24:23.994361] [DEBUG] [LOCAL ] USB: Loaded 54468 existing records from primary storage. [2025-09-29T02:24:24.023945] [INFO ] [MAIN ] USB: Loaded 54468 primary data records. [2025-09-29T02:24:24.705513] [DEBUG] [MAIN ] USAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:24.706802] [INFO ] [MAIN ] USAC: Generated 1820 derivative records from 23060 primary records. [2025-09-29T02:24:24.707984] [DEBUG] [LOCAL ] USAC: Saving derivative data. [2025-09-29T02:24:24.729192] [DEBUG] [LOCAL ] USAC: Derivative data saved (1820 records). [2025-09-29T02:24:24.730059] [INFO ] [MAIN ] USAC: Successfully saved derivative data. [2025-09-29T02:24:24.732904] [INFO ] [MAIN ] Derivative Progress: 2044/2211 symbols completed. USAC took 1.3s. Estimated remaining: 1m 11s. Rate: 141.3 symbols/min [2025-09-29T02:24:24.733714] [INFO ] [MAIN ] USNA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:24.758611] [DEBUG] [MAIN ] USFD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:24.760008] [INFO ] [MAIN ] USFD: Generated 1820 derivative records from 51959 primary records. [2025-09-29T02:24:24.760151] [DEBUG] [LOCAL ] USFD: Saving derivative data. [2025-09-29T02:24:24.793023] [DEBUG] [MAIN ] USB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:24.804905] [DEBUG] [LOCAL ] USNA: Loaded 18368 existing records from primary storage. [2025-09-29T02:24:24.806625] [INFO ] [MAIN ] USNA: Loaded 18368 primary data records. [2025-09-29T02:24:24.805634] [INFO ] [MAIN ] USB: Generated 1820 derivative records from 54468 primary records. [2025-09-29T02:24:24.807571] [DEBUG] [LOCAL ] USFD: Derivative data saved (1820 records). [2025-09-29T02:24:24.831015] [INFO ] [MAIN ] USFD: Successfully saved derivative data. [2025-09-29T02:24:24.847511] [DEBUG] [LOCAL ] USB: Saving derivative data. [2025-09-29T02:24:24.850905] [INFO ] [MAIN ] Derivative Progress: 2045/2211 symbols completed. USFD took 1.3s. Estimated remaining: 1m 10s. Rate: 141.4 symbols/min [2025-09-29T02:24:24.906554] [INFO ] [MAIN ] USPH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:24.950970] [DEBUG] [LOCAL ] USB: Derivative data saved (1820 records). [2025-09-29T02:24:24.962553] [INFO ] [MAIN ] USB: Successfully saved derivative data. [2025-09-29T02:24:24.975968] [INFO ] [MAIN ] Derivative Progress: 2046/2211 symbols completed. USB took 1.5s. Estimated remaining: 1m 10s. Rate: 141.4 symbols/min [2025-09-29T02:24:25.011104] [INFO ] [MAIN ] UTF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:25.165180] [DEBUG] [LOCAL ] USPH: Loaded 16827 existing records from primary storage. [2025-09-29T02:24:25.181252] [INFO ] [MAIN ] USPH: Loaded 16827 primary data records. [2025-09-29T02:24:25.390221] [DEBUG] [LOCAL ] UTF: Loaded 29200 existing records from primary storage. [2025-09-29T02:24:25.418673] [INFO ] [MAIN ] UTF: Loaded 29200 primary data records. [2025-09-29T02:24:25.710350] [DEBUG] [MAIN ] USNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:25.724039] [INFO ] [MAIN ] USNA: Generated 1820 derivative records from 18368 primary records. [2025-09-29T02:24:25.734628] [DEBUG] [LOCAL ] USNA: Saving derivative data. [2025-09-29T02:24:25.938676] [DEBUG] [LOCAL ] USNA: Derivative data saved (1820 records). [2025-09-29T02:24:25.940185] [INFO ] [MAIN ] USNA: Successfully saved derivative data. [2025-09-29T02:24:25.943036] [INFO ] [MAIN ] Derivative Progress: 2047/2211 symbols completed. USNA took 1.2s. Estimated remaining: 1m 10s. Rate: 141.3 symbols/min [2025-09-29T02:24:25.944296] [INFO ] [MAIN ] UTI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:25.964676] [DEBUG] [MAIN ] USPH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:25.965629] [INFO ] [MAIN ] USPH: Generated 1820 derivative records from 16827 primary records. [2025-09-29T02:24:25.967631] [DEBUG] [LOCAL ] USPH: Saving derivative data. [2025-09-29T02:24:25.987962] [DEBUG] [LOCAL ] USPH: Derivative data saved (1820 records). [2025-09-29T02:24:25.988389] [INFO ] [MAIN ] USPH: Successfully saved derivative data. [2025-09-29T02:24:25.991798] [INFO ] [MAIN ] Derivative Progress: 2048/2211 symbols completed. USPH took 1.1s. Estimated remaining: 1m 9s. Rate: 141.4 symbols/min [2025-09-29T02:24:25.992228] [INFO ] [MAIN ] UTL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:26.009679] [DEBUG] [MAIN ] UTF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:26.021789] [INFO ] [MAIN ] UTF: Generated 1820 derivative records from 29200 primary records. [2025-09-29T02:24:26.022114] [DEBUG] [LOCAL ] UTF: Saving derivative data. [2025-09-29T02:24:26.061898] [DEBUG] [LOCAL ] UTF: Derivative data saved (1820 records). [2025-09-29T02:24:26.062104] [INFO ] [MAIN ] UTF: Successfully saved derivative data. [2025-09-29T02:24:26.065305] [INFO ] [MAIN ] Derivative Progress: 2049/2211 symbols completed. UTF took 1.1s. Estimated remaining: 1m 9s. Rate: 141.5 symbols/min [2025-09-29T02:24:26.066428] [INFO ] [MAIN ] UTZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:26.066197] [DEBUG] [LOCAL ] UTL: Loaded 11273 existing records from primary storage. [2025-09-29T02:24:26.067158] [INFO ] [MAIN ] UTL: Loaded 11273 primary data records. [2025-09-29T02:24:26.068794] [DEBUG] [LOCAL ] UTI: Loaded 41146 existing records from primary storage. [2025-09-29T02:24:26.081495] [INFO ] [MAIN ] UTI: Loaded 41146 primary data records. [2025-09-29T02:24:26.793063] [DEBUG] [LOCAL ] UTZ: Loaded 45341 existing records from primary storage. [2025-09-29T02:24:26.794131] [INFO ] [MAIN ] UTZ: Loaded 45341 primary data records. [2025-09-29T02:24:27.198459] [DEBUG] [MAIN ] UTL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:27.198083] [DEBUG] [MAIN ] UTI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:27.199636] [INFO ] [MAIN ] UTI: Generated 1820 derivative records from 41146 primary records. [2025-09-29T02:24:27.200926] [INFO ] [MAIN ] UTL: Generated 1820 derivative records from 11273 primary records. [2025-09-29T02:24:27.202094] [DEBUG] [LOCAL ] UTL: Saving derivative data. [2025-09-29T02:24:27.202166] [DEBUG] [LOCAL ] UTI: Saving derivative data. [2025-09-29T02:24:27.238624] [DEBUG] [LOCAL ] UTL: Derivative data saved (1820 records). [2025-09-29T02:24:27.242548] [DEBUG] [LOCAL ] UTI: Derivative data saved (1820 records). [2025-09-29T02:24:27.242908] [INFO ] [MAIN ] UTI: Successfully saved derivative data. [2025-09-29T02:24:27.240030] [INFO ] [MAIN ] UTL: Successfully saved derivative data. [2025-09-29T02:24:27.246523] [INFO ] [MAIN ] Derivative Progress: 2050/2211 symbols completed. UTI took 1.3s. Estimated remaining: 1m 8s. Rate: 141.3 symbols/min [2025-09-29T02:24:27.250428] [INFO ] [MAIN ] UVE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:27.250592] [INFO ] [MAIN ] Derivative Progress: 2051/2211 symbols completed. UTL took 1.3s. Estimated remaining: 1m 8s. Rate: 141.4 symbols/min [2025-09-29T02:24:27.251452] [INFO ] [MAIN ] UVV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:27.271826] [DEBUG] [MAIN ] UTZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:27.272613] [INFO ] [MAIN ] UTZ: Generated 1820 derivative records from 45341 primary records. [2025-09-29T02:24:27.272720] [DEBUG] [LOCAL ] UTZ: Saving derivative data. [2025-09-29T02:24:27.302418] [DEBUG] [LOCAL ] UTZ: Derivative data saved (1820 records). [2025-09-29T02:24:27.302793] [INFO ] [MAIN ] UTZ: Successfully saved derivative data. [2025-09-29T02:24:27.306100] [INFO ] [MAIN ] Derivative Progress: 2052/2211 symbols completed. UTZ took 1.2s. Estimated remaining: 1m 7s. Rate: 141.5 symbols/min [2025-09-29T02:24:27.306524] [INFO ] [MAIN ] UWMC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:27.332021] [DEBUG] [LOCAL ] UVE: Loaded 22124 existing records from primary storage. [2025-09-29T02:24:27.332361] [INFO ] [MAIN ] UVE: Loaded 22124 primary data records. [2025-09-29T02:24:27.401801] [DEBUG] [LOCAL ] UVV: Loaded 22660 existing records from primary storage. [2025-09-29T02:24:27.447262] [INFO ] [MAIN ] UVV: Loaded 22660 primary data records. [2025-09-29T02:24:28.015001] [DEBUG] [LOCAL ] UWMC: Loaded 53516 existing records from primary storage. [2025-09-29T02:24:28.037798] [INFO ] [MAIN ] UWMC: Loaded 53516 primary data records. [2025-09-29T02:24:28.774150] [DEBUG] [MAIN ] UVE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:28.776623] [INFO ] [MAIN ] UVE: Generated 1820 derivative records from 22124 primary records. [2025-09-29T02:24:28.777336] [DEBUG] [LOCAL ] UVE: Saving derivative data. [2025-09-29T02:24:28.809941] [DEBUG] [MAIN ] UVV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:28.812722] [INFO ] [MAIN ] UVV: Generated 1820 derivative records from 22660 primary records. [2025-09-29T02:24:28.813143] [DEBUG] [LOCAL ] UVV: Saving derivative data. [2025-09-29T02:24:28.814002] [DEBUG] [LOCAL ] UVE: Derivative data saved (1820 records). [2025-09-29T02:24:28.815321] [INFO ] [MAIN ] UVE: Successfully saved derivative data. [2025-09-29T02:24:28.818148] [INFO ] [MAIN ] Derivative Progress: 2053/2211 symbols completed. UVE took 1.6s. Estimated remaining: 1m 7s. Rate: 141.3 symbols/min [2025-09-29T02:24:28.835682] [DEBUG] [LOCAL ] UVV: Derivative data saved (1820 records). [2025-09-29T02:24:28.837035] [INFO ] [MAIN ] UVV: Successfully saved derivative data. [2025-09-29T02:24:28.840482] [INFO ] [MAIN ] Derivative Progress: 2054/2211 symbols completed. UVV took 1.6s. Estimated remaining: 1m 7s. Rate: 141.3 symbols/min [2025-09-29T02:24:28.855943] [DEBUG] [MAIN ] UWMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:28.856747] [INFO ] [MAIN ] UWMC: Generated 1820 derivative records from 53516 primary records. [2025-09-29T02:24:28.856866] [DEBUG] [LOCAL ] UWMC: Saving derivative data. [2025-09-29T02:24:28.872575] [DEBUG] [LOCAL ] UWMC: Derivative data saved (1820 records). [2025-09-29T02:24:28.872747] [INFO ] [MAIN ] UWMC: Successfully saved derivative data. [2025-09-29T02:24:28.876197] [INFO ] [MAIN ] Derivative Progress: 2055/2211 symbols completed. UWMC took 1.6s. Estimated remaining: 1m 6s. Rate: 141.4 symbols/min [2025-09-29T02:24:28.876913] [INFO ] [MAIN ] UZD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:28.877109] [INFO ] [MAIN ] UZE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:28.877232] [INFO ] [MAIN ] UZF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:28.891221] [DEBUG] [LOCAL ] UZD: Loaded 6455 existing records from primary storage. [2025-09-29T02:24:28.891611] [INFO ] [MAIN ] UZD: Loaded 6455 primary data records. [2025-09-29T02:24:28.948354] [DEBUG] [LOCAL ] UZE: Loaded 7528 existing records from primary storage. [2025-09-29T02:24:28.991626] [DEBUG] [LOCAL ] UZF: Loaded 6574 existing records from primary storage. [2025-09-29T02:24:29.011777] [INFO ] [MAIN ] UZF: Loaded 6574 primary data records. [2025-09-29T02:24:28.997172] [INFO ] [MAIN ] UZE: Loaded 7528 primary data records. [2025-09-29T02:24:29.980000] [DEBUG] [MAIN ] UZD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:29.981749] [INFO ] [MAIN ] UZD: Generated 1820 derivative records from 6455 primary records. [2025-09-29T02:24:29.981998] [DEBUG] [LOCAL ] UZD: Saving derivative data. [2025-09-29T02:24:30.003889] [DEBUG] [LOCAL ] UZD: Derivative data saved (1820 records). [2025-09-29T02:24:30.005940] [INFO ] [MAIN ] UZD: Successfully saved derivative data. [2025-09-29T02:24:30.022699] [INFO ] [MAIN ] Derivative Progress: 2056/2211 symbols completed. UZD took 1.1s. Estimated remaining: 1m 6s. Rate: 141.3 symbols/min [2025-09-29T02:24:30.020212] [DEBUG] [MAIN ] UZF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:30.041320] [INFO ] [MAIN ] V: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:30.041889] [DEBUG] [MAIN ] UZE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:30.043561] [INFO ] [MAIN ] UZF: Generated 1820 derivative records from 6574 primary records. [2025-09-29T02:24:30.044309] [DEBUG] [LOCAL ] UZF: Saving derivative data. [2025-09-29T02:24:30.045454] [INFO ] [MAIN ] UZE: Generated 1820 derivative records from 7528 primary records. [2025-09-29T02:24:30.046566] [DEBUG] [LOCAL ] UZE: Saving derivative data. [2025-09-29T02:24:30.063065] [DEBUG] [LOCAL ] UZF: Derivative data saved (1820 records). [2025-09-29T02:24:30.080053] [INFO ] [MAIN ] UZF: Successfully saved derivative data. [2025-09-29T02:24:30.084002] [INFO ] [MAIN ] Derivative Progress: 2057/2211 symbols completed. UZF took 1.2s. Estimated remaining: 1m 5s. Rate: 141.4 symbols/min [2025-09-29T02:24:30.084721] [INFO ] [MAIN ] VAC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:30.092027] [DEBUG] [LOCAL ] UZE: Derivative data saved (1820 records). [2025-09-29T02:24:30.092462] [INFO ] [MAIN ] UZE: Successfully saved derivative data. [2025-09-29T02:24:30.095933] [INFO ] [MAIN ] Derivative Progress: 2058/2211 symbols completed. UZE took 1.2s. Estimated remaining: 1m 5s. Rate: 141.4 symbols/min [2025-09-29T02:24:30.096192] [INFO ] [MAIN ] VAL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:30.183067] [DEBUG] [LOCAL ] VAC: Loaded 35026 existing records from primary storage. [2025-09-29T02:24:30.183369] [INFO ] [MAIN ] VAC: Loaded 35026 primary data records. [2025-09-29T02:24:30.190790] [DEBUG] [LOCAL ] V: Loaded 54535 existing records from primary storage. [2025-09-29T02:24:30.191161] [INFO ] [MAIN ] V: Loaded 54535 primary data records. [2025-09-29T02:24:30.434057] [DEBUG] [LOCAL ] VAL: Loaded 51142 existing records from primary storage. [2025-09-29T02:24:30.475961] [INFO ] [MAIN ] VAL: Loaded 51142 primary data records. [2025-09-29T02:24:31.310746] [DEBUG] [MAIN ] VAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:31.325384] [INFO ] [MAIN ] VAC: Generated 1820 derivative records from 35026 primary records. [2025-09-29T02:24:31.325840] [DEBUG] [MAIN ] V: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:31.326551] [DEBUG] [LOCAL ] VAC: Saving derivative data. [2025-09-29T02:24:31.328978] [INFO ] [MAIN ] V: Generated 1820 derivative records from 54535 primary records. [2025-09-29T02:24:31.329508] [DEBUG] [LOCAL ] V: Saving derivative data. [2025-09-29T02:24:31.360692] [DEBUG] [LOCAL ] VAC: Derivative data saved (1820 records). [2025-09-29T02:24:31.366139] [INFO ] [MAIN ] VAC: Successfully saved derivative data. [2025-09-29T02:24:31.367340] [DEBUG] [LOCAL ] V: Derivative data saved (1820 records). [2025-09-29T02:24:31.370882] [INFO ] [MAIN ] V: Successfully saved derivative data. [2025-09-29T02:24:31.370565] [INFO ] [MAIN ] Derivative Progress: 2059/2211 symbols completed. VAC took 1.3s. Estimated remaining: 1m 5s. Rate: 141.3 symbols/min [2025-09-29T02:24:31.374677] [INFO ] [MAIN ] Derivative Progress: 2060/2211 symbols completed. V took 1.3s. Estimated remaining: 1m 4s. Rate: 141.3 symbols/min [2025-09-29T02:24:31.371173] [INFO ] [MAIN ] VALE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:31.375200] [INFO ] [MAIN ] VATE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:31.403030] [DEBUG] [LOCAL ] VATE: Loaded 5658 existing records from primary storage. [2025-09-29T02:24:31.403778] [DEBUG] [MAIN ] VAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:31.404038] [INFO ] [MAIN ] VATE: Loaded 5658 primary data records. [2025-09-29T02:24:31.404893] [INFO ] [MAIN ] VAL: Generated 1820 derivative records from 51142 primary records. [2025-09-29T02:24:31.405285] [DEBUG] [LOCAL ] VAL: Saving derivative data. [2025-09-29T02:24:31.576064] [DEBUG] [LOCAL ] VAL: Derivative data saved (1820 records). [2025-09-29T02:24:31.592012] [INFO ] [MAIN ] VAL: Successfully saved derivative data. [2025-09-29T02:24:31.635957] [INFO ] [MAIN ] Derivative Progress: 2061/2211 symbols completed. VAL took 1.5s. Estimated remaining: 1m 4s. Rate: 141.4 symbols/min [2025-09-29T02:24:31.661784] [INFO ] [MAIN ] VBF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:31.812788] [DEBUG] [LOCAL ] VALE: Loaded 54474 existing records from primary storage. [2025-09-29T02:24:31.814086] [INFO ] [MAIN ] VALE: Loaded 54474 primary data records. [2025-09-29T02:24:31.908802] [DEBUG] [LOCAL ] VBF: Loaded 7206 existing records from primary storage. [2025-09-29T02:24:31.939964] [INFO ] [MAIN ] VBF: Loaded 7206 primary data records. [2025-09-29T02:24:32.519167] [DEBUG] [MAIN ] VATE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:32.520457] [INFO ] [MAIN ] VATE: Generated 1820 derivative records from 5658 primary records. [2025-09-29T02:24:32.520781] [DEBUG] [LOCAL ] VATE: Saving derivative data. [2025-09-29T02:24:32.539919] [DEBUG] [LOCAL ] VATE: Derivative data saved (1820 records). [2025-09-29T02:24:32.542953] [INFO ] [MAIN ] VATE: Successfully saved derivative data. [2025-09-29T02:24:32.562303] [DEBUG] [MAIN ] VALE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:32.548516] [INFO ] [MAIN ] Derivative Progress: 2062/2211 symbols completed. VATE took 1.2s. Estimated remaining: 1m 3s. Rate: 141.3 symbols/min [2025-09-29T02:24:32.563848] [INFO ] [MAIN ] VALE: Generated 1820 derivative records from 54474 primary records. [2025-09-29T02:24:32.564034] [INFO ] [MAIN ] VCV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:32.564099] [DEBUG] [LOCAL ] VALE: Saving derivative data. [2025-09-29T02:24:32.583680] [DEBUG] [LOCAL ] VALE: Derivative data saved (1820 records). [2025-09-29T02:24:32.583972] [INFO ] [MAIN ] VALE: Successfully saved derivative data. [2025-09-29T02:24:32.587236] [INFO ] [MAIN ] Derivative Progress: 2063/2211 symbols completed. VALE took 1.2s. Estimated remaining: 1m 3s. Rate: 141.4 symbols/min [2025-09-29T02:24:32.587597] [INFO ] [MAIN ] VEEV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:32.602946] [DEBUG] [LOCAL ] VCV: Loaded 13766 existing records from primary storage. [2025-09-29T02:24:32.603240] [INFO ] [MAIN ] VCV: Loaded 13766 primary data records. [2025-09-29T02:24:32.659013] [DEBUG] [MAIN ] VBF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:32.700208] [INFO ] [MAIN ] VBF: Generated 1820 derivative records from 7206 primary records. [2025-09-29T02:24:32.738839] [DEBUG] [LOCAL ] VBF: Saving derivative data. [2025-09-29T02:24:32.827080] [DEBUG] [LOCAL ] VBF: Derivative data saved (1820 records). [2025-09-29T02:24:32.853394] [INFO ] [MAIN ] VBF: Successfully saved derivative data. [2025-09-29T02:24:32.863286] [INFO ] [MAIN ] Derivative Progress: 2064/2211 symbols completed. VBF took 1.2s. Estimated remaining: 1m 2s. Rate: 141.4 symbols/min [2025-09-29T02:24:32.991991] [INFO ] [MAIN ] VEL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:33.016381] [DEBUG] [LOCAL ] VEEV: Loaded 47821 existing records from primary storage. [2025-09-29T02:24:33.020182] [INFO ] [MAIN ] VEEV: Loaded 47821 primary data records. [2025-09-29T02:24:33.089422] [DEBUG] [LOCAL ] VEL: Loaded 13299 existing records from primary storage. [2025-09-29T02:24:33.106217] [INFO ] [MAIN ] VEL: Loaded 13299 primary data records. [2025-09-29T02:24:33.603731] [DEBUG] [MAIN ] VCV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:33.623573] [INFO ] [MAIN ] VCV: Generated 1820 derivative records from 13766 primary records. [2025-09-29T02:24:33.630563] [DEBUG] [LOCAL ] VCV: Saving derivative data. [2025-09-29T02:24:33.775220] [DEBUG] [LOCAL ] VCV: Derivative data saved (1820 records). [2025-09-29T02:24:33.776735] [INFO ] [MAIN ] VCV: Successfully saved derivative data. [2025-09-29T02:24:33.780024] [INFO ] [MAIN ] Derivative Progress: 2065/2211 symbols completed. VCV took 1.2s. Estimated remaining: 1m 2s. Rate: 141.3 symbols/min [2025-09-29T02:24:33.780665] [INFO ] [MAIN ] VET: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:33.804180] [DEBUG] [MAIN ] VEEV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:33.805160] [INFO ] [MAIN ] VEEV: Generated 1820 derivative records from 47821 primary records. [2025-09-29T02:24:33.805364] [DEBUG] [LOCAL ] VEEV: Saving derivative data. [2025-09-29T02:24:33.838518] [DEBUG] [MAIN ] VEL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:33.840141] [INFO ] [MAIN ] VEL: Generated 1820 derivative records from 13299 primary records. [2025-09-29T02:24:33.840387] [DEBUG] [LOCAL ] VEL: Saving derivative data. [2025-09-29T02:24:33.840226] [DEBUG] [LOCAL ] VEEV: Derivative data saved (1820 records). [2025-09-29T02:24:33.841075] [INFO ] [MAIN ] VEEV: Successfully saved derivative data. [2025-09-29T02:24:33.862022] [INFO ] [MAIN ] Derivative Progress: 2066/2211 symbols completed. VEEV took 1.3s. Estimated remaining: 1m 2s. Rate: 141.4 symbols/min [2025-09-29T02:24:33.866540] [INFO ] [MAIN ] VFC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:33.873014] [DEBUG] [LOCAL ] VEL: Derivative data saved (1820 records). [2025-09-29T02:24:33.873416] [INFO ] [MAIN ] VEL: Successfully saved derivative data. [2025-09-29T02:24:33.876417] [INFO ] [MAIN ] Derivative Progress: 2067/2211 symbols completed. VEL took 0.9s. Estimated remaining: 1m 1s. Rate: 141.4 symbols/min [2025-09-29T02:24:33.878345] [INFO ] [MAIN ] VGI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:33.898723] [DEBUG] [LOCAL ] VET: Loaded 44749 existing records from primary storage. [2025-09-29T02:24:33.899126] [INFO ] [MAIN ] VET: Loaded 44749 primary data records. [2025-09-29T02:24:34.018888] [DEBUG] [LOCAL ] VGI: Loaded 5237 existing records from primary storage. [2025-09-29T02:24:34.023768] [INFO ] [MAIN ] VGI: Loaded 5237 primary data records. [2025-09-29T02:24:34.613919] [DEBUG] [LOCAL ] VFC: Loaded 54390 existing records from primary storage. [2025-09-29T02:24:34.629023] [INFO ] [MAIN ] VFC: Loaded 54390 primary data records. [2025-09-29T02:24:34.997452] [DEBUG] [MAIN ] VET: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:35.001996] [INFO ] [MAIN ] VET: Generated 1820 derivative records from 44749 primary records. [2025-09-29T02:24:35.002420] [DEBUG] [LOCAL ] VET: Saving derivative data. [2025-09-29T02:24:35.027239] [DEBUG] [MAIN ] VGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:35.035094] [DEBUG] [LOCAL ] VET: Derivative data saved (1820 records). [2025-09-29T02:24:35.036009] [INFO ] [MAIN ] VGI: Generated 1820 derivative records from 5237 primary records. [2025-09-29T02:24:35.036106] [INFO ] [MAIN ] VET: Successfully saved derivative data. [2025-09-29T02:24:35.039367] [INFO ] [MAIN ] Derivative Progress: 2068/2211 symbols completed. VET took 1.3s. Estimated remaining: 1m 1s. Rate: 141.3 symbols/min [2025-09-29T02:24:35.036288] [DEBUG] [LOCAL ] VGI: Saving derivative data. [2025-09-29T02:24:35.055786] [DEBUG] [LOCAL ] VGI: Derivative data saved (1820 records). [2025-09-29T02:24:35.056049] [INFO ] [MAIN ] VGI: Successfully saved derivative data. [2025-09-29T02:24:35.058726] [INFO ] [MAIN ] Derivative Progress: 2069/2211 symbols completed. VGI took 1.2s. Estimated remaining: 1m 0s. Rate: 141.4 symbols/min [2025-09-29T02:24:35.076511] [DEBUG] [MAIN ] VFC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:35.077246] [INFO ] [MAIN ] VFC: Generated 1820 derivative records from 54390 primary records. [2025-09-29T02:24:35.077354] [DEBUG] [LOCAL ] VFC: Saving derivative data. [2025-09-29T02:24:35.094944] [DEBUG] [LOCAL ] VFC: Derivative data saved (1820 records). [2025-09-29T02:24:35.095033] [INFO ] [MAIN ] VFC: Successfully saved derivative data. [2025-09-29T02:24:35.098516] [INFO ] [MAIN ] Derivative Progress: 2070/2211 symbols completed. VFC took 1.2s. Estimated remaining: 59.8s. Rate: 141.4 symbols/min [2025-09-29T02:24:35.099034] [INFO ] [MAIN ] VICI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:35.098958] [INFO ] [MAIN ] VGM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:35.099240] [INFO ] [MAIN ] VHI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:35.106449] [DEBUG] [LOCAL ] VHI: Loaded 2905 existing records from primary storage. [2025-09-29T02:24:35.106753] [INFO ] [MAIN ] VHI: Loaded 2905 primary data records. [2025-09-29T02:24:35.234449] [DEBUG] [LOCAL ] VGM: Loaded 18384 existing records from primary storage. [2025-09-29T02:24:35.261273] [INFO ] [MAIN ] VGM: Loaded 18384 primary data records. [2025-09-29T02:24:35.713884] [DEBUG] [LOCAL ] VICI: Loaded 54427 existing records from primary storage. [2025-09-29T02:24:35.752977] [INFO ] [MAIN ] VICI: Loaded 54427 primary data records. [2025-09-29T02:24:36.267345] [DEBUG] [MAIN ] VHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:36.269215] [INFO ] [MAIN ] VHI: Generated 1820 derivative records from 2905 primary records. [2025-09-29T02:24:36.271126] [DEBUG] [LOCAL ] VHI: Saving derivative data. [2025-09-29T02:24:36.290940] [DEBUG] [LOCAL ] VHI: Derivative data saved (1820 records). [2025-09-29T02:24:36.300455] [INFO ] [MAIN ] VHI: Successfully saved derivative data. [2025-09-29T02:24:36.308003] [INFO ] [MAIN ] Derivative Progress: 2071/2211 symbols completed. VHI took 1.2s. Estimated remaining: 59.4s. Rate: 141.3 symbols/min [2025-09-29T02:24:36.308898] [INFO ] [MAIN ] VIK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:36.309252] [DEBUG] [MAIN ] VGM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:36.311153] [INFO ] [MAIN ] VGM: Generated 1820 derivative records from 18384 primary records. [2025-09-29T02:24:36.311478] [DEBUG] [LOCAL ] VGM: Saving derivative data. [2025-09-29T02:24:36.333991] [DEBUG] [LOCAL ] VGM: Derivative data saved (1820 records). [2025-09-29T02:24:36.335274] [INFO ] [MAIN ] VGM: Successfully saved derivative data. [2025-09-29T02:24:36.338693] [INFO ] [MAIN ] Derivative Progress: 2072/2211 symbols completed. VGM took 1.2s. Estimated remaining: 59.0s. Rate: 141.4 symbols/min [2025-09-29T02:24:36.346977] [INFO ] [MAIN ] VIPS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:36.353062] [DEBUG] [MAIN ] VICI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:36.354501] [INFO ] [MAIN ] VICI: Generated 1820 derivative records from 54427 primary records. [2025-09-29T02:24:36.354714] [DEBUG] [LOCAL ] VICI: Saving derivative data. [2025-09-29T02:24:36.376698] [DEBUG] [LOCAL ] VICI: Derivative data saved (1820 records). [2025-09-29T02:24:36.376923] [INFO ] [MAIN ] VICI: Successfully saved derivative data. [2025-09-29T02:24:36.379875] [INFO ] [MAIN ] Derivative Progress: 2073/2211 symbols completed. VICI took 1.3s. Estimated remaining: 58.5s. Rate: 141.4 symbols/min [2025-09-29T02:24:36.380197] [INFO ] [MAIN ] VIRT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:36.421914] [DEBUG] [LOCAL ] VIK: Loaded 53250 existing records from primary storage. [2025-09-29T02:24:36.422340] [INFO ] [MAIN ] VIK: Loaded 53250 primary data records. [2025-09-29T02:24:36.662465] [DEBUG] [LOCAL ] VIPS: Loaded 52093 existing records from primary storage. [2025-09-29T02:24:36.804627] [INFO ] [MAIN ] VIPS: Loaded 52093 primary data records. [2025-09-29T02:24:36.799364] [DEBUG] [LOCAL ] VIRT: Loaded 47448 existing records from primary storage. [2025-09-29T02:24:36.814515] [INFO ] [MAIN ] VIRT: Loaded 47448 primary data records. [2025-09-29T02:24:37.570161] [DEBUG] [MAIN ] VIK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:37.571260] [INFO ] [MAIN ] VIK: Generated 1820 derivative records from 53250 primary records. [2025-09-29T02:24:37.571383] [DEBUG] [LOCAL ] VIK: Saving derivative data. [2025-09-29T02:24:37.591534] [DEBUG] [LOCAL ] VIK: Derivative data saved (1820 records). [2025-09-29T02:24:37.592029] [INFO ] [MAIN ] VIK: Successfully saved derivative data. [2025-09-29T02:24:37.595209] [INFO ] [MAIN ] Derivative Progress: 2074/2211 symbols completed. VIK took 1.3s. Estimated remaining: 58.2s. Rate: 141.3 symbols/min [2025-09-29T02:24:37.595790] [INFO ] [MAIN ] VIST: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:37.615583] [DEBUG] [MAIN ] VIPS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:37.618336] [INFO ] [MAIN ] VIPS: Generated 1820 derivative records from 52093 primary records. [2025-09-29T02:24:37.619330] [DEBUG] [LOCAL ] VIPS: Saving derivative data. [2025-09-29T02:24:37.642692] [DEBUG] [MAIN ] VIRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:37.648966] [INFO ] [MAIN ] VIRT: Generated 1820 derivative records from 47448 primary records. [2025-09-29T02:24:37.651866] [DEBUG] [LOCAL ] VIRT: Saving derivative data. [2025-09-29T02:24:37.653425] [DEBUG] [LOCAL ] VIPS: Derivative data saved (1820 records). [2025-09-29T02:24:37.653973] [INFO ] [MAIN ] VIPS: Successfully saved derivative data. [2025-09-29T02:24:37.658100] [INFO ] [MAIN ] Derivative Progress: 2075/2211 symbols completed. VIPS took 1.3s. Estimated remaining: 57.7s. Rate: 141.4 symbols/min [2025-09-29T02:24:37.665858] [INFO ] [MAIN ] VIV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:37.688025] [DEBUG] [LOCAL ] VIRT: Derivative data saved (1820 records). [2025-09-29T02:24:37.688310] [INFO ] [MAIN ] VIRT: Successfully saved derivative data. [2025-09-29T02:24:37.691033] [INFO ] [MAIN ] Derivative Progress: 2076/2211 symbols completed. VIRT took 1.3s. Estimated remaining: 57.3s. Rate: 141.4 symbols/min [2025-09-29T02:24:37.691409] [INFO ] [MAIN ] VKQ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:37.716418] [DEBUG] [LOCAL ] VIST: Loaded 46722 existing records from primary storage. [2025-09-29T02:24:37.716851] [INFO ] [MAIN ] VIST: Loaded 46722 primary data records. [2025-09-29T02:24:37.843265] [DEBUG] [LOCAL ] VKQ: Loaded 17552 existing records from primary storage. [2025-09-29T02:24:37.857316] [INFO ] [MAIN ] VKQ: Loaded 17552 primary data records. [2025-09-29T02:24:38.190914] [DEBUG] [LOCAL ] VIV: Loaded 45667 existing records from primary storage. [2025-09-29T02:24:38.204888] [INFO ] [MAIN ] VIV: Loaded 45667 primary data records. [2025-09-29T02:24:38.795117] [DEBUG] [MAIN ] VIST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:38.797253] [INFO ] [MAIN ] VIST: Generated 1820 derivative records from 46722 primary records. [2025-09-29T02:24:38.798008] [DEBUG] [LOCAL ] VIST: Saving derivative data. [2025-09-29T02:24:38.818684] [DEBUG] [LOCAL ] VIST: Derivative data saved (1820 records). [2025-09-29T02:24:38.820975] [INFO ] [MAIN ] VIST: Successfully saved derivative data. [2025-09-29T02:24:38.824045] [INFO ] [MAIN ] Derivative Progress: 2077/2211 symbols completed. VIST took 1.2s. Estimated remaining: 56.9s. Rate: 141.3 symbols/min [2025-09-29T02:24:38.824584] [INFO ] [MAIN ] VLN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:38.839610] [DEBUG] [MAIN ] VKQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:38.841050] [INFO ] [MAIN ] VKQ: Generated 1820 derivative records from 17552 primary records. [2025-09-29T02:24:38.841363] [DEBUG] [LOCAL ] VKQ: Saving derivative data. [2025-09-29T02:24:38.859086] [DEBUG] [LOCAL ] VKQ: Derivative data saved (1820 records). [2025-09-29T02:24:38.860098] [INFO ] [MAIN ] VKQ: Successfully saved derivative data. [2025-09-29T02:24:38.863575] [INFO ] [MAIN ] Derivative Progress: 2078/2211 symbols completed. VKQ took 1.2s. Estimated remaining: 56.4s. Rate: 141.4 symbols/min [2025-09-29T02:24:38.872028] [INFO ] [MAIN ] VLO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:38.886506] [DEBUG] [MAIN ] VIV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:38.887585] [INFO ] [MAIN ] VIV: Generated 1820 derivative records from 45667 primary records. [2025-09-29T02:24:38.897848] [DEBUG] [LOCAL ] VIV: Saving derivative data. [2025-09-29T02:24:38.899505] [DEBUG] [LOCAL ] VLN: Loaded 29056 existing records from primary storage. [2025-09-29T02:24:38.899999] [INFO ] [MAIN ] VLN: Loaded 29056 primary data records. [2025-09-29T02:24:39.013950] [DEBUG] [LOCAL ] VIV: Derivative data saved (1820 records). [2025-09-29T02:24:39.033738] [INFO ] [MAIN ] VIV: Successfully saved derivative data. [2025-09-29T02:24:39.036771] [INFO ] [MAIN ] Derivative Progress: 2079/2211 symbols completed. VIV took 1.4s. Estimated remaining: 56.0s. Rate: 141.4 symbols/min [2025-09-29T02:24:39.058274] [INFO ] [MAIN ] VLRS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:39.288133] [DEBUG] [LOCAL ] VLO: Loaded 53865 existing records from primary storage. [2025-09-29T02:24:39.288905] [INFO ] [MAIN ] VLO: Loaded 53865 primary data records. [2025-09-29T02:24:39.500618] [DEBUG] [MAIN ] VLN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:39.657524] [INFO ] [MAIN ] VLN: Generated 1820 derivative records from 29056 primary records. [2025-09-29T02:24:39.656431] [DEBUG] [LOCAL ] VLRS: Loaded 41188 existing records from primary storage. [2025-09-29T02:24:39.658630] [INFO ] [MAIN ] VLRS: Loaded 41188 primary data records. [2025-09-29T02:24:39.658510] [DEBUG] [LOCAL ] VLN: Saving derivative data. [2025-09-29T02:24:39.797025] [DEBUG] [LOCAL ] VLN: Derivative data saved (1820 records). [2025-09-29T02:24:39.803289] [INFO ] [MAIN ] VLN: Successfully saved derivative data. [2025-09-29T02:24:39.821191] [INFO ] [MAIN ] Derivative Progress: 2080/2211 symbols completed. VLN took 1.0s. Estimated remaining: 55.6s. Rate: 141.4 symbols/min [2025-09-29T02:24:39.919496] [INFO ] [MAIN ] VLT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:40.054207] [DEBUG] [LOCAL ] VLT: Loaded 4615 existing records from primary storage. [2025-09-29T02:24:40.054820] [INFO ] [MAIN ] VLT: Loaded 4615 primary data records. [2025-09-29T02:24:40.205071] [DEBUG] [MAIN ] VLO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:40.256435] [INFO ] [MAIN ] VLO: Generated 1820 derivative records from 53865 primary records. [2025-09-29T02:24:40.276784] [DEBUG] [LOCAL ] VLO: Saving derivative data. [2025-09-29T02:24:40.423555] [DEBUG] [LOCAL ] VLO: Derivative data saved (1820 records). [2025-09-29T02:24:40.424847] [INFO ] [MAIN ] VLO: Successfully saved derivative data. [2025-09-29T02:24:40.428142] [INFO ] [MAIN ] Derivative Progress: 2081/2211 symbols completed. VLO took 1.6s. Estimated remaining: 55.2s. Rate: 141.3 symbols/min [2025-09-29T02:24:40.428410] [INFO ] [MAIN ] VLTO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:40.447296] [DEBUG] [MAIN ] VLRS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:40.448203] [INFO ] [MAIN ] VLRS: Generated 1820 derivative records from 41188 primary records. [2025-09-29T02:24:40.448452] [DEBUG] [LOCAL ] VLRS: Saving derivative data. [2025-09-29T02:24:40.466186] [DEBUG] [LOCAL ] VLRS: Derivative data saved (1820 records). [2025-09-29T02:24:40.466784] [INFO ] [MAIN ] VLRS: Successfully saved derivative data. [2025-09-29T02:24:40.469542] [INFO ] [MAIN ] Derivative Progress: 2082/2211 symbols completed. VLRS took 1.4s. Estimated remaining: 54.7s. Rate: 141.4 symbols/min [2025-09-29T02:24:40.470130] [INFO ] [MAIN ] VMC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:40.488541] [DEBUG] [MAIN ] VLT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:40.489443] [INFO ] [MAIN ] VLT: Generated 1820 derivative records from 4615 primary records. [2025-09-29T02:24:40.489554] [DEBUG] [LOCAL ] VLT: Saving derivative data. [2025-09-29T02:24:40.518132] [DEBUG] [LOCAL ] VLT: Derivative data saved (1820 records). [2025-09-29T02:24:40.518347] [INFO ] [MAIN ] VLT: Successfully saved derivative data. [2025-09-29T02:24:40.521006] [INFO ] [MAIN ] Derivative Progress: 2083/2211 symbols completed. VLT took 0.6s. Estimated remaining: 54.3s. Rate: 141.4 symbols/min [2025-09-29T02:24:40.538514] [DEBUG] [LOCAL ] VLTO: Loaded 46710 existing records from primary storage. [2025-09-29T02:24:40.538737] [INFO ] [MAIN ] VLTO: Loaded 46710 primary data records. [2025-09-29T02:24:40.760142] [DEBUG] [LOCAL ] VMC: Loaded 44263 existing records from primary storage. [2025-09-29T02:24:40.760400] [INFO ] [MAIN ] VMC: Loaded 44263 primary data records. [2025-09-29T02:24:41.240214] [DEBUG] [MAIN ] VLTO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:41.241950] [INFO ] [MAIN ] VLTO: Generated 1820 derivative records from 46710 primary records. [2025-09-29T02:24:41.242063] [DEBUG] [LOCAL ] VLTO: Saving derivative data. [2025-09-29T02:24:41.260145] [DEBUG] [LOCAL ] VLTO: Derivative data saved (1820 records). [2025-09-29T02:24:41.260590] [INFO ] [MAIN ] VLTO: Successfully saved derivative data. [2025-09-29T02:24:41.263639] [INFO ] [MAIN ] Derivative Progress: 2084/2211 symbols completed. VLTO took 0.8s. Estimated remaining: 53.9s. Rate: 141.4 symbols/min [2025-09-29T02:24:41.284804] [DEBUG] [MAIN ] VMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:41.285612] [INFO ] [MAIN ] VMC: Generated 1820 derivative records from 44263 primary records. [2025-09-29T02:24:41.285739] [DEBUG] [LOCAL ] VMC: Saving derivative data. [2025-09-29T02:24:41.306452] [DEBUG] [LOCAL ] VMC: Derivative data saved (1820 records). [2025-09-29T02:24:41.306691] [INFO ] [MAIN ] VMC: Successfully saved derivative data. [2025-09-29T02:24:41.310598] [INFO ] [MAIN ] Derivative Progress: 2085/2211 symbols completed. VMC took 0.8s. Estimated remaining: 53.4s. Rate: 141.5 symbols/min [2025-09-29T02:24:41.311393] [INFO ] [MAIN ] VNCE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:41.311533] [INFO ] [MAIN ] VMO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:41.311240] [INFO ] [MAIN ] VMI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:41.334553] [DEBUG] [LOCAL ] VMI: Loaded 15711 existing records from primary storage. [2025-09-29T02:24:41.341186] [INFO ] [MAIN ] VMI: Loaded 15711 primary data records. [2025-09-29T02:24:41.349399] [DEBUG] [LOCAL ] VNCE: Loaded 7593 existing records from primary storage. [2025-09-29T02:24:41.373179] [INFO ] [MAIN ] VNCE: Loaded 7593 primary data records. [2025-09-29T02:24:41.556625] [DEBUG] [LOCAL ] VMO: Loaded 21297 existing records from primary storage. [2025-09-29T02:24:41.572490] [INFO ] [MAIN ] VMO: Loaded 21297 primary data records. [2025-09-29T02:24:42.489378] [DEBUG] [MAIN ] VMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:42.491375] [INFO ] [MAIN ] VMI: Generated 1820 derivative records from 15711 primary records. [2025-09-29T02:24:42.491829] [DEBUG] [LOCAL ] VMI: Saving derivative data. [2025-09-29T02:24:42.518487] [DEBUG] [MAIN ] VNCE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:42.524102] [DEBUG] [LOCAL ] VMI: Derivative data saved (1820 records). [2025-09-29T02:24:42.524321] [INFO ] [MAIN ] VMI: Successfully saved derivative data. [2025-09-29T02:24:42.523404] [INFO ] [MAIN ] VNCE: Generated 1820 derivative records from 7593 primary records. [2025-09-29T02:24:42.527233] [DEBUG] [LOCAL ] VNCE: Saving derivative data. [2025-09-29T02:24:42.527101] [INFO ] [MAIN ] Derivative Progress: 2086/2211 symbols completed. VMI took 1.2s. Estimated remaining: 53.1s. Rate: 141.3 symbols/min [2025-09-29T02:24:42.538371] [INFO ] [MAIN ] VNO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:42.563068] [DEBUG] [LOCAL ] VNCE: Derivative data saved (1820 records). [2025-09-29T02:24:42.563446] [DEBUG] [MAIN ] VMO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:42.564995] [INFO ] [MAIN ] VMO: Generated 1820 derivative records from 21297 primary records. [2025-09-29T02:24:42.564070] [INFO ] [MAIN ] VNCE: Successfully saved derivative data. [2025-09-29T02:24:42.565330] [DEBUG] [LOCAL ] VMO: Saving derivative data. [2025-09-29T02:24:42.568810] [INFO ] [MAIN ] Derivative Progress: 2087/2211 symbols completed. VNCE took 1.3s. Estimated remaining: 52.6s. Rate: 141.4 symbols/min [2025-09-29T02:24:42.571559] [INFO ] [MAIN ] VNT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:42.588676] [DEBUG] [LOCAL ] VMO: Derivative data saved (1820 records). [2025-09-29T02:24:42.588844] [INFO ] [MAIN ] VMO: Successfully saved derivative data. [2025-09-29T02:24:42.591763] [INFO ] [MAIN ] Derivative Progress: 2088/2211 symbols completed. VMO took 1.3s. Estimated remaining: 52.2s. Rate: 141.5 symbols/min [2025-09-29T02:24:42.592094] [INFO ] [MAIN ] VOC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:42.605407] [DEBUG] [LOCAL ] VOC: Loaded 9021 existing records from primary storage. [2025-09-29T02:24:42.605687] [INFO ] [MAIN ] VOC: Loaded 9021 primary data records. [2025-09-29T02:24:42.803593] [DEBUG] [LOCAL ] VNO: Loaded 49668 existing records from primary storage. [2025-09-29T02:24:42.856302] [INFO ] [MAIN ] VNO: Loaded 49668 primary data records. [2025-09-29T02:24:42.995903] [DEBUG] [LOCAL ] VNT: Loaded 44451 existing records from primary storage. [2025-09-29T02:24:43.041908] [INFO ] [MAIN ] VNT: Loaded 44451 primary data records. [2025-09-29T02:24:43.733075] [DEBUG] [MAIN ] VOC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:43.734907] [INFO ] [MAIN ] VOC: Generated 1820 derivative records from 9021 primary records. [2025-09-29T02:24:43.735461] [DEBUG] [LOCAL ] VOC: Saving derivative data. [2025-09-29T02:24:43.755684] [DEBUG] [LOCAL ] VOC: Derivative data saved (1820 records). [2025-09-29T02:24:43.755904] [INFO ] [MAIN ] VOC: Successfully saved derivative data. [2025-09-29T02:24:43.758442] [INFO ] [MAIN ] Derivative Progress: 2089/2211 symbols completed. VOC took 1.2s. Estimated remaining: 51.8s. Rate: 141.3 symbols/min [2025-09-29T02:24:43.758738] [INFO ] [MAIN ] VOYA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:43.778178] [DEBUG] [MAIN ] VNO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:43.779316] [INFO ] [MAIN ] VNO: Generated 1820 derivative records from 49668 primary records. [2025-09-29T02:24:43.780008] [DEBUG] [LOCAL ] VNO: Saving derivative data. [2025-09-29T02:24:43.804419] [DEBUG] [LOCAL ] VNO: Derivative data saved (1820 records). [2025-09-29T02:24:43.805485] [INFO ] [MAIN ] VNO: Successfully saved derivative data. [2025-09-29T02:24:43.809341] [INFO ] [MAIN ] Derivative Progress: 2090/2211 symbols completed. VNO took 1.3s. Estimated remaining: 51.3s. Rate: 141.4 symbols/min [2025-09-29T02:24:43.817588] [INFO ] [MAIN ] VPG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:43.823757] [DEBUG] [MAIN ] VNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:43.824805] [INFO ] [MAIN ] VNT: Generated 1820 derivative records from 44451 primary records. [2025-09-29T02:24:43.824974] [DEBUG] [LOCAL ] VNT: Saving derivative data. [2025-09-29T02:24:43.869001] [DEBUG] [LOCAL ] VNT: Derivative data saved (1820 records). [2025-09-29T02:24:43.870283] [INFO ] [MAIN ] VNT: Successfully saved derivative data. [2025-09-29T02:24:43.874552] [DEBUG] [LOCAL ] VOYA: Loaded 43377 existing records from primary storage. [2025-09-29T02:24:43.873266] [INFO ] [MAIN ] Derivative Progress: 2091/2211 symbols completed. VNT took 1.3s. Estimated remaining: 50.9s. Rate: 141.5 symbols/min [2025-09-29T02:24:43.874818] [INFO ] [MAIN ] VOYA: Loaded 43377 primary data records. [2025-09-29T02:24:43.874928] [INFO ] [MAIN ] VPV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:43.929945] [DEBUG] [LOCAL ] VPG: Loaded 17373 existing records from primary storage. [2025-09-29T02:24:43.954830] [INFO ] [MAIN ] VPG: Loaded 17373 primary data records. [2025-09-29T02:24:43.998508] [DEBUG] [LOCAL ] VPV: Loaded 5429 existing records from primary storage. [2025-09-29T02:24:44.050977] [INFO ] [MAIN ] VPV: Loaded 5429 primary data records. [2025-09-29T02:24:44.970244] [DEBUG] [MAIN ] VOYA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:44.971909] [INFO ] [MAIN ] VOYA: Generated 1820 derivative records from 43377 primary records. [2025-09-29T02:24:44.979871] [DEBUG] [LOCAL ] VOYA: Saving derivative data. [2025-09-29T02:24:44.985983] [DEBUG] [MAIN ] VPG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:44.995973] [INFO ] [MAIN ] VPG: Generated 1820 derivative records from 17373 primary records. [2025-09-29T02:24:44.998755] [DEBUG] [LOCAL ] VPG: Saving derivative data. [2025-09-29T02:24:45.004010] [DEBUG] [LOCAL ] VOYA: Derivative data saved (1820 records). [2025-09-29T02:24:45.004154] [INFO ] [MAIN ] VOYA: Successfully saved derivative data. [2025-09-29T02:24:45.008127] [INFO ] [MAIN ] Derivative Progress: 2092/2211 symbols completed. VOYA took 1.2s. Estimated remaining: 50.5s. Rate: 141.3 symbols/min [2025-09-29T02:24:45.008747] [INFO ] [MAIN ] VRE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:45.035819] [DEBUG] [MAIN ] VPV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:45.040136] [INFO ] [MAIN ] VPV: Generated 1820 derivative records from 5429 primary records. [2025-09-29T02:24:45.041394] [DEBUG] [LOCAL ] VPG: Derivative data saved (1820 records). [2025-09-29T02:24:45.041606] [INFO ] [MAIN ] VPG: Successfully saved derivative data. [2025-09-29T02:24:45.041476] [DEBUG] [LOCAL ] VPV: Saving derivative data. [2025-09-29T02:24:45.044423] [INFO ] [MAIN ] Derivative Progress: 2093/2211 symbols completed. VPG took 1.2s. Estimated remaining: 50.1s. Rate: 141.4 symbols/min [2025-09-29T02:24:45.044702] [INFO ] [MAIN ] VRT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:45.074051] [DEBUG] [LOCAL ] VPV: Derivative data saved (1820 records). [2025-09-29T02:24:45.074360] [INFO ] [MAIN ] VPV: Successfully saved derivative data. [2025-09-29T02:24:45.077994] [INFO ] [MAIN ] Derivative Progress: 2094/2211 symbols completed. VPV took 1.2s. Estimated remaining: 49.6s. Rate: 141.5 symbols/min [2025-09-29T02:24:45.078567] [INFO ] [MAIN ] VRTS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:45.099537] [DEBUG] [LOCAL ] VRE: Loaded 35345 existing records from primary storage. [2025-09-29T02:24:45.101672] [INFO ] [MAIN ] VRE: Loaded 35345 primary data records. [2025-09-29T02:24:45.163827] [DEBUG] [LOCAL ] VRTS: Loaded 9287 existing records from primary storage. [2025-09-29T02:24:45.211740] [INFO ] [MAIN ] VRTS: Loaded 9287 primary data records. [2025-09-29T02:24:45.500861] [DEBUG] [LOCAL ] VRT: Loaded 54533 existing records from primary storage. [2025-09-29T02:24:45.570259] [INFO ] [MAIN ] VRT: Loaded 54533 primary data records. [2025-09-29T02:24:46.237097] [DEBUG] [MAIN ] VRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:46.238559] [INFO ] [MAIN ] VRE: Generated 1820 derivative records from 35345 primary records. [2025-09-29T02:24:46.239063] [DEBUG] [LOCAL ] VRE: Saving derivative data. [2025-09-29T02:24:46.259562] [DEBUG] [LOCAL ] VRE: Derivative data saved (1820 records). [2025-09-29T02:24:46.267887] [INFO ] [MAIN ] VRE: Successfully saved derivative data. [2025-09-29T02:24:46.271015] [INFO ] [MAIN ] Derivative Progress: 2095/2211 symbols completed. VRE took 1.3s. Estimated remaining: 49.2s. Rate: 141.3 symbols/min [2025-09-29T02:24:46.276615] [INFO ] [MAIN ] VSCO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:46.276969] [DEBUG] [MAIN ] VRTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:46.279532] [INFO ] [MAIN ] VRTS: Generated 1820 derivative records from 9287 primary records. [2025-09-29T02:24:46.279763] [DEBUG] [LOCAL ] VRTS: Saving derivative data. [2025-09-29T02:24:46.311025] [DEBUG] [MAIN ] VRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:46.312316] [DEBUG] [LOCAL ] VRTS: Derivative data saved (1820 records). [2025-09-29T02:24:46.313374] [INFO ] [MAIN ] VRT: Generated 1820 derivative records from 54533 primary records. [2025-09-29T02:24:46.313511] [INFO ] [MAIN ] VRTS: Successfully saved derivative data. [2025-09-29T02:24:46.313717] [DEBUG] [LOCAL ] VRT: Saving derivative data. [2025-09-29T02:24:46.316612] [INFO ] [MAIN ] Derivative Progress: 2096/2211 symbols completed. VRTS took 1.2s. Estimated remaining: 48.8s. Rate: 141.4 symbols/min [2025-09-29T02:24:46.316975] [INFO ] [MAIN ] VSH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:46.336794] [DEBUG] [LOCAL ] VRT: Derivative data saved (1820 records). [2025-09-29T02:24:46.337167] [INFO ] [MAIN ] VRT: Successfully saved derivative data. [2025-09-29T02:24:46.339918] [INFO ] [MAIN ] Derivative Progress: 2097/2211 symbols completed. VRT took 1.3s. Estimated remaining: 48.4s. Rate: 141.5 symbols/min [2025-09-29T02:24:46.340157] [INFO ] [MAIN ] VST: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:46.398519] [DEBUG] [LOCAL ] VSCO: Loaded 53556 existing records from primary storage. [2025-09-29T02:24:46.399058] [INFO ] [MAIN ] VSCO: Loaded 53556 primary data records. [2025-09-29T02:24:46.520244] [DEBUG] [LOCAL ] VSH: Loaded 49188 existing records from primary storage. [2025-09-29T02:24:46.533949] [INFO ] [MAIN ] VSH: Loaded 49188 primary data records. [2025-09-29T02:24:46.766438] [DEBUG] [LOCAL ] VST: Loaded 54498 existing records from primary storage. [2025-09-29T02:24:46.911850] [INFO ] [MAIN ] VST: Loaded 54498 primary data records. [2025-09-29T02:24:47.492504] [DEBUG] [MAIN ] VSCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:47.494003] [INFO ] [MAIN ] VSCO: Generated 1820 derivative records from 53556 primary records. [2025-09-29T02:24:47.494403] [DEBUG] [LOCAL ] VSCO: Saving derivative data. [2025-09-29T02:24:47.516142] [DEBUG] [LOCAL ] VSCO: Derivative data saved (1820 records). [2025-09-29T02:24:47.519261] [INFO ] [MAIN ] VSCO: Successfully saved derivative data. [2025-09-29T02:24:47.523674] [INFO ] [MAIN ] Derivative Progress: 2098/2211 symbols completed. VSCO took 1.2s. Estimated remaining: 48.0s. Rate: 141.3 symbols/min [2025-09-29T02:24:47.538766] [DEBUG] [MAIN ] VSH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:47.539574] [INFO ] [MAIN ] VSH: Generated 1820 derivative records from 49188 primary records. [2025-09-29T02:24:47.539713] [DEBUG] [LOCAL ] VSH: Saving derivative data. [2025-09-29T02:24:47.560737] [DEBUG] [LOCAL ] VSH: Derivative data saved (1820 records). [2025-09-29T02:24:47.560884] [INFO ] [MAIN ] VSH: Successfully saved derivative data. [2025-09-29T02:24:47.564230] [INFO ] [MAIN ] Derivative Progress: 2099/2211 symbols completed. VSH took 1.2s. Estimated remaining: 47.5s. Rate: 141.4 symbols/min [2025-09-29T02:24:47.578624] [DEBUG] [MAIN ] VST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:47.579477] [INFO ] [MAIN ] VST: Generated 1820 derivative records from 54498 primary records. [2025-09-29T02:24:47.579570] [DEBUG] [LOCAL ] VST: Saving derivative data. [2025-09-29T02:24:47.596281] [DEBUG] [LOCAL ] VST: Derivative data saved (1820 records). [2025-09-29T02:24:47.596422] [INFO ] [MAIN ] VST: Successfully saved derivative data. [2025-09-29T02:24:47.599453] [INFO ] [MAIN ] Derivative Progress: 2100/2211 symbols completed. VST took 1.3s. Estimated remaining: 47.1s. Rate: 141.5 symbols/min [2025-09-29T02:24:47.600217] [INFO ] [MAIN ] VSTS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:47.600385] [INFO ] [MAIN ] VTEX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:47.600553] [INFO ] [MAIN ] VTLE: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:47.664360] [DEBUG] [LOCAL ] VTEX: Loaded 43948 existing records from primary storage. [2025-09-29T02:24:47.677604] [INFO ] [MAIN ] VTEX: Loaded 43948 primary data records. [2025-09-29T02:24:47.752825] [DEBUG] [LOCAL ] VSTS: Loaded 49773 existing records from primary storage. [2025-09-29T02:24:47.794799] [INFO ] [MAIN ] VSTS: Loaded 49773 primary data records. [2025-09-29T02:24:47.899808] [DEBUG] [LOCAL ] VTLE: Loaded 49337 existing records from primary storage. [2025-09-29T02:24:47.941442] [INFO ] [MAIN ] VTLE: Loaded 49337 primary data records. [2025-09-29T02:24:48.814188] [DEBUG] [MAIN ] VTEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:48.815691] [INFO ] [MAIN ] VTEX: Generated 1820 derivative records from 43948 primary records. [2025-09-29T02:24:48.815926] [DEBUG] [LOCAL ] VTEX: Saving derivative data. [2025-09-29T02:24:48.839483] [DEBUG] [LOCAL ] VTEX: Derivative data saved (1820 records). [2025-09-29T02:24:48.840623] [INFO ] [MAIN ] VTEX: Successfully saved derivative data. [2025-09-29T02:24:48.857918] [INFO ] [MAIN ] Derivative Progress: 2101/2211 symbols completed. VTEX took 1.3s. Estimated remaining: 46.7s. Rate: 141.3 symbols/min [2025-09-29T02:24:48.854850] [DEBUG] [MAIN ] VSTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:48.858796] [INFO ] [MAIN ] VTMX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:48.860551] [INFO ] [MAIN ] VSTS: Generated 1820 derivative records from 49773 primary records. [2025-09-29T02:24:48.860701] [DEBUG] [LOCAL ] VSTS: Saving derivative data. [2025-09-29T02:24:48.881832] [DEBUG] [LOCAL ] VSTS: Derivative data saved (1820 records). [2025-09-29T02:24:48.890725] [INFO ] [MAIN ] VSTS: Successfully saved derivative data. [2025-09-29T02:24:48.898855] [INFO ] [MAIN ] Derivative Progress: 2102/2211 symbols completed. VSTS took 1.3s. Estimated remaining: 46.3s. Rate: 141.4 symbols/min [2025-09-29T02:24:48.899734] [INFO ] [MAIN ] VTN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:48.899608] [DEBUG] [MAIN ] VTLE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:48.901036] [INFO ] [MAIN ] VTLE: Generated 1820 derivative records from 49337 primary records. [2025-09-29T02:24:48.906166] [DEBUG] [LOCAL ] VTLE: Saving derivative data. [2025-09-29T02:24:48.930131] [DEBUG] [LOCAL ] VTMX: Loaded 17811 existing records from primary storage. [2025-09-29T02:24:48.934546] [DEBUG] [LOCAL ] VTN: Loaded 7293 existing records from primary storage. [2025-09-29T02:24:48.935308] [INFO ] [MAIN ] VTN: Loaded 7293 primary data records. [2025-09-29T02:24:48.935141] [INFO ] [MAIN ] VTMX: Loaded 17811 primary data records. [2025-09-29T02:24:48.994094] [DEBUG] [LOCAL ] VTLE: Derivative data saved (1820 records). [2025-09-29T02:24:49.023906] [INFO ] [MAIN ] VTLE: Successfully saved derivative data. [2025-09-29T02:24:49.095275] [INFO ] [MAIN ] Derivative Progress: 2103/2211 symbols completed. VTLE took 1.5s. Estimated remaining: 45.8s. Rate: 141.4 symbols/min [2025-09-29T02:24:49.122723] [INFO ] [MAIN ] VTOL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:49.634121] [DEBUG] [LOCAL ] VTOL: Loaded 19915 existing records from primary storage. [2025-09-29T02:24:49.634483] [INFO ] [MAIN ] VTOL: Loaded 19915 primary data records. [2025-09-29T02:24:50.012709] [DEBUG] [MAIN ] VTMX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:50.018125] [DEBUG] [MAIN ] VTN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:50.019063] [INFO ] [MAIN ] VTN: Generated 1820 derivative records from 7293 primary records. [2025-09-29T02:24:50.019948] [INFO ] [MAIN ] VTMX: Generated 1820 derivative records from 17811 primary records. [2025-09-29T02:24:50.019274] [DEBUG] [LOCAL ] VTN: Saving derivative data. [2025-09-29T02:24:50.030583] [DEBUG] [LOCAL ] VTMX: Saving derivative data. [2025-09-29T02:24:50.055228] [DEBUG] [LOCAL ] VTMX: Derivative data saved (1820 records). [2025-09-29T02:24:50.054073] [DEBUG] [LOCAL ] VTN: Derivative data saved (1820 records). [2025-09-29T02:24:50.055875] [INFO ] [MAIN ] VTN: Successfully saved derivative data. [2025-09-29T02:24:50.058359] [INFO ] [MAIN ] Derivative Progress: 2104/2211 symbols completed. VTN took 1.2s. Estimated remaining: 45.4s. Rate: 141.3 symbols/min [2025-09-29T02:24:50.058686] [INFO ] [MAIN ] VTR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:50.059005] [INFO ] [MAIN ] VTMX: Successfully saved derivative data. [2025-09-29T02:24:50.061735] [INFO ] [MAIN ] Derivative Progress: 2105/2211 symbols completed. VTMX took 1.2s. Estimated remaining: 45.0s. Rate: 141.4 symbols/min [2025-09-29T02:24:50.062612] [INFO ] [MAIN ] VTS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:50.081937] [DEBUG] [MAIN ] VTOL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:50.082972] [INFO ] [MAIN ] VTOL: Generated 1820 derivative records from 19915 primary records. [2025-09-29T02:24:50.083313] [DEBUG] [LOCAL ] VTOL: Saving derivative data. [2025-09-29T02:24:50.104796] [DEBUG] [LOCAL ] VTOL: Derivative data saved (1820 records). [2025-09-29T02:24:50.105073] [INFO ] [MAIN ] VTOL: Successfully saved derivative data. [2025-09-29T02:24:50.108402] [INFO ] [MAIN ] Derivative Progress: 2106/2211 symbols completed. VTOL took 1.0s. Estimated remaining: 44.5s. Rate: 141.5 symbols/min [2025-09-29T02:24:50.108913] [INFO ] [MAIN ] VVR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:50.148810] [DEBUG] [LOCAL ] VTS: Loaded 30992 existing records from primary storage. [2025-09-29T02:24:50.149131] [INFO ] [MAIN ] VTS: Loaded 30992 primary data records. [2025-09-29T02:24:50.290318] [DEBUG] [LOCAL ] VTR: Loaded 53620 existing records from primary storage. [2025-09-29T02:24:50.292066] [INFO ] [MAIN ] VTR: Loaded 53620 primary data records. [2025-09-29T02:24:50.463139] [DEBUG] [LOCAL ] VVR: Loaded 31251 existing records from primary storage. [2025-09-29T02:24:50.480839] [INFO ] [MAIN ] VVR: Loaded 31251 primary data records. [2025-09-29T02:24:51.259371] [DEBUG] [MAIN ] VTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:51.260489] [INFO ] [MAIN ] VTS: Generated 1820 derivative records from 30992 primary records. [2025-09-29T02:24:51.260810] [DEBUG] [LOCAL ] VTS: Saving derivative data. [2025-09-29T02:24:51.282870] [DEBUG] [LOCAL ] VTS: Derivative data saved (1820 records). [2025-09-29T02:24:51.283420] [INFO ] [MAIN ] VTS: Successfully saved derivative data. [2025-09-29T02:24:51.294358] [INFO ] [MAIN ] Derivative Progress: 2107/2211 symbols completed. VTS took 1.2s. Estimated remaining: 44.1s. Rate: 141.4 symbols/min [2025-09-29T02:24:51.300220] [INFO ] [MAIN ] VVV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:51.300565] [DEBUG] [MAIN ] VTR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:51.302008] [INFO ] [MAIN ] VTR: Generated 1820 derivative records from 53620 primary records. [2025-09-29T02:24:51.302673] [DEBUG] [LOCAL ] VTR: Saving derivative data. [2025-09-29T02:24:51.336344] [DEBUG] [MAIN ] VVR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:51.336414] [DEBUG] [LOCAL ] VTR: Derivative data saved (1820 records). [2025-09-29T02:24:51.337549] [INFO ] [MAIN ] VTR: Successfully saved derivative data. [2025-09-29T02:24:51.340244] [INFO ] [MAIN ] Derivative Progress: 2108/2211 symbols completed. VTR took 1.3s. Estimated remaining: 43.7s. Rate: 141.4 symbols/min [2025-09-29T02:24:51.337457] [INFO ] [MAIN ] VVR: Generated 1820 derivative records from 31251 primary records. [2025-09-29T02:24:51.340594] [DEBUG] [LOCAL ] VVR: Saving derivative data. [2025-09-29T02:24:51.340701] [INFO ] [MAIN ] VVX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:51.360840] [DEBUG] [LOCAL ] VVR: Derivative data saved (1820 records). [2025-09-29T02:24:51.360998] [INFO ] [MAIN ] VVR: Successfully saved derivative data. [2025-09-29T02:24:51.364351] [INFO ] [MAIN ] Derivative Progress: 2109/2211 symbols completed. VVR took 1.3s. Estimated remaining: 43.3s. Rate: 141.5 symbols/min [2025-09-29T02:24:51.364686] [INFO ] [MAIN ] VYX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:51.398031] [DEBUG] [LOCAL ] VVX: Loaded 23664 existing records from primary storage. [2025-09-29T02:24:51.398208] [INFO ] [MAIN ] VVX: Loaded 23664 primary data records. [2025-09-29T02:24:51.527121] [DEBUG] [LOCAL ] VVV: Loaded 50933 existing records from primary storage. [2025-09-29T02:24:51.532125] [INFO ] [MAIN ] VVV: Loaded 50933 primary data records. [2025-09-29T02:24:51.891074] [DEBUG] [LOCAL ] VYX: Loaded 49624 existing records from primary storage. [2025-09-29T02:24:51.898052] [INFO ] [MAIN ] VYX: Loaded 49624 primary data records. [2025-09-29T02:24:52.474879] [DEBUG] [MAIN ] VVX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:52.476740] [INFO ] [MAIN ] VVX: Generated 1820 derivative records from 23664 primary records. [2025-09-29T02:24:52.477359] [DEBUG] [LOCAL ] VVX: Saving derivative data. [2025-09-29T02:24:52.513202] [DEBUG] [MAIN ] VVV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:52.512739] [DEBUG] [LOCAL ] VVX: Derivative data saved (1820 records). [2025-09-29T02:24:52.513432] [INFO ] [MAIN ] VVX: Successfully saved derivative data. [2025-09-29T02:24:52.515760] [INFO ] [MAIN ] Derivative Progress: 2110/2211 symbols completed. VVX took 1.2s. Estimated remaining: 42.9s. Rate: 141.4 symbols/min [2025-09-29T02:24:52.516771] [INFO ] [MAIN ] VVV: Generated 1820 derivative records from 50933 primary records. [2025-09-29T02:24:52.517101] [DEBUG] [LOCAL ] VVV: Saving derivative data. [2025-09-29T02:24:52.518091] [INFO ] [MAIN ] VZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:52.536043] [DEBUG] [LOCAL ] VVV: Derivative data saved (1820 records). [2025-09-29T02:24:52.538154] [INFO ] [MAIN ] VVV: Successfully saved derivative data. [2025-09-29T02:24:52.541344] [INFO ] [MAIN ] Derivative Progress: 2111/2211 symbols completed. VVV took 1.2s. Estimated remaining: 42.4s. Rate: 141.4 symbols/min [2025-09-29T02:24:52.541914] [INFO ] [MAIN ] W: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:52.555622] [DEBUG] [MAIN ] VYX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:52.556913] [INFO ] [MAIN ] VYX: Generated 1820 derivative records from 49624 primary records. [2025-09-29T02:24:52.557048] [DEBUG] [LOCAL ] VYX: Saving derivative data. [2025-09-29T02:24:52.580777] [DEBUG] [LOCAL ] VYX: Derivative data saved (1820 records). [2025-09-29T02:24:52.581294] [INFO ] [MAIN ] VYX: Successfully saved derivative data. [2025-09-29T02:24:52.585183] [INFO ] [MAIN ] Derivative Progress: 2112/2211 symbols completed. VYX took 1.2s. Estimated remaining: 42.0s. Rate: 141.5 symbols/min [2025-09-29T02:24:52.585521] [INFO ] [MAIN ] WAB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:52.643928] [DEBUG] [LOCAL ] VZ: Loaded 54571 existing records from primary storage. [2025-09-29T02:24:52.644287] [INFO ] [MAIN ] VZ: Loaded 54571 primary data records. [2025-09-29T02:24:52.793542] [DEBUG] [LOCAL ] W: Loaded 54266 existing records from primary storage. [2025-09-29T02:24:52.835478] [DEBUG] [LOCAL ] WAB: Loaded 44872 existing records from primary storage. [2025-09-29T02:24:52.866114] [INFO ] [MAIN ] W: Loaded 54266 primary data records. [2025-09-29T02:24:52.892909] [INFO ] [MAIN ] WAB: Loaded 44872 primary data records. [2025-09-29T02:24:53.762384] [DEBUG] [MAIN ] VZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:53.765496] [INFO ] [MAIN ] VZ: Generated 1820 derivative records from 54571 primary records. [2025-09-29T02:24:53.766512] [DEBUG] [LOCAL ] VZ: Saving derivative data. [2025-09-29T02:24:53.785361] [DEBUG] [LOCAL ] VZ: Derivative data saved (1820 records). [2025-09-29T02:24:53.786010] [INFO ] [MAIN ] VZ: Successfully saved derivative data. [2025-09-29T02:24:53.788361] [INFO ] [MAIN ] Derivative Progress: 2113/2211 symbols completed. VZ took 1.3s. Estimated remaining: 41.6s. Rate: 141.4 symbols/min [2025-09-29T02:24:53.807979] [DEBUG] [MAIN ] W: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:53.821894] [INFO ] [MAIN ] W: Generated 1820 derivative records from 54266 primary records. [2025-09-29T02:24:53.822265] [DEBUG] [LOCAL ] W: Saving derivative data. [2025-09-29T02:24:53.822716] [DEBUG] [MAIN ] WAB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:53.824269] [INFO ] [MAIN ] WAB: Generated 1820 derivative records from 44872 primary records. [2025-09-29T02:24:53.824628] [DEBUG] [LOCAL ] WAB: Saving derivative data. [2025-09-29T02:24:53.841019] [DEBUG] [LOCAL ] W: Derivative data saved (1820 records). [2025-09-29T02:24:53.841361] [INFO ] [MAIN ] W: Successfully saved derivative data. [2025-09-29T02:24:53.851910] [INFO ] [MAIN ] Derivative Progress: 2114/2211 symbols completed. W took 1.3s. Estimated remaining: 41.2s. Rate: 141.4 symbols/min [2025-09-29T02:24:53.860344] [DEBUG] [LOCAL ] WAB: Derivative data saved (1820 records). [2025-09-29T02:24:53.860478] [INFO ] [MAIN ] WAB: Successfully saved derivative data. [2025-09-29T02:24:53.863360] [INFO ] [MAIN ] Derivative Progress: 2115/2211 symbols completed. WAB took 1.3s. Estimated remaining: 40.7s. Rate: 141.5 symbols/min [2025-09-29T02:24:53.864108] [INFO ] [MAIN ] WAT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:53.863946] [INFO ] [MAIN ] WBS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:53.863879] [INFO ] [MAIN ] WAL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:53.947736] [DEBUG] [LOCAL ] WAT: Loaded 35620 existing records from primary storage. [2025-09-29T02:24:53.949207] [DEBUG] [LOCAL ] WAL: Loaded 46040 existing records from primary storage. [2025-09-29T02:24:53.949549] [INFO ] [MAIN ] WAT: Loaded 35620 primary data records. [2025-09-29T02:24:53.949899] [INFO ] [MAIN ] WAL: Loaded 46040 primary data records. [2025-09-29T02:24:54.170518] [DEBUG] [LOCAL ] WBS: Loaded 49471 existing records from primary storage. [2025-09-29T02:24:54.180038] [INFO ] [MAIN ] WBS: Loaded 49471 primary data records. [2025-09-29T02:24:55.052959] [DEBUG] [MAIN ] WAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:55.054372] [INFO ] [MAIN ] WAL: Generated 1820 derivative records from 46040 primary records. [2025-09-29T02:24:55.054624] [DEBUG] [LOCAL ] WAL: Saving derivative data. [2025-09-29T02:24:55.076056] [DEBUG] [LOCAL ] WAL: Derivative data saved (1820 records). [2025-09-29T02:24:55.076789] [INFO ] [MAIN ] WAL: Successfully saved derivative data. [2025-09-29T02:24:55.087439] [INFO ] [MAIN ] Derivative Progress: 2116/2211 symbols completed. WAL took 1.2s. Estimated remaining: 40.3s. Rate: 141.4 symbols/min [2025-09-29T02:24:55.093247] [INFO ] [MAIN ] WBX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:55.093638] [DEBUG] [MAIN ] WAT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:55.094780] [INFO ] [MAIN ] WAT: Generated 1820 derivative records from 35620 primary records. [2025-09-29T02:24:55.096130] [DEBUG] [LOCAL ] WAT: Saving derivative data. [2025-09-29T02:24:55.134390] [DEBUG] [MAIN ] WBS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:55.134026] [DEBUG] [LOCAL ] WAT: Derivative data saved (1820 records). [2025-09-29T02:24:55.135483] [INFO ] [MAIN ] WBS: Generated 1820 derivative records from 49471 primary records. [2025-09-29T02:24:55.134637] [INFO ] [MAIN ] WAT: Successfully saved derivative data. [2025-09-29T02:24:55.138525] [INFO ] [MAIN ] Derivative Progress: 2117/2211 symbols completed. WAT took 1.3s. Estimated remaining: 39.9s. Rate: 141.4 symbols/min [2025-09-29T02:24:55.138619] [DEBUG] [LOCAL ] WBS: Saving derivative data. [2025-09-29T02:24:55.138888] [INFO ] [MAIN ] WCC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:55.146346] [DEBUG] [LOCAL ] WBX: Loaded 12558 existing records from primary storage. [2025-09-29T02:24:55.158571] [INFO ] [MAIN ] WBX: Loaded 12558 primary data records. [2025-09-29T02:24:55.280507] [DEBUG] [LOCAL ] WBS: Derivative data saved (1820 records). [2025-09-29T02:24:55.369318] [INFO ] [MAIN ] WBS: Successfully saved derivative data. [2025-09-29T02:24:55.495421] [INFO ] [MAIN ] Derivative Progress: 2118/2211 symbols completed. WBS took 1.6s. Estimated remaining: 39.5s. Rate: 141.4 symbols/min [2025-09-29T02:24:55.505293] [INFO ] [MAIN ] WCN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:55.523907] [DEBUG] [LOCAL ] WCC: Loaded 40567 existing records from primary storage. [2025-09-29T02:24:55.524835] [INFO ] [MAIN ] WCC: Loaded 40567 primary data records. [2025-09-29T02:24:55.900819] [DEBUG] [MAIN ] WBX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:55.902511] [INFO ] [MAIN ] WBX: Generated 1820 derivative records from 12558 primary records. [2025-09-29T02:24:55.917409] [DEBUG] [LOCAL ] WBX: Saving derivative data. [2025-09-29T02:24:55.923248] [DEBUG] [LOCAL ] WCN: Loaded 48708 existing records from primary storage. [2025-09-29T02:24:55.937734] [INFO ] [MAIN ] WCN: Loaded 48708 primary data records. [2025-09-29T02:24:55.939052] [DEBUG] [LOCAL ] WBX: Derivative data saved (1820 records). [2025-09-29T02:24:55.939308] [INFO ] [MAIN ] WBX: Successfully saved derivative data. [2025-09-29T02:24:55.989892] [INFO ] [MAIN ] Derivative Progress: 2119/2211 symbols completed. WBX took 0.9s. Estimated remaining: 39.0s. Rate: 141.4 symbols/min [2025-09-29T02:24:56.027183] [INFO ] [MAIN ] WD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:56.321276] [DEBUG] [MAIN ] WCC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:56.322219] [DEBUG] [LOCAL ] WD: Loaded 23747 existing records from primary storage. [2025-09-29T02:24:56.323942] [INFO ] [MAIN ] WD: Loaded 23747 primary data records. [2025-09-29T02:24:56.323515] [INFO ] [MAIN ] WCC: Generated 1820 derivative records from 40567 primary records. [2025-09-29T02:24:56.324395] [DEBUG] [LOCAL ] WCC: Saving derivative data. [2025-09-29T02:24:56.455207] [DEBUG] [LOCAL ] WCC: Derivative data saved (1820 records). [2025-09-29T02:24:56.465809] [INFO ] [MAIN ] WCC: Successfully saved derivative data. [2025-09-29T02:24:56.500456] [INFO ] [MAIN ] Derivative Progress: 2120/2211 symbols completed. WCC took 1.4s. Estimated remaining: 38.6s. Rate: 141.4 symbols/min [2025-09-29T02:24:56.538891] [INFO ] [MAIN ] WDH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:56.690387] [DEBUG] [MAIN ] WCN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:56.692996] [INFO ] [MAIN ] WCN: Generated 1820 derivative records from 48708 primary records. [2025-09-29T02:24:56.693317] [DEBUG] [LOCAL ] WCN: Saving derivative data. [2025-09-29T02:24:56.725382] [DEBUG] [LOCAL ] WDH: Loaded 17597 existing records from primary storage. [2025-09-29T02:24:56.727211] [DEBUG] [LOCAL ] WCN: Derivative data saved (1820 records). [2025-09-29T02:24:56.727392] [INFO ] [MAIN ] WDH: Loaded 17597 primary data records. [2025-09-29T02:24:56.727599] [INFO ] [MAIN ] WCN: Successfully saved derivative data. [2025-09-29T02:24:56.735497] [INFO ] [MAIN ] Derivative Progress: 2121/2211 symbols completed. WCN took 1.2s. Estimated remaining: 38.2s. Rate: 141.4 symbols/min [2025-09-29T02:24:56.756444] [INFO ] [MAIN ] WDI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:57.091863] [DEBUG] [LOCAL ] WDI: Loaded 21314 existing records from primary storage. [2025-09-29T02:24:57.102605] [INFO ] [MAIN ] WDI: Loaded 21314 primary data records. [2025-09-29T02:24:57.103054] [DEBUG] [MAIN ] WD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:57.139676] [INFO ] [MAIN ] WD: Generated 1820 derivative records from 23747 primary records. [2025-09-29T02:24:57.190975] [DEBUG] [LOCAL ] WD: Saving derivative data. [2025-09-29T02:24:57.244348] [DEBUG] [LOCAL ] WD: Derivative data saved (1820 records). [2025-09-29T02:24:57.244886] [INFO ] [MAIN ] WD: Successfully saved derivative data. [2025-09-29T02:24:57.247986] [INFO ] [MAIN ] Derivative Progress: 2122/2211 symbols completed. WD took 1.2s. Estimated remaining: 37.8s. Rate: 141.4 symbols/min [2025-09-29T02:24:57.248281] [INFO ] [MAIN ] WDS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:57.537760] [DEBUG] [MAIN ] WDH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:57.539883] [INFO ] [MAIN ] WDH: Generated 1820 derivative records from 17597 primary records. [2025-09-29T02:24:57.540057] [DEBUG] [LOCAL ] WDH: Saving derivative data. [2025-09-29T02:24:57.573305] [DEBUG] [LOCAL ] WDH: Derivative data saved (1820 records). [2025-09-29T02:24:57.574073] [INFO ] [MAIN ] WDH: Successfully saved derivative data. [2025-09-29T02:24:57.577625] [INFO ] [MAIN ] Derivative Progress: 2123/2211 symbols completed. WDH took 1.0s. Estimated remaining: 37.3s. Rate: 141.4 symbols/min [2025-09-29T02:24:57.578217] [INFO ] [MAIN ] WEA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:57.616026] [DEBUG] [MAIN ] WDI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:57.618531] [INFO ] [MAIN ] WDI: Generated 1820 derivative records from 21314 primary records. [2025-09-29T02:24:57.619396] [DEBUG] [LOCAL ] WDI: Saving derivative data. [2025-09-29T02:24:57.617420] [DEBUG] [LOCAL ] WDS: Loaded 44259 existing records from primary storage. [2025-09-29T02:24:57.624551] [DEBUG] [LOCAL ] WEA: Loaded 7379 existing records from primary storage. [2025-09-29T02:24:57.624949] [INFO ] [MAIN ] WDS: Loaded 44259 primary data records. [2025-09-29T02:24:57.634413] [INFO ] [MAIN ] WEA: Loaded 7379 primary data records. [2025-09-29T02:24:57.770103] [DEBUG] [LOCAL ] WDI: Derivative data saved (1820 records). [2025-09-29T02:24:57.827404] [INFO ] [MAIN ] WDI: Successfully saved derivative data. [2025-09-29T02:24:57.862750] [INFO ] [MAIN ] Derivative Progress: 2124/2211 symbols completed. WDI took 1.1s. Estimated remaining: 36.9s. Rate: 141.5 symbols/min [2025-09-29T02:24:57.889130] [INFO ] [MAIN ] WEAV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:58.368092] [DEBUG] [LOCAL ] WEAV: Loaded 42562 existing records from primary storage. [2025-09-29T02:24:58.368557] [INFO ] [MAIN ] WEAV: Loaded 42562 primary data records. [2025-09-29T02:24:58.460094] [DEBUG] [MAIN ] WDS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:58.487101] [INFO ] [MAIN ] WDS: Generated 1820 derivative records from 44259 primary records. [2025-09-29T02:24:58.510236] [DEBUG] [LOCAL ] WDS: Saving derivative data. [2025-09-29T02:24:58.557072] [DEBUG] [MAIN ] WEA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:58.575335] [INFO ] [MAIN ] WEA: Generated 1820 derivative records from 7379 primary records. [2025-09-29T02:24:58.617160] [DEBUG] [LOCAL ] WDS: Derivative data saved (1820 records). [2025-09-29T02:24:58.636392] [INFO ] [MAIN ] WDS: Successfully saved derivative data. [2025-09-29T02:24:58.639127] [INFO ] [MAIN ] Derivative Progress: 2125/2211 symbols completed. WDS took 1.4s. Estimated remaining: 36.5s. Rate: 141.4 symbols/min [2025-09-29T02:24:58.633157] [DEBUG] [LOCAL ] WEA: Saving derivative data. [2025-09-29T02:24:58.644356] [INFO ] [MAIN ] WEC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:58.797837] [DEBUG] [LOCAL ] WEA: Derivative data saved (1820 records). [2025-09-29T02:24:58.798366] [INFO ] [MAIN ] WEA: Successfully saved derivative data. [2025-09-29T02:24:58.801829] [INFO ] [MAIN ] Derivative Progress: 2126/2211 symbols completed. WEA took 1.2s. Estimated remaining: 36.1s. Rate: 141.4 symbols/min [2025-09-29T02:24:58.803084] [INFO ] [MAIN ] WELL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:58.834797] [DEBUG] [MAIN ] WEAV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:24:58.836435] [INFO ] [MAIN ] WEAV: Generated 1820 derivative records from 42562 primary records. [2025-09-29T02:24:58.836603] [DEBUG] [LOCAL ] WEAV: Saving derivative data. [2025-09-29T02:24:58.869169] [DEBUG] [LOCAL ] WEAV: Derivative data saved (1820 records). [2025-09-29T02:24:58.869586] [INFO ] [MAIN ] WEAV: Successfully saved derivative data. [2025-09-29T02:24:58.872442] [INFO ] [MAIN ] Derivative Progress: 2127/2211 symbols completed. WEAV took 1.0s. Estimated remaining: 35.6s. Rate: 141.5 symbols/min [2025-09-29T02:24:58.872770] [INFO ] [MAIN ] WES: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:24:58.896376] [DEBUG] [LOCAL ] WEC: Loaded 52958 existing records from primary storage. [2025-09-29T02:24:58.911753] [INFO ] [MAIN ] WEC: Loaded 52958 primary data records. [2025-09-29T02:24:59.046990] [DEBUG] [LOCAL ] WELL: Loaded 53132 existing records from primary storage. [2025-09-29T02:24:59.047899] [INFO ] [MAIN ] WELL: Loaded 53132 primary data records. [2025-09-29T02:24:59.425350] [DEBUG] [LOCAL ] WES: Loaded 48689 existing records from primary storage. [2025-09-29T02:24:59.439325] [INFO ] [MAIN ] WES: Loaded 48689 primary data records. [2025-09-29T02:25:00.141059] [DEBUG] [MAIN ] WEC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:00.142443] [INFO ] [MAIN ] WEC: Generated 1820 derivative records from 52958 primary records. [2025-09-29T02:25:00.142586] [DEBUG] [LOCAL ] WEC: Saving derivative data. [2025-09-29T02:25:00.176374] [DEBUG] [MAIN ] WELL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:00.178462] [INFO ] [MAIN ] WELL: Generated 1820 derivative records from 53132 primary records. [2025-09-29T02:25:00.178661] [DEBUG] [LOCAL ] WELL: Saving derivative data. [2025-09-29T02:25:00.182727] [DEBUG] [LOCAL ] WEC: Derivative data saved (1820 records). [2025-09-29T02:25:00.182981] [INFO ] [MAIN ] WEC: Successfully saved derivative data. [2025-09-29T02:25:00.194483] [INFO ] [MAIN ] Derivative Progress: 2128/2211 symbols completed. WEC took 1.6s. Estimated remaining: 35.2s. Rate: 141.4 symbols/min [2025-09-29T02:25:00.203983] [DEBUG] [LOCAL ] WELL: Derivative data saved (1820 records). [2025-09-29T02:25:00.204444] [INFO ] [MAIN ] WELL: Successfully saved derivative data. [2025-09-29T02:25:00.207940] [INFO ] [MAIN ] Derivative Progress: 2129/2211 symbols completed. WELL took 1.4s. Estimated remaining: 34.8s. Rate: 141.4 symbols/min [2025-09-29T02:25:00.224733] [DEBUG] [MAIN ] WES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:00.225561] [INFO ] [MAIN ] WES: Generated 1820 derivative records from 48689 primary records. [2025-09-29T02:25:00.225670] [DEBUG] [LOCAL ] WES: Saving derivative data. [2025-09-29T02:25:00.241990] [DEBUG] [LOCAL ] WES: Derivative data saved (1820 records). [2025-09-29T02:25:00.242150] [INFO ] [MAIN ] WES: Successfully saved derivative data. [2025-09-29T02:25:00.245297] [INFO ] [MAIN ] Derivative Progress: 2130/2211 symbols completed. WES took 1.4s. Estimated remaining: 34.4s. Rate: 141.5 symbols/min [2025-09-29T02:25:00.246133] [INFO ] [MAIN ] WFC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:00.246203] [INFO ] [MAIN ] WF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:00.246033] [INFO ] [MAIN ] WEX: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:00.266936] [DEBUG] [LOCAL ] WF: Loaded 10903 existing records from primary storage. [2025-09-29T02:25:00.267277] [INFO ] [MAIN ] WF: Loaded 10903 primary data records. [2025-09-29T02:25:00.445638] [DEBUG] [LOCAL ] WEX: Loaded 35697 existing records from primary storage. [2025-09-29T02:25:00.520706] [INFO ] [MAIN ] WEX: Loaded 35697 primary data records. [2025-09-29T02:25:00.779582] [DEBUG] [LOCAL ] WFC: Loaded 54528 existing records from primary storage. [2025-09-29T02:25:00.784968] [INFO ] [MAIN ] WFC: Loaded 54528 primary data records. [2025-09-29T02:25:01.397003] [DEBUG] [MAIN ] WF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:01.398142] [INFO ] [MAIN ] WF: Generated 1820 derivative records from 10903 primary records. [2025-09-29T02:25:01.399788] [DEBUG] [LOCAL ] WF: Saving derivative data. [2025-09-29T02:25:01.420450] [DEBUG] [LOCAL ] WF: Derivative data saved (1820 records). [2025-09-29T02:25:01.421542] [INFO ] [MAIN ] WF: Successfully saved derivative data. [2025-09-29T02:25:01.425719] [INFO ] [MAIN ] Derivative Progress: 2131/2211 symbols completed. WF took 1.2s. Estimated remaining: 34.0s. Rate: 141.4 symbols/min [2025-09-29T02:25:01.426597] [INFO ] [MAIN ] WFG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:01.448239] [DEBUG] [MAIN ] WEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:01.450151] [INFO ] [MAIN ] WEX: Generated 1820 derivative records from 35697 primary records. [2025-09-29T02:25:01.450527] [DEBUG] [LOCAL ] WEX: Saving derivative data. [2025-09-29T02:25:01.478588] [DEBUG] [LOCAL ] WEX: Derivative data saved (1820 records). [2025-09-29T02:25:01.479111] [INFO ] [MAIN ] WEX: Successfully saved derivative data. [2025-09-29T02:25:01.481806] [INFO ] [MAIN ] Derivative Progress: 2132/2211 symbols completed. WEX took 1.2s. Estimated remaining: 33.5s. Rate: 141.4 symbols/min [2025-09-29T02:25:01.482437] [INFO ] [MAIN ] WGO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:01.497356] [DEBUG] [MAIN ] WFC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:01.508281] [INFO ] [MAIN ] WFC: Generated 1820 derivative records from 54528 primary records. [2025-09-29T02:25:01.509112] [DEBUG] [LOCAL ] WFG: Loaded 25211 existing records from primary storage. [2025-09-29T02:25:01.509468] [DEBUG] [LOCAL ] WFC: Saving derivative data. [2025-09-29T02:25:01.509624] [INFO ] [MAIN ] WFG: Loaded 25211 primary data records. [2025-09-29T02:25:01.648941] [DEBUG] [LOCAL ] WFC: Derivative data saved (1820 records). [2025-09-29T02:25:01.658610] [INFO ] [MAIN ] WFC: Successfully saved derivative data. [2025-09-29T02:25:01.663041] [INFO ] [MAIN ] Derivative Progress: 2133/2211 symbols completed. WFC took 1.4s. Estimated remaining: 33.1s. Rate: 141.5 symbols/min [2025-09-29T02:25:01.684978] [INFO ] [MAIN ] WH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:01.939460] [DEBUG] [LOCAL ] WGO: Loaded 39823 existing records from primary storage. [2025-09-29T02:25:01.939953] [INFO ] [MAIN ] WGO: Loaded 39823 primary data records. [2025-09-29T02:25:02.319463] [DEBUG] [LOCAL ] WH: Loaded 46339 existing records from primary storage. [2025-09-29T02:25:02.320434] [INFO ] [MAIN ] WH: Loaded 46339 primary data records. [2025-09-29T02:25:02.554537] [DEBUG] [MAIN ] WFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:02.686111] [INFO ] [MAIN ] WFG: Generated 1820 derivative records from 25211 primary records. [2025-09-29T02:25:02.686906] [DEBUG] [LOCAL ] WFG: Saving derivative data. [2025-09-29T02:25:02.711596] [DEBUG] [LOCAL ] WFG: Derivative data saved (1820 records). [2025-09-29T02:25:02.713218] [INFO ] [MAIN ] WFG: Successfully saved derivative data. [2025-09-29T02:25:02.716629] [INFO ] [MAIN ] Derivative Progress: 2134/2211 symbols completed. WFG took 1.3s. Estimated remaining: 32.7s. Rate: 141.4 symbols/min [2025-09-29T02:25:02.717395] [INFO ] [MAIN ] WHD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:02.741374] [DEBUG] [MAIN ] WGO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:02.742453] [INFO ] [MAIN ] WGO: Generated 1820 derivative records from 39823 primary records. [2025-09-29T02:25:02.742777] [DEBUG] [LOCAL ] WGO: Saving derivative data. [2025-09-29T02:25:02.764182] [DEBUG] [LOCAL ] WGO: Derivative data saved (1820 records). [2025-09-29T02:25:02.764595] [INFO ] [MAIN ] WGO: Successfully saved derivative data. [2025-09-29T02:25:02.768167] [INFO ] [MAIN ] Derivative Progress: 2135/2211 symbols completed. WGO took 1.3s. Estimated remaining: 32.2s. Rate: 141.4 symbols/min [2025-09-29T02:25:02.768603] [INFO ] [MAIN ] WHG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:02.783363] [DEBUG] [MAIN ] WH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:02.784594] [INFO ] [MAIN ] WH: Generated 1820 derivative records from 46339 primary records. [2025-09-29T02:25:02.796088] [DEBUG] [LOCAL ] WH: Saving derivative data. [2025-09-29T02:25:02.808135] [DEBUG] [LOCAL ] WHG: Loaded 3416 existing records from primary storage. [2025-09-29T02:25:02.824143] [INFO ] [MAIN ] WHG: Loaded 3416 primary data records. [2025-09-29T02:25:02.824341] [DEBUG] [LOCAL ] WH: Derivative data saved (1820 records). [2025-09-29T02:25:02.843458] [INFO ] [MAIN ] WH: Successfully saved derivative data. [2025-09-29T02:25:02.854891] [INFO ] [MAIN ] Derivative Progress: 2136/2211 symbols completed. WH took 1.2s. Estimated remaining: 31.8s. Rate: 141.5 symbols/min [2025-09-29T02:25:02.855238] [INFO ] [MAIN ] WHR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:02.868515] [DEBUG] [LOCAL ] WHD: Loaded 41130 existing records from primary storage. [2025-09-29T02:25:02.925129] [INFO ] [MAIN ] WHD: Loaded 41130 primary data records. [2025-09-29T02:25:03.544336] [DEBUG] [LOCAL ] WHR: Loaded 48846 existing records from primary storage. [2025-09-29T02:25:03.545384] [INFO ] [MAIN ] WHR: Loaded 48846 primary data records. [2025-09-29T02:25:03.979555] [DEBUG] [MAIN ] WHG: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:25:03.982062] [INFO ] [MAIN ] WHG: Generated 1819 derivative records from 3416 primary records. [2025-09-29T02:25:03.982698] [DEBUG] [LOCAL ] WHG: Saving derivative data. [2025-09-29T02:25:04.007974] [DEBUG] [MAIN ] WHD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:04.013239] [INFO ] [MAIN ] WHD: Generated 1820 derivative records from 41130 primary records. [2025-09-29T02:25:04.014146] [DEBUG] [LOCAL ] WHG: Derivative data saved (1819 records). [2025-09-29T02:25:04.014387] [DEBUG] [LOCAL ] WHD: Saving derivative data. [2025-09-29T02:25:04.014485] [INFO ] [MAIN ] WHG: Successfully saved derivative data. [2025-09-29T02:25:04.017241] [INFO ] [MAIN ] Derivative Progress: 2137/2211 symbols completed. WHG took 1.2s. Estimated remaining: 31.4s. Rate: 141.4 symbols/min [2025-09-29T02:25:04.017877] [INFO ] [MAIN ] WIA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:04.042423] [DEBUG] [LOCAL ] WIA: Loaded 4937 existing records from primary storage. [2025-09-29T02:25:04.039135] [DEBUG] [LOCAL ] WHD: Derivative data saved (1820 records). [2025-09-29T02:25:04.042619] [INFO ] [MAIN ] WIA: Loaded 4937 primary data records. [2025-09-29T02:25:04.048076] [INFO ] [MAIN ] WHD: Successfully saved derivative data. [2025-09-29T02:25:04.108637] [INFO ] [MAIN ] Derivative Progress: 2138/2211 symbols completed. WHD took 1.4s. Estimated remaining: 31.0s. Rate: 141.4 symbols/min [2025-09-29T02:25:04.142394] [INFO ] [MAIN ] WINN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:04.181103] [DEBUG] [MAIN ] WHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:04.204619] [INFO ] [MAIN ] WHR: Generated 1820 derivative records from 48846 primary records. [2025-09-29T02:25:04.248702] [DEBUG] [LOCAL ] WHR: Saving derivative data. [2025-09-29T02:25:04.407592] [DEBUG] [LOCAL ] WINN: Loaded 11944 existing records from primary storage. [2025-09-29T02:25:04.408111] [INFO ] [MAIN ] WINN: Loaded 11944 primary data records. [2025-09-29T02:25:04.495423] [DEBUG] [LOCAL ] WHR: Derivative data saved (1820 records). [2025-09-29T02:25:04.512078] [INFO ] [MAIN ] WHR: Successfully saved derivative data. [2025-09-29T02:25:04.515230] [INFO ] [MAIN ] Derivative Progress: 2139/2211 symbols completed. WHR took 1.7s. Estimated remaining: 30.5s. Rate: 141.4 symbols/min [2025-09-29T02:25:04.525054] [INFO ] [MAIN ] WIT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:04.880703] [DEBUG] [MAIN ] WIA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:04.885350] [INFO ] [MAIN ] WIA: Generated 1820 derivative records from 4937 primary records. [2025-09-29T02:25:04.887460] [DEBUG] [LOCAL ] WIA: Saving derivative data. [2025-09-29T02:25:04.905533] [DEBUG] [LOCAL ] WIA: Derivative data saved (1820 records). [2025-09-29T02:25:04.905822] [INFO ] [MAIN ] WIA: Successfully saved derivative data. [2025-09-29T02:25:04.927987] [INFO ] [MAIN ] Derivative Progress: 2140/2211 symbols completed. WIA took 0.9s. Estimated remaining: 30.1s. Rate: 141.4 symbols/min [2025-09-29T02:25:04.928241] [INFO ] [MAIN ] WIW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:04.931698] [DEBUG] [LOCAL ] WIT: Loaded 53070 existing records from primary storage. [2025-09-29T02:25:04.932474] [INFO ] [MAIN ] WIT: Loaded 53070 primary data records. [2025-09-29T02:25:05.075928] [DEBUG] [LOCAL ] WIW: Loaded 20756 existing records from primary storage. [2025-09-29T02:25:05.076715] [INFO ] [MAIN ] WIW: Loaded 20756 primary data records. [2025-09-29T02:25:05.165736] [DEBUG] [MAIN ] WINN: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:25:05.212613] [INFO ] [MAIN ] WINN: Generated 1819 derivative records from 11944 primary records. [2025-09-29T02:25:05.398375] [DEBUG] [LOCAL ] WINN: Saving derivative data. [2025-09-29T02:25:05.686344] [DEBUG] [LOCAL ] WINN: Derivative data saved (1819 records). [2025-09-29T02:25:05.686606] [INFO ] [MAIN ] WINN: Successfully saved derivative data. [2025-09-29T02:25:05.690674] [INFO ] [MAIN ] Derivative Progress: 2141/2211 symbols completed. WINN took 1.5s. Estimated remaining: 29.7s. Rate: 141.4 symbols/min [2025-09-29T02:25:05.691732] [INFO ] [MAIN ] WK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:05.720518] [DEBUG] [MAIN ] WIT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:05.721418] [INFO ] [MAIN ] WIT: Generated 1820 derivative records from 53070 primary records. [2025-09-29T02:25:05.721726] [DEBUG] [LOCAL ] WIT: Saving derivative data. [2025-09-29T02:25:05.767871] [DEBUG] [MAIN ] WIW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:05.770513] [INFO ] [MAIN ] WIW: Generated 1820 derivative records from 20756 primary records. [2025-09-29T02:25:05.770713] [DEBUG] [LOCAL ] WIW: Saving derivative data. [2025-09-29T02:25:05.771479] [DEBUG] [LOCAL ] WIT: Derivative data saved (1820 records). [2025-09-29T02:25:05.772812] [INFO ] [MAIN ] WIT: Successfully saved derivative data. [2025-09-29T02:25:05.777177] [INFO ] [MAIN ] Derivative Progress: 2142/2211 symbols completed. WIT took 1.3s. Estimated remaining: 29.3s. Rate: 141.4 symbols/min [2025-09-29T02:25:05.778630] [INFO ] [MAIN ] WKC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:05.795362] [DEBUG] [LOCAL ] WIW: Derivative data saved (1820 records). [2025-09-29T02:25:05.795744] [INFO ] [MAIN ] WIW: Successfully saved derivative data. [2025-09-29T02:25:05.799388] [INFO ] [MAIN ] Derivative Progress: 2143/2211 symbols completed. WIW took 0.9s. Estimated remaining: 28.8s. Rate: 141.5 symbols/min [2025-09-29T02:25:05.817237] [DEBUG] [LOCAL ] WK: Loaded 37342 existing records from primary storage. [2025-09-29T02:25:05.817780] [INFO ] [MAIN ] WK: Loaded 37342 primary data records. [2025-09-29T02:25:06.183762] [DEBUG] [LOCAL ] WKC: Loaded 35538 existing records from primary storage. [2025-09-29T02:25:06.185101] [INFO ] [MAIN ] WKC: Loaded 35538 primary data records. [2025-09-29T02:25:06.587014] [DEBUG] [MAIN ] WK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:06.588496] [INFO ] [MAIN ] WK: Generated 1820 derivative records from 37342 primary records. [2025-09-29T02:25:06.588592] [DEBUG] [LOCAL ] WK: Saving derivative data. [2025-09-29T02:25:06.607427] [DEBUG] [LOCAL ] WK: Derivative data saved (1820 records). [2025-09-29T02:25:06.607750] [INFO ] [MAIN ] WK: Successfully saved derivative data. [2025-09-29T02:25:06.610619] [INFO ] [MAIN ] Derivative Progress: 2144/2211 symbols completed. WK took 0.9s. Estimated remaining: 28.4s. Rate: 141.4 symbols/min [2025-09-29T02:25:06.627732] [DEBUG] [MAIN ] WKC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:06.628521] [INFO ] [MAIN ] WKC: Generated 1820 derivative records from 35538 primary records. [2025-09-29T02:25:06.628609] [DEBUG] [LOCAL ] WKC: Saving derivative data. [2025-09-29T02:25:06.645171] [DEBUG] [LOCAL ] WKC: Derivative data saved (1820 records). [2025-09-29T02:25:06.645335] [INFO ] [MAIN ] WKC: Successfully saved derivative data. [2025-09-29T02:25:06.648383] [INFO ] [MAIN ] Derivative Progress: 2145/2211 symbols completed. WKC took 0.9s. Estimated remaining: 28.0s. Rate: 141.5 symbols/min [2025-09-29T02:25:06.649132] [INFO ] [MAIN ] WLY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:06.648974] [INFO ] [MAIN ] WLK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:06.649248] [INFO ] [MAIN ] WLKP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:06.665152] [DEBUG] [LOCAL ] WLKP: Loaded 6800 existing records from primary storage. [2025-09-29T02:25:06.665594] [INFO ] [MAIN ] WLKP: Loaded 6800 primary data records. [2025-09-29T02:25:07.054397] [DEBUG] [LOCAL ] WLY: Loaded 30414 existing records from primary storage. [2025-09-29T02:25:07.065033] [INFO ] [MAIN ] WLY: Loaded 30414 primary data records. [2025-09-29T02:25:07.071577] [DEBUG] [LOCAL ] WLK: Loaded 46113 existing records from primary storage. [2025-09-29T02:25:07.084711] [INFO ] [MAIN ] WLK: Loaded 46113 primary data records. [2025-09-29T02:25:07.784036] [DEBUG] [MAIN ] WLKP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:07.785512] [INFO ] [MAIN ] WLKP: Generated 1820 derivative records from 6800 primary records. [2025-09-29T02:25:07.785818] [DEBUG] [LOCAL ] WLKP: Saving derivative data. [2025-09-29T02:25:07.805725] [DEBUG] [LOCAL ] WLKP: Derivative data saved (1820 records). [2025-09-29T02:25:07.806459] [INFO ] [MAIN ] WLKP: Successfully saved derivative data. [2025-09-29T02:25:07.809583] [INFO ] [MAIN ] Derivative Progress: 2146/2211 symbols completed. WLKP took 1.2s. Estimated remaining: 27.6s. Rate: 141.4 symbols/min [2025-09-29T02:25:07.810130] [INFO ] [MAIN ] WM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:07.828379] [DEBUG] [MAIN ] WLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:07.829625] [INFO ] [MAIN ] WLY: Generated 1820 derivative records from 30414 primary records. [2025-09-29T02:25:07.830009] [DEBUG] [LOCAL ] WLY: Saving derivative data. [2025-09-29T02:25:07.863131] [DEBUG] [MAIN ] WLK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:07.866045] [INFO ] [MAIN ] WLK: Generated 1820 derivative records from 46113 primary records. [2025-09-29T02:25:07.868552] [DEBUG] [LOCAL ] WLK: Saving derivative data. [2025-09-29T02:25:07.869331] [DEBUG] [LOCAL ] WLY: Derivative data saved (1820 records). [2025-09-29T02:25:07.869739] [INFO ] [MAIN ] WLY: Successfully saved derivative data. [2025-09-29T02:25:07.872968] [INFO ] [MAIN ] Derivative Progress: 2147/2211 symbols completed. WLY took 1.2s. Estimated remaining: 27.2s. Rate: 141.4 symbols/min [2025-09-29T02:25:07.873663] [INFO ] [MAIN ] WMB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:07.890071] [DEBUG] [LOCAL ] WLK: Derivative data saved (1820 records). [2025-09-29T02:25:07.890226] [INFO ] [MAIN ] WLK: Successfully saved derivative data. [2025-09-29T02:25:07.894043] [INFO ] [MAIN ] Derivative Progress: 2148/2211 symbols completed. WLK took 1.2s. Estimated remaining: 26.7s. Rate: 141.5 symbols/min [2025-09-29T02:25:07.894464] [INFO ] [MAIN ] WMK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:07.932731] [DEBUG] [LOCAL ] WMK: Loaded 14753 existing records from primary storage. [2025-09-29T02:25:07.947870] [INFO ] [MAIN ] WMK: Loaded 14753 primary data records. [2025-09-29T02:25:07.954535] [DEBUG] [LOCAL ] WM: Loaded 51697 existing records from primary storage. [2025-09-29T02:25:07.988804] [INFO ] [MAIN ] WM: Loaded 51697 primary data records. [2025-09-29T02:25:08.337496] [DEBUG] [LOCAL ] WMB: Loaded 54451 existing records from primary storage. [2025-09-29T02:25:08.520249] [INFO ] [MAIN ] WMB: Loaded 54451 primary data records. [2025-09-29T02:25:09.065340] [DEBUG] [MAIN ] WMK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:09.066796] [INFO ] [MAIN ] WMK: Generated 1820 derivative records from 14753 primary records. [2025-09-29T02:25:09.067080] [DEBUG] [LOCAL ] WMK: Saving derivative data. [2025-09-29T02:25:09.102121] [DEBUG] [LOCAL ] WMK: Derivative data saved (1820 records). [2025-09-29T02:25:09.103309] [INFO ] [MAIN ] WMK: Successfully saved derivative data. [2025-09-29T02:25:09.106274] [INFO ] [MAIN ] Derivative Progress: 2149/2211 symbols completed. WMK took 1.2s. Estimated remaining: 26.3s. Rate: 141.4 symbols/min [2025-09-29T02:25:09.106916] [INFO ] [MAIN ] WMS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:09.103818] [DEBUG] [MAIN ] WM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:09.108563] [INFO ] [MAIN ] WM: Generated 1820 derivative records from 51697 primary records. [2025-09-29T02:25:09.108810] [DEBUG] [LOCAL ] WM: Saving derivative data. [2025-09-29T02:25:09.135754] [DEBUG] [LOCAL ] WM: Derivative data saved (1820 records). [2025-09-29T02:25:09.149260] [INFO ] [MAIN ] WM: Successfully saved derivative data. [2025-09-29T02:25:09.149628] [DEBUG] [MAIN ] WMB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:09.154337] [INFO ] [MAIN ] WMB: Generated 1820 derivative records from 54451 primary records. [2025-09-29T02:25:09.153274] [INFO ] [MAIN ] Derivative Progress: 2150/2211 symbols completed. WM took 1.3s. Estimated remaining: 25.9s. Rate: 141.4 symbols/min [2025-09-29T02:25:09.154612] [INFO ] [MAIN ] WMT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:09.154675] [DEBUG] [LOCAL ] WMB: Saving derivative data. [2025-09-29T02:25:09.183451] [DEBUG] [LOCAL ] WMB: Derivative data saved (1820 records). [2025-09-29T02:25:09.183975] [INFO ] [MAIN ] WMB: Successfully saved derivative data. [2025-09-29T02:25:09.187328] [INFO ] [MAIN ] Derivative Progress: 2151/2211 symbols completed. WMB took 1.3s. Estimated remaining: 25.4s. Rate: 141.5 symbols/min [2025-09-29T02:25:09.187749] [INFO ] [MAIN ] WNC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:09.210493] [DEBUG] [LOCAL ] WMS: Loaded 40249 existing records from primary storage. [2025-09-29T02:25:09.210737] [INFO ] [MAIN ] WMS: Loaded 40249 primary data records. [2025-09-29T02:25:09.609612] [DEBUG] [LOCAL ] WNC: Loaded 40452 existing records from primary storage. [2025-09-29T02:25:09.609918] [INFO ] [MAIN ] WNC: Loaded 40452 primary data records. [2025-09-29T02:25:09.611021] [DEBUG] [LOCAL ] WMT: Loaded 54580 existing records from primary storage. [2025-09-29T02:25:09.624103] [INFO ] [MAIN ] WMT: Loaded 54580 primary data records. [2025-09-29T02:25:10.325157] [DEBUG] [MAIN ] WMS: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-29T02:25:10.326961] [INFO ] [MAIN ] WMS: Generated 1819 derivative records from 40249 primary records. [2025-09-29T02:25:10.327433] [DEBUG] [LOCAL ] WMS: Saving derivative data. [2025-09-29T02:25:10.348998] [DEBUG] [LOCAL ] WMS: Derivative data saved (1819 records). [2025-09-29T02:25:10.349744] [INFO ] [MAIN ] WMS: Successfully saved derivative data. [2025-09-29T02:25:10.352894] [INFO ] [MAIN ] Derivative Progress: 2152/2211 symbols completed. WMS took 1.2s. Estimated remaining: 25.0s. Rate: 141.4 symbols/min [2025-09-29T02:25:10.353943] [INFO ] [MAIN ] WNS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:10.388637] [DEBUG] [MAIN ] WMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:10.389360] [DEBUG] [MAIN ] WNC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:10.390532] [INFO ] [MAIN ] WNC: Generated 1820 derivative records from 40452 primary records. [2025-09-29T02:25:10.391432] [DEBUG] [LOCAL ] WNC: Saving derivative data. [2025-09-29T02:25:10.391337] [INFO ] [MAIN ] WMT: Generated 1820 derivative records from 54580 primary records. [2025-09-29T02:25:10.392590] [DEBUG] [LOCAL ] WMT: Saving derivative data. [2025-09-29T02:25:10.433892] [DEBUG] [LOCAL ] WNC: Derivative data saved (1820 records). [2025-09-29T02:25:10.438715] [INFO ] [MAIN ] WNC: Successfully saved derivative data. [2025-09-29T02:25:10.439404] [DEBUG] [LOCAL ] WMT: Derivative data saved (1820 records). [2025-09-29T02:25:10.439684] [INFO ] [MAIN ] WMT: Successfully saved derivative data. [2025-09-29T02:25:10.442441] [INFO ] [MAIN ] Derivative Progress: 2153/2211 symbols completed. WNC took 1.3s. Estimated remaining: 24.6s. Rate: 141.4 symbols/min [2025-09-29T02:25:10.446123] [INFO ] [MAIN ] WOLF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:10.446230] [INFO ] [MAIN ] Derivative Progress: 2154/2211 symbols completed. WMT took 1.3s. Estimated remaining: 24.2s. Rate: 141.5 symbols/min [2025-09-29T02:25:10.446579] [INFO ] [MAIN ] WOR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:10.463944] [DEBUG] [LOCAL ] WNS: Loaded 40539 existing records from primary storage. [2025-09-29T02:25:10.464297] [INFO ] [MAIN ] WNS: Loaded 40539 primary data records. [2025-09-29T02:25:10.848078] [DEBUG] [LOCAL ] WOR: Loaded 25288 existing records from primary storage. [2025-09-29T02:25:10.879252] [INFO ] [MAIN ] WOR: Loaded 25288 primary data records. [2025-09-29T02:25:10.880461] [DEBUG] [LOCAL ] WOLF: Loaded 54312 existing records from primary storage. [2025-09-29T02:25:10.880866] [INFO ] [MAIN ] WOLF: Loaded 54312 primary data records. [2025-09-29T02:25:11.682354] [DEBUG] [MAIN ] WNS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:11.684676] [INFO ] [MAIN ] WNS: Generated 1820 derivative records from 40539 primary records. [2025-09-29T02:25:11.685165] [DEBUG] [LOCAL ] WNS: Saving derivative data. [2025-09-29T02:25:11.708690] [DEBUG] [LOCAL ] WNS: Derivative data saved (1820 records). [2025-09-29T02:25:11.709700] [INFO ] [MAIN ] WNS: Successfully saved derivative data. [2025-09-29T02:25:11.713501] [INFO ] [MAIN ] Derivative Progress: 2155/2211 symbols completed. WNS took 1.4s. Estimated remaining: 23.8s. Rate: 141.3 symbols/min [2025-09-29T02:25:11.714419] [INFO ] [MAIN ] WOW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:11.741267] [DEBUG] [MAIN ] WOLF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:11.742590] [INFO ] [MAIN ] WOLF: Generated 1820 derivative records from 54312 primary records. [2025-09-29T02:25:11.756876] [DEBUG] [LOCAL ] WOLF: Saving derivative data. [2025-09-29T02:25:11.757476] [DEBUG] [MAIN ] WOR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:11.778032] [INFO ] [MAIN ] WOR: Generated 1820 derivative records from 25288 primary records. [2025-09-29T02:25:11.783210] [DEBUG] [LOCAL ] WOR: Saving derivative data. [2025-09-29T02:25:11.811339] [DEBUG] [LOCAL ] WOLF: Derivative data saved (1820 records). [2025-09-29T02:25:11.812280] [DEBUG] [LOCAL ] WOW: Loaded 30769 existing records from primary storage. [2025-09-29T02:25:11.812841] [INFO ] [MAIN ] WOW: Loaded 30769 primary data records. [2025-09-29T02:25:11.813268] [INFO ] [MAIN ] WOLF: Successfully saved derivative data. [2025-09-29T02:25:11.828546] [INFO ] [MAIN ] Derivative Progress: 2156/2211 symbols completed. WOLF took 1.4s. Estimated remaining: 23.3s. Rate: 141.4 symbols/min [2025-09-29T02:25:11.868838] [INFO ] [MAIN ] WPC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:11.882436] [DEBUG] [LOCAL ] WOR: Derivative data saved (1820 records). [2025-09-29T02:25:11.917386] [INFO ] [MAIN ] WOR: Successfully saved derivative data. [2025-09-29T02:25:11.937914] [INFO ] [MAIN ] Derivative Progress: 2157/2211 symbols completed. WOR took 1.5s. Estimated remaining: 22.9s. Rate: 141.4 symbols/min [2025-09-29T02:25:11.951544] [INFO ] [MAIN ] WPM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:12.224966] [DEBUG] [LOCAL ] WPC: Loaded 49217 existing records from primary storage. [2025-09-29T02:25:12.225474] [INFO ] [MAIN ] WPC: Loaded 49217 primary data records. [2025-09-29T02:25:12.343136] [DEBUG] [MAIN ] WOW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:12.349204] [DEBUG] [LOCAL ] WPM: Loaded 53504 existing records from primary storage. [2025-09-29T02:25:12.378337] [INFO ] [MAIN ] WPM: Loaded 53504 primary data records. [2025-09-29T02:25:12.379972] [INFO ] [MAIN ] WOW: Generated 1820 derivative records from 30769 primary records. [2025-09-29T02:25:12.403071] [DEBUG] [LOCAL ] WOW: Saving derivative data. [2025-09-29T02:25:12.582898] [DEBUG] [LOCAL ] WOW: Derivative data saved (1820 records). [2025-09-29T02:25:12.712406] [INFO ] [MAIN ] WOW: Successfully saved derivative data. [2025-09-29T02:25:12.745613] [INFO ] [MAIN ] Derivative Progress: 2158/2211 symbols completed. WOW took 1.0s. Estimated remaining: 22.5s. Rate: 141.4 symbols/min [2025-09-29T02:25:13.048954] [DEBUG] [MAIN ] WPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:13.050200] [INFO ] [MAIN ] WPC: Generated 1820 derivative records from 49217 primary records. [2025-09-29T02:25:13.050298] [DEBUG] [LOCAL ] WPC: Saving derivative data. [2025-09-29T02:25:13.069434] [DEBUG] [LOCAL ] WPC: Derivative data saved (1820 records). [2025-09-29T02:25:13.069946] [INFO ] [MAIN ] WPC: Successfully saved derivative data. [2025-09-29T02:25:13.072546] [INFO ] [MAIN ] Derivative Progress: 2159/2211 symbols completed. WPC took 1.2s. Estimated remaining: 22.1s. Rate: 141.4 symbols/min [2025-09-29T02:25:13.089114] [DEBUG] [MAIN ] WPM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:13.089984] [INFO ] [MAIN ] WPM: Generated 1820 derivative records from 53504 primary records. [2025-09-29T02:25:13.090107] [DEBUG] [LOCAL ] WPM: Saving derivative data. [2025-09-29T02:25:13.106781] [DEBUG] [LOCAL ] WPM: Derivative data saved (1820 records). [2025-09-29T02:25:13.106979] [INFO ] [MAIN ] WPM: Successfully saved derivative data. [2025-09-29T02:25:13.110036] [INFO ] [MAIN ] Derivative Progress: 2160/2211 symbols completed. WPM took 1.2s. Estimated remaining: 21.6s. Rate: 141.5 symbols/min [2025-09-29T02:25:13.110768] [INFO ] [MAIN ] WPP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:13.110872] [INFO ] [MAIN ] WRB: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:13.110938] [INFO ] [MAIN ] WRBY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:13.168966] [DEBUG] [LOCAL ] WPP: Loaded 34282 existing records from primary storage. [2025-09-29T02:25:13.169395] [INFO ] [MAIN ] WPP: Loaded 34282 primary data records. [2025-09-29T02:25:13.319957] [DEBUG] [LOCAL ] WRBY: Loaded 51609 existing records from primary storage. [2025-09-29T02:25:13.321553] [INFO ] [MAIN ] WRBY: Loaded 51609 primary data records. [2025-09-29T02:25:13.368669] [DEBUG] [LOCAL ] WRB: Loaded 51313 existing records from primary storage. [2025-09-29T02:25:13.392909] [INFO ] [MAIN ] WRB: Loaded 51313 primary data records. [2025-09-29T02:25:14.284164] [DEBUG] [MAIN ] WPP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:14.287527] [INFO ] [MAIN ] WPP: Generated 1820 derivative records from 34282 primary records. [2025-09-29T02:25:14.287840] [DEBUG] [LOCAL ] WPP: Saving derivative data. [2025-09-29T02:25:14.309793] [DEBUG] [LOCAL ] WPP: Derivative data saved (1820 records). [2025-09-29T02:25:14.310768] [INFO ] [MAIN ] WPP: Successfully saved derivative data. [2025-09-29T02:25:14.313495] [INFO ] [MAIN ] Derivative Progress: 2161/2211 symbols completed. WPP took 1.2s. Estimated remaining: 21.2s. Rate: 141.3 symbols/min [2025-09-29T02:25:14.314011] [INFO ] [MAIN ] WS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:14.350206] [DEBUG] [MAIN ] WRB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:14.350574] [DEBUG] [MAIN ] WRBY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:14.352328] [INFO ] [MAIN ] WRB: Generated 1820 derivative records from 51313 primary records. [2025-09-29T02:25:14.351633] [INFO ] [MAIN ] WRBY: Generated 1820 derivative records from 51609 primary records. [2025-09-29T02:25:14.352459] [DEBUG] [LOCAL ] WRB: Saving derivative data. [2025-09-29T02:25:14.352586] [DEBUG] [LOCAL ] WRBY: Saving derivative data. [2025-09-29T02:25:14.401443] [DEBUG] [LOCAL ] WS: Loaded 24434 existing records from primary storage. [2025-09-29T02:25:14.402390] [INFO ] [MAIN ] WS: Loaded 24434 primary data records. [2025-09-29T02:25:14.402144] [DEBUG] [LOCAL ] WRBY: Derivative data saved (1820 records). [2025-09-29T02:25:14.400553] [DEBUG] [LOCAL ] WRB: Derivative data saved (1820 records). [2025-09-29T02:25:14.402795] [INFO ] [MAIN ] WRB: Successfully saved derivative data. [2025-09-29T02:25:14.438513] [INFO ] [MAIN ] WRBY: Successfully saved derivative data. [2025-09-29T02:25:14.438379] [INFO ] [MAIN ] Derivative Progress: 2162/2211 symbols completed. WRB took 1.3s. Estimated remaining: 20.8s. Rate: 141.4 symbols/min [2025-09-29T02:25:14.490339] [INFO ] [MAIN ] WSM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:14.495639] [INFO ] [MAIN ] Derivative Progress: 2163/2211 symbols completed. WRBY took 1.4s. Estimated remaining: 20.4s. Rate: 141.4 symbols/min [2025-09-29T02:25:14.522727] [INFO ] [MAIN ] WSO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:14.775035] [DEBUG] [LOCAL ] WSO: Loaded 25059 existing records from primary storage. [2025-09-29T02:25:14.790774] [INFO ] [MAIN ] WSO: Loaded 25059 primary data records. [2025-09-29T02:25:14.931411] [DEBUG] [LOCAL ] WSM: Loaded 50533 existing records from primary storage. [2025-09-29T02:25:14.973873] [INFO ] [MAIN ] WSM: Loaded 50533 primary data records. [2025-09-29T02:25:15.147575] [DEBUG] [MAIN ] WS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:15.221503] [INFO ] [MAIN ] WS: Generated 1820 derivative records from 24434 primary records. [2025-09-29T02:25:15.244552] [DEBUG] [LOCAL ] WS: Saving derivative data. [2025-09-29T02:25:15.571379] [DEBUG] [LOCAL ] WS: Derivative data saved (1820 records). [2025-09-29T02:25:15.571774] [INFO ] [MAIN ] WS: Successfully saved derivative data. [2025-09-29T02:25:15.573926] [INFO ] [MAIN ] Derivative Progress: 2164/2211 symbols completed. WS took 1.3s. Estimated remaining: 20.0s. Rate: 141.3 symbols/min [2025-09-29T02:25:15.574382] [INFO ] [MAIN ] WSR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:15.603795] [DEBUG] [MAIN ] WSO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:15.604809] [INFO ] [MAIN ] WSO: Generated 1820 derivative records from 25059 primary records. [2025-09-29T02:25:15.605254] [DEBUG] [LOCAL ] WSO: Saving derivative data. [2025-09-29T02:25:15.632902] [DEBUG] [LOCAL ] WSR: Loaded 23550 existing records from primary storage. [2025-09-29T02:25:15.635351] [INFO ] [MAIN ] WSR: Loaded 23550 primary data records. [2025-09-29T02:25:15.634005] [DEBUG] [LOCAL ] WSO: Derivative data saved (1820 records). [2025-09-29T02:25:15.641556] [INFO ] [MAIN ] WSO: Successfully saved derivative data. [2025-09-29T02:25:15.675094] [INFO ] [MAIN ] Derivative Progress: 2165/2211 symbols completed. WSO took 1.2s. Estimated remaining: 19.5s. Rate: 141.4 symbols/min [2025-09-29T02:25:15.719913] [INFO ] [MAIN ] WST: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:15.728583] [DEBUG] [MAIN ] WSM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:15.762631] [INFO ] [MAIN ] WSM: Generated 1820 derivative records from 50533 primary records. [2025-09-29T02:25:15.775386] [DEBUG] [LOCAL ] WSM: Saving derivative data. [2025-09-29T02:25:16.011312] [DEBUG] [LOCAL ] WSM: Derivative data saved (1820 records). [2025-09-29T02:25:16.012369] [INFO ] [MAIN ] WSM: Successfully saved derivative data. [2025-09-29T02:25:16.015991] [INFO ] [MAIN ] Derivative Progress: 2166/2211 symbols completed. WSM took 1.5s. Estimated remaining: 19.1s. Rate: 141.4 symbols/min [2025-09-29T02:25:16.016259] [INFO ] [MAIN ] WT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:16.078815] [DEBUG] [LOCAL ] WST: Loaded 38092 existing records from primary storage. [2025-09-29T02:25:16.079527] [DEBUG] [MAIN ] WSR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:16.080939] [INFO ] [MAIN ] WST: Loaded 38092 primary data records. [2025-09-29T02:25:16.081851] [INFO ] [MAIN ] WSR: Generated 1820 derivative records from 23550 primary records. [2025-09-29T02:25:16.096910] [DEBUG] [LOCAL ] WSR: Saving derivative data. [2025-09-29T02:25:16.242181] [DEBUG] [LOCAL ] WSR: Derivative data saved (1820 records). [2025-09-29T02:25:16.261533] [INFO ] [MAIN ] WSR: Successfully saved derivative data. [2025-09-29T02:25:16.304391] [INFO ] [MAIN ] Derivative Progress: 2167/2211 symbols completed. WSR took 0.7s. Estimated remaining: 18.7s. Rate: 141.4 symbols/min [2025-09-29T02:25:16.305906] [DEBUG] [LOCAL ] WT: Loaded 48354 existing records from primary storage. [2025-09-29T02:25:16.306156] [INFO ] [MAIN ] WT: Loaded 48354 primary data records. [2025-09-29T02:25:16.306232] [INFO ] [MAIN ] WTI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:16.853335] [DEBUG] [LOCAL ] WTI: Loaded 44472 existing records from primary storage. [2025-09-29T02:25:16.854709] [INFO ] [MAIN ] WTI: Loaded 44472 primary data records. [2025-09-29T02:25:17.000500] [DEBUG] [MAIN ] WST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:17.028565] [INFO ] [MAIN ] WST: Generated 1820 derivative records from 38092 primary records. [2025-09-29T02:25:17.050052] [DEBUG] [LOCAL ] WST: Saving derivative data. [2025-09-29T02:25:17.263934] [DEBUG] [LOCAL ] WST: Derivative data saved (1820 records). [2025-09-29T02:25:17.265686] [INFO ] [MAIN ] WST: Successfully saved derivative data. [2025-09-29T02:25:17.268827] [INFO ] [MAIN ] Derivative Progress: 2168/2211 symbols completed. WST took 1.5s. Estimated remaining: 18.3s. Rate: 141.3 symbols/min [2025-09-29T02:25:17.269189] [INFO ] [MAIN ] WTRG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:17.285383] [DEBUG] [MAIN ] WT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:17.286528] [INFO ] [MAIN ] WT: Generated 1820 derivative records from 48354 primary records. [2025-09-29T02:25:17.286853] [DEBUG] [LOCAL ] WT: Saving derivative data. [2025-09-29T02:25:17.306415] [DEBUG] [LOCAL ] WT: Derivative data saved (1820 records). [2025-09-29T02:25:17.306873] [INFO ] [MAIN ] WT: Successfully saved derivative data. [2025-09-29T02:25:17.310244] [INFO ] [MAIN ] Derivative Progress: 2169/2211 symbols completed. WT took 1.3s. Estimated remaining: 17.8s. Rate: 141.4 symbols/min [2025-09-29T02:25:17.311088] [INFO ] [MAIN ] WTS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:17.333935] [DEBUG] [MAIN ] WTI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:17.334738] [INFO ] [MAIN ] WTI: Generated 1820 derivative records from 44472 primary records. [2025-09-29T02:25:17.334865] [DEBUG] [LOCAL ] WTI: Saving derivative data. [2025-09-29T02:25:17.363429] [DEBUG] [LOCAL ] WTI: Derivative data saved (1820 records). [2025-09-29T02:25:17.379358] [INFO ] [MAIN ] WTI: Successfully saved derivative data. [2025-09-29T02:25:17.383313] [INFO ] [MAIN ] Derivative Progress: 2170/2211 symbols completed. WTI took 1.1s. Estimated remaining: 17.4s. Rate: 141.5 symbols/min [2025-09-29T02:25:17.383616] [INFO ] [MAIN ] WTTR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:17.380479] [DEBUG] [LOCAL ] WTS: Loaded 18597 existing records from primary storage. [2025-09-29T02:25:17.384369] [INFO ] [MAIN ] WTS: Loaded 18597 primary data records. [2025-09-29T02:25:17.525733] [DEBUG] [LOCAL ] WTRG: Loaded 51656 existing records from primary storage. [2025-09-29T02:25:17.543776] [INFO ] [MAIN ] WTRG: Loaded 51656 primary data records. [2025-09-29T02:25:17.913804] [DEBUG] [LOCAL ] WTTR: Loaded 45735 existing records from primary storage. [2025-09-29T02:25:17.918484] [INFO ] [MAIN ] WTTR: Loaded 45735 primary data records. [2025-09-29T02:25:18.495254] [DEBUG] [MAIN ] WTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:18.497094] [INFO ] [MAIN ] WTS: Generated 1820 derivative records from 18597 primary records. [2025-09-29T02:25:18.498912] [DEBUG] [LOCAL ] WTS: Saving derivative data. [2025-09-29T02:25:18.518840] [DEBUG] [LOCAL ] WTS: Derivative data saved (1820 records). [2025-09-29T02:25:18.520148] [INFO ] [MAIN ] WTS: Successfully saved derivative data. [2025-09-29T02:25:18.524309] [INFO ] [MAIN ] Derivative Progress: 2171/2211 symbols completed. WTS took 1.2s. Estimated remaining: 17.0s. Rate: 141.3 symbols/min [2025-09-29T02:25:18.524813] [INFO ] [MAIN ] WU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:18.540987] [DEBUG] [MAIN ] WTRG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:18.543769] [INFO ] [MAIN ] WTRG: Generated 1820 derivative records from 51656 primary records. [2025-09-29T02:25:18.544077] [DEBUG] [LOCAL ] WTRG: Saving derivative data. [2025-09-29T02:25:18.574371] [DEBUG] [LOCAL ] WTRG: Derivative data saved (1820 records). [2025-09-29T02:25:18.571306] [DEBUG] [MAIN ] WTTR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:18.574626] [INFO ] [MAIN ] WTRG: Successfully saved derivative data. [2025-09-29T02:25:18.578384] [INFO ] [MAIN ] Derivative Progress: 2172/2211 symbols completed. WTRG took 1.3s. Estimated remaining: 16.5s. Rate: 141.4 symbols/min [2025-09-29T02:25:18.578695] [INFO ] [MAIN ] WWW: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:18.579937] [INFO ] [MAIN ] WTTR: Generated 1820 derivative records from 45735 primary records. [2025-09-29T02:25:18.580193] [DEBUG] [LOCAL ] WTTR: Saving derivative data. [2025-09-29T02:25:18.599196] [DEBUG] [LOCAL ] WTTR: Derivative data saved (1820 records). [2025-09-29T02:25:18.599415] [INFO ] [MAIN ] WTTR: Successfully saved derivative data. [2025-09-29T02:25:18.602710] [INFO ] [MAIN ] Derivative Progress: 2173/2211 symbols completed. WTTR took 1.2s. Estimated remaining: 16.1s. Rate: 141.5 symbols/min [2025-09-29T02:25:18.645334] [DEBUG] [LOCAL ] WU: Loaded 54232 existing records from primary storage. [2025-09-29T02:25:18.645577] [INFO ] [MAIN ] WU: Loaded 54232 primary data records. [2025-09-29T02:25:18.836119] [DEBUG] [LOCAL ] WWW: Loaded 49906 existing records from primary storage. [2025-09-29T02:25:18.842138] [INFO ] [MAIN ] WWW: Loaded 49906 primary data records. [2025-09-29T02:25:19.402366] [DEBUG] [MAIN ] WU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:19.403923] [INFO ] [MAIN ] WU: Generated 1820 derivative records from 54232 primary records. [2025-09-29T02:25:19.404538] [DEBUG] [LOCAL ] WU: Saving derivative data. [2025-09-29T02:25:19.424278] [DEBUG] [LOCAL ] WU: Derivative data saved (1820 records). [2025-09-29T02:25:19.437457] [INFO ] [MAIN ] WU: Successfully saved derivative data. [2025-09-29T02:25:19.440357] [INFO ] [MAIN ] Derivative Progress: 2174/2211 symbols completed. WU took 0.9s. Estimated remaining: 15.7s. Rate: 141.4 symbols/min [2025-09-29T02:25:19.440839] [DEBUG] [MAIN ] WWW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:19.442518] [INFO ] [MAIN ] WWW: Generated 1820 derivative records from 49906 primary records. [2025-09-29T02:25:19.442713] [DEBUG] [LOCAL ] WWW: Saving derivative data. [2025-09-29T02:25:19.460620] [DEBUG] [LOCAL ] WWW: Derivative data saved (1820 records). [2025-09-29T02:25:19.460748] [INFO ] [MAIN ] WWW: Successfully saved derivative data. [2025-09-29T02:25:19.463705] [INFO ] [MAIN ] Derivative Progress: 2175/2211 symbols completed. WWW took 0.9s. Estimated remaining: 15.3s. Rate: 141.5 symbols/min [2025-09-29T02:25:19.464271] [INFO ] [MAIN ] WY: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:19.464539] [INFO ] [MAIN ] XHR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:19.464420] [INFO ] [MAIN ] XFLT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:19.505033] [DEBUG] [LOCAL ] XFLT: Loaded 30306 existing records from primary storage. [2025-09-29T02:25:19.505366] [INFO ] [MAIN ] XFLT: Loaded 30306 primary data records. [2025-09-29T02:25:19.685224] [DEBUG] [LOCAL ] XHR: Loaded 44680 existing records from primary storage. [2025-09-29T02:25:19.745407] [INFO ] [MAIN ] XHR: Loaded 44680 primary data records. [2025-09-29T02:25:19.979262] [DEBUG] [LOCAL ] WY: Loaded 53899 existing records from primary storage. [2025-09-29T02:25:19.979614] [INFO ] [MAIN ] WY: Loaded 53899 primary data records. [2025-09-29T02:25:20.674942] [DEBUG] [MAIN ] XFLT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:20.676195] [INFO ] [MAIN ] XFLT: Generated 1820 derivative records from 30306 primary records. [2025-09-29T02:25:20.676784] [DEBUG] [LOCAL ] XFLT: Saving derivative data. [2025-09-29T02:25:20.695713] [DEBUG] [LOCAL ] XFLT: Derivative data saved (1820 records). [2025-09-29T02:25:20.696067] [INFO ] [MAIN ] XFLT: Successfully saved derivative data. [2025-09-29T02:25:20.698733] [INFO ] [MAIN ] Derivative Progress: 2176/2211 symbols completed. XFLT took 1.2s. Estimated remaining: 14.9s. Rate: 141.3 symbols/min [2025-09-29T02:25:20.698950] [INFO ] [MAIN ] XOM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:20.718561] [DEBUG] [MAIN ] XHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:20.720133] [INFO ] [MAIN ] XHR: Generated 1820 derivative records from 44680 primary records. [2025-09-29T02:25:20.720224] [DEBUG] [LOCAL ] XHR: Saving derivative data. [2025-09-29T02:25:20.744345] [DEBUG] [LOCAL ] XHR: Derivative data saved (1820 records). [2025-09-29T02:25:20.745016] [INFO ] [MAIN ] XHR: Successfully saved derivative data. [2025-09-29T02:25:20.761742] [INFO ] [MAIN ] Derivative Progress: 2177/2211 symbols completed. XHR took 1.3s. Estimated remaining: 14.4s. Rate: 141.4 symbols/min [2025-09-29T02:25:20.762392] [DEBUG] [MAIN ] WY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:20.763809] [INFO ] [MAIN ] XPER: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:20.763630] [INFO ] [MAIN ] WY: Generated 1820 derivative records from 53899 primary records. [2025-09-29T02:25:20.764243] [DEBUG] [LOCAL ] WY: Saving derivative data. [2025-09-29T02:25:20.783531] [DEBUG] [LOCAL ] WY: Derivative data saved (1820 records). [2025-09-29T02:25:20.783737] [INFO ] [MAIN ] WY: Successfully saved derivative data. [2025-09-29T02:25:20.786604] [INFO ] [MAIN ] Derivative Progress: 2178/2211 symbols completed. WY took 1.3s. Estimated remaining: 14.0s. Rate: 141.5 symbols/min [2025-09-29T02:25:20.787171] [INFO ] [MAIN ] XPEV: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:20.829733] [DEBUG] [LOCAL ] XPER: Loaded 30181 existing records from primary storage. [2025-09-29T02:25:20.831765] [INFO ] [MAIN ] XPER: Loaded 30181 primary data records. [2025-09-29T02:25:20.926126] [DEBUG] [LOCAL ] XOM: Loaded 54573 existing records from primary storage. [2025-09-29T02:25:20.968737] [INFO ] [MAIN ] XOM: Loaded 54573 primary data records. [2025-09-29T02:25:21.211401] [DEBUG] [LOCAL ] XPEV: Loaded 54419 existing records from primary storage. [2025-09-29T02:25:21.339526] [INFO ] [MAIN ] XPEV: Loaded 54419 primary data records. [2025-09-29T02:25:22.027125] [DEBUG] [MAIN ] XPER: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:22.028552] [INFO ] [MAIN ] XPER: Generated 1820 derivative records from 30181 primary records. [2025-09-29T02:25:22.028814] [DEBUG] [LOCAL ] XPER: Saving derivative data. [2025-09-29T02:25:22.051130] [DEBUG] [LOCAL ] XPER: Derivative data saved (1820 records). [2025-09-29T02:25:22.051582] [INFO ] [MAIN ] XPER: Successfully saved derivative data. [2025-09-29T02:25:22.054307] [INFO ] [MAIN ] Derivative Progress: 2179/2211 symbols completed. XPER took 1.3s. Estimated remaining: 13.6s. Rate: 141.3 symbols/min [2025-09-29T02:25:22.055004] [INFO ] [MAIN ] XPO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:22.069383] [DEBUG] [MAIN ] XOM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:22.070877] [INFO ] [MAIN ] XOM: Generated 1820 derivative records from 54573 primary records. [2025-09-29T02:25:22.071101] [DEBUG] [LOCAL ] XOM: Saving derivative data. [2025-09-29T02:25:22.090161] [DEBUG] [LOCAL ] XOM: Derivative data saved (1820 records). [2025-09-29T02:25:22.090362] [INFO ] [MAIN ] XOM: Successfully saved derivative data. [2025-09-29T02:25:22.093305] [INFO ] [MAIN ] Derivative Progress: 2180/2211 symbols completed. XOM took 1.4s. Estimated remaining: 13.2s. Rate: 141.4 symbols/min [2025-09-29T02:25:22.093691] [INFO ] [MAIN ] XPOF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:22.116087] [DEBUG] [MAIN ] XPEV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:22.118432] [INFO ] [MAIN ] XPEV: Generated 1820 derivative records from 54419 primary records. [2025-09-29T02:25:22.118639] [DEBUG] [LOCAL ] XPEV: Saving derivative data. [2025-09-29T02:25:22.139112] [DEBUG] [LOCAL ] XPEV: Derivative data saved (1820 records). [2025-09-29T02:25:22.139551] [INFO ] [MAIN ] XPEV: Successfully saved derivative data. [2025-09-29T02:25:22.154949] [INFO ] [MAIN ] Derivative Progress: 2181/2211 symbols completed. XPEV took 1.4s. Estimated remaining: 12.7s. Rate: 141.4 symbols/min [2025-09-29T02:25:22.164026] [INFO ] [MAIN ] XPRO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:22.198467] [DEBUG] [LOCAL ] XPOF: Loaded 39243 existing records from primary storage. [2025-09-29T02:25:22.198904] [INFO ] [MAIN ] XPOF: Loaded 39243 primary data records. [2025-09-29T02:25:22.223302] [DEBUG] [LOCAL ] XPO: Loaded 48656 existing records from primary storage. [2025-09-29T02:25:22.248440] [INFO ] [MAIN ] XPO: Loaded 48656 primary data records. [2025-09-29T02:25:22.550122] [DEBUG] [LOCAL ] XPRO: Loaded 46617 existing records from primary storage. [2025-09-29T02:25:22.703071] [INFO ] [MAIN ] XPRO: Loaded 46617 primary data records. [2025-09-29T02:25:23.261327] [DEBUG] [MAIN ] XPOF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:23.262470] [INFO ] [MAIN ] XPOF: Generated 1820 derivative records from 39243 primary records. [2025-09-29T02:25:23.262814] [DEBUG] [LOCAL ] XPOF: Saving derivative data. [2025-09-29T02:25:23.299568] [DEBUG] [MAIN ] XPO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:23.298137] [DEBUG] [LOCAL ] XPOF: Derivative data saved (1820 records). [2025-09-29T02:25:23.300593] [INFO ] [MAIN ] XPO: Generated 1820 derivative records from 48656 primary records. [2025-09-29T02:25:23.301138] [INFO ] [MAIN ] XPOF: Successfully saved derivative data. [2025-09-29T02:25:23.301034] [DEBUG] [LOCAL ] XPO: Saving derivative data. [2025-09-29T02:25:23.304522] [INFO ] [MAIN ] Derivative Progress: 2182/2211 symbols completed. XPOF took 1.2s. Estimated remaining: 12.3s. Rate: 141.3 symbols/min [2025-09-29T02:25:23.305019] [INFO ] [MAIN ] XYF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:23.327558] [DEBUG] [LOCAL ] XPO: Derivative data saved (1820 records). [2025-09-29T02:25:23.336180] [INFO ] [MAIN ] XPO: Successfully saved derivative data. [2025-09-29T02:25:23.345003] [INFO ] [MAIN ] Derivative Progress: 2183/2211 symbols completed. XPO took 1.3s. Estimated remaining: 11.9s. Rate: 141.4 symbols/min [2025-09-29T02:25:23.345979] [DEBUG] [MAIN ] XPRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:23.346142] [INFO ] [MAIN ] XYL: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:23.347668] [INFO ] [MAIN ] XPRO: Generated 1820 derivative records from 46617 primary records. [2025-09-29T02:25:23.348039] [DEBUG] [LOCAL ] XPRO: Saving derivative data. [2025-09-29T02:25:23.377605] [DEBUG] [LOCAL ] XPRO: Derivative data saved (1820 records). [2025-09-29T02:25:23.378079] [INFO ] [MAIN ] XPRO: Successfully saved derivative data. [2025-09-29T02:25:23.381048] [INFO ] [MAIN ] Derivative Progress: 2184/2211 symbols completed. XPRO took 1.2s. Estimated remaining: 11.5s. Rate: 141.4 symbols/min [2025-09-29T02:25:23.381849] [INFO ] [MAIN ] YALA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:23.393751] [DEBUG] [LOCAL ] XYF: Loaded 28464 existing records from primary storage. [2025-09-29T02:25:23.394191] [INFO ] [MAIN ] XYF: Loaded 28464 primary data records. [2025-09-29T02:25:23.714420] [DEBUG] [LOCAL ] YALA: Loaded 37892 existing records from primary storage. [2025-09-29T02:25:23.713417] [DEBUG] [LOCAL ] XYL: Loaded 48777 existing records from primary storage. [2025-09-29T02:25:23.833363] [INFO ] [MAIN ] YALA: Loaded 37892 primary data records. [2025-09-29T02:25:23.833500] [INFO ] [MAIN ] XYL: Loaded 48777 primary data records. [2025-09-29T02:25:24.619014] [DEBUG] [MAIN ] XYF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:24.620753] [INFO ] [MAIN ] XYF: Generated 1820 derivative records from 28464 primary records. [2025-09-29T02:25:24.621405] [DEBUG] [LOCAL ] XYF: Saving derivative data. [2025-09-29T02:25:24.645599] [DEBUG] [LOCAL ] XYF: Derivative data saved (1820 records). [2025-09-29T02:25:24.646068] [INFO ] [MAIN ] XYF: Successfully saved derivative data. [2025-09-29T02:25:24.649054] [INFO ] [MAIN ] Derivative Progress: 2185/2211 symbols completed. XYF took 1.3s. Estimated remaining: 11.0s. Rate: 141.3 symbols/min [2025-09-29T02:25:24.649842] [INFO ] [MAIN ] YELP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:24.669328] [DEBUG] [MAIN ] YALA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:24.674282] [INFO ] [MAIN ] YALA: Generated 1820 derivative records from 37892 primary records. [2025-09-29T02:25:24.674961] [DEBUG] [LOCAL ] YALA: Saving derivative data. [2025-09-29T02:25:24.697275] [DEBUG] [MAIN ] XYL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:24.703432] [INFO ] [MAIN ] XYL: Generated 1820 derivative records from 48777 primary records. [2025-09-29T02:25:24.706942] [DEBUG] [LOCAL ] YALA: Derivative data saved (1820 records). [2025-09-29T02:25:24.707240] [DEBUG] [LOCAL ] XYL: Saving derivative data. [2025-09-29T02:25:24.707377] [INFO ] [MAIN ] YALA: Successfully saved derivative data. [2025-09-29T02:25:24.710729] [INFO ] [MAIN ] Derivative Progress: 2186/2211 symbols completed. YALA took 1.3s. Estimated remaining: 10.6s. Rate: 141.4 symbols/min [2025-09-29T02:25:24.711053] [INFO ] [MAIN ] YETI: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:24.742702] [DEBUG] [LOCAL ] XYL: Derivative data saved (1820 records). [2025-09-29T02:25:24.742869] [INFO ] [MAIN ] XYL: Successfully saved derivative data. [2025-09-29T02:25:24.745730] [INFO ] [MAIN ] Derivative Progress: 2187/2211 symbols completed. XYL took 1.4s. Estimated remaining: 10.2s. Rate: 141.4 symbols/min [2025-09-29T02:25:24.746001] [INFO ] [MAIN ] YEXT: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:24.765973] [DEBUG] [LOCAL ] YELP: Loaded 45909 existing records from primary storage. [2025-09-29T02:25:24.766271] [INFO ] [MAIN ] YELP: Loaded 45909 primary data records. [2025-09-29T02:25:25.162766] [DEBUG] [LOCAL ] YEXT: Loaded 43863 existing records from primary storage. [2025-09-29T02:25:25.163141] [INFO ] [MAIN ] YEXT: Loaded 43863 primary data records. [2025-09-29T02:25:25.189173] [DEBUG] [LOCAL ] YETI: Loaded 53216 existing records from primary storage. [2025-09-29T02:25:25.221010] [INFO ] [MAIN ] YETI: Loaded 53216 primary data records. [2025-09-29T02:25:25.889582] [DEBUG] [MAIN ] YELP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:25.891944] [INFO ] [MAIN ] YELP: Generated 1820 derivative records from 45909 primary records. [2025-09-29T02:25:25.892973] [DEBUG] [LOCAL ] YELP: Saving derivative data. [2025-09-29T02:25:25.912523] [DEBUG] [LOCAL ] YELP: Derivative data saved (1820 records). [2025-09-29T02:25:25.916531] [INFO ] [MAIN ] YELP: Successfully saved derivative data. [2025-09-29T02:25:25.929419] [INFO ] [MAIN ] Derivative Progress: 2188/2211 symbols completed. YELP took 1.3s. Estimated remaining: 9.8s. Rate: 141.3 symbols/min [2025-09-29T02:25:25.935603] [DEBUG] [MAIN ] YEXT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:25.937414] [INFO ] [MAIN ] YEXT: Generated 1820 derivative records from 43863 primary records. [2025-09-29T02:25:25.937622] [DEBUG] [LOCAL ] YEXT: Saving derivative data. [2025-09-29T02:25:25.955690] [DEBUG] [LOCAL ] YEXT: Derivative data saved (1820 records). [2025-09-29T02:25:25.957231] [INFO ] [MAIN ] YEXT: Successfully saved derivative data. [2025-09-29T02:25:25.961679] [INFO ] [MAIN ] Derivative Progress: 2189/2211 symbols completed. YEXT took 1.2s. Estimated remaining: 9.3s. Rate: 141.4 symbols/min [2025-09-29T02:25:25.975225] [DEBUG] [MAIN ] YETI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:25.976066] [INFO ] [MAIN ] YETI: Generated 1820 derivative records from 53216 primary records. [2025-09-29T02:25:25.976156] [DEBUG] [LOCAL ] YETI: Saving derivative data. [2025-09-29T02:25:25.992504] [DEBUG] [LOCAL ] YETI: Derivative data saved (1820 records). [2025-09-29T02:25:25.992610] [INFO ] [MAIN ] YETI: Successfully saved derivative data. [2025-09-29T02:25:25.996081] [INFO ] [MAIN ] Derivative Progress: 2190/2211 symbols completed. YETI took 1.3s. Estimated remaining: 8.9s. Rate: 141.4 symbols/min [2025-09-29T02:25:25.996852] [INFO ] [MAIN ] YMM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:25.997426] [INFO ] [MAIN ] YPF: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:25.997602] [INFO ] [MAIN ] YOU: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:26.119615] [DEBUG] [LOCAL ] YMM: Loaded 53425 existing records from primary storage. [2025-09-29T02:25:26.121769] [DEBUG] [LOCAL ] YPF: Loaded 51252 existing records from primary storage. [2025-09-29T02:25:26.121936] [INFO ] [MAIN ] YMM: Loaded 53425 primary data records. [2025-09-29T02:25:26.122892] [DEBUG] [LOCAL ] YOU: Loaded 50504 existing records from primary storage. [2025-09-29T02:25:26.145773] [INFO ] [MAIN ] YOU: Loaded 50504 primary data records. [2025-09-29T02:25:26.123452] [INFO ] [MAIN ] YPF: Loaded 51252 primary data records. [2025-09-29T02:25:27.235861] [DEBUG] [MAIN ] YMM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:27.237827] [INFO ] [MAIN ] YMM: Generated 1820 derivative records from 53425 primary records. [2025-09-29T02:25:27.251343] [DEBUG] [LOCAL ] YMM: Saving derivative data. [2025-09-29T02:25:27.251634] [DEBUG] [MAIN ] YPF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:27.255163] [INFO ] [MAIN ] YPF: Generated 1820 derivative records from 51252 primary records. [2025-09-29T02:25:27.255283] [DEBUG] [LOCAL ] YPF: Saving derivative data. [2025-09-29T02:25:27.288867] [DEBUG] [LOCAL ] YMM: Derivative data saved (1820 records). [2025-09-29T02:25:27.297942] [INFO ] [MAIN ] YMM: Successfully saved derivative data. [2025-09-29T02:25:27.301521] [DEBUG] [MAIN ] YOU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:27.305381] [INFO ] [MAIN ] YOU: Generated 1820 derivative records from 50504 primary records. [2025-09-29T02:25:27.303972] [INFO ] [MAIN ] Derivative Progress: 2191/2211 symbols completed. YMM took 1.3s. Estimated remaining: 8.5s. Rate: 141.3 symbols/min [2025-09-29T02:25:27.305844] [DEBUG] [LOCAL ] YOU: Saving derivative data. [2025-09-29T02:25:27.307472] [DEBUG] [LOCAL ] YPF: Derivative data saved (1820 records). [2025-09-29T02:25:27.306236] [INFO ] [MAIN ] YRD: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:27.308168] [INFO ] [MAIN ] YPF: Successfully saved derivative data. [2025-09-29T02:25:27.311142] [INFO ] [MAIN ] Derivative Progress: 2192/2211 symbols completed. YPF took 1.3s. Estimated remaining: 8.1s. Rate: 141.4 symbols/min [2025-09-29T02:25:27.319517] [INFO ] [MAIN ] YSG: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:27.329561] [DEBUG] [LOCAL ] YOU: Derivative data saved (1820 records). [2025-09-29T02:25:27.329926] [INFO ] [MAIN ] YOU: Successfully saved derivative data. [2025-09-29T02:25:27.333041] [INFO ] [MAIN ] Derivative Progress: 2193/2211 symbols completed. YOU took 1.3s. Estimated remaining: 7.6s. Rate: 141.4 symbols/min [2025-09-29T02:25:27.336675] [INFO ] [MAIN ] YUM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:27.343917] [DEBUG] [LOCAL ] YRD: Loaded 12726 existing records from primary storage. [2025-09-29T02:25:27.344276] [INFO ] [MAIN ] YRD: Loaded 12726 primary data records. [2025-09-29T02:25:27.478560] [DEBUG] [LOCAL ] YSG: Loaded 25485 existing records from primary storage. [2025-09-29T02:25:27.482840] [INFO ] [MAIN ] YSG: Loaded 25485 primary data records. [2025-09-29T02:25:27.983524] [DEBUG] [LOCAL ] YUM: Loaded 51931 existing records from primary storage. [2025-09-29T02:25:28.070333] [INFO ] [MAIN ] YUM: Loaded 51931 primary data records. [2025-09-29T02:25:28.445105] [DEBUG] [MAIN ] YRD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:28.447168] [INFO ] [MAIN ] YRD: Generated 1820 derivative records from 12726 primary records. [2025-09-29T02:25:28.450402] [DEBUG] [LOCAL ] YRD: Saving derivative data. [2025-09-29T02:25:28.477293] [DEBUG] [MAIN ] YSG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:28.484896] [DEBUG] [LOCAL ] YRD: Derivative data saved (1820 records). [2025-09-29T02:25:28.486597] [INFO ] [MAIN ] YSG: Generated 1820 derivative records from 25485 primary records. [2025-09-29T02:25:28.487861] [INFO ] [MAIN ] YRD: Successfully saved derivative data. [2025-09-29T02:25:28.491432] [INFO ] [MAIN ] Derivative Progress: 2194/2211 symbols completed. YRD took 1.2s. Estimated remaining: 7.2s. Rate: 141.3 symbols/min [2025-09-29T02:25:28.488115] [DEBUG] [LOCAL ] YSG: Saving derivative data. [2025-09-29T02:25:28.492057] [INFO ] [MAIN ] YUMC: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:28.512772] [DEBUG] [LOCAL ] YSG: Derivative data saved (1820 records). [2025-09-29T02:25:28.512974] [INFO ] [MAIN ] YSG: Successfully saved derivative data. [2025-09-29T02:25:28.515731] [INFO ] [MAIN ] Derivative Progress: 2195/2211 symbols completed. YSG took 1.2s. Estimated remaining: 6.8s. Rate: 141.4 symbols/min [2025-09-29T02:25:28.516241] [INFO ] [MAIN ] ZBH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:28.542156] [DEBUG] [MAIN ] YUM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:28.543277] [INFO ] [MAIN ] YUM: Generated 1820 derivative records from 51931 primary records. [2025-09-29T02:25:28.543522] [DEBUG] [LOCAL ] YUM: Saving derivative data. [2025-09-29T02:25:28.568996] [DEBUG] [LOCAL ] YUM: Derivative data saved (1820 records). [2025-09-29T02:25:28.583284] [INFO ] [MAIN ] YUM: Successfully saved derivative data. [2025-09-29T02:25:28.587050] [INFO ] [MAIN ] Derivative Progress: 2196/2211 symbols completed. YUM took 1.3s. Estimated remaining: 6.4s. Rate: 141.4 symbols/min [2025-09-29T02:25:28.587580] [INFO ] [MAIN ] ZEPP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:28.613318] [DEBUG] [LOCAL ] YUMC: Loaded 53455 existing records from primary storage. [2025-09-29T02:25:28.627153] [INFO ] [MAIN ] YUMC: Loaded 53455 primary data records. [2025-09-29T02:25:28.717370] [DEBUG] [LOCAL ] ZEPP: Loaded 17335 existing records from primary storage. [2025-09-29T02:25:28.741815] [INFO ] [MAIN ] ZEPP: Loaded 17335 primary data records. [2025-09-29T02:25:28.854029] [DEBUG] [LOCAL ] ZBH: Loaded 51948 existing records from primary storage. [2025-09-29T02:25:28.963940] [INFO ] [MAIN ] ZBH: Loaded 51948 primary data records. [2025-09-29T02:25:29.800985] [DEBUG] [MAIN ] YUMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:29.802690] [INFO ] [MAIN ] YUMC: Generated 1820 derivative records from 53455 primary records. [2025-09-29T02:25:29.802804] [DEBUG] [LOCAL ] YUMC: Saving derivative data. [2025-09-29T02:25:29.825026] [DEBUG] [LOCAL ] YUMC: Derivative data saved (1820 records). [2025-09-29T02:25:29.833566] [INFO ] [MAIN ] YUMC: Successfully saved derivative data. [2025-09-29T02:25:29.842720] [INFO ] [MAIN ] Derivative Progress: 2197/2211 symbols completed. YUMC took 1.4s. Estimated remaining: 5.9s. Rate: 141.3 symbols/min [2025-09-29T02:25:29.839790] [DEBUG] [MAIN ] ZEPP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:29.843029] [INFO ] [MAIN ] ZETA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:29.844588] [INFO ] [MAIN ] ZEPP: Generated 1820 derivative records from 17335 primary records. [2025-09-29T02:25:29.845623] [DEBUG] [LOCAL ] ZEPP: Saving derivative data. [2025-09-29T02:25:29.869495] [DEBUG] [LOCAL ] ZEPP: Derivative data saved (1820 records). [2025-09-29T02:25:29.872438] [INFO ] [MAIN ] ZEPP: Successfully saved derivative data. [2025-09-29T02:25:29.876607] [INFO ] [MAIN ] Derivative Progress: 2198/2211 symbols completed. ZEPP took 1.3s. Estimated remaining: 5.5s. Rate: 141.4 symbols/min [2025-09-29T02:25:29.877092] [INFO ] [MAIN ] ZGN: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:29.892559] [DEBUG] [MAIN ] ZBH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:29.893603] [INFO ] [MAIN ] ZBH: Generated 1820 derivative records from 51948 primary records. [2025-09-29T02:25:29.893720] [DEBUG] [LOCAL ] ZBH: Saving derivative data. [2025-09-29T02:25:29.911434] [DEBUG] [LOCAL ] ZBH: Derivative data saved (1820 records). [2025-09-29T02:25:29.911615] [INFO ] [MAIN ] ZBH: Successfully saved derivative data. [2025-09-29T02:25:29.915401] [INFO ] [MAIN ] Derivative Progress: 2199/2211 symbols completed. ZBH took 1.4s. Estimated remaining: 5.1s. Rate: 141.4 symbols/min [2025-09-29T02:25:29.915850] [INFO ] [MAIN ] ZH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:29.982869] [DEBUG] [LOCAL ] ZH: Loaded 27298 existing records from primary storage. [2025-09-29T02:25:29.991666] [INFO ] [MAIN ] ZH: Loaded 27298 primary data records. [2025-09-29T02:25:29.993891] [DEBUG] [LOCAL ] ZETA: Loaded 54375 existing records from primary storage. [2025-09-29T02:25:30.016241] [INFO ] [MAIN ] ZETA: Loaded 54375 primary data records. [2025-09-29T02:25:30.141147] [DEBUG] [LOCAL ] ZGN: Loaded 41333 existing records from primary storage. [2025-09-29T02:25:30.199485] [INFO ] [MAIN ] ZGN: Loaded 41333 primary data records. [2025-09-29T02:25:31.108313] [DEBUG] [MAIN ] ZH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:31.117126] [INFO ] [MAIN ] ZH: Generated 1820 derivative records from 27298 primary records. [2025-09-29T02:25:31.121699] [DEBUG] [LOCAL ] ZH: Saving derivative data. [2025-09-29T02:25:31.122884] [DEBUG] [MAIN ] ZETA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:31.124267] [INFO ] [MAIN ] ZETA: Generated 1820 derivative records from 54375 primary records. [2025-09-29T02:25:31.124543] [DEBUG] [LOCAL ] ZETA: Saving derivative data. [2025-09-29T02:25:31.159045] [DEBUG] [LOCAL ] ZH: Derivative data saved (1820 records). [2025-09-29T02:25:31.159334] [INFO ] [MAIN ] ZH: Successfully saved derivative data. [2025-09-29T02:25:31.169210] [INFO ] [MAIN ] Derivative Progress: 2200/2211 symbols completed. ZH took 1.3s. Estimated remaining: 4.7s. Rate: 141.3 symbols/min [2025-09-29T02:25:31.155946] [DEBUG] [LOCAL ] ZETA: Derivative data saved (1820 records). [2025-09-29T02:25:31.174410] [INFO ] [MAIN ] ZETA: Successfully saved derivative data. [2025-09-29T02:25:31.175241] [DEBUG] [MAIN ] ZGN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:31.174504] [INFO ] [MAIN ] ZIM: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:31.177957] [INFO ] [MAIN ] Derivative Progress: 2201/2211 symbols completed. ZETA took 1.3s. Estimated remaining: 4.2s. Rate: 141.4 symbols/min [2025-09-29T02:25:31.179189] [INFO ] [MAIN ] ZGN: Generated 1820 derivative records from 41333 primary records. [2025-09-29T02:25:31.179401] [INFO ] [MAIN ] ZIP: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:31.179707] [DEBUG] [LOCAL ] ZGN: Saving derivative data. [2025-09-29T02:25:31.198718] [DEBUG] [LOCAL ] ZGN: Derivative data saved (1820 records). [2025-09-29T02:25:31.199064] [INFO ] [MAIN ] ZGN: Successfully saved derivative data. [2025-09-29T02:25:31.201801] [INFO ] [MAIN ] Derivative Progress: 2202/2211 symbols completed. ZGN took 1.3s. Estimated remaining: 3.8s. Rate: 141.4 symbols/min [2025-09-29T02:25:31.202150] [INFO ] [MAIN ] ZK: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:31.265393] [DEBUG] [LOCAL ] ZIP: Loaded 44952 existing records from primary storage. [2025-09-29T02:25:31.265697] [INFO ] [MAIN ] ZIP: Loaded 44952 primary data records. [2025-09-29T02:25:31.400331] [DEBUG] [LOCAL ] ZK: Loaded 40504 existing records from primary storage. [2025-09-29T02:25:31.409138] [DEBUG] [LOCAL ] ZIM: Loaded 54298 existing records from primary storage. [2025-09-29T02:25:31.409345] [INFO ] [MAIN ] ZK: Loaded 40504 primary data records. [2025-09-29T02:25:31.420782] [INFO ] [MAIN ] ZIM: Loaded 54298 primary data records. [2025-09-29T02:25:32.396844] [DEBUG] [MAIN ] ZIP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:32.400167] [INFO ] [MAIN ] ZIP: Generated 1820 derivative records from 44952 primary records. [2025-09-29T02:25:32.401621] [DEBUG] [LOCAL ] ZIP: Saving derivative data. [2025-09-29T02:25:32.421757] [DEBUG] [LOCAL ] ZIP: Derivative data saved (1820 records). [2025-09-29T02:25:32.422367] [INFO ] [MAIN ] ZIP: Successfully saved derivative data. [2025-09-29T02:25:32.425240] [INFO ] [MAIN ] Derivative Progress: 2203/2211 symbols completed. ZIP took 1.2s. Estimated remaining: 3.4s. Rate: 141.3 symbols/min [2025-09-29T02:25:32.447803] [DEBUG] [MAIN ] ZK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:32.448902] [INFO ] [MAIN ] ZK: Generated 1820 derivative records from 40504 primary records. [2025-09-29T02:25:32.449094] [DEBUG] [LOCAL ] ZK: Saving derivative data. [2025-09-29T02:25:32.469101] [DEBUG] [MAIN ] ZIM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:32.478694] [INFO ] [MAIN ] ZIM: Generated 1820 derivative records from 54298 primary records. [2025-09-29T02:25:32.487925] [DEBUG] [LOCAL ] ZK: Derivative data saved (1820 records). [2025-09-29T02:25:32.488058] [DEBUG] [LOCAL ] ZIM: Saving derivative data. [2025-09-29T02:25:32.488286] [INFO ] [MAIN ] ZK: Successfully saved derivative data. [2025-09-29T02:25:32.492102] [INFO ] [MAIN ] Derivative Progress: 2204/2211 symbols completed. ZK took 1.3s. Estimated remaining: 3.0s. Rate: 141.4 symbols/min [2025-09-29T02:25:32.517880] [DEBUG] [LOCAL ] ZIM: Derivative data saved (1820 records). [2025-09-29T02:25:32.518082] [INFO ] [MAIN ] ZIM: Successfully saved derivative data. [2025-09-29T02:25:32.522039] [INFO ] [MAIN ] Derivative Progress: 2205/2211 symbols completed. ZIM took 1.3s. Estimated remaining: 2.5s. Rate: 141.4 symbols/min [2025-09-29T02:25:32.522780] [INFO ] [MAIN ] ZTR: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:32.522602] [INFO ] [MAIN ] ZKH: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:32.523706] [INFO ] [MAIN ] ZTO: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:32.543485] [DEBUG] [LOCAL ] ZKH: Loaded 8119 existing records from primary storage. [2025-09-29T02:25:32.543905] [INFO ] [MAIN ] ZKH: Loaded 8119 primary data records. [2025-09-29T02:25:32.614630] [DEBUG] [LOCAL ] ZTR: Loaded 16911 existing records from primary storage. [2025-09-29T02:25:32.614824] [INFO ] [MAIN ] ZTR: Loaded 16911 primary data records. [2025-09-29T02:25:33.125323] [DEBUG] [LOCAL ] ZTO: Loaded 50751 existing records from primary storage. [2025-09-29T02:25:33.132748] [INFO ] [MAIN ] ZTO: Loaded 50751 primary data records. [2025-09-29T02:25:33.706966] [DEBUG] [MAIN ] ZKH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:33.721761] [INFO ] [MAIN ] ZKH: Generated 1820 derivative records from 8119 primary records. [2025-09-29T02:25:33.722187] [DEBUG] [LOCAL ] ZKH: Saving derivative data. [2025-09-29T02:25:33.723129] [DEBUG] [MAIN ] ZTR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:33.725131] [INFO ] [MAIN ] ZTR: Generated 1820 derivative records from 16911 primary records. [2025-09-29T02:25:33.725807] [DEBUG] [LOCAL ] ZTR: Saving derivative data. [2025-09-29T02:25:33.741407] [DEBUG] [LOCAL ] ZKH: Derivative data saved (1820 records). [2025-09-29T02:25:33.748507] [INFO ] [MAIN ] ZKH: Successfully saved derivative data. [2025-09-29T02:25:33.754014] [INFO ] [MAIN ] Derivative Progress: 2206/2211 symbols completed. ZKH took 1.2s. Estimated remaining: 2.1s. Rate: 141.3 symbols/min [2025-09-29T02:25:33.759981] [INFO ] [MAIN ] ZTS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:33.762523] [DEBUG] [LOCAL ] ZTR: Derivative data saved (1820 records). [2025-09-29T02:25:33.763474] [INFO ] [MAIN ] ZTR: Successfully saved derivative data. [2025-09-29T02:25:33.765926] [INFO ] [MAIN ] Derivative Progress: 2207/2211 symbols completed. ZTR took 1.2s. Estimated remaining: 1.7s. Rate: 141.4 symbols/min [2025-09-29T02:25:33.766366] [INFO ] [MAIN ] ZVIA: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:33.787199] [DEBUG] [MAIN ] ZTO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:33.788154] [INFO ] [MAIN ] ZTO: Generated 1820 derivative records from 50751 primary records. [2025-09-29T02:25:33.788303] [DEBUG] [LOCAL ] ZTO: Saving derivative data. [2025-09-29T02:25:33.806481] [DEBUG] [LOCAL ] ZTO: Derivative data saved (1820 records). [2025-09-29T02:25:33.816473] [INFO ] [MAIN ] ZTO: Successfully saved derivative data. [2025-09-29T02:25:33.820836] [INFO ] [MAIN ] Derivative Progress: 2208/2211 symbols completed. ZTO took 1.3s. Estimated remaining: 1.3s. Rate: 141.4 symbols/min [2025-09-29T02:25:33.821115] [INFO ] [MAIN ] ZWS: Starting derivative data generation with 30-minute intervals. [2025-09-29T02:25:33.838930] [DEBUG] [LOCAL ] ZVIA: Loaded 35966 existing records from primary storage. [2025-09-29T02:25:33.839358] [INFO ] [MAIN ] ZVIA: Loaded 35966 primary data records. [2025-09-29T02:25:34.015447] [DEBUG] [LOCAL ] ZTS: Loaded 53775 existing records from primary storage. [2025-09-29T02:25:34.058272] [INFO ] [MAIN ] ZTS: Loaded 53775 primary data records. [2025-09-29T02:25:34.295354] [DEBUG] [LOCAL ] ZWS: Loaded 43134 existing records from primary storage. [2025-09-29T02:25:34.315824] [INFO ] [MAIN ] ZWS: Loaded 43134 primary data records. [2025-09-29T02:25:34.899438] [DEBUG] [MAIN ] ZVIA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:34.902471] [INFO ] [MAIN ] ZVIA: Generated 1820 derivative records from 35966 primary records. [2025-09-29T02:25:34.903003] [DEBUG] [LOCAL ] ZVIA: Saving derivative data. [2025-09-29T02:25:34.920696] [DEBUG] [LOCAL ] ZVIA: Derivative data saved (1820 records). [2025-09-29T02:25:34.920921] [INFO ] [MAIN ] ZVIA: Successfully saved derivative data. [2025-09-29T02:25:34.924483] [INFO ] [MAIN ] Derivative Progress: 2209/2211 symbols completed. ZVIA took 1.2s. Estimated remaining: 0.8s. Rate: 141.3 symbols/min [2025-09-29T02:25:34.943930] [DEBUG] [MAIN ] ZTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:34.944793] [INFO ] [MAIN ] ZTS: Generated 1820 derivative records from 53775 primary records. [2025-09-29T02:25:34.945116] [DEBUG] [LOCAL ] ZTS: Saving derivative data. [2025-09-29T02:25:34.964766] [DEBUG] [LOCAL ] ZTS: Derivative data saved (1820 records). [2025-09-29T02:25:34.964936] [INFO ] [MAIN ] ZTS: Successfully saved derivative data. [2025-09-29T02:25:34.968113] [INFO ] [MAIN ] Derivative Progress: 2210/2211 symbols completed. ZTS took 1.2s. Estimated remaining: 0.4s. Rate: 141.4 symbols/min [2025-09-29T02:25:34.981055] [DEBUG] [MAIN ] ZWS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-29T02:25:34.981795] [INFO ] [MAIN ] ZWS: Generated 1820 derivative records from 43134 primary records. [2025-09-29T02:25:34.981883] [DEBUG] [LOCAL ] ZWS: Saving derivative data. [2025-09-29T02:25:34.997755] [DEBUG] [LOCAL ] ZWS: Derivative data saved (1820 records). [2025-09-29T02:25:34.997888] [INFO ] [MAIN ] ZWS: Successfully saved derivative data. [2025-09-29T02:25:35.000797] [INFO ] [MAIN ] Derivative Progress: 2211/2211 symbols completed. ZWS took 1.2s. Estimated remaining: 0.0s. Rate: 141.4 symbols/min [2025-09-29T02:25:35.001872] [INFO ] [MAIN ] Parallel derivative generation completed in 15m 38s [2025-09-29T02:25:35.002157] [INFO ] [MAIN ] Derivative generation success rate: 100.0% (2211/2211 symbols) [2025-09-29T02:25:35.662838] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Derivative Generation Completed (2211/2211 @ 100.00%)' [2025-09-29T02:25:35.663501] [INFO ] [MAIN ] Both primary update and derivative generation completed successfully. [2025-09-29T02:25:35.664016] [WARN ] [STATE ] State set to: COMPLETED_OK [2025-09-29T02:25:35.664405] [INFO ] [STATE ] Last completion updated: 2025-09-29T02:25:35.664099 [2025-09-29T17:00:01.397776] [INFO ] [MAIN ] Using last completed trading day: 2025-09-29 [2025-09-29T17:00:01.612134] [DEBUG] [R-STATUS ] Registered 'tdm' as a dependent service. [2025-09-29T17:00:01.612321] [INFO ] [STATE ] Waiting for all dependent services to be clear... [2025-09-29T17:00:01.921490] [WARN ] [tdm-status] Service 'tdm' is not running. [2025-09-29T17:00:01.922162] [WARN ] [STATE ] State set to: RUNNING [2025-09-29T17:00:01.922248] [INFO ] [MAIN ] Refreshing symbols list before update... [2025-09-29T17:00:01.922297] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-09-29T17:00:01.922384] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-09-29T17:00:01.922422] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-09-29T17:00:02.862629] [DEBUG] [SYMBOL ] Found 2423 valid NYSE symbols. [2025-09-29T17:00:02.862850] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-09-29T17:00:02.863055] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-09-29T17:00:02.863790] [INFO ] [LOCAL ] Symbols cache updated with 2371 symbols. [2025-09-29T17:00:02.863851] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-09-29T17:00:02.863884] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-09-29T17:00:02.863941] [INFO ] [MAIN ] Pruning stale symbols... [2025-09-29T17:00:02.863974] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-09-29T17:00:02.864030] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-29T17:00:02.864421] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-09-29T17:00:02.864474] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-29T17:00:02.864695] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-09-29T17:00:02.864775] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2371 valid symbols. [2025-09-29T17:00:02.864810] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-09-29T17:00:02.864843] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-09-29T17:00:02.893431] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-09-29T17:00:02.922397] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-09-29T17:00:02.922579] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-09-29T17:00:02.922621] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-09-29T17:00:02.922688] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-09-29T17:00:02.922775] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-29T17:00:02.923139] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-09-29T17:00:02.923179] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-29T17:00:02.923214] [INFO ] [MAIN ] Starting incremental update for 2371 symbols. [2025-09-29T17:00:02.923245] [INFO ] [MAIN ] Running in parallel mode [2025-09-29T17:00:02.923455] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2371 symbols [2025-09-29T17:00:03.619104] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:00:03.698831] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:00:03.745430] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:00:03.752724] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-09-29T17:00:03.781923] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-09-29T17:00:03.786065] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-09-29T17:00:03.802085] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-29T17:00:03.807951] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:00:03.808080] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-29T17:00:03.808291] [DEBUG] [LOCAL ] AAMI: No existing data file found in primary storage. [2025-09-29T17:00:03.808379] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-09-29T17:00:03.808493] [WARN ] [MAIN ] AAMI: No existing data found, performing full refresh instead. [2025-09-29T17:00:03.809076] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-09-29T17:00:03.809154] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-29T17:00:03.809255] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-09-29T17:00:03.809329] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-09-29T17:00:04.392133] [DEBUG] [LOCAL ] A: Loaded 51487 existing records from primary storage. [2025-09-29T17:00:04.432363] [DEBUG] [LOCAL ] AA: Loaded 54394 existing records from primary storage. [2025-09-29T17:00:04.438075] [INFO ] [MAIN ] A: Loaded 51487 existing records. [2025-09-29T17:00:04.469908] [INFO ] [MAIN ] AA: Loaded 54394 existing records. [2025-09-29T17:00:05.045562] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:00:05.147977] [INFO ] [REMOTE ] AAM: Fetching primary data for 2024-12. [2025-09-29T17:00:05.209213] [WARN ] [MAIN ] A: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:00:05.221894] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-09-29T17:00:05.220746] [WARN ] [MAIN ] AA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:00:05.222060] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-09-29T17:00:05.227862] [DEBUG] [LOCAL ] A: Deleted primary data file. [2025-09-29T17:00:05.239956] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-09-29T17:00:05.227788] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-09-29T17:00:05.275470] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-09-29T17:00:05.275333] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:00:05.324808] [DEBUG] [LOCAL ] AA: Deleted primary data file. [2025-09-29T17:00:05.341874] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-09-29T17:00:05.325325] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2024-12. [2025-09-29T17:00:05.714417] [DEBUG] [REMOTE ] AAMI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T17:00:05.747203] [WARN ] [REMOTE ] AAMI: No data returned for month 2024-12 [2025-09-29T17:00:05.793024] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-29T17:00:05.793104] [FATAL] [REMOTE ] AAMI: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T17:00:05.845317] [FATAL] [MAIN ] AAMI: Failed to fetch primary data. [2025-09-29T17:00:05.871381] [WARN ] [MAIN ] AAMI: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T17:00:05.902067] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-09-29T17:00:05.902667] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-29T17:00:05.960075] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-09-29T17:00:06.069469] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:00:06.036343] [INFO ] [LOCAL ] AAMI: Starting deletion of derivative data. [2025-09-29T17:00:06.075743] [INFO ] [REMOTE ] AA: Fetching primary data for 2024-12. [2025-09-29T17:00:06.075016] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:00:06.075893] [DEBUG] [LOCAL ] AAMI: No derivative data file found to delete. [2025-09-29T17:00:06.076203] [INFO ] [REMOTE ] A: Fetching primary data for 2024-12. [2025-09-29T17:00:06.077450] [INFO ] [MAIN ] Update Progress: 1/2371 symbols completed. AAMI took 3.0s. Estimated remaining: 2h 4m 35s. Rate: 19.0 symbols/min [2025-09-29T17:00:06.272786] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:00:06.323063] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-29T17:00:06.324137] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-09-29T17:00:06.347673] [DEBUG] [LOCAL ] AAP: Loaded 52789 existing records from primary storage. [2025-09-29T17:00:06.348023] [INFO ] [MAIN ] AAP: Loaded 52789 existing records. [2025-09-29T17:00:06.544218] [WARN ] [MAIN ] AAP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:00:06.544473] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-09-29T17:00:06.544526] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-09-29T17:00:06.545722] [DEBUG] [LOCAL ] AAP: Deleted primary data file. [2025-09-29T17:00:06.545798] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-09-29T17:00:06.712516] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-29T17:00:06.726186] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-09-29T17:00:06.959363] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:00:06.959800] [INFO ] [REMOTE ] AAP: Fetching primary data for 2024-12. [2025-09-29T17:00:07.173169] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-29T17:00:07.174208] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-09-29T17:00:07.539222] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-29T17:00:07.540583] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-09-29T17:00:07.830290] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-09-29T17:00:07.831314] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-09-29T17:00:07.874961] [INFO ] [REMOTE ] A: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-29T17:00:07.885887] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-09-29T17:00:08.139148] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-29T17:00:08.150457] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-09-29T17:00:08.173490] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-29T17:00:08.174392] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-09-29T17:00:08.491928] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-29T17:00:08.492872] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-09-29T17:00:08.742997] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-29T17:00:08.754074] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-09-29T17:00:08.935944] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-29T17:00:08.937224] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-09-29T17:00:09.493417] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-29T17:00:09.494246] [INFO ] [REMOTE ] AAM: Full fetch complete (960 records). [2025-09-29T17:00:09.494334] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-09-29T17:00:09.704483] [WARN ] [VALIDATOR ] AAM: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-09-29T17:00:09.705497] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:00:09.705591] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:00:09.705693] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-29T17:00:09.705796] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-29T17:00:09.705852] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-09-29T17:00:09.705897] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-09-29T17:00:09.705984] [INFO ] [MAIN ] Update Progress: 2/2371 symbols completed. AAM took 6.7s. Estimated remaining: 2h 13m 54s. Rate: 17.7 symbols/min [2025-09-29T17:00:09.831209] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-29T17:00:09.883328] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-09-29T17:00:09.961820] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:00:10.002968] [DEBUG] [LOCAL ] AAT: Loaded 31069 existing records from primary storage. [2025-09-29T17:00:10.003274] [INFO ] [MAIN ] AAT: Loaded 31069 existing records. [2025-09-29T17:00:10.198369] [WARN ] [MAIN ] AAT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:00:10.199247] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-09-29T17:00:10.199511] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-09-29T17:00:10.200421] [DEBUG] [LOCAL ] AAT: Deleted primary data file. [2025-09-29T17:00:10.200566] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-09-29T17:00:10.364494] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-09-29T17:00:10.456282] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-09-29T17:00:10.669562] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:00:10.670138] [INFO ] [REMOTE ] AAT: Fetching primary data for 2024-12. [2025-09-29T17:00:10.700116] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-29T17:00:10.711132] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-09-29T17:00:11.742959] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-29T17:00:11.754161] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-09-29T17:00:11.892052] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-29T17:00:11.898050] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-09-29T17:00:12.313508] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-29T17:00:12.324416] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-09-29T17:00:12.753503] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-29T17:00:12.764419] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-09-29T17:00:12.781949] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-29T17:00:12.788934] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-09-29T17:00:13.491600] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-29T17:00:13.503721] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-09-29T17:00:13.973897] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-29T17:00:13.979857] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-09-29T17:00:14.293490] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-29T17:00:14.305382] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-09-29T17:00:15.279571] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-29T17:00:15.286607] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-09-29T17:00:15.474199] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-29T17:00:15.489874] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-09-29T17:00:15.526627] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (3.20 seconds). [2025-09-29T17:00:15.539891] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-09-29T17:00:16.168603] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-29T17:00:16.179975] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-09-29T17:00:16.576236] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-29T17:00:16.584077] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-09-29T17:00:17.474510] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-29T17:00:17.486826] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-09-29T17:00:17.715827] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-29T17:00:17.729576] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-09-29T17:00:18.042901] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-29T17:00:18.060059] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-09-29T17:00:19.229067] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-29T17:00:19.240973] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-09-29T17:00:19.717110] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-29T17:00:19.729303] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-09-29T17:00:19.898466] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-29T17:00:19.910692] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-09-29T17:00:19.950743] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (3.37 seconds). [2025-09-29T17:00:19.957593] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-09-29T17:00:20.656155] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-29T17:00:20.668845] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-09-29T17:00:20.993179] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-29T17:00:21.000580] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-09-29T17:00:21.600061] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-29T17:00:21.611344] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-09-29T17:00:21.785487] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-29T17:00:21.801576] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-09-29T17:00:22.481871] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-29T17:00:22.490049] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-09-29T17:00:22.534679] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-29T17:00:22.545754] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-09-29T17:00:23.181837] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-29T17:00:23.193193] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-09-29T17:00:23.467203] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-29T17:00:23.474386] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-09-29T17:00:23.848798] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-29T17:00:23.861352] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-09-29T17:00:24.224398] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-29T17:00:24.245170] [INFO ] [REMOTE ] A: Full fetch complete (72673 records). [2025-09-29T17:00:24.245370] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-09-29T17:00:24.246294] [FATAL] [VALIDATOR ] A: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:00:24.246389] [FATAL] [MAIN ] A: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:00:24.246435] [WARN ] [MAIN ] A: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:00:24.246476] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-09-29T17:00:24.246556] [DEBUG] [LOCAL ] A: No primary data file found to delete. [2025-09-29T17:00:24.246614] [INFO ] [LOCAL ] A: Starting deletion of derivative data. [2025-09-29T17:00:24.247327] [DEBUG] [LOCAL ] A: Deleted derivative data file. [2025-09-29T17:00:24.247925] [INFO ] [MAIN ] Update Progress: 3/2371 symbols completed. A took 21.3s. Estimated remaining: 4h 40m 32s. Rate: 8.4 symbols/min [2025-09-29T17:00:24.427712] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:00:24.427966] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-09-29T17:00:24.428026] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-09-29T17:00:24.428155] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-09-29T17:00:24.428209] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-29T17:00:24.428257] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-29T17:00:24.428299] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-09-29T17:00:24.882560] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:00:24.883230] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2024-12. [2025-09-29T17:00:24.985413] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-29T17:00:25.023105] [INFO ] [REMOTE ] AAP: Full fetch complete (74696 records). [2025-09-29T17:00:25.024201] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-09-29T17:00:25.025235] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-29T17:00:25.033132] [FATAL] [VALIDATOR ] AAP: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:00:25.033341] [FATAL] [MAIN ] AAP: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:00:25.033395] [WARN ] [MAIN ] AAP: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:00:25.033474] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-09-29T17:00:25.033546] [DEBUG] [LOCAL ] AAP: No primary data file found to delete. [2025-09-29T17:00:25.033585] [INFO ] [LOCAL ] AAP: Starting deletion of derivative data. [2025-09-29T17:00:25.034234] [INFO ] [REMOTE ] AAT: Full fetch complete (42640 records). [2025-09-29T17:00:25.034395] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-09-29T17:00:25.034783] [DEBUG] [LOCAL ] AAP: Deleted derivative data file. [2025-09-29T17:00:25.035550] [INFO ] [MAIN ] Update Progress: 4/2371 symbols completed. AAP took 19.0s. Estimated remaining: 3h 38m 5s. Rate: 10.9 symbols/min [2025-09-29T17:00:25.117972] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T17:00:25.130360] [WARN ] [REMOTE ] AAUC: No data returned for month 2024-12 [2025-09-29T17:00:25.130513] [FATAL] [REMOTE ] AAUC: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T17:00:25.130572] [FATAL] [MAIN ] AAUC: Failed to fetch primary data. [2025-09-29T17:00:25.130613] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T17:00:25.130697] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-29T17:00:25.130783] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-29T17:00:25.130826] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-09-29T17:00:25.130874] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-09-29T17:00:25.130934] [INFO ] [MAIN ] Update Progress: 5/2371 symbols completed. AAUC took 0.9s. Estimated remaining: 2h 55m 9s. Rate: 13.5 symbols/min [2025-09-29T17:00:25.755098] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:00:25.938601] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:00:26.068316] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-29T17:00:26.149897] [DEBUG] [LOCAL ] AB: Loaded 28642 existing records from primary storage. [2025-09-29T17:00:26.150470] [INFO ] [MAIN ] AB: Loaded 28642 existing records. [2025-09-29T17:00:26.192868] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-09-29T17:00:26.267531] [DEBUG] [VALIDATOR ] AAT: All expected trading days are present. [2025-09-29T17:00:26.274318] [DEBUG] [VALIDATOR ] AAT: Primary data validation passed. [2025-09-29T17:00:26.301743] [INFO ] [MAIN ] AAT: Fetched primary data is valid. [2025-09-29T17:00:26.314386] [DEBUG] [LOCAL ] AAT: Saving primary data. [2025-09-29T17:00:26.381423] [DEBUG] [LOCAL ] AAT: Trimmed 42640 records to 30539 (keeping 200 days of data) [2025-09-29T17:00:26.418799] [WARN ] [MAIN ] AB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:00:26.420267] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-09-29T17:00:26.420334] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-09-29T17:00:26.495320] [DEBUG] [LOCAL ] AB: Deleted primary data file. [2025-09-29T17:00:26.508683] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-09-29T17:00:26.655050] [DEBUG] [LOCAL ] ABBV: Loaded 54465 existing records from primary storage. [2025-09-29T17:00:26.666575] [INFO ] [MAIN ] ABBV: Loaded 54465 existing records. [2025-09-29T17:00:27.145359] [WARN ] [MAIN ] ABBV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:00:27.219247] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-09-29T17:00:27.258378] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-09-29T17:00:27.287083] [DEBUG] [LOCAL ] ABBV: Deleted primary data file. [2025-09-29T17:00:27.293542] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:00:27.294395] [INFO ] [REMOTE ] AB: Fetching primary data for 2024-12. [2025-09-29T17:00:27.294466] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-09-29T17:00:27.460954] [DEBUG] [LOCAL ] AAT: Primary data saved (30539 records). [2025-09-29T17:00:27.489247] [INFO ] [MAIN ] AAT: Full history saved. [2025-09-29T17:00:27.497984] [INFO ] [MAIN ] Update Progress: 6/2371 symbols completed. AAT took 17.8s. Estimated remaining: 2h 41m 27s. Rate: 14.6 symbols/min [2025-09-29T17:00:27.855011] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:00:27.913110] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:00:27.913539] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2024-12. [2025-09-29T17:00:27.945952] [DEBUG] [LOCAL ] ABCB: Loaded 31144 existing records from primary storage. [2025-09-29T17:00:27.946318] [INFO ] [MAIN ] ABCB: Loaded 31144 existing records. [2025-09-29T17:00:28.142407] [WARN ] [MAIN ] ABCB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:00:28.142758] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-09-29T17:00:28.142838] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-09-29T17:00:28.143747] [DEBUG] [LOCAL ] ABCB: Deleted primary data file. [2025-09-29T17:00:28.143820] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-09-29T17:00:28.543694] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-09-29T17:00:28.590960] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:00:28.591790] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2024-12. [2025-09-29T17:00:28.593855] [INFO ] [REMOTE ] AA: Full fetch complete (77148 records). [2025-09-29T17:00:28.593950] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-09-29T17:00:28.594883] [FATAL] [VALIDATOR ] AA: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:00:28.594981] [FATAL] [MAIN ] AA: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:00:28.595054] [WARN ] [MAIN ] AA: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:00:28.595130] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-09-29T17:00:28.595213] [DEBUG] [LOCAL ] AA: No primary data file found to delete. [2025-09-29T17:00:28.595285] [INFO ] [LOCAL ] AA: Starting deletion of derivative data. [2025-09-29T17:00:28.595865] [DEBUG] [LOCAL ] AA: Deleted derivative data file. [2025-09-29T17:00:28.596259] [INFO ] [MAIN ] Update Progress: 7/2371 symbols completed. AA took 25.6s. Estimated remaining: 2h 24m 30s. Rate: 16.4 symbols/min [2025-09-29T17:00:28.782123] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:00:28.843579] [DEBUG] [LOCAL ] ABEV: Loaded 54055 existing records from primary storage. [2025-09-29T17:00:28.843995] [INFO ] [MAIN ] ABEV: Loaded 54055 existing records. [2025-09-29T17:00:29.037784] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-29T17:00:29.067044] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-09-29T17:00:29.070994] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:00:29.072205] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-09-29T17:00:29.072260] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-09-29T17:00:29.073010] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-09-29T17:00:29.073114] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-09-29T17:00:29.445979] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:00:29.446328] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2024-12. [2025-09-29T17:00:30.084053] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-29T17:00:30.090861] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-09-29T17:00:30.132087] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-09-29T17:00:30.144755] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-09-29T17:00:30.201916] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-29T17:00:30.210830] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-09-29T17:00:31.323471] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-29T17:00:31.330977] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-09-29T17:00:31.509395] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-29T17:00:31.518677] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-09-29T17:00:31.671951] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-29T17:00:31.683161] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-09-29T17:00:31.818104] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-29T17:00:31.830370] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-09-29T17:00:32.687537] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-29T17:00:32.694448] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-09-29T17:00:32.725534] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-29T17:00:32.735716] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-09-29T17:00:33.592255] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-29T17:00:33.609144] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-09-29T17:00:33.684164] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-29T17:00:33.695360] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-09-29T17:00:33.805222] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-29T17:00:33.816735] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-09-29T17:00:34.306380] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-29T17:00:34.317440] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-09-29T17:00:35.239128] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-29T17:00:35.247284] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-09-29T17:00:35.329201] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-29T17:00:35.340087] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-09-29T17:00:35.625623] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-29T17:00:35.632018] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-09-29T17:00:35.764172] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-29T17:00:35.776341] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-09-29T17:00:36.469544] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-29T17:00:36.476049] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-09-29T17:00:36.722698] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-29T17:00:36.727609] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-09-29T17:00:36.832826] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-29T17:00:36.844437] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-09-29T17:00:37.651519] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-29T17:00:37.657578] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-09-29T17:00:37.884741] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-29T17:00:37.896724] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-09-29T17:00:37.931496] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-29T17:00:37.937692] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-09-29T17:00:38.682303] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-29T17:00:38.693725] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-09-29T17:00:38.747814] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-29T17:00:38.756235] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-09-29T17:00:39.163170] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-29T17:00:39.168585] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-09-29T17:00:39.668638] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-29T17:00:39.680833] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-09-29T17:00:39.860589] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-29T17:00:39.868204] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-09-29T17:00:40.483637] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-29T17:00:40.497405] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-09-29T17:00:40.594435] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-29T17:00:40.600165] [INFO ] [REMOTE ] AB: Full fetch complete (45720 records). [2025-09-29T17:00:40.600320] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-09-29T17:00:41.020308] [DEBUG] [VALIDATOR ] AB: All expected trading days are present. [2025-09-29T17:00:41.020456] [DEBUG] [VALIDATOR ] AB: Primary data validation passed. [2025-09-29T17:00:41.020964] [INFO ] [MAIN ] AB: Fetched primary data is valid. [2025-09-29T17:00:41.021034] [DEBUG] [LOCAL ] AB: Saving primary data. [2025-09-29T17:00:41.022336] [DEBUG] [LOCAL ] AB: Trimmed 45720 records to 27747 (keeping 200 days of data) [2025-09-29T17:00:41.271103] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-29T17:00:41.280007] [INFO ] [REMOTE ] ABCB: Full fetch complete (44479 records). [2025-09-29T17:00:41.280168] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-09-29T17:00:41.496012] [DEBUG] [LOCAL ] AB: Primary data saved (27747 records). [2025-09-29T17:00:41.500445] [INFO ] [MAIN ] AB: Full history saved. [2025-09-29T17:00:41.510193] [INFO ] [MAIN ] Update Progress: 8/2371 symbols completed. AB took 16.5s. Estimated remaining: 3h 9m 58s. Rate: 12.4 symbols/min [2025-09-29T17:00:41.939402] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:00:41.952898] [DEBUG] [VALIDATOR ] ABCB: All expected trading days are present. [2025-09-29T17:00:41.952986] [DEBUG] [VALIDATOR ] ABCB: Primary data validation passed. [2025-09-29T17:00:41.953540] [INFO ] [MAIN ] ABCB: Fetched primary data is valid. [2025-09-29T17:00:41.953666] [DEBUG] [LOCAL ] ABCB: Saving primary data. [2025-09-29T17:00:41.955219] [DEBUG] [LOCAL ] ABCB: Trimmed 44479 records to 30510 (keeping 200 days of data) [2025-09-29T17:00:42.119132] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (2.44 seconds). [2025-09-29T17:00:42.146872] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-09-29T17:00:42.150765] [DEBUG] [LOCAL ] ABG: Loaded 19034 existing records from primary storage. [2025-09-29T17:00:42.152435] [INFO ] [MAIN ] ABG: Loaded 19034 existing records. [2025-09-29T17:00:42.375003] [WARN ] [MAIN ] ABG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:00:42.376912] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-09-29T17:00:42.396411] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-09-29T17:00:42.410552] [DEBUG] [LOCAL ] ABG: Deleted primary data file. [2025-09-29T17:00:42.411921] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-09-29T17:00:42.411766] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-29T17:00:42.503337] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-09-29T17:00:42.895925] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:00:42.897184] [INFO ] [REMOTE ] ABG: Fetching primary data for 2024-12. [2025-09-29T17:00:42.913175] [DEBUG] [LOCAL ] ABCB: Primary data saved (30510 records). [2025-09-29T17:00:42.913329] [INFO ] [MAIN ] ABCB: Full history saved. [2025-09-29T17:00:42.913439] [INFO ] [MAIN ] Update Progress: 9/2371 symbols completed. ABCB took 15.4s. Estimated remaining: 2h 54m 55s. Rate: 13.5 symbols/min [2025-09-29T17:00:43.103982] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:00:43.144255] [DEBUG] [LOCAL ] ABM: Loaded 32915 existing records from primary storage. [2025-09-29T17:00:43.144637] [INFO ] [MAIN ] ABM: Loaded 32915 existing records. [2025-09-29T17:00:43.336151] [WARN ] [MAIN ] ABM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:00:43.336420] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-09-29T17:00:43.336469] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-09-29T17:00:43.337279] [DEBUG] [LOCAL ] ABM: Deleted primary data file. [2025-09-29T17:00:43.337396] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-09-29T17:00:43.713089] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:00:43.713450] [INFO ] [REMOTE ] ABM: Fetching primary data for 2024-12. [2025-09-29T17:00:43.994519] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-29T17:00:43.998232] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-09-29T17:00:44.299522] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-29T17:00:44.313124] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-09-29T17:00:44.379441] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-29T17:00:44.393239] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-09-29T17:00:44.764590] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-29T17:00:44.775798] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-09-29T17:00:45.045066] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-29T17:00:45.049800] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-09-29T17:00:45.640818] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-29T17:00:45.647171] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-09-29T17:00:46.152252] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-29T17:00:46.156791] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-09-29T17:00:46.232483] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-29T17:00:46.245546] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-09-29T17:00:46.378925] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-29T17:00:46.395453] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-09-29T17:00:46.589123] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-29T17:00:46.594485] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-09-29T17:00:47.315142] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-29T17:00:47.320545] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-09-29T17:00:48.060776] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-29T17:00:48.068744] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-09-29T17:00:48.162342] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-29T17:00:48.174122] [INFO ] [REMOTE ] ABEV: Full fetch complete (77198 records). [2025-09-29T17:00:48.174312] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-09-29T17:00:48.621330] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-09-29T17:00:48.621547] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-09-29T17:00:48.622458] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-09-29T17:00:48.622569] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-09-29T17:00:48.625839] [DEBUG] [LOCAL ] ABEV: Trimmed 77198 records to 53278 (keeping 200 days of data) [2025-09-29T17:00:48.749067] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-09-29T17:00:48.765463] [INFO ] [REMOTE ] ABBV: Full fetch complete (77720 records). [2025-09-29T17:00:48.767812] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-09-29T17:00:48.974171] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-29T17:00:49.002864] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-09-29T17:00:49.373188] [DEBUG] [VALIDATOR ] ABBV: All expected trading days are present. [2025-09-29T17:00:49.373697] [DEBUG] [VALIDATOR ] ABBV: Primary data validation passed. [2025-09-29T17:00:49.375024] [INFO ] [MAIN ] ABBV: Fetched primary data is valid. [2025-09-29T17:00:49.376222] [DEBUG] [LOCAL ] ABBV: Saving primary data. [2025-09-29T17:00:49.381872] [DEBUG] [LOCAL ] ABBV: Trimmed 77720 records to 53684 (keeping 200 days of data) [2025-09-29T17:00:49.538094] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-29T17:00:49.550948] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-09-29T17:00:49.782268] [DEBUG] [LOCAL ] ABEV: Primary data saved (53278 records). [2025-09-29T17:00:49.782927] [INFO ] [MAIN ] ABEV: Full history saved. [2025-09-29T17:00:49.783520] [INFO ] [MAIN ] Update Progress: 10/2371 symbols completed. ABEV took 21.2s. Estimated remaining: 3h 4m 24s. Rate: 12.8 symbols/min [2025-09-29T17:00:49.983526] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:00:50.005013] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-29T17:00:50.011568] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-09-29T17:00:50.066045] [DEBUG] [LOCAL ] ABR: Loaded 52817 existing records from primary storage. [2025-09-29T17:00:50.067313] [INFO ] [MAIN ] ABR: Loaded 52817 existing records. [2025-09-29T17:00:50.368964] [WARN ] [MAIN ] ABR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:00:50.370039] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-09-29T17:00:50.370414] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-09-29T17:00:50.372087] [DEBUG] [LOCAL ] ABR: Deleted primary data file. [2025-09-29T17:00:50.375429] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-09-29T17:00:50.576431] [DEBUG] [LOCAL ] ABBV: Primary data saved (53684 records). [2025-09-29T17:00:50.586294] [INFO ] [MAIN ] ABBV: Full history saved. [2025-09-29T17:00:50.611718] [INFO ] [MAIN ] Update Progress: 11/2371 symbols completed. ABBV took 25.5s. Estimated remaining: 2h 50m 31s. Rate: 13.8 symbols/min [2025-09-29T17:00:51.060583] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:00:51.066026] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:00:51.068234] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-29T17:00:51.068610] [INFO ] [REMOTE ] ABR: Fetching primary data for 2024-12. [2025-09-29T17:00:51.088835] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-09-29T17:00:51.091391] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-29T17:00:51.097676] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-09-29T17:00:51.155389] [DEBUG] [LOCAL ] ABT: Loaded 54400 existing records from primary storage. [2025-09-29T17:00:51.155777] [INFO ] [MAIN ] ABT: Loaded 54400 existing records. [2025-09-29T17:00:51.343718] [WARN ] [MAIN ] ABT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:00:51.343947] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-09-29T17:00:51.343998] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-09-29T17:00:51.347690] [DEBUG] [LOCAL ] ABT: Deleted primary data file. [2025-09-29T17:00:51.347767] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-09-29T17:00:51.729291] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:00:51.729728] [INFO ] [REMOTE ] ABT: Fetching primary data for 2024-12. [2025-09-29T17:00:52.212446] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-29T17:00:52.217728] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-09-29T17:00:52.476561] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-29T17:00:52.484937] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-09-29T17:00:52.816990] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-29T17:00:52.828023] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-09-29T17:00:53.409154] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-29T17:00:53.414596] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-09-29T17:00:53.722538] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-29T17:00:53.740801] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-09-29T17:00:53.809735] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-29T17:00:53.817998] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-09-29T17:00:54.209029] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-29T17:00:54.212566] [INFO ] [REMOTE ] ABG: Full fetch complete (26337 records). [2025-09-29T17:00:54.212714] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-09-29T17:00:54.213322] [FATAL] [VALIDATOR ] ABG: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:00:54.213427] [FATAL] [MAIN ] ABG: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:00:54.213544] [WARN ] [MAIN ] ABG: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:00:54.213636] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-09-29T17:00:54.213791] [DEBUG] [LOCAL ] ABG: No primary data file found to delete. [2025-09-29T17:00:54.213834] [INFO ] [LOCAL ] ABG: Starting deletion of derivative data. [2025-09-29T17:00:54.215035] [DEBUG] [LOCAL ] ABG: Deleted derivative data file. [2025-09-29T17:00:54.215142] [INFO ] [MAIN ] Update Progress: 12/2371 symbols completed. ABG took 12.7s. Estimated remaining: 2h 48m 3s. Rate: 14.0 symbols/min [2025-09-29T17:00:54.407999] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:00:54.433732] [DEBUG] [LOCAL ] ACA: Loaded 24034 existing records from primary storage. [2025-09-29T17:00:54.434026] [INFO ] [MAIN ] ACA: Loaded 24034 existing records. [2025-09-29T17:00:54.632197] [WARN ] [MAIN ] ACA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:00:54.632512] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-09-29T17:00:54.632757] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-09-29T17:00:54.633371] [DEBUG] [LOCAL ] ACA: Deleted primary data file. [2025-09-29T17:00:54.633439] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-09-29T17:00:54.913247] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-29T17:00:54.977238] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-09-29T17:00:55.046520] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-29T17:00:55.120701] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:00:55.121209] [INFO ] [REMOTE ] ACA: Fetching primary data for 2024-12. [2025-09-29T17:00:55.121509] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-09-29T17:00:55.158675] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-29T17:00:55.169803] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-09-29T17:00:56.412534] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-29T17:00:56.421272] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-09-29T17:00:56.630074] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-29T17:00:56.640967] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-09-29T17:00:56.686302] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-29T17:00:56.697801] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-09-29T17:00:57.068231] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-29T17:00:57.076794] [INFO ] [REMOTE ] ABM: Full fetch complete (44698 records). [2025-09-29T17:00:57.076946] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-09-29T17:00:57.524523] [DEBUG] [VALIDATOR ] ABM: All expected trading days are present. [2025-09-29T17:00:57.524781] [DEBUG] [VALIDATOR ] ABM: Primary data validation passed. [2025-09-29T17:00:57.525325] [INFO ] [MAIN ] ABM: Fetched primary data is valid. [2025-09-29T17:00:57.525445] [DEBUG] [LOCAL ] ABM: Saving primary data. [2025-09-29T17:00:57.526821] [DEBUG] [LOCAL ] ABM: Trimmed 44698 records to 32159 (keeping 200 days of data) [2025-09-29T17:00:57.686783] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-29T17:00:57.693346] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-09-29T17:00:57.814395] [DEBUG] [LOCAL ] ABM: Primary data saved (32159 records). [2025-09-29T17:00:57.814560] [INFO ] [MAIN ] ABM: Full history saved. [2025-09-29T17:00:57.814707] [INFO ] [MAIN ] Update Progress: 13/2371 symbols completed. ABM took 14.9s. Estimated remaining: 2h 45m 56s. Rate: 14.2 symbols/min [2025-09-29T17:00:58.010575] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:00:58.059227] [DEBUG] [LOCAL ] ACCO: Loaded 38214 existing records from primary storage. [2025-09-29T17:00:58.059577] [INFO ] [MAIN ] ACCO: Loaded 38214 existing records. [2025-09-29T17:00:58.250201] [WARN ] [MAIN ] ACCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:00:58.250634] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-09-29T17:00:58.250795] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-09-29T17:00:58.251385] [DEBUG] [LOCAL ] ACCO: Deleted primary data file. [2025-09-29T17:00:58.251452] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-09-29T17:00:58.644687] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:00:58.645820] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2024-12. [2025-09-29T17:00:58.695541] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-29T17:00:58.702186] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-29T17:00:58.714568] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-09-29T17:00:58.716457] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-09-29T17:00:58.747980] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-29T17:00:58.760750] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-09-29T17:01:00.031545] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-29T17:01:00.038513] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-09-29T17:01:00.217713] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-29T17:01:00.225799] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-09-29T17:01:00.818358] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-29T17:01:00.829901] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-09-29T17:01:01.033724] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-29T17:01:01.034330] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-29T17:01:01.052745] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-09-29T17:01:01.053205] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-09-29T17:01:01.877969] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-29T17:01:01.886003] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-09-29T17:01:02.372914] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-29T17:01:02.381440] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-09-29T17:01:02.757670] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-29T17:01:02.769712] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-09-29T17:01:02.817370] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-29T17:01:02.829787] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-09-29T17:01:03.212920] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-29T17:01:03.220604] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-09-29T17:01:03.434807] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-29T17:01:03.440202] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-09-29T17:01:04.649476] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-29T17:01:04.655423] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-09-29T17:01:04.726067] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-29T17:01:04.736295] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-09-29T17:01:04.767250] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-29T17:01:04.779461] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-09-29T17:01:04.811290] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-29T17:01:04.822876] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-09-29T17:01:05.768263] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-29T17:01:05.773987] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-09-29T17:01:05.921510] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-29T17:01:05.930891] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-09-29T17:01:06.940071] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-29T17:01:06.952593] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-09-29T17:01:07.035587] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-29T17:01:07.040048] [INFO ] [REMOTE ] ACA: Full fetch complete (34308 records). [2025-09-29T17:01:07.040145] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-09-29T17:01:07.477332] [DEBUG] [VALIDATOR ] ACA: All expected trading days are present. [2025-09-29T17:01:07.477559] [DEBUG] [VALIDATOR ] ACA: Primary data validation passed. [2025-09-29T17:01:07.477994] [INFO ] [MAIN ] ACA: Fetched primary data is valid. [2025-09-29T17:01:07.478100] [DEBUG] [LOCAL ] ACA: Saving primary data. [2025-09-29T17:01:07.479468] [DEBUG] [LOCAL ] ACA: Trimmed 34308 records to 23441 (keeping 200 days of data) [2025-09-29T17:01:07.610693] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (2.79 seconds). [2025-09-29T17:01:07.624915] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-09-29T17:01:07.684069] [DEBUG] [LOCAL ] ACA: Primary data saved (23441 records). [2025-09-29T17:01:07.684250] [INFO ] [MAIN ] ACA: Full history saved. [2025-09-29T17:01:07.684352] [INFO ] [MAIN ] Update Progress: 14/2371 symbols completed. ACA took 13.5s. Estimated remaining: 3h 1m 43s. Rate: 13.0 symbols/min [2025-09-29T17:01:07.868157] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-29T17:01:07.906874] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-09-29T17:01:07.908680] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:01:07.940337] [DEBUG] [LOCAL ] ACEL: Loaded 27405 existing records from primary storage. [2025-09-29T17:01:07.940627] [INFO ] [MAIN ] ACEL: Loaded 27405 existing records. [2025-09-29T17:01:08.128539] [WARN ] [MAIN ] ACEL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:01:08.128827] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-09-29T17:01:08.128879] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-09-29T17:01:08.129174] [DEBUG] [LOCAL ] ACEL: Deleted primary data file. [2025-09-29T17:01:08.129239] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-09-29T17:01:08.522637] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:01:08.523073] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2024-12. [2025-09-29T17:01:08.559607] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-29T17:01:08.571417] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-09-29T17:01:09.344631] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-29T17:01:09.357055] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-09-29T17:01:09.398939] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-29T17:01:09.407714] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-09-29T17:01:09.827243] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-29T17:01:09.833204] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-09-29T17:01:10.158791] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-29T17:01:10.170008] [INFO ] [REMOTE ] ABR: Full fetch complete (75199 records). [2025-09-29T17:01:10.170176] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-09-29T17:01:10.623955] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present. [2025-09-29T17:01:10.624093] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed. [2025-09-29T17:01:10.624924] [INFO ] [MAIN ] ABR: Fetched primary data is valid. [2025-09-29T17:01:10.625052] [DEBUG] [LOCAL ] ABR: Saving primary data. [2025-09-29T17:01:10.649910] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-29T17:01:10.658472] [DEBUG] [LOCAL ] ABR: Trimmed 75199 records to 52026 (keeping 200 days of data) [2025-09-29T17:01:10.659915] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-09-29T17:01:11.004786] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-29T17:01:11.012222] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-09-29T17:01:11.036580] [DEBUG] [LOCAL ] ABR: Primary data saved (52026 records). [2025-09-29T17:01:11.036832] [INFO ] [MAIN ] ABR: Full history saved. [2025-09-29T17:01:11.036970] [INFO ] [MAIN ] Update Progress: 15/2371 symbols completed. ABR took 21.3s. Estimated remaining: 2h 58m 18s. Rate: 13.2 symbols/min [2025-09-29T17:01:11.233703] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:01:11.294940] [DEBUG] [LOCAL ] ACHR: Loaded 54598 existing records from primary storage. [2025-09-29T17:01:11.295307] [INFO ] [MAIN ] ACHR: Loaded 54598 existing records. [2025-09-29T17:01:11.505986] [WARN ] [MAIN ] ACHR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:01:11.506561] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-09-29T17:01:11.506805] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-09-29T17:01:11.507680] [DEBUG] [LOCAL ] ACHR: Deleted primary data file. [2025-09-29T17:01:11.507762] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-09-29T17:01:11.717308] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-09-29T17:01:11.784263] [INFO ] [REMOTE ] ABT: Full fetch complete (77588 records). [2025-09-29T17:01:11.835372] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-09-29T17:01:12.179068] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:01:12.195752] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2024-12. [2025-09-29T17:01:12.439667] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-29T17:01:12.478360] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-29T17:01:12.512200] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-09-29T17:01:12.525983] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-09-29T17:01:12.598241] [DEBUG] [VALIDATOR ] ABT: All expected trading days are present. [2025-09-29T17:01:12.598373] [DEBUG] [VALIDATOR ] ABT: Primary data validation passed. [2025-09-29T17:01:12.599411] [INFO ] [MAIN ] ABT: Fetched primary data is valid. [2025-09-29T17:01:12.599483] [DEBUG] [LOCAL ] ABT: Saving primary data. [2025-09-29T17:01:12.601675] [DEBUG] [LOCAL ] ABT: Trimmed 77588 records to 53620 (keeping 200 days of data) [2025-09-29T17:01:12.970886] [DEBUG] [LOCAL ] ABT: Primary data saved (53620 records). [2025-09-29T17:01:12.971085] [INFO ] [MAIN ] ABT: Full history saved. [2025-09-29T17:01:12.971188] [INFO ] [MAIN ] Update Progress: 16/2371 symbols completed. ABT took 22.3s. Estimated remaining: 2h 51m 50s. Rate: 13.7 symbols/min [2025-09-29T17:01:13.154408] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:01:13.215559] [DEBUG] [LOCAL ] ACI: Loaded 54044 existing records from primary storage. [2025-09-29T17:01:13.216010] [INFO ] [MAIN ] ACI: Loaded 54044 existing records. [2025-09-29T17:01:13.416188] [WARN ] [MAIN ] ACI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:01:13.416489] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-09-29T17:01:13.416543] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-09-29T17:01:13.417389] [DEBUG] [LOCAL ] ACI: Deleted primary data file. [2025-09-29T17:01:13.417457] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-09-29T17:01:13.848827] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:01:13.849255] [INFO ] [REMOTE ] ACI: Fetching primary data for 2024-12. [2025-09-29T17:01:13.871008] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-29T17:01:13.896354] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-29T17:01:13.895547] [INFO ] [REMOTE ] ACCO: Full fetch complete (54196 records). [2025-09-29T17:01:13.899059] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-09-29T17:01:13.903816] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-09-29T17:01:14.315785] [DEBUG] [VALIDATOR ] ACCO: All expected trading days are present. [2025-09-29T17:01:14.315881] [DEBUG] [VALIDATOR ] ACCO: Primary data validation passed. [2025-09-29T17:01:14.316442] [INFO ] [MAIN ] ACCO: Fetched primary data is valid. [2025-09-29T17:01:14.316495] [DEBUG] [LOCAL ] ACCO: Saving primary data. [2025-09-29T17:01:14.317877] [DEBUG] [LOCAL ] ACCO: Trimmed 54196 records to 37516 (keeping 200 days of data) [2025-09-29T17:01:14.561303] [DEBUG] [LOCAL ] ACCO: Primary data saved (37516 records). [2025-09-29T17:01:14.561510] [INFO ] [MAIN ] ACCO: Full history saved. [2025-09-29T17:01:14.563033] [INFO ] [MAIN ] Update Progress: 17/2371 symbols completed. ACCO took 16.7s. Estimated remaining: 2h 45m 20s. Rate: 14.2 symbols/min [2025-09-29T17:01:14.753092] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:01:14.791814] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2024-12 (2.60 seconds). [2025-09-29T17:01:14.804294] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-09-29T17:01:14.858180] [DEBUG] [LOCAL ] ACM: Loaded 43767 existing records from primary storage. [2025-09-29T17:01:14.858541] [INFO ] [MAIN ] ACM: Loaded 43767 existing records. [2025-09-29T17:01:15.059637] [WARN ] [MAIN ] ACM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:01:15.059930] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-09-29T17:01:15.059986] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-09-29T17:01:15.060680] [DEBUG] [LOCAL ] ACM: Deleted primary data file. [2025-09-29T17:01:15.060774] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-09-29T17:01:15.445420] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:01:15.445781] [INFO ] [REMOTE ] ACM: Fetching primary data for 2024-12. [2025-09-29T17:01:15.556040] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-29T17:01:15.564194] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-09-29T17:01:15.888843] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-29T17:01:15.899950] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-09-29T17:01:16.662952] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-29T17:01:16.670178] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-09-29T17:01:17.513612] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.71 seconds). [2025-09-29T17:01:17.475556] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-29T17:01:17.567013] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-09-29T17:01:17.582005] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-29T17:01:17.684044] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-29T17:01:17.948121] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-09-29T17:01:18.748109] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-09-29T17:01:19.119228] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-29T17:01:19.282394] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-29T17:01:19.548124] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-09-29T17:01:20.159505] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-29T17:01:20.348145] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-09-29T17:01:21.153288] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-09-29T17:01:21.168306] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-29T17:01:21.948116] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-09-29T17:01:22.748997] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-09-29T17:01:22.758342] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.41 seconds). [2025-09-29T17:01:22.924388] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-29T17:01:23.315435] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-29T17:01:23.548106] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-09-29T17:01:24.228553] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-29T17:01:24.348153] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-09-29T17:01:25.148151] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-09-29T17:01:25.948083] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-09-29T17:01:26.463951] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.92 seconds). [2025-09-29T17:01:26.537009] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-29T17:01:26.748136] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-09-29T17:01:26.822399] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-29T17:01:27.156233] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-29T17:01:27.161729] [INFO ] [REMOTE ] ACEL: Full fetch complete (38564 records). [2025-09-29T17:01:27.161835] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-09-29T17:01:27.162708] [FATAL] [VALIDATOR ] ACEL: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:01:27.162800] [FATAL] [MAIN ] ACEL: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:01:27.162847] [WARN ] [MAIN ] ACEL: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:01:27.162889] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-09-29T17:01:27.162963] [DEBUG] [LOCAL ] ACEL: No primary data file found to delete. [2025-09-29T17:01:27.163022] [INFO ] [LOCAL ] ACEL: Starting deletion of derivative data. [2025-09-29T17:01:27.164109] [DEBUG] [LOCAL ] ACEL: Deleted derivative data file. [2025-09-29T17:01:27.164275] [INFO ] [MAIN ] Update Progress: 18/2371 symbols completed. ACEL took 19.5s. Estimated remaining: 3h 3m 32s. Rate: 12.8 symbols/min [2025-09-29T17:01:27.347706] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:01:27.420055] [DEBUG] [LOCAL ] ACN: Loaded 54204 existing records from primary storage. [2025-09-29T17:01:27.420446] [INFO ] [MAIN ] ACN: Loaded 54204 existing records. [2025-09-29T17:01:27.553281] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-09-29T17:01:27.620843] [WARN ] [MAIN ] ACN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:01:27.621115] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-09-29T17:01:27.621174] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-09-29T17:01:27.623084] [DEBUG] [LOCAL ] ACN: Deleted primary data file. [2025-09-29T17:01:27.623160] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-09-29T17:01:28.074755] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:01:28.348137] [INFO ] [REMOTE ] ACN: Fetching primary data for 2024-12. [2025-09-29T17:01:28.998228] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-29T17:01:29.148124] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-09-29T17:01:29.346448] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-29T17:01:29.873450] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-29T17:01:29.948138] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-09-29T17:01:30.748170] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-09-29T17:01:31.548154] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-09-29T17:01:31.889249] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.74 seconds). [2025-09-29T17:01:31.933065] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-29T17:01:32.348135] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-09-29T17:01:32.550807] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-29T17:01:32.919122] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-29T17:01:33.148115] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-09-29T17:01:33.811116] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-29T17:01:33.948208] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-09-29T17:01:34.748178] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-09-29T17:01:34.859780] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-29T17:01:35.548150] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-09-29T17:01:35.750415] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-29T17:01:36.348117] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-09-29T17:01:37.148095] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-09-29T17:01:37.454582] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.71 seconds). [2025-09-29T17:01:37.705527] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-29T17:01:37.948132] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-09-29T17:01:38.136342] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-29T17:01:38.747578] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-29T17:01:38.756200] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-09-29T17:01:39.548158] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-09-29T17:01:40.348099] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-09-29T17:01:40.663397] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.72 seconds). [2025-09-29T17:01:40.814197] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-29T17:01:41.148161] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-09-29T17:01:41.401084] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-29T17:01:41.842379] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-29T17:01:41.852271] [INFO ] [REMOTE ] ACM: Full fetch complete (62793 records). [2025-09-29T17:01:41.852425] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-09-29T17:01:41.953249] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-09-29T17:01:42.318583] [DEBUG] [VALIDATOR ] ACM: All expected trading days are present. [2025-09-29T17:01:42.318718] [DEBUG] [VALIDATOR ] ACM: Primary data validation passed. [2025-09-29T17:01:42.319456] [INFO ] [MAIN ] ACM: Fetched primary data is valid. [2025-09-29T17:01:42.319526] [DEBUG] [LOCAL ] ACM: Saving primary data. [2025-09-29T17:01:42.321066] [DEBUG] [LOCAL ] ACM: Trimmed 62793 records to 43033 (keeping 200 days of data) [2025-09-29T17:01:42.624530] [DEBUG] [LOCAL ] ACM: Primary data saved (43033 records). [2025-09-29T17:01:42.624696] [INFO ] [MAIN ] ACM: Full history saved. [2025-09-29T17:01:42.628229] [INFO ] [MAIN ] Update Progress: 19/2371 symbols completed. ACM took 28.1s. Estimated remaining: 3h 25m 42s. Rate: 11.4 symbols/min [2025-09-29T17:01:42.753341] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-09-29T17:01:42.813170] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:01:42.848561] [DEBUG] [LOCAL ] ACP: Loaded 31428 existing records from primary storage. [2025-09-29T17:01:42.848882] [INFO ] [MAIN ] ACP: Loaded 31428 existing records. [2025-09-29T17:01:43.037011] [WARN ] [MAIN ] ACP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:01:43.037402] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-09-29T17:01:43.037467] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-09-29T17:01:43.038186] [DEBUG] [LOCAL ] ACP: Deleted primary data file. [2025-09-29T17:01:43.038251] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-09-29T17:01:43.417134] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:01:43.548164] [INFO ] [REMOTE ] ACP: Fetching primary data for 2024-12. [2025-09-29T17:01:44.089713] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-29T17:01:44.101083] [INFO ] [REMOTE ] ACI: Full fetch complete (77045 records). [2025-09-29T17:01:44.101312] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-09-29T17:01:44.536542] [DEBUG] [VALIDATOR ] ACI: All expected trading days are present. [2025-09-29T17:01:44.536715] [DEBUG] [VALIDATOR ] ACI: Primary data validation passed. [2025-09-29T17:01:44.537704] [INFO ] [MAIN ] ACI: Fetched primary data is valid. [2025-09-29T17:01:44.548410] [DEBUG] [LOCAL ] ACI: Saving primary data. [2025-09-29T17:01:44.570776] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (3.42 seconds). [2025-09-29T17:01:44.582265] [DEBUG] [LOCAL ] ACI: Trimmed 77045 records to 53256 (keeping 200 days of data) [2025-09-29T17:01:44.584260] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-09-29T17:01:44.983876] [DEBUG] [LOCAL ] ACI: Primary data saved (53256 records). [2025-09-29T17:01:44.984062] [INFO ] [MAIN ] ACI: Full history saved. [2025-09-29T17:01:44.989151] [INFO ] [MAIN ] Update Progress: 20/2371 symbols completed. ACI took 32.0s. Estimated remaining: 3h 19m 58s. Rate: 11.8 symbols/min [2025-09-29T17:01:45.176236] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:01:45.201331] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-29T17:01:45.210350] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-09-29T17:01:45.218277] [DEBUG] [LOCAL ] ACR: Loaded 6352 existing records from primary storage. [2025-09-29T17:01:45.218531] [INFO ] [MAIN ] ACR: Loaded 6352 existing records. [2025-09-29T17:01:45.414507] [WARN ] [MAIN ] ACR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:01:45.414997] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-09-29T17:01:45.415052] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-09-29T17:01:45.454753] [DEBUG] [LOCAL ] ACR: Deleted primary data file. [2025-09-29T17:01:45.459692] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-09-29T17:01:45.530269] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (2.78 seconds). [2025-09-29T17:01:45.869392] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:01:45.948137] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-09-29T17:01:46.376920] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-29T17:01:46.748158] [INFO ] [REMOTE ] ACR: Fetching primary data for 2024-12. [2025-09-29T17:01:47.528697] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-29T17:01:47.553347] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-09-29T17:01:47.575592] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (2.99 seconds). [2025-09-29T17:01:47.587871] [INFO ] [REMOTE ] ACHR: Full fetch complete (77998 records). [2025-09-29T17:01:47.588059] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-09-29T17:01:48.124616] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-29T17:01:48.124970] [DEBUG] [VALIDATOR ] ACHR: All expected trading days are present. [2025-09-29T17:01:48.154971] [DEBUG] [VALIDATOR ] ACHR: Primary data validation passed. [2025-09-29T17:01:48.159152] [INFO ] [MAIN ] ACHR: Fetched primary data is valid. [2025-09-29T17:01:48.159321] [DEBUG] [LOCAL ] ACHR: Saving primary data. [2025-09-29T17:01:48.161966] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-09-29T17:01:48.175232] [DEBUG] [LOCAL ] ACHR: Trimmed 77998 records to 53818 (keeping 200 days of data) [2025-09-29T17:01:48.357581] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-09-29T17:01:48.528956] [DEBUG] [LOCAL ] ACHR: Primary data saved (53818 records). [2025-09-29T17:01:48.529116] [INFO ] [MAIN ] ACHR: Full history saved. [2025-09-29T17:01:48.529207] [INFO ] [MAIN ] Update Progress: 21/2371 symbols completed. ACHR took 37.5s. Estimated remaining: 3h 16m 58s. Rate: 11.9 symbols/min [2025-09-29T17:01:48.716827] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:01:48.753153] [DEBUG] [LOCAL ] ACRE: Loaded 34027 existing records from primary storage. [2025-09-29T17:01:48.753527] [INFO ] [MAIN ] ACRE: Loaded 34027 existing records. [2025-09-29T17:01:48.942908] [WARN ] [MAIN ] ACRE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:01:48.943127] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-09-29T17:01:48.943177] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-09-29T17:01:48.943713] [DEBUG] [LOCAL ] ACRE: Deleted primary data file. [2025-09-29T17:01:48.943774] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-09-29T17:01:49.153306] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-09-29T17:01:49.319019] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:01:49.925898] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-29T17:01:49.948072] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-09-29T17:01:50.301419] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-29T17:01:50.749085] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-09-29T17:01:50.751633] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-29T17:01:51.548192] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2024-12. [2025-09-29T17:01:52.119806] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-29T17:01:52.348152] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-09-29T17:01:53.061074] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-29T17:01:53.148154] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-09-29T17:01:53.888809] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-29T17:01:53.948119] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-09-29T17:01:54.462494] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-29T17:01:54.748295] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-09-29T17:01:54.751315] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-29T17:01:55.548159] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-09-29T17:01:56.247937] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-29T17:01:56.348269] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-09-29T17:01:57.066702] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-29T17:01:57.148124] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-09-29T17:01:57.685144] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-29T17:01:57.697695] [INFO ] [REMOTE ] ACN: Full fetch complete (77114 records). [2025-09-29T17:01:57.697904] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-09-29T17:01:57.957106] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-09-29T17:01:58.165705] [DEBUG] [VALIDATOR ] ACN: All expected trading days are present. [2025-09-29T17:01:58.165794] [DEBUG] [VALIDATOR ] ACN: Primary data validation passed. [2025-09-29T17:01:58.166507] [INFO ] [MAIN ] ACN: Fetched primary data is valid. [2025-09-29T17:01:58.166573] [DEBUG] [LOCAL ] ACN: Saving primary data. [2025-09-29T17:01:58.168460] [DEBUG] [LOCAL ] ACN: Trimmed 77114 records to 53425 (keeping 200 days of data) [2025-09-29T17:01:58.529305] [DEBUG] [LOCAL ] ACN: Primary data saved (53425 records). [2025-09-29T17:01:58.529500] [INFO ] [MAIN ] ACN: Full history saved. [2025-09-29T17:01:58.529609] [INFO ] [MAIN ] Update Progress: 22/2371 symbols completed. ACN took 31.4s. Estimated remaining: 3h 25m 44s. Rate: 11.4 symbols/min [2025-09-29T17:01:58.723938] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:01:58.748093] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-09-29T17:01:58.748932] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-29T17:01:58.765338] [DEBUG] [LOCAL ] ACV: Loaded 7095 existing records from primary storage. [2025-09-29T17:01:58.765808] [INFO ] [MAIN ] ACV: Loaded 7095 existing records. [2025-09-29T17:01:58.887109] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-29T17:01:58.975803] [WARN ] [MAIN ] ACV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:01:58.976045] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-09-29T17:01:58.976100] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-09-29T17:01:58.976365] [DEBUG] [LOCAL ] ACV: Deleted primary data file. [2025-09-29T17:01:58.976433] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-09-29T17:01:59.444592] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:01:59.548131] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-09-29T17:02:00.067886] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-29T17:02:00.311175] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-29T17:02:00.348152] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-09-29T17:02:00.948957] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-29T17:02:00.950557] [INFO ] [REMOTE ] ACR: Full fetch complete (8582 records). [2025-09-29T17:02:00.950675] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-09-29T17:02:01.153233] [INFO ] [REMOTE ] ACV: Fetching primary data for 2024-12. [2025-09-29T17:02:01.358260] [DEBUG] [VALIDATOR ] ACR: All expected trading days are present. [2025-09-29T17:02:01.358392] [DEBUG] [VALIDATOR ] ACR: Primary data validation passed. [2025-09-29T17:02:01.358732] [INFO ] [MAIN ] ACR: Fetched primary data is valid. [2025-09-29T17:02:01.358818] [DEBUG] [LOCAL ] ACR: Saving primary data. [2025-09-29T17:02:01.359955] [DEBUG] [LOCAL ] ACR: Trimmed 8582 records to 6054 (keeping 200 days of data) [2025-09-29T17:02:01.413132] [DEBUG] [LOCAL ] ACR: Primary data saved (6054 records). [2025-09-29T17:02:01.413310] [INFO ] [MAIN ] ACR: Full history saved. [2025-09-29T17:02:01.413413] [INFO ] [MAIN ] Update Progress: 23/2371 symbols completed. ACR took 16.4s. Estimated remaining: 3h 21m 36s. Rate: 11.6 symbols/min [2025-09-29T17:02:01.603051] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:02:01.670044] [DEBUG] [LOCAL ] ACVA: Loaded 50072 existing records from primary storage. [2025-09-29T17:02:01.670391] [INFO ] [MAIN ] ACVA: Loaded 50072 existing records. [2025-09-29T17:02:01.863050] [WARN ] [MAIN ] ACVA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:02:01.863492] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-09-29T17:02:01.863542] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-09-29T17:02:01.864242] [DEBUG] [LOCAL ] ACVA: Deleted primary data file. [2025-09-29T17:02:01.864309] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-09-29T17:02:01.953260] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-09-29T17:02:02.180325] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-29T17:02:02.291862] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:02:02.748142] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-09-29T17:02:03.520198] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-29T17:02:03.548063] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-09-29T17:02:04.060924] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-29T17:02:04.348123] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-09-29T17:02:04.984463] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-29T17:02:05.148145] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-09-29T17:02:05.513232] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-29T17:02:05.948127] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-09-29T17:02:06.467637] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-29T17:02:06.748129] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-09-29T17:02:07.372570] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-29T17:02:07.380729] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-29T17:02:07.548109] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-09-29T17:02:08.348116] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-09-29T17:02:09.024775] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-29T17:02:09.069714] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-29T17:02:09.148118] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-09-29T17:02:09.948122] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-09-29T17:02:10.500771] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-29T17:02:10.636826] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-29T17:02:10.748136] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2024-12. [2025-09-29T17:02:11.548121] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-09-29T17:02:12.348124] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-09-29T17:02:12.467428] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-29T17:02:12.981595] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-29T17:02:12.987868] [INFO ] [REMOTE ] ACP: Full fetch complete (47250 records). [2025-09-29T17:02:12.988046] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-09-29T17:02:12.992096] [FATAL] [VALIDATOR ] ACP: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:02:12.992245] [FATAL] [MAIN ] ACP: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:02:12.992290] [WARN ] [MAIN ] ACP: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:02:12.992365] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-09-29T17:02:12.992435] [DEBUG] [LOCAL ] ACP: No primary data file found to delete. [2025-09-29T17:02:12.992474] [INFO ] [LOCAL ] ACP: Starting deletion of derivative data. [2025-09-29T17:02:12.992905] [DEBUG] [LOCAL ] ACP: Deleted derivative data file. [2025-09-29T17:02:12.994295] [INFO ] [MAIN ] Update Progress: 24/2371 symbols completed. ACP took 30.4s. Estimated remaining: 3h 31m 60s. Rate: 11.1 symbols/min [2025-09-29T17:02:13.161861] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-09-29T17:02:13.213545] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:02:13.214529] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-09-29T17:02:13.214581] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-09-29T17:02:13.214780] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-09-29T17:02:13.214838] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-29T17:02:13.214885] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-29T17:02:13.214922] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-09-29T17:02:13.634318] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:02:13.826501] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-29T17:02:13.948145] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-09-29T17:02:14.485400] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-29T17:02:14.748133] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-09-29T17:02:14.946317] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-29T17:02:15.548124] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-09-29T17:02:15.870081] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-29T17:02:16.348109] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-09-29T17:02:17.016151] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-29T17:02:17.148120] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-09-29T17:02:17.872763] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-29T17:02:17.871205] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-29T17:02:17.948106] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-09-29T17:02:18.748178] [INFO ] [REMOTE ] AD: Fetching primary data for 2024-12. [2025-09-29T17:02:18.945844] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T17:02:18.946156] [WARN ] [REMOTE ] AD: No data returned for month 2024-12 [2025-09-29T17:02:18.946277] [FATAL] [REMOTE ] AD: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T17:02:18.946326] [FATAL] [MAIN ] AD: Failed to fetch primary data. [2025-09-29T17:02:18.946363] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T17:02:18.946402] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-29T17:02:18.946462] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-29T17:02:18.946501] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-09-29T17:02:18.946543] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-09-29T17:02:18.946593] [INFO ] [MAIN ] Update Progress: 25/2371 symbols completed. AD took 6.0s. Estimated remaining: 3h 32m 44s. Rate: 11.0 symbols/min [2025-09-29T17:02:19.138723] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:02:19.194560] [DEBUG] [LOCAL ] ADC: Loaded 46934 existing records from primary storage. [2025-09-29T17:02:19.194926] [INFO ] [MAIN ] ADC: Loaded 46934 existing records. [2025-09-29T17:02:19.415920] [WARN ] [MAIN ] ADC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:02:19.416250] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-09-29T17:02:19.416320] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-09-29T17:02:19.417243] [DEBUG] [LOCAL ] ADC: Deleted primary data file. [2025-09-29T17:02:19.417305] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-09-29T17:02:19.548485] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-09-29T17:02:19.844695] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:02:19.880541] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-29T17:02:20.245921] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-29T17:02:20.348129] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-09-29T17:02:21.148159] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-09-29T17:02:21.719439] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-29T17:02:21.726632] [INFO ] [REMOTE ] ACRE: Full fetch complete (50587 records). [2025-09-29T17:02:21.726784] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-09-29T17:02:21.959578] [INFO ] [REMOTE ] ADC: Fetching primary data for 2024-12. [2025-09-29T17:02:22.166456] [DEBUG] [VALIDATOR ] ACRE: All expected trading days are present. [2025-09-29T17:02:22.166551] [DEBUG] [VALIDATOR ] ACRE: Primary data validation passed. [2025-09-29T17:02:22.167205] [INFO ] [MAIN ] ACRE: Fetched primary data is valid. [2025-09-29T17:02:22.167277] [DEBUG] [LOCAL ] ACRE: Saving primary data. [2025-09-29T17:02:22.168818] [DEBUG] [LOCAL ] ACRE: Trimmed 50587 records to 33528 (keeping 200 days of data) [2025-09-29T17:02:22.386492] [DEBUG] [LOCAL ] ACRE: Primary data saved (33528 records). [2025-09-29T17:02:22.386676] [INFO ] [MAIN ] ACRE: Full history saved. [2025-09-29T17:02:22.386812] [INFO ] [MAIN ] Update Progress: 26/2371 symbols completed. ACRE took 33.9s. Estimated remaining: 3h 29m 39s. Rate: 11.2 symbols/min [2025-09-29T17:02:22.588685] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:02:22.626495] [DEBUG] [LOCAL ] ADCT: Loaded 34670 existing records from primary storage. [2025-09-29T17:02:22.626857] [INFO ] [MAIN ] ADCT: Loaded 34670 existing records. [2025-09-29T17:02:22.753203] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-09-29T17:02:22.831160] [WARN ] [MAIN ] ADCT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:02:22.831803] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-09-29T17:02:22.831913] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-09-29T17:02:22.832419] [DEBUG] [LOCAL ] ADCT: Deleted primary data file. [2025-09-29T17:02:22.832498] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-09-29T17:02:23.238489] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:02:23.271110] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-29T17:02:23.307588] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-29T17:02:23.403990] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-29T17:02:23.548171] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-09-29T17:02:24.348152] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2024-12. [2025-09-29T17:02:25.115533] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-29T17:02:25.148104] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-09-29T17:02:25.735599] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-29T17:02:25.948147] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-09-29T17:02:26.706321] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-29T17:02:26.748111] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-09-29T17:02:27.038041] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-29T17:02:27.548169] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-09-29T17:02:28.348124] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-09-29T17:02:28.475997] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-29T17:02:28.983639] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-29T17:02:29.148131] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-09-29T17:02:29.957351] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-09-29T17:02:29.969079] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-29T17:02:30.034562] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-29T17:02:30.723263] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-29T17:02:30.748141] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-09-29T17:02:31.548168] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-09-29T17:02:31.604479] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-29T17:02:31.607281] [INFO ] [REMOTE ] ACV: Full fetch complete (9856 records). [2025-09-29T17:02:31.607398] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-09-29T17:02:32.051058] [DEBUG] [VALIDATOR ] ACV: All expected trading days are present. [2025-09-29T17:02:32.051176] [DEBUG] [VALIDATOR ] ACV: Primary data validation passed. [2025-09-29T17:02:32.051482] [INFO ] [MAIN ] ACV: Fetched primary data is valid. [2025-09-29T17:02:32.051562] [DEBUG] [LOCAL ] ACV: Saving primary data. [2025-09-29T17:02:32.052195] [DEBUG] [LOCAL ] ACV: Trimmed 9856 records to 7105 (keeping 200 days of data) [2025-09-29T17:02:32.102496] [DEBUG] [LOCAL ] ACV: Primary data saved (7105 records). [2025-09-29T17:02:32.102676] [INFO ] [MAIN ] ACV: Full history saved. [2025-09-29T17:02:32.103017] [INFO ] [MAIN ] Update Progress: 27/2371 symbols completed. ACV took 33.6s. Estimated remaining: 3h 35m 51s. Rate: 10.9 symbols/min [2025-09-29T17:02:32.285289] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:02:32.347873] [DEBUG] [LOCAL ] ADM: Loaded 54175 existing records from primary storage. [2025-09-29T17:02:32.348184] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-09-29T17:02:32.350766] [INFO ] [MAIN ] ADM: Loaded 54175 existing records. [2025-09-29T17:02:32.548228] [WARN ] [MAIN ] ADM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:02:32.548537] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-09-29T17:02:32.548588] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-09-29T17:02:32.549536] [DEBUG] [LOCAL ] ADM: Deleted primary data file. [2025-09-29T17:02:32.549613] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-09-29T17:02:32.930738] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:02:32.950395] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-29T17:02:33.148171] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-09-29T17:02:33.948491] [INFO ] [REMOTE ] ADM: Fetching primary data for 2024-12. [2025-09-29T17:02:34.150301] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-29T17:02:34.428007] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-29T17:02:34.748135] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-09-29T17:02:35.548124] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-09-29T17:02:35.697300] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-29T17:02:36.348115] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-09-29T17:02:36.585173] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-29T17:02:37.001454] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-29T17:02:37.148156] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-09-29T17:02:37.948150] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-09-29T17:02:38.117957] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-29T17:02:38.748162] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-09-29T17:02:38.967512] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-29T17:02:38.978885] [INFO ] [REMOTE ] ACVA: Full fetch complete (70273 records). [2025-09-29T17:02:38.979068] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-09-29T17:02:39.413134] [DEBUG] [VALIDATOR ] ACVA: All expected trading days are present. [2025-09-29T17:02:39.427186] [DEBUG] [VALIDATOR ] ACVA: Primary data validation passed. [2025-09-29T17:02:39.438762] [INFO ] [MAIN ] ACVA: Fetched primary data is valid. [2025-09-29T17:02:39.439089] [DEBUG] [LOCAL ] ACVA: Saving primary data. [2025-09-29T17:02:39.441137] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-29T17:02:39.452356] [DEBUG] [LOCAL ] ACVA: Trimmed 70273 records to 49259 (keeping 200 days of data) [2025-09-29T17:02:39.548330] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-09-29T17:02:39.767964] [DEBUG] [LOCAL ] ACVA: Primary data saved (49259 records). [2025-09-29T17:02:39.768119] [INFO ] [MAIN ] ACVA: Full history saved. [2025-09-29T17:02:39.769220] [INFO ] [MAIN ] Update Progress: 28/2371 symbols completed. ACVA took 38.4s. Estimated remaining: 3h 38m 45s. Rate: 10.7 symbols/min [2025-09-29T17:02:39.950662] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:02:40.010508] [DEBUG] [LOCAL ] ADNT: Loaded 48095 existing records from primary storage. [2025-09-29T17:02:40.010921] [INFO ] [MAIN ] ADNT: Loaded 48095 existing records. [2025-09-29T17:02:40.206325] [WARN ] [MAIN ] ADNT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:02:40.206575] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-09-29T17:02:40.206637] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-09-29T17:02:40.207176] [DEBUG] [LOCAL ] ADNT: Deleted primary data file. [2025-09-29T17:02:40.207240] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-09-29T17:02:40.358378] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-09-29T17:02:40.658976] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:02:40.694358] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-29T17:02:41.148101] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-09-29T17:02:41.337505] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-29T17:02:41.948137] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-09-29T17:02:41.993987] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-29T17:02:42.748106] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-09-29T17:02:42.786996] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-29T17:02:43.507528] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-29T17:02:43.548129] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-09-29T17:02:44.171119] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-29T17:02:44.348126] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2024-12. [2025-09-29T17:02:45.148171] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-09-29T17:02:45.460727] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-29T17:02:45.954007] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-09-29T17:02:45.959229] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-29T17:02:46.722377] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-29T17:02:46.748077] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-09-29T17:02:47.548180] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-09-29T17:02:47.608011] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-29T17:02:47.622197] [INFO ] [REMOTE ] ADCT: Full fetch complete (51576 records). [2025-09-29T17:02:47.622491] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-09-29T17:02:48.045891] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present. [2025-09-29T17:02:48.046138] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed. [2025-09-29T17:02:48.046821] [INFO ] [MAIN ] ADCT: Fetched primary data is valid. [2025-09-29T17:02:48.046909] [DEBUG] [LOCAL ] ADCT: Saving primary data. [2025-09-29T17:02:48.048406] [DEBUG] [LOCAL ] ADCT: Trimmed 51576 records to 34320 (keeping 200 days of data) [2025-09-29T17:02:48.181861] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-29T17:02:48.291830] [DEBUG] [LOCAL ] ADCT: Primary data saved (34320 records). [2025-09-29T17:02:48.291999] [INFO ] [MAIN ] ADCT: Full history saved. [2025-09-29T17:02:48.292094] [INFO ] [MAIN ] Update Progress: 29/2371 symbols completed. ADCT took 25.9s. Estimated remaining: 3h 42m 35s. Rate: 10.5 symbols/min [2025-09-29T17:02:48.353300] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-09-29T17:02:48.478514] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:02:48.539571] [DEBUG] [LOCAL ] ADT: Loaded 54253 existing records from primary storage. [2025-09-29T17:02:48.539974] [INFO ] [MAIN ] ADT: Loaded 54253 existing records. [2025-09-29T17:02:48.732145] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:02:48.732385] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-09-29T17:02:48.732447] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-09-29T17:02:48.733089] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-09-29T17:02:48.733155] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-09-29T17:02:49.145052] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:02:49.148072] [INFO ] [REMOTE ] ADT: Fetching primary data for 2024-12. [2025-09-29T17:02:49.185728] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-29T17:02:49.666204] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-29T17:02:49.675773] [INFO ] [REMOTE ] ADC: Full fetch complete (66099 records). [2025-09-29T17:02:49.675932] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-09-29T17:02:49.957156] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-09-29T17:02:50.106681] [DEBUG] [VALIDATOR ] ADC: All expected trading days are present. [2025-09-29T17:02:50.106832] [DEBUG] [VALIDATOR ] ADC: Primary data validation passed. [2025-09-29T17:02:50.107704] [INFO ] [MAIN ] ADC: Fetched primary data is valid. [2025-09-29T17:02:50.107779] [DEBUG] [LOCAL ] ADC: Saving primary data. [2025-09-29T17:02:50.109280] [DEBUG] [LOCAL ] ADC: Trimmed 66099 records to 46182 (keeping 200 days of data) [2025-09-29T17:02:50.430296] [DEBUG] [LOCAL ] ADC: Primary data saved (46182 records). [2025-09-29T17:02:50.430458] [INFO ] [MAIN ] ADC: Full history saved. [2025-09-29T17:02:50.431534] [INFO ] [MAIN ] Update Progress: 30/2371 symbols completed. ADC took 31.5s. Estimated remaining: 3h 37m 51s. Rate: 10.7 symbols/min [2025-09-29T17:02:50.634618] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:02:50.672844] [DEBUG] [LOCAL ] ADX: Loaded 28180 existing records from primary storage. [2025-09-29T17:02:50.673114] [INFO ] [MAIN ] ADX: Loaded 28180 existing records. [2025-09-29T17:02:50.753255] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-09-29T17:02:50.870544] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:02:50.870792] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-09-29T17:02:50.870924] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-09-29T17:02:50.871504] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-09-29T17:02:50.871571] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-09-29T17:02:51.299076] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:02:51.305675] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-29T17:02:51.541767] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-29T17:02:51.551570] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-09-29T17:02:52.348154] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-09-29T17:02:52.860453] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-29T17:02:53.148171] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-09-29T17:02:53.247709] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-29T17:02:53.948135] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-09-29T17:02:54.102677] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-29T17:02:54.748089] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-09-29T17:02:55.187487] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-29T17:02:55.548125] [INFO ] [REMOTE ] ADX: Fetching primary data for 2024-12. [2025-09-29T17:02:55.751223] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-29T17:02:56.348118] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-09-29T17:02:56.501925] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-29T17:02:57.061592] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-29T17:02:57.148110] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-09-29T17:02:57.948117] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-09-29T17:02:58.084591] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-29T17:02:58.156523] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-29T17:02:58.748113] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-09-29T17:02:59.552706] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-09-29T17:02:59.559034] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-29T17:03:00.348089] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-09-29T17:03:00.491309] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-29T17:03:00.781009] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-29T17:03:01.148130] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-09-29T17:03:01.577597] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-29T17:03:01.948156] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-09-29T17:03:02.748204] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-09-29T17:03:02.910128] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-29T17:03:03.548119] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-09-29T17:03:03.654163] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-29T17:03:04.348240] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-09-29T17:03:05.148190] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-09-29T17:03:05.532842] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-29T17:03:05.634831] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-29T17:03:05.948149] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-09-29T17:03:06.748174] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-09-29T17:03:06.993472] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (4.25 seconds). [2025-09-29T17:03:07.347325] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-29T17:03:07.525305] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-29T17:03:07.535683] [INFO ] [REMOTE ] ADNT: Full fetch complete (67750 records). [2025-09-29T17:03:07.535861] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-09-29T17:03:07.536914] [FATAL] [VALIDATOR ] ADNT: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:03:07.537062] [FATAL] [MAIN ] ADNT: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:03:07.537125] [WARN ] [MAIN ] ADNT: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:03:07.537171] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-09-29T17:03:07.537245] [DEBUG] [LOCAL ] ADNT: No primary data file found to delete. [2025-09-29T17:03:07.537314] [INFO ] [LOCAL ] ADNT: Starting deletion of derivative data. [2025-09-29T17:03:07.538252] [DEBUG] [LOCAL ] ADNT: Deleted derivative data file. [2025-09-29T17:03:07.539155] [INFO ] [MAIN ] Update Progress: 31/2371 symbols completed. ADNT took 27.8s. Estimated remaining: 3h 52m 16s. Rate: 10.1 symbols/min [2025-09-29T17:03:07.553297] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-09-29T17:03:07.724280] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:03:07.789600] [DEBUG] [LOCAL ] AEE: Loaded 50875 existing records from primary storage. [2025-09-29T17:03:07.790158] [INFO ] [MAIN ] AEE: Loaded 50875 existing records. [2025-09-29T17:03:07.979035] [WARN ] [MAIN ] AEE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:03:07.979259] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-09-29T17:03:07.979310] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-09-29T17:03:07.980419] [DEBUG] [LOCAL ] AEE: Deleted primary data file. [2025-09-29T17:03:07.980482] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-09-29T17:03:08.361422] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:03:08.353608] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-09-29T17:03:09.148107] [INFO ] [REMOTE ] AEE: Fetching primary data for 2024-12. [2025-09-29T17:03:09.386712] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (2.64 seconds). [2025-09-29T17:03:09.513787] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-29T17:03:09.619125] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-29T17:03:09.948159] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-09-29T17:03:10.748173] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-09-29T17:03:10.811666] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-29T17:03:11.119297] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-29T17:03:11.548116] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-09-29T17:03:12.348140] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-09-29T17:03:12.469269] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-29T17:03:12.767409] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-29T17:03:12.778364] [INFO ] [REMOTE ] ADM: Full fetch complete (76844 records). [2025-09-29T17:03:12.778573] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-09-29T17:03:12.779749] [FATAL] [VALIDATOR ] ADM: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:03:12.779896] [FATAL] [MAIN ] ADM: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:03:12.779950] [WARN ] [MAIN ] ADM: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:03:12.780005] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-09-29T17:03:12.780094] [DEBUG] [LOCAL ] ADM: No primary data file found to delete. [2025-09-29T17:03:12.780199] [INFO ] [LOCAL ] ADM: Starting deletion of derivative data. [2025-09-29T17:03:12.781183] [DEBUG] [LOCAL ] ADM: Deleted derivative data file. [2025-09-29T17:03:12.781314] [INFO ] [MAIN ] Update Progress: 32/2371 symbols completed. ADM took 40.7s. Estimated remaining: 3h 51m 17s. Rate: 10.1 symbols/min [2025-09-29T17:03:12.994339] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:03:13.008334] [DEBUG] [LOCAL ] AEFC: Loaded 8643 existing records from primary storage. [2025-09-29T17:03:13.008600] [INFO ] [MAIN ] AEFC: Loaded 8643 existing records. [2025-09-29T17:03:13.156738] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-09-29T17:03:13.207064] [WARN ] [MAIN ] AEFC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:03:13.207461] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-09-29T17:03:13.207525] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-09-29T17:03:13.207742] [DEBUG] [LOCAL ] AEFC: Deleted primary data file. [2025-09-29T17:03:13.207800] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-09-29T17:03:13.603887] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:03:13.948175] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2024-12. [2025-09-29T17:03:14.225761] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-29T17:03:14.748176] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-09-29T17:03:14.845036] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-29T17:03:14.961827] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-29T17:03:15.548166] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-09-29T17:03:16.256561] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-29T17:03:16.348156] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-09-29T17:03:17.148133] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-09-29T17:03:17.182889] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-29T17:03:17.537386] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-29T17:03:17.948143] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-09-29T17:03:18.665298] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-29T17:03:18.748112] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-09-29T17:03:19.078325] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-29T17:03:19.482001] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-29T17:03:19.548168] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-09-29T17:03:20.348194] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-09-29T17:03:21.148146] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-09-29T17:03:21.417627] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-29T17:03:21.948112] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-09-29T17:03:22.250053] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-29T17:03:22.261370] [INFO ] [REMOTE ] ADT: Full fetch complete (77202 records). [2025-09-29T17:03:22.261561] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-09-29T17:03:22.615440] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-29T17:03:22.688070] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-29T17:03:22.730987] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-09-29T17:03:22.731254] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-09-29T17:03:22.732099] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-09-29T17:03:22.732195] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-09-29T17:03:22.732360] [INFO ] [REMOTE ] ADX: Full fetch complete (42074 records). [2025-09-29T17:03:22.732597] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-09-29T17:03:22.748935] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-09-29T17:03:22.795580] [DEBUG] [LOCAL ] ADT: Trimmed 77202 records to 53469 (keeping 200 days of data) [2025-09-29T17:03:23.296183] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-09-29T17:03:23.298007] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-09-29T17:03:23.298809] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-09-29T17:03:23.301603] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-09-29T17:03:23.305350] [DEBUG] [LOCAL ] ADX: Trimmed 42074 records to 27588 (keeping 200 days of data) [2025-09-29T17:03:23.548186] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-09-29T17:03:23.660191] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-29T17:03:23.728326] [DEBUG] [LOCAL ] ADX: Primary data saved (27588 records). [2025-09-29T17:03:23.729325] [INFO ] [MAIN ] ADX: Full history saved. [2025-09-29T17:03:23.729733] [INFO ] [MAIN ] Update Progress: 33/2371 symbols completed. ADX took 33.3s. Estimated remaining: 3h 57m 7s. Rate: 9.9 symbols/min [2025-09-29T17:03:23.938254] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:03:23.944373] [DEBUG] [LOCAL ] ADT: Primary data saved (53469 records). [2025-09-29T17:03:23.944568] [INFO ] [MAIN ] ADT: Full history saved. [2025-09-29T17:03:23.944720] [INFO ] [MAIN ] Update Progress: 34/2371 symbols completed. ADT took 35.7s. Estimated remaining: 3h 50m 17s. Rate: 10.1 symbols/min [2025-09-29T17:03:24.146050] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:03:24.163180] [DEBUG] [LOCAL ] AEG: Loaded 50307 existing records from primary storage. [2025-09-29T17:03:24.163549] [INFO ] [MAIN ] AEG: Loaded 50307 existing records. [2025-09-29T17:03:24.355054] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-09-29T17:03:24.354860] [WARN ] [MAIN ] AEG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:03:24.356180] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-09-29T17:03:24.356283] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-09-29T17:03:24.356831] [DEBUG] [LOCAL ] AEG: Deleted primary data file. [2025-09-29T17:03:24.356992] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-09-29T17:03:24.590199] [DEBUG] [LOCAL ] AEM: Loaded 54243 existing records from primary storage. [2025-09-29T17:03:24.664205] [INFO ] [MAIN ] AEM: Loaded 54243 existing records. [2025-09-29T17:03:24.977959] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:03:24.998574] [WARN ] [MAIN ] AEM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:03:24.999513] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-09-29T17:03:24.999788] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-09-29T17:03:25.001103] [DEBUG] [LOCAL ] AEM: Deleted primary data file. [2025-09-29T17:03:25.001169] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-09-29T17:03:25.150436] [INFO ] [REMOTE ] AEG: Fetching primary data for 2024-12. [2025-09-29T17:03:25.395073] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:03:25.404574] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-29T17:03:25.436338] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-29T17:03:25.948138] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-09-29T17:03:26.748105] [INFO ] [REMOTE ] AEM: Fetching primary data for 2024-12. [2025-09-29T17:03:27.004084] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-29T17:03:27.548137] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-09-29T17:03:27.770604] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-29T17:03:28.046866] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-29T17:03:28.348092] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-09-29T17:03:28.582545] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-29T17:03:29.148126] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-09-29T17:03:29.749181] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-29T17:03:29.948086] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-09-29T17:03:29.977528] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-29T17:03:30.680296] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-29T17:03:30.748091] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-09-29T17:03:31.548176] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-09-29T17:03:32.348098] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-09-29T17:03:32.622057] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-29T17:03:33.132807] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-29T17:03:33.148070] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-09-29T17:03:33.948140] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-09-29T17:03:34.120900] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-29T17:03:34.446043] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-29T17:03:34.448109] [INFO ] [REMOTE ] AEFC: Full fetch complete (12261 records). [2025-09-29T17:03:34.448189] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-09-29T17:03:34.753232] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-09-29T17:03:34.856715] [DEBUG] [VALIDATOR ] AEFC: All expected trading days are present. [2025-09-29T17:03:34.856959] [DEBUG] [VALIDATOR ] AEFC: Primary data validation passed. [2025-09-29T17:03:34.857272] [INFO ] [MAIN ] AEFC: Fetched primary data is valid. [2025-09-29T17:03:34.857355] [DEBUG] [LOCAL ] AEFC: Saving primary data. [2025-09-29T17:03:34.872568] [DEBUG] [LOCAL ] AEFC: Trimmed 12261 records to 8491 (keeping 200 days of data) [2025-09-29T17:03:34.906254] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-29T17:03:34.948559] [DEBUG] [LOCAL ] AEFC: Primary data saved (8491 records). [2025-09-29T17:03:34.948728] [INFO ] [MAIN ] AEFC: Full history saved. [2025-09-29T17:03:34.948834] [INFO ] [MAIN ] Update Progress: 35/2371 symbols completed. AEFC took 22.2s. Estimated remaining: 3h 55m 51s. Rate: 9.9 symbols/min [2025-09-29T17:03:35.124765] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:03:35.193820] [DEBUG] [LOCAL ] AEO: Loaded 54336 existing records from primary storage. [2025-09-29T17:03:35.194203] [INFO ] [MAIN ] AEO: Loaded 54336 existing records. [2025-09-29T17:03:35.402968] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:03:35.403268] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-09-29T17:03:35.403325] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-09-29T17:03:35.404300] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-09-29T17:03:35.404363] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-09-29T17:03:35.553240] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-09-29T17:03:35.781024] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:03:36.348112] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-09-29T17:03:36.461673] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-29T17:03:37.148172] [INFO ] [REMOTE ] AEO: Fetching primary data for 2024-12. [2025-09-29T17:03:37.390149] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-29T17:03:37.948159] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-09-29T17:03:38.323870] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-29T17:03:38.748091] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-09-29T17:03:39.092621] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-29T17:03:39.548119] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-09-29T17:03:39.819629] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-29T17:03:40.336204] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-29T17:03:40.348089] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-09-29T17:03:41.148121] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-09-29T17:03:41.335823] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-29T17:03:41.352850] [INFO ] [REMOTE ] AEE: Full fetch complete (72568 records). [2025-09-29T17:03:41.353059] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-09-29T17:03:41.819511] [DEBUG] [VALIDATOR ] AEE: All expected trading days are present. [2025-09-29T17:03:41.819609] [DEBUG] [VALIDATOR ] AEE: Primary data validation passed. [2025-09-29T17:03:41.820302] [INFO ] [MAIN ] AEE: Fetched primary data is valid. [2025-09-29T17:03:41.820369] [DEBUG] [LOCAL ] AEE: Saving primary data. [2025-09-29T17:03:41.822022] [DEBUG] [LOCAL ] AEE: Trimmed 72568 records to 50084 (keeping 200 days of data) [2025-09-29T17:03:41.948189] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-09-29T17:03:42.173419] [DEBUG] [LOCAL ] AEE: Primary data saved (50084 records). [2025-09-29T17:03:42.173560] [INFO ] [MAIN ] AEE: Full history saved. [2025-09-29T17:03:42.177600] [INFO ] [MAIN ] Update Progress: 36/2371 symbols completed. AEE took 34.6s. Estimated remaining: 3h 57m 1s. Rate: 9.9 symbols/min [2025-09-29T17:03:42.378222] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:03:42.442482] [DEBUG] [LOCAL ] AER: Loaded 49271 existing records from primary storage. [2025-09-29T17:03:42.442855] [INFO ] [MAIN ] AER: Loaded 49271 existing records. [2025-09-29T17:03:42.640003] [WARN ] [MAIN ] AER: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:03:42.640325] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-09-29T17:03:42.640382] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-09-29T17:03:42.657462] [DEBUG] [LOCAL ] AER: Deleted primary data file. [2025-09-29T17:03:42.669829] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-09-29T17:03:42.738604] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-29T17:03:42.812348] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-09-29T17:03:43.089314] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-29T17:03:43.133711] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:03:43.548084] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-09-29T17:03:43.630906] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-29T17:03:44.348118] [INFO ] [REMOTE ] AER: Fetching primary data for 2024-12. [2025-09-29T17:03:44.962009] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-29T17:03:45.148087] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-09-29T17:03:45.351472] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-29T17:03:45.948091] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-09-29T17:03:46.041536] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-29T17:03:46.748171] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-09-29T17:03:46.798131] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-29T17:03:47.548169] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-09-29T17:03:47.683214] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-29T17:03:48.348161] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-09-29T17:03:48.382729] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-29T17:03:49.148115] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-09-29T17:03:49.278392] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-29T17:03:49.948126] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-09-29T17:03:50.389809] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-29T17:03:50.433152] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-29T17:03:50.748117] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-09-29T17:03:51.548119] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-09-29T17:03:51.794384] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-29T17:03:52.348151] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-09-29T17:03:52.421107] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-29T17:03:53.148139] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-09-29T17:03:53.617407] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-29T17:03:53.948087] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-09-29T17:03:54.282518] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-29T17:03:54.748119] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-09-29T17:03:55.018868] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-29T17:03:55.029068] [INFO ] [REMOTE ] AEG: Full fetch complete (70339 records). [2025-09-29T17:03:55.029203] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-09-29T17:03:55.442315] [DEBUG] [VALIDATOR ] AEG: All expected trading days are present. [2025-09-29T17:03:55.442412] [DEBUG] [VALIDATOR ] AEG: Primary data validation passed. [2025-09-29T17:03:55.443296] [INFO ] [MAIN ] AEG: Fetched primary data is valid. [2025-09-29T17:03:55.443366] [DEBUG] [LOCAL ] AEG: Saving primary data. [2025-09-29T17:03:55.444897] [DEBUG] [LOCAL ] AEG: Trimmed 70339 records to 49547 (keeping 200 days of data) [2025-09-29T17:03:55.550279] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-09-29T17:03:55.704492] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-29T17:03:55.836900] [DEBUG] [LOCAL ] AEG: Primary data saved (49547 records). [2025-09-29T17:03:55.837122] [INFO ] [MAIN ] AEG: Full history saved. [2025-09-29T17:03:55.838942] [INFO ] [MAIN ] Update Progress: 37/2371 symbols completed. AEG took 32.1s. Estimated remaining: 4h 4m 53s. Rate: 9.5 symbols/min [2025-09-29T17:03:56.348106] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-09-29T17:03:56.803663] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-29T17:03:57.148109] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-09-29T17:03:58.485961] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-29T17:03:58.497762] [INFO ] [REMOTE ] AEM: Full fetch complete (77149 records). [2025-09-29T17:03:58.497935] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-09-29T17:03:58.939870] [DEBUG] [VALIDATOR ] AEM: All expected trading days are present. [2025-09-29T17:03:58.940083] [DEBUG] [VALIDATOR ] AEM: Primary data validation passed. [2025-09-29T17:03:58.941049] [INFO ] [MAIN ] AEM: Fetched primary data is valid. [2025-09-29T17:03:58.951290] [DEBUG] [LOCAL ] AEM: Saving primary data. [2025-09-29T17:03:58.971982] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-29T17:03:58.982957] [DEBUG] [LOCAL ] AEM: Trimmed 77149 records to 53465 (keeping 200 days of data) [2025-09-29T17:03:58.984557] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-09-29T17:03:59.378608] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (3.83 seconds). [2025-09-29T17:03:59.380904] [DEBUG] [LOCAL ] AEM: Primary data saved (53465 records). [2025-09-29T17:03:59.394261] [INFO ] [MAIN ] AEM: Full history saved. [2025-09-29T17:03:59.395169] [INFO ] [MAIN ] Update Progress: 38/2371 symbols completed. AEM took 35.5s. Estimated remaining: 4h 1m 58s. Rate: 9.6 symbols/min [2025-09-29T17:03:59.395902] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-09-29T17:04:01.134437] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-29T17:04:01.145220] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-09-29T17:04:01.321513] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-09-29T17:04:01.335316] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-09-29T17:04:02.767551] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-29T17:04:02.777287] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-09-29T17:04:03.611249] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-09-29T17:04:03.624235] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-09-29T17:04:04.450251] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-29T17:04:04.461810] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-09-29T17:04:05.762852] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-29T17:04:05.774453] [INFO ] [REMOTE ] AEO: Full fetch complete (77444 records). [2025-09-29T17:04:05.774704] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-09-29T17:04:06.205811] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-09-29T17:04:06.206084] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-09-29T17:04:06.206989] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-09-29T17:04:06.207349] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-09-29T17:04:06.219455] [DEBUG] [LOCAL ] AEO: Trimmed 77444 records to 53558 (keeping 200 days of data) [2025-09-29T17:04:06.240626] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-29T17:04:06.317139] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-09-29T17:04:06.596810] [DEBUG] [LOCAL ] AEO: Primary data saved (53558 records). [2025-09-29T17:04:06.596968] [INFO ] [MAIN ] AEO: Full history saved. [2025-09-29T17:04:06.597077] [INFO ] [MAIN ] Update Progress: 39/2371 symbols completed. AEO took 31.6s. Estimated remaining: 4h 2m 50s. Rate: 9.6 symbols/min [2025-09-29T17:04:08.202797] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-29T17:04:08.213003] [INFO ] [REMOTE ] AER: Full fetch complete (69556 records). [2025-09-29T17:04:08.213188] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-09-29T17:04:08.664081] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-09-29T17:04:08.664180] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-09-29T17:04:08.665109] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-09-29T17:04:08.665181] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-09-29T17:04:08.666750] [DEBUG] [LOCAL ] AER: Trimmed 69556 records to 48447 (keeping 200 days of data) [2025-09-29T17:04:08.997947] [DEBUG] [LOCAL ] AER: Primary data saved (48447 records). [2025-09-29T17:04:08.998104] [INFO ] [MAIN ] AER: Full history saved. [2025-09-29T17:04:08.999361] [INFO ] [MAIN ] Update Progress: 40/2371 symbols completed. AER took 26.8s. Estimated remaining: 3h 59m 0s. Rate: 9.8 symbols/min [2025-09-29T17:04:09.730777] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:04:09.823376] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:04:09.809930] [INFO ] [MAIN ] AEXA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:04:09.831774] [DEBUG] [LOCAL ] AEXA: No existing data file found in primary storage. [2025-09-29T17:04:09.837631] [WARN ] [MAIN ] AEXA: No existing data found, performing full refresh instead. [2025-09-29T17:04:09.838261] [INFO ] [MAIN ] AEXA: Wiping existing primary data before full refresh. [2025-09-29T17:04:09.838347] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-09-29T17:04:09.838426] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-09-29T17:04:09.838477] [INFO ] [MAIN ] AEXA: Starting full primary refresh. [2025-09-29T17:04:09.868772] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:04:09.950131] [DEBUG] [LOCAL ] AFB: Loaded 11422 existing records from primary storage. [2025-09-29T17:04:09.980827] [INFO ] [MAIN ] AFB: Loaded 11422 existing records. [2025-09-29T17:04:10.427327] [WARN ] [MAIN ] AFB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:04:10.442020] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-09-29T17:04:10.442688] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-09-29T17:04:10.441729] [DEBUG] [LOCAL ] AESI: Loaded 50213 existing records from primary storage. [2025-09-29T17:04:10.485021] [DEBUG] [LOCAL ] AES: Loaded 54450 existing records from primary storage. [2025-09-29T17:04:10.463479] [DEBUG] [LOCAL ] AFB: Deleted primary data file. [2025-09-29T17:04:10.502254] [INFO ] [MAIN ] AESI: Loaded 50213 existing records. [2025-09-29T17:04:10.507611] [INFO ] [MAIN ] AES: Loaded 54450 existing records. [2025-09-29T17:04:10.529206] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-09-29T17:04:10.658765] [INFO ] [REMOTE ] AEXA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:04:10.784621] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2024-12. [2025-09-29T17:04:11.159057] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T17:04:11.186884] [WARN ] [REMOTE ] AEXA: No data returned for month 2024-12 [2025-09-29T17:04:11.196843] [WARN ] [MAIN ] AESI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:04:11.237357] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-09-29T17:04:11.229687] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:04:11.237870] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-09-29T17:04:11.237703] [FATAL] [REMOTE ] AEXA: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T17:04:11.237969] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-09-29T17:04:11.253405] [FATAL] [MAIN ] AEXA: Failed to fetch primary data. [2025-09-29T17:04:11.274455] [WARN ] [MAIN ] AEXA: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T17:04:11.285048] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-09-29T17:04:11.269224] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-09-29T17:04:11.290474] [DEBUG] [LOCAL ] AESI: Deleted primary data file. [2025-09-29T17:04:11.290569] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-09-29T17:04:11.301061] [INFO ] [LOCAL ] AEXA: Starting deletion of derivative data. [2025-09-29T17:04:11.308027] [DEBUG] [LOCAL ] AEXA: No derivative data file found to delete. [2025-09-29T17:04:11.307970] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-09-29T17:04:11.308246] [INFO ] [MAIN ] Update Progress: 41/2371 symbols completed. AEXA took 2.3s. Estimated remaining: 3h 55m 16s. Rate: 9.9 symbols/min [2025-09-29T17:04:11.336272] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-09-29T17:04:11.368814] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-09-29T17:04:11.696918] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:04:11.703328] [INFO ] [REMOTE ] AFB: Fetching primary data for 2024-12. [2025-09-29T17:04:11.880673] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:04:12.350924] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:04:12.368332] [INFO ] [REMOTE ] AESI: Fetching primary data for 2024-12. [2025-09-29T17:04:12.451284] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:04:12.451905] [INFO ] [REMOTE ] AES: Fetching primary data for 2024-12. [2025-09-29T17:04:12.453015] [DEBUG] [LOCAL ] AFG: Loaded 33021 existing records from primary storage. [2025-09-29T17:04:12.454392] [INFO ] [MAIN ] AFG: Loaded 33021 existing records. [2025-09-29T17:04:12.654438] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:04:12.654697] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-09-29T17:04:12.654760] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-09-29T17:04:12.655071] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-09-29T17:04:12.655189] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-09-29T17:04:13.013598] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-29T17:04:13.043546] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-09-29T17:04:13.102159] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:04:13.102787] [INFO ] [REMOTE ] AFG: Fetching primary data for 2024-12. [2025-09-29T17:04:13.914594] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-29T17:04:13.918993] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-09-29T17:04:14.020098] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-29T17:04:14.031219] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-09-29T17:04:14.549423] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-29T17:04:14.554971] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-09-29T17:04:14.629241] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-29T17:04:14.640913] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-09-29T17:04:14.849948] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-29T17:04:14.852848] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-09-29T17:04:15.509035] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-29T17:04:15.519014] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-09-29T17:04:15.727498] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-29T17:04:15.736153] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-09-29T17:04:15.802488] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-29T17:04:15.808805] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-09-29T17:04:16.660579] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-29T17:04:16.662327] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-29T17:04:16.677028] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-09-29T17:04:16.678340] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-09-29T17:04:16.915153] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-29T17:04:17.148134] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-09-29T17:04:17.183167] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-29T17:04:17.542816] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-29T17:04:17.948163] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-09-29T17:04:18.451259] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-29T17:04:18.572933] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-29T17:04:18.748153] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-09-29T17:04:19.548089] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-09-29T17:04:19.634841] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-29T17:04:19.994367] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-29T17:04:20.348177] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-09-29T17:04:21.148148] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-09-29T17:04:21.927398] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-29T17:04:21.948098] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-09-29T17:04:22.016467] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-29T17:04:22.748153] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-09-29T17:04:23.065243] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (3.52 seconds). [2025-09-29T17:04:23.327505] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-29T17:04:23.548112] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-09-29T17:04:23.762689] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-29T17:04:24.348146] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-09-29T17:04:24.984433] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-29T17:04:25.148122] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-09-29T17:04:25.319241] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-29T17:04:25.322986] [INFO ] [REMOTE ] AFB: Full fetch complete (16558 records). [2025-09-29T17:04:25.323136] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-09-29T17:04:25.778123] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-09-29T17:04:25.778466] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-09-29T17:04:25.778772] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-09-29T17:04:25.778852] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-09-29T17:04:25.779541] [DEBUG] [LOCAL ] AFB: Trimmed 16558 records to 11281 (keeping 200 days of data) [2025-09-29T17:04:25.853215] [DEBUG] [LOCAL ] AFB: Primary data saved (11281 records). [2025-09-29T17:04:25.853360] [INFO ] [MAIN ] AFB: Full history saved. [2025-09-29T17:04:25.853476] [INFO ] [MAIN ] Update Progress: 42/2371 symbols completed. AFB took 16.8s. Estimated remaining: 4h 3m 0s. Rate: 9.6 symbols/min [2025-09-29T17:04:25.953272] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-09-29T17:04:26.043072] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:04:26.047390] [DEBUG] [LOCAL ] AFGB: Loaded 2404 existing records from primary storage. [2025-09-29T17:04:26.047605] [INFO ] [MAIN ] AFGB: Loaded 2404 existing records. [2025-09-29T17:04:26.244942] [WARN ] [MAIN ] AFGB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:04:26.245326] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-09-29T17:04:26.245441] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-09-29T17:04:26.246045] [DEBUG] [LOCAL ] AFGB: Deleted primary data file. [2025-09-29T17:04:26.246116] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-09-29T17:04:26.642662] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:04:26.748139] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2024-12. [2025-09-29T17:04:27.244461] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-29T17:04:27.314720] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-29T17:04:27.548184] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-09-29T17:04:27.952009] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-29T17:04:28.348122] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-09-29T17:04:29.100270] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-29T17:04:29.148098] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-09-29T17:04:29.605272] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-29T17:04:29.948147] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-09-29T17:04:30.486881] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-29T17:04:30.748124] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-09-29T17:04:31.548136] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-09-29T17:04:31.674198] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-29T17:04:32.348144] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-09-29T17:04:32.594544] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-29T17:04:32.898307] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-29T17:04:32.919635] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-29T17:04:33.148148] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-09-29T17:04:33.699682] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-29T17:04:33.948118] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-09-29T17:04:34.411190] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-29T17:04:34.748128] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-09-29T17:04:35.297807] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-29T17:04:35.548114] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-09-29T17:04:36.046997] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-29T17:04:36.348156] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-09-29T17:04:37.148153] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-09-29T17:04:37.634931] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-29T17:04:37.808860] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-29T17:04:37.948113] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-09-29T17:04:38.748171] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-09-29T17:04:39.548116] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-09-29T17:04:40.032182] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-29T17:04:40.076000] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-29T17:04:40.348114] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-09-29T17:04:41.148102] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-09-29T17:04:41.948110] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-09-29T17:04:42.076719] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-09-29T17:04:42.531083] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-29T17:04:42.532309] [INFO ] [REMOTE ] AFGB: Full fetch complete (3655 records). [2025-09-29T17:04:42.532449] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-09-29T17:04:42.777700] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-09-29T17:04:42.777566] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-09-29T17:04:42.860971] [INFO ] [REMOTE ] AFG: Full fetch complete (45788 records). [2025-09-29T17:04:42.871710] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-09-29T17:04:43.123050] [DEBUG] [VALIDATOR ] AFGB: All expected trading days are present. [2025-09-29T17:04:43.128736] [DEBUG] [VALIDATOR ] AFGB: Primary data validation passed. [2025-09-29T17:04:43.209224] [INFO ] [MAIN ] AFGB: Fetched primary data is valid. [2025-09-29T17:04:43.231520] [DEBUG] [LOCAL ] AFGB: Saving primary data. [2025-09-29T17:04:43.265284] [DEBUG] [LOCAL ] AFGB: Trimmed 3655 records to 2333 (keeping 200 days of data) [2025-09-29T17:04:43.445492] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-29T17:04:43.450924] [DEBUG] [LOCAL ] AFGB: Primary data saved (2333 records). [2025-09-29T17:04:43.476394] [INFO ] [MAIN ] AFGB: Full history saved. [2025-09-29T17:04:43.491848] [INFO ] [MAIN ] Update Progress: 43/2371 symbols completed. AFGB took 17.6s. Estimated remaining: 4h 13m 10s. Rate: 9.2 symbols/min [2025-09-29T17:04:43.495194] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present. [2025-09-29T17:04:43.539920] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed. [2025-09-29T17:04:43.553348] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-09-29T17:04:43.575979] [INFO ] [MAIN ] AFG: Fetched primary data is valid. [2025-09-29T17:04:43.581269] [DEBUG] [LOCAL ] AFG: Saving primary data. [2025-09-29T17:04:43.622822] [DEBUG] [LOCAL ] AFG: Trimmed 45788 records to 32404 (keeping 200 days of data) [2025-09-29T17:04:43.682838] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:04:43.689588] [DEBUG] [LOCAL ] AFGC: Loaded 2602 existing records from primary storage. [2025-09-29T17:04:43.744015] [INFO ] [MAIN ] AFGC: Loaded 2602 existing records. [2025-09-29T17:04:43.986905] [WARN ] [MAIN ] AFGC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:04:43.989628] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-09-29T17:04:43.990037] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-09-29T17:04:43.991881] [DEBUG] [LOCAL ] AFGC: Deleted primary data file. [2025-09-29T17:04:43.991969] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-09-29T17:04:44.398823] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:04:44.400867] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2024-12. [2025-09-29T17:04:44.490899] [DEBUG] [LOCAL ] AFG: Primary data saved (32404 records). [2025-09-29T17:04:44.491065] [INFO ] [MAIN ] AFG: Full history saved. [2025-09-29T17:04:44.491196] [INFO ] [MAIN ] Update Progress: 44/2371 symbols completed. AFG took 33.2s. Estimated remaining: 4h 8m 11s. Rate: 9.4 symbols/min [2025-09-29T17:04:44.698955] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-29T17:04:44.719406] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:04:44.735039] [DEBUG] [LOCAL ] AFGD: Loaded 1859 existing records from primary storage. [2025-09-29T17:04:44.735241] [INFO ] [MAIN ] AFGD: Loaded 1859 existing records. [2025-09-29T17:04:44.924281] [WARN ] [MAIN ] AFGD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:04:44.924546] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-09-29T17:04:44.924611] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-09-29T17:04:44.925014] [DEBUG] [LOCAL ] AFGD: Deleted primary data file. [2025-09-29T17:04:44.925080] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-09-29T17:04:45.054816] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-29T17:04:45.152765] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-09-29T17:04:45.323034] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:04:45.749344] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-29T17:04:45.762534] [INFO ] [REMOTE ] AES: Full fetch complete (77722 records). [2025-09-29T17:04:45.762737] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-09-29T17:04:45.872744] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-29T17:04:45.951502] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-09-29T17:04:46.204269] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-09-29T17:04:46.204359] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-09-29T17:04:46.205159] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-09-29T17:04:46.205229] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-09-29T17:04:46.207159] [DEBUG] [LOCAL ] AES: Trimmed 77722 records to 53670 (keeping 200 days of data) [2025-09-29T17:04:46.531995] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-29T17:04:46.562502] [DEBUG] [LOCAL ] AES: Primary data saved (53670 records). [2025-09-29T17:04:46.562714] [INFO ] [MAIN ] AES: Full history saved. [2025-09-29T17:04:46.562873] [INFO ] [MAIN ] Update Progress: 45/2371 symbols completed. AES took 37.6s. Estimated remaining: 4h 4m 21s. Rate: 9.5 symbols/min [2025-09-29T17:04:46.754721] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:04:46.752448] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-09-29T17:04:46.760875] [DEBUG] [LOCAL ] AFGE: Loaded 2512 existing records from primary storage. [2025-09-29T17:04:46.761112] [INFO ] [MAIN ] AFGE: Loaded 2512 existing records. [2025-09-29T17:04:46.950156] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:04:46.950412] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-09-29T17:04:46.950471] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-09-29T17:04:46.950699] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-09-29T17:04:46.950759] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-09-29T17:04:47.251779] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-29T17:04:47.342727] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:04:47.548137] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-09-29T17:04:48.348119] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2024-12. [2025-09-29T17:04:48.863854] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-29T17:04:49.148085] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2024-12. [2025-09-29T17:04:49.407262] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-29T17:04:49.418138] [INFO ] [REMOTE ] AESI: Full fetch complete (70359 records). [2025-09-29T17:04:49.418335] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-09-29T17:04:49.839525] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-09-29T17:04:49.839799] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-09-29T17:04:49.840577] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-09-29T17:04:49.840753] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-09-29T17:04:49.845792] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-29T17:04:49.850337] [DEBUG] [LOCAL ] AESI: Trimmed 70359 records to 49449 (keeping 200 days of data) [2025-09-29T17:04:49.948232] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-09-29T17:04:50.176156] [DEBUG] [LOCAL ] AESI: Primary data saved (49449 records). [2025-09-29T17:04:50.176304] [INFO ] [MAIN ] AESI: Full history saved. [2025-09-29T17:04:50.176396] [INFO ] [MAIN ] Update Progress: 46/2371 symbols completed. AESI took 41.2s. Estimated remaining: 4h 1m 59s. Rate: 9.6 symbols/min [2025-09-29T17:04:50.352498] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:04:50.419397] [DEBUG] [LOCAL ] AFL: Loaded 53915 existing records from primary storage. [2025-09-29T17:04:50.419821] [INFO ] [MAIN ] AFL: Loaded 53915 existing records. [2025-09-29T17:04:50.619351] [WARN ] [MAIN ] AFL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:04:50.619570] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-09-29T17:04:50.619624] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-09-29T17:04:50.620231] [DEBUG] [LOCAL ] AFL: Deleted primary data file. [2025-09-29T17:04:50.620297] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-09-29T17:04:50.700485] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-29T17:04:50.753214] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-09-29T17:04:51.024335] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:04:51.311014] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-29T17:04:51.548121] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-09-29T17:04:52.025034] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-29T17:04:52.348127] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-09-29T17:04:52.777219] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-29T17:04:53.148120] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-09-29T17:04:53.602445] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-29T17:04:53.948119] [INFO ] [REMOTE ] AFL: Fetching primary data for 2024-12. [2025-09-29T17:04:54.748128] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-09-29T17:04:55.223203] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-29T17:04:55.548155] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-09-29T17:04:55.865102] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-29T17:04:56.004305] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-29T17:04:56.348110] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-09-29T17:04:56.795608] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-29T17:04:57.148117] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-09-29T17:04:57.601480] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-29T17:04:57.948111] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-09-29T17:04:58.748147] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-09-29T17:04:59.248460] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-29T17:04:59.548087] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-09-29T17:04:59.669800] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-29T17:05:00.188901] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-29T17:05:00.348107] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-09-29T17:05:00.897350] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-29T17:05:01.148115] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-09-29T17:05:01.948116] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-09-29T17:05:02.636770] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-29T17:05:02.748105] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-09-29T17:05:02.927888] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-29T17:05:03.199576] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-29T17:05:03.548130] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-09-29T17:05:03.992264] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-29T17:05:04.348132] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-09-29T17:05:04.831089] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-29T17:05:05.148144] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-09-29T17:05:05.948179] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-09-29T17:05:06.494510] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-29T17:05:06.748152] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-09-29T17:05:07.213999] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-29T17:05:07.299688] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-29T17:05:07.300830] [INFO ] [REMOTE ] AFGD: Full fetch complete (3159 records). [2025-09-29T17:05:07.300906] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-09-29T17:05:07.553244] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-09-29T17:05:07.693608] [DEBUG] [VALIDATOR ] AFGD: All expected trading days are present. [2025-09-29T17:05:07.693728] [DEBUG] [VALIDATOR ] AFGD: Primary data validation passed. [2025-09-29T17:05:07.693865] [INFO ] [MAIN ] AFGD: Fetched primary data is valid. [2025-09-29T17:05:07.693939] [DEBUG] [LOCAL ] AFGD: Saving primary data. [2025-09-29T17:05:07.694444] [DEBUG] [LOCAL ] AFGD: Trimmed 3159 records to 1812 (keeping 200 days of data) [2025-09-29T17:05:07.707020] [DEBUG] [LOCAL ] AFGD: Primary data saved (1812 records). [2025-09-29T17:05:07.707207] [INFO ] [MAIN ] AFGD: Full history saved. [2025-09-29T17:05:07.707332] [INFO ] [MAIN ] Update Progress: 47/2371 symbols completed. AFGD took 23.2s. Estimated remaining: 4h 11m 11s. Rate: 9.3 symbols/min [2025-09-29T17:05:07.898815] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:05:07.961292] [DEBUG] [LOCAL ] AG: Loaded 54423 existing records from primary storage. [2025-09-29T17:05:07.961700] [INFO ] [MAIN ] AG: Loaded 54423 existing records. [2025-09-29T17:05:08.154097] [WARN ] [MAIN ] AG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:05:08.154330] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-09-29T17:05:08.154379] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-09-29T17:05:08.154929] [DEBUG] [LOCAL ] AG: Deleted primary data file. [2025-09-29T17:05:08.154992] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-09-29T17:05:08.268322] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-29T17:05:08.353276] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-09-29T17:05:08.558630] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:05:09.057521] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-29T17:05:09.148124] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-09-29T17:05:09.948119] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-09-29T17:05:10.571854] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-29T17:05:10.748117] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-09-29T17:05:11.084972] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-29T17:05:11.537397] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-29T17:05:11.548058] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-09-29T17:05:12.321705] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-29T17:05:12.322995] [INFO ] [REMOTE ] AFGC: Full fetch complete (3731 records). [2025-09-29T17:05:12.323073] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-09-29T17:05:12.355461] [INFO ] [REMOTE ] AG: Fetching primary data for 2024-12. [2025-09-29T17:05:12.712254] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present. [2025-09-29T17:05:12.712342] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed. [2025-09-29T17:05:12.712475] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-09-29T17:05:12.712513] [DEBUG] [LOCAL ] AFGC: Saving primary data. [2025-09-29T17:05:12.712889] [DEBUG] [LOCAL ] AFGC: Trimmed 3731 records to 2542 (keeping 200 days of data) [2025-09-29T17:05:12.729011] [DEBUG] [LOCAL ] AFGC: Primary data saved (2542 records). [2025-09-29T17:05:12.729088] [INFO ] [MAIN ] AFGC: Full history saved. [2025-09-29T17:05:12.729157] [INFO ] [MAIN ] Update Progress: 48/2371 symbols completed. AFGC took 29.2s. Estimated remaining: 4h 9m 53s. Rate: 9.3 symbols/min [2025-09-29T17:05:12.903809] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:05:12.974867] [DEBUG] [LOCAL ] AGCO: Loaded 43086 existing records from primary storage. [2025-09-29T17:05:12.975234] [INFO ] [MAIN ] AGCO: Loaded 43086 existing records. [2025-09-29T17:05:13.162232] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-09-29T17:05:13.168356] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:05:13.170020] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-09-29T17:05:13.170097] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-09-29T17:05:13.170601] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-09-29T17:05:13.170785] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-09-29T17:05:13.545807] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:05:13.948208] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2024-12. [2025-09-29T17:05:14.432000] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-29T17:05:14.748097] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-09-29T17:05:14.940839] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-29T17:05:15.233582] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-29T17:05:15.422023] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-29T17:05:15.423242] [INFO ] [REMOTE ] AFGE: Full fetch complete (3469 records). [2025-09-29T17:05:15.423337] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-09-29T17:05:15.553216] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-09-29T17:05:15.851681] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-09-29T17:05:15.851774] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-09-29T17:05:15.851936] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-09-29T17:05:15.852002] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-09-29T17:05:15.852380] [DEBUG] [LOCAL ] AFGE: Trimmed 3469 records to 2470 (keeping 200 days of data) [2025-09-29T17:05:15.868597] [DEBUG] [LOCAL ] AFGE: Primary data saved (2470 records). [2025-09-29T17:05:15.868771] [INFO ] [MAIN ] AFGE: Full history saved. [2025-09-29T17:05:15.868885] [INFO ] [MAIN ] Update Progress: 49/2371 symbols completed. AFGE took 29.3s. Estimated remaining: 4h 7m 10s. Rate: 9.4 symbols/min [2025-09-29T17:05:16.066428] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:05:16.089995] [DEBUG] [LOCAL ] AGD: Loaded 17937 existing records from primary storage. [2025-09-29T17:05:16.090259] [INFO ] [MAIN ] AGD: Loaded 17937 existing records. [2025-09-29T17:05:16.287457] [WARN ] [MAIN ] AGD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:05:16.287755] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-09-29T17:05:16.287810] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-09-29T17:05:16.288108] [DEBUG] [LOCAL ] AGD: Deleted primary data file. [2025-09-29T17:05:16.288168] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-09-29T17:05:16.361482] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-09-29T17:05:16.675397] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:05:17.148126] [INFO ] [REMOTE ] AGD: Fetching primary data for 2024-12. [2025-09-29T17:05:17.593451] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-29T17:05:17.948172] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-09-29T17:05:18.062519] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-29T17:05:18.192118] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-29T17:05:18.748169] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-09-29T17:05:19.548191] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-09-29T17:05:19.770013] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-29T17:05:20.329533] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-29T17:05:20.348077] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-09-29T17:05:21.148123] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-09-29T17:05:21.246726] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-29T17:05:21.948092] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-09-29T17:05:21.984494] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-29T17:05:22.235679] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-29T17:05:22.748166] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-09-29T17:05:23.548120] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-09-29T17:05:23.645856] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-29T17:05:24.214626] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-09-29T17:05:24.348177] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-09-29T17:05:25.148179] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-09-29T17:05:25.416962] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-29T17:05:25.948138] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-09-29T17:05:26.167396] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-29T17:05:26.748171] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-09-29T17:05:26.785199] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-29T17:05:27.298264] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-29T17:05:27.548134] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-09-29T17:05:28.348132] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-09-29T17:05:28.410665] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-29T17:05:29.148196] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-09-29T17:05:29.613694] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-29T17:05:29.693071] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-29T17:05:29.948136] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-09-29T17:05:30.748143] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-09-29T17:05:31.096294] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-29T17:05:31.106930] [INFO ] [REMOTE ] AFL: Full fetch complete (76529 records). [2025-09-29T17:05:31.107122] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-09-29T17:05:31.108026] [FATAL] [VALIDATOR ] AFL: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:05:31.108124] [FATAL] [MAIN ] AFL: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:05:31.108169] [WARN ] [MAIN ] AFL: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:05:31.108219] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-09-29T17:05:31.108318] [DEBUG] [LOCAL ] AFL: No primary data file found to delete. [2025-09-29T17:05:31.108369] [INFO ] [LOCAL ] AFL: Starting deletion of derivative data. [2025-09-29T17:05:31.109177] [DEBUG] [LOCAL ] AFL: Deleted derivative data file. [2025-09-29T17:05:31.109287] [INFO ] [MAIN ] Update Progress: 50/2371 symbols completed. AFL took 40.9s. Estimated remaining: 4h 13m 54s. Rate: 9.1 symbols/min [2025-09-29T17:05:31.289879] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:05:31.354973] [DEBUG] [LOCAL ] AGI: Loaded 54195 existing records from primary storage. [2025-09-29T17:05:31.355362] [INFO ] [MAIN ] AGI: Loaded 54195 existing records. [2025-09-29T17:05:31.549350] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:05:31.549441] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-09-29T17:05:31.549914] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-09-29T17:05:31.551099] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-09-29T17:05:31.551731] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-09-29T17:05:31.551796] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-09-29T17:05:31.956974] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:05:31.992243] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-29T17:05:32.027478] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-29T17:05:32.348143] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-09-29T17:05:32.783583] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-29T17:05:33.148165] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-09-29T17:05:33.948146] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-09-29T17:05:34.720442] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-09-29T17:05:34.748073] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-09-29T17:05:34.851799] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-29T17:05:34.927956] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-29T17:05:35.548129] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-09-29T17:05:36.348141] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-09-29T17:05:36.819969] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-29T17:05:37.153208] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-09-29T17:05:37.166770] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-29T17:05:37.364514] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-29T17:05:37.948125] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-09-29T17:05:38.748161] [INFO ] [REMOTE ] AGI: Fetching primary data for 2024-12. [2025-09-29T17:05:39.548085] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-09-29T17:05:39.651419] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-29T17:05:39.661453] [INFO ] [REMOTE ] AGCO: Full fetch complete (61940 records). [2025-09-29T17:05:39.661591] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-09-29T17:05:40.082570] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (2.93 seconds). [2025-09-29T17:05:40.115686] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-09-29T17:05:40.115797] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-09-29T17:05:40.116530] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-09-29T17:05:40.116835] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-09-29T17:05:40.116742] [INFO ] [REMOTE ] AG: Full fetch complete (77204 records). [2025-09-29T17:05:40.120761] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-09-29T17:05:40.122146] [FATAL] [VALIDATOR ] AG: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:05:40.122302] [FATAL] [MAIN ] AG: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:05:40.122512] [WARN ] [MAIN ] AG: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:05:40.122836] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-09-29T17:05:40.123014] [DEBUG] [LOCAL ] AGCO: Trimmed 61940 records to 42413 (keeping 200 days of data) [2025-09-29T17:05:40.123140] [DEBUG] [LOCAL ] AG: No primary data file found to delete. [2025-09-29T17:05:40.123771] [INFO ] [LOCAL ] AG: Starting deletion of derivative data. [2025-09-29T17:05:40.125024] [DEBUG] [LOCAL ] AG: Deleted derivative data file. [2025-09-29T17:05:40.125268] [INFO ] [MAIN ] Update Progress: 51/2371 symbols completed. AG took 32.4s. Estimated remaining: 4h 15m 39s. Rate: 9.1 symbols/min [2025-09-29T17:05:40.461770] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:05:40.482026] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-29T17:05:40.489200] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-09-29T17:05:40.672529] [DEBUG] [LOCAL ] AGL: Loaded 53191 existing records from primary storage. [2025-09-29T17:05:40.674584] [INFO ] [MAIN ] AGL: Loaded 53191 existing records. [2025-09-29T17:05:40.892830] [WARN ] [MAIN ] AGL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:05:40.894266] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-09-29T17:05:40.894375] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-09-29T17:05:40.895618] [DEBUG] [LOCAL ] AGL: Deleted primary data file. [2025-09-29T17:05:40.895790] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-09-29T17:05:41.017815] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-09-29T17:05:41.170994] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-09-29T17:05:41.362333] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:05:41.379170] [DEBUG] [LOCAL ] AGCO: Primary data saved (42413 records). [2025-09-29T17:05:41.379304] [INFO ] [MAIN ] AGCO: Full history saved. [2025-09-29T17:05:41.380226] [INFO ] [MAIN ] Update Progress: 52/2371 symbols completed. AGCO took 28.7s. Estimated remaining: 4h 11m 34s. Rate: 9.2 symbols/min [2025-09-29T17:05:41.569005] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:05:41.582883] [DEBUG] [LOCAL ] AGM: Loaded 10125 existing records from primary storage. [2025-09-29T17:05:41.583109] [INFO ] [MAIN ] AGM: Loaded 10125 existing records. [2025-09-29T17:05:41.708493] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-29T17:05:41.792563] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:05:41.792826] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-09-29T17:05:41.792883] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-09-29T17:05:41.793121] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-09-29T17:05:41.793191] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-09-29T17:05:41.952728] [INFO ] [REMOTE ] AGL: Fetching primary data for 2024-12. [2025-09-29T17:05:42.189280] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:05:42.748108] [INFO ] [REMOTE ] AGM: Fetching primary data for 2024-12. [2025-09-29T17:05:42.958590] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-29T17:05:43.548153] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-09-29T17:05:43.651812] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-29T17:05:44.101964] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-29T17:05:44.348131] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-09-29T17:05:45.074780] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-29T17:05:45.148085] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-09-29T17:05:45.340979] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-29T17:05:45.948130] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-09-29T17:05:46.457674] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-29T17:05:46.462824] [INFO ] [REMOTE ] AGD: Full fetch complete (25496 records). [2025-09-29T17:05:46.462967] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-09-29T17:05:46.753317] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-09-29T17:05:46.804105] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-29T17:05:46.907755] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-09-29T17:05:46.907847] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-09-29T17:05:46.908211] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-09-29T17:05:46.908257] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-09-29T17:05:46.909123] [DEBUG] [LOCAL ] AGD: Trimmed 25496 records to 17846 (keeping 200 days of data) [2025-09-29T17:05:47.024755] [DEBUG] [LOCAL ] AGD: Primary data saved (17846 records). [2025-09-29T17:05:47.024912] [INFO ] [MAIN ] AGD: Full history saved. [2025-09-29T17:05:47.025007] [INFO ] [MAIN ] Update Progress: 53/2371 symbols completed. AGD took 31.2s. Estimated remaining: 4h 10m 50s. Rate: 9.2 symbols/min [2025-09-29T17:05:47.211032] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:05:47.242971] [DEBUG] [LOCAL ] AGO: Loaded 28356 existing records from primary storage. [2025-09-29T17:05:47.243253] [INFO ] [MAIN ] AGO: Loaded 28356 existing records. [2025-09-29T17:05:47.444337] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:05:47.444878] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-09-29T17:05:47.444950] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-09-29T17:05:47.445531] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-09-29T17:05:47.445593] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-09-29T17:05:47.551786] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-09-29T17:05:47.828366] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:05:48.348110] [INFO ] [REMOTE ] AGO: Fetching primary data for 2024-12. [2025-09-29T17:05:48.828134] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-29T17:05:49.148142] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-09-29T17:05:49.347697] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-29T17:05:49.860005] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-29T17:05:49.948114] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-09-29T17:05:50.748154] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-09-29T17:05:51.548181] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-09-29T17:05:51.585699] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-29T17:05:51.638133] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-29T17:05:52.348130] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-09-29T17:05:52.839387] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2024-12 (4.49 seconds). [2025-09-29T17:05:52.894610] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-29T17:05:53.148162] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-09-29T17:05:53.683619] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-29T17:05:53.888858] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-29T17:05:53.948118] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-09-29T17:05:54.748131] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-09-29T17:05:55.238165] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-29T17:05:55.385226] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-29T17:05:55.548118] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-09-29T17:05:56.348127] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-09-29T17:05:57.148100] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-09-29T17:05:57.258527] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-29T17:05:57.948087] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-09-29T17:05:58.018736] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-29T17:05:58.358505] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-29T17:05:58.701785] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-29T17:05:58.748124] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-09-29T17:05:59.548126] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-09-29T17:06:00.106142] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-29T17:06:00.348084] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-09-29T17:06:00.574998] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-29T17:06:00.577823] [INFO ] [REMOTE ] AGM: Full fetch complete (12655 records). [2025-09-29T17:06:00.577906] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-09-29T17:06:01.043695] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-09-29T17:06:01.043790] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-09-29T17:06:01.044041] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-09-29T17:06:01.044108] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-09-29T17:06:01.044734] [DEBUG] [LOCAL ] AGM: Trimmed 12655 records to 10075 (keeping 200 days of data) [2025-09-29T17:06:01.120366] [DEBUG] [LOCAL ] AGM: Primary data saved (10075 records). [2025-09-29T17:06:01.120530] [INFO ] [MAIN ] AGM: Full history saved. [2025-09-29T17:06:01.120633] [INFO ] [MAIN ] Update Progress: 54/2371 symbols completed. AGM took 19.7s. Estimated remaining: 4h 16m 9s. Rate: 9.0 symbols/min [2025-09-29T17:06:01.158839] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-09-29T17:06:01.308902] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:06:01.356957] [DEBUG] [LOCAL ] AGRO: Loaded 34097 existing records from primary storage. [2025-09-29T17:06:01.357320] [INFO ] [MAIN ] AGRO: Loaded 34097 existing records. [2025-09-29T17:06:01.565144] [WARN ] [MAIN ] AGRO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:06:01.565594] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-09-29T17:06:01.565693] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-09-29T17:06:01.566320] [DEBUG] [LOCAL ] AGRO: Deleted primary data file. [2025-09-29T17:06:01.566389] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-09-29T17:06:01.942113] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:06:01.948071] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2024-12. [2025-09-29T17:06:02.364334] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-29T17:06:02.748107] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-09-29T17:06:03.040728] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-29T17:06:03.377680] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-29T17:06:03.548102] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-09-29T17:06:04.348100] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-09-29T17:06:04.904965] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-29T17:06:04.941387] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-29T17:06:05.148121] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-09-29T17:06:05.917881] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-29T17:06:05.948094] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-09-29T17:06:06.748098] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-09-29T17:06:07.021624] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-29T17:06:07.083281] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-29T17:06:07.548113] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-09-29T17:06:08.348127] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-09-29T17:06:08.613961] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-29T17:06:09.070035] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-29T17:06:09.148118] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-09-29T17:06:09.631472] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-29T17:06:09.948116] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-09-29T17:06:10.668913] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-29T17:06:10.748109] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-09-29T17:06:11.548106] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-09-29T17:06:12.029082] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-29T17:06:12.040351] [INFO ] [REMOTE ] AGI: Full fetch complete (76773 records). [2025-09-29T17:06:12.040529] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-09-29T17:06:12.357144] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-29T17:06:12.355710] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-09-29T17:06:12.518709] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-09-29T17:06:12.518824] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-09-29T17:06:12.519578] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-09-29T17:06:12.519623] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-09-29T17:06:12.521534] [DEBUG] [LOCAL ] AGI: Trimmed 76773 records to 53415 (keeping 200 days of data) [2025-09-29T17:06:12.808244] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-29T17:06:12.902666] [DEBUG] [LOCAL ] AGI: Primary data saved (53415 records). [2025-09-29T17:06:12.902823] [INFO ] [MAIN ] AGI: Full history saved. [2025-09-29T17:06:12.902924] [INFO ] [MAIN ] Update Progress: 55/2371 symbols completed. AGI took 41.8s. Estimated remaining: 4h 19m 40s. Rate: 8.9 symbols/min [2025-09-29T17:06:13.085396] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:06:13.125526] [DEBUG] [LOCAL ] AGX: Loaded 33823 existing records from primary storage. [2025-09-29T17:06:13.125837] [INFO ] [MAIN ] AGX: Loaded 33823 existing records. [2025-09-29T17:06:13.156735] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-09-29T17:06:13.313237] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:06:13.313446] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-09-29T17:06:13.313495] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-09-29T17:06:13.314109] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-09-29T17:06:13.314174] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-09-29T17:06:13.706639] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:06:13.793120] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-29T17:06:13.948131] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-09-29T17:06:14.626930] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-29T17:06:14.748140] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-09-29T17:06:15.344945] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-29T17:06:15.548178] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-09-29T17:06:15.898681] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-29T17:06:16.348206] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-09-29T17:06:16.802606] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-29T17:06:17.148165] [INFO ] [REMOTE ] AGX: Fetching primary data for 2024-12. [2025-09-29T17:06:17.948119] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-09-29T17:06:18.070691] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-29T17:06:18.251986] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-29T17:06:18.748130] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-09-29T17:06:19.265950] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-29T17:06:19.548115] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-09-29T17:06:20.348090] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-09-29T17:06:20.443186] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-29T17:06:20.854493] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-29T17:06:21.148118] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-09-29T17:06:21.656063] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-29T17:06:21.661867] [INFO ] [REMOTE ] AGO: Full fetch complete (39343 records). [2025-09-29T17:06:21.662041] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-09-29T17:06:21.953233] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-09-29T17:06:22.074682] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-09-29T17:06:22.074790] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-09-29T17:06:22.075292] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-09-29T17:06:22.075367] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-09-29T17:06:22.076536] [DEBUG] [LOCAL ] AGO: Trimmed 39343 records to 27898 (keeping 200 days of data) [2025-09-29T17:06:22.261491] [DEBUG] [LOCAL ] AGO: Primary data saved (27898 records). [2025-09-29T17:06:22.261633] [INFO ] [MAIN ] AGO: Full history saved. [2025-09-29T17:06:22.261764] [INFO ] [MAIN ] Update Progress: 56/2371 symbols completed. AGO took 35.2s. Estimated remaining: 4h 21m 22s. Rate: 8.9 symbols/min [2025-09-29T17:06:22.444300] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:06:22.493136] [DEBUG] [LOCAL ] AHH: Loaded 41885 existing records from primary storage. [2025-09-29T17:06:22.493520] [INFO ] [MAIN ] AHH: Loaded 41885 existing records. [2025-09-29T17:06:22.707620] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:06:22.708026] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-09-29T17:06:22.708173] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-09-29T17:06:22.716356] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-09-29T17:06:22.728852] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-09-29T17:06:22.771006] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-29T17:06:22.768435] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-09-29T17:06:23.158555] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:06:23.548115] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-09-29T17:06:23.961354] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-29T17:06:23.973249] [INFO ] [REMOTE ] AGL: Full fetch complete (75489 records). [2025-09-29T17:06:23.973446] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-09-29T17:06:24.352432] [INFO ] [REMOTE ] AHH: Fetching primary data for 2024-12. [2025-09-29T17:06:24.406463] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-09-29T17:06:24.406677] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-09-29T17:06:24.407505] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-09-29T17:06:24.407594] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-09-29T17:06:24.427952] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-29T17:06:24.434766] [DEBUG] [LOCAL ] AGL: Trimmed 75489 records to 52425 (keeping 200 days of data) [2025-09-29T17:06:24.435820] [INFO ] [REMOTE ] AGRO: Full fetch complete (49879 records). [2025-09-29T17:06:24.436230] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-09-29T17:06:25.004419] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-09-29T17:06:25.005021] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-09-29T17:06:25.006116] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-09-29T17:06:25.006571] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-09-29T17:06:25.013989] [DEBUG] [LOCAL ] AGRO: Trimmed 49879 records to 33601 (keeping 200 days of data) [2025-09-29T17:06:25.142570] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-29T17:06:25.256727] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-09-29T17:06:25.404498] [DEBUG] [LOCAL ] AGRO: Primary data saved (33601 records). [2025-09-29T17:06:25.405426] [INFO ] [MAIN ] AGRO: Full history saved. [2025-09-29T17:06:25.408207] [INFO ] [MAIN ] Update Progress: 57/2371 symbols completed. AGRO took 24.3s. Estimated remaining: 4h 18m 48s. Rate: 8.9 symbols/min [2025-09-29T17:06:25.653748] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:06:25.657112] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-09-29T17:06:25.657924] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-09-29T17:06:25.658060] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-09-29T17:06:25.658106] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-29T17:06:25.658150] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-29T17:06:25.658446] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-09-29T17:06:25.955167] [DEBUG] [LOCAL ] AGL: Primary data saved (52425 records). [2025-09-29T17:06:25.977223] [INFO ] [MAIN ] AGL: Full history saved. [2025-09-29T17:06:25.977882] [INFO ] [MAIN ] Update Progress: 58/2371 symbols completed. AGL took 45.9s. Estimated remaining: 4h 14m 36s. Rate: 9.1 symbols/min [2025-09-29T17:06:26.185902] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:06:26.207003] [INFO ] [REMOTE ] AHL: Fetching primary data for 2024-12. [2025-09-29T17:06:26.263454] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:06:26.293023] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-29T17:06:26.352452] [DEBUG] [LOCAL ] AHR: Loaded 49946 existing records from primary storage. [2025-09-29T17:06:26.352802] [INFO ] [MAIN ] AHR: Loaded 49946 existing records. [2025-09-29T17:06:26.455454] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T17:06:26.475814] [WARN ] [REMOTE ] AHL: No data returned for month 2024-12 [2025-09-29T17:06:26.501702] [FATAL] [REMOTE ] AHL: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T17:06:26.507344] [FATAL] [MAIN ] AHL: Failed to fetch primary data. [2025-09-29T17:06:26.546601] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:06:26.546719] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T17:06:26.547479] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-09-29T17:06:26.547393] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-29T17:06:26.547605] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-09-29T17:06:26.548092] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-29T17:06:26.548252] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-09-29T17:06:26.548456] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-09-29T17:06:26.548750] [INFO ] [MAIN ] Update Progress: 59/2371 symbols completed. AHL took 1.1s. Estimated remaining: 4h 10m 33s. Rate: 9.2 symbols/min [2025-09-29T17:06:26.549031] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-09-29T17:06:26.561517] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-09-29T17:06:26.750296] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-09-29T17:06:27.008200] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:06:27.033975] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-29T17:06:27.181396] [DEBUG] [LOCAL ] AHT: Loaded 6181 existing records from primary storage. [2025-09-29T17:06:27.193841] [INFO ] [MAIN ] AHT: Loaded 6181 existing records. [2025-09-29T17:06:27.215465] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:06:27.412442] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:06:27.412710] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-09-29T17:06:27.412772] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-09-29T17:06:27.413028] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-09-29T17:06:27.413088] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-09-29T17:06:27.561403] [INFO ] [REMOTE ] AHR: Fetching primary data for 2024-12. [2025-09-29T17:06:27.796575] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:06:28.348127] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-09-29T17:06:28.491113] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-29T17:06:29.148131] [INFO ] [REMOTE ] AHT: Fetching primary data for 2024-12. [2025-09-29T17:06:29.392760] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-29T17:06:29.908782] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-29T17:06:29.948104] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-09-29T17:06:30.150111] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-29T17:06:30.748132] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-09-29T17:06:31.327669] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-29T17:06:31.548220] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-09-29T17:06:32.295828] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-29T17:06:32.348130] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-09-29T17:06:33.036016] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-29T17:06:33.148103] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-09-29T17:06:33.840123] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-29T17:06:33.948136] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-09-29T17:06:34.530136] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-29T17:06:34.748152] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-09-29T17:06:35.423328] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-29T17:06:35.470400] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-29T17:06:35.548100] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-09-29T17:06:36.348128] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-09-29T17:06:37.076826] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-29T17:06:37.148116] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-09-29T17:06:37.318058] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-29T17:06:37.948155] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-09-29T17:06:38.391525] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-29T17:06:38.398667] [INFO ] [REMOTE ] AGX: Full fetch complete (48784 records). [2025-09-29T17:06:38.398814] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-09-29T17:06:38.720049] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-29T17:06:38.753310] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-09-29T17:06:38.827749] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-09-29T17:06:38.827969] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-09-29T17:06:38.828521] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-09-29T17:06:38.828569] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-09-29T17:06:38.829830] [DEBUG] [LOCAL ] AGX: Trimmed 48784 records to 33224 (keeping 200 days of data) [2025-09-29T17:06:39.047982] [DEBUG] [LOCAL ] AGX: Primary data saved (33224 records). [2025-09-29T17:06:39.048133] [INFO ] [MAIN ] AGX: Full history saved. [2025-09-29T17:06:39.048220] [INFO ] [MAIN ] Update Progress: 60/2371 symbols completed. AGX took 26.1s. Estimated remaining: 4h 14m 17s. Rate: 9.1 symbols/min [2025-09-29T17:06:39.236568] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:06:39.303820] [DEBUG] [LOCAL ] AI: Loaded 54529 existing records from primary storage. [2025-09-29T17:06:39.304218] [INFO ] [MAIN ] AI: Loaded 54529 existing records. [2025-09-29T17:06:39.490255] [WARN ] [MAIN ] AI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:06:39.490509] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-09-29T17:06:39.490558] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-09-29T17:06:39.491262] [DEBUG] [LOCAL ] AI: Deleted primary data file. [2025-09-29T17:06:39.491328] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-09-29T17:06:39.552707] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-09-29T17:06:39.861584] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:06:40.333631] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-29T17:06:40.348076] [INFO ] [REMOTE ] AI: Fetching primary data for 2024-12. [2025-09-29T17:06:40.634620] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-29T17:06:41.148149] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-09-29T17:06:41.948126] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-09-29T17:06:42.551048] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-29T17:06:42.740063] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-29T17:06:42.750787] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-09-29T17:06:43.003142] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2024-12 (2.66 seconds). [2025-09-29T17:06:43.547474] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-29T17:06:43.549971] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-09-29T17:06:44.348119] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-09-29T17:06:44.956824] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-29T17:06:45.148083] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-09-29T17:06:45.263608] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-29T17:06:45.871056] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-29T17:06:45.948142] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-09-29T17:06:46.748126] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-09-29T17:06:47.361811] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-29T17:06:47.548161] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-09-29T17:06:47.670312] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-29T17:06:47.672711] [INFO ] [REMOTE ] AHT: Full fetch complete (9392 records). [2025-09-29T17:06:47.672863] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-09-29T17:06:48.070402] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-09-29T17:06:48.070482] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-09-29T17:06:48.070718] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-09-29T17:06:48.070783] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-09-29T17:06:48.071347] [DEBUG] [LOCAL ] AHT: Trimmed 9392 records to 6127 (keeping 200 days of data) [2025-09-29T17:06:48.110955] [DEBUG] [LOCAL ] AHT: Primary data saved (6127 records). [2025-09-29T17:06:48.111096] [INFO ] [MAIN ] AHT: Full history saved. [2025-09-29T17:06:48.111186] [INFO ] [MAIN ] Update Progress: 61/2371 symbols completed. AHT took 21.6s. Estimated remaining: 4h 15m 44s. Rate: 9.0 symbols/min [2025-09-29T17:06:48.313236] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:06:48.360044] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-09-29T17:06:48.387029] [DEBUG] [LOCAL ] AIG: Loaded 54254 existing records from primary storage. [2025-09-29T17:06:48.387565] [INFO ] [MAIN ] AIG: Loaded 54254 existing records. [2025-09-29T17:06:48.578747] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:06:48.579024] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-09-29T17:06:48.579074] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-09-29T17:06:48.580623] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-09-29T17:06:48.580724] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-09-29T17:06:48.959304] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:06:48.992023] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-29T17:06:49.148122] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-09-29T17:06:49.864017] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-29T17:06:49.948105] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-09-29T17:06:50.748099] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-09-29T17:06:50.921550] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-29T17:06:51.517250] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-29T17:06:51.548085] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-09-29T17:06:52.348164] [INFO ] [REMOTE ] AIG: Fetching primary data for 2024-12. [2025-09-29T17:06:52.788523] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-29T17:06:52.881886] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-29T17:06:53.148114] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-09-29T17:06:53.948110] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-09-29T17:06:54.222221] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-29T17:06:54.581757] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-29T17:06:54.748139] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-09-29T17:06:55.548162] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-09-29T17:06:55.675431] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-29T17:06:56.348172] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-09-29T17:06:56.546684] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-29T17:06:57.148135] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-09-29T17:06:57.328518] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-29T17:06:57.336332] [INFO ] [REMOTE ] AHH: Full fetch complete (60196 records). [2025-09-29T17:06:57.336502] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-09-29T17:06:57.747089] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-09-29T17:06:57.747341] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-09-29T17:06:57.748181] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-09-29T17:06:57.748328] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-09-29T17:06:57.750142] [DEBUG] [LOCAL ] AHH: Trimmed 60196 records to 41228 (keeping 200 days of data) [2025-09-29T17:06:57.906076] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-29T17:06:57.926685] [INFO ] [REMOTE ] AHR: Full fetch complete (70888 records). [2025-09-29T17:06:57.926891] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-09-29T17:06:57.978559] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-09-29T17:06:58.388686] [DEBUG] [LOCAL ] AHH: Primary data saved (41228 records). [2025-09-29T17:06:58.407526] [INFO ] [MAIN ] AHH: Full history saved. [2025-09-29T17:06:58.424361] [INFO ] [MAIN ] Update Progress: 62/2371 symbols completed. AHH took 36.2s. Estimated remaining: 4h 17m 54s. Rate: 9.0 symbols/min [2025-09-29T17:06:58.628630] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present. [2025-09-29T17:06:58.639826] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed. [2025-09-29T17:06:58.677095] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-09-29T17:06:58.683338] [DEBUG] [LOCAL ] AHR: Saving primary data. [2025-09-29T17:06:58.704411] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:06:58.705072] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-09-29T17:06:58.705159] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-09-29T17:06:58.705467] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-09-29T17:06:58.705739] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-29T17:06:58.706064] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-29T17:06:58.706219] [DEBUG] [LOCAL ] AHR: Trimmed 70888 records to 49171 (keeping 200 days of data) [2025-09-29T17:06:58.706353] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-09-29T17:06:59.321949] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:06:59.323849] [INFO ] [REMOTE ] AII: Fetching primary data for 2024-12. [2025-09-29T17:06:59.362184] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-09-29T17:06:59.452803] [DEBUG] [LOCAL ] AHR: Primary data saved (49171 records). [2025-09-29T17:06:59.452987] [INFO ] [MAIN ] AHR: Full history saved. [2025-09-29T17:06:59.453083] [INFO ] [MAIN ] Update Progress: 63/2371 symbols completed. AHR took 33.5s. Estimated remaining: 4h 14m 20s. Rate: 9.1 symbols/min [2025-09-29T17:06:59.566755] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T17:06:59.556426] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-09-29T17:06:59.567160] [WARN ] [REMOTE ] AII: No data returned for month 2024-12 [2025-09-29T17:06:59.571954] [FATAL] [REMOTE ] AII: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T17:06:59.578095] [FATAL] [MAIN ] AII: Failed to fetch primary data. [2025-09-29T17:06:59.593983] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T17:06:59.615380] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-29T17:06:59.632078] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-29T17:06:59.652100] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-09-29T17:06:59.653900] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:06:59.654155] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-09-29T17:06:59.654339] [INFO ] [MAIN ] Update Progress: 64/2371 symbols completed. AII took 1.2s. Estimated remaining: 4h 10m 22s. Rate: 9.2 symbols/min [2025-09-29T17:06:59.863588] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:06:59.864778] [DEBUG] [LOCAL ] AIN: Loaded 24906 existing records from primary storage. [2025-09-29T17:06:59.865258] [INFO ] [MAIN ] AIN: Loaded 24906 existing records. [2025-09-29T17:06:59.990931] [DEBUG] [LOCAL ] AIO: Loaded 13477 existing records from primary storage. [2025-09-29T17:07:00.001531] [INFO ] [MAIN ] AIO: Loaded 13477 existing records. [2025-09-29T17:07:00.186911] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:07:00.203164] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-09-29T17:07:00.213575] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-09-29T17:07:00.252808] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-09-29T17:07:00.272895] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-09-29T17:07:00.276993] [WARN ] [MAIN ] AIO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:07:00.324275] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-09-29T17:07:00.354745] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-09-29T17:07:00.388571] [DEBUG] [LOCAL ] AIO: Deleted primary data file. [2025-09-29T17:07:00.420765] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-09-29T17:07:00.857019] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:07:00.893039] [INFO ] [REMOTE ] AIN: Fetching primary data for 2024-12. [2025-09-29T17:07:01.052070] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (3.07 seconds). [2025-09-29T17:07:01.148533] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-09-29T17:07:01.182020] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:07:01.239517] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-29T17:07:01.948122] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-09-29T17:07:02.202944] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-29T17:07:02.748110] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-09-29T17:07:03.553225] [INFO ] [REMOTE ] AIO: Fetching primary data for 2024-12. [2025-09-29T17:07:03.573304] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-09-29T17:07:03.815714] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-29T17:07:04.053593] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-29T17:07:04.348079] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-09-29T17:07:04.415898] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-29T17:07:05.148132] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-09-29T17:07:05.343095] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-29T17:07:05.823325] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-29T17:07:05.948122] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-09-29T17:07:06.748118] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-09-29T17:07:07.042603] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-29T17:07:07.548081] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-09-29T17:07:07.707700] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-29T17:07:08.348111] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-09-29T17:07:09.148186] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-09-29T17:07:09.322117] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-29T17:07:09.512294] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-29T17:07:09.948117] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-09-29T17:07:10.241396] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-29T17:07:10.748145] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-09-29T17:07:11.548133] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-09-29T17:07:12.348087] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-09-29T17:07:12.471038] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-09-29T17:07:12.512256] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-29T17:07:12.808449] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-29T17:07:13.148164] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-09-29T17:07:13.174069] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-29T17:07:13.948126] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-09-29T17:07:14.720727] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-29T17:07:14.748124] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-09-29T17:07:14.858502] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-29T17:07:15.548143] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-09-29T17:07:16.348136] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-09-29T17:07:16.579947] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-29T17:07:17.148182] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-09-29T17:07:17.633364] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-29T17:07:17.878711] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-09-29T17:07:17.948114] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-09-29T17:07:18.750394] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-09-29T17:07:18.772864] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-29T17:07:18.784901] [INFO ] [REMOTE ] AIG: Full fetch complete (77376 records). [2025-09-29T17:07:18.785089] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-09-29T17:07:18.929573] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-29T17:07:19.228167] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-09-29T17:07:19.228275] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-09-29T17:07:19.229062] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-09-29T17:07:19.229129] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-09-29T17:07:19.230757] [DEBUG] [LOCAL ] AIG: Trimmed 77376 records to 53471 (keeping 200 days of data) [2025-09-29T17:07:19.549111] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-09-29T17:07:19.574903] [DEBUG] [LOCAL ] AIG: Primary data saved (53471 records). [2025-09-29T17:07:19.575038] [INFO ] [MAIN ] AIG: Full history saved. [2025-09-29T17:07:19.576371] [INFO ] [MAIN ] Update Progress: 65/2371 symbols completed. AIG took 31.5s. Estimated remaining: 4h 18m 11s. Rate: 8.9 symbols/min [2025-09-29T17:07:19.759961] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:07:19.792815] [DEBUG] [LOCAL ] AIR: Loaded 28152 existing records from primary storage. [2025-09-29T17:07:19.793105] [INFO ] [MAIN ] AIR: Loaded 28152 existing records. [2025-09-29T17:07:19.980695] [WARN ] [MAIN ] AIR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:07:19.981074] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-09-29T17:07:19.981144] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-09-29T17:07:19.996877] [DEBUG] [LOCAL ] AIR: Deleted primary data file. [2025-09-29T17:07:19.997498] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-09-29T17:07:19.998206] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-29T17:07:20.386480] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:07:20.354343] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-09-29T17:07:20.397498] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-29T17:07:21.148145] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-09-29T17:07:21.948117] [INFO ] [REMOTE ] AIR: Fetching primary data for 2024-12. [2025-09-29T17:07:22.143395] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-29T17:07:22.735265] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-09-29T17:07:22.748073] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-09-29T17:07:22.857425] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-29T17:07:23.345493] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-29T17:07:23.348604] [INFO ] [REMOTE ] AIO: Full fetch complete (20094 records). [2025-09-29T17:07:23.348710] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-09-29T17:07:23.553200] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-09-29T17:07:23.754954] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-09-29T17:07:23.755051] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-09-29T17:07:23.755347] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-09-29T17:07:23.755410] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-09-29T17:07:23.756686] [DEBUG] [LOCAL ] AIO: Trimmed 20094 records to 13223 (keeping 200 days of data) [2025-09-29T17:07:23.843294] [DEBUG] [LOCAL ] AIO: Primary data saved (13223 records). [2025-09-29T17:07:23.843444] [INFO ] [MAIN ] AIO: Full history saved. [2025-09-29T17:07:23.843531] [INFO ] [MAIN ] Update Progress: 66/2371 symbols completed. AIO took 24.2s. Estimated remaining: 4h 16m 39s. Rate: 9.0 symbols/min [2025-09-29T17:07:24.036614] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:07:24.068928] [DEBUG] [LOCAL ] AIT: Loaded 28208 existing records from primary storage. [2025-09-29T17:07:24.069205] [INFO ] [MAIN ] AIT: Loaded 28208 existing records. [2025-09-29T17:07:24.262533] [WARN ] [MAIN ] AIT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:07:24.262831] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-09-29T17:07:24.262907] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-09-29T17:07:24.263483] [DEBUG] [LOCAL ] AIT: Deleted primary data file. [2025-09-29T17:07:24.263552] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-09-29T17:07:24.357700] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-09-29T17:07:24.678897] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:07:24.881355] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-29T17:07:25.148128] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-09-29T17:07:25.656716] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-29T17:07:25.948145] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-09-29T17:07:26.748142] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-09-29T17:07:27.047329] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-29T17:07:27.548138] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-09-29T17:07:27.593700] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-09-29T17:07:28.031981] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-29T17:07:28.037198] [INFO ] [REMOTE ] AIN: Full fetch complete (33329 records). [2025-09-29T17:07:28.037309] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-09-29T17:07:28.348122] [INFO ] [REMOTE ] AIT: Fetching primary data for 2024-12. [2025-09-29T17:07:28.455239] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-09-29T17:07:28.455335] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-09-29T17:07:28.455790] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-09-29T17:07:28.455868] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-09-29T17:07:28.456718] [DEBUG] [LOCAL ] AIN: Trimmed 33329 records to 24535 (keeping 200 days of data) [2025-09-29T17:07:28.613627] [DEBUG] [LOCAL ] AIN: Primary data saved (24535 records). [2025-09-29T17:07:28.613845] [INFO ] [MAIN ] AIN: Full history saved. [2025-09-29T17:07:28.613988] [INFO ] [MAIN ] Update Progress: 67/2371 symbols completed. AIN took 29.2s. Estimated remaining: 4h 15m 26s. Rate: 9.0 symbols/min [2025-09-29T17:07:28.802423] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:07:28.845144] [DEBUG] [LOCAL ] AIV: Loaded 40950 existing records from primary storage. [2025-09-29T17:07:28.845474] [INFO ] [MAIN ] AIV: Loaded 40950 existing records. [2025-09-29T17:07:28.972628] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-29T17:07:29.062107] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:07:29.062320] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-09-29T17:07:29.062369] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-09-29T17:07:29.062791] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-09-29T17:07:29.062850] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-09-29T17:07:29.153249] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-09-29T17:07:29.445866] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:07:29.729811] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-29T17:07:29.948139] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-09-29T17:07:30.748123] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-09-29T17:07:31.212542] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-29T17:07:31.548094] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-09-29T17:07:31.752527] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.60 seconds). [2025-09-29T17:07:31.783312] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-29T17:07:32.348119] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-09-29T17:07:32.742301] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-29T17:07:33.148131] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-09-29T17:07:33.948178] [INFO ] [REMOTE ] AIV: Fetching primary data for 2024-12. [2025-09-29T17:07:34.259047] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-29T17:07:34.748073] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-09-29T17:07:34.879343] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-09-29T17:07:34.890774] [INFO ] [REMOTE ] AI: Full fetch complete (77896 records). [2025-09-29T17:07:34.890940] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-09-29T17:07:35.318423] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-09-29T17:07:35.318523] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-09-29T17:07:35.319619] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-09-29T17:07:35.319738] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-09-29T17:07:35.322661] [DEBUG] [LOCAL ] AI: Trimmed 77896 records to 53750 (keeping 200 days of data) [2025-09-29T17:07:35.548190] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-09-29T17:07:35.601002] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-29T17:07:35.693760] [DEBUG] [LOCAL ] AI: Primary data saved (53750 records). [2025-09-29T17:07:35.693908] [INFO ] [MAIN ] AI: Full history saved. [2025-09-29T17:07:35.693996] [INFO ] [MAIN ] Update Progress: 68/2371 symbols completed. AI took 56.6s. Estimated remaining: 4h 15m 34s. Rate: 9.0 symbols/min [2025-09-29T17:07:35.875147] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:07:35.910920] [DEBUG] [LOCAL ] AIZ: Loaded 30543 existing records from primary storage. [2025-09-29T17:07:35.911207] [INFO ] [MAIN ] AIZ: Loaded 30543 existing records. [2025-09-29T17:07:36.106387] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:07:36.106791] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-09-29T17:07:36.106864] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-09-29T17:07:36.107363] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-09-29T17:07:36.107447] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-09-29T17:07:36.300295] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-29T17:07:36.354834] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-09-29T17:07:36.539751] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:07:36.714875] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-29T17:07:37.148122] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2024-12. [2025-09-29T17:07:37.871498] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-29T17:07:37.948145] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-09-29T17:07:38.229919] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-29T17:07:38.748123] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-09-29T17:07:39.235376] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-29T17:07:39.548132] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-09-29T17:07:40.005936] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-29T17:07:40.348085] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-09-29T17:07:40.590140] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-29T17:07:41.148135] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-09-29T17:07:41.716275] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-29T17:07:41.948123] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-09-29T17:07:42.721529] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-29T17:07:42.748070] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-09-29T17:07:43.414173] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-29T17:07:43.548103] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-09-29T17:07:43.979344] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-29T17:07:44.348135] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-09-29T17:07:44.939720] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-29T17:07:45.148124] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-09-29T17:07:45.484969] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-29T17:07:45.948138] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-09-29T17:07:46.499493] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-29T17:07:46.748141] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-09-29T17:07:47.515005] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-29T17:07:47.548084] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-09-29T17:07:48.340907] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-29T17:07:48.345190] [INFO ] [REMOTE ] AIT: Full fetch complete (39325 records). [2025-09-29T17:07:48.345291] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-09-29T17:07:48.345976] [FATAL] [VALIDATOR ] AIT: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:07:48.346067] [FATAL] [MAIN ] AIT: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:07:48.346111] [WARN ] [MAIN ] AIT: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:07:48.346153] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-09-29T17:07:48.346212] [DEBUG] [LOCAL ] AIT: No primary data file found to delete. [2025-09-29T17:07:48.346250] [INFO ] [LOCAL ] AIT: Starting deletion of derivative data. [2025-09-29T17:07:48.346699] [DEBUG] [LOCAL ] AIT: Deleted derivative data file. [2025-09-29T17:07:48.346801] [INFO ] [MAIN ] Update Progress: 69/2371 symbols completed. AIT took 24.5s. Estimated remaining: 4h 18m 48s. Rate: 8.9 symbols/min [2025-09-29T17:07:48.352192] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-09-29T17:07:48.532193] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:07:48.538425] [DEBUG] [LOCAL ] AIZN: Loaded 3935 existing records from primary storage. [2025-09-29T17:07:48.538617] [INFO ] [MAIN ] AIZN: Loaded 3935 existing records. [2025-09-29T17:07:48.727087] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:07:48.727299] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-09-29T17:07:48.727349] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-09-29T17:07:48.727599] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-09-29T17:07:48.727893] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-09-29T17:07:49.144778] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:07:49.146725] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-29T17:07:49.154625] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-09-29T17:07:49.810584] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-29T17:07:49.948112] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-09-29T17:07:50.540060] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-29T17:07:50.748160] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2024-12. [2025-09-29T17:07:51.426896] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-29T17:07:51.439413] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-29T17:07:51.548178] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-09-29T17:07:52.130569] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-29T17:07:52.348113] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-09-29T17:07:53.148118] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-09-29T17:07:53.837765] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-29T17:07:53.845294] [INFO ] [REMOTE ] AIR: Full fetch complete (38505 records). [2025-09-29T17:07:53.845425] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-09-29T17:07:53.955544] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-09-29T17:07:54.251166] [DEBUG] [VALIDATOR ] AIR: All expected trading days are present. [2025-09-29T17:07:54.251251] [DEBUG] [VALIDATOR ] AIR: Primary data validation passed. [2025-09-29T17:07:54.251697] [INFO ] [MAIN ] AIR: Fetched primary data is valid. [2025-09-29T17:07:54.251763] [DEBUG] [LOCAL ] AIR: Saving primary data. [2025-09-29T17:07:54.253137] [DEBUG] [LOCAL ] AIR: Trimmed 38505 records to 27816 (keeping 200 days of data) [2025-09-29T17:07:54.424232] [DEBUG] [LOCAL ] AIR: Primary data saved (27816 records). [2025-09-29T17:07:54.424394] [INFO ] [MAIN ] AIR: Full history saved. [2025-09-29T17:07:54.424491] [INFO ] [MAIN ] Update Progress: 70/2371 symbols completed. AIR took 34.8s. Estimated remaining: 4h 18m 19s. Rate: 8.9 symbols/min [2025-09-29T17:07:54.601041] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-29T17:07:54.629595] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:07:54.685899] [DEBUG] [LOCAL ] AJG: Loaded 47710 existing records from primary storage. [2025-09-29T17:07:54.686237] [INFO ] [MAIN ] AJG: Loaded 47710 existing records. [2025-09-29T17:07:54.753236] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-09-29T17:07:54.880489] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:07:54.880746] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-09-29T17:07:54.880825] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-09-29T17:07:54.889095] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-09-29T17:07:54.902467] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-09-29T17:07:54.939751] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-29T17:07:55.295594] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:07:55.548132] [INFO ] [REMOTE ] AJG: Fetching primary data for 2024-12. [2025-09-29T17:07:56.357589] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-09-29T17:07:56.362406] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-29T17:07:57.005220] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-29T17:07:57.148134] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-09-29T17:07:57.356124] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-29T17:07:57.948106] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-09-29T17:07:58.748079] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-09-29T17:07:58.776832] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-29T17:07:59.285133] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-29T17:07:59.548122] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-09-29T17:08:00.046579] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-29T17:08:00.348161] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-09-29T17:08:00.582210] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-29T17:08:01.148202] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-09-29T17:08:01.894719] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-29T17:08:01.948085] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-09-29T17:08:02.212356] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-29T17:08:02.515761] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-29T17:08:02.748129] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-09-29T17:08:03.548114] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-09-29T17:08:04.172919] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-29T17:08:04.348110] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-09-29T17:08:05.148117] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-09-29T17:08:05.175530] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-29T17:08:05.243495] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-29T17:08:05.948117] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-09-29T17:08:06.748099] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-09-29T17:08:06.890857] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-29T17:08:06.900368] [INFO ] [REMOTE ] AIV: Full fetch complete (59477 records). [2025-09-29T17:08:06.900507] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-09-29T17:08:07.329586] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-09-29T17:08:07.331199] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-09-29T17:08:07.331880] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-09-29T17:08:07.333808] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-09-29T17:08:07.334771] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-29T17:08:07.337243] [DEBUG] [LOCAL ] AIV: Trimmed 59477 records to 40298 (keeping 200 days of data) [2025-09-29T17:08:07.548256] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-09-29T17:08:07.590036] [DEBUG] [LOCAL ] AIV: Primary data saved (40298 records). [2025-09-29T17:08:07.590218] [INFO ] [MAIN ] AIV: Full history saved. [2025-09-29T17:08:07.590414] [INFO ] [MAIN ] Update Progress: 71/2371 symbols completed. AIV took 39.0s. Estimated remaining: 4h 21m 40s. Rate: 8.8 symbols/min [2025-09-29T17:08:07.782198] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:08:07.782570] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-09-29T17:08:07.782680] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-09-29T17:08:07.782827] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-09-29T17:08:07.782917] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-29T17:08:07.783035] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-29T17:08:07.783132] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-09-29T17:08:08.160876] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-29T17:08:08.221824] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:08:08.222802] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-29T17:08:08.348115] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-09-29T17:08:09.148172] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-09-29T17:08:09.646736] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-29T17:08:09.648053] [INFO ] [REMOTE ] AIZN: Full fetch complete (5768 records). [2025-09-29T17:08:09.648131] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-09-29T17:08:09.953279] [INFO ] [REMOTE ] AKA: Fetching primary data for 2024-12. [2025-09-29T17:08:10.047293] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-09-29T17:08:10.047406] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-09-29T17:08:10.047680] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-09-29T17:08:10.047746] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-09-29T17:08:10.048212] [DEBUG] [LOCAL ] AIZN: Trimmed 5768 records to 3911 (keeping 200 days of data) [2025-09-29T17:08:10.074084] [DEBUG] [LOCAL ] AIZN: Primary data saved (3911 records). [2025-09-29T17:08:10.074442] [INFO ] [MAIN ] AIZN: Full history saved. [2025-09-29T17:08:10.074554] [INFO ] [MAIN ] Update Progress: 72/2371 symbols completed. AIZN took 21.7s. Estimated remaining: 4h 19m 15s. Rate: 8.9 symbols/min [2025-09-29T17:08:10.253761] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:08:10.322625] [DEBUG] [LOCAL ] AKR: Loaded 46481 existing records from primary storage. [2025-09-29T17:08:10.323032] [INFO ] [MAIN ] AKR: Loaded 46481 existing records. [2025-09-29T17:08:10.516046] [WARN ] [MAIN ] AKR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:08:10.548820] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-09-29T17:08:10.548955] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-09-29T17:08:10.551848] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-29T17:08:10.551924] [DEBUG] [LOCAL ] AKR: Deleted primary data file. [2025-09-29T17:08:10.562625] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-09-29T17:08:10.679109] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-29T17:08:10.755391] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-09-29T17:08:10.981528] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:08:11.210666] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-29T17:08:11.548144] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-09-29T17:08:12.019492] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-29T17:08:12.348165] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-09-29T17:08:12.763146] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-29T17:08:13.148137] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-09-29T17:08:13.643151] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-29T17:08:13.948121] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-09-29T17:08:14.528426] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-29T17:08:14.748127] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-09-29T17:08:15.180219] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-29T17:08:15.548167] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-09-29T17:08:16.348137] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-09-29T17:08:17.012723] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-29T17:08:17.018965] [INFO ] [REMOTE ] AIZ: Full fetch complete (42987 records). [2025-09-29T17:08:17.019193] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-09-29T17:08:17.153265] [INFO ] [REMOTE ] AKR: Fetching primary data for 2024-12. [2025-09-29T17:08:17.439328] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-09-29T17:08:17.439411] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-09-29T17:08:17.439891] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-09-29T17:08:17.439957] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-09-29T17:08:17.441090] [DEBUG] [LOCAL ] AIZ: Trimmed 42987 records to 29952 (keeping 200 days of data) [2025-09-29T17:08:17.684120] [DEBUG] [LOCAL ] AIZ: Primary data saved (29952 records). [2025-09-29T17:08:17.684249] [INFO ] [MAIN ] AIZ: Full history saved. [2025-09-29T17:08:17.684328] [INFO ] [MAIN ] Update Progress: 73/2371 symbols completed. AIZ took 42.0s. Estimated remaining: 4h 19m 35s. Rate: 8.9 symbols/min [2025-09-29T17:08:17.872703] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:08:17.925753] [DEBUG] [LOCAL ] AL: Loaded 44831 existing records from primary storage. [2025-09-29T17:08:17.926089] [INFO ] [MAIN ] AL: Loaded 44831 existing records. [2025-09-29T17:08:17.960736] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-09-29T17:08:18.132816] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:08:18.133166] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-09-29T17:08:18.133228] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-09-29T17:08:18.134265] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-09-29T17:08:18.134331] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-09-29T17:08:18.394855] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-29T17:08:18.452875] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-29T17:08:18.575222] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:08:18.748126] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-09-29T17:08:19.025452] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-29T17:08:19.041578] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-09-29T17:08:19.548132] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-09-29T17:08:20.051496] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-29T17:08:20.052368] [INFO ] [REMOTE ] AKA: Full fetch complete (2429 records). [2025-09-29T17:08:20.052468] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-09-29T17:08:20.245285] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-29T17:08:20.245529] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:08:20.245600] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:08:20.245700] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-29T17:08:20.245799] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-29T17:08:20.245855] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-09-29T17:08:20.245900] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-09-29T17:08:20.245970] [INFO ] [MAIN ] Update Progress: 74/2371 symbols completed. AKA took 12.7s. Estimated remaining: 4h 17m 17s. Rate: 8.9 symbols/min [2025-09-29T17:08:20.351592] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-09-29T17:08:20.426778] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:08:20.505518] [DEBUG] [LOCAL ] ALB: Loaded 54000 existing records from primary storage. [2025-09-29T17:08:20.505965] [INFO ] [MAIN ] ALB: Loaded 54000 existing records. [2025-09-29T17:08:20.697221] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:08:20.697527] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-09-29T17:08:20.697582] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-09-29T17:08:20.698909] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-09-29T17:08:20.698987] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-09-29T17:08:21.156092] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:08:21.156218] [INFO ] [REMOTE ] AL: Fetching primary data for 2024-12. [2025-09-29T17:08:21.733391] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-29T17:08:21.948118] [INFO ] [REMOTE ] ALB: Fetching primary data for 2024-12. [2025-09-29T17:08:22.748106] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-09-29T17:08:22.780351] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-29T17:08:23.548168] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-09-29T17:08:24.110965] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-29T17:08:24.339698] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-29T17:08:24.349702] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-09-29T17:08:25.153203] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-09-29T17:08:25.171881] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-29T17:08:25.809367] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-29T17:08:25.948139] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-09-29T17:08:26.748129] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-09-29T17:08:27.037745] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-29T17:08:27.541200] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-29T17:08:27.550719] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-09-29T17:08:28.348101] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-09-29T17:08:28.390190] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-29T17:08:29.148088] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-09-29T17:08:29.393550] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-29T17:08:29.948098] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-09-29T17:08:30.217185] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-29T17:08:30.748114] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-09-29T17:08:31.006147] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-29T17:08:31.548108] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-09-29T17:08:31.794695] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-29T17:08:31.805621] [INFO ] [REMOTE ] AJG: Full fetch complete (69718 records). [2025-09-29T17:08:31.805822] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-09-29T17:08:32.244636] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-09-29T17:08:32.244764] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-09-29T17:08:32.245582] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-09-29T17:08:32.245701] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-09-29T17:08:32.247372] [DEBUG] [LOCAL ] AJG: Trimmed 69718 records to 46911 (keeping 200 days of data) [2025-09-29T17:08:32.362840] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-09-29T17:08:32.379582] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-29T17:08:32.610214] [DEBUG] [LOCAL ] AJG: Primary data saved (46911 records). [2025-09-29T17:08:32.610368] [INFO ] [MAIN ] AJG: Full history saved. [2025-09-29T17:08:32.615488] [INFO ] [MAIN ] Update Progress: 75/2371 symbols completed. AJG took 38.2s. Estimated remaining: 4h 20m 3s. Rate: 8.8 symbols/min [2025-09-29T17:08:32.801809] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:08:32.866108] [DEBUG] [LOCAL ] ALC: Loaded 51537 existing records from primary storage. [2025-09-29T17:08:32.866479] [INFO ] [MAIN ] ALC: Loaded 51537 existing records. [2025-09-29T17:08:33.062569] [WARN ] [MAIN ] ALC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:08:33.062813] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-09-29T17:08:33.062869] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-09-29T17:08:33.063846] [DEBUG] [LOCAL ] ALC: Deleted primary data file. [2025-09-29T17:08:33.063910] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-09-29T17:08:33.153168] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-09-29T17:08:33.454597] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:08:33.488685] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-29T17:08:33.948146] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-09-29T17:08:34.029919] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-29T17:08:34.547828] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-29T17:08:34.748146] [INFO ] [REMOTE ] ALC: Fetching primary data for 2024-12. [2025-09-29T17:08:35.548132] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-09-29T17:08:35.901346] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-29T17:08:36.348080] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-09-29T17:08:36.691233] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-29T17:08:36.807564] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-29T17:08:37.148157] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-09-29T17:08:37.948070] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-09-29T17:08:38.132169] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-29T17:08:38.748156] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-09-29T17:08:38.911939] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-29T17:08:39.475470] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-29T17:08:39.548108] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-09-29T17:08:40.060537] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-29T17:08:40.348117] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-09-29T17:08:41.148107] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-09-29T17:08:41.386231] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-29T17:08:41.396593] [INFO ] [REMOTE ] AKR: Full fetch complete (65498 records). [2025-09-29T17:08:41.396797] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-09-29T17:08:41.797747] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present. [2025-09-29T17:08:41.797913] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed. [2025-09-29T17:08:41.798783] [INFO ] [MAIN ] AKR: Fetched primary data is valid. [2025-09-29T17:08:41.798853] [DEBUG] [LOCAL ] AKR: Saving primary data. [2025-09-29T17:08:41.800760] [DEBUG] [LOCAL ] AKR: Trimmed 65498 records to 45716 (keeping 200 days of data) [2025-09-29T17:08:41.984755] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-09-29T17:08:42.098231] [DEBUG] [LOCAL ] AKR: Primary data saved (45716 records). [2025-09-29T17:08:42.098439] [INFO ] [MAIN ] AKR: Full history saved. [2025-09-29T17:08:42.101228] [INFO ] [MAIN ] Update Progress: 76/2371 symbols completed. AKR took 32.0s. Estimated remaining: 4h 21m 18s. Rate: 8.8 symbols/min [2025-09-29T17:08:42.334592] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:08:42.368090] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-29T17:08:42.419059] [DEBUG] [LOCAL ] ALE: Loaded 30788 existing records from primary storage. [2025-09-29T17:08:42.419368] [INFO ] [MAIN ] ALE: Loaded 30788 existing records. [2025-09-29T17:08:42.611725] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:08:42.612059] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-09-29T17:08:42.612134] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-09-29T17:08:42.622476] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-09-29T17:08:42.638550] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-09-29T17:08:42.646105] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-29T17:08:42.753464] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-09-29T17:08:43.039430] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:08:43.479808] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-29T17:08:43.548165] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-09-29T17:08:44.348084] [INFO ] [REMOTE ] ALE: Fetching primary data for 2024-12. [2025-09-29T17:08:44.535612] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-29T17:08:45.148141] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-09-29T17:08:45.292852] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-29T17:08:45.948113] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-09-29T17:08:45.986702] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-09-29T17:08:46.748133] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-09-29T17:08:46.894499] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-29T17:08:46.956283] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-29T17:08:47.548114] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-09-29T17:08:48.348176] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-09-29T17:08:48.692504] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-29T17:08:49.148107] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-09-29T17:08:49.414234] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (2.67 seconds). [2025-09-29T17:08:49.948097] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-09-29T17:08:50.057746] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-29T17:08:50.092174] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-29T17:08:50.748125] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-09-29T17:08:51.548118] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-09-29T17:08:52.250318] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-09-29T17:08:52.261606] [INFO ] [REMOTE ] ALB: Full fetch complete (76795 records). [2025-09-29T17:08:52.261915] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-09-29T17:08:52.348577] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-09-29T17:08:52.702414] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-09-29T17:08:52.702906] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-09-29T17:08:52.703937] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-09-29T17:08:52.720730] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-09-29T17:08:52.743099] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-29T17:08:52.755949] [DEBUG] [LOCAL ] ALB: Trimmed 76795 records to 53226 (keeping 200 days of data) [2025-09-29T17:08:53.030162] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-29T17:08:53.159355] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-09-29T17:08:53.195297] [DEBUG] [LOCAL ] ALB: Primary data saved (53226 records). [2025-09-29T17:08:53.195505] [INFO ] [MAIN ] ALB: Full history saved. [2025-09-29T17:08:53.195637] [INFO ] [MAIN ] Update Progress: 77/2371 symbols completed. ALB took 32.9s. Estimated remaining: 4h 23m 18s. Rate: 8.7 symbols/min [2025-09-29T17:08:53.898335] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-29T17:08:53.948175] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-09-29T17:08:54.357849] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-29T17:08:54.748133] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-09-29T17:08:55.554259] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-09-29T17:08:55.575924] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-29T17:08:56.348128] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-09-29T17:08:56.388232] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-29T17:08:56.806739] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-29T17:08:57.148109] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-09-29T17:08:57.948169] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-09-29T17:08:58.024030] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-29T17:08:58.597484] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-29T17:08:58.748107] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-09-29T17:08:59.548087] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-09-29T17:08:59.632119] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-29T17:09:00.124139] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-29T17:09:00.348110] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-09-29T17:09:01.148126] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-09-29T17:09:01.366438] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-29T17:09:01.377695] [INFO ] [REMOTE ] AL: Full fetch complete (62448 records). [2025-09-29T17:09:01.377852] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-09-29T17:09:01.827031] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-09-29T17:09:01.827385] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-09-29T17:09:01.828202] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-09-29T17:09:01.828294] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-09-29T17:09:01.851193] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-29T17:09:01.858884] [DEBUG] [LOCAL ] AL: Trimmed 62448 records to 44176 (keeping 200 days of data) [2025-09-29T17:09:01.859317] [INFO ] [REMOTE ] ALE: Full fetch complete (42621 records). [2025-09-29T17:09:01.859833] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-09-29T17:09:02.452521] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-09-29T17:09:02.455915] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-09-29T17:09:02.456632] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-09-29T17:09:02.456798] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-09-29T17:09:02.556814] [DEBUG] [LOCAL ] ALE: Trimmed 42621 records to 30436 (keeping 200 days of data) [2025-09-29T17:09:02.742871] [DEBUG] [LOCAL ] AL: Primary data saved (44176 records). [2025-09-29T17:09:02.743797] [INFO ] [MAIN ] AL: Full history saved. [2025-09-29T17:09:02.744438] [INFO ] [MAIN ] Update Progress: 78/2371 symbols completed. AL took 45.1s. Estimated remaining: 4h 24m 29s. Rate: 8.7 symbols/min [2025-09-29T17:09:02.822494] [DEBUG] [LOCAL ] ALE: Primary data saved (30436 records). [2025-09-29T17:09:02.822664] [INFO ] [MAIN ] ALE: Full history saved. [2025-09-29T17:09:02.823602] [INFO ] [MAIN ] Update Progress: 79/2371 symbols completed. ALE took 20.7s. Estimated remaining: 4h 21m 4s. Rate: 8.8 symbols/min [2025-09-29T17:09:03.050796] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-29T17:09:03.062396] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-09-29T17:09:05.013683] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-29T17:09:05.024265] [INFO ] [REMOTE ] ALC: Full fetch complete (72799 records). [2025-09-29T17:09:05.024414] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-09-29T17:09:05.433254] [DEBUG] [VALIDATOR ] ALC: All expected trading days are present. [2025-09-29T17:09:05.433348] [DEBUG] [VALIDATOR ] ALC: Primary data validation passed. [2025-09-29T17:09:05.434118] [INFO ] [MAIN ] ALC: Fetched primary data is valid. [2025-09-29T17:09:05.434192] [DEBUG] [LOCAL ] ALC: Saving primary data. [2025-09-29T17:09:05.435753] [DEBUG] [LOCAL ] ALC: Trimmed 72799 records to 50776 (keeping 200 days of data) [2025-09-29T17:09:05.765664] [DEBUG] [LOCAL ] ALC: Primary data saved (50776 records). [2025-09-29T17:09:05.765836] [INFO ] [MAIN ] ALC: Full history saved. [2025-09-29T17:09:05.766711] [INFO ] [MAIN ] Update Progress: 80/2371 symbols completed. ALC took 33.2s. Estimated remaining: 4h 19m 6s. Rate: 8.8 symbols/min [2025-09-29T17:09:06.530568] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:09:06.526171] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:09:06.509505] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:09:06.564716] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:09:06.579221] [DEBUG] [LOCAL ] ALG: Loaded 10562 existing records from primary storage. [2025-09-29T17:09:06.579598] [INFO ] [MAIN ] ALG: Loaded 10562 existing records. [2025-09-29T17:09:06.745106] [DEBUG] [LOCAL ] ALEX: Loaded 31769 existing records from primary storage. [2025-09-29T17:09:06.756001] [INFO ] [MAIN ] ALEX: Loaded 31769 existing records. [2025-09-29T17:09:06.856300] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:09:06.872548] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-09-29T17:09:06.899197] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-09-29T17:09:06.964617] [DEBUG] [LOCAL ] ALK: Loaded 53840 existing records from primary storage. [2025-09-29T17:09:06.980849] [INFO ] [MAIN ] ALK: Loaded 53840 existing records. [2025-09-29T17:09:06.981007] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-09-29T17:09:07.002721] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-09-29T17:09:07.019876] [DEBUG] [LOCAL ] ALIT: Loaded 53534 existing records from primary storage. [2025-09-29T17:09:07.057937] [INFO ] [MAIN ] ALIT: Loaded 53534 existing records. [2025-09-29T17:09:07.346685] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:09:07.419793] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-09-29T17:09:07.431196] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-09-29T17:09:07.463067] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-09-29T17:09:07.488632] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-09-29T17:09:07.701730] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:09:07.737436] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-09-29T17:09:07.750842] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:09:07.802005] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-09-29T17:09:07.814517] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-09-29T17:09:07.777555] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-09-29T17:09:07.861823] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-09-29T17:09:07.882027] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-09-29T17:09:07.882097] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-09-29T17:09:07.948449] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-09-29T17:09:08.361280] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:09:08.396736] [INFO ] [REMOTE ] ALG: Fetching primary data for 2024-12. [2025-09-29T17:09:08.920849] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:09:08.938736] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2024-12. [2025-09-29T17:09:09.123613] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:09:09.141784] [INFO ] [REMOTE ] ALK: Fetching primary data for 2024-12. [2025-09-29T17:09:09.147769] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:09:09.149329] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2024-12. [2025-09-29T17:09:09.311033] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-29T17:09:09.314162] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-09-29T17:09:10.139508] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-29T17:09:10.142707] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-09-29T17:09:10.425005] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-29T17:09:10.432401] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-09-29T17:09:11.037186] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-29T17:09:11.040826] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-09-29T17:09:11.129693] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-29T17:09:11.141267] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-09-29T17:09:11.275241] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-29T17:09:11.286474] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-09-29T17:09:11.608724] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-29T17:09:11.615006] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-09-29T17:09:12.225758] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-29T17:09:12.229413] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-09-29T17:09:12.765438] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-29T17:09:12.770973] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-09-29T17:09:12.939732] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-29T17:09:13.091010] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-29T17:09:13.148102] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-09-29T17:09:13.323722] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-29T17:09:13.948119] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-09-29T17:09:13.986860] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-29T17:09:14.059476] [DEBUG] [REMOTE ] ALK: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-09-29T17:09:14.059855] [WARN ] [REMOTE ] ALK: No data returned for month 2025-02 [2025-09-29T17:09:14.060013] [FATAL] [REMOTE ] ALK: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T17:09:14.060106] [FATAL] [MAIN ] ALK: Failed to fetch primary data. [2025-09-29T17:09:14.060180] [WARN ] [MAIN ] ALK: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T17:09:14.060286] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-09-29T17:09:14.060404] [DEBUG] [LOCAL ] ALK: No primary data file found to delete. [2025-09-29T17:09:14.060496] [INFO ] [LOCAL ] ALK: Starting deletion of derivative data. [2025-09-29T17:09:14.061457] [DEBUG] [LOCAL ] ALK: Deleted derivative data file. [2025-09-29T17:09:14.061578] [INFO ] [MAIN ] Update Progress: 81/2371 symbols completed. ALK took 8.3s. Estimated remaining: 4h 19m 42s. Rate: 8.8 symbols/min [2025-09-29T17:09:14.269682] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:09:14.346137] [DEBUG] [LOCAL ] ALL: Loaded 50903 existing records from primary storage. [2025-09-29T17:09:14.346527] [INFO ] [MAIN ] ALL: Loaded 50903 existing records. [2025-09-29T17:09:14.526021] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-29T17:09:14.583857] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:09:14.584127] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-09-29T17:09:14.584183] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-09-29T17:09:14.584922] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-09-29T17:09:14.584992] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-09-29T17:09:14.753258] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-09-29T17:09:14.986539] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:09:15.548105] [INFO ] [REMOTE ] ALL: Fetching primary data for 2024-12. [2025-09-29T17:09:15.681267] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-29T17:09:16.348139] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-09-29T17:09:17.148096] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-09-29T17:09:17.149513] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-29T17:09:17.342792] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-29T17:09:17.948137] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-09-29T17:09:18.681837] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-29T17:09:18.748143] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-09-29T17:09:19.553139] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-09-29T17:09:19.559387] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-29T17:09:19.673926] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-29T17:09:20.348142] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-09-29T17:09:21.148166] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-09-29T17:09:21.372582] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-29T17:09:21.948105] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-09-29T17:09:22.002189] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-29T17:09:22.563730] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-29T17:09:22.715757] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-29T17:09:22.748102] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-09-29T17:09:23.548140] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-09-29T17:09:24.348126] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-09-29T17:09:24.524066] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-29T17:09:24.526465] [INFO ] [REMOTE ] ALG: Full fetch complete (15887 records). [2025-09-29T17:09:24.526584] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-09-29T17:09:24.944284] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-29T17:09:24.957020] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-09-29T17:09:24.960983] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-09-29T17:09:24.968731] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-09-29T17:09:24.969603] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-09-29T17:09:24.971042] [DEBUG] [LOCAL ] ALG: Trimmed 15887 records to 10273 (keeping 200 days of data) [2025-09-29T17:09:25.044852] [DEBUG] [LOCAL ] ALG: Primary data saved (10273 records). [2025-09-29T17:09:25.045057] [INFO ] [MAIN ] ALG: Full history saved. [2025-09-29T17:09:25.045226] [INFO ] [MAIN ] Update Progress: 82/2371 symbols completed. ALG took 19.3s. Estimated remaining: 4h 21m 31s. Rate: 8.8 symbols/min [2025-09-29T17:09:25.155415] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-09-29T17:09:25.237142] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:09:25.294440] [DEBUG] [LOCAL ] ALLE: Loaded 45637 existing records from primary storage. [2025-09-29T17:09:25.294800] [INFO ] [MAIN ] ALLE: Loaded 45637 existing records. [2025-09-29T17:09:25.491939] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:09:25.492212] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-09-29T17:09:25.492278] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-09-29T17:09:25.492959] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-09-29T17:09:25.493029] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-09-29T17:09:25.900105] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:09:25.948154] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2024-12. [2025-09-29T17:09:26.019206] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-29T17:09:26.748191] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-09-29T17:09:27.206520] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-29T17:09:27.548153] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-09-29T17:09:27.798024] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-29T17:09:28.348118] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-09-29T17:09:28.420381] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-29T17:09:28.778153] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-29T17:09:29.148131] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-09-29T17:09:29.948129] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-09-29T17:09:30.142212] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-29T17:09:30.748156] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-09-29T17:09:30.890936] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-29T17:09:31.315411] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-29T17:09:31.548101] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-09-29T17:09:32.348123] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-09-29T17:09:32.579887] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-29T17:09:33.148105] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-09-29T17:09:33.462213] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-29T17:09:33.948134] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-09-29T17:09:34.182097] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-29T17:09:34.748075] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-09-29T17:09:34.871468] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-29T17:09:35.290351] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-29T17:09:35.548163] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-09-29T17:09:36.348083] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-09-29T17:09:36.594739] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-29T17:09:37.036398] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-29T17:09:37.043337] [INFO ] [REMOTE ] ALEX: Full fetch complete (44620 records). [2025-09-29T17:09:37.043458] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-09-29T17:09:37.150841] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-09-29T17:09:37.440497] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-09-29T17:09:37.440603] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-09-29T17:09:37.441157] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-09-29T17:09:37.441228] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-09-29T17:09:37.442400] [DEBUG] [LOCAL ] ALEX: Trimmed 44620 records to 31165 (keeping 200 days of data) [2025-09-29T17:09:37.641704] [DEBUG] [LOCAL ] ALEX: Primary data saved (31165 records). [2025-09-29T17:09:37.641859] [INFO ] [MAIN ] ALEX: Full history saved. [2025-09-29T17:09:37.641971] [INFO ] [MAIN ] Update Progress: 83/2371 symbols completed. ALEX took 31.9s. Estimated remaining: 4h 24m 3s. Rate: 8.7 symbols/min [2025-09-29T17:09:37.834780] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:09:37.870633] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-29T17:09:37.938461] [DEBUG] [LOCAL ] ALLY: Loaded 53997 existing records from primary storage. [2025-09-29T17:09:37.938848] [INFO ] [MAIN ] ALLY: Loaded 53997 existing records. [2025-09-29T17:09:37.953290] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-09-29T17:09:38.126389] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:09:38.126629] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-09-29T17:09:38.126712] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-09-29T17:09:38.127475] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-09-29T17:09:38.127539] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-09-29T17:09:38.490230] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:09:38.748084] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-09-29T17:09:39.220039] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-29T17:09:39.231308] [INFO ] [REMOTE ] ALIT: Full fetch complete (76415 records). [2025-09-29T17:09:39.231468] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-09-29T17:09:39.551569] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2024-12. [2025-09-29T17:09:39.661784] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-09-29T17:09:39.661909] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-09-29T17:09:39.662987] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-09-29T17:09:39.663091] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-09-29T17:09:39.664827] [DEBUG] [LOCAL ] ALIT: Trimmed 76415 records to 52760 (keeping 200 days of data) [2025-09-29T17:09:39.801610] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-29T17:09:40.043529] [DEBUG] [LOCAL ] ALIT: Primary data saved (52760 records). [2025-09-29T17:09:40.043712] [INFO ] [MAIN ] ALIT: Full history saved. [2025-09-29T17:09:40.043828] [INFO ] [MAIN ] Update Progress: 84/2371 symbols completed. ALIT took 34.3s. Estimated remaining: 4h 21m 53s. Rate: 8.7 symbols/min [2025-09-29T17:09:40.226935] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:09:40.278527] [DEBUG] [LOCAL ] ALSN: Loaded 43953 existing records from primary storage. [2025-09-29T17:09:40.278884] [INFO ] [MAIN ] ALSN: Loaded 43953 existing records. [2025-09-29T17:09:40.352824] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-09-29T17:09:40.482550] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:09:40.483128] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-09-29T17:09:40.483403] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-09-29T17:09:40.484102] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-09-29T17:09:40.484179] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-09-29T17:09:40.866576] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-29T17:09:40.922974] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:09:41.148101] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2024-12. [2025-09-29T17:09:41.475733] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-29T17:09:41.948084] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-09-29T17:09:42.373423] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-29T17:09:42.385098] [INFO ] [REMOTE ] ALL: Full fetch complete (72147 records). [2025-09-29T17:09:42.385251] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-09-29T17:09:42.386185] [FATAL] [VALIDATOR ] ALL: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:09:42.386275] [FATAL] [MAIN ] ALL: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:09:42.386319] [WARN ] [MAIN ] ALL: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:09:42.386388] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-09-29T17:09:42.386454] [DEBUG] [LOCAL ] ALL: No primary data file found to delete. [2025-09-29T17:09:42.386491] [INFO ] [LOCAL ] ALL: Starting deletion of derivative data. [2025-09-29T17:09:42.386919] [DEBUG] [LOCAL ] ALL: Deleted derivative data file. [2025-09-29T17:09:42.388279] [INFO ] [MAIN ] Update Progress: 85/2371 symbols completed. ALL took 28.3s. Estimated remaining: 4h 19m 44s. Rate: 8.8 symbols/min [2025-09-29T17:09:42.564888] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:09:42.590975] [DEBUG] [LOCAL ] ALTG: Loaded 24161 existing records from primary storage. [2025-09-29T17:09:42.591234] [INFO ] [MAIN ] ALTG: Loaded 24161 existing records. [2025-09-29T17:09:42.753060] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-09-29T17:09:42.795087] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:09:42.795787] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-09-29T17:09:42.795977] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-09-29T17:09:42.796329] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-09-29T17:09:42.796452] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-09-29T17:09:43.052758] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-29T17:09:43.246739] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:09:43.548091] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-09-29T17:09:43.850913] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-29T17:09:44.348138] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-09-29T17:09:44.685618] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-29T17:09:45.071456] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-29T17:09:45.148130] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-09-29T17:09:45.853581] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-29T17:09:45.948114] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-09-29T17:09:46.378249] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-29T17:09:46.748155] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2024-12. [2025-09-29T17:09:47.548767] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-29T17:09:47.548909] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-09-29T17:09:47.944008] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-29T17:09:48.348120] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-09-29T17:09:49.081028] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-29T17:09:49.148097] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-09-29T17:09:49.948113] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-09-29T17:09:50.111287] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-29T17:09:50.215092] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-29T17:09:50.748147] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-09-29T17:09:51.525909] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-29T17:09:51.548136] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-09-29T17:09:52.348086] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-09-29T17:09:52.826104] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-29T17:09:53.148101] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-09-29T17:09:53.380491] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-29T17:09:53.954698] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-09-29T17:09:53.974033] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-29T17:09:54.748122] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-09-29T17:09:54.799357] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-29T17:09:55.427816] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-29T17:09:55.548084] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-09-29T17:09:55.795904] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-29T17:09:56.348107] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-09-29T17:09:57.148123] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-09-29T17:09:57.220462] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-29T17:09:57.831759] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-29T17:09:57.948118] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-09-29T17:09:58.748127] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-09-29T17:09:58.944793] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-29T17:09:59.543799] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-29T17:09:59.553060] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-09-29T17:10:00.348126] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-09-29T17:10:00.488665] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-29T17:10:01.085117] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-29T17:10:01.148147] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-09-29T17:10:01.948135] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-09-29T17:10:01.999256] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-29T17:10:02.748133] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-09-29T17:10:03.331344] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-29T17:10:03.518863] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-09-29T17:10:03.530479] [INFO ] [REMOTE ] ALLY: Full fetch complete (76904 records). [2025-09-29T17:10:03.530684] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-09-29T17:10:03.555738] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-09-29T17:10:04.117944] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-09-29T17:10:04.118072] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-09-29T17:10:04.119409] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-09-29T17:10:04.119515] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-09-29T17:10:04.121512] [DEBUG] [LOCAL ] ALLY: Trimmed 76904 records to 53217 (keeping 200 days of data) [2025-09-29T17:10:04.390673] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-09-29T17:10:04.440378] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-29T17:10:04.474772] [INFO ] [REMOTE ] ALSN: Full fetch complete (62126 records). [2025-09-29T17:10:04.476448] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-09-29T17:10:04.937813] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-29T17:10:04.963814] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-09-29T17:10:04.969466] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-09-29T17:10:04.971110] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-09-29T17:10:04.971752] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-09-29T17:10:04.977020] [DEBUG] [LOCAL ] ALSN: Trimmed 62126 records to 43263 (keeping 200 days of data) [2025-09-29T17:10:05.148538] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-09-29T17:10:05.169910] [DEBUG] [LOCAL ] ALLY: Primary data saved (53217 records). [2025-09-29T17:10:05.171116] [INFO ] [MAIN ] ALLY: Full history saved. [2025-09-29T17:10:05.172190] [INFO ] [MAIN ] Update Progress: 86/2371 symbols completed. ALLY took 27.5s. Estimated remaining: 4h 26m 42s. Rate: 8.6 symbols/min [2025-09-29T17:10:05.370539] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:10:05.478322] [DEBUG] [LOCAL ] ALUR: Loaded 10950 existing records from primary storage. [2025-09-29T17:10:05.479866] [INFO ] [MAIN ] ALUR: Loaded 10950 existing records. [2025-09-29T17:10:05.683089] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:10:05.683914] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-09-29T17:10:05.684446] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-09-29T17:10:05.685094] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-09-29T17:10:05.685722] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-09-29T17:10:06.100515] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:10:06.101380] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2024-12. [2025-09-29T17:10:06.154010] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-29T17:10:06.168821] [DEBUG] [LOCAL ] ALSN: Primary data saved (43263 records). [2025-09-29T17:10:06.168962] [INFO ] [MAIN ] ALSN: Full history saved. [2025-09-29T17:10:06.169508] [INFO ] [MAIN ] Update Progress: 87/2371 symbols completed. ALSN took 26.1s. Estimated remaining: 4h 23m 57s. Rate: 8.7 symbols/min [2025-09-29T17:10:06.300923] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-29T17:10:06.369320] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:10:06.418876] [DEBUG] [LOCAL ] ALV: Loaded 43217 existing records from primary storage. [2025-09-29T17:10:06.419230] [INFO ] [MAIN ] ALV: Loaded 43217 existing records. [2025-09-29T17:10:06.611678] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:10:06.611939] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-09-29T17:10:06.612012] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-09-29T17:10:06.612475] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-09-29T17:10:06.612618] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-09-29T17:10:06.755516] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-09-29T17:10:06.988178] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:10:07.548125] [INFO ] [REMOTE ] ALV: Fetching primary data for 2024-12. [2025-09-29T17:10:07.604611] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-29T17:10:08.082119] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-29T17:10:08.348113] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-09-29T17:10:09.155664] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-09-29T17:10:09.160939] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-29T17:10:09.948078] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-09-29T17:10:10.052421] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-29T17:10:10.062091] [INFO ] [REMOTE ] ALLE: Full fetch complete (64766 records). [2025-09-29T17:10:10.062272] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-09-29T17:10:10.494109] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-29T17:10:10.586427] [DEBUG] [VALIDATOR ] ALLE: All expected trading days are present. [2025-09-29T17:10:10.586568] [DEBUG] [VALIDATOR ] ALLE: Primary data validation passed. [2025-09-29T17:10:10.587299] [INFO ] [MAIN ] ALLE: Fetched primary data is valid. [2025-09-29T17:10:10.587365] [DEBUG] [LOCAL ] ALLE: Saving primary data. [2025-09-29T17:10:10.588766] [DEBUG] [LOCAL ] ALLE: Trimmed 64766 records to 44821 (keeping 200 days of data) [2025-09-29T17:10:10.785877] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-09-29T17:10:10.892996] [DEBUG] [LOCAL ] ALLE: Primary data saved (44821 records). [2025-09-29T17:10:10.893141] [INFO ] [MAIN ] ALLE: Full history saved. [2025-09-29T17:10:10.893246] [INFO ] [MAIN ] Update Progress: 88/2371 symbols completed. ALLE took 45.8s. Estimated remaining: 4h 22m 53s. Rate: 8.7 symbols/min [2025-09-29T17:10:11.071897] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:10:11.080279] [DEBUG] [LOCAL ] ALX: Loaded 6121 existing records from primary storage. [2025-09-29T17:10:11.080471] [INFO ] [MAIN ] ALX: Loaded 6121 existing records. [2025-09-29T17:10:11.271559] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:10:11.271808] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-09-29T17:10:11.271864] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-09-29T17:10:11.272287] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-09-29T17:10:11.272347] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-09-29T17:10:11.548730] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-09-29T17:10:11.705040] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:10:11.729524] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-29T17:10:12.248852] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-29T17:10:12.254330] [INFO ] [REMOTE ] ALTG: Full fetch complete (33692 records). [2025-09-29T17:10:12.254464] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-09-29T17:10:12.353210] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-09-29T17:10:12.676820] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-09-29T17:10:12.677025] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-09-29T17:10:12.677587] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-09-29T17:10:12.677697] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-09-29T17:10:12.692903] [DEBUG] [LOCAL ] ALTG: Trimmed 33692 records to 23671 (keeping 200 days of data) [2025-09-29T17:10:12.694357] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-29T17:10:12.837188] [DEBUG] [LOCAL ] ALTG: Primary data saved (23671 records). [2025-09-29T17:10:12.837339] [INFO ] [MAIN ] ALTG: Full history saved. [2025-09-29T17:10:12.837435] [INFO ] [MAIN ] Update Progress: 89/2371 symbols completed. ALTG took 30.4s. Estimated remaining: 4h 20m 38s. Rate: 8.8 symbols/min [2025-09-29T17:10:13.024884] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:10:13.081799] [DEBUG] [LOCAL ] AM: Loaded 52887 existing records from primary storage. [2025-09-29T17:10:13.082154] [INFO ] [MAIN ] AM: Loaded 52887 existing records. [2025-09-29T17:10:13.153424] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-09-29T17:10:13.287745] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:10:13.287961] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-09-29T17:10:13.288008] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-09-29T17:10:13.288490] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-09-29T17:10:13.288554] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-09-29T17:10:13.686546] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:10:13.948099] [INFO ] [REMOTE ] ALX: Fetching primary data for 2024-12. [2025-09-29T17:10:14.050098] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-29T17:10:14.349634] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-29T17:10:14.611508] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-29T17:10:14.748152] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-09-29T17:10:15.548171] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-09-29T17:10:15.970500] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-29T17:10:16.047229] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-29T17:10:16.348124] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-09-29T17:10:16.929815] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-29T17:10:17.148116] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-09-29T17:10:17.654547] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-29T17:10:17.948123] [INFO ] [REMOTE ] AM: Fetching primary data for 2024-12. [2025-09-29T17:10:18.748116] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-09-29T17:10:19.356150] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-29T17:10:19.548137] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-09-29T17:10:19.997056] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-29T17:10:20.302235] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-29T17:10:20.348103] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-09-29T17:10:20.847996] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-29T17:10:21.148123] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-09-29T17:10:21.948130] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-09-29T17:10:22.073268] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-29T17:10:22.748134] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-09-29T17:10:23.430338] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-29T17:10:23.548126] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-09-29T17:10:24.348133] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-09-29T17:10:24.462514] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-29T17:10:25.097840] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-29T17:10:25.148099] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-09-29T17:10:25.301229] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-29T17:10:25.915516] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-29T17:10:25.917399] [INFO ] [REMOTE ] ALUR: Full fetch complete (20475 records). [2025-09-29T17:10:25.917480] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-09-29T17:10:25.918205] [FATAL] [VALIDATOR ] ALUR: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:10:25.918293] [FATAL] [MAIN ] ALUR: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:10:25.918337] [WARN ] [MAIN ] ALUR: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:10:25.918376] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-09-29T17:10:25.918433] [DEBUG] [LOCAL ] ALUR: No primary data file found to delete. [2025-09-29T17:10:25.918468] [INFO ] [LOCAL ] ALUR: Starting deletion of derivative data. [2025-09-29T17:10:25.919236] [DEBUG] [LOCAL ] ALUR: Deleted derivative data file. [2025-09-29T17:10:25.919343] [INFO ] [MAIN ] Update Progress: 90/2371 symbols completed. ALUR took 20.7s. Estimated remaining: 4h 23m 9s. Rate: 8.7 symbols/min [2025-09-29T17:10:25.953194] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-09-29T17:10:26.107857] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:10:26.148993] [DEBUG] [LOCAL ] AMBC: Loaded 37453 existing records from primary storage. [2025-09-29T17:10:26.149291] [INFO ] [MAIN ] AMBC: Loaded 37453 existing records. [2025-09-29T17:10:26.342850] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:10:26.343094] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-09-29T17:10:26.343145] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-09-29T17:10:26.343628] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-09-29T17:10:26.343746] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-09-29T17:10:26.755167] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:10:26.755323] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-09-29T17:10:27.548138] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-09-29T17:10:27.878190] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-29T17:10:28.323315] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-29T17:10:28.348122] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2024-12. [2025-09-29T17:10:28.505150] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-29T17:10:29.148118] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-09-29T17:10:29.713371] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-29T17:10:29.738903] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-29T17:10:29.948109] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-09-29T17:10:30.748160] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-09-29T17:10:30.884900] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-29T17:10:31.548169] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-09-29T17:10:32.304792] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-29T17:10:32.348135] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-09-29T17:10:32.593065] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-29T17:10:33.148144] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-09-29T17:10:33.170335] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-29T17:10:33.948095] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-09-29T17:10:34.322243] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-29T17:10:34.748167] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-09-29T17:10:34.810538] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-29T17:10:34.812767] [INFO ] [REMOTE ] ALX: Full fetch complete (7010 records). [2025-09-29T17:10:34.812843] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-09-29T17:10:35.198247] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-09-29T17:10:35.198340] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-09-29T17:10:35.198596] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-09-29T17:10:35.198674] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-09-29T17:10:35.199185] [DEBUG] [LOCAL ] ALX: Trimmed 7010 records to 6134 (keeping 200 days of data) [2025-09-29T17:10:35.238903] [DEBUG] [LOCAL ] ALX: Primary data saved (6134 records). [2025-09-29T17:10:35.239039] [INFO ] [MAIN ] ALX: Full history saved. [2025-09-29T17:10:35.239122] [INFO ] [MAIN ] Update Progress: 91/2371 symbols completed. ALX took 24.3s. Estimated remaining: 4h 24m 3s. Rate: 8.6 symbols/min [2025-09-29T17:10:35.414954] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:10:35.461854] [DEBUG] [LOCAL ] AMBP: Loaded 45863 existing records from primary storage. [2025-09-29T17:10:35.462292] [INFO ] [MAIN ] AMBP: Loaded 45863 existing records. [2025-09-29T17:10:35.553313] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-09-29T17:10:35.654265] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:10:35.654473] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-09-29T17:10:35.654523] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-09-29T17:10:35.655226] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-09-29T17:10:35.655288] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-09-29T17:10:36.028542] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:10:36.348094] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2024-12. [2025-09-29T17:10:36.412288] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-29T17:10:37.148107] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-09-29T17:10:37.335033] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-29T17:10:37.948144] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-09-29T17:10:38.283537] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-29T17:10:38.691537] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-29T17:10:38.748120] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-09-29T17:10:39.203571] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-29T17:10:39.548123] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-09-29T17:10:40.347302] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-29T17:10:40.359291] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-09-29T17:10:41.113437] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-29T17:10:41.148119] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-09-29T17:10:41.948203] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-09-29T17:10:42.034221] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-29T17:10:42.622901] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-29T17:10:42.748155] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-09-29T17:10:43.548097] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-09-29T17:10:43.973687] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-29T17:10:44.348201] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-09-29T17:10:44.416775] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-29T17:10:44.923858] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-29T17:10:45.148116] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-09-29T17:10:45.890680] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-29T17:10:45.948195] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-09-29T17:10:46.748192] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-09-29T17:10:46.900611] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-29T17:10:47.512520] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-29T17:10:47.548185] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-09-29T17:10:48.031802] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-29T17:10:48.348125] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-09-29T17:10:49.148171] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-09-29T17:10:49.369748] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-29T17:10:49.380888] [INFO ] [REMOTE ] AM: Full fetch complete (75601 records). [2025-09-29T17:10:49.381056] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-09-29T17:10:49.785449] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-09-29T17:10:49.785709] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-09-29T17:10:49.786638] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-09-29T17:10:49.796330] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-09-29T17:10:49.813597] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-29T17:10:49.823051] [DEBUG] [LOCAL ] AM: Trimmed 75601 records to 52096 (keeping 200 days of data) [2025-09-29T17:10:49.951883] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-09-29T17:10:50.151542] [DEBUG] [LOCAL ] AM: Primary data saved (52096 records). [2025-09-29T17:10:50.151778] [INFO ] [MAIN ] AM: Full history saved. [2025-09-29T17:10:50.156518] [INFO ] [MAIN ] Update Progress: 92/2371 symbols completed. AM took 37.3s. Estimated remaining: 4h 27m 13s. Rate: 8.5 symbols/min [2025-09-29T17:10:50.340265] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:10:50.340471] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-09-29T17:10:50.340558] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-09-29T17:10:50.340718] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-09-29T17:10:50.340768] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-29T17:10:50.340809] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-29T17:10:50.340841] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-09-29T17:10:50.734615] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:10:50.748107] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-09-29T17:10:50.792589] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-29T17:10:50.801672] [INFO ] [REMOTE ] ALV: Full fetch complete (61875 records). [2025-09-29T17:10:50.801853] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-09-29T17:10:51.220878] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-09-29T17:10:51.220972] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-09-29T17:10:51.221603] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-09-29T17:10:51.221670] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-09-29T17:10:51.223044] [DEBUG] [LOCAL ] ALV: Trimmed 61875 records to 42485 (keeping 200 days of data) [2025-09-29T17:10:51.505966] [DEBUG] [LOCAL ] ALV: Primary data saved (42485 records). [2025-09-29T17:10:51.506101] [INFO ] [MAIN ] ALV: Full history saved. [2025-09-29T17:10:51.507214] [INFO ] [MAIN ] Update Progress: 93/2371 symbols completed. ALV took 45.3s. Estimated remaining: 4h 24m 47s. Rate: 8.6 symbols/min [2025-09-29T17:10:51.551599] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2024-12. [2025-09-29T17:10:51.689026] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:10:51.753772] [DEBUG] [LOCAL ] AMC: Loaded 54539 existing records from primary storage. [2025-09-29T17:10:51.754205] [INFO ] [MAIN ] AMC: Loaded 54539 existing records. [2025-09-29T17:10:51.894485] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T17:10:51.919310] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-29T17:10:51.934232] [WARN ] [REMOTE ] AMBQ: No data returned for month 2024-12 [2025-09-29T17:10:51.936292] [FATAL] [REMOTE ] AMBQ: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T17:10:51.963627] [FATAL] [MAIN ] AMBQ: Failed to fetch primary data. [2025-09-29T17:10:52.023811] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T17:10:52.030250] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:10:52.030696] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-29T17:10:52.030887] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-09-29T17:10:52.030997] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-09-29T17:10:52.031343] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-29T17:10:52.031581] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-09-29T17:10:52.031891] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-09-29T17:10:52.032031] [INFO ] [MAIN ] Update Progress: 94/2371 symbols completed. AMBQ took 1.9s. Estimated remaining: 4h 22m 4s. Rate: 8.7 symbols/min [2025-09-29T17:10:52.040474] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-09-29T17:10:52.104263] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-09-29T17:10:52.139381] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-29T17:10:52.350978] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-09-29T17:10:52.392203] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:10:52.707462] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:10:52.725281] [DEBUG] [LOCAL ] AMCR: Loaded 54449 existing records from primary storage. [2025-09-29T17:10:52.725740] [INFO ] [MAIN ] AMCR: Loaded 54449 existing records. [2025-09-29T17:10:52.910985] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:10:52.911198] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-09-29T17:10:52.911247] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-09-29T17:10:52.911911] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-09-29T17:10:52.911977] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-09-29T17:10:53.153309] [INFO ] [REMOTE ] AMC: Fetching primary data for 2024-12. [2025-09-29T17:10:53.297306] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:10:53.915322] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-29T17:10:53.948078] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-09-29T17:10:54.748133] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-09-29T17:10:55.548182] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2024-12. [2025-09-29T17:10:55.655822] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-29T17:10:55.747098] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2024-12 (2.59 seconds). [2025-09-29T17:10:56.165894] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-29T17:10:56.348174] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-09-29T17:10:57.144764] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-29T17:10:57.158594] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-09-29T17:10:57.802117] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-29T17:10:57.948125] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-09-29T17:10:58.611470] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-29T17:10:58.748111] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-09-29T17:10:59.548125] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-09-29T17:10:59.712743] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-29T17:11:00.348101] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-09-29T17:11:00.419366] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-29T17:11:00.428683] [INFO ] [REMOTE ] AMBP: Full fetch complete (65823 records). [2025-09-29T17:11:00.428850] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-09-29T17:11:00.874372] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-09-29T17:11:00.874622] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-09-29T17:11:00.875351] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-09-29T17:11:00.882191] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-09-29T17:11:00.901574] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-29T17:11:00.911553] [DEBUG] [LOCAL ] AMBP: Trimmed 65823 records to 45121 (keeping 200 days of data) [2025-09-29T17:11:00.912613] [INFO ] [REMOTE ] AMBC: Full fetch complete (51106 records). [2025-09-29T17:11:00.913196] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-09-29T17:11:01.160821] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-09-29T17:11:01.457203] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-09-29T17:11:01.459348] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-09-29T17:11:01.460151] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-09-29T17:11:01.460240] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-09-29T17:11:01.465269] [DEBUG] [LOCAL ] AMBC: Trimmed 51106 records to 36595 (keeping 200 days of data) [2025-09-29T17:11:01.774771] [DEBUG] [LOCAL ] AMBP: Primary data saved (45121 records). [2025-09-29T17:11:01.776810] [INFO ] [MAIN ] AMBP: Full history saved. [2025-09-29T17:11:01.780158] [INFO ] [MAIN ] Update Progress: 95/2371 symbols completed. AMBP took 26.5s. Estimated remaining: 4h 23m 5s. Rate: 8.7 symbols/min [2025-09-29T17:11:02.053055] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:11:02.083171] [DEBUG] [LOCAL ] AMBC: Primary data saved (36595 records). [2025-09-29T17:11:02.083494] [INFO ] [MAIN ] AMBC: Full history saved. [2025-09-29T17:11:02.083695] [INFO ] [MAIN ] Update Progress: 96/2371 symbols completed. AMBC took 36.2s. Estimated remaining: 4h 20m 21s. Rate: 8.7 symbols/min [2025-09-29T17:11:02.311494] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:11:02.338362] [DEBUG] [LOCAL ] AME: Loaded 49252 existing records from primary storage. [2025-09-29T17:11:02.339548] [INFO ] [MAIN ] AME: Loaded 49252 existing records. [2025-09-29T17:11:02.532879] [DEBUG] [LOCAL ] AMG: Loaded 21046 existing records from primary storage. [2025-09-29T17:11:02.583215] [INFO ] [MAIN ] AMG: Loaded 21046 existing records. [2025-09-29T17:11:02.582788] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:11:02.626019] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-09-29T17:11:02.651680] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-09-29T17:11:02.683160] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-09-29T17:11:02.707334] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-09-29T17:11:02.910609] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:11:02.921045] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-09-29T17:11:02.931761] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-09-29T17:11:03.070184] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-09-29T17:11:03.146510] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-09-29T17:11:03.198660] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (2.85 seconds). [2025-09-29T17:11:03.206736] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-29T17:11:03.320246] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-09-29T17:11:03.339586] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:11:03.360932] [INFO ] [REMOTE ] AME: Fetching primary data for 2024-12. [2025-09-29T17:11:03.560794] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-09-29T17:11:03.702398] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:11:04.348183] [INFO ] [REMOTE ] AMG: Fetching primary data for 2024-12. [2025-09-29T17:11:05.248568] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-29T17:11:05.259064] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-09-29T17:11:05.462845] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-29T17:11:05.642208] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-09-29T17:11:05.695066] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-29T17:11:05.948107] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-09-29T17:11:06.748172] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-09-29T17:11:06.906189] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-29T17:11:06.969497] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-29T17:11:07.548154] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-09-29T17:11:08.348147] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-09-29T17:11:09.019296] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-09-29T17:11:09.148089] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-09-29T17:11:09.154094] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-29T17:11:09.202796] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-29T17:11:09.948108] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-09-29T17:11:10.745426] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-29T17:11:10.750586] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-09-29T17:11:11.544938] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-09-29T17:11:11.555552] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-09-29T17:11:12.348162] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-09-29T17:11:12.876360] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-29T17:11:12.972245] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-29T17:11:13.148133] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-09-29T17:11:13.948123] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-09-29T17:11:14.748086] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-09-29T17:11:14.847176] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-09-29T17:11:15.150697] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-29T17:11:15.548162] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-09-29T17:11:15.787310] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-29T17:11:16.109444] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-29T17:11:16.348141] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-09-29T17:11:17.148155] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-09-29T17:11:17.388556] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-29T17:11:17.948126] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-09-29T17:11:18.253122] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-29T17:11:18.291848] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-29T17:11:18.748162] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-09-29T17:11:19.548154] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-09-29T17:11:19.641033] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-29T17:11:19.901698] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-29T17:11:20.348133] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-09-29T17:11:21.148116] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-09-29T17:11:21.948123] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-09-29T17:11:22.001333] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-29T17:11:22.105129] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-09-29T17:11:22.135916] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-29T17:11:22.748162] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-09-29T17:11:23.548121] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-09-29T17:11:23.659904] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-29T17:11:24.348119] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-09-29T17:11:25.148187] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-09-29T17:11:25.404543] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (2.66 seconds). [2025-09-29T17:11:25.626042] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-29T17:11:25.948100] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-09-29T17:11:26.024764] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-29T17:11:26.606966] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-29T17:11:26.611961] [INFO ] [REMOTE ] AMG: Full fetch complete (29843 records). [2025-09-29T17:11:26.612121] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-09-29T17:11:26.753274] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-09-29T17:11:27.034311] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-09-29T17:11:27.034406] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-09-29T17:11:27.034857] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-09-29T17:11:27.034936] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-09-29T17:11:27.036010] [DEBUG] [LOCAL ] AMG: Trimmed 29843 records to 20495 (keeping 200 days of data) [2025-09-29T17:11:27.188064] [DEBUG] [LOCAL ] AMG: Primary data saved (20495 records). [2025-09-29T17:11:27.188214] [INFO ] [MAIN ] AMG: Full history saved. [2025-09-29T17:11:27.188341] [INFO ] [MAIN ] Update Progress: 97/2371 symbols completed. AMG took 25.1s. Estimated remaining: 4h 27m 21s. Rate: 8.5 symbols/min [2025-09-29T17:11:27.409438] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:11:27.474047] [DEBUG] [LOCAL ] AMH: Loaded 52467 existing records from primary storage. [2025-09-29T17:11:27.474436] [INFO ] [MAIN ] AMH: Loaded 52467 existing records. [2025-09-29T17:11:27.553314] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-09-29T17:11:27.669911] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:11:27.670206] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-09-29T17:11:27.670290] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-09-29T17:11:27.671144] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-09-29T17:11:27.671226] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-09-29T17:11:28.054110] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:11:28.348162] [INFO ] [REMOTE ] AMH: Fetching primary data for 2024-12. [2025-09-29T17:11:28.432030] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-09-29T17:11:28.443706] [INFO ] [REMOTE ] AMC: Full fetch complete (77923 records). [2025-09-29T17:11:28.443894] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-09-29T17:11:28.869983] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-09-29T17:11:28.870195] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-09-29T17:11:28.871290] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-09-29T17:11:28.871453] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-09-29T17:11:28.873282] [DEBUG] [LOCAL ] AMC: Trimmed 77923 records to 53760 (keeping 200 days of data) [2025-09-29T17:11:29.003192] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-29T17:11:29.019367] [INFO ] [REMOTE ] AMCR: Full fetch complete (77677 records). [2025-09-29T17:11:29.023254] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-09-29T17:11:29.397291] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-29T17:11:29.475699] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-09-29T17:11:29.603375] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-09-29T17:11:29.642085] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-09-29T17:11:29.643785] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-09-29T17:11:29.644836] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-09-29T17:11:29.648714] [DEBUG] [LOCAL ] AMCR: Trimmed 77677 records to 53669 (keeping 200 days of data) [2025-09-29T17:11:30.099946] [DEBUG] [LOCAL ] AMC: Primary data saved (53760 records). [2025-09-29T17:11:30.103872] [INFO ] [MAIN ] AMC: Full history saved. [2025-09-29T17:11:30.106530] [DEBUG] [LOCAL ] AMCR: Primary data saved (53669 records). [2025-09-29T17:11:30.105072] [INFO ] [MAIN ] Update Progress: 98/2371 symbols completed. AMC took 38.6s. Estimated remaining: 4h 25m 38s. Rate: 8.6 symbols/min [2025-09-29T17:11:30.106701] [INFO ] [MAIN ] AMCR: Full history saved. [2025-09-29T17:11:30.119317] [INFO ] [MAIN ] Update Progress: 99/2371 symbols completed. AMCR took 38.1s. Estimated remaining: 4h 22m 51s. Rate: 8.6 symbols/min [2025-09-29T17:11:30.369069] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-29T17:11:30.448383] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-09-29T17:11:30.513431] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:11:30.535755] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:11:30.590391] [DEBUG] [LOCAL ] AMP: Loaded 32959 existing records from primary storage. [2025-09-29T17:11:30.590935] [INFO ] [MAIN ] AMP: Loaded 32959 existing records. [2025-09-29T17:11:30.774540] [DEBUG] [LOCAL ] AMN: Loaded 42588 existing records from primary storage. [2025-09-29T17:11:30.819231] [INFO ] [MAIN ] AMN: Loaded 42588 existing records. [2025-09-29T17:11:30.848721] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:11:30.898952] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-09-29T17:11:30.912813] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-09-29T17:11:30.935281] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-09-29T17:11:30.953997] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-09-29T17:11:31.183381] [WARN ] [MAIN ] AMN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:11:31.204321] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-09-29T17:11:31.266316] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-09-29T17:11:31.313010] [DEBUG] [LOCAL ] AMN: Deleted primary data file. [2025-09-29T17:11:31.313232] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-09-29T17:11:31.599520] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:11:31.620753] [INFO ] [REMOTE ] AMP: Fetching primary data for 2024-12. [2025-09-29T17:11:31.828478] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-09-29T17:11:31.908145] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-09-29T17:11:31.915328] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:11:32.289136] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-29T17:11:32.348117] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-09-29T17:11:33.148120] [INFO ] [REMOTE ] AMN: Fetching primary data for 2024-12. [2025-09-29T17:11:33.202037] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-29T17:11:33.784171] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-29T17:11:33.795030] [INFO ] [REMOTE ] AME: Full fetch complete (69851 records). [2025-09-29T17:11:33.795230] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-09-29T17:11:33.961065] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-09-29T17:11:34.137472] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-29T17:11:34.273926] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-09-29T17:11:34.274015] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-09-29T17:11:34.274797] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-09-29T17:11:34.274872] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-09-29T17:11:34.276458] [DEBUG] [LOCAL ] AME: Trimmed 69851 records to 48537 (keeping 200 days of data) [2025-09-29T17:11:34.603623] [DEBUG] [LOCAL ] AME: Primary data saved (48537 records). [2025-09-29T17:11:34.603850] [INFO ] [MAIN ] AME: Full history saved. [2025-09-29T17:11:34.604000] [INFO ] [MAIN ] Update Progress: 100/2371 symbols completed. AME took 32.8s. Estimated remaining: 4h 21m 48s. Rate: 8.7 symbols/min [2025-09-29T17:11:34.753289] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-09-29T17:11:34.804001] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:11:34.865436] [DEBUG] [LOCAL ] AMPX: Loaded 52949 existing records from primary storage. [2025-09-29T17:11:34.865873] [INFO ] [MAIN ] AMPX: Loaded 52949 existing records. [2025-09-29T17:11:35.088422] [WARN ] [MAIN ] AMPX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:11:35.088920] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-09-29T17:11:35.089583] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-09-29T17:11:35.092029] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-29T17:11:35.101062] [DEBUG] [LOCAL ] AMPX: Deleted primary data file. [2025-09-29T17:11:35.102064] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-09-29T17:11:35.495557] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:11:35.522261] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-29T17:11:35.548088] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2024-12. [2025-09-29T17:11:36.324053] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-29T17:11:36.348077] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-09-29T17:11:37.148124] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-09-29T17:11:37.824180] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-29T17:11:37.948112] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-09-29T17:11:38.605931] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-29T17:11:38.748144] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-09-29T17:11:38.808408] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2024-12 (3.26 seconds). [2025-09-29T17:11:39.548124] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-09-29T17:11:39.610770] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-29T17:11:40.350993] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-09-29T17:11:40.356453] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-29T17:11:41.148078] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-09-29T17:11:41.452028] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-29T17:11:41.948098] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-09-29T17:11:42.048155] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-29T17:11:42.453944] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-29T17:11:42.748174] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-09-29T17:11:43.548096] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-09-29T17:11:43.751384] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-29T17:11:44.297251] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-29T17:11:44.348105] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-09-29T17:11:44.783291] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-29T17:11:45.148117] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-09-29T17:11:45.588334] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-29T17:11:45.948117] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-09-29T17:11:46.748121] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-09-29T17:11:47.051870] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-29T17:11:47.467121] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-29T17:11:47.548139] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-09-29T17:11:48.348101] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-09-29T17:11:48.579825] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-29T17:11:48.887204] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-29T17:11:49.148193] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-09-29T17:11:49.948122] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-09-29T17:11:50.314414] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-29T17:11:50.531980] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-29T17:11:50.748129] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-09-29T17:11:51.152174] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-29T17:11:51.548114] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-09-29T17:11:52.025515] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-29T17:11:52.348113] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-09-29T17:11:53.148090] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-09-29T17:11:53.459982] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-29T17:11:53.870196] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-29T17:11:53.948106] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-09-29T17:11:54.551924] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-29T17:11:54.748124] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-09-29T17:11:55.465627] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-29T17:11:55.548116] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-09-29T17:11:56.169134] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-29T17:11:56.348145] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-09-29T17:11:57.148124] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-09-29T17:11:57.892630] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-29T17:11:57.948088] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-09-29T17:11:58.150472] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-09-29T17:11:58.748115] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-09-29T17:11:58.773467] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-29T17:11:58.780493] [INFO ] [REMOTE ] AMP: Full fetch complete (47629 records). [2025-09-29T17:11:58.780610] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-09-29T17:11:59.175224] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-09-29T17:11:59.175347] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-09-29T17:11:59.175943] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-09-29T17:11:59.176008] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-09-29T17:11:59.177123] [DEBUG] [LOCAL ] AMP: Trimmed 47629 records to 32281 (keeping 200 days of data) [2025-09-29T17:11:59.392914] [DEBUG] [LOCAL ] AMP: Primary data saved (32281 records). [2025-09-29T17:11:59.393076] [INFO ] [MAIN ] AMP: Full history saved. [2025-09-29T17:11:59.393167] [INFO ] [MAIN ] Update Progress: 101/2371 symbols completed. AMP took 29.3s. Estimated remaining: 4h 28m 23s. Rate: 8.5 symbols/min [2025-09-29T17:11:59.550936] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-09-29T17:11:59.589368] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:11:59.622604] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-29T17:11:59.670557] [DEBUG] [LOCAL ] AMPY: Loaded 38164 existing records from primary storage. [2025-09-29T17:11:59.670924] [INFO ] [MAIN ] AMPY: Loaded 38164 existing records. [2025-09-29T17:11:59.860317] [WARN ] [MAIN ] AMPY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:11:59.860602] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-09-29T17:11:59.860686] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-09-29T17:11:59.861095] [DEBUG] [LOCAL ] AMPY: Deleted primary data file. [2025-09-29T17:11:59.861156] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-09-29T17:12:00.245835] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:12:00.349986] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2024-12. [2025-09-29T17:12:00.364188] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-29T17:12:00.376319] [INFO ] [REMOTE ] AMH: Full fetch complete (74785 records). [2025-09-29T17:12:00.376485] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-09-29T17:12:00.788544] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-09-29T17:12:00.788666] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-09-29T17:12:00.789481] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-09-29T17:12:00.789551] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-09-29T17:12:00.791305] [DEBUG] [LOCAL ] AMH: Trimmed 74785 records to 51699 (keeping 200 days of data) [2025-09-29T17:12:01.119550] [DEBUG] [LOCAL ] AMH: Primary data saved (51699 records). [2025-09-29T17:12:01.119754] [INFO ] [MAIN ] AMH: Full history saved. [2025-09-29T17:12:01.119861] [INFO ] [MAIN ] Update Progress: 102/2371 symbols completed. AMH took 33.9s. Estimated remaining: 4h 26m 16s. Rate: 8.5 symbols/min [2025-09-29T17:12:01.158794] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-09-29T17:12:01.307990] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:12:01.345217] [DEBUG] [LOCAL ] AMR: Loaded 29441 existing records from primary storage. [2025-09-29T17:12:01.345497] [INFO ] [MAIN ] AMR: Loaded 29441 existing records. [2025-09-29T17:12:01.538077] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:12:01.538929] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-09-29T17:12:01.539078] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-09-29T17:12:01.539590] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-09-29T17:12:01.539686] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-09-29T17:12:01.858192] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-29T17:12:01.956952] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-09-29T17:12:02.006465] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:12:02.045058] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-09-29T17:12:02.748096] [INFO ] [REMOTE ] AMR: Fetching primary data for 2024-12. [2025-09-29T17:12:02.986411] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-29T17:12:02.995754] [INFO ] [REMOTE ] AMN: Full fetch complete (60298 records). [2025-09-29T17:12:02.995924] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-09-29T17:12:03.385904] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-29T17:12:03.446119] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present. [2025-09-29T17:12:03.446215] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed. [2025-09-29T17:12:03.447001] [INFO ] [MAIN ] AMN: Fetched primary data is valid. [2025-09-29T17:12:03.447072] [DEBUG] [LOCAL ] AMN: Saving primary data. [2025-09-29T17:12:03.448533] [DEBUG] [LOCAL ] AMN: Trimmed 60298 records to 41796 (keeping 200 days of data) [2025-09-29T17:12:03.548624] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-09-29T17:12:03.718764] [DEBUG] [LOCAL ] AMN: Primary data saved (41796 records). [2025-09-29T17:12:03.718907] [INFO ] [MAIN ] AMN: Full history saved. [2025-09-29T17:12:03.720401] [INFO ] [MAIN ] Update Progress: 103/2371 symbols completed. AMN took 33.6s. Estimated remaining: 4h 24m 32s. Rate: 8.6 symbols/min [2025-09-29T17:12:03.896204] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:12:03.909903] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-29T17:12:03.953031] [DEBUG] [LOCAL ] AMRC: Loaded 38981 existing records from primary storage. [2025-09-29T17:12:03.953359] [INFO ] [MAIN ] AMRC: Loaded 38981 existing records. [2025-09-29T17:12:04.138061] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:12:04.138278] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-09-29T17:12:04.138389] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-09-29T17:12:04.138739] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-09-29T17:12:04.138801] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-09-29T17:12:04.357151] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-09-29T17:12:04.518869] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:12:05.148113] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2024-12. [2025-09-29T17:12:05.556706] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-29T17:12:05.735374] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-29T17:12:05.747155] [INFO ] [REMOTE ] AMPX: Full fetch complete (74626 records). [2025-09-29T17:12:05.747342] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-09-29T17:12:05.959795] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-09-29T17:12:06.202552] [DEBUG] [VALIDATOR ] AMPX: All expected trading days are present. [2025-09-29T17:12:06.202686] [DEBUG] [VALIDATOR ] AMPX: Primary data validation passed. [2025-09-29T17:12:06.203460] [INFO ] [MAIN ] AMPX: Fetched primary data is valid. [2025-09-29T17:12:06.203526] [DEBUG] [LOCAL ] AMPX: Saving primary data. [2025-09-29T17:12:06.205051] [DEBUG] [LOCAL ] AMPX: Trimmed 74626 records to 52224 (keeping 200 days of data) [2025-09-29T17:12:06.513051] [DEBUG] [LOCAL ] AMPX: Primary data saved (52224 records). [2025-09-29T17:12:06.513205] [INFO ] [MAIN ] AMPX: Full history saved. [2025-09-29T17:12:06.513294] [INFO ] [MAIN ] Update Progress: 104/2371 symbols completed. AMPX took 31.9s. Estimated remaining: 4h 22m 53s. Rate: 8.6 symbols/min [2025-09-29T17:12:06.639739] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-29T17:12:06.719598] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:12:06.719805] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-09-29T17:12:06.719864] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-09-29T17:12:06.719981] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-09-29T17:12:06.720025] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-29T17:12:06.720069] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-29T17:12:06.720103] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-09-29T17:12:06.753218] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-09-29T17:12:07.115020] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:12:07.492325] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-29T17:12:07.548076] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-09-29T17:12:07.670495] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-29T17:12:08.348131] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-09-29T17:12:09.105330] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-29T17:12:09.148100] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-09-29T17:12:09.204541] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-29T17:12:09.948129] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-09-29T17:12:10.644497] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-29T17:12:10.748172] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-09-29T17:12:11.389259] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-29T17:12:11.548140] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2024-12. [2025-09-29T17:12:11.761749] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T17:12:11.762117] [WARN ] [REMOTE ] AMRZ: No data returned for month 2024-12 [2025-09-29T17:12:11.762220] [FATAL] [REMOTE ] AMRZ: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T17:12:11.762281] [FATAL] [MAIN ] AMRZ: Failed to fetch primary data. [2025-09-29T17:12:11.762372] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T17:12:11.762477] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-29T17:12:11.762600] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-29T17:12:11.762710] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-09-29T17:12:11.762819] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-09-29T17:12:11.762926] [INFO ] [MAIN ] Update Progress: 105/2371 symbols completed. AMRZ took 5.2s. Estimated remaining: 4h 22m 9s. Rate: 8.6 symbols/min [2025-09-29T17:12:11.962377] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:12:12.021799] [DEBUG] [LOCAL ] AMT: Loaded 53212 existing records from primary storage. [2025-09-29T17:12:12.022156] [INFO ] [MAIN ] AMT: Loaded 53212 existing records. [2025-09-29T17:12:12.209812] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:12:12.210178] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-09-29T17:12:12.210270] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-09-29T17:12:12.212205] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-09-29T17:12:12.212272] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-09-29T17:12:12.359793] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-09-29T17:12:12.642636] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:12:12.645376] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-29T17:12:13.148130] [INFO ] [REMOTE ] AMT: Fetching primary data for 2024-12. [2025-09-29T17:12:13.793428] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-29T17:12:13.948133] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-09-29T17:12:14.748126] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-09-29T17:12:15.143168] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-29T17:12:15.548114] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-09-29T17:12:15.753917] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-29T17:12:16.252082] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-29T17:12:16.348129] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-09-29T17:12:17.148172] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-09-29T17:12:17.197857] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-29T17:12:17.845996] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-29T17:12:17.948165] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-09-29T17:12:18.748113] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-09-29T17:12:18.894173] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-29T17:12:19.548161] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-09-29T17:12:19.676814] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-29T17:12:20.099534] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-29T17:12:20.348141] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-09-29T17:12:20.769735] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-29T17:12:21.148174] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-09-29T17:12:21.940474] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-29T17:12:21.948110] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-09-29T17:12:21.948016] [INFO ] [REMOTE ] AMPY: Full fetch complete (50478 records). [2025-09-29T17:12:21.948390] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-09-29T17:12:21.950322] [FATAL] [VALIDATOR ] AMPY: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:12:21.950533] [FATAL] [MAIN ] AMPY: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:12:21.950619] [WARN ] [MAIN ] AMPY: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:12:21.950759] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-09-29T17:12:21.950856] [DEBUG] [LOCAL ] AMPY: No primary data file found to delete. [2025-09-29T17:12:21.950914] [INFO ] [LOCAL ] AMPY: Starting deletion of derivative data. [2025-09-29T17:12:21.951874] [DEBUG] [LOCAL ] AMPY: Deleted derivative data file. [2025-09-29T17:12:21.956444] [INFO ] [MAIN ] Update Progress: 106/2371 symbols completed. AMPY took 22.6s. Estimated remaining: 4h 23m 12s. Rate: 8.6 symbols/min [2025-09-29T17:12:22.144899] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:12:22.172954] [DEBUG] [LOCAL ] AMTB: Loaded 20599 existing records from primary storage. [2025-09-29T17:12:22.173436] [INFO ] [MAIN ] AMTB: Loaded 20599 existing records. [2025-09-29T17:12:22.361809] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:12:22.362267] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-09-29T17:12:22.362349] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-09-29T17:12:22.371446] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-09-29T17:12:22.385674] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-09-29T17:12:22.445276] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-29T17:12:22.752295] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-09-29T17:12:22.778723] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:12:23.548120] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2024-12. [2025-09-29T17:12:23.847586] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-29T17:12:24.075077] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-29T17:12:24.348109] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-09-29T17:12:24.457908] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-29T17:12:25.148142] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-09-29T17:12:25.948092] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-09-29T17:12:26.080689] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-29T17:12:26.379922] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-29T17:12:26.748124] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-09-29T17:12:27.218257] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-29T17:12:27.425036] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-29T17:12:27.548158] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-09-29T17:12:28.348127] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-09-29T17:12:28.555957] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-29T17:12:29.148149] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-09-29T17:12:29.905117] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-29T17:12:29.948139] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-09-29T17:12:30.283543] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-29T17:12:30.748157] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-09-29T17:12:31.297221] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-29T17:12:31.548166] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-09-29T17:12:31.723019] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-29T17:12:32.348152] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-09-29T17:12:33.002660] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-29T17:12:33.148138] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-09-29T17:12:33.817465] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-29T17:12:33.948124] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-09-29T17:12:34.049782] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-29T17:12:34.748112] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-09-29T17:12:35.548098] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-09-29T17:12:35.960482] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-29T17:12:36.068493] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-29T17:12:36.077495] [INFO ] [REMOTE ] AMRC: Full fetch complete (52807 records). [2025-09-29T17:12:36.077689] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-09-29T17:12:36.353400] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-09-29T17:12:36.513316] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-09-29T17:12:36.513420] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-09-29T17:12:36.514171] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-09-29T17:12:36.514244] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-09-29T17:12:36.515440] [DEBUG] [LOCAL ] AMRC: Trimmed 52807 records to 38202 (keeping 200 days of data) [2025-09-29T17:12:36.737807] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-29T17:12:36.772938] [DEBUG] [LOCAL ] AMRC: Primary data saved (38202 records). [2025-09-29T17:12:36.773090] [INFO ] [MAIN ] AMRC: Full history saved. [2025-09-29T17:12:36.775406] [INFO ] [MAIN ] Update Progress: 107/2371 symbols completed. AMRC took 33.1s. Estimated remaining: 4h 25m 51s. Rate: 8.5 symbols/min [2025-09-29T17:12:36.947406] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:12:36.955243] [DEBUG] [LOCAL ] AMTD: Loaded 3622 existing records from primary storage. [2025-09-29T17:12:36.955479] [INFO ] [MAIN ] AMTD: Loaded 3622 existing records. [2025-09-29T17:12:37.147770] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:12:37.148020] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-09-29T17:12:37.148285] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-09-29T17:12:37.148117] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-09-29T17:12:37.148709] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-09-29T17:12:37.149431] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-09-29T17:12:37.534814] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:12:37.948115] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-09-29T17:12:38.201029] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-29T17:12:38.634490] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-29T17:12:38.748121] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2024-12. [2025-09-29T17:12:38.996315] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-29T17:12:39.546865] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-29T17:12:39.549050] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-09-29T17:12:39.947762] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-29T17:12:40.348137] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-09-29T17:12:41.148137] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-09-29T17:12:41.950206] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-09-29T17:12:42.200315] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-29T17:12:42.502077] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-29T17:12:42.508232] [INFO ] [REMOTE ] AMR: Full fetch complete (39842 records). [2025-09-29T17:12:42.508384] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-09-29T17:12:42.753201] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-09-29T17:12:42.941847] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-09-29T17:12:42.941984] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-09-29T17:12:42.942674] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-09-29T17:12:42.942791] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-09-29T17:12:42.945199] [DEBUG] [LOCAL ] AMR: Trimmed 39842 records to 28957 (keeping 200 days of data) [2025-09-29T17:12:43.053814] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-29T17:12:43.066098] [INFO ] [REMOTE ] AMTB: Full fetch complete (30067 records). [2025-09-29T17:12:43.070771] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-09-29T17:12:43.346441] [DEBUG] [LOCAL ] AMR: Primary data saved (28957 records). [2025-09-29T17:12:43.360585] [INFO ] [MAIN ] AMR: Full history saved. [2025-09-29T17:12:43.394321] [INFO ] [MAIN ] Update Progress: 108/2371 symbols completed. AMR took 42.3s. Estimated remaining: 4h 25m 35s. Rate: 8.5 symbols/min [2025-09-29T17:12:43.548626] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-09-29T17:12:43.759469] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-09-29T17:12:43.765173] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-09-29T17:12:43.794363] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-09-29T17:12:43.847208] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-09-29T17:12:43.847085] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:12:43.848729] [DEBUG] [LOCAL ] AMTB: Trimmed 30067 records to 20251 (keeping 200 days of data) [2025-09-29T17:12:43.975904] [DEBUG] [LOCAL ] AMTB: Primary data saved (20251 records). [2025-09-29T17:12:43.976096] [INFO ] [MAIN ] AMTB: Full history saved. [2025-09-29T17:12:43.976200] [INFO ] [MAIN ] Update Progress: 109/2371 symbols completed. AMTB took 22.0s. Estimated remaining: 4h 23m 14s. Rate: 8.6 symbols/min [2025-09-29T17:12:44.195188] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:12:44.196845] [DEBUG] [LOCAL ] AMTM: Loaded 51451 existing records from primary storage. [2025-09-29T17:12:44.197502] [INFO ] [MAIN ] AMTM: Loaded 51451 existing records. [2025-09-29T17:12:44.284229] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-29T17:12:44.317011] [DEBUG] [LOCAL ] AMWL: Loaded 8830 existing records from primary storage. [2025-09-29T17:12:44.330591] [INFO ] [MAIN ] AMWL: Loaded 8830 existing records. [2025-09-29T17:12:44.353250] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-09-29T17:12:44.551514] [WARN ] [MAIN ] AMTM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:12:44.552117] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-09-29T17:12:44.558145] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-09-29T17:12:44.568685] [DEBUG] [LOCAL ] AMTM: Deleted primary data file. [2025-09-29T17:12:44.574056] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-09-29T17:12:44.703367] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:12:44.731546] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-09-29T17:12:44.742785] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-09-29T17:12:44.757092] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-09-29T17:12:44.798142] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-09-29T17:12:44.854140] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-29T17:12:45.164263] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-09-29T17:12:45.277389] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-09-29T17:12:45.329037] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:12:45.502009] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:12:45.700631] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-29T17:12:45.948157] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-09-29T17:12:46.748098] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2024-12. [2025-09-29T17:12:47.548082] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-09-29T17:12:47.708896] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-29T17:12:48.002568] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-29T17:12:48.013974] [INFO ] [REMOTE ] AMT: Full fetch complete (76015 records). [2025-09-29T17:12:48.014125] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-09-29T17:12:48.107229] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-29T17:12:48.353229] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-09-29T17:12:48.449299] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-09-29T17:12:48.449390] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-09-29T17:12:48.450217] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-09-29T17:12:48.450285] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-09-29T17:12:48.454735] [DEBUG] [LOCAL ] AMT: Trimmed 76015 records to 52433 (keeping 200 days of data) [2025-09-29T17:12:48.797626] [DEBUG] [LOCAL ] AMT: Primary data saved (52433 records). [2025-09-29T17:12:48.797822] [INFO ] [MAIN ] AMT: Full history saved. [2025-09-29T17:12:48.797935] [INFO ] [MAIN ] Update Progress: 110/2371 symbols completed. AMT took 37.0s. Estimated remaining: 4h 22m 22s. Rate: 8.6 symbols/min [2025-09-29T17:12:48.980849] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:12:49.048667] [DEBUG] [LOCAL ] AMX: Loaded 49855 existing records from primary storage. [2025-09-29T17:12:49.049144] [INFO ] [MAIN ] AMX: Loaded 49855 existing records. [2025-09-29T17:12:49.155584] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2024-12. [2025-09-29T17:12:49.247588] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:12:49.247866] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-09-29T17:12:49.247923] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-09-29T17:12:49.248736] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-09-29T17:12:49.248803] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-09-29T17:12:49.516551] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-29T17:12:49.658908] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:12:49.948111] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-09-29T17:12:50.748076] [INFO ] [REMOTE ] AMX: Fetching primary data for 2024-12. [2025-09-29T17:12:50.762530] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-29T17:12:51.073514] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-29T17:12:51.548119] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-09-29T17:12:52.136369] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-29T17:12:52.299883] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-29T17:12:52.348080] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-09-29T17:12:53.112386] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-29T17:12:53.148111] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-09-29T17:12:53.948111] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-09-29T17:12:54.028109] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-29T17:12:54.742872] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-29T17:12:54.748066] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-09-29T17:12:55.548121] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-09-29T17:12:56.348136] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-09-29T17:12:56.403850] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-29T17:12:56.867814] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-29T17:12:57.148088] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-09-29T17:12:57.338278] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-29T17:12:57.948088] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-09-29T17:12:57.976303] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-29T17:12:58.748117] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-09-29T17:12:59.396604] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-29T17:12:59.505195] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-29T17:12:59.548073] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-09-29T17:13:00.348112] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-09-29T17:13:01.149347] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-09-29T17:13:01.151214] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-29T17:13:01.306692] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-29T17:13:01.948146] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-09-29T17:13:01.968213] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-29T17:13:01.969948] [INFO ] [REMOTE ] AMTD: Full fetch complete (5568 records). [2025-09-29T17:13:01.970024] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-09-29T17:13:02.364048] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-09-29T17:13:02.364130] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-09-29T17:13:02.364332] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-09-29T17:13:02.364420] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-09-29T17:13:02.364993] [DEBUG] [LOCAL ] AMTD: Trimmed 5568 records to 3600 (keeping 200 days of data) [2025-09-29T17:13:02.387618] [DEBUG] [LOCAL ] AMTD: Primary data saved (3600 records). [2025-09-29T17:13:02.387775] [INFO ] [MAIN ] AMTD: Full history saved. [2025-09-29T17:13:02.387862] [INFO ] [MAIN ] Update Progress: 111/2371 symbols completed. AMTD took 25.6s. Estimated remaining: 4h 24m 30s. Rate: 8.5 symbols/min [2025-09-29T17:13:02.567953] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:13:02.613140] [DEBUG] [LOCAL ] AN: Loaded 32842 existing records from primary storage. [2025-09-29T17:13:02.613442] [INFO ] [MAIN ] AN: Loaded 32842 existing records. [2025-09-29T17:13:02.762231] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-09-29T17:13:02.810572] [WARN ] [MAIN ] AN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:13:02.810924] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-09-29T17:13:02.810996] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-09-29T17:13:02.811387] [DEBUG] [LOCAL ] AN: Deleted primary data file. [2025-09-29T17:13:02.811450] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-09-29T17:13:03.192190] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:13:03.548163] [INFO ] [REMOTE ] AN: Fetching primary data for 2024-12. [2025-09-29T17:13:04.085388] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-29T17:13:04.348142] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-09-29T17:13:04.648964] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-29T17:13:05.076685] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-29T17:13:05.123157] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-29T17:13:05.148118] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-09-29T17:13:05.948145] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-09-29T17:13:06.191780] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-29T17:13:06.748110] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-09-29T17:13:07.548076] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-09-29T17:13:07.668037] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-29T17:13:08.348086] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-09-29T17:13:08.495383] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-29T17:13:08.572364] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-29T17:13:08.575228] [INFO ] [REMOTE ] AMWL: Full fetch complete (14003 records). [2025-09-29T17:13:08.575341] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-09-29T17:13:08.960546] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-09-29T17:13:08.960676] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-09-29T17:13:08.960943] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-09-29T17:13:08.961020] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-09-29T17:13:08.961518] [DEBUG] [LOCAL ] AMWL: Trimmed 14003 records to 8685 (keeping 200 days of data) [2025-09-29T17:13:09.013739] [DEBUG] [LOCAL ] AMWL: Primary data saved (8685 records). [2025-09-29T17:13:09.013895] [INFO ] [MAIN ] AMWL: Full history saved. [2025-09-29T17:13:09.014012] [INFO ] [MAIN ] Update Progress: 112/2371 symbols completed. AMWL took 25.0s. Estimated remaining: 4h 24m 15s. Rate: 8.5 symbols/min [2025-09-29T17:13:09.153292] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-09-29T17:13:09.204191] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:13:09.292195] [DEBUG] [LOCAL ] ANET: Loaded 54546 existing records from primary storage. [2025-09-29T17:13:09.292760] [INFO ] [MAIN ] ANET: Loaded 54546 existing records. [2025-09-29T17:13:09.491194] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:13:09.491407] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-09-29T17:13:09.491480] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-09-29T17:13:09.492443] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-09-29T17:13:09.492530] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-09-29T17:13:09.880564] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:13:09.918391] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-29T17:13:09.948108] [INFO ] [REMOTE ] ANET: Fetching primary data for 2024-12. [2025-09-29T17:13:10.748074] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-09-29T17:13:10.867132] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-29T17:13:11.548120] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-09-29T17:13:12.355902] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-09-29T17:13:12.377431] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-09-29T17:13:12.434503] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-29T17:13:12.884228] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-29T17:13:13.148127] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-09-29T17:13:13.948161] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-09-29T17:13:14.168999] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-29T17:13:14.258802] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-29T17:13:14.748137] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-09-29T17:13:15.548115] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-09-29T17:13:16.019052] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-29T17:13:16.348086] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-09-29T17:13:16.413484] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-29T17:13:17.148117] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-09-29T17:13:17.216702] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-29T17:13:17.948156] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-09-29T17:13:18.748089] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-09-29T17:13:18.784628] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (2.44 seconds). [2025-09-29T17:13:18.819700] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-29T17:13:19.548077] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-09-29T17:13:19.771995] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-29T17:13:19.782226] [INFO ] [REMOTE ] AMX: Full fetch complete (70727 records). [2025-09-29T17:13:19.782422] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-09-29T17:13:20.211846] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-09-29T17:13:20.212033] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-09-29T17:13:20.212973] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-09-29T17:13:20.213043] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-09-29T17:13:20.215117] [DEBUG] [LOCAL ] AMX: Trimmed 70727 records to 49128 (keeping 200 days of data) [2025-09-29T17:13:20.348461] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-09-29T17:13:20.487310] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-29T17:13:20.589566] [DEBUG] [LOCAL ] AMX: Primary data saved (49128 records). [2025-09-29T17:13:20.589758] [INFO ] [MAIN ] AMX: Full history saved. [2025-09-29T17:13:20.589876] [INFO ] [MAIN ] Update Progress: 113/2371 symbols completed. AMX took 31.8s. Estimated remaining: 4h 25m 39s. Rate: 8.5 symbols/min [2025-09-29T17:13:20.770682] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:13:20.843550] [DEBUG] [LOCAL ] ANF: Loaded 52967 existing records from primary storage. [2025-09-29T17:13:20.844163] [INFO ] [MAIN ] ANF: Loaded 52967 existing records. [2025-09-29T17:13:21.035388] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-29T17:13:21.071495] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:13:21.072226] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-09-29T17:13:21.072866] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-09-29T17:13:21.073543] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-09-29T17:13:21.073605] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-09-29T17:13:21.153266] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-09-29T17:13:21.454418] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:13:21.948140] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-09-29T17:13:22.479490] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-29T17:13:22.748090] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-09-29T17:13:22.797117] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-09-29T17:13:23.289457] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-29T17:13:23.548115] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-09-29T17:13:24.163534] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-29T17:13:24.348131] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-09-29T17:13:25.148171] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-09-29T17:13:25.541025] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-29T17:13:25.948116] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-09-29T17:13:26.034861] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-09-29T17:13:26.748117] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-09-29T17:13:27.051740] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-29T17:13:27.062518] [INFO ] [REMOTE ] AMTM: Full fetch complete (73951 records). [2025-09-29T17:13:27.062754] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-09-29T17:13:27.483335] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present. [2025-09-29T17:13:27.483465] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed. [2025-09-29T17:13:27.484345] [INFO ] [MAIN ] AMTM: Fetched primary data is valid. [2025-09-29T17:13:27.484430] [DEBUG] [LOCAL ] AMTM: Saving primary data. [2025-09-29T17:13:27.502625] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-29T17:13:27.509876] [DEBUG] [LOCAL ] AMTM: Trimmed 73951 records to 50658 (keeping 200 days of data) [2025-09-29T17:13:27.510082] [INFO ] [REMOTE ] AN: Full fetch complete (47599 records). [2025-09-29T17:13:27.510725] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-09-29T17:13:27.580381] [INFO ] [REMOTE ] ANF: Fetching primary data for 2024-12. [2025-09-29T17:13:28.070040] [DEBUG] [VALIDATOR ] AN: All expected trading days are present. [2025-09-29T17:13:28.070480] [DEBUG] [VALIDATOR ] AN: Primary data validation passed. [2025-09-29T17:13:28.071067] [INFO ] [MAIN ] AN: Fetched primary data is valid. [2025-09-29T17:13:28.071503] [DEBUG] [LOCAL ] AN: Saving primary data. [2025-09-29T17:13:28.075537] [DEBUG] [LOCAL ] AN: Trimmed 47599 records to 32121 (keeping 200 days of data) [2025-09-29T17:13:28.466262] [DEBUG] [LOCAL ] AMTM: Primary data saved (50658 records). [2025-09-29T17:13:28.467303] [INFO ] [MAIN ] AMTM: Full history saved. [2025-09-29T17:13:28.467480] [INFO ] [MAIN ] Update Progress: 114/2371 symbols completed. AMTM took 45.0s. Estimated remaining: 4h 25m 48s. Rate: 8.5 symbols/min [2025-09-29T17:13:28.639586] [DEBUG] [LOCAL ] AN: Primary data saved (32121 records). [2025-09-29T17:13:28.646207] [INFO ] [MAIN ] AN: Full history saved. [2025-09-29T17:13:28.670497] [INFO ] [MAIN ] Update Progress: 115/2371 symbols completed. AN took 26.3s. Estimated remaining: 4h 23m 27s. Rate: 8.6 symbols/min [2025-09-29T17:13:28.676597] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:13:28.724832] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-09-29T17:13:28.765629] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-09-29T17:13:28.790713] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-09-29T17:13:28.791119] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-29T17:13:28.796742] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-29T17:13:28.796841] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-09-29T17:13:28.949553] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:13:29.138581] [DEBUG] [LOCAL ] ANRO: Loaded 19387 existing records from primary storage. [2025-09-29T17:13:29.161461] [INFO ] [MAIN ] ANRO: Loaded 19387 existing records. [2025-09-29T17:13:29.432575] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:13:29.433507] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2024-12. [2025-09-29T17:13:29.522358] [WARN ] [MAIN ] ANRO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:13:29.523626] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-09-29T17:13:29.523802] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-09-29T17:13:29.524221] [DEBUG] [LOCAL ] ANRO: Deleted primary data file. [2025-09-29T17:13:29.524283] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-09-29T17:13:29.652447] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (2.90 seconds). [2025-09-29T17:13:29.690868] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-09-29T17:13:29.719714] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T17:13:29.773298] [WARN ] [REMOTE ] ANGX: No data returned for month 2024-12 [2025-09-29T17:13:29.791353] [FATAL] [REMOTE ] ANGX: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T17:13:29.825710] [FATAL] [MAIN ] ANGX: Failed to fetch primary data. [2025-09-29T17:13:29.848157] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T17:13:29.871149] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-29T17:13:29.891800] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-29T17:13:29.892056] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-09-29T17:13:29.892148] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-09-29T17:13:29.892561] [INFO ] [MAIN ] Update Progress: 116/2371 symbols completed. ANGX took 1.4s. Estimated remaining: 4h 21m 27s. Rate: 8.6 symbols/min [2025-09-29T17:13:30.060941] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:13:30.071207] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2024-12. [2025-09-29T17:13:30.128682] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2024-12 (2.55 seconds). [2025-09-29T17:13:30.214376] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:13:30.245065] [DEBUG] [LOCAL ] ANVS: Loaded 23508 existing records from primary storage. [2025-09-29T17:13:30.245349] [INFO ] [MAIN ] ANVS: Loaded 23508 existing records. [2025-09-29T17:13:30.454945] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:13:30.455264] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-09-29T17:13:30.455319] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-09-29T17:13:30.456371] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-09-29T17:13:30.456432] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-09-29T17:13:30.753380] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-09-29T17:13:30.863311] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:13:31.548155] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2024-12. [2025-09-29T17:13:31.648116] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-29T17:13:31.932789] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-29T17:13:32.348091] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-09-29T17:13:32.674529] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-29T17:13:33.060791] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-29T17:13:33.148139] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-09-29T17:13:33.948158] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-09-29T17:13:34.755598] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-09-29T17:13:34.762001] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-09-29T17:13:34.874502] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-29T17:13:34.988522] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-29T17:13:35.548102] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-09-29T17:13:35.746221] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-29T17:13:36.348106] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-09-29T17:13:37.148118] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-09-29T17:13:37.862531] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-29T17:13:37.953304] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-09-29T17:13:37.975537] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-09-29T17:13:38.748122] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-09-29T17:13:38.942054] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-29T17:13:38.973870] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-29T17:13:39.548138] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-09-29T17:13:40.348098] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-09-29T17:13:40.803093] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-29T17:13:41.148092] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-09-29T17:13:41.338766] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (2.59 seconds). [2025-09-29T17:13:41.350706] [INFO ] [REMOTE ] ANET: Full fetch complete (77859 records). [2025-09-29T17:13:41.350852] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-09-29T17:13:41.662334] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-29T17:13:41.811712] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-09-29T17:13:41.811824] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-09-29T17:13:41.812767] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-09-29T17:13:41.812860] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-09-29T17:13:41.814496] [DEBUG] [LOCAL ] ANET: Trimmed 77859 records to 53766 (keeping 200 days of data) [2025-09-29T17:13:41.948132] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-09-29T17:13:42.173277] [DEBUG] [LOCAL ] ANET: Primary data saved (53766 records). [2025-09-29T17:13:42.173452] [INFO ] [MAIN ] ANET: Full history saved. [2025-09-29T17:13:42.173556] [INFO ] [MAIN ] Update Progress: 117/2371 symbols completed. ANET took 33.2s. Estimated remaining: 4h 23m 3s. Rate: 8.6 symbols/min [2025-09-29T17:13:42.455990] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-29T17:13:42.748104] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-09-29T17:13:43.459036] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-29T17:13:43.548120] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-09-29T17:13:43.858207] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-29T17:13:44.348131] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-09-29T17:13:44.749582] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-29T17:13:45.148169] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-09-29T17:13:45.948126] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-09-29T17:13:46.422391] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-29T17:13:46.748105] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-09-29T17:13:46.876180] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-09-29T17:13:47.179971] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-29T17:13:47.548077] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-09-29T17:13:47.900548] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-29T17:13:48.348106] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-09-29T17:13:48.420936] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-29T17:13:49.148113] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-09-29T17:13:49.948093] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-09-29T17:13:50.026543] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-29T17:13:50.029488] [INFO ] [REMOTE ] ANRO: Full fetch complete (29920 records). [2025-09-29T17:13:50.029577] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-09-29T17:13:50.458250] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-29T17:13:50.456638] [DEBUG] [VALIDATOR ] ANRO: All expected trading days are present. [2025-09-29T17:13:50.468214] [DEBUG] [VALIDATOR ] ANRO: Primary data validation passed. [2025-09-29T17:13:50.468747] [INFO ] [MAIN ] ANRO: Fetched primary data is valid. [2025-09-29T17:13:50.468922] [DEBUG] [LOCAL ] ANRO: Saving primary data. [2025-09-29T17:13:50.470267] [DEBUG] [LOCAL ] ANRO: Trimmed 29920 records to 18969 (keeping 200 days of data) [2025-09-29T17:13:50.585879] [DEBUG] [LOCAL ] ANRO: Primary data saved (18969 records). [2025-09-29T17:13:50.586028] [INFO ] [MAIN ] ANRO: Full history saved. [2025-09-29T17:13:50.586116] [INFO ] [MAIN ] Update Progress: 118/2371 symbols completed. ANRO took 21.9s. Estimated remaining: 4h 23m 23s. Rate: 8.6 symbols/min [2025-09-29T17:13:50.748098] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-09-29T17:13:51.093859] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-29T17:13:51.548176] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-09-29T17:13:52.633389] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-29T17:13:52.646179] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-09-29T17:13:52.765956] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-29T17:13:53.148275] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-09-29T17:13:54.140689] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-29T17:13:54.146176] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-09-29T17:13:54.566626] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-29T17:13:54.748114] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-09-29T17:13:55.290806] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-29T17:13:55.295323] [INFO ] [REMOTE ] ANVS: Full fetch complete (36481 records). [2025-09-29T17:13:55.295442] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-09-29T17:13:55.695863] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-09-29T17:13:55.695975] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-09-29T17:13:55.696506] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-09-29T17:13:55.696568] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-09-29T17:13:55.697595] [DEBUG] [LOCAL ] ANVS: Trimmed 36481 records to 23113 (keeping 200 days of data) [2025-09-29T17:13:55.827413] [DEBUG] [LOCAL ] ANVS: Primary data saved (23113 records). [2025-09-29T17:13:55.827547] [INFO ] [MAIN ] ANVS: Full history saved. [2025-09-29T17:13:55.827635] [INFO ] [MAIN ] Update Progress: 119/2371 symbols completed. ANVS took 25.9s. Estimated remaining: 4h 22m 42s. Rate: 8.6 symbols/min [2025-09-29T17:13:56.754374] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-29T17:13:56.765090] [INFO ] [REMOTE ] ANF: Full fetch complete (75627 records). [2025-09-29T17:13:56.765253] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-09-29T17:13:57.182424] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-09-29T17:13:57.182540] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-09-29T17:13:57.183368] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-09-29T17:13:57.183438] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-09-29T17:13:57.185150] [DEBUG] [LOCAL ] ANF: Trimmed 75627 records to 52173 (keeping 200 days of data) [2025-09-29T17:13:57.506059] [DEBUG] [LOCAL ] ANF: Primary data saved (52173 records). [2025-09-29T17:13:57.506197] [INFO ] [MAIN ] ANF: Full history saved. [2025-09-29T17:13:57.506291] [INFO ] [MAIN ] Update Progress: 120/2371 symbols completed. ANF took 36.9s. Estimated remaining: 4h 20m 55s. Rate: 8.6 symbols/min [2025-09-29T17:13:58.048302] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:13:58.130828] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-09-29T17:13:58.155995] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-09-29T17:13:58.221773] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-09-29T17:13:58.296486] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:13:58.300818] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:13:58.296607] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-29T17:13:58.305293] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:13:58.305928] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-29T17:13:58.306160] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-09-29T17:13:58.462720] [DEBUG] [LOCAL ] AOMR: Loaded 16852 existing records from primary storage. [2025-09-29T17:13:58.463892] [INFO ] [MAIN ] AOMR: Loaded 16852 existing records. [2025-09-29T17:13:58.555983] [DEBUG] [LOCAL ] AOD: Loaded 30414 existing records from primary storage. [2025-09-29T17:13:58.647971] [INFO ] [MAIN ] AOD: Loaded 30414 existing records. [2025-09-29T17:13:58.897558] [DEBUG] [LOCAL ] AON: Loaded 46248 existing records from primary storage. [2025-09-29T17:13:58.981628] [INFO ] [MAIN ] AON: Loaded 46248 existing records. [2025-09-29T17:13:59.242050] [WARN ] [MAIN ] AOMR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:13:59.351559] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:13:59.363054] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-09-29T17:13:59.372487] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-09-29T17:13:59.377471] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2024-12. [2025-09-29T17:13:59.377187] [WARN ] [MAIN ] AOD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:13:59.390153] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-09-29T17:13:59.398147] [DEBUG] [LOCAL ] AOMR: Deleted primary data file. [2025-09-29T17:13:59.402270] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-09-29T17:13:59.402062] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-09-29T17:13:59.407584] [DEBUG] [LOCAL ] AOD: Deleted primary data file. [2025-09-29T17:13:59.451242] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-09-29T17:13:59.617419] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T17:13:59.682069] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:13:59.682234] [WARN ] [REMOTE ] AOMD: No data returned for month 2024-12 [2025-09-29T17:13:59.703664] [FATAL] [REMOTE ] AOMD: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T17:13:59.738106] [FATAL] [MAIN ] AOMD: Failed to fetch primary data. [2025-09-29T17:13:59.732762] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-09-29T17:13:59.778350] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T17:13:59.844229] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-09-29T17:13:59.844160] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-29T17:13:59.932377] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-09-29T17:13:59.937965] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-09-29T17:13:59.932546] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-29T17:14:00.001261] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-09-29T17:14:00.065745] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-09-29T17:14:00.112627] [INFO ] [MAIN ] Update Progress: 121/2371 symbols completed. AOMD took 2.6s. Estimated remaining: 4h 19m 28s. Rate: 8.7 symbols/min [2025-09-29T17:14:00.386127] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:14:00.452601] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2024-12. [2025-09-29T17:14:00.747402] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:14:00.782080] [INFO ] [REMOTE ] AOD: Fetching primary data for 2024-12. [2025-09-29T17:14:00.885140] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:14:00.974216] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:14:00.974680] [INFO ] [REMOTE ] AON: Fetching primary data for 2024-12. [2025-09-29T17:14:00.999123] [DEBUG] [LOCAL ] AORT: Loaded 30087 existing records from primary storage. [2025-09-29T17:14:00.999396] [INFO ] [MAIN ] AORT: Loaded 30087 existing records. [2025-09-29T17:14:01.200886] [WARN ] [MAIN ] AORT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:14:01.201186] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-09-29T17:14:01.201290] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-09-29T17:14:01.201795] [DEBUG] [LOCAL ] AORT: Deleted primary data file. [2025-09-29T17:14:01.201900] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-09-29T17:14:01.602505] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:14:01.602999] [INFO ] [REMOTE ] AORT: Fetching primary data for 2024-12. [2025-09-29T17:14:01.679515] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-29T17:14:01.684783] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-09-29T17:14:02.382905] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-29T17:14:02.389521] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-09-29T17:14:02.539927] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-29T17:14:02.543017] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-09-29T17:14:02.771458] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-29T17:14:02.781232] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-09-29T17:14:02.970030] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-29T17:14:02.975159] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-09-29T17:14:03.609058] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-29T17:14:03.614412] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-09-29T17:14:03.706230] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-29T17:14:04.092263] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-29T17:14:04.277238] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-29T17:14:04.325885] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-29T17:14:04.348079] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-09-29T17:14:05.148123] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-09-29T17:14:05.944002] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-29T17:14:05.952196] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-09-29T17:14:06.375628] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-29T17:14:06.748165] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-09-29T17:14:07.047243] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-29T17:14:07.548138] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-09-29T17:14:08.348103] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-09-29T17:14:08.415465] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-29T17:14:09.148151] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-09-29T17:14:09.320407] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-29T17:14:09.452626] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-29T17:14:09.948131] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-09-29T17:14:10.438878] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-29T17:14:10.748107] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-09-29T17:14:11.000454] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-29T17:14:11.548136] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-09-29T17:14:11.900141] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-29T17:14:12.348128] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-09-29T17:14:13.148101] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-09-29T17:14:13.192311] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-29T17:14:13.218208] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-29T17:14:13.948146] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-09-29T17:14:14.748127] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-09-29T17:14:14.802622] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-29T17:14:15.020130] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-29T17:14:15.548138] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-09-29T17:14:15.705729] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-29T17:14:16.348136] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-09-29T17:14:16.878880] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-29T17:14:17.148113] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-09-29T17:14:17.253700] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-29T17:14:17.948113] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-09-29T17:14:18.621999] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-29T17:14:18.748092] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-09-29T17:14:19.067599] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-29T17:14:19.548163] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-09-29T17:14:19.884377] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-29T17:14:20.348117] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-09-29T17:14:20.891334] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-29T17:14:21.148111] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-09-29T17:14:21.618962] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-29T17:14:21.948130] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-09-29T17:14:22.447821] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-29T17:14:22.748115] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-09-29T17:14:23.548139] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-09-29T17:14:23.600028] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-29T17:14:23.964269] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-29T17:14:23.972182] [INFO ] [REMOTE ] AOD: Full fetch complete (44136 records). [2025-09-29T17:14:23.972345] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-09-29T17:14:24.363236] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-09-29T17:14:24.383702] [DEBUG] [VALIDATOR ] AOD: All expected trading days are present. [2025-09-29T17:14:24.383807] [DEBUG] [VALIDATOR ] AOD: Primary data validation passed. [2025-09-29T17:14:24.384338] [INFO ] [MAIN ] AOD: Fetched primary data is valid. [2025-09-29T17:14:24.384385] [DEBUG] [LOCAL ] AOD: Saving primary data. [2025-09-29T17:14:24.385732] [DEBUG] [LOCAL ] AOD: Trimmed 44136 records to 30055 (keeping 200 days of data) [2025-09-29T17:14:24.578974] [DEBUG] [LOCAL ] AOD: Primary data saved (30055 records). [2025-09-29T17:14:24.579119] [INFO ] [MAIN ] AOD: Full history saved. [2025-09-29T17:14:24.579215] [INFO ] [MAIN ] Update Progress: 122/2371 symbols completed. AOD took 27.1s. Estimated remaining: 4h 24m 44s. Rate: 8.5 symbols/min [2025-09-29T17:14:24.762955] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:14:24.817273] [DEBUG] [LOCAL ] AOS: Loaded 49769 existing records from primary storage. [2025-09-29T17:14:24.817799] [INFO ] [MAIN ] AOS: Loaded 49769 existing records. [2025-09-29T17:14:25.008069] [WARN ] [MAIN ] AOS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:14:25.008863] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-09-29T17:14:25.008937] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-09-29T17:14:25.009455] [DEBUG] [LOCAL ] AOS: Deleted primary data file. [2025-09-29T17:14:25.009521] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-09-29T17:14:25.133631] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-29T17:14:25.148115] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-09-29T17:14:25.461061] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:14:25.948088] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-09-29T17:14:26.233602] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-29T17:14:26.307351] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-29T17:14:26.311710] [INFO ] [REMOTE ] AOMR: Full fetch complete (23123 records). [2025-09-29T17:14:26.311797] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-09-29T17:14:26.745377] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present. [2025-09-29T17:14:26.745478] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed. [2025-09-29T17:14:26.745854] [INFO ] [MAIN ] AOMR: Fetched primary data is valid. [2025-09-29T17:14:26.745922] [DEBUG] [LOCAL ] AOMR: Saving primary data. [2025-09-29T17:14:26.746823] [DEBUG] [LOCAL ] AOMR: Trimmed 23123 records to 16553 (keeping 200 days of data) [2025-09-29T17:14:26.748106] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-09-29T17:14:26.855697] [DEBUG] [LOCAL ] AOMR: Primary data saved (16553 records). [2025-09-29T17:14:26.855856] [INFO ] [MAIN ] AOMR: Full history saved. [2025-09-29T17:14:26.855956] [INFO ] [MAIN ] Update Progress: 123/2371 symbols completed. AOMR took 29.3s. Estimated remaining: 4h 23m 10s. Rate: 8.5 symbols/min [2025-09-29T17:14:27.050212] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:14:27.061574] [DEBUG] [LOCAL ] AP: Loaded 7236 existing records from primary storage. [2025-09-29T17:14:27.061853] [INFO ] [MAIN ] AP: Loaded 7236 existing records. [2025-09-29T17:14:27.264899] [WARN ] [MAIN ] AP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:14:27.265126] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-09-29T17:14:27.265339] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-09-29T17:14:27.265780] [DEBUG] [LOCAL ] AP: Deleted primary data file. [2025-09-29T17:14:27.265875] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-09-29T17:14:27.462951] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-29T17:14:27.501067] [INFO ] [REMOTE ] AORT: Full fetch complete (41748 records). [2025-09-29T17:14:27.554752] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-09-29T17:14:27.554558] [INFO ] [REMOTE ] AOS: Fetching primary data for 2024-12. [2025-09-29T17:14:27.847789] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:14:28.117558] [DEBUG] [VALIDATOR ] AORT: All expected trading days are present. [2025-09-29T17:14:28.117660] [DEBUG] [VALIDATOR ] AORT: Primary data validation passed. [2025-09-29T17:14:28.118129] [INFO ] [MAIN ] AORT: Fetched primary data is valid. [2025-09-29T17:14:28.118173] [DEBUG] [LOCAL ] AORT: Saving primary data. [2025-09-29T17:14:28.119149] [DEBUG] [LOCAL ] AORT: Trimmed 41748 records to 29482 (keeping 200 days of data) [2025-09-29T17:14:28.299314] [DEBUG] [LOCAL ] AORT: Primary data saved (29482 records). [2025-09-29T17:14:28.299670] [INFO ] [MAIN ] AORT: Full history saved. [2025-09-29T17:14:28.299781] [INFO ] [MAIN ] Update Progress: 124/2371 symbols completed. AORT took 28.1s. Estimated remaining: 4h 21m 21s. Rate: 8.6 symbols/min [2025-09-29T17:14:28.357475] [INFO ] [REMOTE ] AP: Fetching primary data for 2024-12. [2025-09-29T17:14:28.494417] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:14:28.521633] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-29T17:14:28.567246] [DEBUG] [LOCAL ] APAM: Loaded 36969 existing records from primary storage. [2025-09-29T17:14:28.567662] [INFO ] [MAIN ] APAM: Loaded 36969 existing records. [2025-09-29T17:14:28.767428] [WARN ] [MAIN ] APAM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:14:28.767669] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-09-29T17:14:28.767748] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-09-29T17:14:28.768334] [DEBUG] [LOCAL ] APAM: Deleted primary data file. [2025-09-29T17:14:28.768395] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-09-29T17:14:29.143728] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-29T17:14:29.164242] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-09-29T17:14:29.169726] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:14:29.288230] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-29T17:14:29.948131] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-09-29T17:14:30.748116] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-09-29T17:14:30.836801] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-29T17:14:30.845993] [INFO ] [REMOTE ] AON: Full fetch complete (64865 records). [2025-09-29T17:14:30.846113] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-09-29T17:14:31.299693] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-09-29T17:14:31.299800] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-09-29T17:14:31.300551] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-09-29T17:14:31.300613] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-09-29T17:14:31.302183] [DEBUG] [LOCAL ] AON: Trimmed 64865 records to 45463 (keeping 200 days of data) [2025-09-29T17:14:31.373371] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-29T17:14:31.548705] [INFO ] [REMOTE ] APAM: Fetching primary data for 2024-12. [2025-09-29T17:14:31.611415] [DEBUG] [LOCAL ] AON: Primary data saved (45463 records). [2025-09-29T17:14:31.611598] [INFO ] [MAIN ] AON: Full history saved. [2025-09-29T17:14:31.611752] [INFO ] [MAIN ] Update Progress: 125/2371 symbols completed. AON took 34.1s. Estimated remaining: 4h 20m 9s. Rate: 8.6 symbols/min [2025-09-29T17:14:31.772161] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-29T17:14:31.864123] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:14:31.918343] [DEBUG] [LOCAL ] APD: Loaded 46087 existing records from primary storage. [2025-09-29T17:14:31.918733] [INFO ] [MAIN ] APD: Loaded 46087 existing records. [2025-09-29T17:14:32.121316] [WARN ] [MAIN ] APD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:14:32.121788] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-09-29T17:14:32.121860] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-09-29T17:14:32.122507] [DEBUG] [LOCAL ] APD: Deleted primary data file. [2025-09-29T17:14:32.122566] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-09-29T17:14:32.358418] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-09-29T17:14:32.525253] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:14:32.917817] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-29T17:14:33.148139] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-09-29T17:14:33.499364] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-29T17:14:33.817591] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-29T17:14:33.948104] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-09-29T17:14:34.748101] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-09-29T17:14:35.302778] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-29T17:14:35.548127] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-09-29T17:14:35.703510] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-29T17:14:36.348137] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-09-29T17:14:36.484188] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-29T17:14:36.933345] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-29T17:14:37.148142] [INFO ] [REMOTE ] APD: Fetching primary data for 2024-12. [2025-09-29T17:14:37.948137] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-09-29T17:14:38.753179] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-09-29T17:14:38.766360] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-29T17:14:39.548126] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-09-29T17:14:39.728455] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-29T17:14:39.805746] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-29T17:14:40.348119] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-09-29T17:14:40.907488] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-29T17:14:41.148129] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-09-29T17:14:41.948127] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-09-29T17:14:42.075398] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-29T17:14:42.748155] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-09-29T17:14:42.817595] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-29T17:14:43.128855] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-29T17:14:43.548136] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-09-29T17:14:44.348272] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-09-29T17:14:44.459901] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-29T17:14:45.123935] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-29T17:14:45.148109] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-09-29T17:14:45.204899] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-29T17:14:45.948194] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-09-29T17:14:46.602483] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-29T17:14:46.667490] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-29T17:14:46.748123] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-09-29T17:14:47.548154] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-09-29T17:14:47.565519] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-29T17:14:47.567735] [INFO ] [REMOTE ] AP: Full fetch complete (8910 records). [2025-09-29T17:14:47.567930] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-09-29T17:14:47.979555] [DEBUG] [VALIDATOR ] AP: All expected trading days are present. [2025-09-29T17:14:47.979639] [DEBUG] [VALIDATOR ] AP: Primary data validation passed. [2025-09-29T17:14:47.979924] [INFO ] [MAIN ] AP: Fetched primary data is valid. [2025-09-29T17:14:47.979971] [DEBUG] [LOCAL ] AP: Saving primary data. [2025-09-29T17:14:47.980915] [DEBUG] [LOCAL ] AP: Trimmed 8910 records to 7191 (keeping 200 days of data) [2025-09-29T17:14:48.025554] [DEBUG] [LOCAL ] AP: Primary data saved (7191 records). [2025-09-29T17:14:48.025716] [INFO ] [MAIN ] AP: Full history saved. [2025-09-29T17:14:48.025835] [INFO ] [MAIN ] Update Progress: 126/2371 symbols completed. AP took 21.2s. Estimated remaining: 4h 22m 50s. Rate: 8.5 symbols/min [2025-09-29T17:14:48.206979] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:14:48.274596] [DEBUG] [LOCAL ] APG: Loaded 50931 existing records from primary storage. [2025-09-29T17:14:48.274954] [INFO ] [MAIN ] APG: Loaded 50931 existing records. [2025-09-29T17:14:48.353235] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-09-29T17:14:48.476438] [WARN ] [MAIN ] APG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:14:48.476674] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-09-29T17:14:48.476735] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-09-29T17:14:48.477417] [DEBUG] [LOCAL ] APG: Deleted primary data file. [2025-09-29T17:14:48.477478] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-09-29T17:14:48.857787] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:14:49.148087] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-09-29T17:14:49.245728] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-29T17:14:49.955749] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-09-29T17:14:49.976207] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-29T17:14:50.579617] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-29T17:14:50.748151] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-09-29T17:14:51.548114] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-09-29T17:14:51.689980] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-29T17:14:51.997583] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-29T17:14:52.348107] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-09-29T17:14:53.129763] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-29T17:14:53.148076] [INFO ] [REMOTE ] APG: Fetching primary data for 2024-12. [2025-09-29T17:14:53.948088] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-09-29T17:14:54.137634] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-29T17:14:54.748098] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-09-29T17:14:54.789591] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-29T17:14:55.297580] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-29T17:14:55.307477] [INFO ] [REMOTE ] AOS: Full fetch complete (70582 records). [2025-09-29T17:14:55.307630] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-09-29T17:14:55.558180] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-09-29T17:14:55.734729] [DEBUG] [VALIDATOR ] AOS: All expected trading days are present. [2025-09-29T17:14:55.734829] [DEBUG] [VALIDATOR ] AOS: Primary data validation passed. [2025-09-29T17:14:55.735626] [INFO ] [MAIN ] AOS: Fetched primary data is valid. [2025-09-29T17:14:55.735709] [DEBUG] [LOCAL ] AOS: Saving primary data. [2025-09-29T17:14:55.737122] [DEBUG] [LOCAL ] AOS: Trimmed 70582 records to 48890 (keeping 200 days of data) [2025-09-29T17:14:56.053817] [DEBUG] [LOCAL ] AOS: Primary data saved (48890 records). [2025-09-29T17:14:56.053984] [INFO ] [MAIN ] AOS: Full history saved. [2025-09-29T17:14:56.054082] [INFO ] [MAIN ] Update Progress: 127/2371 symbols completed. AOS took 31.5s. Estimated remaining: 4h 23m 1s. Rate: 8.5 symbols/min [2025-09-29T17:14:56.231988] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:14:56.296252] [DEBUG] [LOCAL ] APH: Loaded 54471 existing records from primary storage. [2025-09-29T17:14:56.296670] [INFO ] [MAIN ] APH: Loaded 54471 existing records. [2025-09-29T17:14:56.370821] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-09-29T17:14:56.434578] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-29T17:14:56.529253] [WARN ] [MAIN ] APH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:14:56.529563] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-09-29T17:14:56.529618] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-09-29T17:14:56.531669] [DEBUG] [LOCAL ] APH: Deleted primary data file. [2025-09-29T17:14:56.531737] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-09-29T17:14:56.900018] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:14:57.141528] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-29T17:14:57.151737] [INFO ] [REMOTE ] APH: Fetching primary data for 2024-12. [2025-09-29T17:14:57.948074] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-09-29T17:14:58.058253] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-29T17:14:58.748126] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-09-29T17:14:59.250436] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-29T17:14:59.548084] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-09-29T17:14:59.643598] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-29T17:14:59.705172] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-29T17:15:00.348148] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-09-29T17:15:01.148158] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-09-29T17:15:01.569453] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-29T17:15:01.948161] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-09-29T17:15:02.097408] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-29T17:15:02.708282] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-29T17:15:02.714968] [INFO ] [REMOTE ] APAM: Full fetch complete (51404 records). [2025-09-29T17:15:02.715079] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-09-29T17:15:02.715721] [FATAL] [VALIDATOR ] APAM: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:15:02.715809] [FATAL] [MAIN ] APAM: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:15:02.715853] [WARN ] [MAIN ] APAM: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:15:02.715893] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-09-29T17:15:02.715992] [DEBUG] [LOCAL ] APAM: No primary data file found to delete. [2025-09-29T17:15:02.716047] [INFO ] [LOCAL ] APAM: Starting deletion of derivative data. [2025-09-29T17:15:02.717289] [DEBUG] [LOCAL ] APAM: Deleted derivative data file. [2025-09-29T17:15:02.719627] [INFO ] [MAIN ] Update Progress: 128/2371 symbols completed. APAM took 34.4s. Estimated remaining: 4h 22m 48s. Rate: 8.5 symbols/min [2025-09-29T17:15:02.752027] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-09-29T17:15:02.903871] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:15:02.968574] [DEBUG] [LOCAL ] APLE: Loaded 52769 existing records from primary storage. [2025-09-29T17:15:02.968967] [INFO ] [MAIN ] APLE: Loaded 52769 existing records. [2025-09-29T17:15:03.154884] [WARN ] [MAIN ] APLE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:15:03.155094] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-09-29T17:15:03.155146] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-09-29T17:15:03.156061] [DEBUG] [LOCAL ] APLE: Deleted primary data file. [2025-09-29T17:15:03.156121] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-09-29T17:15:03.536715] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:15:03.548069] [INFO ] [REMOTE ] APLE: Fetching primary data for 2024-12. [2025-09-29T17:15:03.744767] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-29T17:15:04.348088] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-09-29T17:15:04.616847] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-29T17:15:05.148135] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-09-29T17:15:05.266833] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-29T17:15:05.948109] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-09-29T17:15:06.165032] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-29T17:15:06.746082] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-29T17:15:06.755843] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-09-29T17:15:07.548079] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-09-29T17:15:07.655806] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-29T17:15:08.348141] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-09-29T17:15:08.624450] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-29T17:15:08.812964] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-29T17:15:08.821819] [INFO ] [REMOTE ] APD: Full fetch complete (66288 records). [2025-09-29T17:15:08.821981] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-09-29T17:15:08.822856] [FATAL] [VALIDATOR ] APD: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:15:08.822958] [FATAL] [MAIN ] APD: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:15:08.823001] [WARN ] [MAIN ] APD: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:15:08.823066] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-09-29T17:15:08.823133] [DEBUG] [LOCAL ] APD: No primary data file found to delete. [2025-09-29T17:15:08.823170] [INFO ] [LOCAL ] APD: Starting deletion of derivative data. [2025-09-29T17:15:08.823997] [DEBUG] [LOCAL ] APD: Deleted derivative data file. [2025-09-29T17:15:08.824106] [INFO ] [MAIN ] Update Progress: 129/2371 symbols completed. APD took 37.2s. Estimated remaining: 4h 22m 24s. Rate: 8.5 symbols/min [2025-09-29T17:15:09.002762] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:15:09.072407] [DEBUG] [LOCAL ] APO: Loaded 54162 existing records from primary storage. [2025-09-29T17:15:09.072795] [INFO ] [MAIN ] APO: Loaded 54162 existing records. [2025-09-29T17:15:09.153295] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-09-29T17:15:09.260332] [WARN ] [MAIN ] APO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:15:09.260550] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-09-29T17:15:09.260598] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-09-29T17:15:09.261509] [DEBUG] [LOCAL ] APO: Deleted primary data file. [2025-09-29T17:15:09.261572] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-09-29T17:15:09.646723] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:15:09.948106] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-09-29T17:15:10.024447] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-29T17:15:10.748171] [INFO ] [REMOTE ] APO: Fetching primary data for 2024-12. [2025-09-29T17:15:11.542182] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-29T17:15:11.557729] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-09-29T17:15:11.686704] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-29T17:15:12.348075] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-09-29T17:15:12.392501] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-29T17:15:13.148075] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-09-29T17:15:13.552194] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-29T17:15:13.948126] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-09-29T17:15:14.132959] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-29T17:15:14.748147] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-09-29T17:15:15.167287] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-29T17:15:15.548148] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-09-29T17:15:16.199795] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-29T17:15:16.348092] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-09-29T17:15:16.451688] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-29T17:15:17.153243] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-09-29T17:15:17.172475] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-29T17:15:17.948119] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-09-29T17:15:18.194905] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-29T17:15:18.748174] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-09-29T17:15:19.031964] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-29T17:15:19.548099] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-09-29T17:15:19.765219] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-29T17:15:20.348132] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-09-29T17:15:20.718384] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-29T17:15:21.148144] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-09-29T17:15:21.322550] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-29T17:15:21.948138] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-09-29T17:15:22.238218] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-29T17:15:22.748099] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-09-29T17:15:22.850760] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-29T17:15:23.548116] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-09-29T17:15:23.894226] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-29T17:15:24.348174] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-09-29T17:15:24.831742] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-29T17:15:25.131318] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-29T17:15:25.148066] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-09-29T17:15:25.948149] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-09-29T17:15:26.065057] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-29T17:15:26.748105] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-09-29T17:15:26.918216] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-29T17:15:26.929010] [INFO ] [REMOTE ] APG: Full fetch complete (71272 records). [2025-09-29T17:15:26.929252] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-09-29T17:15:26.931119] [FATAL] [VALIDATOR ] APG: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:15:26.931403] [FATAL] [MAIN ] APG: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:15:26.931479] [WARN ] [MAIN ] APG: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:15:26.931565] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-09-29T17:15:26.931669] [DEBUG] [LOCAL ] APG: No primary data file found to delete. [2025-09-29T17:15:26.931733] [INFO ] [LOCAL ] APG: Starting deletion of derivative data. [2025-09-29T17:15:26.932307] [DEBUG] [LOCAL ] APG: Deleted derivative data file. [2025-09-29T17:15:26.932444] [INFO ] [MAIN ] Update Progress: 130/2371 symbols completed. APG took 38.9s. Estimated remaining: 4h 25m 28s. Rate: 8.4 symbols/min [2025-09-29T17:15:27.110834] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:15:27.121776] [DEBUG] [LOCAL ] APOS: Loaded 7568 existing records from primary storage. [2025-09-29T17:15:27.122019] [INFO ] [MAIN ] APOS: Loaded 7568 existing records. [2025-09-29T17:15:27.305962] [WARN ] [MAIN ] APOS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:15:27.306231] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-09-29T17:15:27.306287] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-09-29T17:15:27.306724] [DEBUG] [LOCAL ] APOS: Deleted primary data file. [2025-09-29T17:15:27.306808] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-09-29T17:15:27.557074] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-09-29T17:15:27.721110] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:15:27.754855] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-29T17:15:28.348125] [INFO ] [REMOTE ] APOS: Fetching primary data for 2024-12. [2025-09-29T17:15:28.679354] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-29T17:15:28.856163] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-29T17:15:29.148179] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-09-29T17:15:29.809735] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-29T17:15:29.821289] [INFO ] [REMOTE ] APH: Full fetch complete (77683 records). [2025-09-29T17:15:29.821475] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-09-29T17:15:29.953285] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-09-29T17:15:30.253004] [DEBUG] [VALIDATOR ] APH: All expected trading days are present. [2025-09-29T17:15:30.253104] [DEBUG] [VALIDATOR ] APH: Primary data validation passed. [2025-09-29T17:15:30.253909] [INFO ] [MAIN ] APH: Fetched primary data is valid. [2025-09-29T17:15:30.253981] [DEBUG] [LOCAL ] APH: Saving primary data. [2025-09-29T17:15:30.255531] [DEBUG] [LOCAL ] APH: Trimmed 77683 records to 53691 (keeping 200 days of data) [2025-09-29T17:15:30.625600] [DEBUG] [LOCAL ] APH: Primary data saved (53691 records). [2025-09-29T17:15:30.631559] [INFO ] [MAIN ] APH: Full history saved. [2025-09-29T17:15:30.634586] [INFO ] [MAIN ] Update Progress: 131/2371 symbols completed. APH took 34.6s. Estimated remaining: 4h 24m 23s. Rate: 8.5 symbols/min [2025-09-29T17:15:30.641150] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-29T17:15:30.753229] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-09-29T17:15:30.850946] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:15:30.885553] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-29T17:15:30.958994] [DEBUG] [LOCAL ] APTV: Loaded 52964 existing records from primary storage. [2025-09-29T17:15:30.959437] [INFO ] [MAIN ] APTV: Loaded 52964 existing records. [2025-09-29T17:15:31.172554] [WARN ] [MAIN ] APTV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:15:31.172851] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-09-29T17:15:31.172900] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-09-29T17:15:31.173859] [DEBUG] [LOCAL ] APTV: Deleted primary data file. [2025-09-29T17:15:31.173922] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-09-29T17:15:31.543478] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-29T17:15:31.558787] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-09-29T17:15:31.612433] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:15:32.348145] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-09-29T17:15:33.060078] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-29T17:15:33.148089] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-09-29T17:15:33.479471] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-29T17:15:33.490370] [INFO ] [REMOTE ] APLE: Full fetch complete (74272 records). [2025-09-29T17:15:33.490542] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-09-29T17:15:33.911738] [DEBUG] [VALIDATOR ] APLE: All expected trading days are present. [2025-09-29T17:15:33.911845] [DEBUG] [VALIDATOR ] APLE: Primary data validation passed. [2025-09-29T17:15:33.912601] [INFO ] [MAIN ] APLE: Fetched primary data is valid. [2025-09-29T17:15:33.912685] [DEBUG] [LOCAL ] APLE: Saving primary data. [2025-09-29T17:15:33.914242] [DEBUG] [LOCAL ] APLE: Trimmed 74272 records to 51976 (keeping 200 days of data) [2025-09-29T17:15:33.970143] [INFO ] [REMOTE ] APTV: Fetching primary data for 2024-12. [2025-09-29T17:15:34.262827] [DEBUG] [LOCAL ] APLE: Primary data saved (51976 records). [2025-09-29T17:15:34.263037] [INFO ] [MAIN ] APLE: Full history saved. [2025-09-29T17:15:34.263938] [INFO ] [MAIN ] Update Progress: 132/2371 symbols completed. APLE took 31.5s. Estimated remaining: 4h 23m 18s. Rate: 8.5 symbols/min [2025-09-29T17:15:34.457437] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:15:34.521953] [DEBUG] [LOCAL ] AQN: Loaded 52684 existing records from primary storage. [2025-09-29T17:15:34.522343] [INFO ] [MAIN ] AQN: Loaded 52684 existing records. [2025-09-29T17:15:34.725777] [WARN ] [MAIN ] AQN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:15:34.725999] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-09-29T17:15:34.726060] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-09-29T17:15:34.728107] [DEBUG] [LOCAL ] AQN: Deleted primary data file. [2025-09-29T17:15:34.728254] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-09-29T17:15:34.753904] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-09-29T17:15:35.165316] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:15:35.198499] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-29T17:15:35.548109] [INFO ] [REMOTE ] AQN: Fetching primary data for 2024-12. [2025-09-29T17:15:35.765346] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-29T17:15:35.798267] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-29T17:15:36.348118] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-09-29T17:15:37.148141] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-09-29T17:15:37.327171] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-29T17:15:37.765567] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-29T17:15:37.891403] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-29T17:15:37.948189] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-09-29T17:15:38.748178] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-09-29T17:15:39.548132] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-09-29T17:15:40.023532] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-29T17:15:40.348144] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-09-29T17:15:40.382596] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-29T17:15:40.473401] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-29T17:15:41.148125] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-09-29T17:15:41.948179] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-09-29T17:15:42.402587] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-29T17:15:42.415576] [INFO ] [REMOTE ] APO: Full fetch complete (77291 records). [2025-09-29T17:15:42.415789] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-09-29T17:15:42.756828] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-09-29T17:15:42.942228] [DEBUG] [VALIDATOR ] APO: All expected trading days are present. [2025-09-29T17:15:42.942347] [DEBUG] [VALIDATOR ] APO: Primary data validation passed. [2025-09-29T17:15:42.943187] [INFO ] [MAIN ] APO: Fetched primary data is valid. [2025-09-29T17:15:42.943267] [DEBUG] [LOCAL ] APO: Saving primary data. [2025-09-29T17:15:42.961248] [DEBUG] [LOCAL ] APO: Trimmed 77291 records to 53382 (keeping 200 days of data) [2025-09-29T17:15:42.976971] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-29T17:15:43.348694] [DEBUG] [LOCAL ] APO: Primary data saved (53382 records). [2025-09-29T17:15:43.348965] [INFO ] [MAIN ] APO: Full history saved. [2025-09-29T17:15:43.349173] [INFO ] [MAIN ] Update Progress: 133/2371 symbols completed. APO took 34.5s. Estimated remaining: 4h 23m 45s. Rate: 8.5 symbols/min [2025-09-29T17:15:43.532154] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-29T17:15:43.563328] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:15:43.563421] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-09-29T17:15:43.573591] [DEBUG] [LOCAL ] AQNB: Loaded 4228 existing records from primary storage. [2025-09-29T17:15:43.573919] [INFO ] [MAIN ] AQNB: Loaded 4228 existing records. [2025-09-29T17:15:43.790128] [WARN ] [MAIN ] AQNB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:15:43.790512] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-09-29T17:15:43.790610] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-09-29T17:15:43.791365] [DEBUG] [LOCAL ] AQNB: Deleted primary data file. [2025-09-29T17:15:43.791433] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-09-29T17:15:43.917462] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-29T17:15:44.234813] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:15:44.348131] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2024-12. [2025-09-29T17:15:45.089541] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-29T17:15:45.151438] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-09-29T17:15:45.157922] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-29T17:15:45.786507] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-29T17:15:45.948162] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-09-29T17:15:46.748130] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-09-29T17:15:47.548109] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-09-29T17:15:47.820318] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-29T17:15:48.348130] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-09-29T17:15:48.455155] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-29T17:15:48.458201] [INFO ] [REMOTE ] APOS: Full fetch complete (10420 records). [2025-09-29T17:15:48.458371] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-09-29T17:15:48.811867] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-29T17:15:48.909393] [DEBUG] [VALIDATOR ] APOS: All expected trading days are present. [2025-09-29T17:15:48.909479] [DEBUG] [VALIDATOR ] APOS: Primary data validation passed. [2025-09-29T17:15:48.909736] [INFO ] [MAIN ] APOS: Fetched primary data is valid. [2025-09-29T17:15:48.909813] [DEBUG] [LOCAL ] APOS: Saving primary data. [2025-09-29T17:15:48.910342] [DEBUG] [LOCAL ] APOS: Trimmed 10420 records to 7514 (keeping 200 days of data) [2025-09-29T17:15:48.958143] [DEBUG] [LOCAL ] APOS: Primary data saved (7514 records). [2025-09-29T17:15:48.958319] [INFO ] [MAIN ] APOS: Full history saved. [2025-09-29T17:15:48.958451] [INFO ] [MAIN ] Update Progress: 134/2371 symbols completed. APOS took 22.0s. Estimated remaining: 4h 23m 13s. Rate: 8.5 symbols/min [2025-09-29T17:15:49.135443] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:15:49.148133] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-09-29T17:15:49.199792] [DEBUG] [LOCAL ] AR: Loaded 54364 existing records from primary storage. [2025-09-29T17:15:49.200239] [INFO ] [MAIN ] AR: Loaded 54364 existing records. [2025-09-29T17:15:49.388195] [WARN ] [MAIN ] AR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:15:49.388443] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-09-29T17:15:49.388544] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-09-29T17:15:49.390035] [DEBUG] [LOCAL ] AR: Deleted primary data file. [2025-09-29T17:15:49.390127] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-09-29T17:15:49.762958] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:15:49.948116] [INFO ] [REMOTE ] AR: Fetching primary data for 2024-12. [2025-09-29T17:15:50.050573] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-29T17:15:50.638048] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-29T17:15:50.748123] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-09-29T17:15:51.548130] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-09-29T17:15:51.698750] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-29T17:15:52.348108] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-09-29T17:15:52.497903] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-29T17:15:53.148129] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-09-29T17:15:53.193681] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-29T17:15:53.690349] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-29T17:15:53.948101] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-09-29T17:15:54.048614] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-29T17:15:54.748121] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-09-29T17:15:55.275689] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-29T17:15:55.548113] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-09-29T17:15:55.633756] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-29T17:15:55.947997] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-29T17:15:56.348130] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-09-29T17:15:57.148107] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-09-29T17:15:57.752467] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-29T17:15:57.948097] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-09-29T17:15:58.053780] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-29T17:15:58.564951] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-29T17:15:58.748143] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-09-29T17:15:59.447383] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-29T17:15:59.548127] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-09-29T17:16:00.348140] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-09-29T17:16:01.148134] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-09-29T17:16:01.424962] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-29T17:16:01.948188] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-09-29T17:16:02.367520] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-29T17:16:02.412332] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-29T17:16:02.423419] [INFO ] [REMOTE ] APTV: Full fetch complete (75991 records). [2025-09-29T17:16:02.423595] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-09-29T17:16:02.751537] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-09-29T17:16:02.874539] [DEBUG] [VALIDATOR ] APTV: All expected trading days are present. [2025-09-29T17:16:02.874816] [DEBUG] [VALIDATOR ] APTV: Primary data validation passed. [2025-09-29T17:16:02.875814] [INFO ] [MAIN ] APTV: Fetched primary data is valid. [2025-09-29T17:16:02.875950] [DEBUG] [LOCAL ] APTV: Saving primary data. [2025-09-29T17:16:02.877885] [DEBUG] [LOCAL ] APTV: Trimmed 75991 records to 52148 (keeping 200 days of data) [2025-09-29T17:16:03.038131] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-29T17:16:03.261389] [DEBUG] [LOCAL ] APTV: Primary data saved (52148 records). [2025-09-29T17:16:03.261613] [INFO ] [MAIN ] APTV: Full history saved. [2025-09-29T17:16:03.262887] [INFO ] [MAIN ] Update Progress: 135/2371 symbols completed. APTV took 32.6s. Estimated remaining: 4h 25m 6s. Rate: 8.4 symbols/min [2025-09-29T17:16:03.372205] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-29T17:16:03.451107] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:16:03.506851] [DEBUG] [LOCAL ] ARCO: Loaded 45249 existing records from primary storage. [2025-09-29T17:16:03.507318] [INFO ] [MAIN ] ARCO: Loaded 45249 existing records. [2025-09-29T17:16:03.553534] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-09-29T17:16:03.704842] [WARN ] [MAIN ] ARCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:16:03.705175] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-09-29T17:16:03.705239] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-09-29T17:16:03.709069] [DEBUG] [LOCAL ] ARCO: Deleted primary data file. [2025-09-29T17:16:03.709136] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-09-29T17:16:04.076227] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:16:04.348167] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-09-29T17:16:05.072106] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-29T17:16:05.073518] [INFO ] [REMOTE ] AQNB: Full fetch complete (5886 records). [2025-09-29T17:16:05.073597] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-09-29T17:16:05.148855] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2024-12. [2025-09-29T17:16:05.262580] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-29T17:16:05.503599] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present. [2025-09-29T17:16:05.503719] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed. [2025-09-29T17:16:05.503937] [INFO ] [MAIN ] AQNB: Fetched primary data is valid. [2025-09-29T17:16:05.503982] [DEBUG] [LOCAL ] AQNB: Saving primary data. [2025-09-29T17:16:05.504439] [DEBUG] [LOCAL ] AQNB: Trimmed 5886 records to 4142 (keeping 200 days of data) [2025-09-29T17:16:05.535299] [DEBUG] [LOCAL ] AQNB: Primary data saved (4142 records). [2025-09-29T17:16:05.535472] [INFO ] [MAIN ] AQNB: Full history saved. [2025-09-29T17:16:05.535584] [INFO ] [MAIN ] Update Progress: 136/2371 symbols completed. AQNB took 22.2s. Estimated remaining: 4h 23m 39s. Rate: 8.5 symbols/min [2025-09-29T17:16:05.718002] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:16:05.738093] [DEBUG] [LOCAL ] ARDC: Loaded 14821 existing records from primary storage. [2025-09-29T17:16:05.738432] [INFO ] [MAIN ] ARDC: Loaded 14821 existing records. [2025-09-29T17:16:05.961754] [WARN ] [MAIN ] ARDC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:16:05.955193] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-09-29T17:16:05.962511] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-09-29T17:16:05.963366] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-09-29T17:16:05.963708] [DEBUG] [LOCAL ] ARDC: Deleted primary data file. [2025-09-29T17:16:05.963771] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-09-29T17:16:06.340774] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:16:06.748168] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2024-12. [2025-09-29T17:16:07.023433] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-29T17:16:07.355073] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-29T17:16:07.548104] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-09-29T17:16:07.715472] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-29T17:16:08.136278] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-29T17:16:08.348224] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-09-29T17:16:09.148164] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-09-29T17:16:09.965128] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-09-29T17:16:09.969110] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-29T17:16:10.748102] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-09-29T17:16:10.831481] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-29T17:16:11.548112] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-09-29T17:16:11.868283] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-29T17:16:12.353458] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-09-29T17:16:12.373317] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-29T17:16:12.564444] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-29T17:16:13.148149] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-09-29T17:16:13.948094] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-09-29T17:16:14.138471] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-29T17:16:14.459401] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-29T17:16:14.469525] [INFO ] [REMOTE ] AQN: Full fetch complete (74900 records). [2025-09-29T17:16:14.469719] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-09-29T17:16:14.470574] [FATAL] [VALIDATOR ] AQN: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:16:14.470713] [FATAL] [MAIN ] AQN: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:16:14.470806] [WARN ] [MAIN ] AQN: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:16:14.470881] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-09-29T17:16:14.470950] [DEBUG] [LOCAL ] AQN: No primary data file found to delete. [2025-09-29T17:16:14.470989] [INFO ] [LOCAL ] AQN: Starting deletion of derivative data. [2025-09-29T17:16:14.471757] [DEBUG] [LOCAL ] AQN: Deleted derivative data file. [2025-09-29T17:16:14.472566] [INFO ] [MAIN ] Update Progress: 137/2371 symbols completed. AQN took 40.2s. Estimated remaining: 4h 24m 3s. Rate: 8.5 symbols/min [2025-09-29T17:16:14.656454] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:16:14.693418] [DEBUG] [LOCAL ] ARDT: Loaded 28513 existing records from primary storage. [2025-09-29T17:16:14.693746] [INFO ] [MAIN ] ARDT: Loaded 28513 existing records. [2025-09-29T17:16:14.759233] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-09-29T17:16:14.883567] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:16:14.883792] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-09-29T17:16:14.883841] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-09-29T17:16:14.884141] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-09-29T17:16:14.884198] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-09-29T17:16:15.269188] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:16:15.464044] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-29T17:16:15.548103] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-09-29T17:16:15.817579] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-29T17:16:16.348128] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-09-29T17:16:17.148079] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-09-29T17:16:17.267051] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-29T17:16:17.948096] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-09-29T17:16:18.033487] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-29T17:16:18.128946] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-29T17:16:18.748160] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-09-29T17:16:19.548139] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2024-12. [2025-09-29T17:16:19.703115] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-29T17:16:20.348125] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-09-29T17:16:20.514085] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-29T17:16:20.725302] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-29T17:16:21.148155] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-09-29T17:16:21.574698] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-29T17:16:21.948153] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-09-29T17:16:22.504512] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-29T17:16:22.748119] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-09-29T17:16:23.467768] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-29T17:16:23.497771] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-29T17:16:23.548140] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-09-29T17:16:24.348132] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-09-29T17:16:24.415227] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-29T17:16:25.148141] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-09-29T17:16:25.707363] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-29T17:16:25.948122] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-09-29T17:16:26.748103] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-09-29T17:16:27.170150] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-29T17:16:27.181589] [INFO ] [REMOTE ] AR: Full fetch complete (77532 records). [2025-09-29T17:16:27.181843] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-09-29T17:16:27.562054] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-09-29T17:16:27.642726] [DEBUG] [VALIDATOR ] AR: All expected trading days are present. [2025-09-29T17:16:27.644803] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-29T17:16:27.644984] [DEBUG] [VALIDATOR ] AR: Primary data validation passed. [2025-09-29T17:16:27.659210] [INFO ] [MAIN ] AR: Fetched primary data is valid. [2025-09-29T17:16:27.659671] [DEBUG] [LOCAL ] AR: Saving primary data. [2025-09-29T17:16:27.662477] [DEBUG] [LOCAL ] AR: Trimmed 77532 records to 53584 (keeping 200 days of data) [2025-09-29T17:16:28.000759] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-29T17:16:28.028410] [DEBUG] [LOCAL ] AR: Primary data saved (53584 records). [2025-09-29T17:16:28.028571] [INFO ] [MAIN ] AR: Full history saved. [2025-09-29T17:16:28.028685] [INFO ] [MAIN ] Update Progress: 138/2371 symbols completed. AR took 39.1s. Estimated remaining: 4h 25m 40s. Rate: 8.4 symbols/min [2025-09-29T17:16:28.221541] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:16:28.278014] [DEBUG] [LOCAL ] ARE: Loaded 51319 existing records from primary storage. [2025-09-29T17:16:28.278441] [INFO ] [MAIN ] ARE: Loaded 51319 existing records. [2025-09-29T17:16:28.353330] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-09-29T17:16:28.483077] [WARN ] [MAIN ] ARE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:16:28.483324] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-09-29T17:16:28.483373] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-09-29T17:16:28.483888] [DEBUG] [LOCAL ] ARE: Deleted primary data file. [2025-09-29T17:16:28.483950] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-09-29T17:16:28.861255] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:16:28.909832] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-29T17:16:29.148148] [INFO ] [REMOTE ] ARE: Fetching primary data for 2024-12. [2025-09-29T17:16:29.574352] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-29T17:16:29.948183] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-09-29T17:16:30.748205] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-09-29T17:16:30.820671] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-29T17:16:31.392635] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-29T17:16:31.548170] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-09-29T17:16:31.634606] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-29T17:16:32.348119] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-09-29T17:16:33.148083] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-09-29T17:16:33.278530] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-29T17:16:33.722809] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-29T17:16:33.948151] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-09-29T17:16:34.748136] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-09-29T17:16:34.937924] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-29T17:16:35.548093] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-09-29T17:16:35.963359] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-29T17:16:36.348138] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-09-29T17:16:36.393875] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-29T17:16:36.397713] [INFO ] [REMOTE ] ARDC: Full fetch complete (20511 records). [2025-09-29T17:16:36.397801] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-09-29T17:16:36.803186] [DEBUG] [VALIDATOR ] ARDC: All expected trading days are present. [2025-09-29T17:16:36.803374] [DEBUG] [VALIDATOR ] ARDC: Primary data validation passed. [2025-09-29T17:16:36.803909] [INFO ] [MAIN ] ARDC: Fetched primary data is valid. [2025-09-29T17:16:36.804028] [DEBUG] [LOCAL ] ARDC: Saving primary data. [2025-09-29T17:16:36.805138] [DEBUG] [LOCAL ] ARDC: Trimmed 20511 records to 14689 (keeping 200 days of data) [2025-09-29T17:16:36.900840] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-29T17:16:36.932726] [DEBUG] [LOCAL ] ARDC: Primary data saved (14689 records). [2025-09-29T17:16:36.932891] [INFO ] [MAIN ] ARDC: Full history saved. [2025-09-29T17:16:36.932982] [INFO ] [MAIN ] Update Progress: 139/2371 symbols completed. ARDC took 31.4s. Estimated remaining: 4h 26m 1s. Rate: 8.4 symbols/min [2025-09-29T17:16:37.116298] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:16:37.151881] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-09-29T17:16:37.176876] [DEBUG] [LOCAL ] ARES: Loaded 50322 existing records from primary storage. [2025-09-29T17:16:37.177268] [INFO ] [MAIN ] ARES: Loaded 50322 existing records. [2025-09-29T17:16:37.377842] [WARN ] [MAIN ] ARES: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:16:37.378101] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-09-29T17:16:37.378174] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-09-29T17:16:37.381409] [DEBUG] [LOCAL ] ARES: Deleted primary data file. [2025-09-29T17:16:37.381477] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-09-29T17:16:37.774550] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:16:37.948141] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-09-29T17:16:37.998915] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-29T17:16:38.748180] [INFO ] [REMOTE ] ARES: Fetching primary data for 2024-12. [2025-09-29T17:16:38.902112] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-29T17:16:39.208269] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-29T17:16:39.213778] [INFO ] [REMOTE ] ARDT: Full fetch complete (41125 records). [2025-09-29T17:16:39.213908] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-09-29T17:16:39.214532] [FATAL] [VALIDATOR ] ARDT: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:16:39.214622] [FATAL] [MAIN ] ARDT: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:16:39.214711] [WARN ] [MAIN ] ARDT: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:16:39.214787] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-09-29T17:16:39.214890] [DEBUG] [LOCAL ] ARDT: No primary data file found to delete. [2025-09-29T17:16:39.214948] [INFO ] [LOCAL ] ARDT: Starting deletion of derivative data. [2025-09-29T17:16:39.215294] [DEBUG] [LOCAL ] ARDT: Deleted derivative data file. [2025-09-29T17:16:39.215392] [INFO ] [MAIN ] Update Progress: 140/2371 symbols completed. ARDT took 24.7s. Estimated remaining: 4h 24m 37s. Rate: 8.4 symbols/min [2025-09-29T17:16:39.403045] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:16:39.454624] [DEBUG] [LOCAL ] ARI: Loaded 44009 existing records from primary storage. [2025-09-29T17:16:39.454977] [INFO ] [MAIN ] ARI: Loaded 44009 existing records. [2025-09-29T17:16:39.557354] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-09-29T17:16:39.678281] [WARN ] [MAIN ] ARI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:16:39.678519] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-09-29T17:16:39.678569] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-09-29T17:16:39.681433] [DEBUG] [LOCAL ] ARI: Deleted primary data file. [2025-09-29T17:16:39.681502] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-09-29T17:16:40.109967] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:16:40.348134] [INFO ] [REMOTE ] ARI: Fetching primary data for 2024-12. [2025-09-29T17:16:40.501133] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-29T17:16:41.148118] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-09-29T17:16:41.615540] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-29T17:16:41.952194] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-09-29T17:16:42.081751] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-29T17:16:42.748090] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-09-29T17:16:42.846860] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-29T17:16:43.505578] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-29T17:16:43.514808] [INFO ] [REMOTE ] ARCO: Full fetch complete (65627 records). [2025-09-29T17:16:43.515021] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-09-29T17:16:43.553265] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-09-29T17:16:43.940364] [DEBUG] [VALIDATOR ] ARCO: All expected trading days are present. [2025-09-29T17:16:43.940469] [DEBUG] [VALIDATOR ] ARCO: Primary data validation passed. [2025-09-29T17:16:43.941155] [INFO ] [MAIN ] ARCO: Fetched primary data is valid. [2025-09-29T17:16:43.941220] [DEBUG] [LOCAL ] ARCO: Saving primary data. [2025-09-29T17:16:43.942569] [DEBUG] [LOCAL ] ARCO: Trimmed 65627 records to 44534 (keeping 200 days of data) [2025-09-29T17:16:44.233044] [DEBUG] [LOCAL ] ARCO: Primary data saved (44534 records). [2025-09-29T17:16:44.233222] [INFO ] [MAIN ] ARCO: Full history saved. [2025-09-29T17:16:44.233347] [INFO ] [MAIN ] Update Progress: 141/2371 symbols completed. ARCO took 41.0s. Estimated remaining: 4h 23m 56s. Rate: 8.4 symbols/min [2025-09-29T17:16:44.353473] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-09-29T17:16:44.471382] [INFO ] [MAIN ] ARIS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:16:44.496906] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-29T17:16:44.548832] [DEBUG] [LOCAL ] ARIS: Loaded 42624 existing records from primary storage. [2025-09-29T17:16:44.549165] [INFO ] [MAIN ] ARIS: Loaded 42624 existing records. [2025-09-29T17:16:44.735681] [WARN ] [MAIN ] ARIS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:16:44.735887] [INFO ] [MAIN ] ARIS: Wiping existing primary data before full refresh. [2025-09-29T17:16:44.735936] [INFO ] [LOCAL ] ARIS: Starting deletion of primary data. [2025-09-29T17:16:44.736430] [DEBUG] [LOCAL ] ARIS: Deleted primary data file. [2025-09-29T17:16:44.736491] [INFO ] [MAIN ] ARIS: Starting full primary refresh. [2025-09-29T17:16:45.127131] [INFO ] [REMOTE ] ARIS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:16:45.148073] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2024-12. [2025-09-29T17:16:45.337014] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-29T17:16:45.948114] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-09-29T17:16:46.388230] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-29T17:16:46.436908] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-29T17:16:46.748110] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-09-29T17:16:47.402002] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-29T17:16:47.548123] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-09-29T17:16:48.348172] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-01. [2025-09-29T17:16:48.650007] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-29T17:16:49.077354] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-29T17:16:49.148131] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-09-29T17:16:49.655853] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-29T17:16:49.948116] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-09-29T17:16:50.748102] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-09-29T17:16:50.802547] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-29T17:16:51.548092] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-09-29T17:16:51.722813] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-29T17:16:52.348094] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-02. [2025-09-29T17:16:52.657401] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-29T17:16:53.148133] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-09-29T17:16:53.419414] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-29T17:16:53.901958] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-29T17:16:53.948106] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-09-29T17:16:54.721066] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-29T17:16:54.748114] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-03. [2025-09-29T17:16:55.475618] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-29T17:16:55.548030] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-09-29T17:16:56.348099] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-09-29T17:16:56.377007] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-29T17:16:57.148092] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-04. [2025-09-29T17:16:57.328404] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-29T17:16:57.953202] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-09-29T17:16:57.968416] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-29T17:16:58.441408] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-29T17:16:58.748138] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-05. [2025-09-29T17:16:59.548152] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-09-29T17:16:59.696555] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-29T17:17:00.334182] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-29T17:17:00.348072] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-06. [2025-09-29T17:17:01.050190] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-29T17:17:01.148148] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-09-29T17:17:01.825988] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-29T17:17:01.948167] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-09-29T17:17:02.711874] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-29T17:17:02.748120] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-09-29T17:17:03.548112] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-07. [2025-09-29T17:17:03.874228] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-29T17:17:04.345399] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-29T17:17:04.354917] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-09-29T17:17:04.357501] [INFO ] [REMOTE ] ARE: Full fetch complete (72593 records). [2025-09-29T17:17:04.357772] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-09-29T17:17:04.786142] [DEBUG] [VALIDATOR ] ARE: All expected trading days are present. [2025-09-29T17:17:04.786272] [DEBUG] [VALIDATOR ] ARE: Primary data validation passed. [2025-09-29T17:17:04.787187] [INFO ] [MAIN ] ARE: Fetched primary data is valid. [2025-09-29T17:17:04.787340] [DEBUG] [LOCAL ] ARE: Saving primary data. [2025-09-29T17:17:04.791377] [DEBUG] [LOCAL ] ARE: Trimmed 72593 records to 50593 (keeping 200 days of data) [2025-09-29T17:17:04.917451] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-29T17:17:05.148196] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-08. [2025-09-29T17:17:05.157942] [DEBUG] [LOCAL ] ARE: Primary data saved (50593 records). [2025-09-29T17:17:05.158101] [INFO ] [MAIN ] ARE: Full history saved. [2025-09-29T17:17:05.158204] [INFO ] [MAIN ] Update Progress: 142/2371 symbols completed. ARE took 37.1s. Estimated remaining: 4h 27m 26s. Rate: 8.3 symbols/min [2025-09-29T17:17:05.346373] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:17:05.397987] [DEBUG] [LOCAL ] ARLO: Loaded 44493 existing records from primary storage. [2025-09-29T17:17:05.398309] [INFO ] [MAIN ] ARLO: Loaded 44493 existing records. [2025-09-29T17:17:05.590558] [WARN ] [MAIN ] ARLO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:17:05.590844] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-09-29T17:17:05.590909] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-09-29T17:17:05.594082] [DEBUG] [LOCAL ] ARLO: Deleted primary data file. [2025-09-29T17:17:05.594156] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-09-29T17:17:05.950965] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-09-29T17:17:05.975765] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:17:06.337086] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-29T17:17:06.348235] [INFO ] [REMOTE ] ARI: Full fetch complete (62687 records). [2025-09-29T17:17:06.348395] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-09-29T17:17:06.754659] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2024-12. [2025-09-29T17:17:06.827939] [DEBUG] [VALIDATOR ] ARI: All expected trading days are present. [2025-09-29T17:17:06.824247] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-29T17:17:06.838095] [DEBUG] [VALIDATOR ] ARI: Primary data validation passed. [2025-09-29T17:17:06.839454] [INFO ] [MAIN ] ARI: Fetched primary data is valid. [2025-09-29T17:17:06.839959] [DEBUG] [LOCAL ] ARI: Saving primary data. [2025-09-29T17:17:06.841450] [DEBUG] [LOCAL ] ARI: Trimmed 62687 records to 43363 (keeping 200 days of data) [2025-09-29T17:17:07.116823] [DEBUG] [LOCAL ] ARI: Primary data saved (43363 records). [2025-09-29T17:17:07.116962] [INFO ] [MAIN ] ARI: Full history saved. [2025-09-29T17:17:07.118315] [INFO ] [MAIN ] Update Progress: 143/2371 symbols completed. ARI took 27.9s. Estimated remaining: 4h 25m 57s. Rate: 8.4 symbols/min [2025-09-29T17:17:07.296534] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:17:07.355926] [DEBUG] [LOCAL ] ARMK: Loaded 51112 existing records from primary storage. [2025-09-29T17:17:07.356397] [INFO ] [MAIN ] ARMK: Loaded 51112 existing records. [2025-09-29T17:17:07.560544] [WARN ] [MAIN ] ARMK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:17:07.560979] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-09-29T17:17:07.556545] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-09. [2025-09-29T17:17:07.562063] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-09-29T17:17:07.567209] [DEBUG] [LOCAL ] ARMK: Deleted primary data file. [2025-09-29T17:17:07.567306] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-09-29T17:17:07.924367] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-29T17:17:07.997338] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:17:08.354611] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-09-29T17:17:08.360130] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-29T17:17:09.148143] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-09-29T17:17:09.276810] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-29T17:17:09.285847] [INFO ] [REMOTE ] ARIS: Full fetch complete (59830 records). [2025-09-29T17:17:09.286062] [DEBUG] [VALIDATOR ] ARIS: Validating primary data. [2025-09-29T17:17:09.286872] [FATAL] [VALIDATOR ] ARIS: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:17:09.286963] [FATAL] [MAIN ] ARIS: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:17:09.287010] [WARN ] [MAIN ] ARIS: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:17:09.287054] [INFO ] [LOCAL ] ARIS: Starting deletion of primary data. [2025-09-29T17:17:09.287114] [DEBUG] [LOCAL ] ARIS: No primary data file found to delete. [2025-09-29T17:17:09.287154] [INFO ] [LOCAL ] ARIS: Starting deletion of derivative data. [2025-09-29T17:17:09.287598] [DEBUG] [LOCAL ] ARIS: Deleted derivative data file. [2025-09-29T17:17:09.288852] [INFO ] [MAIN ] Update Progress: 144/2371 symbols completed. ARIS took 25.1s. Estimated remaining: 4h 24m 33s. Rate: 8.4 symbols/min [2025-09-29T17:17:09.474616] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:17:09.531133] [DEBUG] [LOCAL ] AROC: Loaded 49733 existing records from primary storage. [2025-09-29T17:17:09.531500] [INFO ] [MAIN ] AROC: Loaded 49733 existing records. [2025-09-29T17:17:09.719142] [WARN ] [MAIN ] AROC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:17:09.719436] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-09-29T17:17:09.719490] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-09-29T17:17:09.725142] [DEBUG] [LOCAL ] AROC: Deleted primary data file. [2025-09-29T17:17:09.725210] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-09-29T17:17:09.967358] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2024-12. [2025-09-29T17:17:10.088254] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:17:10.349704] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-29T17:17:10.360932] [INFO ] [REMOTE ] ARES: Full fetch complete (70673 records). [2025-09-29T17:17:10.361106] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-09-29T17:17:10.757535] [INFO ] [REMOTE ] AROC: Fetching primary data for 2024-12. [2025-09-29T17:17:10.800886] [DEBUG] [VALIDATOR ] ARES: All expected trading days are present. [2025-09-29T17:17:10.801083] [DEBUG] [VALIDATOR ] ARES: Primary data validation passed. [2025-09-29T17:17:10.801982] [INFO ] [MAIN ] ARES: Fetched primary data is valid. [2025-09-29T17:17:10.802075] [DEBUG] [LOCAL ] ARES: Saving primary data. [2025-09-29T17:17:10.828730] [DEBUG] [LOCAL ] ARES: Trimmed 70673 records to 49525 (keeping 200 days of data) [2025-09-29T17:17:10.829901] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-29T17:17:11.177701] [DEBUG] [LOCAL ] ARES: Primary data saved (49525 records). [2025-09-29T17:17:11.177860] [INFO ] [MAIN ] ARES: Full history saved. [2025-09-29T17:17:11.177949] [INFO ] [MAIN ] Update Progress: 145/2371 symbols completed. ARES took 34.2s. Estimated remaining: 4h 23m 5s. Rate: 8.5 symbols/min [2025-09-29T17:17:11.364396] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:17:11.440417] [DEBUG] [LOCAL ] ARR: Loaded 52809 existing records from primary storage. [2025-09-29T17:17:11.440822] [INFO ] [MAIN ] ARR: Loaded 52809 existing records. [2025-09-29T17:17:11.552799] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-09-29T17:17:11.646124] [WARN ] [MAIN ] ARR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:17:11.646491] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-09-29T17:17:11.646606] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-09-29T17:17:11.654304] [DEBUG] [LOCAL ] ARR: Deleted primary data file. [2025-09-29T17:17:11.654400] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-09-29T17:17:11.890774] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-29T17:17:12.099040] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:17:12.348142] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-09-29T17:17:12.515398] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-29T17:17:12.969441] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-29T17:17:13.148136] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-09-29T17:17:13.689584] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-29T17:17:13.948108] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-09-29T17:17:14.748115] [INFO ] [REMOTE ] ARR: Fetching primary data for 2024-12. [2025-09-29T17:17:14.858623] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-29T17:17:15.548191] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-09-29T17:17:15.736171] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-29T17:17:16.348113] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-09-29T17:17:17.124386] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-09-29T17:17:17.148076] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-09-29T17:17:17.216336] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-29T17:17:17.955030] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-09-29T17:17:17.957904] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-29T17:17:18.748074] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-09-29T17:17:18.933720] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-29T17:17:19.548094] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-09-29T17:17:19.749607] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-29T17:17:20.081080] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-29T17:17:20.348117] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-09-29T17:17:21.023606] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-29T17:17:21.148136] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-09-29T17:17:21.805459] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-29T17:17:21.948143] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-09-29T17:17:22.748113] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-09-29T17:17:22.921567] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-29T17:17:22.996670] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-29T17:17:23.548134] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-09-29T17:17:24.348139] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-09-29T17:17:24.692490] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-29T17:17:25.148144] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-09-29T17:17:25.376284] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-29T17:17:25.473908] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-29T17:17:25.948162] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-09-29T17:17:26.647341] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-29T17:17:26.748125] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-09-29T17:17:27.548154] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-09-29T17:17:27.810668] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-29T17:17:28.321339] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-29T17:17:28.348077] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-09-29T17:17:29.148112] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-09-29T17:17:29.184008] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-29T17:17:29.738547] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-29T17:17:29.948126] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-09-29T17:17:30.748142] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-09-29T17:17:30.808285] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-29T17:17:31.313477] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-29T17:17:31.548124] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-09-29T17:17:32.348120] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-09-29T17:17:32.739529] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-29T17:17:33.148169] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-09-29T17:17:33.252087] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-29T17:17:33.261389] [INFO ] [REMOTE ] ARLO: Full fetch complete (62238 records). [2025-09-29T17:17:33.261580] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-09-29T17:17:33.262289] [FATAL] [VALIDATOR ] ARLO: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:17:33.262382] [FATAL] [MAIN ] ARLO: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:17:33.262427] [WARN ] [MAIN ] ARLO: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:17:33.262512] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-09-29T17:17:33.262582] [DEBUG] [LOCAL ] ARLO: No primary data file found to delete. [2025-09-29T17:17:33.262621] [INFO ] [LOCAL ] ARLO: Starting deletion of derivative data. [2025-09-29T17:17:33.263064] [DEBUG] [LOCAL ] ARLO: Deleted derivative data file. [2025-09-29T17:17:33.263182] [INFO ] [MAIN ] Update Progress: 146/2371 symbols completed. ARLO took 28.1s. Estimated remaining: 4h 26m 47s. Rate: 8.3 symbols/min [2025-09-29T17:17:33.442123] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:17:33.480941] [DEBUG] [LOCAL ] ARW: Loaded 33660 existing records from primary storage. [2025-09-29T17:17:33.481246] [INFO ] [MAIN ] ARW: Loaded 33660 existing records. [2025-09-29T17:17:33.674742] [WARN ] [MAIN ] ARW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:17:33.675112] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-09-29T17:17:33.675191] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-09-29T17:17:33.678406] [DEBUG] [LOCAL ] ARW: Deleted primary data file. [2025-09-29T17:17:33.678477] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-09-29T17:17:33.952696] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-09-29T17:17:34.075747] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:17:34.107278] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-29T17:17:34.748091] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-09-29T17:17:35.080975] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-29T17:17:35.548132] [INFO ] [REMOTE ] ARW: Fetching primary data for 2024-12. [2025-09-29T17:17:35.763212] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-29T17:17:36.348109] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-09-29T17:17:36.673402] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-29T17:17:36.683849] [INFO ] [REMOTE ] ARMK: Full fetch complete (72177 records). [2025-09-29T17:17:36.684070] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-09-29T17:17:36.685623] [FATAL] [VALIDATOR ] ARMK: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:17:36.685748] [FATAL] [MAIN ] ARMK: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:17:36.685794] [WARN ] [MAIN ] ARMK: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:17:36.685862] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-09-29T17:17:36.685941] [DEBUG] [LOCAL ] ARMK: No primary data file found to delete. [2025-09-29T17:17:36.685993] [INFO ] [LOCAL ] ARMK: Starting deletion of derivative data. [2025-09-29T17:17:36.686844] [DEBUG] [LOCAL ] ARMK: Deleted derivative data file. [2025-09-29T17:17:36.687908] [INFO ] [MAIN ] Update Progress: 147/2371 symbols completed. ARMK took 29.6s. Estimated remaining: 4h 25m 43s. Rate: 8.4 symbols/min [2025-09-29T17:17:36.890751] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:17:36.891162] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-09-29T17:17:36.891338] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-09-29T17:17:36.891670] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-09-29T17:17:36.891745] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-29T17:17:36.891836] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-29T17:17:36.891926] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-09-29T17:17:37.111750] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-29T17:17:37.154130] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-09-29T17:17:37.344383] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:17:37.948143] [INFO ] [REMOTE ] ARX: Fetching primary data for 2024-12. [2025-09-29T17:17:38.076630] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-29T17:17:38.174389] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T17:17:38.174732] [WARN ] [REMOTE ] ARX: No data returned for month 2024-12 [2025-09-29T17:17:38.174842] [FATAL] [REMOTE ] ARX: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T17:17:38.174892] [FATAL] [MAIN ] ARX: Failed to fetch primary data. [2025-09-29T17:17:38.174949] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T17:17:38.175027] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-29T17:17:38.175111] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-29T17:17:38.175168] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-09-29T17:17:38.175211] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-09-29T17:17:38.175259] [INFO ] [MAIN ] Update Progress: 148/2371 symbols completed. ARX took 1.5s. Estimated remaining: 4h 24m 10s. Rate: 8.4 symbols/min [2025-09-29T17:17:38.372193] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:17:38.437782] [DEBUG] [LOCAL ] AS: Loaded 53854 existing records from primary storage. [2025-09-29T17:17:38.438159] [INFO ] [MAIN ] AS: Loaded 53854 existing records. [2025-09-29T17:17:38.629420] [WARN ] [MAIN ] AS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:17:38.629669] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-09-29T17:17:38.629749] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-09-29T17:17:38.642960] [DEBUG] [LOCAL ] AS: Deleted primary data file. [2025-09-29T17:17:38.660716] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-09-29T17:17:38.708580] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-29T17:17:38.757107] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-09-29T17:17:39.096140] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:17:39.548162] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-09-29T17:17:40.348165] [INFO ] [REMOTE ] AS: Fetching primary data for 2024-12. [2025-09-29T17:17:40.828555] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-29T17:17:40.924492] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-29T17:17:41.148161] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-09-29T17:17:41.852020] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-29T17:17:41.948092] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-09-29T17:17:42.748125] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-09-29T17:17:43.116448] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-29T17:17:43.548105] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-09-29T17:17:43.646174] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-29T17:17:44.348128] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-09-29T17:17:44.721035] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-29T17:17:44.731166] [INFO ] [REMOTE ] AROC: Full fetch complete (70354 records). [2025-09-29T17:17:44.731343] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-09-29T17:17:44.732251] [FATAL] [VALIDATOR ] AROC: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:17:44.732388] [FATAL] [MAIN ] AROC: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:17:44.732433] [WARN ] [MAIN ] AROC: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:17:44.732483] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-09-29T17:17:44.732578] [DEBUG] [LOCAL ] AROC: No primary data file found to delete. [2025-09-29T17:17:44.732678] [INFO ] [LOCAL ] AROC: Starting deletion of derivative data. [2025-09-29T17:17:44.733523] [DEBUG] [LOCAL ] AROC: Deleted derivative data file. [2025-09-29T17:17:44.734691] [INFO ] [MAIN ] Update Progress: 149/2371 symbols completed. AROC took 35.4s. Estimated remaining: 4h 23m 55s. Rate: 8.4 symbols/min [2025-09-29T17:17:44.912882] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:17:44.938982] [DEBUG] [LOCAL ] ASA: Loaded 14109 existing records from primary storage. [2025-09-29T17:17:44.939228] [INFO ] [MAIN ] ASA: Loaded 14109 existing records. [2025-09-29T17:17:45.131906] [WARN ] [MAIN ] ASA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:17:45.132126] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-09-29T17:17:45.132176] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-09-29T17:17:45.132479] [DEBUG] [LOCAL ] ASA: Deleted primary data file. [2025-09-29T17:17:45.132540] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-09-29T17:17:45.165816] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-09-29T17:17:45.599624] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:17:45.737839] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-29T17:17:45.753135] [INFO ] [REMOTE ] ARR: Full fetch complete (75155 records). [2025-09-29T17:17:45.753367] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-09-29T17:17:45.950055] [INFO ] [REMOTE ] ASA: Fetching primary data for 2024-12. [2025-09-29T17:17:46.212050] [DEBUG] [VALIDATOR ] ARR: All expected trading days are present. [2025-09-29T17:17:46.212222] [DEBUG] [VALIDATOR ] ARR: Primary data validation passed. [2025-09-29T17:17:46.213122] [INFO ] [MAIN ] ARR: Fetched primary data is valid. [2025-09-29T17:17:46.213207] [DEBUG] [LOCAL ] ARR: Saving primary data. [2025-09-29T17:17:46.242481] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-29T17:17:46.242620] [DEBUG] [LOCAL ] ARR: Trimmed 75155 records to 52025 (keeping 200 days of data) [2025-09-29T17:17:46.589949] [DEBUG] [LOCAL ] ARR: Primary data saved (52025 records). [2025-09-29T17:17:46.590093] [INFO ] [MAIN ] ARR: Full history saved. [2025-09-29T17:17:46.590179] [INFO ] [MAIN ] Update Progress: 150/2371 symbols completed. ARR took 35.4s. Estimated remaining: 4h 22m 29s. Rate: 8.5 symbols/min [2025-09-29T17:17:46.758465] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-09-29T17:17:46.796826] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:17:46.818766] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-29T17:17:46.886143] [DEBUG] [LOCAL ] ASAN: Loaded 53512 existing records from primary storage. [2025-09-29T17:17:46.886476] [INFO ] [MAIN ] ASAN: Loaded 53512 existing records. [2025-09-29T17:17:47.020264] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-29T17:17:47.106526] [WARN ] [MAIN ] ASAN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:17:47.106785] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-09-29T17:17:47.106836] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-09-29T17:17:47.111734] [DEBUG] [LOCAL ] ASAN: Deleted primary data file. [2025-09-29T17:17:47.111827] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-09-29T17:17:47.475907] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:17:47.548111] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2024-12. [2025-09-29T17:17:48.348097] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-09-29T17:17:48.538993] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-29T17:17:49.148098] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-09-29T17:17:49.179722] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-29T17:17:49.774140] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-29T17:17:49.948109] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-09-29T17:17:50.748115] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-09-29T17:17:50.866854] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-29T17:17:51.548127] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-09-29T17:17:51.783750] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-29T17:17:51.816675] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-29T17:17:52.348127] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-09-29T17:17:53.135334] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-29T17:17:53.143921] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-29T17:17:53.148175] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-09-29T17:17:53.948113] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-09-29T17:17:54.758518] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-09-29T17:17:54.763850] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-29T17:17:55.548084] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-09-29T17:17:55.662957] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-29T17:17:56.348187] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-09-29T17:17:56.707999] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-29T17:17:56.724300] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-29T17:17:57.148123] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-09-29T17:17:57.893540] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-29T17:17:57.948142] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-09-29T17:17:58.204973] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-29T17:17:58.748114] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-09-29T17:17:59.285176] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-29T17:17:59.548115] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-09-29T17:18:00.348149] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-09-29T17:18:00.516874] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-29T17:18:01.148126] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-09-29T17:18:01.297118] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-29T17:18:01.782222] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-29T17:18:01.886824] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-29T17:18:01.948130] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-09-29T17:18:02.748091] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-09-29T17:18:02.903465] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-29T17:18:03.548162] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-09-29T17:18:04.184755] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-29T17:18:04.348132] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-09-29T17:18:04.529612] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-29T17:18:05.148124] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-09-29T17:18:05.698586] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-29T17:18:05.948135] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-09-29T17:18:06.757343] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-09-29T17:18:06.785602] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-29T17:18:07.281818] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-29T17:18:07.548160] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-09-29T17:18:08.078522] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-29T17:18:08.085792] [INFO ] [REMOTE ] ARW: Full fetch complete (47844 records). [2025-09-29T17:18:08.085913] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-09-29T17:18:08.353310] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-09-29T17:18:08.492334] [DEBUG] [VALIDATOR ] ARW: All expected trading days are present. [2025-09-29T17:18:08.492466] [DEBUG] [VALIDATOR ] ARW: Primary data validation passed. [2025-09-29T17:18:08.493184] [INFO ] [MAIN ] ARW: Fetched primary data is valid. [2025-09-29T17:18:08.493362] [DEBUG] [LOCAL ] ARW: Saving primary data. [2025-09-29T17:18:08.494534] [DEBUG] [LOCAL ] ARW: Trimmed 47844 records to 33065 (keeping 200 days of data) [2025-09-29T17:18:08.604322] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-29T17:18:08.611832] [INFO ] [REMOTE ] ASA: Full fetch complete (18677 records). [2025-09-29T17:18:08.613548] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-09-29T17:18:09.049489] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-09-29T17:18:09.049873] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-09-29T17:18:09.051674] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-09-29T17:18:09.052508] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-09-29T17:18:09.060467] [DEBUG] [LOCAL ] ASA: Trimmed 18677 records to 14041 (keeping 200 days of data) [2025-09-29T17:18:09.152241] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-09-29T17:18:09.233117] [DEBUG] [LOCAL ] ASA: Primary data saved (14041 records). [2025-09-29T17:18:09.234479] [INFO ] [MAIN ] ASA: Full history saved. [2025-09-29T17:18:09.235190] [INFO ] [MAIN ] Update Progress: 151/2371 symbols completed. ASA took 24.5s. Estimated remaining: 4h 26m 11s. Rate: 8.3 symbols/min [2025-09-29T17:18:09.422020] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:18:09.428904] [DEBUG] [LOCAL ] ARW: Primary data saved (33065 records). [2025-09-29T17:18:09.429091] [INFO ] [MAIN ] ARW: Full history saved. [2025-09-29T17:18:09.429203] [INFO ] [MAIN ] Update Progress: 152/2371 symbols completed. ARW took 36.2s. Estimated remaining: 4h 24m 22s. Rate: 8.4 symbols/min [2025-09-29T17:18:09.643843] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:18:09.662595] [DEBUG] [LOCAL ] ASB: Loaded 50299 existing records from primary storage. [2025-09-29T17:18:09.663181] [INFO ] [MAIN ] ASB: Loaded 50299 existing records. [2025-09-29T17:18:09.710718] [DEBUG] [LOCAL ] ASBA: Loaded 3458 existing records from primary storage. [2025-09-29T17:18:09.763245] [INFO ] [MAIN ] ASBA: Loaded 3458 existing records. [2025-09-29T17:18:09.996975] [WARN ] [MAIN ] ASB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:18:10.017919] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-09-29T17:18:10.043289] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-09-29T17:18:10.088970] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:18:10.089676] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-09-29T17:18:10.089825] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-09-29T17:18:10.090136] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-09-29T17:18:10.090221] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-09-29T17:18:10.104562] [DEBUG] [LOCAL ] ASB: Deleted primary data file. [2025-09-29T17:18:10.124726] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-09-29T17:18:10.935065] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:18:10.938902] [INFO ] [REMOTE ] ASB: Fetching primary data for 2024-12. [2025-09-29T17:18:10.938571] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:18:10.939906] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2024-12. [2025-09-29T17:18:10.977501] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (2.62 seconds). [2025-09-29T17:18:11.029485] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-29T17:18:11.548114] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-09-29T17:18:11.659852] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-29T17:18:12.348165] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-09-29T17:18:12.631002] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-29T17:18:13.016903] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-29T17:18:13.148152] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-09-29T17:18:13.531278] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-29T17:18:13.542435] [INFO ] [REMOTE ] AS: Full fetch complete (76132 records). [2025-09-29T17:18:13.542668] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-09-29T17:18:13.543942] [FATAL] [VALIDATOR ] AS: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:18:13.544051] [FATAL] [MAIN ] AS: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:18:13.544098] [WARN ] [MAIN ] AS: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:18:13.544143] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-09-29T17:18:13.544220] [DEBUG] [LOCAL ] AS: No primary data file found to delete. [2025-09-29T17:18:13.544261] [INFO ] [LOCAL ] AS: Starting deletion of derivative data. [2025-09-29T17:18:13.544631] [DEBUG] [LOCAL ] AS: Deleted derivative data file. [2025-09-29T17:18:13.545961] [INFO ] [MAIN ] Update Progress: 153/2371 symbols completed. AS took 35.4s. Estimated remaining: 4h 23m 30s. Rate: 8.4 symbols/min [2025-09-29T17:18:13.752181] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:18:13.799326] [DEBUG] [LOCAL ] ASC: Loaded 38153 existing records from primary storage. [2025-09-29T17:18:13.799694] [INFO ] [MAIN ] ASC: Loaded 38153 existing records. [2025-09-29T17:18:13.958409] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-09-29T17:18:14.006028] [WARN ] [MAIN ] ASC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:18:14.006269] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-09-29T17:18:14.006355] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-09-29T17:18:14.009070] [DEBUG] [LOCAL ] ASC: Deleted primary data file. [2025-09-29T17:18:14.009137] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-09-29T17:18:14.389088] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:18:14.418515] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-29T17:18:14.748104] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-09-29T17:18:15.391333] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-29T17:18:15.412601] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-29T17:18:15.548144] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-09-29T17:18:16.348121] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-09-29T17:18:17.022721] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-29T17:18:17.148076] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-09-29T17:18:17.414171] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-29T17:18:17.948139] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-09-29T17:18:18.748107] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-09-29T17:18:18.786423] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-29T17:18:19.465536] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-29T17:18:19.548112] [INFO ] [REMOTE ] ASC: Fetching primary data for 2024-12. [2025-09-29T17:18:19.903663] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-29T17:18:19.914381] [INFO ] [REMOTE ] ASAN: Full fetch complete (76152 records). [2025-09-29T17:18:19.914521] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-09-29T17:18:19.915389] [FATAL] [VALIDATOR ] ASAN: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:18:19.915494] [FATAL] [MAIN ] ASAN: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:18:19.915539] [WARN ] [MAIN ] ASAN: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:18:19.915582] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-09-29T17:18:19.915670] [DEBUG] [LOCAL ] ASAN: No primary data file found to delete. [2025-09-29T17:18:19.915741] [INFO ] [LOCAL ] ASAN: Starting deletion of derivative data. [2025-09-29T17:18:19.916044] [DEBUG] [LOCAL ] ASAN: Deleted derivative data file. [2025-09-29T17:18:19.916159] [INFO ] [MAIN ] Update Progress: 154/2371 symbols completed. ASAN took 33.3s. Estimated remaining: 4h 23m 12s. Rate: 8.4 symbols/min [2025-09-29T17:18:20.104134] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:18:20.126497] [DEBUG] [LOCAL ] ASG: Loaded 20695 existing records from primary storage. [2025-09-29T17:18:20.126814] [INFO ] [MAIN ] ASG: Loaded 20695 existing records. [2025-09-29T17:18:20.316451] [WARN ] [MAIN ] ASG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:18:20.316720] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-09-29T17:18:20.316781] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-09-29T17:18:20.319336] [DEBUG] [LOCAL ] ASG: Deleted primary data file. [2025-09-29T17:18:20.319400] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-09-29T17:18:20.353270] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-09-29T17:18:20.715721] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:18:20.910957] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-29T17:18:20.914754] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-29T17:18:21.148159] [INFO ] [REMOTE ] ASG: Fetching primary data for 2024-12. [2025-09-29T17:18:21.948131] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-09-29T17:18:22.309883] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-29T17:18:22.748136] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-09-29T17:18:23.541848] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-29T17:18:23.556506] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-09-29T17:18:23.813888] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-29T17:18:24.348148] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-09-29T17:18:25.110949] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-29T17:18:25.148089] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-09-29T17:18:25.707799] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-29T17:18:25.948142] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-09-29T17:18:26.425883] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-29T17:18:26.748133] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-09-29T17:18:27.548129] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-09-29T17:18:27.904272] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-29T17:18:28.343529] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-29T17:18:28.351797] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-09-29T17:18:28.406069] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-29T17:18:29.148135] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-09-29T17:18:29.948124] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-09-29T17:18:29.994894] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-29T17:18:30.203155] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-29T17:18:30.748122] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-09-29T17:18:31.498789] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-29T17:18:31.548072] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-09-29T17:18:32.348138] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-09-29T17:18:32.429305] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-29T17:18:33.071601] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-29T17:18:33.148169] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-09-29T17:18:33.793876] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-29T17:18:33.948132] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-09-29T17:18:34.614381] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-29T17:18:34.748077] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-09-29T17:18:34.992046] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-29T17:18:35.548119] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-09-29T17:18:36.317743] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-29T17:18:36.348071] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-09-29T17:18:37.025419] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-29T17:18:37.148111] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-09-29T17:18:37.694639] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-29T17:18:37.948104] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-09-29T17:18:38.056264] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-29T17:18:38.067263] [INFO ] [REMOTE ] ASB: Full fetch complete (71597 records). [2025-09-29T17:18:38.067452] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-09-29T17:18:38.500311] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present. [2025-09-29T17:18:38.500424] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed. [2025-09-29T17:18:38.501197] [INFO ] [MAIN ] ASB: Fetched primary data is valid. [2025-09-29T17:18:38.501276] [DEBUG] [LOCAL ] ASB: Saving primary data. [2025-09-29T17:18:38.502808] [DEBUG] [LOCAL ] ASB: Trimmed 71597 records to 49512 (keeping 200 days of data) [2025-09-29T17:18:38.615144] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-29T17:18:38.619879] [INFO ] [REMOTE ] ASBA: Full fetch complete (5257 records). [2025-09-29T17:18:38.622677] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-09-29T17:18:38.783121] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-09-29T17:18:39.164779] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-09-29T17:18:39.165102] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-09-29T17:18:39.165797] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-09-29T17:18:39.166148] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-09-29T17:18:39.167426] [DEBUG] [LOCAL ] ASBA: Trimmed 5257 records to 3427 (keeping 200 days of data) [2025-09-29T17:18:39.198098] [DEBUG] [LOCAL ] ASBA: Primary data saved (3427 records). [2025-09-29T17:18:39.198225] [INFO ] [MAIN ] ASBA: Full history saved. [2025-09-29T17:18:39.198353] [INFO ] [MAIN ] Update Progress: 155/2371 symbols completed. ASBA took 29.8s. Estimated remaining: 4h 25m 59s. Rate: 8.3 symbols/min [2025-09-29T17:18:39.443313] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:18:39.463076] [DEBUG] [LOCAL ] ASB: Primary data saved (49512 records). [2025-09-29T17:18:39.463289] [INFO ] [MAIN ] ASB: Full history saved. [2025-09-29T17:18:39.464010] [INFO ] [MAIN ] Update Progress: 156/2371 symbols completed. ASB took 30.2s. Estimated remaining: 4h 24m 13s. Rate: 8.4 symbols/min [2025-09-29T17:18:39.554468] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-09-29T17:18:39.589143] [DEBUG] [LOCAL ] ASGI: Loaded 22711 existing records from primary storage. [2025-09-29T17:18:39.595178] [INFO ] [MAIN ] ASGI: Loaded 22711 existing records. [2025-09-29T17:18:39.788267] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:18:39.879078] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:18:39.879593] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-09-29T17:18:39.879696] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-09-29T17:18:39.881019] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-09-29T17:18:39.881087] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-09-29T17:18:40.084413] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-29T17:18:40.083612] [DEBUG] [LOCAL ] ASGN: Loaded 36554 existing records from primary storage. [2025-09-29T17:18:40.086529] [INFO ] [MAIN ] ASGN: Loaded 36554 existing records. [2025-09-29T17:18:40.355808] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-09-29T17:18:40.475307] [WARN ] [MAIN ] ASGN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:18:40.480954] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-09-29T17:18:40.486193] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-09-29T17:18:40.522246] [DEBUG] [LOCAL ] ASGN: Deleted primary data file. [2025-09-29T17:18:40.545791] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-09-29T17:18:40.549898] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:18:40.939556] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:18:41.098512] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-29T17:18:41.148112] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2024-12. [2025-09-29T17:18:41.358783] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-29T17:18:41.948146] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-09-29T17:18:42.322976] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-29T17:18:42.748154] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-09-29T17:18:43.494740] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-29T17:18:43.548131] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2024-12. [2025-09-29T17:18:43.894901] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-29T17:18:44.348117] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-09-29T17:18:44.790336] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-29T17:18:45.148096] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-09-29T17:18:45.403202] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-29T17:18:45.948132] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-09-29T17:18:46.371837] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-29T17:18:46.748130] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-09-29T17:18:46.928407] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-29T17:18:47.548107] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-09-29T17:18:47.811972] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-29T17:18:48.348104] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-09-29T17:18:48.842833] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-29T17:18:48.847396] [INFO ] [REMOTE ] ASG: Full fetch complete (31255 records). [2025-09-29T17:18:48.847514] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-09-29T17:18:48.848135] [FATAL] [VALIDATOR ] ASG: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:18:48.848253] [FATAL] [MAIN ] ASG: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:18:48.848313] [WARN ] [MAIN ] ASG: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:18:48.848392] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-09-29T17:18:48.848467] [DEBUG] [LOCAL ] ASG: No primary data file found to delete. [2025-09-29T17:18:48.848516] [INFO ] [LOCAL ] ASG: Starting deletion of derivative data. [2025-09-29T17:18:48.848834] [DEBUG] [LOCAL ] ASG: Deleted derivative data file. [2025-09-29T17:18:48.848936] [INFO ] [MAIN ] Update Progress: 157/2371 symbols completed. ASG took 28.9s. Estimated remaining: 4h 24m 38s. Rate: 8.4 symbols/min [2025-09-29T17:18:49.148107] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-09-29T17:18:49.346795] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-29T17:18:49.948107] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-09-29T17:18:50.602512] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-29T17:18:50.610458] [INFO ] [REMOTE ] ASC: Full fetch complete (56567 records). [2025-09-29T17:18:50.610680] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-09-29T17:18:50.611553] [FATAL] [VALIDATOR ] ASC: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:18:50.611672] [FATAL] [MAIN ] ASC: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:18:50.611731] [WARN ] [MAIN ] ASC: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:18:50.611826] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-09-29T17:18:50.611894] [DEBUG] [LOCAL ] ASC: No primary data file found to delete. [2025-09-29T17:18:50.611932] [INFO ] [LOCAL ] ASC: Starting deletion of derivative data. [2025-09-29T17:18:50.612135] [DEBUG] [LOCAL ] ASC: Deleted derivative data file. [2025-09-29T17:18:50.612583] [INFO ] [MAIN ] Update Progress: 158/2371 symbols completed. ASC took 37.1s. Estimated remaining: 4h 23m 15s. Rate: 8.4 symbols/min [2025-09-29T17:18:50.748113] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-09-29T17:18:51.046790] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-29T17:18:51.507305] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-29T17:18:51.548086] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-09-29T17:18:52.348149] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-09-29T17:18:52.664120] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-29T17:18:53.148161] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-09-29T17:18:53.852971] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-29T17:18:53.948100] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-09-29T17:18:54.259559] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-29T17:18:54.748533] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-09-29T17:18:55.523520] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-29T17:18:55.548083] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-09-29T17:18:55.842213] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-29T17:18:56.348113] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-09-29T17:18:56.912018] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-29T17:18:57.148092] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-09-29T17:18:57.471839] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-29T17:18:57.948146] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-09-29T17:18:58.453066] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-29T17:18:58.748130] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-09-29T17:18:59.440353] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-29T17:18:59.446182] [INFO ] [REMOTE ] ASGI: Full fetch complete (33552 records). [2025-09-29T17:18:59.446309] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-09-29T17:18:59.879366] [DEBUG] [VALIDATOR ] ASGI: All expected trading days are present. [2025-09-29T17:18:59.879475] [DEBUG] [VALIDATOR ] ASGI: Primary data validation passed. [2025-09-29T17:18:59.880022] [INFO ] [MAIN ] ASGI: Fetched primary data is valid. [2025-09-29T17:18:59.880088] [DEBUG] [LOCAL ] ASGI: Saving primary data. [2025-09-29T17:18:59.881039] [DEBUG] [LOCAL ] ASGI: Trimmed 33552 records to 22549 (keeping 200 days of data) [2025-09-29T17:19:00.026867] [DEBUG] [LOCAL ] ASGI: Primary data saved (22549 records). [2025-09-29T17:19:00.027140] [INFO ] [MAIN ] ASGI: Full history saved. [2025-09-29T17:19:00.027296] [INFO ] [MAIN ] Update Progress: 159/2371 symbols completed. ASGI took 20.8s. Estimated remaining: 4h 23m 39s. Rate: 8.4 symbols/min [2025-09-29T17:19:00.070555] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-29T17:19:00.084359] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-09-29T17:19:01.645895] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-29T17:19:01.655244] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-09-29T17:19:03.362522] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-29T17:19:03.370775] [INFO ] [REMOTE ] ASGN: Full fetch complete (52050 records). [2025-09-29T17:19:03.370931] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-09-29T17:19:03.780191] [DEBUG] [VALIDATOR ] ASGN: All expected trading days are present. [2025-09-29T17:19:03.780274] [DEBUG] [VALIDATOR ] ASGN: Primary data validation passed. [2025-09-29T17:19:03.780834] [INFO ] [MAIN ] ASGN: Fetched primary data is valid. [2025-09-29T17:19:03.780896] [DEBUG] [LOCAL ] ASGN: Saving primary data. [2025-09-29T17:19:03.781964] [DEBUG] [LOCAL ] ASGN: Trimmed 52050 records to 35955 (keeping 200 days of data) [2025-09-29T17:19:04.000317] [DEBUG] [LOCAL ] ASGN: Primary data saved (35955 records). [2025-09-29T17:19:04.000536] [INFO ] [MAIN ] ASGN: Full history saved. [2025-09-29T17:19:04.000635] [INFO ] [MAIN ] Update Progress: 160/2371 symbols completed. ASGN took 24.5s. Estimated remaining: 4h 22m 48s. Rate: 8.4 symbols/min [2025-09-29T17:19:04.811240] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:19:04.794729] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:19:04.848049] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:19:04.867101] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:19:04.881506] [DEBUG] [LOCAL ] ASR: Loaded 9381 existing records from primary storage. [2025-09-29T17:19:04.881838] [INFO ] [MAIN ] ASR: Loaded 9381 existing records. [2025-09-29T17:19:05.038844] [DEBUG] [LOCAL ] ASIX: Loaded 22834 existing records from primary storage. [2025-09-29T17:19:05.057755] [DEBUG] [LOCAL ] ASH: Loaded 38339 existing records from primary storage. [2025-09-29T17:19:05.068516] [INFO ] [MAIN ] ASH: Loaded 38339 existing records. [2025-09-29T17:19:05.101364] [INFO ] [MAIN ] ASIX: Loaded 22834 existing records. [2025-09-29T17:19:05.302422] [WARN ] [MAIN ] ASR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:19:05.342771] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-09-29T17:19:05.365070] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-09-29T17:19:05.376820] [DEBUG] [LOCAL ] ASPN: Loaded 50293 existing records from primary storage. [2025-09-29T17:19:05.413293] [DEBUG] [LOCAL ] ASR: Deleted primary data file. [2025-09-29T17:19:05.440133] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-09-29T17:19:05.440374] [INFO ] [MAIN ] ASPN: Loaded 50293 existing records. [2025-09-29T17:19:05.732338] [WARN ] [MAIN ] ASIX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:19:05.771285] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-09-29T17:19:05.801674] [WARN ] [MAIN ] ASH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:19:05.830942] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-09-29T17:19:05.850283] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-09-29T17:19:05.850608] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-09-29T17:19:05.857000] [DEBUG] [LOCAL ] ASIX: Deleted primary data file. [2025-09-29T17:19:05.868299] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-09-29T17:19:05.856936] [DEBUG] [LOCAL ] ASH: Deleted primary data file. [2025-09-29T17:19:06.049374] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-09-29T17:19:06.189120] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:19:06.226591] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-09-29T17:19:06.284960] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-09-29T17:19:06.362343] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-09-29T17:19:06.418782] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-09-29T17:19:06.885976] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:19:06.948113] [INFO ] [REMOTE ] ASR: Fetching primary data for 2024-12. [2025-09-29T17:19:07.289294] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:19:07.303056] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:19:07.311195] [INFO ] [REMOTE ] ASH: Fetching primary data for 2024-12. [2025-09-29T17:19:07.332295] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2024-12. [2025-09-29T17:19:07.490106] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:19:07.490471] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2024-12. [2025-09-29T17:19:08.006248] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-29T17:19:08.008434] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-09-29T17:19:08.448040] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-29T17:19:08.451838] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-09-29T17:19:08.780234] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-29T17:19:08.782265] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-09-29T17:19:08.923539] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-29T17:19:08.930918] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-09-29T17:19:09.336312] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-29T17:19:09.347551] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-09-29T17:19:09.527888] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-29T17:19:09.532256] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-09-29T17:19:09.648122] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-29T17:19:09.650221] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-09-29T17:19:10.263733] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-29T17:19:10.267725] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-09-29T17:19:10.359577] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-29T17:19:10.373262] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-29T17:19:10.748164] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-09-29T17:19:10.950199] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-29T17:19:11.342200] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-29T17:19:11.548128] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-09-29T17:19:11.608304] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-29T17:19:12.348118] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-09-29T17:19:12.970563] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-29T17:19:13.148088] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-09-29T17:19:13.210843] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-29T17:19:13.948094] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-09-29T17:19:14.093938] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-29T17:19:14.748119] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-09-29T17:19:15.491484] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-29T17:19:15.518732] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-29T17:19:15.548088] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-09-29T17:19:16.304714] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-29T17:19:16.348130] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-09-29T17:19:17.148123] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-09-29T17:19:17.415122] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-29T17:19:17.948146] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-09-29T17:19:18.682420] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-29T17:19:18.748076] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-09-29T17:19:18.830410] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-29T17:19:19.548126] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-09-29T17:19:20.350684] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-09-29T17:19:20.354066] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-29T17:19:20.357302] [INFO ] [REMOTE ] ASR: Full fetch complete (12336 records). [2025-09-29T17:19:20.357430] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-09-29T17:19:20.358054] [FATAL] [VALIDATOR ] ASR: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:19:20.358167] [FATAL] [MAIN ] ASR: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:19:20.358249] [WARN ] [MAIN ] ASR: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:19:20.358327] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-09-29T17:19:20.358439] [DEBUG] [LOCAL ] ASR: No primary data file found to delete. [2025-09-29T17:19:20.358520] [INFO ] [LOCAL ] ASR: Starting deletion of derivative data. [2025-09-29T17:19:20.358973] [DEBUG] [LOCAL ] ASR: Deleted derivative data file. [2025-09-29T17:19:20.359100] [INFO ] [MAIN ] Update Progress: 161/2371 symbols completed. ASR took 16.4s. Estimated remaining: 4h 24m 48s. Rate: 8.3 symbols/min [2025-09-29T17:19:20.582054] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-29T17:19:20.605732] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:19:20.671925] [DEBUG] [LOCAL ] ASX: Loaded 53639 existing records from primary storage. [2025-09-29T17:19:20.672330] [INFO ] [MAIN ] ASX: Loaded 53639 existing records. [2025-09-29T17:19:20.874716] [WARN ] [MAIN ] ASX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:19:20.875317] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-09-29T17:19:20.875393] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-09-29T17:19:20.880090] [DEBUG] [LOCAL ] ASX: Deleted primary data file. [2025-09-29T17:19:20.880158] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-09-29T17:19:21.153274] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-09-29T17:19:21.254830] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:19:21.948188] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-09-29T17:19:22.240029] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-29T17:19:22.748136] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-09-29T17:19:22.788107] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-29T17:19:23.016389] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-29T17:19:23.548129] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-09-29T17:19:24.348086] [INFO ] [REMOTE ] ASX: Fetching primary data for 2024-12. [2025-09-29T17:19:24.505208] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-29T17:19:24.588229] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-29T17:19:25.148114] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-09-29T17:19:25.948163] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-09-29T17:19:26.249271] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-29T17:19:26.634192] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-29T17:19:26.748109] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-09-29T17:19:26.808867] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-29T17:19:27.548128] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-09-29T17:19:28.348124] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-09-29T17:19:28.990791] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-09-29T17:19:29.038149] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-29T17:19:29.148109] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-09-29T17:19:29.948112] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-09-29T17:19:30.019993] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-29T17:19:30.748135] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-09-29T17:19:30.954993] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-29T17:19:31.548128] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-09-29T17:19:31.585980] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-29T17:19:31.594510] [INFO ] [REMOTE ] ASH: Full fetch complete (54941 records). [2025-09-29T17:19:31.594778] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-09-29T17:19:31.989218] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present. [2025-09-29T17:19:31.989315] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed. [2025-09-29T17:19:31.989915] [INFO ] [MAIN ] ASH: Fetched primary data is valid. [2025-09-29T17:19:31.989980] [DEBUG] [LOCAL ] ASH: Saving primary data. [2025-09-29T17:19:31.991170] [DEBUG] [LOCAL ] ASH: Trimmed 54941 records to 37715 (keeping 200 days of data) [2025-09-29T17:19:32.230874] [DEBUG] [LOCAL ] ASH: Primary data saved (37715 records). [2025-09-29T17:19:32.231003] [INFO ] [MAIN ] ASH: Full history saved. [2025-09-29T17:19:32.231098] [INFO ] [MAIN ] Update Progress: 162/2371 symbols completed. ASH took 28.2s. Estimated remaining: 4h 25m 44s. Rate: 8.3 symbols/min [2025-09-29T17:19:32.353247] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-09-29T17:19:32.414977] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:19:32.463050] [DEBUG] [LOCAL ] ATEN: Loaded 40398 existing records from primary storage. [2025-09-29T17:19:32.463447] [INFO ] [MAIN ] ATEN: Loaded 40398 existing records. [2025-09-29T17:19:32.665632] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-29T17:19:32.690911] [WARN ] [MAIN ] ATEN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:19:32.695259] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-09-29T17:19:32.695459] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-09-29T17:19:32.696365] [INFO ] [REMOTE ] ASIX: Full fetch complete (29786 records). [2025-09-29T17:19:32.696557] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-09-29T17:19:32.697289] [FATAL] [VALIDATOR ] ASIX: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:19:32.697440] [FATAL] [MAIN ] ASIX: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:19:32.697590] [WARN ] [MAIN ] ASIX: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:19:32.714213] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-09-29T17:19:32.709018] [DEBUG] [LOCAL ] ATEN: Deleted primary data file. [2025-09-29T17:19:32.724519] [DEBUG] [LOCAL ] ASIX: No primary data file found to delete. [2025-09-29T17:19:32.727452] [INFO ] [LOCAL ] ASIX: Starting deletion of derivative data. [2025-09-29T17:19:32.724406] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-09-29T17:19:32.778545] [DEBUG] [LOCAL ] ASIX: Deleted derivative data file. [2025-09-29T17:19:32.805845] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-29T17:19:32.811303] [INFO ] [MAIN ] Update Progress: 163/2371 symbols completed. ASIX took 28.8s. Estimated remaining: 4h 24m 7s. Rate: 8.4 symbols/min [2025-09-29T17:19:33.152547] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-09-29T17:19:33.350377] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:19:33.347165] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:19:33.394466] [DEBUG] [LOCAL ] ATGE: Loaded 32251 existing records from primary storage. [2025-09-29T17:19:33.394831] [INFO ] [MAIN ] ATGE: Loaded 32251 existing records. [2025-09-29T17:19:33.580781] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:19:33.581074] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-09-29T17:19:33.581150] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-09-29T17:19:33.585690] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-09-29T17:19:33.585757] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-09-29T17:19:33.948607] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2024-12. [2025-09-29T17:19:33.952020] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:19:34.436468] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-29T17:19:34.748082] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-09-29T17:19:34.830276] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-29T17:19:35.535071] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-29T17:19:35.548079] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-09-29T17:19:36.348107] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-09-29T17:19:36.619630] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-29T17:19:37.005856] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-29T17:19:37.148113] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2024-12. [2025-09-29T17:19:37.851335] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-29T17:19:37.948120] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-09-29T17:19:38.543306] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-29T17:19:38.748127] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-09-29T17:19:39.548138] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-09-29T17:19:39.777071] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-29T17:19:40.251406] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-29T17:19:40.348115] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-09-29T17:19:41.148094] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-09-29T17:19:41.342016] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-29T17:19:41.948110] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-09-29T17:19:42.050490] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-29T17:19:42.568340] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-29T17:19:42.748126] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-09-29T17:19:43.548125] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-09-29T17:19:43.921252] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-29T17:19:43.931451] [INFO ] [REMOTE ] ASPN: Full fetch complete (72279 records). [2025-09-29T17:19:43.931621] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-09-29T17:19:44.341203] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-09-29T17:19:44.341385] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-09-29T17:19:44.342239] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-09-29T17:19:44.342327] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-09-29T17:19:44.344059] [DEBUG] [LOCAL ] ASPN: Trimmed 72279 records to 49585 (keeping 200 days of data) [2025-09-29T17:19:44.348106] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-09-29T17:19:44.499608] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-29T17:19:44.691958] [DEBUG] [LOCAL ] ASPN: Primary data saved (49585 records). [2025-09-29T17:19:44.692107] [INFO ] [MAIN ] ASPN: Full history saved. [2025-09-29T17:19:44.692210] [INFO ] [MAIN ] Update Progress: 164/2371 symbols completed. ASPN took 40.6s. Estimated remaining: 4h 25m 3s. Rate: 8.3 symbols/min [2025-09-29T17:19:44.877248] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:19:44.916782] [DEBUG] [LOCAL ] ATHM: Loaded 33015 existing records from primary storage. [2025-09-29T17:19:44.917102] [INFO ] [MAIN ] ATHM: Loaded 33015 existing records. [2025-09-29T17:19:45.051759] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-29T17:19:45.138401] [WARN ] [MAIN ] ATHM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:19:45.138619] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-09-29T17:19:45.138720] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-09-29T17:19:45.143889] [DEBUG] [LOCAL ] ATHM: Deleted primary data file. [2025-09-29T17:19:45.143955] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-09-29T17:19:45.155518] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-09-29T17:19:45.526352] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:19:45.948090] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-09-29T17:19:46.127738] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-29T17:19:46.748098] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-09-29T17:19:46.921722] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-29T17:19:47.133370] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-29T17:19:47.548125] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-09-29T17:19:48.348107] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2024-12. [2025-09-29T17:19:48.480779] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-29T17:19:48.935136] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-29T17:19:49.148125] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-09-29T17:19:49.948094] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-09-29T17:19:50.054783] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-29T17:19:50.539536] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-29T17:19:50.748111] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-09-29T17:19:50.986771] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-29T17:19:51.548107] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-09-29T17:19:52.280505] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-29T17:19:52.348125] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-09-29T17:19:53.105503] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-29T17:19:53.148110] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-09-29T17:19:53.776844] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-29T17:19:53.948140] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-09-29T17:19:54.333396] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-29T17:19:54.748174] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-09-29T17:19:55.329351] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-29T17:19:55.548128] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-09-29T17:19:56.348137] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-09-29T17:19:56.726891] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-29T17:19:56.738610] [INFO ] [REMOTE ] ASX: Full fetch complete (76591 records). [2025-09-29T17:19:56.738800] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-09-29T17:19:57.033089] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-29T17:19:57.153248] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-09-29T17:19:57.244259] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-09-29T17:19:57.244351] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-09-29T17:19:57.245357] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-09-29T17:19:57.245430] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-09-29T17:19:57.247158] [DEBUG] [LOCAL ] ASX: Trimmed 76591 records to 52837 (keeping 200 days of data) [2025-09-29T17:19:57.582954] [DEBUG] [LOCAL ] ASX: Primary data saved (52837 records). [2025-09-29T17:19:57.583113] [INFO ] [MAIN ] ASX: Full history saved. [2025-09-29T17:19:57.583214] [INFO ] [MAIN ] Update Progress: 165/2371 symbols completed. ASX took 37.2s. Estimated remaining: 4h 26m 12s. Rate: 8.3 symbols/min [2025-09-29T17:19:57.761979] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:19:57.770482] [DEBUG] [LOCAL ] ATHS: Loaded 7145 existing records from primary storage. [2025-09-29T17:19:57.770714] [INFO ] [MAIN ] ATHS: Loaded 7145 existing records. [2025-09-29T17:19:57.955068] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-09-29T17:19:57.960904] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:19:57.962478] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-09-29T17:19:57.962687] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-09-29T17:19:57.963274] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-09-29T17:19:57.963493] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-09-29T17:19:58.106267] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-29T17:19:58.407184] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-29T17:19:58.436916] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:19:58.748132] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-09-29T17:19:59.548153] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-09-29T17:19:59.686693] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-29T17:19:59.695045] [INFO ] [REMOTE ] ATEN: Full fetch complete (57392 records). [2025-09-29T17:19:59.695228] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-09-29T17:20:00.168954] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-09-29T17:20:00.169108] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-09-29T17:20:00.170800] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-09-29T17:20:00.170881] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-09-29T17:20:00.173199] [DEBUG] [LOCAL ] ATEN: Trimmed 57392 records to 39679 (keeping 200 days of data) [2025-09-29T17:20:00.301881] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-29T17:20:00.395981] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-09-29T17:20:00.470215] [DEBUG] [LOCAL ] ATEN: Primary data saved (39679 records). [2025-09-29T17:20:00.470377] [INFO ] [MAIN ] ATEN: Full history saved. [2025-09-29T17:20:00.470466] [INFO ] [MAIN ] Update Progress: 166/2371 symbols completed. ATEN took 28.2s. Estimated remaining: 4h 25m 7s. Rate: 8.3 symbols/min [2025-09-29T17:20:00.652439] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:20:00.709582] [DEBUG] [LOCAL ] ATI: Loaded 52283 existing records from primary storage. [2025-09-29T17:20:00.710036] [INFO ] [MAIN ] ATI: Loaded 52283 existing records. [2025-09-29T17:20:00.906755] [WARN ] [MAIN ] ATI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:20:00.907111] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-09-29T17:20:00.907176] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-09-29T17:20:00.912831] [DEBUG] [LOCAL ] ATI: Deleted primary data file. [2025-09-29T17:20:00.913046] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-09-29T17:20:01.160710] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2024-12. [2025-09-29T17:20:01.297385] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-29T17:20:01.359241] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:20:01.876961] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-29T17:20:01.948196] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-09-29T17:20:02.152637] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-29T17:20:02.748166] [INFO ] [REMOTE ] ATI: Fetching primary data for 2024-12. [2025-09-29T17:20:03.308433] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-29T17:20:03.548142] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-09-29T17:20:04.348163] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-09-29T17:20:04.648711] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-29T17:20:05.023623] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-29T17:20:05.032385] [INFO ] [REMOTE ] ATGE: Full fetch complete (46261 records). [2025-09-29T17:20:05.032583] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-09-29T17:20:05.151576] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-09-29T17:20:05.469716] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-29T17:20:05.495875] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-09-29T17:20:05.496422] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-09-29T17:20:05.497570] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-09-29T17:20:05.497733] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-09-29T17:20:05.499485] [DEBUG] [LOCAL ] ATGE: Trimmed 46261 records to 31631 (keeping 200 days of data) [2025-09-29T17:20:05.740277] [DEBUG] [LOCAL ] ATGE: Primary data saved (31631 records). [2025-09-29T17:20:05.740525] [INFO ] [MAIN ] ATGE: Full history saved. [2025-09-29T17:20:05.740684] [INFO ] [MAIN ] Update Progress: 167/2371 symbols completed. ATGE took 32.9s. Estimated remaining: 4h 24m 34s. Rate: 8.3 symbols/min [2025-09-29T17:20:05.889005] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-29T17:20:05.944867] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:20:05.948090] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-09-29T17:20:05.993593] [DEBUG] [LOCAL ] ATKR: Loaded 36196 existing records from primary storage. [2025-09-29T17:20:05.994130] [INFO ] [MAIN ] ATKR: Loaded 36196 existing records. [2025-09-29T17:20:06.189136] [WARN ] [MAIN ] ATKR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:20:06.189438] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-09-29T17:20:06.189494] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-09-29T17:20:06.192825] [DEBUG] [LOCAL ] ATKR: Deleted primary data file. [2025-09-29T17:20:06.193080] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-09-29T17:20:06.550908] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:20:06.665545] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-29T17:20:06.748136] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-09-29T17:20:07.548179] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-09-29T17:20:07.586912] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-29T17:20:08.348155] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-09-29T17:20:09.078494] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-29T17:20:09.148132] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-09-29T17:20:09.262408] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-29T17:20:09.948142] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-09-29T17:20:10.410990] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-29T17:20:10.663871] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-29T17:20:10.748108] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-09-29T17:20:11.521721] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-29T17:20:11.548078] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-09-29T17:20:12.348124] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-09-29T17:20:12.354956] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-29T17:20:13.148131] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-09-29T17:20:13.948166] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2024-12. [2025-09-29T17:20:14.748174] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-09-29T17:20:14.970536] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-29T17:20:15.155769] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (2.81 seconds). [2025-09-29T17:20:15.158970] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-29T17:20:15.166207] [INFO ] [REMOTE ] ATHM: Full fetch complete (51494 records). [2025-09-29T17:20:15.167367] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-09-29T17:20:15.548822] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-09-29T17:20:15.610910] [DEBUG] [VALIDATOR ] ATHM: All expected trading days are present. [2025-09-29T17:20:15.611310] [DEBUG] [VALIDATOR ] ATHM: Primary data validation passed. [2025-09-29T17:20:15.612062] [INFO ] [MAIN ] ATHM: Fetched primary data is valid. [2025-09-29T17:20:15.612588] [DEBUG] [LOCAL ] ATHM: Saving primary data. [2025-09-29T17:20:15.613792] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-29T17:20:15.623991] [DEBUG] [LOCAL ] ATHM: Trimmed 51494 records to 32365 (keeping 200 days of data) [2025-09-29T17:20:15.824451] [DEBUG] [LOCAL ] ATHM: Primary data saved (32365 records). [2025-09-29T17:20:15.824602] [INFO ] [MAIN ] ATHM: Full history saved. [2025-09-29T17:20:15.824716] [INFO ] [MAIN ] Update Progress: 168/2371 symbols completed. ATHM took 31.1s. Estimated remaining: 4h 25m 5s. Rate: 8.3 symbols/min [2025-09-29T17:20:16.005003] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:20:16.049677] [DEBUG] [LOCAL ] ATMU: Loaded 40274 existing records from primary storage. [2025-09-29T17:20:16.049996] [INFO ] [MAIN ] ATMU: Loaded 40274 existing records. [2025-09-29T17:20:16.238936] [WARN ] [MAIN ] ATMU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:20:16.239215] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-09-29T17:20:16.239264] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-09-29T17:20:16.240237] [DEBUG] [LOCAL ] ATMU: Deleted primary data file. [2025-09-29T17:20:16.240300] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-09-29T17:20:16.353229] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-09-29T17:20:16.621513] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:20:17.148126] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-09-29T17:20:17.948190] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2024-12. [2025-09-29T17:20:18.612112] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-29T17:20:18.748141] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-09-29T17:20:18.843860] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-09-29T17:20:18.985884] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (3.44 seconds). [2025-09-29T17:20:18.995087] [INFO ] [REMOTE ] ATHS: Full fetch complete (10062 records). [2025-09-29T17:20:18.995357] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-09-29T17:20:19.557842] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-09-29T17:20:19.622065] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-09-29T17:20:19.622706] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-09-29T17:20:19.624681] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-29T17:20:19.625239] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-09-29T17:20:19.633486] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-09-29T17:20:19.635100] [DEBUG] [LOCAL ] ATHS: Trimmed 10062 records to 6984 (keeping 200 days of data) [2025-09-29T17:20:19.685888] [DEBUG] [LOCAL ] ATHS: Primary data saved (6984 records). [2025-09-29T17:20:19.686056] [INFO ] [MAIN ] ATHS: Full history saved. [2025-09-29T17:20:19.686153] [INFO ] [MAIN ] Update Progress: 169/2371 symbols completed. ATHS took 22.1s. Estimated remaining: 4h 24m 14s. Rate: 8.3 symbols/min [2025-09-29T17:20:19.879552] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:20:19.929181] [DEBUG] [LOCAL ] ATO: Loaded 42489 existing records from primary storage. [2025-09-29T17:20:19.929520] [INFO ] [MAIN ] ATO: Loaded 42489 existing records. [2025-09-29T17:20:20.152414] [WARN ] [MAIN ] ATO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:20:20.152960] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-09-29T17:20:20.153474] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-09-29T17:20:20.154736] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-29T17:20:20.167570] [DEBUG] [LOCAL ] ATO: Deleted primary data file. [2025-09-29T17:20:20.168638] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-09-29T17:20:20.353734] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-09-29T17:20:20.545913] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:20:21.148159] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-09-29T17:20:21.396257] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-29T17:20:21.948077] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-09-29T17:20:21.988093] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-29T17:20:22.198152] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-29T17:20:22.748151] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-09-29T17:20:23.548128] [INFO ] [REMOTE ] ATO: Fetching primary data for 2024-12. [2025-09-29T17:20:23.732168] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-29T17:20:24.329436] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-29T17:20:24.348097] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-09-29T17:20:25.148152] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-09-29T17:20:25.187367] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-29T17:20:25.401831] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-29T17:20:25.948184] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-09-29T17:20:26.748137] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-09-29T17:20:27.003029] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-29T17:20:27.245100] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-29T17:20:27.548180] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-09-29T17:20:28.345792] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-29T17:20:28.354366] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-09-29T17:20:28.680881] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-29T17:20:29.148120] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-09-29T17:20:29.663396] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-29T17:20:29.948112] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-09-29T17:20:30.748150] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-09-29T17:20:30.846354] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-29T17:20:31.548138] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-09-29T17:20:31.665917] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-29T17:20:32.320891] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-29T17:20:32.348130] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-09-29T17:20:33.148154] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-09-29T17:20:33.375163] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-29T17:20:33.463610] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-29T17:20:33.948104] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-09-29T17:20:34.518768] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-29T17:20:34.748123] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-09-29T17:20:35.548276] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-09-29T17:20:35.809217] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-29T17:20:35.823152] [INFO ] [REMOTE ] ATI: Full fetch complete (73936 records). [2025-09-29T17:20:35.823342] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-09-29T17:20:36.270591] [DEBUG] [VALIDATOR ] ATI: All expected trading days are present. [2025-09-29T17:20:36.272234] [DEBUG] [VALIDATOR ] ATI: Primary data validation passed. [2025-09-29T17:20:36.272147] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-29T17:20:36.273273] [INFO ] [MAIN ] ATI: Fetched primary data is valid. [2025-09-29T17:20:36.280679] [DEBUG] [LOCAL ] ATI: Saving primary data. [2025-09-29T17:20:36.285539] [DEBUG] [LOCAL ] ATI: Trimmed 73936 records to 51503 (keeping 200 days of data) [2025-09-29T17:20:36.372550] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-09-29T17:20:36.607631] [DEBUG] [LOCAL ] ATI: Primary data saved (51503 records). [2025-09-29T17:20:36.607879] [INFO ] [MAIN ] ATI: Full history saved. [2025-09-29T17:20:36.608033] [INFO ] [MAIN ] Update Progress: 170/2371 symbols completed. ATI took 36.1s. Estimated remaining: 4h 26m 13s. Rate: 8.3 symbols/min [2025-09-29T17:20:36.796621] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:20:36.839784] [DEBUG] [LOCAL ] ATR: Loaded 30839 existing records from primary storage. [2025-09-29T17:20:36.840063] [INFO ] [MAIN ] ATR: Loaded 30839 existing records. [2025-09-29T17:20:37.033582] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:20:37.033840] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-09-29T17:20:37.033891] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-09-29T17:20:37.038028] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-09-29T17:20:37.038112] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-09-29T17:20:37.148117] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-09-29T17:20:37.438576] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:20:37.465339] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-29T17:20:37.746873] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-29T17:20:37.948124] [INFO ] [REMOTE ] ATR: Fetching primary data for 2024-12. [2025-09-29T17:20:38.341416] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-29T17:20:38.748123] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-09-29T17:20:39.555712] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-09-29T17:20:39.559801] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-29T17:20:40.321077] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-29T17:20:40.329358] [INFO ] [REMOTE ] ATKR: Full fetch complete (53705 records). [2025-09-29T17:20:40.329526] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-09-29T17:20:40.354129] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-09-29T17:20:40.826849] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-09-29T17:20:40.826956] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-09-29T17:20:40.827721] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-09-29T17:20:40.827790] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-09-29T17:20:40.829381] [DEBUG] [LOCAL ] ATKR: Trimmed 53705 records to 35560 (keeping 200 days of data) [2025-09-29T17:20:41.079997] [DEBUG] [LOCAL ] ATKR: Primary data saved (35560 records). [2025-09-29T17:20:41.080231] [INFO ] [MAIN ] ATKR: Full history saved. [2025-09-29T17:20:41.080462] [INFO ] [MAIN ] Update Progress: 171/2371 symbols completed. ATKR took 35.3s. Estimated remaining: 4h 25m 30s. Rate: 8.3 symbols/min [2025-09-29T17:20:41.151165] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-09-29T17:20:41.267845] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:20:41.297143] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-29T17:20:41.321190] [DEBUG] [LOCAL ] ATS: Loaded 18145 existing records from primary storage. [2025-09-29T17:20:41.321469] [INFO ] [MAIN ] ATS: Loaded 18145 existing records. [2025-09-29T17:20:41.510685] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:20:41.510935] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-09-29T17:20:41.511015] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-09-29T17:20:41.512693] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-09-29T17:20:41.512760] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-09-29T17:20:41.889446] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:20:41.907500] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-29T17:20:41.948111] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-09-29T17:20:42.748119] [INFO ] [REMOTE ] ATS: Fetching primary data for 2024-12. [2025-09-29T17:20:42.821692] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-29T17:20:43.403250] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-29T17:20:43.548121] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-09-29T17:20:43.900361] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-29T17:20:44.348162] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-09-29T17:20:45.148126] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-09-29T17:20:45.229142] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-29T17:20:45.238493] [INFO ] [REMOTE ] ATMU: Full fetch complete (56918 records). [2025-09-29T17:20:45.238708] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-09-29T17:20:45.657438] [DEBUG] [VALIDATOR ] ATMU: All expected trading days are present. [2025-09-29T17:20:45.657540] [DEBUG] [VALIDATOR ] ATMU: Primary data validation passed. [2025-09-29T17:20:45.658235] [INFO ] [MAIN ] ATMU: Fetched primary data is valid. [2025-09-29T17:20:45.658306] [DEBUG] [LOCAL ] ATMU: Saving primary data. [2025-09-29T17:20:45.659620] [DEBUG] [LOCAL ] ATMU: Trimmed 56918 records to 39533 (keeping 200 days of data) [2025-09-29T17:20:45.919183] [DEBUG] [LOCAL ] ATMU: Primary data saved (39533 records). [2025-09-29T17:20:45.919354] [INFO ] [MAIN ] ATMU: Full history saved. [2025-09-29T17:20:45.919457] [INFO ] [MAIN ] Update Progress: 172/2371 symbols completed. ATMU took 30.1s. Estimated remaining: 4h 24m 52s. Rate: 8.3 symbols/min [2025-09-29T17:20:45.953626] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-09-29T17:20:46.112829] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:20:46.150071] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-29T17:20:46.172583] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-29T17:20:46.227591] [DEBUG] [LOCAL ] ATUS: Loaded 49958 existing records from primary storage. [2025-09-29T17:20:46.227965] [INFO ] [MAIN ] ATUS: Loaded 49958 existing records. [2025-09-29T17:20:46.427821] [WARN ] [MAIN ] ATUS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:20:46.428142] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-09-29T17:20:46.428223] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-09-29T17:20:46.431500] [DEBUG] [LOCAL ] ATUS: Deleted primary data file. [2025-09-29T17:20:46.431571] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-09-29T17:20:46.753225] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-09-29T17:20:46.828145] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:20:46.845350] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-29T17:20:47.548108] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-09-29T17:20:48.348116] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-09-29T17:20:48.466861] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-29T17:20:48.937607] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-29T17:20:49.148119] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-09-29T17:20:49.337879] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-29T17:20:49.948134] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-09-29T17:20:50.653695] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-29T17:20:50.748085] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2024-12. [2025-09-29T17:20:50.887735] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-29T17:20:51.548148] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-09-29T17:20:52.348157] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-09-29T17:20:52.699787] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-29T17:20:53.123345] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-29T17:20:53.148106] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-09-29T17:20:53.859422] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-29T17:20:53.948109] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-09-29T17:20:54.713312] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-29T17:20:54.748154] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-09-29T17:20:55.165697] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-29T17:20:55.548178] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-09-29T17:20:56.113978] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-29T17:20:56.348168] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-09-29T17:20:56.602780] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-29T17:20:57.148129] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-09-29T17:20:57.706263] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-29T17:20:57.948141] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-09-29T17:20:58.748091] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-09-29T17:20:58.992475] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-29T17:20:59.001178] [INFO ] [REMOTE ] ATO: Full fetch complete (60495 records). [2025-09-29T17:20:59.001310] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-09-29T17:20:59.408296] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-09-29T17:20:59.408400] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-09-29T17:20:59.409059] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-09-29T17:20:59.409137] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-09-29T17:20:59.410460] [DEBUG] [LOCAL ] ATO: Trimmed 60495 records to 41864 (keeping 200 days of data) [2025-09-29T17:20:59.546063] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-29T17:20:59.555669] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-09-29T17:20:59.746923] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-29T17:20:59.753847] [DEBUG] [LOCAL ] ATO: Primary data saved (41864 records). [2025-09-29T17:20:59.753995] [INFO ] [MAIN ] ATO: Full history saved. [2025-09-29T17:20:59.755823] [INFO ] [MAIN ] Update Progress: 173/2371 symbols completed. ATO took 40.1s. Estimated remaining: 4h 26m 8s. Rate: 8.3 symbols/min [2025-09-29T17:20:59.938771] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:21:00.002242] [DEBUG] [LOCAL ] AU: Loaded 53715 existing records from primary storage. [2025-09-29T17:21:00.002594] [INFO ] [MAIN ] AU: Loaded 53715 existing records. [2025-09-29T17:21:00.193204] [WARN ] [MAIN ] AU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:21:00.193422] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-09-29T17:21:00.193472] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-09-29T17:21:00.195054] [DEBUG] [LOCAL ] AU: Deleted primary data file. [2025-09-29T17:21:00.195148] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-09-29T17:21:00.355159] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-09-29T17:21:00.589173] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:21:00.985668] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-29T17:21:01.148140] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-09-29T17:21:01.502571] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-29T17:21:01.948167] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-09-29T17:21:02.755615] [INFO ] [REMOTE ] AU: Fetching primary data for 2024-12. [2025-09-29T17:21:02.758430] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-29T17:21:03.436891] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-29T17:21:03.443919] [INFO ] [REMOTE ] ATR: Full fetch complete (43472 records). [2025-09-29T17:21:03.444054] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-09-29T17:21:03.553421] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-09-29T17:21:03.865663] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present. [2025-09-29T17:21:03.865787] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed. [2025-09-29T17:21:03.866335] [INFO ] [MAIN ] ATR: Fetched primary data is valid. [2025-09-29T17:21:03.866399] [DEBUG] [LOCAL ] ATR: Saving primary data. [2025-09-29T17:21:03.867527] [DEBUG] [LOCAL ] ATR: Trimmed 43472 records to 30406 (keeping 200 days of data) [2025-09-29T17:21:04.068930] [DEBUG] [LOCAL ] ATR: Primary data saved (30406 records). [2025-09-29T17:21:04.069128] [INFO ] [MAIN ] ATR: Full history saved. [2025-09-29T17:21:04.069224] [INFO ] [MAIN ] Update Progress: 174/2371 symbols completed. ATR took 27.5s. Estimated remaining: 4h 25m 24s. Rate: 8.3 symbols/min [2025-09-29T17:21:04.255344] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:21:04.322509] [DEBUG] [LOCAL ] AUB: Loaded 47072 existing records from primary storage. [2025-09-29T17:21:04.322859] [INFO ] [MAIN ] AUB: Loaded 47072 existing records. [2025-09-29T17:21:04.362147] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-09-29T17:21:04.552182] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:21:04.552491] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-09-29T17:21:04.552568] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-09-29T17:21:04.564624] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-09-29T17:21:04.585797] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-09-29T17:21:04.653454] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-29T17:21:05.050865] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:21:05.148161] [INFO ] [REMOTE ] AUB: Fetching primary data for 2024-12. [2025-09-29T17:21:05.247343] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-29T17:21:05.318180] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-29T17:21:05.948166] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-09-29T17:21:06.748159] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-09-29T17:21:06.863898] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-29T17:21:06.868235] [INFO ] [REMOTE ] ATS: Full fetch complete (25635 records). [2025-09-29T17:21:06.868370] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-09-29T17:21:07.252328] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-29T17:21:07.326581] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present. [2025-09-29T17:21:07.326692] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed. [2025-09-29T17:21:07.327082] [INFO ] [MAIN ] ATS: Fetched primary data is valid. [2025-09-29T17:21:07.327127] [DEBUG] [LOCAL ] ATS: Saving primary data. [2025-09-29T17:21:07.327967] [DEBUG] [LOCAL ] ATS: Trimmed 25635 records to 17851 (keeping 200 days of data) [2025-09-29T17:21:07.436907] [DEBUG] [LOCAL ] ATS: Primary data saved (17851 records). [2025-09-29T17:21:07.437064] [INFO ] [MAIN ] ATS: Full history saved. [2025-09-29T17:21:07.437155] [INFO ] [MAIN ] Update Progress: 175/2371 symbols completed. ATS took 26.4s. Estimated remaining: 4h 24m 28s. Rate: 8.3 symbols/min [2025-09-29T17:21:07.555744] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-09-29T17:21:07.638666] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:21:07.645299] [DEBUG] [LOCAL ] AUNA: Loaded 4966 existing records from primary storage. [2025-09-29T17:21:07.645487] [INFO ] [MAIN ] AUNA: Loaded 4966 existing records. [2025-09-29T17:21:07.831941] [WARN ] [MAIN ] AUNA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:21:07.832171] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-09-29T17:21:07.832226] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-09-29T17:21:07.832769] [DEBUG] [LOCAL ] AUNA: Deleted primary data file. [2025-09-29T17:21:07.832835] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-09-29T17:21:08.225691] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:21:08.348085] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2024-12. [2025-09-29T17:21:08.626079] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-29T17:21:09.074711] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-29T17:21:09.148153] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-09-29T17:21:09.231239] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-29T17:21:09.948149] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-09-29T17:21:10.637204] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-29T17:21:10.653173] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-29T17:21:10.748182] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-09-29T17:21:11.384798] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-29T17:21:11.548115] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-09-29T17:21:12.350037] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-09-29T17:21:12.352190] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-29T17:21:13.148126] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-09-29T17:21:13.822584] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-29T17:21:13.948107] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-09-29T17:21:14.748189] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-09-29T17:21:15.141815] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-29T17:21:15.548195] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-09-29T17:21:15.668838] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-29T17:21:16.348129] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-09-29T17:21:16.383353] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-29T17:21:17.148126] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-09-29T17:21:17.221534] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-29T17:21:17.738819] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-29T17:21:17.948152] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-09-29T17:21:18.366373] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-29T17:21:18.748078] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-09-29T17:21:18.964067] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-29T17:21:19.548130] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-09-29T17:21:20.201281] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-29T17:21:20.348133] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-09-29T17:21:20.981284] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-29T17:21:21.068729] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-29T17:21:21.148148] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-09-29T17:21:21.789315] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-29T17:21:21.948121] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-09-29T17:21:22.571142] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-29T17:21:22.748141] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-09-29T17:21:23.548191] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-09-29T17:21:24.348204] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-09-29T17:21:24.505361] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-29T17:21:25.152344] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-09-29T17:21:25.158242] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-29T17:21:25.957437] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-09-29T17:21:25.984866] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-29T17:21:26.748188] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-09-29T17:21:27.024032] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-29T17:21:27.548092] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-09-29T17:21:27.626224] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-29T17:21:28.346061] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-29T17:21:28.348089] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-09-29T17:21:28.349680] [INFO ] [REMOTE ] AUNA: Full fetch complete (7669 records). [2025-09-29T17:21:28.349825] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-09-29T17:21:28.541032] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-29T17:21:28.600091] [INFO ] [REMOTE ] ATUS: Full fetch complete (70918 records). [2025-09-29T17:21:28.630443] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-09-29T17:21:29.051555] [DEBUG] [VALIDATOR ] AUNA: All expected trading days are present. [2025-09-29T17:21:29.067044] [DEBUG] [VALIDATOR ] AUNA: Primary data validation passed. [2025-09-29T17:21:29.108308] [INFO ] [MAIN ] AUNA: Fetched primary data is valid. [2025-09-29T17:21:29.108525] [DEBUG] [LOCAL ] AUNA: Saving primary data. [2025-09-29T17:21:29.109441] [DEBUG] [LOCAL ] AUNA: Trimmed 7669 records to 4872 (keeping 200 days of data) [2025-09-29T17:21:29.182454] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-09-29T17:21:29.235739] [DEBUG] [LOCAL ] AUNA: Primary data saved (4872 records). [2025-09-29T17:21:29.285032] [INFO ] [MAIN ] AUNA: Full history saved. [2025-09-29T17:21:29.285267] [INFO ] [MAIN ] Update Progress: 176/2371 symbols completed. AUNA took 21.8s. Estimated remaining: 4h 27m 23s. Rate: 8.2 symbols/min [2025-09-29T17:21:29.744919] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:21:29.770540] [DEBUG] [VALIDATOR ] ATUS: All expected trading days are present. [2025-09-29T17:21:29.771219] [DEBUG] [VALIDATOR ] ATUS: Primary data validation passed. [2025-09-29T17:21:29.772029] [INFO ] [MAIN ] ATUS: Fetched primary data is valid. [2025-09-29T17:21:29.772095] [DEBUG] [LOCAL ] ATUS: Saving primary data. [2025-09-29T17:21:29.774389] [DEBUG] [LOCAL ] ATUS: Trimmed 70918 records to 49225 (keeping 200 days of data) [2025-09-29T17:21:29.921915] [DEBUG] [LOCAL ] AVA: Loaded 40183 existing records from primary storage. [2025-09-29T17:21:29.923443] [INFO ] [MAIN ] AVA: Loaded 40183 existing records. [2025-09-29T17:21:30.142935] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:21:30.148317] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-09-29T17:21:30.148440] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-09-29T17:21:30.152635] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-09-29T17:21:30.152844] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-09-29T17:21:30.661701] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-29T17:21:30.758211] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-09-29T17:21:30.757238] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:21:30.761489] [INFO ] [REMOTE ] AVA: Fetching primary data for 2024-12. [2025-09-29T17:21:30.803174] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-29T17:21:30.876379] [DEBUG] [LOCAL ] ATUS: Primary data saved (49225 records). [2025-09-29T17:21:30.876544] [INFO ] [MAIN ] ATUS: Full history saved. [2025-09-29T17:21:30.876668] [INFO ] [MAIN ] Update Progress: 177/2371 symbols completed. ATUS took 45.0s. Estimated remaining: 4h 26m 5s. Rate: 8.2 symbols/min [2025-09-29T17:21:31.056888] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:21:31.069762] [DEBUG] [LOCAL ] AVAL: Loaded 9040 existing records from primary storage. [2025-09-29T17:21:31.070019] [INFO ] [MAIN ] AVAL: Loaded 9040 existing records. [2025-09-29T17:21:31.258877] [WARN ] [MAIN ] AVAL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:21:31.259172] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-09-29T17:21:31.259231] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-09-29T17:21:31.261217] [DEBUG] [LOCAL ] AVAL: Deleted primary data file. [2025-09-29T17:21:31.261284] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-09-29T17:21:31.553251] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-09-29T17:21:31.676841] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:21:32.133862] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-29T17:21:32.348112] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-09-29T17:21:32.833558] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-29T17:21:33.143433] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-29T17:21:33.152581] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2024-12. [2025-09-29T17:21:33.677675] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-29T17:21:33.707933] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-29T17:21:33.948111] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-09-29T17:21:34.641269] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-29T17:21:34.748124] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-09-29T17:21:35.548111] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-09-29T17:21:35.623386] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-29T17:21:36.348364] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-09-29T17:21:37.148103] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-09-29T17:21:37.235547] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-29T17:21:37.244981] [INFO ] [REMOTE ] AUB: Full fetch complete (65568 records). [2025-09-29T17:21:37.245119] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-09-29T17:21:37.392736] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-29T17:21:37.691587] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-09-29T17:21:37.691717] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-09-29T17:21:37.692506] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-09-29T17:21:37.692561] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-09-29T17:21:37.694082] [DEBUG] [LOCAL ] AUB: Trimmed 65568 records to 46313 (keeping 200 days of data) [2025-09-29T17:21:37.948134] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-09-29T17:21:37.995685] [DEBUG] [LOCAL ] AUB: Primary data saved (46313 records). [2025-09-29T17:21:37.995854] [INFO ] [MAIN ] AUB: Full history saved. [2025-09-29T17:21:37.995946] [INFO ] [MAIN ] Update Progress: 178/2371 symbols completed. AUB took 33.9s. Estimated remaining: 4h 25m 56s. Rate: 8.2 symbols/min [2025-09-29T17:21:38.198633] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:21:38.256789] [DEBUG] [LOCAL ] AVB: Loaded 42457 existing records from primary storage. [2025-09-29T17:21:38.257182] [INFO ] [MAIN ] AVB: Loaded 42457 existing records. [2025-09-29T17:21:38.457709] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:21:38.458191] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-09-29T17:21:38.458277] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-09-29T17:21:38.458977] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-09-29T17:21:38.459228] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-09-29T17:21:38.750437] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-09-29T17:21:38.908193] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:21:38.917178] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-29T17:21:38.930046] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-29T17:21:39.548107] [INFO ] [REMOTE ] AVB: Fetching primary data for 2024-12. [2025-09-29T17:21:40.348328] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-09-29T17:21:41.044839] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-09-29T17:21:41.092147] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-29T17:21:41.090385] [INFO ] [REMOTE ] AU: Full fetch complete (76271 records). [2025-09-29T17:21:41.100944] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-09-29T17:21:41.160477] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-09-29T17:21:41.548303] [DEBUG] [VALIDATOR ] AU: All expected trading days are present. [2025-09-29T17:21:41.548401] [DEBUG] [VALIDATOR ] AU: Primary data validation passed. [2025-09-29T17:21:41.549188] [INFO ] [MAIN ] AU: Fetched primary data is valid. [2025-09-29T17:21:41.549258] [DEBUG] [LOCAL ] AU: Saving primary data. [2025-09-29T17:21:41.552135] [DEBUG] [LOCAL ] AU: Trimmed 76271 records to 52987 (keeping 200 days of data) [2025-09-29T17:21:41.919572] [DEBUG] [LOCAL ] AU: Primary data saved (52987 records). [2025-09-29T17:21:41.919761] [INFO ] [MAIN ] AU: Full history saved. [2025-09-29T17:21:41.922057] [INFO ] [MAIN ] Update Progress: 179/2371 symbols completed. AU took 42.2s. Estimated remaining: 4h 25m 7s. Rate: 8.3 symbols/min [2025-09-29T17:21:41.957109] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-09-29T17:21:42.098448] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-29T17:21:42.171913] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-29T17:21:42.174982] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:21:42.185563] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-09-29T17:21:42.186020] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-09-29T17:21:42.186163] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-09-29T17:21:42.186217] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-29T17:21:42.186286] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-29T17:21:42.186322] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-09-29T17:21:42.587253] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:21:42.748119] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-09-29T17:21:43.538281] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-29T17:21:43.548067] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-09-29T17:21:43.558522] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-29T17:21:44.348111] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2024-12. [2025-09-29T17:21:44.641891] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T17:21:44.642244] [WARN ] [REMOTE ] AVBC: No data returned for month 2024-12 [2025-09-29T17:21:44.642330] [FATAL] [REMOTE ] AVBC: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T17:21:44.642378] [FATAL] [MAIN ] AVBC: Failed to fetch primary data. [2025-09-29T17:21:44.642413] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T17:21:44.642453] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-29T17:21:44.642512] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-29T17:21:44.642551] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-09-29T17:21:44.642610] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-09-29T17:21:44.642713] [INFO ] [MAIN ] Update Progress: 180/2371 symbols completed. AVBC took 2.7s. Estimated remaining: 4h 24m 5s. Rate: 8.3 symbols/min [2025-09-29T17:21:44.835108] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:21:44.859339] [DEBUG] [LOCAL ] AVD: Loaded 23030 existing records from primary storage. [2025-09-29T17:21:44.859593] [INFO ] [MAIN ] AVD: Loaded 23030 existing records. [2025-09-29T17:21:45.047509] [WARN ] [MAIN ] AVD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:21:45.047762] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-09-29T17:21:45.047816] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-09-29T17:21:45.048225] [DEBUG] [LOCAL ] AVD: Deleted primary data file. [2025-09-29T17:21:45.048289] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-09-29T17:21:45.152568] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-09-29T17:21:45.437242] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:21:45.459209] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-29T17:21:45.948134] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-09-29T17:21:46.381565] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-29T17:21:46.748119] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-09-29T17:21:47.538584] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-29T17:21:47.548057] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-09-29T17:21:48.104759] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-29T17:21:48.348120] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-09-29T17:21:49.148092] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-09-29T17:21:49.182755] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-29T17:21:49.220119] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-29T17:21:49.948138] [INFO ] [REMOTE ] AVD: Fetching primary data for 2024-12. [2025-09-29T17:21:50.731167] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-29T17:21:50.748079] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-09-29T17:21:51.181575] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-29T17:21:51.548156] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-09-29T17:21:52.282846] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-29T17:21:52.348108] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-09-29T17:21:52.383163] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-29T17:21:53.148141] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-09-29T17:21:53.957444] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-09-29T17:21:53.976687] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-29T17:21:54.634436] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-29T17:21:54.748128] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-09-29T17:21:54.884024] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-29T17:21:55.548126] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-09-29T17:21:56.355052] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-09-29T17:21:56.360638] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-29T17:21:56.369815] [INFO ] [REMOTE ] AVA: Full fetch complete (55724 records). [2025-09-29T17:21:56.369980] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-09-29T17:21:56.440800] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-29T17:21:56.883501] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-09-29T17:21:56.883600] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-09-29T17:21:56.884371] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-09-29T17:21:56.884445] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-09-29T17:21:56.885847] [DEBUG] [LOCAL ] AVA: Trimmed 55724 records to 39461 (keeping 200 days of data) [2025-09-29T17:21:57.138020] [DEBUG] [LOCAL ] AVA: Primary data saved (39461 records). [2025-09-29T17:21:57.138190] [INFO ] [MAIN ] AVA: Full history saved. [2025-09-29T17:21:57.138318] [INFO ] [MAIN ] Update Progress: 181/2371 symbols completed. AVA took 27.9s. Estimated remaining: 4h 25m 1s. Rate: 8.3 symbols/min [2025-09-29T17:21:57.154049] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-09-29T17:21:57.353155] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:21:57.381115] [DEBUG] [LOCAL ] AVK: Loaded 18064 existing records from primary storage. [2025-09-29T17:21:57.381435] [INFO ] [MAIN ] AVK: Loaded 18064 existing records. [2025-09-29T17:21:57.584786] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:21:57.585127] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-09-29T17:21:57.585205] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-09-29T17:21:57.585628] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-09-29T17:21:57.585725] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-09-29T17:21:57.948280] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-09-29T17:21:57.993388] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:21:58.022302] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-29T17:21:58.079405] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-29T17:21:58.748186] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-09-29T17:21:58.838711] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-29T17:21:58.840680] [INFO ] [REMOTE ] AVAL: Full fetch complete (14605 records). [2025-09-29T17:21:58.840865] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-09-29T17:21:59.303132] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present. [2025-09-29T17:21:59.303258] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed. [2025-09-29T17:21:59.303709] [INFO ] [MAIN ] AVAL: Fetched primary data is valid. [2025-09-29T17:21:59.303784] [DEBUG] [LOCAL ] AVAL: Saving primary data. [2025-09-29T17:21:59.304708] [DEBUG] [LOCAL ] AVAL: Trimmed 14605 records to 8780 (keeping 200 days of data) [2025-09-29T17:21:59.370044] [DEBUG] [LOCAL ] AVAL: Primary data saved (8780 records). [2025-09-29T17:21:59.370203] [INFO ] [MAIN ] AVAL: Full history saved. [2025-09-29T17:21:59.370296] [INFO ] [MAIN ] Update Progress: 182/2371 symbols completed. AVAL took 28.5s. Estimated remaining: 4h 23m 54s. Rate: 8.3 symbols/min [2025-09-29T17:21:59.549960] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-09-29T17:21:59.551603] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:21:59.597579] [DEBUG] [LOCAL ] AVNS: Loaded 34132 existing records from primary storage. [2025-09-29T17:21:59.597977] [INFO ] [MAIN ] AVNS: Loaded 34132 existing records. [2025-09-29T17:21:59.790240] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:21:59.790442] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-09-29T17:21:59.790490] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-09-29T17:21:59.790944] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-09-29T17:21:59.791005] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-09-29T17:21:59.988951] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-29T17:22:00.288117] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:22:00.348159] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2024-12. [2025-09-29T17:22:01.100690] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-29T17:22:01.148161] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-09-29T17:22:01.861284] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-29T17:22:01.948157] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-09-29T17:22:02.577765] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-29T17:22:02.748138] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-09-29T17:22:03.178200] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-29T17:22:03.548136] [INFO ] [REMOTE ] AVK: Fetching primary data for 2024-12. [2025-09-29T17:22:04.113787] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-29T17:22:04.348125] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-09-29T17:22:04.774019] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-29T17:22:05.148133] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-09-29T17:22:05.677046] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-29T17:22:05.948148] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-09-29T17:22:06.212857] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-29T17:22:06.640571] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-29T17:22:06.748179] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-09-29T17:22:07.548165] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-09-29T17:22:08.090821] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-29T17:22:08.348115] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-09-29T17:22:08.595126] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-29T17:22:09.148153] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-09-29T17:22:09.783127] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-29T17:22:09.948146] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-09-29T17:22:10.157795] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-29T17:22:10.748140] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-09-29T17:22:11.031943] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-29T17:22:11.548164] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-09-29T17:22:12.348110] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-09-29T17:22:12.454254] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-29T17:22:12.463740] [INFO ] [REMOTE ] AVB: Full fetch complete (58478 records). [2025-09-29T17:22:12.463910] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-09-29T17:22:12.869550] [DEBUG] [VALIDATOR ] AVB: All expected trading days are present. [2025-09-29T17:22:12.869629] [DEBUG] [VALIDATOR ] AVB: Primary data validation passed. [2025-09-29T17:22:12.870416] [INFO ] [MAIN ] AVB: Fetched primary data is valid. [2025-09-29T17:22:12.870483] [DEBUG] [LOCAL ] AVB: Saving primary data. [2025-09-29T17:22:12.871789] [DEBUG] [LOCAL ] AVB: Trimmed 58478 records to 41892 (keeping 200 days of data) [2025-09-29T17:22:13.148560] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-29T17:22:13.149052] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-09-29T17:22:13.182752] [DEBUG] [LOCAL ] AVB: Primary data saved (41892 records). [2025-09-29T17:22:13.182925] [INFO ] [MAIN ] AVB: Full history saved. [2025-09-29T17:22:13.183021] [INFO ] [MAIN ] Update Progress: 183/2371 symbols completed. AVB took 35.2s. Estimated remaining: 4h 25m 5s. Rate: 8.3 symbols/min [2025-09-29T17:22:13.366797] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:22:13.413878] [DEBUG] [LOCAL ] AVNT: Loaded 39887 existing records from primary storage. [2025-09-29T17:22:13.414208] [INFO ] [MAIN ] AVNT: Loaded 39887 existing records. [2025-09-29T17:22:13.601327] [WARN ] [MAIN ] AVNT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:22:13.601795] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-09-29T17:22:13.601912] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-09-29T17:22:13.611008] [DEBUG] [LOCAL ] AVNT: Deleted primary data file. [2025-09-29T17:22:13.617913] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-09-29T17:22:13.685704] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-29T17:22:13.949802] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-09-29T17:22:14.022581] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-29T17:22:14.049936] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:22:14.748127] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-09-29T17:22:15.329317] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-29T17:22:15.548173] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-09-29T17:22:15.852533] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-29T17:22:15.857343] [INFO ] [REMOTE ] AVD: Full fetch complete (33788 records). [2025-09-29T17:22:15.857453] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-09-29T17:22:16.250704] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present. [2025-09-29T17:22:16.250790] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed. [2025-09-29T17:22:16.251212] [INFO ] [MAIN ] AVD: Fetched primary data is valid. [2025-09-29T17:22:16.251252] [DEBUG] [LOCAL ] AVD: Saving primary data. [2025-09-29T17:22:16.252031] [DEBUG] [LOCAL ] AVD: Trimmed 33788 records to 22711 (keeping 200 days of data) [2025-09-29T17:22:16.350284] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-09-29T17:22:16.383943] [DEBUG] [LOCAL ] AVD: Primary data saved (22711 records). [2025-09-29T17:22:16.384085] [INFO ] [MAIN ] AVD: Full history saved. [2025-09-29T17:22:16.384172] [INFO ] [MAIN ] Update Progress: 184/2371 symbols completed. AVD took 31.7s. Estimated remaining: 4h 24m 9s. Rate: 8.3 symbols/min [2025-09-29T17:22:16.564985] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:22:16.627287] [DEBUG] [LOCAL ] AVTR: Loaded 54345 existing records from primary storage. [2025-09-29T17:22:16.627887] [INFO ] [MAIN ] AVTR: Loaded 54345 existing records. [2025-09-29T17:22:16.828091] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-29T17:22:16.862731] [WARN ] [MAIN ] AVTR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:22:16.863384] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-09-29T17:22:16.863436] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-09-29T17:22:16.869771] [DEBUG] [LOCAL ] AVTR: Deleted primary data file. [2025-09-29T17:22:16.869860] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-09-29T17:22:17.149565] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-09-29T17:22:17.262418] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-29T17:22:17.300813] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:22:17.948122] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2024-12. [2025-09-29T17:22:18.287697] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-29T17:22:18.298065] [INFO ] [REMOTE ] AVNS: Full fetch complete (48123 records). [2025-09-29T17:22:18.298263] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-09-29T17:22:18.714101] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-09-29T17:22:18.714191] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-09-29T17:22:18.714752] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-09-29T17:22:18.714836] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-09-29T17:22:18.716125] [DEBUG] [LOCAL ] AVNS: Trimmed 48123 records to 33542 (keeping 200 days of data) [2025-09-29T17:22:18.769465] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2024-12. [2025-09-29T17:22:18.926106] [DEBUG] [LOCAL ] AVNS: Primary data saved (33542 records). [2025-09-29T17:22:18.926256] [INFO ] [MAIN ] AVNS: Full history saved. [2025-09-29T17:22:18.926344] [INFO ] [MAIN ] Update Progress: 185/2371 symbols completed. AVNS took 19.6s. Estimated remaining: 4h 23m 7s. Rate: 8.3 symbols/min [2025-09-29T17:22:19.111533] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:22:19.156455] [DEBUG] [LOCAL ] AVY: Loaded 38102 existing records from primary storage. [2025-09-29T17:22:19.156840] [INFO ] [MAIN ] AVY: Loaded 38102 existing records. [2025-09-29T17:22:19.365715] [WARN ] [MAIN ] AVY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:22:19.374977] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-09-29T17:22:19.376255] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-29T17:22:19.376550] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-09-29T17:22:19.390077] [DEBUG] [LOCAL ] AVY: Deleted primary data file. [2025-09-29T17:22:19.390236] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-09-29T17:22:19.553369] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-09-29T17:22:19.788353] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:22:20.348085] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-09-29T17:22:20.708045] [DEBUG] [REMOTE ] AVNT: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-09-29T17:22:20.713902] [WARN ] [REMOTE ] AVNT: No data returned for month 2025-01 [2025-09-29T17:22:20.720994] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-29T17:22:20.722095] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-29T17:22:20.721074] [FATAL] [REMOTE ] AVNT: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T17:22:20.737112] [FATAL] [MAIN ] AVNT: Failed to fetch primary data. [2025-09-29T17:22:20.737294] [WARN ] [MAIN ] AVNT: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T17:22:20.737875] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-09-29T17:22:20.737985] [DEBUG] [LOCAL ] AVNT: No primary data file found to delete. [2025-09-29T17:22:20.738053] [INFO ] [LOCAL ] AVNT: Starting deletion of derivative data. [2025-09-29T17:22:20.739746] [DEBUG] [LOCAL ] AVNT: Deleted derivative data file. [2025-09-29T17:22:20.739838] [INFO ] [MAIN ] Update Progress: 186/2371 symbols completed. AVNT took 7.6s. Estimated remaining: 4h 21m 56s. Rate: 8.3 symbols/min [2025-09-29T17:22:20.978212] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:22:21.007362] [DEBUG] [LOCAL ] AWF: Loaded 24608 existing records from primary storage. [2025-09-29T17:22:21.007623] [INFO ] [MAIN ] AWF: Loaded 24608 existing records. [2025-09-29T17:22:21.153265] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-09-29T17:22:21.232351] [WARN ] [MAIN ] AWF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:22:21.232580] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-09-29T17:22:21.232630] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-09-29T17:22:21.236175] [DEBUG] [LOCAL ] AWF: Deleted primary data file. [2025-09-29T17:22:21.236282] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-09-29T17:22:21.674790] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:22:21.948201] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-09-29T17:22:22.748107] [INFO ] [REMOTE ] AWF: Fetching primary data for 2024-12. [2025-09-29T17:22:22.870746] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-29T17:22:22.979818] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-29T17:22:23.548146] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-09-29T17:22:23.702258] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-29T17:22:24.348107] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-09-29T17:22:24.589389] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-29T17:22:25.148158] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-09-29T17:22:25.485356] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-29T17:22:25.948137] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-09-29T17:22:26.189393] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-29T17:22:26.748130] [INFO ] [REMOTE ] AVY: Fetching primary data for 2024-12. [2025-09-29T17:22:27.095848] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-29T17:22:27.548161] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-09-29T17:22:28.348098] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-09-29T17:22:28.448959] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-29T17:22:28.694271] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-29T17:22:29.148145] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-09-29T17:22:29.948152] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-09-29T17:22:30.116460] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-29T17:22:30.398457] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-29T17:22:30.748169] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-09-29T17:22:31.159331] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-29T17:22:31.163734] [INFO ] [REMOTE ] AVK: Full fetch complete (26593 records). [2025-09-29T17:22:31.163842] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-09-29T17:22:31.556158] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-09-29T17:22:31.558207] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-09-29T17:22:31.558330] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-09-29T17:22:31.558818] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-09-29T17:22:31.558962] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-09-29T17:22:31.561100] [DEBUG] [LOCAL ] AVK: Trimmed 26593 records to 17863 (keeping 200 days of data) [2025-09-29T17:22:31.682415] [DEBUG] [LOCAL ] AVK: Primary data saved (17863 records). [2025-09-29T17:22:31.682568] [INFO ] [MAIN ] AVK: Full history saved. [2025-09-29T17:22:31.682687] [INFO ] [MAIN ] Update Progress: 187/2371 symbols completed. AVK took 34.5s. Estimated remaining: 4h 22m 32s. Rate: 8.3 symbols/min [2025-09-29T17:22:31.865589] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:22:31.895474] [DEBUG] [LOCAL ] AWI: Loaded 26185 existing records from primary storage. [2025-09-29T17:22:31.895788] [INFO ] [MAIN ] AWI: Loaded 26185 existing records. [2025-09-29T17:22:32.095798] [WARN ] [MAIN ] AWI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:22:32.096108] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-09-29T17:22:32.096189] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-09-29T17:22:32.097934] [DEBUG] [LOCAL ] AWI: Deleted primary data file. [2025-09-29T17:22:32.098002] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-09-29T17:22:32.353258] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-09-29T17:22:32.489258] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:22:32.522712] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-29T17:22:32.822552] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-29T17:22:33.148147] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-09-29T17:22:33.948128] [INFO ] [REMOTE ] AWI: Fetching primary data for 2024-12. [2025-09-29T17:22:34.064156] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-29T17:22:34.748130] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-09-29T17:22:34.950465] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-29T17:22:35.105577] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-29T17:22:35.548168] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-09-29T17:22:36.261167] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-29T17:22:36.348129] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-09-29T17:22:37.148124] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-09-29T17:22:37.364910] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-29T17:22:37.414373] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-29T17:22:37.948107] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-09-29T17:22:38.621548] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-29T17:22:38.748118] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-09-29T17:22:39.294162] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-29T17:22:39.548124] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-09-29T17:22:39.847258] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-29T17:22:40.348120] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-09-29T17:22:41.148148] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-09-29T17:22:41.427250] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-29T17:22:41.948143] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-09-29T17:22:42.074293] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-29T17:22:42.257136] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-29T17:22:42.748076] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-09-29T17:22:43.137744] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-29T17:22:43.548125] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-09-29T17:22:44.326580] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-29T17:22:44.348096] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-09-29T17:22:44.739878] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-29T17:22:45.148166] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-09-29T17:22:45.948104] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-09-29T17:22:46.150288] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-29T17:22:46.162161] [INFO ] [REMOTE ] AVTR: Full fetch complete (77052 records). [2025-09-29T17:22:46.162384] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-09-29T17:22:46.163402] [FATAL] [VALIDATOR ] AVTR: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:22:46.163522] [FATAL] [MAIN ] AVTR: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:22:46.163570] [WARN ] [MAIN ] AVTR: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:22:46.163664] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-09-29T17:22:46.163824] [DEBUG] [LOCAL ] AVTR: No primary data file found to delete. [2025-09-29T17:22:46.163896] [INFO ] [LOCAL ] AVTR: Starting deletion of derivative data. [2025-09-29T17:22:46.165333] [DEBUG] [LOCAL ] AVTR: Deleted derivative data file. [2025-09-29T17:22:46.166843] [INFO ] [MAIN ] Update Progress: 188/2371 symbols completed. AVTR took 29.8s. Estimated remaining: 4h 23m 50s. Rate: 8.3 symbols/min [2025-09-29T17:22:46.364823] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:22:46.432022] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-29T17:22:46.457571] [DEBUG] [LOCAL ] AWK: Loaded 49489 existing records from primary storage. [2025-09-29T17:22:46.458085] [INFO ] [MAIN ] AWK: Loaded 49489 existing records. [2025-09-29T17:22:46.653888] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:22:46.654131] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-09-29T17:22:46.654181] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-09-29T17:22:46.658425] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-09-29T17:22:46.658494] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-09-29T17:22:46.756843] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-09-29T17:22:47.076169] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:22:47.185610] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-29T17:22:47.191739] [INFO ] [REMOTE ] AWF: Full fetch complete (36017 records). [2025-09-29T17:22:47.191876] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-09-29T17:22:47.553352] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-09-29T17:22:47.607115] [DEBUG] [VALIDATOR ] AWF: All expected trading days are present. [2025-09-29T17:22:47.607295] [DEBUG] [VALIDATOR ] AWF: Primary data validation passed. [2025-09-29T17:22:47.607921] [INFO ] [MAIN ] AWF: Fetched primary data is valid. [2025-09-29T17:22:47.608000] [DEBUG] [LOCAL ] AWF: Saving primary data. [2025-09-29T17:22:47.609215] [DEBUG] [LOCAL ] AWF: Trimmed 36017 records to 24244 (keeping 200 days of data) [2025-09-29T17:22:47.772875] [DEBUG] [LOCAL ] AWF: Primary data saved (24244 records). [2025-09-29T17:22:47.773057] [INFO ] [MAIN ] AWF: Full history saved. [2025-09-29T17:22:47.773171] [INFO ] [MAIN ] Update Progress: 189/2371 symbols completed. AWF took 27.0s. Estimated remaining: 4h 22m 37s. Rate: 8.3 symbols/min [2025-09-29T17:22:48.023033] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:22:48.048066] [DEBUG] [LOCAL ] AWP: Loaded 21835 existing records from primary storage. [2025-09-29T17:22:48.048351] [INFO ] [MAIN ] AWP: Loaded 21835 existing records. [2025-09-29T17:22:48.250040] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:22:48.250465] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-09-29T17:22:48.250726] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-09-29T17:22:48.254065] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-09-29T17:22:48.254162] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-09-29T17:22:48.367245] [INFO ] [REMOTE ] AWK: Fetching primary data for 2024-12. [2025-09-29T17:22:48.388360] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-29T17:22:48.736789] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:22:49.148105] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-09-29T17:22:49.202159] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-29T17:22:49.948128] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-09-29T17:22:50.495434] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-29T17:22:50.535320] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-09-29T17:22:50.748184] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-09-29T17:22:51.486077] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-29T17:22:51.548155] [INFO ] [REMOTE ] AWP: Fetching primary data for 2024-12. [2025-09-29T17:22:52.348121] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-09-29T17:22:53.148179] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-09-29T17:23:05.026014] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2024-12 (13.48 seconds). [2025-09-29T17:23:05.031461] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-09-29T17:23:06.086524] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (15.34 seconds). [2025-09-29T17:23:06.098311] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-09-29T17:23:06.229676] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-29T17:23:06.236276] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-09-29T17:23:06.362451] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (13.21 seconds). [2025-09-29T17:23:06.368243] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-09-29T17:23:06.432945] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (14.08 seconds). [2025-09-29T17:23:06.441491] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-09-29T17:23:07.307256] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-29T17:23:07.311547] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-09-29T17:23:07.529311] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-29T17:23:07.534974] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-09-29T17:23:07.848125] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-29T17:23:07.858425] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-09-29T17:23:08.454968] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-29T17:23:08.460186] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-09-29T17:23:08.757950] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-29T17:23:08.765618] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-09-29T17:23:09.542887] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-29T17:23:09.548135] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-09-29T17:23:09.725483] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-29T17:23:09.736716] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-09-29T17:23:09.948166] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (3.51 seconds). [2025-09-29T17:23:09.956535] [INFO ] [REMOTE ] AVY: Full fetch complete (56181 records). [2025-09-29T17:23:09.956715] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-09-29T17:23:10.087707] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-29T17:23:10.136473] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-09-29T17:23:10.406183] [DEBUG] [VALIDATOR ] AVY: All expected trading days are present. [2025-09-29T17:23:10.406398] [DEBUG] [VALIDATOR ] AVY: Primary data validation passed. [2025-09-29T17:23:10.407473] [INFO ] [MAIN ] AVY: Fetched primary data is valid. [2025-09-29T17:23:10.407562] [DEBUG] [LOCAL ] AVY: Saving primary data. [2025-09-29T17:23:10.409259] [DEBUG] [LOCAL ] AVY: Trimmed 56181 records to 37420 (keeping 200 days of data) [2025-09-29T17:23:10.653954] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-29T17:23:10.660638] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-09-29T17:23:10.692533] [DEBUG] [LOCAL ] AVY: Primary data saved (37420 records). [2025-09-29T17:23:10.692721] [INFO ] [MAIN ] AVY: Full history saved. [2025-09-29T17:23:10.692826] [INFO ] [MAIN ] Update Progress: 190/2371 symbols completed. AVY took 51.8s. Estimated remaining: 4h 25m 30s. Rate: 8.2 symbols/min [2025-09-29T17:23:10.879758] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:23:10.907406] [DEBUG] [LOCAL ] AWR: Loaded 22993 existing records from primary storage. [2025-09-29T17:23:10.907707] [INFO ] [MAIN ] AWR: Loaded 22993 existing records. [2025-09-29T17:23:11.107355] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:23:11.108208] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-09-29T17:23:11.108360] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-09-29T17:23:11.113481] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-09-29T17:23:11.113618] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-09-29T17:23:11.326902] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-29T17:23:11.387768] [INFO ] [REMOTE ] AWI: Full fetch complete (35270 records). [2025-09-29T17:23:11.422963] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-09-29T17:23:11.456848] [FATAL] [VALIDATOR ] AWI: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:23:11.477982] [FATAL] [MAIN ] AWI: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:23:11.496477] [WARN ] [MAIN ] AWI: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:23:11.521139] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-09-29T17:23:11.529034] [DEBUG] [LOCAL ] AWI: No primary data file found to delete. [2025-09-29T17:23:11.546754] [INFO ] [LOCAL ] AWI: Starting deletion of derivative data. [2025-09-29T17:23:11.546495] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:23:11.547291] [INFO ] [REMOTE ] AWR: Fetching primary data for 2024-12. [2025-09-29T17:23:11.548387] [DEBUG] [LOCAL ] AWI: Deleted derivative data file. [2025-09-29T17:23:11.548753] [INFO ] [MAIN ] Update Progress: 191/2371 symbols completed. AWI took 39.9s. Estimated remaining: 4h 24m 9s. Rate: 8.3 symbols/min [2025-09-29T17:23:11.731021] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-29T17:23:11.768940] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:23:11.769473] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-09-29T17:23:11.802269] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-29T17:23:11.814867] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-09-29T17:23:11.837864] [DEBUG] [LOCAL ] AX: Loaded 28929 existing records from primary storage. [2025-09-29T17:23:11.838148] [INFO ] [MAIN ] AX: Loaded 28929 existing records. [2025-09-29T17:23:12.037955] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:23:12.038159] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-09-29T17:23:12.038207] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-09-29T17:23:12.040953] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-09-29T17:23:12.041020] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-09-29T17:23:12.424735] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:23:12.425095] [INFO ] [REMOTE ] AX: Fetching primary data for 2024-12. [2025-09-29T17:23:13.149837] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-29T17:23:13.157584] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-09-29T17:23:13.200352] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-29T17:23:13.207247] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-09-29T17:23:13.255700] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-29T17:23:13.266512] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-09-29T17:23:13.783235] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-29T17:23:13.790144] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-09-29T17:23:14.354432] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-29T17:23:14.364061] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-09-29T17:23:14.435547] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-29T17:23:14.441577] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-09-29T17:23:14.633209] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-29T17:23:14.649554] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-09-29T17:23:15.014541] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-29T17:23:15.021996] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-09-29T17:23:15.525173] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-29T17:23:15.529930] [INFO ] [REMOTE ] AWP: Full fetch complete (32532 records). [2025-09-29T17:23:15.530059] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-09-29T17:23:15.701823] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-29T17:23:15.719067] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-09-29T17:23:15.973267] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-09-29T17:23:15.973585] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-09-29T17:23:15.974060] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-09-29T17:23:15.974295] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-09-29T17:23:15.990738] [DEBUG] [LOCAL ] AWP: Trimmed 32532 records to 21606 (keeping 200 days of data) [2025-09-29T17:23:15.992149] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-29T17:23:15.999289] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-09-29T17:23:16.133774] [DEBUG] [LOCAL ] AWP: Primary data saved (21606 records). [2025-09-29T17:23:16.133955] [INFO ] [MAIN ] AWP: Full history saved. [2025-09-29T17:23:16.134109] [INFO ] [MAIN ] Update Progress: 192/2371 symbols completed. AWP took 28.4s. Estimated remaining: 4h 23m 31s. Rate: 8.3 symbols/min [2025-09-29T17:23:16.323517] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:23:16.355786] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-29T17:23:16.367396] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-09-29T17:23:16.419028] [DEBUG] [LOCAL ] AXL: Loaded 51239 existing records from primary storage. [2025-09-29T17:23:16.419388] [INFO ] [MAIN ] AXL: Loaded 51239 existing records. [2025-09-29T17:23:16.618621] [WARN ] [MAIN ] AXL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:23:16.618897] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-09-29T17:23:16.618951] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-09-29T17:23:16.624905] [DEBUG] [LOCAL ] AXL: Deleted primary data file. [2025-09-29T17:23:16.625012] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-09-29T17:23:17.012920] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:23:17.027724] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-29T17:23:17.148139] [INFO ] [REMOTE ] AXL: Fetching primary data for 2024-12. [2025-09-29T17:23:17.359461] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-29T17:23:17.886458] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-29T17:23:17.948089] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-09-29T17:23:18.748113] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-09-29T17:23:18.950390] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-29T17:23:19.548142] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-09-29T17:23:19.750491] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-29T17:23:19.791174] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-29T17:23:19.801473] [INFO ] [REMOTE ] AWK: Full fetch complete (70548 records). [2025-09-29T17:23:19.801615] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-09-29T17:23:20.207886] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-09-29T17:23:20.207979] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-09-29T17:23:20.208804] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-09-29T17:23:20.208911] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-09-29T17:23:20.210427] [DEBUG] [LOCAL ] AWK: Trimmed 70548 records to 48718 (keeping 200 days of data) [2025-09-29T17:23:20.349836] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-09-29T17:23:20.537035] [DEBUG] [LOCAL ] AWK: Primary data saved (48718 records). [2025-09-29T17:23:20.537211] [INFO ] [MAIN ] AWK: Full history saved. [2025-09-29T17:23:20.538758] [INFO ] [MAIN ] Update Progress: 193/2371 symbols completed. AWK took 34.4s. Estimated remaining: 4h 22m 52s. Rate: 8.3 symbols/min [2025-09-29T17:23:20.723086] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:23:20.795102] [DEBUG] [LOCAL ] AXP: Loaded 53999 existing records from primary storage. [2025-09-29T17:23:20.795438] [INFO ] [MAIN ] AXP: Loaded 53999 existing records. [2025-09-29T17:23:21.004416] [WARN ] [MAIN ] AXP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:23:21.005503] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-09-29T17:23:21.005554] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-09-29T17:23:21.006427] [DEBUG] [LOCAL ] AXP: Deleted primary data file. [2025-09-29T17:23:21.006491] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-09-29T17:23:21.150005] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-09-29T17:23:21.340568] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-29T17:23:21.450844] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:23:21.519992] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-29T17:23:21.948127] [INFO ] [REMOTE ] AXP: Fetching primary data for 2024-12. [2025-09-29T17:23:22.539010] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-29T17:23:22.748118] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-09-29T17:23:23.548127] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-09-29T17:23:23.893463] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-29T17:23:23.932271] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-29T17:23:24.348163] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-09-29T17:23:25.124217] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-29T17:23:25.148105] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-09-29T17:23:25.555606] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-29T17:23:25.948083] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-09-29T17:23:26.423960] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-29T17:23:26.748158] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-09-29T17:23:27.553205] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-09-29T17:23:27.570451] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-29T17:23:28.348129] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-09-29T17:23:28.680589] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-29T17:23:28.860314] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-29T17:23:29.148123] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-09-29T17:23:29.948130] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-09-29T17:23:30.171370] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-29T17:23:30.518836] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-29T17:23:30.525913] [INFO ] [REMOTE ] AWR: Full fetch complete (31953 records). [2025-09-29T17:23:30.526126] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-09-29T17:23:30.748407] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-09-29T17:23:30.979848] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-09-29T17:23:30.980369] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-29T17:23:30.985756] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-09-29T17:23:30.987013] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-09-29T17:23:30.987102] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-09-29T17:23:30.988604] [DEBUG] [LOCAL ] AWR: Trimmed 31953 records to 22508 (keeping 200 days of data) [2025-09-29T17:23:31.133293] [DEBUG] [LOCAL ] AWR: Primary data saved (22508 records). [2025-09-29T17:23:31.133467] [INFO ] [MAIN ] AWR: Full history saved. [2025-09-29T17:23:31.133618] [INFO ] [MAIN ] Update Progress: 194/2371 symbols completed. AWR took 20.4s. Estimated remaining: 4h 23m 22s. Rate: 8.3 symbols/min [2025-09-29T17:23:31.317885] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:23:31.324503] [DEBUG] [LOCAL ] AXR: Loaded 3220 existing records from primary storage. [2025-09-29T17:23:31.324735] [INFO ] [MAIN ] AXR: Loaded 3220 existing records. [2025-09-29T17:23:31.508091] [WARN ] [MAIN ] AXR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:23:31.508350] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-09-29T17:23:31.508400] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-09-29T17:23:31.508634] [DEBUG] [LOCAL ] AXR: Deleted primary data file. [2025-09-29T17:23:31.508746] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-09-29T17:23:31.553306] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-09-29T17:23:31.897130] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:23:32.348123] [INFO ] [REMOTE ] AXR: Fetching primary data for 2024-12. [2025-09-29T17:23:32.583289] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-29T17:23:32.618395] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-29T17:23:32.967491] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-29T17:23:33.148155] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-09-29T17:23:33.948115] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-09-29T17:23:34.698661] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-29T17:23:34.748072] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-09-29T17:23:35.548098] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-09-29T17:23:35.993163] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-29T17:23:36.107053] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-29T17:23:36.348115] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-09-29T17:23:36.827722] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-29T17:23:37.148108] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-09-29T17:23:37.704687] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-29T17:23:37.948107] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-09-29T17:23:38.748762] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-09-29T17:23:38.748676] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-29T17:23:38.756715] [INFO ] [REMOTE ] AX: Full fetch complete (42682 records). [2025-09-29T17:23:38.756842] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-09-29T17:23:39.196768] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-09-29T17:23:39.196870] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-09-29T17:23:39.197449] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-09-29T17:23:39.197515] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-09-29T17:23:39.198463] [DEBUG] [LOCAL ] AX: Trimmed 42682 records to 28381 (keeping 200 days of data) [2025-09-29T17:23:39.371152] [DEBUG] [LOCAL ] AX: Primary data saved (28381 records). [2025-09-29T17:23:39.371294] [INFO ] [MAIN ] AX: Full history saved. [2025-09-29T17:23:39.371378] [INFO ] [MAIN ] Update Progress: 195/2371 symbols completed. AX took 27.8s. Estimated remaining: 4h 23m 26s. Rate: 8.3 symbols/min [2025-09-29T17:23:39.550100] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:23:39.550235] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-09-29T17:23:39.593044] [DEBUG] [LOCAL ] AXS: Loaded 38920 existing records from primary storage. [2025-09-29T17:23:39.593359] [INFO ] [MAIN ] AXS: Loaded 38920 existing records. [2025-09-29T17:23:39.791707] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:23:39.792013] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-09-29T17:23:39.792075] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-09-29T17:23:39.795806] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-09-29T17:23:39.795879] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-09-29T17:23:40.185868] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:23:40.223042] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-29T17:23:40.226898] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-29T17:23:40.348149] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-09-29T17:23:41.150166] [INFO ] [REMOTE ] AXS: Fetching primary data for 2024-12. [2025-09-29T17:23:41.154032] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-09-29T17:23:41.165708] [INFO ] [REMOTE ] AXL: Full fetch complete (72613 records). [2025-09-29T17:23:41.165861] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-09-29T17:23:41.561328] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-09-29T17:23:41.561449] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-09-29T17:23:41.562536] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-09-29T17:23:41.562611] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-09-29T17:23:41.564626] [DEBUG] [LOCAL ] AXL: Trimmed 72613 records to 50519 (keeping 200 days of data) [2025-09-29T17:23:41.864814] [DEBUG] [LOCAL ] AXL: Primary data saved (50519 records). [2025-09-29T17:23:41.865058] [INFO ] [MAIN ] AXL: Full history saved. [2025-09-29T17:23:41.865207] [INFO ] [MAIN ] Update Progress: 196/2371 symbols completed. AXL took 25.7s. Estimated remaining: 4h 22m 26s. Rate: 8.3 symbols/min [2025-09-29T17:23:41.962561] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-09-29T17:23:42.052227] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:23:42.119954] [DEBUG] [LOCAL ] AXTA: Loaded 52835 existing records from primary storage. [2025-09-29T17:23:42.120460] [INFO ] [MAIN ] AXTA: Loaded 52835 existing records. [2025-09-29T17:23:42.307784] [WARN ] [MAIN ] AXTA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:23:42.308400] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-09-29T17:23:42.308511] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-09-29T17:23:42.309306] [DEBUG] [LOCAL ] AXTA: Deleted primary data file. [2025-09-29T17:23:42.309373] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-09-29T17:23:42.567035] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-29T17:23:42.711830] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:23:42.748374] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2024-12. [2025-09-29T17:23:42.749783] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-09-29T17:23:42.887315] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-29T17:23:43.548171] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-09-29T17:23:44.348095] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-09-29T17:23:44.775232] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-29T17:23:44.790436] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-29T17:23:44.983100] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-29T17:23:45.148178] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-09-29T17:23:45.948131] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-09-29T17:23:46.748129] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-09-29T17:23:46.786963] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-29T17:23:46.813628] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-29T17:23:47.548162] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-09-29T17:23:48.348112] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-09-29T17:23:48.861717] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-29T17:23:48.910329] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-29T17:23:48.934059] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-29T17:23:49.148138] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-09-29T17:23:49.948128] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-09-29T17:23:50.507191] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-29T17:23:50.743837] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-29T17:23:50.751824] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-09-29T17:23:51.548134] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-09-29T17:23:52.321214] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-29T17:23:52.348087] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-09-29T17:23:53.091976] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-29T17:23:53.148132] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-09-29T17:23:53.948140] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-09-29T17:23:54.088172] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-29T17:23:54.495634] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-29T17:23:54.748116] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-09-29T17:23:55.107587] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-29T17:23:55.548155] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-09-29T17:23:56.066504] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-29T17:23:56.233560] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-29T17:23:56.348076] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-09-29T17:23:57.148119] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-09-29T17:23:57.698108] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-29T17:23:57.948110] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-09-29T17:23:58.748120] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-09-29T17:23:59.233672] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-29T17:23:59.313814] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-29T17:23:59.548092] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-09-29T17:24:00.348093] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-09-29T17:24:00.441373] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-29T17:24:01.148097] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-09-29T17:24:01.613551] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-29T17:24:01.948131] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-09-29T17:24:02.139799] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-29T17:24:02.399183] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-29T17:24:02.400836] [INFO ] [REMOTE ] AXR: Full fetch complete (4968 records). [2025-09-29T17:24:02.400909] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-09-29T17:24:02.754134] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-09-29T17:24:02.874449] [DEBUG] [VALIDATOR ] AXR: All expected trading days are present. [2025-09-29T17:24:02.874673] [DEBUG] [VALIDATOR ] AXR: Primary data validation passed. [2025-09-29T17:24:02.874866] [INFO ] [MAIN ] AXR: Fetched primary data is valid. [2025-09-29T17:24:02.875065] [DEBUG] [LOCAL ] AXR: Saving primary data. [2025-09-29T17:24:02.895365] [DEBUG] [LOCAL ] AXR: Trimmed 4968 records to 3112 (keeping 200 days of data) [2025-09-29T17:24:02.899783] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-29T17:24:02.928527] [DEBUG] [LOCAL ] AXR: Primary data saved (3112 records). [2025-09-29T17:24:02.928712] [INFO ] [MAIN ] AXR: Full history saved. [2025-09-29T17:24:02.928826] [INFO ] [MAIN ] Update Progress: 197/2371 symbols completed. AXR took 31.8s. Estimated remaining: 4h 24m 51s. Rate: 8.2 symbols/min [2025-09-29T17:24:03.548136] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-09-29T17:24:04.348168] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-09-29T17:24:04.451429] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-29T17:24:05.148162] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-09-29T17:24:05.902885] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-09-29T17:24:05.913913] [INFO ] [REMOTE ] AXP: Full fetch complete (76892 records). [2025-09-29T17:24:05.914077] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-09-29T17:24:06.274403] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-29T17:24:06.323590] [INFO ] [REMOTE ] AXS: Full fetch complete (55610 records). [2025-09-29T17:24:06.339486] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-09-29T17:24:06.460256] [DEBUG] [VALIDATOR ] AXP: All expected trading days are present. [2025-09-29T17:24:06.460390] [DEBUG] [VALIDATOR ] AXP: Primary data validation passed. [2025-09-29T17:24:06.461614] [INFO ] [MAIN ] AXP: Fetched primary data is valid. [2025-09-29T17:24:06.461770] [DEBUG] [LOCAL ] AXP: Saving primary data. [2025-09-29T17:24:06.475687] [DEBUG] [LOCAL ] AXP: Trimmed 76892 records to 53201 (keeping 200 days of data) [2025-09-29T17:24:07.192200] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-29T17:24:07.289268] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-09-29T17:24:07.315204] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-09-29T17:24:07.315447] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-09-29T17:24:07.317180] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-09-29T17:24:07.317875] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-09-29T17:24:07.320740] [DEBUG] [LOCAL ] AXS: Trimmed 55610 records to 38385 (keeping 200 days of data) [2025-09-29T17:24:07.787707] [DEBUG] [LOCAL ] AXS: Primary data saved (38385 records). [2025-09-29T17:24:07.789159] [INFO ] [MAIN ] AXS: Full history saved. [2025-09-29T17:24:07.793082] [INFO ] [MAIN ] Update Progress: 198/2371 symbols completed. AXS took 28.4s. Estimated remaining: 4h 24m 17s. Rate: 8.2 symbols/min [2025-09-29T17:24:07.806220] [DEBUG] [LOCAL ] AXP: Primary data saved (53201 records). [2025-09-29T17:24:07.806401] [INFO ] [MAIN ] AXP: Full history saved. [2025-09-29T17:24:07.810129] [INFO ] [MAIN ] Update Progress: 199/2371 symbols completed. AXP took 47.3s. Estimated remaining: 4h 22m 50s. Rate: 8.3 symbols/min [2025-09-29T17:24:09.061405] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-29T17:24:09.073090] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-09-29T17:24:10.819319] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-29T17:24:10.830190] [INFO ] [REMOTE ] AXTA: Full fetch complete (74929 records). [2025-09-29T17:24:10.830343] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-09-29T17:24:11.248524] [DEBUG] [VALIDATOR ] AXTA: All expected trading days are present. [2025-09-29T17:24:11.248691] [DEBUG] [VALIDATOR ] AXTA: Primary data validation passed. [2025-09-29T17:24:11.249540] [INFO ] [MAIN ] AXTA: Fetched primary data is valid. [2025-09-29T17:24:11.249614] [DEBUG] [LOCAL ] AXTA: Saving primary data. [2025-09-29T17:24:11.254541] [DEBUG] [LOCAL ] AXTA: Trimmed 74929 records to 52065 (keeping 200 days of data) [2025-09-29T17:24:11.567623] [DEBUG] [LOCAL ] AXTA: Primary data saved (52065 records). [2025-09-29T17:24:11.567830] [INFO ] [MAIN ] AXTA: Full history saved. [2025-09-29T17:24:11.567971] [INFO ] [MAIN ] Update Progress: 200/2371 symbols completed. AXTA took 29.7s. Estimated remaining: 4h 22m 5s. Rate: 8.3 symbols/min [2025-09-29T17:24:12.239459] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:24:12.164906] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:24:12.265318] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-09-29T17:24:12.309435] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-09-29T17:24:12.327122] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:24:12.327603] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-09-29T17:24:12.335613] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-29T17:24:12.364804] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:24:12.368193] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-29T17:24:12.368305] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-09-29T17:24:12.474811] [DEBUG] [LOCAL ] AZO: Loaded 11687 existing records from primary storage. [2025-09-29T17:24:12.503317] [DEBUG] [LOCAL ] AZZ: Loaded 22359 existing records from primary storage. [2025-09-29T17:24:12.502863] [INFO ] [MAIN ] AZO: Loaded 11687 existing records. [2025-09-29T17:24:12.509463] [INFO ] [MAIN ] AZZ: Loaded 22359 existing records. [2025-09-29T17:24:12.938991] [DEBUG] [LOCAL ] AYI: Loaded 25446 existing records from primary storage. [2025-09-29T17:24:13.060807] [WARN ] [MAIN ] AZZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:24:13.049313] [INFO ] [MAIN ] AYI: Loaded 25446 existing records. [2025-09-29T17:24:13.094905] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:24:13.100436] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-09-29T17:24:13.116219] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-09-29T17:24:13.141934] [DEBUG] [LOCAL ] AZZ: Deleted primary data file. [2025-09-29T17:24:13.152432] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-09-29T17:24:13.165707] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-09-29T17:24:13.165815] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-09-29T17:24:13.203773] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-09-29T17:24:13.250186] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-09-29T17:24:13.549385] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:24:13.585912] [INFO ] [REMOTE ] B: Fetching primary data for 2024-12. [2025-09-29T17:24:13.770902] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:24:13.791332] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-09-29T17:24:13.796610] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-09-29T17:24:13.833713] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-09-29T17:24:13.844086] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-09-29T17:24:14.295527] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:24:14.326544] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2024-12. [2025-09-29T17:24:14.459832] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:24:14.472014] [INFO ] [REMOTE ] AZO: Fetching primary data for 2024-12. [2025-09-29T17:24:14.638880] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:24:14.639190] [INFO ] [REMOTE ] AYI: Fetching primary data for 2024-12. [2025-09-29T17:24:14.926303] [INFO ] [REMOTE ] B: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-29T17:24:14.934046] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-09-29T17:24:15.486760] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-29T17:24:15.491030] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-09-29T17:24:15.794719] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-29T17:24:15.799181] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-09-29T17:24:15.816986] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-29T17:24:15.824125] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-09-29T17:24:15.909842] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-29T17:24:15.915400] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-09-29T17:24:16.029289] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T17:24:16.029598] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-09-29T17:24:16.029707] [FATAL] [REMOTE ] B: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T17:24:16.029787] [FATAL] [MAIN ] B: Failed to fetch primary data. [2025-09-29T17:24:16.029829] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T17:24:16.029868] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-29T17:24:16.029927] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-29T17:24:16.029963] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-09-29T17:24:16.030046] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-09-29T17:24:16.030117] [INFO ] [MAIN ] Update Progress: 201/2371 symbols completed. B took 4.4s. Estimated remaining: 4h 21m 28s. Rate: 8.3 symbols/min [2025-09-29T17:24:16.213857] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:24:16.276303] [DEBUG] [LOCAL ] BA: Loaded 54571 existing records from primary storage. [2025-09-29T17:24:16.276724] [INFO ] [MAIN ] BA: Loaded 54571 existing records. [2025-09-29T17:24:16.402887] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-29T17:24:16.436082] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-09-29T17:24:16.481243] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:24:16.481453] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-09-29T17:24:16.481501] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-09-29T17:24:16.489574] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-09-29T17:24:16.489660] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-09-29T17:24:16.870415] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:24:16.870783] [INFO ] [REMOTE ] BA: Fetching primary data for 2024-12. [2025-09-29T17:24:17.069740] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-29T17:24:17.074013] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-09-29T17:24:17.318372] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-29T17:24:17.321253] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-09-29T17:24:17.396019] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-29T17:24:17.874346] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-29T17:24:17.948140] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-09-29T17:24:18.515022] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-29T17:24:18.748134] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-09-29T17:24:19.014588] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-29T17:24:19.454766] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2024-12 (2.58 seconds). [2025-09-29T17:24:19.548085] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-09-29T17:24:19.871333] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-29T17:24:20.348147] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-09-29T17:24:21.148134] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-09-29T17:24:21.713151] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-29T17:24:21.933628] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (2.39 seconds). [2025-09-29T17:24:21.948064] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-09-29T17:24:22.177199] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-29T17:24:22.748114] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-09-29T17:24:23.548131] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-09-29T17:24:23.609484] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-29T17:24:24.124136] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-29T17:24:24.348098] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-09-29T17:24:24.527716] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-29T17:24:25.148101] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-09-29T17:24:25.343390] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-29T17:24:25.948109] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-09-29T17:24:26.306162] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-29T17:24:26.748094] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-09-29T17:24:26.825329] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-29T17:24:27.548091] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-09-29T17:24:27.564353] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-29T17:24:28.348150] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-09-29T17:24:29.035824] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-29T17:24:29.148156] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-09-29T17:24:29.519728] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-29T17:24:29.935138] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-29T17:24:29.948081] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-09-29T17:24:30.748119] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-09-29T17:24:31.270325] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-29T17:24:31.548112] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-09-29T17:24:32.348140] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-09-29T17:24:32.401931] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-29T17:24:32.790004] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-29T17:24:33.148082] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-09-29T17:24:33.549056] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-29T17:24:33.948114] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-09-29T17:24:34.748109] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-09-29T17:24:35.225129] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-29T17:24:35.229520] [INFO ] [REMOTE ] AZZ: Full fetch complete (30875 records). [2025-09-29T17:24:35.229605] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-09-29T17:24:35.550385] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-09-29T17:24:35.619357] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-09-29T17:24:35.619767] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-09-29T17:24:35.620423] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-09-29T17:24:35.620515] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-09-29T17:24:35.635585] [DEBUG] [LOCAL ] AZZ: Trimmed 30875 records to 21975 (keeping 200 days of data) [2025-09-29T17:24:35.636544] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-29T17:24:35.782699] [DEBUG] [LOCAL ] AZZ: Primary data saved (21975 records). [2025-09-29T17:24:35.783002] [INFO ] [MAIN ] AZZ: Full history saved. [2025-09-29T17:24:35.783172] [INFO ] [MAIN ] Update Progress: 202/2371 symbols completed. AZZ took 24.2s. Estimated remaining: 4h 23m 35s. Rate: 8.2 symbols/min [2025-09-29T17:24:35.989280] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:24:36.011992] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.86 seconds). [2025-09-29T17:24:36.087752] [DEBUG] [LOCAL ] BABA: Loaded 54600 existing records from primary storage. [2025-09-29T17:24:36.088185] [INFO ] [MAIN ] BABA: Loaded 54600 existing records. [2025-09-29T17:24:36.274293] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:24:36.274566] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-09-29T17:24:36.274701] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-09-29T17:24:36.281699] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-09-29T17:24:36.281836] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-09-29T17:24:36.350225] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-09-29T17:24:36.522629] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-29T17:24:36.680242] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:24:37.148119] [INFO ] [REMOTE ] BABA: Fetching primary data for 2024-12. [2025-09-29T17:24:37.948125] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-09-29T17:24:38.748112] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-09-29T17:24:38.955620] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (2.61 seconds). [2025-09-29T17:24:39.208085] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-29T17:24:39.213734] [INFO ] [REMOTE ] AYI: Full fetch complete (36682 records). [2025-09-29T17:24:39.213912] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-09-29T17:24:39.552618] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-09-29T17:24:39.668746] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present. [2025-09-29T17:24:39.668903] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed. [2025-09-29T17:24:39.677165] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-29T17:24:39.676854] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-09-29T17:24:39.680910] [DEBUG] [LOCAL ] AYI: Saving primary data. [2025-09-29T17:24:39.681199] [INFO ] [REMOTE ] AZO: Full fetch complete (16292 records). [2025-09-29T17:24:39.681502] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-09-29T17:24:39.711770] [DEBUG] [LOCAL ] AYI: Trimmed 36682 records to 25060 (keeping 200 days of data) [2025-09-29T17:24:40.078265] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2024-12 (2.93 seconds). [2025-09-29T17:24:40.327956] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-09-29T17:24:40.328875] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-09-29T17:24:40.329542] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-09-29T17:24:40.329627] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-09-29T17:24:40.336003] [DEBUG] [LOCAL ] AZO: Trimmed 16292 records to 11372 (keeping 200 days of data) [2025-09-29T17:24:40.335863] [DEBUG] [LOCAL ] AYI: Primary data saved (25060 records). [2025-09-29T17:24:40.336511] [INFO ] [MAIN ] AYI: Full history saved. [2025-09-29T17:24:40.336891] [INFO ] [MAIN ] Update Progress: 203/2371 symbols completed. AYI took 28.8s. Estimated remaining: 4h 22m 58s. Rate: 8.2 symbols/min [2025-09-29T17:24:40.373007] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-09-29T17:24:40.553791] [DEBUG] [LOCAL ] AZO: Primary data saved (11372 records). [2025-09-29T17:24:40.583688] [INFO ] [MAIN ] AZO: Full history saved. [2025-09-29T17:24:40.600437] [INFO ] [MAIN ] Update Progress: 204/2371 symbols completed. AZO took 29.0s. Estimated remaining: 4h 21m 37s. Rate: 8.3 symbols/min [2025-09-29T17:24:40.604290] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:24:40.792355] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:24:40.841245] [DEBUG] [LOCAL ] BAC: Loaded 54588 existing records from primary storage. [2025-09-29T17:24:40.841701] [INFO ] [MAIN ] BAC: Loaded 54588 existing records. [2025-09-29T17:24:41.074577] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:24:41.076191] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-09-29T17:24:41.076303] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-09-29T17:24:41.076012] [DEBUG] [LOCAL ] BAH: Loaded 52477 existing records from primary storage. [2025-09-29T17:24:41.076759] [INFO ] [MAIN ] BAH: Loaded 52477 existing records. [2025-09-29T17:24:41.113737] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-09-29T17:24:41.150216] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-09-29T17:24:41.400885] [WARN ] [MAIN ] BAH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:24:41.427307] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-09-29T17:24:41.432596] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-09-29T17:24:41.459114] [DEBUG] [LOCAL ] BAH: Deleted primary data file. [2025-09-29T17:24:41.469886] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-09-29T17:24:41.904786] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:24:41.928290] [INFO ] [REMOTE ] BAC: Fetching primary data for 2024-12. [2025-09-29T17:24:42.143859] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:24:42.144374] [INFO ] [REMOTE ] BAH: Fetching primary data for 2024-12. [2025-09-29T17:24:42.196918] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (2.64 seconds). [2025-09-29T17:24:42.748120] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-09-29T17:24:42.981818] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (2.61 seconds). [2025-09-29T17:24:43.548140] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-09-29T17:24:43.702284] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-29T17:24:44.348164] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-01. [2025-09-29T17:24:44.551832] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2024-12 (2.62 seconds). [2025-09-29T17:24:44.789344] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-29T17:24:45.148162] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-09-29T17:24:45.777806] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-09-29T17:24:45.948133] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-09-29T17:24:46.238772] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-29T17:24:46.748122] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-09-29T17:24:47.437430] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-29T17:24:47.548160] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-09-29T17:24:48.348080] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-09-29T17:24:48.684639] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (2.74 seconds). [2025-09-29T17:24:49.148072] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-09-29T17:24:49.256750] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (2.51 seconds). [2025-09-29T17:24:49.716156] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-29T17:24:49.948092] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-09-29T17:24:49.951003] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-29T17:24:50.748153] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-09-29T17:24:51.548148] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-09-29T17:24:51.857782] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (2.71 seconds). [2025-09-29T17:24:52.246109] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-09-29T17:24:52.257448] [INFO ] [REMOTE ] BA: Full fetch complete (77925 records). [2025-09-29T17:24:52.257614] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-09-29T17:24:52.354193] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-09-29T17:24:52.692753] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-09-29T17:24:52.692870] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-09-29T17:24:52.694080] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-09-29T17:24:52.694182] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-09-29T17:24:52.696084] [DEBUG] [LOCAL ] BA: Trimmed 77925 records to 53791 (keeping 200 days of data) [2025-09-29T17:24:53.051830] [DEBUG] [LOCAL ] BA: Primary data saved (53791 records). [2025-09-29T17:24:53.051984] [INFO ] [MAIN ] BA: Full history saved. [2025-09-29T17:24:53.052075] [INFO ] [MAIN ] Update Progress: 205/2371 symbols completed. BA took 37.0s. Estimated remaining: 4h 22m 24s. Rate: 8.3 symbols/min [2025-09-29T17:24:53.251349] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:24:53.285375] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-29T17:24:53.297748] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-09-29T17:24:53.345444] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.60 seconds). [2025-09-29T17:24:53.372064] [DEBUG] [LOCAL ] BAK: Loaded 39413 existing records from primary storage. [2025-09-29T17:24:53.372370] [INFO ] [MAIN ] BAK: Loaded 39413 existing records. [2025-09-29T17:24:53.568013] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:24:53.568234] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-09-29T17:24:53.568288] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-09-29T17:24:53.571990] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-09-29T17:24:53.572061] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-09-29T17:24:53.956189] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-09-29T17:24:53.981420] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:24:54.748122] [INFO ] [REMOTE ] BAK: Fetching primary data for 2024-12. [2025-09-29T17:24:55.220599] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (2.87 seconds). [2025-09-29T17:24:55.562191] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-09-29T17:24:55.565504] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-29T17:24:56.286107] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-29T17:24:56.348079] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-09-29T17:24:56.458153] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-29T17:24:57.148142] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-09-29T17:24:57.948130] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-09-29T17:24:58.157697] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-09-29T17:24:58.607507] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-29T17:24:58.748162] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-09-29T17:24:58.870870] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-09-29T17:24:59.548176] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-09-29T17:24:59.776874] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-29T17:25:00.348170] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-09-29T17:25:01.148131] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-09-29T17:25:01.444534] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (2.70 seconds). [2025-09-29T17:25:01.497877] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-29T17:25:01.848835] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-09-29T17:25:01.948194] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-09-29T17:25:02.748149] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-09-29T17:25:02.998328] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-29T17:25:03.548141] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-09-29T17:25:04.348145] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-09-29T17:25:04.882254] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (2.93 seconds). [2025-09-29T17:25:05.148142] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-09-29T17:25:05.501182] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-29T17:25:05.576721] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-29T17:25:05.891904] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (3.14 seconds). [2025-09-29T17:25:05.948103] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-09-29T17:25:06.748163] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-09-29T17:25:07.548144] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-09-29T17:25:08.117092] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.97 seconds). [2025-09-29T17:25:08.131909] [INFO ] [REMOTE ] BABA: Full fetch complete (77983 records). [2025-09-29T17:25:08.132052] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-09-29T17:25:08.604540] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (2.66 seconds). [2025-09-29T17:25:08.637251] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-09-29T17:25:08.643586] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-09-29T17:25:08.657075] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-09-29T17:25:08.657420] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-09-29T17:25:08.690084] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-09-29T17:25:08.692220] [DEBUG] [LOCAL ] BABA: Trimmed 77983 records to 53820 (keeping 200 days of data) [2025-09-29T17:25:08.693730] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-29T17:25:09.102425] [DEBUG] [LOCAL ] BABA: Primary data saved (53820 records). [2025-09-29T17:25:09.102622] [INFO ] [MAIN ] BABA: Full history saved. [2025-09-29T17:25:09.103722] [INFO ] [MAIN ] Update Progress: 206/2371 symbols completed. BABA took 33.3s. Estimated remaining: 4h 23m 50s. Rate: 8.2 symbols/min [2025-09-29T17:25:09.150269] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-09-29T17:25:09.321171] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-29T17:25:09.350605] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:25:09.410590] [DEBUG] [LOCAL ] BALL: Loaded 52583 existing records from primary storage. [2025-09-29T17:25:09.410995] [INFO ] [MAIN ] BALL: Loaded 52583 existing records. [2025-09-29T17:25:09.621502] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:25:09.621823] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-09-29T17:25:09.621874] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-09-29T17:25:09.628684] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-09-29T17:25:09.628762] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-09-29T17:25:09.953294] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-09-29T17:25:10.058268] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:25:10.748178] [INFO ] [REMOTE ] BALL: Fetching primary data for 2024-12. [2025-09-29T17:25:11.230143] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-29T17:25:11.241723] [INFO ] [REMOTE ] BAH: Full fetch complete (74827 records). [2025-09-29T17:25:11.241975] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-09-29T17:25:11.340666] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (2.65 seconds). [2025-09-29T17:25:11.422464] [INFO ] [REMOTE ] BAC: Full fetch complete (77943 records). [2025-09-29T17:25:11.463930] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-09-29T17:25:11.980994] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-29T17:25:12.074277] [DEBUG] [VALIDATOR ] BAH: All expected trading days are present. [2025-09-29T17:25:12.080173] [DEBUG] [VALIDATOR ] BAH: Primary data validation passed. [2025-09-29T17:25:12.082029] [INFO ] [MAIN ] BAH: Fetched primary data is valid. [2025-09-29T17:25:12.082474] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-09-29T17:25:12.096017] [DEBUG] [LOCAL ] BAH: Saving primary data. [2025-09-29T17:25:12.190390] [DEBUG] [LOCAL ] BAH: Trimmed 74827 records to 51698 (keeping 200 days of data) [2025-09-29T17:25:12.414518] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-09-29T17:25:12.414980] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-09-29T17:25:12.416081] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-09-29T17:25:12.416805] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-09-29T17:25:12.423319] [DEBUG] [LOCAL ] BAC: Trimmed 77943 records to 53808 (keeping 200 days of data) [2025-09-29T17:25:12.723667] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-29T17:25:12.741005] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-09-29T17:25:13.078736] [DEBUG] [LOCAL ] BAH: Primary data saved (51698 records). [2025-09-29T17:25:13.079695] [INFO ] [MAIN ] BAH: Full history saved. [2025-09-29T17:25:13.080776] [INFO ] [MAIN ] Update Progress: 207/2371 symbols completed. BAH took 32.5s. Estimated remaining: 4h 23m 7s. Rate: 8.2 symbols/min [2025-09-29T17:25:13.283310] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:25:13.287233] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-09-29T17:25:13.287711] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-09-29T17:25:13.295136] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-09-29T17:25:13.295526] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-09-29T17:25:13.296223] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-09-29T17:25:13.296536] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-09-29T17:25:13.371430] [DEBUG] [LOCAL ] BAC: Primary data saved (53808 records). [2025-09-29T17:25:13.411222] [INFO ] [MAIN ] BAC: Full history saved. [2025-09-29T17:25:13.417802] [INFO ] [MAIN ] Update Progress: 208/2371 symbols completed. BAC took 33.1s. Estimated remaining: 4h 21m 48s. Rate: 8.3 symbols/min [2025-09-29T17:25:13.818639] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:25:13.901392] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:25:13.902073] [INFO ] [REMOTE ] BALY: Fetching primary data for 2024-12. [2025-09-29T17:25:13.927592] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-29T17:25:13.957788] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-09-29T17:25:13.982181] [DEBUG] [LOCAL ] BAM: Loaded 52779 existing records from primary storage. [2025-09-29T17:25:13.982522] [INFO ] [MAIN ] BAM: Loaded 52779 existing records. [2025-09-29T17:25:14.173596] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:25:14.173816] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-09-29T17:25:14.173864] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-09-29T17:25:14.181218] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-09-29T17:25:14.181288] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-09-29T17:25:14.578970] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:25:14.619743] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-29T17:25:14.748157] [INFO ] [REMOTE ] BAM: Fetching primary data for 2024-12. [2025-09-29T17:25:15.083157] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-29T17:25:15.504815] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-29T17:25:15.548132] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-09-29T17:25:16.348137] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-09-29T17:25:16.502968] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-29T17:25:17.109941] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-29T17:25:17.148166] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-09-29T17:25:17.427867] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-29T17:25:17.948137] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-09-29T17:25:18.607923] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-29T17:25:18.748121] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-09-29T17:25:18.956378] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-29T17:25:19.548156] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-09-29T17:25:20.084093] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-29T17:25:20.348117] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-09-29T17:25:21.148091] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-09-29T17:25:21.359009] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-29T17:25:21.948160] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-09-29T17:25:22.050003] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-29T17:25:22.058289] [INFO ] [REMOTE ] BAK: Full fetch complete (57024 records). [2025-09-29T17:25:22.058471] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-09-29T17:25:22.536672] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-09-29T17:25:22.537415] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-09-29T17:25:22.538709] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-09-29T17:25:22.538834] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-09-29T17:25:22.537770] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-29T17:25:22.543151] [DEBUG] [LOCAL ] BAK: Trimmed 57024 records to 39012 (keeping 200 days of data) [2025-09-29T17:25:22.749623] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-09-29T17:25:22.790977] [DEBUG] [LOCAL ] BAK: Primary data saved (39012 records). [2025-09-29T17:25:22.791135] [INFO ] [MAIN ] BAK: Full history saved. [2025-09-29T17:25:22.791254] [INFO ] [MAIN ] Update Progress: 209/2371 symbols completed. BAK took 29.7s. Estimated remaining: 4h 22m 2s. Rate: 8.3 symbols/min [2025-09-29T17:25:22.986718] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:25:23.025946] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-29T17:25:23.102114] [DEBUG] [LOCAL ] BANC: Loaded 52019 existing records from primary storage. [2025-09-29T17:25:23.102499] [INFO ] [MAIN ] BANC: Loaded 52019 existing records. [2025-09-29T17:25:23.306417] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:25:23.306691] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-09-29T17:25:23.306790] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-09-29T17:25:23.312545] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-09-29T17:25:23.312612] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-09-29T17:25:23.554312] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-09-29T17:25:23.589348] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-29T17:25:23.702513] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:25:24.348161] [INFO ] [REMOTE ] BANC: Fetching primary data for 2024-12. [2025-09-29T17:25:25.148113] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-09-29T17:25:25.528299] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-29T17:25:25.948087] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-09-29T17:25:26.341342] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-29T17:25:26.361170] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-29T17:25:26.748117] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-09-29T17:25:27.548088] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-09-29T17:25:27.732588] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-29T17:25:28.348089] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-09-29T17:25:28.522078] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-29T17:25:28.521800] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-29T17:25:29.148112] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-09-29T17:25:29.663223] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-29T17:25:29.948115] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-09-29T17:25:30.748092] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-09-29T17:25:30.777777] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-29T17:25:31.548144] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-09-29T17:25:31.688988] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-29T17:25:32.332658] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-29T17:25:32.348087] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-09-29T17:25:32.480480] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-29T17:25:33.148119] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-09-29T17:25:33.948120] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-09-29T17:25:34.043288] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-29T17:25:34.599130] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-29T17:25:34.748106] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-09-29T17:25:35.548121] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-09-29T17:25:35.671292] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-29T17:25:36.348124] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-09-29T17:25:36.706853] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-29T17:25:37.148124] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-09-29T17:25:37.535870] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-29T17:25:37.547625] [INFO ] [REMOTE ] BALL: Full fetch complete (75358 records). [2025-09-29T17:25:37.547866] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-09-29T17:25:37.960010] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-09-29T17:25:37.985930] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-09-29T17:25:37.987142] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-09-29T17:25:37.988166] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-09-29T17:25:37.988667] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-09-29T17:25:37.990593] [DEBUG] [LOCAL ] BALL: Trimmed 75358 records to 51786 (keeping 200 days of data) [2025-09-29T17:25:38.090674] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-29T17:25:38.373250] [DEBUG] [LOCAL ] BALL: Primary data saved (51786 records). [2025-09-29T17:25:38.373432] [INFO ] [MAIN ] BALL: Full history saved. [2025-09-29T17:25:38.374124] [INFO ] [MAIN ] Update Progress: 210/2371 symbols completed. BALL took 29.3s. Estimated remaining: 4h 23m 21s. Rate: 8.2 symbols/min [2025-09-29T17:25:38.564380] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:25:38.593735] [DEBUG] [LOCAL ] BAP: Loaded 26635 existing records from primary storage. [2025-09-29T17:25:38.594023] [INFO ] [MAIN ] BAP: Loaded 26635 existing records. [2025-09-29T17:25:38.751753] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-09-29T17:25:38.820129] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:25:38.821383] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-29T17:25:38.821681] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-09-29T17:25:38.821864] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-09-29T17:25:38.828118] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-09-29T17:25:38.828220] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-09-29T17:25:39.161672] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-29T17:25:39.259503] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:25:39.548148] [INFO ] [REMOTE ] BAP: Fetching primary data for 2024-12. [2025-09-29T17:25:40.348142] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-09-29T17:25:40.592067] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-29T17:25:40.808621] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-29T17:25:41.148137] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-09-29T17:25:41.744639] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-29T17:25:41.948146] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-09-29T17:25:42.748071] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-09-29T17:25:42.927142] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-29T17:25:43.548092] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-09-29T17:25:43.835669] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-29T17:25:43.988509] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-29T17:25:44.187599] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-29T17:25:44.190744] [INFO ] [REMOTE ] BALY: Full fetch complete (17074 records). [2025-09-29T17:25:44.190888] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-09-29T17:25:44.357820] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-09-29T17:25:44.395597] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-29T17:25:44.396261] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:25:44.396334] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:25:44.396409] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-09-29T17:25:44.396477] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-09-29T17:25:44.396516] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-09-29T17:25:44.396599] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-09-29T17:25:44.396716] [INFO ] [MAIN ] Update Progress: 211/2371 symbols completed. BALY took 31.3s. Estimated remaining: 4h 23m 0s. Rate: 8.2 symbols/min [2025-09-29T17:25:44.574176] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:25:44.611523] [DEBUG] [LOCAL ] BARK: Loaded 38893 existing records from primary storage. [2025-09-29T17:25:44.611876] [INFO ] [MAIN ] BARK: Loaded 38893 existing records. [2025-09-29T17:25:44.809604] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:25:44.809865] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-09-29T17:25:44.809936] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-09-29T17:25:44.813850] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-09-29T17:25:44.813936] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-09-29T17:25:45.153246] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-09-29T17:25:45.215144] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:25:45.948130] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-09-29T17:25:46.042182] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-29T17:25:46.748120] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-09-29T17:25:47.110269] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-29T17:25:47.159122] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-29T17:25:47.548145] [INFO ] [REMOTE ] BARK: Fetching primary data for 2024-12. [2025-09-29T17:25:48.348155] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-09-29T17:25:48.646798] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-29T17:25:48.664410] [INFO ] [REMOTE ] BAM: Full fetch complete (74187 records). [2025-09-29T17:25:48.664635] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-09-29T17:25:49.125230] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present. [2025-09-29T17:25:49.125385] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed. [2025-09-29T17:25:49.126393] [INFO ] [MAIN ] BAM: Fetched primary data is valid. [2025-09-29T17:25:49.126586] [DEBUG] [LOCAL ] BAM: Saving primary data. [2025-09-29T17:25:49.132085] [DEBUG] [LOCAL ] BAM: Trimmed 74187 records to 51993 (keeping 200 days of data) [2025-09-29T17:25:49.187276] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-09-29T17:25:49.263373] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-29T17:25:49.497061] [DEBUG] [LOCAL ] BAM: Primary data saved (51993 records). [2025-09-29T17:25:49.497219] [INFO ] [MAIN ] BAM: Full history saved. [2025-09-29T17:25:49.497305] [INFO ] [MAIN ] Update Progress: 212/2371 symbols completed. BAM took 36.1s. Estimated remaining: 4h 22m 30s. Rate: 8.2 symbols/min [2025-09-29T17:25:49.691713] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:25:49.693731] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-29T17:25:49.752966] [DEBUG] [LOCAL ] BAX: Loaded 54273 existing records from primary storage. [2025-09-29T17:25:49.753314] [INFO ] [MAIN ] BAX: Loaded 54273 existing records. [2025-09-29T17:25:49.944828] [WARN ] [MAIN ] BAX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:25:49.945061] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-09-29T17:25:49.945110] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-09-29T17:25:49.948127] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-09-29T17:25:49.951273] [DEBUG] [LOCAL ] BAX: Deleted primary data file. [2025-09-29T17:25:49.951356] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-09-29T17:25:50.342947] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:25:50.748160] [INFO ] [REMOTE ] BAX: Fetching primary data for 2024-12. [2025-09-29T17:25:51.194195] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-29T17:25:51.205418] [INFO ] [REMOTE ] BANC: Full fetch complete (74203 records). [2025-09-29T17:25:51.205566] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-09-29T17:25:51.551683] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-09-29T17:25:51.653812] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-09-29T17:25:51.653953] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-09-29T17:25:51.654959] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-09-29T17:25:51.655164] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-09-29T17:25:51.657579] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-29T17:25:51.668044] [DEBUG] [LOCAL ] BANC: Trimmed 74203 records to 51232 (keeping 200 days of data) [2025-09-29T17:25:51.995411] [DEBUG] [LOCAL ] BANC: Primary data saved (51232 records). [2025-09-29T17:25:51.995567] [INFO ] [MAIN ] BANC: Full history saved. [2025-09-29T17:25:51.995682] [INFO ] [MAIN ] Update Progress: 213/2371 symbols completed. BANC took 29.2s. Estimated remaining: 4h 21m 34s. Rate: 8.3 symbols/min [2025-09-29T17:25:52.190669] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:25:52.253018] [DEBUG] [LOCAL ] BB: Loaded 53701 existing records from primary storage. [2025-09-29T17:25:52.253355] [INFO ] [MAIN ] BB: Loaded 53701 existing records. [2025-09-29T17:25:52.357009] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-09-29T17:25:52.466309] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:25:52.466840] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-09-29T17:25:52.466981] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-09-29T17:25:52.467528] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-09-29T17:25:52.467588] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-09-29T17:25:52.866330] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:25:52.892174] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-29T17:25:53.038198] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-29T17:25:53.148159] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-09-29T17:25:53.948109] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-09-29T17:25:53.984908] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-29T17:25:54.400710] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-29T17:25:54.748126] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-09-29T17:25:55.391836] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-29T17:25:55.548088] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-09-29T17:25:55.867976] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-29T17:25:56.348139] [INFO ] [REMOTE ] BB: Fetching primary data for 2024-12. [2025-09-29T17:25:56.709254] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-29T17:25:57.148110] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-09-29T17:25:57.948165] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-09-29T17:25:58.559622] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-29T17:25:58.643030] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-29T17:25:58.748085] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-09-29T17:25:59.179749] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-29T17:25:59.548143] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-09-29T17:26:00.360197] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-09-29T17:26:00.368005] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-29T17:26:00.829686] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-29T17:26:01.148152] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-09-29T17:26:01.948148] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-09-29T17:26:02.445232] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-29T17:26:02.643909] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-29T17:26:02.748151] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-09-29T17:26:03.132368] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-29T17:26:03.138573] [INFO ] [REMOTE ] BAP: Full fetch complete (37745 records). [2025-09-29T17:26:03.138731] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-09-29T17:26:03.527723] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-09-29T17:26:03.527832] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-09-29T17:26:03.528405] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-09-29T17:26:03.528448] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-09-29T17:26:03.529551] [DEBUG] [LOCAL ] BAP: Trimmed 37745 records to 26168 (keeping 200 days of data) [2025-09-29T17:26:03.585472] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-09-29T17:26:03.702373] [DEBUG] [LOCAL ] BAP: Primary data saved (26168 records). [2025-09-29T17:26:03.702609] [INFO ] [MAIN ] BAP: Full history saved. [2025-09-29T17:26:03.702755] [INFO ] [MAIN ] Update Progress: 214/2371 symbols completed. BAP took 25.3s. Estimated remaining: 4h 22m 12s. Rate: 8.2 symbols/min [2025-09-29T17:26:03.875812] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:26:03.945082] [DEBUG] [LOCAL ] BBAI: Loaded 54600 existing records from primary storage. [2025-09-29T17:26:03.945685] [INFO ] [MAIN ] BBAI: Loaded 54600 existing records. [2025-09-29T17:26:04.123062] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:26:04.123387] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-09-29T17:26:04.123441] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-09-29T17:26:04.124155] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-09-29T17:26:04.124218] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-09-29T17:26:04.352734] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-09-29T17:26:04.491223] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:26:04.808964] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-29T17:26:05.028634] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-29T17:26:05.148169] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-09-29T17:26:05.948187] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2024-12. [2025-09-29T17:26:06.137593] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-29T17:26:06.748098] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-09-29T17:26:06.883530] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-29T17:26:07.548141] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-09-29T17:26:08.348147] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-09-29T17:26:08.749101] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2024-12 (2.80 seconds). [2025-09-29T17:26:08.906199] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-29T17:26:09.148156] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-09-29T17:26:09.328395] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-29T17:26:09.948105] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-09-29T17:26:10.153718] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-29T17:26:10.748209] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-09-29T17:26:11.125665] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-29T17:26:11.548105] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-09-29T17:26:11.935516] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-29T17:26:12.348179] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-09-29T17:26:13.148101] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-09-29T17:26:13.272619] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (2.52 seconds). [2025-09-29T17:26:13.513161] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-29T17:26:13.948102] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-09-29T17:26:14.407819] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-29T17:26:14.748084] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-09-29T17:26:14.950621] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-29T17:26:15.379383] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-29T17:26:15.548121] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-09-29T17:26:16.348102] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-09-29T17:26:16.449511] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-29T17:26:17.148131] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-09-29T17:26:17.530227] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-29T17:26:17.541553] [INFO ] [REMOTE ] BAX: Full fetch complete (77052 records). [2025-09-29T17:26:17.541715] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-09-29T17:26:17.542552] [FATAL] [VALIDATOR ] BAX: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:26:17.542664] [FATAL] [MAIN ] BAX: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:26:17.542734] [WARN ] [MAIN ] BAX: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:26:17.542823] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-09-29T17:26:17.542923] [DEBUG] [LOCAL ] BAX: No primary data file found to delete. [2025-09-29T17:26:17.542978] [INFO ] [LOCAL ] BAX: Starting deletion of derivative data. [2025-09-29T17:26:17.543883] [DEBUG] [LOCAL ] BAX: Deleted derivative data file. [2025-09-29T17:26:17.544142] [INFO ] [MAIN ] Update Progress: 215/2371 symbols completed. BAX took 28.0s. Estimated remaining: 4h 23m 10s. Rate: 8.2 symbols/min [2025-09-29T17:26:17.727492] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:26:17.777089] [DEBUG] [LOCAL ] BBAR: Loaded 41988 existing records from primary storage. [2025-09-29T17:26:17.777489] [INFO ] [MAIN ] BBAR: Loaded 41988 existing records. [2025-09-29T17:26:17.956452] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-09-29T17:26:17.963773] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:26:17.964051] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-09-29T17:26:17.964132] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-09-29T17:26:17.964564] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-09-29T17:26:17.964621] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-09-29T17:26:18.348181] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:26:18.737101] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-09-29T17:26:18.748054] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-09-29T17:26:18.988438] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-29T17:26:19.548124] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2024-12. [2025-09-29T17:26:19.593369] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-29T17:26:19.601278] [INFO ] [REMOTE ] BARK: Full fetch complete (56710 records). [2025-09-29T17:26:19.601447] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-09-29T17:26:20.015526] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-09-29T17:26:20.015609] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-09-29T17:26:20.016305] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-09-29T17:26:20.016372] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-09-29T17:26:20.017586] [DEBUG] [LOCAL ] BARK: Trimmed 56710 records to 38149 (keeping 200 days of data) [2025-09-29T17:26:20.249906] [DEBUG] [LOCAL ] BARK: Primary data saved (38149 records). [2025-09-29T17:26:20.250765] [INFO ] [MAIN ] BARK: Full history saved. [2025-09-29T17:26:20.251506] [INFO ] [MAIN ] Update Progress: 216/2371 symbols completed. BARK took 35.9s. Estimated remaining: 4h 22m 17s. Rate: 8.2 symbols/min [2025-09-29T17:26:20.356174] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-09-29T17:26:20.440613] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:26:20.499966] [DEBUG] [LOCAL ] BBD: Loaded 53959 existing records from primary storage. [2025-09-29T17:26:20.500366] [INFO ] [MAIN ] BBD: Loaded 53959 existing records. [2025-09-29T17:26:20.698265] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:26:20.698592] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-09-29T17:26:20.698666] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-09-29T17:26:20.699239] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-09-29T17:26:20.699312] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-09-29T17:26:21.120638] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:26:21.148099] [INFO ] [REMOTE ] BBD: Fetching primary data for 2024-12. [2025-09-29T17:26:21.266916] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-29T17:26:21.330420] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-09-29T17:26:21.948111] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-09-29T17:26:22.434570] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-29T17:26:22.625532] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-29T17:26:22.748133] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-09-29T17:26:23.167837] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-29T17:26:23.548132] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-09-29T17:26:24.348117] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-09-29T17:26:24.848992] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-29T17:26:24.860096] [INFO ] [REMOTE ] BB: Full fetch complete (76984 records). [2025-09-29T17:26:24.860244] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-09-29T17:26:25.152437] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-09-29T17:26:25.298408] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-09-29T17:26:25.298532] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-09-29T17:26:25.299621] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-09-29T17:26:25.299763] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-09-29T17:26:25.330280] [DEBUG] [LOCAL ] BB: Trimmed 76984 records to 52924 (keeping 200 days of data) [2025-09-29T17:26:25.331588] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-29T17:26:25.676980] [DEBUG] [LOCAL ] BB: Primary data saved (52924 records). [2025-09-29T17:26:25.677133] [INFO ] [MAIN ] BB: Full history saved. [2025-09-29T17:26:25.677219] [INFO ] [MAIN ] Update Progress: 217/2371 symbols completed. BB took 33.7s. Estimated remaining: 4h 21m 51s. Rate: 8.2 symbols/min [2025-09-29T17:26:25.853871] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:26:25.893757] [DEBUG] [LOCAL ] BBDC: Loaded 33756 existing records from primary storage. [2025-09-29T17:26:25.894052] [INFO ] [MAIN ] BBDC: Loaded 33756 existing records. [2025-09-29T17:26:25.960394] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-09-29T17:26:26.084156] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:26:26.084458] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-09-29T17:26:26.084510] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-09-29T17:26:26.085186] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-09-29T17:26:26.085251] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-09-29T17:26:26.458901] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:26:26.747686] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-29T17:26:26.755781] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2024-12. [2025-09-29T17:26:27.028149] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (2.68 seconds). [2025-09-29T17:26:27.548080] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-09-29T17:26:27.660509] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-29T17:26:28.296736] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-29T17:26:28.348124] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-09-29T17:26:28.986817] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-29T17:26:29.148119] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-09-29T17:26:29.948106] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-09-29T17:26:30.207937] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-29T17:26:30.748114] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-09-29T17:26:31.548123] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-09-29T17:26:31.648964] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-29T17:26:32.082504] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.93 seconds). [2025-09-29T17:26:32.171120] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-29T17:26:32.348112] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-09-29T17:26:32.577500] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-29T17:26:33.148120] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-09-29T17:26:33.948108] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-09-29T17:26:34.571030] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-29T17:26:34.748133] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-09-29T17:26:35.108810] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (2.76 seconds). [2025-09-29T17:26:35.548122] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-09-29T17:26:35.952245] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-29T17:26:36.348146] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-09-29T17:26:36.469628] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-29T17:26:37.148127] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-09-29T17:26:37.948097] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-09-29T17:26:38.019940] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-09-29T17:26:38.058973] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-29T17:26:38.753919] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-09-29T17:26:38.757483] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-29T17:26:39.402235] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-29T17:26:39.548108] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-09-29T17:26:40.348150] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-09-29T17:26:41.148094] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-09-29T17:26:41.326189] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-29T17:26:41.421893] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.67 seconds). [2025-09-29T17:26:41.948093] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-09-29T17:26:42.198525] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-29T17:26:42.244742] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-29T17:26:42.748151] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-09-29T17:26:43.492271] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-29T17:26:43.548078] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-09-29T17:26:44.353346] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-09-29T17:26:44.370916] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-29T17:26:45.148102] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-09-29T17:26:45.531232] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-29T17:26:45.543973] [INFO ] [REMOTE ] BBD: Full fetch complete (77115 records). [2025-09-29T17:26:45.544170] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-09-29T17:26:45.950493] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-09-29T17:26:45.994776] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-09-29T17:26:45.995803] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-09-29T17:26:45.997442] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-29T17:26:45.998691] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-09-29T17:26:46.007905] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-09-29T17:26:46.009796] [DEBUG] [LOCAL ] BBD: Trimmed 77115 records to 53196 (keeping 200 days of data) [2025-09-29T17:26:46.332983] [DEBUG] [LOCAL ] BBD: Primary data saved (53196 records). [2025-09-29T17:26:46.333167] [INFO ] [MAIN ] BBD: Full history saved. [2025-09-29T17:26:46.336413] [INFO ] [MAIN ] Update Progress: 218/2371 symbols completed. BBD took 26.1s. Estimated remaining: 4h 23m 56s. Rate: 8.2 symbols/min [2025-09-29T17:26:46.519583] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:26:46.528129] [DEBUG] [LOCAL ] BBDO: Loaded 5051 existing records from primary storage. [2025-09-29T17:26:46.528353] [INFO ] [MAIN ] BBDO: Loaded 5051 existing records. [2025-09-29T17:26:46.731604] [WARN ] [MAIN ] BBDO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:26:46.732308] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-09-29T17:26:46.732402] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-09-29T17:26:46.732867] [DEBUG] [LOCAL ] BBDO: Deleted primary data file. [2025-09-29T17:26:46.732972] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-09-29T17:26:46.769378] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-09-29T17:26:46.924447] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-29T17:26:47.155570] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:26:47.548122] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2024-12. [2025-09-29T17:26:48.091014] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-29T17:26:48.348183] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-09-29T17:26:48.491827] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-29T17:26:49.153882] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-09-29T17:26:49.174776] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (3.22 seconds). [2025-09-29T17:26:49.188750] [INFO ] [REMOTE ] BBAI: Full fetch complete (77999 records). [2025-09-29T17:26:49.188959] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-09-29T17:26:49.603772] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-09-29T17:26:49.603974] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-09-29T17:26:49.605030] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-09-29T17:26:49.605682] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-09-29T17:26:49.607712] [DEBUG] [LOCAL ] BBAI: Trimmed 77999 records to 53820 (keeping 200 days of data) [2025-09-29T17:26:49.813019] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-29T17:26:49.811863] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-29T17:26:49.950924] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-09-29T17:26:49.972071] [DEBUG] [LOCAL ] BBAI: Primary data saved (53820 records). [2025-09-29T17:26:49.972819] [INFO ] [MAIN ] BBAI: Full history saved. [2025-09-29T17:26:49.975493] [INFO ] [MAIN ] Update Progress: 219/2371 symbols completed. BBAI took 46.3s. Estimated remaining: 4h 23m 12s. Rate: 8.2 symbols/min [2025-09-29T17:26:50.154549] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:26:50.176337] [DEBUG] [LOCAL ] BBN: Loaded 18193 existing records from primary storage. [2025-09-29T17:26:50.176605] [INFO ] [MAIN ] BBN: Loaded 18193 existing records. [2025-09-29T17:26:50.367352] [WARN ] [MAIN ] BBN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:26:50.367636] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-09-29T17:26:50.367730] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-09-29T17:26:50.367998] [DEBUG] [LOCAL ] BBN: Deleted primary data file. [2025-09-29T17:26:50.368058] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-09-29T17:26:50.750981] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-09-29T17:26:50.750867] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:26:51.353793] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-29T17:26:51.548121] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-09-29T17:26:51.591376] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-29T17:26:51.599882] [INFO ] [REMOTE ] BBDC: Full fetch complete (48846 records). [2025-09-29T17:26:51.600045] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-09-29T17:26:52.011516] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present. [2025-09-29T17:26:52.011615] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed. [2025-09-29T17:26:52.012346] [INFO ] [MAIN ] BBDC: Fetched primary data is valid. [2025-09-29T17:26:52.012417] [DEBUG] [LOCAL ] BBDC: Saving primary data. [2025-09-29T17:26:52.013776] [DEBUG] [LOCAL ] BBDC: Trimmed 48846 records to 33080 (keeping 200 days of data) [2025-09-29T17:26:52.222501] [DEBUG] [LOCAL ] BBDC: Primary data saved (33080 records). [2025-09-29T17:26:52.222668] [INFO ] [MAIN ] BBDC: Full history saved. [2025-09-29T17:26:52.222771] [INFO ] [MAIN ] Update Progress: 220/2371 symbols completed. BBDC took 26.5s. Estimated remaining: 4h 22m 15s. Rate: 8.2 symbols/min [2025-09-29T17:26:52.353257] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-09-29T17:26:52.411890] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:26:52.412076] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-09-29T17:26:52.412115] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-09-29T17:26:52.412265] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-09-29T17:26:52.412331] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-29T17:26:52.412406] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-29T17:26:52.412453] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-09-29T17:26:52.786912] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:26:53.129884] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-29T17:26:53.148074] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-09-29T17:26:53.400734] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-29T17:26:53.412352] [INFO ] [REMOTE ] BBAR: Full fetch complete (60781 records). [2025-09-29T17:26:53.412523] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-09-29T17:26:53.752998] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-29T17:26:53.845433] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-09-29T17:26:53.845526] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-09-29T17:26:53.846322] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-09-29T17:26:53.846395] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-09-29T17:26:53.847842] [DEBUG] [LOCAL ] BBAR: Trimmed 60781 records to 41378 (keeping 200 days of data) [2025-09-29T17:26:53.948213] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-09-29T17:26:54.123880] [DEBUG] [LOCAL ] BBAR: Primary data saved (41378 records). [2025-09-29T17:26:54.124024] [INFO ] [MAIN ] BBAR: Full history saved. [2025-09-29T17:26:54.124153] [INFO ] [MAIN ] Update Progress: 221/2371 symbols completed. BBAR took 36.6s. Estimated remaining: 4h 21m 15s. Rate: 8.2 symbols/min [2025-09-29T17:26:54.309697] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:26:54.317588] [DEBUG] [LOCAL ] BBU: Loaded 4478 existing records from primary storage. [2025-09-29T17:26:54.317866] [INFO ] [MAIN ] BBU: Loaded 4478 existing records. [2025-09-29T17:26:54.513233] [WARN ] [MAIN ] BBU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:26:54.513495] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-09-29T17:26:54.513549] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-09-29T17:26:54.513862] [DEBUG] [LOCAL ] BBU: Deleted primary data file. [2025-09-29T17:26:54.513924] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-09-29T17:26:54.749814] [INFO ] [REMOTE ] BBT: Fetching primary data for 2024-12. [2025-09-29T17:26:54.835365] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-29T17:26:54.904845] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:26:55.021005] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T17:26:55.021311] [WARN ] [REMOTE ] BBT: No data returned for month 2024-12 [2025-09-29T17:26:55.021417] [FATAL] [REMOTE ] BBT: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T17:26:55.021552] [FATAL] [MAIN ] BBT: Failed to fetch primary data. [2025-09-29T17:26:55.021638] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T17:26:55.021755] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-29T17:26:55.021839] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-29T17:26:55.021880] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-09-29T17:26:55.021950] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-09-29T17:26:55.022010] [INFO ] [MAIN ] Update Progress: 222/2371 symbols completed. BBT took 2.8s. Estimated remaining: 4h 20m 5s. Rate: 8.3 symbols/min [2025-09-29T17:26:55.201476] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:26:55.218057] [DEBUG] [LOCAL ] BBUC: Loaded 13503 existing records from primary storage. [2025-09-29T17:26:55.218304] [INFO ] [MAIN ] BBUC: Loaded 13503 existing records. [2025-09-29T17:26:55.404052] [WARN ] [MAIN ] BBUC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:26:55.404307] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-09-29T17:26:55.404365] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-09-29T17:26:55.404696] [DEBUG] [LOCAL ] BBUC: Deleted primary data file. [2025-09-29T17:26:55.404756] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-09-29T17:26:55.553253] [INFO ] [REMOTE ] BBU: Fetching primary data for 2024-12. [2025-09-29T17:26:55.787815] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:26:56.348126] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2024-12. [2025-09-29T17:26:56.376548] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-29T17:26:57.148217] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-09-29T17:26:57.219065] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-29T17:26:57.582459] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-29T17:26:57.948103] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-09-29T17:26:58.652291] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-29T17:26:58.748139] [INFO ] [REMOTE ] BBN: Fetching primary data for 2024-12. [2025-09-29T17:26:59.548169] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-09-29T17:27:00.114121] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-29T17:27:00.155305] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-29T17:27:00.348204] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-09-29T17:27:01.138773] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-29T17:27:01.148124] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-09-29T17:27:01.738026] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-29T17:27:01.948127] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-09-29T17:27:02.364077] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-29T17:27:02.748118] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-09-29T17:27:03.335526] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-29T17:27:03.548155] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-09-29T17:27:04.269784] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-29T17:27:04.271322] [INFO ] [REMOTE ] BBDO: Full fetch complete (7676 records). [2025-09-29T17:27:04.271427] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-09-29T17:27:04.353210] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-09-29T17:27:04.721905] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present. [2025-09-29T17:27:04.721993] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed. [2025-09-29T17:27:04.722210] [INFO ] [MAIN ] BBDO: Fetched primary data is valid. [2025-09-29T17:27:04.722253] [DEBUG] [LOCAL ] BBDO: Saving primary data. [2025-09-29T17:27:04.722807] [DEBUG] [LOCAL ] BBDO: Trimmed 7676 records to 4954 (keeping 200 days of data) [2025-09-29T17:27:04.758985] [DEBUG] [LOCAL ] BBDO: Primary data saved (4954 records). [2025-09-29T17:27:04.759142] [INFO ] [MAIN ] BBDO: Full history saved. [2025-09-29T17:27:04.759276] [INFO ] [MAIN ] Update Progress: 223/2371 symbols completed. BBDO took 18.4s. Estimated remaining: 4h 20m 22s. Rate: 8.2 symbols/min [2025-09-29T17:27:04.942975] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-29T17:27:04.947592] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:27:05.016976] [DEBUG] [LOCAL ] BBVA: Loaded 50167 existing records from primary storage. [2025-09-29T17:27:05.017379] [INFO ] [MAIN ] BBVA: Loaded 50167 existing records. [2025-09-29T17:27:05.162946] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-09-29T17:27:05.208072] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:27:05.208334] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-09-29T17:27:05.208384] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-09-29T17:27:05.209103] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-09-29T17:27:05.209164] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-09-29T17:27:05.585287] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:27:05.948107] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-09-29T17:27:06.053168] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-29T17:27:06.513293] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-29T17:27:06.748116] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-09-29T17:27:07.548092] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-09-29T17:27:07.856016] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-29T17:27:08.348156] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-09-29T17:27:08.554278] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-29T17:27:08.797725] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-29T17:27:09.148144] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-09-29T17:27:09.952334] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-09-29T17:27:09.955800] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-29T17:27:10.674382] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-29T17:27:10.748143] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-09-29T17:27:11.548140] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-09-29T17:27:11.820312] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-29T17:27:12.348080] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-09-29T17:27:12.402671] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-29T17:27:13.148114] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2024-12. [2025-09-29T17:27:13.405143] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-29T17:27:13.948128] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-09-29T17:27:14.748114] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-09-29T17:27:14.848163] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-29T17:27:14.850576] [INFO ] [REMOTE ] BBU: Full fetch complete (6478 records). [2025-09-29T17:27:14.850756] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-09-29T17:27:15.076471] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-29T17:27:15.308712] [DEBUG] [VALIDATOR ] BBU: All expected trading days are present. [2025-09-29T17:27:15.308822] [DEBUG] [VALIDATOR ] BBU: Primary data validation passed. [2025-09-29T17:27:15.309037] [INFO ] [MAIN ] BBU: Fetched primary data is valid. [2025-09-29T17:27:15.309128] [DEBUG] [LOCAL ] BBU: Saving primary data. [2025-09-29T17:27:15.309733] [DEBUG] [LOCAL ] BBU: Trimmed 6478 records to 4536 (keeping 200 days of data) [2025-09-29T17:27:15.340530] [DEBUG] [LOCAL ] BBU: Primary data saved (4536 records). [2025-09-29T17:27:15.340702] [INFO ] [MAIN ] BBU: Full history saved. [2025-09-29T17:27:15.340849] [INFO ] [MAIN ] Update Progress: 224/2371 symbols completed. BBU took 21.2s. Estimated remaining: 4h 20m 46s. Rate: 8.2 symbols/min [2025-09-29T17:27:15.528062] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:27:15.554477] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-09-29T17:27:15.567967] [DEBUG] [LOCAL ] BBW: Loaded 27177 existing records from primary storage. [2025-09-29T17:27:15.568259] [INFO ] [MAIN ] BBW: Loaded 27177 existing records. [2025-09-29T17:27:15.706862] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-29T17:27:15.777321] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:27:15.777713] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-09-29T17:27:15.777774] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-09-29T17:27:15.779061] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-09-29T17:27:15.779142] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-09-29T17:27:16.155718] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:27:16.348106] [INFO ] [REMOTE ] BBW: Fetching primary data for 2024-12. [2025-09-29T17:27:17.148141] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-09-29T17:27:17.291372] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-29T17:27:17.874364] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-29T17:27:17.948098] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-09-29T17:27:18.235126] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-29T17:27:18.748133] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-09-29T17:27:19.548141] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-09-29T17:27:19.642263] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-29T17:27:20.009257] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-29T17:27:20.348088] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-09-29T17:27:20.513468] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-29T17:27:21.148144] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-09-29T17:27:21.327107] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-29T17:27:21.948081] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-09-29T17:27:22.104833] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-29T17:27:22.748119] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-09-29T17:27:22.857239] [DEBUG] [REMOTE ] BBUC: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-09-29T17:27:22.857673] [WARN ] [REMOTE ] BBUC: No data returned for month 2025-06 [2025-09-29T17:27:22.857766] [FATAL] [REMOTE ] BBUC: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T17:27:22.857912] [FATAL] [MAIN ] BBUC: Failed to fetch primary data. [2025-09-29T17:27:22.857984] [WARN ] [MAIN ] BBUC: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T17:27:22.858076] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-09-29T17:27:22.858199] [DEBUG] [LOCAL ] BBUC: No primary data file found to delete. [2025-09-29T17:27:22.858278] [INFO ] [LOCAL ] BBUC: Starting deletion of derivative data. [2025-09-29T17:27:22.858961] [DEBUG] [LOCAL ] BBUC: Deleted derivative data file. [2025-09-29T17:27:22.859154] [INFO ] [MAIN ] Update Progress: 225/2371 symbols completed. BBUC took 27.8s. Estimated remaining: 4h 20m 41s. Rate: 8.2 symbols/min [2025-09-29T17:27:23.042544] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:27:23.117433] [DEBUG] [LOCAL ] BBWI: Loaded 54360 existing records from primary storage. [2025-09-29T17:27:23.117850] [INFO ] [MAIN ] BBWI: Loaded 54360 existing records. [2025-09-29T17:27:23.301854] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:27:23.302085] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-09-29T17:27:23.302135] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-09-29T17:27:23.303407] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-09-29T17:27:23.303481] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-09-29T17:27:23.556713] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-09-29T17:27:23.711749] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:27:23.759067] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-29T17:27:24.348128] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2024-12. [2025-09-29T17:27:24.414741] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-29T17:27:25.148116] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-09-29T17:27:25.950819] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-09-29T17:27:25.953359] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-29T17:27:26.199214] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-29T17:27:26.748117] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-09-29T17:27:27.225624] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-29T17:27:27.548129] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-09-29T17:27:28.348119] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-09-29T17:27:28.487957] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-29T17:27:29.072928] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-29T17:27:29.077238] [INFO ] [REMOTE ] BBN: Full fetch complete (26685 records). [2025-09-29T17:27:29.077411] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-09-29T17:27:29.152621] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-09-29T17:27:29.226756] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-29T17:27:29.504558] [DEBUG] [VALIDATOR ] BBN: All expected trading days are present. [2025-09-29T17:27:29.504709] [DEBUG] [VALIDATOR ] BBN: Primary data validation passed. [2025-09-29T17:27:29.505220] [INFO ] [MAIN ] BBN: Fetched primary data is valid. [2025-09-29T17:27:29.505299] [DEBUG] [LOCAL ] BBN: Saving primary data. [2025-09-29T17:27:29.506349] [DEBUG] [LOCAL ] BBN: Trimmed 26685 records to 18016 (keeping 200 days of data) [2025-09-29T17:27:29.625031] [DEBUG] [LOCAL ] BBN: Primary data saved (18016 records). [2025-09-29T17:27:29.625221] [INFO ] [MAIN ] BBN: Full history saved. [2025-09-29T17:27:29.625330] [INFO ] [MAIN ] Update Progress: 226/2371 symbols completed. BBN took 39.6s. Estimated remaining: 4h 20m 29s. Rate: 8.2 symbols/min [2025-09-29T17:27:29.800093] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:27:29.874308] [DEBUG] [LOCAL ] BBY: Loaded 54253 existing records from primary storage. [2025-09-29T17:27:29.874663] [INFO ] [MAIN ] BBY: Loaded 54253 existing records. [2025-09-29T17:27:29.953264] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-09-29T17:27:30.065892] [WARN ] [MAIN ] BBY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:27:30.066137] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-09-29T17:27:30.066197] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-09-29T17:27:30.067117] [DEBUG] [LOCAL ] BBY: Deleted primary data file. [2025-09-29T17:27:30.067177] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-09-29T17:27:30.431426] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:27:30.748115] [INFO ] [REMOTE ] BBY: Fetching primary data for 2024-12. [2025-09-29T17:27:31.062150] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-29T17:27:31.160437] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-29T17:27:31.548108] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-09-29T17:27:32.348104] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-09-29T17:27:32.715590] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-29T17:27:32.765818] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-29T17:27:33.148106] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-09-29T17:27:33.948108] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-09-29T17:27:34.183464] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-29T17:27:34.748150] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-09-29T17:27:34.804749] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-29T17:27:35.548159] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-09-29T17:27:35.840761] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-29T17:27:35.956975] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-29T17:27:36.348138] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-09-29T17:27:37.044271] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-29T17:27:37.148166] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-09-29T17:27:37.948108] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-09-29T17:27:38.038442] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-29T17:27:38.669417] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-29T17:27:38.748111] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-09-29T17:27:39.321474] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-29T17:27:39.548198] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-09-29T17:27:40.256368] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-29T17:27:40.348132] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-09-29T17:27:41.158062] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-09-29T17:27:41.180574] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-29T17:27:41.912741] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-29T17:27:41.948123] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-09-29T17:27:42.748157] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-09-29T17:27:42.881473] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-29T17:27:42.889191] [INFO ] [REMOTE ] BBW: Full fetch complete (39025 records). [2025-09-29T17:27:42.889345] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-09-29T17:27:43.299732] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-09-29T17:27:43.299848] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-09-29T17:27:43.300365] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-09-29T17:27:43.300416] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-09-29T17:27:43.301417] [DEBUG] [LOCAL ] BBW: Trimmed 39025 records to 26648 (keeping 200 days of data) [2025-09-29T17:27:43.475834] [DEBUG] [LOCAL ] BBW: Primary data saved (26648 records). [2025-09-29T17:27:43.475971] [INFO ] [MAIN ] BBW: Full history saved. [2025-09-29T17:27:43.476071] [INFO ] [MAIN ] Update Progress: 227/2371 symbols completed. BBW took 28.1s. Estimated remaining: 4h 21m 24s. Rate: 8.2 symbols/min [2025-09-29T17:27:43.550752] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-09-29T17:27:43.656242] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:27:43.701297] [DEBUG] [LOCAL ] BC: Loaded 45020 existing records from primary storage. [2025-09-29T17:27:43.701611] [INFO ] [MAIN ] BC: Loaded 45020 existing records. [2025-09-29T17:27:43.913490] [WARN ] [MAIN ] BC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:27:43.913871] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-09-29T17:27:43.913956] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-09-29T17:27:43.914703] [DEBUG] [LOCAL ] BC: Deleted primary data file. [2025-09-29T17:27:43.914867] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-09-29T17:27:44.108040] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-29T17:27:44.338823] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:27:44.348080] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-09-29T17:27:44.757814] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-29T17:27:44.899254] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-29T17:27:45.148229] [INFO ] [REMOTE ] BC: Fetching primary data for 2024-12. [2025-09-29T17:27:45.948088] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-09-29T17:27:46.262570] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-29T17:27:46.700022] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-29T17:27:46.748150] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-09-29T17:27:47.532568] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-29T17:27:47.548066] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-09-29T17:27:48.348103] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-09-29T17:27:48.590088] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-29T17:27:49.148154] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-09-29T17:27:49.364719] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-29T17:27:49.376092] [INFO ] [REMOTE ] BBWI: Full fetch complete (77415 records). [2025-09-29T17:27:49.376271] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-09-29T17:27:49.784594] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-09-29T17:27:49.784747] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-09-29T17:27:49.785530] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-09-29T17:27:49.785609] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-09-29T17:27:49.787170] [DEBUG] [LOCAL ] BBWI: Trimmed 77415 records to 53580 (keeping 200 days of data) [2025-09-29T17:27:49.971446] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-09-29T17:27:50.132364] [DEBUG] [LOCAL ] BBWI: Primary data saved (53580 records). [2025-09-29T17:27:50.132549] [INFO ] [MAIN ] BBWI: Full history saved. [2025-09-29T17:27:50.132870] [INFO ] [MAIN ] Update Progress: 228/2371 symbols completed. BBWI took 27.3s. Estimated remaining: 4h 21m 10s. Rate: 8.2 symbols/min [2025-09-29T17:27:50.332983] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-29T17:27:50.351766] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:27:50.404433] [DEBUG] [LOCAL ] BCAT: Loaded 34910 existing records from primary storage. [2025-09-29T17:27:50.404744] [INFO ] [MAIN ] BCAT: Loaded 34910 existing records. [2025-09-29T17:27:50.593249] [WARN ] [MAIN ] BCAT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:27:50.593683] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-09-29T17:27:50.593837] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-09-29T17:27:50.594518] [DEBUG] [LOCAL ] BCAT: Deleted primary data file. [2025-09-29T17:27:50.594585] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-09-29T17:27:50.750345] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-09-29T17:27:51.002428] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-29T17:27:51.008728] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:27:51.548108] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-09-29T17:27:51.727211] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-29T17:27:52.348093] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-09-29T17:27:52.616687] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-29T17:27:53.047888] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-29T17:27:53.148156] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2024-12. [2025-09-29T17:27:53.948150] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-09-29T17:27:54.221306] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-29T17:27:54.243749] [INFO ] [REMOTE ] BBVA: Full fetch complete (71586 records). [2025-09-29T17:27:54.244017] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-09-29T17:27:54.755483] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-09-29T17:27:54.813933] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-09-29T17:27:54.814167] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-09-29T17:27:54.815317] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-09-29T17:27:54.815465] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-09-29T17:27:54.844691] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-29T17:27:54.843025] [DEBUG] [LOCAL ] BBVA: Trimmed 71586 records to 49353 (keeping 200 days of data) [2025-09-29T17:27:55.183723] [DEBUG] [LOCAL ] BBVA: Primary data saved (49353 records). [2025-09-29T17:27:55.183925] [INFO ] [MAIN ] BBVA: Full history saved. [2025-09-29T17:27:55.184853] [INFO ] [MAIN ] Update Progress: 229/2371 symbols completed. BBVA took 50.4s. Estimated remaining: 4h 20m 42s. Rate: 8.2 symbols/min [2025-09-29T17:27:55.359772] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:27:55.394799] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-29T17:27:55.443193] [DEBUG] [LOCAL ] BCC: Loaded 28735 existing records from primary storage. [2025-09-29T17:27:55.443626] [INFO ] [MAIN ] BCC: Loaded 28735 existing records. [2025-09-29T17:27:55.550598] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-09-29T17:27:55.636185] [WARN ] [MAIN ] BCC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:27:55.636515] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-09-29T17:27:55.636573] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-09-29T17:27:55.638121] [DEBUG] [LOCAL ] BCC: Deleted primary data file. [2025-09-29T17:27:55.638193] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-09-29T17:27:55.985091] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:27:56.348138] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-09-29T17:27:56.877499] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-29T17:27:57.148100] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-09-29T17:27:57.257399] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-29T17:27:57.487356] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-29T17:27:57.948162] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-09-29T17:27:58.748141] [INFO ] [REMOTE ] BCC: Fetching primary data for 2024-12. [2025-09-29T17:27:59.029182] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-29T17:27:59.041277] [INFO ] [REMOTE ] BBY: Full fetch complete (77243 records). [2025-09-29T17:27:59.041421] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-09-29T17:27:59.437158] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-29T17:27:59.497881] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present. [2025-09-29T17:27:59.497980] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed. [2025-09-29T17:27:59.498806] [INFO ] [MAIN ] BBY: Fetched primary data is valid. [2025-09-29T17:27:59.498873] [DEBUG] [LOCAL ] BBY: Saving primary data. [2025-09-29T17:27:59.500443] [DEBUG] [LOCAL ] BBY: Trimmed 77243 records to 53470 (keeping 200 days of data) [2025-09-29T17:27:59.561964] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-09-29T17:27:59.848767] [DEBUG] [LOCAL ] BBY: Primary data saved (53470 records). [2025-09-29T17:27:59.848915] [INFO ] [MAIN ] BBY: Full history saved. [2025-09-29T17:27:59.850005] [INFO ] [MAIN ] Update Progress: 230/2371 symbols completed. BBY took 30.2s. Estimated remaining: 4h 20m 10s. Rate: 8.2 symbols/min [2025-09-29T17:28:00.038117] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:28:00.057163] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-29T17:28:00.117919] [DEBUG] [LOCAL ] BCE: Loaded 53072 existing records from primary storage. [2025-09-29T17:28:00.118275] [INFO ] [MAIN ] BCE: Loaded 53072 existing records. [2025-09-29T17:28:00.311894] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:28:00.312169] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-09-29T17:28:00.312230] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-09-29T17:28:00.312845] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-09-29T17:28:00.312904] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-09-29T17:28:00.353219] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-09-29T17:28:00.745581] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:28:01.129582] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-29T17:28:01.148109] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-09-29T17:28:01.663322] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-29T17:28:01.948171] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-09-29T17:28:02.673252] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-29T17:28:02.748152] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-09-29T17:28:03.544281] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-29T17:28:03.553257] [INFO ] [REMOTE ] BCE: Fetching primary data for 2024-12. [2025-09-29T17:28:04.109133] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-29T17:28:04.348112] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-09-29T17:28:05.148126] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-09-29T17:28:05.366558] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-29T17:28:05.800558] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-29T17:28:05.948159] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-09-29T17:28:06.749794] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-09-29T17:28:06.753288] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-29T17:28:07.548088] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-09-29T17:28:07.843620] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-29T17:28:07.859669] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-29T17:28:08.348155] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-09-29T17:28:09.148136] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-09-29T17:28:09.308961] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-29T17:28:09.379005] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-29T17:28:09.948129] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-09-29T17:28:10.748137] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-09-29T17:28:10.839516] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-29T17:28:11.435426] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-29T17:28:11.548099] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-09-29T17:28:12.349376] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-09-29T17:28:12.354623] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-29T17:28:13.011201] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-29T17:28:13.148137] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-09-29T17:28:13.524036] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-29T17:28:13.948141] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-09-29T17:28:14.748164] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-09-29T17:28:14.811014] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-29T17:28:14.819413] [INFO ] [REMOTE ] BC: Full fetch complete (63836 records). [2025-09-29T17:28:14.819538] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-09-29T17:28:15.234160] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-09-29T17:28:15.234401] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-09-29T17:28:15.235381] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-09-29T17:28:15.235542] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-09-29T17:28:15.237108] [DEBUG] [LOCAL ] BC: Trimmed 63836 records to 44259 (keeping 200 days of data) [2025-09-29T17:28:15.488544] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-29T17:28:15.553637] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-09-29T17:28:15.564770] [DEBUG] [LOCAL ] BC: Primary data saved (44259 records). [2025-09-29T17:28:15.564927] [INFO ] [MAIN ] BC: Full history saved. [2025-09-29T17:28:15.565050] [INFO ] [MAIN ] Update Progress: 231/2371 symbols completed. BC took 32.1s. Estimated remaining: 4h 21m 21s. Rate: 8.2 symbols/min [2025-09-29T17:28:15.758173] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:28:15.794892] [DEBUG] [LOCAL ] BCH: Loaded 30039 existing records from primary storage. [2025-09-29T17:28:15.795205] [INFO ] [MAIN ] BCH: Loaded 30039 existing records. [2025-09-29T17:28:15.992031] [WARN ] [MAIN ] BCH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:28:15.992257] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-09-29T17:28:15.992306] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-09-29T17:28:15.992871] [DEBUG] [LOCAL ] BCH: Deleted primary data file. [2025-09-29T17:28:15.992954] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-09-29T17:28:16.348366] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-09-29T17:28:16.414420] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:28:16.623912] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-29T17:28:17.148119] [INFO ] [REMOTE ] BCH: Fetching primary data for 2024-12. [2025-09-29T17:28:17.338801] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-29T17:28:17.346824] [INFO ] [REMOTE ] BCAT: Full fetch complete (49774 records). [2025-09-29T17:28:17.347070] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-09-29T17:28:17.348015] [FATAL] [VALIDATOR ] BCAT: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:28:17.348109] [FATAL] [MAIN ] BCAT: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:28:17.348156] [WARN ] [MAIN ] BCAT: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:28:17.348199] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-09-29T17:28:17.348325] [DEBUG] [LOCAL ] BCAT: No primary data file found to delete. [2025-09-29T17:28:17.348385] [INFO ] [LOCAL ] BCAT: Starting deletion of derivative data. [2025-09-29T17:28:17.349354] [DEBUG] [LOCAL ] BCAT: Deleted derivative data file. [2025-09-29T17:28:17.349460] [INFO ] [MAIN ] Update Progress: 232/2371 symbols completed. BCAT took 27.2s. Estimated remaining: 4h 20m 22s. Rate: 8.2 symbols/min [2025-09-29T17:28:17.487084] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-29T17:28:17.570388] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:28:17.604870] [DEBUG] [LOCAL ] BCO: Loaded 26740 existing records from primary storage. [2025-09-29T17:28:17.605177] [INFO ] [MAIN ] BCO: Loaded 26740 existing records. [2025-09-29T17:28:17.796862] [WARN ] [MAIN ] BCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:28:17.797083] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-09-29T17:28:17.797152] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-09-29T17:28:17.798184] [DEBUG] [LOCAL ] BCO: Deleted primary data file. [2025-09-29T17:28:17.798246] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-09-29T17:28:17.955484] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-09-29T17:28:18.178731] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:28:18.748104] [INFO ] [REMOTE ] BCO: Fetching primary data for 2024-12. [2025-09-29T17:28:19.345398] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-29T17:28:19.548144] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-09-29T17:28:19.980420] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-29T17:28:20.313243] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2024-12 (3.17 seconds). [2025-09-29T17:28:20.348087] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-09-29T17:28:21.148138] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-09-29T17:28:21.450455] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-29T17:28:21.477755] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-29T17:28:21.948086] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-09-29T17:28:22.209303] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-29T17:28:22.748098] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-09-29T17:28:23.554080] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-09-29T17:28:23.568595] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-29T17:28:23.943283] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-29T17:28:24.348107] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-09-29T17:28:24.989429] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-29T17:28:25.148115] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-09-29T17:28:25.948818] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-09-29T17:28:25.952174] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-29T17:28:26.312248] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-29T17:28:26.748190] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-09-29T17:28:27.302270] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-29T17:28:27.308891] [INFO ] [REMOTE ] BCC: Full fetch complete (40503 records). [2025-09-29T17:28:27.309012] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-09-29T17:28:27.553297] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-09-29T17:28:27.720380] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present. [2025-09-29T17:28:27.720475] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed. [2025-09-29T17:28:27.721041] [INFO ] [MAIN ] BCC: Fetched primary data is valid. [2025-09-29T17:28:27.721109] [DEBUG] [LOCAL ] BCC: Saving primary data. [2025-09-29T17:28:27.722099] [DEBUG] [LOCAL ] BCC: Trimmed 40503 records to 28242 (keeping 200 days of data) [2025-09-29T17:28:27.911892] [DEBUG] [LOCAL ] BCC: Primary data saved (28242 records). [2025-09-29T17:28:27.912036] [INFO ] [MAIN ] BCC: Full history saved. [2025-09-29T17:28:27.912123] [INFO ] [MAIN ] Update Progress: 233/2371 symbols completed. BCC took 32.7s. Estimated remaining: 4h 20m 45s. Rate: 8.2 symbols/min [2025-09-29T17:28:28.110506] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-29T17:28:28.115367] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:28:28.189155] [DEBUG] [LOCAL ] BCS: Loaded 54242 existing records from primary storage. [2025-09-29T17:28:28.189539] [INFO ] [MAIN ] BCS: Loaded 54242 existing records. [2025-09-29T17:28:28.359211] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-09-29T17:28:28.408500] [WARN ] [MAIN ] BCS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:28:28.408839] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-09-29T17:28:28.408915] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-09-29T17:28:28.409937] [DEBUG] [LOCAL ] BCS: Deleted primary data file. [2025-09-29T17:28:28.410002] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-09-29T17:28:28.794034] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:28:29.148116] [INFO ] [REMOTE ] BCS: Fetching primary data for 2024-12. [2025-09-29T17:28:29.486992] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-29T17:28:29.898610] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-29T17:28:29.948131] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-09-29T17:28:30.748109] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-09-29T17:28:30.979959] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-29T17:28:31.548086] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-09-29T17:28:31.716016] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-29T17:28:31.834150] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-29T17:28:32.348095] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-09-29T17:28:32.777847] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-29T17:28:33.148162] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-09-29T17:28:33.948096] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-09-29T17:28:34.184948] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-29T17:28:34.195589] [INFO ] [REMOTE ] BCE: Full fetch complete (76083 records). [2025-09-29T17:28:34.195793] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-09-29T17:28:34.494624] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-29T17:28:34.648184] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-09-29T17:28:34.648268] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-09-29T17:28:34.649046] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-09-29T17:28:34.649134] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-09-29T17:28:34.650618] [DEBUG] [LOCAL ] BCE: Trimmed 76083 records to 52283 (keeping 200 days of data) [2025-09-29T17:28:34.748286] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-09-29T17:28:34.992504] [DEBUG] [LOCAL ] BCE: Primary data saved (52283 records). [2025-09-29T17:28:34.992689] [INFO ] [MAIN ] BCE: Full history saved. [2025-09-29T17:28:34.993998] [INFO ] [MAIN ] Update Progress: 234/2371 symbols completed. BCE took 35.1s. Estimated remaining: 4h 20m 35s. Rate: 8.2 symbols/min [2025-09-29T17:28:35.183390] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:28:35.218405] [DEBUG] [LOCAL ] BCSF: Loaded 28231 existing records from primary storage. [2025-09-29T17:28:35.218878] [INFO ] [MAIN ] BCSF: Loaded 28231 existing records. [2025-09-29T17:28:35.369837] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-29T17:28:35.438990] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:28:35.439192] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-09-29T17:28:35.439238] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-09-29T17:28:35.439621] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-09-29T17:28:35.439721] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-09-29T17:28:35.553245] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-09-29T17:28:35.820999] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:28:36.087147] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-29T17:28:36.348152] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-09-29T17:28:37.148095] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-09-29T17:28:37.454524] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-29T17:28:37.531846] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-29T17:28:37.948127] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-09-29T17:28:38.332175] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-29T17:28:38.748157] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-09-29T17:28:39.444419] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-29T17:28:39.548152] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-09-29T17:28:39.853746] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-29T17:28:39.860630] [INFO ] [REMOTE ] BCH: Full fetch complete (40868 records). [2025-09-29T17:28:39.860844] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-09-29T17:28:40.262665] [DEBUG] [VALIDATOR ] BCH: All expected trading days are present. [2025-09-29T17:28:40.262759] [DEBUG] [VALIDATOR ] BCH: Primary data validation passed. [2025-09-29T17:28:40.263247] [INFO ] [MAIN ] BCH: Fetched primary data is valid. [2025-09-29T17:28:40.263292] [DEBUG] [LOCAL ] BCH: Saving primary data. [2025-09-29T17:28:40.264218] [DEBUG] [LOCAL ] BCH: Trimmed 40868 records to 29497 (keeping 200 days of data) [2025-09-29T17:28:40.354927] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2024-12. [2025-09-29T17:28:40.446809] [DEBUG] [LOCAL ] BCH: Primary data saved (29497 records). [2025-09-29T17:28:40.446952] [INFO ] [MAIN ] BCH: Full history saved. [2025-09-29T17:28:40.447039] [INFO ] [MAIN ] Update Progress: 235/2371 symbols completed. BCH took 24.9s. Estimated remaining: 4h 20m 11s. Rate: 8.2 symbols/min [2025-09-29T17:28:40.629255] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:28:40.655801] [DEBUG] [LOCAL ] BCX: Loaded 21920 existing records from primary storage. [2025-09-29T17:28:40.656078] [INFO ] [MAIN ] BCX: Loaded 21920 existing records. [2025-09-29T17:28:40.844110] [WARN ] [MAIN ] BCX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:28:40.844340] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-09-29T17:28:40.844387] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-09-29T17:28:40.845183] [DEBUG] [LOCAL ] BCX: Deleted primary data file. [2025-09-29T17:28:40.845242] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-09-29T17:28:41.153234] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-09-29T17:28:41.222129] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:28:41.645673] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-29T17:28:41.690746] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-29T17:28:41.948120] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-09-29T17:28:42.085408] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-29T17:28:42.748138] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-09-29T17:28:43.548167] [INFO ] [REMOTE ] BCX: Fetching primary data for 2024-12. [2025-09-29T17:28:43.648549] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-29T17:28:43.880183] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-29T17:28:44.348145] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-09-29T17:28:44.632828] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-29T17:28:45.148108] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-09-29T17:28:45.843108] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-29T17:28:45.948108] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-09-29T17:28:46.511685] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-29T17:28:46.748184] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-09-29T17:28:47.062315] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-29T17:28:47.548115] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-09-29T17:28:48.130350] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-29T17:28:48.348106] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-09-29T17:28:48.800368] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-29T17:28:49.148110] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-09-29T17:28:49.948127] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-09-29T17:28:50.229077] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-29T17:28:50.504480] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-29T17:28:50.748115] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-09-29T17:28:50.859938] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-29T17:28:50.865517] [INFO ] [REMOTE ] BCO: Full fetch complete (36743 records). [2025-09-29T17:28:50.865710] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-09-29T17:28:51.265102] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present. [2025-09-29T17:28:51.265193] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed. [2025-09-29T17:28:51.265767] [INFO ] [MAIN ] BCO: Fetched primary data is valid. [2025-09-29T17:28:51.265865] [DEBUG] [LOCAL ] BCO: Saving primary data. [2025-09-29T17:28:51.266832] [DEBUG] [LOCAL ] BCO: Trimmed 36743 records to 26212 (keeping 200 days of data) [2025-09-29T17:28:51.442753] [DEBUG] [LOCAL ] BCO: Primary data saved (26212 records). [2025-09-29T17:28:51.442898] [INFO ] [MAIN ] BCO: Full history saved. [2025-09-29T17:28:51.442988] [INFO ] [MAIN ] Update Progress: 236/2371 symbols completed. BCO took 34.1s. Estimated remaining: 4h 20m 37s. Rate: 8.2 symbols/min [2025-09-29T17:28:51.553413] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-09-29T17:28:51.622786] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:28:51.652036] [DEBUG] [LOCAL ] BDC: Loaded 25073 existing records from primary storage. [2025-09-29T17:28:51.652310] [INFO ] [MAIN ] BDC: Loaded 25073 existing records. [2025-09-29T17:28:51.839084] [WARN ] [MAIN ] BDC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:28:51.839288] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-09-29T17:28:51.839344] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-09-29T17:28:51.839889] [DEBUG] [LOCAL ] BDC: Deleted primary data file. [2025-09-29T17:28:51.839956] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-09-29T17:28:52.234062] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:28:52.236164] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-29T17:28:52.348084] [INFO ] [REMOTE ] BDC: Fetching primary data for 2024-12. [2025-09-29T17:28:52.678706] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-29T17:28:53.148138] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-09-29T17:28:53.598857] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-29T17:28:53.948124] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-09-29T17:28:54.285159] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-29T17:28:54.748131] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-09-29T17:28:55.271443] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-29T17:28:55.548090] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-09-29T17:28:55.588251] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-29T17:28:56.348131] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-09-29T17:28:57.148124] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-09-29T17:28:57.239923] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-29T17:28:57.568602] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-29T17:28:57.948122] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-09-29T17:28:58.398675] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-29T17:28:58.748255] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-09-29T17:28:59.180749] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-29T17:28:59.187322] [INFO ] [REMOTE ] BCSF: Full fetch complete (38264 records). [2025-09-29T17:28:59.187504] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-09-29T17:28:59.553304] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-09-29T17:28:59.675793] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-09-29T17:28:59.675907] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-09-29T17:28:59.676518] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-09-29T17:28:59.676591] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-09-29T17:28:59.678039] [DEBUG] [LOCAL ] BCSF: Trimmed 38264 records to 27789 (keeping 200 days of data) [2025-09-29T17:28:59.852071] [DEBUG] [LOCAL ] BCSF: Primary data saved (27789 records). [2025-09-29T17:28:59.852272] [INFO ] [MAIN ] BCSF: Full history saved. [2025-09-29T17:28:59.852382] [INFO ] [MAIN ] Update Progress: 237/2371 symbols completed. BCSF took 24.9s. Estimated remaining: 4h 20m 40s. Rate: 8.2 symbols/min [2025-09-29T17:29:00.348086] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-09-29T17:29:00.439826] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-29T17:29:00.825427] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-29T17:29:01.148099] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-09-29T17:29:01.164524] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-29T17:29:01.948120] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-09-29T17:29:02.748086] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-09-29T17:29:03.016939] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-29T17:29:03.088787] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-29T17:29:03.548118] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-09-29T17:29:04.163907] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-29T17:29:04.348415] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-09-29T17:29:04.820061] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-29T17:29:05.148168] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-09-29T17:29:05.948127] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-09-29T17:29:06.125338] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-29T17:29:06.136965] [INFO ] [REMOTE ] BCS: Full fetch complete (77299 records). [2025-09-29T17:29:06.137163] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-09-29T17:29:06.294185] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-29T17:29:06.593244] [DEBUG] [VALIDATOR ] BCS: All expected trading days are present. [2025-09-29T17:29:06.593423] [DEBUG] [VALIDATOR ] BCS: Primary data validation passed. [2025-09-29T17:29:06.594376] [INFO ] [MAIN ] BCS: Fetched primary data is valid. [2025-09-29T17:29:06.594445] [DEBUG] [LOCAL ] BCS: Saving primary data. [2025-09-29T17:29:06.596205] [DEBUG] [LOCAL ] BCS: Trimmed 77299 records to 53457 (keeping 200 days of data) [2025-09-29T17:29:06.782407] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-09-29T17:29:06.940082] [DEBUG] [LOCAL ] BCS: Primary data saved (53457 records). [2025-09-29T17:29:06.940234] [INFO ] [MAIN ] BCS: Full history saved. [2025-09-29T17:29:06.940889] [INFO ] [MAIN ] Update Progress: 238/2371 symbols completed. BCS took 39.0s. Estimated remaining: 4h 20m 30s. Rate: 8.2 symbols/min [2025-09-29T17:29:07.873215] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-29T17:29:07.879528] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-09-29T17:29:07.926200] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-29T17:29:07.931320] [INFO ] [REMOTE ] BCX: Full fetch complete (33940 records). [2025-09-29T17:29:07.931420] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-09-29T17:29:08.358442] [DEBUG] [VALIDATOR ] BCX: All expected trading days are present. [2025-09-29T17:29:08.358541] [DEBUG] [VALIDATOR ] BCX: Primary data validation passed. [2025-09-29T17:29:08.359140] [INFO ] [MAIN ] BCX: Fetched primary data is valid. [2025-09-29T17:29:08.359203] [DEBUG] [LOCAL ] BCX: Saving primary data. [2025-09-29T17:29:08.361298] [DEBUG] [LOCAL ] BCX: Trimmed 33940 records to 21626 (keeping 200 days of data) [2025-09-29T17:29:08.497307] [DEBUG] [LOCAL ] BCX: Primary data saved (21626 records). [2025-09-29T17:29:08.497486] [INFO ] [MAIN ] BCX: Full history saved. [2025-09-29T17:29:08.497592] [INFO ] [MAIN ] Update Progress: 239/2371 symbols completed. BCX took 28.1s. Estimated remaining: 4h 19m 31s. Rate: 8.2 symbols/min [2025-09-29T17:29:08.751755] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-29T17:29:08.760072] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-09-29T17:29:09.890858] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-29T17:29:09.896614] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-09-29T17:29:11.095067] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-29T17:29:11.100846] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-09-29T17:29:12.348807] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-29T17:29:12.354994] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-09-29T17:29:13.546212] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-29T17:29:13.552247] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-09-29T17:29:14.899696] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-29T17:29:14.904959] [INFO ] [REMOTE ] BDC: Full fetch complete (35770 records). [2025-09-29T17:29:14.905060] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-09-29T17:29:15.325288] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-09-29T17:29:15.325376] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-09-29T17:29:15.325858] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-09-29T17:29:15.325921] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-09-29T17:29:15.326942] [DEBUG] [LOCAL ] BDC: Trimmed 35770 records to 24595 (keeping 200 days of data) [2025-09-29T17:29:15.488066] [DEBUG] [LOCAL ] BDC: Primary data saved (24595 records). [2025-09-29T17:29:15.488204] [INFO ] [MAIN ] BDC: Full history saved. [2025-09-29T17:29:15.488285] [INFO ] [MAIN ] Update Progress: 240/2371 symbols completed. BDC took 24.0s. Estimated remaining: 4h 19m 21s. Rate: 8.2 symbols/min [2025-09-29T17:29:16.107719] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:29:16.145840] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:29:16.222867] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:29:16.243019] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:29:16.335350] [DEBUG] [LOCAL ] BDJ: Loaded 29325 existing records from primary storage. [2025-09-29T17:29:16.353328] [INFO ] [MAIN ] BDJ: Loaded 29325 existing records. [2025-09-29T17:29:16.353488] [DEBUG] [LOCAL ] BE: Loaded 54433 existing records from primary storage. [2025-09-29T17:29:16.359810] [INFO ] [MAIN ] BE: Loaded 54433 existing records. [2025-09-29T17:29:16.556198] [DEBUG] [LOCAL ] BDN: Loaded 48230 existing records from primary storage. [2025-09-29T17:29:16.604704] [DEBUG] [LOCAL ] BDX: Loaded 53191 existing records from primary storage. [2025-09-29T17:29:16.617615] [INFO ] [MAIN ] BDN: Loaded 48230 existing records. [2025-09-29T17:29:16.621532] [INFO ] [MAIN ] BDX: Loaded 53191 existing records. [2025-09-29T17:29:16.853701] [WARN ] [MAIN ] BDJ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:29:16.964169] [WARN ] [MAIN ] BE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:29:16.974701] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-09-29T17:29:17.008160] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-09-29T17:29:17.008226] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-09-29T17:29:17.024527] [DEBUG] [LOCAL ] BDJ: Deleted primary data file. [2025-09-29T17:29:17.013544] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-09-29T17:29:17.034382] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-09-29T17:29:17.076267] [DEBUG] [LOCAL ] BE: Deleted primary data file. [2025-09-29T17:29:17.123195] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-09-29T17:29:17.227945] [WARN ] [MAIN ] BDN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:29:17.288828] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-09-29T17:29:17.314963] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-09-29T17:29:17.361500] [DEBUG] [LOCAL ] BDN: Deleted primary data file. [2025-09-29T17:29:17.379348] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-09-29T17:29:17.471448] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:29:17.567489] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-09-29T17:29:17.567751] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-09-29T17:29:17.640724] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-09-29T17:29:17.707488] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-09-29T17:29:18.398532] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:29:18.427639] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2024-12. [2025-09-29T17:29:18.580322] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:29:18.603419] [INFO ] [REMOTE ] BE: Fetching primary data for 2024-12. [2025-09-29T17:29:18.692575] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:29:18.719620] [INFO ] [REMOTE ] BDN: Fetching primary data for 2024-12. [2025-09-29T17:29:18.822193] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:29:18.822496] [INFO ] [REMOTE ] BDX: Fetching primary data for 2024-12. [2025-09-29T17:29:20.207020] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-29T17:29:20.213683] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-09-29T17:29:20.538195] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-29T17:29:20.548760] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-09-29T17:29:20.761774] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-29T17:29:20.773822] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-09-29T17:29:20.873131] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-09-29T17:29:20.885031] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-09-29T17:29:21.103757] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-29T17:29:21.110637] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-09-29T17:29:21.899456] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-29T17:29:21.909671] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-09-29T17:29:22.211603] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-29T17:29:22.218719] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-09-29T17:29:22.495726] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-29T17:29:22.507261] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-09-29T17:29:22.930105] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-29T17:29:22.941473] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-09-29T17:29:23.069585] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-29T17:29:23.076240] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-09-29T17:29:23.611580] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-29T17:29:23.621199] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-09-29T17:29:23.970849] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-29T17:29:24.348122] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-09-29T17:29:24.458602] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-29T17:29:24.705143] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-29T17:29:25.148122] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-09-29T17:29:25.296932] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-29T17:29:25.948101] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-09-29T17:29:26.057110] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-29T17:29:26.088375] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-29T17:29:26.748113] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-09-29T17:29:27.548098] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-09-29T17:29:27.830304] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-29T17:29:27.890017] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-29T17:29:28.348121] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-09-29T17:29:29.148101] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-09-29T17:29:29.310133] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-29T17:29:29.948109] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-09-29T17:29:30.269110] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-29T17:29:30.748105] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-09-29T17:29:30.792752] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-29T17:29:31.429802] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-29T17:29:31.548120] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-09-29T17:29:32.348121] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-09-29T17:29:32.647810] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-29T17:29:33.116806] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-29T17:29:33.148068] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-09-29T17:29:33.619566] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-29T17:29:33.948116] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-09-29T17:29:34.748128] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-09-29T17:29:34.927236] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-29T17:29:35.079939] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-29T17:29:35.548114] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-09-29T17:29:35.968075] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-29T17:29:36.348146] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-09-29T17:29:37.148089] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-09-29T17:29:37.290874] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-29T17:29:37.905408] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-29T17:29:37.948068] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-09-29T17:29:38.748142] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-09-29T17:29:38.813150] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-29T17:29:39.552770] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-09-29T17:29:39.559111] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-29T17:29:40.090597] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-29T17:29:40.096907] [INFO ] [REMOTE ] BDJ: Full fetch complete (42899 records). [2025-09-29T17:29:40.097060] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-09-29T17:29:40.353292] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-09-29T17:29:40.511522] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-09-29T17:29:40.511627] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-09-29T17:29:40.512261] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-09-29T17:29:40.512338] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-09-29T17:29:40.513561] [DEBUG] [LOCAL ] BDJ: Trimmed 42899 records to 28915 (keeping 200 days of data) [2025-09-29T17:29:40.693935] [DEBUG] [LOCAL ] BDJ: Primary data saved (28915 records). [2025-09-29T17:29:40.694075] [INFO ] [MAIN ] BDJ: Full history saved. [2025-09-29T17:29:40.694173] [INFO ] [MAIN ] Update Progress: 241/2371 symbols completed. BDJ took 25.2s. Estimated remaining: 4h 21m 52s. Rate: 8.1 symbols/min [2025-09-29T17:29:40.879793] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:29:40.880006] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-09-29T17:29:40.880063] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-09-29T17:29:40.880181] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-09-29T17:29:40.880224] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-29T17:29:40.880267] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-09-29T17:29:40.880300] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-09-29T17:29:41.153258] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-09-29T17:29:41.257988] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:29:41.784623] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-29T17:29:41.861683] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-29T17:29:41.871987] [INFO ] [REMOTE ] BDN: Full fetch complete (69213 records). [2025-09-29T17:29:41.872126] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-09-29T17:29:41.953199] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-09-29T17:29:42.286156] [DEBUG] [VALIDATOR ] BDN: All expected trading days are present. [2025-09-29T17:29:42.286258] [DEBUG] [VALIDATOR ] BDN: Primary data validation passed. [2025-09-29T17:29:42.287100] [INFO ] [MAIN ] BDN: Fetched primary data is valid. [2025-09-29T17:29:42.287168] [DEBUG] [LOCAL ] BDN: Saving primary data. [2025-09-29T17:29:42.288845] [DEBUG] [LOCAL ] BDN: Trimmed 69213 records to 47512 (keeping 200 days of data) [2025-09-29T17:29:42.569408] [DEBUG] [LOCAL ] BDN: Primary data saved (47512 records). [2025-09-29T17:29:42.569572] [INFO ] [MAIN ] BDN: Full history saved. [2025-09-29T17:29:42.570246] [INFO ] [MAIN ] Update Progress: 242/2371 symbols completed. BDN took 27.1s. Estimated remaining: 4h 20m 56s. Rate: 8.2 symbols/min [2025-09-29T17:29:42.766543] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2024-12. [2025-09-29T17:29:42.771513] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:29:42.849385] [DEBUG] [LOCAL ] BEKE: Loaded 54025 existing records from primary storage. [2025-09-29T17:29:42.849800] [INFO ] [MAIN ] BEKE: Loaded 54025 existing records. [2025-09-29T17:29:43.052891] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:29:43.053361] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-09-29T17:29:43.053551] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-09-29T17:29:43.054082] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-09-29T17:29:43.054147] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-09-29T17:29:43.345018] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-29T17:29:43.386107] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-29T17:29:43.488230] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:29:43.548079] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2024-12. [2025-09-29T17:29:44.348084] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-09-29T17:29:44.441714] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-09-29T17:29:45.148117] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-09-29T17:29:45.693539] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-29T17:29:45.948152] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-09-29T17:29:46.263671] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-29T17:29:46.274857] [INFO ] [REMOTE ] BDX: Full fetch complete (75795 records). [2025-09-29T17:29:46.275039] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-09-29T17:29:46.688378] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-09-29T17:29:46.688504] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-09-29T17:29:46.689347] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-09-29T17:29:46.689437] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-09-29T17:29:46.690931] [DEBUG] [LOCAL ] BDX: Trimmed 75795 records to 52378 (keeping 200 days of data) [2025-09-29T17:29:46.751819] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-09-29T17:29:47.041931] [DEBUG] [LOCAL ] BDX: Primary data saved (52378 records). [2025-09-29T17:29:47.042077] [INFO ] [MAIN ] BDX: Full history saved. [2025-09-29T17:29:47.043299] [INFO ] [MAIN ] Update Progress: 243/2371 symbols completed. BDX took 31.5s. Estimated remaining: 4h 20m 24s. Rate: 8.2 symbols/min [2025-09-29T17:29:47.152358] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-29T17:29:47.225400] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:29:47.290065] [DEBUG] [LOCAL ] BEN: Loaded 53833 existing records from primary storage. [2025-09-29T17:29:47.290504] [INFO ] [MAIN ] BEN: Loaded 53833 existing records. [2025-09-29T17:29:47.480661] [WARN ] [MAIN ] BEN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:29:47.480938] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-09-29T17:29:47.480995] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-09-29T17:29:47.481404] [DEBUG] [LOCAL ] BEN: Deleted primary data file. [2025-09-29T17:29:47.481497] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-09-29T17:29:47.553268] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-09-29T17:29:47.925066] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:29:47.958499] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-29T17:29:47.962250] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (2.81 seconds). [2025-09-29T17:29:47.985907] [INFO ] [REMOTE ] BE: Full fetch complete (77662 records). [2025-09-29T17:29:48.004001] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-09-29T17:29:48.013147] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-29T17:29:48.353270] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-09-29T17:29:48.455078] [DEBUG] [VALIDATOR ] BE: All expected trading days are present. [2025-09-29T17:29:48.455182] [DEBUG] [VALIDATOR ] BE: Primary data validation passed. [2025-09-29T17:29:48.456103] [INFO ] [MAIN ] BE: Fetched primary data is valid. [2025-09-29T17:29:48.456171] [DEBUG] [LOCAL ] BE: Saving primary data. [2025-09-29T17:29:48.457805] [DEBUG] [LOCAL ] BE: Trimmed 77662 records to 53653 (keeping 200 days of data) [2025-09-29T17:29:48.784771] [DEBUG] [LOCAL ] BE: Primary data saved (53653 records). [2025-09-29T17:29:48.784919] [INFO ] [MAIN ] BE: Full history saved. [2025-09-29T17:29:48.785034] [INFO ] [MAIN ] Update Progress: 244/2371 symbols completed. BE took 33.3s. Estimated remaining: 4h 19m 28s. Rate: 8.2 symbols/min [2025-09-29T17:29:48.873572] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-29T17:29:48.977119] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:29:49.017454] [DEBUG] [LOCAL ] BEP: Loaded 39244 existing records from primary storage. [2025-09-29T17:29:49.017792] [INFO ] [MAIN ] BEP: Loaded 39244 existing records. [2025-09-29T17:29:49.153271] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-09-29T17:29:49.215254] [WARN ] [MAIN ] BEP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:29:49.215486] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-09-29T17:29:49.215536] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-09-29T17:29:49.215971] [DEBUG] [LOCAL ] BEP: Deleted primary data file. [2025-09-29T17:29:49.216035] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-09-29T17:29:49.593425] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:29:49.948137] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-09-29T17:29:50.429525] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-29T17:29:50.748108] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-09-29T17:29:50.939638] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-29T17:29:51.097736] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-29T17:29:51.548160] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-09-29T17:29:52.348163] [INFO ] [REMOTE ] BEN: Fetching primary data for 2024-12. [2025-09-29T17:29:53.148120] [INFO ] [REMOTE ] BEP: Fetching primary data for 2024-12. [2025-09-29T17:29:53.605889] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-29T17:29:53.948137] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-09-29T17:29:54.217120] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-29T17:29:54.713004] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-29T17:29:54.748111] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-09-29T17:29:55.548163] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-09-29T17:29:55.968841] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-29T17:29:56.270327] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-29T17:29:56.348113] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-09-29T17:29:57.148231] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-09-29T17:29:57.288098] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-29T17:29:57.920720] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-29T17:29:57.948152] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-09-29T17:29:58.748108] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-09-29T17:29:58.999229] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-29T17:29:59.228237] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-29T17:29:59.548148] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-09-29T17:29:59.610320] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-29T17:30:00.348162] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-09-29T17:30:01.148147] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-09-29T17:30:01.377567] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-29T17:30:01.948230] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-09-29T17:30:02.465445] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-29T17:30:02.748173] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-09-29T17:30:02.978225] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-29T17:30:03.548155] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-09-29T17:30:03.848930] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-09-29T17:30:03.919312] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-29T17:30:04.348132] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-09-29T17:30:04.789805] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-29T17:30:05.148172] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-09-29T17:30:05.395369] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-09-29T17:30:05.948110] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-09-29T17:30:06.417688] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-29T17:30:06.568621] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-29T17:30:06.569455] [INFO ] [REMOTE ] BEDU: Full fetch complete (1429 records). [2025-09-29T17:30:06.569528] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-09-29T17:30:06.758057] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-09-29T17:30:06.764613] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-09-29T17:30:06.766017] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:30:06.766095] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:30:06.766242] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-29T17:30:06.766335] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-09-29T17:30:06.766393] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-09-29T17:30:06.766452] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-09-29T17:30:06.766536] [INFO ] [MAIN ] Update Progress: 245/2371 symbols completed. BEDU took 26.1s. Estimated remaining: 4h 20m 53s. Rate: 8.1 symbols/min [2025-09-29T17:30:06.945875] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:30:07.000011] [DEBUG] [LOCAL ] BEPC: Loaded 47209 existing records from primary storage. [2025-09-29T17:30:07.000375] [INFO ] [MAIN ] BEPC: Loaded 47209 existing records. [2025-09-29T17:30:07.192249] [WARN ] [MAIN ] BEPC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:30:07.192486] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-09-29T17:30:07.192537] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-09-29T17:30:07.193147] [DEBUG] [LOCAL ] BEPC: Deleted primary data file. [2025-09-29T17:30:07.193211] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-09-29T17:30:07.553405] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-09-29T17:30:07.589534] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:30:08.265062] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-29T17:30:08.348151] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-09-29T17:30:09.148080] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-09-29T17:30:09.655488] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-29T17:30:09.948146] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2024-12. [2025-09-29T17:30:10.183697] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-29T17:30:10.748154] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-09-29T17:30:11.034419] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-29T17:30:11.548137] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-09-29T17:30:11.668511] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-29T17:30:12.323961] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-29T17:30:12.348119] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-09-29T17:30:13.148114] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-09-29T17:30:13.509024] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-29T17:30:13.520989] [INFO ] [REMOTE ] BEKE: Full fetch complete (77191 records). [2025-09-29T17:30:13.521259] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-09-29T17:30:13.961407] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-09-29T17:30:13.992758] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-09-29T17:30:13.992942] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-09-29T17:30:13.994170] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-09-29T17:30:13.994694] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-09-29T17:30:14.024289] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-29T17:30:14.022994] [DEBUG] [LOCAL ] BEKE: Trimmed 77191 records to 53241 (keeping 200 days of data) [2025-09-29T17:30:14.368593] [DEBUG] [LOCAL ] BEKE: Primary data saved (53241 records). [2025-09-29T17:30:14.368798] [INFO ] [MAIN ] BEKE: Full history saved. [2025-09-29T17:30:14.369675] [INFO ] [MAIN ] Update Progress: 246/2371 symbols completed. BEKE took 31.8s. Estimated remaining: 4h 20m 48s. Rate: 8.1 symbols/min [2025-09-29T17:30:14.551033] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:30:14.561439] [DEBUG] [LOCAL ] BEPH: Loaded 5208 existing records from primary storage. [2025-09-29T17:30:14.561723] [INFO ] [MAIN ] BEPH: Loaded 5208 existing records. [2025-09-29T17:30:14.755963] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-09-29T17:30:14.755875] [WARN ] [MAIN ] BEPH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:30:14.756180] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-09-29T17:30:14.757081] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-09-29T17:30:14.757304] [DEBUG] [LOCAL ] BEPH: Deleted primary data file. [2025-09-29T17:30:14.757390] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-09-29T17:30:15.150594] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:30:15.183469] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-29T17:30:15.548125] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-09-29T17:30:15.949512] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-29T17:30:16.253530] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-29T17:30:16.348121] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-09-29T17:30:17.148081] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2024-12. [2025-09-29T17:30:17.252439] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-29T17:30:17.728207] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-29T17:30:17.736345] [INFO ] [REMOTE ] BEP: Full fetch complete (58325 records). [2025-09-29T17:30:17.736487] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-09-29T17:30:17.899619] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-29T17:30:17.955195] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-09-29T17:30:18.163282] [DEBUG] [VALIDATOR ] BEP: All expected trading days are present. [2025-09-29T17:30:18.163387] [DEBUG] [VALIDATOR ] BEP: Primary data validation passed. [2025-09-29T17:30:18.164065] [INFO ] [MAIN ] BEP: Fetched primary data is valid. [2025-09-29T17:30:18.164129] [DEBUG] [LOCAL ] BEP: Saving primary data. [2025-09-29T17:30:18.165324] [DEBUG] [LOCAL ] BEP: Trimmed 58325 records to 38575 (keeping 200 days of data) [2025-09-29T17:30:18.404472] [DEBUG] [LOCAL ] BEP: Primary data saved (38575 records). [2025-09-29T17:30:18.404626] [INFO ] [MAIN ] BEP: Full history saved. [2025-09-29T17:30:18.404768] [INFO ] [MAIN ] Update Progress: 247/2371 symbols completed. BEP took 29.6s. Estimated remaining: 4h 20m 12s. Rate: 8.2 symbols/min [2025-09-29T17:30:18.581093] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:30:18.586956] [DEBUG] [LOCAL ] BEPI: Loaded 3487 existing records from primary storage. [2025-09-29T17:30:18.587135] [INFO ] [MAIN ] BEPI: Loaded 3487 existing records. [2025-09-29T17:30:18.757088] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-09-29T17:30:18.780455] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:30:18.781561] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-09-29T17:30:18.781624] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-09-29T17:30:18.782054] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-09-29T17:30:18.782113] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-09-29T17:30:19.156914] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:30:19.548139] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2024-12. [2025-09-29T17:30:20.095862] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-29T17:30:20.107064] [INFO ] [REMOTE ] BEN: Full fetch complete (76889 records). [2025-09-29T17:30:20.107231] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-09-29T17:30:20.185575] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-29T17:30:20.355981] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-09-29T17:30:20.530263] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-09-29T17:30:20.530347] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-09-29T17:30:20.531170] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-09-29T17:30:20.531239] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-09-29T17:30:20.532736] [DEBUG] [LOCAL ] BEN: Trimmed 76889 records to 53054 (keeping 200 days of data) [2025-09-29T17:30:20.855571] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-29T17:30:20.879511] [DEBUG] [LOCAL ] BEN: Primary data saved (53054 records). [2025-09-29T17:30:20.879690] [INFO ] [MAIN ] BEN: Full history saved. [2025-09-29T17:30:20.879811] [INFO ] [MAIN ] Update Progress: 248/2371 symbols completed. BEN took 33.8s. Estimated remaining: 4h 19m 23s. Rate: 8.2 symbols/min [2025-09-29T17:30:21.068855] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:30:21.073985] [DEBUG] [LOCAL ] BEPJ: Loaded 3268 existing records from primary storage. [2025-09-29T17:30:21.074157] [INFO ] [MAIN ] BEPJ: Loaded 3268 existing records. [2025-09-29T17:30:21.153215] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-09-29T17:30:21.264943] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:30:21.265230] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-09-29T17:30:21.265288] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-09-29T17:30:21.265584] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-09-29T17:30:21.265669] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-09-29T17:30:21.639772] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:30:21.669323] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-29T17:30:21.948080] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2024-12. [2025-09-29T17:30:22.207572] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (3.45 seconds). [2025-09-29T17:30:22.590959] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-29T17:30:22.748108] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-09-29T17:30:23.102340] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-29T17:30:23.548122] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-09-29T17:30:24.178158] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-29T17:30:24.348116] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-09-29T17:30:24.838377] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-29T17:30:25.148111] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-09-29T17:30:25.653209] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-29T17:30:25.948107] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-09-29T17:30:26.525023] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-29T17:30:26.748091] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-09-29T17:30:27.495432] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-29T17:30:27.548113] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-09-29T17:30:28.145143] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-29T17:30:28.348123] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-09-29T17:30:28.924237] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-29T17:30:29.148115] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-09-29T17:30:29.948111] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-09-29T17:30:30.084298] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-29T17:30:30.748105] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-09-29T17:30:31.370822] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-29T17:30:31.548181] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-09-29T17:30:31.586322] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-29T17:30:32.029925] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-29T17:30:32.348163] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-09-29T17:30:33.148106] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-09-29T17:30:33.849956] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-29T17:30:33.948134] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-09-29T17:30:34.109324] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-29T17:30:34.352174] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-29T17:30:34.748125] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-09-29T17:30:35.362119] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-29T17:30:35.548160] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-09-29T17:30:36.246346] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-29T17:30:36.348165] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-09-29T17:30:36.821378] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-29T17:30:37.148114] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-09-29T17:30:37.695967] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-29T17:30:37.697189] [INFO ] [REMOTE ] BEPI: Full fetch complete (4998 records). [2025-09-29T17:30:37.697262] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-09-29T17:30:37.954209] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-09-29T17:30:38.082125] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-09-29T17:30:38.082204] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-09-29T17:30:38.082349] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-09-29T17:30:38.082389] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-09-29T17:30:38.082803] [DEBUG] [LOCAL ] BEPI: Trimmed 4998 records to 3481 (keeping 200 days of data) [2025-09-29T17:30:38.104574] [DEBUG] [LOCAL ] BEPI: Primary data saved (3481 records). [2025-09-29T17:30:38.104703] [INFO ] [MAIN ] BEPI: Full history saved. [2025-09-29T17:30:38.104797] [INFO ] [MAIN ] Update Progress: 249/2371 symbols completed. BEPI took 19.7s. Estimated remaining: 4h 20m 40s. Rate: 8.1 symbols/min [2025-09-29T17:30:38.282241] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:30:38.324045] [DEBUG] [LOCAL ] BFAM: Loaded 33519 existing records from primary storage. [2025-09-29T17:30:38.324320] [INFO ] [MAIN ] BFAM: Loaded 33519 existing records. [2025-09-29T17:30:38.509005] [WARN ] [MAIN ] BFAM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:30:38.509236] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-09-29T17:30:38.509286] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-09-29T17:30:38.509959] [DEBUG] [LOCAL ] BFAM: Deleted primary data file. [2025-09-29T17:30:38.510020] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-09-29T17:30:38.758121] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-09-29T17:30:38.894580] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:30:39.366895] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-29T17:30:39.548108] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2024-12. [2025-09-29T17:30:39.637384] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-29T17:30:40.348133] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-09-29T17:30:40.805376] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-29T17:30:41.077689] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-29T17:30:41.148123] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-09-29T17:30:41.462187] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-29T17:30:41.948115] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-09-29T17:30:42.557521] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-29T17:30:42.748123] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-09-29T17:30:43.548116] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-09-29T17:30:44.156960] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-29T17:30:44.348099] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-09-29T17:30:44.437155] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-29T17:30:44.847411] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-29T17:30:45.148133] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-09-29T17:30:45.676126] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-29T17:30:45.677297] [INFO ] [REMOTE ] BEPJ: Full fetch complete (4481 records). [2025-09-29T17:30:45.677425] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-09-29T17:30:45.956873] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-09-29T17:30:46.103796] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-09-29T17:30:46.103879] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-09-29T17:30:46.104029] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-09-29T17:30:46.104072] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-09-29T17:30:46.104488] [DEBUG] [LOCAL ] BEPJ: Trimmed 4481 records to 3138 (keeping 200 days of data) [2025-09-29T17:30:46.125373] [DEBUG] [LOCAL ] BEPJ: Primary data saved (3138 records). [2025-09-29T17:30:46.125539] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-09-29T17:30:46.125709] [INFO ] [MAIN ] Update Progress: 250/2371 symbols completed. BEPJ took 25.2s. Estimated remaining: 4h 20m 38s. Rate: 8.1 symbols/min [2025-09-29T17:30:46.311535] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:30:46.360271] [DEBUG] [LOCAL ] BFH: Loaded 42308 existing records from primary storage. [2025-09-29T17:30:46.360596] [INFO ] [MAIN ] BFH: Loaded 42308 existing records. [2025-09-29T17:30:46.549277] [WARN ] [MAIN ] BFH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:30:46.549545] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-09-29T17:30:46.549606] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-09-29T17:30:46.550087] [DEBUG] [LOCAL ] BFH: Deleted primary data file. [2025-09-29T17:30:46.550149] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-09-29T17:30:46.753412] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-09-29T17:30:46.901524] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-29T17:30:46.943431] [INFO ] [REMOTE ] BEPH: Full fetch complete (7523 records). [2025-09-29T17:30:46.950154] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-09-29T17:30:46.949997] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:30:46.951424] [FATAL] [VALIDATOR ] BEPH: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:30:46.951525] [FATAL] [MAIN ] BEPH: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:30:46.951601] [WARN ] [MAIN ] BEPH: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:30:46.951701] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-09-29T17:30:46.951777] [DEBUG] [LOCAL ] BEPH: No primary data file found to delete. [2025-09-29T17:30:46.951817] [INFO ] [LOCAL ] BEPH: Starting deletion of derivative data. [2025-09-29T17:30:46.952608] [DEBUG] [LOCAL ] BEPH: Deleted derivative data file. [2025-09-29T17:30:46.952781] [INFO ] [MAIN ] Update Progress: 251/2371 symbols completed. BEPH took 32.6s. Estimated remaining: 4h 19m 35s. Rate: 8.2 symbols/min [2025-09-29T17:30:47.144320] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:30:47.165611] [DEBUG] [LOCAL ] BFK: Loaded 14145 existing records from primary storage. [2025-09-29T17:30:47.165907] [INFO ] [MAIN ] BFK: Loaded 14145 existing records. [2025-09-29T17:30:47.370989] [WARN ] [MAIN ] BFK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:30:47.371199] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-09-29T17:30:47.371271] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-09-29T17:30:47.371620] [DEBUG] [LOCAL ] BFK: Deleted primary data file. [2025-09-29T17:30:47.371717] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-09-29T17:30:47.550020] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-09-29T17:30:47.842608] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:30:48.137440] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-29T17:30:48.348132] [INFO ] [REMOTE ] BFH: Fetching primary data for 2024-12. [2025-09-29T17:30:49.148112] [INFO ] [REMOTE ] BFK: Fetching primary data for 2024-12. [2025-09-29T17:30:49.416491] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-29T17:30:49.708109] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-29T17:30:49.948125] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-09-29T17:30:50.178943] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-29T17:30:50.748138] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-09-29T17:30:51.452188] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-29T17:30:51.548128] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-09-29T17:30:51.972864] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-29T17:30:52.055969] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-29T17:30:52.348140] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-09-29T17:30:53.148758] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-09-29T17:30:53.629035] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-29T17:30:53.948181] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-09-29T17:30:54.552953] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-29T17:30:54.748162] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-09-29T17:30:54.903145] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-29T17:30:55.548122] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-09-29T17:30:56.238997] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-29T17:30:56.348121] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-09-29T17:30:56.606021] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-29T17:30:57.148134] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-09-29T17:30:57.948136] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-09-29T17:30:58.164310] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-29T17:30:58.164782] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-29T17:30:58.183548] [INFO ] [REMOTE ] BEPC: Full fetch complete (68464 records). [2025-09-29T17:30:58.183809] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-09-29T17:30:58.638125] [DEBUG] [VALIDATOR ] BEPC: All expected trading days are present. [2025-09-29T17:30:58.638217] [DEBUG] [VALIDATOR ] BEPC: Primary data validation passed. [2025-09-29T17:30:58.639011] [INFO ] [MAIN ] BEPC: Fetched primary data is valid. [2025-09-29T17:30:58.639083] [DEBUG] [LOCAL ] BEPC: Saving primary data. [2025-09-29T17:30:58.640621] [DEBUG] [LOCAL ] BEPC: Trimmed 68464 records to 46440 (keeping 200 days of data) [2025-09-29T17:30:58.748684] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-09-29T17:30:58.944474] [DEBUG] [LOCAL ] BEPC: Primary data saved (46440 records). [2025-09-29T17:30:58.944721] [INFO ] [MAIN ] BEPC: Full history saved. [2025-09-29T17:30:58.947559] [INFO ] [MAIN ] Update Progress: 252/2371 symbols completed. BEPC took 52.2s. Estimated remaining: 4h 20m 7s. Rate: 8.1 symbols/min [2025-09-29T17:30:59.134742] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:30:59.200664] [DEBUG] [LOCAL ] BFLY: Loaded 52590 existing records from primary storage. [2025-09-29T17:30:59.201066] [INFO ] [MAIN ] BFLY: Loaded 52590 existing records. [2025-09-29T17:30:59.402941] [WARN ] [MAIN ] BFLY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:30:59.403468] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-09-29T17:30:59.403614] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-09-29T17:30:59.412010] [DEBUG] [LOCAL ] BFLY: Deleted primary data file. [2025-09-29T17:30:59.425582] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-09-29T17:30:59.427063] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-29T17:30:59.552541] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-09-29T17:30:59.835680] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:31:00.348090] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-09-29T17:31:00.426911] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-29T17:31:00.820514] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-29T17:31:01.148155] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-09-29T17:31:01.177037] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-29T17:31:01.948116] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2024-12. [2025-09-29T17:31:02.748107] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-09-29T17:31:03.023233] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-29T17:31:03.548146] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-09-29T17:31:03.849511] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-29T17:31:04.348134] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-09-29T17:31:04.385482] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-29T17:31:04.400604] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-29T17:31:05.148170] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-09-29T17:31:05.948116] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-09-29T17:31:06.065531] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-29T17:31:06.112593] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-29T17:31:06.748118] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-09-29T17:31:07.548131] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-09-29T17:31:07.597605] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-29T17:31:08.201377] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-29T17:31:08.348135] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-09-29T17:31:09.148083] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-09-29T17:31:09.443774] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-29T17:31:09.808224] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-29T17:31:09.838686] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-29T17:31:09.948116] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-09-29T17:31:10.748142] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-09-29T17:31:11.491923] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-29T17:31:11.499872] [INFO ] [REMOTE ] BFAM: Full fetch complete (46934 records). [2025-09-29T17:31:11.500059] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-09-29T17:31:11.553342] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-09-29T17:31:11.977845] [DEBUG] [VALIDATOR ] BFAM: All expected trading days are present. [2025-09-29T17:31:11.977940] [DEBUG] [VALIDATOR ] BFAM: Primary data validation passed. [2025-09-29T17:31:11.978560] [INFO ] [MAIN ] BFAM: Fetched primary data is valid. [2025-09-29T17:31:11.978614] [DEBUG] [LOCAL ] BFAM: Saving primary data. [2025-09-29T17:31:11.979875] [DEBUG] [LOCAL ] BFAM: Trimmed 46934 records to 33077 (keeping 200 days of data) [2025-09-29T17:31:12.201163] [DEBUG] [LOCAL ] BFAM: Primary data saved (33077 records). [2025-09-29T17:31:12.201340] [INFO ] [MAIN ] BFAM: Full history saved. [2025-09-29T17:31:12.201447] [INFO ] [MAIN ] Update Progress: 253/2371 symbols completed. BFAM took 34.1s. Estimated remaining: 4h 20m 49s. Rate: 8.1 symbols/min [2025-09-29T17:31:12.356711] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-09-29T17:31:12.395636] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:31:12.412735] [DEBUG] [LOCAL ] BFS: Loaded 9240 existing records from primary storage. [2025-09-29T17:31:12.413055] [INFO ] [MAIN ] BFS: Loaded 9240 existing records. [2025-09-29T17:31:12.612979] [WARN ] [MAIN ] BFS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:31:12.633278] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-09-29T17:31:12.633484] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-09-29T17:31:12.634321] [DEBUG] [LOCAL ] BFS: Deleted primary data file. [2025-09-29T17:31:12.635751] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-29T17:31:12.635959] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-09-29T17:31:13.059699] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:31:13.148164] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-09-29T17:31:13.324759] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-29T17:31:13.593475] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-29T17:31:13.948123] [INFO ] [REMOTE ] BFS: Fetching primary data for 2024-12. [2025-09-29T17:31:14.488560] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-29T17:31:14.748162] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-09-29T17:31:14.850515] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-29T17:31:15.548158] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-09-29T17:31:15.580559] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-29T17:31:15.586405] [INFO ] [REMOTE ] BFK: Full fetch complete (19339 records). [2025-09-29T17:31:15.586524] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-09-29T17:31:16.018845] [DEBUG] [VALIDATOR ] BFK: All expected trading days are present. [2025-09-29T17:31:16.018937] [DEBUG] [VALIDATOR ] BFK: Primary data validation passed. [2025-09-29T17:31:16.019373] [INFO ] [MAIN ] BFK: Fetched primary data is valid. [2025-09-29T17:31:16.019444] [DEBUG] [LOCAL ] BFK: Saving primary data. [2025-09-29T17:31:16.020377] [DEBUG] [LOCAL ] BFK: Trimmed 19339 records to 13908 (keeping 200 days of data) [2025-09-29T17:31:16.116639] [DEBUG] [LOCAL ] BFK: Primary data saved (13908 records). [2025-09-29T17:31:16.116964] [INFO ] [MAIN ] BFK: Full history saved. [2025-09-29T17:31:16.117073] [INFO ] [MAIN ] Update Progress: 254/2371 symbols completed. BFK took 29.2s. Estimated remaining: 4h 20m 12s. Rate: 8.1 symbols/min [2025-09-29T17:31:16.295870] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:31:16.311844] [DEBUG] [LOCAL ] BFZ: Loaded 12223 existing records from primary storage. [2025-09-29T17:31:16.312121] [INFO ] [MAIN ] BFZ: Loaded 12223 existing records. [2025-09-29T17:31:16.353389] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-09-29T17:31:16.510854] [WARN ] [MAIN ] BFZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:31:16.511172] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-09-29T17:31:16.511261] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-09-29T17:31:16.511601] [DEBUG] [LOCAL ] BFZ: Deleted primary data file. [2025-09-29T17:31:16.511693] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-09-29T17:31:16.934207] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:31:17.148122] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2024-12. [2025-09-29T17:31:17.270097] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-29T17:31:17.270879] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-29T17:31:17.281899] [INFO ] [REMOTE ] BFH: Full fetch complete (59704 records). [2025-09-29T17:31:17.282022] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-09-29T17:31:17.720806] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-09-29T17:31:17.720911] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-09-29T17:31:17.721680] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-09-29T17:31:17.721748] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-09-29T17:31:17.723344] [DEBUG] [LOCAL ] BFH: Trimmed 59704 records to 41647 (keeping 200 days of data) [2025-09-29T17:31:17.950144] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-09-29T17:31:17.999211] [DEBUG] [LOCAL ] BFH: Primary data saved (41647 records). [2025-09-29T17:31:17.999346] [INFO ] [MAIN ] BFH: Full history saved. [2025-09-29T17:31:17.999429] [INFO ] [MAIN ] Update Progress: 255/2371 symbols completed. BFH took 31.9s. Estimated remaining: 4h 19m 19s. Rate: 8.2 symbols/min [2025-09-29T17:31:18.190375] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:31:18.251181] [DEBUG] [LOCAL ] BG: Loaded 51118 existing records from primary storage. [2025-09-29T17:31:18.251531] [INFO ] [MAIN ] BG: Loaded 51118 existing records. [2025-09-29T17:31:18.467814] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-29T17:31:18.473779] [WARN ] [MAIN ] BG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:31:18.478737] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-09-29T17:31:18.478798] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-09-29T17:31:18.479744] [DEBUG] [LOCAL ] BG: Deleted primary data file. [2025-09-29T17:31:18.479806] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-09-29T17:31:18.753225] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-09-29T17:31:18.879413] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:31:19.548128] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-09-29T17:31:19.785771] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-29T17:31:19.797890] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-29T17:31:20.195080] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-29T17:31:20.348111] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-09-29T17:31:21.148102] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-09-29T17:31:21.283756] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-29T17:31:21.948094] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-09-29T17:31:22.749000] [INFO ] [REMOTE ] BG: Fetching primary data for 2024-12. [2025-09-29T17:31:22.753444] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-29T17:31:22.986435] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-29T17:31:23.548123] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-09-29T17:31:24.348114] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-09-29T17:31:24.458981] [DEBUG] [REMOTE ] BFZ: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-09-29T17:31:24.459298] [WARN ] [REMOTE ] BFZ: No data returned for month 2025-03 [2025-09-29T17:31:24.459429] [FATAL] [REMOTE ] BFZ: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T17:31:24.459594] [FATAL] [MAIN ] BFZ: Failed to fetch primary data. [2025-09-29T17:31:24.459707] [WARN ] [MAIN ] BFZ: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T17:31:24.459797] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-09-29T17:31:24.459883] [DEBUG] [LOCAL ] BFZ: No primary data file found to delete. [2025-09-29T17:31:24.459940] [INFO ] [LOCAL ] BFZ: Starting deletion of derivative data. [2025-09-29T17:31:24.460484] [DEBUG] [LOCAL ] BFZ: Deleted derivative data file. [2025-09-29T17:31:24.460594] [INFO ] [MAIN ] Update Progress: 256/2371 symbols completed. BFZ took 8.3s. Estimated remaining: 4h 19m 5s. Rate: 8.2 symbols/min [2025-09-29T17:31:24.659488] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:31:24.691900] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-29T17:31:24.730275] [DEBUG] [LOCAL ] BGB: Loaded 17621 existing records from primary storage. [2025-09-29T17:31:24.730628] [INFO ] [MAIN ] BGB: Loaded 17621 existing records. [2025-09-29T17:31:24.946081] [WARN ] [MAIN ] BGB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:31:24.946320] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-09-29T17:31:24.946370] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-09-29T17:31:24.946829] [DEBUG] [LOCAL ] BGB: Deleted primary data file. [2025-09-29T17:31:24.946988] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-09-29T17:31:25.152762] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-09-29T17:31:25.341848] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:31:25.375391] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-29T17:31:25.948115] [INFO ] [REMOTE ] BGB: Fetching primary data for 2024-12. [2025-09-29T17:31:26.748120] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-09-29T17:31:26.915262] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-29T17:31:27.070824] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-29T17:31:27.548098] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-09-29T17:31:28.348127] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-09-29T17:31:28.510433] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-29T17:31:28.511421] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-29T17:31:29.148115] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-09-29T17:31:29.274193] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-29T17:31:29.948124] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-09-29T17:31:30.227428] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-29T17:31:30.748214] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-09-29T17:31:31.548158] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-09-29T17:31:32.005307] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-29T17:31:32.336773] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-29T17:31:32.348052] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-09-29T17:31:32.590744] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-29T17:31:33.148112] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-09-29T17:31:33.171572] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-29T17:31:33.948161] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-09-29T17:31:34.748098] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-09-29T17:31:34.825041] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-29T17:31:35.190367] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-29T17:31:35.205098] [INFO ] [REMOTE ] BFLY: Full fetch complete (75269 records). [2025-09-29T17:31:35.205303] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-09-29T17:31:35.554852] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-09-29T17:31:35.621268] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present. [2025-09-29T17:31:35.621371] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed. [2025-09-29T17:31:35.622292] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-09-29T17:31:35.622380] [DEBUG] [LOCAL ] BFLY: Saving primary data. [2025-09-29T17:31:35.624146] [DEBUG] [LOCAL ] BFLY: Trimmed 75269 records to 51799 (keeping 200 days of data) [2025-09-29T17:31:35.965996] [DEBUG] [LOCAL ] BFLY: Primary data saved (51799 records). [2025-09-29T17:31:35.966242] [INFO ] [MAIN ] BFLY: Full history saved. [2025-09-29T17:31:35.966453] [INFO ] [MAIN ] Update Progress: 257/2371 symbols completed. BFLY took 37.0s. Estimated remaining: 4h 19m 32s. Rate: 8.1 symbols/min [2025-09-29T17:31:36.186735] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:31:36.209635] [DEBUG] [LOCAL ] BGH: Loaded 16728 existing records from primary storage. [2025-09-29T17:31:36.209941] [INFO ] [MAIN ] BGH: Loaded 16728 existing records. [2025-09-29T17:31:36.369603] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-09-29T17:31:36.429986] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-29T17:31:36.448614] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-29T17:31:36.476638] [WARN ] [MAIN ] BGH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:31:36.477901] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-09-29T17:31:36.478000] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-09-29T17:31:36.478354] [DEBUG] [LOCAL ] BGH: Deleted primary data file. [2025-09-29T17:31:36.478786] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-09-29T17:31:36.886660] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:31:37.148284] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-09-29T17:31:37.548787] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-29T17:31:37.948122] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-09-29T17:31:38.748096] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-09-29T17:31:38.998129] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-29T17:31:39.176079] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-29T17:31:39.548140] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-09-29T17:31:39.775666] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-29T17:31:39.778581] [INFO ] [REMOTE ] BFS: Full fetch complete (12592 records). [2025-09-29T17:31:39.778769] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-09-29T17:31:39.779274] [FATAL] [VALIDATOR ] BFS: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:31:39.779362] [FATAL] [MAIN ] BFS: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:31:39.779407] [WARN ] [MAIN ] BFS: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:31:39.779473] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-09-29T17:31:39.779545] [DEBUG] [LOCAL ] BFS: No primary data file found to delete. [2025-09-29T17:31:39.779627] [INFO ] [LOCAL ] BFS: Starting deletion of derivative data. [2025-09-29T17:31:39.780790] [DEBUG] [LOCAL ] BFS: Deleted derivative data file. [2025-09-29T17:31:39.781114] [INFO ] [MAIN ] Update Progress: 258/2371 symbols completed. BFS took 27.6s. Estimated remaining: 4h 18m 55s. Rate: 8.2 symbols/min [2025-09-29T17:31:39.961880] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:31:39.981549] [DEBUG] [LOCAL ] BGR: Loaded 13658 existing records from primary storage. [2025-09-29T17:31:39.981812] [INFO ] [MAIN ] BGR: Loaded 13658 existing records. [2025-09-29T17:31:40.171710] [WARN ] [MAIN ] BGR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:31:40.171978] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-09-29T17:31:40.172037] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-09-29T17:31:40.172547] [DEBUG] [LOCAL ] BGR: Deleted primary data file. [2025-09-29T17:31:40.172610] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-09-29T17:31:40.362898] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-09-29T17:31:40.559137] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:31:40.652589] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-29T17:31:41.148134] [INFO ] [REMOTE ] BGH: Fetching primary data for 2024-12. [2025-09-29T17:31:41.948106] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-09-29T17:31:42.116032] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-29T17:31:42.206849] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-29T17:31:42.748180] [INFO ] [REMOTE ] BGR: Fetching primary data for 2024-12. [2025-09-29T17:31:42.838463] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-29T17:31:43.548101] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-09-29T17:31:43.826336] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-29T17:31:44.348140] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-09-29T17:31:44.594570] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-29T17:31:45.148159] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-09-29T17:31:45.283715] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-29T17:31:45.873424] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-29T17:31:45.948129] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-09-29T17:31:46.748113] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-09-29T17:31:46.801229] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-29T17:31:47.485273] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-29T17:31:47.548127] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-09-29T17:31:48.348104] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-09-29T17:31:48.567573] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-29T17:31:48.573951] [INFO ] [REMOTE ] BGB: Full fetch complete (26906 records). [2025-09-29T17:31:48.574096] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-09-29T17:31:48.988631] [DEBUG] [VALIDATOR ] BGB: All expected trading days are present. [2025-09-29T17:31:48.988744] [DEBUG] [VALIDATOR ] BGB: Primary data validation passed. [2025-09-29T17:31:48.989144] [INFO ] [MAIN ] BGB: Fetched primary data is valid. [2025-09-29T17:31:48.989207] [DEBUG] [LOCAL ] BGB: Saving primary data. [2025-09-29T17:31:48.989938] [DEBUG] [LOCAL ] BGB: Trimmed 26906 records to 17484 (keeping 200 days of data) [2025-09-29T17:31:49.104607] [DEBUG] [LOCAL ] BGB: Primary data saved (17484 records). [2025-09-29T17:31:49.104869] [INFO ] [MAIN ] BGB: Full history saved. [2025-09-29T17:31:49.104999] [INFO ] [MAIN ] Update Progress: 259/2371 symbols completed. BGB took 24.6s. Estimated remaining: 4h 19m 4s. Rate: 8.2 symbols/min [2025-09-29T17:31:49.149667] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-09-29T17:31:49.290154] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:31:49.318469] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-29T17:31:49.364213] [DEBUG] [LOCAL ] BGS: Loaded 51183 existing records from primary storage. [2025-09-29T17:31:49.364571] [INFO ] [MAIN ] BGS: Loaded 51183 existing records. [2025-09-29T17:31:49.564485] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:31:49.564754] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-09-29T17:31:49.564811] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-09-29T17:31:49.565381] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-09-29T17:31:49.565447] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-09-29T17:31:49.954023] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-09-29T17:31:49.991898] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:31:50.748136] [INFO ] [REMOTE ] BGS: Fetching primary data for 2024-12. [2025-09-29T17:31:50.848147] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-29T17:31:50.878370] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-29T17:31:51.548171] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-09-29T17:31:52.348126] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-09-29T17:31:52.457478] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-29T17:31:52.533863] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-29T17:31:52.907446] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-29T17:31:53.148140] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-09-29T17:31:53.948142] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-09-29T17:31:54.748161] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-09-29T17:31:54.950855] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-29T17:31:55.534209] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-09-29T17:31:55.548091] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-09-29T17:31:56.348098] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-09-29T17:31:56.434872] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-29T17:31:57.148086] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-09-29T17:31:57.266813] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-29T17:31:57.357946] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-29T17:31:57.948099] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-09-29T17:31:58.748112] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-09-29T17:31:58.801196] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-29T17:31:58.837066] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-29T17:31:59.548134] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-09-29T17:32:00.348099] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-09-29T17:32:00.703132] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-29T17:32:00.715857] [INFO ] [REMOTE ] BG: Full fetch complete (72769 records). [2025-09-29T17:32:00.716107] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-09-29T17:32:01.156186] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-09-29T17:32:01.183061] [DEBUG] [VALIDATOR ] BG: All expected trading days are present. [2025-09-29T17:32:01.183309] [DEBUG] [VALIDATOR ] BG: Primary data validation passed. [2025-09-29T17:32:01.184289] [INFO ] [MAIN ] BG: Fetched primary data is valid. [2025-09-29T17:32:01.184536] [DEBUG] [LOCAL ] BG: Saving primary data. [2025-09-29T17:32:01.218390] [DEBUG] [LOCAL ] BG: Trimmed 72769 records to 50382 (keeping 200 days of data) [2025-09-29T17:32:01.220707] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-29T17:32:01.384776] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-29T17:32:01.595346] [DEBUG] [LOCAL ] BG: Primary data saved (50382 records). [2025-09-29T17:32:01.595498] [INFO ] [MAIN ] BG: Full history saved. [2025-09-29T17:32:01.595583] [INFO ] [MAIN ] Update Progress: 260/2371 symbols completed. BG took 43.6s. Estimated remaining: 4h 19m 38s. Rate: 8.1 symbols/min [2025-09-29T17:32:01.807074] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:32:01.817514] [DEBUG] [LOCAL ] BGSF: Loaded 7050 existing records from primary storage. [2025-09-29T17:32:01.817800] [INFO ] [MAIN ] BGSF: Loaded 7050 existing records. [2025-09-29T17:32:01.951170] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-09-29T17:32:02.029792] [WARN ] [MAIN ] BGSF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:32:02.030186] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-09-29T17:32:02.030303] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-09-29T17:32:02.030529] [DEBUG] [LOCAL ] BGSF: Deleted primary data file. [2025-09-29T17:32:02.030589] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-09-29T17:32:02.253418] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-29T17:32:02.457531] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:32:02.748150] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-09-29T17:32:03.548129] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2024-12. [2025-09-29T17:32:03.662417] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-29T17:32:04.003358] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-29T17:32:04.240940] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-29T17:32:04.348159] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-09-29T17:32:05.148156] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-09-29T17:32:05.405309] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-29T17:32:05.948147] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-09-29T17:32:06.275088] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-29T17:32:06.278858] [INFO ] [REMOTE ] BGR: Full fetch complete (20239 records). [2025-09-29T17:32:06.279038] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-09-29T17:32:06.700049] [DEBUG] [VALIDATOR ] BGR: All expected trading days are present. [2025-09-29T17:32:06.700136] [DEBUG] [VALIDATOR ] BGR: Primary data validation passed. [2025-09-29T17:32:06.700557] [INFO ] [MAIN ] BGR: Fetched primary data is valid. [2025-09-29T17:32:06.700624] [DEBUG] [LOCAL ] BGR: Saving primary data. [2025-09-29T17:32:06.701425] [DEBUG] [LOCAL ] BGR: Trimmed 20239 records to 13477 (keeping 200 days of data) [2025-09-29T17:32:06.764366] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-09-29T17:32:06.793096] [DEBUG] [LOCAL ] BGR: Primary data saved (13477 records). [2025-09-29T17:32:06.793239] [INFO ] [MAIN ] BGR: Full history saved. [2025-09-29T17:32:06.793324] [INFO ] [MAIN ] Update Progress: 261/2371 symbols completed. BGR took 27.0s. Estimated remaining: 4h 19m 13s. Rate: 8.1 symbols/min [2025-09-29T17:32:06.975979] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:32:06.990203] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-29T17:32:07.011175] [DEBUG] [LOCAL ] BGT: Loaded 16793 existing records from primary storage. [2025-09-29T17:32:07.011477] [INFO ] [MAIN ] BGT: Loaded 16793 existing records. [2025-09-29T17:32:07.203018] [WARN ] [MAIN ] BGT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:32:07.203249] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-09-29T17:32:07.203304] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-09-29T17:32:07.203771] [DEBUG] [LOCAL ] BGT: Deleted primary data file. [2025-09-29T17:32:07.203833] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-09-29T17:32:07.553358] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-09-29T17:32:07.617052] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:32:08.125047] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-29T17:32:08.348135] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-09-29T17:32:08.575172] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-29T17:32:08.768541] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-29T17:32:09.148132] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-09-29T17:32:09.749477] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-29T17:32:09.948126] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-09-29T17:32:10.748129] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-09-29T17:32:10.980580] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-29T17:32:11.248036] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-29T17:32:11.548176] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-09-29T17:32:11.945060] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-29T17:32:12.348104] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-09-29T17:32:13.148121] [INFO ] [REMOTE ] BGT: Fetching primary data for 2024-12. [2025-09-29T17:32:13.174832] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-29T17:32:13.948097] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-09-29T17:32:14.274011] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-29T17:32:14.748115] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-09-29T17:32:15.046459] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-29T17:32:15.050576] [INFO ] [REMOTE ] BGH: Full fetch complete (22086 records). [2025-09-29T17:32:15.050698] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-09-29T17:32:15.473443] [DEBUG] [VALIDATOR ] BGH: All expected trading days are present. [2025-09-29T17:32:15.473557] [DEBUG] [VALIDATOR ] BGH: Primary data validation passed. [2025-09-29T17:32:15.474057] [INFO ] [MAIN ] BGH: Fetched primary data is valid. [2025-09-29T17:32:15.474140] [DEBUG] [LOCAL ] BGH: Saving primary data. [2025-09-29T17:32:15.475195] [DEBUG] [LOCAL ] BGH: Trimmed 22086 records to 16600 (keeping 200 days of data) [2025-09-29T17:32:15.549977] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-09-29T17:32:15.585497] [DEBUG] [LOCAL ] BGH: Primary data saved (16600 records). [2025-09-29T17:32:15.585673] [INFO ] [MAIN ] BGH: Full history saved. [2025-09-29T17:32:15.585780] [INFO ] [MAIN ] Update Progress: 262/2371 symbols completed. BGH took 39.6s. Estimated remaining: 4h 19m 17s. Rate: 8.1 symbols/min [2025-09-29T17:32:15.783697] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:32:15.798216] [DEBUG] [LOCAL ] BGX: Loaded 10900 existing records from primary storage. [2025-09-29T17:32:15.798505] [INFO ] [MAIN ] BGX: Loaded 10900 existing records. [2025-09-29T17:32:15.951810] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-29T17:32:16.030476] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:32:16.030763] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-09-29T17:32:16.030819] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-09-29T17:32:16.031178] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-09-29T17:32:16.031239] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-09-29T17:32:16.353273] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-09-29T17:32:16.431798] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:32:17.148131] [INFO ] [REMOTE ] BGX: Fetching primary data for 2024-12. [2025-09-29T17:32:17.410852] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-29T17:32:17.413573] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-29T17:32:17.737917] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-29T17:32:17.948111] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-09-29T17:32:18.600516] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-29T17:32:18.748120] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-09-29T17:32:19.548118] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-09-29T17:32:20.348088] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-09-29T17:32:20.499908] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-29T17:32:20.697576] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-29T17:32:21.118250] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-29T17:32:21.148112] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-09-29T17:32:21.620001] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-29T17:32:21.948125] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-09-29T17:32:22.748109] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-09-29T17:32:23.020437] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-29T17:32:23.548110] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-09-29T17:32:24.348074] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-09-29T17:32:24.362970] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-29T17:32:24.492991] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-29T17:32:25.148168] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-09-29T17:32:25.713938] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-29T17:32:25.717866] [INFO ] [REMOTE ] BGSF: Full fetch complete (8312 records). [2025-09-29T17:32:25.717958] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-09-29T17:32:25.718377] [FATAL] [VALIDATOR ] BGSF: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:32:25.718465] [FATAL] [MAIN ] BGSF: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:32:25.718511] [WARN ] [MAIN ] BGSF: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:32:25.718582] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-09-29T17:32:25.718672] [DEBUG] [LOCAL ] BGSF: No primary data file found to delete. [2025-09-29T17:32:25.718733] [INFO ] [LOCAL ] BGSF: Starting deletion of derivative data. [2025-09-29T17:32:25.719504] [DEBUG] [LOCAL ] BGSF: Deleted derivative data file. [2025-09-29T17:32:25.719601] [INFO ] [MAIN ] Update Progress: 263/2371 symbols completed. BGSF took 24.1s. Estimated remaining: 4h 19m 32s. Rate: 8.1 symbols/min [2025-09-29T17:32:25.908608] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:32:25.937073] [DEBUG] [LOCAL ] BGY: Loaded 22790 existing records from primary storage. [2025-09-29T17:32:25.937408] [INFO ] [MAIN ] BGY: Loaded 22790 existing records. [2025-09-29T17:32:25.953199] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-09-29T17:32:26.098922] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-29T17:32:26.144312] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:32:26.144548] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-09-29T17:32:26.144597] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-09-29T17:32:26.145021] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-09-29T17:32:26.145084] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-09-29T17:32:26.535377] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:32:26.748150] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-09-29T17:32:27.149677] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-29T17:32:27.329521] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-29T17:32:27.548131] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-09-29T17:32:28.348152] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-09-29T17:32:28.480445] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-29T17:32:29.148122] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-09-29T17:32:29.312201] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-29T17:32:29.948129] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-09-29T17:32:30.097428] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-29T17:32:30.562827] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-29T17:32:30.748117] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-09-29T17:32:31.548164] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-09-29T17:32:31.911773] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-29T17:32:32.349182] [INFO ] [REMOTE ] BGY: Fetching primary data for 2024-12. [2025-09-29T17:32:32.354431] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-29T17:32:33.148113] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-09-29T17:32:33.224876] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-29T17:32:33.948180] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-09-29T17:32:34.748126] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-09-29T17:32:35.070484] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-29T17:32:35.205501] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-29T17:32:35.216448] [INFO ] [REMOTE ] BGS: Full fetch complete (72482 records). [2025-09-29T17:32:35.216607] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-09-29T17:32:35.553253] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-09-29T17:32:35.637630] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-09-29T17:32:35.637753] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-09-29T17:32:35.638572] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-09-29T17:32:35.638616] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-09-29T17:32:35.640303] [DEBUG] [LOCAL ] BGS: Trimmed 72482 records to 50439 (keeping 200 days of data) [2025-09-29T17:32:35.856591] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-29T17:32:35.862226] [INFO ] [REMOTE ] BGX: Full fetch complete (15942 records). [2025-09-29T17:32:35.862317] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-09-29T17:32:36.286117] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-09-29T17:32:36.286529] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-09-29T17:32:36.288172] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-09-29T17:32:36.289515] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-09-29T17:32:36.292072] [DEBUG] [LOCAL ] BGX: Trimmed 15942 records to 10834 (keeping 200 days of data) [2025-09-29T17:32:36.348121] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-09-29T17:32:36.431845] [DEBUG] [LOCAL ] BGS: Primary data saved (50439 records). [2025-09-29T17:32:36.433918] [INFO ] [MAIN ] BGS: Full history saved. [2025-09-29T17:32:36.435320] [INFO ] [MAIN ] Update Progress: 264/2371 symbols completed. BGS took 47.3s. Estimated remaining: 4h 19m 51s. Rate: 8.1 symbols/min [2025-09-29T17:32:36.524801] [DEBUG] [LOCAL ] BGX: Primary data saved (10834 records). [2025-09-29T17:32:36.550856] [INFO ] [MAIN ] BGX: Full history saved. [2025-09-29T17:32:36.554754] [INFO ] [MAIN ] Update Progress: 265/2371 symbols completed. BGX took 21.0s. Estimated remaining: 4h 18m 46s. Rate: 8.1 symbols/min [2025-09-29T17:32:36.700217] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:32:36.822049] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-29T17:32:36.855468] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:32:36.868508] [DEBUG] [LOCAL ] BH: Loaded 15938 existing records from primary storage. [2025-09-29T17:32:36.868846] [INFO ] [MAIN ] BH: Loaded 15938 existing records. [2025-09-29T17:32:37.079348] [WARN ] [MAIN ] BH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:32:37.080419] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-09-29T17:32:37.080791] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-09-29T17:32:37.081286] [DEBUG] [LOCAL ] BH: Deleted primary data file. [2025-09-29T17:32:37.081349] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-09-29T17:32:37.157026] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-09-29T17:32:37.229205] [DEBUG] [LOCAL ] BHC: Loaded 47495 existing records from primary storage. [2025-09-29T17:32:37.243942] [INFO ] [MAIN ] BHC: Loaded 47495 existing records. [2025-09-29T17:32:37.232848] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-29T17:32:37.653308] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:32:37.685139] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-09-29T17:32:37.686526] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-09-29T17:32:37.711379] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-09-29T17:32:37.722230] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-09-29T17:32:37.726122] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:32:37.953227] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-09-29T17:32:38.103477] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:32:38.408366] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-29T17:32:38.748167] [INFO ] [REMOTE ] BH: Fetching primary data for 2024-12. [2025-09-29T17:32:39.166266] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-29T17:32:39.169997] [INFO ] [REMOTE ] BGT: Full fetch complete (24316 records). [2025-09-29T17:32:39.170107] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-09-29T17:32:39.550033] [INFO ] [REMOTE ] BHC: Fetching primary data for 2024-12. [2025-09-29T17:32:39.594477] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-09-29T17:32:39.594584] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-09-29T17:32:39.595044] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-09-29T17:32:39.595113] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-09-29T17:32:39.595889] [DEBUG] [LOCAL ] BGT: Trimmed 24316 records to 16594 (keeping 200 days of data) [2025-09-29T17:32:39.705229] [DEBUG] [LOCAL ] BGT: Primary data saved (16594 records). [2025-09-29T17:32:39.705459] [INFO ] [MAIN ] BGT: Full history saved. [2025-09-29T17:32:39.705594] [INFO ] [MAIN ] Update Progress: 266/2371 symbols completed. BGT took 32.9s. Estimated remaining: 4h 18m 5s. Rate: 8.2 symbols/min [2025-09-29T17:32:39.824121] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-29T17:32:39.906790] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:32:39.939578] [DEBUG] [LOCAL ] BHE: Loaded 25353 existing records from primary storage. [2025-09-29T17:32:39.939901] [INFO ] [MAIN ] BHE: Loaded 25353 existing records. [2025-09-29T17:32:40.140132] [WARN ] [MAIN ] BHE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:32:40.140384] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-09-29T17:32:40.141257] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-09-29T17:32:40.141817] [DEBUG] [LOCAL ] BHE: Deleted primary data file. [2025-09-29T17:32:40.141880] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-09-29T17:32:40.353238] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-09-29T17:32:40.517956] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:32:41.148108] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-09-29T17:32:41.222267] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-29T17:32:41.524944] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-29T17:32:41.917906] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-29T17:32:41.948095] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-09-29T17:32:42.533608] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-29T17:32:42.748136] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-09-29T17:32:43.548098] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-09-29T17:32:43.570262] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-29T17:32:44.348156] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-09-29T17:32:45.103799] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-29T17:32:45.151721] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-09-29T17:32:45.152791] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-29T17:32:45.948130] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-09-29T17:32:46.356272] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-29T17:32:46.748170] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-09-29T17:32:46.875101] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-29T17:32:47.548156] [INFO ] [REMOTE ] BHE: Fetching primary data for 2024-12. [2025-09-29T17:32:47.845992] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-29T17:32:48.348154] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-09-29T17:32:48.773743] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-29T17:32:49.148134] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-09-29T17:32:49.363613] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-29T17:32:49.948105] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-09-29T17:32:50.106424] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-29T17:32:50.748114] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-09-29T17:32:51.033978] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-29T17:32:51.548141] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-09-29T17:32:51.600845] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-29T17:32:52.348116] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-09-29T17:32:52.639378] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-29T17:32:53.148109] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-09-29T17:32:53.422050] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-29T17:32:53.948142] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-09-29T17:32:54.418705] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-29T17:32:54.748074] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-09-29T17:32:55.045881] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-29T17:32:55.049803] [INFO ] [REMOTE ] BGY: Full fetch complete (33379 records). [2025-09-29T17:32:55.049901] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-09-29T17:32:55.446375] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-09-29T17:32:55.446461] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-09-29T17:32:55.446921] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-09-29T17:32:55.446985] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-09-29T17:32:55.447842] [DEBUG] [LOCAL ] BGY: Trimmed 33379 records to 22400 (keeping 200 days of data) [2025-09-29T17:32:55.548374] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-09-29T17:32:55.587432] [DEBUG] [LOCAL ] BGY: Primary data saved (22400 records). [2025-09-29T17:32:55.587574] [INFO ] [MAIN ] BGY: Full history saved. [2025-09-29T17:32:55.587685] [INFO ] [MAIN ] Update Progress: 267/2371 symbols completed. BGY took 29.9s. Estimated remaining: 4h 19m 5s. Rate: 8.1 symbols/min [2025-09-29T17:32:55.796549] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:32:55.828379] [DEBUG] [LOCAL ] BHK: Loaded 22922 existing records from primary storage. [2025-09-29T17:32:55.828699] [INFO ] [MAIN ] BHK: Loaded 22922 existing records. [2025-09-29T17:32:56.028690] [WARN ] [MAIN ] BHK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:32:56.028980] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-09-29T17:32:56.029050] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-09-29T17:32:56.029581] [DEBUG] [LOCAL ] BHK: Deleted primary data file. [2025-09-29T17:32:56.029678] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-09-29T17:32:56.316939] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-29T17:32:56.360520] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-09-29T17:32:56.447478] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:32:57.148170] [INFO ] [REMOTE ] BHK: Fetching primary data for 2024-12. [2025-09-29T17:32:57.412235] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-29T17:32:57.531812] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-29T17:32:57.537564] [INFO ] [REMOTE ] BH: Full fetch complete (19398 records). [2025-09-29T17:32:57.537887] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-09-29T17:32:57.538553] [FATAL] [VALIDATOR ] BH: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:32:57.540044] [FATAL] [MAIN ] BH: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:32:57.540273] [WARN ] [MAIN ] BH: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:32:57.540374] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-09-29T17:32:57.540518] [DEBUG] [LOCAL ] BH: No primary data file found to delete. [2025-09-29T17:32:57.540589] [INFO ] [LOCAL ] BH: Starting deletion of derivative data. [2025-09-29T17:32:57.541634] [DEBUG] [LOCAL ] BH: Deleted derivative data file. [2025-09-29T17:32:57.541866] [INFO ] [MAIN ] Update Progress: 268/2371 symbols completed. BH took 21.1s. Estimated remaining: 4h 18m 15s. Rate: 8.1 symbols/min [2025-09-29T17:32:57.806020] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:32:57.880318] [DEBUG] [LOCAL ] BHP: Loaded 54153 existing records from primary storage. [2025-09-29T17:32:57.880733] [INFO ] [MAIN ] BHP: Loaded 54153 existing records. [2025-09-29T17:32:57.950763] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-09-29T17:32:58.083806] [WARN ] [MAIN ] BHP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:32:58.084273] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-09-29T17:32:58.084324] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-09-29T17:32:58.085502] [DEBUG] [LOCAL ] BHP: Deleted primary data file. [2025-09-29T17:32:58.085598] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-09-29T17:32:58.378987] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-29T17:32:58.491297] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:32:58.748162] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-09-29T17:32:59.392189] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-29T17:32:59.548158] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-09-29T17:33:00.135907] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-29T17:33:00.348114] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-09-29T17:33:00.672396] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-29T17:33:01.148117] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-09-29T17:33:01.948093] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-09-29T17:33:02.211884] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-29T17:33:02.248276] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-29T17:33:02.748121] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-09-29T17:33:03.011070] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-29T17:33:03.548145] [INFO ] [REMOTE ] BHP: Fetching primary data for 2024-12. [2025-09-29T17:33:03.666774] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-29T17:33:04.348148] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-09-29T17:33:05.158687] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-09-29T17:33:05.164552] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-29T17:33:05.884799] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-29T17:33:05.948176] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-09-29T17:33:06.139625] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-29T17:33:06.748089] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-09-29T17:33:07.113000] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-29T17:33:07.548135] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-09-29T17:33:08.348096] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-09-29T17:33:08.598585] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-29T17:33:08.670199] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-29T17:33:09.148119] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-09-29T17:33:09.683028] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-29T17:33:09.948166] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-09-29T17:33:10.748111] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-09-29T17:33:10.817996] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-29T17:33:11.183367] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-29T17:33:11.188416] [INFO ] [REMOTE ] BHE: Full fetch complete (36383 records). [2025-09-29T17:33:11.188524] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-09-29T17:33:11.190099] [FATAL] [VALIDATOR ] BHE: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:33:11.190203] [FATAL] [MAIN ] BHE: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:33:11.190282] [WARN ] [MAIN ] BHE: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:33:11.190384] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-09-29T17:33:11.190466] [DEBUG] [LOCAL ] BHE: No primary data file found to delete. [2025-09-29T17:33:11.190507] [INFO ] [LOCAL ] BHE: Starting deletion of derivative data. [2025-09-29T17:33:11.191214] [DEBUG] [LOCAL ] BHE: Deleted derivative data file. [2025-09-29T17:33:11.191324] [INFO ] [MAIN ] Update Progress: 269/2371 symbols completed. BHE took 31.5s. Estimated remaining: 4h 18m 57s. Rate: 8.1 symbols/min [2025-09-29T17:33:11.374346] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:33:11.397777] [DEBUG] [LOCAL ] BHR: Loaded 21771 existing records from primary storage. [2025-09-29T17:33:11.398065] [INFO ] [MAIN ] BHR: Loaded 21771 existing records. [2025-09-29T17:33:11.553188] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-09-29T17:33:11.593534] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:33:11.594425] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-09-29T17:33:11.594519] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-09-29T17:33:11.595108] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-09-29T17:33:11.595171] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-09-29T17:33:11.971932] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-29T17:33:12.096196] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:33:12.348095] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-09-29T17:33:13.148132] [INFO ] [REMOTE ] BHR: Fetching primary data for 2024-12. [2025-09-29T17:33:13.385541] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-29T17:33:13.438767] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-29T17:33:13.948076] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-09-29T17:33:14.150671] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-29T17:33:14.748117] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-09-29T17:33:15.548130] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-09-29T17:33:15.664191] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-29T17:33:15.673898] [INFO ] [REMOTE ] BHC: Full fetch complete (66607 records). [2025-09-29T17:33:15.674082] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-09-29T17:33:15.675042] [FATAL] [VALIDATOR ] BHC: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:33:15.675161] [FATAL] [MAIN ] BHC: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:33:15.675206] [WARN ] [MAIN ] BHC: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:33:15.675275] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-09-29T17:33:15.675344] [DEBUG] [LOCAL ] BHC: No primary data file found to delete. [2025-09-29T17:33:15.675425] [INFO ] [LOCAL ] BHC: Starting deletion of derivative data. [2025-09-29T17:33:15.676588] [DEBUG] [LOCAL ] BHC: Deleted derivative data file. [2025-09-29T17:33:15.676737] [INFO ] [MAIN ] Update Progress: 270/2371 symbols completed. BHC took 39.1s. Estimated remaining: 4h 18m 27s. Rate: 8.1 symbols/min [2025-09-29T17:33:15.869303] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:33:15.869502] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-09-29T17:33:15.869542] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-09-29T17:33:15.869693] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-09-29T17:33:15.869748] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-29T17:33:15.869792] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-09-29T17:33:15.869825] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-09-29T17:33:16.263110] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:33:16.348129] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-09-29T17:33:16.832556] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-29T17:33:16.885279] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-29T17:33:17.148122] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-09-29T17:33:17.424467] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-29T17:33:17.948097] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-09-29T17:33:18.336867] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-29T17:33:18.748086] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-09-29T17:33:18.903628] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-29T17:33:19.548086] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-09-29T17:33:19.853473] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-29T17:33:19.859772] [INFO ] [REMOTE ] BHK: Full fetch complete (29915 records). [2025-09-29T17:33:19.859882] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-09-29T17:33:20.248169] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present. [2025-09-29T17:33:20.248263] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed. [2025-09-29T17:33:20.248733] [INFO ] [MAIN ] BHK: Fetched primary data is valid. [2025-09-29T17:33:20.248801] [DEBUG] [LOCAL ] BHK: Saving primary data. [2025-09-29T17:33:20.249610] [DEBUG] [LOCAL ] BHK: Trimmed 29915 records to 22906 (keeping 200 days of data) [2025-09-29T17:33:20.348701] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-09-29T17:33:20.398504] [DEBUG] [LOCAL ] BHK: Primary data saved (22906 records). [2025-09-29T17:33:20.398675] [INFO ] [MAIN ] BHK: Full history saved. [2025-09-29T17:33:20.398785] [INFO ] [MAIN ] Update Progress: 271/2371 symbols completed. BHK took 24.8s. Estimated remaining: 4h 17m 59s. Rate: 8.1 symbols/min [2025-09-29T17:33:20.594426] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:33:20.659862] [DEBUG] [LOCAL ] BHVN: Loaded 50401 existing records from primary storage. [2025-09-29T17:33:20.660313] [INFO ] [MAIN ] BHVN: Loaded 50401 existing records. [2025-09-29T17:33:20.854023] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:33:20.854320] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-09-29T17:33:20.854396] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-09-29T17:33:20.855100] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-09-29T17:33:20.855172] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-09-29T17:33:21.154304] [INFO ] [REMOTE ] BHV: Fetching primary data for 2024-12. [2025-09-29T17:33:21.241018] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:33:21.494812] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-29T17:33:21.531062] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-29T17:33:21.647478] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-29T17:33:21.948118] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-09-29T17:33:22.303333] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-29T17:33:22.748114] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-09-29T17:33:23.190011] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-29T17:33:23.548150] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2024-12. [2025-09-29T17:33:24.348146] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-09-29T17:33:24.694320] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-29T17:33:25.148152] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-09-29T17:33:25.382440] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-29T17:33:25.948151] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-09-29T17:33:26.748149] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-09-29T17:33:27.220277] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-29T17:33:27.222001] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-29T17:33:27.523196] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-29T17:33:27.548094] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-09-29T17:33:28.348122] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-09-29T17:33:28.704105] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-29T17:33:29.062903] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-29T17:33:29.148205] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-09-29T17:33:29.948153] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-09-29T17:33:30.304459] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-29T17:33:30.734888] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-29T17:33:30.748056] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-09-29T17:33:31.548124] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-09-29T17:33:32.062982] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-29T17:33:32.348105] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-09-29T17:33:32.538459] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-29T17:33:32.732379] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-29T17:33:33.148108] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-09-29T17:33:33.741234] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-29T17:33:33.742208] [INFO ] [REMOTE ] BHV: Full fetch complete (1363 records). [2025-09-29T17:33:33.742297] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-09-29T17:33:33.742722] [FATAL] [VALIDATOR ] BHV: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:33:33.742952] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:33:33.743026] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:33:33.743099] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-29T17:33:33.743165] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-09-29T17:33:33.743205] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-09-29T17:33:33.743245] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-09-29T17:33:33.743319] [INFO ] [MAIN ] Update Progress: 272/2371 symbols completed. BHV took 18.1s. Estimated remaining: 4h 18m 37s. Rate: 8.1 symbols/min [2025-09-29T17:33:33.930707] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:33:33.948132] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-09-29T17:33:34.004471] [DEBUG] [LOCAL ] BILL: Loaded 53105 existing records from primary storage. [2025-09-29T17:33:34.004873] [INFO ] [MAIN ] BILL: Loaded 53105 existing records. [2025-09-29T17:33:34.212064] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:33:34.212292] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-09-29T17:33:34.212340] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-09-29T17:33:34.213246] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-09-29T17:33:34.213333] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-09-29T17:33:34.584227] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:33:34.748131] [INFO ] [REMOTE ] BILL: Fetching primary data for 2024-12. [2025-09-29T17:33:35.512283] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-29T17:33:35.548140] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-09-29T17:33:36.348086] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-09-29T17:33:36.753124] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-29T17:33:37.018541] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-29T17:33:37.148124] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-09-29T17:33:37.948101] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-09-29T17:33:38.111338] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-29T17:33:38.748103] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-09-29T17:33:38.980791] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-29T17:33:39.025413] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-29T17:33:39.548160] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-09-29T17:33:40.348094] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-09-29T17:33:40.827723] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-29T17:33:40.977868] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-29T17:33:41.148110] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-09-29T17:33:41.948114] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-09-29T17:33:42.154115] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-29T17:33:42.751483] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-09-29T17:33:42.757094] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-29T17:33:42.951293] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-29T17:33:43.548149] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-09-29T17:33:44.348085] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-09-29T17:33:44.691825] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-29T17:33:45.148115] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-09-29T17:33:45.256589] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-29T17:33:45.861931] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-29T17:33:45.948113] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-09-29T17:33:46.748150] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-09-29T17:33:47.130120] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-29T17:33:47.332017] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-29T17:33:47.548171] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-09-29T17:33:48.348167] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-09-29T17:33:48.653899] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-29T17:33:49.148152] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-09-29T17:33:49.416000] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-29T17:33:49.428547] [INFO ] [REMOTE ] BHP: Full fetch complete (77245 records). [2025-09-29T17:33:49.428756] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-09-29T17:33:49.952606] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-09-29T17:33:49.987298] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present. [2025-09-29T17:33:49.987451] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed. [2025-09-29T17:33:49.989322] [INFO ] [MAIN ] BHP: Fetched primary data is valid. [2025-09-29T17:33:49.990701] [DEBUG] [LOCAL ] BHP: Saving primary data. [2025-09-29T17:33:49.993423] [DEBUG] [LOCAL ] BHP: Trimmed 77245 records to 53373 (keeping 200 days of data) [2025-09-29T17:33:50.187543] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-29T17:33:50.480564] [DEBUG] [LOCAL ] BHP: Primary data saved (53373 records). [2025-09-29T17:33:50.480773] [INFO ] [MAIN ] BHP: Full history saved. [2025-09-29T17:33:50.482545] [INFO ] [MAIN ] Update Progress: 273/2371 symbols completed. BHP took 52.9s. Estimated remaining: 4h 19m 42s. Rate: 8.1 symbols/min [2025-09-29T17:33:50.691529] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:33:50.724685] [DEBUG] [LOCAL ] BIO: Loaded 25533 existing records from primary storage. [2025-09-29T17:33:50.725105] [INFO ] [MAIN ] BIO: Loaded 25533 existing records. [2025-09-29T17:33:50.759631] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-09-29T17:33:50.928181] [WARN ] [MAIN ] BIO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:33:50.928528] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-09-29T17:33:50.928728] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-09-29T17:33:50.929305] [DEBUG] [LOCAL ] BIO: Deleted primary data file. [2025-09-29T17:33:50.929373] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-09-29T17:33:51.077696] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-29T17:33:51.381268] [INFO ] [REMOTE ] BIO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:33:51.395583] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-29T17:33:51.548128] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-09-29T17:33:52.348152] [INFO ] [REMOTE ] BIO: Fetching primary data for 2024-12. [2025-09-29T17:33:52.771482] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-29T17:33:52.798721] [INFO ] [REMOTE ] BHVN: Full fetch complete (69727 records). [2025-09-29T17:33:52.800000] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-29T17:33:52.800146] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-09-29T17:33:52.806619] [INFO ] [REMOTE ] BHR: Full fetch complete (30569 records). [2025-09-29T17:33:52.853186] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-09-29T17:33:53.164896] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-09-29T17:33:53.661270] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-09-29T17:33:53.661407] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present. [2025-09-29T17:33:53.662204] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-09-29T17:33:53.662605] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-29T17:33:53.662860] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed. [2025-09-29T17:33:53.667764] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-09-29T17:33:53.668352] [INFO ] [MAIN ] BHR: Fetched primary data is valid. [2025-09-29T17:33:53.668503] [DEBUG] [LOCAL ] BHR: Saving primary data. [2025-09-29T17:33:53.668575] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-09-29T17:33:53.670059] [DEBUG] [LOCAL ] BHR: Trimmed 30569 records to 21364 (keeping 200 days of data) [2025-09-29T17:33:53.671070] [DEBUG] [LOCAL ] BHVN: Trimmed 69727 records to 49696 (keeping 200 days of data) [2025-09-29T17:33:53.975920] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-01. [2025-09-29T17:33:54.031943] [DEBUG] [LOCAL ] BHR: Primary data saved (21364 records). [2025-09-29T17:33:54.035742] [INFO ] [MAIN ] BHR: Full history saved. [2025-09-29T17:33:54.058867] [INFO ] [MAIN ] Update Progress: 274/2371 symbols completed. BHR took 42.9s. Estimated remaining: 4h 19m 5s. Rate: 8.1 symbols/min [2025-09-29T17:33:54.287102] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:33:54.300334] [DEBUG] [LOCAL ] BHVN: Primary data saved (49696 records). [2025-09-29T17:33:54.300602] [INFO ] [MAIN ] BHVN: Full history saved. [2025-09-29T17:33:54.300771] [INFO ] [MAIN ] Update Progress: 275/2371 symbols completed. BHVN took 33.9s. Estimated remaining: 4h 18m 3s. Rate: 8.1 symbols/min [2025-09-29T17:33:54.522758] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:33:54.524260] [DEBUG] [LOCAL ] BIP: Loaded 40240 existing records from primary storage. [2025-09-29T17:33:54.524793] [INFO ] [MAIN ] BIP: Loaded 40240 existing records. [2025-09-29T17:33:54.715776] [WARN ] [MAIN ] BIP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:33:54.716244] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-09-29T17:33:54.728087] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-09-29T17:33:54.729017] [DEBUG] [LOCAL ] BIP: Deleted primary data file. [2025-09-29T17:33:54.729091] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-09-29T17:33:54.854041] [DEBUG] [LOCAL ] BIPC: Loaded 42317 existing records from primary storage. [2025-09-29T17:33:54.895982] [INFO ] [MAIN ] BIPC: Loaded 42317 existing records. [2025-09-29T17:33:55.311960] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-29T17:33:55.370868] [INFO ] [REMOTE ] BIP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:33:55.340944] [WARN ] [MAIN ] BIPC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:33:55.371738] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-09-29T17:33:55.371454] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-09-29T17:33:55.375222] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-09-29T17:33:55.376496] [DEBUG] [LOCAL ] BIPC: Deleted primary data file. [2025-09-29T17:33:55.377016] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-09-29T17:33:55.390032] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-29T17:33:55.553354] [INFO ] [REMOTE ] BIP: Fetching primary data for 2024-12. [2025-09-29T17:33:55.769394] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:33:56.348136] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2024-12. [2025-09-29T17:33:56.564208] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-29T17:33:57.157528] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-09-29T17:33:57.162156] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-29T17:33:57.904356] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-29T17:33:57.948070] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-01. [2025-09-29T17:33:58.748121] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-09-29T17:33:59.192102] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-29T17:33:59.463863] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-29T17:33:59.548097] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-09-29T17:34:00.098340] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-29T17:34:00.348127] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-09-29T17:34:01.148112] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-01. [2025-09-29T17:34:01.515069] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-29T17:34:01.890230] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-29T17:34:01.948127] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-09-29T17:34:02.583359] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-29T17:34:02.748116] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-09-29T17:34:02.806374] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-29T17:34:03.548121] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-09-29T17:34:03.933829] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-29T17:34:04.348113] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-09-29T17:34:05.029784] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-29T17:34:05.148124] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-09-29T17:34:05.816544] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-29T17:34:05.948158] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-09-29T17:34:06.741200] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-29T17:34:06.750765] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-09-29T17:34:07.548115] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-09-29T17:34:08.023485] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-29T17:34:08.034805] [INFO ] [REMOTE ] BILL: Full fetch complete (75608 records). [2025-09-29T17:34:08.034969] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-09-29T17:34:08.349334] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-09-29T17:34:08.407985] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-29T17:34:08.521383] [DEBUG] [VALIDATOR ] BILL: All expected trading days are present. [2025-09-29T17:34:08.521497] [DEBUG] [VALIDATOR ] BILL: Primary data validation passed. [2025-09-29T17:34:08.522494] [INFO ] [MAIN ] BILL: Fetched primary data is valid. [2025-09-29T17:34:08.522579] [DEBUG] [LOCAL ] BILL: Saving primary data. [2025-09-29T17:34:08.524411] [DEBUG] [LOCAL ] BILL: Trimmed 75608 records to 52329 (keeping 200 days of data) [2025-09-29T17:34:08.856151] [DEBUG] [LOCAL ] BILL: Primary data saved (52329 records). [2025-09-29T17:34:08.856324] [INFO ] [MAIN ] BILL: Full history saved. [2025-09-29T17:34:08.856423] [INFO ] [MAIN ] Update Progress: 276/2371 symbols completed. BILL took 35.1s. Estimated remaining: 4h 18m 50s. Rate: 8.1 symbols/min [2025-09-29T17:34:09.052636] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:34:09.058415] [DEBUG] [LOCAL ] BIPH: Loaded 2632 existing records from primary storage. [2025-09-29T17:34:09.058662] [INFO ] [MAIN ] BIPH: Loaded 2632 existing records. [2025-09-29T17:34:09.156522] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-09-29T17:34:09.268525] [WARN ] [MAIN ] BIPH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:34:09.269058] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-09-29T17:34:09.269232] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-09-29T17:34:09.269755] [DEBUG] [LOCAL ] BIPH: Deleted primary data file. [2025-09-29T17:34:09.269875] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-09-29T17:34:09.482322] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-29T17:34:09.715632] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:34:09.948124] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-09-29T17:34:10.173710] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-29T17:34:10.470809] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-29T17:34:10.748145] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-09-29T17:34:11.374026] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-29T17:34:11.548128] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-09-29T17:34:12.348107] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2024-12. [2025-09-29T17:34:12.389515] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-29T17:34:12.769341] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-29T17:34:12.773548] [INFO ] [REMOTE ] BIO: Full fetch complete (34087 records). [2025-09-29T17:34:12.773742] [DEBUG] [VALIDATOR ] BIO: Validating primary data. [2025-09-29T17:34:12.897052] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-29T17:34:13.153223] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-09-29T17:34:13.197317] [DEBUG] [VALIDATOR ] BIO: All expected trading days are present. [2025-09-29T17:34:13.197455] [DEBUG] [VALIDATOR ] BIO: Primary data validation passed. [2025-09-29T17:34:13.198213] [INFO ] [MAIN ] BIO: Fetched primary data is valid. [2025-09-29T17:34:13.198306] [DEBUG] [LOCAL ] BIO: Saving primary data. [2025-09-29T17:34:13.199757] [DEBUG] [LOCAL ] BIO: Trimmed 34087 records to 25004 (keeping 200 days of data) [2025-09-29T17:34:13.363975] [DEBUG] [LOCAL ] BIO: Primary data saved (25004 records). [2025-09-29T17:34:13.364107] [INFO ] [MAIN ] BIO: Full history saved. [2025-09-29T17:34:13.364217] [INFO ] [MAIN ] Update Progress: 277/2371 symbols completed. BIO took 22.9s. Estimated remaining: 4h 18m 20s. Rate: 8.1 symbols/min [2025-09-29T17:34:13.948099] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-09-29T17:34:14.706435] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-29T17:34:14.748109] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-09-29T17:34:15.398459] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-29T17:34:15.548110] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-01. [2025-09-29T17:34:16.215845] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-29T17:34:16.304612] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-29T17:34:16.348096] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-09-29T17:34:17.148115] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-09-29T17:34:17.871124] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-29T17:34:17.948107] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-09-29T17:34:18.083869] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-29T17:34:18.748125] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-09-29T17:34:19.494614] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-29T17:34:19.503599] [INFO ] [REMOTE ] BIPC: Full fetch complete (59482 records). [2025-09-29T17:34:19.503789] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-09-29T17:34:19.504683] [FATAL] [VALIDATOR ] BIPC: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:34:19.504773] [FATAL] [MAIN ] BIPC: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:34:19.504819] [WARN ] [MAIN ] BIPC: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:34:19.504859] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-09-29T17:34:19.504919] [DEBUG] [LOCAL ] BIPC: No primary data file found to delete. [2025-09-29T17:34:19.504968] [INFO ] [LOCAL ] BIPC: Starting deletion of derivative data. [2025-09-29T17:34:19.505367] [DEBUG] [LOCAL ] BIPC: Deleted derivative data file. [2025-09-29T17:34:19.505470] [INFO ] [MAIN ] Update Progress: 278/2371 symbols completed. BIPC took 25.2s. Estimated remaining: 4h 18m 4s. Rate: 8.1 symbols/min [2025-09-29T17:34:19.548134] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-09-29T17:34:20.001095] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-29T17:34:20.353211] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-09-29T17:34:20.371897] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-29T17:34:20.948776] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-29T17:34:21.148131] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-09-29T17:34:21.948233] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-09-29T17:34:22.668487] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-29T17:34:22.694419] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-29T17:34:22.748084] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-09-29T17:34:23.548114] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-09-29T17:34:24.086269] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-29T17:34:24.348130] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-09-29T17:34:24.423106] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-29T17:34:24.434024] [INFO ] [REMOTE ] BIP: Full fetch complete (56746 records). [2025-09-29T17:34:24.434199] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-09-29T17:34:24.842876] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-29T17:34:24.843278] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-09-29T17:34:24.844882] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-09-29T17:34:24.845683] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-09-29T17:34:24.845753] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-09-29T17:34:24.847109] [DEBUG] [LOCAL ] BIP: Trimmed 56746 records to 39545 (keeping 200 days of data) [2025-09-29T17:34:25.103164] [DEBUG] [LOCAL ] BIP: Primary data saved (39545 records). [2025-09-29T17:34:25.103364] [INFO ] [MAIN ] BIP: Full history saved. [2025-09-29T17:34:25.103477] [INFO ] [MAIN ] Update Progress: 279/2371 symbols completed. BIP took 31.0s. Estimated remaining: 4h 17m 43s. Rate: 8.1 symbols/min [2025-09-29T17:34:25.148163] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-09-29T17:34:25.584035] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-29T17:34:25.948111] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-09-29T17:34:26.371948] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-29T17:34:26.748173] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-09-29T17:34:27.296719] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-29T17:34:27.297901] [INFO ] [REMOTE ] BIPH: Full fetch complete (4337 records). [2025-09-29T17:34:27.297980] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-09-29T17:34:27.682843] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-09-29T17:34:27.682939] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-09-29T17:34:27.683135] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-09-29T17:34:27.683205] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-09-29T17:34:27.683632] [DEBUG] [LOCAL ] BIPH: Trimmed 4337 records to 2572 (keeping 200 days of data) [2025-09-29T17:34:27.701032] [DEBUG] [LOCAL ] BIPH: Primary data saved (2572 records). [2025-09-29T17:34:27.701155] [INFO ] [MAIN ] BIPH: Full history saved. [2025-09-29T17:34:27.701254] [INFO ] [MAIN ] Update Progress: 280/2371 symbols completed. BIPH took 18.8s. Estimated remaining: 4h 16m 59s. Rate: 8.1 symbols/min [2025-09-29T17:34:28.345327] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:34:28.334681] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:34:28.489362] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:34:28.488495] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:34:28.492637] [DEBUG] [LOCAL ] BIPJ: Loaded 3026 existing records from primary storage. [2025-09-29T17:34:28.493472] [INFO ] [MAIN ] BIPJ: Loaded 3026 existing records. [2025-09-29T17:34:28.496963] [DEBUG] [LOCAL ] BIPI: Loaded 3282 existing records from primary storage. [2025-09-29T17:34:28.519205] [INFO ] [MAIN ] BIPI: Loaded 3282 existing records. [2025-09-29T17:34:28.763243] [DEBUG] [LOCAL ] BIT: Loaded 22765 existing records from primary storage. [2025-09-29T17:34:28.823013] [INFO ] [MAIN ] BIT: Loaded 22765 existing records. [2025-09-29T17:34:28.885852] [WARN ] [MAIN ] BIPJ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:34:28.949948] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-09-29T17:34:29.004440] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-09-29T17:34:29.018580] [DEBUG] [LOCAL ] BIRK: Loaded 51674 existing records from primary storage. [2025-09-29T17:34:29.050432] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:34:29.041846] [DEBUG] [LOCAL ] BIPJ: Deleted primary data file. [2025-09-29T17:34:29.065234] [INFO ] [MAIN ] BIRK: Loaded 51674 existing records. [2025-09-29T17:34:29.065330] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-09-29T17:34:29.065419] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-09-29T17:34:29.076015] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-09-29T17:34:29.151533] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-09-29T17:34:29.295072] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-09-29T17:34:29.351710] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:34:29.412623] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-09-29T17:34:29.419016] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-09-29T17:34:29.456108] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-09-29T17:34:29.483512] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-09-29T17:34:29.659524] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:34:29.711768] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-09-29T17:34:29.809272] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-09-29T17:34:29.939246] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-09-29T17:34:29.979905] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-09-29T17:34:30.521505] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:34:30.570606] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2024-12. [2025-09-29T17:34:30.707542] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:34:30.744986] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2024-12. [2025-09-29T17:34:30.865247] [INFO ] [REMOTE ] BIT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:34:30.875839] [INFO ] [REMOTE ] BIT: Fetching primary data for 2024-12. [2025-09-29T17:34:31.001203] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:34:31.001509] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2024-12. [2025-09-29T17:34:31.378024] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-29T17:34:31.379816] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-01. [2025-09-29T17:34:31.652389] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-29T17:34:31.655693] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-01. [2025-09-29T17:34:31.881485] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-29T17:34:31.972157] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-29T17:34:32.205375] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-29T17:34:32.348092] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-09-29T17:34:32.592295] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-29T17:34:32.649174] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-29T17:34:33.148123] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-09-29T17:34:33.580713] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-29T17:34:33.948118] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-09-29T17:34:34.424509] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-29T17:34:34.748119] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-09-29T17:34:35.362764] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-29T17:34:35.548155] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-09-29T17:34:36.281772] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-29T17:34:36.348124] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-09-29T17:34:36.898674] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-29T17:34:37.148130] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-09-29T17:34:37.606464] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-29T17:34:37.948146] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-01. [2025-09-29T17:34:38.748171] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-01. [2025-09-29T17:34:39.548097] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-09-29T17:34:39.588336] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-29T17:34:39.772807] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-29T17:34:40.030592] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-29T17:34:40.348146] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-09-29T17:34:41.148150] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-09-29T17:34:41.222849] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-29T17:34:41.796720] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-29T17:34:41.948189] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-09-29T17:34:42.551101] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-29T17:34:42.748182] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-09-29T17:34:43.282857] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-29T17:34:43.548117] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-09-29T17:34:44.348131] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-09-29T17:34:44.525834] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-29T17:34:44.527803] [INFO ] [REMOTE ] BIPI: Full fetch complete (5198 records). [2025-09-29T17:34:44.527884] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-09-29T17:34:44.904796] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-09-29T17:34:44.904883] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-09-29T17:34:44.905033] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-09-29T17:34:44.905073] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-09-29T17:34:44.905449] [DEBUG] [LOCAL ] BIPI: Trimmed 5198 records to 3221 (keeping 200 days of data) [2025-09-29T17:34:44.925711] [DEBUG] [LOCAL ] BIPI: Primary data saved (3221 records). [2025-09-29T17:34:44.925805] [INFO ] [MAIN ] BIPI: Full history saved. [2025-09-29T17:34:44.925882] [INFO ] [MAIN ] Update Progress: 281/2371 symbols completed. BIPI took 17.2s. Estimated remaining: 4h 18m 5s. Rate: 8.1 symbols/min [2025-09-29T17:34:45.108620] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:34:45.154728] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-09-29T17:34:45.179553] [DEBUG] [LOCAL ] BJ: Loaded 52156 existing records from primary storage. [2025-09-29T17:34:45.179964] [INFO ] [MAIN ] BJ: Loaded 52156 existing records. [2025-09-29T17:34:45.390170] [WARN ] [MAIN ] BJ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:34:45.390674] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-09-29T17:34:45.390739] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-09-29T17:34:45.391486] [DEBUG] [LOCAL ] BJ: Deleted primary data file. [2025-09-29T17:34:45.391546] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-09-29T17:34:45.556966] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-29T17:34:45.790971] [INFO ] [REMOTE ] BJ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:34:45.948117] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-09-29T17:34:46.750523] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-09-29T17:34:46.757112] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-29T17:34:46.968722] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-29T17:34:47.323584] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-29T17:34:47.548125] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-09-29T17:34:48.348111] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-09-29T17:34:48.911472] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-29T17:34:49.148130] [INFO ] [REMOTE ] BJ: Fetching primary data for 2024-12. [2025-09-29T17:34:49.218304] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-29T17:34:49.948134] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-09-29T17:34:50.618477] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-29T17:34:50.748142] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-01. [2025-09-29T17:34:51.548089] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-09-29T17:34:51.804112] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-29T17:34:52.348142] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-09-29T17:34:52.401834] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-29T17:34:52.554934] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-29T17:34:53.148183] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-09-29T17:34:53.948086] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-09-29T17:34:54.048043] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-29T17:34:54.099148] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-29T17:34:54.565732] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-29T17:34:54.748106] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-09-29T17:34:55.548133] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-09-29T17:34:55.981803] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-29T17:34:56.348176] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-09-29T17:34:57.127698] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-29T17:34:57.148130] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-09-29T17:34:57.626028] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-29T17:34:57.948143] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-09-29T17:34:58.748128] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-09-29T17:34:58.950498] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-29T17:34:58.953292] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-29T17:34:58.955186] [INFO ] [REMOTE ] BIPJ: Full fetch complete (4346 records). [2025-09-29T17:34:58.965905] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-09-29T17:34:59.358875] [DEBUG] [VALIDATOR ] BIPJ: All expected trading days are present. [2025-09-29T17:34:59.358963] [DEBUG] [VALIDATOR ] BIPJ: Primary data validation passed. [2025-09-29T17:34:59.359117] [INFO ] [MAIN ] BIPJ: Fetched primary data is valid. [2025-09-29T17:34:59.359188] [DEBUG] [LOCAL ] BIPJ: Saving primary data. [2025-09-29T17:34:59.359563] [DEBUG] [LOCAL ] BIPJ: Trimmed 4346 records to 3022 (keeping 200 days of data) [2025-09-29T17:34:59.379909] [DEBUG] [LOCAL ] BIPJ: Primary data saved (3022 records). [2025-09-29T17:34:59.380031] [INFO ] [MAIN ] BIPJ: Full history saved. [2025-09-29T17:34:59.380160] [INFO ] [MAIN ] Update Progress: 282/2371 symbols completed. BIPJ took 31.7s. Estimated remaining: 4h 18m 50s. Rate: 8.1 symbols/min [2025-09-29T17:34:59.558324] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-09-29T17:34:59.562352] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:34:59.639139] [DEBUG] [LOCAL ] BK: Loaded 54319 existing records from primary storage. [2025-09-29T17:34:59.639593] [INFO ] [MAIN ] BK: Loaded 54319 existing records. [2025-09-29T17:34:59.839736] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:34:59.840120] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-09-29T17:34:59.840186] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-09-29T17:34:59.840892] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-09-29T17:34:59.840954] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-09-29T17:35:00.094966] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-29T17:35:00.258120] [INFO ] [REMOTE ] BK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:35:00.348120] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-09-29T17:35:01.148098] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-09-29T17:35:01.505136] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-29T17:35:01.948184] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-09-29T17:35:01.973412] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-29T17:35:01.983085] [INFO ] [REMOTE ] BIT: Full fetch complete (31370 records). [2025-09-29T17:35:01.983259] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-09-29T17:35:02.397087] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present. [2025-09-29T17:35:02.397171] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed. [2025-09-29T17:35:02.397714] [INFO ] [MAIN ] BIT: Fetched primary data is valid. [2025-09-29T17:35:02.397781] [DEBUG] [LOCAL ] BIT: Saving primary data. [2025-09-29T17:35:02.398587] [DEBUG] [LOCAL ] BIT: Trimmed 31370 records to 22570 (keeping 200 days of data) [2025-09-29T17:35:02.540398] [DEBUG] [LOCAL ] BIT: Primary data saved (22570 records). [2025-09-29T17:35:02.540531] [INFO ] [MAIN ] BIT: Full history saved. [2025-09-29T17:35:02.540619] [INFO ] [MAIN ] Update Progress: 283/2371 symbols completed. BIT took 34.8s. Estimated remaining: 4h 18m 11s. Rate: 8.1 symbols/min [2025-09-29T17:35:02.744533] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:35:02.748107] [INFO ] [REMOTE ] BK: Fetching primary data for 2024-12. [2025-09-29T17:35:02.804131] [DEBUG] [LOCAL ] BKD: Loaded 50889 existing records from primary storage. [2025-09-29T17:35:02.804453] [INFO ] [MAIN ] BKD: Loaded 50889 existing records. [2025-09-29T17:35:02.997767] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:35:02.998377] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-09-29T17:35:02.998588] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-09-29T17:35:02.999236] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-09-29T17:35:02.999316] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-09-29T17:35:03.299479] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-29T17:35:03.439702] [INFO ] [REMOTE ] BKD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:35:03.479333] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-29T17:35:03.548100] [INFO ] [REMOTE ] BKD: Fetching primary data for 2024-12. [2025-09-29T17:35:04.348161] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-09-29T17:35:04.584496] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-29T17:35:05.148097] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-09-29T17:35:05.249537] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-29T17:35:05.948098] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-01. [2025-09-29T17:35:06.080469] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-29T17:35:06.748164] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-09-29T17:35:07.028711] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-29T17:35:07.488921] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-29T17:35:07.548138] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-09-29T17:35:08.348096] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-09-29T17:35:08.496023] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-29T17:35:09.148168] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-09-29T17:35:09.719445] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-29T17:35:09.730773] [INFO ] [REMOTE ] BIRK: Full fetch complete (72920 records). [2025-09-29T17:35:09.730961] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-09-29T17:35:09.949569] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-09-29T17:35:10.165538] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-09-29T17:35:10.165722] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-09-29T17:35:10.166626] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-09-29T17:35:10.166795] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-09-29T17:35:10.182746] [DEBUG] [LOCAL ] BIRK: Trimmed 72920 records to 50899 (keeping 200 days of data) [2025-09-29T17:35:10.197516] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-29T17:35:10.512087] [DEBUG] [LOCAL ] BIRK: Primary data saved (50899 records). [2025-09-29T17:35:10.512239] [INFO ] [MAIN ] BIRK: Full history saved. [2025-09-29T17:35:10.512329] [INFO ] [MAIN ] Update Progress: 284/2371 symbols completed. BIRK took 42.8s. Estimated remaining: 4h 18m 8s. Rate: 8.1 symbols/min [2025-09-29T17:35:10.692923] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:35:10.731046] [DEBUG] [LOCAL ] BKE: Loaded 35206 existing records from primary storage. [2025-09-29T17:35:10.731345] [INFO ] [MAIN ] BKE: Loaded 35206 existing records. [2025-09-29T17:35:10.753363] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-09-29T17:35:10.921523] [WARN ] [MAIN ] BKE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:35:10.922114] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-09-29T17:35:10.922266] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-09-29T17:35:10.922567] [DEBUG] [LOCAL ] BKE: Deleted primary data file. [2025-09-29T17:35:10.922626] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-09-29T17:35:11.335695] [INFO ] [REMOTE ] BKE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:35:11.338228] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-29T17:35:11.548115] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-09-29T17:35:11.845638] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-29T17:35:12.348127] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-09-29T17:35:12.398367] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-29T17:35:13.148109] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-09-29T17:35:13.548550] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-29T17:35:13.948113] [INFO ] [REMOTE ] BKE: Fetching primary data for 2024-12. [2025-09-29T17:35:14.319761] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-29T17:35:14.703632] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-29T17:35:14.748110] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-09-29T17:35:14.953182] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-29T17:35:15.548134] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-09-29T17:35:16.348132] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-09-29T17:35:16.559464] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-29T17:35:17.148128] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-09-29T17:35:17.381593] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-29T17:35:17.392952] [INFO ] [REMOTE ] BJ: Full fetch complete (73434 records). [2025-09-29T17:35:17.393146] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-09-29T17:35:17.394152] [FATAL] [VALIDATOR ] BJ: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:35:17.394246] [FATAL] [MAIN ] BJ: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:35:17.394292] [WARN ] [MAIN ] BJ: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:35:17.394360] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-09-29T17:35:17.394445] [DEBUG] [LOCAL ] BJ: No primary data file found to delete. [2025-09-29T17:35:17.394503] [INFO ] [LOCAL ] BJ: Starting deletion of derivative data. [2025-09-29T17:35:17.394924] [DEBUG] [LOCAL ] BJ: Deleted derivative data file. [2025-09-29T17:35:17.395993] [INFO ] [MAIN ] Update Progress: 285/2371 symbols completed. BJ took 32.5s. Estimated remaining: 4h 17m 56s. Rate: 8.1 symbols/min [2025-09-29T17:35:17.580448] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:35:17.624909] [DEBUG] [LOCAL ] BKH: Loaded 37133 existing records from primary storage. [2025-09-29T17:35:17.625247] [INFO ] [MAIN ] BKH: Loaded 37133 existing records. [2025-09-29T17:35:17.817858] [WARN ] [MAIN ] BKH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:35:17.818076] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-09-29T17:35:17.818170] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-09-29T17:35:17.818964] [DEBUG] [LOCAL ] BKH: Deleted primary data file. [2025-09-29T17:35:17.819068] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-09-29T17:35:17.953234] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-01. [2025-09-29T17:35:18.236903] [INFO ] [REMOTE ] BKH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:35:18.266637] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-29T17:35:18.748102] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-09-29T17:35:19.078066] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-29T17:35:19.361332] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-29T17:35:19.548115] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-09-29T17:35:19.996958] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-29T17:35:20.348150] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-09-29T17:35:21.081001] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-29T17:35:21.148145] [INFO ] [REMOTE ] BKH: Fetching primary data for 2024-12. [2025-09-29T17:35:21.526242] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-29T17:35:21.948174] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-09-29T17:35:22.381558] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-29T17:35:22.748154] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-09-29T17:35:23.511770] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-29T17:35:23.548137] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-09-29T17:35:24.348091] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-09-29T17:35:24.772708] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-29T17:35:25.148101] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-09-29T17:35:25.215624] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-29T17:35:25.948120] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-01. [2025-09-29T17:35:26.175999] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-29T17:35:26.748098] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-09-29T17:35:26.931827] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-29T17:35:27.548174] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-09-29T17:35:27.596710] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-29T17:35:28.353212] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-09-29T17:35:28.366320] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-29T17:35:29.148115] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-09-29T17:35:29.384161] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-29T17:35:29.395759] [INFO ] [REMOTE ] BK: Full fetch complete (77481 records). [2025-09-29T17:35:29.395941] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-09-29T17:35:29.850063] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-09-29T17:35:29.850340] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-09-29T17:35:29.851399] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-09-29T17:35:29.851470] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-09-29T17:35:29.853221] [DEBUG] [LOCAL ] BK: Trimmed 77481 records to 53539 (keeping 200 days of data) [2025-09-29T17:35:29.948525] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-09-29T17:35:30.123380] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-29T17:35:30.254636] [DEBUG] [LOCAL ] BK: Primary data saved (53539 records). [2025-09-29T17:35:30.254809] [INFO ] [MAIN ] BK: Full history saved. [2025-09-29T17:35:30.254907] [INFO ] [MAIN ] Update Progress: 286/2371 symbols completed. BK took 30.9s. Estimated remaining: 4h 18m 29s. Rate: 8.1 symbols/min [2025-09-29T17:35:30.443383] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:35:30.480388] [DEBUG] [LOCAL ] BKKT: Loaded 35164 existing records from primary storage. [2025-09-29T17:35:30.480716] [INFO ] [MAIN ] BKKT: Loaded 35164 existing records. [2025-09-29T17:35:30.619612] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-29T17:35:30.734814] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:35:30.735105] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-09-29T17:35:30.735157] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-09-29T17:35:30.735726] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-09-29T17:35:30.735789] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-09-29T17:35:30.757401] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-09-29T17:35:31.122067] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:35:31.339277] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-29T17:35:31.548118] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-09-29T17:35:32.290341] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-29T17:35:32.301074] [INFO ] [REMOTE ] BKD: Full fetch complete (71538 records). [2025-09-29T17:35:32.301240] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-09-29T17:35:32.353272] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2024-12. [2025-09-29T17:35:32.778131] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-09-29T17:35:32.778325] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-09-29T17:35:32.779216] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-09-29T17:35:32.779303] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-09-29T17:35:32.781167] [DEBUG] [LOCAL ] BKD: Trimmed 71538 records to 50182 (keeping 200 days of data) [2025-09-29T17:35:32.804376] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-29T17:35:33.121289] [DEBUG] [LOCAL ] BKD: Primary data saved (50182 records). [2025-09-29T17:35:33.121447] [INFO ] [MAIN ] BKD: Full history saved. [2025-09-29T17:35:33.121534] [INFO ] [MAIN ] Update Progress: 287/2371 symbols completed. BKD took 30.6s. Estimated remaining: 4h 17m 48s. Rate: 8.1 symbols/min [2025-09-29T17:35:33.156116] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-09-29T17:35:33.316786] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:35:33.325936] [DEBUG] [LOCAL ] BKN: Loaded 7853 existing records from primary storage. [2025-09-29T17:35:33.326177] [INFO ] [MAIN ] BKN: Loaded 7853 existing records. [2025-09-29T17:35:33.544990] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:35:33.545348] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-09-29T17:35:33.545406] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-09-29T17:35:33.545701] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-09-29T17:35:33.545761] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-09-29T17:35:33.949759] [INFO ] [REMOTE ] BKN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:35:33.949999] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-09-29T17:35:34.214038] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-29T17:35:34.632426] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-29T17:35:34.748190] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-01. [2025-09-29T17:35:34.958473] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-29T17:35:35.548103] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-09-29T17:35:35.924565] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-29T17:35:36.348128] [INFO ] [REMOTE ] BKN: Fetching primary data for 2024-12. [2025-09-29T17:35:37.100771] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-29T17:35:37.148109] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-09-29T17:35:37.266822] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-29T17:35:37.948166] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-09-29T17:35:38.499370] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-29T17:35:38.748148] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-09-29T17:35:39.548207] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-09-29T17:35:39.727291] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-29T17:35:39.737165] [INFO ] [REMOTE ] BKE: Full fetch complete (50197 records). [2025-09-29T17:35:39.737323] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-09-29T17:35:40.152181] [DEBUG] [VALIDATOR ] BKE: All expected trading days are present. [2025-09-29T17:35:40.152277] [DEBUG] [VALIDATOR ] BKE: Primary data validation passed. [2025-09-29T17:35:40.152937] [INFO ] [MAIN ] BKE: Fetched primary data is valid. [2025-09-29T17:35:40.153007] [DEBUG] [LOCAL ] BKE: Saving primary data. [2025-09-29T17:35:40.154286] [DEBUG] [LOCAL ] BKE: Trimmed 50197 records to 34611 (keeping 200 days of data) [2025-09-29T17:35:40.358545] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-01. [2025-09-29T17:35:40.389455] [DEBUG] [LOCAL ] BKE: Primary data saved (34611 records). [2025-09-29T17:35:40.389587] [INFO ] [MAIN ] BKE: Full history saved. [2025-09-29T17:35:40.389746] [INFO ] [MAIN ] Update Progress: 288/2371 symbols completed. BKE took 29.9s. Estimated remaining: 4h 17m 40s. Rate: 8.1 symbols/min [2025-09-29T17:35:40.577607] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-29T17:35:40.595503] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:35:40.649065] [DEBUG] [LOCAL ] BKSY: Loaded 48993 existing records from primary storage. [2025-09-29T17:35:40.649405] [INFO ] [MAIN ] BKSY: Loaded 48993 existing records. [2025-09-29T17:35:40.843328] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:35:40.843627] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-09-29T17:35:40.843777] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-09-29T17:35:40.844431] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-09-29T17:35:40.844509] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-09-29T17:35:41.161056] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-09-29T17:35:41.194306] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-29T17:35:41.258748] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-29T17:35:41.297107] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:35:41.948133] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-09-29T17:35:42.413466] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-29T17:35:42.748150] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2024-12. [2025-09-29T17:35:43.443305] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-29T17:35:43.548142] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-09-29T17:35:44.270461] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-29T17:35:44.348130] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-09-29T17:35:45.056156] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-29T17:35:45.148091] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-09-29T17:35:45.186742] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-29T17:35:45.941374] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-29T17:35:45.948118] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-01. [2025-09-29T17:35:46.748109] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-09-29T17:35:47.548131] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-09-29T17:35:47.655899] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-29T17:35:47.695788] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-29T17:35:48.348106] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-09-29T17:35:48.999977] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-29T17:35:49.014199] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-29T17:35:49.148128] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-09-29T17:35:49.948129] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-09-29T17:35:50.748107] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-09-29T17:35:51.095598] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-29T17:35:51.449367] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-29T17:35:51.548142] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-09-29T17:35:52.018594] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-29T17:35:52.348160] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-09-29T17:35:53.130046] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-29T17:35:53.148080] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-09-29T17:35:53.948160] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-09-29T17:35:54.179556] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-29T17:35:54.748132] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-09-29T17:35:55.076321] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-29T17:35:55.548143] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-09-29T17:35:55.675211] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-29T17:35:56.268336] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-29T17:35:56.348127] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-09-29T17:35:56.583377] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-29T17:35:57.148126] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-09-29T17:35:57.948147] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-09-29T17:35:58.493893] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-29T17:35:58.504281] [INFO ] [REMOTE ] BKKT: Full fetch complete (50041 records). [2025-09-29T17:35:58.504416] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-09-29T17:35:58.707907] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-29T17:35:58.757062] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-09-29T17:35:58.972387] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-29T17:35:58.972504] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-09-29T17:35:58.981813] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-09-29T17:35:58.983076] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-09-29T17:35:58.983176] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-09-29T17:35:58.985119] [DEBUG] [LOCAL ] BKKT: Trimmed 50041 records to 34818 (keeping 200 days of data) [2025-09-29T17:35:59.195686] [DEBUG] [LOCAL ] BKKT: Primary data saved (34818 records). [2025-09-29T17:35:59.195849] [INFO ] [MAIN ] BKKT: Full history saved. [2025-09-29T17:35:59.195939] [INFO ] [MAIN ] Update Progress: 289/2371 symbols completed. BKKT took 28.9s. Estimated remaining: 4h 18m 54s. Rate: 8.0 symbols/min [2025-09-29T17:35:59.376693] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:35:59.390209] [DEBUG] [LOCAL ] BKT: Loaded 11125 existing records from primary storage. [2025-09-29T17:35:59.390456] [INFO ] [MAIN ] BKT: Loaded 11125 existing records. [2025-09-29T17:35:59.552166] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-09-29T17:35:59.580088] [WARN ] [MAIN ] BKT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:35:59.580450] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-09-29T17:35:59.580503] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-09-29T17:35:59.581098] [DEBUG] [LOCAL ] BKT: Deleted primary data file. [2025-09-29T17:35:59.581166] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-09-29T17:35:59.954151] [INFO ] [REMOTE ] BKT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:36:00.315671] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-29T17:36:00.324545] [INFO ] [REMOTE ] BKH: Full fetch complete (52300 records). [2025-09-29T17:36:00.324724] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-09-29T17:36:00.353273] [INFO ] [REMOTE ] BKT: Fetching primary data for 2024-12. [2025-09-29T17:36:00.642481] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-29T17:36:00.683430] [INFO ] [REMOTE ] BKN: Full fetch complete (11949 records). [2025-09-29T17:36:00.699529] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-09-29T17:36:00.937900] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present. [2025-09-29T17:36:00.943153] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed. [2025-09-29T17:36:00.961220] [INFO ] [MAIN ] BKH: Fetched primary data is valid. [2025-09-29T17:36:00.966475] [DEBUG] [LOCAL ] BKH: Saving primary data. [2025-09-29T17:36:01.013762] [DEBUG] [LOCAL ] BKH: Trimmed 52300 records to 36557 (keeping 200 days of data) [2025-09-29T17:36:01.181426] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-09-29T17:36:01.276325] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-29T17:36:01.333912] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-09-29T17:36:01.335006] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-09-29T17:36:01.335767] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-09-29T17:36:01.336124] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-09-29T17:36:01.341438] [DEBUG] [LOCAL ] BKN: Trimmed 11949 records to 7759 (keeping 200 days of data) [2025-09-29T17:36:01.418443] [DEBUG] [LOCAL ] BKN: Primary data saved (7759 records). [2025-09-29T17:36:01.420171] [INFO ] [MAIN ] BKN: Full history saved. [2025-09-29T17:36:01.421484] [INFO ] [MAIN ] Update Progress: 290/2371 symbols completed. BKN took 28.3s. Estimated remaining: 4h 18m 9s. Rate: 8.1 symbols/min [2025-09-29T17:36:01.669538] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:36:01.755699] [DEBUG] [LOCAL ] BKH: Primary data saved (36557 records). [2025-09-29T17:36:01.756747] [INFO ] [MAIN ] BKH: Full history saved. [2025-09-29T17:36:01.759118] [INFO ] [MAIN ] Update Progress: 291/2371 symbols completed. BKH took 44.4s. Estimated remaining: 4h 17m 11s. Rate: 8.1 symbols/min [2025-09-29T17:36:01.756572] [DEBUG] [LOCAL ] BKU: Loaded 42412 existing records from primary storage. [2025-09-29T17:36:01.778576] [INFO ] [MAIN ] BKU: Loaded 42412 existing records. [2025-09-29T17:36:01.951856] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-01. [2025-09-29T17:36:02.145997] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:36:02.226161] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:36:02.226514] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-09-29T17:36:02.226583] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-09-29T17:36:02.227279] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-09-29T17:36:02.227376] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-09-29T17:36:02.379625] [DEBUG] [LOCAL ] BKV: Loaded 30278 existing records from primary storage. [2025-09-29T17:36:02.409821] [INFO ] [MAIN ] BKV: Loaded 30278 existing records. [2025-09-29T17:36:02.806524] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:36:02.859034] [INFO ] [REMOTE ] BKU: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:36:02.859588] [INFO ] [REMOTE ] BKU: Fetching primary data for 2024-12. [2025-09-29T17:36:02.859265] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-09-29T17:36:02.861507] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-09-29T17:36:02.861842] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-29T17:36:02.866181] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-09-29T17:36:02.866280] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-09-29T17:36:03.263146] [INFO ] [REMOTE ] BKV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:36:03.300443] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-29T17:36:03.548158] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-09-29T17:36:04.348167] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-09-29T17:36:04.428310] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-29T17:36:05.133215] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-29T17:36:05.148054] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-09-29T17:36:05.455683] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-29T17:36:05.904436] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-29T17:36:05.948168] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-01. [2025-09-29T17:36:06.748160] [INFO ] [REMOTE ] BKV: Fetching primary data for 2024-12. [2025-09-29T17:36:07.514913] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-29T17:36:07.548087] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-09-29T17:36:07.798823] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-29T17:36:08.348104] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-09-29T17:36:08.965307] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-29T17:36:09.148130] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-09-29T17:36:09.948114] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-09-29T17:36:09.995592] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-29T17:36:10.409537] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-29T17:36:10.748117] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-01. [2025-09-29T17:36:11.505984] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-29T17:36:11.548104] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-09-29T17:36:12.049462] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-29T17:36:12.348134] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-09-29T17:36:13.104222] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-29T17:36:13.148081] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-09-29T17:36:13.506687] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-29T17:36:13.948116] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-09-29T17:36:14.756455] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-09-29T17:36:14.761369] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-29T17:36:15.238694] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-29T17:36:15.548089] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-09-29T17:36:15.586983] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-29T17:36:16.348114] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-09-29T17:36:17.148118] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-09-29T17:36:17.191736] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-29T17:36:17.948109] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-09-29T17:36:18.329243] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-29T17:36:18.415513] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-29T17:36:18.426322] [INFO ] [REMOTE ] BKSY: Full fetch complete (69457 records). [2025-09-29T17:36:18.426457] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-09-29T17:36:18.570689] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-29T17:36:18.753221] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-09-29T17:36:18.866367] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-09-29T17:36:18.866463] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-09-29T17:36:18.867309] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-09-29T17:36:18.867437] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-09-29T17:36:18.871734] [DEBUG] [LOCAL ] BKSY: Trimmed 69457 records to 48195 (keeping 200 days of data) [2025-09-29T17:36:19.169027] [DEBUG] [LOCAL ] BKSY: Primary data saved (48195 records). [2025-09-29T17:36:19.169177] [INFO ] [MAIN ] BKSY: Full history saved. [2025-09-29T17:36:19.169284] [INFO ] [MAIN ] Update Progress: 292/2371 symbols completed. BKSY took 38.8s. Estimated remaining: 4h 18m 15s. Rate: 8.1 symbols/min [2025-09-29T17:36:19.353222] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:36:19.396824] [DEBUG] [LOCAL ] BLCO: Loaded 36110 existing records from primary storage. [2025-09-29T17:36:19.397137] [INFO ] [MAIN ] BLCO: Loaded 36110 existing records. [2025-09-29T17:36:19.553241] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-09-29T17:36:19.605586] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:36:19.605955] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-09-29T17:36:19.606030] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-09-29T17:36:19.606760] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-09-29T17:36:19.606832] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-09-29T17:36:19.751997] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-29T17:36:20.062904] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:36:20.348129] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-09-29T17:36:20.792878] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-29T17:36:21.148153] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2024-12. [2025-09-29T17:36:21.512070] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-29T17:36:21.517289] [INFO ] [REMOTE ] BKT: Full fetch complete (15209 records). [2025-09-29T17:36:21.517565] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-09-29T17:36:21.954269] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-09-29T17:36:21.967847] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-09-29T17:36:21.967943] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-09-29T17:36:21.968305] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-09-29T17:36:21.968407] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-09-29T17:36:21.969176] [DEBUG] [LOCAL ] BKT: Trimmed 15209 records to 11191 (keeping 200 days of data) [2025-09-29T17:36:22.046031] [DEBUG] [LOCAL ] BKT: Primary data saved (11191 records). [2025-09-29T17:36:22.046231] [INFO ] [MAIN ] BKT: Full history saved. [2025-09-29T17:36:22.046391] [INFO ] [MAIN ] Update Progress: 293/2371 symbols completed. BKT took 22.9s. Estimated remaining: 4h 17m 35s. Rate: 8.1 symbols/min [2025-09-29T17:36:22.237794] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:36:22.274035] [DEBUG] [LOCAL ] BLD: Loaded 28408 existing records from primary storage. [2025-09-29T17:36:22.274329] [INFO ] [MAIN ] BLD: Loaded 28408 existing records. [2025-09-29T17:36:22.492919] [WARN ] [MAIN ] BLD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:36:22.493350] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-09-29T17:36:22.493434] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-09-29T17:36:22.502111] [DEBUG] [LOCAL ] BLD: Deleted primary data file. [2025-09-29T17:36:22.512851] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-09-29T17:36:22.578814] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-29T17:36:22.753235] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-01. [2025-09-29T17:36:22.927568] [INFO ] [REMOTE ] BLD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:36:23.455904] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-29T17:36:23.548140] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-09-29T17:36:24.248754] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-29T17:36:24.348131] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-09-29T17:36:25.148125] [INFO ] [REMOTE ] BLD: Fetching primary data for 2024-12. [2025-09-29T17:36:25.207802] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-29T17:36:25.216453] [INFO ] [REMOTE ] BKU: Full fetch complete (59775 records). [2025-09-29T17:36:25.216700] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-09-29T17:36:25.640493] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-09-29T17:36:25.640611] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-09-29T17:36:25.641357] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-09-29T17:36:25.641495] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-09-29T17:36:25.643059] [DEBUG] [LOCAL ] BKU: Trimmed 59775 records to 41557 (keeping 200 days of data) [2025-09-29T17:36:25.774512] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-29T17:36:25.947732] [DEBUG] [LOCAL ] BKU: Primary data saved (41557 records). [2025-09-29T17:36:25.947900] [INFO ] [MAIN ] BKU: Full history saved. [2025-09-29T17:36:25.948074] [INFO ] [MAIN ] Update Progress: 294/2371 symbols completed. BKU took 24.5s. Estimated remaining: 4h 17m 2s. Rate: 8.1 symbols/min [2025-09-29T17:36:25.948205] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-09-29T17:36:26.129924] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:36:26.185876] [DEBUG] [LOCAL ] BLDR: Loaded 52403 existing records from primary storage. [2025-09-29T17:36:26.186200] [INFO ] [MAIN ] BLDR: Loaded 52403 existing records. [2025-09-29T17:36:26.381759] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:36:26.382075] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-09-29T17:36:26.382188] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-09-29T17:36:26.383393] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-09-29T17:36:26.383457] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-09-29T17:36:26.716929] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-29T17:36:26.748712] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-09-29T17:36:26.843113] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:36:27.453283] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-29T17:36:27.548120] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-09-29T17:36:27.920357] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-29T17:36:28.348128] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-09-29T17:36:29.062677] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-29T17:36:29.148129] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-09-29T17:36:29.781910] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-29T17:36:29.948113] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-09-29T17:36:30.605125] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-29T17:36:30.748112] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2024-12. [2025-09-29T17:36:31.390306] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-29T17:36:31.548112] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-09-29T17:36:32.348082] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-09-29T17:36:32.633012] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-29T17:36:32.679946] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-29T17:36:33.148163] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-09-29T17:36:33.767893] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-29T17:36:33.948112] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-01. [2025-09-29T17:36:34.299711] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-29T17:36:34.748163] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-01. [2025-09-29T17:36:35.548120] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-09-29T17:36:35.745248] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-29T17:36:36.047871] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-29T17:36:36.348160] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-09-29T17:36:36.510626] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-29T17:36:36.516845] [INFO ] [REMOTE ] BKV: Full fetch complete (44990 records). [2025-09-29T17:36:36.517009] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-09-29T17:36:36.909097] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-09-29T17:36:36.909212] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-09-29T17:36:36.909845] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-09-29T17:36:36.909912] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-09-29T17:36:36.911067] [DEBUG] [LOCAL ] BKV: Trimmed 44990 records to 29665 (keeping 200 days of data) [2025-09-29T17:36:37.102040] [DEBUG] [LOCAL ] BKV: Primary data saved (29665 records). [2025-09-29T17:36:37.102222] [INFO ] [MAIN ] BKV: Full history saved. [2025-09-29T17:36:37.102326] [INFO ] [MAIN ] Update Progress: 295/2371 symbols completed. BKV took 35.3s. Estimated remaining: 4h 17m 21s. Rate: 8.1 symbols/min [2025-09-29T17:36:37.158908] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-09-29T17:36:37.284958] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:36:37.303782] [DEBUG] [LOCAL ] BLE: Loaded 14718 existing records from primary storage. [2025-09-29T17:36:37.304089] [INFO ] [MAIN ] BLE: Loaded 14718 existing records. [2025-09-29T17:36:37.486294] [WARN ] [MAIN ] BLE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:36:37.486497] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-09-29T17:36:37.486546] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-09-29T17:36:37.487018] [DEBUG] [LOCAL ] BLE: Deleted primary data file. [2025-09-29T17:36:37.487080] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-09-29T17:36:37.862944] [INFO ] [REMOTE ] BLE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:36:37.948119] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-09-29T17:36:38.048370] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-29T17:36:38.559359] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-29T17:36:38.748127] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-09-29T17:36:39.374932] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-29T17:36:39.548127] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-09-29T17:36:39.641711] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-29T17:36:40.348125] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-09-29T17:36:40.796353] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-29T17:36:41.148116] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-09-29T17:36:41.697809] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-29T17:36:41.948177] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-09-29T17:36:42.753207] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-09-29T17:36:42.763974] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-29T17:36:42.771920] [INFO ] [REMOTE ] BLCO: Full fetch complete (52733 records). [2025-09-29T17:36:42.772113] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-09-29T17:36:43.187995] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-09-29T17:36:43.188086] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-09-29T17:36:43.188768] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-09-29T17:36:43.188834] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-09-29T17:36:43.190172] [DEBUG] [LOCAL ] BLCO: Trimmed 52733 records to 35418 (keeping 200 days of data) [2025-09-29T17:36:43.413896] [DEBUG] [LOCAL ] BLCO: Primary data saved (35418 records). [2025-09-29T17:36:43.414055] [INFO ] [MAIN ] BLCO: Full history saved. [2025-09-29T17:36:43.414220] [INFO ] [MAIN ] Update Progress: 296/2371 symbols completed. BLCO took 24.2s. Estimated remaining: 4h 17m 6s. Rate: 8.1 symbols/min [2025-09-29T17:36:43.548773] [INFO ] [REMOTE ] BLE: Fetching primary data for 2024-12. [2025-09-29T17:36:43.608582] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:36:43.649452] [DEBUG] [LOCAL ] BLK: Loaded 35240 existing records from primary storage. [2025-09-29T17:36:43.649848] [INFO ] [MAIN ] BLK: Loaded 35240 existing records. [2025-09-29T17:36:43.844230] [WARN ] [MAIN ] BLK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:36:43.844770] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-09-29T17:36:43.844894] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-09-29T17:36:43.845587] [DEBUG] [LOCAL ] BLK: Deleted primary data file. [2025-09-29T17:36:43.845687] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-09-29T17:36:44.016279] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-29T17:36:44.279264] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-29T17:36:44.353252] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-09-29T17:36:44.377686] [INFO ] [REMOTE ] BLK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:36:44.758404] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-29T17:36:45.148165] [INFO ] [REMOTE ] BLK: Fetching primary data for 2024-12. [2025-09-29T17:36:45.924075] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-29T17:36:45.948075] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-09-29T17:36:46.748141] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-09-29T17:36:46.921882] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-29T17:36:47.548168] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-01. [2025-09-29T17:36:47.771216] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-29T17:36:48.018095] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-29T17:36:48.348101] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-09-29T17:36:48.986718] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-29T17:36:49.148176] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-01. [2025-09-29T17:36:49.658301] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-29T17:36:49.948109] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-09-29T17:36:50.010124] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-29T17:36:50.748148] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-09-29T17:36:51.448637] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-29T17:36:51.548136] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-09-29T17:36:51.735011] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-29T17:36:52.348165] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-09-29T17:36:52.883379] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-29T17:36:53.148098] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-09-29T17:36:53.948101] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-09-29T17:36:54.136268] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-29T17:36:54.395207] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-29T17:36:54.401268] [INFO ] [REMOTE ] BLD: Full fetch complete (40371 records). [2025-09-29T17:36:54.401389] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-09-29T17:36:54.757205] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-09-29T17:36:54.811229] [DEBUG] [VALIDATOR ] BLD: All expected trading days are present. [2025-09-29T17:36:54.811317] [DEBUG] [VALIDATOR ] BLD: Primary data validation passed. [2025-09-29T17:36:54.811923] [INFO ] [MAIN ] BLD: Fetched primary data is valid. [2025-09-29T17:36:54.812020] [DEBUG] [LOCAL ] BLD: Saving primary data. [2025-09-29T17:36:54.813217] [DEBUG] [LOCAL ] BLD: Trimmed 40371 records to 27802 (keeping 200 days of data) [2025-09-29T17:36:54.998575] [DEBUG] [LOCAL ] BLD: Primary data saved (27802 records). [2025-09-29T17:36:54.998772] [INFO ] [MAIN ] BLD: Full history saved. [2025-09-29T17:36:54.998885] [INFO ] [MAIN ] Update Progress: 297/2371 symbols completed. BLD took 33.0s. Estimated remaining: 4h 17m 27s. Rate: 8.1 symbols/min [2025-09-29T17:36:55.181060] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:36:55.231839] [DEBUG] [LOCAL ] BLND: Loaded 50107 existing records from primary storage. [2025-09-29T17:36:55.232160] [INFO ] [MAIN ] BLND: Loaded 50107 existing records. [2025-09-29T17:36:55.429940] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:36:55.430194] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-09-29T17:36:55.430245] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-09-29T17:36:55.430859] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-09-29T17:36:55.430925] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-09-29T17:36:55.553087] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-09-29T17:36:55.832781] [INFO ] [REMOTE ] BLND: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:36:55.856934] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-29T17:36:56.348098] [INFO ] [REMOTE ] BLND: Fetching primary data for 2024-12. [2025-09-29T17:36:56.529089] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-29T17:36:56.790627] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-29T17:36:57.148106] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-09-29T17:36:57.948124] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-09-29T17:36:58.282708] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-29T17:36:58.748145] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-09-29T17:36:59.215531] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-29T17:36:59.226613] [INFO ] [REMOTE ] BLDR: Full fetch complete (74390 records). [2025-09-29T17:36:59.226811] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-09-29T17:36:59.548235] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-01. [2025-09-29T17:36:59.672417] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-09-29T17:36:59.672706] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-09-29T17:36:59.673921] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-09-29T17:36:59.674045] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-09-29T17:36:59.700718] [DEBUG] [LOCAL ] BLDR: Trimmed 74390 records to 51635 (keeping 200 days of data) [2025-09-29T17:36:59.702448] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-29T17:36:59.840036] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-29T17:37:00.083420] [DEBUG] [LOCAL ] BLDR: Primary data saved (51635 records). [2025-09-29T17:37:00.083584] [INFO ] [MAIN ] BLDR: Full history saved. [2025-09-29T17:37:00.083711] [INFO ] [MAIN ] Update Progress: 298/2371 symbols completed. BLDR took 34.1s. Estimated remaining: 4h 17m 3s. Rate: 8.1 symbols/min [2025-09-29T17:37:00.279461] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:37:00.279701] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-09-29T17:37:00.279762] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-09-29T17:37:00.279900] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-09-29T17:37:00.279946] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-09-29T17:37:00.280002] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-09-29T17:37:00.280040] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-09-29T17:37:00.353303] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-09-29T17:37:00.668565] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:37:01.155800] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2024-12. [2025-09-29T17:37:01.175960] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-29T17:37:01.314055] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-29T17:37:01.393479] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T17:37:01.393855] [WARN ] [REMOTE ] BLSH: No data returned for month 2024-12 [2025-09-29T17:37:01.393955] [FATAL] [REMOTE ] BLSH: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T17:37:01.394007] [FATAL] [MAIN ] BLSH: Failed to fetch primary data. [2025-09-29T17:37:01.394077] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T17:37:01.394156] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-09-29T17:37:01.394221] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-09-29T17:37:01.394257] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-09-29T17:37:01.394311] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-09-29T17:37:01.394400] [INFO ] [MAIN ] Update Progress: 299/2371 symbols completed. BLSH took 1.3s. Estimated remaining: 4h 16m 13s. Rate: 8.1 symbols/min [2025-09-29T17:37:01.589902] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:37:01.605503] [DEBUG] [LOCAL ] BLW: Loaded 13044 existing records from primary storage. [2025-09-29T17:37:01.605807] [INFO ] [MAIN ] BLW: Loaded 13044 existing records. [2025-09-29T17:37:01.797181] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:37:01.797427] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-09-29T17:37:01.797483] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-09-29T17:37:01.797767] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-09-29T17:37:01.797827] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-09-29T17:37:01.957705] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-09-29T17:37:02.191916] [INFO ] [REMOTE ] BLW: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:37:02.748130] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-09-29T17:37:03.548121] [INFO ] [REMOTE ] BLW: Fetching primary data for 2024-12. [2025-09-29T17:37:03.615387] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-29T17:37:03.652437] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-29T17:37:04.348086] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-09-29T17:37:04.582742] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-29T17:37:05.148109] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-01. [2025-09-29T17:37:05.198792] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-29T17:37:05.948117] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-09-29T17:37:05.984307] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-29T17:37:06.748139] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-09-29T17:37:07.548124] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-09-29T17:37:07.630625] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-29T17:37:07.656772] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-29T17:37:08.173560] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-29T17:37:08.348094] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-09-29T17:37:09.148120] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-09-29T17:37:09.948118] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-09-29T17:37:10.114773] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-29T17:37:10.121381] [INFO ] [REMOTE ] BLE: Full fetch complete (20476 records). [2025-09-29T17:37:10.121555] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-09-29T17:37:10.473121] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-29T17:37:10.554821] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-09-29T17:37:10.554950] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-09-29T17:37:10.555335] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-09-29T17:37:10.555379] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-09-29T17:37:10.556015] [DEBUG] [LOCAL ] BLE: Trimmed 20476 records to 14424 (keeping 200 days of data) [2025-09-29T17:37:10.644442] [DEBUG] [LOCAL ] BLE: Primary data saved (14424 records). [2025-09-29T17:37:10.644591] [INFO ] [MAIN ] BLE: Full history saved. [2025-09-29T17:37:10.644700] [INFO ] [MAIN ] Update Progress: 300/2371 symbols completed. BLE took 33.5s. Estimated remaining: 4h 16m 19s. Rate: 8.1 symbols/min [2025-09-29T17:37:10.749986] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-09-29T17:37:10.824817] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:37:10.843566] [DEBUG] [LOCAL ] BLX: Loaded 15880 existing records from primary storage. [2025-09-29T17:37:10.843890] [INFO ] [MAIN ] BLX: Loaded 15880 existing records. [2025-09-29T17:37:11.042897] [WARN ] [MAIN ] BLX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:37:11.052549] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-09-29T17:37:11.052708] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-09-29T17:37:11.053829] [DEBUG] [LOCAL ] BLX: Deleted primary data file. [2025-09-29T17:37:11.053765] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-29T17:37:11.053953] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-09-29T17:37:11.422527] [INFO ] [REMOTE ] BLX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:37:11.548115] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-09-29T17:37:12.348090] [INFO ] [REMOTE ] BLX: Fetching primary data for 2024-12. [2025-09-29T17:37:12.808158] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-29T17:37:13.148121] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-09-29T17:37:13.388740] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-29T17:37:13.414377] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-29T17:37:13.948123] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-09-29T17:37:14.748085] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-09-29T17:37:14.814401] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-29T17:37:14.935664] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-29T17:37:15.548107] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-09-29T17:37:16.327521] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-29T17:37:16.348066] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-09-29T17:37:16.434801] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-29T17:37:17.148083] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-09-29T17:37:17.518973] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-29T17:37:17.948056] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-09-29T17:37:18.127156] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-29T17:37:18.748193] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-09-29T17:37:19.548121] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-09-29T17:37:19.585527] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-29T17:37:19.687390] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-29T17:37:20.348116] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-09-29T17:37:20.684221] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-29T17:37:21.148133] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-09-29T17:37:21.948161] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-09-29T17:37:22.042633] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-29T17:37:22.209096] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-29T17:37:22.748334] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-09-29T17:37:22.928792] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-29T17:37:23.548130] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-09-29T17:37:24.340782] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-29T17:37:24.350123] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-09-29T17:37:24.837357] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-29T17:37:25.148112] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-09-29T17:37:25.328419] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-29T17:37:25.948125] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-09-29T17:37:26.748151] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-09-29T17:37:26.957508] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-29T17:37:27.231293] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-29T17:37:27.238474] [INFO ] [REMOTE ] BLK: Full fetch complete (52747 records). [2025-09-29T17:37:27.238606] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-09-29T17:37:27.553367] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-09-29T17:37:27.680096] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-09-29T17:37:27.680207] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-09-29T17:37:27.680985] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-09-29T17:37:27.681078] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-09-29T17:37:27.690588] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-29T17:37:27.694697] [DEBUG] [LOCAL ] BLK: Trimmed 52747 records to 34520 (keeping 200 days of data) [2025-09-29T17:37:27.925167] [DEBUG] [LOCAL ] BLK: Primary data saved (34520 records). [2025-09-29T17:37:27.925315] [INFO ] [MAIN ] BLK: Full history saved. [2025-09-29T17:37:27.925403] [INFO ] [MAIN ] Update Progress: 301/2371 symbols completed. BLK took 44.5s. Estimated remaining: 4h 17m 19s. Rate: 8.0 symbols/min [2025-09-29T17:37:28.116801] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:37:28.155207] [DEBUG] [LOCAL ] BMA: Loaded 35645 existing records from primary storage. [2025-09-29T17:37:28.155510] [INFO ] [MAIN ] BMA: Loaded 35645 existing records. [2025-09-29T17:37:28.333862] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:37:28.334098] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-09-29T17:37:28.334157] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-09-29T17:37:28.334553] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-09-29T17:37:28.334611] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-09-29T17:37:28.355180] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-09-29T17:37:28.716608] [INFO ] [REMOTE ] BMA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:37:29.148134] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-09-29T17:37:29.602629] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-29T17:37:29.602298] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-29T17:37:29.619737] [INFO ] [REMOTE ] BLND: Full fetch complete (72260 records). [2025-09-29T17:37:29.619925] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-09-29T17:37:29.893573] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-29T17:37:29.953294] [INFO ] [REMOTE ] BMA: Fetching primary data for 2024-12. [2025-09-29T17:37:30.079841] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-09-29T17:37:30.079936] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-09-29T17:37:30.080828] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-09-29T17:37:30.080895] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-09-29T17:37:30.082508] [DEBUG] [LOCAL ] BLND: Trimmed 72260 records to 49330 (keeping 200 days of data) [2025-09-29T17:37:30.385225] [DEBUG] [LOCAL ] BLND: Primary data saved (49330 records). [2025-09-29T17:37:30.385359] [INFO ] [MAIN ] BLND: Full history saved. [2025-09-29T17:37:30.385459] [INFO ] [MAIN ] Update Progress: 302/2371 symbols completed. BLND took 35.4s. Estimated remaining: 4h 16m 37s. Rate: 8.1 symbols/min [2025-09-29T17:37:30.571259] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:37:30.584341] [DEBUG] [LOCAL ] BME: Loaded 10968 existing records from primary storage. [2025-09-29T17:37:30.584603] [INFO ] [MAIN ] BME: Loaded 10968 existing records. [2025-09-29T17:37:30.752147] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-09-29T17:37:30.776035] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:37:30.777216] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-09-29T17:37:30.777273] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-09-29T17:37:30.777741] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-09-29T17:37:30.777804] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-09-29T17:37:31.218486] [INFO ] [REMOTE ] BME: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:37:31.505033] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-29T17:37:31.548093] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-01. [2025-09-29T17:37:31.777826] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-29T17:37:32.348115] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-09-29T17:37:33.064916] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-29T17:37:33.090849] [INFO ] [REMOTE ] BLW: Full fetch complete (19015 records). [2025-09-29T17:37:33.091012] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-09-29T17:37:33.099259] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-29T17:37:33.153183] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-09-29T17:37:33.484922] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-09-29T17:37:33.485006] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-09-29T17:37:33.485343] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-09-29T17:37:33.485387] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-09-29T17:37:33.486033] [DEBUG] [LOCAL ] BLW: Trimmed 19015 records to 12943 (keeping 200 days of data) [2025-09-29T17:37:33.567619] [DEBUG] [LOCAL ] BLW: Primary data saved (12943 records). [2025-09-29T17:37:33.567791] [INFO ] [MAIN ] BLW: Full history saved. [2025-09-29T17:37:33.567894] [INFO ] [MAIN ] Update Progress: 303/2371 symbols completed. BLW took 32.2s. Estimated remaining: 4h 16m 1s. Rate: 8.1 symbols/min [2025-09-29T17:37:33.747713] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:37:33.775216] [DEBUG] [LOCAL ] BMEZ: Loaded 26421 existing records from primary storage. [2025-09-29T17:37:33.775530] [INFO ] [MAIN ] BMEZ: Loaded 26421 existing records. [2025-09-29T17:37:33.960791] [INFO ] [REMOTE ] BME: Fetching primary data for 2024-12. [2025-09-29T17:37:33.967729] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:37:33.969009] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-09-29T17:37:33.969069] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-09-29T17:37:33.969426] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-09-29T17:37:33.969485] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-09-29T17:37:34.368774] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-29T17:37:34.382365] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:37:34.388210] [INFO ] [REMOTE ] BLX: Full fetch complete (22707 records). [2025-09-29T17:37:34.388633] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-09-29T17:37:34.753338] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2024-12. [2025-09-29T17:37:34.792246] [DEBUG] [VALIDATOR ] BLX: All expected trading days are present. [2025-09-29T17:37:34.792344] [DEBUG] [VALIDATOR ] BLX: Primary data validation passed. [2025-09-29T17:37:34.792843] [INFO ] [MAIN ] BLX: Fetched primary data is valid. [2025-09-29T17:37:34.792961] [DEBUG] [LOCAL ] BLX: Saving primary data. [2025-09-29T17:37:34.793967] [DEBUG] [LOCAL ] BLX: Trimmed 22707 records to 15569 (keeping 200 days of data) [2025-09-29T17:37:34.897282] [DEBUG] [LOCAL ] BLX: Primary data saved (15569 records). [2025-09-29T17:37:34.897494] [INFO ] [MAIN ] BLX: Full history saved. [2025-09-29T17:37:34.897631] [INFO ] [MAIN ] Update Progress: 304/2371 symbols completed. BLX took 24.3s. Estimated remaining: 4h 15m 12s. Rate: 8.1 symbols/min [2025-09-29T17:37:35.075258] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:37:35.106394] [DEBUG] [LOCAL ] BMI: Loaded 24611 existing records from primary storage. [2025-09-29T17:37:35.106694] [INFO ] [MAIN ] BMI: Loaded 24611 existing records. [2025-09-29T17:37:35.235606] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-29T17:37:35.308697] [WARN ] [MAIN ] BMI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:37:35.308920] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-09-29T17:37:35.308973] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-09-29T17:37:35.309412] [DEBUG] [LOCAL ] BMI: Deleted primary data file. [2025-09-29T17:37:35.309473] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-09-29T17:37:35.556288] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-09-29T17:37:35.694133] [INFO ] [REMOTE ] BMI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:37:36.353429] [INFO ] [REMOTE ] BMI: Fetching primary data for 2024-12. [2025-09-29T17:37:36.358864] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-29T17:37:36.971795] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-29T17:37:37.148169] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-01. [2025-09-29T17:37:37.380707] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-29T17:37:37.948194] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-09-29T17:37:38.366254] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-29T17:37:38.748170] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-01. [2025-09-29T17:37:39.210960] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-29T17:37:39.548107] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-09-29T17:37:39.708332] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-29T17:37:40.348143] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-09-29T17:37:40.971399] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-29T17:37:41.091912] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-29T17:37:41.148131] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-09-29T17:37:41.948120] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-09-29T17:37:42.684383] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-29T17:37:42.748079] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-09-29T17:37:43.076770] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-29T17:37:43.548122] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-09-29T17:37:43.714572] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-29T17:37:44.348142] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-01. [2025-09-29T17:37:44.818750] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-29T17:37:45.148106] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-09-29T17:37:45.171832] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-29T17:37:45.948119] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-09-29T17:37:46.526550] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-29T17:37:46.748158] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-09-29T17:37:47.120830] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-29T17:37:47.548093] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-09-29T17:37:47.675119] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-29T17:37:48.348098] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-09-29T17:37:48.605354] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-29T17:37:49.148137] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-09-29T17:37:49.520517] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-29T17:37:49.948127] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-09-29T17:37:50.076854] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-29T17:37:50.485443] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-29T17:37:50.748153] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-09-29T17:37:51.548149] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-09-29T17:37:51.587984] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-29T17:37:52.348140] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-09-29T17:37:52.976236] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-29T17:37:53.148135] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-09-29T17:37:53.697251] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-29T17:37:53.948148] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-09-29T17:37:54.748134] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-09-29T17:37:54.804327] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-29T17:37:54.814587] [INFO ] [REMOTE ] BMA: Full fetch complete (51331 records). [2025-09-29T17:37:54.814824] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-09-29T17:37:55.236618] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-09-29T17:37:55.236836] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-09-29T17:37:55.237621] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-09-29T17:37:55.237886] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-09-29T17:37:55.246110] [DEBUG] [LOCAL ] BMA: Trimmed 51331 records to 35091 (keeping 200 days of data) [2025-09-29T17:37:55.259458] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-29T17:37:55.468757] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-29T17:37:55.498911] [DEBUG] [LOCAL ] BMA: Primary data saved (35091 records). [2025-09-29T17:37:55.499066] [INFO ] [MAIN ] BMA: Full history saved. [2025-09-29T17:37:55.499179] [INFO ] [MAIN ] Update Progress: 305/2371 symbols completed. BMA took 27.6s. Estimated remaining: 4h 16m 34s. Rate: 8.1 symbols/min [2025-09-29T17:37:55.554142] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-09-29T17:37:55.682247] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:37:55.687212] [DEBUG] [LOCAL ] BMN: Loaded 2548 existing records from primary storage. [2025-09-29T17:37:55.687457] [INFO ] [MAIN ] BMN: Loaded 2548 existing records. [2025-09-29T17:37:55.879036] [WARN ] [MAIN ] BMN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:37:55.879309] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-09-29T17:37:55.879372] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-09-29T17:37:55.879967] [DEBUG] [LOCAL ] BMN: Deleted primary data file. [2025-09-29T17:37:55.880035] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-09-29T17:37:56.264158] [INFO ] [REMOTE ] BMN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:37:56.348085] [INFO ] [REMOTE ] BMN: Fetching primary data for 2024-12. [2025-09-29T17:37:56.419415] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-29T17:37:56.931034] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-29T17:37:57.148124] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-01. [2025-09-29T17:37:57.623531] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-29T17:37:57.948127] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-09-29T17:37:58.390374] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-29T17:37:58.748110] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-09-29T17:37:59.548115] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-09-29T17:37:59.792769] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-29T17:38:00.348130] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-09-29T17:38:00.571628] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-29T17:38:01.148148] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-09-29T17:38:01.645476] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-29T17:38:01.648455] [INFO ] [REMOTE ] BME: Full fetch complete (16046 records). [2025-09-29T17:38:01.648558] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-09-29T17:38:01.739793] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-29T17:38:01.953423] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-09-29T17:38:02.055391] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-09-29T17:38:02.055567] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-09-29T17:38:02.055961] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-09-29T17:38:02.056025] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-09-29T17:38:02.056577] [DEBUG] [LOCAL ] BME: Trimmed 16046 records to 10831 (keeping 200 days of data) [2025-09-29T17:38:02.130177] [DEBUG] [LOCAL ] BME: Primary data saved (10831 records). [2025-09-29T17:38:02.130327] [INFO ] [MAIN ] BME: Full history saved. [2025-09-29T17:38:02.130432] [INFO ] [MAIN ] Update Progress: 306/2371 symbols completed. BME took 31.7s. Estimated remaining: 4h 16m 21s. Rate: 8.1 symbols/min [2025-09-29T17:38:02.320758] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:38:02.368756] [DEBUG] [LOCAL ] BMO: Loaded 41940 existing records from primary storage. [2025-09-29T17:38:02.369141] [INFO ] [MAIN ] BMO: Loaded 41940 existing records. [2025-09-29T17:38:02.588240] [WARN ] [MAIN ] BMO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:38:02.588463] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-09-29T17:38:02.588534] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-09-29T17:38:02.589017] [DEBUG] [LOCAL ] BMO: Deleted primary data file. [2025-09-29T17:38:02.589094] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-09-29T17:38:02.753248] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-09-29T17:38:03.007787] [INFO ] [REMOTE ] BMO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:38:03.358805] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-29T17:38:03.419800] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-29T17:38:03.548136] [INFO ] [REMOTE ] BMO: Fetching primary data for 2024-12. [2025-09-29T17:38:04.348124] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-09-29T17:38:05.148124] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-09-29T17:38:05.440306] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-29T17:38:05.647387] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-29T17:38:05.674370] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-29T17:38:05.948109] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-09-29T17:38:06.396353] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-29T17:38:06.748117] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-09-29T17:38:07.548119] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-09-29T17:38:08.201842] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-29T17:38:08.348108] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-09-29T17:38:08.619523] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-29T17:38:08.932372] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-29T17:38:09.148132] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-09-29T17:38:09.948084] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-09-29T17:38:10.344473] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-29T17:38:10.418351] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-29T17:38:10.748149] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-09-29T17:38:11.548120] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-01. [2025-09-29T17:38:12.082315] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-29T17:38:12.088154] [INFO ] [REMOTE ] BMEZ: Full fetch complete (40871 records). [2025-09-29T17:38:12.088255] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-09-29T17:38:12.353203] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-09-29T17:38:12.487640] [DEBUG] [VALIDATOR ] BMEZ: All expected trading days are present. [2025-09-29T17:38:12.487757] [DEBUG] [VALIDATOR ] BMEZ: Primary data validation passed. [2025-09-29T17:38:12.488330] [INFO ] [MAIN ] BMEZ: Fetched primary data is valid. [2025-09-29T17:38:12.488395] [DEBUG] [LOCAL ] BMEZ: Saving primary data. [2025-09-29T17:38:12.489422] [DEBUG] [LOCAL ] BMEZ: Trimmed 40871 records to 26001 (keeping 200 days of data) [2025-09-29T17:38:12.656573] [DEBUG] [LOCAL ] BMEZ: Primary data saved (26001 records). [2025-09-29T17:38:12.656734] [INFO ] [MAIN ] BMEZ: Full history saved. [2025-09-29T17:38:12.656840] [INFO ] [MAIN ] Update Progress: 307/2371 symbols completed. BMEZ took 39.1s. Estimated remaining: 4h 16m 34s. Rate: 8.0 symbols/min [2025-09-29T17:38:12.844342] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:38:12.912315] [DEBUG] [LOCAL ] BMY: Loaded 54537 existing records from primary storage. [2025-09-29T17:38:12.912692] [INFO ] [MAIN ] BMY: Loaded 54537 existing records. [2025-09-29T17:38:13.072714] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-29T17:38:13.137309] [WARN ] [MAIN ] BMY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:38:13.137544] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-09-29T17:38:13.137594] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-09-29T17:38:13.138323] [DEBUG] [LOCAL ] BMY: Deleted primary data file. [2025-09-29T17:38:13.138384] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-09-29T17:38:13.153197] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-09-29T17:38:13.512601] [INFO ] [REMOTE ] BMY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:38:13.717671] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-29T17:38:13.718913] [INFO ] [REMOTE ] BMN: Full fetch complete (3753 records). [2025-09-29T17:38:13.718989] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-09-29T17:38:13.953182] [INFO ] [REMOTE ] BMY: Fetching primary data for 2024-12. [2025-09-29T17:38:14.092923] [DEBUG] [VALIDATOR ] BMN: All expected trading days are present. [2025-09-29T17:38:14.093067] [DEBUG] [VALIDATOR ] BMN: Primary data validation passed. [2025-09-29T17:38:14.093202] [INFO ] [MAIN ] BMN: Fetched primary data is valid. [2025-09-29T17:38:14.093245] [DEBUG] [LOCAL ] BMN: Saving primary data. [2025-09-29T17:38:14.093605] [DEBUG] [LOCAL ] BMN: Trimmed 3753 records to 2561 (keeping 200 days of data) [2025-09-29T17:38:14.110082] [DEBUG] [LOCAL ] BMN: Primary data saved (2561 records). [2025-09-29T17:38:14.110167] [INFO ] [MAIN ] BMN: Full history saved. [2025-09-29T17:38:14.110255] [INFO ] [MAIN ] Update Progress: 308/2371 symbols completed. BMN took 18.6s. Estimated remaining: 4h 15m 46s. Rate: 8.1 symbols/min [2025-09-29T17:38:14.289175] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:38:14.353149] [DEBUG] [LOCAL ] BN: Loaded 53774 existing records from primary storage. [2025-09-29T17:38:14.353589] [INFO ] [MAIN ] BN: Loaded 53774 existing records. [2025-09-29T17:38:14.598825] [WARN ] [MAIN ] BN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:38:14.599162] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-09-29T17:38:14.599223] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-09-29T17:38:14.600518] [DEBUG] [LOCAL ] BN: Deleted primary data file. [2025-09-29T17:38:14.600594] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-09-29T17:38:14.748344] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-09-29T17:38:15.034692] [INFO ] [REMOTE ] BN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:38:15.054848] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-29T17:38:15.063833] [INFO ] [REMOTE ] BMI: Full fetch complete (33020 records). [2025-09-29T17:38:15.063960] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-09-29T17:38:15.465098] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-09-29T17:38:15.465182] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-09-29T17:38:15.465686] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-09-29T17:38:15.465750] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-09-29T17:38:15.468000] [DEBUG] [LOCAL ] BMI: Trimmed 33020 records to 24272 (keeping 200 days of data) [2025-09-29T17:38:15.569113] [INFO ] [REMOTE ] BN: Fetching primary data for 2024-12. [2025-09-29T17:38:15.637695] [DEBUG] [LOCAL ] BMI: Primary data saved (24272 records). [2025-09-29T17:38:15.637836] [INFO ] [MAIN ] BMI: Full history saved. [2025-09-29T17:38:15.637933] [INFO ] [MAIN ] Update Progress: 309/2371 symbols completed. BMI took 40.7s. Estimated remaining: 4h 14m 60s. Rate: 8.1 symbols/min [2025-09-29T17:38:15.827755] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:38:15.862534] [DEBUG] [LOCAL ] BNED: Loaded 30226 existing records from primary storage. [2025-09-29T17:38:15.862939] [INFO ] [MAIN ] BNED: Loaded 30226 existing records. [2025-09-29T17:38:16.060813] [WARN ] [MAIN ] BNED: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:38:16.061182] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-09-29T17:38:16.061312] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-09-29T17:38:16.061773] [DEBUG] [LOCAL ] BNED: Deleted primary data file. [2025-09-29T17:38:16.061905] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-09-29T17:38:16.259076] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-09-29T17:38:16.358391] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-01. [2025-09-29T17:38:16.533865] [INFO ] [REMOTE ] BNED: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:38:16.525434] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-29T17:38:17.148107] [INFO ] [REMOTE ] BNED: Fetching primary data for 2024-12. [2025-09-29T17:38:17.446365] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-29T17:38:17.948101] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-01. [2025-09-29T17:38:18.351918] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-29T17:38:18.748283] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-09-29T17:38:18.748209] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-29T17:38:19.548124] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-09-29T17:38:19.634068] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-29T17:38:20.353217] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-01. [2025-09-29T17:38:20.369067] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-29T17:38:21.148115] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-09-29T17:38:21.477115] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-29T17:38:21.669060] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-29T17:38:21.948114] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-09-29T17:38:22.695495] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-29T17:38:22.748151] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-09-29T17:38:23.548140] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-09-29T17:38:23.989974] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-29T17:38:24.348152] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-09-29T17:38:24.612246] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-29T17:38:24.817690] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-29T17:38:25.148141] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-09-29T17:38:25.948152] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-09-29T17:38:26.244139] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-29T17:38:26.664191] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-29T17:38:26.748147] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-09-29T17:38:27.548130] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-09-29T17:38:27.657599] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-29T17:38:28.124558] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-29T17:38:28.348107] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-09-29T17:38:29.148209] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-09-29T17:38:29.775923] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-29T17:38:29.948193] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-09-29T17:38:30.301373] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-29T17:38:30.681849] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-29T17:38:30.748100] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-09-29T17:38:31.548159] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-09-29T17:38:31.777045] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-29T17:38:32.050273] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-29T17:38:32.348127] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-09-29T17:38:32.599853] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-29T17:38:33.148150] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-09-29T17:38:33.948127] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-09-29T17:38:34.376712] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-29T17:38:34.495940] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-29T17:38:34.748128] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-09-29T17:38:35.409334] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-29T17:38:35.548124] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-09-29T17:38:36.122282] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-29T17:38:36.348138] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-09-29T17:38:37.148120] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-09-29T17:38:37.310381] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-29T17:38:37.668265] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-29T17:38:37.948129] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-09-29T17:38:38.748208] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-09-29T17:38:39.377013] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-29T17:38:39.444955] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-29T17:38:39.548095] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-09-29T17:38:39.986981] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-29T17:38:39.993006] [INFO ] [REMOTE ] BNED: Full fetch complete (43997 records). [2025-09-29T17:38:39.993152] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-09-29T17:38:40.351332] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-09-29T17:38:40.431202] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-09-29T17:38:40.431328] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-09-29T17:38:40.432007] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-09-29T17:38:40.432114] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-09-29T17:38:40.434412] [DEBUG] [LOCAL ] BNED: Trimmed 43997 records to 29579 (keeping 200 days of data) [2025-09-29T17:38:40.580912] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-29T17:38:40.606754] [INFO ] [REMOTE ] BMY: Full fetch complete (77795 records). [2025-09-29T17:38:40.609096] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-09-29T17:38:41.128916] [DEBUG] [LOCAL ] BNED: Primary data saved (29579 records). [2025-09-29T17:38:41.128811] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-09-29T17:38:41.129034] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-09-29T17:38:41.129143] [INFO ] [MAIN ] BNED: Full history saved. [2025-09-29T17:38:41.130118] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-09-29T17:38:41.130298] [INFO ] [MAIN ] Update Progress: 310/2371 symbols completed. BNED took 25.5s. Estimated remaining: 4h 16m 52s. Rate: 8.0 symbols/min [2025-09-29T17:38:41.130388] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-09-29T17:38:41.153634] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-09-29T17:38:41.233413] [DEBUG] [LOCAL ] BMY: Trimmed 77795 records to 53757 (keeping 200 days of data) [2025-09-29T17:38:41.430752] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:38:41.444002] [DEBUG] [LOCAL ] BNH: Loaded 4926 existing records from primary storage. [2025-09-29T17:38:41.444795] [INFO ] [MAIN ] BNH: Loaded 4926 existing records. [2025-09-29T17:38:41.667775] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:38:41.670511] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-09-29T17:38:41.671167] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-09-29T17:38:41.671864] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-09-29T17:38:41.672445] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-09-29T17:38:42.223128] [INFO ] [REMOTE ] BNH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:38:42.248467] [INFO ] [REMOTE ] BNH: Fetching primary data for 2024-12. [2025-09-29T17:38:42.253717] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-29T17:38:42.382438] [DEBUG] [LOCAL ] BMY: Primary data saved (53757 records). [2025-09-29T17:38:42.382598] [INFO ] [MAIN ] BMY: Full history saved. [2025-09-29T17:38:42.382712] [INFO ] [MAIN ] Update Progress: 311/2371 symbols completed. BMY took 29.7s. Estimated remaining: 4h 16m 4s. Rate: 8.0 symbols/min [2025-09-29T17:38:42.562018] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:38:42.566848] [DEBUG] [LOCAL ] BNJ: Loaded 2631 existing records from primary storage. [2025-09-29T17:38:42.567050] [INFO ] [MAIN ] BNJ: Loaded 2631 existing records. [2025-09-29T17:38:42.756703] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-09-29T17:38:42.764082] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:38:42.764516] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-09-29T17:38:42.765412] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-09-29T17:38:42.765695] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-09-29T17:38:42.765754] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-09-29T17:38:43.097154] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-29T17:38:43.176984] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:38:43.276314] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-29T17:38:43.548126] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-09-29T17:38:44.280876] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-29T17:38:44.290901] [INFO ] [REMOTE ] BMO: Full fetch complete (59692 records). [2025-09-29T17:38:44.291064] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-09-29T17:38:44.357324] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2024-12. [2025-09-29T17:38:44.727048] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present. [2025-09-29T17:38:44.727178] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed. [2025-09-29T17:38:44.727915] [INFO ] [MAIN ] BMO: Fetched primary data is valid. [2025-09-29T17:38:44.727981] [DEBUG] [LOCAL ] BMO: Saving primary data. [2025-09-29T17:38:44.729290] [DEBUG] [LOCAL ] BMO: Trimmed 59692 records to 41236 (keeping 200 days of data) [2025-09-29T17:38:45.003782] [DEBUG] [LOCAL ] BMO: Primary data saved (41236 records). [2025-09-29T17:38:45.003915] [INFO ] [MAIN ] BMO: Full history saved. [2025-09-29T17:38:45.003998] [INFO ] [MAIN ] Update Progress: 312/2371 symbols completed. BMO took 42.9s. Estimated remaining: 4h 15m 24s. Rate: 8.1 symbols/min [2025-09-29T17:38:45.155969] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-01. [2025-09-29T17:38:45.193437] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:38:45.248130] [DEBUG] [LOCAL ] BNL: Loaded 47577 existing records from primary storage. [2025-09-29T17:38:45.248693] [INFO ] [MAIN ] BNL: Loaded 47577 existing records. [2025-09-29T17:38:45.444725] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:38:45.450055] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-09-29T17:38:45.450426] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-29T17:38:45.478071] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-09-29T17:38:45.481508] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-09-29T17:38:45.482580] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-29T17:38:45.482733] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-09-29T17:38:45.885702] [INFO ] [REMOTE ] BNL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:38:45.919965] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-29T17:38:45.948084] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-09-29T17:38:46.748112] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-09-29T17:38:47.159636] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-29T17:38:47.548098] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-01. [2025-09-29T17:38:47.962099] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-29T17:38:47.973280] [INFO ] [REMOTE ] BN: Full fetch complete (76650 records). [2025-09-29T17:38:47.973451] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-09-29T17:38:48.066896] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-29T17:38:48.356586] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-09-29T17:38:48.414923] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-09-29T17:38:48.415084] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-09-29T17:38:48.416176] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-09-29T17:38:48.416247] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-09-29T17:38:48.418161] [DEBUG] [LOCAL ] BN: Trimmed 76650 records to 52993 (keeping 200 days of data) [2025-09-29T17:38:48.754455] [DEBUG] [LOCAL ] BN: Primary data saved (52993 records). [2025-09-29T17:38:48.754607] [INFO ] [MAIN ] BN: Full history saved. [2025-09-29T17:38:48.754718] [INFO ] [MAIN ] Update Progress: 313/2371 symbols completed. BN took 34.6s. Estimated remaining: 4h 14m 53s. Rate: 8.1 symbols/min [2025-09-29T17:38:48.933060] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:38:48.937162] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-29T17:38:48.993909] [DEBUG] [LOCAL ] BNS: Loaded 52212 existing records from primary storage. [2025-09-29T17:38:48.994285] [INFO ] [MAIN ] BNS: Loaded 52212 existing records. [2025-09-29T17:38:49.153302] [INFO ] [REMOTE ] BNL: Fetching primary data for 2024-12. [2025-09-29T17:38:49.200045] [WARN ] [MAIN ] BNS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:38:49.200525] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-09-29T17:38:49.200598] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-09-29T17:38:49.201400] [DEBUG] [LOCAL ] BNS: Deleted primary data file. [2025-09-29T17:38:49.201478] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-09-29T17:38:49.606634] [INFO ] [REMOTE ] BNS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:38:49.948115] [INFO ] [REMOTE ] BNS: Fetching primary data for 2024-12. [2025-09-29T17:38:50.753260] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-09-29T17:38:50.773828] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-29T17:38:51.332664] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-29T17:38:51.443437] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-29T17:38:51.548113] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-01. [2025-09-29T17:38:52.348109] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-09-29T17:38:52.893464] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-29T17:38:53.148102] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-09-29T17:38:53.223664] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-29T17:38:53.948111] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-09-29T17:38:54.748147] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-01. [2025-09-29T17:38:54.799610] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-29T17:38:55.217281] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-29T17:38:55.548127] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-09-29T17:38:56.138735] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-29T17:38:56.202163] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-29T17:38:56.348113] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-09-29T17:38:57.148119] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-09-29T17:38:57.717837] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-29T17:38:57.948094] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-09-29T17:38:57.998737] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-29T17:38:58.387305] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-29T17:38:58.748138] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-09-29T17:38:59.548110] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-09-29T17:39:00.248995] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-29T17:39:00.348114] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-09-29T17:39:01.148102] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-09-29T17:39:01.266334] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-29T17:39:01.542047] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-29T17:39:01.948116] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-09-29T17:39:02.104230] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-29T17:39:02.748125] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-09-29T17:39:03.061885] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-29T17:39:03.548073] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-09-29T17:39:03.744789] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-29T17:39:03.910130] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-29T17:39:04.348131] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-09-29T17:39:05.148123] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-09-29T17:39:05.948149] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-09-29T17:39:05.971283] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-29T17:39:06.015772] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-29T17:39:06.647726] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-29T17:39:06.649124] [INFO ] [REMOTE ] BNJ: Full fetch complete (4415 records). [2025-09-29T17:39:06.649204] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-09-29T17:39:06.753254] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-09-29T17:39:07.047243] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-09-29T17:39:07.047367] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-09-29T17:39:07.047550] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-09-29T17:39:07.047622] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-09-29T17:39:07.048076] [DEBUG] [LOCAL ] BNJ: Trimmed 4415 records to 2582 (keeping 200 days of data) [2025-09-29T17:39:07.064604] [DEBUG] [LOCAL ] BNJ: Primary data saved (2582 records). [2025-09-29T17:39:07.064729] [INFO ] [MAIN ] BNJ: Full history saved. [2025-09-29T17:39:07.064830] [INFO ] [MAIN ] Update Progress: 314/2371 symbols completed. BNJ took 24.7s. Estimated remaining: 4h 15m 56s. Rate: 8.0 symbols/min [2025-09-29T17:39:07.250300] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:39:07.256955] [DEBUG] [LOCAL ] BNT: Loaded 3473 existing records from primary storage. [2025-09-29T17:39:07.257147] [INFO ] [MAIN ] BNT: Loaded 3473 existing records. [2025-09-29T17:39:07.442777] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:39:07.443022] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-09-29T17:39:07.443072] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-09-29T17:39:07.443330] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-09-29T17:39:07.443390] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-09-29T17:39:07.549030] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-09-29T17:39:07.832677] [INFO ] [REMOTE ] BNT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:39:08.348107] [INFO ] [REMOTE ] BNT: Fetching primary data for 2024-12. [2025-09-29T17:39:08.563276] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-29T17:39:08.923515] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-29T17:39:09.148121] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-09-29T17:39:09.223577] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-29T17:39:09.948115] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-09-29T17:39:10.517689] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-29T17:39:10.748128] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-09-29T17:39:11.390583] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-29T17:39:11.536574] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-29T17:39:11.548058] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-09-29T17:39:12.348114] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-09-29T17:39:13.003420] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-29T17:39:13.004940] [INFO ] [REMOTE ] BNH: Full fetch complete (6867 records). [2025-09-29T17:39:13.005015] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-09-29T17:39:13.159392] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-09-29T17:39:13.430873] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-09-29T17:39:13.430984] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-09-29T17:39:13.431231] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-09-29T17:39:13.431522] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-09-29T17:39:13.433253] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-29T17:39:13.433916] [DEBUG] [LOCAL ] BNH: Trimmed 6867 records to 4916 (keeping 200 days of data) [2025-09-29T17:39:13.476413] [DEBUG] [LOCAL ] BNH: Primary data saved (4916 records). [2025-09-29T17:39:13.476537] [INFO ] [MAIN ] BNH: Full history saved. [2025-09-29T17:39:13.476622] [INFO ] [MAIN ] Update Progress: 315/2371 symbols completed. BNH took 32.3s. Estimated remaining: 4h 15m 42s. Rate: 8.0 symbols/min [2025-09-29T17:39:13.651571] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:39:13.660806] [DEBUG] [LOCAL ] BNY: Loaded 7446 existing records from primary storage. [2025-09-29T17:39:13.660999] [INFO ] [MAIN ] BNY: Loaded 7446 existing records. [2025-09-29T17:39:13.852613] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:39:13.852875] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-09-29T17:39:13.852925] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-09-29T17:39:13.853263] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-09-29T17:39:13.853323] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-09-29T17:39:13.954293] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-09-29T17:39:14.225323] [INFO ] [REMOTE ] BNY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:39:14.748111] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-01. [2025-09-29T17:39:15.136285] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-29T17:39:15.231861] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-29T17:39:15.548122] [INFO ] [REMOTE ] BNY: Fetching primary data for 2024-12. [2025-09-29T17:39:15.617404] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-29T17:39:16.348103] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-09-29T17:39:16.534470] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-29T17:39:17.148114] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-01. [2025-09-29T17:39:17.764492] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-29T17:39:17.948117] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-09-29T17:39:18.117975] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-29T17:39:18.128058] [INFO ] [REMOTE ] BNL: Full fetch complete (66750 records). [2025-09-29T17:39:18.128228] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-09-29T17:39:18.605231] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-09-29T17:39:18.605326] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-09-29T17:39:18.606068] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-09-29T17:39:18.606133] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-09-29T17:39:18.607546] [DEBUG] [LOCAL ] BNL: Trimmed 66750 records to 46846 (keeping 200 days of data) [2025-09-29T17:39:18.791798] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-09-29T17:39:18.910739] [DEBUG] [LOCAL ] BNL: Primary data saved (46846 records). [2025-09-29T17:39:18.910902] [INFO ] [MAIN ] BNL: Full history saved. [2025-09-29T17:39:18.910997] [INFO ] [MAIN ] Update Progress: 316/2371 symbols completed. BNL took 33.9s. Estimated remaining: 4h 15m 21s. Rate: 8.0 symbols/min [2025-09-29T17:39:19.094596] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:39:19.113858] [DEBUG] [LOCAL ] BOC: Loaded 18626 existing records from primary storage. [2025-09-29T17:39:19.114110] [INFO ] [MAIN ] BOC: Loaded 18626 existing records. [2025-09-29T17:39:19.303514] [WARN ] [MAIN ] BOC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:39:19.303887] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-09-29T17:39:19.303943] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-09-29T17:39:19.304236] [DEBUG] [LOCAL ] BOC: Deleted primary data file. [2025-09-29T17:39:19.304293] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-09-29T17:39:19.501459] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-29T17:39:19.553343] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-09-29T17:39:19.713938] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-29T17:39:19.764797] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:39:20.269180] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-29T17:39:20.348113] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-09-29T17:39:21.148170] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-09-29T17:39:21.778902] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-29T17:39:21.948196] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-09-29T17:39:22.254606] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-29T17:39:22.266594] [INFO ] [REMOTE ] BNS: Full fetch complete (74183 records). [2025-09-29T17:39:22.266813] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-09-29T17:39:22.637102] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-29T17:39:22.755415] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-09-29T17:39:22.760416] [DEBUG] [VALIDATOR ] BNS: All expected trading days are present. [2025-09-29T17:39:22.760512] [DEBUG] [VALIDATOR ] BNS: Primary data validation passed. [2025-09-29T17:39:22.761418] [INFO ] [MAIN ] BNS: Fetched primary data is valid. [2025-09-29T17:39:22.761530] [DEBUG] [LOCAL ] BNS: Saving primary data. [2025-09-29T17:39:22.763273] [DEBUG] [LOCAL ] BNS: Trimmed 74183 records to 51439 (keeping 200 days of data) [2025-09-29T17:39:23.078390] [DEBUG] [LOCAL ] BNS: Primary data saved (51439 records). [2025-09-29T17:39:23.078536] [INFO ] [MAIN ] BNS: Full history saved. [2025-09-29T17:39:23.078623] [INFO ] [MAIN ] Update Progress: 317/2371 symbols completed. BNS took 34.3s. Estimated remaining: 4h 14m 53s. Rate: 8.1 symbols/min [2025-09-29T17:39:23.548108] [INFO ] [REMOTE ] BOC: Fetching primary data for 2024-12. [2025-09-29T17:39:23.559954] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-29T17:39:24.348134] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-09-29T17:39:24.462810] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-29T17:39:24.760061] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-29T17:39:25.148127] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-09-29T17:39:25.908169] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-29T17:39:25.948064] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-09-29T17:39:26.748130] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-09-29T17:39:26.802723] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-29T17:39:27.548136] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-09-29T17:39:27.724710] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-29T17:39:28.348157] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-09-29T17:39:28.436877] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-29T17:39:28.438892] [INFO ] [REMOTE ] BNY: Full fetch complete (10424 records). [2025-09-29T17:39:28.438967] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-09-29T17:39:28.838707] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-09-29T17:39:28.838808] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-09-29T17:39:28.839095] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-09-29T17:39:28.839138] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-09-29T17:39:28.839659] [DEBUG] [LOCAL ] BNY: Trimmed 10424 records to 7148 (keeping 200 days of data) [2025-09-29T17:39:28.882474] [DEBUG] [LOCAL ] BNY: Primary data saved (7148 records). [2025-09-29T17:39:28.882590] [INFO ] [MAIN ] BNY: Full history saved. [2025-09-29T17:39:28.882695] [INFO ] [MAIN ] Update Progress: 318/2371 symbols completed. BNY took 15.4s. Estimated remaining: 4h 14m 35s. Rate: 8.1 symbols/min [2025-09-29T17:39:29.148124] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-09-29T17:39:29.201431] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-29T17:39:29.531929] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-29T17:39:29.948334] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-09-29T17:39:30.748100] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-09-29T17:39:30.987488] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-29T17:39:31.487108] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-29T17:39:31.548221] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-09-29T17:39:32.348125] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-09-29T17:39:32.667613] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-29T17:39:32.753796] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-29T17:39:33.148179] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-09-29T17:39:33.948101] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-09-29T17:39:34.094159] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-29T17:39:34.464211] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-29T17:39:34.748166] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-09-29T17:39:35.294476] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-29T17:39:35.548130] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-09-29T17:39:35.990316] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-29T17:39:36.348109] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-09-29T17:39:37.060970] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-29T17:39:37.062625] [INFO ] [REMOTE ] BNT: Full fetch complete (4499 records). [2025-09-29T17:39:37.062770] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-09-29T17:39:37.153239] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-09-29T17:39:37.465205] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-09-29T17:39:37.465331] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-09-29T17:39:37.465523] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-09-29T17:39:37.465573] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-09-29T17:39:37.466075] [DEBUG] [LOCAL ] BNT: Trimmed 4499 records to 3382 (keeping 200 days of data) [2025-09-29T17:39:37.488600] [DEBUG] [LOCAL ] BNT: Primary data saved (3382 records). [2025-09-29T17:39:37.488750] [INFO ] [MAIN ] BNT: Full history saved. [2025-09-29T17:39:37.488843] [INFO ] [MAIN ] Update Progress: 319/2371 symbols completed. BNT took 30.4s. Estimated remaining: 4h 14m 35s. Rate: 8.1 symbols/min [2025-09-29T17:39:38.257159] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-29T17:39:38.263215] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-09-29T17:39:39.267579] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-29T17:39:39.272346] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-09-29T17:39:40.351480] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-29T17:39:40.356880] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-09-29T17:39:41.490424] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-29T17:39:41.494921] [INFO ] [REMOTE ] BOC: Full fetch complete (25830 records). [2025-09-29T17:39:41.495089] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-09-29T17:39:41.927921] [DEBUG] [VALIDATOR ] BOC: All expected trading days are present. [2025-09-29T17:39:41.928126] [DEBUG] [VALIDATOR ] BOC: Primary data validation passed. [2025-09-29T17:39:41.928543] [INFO ] [MAIN ] BOC: Fetched primary data is valid. [2025-09-29T17:39:41.928587] [DEBUG] [LOCAL ] BOC: Saving primary data. [2025-09-29T17:39:41.929275] [DEBUG] [LOCAL ] BOC: Trimmed 25830 records to 18267 (keeping 200 days of data) [2025-09-29T17:39:42.041080] [DEBUG] [LOCAL ] BOC: Primary data saved (18267 records). [2025-09-29T17:39:42.041223] [INFO ] [MAIN ] BOC: Full history saved. [2025-09-29T17:39:42.041341] [INFO ] [MAIN ] Update Progress: 320/2371 symbols completed. BOC took 23.1s. Estimated remaining: 4h 14m 9s. Rate: 8.1 symbols/min [2025-09-29T17:39:42.694454] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:39:42.692462] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:39:42.719921] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:39:42.803986] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:39:42.835928] [DEBUG] [LOCAL ] BOE: Loaded 17816 existing records from primary storage. [2025-09-29T17:39:42.855865] [INFO ] [MAIN ] BOE: Loaded 17816 existing records. [2025-09-29T17:39:42.874345] [DEBUG] [LOCAL ] BOH: Loaded 31676 existing records from primary storage. [2025-09-29T17:39:42.915757] [INFO ] [MAIN ] BOH: Loaded 31676 existing records. [2025-09-29T17:39:43.004183] [DEBUG] [LOCAL ] BOND: Loaded 32554 existing records from primary storage. [2025-09-29T17:39:43.059713] [INFO ] [MAIN ] BOND: Loaded 32554 existing records. [2025-09-29T17:39:43.102341] [DEBUG] [LOCAL ] BOOT: Loaded 41409 existing records from primary storage. [2025-09-29T17:39:43.168419] [INFO ] [MAIN ] BOOT: Loaded 41409 existing records. [2025-09-29T17:39:43.500311] [WARN ] [MAIN ] BOE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:39:43.504922] [WARN ] [MAIN ] BOH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:39:43.531310] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-09-29T17:39:43.520811] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-09-29T17:39:43.536840] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-09-29T17:39:43.536675] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-09-29T17:39:43.537595] [DEBUG] [LOCAL ] BOE: Deleted primary data file. [2025-09-29T17:39:43.537560] [DEBUG] [LOCAL ] BOH: Deleted primary data file. [2025-09-29T17:39:43.558548] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-09-29T17:39:43.563991] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-09-29T17:39:43.669918] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:39:43.867156] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-09-29T17:39:43.913519] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-09-29T17:39:43.917695] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:39:43.984013] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-09-29T17:39:43.983785] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-09-29T17:39:44.005603] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-09-29T17:39:44.005709] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-09-29T17:39:44.109553] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-09-29T17:39:44.269212] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-09-29T17:39:44.751268] [INFO ] [REMOTE ] BOE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:39:44.838079] [INFO ] [REMOTE ] BOE: Fetching primary data for 2024-12. [2025-09-29T17:39:44.941031] [INFO ] [REMOTE ] BOH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:39:45.048828] [INFO ] [REMOTE ] BOH: Fetching primary data for 2024-12. [2025-09-29T17:39:45.245210] [INFO ] [REMOTE ] BOND: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:39:45.251311] [INFO ] [REMOTE ] BOND: Fetching primary data for 2024-12. [2025-09-29T17:39:45.331970] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:39:45.332337] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2024-12. [2025-09-29T17:39:46.136194] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-29T17:39:46.141395] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-01. [2025-09-29T17:39:46.486107] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-29T17:39:46.492373] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-09-29T17:39:46.708759] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-29T17:39:46.716453] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-09-29T17:39:46.795041] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-29T17:39:46.803256] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-01. [2025-09-29T17:39:47.228691] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-29T17:39:47.233388] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-09-29T17:39:47.627500] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-29T17:39:47.634257] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-09-29T17:39:47.816484] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-29T17:39:47.844012] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-29T17:39:48.348132] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-09-29T17:39:48.405563] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-29T17:39:48.488241] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-29T17:39:49.148106] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-09-29T17:39:49.399662] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-29T17:39:49.948137] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-09-29T17:39:50.442601] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-29T17:39:50.735440] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-29T17:39:50.748059] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-09-29T17:39:51.548157] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-09-29T17:39:52.232500] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-29T17:39:52.348121] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-09-29T17:39:53.120878] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-29T17:39:53.148126] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-09-29T17:39:53.858762] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-29T17:39:53.948165] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-09-29T17:39:54.594718] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-29T17:39:54.748123] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-09-29T17:39:55.256521] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-29T17:39:55.548114] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-09-29T17:39:56.130328] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-29T17:39:56.348115] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-09-29T17:39:56.387082] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-29T17:39:57.148130] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-09-29T17:39:57.868566] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-29T17:39:57.885690] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-29T17:39:57.948144] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-09-29T17:39:58.748127] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-09-29T17:39:58.936710] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-29T17:39:59.548148] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-09-29T17:39:59.765866] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-29T17:40:00.348117] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-09-29T17:40:01.148154] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-09-29T17:40:01.357799] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-29T17:40:01.358933] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-29T17:40:01.948189] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-09-29T17:40:02.216696] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-29T17:40:02.748128] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-09-29T17:40:03.548134] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-09-29T17:40:03.756238] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-29T17:40:04.304064] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-29T17:40:04.348115] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-09-29T17:40:04.450820] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-29T17:40:05.148117] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-09-29T17:40:05.646919] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-29T17:40:05.948137] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-09-29T17:40:06.054907] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-29T17:40:06.059616] [INFO ] [REMOTE ] BOE: Full fetch complete (26707 records). [2025-09-29T17:40:06.059808] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-09-29T17:40:06.470773] [DEBUG] [VALIDATOR ] BOE: All expected trading days are present. [2025-09-29T17:40:06.470864] [DEBUG] [VALIDATOR ] BOE: Primary data validation passed. [2025-09-29T17:40:06.471352] [INFO ] [MAIN ] BOE: Fetched primary data is valid. [2025-09-29T17:40:06.471438] [DEBUG] [LOCAL ] BOE: Saving primary data. [2025-09-29T17:40:06.472256] [DEBUG] [LOCAL ] BOE: Trimmed 26707 records to 17601 (keeping 200 days of data) [2025-09-29T17:40:06.590932] [DEBUG] [LOCAL ] BOE: Primary data saved (17601 records). [2025-09-29T17:40:06.591082] [INFO ] [MAIN ] BOE: Full history saved. [2025-09-29T17:40:06.591202] [INFO ] [MAIN ] Update Progress: 321/2371 symbols completed. BOE took 24.5s. Estimated remaining: 4h 15m 51s. Rate: 8.0 symbols/min [2025-09-29T17:40:06.753254] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-09-29T17:40:06.782482] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:40:06.834209] [DEBUG] [LOCAL ] BORR: Loaded 51902 existing records from primary storage. [2025-09-29T17:40:06.834528] [INFO ] [MAIN ] BORR: Loaded 51902 existing records. [2025-09-29T17:40:07.023638] [WARN ] [MAIN ] BORR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:40:07.023938] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-09-29T17:40:07.023998] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-09-29T17:40:07.024501] [DEBUG] [LOCAL ] BORR: Deleted primary data file. [2025-09-29T17:40:07.024559] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-09-29T17:40:07.400928] [INFO ] [REMOTE ] BORR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:40:07.526167] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-29T17:40:07.548113] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-09-29T17:40:07.932416] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-29T17:40:08.348125] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-09-29T17:40:09.050468] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-29T17:40:09.148117] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-09-29T17:40:09.907462] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-29T17:40:09.915288] [INFO ] [REMOTE ] BOND: Full fetch complete (46341 records). [2025-09-29T17:40:09.915477] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-09-29T17:40:09.953682] [INFO ] [REMOTE ] BORR: Fetching primary data for 2024-12. [2025-09-29T17:40:10.336552] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-09-29T17:40:10.336676] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-09-29T17:40:10.337290] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-09-29T17:40:10.337366] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-09-29T17:40:10.338542] [DEBUG] [LOCAL ] BOND: Trimmed 46341 records to 32075 (keeping 200 days of data) [2025-09-29T17:40:10.554602] [DEBUG] [LOCAL ] BOND: Primary data saved (32075 records). [2025-09-29T17:40:10.554778] [INFO ] [MAIN ] BOND: Full history saved. [2025-09-29T17:40:10.559503] [INFO ] [MAIN ] Update Progress: 322/2371 symbols completed. BOND took 28.5s. Estimated remaining: 4h 15m 21s. Rate: 8.0 symbols/min [2025-09-29T17:40:10.749192] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-09-29T17:40:10.748951] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:40:10.770008] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-29T17:40:10.777062] [INFO ] [REMOTE ] BOH: Full fetch complete (44882 records). [2025-09-29T17:40:10.777260] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-09-29T17:40:10.948465] [DEBUG] [LOCAL ] BOW: Loaded 23974 existing records from primary storage. [2025-09-29T17:40:10.975808] [INFO ] [MAIN ] BOW: Loaded 23974 existing records. [2025-09-29T17:40:11.375551] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:40:11.409343] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-09-29T17:40:11.432146] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-09-29T17:40:11.441464] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-09-29T17:40:11.444191] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-09-29T17:40:11.444331] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-09-29T17:40:11.444288] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-09-29T17:40:11.444999] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-09-29T17:40:11.445126] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-09-29T17:40:11.522909] [DEBUG] [LOCAL ] BOH: Trimmed 44882 records to 30949 (keeping 200 days of data) [2025-09-29T17:40:12.024175] [INFO ] [REMOTE ] BOW: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:40:12.025378] [INFO ] [REMOTE ] BOW: Fetching primary data for 2024-12. [2025-09-29T17:40:12.072084] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-29T17:40:12.153454] [DEBUG] [LOCAL ] BOH: Primary data saved (30949 records). [2025-09-29T17:40:12.153601] [INFO ] [MAIN ] BOH: Full history saved. [2025-09-29T17:40:12.153723] [INFO ] [MAIN ] Update Progress: 323/2371 symbols completed. BOH took 30.1s. Estimated remaining: 4h 14m 36s. Rate: 8.0 symbols/min [2025-09-29T17:40:12.337960] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:40:12.348149] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-01. [2025-09-29T17:40:12.391344] [DEBUG] [LOCAL ] BOX: Loaded 51017 existing records from primary storage. [2025-09-29T17:40:12.391700] [INFO ] [MAIN ] BOX: Loaded 51017 existing records. [2025-09-29T17:40:12.584063] [WARN ] [MAIN ] BOX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:40:12.584472] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-09-29T17:40:12.584550] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-09-29T17:40:12.585109] [DEBUG] [LOCAL ] BOX: Deleted primary data file. [2025-09-29T17:40:12.599261] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-09-29T17:40:12.675939] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-29T17:40:13.004503] [INFO ] [REMOTE ] BOX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:40:13.017584] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-29T17:40:13.148111] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-09-29T17:40:13.948124] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-01. [2025-09-29T17:40:14.177006] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-29T17:40:14.667627] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-29T17:40:14.688298] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-29T17:40:14.748132] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-09-29T17:40:15.548096] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-09-29T17:40:15.631556] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-29T17:40:16.348151] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-09-29T17:40:17.148139] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-09-29T17:40:17.645802] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-29T17:40:17.948088] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-09-29T17:40:18.243989] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (2.70 seconds). [2025-09-29T17:40:18.750199] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-09-29T17:40:18.753211] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-29T17:40:18.762144] [INFO ] [REMOTE ] BOOT: Full fetch complete (60238 records). [2025-09-29T17:40:18.762266] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-09-29T17:40:18.875320] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-29T17:40:19.222369] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-09-29T17:40:19.222458] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-09-29T17:40:19.223196] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-09-29T17:40:19.223264] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-09-29T17:40:19.224714] [DEBUG] [LOCAL ] BOOT: Trimmed 60238 records to 40631 (keeping 200 days of data) [2025-09-29T17:40:19.486200] [DEBUG] [LOCAL ] BOOT: Primary data saved (40631 records). [2025-09-29T17:40:19.486394] [INFO ] [MAIN ] BOOT: Full history saved. [2025-09-29T17:40:19.486498] [INFO ] [MAIN ] Update Progress: 324/2371 symbols completed. BOOT took 37.4s. Estimated remaining: 4h 14m 28s. Rate: 8.0 symbols/min [2025-09-29T17:40:19.553364] [INFO ] [REMOTE ] BOX: Fetching primary data for 2024-12. [2025-09-29T17:40:19.667815] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:40:19.742586] [DEBUG] [LOCAL ] BP: Loaded 54491 existing records from primary storage. [2025-09-29T17:40:19.743179] [INFO ] [MAIN ] BP: Loaded 54491 existing records. [2025-09-29T17:40:19.938137] [WARN ] [MAIN ] BP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:40:19.938509] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-09-29T17:40:19.938566] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-09-29T17:40:19.939462] [DEBUG] [LOCAL ] BP: Deleted primary data file. [2025-09-29T17:40:19.939527] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-09-29T17:40:20.322485] [INFO ] [REMOTE ] BP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:40:20.348111] [INFO ] [REMOTE ] BP: Fetching primary data for 2024-12. [2025-09-29T17:40:20.549879] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-29T17:40:21.148151] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-09-29T17:40:21.446075] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-29T17:40:21.948107] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-09-29T17:40:21.984486] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-29T17:40:22.591077] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-29T17:40:22.748093] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-09-29T17:40:23.548145] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-01. [2025-09-29T17:40:23.842094] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-29T17:40:23.944627] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-29T17:40:24.348113] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-09-29T17:40:25.148153] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-09-29T17:40:25.352604] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-29T17:40:25.532166] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-29T17:40:25.948185] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-09-29T17:40:26.748148] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-01. [2025-09-29T17:40:26.874702] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-29T17:40:27.548141] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-09-29T17:40:27.614506] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-29T17:40:28.143442] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-29T17:40:28.348123] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-09-29T17:40:29.148136] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-09-29T17:40:29.300261] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-29T17:40:29.857498] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-29T17:40:29.948122] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-09-29T17:40:30.748084] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-09-29T17:40:31.262579] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-29T17:40:31.548177] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-09-29T17:40:31.833812] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-29T17:40:31.865170] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-29T17:40:32.348184] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-09-29T17:40:33.148165] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-09-29T17:40:33.473118] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-29T17:40:33.948099] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-09-29T17:40:34.032811] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-29T17:40:34.097017] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-29T17:40:34.102254] [INFO ] [REMOTE ] BOW: Full fetch complete (31169 records). [2025-09-29T17:40:34.102501] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-09-29T17:40:34.510719] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-09-29T17:40:34.510843] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-09-29T17:40:34.511367] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-09-29T17:40:34.511440] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-09-29T17:40:34.512479] [DEBUG] [LOCAL ] BOW: Trimmed 31169 records to 23476 (keeping 200 days of data) [2025-09-29T17:40:34.662997] [DEBUG] [LOCAL ] BOW: Primary data saved (23476 records). [2025-09-29T17:40:34.663159] [INFO ] [MAIN ] BOW: Full history saved. [2025-09-29T17:40:34.663255] [INFO ] [MAIN ] Update Progress: 325/2371 symbols completed. BOW took 24.1s. Estimated remaining: 4h 15m 9s. Rate: 8.0 symbols/min [2025-09-29T17:40:34.753262] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-09-29T17:40:34.859855] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:40:34.909904] [DEBUG] [LOCAL ] BR: Loaded 35251 existing records from primary storage. [2025-09-29T17:40:34.910224] [INFO ] [MAIN ] BR: Loaded 35251 existing records. [2025-09-29T17:40:35.099912] [WARN ] [MAIN ] BR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:40:35.100156] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-09-29T17:40:35.100206] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-09-29T17:40:35.100743] [DEBUG] [LOCAL ] BR: Deleted primary data file. [2025-09-29T17:40:35.100866] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-09-29T17:40:35.502285] [INFO ] [REMOTE ] BR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:40:35.548190] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-09-29T17:40:36.066957] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-29T17:40:36.159009] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-29T17:40:36.348166] [INFO ] [REMOTE ] BR: Fetching primary data for 2024-12. [2025-09-29T17:40:37.148127] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-09-29T17:40:37.362954] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-29T17:40:37.428080] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-29T17:40:37.948116] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-09-29T17:40:38.748127] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-09-29T17:40:39.202557] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-29T17:40:39.548167] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-09-29T17:40:39.659054] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-29T17:40:40.348092] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-01. [2025-09-29T17:40:40.670765] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-29T17:40:41.148126] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-09-29T17:40:41.475274] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-29T17:40:41.509728] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-29T17:40:41.948135] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-09-29T17:40:42.748122] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-09-29T17:40:43.136979] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-29T17:40:43.148588] [INFO ] [REMOTE ] BORR: Full fetch complete (74694 records). [2025-09-29T17:40:43.148813] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-09-29T17:40:43.470010] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-29T17:40:43.553208] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-09-29T17:40:43.639116] [DEBUG] [VALIDATOR ] BORR: All expected trading days are present. [2025-09-29T17:40:43.639217] [DEBUG] [VALIDATOR ] BORR: Primary data validation passed. [2025-09-29T17:40:43.640116] [INFO ] [MAIN ] BORR: Fetched primary data is valid. [2025-09-29T17:40:43.640193] [DEBUG] [LOCAL ] BORR: Saving primary data. [2025-09-29T17:40:43.641777] [DEBUG] [LOCAL ] BORR: Trimmed 74694 records to 51131 (keeping 200 days of data) [2025-09-29T17:40:43.950538] [DEBUG] [LOCAL ] BORR: Primary data saved (51131 records). [2025-09-29T17:40:43.950765] [INFO ] [MAIN ] BORR: Full history saved. [2025-09-29T17:40:43.950893] [INFO ] [MAIN ] Update Progress: 326/2371 symbols completed. BORR took 37.4s. Estimated remaining: 4h 15m 13s. Rate: 8.0 symbols/min [2025-09-29T17:40:44.132267] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:40:44.187241] [DEBUG] [LOCAL ] BRBR: Loaded 51987 existing records from primary storage. [2025-09-29T17:40:44.187612] [INFO ] [MAIN ] BRBR: Loaded 51987 existing records. [2025-09-29T17:40:44.350555] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-09-29T17:40:44.375242] [WARN ] [MAIN ] BRBR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:40:44.376339] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-09-29T17:40:44.376430] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-09-29T17:40:44.376854] [DEBUG] [LOCAL ] BRBR: Deleted primary data file. [2025-09-29T17:40:44.376919] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-09-29T17:40:44.763912] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:40:45.109572] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-29T17:40:45.148704] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2024-12. [2025-09-29T17:40:45.152325] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-09-29T17:40:45.948103] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-09-29T17:40:46.291127] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-29T17:40:46.690946] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-29T17:40:46.748117] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-01. [2025-09-29T17:40:47.548166] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-09-29T17:40:47.943734] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-29T17:40:47.955487] [INFO ] [REMOTE ] BP: Full fetch complete (77763 records). [2025-09-29T17:40:47.955726] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-09-29T17:40:48.361184] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-09-29T17:40:48.384376] [DEBUG] [VALIDATOR ] BP: All expected trading days are present. [2025-09-29T17:40:48.385621] [DEBUG] [VALIDATOR ] BP: Primary data validation passed. [2025-09-29T17:40:48.386745] [INFO ] [MAIN ] BP: Fetched primary data is valid. [2025-09-29T17:40:48.387086] [DEBUG] [LOCAL ] BP: Saving primary data. [2025-09-29T17:40:48.398405] [DEBUG] [LOCAL ] BP: Trimmed 77763 records to 53711 (keeping 200 days of data) [2025-09-29T17:40:48.419614] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-29T17:40:48.769559] [DEBUG] [LOCAL ] BP: Primary data saved (53711 records). [2025-09-29T17:40:48.769791] [INFO ] [MAIN ] BP: Full history saved. [2025-09-29T17:40:48.769961] [INFO ] [MAIN ] Update Progress: 327/2371 symbols completed. BP took 29.3s. Estimated remaining: 4h 14m 48s. Rate: 8.0 symbols/min [2025-09-29T17:40:48.952553] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:40:48.975537] [DEBUG] [LOCAL ] BRC: Loaded 19567 existing records from primary storage. [2025-09-29T17:40:48.975846] [INFO ] [MAIN ] BRC: Loaded 19567 existing records. [2025-09-29T17:40:49.162884] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-09-29T17:40:49.170432] [WARN ] [MAIN ] BRC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:40:49.171027] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-09-29T17:40:49.171115] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-09-29T17:40:49.171517] [DEBUG] [LOCAL ] BRC: Deleted primary data file. [2025-09-29T17:40:49.171710] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-09-29T17:40:49.291533] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-29T17:40:49.602500] [INFO ] [REMOTE ] BRC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:40:49.948067] [INFO ] [REMOTE ] BRC: Fetching primary data for 2024-12. [2025-09-29T17:40:50.282008] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-29T17:40:50.472661] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-29T17:40:50.748129] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-09-29T17:40:51.146856] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-29T17:40:51.548109] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-01. [2025-09-29T17:40:52.348092] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-09-29T17:40:52.582867] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-29T17:40:53.148154] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-09-29T17:40:53.948130] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-09-29T17:40:53.998699] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (3.25 seconds). [2025-09-29T17:40:54.092177] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-29T17:40:54.748129] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-09-29T17:40:55.004328] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-29T17:40:55.024814] [INFO ] [REMOTE ] BOX: Full fetch complete (72088 records). [2025-09-29T17:40:55.030994] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-29T17:40:55.030473] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-09-29T17:40:55.453862] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-09-29T17:40:55.453959] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-09-29T17:40:55.454755] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-09-29T17:40:55.454825] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-09-29T17:40:55.456445] [DEBUG] [LOCAL ] BOX: Trimmed 72088 records to 50244 (keeping 200 days of data) [2025-09-29T17:40:55.549070] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-09-29T17:40:55.775987] [DEBUG] [LOCAL ] BOX: Primary data saved (50244 records). [2025-09-29T17:40:55.776163] [INFO ] [MAIN ] BOX: Full history saved. [2025-09-29T17:40:55.777949] [INFO ] [MAIN ] Update Progress: 328/2371 symbols completed. BOX took 43.6s. Estimated remaining: 4h 14m 38s. Rate: 8.0 symbols/min [2025-09-29T17:40:55.969296] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:40:56.020485] [DEBUG] [LOCAL ] BRCC: Loaded 40896 existing records from primary storage. [2025-09-29T17:40:56.020873] [INFO ] [MAIN ] BRCC: Loaded 40896 existing records. [2025-09-29T17:40:56.173776] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-29T17:40:56.249021] [WARN ] [MAIN ] BRCC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:40:56.249743] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-09-29T17:40:56.249801] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-09-29T17:40:56.250318] [DEBUG] [LOCAL ] BRCC: Deleted primary data file. [2025-09-29T17:40:56.250401] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-09-29T17:40:56.354026] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-09-29T17:40:56.675358] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:40:56.695693] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-29T17:40:57.148129] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2024-12. [2025-09-29T17:40:57.849107] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-29T17:40:57.948118] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-09-29T17:40:58.748092] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-09-29T17:40:58.846816] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-29T17:40:59.548116] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-01. [2025-09-29T17:40:59.716913] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-29T17:40:59.825102] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-29T17:41:00.348113] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-09-29T17:41:00.932937] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-29T17:41:01.148136] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-09-29T17:41:01.948107] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-09-29T17:41:02.131826] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-29T17:41:02.186625] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-29T17:41:02.748108] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-09-29T17:41:03.207395] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-29T17:41:03.548127] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-09-29T17:41:04.214227] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-29T17:41:04.348131] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-09-29T17:41:05.148130] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-09-29T17:41:05.243137] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-29T17:41:05.880770] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-29T17:41:05.948119] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-09-29T17:41:06.589382] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-29T17:41:06.748130] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-09-29T17:41:07.548242] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-09-29T17:41:07.569564] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-29T17:41:07.634035] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-29T17:41:08.348125] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-09-29T17:41:09.148106] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-09-29T17:41:09.304617] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-29T17:41:09.312287] [INFO ] [REMOTE ] BR: Full fetch complete (49064 records). [2025-09-29T17:41:09.312413] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-09-29T17:41:09.730090] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-09-29T17:41:09.730238] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-09-29T17:41:09.731090] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-09-29T17:41:09.731172] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-09-29T17:41:09.732775] [DEBUG] [LOCAL ] BR: Trimmed 49064 records to 34585 (keeping 200 days of data) [2025-09-29T17:41:09.949365] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-09-29T17:41:09.965566] [DEBUG] [LOCAL ] BR: Primary data saved (34585 records). [2025-09-29T17:41:09.965758] [INFO ] [MAIN ] BR: Full history saved. [2025-09-29T17:41:09.965871] [INFO ] [MAIN ] Update Progress: 329/2371 symbols completed. BR took 35.3s. Estimated remaining: 4h 15m 12s. Rate: 8.0 symbols/min [2025-09-29T17:41:10.149054] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:41:10.183211] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-29T17:41:10.243893] [DEBUG] [LOCAL ] BRO: Loaded 52664 existing records from primary storage. [2025-09-29T17:41:10.244270] [INFO ] [MAIN ] BRO: Loaded 52664 existing records. [2025-09-29T17:41:10.446133] [WARN ] [MAIN ] BRO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:41:10.446504] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-09-29T17:41:10.446581] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-09-29T17:41:10.447404] [DEBUG] [LOCAL ] BRO: Deleted primary data file. [2025-09-29T17:41:10.447484] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-09-29T17:41:10.754271] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-09-29T17:41:10.825833] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-29T17:41:10.881388] [INFO ] [REMOTE ] BRO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:41:10.893851] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-29T17:41:11.548114] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-09-29T17:41:12.294795] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-29T17:41:12.348090] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-09-29T17:41:12.684723] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-29T17:41:13.148110] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-09-29T17:41:13.747986] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-29T17:41:13.752448] [INFO ] [REMOTE ] BRC: Full fetch complete (29095 records). [2025-09-29T17:41:13.752576] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-09-29T17:41:13.953200] [INFO ] [REMOTE ] BRO: Fetching primary data for 2024-12. [2025-09-29T17:41:14.149686] [DEBUG] [VALIDATOR ] BRC: All expected trading days are present. [2025-09-29T17:41:14.149782] [DEBUG] [VALIDATOR ] BRC: Primary data validation passed. [2025-09-29T17:41:14.150296] [INFO ] [MAIN ] BRC: Fetched primary data is valid. [2025-09-29T17:41:14.150351] [DEBUG] [LOCAL ] BRC: Saving primary data. [2025-09-29T17:41:14.151173] [DEBUG] [LOCAL ] BRC: Trimmed 29095 records to 19180 (keeping 200 days of data) [2025-09-29T17:41:14.279777] [DEBUG] [LOCAL ] BRC: Primary data saved (19180 records). [2025-09-29T17:41:14.279954] [INFO ] [MAIN ] BRC: Full history saved. [2025-09-29T17:41:14.280049] [INFO ] [MAIN ] Update Progress: 330/2371 symbols completed. BRC took 25.5s. Estimated remaining: 4h 14m 45s. Rate: 8.0 symbols/min [2025-09-29T17:41:14.465469] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:41:14.519551] [DEBUG] [LOCAL ] BROS: Loaded 54067 existing records from primary storage. [2025-09-29T17:41:14.519946] [INFO ] [MAIN ] BROS: Loaded 54067 existing records. [2025-09-29T17:41:14.717302] [WARN ] [MAIN ] BROS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:41:14.717917] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-09-29T17:41:14.718055] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-09-29T17:41:14.718896] [DEBUG] [LOCAL ] BROS: Deleted primary data file. [2025-09-29T17:41:14.718980] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-09-29T17:41:14.754139] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-09-29T17:41:15.075142] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-29T17:41:15.160359] [INFO ] [REMOTE ] BROS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:41:15.548127] [INFO ] [REMOTE ] BROS: Fetching primary data for 2024-12. [2025-09-29T17:41:15.960579] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-29T17:41:16.348235] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-09-29T17:41:16.908951] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-29T17:41:16.919763] [INFO ] [REMOTE ] BRBR: Full fetch complete (71964 records). [2025-09-29T17:41:16.919908] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-09-29T17:41:17.160600] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-01. [2025-09-29T17:41:17.346966] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-09-29T17:41:17.347121] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-09-29T17:41:17.348205] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-09-29T17:41:17.348385] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-09-29T17:41:17.350872] [DEBUG] [LOCAL ] BRBR: Trimmed 71964 records to 51250 (keeping 200 days of data) [2025-09-29T17:41:17.490850] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-29T17:41:17.733268] [DEBUG] [LOCAL ] BRBR: Primary data saved (51250 records). [2025-09-29T17:41:17.733433] [INFO ] [MAIN ] BRBR: Full history saved. [2025-09-29T17:41:17.733528] [INFO ] [MAIN ] Update Progress: 331/2371 symbols completed. BRBR took 33.8s. Estimated remaining: 4h 14m 13s. Rate: 8.0 symbols/min [2025-09-29T17:41:17.914622] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:41:17.915170] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-09-29T17:41:17.915293] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-09-29T17:41:17.915628] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-09-29T17:41:17.915991] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-09-29T17:41:17.916069] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-09-29T17:41:17.916106] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-09-29T17:41:17.953328] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-01. [2025-09-29T17:41:18.051961] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-29T17:41:18.360219] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:41:18.748089] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2024-12. [2025-09-29T17:41:19.120325] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T17:41:19.120673] [WARN ] [REMOTE ] BRSL: No data returned for month 2024-12 [2025-09-29T17:41:19.120777] [FATAL] [REMOTE ] BRSL: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T17:41:19.120829] [FATAL] [MAIN ] BRSL: Failed to fetch primary data. [2025-09-29T17:41:19.120889] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T17:41:19.120963] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-09-29T17:41:19.121031] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-09-29T17:41:19.121081] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-09-29T17:41:19.121163] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-09-29T17:41:19.121235] [INFO ] [MAIN ] Update Progress: 332/2371 symbols completed. BRSL took 1.4s. Estimated remaining: 4h 13m 28s. Rate: 8.0 symbols/min [2025-09-29T17:41:19.312806] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:41:19.342867] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-29T17:41:19.387304] [DEBUG] [LOCAL ] BRSP: Loaded 37442 existing records from primary storage. [2025-09-29T17:41:19.387704] [INFO ] [MAIN ] BRSP: Loaded 37442 existing records. [2025-09-29T17:41:19.549233] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-09-29T17:41:19.581688] [WARN ] [MAIN ] BRSP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:41:19.582050] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-09-29T17:41:19.582114] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-09-29T17:41:19.582500] [DEBUG] [LOCAL ] BRSP: Deleted primary data file. [2025-09-29T17:41:19.582561] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-09-29T17:41:19.966309] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:41:20.000208] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-29T17:41:20.348098] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-09-29T17:41:21.148119] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2024-12. [2025-09-29T17:41:21.329124] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-29T17:41:21.948163] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-09-29T17:41:22.286817] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-29T17:41:22.579933] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-29T17:41:22.748151] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-09-29T17:41:23.548139] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-09-29T17:41:23.711981] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-29T17:41:23.721461] [INFO ] [REMOTE ] BRCC: Full fetch complete (57785 records). [2025-09-29T17:41:23.721637] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-09-29T17:41:24.177047] [DEBUG] [VALIDATOR ] BRCC: All expected trading days are present. [2025-09-29T17:41:24.177272] [DEBUG] [VALIDATOR ] BRCC: Primary data validation passed. [2025-09-29T17:41:24.178254] [INFO ] [MAIN ] BRCC: Fetched primary data is valid. [2025-09-29T17:41:24.178389] [DEBUG] [LOCAL ] BRCC: Saving primary data. [2025-09-29T17:41:24.180377] [DEBUG] [LOCAL ] BRCC: Trimmed 57785 records to 40218 (keeping 200 days of data) [2025-09-29T17:41:24.383155] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-01. [2025-09-29T17:41:24.492066] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-29T17:41:24.580519] [DEBUG] [LOCAL ] BRCC: Primary data saved (40218 records). [2025-09-29T17:41:24.580736] [INFO ] [MAIN ] BRCC: Full history saved. [2025-09-29T17:41:24.584053] [INFO ] [MAIN ] Update Progress: 333/2371 symbols completed. BRCC took 28.8s. Estimated remaining: 4h 13m 8s. Rate: 8.1 symbols/min [2025-09-29T17:41:24.866336] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:41:24.877504] [DEBUG] [LOCAL ] BRT: Loaded 5034 existing records from primary storage. [2025-09-29T17:41:24.877859] [INFO ] [MAIN ] BRT: Loaded 5034 existing records. [2025-09-29T17:41:25.148195] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-09-29T17:41:25.194120] [WARN ] [MAIN ] BRT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:41:25.195317] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-09-29T17:41:25.195526] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-09-29T17:41:25.196083] [DEBUG] [LOCAL ] BRT: Deleted primary data file. [2025-09-29T17:41:25.196241] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-09-29T17:41:25.668423] [INFO ] [REMOTE ] BRT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:41:25.671315] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-29T17:41:25.899102] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-29T17:41:25.948095] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-09-29T17:41:26.748121] [INFO ] [REMOTE ] BRT: Fetching primary data for 2024-12. [2025-09-29T17:41:27.157804] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-29T17:41:27.453427] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-29T17:41:27.454864] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-29T17:41:27.548119] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-09-29T17:41:28.348143] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-09-29T17:41:28.972924] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-29T17:41:29.148117] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-01. [2025-09-29T17:41:29.628297] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-29T17:41:29.948157] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-09-29T17:41:30.262303] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-29T17:41:30.748116] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-09-29T17:41:31.472740] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-29T17:41:31.548130] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-09-29T17:41:32.348107] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-09-29T17:41:32.549505] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-29T17:41:33.148162] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-09-29T17:41:33.641041] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-29T17:41:33.678284] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-29T17:41:33.762008] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-29T17:41:33.948129] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-09-29T17:41:34.748166] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-09-29T17:41:35.548131] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-09-29T17:41:35.900311] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-29T17:41:36.348117] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-09-29T17:41:36.453769] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-29T17:41:36.485322] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-29T17:41:36.929797] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-29T17:41:37.148111] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-09-29T17:41:37.948147] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-09-29T17:41:38.730466] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-29T17:41:38.748084] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-09-29T17:41:38.978884] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-29T17:41:39.382315] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-29T17:41:39.548121] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-09-29T17:41:40.348112] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-09-29T17:41:41.148135] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-09-29T17:41:41.245274] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-29T17:41:41.948171] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-09-29T17:41:42.489152] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-29T17:41:42.588904] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-29T17:41:42.748141] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-09-29T17:41:43.548156] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-09-29T17:41:44.059299] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-29T17:41:44.070246] [INFO ] [REMOTE ] BRO: Full fetch complete (74218 records). [2025-09-29T17:41:44.070395] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-09-29T17:41:44.355387] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-09-29T17:41:44.505350] [DEBUG] [VALIDATOR ] BRO: All expected trading days are present. [2025-09-29T17:41:44.505542] [DEBUG] [VALIDATOR ] BRO: Primary data validation passed. [2025-09-29T17:41:44.506454] [INFO ] [MAIN ] BRO: Fetched primary data is valid. [2025-09-29T17:41:44.506527] [DEBUG] [LOCAL ] BRO: Saving primary data. [2025-09-29T17:41:44.508206] [DEBUG] [LOCAL ] BRO: Trimmed 74218 records to 51890 (keeping 200 days of data) [2025-09-29T17:41:44.904851] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-29T17:41:44.960955] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-29T17:41:44.978460] [DEBUG] [LOCAL ] BRO: Primary data saved (51890 records). [2025-09-29T17:41:44.978686] [INFO ] [MAIN ] BRO: Full history saved. [2025-09-29T17:41:44.979362] [INFO ] [MAIN ] Update Progress: 334/2371 symbols completed. BRO took 35.0s. Estimated remaining: 4h 14m 20s. Rate: 8.0 symbols/min [2025-09-29T17:41:45.099896] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-29T17:41:45.153216] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-09-29T17:41:45.192581] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:41:45.223136] [DEBUG] [LOCAL ] BRW: Loaded 19862 existing records from primary storage. [2025-09-29T17:41:45.223455] [INFO ] [MAIN ] BRW: Loaded 19862 existing records. [2025-09-29T17:41:45.438364] [WARN ] [MAIN ] BRW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:41:45.438632] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-09-29T17:41:45.438735] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-09-29T17:41:45.439045] [DEBUG] [LOCAL ] BRW: Deleted primary data file. [2025-09-29T17:41:45.439104] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-09-29T17:41:45.906904] [INFO ] [REMOTE ] BRW: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:41:45.948094] [INFO ] [REMOTE ] BRW: Fetching primary data for 2024-12. [2025-09-29T17:41:46.748169] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-09-29T17:41:47.187810] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-29T17:41:47.245716] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-29T17:41:47.364028] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-29T17:41:47.375315] [INFO ] [REMOTE ] BROS: Full fetch complete (77003 records). [2025-09-29T17:41:47.375473] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-09-29T17:41:47.551355] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-09-29T17:41:47.823255] [DEBUG] [VALIDATOR ] BROS: All expected trading days are present. [2025-09-29T17:41:47.823366] [DEBUG] [VALIDATOR ] BROS: Primary data validation passed. [2025-09-29T17:41:47.824569] [INFO ] [MAIN ] BROS: Fetched primary data is valid. [2025-09-29T17:41:47.824697] [DEBUG] [LOCAL ] BROS: Saving primary data. [2025-09-29T17:41:47.827293] [DEBUG] [LOCAL ] BROS: Trimmed 77003 records to 53289 (keeping 200 days of data) [2025-09-29T17:41:48.174699] [DEBUG] [LOCAL ] BROS: Primary data saved (53289 records). [2025-09-29T17:41:48.174846] [INFO ] [MAIN ] BROS: Full history saved. [2025-09-29T17:41:48.174930] [INFO ] [MAIN ] Update Progress: 335/2371 symbols completed. BROS took 33.9s. Estimated remaining: 4h 13m 46s. Rate: 8.0 symbols/min [2025-09-29T17:41:48.348500] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:41:48.348633] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-01. [2025-09-29T17:41:48.404112] [DEBUG] [LOCAL ] BRX: Loaded 52462 existing records from primary storage. [2025-09-29T17:41:48.404454] [INFO ] [MAIN ] BRX: Loaded 52462 existing records. [2025-09-29T17:41:48.594318] [WARN ] [MAIN ] BRX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:41:48.594637] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-09-29T17:41:48.594721] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-09-29T17:41:48.595219] [DEBUG] [LOCAL ] BRX: Deleted primary data file. [2025-09-29T17:41:48.595279] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-09-29T17:41:48.982504] [INFO ] [REMOTE ] BRX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:41:49.149560] [INFO ] [REMOTE ] BRX: Fetching primary data for 2024-12. [2025-09-29T17:41:49.152673] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-29T17:41:49.161896] [INFO ] [REMOTE ] BRSP: Full fetch complete (54094 records). [2025-09-29T17:41:49.162083] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-09-29T17:41:49.614365] [DEBUG] [VALIDATOR ] BRSP: All expected trading days are present. [2025-09-29T17:41:49.614474] [DEBUG] [VALIDATOR ] BRSP: Primary data validation passed. [2025-09-29T17:41:49.615286] [INFO ] [MAIN ] BRSP: Fetched primary data is valid. [2025-09-29T17:41:49.615368] [DEBUG] [LOCAL ] BRSP: Saving primary data. [2025-09-29T17:41:49.632915] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-29T17:41:49.640376] [DEBUG] [LOCAL ] BRSP: Trimmed 54094 records to 36849 (keeping 200 days of data) [2025-09-29T17:41:49.856608] [DEBUG] [LOCAL ] BRSP: Primary data saved (36849 records). [2025-09-29T17:41:49.856772] [INFO ] [MAIN ] BRSP: Full history saved. [2025-09-29T17:41:49.856858] [INFO ] [MAIN ] Update Progress: 336/2371 symbols completed. BRSP took 30.7s. Estimated remaining: 4h 13m 3s. Rate: 8.0 symbols/min [2025-09-29T17:41:49.953292] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-09-29T17:41:50.041218] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:41:50.075970] [DEBUG] [LOCAL ] BSAC: Loaded 33389 existing records from primary storage. [2025-09-29T17:41:50.076242] [INFO ] [MAIN ] BSAC: Loaded 33389 existing records. [2025-09-29T17:41:50.268111] [WARN ] [MAIN ] BSAC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:41:50.268340] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-09-29T17:41:50.268387] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-09-29T17:41:50.268722] [DEBUG] [LOCAL ] BSAC: Deleted primary data file. [2025-09-29T17:41:50.268783] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-09-29T17:41:50.666816] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:41:50.748083] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2024-12. [2025-09-29T17:41:51.014332] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-29T17:41:51.038098] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-29T17:41:51.548121] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-09-29T17:41:52.025071] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-29T17:41:52.348121] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-01. [2025-09-29T17:41:52.526069] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-29T17:41:53.148127] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-09-29T17:41:53.431108] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-29T17:41:53.921734] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-29T17:41:53.948072] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-09-29T17:41:54.748124] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-09-29T17:41:55.003151] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-29T17:41:55.548149] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-09-29T17:41:56.020400] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-29T17:41:56.180484] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-29T17:41:56.348153] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-09-29T17:41:57.148087] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-09-29T17:41:57.381584] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-29T17:41:57.915185] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-29T17:41:57.917050] [INFO ] [REMOTE ] BRT: Full fetch complete (6798 records). [2025-09-29T17:41:57.917140] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-09-29T17:41:57.953387] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-09-29T17:41:58.295512] [DEBUG] [VALIDATOR ] BRT: All expected trading days are present. [2025-09-29T17:41:58.295593] [DEBUG] [VALIDATOR ] BRT: Primary data validation passed. [2025-09-29T17:41:58.295808] [INFO ] [MAIN ] BRT: Fetched primary data is valid. [2025-09-29T17:41:58.295871] [DEBUG] [LOCAL ] BRT: Saving primary data. [2025-09-29T17:41:58.296307] [DEBUG] [LOCAL ] BRT: Trimmed 6798 records to 4966 (keeping 200 days of data) [2025-09-29T17:41:58.331853] [DEBUG] [LOCAL ] BRT: Primary data saved (4966 records). [2025-09-29T17:41:58.331995] [INFO ] [MAIN ] BRT: Full history saved. [2025-09-29T17:41:58.332105] [INFO ] [MAIN ] Update Progress: 337/2371 symbols completed. BRT took 33.7s. Estimated remaining: 4h 13m 2s. Rate: 8.0 symbols/min [2025-09-29T17:41:58.509222] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:41:58.555040] [DEBUG] [LOCAL ] BSBR: Loaded 35731 existing records from primary storage. [2025-09-29T17:41:58.555338] [INFO ] [MAIN ] BSBR: Loaded 35731 existing records. [2025-09-29T17:41:58.753193] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-01. [2025-09-29T17:41:58.785006] [WARN ] [MAIN ] BSBR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:41:58.785704] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-09-29T17:41:58.785764] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-09-29T17:41:58.786129] [DEBUG] [LOCAL ] BSBR: Deleted primary data file. [2025-09-29T17:41:58.786188] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-09-29T17:41:59.182901] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:41:59.248079] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-29T17:41:59.548127] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-09-29T17:42:00.348117] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-09-29T17:42:00.433816] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-29T17:42:00.811117] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-29T17:42:01.148117] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2024-12. [2025-09-29T17:42:01.772827] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-29T17:42:01.948130] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-09-29T17:42:02.748112] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-09-29T17:42:03.382826] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-29T17:42:03.445688] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-29T17:42:03.452108] [INFO ] [REMOTE ] BRW: Full fetch complete (29921 records). [2025-09-29T17:42:03.452256] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-09-29T17:42:03.556082] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-01. [2025-09-29T17:42:03.885468] [DEBUG] [VALIDATOR ] BRW: All expected trading days are present. [2025-09-29T17:42:03.885570] [DEBUG] [VALIDATOR ] BRW: Primary data validation passed. [2025-09-29T17:42:03.886046] [INFO ] [MAIN ] BRW: Fetched primary data is valid. [2025-09-29T17:42:03.886119] [DEBUG] [LOCAL ] BRW: Saving primary data. [2025-09-29T17:42:03.887135] [DEBUG] [LOCAL ] BRW: Trimmed 29921 records to 19790 (keeping 200 days of data) [2025-09-29T17:42:04.015946] [DEBUG] [LOCAL ] BRW: Primary data saved (19790 records). [2025-09-29T17:42:04.016154] [INFO ] [MAIN ] BRW: Full history saved. [2025-09-29T17:42:04.016293] [INFO ] [MAIN ] Update Progress: 338/2371 symbols completed. BRW took 19.0s. Estimated remaining: 4h 12m 44s. Rate: 8.0 symbols/min [2025-09-29T17:42:04.207385] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:42:04.217746] [DEBUG] [LOCAL ] BSL: Loaded 8196 existing records from primary storage. [2025-09-29T17:42:04.217980] [INFO ] [MAIN ] BSL: Loaded 8196 existing records. [2025-09-29T17:42:04.352203] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-09-29T17:42:04.442480] [WARN ] [MAIN ] BSL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:42:04.442915] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-09-29T17:42:04.443015] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-09-29T17:42:04.443311] [DEBUG] [LOCAL ] BSL: Deleted primary data file. [2025-09-29T17:42:04.443414] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-09-29T17:42:04.574170] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-29T17:42:04.857810] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:42:05.056487] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-29T17:42:05.148119] [INFO ] [REMOTE ] BSL: Fetching primary data for 2024-12. [2025-09-29T17:42:05.948084] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-09-29T17:42:06.002086] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-29T17:42:06.347281] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-29T17:42:06.748155] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-09-29T17:42:07.408939] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-29T17:42:07.475101] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-29T17:42:07.548172] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-09-29T17:42:08.348116] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-09-29T17:42:08.893958] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-29T17:42:09.148167] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-09-29T17:42:09.948154] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-09-29T17:42:10.055349] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-29T17:42:10.268769] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-29T17:42:10.748129] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-09-29T17:42:11.370342] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-29T17:42:11.548166] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-09-29T17:42:11.563953] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-29T17:42:12.348128] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-09-29T17:42:13.003322] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-29T17:42:13.140467] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-29T17:42:13.148059] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-09-29T17:42:13.872854] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-29T17:42:13.948142] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-09-29T17:42:14.621070] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-29T17:42:14.748155] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-09-29T17:42:15.548156] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-09-29T17:42:15.564915] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-29T17:42:16.348119] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-09-29T17:42:16.893048] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-29T17:42:16.918120] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-29T17:42:17.148148] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-09-29T17:42:17.948335] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-09-29T17:42:18.519805] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-29T17:42:18.529674] [INFO ] [REMOTE ] BSAC: Full fetch complete (43531 records). [2025-09-29T17:42:18.529894] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-09-29T17:42:18.748387] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-09-29T17:42:18.889738] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-29T17:42:18.939399] [INFO ] [REMOTE ] BSL: Full fetch complete (12723 records). [2025-09-29T17:42:18.965744] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-09-29T17:42:19.398705] [DEBUG] [VALIDATOR ] BSAC: All expected trading days are present. [2025-09-29T17:42:19.456837] [DEBUG] [VALIDATOR ] BSAC: Primary data validation passed. [2025-09-29T17:42:19.483382] [INFO ] [MAIN ] BSAC: Fetched primary data is valid. [2025-09-29T17:42:19.498821] [DEBUG] [LOCAL ] BSAC: Saving primary data. [2025-09-29T17:42:19.561221] [DEBUG] [LOCAL ] BSAC: Trimmed 43531 records to 32849 (keeping 200 days of data) [2025-09-29T17:42:19.550589] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-09-29T17:42:19.626026] [DEBUG] [VALIDATOR ] BSL: All expected trading days are present. [2025-09-29T17:42:19.626115] [DEBUG] [VALIDATOR ] BSL: Primary data validation passed. [2025-09-29T17:42:19.626281] [INFO ] [MAIN ] BSL: Fetched primary data is valid. [2025-09-29T17:42:19.626358] [DEBUG] [LOCAL ] BSL: Saving primary data. [2025-09-29T17:42:19.686278] [DEBUG] [LOCAL ] BSL: Trimmed 12723 records to 8156 (keeping 200 days of data) [2025-09-29T17:42:19.783796] [DEBUG] [LOCAL ] BSL: Primary data saved (8156 records). [2025-09-29T17:42:19.784535] [INFO ] [MAIN ] BSL: Full history saved. [2025-09-29T17:42:19.784966] [INFO ] [MAIN ] Update Progress: 339/2371 symbols completed. BSL took 15.8s. Estimated remaining: 4h 13m 26s. Rate: 8.0 symbols/min [2025-09-29T17:42:19.988274] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:42:20.099533] [DEBUG] [LOCAL ] BSM: Loaded 32809 existing records from primary storage. [2025-09-29T17:42:20.101690] [INFO ] [MAIN ] BSM: Loaded 32809 existing records. [2025-09-29T17:42:20.340382] [WARN ] [MAIN ] BSM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:42:20.341634] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-09-29T17:42:20.342515] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-09-29T17:42:20.344962] [DEBUG] [LOCAL ] BSM: Deleted primary data file. [2025-09-29T17:42:20.345452] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-09-29T17:42:20.360175] [DEBUG] [LOCAL ] BSAC: Primary data saved (32849 records). [2025-09-29T17:42:20.370822] [INFO ] [MAIN ] BSAC: Full history saved. [2025-09-29T17:42:20.382070] [INFO ] [MAIN ] Update Progress: 340/2371 symbols completed. BSAC took 30.5s. Estimated remaining: 4h 12m 38s. Rate: 8.0 symbols/min [2025-09-29T17:42:20.769223] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:42:20.880580] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-29T17:42:20.955210] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-09-29T17:42:20.980075] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:42:20.994724] [DEBUG] [LOCAL ] BST: Loaded 19385 existing records from primary storage. [2025-09-29T17:42:20.994950] [INFO ] [MAIN ] BST: Loaded 19385 existing records. [2025-09-29T17:42:21.150598] [INFO ] [REMOTE ] BSM: Fetching primary data for 2024-12. [2025-09-29T17:42:21.193630] [WARN ] [MAIN ] BST: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:42:21.194444] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-09-29T17:42:21.194572] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-09-29T17:42:21.210087] [DEBUG] [LOCAL ] BST: Deleted primary data file. [2025-09-29T17:42:21.213919] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-29T17:42:21.214012] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-09-29T17:42:21.617558] [INFO ] [REMOTE ] BST: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:42:21.948151] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-09-29T17:42:22.520975] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-29T17:42:22.603543] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-29T17:42:22.748133] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-09-29T17:42:22.817258] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-29T17:42:23.548128] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-09-29T17:42:24.005507] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-29T17:42:24.348139] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-09-29T17:42:25.044187] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-29T17:42:25.148138] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-09-29T17:42:25.595006] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-29T17:42:25.948138] [INFO ] [REMOTE ] BST: Fetching primary data for 2024-12. [2025-09-29T17:42:26.465182] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-29T17:42:26.748138] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-09-29T17:42:27.058117] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-29T17:42:27.548164] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-01. [2025-09-29T17:42:27.801019] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-29T17:42:28.308815] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-29T17:42:28.348145] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-09-29T17:42:29.148153] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-09-29T17:42:29.742179] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-29T17:42:29.948142] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-09-29T17:42:30.748144] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-09-29T17:42:30.997702] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-29T17:42:31.059884] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-29T17:42:31.548214] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-09-29T17:42:32.142534] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-29T17:42:32.348146] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-09-29T17:42:32.757109] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-29T17:42:33.148115] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-09-29T17:42:33.894618] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-29T17:42:33.948117] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-09-29T17:42:34.754728] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-09-29T17:42:34.778743] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-29T17:42:34.960538] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-29T17:42:35.548179] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-09-29T17:42:35.976935] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-29T17:42:36.348116] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-09-29T17:42:36.788815] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-29T17:42:36.800471] [INFO ] [REMOTE ] BSBR: Full fetch complete (50644 records). [2025-09-29T17:42:36.800669] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-09-29T17:42:37.153289] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-09-29T17:42:37.248006] [DEBUG] [VALIDATOR ] BSBR: All expected trading days are present. [2025-09-29T17:42:37.248127] [DEBUG] [VALIDATOR ] BSBR: Primary data validation passed. [2025-09-29T17:42:37.248944] [INFO ] [MAIN ] BSBR: Fetched primary data is valid. [2025-09-29T17:42:37.249038] [DEBUG] [LOCAL ] BSBR: Saving primary data. [2025-09-29T17:42:37.250420] [DEBUG] [LOCAL ] BSBR: Trimmed 50644 records to 35252 (keeping 200 days of data) [2025-09-29T17:42:37.474197] [DEBUG] [LOCAL ] BSBR: Primary data saved (35252 records). [2025-09-29T17:42:37.474342] [INFO ] [MAIN ] BSBR: Full history saved. [2025-09-29T17:42:37.474454] [INFO ] [MAIN ] Update Progress: 341/2371 symbols completed. BSBR took 39.1s. Estimated remaining: 4h 13m 27s. Rate: 8.0 symbols/min [2025-09-29T17:42:37.664215] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:42:37.689783] [DEBUG] [LOCAL ] BSTZ: Loaded 25188 existing records from primary storage. [2025-09-29T17:42:37.690064] [INFO ] [MAIN ] BSTZ: Loaded 25188 existing records. [2025-09-29T17:42:37.914884] [WARN ] [MAIN ] BSTZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:42:37.915181] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-09-29T17:42:37.915275] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-09-29T17:42:37.915696] [DEBUG] [LOCAL ] BSTZ: Deleted primary data file. [2025-09-29T17:42:37.915761] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-09-29T17:42:37.951957] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-09-29T17:42:38.304964] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:42:38.337444] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-29T17:42:38.348752] [INFO ] [REMOTE ] BRX: Full fetch complete (74910 records). [2025-09-29T17:42:38.348946] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-09-29T17:42:38.492306] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-29T17:42:38.755001] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-09-29T17:42:38.809303] [DEBUG] [VALIDATOR ] BRX: All expected trading days are present. [2025-09-29T17:42:38.809403] [DEBUG] [VALIDATOR ] BRX: Primary data validation passed. [2025-09-29T17:42:38.810404] [INFO ] [MAIN ] BRX: Fetched primary data is valid. [2025-09-29T17:42:38.810492] [DEBUG] [LOCAL ] BRX: Saving primary data. [2025-09-29T17:42:38.812150] [DEBUG] [LOCAL ] BRX: Trimmed 74910 records to 51703 (keeping 200 days of data) [2025-09-29T17:42:39.140956] [DEBUG] [LOCAL ] BRX: Primary data saved (51703 records). [2025-09-29T17:42:39.141112] [INFO ] [MAIN ] BRX: Full history saved. [2025-09-29T17:42:39.141228] [INFO ] [MAIN ] Update Progress: 342/2371 symbols completed. BRX took 51.0s. Estimated remaining: 4h 12m 45s. Rate: 8.0 symbols/min [2025-09-29T17:42:39.328168] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:42:39.385388] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-29T17:42:39.415263] [DEBUG] [LOCAL ] BSX: Loaded 54468 existing records from primary storage. [2025-09-29T17:42:39.415709] [INFO ] [MAIN ] BSX: Loaded 54468 existing records. [2025-09-29T17:42:39.553260] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2024-12. [2025-09-29T17:42:39.620914] [WARN ] [MAIN ] BSX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:42:39.621261] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-09-29T17:42:39.621337] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-09-29T17:42:39.621933] [DEBUG] [LOCAL ] BSX: Deleted primary data file. [2025-09-29T17:42:39.621994] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-09-29T17:42:39.913383] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-29T17:42:40.028805] [INFO ] [REMOTE ] BSX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:42:40.348125] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-09-29T17:42:40.854768] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-29T17:42:41.148172] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-09-29T17:42:41.389501] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-29T17:42:41.948184] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-09-29T17:42:42.476871] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-29T17:42:42.748178] [INFO ] [REMOTE ] BSX: Fetching primary data for 2024-12. [2025-09-29T17:42:43.135624] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-29T17:42:43.548118] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-09-29T17:42:44.348133] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-09-29T17:42:44.650037] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-29T17:42:45.014530] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-29T17:42:45.148187] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-09-29T17:42:45.420138] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-29T17:42:45.948116] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-01. [2025-09-29T17:42:46.181347] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-29T17:42:46.748162] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-09-29T17:42:47.548090] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-09-29T17:42:47.667686] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-29T17:42:47.820209] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-29T17:42:48.348111] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-09-29T17:42:49.008804] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-29T17:42:49.013327] [INFO ] [REMOTE ] BST: Full fetch complete (28764 records). [2025-09-29T17:42:49.013441] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-09-29T17:42:49.162554] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-09-29T17:42:49.423102] [DEBUG] [VALIDATOR ] BST: All expected trading days are present. [2025-09-29T17:42:49.423234] [DEBUG] [VALIDATOR ] BST: Primary data validation passed. [2025-09-29T17:42:49.423819] [INFO ] [MAIN ] BST: Fetched primary data is valid. [2025-09-29T17:42:49.423883] [DEBUG] [LOCAL ] BST: Saving primary data. [2025-09-29T17:42:49.424603] [DEBUG] [LOCAL ] BST: Trimmed 28764 records to 18957 (keeping 200 days of data) [2025-09-29T17:42:49.551805] [DEBUG] [LOCAL ] BST: Primary data saved (18957 records). [2025-09-29T17:42:49.552041] [INFO ] [MAIN ] BST: Full history saved. [2025-09-29T17:42:49.552156] [INFO ] [MAIN ] Update Progress: 343/2371 symbols completed. BST took 29.2s. Estimated remaining: 4h 12m 55s. Rate: 8.0 symbols/min [2025-09-29T17:42:49.730909] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-29T17:42:49.753631] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:42:49.770488] [DEBUG] [LOCAL ] BTA: Loaded 5464 existing records from primary storage. [2025-09-29T17:42:49.770805] [INFO ] [MAIN ] BTA: Loaded 5464 existing records. [2025-09-29T17:42:49.951418] [WARN ] [MAIN ] BTA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:42:49.951635] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-09-29T17:42:49.952405] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-09-29T17:42:49.953676] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-09-29T17:42:49.954131] [DEBUG] [LOCAL ] BTA: Deleted primary data file. [2025-09-29T17:42:49.954195] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-09-29T17:42:50.392162] [INFO ] [REMOTE ] BTA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:42:50.473489] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-29T17:42:50.481809] [INFO ] [REMOTE ] BSM: Full fetch complete (47550 records). [2025-09-29T17:42:50.482069] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-09-29T17:42:50.755906] [INFO ] [REMOTE ] BTA: Fetching primary data for 2024-12. [2025-09-29T17:42:50.898788] [DEBUG] [VALIDATOR ] BSM: All expected trading days are present. [2025-09-29T17:42:50.899090] [DEBUG] [VALIDATOR ] BSM: Primary data validation passed. [2025-09-29T17:42:50.899726] [INFO ] [MAIN ] BSM: Fetched primary data is valid. [2025-09-29T17:42:50.899795] [DEBUG] [LOCAL ] BSM: Saving primary data. [2025-09-29T17:42:50.901043] [DEBUG] [LOCAL ] BSM: Trimmed 47550 records to 32184 (keeping 200 days of data) [2025-09-29T17:42:51.101679] [DEBUG] [LOCAL ] BSM: Primary data saved (32184 records). [2025-09-29T17:42:51.101845] [INFO ] [MAIN ] BSM: Full history saved. [2025-09-29T17:42:51.101932] [INFO ] [MAIN ] Update Progress: 344/2371 symbols completed. BSM took 31.3s. Estimated remaining: 4h 12m 13s. Rate: 8.0 symbols/min [2025-09-29T17:42:51.287316] [INFO ] [MAIN ] BTCM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:42:51.303672] [DEBUG] [LOCAL ] BTCM: Loaded 15122 existing records from primary storage. [2025-09-29T17:42:51.303939] [INFO ] [MAIN ] BTCM: Loaded 15122 existing records. [2025-09-29T17:42:51.517905] [WARN ] [MAIN ] BTCM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:42:51.518312] [INFO ] [MAIN ] BTCM: Wiping existing primary data before full refresh. [2025-09-29T17:42:51.518385] [INFO ] [LOCAL ] BTCM: Starting deletion of primary data. [2025-09-29T17:42:51.518735] [DEBUG] [LOCAL ] BTCM: Deleted primary data file. [2025-09-29T17:42:51.518887] [INFO ] [MAIN ] BTCM: Starting full primary refresh. [2025-09-29T17:42:51.552697] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-09-29T17:42:51.658075] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-29T17:42:51.674778] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-29T17:42:51.964418] [INFO ] [REMOTE ] BTCM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:42:52.348140] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-01. [2025-09-29T17:42:53.148137] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2024-12. [2025-09-29T17:42:53.183587] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-29T17:42:53.546437] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-29T17:42:53.948112] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-09-29T17:42:54.364880] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-29T17:42:54.748116] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-01. [2025-09-29T17:42:55.475720] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-29T17:42:55.548094] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-02. [2025-09-29T17:42:56.002374] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-29T17:42:56.003384] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-29T17:42:56.348117] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-09-29T17:42:57.148136] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-03. [2025-09-29T17:42:57.761613] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-29T17:42:57.948115] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-09-29T17:42:58.403353] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-29T17:42:58.748119] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-09-29T17:42:59.090387] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-29T17:42:59.505484] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-29T17:42:59.548117] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-09-29T17:43:00.348112] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-09-29T17:43:00.829435] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-29T17:43:00.949218] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-29T17:43:01.148112] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-04. [2025-09-29T17:43:01.863320] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-29T17:43:01.948127] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-05. [2025-09-29T17:43:02.686239] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-29T17:43:02.748108] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-09-29T17:43:03.488430] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-29T17:43:03.548139] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-09-29T17:43:04.195788] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-29T17:43:04.348119] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-09-29T17:43:04.940129] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-29T17:43:05.148111] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-09-29T17:43:05.948151] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-06. [2025-09-29T17:43:06.502265] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-29T17:43:06.713811] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-29T17:43:06.748086] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-07. [2025-09-29T17:43:07.548137] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-09-29T17:43:08.348102] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-09-29T17:43:08.662545] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-29T17:43:08.725849] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-29T17:43:08.963925] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-29T17:43:09.148110] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-09-29T17:43:09.948127] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-09-29T17:43:10.423070] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-29T17:43:10.428957] [INFO ] [REMOTE ] BSTZ: Full fetch complete (36664 records). [2025-09-29T17:43:10.429127] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-09-29T17:43:10.753219] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-09-29T17:43:10.880096] [DEBUG] [VALIDATOR ] BSTZ: All expected trading days are present. [2025-09-29T17:43:10.880191] [DEBUG] [VALIDATOR ] BSTZ: Primary data validation passed. [2025-09-29T17:43:10.880763] [INFO ] [MAIN ] BSTZ: Fetched primary data is valid. [2025-09-29T17:43:10.880833] [DEBUG] [LOCAL ] BSTZ: Saving primary data. [2025-09-29T17:43:10.881989] [DEBUG] [LOCAL ] BSTZ: Trimmed 36664 records to 24704 (keeping 200 days of data) [2025-09-29T17:43:11.064066] [DEBUG] [LOCAL ] BSTZ: Primary data saved (24704 records). [2025-09-29T17:43:11.064281] [INFO ] [MAIN ] BSTZ: Full history saved. [2025-09-29T17:43:11.064463] [INFO ] [MAIN ] Update Progress: 345/2371 symbols completed. BSTZ took 33.6s. Estimated remaining: 4h 13m 19s. Rate: 8.0 symbols/min [2025-09-29T17:43:11.284122] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-29T17:43:11.364989] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:43:11.449930] [DEBUG] [LOCAL ] BTE: Loaded 53505 existing records from primary storage. [2025-09-29T17:43:11.450463] [INFO ] [MAIN ] BTE: Loaded 53505 existing records. [2025-09-29T17:43:11.561166] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-08. [2025-09-29T17:43:11.757337] [WARN ] [MAIN ] BTE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:43:11.757691] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-09-29T17:43:11.757765] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-09-29T17:43:11.758258] [DEBUG] [LOCAL ] BTE: Deleted primary data file. [2025-09-29T17:43:11.758331] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-09-29T17:43:12.245822] [INFO ] [REMOTE ] BTE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:43:12.283216] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-09-29T17:43:12.348122] [INFO ] [REMOTE ] BTE: Fetching primary data for 2024-12. [2025-09-29T17:43:12.707629] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-29T17:43:13.148164] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-09-29T17:43:13.948122] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-09. [2025-09-29T17:43:14.050165] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-29T17:43:14.052197] [INFO ] [REMOTE ] BTA: Full fetch complete (9608 records). [2025-09-29T17:43:14.052287] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-09-29T17:43:14.495891] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-29T17:43:14.493715] [DEBUG] [VALIDATOR ] BTA: All expected trading days are present. [2025-09-29T17:43:14.506905] [DEBUG] [VALIDATOR ] BTA: Primary data validation passed. [2025-09-29T17:43:14.507230] [INFO ] [MAIN ] BTA: Fetched primary data is valid. [2025-09-29T17:43:14.507318] [DEBUG] [LOCAL ] BTA: Saving primary data. [2025-09-29T17:43:14.507887] [DEBUG] [LOCAL ] BTA: Trimmed 9608 records to 5413 (keeping 200 days of data) [2025-09-29T17:43:14.542874] [DEBUG] [LOCAL ] BTA: Primary data saved (5413 records). [2025-09-29T17:43:14.543007] [INFO ] [MAIN ] BTA: Full history saved. [2025-09-29T17:43:14.543095] [INFO ] [MAIN ] Update Progress: 346/2371 symbols completed. BTA took 25.0s. Estimated remaining: 4h 12m 48s. Rate: 8.0 symbols/min [2025-09-29T17:43:14.738825] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:43:14.748089] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-01. [2025-09-29T17:43:14.800349] [DEBUG] [LOCAL ] BTI: Loaded 54335 existing records from primary storage. [2025-09-29T17:43:14.800749] [INFO ] [MAIN ] BTI: Loaded 54335 existing records. [2025-09-29T17:43:14.994016] [WARN ] [MAIN ] BTI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:43:14.994303] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-09-29T17:43:14.994362] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-09-29T17:43:14.996631] [DEBUG] [LOCAL ] BTI: Deleted primary data file. [2025-09-29T17:43:14.996719] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-09-29T17:43:15.348334] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-29T17:43:15.407174] [INFO ] [REMOTE ] BTCM: Full fetch complete (19406 records). [2025-09-29T17:43:15.421707] [DEBUG] [VALIDATOR ] BTCM: Validating primary data. [2025-09-29T17:43:15.427595] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:43:15.553266] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-09-29T17:43:15.825213] [DEBUG] [VALIDATOR ] BTCM: All expected trading days are present. [2025-09-29T17:43:15.825299] [DEBUG] [VALIDATOR ] BTCM: Primary data validation passed. [2025-09-29T17:43:15.825727] [INFO ] [MAIN ] BTCM: Fetched primary data is valid. [2025-09-29T17:43:15.825826] [DEBUG] [LOCAL ] BTCM: Saving primary data. [2025-09-29T17:43:15.826591] [DEBUG] [LOCAL ] BTCM: Trimmed 19406 records to 15156 (keeping 200 days of data) [2025-09-29T17:43:15.916211] [DEBUG] [LOCAL ] BTCM: Primary data saved (15156 records). [2025-09-29T17:43:15.916362] [INFO ] [MAIN ] BTCM: Full history saved. [2025-09-29T17:43:15.916447] [INFO ] [MAIN ] Update Progress: 347/2371 symbols completed. BTCM took 24.8s. Estimated remaining: 4h 12m 5s. Rate: 8.0 symbols/min [2025-09-29T17:43:16.090635] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:43:16.101185] [DEBUG] [LOCAL ] BTO: Loaded 8982 existing records from primary storage. [2025-09-29T17:43:16.101420] [INFO ] [MAIN ] BTO: Loaded 8982 existing records. [2025-09-29T17:43:16.294087] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:43:16.294442] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-09-29T17:43:16.294499] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-09-29T17:43:16.294769] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-09-29T17:43:16.294828] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-09-29T17:43:16.361386] [INFO ] [REMOTE ] BTI: Fetching primary data for 2024-12. [2025-09-29T17:43:16.708718] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-29T17:43:16.805321] [INFO ] [REMOTE ] BTO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:43:17.148163] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-09-29T17:43:17.455924] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-29T17:43:17.948135] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-09-29T17:43:18.557000] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-09-29T17:43:18.573590] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-29T17:43:18.748165] [INFO ] [REMOTE ] BTO: Fetching primary data for 2024-12. [2025-09-29T17:43:19.452610] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-29T17:43:19.548083] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-09-29T17:43:19.653567] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-29T17:43:20.348148] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-09-29T17:43:21.106151] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-29T17:43:21.148129] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-09-29T17:43:21.948161] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-09-29T17:43:22.342731] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-29T17:43:22.748147] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-09-29T17:43:22.928510] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-29T17:43:23.548129] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-01. [2025-09-29T17:43:23.892506] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-29T17:43:24.042483] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-29T17:43:24.348139] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-09-29T17:43:24.643621] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-29T17:43:24.655377] [INFO ] [REMOTE ] BSX: Full fetch complete (77695 records). [2025-09-29T17:43:24.655579] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-09-29T17:43:25.087742] [DEBUG] [VALIDATOR ] BSX: All expected trading days are present. [2025-09-29T17:43:25.087861] [DEBUG] [VALIDATOR ] BSX: Primary data validation passed. [2025-09-29T17:43:25.088777] [INFO ] [MAIN ] BSX: Fetched primary data is valid. [2025-09-29T17:43:25.088845] [DEBUG] [LOCAL ] BSX: Saving primary data. [2025-09-29T17:43:25.090440] [DEBUG] [LOCAL ] BSX: Trimmed 77695 records to 53688 (keeping 200 days of data) [2025-09-29T17:43:25.153279] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-09-29T17:43:25.458434] [DEBUG] [LOCAL ] BSX: Primary data saved (53688 records). [2025-09-29T17:43:25.458611] [INFO ] [MAIN ] BSX: Full history saved. [2025-09-29T17:43:25.458759] [INFO ] [MAIN ] Update Progress: 348/2371 symbols completed. BSX took 46.3s. Estimated remaining: 4h 12m 9s. Rate: 8.0 symbols/min [2025-09-29T17:43:25.650889] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:43:25.669399] [DEBUG] [LOCAL ] BTT: Loaded 16126 existing records from primary storage. [2025-09-29T17:43:25.669681] [INFO ] [MAIN ] BTT: Loaded 16126 existing records. [2025-09-29T17:43:25.886132] [WARN ] [MAIN ] BTT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:43:25.886481] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-09-29T17:43:25.886592] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-09-29T17:43:25.886996] [DEBUG] [LOCAL ] BTT: Deleted primary data file. [2025-09-29T17:43:25.887179] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-09-29T17:43:25.955817] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-09-29T17:43:26.026868] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-29T17:43:26.252042] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-29T17:43:26.340717] [INFO ] [REMOTE ] BTT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:43:26.748119] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-09-29T17:43:27.548135] [INFO ] [REMOTE ] BTT: Fetching primary data for 2024-12. [2025-09-29T17:43:27.569670] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-29T17:43:27.822344] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-29T17:43:28.348127] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-09-29T17:43:28.960252] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-29T17:43:29.148134] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-01. [2025-09-29T17:43:29.948105] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-09-29T17:43:30.107264] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-29T17:43:30.513172] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-29T17:43:30.610621] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-29T17:43:30.748129] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-09-29T17:43:31.519755] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-29T17:43:31.548135] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-09-29T17:43:32.348151] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-09-29T17:43:32.365569] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-29T17:43:33.148130] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-09-29T17:43:33.948126] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-09-29T17:43:34.113399] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-29T17:43:34.157839] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-29T17:43:34.748174] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-09-29T17:43:35.548126] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-09-29T17:43:36.102449] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-29T17:43:36.303768] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-29T17:43:36.348091] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-09-29T17:43:36.593930] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-29T17:43:37.148102] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-09-29T17:43:37.302350] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-29T17:43:37.948122] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-09-29T17:43:38.748079] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-09-29T17:43:38.858711] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-29T17:43:39.508430] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-29T17:43:39.548119] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-09-29T17:43:40.326019] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-09-29T17:43:40.347808] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-29T17:43:40.349910] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-09-29T17:43:40.351547] [INFO ] [REMOTE ] BTO: Full fetch complete (13309 records). [2025-09-29T17:43:40.351676] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-09-29T17:43:40.770105] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-09-29T17:43:40.770239] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-09-29T17:43:40.770740] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-09-29T17:43:40.770809] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-09-29T17:43:40.771432] [DEBUG] [LOCAL ] BTO: Trimmed 13309 records to 8806 (keeping 200 days of data) [2025-09-29T17:43:40.831865] [DEBUG] [LOCAL ] BTO: Primary data saved (8806 records). [2025-09-29T17:43:40.832088] [INFO ] [MAIN ] BTO: Full history saved. [2025-09-29T17:43:40.832200] [INFO ] [MAIN ] Update Progress: 349/2371 symbols completed. BTO took 24.9s. Estimated remaining: 4h 12m 47s. Rate: 8.0 symbols/min [2025-09-29T17:43:41.009306] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:43:41.082494] [DEBUG] [LOCAL ] BTU: Loaded 54082 existing records from primary storage. [2025-09-29T17:43:41.082978] [INFO ] [MAIN ] BTU: Loaded 54082 existing records. [2025-09-29T17:43:41.153341] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-09-29T17:43:41.286288] [WARN ] [MAIN ] BTU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:43:41.286920] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-09-29T17:43:41.286997] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-09-29T17:43:41.288125] [DEBUG] [LOCAL ] BTU: Deleted primary data file. [2025-09-29T17:43:41.288187] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-09-29T17:43:41.650251] [INFO ] [REMOTE ] BTU: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:43:41.948133] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-09-29T17:43:42.263020] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-29T17:43:42.274490] [INFO ] [REMOTE ] BTE: Full fetch complete (76020 records). [2025-09-29T17:43:42.274776] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-09-29T17:43:42.677899] [DEBUG] [VALIDATOR ] BTE: All expected trading days are present. [2025-09-29T17:43:42.678000] [DEBUG] [VALIDATOR ] BTE: Primary data validation passed. [2025-09-29T17:43:42.678822] [INFO ] [MAIN ] BTE: Fetched primary data is valid. [2025-09-29T17:43:42.678889] [DEBUG] [LOCAL ] BTE: Saving primary data. [2025-09-29T17:43:42.680495] [DEBUG] [LOCAL ] BTE: Trimmed 76020 records to 52726 (keeping 200 days of data) [2025-09-29T17:43:42.774936] [INFO ] [REMOTE ] BTU: Fetching primary data for 2024-12. [2025-09-29T17:43:43.017814] [DEBUG] [LOCAL ] BTE: Primary data saved (52726 records). [2025-09-29T17:43:43.018006] [INFO ] [MAIN ] BTE: Full history saved. [2025-09-29T17:43:43.018123] [INFO ] [MAIN ] Update Progress: 350/2371 symbols completed. BTE took 32.0s. Estimated remaining: 4h 12m 9s. Rate: 8.0 symbols/min [2025-09-29T17:43:43.206921] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:43:43.207269] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-09-29T17:43:43.207390] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-09-29T17:43:43.207543] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-09-29T17:43:43.207619] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-09-29T17:43:43.207856] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-09-29T17:43:43.207968] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-09-29T17:43:43.490352] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-29T17:43:43.568058] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-09-29T17:43:43.575866] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-09-29T17:43:43.672738] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:43:44.343742] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-29T17:43:44.354021] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-09-29T17:43:44.458010] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-29T17:43:45.148107] [INFO ] [REMOTE ] BTX: Fetching primary data for 2024-12. [2025-09-29T17:43:45.347016] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T17:43:45.347381] [WARN ] [REMOTE ] BTX: No data returned for month 2024-12 [2025-09-29T17:43:45.347482] [FATAL] [REMOTE ] BTX: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T17:43:45.347531] [FATAL] [MAIN ] BTX: Failed to fetch primary data. [2025-09-29T17:43:45.347591] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T17:43:45.347706] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-09-29T17:43:45.347789] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-09-29T17:43:45.347861] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-09-29T17:43:45.347954] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-09-29T17:43:45.348027] [INFO ] [MAIN ] Update Progress: 351/2371 symbols completed. BTX took 2.3s. Estimated remaining: 4h 11m 32s. Rate: 8.0 symbols/min [2025-09-29T17:43:45.522223] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:43:45.550159] [DEBUG] [LOCAL ] BTZ: Loaded 23002 existing records from primary storage. [2025-09-29T17:43:45.550416] [INFO ] [MAIN ] BTZ: Loaded 23002 existing records. [2025-09-29T17:43:45.731206] [WARN ] [MAIN ] BTZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:43:45.731481] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-09-29T17:43:45.731534] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-09-29T17:43:45.731943] [DEBUG] [LOCAL ] BTZ: Deleted primary data file. [2025-09-29T17:43:45.732004] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-09-29T17:43:45.953911] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-01. [2025-09-29T17:43:46.104254] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:43:46.369927] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-29T17:43:46.748118] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-09-29T17:43:47.548095] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-09-29T17:43:47.676477] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-29T17:43:47.746281] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-29T17:43:48.348126] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2024-12. [2025-09-29T17:43:49.148123] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-09-29T17:43:49.609488] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-29T17:43:49.663935] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-29T17:43:49.948096] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-09-29T17:43:50.137494] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-29T17:43:50.748150] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-09-29T17:43:51.548127] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-09-29T17:43:52.081630] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-29T17:43:52.093076] [INFO ] [REMOTE ] BTI: Full fetch complete (77428 records). [2025-09-29T17:43:52.093219] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-09-29T17:43:52.349568] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-09-29T17:43:52.517774] [DEBUG] [VALIDATOR ] BTI: All expected trading days are present. [2025-09-29T17:43:52.517890] [DEBUG] [VALIDATOR ] BTI: Primary data validation passed. [2025-09-29T17:43:52.518743] [INFO ] [MAIN ] BTI: Fetched primary data is valid. [2025-09-29T17:43:52.518823] [DEBUG] [LOCAL ] BTI: Saving primary data. [2025-09-29T17:43:52.559227] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-29T17:43:52.556755] [DEBUG] [LOCAL ] BTI: Trimmed 77428 records to 53554 (keeping 200 days of data) [2025-09-29T17:43:52.560304] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-29T17:43:52.904891] [DEBUG] [LOCAL ] BTI: Primary data saved (53554 records). [2025-09-29T17:43:52.905053] [INFO ] [MAIN ] BTI: Full history saved. [2025-09-29T17:43:52.905203] [INFO ] [MAIN ] Update Progress: 352/2371 symbols completed. BTI took 38.4s. Estimated remaining: 4h 11m 25s. Rate: 8.0 symbols/min [2025-09-29T17:43:53.094563] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:43:53.151252] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-09-29T17:43:53.153759] [DEBUG] [LOCAL ] BUD: Loaded 53504 existing records from primary storage. [2025-09-29T17:43:53.154271] [INFO ] [MAIN ] BUD: Loaded 53504 existing records. [2025-09-29T17:43:53.363006] [WARN ] [MAIN ] BUD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:43:53.363430] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-09-29T17:43:53.363775] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-09-29T17:43:53.364275] [DEBUG] [LOCAL ] BUD: Deleted primary data file. [2025-09-29T17:43:53.364339] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-09-29T17:43:53.666246] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-29T17:43:53.788760] [INFO ] [REMOTE ] BUD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:43:53.948109] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-09-29T17:43:54.534132] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-29T17:43:54.538336] [INFO ] [REMOTE ] BTT: Full fetch complete (24204 records). [2025-09-29T17:43:54.538440] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-09-29T17:43:54.538979] [FATAL] [VALIDATOR ] BTT: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:43:54.539062] [FATAL] [MAIN ] BTT: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:43:54.539106] [WARN ] [MAIN ] BTT: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:43:54.539171] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-09-29T17:43:54.539238] [DEBUG] [LOCAL ] BTT: No primary data file found to delete. [2025-09-29T17:43:54.539274] [INFO ] [LOCAL ] BTT: Starting deletion of derivative data. [2025-09-29T17:43:54.539719] [DEBUG] [LOCAL ] BTT: Deleted derivative data file. [2025-09-29T17:43:54.539866] [INFO ] [MAIN ] Update Progress: 353/2371 symbols completed. BTT took 29.1s. Estimated remaining: 4h 10m 44s. Rate: 8.0 symbols/min [2025-09-29T17:43:54.728784] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:43:54.746723] [DEBUG] [LOCAL ] BUI: Loaded 11615 existing records from primary storage. [2025-09-29T17:43:54.746966] [INFO ] [MAIN ] BUI: Loaded 11615 existing records. [2025-09-29T17:43:54.758122] [INFO ] [REMOTE ] BUD: Fetching primary data for 2024-12. [2025-09-29T17:43:54.932776] [WARN ] [MAIN ] BUI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:43:54.932995] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-09-29T17:43:54.933044] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-09-29T17:43:54.933282] [DEBUG] [LOCAL ] BUI: Deleted primary data file. [2025-09-29T17:43:54.933362] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-09-29T17:43:55.297825] [INFO ] [REMOTE ] BUI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:43:55.548093] [INFO ] [REMOTE ] BUI: Fetching primary data for 2024-12. [2025-09-29T17:43:55.884496] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-29T17:43:56.348074] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-09-29T17:43:56.502179] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-29T17:43:56.752603] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-29T17:43:57.148111] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-01. [2025-09-29T17:43:57.948091] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-09-29T17:43:58.091621] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-29T17:43:58.417537] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-29T17:43:58.708231] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-29T17:43:58.748072] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-09-29T17:43:59.548127] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-09-29T17:43:59.951327] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-29T17:44:00.348106] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-09-29T17:44:01.148078] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-09-29T17:44:01.222386] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-29T17:44:01.349750] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-29T17:44:01.948123] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-01. [2025-09-29T17:44:02.432341] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-29T17:44:02.748116] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-09-29T17:44:03.542151] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-29T17:44:03.548176] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-09-29T17:44:03.749412] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-29T17:44:04.348114] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-09-29T17:44:05.148169] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-09-29T17:44:05.424497] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-29T17:44:05.489608] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-29T17:44:05.948138] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-09-29T17:44:06.748132] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-09-29T17:44:06.919846] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-29T17:44:07.031977] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-29T17:44:07.548121] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-09-29T17:44:08.348093] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-09-29T17:44:08.531146] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-29T17:44:08.664257] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-29T17:44:09.148131] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-09-29T17:44:09.380223] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-29T17:44:09.948136] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-09-29T17:44:10.420141] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-29T17:44:10.748164] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-09-29T17:44:11.548150] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-09-29T17:44:11.838347] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-29T17:44:11.950173] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-29T17:44:11.955251] [INFO ] [REMOTE ] BTZ: Full fetch complete (33686 records). [2025-09-29T17:44:11.955356] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-09-29T17:44:12.348816] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-09-29T17:44:12.390577] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-09-29T17:44:12.390717] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-09-29T17:44:12.391274] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-09-29T17:44:12.391393] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-09-29T17:44:12.401788] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-29T17:44:12.405906] [DEBUG] [LOCAL ] BTZ: Trimmed 33686 records to 22647 (keeping 200 days of data) [2025-09-29T17:44:12.566631] [DEBUG] [LOCAL ] BTZ: Primary data saved (22647 records). [2025-09-29T17:44:12.566766] [INFO ] [MAIN ] BTZ: Full history saved. [2025-09-29T17:44:12.566868] [INFO ] [MAIN ] Update Progress: 354/2371 symbols completed. BTZ took 27.2s. Estimated remaining: 4h 11m 37s. Rate: 8.0 symbols/min [2025-09-29T17:44:12.751909] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:44:12.805020] [DEBUG] [LOCAL ] BUR: Loaded 45700 existing records from primary storage. [2025-09-29T17:44:12.805354] [INFO ] [MAIN ] BUR: Loaded 45700 existing records. [2025-09-29T17:44:12.996730] [WARN ] [MAIN ] BUR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:44:12.996940] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-09-29T17:44:12.996989] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-09-29T17:44:12.999751] [DEBUG] [LOCAL ] BUR: Deleted primary data file. [2025-09-29T17:44:12.999821] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-09-29T17:44:13.153775] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-09-29T17:44:13.385779] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:44:13.948130] [INFO ] [REMOTE ] BUR: Fetching primary data for 2024-12. [2025-09-29T17:44:14.440870] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-29T17:44:14.453778] [INFO ] [REMOTE ] BTU: Full fetch complete (76865 records). [2025-09-29T17:44:14.453958] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-09-29T17:44:14.757455] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-09-29T17:44:14.881078] [DEBUG] [VALIDATOR ] BTU: All expected trading days are present. [2025-09-29T17:44:14.881172] [DEBUG] [VALIDATOR ] BTU: Primary data validation passed. [2025-09-29T17:44:14.882003] [INFO ] [MAIN ] BTU: Fetched primary data is valid. [2025-09-29T17:44:14.882074] [DEBUG] [LOCAL ] BTU: Saving primary data. [2025-09-29T17:44:14.884194] [DEBUG] [LOCAL ] BTU: Trimmed 76865 records to 53306 (keeping 200 days of data) [2025-09-29T17:44:15.266437] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-29T17:44:15.312883] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-29T17:44:15.334483] [DEBUG] [LOCAL ] BTU: Primary data saved (53306 records). [2025-09-29T17:44:15.334672] [INFO ] [MAIN ] BTU: Full history saved. [2025-09-29T17:44:15.334804] [INFO ] [MAIN ] Update Progress: 355/2371 symbols completed. BTU took 34.5s. Estimated remaining: 4h 11m 3s. Rate: 8.0 symbols/min [2025-09-29T17:44:15.539104] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:44:15.548123] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-09-29T17:44:15.548004] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-29T17:44:15.603933] [DEBUG] [LOCAL ] BURL: Loaded 46896 existing records from primary storage. [2025-09-29T17:44:15.604293] [INFO ] [MAIN ] BURL: Loaded 46896 existing records. [2025-09-29T17:44:15.801314] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:44:15.801602] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-09-29T17:44:15.801680] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-09-29T17:44:15.802252] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-09-29T17:44:15.802313] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-09-29T17:44:16.188952] [INFO ] [REMOTE ] BURL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:44:16.348188] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-09-29T17:44:17.144966] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-29T17:44:17.153443] [INFO ] [REMOTE ] BURL: Fetching primary data for 2024-12. [2025-09-29T17:44:17.209298] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-29T17:44:17.948113] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-09-29T17:44:18.748150] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-09-29T17:44:18.782931] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-29T17:44:19.430463] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-29T17:44:19.548170] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-09-29T17:44:20.348115] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-09-29T17:44:20.817199] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-29T17:44:20.865976] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-29T17:44:21.040415] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-29T17:44:21.148191] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-09-29T17:44:21.948267] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-01. [2025-09-29T17:44:22.748144] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-09-29T17:44:22.958135] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-29T17:44:23.475783] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-29T17:44:23.548107] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-09-29T17:44:24.348116] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-09-29T17:44:24.421416] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-29T17:44:25.148152] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-09-29T17:44:25.248113] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-29T17:44:25.957908] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-09-29T17:44:25.960954] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-29T17:44:26.428011] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-29T17:44:26.748113] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-09-29T17:44:26.941048] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-29T17:44:26.944824] [INFO ] [REMOTE ] BUI: Full fetch complete (16291 records). [2025-09-29T17:44:26.944911] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-09-29T17:44:27.377141] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present. [2025-09-29T17:44:27.377323] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed. [2025-09-29T17:44:27.377801] [INFO ] [MAIN ] BUI: Fetched primary data is valid. [2025-09-29T17:44:27.377868] [DEBUG] [LOCAL ] BUI: Saving primary data. [2025-09-29T17:44:27.378429] [DEBUG] [LOCAL ] BUI: Trimmed 16291 records to 11526 (keeping 200 days of data) [2025-09-29T17:44:27.454372] [DEBUG] [LOCAL ] BUI: Primary data saved (11526 records). [2025-09-29T17:44:27.454531] [INFO ] [MAIN ] BUI: Full history saved. [2025-09-29T17:44:27.454622] [INFO ] [MAIN ] Update Progress: 356/2371 symbols completed. BUI took 32.9s. Estimated remaining: 4h 11m 22s. Rate: 8.0 symbols/min [2025-09-29T17:44:27.553212] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-09-29T17:44:27.635998] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:44:27.653749] [DEBUG] [LOCAL ] BUXX: Loaded 15364 existing records from primary storage. [2025-09-29T17:44:27.654006] [INFO ] [MAIN ] BUXX: Loaded 15364 existing records. [2025-09-29T17:44:27.848958] [WARN ] [MAIN ] BUXX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:44:27.849458] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-09-29T17:44:27.849566] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-09-29T17:44:27.850095] [DEBUG] [LOCAL ] BUXX: Deleted primary data file. [2025-09-29T17:44:27.850177] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-09-29T17:44:28.238033] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:44:28.348100] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-09-29T17:44:28.521726] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-29T17:44:29.046686] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-29T17:44:29.148173] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2024-12. [2025-09-29T17:44:29.950091] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-09-29T17:44:29.963957] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-29T17:44:30.027493] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-29T17:44:30.748103] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-09-29T17:44:31.548112] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-09-29T17:44:31.662113] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-29T17:44:31.845975] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-29T17:44:32.348112] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-09-29T17:44:33.088884] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-29T17:44:33.148113] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-09-29T17:44:33.493240] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-29T17:44:33.948163] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-09-29T17:44:33.972577] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-29T17:44:34.056756] [DEBUG] [REMOTE ] BUR: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-09-29T17:44:34.057131] [WARN ] [REMOTE ] BUR: No data returned for month 2025-07 [2025-09-29T17:44:34.057229] [FATAL] [REMOTE ] BUR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T17:44:34.057315] [FATAL] [MAIN ] BUR: Failed to fetch primary data. [2025-09-29T17:44:34.057393] [WARN ] [MAIN ] BUR: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T17:44:34.057489] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-09-29T17:44:34.057591] [DEBUG] [LOCAL ] BUR: No primary data file found to delete. [2025-09-29T17:44:34.057664] [INFO ] [LOCAL ] BUR: Starting deletion of derivative data. [2025-09-29T17:44:34.058148] [DEBUG] [LOCAL ] BUR: Deleted derivative data file. [2025-09-29T17:44:34.059057] [INFO ] [MAIN ] Update Progress: 357/2371 symbols completed. BUR took 21.5s. Estimated remaining: 4h 11m 9s. Rate: 8.0 symbols/min [2025-09-29T17:44:34.748160] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-09-29T17:44:35.548183] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-09-29T17:44:35.808581] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-29T17:44:36.348160] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-09-29T17:44:37.148184] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-09-29T17:44:37.386118] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-29T17:44:37.948104] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-09-29T17:44:38.254472] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-29T17:44:38.428357] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-29T17:44:38.439750] [INFO ] [REMOTE ] BUD: Full fetch complete (76488 records). [2025-09-29T17:44:38.439935] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-09-29T17:44:38.753229] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-09-29T17:44:38.889911] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-09-29T17:44:38.890018] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-09-29T17:44:38.890850] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-09-29T17:44:38.890932] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-09-29T17:44:38.892565] [DEBUG] [LOCAL ] BUD: Trimmed 76488 records to 52720 (keeping 200 days of data) [2025-09-29T17:44:39.223310] [DEBUG] [LOCAL ] BUD: Primary data saved (52720 records). [2025-09-29T17:44:39.223460] [INFO ] [MAIN ] BUD: Full history saved. [2025-09-29T17:44:39.223583] [INFO ] [MAIN ] Update Progress: 358/2371 symbols completed. BUD took 46.3s. Estimated remaining: 4h 10m 49s. Rate: 8.0 symbols/min [2025-09-29T17:44:39.640195] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-29T17:44:39.649990] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-09-29T17:44:39.796505] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-29T17:44:40.348163] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-09-29T17:44:41.184400] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-29T17:44:41.203678] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-29T17:44:41.207954] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-09-29T17:44:41.948131] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-09-29T17:44:42.667177] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-29T17:44:42.700659] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-29T17:44:42.748108] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-09-29T17:44:43.548129] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-09-29T17:44:44.513215] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-29T17:44:44.523407] [INFO ] [REMOTE ] BURL: Full fetch complete (65746 records). [2025-09-29T17:44:44.523606] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-09-29T17:44:44.655203] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-29T17:44:44.699432] [INFO ] [REMOTE ] BUXX: Full fetch complete (20361 records). [2025-09-29T17:44:44.720691] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-09-29T17:44:45.286968] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-09-29T17:44:45.298602] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-09-29T17:44:45.299518] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-09-29T17:44:45.299599] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-09-29T17:44:45.362634] [DEBUG] [LOCAL ] BURL: Trimmed 65746 records to 46116 (keeping 200 days of data) [2025-09-29T17:44:45.394037] [DEBUG] [VALIDATOR ] BUXX: All expected trading days are present. [2025-09-29T17:44:45.394243] [DEBUG] [VALIDATOR ] BUXX: Primary data validation passed. [2025-09-29T17:44:45.394962] [INFO ] [MAIN ] BUXX: Fetched primary data is valid. [2025-09-29T17:44:45.395094] [DEBUG] [LOCAL ] BUXX: Saving primary data. [2025-09-29T17:44:45.395980] [DEBUG] [LOCAL ] BUXX: Trimmed 20361 records to 15148 (keeping 200 days of data) [2025-09-29T17:44:45.615674] [DEBUG] [LOCAL ] BUXX: Primary data saved (15148 records). [2025-09-29T17:44:45.618057] [INFO ] [MAIN ] BUXX: Full history saved. [2025-09-29T17:44:45.618975] [INFO ] [MAIN ] Update Progress: 359/2371 symbols completed. BUXX took 18.2s. Estimated remaining: 4h 10m 35s. Rate: 8.0 symbols/min [2025-09-29T17:44:45.790293] [DEBUG] [LOCAL ] BURL: Primary data saved (46116 records). [2025-09-29T17:44:45.790475] [INFO ] [MAIN ] BURL: Full history saved. [2025-09-29T17:44:45.790604] [INFO ] [MAIN ] Update Progress: 360/2371 symbols completed. BURL took 30.5s. Estimated remaining: 4h 9m 47s. Rate: 8.1 symbols/min [2025-09-29T17:44:46.450477] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:44:46.553915] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:44:46.594217] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:44:46.599780] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:44:46.723595] [DEBUG] [LOCAL ] BVN: Loaded 44520 existing records from primary storage. [2025-09-29T17:44:46.724341] [INFO ] [MAIN ] BVN: Loaded 44520 existing records. [2025-09-29T17:44:46.730175] [DEBUG] [LOCAL ] BW: Loaded 40297 existing records from primary storage. [2025-09-29T17:44:46.742081] [DEBUG] [LOCAL ] BV: Loaded 39048 existing records from primary storage. [2025-09-29T17:44:46.759869] [INFO ] [MAIN ] BW: Loaded 40297 existing records. [2025-09-29T17:44:46.767260] [INFO ] [MAIN ] BV: Loaded 39048 existing records. [2025-09-29T17:44:46.995201] [DEBUG] [LOCAL ] BWA: Loaded 52976 existing records from primary storage. [2025-09-29T17:44:47.082399] [INFO ] [MAIN ] BWA: Loaded 52976 existing records. [2025-09-29T17:44:47.378985] [WARN ] [MAIN ] BVN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:44:47.455785] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-09-29T17:44:47.468094] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:44:47.480031] [WARN ] [MAIN ] BV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:44:47.484400] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-09-29T17:44:47.484837] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-09-29T17:44:47.485038] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-09-29T17:44:47.485577] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-09-29T17:44:47.501355] [DEBUG] [LOCAL ] BVN: Deleted primary data file. [2025-09-29T17:44:47.512110] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-09-29T17:44:47.512305] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-09-29T17:44:47.527337] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-09-29T17:44:47.538875] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-09-29T17:44:47.566197] [DEBUG] [LOCAL ] BV: Deleted primary data file. [2025-09-29T17:44:47.585826] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-09-29T17:44:47.578014] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:44:47.618679] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-09-29T17:44:47.682771] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-09-29T17:44:47.820704] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-09-29T17:44:47.878209] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-09-29T17:44:49.100824] [INFO ] [REMOTE ] BVN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:44:49.125870] [INFO ] [REMOTE ] BV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:44:49.159567] [INFO ] [REMOTE ] BV: Fetching primary data for 2024-12. [2025-09-29T17:44:49.148257] [INFO ] [REMOTE ] BW: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:44:49.168216] [INFO ] [REMOTE ] BVN: Fetching primary data for 2024-12. [2025-09-29T17:44:49.173636] [INFO ] [REMOTE ] BW: Fetching primary data for 2024-12. [2025-09-29T17:44:49.270443] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:44:49.271437] [INFO ] [REMOTE ] BWA: Fetching primary data for 2024-12. [2025-09-29T17:44:50.651031] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-29T17:44:50.658874] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-09-29T17:44:50.878349] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-29T17:44:50.888563] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-01. [2025-09-29T17:44:50.923675] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-29T17:44:50.933353] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-01. [2025-09-29T17:44:51.238050] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-29T17:44:51.249293] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-09-29T17:44:51.821711] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-29T17:44:51.828292] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-09-29T17:44:52.232931] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-29T17:44:52.242711] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-09-29T17:44:52.330518] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-29T17:44:52.348068] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-09-29T17:44:52.789750] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-29T17:44:53.148125] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-09-29T17:44:53.213223] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-29T17:44:53.346672] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-29T17:44:53.429497] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-29T17:44:53.948114] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-09-29T17:44:54.722149] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-29T17:44:54.748123] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-09-29T17:44:55.509256] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-29T17:44:55.548100] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-09-29T17:44:55.947766] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-29T17:44:56.348123] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-09-29T17:44:57.102227] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-29T17:44:57.148118] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-09-29T17:44:57.904271] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-29T17:44:57.948120] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-09-29T17:44:58.670091] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-29T17:44:58.748113] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-09-29T17:44:59.548088] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-09-29T17:44:59.741714] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-29T17:45:00.231419] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-29T17:45:00.348109] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-09-29T17:45:00.988823] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-29T17:45:01.148177] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-09-29T17:45:01.948140] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-09-29T17:45:01.983320] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-29T17:45:02.748088] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-09-29T17:45:03.277518] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-29T17:45:03.548143] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-09-29T17:45:03.649969] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-29T17:45:03.914172] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-29T17:45:04.348142] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-09-29T17:45:05.148147] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-09-29T17:45:05.288326] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-29T17:45:05.348710] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-29T17:45:05.948130] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-09-29T17:45:06.464152] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-29T17:45:06.748141] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-09-29T17:45:07.495804] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-29T17:45:07.548125] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-09-29T17:45:08.348125] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-09-29T17:45:08.639838] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-29T17:45:09.148361] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-09-29T17:45:09.148287] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-29T17:45:09.508486] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-29T17:45:09.948162] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-09-29T17:45:10.748100] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-09-29T17:45:10.821865] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-29T17:45:11.460326] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-29T17:45:11.548176] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-09-29T17:45:12.348110] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-09-29T17:45:12.715479] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-29T17:45:13.148125] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-09-29T17:45:13.331551] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-29T17:45:13.342140] [INFO ] [REMOTE ] BW: Full fetch complete (58788 records). [2025-09-29T17:45:13.342329] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-09-29T17:45:13.889402] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-09-29T17:45:13.889533] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-09-29T17:45:13.890702] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-09-29T17:45:13.890847] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-09-29T17:45:13.892745] [DEBUG] [LOCAL ] BW: Trimmed 58788 records to 39676 (keeping 200 days of data) [2025-09-29T17:45:13.972781] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-09-29T17:45:14.250855] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-29T17:45:14.269823] [INFO ] [REMOTE ] BVN: Full fetch complete (62834 records). [2025-09-29T17:45:14.270050] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-09-29T17:45:14.807501] [DEBUG] [VALIDATOR ] BVN: All expected trading days are present. [2025-09-29T17:45:14.808064] [DEBUG] [VALIDATOR ] BVN: Primary data validation passed. [2025-09-29T17:45:14.809923] [INFO ] [MAIN ] BVN: Fetched primary data is valid. [2025-09-29T17:45:14.810192] [DEBUG] [LOCAL ] BVN: Saving primary data. [2025-09-29T17:45:14.837446] [DEBUG] [LOCAL ] BVN: Trimmed 62834 records to 43956 (keeping 200 days of data) [2025-09-29T17:45:14.840251] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-29T17:45:14.852504] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-09-29T17:45:14.954320] [DEBUG] [LOCAL ] BW: Primary data saved (39676 records). [2025-09-29T17:45:14.958317] [INFO ] [MAIN ] BW: Full history saved. [2025-09-29T17:45:14.959987] [INFO ] [MAIN ] Update Progress: 361/2371 symbols completed. BW took 29.2s. Estimated remaining: 4h 11m 40s. Rate: 8.0 symbols/min [2025-09-29T17:45:15.161970] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:45:15.181918] [DEBUG] [LOCAL ] BWG: Loaded 12478 existing records from primary storage. [2025-09-29T17:45:15.182981] [INFO ] [MAIN ] BWG: Loaded 12478 existing records. [2025-09-29T17:45:15.394567] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:45:15.452588] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-09-29T17:45:15.479427] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-09-29T17:45:15.480527] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-09-29T17:45:15.480917] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-09-29T17:45:15.948231] [INFO ] [REMOTE ] BWG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:45:15.953864] [INFO ] [REMOTE ] BWG: Fetching primary data for 2024-12. [2025-09-29T17:45:15.953222] [DEBUG] [LOCAL ] BVN: Primary data saved (43956 records). [2025-09-29T17:45:15.955527] [INFO ] [MAIN ] BVN: Full history saved. [2025-09-29T17:45:15.955631] [INFO ] [MAIN ] Update Progress: 362/2371 symbols completed. BVN took 30.2s. Estimated remaining: 4h 10m 57s. Rate: 8.0 symbols/min [2025-09-29T17:45:16.152881] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:45:16.175730] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-29T17:45:16.220581] [DEBUG] [LOCAL ] BWLP: Loaded 33185 existing records from primary storage. [2025-09-29T17:45:16.220921] [INFO ] [MAIN ] BWLP: Loaded 33185 existing records. [2025-09-29T17:45:16.352766] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-09-29T17:45:16.422138] [WARN ] [MAIN ] BWLP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:45:16.422597] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-09-29T17:45:16.422785] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-09-29T17:45:16.423224] [DEBUG] [LOCAL ] BWLP: Deleted primary data file. [2025-09-29T17:45:16.423335] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-09-29T17:45:16.616711] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-29T17:45:16.701057] [INFO ] [REMOTE ] BV: Full fetch complete (53546 records). [2025-09-29T17:45:16.739815] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-09-29T17:45:16.772063] [FATAL] [VALIDATOR ] BV: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:45:16.774625] [FATAL] [MAIN ] BV: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:45:16.790703] [WARN ] [MAIN ] BV: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:45:16.817628] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-09-29T17:45:16.903294] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:45:16.900096] [DEBUG] [LOCAL ] BV: No primary data file found to delete. [2025-09-29T17:45:16.903807] [INFO ] [LOCAL ] BV: Starting deletion of derivative data. [2025-09-29T17:45:16.904281] [DEBUG] [LOCAL ] BV: Deleted derivative data file. [2025-09-29T17:45:16.904382] [INFO ] [MAIN ] Update Progress: 363/2371 symbols completed. BV took 31.1s. Estimated remaining: 4h 10m 13s. Rate: 8.0 symbols/min [2025-09-29T17:45:17.018800] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-29T17:45:17.099454] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:45:17.109188] [DEBUG] [LOCAL ] BWMX: Loaded 7676 existing records from primary storage. [2025-09-29T17:45:17.109421] [INFO ] [MAIN ] BWMX: Loaded 7676 existing records. [2025-09-29T17:45:17.155680] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-01. [2025-09-29T17:45:17.310538] [WARN ] [MAIN ] BWMX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:45:17.310778] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-09-29T17:45:17.310831] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-09-29T17:45:17.311045] [DEBUG] [LOCAL ] BWMX: Deleted primary data file. [2025-09-29T17:45:17.311105] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-09-29T17:45:17.681118] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:45:17.948169] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2024-12. [2025-09-29T17:45:18.143009] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-29T17:45:18.154184] [INFO ] [REMOTE ] BWA: Full fetch complete (75711 records). [2025-09-29T17:45:18.154352] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-09-29T17:45:18.277561] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-29T17:45:18.609740] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-09-29T17:45:18.610456] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-09-29T17:45:18.611754] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-09-29T17:45:18.611867] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-09-29T17:45:18.610721] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-29T17:45:18.615589] [DEBUG] [LOCAL ] BWA: Trimmed 75711 records to 52193 (keeping 200 days of data) [2025-09-29T17:45:18.748261] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-01. [2025-09-29T17:45:18.959321] [DEBUG] [LOCAL ] BWA: Primary data saved (52193 records). [2025-09-29T17:45:18.959492] [INFO ] [MAIN ] BWA: Full history saved. [2025-09-29T17:45:18.959630] [INFO ] [MAIN ] Update Progress: 364/2371 symbols completed. BWA took 33.2s. Estimated remaining: 4h 9m 36s. Rate: 8.0 symbols/min [2025-09-29T17:45:19.143679] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:45:19.149545] [DEBUG] [LOCAL ] BWNB: Loaded 4468 existing records from primary storage. [2025-09-29T17:45:19.149740] [INFO ] [MAIN ] BWNB: Loaded 4468 existing records. [2025-09-29T17:45:19.341383] [WARN ] [MAIN ] BWNB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:45:19.341604] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-09-29T17:45:19.341686] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-09-29T17:45:19.341876] [DEBUG] [LOCAL ] BWNB: Deleted primary data file. [2025-09-29T17:45:19.341934] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-09-29T17:45:19.548911] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2024-12. [2025-09-29T17:45:19.540293] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-29T17:45:19.766707] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:45:20.348181] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-09-29T17:45:21.112276] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-29T17:45:21.148121] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-09-29T17:45:21.352175] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-29T17:45:21.590699] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-29T17:45:21.948146] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-09-29T17:45:22.703263] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-29T17:45:22.748120] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-09-29T17:45:23.548158] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2024-12. [2025-09-29T17:45:23.654392] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-29T17:45:24.237742] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-29T17:45:24.348117] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-09-29T17:45:24.928348] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-29T17:45:25.148143] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-09-29T17:45:25.945572] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-29T17:45:25.949101] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-09-29T17:45:26.526140] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-29T17:45:26.748113] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-09-29T17:45:27.548127] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-01. [2025-09-29T17:45:27.809046] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-29T17:45:28.014195] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-29T17:45:28.348108] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-09-29T17:45:28.842603] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-29T17:45:29.148114] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-09-29T17:45:29.951106] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-09-29T17:45:29.954319] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-29T17:45:30.748102] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-01. [2025-09-29T17:45:30.812302] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-29T17:45:31.548202] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-09-29T17:45:32.321522] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-29T17:45:32.348080] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-09-29T17:45:32.585408] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-29T17:45:32.588975] [INFO ] [REMOTE ] BWG: Full fetch complete (17790 records). [2025-09-29T17:45:32.589056] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-09-29T17:45:32.999391] [DEBUG] [VALIDATOR ] BWG: All expected trading days are present. [2025-09-29T17:45:32.999479] [DEBUG] [VALIDATOR ] BWG: Primary data validation passed. [2025-09-29T17:45:32.999905] [INFO ] [MAIN ] BWG: Fetched primary data is valid. [2025-09-29T17:45:32.999969] [DEBUG] [LOCAL ] BWG: Saving primary data. [2025-09-29T17:45:33.000518] [DEBUG] [LOCAL ] BWG: Trimmed 17790 records to 12382 (keeping 200 days of data) [2025-09-29T17:45:33.081284] [DEBUG] [LOCAL ] BWG: Primary data saved (12382 records). [2025-09-29T17:45:33.081436] [INFO ] [MAIN ] BWG: Full history saved. [2025-09-29T17:45:33.081536] [INFO ] [MAIN ] Update Progress: 365/2371 symbols completed. BWG took 18.1s. Estimated remaining: 4h 10m 5s. Rate: 8.0 symbols/min [2025-09-29T17:45:33.150343] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-09-29T17:45:33.199983] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-29T17:45:33.282599] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:45:33.292888] [DEBUG] [LOCAL ] BWSN: Loaded 5130 existing records from primary storage. [2025-09-29T17:45:33.293098] [INFO ] [MAIN ] BWSN: Loaded 5130 existing records. [2025-09-29T17:45:33.488515] [WARN ] [MAIN ] BWSN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:45:33.488750] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-09-29T17:45:33.488805] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-09-29T17:45:33.489034] [DEBUG] [LOCAL ] BWSN: Deleted primary data file. [2025-09-29T17:45:33.489094] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-09-29T17:45:33.878596] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:45:33.948116] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-09-29T17:45:34.533928] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-29T17:45:34.694104] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-29T17:45:34.748138] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-09-29T17:45:35.548136] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-09-29T17:45:36.280910] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-29T17:45:36.335256] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-29T17:45:36.348058] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-09-29T17:45:36.906170] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-29T17:45:37.148135] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2024-12. [2025-09-29T17:45:37.865068] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-29T17:45:37.948146] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-09-29T17:45:38.748129] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-09-29T17:45:38.767732] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-29T17:45:39.548121] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-01. [2025-09-29T17:45:39.983875] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-29T17:45:40.192038] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-29T17:45:40.348129] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-09-29T17:45:40.720031] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-29T17:45:41.148122] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-09-29T17:45:41.948178] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-09-29T17:45:42.668060] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-29T17:45:42.748122] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-09-29T17:45:42.849430] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-29T17:45:43.306862] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-29T17:45:43.548122] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-09-29T17:45:43.958267] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-29T17:45:44.348122] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-09-29T17:45:45.148141] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-09-29T17:45:45.174568] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-29T17:45:45.751247] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-29T17:45:45.948108] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-09-29T17:45:46.748101] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-09-29T17:45:46.828333] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-29T17:45:47.444731] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-29T17:45:47.548107] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-09-29T17:45:48.170945] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-29T17:45:48.348121] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-09-29T17:45:49.133308] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-29T17:45:49.148144] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-09-29T17:45:49.884043] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-29T17:45:49.886824] [INFO ] [REMOTE ] BWMX: Full fetch complete (10054 records). [2025-09-29T17:45:49.886938] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-09-29T17:45:49.953287] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-09-29T17:45:50.267127] [DEBUG] [VALIDATOR ] BWMX: All expected trading days are present. [2025-09-29T17:45:50.267214] [DEBUG] [VALIDATOR ] BWMX: Primary data validation passed. [2025-09-29T17:45:50.267531] [INFO ] [MAIN ] BWMX: Fetched primary data is valid. [2025-09-29T17:45:50.267593] [DEBUG] [LOCAL ] BWMX: Saving primary data. [2025-09-29T17:45:50.268130] [DEBUG] [LOCAL ] BWMX: Trimmed 10054 records to 7635 (keeping 200 days of data) [2025-09-29T17:45:50.324280] [DEBUG] [LOCAL ] BWMX: Primary data saved (7635 records). [2025-09-29T17:45:50.324807] [INFO ] [MAIN ] BWMX: Full history saved. [2025-09-29T17:45:50.324997] [INFO ] [MAIN ] Update Progress: 366/2371 symbols completed. BWMX took 33.4s. Estimated remaining: 4h 10m 51s. Rate: 8.0 symbols/min [2025-09-29T17:45:50.495779] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-29T17:45:50.517782] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:45:50.570067] [DEBUG] [LOCAL ] BWXT: Loaded 47442 existing records from primary storage. [2025-09-29T17:45:50.570398] [INFO ] [MAIN ] BWXT: Loaded 47442 existing records. [2025-09-29T17:45:50.760283] [WARN ] [MAIN ] BWXT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:45:50.748130] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-09-29T17:45:50.761485] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-09-29T17:45:50.761545] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-09-29T17:45:50.761954] [DEBUG] [LOCAL ] BWXT: Deleted primary data file. [2025-09-29T17:45:50.762016] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-09-29T17:45:51.152681] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:45:51.548125] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2024-12. [2025-09-29T17:45:51.823054] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-29T17:45:52.348128] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-09-29T17:45:53.148087] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-09-29T17:45:53.260683] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-29T17:45:53.414470] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-29T17:45:53.544492] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-29T17:45:53.948120] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-09-29T17:45:54.748113] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-01. [2025-09-29T17:45:55.312543] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-29T17:45:55.548096] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-09-29T17:45:56.348109] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-09-29T17:45:56.355630] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-29T17:45:56.356971] [INFO ] [REMOTE ] BWNB: Full fetch complete (5709 records). [2025-09-29T17:45:56.357051] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-09-29T17:45:56.357490] [FATAL] [VALIDATOR ] BWNB: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:45:56.357859] [FATAL] [MAIN ] BWNB: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:45:56.357954] [WARN ] [MAIN ] BWNB: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:45:56.358194] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-09-29T17:45:56.358290] [DEBUG] [LOCAL ] BWNB: No primary data file found to delete. [2025-09-29T17:45:56.358341] [INFO ] [LOCAL ] BWNB: Starting deletion of derivative data. [2025-09-29T17:45:56.359081] [DEBUG] [LOCAL ] BWNB: Deleted derivative data file. [2025-09-29T17:45:56.359193] [INFO ] [MAIN ] Update Progress: 367/2371 symbols completed. BWNB took 37.4s. Estimated remaining: 4h 10m 35s. Rate: 8.0 symbols/min [2025-09-29T17:45:56.571315] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:45:56.636378] [DEBUG] [LOCAL ] BX: Loaded 54270 existing records from primary storage. [2025-09-29T17:45:56.636927] [INFO ] [MAIN ] BX: Loaded 54270 existing records. [2025-09-29T17:45:56.789039] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-29T17:45:56.879662] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:45:56.879875] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-09-29T17:45:56.879928] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-09-29T17:45:56.880357] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-09-29T17:45:56.880418] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-09-29T17:45:56.989876] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-29T17:45:57.000042] [INFO ] [REMOTE ] BWSN: Full fetch complete (6129 records). [2025-09-29T17:45:57.010413] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-09-29T17:45:57.035976] [FATAL] [VALIDATOR ] BWSN: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:45:57.051742] [FATAL] [MAIN ] BWSN: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:45:57.058884] [WARN ] [MAIN ] BWSN: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:45:57.086682] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-09-29T17:45:57.148892] [DEBUG] [LOCAL ] BWSN: No primary data file found to delete. [2025-09-29T17:45:57.148717] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-09-29T17:45:57.160817] [INFO ] [LOCAL ] BWSN: Starting deletion of derivative data. [2025-09-29T17:45:57.193128] [DEBUG] [LOCAL ] BWSN: Deleted derivative data file. [2025-09-29T17:45:57.198965] [INFO ] [MAIN ] Update Progress: 368/2371 symbols completed. BWSN took 24.1s. Estimated remaining: 4h 9m 51s. Rate: 8.0 symbols/min [2025-09-29T17:45:57.396309] [INFO ] [REMOTE ] BX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:45:57.481469] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:45:57.496545] [DEBUG] [LOCAL ] BXC: Loaded 13880 existing records from primary storage. [2025-09-29T17:45:57.496823] [INFO ] [MAIN ] BXC: Loaded 13880 existing records. [2025-09-29T17:45:57.688207] [WARN ] [MAIN ] BXC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:45:57.688423] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-09-29T17:45:57.688470] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-09-29T17:45:57.688763] [DEBUG] [LOCAL ] BXC: Deleted primary data file. [2025-09-29T17:45:57.688824] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-09-29T17:45:57.953218] [INFO ] [REMOTE ] BX: Fetching primary data for 2024-12. [2025-09-29T17:45:58.073306] [INFO ] [REMOTE ] BXC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:45:58.748115] [INFO ] [REMOTE ] BXC: Fetching primary data for 2024-12. [2025-09-29T17:45:58.891141] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-29T17:45:59.356809] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-29T17:45:59.548193] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-01. [2025-09-29T17:46:00.169728] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-09-29T17:46:00.348140] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-09-29T17:46:00.439917] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-29T17:46:01.148127] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-09-29T17:46:01.948139] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-01. [2025-09-29T17:46:02.002578] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-29T17:46:02.158602] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-29T17:46:02.748154] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-09-29T17:46:03.548092] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-09-29T17:46:03.965718] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-29T17:46:04.348098] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-09-29T17:46:04.501214] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-29T17:46:04.508017] [INFO ] [REMOTE ] BWLP: Full fetch complete (48347 records). [2025-09-29T17:46:04.508128] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-09-29T17:46:04.906397] [DEBUG] [VALIDATOR ] BWLP: All expected trading days are present. [2025-09-29T17:46:04.906497] [DEBUG] [VALIDATOR ] BWLP: Primary data validation passed. [2025-09-29T17:46:04.907197] [INFO ] [MAIN ] BWLP: Fetched primary data is valid. [2025-09-29T17:46:04.907264] [DEBUG] [LOCAL ] BWLP: Saving primary data. [2025-09-29T17:46:04.908481] [DEBUG] [LOCAL ] BWLP: Trimmed 48347 records to 32466 (keeping 200 days of data) [2025-09-29T17:46:05.121555] [DEBUG] [LOCAL ] BWLP: Primary data saved (32466 records). [2025-09-29T17:46:05.121816] [INFO ] [MAIN ] BWLP: Full history saved. [2025-09-29T17:46:05.121942] [INFO ] [MAIN ] Update Progress: 369/2371 symbols completed. BWLP took 49.2s. Estimated remaining: 4h 9m 46s. Rate: 8.0 symbols/min [2025-09-29T17:46:05.155158] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-09-29T17:46:05.312491] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:46:05.340567] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-29T17:46:05.397237] [DEBUG] [LOCAL ] BXMT: Loaded 47994 existing records from primary storage. [2025-09-29T17:46:05.397632] [INFO ] [MAIN ] BXMT: Loaded 47994 existing records. [2025-09-29T17:46:05.604396] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:46:05.604892] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-09-29T17:46:05.604967] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-09-29T17:46:05.605394] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-09-29T17:46:05.605457] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-09-29T17:46:05.952755] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-09-29T17:46:06.067326] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:46:06.083894] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-29T17:46:06.360532] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-29T17:46:06.748177] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2024-12. [2025-09-29T17:46:07.548179] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-09-29T17:46:07.849387] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-29T17:46:08.318757] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-29T17:46:08.348137] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-09-29T17:46:08.666488] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-29T17:46:09.148111] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-09-29T17:46:09.948150] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-01. [2025-09-29T17:46:10.117194] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-29T17:46:10.152245] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-29T17:46:10.748140] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-09-29T17:46:11.557013] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-09-29T17:46:11.566132] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-29T17:46:11.596948] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-29T17:46:12.348129] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-09-29T17:46:13.148087] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-09-29T17:46:13.266833] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-29T17:46:13.600462] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-29T17:46:13.948123] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-09-29T17:46:14.689624] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-29T17:46:14.748121] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-09-29T17:46:14.861079] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-29T17:46:15.548152] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-09-29T17:46:16.348085] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-09-29T17:46:16.523060] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-29T17:46:17.009954] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-29T17:46:17.148146] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-09-29T17:46:17.327740] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-29T17:46:17.331620] [INFO ] [REMOTE ] BXC: Full fetch complete (17854 records). [2025-09-29T17:46:17.331814] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-09-29T17:46:17.761852] [DEBUG] [VALIDATOR ] BXC: All expected trading days are present. [2025-09-29T17:46:17.761954] [DEBUG] [VALIDATOR ] BXC: Primary data validation passed. [2025-09-29T17:46:17.762363] [INFO ] [MAIN ] BXC: Fetched primary data is valid. [2025-09-29T17:46:17.762409] [DEBUG] [LOCAL ] BXC: Saving primary data. [2025-09-29T17:46:17.763049] [DEBUG] [LOCAL ] BXC: Trimmed 17854 records to 13669 (keeping 200 days of data) [2025-09-29T17:46:17.849284] [DEBUG] [LOCAL ] BXC: Primary data saved (13669 records). [2025-09-29T17:46:17.849437] [INFO ] [MAIN ] BXC: Full history saved. [2025-09-29T17:46:17.849558] [INFO ] [MAIN ] Update Progress: 370/2371 symbols completed. BXC took 20.6s. Estimated remaining: 4h 10m 7s. Rate: 8.0 symbols/min [2025-09-29T17:46:17.954187] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-09-29T17:46:18.030000] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:46:18.054240] [DEBUG] [LOCAL ] BXMX: Loaded 19855 existing records from primary storage. [2025-09-29T17:46:18.054497] [INFO ] [MAIN ] BXMX: Loaded 19855 existing records. [2025-09-29T17:46:18.239011] [WARN ] [MAIN ] BXMX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:46:18.239287] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-09-29T17:46:18.239343] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-09-29T17:46:18.239635] [DEBUG] [LOCAL ] BXMX: Deleted primary data file. [2025-09-29T17:46:18.239749] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-09-29T17:46:18.621619] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:46:18.748173] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2024-12. [2025-09-29T17:46:18.964036] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-29T17:46:19.423299] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-29T17:46:19.548090] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-01. [2025-09-29T17:46:19.920837] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-29T17:46:20.348163] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-09-29T17:46:20.569454] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-29T17:46:21.148146] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-09-29T17:46:21.948079] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-09-29T17:46:22.181536] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-29T17:46:22.239867] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-29T17:46:22.748131] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-09-29T17:46:23.548085] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-09-29T17:46:24.084074] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-29T17:46:24.354451] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-09-29T17:46:24.370851] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-29T17:46:25.148105] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-09-29T17:46:25.256829] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-29T17:46:25.266981] [INFO ] [REMOTE ] BWXT: Full fetch complete (67395 records). [2025-09-29T17:46:25.267134] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-09-29T17:46:25.717720] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-29T17:46:25.746323] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-09-29T17:46:25.746860] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-09-29T17:46:25.747842] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-09-29T17:46:25.747912] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-09-29T17:46:25.752346] [DEBUG] [LOCAL ] BWXT: Trimmed 67395 records to 46789 (keeping 200 days of data) [2025-09-29T17:46:25.961218] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-09-29T17:46:26.083102] [DEBUG] [LOCAL ] BWXT: Primary data saved (46789 records). [2025-09-29T17:46:26.083252] [INFO ] [MAIN ] BWXT: Full history saved. [2025-09-29T17:46:26.084390] [INFO ] [MAIN ] Update Progress: 371/2371 symbols completed. BWXT took 35.8s. Estimated remaining: 4h 10m 4s. Rate: 8.0 symbols/min [2025-09-29T17:46:26.262328] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:46:26.324979] [DEBUG] [LOCAL ] BXP: Loaded 50577 existing records from primary storage. [2025-09-29T17:46:26.325329] [INFO ] [MAIN ] BXP: Loaded 50577 existing records. [2025-09-29T17:46:26.515413] [WARN ] [MAIN ] BXP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:46:26.515939] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-09-29T17:46:26.516102] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-09-29T17:46:26.516404] [DEBUG] [LOCAL ] BXP: Deleted primary data file. [2025-09-29T17:46:26.516465] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-09-29T17:46:26.757442] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-09-29T17:46:26.976620] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-29T17:46:26.974997] [INFO ] [REMOTE ] BXP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:46:27.548145] [INFO ] [REMOTE ] BXP: Fetching primary data for 2024-12. [2025-09-29T17:46:28.053106] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-29T17:46:28.316628] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-09-29T17:46:28.348140] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-09-29T17:46:29.148072] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-09-29T17:46:29.184813] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-29T17:46:29.233801] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-29T17:46:29.948157] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-09-29T17:46:30.748130] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-09-29T17:46:31.257437] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-29T17:46:31.548147] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-01. [2025-09-29T17:46:31.760983] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-29T17:46:31.818348] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-29T17:46:32.348110] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-09-29T17:46:33.148117] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-09-29T17:46:33.217915] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-29T17:46:33.948128] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-09-29T17:46:34.100978] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-29T17:46:34.223934] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-29T17:46:34.748128] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-09-29T17:46:35.548139] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-09-29T17:46:35.749206] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-29T17:46:35.934186] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-29T17:46:36.348134] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-09-29T17:46:37.148087] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-09-29T17:46:37.191297] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-29T17:46:37.948184] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-09-29T17:46:38.528925] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-29T17:46:38.540428] [INFO ] [REMOTE ] BX: Full fetch complete (77401 records). [2025-09-29T17:46:38.540610] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-09-29T17:46:38.751111] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-09-29T17:46:38.990308] [DEBUG] [VALIDATOR ] BX: All expected trading days are present. [2025-09-29T17:46:38.990470] [DEBUG] [VALIDATOR ] BX: Primary data validation passed. [2025-09-29T17:46:38.991587] [INFO ] [MAIN ] BX: Fetched primary data is valid. [2025-09-29T17:46:38.991744] [DEBUG] [LOCAL ] BX: Saving primary data. [2025-09-29T17:46:38.994286] [DEBUG] [LOCAL ] BX: Trimmed 77401 records to 53489 (keeping 200 days of data) [2025-09-29T17:46:39.139007] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-29T17:46:39.156809] [INFO ] [REMOTE ] BXMT: Full fetch complete (69616 records). [2025-09-29T17:46:39.158039] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-09-29T17:46:39.755508] [DEBUG] [VALIDATOR ] BXMT: All expected trading days are present. [2025-09-29T17:46:39.756522] [DEBUG] [VALIDATOR ] BXMT: Primary data validation passed. [2025-09-29T17:46:39.761231] [INFO ] [MAIN ] BXMT: Fetched primary data is valid. [2025-09-29T17:46:39.761455] [DEBUG] [LOCAL ] BXMT: Saving primary data. [2025-09-29T17:46:39.769413] [DEBUG] [LOCAL ] BXMT: Trimmed 69616 records to 47211 (keeping 200 days of data) [2025-09-29T17:46:39.911304] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-29T17:46:39.929014] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-09-29T17:46:40.080479] [DEBUG] [LOCAL ] BX: Primary data saved (53489 records). [2025-09-29T17:46:40.083446] [INFO ] [MAIN ] BX: Full history saved. [2025-09-29T17:46:40.083700] [INFO ] [MAIN ] Update Progress: 372/2371 symbols completed. BX took 43.7s. Estimated remaining: 4h 10m 31s. Rate: 8.0 symbols/min [2025-09-29T17:46:40.274711] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-29T17:46:40.308353] [INFO ] [REMOTE ] BXMX: Full fetch complete (28806 records). [2025-09-29T17:46:40.309520] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-09-29T17:46:40.457425] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:46:40.788766] [DEBUG] [LOCAL ] BXSL: Loaded 48276 existing records from primary storage. [2025-09-29T17:46:40.839208] [INFO ] [MAIN ] BXSL: Loaded 48276 existing records. [2025-09-29T17:46:40.889899] [DEBUG] [VALIDATOR ] BXMX: All expected trading days are present. [2025-09-29T17:46:40.938399] [DEBUG] [VALIDATOR ] BXMX: Primary data validation passed. [2025-09-29T17:46:40.978939] [INFO ] [MAIN ] BXMX: Fetched primary data is valid. [2025-09-29T17:46:40.993791] [DEBUG] [LOCAL ] BXMX: Saving primary data. [2025-09-29T17:46:41.037716] [DEBUG] [LOCAL ] BXMX: Trimmed 28806 records to 19482 (keeping 200 days of data) [2025-09-29T17:46:41.230923] [WARN ] [MAIN ] BXSL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:46:41.236702] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-09-29T17:46:41.240574] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-09-29T17:46:41.245149] [DEBUG] [LOCAL ] BXSL: Deleted primary data file. [2025-09-29T17:46:41.245479] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-09-29T17:46:41.245060] [DEBUG] [LOCAL ] BXMT: Primary data saved (47211 records). [2025-09-29T17:46:41.260150] [INFO ] [MAIN ] BXMT: Full history saved. [2025-09-29T17:46:41.282978] [INFO ] [MAIN ] Update Progress: 373/2371 symbols completed. BXMT took 36.2s. Estimated remaining: 4h 9m 50s. Rate: 8.0 symbols/min [2025-09-29T17:46:41.662079] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:46:41.823875] [DEBUG] [LOCAL ] BY: Loaded 21895 existing records from primary storage. [2025-09-29T17:46:41.835253] [INFO ] [MAIN ] BY: Loaded 21895 existing records. [2025-09-29T17:46:41.985930] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:46:42.008347] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2024-12. [2025-09-29T17:46:42.036314] [DEBUG] [LOCAL ] BXMX: Primary data saved (19482 records). [2025-09-29T17:46:42.037240] [INFO ] [MAIN ] BXMX: Full history saved. [2025-09-29T17:46:42.048050] [INFO ] [MAIN ] Update Progress: 374/2371 symbols completed. BXMX took 24.2s. Estimated remaining: 4h 9m 6s. Rate: 8.0 symbols/min [2025-09-29T17:46:42.179050] [WARN ] [MAIN ] BY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:46:42.202794] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-09-29T17:46:42.221555] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-09-29T17:46:42.262932] [DEBUG] [LOCAL ] BY: Deleted primary data file. [2025-09-29T17:46:42.266427] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-09-29T17:46:42.329221] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-09-29T17:46:42.451902] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:46:42.471197] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-09-29T17:46:42.781701] [INFO ] [REMOTE ] BY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:46:42.782078] [INFO ] [REMOTE ] BY: Fetching primary data for 2024-12. [2025-09-29T17:46:42.784139] [DEBUG] [LOCAL ] BYD: Loaded 45804 existing records from primary storage. [2025-09-29T17:46:42.784624] [INFO ] [MAIN ] BYD: Loaded 45804 existing records. [2025-09-29T17:46:42.978705] [WARN ] [MAIN ] BYD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:46:42.978932] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-09-29T17:46:42.978993] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-09-29T17:46:42.979423] [DEBUG] [LOCAL ] BYD: Deleted primary data file. [2025-09-29T17:46:42.979485] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-09-29T17:46:43.360771] [INFO ] [REMOTE ] BYD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:46:43.361127] [INFO ] [REMOTE ] BYD: Fetching primary data for 2024-12. [2025-09-29T17:46:43.774363] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-29T17:46:43.785312] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-01. [2025-09-29T17:46:43.922626] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-29T17:46:44.213063] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-29T17:46:44.348101] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-01. [2025-09-29T17:46:44.673127] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-29T17:46:45.148148] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-01. [2025-09-29T17:46:45.226715] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-29T17:46:45.616021] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-29T17:46:45.948122] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-09-29T17:46:46.682512] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-29T17:46:46.748123] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-09-29T17:46:46.802371] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-29T17:46:47.548128] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-09-29T17:46:48.330503] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-29T17:46:48.348069] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-09-29T17:46:49.148140] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-09-29T17:46:49.258388] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-29T17:46:49.590558] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-29T17:46:49.948096] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-09-29T17:46:50.748088] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-09-29T17:46:50.931551] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-29T17:46:51.548118] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-09-29T17:46:51.764984] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-29T17:46:52.348084] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-09-29T17:46:52.458853] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-29T17:46:53.148107] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-09-29T17:46:53.293105] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-29T17:46:53.901271] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-29T17:46:53.948109] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-09-29T17:46:54.010312] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-29T17:46:54.748119] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-09-29T17:46:55.553292] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-09-29T17:46:55.572698] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-29T17:46:55.898474] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-29T17:46:56.348101] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-09-29T17:46:57.148113] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-09-29T17:46:57.246810] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-29T17:46:57.300870] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-29T17:46:57.948119] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-09-29T17:46:58.748220] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-09-29T17:46:58.804784] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-29T17:46:59.095548] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-29T17:46:59.548170] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-09-29T17:47:00.150954] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-29T17:47:00.348116] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-09-29T17:47:00.459036] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-29T17:47:01.148117] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-09-29T17:47:01.948108] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-09-29T17:47:02.177293] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-29T17:47:02.378457] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-29T17:47:02.389212] [INFO ] [REMOTE ] BXP: Full fetch complete (70986 records). [2025-09-29T17:47:02.389384] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-09-29T17:47:02.390268] [FATAL] [VALIDATOR ] BXP: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:47:02.390389] [FATAL] [MAIN ] BXP: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:47:02.390464] [WARN ] [MAIN ] BXP: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:47:02.390569] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-09-29T17:47:02.390672] [DEBUG] [LOCAL ] BXP: No primary data file found to delete. [2025-09-29T17:47:02.390732] [INFO ] [LOCAL ] BXP: Starting deletion of derivative data. [2025-09-29T17:47:02.391431] [DEBUG] [LOCAL ] BXP: Deleted derivative data file. [2025-09-29T17:47:02.392124] [INFO ] [MAIN ] Update Progress: 375/2371 symbols completed. BXP took 36.3s. Estimated remaining: 4h 10m 7s. Rate: 8.0 symbols/min [2025-09-29T17:47:02.583866] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:47:02.598276] [DEBUG] [LOCAL ] BYM: Loaded 12225 existing records from primary storage. [2025-09-29T17:47:02.598551] [INFO ] [MAIN ] BYM: Loaded 12225 existing records. [2025-09-29T17:47:02.754631] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-09-29T17:47:02.801416] [WARN ] [MAIN ] BYM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:47:02.801668] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-09-29T17:47:02.801732] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-09-29T17:47:02.801962] [DEBUG] [LOCAL ] BYM: Deleted primary data file. [2025-09-29T17:47:02.802022] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-09-29T17:47:03.200095] [INFO ] [REMOTE ] BYM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:47:03.483521] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-29T17:47:03.548123] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-09-29T17:47:04.348091] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-09-29T17:47:04.617482] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-29T17:47:05.148107] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-09-29T17:47:05.255943] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-29T17:47:05.641928] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-29T17:47:05.646853] [INFO ] [REMOTE ] BY: Full fetch complete (29398 records). [2025-09-29T17:47:05.646946] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-09-29T17:47:05.956584] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-09-29T17:47:06.066317] [DEBUG] [VALIDATOR ] BY: All expected trading days are present. [2025-09-29T17:47:06.066426] [DEBUG] [VALIDATOR ] BY: Primary data validation passed. [2025-09-29T17:47:06.067100] [INFO ] [MAIN ] BY: Fetched primary data is valid. [2025-09-29T17:47:06.067180] [DEBUG] [LOCAL ] BY: Saving primary data. [2025-09-29T17:47:06.068408] [DEBUG] [LOCAL ] BY: Trimmed 29398 records to 21703 (keeping 200 days of data) [2025-09-29T17:47:06.208228] [DEBUG] [LOCAL ] BY: Primary data saved (21703 records). [2025-09-29T17:47:06.208360] [INFO ] [MAIN ] BY: Full history saved. [2025-09-29T17:47:06.208440] [INFO ] [MAIN ] Update Progress: 376/2371 symbols completed. BY took 24.9s. Estimated remaining: 4h 9m 40s. Rate: 8.0 symbols/min [2025-09-29T17:47:06.387560] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:47:06.427316] [DEBUG] [LOCAL ] BZH: Loaded 33088 existing records from primary storage. [2025-09-29T17:47:06.427686] [INFO ] [MAIN ] BZH: Loaded 33088 existing records. [2025-09-29T17:47:06.622057] [WARN ] [MAIN ] BZH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:47:06.622440] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-09-29T17:47:06.622495] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-09-29T17:47:06.622877] [DEBUG] [LOCAL ] BZH: Deleted primary data file. [2025-09-29T17:47:06.622975] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-09-29T17:47:06.749411] [INFO ] [REMOTE ] BYM: Fetching primary data for 2024-12. [2025-09-29T17:47:07.013498] [INFO ] [REMOTE ] BZH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:47:07.042198] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-29T17:47:07.349848] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-29T17:47:07.548117] [INFO ] [REMOTE ] BZH: Fetching primary data for 2024-12. [2025-09-29T17:47:07.872742] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-29T17:47:08.348153] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-09-29T17:47:08.951629] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-29T17:47:09.148159] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-09-29T17:47:09.948132] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-01. [2025-09-29T17:47:10.103570] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-29T17:47:10.112849] [INFO ] [REMOTE ] BYD: Full fetch complete (64965 records). [2025-09-29T17:47:10.113000] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-09-29T17:47:10.532505] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present. [2025-09-29T17:47:10.533015] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed. [2025-09-29T17:47:10.533799] [INFO ] [MAIN ] BYD: Fetched primary data is valid. [2025-09-29T17:47:10.533919] [DEBUG] [LOCAL ] BYD: Saving primary data. [2025-09-29T17:47:10.535325] [DEBUG] [LOCAL ] BYD: Trimmed 64965 records to 45040 (keeping 200 days of data) [2025-09-29T17:47:10.771425] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-01. [2025-09-29T17:47:10.841305] [DEBUG] [LOCAL ] BYD: Primary data saved (45040 records). [2025-09-29T17:47:10.841440] [INFO ] [MAIN ] BYD: Full history saved. [2025-09-29T17:47:10.841551] [INFO ] [MAIN ] Update Progress: 377/2371 symbols completed. BYD took 28.8s. Estimated remaining: 4h 9m 17s. Rate: 8.0 symbols/min [2025-09-29T17:47:10.909798] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-29T17:47:11.041311] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:47:11.100106] [DEBUG] [LOCAL ] C: Loaded 54521 existing records from primary storage. [2025-09-29T17:47:11.100429] [INFO ] [MAIN ] C: Loaded 54521 existing records. [2025-09-29T17:47:11.287032] [WARN ] [MAIN ] C: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:47:11.287497] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-09-29T17:47:11.287596] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-09-29T17:47:11.288469] [DEBUG] [LOCAL ] C: Deleted primary data file. [2025-09-29T17:47:11.299340] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-09-29T17:47:11.400339] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-29T17:47:11.452894] [INFO ] [REMOTE ] BXSL: Full fetch complete (69365 records). [2025-09-29T17:47:11.463577] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-09-29T17:47:11.577130] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-09-29T17:47:12.003809] [INFO ] [REMOTE ] C: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:47:12.242685] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-29T17:47:12.242995] [DEBUG] [VALIDATOR ] BXSL: All expected trading days are present. [2025-09-29T17:47:12.249553] [DEBUG] [VALIDATOR ] BXSL: Primary data validation passed. [2025-09-29T17:47:12.250843] [INFO ] [MAIN ] BXSL: Fetched primary data is valid. [2025-09-29T17:47:12.250917] [DEBUG] [LOCAL ] BXSL: Saving primary data. [2025-09-29T17:47:12.252504] [DEBUG] [LOCAL ] BXSL: Trimmed 69365 records to 47578 (keeping 200 days of data) [2025-09-29T17:47:12.348290] [INFO ] [REMOTE ] C: Fetching primary data for 2024-12. [2025-09-29T17:47:12.481122] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-29T17:47:12.572760] [DEBUG] [LOCAL ] BXSL: Primary data saved (47578 records). [2025-09-29T17:47:12.572961] [INFO ] [MAIN ] BXSL: Full history saved. [2025-09-29T17:47:12.573132] [INFO ] [MAIN ] Update Progress: 378/2371 symbols completed. BXSL took 32.5s. Estimated remaining: 4h 8m 39s. Rate: 8.0 symbols/min [2025-09-29T17:47:12.759830] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:47:12.782957] [DEBUG] [LOCAL ] CAAP: Loaded 20021 existing records from primary storage. [2025-09-29T17:47:12.783256] [INFO ] [MAIN ] CAAP: Loaded 20021 existing records. [2025-09-29T17:47:12.983948] [WARN ] [MAIN ] CAAP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:47:12.984182] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-09-29T17:47:12.984249] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-09-29T17:47:12.984546] [DEBUG] [LOCAL ] CAAP: Deleted primary data file. [2025-09-29T17:47:12.984606] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-09-29T17:47:13.153201] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-09-29T17:47:13.395778] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:47:13.948126] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2024-12. [2025-09-29T17:47:14.293338] [INFO ] [REMOTE ] C: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-29T17:47:14.369894] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-29T17:47:14.748119] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-09-29T17:47:15.157573] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-29T17:47:15.548144] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-01. [2025-09-29T17:47:15.795618] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-29T17:47:16.348114] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-09-29T17:47:16.591853] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-29T17:47:17.148089] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-09-29T17:47:17.181608] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-29T17:47:17.948134] [INFO ] [REMOTE ] C: Fetching primary data for 2025-01. [2025-09-29T17:47:18.549810] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-29T17:47:18.748138] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-09-29T17:47:19.548117] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-09-29T17:47:20.141822] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-29T17:47:20.348096] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-09-29T17:47:20.441837] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-01 (2.49 seconds). [2025-09-29T17:47:20.474998] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-29T17:47:21.148126] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-09-29T17:47:21.158254] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-29T17:47:21.948120] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-09-29T17:47:22.742401] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-29T17:47:22.748066] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-09-29T17:47:23.089155] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-29T17:47:23.481935] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-29T17:47:23.548137] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-09-29T17:47:24.348137] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-09-29T17:47:24.636324] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-29T17:47:25.148166] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-09-29T17:47:25.709942] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-29T17:47:25.948087] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-09-29T17:47:26.102196] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-29T17:47:26.105357] [INFO ] [REMOTE ] BYM: Full fetch complete (18078 records). [2025-09-29T17:47:26.105441] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-09-29T17:47:26.520791] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present. [2025-09-29T17:47:26.520923] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed. [2025-09-29T17:47:26.521587] [INFO ] [MAIN ] BYM: Fetched primary data is valid. [2025-09-29T17:47:26.521685] [DEBUG] [LOCAL ] BYM: Saving primary data. [2025-09-29T17:47:26.522522] [DEBUG] [LOCAL ] BYM: Trimmed 18078 records to 12098 (keeping 200 days of data) [2025-09-29T17:47:26.599173] [DEBUG] [LOCAL ] BYM: Primary data saved (12098 records). [2025-09-29T17:47:26.599327] [INFO ] [MAIN ] BYM: Full history saved. [2025-09-29T17:47:26.599438] [INFO ] [MAIN ] Update Progress: 379/2371 symbols completed. BYM took 24.2s. Estimated remaining: 4h 9m 6s. Rate: 8.0 symbols/min [2025-09-29T17:47:26.753267] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-09-29T17:47:26.783251] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:47:26.804596] [DEBUG] [LOCAL ] CABO: Loaded 17549 existing records from primary storage. [2025-09-29T17:47:26.804891] [INFO ] [MAIN ] CABO: Loaded 17549 existing records. [2025-09-29T17:47:26.997784] [WARN ] [MAIN ] CABO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:47:26.998018] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-09-29T17:47:26.998079] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-09-29T17:47:26.998453] [DEBUG] [LOCAL ] CABO: Deleted primary data file. [2025-09-29T17:47:26.998525] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-09-29T17:47:27.391214] [INFO ] [REMOTE ] CABO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:47:27.414030] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-29T17:47:27.548117] [INFO ] [REMOTE ] CABO: Fetching primary data for 2024-12. [2025-09-29T17:47:27.964692] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-29T17:47:28.348122] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-09-29T17:47:28.515357] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-29T17:47:29.148119] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-09-29T17:47:29.948074] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-01. [2025-09-29T17:47:30.257868] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-29T17:47:30.488090] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-29T17:47:30.662193] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-29T17:47:30.748137] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-09-29T17:47:31.548163] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-09-29T17:47:31.743249] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-29T17:47:32.348090] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-09-29T17:47:33.095258] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-29T17:47:33.148116] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-09-29T17:47:33.948119] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-09-29T17:47:34.146096] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-29T17:47:34.521941] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-29T17:47:34.748101] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-09-29T17:47:35.306853] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-29T17:47:35.548130] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-09-29T17:47:36.348118] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-09-29T17:47:36.369561] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-29T17:47:36.844348] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-29T17:47:37.148098] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-09-29T17:47:37.323340] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-29T17:47:37.948123] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-09-29T17:47:38.276584] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-29T17:47:38.748126] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-09-29T17:47:39.352485] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-29T17:47:39.358543] [INFO ] [REMOTE ] CAAP: Full fetch complete (27854 records). [2025-09-29T17:47:39.358670] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-09-29T17:47:39.553324] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-09-29T17:47:39.771628] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-09-29T17:47:39.771739] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-09-29T17:47:39.772264] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-09-29T17:47:39.772328] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-09-29T17:47:39.773196] [DEBUG] [LOCAL ] CAAP: Trimmed 27854 records to 19823 (keeping 200 days of data) [2025-09-29T17:47:39.895543] [DEBUG] [LOCAL ] CAAP: Primary data saved (19823 records). [2025-09-29T17:47:39.895728] [INFO ] [MAIN ] CAAP: Full history saved. [2025-09-29T17:47:39.895875] [INFO ] [MAIN ] Update Progress: 380/2371 symbols completed. CAAP took 27.3s. Estimated remaining: 4h 9m 29s. Rate: 8.0 symbols/min [2025-09-29T17:47:40.075794] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:47:40.103665] [DEBUG] [LOCAL ] CACI: Loaded 25384 existing records from primary storage. [2025-09-29T17:47:40.103944] [INFO ] [MAIN ] CACI: Loaded 25384 existing records. [2025-09-29T17:47:40.304457] [WARN ] [MAIN ] CACI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:47:40.304703] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-09-29T17:47:40.304764] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-09-29T17:47:40.305100] [DEBUG] [LOCAL ] CACI: Deleted primary data file. [2025-09-29T17:47:40.305162] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-09-29T17:47:40.369615] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-09-29T17:47:40.690603] [INFO ] [REMOTE ] CACI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:47:40.722781] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-29T17:47:40.784257] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-29T17:47:41.148079] [INFO ] [REMOTE ] CACI: Fetching primary data for 2024-12. [2025-09-29T17:47:41.439059] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-29T17:47:41.948117] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-09-29T17:47:42.380853] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-29T17:47:42.748113] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-09-29T17:47:43.182554] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-29T17:47:43.548119] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-01. [2025-09-29T17:47:44.348134] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-09-29T17:47:44.416269] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-29T17:47:44.423470] [INFO ] [REMOTE ] BZH: Full fetch complete (46957 records). [2025-09-29T17:47:44.423588] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-09-29T17:47:44.829507] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present. [2025-09-29T17:47:44.829618] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed. [2025-09-29T17:47:44.830279] [INFO ] [MAIN ] BZH: Fetched primary data is valid. [2025-09-29T17:47:44.830577] [DEBUG] [LOCAL ] BZH: Saving primary data. [2025-09-29T17:47:44.850672] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-29T17:47:44.857468] [DEBUG] [LOCAL ] BZH: Trimmed 46957 records to 32490 (keeping 200 days of data) [2025-09-29T17:47:45.055374] [DEBUG] [LOCAL ] BZH: Primary data saved (32490 records). [2025-09-29T17:47:45.055577] [INFO ] [MAIN ] BZH: Full history saved. [2025-09-29T17:47:45.055734] [INFO ] [MAIN ] Update Progress: 381/2371 symbols completed. BZH took 38.8s. Estimated remaining: 4h 9m 9s. Rate: 8.0 symbols/min [2025-09-29T17:47:45.154141] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-09-29T17:47:45.241981] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:47:45.288794] [DEBUG] [LOCAL ] CADE: Loaded 49496 existing records from primary storage. [2025-09-29T17:47:45.289123] [INFO ] [MAIN ] CADE: Loaded 49496 existing records. [2025-09-29T17:47:45.486468] [WARN ] [MAIN ] CADE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:47:45.498006] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-09-29T17:47:45.498598] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-09-29T17:47:45.499054] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-29T17:47:45.500671] [DEBUG] [LOCAL ] CADE: Deleted primary data file. [2025-09-29T17:47:45.503539] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-09-29T17:47:45.881596] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:47:45.948072] [INFO ] [REMOTE ] CADE: Fetching primary data for 2024-12. [2025-09-29T17:47:46.659259] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-29T17:47:46.748120] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-09-29T17:47:47.556108] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-09-29T17:47:47.580946] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-29T17:47:47.965380] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-29T17:47:48.348117] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-09-29T17:47:48.660439] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-29T17:47:49.148105] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-09-29T17:47:49.948119] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-09-29T17:47:50.704764] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-09-29T17:47:50.743754] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-29T17:47:50.751938] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-09-29T17:47:51.548112] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-09-29T17:47:51.670155] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-29T17:47:51.885458] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-29T17:47:52.348120] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-09-29T17:47:53.026940] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-29T17:47:53.148105] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-09-29T17:47:53.948084] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-09-29T17:47:54.072849] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-29T17:47:54.108483] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-29T17:47:54.111710] [INFO ] [REMOTE ] CABO: Full fetch complete (22955 records). [2025-09-29T17:47:54.111810] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-09-29T17:47:54.112305] [FATAL] [VALIDATOR ] CABO: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:47:54.112391] [FATAL] [MAIN ] CABO: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:47:54.112436] [WARN ] [MAIN ] CABO: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:47:54.112506] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-09-29T17:47:54.112574] [DEBUG] [LOCAL ] CABO: No primary data file found to delete. [2025-09-29T17:47:54.112613] [INFO ] [LOCAL ] CABO: Starting deletion of derivative data. [2025-09-29T17:47:54.113106] [DEBUG] [LOCAL ] CABO: Deleted derivative data file. [2025-09-29T17:47:54.113220] [INFO ] [MAIN ] Update Progress: 382/2371 symbols completed. CABO took 27.5s. Estimated remaining: 4h 9m 10s. Rate: 8.0 symbols/min [2025-09-29T17:47:54.291015] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:47:54.330709] [DEBUG] [LOCAL ] CAE: Loaded 39622 existing records from primary storage. [2025-09-29T17:47:54.331027] [INFO ] [MAIN ] CAE: Loaded 39622 existing records. [2025-09-29T17:47:54.521205] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:47:54.521421] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-09-29T17:47:54.521501] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-09-29T17:47:54.522213] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-09-29T17:47:54.522329] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-09-29T17:47:54.753267] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-09-29T17:47:54.912126] [INFO ] [REMOTE ] CAE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:47:55.486914] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-29T17:47:55.548069] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-09-29T17:47:56.348134] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-09-29T17:47:56.788056] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-29T17:47:57.149117] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-09-29T17:47:57.149225] [INFO ] [REMOTE ] CAE: Fetching primary data for 2024-12. [2025-09-29T17:47:57.161750] [INFO ] [REMOTE ] C: Full fetch complete (77785 records). [2025-09-29T17:47:57.161931] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-09-29T17:47:57.494813] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-29T17:47:57.602456] [DEBUG] [VALIDATOR ] C: All expected trading days are present. [2025-09-29T17:47:57.602550] [DEBUG] [VALIDATOR ] C: Primary data validation passed. [2025-09-29T17:47:57.603412] [INFO ] [MAIN ] C: Fetched primary data is valid. [2025-09-29T17:47:57.603484] [DEBUG] [LOCAL ] C: Saving primary data. [2025-09-29T17:47:57.605377] [DEBUG] [LOCAL ] C: Trimmed 77785 records to 53741 (keeping 200 days of data) [2025-09-29T17:47:57.943736] [DEBUG] [LOCAL ] C: Primary data saved (53741 records). [2025-09-29T17:47:57.943879] [INFO ] [MAIN ] C: Full history saved. [2025-09-29T17:47:57.943964] [INFO ] [MAIN ] Update Progress: 383/2371 symbols completed. C took 47.1s. Estimated remaining: 4h 8m 43s. Rate: 8.0 symbols/min [2025-09-29T17:47:57.955957] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-09-29T17:47:58.125602] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:47:58.131546] [DEBUG] [LOCAL ] CAF: Loaded 3471 existing records from primary storage. [2025-09-29T17:47:58.131742] [INFO ] [MAIN ] CAF: Loaded 3471 existing records. [2025-09-29T17:47:58.316893] [WARN ] [MAIN ] CAF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:47:58.317116] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-09-29T17:47:58.317166] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-09-29T17:47:58.317366] [DEBUG] [LOCAL ] CAF: Deleted primary data file. [2025-09-29T17:47:58.317425] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-09-29T17:47:58.707103] [INFO ] [REMOTE ] CAF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:47:58.744499] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-29T17:47:58.752617] [INFO ] [REMOTE ] CAF: Fetching primary data for 2024-12. [2025-09-29T17:47:59.169732] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-29T17:47:59.548118] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-09-29T17:47:59.590443] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-29T17:48:00.348194] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-01. [2025-09-29T17:48:00.883149] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-29T17:48:00.969440] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-29T17:48:01.148097] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-09-29T17:48:01.815328] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-29T17:48:01.948134] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-01. [2025-09-29T17:48:02.748152] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-09-29T17:48:03.547070] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-29T17:48:03.554332] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-09-29T17:48:04.139252] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-29T17:48:04.144020] [INFO ] [REMOTE ] CACI: Full fetch complete (38936 records). [2025-09-29T17:48:04.144149] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-09-29T17:48:04.144883] [FATAL] [VALIDATOR ] CACI: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:48:04.144983] [FATAL] [MAIN ] CACI: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:48:04.145055] [WARN ] [MAIN ] CACI: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:48:04.145129] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-09-29T17:48:04.145198] [DEBUG] [LOCAL ] CACI: No primary data file found to delete. [2025-09-29T17:48:04.145260] [INFO ] [LOCAL ] CACI: Starting deletion of derivative data. [2025-09-29T17:48:04.145705] [DEBUG] [LOCAL ] CACI: Deleted derivative data file. [2025-09-29T17:48:04.145808] [INFO ] [MAIN ] Update Progress: 384/2371 symbols completed. CACI took 24.2s. Estimated remaining: 4h 8m 29s. Rate: 8.0 symbols/min [2025-09-29T17:48:04.326792] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:48:04.361292] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-09-29T17:48:04.385857] [DEBUG] [LOCAL ] CAG: Loaded 54439 existing records from primary storage. [2025-09-29T17:48:04.386200] [INFO ] [MAIN ] CAG: Loaded 54439 existing records. [2025-09-29T17:48:04.575689] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:48:04.575918] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-09-29T17:48:04.575967] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-09-29T17:48:04.576385] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-09-29T17:48:04.576446] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-09-29T17:48:04.948388] [INFO ] [REMOTE ] CAG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:48:05.148131] [INFO ] [REMOTE ] CAG: Fetching primary data for 2024-12. [2025-09-29T17:48:05.344284] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-29T17:48:05.946742] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-29T17:48:05.954487] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-09-29T17:48:06.542357] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-29T17:48:06.748128] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-09-29T17:48:06.781200] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-29T17:48:07.548129] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-09-29T17:48:08.199894] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-29T17:48:08.349544] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-09-29T17:48:08.356243] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-29T17:48:09.148165] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-09-29T17:48:09.948145] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-09-29T17:48:10.057053] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-29T17:48:10.479485] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-29T17:48:10.635760] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-29T17:48:10.748116] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-09-29T17:48:11.227057] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-29T17:48:11.548145] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-01. [2025-09-29T17:48:12.348186] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-09-29T17:48:13.148138] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-09-29T17:48:13.364113] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-29T17:48:13.700526] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-29T17:48:13.852891] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-29T17:48:13.948115] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-09-29T17:48:14.748156] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-09-29T17:48:15.401318] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-29T17:48:15.548142] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-09-29T17:48:16.014182] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-29T17:48:16.348132] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-09-29T17:48:16.569997] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-29T17:48:16.791774] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-29T17:48:16.793256] [INFO ] [REMOTE ] CAF: Full fetch complete (5546 records). [2025-09-29T17:48:16.793333] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-09-29T17:48:16.793789] [FATAL] [VALIDATOR ] CAF: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:48:16.793891] [FATAL] [MAIN ] CAF: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:48:16.793936] [WARN ] [MAIN ] CAF: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:48:16.793976] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-09-29T17:48:16.794035] [DEBUG] [LOCAL ] CAF: No primary data file found to delete. [2025-09-29T17:48:16.794072] [INFO ] [LOCAL ] CAF: Starting deletion of derivative data. [2025-09-29T17:48:16.794296] [DEBUG] [LOCAL ] CAF: Deleted derivative data file. [2025-09-29T17:48:16.794387] [INFO ] [MAIN ] Update Progress: 385/2371 symbols completed. CAF took 18.9s. Estimated remaining: 4h 8m 48s. Rate: 8.0 symbols/min [2025-09-29T17:48:16.975153] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:48:17.039191] [DEBUG] [LOCAL ] CAH: Loaded 52209 existing records from primary storage. [2025-09-29T17:48:17.039553] [INFO ] [MAIN ] CAH: Loaded 52209 existing records. [2025-09-29T17:48:17.153240] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-09-29T17:48:17.234237] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:48:17.234473] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-09-29T17:48:17.234546] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-09-29T17:48:17.235148] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-09-29T17:48:17.235212] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-09-29T17:48:17.612631] [INFO ] [REMOTE ] CAH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:48:17.948124] [INFO ] [REMOTE ] CAH: Fetching primary data for 2024-12. [2025-09-29T17:48:18.748157] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-09-29T17:48:19.029784] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-29T17:48:19.509970] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-29T17:48:19.548089] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-01. [2025-09-29T17:48:20.348114] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-09-29T17:48:20.395583] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-29T17:48:21.148142] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-09-29T17:48:21.387921] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-29T17:48:21.948110] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-09-29T17:48:22.021610] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-29T17:48:22.577332] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-29T17:48:22.748146] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-09-29T17:48:23.351340] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-29T17:48:23.548163] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-09-29T17:48:24.294455] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-29T17:48:24.303915] [INFO ] [REMOTE ] CAE: Full fetch complete (55778 records). [2025-09-29T17:48:24.304110] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-09-29T17:48:24.357010] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-09-29T17:48:24.772982] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-09-29T17:48:24.773176] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-09-29T17:48:24.773993] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-09-29T17:48:24.774078] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-09-29T17:48:24.775490] [DEBUG] [LOCAL ] CAE: Trimmed 55778 records to 38991 (keeping 200 days of data) [2025-09-29T17:48:25.007871] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-29T17:48:25.052075] [DEBUG] [LOCAL ] CAE: Primary data saved (38991 records). [2025-09-29T17:48:25.052214] [INFO ] [MAIN ] CAE: Full history saved. [2025-09-29T17:48:25.052935] [INFO ] [MAIN ] Update Progress: 386/2371 symbols completed. CAE took 30.9s. Estimated remaining: 4h 8m 44s. Rate: 8.0 symbols/min [2025-09-29T17:48:25.154038] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-09-29T17:48:25.237855] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:48:25.286420] [DEBUG] [LOCAL ] CAL: Loaded 43833 existing records from primary storage. [2025-09-29T17:48:25.286787] [INFO ] [MAIN ] CAL: Loaded 43833 existing records. [2025-09-29T17:48:25.479741] [WARN ] [MAIN ] CAL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:48:25.480075] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-09-29T17:48:25.480140] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-09-29T17:48:25.480611] [DEBUG] [LOCAL ] CAL: Deleted primary data file. [2025-09-29T17:48:25.480707] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-09-29T17:48:25.869065] [INFO ] [REMOTE ] CAL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:48:25.948128] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-09-29T17:48:26.216002] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-29T17:48:26.709308] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-29T17:48:26.748163] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-09-29T17:48:27.548154] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-09-29T17:48:27.934812] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-29T17:48:27.944908] [INFO ] [REMOTE ] CADE: Full fetch complete (69441 records). [2025-09-29T17:48:27.945038] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-09-29T17:48:27.945722] [FATAL] [VALIDATOR ] CADE: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:48:27.945810] [FATAL] [MAIN ] CADE: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:48:27.945854] [WARN ] [MAIN ] CADE: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:48:27.945894] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-09-29T17:48:27.945975] [DEBUG] [LOCAL ] CADE: No primary data file found to delete. [2025-09-29T17:48:27.946030] [INFO ] [LOCAL ] CADE: Starting deletion of derivative data. [2025-09-29T17:48:27.946485] [DEBUG] [LOCAL ] CADE: Deleted derivative data file. [2025-09-29T17:48:27.946581] [INFO ] [MAIN ] Update Progress: 387/2371 symbols completed. CADE took 42.9s. Estimated remaining: 4h 8m 13s. Rate: 8.0 symbols/min [2025-09-29T17:48:28.131811] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:48:28.172703] [DEBUG] [LOCAL ] CALX: Loaded 38931 existing records from primary storage. [2025-09-29T17:48:28.173045] [INFO ] [MAIN ] CALX: Loaded 38931 existing records. [2025-09-29T17:48:28.354932] [INFO ] [REMOTE ] CAL: Fetching primary data for 2024-12. [2025-09-29T17:48:28.368853] [WARN ] [MAIN ] CALX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:48:28.370587] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-09-29T17:48:28.370701] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-09-29T17:48:28.371223] [DEBUG] [LOCAL ] CALX: Deleted primary data file. [2025-09-29T17:48:28.371286] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-09-29T17:48:28.775997] [INFO ] [REMOTE ] CALX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:48:28.807003] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-29T17:48:29.148090] [INFO ] [REMOTE ] CALX: Fetching primary data for 2024-12. [2025-09-29T17:48:29.190580] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-29T17:48:29.948132] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-09-29T17:48:30.080150] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-29T17:48:30.748119] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-09-29T17:48:30.841938] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-29T17:48:31.548149] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-01. [2025-09-29T17:48:32.121965] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-29T17:48:32.348098] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-09-29T17:48:32.577032] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-29T17:48:32.744191] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-29T17:48:33.148118] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-09-29T17:48:33.878527] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-29T17:48:33.948101] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-09-29T17:48:34.748142] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-09-29T17:48:34.983109] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-29T17:48:35.548088] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-01. [2025-09-29T17:48:35.789867] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-29T17:48:36.115616] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-29T17:48:36.348111] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-09-29T17:48:37.029269] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-29T17:48:37.148095] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-09-29T17:48:37.843734] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-29T17:48:37.948103] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-09-29T17:48:38.748144] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-09-29T17:48:39.202208] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-29T17:48:39.471923] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-29T17:48:39.548088] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-09-29T17:48:40.348097] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-09-29T17:48:40.677735] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-29T17:48:40.688696] [INFO ] [REMOTE ] CAH: Full fetch complete (74589 records). [2025-09-29T17:48:40.688848] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-09-29T17:48:41.116367] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-09-29T17:48:41.116560] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-09-29T17:48:41.117714] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-09-29T17:48:41.117805] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-09-29T17:48:41.119454] [DEBUG] [LOCAL ] CAH: Trimmed 74589 records to 51421 (keeping 200 days of data) [2025-09-29T17:48:41.177205] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-09-29T17:48:41.504058] [DEBUG] [LOCAL ] CAH: Primary data saved (51421 records). [2025-09-29T17:48:41.506276] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-29T17:48:41.506563] [INFO ] [MAIN ] CAH: Full history saved. [2025-09-29T17:48:41.522236] [INFO ] [MAIN ] Update Progress: 388/2371 symbols completed. CAH took 24.7s. Estimated remaining: 4h 8m 36s. Rate: 8.0 symbols/min [2025-09-29T17:48:41.703865] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:48:41.732112] [DEBUG] [LOCAL ] CANG: Loaded 27132 existing records from primary storage. [2025-09-29T17:48:41.732397] [INFO ] [MAIN ] CANG: Loaded 27132 existing records. [2025-09-29T17:48:41.932168] [WARN ] [MAIN ] CANG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:48:41.932478] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-09-29T17:48:41.932585] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-09-29T17:48:41.933204] [DEBUG] [LOCAL ] CANG: Deleted primary data file. [2025-09-29T17:48:41.933266] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-09-29T17:48:41.965505] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-09-29T17:48:42.139212] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-29T17:48:42.458021] [INFO ] [REMOTE ] CANG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:48:42.748086] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-09-29T17:48:42.846524] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-29T17:48:43.548111] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-09-29T17:48:44.348139] [INFO ] [REMOTE ] CANG: Fetching primary data for 2024-12. [2025-09-29T17:48:44.488961] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-09-29T17:48:44.500459] [INFO ] [REMOTE ] CAG: Full fetch complete (77650 records). [2025-09-29T17:48:44.500612] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-09-29T17:48:44.923718] [DEBUG] [VALIDATOR ] CAG: All expected trading days are present. [2025-09-29T17:48:44.923817] [DEBUG] [VALIDATOR ] CAG: Primary data validation passed. [2025-09-29T17:48:44.924719] [INFO ] [MAIN ] CAG: Fetched primary data is valid. [2025-09-29T17:48:44.924790] [DEBUG] [LOCAL ] CAG: Saving primary data. [2025-09-29T17:48:44.926381] [DEBUG] [LOCAL ] CAG: Trimmed 77650 records to 53660 (keeping 200 days of data) [2025-09-29T17:48:45.246068] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-29T17:48:45.281726] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-09-29T17:48:45.307952] [DEBUG] [LOCAL ] CAG: Primary data saved (53660 records). [2025-09-29T17:48:45.308109] [INFO ] [MAIN ] CAG: Full history saved. [2025-09-29T17:48:45.308198] [INFO ] [MAIN ] Update Progress: 389/2371 symbols completed. CAG took 41.2s. Estimated remaining: 4h 8m 10s. Rate: 8.0 symbols/min [2025-09-29T17:48:45.485868] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:48:45.493549] [DEBUG] [LOCAL ] CAPL: Loaded 5930 existing records from primary storage. [2025-09-29T17:48:45.493775] [INFO ] [MAIN ] CAPL: Loaded 5930 existing records. [2025-09-29T17:48:45.683433] [WARN ] [MAIN ] CAPL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:48:45.683638] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-09-29T17:48:45.683724] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-09-29T17:48:45.684009] [DEBUG] [LOCAL ] CAPL: Deleted primary data file. [2025-09-29T17:48:45.684069] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-09-29T17:48:46.079607] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:48:46.098922] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2024-12. [2025-09-29T17:48:46.100303] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-29T17:48:46.748140] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-01. [2025-09-29T17:48:46.883848] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-29T17:48:46.941697] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-29T17:48:47.548119] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-09-29T17:48:47.851118] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-29T17:48:48.348126] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-09-29T17:48:49.093610] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-29T17:48:49.148084] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-09-29T17:48:49.465204] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-29T17:48:49.948114] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-09-29T17:48:50.738198] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-29T17:48:50.748096] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-01. [2025-09-29T17:48:51.184957] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-29T17:48:51.486572] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-29T17:48:51.548118] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-09-29T17:48:52.348097] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-09-29T17:48:52.587040] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-29T17:48:52.726248] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-29T17:48:53.148118] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-09-29T17:48:53.948112] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-09-29T17:48:54.332739] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-29T17:48:54.748165] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-09-29T17:48:55.406558] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-29T17:48:55.431980] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-29T17:48:55.548115] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-09-29T17:48:56.338433] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-29T17:48:56.348066] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-09-29T17:48:57.148101] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-09-29T17:48:57.321878] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-29T17:48:57.948128] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-09-29T17:48:58.489415] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-29T17:48:58.748161] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-09-29T17:48:59.548198] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-09-29T17:48:59.707724] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-29T17:48:59.720281] [INFO ] [REMOTE ] CAL: Full fetch complete (61494 records). [2025-09-29T17:48:59.720501] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-09-29T17:48:59.723028] [FATAL] [VALIDATOR ] CAL: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:48:59.723135] [FATAL] [MAIN ] CAL: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:48:59.723180] [WARN ] [MAIN ] CAL: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:48:59.723271] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-09-29T17:48:59.723404] [DEBUG] [LOCAL ] CAL: No primary data file found to delete. [2025-09-29T17:48:59.723461] [INFO ] [LOCAL ] CAL: Starting deletion of derivative data. [2025-09-29T17:48:59.724150] [DEBUG] [LOCAL ] CAL: Deleted derivative data file. [2025-09-29T17:48:59.725074] [INFO ] [MAIN ] Update Progress: 390/2371 symbols completed. CAL took 34.7s. Estimated remaining: 4h 8m 37s. Rate: 8.0 symbols/min [2025-09-29T17:48:59.941363] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:48:59.951375] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-29T17:49:00.032700] [DEBUG] [LOCAL ] CARR: Loaded 54374 existing records from primary storage. [2025-09-29T17:49:00.033079] [INFO ] [MAIN ] CARR: Loaded 54374 existing records. [2025-09-29T17:49:00.145854] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-29T17:49:00.237271] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:49:00.237528] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-09-29T17:49:00.237590] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-09-29T17:49:00.238137] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-09-29T17:49:00.238200] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-09-29T17:49:00.353209] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-09-29T17:49:00.632058] [INFO ] [REMOTE ] CARR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:49:01.060552] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-29T17:49:01.148109] [INFO ] [REMOTE ] CARR: Fetching primary data for 2024-12. [2025-09-29T17:49:01.950577] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-09-29T17:49:02.748131] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-09-29T17:49:03.174292] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-29T17:49:03.355790] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-29T17:49:03.504095] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-29T17:49:03.548112] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-01. [2025-09-29T17:49:03.791143] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (21.04 seconds). [2025-09-29T17:49:04.348119] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-09-29T17:49:05.148096] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-09-29T17:49:05.340477] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-29T17:49:05.814343] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-29T17:49:05.821177] [INFO ] [REMOTE ] CANG: Full fetch complete (40634 records). [2025-09-29T17:49:05.821300] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-09-29T17:49:05.929683] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-29T17:49:05.949616] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-09-29T17:49:05.949901] [INFO ] [REMOTE ] CAPL: Full fetch complete (8855 records). [2025-09-29T17:49:05.961051] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-09-29T17:49:06.024409] [FATAL] [VALIDATOR ] CAPL: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:49:06.108174] [FATAL] [MAIN ] CAPL: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:49:06.125285] [WARN ] [MAIN ] CAPL: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:49:06.147397] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-09-29T17:49:06.147527] [DEBUG] [LOCAL ] CAPL: No primary data file found to delete. [2025-09-29T17:49:06.153213] [INFO ] [LOCAL ] CAPL: Starting deletion of derivative data. [2025-09-29T17:49:06.174117] [DEBUG] [LOCAL ] CAPL: Deleted derivative data file. [2025-09-29T17:49:06.197514] [INFO ] [MAIN ] Update Progress: 391/2371 symbols completed. CAPL took 20.9s. Estimated remaining: 4h 8m 25s. Rate: 8.0 symbols/min [2025-09-29T17:49:06.245551] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-09-29T17:49:06.272907] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-09-29T17:49:06.291451] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-09-29T17:49:06.291616] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-09-29T17:49:06.364594] [DEBUG] [LOCAL ] CANG: Trimmed 40634 records to 26896 (keeping 200 days of data) [2025-09-29T17:49:06.524607] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:49:06.587248] [DEBUG] [LOCAL ] CARS: Loaded 40616 existing records from primary storage. [2025-09-29T17:49:06.587698] [INFO ] [MAIN ] CARS: Loaded 40616 existing records. [2025-09-29T17:49:06.752856] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-09-29T17:49:06.826970] [WARN ] [MAIN ] CARS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:49:06.827886] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-09-29T17:49:06.828245] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-09-29T17:49:06.828717] [DEBUG] [LOCAL ] CARS: Deleted primary data file. [2025-09-29T17:49:06.829124] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-09-29T17:49:06.938858] [DEBUG] [LOCAL ] CANG: Primary data saved (26896 records). [2025-09-29T17:49:06.949531] [INFO ] [MAIN ] CANG: Full history saved. [2025-09-29T17:49:06.960485] [INFO ] [MAIN ] Update Progress: 392/2371 symbols completed. CANG took 25.4s. Estimated remaining: 4h 7m 43s. Rate: 8.0 symbols/min [2025-09-29T17:49:07.320544] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:49:07.420276] [INFO ] [REMOTE ] CARS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:49:07.444978] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-29T17:49:07.495488] [DEBUG] [LOCAL ] CAT: Loaded 53693 existing records from primary storage. [2025-09-29T17:49:07.495855] [INFO ] [MAIN ] CAT: Loaded 53693 existing records. [2025-09-29T17:49:07.558537] [INFO ] [REMOTE ] CARS: Fetching primary data for 2024-12. [2025-09-29T17:49:07.680114] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:49:07.680332] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-09-29T17:49:07.680383] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-09-29T17:49:07.680877] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-09-29T17:49:07.680937] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-09-29T17:49:08.048454] [INFO ] [REMOTE ] CAT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:49:08.348082] [INFO ] [REMOTE ] CAT: Fetching primary data for 2024-12. [2025-09-29T17:49:08.517694] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-29T17:49:08.799625] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-29T17:49:09.148103] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-09-29T17:49:09.948145] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-01. [2025-09-29T17:49:10.480334] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-29T17:49:10.531070] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-29T17:49:10.748138] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-09-29T17:49:10.980580] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-29T17:49:11.548177] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-01. [2025-09-29T17:49:12.353219] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-09-29T17:49:12.368422] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-29T17:49:13.148105] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-09-29T17:49:13.678949] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-29T17:49:13.828690] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-29T17:49:13.948120] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-09-29T17:49:14.672064] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-29T17:49:14.748122] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-09-29T17:49:15.217420] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-29T17:49:15.548117] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-09-29T17:49:16.348120] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-09-29T17:49:16.368568] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-29T17:49:16.376237] [INFO ] [REMOTE ] CALX: Full fetch complete (53935 records). [2025-09-29T17:49:16.376371] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-09-29T17:49:16.377036] [FATAL] [VALIDATOR ] CALX: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:49:16.377126] [FATAL] [MAIN ] CALX: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:49:16.377172] [WARN ] [MAIN ] CALX: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:49:16.377244] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-09-29T17:49:16.377392] [DEBUG] [LOCAL ] CALX: No primary data file found to delete. [2025-09-29T17:49:16.377450] [INFO ] [LOCAL ] CALX: Starting deletion of derivative data. [2025-09-29T17:49:16.377778] [DEBUG] [LOCAL ] CALX: Deleted derivative data file. [2025-09-29T17:49:16.377875] [INFO ] [MAIN ] Update Progress: 393/2371 symbols completed. CALX took 48.4s. Estimated remaining: 4h 7m 45s. Rate: 8.0 symbols/min [2025-09-29T17:49:16.557582] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:49:16.566473] [DEBUG] [LOCAL ] CATO: Loaded 7286 existing records from primary storage. [2025-09-29T17:49:16.566708] [INFO ] [MAIN ] CATO: Loaded 7286 existing records. [2025-09-29T17:49:16.764889] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:49:16.765252] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-09-29T17:49:16.765311] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-09-29T17:49:16.765538] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-09-29T17:49:16.765598] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-09-29T17:49:17.168061] [INFO ] [REMOTE ] CATO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:49:17.180424] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-09-29T17:49:17.183507] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-29T17:49:17.948077] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-09-29T17:49:18.386595] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-29T17:49:18.748142] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-09-29T17:49:19.112202] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-29T17:49:19.545734] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-29T17:49:19.554238] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-09-29T17:49:20.348112] [INFO ] [REMOTE ] CATO: Fetching primary data for 2024-12. [2025-09-29T17:49:20.925305] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-29T17:49:21.009314] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-29T17:49:21.148100] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-09-29T17:49:21.462764] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-29T17:49:21.948156] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-09-29T17:49:22.748131] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-01. [2025-09-29T17:49:23.218465] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-29T17:49:23.290912] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-29T17:49:23.294484] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-29T17:49:23.548110] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-09-29T17:49:24.348125] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-09-29T17:49:25.102153] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-29T17:49:25.148082] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-09-29T17:49:25.559127] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-29T17:49:25.797793] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-29T17:49:25.948118] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-09-29T17:49:26.748129] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-09-29T17:49:27.287167] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-29T17:49:27.548104] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-09-29T17:49:28.348117] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-09-29T17:49:28.769776] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-29T17:49:29.026752] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-29T17:49:29.028233] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-29T17:49:29.148088] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-09-29T17:49:29.768294] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-29T17:49:29.948112] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-09-29T17:49:30.748126] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-09-29T17:49:31.349900] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-29T17:49:31.358196] [INFO ] [REMOTE ] CARS: Full fetch complete (55355 records). [2025-09-29T17:49:31.358348] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-09-29T17:49:31.585961] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-09-29T17:49:31.723188] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-29T17:49:31.824964] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-09-29T17:49:31.825061] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-09-29T17:49:31.826000] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-09-29T17:49:31.826071] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-09-29T17:49:31.827451] [DEBUG] [LOCAL ] CARS: Trimmed 55355 records to 39894 (keeping 200 days of data) [2025-09-29T17:49:32.067120] [DEBUG] [LOCAL ] CARS: Primary data saved (39894 records). [2025-09-29T17:49:32.067273] [INFO ] [MAIN ] CARS: Full history saved. [2025-09-29T17:49:32.067381] [INFO ] [MAIN ] Update Progress: 394/2371 symbols completed. CARS took 25.9s. Estimated remaining: 4h 8m 18s. Rate: 8.0 symbols/min [2025-09-29T17:49:32.240551] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:49:32.303481] [DEBUG] [LOCAL ] CAVA: Loaded 54330 existing records from primary storage. [2025-09-29T17:49:32.303847] [INFO ] [MAIN ] CAVA: Loaded 54330 existing records. [2025-09-29T17:49:32.359245] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-09-29T17:49:32.493109] [WARN ] [MAIN ] CAVA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:49:32.493278] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-09-29T17:49:32.493328] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-09-29T17:49:32.494012] [DEBUG] [LOCAL ] CAVA: Deleted primary data file. [2025-09-29T17:49:32.494085] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-09-29T17:49:32.889322] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:49:33.054902] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-29T17:49:33.148094] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2024-12. [2025-09-29T17:49:33.387150] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-29T17:49:33.948148] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-09-29T17:49:34.731615] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-29T17:49:34.748124] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-09-29T17:49:35.548129] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-09-29T17:49:36.348152] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-09-29T17:49:36.861964] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-29T17:49:36.873607] [INFO ] [REMOTE ] CARR: Full fetch complete (77602 records). [2025-09-29T17:49:36.873771] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-09-29T17:49:37.234916] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2024-12 (4.09 seconds). [2025-09-29T17:49:37.262575] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-01. [2025-09-29T17:49:37.334776] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-29T17:49:37.363582] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-09-29T17:49:37.362796] [INFO ] [REMOTE ] CATO: Full fetch complete (11670 records). [2025-09-29T17:49:37.363829] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-09-29T17:49:37.364036] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-09-29T17:49:37.365460] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-09-29T17:49:37.365668] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-09-29T17:49:37.477545] [DEBUG] [LOCAL ] CARR: Trimmed 77602 records to 53594 (keeping 200 days of data) [2025-09-29T17:49:37.876518] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-09-29T17:49:37.877431] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-09-29T17:49:37.878172] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-09-29T17:49:37.879009] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-09-29T17:49:37.882277] [DEBUG] [LOCAL ] CATO: Trimmed 11670 records to 7098 (keeping 200 days of data) [2025-09-29T17:49:37.969614] [DEBUG] [LOCAL ] CATO: Primary data saved (7098 records). [2025-09-29T17:49:37.970403] [INFO ] [MAIN ] CATO: Full history saved. [2025-09-29T17:49:37.970962] [INFO ] [MAIN ] Update Progress: 395/2371 symbols completed. CATO took 21.6s. Estimated remaining: 4h 8m 3s. Rate: 8.0 symbols/min [2025-09-29T17:49:37.979305] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-09-29T17:49:38.039165] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-09-29T17:49:38.303133] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:49:38.425871] [DEBUG] [LOCAL ] CARR: Primary data saved (53594 records). [2025-09-29T17:49:38.426033] [INFO ] [MAIN ] CARR: Full history saved. [2025-09-29T17:49:38.426940] [INFO ] [MAIN ] Update Progress: 396/2371 symbols completed. CARR took 38.7s. Estimated remaining: 4h 7m 20s. Rate: 8.0 symbols/min [2025-09-29T17:49:38.550218] [DEBUG] [LOCAL ] CB: Loaded 50773 existing records from primary storage. [2025-09-29T17:49:38.563962] [INFO ] [MAIN ] CB: Loaded 50773 existing records. [2025-09-29T17:49:38.757261] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:49:38.847259] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:49:38.847673] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-09-29T17:49:38.847740] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-09-29T17:49:38.852153] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-09-29T17:49:38.852302] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-09-29T17:49:38.852560] [DEBUG] [LOCAL ] CBAN: Loaded 11141 existing records from primary storage. [2025-09-29T17:49:38.916283] [INFO ] [MAIN ] CBAN: Loaded 11141 existing records. [2025-09-29T17:49:39.324937] [WARN ] [MAIN ] CBAN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:49:39.361602] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-09-29T17:49:39.367244] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-09-29T17:49:39.401841] [DEBUG] [LOCAL ] CBAN: Deleted primary data file. [2025-09-29T17:49:39.443279] [INFO ] [REMOTE ] CB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:49:39.443585] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-09-29T17:49:39.443883] [INFO ] [REMOTE ] CB: Fetching primary data for 2024-12. [2025-09-29T17:49:39.830787] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-09-29T17:49:39.874067] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:49:39.874839] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2024-12. [2025-09-29T17:49:40.359202] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-09-29T17:49:40.364871] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-09-29T17:49:40.450792] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-29T17:49:41.056274] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-29T17:49:41.148106] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-09-29T17:49:41.948077] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-09-29T17:49:42.301134] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-29T17:49:42.748094] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-09-29T17:49:43.211488] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-29T17:49:43.548128] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-01. [2025-09-29T17:49:43.894387] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-29T17:49:44.346392] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-29T17:49:44.349786] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-09-29T17:49:44.886789] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-29T17:49:45.148137] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-09-29T17:49:45.248915] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-29T17:49:45.948120] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-09-29T17:49:46.748125] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-09-29T17:49:47.017060] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-29T17:49:47.259699] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-29T17:49:47.548158] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-09-29T17:49:48.073865] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-29T17:49:48.348117] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-09-29T17:49:49.148115] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-09-29T17:49:49.769037] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-29T17:49:49.948135] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-09-29T17:49:50.456772] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-29T17:49:50.748123] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-09-29T17:49:51.049342] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-29T17:49:51.548112] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-09-29T17:49:52.086055] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-29T17:49:52.348117] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-09-29T17:49:53.027912] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-29T17:49:53.039349] [INFO ] [REMOTE ] CAT: Full fetch complete (76665 records). [2025-09-29T17:49:53.039518] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-09-29T17:49:53.150288] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-09-29T17:49:53.486724] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-09-29T17:49:53.486941] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-09-29T17:49:53.488113] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-09-29T17:49:53.488199] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-09-29T17:49:53.490125] [DEBUG] [LOCAL ] CAT: Trimmed 76665 records to 52915 (keeping 200 days of data) [2025-09-29T17:49:53.620310] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-29T17:49:53.882146] [DEBUG] [LOCAL ] CAT: Primary data saved (52915 records). [2025-09-29T17:49:53.882308] [INFO ] [MAIN ] CAT: Full history saved. [2025-09-29T17:49:53.882399] [INFO ] [MAIN ] Update Progress: 397/2371 symbols completed. CAT took 46.9s. Estimated remaining: 4h 7m 52s. Rate: 8.0 symbols/min [2025-09-29T17:49:53.948210] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-09-29T17:49:54.511371] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-29T17:49:54.748184] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-09-29T17:49:55.368045] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-29T17:49:55.548111] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-09-29T17:49:55.690322] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-29T17:49:56.348061] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-09-29T17:49:56.423767] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-29T17:49:56.924021] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-29T17:49:57.148174] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-09-29T17:49:57.766557] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-29T17:49:57.948150] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-09-29T17:49:58.748170] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-09-29T17:49:58.788889] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-29T17:49:59.306120] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-29T17:49:59.548141] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-09-29T17:50:00.319830] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-29T17:50:00.348098] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-09-29T17:50:00.396704] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-29T17:50:01.148170] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-09-29T17:50:01.210209] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-29T17:50:01.948346] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-09-29T17:50:02.748178] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-09-29T17:50:03.227392] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-29T17:50:03.548157] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-09-29T17:50:04.481690] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-09-29T17:50:04.494049] [INFO ] [REMOTE ] CAVA: Full fetch complete (77287 records). [2025-09-29T17:50:04.494258] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-09-29T17:50:04.611960] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-29T17:50:04.624579] [INFO ] [REMOTE ] CBAN: Full fetch complete (16015 records). [2025-09-29T17:50:04.635020] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-09-29T17:50:04.665499] [FATAL] [VALIDATOR ] CBAN: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:50:04.699405] [FATAL] [MAIN ] CBAN: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:50:04.721418] [WARN ] [MAIN ] CBAN: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:50:04.795182] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-09-29T17:50:04.833141] [DEBUG] [LOCAL ] CBAN: No primary data file found to delete. [2025-09-29T17:50:04.835866] [INFO ] [LOCAL ] CBAN: Starting deletion of derivative data. [2025-09-29T17:50:04.847104] [DEBUG] [LOCAL ] CBAN: Deleted derivative data file. [2025-09-29T17:50:04.862677] [INFO ] [MAIN ] Update Progress: 398/2371 symbols completed. CBAN took 26.4s. Estimated remaining: 4h 8m 1s. Rate: 8.0 symbols/min [2025-09-29T17:50:04.939510] [DEBUG] [VALIDATOR ] CAVA: All expected trading days are present. [2025-09-29T17:50:04.939606] [DEBUG] [VALIDATOR ] CAVA: Primary data validation passed. [2025-09-29T17:50:04.940485] [INFO ] [MAIN ] CAVA: Fetched primary data is valid. [2025-09-29T17:50:04.940556] [DEBUG] [LOCAL ] CAVA: Saving primary data. [2025-09-29T17:50:04.942251] [DEBUG] [LOCAL ] CAVA: Trimmed 77287 records to 53552 (keeping 200 days of data) [2025-09-29T17:50:05.281934] [DEBUG] [LOCAL ] CAVA: Primary data saved (53552 records). [2025-09-29T17:50:05.282233] [INFO ] [MAIN ] CAVA: Full history saved. [2025-09-29T17:50:05.282442] [INFO ] [MAIN ] Update Progress: 399/2371 symbols completed. CAVA took 33.2s. Estimated remaining: 4h 7m 19s. Rate: 8.0 symbols/min [2025-09-29T17:50:07.334200] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (3.79 seconds). [2025-09-29T17:50:07.345211] [INFO ] [REMOTE ] CB: Full fetch complete (72684 records). [2025-09-29T17:50:07.345379] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-09-29T17:50:07.779114] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-09-29T17:50:07.779205] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-09-29T17:50:07.780017] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-09-29T17:50:07.780082] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-09-29T17:50:07.781973] [DEBUG] [LOCAL ] CB: Trimmed 72684 records to 49973 (keeping 200 days of data) [2025-09-29T17:50:08.115498] [DEBUG] [LOCAL ] CB: Primary data saved (49973 records). [2025-09-29T17:50:08.115703] [INFO ] [MAIN ] CB: Full history saved. [2025-09-29T17:50:08.115880] [INFO ] [MAIN ] Update Progress: 400/2371 symbols completed. CB took 30.1s. Estimated remaining: 4h 6m 48s. Rate: 8.0 symbols/min [2025-09-29T17:50:08.839240] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:50:08.942437] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:50:08.947667] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:50:08.904702] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:50:08.948217] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-09-29T17:50:08.948906] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-09-29T17:50:08.950043] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-09-29T17:50:08.950129] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-09-29T17:50:08.950868] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-09-29T17:50:08.950996] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-09-29T17:50:09.008297] [DEBUG] [LOCAL ] CBNA: Loaded 2923 existing records from primary storage. [2025-09-29T17:50:09.044934] [INFO ] [MAIN ] CBNA: Loaded 2923 existing records. [2025-09-29T17:50:09.166701] [DEBUG] [LOCAL ] CBL: Loaded 16862 existing records from primary storage. [2025-09-29T17:50:09.217688] [INFO ] [MAIN ] CBL: Loaded 16862 existing records. [2025-09-29T17:50:09.467417] [DEBUG] [LOCAL ] CBRE: Loaded 51366 existing records from primary storage. [2025-09-29T17:50:09.497857] [INFO ] [MAIN ] CBRE: Loaded 51366 existing records. [2025-09-29T17:50:09.895910] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:50:09.998709] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-09-29T17:50:10.094073] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-09-29T17:50:10.130091] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:50:10.121290] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:50:10.155135] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-09-29T17:50:10.161901] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:50:10.162817] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-09-29T17:50:10.162999] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-09-29T17:50:10.162548] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-09-29T17:50:10.164051] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-09-29T17:50:10.164149] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-09-29T17:50:10.163910] [INFO ] [REMOTE ] CBO: Fetching primary data for 2024-12. [2025-09-29T17:50:10.201456] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-09-29T17:50:10.227056] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-09-29T17:50:10.252131] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-09-29T17:50:10.275249] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-09-29T17:50:10.566740] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T17:50:10.581760] [WARN ] [REMOTE ] CBO: No data returned for month 2024-12 [2025-09-29T17:50:10.618158] [FATAL] [REMOTE ] CBO: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T17:50:10.643371] [FATAL] [MAIN ] CBO: Failed to fetch primary data. [2025-09-29T17:50:10.713190] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T17:50:10.758736] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-09-29T17:50:10.867739] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-09-29T17:50:10.892302] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-09-29T17:50:10.972420] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-09-29T17:50:11.056277] [INFO ] [MAIN ] Update Progress: 401/2371 symbols completed. CBO took 2.9s. Estimated remaining: 4h 6m 18s. Rate: 8.0 symbols/min [2025-09-29T17:50:11.445623] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:50:11.465138] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:50:11.498390] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2024-12. [2025-09-29T17:50:11.521557] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2024-12. [2025-09-29T17:50:11.625863] [INFO ] [REMOTE ] CBL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:50:11.636357] [INFO ] [REMOTE ] CBL: Fetching primary data for 2024-12. [2025-09-29T17:50:11.666381] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:50:11.705149] [DEBUG] [LOCAL ] CBT: Loaded 31567 existing records from primary storage. [2025-09-29T17:50:11.705481] [INFO ] [MAIN ] CBT: Loaded 31567 existing records. [2025-09-29T17:50:11.891814] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:50:11.892083] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-09-29T17:50:11.892147] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-09-29T17:50:11.892794] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-09-29T17:50:11.892858] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-09-29T17:50:12.277274] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-29T17:50:12.298479] [INFO ] [REMOTE ] CBT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:50:12.300745] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-01. [2025-09-29T17:50:12.301411] [INFO ] [REMOTE ] CBT: Fetching primary data for 2024-12. [2025-09-29T17:50:12.837057] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-29T17:50:12.844873] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-01. [2025-09-29T17:50:12.989862] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-29T17:50:12.991554] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-09-29T17:50:13.052284] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-29T17:50:13.063963] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-01. [2025-09-29T17:50:13.447608] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-29T17:50:13.455184] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-01. [2025-09-29T17:50:13.530740] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-29T17:50:13.532838] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-09-29T17:50:13.770689] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-29T17:50:13.775363] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-09-29T17:50:14.012627] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-29T17:50:14.013917] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-09-29T17:50:14.534684] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-29T17:50:14.735573] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-29T17:50:14.748086] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-09-29T17:50:14.861533] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-29T17:50:14.873675] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-29T17:50:15.294422] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-29T17:50:15.548102] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-09-29T17:50:16.348137] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-09-29T17:50:16.857623] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-29T17:50:16.908138] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-29T17:50:17.148135] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-09-29T17:50:17.607482] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-29T17:50:17.948117] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-09-29T17:50:18.748128] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-09-29T17:50:19.041908] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-29T17:50:19.548168] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-09-29T17:50:20.317722] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-29T17:50:20.348150] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-09-29T17:50:20.948622] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-29T17:50:21.148109] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-09-29T17:50:21.948104] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-09-29T17:50:22.058582] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-29T17:50:22.620070] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-29T17:50:22.748166] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-09-29T17:50:23.032167] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-29T17:50:23.297443] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-29T17:50:23.548135] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-09-29T17:50:24.348137] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-09-29T17:50:25.059525] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-29T17:50:25.148141] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-09-29T17:50:25.358970] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-29T17:50:25.856854] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-29T17:50:25.857998] [INFO ] [REMOTE ] CBNA: Full fetch complete (4635 records). [2025-09-29T17:50:25.858109] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-09-29T17:50:25.953330] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-09-29T17:50:26.282153] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-09-29T17:50:26.282233] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-09-29T17:50:26.282403] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-09-29T17:50:26.282443] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-09-29T17:50:26.282845] [DEBUG] [LOCAL ] CBNA: Trimmed 4635 records to 2901 (keeping 200 days of data) [2025-09-29T17:50:26.301603] [DEBUG] [LOCAL ] CBNA: Primary data saved (2901 records). [2025-09-29T17:50:26.301743] [INFO ] [MAIN ] CBNA: Full history saved. [2025-09-29T17:50:26.301847] [INFO ] [MAIN ] Update Progress: 402/2371 symbols completed. CBNA took 18.2s. Estimated remaining: 4h 6m 49s. Rate: 8.0 symbols/min [2025-09-29T17:50:26.488874] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:50:26.518718] [DEBUG] [LOCAL ] CBU: Loaded 23130 existing records from primary storage. [2025-09-29T17:50:26.518986] [INFO ] [MAIN ] CBU: Loaded 23130 existing records. [2025-09-29T17:50:26.723604] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:50:26.723940] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-09-29T17:50:26.724012] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-09-29T17:50:26.724438] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-09-29T17:50:26.724500] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-09-29T17:50:26.755443] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-09-29T17:50:26.970212] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-29T17:50:27.135202] [INFO ] [REMOTE ] CBU: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:50:27.548124] [INFO ] [REMOTE ] CBU: Fetching primary data for 2024-12. [2025-09-29T17:50:28.348153] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-09-29T17:50:28.448074] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-29T17:50:28.704218] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-29T17:50:29.148157] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-09-29T17:50:29.319065] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-29T17:50:29.948138] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-09-29T17:50:30.748131] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-09-29T17:50:30.958579] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-29T17:50:31.121090] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-29T17:50:31.548138] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-09-29T17:50:31.800334] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-29T17:50:32.348146] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-09-29T17:50:33.148087] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-09-29T17:50:33.186218] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-29T17:50:33.623696] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-29T17:50:33.948134] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-09-29T17:50:34.468044] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-29T17:50:34.748125] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-09-29T17:50:35.548143] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-01. [2025-09-29T17:50:35.598828] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-29T17:50:35.737053] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-29T17:50:35.742306] [INFO ] [REMOTE ] CBL: Full fetch complete (25478 records). [2025-09-29T17:50:35.742531] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-09-29T17:50:36.163174] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-09-29T17:50:36.163258] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-09-29T17:50:36.163727] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-09-29T17:50:36.163845] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-09-29T17:50:36.164718] [DEBUG] [LOCAL ] CBL: Trimmed 25478 records to 16397 (keeping 200 days of data) [2025-09-29T17:50:36.269235] [DEBUG] [LOCAL ] CBL: Primary data saved (16397 records). [2025-09-29T17:50:36.269382] [INFO ] [MAIN ] CBL: Full history saved. [2025-09-29T17:50:36.269538] [INFO ] [MAIN ] Update Progress: 403/2371 symbols completed. CBL took 28.2s. Estimated remaining: 4h 6m 53s. Rate: 8.0 symbols/min [2025-09-29T17:50:36.353198] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-09-29T17:50:36.470266] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:50:36.470490] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-09-29T17:50:36.470638] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-09-29T17:50:36.470814] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-09-29T17:50:36.470870] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-09-29T17:50:36.470934] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-09-29T17:50:36.470980] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-09-29T17:50:36.819567] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-29T17:50:36.895825] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:50:37.148105] [INFO ] [REMOTE ] CBX: Fetching primary data for 2024-12. [2025-09-29T17:50:37.367166] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T17:50:37.367510] [WARN ] [REMOTE ] CBX: No data returned for month 2024-12 [2025-09-29T17:50:37.367604] [FATAL] [REMOTE ] CBX: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T17:50:37.367699] [FATAL] [MAIN ] CBX: Failed to fetch primary data. [2025-09-29T17:50:37.367777] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T17:50:37.367864] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-09-29T17:50:37.367963] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-09-29T17:50:37.368022] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-09-29T17:50:37.368081] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-09-29T17:50:37.368168] [INFO ] [MAIN ] Update Progress: 404/2371 symbols completed. CBX took 1.1s. Estimated remaining: 4h 6m 14s. Rate: 8.0 symbols/min [2025-09-29T17:50:37.555998] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:50:37.594332] [DEBUG] [LOCAL ] CBZ: Loaded 34130 existing records from primary storage. [2025-09-29T17:50:37.594638] [INFO ] [MAIN ] CBZ: Loaded 34130 existing records. [2025-09-29T17:50:37.790007] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:50:37.790335] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-09-29T17:50:37.790388] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-09-29T17:50:37.790726] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-09-29T17:50:37.790787] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-09-29T17:50:37.955123] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-09-29T17:50:38.081898] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-29T17:50:38.137105] [INFO ] [REMOTE ] CBT: Full fetch complete (45849 records). [2025-09-29T17:50:38.157740] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-09-29T17:50:38.293875] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:50:38.662086] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-09-29T17:50:38.662173] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-09-29T17:50:38.662940] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-09-29T17:50:38.663011] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-09-29T17:50:38.664178] [DEBUG] [LOCAL ] CBT: Trimmed 45849 records to 30857 (keeping 200 days of data) [2025-09-29T17:50:38.753550] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2024-12. [2025-09-29T17:50:38.857744] [DEBUG] [LOCAL ] CBT: Primary data saved (30857 records). [2025-09-29T17:50:38.857894] [INFO ] [MAIN ] CBT: Full history saved. [2025-09-29T17:50:38.857984] [INFO ] [MAIN ] Update Progress: 405/2371 symbols completed. CBT took 27.7s. Estimated remaining: 4h 5m 37s. Rate: 8.0 symbols/min [2025-09-29T17:50:39.036509] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:50:39.094309] [DEBUG] [LOCAL ] CC: Loaded 53801 existing records from primary storage. [2025-09-29T17:50:39.094696] [INFO ] [MAIN ] CC: Loaded 53801 existing records. [2025-09-29T17:50:39.315592] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-29T17:50:39.325565] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:50:39.330813] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-09-29T17:50:39.330928] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-09-29T17:50:39.331460] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-09-29T17:50:39.331526] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-09-29T17:50:39.555448] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-09-29T17:50:39.733565] [INFO ] [REMOTE ] CC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:50:39.751606] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-29T17:50:40.348115] [INFO ] [REMOTE ] CC: Fetching primary data for 2024-12. [2025-09-29T17:50:40.819150] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-29T17:50:41.148120] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-09-29T17:50:41.948136] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-01. [2025-09-29T17:50:42.080376] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-29T17:50:42.303471] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-29T17:50:42.748114] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-09-29T17:50:43.075401] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-29T17:50:43.548124] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-09-29T17:50:44.348089] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-01. [2025-09-29T17:50:44.459426] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-29T17:50:44.574734] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-29T17:50:45.148111] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-09-29T17:50:45.887686] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-29T17:50:45.911128] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-29T17:50:45.948080] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-09-29T17:50:46.748194] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-09-29T17:50:47.548100] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-09-29T17:50:47.593818] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-29T17:50:48.017519] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-29T17:50:48.348152] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-09-29T17:50:49.148086] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-09-29T17:50:49.491893] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-29T17:50:49.502530] [INFO ] [REMOTE ] CBRE: Full fetch complete (73983 records). [2025-09-29T17:50:49.502754] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-09-29T17:50:49.928732] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-09-29T17:50:49.928853] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-09-29T17:50:49.929823] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-09-29T17:50:49.929914] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-09-29T17:50:49.931544] [DEBUG] [LOCAL ] CBRE: Trimmed 73983 records to 50596 (keeping 200 days of data) [2025-09-29T17:50:49.983239] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-09-29T17:50:50.197588] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-29T17:50:50.227892] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-29T17:50:50.319990] [DEBUG] [LOCAL ] CBRE: Primary data saved (50596 records). [2025-09-29T17:50:50.320158] [INFO ] [MAIN ] CBRE: Full history saved. [2025-09-29T17:50:50.320248] [INFO ] [MAIN ] Update Progress: 406/2371 symbols completed. CBRE took 42.2s. Estimated remaining: 4h 5m 49s. Rate: 8.0 symbols/min [2025-09-29T17:50:50.507917] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:50:50.570749] [DEBUG] [LOCAL ] CCI: Loaded 53922 existing records from primary storage. [2025-09-29T17:50:50.571178] [INFO ] [MAIN ] CCI: Loaded 53922 existing records. [2025-09-29T17:50:50.763418] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-09-29T17:50:50.772298] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:50:50.773498] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-09-29T17:50:50.773585] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-09-29T17:50:50.774238] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-09-29T17:50:50.774466] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-09-29T17:50:51.209485] [INFO ] [REMOTE ] CCI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:50:51.418797] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-29T17:50:51.548122] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-09-29T17:50:52.123030] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-29T17:50:52.348108] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-09-29T17:50:53.148111] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-09-29T17:50:53.389636] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-29T17:50:53.420016] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-29T17:50:53.425560] [INFO ] [REMOTE ] CBU: Full fetch complete (32259 records). [2025-09-29T17:50:53.425683] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-09-29T17:50:53.830369] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-09-29T17:50:53.830456] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-09-29T17:50:53.831056] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-09-29T17:50:53.831182] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-09-29T17:50:53.832136] [DEBUG] [LOCAL ] CBU: Trimmed 32259 records to 22640 (keeping 200 days of data) [2025-09-29T17:50:53.948754] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-09-29T17:50:53.980011] [DEBUG] [LOCAL ] CBU: Primary data saved (22640 records). [2025-09-29T17:50:53.980183] [INFO ] [MAIN ] CBU: Full history saved. [2025-09-29T17:50:53.980324] [INFO ] [MAIN ] Update Progress: 407/2371 symbols completed. CBU took 27.7s. Estimated remaining: 4h 5m 23s. Rate: 8.0 symbols/min [2025-09-29T17:50:54.171023] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:50:54.171273] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-09-29T17:50:54.171409] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-09-29T17:50:54.171531] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-09-29T17:50:54.171574] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-09-29T17:50:54.171617] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-09-29T17:50:54.171678] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-09-29T17:50:54.565774] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:50:54.588232] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-29T17:50:54.748118] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2024-12. [2025-09-29T17:50:55.187279] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-29T17:50:55.548111] [INFO ] [REMOTE ] CCI: Fetching primary data for 2024-12. [2025-09-29T17:50:55.710633] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-29T17:50:56.348144] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-09-29T17:50:56.791241] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-29T17:50:57.148090] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-09-29T17:50:57.411281] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-29T17:50:57.948095] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-09-29T17:50:58.392487] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-29T17:50:58.748153] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-01. [2025-09-29T17:50:59.548206] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-09-29T17:50:59.715166] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-29T17:51:00.348126] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-09-29T17:51:00.548383] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-29T17:51:00.639202] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-09-29T17:51:01.148160] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-09-29T17:51:01.178371] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-29T17:51:01.948142] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-09-29T17:51:02.748149] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-09-29T17:51:03.109776] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-29T17:51:03.232828] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-29T17:51:03.322369] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-29T17:51:03.548187] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-09-29T17:51:04.348148] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-09-29T17:51:04.782363] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-29T17:51:04.878627] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-29T17:51:05.148131] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-09-29T17:51:05.948167] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-09-29T17:51:06.507428] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-29T17:51:06.748132] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-09-29T17:51:07.133974] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-29T17:51:07.181397] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-29T17:51:07.548112] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-09-29T17:51:08.348134] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-09-29T17:51:09.148155] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-09-29T17:51:09.186204] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-29T17:51:09.195036] [INFO ] [REMOTE ] CBZ: Full fetch complete (45176 records). [2025-09-29T17:51:09.195172] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-09-29T17:51:09.600776] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-09-29T17:51:09.600886] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-09-29T17:51:09.601499] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-09-29T17:51:09.601543] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-09-29T17:51:09.602552] [DEBUG] [LOCAL ] CBZ: Trimmed 45176 records to 33640 (keeping 200 days of data) [2025-09-29T17:51:09.813083] [DEBUG] [LOCAL ] CBZ: Primary data saved (33640 records). [2025-09-29T17:51:09.813243] [INFO ] [MAIN ] CBZ: Full history saved. [2025-09-29T17:51:09.813335] [INFO ] [MAIN ] Update Progress: 408/2371 symbols completed. CBZ took 32.4s. Estimated remaining: 4h 5m 56s. Rate: 8.0 symbols/min [2025-09-29T17:51:09.953539] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-09-29T17:51:10.007574] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:51:10.045555] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-29T17:51:10.072131] [DEBUG] [LOCAL ] CCIF: Loaded 15698 existing records from primary storage. [2025-09-29T17:51:10.072448] [INFO ] [MAIN ] CCIF: Loaded 15698 existing records. [2025-09-29T17:51:10.279033] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:51:10.279270] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-09-29T17:51:10.279319] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-09-29T17:51:10.279573] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-09-29T17:51:10.279633] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-09-29T17:51:10.397882] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-29T17:51:10.676027] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:51:10.748093] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-09-29T17:51:10.999708] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-29T17:51:11.189815] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-29T17:51:11.548197] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-09-29T17:51:12.188185] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-29T17:51:12.189165] [INFO ] [REMOTE ] CCIA: Full fetch complete (2047 records). [2025-09-29T17:51:12.189275] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-09-29T17:51:12.350569] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-09-29T17:51:12.381604] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-29T17:51:12.382013] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:51:12.382085] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:51:12.382163] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-09-29T17:51:12.382232] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-09-29T17:51:12.382274] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-09-29T17:51:12.382335] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-09-29T17:51:12.382418] [INFO ] [MAIN ] Update Progress: 409/2371 symbols completed. CCIA took 18.4s. Estimated remaining: 4h 5m 24s. Rate: 8.0 symbols/min [2025-09-29T17:51:12.565365] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:51:12.629388] [DEBUG] [LOCAL ] CCJ: Loaded 54453 existing records from primary storage. [2025-09-29T17:51:12.629831] [INFO ] [MAIN ] CCJ: Loaded 54453 existing records. [2025-09-29T17:51:12.821219] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:51:12.821466] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-09-29T17:51:12.821516] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-09-29T17:51:12.822097] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-09-29T17:51:12.822162] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-09-29T17:51:13.153275] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-09-29T17:51:13.218831] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:51:13.948129] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2024-12. [2025-09-29T17:51:14.333022] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-29T17:51:14.344895] [INFO ] [REMOTE ] CC: Full fetch complete (75574 records). [2025-09-29T17:51:14.345067] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-09-29T17:51:14.768140] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2024-12. [2025-09-29T17:51:14.787322] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-09-29T17:51:14.788897] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-09-29T17:51:14.790024] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-09-29T17:51:14.790100] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-09-29T17:51:14.792022] [DEBUG] [LOCAL ] CC: Trimmed 75574 records to 53007 (keeping 200 days of data) [2025-09-29T17:51:15.087530] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-29T17:51:15.185200] [DEBUG] [LOCAL ] CC: Primary data saved (53007 records). [2025-09-29T17:51:15.185357] [INFO ] [MAIN ] CC: Full history saved. [2025-09-29T17:51:15.185447] [INFO ] [MAIN ] Update Progress: 410/2371 symbols completed. CC took 36.3s. Estimated remaining: 4h 4m 54s. Rate: 8.0 symbols/min [2025-09-29T17:51:15.381788] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:51:15.436931] [DEBUG] [LOCAL ] CCK: Loaded 47083 existing records from primary storage. [2025-09-29T17:51:15.437515] [INFO ] [MAIN ] CCK: Loaded 47083 existing records. [2025-09-29T17:51:15.553259] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-09-29T17:51:15.636090] [WARN ] [MAIN ] CCK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:51:15.636597] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-09-29T17:51:15.636709] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-09-29T17:51:15.637551] [DEBUG] [LOCAL ] CCK: Deleted primary data file. [2025-09-29T17:51:15.637614] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-09-29T17:51:15.952781] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-29T17:51:16.076493] [INFO ] [REMOTE ] CCK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:51:16.083129] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-29T17:51:16.348125] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-01. [2025-09-29T17:51:17.021770] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-29T17:51:17.148087] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-01. [2025-09-29T17:51:17.575157] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-29T17:51:17.948134] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-09-29T17:51:18.748087] [INFO ] [REMOTE ] CCK: Fetching primary data for 2024-12. [2025-09-29T17:51:19.175892] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-29T17:51:19.273008] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-29T17:51:19.548166] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-09-29T17:51:20.348143] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-09-29T17:51:20.481401] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-29T17:51:21.148116] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-01. [2025-09-29T17:51:21.577719] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-29T17:51:21.948116] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-09-29T17:51:22.146277] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-29T17:51:22.429117] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-29T17:51:22.748135] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-09-29T17:51:22.862781] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-29T17:51:23.548130] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-09-29T17:51:24.348146] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-09-29T17:51:24.538093] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-29T17:51:25.148196] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-09-29T17:51:25.470068] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-29T17:51:25.910789] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-29T17:51:25.948123] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-09-29T17:51:26.259549] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-29T17:51:26.748185] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-09-29T17:51:27.548135] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-09-29T17:51:28.009331] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-29T17:51:28.035578] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-29T17:51:28.348142] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-09-29T17:51:29.148144] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-09-29T17:51:29.659006] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-29T17:51:29.670412] [INFO ] [REMOTE ] CCI: Full fetch complete (76999 records). [2025-09-29T17:51:29.670630] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-09-29T17:51:29.953316] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-09-29T17:51:30.113596] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-09-29T17:51:30.113929] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-09-29T17:51:30.114894] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-09-29T17:51:30.114978] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-09-29T17:51:30.116985] [DEBUG] [LOCAL ] CCI: Trimmed 76999 records to 53143 (keeping 200 days of data) [2025-09-29T17:51:30.247215] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-29T17:51:30.521184] [DEBUG] [LOCAL ] CCI: Primary data saved (53143 records). [2025-09-29T17:51:30.521390] [INFO ] [MAIN ] CCI: Full history saved. [2025-09-29T17:51:30.521508] [INFO ] [MAIN ] Update Progress: 411/2371 symbols completed. CCI took 40.2s. Estimated remaining: 4h 5m 24s. Rate: 8.0 symbols/min [2025-09-29T17:51:30.718192] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:51:30.754321] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-09-29T17:51:30.783383] [DEBUG] [LOCAL ] CCL: Loaded 54580 existing records from primary storage. [2025-09-29T17:51:30.783779] [INFO ] [MAIN ] CCL: Loaded 54580 existing records. [2025-09-29T17:51:31.000903] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:51:31.001714] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-09-29T17:51:31.013418] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-09-29T17:51:31.013985] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-29T17:51:31.018232] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-09-29T17:51:31.018846] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-09-29T17:51:31.408284] [INFO ] [REMOTE ] CCL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:51:31.448233] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-09-29T17:51:31.548129] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-09-29T17:51:32.348167] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-09-29T17:51:32.448407] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-29T17:51:32.491077] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-29T17:51:33.148138] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-09-29T17:51:33.886347] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-29T17:51:33.948148] [INFO ] [REMOTE ] CCL: Fetching primary data for 2024-12. [2025-09-29T17:51:34.456923] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-29T17:51:34.748180] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-09-29T17:51:35.548103] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-09-29T17:51:35.704049] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-29T17:51:36.348125] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-09-29T17:51:36.429351] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2024-12 (2.48 seconds). [2025-09-29T17:51:37.148153] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-01. [2025-09-29T17:51:37.600535] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-29T17:51:37.605340] [INFO ] [REMOTE ] CCIF: Full fetch complete (21837 records). [2025-09-29T17:51:37.605598] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-09-29T17:51:37.950898] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-09-29T17:51:37.958508] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-09-29T17:51:38.064894] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-09-29T17:51:38.064985] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-09-29T17:51:38.065607] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-09-29T17:51:38.065678] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-09-29T17:51:38.066430] [DEBUG] [LOCAL ] CCIF: Trimmed 21837 records to 15655 (keeping 200 days of data) [2025-09-29T17:51:38.178567] [DEBUG] [LOCAL ] CCIF: Primary data saved (15655 records). [2025-09-29T17:51:38.178763] [INFO ] [MAIN ] CCIF: Full history saved. [2025-09-29T17:51:38.178891] [INFO ] [MAIN ] Update Progress: 412/2371 symbols completed. CCIF took 28.4s. Estimated remaining: 4h 5m 17s. Rate: 8.0 symbols/min [2025-09-29T17:51:38.368300] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:51:38.428986] [DEBUG] [LOCAL ] CCO: Loaded 48387 existing records from primary storage. [2025-09-29T17:51:38.429325] [INFO ] [MAIN ] CCO: Loaded 48387 existing records. [2025-09-29T17:51:38.627767] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:51:38.628048] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-09-29T17:51:38.628109] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-09-29T17:51:38.628773] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-09-29T17:51:38.628834] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-09-29T17:51:38.753250] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-09-29T17:51:39.009709] [INFO ] [REMOTE ] CCO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:51:39.548173] [INFO ] [REMOTE ] CCO: Fetching primary data for 2024-12. [2025-09-29T17:51:39.653503] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-01 (2.51 seconds). [2025-09-29T17:51:39.758356] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-29T17:51:40.348106] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-09-29T17:51:40.847721] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-29T17:51:40.946463] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-29T17:51:41.148201] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-09-29T17:51:41.948148] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-01. [2025-09-29T17:51:42.535733] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-29T17:51:42.748135] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-09-29T17:51:43.137722] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-29T17:51:43.149172] [INFO ] [REMOTE ] CCJ: Full fetch complete (77684 records). [2025-09-29T17:51:43.149347] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-09-29T17:51:43.545608] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-29T17:51:43.575971] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-09-29T17:51:43.618813] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-09-29T17:51:43.618934] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-09-29T17:51:43.620085] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-09-29T17:51:43.620160] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-09-29T17:51:43.622736] [DEBUG] [LOCAL ] CCJ: Trimmed 77684 records to 53673 (keeping 200 days of data) [2025-09-29T17:51:43.972420] [DEBUG] [LOCAL ] CCJ: Primary data saved (53673 records). [2025-09-29T17:51:43.972636] [INFO ] [MAIN ] CCJ: Full history saved. [2025-09-29T17:51:43.974535] [INFO ] [MAIN ] Update Progress: 413/2371 symbols completed. CCJ took 31.6s. Estimated remaining: 4h 5m 2s. Rate: 8.0 symbols/min [2025-09-29T17:51:44.147043] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:51:44.162869] [DEBUG] [LOCAL ] CCRD: Loaded 9100 existing records from primary storage. [2025-09-29T17:51:44.163249] [INFO ] [MAIN ] CCRD: Loaded 9100 existing records. [2025-09-29T17:51:44.361036] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-09-29T17:51:44.360878] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:51:44.362781] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-09-29T17:51:44.362935] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-09-29T17:51:44.363384] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-09-29T17:51:44.363591] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-09-29T17:51:44.591325] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-29T17:51:44.850332] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:51:45.148199] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-09-29T17:51:45.573382] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-29T17:51:45.775775] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-29T17:51:45.948174] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-09-29T17:51:46.717819] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-29T17:51:46.748101] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-09-29T17:51:47.548123] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-09-29T17:51:48.170306] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-29T17:51:48.348104] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2024-12. [2025-09-29T17:51:48.398113] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-29T17:51:49.039090] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-29T17:51:49.148143] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-09-29T17:51:49.301078] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-29T17:51:49.948124] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-01. [2025-09-29T17:51:50.449196] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-29T17:51:50.748128] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-09-29T17:51:51.512858] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-09-29T17:51:51.548069] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-09-29T17:51:52.254260] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-29T17:51:52.348122] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-09-29T17:51:53.148153] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-09-29T17:51:53.878260] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-09-29T17:51:53.948896] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-09-29T17:51:53.954704] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-29T17:51:54.582870] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-29T17:51:54.753219] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-09-29T17:51:54.771402] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-29T17:51:54.782376] [INFO ] [REMOTE ] CCK: Full fetch complete (67740 records). [2025-09-29T17:51:54.782505] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-09-29T17:51:55.204278] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-09-29T17:51:55.204373] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-09-29T17:51:55.205312] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-09-29T17:51:55.205386] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-09-29T17:51:55.207020] [DEBUG] [LOCAL ] CCK: Trimmed 67740 records to 46287 (keeping 200 days of data) [2025-09-29T17:51:55.519123] [DEBUG] [LOCAL ] CCK: Primary data saved (46287 records). [2025-09-29T17:51:55.519413] [INFO ] [MAIN ] CCK: Full history saved. [2025-09-29T17:51:55.519518] [INFO ] [MAIN ] Update Progress: 414/2371 symbols completed. CCK took 40.3s. Estimated remaining: 4h 5m 13s. Rate: 8.0 symbols/min [2025-09-29T17:51:55.553344] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-09-29T17:51:55.708703] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:51:55.742875] [DEBUG] [LOCAL ] CCS: Loaded 31155 existing records from primary storage. [2025-09-29T17:51:55.743241] [INFO ] [MAIN ] CCS: Loaded 31155 existing records. [2025-09-29T17:51:55.932999] [WARN ] [MAIN ] CCS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:51:55.933333] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-09-29T17:51:55.933387] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-09-29T17:51:55.933884] [DEBUG] [LOCAL ] CCS: Deleted primary data file. [2025-09-29T17:51:55.933946] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-09-29T17:51:56.317322] [INFO ] [REMOTE ] CCS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:51:56.354350] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-09-29T17:51:56.361982] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-29T17:51:56.983574] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-29T17:51:57.148117] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-09-29T17:51:57.948181] [INFO ] [REMOTE ] CCS: Fetching primary data for 2024-12. [2025-09-29T17:51:58.076723] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-09-29T17:51:58.718836] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-29T17:51:58.748145] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-09-29T17:51:59.226624] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-29T17:51:59.548165] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-01. [2025-09-29T17:52:00.348119] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-09-29T17:52:00.621901] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-29T17:52:01.148078] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-09-29T17:52:01.211156] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-09-29T17:52:01.892628] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-29T17:52:01.948177] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-09-29T17:52:02.582959] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-29T17:52:02.748136] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-09-29T17:52:03.548220] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-09-29T17:52:04.330542] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-29T17:52:04.348073] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-09-29T17:52:04.588788] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (2.64 seconds). [2025-09-29T17:52:04.599890] [INFO ] [REMOTE ] CCL: Full fetch complete (77920 records). [2025-09-29T17:52:04.600039] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-09-29T17:52:04.936692] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-29T17:52:05.056707] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-29T17:52:05.080618] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present. [2025-09-29T17:52:05.090545] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed. [2025-09-29T17:52:05.091569] [INFO ] [MAIN ] CCL: Fetched primary data is valid. [2025-09-29T17:52:05.091812] [DEBUG] [LOCAL ] CCL: Saving primary data. [2025-09-29T17:52:05.093395] [INFO ] [REMOTE ] CCO: Full fetch complete (66374 records). [2025-09-29T17:52:05.093689] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-09-29T17:52:05.093934] [DEBUG] [LOCAL ] CCL: Trimmed 77920 records to 53800 (keeping 200 days of data) [2025-09-29T17:52:05.158630] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-09-29T17:52:05.630754] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-09-29T17:52:05.631443] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-09-29T17:52:05.633011] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-09-29T17:52:05.633923] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-09-29T17:52:05.638907] [DEBUG] [LOCAL ] CCO: Trimmed 66374 records to 47797 (keeping 200 days of data) [2025-09-29T17:52:05.950079] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-09-29T17:52:06.118394] [DEBUG] [LOCAL ] CCO: Primary data saved (47797 records). [2025-09-29T17:52:06.119452] [INFO ] [MAIN ] CCO: Full history saved. [2025-09-29T17:52:06.129601] [INFO ] [MAIN ] Update Progress: 415/2371 symbols completed. CCO took 28.0s. Estimated remaining: 4h 5m 20s. Rate: 8.0 symbols/min [2025-09-29T17:52:06.145781] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-29T17:52:06.342199] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:52:06.355930] [DEBUG] [LOCAL ] CCL: Primary data saved (53800 records). [2025-09-29T17:52:06.356186] [INFO ] [MAIN ] CCL: Full history saved. [2025-09-29T17:52:06.356288] [INFO ] [MAIN ] Update Progress: 416/2371 symbols completed. CCL took 35.8s. Estimated remaining: 4h 4m 39s. Rate: 8.0 symbols/min [2025-09-29T17:52:06.504768] [DEBUG] [LOCAL ] CCU: Loaded 23800 existing records from primary storage. [2025-09-29T17:52:06.533120] [INFO ] [MAIN ] CCU: Loaded 23800 existing records. [2025-09-29T17:52:06.636407] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:52:06.654257] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-09-29T17:52:06.676015] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-09-29T17:52:06.678958] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-09-29T17:52:06.679053] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-09-29T17:52:06.679113] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-09-29T17:52:06.684876] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-09-29T17:52:06.750822] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-09-29T17:52:06.879966] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:52:06.922368] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-09-29T17:52:06.933630] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-09-29T17:52:07.007550] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-09-29T17:52:07.040680] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-09-29T17:52:07.289756] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:52:07.500566] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-29T17:52:07.553226] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-09-29T17:52:07.627437] [INFO ] [REMOTE ] CCU: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:52:07.649326] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-29T17:52:08.348130] [INFO ] [REMOTE ] CCU: Fetching primary data for 2024-12. [2025-09-29T17:52:09.074579] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-29T17:52:09.148136] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-09-29T17:52:09.184674] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-29T17:52:09.948094] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2024-12. [2025-09-29T17:52:10.083424] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-29T17:52:10.508279] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-29T17:52:10.748119] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-09-29T17:52:11.548168] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-09-29T17:52:11.687168] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-29T17:52:11.691047] [INFO ] [REMOTE ] CCRD: Full fetch complete (11862 records). [2025-09-29T17:52:11.691178] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-09-29T17:52:11.820535] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-09-29T17:52:12.116797] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-09-29T17:52:12.116891] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-09-29T17:52:12.117231] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-09-29T17:52:12.117312] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-09-29T17:52:12.117929] [DEBUG] [LOCAL ] CCRD: Trimmed 11862 records to 9032 (keeping 200 days of data) [2025-09-29T17:52:12.171738] [DEBUG] [LOCAL ] CCRD: Primary data saved (9032 records). [2025-09-29T17:52:12.171868] [INFO ] [MAIN ] CCRD: Full history saved. [2025-09-29T17:52:12.171964] [INFO ] [MAIN ] Update Progress: 417/2371 symbols completed. CCRD took 28.2s. Estimated remaining: 4h 4m 23s. Rate: 8.0 symbols/min [2025-09-29T17:52:12.348880] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-09-29T17:52:12.351605] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:52:12.420595] [DEBUG] [LOCAL ] CDE: Loaded 54421 existing records from primary storage. [2025-09-29T17:52:12.421068] [INFO ] [MAIN ] CDE: Loaded 54421 existing records. [2025-09-29T17:52:12.611499] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:52:12.611762] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-09-29T17:52:12.611826] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-09-29T17:52:12.612262] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-09-29T17:52:12.612340] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-09-29T17:52:12.976456] [INFO ] [REMOTE ] CDE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:52:13.148097] [INFO ] [REMOTE ] CDE: Fetching primary data for 2024-12. [2025-09-29T17:52:13.711832] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-29T17:52:13.948126] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-09-29T17:52:14.182580] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-09-29T17:52:14.748169] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-09-29T17:52:15.122310] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-29T17:52:15.548144] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-01. [2025-09-29T17:52:15.621754] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-29T17:52:16.348094] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-09-29T17:52:16.629951] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-29T17:52:17.148132] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-01. [2025-09-29T17:52:17.660358] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-29T17:52:17.948132] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-09-29T17:52:18.181963] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-09-29T17:52:18.748088] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-09-29T17:52:18.950925] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-29T17:52:19.548087] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-09-29T17:52:19.918263] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-29T17:52:20.348112] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-09-29T17:52:21.148147] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-09-29T17:52:21.208057] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-29T17:52:21.659877] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-29T17:52:21.835139] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-29T17:52:21.841729] [INFO ] [REMOTE ] CCS: Full fetch complete (45000 records). [2025-09-29T17:52:21.841860] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-09-29T17:52:21.948244] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-09-29T17:52:22.242541] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-09-29T17:52:22.242706] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-09-29T17:52:22.243389] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-09-29T17:52:22.243454] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-09-29T17:52:22.244629] [DEBUG] [LOCAL ] CCS: Trimmed 45000 records to 30622 (keeping 200 days of data) [2025-09-29T17:52:22.439306] [DEBUG] [LOCAL ] CCS: Primary data saved (30622 records). [2025-09-29T17:52:22.439449] [INFO ] [MAIN ] CCS: Full history saved. [2025-09-29T17:52:22.439541] [INFO ] [MAIN ] Update Progress: 418/2371 symbols completed. CCS took 26.9s. Estimated remaining: 4h 4m 29s. Rate: 8.0 symbols/min [2025-09-29T17:52:22.620167] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:52:22.633371] [DEBUG] [LOCAL ] CDLR: Loaded 9966 existing records from primary storage. [2025-09-29T17:52:22.633594] [INFO ] [MAIN ] CDLR: Loaded 9966 existing records. [2025-09-29T17:52:22.753225] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-09-29T17:52:22.831634] [WARN ] [MAIN ] CDLR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:52:22.831895] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-09-29T17:52:22.831951] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-09-29T17:52:22.832166] [DEBUG] [LOCAL ] CDLR: Deleted primary data file. [2025-09-29T17:52:22.832225] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-09-29T17:52:23.096605] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-29T17:52:23.249122] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-29T17:52:23.263732] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:52:23.548134] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-09-29T17:52:24.348159] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2024-12. [2025-09-29T17:52:24.628244] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-29T17:52:25.148106] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-09-29T17:52:25.172246] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-29T17:52:25.948074] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-09-29T17:52:26.174442] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T17:52:26.174783] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-09-29T17:52:26.174871] [FATAL] [REMOTE ] CCZ: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T17:52:26.174956] [FATAL] [MAIN ] CCZ: Failed to fetch primary data. [2025-09-29T17:52:26.175020] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T17:52:26.175091] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-09-29T17:52:26.175157] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-09-29T17:52:26.175206] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-09-29T17:52:26.175286] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-09-29T17:52:26.175356] [INFO ] [MAIN ] Update Progress: 419/2371 symbols completed. CCZ took 19.8s. Estimated remaining: 4h 4m 4s. Rate: 8.0 symbols/min [2025-09-29T17:52:26.357038] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:52:26.420112] [DEBUG] [LOCAL ] CDP: Loaded 43357 existing records from primary storage. [2025-09-29T17:52:26.421869] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-29T17:52:26.422256] [INFO ] [MAIN ] CDP: Loaded 43357 existing records. [2025-09-29T17:52:26.613524] [WARN ] [MAIN ] CDP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:52:26.613770] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-09-29T17:52:26.613824] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-09-29T17:52:26.614203] [DEBUG] [LOCAL ] CDP: Deleted primary data file. [2025-09-29T17:52:26.614263] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-09-29T17:52:26.756961] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-09-29T17:52:27.027635] [INFO ] [REMOTE ] CDP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:52:27.548158] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-09-29T17:52:28.348132] [INFO ] [REMOTE ] CDP: Fetching primary data for 2024-12. [2025-09-29T17:52:28.616390] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-29T17:52:28.836630] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-29T17:52:29.148154] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-09-29T17:52:29.948129] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-09-29T17:52:30.022222] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-29T17:52:30.748124] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-01. [2025-09-29T17:52:31.064992] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-29T17:52:31.101907] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-29T17:52:31.548122] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-09-29T17:52:32.190435] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-29T17:52:32.348148] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-09-29T17:52:32.682610] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-29T17:52:33.148126] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-09-29T17:52:33.661777] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-29T17:52:33.948118] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-09-29T17:52:34.319423] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-29T17:52:34.748163] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-09-29T17:52:35.505547] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-29T17:52:35.548079] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-09-29T17:52:36.348085] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-09-29T17:52:36.456385] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-29T17:52:37.148086] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-01. [2025-09-29T17:52:37.228586] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-29T17:52:37.457161] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-29T17:52:37.461339] [INFO ] [REMOTE ] CCU: Full fetch complete (33034 records). [2025-09-29T17:52:37.461439] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-09-29T17:52:37.753044] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-29T17:52:37.884443] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-09-29T17:52:37.884543] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-09-29T17:52:37.885125] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-09-29T17:52:37.885196] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-09-29T17:52:37.886254] [DEBUG] [LOCAL ] CCU: Trimmed 33034 records to 23240 (keeping 200 days of data) [2025-09-29T17:52:37.948161] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-09-29T17:52:38.032496] [DEBUG] [LOCAL ] CCU: Primary data saved (23240 records). [2025-09-29T17:52:38.032639] [INFO ] [MAIN ] CCU: Full history saved. [2025-09-29T17:52:38.032784] [INFO ] [MAIN ] Update Progress: 420/2371 symbols completed. CCU took 31.9s. Estimated remaining: 4h 4m 16s. Rate: 8.0 symbols/min [2025-09-29T17:52:38.225694] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:52:38.254060] [DEBUG] [LOCAL ] CDRE: Loaded 25747 existing records from primary storage. [2025-09-29T17:52:38.254436] [INFO ] [MAIN ] CDRE: Loaded 25747 existing records. [2025-09-29T17:52:38.454674] [WARN ] [MAIN ] CDRE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:52:38.454916] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-09-29T17:52:38.455005] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-09-29T17:52:38.455296] [DEBUG] [LOCAL ] CDRE: Deleted primary data file. [2025-09-29T17:52:38.455357] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-09-29T17:52:38.635697] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-29T17:52:38.753283] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-09-29T17:52:38.860522] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:52:39.548113] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-09-29T17:52:40.348107] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-09-29T17:52:40.394134] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-29T17:52:41.148089] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-09-29T17:52:41.288621] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-29T17:52:41.323572] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-29T17:52:41.948111] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-09-29T17:52:42.748091] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2024-12. [2025-09-29T17:52:42.761890] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-29T17:52:42.852870] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-29T17:52:43.548097] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-09-29T17:52:44.137214] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-29T17:52:44.216754] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-29T17:52:44.348109] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-09-29T17:52:45.148129] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-09-29T17:52:45.948118] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-09-29T17:52:46.496096] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-29T17:52:46.566535] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-29T17:52:46.748107] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-09-29T17:52:46.858744] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-29T17:52:47.548117] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-09-29T17:52:48.348121] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-01. [2025-09-29T17:52:48.455605] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-29T17:52:48.721043] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-29T17:52:49.148129] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-09-29T17:52:49.448086] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-29T17:52:49.602045] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-29T17:52:49.948163] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-09-29T17:52:50.748214] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-09-29T17:52:51.548147] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-09-29T17:52:51.713845] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-29T17:52:51.716446] [INFO ] [REMOTE ] CDLR: Full fetch complete (13141 records). [2025-09-29T17:52:51.716523] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-09-29T17:52:52.133616] [DEBUG] [VALIDATOR ] CDLR: All expected trading days are present. [2025-09-29T17:52:52.133775] [DEBUG] [VALIDATOR ] CDLR: Primary data validation passed. [2025-09-29T17:52:52.134208] [INFO ] [MAIN ] CDLR: Fetched primary data is valid. [2025-09-29T17:52:52.134325] [DEBUG] [LOCAL ] CDLR: Saving primary data. [2025-09-29T17:52:52.134964] [DEBUG] [LOCAL ] CDLR: Trimmed 13141 records to 9783 (keeping 200 days of data) [2025-09-29T17:52:52.193458] [DEBUG] [LOCAL ] CDLR: Primary data saved (9783 records). [2025-09-29T17:52:52.193583] [INFO ] [MAIN ] CDLR: Full history saved. [2025-09-29T17:52:52.193688] [INFO ] [MAIN ] Update Progress: 421/2371 symbols completed. CDLR took 29.8s. Estimated remaining: 4h 4m 40s. Rate: 8.0 symbols/min [2025-09-29T17:52:52.353141] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-09-29T17:52:52.393077] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:52:52.426969] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-09-29T17:52:52.438786] [INFO ] [REMOTE ] CDE: Full fetch complete (77581 records). [2025-09-29T17:52:52.438932] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-09-29T17:52:52.827125] [DEBUG] [LOCAL ] CE: Loaded 52316 existing records from primary storage. [2025-09-29T17:52:52.851273] [INFO ] [MAIN ] CE: Loaded 52316 existing records. [2025-09-29T17:52:53.001010] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-09-29T17:52:53.014379] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-09-29T17:52:53.020779] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-09-29T17:52:53.040077] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-09-29T17:52:53.144222] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:52:53.145072] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-09-29T17:52:53.145424] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-09-29T17:52:53.146312] [DEBUG] [LOCAL ] CDE: Trimmed 77581 records to 53641 (keeping 200 days of data) [2025-09-29T17:52:53.146399] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-09-29T17:52:53.147093] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-09-29T17:52:53.377613] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-29T17:52:53.460500] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-09-29T17:52:53.510563] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-29T17:52:53.705133] [INFO ] [REMOTE ] CE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:52:53.932125] [DEBUG] [LOCAL ] CDE: Primary data saved (53641 records). [2025-09-29T17:52:53.932282] [INFO ] [MAIN ] CDE: Full history saved. [2025-09-29T17:52:53.932386] [INFO ] [MAIN ] Update Progress: 422/2371 symbols completed. CDE took 41.8s. Estimated remaining: 4h 4m 5s. Rate: 8.0 symbols/min [2025-09-29T17:52:53.953313] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-09-29T17:52:54.129258] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:52:54.140162] [DEBUG] [LOCAL ] CEE: Loaded 6697 existing records from primary storage. [2025-09-29T17:52:54.140468] [INFO ] [MAIN ] CEE: Loaded 6697 existing records. [2025-09-29T17:52:54.358447] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:52:54.358704] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-09-29T17:52:54.358766] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-09-29T17:52:54.358989] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-09-29T17:52:54.359050] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-09-29T17:52:54.752678] [INFO ] [REMOTE ] CEE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:52:54.748745] [INFO ] [REMOTE ] CE: Fetching primary data for 2024-12. [2025-09-29T17:52:55.356133] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-29T17:52:55.365273] [INFO ] [REMOTE ] CDP: Full fetch complete (61847 records). [2025-09-29T17:52:55.365421] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-09-29T17:52:55.549942] [INFO ] [REMOTE ] CEE: Fetching primary data for 2024-12. [2025-09-29T17:52:55.703369] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-29T17:52:55.807775] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-09-29T17:52:55.807963] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-09-29T17:52:55.808827] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-09-29T17:52:55.808899] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-09-29T17:52:55.810317] [DEBUG] [LOCAL ] CDP: Trimmed 61847 records to 42547 (keeping 200 days of data) [2025-09-29T17:52:56.071520] [DEBUG] [LOCAL ] CDP: Primary data saved (42547 records). [2025-09-29T17:52:56.071675] [INFO ] [MAIN ] CDP: Full history saved. [2025-09-29T17:52:56.071783] [INFO ] [MAIN ] Update Progress: 423/2371 symbols completed. CDP took 29.9s. Estimated remaining: 4h 3m 33s. Rate: 8.0 symbols/min [2025-09-29T17:52:56.252331] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:52:56.285236] [DEBUG] [LOCAL ] CEPU: Loaded 26454 existing records from primary storage. [2025-09-29T17:52:56.285530] [INFO ] [MAIN ] CEPU: Loaded 26454 existing records. [2025-09-29T17:52:56.353299] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-09-29T17:52:56.405851] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-29T17:52:56.496770] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:52:56.497159] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-09-29T17:52:56.497244] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-09-29T17:52:56.497894] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-09-29T17:52:56.497957] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-09-29T17:52:56.701073] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-29T17:52:56.938270] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:52:57.148090] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-01. [2025-09-29T17:52:57.544526] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-29T17:52:57.728310] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-29T17:52:57.948157] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2024-12. [2025-09-29T17:52:58.748147] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-01. [2025-09-29T17:52:59.395789] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-29T17:52:59.548161] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-09-29T17:53:00.348124] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-09-29T17:53:00.595776] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-29T17:53:01.033728] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-29T17:53:01.148124] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-09-29T17:53:01.316113] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-29T17:53:01.948114] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-09-29T17:53:02.748139] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-09-29T17:53:02.962239] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-29T17:53:03.234136] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-29T17:53:03.548158] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-09-29T17:53:03.794695] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-29T17:53:04.348157] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-09-29T17:53:04.691800] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-29T17:53:05.148146] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-09-29T17:53:05.389334] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-29T17:53:05.948173] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-09-29T17:53:06.290143] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-29T17:53:06.460251] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-29T17:53:06.748134] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-09-29T17:53:07.548119] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-09-29T17:53:08.348078] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-09-29T17:53:08.549592] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-29T17:53:08.720289] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-29T17:53:09.148161] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-09-29T17:53:09.787875] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-29T17:53:09.899896] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-29T17:53:09.948088] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-09-29T17:53:10.655558] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-29T17:53:10.748118] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-09-29T17:53:11.328802] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-29T17:53:11.548207] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-09-29T17:53:12.348160] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-09-29T17:53:13.078010] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-29T17:53:13.148143] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-09-29T17:53:13.354338] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-29T17:53:13.948112] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-09-29T17:53:14.288440] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-29T17:53:14.559918] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-29T17:53:14.561375] [INFO ] [REMOTE ] CEE: Full fetch complete (10170 records). [2025-09-29T17:53:14.561455] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-09-29T17:53:14.749200] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-09-29T17:53:14.950924] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-09-29T17:53:14.951006] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-09-29T17:53:14.951271] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-09-29T17:53:14.951313] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-09-29T17:53:14.951851] [DEBUG] [LOCAL ] CEE: Trimmed 10170 records to 6213 (keeping 200 days of data) [2025-09-29T17:53:14.990957] [DEBUG] [LOCAL ] CEE: Primary data saved (6213 records). [2025-09-29T17:53:14.991154] [INFO ] [MAIN ] CEE: Full history saved. [2025-09-29T17:53:14.991265] [INFO ] [MAIN ] Update Progress: 424/2371 symbols completed. CEE took 21.1s. Estimated remaining: 4h 4m 18s. Rate: 8.0 symbols/min [2025-09-29T17:53:15.175527] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:53:15.240091] [DEBUG] [LOCAL ] CF: Loaded 52983 existing records from primary storage. [2025-09-29T17:53:15.240435] [INFO ] [MAIN ] CF: Loaded 52983 existing records. [2025-09-29T17:53:15.438042] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:53:15.438311] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-09-29T17:53:15.438372] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-09-29T17:53:15.438985] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-09-29T17:53:15.439048] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-09-29T17:53:15.551222] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-09-29T17:53:15.846737] [INFO ] [REMOTE ] CF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:53:15.881058] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-29T17:53:16.348140] [INFO ] [REMOTE ] CF: Fetching primary data for 2024-12. [2025-09-29T17:53:17.148171] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-09-29T17:53:17.322431] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-29T17:53:17.956310] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-09-29T17:53:17.977715] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-29T17:53:18.350697] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-29T17:53:18.748152] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-09-29T17:53:19.178326] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-29T17:53:19.548155] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-09-29T17:53:19.853400] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-29T17:53:20.348122] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-01. [2025-09-29T17:53:20.684911] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-29T17:53:20.698010] [INFO ] [REMOTE ] CDRE: Full fetch complete (35307 records). [2025-09-29T17:53:20.698723] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-09-29T17:53:21.100300] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present. [2025-09-29T17:53:21.100391] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed. [2025-09-29T17:53:21.100946] [INFO ] [MAIN ] CDRE: Fetched primary data is valid. [2025-09-29T17:53:21.101011] [DEBUG] [LOCAL ] CDRE: Saving primary data. [2025-09-29T17:53:21.102035] [DEBUG] [LOCAL ] CDRE: Trimmed 35307 records to 25219 (keeping 200 days of data) [2025-09-29T17:53:21.156540] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-09-29T17:53:21.262856] [DEBUG] [LOCAL ] CDRE: Primary data saved (25219 records). [2025-09-29T17:53:21.263002] [INFO ] [MAIN ] CDRE: Full history saved. [2025-09-29T17:53:21.263120] [INFO ] [MAIN ] Update Progress: 425/2371 symbols completed. CDRE took 43.2s. Estimated remaining: 4h 4m 5s. Rate: 8.0 symbols/min [2025-09-29T17:53:21.461774] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:53:21.524181] [DEBUG] [LOCAL ] CFG: Loaded 54404 existing records from primary storage. [2025-09-29T17:53:21.524561] [INFO ] [MAIN ] CFG: Loaded 54404 existing records. [2025-09-29T17:53:21.738592] [WARN ] [MAIN ] CFG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:53:21.739241] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-09-29T17:53:21.739349] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-09-29T17:53:21.740020] [DEBUG] [LOCAL ] CFG: Deleted primary data file. [2025-09-29T17:53:21.740085] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-09-29T17:53:21.951401] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-09-29T17:53:22.149874] [INFO ] [REMOTE ] CFG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:53:22.179504] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-29T17:53:22.585532] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-29T17:53:22.593128] [INFO ] [REMOTE ] CEPU: Full fetch complete (39661 records). [2025-09-29T17:53:22.593261] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-09-29T17:53:22.753203] [INFO ] [REMOTE ] CFG: Fetching primary data for 2024-12. [2025-09-29T17:53:23.001941] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-09-29T17:53:23.002039] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-09-29T17:53:23.002603] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-09-29T17:53:23.002669] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-09-29T17:53:23.003859] [DEBUG] [LOCAL ] CEPU: Trimmed 39661 records to 25890 (keeping 200 days of data) [2025-09-29T17:53:23.155506] [DEBUG] [LOCAL ] CEPU: Primary data saved (25890 records). [2025-09-29T17:53:23.155675] [INFO ] [MAIN ] CEPU: Full history saved. [2025-09-29T17:53:23.155781] [INFO ] [MAIN ] Update Progress: 426/2371 symbols completed. CEPU took 27.1s. Estimated remaining: 4h 3m 31s. Rate: 8.0 symbols/min [2025-09-29T17:53:23.335606] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:53:23.335884] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-09-29T17:53:23.335935] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-09-29T17:53:23.336045] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-09-29T17:53:23.336087] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-09-29T17:53:23.336128] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-09-29T17:53:23.336192] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-09-29T17:53:23.557555] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-09-29T17:53:23.771273] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:53:23.802625] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-29T17:53:24.348124] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-09-29T17:53:24.712611] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-29T17:53:25.128769] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-29T17:53:25.148134] [INFO ] [REMOTE ] CFND: Fetching primary data for 2024-12. [2025-09-29T17:53:25.389100] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T17:53:25.389439] [WARN ] [REMOTE ] CFND: No data returned for month 2024-12 [2025-09-29T17:53:25.389554] [FATAL] [REMOTE ] CFND: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T17:53:25.389637] [FATAL] [MAIN ] CFND: Failed to fetch primary data. [2025-09-29T17:53:25.389720] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T17:53:25.389841] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-09-29T17:53:25.389936] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-09-29T17:53:25.389995] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-09-29T17:53:25.390063] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-09-29T17:53:25.390154] [INFO ] [MAIN ] Update Progress: 427/2371 symbols completed. CFND took 2.2s. Estimated remaining: 4h 2m 60s. Rate: 8.0 symbols/min [2025-09-29T17:53:25.567468] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:53:25.615772] [DEBUG] [LOCAL ] CFR: Loaded 33971 existing records from primary storage. [2025-09-29T17:53:25.616330] [INFO ] [MAIN ] CFR: Loaded 33971 existing records. [2025-09-29T17:53:25.818787] [WARN ] [MAIN ] CFR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:53:25.819319] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-09-29T17:53:25.819434] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-09-29T17:53:25.819927] [DEBUG] [LOCAL ] CFR: Deleted primary data file. [2025-09-29T17:53:25.820049] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-09-29T17:53:25.949293] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-09-29T17:53:26.130888] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-29T17:53:26.249513] [INFO ] [REMOTE ] CFR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:53:26.748138] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-09-29T17:53:27.548145] [INFO ] [REMOTE ] CFR: Fetching primary data for 2024-12. [2025-09-29T17:53:28.231918] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-29T17:53:28.348117] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-01. [2025-09-29T17:53:28.574043] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-29T17:53:29.112431] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-29T17:53:29.148153] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-01. [2025-09-29T17:53:29.948161] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-09-29T17:53:30.130268] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-29T17:53:30.590325] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-29T17:53:30.748142] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-09-29T17:53:31.548077] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-09-29T17:53:31.820289] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-29T17:53:31.831511] [INFO ] [REMOTE ] CE: Full fetch complete (74876 records). [2025-09-29T17:53:31.831730] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-09-29T17:53:32.264834] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-09-29T17:53:32.265072] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-09-29T17:53:32.266170] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-09-29T17:53:32.266261] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-09-29T17:53:32.267942] [DEBUG] [LOCAL ] CE: Trimmed 74876 records to 51527 (keeping 200 days of data) [2025-09-29T17:53:32.367631] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-09-29T17:53:32.405259] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-29T17:53:32.663719] [DEBUG] [LOCAL ] CE: Primary data saved (51527 records). [2025-09-29T17:53:32.663928] [INFO ] [MAIN ] CE: Full history saved. [2025-09-29T17:53:32.664059] [INFO ] [MAIN ] Update Progress: 428/2371 symbols completed. CE took 40.5s. Estimated remaining: 4h 2m 51s. Rate: 8.0 symbols/min [2025-09-29T17:53:32.857493] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:53:32.881132] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-29T17:53:32.932445] [DEBUG] [LOCAL ] CGAU: Loaded 43406 existing records from primary storage. [2025-09-29T17:53:32.932827] [INFO ] [MAIN ] CGAU: Loaded 43406 existing records. [2025-09-29T17:53:33.122511] [WARN ] [MAIN ] CGAU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:53:33.122772] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-09-29T17:53:33.122825] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-09-29T17:53:33.123231] [DEBUG] [LOCAL ] CGAU: Deleted primary data file. [2025-09-29T17:53:33.123289] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-09-29T17:53:33.154271] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-09-29T17:53:33.496444] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:53:33.948121] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2024-12. [2025-09-29T17:53:34.356470] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-29T17:53:34.640350] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-29T17:53:34.748111] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-09-29T17:53:35.548105] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-09-29T17:53:35.579198] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-29T17:53:36.287631] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-29T17:53:36.348091] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-09-29T17:53:37.148149] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-01. [2025-09-29T17:53:37.203767] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-29T17:53:37.748479] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-29T17:53:37.948127] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-09-29T17:53:38.582462] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-29T17:53:38.748127] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-09-29T17:53:39.553484] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-09-29T17:53:39.570785] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-29T17:53:39.968959] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-29T17:53:40.348139] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-09-29T17:53:41.026751] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-29T17:53:41.148121] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-09-29T17:53:41.953207] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-09-29T17:53:41.975139] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-29T17:53:42.302459] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-29T17:53:42.748204] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-09-29T17:53:43.548132] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-09-29T17:53:43.719517] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-29T17:53:44.153610] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-29T17:53:44.348133] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-09-29T17:53:44.911207] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-29T17:53:45.148128] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-09-29T17:53:45.948137] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-09-29T17:53:46.034062] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-29T17:53:46.748088] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-09-29T17:53:47.284685] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-29T17:53:47.440316] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-29T17:53:47.448240] [INFO ] [REMOTE ] CFR: Full fetch complete (48600 records). [2025-09-29T17:53:47.448446] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-09-29T17:53:47.553321] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-09-29T17:53:47.900055] [DEBUG] [VALIDATOR ] CFR: All expected trading days are present. [2025-09-29T17:53:47.900153] [DEBUG] [VALIDATOR ] CFR: Primary data validation passed. [2025-09-29T17:53:47.900937] [INFO ] [MAIN ] CFR: Fetched primary data is valid. [2025-09-29T17:53:47.901010] [DEBUG] [LOCAL ] CFR: Saving primary data. [2025-09-29T17:53:47.902260] [DEBUG] [LOCAL ] CFR: Trimmed 48600 records to 33412 (keeping 200 days of data) [2025-09-29T17:53:48.133449] [DEBUG] [LOCAL ] CFR: Primary data saved (33412 records). [2025-09-29T17:53:48.133601] [INFO ] [MAIN ] CFR: Full history saved. [2025-09-29T17:53:48.133712] [INFO ] [MAIN ] Update Progress: 429/2371 symbols completed. CFR took 22.7s. Estimated remaining: 4h 3m 20s. Rate: 8.0 symbols/min [2025-09-29T17:53:48.328367] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:53:48.332505] [DEBUG] [LOCAL ] CGV: Loaded 1431 existing records from primary storage. [2025-09-29T17:53:48.332701] [INFO ] [MAIN ] CGV: Loaded 1431 existing records. [2025-09-29T17:53:48.356352] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-09-29T17:53:48.556241] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:53:48.556802] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-09-29T17:53:48.556878] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-09-29T17:53:48.557269] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-09-29T17:53:48.557607] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-09-29T17:53:48.902164] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-29T17:53:49.015560] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:53:49.078736] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-29T17:53:49.148121] [INFO ] [REMOTE ] CGV: Fetching primary data for 2024-12. [2025-09-29T17:53:49.690226] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-29T17:53:49.948158] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-09-29T17:53:50.142753] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-29T17:53:50.748146] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-09-29T17:53:51.190461] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-29T17:53:51.548141] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-09-29T17:53:51.731340] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-29T17:53:52.348123] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-09-29T17:53:52.863096] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-29T17:53:53.148153] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-09-29T17:53:53.583826] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-29T17:53:53.948097] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-09-29T17:53:54.364101] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-29T17:53:54.375576] [INFO ] [REMOTE ] CFG: Full fetch complete (77575 records). [2025-09-29T17:53:54.375838] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-09-29T17:53:54.753298] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-09-29T17:53:54.803577] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present. [2025-09-29T17:53:54.803690] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed. [2025-09-29T17:53:54.804603] [INFO ] [MAIN ] CFG: Fetched primary data is valid. [2025-09-29T17:53:54.804720] [DEBUG] [LOCAL ] CFG: Saving primary data. [2025-09-29T17:53:54.807619] [DEBUG] [LOCAL ] CFG: Trimmed 77575 records to 53624 (keeping 200 days of data) [2025-09-29T17:53:55.163749] [DEBUG] [LOCAL ] CFG: Primary data saved (53624 records). [2025-09-29T17:53:55.163901] [INFO ] [MAIN ] CFG: Full history saved. [2025-09-29T17:53:55.164007] [INFO ] [MAIN ] Update Progress: 430/2371 symbols completed. CFG took 33.9s. Estimated remaining: 4h 3m 10s. Rate: 8.0 symbols/min [2025-09-29T17:53:55.351952] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:53:55.380104] [DEBUG] [LOCAL ] CHCT: Loaded 24309 existing records from primary storage. [2025-09-29T17:53:55.380409] [INFO ] [MAIN ] CHCT: Loaded 24309 existing records. [2025-09-29T17:53:55.551491] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-09-29T17:53:55.576222] [WARN ] [MAIN ] CHCT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:53:55.578392] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-09-29T17:53:55.578568] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-09-29T17:53:55.579017] [DEBUG] [LOCAL ] CHCT: Deleted primary data file. [2025-09-29T17:53:55.579161] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-09-29T17:53:55.987198] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:53:56.021817] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-29T17:53:56.036977] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-29T17:53:56.293020] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-29T17:53:56.348155] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-09-29T17:53:56.792622] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-29T17:53:57.148137] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2024-12. [2025-09-29T17:53:57.948165] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-09-29T17:53:58.306412] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-29T17:53:58.446409] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-29T17:53:58.748152] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-09-29T17:53:59.174173] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-29T17:53:59.548125] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-09-29T17:54:00.076111] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-29T17:54:00.348166] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-09-29T17:54:01.148156] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-09-29T17:54:01.531766] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-29T17:54:01.741783] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-29T17:54:01.948115] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-09-29T17:54:02.748132] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-09-29T17:54:03.184835] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-29T17:54:03.185769] [INFO ] [REMOTE ] CGV: Full fetch complete (2283 records). [2025-09-29T17:54:03.185842] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-09-29T17:54:03.186216] [FATAL] [VALIDATOR ] CGV: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T17:54:03.186302] [FATAL] [MAIN ] CGV: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:54:03.186348] [WARN ] [MAIN ] CGV: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:54:03.186388] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-09-29T17:54:03.186444] [DEBUG] [LOCAL ] CGV: No primary data file found to delete. [2025-09-29T17:54:03.186479] [INFO ] [LOCAL ] CGV: Starting deletion of derivative data. [2025-09-29T17:54:03.187303] [DEBUG] [LOCAL ] CGV: Deleted derivative data file. [2025-09-29T17:54:03.187424] [INFO ] [MAIN ] Update Progress: 431/2371 symbols completed. CGV took 15.1s. Estimated remaining: 4h 3m 5s. Rate: 8.0 symbols/min [2025-09-29T17:54:03.376746] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:54:03.433996] [DEBUG] [LOCAL ] CHD: Loaded 52767 existing records from primary storage. [2025-09-29T17:54:03.434324] [INFO ] [MAIN ] CHD: Loaded 52767 existing records. [2025-09-29T17:54:03.562328] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-09-29T17:54:03.628741] [WARN ] [MAIN ] CHD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:54:03.629084] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-09-29T17:54:03.629254] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-09-29T17:54:03.639753] [DEBUG] [LOCAL ] CHD: Deleted primary data file. [2025-09-29T17:54:03.655283] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-09-29T17:54:03.703696] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-29T17:54:04.072048] [INFO ] [REMOTE ] CHD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:54:04.348115] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-09-29T17:54:05.148115] [INFO ] [REMOTE ] CHD: Fetching primary data for 2024-12. [2025-09-29T17:54:05.635220] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-29T17:54:05.646418] [INFO ] [REMOTE ] CF: Full fetch complete (75182 records). [2025-09-29T17:54:05.646615] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-09-29T17:54:05.950986] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-01. [2025-09-29T17:54:06.121556] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-09-29T17:54:06.123713] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-29T17:54:06.123897] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-09-29T17:54:06.134890] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-09-29T17:54:06.135211] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-09-29T17:54:06.136021] [INFO ] [REMOTE ] CGAU: Full fetch complete (60752 records). [2025-09-29T17:54:06.136197] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-09-29T17:54:06.218217] [DEBUG] [LOCAL ] CF: Trimmed 75182 records to 52195 (keeping 200 days of data) [2025-09-29T17:54:06.674794] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present. [2025-09-29T17:54:06.674909] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed. [2025-09-29T17:54:06.678924] [INFO ] [MAIN ] CGAU: Fetched primary data is valid. [2025-09-29T17:54:06.679307] [DEBUG] [LOCAL ] CGAU: Saving primary data. [2025-09-29T17:54:06.685359] [DEBUG] [LOCAL ] CGAU: Trimmed 60752 records to 42672 (keeping 200 days of data) [2025-09-29T17:54:07.104313] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-29T17:54:07.120331] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-01. [2025-09-29T17:54:07.210240] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-29T17:54:07.258194] [DEBUG] [LOCAL ] CF: Primary data saved (52195 records). [2025-09-29T17:54:07.261392] [INFO ] [MAIN ] CF: Full history saved. [2025-09-29T17:54:07.261286] [DEBUG] [LOCAL ] CGAU: Primary data saved (42672 records). [2025-09-29T17:54:07.261730] [INFO ] [MAIN ] CGAU: Full history saved. [2025-09-29T17:54:07.261596] [INFO ] [MAIN ] Update Progress: 432/2371 symbols completed. CF took 52.3s. Estimated remaining: 4h 2m 42s. Rate: 8.0 symbols/min [2025-09-29T17:54:07.267214] [INFO ] [MAIN ] Update Progress: 433/2371 symbols completed. CGAU took 34.6s. Estimated remaining: 4h 2m 1s. Rate: 8.0 symbols/min [2025-09-29T17:54:07.548522] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-09-29T17:54:07.653772] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:54:07.684527] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:54:07.710283] [DEBUG] [LOCAL ] CHE: Loaded 14983 existing records from primary storage. [2025-09-29T17:54:07.710767] [INFO ] [MAIN ] CHE: Loaded 14983 existing records. [2025-09-29T17:54:07.888271] [DEBUG] [LOCAL ] CHGG: Loaded 48434 existing records from primary storage. [2025-09-29T17:54:07.912138] [INFO ] [MAIN ] CHGG: Loaded 48434 existing records. [2025-09-29T17:54:07.962331] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:54:08.031067] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-09-29T17:54:08.050542] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-09-29T17:54:08.076834] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-09-29T17:54:08.087787] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-09-29T17:54:08.325593] [WARN ] [MAIN ] CHGG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:54:08.330180] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-09-29T17:54:08.330702] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-09-29T17:54:08.352300] [DEBUG] [LOCAL ] CHGG: Deleted primary data file. [2025-09-29T17:54:08.367895] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-09-29T17:54:08.964208] [INFO ] [REMOTE ] CHE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:54:08.975852] [INFO ] [REMOTE ] CHE: Fetching primary data for 2024-12. [2025-09-29T17:54:09.066062] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:54:09.081575] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-29T17:54:09.117199] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-29T17:54:09.148082] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-09-29T17:54:09.948183] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-09-29T17:54:09.967687] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-29T17:54:10.748094] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-01. [2025-09-29T17:54:10.806603] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-29T17:54:11.113272] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-29T17:54:11.548153] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2024-12. [2025-09-29T17:54:11.630375] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-29T17:54:12.348153] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-09-29T17:54:13.148102] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-09-29T17:54:13.219728] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-29T17:54:13.506628] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-29T17:54:13.948124] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-01. [2025-09-29T17:54:14.748085] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-09-29T17:54:14.842360] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-29T17:54:15.548099] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-09-29T17:54:15.800076] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-29T17:54:15.871340] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-29T17:54:16.348118] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-09-29T17:54:17.148114] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-09-29T17:54:17.366022] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-29T17:54:17.683510] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-29T17:54:17.952707] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-09-29T17:54:17.958568] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-29T17:54:18.748113] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-09-29T17:54:18.998478] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-29T17:54:19.548119] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-09-29T17:54:20.348086] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-09-29T17:54:20.522890] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-29T17:54:21.148123] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-09-29T17:54:21.240550] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-29T17:54:21.509402] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-29T17:54:21.948154] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-09-29T17:54:22.748129] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-09-29T17:54:22.900038] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-29T17:54:22.921275] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-29T17:54:23.548126] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-09-29T17:54:23.703119] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-29T17:54:24.348147] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-09-29T17:54:24.509973] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-29T17:54:25.148156] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-09-29T17:54:25.948145] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-09-29T17:54:26.145318] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-29T17:54:26.181180] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-29T17:54:26.748079] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-09-29T17:54:26.833199] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-29T17:54:27.548126] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-09-29T17:54:28.348092] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-09-29T17:54:28.762835] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-29T17:54:28.822996] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-29T17:54:29.148118] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-09-29T17:54:29.948109] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-09-29T17:54:30.152018] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-29T17:54:30.297659] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-29T17:54:30.748118] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-09-29T17:54:31.548100] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-09-29T17:54:31.666291] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-29T17:54:32.076710] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-29T17:54:32.080848] [INFO ] [REMOTE ] CHE: Full fetch complete (19790 records). [2025-09-29T17:54:32.080982] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-09-29T17:54:32.357255] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-09-29T17:54:32.487312] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-09-29T17:54:32.487447] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-09-29T17:54:32.487980] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-09-29T17:54:32.488062] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-09-29T17:54:32.488996] [DEBUG] [LOCAL ] CHE: Trimmed 19790 records to 14789 (keeping 200 days of data) [2025-09-29T17:54:32.606374] [DEBUG] [LOCAL ] CHE: Primary data saved (14789 records). [2025-09-29T17:54:32.606562] [INFO ] [MAIN ] CHE: Full history saved. [2025-09-29T17:54:32.606794] [INFO ] [MAIN ] Update Progress: 434/2371 symbols completed. CHE took 25.3s. Estimated remaining: 4h 3m 13s. Rate: 8.0 symbols/min [2025-09-29T17:54:32.786409] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:54:32.834516] [DEBUG] [LOCAL ] CHH: Loaded 32744 existing records from primary storage. [2025-09-29T17:54:32.834833] [INFO ] [MAIN ] CHH: Loaded 32744 existing records. [2025-09-29T17:54:33.020582] [WARN ] [MAIN ] CHH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:54:33.020818] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-09-29T17:54:33.020867] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-09-29T17:54:33.021307] [DEBUG] [LOCAL ] CHH: Deleted primary data file. [2025-09-29T17:54:33.021381] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-09-29T17:54:33.151115] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-09-29T17:54:33.410001] [INFO ] [REMOTE ] CHH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:54:33.444973] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-29T17:54:33.948114] [INFO ] [REMOTE ] CHH: Fetching primary data for 2024-12. [2025-09-29T17:54:34.125874] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-29T17:54:34.584179] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-29T17:54:34.589455] [INFO ] [REMOTE ] CHCT: Full fetch complete (34971 records). [2025-09-29T17:54:34.589633] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-09-29T17:54:34.753362] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-09-29T17:54:35.187916] [DEBUG] [VALIDATOR ] CHCT: All expected trading days are present. [2025-09-29T17:54:35.188063] [DEBUG] [VALIDATOR ] CHCT: Primary data validation passed. [2025-09-29T17:54:35.189333] [INFO ] [MAIN ] CHCT: Fetched primary data is valid. [2025-09-29T17:54:35.189430] [DEBUG] [LOCAL ] CHCT: Saving primary data. [2025-09-29T17:54:35.190828] [DEBUG] [LOCAL ] CHCT: Trimmed 34971 records to 23872 (keeping 200 days of data) [2025-09-29T17:54:35.369565] [DEBUG] [LOCAL ] CHCT: Primary data saved (23872 records). [2025-09-29T17:54:35.369789] [INFO ] [MAIN ] CHCT: Full history saved. [2025-09-29T17:54:35.369937] [INFO ] [MAIN ] Update Progress: 435/2371 symbols completed. CHCT took 40.2s. Estimated remaining: 4h 2m 44s. Rate: 8.0 symbols/min [2025-09-29T17:54:35.549728] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-09-29T17:54:35.583128] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:54:35.605624] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-29T17:54:35.636824] [DEBUG] [LOCAL ] CHMI: Loaded 22359 existing records from primary storage. [2025-09-29T17:54:35.637162] [INFO ] [MAIN ] CHMI: Loaded 22359 existing records. [2025-09-29T17:54:35.849186] [WARN ] [MAIN ] CHMI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:54:35.849473] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-09-29T17:54:35.849534] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-09-29T17:54:35.850197] [DEBUG] [LOCAL ] CHMI: Deleted primary data file. [2025-09-29T17:54:35.850263] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-09-29T17:54:36.253639] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:54:36.348130] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-01. [2025-09-29T17:54:37.088795] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-29T17:54:37.099368] [INFO ] [REMOTE ] CHGG: Full fetch complete (70592 records). [2025-09-29T17:54:37.099552] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-09-29T17:54:37.150557] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2024-12. [2025-09-29T17:54:37.539118] [DEBUG] [VALIDATOR ] CHGG: All expected trading days are present. [2025-09-29T17:54:37.539287] [DEBUG] [VALIDATOR ] CHGG: Primary data validation passed. [2025-09-29T17:54:37.540236] [INFO ] [MAIN ] CHGG: Fetched primary data is valid. [2025-09-29T17:54:37.540471] [DEBUG] [LOCAL ] CHGG: Saving primary data. [2025-09-29T17:54:37.543056] [DEBUG] [LOCAL ] CHGG: Trimmed 70592 records to 47693 (keeping 200 days of data) [2025-09-29T17:54:37.689837] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-29T17:54:37.714178] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-29T17:54:37.915079] [DEBUG] [LOCAL ] CHGG: Primary data saved (47693 records). [2025-09-29T17:54:37.915270] [INFO ] [MAIN ] CHGG: Full history saved. [2025-09-29T17:54:37.915396] [INFO ] [MAIN ] Update Progress: 436/2371 symbols completed. CHGG took 30.6s. Estimated remaining: 4h 2m 15s. Rate: 8.0 symbols/min [2025-09-29T17:54:37.953294] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-09-29T17:54:38.133503] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:54:38.149484] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-29T17:54:38.160031] [DEBUG] [LOCAL ] CHN: Loaded 4900 existing records from primary storage. [2025-09-29T17:54:38.160252] [INFO ] [MAIN ] CHN: Loaded 4900 existing records. [2025-09-29T17:54:38.350671] [WARN ] [MAIN ] CHN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:54:38.350901] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-09-29T17:54:38.350948] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-09-29T17:54:38.351157] [DEBUG] [LOCAL ] CHN: Deleted primary data file. [2025-09-29T17:54:38.351215] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-09-29T17:54:38.774727] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-01. [2025-09-29T17:54:38.781307] [INFO ] [REMOTE ] CHN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:54:39.434055] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-29T17:54:39.548075] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-09-29T17:54:39.926331] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-29T17:54:40.348137] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-09-29T17:54:41.148133] [INFO ] [REMOTE ] CHN: Fetching primary data for 2024-12. [2025-09-29T17:54:41.637038] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-29T17:54:41.649108] [INFO ] [REMOTE ] CHD: Full fetch complete (74390 records). [2025-09-29T17:54:41.649445] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-09-29T17:54:41.829413] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-29T17:54:41.877435] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-29T17:54:41.957964] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-09-29T17:54:42.159927] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present. [2025-09-29T17:54:42.160076] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed. [2025-09-29T17:54:42.161333] [INFO ] [MAIN ] CHD: Fetched primary data is valid. [2025-09-29T17:54:42.161488] [DEBUG] [LOCAL ] CHD: Saving primary data. [2025-09-29T17:54:42.164050] [DEBUG] [LOCAL ] CHD: Trimmed 74390 records to 52043 (keeping 200 days of data) [2025-09-29T17:54:42.510067] [DEBUG] [LOCAL ] CHD: Primary data saved (52043 records). [2025-09-29T17:54:42.510238] [INFO ] [MAIN ] CHD: Full history saved. [2025-09-29T17:54:42.510344] [INFO ] [MAIN ] Update Progress: 437/2371 symbols completed. CHD took 39.3s. Estimated remaining: 4h 1m 54s. Rate: 8.0 symbols/min [2025-09-29T17:54:42.748109] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-01. [2025-09-29T17:54:43.049341] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-29T17:54:43.319420] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-29T17:54:43.548114] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-09-29T17:54:44.348076] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-09-29T17:54:44.472404] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-29T17:54:44.987695] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-29T17:54:45.148111] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-09-29T17:54:45.948117] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-09-29T17:54:46.319358] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-29T17:54:46.553982] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-29T17:54:46.748120] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-09-29T17:54:47.548173] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-09-29T17:54:47.783919] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-29T17:54:48.348170] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-09-29T17:54:49.037855] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-29T17:54:49.111616] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-29T17:54:49.148106] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-09-29T17:54:49.948174] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-09-29T17:54:50.551169] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-29T17:54:50.669277] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-29T17:54:50.748146] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-09-29T17:54:51.548128] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-09-29T17:54:51.903449] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-29T17:54:51.972355] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-29T17:54:52.348147] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-09-29T17:54:53.148149] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-09-29T17:54:53.367036] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-29T17:54:53.721618] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-29T17:54:53.948129] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-09-29T17:54:54.438692] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-29T17:54:54.748152] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-09-29T17:54:55.548141] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-09-29T17:54:56.021309] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-29T17:54:56.082078] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-29T17:54:56.083932] [INFO ] [REMOTE ] CHN: Full fetch complete (7572 records). [2025-09-29T17:54:56.084007] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-09-29T17:54:56.353216] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-09-29T17:54:56.479019] [DEBUG] [VALIDATOR ] CHN: All expected trading days are present. [2025-09-29T17:54:56.479101] [DEBUG] [VALIDATOR ] CHN: Primary data validation passed. [2025-09-29T17:54:56.479322] [INFO ] [MAIN ] CHN: Fetched primary data is valid. [2025-09-29T17:54:56.479365] [DEBUG] [LOCAL ] CHN: Saving primary data. [2025-09-29T17:54:56.479858] [DEBUG] [LOCAL ] CHN: Trimmed 7572 records to 4812 (keeping 200 days of data) [2025-09-29T17:54:56.509515] [DEBUG] [LOCAL ] CHN: Primary data saved (4812 records). [2025-09-29T17:54:56.509625] [INFO ] [MAIN ] CHN: Full history saved. [2025-09-29T17:54:56.509742] [INFO ] [MAIN ] Update Progress: 438/2371 symbols completed. CHN took 18.6s. Estimated remaining: 4h 2m 15s. Rate: 8.0 symbols/min [2025-09-29T17:54:57.148141] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-09-29T17:54:57.549301] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-29T17:54:57.948104] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-09-29T17:54:58.145253] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-29T17:54:58.748098] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-09-29T17:54:58.972569] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-29T17:54:59.548100] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-09-29T17:55:00.308220] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-29T17:55:00.314934] [INFO ] [REMOTE ] CHH: Full fetch complete (46472 records). [2025-09-29T17:55:00.315050] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-09-29T17:55:00.774002] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-29T17:55:00.774327] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-09-29T17:55:00.779736] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-09-29T17:55:00.779889] [INFO ] [REMOTE ] CHMI: Full fetch complete (31703 records). [2025-09-29T17:55:00.780633] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-09-29T17:55:00.780934] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-09-29T17:55:00.781206] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-09-29T17:55:00.872690] [DEBUG] [LOCAL ] CHH: Trimmed 46472 records to 32071 (keeping 200 days of data) [2025-09-29T17:55:01.343715] [DEBUG] [VALIDATOR ] CHMI: All expected trading days are present. [2025-09-29T17:55:01.346754] [DEBUG] [VALIDATOR ] CHMI: Primary data validation passed. [2025-09-29T17:55:01.348132] [INFO ] [MAIN ] CHMI: Fetched primary data is valid. [2025-09-29T17:55:01.348216] [DEBUG] [LOCAL ] CHMI: Saving primary data. [2025-09-29T17:55:01.386259] [DEBUG] [LOCAL ] CHMI: Trimmed 31703 records to 21938 (keeping 200 days of data) [2025-09-29T17:55:01.537896] [DEBUG] [LOCAL ] CHH: Primary data saved (32071 records). [2025-09-29T17:55:01.538566] [INFO ] [MAIN ] CHH: Full history saved. [2025-09-29T17:55:01.540071] [INFO ] [MAIN ] Update Progress: 439/2371 symbols completed. CHH took 28.9s. Estimated remaining: 4h 1m 57s. Rate: 8.0 symbols/min [2025-09-29T17:55:01.578824] [DEBUG] [LOCAL ] CHMI: Primary data saved (21938 records). [2025-09-29T17:55:01.578957] [INFO ] [MAIN ] CHMI: Full history saved. [2025-09-29T17:55:01.579042] [INFO ] [MAIN ] Update Progress: 440/2371 symbols completed. CHMI took 26.2s. Estimated remaining: 4h 1m 17s. Rate: 8.0 symbols/min [2025-09-29T17:55:02.198992] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:55:02.326955] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:55:02.379169] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:55:02.360330] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:55:02.407421] [DEBUG] [LOCAL ] CHT: Loaded 19816 existing records from primary storage. [2025-09-29T17:55:02.407808] [INFO ] [MAIN ] CHT: Loaded 19816 existing records. [2025-09-29T17:55:02.675380] [WARN ] [MAIN ] CHT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:55:02.691984] [DEBUG] [LOCAL ] CHWY: Loaded 54434 existing records from primary storage. [2025-09-29T17:55:02.690473] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-09-29T17:55:02.692494] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-09-29T17:55:02.693584] [DEBUG] [LOCAL ] CHPT: Loaded 49765 existing records from primary storage. [2025-09-29T17:55:02.692727] [INFO ] [MAIN ] CHWY: Loaded 54434 existing records. [2025-09-29T17:55:02.706378] [INFO ] [MAIN ] CHPT: Loaded 49765 existing records. [2025-09-29T17:55:02.693831] [DEBUG] [LOCAL ] CHT: Deleted primary data file. [2025-09-29T17:55:02.802763] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-09-29T17:55:02.820377] [DEBUG] [LOCAL ] CI: Loaded 50561 existing records from primary storage. [2025-09-29T17:55:02.871744] [INFO ] [MAIN ] CI: Loaded 50561 existing records. [2025-09-29T17:55:03.333015] [WARN ] [MAIN ] CHWY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:55:03.409912] [WARN ] [MAIN ] CHPT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:55:03.430037] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-09-29T17:55:03.463865] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-09-29T17:55:03.495485] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-09-29T17:55:03.543218] [DEBUG] [LOCAL ] CHWY: Deleted primary data file. [2025-09-29T17:55:03.528241] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-09-29T17:55:03.586851] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-09-29T17:55:03.614040] [DEBUG] [LOCAL ] CHPT: Deleted primary data file. [2025-09-29T17:55:03.626480] [WARN ] [MAIN ] CI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:55:03.658012] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-09-29T17:55:03.744725] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-09-29T17:55:03.783465] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-09-29T17:55:03.845684] [DEBUG] [LOCAL ] CI: Deleted primary data file. [2025-09-29T17:55:03.895742] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-09-29T17:55:03.956817] [INFO ] [REMOTE ] CHT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:55:03.978354] [INFO ] [REMOTE ] CHT: Fetching primary data for 2024-12. [2025-09-29T17:55:04.788006] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:55:04.846792] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2024-12. [2025-09-29T17:55:04.850302] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:55:04.850759] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2024-12. [2025-09-29T17:55:04.943491] [INFO ] [REMOTE ] CI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:55:04.943929] [INFO ] [REMOTE ] CI: Fetching primary data for 2024-12. [2025-09-29T17:55:05.258766] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-29T17:55:05.263087] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-01. [2025-09-29T17:55:06.352869] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-29T17:55:06.358061] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-09-29T17:55:06.805015] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-29T17:55:06.816478] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-01. [2025-09-29T17:55:06.989093] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-29T17:55:07.001018] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-01. [2025-09-29T17:55:07.031834] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-29T17:55:07.037044] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-09-29T17:55:07.085617] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-29T17:55:07.548200] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-01. [2025-09-29T17:55:08.183383] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-29T17:55:08.348085] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-09-29T17:55:08.548634] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-29T17:55:08.751076] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-29T17:55:09.148089] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-09-29T17:55:09.469106] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-29T17:55:09.948137] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-09-29T17:55:09.990194] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-09-29T17:55:10.748163] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-09-29T17:55:10.797404] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-29T17:55:11.353109] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-29T17:55:11.548118] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-09-29T17:55:11.622137] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-29T17:55:12.348127] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-09-29T17:55:13.148144] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-09-29T17:55:13.369765] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-29T17:55:13.513385] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-29T17:55:13.948154] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-09-29T17:55:14.748166] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-09-29T17:55:14.832138] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-29T17:55:15.548162] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-09-29T17:55:15.871431] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-29T17:55:15.896497] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-29T17:55:16.348125] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-09-29T17:55:17.148105] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-09-29T17:55:17.341336] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-29T17:55:17.948182] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-09-29T17:55:18.748152] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-09-29T17:55:18.984574] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (2.64 seconds). [2025-09-29T17:55:19.191896] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-29T17:55:19.454517] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-29T17:55:19.548091] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-09-29T17:55:19.694333] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-29T17:55:20.348154] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-09-29T17:55:21.148135] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-09-29T17:55:21.459226] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-29T17:55:21.948123] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-09-29T17:55:22.058488] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-29T17:55:22.206609] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-29T17:55:22.211211] [INFO ] [REMOTE ] CHT: Full fetch complete (27323 records). [2025-09-29T17:55:22.211297] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-09-29T17:55:22.631085] [DEBUG] [VALIDATOR ] CHT: All expected trading days are present. [2025-09-29T17:55:22.631243] [DEBUG] [VALIDATOR ] CHT: Primary data validation passed. [2025-09-29T17:55:22.631873] [INFO ] [MAIN ] CHT: Fetched primary data is valid. [2025-09-29T17:55:22.631941] [DEBUG] [LOCAL ] CHT: Saving primary data. [2025-09-29T17:55:22.633043] [DEBUG] [LOCAL ] CHT: Trimmed 27323 records to 19553 (keeping 200 days of data) [2025-09-29T17:55:22.748621] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-09-29T17:55:22.759821] [DEBUG] [LOCAL ] CHT: Primary data saved (19553 records). [2025-09-29T17:55:22.760001] [INFO ] [MAIN ] CHT: Full history saved. [2025-09-29T17:55:22.760125] [INFO ] [MAIN ] Update Progress: 441/2371 symbols completed. CHT took 21.2s. Estimated remaining: 4h 2m 9s. Rate: 8.0 symbols/min [2025-09-29T17:55:22.945308] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:55:22.967392] [DEBUG] [LOCAL ] CIA: Loaded 17213 existing records from primary storage. [2025-09-29T17:55:22.967710] [INFO ] [MAIN ] CIA: Loaded 17213 existing records. [2025-09-29T17:55:23.169732] [WARN ] [MAIN ] CIA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:55:23.169975] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-09-29T17:55:23.170028] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-09-29T17:55:23.170261] [DEBUG] [LOCAL ] CIA: Deleted primary data file. [2025-09-29T17:55:23.170320] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-09-29T17:55:23.548152] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-09-29T17:55:23.575288] [INFO ] [REMOTE ] CIA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:55:24.062107] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-29T17:55:24.348100] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-09-29T17:55:24.482745] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-29T17:55:25.148131] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-09-29T17:55:25.458566] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-29T17:55:25.948094] [INFO ] [REMOTE ] CIA: Fetching primary data for 2024-12. [2025-09-29T17:55:26.449707] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-29T17:55:26.551331] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-29T17:55:26.748112] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-09-29T17:55:27.179208] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-29T17:55:27.548177] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-09-29T17:55:28.348136] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-01. [2025-09-29T17:55:28.836128] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-29T17:55:29.066605] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-29T17:55:29.148176] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-09-29T17:55:29.317287] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-29T17:55:29.948143] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-09-29T17:55:30.081173] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-29T17:55:30.748124] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-09-29T17:55:31.548090] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-09-29T17:55:31.725130] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-29T17:55:31.981081] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-29T17:55:31.992587] [INFO ] [REMOTE ] CI: Full fetch complete (72442 records). [2025-09-29T17:55:31.992970] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-09-29T17:55:32.353188] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-09-29T17:55:32.433523] [DEBUG] [VALIDATOR ] CI: All expected trading days are present. [2025-09-29T17:55:32.433614] [DEBUG] [VALIDATOR ] CI: Primary data validation passed. [2025-09-29T17:55:32.434539] [INFO ] [MAIN ] CI: Fetched primary data is valid. [2025-09-29T17:55:32.434605] [DEBUG] [LOCAL ] CI: Saving primary data. [2025-09-29T17:55:32.436091] [DEBUG] [LOCAL ] CI: Trimmed 72442 records to 49743 (keeping 200 days of data) [2025-09-29T17:55:32.770096] [DEBUG] [LOCAL ] CI: Primary data saved (49743 records). [2025-09-29T17:55:32.770247] [INFO ] [MAIN ] CI: Full history saved. [2025-09-29T17:55:32.770359] [INFO ] [MAIN ] Update Progress: 442/2371 symbols completed. CI took 31.2s. Estimated remaining: 4h 2m 12s. Rate: 8.0 symbols/min [2025-09-29T17:55:32.953228] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:55:32.991300] [DEBUG] [LOCAL ] CIB: Loaded 31435 existing records from primary storage. [2025-09-29T17:55:32.991594] [INFO ] [MAIN ] CIB: Loaded 31435 existing records. [2025-09-29T17:55:33.155521] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-09-29T17:55:33.189008] [WARN ] [MAIN ] CIB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:55:33.189231] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-09-29T17:55:33.189311] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-09-29T17:55:33.189884] [DEBUG] [LOCAL ] CIB: Deleted primary data file. [2025-09-29T17:55:33.189983] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-09-29T17:55:33.588498] [INFO ] [REMOTE ] CIB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:55:33.672913] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-29T17:55:33.948083] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-09-29T17:55:34.259424] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-29T17:55:34.621902] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-29T17:55:34.748128] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-09-29T17:55:35.335377] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-29T17:55:35.548141] [INFO ] [REMOTE ] CIB: Fetching primary data for 2024-12. [2025-09-29T17:55:35.691202] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-29T17:55:36.348118] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-09-29T17:55:36.471510] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-29T17:55:37.148123] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-01. [2025-09-29T17:55:37.351575] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-29T17:55:37.948120] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-09-29T17:55:38.447314] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-29T17:55:38.748101] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-09-29T17:55:39.060733] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-29T17:55:39.548158] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-09-29T17:55:40.104989] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-29T17:55:40.123099] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-29T17:55:40.348116] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-09-29T17:55:41.148114] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-09-29T17:55:41.948117] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-09-29T17:55:42.748126] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-09-29T17:55:42.938786] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-29T17:55:42.942697] [INFO ] [REMOTE ] CIA: Full fetch complete (23469 records). [2025-09-29T17:55:42.942842] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-09-29T17:55:43.053588] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-29T17:55:43.092263] [INFO ] [REMOTE ] CHPT: Full fetch complete (73000 records). [2025-09-29T17:55:43.113099] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-09-29T17:55:43.621401] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present. [2025-09-29T17:55:43.634698] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed. [2025-09-29T17:55:43.665304] [INFO ] [MAIN ] CIA: Fetched primary data is valid. [2025-09-29T17:55:43.706018] [DEBUG] [LOCAL ] CIA: Saving primary data. [2025-09-29T17:55:43.758768] [DEBUG] [LOCAL ] CIA: Trimmed 23469 records to 16973 (keeping 200 days of data) [2025-09-29T17:55:43.882737] [DEBUG] [VALIDATOR ] CHPT: All expected trading days are present. [2025-09-29T17:55:43.905918] [DEBUG] [VALIDATOR ] CHPT: Primary data validation passed. [2025-09-29T17:55:43.909381] [INFO ] [MAIN ] CHPT: Fetched primary data is valid. [2025-09-29T17:55:43.909795] [DEBUG] [LOCAL ] CHPT: Saving primary data. [2025-09-29T17:55:43.917053] [DEBUG] [LOCAL ] CHPT: Trimmed 73000 records to 48897 (keeping 200 days of data) [2025-09-29T17:55:44.023876] [DEBUG] [LOCAL ] CIA: Primary data saved (16973 records). [2025-09-29T17:55:44.024513] [INFO ] [MAIN ] CIA: Full history saved. [2025-09-29T17:55:44.024930] [INFO ] [MAIN ] Update Progress: 443/2371 symbols completed. CIA took 21.3s. Estimated remaining: 4h 2m 21s. Rate: 8.0 symbols/min [2025-09-29T17:55:44.237719] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:55:44.238766] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-09-29T17:55:44.239211] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-09-29T17:55:44.239850] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-09-29T17:55:44.240355] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-09-29T17:55:44.240447] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-09-29T17:55:44.240886] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-09-29T17:55:44.906625] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (4.56 seconds). [2025-09-29T17:55:44.960152] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-09-29T17:55:44.949089] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:55:44.962544] [INFO ] [REMOTE ] CICB: Fetching primary data for 2024-12. [2025-09-29T17:55:45.131482] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-09-29T17:55:45.149930] [INFO ] [REMOTE ] CHWY: Full fetch complete (77635 records). [2025-09-29T17:55:45.151097] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-09-29T17:55:45.210017] [DEBUG] [LOCAL ] CHPT: Primary data saved (48897 records). [2025-09-29T17:55:45.234841] [INFO ] [MAIN ] CHPT: Full history saved. [2025-09-29T17:55:45.274332] [INFO ] [MAIN ] Update Progress: 444/2371 symbols completed. CHPT took 43.7s. Estimated remaining: 4h 1m 46s. Rate: 8.0 symbols/min [2025-09-29T17:55:45.612562] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-29T17:55:45.636241] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-09-29T17:55:45.715551] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:55:45.891285] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present. [2025-09-29T17:55:45.891430] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed. [2025-09-29T17:55:45.892609] [INFO ] [MAIN ] CHWY: Fetched primary data is valid. [2025-09-29T17:55:45.892724] [DEBUG] [LOCAL ] CHWY: Saving primary data. [2025-09-29T17:55:45.894897] [DEBUG] [LOCAL ] CHWY: Trimmed 77635 records to 53654 (keeping 200 days of data) [2025-09-29T17:55:46.033395] [DEBUG] [LOCAL ] CIEN: Loaded 52854 existing records from primary storage. [2025-09-29T17:55:46.034532] [INFO ] [MAIN ] CIEN: Loaded 52854 existing records. [2025-09-29T17:55:46.250197] [WARN ] [MAIN ] CIEN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:55:46.254276] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-09-29T17:55:46.256879] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-09-29T17:55:46.260476] [DEBUG] [LOCAL ] CIEN: Deleted primary data file. [2025-09-29T17:55:46.260539] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-09-29T17:55:46.737021] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-29T17:55:46.789973] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-09-29T17:55:46.880126] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:55:46.881478] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2024-12. [2025-09-29T17:55:46.972965] [DEBUG] [LOCAL ] CHWY: Primary data saved (53654 records). [2025-09-29T17:55:46.976377] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-29T17:55:46.976456] [INFO ] [MAIN ] CHWY: Full history saved. [2025-09-29T17:55:46.977958] [INFO ] [MAIN ] Update Progress: 445/2371 symbols completed. CHWY took 45.4s. Estimated remaining: 4h 1m 13s. Rate: 8.0 symbols/min [2025-09-29T17:55:47.159486] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:55:47.166402] [DEBUG] [LOCAL ] CIF: Loaded 4396 existing records from primary storage. [2025-09-29T17:55:47.166622] [INFO ] [MAIN ] CIF: Loaded 4396 existing records. [2025-09-29T17:55:47.360246] [WARN ] [MAIN ] CIF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:55:47.360454] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-09-29T17:55:47.360504] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-09-29T17:55:47.360792] [DEBUG] [LOCAL ] CIF: Deleted primary data file. [2025-09-29T17:55:47.360853] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-09-29T17:55:47.548438] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-09-29T17:55:47.784522] [INFO ] [REMOTE ] CIF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:55:48.022684] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-29T17:55:48.094308] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-29T17:55:48.348152] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-09-29T17:55:48.804906] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-29T17:55:48.979933] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-29T17:55:49.148153] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-09-29T17:55:49.671047] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-29T17:55:49.948131] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-09-29T17:55:50.748144] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-01. [2025-09-29T17:55:51.080080] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-29T17:55:51.548124] [INFO ] [REMOTE ] CIF: Fetching primary data for 2024-12. [2025-09-29T17:55:52.223752] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-29T17:55:52.334346] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-29T17:55:52.348066] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-09-29T17:55:53.148149] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-09-29T17:55:53.483577] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-29T17:55:53.948130] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-09-29T17:55:54.088807] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-29T17:55:54.387687] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-29T17:55:54.748167] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-09-29T17:55:55.548114] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-09-29T17:55:56.348284] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-01. [2025-09-29T17:55:56.351769] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-29T17:55:56.381757] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-29T17:55:57.079508] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-29T17:55:57.148126] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-09-29T17:55:57.880399] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-29T17:55:57.948155] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-09-29T17:55:58.748117] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-09-29T17:55:59.295349] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-29T17:55:59.548218] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-09-29T17:55:59.841304] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-29T17:56:00.348156] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-09-29T17:56:00.905051] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-29T17:56:00.970267] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-29T17:56:01.148161] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-09-29T17:56:01.948153] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-09-29T17:56:02.631022] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-29T17:56:02.638080] [INFO ] [REMOTE ] CIB: Full fetch complete (44438 records). [2025-09-29T17:56:02.638290] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-09-29T17:56:02.752031] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-09-29T17:56:03.060639] [DEBUG] [VALIDATOR ] CIB: All expected trading days are present. [2025-09-29T17:56:03.060917] [DEBUG] [VALIDATOR ] CIB: Primary data validation passed. [2025-09-29T17:56:03.062027] [INFO ] [MAIN ] CIB: Fetched primary data is valid. [2025-09-29T17:56:03.062103] [DEBUG] [LOCAL ] CIB: Saving primary data. [2025-09-29T17:56:03.063337] [DEBUG] [LOCAL ] CIB: Trimmed 44438 records to 30906 (keeping 200 days of data) [2025-09-29T17:56:03.153481] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-29T17:56:03.265503] [DEBUG] [LOCAL ] CIB: Primary data saved (30906 records). [2025-09-29T17:56:03.265763] [INFO ] [MAIN ] CIB: Full history saved. [2025-09-29T17:56:03.266012] [INFO ] [MAIN ] Update Progress: 446/2371 symbols completed. CIB took 30.5s. Estimated remaining: 4h 1m 44s. Rate: 8.0 symbols/min [2025-09-29T17:56:03.454028] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:56:03.493900] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-29T17:56:03.546322] [DEBUG] [LOCAL ] CIG: Loaded 44447 existing records from primary storage. [2025-09-29T17:56:03.546712] [INFO ] [MAIN ] CIG: Loaded 44447 existing records. [2025-09-29T17:56:03.557792] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-09-29T17:56:03.748024] [WARN ] [MAIN ] CIG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:56:03.748300] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-09-29T17:56:03.748368] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-09-29T17:56:03.748799] [DEBUG] [LOCAL ] CIG: Deleted primary data file. [2025-09-29T17:56:03.748863] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-09-29T17:56:04.138016] [INFO ] [REMOTE ] CIG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:56:04.134185] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-29T17:56:04.139275] [INFO ] [REMOTE ] CICB: Full fetch complete (2101 records). [2025-09-29T17:56:04.139352] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-09-29T17:56:04.327482] [WARN ] [VALIDATOR ] CICB: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-29T17:56:04.327720] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:56:04.327793] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:56:04.327870] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-09-29T17:56:04.327985] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-09-29T17:56:04.328044] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-09-29T17:56:04.328106] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-09-29T17:56:04.328212] [INFO ] [MAIN ] Update Progress: 447/2371 symbols completed. CICB took 20.3s. Estimated remaining: 4h 1m 8s. Rate: 8.0 symbols/min [2025-09-29T17:56:04.353488] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-09-29T17:56:04.555512] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:56:04.578888] [DEBUG] [LOCAL ] CII: Loaded 15638 existing records from primary storage. [2025-09-29T17:56:04.579189] [INFO ] [MAIN ] CII: Loaded 15638 existing records. [2025-09-29T17:56:04.777551] [WARN ] [MAIN ] CII: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:56:04.777929] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-09-29T17:56:04.778006] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-09-29T17:56:04.778688] [DEBUG] [LOCAL ] CII: Deleted primary data file. [2025-09-29T17:56:04.778764] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-09-29T17:56:05.167132] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-09-29T17:56:05.180901] [INFO ] [REMOTE ] CII: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:56:05.183795] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-29T17:56:05.948103] [INFO ] [REMOTE ] CIG: Fetching primary data for 2024-12. [2025-09-29T17:56:06.588246] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-29T17:56:06.748141] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-09-29T17:56:07.292346] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-29T17:56:07.548174] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-09-29T17:56:08.161208] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-29T17:56:08.348149] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-09-29T17:56:08.604318] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-29T17:56:08.751814] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-29T17:56:09.148166] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-09-29T17:56:09.743317] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-29T17:56:09.948174] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-09-29T17:56:10.543605] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-29T17:56:10.748118] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-09-29T17:56:11.548150] [INFO ] [REMOTE ] CII: Fetching primary data for 2024-12. [2025-09-29T17:56:12.348342] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-09-29T17:56:12.355152] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-29T17:56:12.381839] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-29T17:56:12.890250] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-29T17:56:12.891860] [INFO ] [REMOTE ] CIF: Full fetch complete (6614 records). [2025-09-29T17:56:12.891935] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-09-29T17:56:13.153431] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-01. [2025-09-29T17:56:13.301983] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-09-29T17:56:13.302086] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-09-29T17:56:13.302330] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-09-29T17:56:13.302395] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-09-29T17:56:13.302884] [DEBUG] [LOCAL ] CIF: Trimmed 6614 records to 4271 (keeping 200 days of data) [2025-09-29T17:56:13.329130] [DEBUG] [LOCAL ] CIF: Primary data saved (4271 records). [2025-09-29T17:56:13.329265] [INFO ] [MAIN ] CIF: Full history saved. [2025-09-29T17:56:13.329376] [INFO ] [MAIN ] Update Progress: 448/2371 symbols completed. CIF took 26.4s. Estimated remaining: 4h 1m 7s. Rate: 8.0 symbols/min [2025-09-29T17:56:13.519530] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:56:13.579783] [DEBUG] [LOCAL ] CIM: Loaded 37858 existing records from primary storage. [2025-09-29T17:56:13.580099] [INFO ] [MAIN ] CIM: Loaded 37858 existing records. [2025-09-29T17:56:13.771021] [WARN ] [MAIN ] CIM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:56:13.771245] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-09-29T17:56:13.771294] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-09-29T17:56:13.771673] [DEBUG] [LOCAL ] CIM: Deleted primary data file. [2025-09-29T17:56:13.771734] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-09-29T17:56:13.960992] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-01. [2025-09-29T17:56:14.182540] [INFO ] [REMOTE ] CIM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:56:14.653762] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-29T17:56:14.673056] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-29T17:56:14.748126] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-09-29T17:56:15.548151] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-09-29T17:56:16.348114] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-09-29T17:56:16.506498] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-29T17:56:16.880190] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-29T17:56:16.892668] [INFO ] [REMOTE ] CIEN: Full fetch complete (75581 records). [2025-09-29T17:56:16.892844] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-09-29T17:56:17.153315] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-09-29T17:56:17.330250] [DEBUG] [VALIDATOR ] CIEN: All expected trading days are present. [2025-09-29T17:56:17.330355] [DEBUG] [VALIDATOR ] CIEN: Primary data validation passed. [2025-09-29T17:56:17.331522] [INFO ] [MAIN ] CIEN: Fetched primary data is valid. [2025-09-29T17:56:17.331602] [DEBUG] [LOCAL ] CIEN: Saving primary data. [2025-09-29T17:56:17.333146] [DEBUG] [LOCAL ] CIEN: Trimmed 75581 records to 52074 (keeping 200 days of data) [2025-09-29T17:56:17.676157] [DEBUG] [LOCAL ] CIEN: Primary data saved (52074 records). [2025-09-29T17:56:17.676319] [INFO ] [MAIN ] CIEN: Full history saved. [2025-09-29T17:56:17.676468] [INFO ] [MAIN ] Update Progress: 449/2371 symbols completed. CIEN took 32.4s. Estimated remaining: 4h 0m 46s. Rate: 8.0 symbols/min [2025-09-29T17:56:17.887707] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:56:17.899493] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-29T17:56:17.911358] [DEBUG] [LOCAL ] CIMN: Loaded 2697 existing records from primary storage. [2025-09-29T17:56:17.911582] [INFO ] [MAIN ] CIMN: Loaded 2697 existing records. [2025-09-29T17:56:17.953354] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-09-29T17:56:18.114313] [WARN ] [MAIN ] CIMN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:56:18.128665] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-09-29T17:56:18.129350] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-09-29T17:56:18.129999] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-29T17:56:18.134957] [DEBUG] [LOCAL ] CIMN: Deleted primary data file. [2025-09-29T17:56:18.135629] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-09-29T17:56:18.508256] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:56:18.748106] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-09-29T17:56:19.433859] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-29T17:56:19.548085] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-09-29T17:56:19.872577] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-29T17:56:20.348109] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2024-12. [2025-09-29T17:56:21.015801] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-29T17:56:21.061815] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-29T17:56:21.148122] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-09-29T17:56:21.850773] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-29T17:56:21.948179] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-09-29T17:56:22.748116] [INFO ] [REMOTE ] CIM: Fetching primary data for 2024-12. [2025-09-29T17:56:22.875249] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-29T17:56:23.548130] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-09-29T17:56:24.036086] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-29T17:56:24.348154] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-01. [2025-09-29T17:56:24.715989] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-09-29T17:56:25.122335] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-29T17:56:25.148089] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-09-29T17:56:25.948158] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-09-29T17:56:26.393318] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-29T17:56:26.748111] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-09-29T17:56:26.812988] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-29T17:56:27.096901] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-29T17:56:27.548146] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-09-29T17:56:27.994620] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-29T17:56:28.348124] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-09-29T17:56:29.148110] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-09-29T17:56:29.336051] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-29T17:56:29.948132] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-09-29T17:56:30.343264] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-29T17:56:30.748113] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-09-29T17:56:30.898040] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-29T17:56:31.294473] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-29T17:56:31.548106] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-09-29T17:56:32.348109] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-01. [2025-09-29T17:56:32.466202] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-29T17:56:32.470078] [INFO ] [REMOTE ] CII: Full fetch complete (23069 records). [2025-09-29T17:56:32.470170] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-09-29T17:56:32.865397] [DEBUG] [VALIDATOR ] CII: All expected trading days are present. [2025-09-29T17:56:32.865481] [DEBUG] [VALIDATOR ] CII: Primary data validation passed. [2025-09-29T17:56:32.865982] [INFO ] [MAIN ] CII: Fetched primary data is valid. [2025-09-29T17:56:32.866045] [DEBUG] [LOCAL ] CII: Saving primary data. [2025-09-29T17:56:32.866752] [DEBUG] [LOCAL ] CII: Trimmed 23069 records to 15286 (keeping 200 days of data) [2025-09-29T17:56:32.971150] [DEBUG] [LOCAL ] CII: Primary data saved (15286 records). [2025-09-29T17:56:32.971325] [INFO ] [MAIN ] CII: Full history saved. [2025-09-29T17:56:32.971437] [INFO ] [MAIN ] Update Progress: 450/2371 symbols completed. CII took 28.6s. Estimated remaining: 4h 1m 12s. Rate: 8.0 symbols/min [2025-09-29T17:56:33.149678] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-09-29T17:56:33.151272] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:56:33.152445] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-09-29T17:56:33.152501] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-09-29T17:56:33.152635] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-09-29T17:56:33.152719] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-09-29T17:56:33.152769] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-09-29T17:56:33.152843] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-09-29T17:56:33.547423] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:56:33.745035] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-29T17:56:33.948112] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-09-29T17:56:34.748110] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2024-12. [2025-09-29T17:56:34.895401] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-29T17:56:35.480737] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-29T17:56:35.507333] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-29T17:56:35.548088] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-09-29T17:56:36.348112] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-09-29T17:56:37.128489] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-29T17:56:37.148158] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-09-29T17:56:37.954886] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-09-29T17:56:37.979123] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-29T17:56:37.989519] [INFO ] [REMOTE ] CIG: Full fetch complete (61079 records). [2025-09-29T17:56:37.989738] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-09-29T17:56:38.400191] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-29T17:56:38.441150] [DEBUG] [VALIDATOR ] CIG: All expected trading days are present. [2025-09-29T17:56:38.441254] [DEBUG] [VALIDATOR ] CIG: Primary data validation passed. [2025-09-29T17:56:38.442120] [INFO ] [MAIN ] CIG: Fetched primary data is valid. [2025-09-29T17:56:38.442187] [DEBUG] [LOCAL ] CIG: Saving primary data. [2025-09-29T17:56:38.443621] [DEBUG] [LOCAL ] CIG: Trimmed 61079 records to 43863 (keeping 200 days of data) [2025-09-29T17:56:38.722767] [DEBUG] [LOCAL ] CIG: Primary data saved (43863 records). [2025-09-29T17:56:38.722907] [INFO ] [MAIN ] CIG: Full history saved. [2025-09-29T17:56:38.723009] [INFO ] [MAIN ] Update Progress: 451/2371 symbols completed. CIG took 35.5s. Estimated remaining: 4h 0m 57s. Rate: 8.0 symbols/min [2025-09-29T17:56:38.754999] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-09-29T17:56:38.913618] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-29T17:56:38.956523] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:56:38.957229] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-09-29T17:56:38.957286] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-09-29T17:56:38.957420] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-09-29T17:56:38.957471] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-09-29T17:56:38.957514] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-09-29T17:56:38.957547] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-09-29T17:56:39.359385] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:56:39.360109] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-29T17:56:39.548120] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2024-12. [2025-09-29T17:56:39.762857] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T17:56:39.763214] [WARN ] [REMOTE ] CIMP: No data returned for month 2024-12 [2025-09-29T17:56:39.763308] [FATAL] [REMOTE ] CIMP: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T17:56:39.763358] [FATAL] [MAIN ] CIMP: Failed to fetch primary data. [2025-09-29T17:56:39.763420] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T17:56:39.763494] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-09-29T17:56:39.763562] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-09-29T17:56:39.763601] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-09-29T17:56:39.763677] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-09-29T17:56:39.763750] [INFO ] [MAIN ] Update Progress: 452/2371 symbols completed. CIMP took 1.0s. Estimated remaining: 4h 0m 22s. Rate: 8.0 symbols/min [2025-09-29T17:56:39.941125] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:56:39.962600] [DEBUG] [LOCAL ] CINT: Loaded 18868 existing records from primary storage. [2025-09-29T17:56:39.962905] [INFO ] [MAIN ] CINT: Loaded 18868 existing records. [2025-09-29T17:56:40.158906] [WARN ] [MAIN ] CINT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:56:40.159169] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-09-29T17:56:40.159240] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-09-29T17:56:40.159580] [DEBUG] [LOCAL ] CINT: Deleted primary data file. [2025-09-29T17:56:40.159675] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-09-29T17:56:40.353672] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-09-29T17:56:40.534726] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:56:40.919702] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-29T17:56:41.148127] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-09-29T17:56:41.611725] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-29T17:56:41.948135] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-09-29T17:56:42.748146] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-09-29T17:56:43.352106] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-29T17:56:43.392380] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-29T17:56:43.548124] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-09-29T17:56:43.828825] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-09-29T17:56:44.348149] [INFO ] [REMOTE ] CINT: Fetching primary data for 2024-12. [2025-09-29T17:56:45.148083] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-09-29T17:56:45.457436] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-29T17:56:45.601327] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-29T17:56:45.948124] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-09-29T17:56:46.748088] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-09-29T17:56:46.988549] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-29T17:56:47.548133] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-09-29T17:56:48.264378] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-29T17:56:48.348084] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-09-29T17:56:48.373157] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-29T17:56:49.148160] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-09-29T17:56:49.669702] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-29T17:56:49.670999] [INFO ] [REMOTE ] CIMN: Full fetch complete (3904 records). [2025-09-29T17:56:49.671093] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-09-29T17:56:49.958510] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-09-29T17:56:50.007177] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-29T17:56:50.111341] [DEBUG] [VALIDATOR ] CIMN: All expected trading days are present. [2025-09-29T17:56:50.111424] [DEBUG] [VALIDATOR ] CIMN: Primary data validation passed. [2025-09-29T17:56:50.111570] [INFO ] [MAIN ] CIMN: Fetched primary data is valid. [2025-09-29T17:56:50.111610] [DEBUG] [LOCAL ] CIMN: Saving primary data. [2025-09-29T17:56:50.112002] [DEBUG] [LOCAL ] CIMN: Trimmed 3904 records to 2664 (keeping 200 days of data) [2025-09-29T17:56:50.130070] [DEBUG] [LOCAL ] CIMN: Primary data saved (2664 records). [2025-09-29T17:56:50.130210] [INFO ] [MAIN ] CIMN: Full history saved. [2025-09-29T17:56:50.130351] [INFO ] [MAIN ] Update Progress: 453/2371 symbols completed. CIMN took 32.5s. Estimated remaining: 4h 0m 26s. Rate: 8.0 symbols/min [2025-09-29T17:56:50.318563] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:56:50.344945] [DEBUG] [LOCAL ] CIO: Loaded 20406 existing records from primary storage. [2025-09-29T17:56:50.345211] [INFO ] [MAIN ] CIO: Loaded 20406 existing records. [2025-09-29T17:56:50.613023] [WARN ] [MAIN ] CIO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:56:50.613266] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-09-29T17:56:50.613326] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-09-29T17:56:50.613692] [DEBUG] [LOCAL ] CIO: Deleted primary data file. [2025-09-29T17:56:50.613752] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-09-29T17:56:50.755465] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-09-29T17:56:51.082357] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:56:51.084612] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-29T17:56:51.548152] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-09-29T17:56:52.239113] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-29T17:56:52.348096] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-09-29T17:56:52.571414] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-29T17:56:53.148134] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-09-29T17:56:53.757261] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-29T17:56:53.948097] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-09-29T17:56:53.996705] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-29T17:56:54.005324] [INFO ] [REMOTE ] CIM: Full fetch complete (54709 records). [2025-09-29T17:56:54.005536] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-09-29T17:56:54.421034] [DEBUG] [VALIDATOR ] CIM: All expected trading days are present. [2025-09-29T17:56:54.421174] [DEBUG] [VALIDATOR ] CIM: Primary data validation passed. [2025-09-29T17:56:54.421976] [INFO ] [MAIN ] CIM: Fetched primary data is valid. [2025-09-29T17:56:54.422045] [DEBUG] [LOCAL ] CIM: Saving primary data. [2025-09-29T17:56:54.423377] [DEBUG] [LOCAL ] CIM: Trimmed 54709 records to 37273 (keeping 200 days of data) [2025-09-29T17:56:54.666098] [DEBUG] [LOCAL ] CIM: Primary data saved (37273 records). [2025-09-29T17:56:54.666255] [INFO ] [MAIN ] CIM: Full history saved. [2025-09-29T17:56:54.666347] [INFO ] [MAIN ] Update Progress: 454/2371 symbols completed. CIM took 41.3s. Estimated remaining: 4h 0m 6s. Rate: 8.0 symbols/min [2025-09-29T17:56:54.753138] [INFO ] [REMOTE ] CIO: Fetching primary data for 2024-12. [2025-09-29T17:56:54.856086] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:56:54.891274] [DEBUG] [LOCAL ] CION: Loaded 29661 existing records from primary storage. [2025-09-29T17:56:54.891551] [INFO ] [MAIN ] CION: Loaded 29661 existing records. [2025-09-29T17:56:55.022517] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-29T17:56:55.094844] [WARN ] [MAIN ] CION: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:56:55.095113] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-09-29T17:56:55.095172] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-09-29T17:56:55.095611] [DEBUG] [LOCAL ] CION: Deleted primary data file. [2025-09-29T17:56:55.095713] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-09-29T17:56:55.479688] [INFO ] [REMOTE ] CION: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:56:55.548135] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-09-29T17:56:55.790162] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-29T17:56:55.908107] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-29T17:56:56.348116] [INFO ] [REMOTE ] CION: Fetching primary data for 2024-12. [2025-09-29T17:56:57.148118] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-09-29T17:56:57.751376] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-29T17:56:57.907798] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-29T17:56:57.948084] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-09-29T17:56:58.508517] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-29T17:56:58.748123] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-09-29T17:56:59.548110] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-01. [2025-09-29T17:56:59.873383] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-29T17:57:00.348168] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-09-29T17:57:00.738239] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-29T17:57:01.148120] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-09-29T17:57:01.215985] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-29T17:57:01.217956] [INFO ] [REMOTE ] CIMO: Full fetch complete (5384 records). [2025-09-29T17:57:01.218066] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-09-29T17:57:01.409881] [WARN ] [VALIDATOR ] CIMO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-29T17:57:01.410092] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-09-29T17:57:01.410162] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-09-29T17:57:01.410235] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-09-29T17:57:01.410300] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-09-29T17:57:01.410336] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-09-29T17:57:01.410396] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-09-29T17:57:01.410487] [INFO ] [MAIN ] Update Progress: 455/2371 symbols completed. CIMO took 28.4s. Estimated remaining: 3h 59m 55s. Rate: 8.0 symbols/min [2025-09-29T17:57:01.613686] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:57:01.673920] [DEBUG] [LOCAL ] CIVI: Loaded 53363 existing records from primary storage. [2025-09-29T17:57:01.674278] [INFO ] [MAIN ] CIVI: Loaded 53363 existing records. [2025-09-29T17:57:01.872829] [WARN ] [MAIN ] CIVI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:57:01.873063] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-09-29T17:57:01.873113] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-09-29T17:57:01.873608] [DEBUG] [LOCAL ] CIVI: Deleted primary data file. [2025-09-29T17:57:01.873704] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-09-29T17:57:01.954251] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-09-29T17:57:02.223930] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-29T17:57:02.290561] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:57:02.748111] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-09-29T17:57:02.850153] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-29T17:57:03.548109] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-09-29T17:57:04.152261] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-29T17:57:04.278531] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-29T17:57:04.348111] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-09-29T17:57:05.148147] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-09-29T17:57:05.655763] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-29T17:57:05.948078] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2024-12. [2025-09-29T17:57:06.307066] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-29T17:57:06.748113] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-09-29T17:57:07.548137] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-09-29T17:57:07.704118] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-29T17:57:07.769178] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-29T17:57:08.348141] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-01. [2025-09-29T17:57:08.544549] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-29T17:57:09.148117] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-09-29T17:57:09.948160] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-09-29T17:57:10.077917] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-29T17:57:10.443578] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-29T17:57:10.748096] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-09-29T17:57:10.896173] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-29T17:57:11.548152] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-09-29T17:57:11.896080] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-29T17:57:12.348106] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-09-29T17:57:12.507636] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-29T17:57:13.148164] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-09-29T17:57:13.680196] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-29T17:57:13.948176] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-09-29T17:57:14.216060] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-29T17:57:14.221360] [INFO ] [REMOTE ] CINT: Full fetch complete (26301 records). [2025-09-29T17:57:14.221441] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-09-29T17:57:14.611336] [DEBUG] [VALIDATOR ] CINT: All expected trading days are present. [2025-09-29T17:57:14.611421] [DEBUG] [VALIDATOR ] CINT: Primary data validation passed. [2025-09-29T17:57:14.611944] [INFO ] [MAIN ] CINT: Fetched primary data is valid. [2025-09-29T17:57:14.612022] [DEBUG] [LOCAL ] CINT: Saving primary data. [2025-09-29T17:57:14.612767] [DEBUG] [LOCAL ] CINT: Trimmed 26301 records to 18619 (keeping 200 days of data) [2025-09-29T17:57:14.717739] [DEBUG] [LOCAL ] CINT: Primary data saved (18619 records). [2025-09-29T17:57:14.717893] [INFO ] [MAIN ] CINT: Full history saved. [2025-09-29T17:57:14.717979] [INFO ] [MAIN ] Update Progress: 456/2371 symbols completed. CINT took 35.0s. Estimated remaining: 4h 0m 12s. Rate: 8.0 symbols/min [2025-09-29T17:57:14.754996] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-09-29T17:57:14.909769] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:57:14.962008] [DEBUG] [LOCAL ] CL: Loaded 54424 existing records from primary storage. [2025-09-29T17:57:14.962373] [INFO ] [MAIN ] CL: Loaded 54424 existing records. [2025-09-29T17:57:15.151318] [WARN ] [MAIN ] CL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:57:15.151543] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-09-29T17:57:15.151591] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-09-29T17:57:15.152171] [DEBUG] [LOCAL ] CL: Deleted primary data file. [2025-09-29T17:57:15.152234] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-09-29T17:57:15.543781] [INFO ] [REMOTE ] CL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:57:15.548062] [INFO ] [REMOTE ] CL: Fetching primary data for 2024-12. [2025-09-29T17:57:15.652217] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-29T17:57:15.698598] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-29T17:57:16.348141] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-09-29T17:57:17.148091] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-09-29T17:57:17.489498] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-29T17:57:17.948117] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-01. [2025-09-29T17:57:18.108263] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-29T17:57:18.322279] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-29T17:57:18.748160] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-09-29T17:57:19.548107] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-09-29T17:57:19.820024] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-29T17:57:20.170534] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-29T17:57:20.348130] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-09-29T17:57:20.504875] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-29T17:57:21.148116] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-09-29T17:57:21.948123] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-09-29T17:57:22.039430] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-29T17:57:22.340844] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-29T17:57:22.748118] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-09-29T17:57:23.477470] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-29T17:57:23.483602] [INFO ] [REMOTE ] CION: Full fetch complete (41175 records). [2025-09-29T17:57:23.483802] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-09-29T17:57:23.553268] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-09-29T17:57:23.880888] [DEBUG] [VALIDATOR ] CION: All expected trading days are present. [2025-09-29T17:57:23.881029] [DEBUG] [VALIDATOR ] CION: Primary data validation passed. [2025-09-29T17:57:23.881754] [INFO ] [MAIN ] CION: Fetched primary data is valid. [2025-09-29T17:57:23.881820] [DEBUG] [LOCAL ] CION: Saving primary data. [2025-09-29T17:57:23.883211] [DEBUG] [LOCAL ] CION: Trimmed 41175 records to 29154 (keeping 200 days of data) [2025-09-29T17:57:24.064776] [DEBUG] [LOCAL ] CION: Primary data saved (29154 records). [2025-09-29T17:57:24.064919] [INFO ] [MAIN ] CION: Full history saved. [2025-09-29T17:57:24.065005] [INFO ] [MAIN ] Update Progress: 457/2371 symbols completed. CION took 29.4s. Estimated remaining: 4h 0m 12s. Rate: 8.0 symbols/min [2025-09-29T17:57:24.261672] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:57:24.299702] [DEBUG] [LOCAL ] CLB: Loaded 33475 existing records from primary storage. [2025-09-29T17:57:24.300031] [INFO ] [MAIN ] CLB: Loaded 33475 existing records. [2025-09-29T17:57:24.351124] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-09-29T17:57:24.548627] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-29T17:57:24.583225] [WARN ] [MAIN ] CLB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:57:24.583945] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-09-29T17:57:24.584009] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-09-29T17:57:24.584338] [DEBUG] [LOCAL ] CLB: Deleted primary data file. [2025-09-29T17:57:24.584404] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-09-29T17:57:24.931133] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-29T17:57:24.972619] [INFO ] [REMOTE ] CIO: Full fetch complete (28938 records). [2025-09-29T17:57:24.973995] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-09-29T17:57:25.002924] [INFO ] [REMOTE ] CLB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:57:25.153266] [INFO ] [REMOTE ] CLB: Fetching primary data for 2024-12. [2025-09-29T17:57:25.388730] [DEBUG] [VALIDATOR ] CIO: All expected trading days are present. [2025-09-29T17:57:25.388820] [DEBUG] [VALIDATOR ] CIO: Primary data validation passed. [2025-09-29T17:57:25.389293] [INFO ] [MAIN ] CIO: Fetched primary data is valid. [2025-09-29T17:57:25.389333] [DEBUG] [LOCAL ] CIO: Saving primary data. [2025-09-29T17:57:25.390156] [DEBUG] [LOCAL ] CIO: Trimmed 28938 records to 20139 (keeping 200 days of data) [2025-09-29T17:57:25.511866] [DEBUG] [LOCAL ] CIO: Primary data saved (20139 records). [2025-09-29T17:57:25.512000] [INFO ] [MAIN ] CIO: Full history saved. [2025-09-29T17:57:25.512078] [INFO ] [MAIN ] Update Progress: 458/2371 symbols completed. CIO took 35.4s. Estimated remaining: 3h 59m 39s. Rate: 8.0 symbols/min [2025-09-29T17:57:25.712618] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:57:25.731869] [DEBUG] [LOCAL ] CLCO: Loaded 13189 existing records from primary storage. [2025-09-29T17:57:25.732214] [INFO ] [MAIN ] CLCO: Loaded 13189 existing records. [2025-09-29T17:57:25.916468] [WARN ] [MAIN ] CLCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:57:25.916704] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-09-29T17:57:25.916762] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-09-29T17:57:25.917056] [DEBUG] [LOCAL ] CLCO: Deleted primary data file. [2025-09-29T17:57:25.917116] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-09-29T17:57:25.981730] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-09-29T17:57:26.332567] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:57:26.364839] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-29T17:57:26.579999] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-29T17:57:26.748116] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2024-12. [2025-09-29T17:57:27.548098] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-09-29T17:57:27.878273] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-29T17:57:28.003244] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-29T17:57:28.348125] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-09-29T17:57:29.148179] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-01. [2025-09-29T17:57:29.471230] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-29T17:57:29.950179] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-09-29T17:57:29.958709] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-29T17:57:30.398585] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-29T17:57:30.748159] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-09-29T17:57:31.553290] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-01. [2025-09-29T17:57:31.576450] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-29T17:57:32.007832] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-29T17:57:32.348115] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-09-29T17:57:32.535469] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-29T17:57:33.148162] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-09-29T17:57:33.675399] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-29T17:57:33.948111] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-09-29T17:57:34.748113] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-09-29T17:57:34.871919] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-29T17:57:35.548123] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-09-29T17:57:36.215499] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-29T17:57:36.348120] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-09-29T17:57:36.565287] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-29T17:57:37.148125] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-09-29T17:57:37.504684] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-29T17:57:37.948113] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-09-29T17:57:38.102410] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (4.15 seconds). [2025-09-29T17:57:38.104282] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-29T17:57:38.748116] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-09-29T17:57:39.250965] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-29T17:57:39.402435] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-29T17:57:39.548118] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-09-29T17:57:40.348123] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-09-29T17:57:41.148121] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-09-29T17:57:41.834115] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-29T17:57:41.916704] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-09-29T17:57:41.948074] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-09-29T17:57:42.430020] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-29T17:57:42.441626] [INFO ] [REMOTE ] CIVI: Full fetch complete (75607 records). [2025-09-29T17:57:42.441903] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-09-29T17:57:42.753307] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-09-29T17:57:42.875146] [DEBUG] [VALIDATOR ] CIVI: All expected trading days are present. [2025-09-29T17:57:42.875237] [DEBUG] [VALIDATOR ] CIVI: Primary data validation passed. [2025-09-29T17:57:42.876121] [INFO ] [MAIN ] CIVI: Fetched primary data is valid. [2025-09-29T17:57:42.876191] [DEBUG] [LOCAL ] CIVI: Saving primary data. [2025-09-29T17:57:42.878049] [DEBUG] [LOCAL ] CIVI: Trimmed 75607 records to 52585 (keeping 200 days of data) [2025-09-29T17:57:43.217186] [DEBUG] [LOCAL ] CIVI: Primary data saved (52585 records). [2025-09-29T17:57:43.217331] [INFO ] [MAIN ] CIVI: Full history saved. [2025-09-29T17:57:43.217453] [INFO ] [MAIN ] Update Progress: 459/2371 symbols completed. CIVI took 41.8s. Estimated remaining: 4h 0m 14s. Rate: 8.0 symbols/min [2025-09-29T17:57:43.412255] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:57:43.422231] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-29T17:57:43.451360] [DEBUG] [LOCAL ] CLDT: Loaded 26082 existing records from primary storage. [2025-09-29T17:57:43.451693] [INFO ] [MAIN ] CLDT: Loaded 26082 existing records. [2025-09-29T17:57:43.553239] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-09-29T17:57:43.645929] [WARN ] [MAIN ] CLDT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:57:43.646153] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-09-29T17:57:43.646204] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-09-29T17:57:43.646541] [DEBUG] [LOCAL ] CLDT: Deleted primary data file. [2025-09-29T17:57:43.646603] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-09-29T17:57:44.023536] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:57:44.058304] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-29T17:57:44.348124] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2024-12. [2025-09-29T17:57:44.435786] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-29T17:57:45.148165] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-09-29T17:57:45.642613] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-29T17:57:45.948126] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-01. [2025-09-29T17:57:46.588527] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-29T17:57:46.748262] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-09-29T17:57:47.039437] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-29T17:57:47.553688] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-09-29T17:57:47.556985] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-29T17:57:48.348133] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-09-29T17:57:48.869542] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-29T17:57:49.148146] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-09-29T17:57:49.413708] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-29T17:57:49.416741] [INFO ] [REMOTE ] CLCO: Full fetch complete (22908 records). [2025-09-29T17:57:49.416838] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-09-29T17:57:49.835605] [DEBUG] [VALIDATOR ] CLCO: All expected trading days are present. [2025-09-29T17:57:49.835779] [DEBUG] [VALIDATOR ] CLCO: Primary data validation passed. [2025-09-29T17:57:49.836284] [INFO ] [MAIN ] CLCO: Fetched primary data is valid. [2025-09-29T17:57:49.836332] [DEBUG] [LOCAL ] CLCO: Saving primary data. [2025-09-29T17:57:49.837099] [DEBUG] [LOCAL ] CLCO: Trimmed 22908 records to 12684 (keeping 200 days of data) [2025-09-29T17:57:49.920734] [DEBUG] [LOCAL ] CLCO: Primary data saved (12684 records). [2025-09-29T17:57:49.920922] [INFO ] [MAIN ] CLCO: Full history saved. [2025-09-29T17:57:49.921042] [INFO ] [MAIN ] Update Progress: 460/2371 symbols completed. CLCO took 24.4s. Estimated remaining: 4h 0m 3s. Rate: 8.0 symbols/min [2025-09-29T17:57:49.955233] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-09-29T17:57:50.112878] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:57:50.176835] [DEBUG] [LOCAL ] CLF: Loaded 54521 existing records from primary storage. [2025-09-29T17:57:50.177218] [INFO ] [MAIN ] CLF: Loaded 54521 existing records. [2025-09-29T17:57:50.373352] [WARN ] [MAIN ] CLF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:57:50.373629] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-09-29T17:57:50.373735] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-09-29T17:57:50.374136] [DEBUG] [LOCAL ] CLF: Deleted primary data file. [2025-09-29T17:57:50.374197] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-09-29T17:57:50.753274] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-09-29T17:57:50.788107] [INFO ] [REMOTE ] CLF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:57:50.970103] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-29T17:57:51.216492] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-29T17:57:51.227763] [INFO ] [REMOTE ] CL: Full fetch complete (77617 records). [2025-09-29T17:57:51.227938] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-09-29T17:57:51.548260] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-09-29T17:57:51.653055] [DEBUG] [VALIDATOR ] CL: All expected trading days are present. [2025-09-29T17:57:51.653150] [DEBUG] [VALIDATOR ] CL: Primary data validation passed. [2025-09-29T17:57:51.654037] [INFO ] [MAIN ] CL: Fetched primary data is valid. [2025-09-29T17:57:51.654107] [DEBUG] [LOCAL ] CL: Saving primary data. [2025-09-29T17:57:51.655710] [DEBUG] [LOCAL ] CL: Trimmed 77617 records to 53644 (keeping 200 days of data) [2025-09-29T17:57:51.929862] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-29T17:57:51.943000] [INFO ] [REMOTE ] CLB: Full fetch complete (46556 records). [2025-09-29T17:57:51.951761] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-09-29T17:57:52.351038] [INFO ] [REMOTE ] CLF: Fetching primary data for 2024-12. [2025-09-29T17:57:52.482022] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present. [2025-09-29T17:57:52.482769] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed. [2025-09-29T17:57:52.483892] [INFO ] [MAIN ] CLB: Fetched primary data is valid. [2025-09-29T17:57:52.484544] [DEBUG] [LOCAL ] CLB: Saving primary data. [2025-09-29T17:57:52.492717] [DEBUG] [LOCAL ] CL: Primary data saved (53644 records). [2025-09-29T17:57:52.493136] [INFO ] [MAIN ] CL: Full history saved. [2025-09-29T17:57:52.493277] [INFO ] [MAIN ] Update Progress: 461/2371 symbols completed. CL took 37.8s. Estimated remaining: 3h 59m 35s. Rate: 8.0 symbols/min [2025-09-29T17:57:52.493414] [DEBUG] [LOCAL ] CLB: Trimmed 46556 records to 32878 (keeping 200 days of data) [2025-09-29T17:57:52.788042] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:57:52.912499] [DEBUG] [LOCAL ] CLH: Loaded 28493 existing records from primary storage. [2025-09-29T17:57:52.925358] [DEBUG] [LOCAL ] CLB: Primary data saved (32878 records). [2025-09-29T17:57:52.938808] [INFO ] [MAIN ] CLH: Loaded 28493 existing records. [2025-09-29T17:57:52.939075] [INFO ] [MAIN ] CLB: Full history saved. [2025-09-29T17:57:52.939980] [INFO ] [MAIN ] Update Progress: 462/2371 symbols completed. CLB took 28.9s. Estimated remaining: 3h 58m 58s. Rate: 8.0 symbols/min [2025-09-29T17:57:52.941019] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-29T17:57:53.152250] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-09-29T17:57:53.333062] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:57:53.337333] [WARN ] [MAIN ] CLH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:57:53.337714] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-09-29T17:57:53.338106] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-09-29T17:57:53.338584] [DEBUG] [LOCAL ] CLH: Deleted primary data file. [2025-09-29T17:57:53.338696] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-09-29T17:57:53.452509] [DEBUG] [LOCAL ] CLPR: Loaded 11615 existing records from primary storage. [2025-09-29T17:57:53.473940] [INFO ] [MAIN ] CLPR: Loaded 11615 existing records. [2025-09-29T17:57:53.933467] [WARN ] [MAIN ] CLPR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:57:53.948211] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-09-29T17:57:53.950310] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-09-29T17:57:53.971403] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:57:53.971794] [INFO ] [REMOTE ] CLH: Fetching primary data for 2024-12. [2025-09-29T17:57:53.971839] [DEBUG] [LOCAL ] CLPR: Deleted primary data file. [2025-09-29T17:57:53.971947] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-09-29T17:57:54.359126] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:57:54.432834] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-29T17:57:54.748090] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-01. [2025-09-29T17:57:54.974799] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-29T17:57:55.503411] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-29T17:57:55.548113] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2024-12. [2025-09-29T17:57:56.348103] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-09-29T17:57:56.543811] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-29T17:57:56.545086] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-29T17:57:57.148126] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-09-29T17:57:57.725745] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-29T17:57:57.948120] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-01. [2025-09-29T17:57:58.251183] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-29T17:57:58.749015] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-29T17:57:58.748673] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-09-29T17:57:59.548154] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-09-29T17:58:00.239605] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-29T17:58:00.348146] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-09-29T17:58:00.971062] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-09-29T17:58:01.148123] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-09-29T17:58:01.771450] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-29T17:58:01.925668] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-29T17:58:01.948131] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-09-29T17:58:02.748146] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-09-29T17:58:02.911956] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-29T17:58:03.548114] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-09-29T17:58:04.348120] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-09-29T17:58:04.368319] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-29T17:58:04.680476] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-29T17:58:05.148159] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-09-29T17:58:05.669012] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-29T17:58:05.948097] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-09-29T17:58:05.969758] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-29T17:58:06.748121] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-09-29T17:58:07.548103] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-09-29T17:58:07.859522] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-29T17:58:08.044390] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-29T17:58:08.273308] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-29T17:58:08.348103] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-09-29T17:58:09.148120] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-09-29T17:58:09.317462] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-29T17:58:09.878934] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-29T17:58:09.948150] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-09-29T17:58:10.748153] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-09-29T17:58:11.178454] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-29T17:58:11.441331] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-29T17:58:11.548129] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-09-29T17:58:12.348131] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-09-29T17:58:12.458991] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-29T17:58:13.123279] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-29T17:58:13.125344] [INFO ] [REMOTE ] CLPR: Full fetch complete (17633 records). [2025-09-29T17:58:13.125442] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-09-29T17:58:13.156782] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-09-29T17:58:13.535264] [DEBUG] [VALIDATOR ] CLPR: All expected trading days are present. [2025-09-29T17:58:13.535348] [DEBUG] [VALIDATOR ] CLPR: Primary data validation passed. [2025-09-29T17:58:13.535783] [INFO ] [MAIN ] CLPR: Fetched primary data is valid. [2025-09-29T17:58:13.535847] [DEBUG] [LOCAL ] CLPR: Saving primary data. [2025-09-29T17:58:13.536475] [DEBUG] [LOCAL ] CLPR: Trimmed 17633 records to 11464 (keeping 200 days of data) [2025-09-29T17:58:13.620735] [DEBUG] [LOCAL ] CLPR: Primary data saved (11464 records). [2025-09-29T17:58:13.620906] [INFO ] [MAIN ] CLPR: Full history saved. [2025-09-29T17:58:13.621068] [INFO ] [MAIN ] Update Progress: 463/2371 symbols completed. CLPR took 20.7s. Estimated remaining: 3h 59m 45s. Rate: 8.0 symbols/min [2025-09-29T17:58:13.799273] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:58:13.869132] [DEBUG] [LOCAL ] CLS: Loaded 54412 existing records from primary storage. [2025-09-29T17:58:13.869543] [INFO ] [MAIN ] CLS: Loaded 54412 existing records. [2025-09-29T17:58:13.956451] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-09-29T17:58:14.070606] [WARN ] [MAIN ] CLS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:58:14.070860] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-09-29T17:58:14.071027] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-09-29T17:58:14.071368] [DEBUG] [LOCAL ] CLS: Deleted primary data file. [2025-09-29T17:58:14.071426] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-09-29T17:58:14.472878] [INFO ] [REMOTE ] CLS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:58:14.748150] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-09-29T17:58:15.181220] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-29T17:58:15.533054] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-09-29T17:58:15.548060] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-09-29T17:58:15.850035] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-29T17:58:15.855310] [INFO ] [REMOTE ] CLDT: Full fetch complete (37007 records). [2025-09-29T17:58:15.855441] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-09-29T17:58:16.270985] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-09-29T17:58:16.271067] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-09-29T17:58:16.271688] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-09-29T17:58:16.271818] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-09-29T17:58:16.272828] [DEBUG] [LOCAL ] CLDT: Trimmed 37007 records to 25475 (keeping 200 days of data) [2025-09-29T17:58:16.366286] [INFO ] [REMOTE ] CLS: Fetching primary data for 2024-12. [2025-09-29T17:58:16.456820] [DEBUG] [LOCAL ] CLDT: Primary data saved (25475 records). [2025-09-29T17:58:16.457013] [INFO ] [MAIN ] CLDT: Full history saved. [2025-09-29T17:58:16.457146] [INFO ] [MAIN ] Update Progress: 464/2371 symbols completed. CLDT took 33.2s. Estimated remaining: 3h 59m 18s. Rate: 8.0 symbols/min [2025-09-29T17:58:16.646694] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:58:16.707962] [DEBUG] [LOCAL ] CLVT: Loaded 52713 existing records from primary storage. [2025-09-29T17:58:16.708313] [INFO ] [MAIN ] CLVT: Loaded 52713 existing records. [2025-09-29T17:58:16.901015] [WARN ] [MAIN ] CLVT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:58:16.901216] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-09-29T17:58:16.901264] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-09-29T17:58:16.901804] [DEBUG] [LOCAL ] CLVT: Deleted primary data file. [2025-09-29T17:58:16.901901] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-09-29T17:58:17.163371] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-09-29T17:58:17.289216] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:58:17.628704] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-29T17:58:17.948167] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2024-12. [2025-09-29T17:58:18.499036] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-29T17:58:18.575086] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-29T17:58:18.748134] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-09-29T17:58:19.548124] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-09-29T17:58:19.695883] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-29T17:58:20.348125] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-01. [2025-09-29T17:58:20.814755] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-29T17:58:21.148166] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-09-29T17:58:21.690425] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-29T17:58:21.846130] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-09-29T17:58:21.955961] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-09-29T17:58:21.976248] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-29T17:58:22.748168] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-09-29T17:58:23.260271] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-29T17:58:23.548136] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-09-29T17:58:24.348142] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-09-29T17:58:24.710453] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-29T17:58:24.791721] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-29T17:58:25.148180] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-09-29T17:58:25.948161] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-09-29T17:58:26.142173] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-29T17:58:26.748119] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-09-29T17:58:27.153901] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-29T17:58:27.548104] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-09-29T17:58:27.655000] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-29T17:58:28.348110] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-09-29T17:58:28.693469] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-29T17:58:28.707764] [INFO ] [REMOTE ] CLF: Full fetch complete (77809 records). [2025-09-29T17:58:28.708129] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-09-29T17:58:29.131065] [DEBUG] [VALIDATOR ] CLF: All expected trading days are present. [2025-09-29T17:58:29.131172] [DEBUG] [VALIDATOR ] CLF: Primary data validation passed. [2025-09-29T17:58:29.132099] [INFO ] [MAIN ] CLF: Fetched primary data is valid. [2025-09-29T17:58:29.132173] [DEBUG] [LOCAL ] CLF: Saving primary data. [2025-09-29T17:58:29.133823] [DEBUG] [LOCAL ] CLF: Trimmed 77809 records to 53741 (keeping 200 days of data) [2025-09-29T17:58:29.189218] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-09-29T17:58:29.479346] [DEBUG] [LOCAL ] CLF: Primary data saved (53741 records). [2025-09-29T17:58:29.479508] [INFO ] [MAIN ] CLF: Full history saved. [2025-09-29T17:58:29.479601] [INFO ] [MAIN ] Update Progress: 465/2371 symbols completed. CLF took 39.6s. Estimated remaining: 3h 59m 33s. Rate: 8.0 symbols/min [2025-09-29T17:58:29.659056] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:58:29.685898] [DEBUG] [LOCAL ] CLW: Loaded 22226 existing records from primary storage. [2025-09-29T17:58:29.686217] [INFO ] [MAIN ] CLW: Loaded 22226 existing records. [2025-09-29T17:58:29.878194] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:58:29.878615] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-09-29T17:58:29.878819] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-09-29T17:58:29.879392] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-09-29T17:58:29.879460] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-09-29T17:58:30.220039] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-09-29T17:58:30.253548] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-29T17:58:30.287076] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-09-29T17:58:30.379127] [INFO ] [REMOTE ] CLW: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:58:30.398239] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-29T17:58:30.403926] [INFO ] [REMOTE ] CLH: Full fetch complete (41839 records). [2025-09-29T17:58:30.404018] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-09-29T17:58:30.752968] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-09-29T17:58:30.848455] [DEBUG] [VALIDATOR ] CLH: All expected trading days are present. [2025-09-29T17:58:30.848542] [DEBUG] [VALIDATOR ] CLH: Primary data validation passed. [2025-09-29T17:58:30.849244] [INFO ] [MAIN ] CLH: Fetched primary data is valid. [2025-09-29T17:58:30.849319] [DEBUG] [LOCAL ] CLH: Saving primary data. [2025-09-29T17:58:30.850422] [DEBUG] [LOCAL ] CLH: Trimmed 41839 records to 27795 (keeping 200 days of data) [2025-09-29T17:58:31.047082] [DEBUG] [LOCAL ] CLH: Primary data saved (27795 records). [2025-09-29T17:58:31.047223] [INFO ] [MAIN ] CLH: Full history saved. [2025-09-29T17:58:31.047326] [INFO ] [MAIN ] Update Progress: 466/2371 symbols completed. CLH took 38.6s. Estimated remaining: 3h 59m 1s. Rate: 8.0 symbols/min [2025-09-29T17:58:31.236969] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:58:31.308846] [DEBUG] [LOCAL ] CLX: Loaded 52189 existing records from primary storage. [2025-09-29T17:58:31.309236] [INFO ] [MAIN ] CLX: Loaded 52189 existing records. [2025-09-29T17:58:31.505762] [WARN ] [MAIN ] CLX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:58:31.505993] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-09-29T17:58:31.506092] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-09-29T17:58:31.506798] [DEBUG] [LOCAL ] CLX: Deleted primary data file. [2025-09-29T17:58:31.506859] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-09-29T17:58:31.571308] [INFO ] [REMOTE ] CLW: Fetching primary data for 2024-12. [2025-09-29T17:58:31.897005] [INFO ] [REMOTE ] CLX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:58:32.348085] [INFO ] [REMOTE ] CLX: Fetching primary data for 2024-12. [2025-09-29T17:58:32.468173] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-29T17:58:32.514467] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-29T17:58:32.670204] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-29T17:58:33.148131] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-09-29T17:58:33.849752] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-29T17:58:33.948113] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-01. [2025-09-29T17:58:34.748129] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-01. [2025-09-29T17:58:35.220796] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-29T17:58:35.343913] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-29T17:58:35.548119] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-09-29T17:58:36.034152] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-29T17:58:36.348151] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-09-29T17:58:36.705745] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-29T17:58:37.148121] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-09-29T17:58:37.948110] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-09-29T17:58:38.533015] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-29T17:58:38.597587] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-29T17:58:38.748078] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-09-29T17:58:39.128288] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-29T17:58:39.548130] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-09-29T17:58:40.348119] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-09-29T17:58:41.153264] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-09-29T17:58:41.173466] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-09-29T17:58:41.251675] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-29T17:58:41.909390] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-29T17:58:41.948076] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-09-29T17:58:42.407907] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-29T17:58:42.748126] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-09-29T17:58:43.548119] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-09-29T17:58:43.685098] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-29T17:58:43.993714] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-29T17:58:44.348140] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-09-29T17:58:45.148141] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-09-29T17:58:45.948168] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-09-29T17:58:46.156833] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (2.61 seconds). [2025-09-29T17:58:46.180082] [INFO ] [REMOTE ] CLS: Full fetch complete (77449 records). [2025-09-29T17:58:46.181165] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-29T17:58:46.186490] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-09-29T17:58:46.570083] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-29T17:58:46.666990] [DEBUG] [VALIDATOR ] CLS: All expected trading days are present. [2025-09-29T17:58:46.667097] [DEBUG] [VALIDATOR ] CLS: Primary data validation passed. [2025-09-29T17:58:46.668104] [INFO ] [MAIN ] CLS: Fetched primary data is valid. [2025-09-29T17:58:46.668183] [DEBUG] [LOCAL ] CLS: Saving primary data. [2025-09-29T17:58:46.669867] [DEBUG] [LOCAL ] CLS: Trimmed 77449 records to 53629 (keeping 200 days of data) [2025-09-29T17:58:46.769236] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-09-29T17:58:47.018931] [DEBUG] [LOCAL ] CLS: Primary data saved (53629 records). [2025-09-29T17:58:47.019092] [INFO ] [MAIN ] CLS: Full history saved. [2025-09-29T17:58:47.019209] [INFO ] [MAIN ] Update Progress: 467/2371 symbols completed. CLS took 33.4s. Estimated remaining: 3h 59m 28s. Rate: 8.0 symbols/min [2025-09-29T17:58:47.202638] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:58:47.256818] [DEBUG] [LOCAL ] CM: Loaded 49317 existing records from primary storage. [2025-09-29T17:58:47.257179] [INFO ] [MAIN ] CM: Loaded 49317 existing records. [2025-09-29T17:58:47.457263] [WARN ] [MAIN ] CM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:58:47.457800] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-09-29T17:58:47.458074] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-09-29T17:58:47.459167] [DEBUG] [LOCAL ] CM: Deleted primary data file. [2025-09-29T17:58:47.459252] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-09-29T17:58:47.556846] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-09-29T17:58:47.896197] [INFO ] [REMOTE ] CM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:58:47.899426] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-29T17:58:47.926574] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-29T17:58:48.348121] [INFO ] [REMOTE ] CM: Fetching primary data for 2024-12. [2025-09-29T17:58:49.148102] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-09-29T17:58:49.481902] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-29T17:58:49.948095] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-09-29T17:58:50.032138] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-29T17:58:50.748117] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-09-29T17:58:51.548146] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-01. [2025-09-29T17:58:52.768145] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-29T17:58:52.778373] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-09-29T17:58:54.414877] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-29T17:58:54.424796] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-09-29T17:58:55.805813] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-29T17:58:55.817565] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-09-29T17:58:56.390377] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (7.24 seconds). [2025-09-29T17:58:56.395873] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-09-29T17:58:57.255554] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-29T17:58:57.266498] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-09-29T17:58:57.732729] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-29T17:58:57.738019] [INFO ] [REMOTE ] CLW: Full fetch complete (35228 records). [2025-09-29T17:58:57.738107] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-09-29T17:58:58.147035] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present. [2025-09-29T17:58:58.147164] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed. [2025-09-29T17:58:58.147868] [INFO ] [MAIN ] CLW: Fetched primary data is valid. [2025-09-29T17:58:58.147946] [DEBUG] [LOCAL ] CLW: Saving primary data. [2025-09-29T17:58:58.148964] [DEBUG] [LOCAL ] CLW: Trimmed 35228 records to 21833 (keeping 200 days of data) [2025-09-29T17:58:58.281485] [DEBUG] [LOCAL ] CLW: Primary data saved (21833 records). [2025-09-29T17:58:58.281619] [INFO ] [MAIN ] CLW: Full history saved. [2025-09-29T17:58:58.281735] [INFO ] [MAIN ] Update Progress: 468/2371 symbols completed. CLW took 28.8s. Estimated remaining: 3h 59m 36s. Rate: 7.9 symbols/min [2025-09-29T17:58:58.466595] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:58:58.519130] [DEBUG] [LOCAL ] CMA: Loaded 50721 existing records from primary storage. [2025-09-29T17:58:58.519475] [INFO ] [MAIN ] CMA: Loaded 50721 existing records. [2025-09-29T17:58:58.731691] [WARN ] [MAIN ] CMA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:58:58.732782] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-09-29T17:58:58.733128] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-09-29T17:58:58.733735] [DEBUG] [LOCAL ] CMA: Deleted primary data file. [2025-09-29T17:58:58.733832] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-09-29T17:58:58.893346] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (8.15 seconds). [2025-09-29T17:58:59.003943] [INFO ] [REMOTE ] CLVT: Full fetch complete (75231 records). [2025-09-29T17:58:59.029581] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-09-29T17:58:59.322053] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:58:59.373592] [INFO ] [REMOTE ] CMA: Fetching primary data for 2024-12. [2025-09-29T17:58:59.402309] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-29T17:58:59.477036] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-09-29T17:58:59.668678] [DEBUG] [VALIDATOR ] CLVT: All expected trading days are present. [2025-09-29T17:58:59.668804] [DEBUG] [VALIDATOR ] CLVT: Primary data validation passed. [2025-09-29T17:58:59.669692] [INFO ] [MAIN ] CLVT: Fetched primary data is valid. [2025-09-29T17:58:59.669760] [DEBUG] [LOCAL ] CLVT: Saving primary data. [2025-09-29T17:58:59.671290] [DEBUG] [LOCAL ] CLVT: Trimmed 75231 records to 51942 (keeping 200 days of data) [2025-09-29T17:58:59.929959] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (9.98 seconds). [2025-09-29T17:58:59.946848] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-09-29T17:59:00.038795] [DEBUG] [LOCAL ] CLVT: Primary data saved (51942 records). [2025-09-29T17:59:00.039040] [INFO ] [MAIN ] CLVT: Full history saved. [2025-09-29T17:59:00.039179] [INFO ] [MAIN ] Update Progress: 469/2371 symbols completed. CLVT took 43.6s. Estimated remaining: 3h 59m 5s. Rate: 8.0 symbols/min [2025-09-29T17:59:00.226687] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:59:00.250260] [DEBUG] [LOCAL ] CMBT: Loaded 22911 existing records from primary storage. [2025-09-29T17:59:00.250543] [INFO ] [MAIN ] CMBT: Loaded 22911 existing records. [2025-09-29T17:59:00.441876] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:59:00.442091] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-09-29T17:59:00.442142] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-09-29T17:59:00.442419] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-09-29T17:59:00.442479] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-09-29T17:59:00.851056] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:59:00.852321] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2024-12. [2025-09-29T17:59:01.026062] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-29T17:59:01.037344] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-09-29T17:59:01.095027] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-29T17:59:01.105632] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-09-29T17:59:01.781181] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-29T17:59:01.786136] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-01. [2025-09-29T17:59:01.823812] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-29T17:59:01.948161] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-09-29T17:59:02.550101] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-29T17:59:02.579011] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-29T17:59:02.748086] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-09-29T17:59:02.829152] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-29T17:59:03.548075] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-09-29T17:59:03.720315] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-29T17:59:03.731332] [INFO ] [REMOTE ] CLX: Full fetch complete (73005 records). [2025-09-29T17:59:03.731537] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-09-29T17:59:04.137580] [DEBUG] [VALIDATOR ] CLX: All expected trading days are present. [2025-09-29T17:59:04.137711] [DEBUG] [VALIDATOR ] CLX: Primary data validation passed. [2025-09-29T17:59:04.138639] [INFO ] [MAIN ] CLX: Fetched primary data is valid. [2025-09-29T17:59:04.138778] [DEBUG] [LOCAL ] CLX: Saving primary data. [2025-09-29T17:59:04.140403] [DEBUG] [LOCAL ] CLX: Trimmed 73005 records to 51455 (keeping 200 days of data) [2025-09-29T17:59:04.263497] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-29T17:59:04.370455] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-09-29T17:59:04.509097] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-29T17:59:04.533309] [DEBUG] [LOCAL ] CLX: Primary data saved (51455 records). [2025-09-29T17:59:04.533462] [INFO ] [MAIN ] CLX: Full history saved. [2025-09-29T17:59:04.533564] [INFO ] [MAIN ] Update Progress: 470/2371 symbols completed. CLX took 33.5s. Estimated remaining: 3h 58m 45s. Rate: 8.0 symbols/min [2025-09-29T17:59:04.709937] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:59:04.754825] [DEBUG] [LOCAL ] CMC: Loaded 46311 existing records from primary storage. [2025-09-29T17:59:04.755157] [INFO ] [MAIN ] CMC: Loaded 46311 existing records. [2025-09-29T17:59:04.951553] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:59:04.951848] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-09-29T17:59:04.951905] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-09-29T17:59:04.952326] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-09-29T17:59:04.952388] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-09-29T17:59:05.153403] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-09-29T17:59:05.337969] [INFO ] [REMOTE ] CMC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:59:05.948166] [INFO ] [REMOTE ] CMC: Fetching primary data for 2024-12. [2025-09-29T17:59:06.079413] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-29T17:59:06.089897] [INFO ] [REMOTE ] CM: Full fetch complete (69362 records). [2025-09-29T17:59:06.090095] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-09-29T17:59:06.419232] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-29T17:59:06.545405] [DEBUG] [VALIDATOR ] CM: All expected trading days are present. [2025-09-29T17:59:06.545494] [DEBUG] [VALIDATOR ] CM: Primary data validation passed. [2025-09-29T17:59:06.546382] [INFO ] [MAIN ] CM: Fetched primary data is valid. [2025-09-29T17:59:06.546449] [DEBUG] [LOCAL ] CM: Saving primary data. [2025-09-29T17:59:06.547951] [DEBUG] [LOCAL ] CM: Trimmed 69362 records to 48571 (keeping 200 days of data) [2025-09-29T17:59:06.769360] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-09-29T17:59:06.864054] [DEBUG] [LOCAL ] CM: Primary data saved (48571 records). [2025-09-29T17:59:06.864201] [INFO ] [MAIN ] CM: Full history saved. [2025-09-29T17:59:06.864301] [INFO ] [MAIN ] Update Progress: 471/2371 symbols completed. CM took 19.8s. Estimated remaining: 3h 58m 16s. Rate: 8.0 symbols/min [2025-09-29T17:59:07.049568] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:59:07.057704] [DEBUG] [LOCAL ] CMCM: Loaded 4834 existing records from primary storage. [2025-09-29T17:59:07.058110] [INFO ] [MAIN ] CMCM: Loaded 4834 existing records. [2025-09-29T17:59:07.265680] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:59:07.265921] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-09-29T17:59:07.265972] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-09-29T17:59:07.266251] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-09-29T17:59:07.266311] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-09-29T17:59:07.556790] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-09-29T17:59:07.658036] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:59:07.695673] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-29T17:59:07.869284] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-29T17:59:08.348133] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-09-29T17:59:09.000792] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-29T17:59:09.148119] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-09-29T17:59:09.438075] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-29T17:59:09.948151] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-09-29T17:59:10.748146] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2024-12. [2025-09-29T17:59:10.924985] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-29T17:59:10.971128] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-29T17:59:11.472245] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-29T17:59:11.548140] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-01. [2025-09-29T17:59:12.348136] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-01. [2025-09-29T17:59:12.851098] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-29T17:59:13.024687] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-29T17:59:13.148116] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-09-29T17:59:13.948122] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-09-29T17:59:14.645120] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-29T17:59:14.748148] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-09-29T17:59:14.868945] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-29T17:59:15.548155] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-09-29T17:59:16.348098] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-09-29T17:59:16.463995] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-29T17:59:17.148128] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-09-29T17:59:17.477828] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-29T17:59:17.627353] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-29T17:59:17.644672] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-29T17:59:17.948104] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-09-29T17:59:18.748115] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-09-29T17:59:19.548091] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-09-29T17:59:19.651257] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-29T17:59:20.071562] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-29T17:59:20.348087] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-09-29T17:59:20.603315] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-29T17:59:21.148132] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-09-29T17:59:21.949240] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-09-29T17:59:21.949492] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-29T17:59:21.994822] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-29T17:59:22.748114] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-09-29T17:59:23.208906] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-29T17:59:23.548115] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-09-29T17:59:23.579750] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-29T17:59:24.125678] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-29T17:59:24.348126] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-09-29T17:59:25.148168] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-09-29T17:59:25.679851] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-29T17:59:25.953254] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-09-29T17:59:25.968970] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-29T17:59:26.748124] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-09-29T17:59:27.548086] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-09-29T17:59:27.629468] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-29T17:59:28.339194] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-29T17:59:28.349080] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-09-29T17:59:28.768810] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-29T17:59:29.148084] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-09-29T17:59:29.271352] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-29T17:59:29.282076] [INFO ] [REMOTE ] CMBT: Full fetch complete (29921 records). [2025-09-29T17:59:29.282196] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-09-29T17:59:29.686940] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-09-29T17:59:29.687091] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-09-29T17:59:29.687810] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-09-29T17:59:29.687895] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-09-29T17:59:29.689139] [DEBUG] [LOCAL ] CMBT: Trimmed 29921 records to 22930 (keeping 200 days of data) [2025-09-29T17:59:29.828500] [DEBUG] [LOCAL ] CMBT: Primary data saved (22930 records). [2025-09-29T17:59:29.828661] [INFO ] [MAIN ] CMBT: Full history saved. [2025-09-29T17:59:29.828769] [INFO ] [MAIN ] Update Progress: 472/2371 symbols completed. CMBT took 29.8s. Estimated remaining: 3h 59m 11s. Rate: 7.9 symbols/min [2025-09-29T17:59:29.953247] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-09-29T17:59:30.006535] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:59:30.006797] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-09-29T17:59:30.006844] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-09-29T17:59:30.006990] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-09-29T17:59:30.007032] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-09-29T17:59:30.007074] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-09-29T17:59:30.007108] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-09-29T17:59:30.383769] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:59:30.591797] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-29T17:59:30.748116] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-09-29T17:59:30.925754] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-29T17:59:30.928336] [INFO ] [REMOTE ] CMCM: Full fetch complete (7028 records). [2025-09-29T17:59:30.928417] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-09-29T17:59:31.313173] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-09-29T17:59:31.313255] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-09-29T17:59:31.313443] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-09-29T17:59:31.313481] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-09-29T17:59:31.313937] [DEBUG] [LOCAL ] CMCM: Trimmed 7028 records to 4758 (keeping 200 days of data) [2025-09-29T17:59:31.343182] [DEBUG] [LOCAL ] CMCM: Primary data saved (4758 records). [2025-09-29T17:59:31.343333] [INFO ] [MAIN ] CMCM: Full history saved. [2025-09-29T17:59:31.343425] [INFO ] [MAIN ] Update Progress: 473/2371 symbols completed. CMCM took 24.5s. Estimated remaining: 3h 58m 39s. Rate: 8.0 symbols/min [2025-09-29T17:59:31.526918] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:59:31.548114] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2024-12. [2025-09-29T17:59:31.608486] [DEBUG] [LOCAL ] CMG: Loaded 54501 existing records from primary storage. [2025-09-29T17:59:31.609112] [INFO ] [MAIN ] CMG: Loaded 54501 existing records. [2025-09-29T17:59:31.776341] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T17:59:31.813373] [WARN ] [REMOTE ] CMDB: No data returned for month 2024-12 [2025-09-29T17:59:31.837907] [WARN ] [MAIN ] CMG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:59:31.838390] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-09-29T17:59:31.838157] [FATAL] [REMOTE ] CMDB: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T17:59:31.838577] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-09-29T17:59:31.838534] [FATAL] [MAIN ] CMDB: Failed to fetch primary data. [2025-09-29T17:59:31.838791] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T17:59:31.838871] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-09-29T17:59:31.838949] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-09-29T17:59:31.839007] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-09-29T17:59:31.839108] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-09-29T17:59:31.839187] [INFO ] [MAIN ] Update Progress: 474/2371 symbols completed. CMDB took 2.0s. Estimated remaining: 3h 58m 3s. Rate: 8.0 symbols/min [2025-09-29T17:59:31.844506] [DEBUG] [LOCAL ] CMG: Deleted primary data file. [2025-09-29T17:59:31.907347] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-09-29T17:59:32.171548] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:59:32.348870] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-09-29T17:59:32.498386] [INFO ] [REMOTE ] CMG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:59:32.502193] [DEBUG] [LOCAL ] CMI: Loaded 42484 existing records from primary storage. [2025-09-29T17:59:32.502723] [INFO ] [MAIN ] CMI: Loaded 42484 existing records. [2025-09-29T17:59:32.715382] [WARN ] [MAIN ] CMI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:59:32.715630] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-09-29T17:59:32.715717] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-09-29T17:59:32.716279] [DEBUG] [LOCAL ] CMI: Deleted primary data file. [2025-09-29T17:59:32.716548] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-09-29T17:59:32.864936] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-29T17:59:32.928280] [INFO ] [REMOTE ] CMA: Full fetch complete (73165 records). [2025-09-29T17:59:32.949694] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-09-29T17:59:33.163804] [INFO ] [REMOTE ] CMG: Fetching primary data for 2024-12. [2025-09-29T17:59:33.636148] [INFO ] [REMOTE ] CMI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:59:33.932683] [DEBUG] [VALIDATOR ] CMA: All expected trading days are present. [2025-09-29T17:59:33.932874] [DEBUG] [VALIDATOR ] CMA: Primary data validation passed. [2025-09-29T17:59:33.933783] [INFO ] [MAIN ] CMA: Fetched primary data is valid. [2025-09-29T17:59:33.933870] [DEBUG] [LOCAL ] CMA: Saving primary data. [2025-09-29T17:59:33.935706] [DEBUG] [LOCAL ] CMA: Trimmed 73165 records to 49918 (keeping 200 days of data) [2025-09-29T17:59:33.992152] [INFO ] [REMOTE ] CMI: Fetching primary data for 2024-12. [2025-09-29T17:59:34.064096] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-29T17:59:34.314841] [DEBUG] [LOCAL ] CMA: Primary data saved (49918 records). [2025-09-29T17:59:34.315037] [INFO ] [MAIN ] CMA: Full history saved. [2025-09-29T17:59:34.315156] [INFO ] [MAIN ] Update Progress: 475/2371 symbols completed. CMA took 36.0s. Estimated remaining: 3h 57m 35s. Rate: 8.0 symbols/min [2025-09-29T17:59:34.493533] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:59:34.530283] [DEBUG] [LOCAL ] CMP: Loaded 36848 existing records from primary storage. [2025-09-29T17:59:34.530612] [INFO ] [MAIN ] CMP: Loaded 36848 existing records. [2025-09-29T17:59:34.713768] [WARN ] [MAIN ] CMP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:59:34.713998] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-09-29T17:59:34.714047] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-09-29T17:59:34.714391] [DEBUG] [LOCAL ] CMP: Deleted primary data file. [2025-09-29T17:59:34.714451] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-09-29T17:59:34.758599] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-09-29T17:59:35.099303] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:59:35.495114] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-09-29T17:59:35.557094] [INFO ] [REMOTE ] CMP: Fetching primary data for 2024-12. [2025-09-29T17:59:35.562738] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-29T17:59:36.133171] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-29T17:59:36.143358] [INFO ] [REMOTE ] CMC: Full fetch complete (67018 records). [2025-09-29T17:59:36.143527] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-09-29T17:59:36.355636] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-01. [2025-09-29T17:59:36.569499] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present. [2025-09-29T17:59:36.569603] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed. [2025-09-29T17:59:36.570535] [INFO ] [MAIN ] CMC: Fetched primary data is valid. [2025-09-29T17:59:36.570608] [DEBUG] [LOCAL ] CMC: Saving primary data. [2025-09-29T17:59:36.572148] [DEBUG] [LOCAL ] CMC: Trimmed 67018 records to 45570 (keeping 200 days of data) [2025-09-29T17:59:36.875057] [DEBUG] [LOCAL ] CMC: Primary data saved (45570 records). [2025-09-29T17:59:36.875241] [INFO ] [MAIN ] CMC: Full history saved. [2025-09-29T17:59:36.875379] [INFO ] [MAIN ] Update Progress: 476/2371 symbols completed. CMC took 32.3s. Estimated remaining: 3h 57m 8s. Rate: 8.0 symbols/min [2025-09-29T17:59:37.062666] [INFO ] [MAIN ] CMPO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T17:59:37.089978] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-29T17:59:37.135239] [DEBUG] [LOCAL ] CMPO: Loaded 40071 existing records from primary storage. [2025-09-29T17:59:37.135603] [INFO ] [MAIN ] CMPO: Loaded 40071 existing records. [2025-09-29T17:59:37.156429] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-01. [2025-09-29T17:59:37.328143] [WARN ] [MAIN ] CMPO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T17:59:37.328367] [INFO ] [MAIN ] CMPO: Wiping existing primary data before full refresh. [2025-09-29T17:59:37.328416] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-09-29T17:59:37.328911] [DEBUG] [LOCAL ] CMPO: Deleted primary data file. [2025-09-29T17:59:37.328978] [INFO ] [MAIN ] CMPO: Starting full primary refresh. [2025-09-29T17:59:37.732625] [INFO ] [REMOTE ] CMPO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T17:59:37.885907] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-29T17:59:37.948180] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-09-29T17:59:38.748235] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-09-29T17:59:39.263446] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-29T17:59:39.319827] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-09-29T17:59:39.548200] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-09-29T17:59:40.247389] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-29T17:59:40.348117] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-09-29T17:59:41.148155] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2024-12. [2025-09-29T17:59:41.654833] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-29T17:59:41.948210] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-09-29T17:59:42.209299] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-29T17:59:42.385323] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-29T17:59:42.748104] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-01. [2025-09-29T17:59:43.425989] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-29T17:59:43.548129] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-09-29T17:59:44.317840] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-29T17:59:44.348084] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-09-29T17:59:45.148144] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-02. [2025-09-29T17:59:45.803360] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-29T17:59:45.831600] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-29T17:59:45.948114] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-09-29T17:59:46.748120] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-09-29T17:59:46.841726] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-29T17:59:47.317514] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-29T17:59:47.548146] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-09-29T17:59:48.348100] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-09-29T17:59:48.446173] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-29T17:59:49.148144] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-03. [2025-09-29T17:59:49.664081] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-29T17:59:49.718493] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-29T17:59:49.948132] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-09-29T17:59:50.496182] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-29T17:59:50.748130] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-09-29T17:59:51.548106] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-09-29T17:59:51.593519] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-29T17:59:52.348110] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-04. [2025-09-29T17:59:52.666622] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-29T17:59:52.996243] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-29T17:59:53.148118] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-09-29T17:59:53.930681] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-29T17:59:53.948084] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-05. [2025-09-29T17:59:54.646722] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-29T17:59:54.748116] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-09-29T17:59:55.033259] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-29T17:59:55.548125] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-09-29T17:59:55.814000] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-29T17:59:56.348158] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-09-29T17:59:56.985566] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-29T17:59:57.148128] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-09-29T17:59:57.517072] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-29T17:59:57.523047] [INFO ] [REMOTE ] CMP: Full fetch complete (52794 records). [2025-09-29T17:59:57.523151] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-09-29T17:59:57.934667] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present. [2025-09-29T17:59:57.934775] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed. [2025-09-29T17:59:57.935520] [INFO ] [MAIN ] CMP: Fetched primary data is valid. [2025-09-29T17:59:57.935590] [DEBUG] [LOCAL ] CMP: Saving primary data. [2025-09-29T17:59:57.936919] [DEBUG] [LOCAL ] CMP: Trimmed 52794 records to 36313 (keeping 200 days of data) [2025-09-29T17:59:57.990240] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-09-29T17:59:58.169574] [DEBUG] [LOCAL ] CMP: Primary data saved (36313 records). [2025-09-29T17:59:58.169750] [INFO ] [MAIN ] CMP: Full history saved. [2025-09-29T17:59:58.169857] [INFO ] [MAIN ] Update Progress: 477/2371 symbols completed. CMP took 23.9s. Estimated remaining: 3h 57m 55s. Rate: 8.0 symbols/min [2025-09-29T17:59:58.748160] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-06. [2025-09-29T17:59:59.320574] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-29T17:59:59.548094] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-09-29T17:59:59.584530] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-29T18:00:00.057164] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-29T18:00:00.348128] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-09-29T18:00:01.148268] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-07. [2025-09-29T18:00:01.692179] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-29T18:00:01.948162] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-09-29T18:00:02.046493] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-29T18:00:02.516157] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-29T18:00:02.748120] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-09-29T18:00:03.548352] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-08. [2025-09-29T18:00:04.279427] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-09-29T18:00:04.348142] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-09-29T18:00:04.634779] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-29T18:00:04.644905] [INFO ] [REMOTE ] CMI: Full fetch complete (59957 records). [2025-09-29T18:00:04.645054] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-09-29T18:00:05.283860] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-09-29T18:00:05.284036] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-09-29T18:00:05.284885] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-09-29T18:00:05.284975] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-09-29T18:00:05.313454] [DEBUG] [LOCAL ] CMI: Trimmed 59957 records to 41746 (keeping 200 days of data) [2025-09-29T18:00:05.314535] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-29T18:00:05.326363] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-09. [2025-09-29T18:00:05.618877] [DEBUG] [LOCAL ] CMI: Primary data saved (41746 records). [2025-09-29T18:00:05.619013] [INFO ] [MAIN ] CMI: Full history saved. [2025-09-29T18:00:05.619133] [INFO ] [MAIN ] Update Progress: 478/2371 symbols completed. CMI took 33.8s. Estimated remaining: 3h 57m 48s. Rate: 8.0 symbols/min [2025-09-29T18:00:06.786092] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-29T18:00:06.795882] [INFO ] [REMOTE ] CMPO: Full fetch complete (58944 records). [2025-09-29T18:00:06.796031] [DEBUG] [VALIDATOR ] CMPO: Validating primary data. [2025-09-29T18:00:07.259140] [DEBUG] [VALIDATOR ] CMPO: All expected trading days are present. [2025-09-29T18:00:07.259295] [DEBUG] [VALIDATOR ] CMPO: Primary data validation passed. [2025-09-29T18:00:07.260080] [INFO ] [MAIN ] CMPO: Fetched primary data is valid. [2025-09-29T18:00:07.260163] [DEBUG] [LOCAL ] CMPO: Saving primary data. [2025-09-29T18:00:07.263308] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (2.92 seconds). [2025-09-29T18:00:07.274685] [DEBUG] [LOCAL ] CMPO: Trimmed 58944 records to 39383 (keeping 200 days of data) [2025-09-29T18:00:07.275564] [INFO ] [REMOTE ] CMG: Full fetch complete (77795 records). [2025-09-29T18:00:07.275717] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-09-29T18:00:07.829478] [DEBUG] [VALIDATOR ] CMG: All expected trading days are present. [2025-09-29T18:00:07.829900] [DEBUG] [VALIDATOR ] CMG: Primary data validation passed. [2025-09-29T18:00:07.831554] [INFO ] [MAIN ] CMG: Fetched primary data is valid. [2025-09-29T18:00:07.831685] [DEBUG] [LOCAL ] CMG: Saving primary data. [2025-09-29T18:00:07.835936] [DEBUG] [LOCAL ] CMG: Trimmed 77795 records to 53721 (keeping 200 days of data) [2025-09-29T18:00:08.171249] [DEBUG] [LOCAL ] CMPO: Primary data saved (39383 records). [2025-09-29T18:00:08.171715] [INFO ] [MAIN ] CMPO: Full history saved. [2025-09-29T18:00:08.172130] [INFO ] [MAIN ] Update Progress: 479/2371 symbols completed. CMPO took 31.3s. Estimated remaining: 3h 57m 20s. Rate: 8.0 symbols/min [2025-09-29T18:00:08.297738] [DEBUG] [LOCAL ] CMG: Primary data saved (53721 records). [2025-09-29T18:00:08.297904] [INFO ] [MAIN ] CMG: Full history saved. [2025-09-29T18:00:08.298014] [INFO ] [MAIN ] Update Progress: 480/2371 symbols completed. CMG took 37.0s. Estimated remaining: 3h 56m 44s. Rate: 8.0 symbols/min [2025-09-29T18:00:08.954336] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:00:09.091469] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:00:09.113544] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:00:09.116318] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:00:09.123368] [DEBUG] [LOCAL ] CMSC: Loaded 5131 existing records from primary storage. [2025-09-29T18:00:09.124014] [INFO ] [MAIN ] CMSC: Loaded 5131 existing records. [2025-09-29T18:00:09.168078] [DEBUG] [LOCAL ] CMSA: Loaded 3421 existing records from primary storage. [2025-09-29T18:00:09.207743] [INFO ] [MAIN ] CMSA: Loaded 3421 existing records. [2025-09-29T18:00:09.588723] [WARN ] [MAIN ] CMSA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:00:09.517190] [DEBUG] [LOCAL ] CMRE: Loaded 36068 existing records from primary storage. [2025-09-29T18:00:09.592515] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:00:09.593315] [INFO ] [MAIN ] CMRE: Loaded 36068 existing records. [2025-09-29T18:00:09.599415] [DEBUG] [LOCAL ] CMS: Loaded 53371 existing records from primary storage. [2025-09-29T18:00:09.592861] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-09-29T18:00:09.599676] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-09-29T18:00:09.605855] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-09-29T18:00:09.625287] [INFO ] [MAIN ] CMS: Loaded 53371 existing records. [2025-09-29T18:00:09.625463] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-09-29T18:00:09.630747] [DEBUG] [LOCAL ] CMSA: Deleted primary data file. [2025-09-29T18:00:09.664503] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-09-29T18:00:09.690186] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-09-29T18:00:09.716204] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-09-29T18:00:10.208770] [WARN ] [MAIN ] CMRE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:00:10.242281] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-09-29T18:00:10.276891] [WARN ] [MAIN ] CMS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:00:10.265932] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-09-29T18:00:10.316944] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-09-29T18:00:10.322240] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-09-29T18:00:10.369017] [DEBUG] [LOCAL ] CMRE: Deleted primary data file. [2025-09-29T18:00:10.389200] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-09-29T18:00:10.394981] [DEBUG] [LOCAL ] CMS: Deleted primary data file. [2025-09-29T18:00:10.405317] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-09-29T18:00:11.265697] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:00:11.335228] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2024-12. [2025-09-29T18:00:11.342280] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:00:11.354344] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2024-12. [2025-09-29T18:00:11.520876] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:00:11.526778] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2024-12. [2025-09-29T18:00:11.602373] [INFO ] [REMOTE ] CMS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:00:11.602689] [INFO ] [REMOTE ] CMS: Fetching primary data for 2024-12. [2025-09-29T18:00:12.248541] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-29T18:00:12.250434] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-01. [2025-09-29T18:00:12.615869] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-29T18:00:12.621683] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-09-29T18:00:12.847029] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-29T18:00:12.849015] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-09-29T18:00:13.462596] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-29T18:00:13.464395] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-09-29T18:00:13.467757] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-29T18:00:13.480717] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-01. [2025-09-29T18:00:13.577131] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-29T18:00:13.587362] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-09-29T18:00:13.803969] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-09-29T18:00:13.948121] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-01. [2025-09-29T18:00:14.037329] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-29T18:00:14.524800] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-29T18:00:14.748172] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-09-29T18:00:14.872832] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-29T18:00:15.152760] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-29T18:00:15.207987] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-29T18:00:15.548158] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-09-29T18:00:16.019341] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-29T18:00:16.348129] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-09-29T18:00:17.148114] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-09-29T18:00:17.694942] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-29T18:00:17.948113] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-09-29T18:00:18.597733] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-29T18:00:18.748119] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-09-29T18:00:19.463984] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-29T18:00:19.548146] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-09-29T18:00:20.348115] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-09-29T18:00:20.571462] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-29T18:00:20.869317] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-29T18:00:20.898565] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-29T18:00:21.148121] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-09-29T18:00:21.948146] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-09-29T18:00:22.748120] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-09-29T18:00:22.912205] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-29T18:00:23.465619] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-29T18:00:23.474237] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-29T18:00:23.548081] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-09-29T18:00:24.026622] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-29T18:00:24.348130] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-09-29T18:00:25.148133] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-09-29T18:00:25.840169] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-29T18:00:25.948159] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-09-29T18:00:26.314459] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-29T18:00:26.748143] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-09-29T18:00:27.249571] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-29T18:00:27.413376] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-29T18:00:27.548117] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-09-29T18:00:28.348128] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-09-29T18:00:28.843657] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-29T18:00:28.986495] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-29T18:00:29.148120] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-09-29T18:00:29.859121] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-29T18:00:29.860602] [INFO ] [REMOTE ] CMSC: Full fetch complete (7167 records). [2025-09-29T18:00:29.860704] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-09-29T18:00:29.953302] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-09-29T18:00:30.283678] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-09-29T18:00:30.283804] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-09-29T18:00:30.284053] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-09-29T18:00:30.284101] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-09-29T18:00:30.284573] [DEBUG] [LOCAL ] CMSC: Trimmed 7167 records to 5080 (keeping 200 days of data) [2025-09-29T18:00:30.320771] [DEBUG] [LOCAL ] CMSC: Primary data saved (5080 records). [2025-09-29T18:00:30.320914] [INFO ] [MAIN ] CMSC: Full history saved. [2025-09-29T18:00:30.321004] [INFO ] [MAIN ] Update Progress: 481/2371 symbols completed. CMSC took 22.0s. Estimated remaining: 3h 57m 33s. Rate: 8.0 symbols/min [2025-09-29T18:00:30.524608] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:00:30.534914] [DEBUG] [LOCAL ] CMSD: Loaded 8184 existing records from primary storage. [2025-09-29T18:00:30.535158] [INFO ] [MAIN ] CMSD: Loaded 8184 existing records. [2025-09-29T18:00:30.651336] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-29T18:00:30.737958] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:00:30.738181] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-09-29T18:00:30.738268] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-09-29T18:00:30.738783] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-09-29T18:00:30.738846] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-09-29T18:00:30.753259] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-09-29T18:00:31.160310] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:00:31.548114] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-09-29T18:00:32.348104] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-09-29T18:00:32.682636] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-29T18:00:32.995176] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-29T18:00:33.029766] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-29T18:00:33.039469] [INFO ] [REMOTE ] CMRE: Full fetch complete (49854 records). [2025-09-29T18:00:33.039602] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-09-29T18:00:33.151162] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-09-29T18:00:33.455859] [DEBUG] [VALIDATOR ] CMRE: All expected trading days are present. [2025-09-29T18:00:33.456011] [DEBUG] [VALIDATOR ] CMRE: Primary data validation passed. [2025-09-29T18:00:33.456822] [INFO ] [MAIN ] CMRE: Fetched primary data is valid. [2025-09-29T18:00:33.456890] [DEBUG] [LOCAL ] CMRE: Saving primary data. [2025-09-29T18:00:33.459944] [DEBUG] [LOCAL ] CMRE: Trimmed 49854 records to 35457 (keeping 200 days of data) [2025-09-29T18:00:33.685823] [DEBUG] [LOCAL ] CMRE: Primary data saved (35457 records). [2025-09-29T18:00:33.685972] [INFO ] [MAIN ] CMRE: Full history saved. [2025-09-29T18:00:33.686056] [INFO ] [MAIN ] Update Progress: 482/2371 symbols completed. CMRE took 25.4s. Estimated remaining: 3h 57m 9s. Rate: 8.0 symbols/min [2025-09-29T18:00:33.867979] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:00:33.905707] [DEBUG] [LOCAL ] CMTG: Loaded 37931 existing records from primary storage. [2025-09-29T18:00:33.906055] [INFO ] [MAIN ] CMTG: Loaded 37931 existing records. [2025-09-29T18:00:33.956093] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-09-29T18:00:34.116506] [WARN ] [MAIN ] CMTG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:00:34.116808] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-09-29T18:00:34.116861] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-09-29T18:00:34.117689] [DEBUG] [LOCAL ] CMTG: Deleted primary data file. [2025-09-29T18:00:34.117763] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-09-29T18:00:34.507017] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:00:34.573174] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-29T18:00:34.748125] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-09-29T18:00:34.813193] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-29T18:00:35.294571] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-29T18:00:35.548108] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-09-29T18:00:36.310755] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-29T18:00:36.312015] [INFO ] [REMOTE ] CMSA: Full fetch complete (5053 records). [2025-09-29T18:00:36.312089] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-09-29T18:00:36.353216] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-09-29T18:00:36.694945] [DEBUG] [VALIDATOR ] CMSA: All expected trading days are present. [2025-09-29T18:00:36.695025] [DEBUG] [VALIDATOR ] CMSA: Primary data validation passed. [2025-09-29T18:00:36.695192] [INFO ] [MAIN ] CMSA: Fetched primary data is valid. [2025-09-29T18:00:36.695232] [DEBUG] [LOCAL ] CMSA: Saving primary data. [2025-09-29T18:00:36.695693] [DEBUG] [LOCAL ] CMSA: Trimmed 5053 records to 3414 (keeping 200 days of data) [2025-09-29T18:00:36.717533] [DEBUG] [LOCAL ] CMSA: Primary data saved (3414 records). [2025-09-29T18:00:36.717701] [INFO ] [MAIN ] CMSA: Full history saved. [2025-09-29T18:00:36.717805] [INFO ] [MAIN ] Update Progress: 483/2371 symbols completed. CMSA took 28.4s. Estimated remaining: 3h 56m 44s. Rate: 8.0 symbols/min [2025-09-29T18:00:36.908561] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:00:36.918634] [DEBUG] [LOCAL ] CMU: Loaded 7303 existing records from primary storage. [2025-09-29T18:00:36.918905] [INFO ] [MAIN ] CMU: Loaded 7303 existing records. [2025-09-29T18:00:37.121392] [WARN ] [MAIN ] CMU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:00:37.121661] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-09-29T18:00:37.121765] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-09-29T18:00:37.122279] [DEBUG] [LOCAL ] CMU: Deleted primary data file. [2025-09-29T18:00:37.122359] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-09-29T18:00:37.154136] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2024-12. [2025-09-29T18:00:37.508021] [INFO ] [REMOTE ] CMU: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:00:37.948103] [INFO ] [REMOTE ] CMU: Fetching primary data for 2024-12. [2025-09-29T18:00:38.195793] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-29T18:00:38.311250] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-29T18:00:38.685111] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-29T18:00:38.748171] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-09-29T18:00:39.548156] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2024-12. [2025-09-29T18:00:40.348115] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-01. [2025-09-29T18:00:40.590028] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-29T18:00:40.600766] [INFO ] [REMOTE ] CMS: Full fetch complete (75636 records). [2025-09-29T18:00:40.600978] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-09-29T18:00:40.601744] [FATAL] [VALIDATOR ] CMS: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:00:40.601838] [FATAL] [MAIN ] CMS: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:00:40.601885] [WARN ] [MAIN ] CMS: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:00:40.601926] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-09-29T18:00:40.601987] [DEBUG] [LOCAL ] CMS: No primary data file found to delete. [2025-09-29T18:00:40.602024] [INFO ] [LOCAL ] CMS: Starting deletion of derivative data. [2025-09-29T18:00:40.602768] [DEBUG] [LOCAL ] CMS: Deleted derivative data file. [2025-09-29T18:00:40.602918] [INFO ] [MAIN ] Update Progress: 484/2371 symbols completed. CMS took 32.3s. Estimated remaining: 3h 56m 22s. Rate: 8.0 symbols/min [2025-09-29T18:00:40.793379] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:00:40.804995] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-29T18:00:40.847623] [DEBUG] [LOCAL ] CNA: Loaded 33235 existing records from primary storage. [2025-09-29T18:00:40.847955] [INFO ] [MAIN ] CNA: Loaded 33235 existing records. [2025-09-29T18:00:41.033508] [WARN ] [MAIN ] CNA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:00:41.033742] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-09-29T18:00:41.033796] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-09-29T18:00:41.034165] [DEBUG] [LOCAL ] CNA: Deleted primary data file. [2025-09-29T18:00:41.034224] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-09-29T18:00:41.153322] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-01. [2025-09-29T18:00:41.243336] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-29T18:00:41.440397] [INFO ] [REMOTE ] CNA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:00:41.889967] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-29T18:00:41.948118] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-09-29T18:00:42.466682] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-29T18:00:42.748115] [INFO ] [REMOTE ] CNA: Fetching primary data for 2024-12. [2025-09-29T18:00:43.548137] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-09-29T18:00:44.262261] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-29T18:00:44.293243] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-29T18:00:44.348164] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-09-29T18:00:44.941139] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-29T18:00:45.148115] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-09-29T18:00:45.948195] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-01. [2025-09-29T18:00:45.951837] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-29T18:00:46.748086] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-09-29T18:00:47.109014] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-29T18:00:47.220439] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-29T18:00:47.548156] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-09-29T18:00:48.185174] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-29T18:00:48.348111] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-09-29T18:00:49.148157] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-09-29T18:00:49.713602] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-29T18:00:49.728987] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-29T18:00:49.948112] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-09-29T18:00:50.680436] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-29T18:00:50.748103] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-09-29T18:00:51.548129] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-01. [2025-09-29T18:00:52.173638] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-29T18:00:52.348147] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-09-29T18:00:52.742206] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-29T18:00:52.756698] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-29T18:00:53.148106] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-09-29T18:00:53.948124] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-09-29T18:00:54.637150] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-29T18:00:54.748175] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-09-29T18:00:54.891562] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-29T18:00:55.548121] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-09-29T18:00:55.999234] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-29T18:00:56.271063] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-29T18:00:56.273117] [INFO ] [REMOTE ] CMSD: Full fetch complete (12461 records). [2025-09-29T18:00:56.273250] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-09-29T18:00:56.353315] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-09-29T18:00:56.665863] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-09-29T18:00:56.665973] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-09-29T18:00:56.666380] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-09-29T18:00:56.666457] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-09-29T18:00:56.667128] [DEBUG] [LOCAL ] CMSD: Trimmed 12461 records to 8088 (keeping 200 days of data) [2025-09-29T18:00:56.723761] [DEBUG] [LOCAL ] CMSD: Primary data saved (8088 records). [2025-09-29T18:00:56.723925] [INFO ] [MAIN ] CMSD: Full history saved. [2025-09-29T18:00:56.724045] [INFO ] [MAIN ] Update Progress: 485/2371 symbols completed. CMSD took 26.4s. Estimated remaining: 3h 56m 48s. Rate: 8.0 symbols/min [2025-09-29T18:00:56.910679] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:00:56.969096] [DEBUG] [LOCAL ] CNC: Loaded 54518 existing records from primary storage. [2025-09-29T18:00:56.969470] [INFO ] [MAIN ] CNC: Loaded 54518 existing records. [2025-09-29T18:00:57.154247] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-09-29T18:00:57.169758] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:00:57.171239] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-09-29T18:00:57.171346] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-09-29T18:00:57.172277] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-09-29T18:00:57.172363] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-09-29T18:00:57.597470] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:00:57.622108] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-29T18:00:57.948101] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-09-29T18:00:58.409882] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-29T18:00:58.748135] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-09-29T18:00:59.489496] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-29T18:00:59.548137] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-09-29T18:01:00.304309] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-29T18:01:00.348113] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-09-29T18:01:00.797180] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-29T18:01:01.148162] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-09-29T18:01:01.771090] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-29T18:01:01.856668] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-29T18:01:01.948155] [INFO ] [REMOTE ] CNC: Fetching primary data for 2024-12. [2025-09-29T18:01:02.748176] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-09-29T18:01:03.548109] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-09-29T18:01:03.729081] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-29T18:01:03.979186] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-29T18:01:04.021020] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-29T18:01:04.027876] [INFO ] [REMOTE ] CNA: Full fetch complete (45577 records). [2025-09-29T18:01:04.028035] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-09-29T18:01:04.353231] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-09-29T18:01:04.446855] [DEBUG] [VALIDATOR ] CNA: All expected trading days are present. [2025-09-29T18:01:04.446978] [DEBUG] [VALIDATOR ] CNA: Primary data validation passed. [2025-09-29T18:01:04.447771] [INFO ] [MAIN ] CNA: Fetched primary data is valid. [2025-09-29T18:01:04.447851] [DEBUG] [LOCAL ] CNA: Saving primary data. [2025-09-29T18:01:04.449212] [DEBUG] [LOCAL ] CNA: Trimmed 45577 records to 32662 (keeping 200 days of data) [2025-09-29T18:01:04.660129] [DEBUG] [LOCAL ] CNA: Primary data saved (32662 records). [2025-09-29T18:01:04.660283] [INFO ] [MAIN ] CNA: Full history saved. [2025-09-29T18:01:04.660387] [INFO ] [MAIN ] Update Progress: 486/2371 symbols completed. CNA took 24.1s. Estimated remaining: 3h 56m 42s. Rate: 8.0 symbols/min [2025-09-29T18:01:04.852582] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:01:04.868258] [DEBUG] [LOCAL ] CNF: Loaded 11166 existing records from primary storage. [2025-09-29T18:01:04.868522] [INFO ] [MAIN ] CNF: Loaded 11166 existing records. [2025-09-29T18:01:05.060983] [WARN ] [MAIN ] CNF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:01:05.061224] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-09-29T18:01:05.061276] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-09-29T18:01:05.062295] [DEBUG] [LOCAL ] CNF: Deleted primary data file. [2025-09-29T18:01:05.062357] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-09-29T18:01:05.153340] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-09-29T18:01:05.443818] [INFO ] [REMOTE ] CNF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:01:05.928069] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-29T18:01:05.948093] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-09-29T18:01:06.748151] [INFO ] [REMOTE ] CNF: Fetching primary data for 2024-12. [2025-09-29T18:01:07.312990] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-29T18:01:07.403719] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-29T18:01:07.534027] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-09-29T18:01:07.548075] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-09-29T18:01:08.348114] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-09-29T18:01:09.149850] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-29T18:01:09.148296] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-01. [2025-09-29T18:01:09.769549] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-29T18:01:09.786987] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-29T18:01:09.948102] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-09-29T18:01:10.748137] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-09-29T18:01:11.197886] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-29T18:01:11.548154] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-09-29T18:01:11.860869] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-29T18:01:12.348094] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-09-29T18:01:12.429446] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-29T18:01:13.148117] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-09-29T18:01:13.452261] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-29T18:01:13.948119] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-09-29T18:01:14.396903] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-29T18:01:14.748107] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-09-29T18:01:15.093296] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-29T18:01:15.429076] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-29T18:01:15.548115] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-09-29T18:01:16.298747] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-29T18:01:16.300387] [INFO ] [REMOTE ] CMU: Full fetch complete (9641 records). [2025-09-29T18:01:16.300475] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-09-29T18:01:16.353286] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-09-29T18:01:16.693164] [DEBUG] [VALIDATOR ] CMU: All expected trading days are present. [2025-09-29T18:01:16.693300] [DEBUG] [VALIDATOR ] CMU: Primary data validation passed. [2025-09-29T18:01:16.693619] [INFO ] [MAIN ] CMU: Fetched primary data is valid. [2025-09-29T18:01:16.693718] [DEBUG] [LOCAL ] CMU: Saving primary data. [2025-09-29T18:01:16.694231] [DEBUG] [LOCAL ] CMU: Trimmed 9641 records to 7024 (keeping 200 days of data) [2025-09-29T18:01:16.741541] [DEBUG] [LOCAL ] CMU: Primary data saved (7024 records). [2025-09-29T18:01:16.741715] [INFO ] [MAIN ] CMU: Full history saved. [2025-09-29T18:01:16.741831] [INFO ] [MAIN ] Update Progress: 487/2371 symbols completed. CMU took 40.0s. Estimated remaining: 3h 56m 52s. Rate: 8.0 symbols/min [2025-09-29T18:01:16.935636] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:01:16.994188] [DEBUG] [LOCAL ] CNH: Loaded 54337 existing records from primary storage. [2025-09-29T18:01:16.994520] [INFO ] [MAIN ] CNH: Loaded 54337 existing records. [2025-09-29T18:01:17.149771] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-09-29T18:01:17.192102] [WARN ] [MAIN ] CNH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:01:17.192343] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-09-29T18:01:17.192410] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-09-29T18:01:17.192956] [DEBUG] [LOCAL ] CNH: Deleted primary data file. [2025-09-29T18:01:17.193019] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-09-29T18:01:17.608509] [INFO ] [REMOTE ] CNH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:01:17.948118] [INFO ] [REMOTE ] CNH: Fetching primary data for 2024-12. [2025-09-29T18:01:17.957122] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-29T18:01:18.351878] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-29T18:01:18.748187] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-09-29T18:01:19.318168] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-29T18:01:19.548186] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-09-29T18:01:19.847871] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-29T18:01:20.348126] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-01. [2025-09-29T18:01:21.073976] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-29T18:01:21.081058] [INFO ] [REMOTE ] CMTG: Full fetch complete (53408 records). [2025-09-29T18:01:21.081203] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-09-29T18:01:21.153220] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-09-29T18:01:21.504569] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present. [2025-09-29T18:01:21.504696] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed. [2025-09-29T18:01:21.505481] [INFO ] [MAIN ] CMTG: Fetched primary data is valid. [2025-09-29T18:01:21.505549] [DEBUG] [LOCAL ] CMTG: Saving primary data. [2025-09-29T18:01:21.506940] [DEBUG] [LOCAL ] CMTG: Trimmed 53408 records to 37127 (keeping 200 days of data) [2025-09-29T18:01:21.743011] [DEBUG] [LOCAL ] CMTG: Primary data saved (37127 records). [2025-09-29T18:01:21.743172] [INFO ] [MAIN ] CMTG: Full history saved. [2025-09-29T18:01:21.743294] [INFO ] [MAIN ] Update Progress: 488/2371 symbols completed. CMTG took 48.1s. Estimated remaining: 3h 56m 35s. Rate: 8.0 symbols/min [2025-09-29T18:01:21.941397] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:01:21.961327] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-09-29T18:01:21.976422] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-29T18:01:22.040154] [DEBUG] [LOCAL ] CNI: Loaded 52419 existing records from primary storage. [2025-09-29T18:01:22.040534] [INFO ] [MAIN ] CNI: Loaded 52419 existing records. [2025-09-29T18:01:22.230843] [WARN ] [MAIN ] CNI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:01:22.231054] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-09-29T18:01:22.231101] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-09-29T18:01:22.231677] [DEBUG] [LOCAL ] CNI: Deleted primary data file. [2025-09-29T18:01:22.231744] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-09-29T18:01:22.606016] [INFO ] [REMOTE ] CNI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:01:22.622706] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-29T18:01:22.748075] [INFO ] [REMOTE ] CNI: Fetching primary data for 2024-12. [2025-09-29T18:01:23.085543] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-29T18:01:23.548172] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-09-29T18:01:24.348129] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-09-29T18:01:24.503520] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-29T18:01:25.135497] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-29T18:01:25.148061] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-09-29T18:01:25.948087] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-09-29T18:01:26.043756] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-09-29T18:01:26.113946] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-29T18:01:26.748131] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-09-29T18:01:27.369030] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-29T18:01:27.548134] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-09-29T18:01:27.901446] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-29T18:01:27.904978] [INFO ] [REMOTE ] CNF: Full fetch complete (12937 records). [2025-09-29T18:01:27.905068] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-09-29T18:01:28.299455] [DEBUG] [VALIDATOR ] CNF: All expected trading days are present. [2025-09-29T18:01:28.299574] [DEBUG] [VALIDATOR ] CNF: Primary data validation passed. [2025-09-29T18:01:28.300013] [INFO ] [MAIN ] CNF: Fetched primary data is valid. [2025-09-29T18:01:28.300080] [DEBUG] [LOCAL ] CNF: Saving primary data. [2025-09-29T18:01:28.300591] [DEBUG] [LOCAL ] CNF: Trimmed 12937 records to 11068 (keeping 200 days of data) [2025-09-29T18:01:28.348441] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-01. [2025-09-29T18:01:28.366911] [DEBUG] [LOCAL ] CNF: Primary data saved (11068 records). [2025-09-29T18:01:28.367067] [INFO ] [MAIN ] CNF: Full history saved. [2025-09-29T18:01:28.367159] [INFO ] [MAIN ] Update Progress: 489/2371 symbols completed. CNF took 23.7s. Estimated remaining: 3h 56m 24s. Rate: 8.0 symbols/min [2025-09-29T18:01:28.565626] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:01:28.641869] [DEBUG] [LOCAL ] CNK: Loaded 53658 existing records from primary storage. [2025-09-29T18:01:28.642288] [INFO ] [MAIN ] CNK: Loaded 53658 existing records. [2025-09-29T18:01:28.948389] [WARN ] [MAIN ] CNK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:01:28.948731] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-09-29T18:01:28.948803] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-09-29T18:01:28.949435] [DEBUG] [LOCAL ] CNK: Deleted primary data file. [2025-09-29T18:01:28.949505] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-09-29T18:01:29.153814] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-09-29T18:01:29.452579] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:01:29.489141] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-29T18:01:29.881314] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-29T18:01:29.948126] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-09-29T18:01:30.748114] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-09-29T18:01:31.357420] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-29T18:01:31.548128] [INFO ] [REMOTE ] CNK: Fetching primary data for 2024-12. [2025-09-29T18:01:32.212261] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-29T18:01:32.353195] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-09-29T18:01:32.371278] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-29T18:01:33.148106] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-09-29T18:01:33.385981] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-29T18:01:33.948157] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-09-29T18:01:34.735968] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-09-29T18:01:34.747344] [INFO ] [REMOTE ] CNC: Full fetch complete (77674 records). [2025-09-29T18:01:34.747554] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-09-29T18:01:34.753553] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-09-29T18:01:35.181458] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-09-29T18:01:35.181670] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-09-29T18:01:35.182730] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-09-29T18:01:35.182818] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-09-29T18:01:35.215614] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-29T18:01:35.213989] [DEBUG] [LOCAL ] CNC: Trimmed 77674 records to 53739 (keeping 200 days of data) [2025-09-29T18:01:35.548079] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-09-29T18:01:35.565928] [DEBUG] [LOCAL ] CNC: Primary data saved (53739 records). [2025-09-29T18:01:35.566127] [INFO ] [MAIN ] CNC: Full history saved. [2025-09-29T18:01:35.566260] [INFO ] [MAIN ] Update Progress: 490/2371 symbols completed. CNC took 38.8s. Estimated remaining: 3h 56m 15s. Rate: 8.0 symbols/min [2025-09-29T18:01:35.783761] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:01:35.790078] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-29T18:01:35.856782] [DEBUG] [LOCAL ] CNM: Loaded 51747 existing records from primary storage. [2025-09-29T18:01:35.857108] [INFO ] [MAIN ] CNM: Loaded 51747 existing records. [2025-09-29T18:01:36.047292] [WARN ] [MAIN ] CNM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:01:36.048329] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-09-29T18:01:36.048403] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-09-29T18:01:36.049001] [DEBUG] [LOCAL ] CNM: Deleted primary data file. [2025-09-29T18:01:36.049065] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-09-29T18:01:36.350923] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-09-29T18:01:36.449778] [INFO ] [REMOTE ] CNM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:01:36.561045] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-29T18:01:37.148113] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-09-29T18:01:37.500979] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-29T18:01:37.948104] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-09-29T18:01:37.988090] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-29T18:01:38.489163] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-29T18:01:38.748181] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-09-29T18:01:39.494216] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-29T18:01:39.548149] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-09-29T18:01:40.343083] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-29T18:01:40.353938] [INFO ] [REMOTE ] CNM: Fetching primary data for 2024-12. [2025-09-29T18:01:41.148120] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-09-29T18:01:41.239489] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-29T18:01:41.861629] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-29T18:01:41.948158] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-09-29T18:01:42.748167] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-01. [2025-09-29T18:01:43.002174] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-29T18:01:43.548114] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-09-29T18:01:43.804973] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-29T18:01:44.348147] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-09-29T18:01:44.444695] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-29T18:01:45.148101] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-09-29T18:01:45.578152] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-29T18:01:45.948141] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-09-29T18:01:46.442455] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-29T18:01:46.529584] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-29T18:01:46.748161] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-09-29T18:01:47.548126] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-09-29T18:01:47.651217] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-29T18:01:48.348110] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-09-29T18:01:48.449552] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-29T18:01:48.461579] [INFO ] [REMOTE ] CNI: Full fetch complete (74656 records). [2025-09-29T18:01:48.461812] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-09-29T18:01:48.919189] [DEBUG] [VALIDATOR ] CNI: All expected trading days are present. [2025-09-29T18:01:48.919325] [DEBUG] [VALIDATOR ] CNI: Primary data validation passed. [2025-09-29T18:01:48.920335] [INFO ] [MAIN ] CNI: Fetched primary data is valid. [2025-09-29T18:01:48.920406] [DEBUG] [LOCAL ] CNI: Saving primary data. [2025-09-29T18:01:48.922315] [DEBUG] [LOCAL ] CNI: Trimmed 74656 records to 51653 (keeping 200 days of data) [2025-09-29T18:01:49.157309] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-09-29T18:01:49.238541] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-29T18:01:49.363305] [DEBUG] [LOCAL ] CNI: Primary data saved (51653 records). [2025-09-29T18:01:49.363462] [INFO ] [MAIN ] CNI: Full history saved. [2025-09-29T18:01:49.363550] [INFO ] [MAIN ] Update Progress: 491/2371 symbols completed. CNI took 27.6s. Estimated remaining: 3h 56m 32s. Rate: 7.9 symbols/min [2025-09-29T18:01:49.557542] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:01:49.595463] [DEBUG] [LOCAL ] CNMD: Loaded 32884 existing records from primary storage. [2025-09-29T18:01:49.595836] [INFO ] [MAIN ] CNMD: Loaded 32884 existing records. [2025-09-29T18:01:49.787547] [WARN ] [MAIN ] CNMD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:01:49.788025] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-09-29T18:01:49.788303] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-09-29T18:01:49.788824] [DEBUG] [LOCAL ] CNMD: Deleted primary data file. [2025-09-29T18:01:49.788893] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-09-29T18:01:49.973094] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-09-29T18:01:50.180320] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:01:50.221853] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-29T18:01:50.748132] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2024-12. [2025-09-29T18:01:50.828505] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-29T18:01:51.548101] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-09-29T18:01:52.128894] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-29T18:01:52.144078] [INFO ] [REMOTE ] CNH: Full fetch complete (77531 records). [2025-09-29T18:01:52.144339] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-09-29T18:01:52.283329] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-29T18:01:52.359769] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-01. [2025-09-29T18:01:52.586884] [DEBUG] [VALIDATOR ] CNH: All expected trading days are present. [2025-09-29T18:01:52.586971] [DEBUG] [VALIDATOR ] CNH: Primary data validation passed. [2025-09-29T18:01:52.587946] [INFO ] [MAIN ] CNH: Fetched primary data is valid. [2025-09-29T18:01:52.588013] [DEBUG] [LOCAL ] CNH: Saving primary data. [2025-09-29T18:01:52.589591] [DEBUG] [LOCAL ] CNH: Trimmed 77531 records to 53557 (keeping 200 days of data) [2025-09-29T18:01:52.932988] [DEBUG] [LOCAL ] CNH: Primary data saved (53557 records). [2025-09-29T18:01:52.933188] [INFO ] [MAIN ] CNH: Full history saved. [2025-09-29T18:01:52.933285] [INFO ] [MAIN ] Update Progress: 492/2371 symbols completed. CNH took 36.2s. Estimated remaining: 3h 56m 9s. Rate: 8.0 symbols/min [2025-09-29T18:01:53.124069] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:01:53.149911] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-09-29T18:01:53.168750] [DEBUG] [LOCAL ] CNNE: Loaded 37257 existing records from primary storage. [2025-09-29T18:01:53.169377] [INFO ] [MAIN ] CNNE: Loaded 37257 existing records. [2025-09-29T18:01:53.366986] [WARN ] [MAIN ] CNNE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:01:53.367405] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-09-29T18:01:53.367482] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-09-29T18:01:53.367951] [DEBUG] [LOCAL ] CNNE: Deleted primary data file. [2025-09-29T18:01:53.368014] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-09-29T18:01:53.693638] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-29T18:01:53.847046] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:01:53.859529] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-29T18:01:53.948166] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2024-12. [2025-09-29T18:01:54.748090] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-09-29T18:01:55.083239] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-29T18:01:55.167632] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-29T18:01:55.548116] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-01. [2025-09-29T18:01:55.836842] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-29T18:01:56.348120] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-09-29T18:01:56.592723] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-29T18:01:57.148120] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-09-29T18:01:57.887716] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-29T18:01:57.948121] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-09-29T18:01:58.389546] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-29T18:01:58.748148] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-09-29T18:01:58.967842] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-29T18:01:59.548162] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-09-29T18:02:00.351828] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-09-29T18:02:00.358858] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-29T18:02:00.370914] [INFO ] [REMOTE ] CNK: Full fetch complete (75712 records). [2025-09-29T18:02:00.371102] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-09-29T18:02:00.808805] [DEBUG] [VALIDATOR ] CNK: All expected trading days are present. [2025-09-29T18:02:00.808913] [DEBUG] [VALIDATOR ] CNK: Primary data validation passed. [2025-09-29T18:02:00.810038] [INFO ] [MAIN ] CNK: Fetched primary data is valid. [2025-09-29T18:02:00.810131] [DEBUG] [LOCAL ] CNK: Saving primary data. [2025-09-29T18:02:00.811827] [DEBUG] [LOCAL ] CNK: Trimmed 75712 records to 52880 (keeping 200 days of data) [2025-09-29T18:02:01.148392] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-09-29T18:02:01.173020] [DEBUG] [LOCAL ] CNK: Primary data saved (52880 records). [2025-09-29T18:02:01.173154] [INFO ] [MAIN ] CNK: Full history saved. [2025-09-29T18:02:01.173299] [INFO ] [MAIN ] Update Progress: 493/2371 symbols completed. CNK took 32.8s. Estimated remaining: 3h 56m 4s. Rate: 8.0 symbols/min [2025-09-29T18:02:01.372914] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:02:01.422061] [DEBUG] [LOCAL ] CNO: Loaded 41901 existing records from primary storage. [2025-09-29T18:02:01.422438] [INFO ] [MAIN ] CNO: Loaded 41901 existing records. [2025-09-29T18:02:01.650902] [WARN ] [MAIN ] CNO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:02:01.653285] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-29T18:02:01.653419] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-09-29T18:02:01.662365] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-09-29T18:02:01.663444] [DEBUG] [LOCAL ] CNO: Deleted primary data file. [2025-09-29T18:02:01.663542] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-09-29T18:02:01.958908] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-09-29T18:02:02.095631] [INFO ] [REMOTE ] CNO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:02:02.127561] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-29T18:02:02.709525] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-29T18:02:02.748121] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-09-29T18:02:03.140489] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-29T18:02:03.548141] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-09-29T18:02:04.332944] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-29T18:02:04.348069] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-09-29T18:02:04.845037] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-29T18:02:05.148168] [INFO ] [REMOTE ] CNO: Fetching primary data for 2024-12. [2025-09-29T18:02:05.948238] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-09-29T18:02:05.977501] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-29T18:02:06.748163] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-09-29T18:02:06.817012] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-29T18:02:07.442436] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-29T18:02:07.548133] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-01. [2025-09-29T18:02:07.846488] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-29T18:02:08.348121] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-09-29T18:02:08.877013] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-29T18:02:09.148162] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-09-29T18:02:09.775039] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-29T18:02:09.948151] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-09-29T18:02:10.748156] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-09-29T18:02:11.072747] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-29T18:02:11.466313] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-29T18:02:11.548198] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-09-29T18:02:11.654497] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-29T18:02:12.348146] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-09-29T18:02:12.938480] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-29T18:02:13.148119] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-09-29T18:02:13.533349] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-29T18:02:13.948123] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-09-29T18:02:14.520564] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-29T18:02:14.527137] [INFO ] [REMOTE ] CNMD: Full fetch complete (46974 records). [2025-09-29T18:02:14.527282] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-09-29T18:02:14.528082] [FATAL] [VALIDATOR ] CNMD: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:02:14.528179] [FATAL] [MAIN ] CNMD: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:02:14.528224] [WARN ] [MAIN ] CNMD: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:02:14.528265] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-09-29T18:02:14.528325] [DEBUG] [LOCAL ] CNMD: No primary data file found to delete. [2025-09-29T18:02:14.528362] [INFO ] [LOCAL ] CNMD: Starting deletion of derivative data. [2025-09-29T18:02:14.529201] [DEBUG] [LOCAL ] CNMD: Deleted derivative data file. [2025-09-29T18:02:14.529314] [INFO ] [MAIN ] Update Progress: 494/2371 symbols completed. CNMD took 25.2s. Estimated remaining: 3h 56m 19s. Rate: 7.9 symbols/min [2025-09-29T18:02:14.754691] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-09-29T18:02:14.754545] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:02:14.825328] [DEBUG] [LOCAL ] CNP: Loaded 54249 existing records from primary storage. [2025-09-29T18:02:14.825849] [INFO ] [MAIN ] CNP: Loaded 54249 existing records. [2025-09-29T18:02:15.027762] [WARN ] [MAIN ] CNP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:02:15.027994] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-09-29T18:02:15.028064] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-09-29T18:02:15.028943] [DEBUG] [LOCAL ] CNP: Deleted primary data file. [2025-09-29T18:02:15.029005] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-09-29T18:02:15.457880] [INFO ] [REMOTE ] CNP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:02:15.543445] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-29T18:02:15.553530] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-09-29T18:02:16.323750] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-29T18:02:16.348090] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-09-29T18:02:17.148138] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-09-29T18:02:17.245408] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-29T18:02:17.626064] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-29T18:02:17.948119] [INFO ] [REMOTE ] CNP: Fetching primary data for 2024-12. [2025-09-29T18:02:18.748142] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-09-29T18:02:19.205536] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-29T18:02:19.222349] [INFO ] [REMOTE ] CNM: Full fetch complete (73626 records). [2025-09-29T18:02:19.222548] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-09-29T18:02:19.548514] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-09-29T18:02:19.696559] [DEBUG] [VALIDATOR ] CNM: All expected trading days are present. [2025-09-29T18:02:19.696710] [DEBUG] [VALIDATOR ] CNM: Primary data validation passed. [2025-09-29T18:02:19.697910] [INFO ] [MAIN ] CNM: Fetched primary data is valid. [2025-09-29T18:02:19.697980] [DEBUG] [LOCAL ] CNM: Saving primary data. [2025-09-29T18:02:19.705487] [DEBUG] [LOCAL ] CNM: Trimmed 73626 records to 50973 (keeping 200 days of data) [2025-09-29T18:02:19.884707] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-29T18:02:20.020085] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-29T18:02:20.036637] [INFO ] [REMOTE ] CNNE: Full fetch complete (49564 records). [2025-09-29T18:02:20.039562] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-09-29T18:02:20.354018] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-01. [2025-09-29T18:02:20.561578] [DEBUG] [VALIDATOR ] CNNE: All expected trading days are present. [2025-09-29T18:02:20.562720] [DEBUG] [VALIDATOR ] CNNE: Primary data validation passed. [2025-09-29T18:02:20.563543] [INFO ] [MAIN ] CNNE: Fetched primary data is valid. [2025-09-29T18:02:20.563974] [DEBUG] [LOCAL ] CNNE: Saving primary data. [2025-09-29T18:02:20.569380] [DEBUG] [LOCAL ] CNNE: Trimmed 49564 records to 36466 (keeping 200 days of data) [2025-09-29T18:02:20.631628] [DEBUG] [LOCAL ] CNM: Primary data saved (50973 records). [2025-09-29T18:02:20.643059] [INFO ] [MAIN ] CNM: Full history saved. [2025-09-29T18:02:20.673188] [INFO ] [MAIN ] Update Progress: 495/2371 symbols completed. CNM took 45.1s. Estimated remaining: 3h 56m 6s. Rate: 7.9 symbols/min [2025-09-29T18:02:20.907611] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:02:21.030716] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-29T18:02:21.072818] [DEBUG] [LOCAL ] CNNE: Primary data saved (36466 records). [2025-09-29T18:02:21.073032] [INFO ] [MAIN ] CNNE: Full history saved. [2025-09-29T18:02:21.073134] [INFO ] [MAIN ] Update Progress: 496/2371 symbols completed. CNNE took 28.1s. Estimated remaining: 3h 55m 31s. Rate: 8.0 symbols/min [2025-09-29T18:02:21.158951] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-09-29T18:02:21.267421] [DEBUG] [LOCAL ] CNQ: Loaded 54361 existing records from primary storage. [2025-09-29T18:02:21.302377] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:02:21.302569] [DEBUG] [LOCAL ] CNR: No existing data file found in primary storage. [2025-09-29T18:02:21.300495] [INFO ] [MAIN ] CNQ: Loaded 54361 existing records. [2025-09-29T18:02:21.347690] [WARN ] [MAIN ] CNR: No existing data found, performing full refresh instead. [2025-09-29T18:02:21.379310] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-09-29T18:02:21.385098] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-09-29T18:02:21.401530] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-09-29T18:02:21.409795] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-09-29T18:02:21.616540] [WARN ] [MAIN ] CNQ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:02:21.632873] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-09-29T18:02:21.638135] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-09-29T18:02:21.664930] [DEBUG] [LOCAL ] CNQ: Deleted primary data file. [2025-09-29T18:02:21.668828] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-09-29T18:02:22.187200] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:02:22.245303] [INFO ] [REMOTE ] CNR: Fetching primary data for 2024-12. [2025-09-29T18:02:22.314609] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:02:22.353568] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-29T18:02:22.492875] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-29T18:02:22.683763] [DEBUG] [REMOTE ] CNR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T18:02:22.684259] [WARN ] [REMOTE ] CNR: No data returned for month 2024-12 [2025-09-29T18:02:22.684359] [FATAL] [REMOTE ] CNR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T18:02:22.684412] [FATAL] [MAIN ] CNR: Failed to fetch primary data. [2025-09-29T18:02:22.684478] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T18:02:22.684555] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-09-29T18:02:22.684624] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-09-29T18:02:22.684700] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-09-29T18:02:22.684771] [DEBUG] [LOCAL ] CNR: No derivative data file found to delete. [2025-09-29T18:02:22.684844] [INFO ] [MAIN ] Update Progress: 497/2371 symbols completed. CNR took 1.6s. Estimated remaining: 3h 55m 1s. Rate: 8.0 symbols/min [2025-09-29T18:02:22.753285] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2024-12. [2025-09-29T18:02:22.918627] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:02:22.940335] [DEBUG] [LOCAL ] CNS: Loaded 21245 existing records from primary storage. [2025-09-29T18:02:22.940596] [INFO ] [MAIN ] CNS: Loaded 21245 existing records. [2025-09-29T18:02:23.143137] [WARN ] [MAIN ] CNS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:02:23.143352] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-09-29T18:02:23.143402] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-09-29T18:02:23.143677] [DEBUG] [LOCAL ] CNS: Deleted primary data file. [2025-09-29T18:02:23.143737] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-09-29T18:02:23.538985] [INFO ] [REMOTE ] CNS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:02:23.548132] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-09-29T18:02:24.348146] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-09-29T18:02:24.774127] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-29T18:02:24.823112] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-29T18:02:25.148147] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-09-29T18:02:25.948179] [INFO ] [REMOTE ] CNS: Fetching primary data for 2024-12. [2025-09-29T18:02:26.096168] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-29T18:02:26.581375] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-29T18:02:26.591973] [INFO ] [REMOTE ] CNO: Full fetch complete (60614 records). [2025-09-29T18:02:26.592169] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-09-29T18:02:26.756508] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-09-29T18:02:27.020002] [DEBUG] [VALIDATOR ] CNO: All expected trading days are present. [2025-09-29T18:02:27.020126] [DEBUG] [VALIDATOR ] CNO: Primary data validation passed. [2025-09-29T18:02:27.021005] [INFO ] [MAIN ] CNO: Fetched primary data is valid. [2025-09-29T18:02:27.021087] [DEBUG] [LOCAL ] CNO: Saving primary data. [2025-09-29T18:02:27.034985] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-29T18:02:27.043787] [DEBUG] [LOCAL ] CNO: Trimmed 60614 records to 41180 (keeping 200 days of data) [2025-09-29T18:02:27.332032] [DEBUG] [LOCAL ] CNO: Primary data saved (41180 records). [2025-09-29T18:02:27.332170] [INFO ] [MAIN ] CNO: Full history saved. [2025-09-29T18:02:27.332257] [INFO ] [MAIN ] Update Progress: 498/2371 symbols completed. CNO took 26.2s. Estimated remaining: 3h 54m 43s. Rate: 8.0 symbols/min [2025-09-29T18:02:27.511994] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:02:27.550266] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-01. [2025-09-29T18:02:27.573226] [DEBUG] [LOCAL ] CNX: Loaded 52150 existing records from primary storage. [2025-09-29T18:02:27.573574] [INFO ] [MAIN ] CNX: Loaded 52150 existing records. [2025-09-29T18:02:27.764176] [WARN ] [MAIN ] CNX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:02:27.764388] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-09-29T18:02:27.764436] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-09-29T18:02:27.764845] [DEBUG] [LOCAL ] CNX: Deleted primary data file. [2025-09-29T18:02:27.764905] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-09-29T18:02:28.191289] [INFO ] [REMOTE ] CNX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:02:28.348109] [INFO ] [REMOTE ] CNX: Fetching primary data for 2024-12. [2025-09-29T18:02:28.636343] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-29T18:02:28.661930] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-29T18:02:29.148120] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-09-29T18:02:29.948114] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-09-29T18:02:30.091120] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-29T18:02:30.137466] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-29T18:02:30.748110] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-01. [2025-09-29T18:02:31.484324] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-29T18:02:31.548139] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-09-29T18:02:32.095909] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-29T18:02:32.348172] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-09-29T18:02:33.148142] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-09-29T18:02:33.276429] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-29T18:02:33.721760] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-29T18:02:33.948119] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-09-29T18:02:34.067571] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-29T18:02:34.748154] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-09-29T18:02:35.378821] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-29T18:02:35.548347] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-09-29T18:02:36.348183] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-09-29T18:02:36.747042] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-29T18:02:37.148130] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-09-29T18:02:37.649283] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-29T18:02:37.948589] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-09-29T18:02:37.955951] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-29T18:02:38.748161] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-09-29T18:02:39.034451] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-29T18:02:39.099093] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-29T18:02:39.548124] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-09-29T18:02:40.348165] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-09-29T18:02:40.563070] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-29T18:02:40.717923] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-29T18:02:41.148135] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-09-29T18:02:41.810496] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-29T18:02:41.948128] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-09-29T18:02:42.748127] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-09-29T18:02:42.840043] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-29T18:02:43.548111] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-09-29T18:02:43.669571] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-29T18:02:43.834140] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-29T18:02:44.348124] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-09-29T18:02:45.010838] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-29T18:02:45.148162] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-09-29T18:02:45.457867] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-29T18:02:45.948144] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-09-29T18:02:46.726875] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-29T18:02:46.748075] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-09-29T18:02:47.548130] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-09-29T18:02:47.804331] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-29T18:02:48.348146] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-09-29T18:02:48.651160] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-29T18:02:48.942268] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-29T18:02:49.148153] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-09-29T18:02:49.948155] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-09-29T18:02:50.039487] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-29T18:02:50.050765] [INFO ] [REMOTE ] CNP: Full fetch complete (77369 records). [2025-09-29T18:02:50.050925] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-09-29T18:02:50.475844] [DEBUG] [VALIDATOR ] CNP: All expected trading days are present. [2025-09-29T18:02:50.475933] [DEBUG] [VALIDATOR ] CNP: Primary data validation passed. [2025-09-29T18:02:50.476916] [INFO ] [MAIN ] CNP: Fetched primary data is valid. [2025-09-29T18:02:50.477018] [DEBUG] [LOCAL ] CNP: Saving primary data. [2025-09-29T18:02:50.478589] [DEBUG] [LOCAL ] CNP: Trimmed 77369 records to 53469 (keeping 200 days of data) [2025-09-29T18:02:50.779460] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-09-29T18:02:50.837009] [DEBUG] [LOCAL ] CNP: Primary data saved (53469 records). [2025-09-29T18:02:50.837147] [INFO ] [MAIN ] CNP: Full history saved. [2025-09-29T18:02:50.837268] [INFO ] [MAIN ] Update Progress: 499/2371 symbols completed. CNP took 36.3s. Estimated remaining: 3h 55m 35s. Rate: 7.9 symbols/min [2025-09-29T18:02:51.038735] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:02:51.055887] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-29T18:02:51.104734] [DEBUG] [LOCAL ] CODI: Loaded 40312 existing records from primary storage. [2025-09-29T18:02:51.105048] [INFO ] [MAIN ] CODI: Loaded 40312 existing records. [2025-09-29T18:02:51.292631] [WARN ] [MAIN ] CODI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:02:51.292896] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-09-29T18:02:51.292946] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-09-29T18:02:51.293382] [DEBUG] [LOCAL ] CODI: Deleted primary data file. [2025-09-29T18:02:51.293441] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-09-29T18:02:51.553182] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-09-29T18:02:51.670518] [INFO ] [REMOTE ] CODI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:02:51.734216] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-29T18:02:52.034141] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-29T18:02:52.348143] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-09-29T18:02:53.148135] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-09-29T18:02:53.554794] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-29T18:02:53.948096] [INFO ] [REMOTE ] CODI: Fetching primary data for 2024-12. [2025-09-29T18:02:54.049117] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-29T18:02:54.060097] [INFO ] [REMOTE ] CNQ: Full fetch complete (77160 records). [2025-09-29T18:02:54.060256] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-09-29T18:02:54.061112] [FATAL] [VALIDATOR ] CNQ: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:02:54.061209] [FATAL] [MAIN ] CNQ: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:02:54.061254] [WARN ] [MAIN ] CNQ: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:02:54.061297] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-09-29T18:02:54.061402] [DEBUG] [LOCAL ] CNQ: No primary data file found to delete. [2025-09-29T18:02:54.061448] [INFO ] [LOCAL ] CNQ: Starting deletion of derivative data. [2025-09-29T18:02:54.062302] [DEBUG] [LOCAL ] CNQ: Deleted derivative data file. [2025-09-29T18:02:54.062422] [INFO ] [MAIN ] Update Progress: 500/2371 symbols completed. CNQ took 33.4s. Estimated remaining: 3h 55m 12s. Rate: 8.0 symbols/min [2025-09-29T18:02:54.263385] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:02:54.259858] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-29T18:02:54.268989] [INFO ] [REMOTE ] CNS: Full fetch complete (30057 records). [2025-09-29T18:02:54.269091] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-09-29T18:02:54.653383] [DEBUG] [LOCAL ] COF: Loaded 54389 existing records from primary storage. [2025-09-29T18:02:54.688096] [INFO ] [MAIN ] COF: Loaded 54389 existing records. [2025-09-29T18:02:54.756773] [DEBUG] [VALIDATOR ] CNS: All expected trading days are present. [2025-09-29T18:02:54.751396] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-09-29T18:02:54.770258] [DEBUG] [VALIDATOR ] CNS: Primary data validation passed. [2025-09-29T18:02:54.775215] [INFO ] [MAIN ] CNS: Fetched primary data is valid. [2025-09-29T18:02:54.796398] [DEBUG] [LOCAL ] CNS: Saving primary data. [2025-09-29T18:02:54.836746] [DEBUG] [LOCAL ] CNS: Trimmed 30057 records to 20650 (keeping 200 days of data) [2025-09-29T18:02:54.986117] [WARN ] [MAIN ] COF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:02:54.995427] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-09-29T18:02:55.024857] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-09-29T18:02:55.026451] [DEBUG] [LOCAL ] COF: Deleted primary data file. [2025-09-29T18:02:55.026931] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-09-29T18:02:55.396412] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-29T18:02:55.435540] [DEBUG] [LOCAL ] CNS: Primary data saved (20650 records). [2025-09-29T18:02:55.469029] [INFO ] [MAIN ] CNS: Full history saved. [2025-09-29T18:02:55.476998] [INFO ] [MAIN ] Update Progress: 501/2371 symbols completed. CNS took 32.8s. Estimated remaining: 3h 54m 41s. Rate: 8.0 symbols/min [2025-09-29T18:02:55.510747] [INFO ] [REMOTE ] COF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:02:55.553620] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-01. [2025-09-29T18:02:55.699384] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:02:55.769150] [DEBUG] [LOCAL ] COHR: Loaded 54144 existing records from primary storage. [2025-09-29T18:02:55.769569] [INFO ] [MAIN ] COHR: Loaded 54144 existing records. [2025-09-29T18:02:55.991554] [WARN ] [MAIN ] COHR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:02:55.992209] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-09-29T18:02:55.992269] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-09-29T18:02:55.992794] [DEBUG] [LOCAL ] COHR: Deleted primary data file. [2025-09-29T18:02:55.992856] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-09-29T18:02:56.362280] [INFO ] [REMOTE ] COF: Fetching primary data for 2024-12. [2025-09-29T18:02:56.402793] [INFO ] [REMOTE ] COHR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:02:56.753638] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-29T18:02:56.788384] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-29T18:02:56.799122] [INFO ] [REMOTE ] CNX: Full fetch complete (74774 records). [2025-09-29T18:02:56.799289] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-09-29T18:02:57.153235] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-09-29T18:02:57.211998] [DEBUG] [VALIDATOR ] CNX: All expected trading days are present. [2025-09-29T18:02:57.212090] [DEBUG] [VALIDATOR ] CNX: Primary data validation passed. [2025-09-29T18:02:57.212987] [INFO ] [MAIN ] CNX: Fetched primary data is valid. [2025-09-29T18:02:57.213053] [DEBUG] [LOCAL ] CNX: Saving primary data. [2025-09-29T18:02:57.214667] [DEBUG] [LOCAL ] CNX: Trimmed 74774 records to 51375 (keeping 200 days of data) [2025-09-29T18:02:57.524111] [DEBUG] [LOCAL ] CNX: Primary data saved (51375 records). [2025-09-29T18:02:57.524259] [INFO ] [MAIN ] CNX: Full history saved. [2025-09-29T18:02:57.524345] [INFO ] [MAIN ] Update Progress: 502/2371 symbols completed. CNX took 30.2s. Estimated remaining: 3h 54m 13s. Rate: 8.0 symbols/min [2025-09-29T18:02:57.716939] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:02:57.775248] [DEBUG] [LOCAL ] COLD: Loaded 52785 existing records from primary storage. [2025-09-29T18:02:57.775593] [INFO ] [MAIN ] COLD: Loaded 52785 existing records. [2025-09-29T18:02:57.951638] [INFO ] [REMOTE ] COHR: Fetching primary data for 2024-12. [2025-09-29T18:02:57.975382] [WARN ] [MAIN ] COLD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:02:57.976740] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-09-29T18:02:57.976801] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-09-29T18:02:57.977466] [DEBUG] [LOCAL ] COLD: Deleted primary data file. [2025-09-29T18:02:57.977541] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-09-29T18:02:58.371716] [INFO ] [REMOTE ] COLD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:02:58.390203] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-29T18:02:58.428727] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-29T18:02:58.748127] [INFO ] [REMOTE ] COLD: Fetching primary data for 2024-12. [2025-09-29T18:02:59.548110] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-09-29T18:02:59.661446] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-29T18:03:00.348115] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-01. [2025-09-29T18:03:00.778635] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-29T18:03:01.148092] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-01. [2025-09-29T18:03:01.318153] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-29T18:03:01.948074] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-09-29T18:03:02.126444] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-29T18:03:02.748118] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-09-29T18:03:03.053143] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-29T18:03:03.467545] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-29T18:03:03.548153] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-09-29T18:03:04.352439] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-01. [2025-09-29T18:03:04.358505] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-29T18:03:05.148137] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-09-29T18:03:05.322212] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-29T18:03:05.591255] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-29T18:03:05.948115] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-09-29T18:03:06.748110] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-09-29T18:03:06.914164] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-29T18:03:07.548168] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-09-29T18:03:07.665212] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-29T18:03:08.348119] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-09-29T18:03:08.713416] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-29T18:03:09.148123] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-09-29T18:03:09.543088] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-29T18:03:09.948101] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-09-29T18:03:10.024290] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-29T18:03:10.748116] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-09-29T18:03:11.197526] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-29T18:03:11.548138] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-09-29T18:03:11.623388] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-29T18:03:12.348164] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-09-29T18:03:12.828078] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-29T18:03:12.936379] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-29T18:03:13.148144] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-09-29T18:03:13.948198] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-09-29T18:03:14.201542] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-29T18:03:14.748134] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-09-29T18:03:15.050052] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-29T18:03:15.548154] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-09-29T18:03:16.041848] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-29T18:03:16.050334] [INFO ] [REMOTE ] CODI: Full fetch complete (50784 records). [2025-09-29T18:03:16.050570] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-09-29T18:03:16.225751] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-29T18:03:16.353233] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-09-29T18:03:16.536123] [DEBUG] [VALIDATOR ] CODI: All expected trading days are present. [2025-09-29T18:03:16.536228] [DEBUG] [VALIDATOR ] CODI: Primary data validation passed. [2025-09-29T18:03:16.537066] [INFO ] [MAIN ] CODI: Fetched primary data is valid. [2025-09-29T18:03:16.537143] [DEBUG] [LOCAL ] CODI: Saving primary data. [2025-09-29T18:03:16.540691] [DEBUG] [LOCAL ] CODI: Trimmed 50784 records to 39820 (keeping 200 days of data) [2025-09-29T18:03:16.779435] [DEBUG] [LOCAL ] CODI: Primary data saved (39820 records). [2025-09-29T18:03:16.779669] [INFO ] [MAIN ] CODI: Full history saved. [2025-09-29T18:03:16.779851] [INFO ] [MAIN ] Update Progress: 503/2371 symbols completed. CODI took 25.9s. Estimated remaining: 3h 54m 49s. Rate: 8.0 symbols/min [2025-09-29T18:03:16.971882] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:03:17.032561] [DEBUG] [LOCAL ] COMP: Loaded 54166 existing records from primary storage. [2025-09-29T18:03:17.032928] [INFO ] [MAIN ] COMP: Loaded 54166 existing records. [2025-09-29T18:03:17.148914] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-09-29T18:03:17.239132] [WARN ] [MAIN ] COMP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:03:17.239802] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-09-29T18:03:17.239955] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-09-29T18:03:17.240683] [DEBUG] [LOCAL ] COMP: Deleted primary data file. [2025-09-29T18:03:17.240769] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-09-29T18:03:17.434062] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-29T18:03:17.685106] [INFO ] [REMOTE ] COMP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:03:17.948109] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-09-29T18:03:18.085145] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-29T18:03:18.748116] [INFO ] [REMOTE ] COMP: Fetching primary data for 2024-12. [2025-09-29T18:03:19.548142] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-09-29T18:03:19.704460] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (2.56 seconds). [2025-09-29T18:03:19.799711] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-29T18:03:20.348119] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-09-29T18:03:20.618242] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-29T18:03:21.148866] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-09-29T18:03:21.487792] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-29T18:03:21.948109] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-01. [2025-09-29T18:03:22.220610] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-29T18:03:22.748114] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-09-29T18:03:22.985262] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-29T18:03:23.548153] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-09-29T18:03:23.679175] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-29T18:03:24.348138] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-09-29T18:03:25.148121] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-09-29T18:03:25.534934] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (2.79 seconds). [2025-09-29T18:03:25.546805] [INFO ] [REMOTE ] COHR: Full fetch complete (77110 records). [2025-09-29T18:03:25.547233] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-09-29T18:03:25.941550] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-09-29T18:03:26.009254] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-09-29T18:03:26.062735] [DEBUG] [VALIDATOR ] COHR: All expected trading days are present. [2025-09-29T18:03:26.062845] [DEBUG] [VALIDATOR ] COHR: Primary data validation passed. [2025-09-29T18:03:26.063794] [INFO ] [MAIN ] COHR: Fetched primary data is valid. [2025-09-29T18:03:26.064019] [DEBUG] [LOCAL ] COHR: Saving primary data. [2025-09-29T18:03:26.097597] [DEBUG] [LOCAL ] COHR: Trimmed 77110 records to 53363 (keeping 200 days of data) [2025-09-29T18:03:26.099257] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-29T18:03:26.440906] [DEBUG] [LOCAL ] COHR: Primary data saved (53363 records). [2025-09-29T18:03:26.441051] [INFO ] [MAIN ] COHR: Full history saved. [2025-09-29T18:03:26.441149] [INFO ] [MAIN ] Update Progress: 504/2371 symbols completed. COHR took 31.0s. Estimated remaining: 3h 54m 50s. Rate: 8.0 symbols/min [2025-09-29T18:03:26.625291] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:03:26.674510] [DEBUG] [LOCAL ] CON: Loaded 39289 existing records from primary storage. [2025-09-29T18:03:26.674846] [INFO ] [MAIN ] CON: Loaded 39289 existing records. [2025-09-29T18:03:26.748460] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-09-29T18:03:26.868124] [WARN ] [MAIN ] CON: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:03:26.868571] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-09-29T18:03:26.868750] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-09-29T18:03:26.869169] [DEBUG] [LOCAL ] CON: Deleted primary data file. [2025-09-29T18:03:26.869228] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-09-29T18:03:27.276347] [INFO ] [REMOTE ] CON: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:03:27.279498] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-29T18:03:27.548122] [INFO ] [REMOTE ] CON: Fetching primary data for 2024-12. [2025-09-29T18:03:28.161582] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-29T18:03:28.348152] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-09-29T18:03:28.501525] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-29T18:03:29.148119] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-09-29T18:03:29.216473] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-29T18:03:29.948125] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-09-29T18:03:30.311736] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-29T18:03:30.323169] [INFO ] [REMOTE ] COF: Full fetch complete (77407 records). [2025-09-29T18:03:30.323344] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-09-29T18:03:30.751307] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-01. [2025-09-29T18:03:30.755286] [DEBUG] [VALIDATOR ] COF: All expected trading days are present. [2025-09-29T18:03:30.756611] [DEBUG] [VALIDATOR ] COF: Primary data validation passed. [2025-09-29T18:03:30.757730] [INFO ] [MAIN ] COF: Fetched primary data is valid. [2025-09-29T18:03:30.757917] [DEBUG] [LOCAL ] COF: Saving primary data. [2025-09-29T18:03:30.759600] [DEBUG] [LOCAL ] COF: Trimmed 77407 records to 53608 (keeping 200 days of data) [2025-09-29T18:03:31.064846] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-29T18:03:31.186096] [DEBUG] [LOCAL ] COF: Primary data saved (53608 records). [2025-09-29T18:03:31.186257] [INFO ] [MAIN ] COF: Full history saved. [2025-09-29T18:03:31.186390] [INFO ] [MAIN ] Update Progress: 505/2371 symbols completed. COF took 37.1s. Estimated remaining: 3h 54m 32s. Rate: 8.0 symbols/min [2025-09-29T18:03:31.363941] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:03:31.389784] [DEBUG] [LOCAL ] COOK: Loaded 24850 existing records from primary storage. [2025-09-29T18:03:31.390040] [INFO ] [MAIN ] COOK: Loaded 24850 existing records. [2025-09-29T18:03:31.572494] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-09-29T18:03:31.580565] [WARN ] [MAIN ] COOK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:03:31.581070] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-09-29T18:03:31.581258] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-09-29T18:03:31.581762] [DEBUG] [LOCAL ] COOK: Deleted primary data file. [2025-09-29T18:03:31.581844] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-09-29T18:03:31.972485] [INFO ] [REMOTE ] COOK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:03:32.006482] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-29T18:03:32.220775] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-29T18:03:32.348121] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-09-29T18:03:33.148089] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-09-29T18:03:33.203429] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-29T18:03:33.948134] [INFO ] [REMOTE ] COOK: Fetching primary data for 2024-12. [2025-09-29T18:03:34.358249] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-29T18:03:34.370552] [INFO ] [REMOTE ] COLD: Full fetch complete (74195 records). [2025-09-29T18:03:34.370770] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-09-29T18:03:34.751838] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-09-29T18:03:34.754500] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-29T18:03:34.860116] [DEBUG] [VALIDATOR ] COLD: All expected trading days are present. [2025-09-29T18:03:34.860211] [DEBUG] [VALIDATOR ] COLD: Primary data validation passed. [2025-09-29T18:03:34.861248] [INFO ] [MAIN ] COLD: Fetched primary data is valid. [2025-09-29T18:03:34.861319] [DEBUG] [LOCAL ] COLD: Saving primary data. [2025-09-29T18:03:34.863207] [DEBUG] [LOCAL ] COLD: Trimmed 74195 records to 52032 (keeping 200 days of data) [2025-09-29T18:03:35.207735] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-29T18:03:35.226088] [DEBUG] [LOCAL ] COLD: Primary data saved (52032 records). [2025-09-29T18:03:35.226252] [INFO ] [MAIN ] COLD: Full history saved. [2025-09-29T18:03:35.226377] [INFO ] [MAIN ] Update Progress: 506/2371 symbols completed. COLD took 37.7s. Estimated remaining: 3h 54m 11s. Rate: 8.0 symbols/min [2025-09-29T18:03:35.415271] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:03:35.470859] [DEBUG] [LOCAL ] COP: Loaded 54507 existing records from primary storage. [2025-09-29T18:03:35.471205] [INFO ] [MAIN ] COP: Loaded 54507 existing records. [2025-09-29T18:03:35.553255] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-01. [2025-09-29T18:03:35.706316] [WARN ] [MAIN ] COP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:03:35.706563] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-09-29T18:03:35.706615] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-09-29T18:03:35.707015] [DEBUG] [LOCAL ] COP: Deleted primary data file. [2025-09-29T18:03:35.707075] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-09-29T18:03:36.096067] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:03:36.348088] [INFO ] [REMOTE ] COP: Fetching primary data for 2024-12. [2025-09-29T18:03:36.515492] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-29T18:03:36.639336] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-29T18:03:37.148119] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-09-29T18:03:37.948173] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-09-29T18:03:38.034426] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-29T18:03:38.748122] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-09-29T18:03:38.880273] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-29T18:03:39.548149] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-09-29T18:03:40.050181] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-29T18:03:40.348129] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-09-29T18:03:40.533859] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-29T18:03:40.796215] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-29T18:03:41.148220] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-09-29T18:03:41.839331] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-29T18:03:41.948092] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-09-29T18:03:42.083258] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-29T18:03:42.748144] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-09-29T18:03:43.548109] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-09-29T18:03:43.666909] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-29T18:03:43.695083] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-29T18:03:44.348118] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-09-29T18:03:45.148112] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-09-29T18:03:45.238487] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-29T18:03:45.948101] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-09-29T18:03:46.202026] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-29T18:03:46.219619] [INFO ] [REMOTE ] COMP: Full fetch complete (76715 records). [2025-09-29T18:03:46.232417] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-29T18:03:46.231591] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-09-29T18:03:46.240855] [FATAL] [VALIDATOR ] COMP: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:03:46.240985] [FATAL] [MAIN ] COMP: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:03:46.241077] [WARN ] [MAIN ] COMP: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:03:46.241154] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-09-29T18:03:46.241230] [DEBUG] [LOCAL ] COMP: No primary data file found to delete. [2025-09-29T18:03:46.241269] [INFO ] [LOCAL ] COMP: Starting deletion of derivative data. [2025-09-29T18:03:46.241587] [DEBUG] [LOCAL ] COMP: Deleted derivative data file. [2025-09-29T18:03:46.241705] [INFO ] [MAIN ] Update Progress: 507/2371 symbols completed. COMP took 29.5s. Estimated remaining: 3h 54m 17s. Rate: 8.0 symbols/min [2025-09-29T18:03:46.421592] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:03:46.479072] [DEBUG] [LOCAL ] COR: Loaded 47937 existing records from primary storage. [2025-09-29T18:03:46.479425] [INFO ] [MAIN ] COR: Loaded 47937 existing records. [2025-09-29T18:03:46.673137] [WARN ] [MAIN ] COR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:03:46.673433] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-09-29T18:03:46.673511] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-09-29T18:03:46.674182] [DEBUG] [LOCAL ] COR: Deleted primary data file. [2025-09-29T18:03:46.674246] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-09-29T18:03:46.756689] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-09-29T18:03:47.064235] [INFO ] [REMOTE ] COR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:03:47.296556] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-29T18:03:47.548182] [INFO ] [REMOTE ] COR: Fetching primary data for 2024-12. [2025-09-29T18:03:48.348064] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-09-29T18:03:48.693723] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-29T18:03:49.148148] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-09-29T18:03:49.408579] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-29T18:03:49.717741] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-29T18:03:49.948137] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-01. [2025-09-29T18:03:50.748141] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-09-29T18:03:51.186579] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-29T18:03:51.548160] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-09-29T18:03:51.774551] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-29T18:03:52.348084] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-09-29T18:03:52.711284] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-29T18:03:52.897610] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-29T18:03:53.148126] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-09-29T18:03:53.763162] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-29T18:03:53.948153] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-09-29T18:03:54.748110] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-09-29T18:03:55.142671] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-29T18:03:55.291039] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-29T18:03:55.548087] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-09-29T18:03:55.928095] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-29T18:03:56.348131] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-09-29T18:03:57.148110] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-09-29T18:03:57.562717] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-29T18:03:57.810287] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-29T18:03:57.824094] [INFO ] [REMOTE ] CON: Full fetch complete (56983 records). [2025-09-29T18:03:57.824343] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-09-29T18:03:57.953256] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-09-29T18:03:58.238830] [DEBUG] [VALIDATOR ] CON: All expected trading days are present. [2025-09-29T18:03:58.238926] [DEBUG] [VALIDATOR ] CON: Primary data validation passed. [2025-09-29T18:03:58.239790] [INFO ] [MAIN ] CON: Fetched primary data is valid. [2025-09-29T18:03:58.239857] [DEBUG] [LOCAL ] CON: Saving primary data. [2025-09-29T18:03:58.241163] [DEBUG] [LOCAL ] CON: Trimmed 56983 records to 38727 (keeping 200 days of data) [2025-09-29T18:03:58.492135] [DEBUG] [LOCAL ] CON: Primary data saved (38727 records). [2025-09-29T18:03:58.492319] [INFO ] [MAIN ] CON: Full history saved. [2025-09-29T18:03:58.492420] [INFO ] [MAIN ] Update Progress: 508/2371 symbols completed. CON took 32.1s. Estimated remaining: 3h 54m 26s. Rate: 7.9 symbols/min [2025-09-29T18:03:58.670998] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:03:58.732019] [DEBUG] [LOCAL ] COTY: Loaded 54014 existing records from primary storage. [2025-09-29T18:03:58.732367] [INFO ] [MAIN ] COTY: Loaded 54014 existing records. [2025-09-29T18:03:58.764331] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-09-29T18:03:58.983063] [WARN ] [MAIN ] COTY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:03:58.983610] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-09-29T18:03:58.983832] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-09-29T18:03:58.984484] [DEBUG] [LOCAL ] COTY: Deleted primary data file. [2025-09-29T18:03:58.984565] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-09-29T18:03:59.099968] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-29T18:03:59.390009] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-29T18:03:59.451952] [INFO ] [REMOTE ] COOK: Full fetch complete (32726 records). [2025-09-29T18:03:59.466571] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-09-29T18:03:59.551115] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-09-29T18:03:59.714988] [INFO ] [REMOTE ] COTY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:03:59.991212] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present. [2025-09-29T18:03:59.991293] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed. [2025-09-29T18:03:59.991850] [INFO ] [MAIN ] COOK: Fetched primary data is valid. [2025-09-29T18:03:59.991912] [DEBUG] [LOCAL ] COOK: Saving primary data. [2025-09-29T18:03:59.992788] [DEBUG] [LOCAL ] COOK: Trimmed 32726 records to 24365 (keeping 200 days of data) [2025-09-29T18:04:00.137255] [DEBUG] [LOCAL ] COOK: Primary data saved (24365 records). [2025-09-29T18:04:00.137422] [INFO ] [MAIN ] COOK: Full history saved. [2025-09-29T18:04:00.137528] [INFO ] [MAIN ] Update Progress: 509/2371 symbols completed. COOK took 29.0s. Estimated remaining: 3h 53m 57s. Rate: 8.0 symbols/min [2025-09-29T18:04:00.322813] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:04:00.351305] [INFO ] [REMOTE ] COTY: Fetching primary data for 2024-12. [2025-09-29T18:04:00.373568] [DEBUG] [LOCAL ] COUR: Loaded 49636 existing records from primary storage. [2025-09-29T18:04:00.373942] [INFO ] [MAIN ] COUR: Loaded 49636 existing records. [2025-09-29T18:04:00.565248] [WARN ] [MAIN ] COUR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:04:00.565480] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-09-29T18:04:00.565528] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-09-29T18:04:00.566051] [DEBUG] [LOCAL ] COUR: Deleted primary data file. [2025-09-29T18:04:00.566112] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-09-29T18:04:00.960728] [INFO ] [REMOTE ] COUR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:04:01.148171] [INFO ] [REMOTE ] COUR: Fetching primary data for 2024-12. [2025-09-29T18:04:01.235742] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-09-29T18:04:01.723563] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-29T18:04:01.948079] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-09-29T18:04:02.497536] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-29T18:04:02.748115] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-09-29T18:04:03.212364] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-29T18:04:03.548101] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-01. [2025-09-29T18:04:03.784404] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-29T18:04:04.348178] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-09-29T18:04:04.692032] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-29T18:04:04.832595] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-29T18:04:05.148165] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-09-29T18:04:05.948148] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-09-29T18:04:06.580364] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-29T18:04:06.591740] [INFO ] [REMOTE ] COP: Full fetch complete (77769 records). [2025-09-29T18:04:06.592007] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-09-29T18:04:06.751013] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-01. [2025-09-29T18:04:07.038307] [DEBUG] [VALIDATOR ] COP: All expected trading days are present. [2025-09-29T18:04:07.038464] [DEBUG] [VALIDATOR ] COP: Primary data validation passed. [2025-09-29T18:04:07.040061] [INFO ] [MAIN ] COP: Fetched primary data is valid. [2025-09-29T18:04:07.040140] [DEBUG] [LOCAL ] COP: Saving primary data. [2025-09-29T18:04:07.059772] [DEBUG] [LOCAL ] COP: Trimmed 77769 records to 53727 (keeping 200 days of data) [2025-09-29T18:04:07.076488] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-29T18:04:07.444871] [DEBUG] [LOCAL ] COP: Primary data saved (53727 records). [2025-09-29T18:04:07.445043] [INFO ] [MAIN ] COP: Full history saved. [2025-09-29T18:04:07.445260] [INFO ] [MAIN ] Update Progress: 510/2371 symbols completed. COP took 32.2s. Estimated remaining: 3h 53m 49s. Rate: 8.0 symbols/min [2025-09-29T18:04:07.551298] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-09-29T18:04:07.644278] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:04:07.663577] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-29T18:04:07.787434] [DEBUG] [LOCAL ] CP: Loaded 54051 existing records from primary storage. [2025-09-29T18:04:07.787815] [INFO ] [MAIN ] CP: Loaded 54051 existing records. [2025-09-29T18:04:07.977444] [WARN ] [MAIN ] CP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:04:07.977693] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-09-29T18:04:07.977753] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-09-29T18:04:07.978314] [DEBUG] [LOCAL ] CP: Deleted primary data file. [2025-09-29T18:04:07.978375] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-09-29T18:04:08.353461] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-09-29T18:04:08.390264] [INFO ] [REMOTE ] CP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:04:08.782786] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-29T18:04:09.041308] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-29T18:04:09.148156] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-09-29T18:04:09.663147] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-29T18:04:09.948133] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-09-29T18:04:10.748141] [INFO ] [REMOTE ] CP: Fetching primary data for 2024-12. [2025-09-29T18:04:10.818337] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-29T18:04:11.548142] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-09-29T18:04:11.735494] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-29T18:04:12.310254] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-29T18:04:12.348125] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-09-29T18:04:13.128820] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-29T18:04:13.148082] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-01. [2025-09-29T18:04:13.948444] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-09-29T18:04:14.121617] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-29T18:04:14.748153] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-09-29T18:04:14.841210] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-29T18:04:15.554430] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-09-29T18:04:15.585388] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-29T18:04:16.138153] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-29T18:04:16.348139] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-09-29T18:04:17.148107] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-09-29T18:04:17.498712] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-29T18:04:17.948089] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-09-29T18:04:18.186227] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-29T18:04:18.748129] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-09-29T18:04:18.944521] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-29T18:04:18.954392] [INFO ] [REMOTE ] COR: Full fetch complete (68871 records). [2025-09-29T18:04:18.954539] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-09-29T18:04:19.399475] [DEBUG] [VALIDATOR ] COR: All expected trading days are present. [2025-09-29T18:04:19.399637] [DEBUG] [VALIDATOR ] COR: Primary data validation passed. [2025-09-29T18:04:19.400542] [INFO ] [MAIN ] COR: Fetched primary data is valid. [2025-09-29T18:04:19.400595] [DEBUG] [LOCAL ] COR: Saving primary data. [2025-09-29T18:04:19.402047] [DEBUG] [LOCAL ] COR: Trimmed 68871 records to 47081 (keeping 200 days of data) [2025-09-29T18:04:19.600300] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-09-29T18:04:19.755527] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-29T18:04:19.774123] [DEBUG] [LOCAL ] COR: Primary data saved (47081 records). [2025-09-29T18:04:19.774443] [INFO ] [MAIN ] COR: Full history saved. [2025-09-29T18:04:19.774571] [INFO ] [MAIN ] Update Progress: 511/2371 symbols completed. COR took 33.5s. Estimated remaining: 3h 53m 59s. Rate: 7.9 symbols/min [2025-09-29T18:04:19.979707] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:04:20.016014] [DEBUG] [LOCAL ] CPA: Loaded 29208 existing records from primary storage. [2025-09-29T18:04:20.016327] [INFO ] [MAIN ] CPA: Loaded 29208 existing records. [2025-09-29T18:04:20.238973] [WARN ] [MAIN ] CPA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:04:20.239999] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-09-29T18:04:20.240146] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-09-29T18:04:20.241186] [DEBUG] [LOCAL ] CPA: Deleted primary data file. [2025-09-29T18:04:20.241248] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-09-29T18:04:20.349750] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-09-29T18:04:20.663907] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-29T18:04:20.670116] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:04:21.148099] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-09-29T18:04:21.480786] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-29T18:04:21.948132] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-09-29T18:04:22.123878] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-29T18:04:22.748090] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-09-29T18:04:23.043542] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-29T18:04:23.548096] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-09-29T18:04:23.963260] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-29T18:04:24.348135] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-09-29T18:04:24.563676] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-29T18:04:25.148104] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-09-29T18:04:25.310562] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-29T18:04:25.948092] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-09-29T18:04:26.010284] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-29T18:04:26.748096] [INFO ] [REMOTE ] CPA: Fetching primary data for 2024-12. [2025-09-29T18:04:26.911911] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-29T18:04:27.548088] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-09-29T18:04:27.892422] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-29T18:04:27.902536] [INFO ] [REMOTE ] COUR: Full fetch complete (70529 records). [2025-09-29T18:04:27.902724] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-09-29T18:04:27.903550] [FATAL] [VALIDATOR ] COUR: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:04:27.903695] [FATAL] [MAIN ] COUR: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:04:27.903762] [WARN ] [MAIN ] COUR: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:04:27.903831] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-09-29T18:04:27.903900] [DEBUG] [LOCAL ] COUR: No primary data file found to delete. [2025-09-29T18:04:27.903936] [INFO ] [LOCAL ] COUR: Starting deletion of derivative data. [2025-09-29T18:04:27.904551] [DEBUG] [LOCAL ] COUR: Deleted derivative data file. [2025-09-29T18:04:27.904719] [INFO ] [MAIN ] Update Progress: 512/2371 symbols completed. COUR took 27.8s. Estimated remaining: 3h 53m 53s. Rate: 7.9 symbols/min [2025-09-29T18:04:28.092595] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:04:28.092998] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-09-29T18:04:28.093219] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-09-29T18:04:28.093436] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-09-29T18:04:28.093623] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-09-29T18:04:28.093730] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-09-29T18:04:28.093895] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-09-29T18:04:28.285625] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-29T18:04:28.353263] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-09-29T18:04:28.515782] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:04:29.090466] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-29T18:04:29.148136] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-09-29T18:04:29.341024] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-29T18:04:29.948133] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2024-12. [2025-09-29T18:04:30.436739] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-29T18:04:30.748135] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-09-29T18:04:31.018040] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-29T18:04:31.115219] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-09-29T18:04:31.548153] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-09-29T18:04:32.021567] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-29T18:04:32.348173] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-09-29T18:04:33.148164] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-09-29T18:04:33.504009] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-29T18:04:33.948120] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-09-29T18:04:34.431550] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-29T18:04:34.442964] [INFO ] [REMOTE ] COTY: Full fetch complete (77070 records). [2025-09-29T18:04:34.443133] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-09-29T18:04:34.757617] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-09-29T18:04:34.869350] [DEBUG] [VALIDATOR ] COTY: All expected trading days are present. [2025-09-29T18:04:34.869447] [DEBUG] [VALIDATOR ] COTY: Primary data validation passed. [2025-09-29T18:04:34.870348] [INFO ] [MAIN ] COTY: Fetched primary data is valid. [2025-09-29T18:04:34.870417] [DEBUG] [LOCAL ] COTY: Saving primary data. [2025-09-29T18:04:34.873152] [DEBUG] [LOCAL ] COTY: Trimmed 77070 records to 53223 (keeping 200 days of data) [2025-09-29T18:04:35.187748] [DEBUG] [LOCAL ] COTY: Primary data saved (53223 records). [2025-09-29T18:04:35.187903] [INFO ] [MAIN ] COTY: Full history saved. [2025-09-29T18:04:35.187990] [INFO ] [MAIN ] Update Progress: 513/2371 symbols completed. COTY took 36.7s. Estimated remaining: 3h 53m 45s. Rate: 7.9 symbols/min [2025-09-29T18:04:35.325404] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-29T18:04:35.380823] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:04:35.418797] [DEBUG] [LOCAL ] CPAY: Loaded 31286 existing records from primary storage. [2025-09-29T18:04:35.419099] [INFO ] [MAIN ] CPAY: Loaded 31286 existing records. [2025-09-29T18:04:35.548815] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-09-29T18:04:35.556541] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-29T18:04:35.649950] [WARN ] [MAIN ] CPAY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:04:35.650164] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-09-29T18:04:35.650213] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-09-29T18:04:35.650753] [DEBUG] [LOCAL ] CPAY: Deleted primary data file. [2025-09-29T18:04:35.650815] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-09-29T18:04:36.028281] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:04:36.348119] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2024-12. [2025-09-29T18:04:37.148136] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-09-29T18:04:37.453805] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-29T18:04:37.519451] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-29T18:04:37.886097] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-29T18:04:37.948154] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-09-29T18:04:38.483905] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-29T18:04:38.748155] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-09-29T18:04:39.211728] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-29T18:04:39.548152] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-01. [2025-09-29T18:04:40.348155] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-09-29T18:04:40.746543] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-29T18:04:40.980906] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-29T18:04:41.148118] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-09-29T18:04:41.948163] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-09-29T18:04:42.235717] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-29T18:04:42.638130] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-29T18:04:42.639181] [INFO ] [REMOTE ] CPAC: Full fetch complete (1899 records). [2025-09-29T18:04:42.639257] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-09-29T18:04:42.750122] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-09-29T18:04:42.845952] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-29T18:04:42.846190] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:04:42.846278] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:04:42.846375] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-09-29T18:04:42.846519] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-09-29T18:04:42.846592] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-09-29T18:04:42.846694] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-09-29T18:04:42.846798] [INFO ] [MAIN ] Update Progress: 514/2371 symbols completed. CPAC took 14.9s. Estimated remaining: 3h 53m 38s. Rate: 7.9 symbols/min [2025-09-29T18:04:42.911747] [DEBUG] [REMOTE ] CPA: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-09-29T18:04:42.933846] [WARN ] [REMOTE ] CPA: No data returned for month 2025-03 [2025-09-29T18:04:42.950565] [FATAL] [REMOTE ] CPA: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T18:04:42.963108] [FATAL] [MAIN ] CPA: Failed to fetch primary data. [2025-09-29T18:04:42.963247] [WARN ] [MAIN ] CPA: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T18:04:42.969098] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-09-29T18:04:42.984584] [DEBUG] [LOCAL ] CPA: No primary data file found to delete. [2025-09-29T18:04:42.989808] [INFO ] [LOCAL ] CPA: Starting deletion of derivative data. [2025-09-29T18:04:43.034195] [DEBUG] [LOCAL ] CPA: Deleted derivative data file. [2025-09-29T18:04:43.037948] [INFO ] [MAIN ] Update Progress: 515/2371 symbols completed. CPA took 23.3s. Estimated remaining: 3h 53m 3s. Rate: 8.0 symbols/min [2025-09-29T18:04:43.037800] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:04:43.241967] [DEBUG] [LOCAL ] CPF: Loaded 15618 existing records from primary storage. [2025-09-29T18:04:43.251480] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:04:43.251929] [INFO ] [MAIN ] CPF: Loaded 15618 existing records. [2025-09-29T18:04:43.423504] [DEBUG] [LOCAL ] CPK: Loaded 13588 existing records from primary storage. [2025-09-29T18:04:43.443618] [INFO ] [MAIN ] CPK: Loaded 13588 existing records. [2025-09-29T18:04:43.551723] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-09-29T18:04:43.561673] [WARN ] [MAIN ] CPF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:04:43.576880] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-09-29T18:04:43.596942] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-09-29T18:04:43.601401] [DEBUG] [LOCAL ] CPF: Deleted primary data file. [2025-09-29T18:04:43.617507] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-09-29T18:04:43.796466] [WARN ] [MAIN ] CPK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:04:43.796784] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-09-29T18:04:43.797088] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-09-29T18:04:43.807825] [DEBUG] [LOCAL ] CPK: Deleted primary data file. [2025-09-29T18:04:43.813035] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-09-29T18:04:44.350298] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-09-29T18:04:44.383002] [INFO ] [REMOTE ] CPF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:04:44.486611] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:04:45.148112] [INFO ] [REMOTE ] CPF: Fetching primary data for 2024-12. [2025-09-29T18:04:45.621730] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-29T18:04:45.633159] [INFO ] [REMOTE ] CP: Full fetch complete (77128 records). [2025-09-29T18:04:45.633342] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-09-29T18:04:45.950766] [INFO ] [REMOTE ] CPK: Fetching primary data for 2024-12. [2025-09-29T18:04:46.075453] [DEBUG] [VALIDATOR ] CP: All expected trading days are present. [2025-09-29T18:04:46.075622] [DEBUG] [VALIDATOR ] CP: Primary data validation passed. [2025-09-29T18:04:46.076603] [INFO ] [MAIN ] CP: Fetched primary data is valid. [2025-09-29T18:04:46.076737] [DEBUG] [LOCAL ] CP: Saving primary data. [2025-09-29T18:04:46.098777] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-29T18:04:46.106101] [DEBUG] [LOCAL ] CP: Trimmed 77128 records to 53268 (keeping 200 days of data) [2025-09-29T18:04:46.459732] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-29T18:04:46.486357] [DEBUG] [LOCAL ] CP: Primary data saved (53268 records). [2025-09-29T18:04:46.486529] [INFO ] [MAIN ] CP: Full history saved. [2025-09-29T18:04:46.486623] [INFO ] [MAIN ] Update Progress: 516/2371 symbols completed. CP took 39.0s. Estimated remaining: 3h 52m 41s. Rate: 8.0 symbols/min [2025-09-29T18:04:46.663015] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:04:46.723375] [DEBUG] [LOCAL ] CPNG: Loaded 54450 existing records from primary storage. [2025-09-29T18:04:46.723920] [INFO ] [MAIN ] CPNG: Loaded 54450 existing records. [2025-09-29T18:04:46.756029] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-09-29T18:04:46.863666] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-29T18:04:46.926859] [WARN ] [MAIN ] CPNG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:04:46.927075] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-09-29T18:04:46.927125] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-09-29T18:04:46.927519] [DEBUG] [LOCAL ] CPNG: Deleted primary data file. [2025-09-29T18:04:46.927580] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-09-29T18:04:47.293854] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:04:47.548134] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2024-12. [2025-09-29T18:04:48.348093] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-09-29T18:04:48.438618] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-29T18:04:48.857802] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-29T18:04:49.148109] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-09-29T18:04:49.728421] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-29T18:04:49.948127] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-01. [2025-09-29T18:04:50.502014] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-29T18:04:50.748160] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-09-29T18:04:50.804496] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-29T18:04:51.548141] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-09-29T18:04:51.659011] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-29T18:04:52.348072] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-09-29T18:04:52.821376] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-29T18:04:52.933799] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-29T18:04:53.148185] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-09-29T18:04:53.948089] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-01. [2025-09-29T18:04:54.438380] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-29T18:04:54.748090] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-09-29T18:04:55.548087] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-09-29T18:04:55.820031] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-29T18:04:56.011028] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-29T18:04:56.348128] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-09-29T18:04:56.641600] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-29T18:04:57.148117] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-09-29T18:04:57.948139] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-09-29T18:04:58.650981] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-29T18:04:58.704363] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-09-29T18:04:58.748074] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-09-29T18:04:58.990092] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-29T18:04:59.548144] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-09-29T18:05:00.215949] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-29T18:05:00.225632] [INFO ] [REMOTE ] CPAY: Full fetch complete (45012 records). [2025-09-29T18:05:00.225863] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-09-29T18:05:00.352183] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-09-29T18:05:00.604442] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-29T18:05:00.711979] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-09-29T18:05:00.712076] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-09-29T18:05:00.712800] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-09-29T18:05:00.712869] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-09-29T18:05:00.714042] [DEBUG] [LOCAL ] CPAY: Trimmed 45012 records to 30608 (keeping 200 days of data) [2025-09-29T18:05:00.906436] [DEBUG] [LOCAL ] CPAY: Primary data saved (30608 records). [2025-09-29T18:05:00.906585] [INFO ] [MAIN ] CPAY: Full history saved. [2025-09-29T18:05:00.906712] [INFO ] [MAIN ] Update Progress: 517/2371 symbols completed. CPAY took 25.7s. Estimated remaining: 3h 52m 58s. Rate: 8.0 symbols/min [2025-09-29T18:05:01.148166] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-09-29T18:05:01.948167] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-09-29T18:05:02.141540] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-29T18:05:02.750690] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-09-29T18:05:02.763127] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-09-29T18:05:03.140178] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-29T18:05:03.519456] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-29T18:05:03.548077] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-09-29T18:05:04.348109] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-09-29T18:05:04.385763] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-29T18:05:05.148086] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-09-29T18:05:05.181938] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-29T18:05:05.948188] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-09-29T18:05:06.249632] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-29T18:05:06.253180] [INFO ] [REMOTE ] CPK: Full fetch complete (17789 records). [2025-09-29T18:05:06.253314] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-09-29T18:05:06.735825] [DEBUG] [VALIDATOR ] CPK: All expected trading days are present. [2025-09-29T18:05:06.735918] [DEBUG] [VALIDATOR ] CPK: Primary data validation passed. [2025-09-29T18:05:06.736379] [INFO ] [MAIN ] CPK: Fetched primary data is valid. [2025-09-29T18:05:06.736425] [DEBUG] [LOCAL ] CPK: Saving primary data. [2025-09-29T18:05:06.737155] [DEBUG] [LOCAL ] CPK: Trimmed 17789 records to 13437 (keeping 200 days of data) [2025-09-29T18:05:06.787602] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-09-29T18:05:06.850555] [DEBUG] [LOCAL ] CPK: Primary data saved (13437 records). [2025-09-29T18:05:06.850742] [INFO ] [MAIN ] CPK: Full history saved. [2025-09-29T18:05:06.850846] [INFO ] [MAIN ] Update Progress: 518/2371 symbols completed. CPK took 23.8s. Estimated remaining: 3h 52m 45s. Rate: 8.0 symbols/min [2025-09-29T18:05:07.886970] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-29T18:05:07.898958] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-09-29T18:05:07.936497] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-29T18:05:08.348162] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-09-29T18:05:09.323137] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-29T18:05:09.327611] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-09-29T18:05:10.107898] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-29T18:05:10.120814] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-09-29T18:05:10.277574] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-29T18:05:10.748113] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-09-29T18:05:11.859862] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-29T18:05:11.863886] [INFO ] [REMOTE ] CPF: Full fetch complete (24151 records). [2025-09-29T18:05:11.864020] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-09-29T18:05:12.316013] [DEBUG] [VALIDATOR ] CPF: All expected trading days are present. [2025-09-29T18:05:12.316301] [DEBUG] [VALIDATOR ] CPF: Primary data validation passed. [2025-09-29T18:05:12.317058] [INFO ] [MAIN ] CPF: Fetched primary data is valid. [2025-09-29T18:05:12.317163] [DEBUG] [LOCAL ] CPF: Saving primary data. [2025-09-29T18:05:12.318173] [DEBUG] [LOCAL ] CPF: Trimmed 24151 records to 15248 (keeping 200 days of data) [2025-09-29T18:05:12.398693] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-09-29T18:05:12.431387] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-09-29T18:05:12.459919] [DEBUG] [LOCAL ] CPF: Primary data saved (15248 records). [2025-09-29T18:05:12.460063] [INFO ] [MAIN ] CPF: Full history saved. [2025-09-29T18:05:12.460154] [INFO ] [MAIN ] Update Progress: 519/2371 symbols completed. CPF took 29.6s. Estimated remaining: 3h 52m 31s. Rate: 8.0 symbols/min [2025-09-29T18:05:14.620086] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-29T18:05:14.635184] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-09-29T18:05:19.186917] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (4.55 seconds). [2025-09-29T18:05:19.199015] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-09-29T18:05:21.969020] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (2.77 seconds). [2025-09-29T18:05:21.980378] [INFO ] [REMOTE ] CPNG: Full fetch complete (77670 records). [2025-09-29T18:05:21.980533] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-09-29T18:05:22.425344] [DEBUG] [VALIDATOR ] CPNG: All expected trading days are present. [2025-09-29T18:05:22.425431] [DEBUG] [VALIDATOR ] CPNG: Primary data validation passed. [2025-09-29T18:05:22.426433] [INFO ] [MAIN ] CPNG: Fetched primary data is valid. [2025-09-29T18:05:22.426500] [DEBUG] [LOCAL ] CPNG: Saving primary data. [2025-09-29T18:05:22.428250] [DEBUG] [LOCAL ] CPNG: Trimmed 77670 records to 53670 (keeping 200 days of data) [2025-09-29T18:05:22.765497] [DEBUG] [LOCAL ] CPNG: Primary data saved (53670 records). [2025-09-29T18:05:22.765743] [INFO ] [MAIN ] CPNG: Full history saved. [2025-09-29T18:05:22.765974] [INFO ] [MAIN ] Update Progress: 520/2371 symbols completed. CPNG took 36.3s. Estimated remaining: 3h 52m 33s. Rate: 8.0 symbols/min [2025-09-29T18:05:23.352833] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:05:23.511605] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:05:23.522369] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:05:23.551267] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:05:23.578275] [DEBUG] [LOCAL ] CQP: Loaded 20033 existing records from primary storage. [2025-09-29T18:05:23.578603] [INFO ] [MAIN ] CQP: Loaded 20033 existing records. [2025-09-29T18:05:23.739170] [DEBUG] [LOCAL ] CPS: Loaded 26476 existing records from primary storage. [2025-09-29T18:05:23.745687] [INFO ] [MAIN ] CPS: Loaded 26476 existing records. [2025-09-29T18:05:23.893496] [DEBUG] [LOCAL ] CPT: Loaded 45034 existing records from primary storage. [2025-09-29T18:05:23.904427] [DEBUG] [LOCAL ] CPRI: Loaded 53326 existing records from primary storage. [2025-09-29T18:05:23.952044] [INFO ] [MAIN ] CPRI: Loaded 53326 existing records. [2025-09-29T18:05:23.946584] [INFO ] [MAIN ] CPT: Loaded 45034 existing records. [2025-09-29T18:05:23.973028] [WARN ] [MAIN ] CQP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:05:24.014888] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-09-29T18:05:24.043670] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-09-29T18:05:24.059391] [DEBUG] [LOCAL ] CQP: Deleted primary data file. [2025-09-29T18:05:24.074158] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-09-29T18:05:24.438022] [WARN ] [MAIN ] CPS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:05:24.469318] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-09-29T18:05:24.484997] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-09-29T18:05:24.564214] [DEBUG] [LOCAL ] CPS: Deleted primary data file. [2025-09-29T18:05:24.661178] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-09-29T18:05:24.691880] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:05:24.702628] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-09-29T18:05:24.706536] [WARN ] [MAIN ] CPRI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:05:24.808268] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-09-29T18:05:24.788592] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-09-29T18:05:24.836537] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-09-29T18:05:24.836592] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-09-29T18:05:24.864996] [DEBUG] [LOCAL ] CPRI: Deleted primary data file. [2025-09-29T18:05:24.865072] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-09-29T18:05:24.941302] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-09-29T18:05:25.685142] [INFO ] [REMOTE ] CQP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:05:25.737691] [INFO ] [REMOTE ] CQP: Fetching primary data for 2024-12. [2025-09-29T18:05:26.125203] [INFO ] [REMOTE ] CPS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:05:26.189342] [INFO ] [REMOTE ] CPS: Fetching primary data for 2024-12. [2025-09-29T18:05:26.220963] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:05:26.237019] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2024-12. [2025-09-29T18:05:26.298757] [INFO ] [REMOTE ] CPT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:05:26.299063] [INFO ] [REMOTE ] CPT: Fetching primary data for 2024-12. [2025-09-29T18:05:26.811215] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-29T18:05:26.816292] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-01. [2025-09-29T18:05:27.604019] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-29T18:05:27.608599] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-01. [2025-09-29T18:05:27.886881] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-29T18:05:27.895528] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-01. [2025-09-29T18:05:28.002741] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-29T18:05:28.014680] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-01. [2025-09-29T18:05:28.032051] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-29T18:05:28.043099] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-09-29T18:05:28.528736] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-29T18:05:28.534034] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-09-29T18:05:28.986369] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-29T18:05:28.992448] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-09-29T18:05:29.516751] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-29T18:05:29.529052] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-09-29T18:05:29.575340] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-29T18:05:29.576542] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-29T18:05:29.591714] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-09-29T18:05:29.592481] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-09-29T18:05:29.751910] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-29T18:05:29.757333] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-09-29T18:05:30.544019] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-29T18:05:30.550338] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-09-29T18:05:30.832253] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-29T18:05:30.834425] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-29T18:05:30.839457] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-09-29T18:05:30.850252] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-09-29T18:05:31.292198] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-29T18:05:31.303525] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-09-29T18:05:32.076412] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-29T18:05:32.088555] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-09-29T18:05:32.139954] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-29T18:05:32.148245] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-09-29T18:05:32.281492] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-29T18:05:32.291862] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-09-29T18:05:32.729683] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-29T18:05:32.741611] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-09-29T18:05:33.248611] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-29T18:05:33.255813] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-09-29T18:05:33.412991] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-29T18:05:33.420555] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-09-29T18:05:33.810791] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-29T18:05:33.948135] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-09-29T18:05:34.223555] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-29T18:05:34.435061] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-29T18:05:34.527081] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-29T18:05:34.748157] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-09-29T18:05:35.450283] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-29T18:05:35.548164] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-09-29T18:05:36.348137] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-09-29T18:05:36.579282] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-29T18:05:36.626091] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-29T18:05:37.148167] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-09-29T18:05:37.515770] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-29T18:05:37.948109] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-09-29T18:05:38.176024] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-29T18:05:38.179296] [INFO ] [REMOTE ] CQP: Full fetch complete (30745 records). [2025-09-29T18:05:38.179444] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-09-29T18:05:38.571599] [DEBUG] [VALIDATOR ] CQP: All expected trading days are present. [2025-09-29T18:05:38.571727] [DEBUG] [VALIDATOR ] CQP: Primary data validation passed. [2025-09-29T18:05:38.572343] [INFO ] [MAIN ] CQP: Fetched primary data is valid. [2025-09-29T18:05:38.572419] [DEBUG] [LOCAL ] CQP: Saving primary data. [2025-09-29T18:05:38.573287] [DEBUG] [LOCAL ] CQP: Trimmed 30745 records to 19676 (keeping 200 days of data) [2025-09-29T18:05:38.706767] [DEBUG] [LOCAL ] CQP: Primary data saved (19676 records). [2025-09-29T18:05:38.707034] [INFO ] [MAIN ] CQP: Full history saved. [2025-09-29T18:05:38.707257] [INFO ] [MAIN ] Update Progress: 521/2371 symbols completed. CQP took 15.9s. Estimated remaining: 3h 52m 55s. Rate: 7.9 symbols/min [2025-09-29T18:05:38.756399] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-09-29T18:05:38.908887] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:05:38.938119] [DEBUG] [LOCAL ] CR: Loaded 25019 existing records from primary storage. [2025-09-29T18:05:38.938395] [INFO ] [MAIN ] CR: Loaded 25019 existing records. [2025-09-29T18:05:39.133018] [WARN ] [MAIN ] CR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:05:39.133286] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-09-29T18:05:39.133346] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-09-29T18:05:39.133883] [DEBUG] [LOCAL ] CR: Deleted primary data file. [2025-09-29T18:05:39.133960] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-09-29T18:05:39.520077] [INFO ] [REMOTE ] CR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:05:39.548079] [INFO ] [REMOTE ] CR: Fetching primary data for 2024-12. [2025-09-29T18:05:39.692201] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-29T18:05:39.935087] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-29T18:05:40.348109] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-09-29T18:05:40.571708] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-29T18:05:41.148090] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-01. [2025-09-29T18:05:41.310864] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-29T18:05:41.948142] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-09-29T18:05:42.369062] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-29T18:05:42.748115] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-09-29T18:05:43.548116] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-09-29T18:05:43.703860] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-29T18:05:43.750833] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-29T18:05:44.348146] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-09-29T18:05:45.148115] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-09-29T18:05:45.184159] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-29T18:05:45.606509] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-29T18:05:45.948116] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-09-29T18:05:46.748142] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-09-29T18:05:46.835940] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-29T18:05:47.012276] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-29T18:05:47.017189] [INFO ] [REMOTE ] CPS: Full fetch complete (36113 records). [2025-09-29T18:05:47.017287] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-09-29T18:05:47.018700] [FATAL] [VALIDATOR ] CPS: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:05:47.018794] [FATAL] [MAIN ] CPS: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:05:47.018841] [WARN ] [MAIN ] CPS: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:05:47.018912] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-09-29T18:05:47.019018] [DEBUG] [LOCAL ] CPS: No primary data file found to delete. [2025-09-29T18:05:47.019087] [INFO ] [LOCAL ] CPS: Starting deletion of derivative data. [2025-09-29T18:05:47.019521] [DEBUG] [LOCAL ] CPS: Deleted derivative data file. [2025-09-29T18:05:47.019635] [INFO ] [MAIN ] Update Progress: 522/2371 symbols completed. CPS took 24.2s. Estimated remaining: 3h 52m 51s. Rate: 7.9 symbols/min [2025-09-29T18:05:47.205832] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:05:47.217111] [DEBUG] [LOCAL ] CRBD: Loaded 9131 existing records from primary storage. [2025-09-29T18:05:47.217359] [INFO ] [MAIN ] CRBD: Loaded 9131 existing records. [2025-09-29T18:05:47.409230] [WARN ] [MAIN ] CRBD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:05:47.409512] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-09-29T18:05:47.409583] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-09-29T18:05:47.410079] [DEBUG] [LOCAL ] CRBD: Deleted primary data file. [2025-09-29T18:05:47.410140] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-09-29T18:05:47.558362] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-09-29T18:05:47.811945] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:05:48.197366] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-29T18:05:48.348112] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2024-12. [2025-09-29T18:05:49.148086] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-09-29T18:05:49.229026] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-29T18:05:49.238579] [INFO ] [REMOTE ] CPT: Full fetch complete (63783 records). [2025-09-29T18:05:49.238740] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-09-29T18:05:49.688450] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-29T18:05:49.688674] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-09-29T18:05:49.696316] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-09-29T18:05:49.698065] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-09-29T18:05:49.698150] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-09-29T18:05:49.699475] [DEBUG] [LOCAL ] CPT: Trimmed 63783 records to 44317 (keeping 200 days of data) [2025-09-29T18:05:49.948093] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-09-29T18:05:49.973028] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-29T18:05:50.020792] [DEBUG] [LOCAL ] CPT: Primary data saved (44317 records). [2025-09-29T18:05:50.020940] [INFO ] [MAIN ] CPT: Full history saved. [2025-09-29T18:05:50.021027] [INFO ] [MAIN ] Update Progress: 523/2371 symbols completed. CPT took 27.3s. Estimated remaining: 3h 52m 27s. Rate: 8.0 symbols/min [2025-09-29T18:05:50.198444] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:05:50.253257] [DEBUG] [LOCAL ] CRBG: Loaded 53110 existing records from primary storage. [2025-09-29T18:05:50.253576] [INFO ] [MAIN ] CRBG: Loaded 53110 existing records. [2025-09-29T18:05:50.451148] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:05:50.451450] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-09-29T18:05:50.451511] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-09-29T18:05:50.452090] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-09-29T18:05:50.452151] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-09-29T18:05:50.753361] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-09-29T18:05:50.841521] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:05:51.548145] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2024-12. [2025-09-29T18:05:51.779147] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-29T18:05:51.814094] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-29T18:05:52.348121] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-09-29T18:05:53.148086] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-01. [2025-09-29T18:05:53.258101] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-29T18:05:53.598693] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-29T18:05:53.663564] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-29T18:05:53.948130] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-09-29T18:05:54.748092] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-09-29T18:05:55.084639] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-29T18:05:55.548151] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-09-29T18:05:56.348128] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-09-29T18:05:56.708389] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-29T18:05:56.714022] [INFO ] [REMOTE ] CR: Full fetch complete (34810 records). [2025-09-29T18:05:56.714140] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-09-29T18:05:56.714718] [FATAL] [VALIDATOR ] CR: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:05:56.714805] [FATAL] [MAIN ] CR: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:05:56.714850] [WARN ] [MAIN ] CR: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:05:56.714918] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-09-29T18:05:56.714985] [DEBUG] [LOCAL ] CR: No primary data file found to delete. [2025-09-29T18:05:56.715022] [INFO ] [LOCAL ] CR: Starting deletion of derivative data. [2025-09-29T18:05:56.715306] [DEBUG] [LOCAL ] CR: Deleted derivative data file. [2025-09-29T18:05:56.715400] [INFO ] [MAIN ] Update Progress: 524/2371 symbols completed. CR took 18.0s. Estimated remaining: 3h 52m 16s. Rate: 8.0 symbols/min [2025-09-29T18:05:56.895859] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:05:56.945166] [DEBUG] [LOCAL ] CRC: Loaded 44946 existing records from primary storage. [2025-09-29T18:05:56.945505] [INFO ] [MAIN ] CRC: Loaded 44946 existing records. [2025-09-29T18:05:57.168805] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-09-29T18:05:57.175671] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:05:57.176482] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-09-29T18:05:57.178527] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-09-29T18:05:57.191195] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-09-29T18:05:57.192859] [INFO ] [REMOTE ] CPRI: Full fetch complete (75767 records). [2025-09-29T18:05:57.192991] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-09-29T18:05:57.193098] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-09-29T18:05:57.192963] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-09-29T18:05:57.268733] [FATAL] [VALIDATOR ] CPRI: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:05:57.297927] [FATAL] [MAIN ] CPRI: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:05:57.309218] [WARN ] [MAIN ] CPRI: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:05:57.309716] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-09-29T18:05:57.330739] [DEBUG] [LOCAL ] CPRI: No primary data file found to delete. [2025-09-29T18:05:57.350427] [INFO ] [LOCAL ] CPRI: Starting deletion of derivative data. [2025-09-29T18:05:57.389778] [DEBUG] [LOCAL ] CPRI: Deleted derivative data file. [2025-09-29T18:05:57.428070] [INFO ] [MAIN ] Update Progress: 525/2371 symbols completed. CPRI took 34.7s. Estimated remaining: 3h 51m 45s. Rate: 8.0 symbols/min [2025-09-29T18:05:57.720910] [INFO ] [REMOTE ] CRC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:05:57.780423] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:05:57.780813] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-09-29T18:05:57.780887] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-09-29T18:05:57.787708] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-09-29T18:05:57.787925] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-29T18:05:57.788125] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-09-29T18:05:57.790914] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-09-29T18:05:57.790964] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-09-29T18:05:57.949728] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-09-29T18:05:58.218114] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:05:58.263262] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-29T18:05:58.673451] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-29T18:05:58.748123] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-09-29T18:05:59.548345] [INFO ] [REMOTE ] CRC: Fetching primary data for 2024-12. [2025-09-29T18:06:00.348116] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-09-29T18:06:00.405485] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-29T18:06:01.148119] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-09-29T18:06:01.320605] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-29T18:06:01.330550] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-29T18:06:01.948130] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-09-29T18:06:02.632312] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-29T18:06:02.748143] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-09-29T18:06:02.916123] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-29T18:06:03.548126] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2024-12. [2025-09-29T18:06:03.777471] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T18:06:03.777843] [WARN ] [REMOTE ] CRCL: No data returned for month 2024-12 [2025-09-29T18:06:03.777998] [FATAL] [REMOTE ] CRCL: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T18:06:03.778047] [FATAL] [MAIN ] CRCL: Failed to fetch primary data. [2025-09-29T18:06:03.778341] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T18:06:03.778431] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-09-29T18:06:03.778534] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-09-29T18:06:03.778591] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-09-29T18:06:03.778671] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-09-29T18:06:03.778757] [INFO ] [MAIN ] Update Progress: 526/2371 symbols completed. CRCL took 6.3s. Estimated remaining: 3h 51m 33s. Rate: 8.0 symbols/min [2025-09-29T18:06:03.978598] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:06:04.039414] [DEBUG] [LOCAL ] CRGY: Loaded 53290 existing records from primary storage. [2025-09-29T18:06:04.039894] [INFO ] [MAIN ] CRGY: Loaded 53290 existing records. [2025-09-29T18:06:04.243138] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:06:04.243673] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-09-29T18:06:04.243776] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-09-29T18:06:04.252236] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-09-29T18:06:04.258082] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-09-29T18:06:04.353757] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-29T18:06:04.364158] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-09-29T18:06:04.691309] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:06:05.148143] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2024-12. [2025-09-29T18:06:05.224765] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-29T18:06:05.948135] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-09-29T18:06:06.748155] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-09-29T18:06:07.042254] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-29T18:06:07.365705] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-29T18:06:07.525422] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-29T18:06:07.548082] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-01. [2025-09-29T18:06:08.348108] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-09-29T18:06:09.148106] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-09-29T18:06:09.321877] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-29T18:06:09.948081] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-09-29T18:06:09.993096] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-29T18:06:10.748080] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-09-29T18:06:11.072536] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-29T18:06:11.223486] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-29T18:06:11.548157] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-09-29T18:06:12.348134] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-09-29T18:06:13.031841] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-29T18:06:13.148148] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-09-29T18:06:13.881773] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-29T18:06:13.948094] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-09-29T18:06:14.404196] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-29T18:06:14.492284] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (3.74 seconds). [2025-09-29T18:06:14.748166] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-09-29T18:06:15.548098] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-09-29T18:06:15.785097] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-29T18:06:16.348079] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-09-29T18:06:16.415936] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-29T18:06:16.905180] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-29T18:06:17.148127] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-09-29T18:06:17.948120] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-09-29T18:06:18.151926] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-29T18:06:18.748129] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-09-29T18:06:18.882884] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-29T18:06:19.305887] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-29T18:06:19.548117] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-09-29T18:06:20.081308] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-29T18:06:20.348088] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-09-29T18:06:20.753804] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-29T18:06:21.148115] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-09-29T18:06:21.174161] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-29T18:06:21.176256] [INFO ] [REMOTE ] CRBD: Full fetch complete (15139 records). [2025-09-29T18:06:21.176337] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-09-29T18:06:21.575306] [DEBUG] [VALIDATOR ] CRBD: All expected trading days are present. [2025-09-29T18:06:21.575458] [DEBUG] [VALIDATOR ] CRBD: Primary data validation passed. [2025-09-29T18:06:21.575889] [INFO ] [MAIN ] CRBD: Fetched primary data is valid. [2025-09-29T18:06:21.575969] [DEBUG] [LOCAL ] CRBD: Saving primary data. [2025-09-29T18:06:21.576509] [DEBUG] [LOCAL ] CRBD: Trimmed 15139 records to 9005 (keeping 200 days of data) [2025-09-29T18:06:21.639779] [DEBUG] [LOCAL ] CRBD: Primary data saved (9005 records). [2025-09-29T18:06:21.639928] [INFO ] [MAIN ] CRBD: Full history saved. [2025-09-29T18:06:21.640017] [INFO ] [MAIN ] Update Progress: 527/2371 symbols completed. CRBD took 34.6s. Estimated remaining: 3h 52m 2s. Rate: 7.9 symbols/min [2025-09-29T18:06:21.839730] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:06:21.903512] [DEBUG] [LOCAL ] CRH: Loaded 54243 existing records from primary storage. [2025-09-29T18:06:21.903968] [INFO ] [MAIN ] CRH: Loaded 54243 existing records. [2025-09-29T18:06:21.958630] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-09-29T18:06:22.093929] [WARN ] [MAIN ] CRH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:06:22.094142] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-09-29T18:06:22.094190] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-09-29T18:06:22.094619] [DEBUG] [LOCAL ] CRH: Deleted primary data file. [2025-09-29T18:06:22.094715] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-09-29T18:06:22.476664] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:06:22.748115] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-09-29T18:06:23.508324] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-09-29T18:06:23.520226] [INFO ] [REMOTE ] CRBG: Full fetch complete (75687 records). [2025-09-29T18:06:23.520440] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-09-29T18:06:23.555188] [INFO ] [REMOTE ] CRH: Fetching primary data for 2024-12. [2025-09-29T18:06:23.973125] [DEBUG] [VALIDATOR ] CRBG: All expected trading days are present. [2025-09-29T18:06:23.973387] [DEBUG] [VALIDATOR ] CRBG: Primary data validation passed. [2025-09-29T18:06:23.974550] [INFO ] [MAIN ] CRBG: Fetched primary data is valid. [2025-09-29T18:06:23.974666] [DEBUG] [LOCAL ] CRBG: Saving primary data. [2025-09-29T18:06:24.017134] [DEBUG] [LOCAL ] CRBG: Trimmed 75687 records to 52335 (keeping 200 days of data) [2025-09-29T18:06:24.020262] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-29T18:06:24.349087] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-09-29T18:06:24.398481] [DEBUG] [LOCAL ] CRBG: Primary data saved (52335 records). [2025-09-29T18:06:24.398636] [INFO ] [MAIN ] CRBG: Full history saved. [2025-09-29T18:06:24.398790] [INFO ] [MAIN ] Update Progress: 528/2371 symbols completed. CRBG took 34.4s. Estimated remaining: 3h 51m 37s. Rate: 8.0 symbols/min [2025-09-29T18:06:24.611876] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:06:24.617223] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-29T18:06:24.677710] [DEBUG] [LOCAL ] CRI: Loaded 50713 existing records from primary storage. [2025-09-29T18:06:24.678098] [INFO ] [MAIN ] CRI: Loaded 50713 existing records. [2025-09-29T18:06:24.877981] [WARN ] [MAIN ] CRI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:06:24.878249] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-09-29T18:06:24.878300] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-09-29T18:06:24.878623] [DEBUG] [LOCAL ] CRI: Deleted primary data file. [2025-09-29T18:06:24.878776] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-09-29T18:06:25.158392] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-09-29T18:06:25.306116] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:06:25.600661] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-29T18:06:25.801720] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-29T18:06:25.948147] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-09-29T18:06:26.748167] [INFO ] [REMOTE ] CRI: Fetching primary data for 2024-12. [2025-09-29T18:06:26.795123] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-29T18:06:27.548139] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-09-29T18:06:28.025845] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-29T18:06:28.036850] [INFO ] [REMOTE ] CRGY: Full fetch complete (75961 records). [2025-09-29T18:06:28.037019] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-09-29T18:06:28.356378] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-09-29T18:06:28.474210] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-09-29T18:06:28.474338] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-09-29T18:06:28.475537] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-09-29T18:06:28.475734] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-09-29T18:06:28.477600] [DEBUG] [LOCAL ] CRGY: Trimmed 75961 records to 52509 (keeping 200 days of data) [2025-09-29T18:06:28.600398] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-29T18:06:28.886750] [DEBUG] [LOCAL ] CRGY: Primary data saved (52509 records). [2025-09-29T18:06:28.887064] [INFO ] [MAIN ] CRGY: Full history saved. [2025-09-29T18:06:28.887215] [INFO ] [MAIN ] Update Progress: 529/2371 symbols completed. CRGY took 25.1s. Estimated remaining: 3h 51m 19s. Rate: 8.0 symbols/min [2025-09-29T18:06:29.076120] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:06:29.115551] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-29T18:06:29.126296] [INFO ] [REMOTE ] CRC: Full fetch complete (62317 records). [2025-09-29T18:06:29.126564] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-09-29T18:06:29.153271] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-09-29T18:06:29.430680] [DEBUG] [LOCAL ] CRK: Loaded 52891 existing records from primary storage. [2025-09-29T18:06:29.477618] [INFO ] [MAIN ] CRK: Loaded 52891 existing records. [2025-09-29T18:06:29.790460] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present. [2025-09-29T18:06:29.790917] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed. [2025-09-29T18:06:29.819578] [WARN ] [MAIN ] CRK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:06:29.812595] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-09-29T18:06:29.820915] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-09-29T18:06:29.821188] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-09-29T18:06:29.821372] [DEBUG] [LOCAL ] CRC: Saving primary data. [2025-09-29T18:06:29.822107] [DEBUG] [LOCAL ] CRK: Deleted primary data file. [2025-09-29T18:06:29.822194] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-09-29T18:06:29.903975] [DEBUG] [LOCAL ] CRC: Trimmed 62317 records to 44146 (keeping 200 days of data) [2025-09-29T18:06:30.350795] [INFO ] [REMOTE ] CRK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:06:30.355474] [INFO ] [REMOTE ] CRK: Fetching primary data for 2024-12. [2025-09-29T18:06:30.479832] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-29T18:06:30.558730] [DEBUG] [LOCAL ] CRC: Primary data saved (44146 records). [2025-09-29T18:06:30.558875] [INFO ] [MAIN ] CRC: Full history saved. [2025-09-29T18:06:30.558966] [INFO ] [MAIN ] Update Progress: 530/2371 symbols completed. CRC took 33.8s. Estimated remaining: 3h 50m 51s. Rate: 8.0 symbols/min [2025-09-29T18:06:30.749389] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-09-29T18:06:30.750636] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:06:30.781513] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-29T18:06:30.831605] [DEBUG] [LOCAL ] CRL: Loaded 43853 existing records from primary storage. [2025-09-29T18:06:30.831985] [INFO ] [MAIN ] CRL: Loaded 43853 existing records. [2025-09-29T18:06:31.012425] [WARN ] [MAIN ] CRL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:06:31.012691] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-09-29T18:06:31.012752] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-09-29T18:06:31.013248] [DEBUG] [LOCAL ] CRL: Deleted primary data file. [2025-09-29T18:06:31.013311] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-09-29T18:06:31.389494] [INFO ] [REMOTE ] CRL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:06:31.548141] [INFO ] [REMOTE ] CRL: Fetching primary data for 2024-12. [2025-09-29T18:06:32.265902] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-29T18:06:32.348109] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-09-29T18:06:32.906272] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-09-29T18:06:33.148134] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-09-29T18:06:33.208521] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-29T18:06:33.902004] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-29T18:06:33.948101] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-09-29T18:06:34.748099] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-01. [2025-09-29T18:06:35.208081] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-29T18:06:35.548073] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-09-29T18:06:35.595035] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-29T18:06:35.862117] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-29T18:06:36.348099] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-09-29T18:06:37.114724] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-29T18:06:37.148099] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-09-29T18:06:37.948167] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-09-29T18:06:38.623478] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-29T18:06:38.748123] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-09-29T18:06:38.900873] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-29T18:06:39.548118] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-09-29T18:06:39.612559] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-29T18:06:40.348110] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-09-29T18:06:40.745150] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-29T18:06:40.970383] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-29T18:06:41.148114] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-09-29T18:06:41.924998] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-29T18:06:41.948064] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-09-29T18:06:42.753276] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-09-29T18:06:42.767985] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-29T18:06:43.548122] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-09-29T18:06:43.738910] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-29T18:06:44.348112] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-09-29T18:06:44.599191] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-29T18:06:44.736492] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-29T18:06:45.148152] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-09-29T18:06:45.948130] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-09-29T18:06:46.203611] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-29T18:06:46.748095] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-09-29T18:06:46.979055] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-29T18:06:47.202035] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-29T18:06:47.548137] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-09-29T18:06:48.355127] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-09-29T18:06:48.378873] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-29T18:06:49.148108] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-09-29T18:06:49.368845] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-29T18:06:49.846766] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-29T18:06:49.948125] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-09-29T18:06:50.748161] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-09-29T18:06:51.265948] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-29T18:06:51.412602] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-29T18:06:51.548139] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-09-29T18:06:52.348088] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-09-29T18:06:52.597702] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-29T18:06:53.148116] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-09-29T18:06:53.550221] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-29T18:06:53.948166] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-09-29T18:06:54.220308] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-29T18:06:54.748149] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-09-29T18:06:55.046192] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-29T18:06:55.548083] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-09-29T18:06:55.598926] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-29T18:06:55.609776] [INFO ] [REMOTE ] CRH: Full fetch complete (77295 records). [2025-09-29T18:06:55.609939] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-09-29T18:06:56.048030] [DEBUG] [VALIDATOR ] CRH: All expected trading days are present. [2025-09-29T18:06:56.048143] [DEBUG] [VALIDATOR ] CRH: Primary data validation passed. [2025-09-29T18:06:56.049093] [INFO ] [MAIN ] CRH: Fetched primary data is valid. [2025-09-29T18:06:56.049172] [DEBUG] [LOCAL ] CRH: Saving primary data. [2025-09-29T18:06:56.050703] [DEBUG] [LOCAL ] CRH: Trimmed 77295 records to 53463 (keeping 200 days of data) [2025-09-29T18:06:56.353407] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-09-29T18:06:56.407240] [DEBUG] [LOCAL ] CRH: Primary data saved (53463 records). [2025-09-29T18:06:56.407484] [INFO ] [MAIN ] CRH: Full history saved. [2025-09-29T18:06:56.407702] [INFO ] [MAIN ] Update Progress: 531/2371 symbols completed. CRH took 34.8s. Estimated remaining: 3h 51m 47s. Rate: 7.9 symbols/min [2025-09-29T18:06:56.610896] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:06:56.647290] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-29T18:06:56.692390] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-29T18:06:56.741627] [DEBUG] [LOCAL ] CRM: Loaded 54550 existing records from primary storage. [2025-09-29T18:06:56.742003] [INFO ] [MAIN ] CRM: Loaded 54550 existing records. [2025-09-29T18:06:56.922549] [WARN ] [MAIN ] CRM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:06:56.922855] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-09-29T18:06:56.922934] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-09-29T18:06:56.923935] [DEBUG] [LOCAL ] CRM: Deleted primary data file. [2025-09-29T18:06:56.924000] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-09-29T18:06:57.159999] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-09-29T18:06:57.290925] [INFO ] [REMOTE ] CRM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:06:57.933565] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-29T18:06:57.943822] [INFO ] [REMOTE ] CRI: Full fetch complete (70969 records). [2025-09-29T18:06:57.943984] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-09-29T18:06:57.956244] [INFO ] [REMOTE ] CRM: Fetching primary data for 2024-12. [2025-09-29T18:06:58.369296] [DEBUG] [VALIDATOR ] CRI: All expected trading days are present. [2025-09-29T18:06:58.369405] [DEBUG] [VALIDATOR ] CRI: Primary data validation passed. [2025-09-29T18:06:58.370392] [INFO ] [MAIN ] CRI: Fetched primary data is valid. [2025-09-29T18:06:58.370459] [DEBUG] [LOCAL ] CRI: Saving primary data. [2025-09-29T18:06:58.371982] [DEBUG] [LOCAL ] CRI: Trimmed 70969 records to 49926 (keeping 200 days of data) [2025-09-29T18:06:58.692401] [DEBUG] [LOCAL ] CRI: Primary data saved (49926 records). [2025-09-29T18:06:58.692568] [INFO ] [MAIN ] CRI: Full history saved. [2025-09-29T18:06:58.692712] [INFO ] [MAIN ] Update Progress: 532/2371 symbols completed. CRI took 34.3s. Estimated remaining: 3h 51m 22s. Rate: 7.9 symbols/min [2025-09-29T18:06:58.750596] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-09-29T18:06:58.879865] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:06:58.907319] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-29T18:06:58.916225] [INFO ] [REMOTE ] CRL: Full fetch complete (62729 records). [2025-09-29T18:06:58.916369] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-09-29T18:06:59.281996] [DEBUG] [LOCAL ] CRS: Loaded 43928 existing records from primary storage. [2025-09-29T18:06:59.293072] [INFO ] [MAIN ] CRS: Loaded 43928 existing records. [2025-09-29T18:06:59.511983] [DEBUG] [VALIDATOR ] CRL: All expected trading days are present. [2025-09-29T18:06:59.532059] [DEBUG] [VALIDATOR ] CRL: Primary data validation passed. [2025-09-29T18:06:59.538109] [INFO ] [MAIN ] CRL: Fetched primary data is valid. [2025-09-29T18:06:59.544274] [DEBUG] [LOCAL ] CRL: Saving primary data. [2025-09-29T18:06:59.579466] [WARN ] [MAIN ] CRS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:06:59.579960] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-09-29T18:06:59.580038] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-09-29T18:06:59.580238] [DEBUG] [LOCAL ] CRL: Trimmed 62729 records to 43015 (keeping 200 days of data) [2025-09-29T18:06:59.581282] [DEBUG] [LOCAL ] CRS: Deleted primary data file. [2025-09-29T18:06:59.581366] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-09-29T18:07:00.125234] [INFO ] [REMOTE ] CRS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:07:00.130409] [INFO ] [REMOTE ] CRS: Fetching primary data for 2024-12. [2025-09-29T18:07:00.275639] [DEBUG] [LOCAL ] CRL: Primary data saved (43015 records). [2025-09-29T18:07:00.275804] [INFO ] [MAIN ] CRL: Full history saved. [2025-09-29T18:07:00.275894] [INFO ] [MAIN ] Update Progress: 533/2371 symbols completed. CRL took 29.7s. Estimated remaining: 3h 50m 53s. Rate: 8.0 symbols/min [2025-09-29T18:07:00.465789] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:07:00.473462] [DEBUG] [LOCAL ] CRT: Loaded 5018 existing records from primary storage. [2025-09-29T18:07:00.473934] [INFO ] [MAIN ] CRT: Loaded 5018 existing records. [2025-09-29T18:07:00.676991] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2024-12 (2.72 seconds). [2025-09-29T18:07:00.739974] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-09-29T18:07:00.744761] [WARN ] [MAIN ] CRT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:07:00.746522] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-09-29T18:07:00.762460] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-09-29T18:07:00.775666] [DEBUG] [LOCAL ] CRT: Deleted primary data file. [2025-09-29T18:07:00.775855] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-09-29T18:07:00.818542] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-29T18:07:00.885247] [INFO ] [REMOTE ] CRK: Full fetch complete (75591 records). [2025-09-29T18:07:00.904117] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-09-29T18:07:01.531059] [INFO ] [REMOTE ] CRT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:07:01.543151] [INFO ] [REMOTE ] CRT: Fetching primary data for 2024-12. [2025-09-29T18:07:01.678186] [DEBUG] [VALIDATOR ] CRK: All expected trading days are present. [2025-09-29T18:07:01.678282] [DEBUG] [VALIDATOR ] CRK: Primary data validation passed. [2025-09-29T18:07:01.679266] [INFO ] [MAIN ] CRK: Fetched primary data is valid. [2025-09-29T18:07:01.679372] [DEBUG] [LOCAL ] CRK: Saving primary data. [2025-09-29T18:07:01.681330] [DEBUG] [LOCAL ] CRK: Trimmed 75591 records to 52121 (keeping 200 days of data) [2025-09-29T18:07:02.012894] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-29T18:07:02.022574] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-09-29T18:07:02.041707] [DEBUG] [LOCAL ] CRK: Primary data saved (52121 records). [2025-09-29T18:07:02.041870] [INFO ] [MAIN ] CRK: Full history saved. [2025-09-29T18:07:02.041974] [INFO ] [MAIN ] Update Progress: 534/2371 symbols completed. CRK took 33.2s. Estimated remaining: 3h 50m 26s. Rate: 8.0 symbols/min [2025-09-29T18:07:02.218792] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:07:02.262905] [DEBUG] [LOCAL ] CSAN: Loaded 42951 existing records from primary storage. [2025-09-29T18:07:02.263260] [INFO ] [MAIN ] CSAN: Loaded 42951 existing records. [2025-09-29T18:07:02.460233] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:07:02.460442] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-09-29T18:07:02.460535] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-09-29T18:07:02.461064] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-09-29T18:07:02.461127] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-09-29T18:07:02.581385] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-29T18:07:02.751952] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-01. [2025-09-29T18:07:02.870542] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:07:02.919892] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-29T18:07:03.548149] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-09-29T18:07:03.581767] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-29T18:07:03.618073] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-29T18:07:04.348091] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-09-29T18:07:04.894122] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-29T18:07:05.148126] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-09-29T18:07:05.948120] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-09-29T18:07:06.107954] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (2.56 seconds). [2025-09-29T18:07:06.462785] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-29T18:07:06.748087] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-09-29T18:07:06.786422] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-29T18:07:07.548111] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2024-12. [2025-09-29T18:07:08.348101] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-09-29T18:07:09.089305] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-29T18:07:09.150767] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-01. [2025-09-29T18:07:09.157210] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-09-29T18:07:09.794622] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-29T18:07:09.948120] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-09-29T18:07:10.704616] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-29T18:07:10.748184] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-09-29T18:07:11.548170] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-09-29T18:07:11.680764] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-29T18:07:11.971673] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-29T18:07:12.348106] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-09-29T18:07:13.148081] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-09-29T18:07:13.242951] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-09-29T18:07:13.948133] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-09-29T18:07:14.078772] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-29T18:07:14.615298] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-29T18:07:14.748122] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-09-29T18:07:14.776977] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-29T18:07:15.548119] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-09-29T18:07:16.243011] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-29T18:07:16.348112] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-09-29T18:07:17.157001] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-09-29T18:07:17.175323] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-29T18:07:17.889557] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-29T18:07:17.948093] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-09-29T18:07:18.748127] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-09-29T18:07:19.548124] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-09-29T18:07:19.624218] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-29T18:07:19.785590] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (2.63 seconds). [2025-09-29T18:07:20.204244] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-29T18:07:20.348085] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-09-29T18:07:20.469206] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-29T18:07:21.148114] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-09-29T18:07:21.769633] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-29T18:07:21.948102] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-09-29T18:07:22.519000] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-29T18:07:22.592675] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-29T18:07:22.748109] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-09-29T18:07:23.548119] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-09-29T18:07:24.353254] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-09-29T18:07:24.369343] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-29T18:07:24.390882] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-29T18:07:24.392773] [INFO ] [REMOTE ] CRT: Full fetch complete (7636 records). [2025-09-29T18:07:24.392883] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-09-29T18:07:24.773257] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present. [2025-09-29T18:07:24.773337] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed. [2025-09-29T18:07:24.773521] [INFO ] [MAIN ] CRT: Fetched primary data is valid. [2025-09-29T18:07:24.773563] [DEBUG] [LOCAL ] CRT: Saving primary data. [2025-09-29T18:07:24.773990] [DEBUG] [LOCAL ] CRT: Trimmed 7636 records to 4976 (keeping 200 days of data) [2025-09-29T18:07:24.804761] [DEBUG] [LOCAL ] CRT: Primary data saved (4976 records). [2025-09-29T18:07:24.804862] [INFO ] [MAIN ] CRT: Full history saved. [2025-09-29T18:07:24.804974] [INFO ] [MAIN ] Update Progress: 535/2371 symbols completed. CRT took 24.5s. Estimated remaining: 3h 51m 11s. Rate: 7.9 symbols/min [2025-09-29T18:07:24.988665] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:07:25.035357] [DEBUG] [LOCAL ] CSL: Loaded 32100 existing records from primary storage. [2025-09-29T18:07:25.035688] [INFO ] [MAIN ] CSL: Loaded 32100 existing records. [2025-09-29T18:07:25.149435] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-09-29T18:07:25.236071] [WARN ] [MAIN ] CSL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:07:25.236311] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-09-29T18:07:25.236372] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-09-29T18:07:25.237203] [DEBUG] [LOCAL ] CSL: Deleted primary data file. [2025-09-29T18:07:25.237270] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-09-29T18:07:25.629246] [INFO ] [REMOTE ] CSL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:07:25.856283] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-29T18:07:25.948088] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-09-29T18:07:26.748167] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-09-29T18:07:27.536863] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-29T18:07:27.548062] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-09-29T18:07:27.588011] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-09-29T18:07:28.348083] [INFO ] [REMOTE ] CSL: Fetching primary data for 2024-12. [2025-09-29T18:07:28.640049] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-29T18:07:28.649605] [INFO ] [REMOTE ] CRS: Full fetch complete (62622 records). [2025-09-29T18:07:28.649782] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-09-29T18:07:29.079222] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-29T18:07:29.119679] [DEBUG] [VALIDATOR ] CRS: All expected trading days are present. [2025-09-29T18:07:29.119770] [DEBUG] [VALIDATOR ] CRS: Primary data validation passed. [2025-09-29T18:07:29.120717] [INFO ] [MAIN ] CRS: Fetched primary data is valid. [2025-09-29T18:07:29.120786] [DEBUG] [LOCAL ] CRS: Saving primary data. [2025-09-29T18:07:29.122608] [DEBUG] [LOCAL ] CRS: Trimmed 62622 records to 43170 (keeping 200 days of data) [2025-09-29T18:07:29.190995] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-09-29T18:07:29.418302] [DEBUG] [LOCAL ] CRS: Primary data saved (43170 records). [2025-09-29T18:07:29.418445] [INFO ] [MAIN ] CRS: Full history saved. [2025-09-29T18:07:29.418546] [INFO ] [MAIN ] Update Progress: 536/2371 symbols completed. CRS took 30.7s. Estimated remaining: 3h 50m 53s. Rate: 7.9 symbols/min [2025-09-29T18:07:29.598800] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:07:29.616954] [DEBUG] [LOCAL ] CSR: Loaded 12808 existing records from primary storage. [2025-09-29T18:07:29.617214] [INFO ] [MAIN ] CSR: Loaded 12808 existing records. [2025-09-29T18:07:29.818515] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:07:29.818820] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-09-29T18:07:29.818928] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-09-29T18:07:29.819245] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-09-29T18:07:29.819305] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-09-29T18:07:29.947959] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-29T18:07:29.953773] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-09-29T18:07:30.226885] [INFO ] [REMOTE ] CSR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:07:30.748095] [INFO ] [REMOTE ] CSR: Fetching primary data for 2024-12. [2025-09-29T18:07:31.117265] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-29T18:07:31.126797] [INFO ] [REMOTE ] CSAN: Full fetch complete (60812 records). [2025-09-29T18:07:31.126930] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-09-29T18:07:31.533077] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-09-29T18:07:31.533219] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-09-29T18:07:31.534230] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-09-29T18:07:31.534301] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-09-29T18:07:31.535623] [DEBUG] [LOCAL ] CSAN: Trimmed 60812 records to 42412 (keeping 200 days of data) [2025-09-29T18:07:31.583453] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-01. [2025-09-29T18:07:31.653151] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-29T18:07:31.806950] [DEBUG] [LOCAL ] CSAN: Primary data saved (42412 records). [2025-09-29T18:07:31.807101] [INFO ] [MAIN ] CSAN: Full history saved. [2025-09-29T18:07:31.807190] [INFO ] [MAIN ] Update Progress: 537/2371 symbols completed. CSAN took 29.8s. Estimated remaining: 3h 50m 28s. Rate: 8.0 symbols/min [2025-09-29T18:07:31.978834] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:07:32.032932] [DEBUG] [LOCAL ] CSTM: Loaded 48360 existing records from primary storage. [2025-09-29T18:07:32.033270] [INFO ] [MAIN ] CSTM: Loaded 48360 existing records. [2025-09-29T18:07:32.217948] [WARN ] [MAIN ] CSTM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:07:32.218248] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-09-29T18:07:32.218303] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-09-29T18:07:32.218727] [DEBUG] [LOCAL ] CSTM: Deleted primary data file. [2025-09-29T18:07:32.218790] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-09-29T18:07:32.364424] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-01. [2025-09-29T18:07:32.607551] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:07:32.773323] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (2.82 seconds). [2025-09-29T18:07:32.804950] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-29T18:07:33.148128] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-09-29T18:07:33.269263] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-29T18:07:33.948139] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2024-12. [2025-09-29T18:07:34.314364] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-29T18:07:34.748111] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-09-29T18:07:35.548082] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-09-29T18:07:35.613998] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-29T18:07:35.787950] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-29T18:07:36.348119] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-09-29T18:07:36.759712] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-29T18:07:37.123362] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-29T18:07:37.148116] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-09-29T18:07:37.948119] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-09-29T18:07:38.208618] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-29T18:07:38.748166] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-09-29T18:07:39.548114] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-09-29T18:07:39.640156] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-29T18:07:40.348204] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-09-29T18:07:40.441786] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-09-29T18:07:40.453089] [INFO ] [REMOTE ] CRM: Full fetch complete (77454 records). [2025-09-29T18:07:40.453311] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-09-29T18:07:40.454300] [FATAL] [VALIDATOR ] CRM: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:07:40.454404] [FATAL] [MAIN ] CRM: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:07:40.454451] [WARN ] [MAIN ] CRM: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:07:40.454496] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-09-29T18:07:40.454562] [DEBUG] [LOCAL ] CRM: No primary data file found to delete. [2025-09-29T18:07:40.454600] [INFO ] [LOCAL ] CRM: Starting deletion of derivative data. [2025-09-29T18:07:40.454941] [DEBUG] [LOCAL ] CRM: Deleted derivative data file. [2025-09-29T18:07:40.455061] [INFO ] [MAIN ] Update Progress: 538/2371 symbols completed. CRM took 44.0s. Estimated remaining: 3h 50m 24s. Rate: 8.0 symbols/min [2025-09-29T18:07:40.647994] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:07:40.673014] [DEBUG] [LOCAL ] CSV: Loaded 13198 existing records from primary storage. [2025-09-29T18:07:40.673572] [INFO ] [MAIN ] CSV: Loaded 13198 existing records. [2025-09-29T18:07:40.873852] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:07:40.874189] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-09-29T18:07:40.874278] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-09-29T18:07:40.874697] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-09-29T18:07:40.874765] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-09-29T18:07:41.167425] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-01. [2025-09-29T18:07:41.290522] [INFO ] [REMOTE ] CSV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:07:41.315205] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-29T18:07:41.322093] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-29T18:07:41.948147] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-09-29T18:07:42.748120] [INFO ] [REMOTE ] CSV: Fetching primary data for 2024-12. [2025-09-29T18:07:42.863429] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-29T18:07:42.904305] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-29T18:07:43.548110] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-09-29T18:07:43.818178] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-29T18:07:44.348133] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-09-29T18:07:44.980149] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-29T18:07:45.148113] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-09-29T18:07:45.394133] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-29T18:07:45.787709] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-29T18:07:45.948134] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-09-29T18:07:46.748149] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-09-29T18:07:47.548114] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-09-29T18:07:47.620410] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-29T18:07:47.715336] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-29T18:07:48.348089] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-09-29T18:07:48.509195] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-29T18:07:49.148116] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-09-29T18:07:49.884154] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-29T18:07:49.948086] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-09-29T18:07:50.327742] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-29T18:07:50.748087] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-09-29T18:07:50.923135] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-29T18:07:51.548101] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-09-29T18:07:51.704884] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-29T18:07:51.708395] [INFO ] [REMOTE ] CSR: Full fetch complete (17606 records). [2025-09-29T18:07:51.708498] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-09-29T18:07:52.103530] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-09-29T18:07:52.103619] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-09-29T18:07:52.104200] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-09-29T18:07:52.104268] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-09-29T18:07:52.104979] [DEBUG] [LOCAL ] CSR: Trimmed 17606 records to 12759 (keeping 200 days of data) [2025-09-29T18:07:52.197281] [DEBUG] [LOCAL ] CSR: Primary data saved (12759 records). [2025-09-29T18:07:52.197487] [INFO ] [MAIN ] CSR: Full history saved. [2025-09-29T18:07:52.197605] [INFO ] [MAIN ] Update Progress: 539/2371 symbols completed. CSR took 22.8s. Estimated remaining: 3h 50m 31s. Rate: 7.9 symbols/min [2025-09-29T18:07:52.360529] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-09-29T18:07:52.397206] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:07:52.397495] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-09-29T18:07:52.397551] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-09-29T18:07:52.397721] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-09-29T18:07:52.397772] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-09-29T18:07:52.397875] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-09-29T18:07:52.397916] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-09-29T18:07:52.693221] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-29T18:07:52.788391] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:07:53.148114] [INFO ] [REMOTE ] CSW: Fetching primary data for 2024-12. [2025-09-29T18:07:53.347141] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T18:07:53.347505] [WARN ] [REMOTE ] CSW: No data returned for month 2024-12 [2025-09-29T18:07:53.347598] [FATAL] [REMOTE ] CSW: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T18:07:53.347675] [FATAL] [MAIN ] CSW: Failed to fetch primary data. [2025-09-29T18:07:53.347733] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T18:07:53.347804] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-09-29T18:07:53.347873] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-09-29T18:07:53.347912] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-09-29T18:07:53.347956] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-09-29T18:07:53.348005] [INFO ] [MAIN ] Update Progress: 540/2371 symbols completed. CSW took 1.2s. Estimated remaining: 3h 50m 2s. Rate: 8.0 symbols/min [2025-09-29T18:07:53.537087] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:07:53.546875] [DEBUG] [LOCAL ] CTBB: Loaded 7168 existing records from primary storage. [2025-09-29T18:07:53.547138] [INFO ] [MAIN ] CTBB: Loaded 7168 existing records. [2025-09-29T18:07:53.750925] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:07:53.751378] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-09-29T18:07:53.751590] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-09-29T18:07:53.751944] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-09-29T18:07:53.752010] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-09-29T18:07:53.953348] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-09-29T18:07:54.118021] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-29T18:07:54.203890] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:07:54.748127] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-09-29T18:07:55.548120] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-09-29T18:07:55.589277] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-29T18:07:55.749777] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-29T18:07:56.348123] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-09-29T18:07:56.926126] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-29T18:07:57.034623] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-29T18:07:57.148099] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-09-29T18:07:57.948127] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-09-29T18:07:58.097031] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-29T18:07:58.748110] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-09-29T18:07:59.554490] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-09-29T18:07:59.577612] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-29T18:08:00.348128] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-09-29T18:08:00.499824] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-29T18:08:00.516756] [INFO ] [REMOTE ] CSL: Full fetch complete (45331 records). [2025-09-29T18:08:00.517086] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-29T18:08:00.520831] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-09-29T18:08:00.986854] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present. [2025-09-29T18:08:00.986941] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed. [2025-09-29T18:08:00.987752] [INFO ] [MAIN ] CSL: Fetched primary data is valid. [2025-09-29T18:08:00.987825] [DEBUG] [LOCAL ] CSL: Saving primary data. [2025-09-29T18:08:00.989032] [DEBUG] [LOCAL ] CSL: Trimmed 45331 records to 31556 (keeping 200 days of data) [2025-09-29T18:08:01.157987] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-09-29T18:08:01.206488] [DEBUG] [LOCAL ] CSL: Primary data saved (31556 records). [2025-09-29T18:08:01.206678] [INFO ] [MAIN ] CSL: Full history saved. [2025-09-29T18:08:01.206790] [INFO ] [MAIN ] Update Progress: 541/2371 symbols completed. CSL took 36.4s. Estimated remaining: 3h 49m 55s. Rate: 8.0 symbols/min [2025-09-29T18:08:01.388969] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:08:01.399434] [DEBUG] [LOCAL ] CTDD: Loaded 5947 existing records from primary storage. [2025-09-29T18:08:01.399755] [INFO ] [MAIN ] CTDD: Loaded 5947 existing records. [2025-09-29T18:08:01.646820] [WARN ] [MAIN ] CTDD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:08:01.647264] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-09-29T18:08:01.647337] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-09-29T18:08:01.648324] [DEBUG] [LOCAL ] CTDD: Deleted primary data file. [2025-09-29T18:08:01.648518] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-09-29T18:08:01.956572] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2024-12. [2025-09-29T18:08:02.055789] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:08:02.114530] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-29T18:08:02.617878] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-29T18:08:02.621595] [INFO ] [REMOTE ] CSV: Full fetch complete (19378 records). [2025-09-29T18:08:02.621796] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-09-29T18:08:02.622375] [FATAL] [VALIDATOR ] CSV: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:08:02.622464] [FATAL] [MAIN ] CSV: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:08:02.622510] [WARN ] [MAIN ] CSV: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:08:02.622582] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-09-29T18:08:02.622675] [DEBUG] [LOCAL ] CSV: No primary data file found to delete. [2025-09-29T18:08:02.622754] [INFO ] [LOCAL ] CSV: Starting deletion of derivative data. [2025-09-29T18:08:02.623149] [DEBUG] [LOCAL ] CSV: Deleted derivative data file. [2025-09-29T18:08:02.623280] [INFO ] [MAIN ] Update Progress: 542/2371 symbols completed. CSV took 22.2s. Estimated remaining: 3h 49m 27s. Rate: 8.0 symbols/min [2025-09-29T18:08:02.748887] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2024-12. [2025-09-29T18:08:02.831365] [INFO ] [MAIN ] CTEST: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:08:02.831762] [DEBUG] [LOCAL ] CTEST: No existing data file found in primary storage. [2025-09-29T18:08:02.831876] [WARN ] [MAIN ] CTEST: No existing data found, performing full refresh instead. [2025-09-29T18:08:02.832003] [INFO ] [MAIN ] CTEST: Wiping existing primary data before full refresh. [2025-09-29T18:08:02.832049] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-09-29T18:08:02.832094] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-09-29T18:08:02.832130] [INFO ] [MAIN ] CTEST: Starting full primary refresh. [2025-09-29T18:08:02.976192] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-29T18:08:03.231042] [INFO ] [REMOTE ] CTEST: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:08:03.548095] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-01. [2025-09-29T18:08:03.708759] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-29T18:08:04.313397] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-29T18:08:04.348175] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-09-29T18:08:05.148883] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2024-12. [2025-09-29T18:08:05.151049] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-29T18:08:05.555169] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T18:08:05.555493] [WARN ] [REMOTE ] CTEST: No data returned for month 2024-12 [2025-09-29T18:08:05.555582] [FATAL] [REMOTE ] CTEST: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T18:08:05.555634] [FATAL] [MAIN ] CTEST: Failed to fetch primary data. [2025-09-29T18:08:05.555713] [WARN ] [MAIN ] CTEST: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T18:08:05.555796] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-09-29T18:08:05.555882] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-09-29T18:08:05.555952] [INFO ] [LOCAL ] CTEST: Starting deletion of derivative data. [2025-09-29T18:08:05.556057] [DEBUG] [LOCAL ] CTEST: No derivative data file found to delete. [2025-09-29T18:08:05.556159] [INFO ] [MAIN ] Update Progress: 543/2371 symbols completed. CTEST took 2.9s. Estimated remaining: 3h 49m 4s. Rate: 8.0 symbols/min [2025-09-29T18:08:05.749931] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:08:05.750209] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-09-29T18:08:05.750267] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-09-29T18:08:05.750408] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-09-29T18:08:05.750462] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-09-29T18:08:05.750508] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-09-29T18:08:05.750543] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-09-29T18:08:05.953333] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-09-29T18:08:06.137813] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:08:06.748125] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-01. [2025-09-29T18:08:06.879870] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-29T18:08:07.121586] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-09-29T18:08:07.548169] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-09-29T18:08:08.310474] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-29T18:08:08.348111] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-09-29T18:08:09.148125] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-09-29T18:08:09.736232] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-29T18:08:09.904494] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-29T18:08:09.948104] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-09-29T18:08:10.630700] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-29T18:08:10.748164] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2024-12. [2025-09-29T18:08:10.948890] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T18:08:10.949265] [WARN ] [REMOTE ] CTEV: No data returned for month 2024-12 [2025-09-29T18:08:10.949367] [FATAL] [REMOTE ] CTEV: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T18:08:10.949417] [FATAL] [MAIN ] CTEV: Failed to fetch primary data. [2025-09-29T18:08:10.949480] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T18:08:10.949554] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-09-29T18:08:10.949621] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-09-29T18:08:10.949700] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-09-29T18:08:10.949771] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-09-29T18:08:10.949831] [INFO ] [MAIN ] Update Progress: 544/2371 symbols completed. CTEV took 5.4s. Estimated remaining: 3h 48m 49s. Rate: 8.0 symbols/min [2025-09-29T18:08:11.158466] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:08:11.204086] [DEBUG] [LOCAL ] CTO: Loaded 28661 existing records from primary storage. [2025-09-29T18:08:11.204375] [INFO ] [MAIN ] CTO: Loaded 28661 existing records. [2025-09-29T18:08:11.407981] [WARN ] [MAIN ] CTO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:08:11.408233] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-09-29T18:08:11.408291] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-09-29T18:08:11.408731] [DEBUG] [LOCAL ] CTO: Deleted primary data file. [2025-09-29T18:08:11.408810] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-09-29T18:08:11.553273] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-09-29T18:08:11.819132] [INFO ] [REMOTE ] CTO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:08:12.348126] [INFO ] [REMOTE ] CTO: Fetching primary data for 2024-12. [2025-09-29T18:08:12.397679] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-29T18:08:13.148153] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-09-29T18:08:13.592364] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-29T18:08:13.948127] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-09-29T18:08:14.028964] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-29T18:08:14.748132] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-01. [2025-09-29T18:08:15.548167] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-09-29T18:08:15.761994] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-29T18:08:15.772130] [INFO ] [REMOTE ] CSTM: Full fetch complete (69161 records). [2025-09-29T18:08:15.772346] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-09-29T18:08:16.179625] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-29T18:08:16.238681] [DEBUG] [VALIDATOR ] CSTM: All expected trading days are present. [2025-09-29T18:08:16.246397] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-29T18:08:16.246186] [DEBUG] [VALIDATOR ] CSTM: Primary data validation passed. [2025-09-29T18:08:16.249804] [INFO ] [MAIN ] CSTM: Fetched primary data is valid. [2025-09-29T18:08:16.250480] [DEBUG] [LOCAL ] CSTM: Saving primary data. [2025-09-29T18:08:16.252293] [DEBUG] [LOCAL ] CSTM: Trimmed 69161 records to 47545 (keeping 200 days of data) [2025-09-29T18:08:16.348901] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-09-29T18:08:16.548867] [DEBUG] [LOCAL ] CSTM: Primary data saved (47545 records). [2025-09-29T18:08:16.549060] [INFO ] [MAIN ] CSTM: Full history saved. [2025-09-29T18:08:16.549214] [INFO ] [MAIN ] Update Progress: 545/2371 symbols completed. CSTM took 44.7s. Estimated remaining: 3h 48m 36s. Rate: 8.0 symbols/min [2025-09-29T18:08:16.736289] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:08:16.778049] [DEBUG] [LOCAL ] CTOS: Loaded 37246 existing records from primary storage. [2025-09-29T18:08:16.778370] [INFO ] [MAIN ] CTOS: Loaded 37246 existing records. [2025-09-29T18:08:16.982776] [WARN ] [MAIN ] CTOS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:08:16.982992] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-09-29T18:08:16.983039] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-09-29T18:08:16.983467] [DEBUG] [LOCAL ] CTOS: Deleted primary data file. [2025-09-29T18:08:16.983535] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-09-29T18:08:17.110725] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-29T18:08:17.157701] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-09-29T18:08:17.398363] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:08:17.948109] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-09-29T18:08:17.966183] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-29T18:08:18.748113] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-09-29T18:08:19.243226] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-29T18:08:19.473780] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-29T18:08:19.475842] [INFO ] [REMOTE ] CTBB: Full fetch complete (10911 records). [2025-09-29T18:08:19.475920] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-09-29T18:08:19.553237] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-09-29T18:08:19.915597] [DEBUG] [VALIDATOR ] CTBB: All expected trading days are present. [2025-09-29T18:08:19.915701] [DEBUG] [VALIDATOR ] CTBB: Primary data validation passed. [2025-09-29T18:08:19.915995] [INFO ] [MAIN ] CTBB: Fetched primary data is valid. [2025-09-29T18:08:19.916039] [DEBUG] [LOCAL ] CTBB: Saving primary data. [2025-09-29T18:08:19.916518] [DEBUG] [LOCAL ] CTBB: Trimmed 10911 records to 7077 (keeping 200 days of data) [2025-09-29T18:08:19.962209] [DEBUG] [LOCAL ] CTBB: Primary data saved (7077 records). [2025-09-29T18:08:19.962348] [INFO ] [MAIN ] CTBB: Full history saved. [2025-09-29T18:08:19.962450] [INFO ] [MAIN ] Update Progress: 546/2371 symbols completed. CTBB took 26.6s. Estimated remaining: 3h 48m 14s. Rate: 8.0 symbols/min [2025-09-29T18:08:20.149107] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:08:20.220626] [DEBUG] [LOCAL ] CTRA: Loaded 54428 existing records from primary storage. [2025-09-29T18:08:20.221095] [INFO ] [MAIN ] CTRA: Loaded 54428 existing records. [2025-09-29T18:08:20.353263] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2024-12. [2025-09-29T18:08:20.438758] [WARN ] [MAIN ] CTRA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:08:20.439092] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-09-29T18:08:20.439146] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-09-29T18:08:20.439581] [DEBUG] [LOCAL ] CTRA: Deleted primary data file. [2025-09-29T18:08:20.439667] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-09-29T18:08:20.840308] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:08:21.072956] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-29T18:08:21.148117] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-09-29T18:08:21.523213] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-29T18:08:21.948116] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-09-29T18:08:22.523488] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-29T18:08:22.535746] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-29T18:08:22.748109] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-09-29T18:08:23.362480] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-29T18:08:23.548140] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-09-29T18:08:24.348145] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2024-12. [2025-09-29T18:08:24.769101] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-29T18:08:25.148352] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-09-29T18:08:25.754220] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-29T18:08:25.948150] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-01. [2025-09-29T18:08:26.312731] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-29T18:08:26.748095] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-01. [2025-09-29T18:08:27.267990] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-29T18:08:27.548177] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-09-29T18:08:28.348081] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-09-29T18:08:28.663632] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-29T18:08:28.805747] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-29T18:08:29.148157] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-09-29T18:08:29.654998] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-29T18:08:29.814260] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-29T18:08:29.948133] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-09-29T18:08:30.748115] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-09-29T18:08:31.402871] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-29T18:08:31.548155] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-09-29T18:08:31.884369] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-29T18:08:32.348115] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-09-29T18:08:32.970636] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-29T18:08:33.148113] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-09-29T18:08:33.541983] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-29T18:08:33.948122] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-09-29T18:08:34.748110] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-09-29T18:08:35.027765] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-29T18:08:35.366177] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-29T18:08:35.500937] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-29T18:08:35.503061] [INFO ] [REMOTE ] CTDD: Full fetch complete (8532 records). [2025-09-29T18:08:35.503146] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-09-29T18:08:35.553198] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-09-29T18:08:35.900888] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present. [2025-09-29T18:08:35.900971] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed. [2025-09-29T18:08:35.901216] [INFO ] [MAIN ] CTDD: Fetched primary data is valid. [2025-09-29T18:08:35.901287] [DEBUG] [LOCAL ] CTDD: Saving primary data. [2025-09-29T18:08:35.901767] [DEBUG] [LOCAL ] CTDD: Trimmed 8532 records to 5923 (keeping 200 days of data) [2025-09-29T18:08:35.939636] [DEBUG] [LOCAL ] CTDD: Primary data saved (5923 records). [2025-09-29T18:08:35.939819] [INFO ] [MAIN ] CTDD: Full history saved. [2025-09-29T18:08:35.939927] [INFO ] [MAIN ] Update Progress: 547/2371 symbols completed. CTDD took 34.7s. Estimated remaining: 3h 48m 35s. Rate: 8.0 symbols/min [2025-09-29T18:08:36.118632] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:08:36.171296] [DEBUG] [LOCAL ] CTRE: Loaded 49964 existing records from primary storage. [2025-09-29T18:08:36.171614] [INFO ] [MAIN ] CTRE: Loaded 49964 existing records. [2025-09-29T18:08:36.366782] [WARN ] [MAIN ] CTRE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:08:36.367105] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-09-29T18:08:36.359913] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-09-29T18:08:36.368226] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-09-29T18:08:36.368771] [DEBUG] [LOCAL ] CTRE: Deleted primary data file. [2025-09-29T18:08:36.368836] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-09-29T18:08:36.759188] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:08:37.052999] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-29T18:08:37.059314] [INFO ] [REMOTE ] CTO: Full fetch complete (41761 records). [2025-09-29T18:08:37.059416] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-09-29T18:08:37.156614] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2024-12. [2025-09-29T18:08:37.464290] [DEBUG] [VALIDATOR ] CTO: All expected trading days are present. [2025-09-29T18:08:37.464412] [DEBUG] [VALIDATOR ] CTO: Primary data validation passed. [2025-09-29T18:08:37.465148] [INFO ] [MAIN ] CTO: Fetched primary data is valid. [2025-09-29T18:08:37.465215] [DEBUG] [LOCAL ] CTO: Saving primary data. [2025-09-29T18:08:37.466340] [DEBUG] [LOCAL ] CTO: Trimmed 41761 records to 27978 (keeping 200 days of data) [2025-09-29T18:08:37.645674] [DEBUG] [LOCAL ] CTO: Primary data saved (27978 records). [2025-09-29T18:08:37.645834] [INFO ] [MAIN ] CTO: Full history saved. [2025-09-29T18:08:37.645932] [INFO ] [MAIN ] Update Progress: 548/2371 symbols completed. CTO took 26.7s. Estimated remaining: 3h 48m 8s. Rate: 8.0 symbols/min [2025-09-29T18:08:37.825206] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:08:37.869418] [DEBUG] [LOCAL ] CTRI: Loaded 38571 existing records from primary storage. [2025-09-29T18:08:37.869774] [INFO ] [MAIN ] CTRI: Loaded 38571 existing records. [2025-09-29T18:08:37.950955] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-09-29T18:08:38.067161] [WARN ] [MAIN ] CTRI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:08:38.067681] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-09-29T18:08:38.067798] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-09-29T18:08:38.068307] [DEBUG] [LOCAL ] CTRI: Deleted primary data file. [2025-09-29T18:08:38.068372] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-09-29T18:08:38.484880] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:08:38.513495] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-29T18:08:38.748086] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-09-29T18:08:38.948781] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-29T18:08:39.241091] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-29T18:08:39.548115] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-01. [2025-09-29T18:08:40.348085] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2024-12. [2025-09-29T18:08:40.756791] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-29T18:08:41.148135] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-09-29T18:08:41.181753] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-29T18:08:41.449912] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-29T18:08:41.948156] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-01. [2025-09-29T18:08:42.748095] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-09-29T18:08:42.810669] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-29T18:08:43.120562] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-29T18:08:43.548159] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-09-29T18:08:44.306701] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-29T18:08:44.348126] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-09-29T18:08:44.748194] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-29T18:08:45.148166] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-09-29T18:08:45.705475] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-29T18:08:45.948182] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-09-29T18:08:46.422741] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-29T18:08:46.748181] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-09-29T18:08:47.083356] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-29T18:08:47.548147] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-09-29T18:08:48.194471] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-29T18:08:48.202039] [INFO ] [REMOTE ] CTOS: Full fetch complete (53512 records). [2025-09-29T18:08:48.202219] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-09-29T18:08:48.354349] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-09-29T18:08:48.630365] [DEBUG] [VALIDATOR ] CTOS: All expected trading days are present. [2025-09-29T18:08:48.630471] [DEBUG] [VALIDATOR ] CTOS: Primary data validation passed. [2025-09-29T18:08:48.631355] [INFO ] [MAIN ] CTOS: Fetched primary data is valid. [2025-09-29T18:08:48.631426] [DEBUG] [LOCAL ] CTOS: Saving primary data. [2025-09-29T18:08:48.632791] [DEBUG] [LOCAL ] CTOS: Trimmed 53512 records to 36520 (keeping 200 days of data) [2025-09-29T18:08:48.851307] [DEBUG] [LOCAL ] CTOS: Primary data saved (36520 records). [2025-09-29T18:08:48.851458] [INFO ] [MAIN ] CTOS: Full history saved. [2025-09-29T18:08:48.851545] [INFO ] [MAIN ] Update Progress: 549/2371 symbols completed. CTOS took 32.3s. Estimated remaining: 3h 48m 13s. Rate: 8.0 symbols/min [2025-09-29T18:08:49.039406] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:08:49.064196] [DEBUG] [LOCAL ] CTS: Loaded 19637 existing records from primary storage. [2025-09-29T18:08:49.064604] [INFO ] [MAIN ] CTS: Loaded 19637 existing records. [2025-09-29T18:08:49.150259] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-09-29T18:08:49.289305] [WARN ] [MAIN ] CTS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:08:49.292635] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-09-29T18:08:49.292772] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-09-29T18:08:49.294783] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-29T18:08:49.294852] [DEBUG] [LOCAL ] CTS: Deleted primary data file. [2025-09-29T18:08:49.295067] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-09-29T18:08:49.670936] [INFO ] [REMOTE ] CTS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:08:49.948152] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-09-29T18:08:50.215124] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-29T18:08:50.247876] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-29T18:08:50.748117] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-09-29T18:08:51.548159] [INFO ] [REMOTE ] CTS: Fetching primary data for 2024-12. [2025-09-29T18:08:51.637744] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-29T18:08:52.348105] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-09-29T18:08:52.637297] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-29T18:08:52.732952] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-29T18:08:53.148132] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-09-29T18:08:53.948169] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-01. [2025-09-29T18:08:54.149897] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-29T18:08:54.729746] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-29T18:08:54.748071] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-09-29T18:08:55.122749] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-29T18:08:55.548130] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-09-29T18:08:55.825985] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-29T18:08:56.348195] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-09-29T18:08:57.140617] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-29T18:08:57.148482] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-09-29T18:08:57.957752] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-09-29T18:08:57.978244] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-29T18:08:58.748147] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-09-29T18:08:59.082000] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-29T18:08:59.163971] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-29T18:08:59.175282] [INFO ] [REMOTE ] CTRA: Full fetch complete (77663 records). [2025-09-29T18:08:59.175434] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-09-29T18:08:59.553220] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-09-29T18:08:59.615116] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-09-29T18:08:59.615202] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-09-29T18:08:59.616241] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-09-29T18:08:59.616311] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-09-29T18:08:59.618077] [DEBUG] [LOCAL ] CTRA: Trimmed 77663 records to 53648 (keeping 200 days of data) [2025-09-29T18:08:59.880401] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-29T18:09:00.007949] [DEBUG] [LOCAL ] CTRA: Primary data saved (53648 records). [2025-09-29T18:09:00.008100] [INFO ] [MAIN ] CTRA: Full history saved. [2025-09-29T18:09:00.008192] [INFO ] [MAIN ] Update Progress: 550/2371 symbols completed. CTRA took 40.0s. Estimated remaining: 3h 48m 18s. Rate: 8.0 symbols/min [2025-09-29T18:09:00.187441] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:09:00.245528] [DEBUG] [LOCAL ] CTVA: Loaded 54002 existing records from primary storage. [2025-09-29T18:09:00.245913] [INFO ] [MAIN ] CTVA: Loaded 54002 existing records. [2025-09-29T18:09:00.353223] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-09-29T18:09:00.450913] [WARN ] [MAIN ] CTVA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:09:00.451121] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-09-29T18:09:00.451170] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-09-29T18:09:00.451589] [DEBUG] [LOCAL ] CTVA: Deleted primary data file. [2025-09-29T18:09:00.451695] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-09-29T18:09:00.844853] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:09:00.963347] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-29T18:09:01.148113] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-09-29T18:09:01.607921] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-29T18:09:01.948092] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-09-29T18:09:02.173828] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-29T18:09:02.748116] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-09-29T18:09:03.367258] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-29T18:09:03.392113] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-29T18:09:03.548122] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-09-29T18:09:04.348148] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2024-12. [2025-09-29T18:09:05.148141] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-09-29T18:09:05.384056] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-29T18:09:05.920287] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-29T18:09:05.948060] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-01. [2025-09-29T18:09:06.755380] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-09-29T18:09:06.761372] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-29T18:09:06.772488] [INFO ] [REMOTE ] CTRI: Full fetch complete (51542 records). [2025-09-29T18:09:06.772690] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-09-29T18:09:07.197681] [DEBUG] [VALIDATOR ] CTRI: All expected trading days are present. [2025-09-29T18:09:07.197845] [DEBUG] [VALIDATOR ] CTRI: Primary data validation passed. [2025-09-29T18:09:07.198709] [INFO ] [MAIN ] CTRI: Fetched primary data is valid. [2025-09-29T18:09:07.198784] [DEBUG] [LOCAL ] CTRI: Saving primary data. [2025-09-29T18:09:07.200163] [DEBUG] [LOCAL ] CTRI: Trimmed 51542 records to 38199 (keeping 200 days of data) [2025-09-29T18:09:07.440511] [DEBUG] [LOCAL ] CTRI: Primary data saved (38199 records). [2025-09-29T18:09:07.440745] [INFO ] [MAIN ] CTRI: Full history saved. [2025-09-29T18:09:07.440892] [INFO ] [MAIN ] Update Progress: 551/2371 symbols completed. CTRI took 29.8s. Estimated remaining: 3h 48m 10s. Rate: 8.0 symbols/min [2025-09-29T18:09:07.550778] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-09-29T18:09:07.650116] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:09:07.650330] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-09-29T18:09:07.650447] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-09-29T18:09:07.650846] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-09-29T18:09:07.650915] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-09-29T18:09:07.651145] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-09-29T18:09:07.651247] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-09-29T18:09:08.059175] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-29T18:09:08.105047] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:09:08.202718] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-29T18:09:08.348099] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-09-29T18:09:08.625900] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-29T18:09:09.148117] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-09-29T18:09:09.948132] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2024-12. [2025-09-29T18:09:10.016173] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-29T18:09:10.216532] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-29T18:09:10.435764] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-29T18:09:10.748117] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-09-29T18:09:11.548166] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-09-29T18:09:12.348104] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-09-29T18:09:12.665180] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-09-29T18:09:12.767421] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-29T18:09:12.780935] [INFO ] [REMOTE ] CTRE: Full fetch complete (71125 records). [2025-09-29T18:09:12.781106] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-09-29T18:09:12.956107] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-29T18:09:12.994379] [INFO ] [REMOTE ] CTS: Full fetch complete (26702 records). [2025-09-29T18:09:13.007746] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-09-29T18:09:13.158719] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-09-29T18:09:13.625076] [DEBUG] [VALIDATOR ] CTRE: All expected trading days are present. [2025-09-29T18:09:13.625497] [DEBUG] [VALIDATOR ] CTRE: Primary data validation passed. [2025-09-29T18:09:13.637355] [INFO ] [MAIN ] CTRE: Fetched primary data is valid. [2025-09-29T18:09:13.642909] [DEBUG] [LOCAL ] CTRE: Saving primary data. [2025-09-29T18:09:13.657947] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-29T18:09:13.728825] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present. [2025-09-29T18:09:13.728575] [DEBUG] [LOCAL ] CTRE: Trimmed 71125 records to 49220 (keeping 200 days of data) [2025-09-29T18:09:13.729025] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed. [2025-09-29T18:09:13.729462] [INFO ] [MAIN ] CTS: Fetched primary data is valid. [2025-09-29T18:09:13.729958] [DEBUG] [LOCAL ] CTS: Saving primary data. [2025-09-29T18:09:13.731163] [DEBUG] [LOCAL ] CTS: Trimmed 26702 records to 19346 (keeping 200 days of data) [2025-09-29T18:09:13.948423] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-09-29T18:09:14.090965] [DEBUG] [LOCAL ] CTS: Primary data saved (19346 records). [2025-09-29T18:09:14.092741] [INFO ] [MAIN ] CTS: Full history saved. [2025-09-29T18:09:14.094006] [INFO ] [MAIN ] Update Progress: 552/2371 symbols completed. CTS took 25.2s. Estimated remaining: 3h 47m 59s. Rate: 8.0 symbols/min [2025-09-29T18:09:14.291928] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:09:14.394939] [DEBUG] [LOCAL ] CUBE: Loaded 51391 existing records from primary storage. [2025-09-29T18:09:14.395884] [INFO ] [MAIN ] CUBE: Loaded 51391 existing records. [2025-09-29T18:09:14.478029] [DEBUG] [LOCAL ] CTRE: Primary data saved (49220 records). [2025-09-29T18:09:14.494900] [INFO ] [MAIN ] CTRE: Full history saved. [2025-09-29T18:09:14.506103] [INFO ] [MAIN ] Update Progress: 553/2371 symbols completed. CTRE took 38.6s. Estimated remaining: 3h 47m 28s. Rate: 8.0 symbols/min [2025-09-29T18:09:14.745576] [WARN ] [MAIN ] CUBE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:09:14.781059] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-09-29T18:09:14.757675] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-09-29T18:09:14.782515] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-09-29T18:09:14.780963] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:09:14.783398] [DEBUG] [LOCAL ] CUBE: Deleted primary data file. [2025-09-29T18:09:14.783623] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-09-29T18:09:15.103974] [DEBUG] [LOCAL ] CUBI: Loaded 27667 existing records from primary storage. [2025-09-29T18:09:15.107442] [INFO ] [MAIN ] CUBI: Loaded 27667 existing records. [2025-09-29T18:09:15.181330] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-29T18:09:15.337627] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:09:15.423434] [WARN ] [MAIN ] CUBI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:09:15.423719] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-09-29T18:09:15.423778] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-09-29T18:09:15.424265] [DEBUG] [LOCAL ] CUBI: Deleted primary data file. [2025-09-29T18:09:15.424324] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-09-29T18:09:15.549665] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-09-29T18:09:15.844126] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:09:15.875577] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-29T18:09:15.941937] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-29T18:09:16.348123] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-09-29T18:09:16.632821] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-09-29T18:09:17.148120] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-09-29T18:09:17.369369] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.22 seconds). [2025-09-29T18:09:17.948108] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-09-29T18:09:18.288135] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-29T18:09:18.748117] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2024-12. [2025-09-29T18:09:19.548112] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-09-29T18:09:20.042147] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-29T18:09:20.348118] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-09-29T18:09:20.784574] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-29T18:09:21.148108] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-09-29T18:09:21.311789] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-29T18:09:21.606276] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-29T18:09:21.607103] [INFO ] [REMOTE ] CUBB: Full fetch complete (927 records). [2025-09-29T18:09:21.607178] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-09-29T18:09:21.799997] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-29T18:09:21.800208] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:09:21.800265] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:09:21.800343] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-09-29T18:09:21.800419] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-09-29T18:09:21.800462] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-09-29T18:09:21.800553] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-09-29T18:09:21.800670] [INFO ] [MAIN ] Update Progress: 554/2371 symbols completed. CUBB took 14.4s. Estimated remaining: 3h 47m 20s. Rate: 8.0 symbols/min [2025-09-29T18:09:21.954192] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2024-12. [2025-09-29T18:09:21.990569] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:09:22.046606] [DEBUG] [LOCAL ] CUK: Loaded 51762 existing records from primary storage. [2025-09-29T18:09:22.046987] [INFO ] [MAIN ] CUK: Loaded 51762 existing records. [2025-09-29T18:09:22.240288] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:09:22.240493] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-09-29T18:09:22.240540] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-09-29T18:09:22.241016] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-09-29T18:09:22.241074] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-09-29T18:09:22.613419] [INFO ] [REMOTE ] CUK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:09:22.748118] [INFO ] [REMOTE ] CUK: Fetching primary data for 2024-12. [2025-09-29T18:09:23.548156] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-01. [2025-09-29T18:09:23.793513] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-29T18:09:24.348151] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-01. [2025-09-29T18:09:24.517486] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-29T18:09:24.887907] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-29T18:09:25.148123] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-01. [2025-09-29T18:09:25.948083] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-09-29T18:09:26.083008] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-29T18:09:26.631738] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-29T18:09:26.748136] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-09-29T18:09:27.548167] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-09-29T18:09:27.754771] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-29T18:09:28.143791] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-29T18:09:28.348134] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-09-29T18:09:29.148076] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-09-29T18:09:29.171343] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-29T18:09:29.492930] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-29T18:09:29.948104] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-09-29T18:09:30.748097] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-09-29T18:09:30.785859] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-29T18:09:31.246322] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-29T18:09:31.548207] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-09-29T18:09:32.348143] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-09-29T18:09:32.673706] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-29T18:09:33.148158] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-09-29T18:09:33.499198] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-29T18:09:33.916772] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-29T18:09:33.948065] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-09-29T18:09:34.748137] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-09-29T18:09:35.263213] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-29T18:09:35.548100] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-09-29T18:09:35.740193] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-29T18:09:36.348136] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-09-29T18:09:36.432269] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-29T18:09:37.148124] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-09-29T18:09:37.198873] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-29T18:09:37.685736] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-29T18:09:37.948136] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-09-29T18:09:38.748078] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-09-29T18:09:38.823727] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-29T18:09:39.022569] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-29T18:09:39.548122] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-09-29T18:09:40.238334] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-29T18:09:40.348124] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-09-29T18:09:41.148089] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-09-29T18:09:41.326159] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-29T18:09:41.587837] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-29T18:09:41.948096] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-09-29T18:09:42.748123] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-09-29T18:09:43.162187] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-29T18:09:43.175112] [INFO ] [REMOTE ] CTVA: Full fetch complete (76965 records). [2025-09-29T18:09:43.175310] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-09-29T18:09:43.528796] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-29T18:09:43.551856] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-09-29T18:09:43.644470] [DEBUG] [VALIDATOR ] CTVA: All expected trading days are present. [2025-09-29T18:09:43.644562] [DEBUG] [VALIDATOR ] CTVA: Primary data validation passed. [2025-09-29T18:09:43.645578] [INFO ] [MAIN ] CTVA: Fetched primary data is valid. [2025-09-29T18:09:43.645668] [DEBUG] [LOCAL ] CTVA: Saving primary data. [2025-09-29T18:09:43.648618] [DEBUG] [LOCAL ] CTVA: Trimmed 76965 records to 53232 (keeping 200 days of data) [2025-09-29T18:09:44.004694] [DEBUG] [LOCAL ] CTVA: Primary data saved (53232 records). [2025-09-29T18:09:44.004847] [INFO ] [MAIN ] CTVA: Full history saved. [2025-09-29T18:09:44.004983] [INFO ] [MAIN ] Update Progress: 555/2371 symbols completed. CTVA took 44.0s. Estimated remaining: 3h 48m 1s. Rate: 8.0 symbols/min [2025-09-29T18:09:44.187157] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:09:44.192767] [DEBUG] [LOCAL ] CULP: Loaded 3111 existing records from primary storage. [2025-09-29T18:09:44.192960] [INFO ] [MAIN ] CULP: Loaded 3111 existing records. [2025-09-29T18:09:44.363990] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-09-29T18:09:44.384917] [WARN ] [MAIN ] CULP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:09:44.385267] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-09-29T18:09:44.385366] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-09-29T18:09:44.385872] [DEBUG] [LOCAL ] CULP: Deleted primary data file. [2025-09-29T18:09:44.385936] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-09-29T18:09:44.778141] [INFO ] [REMOTE ] CULP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:09:44.809241] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-29T18:09:45.148169] [INFO ] [REMOTE ] CULP: Fetching primary data for 2024-12. [2025-09-29T18:09:45.470394] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-29T18:09:45.585277] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-29T18:09:45.838767] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-29T18:09:45.948118] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-09-29T18:09:46.748146] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-01. [2025-09-29T18:09:47.110916] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-29T18:09:47.548141] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-09-29T18:09:47.854265] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-29T18:09:47.896863] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-29T18:09:48.348152] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-09-29T18:09:49.004868] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-29T18:09:49.148111] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-09-29T18:09:49.948174] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-09-29T18:09:50.555478] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-29T18:09:50.748130] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-09-29T18:09:51.290953] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-29T18:09:51.302899] [INFO ] [REMOTE ] CUK: Full fetch complete (73842 records). [2025-09-29T18:09:51.303095] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-09-29T18:09:51.553350] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-09-29T18:09:51.753490] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present. [2025-09-29T18:09:51.753591] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed. [2025-09-29T18:09:51.754580] [INFO ] [MAIN ] CUK: Fetched primary data is valid. [2025-09-29T18:09:51.754675] [DEBUG] [LOCAL ] CUK: Saving primary data. [2025-09-29T18:09:51.756255] [DEBUG] [LOCAL ] CUK: Trimmed 73842 records to 50998 (keeping 200 days of data) [2025-09-29T18:09:52.080998] [DEBUG] [LOCAL ] CUK: Primary data saved (50998 records). [2025-09-29T18:09:52.081160] [INFO ] [MAIN ] CUK: Full history saved. [2025-09-29T18:09:52.081290] [INFO ] [MAIN ] Update Progress: 556/2371 symbols completed. CUK took 30.3s. Estimated remaining: 3h 47m 55s. Rate: 8.0 symbols/min [2025-09-29T18:09:52.266521] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:09:52.305158] [DEBUG] [LOCAL ] CURB: Loaded 33350 existing records from primary storage. [2025-09-29T18:09:52.305670] [INFO ] [MAIN ] CURB: Loaded 33350 existing records. [2025-09-29T18:09:52.352071] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-09-29T18:09:52.506530] [WARN ] [MAIN ] CURB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:09:52.506875] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-09-29T18:09:52.506960] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-09-29T18:09:52.507521] [DEBUG] [LOCAL ] CURB: Deleted primary data file. [2025-09-29T18:09:52.520230] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-09-29T18:09:52.650985] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-29T18:09:52.904840] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-29T18:09:52.992223] [INFO ] [REMOTE ] CURB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:09:53.152133] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-09-29T18:09:53.156384] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-29T18:09:53.163295] [INFO ] [REMOTE ] CUBI: Full fetch complete (39325 records). [2025-09-29T18:09:53.163389] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-09-29T18:09:53.545135] [DEBUG] [VALIDATOR ] CUBI: All expected trading days are present. [2025-09-29T18:09:53.545220] [DEBUG] [VALIDATOR ] CUBI: Primary data validation passed. [2025-09-29T18:09:53.545914] [INFO ] [MAIN ] CUBI: Fetched primary data is valid. [2025-09-29T18:09:53.545983] [DEBUG] [LOCAL ] CUBI: Saving primary data. [2025-09-29T18:09:53.546960] [DEBUG] [LOCAL ] CUBI: Trimmed 39325 records to 27225 (keeping 200 days of data) [2025-09-29T18:09:53.720930] [DEBUG] [LOCAL ] CUBI: Primary data saved (27225 records). [2025-09-29T18:09:53.721071] [INFO ] [MAIN ] CUBI: Full history saved. [2025-09-29T18:09:53.721158] [INFO ] [MAIN ] Update Progress: 557/2371 symbols completed. CUBI took 39.2s. Estimated remaining: 3h 47m 28s. Rate: 8.0 symbols/min [2025-09-29T18:09:53.948136] [INFO ] [REMOTE ] CURB: Fetching primary data for 2024-12. [2025-09-29T18:09:54.748100] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-09-29T18:09:55.189206] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-29T18:09:55.191169] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-29T18:09:55.203410] [INFO ] [REMOTE ] CUBE: Full fetch complete (72990 records). [2025-09-29T18:09:55.203559] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-09-29T18:09:55.559911] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-09-29T18:09:55.654545] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-29T18:09:55.654748] [DEBUG] [VALIDATOR ] CUBE: All expected trading days are present. [2025-09-29T18:09:55.662002] [DEBUG] [VALIDATOR ] CUBE: Primary data validation passed. [2025-09-29T18:09:55.663814] [INFO ] [MAIN ] CUBE: Fetched primary data is valid. [2025-09-29T18:09:55.663898] [DEBUG] [LOCAL ] CUBE: Saving primary data. [2025-09-29T18:09:55.667376] [DEBUG] [LOCAL ] CUBE: Trimmed 72990 records to 50626 (keeping 200 days of data) [2025-09-29T18:09:56.000513] [DEBUG] [LOCAL ] CUBE: Primary data saved (50626 records). [2025-09-29T18:09:56.000694] [INFO ] [MAIN ] CUBE: Full history saved. [2025-09-29T18:09:56.000813] [INFO ] [MAIN ] Update Progress: 558/2371 symbols completed. CUBE took 41.9s. Estimated remaining: 3h 47m 4s. Rate: 8.0 symbols/min [2025-09-29T18:09:56.324765] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-29T18:09:56.348134] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-01. [2025-09-29T18:09:57.148129] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-09-29T18:09:57.615031] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-29T18:09:57.700577] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-29T18:09:57.948146] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-09-29T18:09:58.748165] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-09-29T18:09:59.008113] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-29T18:09:59.490613] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-29T18:09:59.491973] [INFO ] [REMOTE ] CULP: Full fetch complete (4752 records). [2025-09-29T18:09:59.492044] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-09-29T18:09:59.558998] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-09-29T18:09:59.868333] [DEBUG] [VALIDATOR ] CULP: All expected trading days are present. [2025-09-29T18:09:59.868411] [DEBUG] [VALIDATOR ] CULP: Primary data validation passed. [2025-09-29T18:09:59.868556] [INFO ] [MAIN ] CULP: Fetched primary data is valid. [2025-09-29T18:09:59.868606] [DEBUG] [LOCAL ] CULP: Saving primary data. [2025-09-29T18:09:59.868995] [DEBUG] [LOCAL ] CULP: Trimmed 4752 records to 2994 (keeping 200 days of data) [2025-09-29T18:09:59.886033] [DEBUG] [LOCAL ] CULP: Primary data saved (2994 records). [2025-09-29T18:09:59.886124] [INFO ] [MAIN ] CULP: Full history saved. [2025-09-29T18:09:59.886200] [INFO ] [MAIN ] Update Progress: 559/2371 symbols completed. CULP took 15.9s. Estimated remaining: 3h 46m 44s. Rate: 8.0 symbols/min [2025-09-29T18:10:01.090595] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-29T18:10:01.098815] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-09-29T18:10:02.694323] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-29T18:10:02.706916] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-09-29T18:10:03.983086] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-29T18:10:03.989515] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-09-29T18:10:05.362381] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-29T18:10:05.369753] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-09-29T18:10:07.066250] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-29T18:10:07.075079] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-09-29T18:10:08.603917] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-29T18:10:08.612020] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-09-29T18:10:09.604935] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-29T18:10:09.612375] [INFO ] [REMOTE ] CURB: Full fetch complete (46992 records). [2025-09-29T18:10:09.612521] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-09-29T18:10:09.613703] [FATAL] [VALIDATOR ] CURB: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:10:09.613817] [FATAL] [MAIN ] CURB: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:10:09.613868] [WARN ] [MAIN ] CURB: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:10:09.613945] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-09-29T18:10:09.614036] [DEBUG] [LOCAL ] CURB: No primary data file found to delete. [2025-09-29T18:10:09.614109] [INFO ] [LOCAL ] CURB: Starting deletion of derivative data. [2025-09-29T18:10:09.614881] [DEBUG] [LOCAL ] CURB: Deleted derivative data file. [2025-09-29T18:10:09.614994] [INFO ] [MAIN ] Update Progress: 560/2371 symbols completed. CURB took 17.5s. Estimated remaining: 3h 46m 44s. Rate: 8.0 symbols/min [2025-09-29T18:10:10.326887] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:10:10.369199] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:10:10.372783] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:10:10.374180] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:10:10.392598] [DEBUG] [LOCAL ] CVEO: Loaded 15402 existing records from primary storage. [2025-09-29T18:10:10.393054] [INFO ] [MAIN ] CVEO: Loaded 15402 existing records. [2025-09-29T18:10:10.521117] [DEBUG] [LOCAL ] CURV: Loaded 26933 existing records from primary storage. [2025-09-29T18:10:10.543829] [INFO ] [MAIN ] CURV: Loaded 26933 existing records. [2025-09-29T18:10:10.738699] [WARN ] [MAIN ] CVEO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:10:10.756843] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-09-29T18:10:10.756611] [DEBUG] [LOCAL ] CUZ: Loaded 50140 existing records from primary storage. [2025-09-29T18:10:10.780609] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-09-29T18:10:10.795094] [INFO ] [MAIN ] CUZ: Loaded 50140 existing records. [2025-09-29T18:10:10.816901] [DEBUG] [LOCAL ] CVE: Loaded 54336 existing records from primary storage. [2025-09-29T18:10:10.827625] [INFO ] [MAIN ] CVE: Loaded 54336 existing records. [2025-09-29T18:10:10.843683] [DEBUG] [LOCAL ] CVEO: Deleted primary data file. [2025-09-29T18:10:10.879475] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-09-29T18:10:11.048862] [WARN ] [MAIN ] CURV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:10:11.134064] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-09-29T18:10:11.207382] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-09-29T18:10:11.239476] [DEBUG] [LOCAL ] CURV: Deleted primary data file. [2025-09-29T18:10:11.245429] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-09-29T18:10:11.512045] [WARN ] [MAIN ] CVE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:10:11.639818] [WARN ] [MAIN ] CUZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:10:11.651802] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-09-29T18:10:11.695972] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-09-29T18:10:11.701418] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-09-29T18:10:11.759626] [DEBUG] [LOCAL ] CVE: Deleted primary data file. [2025-09-29T18:10:11.759518] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-09-29T18:10:11.796901] [DEBUG] [LOCAL ] CUZ: Deleted primary data file. [2025-09-29T18:10:11.797084] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-09-29T18:10:11.808678] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-09-29T18:10:12.168314] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:10:12.211421] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2024-12. [2025-09-29T18:10:12.624591] [INFO ] [REMOTE ] CURV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:10:12.726282] [INFO ] [REMOTE ] CURV: Fetching primary data for 2024-12. [2025-09-29T18:10:13.034875] [INFO ] [REMOTE ] CVE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:10:13.047790] [INFO ] [REMOTE ] CVE: Fetching primary data for 2024-12. [2025-09-29T18:10:13.047260] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:10:13.049137] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2024-12. [2025-09-29T18:10:13.312226] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-29T18:10:13.315042] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-09-29T18:10:14.093234] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-29T18:10:14.095667] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-09-29T18:10:14.758390] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-29T18:10:14.769249] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-01. [2025-09-29T18:10:15.131252] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-29T18:10:15.149441] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-01. [2025-09-29T18:10:15.160635] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-29T18:10:15.164604] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-09-29T18:10:16.073552] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-29T18:10:16.077855] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-09-29T18:10:16.109007] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2024-12 (3.38 seconds). [2025-09-29T18:10:16.117276] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-01. [2025-09-29T18:10:16.441313] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-29T18:10:16.451560] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-09-29T18:10:16.765476] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-29T18:10:16.769521] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-09-29T18:10:17.050762] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-29T18:10:17.062913] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-09-29T18:10:17.313225] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-29T18:10:17.318975] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-09-29T18:10:17.647907] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-29T18:10:17.658099] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-09-29T18:10:17.680351] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-29T18:10:17.948105] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-09-29T18:10:18.491280] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-29T18:10:18.748083] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-09-29T18:10:18.832596] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-29T18:10:18.876674] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-29T18:10:19.234791] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-29T18:10:19.548091] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-09-29T18:10:19.895896] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-29T18:10:20.348130] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-09-29T18:10:21.148114] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-09-29T18:10:21.475480] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-29T18:10:21.506547] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-29T18:10:21.948107] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-09-29T18:10:22.130831] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-29T18:10:22.748113] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-09-29T18:10:23.548089] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-09-29T18:10:23.724604] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-29T18:10:23.941388] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-29T18:10:24.348117] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-09-29T18:10:24.655814] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-29T18:10:25.148121] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-09-29T18:10:25.461204] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-29T18:10:25.948121] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-09-29T18:10:26.748127] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-09-29T18:10:27.171354] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-29T18:10:27.368163] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-29T18:10:27.548094] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-09-29T18:10:28.342789] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-29T18:10:28.350110] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-09-29T18:10:28.740858] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-29T18:10:28.744587] [INFO ] [REMOTE ] CVEO: Full fetch complete (20216 records). [2025-09-29T18:10:28.744751] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-09-29T18:10:29.161229] [DEBUG] [VALIDATOR ] CVEO: All expected trading days are present. [2025-09-29T18:10:29.151694] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-09-29T18:10:29.162335] [DEBUG] [VALIDATOR ] CVEO: Primary data validation passed. [2025-09-29T18:10:29.162986] [INFO ] [MAIN ] CVEO: Fetched primary data is valid. [2025-09-29T18:10:29.163057] [DEBUG] [LOCAL ] CVEO: Saving primary data. [2025-09-29T18:10:29.164148] [DEBUG] [LOCAL ] CVEO: Trimmed 20216 records to 15098 (keeping 200 days of data) [2025-09-29T18:10:29.260387] [DEBUG] [LOCAL ] CVEO: Primary data saved (15098 records). [2025-09-29T18:10:29.260594] [INFO ] [MAIN ] CVEO: Full history saved. [2025-09-29T18:10:29.260829] [INFO ] [MAIN ] Update Progress: 561/2371 symbols completed. CVEO took 19.6s. Estimated remaining: 3h 47m 16s. Rate: 8.0 symbols/min [2025-09-29T18:10:29.442162] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:10:29.498171] [DEBUG] [LOCAL ] CVI: Loaded 47160 existing records from primary storage. [2025-09-29T18:10:29.498535] [INFO ] [MAIN ] CVI: Loaded 47160 existing records. [2025-09-29T18:10:29.687150] [WARN ] [MAIN ] CVI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:10:29.687432] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-09-29T18:10:29.687496] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-09-29T18:10:29.687972] [DEBUG] [LOCAL ] CVI: Deleted primary data file. [2025-09-29T18:10:29.688032] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-09-29T18:10:29.963854] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-09-29T18:10:30.085800] [INFO ] [REMOTE ] CVI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:10:30.146750] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-29T18:10:30.415665] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-29T18:10:30.748124] [INFO ] [REMOTE ] CVI: Fetching primary data for 2024-12. [2025-09-29T18:10:31.548128] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-09-29T18:10:31.788820] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-29T18:10:32.348109] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-09-29T18:10:32.494234] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-29T18:10:33.112003] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-29T18:10:33.119428] [INFO ] [REMOTE ] CURV: Full fetch complete (39137 records). [2025-09-29T18:10:33.119556] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-09-29T18:10:33.153217] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-09-29T18:10:33.546124] [DEBUG] [VALIDATOR ] CURV: All expected trading days are present. [2025-09-29T18:10:33.546321] [DEBUG] [VALIDATOR ] CURV: Primary data validation passed. [2025-09-29T18:10:33.547208] [INFO ] [MAIN ] CURV: Fetched primary data is valid. [2025-09-29T18:10:33.547394] [DEBUG] [LOCAL ] CURV: Saving primary data. [2025-09-29T18:10:33.549102] [DEBUG] [LOCAL ] CURV: Trimmed 39137 records to 26507 (keeping 200 days of data) [2025-09-29T18:10:33.719701] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-29T18:10:33.757581] [DEBUG] [LOCAL ] CURV: Primary data saved (26507 records). [2025-09-29T18:10:33.757766] [INFO ] [MAIN ] CURV: Full history saved. [2025-09-29T18:10:33.757872] [INFO ] [MAIN ] Update Progress: 562/2371 symbols completed. CURV took 24.1s. Estimated remaining: 3h 46m 58s. Rate: 8.0 symbols/min [2025-09-29T18:10:33.963161] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-09-29T18:10:34.004948] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:10:34.025471] [DEBUG] [LOCAL ] CVLG: Loaded 15730 existing records from primary storage. [2025-09-29T18:10:34.025790] [INFO ] [MAIN ] CVLG: Loaded 15730 existing records. [2025-09-29T18:10:34.222665] [WARN ] [MAIN ] CVLG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:10:34.223065] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-09-29T18:10:34.223127] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-09-29T18:10:34.224167] [DEBUG] [LOCAL ] CVLG: Deleted primary data file. [2025-09-29T18:10:34.224249] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-09-29T18:10:34.621508] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:10:34.748183] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2024-12. [2025-09-29T18:10:35.178413] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-29T18:10:35.353760] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-29T18:10:35.371789] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-29T18:10:35.548183] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-09-29T18:10:36.348139] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-01. [2025-09-29T18:10:37.148112] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-01. [2025-09-29T18:10:37.303029] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-29T18:10:37.932717] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-29T18:10:37.948060] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-09-29T18:10:37.990232] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-29T18:10:38.748131] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-09-29T18:10:39.235478] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-29T18:10:39.548141] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-09-29T18:10:40.348093] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-09-29T18:10:40.548819] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-29T18:10:40.559464] [INFO ] [REMOTE ] CUZ: Full fetch complete (70856 records). [2025-09-29T18:10:40.559631] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-09-29T18:10:40.980763] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present. [2025-09-29T18:10:40.980867] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed. [2025-09-29T18:10:40.981745] [INFO ] [MAIN ] CUZ: Fetched primary data is valid. [2025-09-29T18:10:40.981832] [DEBUG] [LOCAL ] CUZ: Saving primary data. [2025-09-29T18:10:40.983287] [DEBUG] [LOCAL ] CUZ: Trimmed 70856 records to 49357 (keeping 200 days of data) [2025-09-29T18:10:41.170228] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-09-29T18:10:41.334053] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-29T18:10:41.336321] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-29T18:10:41.360468] [DEBUG] [LOCAL ] CUZ: Primary data saved (49357 records). [2025-09-29T18:10:41.361094] [INFO ] [MAIN ] CUZ: Full history saved. [2025-09-29T18:10:41.361252] [INFO ] [MAIN ] Update Progress: 563/2371 symbols completed. CUZ took 31.7s. Estimated remaining: 3h 46m 51s. Rate: 8.0 symbols/min [2025-09-29T18:10:41.570184] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:10:41.629741] [DEBUG] [LOCAL ] CVNA: Loaded 53766 existing records from primary storage. [2025-09-29T18:10:41.630090] [INFO ] [MAIN ] CVNA: Loaded 53766 existing records. [2025-09-29T18:10:41.881922] [WARN ] [MAIN ] CVNA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:10:41.882162] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-09-29T18:10:41.882238] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-09-29T18:10:41.882942] [DEBUG] [LOCAL ] CVNA: Deleted primary data file. [2025-09-29T18:10:41.883006] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-09-29T18:10:41.955543] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-09-29T18:10:42.313258] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:10:42.748144] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-09-29T18:10:43.093065] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-29T18:10:43.548118] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-09-29T18:10:43.650366] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-29T18:10:43.670917] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-29T18:10:44.348142] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2024-12. [2025-09-29T18:10:45.148102] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-09-29T18:10:45.548761] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-29T18:10:45.560590] [INFO ] [REMOTE ] CVE: Full fetch complete (77550 records). [2025-09-29T18:10:45.560923] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-09-29T18:10:45.957481] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-09-29T18:10:46.011445] [DEBUG] [VALIDATOR ] CVE: All expected trading days are present. [2025-09-29T18:10:46.011532] [DEBUG] [VALIDATOR ] CVE: Primary data validation passed. [2025-09-29T18:10:46.012565] [INFO ] [MAIN ] CVE: Fetched primary data is valid. [2025-09-29T18:10:46.012635] [DEBUG] [LOCAL ] CVE: Saving primary data. [2025-09-29T18:10:46.014308] [DEBUG] [LOCAL ] CVE: Trimmed 77550 records to 53557 (keeping 200 days of data) [2025-09-29T18:10:46.375108] [DEBUG] [LOCAL ] CVE: Primary data saved (53557 records). [2025-09-29T18:10:46.375276] [INFO ] [MAIN ] CVE: Full history saved. [2025-09-29T18:10:46.375368] [INFO ] [MAIN ] Update Progress: 564/2371 symbols completed. CVE took 36.8s. Estimated remaining: 3h 46m 36s. Rate: 8.0 symbols/min [2025-09-29T18:10:46.550505] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-09-29T18:10:46.612020] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:10:46.670344] [DEBUG] [LOCAL ] CVS: Loaded 54476 existing records from primary storage. [2025-09-29T18:10:46.670898] [INFO ] [MAIN ] CVS: Loaded 54476 existing records. [2025-09-29T18:10:46.750367] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-01. [2025-09-29T18:10:46.877994] [WARN ] [MAIN ] CVS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:10:46.879043] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-09-29T18:10:46.879253] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-09-29T18:10:46.879858] [DEBUG] [LOCAL ] CVS: Deleted primary data file. [2025-09-29T18:10:46.879966] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-09-29T18:10:46.978688] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-29T18:10:47.140336] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-29T18:10:47.379919] [INFO ] [REMOTE ] CVS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:10:47.548157] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-09-29T18:10:48.348126] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-09-29T18:10:48.543212] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-29T18:10:48.726361] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-29T18:10:49.148125] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-09-29T18:10:49.948113] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-09-29T18:10:49.982917] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-29T18:10:50.143876] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-29T18:10:50.748139] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-09-29T18:10:51.548123] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-09-29T18:10:51.696796] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-29T18:10:52.158587] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-09-29T18:10:52.348129] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-09-29T18:10:53.146274] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-29T18:10:53.148876] [INFO ] [REMOTE ] CVS: Fetching primary data for 2024-12. [2025-09-29T18:10:53.280356] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-29T18:10:53.948148] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-09-29T18:10:54.748150] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-09-29T18:10:55.548142] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-09-29T18:10:55.756752] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2024-12 (2.61 seconds). [2025-09-29T18:10:56.190353] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-29T18:10:56.231376] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-29T18:10:56.348138] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-09-29T18:10:56.553484] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-29T18:10:56.557574] [INFO ] [REMOTE ] CVLG: Full fetch complete (20833 records). [2025-09-29T18:10:56.557717] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-09-29T18:10:56.940479] [DEBUG] [VALIDATOR ] CVLG: All expected trading days are present. [2025-09-29T18:10:56.940565] [DEBUG] [VALIDATOR ] CVLG: Primary data validation passed. [2025-09-29T18:10:56.941039] [INFO ] [MAIN ] CVLG: Fetched primary data is valid. [2025-09-29T18:10:56.941103] [DEBUG] [LOCAL ] CVLG: Saving primary data. [2025-09-29T18:10:56.941784] [DEBUG] [LOCAL ] CVLG: Trimmed 20833 records to 15540 (keeping 200 days of data) [2025-09-29T18:10:57.041394] [DEBUG] [LOCAL ] CVLG: Primary data saved (15540 records). [2025-09-29T18:10:57.041581] [INFO ] [MAIN ] CVLG: Full history saved. [2025-09-29T18:10:57.041701] [INFO ] [MAIN ] Update Progress: 565/2371 symbols completed. CVLG took 23.3s. Estimated remaining: 3h 46m 38s. Rate: 8.0 symbols/min [2025-09-29T18:10:57.151101] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-09-29T18:10:57.227066] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:10:57.291440] [DEBUG] [LOCAL ] CVX: Loaded 54540 existing records from primary storage. [2025-09-29T18:10:57.291833] [INFO ] [MAIN ] CVX: Loaded 54540 existing records. [2025-09-29T18:10:57.499050] [WARN ] [MAIN ] CVX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:10:57.499274] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-09-29T18:10:57.499324] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-09-29T18:10:57.499910] [DEBUG] [LOCAL ] CVX: Deleted primary data file. [2025-09-29T18:10:57.499973] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-09-29T18:10:57.897351] [INFO ] [REMOTE ] CVX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:10:57.948096] [INFO ] [REMOTE ] CVX: Fetching primary data for 2024-12. [2025-09-29T18:10:58.722299] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-29T18:10:58.748103] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-09-29T18:10:58.982422] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-29T18:10:58.992911] [INFO ] [REMOTE ] CVI: Full fetch complete (67277 records). [2025-09-29T18:10:58.993098] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-09-29T18:10:59.442589] [DEBUG] [VALIDATOR ] CVI: All expected trading days are present. [2025-09-29T18:10:59.442762] [DEBUG] [VALIDATOR ] CVI: Primary data validation passed. [2025-09-29T18:10:59.443790] [INFO ] [MAIN ] CVI: Fetched primary data is valid. [2025-09-29T18:10:59.443910] [DEBUG] [LOCAL ] CVI: Saving primary data. [2025-09-29T18:10:59.445582] [DEBUG] [LOCAL ] CVI: Trimmed 67277 records to 46430 (keeping 200 days of data) [2025-09-29T18:10:59.555756] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-01. [2025-09-29T18:10:59.850094] [DEBUG] [LOCAL ] CVI: Primary data saved (46430 records). [2025-09-29T18:10:59.850300] [INFO ] [MAIN ] CVI: Full history saved. [2025-09-29T18:10:59.850459] [INFO ] [MAIN ] Update Progress: 566/2371 symbols completed. CVI took 30.6s. Estimated remaining: 3h 46m 16s. Rate: 8.0 symbols/min [2025-09-29T18:11:00.132033] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:11:00.164905] [DEBUG] [LOCAL ] CW: Loaded 22705 existing records from primary storage. [2025-09-29T18:11:00.165249] [INFO ] [MAIN ] CW: Loaded 22705 existing records. [2025-09-29T18:11:00.402418] [WARN ] [MAIN ] CW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:11:00.402925] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-09-29T18:11:00.403003] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-09-29T18:11:00.403337] [DEBUG] [LOCAL ] CW: Deleted primary data file. [2025-09-29T18:11:00.403415] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-09-29T18:11:00.604098] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2024-12 (2.66 seconds). [2025-09-29T18:11:00.638574] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-01. [2025-09-29T18:11:00.914971] [INFO ] [REMOTE ] CW: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:11:01.117141] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-09-29T18:11:01.148094] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-09-29T18:11:01.752378] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-09-29T18:11:01.948107] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-09-29T18:11:02.748088] [INFO ] [REMOTE ] CW: Fetching primary data for 2024-12. [2025-09-29T18:11:03.235379] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-01 (2.60 seconds). [2025-09-29T18:11:03.318932] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-29T18:11:03.548190] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-09-29T18:11:04.004613] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-29T18:11:04.034440] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-29T18:11:04.348129] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-01. [2025-09-29T18:11:05.148187] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-09-29T18:11:05.574576] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-29T18:11:05.776162] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-29T18:11:05.948121] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-09-29T18:11:06.748181] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-09-29T18:11:07.378580] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-09-29T18:11:07.548147] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-09-29T18:11:07.993095] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-29T18:11:08.348117] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-09-29T18:11:08.507347] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-29T18:11:08.970372] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-29T18:11:09.148124] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-09-29T18:11:09.948140] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-09-29T18:11:10.702960] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-09-29T18:11:10.713681] [INFO ] [REMOTE ] CVNA: Full fetch complete (76673 records). [2025-09-29T18:11:10.713828] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-09-29T18:11:10.754128] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-09-29T18:11:11.147627] [DEBUG] [VALIDATOR ] CVNA: All expected trading days are present. [2025-09-29T18:11:11.147878] [DEBUG] [VALIDATOR ] CVNA: Primary data validation passed. [2025-09-29T18:11:11.149175] [INFO ] [MAIN ] CVNA: Fetched primary data is valid. [2025-09-29T18:11:11.149298] [DEBUG] [LOCAL ] CVNA: Saving primary data. [2025-09-29T18:11:11.151587] [DEBUG] [LOCAL ] CVNA: Trimmed 76673 records to 52985 (keeping 200 days of data) [2025-09-29T18:11:11.274773] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-29T18:11:11.540442] [DEBUG] [LOCAL ] CVNA: Primary data saved (52985 records). [2025-09-29T18:11:11.540594] [INFO ] [MAIN ] CVNA: Full history saved. [2025-09-29T18:11:11.540707] [INFO ] [MAIN ] Update Progress: 567/2371 symbols completed. CVNA took 30.2s. Estimated remaining: 3h 46m 21s. Rate: 8.0 symbols/min [2025-09-29T18:11:11.552263] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-09-29T18:11:11.724741] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:11:11.778407] [DEBUG] [LOCAL ] CWAN: Loaded 53154 existing records from primary storage. [2025-09-29T18:11:11.778809] [INFO ] [MAIN ] CWAN: Loaded 53154 existing records. [2025-09-29T18:11:11.984296] [WARN ] [MAIN ] CWAN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:11:11.984896] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-09-29T18:11:11.985077] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-09-29T18:11:11.990871] [DEBUG] [LOCAL ] CWAN: Deleted primary data file. [2025-09-29T18:11:11.999459] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-09-29T18:11:12.026036] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-29T18:11:12.367114] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-09-29T18:11:12.411287] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:11:12.444696] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (2.50 seconds). [2025-09-29T18:11:13.148134] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-09-29T18:11:13.570222] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-29T18:11:13.718193] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-29T18:11:13.948098] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-09-29T18:11:14.748138] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2024-12. [2025-09-29T18:11:15.548117] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-09-29T18:11:15.804740] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (2.66 seconds). [2025-09-29T18:11:15.854749] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-29T18:11:16.348129] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-09-29T18:11:16.437962] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-29T18:11:17.127219] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-29T18:11:17.148080] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-09-29T18:11:17.948125] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-09-29T18:11:18.397629] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-29T18:11:18.489697] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-29T18:11:18.748128] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-09-29T18:11:19.548124] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-09-29T18:11:20.258532] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-29T18:11:20.348125] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-09-29T18:11:20.526308] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-29T18:11:21.148113] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-09-29T18:11:21.853522] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-09-29T18:11:21.948111] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-09-29T18:11:22.036519] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-29T18:11:22.748086] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-09-29T18:11:22.939607] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-29T18:11:22.973377] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-29T18:11:23.548155] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-09-29T18:11:24.348123] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-09-29T18:11:24.719133] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-29T18:11:25.004860] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-29T18:11:25.148162] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-09-29T18:11:25.948117] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-09-29T18:11:26.070241] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-29T18:11:26.345173] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-29T18:11:26.350091] [INFO ] [REMOTE ] CW: Full fetch complete (33427 records). [2025-09-29T18:11:26.350189] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-09-29T18:11:26.748382] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-09-29T18:11:26.748838] [DEBUG] [VALIDATOR ] CW: All expected trading days are present. [2025-09-29T18:11:26.749172] [DEBUG] [VALIDATOR ] CW: Primary data validation passed. [2025-09-29T18:11:26.750712] [INFO ] [MAIN ] CW: Fetched primary data is valid. [2025-09-29T18:11:26.750891] [DEBUG] [LOCAL ] CW: Saving primary data. [2025-09-29T18:11:26.752067] [DEBUG] [LOCAL ] CW: Trimmed 33427 records to 22246 (keeping 200 days of data) [2025-09-29T18:11:26.896863] [DEBUG] [LOCAL ] CW: Primary data saved (22246 records). [2025-09-29T18:11:26.897000] [INFO ] [MAIN ] CW: Full history saved. [2025-09-29T18:11:26.897085] [INFO ] [MAIN ] Update Progress: 568/2371 symbols completed. CW took 27.0s. Estimated remaining: 3h 46m 39s. Rate: 8.0 symbols/min [2025-09-29T18:11:27.069167] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:11:27.114127] [DEBUG] [LOCAL ] CWEN: Loaded 45717 existing records from primary storage. [2025-09-29T18:11:27.114435] [INFO ] [MAIN ] CWEN: Loaded 45717 existing records. [2025-09-29T18:11:27.298831] [WARN ] [MAIN ] CWEN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:11:27.299143] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-09-29T18:11:27.299205] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-09-29T18:11:27.299695] [DEBUG] [LOCAL ] CWEN: Deleted primary data file. [2025-09-29T18:11:27.299756] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-09-29T18:11:27.553232] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-09-29T18:11:27.662888] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:11:27.882275] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-29T18:11:27.893826] [INFO ] [REMOTE ] CVS: Full fetch complete (77813 records). [2025-09-29T18:11:27.894017] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-09-29T18:11:28.322613] [DEBUG] [VALIDATOR ] CVS: All expected trading days are present. [2025-09-29T18:11:28.322770] [DEBUG] [VALIDATOR ] CVS: Primary data validation passed. [2025-09-29T18:11:28.323756] [INFO ] [MAIN ] CVS: Fetched primary data is valid. [2025-09-29T18:11:28.323845] [DEBUG] [LOCAL ] CVS: Saving primary data. [2025-09-29T18:11:28.325559] [DEBUG] [LOCAL ] CVS: Trimmed 77813 records to 53696 (keeping 200 days of data) [2025-09-29T18:11:28.392396] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2024-12. [2025-09-29T18:11:28.451161] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-29T18:11:28.720864] [DEBUG] [LOCAL ] CVS: Primary data saved (53696 records). [2025-09-29T18:11:28.721058] [INFO ] [MAIN ] CVS: Full history saved. [2025-09-29T18:11:28.721151] [INFO ] [MAIN ] Update Progress: 569/2371 symbols completed. CVS took 42.3s. Estimated remaining: 3h 46m 13s. Rate: 8.0 symbols/min [2025-09-29T18:11:28.905280] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:11:28.963077] [DEBUG] [LOCAL ] CWH: Loaded 52151 existing records from primary storage. [2025-09-29T18:11:28.963480] [INFO ] [MAIN ] CWH: Loaded 52151 existing records. [2025-09-29T18:11:29.160541] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-09-29T18:11:29.167104] [WARN ] [MAIN ] CWH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:11:29.169319] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-09-29T18:11:29.169386] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-09-29T18:11:29.169966] [DEBUG] [LOCAL ] CWH: Deleted primary data file. [2025-09-29T18:11:29.170028] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-09-29T18:11:29.597980] [INFO ] [REMOTE ] CWH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:11:29.932983] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-09-29T18:11:29.948084] [INFO ] [REMOTE ] CWH: Fetching primary data for 2024-12. [2025-09-29T18:11:30.251527] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-29T18:11:30.748136] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-09-29T18:11:30.913762] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-29T18:11:31.253173] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-29T18:11:31.548130] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-01. [2025-09-29T18:11:32.348150] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-01. [2025-09-29T18:11:33.051403] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-29T18:11:33.148097] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-09-29T18:11:33.203247] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-09-29T18:11:33.214516] [INFO ] [REMOTE ] CVX: Full fetch complete (77845 records). [2025-09-29T18:11:33.214732] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-09-29T18:11:33.646156] [DEBUG] [VALIDATOR ] CVX: All expected trading days are present. [2025-09-29T18:11:33.646304] [DEBUG] [VALIDATOR ] CVX: Primary data validation passed. [2025-09-29T18:11:33.647254] [INFO ] [MAIN ] CVX: Fetched primary data is valid. [2025-09-29T18:11:33.647321] [DEBUG] [LOCAL ] CVX: Saving primary data. [2025-09-29T18:11:33.648973] [DEBUG] [LOCAL ] CVX: Trimmed 77845 records to 53760 (keeping 200 days of data) [2025-09-29T18:11:33.964997] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-09-29T18:11:34.025360] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-29T18:11:34.063352] [DEBUG] [LOCAL ] CVX: Primary data saved (53760 records). [2025-09-29T18:11:34.064187] [INFO ] [MAIN ] CVX: Full history saved. [2025-09-29T18:11:34.064487] [INFO ] [MAIN ] Update Progress: 570/2371 symbols completed. CVX took 37.0s. Estimated remaining: 3h 45m 59s. Rate: 8.0 symbols/min [2025-09-29T18:11:34.251225] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:11:34.306501] [DEBUG] [LOCAL ] CWK: Loaded 50158 existing records from primary storage. [2025-09-29T18:11:34.306976] [INFO ] [MAIN ] CWK: Loaded 50158 existing records. [2025-09-29T18:11:34.506986] [WARN ] [MAIN ] CWK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:11:34.507336] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-09-29T18:11:34.507557] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-09-29T18:11:34.508488] [DEBUG] [LOCAL ] CWK: Deleted primary data file. [2025-09-29T18:11:34.508554] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-09-29T18:11:34.753266] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-09-29T18:11:34.942559] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-29T18:11:34.987121] [INFO ] [REMOTE ] CWK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:11:35.271880] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-29T18:11:35.548149] [INFO ] [REMOTE ] CWK: Fetching primary data for 2024-12. [2025-09-29T18:11:36.019791] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-29T18:11:36.348121] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-09-29T18:11:37.148129] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-09-29T18:11:37.189411] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-29T18:11:37.948100] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-09-29T18:11:38.053775] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-29T18:11:38.748096] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-01. [2025-09-29T18:11:38.854392] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-29T18:11:39.558902] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-09-29T18:11:39.565391] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-29T18:11:40.149335] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-29T18:11:40.348118] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-09-29T18:11:41.148085] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-09-29T18:11:41.557315] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-29T18:11:41.948101] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-09-29T18:11:42.008612] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-29T18:11:42.755172] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-09-29T18:11:42.784386] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-29T18:11:43.284345] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-29T18:11:43.548114] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-09-29T18:11:44.348121] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-09-29T18:11:44.533316] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-29T18:11:44.874107] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-29T18:11:45.148177] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-09-29T18:11:45.948102] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-09-29T18:11:46.524025] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-29T18:11:46.536762] [INFO ] [REMOTE ] CWAN: Full fetch complete (75104 records). [2025-09-29T18:11:46.537025] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-09-29T18:11:46.764083] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-09-29T18:11:46.930708] [DEBUG] [VALIDATOR ] CWAN: All expected trading days are present. [2025-09-29T18:11:46.930831] [DEBUG] [VALIDATOR ] CWAN: Primary data validation passed. [2025-09-29T18:11:46.932172] [INFO ] [MAIN ] CWAN: Fetched primary data is valid. [2025-09-29T18:11:46.932244] [DEBUG] [LOCAL ] CWAN: Saving primary data. [2025-09-29T18:11:46.934308] [DEBUG] [LOCAL ] CWAN: Trimmed 75104 records to 52393 (keeping 200 days of data) [2025-09-29T18:11:47.270803] [DEBUG] [LOCAL ] CWAN: Primary data saved (52393 records). [2025-09-29T18:11:47.271030] [INFO ] [MAIN ] CWAN: Full history saved. [2025-09-29T18:11:47.271149] [INFO ] [MAIN ] Update Progress: 571/2371 symbols completed. CWAN took 35.7s. Estimated remaining: 3h 46m 9s. Rate: 8.0 symbols/min [2025-09-29T18:11:47.451678] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:11:47.489721] [DEBUG] [LOCAL ] CWT: Loaded 28294 existing records from primary storage. [2025-09-29T18:11:47.490130] [INFO ] [MAIN ] CWT: Loaded 28294 existing records. [2025-09-29T18:11:47.688446] [WARN ] [MAIN ] CWT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:11:47.689056] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-09-29T18:11:47.689150] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-09-29T18:11:47.690093] [DEBUG] [LOCAL ] CWT: Deleted primary data file. [2025-09-29T18:11:47.690164] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-09-29T18:11:47.935963] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-29T18:11:48.005786] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-09-29T18:11:48.145617] [INFO ] [REMOTE ] CWT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:11:48.179795] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (3.03 seconds). [2025-09-29T18:11:48.348140] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-09-29T18:11:48.495113] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-29T18:11:49.148126] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-09-29T18:11:49.576444] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-29T18:11:49.849960] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-29T18:11:49.948108] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-09-29T18:11:50.306139] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-29T18:11:50.748154] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-09-29T18:11:51.235332] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-29T18:11:51.548175] [INFO ] [REMOTE ] CWT: Fetching primary data for 2024-12. [2025-09-29T18:11:52.350194] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-09-29T18:11:52.366636] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-29T18:11:52.553842] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-29T18:11:53.148144] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-01. [2025-09-29T18:11:53.948170] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-09-29T18:11:54.221521] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-29T18:11:54.328539] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-29T18:11:54.748157] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-09-29T18:11:55.548148] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-09-29T18:11:55.612900] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-29T18:11:56.083175] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-29T18:11:56.348125] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-09-29T18:11:57.148151] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-09-29T18:11:57.366072] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-29T18:11:57.410425] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-29T18:11:57.948131] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-09-29T18:11:58.672710] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-29T18:11:58.682638] [INFO ] [REMOTE ] CWEN: Full fetch complete (64478 records). [2025-09-29T18:11:58.682824] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-09-29T18:11:58.753374] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-09-29T18:11:59.129372] [DEBUG] [VALIDATOR ] CWEN: All expected trading days are present. [2025-09-29T18:11:59.129547] [DEBUG] [VALIDATOR ] CWEN: Primary data validation passed. [2025-09-29T18:11:59.130863] [INFO ] [MAIN ] CWEN: Fetched primary data is valid. [2025-09-29T18:11:59.130950] [DEBUG] [LOCAL ] CWEN: Saving primary data. [2025-09-29T18:11:59.135919] [DEBUG] [LOCAL ] CWEN: Trimmed 64478 records to 44991 (keeping 200 days of data) [2025-09-29T18:11:59.425720] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-29T18:11:59.481852] [DEBUG] [LOCAL ] CWEN: Primary data saved (44991 records). [2025-09-29T18:11:59.482000] [INFO ] [MAIN ] CWEN: Full history saved. [2025-09-29T18:11:59.482155] [INFO ] [MAIN ] Update Progress: 572/2371 symbols completed. CWEN took 32.6s. Estimated remaining: 3h 46m 16s. Rate: 8.0 symbols/min [2025-09-29T18:11:59.556006] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-09-29T18:11:59.684147] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:11:59.738002] [DEBUG] [LOCAL ] CX: Loaded 53603 existing records from primary storage. [2025-09-29T18:11:59.738409] [INFO ] [MAIN ] CX: Loaded 53603 existing records. [2025-09-29T18:11:59.935772] [WARN ] [MAIN ] CX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:11:59.936024] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-09-29T18:11:59.936082] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-09-29T18:11:59.936605] [DEBUG] [LOCAL ] CX: Deleted primary data file. [2025-09-29T18:11:59.936699] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-09-29T18:12:00.319858] [INFO ] [REMOTE ] CX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:12:00.348142] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-09-29T18:12:00.720566] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-29T18:12:00.974406] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-29T18:12:01.148094] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-09-29T18:12:01.948154] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-09-29T18:12:02.308047] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-29T18:12:02.320945] [INFO ] [REMOTE ] CWH: Full fetch complete (72871 records). [2025-09-29T18:12:02.321100] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-09-29T18:12:02.736994] [DEBUG] [VALIDATOR ] CWH: All expected trading days are present. [2025-09-29T18:12:02.737110] [DEBUG] [VALIDATOR ] CWH: Primary data validation passed. [2025-09-29T18:12:02.738236] [INFO ] [MAIN ] CWH: Fetched primary data is valid. [2025-09-29T18:12:02.738406] [DEBUG] [LOCAL ] CWH: Saving primary data. [2025-09-29T18:12:02.740854] [DEBUG] [LOCAL ] CWH: Trimmed 72871 records to 51377 (keeping 200 days of data) [2025-09-29T18:12:02.748098] [INFO ] [REMOTE ] CX: Fetching primary data for 2024-12. [2025-09-29T18:12:02.894064] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-29T18:12:02.914758] [INFO ] [REMOTE ] CWK: Full fetch complete (70938 records). [2025-09-29T18:12:02.918737] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-09-29T18:12:03.469101] [DEBUG] [VALIDATOR ] CWK: All expected trading days are present. [2025-09-29T18:12:03.475077] [DEBUG] [VALIDATOR ] CWK: Primary data validation passed. [2025-09-29T18:12:03.476833] [INFO ] [MAIN ] CWK: Fetched primary data is valid. [2025-09-29T18:12:03.477290] [DEBUG] [LOCAL ] CWK: Saving primary data. [2025-09-29T18:12:03.505263] [DEBUG] [LOCAL ] CWK: Trimmed 70938 records to 49419 (keeping 200 days of data) [2025-09-29T18:12:03.507572] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-29T18:12:03.549958] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-09-29T18:12:03.758445] [DEBUG] [LOCAL ] CWH: Primary data saved (51377 records). [2025-09-29T18:12:03.767849] [INFO ] [MAIN ] CWH: Full history saved. [2025-09-29T18:12:03.768346] [INFO ] [MAIN ] Update Progress: 573/2371 symbols completed. CWH took 35.0s. Estimated remaining: 3h 45m 58s. Rate: 8.0 symbols/min [2025-09-29T18:12:04.008275] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:12:04.070115] [DEBUG] [LOCAL ] CXE: Loaded 7247 existing records from primary storage. [2025-09-29T18:12:04.073071] [INFO ] [MAIN ] CXE: Loaded 7247 existing records. [2025-09-29T18:12:04.228904] [DEBUG] [LOCAL ] CWK: Primary data saved (49419 records). [2025-09-29T18:12:04.229093] [INFO ] [MAIN ] CWK: Full history saved. [2025-09-29T18:12:04.229210] [INFO ] [MAIN ] Update Progress: 574/2371 symbols completed. CWK took 30.2s. Estimated remaining: 3h 45m 29s. Rate: 8.0 symbols/min [2025-09-29T18:12:04.338952] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:12:04.351983] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-09-29T18:12:04.374184] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-09-29T18:12:04.404405] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-09-29T18:12:04.404740] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-09-29T18:12:04.613831] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:12:04.724096] [DEBUG] [LOCAL ] CXH: Loaded 4436 existing records from primary storage. [2025-09-29T18:12:04.738713] [INFO ] [MAIN ] CXH: Loaded 4436 existing records. [2025-09-29T18:12:05.039271] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-09-29T18:12:05.183484] [INFO ] [REMOTE ] CXE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:12:05.190463] [WARN ] [MAIN ] CXH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:12:05.153384] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-01. [2025-09-29T18:12:05.191887] [INFO ] [REMOTE ] CXE: Fetching primary data for 2024-12. [2025-09-29T18:12:05.192298] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-09-29T18:12:05.193225] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-09-29T18:12:05.194664] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-29T18:12:05.194768] [DEBUG] [LOCAL ] CXH: Deleted primary data file. [2025-09-29T18:12:05.200770] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-09-29T18:12:05.582416] [INFO ] [REMOTE ] CXH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:12:05.948097] [INFO ] [REMOTE ] CXH: Fetching primary data for 2024-12. [2025-09-29T18:12:06.282309] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-29T18:12:06.633341] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-29T18:12:06.748118] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-01. [2025-09-29T18:12:07.052432] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-29T18:12:07.548151] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-09-29T18:12:07.574904] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-29T18:12:08.348151] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-09-29T18:12:09.056350] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-29T18:12:09.143809] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-29T18:12:09.148054] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-09-29T18:12:09.948107] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-01. [2025-09-29T18:12:09.973227] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-29T18:12:10.426887] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-29T18:12:10.748119] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-09-29T18:12:11.548137] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-09-29T18:12:12.128105] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-29T18:12:12.348153] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-09-29T18:12:12.837615] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-29T18:12:13.148127] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-09-29T18:12:13.568005] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-29T18:12:13.673273] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-29T18:12:13.948146] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-09-29T18:12:14.631360] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-29T18:12:14.748126] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-09-29T18:12:15.327602] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-29T18:12:15.548158] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-09-29T18:12:16.139212] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-29T18:12:16.348120] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-09-29T18:12:17.011145] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-29T18:12:17.148126] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-09-29T18:12:17.840095] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-29T18:12:17.948144] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-09-29T18:12:18.730226] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-29T18:12:18.748159] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-09-29T18:12:19.330098] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-29T18:12:19.548136] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-09-29T18:12:20.215975] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-29T18:12:20.348147] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-09-29T18:12:20.960950] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-29T18:12:21.148130] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-09-29T18:12:21.948091] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-09-29T18:12:22.006074] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-29T18:12:22.008502] [INFO ] [REMOTE ] CXE: Full fetch complete (11848 records). [2025-09-29T18:12:22.008586] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-09-29T18:12:22.399797] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-09-29T18:12:22.399891] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-09-29T18:12:22.400273] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-09-29T18:12:22.400347] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-09-29T18:12:22.401056] [DEBUG] [LOCAL ] CXE: Trimmed 11848 records to 6813 (keeping 200 days of data) [2025-09-29T18:12:22.445627] [DEBUG] [LOCAL ] CXE: Primary data saved (6813 records). [2025-09-29T18:12:22.445813] [INFO ] [MAIN ] CXE: Full history saved. [2025-09-29T18:12:22.445913] [INFO ] [MAIN ] Update Progress: 575/2371 symbols completed. CXE took 18.7s. Estimated remaining: 3h 45m 54s. Rate: 8.0 symbols/min [2025-09-29T18:12:22.629629] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:12:22.689282] [DEBUG] [LOCAL ] CXM: Loaded 48607 existing records from primary storage. [2025-09-29T18:12:22.690052] [INFO ] [MAIN ] CXM: Loaded 48607 existing records. [2025-09-29T18:12:22.753363] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-09-29T18:12:22.874325] [WARN ] [MAIN ] CXM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:12:22.874673] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-09-29T18:12:22.874744] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-09-29T18:12:22.875200] [DEBUG] [LOCAL ] CXM: Deleted primary data file. [2025-09-29T18:12:22.875262] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-09-29T18:12:23.256279] [INFO ] [REMOTE ] CXM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:12:23.324406] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-29T18:12:23.330505] [INFO ] [REMOTE ] CWT: Full fetch complete (40322 records). [2025-09-29T18:12:23.330614] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-09-29T18:12:23.553324] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-09-29T18:12:23.744891] [DEBUG] [VALIDATOR ] CWT: All expected trading days are present. [2025-09-29T18:12:23.745001] [DEBUG] [VALIDATOR ] CWT: Primary data validation passed. [2025-09-29T18:12:23.745778] [INFO ] [MAIN ] CWT: Fetched primary data is valid. [2025-09-29T18:12:23.745844] [DEBUG] [LOCAL ] CWT: Saving primary data. [2025-09-29T18:12:23.747060] [DEBUG] [LOCAL ] CWT: Trimmed 40322 records to 27821 (keeping 200 days of data) [2025-09-29T18:12:23.920478] [DEBUG] [LOCAL ] CWT: Primary data saved (27821 records). [2025-09-29T18:12:23.920632] [INFO ] [MAIN ] CWT: Full history saved. [2025-09-29T18:12:23.920759] [INFO ] [MAIN ] Update Progress: 576/2371 symbols completed. CWT took 36.6s. Estimated remaining: 3h 45m 28s. Rate: 8.0 symbols/min [2025-09-29T18:12:24.110318] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:12:24.143512] [DEBUG] [LOCAL ] CXT: Loaded 31611 existing records from primary storage. [2025-09-29T18:12:24.143846] [INFO ] [MAIN ] CXT: Loaded 31611 existing records. [2025-09-29T18:12:24.256725] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-29T18:12:24.343804] [WARN ] [MAIN ] CXT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:12:24.344043] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-09-29T18:12:24.344092] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-09-29T18:12:24.344380] [DEBUG] [LOCAL ] CXT: Deleted primary data file. [2025-09-29T18:12:24.344487] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-09-29T18:12:24.356099] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-09-29T18:12:24.744456] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:12:24.795737] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-29T18:12:25.148099] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-09-29T18:12:25.287966] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-29T18:12:25.289750] [INFO ] [REMOTE ] CXH: Full fetch complete (5479 records). [2025-09-29T18:12:25.289857] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-09-29T18:12:25.661148] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present. [2025-09-29T18:12:25.661349] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed. [2025-09-29T18:12:25.661788] [INFO ] [MAIN ] CXH: Fetched primary data is valid. [2025-09-29T18:12:25.661876] [DEBUG] [LOCAL ] CXH: Saving primary data. [2025-09-29T18:12:25.662438] [DEBUG] [LOCAL ] CXH: Trimmed 5479 records to 4413 (keeping 200 days of data) [2025-09-29T18:12:25.694902] [DEBUG] [LOCAL ] CXH: Primary data saved (4413 records). [2025-09-29T18:12:25.695082] [INFO ] [MAIN ] CXH: Full history saved. [2025-09-29T18:12:25.695193] [INFO ] [MAIN ] Update Progress: 577/2371 symbols completed. CXH took 21.5s. Estimated remaining: 3h 45m 2s. Rate: 8.0 symbols/min [2025-09-29T18:12:25.881579] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:12:25.938857] [DEBUG] [LOCAL ] CXW: Loaded 44899 existing records from primary storage. [2025-09-29T18:12:25.939339] [INFO ] [MAIN ] CXW: Loaded 44899 existing records. [2025-09-29T18:12:25.953584] [INFO ] [REMOTE ] CXM: Fetching primary data for 2024-12. [2025-09-29T18:12:26.172143] [WARN ] [MAIN ] CXW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:12:26.172534] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-09-29T18:12:26.172623] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-09-29T18:12:26.173165] [DEBUG] [LOCAL ] CXW: Deleted primary data file. [2025-09-29T18:12:26.173230] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-09-29T18:12:26.602828] [INFO ] [REMOTE ] CXW: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:12:26.748161] [INFO ] [REMOTE ] CXT: Fetching primary data for 2024-12. [2025-09-29T18:12:26.924235] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-29T18:12:27.369518] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-29T18:12:27.548184] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-01. [2025-09-29T18:12:28.117888] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-29T18:12:28.348163] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-09-29T18:12:29.113043] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-29T18:12:29.148068] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-09-29T18:12:29.485758] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-29T18:12:29.948176] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-09-29T18:12:30.376519] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-29T18:12:30.748220] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-09-29T18:12:31.555748] [INFO ] [REMOTE ] CXW: Fetching primary data for 2024-12. [2025-09-29T18:12:31.586206] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-29T18:12:32.348197] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-09-29T18:12:32.422502] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-29T18:12:32.995404] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-29T18:12:33.148171] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-01. [2025-09-29T18:12:33.889924] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-29T18:12:33.948079] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-09-29T18:12:34.418084] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-29T18:12:34.748168] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-09-29T18:12:35.548153] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-09-29T18:12:36.028882] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-29T18:12:36.348098] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-09-29T18:12:36.393704] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-29T18:12:36.523563] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-29T18:12:37.148123] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-09-29T18:12:37.948202] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-09-29T18:12:38.226784] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-29T18:12:38.238489] [INFO ] [REMOTE ] CX: Full fetch complete (76384 records). [2025-09-29T18:12:38.238785] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-09-29T18:12:38.651216] [DEBUG] [VALIDATOR ] CX: All expected trading days are present. [2025-09-29T18:12:38.651457] [DEBUG] [VALIDATOR ] CX: Primary data validation passed. [2025-09-29T18:12:38.652765] [INFO ] [MAIN ] CX: Fetched primary data is valid. [2025-09-29T18:12:38.652926] [DEBUG] [LOCAL ] CX: Saving primary data. [2025-09-29T18:12:38.679690] [DEBUG] [LOCAL ] CX: Trimmed 76384 records to 52822 (keeping 200 days of data) [2025-09-29T18:12:38.681026] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-29T18:12:38.756879] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-09-29T18:12:39.040691] [DEBUG] [LOCAL ] CX: Primary data saved (52822 records). [2025-09-29T18:12:39.040916] [INFO ] [MAIN ] CX: Full history saved. [2025-09-29T18:12:39.041042] [INFO ] [MAIN ] Update Progress: 578/2371 symbols completed. CX took 39.6s. Estimated remaining: 3h 45m 13s. Rate: 8.0 symbols/min [2025-09-29T18:12:39.224765] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:12:39.263710] [DEBUG] [LOCAL ] CYD: Loaded 27145 existing records from primary storage. [2025-09-29T18:12:39.264097] [INFO ] [MAIN ] CYD: Loaded 27145 existing records. [2025-09-29T18:12:39.453213] [WARN ] [MAIN ] CYD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:12:39.453897] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-09-29T18:12:39.454119] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-09-29T18:12:39.466675] [DEBUG] [LOCAL ] CYD: Deleted primary data file. [2025-09-29T18:12:39.485183] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-09-29T18:12:39.562931] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-29T18:12:39.554530] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-09-29T18:12:39.919003] [INFO ] [REMOTE ] CYD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:12:40.265507] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-29T18:12:40.348148] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-09-29T18:12:41.148093] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-09-29T18:12:41.304935] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-29T18:12:41.492151] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-29T18:12:41.948116] [INFO ] [REMOTE ] CYD: Fetching primary data for 2024-12. [2025-09-29T18:12:42.619858] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-29T18:12:42.620548] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-29T18:12:42.748106] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-01. [2025-09-29T18:12:43.350738] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-29T18:12:43.548176] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-09-29T18:12:44.348190] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-09-29T18:12:44.886250] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-29T18:12:45.148119] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-09-29T18:12:45.948109] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-09-29T18:12:45.996437] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-29T18:12:46.474474] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-29T18:12:46.748115] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-09-29T18:12:47.548092] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-09-29T18:12:47.626897] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-29T18:12:47.712784] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-29T18:12:48.348118] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-09-29T18:12:49.097226] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-29T18:12:49.148075] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-09-29T18:12:49.821781] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-29T18:12:49.948122] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-09-29T18:12:50.756759] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-09-29T18:12:50.777330] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-29T18:12:51.221014] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-29T18:12:51.548141] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-09-29T18:12:52.161209] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-29T18:12:52.348204] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-09-29T18:12:52.860092] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-29T18:12:53.148121] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-09-29T18:12:53.828244] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-29T18:12:53.835465] [INFO ] [REMOTE ] CXT: Full fetch complete (45291 records). [2025-09-29T18:12:53.835615] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-09-29T18:12:53.948957] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-09-29T18:12:54.250392] [DEBUG] [VALIDATOR ] CXT: All expected trading days are present. [2025-09-29T18:12:54.250486] [DEBUG] [VALIDATOR ] CXT: Primary data validation passed. [2025-09-29T18:12:54.251364] [INFO ] [MAIN ] CXT: Fetched primary data is valid. [2025-09-29T18:12:54.251446] [DEBUG] [LOCAL ] CXT: Saving primary data. [2025-09-29T18:12:54.252689] [DEBUG] [LOCAL ] CXT: Trimmed 45291 records to 31002 (keeping 200 days of data) [2025-09-29T18:12:54.457287] [DEBUG] [LOCAL ] CXT: Primary data saved (31002 records). [2025-09-29T18:12:54.457486] [INFO ] [MAIN ] CXT: Full history saved. [2025-09-29T18:12:54.457629] [INFO ] [MAIN ] Update Progress: 579/2371 symbols completed. CXT took 30.5s. Estimated remaining: 3h 45m 30s. Rate: 7.9 symbols/min [2025-09-29T18:12:54.687024] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:12:54.742471] [DEBUG] [LOCAL ] CYH: Loaded 48352 existing records from primary storage. [2025-09-29T18:12:54.742838] [INFO ] [MAIN ] CYH: Loaded 48352 existing records. [2025-09-29T18:12:54.754502] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-09-29T18:12:54.925027] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-29T18:12:54.997091] [INFO ] [REMOTE ] CXM: Full fetch complete (68891 records). [2025-09-29T18:12:55.001679] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-09-29T18:12:55.001400] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:12:55.002164] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-09-29T18:12:55.002238] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-09-29T18:12:55.002742] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-09-29T18:12:55.008118] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-09-29T18:12:55.869114] [INFO ] [REMOTE ] CYH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:12:55.903882] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-09-29T18:12:55.903685] [INFO ] [REMOTE ] CYH: Fetching primary data for 2024-12. [2025-09-29T18:12:55.904376] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-09-29T18:12:55.912121] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-09-29T18:12:55.917811] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-09-29T18:12:55.922175] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-29T18:12:55.944819] [DEBUG] [LOCAL ] CXM: Trimmed 68891 records to 47791 (keeping 200 days of data) [2025-09-29T18:12:55.956846] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-29T18:12:56.252946] [DEBUG] [LOCAL ] CXM: Primary data saved (47791 records). [2025-09-29T18:12:56.253099] [INFO ] [MAIN ] CXM: Full history saved. [2025-09-29T18:12:56.253190] [INFO ] [MAIN ] Update Progress: 580/2371 symbols completed. CXM took 33.8s. Estimated remaining: 3h 45m 5s. Rate: 8.0 symbols/min [2025-09-29T18:12:56.354888] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-09-29T18:12:56.440138] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:12:56.499782] [DEBUG] [LOCAL ] D: Loaded 54426 existing records from primary storage. [2025-09-29T18:12:56.500187] [INFO ] [MAIN ] D: Loaded 54426 existing records. [2025-09-29T18:12:56.683436] [WARN ] [MAIN ] D: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:12:56.683684] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-09-29T18:12:56.683828] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-09-29T18:12:56.684254] [DEBUG] [LOCAL ] D: Deleted primary data file. [2025-09-29T18:12:56.684315] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-09-29T18:12:57.050951] [INFO ] [REMOTE ] D: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:12:57.148082] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-09-29T18:12:57.556128] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-29T18:12:57.748361] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-29T18:12:57.948120] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-09-29T18:12:58.748172] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-01. [2025-09-29T18:12:58.880787] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-29T18:12:59.073494] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-29T18:12:59.548137] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-09-29T18:13:00.348121] [INFO ] [REMOTE ] D: Fetching primary data for 2024-12. [2025-09-29T18:13:00.427740] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-29T18:13:00.822737] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-29T18:13:01.148107] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-09-29T18:13:01.948106] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-09-29T18:13:02.364409] [INFO ] [REMOTE ] D: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-29T18:13:02.721910] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-29T18:13:02.728726] [INFO ] [REMOTE ] CYD: Full fetch complete (32891 records). [2025-09-29T18:13:02.728898] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-09-29T18:13:02.753263] [INFO ] [REMOTE ] D: Fetching primary data for 2025-01. [2025-09-29T18:13:03.121791] [DEBUG] [VALIDATOR ] CYD: All expected trading days are present. [2025-09-29T18:13:03.121946] [DEBUG] [VALIDATOR ] CYD: Primary data validation passed. [2025-09-29T18:13:03.122827] [INFO ] [MAIN ] CYD: Fetched primary data is valid. [2025-09-29T18:13:03.122990] [DEBUG] [LOCAL ] CYD: Saving primary data. [2025-09-29T18:13:03.124348] [DEBUG] [LOCAL ] CYD: Trimmed 32891 records to 26601 (keeping 200 days of data) [2025-09-29T18:13:03.315478] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-29T18:13:03.341079] [DEBUG] [LOCAL ] CYD: Primary data saved (26601 records). [2025-09-29T18:13:03.341292] [INFO ] [MAIN ] CYD: Full history saved. [2025-09-29T18:13:03.341417] [INFO ] [MAIN ] Update Progress: 581/2371 symbols completed. CYD took 24.3s. Estimated remaining: 3h 44m 56s. Rate: 8.0 symbols/min [2025-09-29T18:13:03.520122] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:13:03.536694] [DEBUG] [LOCAL ] DAC: Loaded 12769 existing records from primary storage. [2025-09-29T18:13:03.537107] [INFO ] [MAIN ] DAC: Loaded 12769 existing records. [2025-09-29T18:13:03.558390] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-09-29T18:13:03.728751] [WARN ] [MAIN ] DAC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:13:03.729020] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-09-29T18:13:03.729082] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-09-29T18:13:03.729327] [DEBUG] [LOCAL ] DAC: Deleted primary data file. [2025-09-29T18:13:03.729387] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-09-29T18:13:04.102265] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:13:04.348159] [INFO ] [REMOTE ] DAC: Fetching primary data for 2024-12. [2025-09-29T18:13:04.455550] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-29T18:13:05.148134] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-09-29T18:13:05.376051] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-29T18:13:05.437182] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-29T18:13:05.948135] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-09-29T18:13:06.748122] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-09-29T18:13:06.976334] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-29T18:13:07.548158] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-09-29T18:13:07.608342] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-29T18:13:07.727222] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-29T18:13:08.348139] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-09-29T18:13:09.148114] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-09-29T18:13:09.568682] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-29T18:13:09.948126] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-09-29T18:13:10.165769] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-29T18:13:10.748115] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-09-29T18:13:10.981558] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-29T18:13:10.990853] [INFO ] [REMOTE ] CXW: Full fetch complete (64995 records). [2025-09-29T18:13:10.991019] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-09-29T18:13:11.386129] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-09-29T18:13:11.386215] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-09-29T18:13:11.387160] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-09-29T18:13:11.387227] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-09-29T18:13:11.388672] [DEBUG] [LOCAL ] CXW: Trimmed 64995 records to 44141 (keeping 200 days of data) [2025-09-29T18:13:11.561145] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-09-29T18:13:11.661061] [DEBUG] [LOCAL ] CXW: Primary data saved (44141 records). [2025-09-29T18:13:11.661205] [INFO ] [MAIN ] CXW: Full history saved. [2025-09-29T18:13:11.661312] [INFO ] [MAIN ] Update Progress: 582/2371 symbols completed. CXW took 46.0s. Estimated remaining: 3h 44m 50s. Rate: 8.0 symbols/min [2025-09-29T18:13:11.861476] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:13:11.921876] [DEBUG] [LOCAL ] DAL: Loaded 54533 existing records from primary storage. [2025-09-29T18:13:11.922278] [INFO ] [MAIN ] DAL: Loaded 54533 existing records. [2025-09-29T18:13:12.114366] [WARN ] [MAIN ] DAL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:13:12.114865] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-09-29T18:13:12.114945] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-09-29T18:13:12.115939] [DEBUG] [LOCAL ] DAL: Deleted primary data file. [2025-09-29T18:13:12.128052] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-09-29T18:13:12.217069] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-29T18:13:12.349169] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-09-29T18:13:12.364556] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-29T18:13:12.614729] [INFO ] [REMOTE ] DAL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:13:12.626377] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-29T18:13:13.148133] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-09-29T18:13:13.948099] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-09-29T18:13:14.043219] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-29T18:13:14.235538] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-29T18:13:14.748106] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-09-29T18:13:15.211773] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-29T18:13:15.548100] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-09-29T18:13:15.955130] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-29T18:13:16.348103] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-09-29T18:13:17.148085] [INFO ] [REMOTE ] DAL: Fetching primary data for 2024-12. [2025-09-29T18:13:17.281160] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-29T18:13:17.333038] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-29T18:13:17.948112] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-09-29T18:13:18.748140] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-09-29T18:13:18.946389] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-29T18:13:19.548154] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-01. [2025-09-29T18:13:19.811183] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-29T18:13:20.104445] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-29T18:13:20.348140] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-09-29T18:13:21.148084] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-09-29T18:13:21.351796] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-29T18:13:21.737730] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-09-29T18:13:21.948127] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-09-29T18:13:22.612000] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-29T18:13:22.621566] [INFO ] [REMOTE ] CYH: Full fetch complete (70128 records). [2025-09-29T18:13:22.621763] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-09-29T18:13:22.753217] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-09-29T18:13:23.053208] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-09-29T18:13:23.053323] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-09-29T18:13:23.054204] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-09-29T18:13:23.054286] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-09-29T18:13:23.055762] [DEBUG] [LOCAL ] CYH: Trimmed 70128 records to 47561 (keeping 200 days of data) [2025-09-29T18:13:23.328980] [DEBUG] [LOCAL ] CYH: Primary data saved (47561 records). [2025-09-29T18:13:23.329121] [INFO ] [MAIN ] CYH: Full history saved. [2025-09-29T18:13:23.329228] [INFO ] [MAIN ] Update Progress: 583/2371 symbols completed. CYH took 28.9s. Estimated remaining: 3h 44m 56s. Rate: 7.9 symbols/min [2025-09-29T18:13:23.504318] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:13:23.555190] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-09-29T18:13:23.559677] [DEBUG] [LOCAL ] DAN: Loaded 49753 existing records from primary storage. [2025-09-29T18:13:23.560230] [INFO ] [MAIN ] DAN: Loaded 49753 existing records. [2025-09-29T18:13:23.761573] [WARN ] [MAIN ] DAN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:13:23.762277] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-09-29T18:13:23.762563] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-09-29T18:13:23.771268] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-29T18:13:23.771450] [DEBUG] [LOCAL ] DAN: Deleted primary data file. [2025-09-29T18:13:23.774963] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-09-29T18:13:24.149488] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-09-29T18:13:24.199771] [INFO ] [REMOTE ] DAN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:13:24.348107] [INFO ] [REMOTE ] DAN: Fetching primary data for 2024-12. [2025-09-29T18:13:25.148148] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-09-29T18:13:25.662997] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-29T18:13:25.708484] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-29T18:13:25.948105] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-09-29T18:13:26.189267] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-29T18:13:26.748146] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-09-29T18:13:27.548162] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-01. [2025-09-29T18:13:27.684788] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-29T18:13:28.348157] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-09-29T18:13:28.960563] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-29T18:13:29.148099] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-09-29T18:13:29.222618] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-29T18:13:29.948122] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-09-29T18:13:30.350003] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-29T18:13:30.361358] [INFO ] [REMOTE ] D: Full fetch complete (77656 records). [2025-09-29T18:13:30.361551] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-09-29T18:13:30.750914] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-09-29T18:13:30.750837] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-29T18:13:30.811382] [DEBUG] [VALIDATOR ] D: All expected trading days are present. [2025-09-29T18:13:30.811547] [DEBUG] [VALIDATOR ] D: Primary data validation passed. [2025-09-29T18:13:30.812990] [INFO ] [MAIN ] D: Fetched primary data is valid. [2025-09-29T18:13:30.813294] [DEBUG] [LOCAL ] D: Saving primary data. [2025-09-29T18:13:30.810101] [INFO ] [REMOTE ] DAC: Full fetch complete (19571 records). [2025-09-29T18:13:30.813772] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-09-29T18:13:30.925260] [DEBUG] [LOCAL ] D: Trimmed 77656 records to 53646 (keeping 200 days of data) [2025-09-29T18:13:31.465517] [DEBUG] [VALIDATOR ] DAC: All expected trading days are present. [2025-09-29T18:13:31.468685] [DEBUG] [VALIDATOR ] DAC: Primary data validation passed. [2025-09-29T18:13:31.471210] [INFO ] [MAIN ] DAC: Fetched primary data is valid. [2025-09-29T18:13:31.471399] [DEBUG] [LOCAL ] DAC: Saving primary data. [2025-09-29T18:13:31.483585] [DEBUG] [LOCAL ] DAC: Trimmed 19571 records to 12571 (keeping 200 days of data) [2025-09-29T18:13:31.604122] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-09-29T18:13:31.687296] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-09-29T18:13:31.701888] [DEBUG] [LOCAL ] DAC: Primary data saved (12571 records). [2025-09-29T18:13:31.705993] [INFO ] [MAIN ] DAC: Full history saved. [2025-09-29T18:13:31.707285] [INFO ] [MAIN ] Update Progress: 584/2371 symbols completed. DAC took 28.4s. Estimated remaining: 3h 44m 51s. Rate: 7.9 symbols/min [2025-09-29T18:13:31.883395] [DEBUG] [LOCAL ] D: Primary data saved (53646 records). [2025-09-29T18:13:31.891783] [INFO ] [MAIN ] D: Full history saved. [2025-09-29T18:13:31.891914] [INFO ] [MAIN ] Update Progress: 585/2371 symbols completed. D took 35.6s. Estimated remaining: 3h 44m 21s. Rate: 8.0 symbols/min [2025-09-29T18:13:31.925761] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:13:32.108982] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:13:32.117484] [DEBUG] [LOCAL ] DAO: Loaded 21546 existing records from primary storage. [2025-09-29T18:13:32.118182] [INFO ] [MAIN ] DAO: Loaded 21546 existing records. [2025-09-29T18:13:32.317350] [WARN ] [MAIN ] DAO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:13:32.318249] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-09-29T18:13:32.318326] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-09-29T18:13:32.318750] [DEBUG] [LOCAL ] DAO: Deleted primary data file. [2025-09-29T18:13:32.318831] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-09-29T18:13:32.515450] [DEBUG] [LOCAL ] DAR: Loaded 52603 existing records from primary storage. [2025-09-29T18:13:32.531861] [INFO ] [MAIN ] DAR: Loaded 52603 existing records. [2025-09-29T18:13:32.881459] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-29T18:13:32.937093] [INFO ] [REMOTE ] DAO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:13:32.974284] [INFO ] [REMOTE ] DAO: Fetching primary data for 2024-12. [2025-09-29T18:13:33.015055] [WARN ] [MAIN ] DAR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:13:33.016736] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-09-29T18:13:33.016831] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-09-29T18:13:33.017350] [DEBUG] [LOCAL ] DAR: Deleted primary data file. [2025-09-29T18:13:33.017512] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-09-29T18:13:33.153266] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-09-29T18:13:33.407193] [INFO ] [REMOTE ] DAR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:13:33.948093] [INFO ] [REMOTE ] DAR: Fetching primary data for 2024-12. [2025-09-29T18:13:34.116215] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-09-29T18:13:34.334289] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-29T18:13:34.748112] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-09-29T18:13:35.199825] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-29T18:13:35.548131] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-01. [2025-09-29T18:13:35.920296] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-29T18:13:36.348162] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-01. [2025-09-29T18:13:36.589168] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-29T18:13:36.738260] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-29T18:13:37.148211] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-09-29T18:13:37.954729] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-09-29T18:13:37.977337] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-29T18:13:38.563183] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-29T18:13:38.748134] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-09-29T18:13:39.548133] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-09-29T18:13:40.222172] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-09-29T18:13:40.348157] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-09-29T18:13:40.521144] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-29T18:13:41.148091] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-09-29T18:13:41.320485] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-29T18:13:41.489447] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-29T18:13:41.948125] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-09-29T18:13:42.676816] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-29T18:13:42.748100] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-09-29T18:13:43.548088] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-09-29T18:13:43.682424] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-29T18:13:44.097164] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-29T18:13:44.348154] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-09-29T18:13:44.901379] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-29T18:13:45.148111] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-09-29T18:13:45.948070] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-09-29T18:13:46.194691] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-29T18:13:46.439260] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-29T18:13:46.748196] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-09-29T18:13:47.548191] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-09-29T18:13:48.259107] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-29T18:13:48.348079] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-09-29T18:13:48.471592] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-29T18:13:49.148139] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-09-29T18:13:49.298831] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-29T18:13:49.948120] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-09-29T18:13:50.599715] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-29T18:13:50.611447] [INFO ] [REMOTE ] DAL: Full fetch complete (77823 records). [2025-09-29T18:13:50.611599] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-09-29T18:13:50.751588] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-09-29T18:13:50.972833] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-29T18:13:51.080458] [DEBUG] [VALIDATOR ] DAL: All expected trading days are present. [2025-09-29T18:13:51.080551] [DEBUG] [VALIDATOR ] DAL: Primary data validation passed. [2025-09-29T18:13:51.081486] [INFO ] [MAIN ] DAL: Fetched primary data is valid. [2025-09-29T18:13:51.081552] [DEBUG] [LOCAL ] DAL: Saving primary data. [2025-09-29T18:13:51.083049] [DEBUG] [LOCAL ] DAL: Trimmed 77823 records to 53753 (keeping 200 days of data) [2025-09-29T18:13:51.433704] [DEBUG] [LOCAL ] DAL: Primary data saved (53753 records). [2025-09-29T18:13:51.433883] [INFO ] [MAIN ] DAL: Full history saved. [2025-09-29T18:13:51.434059] [INFO ] [MAIN ] Update Progress: 586/2371 symbols completed. DAL took 39.8s. Estimated remaining: 3h 44m 50s. Rate: 7.9 symbols/min [2025-09-29T18:13:51.567336] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-09-29T18:13:51.659384] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:13:51.691442] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-29T18:13:51.737962] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-29T18:13:51.753915] [DEBUG] [LOCAL ] DAVA: Loaded 41308 existing records from primary storage. [2025-09-29T18:13:51.754533] [INFO ] [MAIN ] DAVA: Loaded 41308 existing records. [2025-09-29T18:13:51.941270] [WARN ] [MAIN ] DAVA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:13:51.941558] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-09-29T18:13:51.941611] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-09-29T18:13:51.942278] [DEBUG] [LOCAL ] DAVA: Deleted primary data file. [2025-09-29T18:13:51.942340] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-09-29T18:13:52.324591] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:13:52.348079] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2024-12. [2025-09-29T18:13:53.154057] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-09-29T18:13:53.167205] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-29T18:13:53.178234] [INFO ] [REMOTE ] DAN: Full fetch complete (70838 records). [2025-09-29T18:13:53.178454] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-09-29T18:13:53.603059] [DEBUG] [VALIDATOR ] DAN: All expected trading days are present. [2025-09-29T18:13:53.603202] [DEBUG] [VALIDATOR ] DAN: Primary data validation passed. [2025-09-29T18:13:53.604198] [INFO ] [MAIN ] DAN: Fetched primary data is valid. [2025-09-29T18:13:53.604278] [DEBUG] [LOCAL ] DAN: Saving primary data. [2025-09-29T18:13:53.605798] [DEBUG] [LOCAL ] DAN: Trimmed 70838 records to 48995 (keeping 200 days of data) [2025-09-29T18:13:53.852684] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-29T18:13:53.948161] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-01. [2025-09-29T18:13:53.958577] [DEBUG] [LOCAL ] DAN: Primary data saved (48995 records). [2025-09-29T18:13:53.958831] [INFO ] [MAIN ] DAN: Full history saved. [2025-09-29T18:13:53.958932] [INFO ] [MAIN ] Update Progress: 587/2371 symbols completed. DAN took 30.6s. Estimated remaining: 3h 44m 27s. Rate: 7.9 symbols/min [2025-09-29T18:13:54.160298] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:13:54.216719] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-29T18:13:54.237667] [DEBUG] [LOCAL ] DAY: Loaded 50491 existing records from primary storage. [2025-09-29T18:13:54.238105] [INFO ] [MAIN ] DAY: Loaded 50491 existing records. [2025-09-29T18:13:54.432523] [WARN ] [MAIN ] DAY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:13:54.432846] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-09-29T18:13:54.432922] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-09-29T18:13:54.433599] [DEBUG] [LOCAL ] DAY: Deleted primary data file. [2025-09-29T18:13:54.433698] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-09-29T18:13:54.753196] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-09-29T18:13:54.831777] [INFO ] [REMOTE ] DAY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:13:54.963574] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-29T18:13:55.548118] [INFO ] [REMOTE ] DAY: Fetching primary data for 2024-12. [2025-09-29T18:13:56.348138] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-09-29T18:13:56.638272] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-29T18:13:57.148115] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-09-29T18:13:57.217181] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-29T18:13:57.419727] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-29T18:13:57.948077] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-01. [2025-09-29T18:13:58.040169] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-29T18:13:58.748123] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-09-29T18:13:59.434473] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-29T18:13:59.548138] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-09-29T18:13:59.980810] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-29T18:13:59.985754] [INFO ] [REMOTE ] DAO: Full fetch complete (32941 records). [2025-09-29T18:13:59.985873] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-09-29T18:14:00.369016] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-09-29T18:14:00.384434] [DEBUG] [VALIDATOR ] DAO: All expected trading days are present. [2025-09-29T18:14:00.384496] [DEBUG] [VALIDATOR ] DAO: Primary data validation passed. [2025-09-29T18:14:00.385087] [INFO ] [MAIN ] DAO: Fetched primary data is valid. [2025-09-29T18:14:00.385152] [DEBUG] [LOCAL ] DAO: Saving primary data. [2025-09-29T18:14:00.386029] [DEBUG] [LOCAL ] DAO: Trimmed 32941 records to 21017 (keeping 200 days of data) [2025-09-29T18:14:00.511718] [DEBUG] [LOCAL ] DAO: Primary data saved (21017 records). [2025-09-29T18:14:00.511856] [INFO ] [MAIN ] DAO: Full history saved. [2025-09-29T18:14:00.511976] [INFO ] [MAIN ] Update Progress: 588/2371 symbols completed. DAO took 28.8s. Estimated remaining: 3h 44m 16s. Rate: 8.0 symbols/min [2025-09-29T18:14:00.691777] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:14:00.747558] [DEBUG] [LOCAL ] DB: Loaded 53377 existing records from primary storage. [2025-09-29T18:14:00.747948] [INFO ] [MAIN ] DB: Loaded 53377 existing records. [2025-09-29T18:14:00.954342] [WARN ] [MAIN ] DB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:14:00.955036] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-09-29T18:14:00.955261] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-09-29T18:14:00.956390] [DEBUG] [LOCAL ] DB: Deleted primary data file. [2025-09-29T18:14:00.956456] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-09-29T18:14:01.153843] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-09-29T18:14:01.400700] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-29T18:14:01.439525] [INFO ] [REMOTE ] DB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:14:01.948125] [INFO ] [REMOTE ] DB: Fetching primary data for 2024-12. [2025-09-29T18:14:02.121286] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-29T18:14:02.666048] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-29T18:14:02.748137] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-09-29T18:14:03.417320] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-29T18:14:03.548117] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-01. [2025-09-29T18:14:03.885843] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-29T18:14:04.348118] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-09-29T18:14:05.148084] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-09-29T18:14:05.347406] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-29T18:14:05.948116] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-09-29T18:14:06.052236] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-29T18:14:06.748155] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-09-29T18:14:06.983905] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-29T18:14:06.995411] [INFO ] [REMOTE ] DAR: Full fetch complete (74563 records). [2025-09-29T18:14:06.995557] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-09-29T18:14:07.418551] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-09-29T18:14:07.418769] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-09-29T18:14:07.419772] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-09-29T18:14:07.419881] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-09-29T18:14:07.422847] [DEBUG] [LOCAL ] DAR: Trimmed 74563 records to 51851 (keeping 200 days of data) [2025-09-29T18:14:07.554819] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-09-29T18:14:07.777442] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-29T18:14:07.796062] [DEBUG] [LOCAL ] DAR: Primary data saved (51851 records). [2025-09-29T18:14:07.796230] [INFO ] [MAIN ] DAR: Full history saved. [2025-09-29T18:14:07.796370] [INFO ] [MAIN ] Update Progress: 589/2371 symbols completed. DAR took 35.9s. Estimated remaining: 3h 44m 8s. Rate: 8.0 symbols/min [2025-09-29T18:14:07.988485] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:14:08.022847] [DEBUG] [LOCAL ] DBD: Loaded 24109 existing records from primary storage. [2025-09-29T18:14:08.023122] [INFO ] [MAIN ] DBD: Loaded 24109 existing records. [2025-09-29T18:14:08.226402] [WARN ] [MAIN ] DBD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:14:08.226665] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-09-29T18:14:08.226730] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-09-29T18:14:08.227081] [DEBUG] [LOCAL ] DBD: Deleted primary data file. [2025-09-29T18:14:08.227141] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-09-29T18:14:08.349730] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-09-29T18:14:08.620934] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:14:08.664966] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-29T18:14:08.972839] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-29T18:14:09.148114] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-09-29T18:14:09.948138] [INFO ] [REMOTE ] DBD: Fetching primary data for 2024-12. [2025-09-29T18:14:10.204707] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-29T18:14:10.457539] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-29T18:14:10.748115] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-09-29T18:14:11.037894] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-29T18:14:11.548104] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-09-29T18:14:12.240692] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-29T18:14:12.348108] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-09-29T18:14:13.148119] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-09-29T18:14:13.599130] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-29T18:14:13.948120] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-09-29T18:14:14.079228] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-29T18:14:14.748098] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-09-29T18:14:14.835759] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-29T18:14:14.889340] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-29T18:14:15.548137] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-09-29T18:14:16.348146] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-09-29T18:14:16.663609] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-29T18:14:16.799947] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-29T18:14:17.148162] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-09-29T18:14:17.948165] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-09-29T18:14:18.748113] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-09-29T18:14:19.129815] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-29T18:14:19.185499] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (2.84 seconds). [2025-09-29T18:14:19.347921] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-29T18:14:19.358262] [INFO ] [REMOTE ] DAVA: Full fetch complete (55646 records). [2025-09-29T18:14:19.358404] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-09-29T18:14:19.553325] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-09-29T18:14:19.837959] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present. [2025-09-29T18:14:19.837805] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-29T18:14:19.838171] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed. [2025-09-29T18:14:19.844174] [INFO ] [MAIN ] DAVA: Fetched primary data is valid. [2025-09-29T18:14:19.844277] [DEBUG] [LOCAL ] DAVA: Saving primary data. [2025-09-29T18:14:19.845671] [DEBUG] [LOCAL ] DAVA: Trimmed 55646 records to 40816 (keeping 200 days of data) [2025-09-29T18:14:20.103452] [DEBUG] [LOCAL ] DAVA: Primary data saved (40816 records). [2025-09-29T18:14:20.103585] [INFO ] [MAIN ] DAVA: Full history saved. [2025-09-29T18:14:20.103704] [INFO ] [MAIN ] Update Progress: 590/2371 symbols completed. DAVA took 28.7s. Estimated remaining: 3h 44m 15s. Rate: 7.9 symbols/min [2025-09-29T18:14:20.296131] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:14:20.351777] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-09-29T18:14:20.354140] [DEBUG] [LOCAL ] DBI: Loaded 45524 existing records from primary storage. [2025-09-29T18:14:20.354631] [INFO ] [MAIN ] DBI: Loaded 45524 existing records. [2025-09-29T18:14:20.543715] [WARN ] [MAIN ] DBI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:14:20.543948] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-09-29T18:14:20.543995] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-09-29T18:14:20.544455] [DEBUG] [LOCAL ] DBI: Deleted primary data file. [2025-09-29T18:14:20.544514] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-09-29T18:14:20.929199] [INFO ] [REMOTE ] DBI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:14:21.148087] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-09-29T18:14:21.387618] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-29T18:14:21.948135] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-09-29T18:14:22.281917] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-29T18:14:22.328589] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-29T18:14:22.748126] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-09-29T18:14:23.548088] [INFO ] [REMOTE ] DBI: Fetching primary data for 2024-12. [2025-09-29T18:14:23.829097] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-29T18:14:24.032401] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-29T18:14:24.348152] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-09-29T18:14:25.148104] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-09-29T18:14:25.229421] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-29T18:14:25.948109] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-09-29T18:14:26.100330] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-29T18:14:26.153756] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-29T18:14:26.748115] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-09-29T18:14:27.421154] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-29T18:14:27.431762] [INFO ] [REMOTE ] DAY: Full fetch complete (71675 records). [2025-09-29T18:14:27.431929] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-09-29T18:14:27.553308] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-09-29T18:14:27.873285] [DEBUG] [VALIDATOR ] DAY: All expected trading days are present. [2025-09-29T18:14:27.873455] [DEBUG] [VALIDATOR ] DAY: Primary data validation passed. [2025-09-29T18:14:27.874375] [INFO ] [MAIN ] DAY: Fetched primary data is valid. [2025-09-29T18:14:27.874442] [DEBUG] [LOCAL ] DAY: Saving primary data. [2025-09-29T18:14:27.875912] [DEBUG] [LOCAL ] DAY: Trimmed 71675 records to 49690 (keeping 200 days of data) [2025-09-29T18:14:28.189136] [DEBUG] [LOCAL ] DAY: Primary data saved (49690 records). [2025-09-29T18:14:28.189310] [INFO ] [MAIN ] DAY: Full history saved. [2025-09-29T18:14:28.189413] [INFO ] [MAIN ] Update Progress: 591/2371 symbols completed. DAY took 34.2s. Estimated remaining: 3h 44m 9s. Rate: 7.9 symbols/min [2025-09-29T18:14:28.348948] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-09-29T18:14:28.384345] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:14:28.398396] [DEBUG] [LOCAL ] DBL: Loaded 9259 existing records from primary storage. [2025-09-29T18:14:28.398736] [INFO ] [MAIN ] DBL: Loaded 9259 existing records. [2025-09-29T18:14:28.605124] [WARN ] [MAIN ] DBL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:14:28.633046] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-09-29T18:14:28.633634] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-09-29T18:14:28.634864] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-29T18:14:28.645024] [DEBUG] [LOCAL ] DBL: Deleted primary data file. [2025-09-29T18:14:28.645370] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-09-29T18:14:28.983540] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-29T18:14:29.069500] [INFO ] [REMOTE ] DBL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:14:29.148158] [INFO ] [REMOTE ] DBL: Fetching primary data for 2024-12. [2025-09-29T18:14:29.934732] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-29T18:14:29.948074] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-09-29T18:14:30.487573] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-29T18:14:30.503610] [INFO ] [REMOTE ] DB: Full fetch complete (74420 records). [2025-09-29T18:14:30.504347] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-09-29T18:14:30.504559] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-29T18:14:30.753326] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-09-29T18:14:30.928958] [DEBUG] [VALIDATOR ] DB: All expected trading days are present. [2025-09-29T18:14:30.929047] [DEBUG] [VALIDATOR ] DB: Primary data validation passed. [2025-09-29T18:14:30.930137] [INFO ] [MAIN ] DB: Fetched primary data is valid. [2025-09-29T18:14:30.930215] [DEBUG] [LOCAL ] DB: Saving primary data. [2025-09-29T18:14:30.932539] [DEBUG] [LOCAL ] DB: Trimmed 74420 records to 52583 (keeping 200 days of data) [2025-09-29T18:14:31.262216] [DEBUG] [LOCAL ] DB: Primary data saved (52583 records). [2025-09-29T18:14:31.262366] [INFO ] [MAIN ] DB: Full history saved. [2025-09-29T18:14:31.262454] [INFO ] [MAIN ] Update Progress: 592/2371 symbols completed. DB took 30.8s. Estimated remaining: 3h 43m 48s. Rate: 7.9 symbols/min [2025-09-29T18:14:31.442723] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:14:31.495325] [DEBUG] [LOCAL ] DBRG: Loaded 50526 existing records from primary storage. [2025-09-29T18:14:31.495697] [INFO ] [MAIN ] DBRG: Loaded 50526 existing records. [2025-09-29T18:14:31.559306] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-09-29T18:14:31.695504] [WARN ] [MAIN ] DBRG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:14:31.695961] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-09-29T18:14:31.696097] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-09-29T18:14:31.697171] [DEBUG] [LOCAL ] DBRG: Deleted primary data file. [2025-09-29T18:14:31.697255] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-09-29T18:14:32.005969] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-29T18:14:32.098502] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:14:32.348157] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-09-29T18:14:33.141727] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-29T18:14:33.150519] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-09-29T18:14:33.170243] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-29T18:14:33.948078] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-09-29T18:14:34.191062] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-29T18:14:34.197186] [INFO ] [REMOTE ] DBD: Full fetch complete (30699 records). [2025-09-29T18:14:34.197364] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-09-29T18:14:34.198051] [FATAL] [VALIDATOR ] DBD: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:14:34.198176] [FATAL] [MAIN ] DBD: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:14:34.198248] [WARN ] [MAIN ] DBD: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:14:34.198323] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-09-29T18:14:34.198392] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-09-29T18:14:34.198440] [INFO ] [LOCAL ] DBD: Starting deletion of derivative data. [2025-09-29T18:14:34.198885] [DEBUG] [LOCAL ] DBD: Deleted derivative data file. [2025-09-29T18:14:34.199055] [INFO ] [MAIN ] Update Progress: 593/2371 symbols completed. DBD took 26.4s. Estimated remaining: 3h 43m 26s. Rate: 8.0 symbols/min [2025-09-29T18:14:34.387377] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:14:34.436429] [DEBUG] [LOCAL ] DCI: Loaded 38065 existing records from primary storage. [2025-09-29T18:14:34.436808] [INFO ] [MAIN ] DCI: Loaded 38065 existing records. [2025-09-29T18:14:34.648131] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-29T18:14:34.701313] [WARN ] [MAIN ] DCI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:14:34.701556] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-09-29T18:14:34.701606] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-09-29T18:14:34.702076] [DEBUG] [LOCAL ] DCI: Deleted primary data file. [2025-09-29T18:14:34.702138] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-09-29T18:14:34.753435] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-09-29T18:14:35.102972] [INFO ] [REMOTE ] DCI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:14:35.548145] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-09-29T18:14:35.566938] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-29T18:14:36.348137] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-09-29T18:14:37.073789] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-29T18:14:37.148093] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-09-29T18:14:37.400500] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-29T18:14:37.933953] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-29T18:14:37.948087] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-09-29T18:14:38.748144] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-09-29T18:14:38.786425] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-29T18:14:39.548158] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2024-12. [2025-09-29T18:14:40.322214] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-29T18:14:40.348126] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-09-29T18:14:41.154399] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-09-29T18:14:41.181295] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-29T18:14:41.948099] [INFO ] [REMOTE ] DCI: Fetching primary data for 2024-12. [2025-09-29T18:14:42.040983] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-29T18:14:42.051987] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-29T18:14:42.748127] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-09-29T18:14:43.250264] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-29T18:14:43.548144] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-01. [2025-09-29T18:14:44.006674] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-29T18:14:44.348150] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-09-29T18:14:45.106555] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-29T18:14:45.148141] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-01. [2025-09-29T18:14:45.540128] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-29T18:14:45.948151] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-09-29T18:14:46.627379] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-29T18:14:46.748116] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-09-29T18:14:47.548107] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-09-29T18:14:47.627261] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-29T18:14:48.152207] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-29T18:14:48.348198] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-09-29T18:14:49.148084] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-09-29T18:14:49.262843] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-29T18:14:49.264939] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-29T18:14:49.278954] [INFO ] [REMOTE ] DBL: Full fetch complete (12548 records). [2025-09-29T18:14:49.279128] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-09-29T18:14:49.678745] [DEBUG] [VALIDATOR ] DBL: All expected trading days are present. [2025-09-29T18:14:49.678901] [DEBUG] [VALIDATOR ] DBL: Primary data validation passed. [2025-09-29T18:14:49.680211] [INFO ] [MAIN ] DBL: Fetched primary data is valid. [2025-09-29T18:14:49.680290] [DEBUG] [LOCAL ] DBL: Saving primary data. [2025-09-29T18:14:49.681474] [DEBUG] [LOCAL ] DBL: Trimmed 12548 records to 9252 (keeping 200 days of data) [2025-09-29T18:14:49.741760] [DEBUG] [LOCAL ] DBL: Primary data saved (9252 records). [2025-09-29T18:14:49.741912] [INFO ] [MAIN ] DBL: Full history saved. [2025-09-29T18:14:49.742011] [INFO ] [MAIN ] Update Progress: 594/2371 symbols completed. DBL took 21.6s. Estimated remaining: 3h 43m 43s. Rate: 7.9 symbols/min [2025-09-29T18:14:49.921580] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:14:49.938333] [DEBUG] [LOCAL ] DCO: Loaded 14003 existing records from primary storage. [2025-09-29T18:14:49.938562] [INFO ] [MAIN ] DCO: Loaded 14003 existing records. [2025-09-29T18:14:49.953209] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-09-29T18:14:50.132501] [WARN ] [MAIN ] DCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:14:50.132803] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-09-29T18:14:50.132865] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-09-29T18:14:50.133143] [DEBUG] [LOCAL ] DCO: Deleted primary data file. [2025-09-29T18:14:50.133207] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-09-29T18:14:50.519720] [INFO ] [REMOTE ] DCO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:14:50.698670] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-29T18:14:50.748201] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-09-29T18:14:51.548173] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-09-29T18:14:51.949799] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-29T18:14:51.959056] [INFO ] [REMOTE ] DBI: Full fetch complete (65797 records). [2025-09-29T18:14:51.959204] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-09-29T18:14:51.959967] [FATAL] [VALIDATOR ] DBI: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:14:51.960066] [FATAL] [MAIN ] DBI: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:14:51.960121] [WARN ] [MAIN ] DBI: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:14:51.960200] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-09-29T18:14:51.960276] [DEBUG] [LOCAL ] DBI: No primary data file found to delete. [2025-09-29T18:14:51.960317] [INFO ] [LOCAL ] DBI: Starting deletion of derivative data. [2025-09-29T18:14:51.961066] [DEBUG] [LOCAL ] DBI: Deleted derivative data file. [2025-09-29T18:14:51.961205] [INFO ] [MAIN ] Update Progress: 595/2371 symbols completed. DBI took 31.9s. Estimated remaining: 3h 43m 19s. Rate: 8.0 symbols/min [2025-09-29T18:14:52.144717] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:14:52.207247] [DEBUG] [LOCAL ] DD: Loaded 53595 existing records from primary storage. [2025-09-29T18:14:52.207621] [INFO ] [MAIN ] DD: Loaded 53595 existing records. [2025-09-29T18:14:52.364386] [INFO ] [REMOTE ] DCO: Fetching primary data for 2024-12. [2025-09-29T18:14:52.405933] [WARN ] [MAIN ] DD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:14:52.406433] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-09-29T18:14:52.406514] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-09-29T18:14:52.407157] [DEBUG] [LOCAL ] DD: Deleted primary data file. [2025-09-29T18:14:52.407217] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-09-29T18:14:52.829695] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-29T18:14:52.825882] [INFO ] [REMOTE ] DD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:14:53.055200] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-29T18:14:53.148179] [INFO ] [REMOTE ] DD: Fetching primary data for 2024-12. [2025-09-29T18:14:53.313357] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-29T18:14:53.948166] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-09-29T18:14:54.748128] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-09-29T18:14:54.991481] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-29T18:14:55.288432] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-29T18:14:55.548160] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-01. [2025-09-29T18:14:56.107015] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-29T18:14:56.348136] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-09-29T18:14:56.409599] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-29T18:14:57.148136] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-09-29T18:14:57.552740] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-29T18:14:57.646596] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-29T18:14:57.948117] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-09-29T18:14:58.748119] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-09-29T18:14:58.797633] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-29T18:14:59.548160] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-09-29T18:15:00.348116] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-01. [2025-09-29T18:15:00.387411] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-29T18:15:00.631150] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-29T18:15:01.148116] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-09-29T18:15:01.948166] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-09-29T18:15:02.296345] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-29T18:15:02.377933] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-29T18:15:02.554380] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-29T18:15:02.748123] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-09-29T18:15:03.548175] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-09-29T18:15:04.348116] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-09-29T18:15:04.855305] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-29T18:15:05.004016] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-09-29T18:15:05.148154] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-09-29T18:15:05.948154] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-09-29T18:15:06.231946] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-29T18:15:06.423988] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-29T18:15:06.748109] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-09-29T18:15:07.472878] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-29T18:15:07.548114] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-09-29T18:15:08.348141] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-09-29T18:15:08.624525] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-29T18:15:09.136932] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-29T18:15:09.144996] [INFO ] [REMOTE ] DCI: Full fetch complete (53843 records). [2025-09-29T18:15:09.145130] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-09-29T18:15:09.146030] [FATAL] [VALIDATOR ] DCI: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:15:09.146121] [FATAL] [MAIN ] DCI: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:15:09.146166] [WARN ] [MAIN ] DCI: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:15:09.146207] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-09-29T18:15:09.146266] [DEBUG] [LOCAL ] DCI: No primary data file found to delete. [2025-09-29T18:15:09.146307] [INFO ] [LOCAL ] DCI: Starting deletion of derivative data. [2025-09-29T18:15:09.146959] [DEBUG] [LOCAL ] DCI: Deleted derivative data file. [2025-09-29T18:15:09.147095] [INFO ] [MAIN ] Update Progress: 596/2371 symbols completed. DCI took 34.9s. Estimated remaining: 3h 43m 40s. Rate: 7.9 symbols/min [2025-09-29T18:15:09.153183] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-09-29T18:15:09.332567] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:15:09.388486] [DEBUG] [LOCAL ] DDD: Loaded 51647 existing records from primary storage. [2025-09-29T18:15:09.388849] [INFO ] [MAIN ] DDD: Loaded 51647 existing records. [2025-09-29T18:15:09.580233] [WARN ] [MAIN ] DDD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:15:09.580492] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-09-29T18:15:09.580543] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-09-29T18:15:09.581083] [DEBUG] [LOCAL ] DDD: Deleted primary data file. [2025-09-29T18:15:09.581143] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-09-29T18:15:09.958257] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-09-29T18:15:09.962258] [INFO ] [REMOTE ] DDD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:15:10.183447] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-29T18:15:10.274813] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-29T18:15:10.748111] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-09-29T18:15:11.548107] [INFO ] [REMOTE ] DDD: Fetching primary data for 2024-12. [2025-09-29T18:15:11.638049] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-29T18:15:12.327731] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-29T18:15:12.348060] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-09-29T18:15:13.148086] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-09-29T18:15:13.562337] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-29T18:15:13.948088] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-09-29T18:15:14.055708] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-29T18:15:14.748210] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-09-29T18:15:14.945716] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-29T18:15:14.956112] [INFO ] [REMOTE ] DBRG: Full fetch complete (71925 records). [2025-09-29T18:15:14.956280] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-09-29T18:15:14.957172] [FATAL] [VALIDATOR ] DBRG: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:15:14.957269] [FATAL] [MAIN ] DBRG: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:15:14.957314] [WARN ] [MAIN ] DBRG: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:15:14.957381] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-09-29T18:15:14.957516] [DEBUG] [LOCAL ] DBRG: No primary data file found to delete. [2025-09-29T18:15:14.957563] [INFO ] [LOCAL ] DBRG: Starting deletion of derivative data. [2025-09-29T18:15:14.957949] [DEBUG] [LOCAL ] DBRG: Deleted derivative data file. [2025-09-29T18:15:14.958056] [INFO ] [MAIN ] Update Progress: 597/2371 symbols completed. DBRG took 43.7s. Estimated remaining: 3h 43m 28s. Rate: 7.9 symbols/min [2025-09-29T18:15:15.297248] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-29T18:15:15.301414] [INFO ] [REMOTE ] DCO: Full fetch complete (19265 records). [2025-09-29T18:15:15.301554] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-09-29T18:15:15.557492] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-09-29T18:15:15.728952] [DEBUG] [VALIDATOR ] DCO: All expected trading days are present. [2025-09-29T18:15:15.729056] [DEBUG] [VALIDATOR ] DCO: Primary data validation passed. [2025-09-29T18:15:15.729540] [INFO ] [MAIN ] DCO: Fetched primary data is valid. [2025-09-29T18:15:15.729599] [DEBUG] [LOCAL ] DCO: Saving primary data. [2025-09-29T18:15:15.730517] [DEBUG] [LOCAL ] DCO: Trimmed 19265 records to 13831 (keeping 200 days of data) [2025-09-29T18:15:15.821400] [DEBUG] [LOCAL ] DCO: Primary data saved (13831 records). [2025-09-29T18:15:15.821558] [INFO ] [MAIN ] DCO: Full history saved. [2025-09-29T18:15:15.821689] [INFO ] [MAIN ] Update Progress: 598/2371 symbols completed. DCO took 26.1s. Estimated remaining: 3h 43m 0s. Rate: 8.0 symbols/min [2025-09-29T18:15:16.529157] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-29T18:15:16.540573] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-09-29T18:15:17.338506] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-29T18:15:17.349626] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-09-29T18:15:18.243639] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-29T18:15:18.253841] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-09-29T18:15:19.346989] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-29T18:15:19.359299] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-09-29T18:15:20.117185] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-29T18:15:20.128443] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-09-29T18:15:21.527963] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-29T18:15:21.540322] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-09-29T18:15:21.693236] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-29T18:15:21.705205] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-09-29T18:15:23.448452] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-29T18:15:23.460852] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-09-29T18:15:23.570856] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-29T18:15:23.584492] [INFO ] [REMOTE ] DD: Full fetch complete (76293 records). [2025-09-29T18:15:23.584807] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-09-29T18:15:24.065219] [DEBUG] [VALIDATOR ] DD: All expected trading days are present. [2025-09-29T18:15:24.065306] [DEBUG] [VALIDATOR ] DD: Primary data validation passed. [2025-09-29T18:15:24.066344] [INFO ] [MAIN ] DD: Fetched primary data is valid. [2025-09-29T18:15:24.066417] [DEBUG] [LOCAL ] DD: Saving primary data. [2025-09-29T18:15:24.067996] [DEBUG] [LOCAL ] DD: Trimmed 76293 records to 52829 (keeping 200 days of data) [2025-09-29T18:15:24.418746] [DEBUG] [LOCAL ] DD: Primary data saved (52829 records). [2025-09-29T18:15:24.418902] [INFO ] [MAIN ] DD: Full history saved. [2025-09-29T18:15:24.419001] [INFO ] [MAIN ] Update Progress: 599/2371 symbols completed. DD took 32.5s. Estimated remaining: 3h 42m 56s. Rate: 7.9 symbols/min [2025-09-29T18:15:25.465794] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-29T18:15:25.477922] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-09-29T18:15:27.251109] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-29T18:15:27.262535] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-09-29T18:15:29.035820] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-29T18:15:29.048101] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-09-29T18:15:31.263805] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-29T18:15:31.274847] [INFO ] [REMOTE ] DDD: Full fetch complete (73691 records). [2025-09-29T18:15:31.274987] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-09-29T18:15:31.700570] [DEBUG] [VALIDATOR ] DDD: All expected trading days are present. [2025-09-29T18:15:31.700691] [DEBUG] [VALIDATOR ] DDD: Primary data validation passed. [2025-09-29T18:15:31.701742] [INFO ] [MAIN ] DDD: Fetched primary data is valid. [2025-09-29T18:15:31.701814] [DEBUG] [LOCAL ] DDD: Saving primary data. [2025-09-29T18:15:31.703525] [DEBUG] [LOCAL ] DDD: Trimmed 73691 records to 50893 (keeping 200 days of data) [2025-09-29T18:15:32.031581] [DEBUG] [LOCAL ] DDD: Primary data saved (50893 records). [2025-09-29T18:15:32.031784] [INFO ] [MAIN ] DDD: Full history saved. [2025-09-29T18:15:32.031911] [INFO ] [MAIN ] Update Progress: 600/2371 symbols completed. DDD took 22.9s. Estimated remaining: 3h 42m 48s. Rate: 7.9 symbols/min [2025-09-29T18:15:32.704502] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:15:32.775517] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:15:32.803259] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:15:32.802239] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:15:32.810259] [DEBUG] [LOCAL ] DDT: Loaded 2117 existing records from primary storage. [2025-09-29T18:15:32.810787] [INFO ] [MAIN ] DDT: Loaded 2117 existing records. [2025-09-29T18:15:32.946505] [DEBUG] [LOCAL ] DDS: Loaded 13374 existing records from primary storage. [2025-09-29T18:15:33.007591] [INFO ] [MAIN ] DDS: Loaded 13374 existing records. [2025-09-29T18:15:33.096328] [WARN ] [MAIN ] DDT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:15:33.106045] [DEBUG] [LOCAL ] DDL: Loaded 37016 existing records from primary storage. [2025-09-29T18:15:33.147111] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-09-29T18:15:33.147452] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-09-29T18:15:33.147593] [INFO ] [MAIN ] DDL: Loaded 37016 existing records. [2025-09-29T18:15:33.168546] [DEBUG] [LOCAL ] DDT: Deleted primary data file. [2025-09-29T18:15:33.174053] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-09-29T18:15:33.185710] [DEBUG] [LOCAL ] DE: Loaded 48397 existing records from primary storage. [2025-09-29T18:15:33.233675] [INFO ] [MAIN ] DE: Loaded 48397 existing records. [2025-09-29T18:15:33.460459] [WARN ] [MAIN ] DDS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:15:33.511331] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-09-29T18:15:33.543326] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-09-29T18:15:33.604371] [DEBUG] [LOCAL ] DDS: Deleted primary data file. [2025-09-29T18:15:33.630969] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-09-29T18:15:33.826928] [WARN ] [MAIN ] DDL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:15:33.936346] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-09-29T18:15:34.034501] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-09-29T18:15:34.034308] [WARN ] [MAIN ] DE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:15:34.088349] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-09-29T18:15:34.098928] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-09-29T18:15:34.083102] [DEBUG] [LOCAL ] DDL: Deleted primary data file. [2025-09-29T18:15:34.136179] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-09-29T18:15:34.127174] [DEBUG] [LOCAL ] DE: Deleted primary data file. [2025-09-29T18:15:34.136483] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-09-29T18:15:34.696602] [INFO ] [REMOTE ] DDT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:15:34.779228] [INFO ] [REMOTE ] DDT: Fetching primary data for 2024-12. [2025-09-29T18:15:35.045177] [INFO ] [REMOTE ] DDS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:15:35.118079] [INFO ] [REMOTE ] DDS: Fetching primary data for 2024-12. [2025-09-29T18:15:35.356768] [INFO ] [REMOTE ] DDL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:15:35.361084] [INFO ] [REMOTE ] DE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:15:35.361533] [INFO ] [REMOTE ] DE: Fetching primary data for 2024-12. [2025-09-29T18:15:35.361942] [INFO ] [REMOTE ] DDL: Fetching primary data for 2024-12. [2025-09-29T18:15:35.469334] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-29T18:15:35.470545] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-01. [2025-09-29T18:15:35.928493] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-29T18:15:35.929872] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-09-29T18:15:36.040556] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-29T18:15:36.044081] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-01. [2025-09-29T18:15:36.455456] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-29T18:15:36.457140] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-09-29T18:15:36.703619] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-29T18:15:36.713356] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-09-29T18:15:36.765108] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-29T18:15:36.775633] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-01. [2025-09-29T18:15:36.940697] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-29T18:15:36.943959] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-09-29T18:15:37.002112] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-29T18:15:37.003405] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-09-29T18:15:37.647942] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-29T18:15:37.649538] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-09-29T18:15:37.833902] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-29T18:15:37.837343] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-09-29T18:15:38.082902] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-29T18:15:38.095254] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-09-29T18:15:38.095370] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-29T18:15:38.097722] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-09-29T18:15:38.451540] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-29T18:15:38.462960] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-09-29T18:15:38.544759] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-29T18:15:38.748186] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-09-29T18:15:38.867747] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-29T18:15:39.179847] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-29T18:15:39.498379] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-29T18:15:39.548111] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-09-29T18:15:40.032109] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-29T18:15:40.090504] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-29T18:15:40.348178] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-09-29T18:15:41.148118] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-09-29T18:15:41.771622] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-29T18:15:41.948181] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-09-29T18:15:42.748109] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-09-29T18:15:43.094152] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-29T18:15:43.502594] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-29T18:15:43.503661] [INFO ] [REMOTE ] DDT: Full fetch complete (2906 records). [2025-09-29T18:15:43.503745] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-09-29T18:15:43.553121] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-09-29T18:15:43.728876] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-29T18:15:43.948437] [DEBUG] [VALIDATOR ] DDT: All expected trading days are present. [2025-09-29T18:15:43.948550] [DEBUG] [VALIDATOR ] DDT: Primary data validation passed. [2025-09-29T18:15:43.948706] [INFO ] [MAIN ] DDT: Fetched primary data is valid. [2025-09-29T18:15:43.948769] [DEBUG] [LOCAL ] DDT: Saving primary data. [2025-09-29T18:15:43.949133] [DEBUG] [LOCAL ] DDT: Trimmed 2906 records to 2094 (keeping 200 days of data) [2025-09-29T18:15:43.963260] [DEBUG] [LOCAL ] DDT: Primary data saved (2094 records). [2025-09-29T18:15:43.963363] [INFO ] [MAIN ] DDT: Full history saved. [2025-09-29T18:15:43.963460] [INFO ] [MAIN ] Update Progress: 601/2371 symbols completed. DDT took 11.9s. Estimated remaining: 3h 42m 54s. Rate: 7.9 symbols/min [2025-09-29T18:15:44.140517] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:15:44.193882] [DEBUG] [LOCAL ] DEA: Loaded 41860 existing records from primary storage. [2025-09-29T18:15:44.194316] [INFO ] [MAIN ] DEA: Loaded 41860 existing records. [2025-09-29T18:15:44.353276] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-09-29T18:15:44.400485] [WARN ] [MAIN ] DEA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:15:44.400845] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-09-29T18:15:44.400919] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-09-29T18:15:44.401555] [DEBUG] [LOCAL ] DEA: Deleted primary data file. [2025-09-29T18:15:44.401616] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-09-29T18:15:44.802593] [INFO ] [REMOTE ] DEA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:15:45.148149] [INFO ] [REMOTE ] DEA: Fetching primary data for 2024-12. [2025-09-29T18:15:45.475056] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-29T18:15:45.948236] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-09-29T18:15:45.950006] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-29T18:15:46.748100] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-09-29T18:15:46.927052] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-29T18:15:46.977101] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-29T18:15:47.548110] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-01. [2025-09-29T18:15:47.986130] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-29T18:15:48.348132] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-09-29T18:15:49.152417] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-09-29T18:15:49.157478] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-29T18:15:49.621824] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-29T18:15:49.948126] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-09-29T18:15:50.316477] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-29T18:15:50.748170] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-09-29T18:15:51.235832] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-29T18:15:51.548092] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-09-29T18:15:51.564589] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-29T18:15:52.348164] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-09-29T18:15:53.133745] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-29T18:15:53.148073] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-09-29T18:15:53.948122] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-09-29T18:15:54.228212] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-29T18:15:54.748124] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-09-29T18:15:54.821240] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-29T18:15:54.996449] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-29T18:15:55.548120] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-09-29T18:15:56.319678] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-29T18:15:56.348089] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-09-29T18:15:56.431514] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-29T18:15:57.148179] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-09-29T18:15:57.948110] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-09-29T18:15:58.203538] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-29T18:15:58.225098] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-29T18:15:58.229992] [INFO ] [REMOTE ] DDS: Full fetch complete (19191 records). [2025-09-29T18:15:58.230142] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-09-29T18:15:58.653793] [DEBUG] [VALIDATOR ] DDS: All expected trading days are present. [2025-09-29T18:15:58.653894] [DEBUG] [VALIDATOR ] DDS: Primary data validation passed. [2025-09-29T18:15:58.654361] [INFO ] [MAIN ] DDS: Fetched primary data is valid. [2025-09-29T18:15:58.654405] [DEBUG] [LOCAL ] DDS: Saving primary data. [2025-09-29T18:15:58.655039] [DEBUG] [LOCAL ] DDS: Trimmed 19191 records to 13100 (keeping 200 days of data) [2025-09-29T18:15:58.748147] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-09-29T18:15:58.748053] [DEBUG] [LOCAL ] DDS: Primary data saved (13100 records). [2025-09-29T18:15:58.749316] [INFO ] [MAIN ] DDS: Full history saved. [2025-09-29T18:15:58.749458] [INFO ] [MAIN ] Update Progress: 602/2371 symbols completed. DDS took 26.7s. Estimated remaining: 3h 43m 7s. Rate: 7.9 symbols/min [2025-09-29T18:15:58.937955] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:15:58.976919] [DEBUG] [LOCAL ] DEC: Loaded 31121 existing records from primary storage. [2025-09-29T18:15:58.977209] [INFO ] [MAIN ] DEC: Loaded 31121 existing records. [2025-09-29T18:15:59.167409] [WARN ] [MAIN ] DEC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:15:59.167765] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-09-29T18:15:59.167849] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-09-29T18:15:59.168695] [DEBUG] [LOCAL ] DEC: Deleted primary data file. [2025-09-29T18:15:59.168775] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-09-29T18:15:59.555919] [INFO ] [REMOTE ] DEC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:15:59.556028] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-09-29T18:15:59.761590] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-29T18:15:59.772145] [INFO ] [REMOTE ] DDL: Full fetch complete (53325 records). [2025-09-29T18:15:59.772342] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-09-29T18:16:00.191265] [DEBUG] [VALIDATOR ] DDL: All expected trading days are present. [2025-09-29T18:16:00.191458] [DEBUG] [VALIDATOR ] DDL: Primary data validation passed. [2025-09-29T18:16:00.192338] [INFO ] [MAIN ] DDL: Fetched primary data is valid. [2025-09-29T18:16:00.192461] [DEBUG] [LOCAL ] DDL: Saving primary data. [2025-09-29T18:16:00.202538] [DEBUG] [LOCAL ] DDL: Trimmed 53325 records to 36597 (keeping 200 days of data) [2025-09-29T18:16:00.220706] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-29T18:16:00.350310] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-09-29T18:16:00.461373] [DEBUG] [LOCAL ] DDL: Primary data saved (36597 records). [2025-09-29T18:16:00.461525] [INFO ] [MAIN ] DDL: Full history saved. [2025-09-29T18:16:00.461616] [INFO ] [MAIN ] Update Progress: 603/2371 symbols completed. DDL took 28.4s. Estimated remaining: 3h 42m 43s. Rate: 7.9 symbols/min [2025-09-29T18:16:00.646228] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:16:00.721179] [DEBUG] [LOCAL ] DECK: Loaded 54078 existing records from primary storage. [2025-09-29T18:16:00.721556] [INFO ] [MAIN ] DECK: Loaded 54078 existing records. [2025-09-29T18:16:00.928337] [WARN ] [MAIN ] DECK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:16:00.928676] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-09-29T18:16:00.928742] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-09-29T18:16:00.929790] [DEBUG] [LOCAL ] DECK: Deleted primary data file. [2025-09-29T18:16:00.929852] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-09-29T18:16:01.159772] [INFO ] [REMOTE ] DEC: Fetching primary data for 2024-12. [2025-09-29T18:16:01.341613] [INFO ] [REMOTE ] DECK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:16:01.552203] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-29T18:16:01.613018] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-29T18:16:01.948135] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-09-29T18:16:02.332599] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-29T18:16:02.748138] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-09-29T18:16:03.544034] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-29T18:16:03.553390] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-09-29T18:16:04.006099] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-29T18:16:04.348138] [INFO ] [REMOTE ] DECK: Fetching primary data for 2024-12. [2025-09-29T18:16:05.148138] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-09-29T18:16:05.473092] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-29T18:16:05.948089] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-09-29T18:16:06.258673] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-29T18:16:06.365151] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-29T18:16:06.748115] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-01. [2025-09-29T18:16:07.548110] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-09-29T18:16:07.674182] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-29T18:16:07.684462] [INFO ] [REMOTE ] DE: Full fetch complete (69535 records). [2025-09-29T18:16:07.684627] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-09-29T18:16:08.088967] [DEBUG] [VALIDATOR ] DE: All expected trading days are present. [2025-09-29T18:16:08.089063] [DEBUG] [VALIDATOR ] DE: Primary data validation passed. [2025-09-29T18:16:08.090013] [INFO ] [MAIN ] DE: Fetched primary data is valid. [2025-09-29T18:16:08.090084] [DEBUG] [LOCAL ] DE: Saving primary data. [2025-09-29T18:16:08.091562] [DEBUG] [LOCAL ] DE: Trimmed 69535 records to 47576 (keeping 200 days of data) [2025-09-29T18:16:08.348942] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-09-29T18:16:08.432685] [DEBUG] [LOCAL ] DE: Primary data saved (47576 records). [2025-09-29T18:16:08.432841] [INFO ] [MAIN ] DE: Full history saved. [2025-09-29T18:16:08.432952] [INFO ] [MAIN ] Update Progress: 604/2371 symbols completed. DE took 36.4s. Estimated remaining: 3h 42m 36s. Rate: 7.9 symbols/min [2025-09-29T18:16:08.620958] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:16:08.664301] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-29T18:16:08.715973] [DEBUG] [LOCAL ] DEI: Loaded 49204 existing records from primary storage. [2025-09-29T18:16:08.716447] [INFO ] [MAIN ] DEI: Loaded 49204 existing records. [2025-09-29T18:16:08.935001] [WARN ] [MAIN ] DEI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:16:08.935546] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-09-29T18:16:08.935907] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-09-29T18:16:08.937731] [DEBUG] [LOCAL ] DEI: Deleted primary data file. [2025-09-29T18:16:08.937800] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-09-29T18:16:09.154177] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-09-29T18:16:09.372377] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-29T18:16:09.376372] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:16:09.948083] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-09-29T18:16:09.975493] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-29T18:16:10.748124] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-09-29T18:16:11.318703] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-09-29T18:16:11.413464] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-29T18:16:11.548156] [INFO ] [REMOTE ] DEI: Fetching primary data for 2024-12. [2025-09-29T18:16:12.348151] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-09-29T18:16:12.463318] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-29T18:16:12.472989] [INFO ] [REMOTE ] DEA: Full fetch complete (62662 records). [2025-09-29T18:16:12.473167] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-09-29T18:16:12.910580] [DEBUG] [VALIDATOR ] DEA: All expected trading days are present. [2025-09-29T18:16:12.910834] [DEBUG] [VALIDATOR ] DEA: Primary data validation passed. [2025-09-29T18:16:12.911850] [INFO ] [MAIN ] DEA: Fetched primary data is valid. [2025-09-29T18:16:12.912026] [DEBUG] [LOCAL ] DEA: Saving primary data. [2025-09-29T18:16:12.913744] [DEBUG] [LOCAL ] DEA: Trimmed 62662 records to 40957 (keeping 200 days of data) [2025-09-29T18:16:13.051119] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-29T18:16:13.153252] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-09-29T18:16:13.225318] [DEBUG] [LOCAL ] DEA: Primary data saved (40957 records). [2025-09-29T18:16:13.225467] [INFO ] [MAIN ] DEA: Full history saved. [2025-09-29T18:16:13.225562] [INFO ] [MAIN ] Update Progress: 605/2371 symbols completed. DEA took 29.3s. Estimated remaining: 3h 42m 21s. Rate: 7.9 symbols/min [2025-09-29T18:16:13.450835] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:16:13.522017] [DEBUG] [LOCAL ] DELL: Loaded 54515 existing records from primary storage. [2025-09-29T18:16:13.522419] [INFO ] [MAIN ] DELL: Loaded 54515 existing records. [2025-09-29T18:16:13.719301] [WARN ] [MAIN ] DELL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:16:13.719722] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-09-29T18:16:13.719787] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-09-29T18:16:13.720611] [DEBUG] [LOCAL ] DELL: Deleted primary data file. [2025-09-29T18:16:13.720720] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-09-29T18:16:13.954807] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-09-29T18:16:14.112694] [INFO ] [REMOTE ] DELL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:16:14.416584] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-29T18:16:14.460004] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-29T18:16:14.748118] [INFO ] [REMOTE ] DELL: Fetching primary data for 2024-12. [2025-09-29T18:16:15.476130] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-29T18:16:15.548132] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-09-29T18:16:16.348139] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-09-29T18:16:16.890899] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-29T18:16:17.148154] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-09-29T18:16:17.306082] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2024-12 (2.56 seconds). [2025-09-29T18:16:17.948149] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-09-29T18:16:18.752196] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-01. [2025-09-29T18:16:18.756634] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-29T18:16:19.020123] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-09-29T18:16:19.126810] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-29T18:16:19.548125] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-09-29T18:16:20.348133] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-09-29T18:16:21.148129] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-09-29T18:16:21.268629] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-01 (2.52 seconds). [2025-09-29T18:16:21.565812] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-29T18:16:21.712551] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-29T18:16:21.948138] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-09-29T18:16:22.748120] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-09-29T18:16:22.998565] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-29T18:16:23.548178] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-09-29T18:16:24.305892] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-09-29T18:16:24.348086] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-09-29T18:16:24.730709] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-29T18:16:25.148131] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-09-29T18:16:25.507953] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-29T18:16:25.948123] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-09-29T18:16:26.713132] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-09-29T18:16:26.748152] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-09-29T18:16:27.083395] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-29T18:16:27.548226] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-09-29T18:16:27.813327] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-29T18:16:28.348136] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-09-29T18:16:29.148128] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-09-29T18:16:29.371073] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (2.62 seconds). [2025-09-29T18:16:29.646609] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-29T18:16:29.869135] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-29T18:16:29.948139] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-09-29T18:16:30.715727] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-29T18:16:30.722609] [INFO ] [REMOTE ] DEC: Full fetch complete (43030 records). [2025-09-29T18:16:30.722876] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-09-29T18:16:30.753342] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-09-29T18:16:31.153684] [DEBUG] [VALIDATOR ] DEC: All expected trading days are present. [2025-09-29T18:16:31.153801] [DEBUG] [VALIDATOR ] DEC: Primary data validation passed. [2025-09-29T18:16:31.154584] [INFO ] [MAIN ] DEC: Fetched primary data is valid. [2025-09-29T18:16:31.154686] [DEBUG] [LOCAL ] DEC: Saving primary data. [2025-09-29T18:16:31.155927] [DEBUG] [LOCAL ] DEC: Trimmed 43030 records to 30417 (keeping 200 days of data) [2025-09-29T18:16:31.364851] [DEBUG] [LOCAL ] DEC: Primary data saved (30417 records). [2025-09-29T18:16:31.365134] [INFO ] [MAIN ] DEC: Full history saved. [2025-09-29T18:16:31.365265] [INFO ] [MAIN ] Update Progress: 606/2371 symbols completed. DEC took 32.6s. Estimated remaining: 3h 42m 44s. Rate: 7.9 symbols/min [2025-09-29T18:16:31.558563] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:16:31.553938] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-09-29T18:16:31.620093] [DEBUG] [LOCAL ] DEO: Loaded 49777 existing records from primary storage. [2025-09-29T18:16:31.620531] [INFO ] [MAIN ] DEO: Loaded 49777 existing records. [2025-09-29T18:16:31.788264] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-29T18:16:31.869328] [WARN ] [MAIN ] DEO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:16:31.869779] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-09-29T18:16:31.869873] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-09-29T18:16:31.870527] [DEBUG] [LOCAL ] DEO: Deleted primary data file. [2025-09-29T18:16:31.870625] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-09-29T18:16:32.267771] [INFO ] [REMOTE ] DEO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:16:32.348167] [INFO ] [REMOTE ] DEO: Fetching primary data for 2024-12. [2025-09-29T18:16:33.111141] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-09-29T18:16:33.130925] [INFO ] [REMOTE ] DECK: Full fetch complete (76635 records). [2025-09-29T18:16:33.131267] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-09-29T18:16:33.154697] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-09-29T18:16:33.733551] [DEBUG] [VALIDATOR ] DECK: All expected trading days are present. [2025-09-29T18:16:33.733721] [DEBUG] [VALIDATOR ] DECK: Primary data validation passed. [2025-09-29T18:16:33.734867] [INFO ] [MAIN ] DECK: Fetched primary data is valid. [2025-09-29T18:16:33.735100] [DEBUG] [LOCAL ] DECK: Saving primary data. [2025-09-29T18:16:33.736979] [DEBUG] [LOCAL ] DECK: Trimmed 76635 records to 53297 (keeping 200 days of data) [2025-09-29T18:16:33.881609] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-09-29T18:16:34.004466] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-09-29T18:16:34.168499] [DEBUG] [LOCAL ] DECK: Primary data saved (53297 records). [2025-09-29T18:16:34.168750] [INFO ] [MAIN ] DECK: Full history saved. [2025-09-29T18:16:34.168961] [INFO ] [MAIN ] Update Progress: 607/2371 symbols completed. DECK took 33.7s. Estimated remaining: 3h 42m 23s. Rate: 7.9 symbols/min [2025-09-29T18:16:34.326249] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-29T18:16:34.404106] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:16:34.443469] [DEBUG] [LOCAL ] DFH: Loaded 33106 existing records from primary storage. [2025-09-29T18:16:34.443792] [INFO ] [MAIN ] DFH: Loaded 33106 existing records. [2025-09-29T18:16:34.643561] [WARN ] [MAIN ] DFH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:16:34.643991] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-09-29T18:16:34.644093] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-09-29T18:16:34.644604] [DEBUG] [LOCAL ] DFH: Deleted primary data file. [2025-09-29T18:16:34.644816] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-09-29T18:16:34.758429] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-01. [2025-09-29T18:16:34.796085] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-29T18:16:35.089511] [INFO ] [REMOTE ] DFH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:16:35.548142] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-09-29T18:16:36.279931] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-09-29T18:16:36.348133] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-09-29T18:16:36.603402] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-29T18:16:37.148094] [INFO ] [REMOTE ] DFH: Fetching primary data for 2024-12. [2025-09-29T18:16:37.522860] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-29T18:16:37.533140] [INFO ] [REMOTE ] DEI: Full fetch complete (69651 records). [2025-09-29T18:16:37.533316] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-09-29T18:16:37.953602] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-09-29T18:16:37.977588] [DEBUG] [VALIDATOR ] DEI: All expected trading days are present. [2025-09-29T18:16:37.977736] [DEBUG] [VALIDATOR ] DEI: Primary data validation passed. [2025-09-29T18:16:37.978838] [INFO ] [MAIN ] DEI: Fetched primary data is valid. [2025-09-29T18:16:37.979060] [DEBUG] [LOCAL ] DEI: Saving primary data. [2025-09-29T18:16:37.980756] [DEBUG] [LOCAL ] DEI: Trimmed 69651 records to 48386 (keeping 200 days of data) [2025-09-29T18:16:38.302156] [DEBUG] [LOCAL ] DEI: Primary data saved (48386 records). [2025-09-29T18:16:38.302347] [INFO ] [MAIN ] DEI: Full history saved. [2025-09-29T18:16:38.302457] [INFO ] [MAIN ] Update Progress: 608/2371 symbols completed. DEI took 29.9s. Estimated remaining: 3h 42m 5s. Rate: 7.9 symbols/min [2025-09-29T18:16:38.500674] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:16:38.526424] [DEBUG] [LOCAL ] DFIN: Loaded 23650 existing records from primary storage. [2025-09-29T18:16:38.526869] [INFO ] [MAIN ] DFIN: Loaded 23650 existing records. [2025-09-29T18:16:38.742748] [WARN ] [MAIN ] DFIN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:16:38.743510] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-09-29T18:16:38.743907] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-09-29T18:16:38.744480] [DEBUG] [LOCAL ] DFIN: Deleted primary data file. [2025-09-29T18:16:38.744626] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-09-29T18:16:38.853334] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-29T18:16:38.904628] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-01. [2025-09-29T18:16:38.957253] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-09-29T18:16:39.227254] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:16:39.548100] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2024-12. [2025-09-29T18:16:39.736697] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-29T18:16:40.183370] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-29T18:16:40.332459] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-29T18:16:40.348092] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-09-29T18:16:41.148095] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-09-29T18:16:41.370734] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-29T18:16:41.948109] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-09-29T18:16:42.748133] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-09-29T18:16:42.936997] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-29T18:16:43.548139] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-09-29T18:16:43.830910] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-29T18:16:44.318219] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-29T18:16:44.348108] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-09-29T18:16:44.943258] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-29T18:16:45.148143] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-09-29T18:16:45.948145] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-09-29T18:16:46.154923] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-29T18:16:46.748109] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-09-29T18:16:47.211014] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (2.86 seconds). [2025-09-29T18:16:47.222506] [INFO ] [REMOTE ] DELL: Full fetch complete (77820 records). [2025-09-29T18:16:47.222716] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-09-29T18:16:47.549978] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-09-29T18:16:47.668201] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-29T18:16:47.700702] [DEBUG] [VALIDATOR ] DELL: All expected trading days are present. [2025-09-29T18:16:47.701181] [DEBUG] [VALIDATOR ] DELL: Primary data validation passed. [2025-09-29T18:16:47.702243] [INFO ] [MAIN ] DELL: Fetched primary data is valid. [2025-09-29T18:16:47.702388] [DEBUG] [LOCAL ] DELL: Saving primary data. [2025-09-29T18:16:47.704160] [DEBUG] [LOCAL ] DELL: Trimmed 77820 records to 53735 (keeping 200 days of data) [2025-09-29T18:16:48.060790] [DEBUG] [LOCAL ] DELL: Primary data saved (53735 records). [2025-09-29T18:16:48.060938] [INFO ] [MAIN ] DELL: Full history saved. [2025-09-29T18:16:48.061026] [INFO ] [MAIN ] Update Progress: 609/2371 symbols completed. DELL took 34.8s. Estimated remaining: 3h 42m 4s. Rate: 7.9 symbols/min [2025-09-29T18:16:48.240379] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:16:48.255412] [DEBUG] [LOCAL ] DFP: Loaded 11771 existing records from primary storage. [2025-09-29T18:16:48.255736] [INFO ] [MAIN ] DFP: Loaded 11771 existing records. [2025-09-29T18:16:48.354492] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-09-29T18:16:48.455137] [WARN ] [MAIN ] DFP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:16:48.455590] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-09-29T18:16:48.455740] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-09-29T18:16:48.456408] [DEBUG] [LOCAL ] DFP: Deleted primary data file. [2025-09-29T18:16:48.456573] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-09-29T18:16:48.750556] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-29T18:16:48.903418] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:16:48.929347] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-29T18:16:49.148120] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-09-29T18:16:49.645992] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-29T18:16:49.948119] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-09-29T18:16:50.748149] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-09-29T18:16:50.878386] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-29T18:16:50.908418] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-29T18:16:51.548119] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-09-29T18:16:51.762726] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-29T18:16:52.348116] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-09-29T18:16:53.148096] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-09-29T18:16:53.225879] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-29T18:16:53.270354] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-29T18:16:53.948151] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-09-29T18:16:54.532153] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-29T18:16:54.748133] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-09-29T18:16:55.129075] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-29T18:16:55.548115] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-09-29T18:16:56.125828] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-29T18:16:56.348119] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-09-29T18:16:56.644677] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-29T18:16:57.148115] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-09-29T18:16:57.674371] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-29T18:16:57.948130] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-09-29T18:16:58.748109] [INFO ] [REMOTE ] DFP: Fetching primary data for 2024-12. [2025-09-29T18:16:59.142351] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-29T18:16:59.171110] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-29T18:16:59.176437] [INFO ] [REMOTE ] DFIN: Full fetch complete (33660 records). [2025-09-29T18:16:59.176536] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-09-29T18:16:59.569494] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-09-29T18:16:59.585226] [DEBUG] [VALIDATOR ] DFIN: All expected trading days are present. [2025-09-29T18:16:59.585383] [DEBUG] [VALIDATOR ] DFIN: Primary data validation passed. [2025-09-29T18:16:59.586117] [INFO ] [MAIN ] DFIN: Fetched primary data is valid. [2025-09-29T18:16:59.593516] [DEBUG] [LOCAL ] DFIN: Saving primary data. [2025-09-29T18:16:59.594259] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-29T18:16:59.598140] [DEBUG] [LOCAL ] DFIN: Trimmed 33660 records to 23167 (keeping 200 days of data) [2025-09-29T18:16:59.738959] [DEBUG] [LOCAL ] DFIN: Primary data saved (23167 records). [2025-09-29T18:16:59.739092] [INFO ] [MAIN ] DFIN: Full history saved. [2025-09-29T18:16:59.739179] [INFO ] [MAIN ] Update Progress: 610/2371 symbols completed. DFIN took 21.4s. Estimated remaining: 3h 42m 8s. Rate: 7.9 symbols/min [2025-09-29T18:16:59.914426] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:16:59.986508] [DEBUG] [LOCAL ] DG: Loaded 54068 existing records from primary storage. [2025-09-29T18:16:59.986895] [INFO ] [MAIN ] DG: Loaded 54068 existing records. [2025-09-29T18:17:00.174458] [WARN ] [MAIN ] DG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:17:00.174767] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-09-29T18:17:00.174829] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-09-29T18:17:00.175735] [DEBUG] [LOCAL ] DG: Deleted primary data file. [2025-09-29T18:17:00.175801] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-09-29T18:17:00.350506] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-09-29T18:17:00.572253] [INFO ] [REMOTE ] DG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:17:01.148095] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-09-29T18:17:01.289016] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-29T18:17:01.548746] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-29T18:17:01.948133] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-09-29T18:17:02.748112] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-09-29T18:17:02.930938] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-29T18:17:02.938054] [INFO ] [REMOTE ] DFH: Full fetch complete (48878 records). [2025-09-29T18:17:02.938161] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-09-29T18:17:03.353251] [DEBUG] [VALIDATOR ] DFH: All expected trading days are present. [2025-09-29T18:17:03.353432] [DEBUG] [VALIDATOR ] DFH: Primary data validation passed. [2025-09-29T18:17:03.354319] [INFO ] [MAIN ] DFH: Fetched primary data is valid. [2025-09-29T18:17:03.361772] [DEBUG] [LOCAL ] DFH: Saving primary data. [2025-09-29T18:17:03.362055] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-29T18:17:03.366334] [DEBUG] [LOCAL ] DFH: Trimmed 48878 records to 32389 (keeping 200 days of data) [2025-09-29T18:17:03.548199] [INFO ] [REMOTE ] DG: Fetching primary data for 2024-12. [2025-09-29T18:17:03.570087] [DEBUG] [LOCAL ] DFH: Primary data saved (32389 records). [2025-09-29T18:17:03.570221] [INFO ] [MAIN ] DFH: Full history saved. [2025-09-29T18:17:03.570327] [INFO ] [MAIN ] Update Progress: 611/2371 symbols completed. DFH took 29.4s. Estimated remaining: 3h 41m 50s. Rate: 7.9 symbols/min [2025-09-29T18:17:03.755982] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:17:03.816993] [DEBUG] [LOCAL ] DGX: Loaded 45736 existing records from primary storage. [2025-09-29T18:17:03.817558] [INFO ] [MAIN ] DGX: Loaded 45736 existing records. [2025-09-29T18:17:04.015637] [WARN ] [MAIN ] DGX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:17:04.016037] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-09-29T18:17:04.016167] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-09-29T18:17:04.026503] [DEBUG] [LOCAL ] DGX: Deleted primary data file. [2025-09-29T18:17:04.044348] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-09-29T18:17:04.080111] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-29T18:17:04.168199] [INFO ] [REMOTE ] DEO: Full fetch complete (71140 records). [2025-09-29T18:17:04.183768] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-09-29T18:17:04.210222] [FATAL] [VALIDATOR ] DEO: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:17:04.226374] [FATAL] [MAIN ] DEO: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:17:04.245686] [WARN ] [MAIN ] DEO: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:17:04.306364] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-09-29T18:17:04.345129] [DEBUG] [LOCAL ] DEO: No primary data file found to delete. [2025-09-29T18:17:04.353215] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-09-29T18:17:04.356325] [INFO ] [LOCAL ] DEO: Starting deletion of derivative data. [2025-09-29T18:17:04.384500] [DEBUG] [LOCAL ] DEO: Deleted derivative data file. [2025-09-29T18:17:04.422516] [INFO ] [MAIN ] Update Progress: 612/2371 symbols completed. DEO took 33.1s. Estimated remaining: 3h 41m 23s. Rate: 7.9 symbols/min [2025-09-29T18:17:04.445716] [INFO ] [REMOTE ] DGX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:17:04.625527] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:17:04.648107] [DEBUG] [LOCAL ] DHF: Loaded 20835 existing records from primary storage. [2025-09-29T18:17:04.648396] [INFO ] [MAIN ] DHF: Loaded 20835 existing records. [2025-09-29T18:17:04.832885] [WARN ] [MAIN ] DHF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:17:04.833156] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-09-29T18:17:04.833221] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-09-29T18:17:04.833579] [DEBUG] [LOCAL ] DHF: Deleted primary data file. [2025-09-29T18:17:04.833671] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-09-29T18:17:05.153249] [INFO ] [REMOTE ] DGX: Fetching primary data for 2024-12. [2025-09-29T18:17:05.229897] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:17:05.389254] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-29T18:17:05.451587] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-29T18:17:05.948106] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-01. [2025-09-29T18:17:06.748092] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-09-29T18:17:06.887247] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-29T18:17:07.548139] [INFO ] [REMOTE ] DHF: Fetching primary data for 2024-12. [2025-09-29T18:17:07.610499] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-29T18:17:07.949547] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-29T18:17:08.279000] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-29T18:17:08.348131] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-09-29T18:17:09.148141] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-09-29T18:17:09.388130] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-29T18:17:09.948134] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-09-29T18:17:10.748151] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-01. [2025-09-29T18:17:10.951112] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-29T18:17:10.987151] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-29T18:17:11.548145] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-09-29T18:17:12.348098] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-09-29T18:17:12.420027] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-29T18:17:13.148119] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-09-29T18:17:13.204235] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-29T18:17:13.582747] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-29T18:17:13.951401] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-09-29T18:17:13.952584] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-29T18:17:14.748164] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-09-29T18:17:15.548129] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-09-29T18:17:15.706838] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-29T18:17:15.756512] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-29T18:17:16.348105] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-09-29T18:17:16.439394] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-29T18:17:17.148164] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-09-29T18:17:17.948140] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-09-29T18:17:17.972301] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-29T18:17:18.158526] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-29T18:17:18.748098] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-09-29T18:17:19.152609] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-29T18:17:19.548125] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-09-29T18:17:20.348083] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-09-29T18:17:20.482744] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-29T18:17:20.505344] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-29T18:17:20.509062] [INFO ] [REMOTE ] DFP: Full fetch complete (16099 records). [2025-09-29T18:17:20.509170] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-09-29T18:17:20.509879] [FATAL] [VALIDATOR ] DFP: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:17:20.509985] [FATAL] [MAIN ] DFP: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:17:20.510060] [WARN ] [MAIN ] DFP: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:17:20.510155] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-09-29T18:17:20.510244] [DEBUG] [LOCAL ] DFP: No primary data file found to delete. [2025-09-29T18:17:20.510285] [INFO ] [LOCAL ] DFP: Starting deletion of derivative data. [2025-09-29T18:17:20.510816] [DEBUG] [LOCAL ] DFP: Deleted derivative data file. [2025-09-29T18:17:20.510929] [INFO ] [MAIN ] Update Progress: 613/2371 symbols completed. DFP took 32.4s. Estimated remaining: 3h 41m 40s. Rate: 7.9 symbols/min [2025-09-29T18:17:20.679675] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:17:20.749951] [DEBUG] [LOCAL ] DHI: Loaded 54147 existing records from primary storage. [2025-09-29T18:17:20.750742] [INFO ] [MAIN ] DHI: Loaded 54147 existing records. [2025-09-29T18:17:20.949061] [WARN ] [MAIN ] DHI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:17:20.949347] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-09-29T18:17:20.949411] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-09-29T18:17:20.950095] [DEBUG] [LOCAL ] DHI: Deleted primary data file. [2025-09-29T18:17:20.950162] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-09-29T18:17:21.155514] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-09-29T18:17:21.354924] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:17:21.425857] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-29T18:17:21.948128] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-09-29T18:17:22.748133] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-09-29T18:17:22.989889] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-29T18:17:23.039848] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-29T18:17:23.548112] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-09-29T18:17:24.348122] [INFO ] [REMOTE ] DHI: Fetching primary data for 2024-12. [2025-09-29T18:17:24.732438] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-29T18:17:25.029763] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-29T18:17:25.148185] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-09-29T18:17:25.948170] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-09-29T18:17:26.303568] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-29T18:17:26.372478] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-29T18:17:26.748112] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-09-29T18:17:27.548105] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-09-29T18:17:27.939824] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-29T18:17:28.348102] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-09-29T18:17:28.579946] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-29T18:17:28.586321] [INFO ] [REMOTE ] DHF: Full fetch complete (29620 records). [2025-09-29T18:17:28.586529] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-09-29T18:17:29.011061] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-09-29T18:17:29.124355] [DEBUG] [VALIDATOR ] DHF: All expected trading days are present. [2025-09-29T18:17:29.124482] [DEBUG] [VALIDATOR ] DHF: Primary data validation passed. [2025-09-29T18:17:29.125255] [INFO ] [MAIN ] DHF: Fetched primary data is valid. [2025-09-29T18:17:29.125324] [DEBUG] [LOCAL ] DHF: Saving primary data. [2025-09-29T18:17:29.126338] [DEBUG] [LOCAL ] DHF: Trimmed 29620 records to 20678 (keeping 200 days of data) [2025-09-29T18:17:29.188002] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-09-29T18:17:29.278573] [DEBUG] [LOCAL ] DHF: Primary data saved (20678 records). [2025-09-29T18:17:29.278812] [INFO ] [MAIN ] DHF: Full history saved. [2025-09-29T18:17:29.278932] [INFO ] [MAIN ] Update Progress: 614/2371 symbols completed. DHF took 24.8s. Estimated remaining: 3h 41m 36s. Rate: 7.9 symbols/min [2025-09-29T18:17:29.453609] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:17:29.528085] [DEBUG] [LOCAL ] DHR: Loaded 54139 existing records from primary storage. [2025-09-29T18:17:29.528617] [INFO ] [MAIN ] DHR: Loaded 54139 existing records. [2025-09-29T18:17:29.705267] [WARN ] [MAIN ] DHR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:17:29.705594] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-09-29T18:17:29.705670] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-09-29T18:17:29.706308] [DEBUG] [LOCAL ] DHR: Deleted primary data file. [2025-09-29T18:17:29.706369] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-09-29T18:17:29.971444] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-09-29T18:17:30.095941] [INFO ] [REMOTE ] DHR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:17:30.147231] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-29T18:17:30.748188] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-09-29T18:17:30.859835] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-29T18:17:31.239070] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-29T18:17:31.548165] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-09-29T18:17:32.348169] [INFO ] [REMOTE ] DHR: Fetching primary data for 2024-12. [2025-09-29T18:17:32.637158] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-29T18:17:33.148101] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-09-29T18:17:33.468765] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-29T18:17:33.910268] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-29T18:17:33.948107] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-01. [2025-09-29T18:17:34.748198] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-09-29T18:17:34.964351] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-29T18:17:35.548144] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-09-29T18:17:35.771899] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-29T18:17:36.348108] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-09-29T18:17:36.439340] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-29T18:17:37.148098] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-09-29T18:17:37.247909] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-29T18:17:37.861986] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-29T18:17:37.948169] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-09-29T18:17:38.748167] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-09-29T18:17:39.195735] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-29T18:17:39.207496] [INFO ] [REMOTE ] DG: Full fetch complete (77212 records). [2025-09-29T18:17:39.207714] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-09-29T18:17:39.553208] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-09-29T18:17:39.651537] [DEBUG] [VALIDATOR ] DG: All expected trading days are present. [2025-09-29T18:17:39.651665] [DEBUG] [VALIDATOR ] DG: Primary data validation passed. [2025-09-29T18:17:39.652782] [INFO ] [MAIN ] DG: Fetched primary data is valid. [2025-09-29T18:17:39.652861] [DEBUG] [LOCAL ] DG: Saving primary data. [2025-09-29T18:17:39.654476] [DEBUG] [LOCAL ] DG: Trimmed 77212 records to 53284 (keeping 200 days of data) [2025-09-29T18:17:40.089386] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-29T18:17:40.130725] [DEBUG] [LOCAL ] DG: Primary data saved (53284 records). [2025-09-29T18:17:40.130892] [INFO ] [MAIN ] DG: Full history saved. [2025-09-29T18:17:40.131003] [INFO ] [MAIN ] Update Progress: 615/2371 symbols completed. DG took 40.4s. Estimated remaining: 3h 41m 38s. Rate: 7.9 symbols/min [2025-09-29T18:17:40.324519] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:17:40.358605] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-09-29T18:17:40.362158] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-29T18:17:40.422035] [DEBUG] [LOCAL ] DHT: Loaded 48583 existing records from primary storage. [2025-09-29T18:17:40.422426] [INFO ] [MAIN ] DHT: Loaded 48583 existing records. [2025-09-29T18:17:40.615974] [WARN ] [MAIN ] DHT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:17:40.616196] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-09-29T18:17:40.616245] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-09-29T18:17:40.617058] [DEBUG] [LOCAL ] DHT: Deleted primary data file. [2025-09-29T18:17:40.617122] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-09-29T18:17:41.010391] [INFO ] [REMOTE ] DHT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:17:41.148153] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-09-29T18:17:41.360106] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-29T18:17:41.369167] [INFO ] [REMOTE ] DGX: Full fetch complete (65073 records). [2025-09-29T18:17:41.369344] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-09-29T18:17:41.831436] [DEBUG] [VALIDATOR ] DGX: All expected trading days are present. [2025-09-29T18:17:41.831531] [DEBUG] [VALIDATOR ] DGX: Primary data validation passed. [2025-09-29T18:17:41.832854] [INFO ] [MAIN ] DGX: Fetched primary data is valid. [2025-09-29T18:17:41.832939] [DEBUG] [LOCAL ] DGX: Saving primary data. [2025-09-29T18:17:41.834476] [DEBUG] [LOCAL ] DGX: Trimmed 65073 records to 44954 (keeping 200 days of data) [2025-09-29T18:17:41.948260] [INFO ] [REMOTE ] DHT: Fetching primary data for 2024-12. [2025-09-29T18:17:42.113696] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-29T18:17:42.177414] [DEBUG] [LOCAL ] DGX: Primary data saved (44954 records). [2025-09-29T18:17:42.177606] [INFO ] [MAIN ] DGX: Full history saved. [2025-09-29T18:17:42.177730] [INFO ] [MAIN ] Update Progress: 616/2371 symbols completed. DGX took 38.6s. Estimated remaining: 3h 41m 14s. Rate: 7.9 symbols/min [2025-09-29T18:17:42.354971] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:17:42.374904] [DEBUG] [LOCAL ] DHX: Loaded 13404 existing records from primary storage. [2025-09-29T18:17:42.375267] [INFO ] [MAIN ] DHX: Loaded 13404 existing records. [2025-09-29T18:17:42.596724] [WARN ] [MAIN ] DHX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:17:42.597370] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-09-29T18:17:42.597563] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-09-29T18:17:42.598746] [DEBUG] [LOCAL ] DHX: Deleted primary data file. [2025-09-29T18:17:42.598931] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-09-29T18:17:42.759446] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-09-29T18:17:43.012638] [INFO ] [REMOTE ] DHX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:17:43.046078] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-29T18:17:43.548745] [INFO ] [REMOTE ] DHX: Fetching primary data for 2024-12. [2025-09-29T18:17:43.556028] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-29T18:17:44.348114] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-09-29T18:17:44.436339] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-29T18:17:44.663226] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-29T18:17:45.148131] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-09-29T18:17:45.948098] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-01. [2025-09-29T18:17:46.448684] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-29T18:17:46.748144] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-09-29T18:17:47.180841] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-29T18:17:47.548140] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-01. [2025-09-29T18:17:47.683397] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-29T18:17:48.181791] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-29T18:17:48.348118] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-09-29T18:17:48.524311] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-29T18:17:49.148143] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-09-29T18:17:49.948146] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-09-29T18:17:50.576696] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-29T18:17:50.753311] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-09-29T18:17:50.776550] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-29T18:17:51.101581] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-29T18:17:51.548115] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-09-29T18:17:52.348128] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-09-29T18:17:52.898068] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-29T18:17:52.915331] [INFO ] [REMOTE ] DHI: Full fetch complete (77223 records). [2025-09-29T18:17:52.915516] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-09-29T18:17:53.153295] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-09-29T18:17:53.339797] [DEBUG] [VALIDATOR ] DHI: All expected trading days are present. [2025-09-29T18:17:53.340047] [DEBUG] [VALIDATOR ] DHI: Primary data validation passed. [2025-09-29T18:17:53.341050] [INFO ] [MAIN ] DHI: Fetched primary data is valid. [2025-09-29T18:17:53.341136] [DEBUG] [LOCAL ] DHI: Saving primary data. [2025-09-29T18:17:53.371243] [DEBUG] [LOCAL ] DHI: Trimmed 77223 records to 53361 (keeping 200 days of data) [2025-09-29T18:17:53.373358] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-29T18:17:53.741362] [DEBUG] [LOCAL ] DHI: Primary data saved (53361 records). [2025-09-29T18:17:53.741553] [INFO ] [MAIN ] DHI: Full history saved. [2025-09-29T18:17:53.741737] [INFO ] [MAIN ] Update Progress: 617/2371 symbols completed. DHI took 33.2s. Estimated remaining: 3h 41m 18s. Rate: 7.9 symbols/min [2025-09-29T18:17:53.920573] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:17:53.942290] [DEBUG] [LOCAL ] DIAX: Loaded 12780 existing records from primary storage. [2025-09-29T18:17:53.942547] [INFO ] [MAIN ] DIAX: Loaded 12780 existing records. [2025-09-29T18:17:53.954073] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-09-29T18:17:54.138816] [WARN ] [MAIN ] DIAX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:17:54.139359] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-09-29T18:17:54.139498] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-09-29T18:17:54.139788] [DEBUG] [LOCAL ] DIAX: Deleted primary data file. [2025-09-29T18:17:54.139847] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-09-29T18:17:54.258273] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-29T18:17:54.549253] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:17:54.588688] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-29T18:17:54.748117] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-09-29T18:17:55.548080] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2024-12. [2025-09-29T18:17:55.810226] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-29T18:17:55.834404] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-29T18:17:56.348093] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-09-29T18:17:56.627195] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-29T18:17:57.148134] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-09-29T18:17:57.948098] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-01. [2025-09-29T18:17:58.209595] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-29T18:17:58.748096] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-09-29T18:17:58.817992] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-29T18:17:58.923113] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-29T18:17:59.548109] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-09-29T18:18:00.348101] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-09-29T18:18:00.560722] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-29T18:18:01.148105] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-09-29T18:18:01.607694] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-29T18:18:01.626485] [INFO ] [REMOTE ] DHR: Full fetch complete (76880 records). [2025-09-29T18:18:01.631461] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-09-29T18:18:01.631873] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-29T18:18:01.636757] [FATAL] [VALIDATOR ] DHR: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:18:01.637266] [FATAL] [MAIN ] DHR: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:18:01.637366] [WARN ] [MAIN ] DHR: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:18:01.637489] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-09-29T18:18:01.637589] [DEBUG] [LOCAL ] DHR: No primary data file found to delete. [2025-09-29T18:18:01.637683] [INFO ] [LOCAL ] DHR: Starting deletion of derivative data. [2025-09-29T18:18:01.638397] [DEBUG] [LOCAL ] DHR: Deleted derivative data file. [2025-09-29T18:18:01.638515] [INFO ] [MAIN ] Update Progress: 618/2371 symbols completed. DHR took 32.4s. Estimated remaining: 3h 41m 12s. Rate: 7.9 symbols/min [2025-09-29T18:18:01.827564] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:18:01.876732] [DEBUG] [LOCAL ] DIN: Loaded 37823 existing records from primary storage. [2025-09-29T18:18:01.877064] [INFO ] [MAIN ] DIN: Loaded 37823 existing records. [2025-09-29T18:18:01.957049] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-09-29T18:18:02.072326] [WARN ] [MAIN ] DIN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:18:02.072565] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-09-29T18:18:02.072626] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-09-29T18:18:02.073081] [DEBUG] [LOCAL ] DIN: Deleted primary data file. [2025-09-29T18:18:02.073142] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-09-29T18:18:02.465995] [INFO ] [REMOTE ] DIN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:18:02.495729] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-29T18:18:02.602744] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-29T18:18:02.748115] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-09-29T18:18:03.390314] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-29T18:18:03.548131] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-09-29T18:18:04.348152] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-09-29T18:18:04.469664] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-29T18:18:05.005825] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-29T18:18:05.148126] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-09-29T18:18:05.948090] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-09-29T18:18:06.192333] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-29T18:18:06.748101] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-09-29T18:18:07.318210] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-29T18:18:07.548081] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-09-29T18:18:07.738526] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-29T18:18:08.348119] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-09-29T18:18:08.779266] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-29T18:18:08.783032] [INFO ] [REMOTE ] DHX: Full fetch complete (20810 records). [2025-09-29T18:18:08.783144] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-09-29T18:18:09.154714] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-09-29T18:18:09.206012] [DEBUG] [VALIDATOR ] DHX: All expected trading days are present. [2025-09-29T18:18:09.206139] [DEBUG] [VALIDATOR ] DHX: Primary data validation passed. [2025-09-29T18:18:09.206690] [INFO ] [MAIN ] DHX: Fetched primary data is valid. [2025-09-29T18:18:09.206753] [DEBUG] [LOCAL ] DHX: Saving primary data. [2025-09-29T18:18:09.207422] [DEBUG] [LOCAL ] DHX: Trimmed 20810 records to 13104 (keeping 200 days of data) [2025-09-29T18:18:09.290440] [DEBUG] [LOCAL ] DHX: Primary data saved (13104 records). [2025-09-29T18:18:09.290589] [INFO ] [MAIN ] DHX: Full history saved. [2025-09-29T18:18:09.290702] [INFO ] [MAIN ] Update Progress: 619/2371 symbols completed. DHX took 27.1s. Estimated remaining: 3h 41m 4s. Rate: 7.9 symbols/min [2025-09-29T18:18:09.487236] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:18:09.599634] [DEBUG] [LOCAL ] DINO: Loaded 53729 existing records from primary storage. [2025-09-29T18:18:09.600045] [INFO ] [MAIN ] DINO: Loaded 53729 existing records. [2025-09-29T18:18:09.799531] [WARN ] [MAIN ] DINO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:18:09.799765] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-09-29T18:18:09.799817] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-09-29T18:18:09.800180] [DEBUG] [LOCAL ] DINO: Deleted primary data file. [2025-09-29T18:18:09.800238] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-09-29T18:18:09.955858] [INFO ] [REMOTE ] DIN: Fetching primary data for 2024-12. [2025-09-29T18:18:10.138196] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-29T18:18:10.219035] [INFO ] [REMOTE ] DINO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:18:10.247319] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-29T18:18:10.257467] [INFO ] [REMOTE ] DHT: Full fetch complete (70041 records). [2025-09-29T18:18:10.257627] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-09-29T18:18:10.693303] [DEBUG] [VALIDATOR ] DHT: All expected trading days are present. [2025-09-29T18:18:10.693394] [DEBUG] [VALIDATOR ] DHT: Primary data validation passed. [2025-09-29T18:18:10.694394] [INFO ] [MAIN ] DHT: Fetched primary data is valid. [2025-09-29T18:18:10.694463] [DEBUG] [LOCAL ] DHT: Saving primary data. [2025-09-29T18:18:10.695994] [DEBUG] [LOCAL ] DHT: Trimmed 70041 records to 47882 (keeping 200 days of data) [2025-09-29T18:18:10.762029] [INFO ] [REMOTE ] DINO: Fetching primary data for 2024-12. [2025-09-29T18:18:11.021088] [DEBUG] [LOCAL ] DHT: Primary data saved (47882 records). [2025-09-29T18:18:11.021312] [INFO ] [MAIN ] DHT: Full history saved. [2025-09-29T18:18:11.021498] [INFO ] [MAIN ] Update Progress: 620/2371 symbols completed. DHT took 30.9s. Estimated remaining: 3h 40m 40s. Rate: 7.9 symbols/min [2025-09-29T18:18:11.209800] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:18:11.286094] [DEBUG] [LOCAL ] DIS: Loaded 54568 existing records from primary storage. [2025-09-29T18:18:11.286550] [INFO ] [MAIN ] DIS: Loaded 54568 existing records. [2025-09-29T18:18:11.500566] [WARN ] [MAIN ] DIS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:18:11.501011] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-09-29T18:18:11.501071] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-09-29T18:18:11.501627] [DEBUG] [LOCAL ] DIS: Deleted primary data file. [2025-09-29T18:18:11.501729] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-09-29T18:18:11.553331] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-09-29T18:18:11.919847] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-29T18:18:11.951666] [INFO ] [REMOTE ] DIS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:18:12.348131] [INFO ] [REMOTE ] DIS: Fetching primary data for 2024-12. [2025-09-29T18:18:12.468165] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-29T18:18:12.795747] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-29T18:18:13.148162] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-01. [2025-09-29T18:18:13.948138] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-09-29T18:18:14.748126] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-01. [2025-09-29T18:18:14.883901] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-29T18:18:14.939301] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-29T18:18:14.975450] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2024-12 (2.63 seconds). [2025-09-29T18:18:15.548150] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-09-29T18:18:16.343456] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-29T18:18:16.351819] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-09-29T18:18:17.148109] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-09-29T18:18:17.269272] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-29T18:18:17.443381] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-29T18:18:17.948171] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-09-29T18:18:18.570509] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-29T18:18:18.748132] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-01. [2025-09-29T18:18:19.548082] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-09-29T18:18:19.600894] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-29T18:18:20.348140] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-09-29T18:18:20.655807] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-29T18:18:20.659445] [INFO ] [REMOTE ] DIAX: Full fetch complete (17306 records). [2025-09-29T18:18:20.659567] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-09-29T18:18:20.660176] [FATAL] [VALIDATOR ] DIAX: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:18:20.660269] [FATAL] [MAIN ] DIAX: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:18:20.660314] [WARN ] [MAIN ] DIAX: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:18:20.660356] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-09-29T18:18:20.660418] [DEBUG] [LOCAL ] DIAX: No primary data file found to delete. [2025-09-29T18:18:20.660455] [INFO ] [LOCAL ] DIAX: Starting deletion of derivative data. [2025-09-29T18:18:20.660848] [DEBUG] [LOCAL ] DIAX: Deleted derivative data file. [2025-09-29T18:18:20.660947] [INFO ] [MAIN ] Update Progress: 621/2371 symbols completed. DIAX took 26.9s. Estimated remaining: 3h 40m 38s. Rate: 7.9 symbols/min [2025-09-29T18:18:20.842709] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:18:20.843018] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-09-29T18:18:20.843096] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-09-29T18:18:20.843268] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-09-29T18:18:20.843314] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-09-29T18:18:20.843418] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-09-29T18:18:20.843470] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-09-29T18:18:21.151600] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-09-29T18:18:21.269282] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:18:21.301599] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-01 (2.55 seconds). [2025-09-29T18:18:21.948125] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2024-12. [2025-09-29T18:18:22.007559] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-29T18:18:22.407901] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-29T18:18:22.748104] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-09-29T18:18:22.827519] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-29T18:18:23.548121] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-09-29T18:18:24.018261] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-29T18:18:24.348113] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-09-29T18:18:24.791194] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-29T18:18:25.148144] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-09-29T18:18:25.948128] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-09-29T18:18:26.392749] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-29T18:18:26.634237] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-29T18:18:26.748146] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-09-29T18:18:27.054371] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-29T18:18:27.548165] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-09-29T18:18:28.139789] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-29T18:18:28.348125] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-09-29T18:18:28.861453] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-29T18:18:29.148136] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-09-29T18:18:29.264681] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-29T18:18:29.948149] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-09-29T18:18:30.233556] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-09-29T18:18:30.748129] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-09-29T18:18:31.440437] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-09-29T18:18:31.548115] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-09-29T18:18:32.348094] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-09-29T18:18:32.523126] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-29T18:18:32.795529] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-29T18:18:33.148145] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-09-29T18:18:33.493377] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-29T18:18:33.948075] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-09-29T18:18:34.053161] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-09-29T18:18:34.748167] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-09-29T18:18:35.185410] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-29T18:18:35.548152] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-09-29T18:18:35.708757] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-29T18:18:35.942043] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-29T18:18:36.348124] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-09-29T18:18:36.825354] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-29T18:18:36.826248] [INFO ] [REMOTE ] DIVY: Full fetch complete (1717 records). [2025-09-29T18:18:36.826323] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-09-29T18:18:37.030084] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-29T18:18:37.030326] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:18:37.030399] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:18:37.030474] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-09-29T18:18:37.030557] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-09-29T18:18:37.030615] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-09-29T18:18:37.030698] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-09-29T18:18:37.030775] [INFO ] [MAIN ] Update Progress: 622/2371 symbols completed. DIVY took 16.4s. Estimated remaining: 3h 40m 56s. Rate: 7.9 symbols/min [2025-09-29T18:18:37.153262] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-09-29T18:18:37.221597] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:18:37.288755] [DEBUG] [LOCAL ] DK: Loaded 50093 existing records from primary storage. [2025-09-29T18:18:37.289888] [INFO ] [MAIN ] DK: Loaded 50093 existing records. [2025-09-29T18:18:37.482312] [WARN ] [MAIN ] DK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:18:37.482747] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-09-29T18:18:37.482873] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-09-29T18:18:37.484271] [DEBUG] [LOCAL ] DK: Deleted primary data file. [2025-09-29T18:18:37.484367] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-09-29T18:18:37.953812] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-09-29T18:18:37.959888] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:18:38.748117] [INFO ] [REMOTE ] DK: Fetching primary data for 2024-12. [2025-09-29T18:18:39.421216] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-29T18:18:39.432946] [INFO ] [REMOTE ] DINO: Full fetch complete (76686 records). [2025-09-29T18:18:39.433113] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-09-29T18:18:39.553183] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-09-29T18:18:39.852626] [DEBUG] [VALIDATOR ] DINO: All expected trading days are present. [2025-09-29T18:18:39.852756] [DEBUG] [VALIDATOR ] DINO: Primary data validation passed. [2025-09-29T18:18:39.853699] [INFO ] [MAIN ] DINO: Fetched primary data is valid. [2025-09-29T18:18:39.853780] [DEBUG] [LOCAL ] DINO: Saving primary data. [2025-09-29T18:18:39.855855] [DEBUG] [LOCAL ] DINO: Trimmed 76686 records to 52952 (keeping 200 days of data) [2025-09-29T18:18:40.199947] [DEBUG] [LOCAL ] DINO: Primary data saved (52952 records). [2025-09-29T18:18:40.200139] [INFO ] [MAIN ] DINO: Full history saved. [2025-09-29T18:18:40.200324] [INFO ] [MAIN ] Update Progress: 623/2371 symbols completed. DINO took 30.9s. Estimated remaining: 3h 40m 36s. Rate: 7.9 symbols/min [2025-09-29T18:18:40.384622] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:18:40.408940] [DEBUG] [LOCAL ] DKL: Loaded 19229 existing records from primary storage. [2025-09-29T18:18:40.409284] [INFO ] [MAIN ] DKL: Loaded 19229 existing records. [2025-09-29T18:18:40.607140] [WARN ] [MAIN ] DKL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:18:40.607450] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-09-29T18:18:40.607924] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-09-29T18:18:40.608698] [DEBUG] [LOCAL ] DKL: Deleted primary data file. [2025-09-29T18:18:40.609161] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-09-29T18:18:40.726127] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-29T18:18:40.799893] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (2.85 seconds). [2025-09-29T18:18:40.777752] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-09-29T18:18:40.876499] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-29T18:18:41.124576] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:18:41.148076] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-09-29T18:18:41.948114] [INFO ] [REMOTE ] DKL: Fetching primary data for 2024-12. [2025-09-29T18:18:42.374858] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-29T18:18:42.505864] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-29T18:18:42.748124] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-09-29T18:18:43.205384] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-29T18:18:43.548150] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-09-29T18:18:44.282232] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-29T18:18:44.348139] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-09-29T18:18:44.558825] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-29T18:18:45.148161] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-09-29T18:18:45.948121] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-09-29T18:18:46.655066] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-09-29T18:18:46.748637] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-09-29T18:18:46.754813] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-29T18:18:47.081690] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-29T18:18:47.548122] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-09-29T18:18:48.348109] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-09-29T18:18:48.551297] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-29T18:18:48.561708] [INFO ] [REMOTE ] DIN: Full fetch complete (55191 records). [2025-09-29T18:18:48.561896] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-09-29T18:18:49.076914] [DEBUG] [VALIDATOR ] DIN: All expected trading days are present. [2025-09-29T18:18:49.077053] [DEBUG] [VALIDATOR ] DIN: Primary data validation passed. [2025-09-29T18:18:49.077953] [INFO ] [MAIN ] DIN: Fetched primary data is valid. [2025-09-29T18:18:49.078033] [DEBUG] [LOCAL ] DIN: Saving primary data. [2025-09-29T18:18:49.079437] [DEBUG] [LOCAL ] DIN: Trimmed 55191 records to 37181 (keeping 200 days of data) [2025-09-29T18:18:49.172568] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-09-29T18:18:49.322128] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-29T18:18:49.359724] [DEBUG] [LOCAL ] DIN: Primary data saved (37181 records). [2025-09-29T18:18:49.359884] [INFO ] [MAIN ] DIN: Full history saved. [2025-09-29T18:18:49.359974] [INFO ] [MAIN ] Update Progress: 624/2371 symbols completed. DIN took 47.7s. Estimated remaining: 3h 40m 33s. Rate: 7.9 symbols/min [2025-09-29T18:18:49.548935] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:18:49.607754] [DEBUG] [LOCAL ] DKS: Loaded 50579 existing records from primary storage. [2025-09-29T18:18:49.608087] [INFO ] [MAIN ] DKS: Loaded 50579 existing records. [2025-09-29T18:18:49.799923] [WARN ] [MAIN ] DKS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:18:49.800306] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-09-29T18:18:49.800444] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-09-29T18:18:49.801142] [DEBUG] [LOCAL ] DKS: Deleted primary data file. [2025-09-29T18:18:49.801205] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-09-29T18:18:49.958494] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-09-29T18:18:50.228396] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (2.68 seconds). [2025-09-29T18:18:50.234370] [INFO ] [REMOTE ] DKS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:18:50.748128] [INFO ] [REMOTE ] DKS: Fetching primary data for 2024-12. [2025-09-29T18:18:50.808245] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-29T18:18:51.378432] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-29T18:18:51.548118] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-09-29T18:18:52.348124] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-09-29T18:18:52.567338] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-29T18:18:53.022188] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-29T18:18:53.148116] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-01. [2025-09-29T18:18:53.614076] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-29T18:18:53.948142] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-09-29T18:18:54.721421] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-29T18:18:54.748083] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-09-29T18:18:55.548126] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-09-29T18:18:56.092982] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-29T18:18:56.348115] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-09-29T18:18:56.505569] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-29T18:18:56.598880] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-29T18:18:57.148107] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-09-29T18:18:57.948110] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-09-29T18:18:58.748112] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-09-29T18:18:58.837498] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-29T18:18:58.885282] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-29T18:18:58.983910] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (2.64 seconds). [2025-09-29T18:18:58.995919] [INFO ] [REMOTE ] DIS: Full fetch complete (77944 records). [2025-09-29T18:18:58.996125] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-09-29T18:18:59.414056] [DEBUG] [VALIDATOR ] DIS: All expected trading days are present. [2025-09-29T18:18:59.414156] [DEBUG] [VALIDATOR ] DIS: Primary data validation passed. [2025-09-29T18:18:59.415246] [INFO ] [MAIN ] DIS: Fetched primary data is valid. [2025-09-29T18:18:59.415321] [DEBUG] [LOCAL ] DIS: Saving primary data. [2025-09-29T18:18:59.416977] [DEBUG] [LOCAL ] DIS: Trimmed 77944 records to 53788 (keeping 200 days of data) [2025-09-29T18:18:59.548989] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-09-29T18:18:59.787790] [DEBUG] [LOCAL ] DIS: Primary data saved (53788 records). [2025-09-29T18:18:59.787960] [INFO ] [MAIN ] DIS: Full history saved. [2025-09-29T18:18:59.788096] [INFO ] [MAIN ] Update Progress: 625/2371 symbols completed. DIS took 48.8s. Estimated remaining: 3h 40m 33s. Rate: 7.9 symbols/min [2025-09-29T18:18:59.974099] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:19:00.007825] [DEBUG] [LOCAL ] DLB: Loaded 32601 existing records from primary storage. [2025-09-29T18:19:00.008127] [INFO ] [MAIN ] DLB: Loaded 32601 existing records. [2025-09-29T18:19:00.208602] [WARN ] [MAIN ] DLB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:19:00.208913] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-09-29T18:19:00.208972] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-09-29T18:19:00.209537] [DEBUG] [LOCAL ] DLB: Deleted primary data file. [2025-09-29T18:19:00.209599] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-09-29T18:19:00.364582] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-09-29T18:19:00.577730] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-29T18:19:00.649318] [INFO ] [REMOTE ] DLB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:19:00.690077] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-29T18:19:01.148109] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-09-29T18:19:01.948084] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-09-29T18:19:02.200151] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-29T18:19:02.748095] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-09-29T18:19:03.041967] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-29T18:19:03.046957] [INFO ] [REMOTE ] DKL: Full fetch complete (28971 records). [2025-09-29T18:19:03.047106] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-09-29T18:19:03.385729] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-29T18:19:03.516725] [DEBUG] [VALIDATOR ] DKL: All expected trading days are present. [2025-09-29T18:19:03.516818] [DEBUG] [VALIDATOR ] DKL: Primary data validation passed. [2025-09-29T18:19:03.517421] [INFO ] [MAIN ] DKL: Fetched primary data is valid. [2025-09-29T18:19:03.517510] [DEBUG] [LOCAL ] DKL: Saving primary data. [2025-09-29T18:19:03.518499] [DEBUG] [LOCAL ] DKL: Trimmed 28971 records to 18836 (keeping 200 days of data) [2025-09-29T18:19:03.568095] [INFO ] [REMOTE ] DLB: Fetching primary data for 2024-12. [2025-09-29T18:19:03.639395] [DEBUG] [LOCAL ] DKL: Primary data saved (18836 records). [2025-09-29T18:19:03.639561] [INFO ] [MAIN ] DKL: Full history saved. [2025-09-29T18:19:03.639692] [INFO ] [MAIN ] Update Progress: 626/2371 symbols completed. DKL took 23.4s. Estimated remaining: 3h 40m 15s. Rate: 7.9 symbols/min [2025-09-29T18:19:03.825747] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:19:03.833747] [DEBUG] [LOCAL ] DLNG: Loaded 6276 existing records from primary storage. [2025-09-29T18:19:03.834023] [INFO ] [MAIN ] DLNG: Loaded 6276 existing records. [2025-09-29T18:19:04.021301] [WARN ] [MAIN ] DLNG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:19:04.021513] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-09-29T18:19:04.021560] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-09-29T18:19:04.021892] [DEBUG] [LOCAL ] DLNG: Deleted primary data file. [2025-09-29T18:19:04.021951] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-09-29T18:19:04.357902] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-09-29T18:19:04.405722] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:19:04.577531] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-29T18:19:05.051254] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-29T18:19:05.148155] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2024-12. [2025-09-29T18:19:05.948197] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-01. [2025-09-29T18:19:06.021783] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-29T18:19:06.045464] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-29T18:19:06.748171] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-09-29T18:19:07.350590] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-29T18:19:07.548089] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-09-29T18:19:07.757399] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-29T18:19:08.348160] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-09-29T18:19:08.635471] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-29T18:19:09.148169] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-09-29T18:19:09.948105] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-09-29T18:19:10.295704] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-29T18:19:10.307087] [INFO ] [REMOTE ] DK: Full fetch complete (70734 records). [2025-09-29T18:19:10.307248] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-09-29T18:19:10.742102] [DEBUG] [VALIDATOR ] DK: All expected trading days are present. [2025-09-29T18:19:10.754216] [DEBUG] [VALIDATOR ] DK: Primary data validation passed. [2025-09-29T18:19:10.753824] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-09-29T18:19:10.755603] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-29T18:19:10.757701] [INFO ] [MAIN ] DK: Fetched primary data is valid. [2025-09-29T18:19:10.761796] [DEBUG] [LOCAL ] DK: Saving primary data. [2025-09-29T18:19:10.787577] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-29T18:19:10.786488] [DEBUG] [LOCAL ] DK: Trimmed 70734 records to 49324 (keeping 200 days of data) [2025-09-29T18:19:11.110446] [DEBUG] [LOCAL ] DK: Primary data saved (49324 records). [2025-09-29T18:19:11.110604] [INFO ] [MAIN ] DK: Full history saved. [2025-09-29T18:19:11.110729] [INFO ] [MAIN ] Update Progress: 627/2371 symbols completed. DK took 34.1s. Estimated remaining: 3h 40m 7s. Rate: 7.9 symbols/min [2025-09-29T18:19:11.295104] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:19:11.355149] [DEBUG] [LOCAL ] DLR: Loaded 51825 existing records from primary storage. [2025-09-29T18:19:11.355483] [INFO ] [MAIN ] DLR: Loaded 51825 existing records. [2025-09-29T18:19:11.542146] [WARN ] [MAIN ] DLR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:19:11.542428] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-09-29T18:19:11.542484] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-09-29T18:19:11.542976] [DEBUG] [LOCAL ] DLR: Deleted primary data file. [2025-09-29T18:19:11.543036] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-09-29T18:19:11.555285] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-09-29T18:19:11.936943] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:19:12.317751] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-29T18:19:12.348098] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-09-29T18:19:12.557626] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-29T18:19:13.015754] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-29T18:19:13.148161] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-09-29T18:19:13.894596] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-29T18:19:13.948160] [INFO ] [REMOTE ] DLR: Fetching primary data for 2024-12. [2025-09-29T18:19:14.748145] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-09-29T18:19:15.548090] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-09-29T18:19:15.655013] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-29T18:19:16.348094] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-09-29T18:19:16.665176] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-29T18:19:17.001878] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-29T18:19:17.148114] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-09-29T18:19:17.948123] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-09-29T18:19:18.249797] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-29T18:19:18.480581] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-29T18:19:18.633439] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-29T18:19:18.748133] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-09-29T18:19:19.548146] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-09-29T18:19:20.279726] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-29T18:19:20.348133] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-09-29T18:19:20.824326] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-29T18:19:21.148137] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-09-29T18:19:21.948170] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-09-29T18:19:22.253481] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-29T18:19:22.607858] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-29T18:19:22.748110] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-09-29T18:19:22.987235] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-29T18:19:23.349613] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-29T18:19:23.548109] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-09-29T18:19:24.348124] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-09-29T18:19:24.937943] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-29T18:19:25.148139] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-09-29T18:19:25.154691] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-29T18:19:25.156526] [INFO ] [REMOTE ] DLNG: Full fetch complete (11988 records). [2025-09-29T18:19:25.156611] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-09-29T18:19:25.610361] [DEBUG] [VALIDATOR ] DLNG: All expected trading days are present. [2025-09-29T18:19:25.610459] [DEBUG] [VALIDATOR ] DLNG: Primary data validation passed. [2025-09-29T18:19:25.610857] [INFO ] [MAIN ] DLNG: Fetched primary data is valid. [2025-09-29T18:19:25.610922] [DEBUG] [LOCAL ] DLNG: Saving primary data. [2025-09-29T18:19:25.611486] [DEBUG] [LOCAL ] DLNG: Trimmed 11988 records to 6117 (keeping 200 days of data) [2025-09-29T18:19:25.650464] [DEBUG] [LOCAL ] DLNG: Primary data saved (6117 records). [2025-09-29T18:19:25.650607] [INFO ] [MAIN ] DLNG: Full history saved. [2025-09-29T18:19:25.650724] [INFO ] [MAIN ] Update Progress: 628/2371 symbols completed. DLNG took 22.0s. Estimated remaining: 3h 40m 19s. Rate: 7.9 symbols/min [2025-09-29T18:19:25.842838] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:19:25.880589] [DEBUG] [LOCAL ] DLX: Loaded 29284 existing records from primary storage. [2025-09-29T18:19:25.880939] [INFO ] [MAIN ] DLX: Loaded 29284 existing records. [2025-09-29T18:19:25.957882] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-09-29T18:19:26.078936] [WARN ] [MAIN ] DLX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:19:26.079219] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-09-29T18:19:26.079268] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-09-29T18:19:26.079685] [DEBUG] [LOCAL ] DLX: Deleted primary data file. [2025-09-29T18:19:26.079750] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-09-29T18:19:26.491778] [INFO ] [REMOTE ] DLX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:19:26.748169] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-09-29T18:19:27.092758] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-29T18:19:27.415981] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-29T18:19:27.548138] [INFO ] [REMOTE ] DLX: Fetching primary data for 2024-12. [2025-09-29T18:19:28.350719] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-09-29T18:19:28.463541] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-29T18:19:28.836202] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-29T18:19:29.148152] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-09-29T18:19:29.948166] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-01. [2025-09-29T18:19:30.504163] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-29T18:19:30.515699] [INFO ] [REMOTE ] DKS: Full fetch complete (71570 records). [2025-09-29T18:19:30.515876] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-09-29T18:19:30.758364] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-09-29T18:19:30.948985] [DEBUG] [VALIDATOR ] DKS: All expected trading days are present. [2025-09-29T18:19:30.949098] [DEBUG] [VALIDATOR ] DKS: Primary data validation passed. [2025-09-29T18:19:30.950179] [INFO ] [MAIN ] DKS: Fetched primary data is valid. [2025-09-29T18:19:30.950250] [DEBUG] [LOCAL ] DKS: Saving primary data. [2025-09-29T18:19:30.952120] [DEBUG] [LOCAL ] DKS: Trimmed 71570 records to 49803 (keeping 200 days of data) [2025-09-29T18:19:31.236398] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-29T18:19:31.341811] [DEBUG] [LOCAL ] DKS: Primary data saved (49803 records). [2025-09-29T18:19:31.341997] [INFO ] [MAIN ] DKS: Full history saved. [2025-09-29T18:19:31.342111] [INFO ] [MAIN ] Update Progress: 629/2371 symbols completed. DKS took 42.0s. Estimated remaining: 3h 40m 6s. Rate: 7.9 symbols/min [2025-09-29T18:19:31.540474] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:19:31.554832] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-09-29T18:19:31.594229] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-09-29T18:19:31.628404] [DEBUG] [LOCAL ] DLY: Loaded 19800 existing records from primary storage. [2025-09-29T18:19:31.628950] [INFO ] [MAIN ] DLY: Loaded 19800 existing records. [2025-09-29T18:19:31.843926] [WARN ] [MAIN ] DLY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:19:31.844209] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-09-29T18:19:31.844274] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-09-29T18:19:31.844991] [DEBUG] [LOCAL ] DLY: Deleted primary data file. [2025-09-29T18:19:31.845071] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-09-29T18:19:32.290549] [INFO ] [REMOTE ] DLY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:19:32.312056] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-29T18:19:32.320122] [INFO ] [REMOTE ] DLB: Full fetch complete (46851 records). [2025-09-29T18:19:32.320296] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-09-29T18:19:32.358992] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-09-29T18:19:32.804935] [DEBUG] [VALIDATOR ] DLB: All expected trading days are present. [2025-09-29T18:19:32.805048] [DEBUG] [VALIDATOR ] DLB: Primary data validation passed. [2025-09-29T18:19:32.805860] [INFO ] [MAIN ] DLB: Fetched primary data is valid. [2025-09-29T18:19:32.805936] [DEBUG] [LOCAL ] DLB: Saving primary data. [2025-09-29T18:19:32.807152] [DEBUG] [LOCAL ] DLB: Trimmed 46851 records to 31993 (keeping 200 days of data) [2025-09-29T18:19:33.020117] [DEBUG] [LOCAL ] DLB: Primary data saved (31993 records). [2025-09-29T18:19:33.020259] [INFO ] [MAIN ] DLB: Full history saved. [2025-09-29T18:19:33.020390] [INFO ] [MAIN ] Update Progress: 630/2371 symbols completed. DLB took 33.2s. Estimated remaining: 3h 39m 42s. Rate: 7.9 symbols/min [2025-09-29T18:19:33.153507] [INFO ] [REMOTE ] DLY: Fetching primary data for 2024-12. [2025-09-29T18:19:33.183472] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-29T18:19:33.233399] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:19:33.249577] [DEBUG] [LOCAL ] DMA: Loaded 4604 existing records from primary storage. [2025-09-29T18:19:33.249880] [INFO ] [MAIN ] DMA: Loaded 4604 existing records. [2025-09-29T18:19:33.449822] [WARN ] [MAIN ] DMA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:19:33.450049] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-09-29T18:19:33.450097] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-09-29T18:19:33.450269] [DEBUG] [LOCAL ] DMA: Deleted primary data file. [2025-09-29T18:19:33.450326] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-09-29T18:19:33.849525] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:19:33.948086] [INFO ] [REMOTE ] DMA: Fetching primary data for 2024-12. [2025-09-29T18:19:34.186527] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-29T18:19:34.588822] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-29T18:19:34.639818] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-29T18:19:34.748161] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-09-29T18:19:35.307240] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-29T18:19:35.548136] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-09-29T18:19:36.348127] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-01. [2025-09-29T18:19:36.972675] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-29T18:19:37.148133] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-09-29T18:19:37.319730] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-29T18:19:37.948113] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-09-29T18:19:38.515698] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-29T18:19:38.538760] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-29T18:19:38.748118] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-09-29T18:19:39.548143] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-09-29T18:19:40.226325] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-29T18:19:40.348121] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-09-29T18:19:40.458202] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-29T18:19:41.148125] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-09-29T18:19:41.658382] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-29T18:19:41.948099] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-09-29T18:19:42.142978] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-29T18:19:42.300463] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-29T18:19:42.748140] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-09-29T18:19:43.548126] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-09-29T18:19:44.117471] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-29T18:19:44.348157] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-09-29T18:19:44.972112] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-29T18:19:45.130360] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-29T18:19:45.148132] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-09-29T18:19:45.608634] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-29T18:19:45.948114] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-09-29T18:19:46.748127] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-09-29T18:19:47.170171] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-29T18:19:47.548121] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-09-29T18:19:48.348100] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-09-29T18:19:48.508826] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-29T18:19:48.530474] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-29T18:19:48.939579] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-29T18:19:49.148107] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-09-29T18:19:49.948179] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-09-29T18:19:50.753190] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-09-29T18:19:50.767495] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-29T18:19:50.939811] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-29T18:19:51.548098] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-09-29T18:19:52.348103] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-09-29T18:19:52.804981] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-29T18:19:52.815698] [INFO ] [REMOTE ] DLR: Full fetch complete (74138 records). [2025-09-29T18:19:52.815840] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-09-29T18:19:53.151316] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-09-29T18:19:53.159594] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-29T18:19:53.268025] [DEBUG] [VALIDATOR ] DLR: All expected trading days are present. [2025-09-29T18:19:53.268200] [DEBUG] [VALIDATOR ] DLR: Primary data validation passed. [2025-09-29T18:19:53.269252] [INFO ] [MAIN ] DLR: Fetched primary data is valid. [2025-09-29T18:19:53.269418] [DEBUG] [LOCAL ] DLR: Saving primary data. [2025-09-29T18:19:53.271250] [DEBUG] [LOCAL ] DLR: Trimmed 74138 records to 51011 (keeping 200 days of data) [2025-09-29T18:19:53.399807] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-29T18:19:53.662111] [DEBUG] [LOCAL ] DLR: Primary data saved (51011 records). [2025-09-29T18:19:53.662471] [INFO ] [MAIN ] DLR: Full history saved. [2025-09-29T18:19:53.662662] [INFO ] [MAIN ] Update Progress: 631/2371 symbols completed. DLR took 42.6s. Estimated remaining: 3h 40m 11s. Rate: 7.9 symbols/min [2025-09-29T18:19:53.849447] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-29T18:19:53.870908] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:19:53.887474] [DEBUG] [LOCAL ] DMB: Loaded 10254 existing records from primary storage. [2025-09-29T18:19:53.887747] [INFO ] [MAIN ] DMB: Loaded 10254 existing records. [2025-09-29T18:19:53.953297] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-09-29T18:19:54.081137] [WARN ] [MAIN ] DMB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:19:54.081398] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-09-29T18:19:54.081451] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-09-29T18:19:54.081766] [DEBUG] [LOCAL ] DMB: Deleted primary data file. [2025-09-29T18:19:54.081827] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-09-29T18:19:54.457373] [INFO ] [REMOTE ] DMB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:19:54.711143] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-29T18:19:54.712876] [INFO ] [REMOTE ] DMA: Full fetch complete (6623 records). [2025-09-29T18:19:54.712948] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-09-29T18:19:54.753875] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-09-29T18:19:55.096585] [DEBUG] [VALIDATOR ] DMA: All expected trading days are present. [2025-09-29T18:19:55.096699] [DEBUG] [VALIDATOR ] DMA: Primary data validation passed. [2025-09-29T18:19:55.096890] [INFO ] [MAIN ] DMA: Fetched primary data is valid. [2025-09-29T18:19:55.096931] [DEBUG] [LOCAL ] DMA: Saving primary data. [2025-09-29T18:19:55.097347] [DEBUG] [LOCAL ] DMA: Trimmed 6623 records to 4526 (keeping 200 days of data) [2025-09-29T18:19:55.125855] [DEBUG] [LOCAL ] DMA: Primary data saved (4526 records). [2025-09-29T18:19:55.125968] [INFO ] [MAIN ] DMA: Full history saved. [2025-09-29T18:19:55.126061] [INFO ] [MAIN ] Update Progress: 632/2371 symbols completed. DMA took 22.1s. Estimated remaining: 3h 39m 46s. Rate: 7.9 symbols/min [2025-09-29T18:19:55.307948] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:19:55.321926] [DEBUG] [LOCAL ] DMO: Loaded 9981 existing records from primary storage. [2025-09-29T18:19:55.322161] [INFO ] [MAIN ] DMO: Loaded 9981 existing records. [2025-09-29T18:19:55.505682] [WARN ] [MAIN ] DMO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:19:55.505959] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-09-29T18:19:55.506016] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-09-29T18:19:55.506561] [DEBUG] [LOCAL ] DMO: Deleted primary data file. [2025-09-29T18:19:55.506621] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-09-29T18:19:55.553205] [INFO ] [REMOTE ] DMB: Fetching primary data for 2024-12. [2025-09-29T18:19:55.889660] [INFO ] [REMOTE ] DMO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:19:56.103222] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-29T18:19:56.108822] [INFO ] [REMOTE ] DLX: Full fetch complete (41366 records). [2025-09-29T18:19:56.108922] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-09-29T18:19:56.353275] [INFO ] [REMOTE ] DMO: Fetching primary data for 2024-12. [2025-09-29T18:19:56.431353] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-29T18:19:56.526363] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-09-29T18:19:56.526454] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-09-29T18:19:56.527190] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-09-29T18:19:56.527256] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-09-29T18:19:56.528444] [DEBUG] [LOCAL ] DLX: Trimmed 41366 records to 28625 (keeping 200 days of data) [2025-09-29T18:19:56.708463] [DEBUG] [LOCAL ] DLX: Primary data saved (28625 records). [2025-09-29T18:19:56.708589] [INFO ] [MAIN ] DLX: Full history saved. [2025-09-29T18:19:56.708698] [INFO ] [MAIN ] Update Progress: 633/2371 symbols completed. DLX took 31.1s. Estimated remaining: 3h 39m 22s. Rate: 7.9 symbols/min [2025-09-29T18:19:56.882827] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:19:56.934571] [DEBUG] [LOCAL ] DNA: Loaded 48990 existing records from primary storage. [2025-09-29T18:19:56.934948] [INFO ] [MAIN ] DNA: Loaded 48990 existing records. [2025-09-29T18:19:57.121288] [WARN ] [MAIN ] DNA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:19:57.121606] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-09-29T18:19:57.121755] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-09-29T18:19:57.122334] [DEBUG] [LOCAL ] DNA: Deleted primary data file. [2025-09-29T18:19:57.122397] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-09-29T18:19:57.155530] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-09-29T18:19:57.309048] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-29T18:19:57.547639] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:19:57.948111] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-01. [2025-09-29T18:19:58.333573] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-29T18:19:58.732387] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-29T18:19:58.748081] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-09-29T18:19:59.494466] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-29T18:19:59.548086] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-09-29T18:20:00.348141] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-01. [2025-09-29T18:20:00.368968] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-29T18:20:01.148167] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-09-29T18:20:01.248992] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-29T18:20:01.948126] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-09-29T18:20:02.028485] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-29T18:20:02.654556] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-29T18:20:02.748162] [INFO ] [REMOTE ] DNA: Fetching primary data for 2024-12. [2025-09-29T18:20:03.548120] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-09-29T18:20:04.348111] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-09-29T18:20:04.425027] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-29T18:20:04.693832] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-29T18:20:05.148179] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-09-29T18:20:05.640968] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-29T18:20:05.647312] [INFO ] [REMOTE ] DLY: Full fetch complete (28234 records). [2025-09-29T18:20:05.647487] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-09-29T18:20:05.786345] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-29T18:20:05.955496] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-09-29T18:20:06.166250] [DEBUG] [VALIDATOR ] DLY: All expected trading days are present. [2025-09-29T18:20:06.166331] [DEBUG] [VALIDATOR ] DLY: Primary data validation passed. [2025-09-29T18:20:06.166955] [INFO ] [MAIN ] DLY: Fetched primary data is valid. [2025-09-29T18:20:06.167020] [DEBUG] [LOCAL ] DLY: Saving primary data. [2025-09-29T18:20:06.167792] [DEBUG] [LOCAL ] DLY: Trimmed 28234 records to 19652 (keeping 200 days of data) [2025-09-29T18:20:06.297380] [DEBUG] [LOCAL ] DLY: Primary data saved (19652 records). [2025-09-29T18:20:06.297550] [INFO ] [MAIN ] DLY: Full history saved. [2025-09-29T18:20:06.297710] [INFO ] [MAIN ] Update Progress: 634/2371 symbols completed. DLY took 35.0s. Estimated remaining: 3h 39m 20s. Rate: 7.9 symbols/min [2025-09-29T18:20:06.481797] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:20:06.534730] [DEBUG] [LOCAL ] DNOW: Loaded 44205 existing records from primary storage. [2025-09-29T18:20:06.535272] [INFO ] [MAIN ] DNOW: Loaded 44205 existing records. [2025-09-29T18:20:06.748662] [WARN ] [MAIN ] DNOW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:20:06.748851] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-09-29T18:20:06.750275] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-09-29T18:20:06.750363] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-09-29T18:20:06.750755] [DEBUG] [LOCAL ] DNOW: Deleted primary data file. [2025-09-29T18:20:06.750818] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-09-29T18:20:07.123487] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:20:07.548087] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2024-12. [2025-09-29T18:20:07.826536] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-29T18:20:08.100580] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-29T18:20:08.348093] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-09-29T18:20:08.947043] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-29T18:20:09.148174] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-09-29T18:20:09.958839] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-09-29T18:20:09.979527] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-29T18:20:10.163278] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-29T18:20:10.748124] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-09-29T18:20:10.874485] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-29T18:20:11.548081] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-09-29T18:20:11.550255] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-29T18:20:12.247149] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-29T18:20:12.348143] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-09-29T18:20:13.134266] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-29T18:20:13.148114] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-09-29T18:20:13.948182] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-01. [2025-09-29T18:20:13.994795] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-29T18:20:14.748124] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-09-29T18:20:15.404420] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-29T18:20:15.548151] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-09-29T18:20:16.348154] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-09-29T18:20:16.516620] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-29T18:20:16.520332] [INFO ] [REMOTE ] DMO: Full fetch complete (14540 records). [2025-09-29T18:20:16.520437] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-09-29T18:20:16.521283] [FATAL] [VALIDATOR ] DMO: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:20:16.521372] [FATAL] [MAIN ] DMO: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:20:16.521417] [WARN ] [MAIN ] DMO: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:20:16.521457] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-09-29T18:20:16.521516] [DEBUG] [LOCAL ] DMO: No primary data file found to delete. [2025-09-29T18:20:16.521557] [INFO ] [LOCAL ] DMO: Starting deletion of derivative data. [2025-09-29T18:20:16.522160] [DEBUG] [LOCAL ] DMO: Deleted derivative data file. [2025-09-29T18:20:16.522269] [INFO ] [MAIN ] Update Progress: 635/2371 symbols completed. DMO took 21.4s. Estimated remaining: 3h 39m 20s. Rate: 7.9 symbols/min [2025-09-29T18:20:16.732243] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:20:16.766975] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-29T18:20:16.814559] [DEBUG] [LOCAL ] DNP: Loaded 33786 existing records from primary storage. [2025-09-29T18:20:16.814915] [INFO ] [MAIN ] DNP: Loaded 33786 existing records. [2025-09-29T18:20:17.006394] [WARN ] [MAIN ] DNP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:20:17.006633] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-09-29T18:20:17.006726] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-09-29T18:20:17.007079] [DEBUG] [LOCAL ] DNP: Deleted primary data file. [2025-09-29T18:20:17.007145] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-09-29T18:20:17.158857] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-09-29T18:20:17.294147] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-29T18:20:17.404857] [INFO ] [REMOTE ] DNP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:20:17.948107] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-09-29T18:20:18.729457] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-29T18:20:18.748076] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-09-29T18:20:18.980208] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-29T18:20:18.985525] [INFO ] [REMOTE ] DMB: Full fetch complete (15081 records). [2025-09-29T18:20:18.985712] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-09-29T18:20:19.386039] [DEBUG] [VALIDATOR ] DMB: All expected trading days are present. [2025-09-29T18:20:19.386124] [DEBUG] [VALIDATOR ] DMB: Primary data validation passed. [2025-09-29T18:20:19.386502] [INFO ] [MAIN ] DMB: Fetched primary data is valid. [2025-09-29T18:20:19.386543] [DEBUG] [LOCAL ] DMB: Saving primary data. [2025-09-29T18:20:19.387161] [DEBUG] [LOCAL ] DMB: Trimmed 15081 records to 10202 (keeping 200 days of data) [2025-09-29T18:20:19.466696] [DEBUG] [LOCAL ] DMB: Primary data saved (10202 records). [2025-09-29T18:20:19.466859] [INFO ] [MAIN ] DMB: Full history saved. [2025-09-29T18:20:19.466976] [INFO ] [MAIN ] Update Progress: 636/2371 symbols completed. DMB took 25.8s. Estimated remaining: 3h 38m 59s. Rate: 7.9 symbols/min [2025-09-29T18:20:19.553388] [INFO ] [REMOTE ] DNP: Fetching primary data for 2024-12. [2025-09-29T18:20:19.668029] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:20:19.746109] [DEBUG] [LOCAL ] DOC: Loaded 54317 existing records from primary storage. [2025-09-29T18:20:19.746480] [INFO ] [MAIN ] DOC: Loaded 54317 existing records. [2025-09-29T18:20:19.947301] [WARN ] [MAIN ] DOC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:20:19.947570] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-09-29T18:20:19.947677] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-09-29T18:20:19.948365] [DEBUG] [LOCAL ] DOC: Deleted primary data file. [2025-09-29T18:20:19.948427] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-09-29T18:20:20.337749] [INFO ] [REMOTE ] DOC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:20:20.353210] [INFO ] [REMOTE ] DOC: Fetching primary data for 2024-12. [2025-09-29T18:20:20.374588] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-29T18:20:21.148103] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-09-29T18:20:21.201362] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-29T18:20:21.948184] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-01. [2025-09-29T18:20:22.295715] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-29T18:20:22.592720] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-29T18:20:22.748170] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-01. [2025-09-29T18:20:23.458634] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-29T18:20:23.548159] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-09-29T18:20:24.348121] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-09-29T18:20:24.504244] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-29T18:20:24.937816] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-29T18:20:25.148121] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-09-29T18:20:25.953251] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-09-29T18:20:25.972804] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-29T18:20:26.748169] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-09-29T18:20:26.809557] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-29T18:20:27.318097] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-29T18:20:27.548129] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-09-29T18:20:28.041113] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-29T18:20:28.348143] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-09-29T18:20:29.148168] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-09-29T18:20:29.513973] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-29T18:20:29.948134] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-09-29T18:20:30.258907] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-29T18:20:30.483861] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-29T18:20:30.748120] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-09-29T18:20:31.548267] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-09-29T18:20:31.835016] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-29T18:20:32.348153] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-09-29T18:20:32.929950] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-29T18:20:33.148085] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-09-29T18:20:33.409541] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-29T18:20:33.874473] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-29T18:20:33.948134] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-09-29T18:20:34.748141] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-09-29T18:20:35.398712] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-29T18:20:35.548142] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-09-29T18:20:35.759819] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-29T18:20:35.963999] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-29T18:20:36.348111] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-09-29T18:20:37.148093] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-09-29T18:20:37.594229] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-29T18:20:37.948174] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-09-29T18:20:38.184965] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-29T18:20:38.219435] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-29T18:20:38.748134] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-09-29T18:20:39.548119] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-09-29T18:20:39.685061] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-29T18:20:40.348143] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-09-29T18:20:40.758228] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-29T18:20:40.963263] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-29T18:20:41.148379] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-09-29T18:20:41.522867] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-29T18:20:41.948130] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-09-29T18:20:42.748120] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-09-29T18:20:43.076349] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-29T18:20:43.524908] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-29T18:20:43.531968] [INFO ] [REMOTE ] DNP: Full fetch complete (49419 records). [2025-09-29T18:20:43.532139] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-09-29T18:20:43.554528] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-09-29T18:20:43.960495] [DEBUG] [VALIDATOR ] DNP: All expected trading days are present. [2025-09-29T18:20:43.960584] [DEBUG] [VALIDATOR ] DNP: Primary data validation passed. [2025-09-29T18:20:43.961675] [INFO ] [MAIN ] DNP: Fetched primary data is valid. [2025-09-29T18:20:43.961742] [DEBUG] [LOCAL ] DNP: Saving primary data. [2025-09-29T18:20:43.963831] [DEBUG] [LOCAL ] DNP: Trimmed 49419 records to 33167 (keeping 200 days of data) [2025-09-29T18:20:44.180304] [DEBUG] [LOCAL ] DNP: Primary data saved (33167 records). [2025-09-29T18:20:44.180480] [INFO ] [MAIN ] DNP: Full history saved. [2025-09-29T18:20:44.180580] [INFO ] [MAIN ] Update Progress: 637/2371 symbols completed. DNP took 27.7s. Estimated remaining: 3h 39m 39s. Rate: 7.9 symbols/min [2025-09-29T18:20:44.348177] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-09-29T18:20:44.898481] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-29T18:20:44.908372] [INFO ] [REMOTE ] DNA: Full fetch complete (70849 records). [2025-09-29T18:20:44.908530] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-09-29T18:20:45.356238] [DEBUG] [VALIDATOR ] DNA: All expected trading days are present. [2025-09-29T18:20:45.356332] [DEBUG] [VALIDATOR ] DNA: Primary data validation passed. [2025-09-29T18:20:45.357479] [INFO ] [MAIN ] DNA: Fetched primary data is valid. [2025-09-29T18:20:45.357564] [DEBUG] [LOCAL ] DNA: Saving primary data. [2025-09-29T18:20:45.359302] [DEBUG] [LOCAL ] DNA: Trimmed 70849 records to 48248 (keeping 200 days of data) [2025-09-29T18:20:45.497668] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-29T18:20:45.513069] [INFO ] [REMOTE ] DNOW: Full fetch complete (62763 records). [2025-09-29T18:20:45.514155] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-09-29T18:20:46.070900] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present. [2025-09-29T18:20:46.071820] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed. [2025-09-29T18:20:46.075868] [INFO ] [MAIN ] DNOW: Fetched primary data is valid. [2025-09-29T18:20:46.077098] [DEBUG] [LOCAL ] DNOW: Saving primary data. [2025-09-29T18:20:46.080501] [DEBUG] [LOCAL ] DNOW: Trimmed 62763 records to 43639 (keeping 200 days of data) [2025-09-29T18:20:46.276054] [DEBUG] [LOCAL ] DNA: Primary data saved (48248 records). [2025-09-29T18:20:46.276699] [INFO ] [MAIN ] DNA: Full history saved. [2025-09-29T18:20:46.277462] [INFO ] [MAIN ] Update Progress: 638/2371 symbols completed. DNA took 49.6s. Estimated remaining: 3h 39m 16s. Rate: 7.9 symbols/min [2025-09-29T18:20:46.436034] [DEBUG] [LOCAL ] DNOW: Primary data saved (43639 records). [2025-09-29T18:20:46.436169] [INFO ] [MAIN ] DNOW: Full history saved. [2025-09-29T18:20:46.436252] [INFO ] [MAIN ] Update Progress: 639/2371 symbols completed. DNOW took 40.1s. Estimated remaining: 3h 38m 48s. Rate: 7.9 symbols/min [2025-09-29T18:20:46.471890] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-29T18:20:46.483409] [INFO ] [REMOTE ] DOC: Full fetch complete (77389 records). [2025-09-29T18:20:46.483556] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-09-29T18:20:46.954805] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-09-29T18:20:46.954991] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-09-29T18:20:46.956044] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-09-29T18:20:46.956110] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-09-29T18:20:46.957615] [DEBUG] [LOCAL ] DOC: Trimmed 77389 records to 53542 (keeping 200 days of data) [2025-09-29T18:20:47.322693] [DEBUG] [LOCAL ] DOC: Primary data saved (53542 records). [2025-09-29T18:20:47.322832] [INFO ] [MAIN ] DOC: Full history saved. [2025-09-29T18:20:47.322915] [INFO ] [MAIN ] Update Progress: 640/2371 symbols completed. DOC took 27.9s. Estimated remaining: 3h 38m 23s. Rate: 7.9 symbols/min [2025-09-29T18:20:48.077990] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:20:48.098328] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:20:48.167966] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:20:48.169881] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:20:48.252480] [DEBUG] [LOCAL ] DOUG: Loaded 35254 existing records from primary storage. [2025-09-29T18:20:48.253061] [INFO ] [MAIN ] DOUG: Loaded 35254 existing records. [2025-09-29T18:20:48.385843] [DEBUG] [LOCAL ] DOCS: Loaded 51956 existing records from primary storage. [2025-09-29T18:20:48.365482] [DEBUG] [LOCAL ] DOLE: Loaded 38568 existing records from primary storage. [2025-09-29T18:20:48.408129] [INFO ] [MAIN ] DOCS: Loaded 51956 existing records. [2025-09-29T18:20:48.407571] [INFO ] [MAIN ] DOLE: Loaded 38568 existing records. [2025-09-29T18:20:48.700933] [DEBUG] [LOCAL ] DOCN: Loaded 51245 existing records from primary storage. [2025-09-29T18:20:48.748743] [INFO ] [MAIN ] DOCN: Loaded 51245 existing records. [2025-09-29T18:20:48.844800] [WARN ] [MAIN ] DOUG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:20:48.952294] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-09-29T18:20:48.984659] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-09-29T18:20:49.071809] [WARN ] [MAIN ] DOCS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:20:49.101035] [DEBUG] [LOCAL ] DOUG: Deleted primary data file. [2025-09-29T18:20:49.101938] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-09-29T18:20:49.113583] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-09-29T18:20:49.161021] [WARN ] [MAIN ] DOLE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:20:49.210485] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-09-29T18:20:49.214218] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-09-29T18:20:49.224719] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-09-29T18:20:49.251831] [DEBUG] [LOCAL ] DOLE: Deleted primary data file. [2025-09-29T18:20:49.255559] [DEBUG] [LOCAL ] DOCS: Deleted primary data file. [2025-09-29T18:20:49.255513] [WARN ] [MAIN ] DOCN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:20:49.287321] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-09-29T18:20:49.296256] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-09-29T18:20:49.266047] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-09-29T18:20:49.287076] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-09-29T18:20:49.314128] [DEBUG] [LOCAL ] DOCN: Deleted primary data file. [2025-09-29T18:20:49.334680] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-09-29T18:20:50.528920] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:20:50.571858] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2024-12. [2025-09-29T18:20:50.769031] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:20:50.780974] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2024-12. [2025-09-29T18:20:50.838506] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:20:50.873991] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2024-12. [2025-09-29T18:20:50.915632] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:20:50.916016] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2024-12. [2025-09-29T18:20:52.191387] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-29T18:20:52.200467] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-09-29T18:20:52.419209] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-29T18:20:52.426381] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-01. [2025-09-29T18:20:52.564804] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-29T18:20:52.575143] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-01. [2025-09-29T18:20:52.707999] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-29T18:20:52.723311] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-01. [2025-09-29T18:20:53.540430] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-29T18:20:53.548636] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-09-29T18:20:53.603788] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-29T18:20:53.611618] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-09-29T18:20:54.153194] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-29T18:20:54.164105] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-09-29T18:20:54.402382] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-29T18:20:54.413344] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-09-29T18:20:54.557149] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-29T18:20:54.584615] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-29T18:20:54.748103] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-09-29T18:20:55.548124] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-09-29T18:20:55.812975] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-29T18:20:55.889528] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-29T18:20:55.980520] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-29T18:20:56.348109] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-09-29T18:20:57.003818] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-29T18:20:57.148107] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-09-29T18:20:57.948156] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-09-29T18:20:58.106659] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-29T18:20:58.753373] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-09-29T18:20:58.768369] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-29T18:20:59.553212] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-09-29T18:20:59.571290] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-29T18:21:00.101109] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-29T18:21:00.348170] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-09-29T18:21:01.148128] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-09-29T18:21:01.416183] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-29T18:21:01.948160] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-09-29T18:21:02.104800] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-29T18:21:02.748545] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-09-29T18:21:02.754101] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-29T18:21:03.548109] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-09-29T18:21:03.897798] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-29T18:21:04.348135] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-09-29T18:21:04.408499] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-29T18:21:04.980752] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-29T18:21:05.148165] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-09-29T18:21:05.948157] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-09-29T18:21:06.222470] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-29T18:21:06.489988] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-29T18:21:06.748128] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-09-29T18:21:07.548145] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-09-29T18:21:07.677939] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-29T18:21:08.348077] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-09-29T18:21:08.564524] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-29T18:21:09.148164] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-09-29T18:21:09.219708] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-29T18:21:09.800214] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-29T18:21:09.948309] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-09-29T18:21:10.564320] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-29T18:21:10.748171] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-09-29T18:21:11.393579] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-29T18:21:11.548178] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-09-29T18:21:12.348138] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-09-29T18:21:12.558137] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-29T18:21:13.148173] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-09-29T18:21:13.379068] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-29T18:21:13.423599] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-29T18:21:13.948179] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-09-29T18:21:14.748193] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-09-29T18:21:15.073055] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-29T18:21:15.093037] [INFO ] [REMOTE ] DOLE: Full fetch complete (53568 records). [2025-09-29T18:21:15.093328] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-09-29T18:21:15.535607] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-29T18:21:15.552322] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-09-29T18:21:15.609000] [INFO ] [REMOTE ] DOUG: Full fetch complete (51352 records). [2025-09-29T18:21:15.614262] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-09-29T18:21:15.820220] [DEBUG] [VALIDATOR ] DOLE: All expected trading days are present. [2025-09-29T18:21:15.844263] [DEBUG] [VALIDATOR ] DOLE: Primary data validation passed. [2025-09-29T18:21:15.848581] [INFO ] [MAIN ] DOLE: Fetched primary data is valid. [2025-09-29T18:21:15.848729] [DEBUG] [LOCAL ] DOLE: Saving primary data. [2025-09-29T18:21:15.899566] [DEBUG] [LOCAL ] DOLE: Trimmed 53568 records to 38140 (keeping 200 days of data) [2025-09-29T18:21:16.278979] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-09-29T18:21:16.279390] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-09-29T18:21:16.280316] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-09-29T18:21:16.280415] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-09-29T18:21:16.284725] [DEBUG] [LOCAL ] DOUG: Trimmed 51352 records to 34627 (keeping 200 days of data) [2025-09-29T18:21:16.626060] [DEBUG] [LOCAL ] DOUG: Primary data saved (34627 records). [2025-09-29T18:21:16.630364] [INFO ] [MAIN ] DOUG: Full history saved. [2025-09-29T18:21:16.630509] [INFO ] [MAIN ] Update Progress: 641/2371 symbols completed. DOUG took 29.3s. Estimated remaining: 3h 39m 14s. Rate: 7.9 symbols/min [2025-09-29T18:21:16.795871] [DEBUG] [LOCAL ] DOLE: Primary data saved (38140 records). [2025-09-29T18:21:16.817751] [INFO ] [MAIN ] DOLE: Full history saved. [2025-09-29T18:21:16.823082] [INFO ] [MAIN ] Update Progress: 642/2371 symbols completed. DOLE took 29.5s. Estimated remaining: 3h 38m 46s. Rate: 7.9 symbols/min [2025-09-29T18:21:16.885756] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:21:16.998458] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-29T18:21:17.066878] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-09-29T18:21:17.088561] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:21:17.129360] [DEBUG] [LOCAL ] DOV: Loaded 46376 existing records from primary storage. [2025-09-29T18:21:17.129774] [INFO ] [MAIN ] DOV: Loaded 46376 existing records. [2025-09-29T18:21:17.340878] [WARN ] [MAIN ] DOV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:21:17.357947] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-09-29T18:21:17.359286] [DEBUG] [LOCAL ] DOW: Loaded 54513 existing records from primary storage. [2025-09-29T18:21:17.358163] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-09-29T18:21:17.360018] [INFO ] [MAIN ] DOW: Loaded 54513 existing records. [2025-09-29T18:21:17.371570] [DEBUG] [LOCAL ] DOV: Deleted primary data file. [2025-09-29T18:21:17.393456] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-09-29T18:21:17.695203] [WARN ] [MAIN ] DOW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:21:17.711581] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-09-29T18:21:17.716980] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-09-29T18:21:17.743747] [DEBUG] [LOCAL ] DOW: Deleted primary data file. [2025-09-29T18:21:17.757297] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-09-29T18:21:18.089125] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (2.54 seconds). [2025-09-29T18:21:18.285310] [INFO ] [REMOTE ] DOV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:21:18.248729] [INFO ] [REMOTE ] DOCS: Full fetch complete (73804 records). [2025-09-29T18:21:18.321154] [INFO ] [REMOTE ] DOV: Fetching primary data for 2024-12. [2025-09-29T18:21:18.320873] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-09-29T18:21:18.346392] [FATAL] [VALIDATOR ] DOCS: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:21:18.367514] [FATAL] [MAIN ] DOCS: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:21:18.367670] [WARN ] [MAIN ] DOCS: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:21:18.367735] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-09-29T18:21:18.378611] [DEBUG] [LOCAL ] DOCS: No primary data file found to delete. [2025-09-29T18:21:18.389010] [INFO ] [LOCAL ] DOCS: Starting deletion of derivative data. [2025-09-29T18:21:18.454262] [INFO ] [REMOTE ] DOW: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:21:18.447302] [DEBUG] [LOCAL ] DOCS: Deleted derivative data file. [2025-09-29T18:21:18.454459] [INFO ] [MAIN ] Update Progress: 643/2371 symbols completed. DOCS took 31.1s. Estimated remaining: 3h 38m 23s. Rate: 7.9 symbols/min [2025-09-29T18:21:18.454771] [INFO ] [REMOTE ] DOW: Fetching primary data for 2024-12. [2025-09-29T18:21:18.642429] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:21:18.659859] [DEBUG] [LOCAL ] DPG: Loaded 13683 existing records from primary storage. [2025-09-29T18:21:18.660148] [INFO ] [MAIN ] DPG: Loaded 13683 existing records. [2025-09-29T18:21:18.866079] [WARN ] [MAIN ] DPG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:21:18.866449] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-09-29T18:21:18.866532] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-09-29T18:21:18.867045] [DEBUG] [LOCAL ] DPG: Deleted primary data file. [2025-09-29T18:21:18.867106] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-09-29T18:21:19.343293] [INFO ] [REMOTE ] DPG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:21:19.343991] [INFO ] [REMOTE ] DPG: Fetching primary data for 2024-12. [2025-09-29T18:21:19.378581] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-29T18:21:19.390624] [INFO ] [REMOTE ] DOCN: Full fetch complete (71529 records). [2025-09-29T18:21:19.390846] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-09-29T18:21:19.809196] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-09-29T18:21:19.809290] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-09-29T18:21:19.810195] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-09-29T18:21:19.810301] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-09-29T18:21:19.812110] [DEBUG] [LOCAL ] DOCN: Trimmed 71529 records to 50511 (keeping 200 days of data) [2025-09-29T18:21:20.081622] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-29T18:21:20.092165] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-01. [2025-09-29T18:21:20.164704] [DEBUG] [LOCAL ] DOCN: Primary data saved (50511 records). [2025-09-29T18:21:20.164875] [INFO ] [MAIN ] DOCN: Full history saved. [2025-09-29T18:21:20.164966] [INFO ] [MAIN ] Update Progress: 644/2371 symbols completed. DOCN took 32.8s. Estimated remaining: 3h 37m 59s. Rate: 7.9 symbols/min [2025-09-29T18:21:20.349950] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:21:20.415026] [DEBUG] [LOCAL ] DQ: Loaded 43880 existing records from primary storage. [2025-09-29T18:21:20.415695] [INFO ] [MAIN ] DQ: Loaded 43880 existing records. [2025-09-29T18:21:20.422143] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-29T18:21:20.536485] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-01. [2025-09-29T18:21:20.549257] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-29T18:21:20.660718] [WARN ] [MAIN ] DQ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:21:20.660930] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-09-29T18:21:20.660979] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-09-29T18:21:20.661434] [DEBUG] [LOCAL ] DQ: Deleted primary data file. [2025-09-29T18:21:20.661499] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-09-29T18:21:21.053528] [INFO ] [REMOTE ] DQ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:21:21.143845] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-29T18:21:21.148127] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-09-29T18:21:21.725008] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-29T18:21:21.948150] [INFO ] [REMOTE ] DQ: Fetching primary data for 2024-12. [2025-09-29T18:21:21.998039] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-29T18:21:22.748119] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-09-29T18:21:23.510557] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-29T18:21:23.531098] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-29T18:21:23.548128] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-09-29T18:21:24.348123] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-01. [2025-09-29T18:21:24.488525] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-29T18:21:25.148171] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-09-29T18:21:25.948157] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-01. [2025-09-29T18:21:26.285421] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-29T18:21:26.656857] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-29T18:21:26.748170] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-09-29T18:21:27.189765] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-29T18:21:27.548137] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-09-29T18:21:28.348126] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-09-29T18:21:28.570618] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-29T18:21:29.148176] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-09-29T18:21:29.376801] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-29T18:21:29.948160] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-09-29T18:21:30.016107] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-29T18:21:30.689389] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-29T18:21:30.748116] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-09-29T18:21:31.078074] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-29T18:21:31.548177] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-09-29T18:21:32.348106] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-09-29T18:21:32.516427] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-29T18:21:33.148147] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-09-29T18:21:33.568192] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-29T18:21:33.906854] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-29T18:21:33.948101] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-09-29T18:21:34.748115] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-09-29T18:21:34.909033] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-29T18:21:35.499052] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-29T18:21:35.548111] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-09-29T18:21:36.348166] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-09-29T18:21:36.779134] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-29T18:21:36.981344] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-29T18:21:37.148133] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-09-29T18:21:37.948133] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-09-29T18:21:38.121683] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-29T18:21:38.748186] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-09-29T18:21:38.943839] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-29T18:21:39.316948] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-29T18:21:39.548149] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-09-29T18:21:40.348089] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-09-29T18:21:40.622446] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-29T18:21:41.148108] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-09-29T18:21:41.327598] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-29T18:21:41.424289] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-29T18:21:41.948185] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-09-29T18:21:42.748117] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-09-29T18:21:43.013793] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-29T18:21:43.548115] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-09-29T18:21:44.189766] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-29T18:21:44.348133] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-09-29T18:21:44.637306] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-29T18:21:44.647152] [INFO ] [REMOTE ] DOV: Full fetch complete (65199 records). [2025-09-29T18:21:44.647329] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-09-29T18:21:45.066304] [DEBUG] [VALIDATOR ] DOV: All expected trading days are present. [2025-09-29T18:21:45.066461] [DEBUG] [VALIDATOR ] DOV: Primary data validation passed. [2025-09-29T18:21:45.067549] [INFO ] [MAIN ] DOV: Fetched primary data is valid. [2025-09-29T18:21:45.067744] [DEBUG] [LOCAL ] DOV: Saving primary data. [2025-09-29T18:21:45.069217] [DEBUG] [LOCAL ] DOV: Trimmed 65199 records to 45536 (keeping 200 days of data) [2025-09-29T18:21:45.169917] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-09-29T18:21:45.339709] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-29T18:21:45.433715] [DEBUG] [LOCAL ] DOV: Primary data saved (45536 records). [2025-09-29T18:21:45.435828] [INFO ] [MAIN ] DOV: Full history saved. [2025-09-29T18:21:45.435692] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-29T18:21:45.436040] [INFO ] [MAIN ] Update Progress: 645/2371 symbols completed. DOV took 28.8s. Estimated remaining: 3h 38m 39s. Rate: 7.9 symbols/min [2025-09-29T18:21:45.628892] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:21:45.670732] [DEBUG] [LOCAL ] DRD: Loaded 37397 existing records from primary storage. [2025-09-29T18:21:45.671081] [INFO ] [MAIN ] DRD: Loaded 37397 existing records. [2025-09-29T18:21:45.866727] [WARN ] [MAIN ] DRD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:21:45.867005] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-09-29T18:21:45.867054] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-09-29T18:21:45.867414] [DEBUG] [LOCAL ] DRD: Deleted primary data file. [2025-09-29T18:21:45.867506] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-09-29T18:21:45.953279] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-09-29T18:21:46.246754] [INFO ] [REMOTE ] DRD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:21:46.748133] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-09-29T18:21:46.884402] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-29T18:21:47.355589] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-29T18:21:47.548119] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-09-29T18:21:48.198539] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-29T18:21:48.209133] [INFO ] [REMOTE ] DQ: Full fetch complete (62589 records). [2025-09-29T18:21:48.209295] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-09-29T18:21:48.210033] [FATAL] [VALIDATOR ] DQ: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:21:48.210126] [FATAL] [MAIN ] DQ: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:21:48.210172] [WARN ] [MAIN ] DQ: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:21:48.210215] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-09-29T18:21:48.210276] [DEBUG] [LOCAL ] DQ: No primary data file found to delete. [2025-09-29T18:21:48.210313] [INFO ] [LOCAL ] DQ: Starting deletion of derivative data. [2025-09-29T18:21:48.210712] [DEBUG] [LOCAL ] DQ: Deleted derivative data file. [2025-09-29T18:21:48.210814] [INFO ] [MAIN ] Update Progress: 646/2371 symbols completed. DQ took 28.0s. Estimated remaining: 3h 38m 18s. Rate: 7.9 symbols/min [2025-09-29T18:21:48.353208] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-09-29T18:21:48.418052] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:21:48.467584] [DEBUG] [LOCAL ] DRH: Loaded 51205 existing records from primary storage. [2025-09-29T18:21:48.467989] [INFO ] [MAIN ] DRH: Loaded 51205 existing records. [2025-09-29T18:21:48.568036] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-29T18:21:48.594245] [INFO ] [REMOTE ] DPG: Full fetch complete (19080 records). [2025-09-29T18:21:48.604945] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-09-29T18:21:48.774435] [WARN ] [MAIN ] DRH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:21:48.792053] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-09-29T18:21:48.792193] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-09-29T18:21:48.798006] [DEBUG] [LOCAL ] DRH: Deleted primary data file. [2025-09-29T18:21:48.803222] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-09-29T18:21:49.154887] [INFO ] [REMOTE ] DRD: Fetching primary data for 2024-12. [2025-09-29T18:21:49.354514] [DEBUG] [VALIDATOR ] DPG: All expected trading days are present. [2025-09-29T18:21:49.366930] [DEBUG] [VALIDATOR ] DPG: Primary data validation passed. [2025-09-29T18:21:49.367535] [INFO ] [MAIN ] DPG: Fetched primary data is valid. [2025-09-29T18:21:49.372729] [DEBUG] [LOCAL ] DPG: Saving primary data. [2025-09-29T18:21:49.398056] [DEBUG] [LOCAL ] DPG: Trimmed 19080 records to 13524 (keeping 200 days of data) [2025-09-29T18:21:49.545499] [INFO ] [REMOTE ] DRH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:21:49.604771] [DEBUG] [LOCAL ] DPG: Primary data saved (13524 records). [2025-09-29T18:21:49.604960] [INFO ] [MAIN ] DPG: Full history saved. [2025-09-29T18:21:49.605095] [INFO ] [MAIN ] Update Progress: 647/2371 symbols completed. DPG took 31.2s. Estimated remaining: 3h 37m 54s. Rate: 7.9 symbols/min [2025-09-29T18:21:49.841715] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:21:49.899957] [DEBUG] [LOCAL ] DRI: Loaded 48554 existing records from primary storage. [2025-09-29T18:21:49.900311] [INFO ] [MAIN ] DRI: Loaded 48554 existing records. [2025-09-29T18:21:49.966173] [INFO ] [REMOTE ] DRH: Fetching primary data for 2024-12. [2025-09-29T18:21:50.100867] [WARN ] [MAIN ] DRI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:21:50.101063] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-09-29T18:21:50.101110] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-09-29T18:21:50.101706] [DEBUG] [LOCAL ] DRI: Deleted primary data file. [2025-09-29T18:21:50.101964] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-09-29T18:21:50.543719] [INFO ] [REMOTE ] DRI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:21:50.545289] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-29T18:21:50.588525] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-09-29T18:21:50.599281] [INFO ] [REMOTE ] DOW: Full fetch complete (77401 records). [2025-09-29T18:21:50.599441] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-09-29T18:21:50.600437] [FATAL] [VALIDATOR ] DOW: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:21:50.600533] [FATAL] [MAIN ] DOW: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:21:50.600581] [WARN ] [MAIN ] DOW: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:21:50.600707] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-09-29T18:21:50.600801] [DEBUG] [LOCAL ] DOW: No primary data file found to delete. [2025-09-29T18:21:50.600872] [INFO ] [LOCAL ] DOW: Starting deletion of derivative data. [2025-09-29T18:21:50.601265] [DEBUG] [LOCAL ] DOW: Deleted derivative data file. [2025-09-29T18:21:50.601369] [INFO ] [MAIN ] Update Progress: 648/2371 symbols completed. DOW took 33.8s. Estimated remaining: 3h 37m 29s. Rate: 7.9 symbols/min [2025-09-29T18:21:50.756801] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-01. [2025-09-29T18:21:50.791191] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:21:50.802876] [DEBUG] [LOCAL ] DRLL: Loaded 9737 existing records from primary storage. [2025-09-29T18:21:50.803111] [INFO ] [MAIN ] DRLL: Loaded 9737 existing records. [2025-09-29T18:21:50.992050] [WARN ] [MAIN ] DRLL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:21:50.992287] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-09-29T18:21:50.992357] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-09-29T18:21:50.992669] [DEBUG] [LOCAL ] DRLL: Deleted primary data file. [2025-09-29T18:21:50.992733] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-09-29T18:21:51.413845] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:21:51.548147] [INFO ] [REMOTE ] DRI: Fetching primary data for 2024-12. [2025-09-29T18:21:51.682274] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-29T18:21:51.990229] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-29T18:21:52.348195] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2024-12. [2025-09-29T18:21:53.148133] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-09-29T18:21:53.234001] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-29T18:21:53.260451] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-29T18:21:53.948117] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-01. [2025-09-29T18:21:54.445634] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-29T18:21:54.748198] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-09-29T18:21:55.548110] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-01. [2025-09-29T18:21:55.833234] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-29T18:21:56.337298] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-29T18:21:56.348185] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-09-29T18:21:57.085519] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-29T18:21:57.148125] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-09-29T18:21:57.900735] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-29T18:21:57.948095] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-09-29T18:21:58.265295] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-29T18:21:58.748126] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-09-29T18:21:59.305329] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-29T18:21:59.548135] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-09-29T18:22:00.347710] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-29T18:22:00.351432] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-09-29T18:22:01.148361] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-09-29T18:22:01.154265] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-29T18:22:01.843447] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-29T18:22:01.944306] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-29T18:22:01.955620] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-09-29T18:22:02.748167] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-09-29T18:22:03.548125] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-09-29T18:22:03.686853] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-29T18:22:03.926712] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-29T18:22:04.348290] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-09-29T18:22:05.148113] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-09-29T18:22:05.336112] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-29T18:22:05.948635] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-09-29T18:22:05.948468] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-29T18:22:05.970603] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-29T18:22:06.748157] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-09-29T18:22:07.548132] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-09-29T18:22:07.782935] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-29T18:22:08.348115] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-09-29T18:22:08.571791] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-29T18:22:08.886703] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-29T18:22:09.148137] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-09-29T18:22:09.259458] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-29T18:22:09.948177] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-09-29T18:22:10.748113] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-09-29T18:22:10.848135] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-29T18:22:10.872150] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-29T18:22:11.548207] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-09-29T18:22:12.111222] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-29T18:22:12.348190] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-09-29T18:22:13.003417] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-29T18:22:13.014694] [INFO ] [REMOTE ] DRD: Full fetch complete (49548 records). [2025-09-29T18:22:13.014899] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-09-29T18:22:13.153509] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-09-29T18:22:13.429801] [DEBUG] [VALIDATOR ] DRD: All expected trading days are present. [2025-09-29T18:22:13.429942] [DEBUG] [VALIDATOR ] DRD: Primary data validation passed. [2025-09-29T18:22:13.430753] [INFO ] [MAIN ] DRD: Fetched primary data is valid. [2025-09-29T18:22:13.430851] [DEBUG] [LOCAL ] DRD: Saving primary data. [2025-09-29T18:22:13.432166] [DEBUG] [LOCAL ] DRD: Trimmed 49548 records to 36927 (keeping 200 days of data) [2025-09-29T18:22:13.677244] [DEBUG] [LOCAL ] DRD: Primary data saved (36927 records). [2025-09-29T18:22:13.677414] [INFO ] [MAIN ] DRD: Full history saved. [2025-09-29T18:22:13.677618] [INFO ] [MAIN ] Update Progress: 649/2371 symbols completed. DRD took 28.2s. Estimated remaining: 3h 38m 3s. Rate: 7.9 symbols/min [2025-09-29T18:22:13.870697] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:22:13.906879] [DEBUG] [LOCAL ] DSL: Loaded 28651 existing records from primary storage. [2025-09-29T18:22:13.907222] [INFO ] [MAIN ] DSL: Loaded 28651 existing records. [2025-09-29T18:22:13.955272] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-09-29T18:22:14.110928] [WARN ] [MAIN ] DSL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:22:14.111162] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-09-29T18:22:14.111212] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-09-29T18:22:14.111896] [DEBUG] [LOCAL ] DSL: Deleted primary data file. [2025-09-29T18:22:14.111957] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-09-29T18:22:14.417153] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-29T18:22:14.552121] [INFO ] [REMOTE ] DSL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:22:14.567159] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-09-29T18:22:14.748139] [INFO ] [REMOTE ] DSL: Fetching primary data for 2024-12. [2025-09-29T18:22:15.548204] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-09-29T18:22:15.772296] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-29T18:22:16.151954] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-29T18:22:16.304926] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-29T18:22:16.348095] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-09-29T18:22:17.148212] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-09-29T18:22:17.886736] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-29T18:22:17.948150] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-09-29T18:22:18.478300] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-29T18:22:18.748118] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-09-29T18:22:19.542048] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-29T18:22:19.552727] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-09-29T18:22:20.348170] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-01. [2025-09-29T18:22:20.381819] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-29T18:22:20.424897] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-29T18:22:20.427298] [INFO ] [REMOTE ] DRLL: Full fetch complete (15603 records). [2025-09-29T18:22:20.427399] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-09-29T18:22:20.427923] [FATAL] [VALIDATOR ] DRLL: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:22:20.428010] [FATAL] [MAIN ] DRLL: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:22:20.428056] [WARN ] [MAIN ] DRLL: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:22:20.428099] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-09-29T18:22:20.428191] [DEBUG] [LOCAL ] DRLL: No primary data file found to delete. [2025-09-29T18:22:20.428250] [INFO ] [LOCAL ] DRLL: Starting deletion of derivative data. [2025-09-29T18:22:20.428883] [DEBUG] [LOCAL ] DRLL: Deleted derivative data file. [2025-09-29T18:22:20.428988] [INFO ] [MAIN ] Update Progress: 650/2371 symbols completed. DRLL took 29.8s. Estimated remaining: 3h 37m 53s. Rate: 7.9 symbols/min [2025-09-29T18:22:20.646308] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:22:20.673865] [DEBUG] [LOCAL ] DSM: Loaded 15895 existing records from primary storage. [2025-09-29T18:22:20.674134] [INFO ] [MAIN ] DSM: Loaded 15895 existing records. [2025-09-29T18:22:20.869531] [WARN ] [MAIN ] DSM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:22:20.869829] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-09-29T18:22:20.869931] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-09-29T18:22:20.870226] [DEBUG] [LOCAL ] DSM: Deleted primary data file. [2025-09-29T18:22:20.870288] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-09-29T18:22:21.156835] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-09-29T18:22:21.277213] [INFO ] [REMOTE ] DSM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:22:21.590125] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-29T18:22:21.948136] [INFO ] [REMOTE ] DSM: Fetching primary data for 2024-12. [2025-09-29T18:22:22.748082] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-09-29T18:22:22.984743] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-29T18:22:23.173914] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-29T18:22:23.185812] [INFO ] [REMOTE ] DRH: Full fetch complete (71868 records). [2025-09-29T18:22:23.186004] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-09-29T18:22:23.564453] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-09-29T18:22:23.634512] [DEBUG] [VALIDATOR ] DRH: All expected trading days are present. [2025-09-29T18:22:23.634612] [DEBUG] [VALIDATOR ] DRH: Primary data validation passed. [2025-09-29T18:22:23.635772] [INFO ] [MAIN ] DRH: Fetched primary data is valid. [2025-09-29T18:22:23.635848] [DEBUG] [LOCAL ] DRH: Saving primary data. [2025-09-29T18:22:23.638066] [DEBUG] [LOCAL ] DRH: Trimmed 71868 records to 50452 (keeping 200 days of data) [2025-09-29T18:22:23.969378] [DEBUG] [LOCAL ] DRH: Primary data saved (50452 records). [2025-09-29T18:22:23.969566] [INFO ] [MAIN ] DRH: Full history saved. [2025-09-29T18:22:23.969765] [INFO ] [MAIN ] Update Progress: 651/2371 symbols completed. DRH took 35.8s. Estimated remaining: 3h 37m 35s. Rate: 7.9 symbols/min [2025-09-29T18:22:24.203666] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:22:24.209914] [DEBUG] [LOCAL ] DSMC: Loaded 1974 existing records from primary storage. [2025-09-29T18:22:24.210108] [INFO ] [MAIN ] DSMC: Loaded 1974 existing records. [2025-09-29T18:22:24.355783] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-09-29T18:22:24.400237] [WARN ] [MAIN ] DSMC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:22:24.400791] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-09-29T18:22:24.400860] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-09-29T18:22:24.401121] [DEBUG] [LOCAL ] DSMC: Deleted primary data file. [2025-09-29T18:22:24.401183] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-09-29T18:22:24.679364] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-29T18:22:24.836427] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:22:24.866862] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-29T18:22:24.877924] [INFO ] [REMOTE ] DRI: Full fetch complete (69256 records). [2025-09-29T18:22:24.878113] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-09-29T18:22:24.878964] [FATAL] [VALIDATOR ] DRI: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:22:24.879068] [FATAL] [MAIN ] DRI: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:22:24.879136] [WARN ] [MAIN ] DRI: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:22:24.879181] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-09-29T18:22:24.879242] [DEBUG] [LOCAL ] DRI: No primary data file found to delete. [2025-09-29T18:22:24.879280] [INFO ] [LOCAL ] DRI: Starting deletion of derivative data. [2025-09-29T18:22:24.879944] [DEBUG] [LOCAL ] DRI: Deleted derivative data file. [2025-09-29T18:22:24.880053] [INFO ] [MAIN ] Update Progress: 652/2371 symbols completed. DRI took 35.3s. Estimated remaining: 3h 37m 9s. Rate: 7.9 symbols/min [2025-09-29T18:22:25.076513] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:22:25.104605] [DEBUG] [LOCAL ] DSU: Loaded 22684 existing records from primary storage. [2025-09-29T18:22:25.104944] [INFO ] [MAIN ] DSU: Loaded 22684 existing records. [2025-09-29T18:22:25.153263] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2024-12. [2025-09-29T18:22:25.341772] [WARN ] [MAIN ] DSU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:22:25.342080] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-09-29T18:22:25.342168] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-09-29T18:22:25.342517] [DEBUG] [LOCAL ] DSU: Deleted primary data file. [2025-09-29T18:22:25.342639] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-09-29T18:22:25.776427] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-29T18:22:25.825911] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-29T18:22:25.953518] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-09-29T18:22:26.048436] [INFO ] [REMOTE ] DSU: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:22:26.748127] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-09-29T18:22:27.321529] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-29T18:22:27.429688] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-29T18:22:27.548175] [INFO ] [REMOTE ] DSU: Fetching primary data for 2024-12. [2025-09-29T18:22:28.348085] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-09-29T18:22:28.525243] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-29T18:22:29.148145] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-09-29T18:22:29.794315] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-29T18:22:29.948130] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-09-29T18:22:30.241418] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-29T18:22:30.748145] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-01. [2025-09-29T18:22:31.086985] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-29T18:22:31.548147] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-09-29T18:22:31.895478] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-29T18:22:31.970684] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-29T18:22:32.348125] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-09-29T18:22:33.148138] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-09-29T18:22:33.528285] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-29T18:22:33.948158] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-09-29T18:22:34.033919] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-29T18:22:34.492243] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-29T18:22:34.748160] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-09-29T18:22:35.548096] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-09-29T18:22:35.622617] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-29T18:22:36.183581] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-29T18:22:36.348151] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-09-29T18:22:37.148148] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-09-29T18:22:37.596809] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-29T18:22:37.861850] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-29T18:22:37.948230] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-09-29T18:22:38.295978] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-29T18:22:38.748179] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-09-29T18:22:39.548153] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-09-29T18:22:39.964174] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-29T18:22:40.348108] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-09-29T18:22:40.692185] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-29T18:22:40.736068] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-29T18:22:41.148131] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-09-29T18:22:41.948126] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-09-29T18:22:42.378500] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-29T18:22:42.493629] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-29T18:22:42.502049] [INFO ] [REMOTE ] DSL: Full fetch complete (41354 records). [2025-09-29T18:22:42.502210] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-09-29T18:22:42.753231] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-09-29T18:22:43.009927] [DEBUG] [VALIDATOR ] DSL: All expected trading days are present. [2025-09-29T18:22:43.010032] [DEBUG] [VALIDATOR ] DSL: Primary data validation passed. [2025-09-29T18:22:43.010922] [INFO ] [MAIN ] DSL: Fetched primary data is valid. [2025-09-29T18:22:43.011000] [DEBUG] [LOCAL ] DSL: Saving primary data. [2025-09-29T18:22:43.012320] [DEBUG] [LOCAL ] DSL: Trimmed 41354 records to 28288 (keeping 200 days of data) [2025-09-29T18:22:43.267669] [DEBUG] [LOCAL ] DSL: Primary data saved (28288 records). [2025-09-29T18:22:43.267844] [INFO ] [MAIN ] DSL: Full history saved. [2025-09-29T18:22:43.267967] [INFO ] [MAIN ] Update Progress: 653/2371 symbols completed. DSL took 29.6s. Estimated remaining: 3h 37m 30s. Rate: 7.9 symbols/min [2025-09-29T18:22:43.499528] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:22:43.533877] [DEBUG] [LOCAL ] DSX: Loaded 24642 existing records from primary storage. [2025-09-29T18:22:43.534175] [INFO ] [MAIN ] DSX: Loaded 24642 existing records. [2025-09-29T18:22:43.556909] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-09-29T18:22:43.758942] [WARN ] [MAIN ] DSX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:22:43.759164] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-09-29T18:22:43.759214] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-09-29T18:22:43.759514] [DEBUG] [LOCAL ] DSX: Deleted primary data file. [2025-09-29T18:22:43.759575] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-09-29T18:22:44.177927] [INFO ] [REMOTE ] DSX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:22:44.196913] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-29T18:22:44.198872] [INFO ] [REMOTE ] DSMC: Full fetch complete (2878 records). [2025-09-29T18:22:44.199027] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-09-29T18:22:44.251908] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-29T18:22:44.353253] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-09-29T18:22:44.633047] [DEBUG] [VALIDATOR ] DSMC: All expected trading days are present. [2025-09-29T18:22:44.633170] [DEBUG] [VALIDATOR ] DSMC: Primary data validation passed. [2025-09-29T18:22:44.633350] [INFO ] [MAIN ] DSMC: Fetched primary data is valid. [2025-09-29T18:22:44.633461] [DEBUG] [LOCAL ] DSMC: Saving primary data. [2025-09-29T18:22:44.633964] [DEBUG] [LOCAL ] DSMC: Trimmed 2878 records to 1912 (keeping 200 days of data) [2025-09-29T18:22:44.647878] [DEBUG] [LOCAL ] DSMC: Primary data saved (1912 records). [2025-09-29T18:22:44.648000] [INFO ] [MAIN ] DSMC: Full history saved. [2025-09-29T18:22:44.648110] [INFO ] [MAIN ] Update Progress: 654/2371 symbols completed. DSMC took 20.7s. Estimated remaining: 3h 37m 6s. Rate: 7.9 symbols/min [2025-09-29T18:22:44.849985] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:22:44.910514] [DEBUG] [LOCAL ] DT: Loaded 53708 existing records from primary storage. [2025-09-29T18:22:44.910897] [INFO ] [MAIN ] DT: Loaded 53708 existing records. [2025-09-29T18:22:45.097223] [WARN ] [MAIN ] DT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:22:45.097910] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-09-29T18:22:45.097961] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-09-29T18:22:45.098540] [DEBUG] [LOCAL ] DT: Deleted primary data file. [2025-09-29T18:22:45.098667] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-09-29T18:22:45.155993] [INFO ] [REMOTE ] DSX: Fetching primary data for 2024-12. [2025-09-29T18:22:45.517076] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:22:45.528922] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-29T18:22:45.948114] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-09-29T18:22:46.738722] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-29T18:22:46.748066] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-01. [2025-09-29T18:22:47.009864] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-29T18:22:47.548114] [INFO ] [REMOTE ] DT: Fetching primary data for 2024-12. [2025-09-29T18:22:47.907287] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-29T18:22:48.348145] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-09-29T18:22:49.148108] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-09-29T18:22:49.397544] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-29T18:22:49.433278] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-29T18:22:49.948145] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-09-29T18:22:50.370593] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-29T18:22:50.748132] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-09-29T18:22:50.858703] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-29T18:22:51.548123] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-09-29T18:22:51.926242] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-29T18:22:52.348170] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-09-29T18:22:53.148155] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-09-29T18:22:53.948118] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-09-29T18:23:04.670875] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (12.32 seconds). [2025-09-29T18:23:04.677392] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-09-29T18:23:06.636221] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (15.09 seconds). [2025-09-29T18:23:06.653891] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-09-29T18:23:06.917827] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-29T18:23:06.937235] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (12.99 seconds). [2025-09-29T18:23:06.936519] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-09-29T18:23:06.943712] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-09-29T18:23:07.423499] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (14.28 seconds). [2025-09-29T18:23:07.428225] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-09-29T18:23:07.901666] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-29T18:23:07.908370] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-09-29T18:23:07.987544] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-29T18:23:07.991269] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-09-29T18:23:08.142426] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-29T18:23:08.149386] [INFO ] [REMOTE ] DSU: Full fetch complete (32708 records). [2025-09-29T18:23:08.149536] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-09-29T18:23:08.575031] [DEBUG] [VALIDATOR ] DSU: All expected trading days are present. [2025-09-29T18:23:08.575157] [DEBUG] [VALIDATOR ] DSU: Primary data validation passed. [2025-09-29T18:23:08.576024] [INFO ] [MAIN ] DSU: Fetched primary data is valid. [2025-09-29T18:23:08.576121] [DEBUG] [LOCAL ] DSU: Saving primary data. [2025-09-29T18:23:08.610832] [DEBUG] [LOCAL ] DSU: Trimmed 32708 records to 22497 (keeping 200 days of data) [2025-09-29T18:23:08.618206] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-29T18:23:08.721493] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-09-29T18:23:08.783277] [DEBUG] [LOCAL ] DSU: Primary data saved (22497 records). [2025-09-29T18:23:08.783446] [INFO ] [MAIN ] DSU: Full history saved. [2025-09-29T18:23:08.783588] [INFO ] [MAIN ] Update Progress: 655/2371 symbols completed. DSU took 43.9s. Estimated remaining: 3h 37m 42s. Rate: 7.9 symbols/min [2025-09-29T18:23:08.913102] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-29T18:23:08.962114] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-09-29T18:23:09.004017] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:23:09.013521] [DEBUG] [LOCAL ] DTB: Loaded 4817 existing records from primary storage. [2025-09-29T18:23:09.014302] [INFO ] [MAIN ] DTB: Loaded 4817 existing records. [2025-09-29T18:23:09.206779] [WARN ] [MAIN ] DTB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:23:09.207057] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-09-29T18:23:09.207107] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-09-29T18:23:09.207606] [DEBUG] [LOCAL ] DTB: Deleted primary data file. [2025-09-29T18:23:09.207737] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-09-29T18:23:09.592976] [INFO ] [REMOTE ] DTB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:23:09.593359] [INFO ] [REMOTE ] DTB: Fetching primary data for 2024-12. [2025-09-29T18:23:09.963236] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-29T18:23:09.966638] [INFO ] [REMOTE ] DSM: Full fetch complete (24706 records). [2025-09-29T18:23:09.966759] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-09-29T18:23:09.967296] [FATAL] [VALIDATOR ] DSM: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:23:09.967396] [FATAL] [MAIN ] DSM: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:23:09.967465] [WARN ] [MAIN ] DSM: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:23:09.967524] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-09-29T18:23:09.967600] [DEBUG] [LOCAL ] DSM: No primary data file found to delete. [2025-09-29T18:23:09.967685] [INFO ] [LOCAL ] DSM: Starting deletion of derivative data. [2025-09-29T18:23:09.968018] [DEBUG] [LOCAL ] DSM: Deleted derivative data file. [2025-09-29T18:23:09.968151] [INFO ] [MAIN ] Update Progress: 656/2371 symbols completed. DSM took 49.5s. Estimated remaining: 3h 37m 18s. Rate: 7.9 symbols/min [2025-09-29T18:23:10.150213] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:23:10.222134] [DEBUG] [LOCAL ] DTE: Loaded 48557 existing records from primary storage. [2025-09-29T18:23:10.222481] [INFO ] [MAIN ] DTE: Loaded 48557 existing records. [2025-09-29T18:23:10.412133] [WARN ] [MAIN ] DTE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:23:10.412553] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-09-29T18:23:10.412884] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-09-29T18:23:10.413857] [DEBUG] [LOCAL ] DTE: Deleted primary data file. [2025-09-29T18:23:10.413923] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-09-29T18:23:10.526967] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-29T18:23:10.546834] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-01. [2025-09-29T18:23:10.781188] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-29T18:23:10.844963] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-09-29T18:23:10.907242] [INFO ] [REMOTE ] DTE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:23:10.908054] [INFO ] [REMOTE ] DTE: Fetching primary data for 2024-12. [2025-09-29T18:23:10.927075] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (3.02 seconds). [2025-09-29T18:23:10.933485] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-09-29T18:23:11.184928] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-29T18:23:11.186584] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-09-29T18:23:11.593074] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-29T18:23:11.594488] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-09-29T18:23:12.153206] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-29T18:23:12.154976] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-09-29T18:23:12.203244] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-29T18:23:12.209405] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-09-29T18:23:12.379053] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-29T18:23:12.389903] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-09-29T18:23:12.654229] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-29T18:23:12.666387] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-09-29T18:23:12.719630] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-29T18:23:12.722282] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-09-29T18:23:12.979072] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-29T18:23:12.984413] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-09-29T18:23:13.294871] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-29T18:23:13.296536] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-09-29T18:23:13.692461] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-29T18:23:13.694401] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-09-29T18:23:13.773179] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-29T18:23:13.948068] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-09-29T18:23:14.246418] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-29T18:23:14.353738] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-29T18:23:14.359340] [INFO ] [REMOTE ] DSX: Full fetch complete (36587 records). [2025-09-29T18:23:14.359497] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-09-29T18:23:14.360186] [FATAL] [VALIDATOR ] DSX: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:23:14.360293] [FATAL] [MAIN ] DSX: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:23:14.360337] [WARN ] [MAIN ] DSX: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:23:14.360398] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-09-29T18:23:14.360513] [DEBUG] [LOCAL ] DSX: No primary data file found to delete. [2025-09-29T18:23:14.360597] [INFO ] [LOCAL ] DSX: Starting deletion of derivative data. [2025-09-29T18:23:14.361084] [DEBUG] [LOCAL ] DSX: Deleted derivative data file. [2025-09-29T18:23:14.361251] [INFO ] [MAIN ] Update Progress: 657/2371 symbols completed. DSX took 31.1s. Estimated remaining: 3h 37m 2s. Rate: 7.9 symbols/min [2025-09-29T18:23:14.546950] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:23:14.547310] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-09-29T18:23:14.547379] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-09-29T18:23:14.547729] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-09-29T18:23:14.547931] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-09-29T18:23:14.548073] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-09-29T18:23:14.548198] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-09-29T18:23:14.755550] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-09-29T18:23:14.865163] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-29T18:23:14.983313] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:23:15.164248] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-29T18:23:15.513363] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-29T18:23:15.548089] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-09-29T18:23:16.270946] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-29T18:23:16.273572] [INFO ] [REMOTE ] DTB: Full fetch complete (6877 records). [2025-09-29T18:23:16.273715] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-09-29T18:23:16.353326] [INFO ] [REMOTE ] DTF: Fetching primary data for 2024-12. [2025-09-29T18:23:16.671144] [DEBUG] [VALIDATOR ] DTB: All expected trading days are present. [2025-09-29T18:23:16.671238] [DEBUG] [VALIDATOR ] DTB: Primary data validation passed. [2025-09-29T18:23:16.671454] [INFO ] [MAIN ] DTB: Fetched primary data is valid. [2025-09-29T18:23:16.671507] [DEBUG] [LOCAL ] DTB: Saving primary data. [2025-09-29T18:23:16.672009] [DEBUG] [LOCAL ] DTB: Trimmed 6877 records to 4788 (keeping 200 days of data) [2025-09-29T18:23:16.702874] [DEBUG] [LOCAL ] DTB: Primary data saved (4788 records). [2025-09-29T18:23:16.703022] [INFO ] [MAIN ] DTB: Full history saved. [2025-09-29T18:23:16.703168] [INFO ] [MAIN ] Update Progress: 658/2371 symbols completed. DTB took 7.9s. Estimated remaining: 3h 36m 41s. Rate: 7.9 symbols/min [2025-09-29T18:23:16.892385] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:23:16.902912] [DEBUG] [LOCAL ] DTG: Loaded 5952 existing records from primary storage. [2025-09-29T18:23:16.903186] [INFO ] [MAIN ] DTG: Loaded 5952 existing records. [2025-09-29T18:23:17.105145] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-29T18:23:17.111329] [WARN ] [MAIN ] DTG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:23:17.113321] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-09-29T18:23:17.113388] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-09-29T18:23:17.113627] [DEBUG] [LOCAL ] DTG: Deleted primary data file. [2025-09-29T18:23:17.113723] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-09-29T18:23:17.153247] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-09-29T18:23:17.481330] [INFO ] [REMOTE ] DTG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:23:17.948163] [INFO ] [REMOTE ] DTG: Fetching primary data for 2024-12. [2025-09-29T18:23:18.748125] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-09-29T18:23:18.803391] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-29T18:23:19.050024] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-29T18:23:19.182624] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-29T18:23:19.548110] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-09-29T18:23:20.237667] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-29T18:23:20.348172] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-09-29T18:23:21.148166] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-09-29T18:23:21.905316] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-29T18:23:21.948106] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-09-29T18:23:22.188550] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-29T18:23:22.453303] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-29T18:23:22.748135] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-09-29T18:23:23.548119] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-09-29T18:23:24.348110] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-09-29T18:23:24.601804] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-29T18:23:25.000219] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-29T18:23:25.127341] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-29T18:23:25.148088] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-09-29T18:23:25.948132] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-09-29T18:23:26.748136] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-09-29T18:23:26.893853] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-29T18:23:27.248687] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-29T18:23:27.506367] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-29T18:23:27.548113] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-09-29T18:23:28.348120] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-09-29T18:23:28.954315] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-29T18:23:29.148132] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-09-29T18:23:29.227794] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-29T18:23:29.242061] [INFO ] [REMOTE ] DT: Full fetch complete (76641 records). [2025-09-29T18:23:29.242252] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-09-29T18:23:29.695082] [DEBUG] [VALIDATOR ] DT: All expected trading days are present. [2025-09-29T18:23:29.695187] [DEBUG] [VALIDATOR ] DT: Primary data validation passed. [2025-09-29T18:23:29.696243] [INFO ] [MAIN ] DT: Fetched primary data is valid. [2025-09-29T18:23:29.696318] [DEBUG] [LOCAL ] DT: Saving primary data. [2025-09-29T18:23:29.698052] [DEBUG] [LOCAL ] DT: Trimmed 76641 records to 52927 (keeping 200 days of data) [2025-09-29T18:23:29.948383] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-09-29T18:23:30.060710] [DEBUG] [LOCAL ] DT: Primary data saved (52927 records). [2025-09-29T18:23:30.060865] [INFO ] [MAIN ] DT: Full history saved. [2025-09-29T18:23:30.060952] [INFO ] [MAIN ] Update Progress: 659/2371 symbols completed. DT took 45.4s. Estimated remaining: 3h 36m 48s. Rate: 7.9 symbols/min [2025-09-29T18:23:30.248504] [INFO ] [MAIN ] DTK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:23:30.248901] [DEBUG] [LOCAL ] DTK: No existing data file found in primary storage. [2025-09-29T18:23:30.248953] [WARN ] [MAIN ] DTK: No existing data found, performing full refresh instead. [2025-09-29T18:23:30.249108] [INFO ] [MAIN ] DTK: Wiping existing primary data before full refresh. [2025-09-29T18:23:30.249194] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-09-29T18:23:30.249287] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-09-29T18:23:30.249335] [INFO ] [MAIN ] DTK: Starting full primary refresh. [2025-09-29T18:23:30.575230] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-29T18:23:30.666786] [INFO ] [REMOTE ] DTK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:23:30.747103] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-29T18:23:30.751040] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-09-29T18:23:31.119014] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-29T18:23:31.548099] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-09-29T18:23:32.171397] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-29T18:23:32.348112] [INFO ] [REMOTE ] DTK: Fetching primary data for 2024-12. [2025-09-29T18:23:32.542485] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T18:23:32.542912] [WARN ] [REMOTE ] DTK: No data returned for month 2024-12 [2025-09-29T18:23:32.542990] [FATAL] [REMOTE ] DTK: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T18:23:32.543061] [FATAL] [MAIN ] DTK: Failed to fetch primary data. [2025-09-29T18:23:32.543128] [WARN ] [MAIN ] DTK: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T18:23:32.543202] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-09-29T18:23:32.543271] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-09-29T18:23:32.543316] [INFO ] [LOCAL ] DTK: Starting deletion of derivative data. [2025-09-29T18:23:32.543394] [DEBUG] [LOCAL ] DTK: No derivative data file found to delete. [2025-09-29T18:23:32.543468] [INFO ] [MAIN ] Update Progress: 660/2371 symbols completed. DTK took 2.5s. Estimated remaining: 3h 36m 27s. Rate: 7.9 symbols/min [2025-09-29T18:23:32.752114] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:23:32.807772] [DEBUG] [LOCAL ] DTM: Loaded 45043 existing records from primary storage. [2025-09-29T18:23:32.808123] [INFO ] [MAIN ] DTM: Loaded 45043 existing records. [2025-09-29T18:23:33.041052] [WARN ] [MAIN ] DTM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:23:33.041288] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-09-29T18:23:33.041338] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-09-29T18:23:33.041945] [DEBUG] [LOCAL ] DTM: Deleted primary data file. [2025-09-29T18:23:33.042011] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-09-29T18:23:33.153326] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-09-29T18:23:33.446750] [INFO ] [REMOTE ] DTM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:23:33.529710] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-29T18:23:33.948143] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-09-29T18:23:34.748111] [INFO ] [REMOTE ] DTM: Fetching primary data for 2024-12. [2025-09-29T18:23:35.548100] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-09-29T18:23:35.829183] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-29T18:23:35.909275] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-29T18:23:36.348138] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-09-29T18:23:36.477566] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-29T18:23:37.025170] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-29T18:23:37.148126] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-01. [2025-09-29T18:23:37.948138] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-09-29T18:23:38.435521] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-29T18:23:38.730083] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-29T18:23:38.748068] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-09-29T18:23:39.436269] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-29T18:23:39.548049] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-09-29T18:23:40.348128] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-09-29T18:23:40.475991] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-29T18:23:41.148128] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-09-29T18:23:41.948120] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-09-29T18:23:42.038668] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-29T18:23:42.686458] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-29T18:23:42.748109] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-09-29T18:23:42.806512] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-29T18:23:42.808285] [INFO ] [REMOTE ] DTG: Full fetch complete (8957 records). [2025-09-29T18:23:42.808370] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-09-29T18:23:43.212216] [DEBUG] [VALIDATOR ] DTG: All expected trading days are present. [2025-09-29T18:23:43.212304] [DEBUG] [VALIDATOR ] DTG: Primary data validation passed. [2025-09-29T18:23:43.212680] [INFO ] [MAIN ] DTG: Fetched primary data is valid. [2025-09-29T18:23:43.212744] [DEBUG] [LOCAL ] DTG: Saving primary data. [2025-09-29T18:23:43.213223] [DEBUG] [LOCAL ] DTG: Trimmed 8957 records to 5880 (keeping 200 days of data) [2025-09-29T18:23:43.252376] [DEBUG] [LOCAL ] DTG: Primary data saved (5880 records). [2025-09-29T18:23:43.252528] [INFO ] [MAIN ] DTG: Full history saved. [2025-09-29T18:23:43.252617] [INFO ] [MAIN ] Update Progress: 661/2371 symbols completed. DTG took 26.5s. Estimated remaining: 3h 36m 28s. Rate: 7.9 symbols/min [2025-09-29T18:23:43.442137] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:23:43.451167] [DEBUG] [LOCAL ] DTW: Loaded 4923 existing records from primary storage. [2025-09-29T18:23:43.451431] [INFO ] [MAIN ] DTW: Loaded 4923 existing records. [2025-09-29T18:23:43.554371] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-09-29T18:23:43.641119] [WARN ] [MAIN ] DTW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:23:43.641367] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-09-29T18:23:43.641428] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-09-29T18:23:43.641730] [DEBUG] [LOCAL ] DTW: Deleted primary data file. [2025-09-29T18:23:43.641790] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-09-29T18:23:44.010382] [INFO ] [REMOTE ] DTW: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:23:44.348143] [INFO ] [REMOTE ] DTW: Fetching primary data for 2024-12. [2025-09-29T18:23:44.633936] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-29T18:23:44.645799] [INFO ] [REMOTE ] DTE: Full fetch complete (69123 records). [2025-09-29T18:23:44.646032] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-09-29T18:23:45.090346] [DEBUG] [VALIDATOR ] DTE: All expected trading days are present. [2025-09-29T18:23:45.090685] [DEBUG] [VALIDATOR ] DTE: Primary data validation passed. [2025-09-29T18:23:45.092236] [INFO ] [MAIN ] DTE: Fetched primary data is valid. [2025-09-29T18:23:45.092469] [DEBUG] [LOCAL ] DTE: Saving primary data. [2025-09-29T18:23:45.094902] [DEBUG] [LOCAL ] DTE: Trimmed 69123 records to 47796 (keeping 200 days of data) [2025-09-29T18:23:45.159759] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-09-29T18:23:45.388747] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-29T18:23:45.400140] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-29T18:23:45.523593] [DEBUG] [LOCAL ] DTE: Primary data saved (47796 records). [2025-09-29T18:23:45.523827] [INFO ] [MAIN ] DTE: Full history saved. [2025-09-29T18:23:45.523969] [INFO ] [MAIN ] Update Progress: 662/2371 symbols completed. DTE took 35.6s. Estimated remaining: 3h 36m 6s. Rate: 7.9 symbols/min [2025-09-29T18:23:45.624969] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-29T18:23:45.637370] [INFO ] [REMOTE ] DTF: Full fetch complete (2104 records). [2025-09-29T18:23:45.637564] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-09-29T18:23:45.836077] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:23:45.926461] [WARN ] [VALIDATOR ] DTF: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-29T18:23:45.926927] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:23:45.927002] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:23:45.927081] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-09-29T18:23:45.927161] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-09-29T18:23:45.927201] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-09-29T18:23:45.927268] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-09-29T18:23:45.927363] [INFO ] [MAIN ] Update Progress: 663/2371 symbols completed. DTF took 31.6s. Estimated remaining: 3h 35m 40s. Rate: 7.9 symbols/min [2025-09-29T18:23:45.953724] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-09-29T18:23:46.142145] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:23:46.178233] [DEBUG] [LOCAL ] DUK: Loaded 54238 existing records from primary storage. [2025-09-29T18:23:46.178986] [INFO ] [MAIN ] DUK: Loaded 54238 existing records. [2025-09-29T18:23:46.187853] [DEBUG] [LOCAL ] DUKB: Loaded 6414 existing records from primary storage. [2025-09-29T18:23:46.207243] [INFO ] [MAIN ] DUKB: Loaded 6414 existing records. [2025-09-29T18:23:46.591915] [WARN ] [MAIN ] DUKB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:23:46.603304] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-09-29T18:23:46.629158] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-09-29T18:23:46.636568] [WARN ] [MAIN ] DUK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:23:46.637024] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-09-29T18:23:46.637084] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-09-29T18:23:46.637190] [DEBUG] [LOCAL ] DUKB: Deleted primary data file. [2025-09-29T18:23:46.637283] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-09-29T18:23:46.642834] [DEBUG] [LOCAL ] DUK: Deleted primary data file. [2025-09-29T18:23:46.665096] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-09-29T18:23:46.750616] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-09-29T18:23:47.442195] [INFO ] [REMOTE ] DUK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:23:47.448874] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:23:47.486334] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-29T18:23:47.548118] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-09-29T18:23:47.822416] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-29T18:23:48.110175] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-29T18:23:48.348120] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-09-29T18:23:49.148145] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2024-12. [2025-09-29T18:23:49.953257] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-09-29T18:23:49.968510] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-29T18:23:49.984462] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-29T18:23:50.618799] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-29T18:23:50.748110] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-01. [2025-09-29T18:23:51.397538] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-29T18:23:51.548105] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-09-29T18:23:51.990307] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-29T18:23:52.348116] [INFO ] [REMOTE ] DUK: Fetching primary data for 2024-12. [2025-09-29T18:23:53.148123] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-09-29T18:23:53.757120] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-29T18:23:53.948140] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-09-29T18:23:54.544418] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-29T18:23:54.748123] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-09-29T18:23:55.467228] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-29T18:23:55.548103] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-09-29T18:23:56.348144] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-09-29T18:23:56.367865] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-29T18:23:56.495201] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2024-12 (4.15 seconds). [2025-09-29T18:23:57.148135] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-09-29T18:23:57.733302] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-29T18:23:57.810203] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-29T18:23:57.948112] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-09-29T18:23:58.748132] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-09-29T18:23:59.436788] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-29T18:23:59.548114] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-09-29T18:23:59.617861] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-29T18:24:00.348127] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-09-29T18:24:00.374002] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-29T18:24:01.148153] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-09-29T18:24:01.779793] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-29T18:24:01.948085] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-09-29T18:24:02.038875] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-29T18:24:02.628780] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-29T18:24:02.748157] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-09-29T18:24:03.466254] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-29T18:24:03.548098] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-09-29T18:24:04.150329] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-29T18:24:04.348113] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-09-29T18:24:05.148160] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-09-29T18:24:05.263307] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-29T18:24:05.265083] [INFO ] [REMOTE ] DUKB: Full fetch complete (9527 records). [2025-09-29T18:24:05.265180] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-09-29T18:24:05.663922] [DEBUG] [VALIDATOR ] DUKB: All expected trading days are present. [2025-09-29T18:24:05.664034] [DEBUG] [VALIDATOR ] DUKB: Primary data validation passed. [2025-09-29T18:24:05.664316] [INFO ] [MAIN ] DUKB: Fetched primary data is valid. [2025-09-29T18:24:05.664387] [DEBUG] [LOCAL ] DUKB: Saving primary data. [2025-09-29T18:24:05.665042] [DEBUG] [LOCAL ] DUKB: Trimmed 9527 records to 6344 (keeping 200 days of data) [2025-09-29T18:24:05.705485] [DEBUG] [LOCAL ] DUKB: Primary data saved (6344 records). [2025-09-29T18:24:05.705624] [INFO ] [MAIN ] DUKB: Full history saved. [2025-09-29T18:24:05.705741] [INFO ] [MAIN ] Update Progress: 664/2371 symbols completed. DUKB took 19.8s. Estimated remaining: 3h 36m 4s. Rate: 7.9 symbols/min [2025-09-29T18:24:05.884282] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:24:05.948903] [DEBUG] [LOCAL ] DV: Loaded 52038 existing records from primary storage. [2025-09-29T18:24:05.948988] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-01. [2025-09-29T18:24:05.950218] [INFO ] [MAIN ] DV: Loaded 52038 existing records. [2025-09-29T18:24:06.146044] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:24:06.146298] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-09-29T18:24:06.146346] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-09-29T18:24:06.146761] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-09-29T18:24:06.146821] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-09-29T18:24:06.460721] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-29T18:24:06.498357] [INFO ] [REMOTE ] DTW: Full fetch complete (7678 records). [2025-09-29T18:24:06.509953] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-09-29T18:24:06.547106] [INFO ] [REMOTE ] DV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:24:06.753254] [INFO ] [REMOTE ] DV: Fetching primary data for 2024-12. [2025-09-29T18:24:06.955730] [DEBUG] [VALIDATOR ] DTW: All expected trading days are present. [2025-09-29T18:24:06.955821] [DEBUG] [VALIDATOR ] DTW: Primary data validation passed. [2025-09-29T18:24:06.956053] [INFO ] [MAIN ] DTW: Fetched primary data is valid. [2025-09-29T18:24:06.956094] [DEBUG] [LOCAL ] DTW: Saving primary data. [2025-09-29T18:24:06.956540] [DEBUG] [LOCAL ] DTW: Trimmed 7678 records to 4881 (keeping 200 days of data) [2025-09-29T18:24:06.988503] [DEBUG] [LOCAL ] DTW: Primary data saved (4881 records). [2025-09-29T18:24:06.988634] [INFO ] [MAIN ] DTW: Full history saved. [2025-09-29T18:24:06.988765] [INFO ] [MAIN ] Update Progress: 665/2371 symbols completed. DTW took 23.7s. Estimated remaining: 3h 35m 40s. Rate: 7.9 symbols/min [2025-09-29T18:24:07.200934] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:24:07.260721] [DEBUG] [LOCAL ] DVA: Loaded 41877 existing records from primary storage. [2025-09-29T18:24:07.261135] [INFO ] [MAIN ] DVA: Loaded 41877 existing records. [2025-09-29T18:24:07.472464] [WARN ] [MAIN ] DVA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:24:07.472752] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-09-29T18:24:07.472809] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-09-29T18:24:07.473169] [DEBUG] [LOCAL ] DVA: Deleted primary data file. [2025-09-29T18:24:07.473233] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-09-29T18:24:07.558380] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-09-29T18:24:07.872733] [INFO ] [REMOTE ] DVA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:24:07.973740] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-29T18:24:08.348112] [INFO ] [REMOTE ] DVA: Fetching primary data for 2024-12. [2025-09-29T18:24:08.500907] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-29T18:24:09.148111] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-01. [2025-09-29T18:24:09.186298] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-29T18:24:09.195565] [INFO ] [REMOTE ] DTM: Full fetch complete (64872 records). [2025-09-29T18:24:09.195722] [DEBUG] [VALIDATOR ] DTM: Validating primary data. [2025-09-29T18:24:09.621221] [DEBUG] [VALIDATOR ] DTM: All expected trading days are present. [2025-09-29T18:24:09.621350] [DEBUG] [VALIDATOR ] DTM: Primary data validation passed. [2025-09-29T18:24:09.622263] [INFO ] [MAIN ] DTM: Fetched primary data is valid. [2025-09-29T18:24:09.622347] [DEBUG] [LOCAL ] DTM: Saving primary data. [2025-09-29T18:24:09.624709] [DEBUG] [LOCAL ] DTM: Trimmed 64872 records to 44232 (keeping 200 days of data) [2025-09-29T18:24:09.948332] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-09-29T18:24:09.952160] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-29T18:24:09.964082] [DEBUG] [LOCAL ] DTM: Primary data saved (44232 records). [2025-09-29T18:24:09.964262] [INFO ] [MAIN ] DTM: Full history saved. [2025-09-29T18:24:09.964371] [INFO ] [MAIN ] Update Progress: 666/2371 symbols completed. DTM took 37.4s. Estimated remaining: 3h 35m 21s. Rate: 7.9 symbols/min [2025-09-29T18:24:10.148364] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:24:10.202459] [DEBUG] [LOCAL ] DVN: Loaded 54479 existing records from primary storage. [2025-09-29T18:24:10.202831] [INFO ] [MAIN ] DVN: Loaded 54479 existing records. [2025-09-29T18:24:10.392162] [WARN ] [MAIN ] DVN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:24:10.392468] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-09-29T18:24:10.392523] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-09-29T18:24:10.393580] [DEBUG] [LOCAL ] DVN: Deleted primary data file. [2025-09-29T18:24:10.393684] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-09-29T18:24:10.766703] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-01. [2025-09-29T18:24:10.819185] [INFO ] [REMOTE ] DVN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:24:10.849858] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-29T18:24:11.334367] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-29T18:24:11.548228] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-09-29T18:24:12.295949] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-29T18:24:12.348170] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-09-29T18:24:13.148153] [INFO ] [REMOTE ] DVN: Fetching primary data for 2024-12. [2025-09-29T18:24:13.948101] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-09-29T18:24:14.883287] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (3.34 seconds). [2025-09-29T18:24:14.895445] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-09-29T18:24:15.325565] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-29T18:24:15.548074] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-01. [2025-09-29T18:24:15.809829] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (3.46 seconds). [2025-09-29T18:24:16.348082] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-09-29T18:24:16.622123] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-29T18:24:16.812800] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (2.86 seconds). [2025-09-29T18:24:17.148755] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-29T18:24:17.148836] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-09-29T18:24:17.948093] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-09-29T18:24:18.062598] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-29T18:24:18.754766] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-09-29T18:24:18.780847] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-29T18:24:19.548077] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-09-29T18:24:19.600107] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-29T18:24:20.156073] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-29T18:24:20.348136] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-09-29T18:24:21.148073] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-09-29T18:24:21.516463] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-29T18:24:21.948168] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-09-29T18:24:22.126226] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-29T18:24:22.748155] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-09-29T18:24:23.091963] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-29T18:24:23.548093] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-09-29T18:24:23.758309] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-29T18:24:24.015996] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-29T18:24:24.348121] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-09-29T18:24:25.148184] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-09-29T18:24:25.780905] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-29T18:24:25.948168] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-09-29T18:24:26.096740] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-29T18:24:26.748118] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-09-29T18:24:27.147423] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-29T18:24:27.562712] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-09-29T18:24:27.566470] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-29T18:24:28.348126] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-09-29T18:24:28.723596] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-29T18:24:29.148103] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-09-29T18:24:29.419462] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-29T18:24:29.744566] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-29T18:24:29.948125] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-09-29T18:24:30.736160] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-29T18:24:30.751374] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-09-29T18:24:31.548158] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-09-29T18:24:32.348094] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-09-29T18:24:32.429464] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-09-29T18:24:32.440914] [INFO ] [REMOTE ] DUK: Full fetch complete (77405 records). [2025-09-29T18:24:32.441079] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-09-29T18:24:32.877003] [DEBUG] [VALIDATOR ] DUK: All expected trading days are present. [2025-09-29T18:24:32.877405] [DEBUG] [VALIDATOR ] DUK: Primary data validation passed. [2025-09-29T18:24:32.878639] [INFO ] [MAIN ] DUK: Fetched primary data is valid. [2025-09-29T18:24:32.878891] [DEBUG] [LOCAL ] DUK: Saving primary data. [2025-09-29T18:24:32.916259] [DEBUG] [LOCAL ] DUK: Trimmed 77405 records to 53458 (keeping 200 days of data) [2025-09-29T18:24:32.919335] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-29T18:24:33.056557] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-29T18:24:33.167179] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-09-29T18:24:33.360485] [DEBUG] [LOCAL ] DUK: Primary data saved (53458 records). [2025-09-29T18:24:33.360710] [INFO ] [MAIN ] DUK: Full history saved. [2025-09-29T18:24:33.360873] [INFO ] [MAIN ] Update Progress: 667/2371 symbols completed. DUK took 47.8s. Estimated remaining: 3h 35m 54s. Rate: 7.9 symbols/min [2025-09-29T18:24:33.543004] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:24:33.606293] [DEBUG] [LOCAL ] DX: Loaded 53228 existing records from primary storage. [2025-09-29T18:24:33.606763] [INFO ] [MAIN ] DX: Loaded 53228 existing records. [2025-09-29T18:24:33.792902] [WARN ] [MAIN ] DX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:24:33.793283] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-09-29T18:24:33.793339] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-09-29T18:24:33.794150] [DEBUG] [LOCAL ] DX: Deleted primary data file. [2025-09-29T18:24:33.794216] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-09-29T18:24:33.953942] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-09-29T18:24:34.169711] [INFO ] [REMOTE ] DX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:24:34.422500] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-29T18:24:34.433958] [INFO ] [REMOTE ] DV: Full fetch complete (73353 records). [2025-09-29T18:24:34.434206] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-09-29T18:24:34.749050] [INFO ] [REMOTE ] DX: Fetching primary data for 2024-12. [2025-09-29T18:24:34.889619] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-09-29T18:24:34.889780] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-09-29T18:24:34.891141] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-09-29T18:24:34.891400] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-09-29T18:24:34.918158] [DEBUG] [LOCAL ] DV: Trimmed 73353 records to 51263 (keeping 200 days of data) [2025-09-29T18:24:34.920085] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-29T18:24:35.254741] [DEBUG] [LOCAL ] DV: Primary data saved (51263 records). [2025-09-29T18:24:35.254963] [INFO ] [MAIN ] DV: Full history saved. [2025-09-29T18:24:35.255077] [INFO ] [MAIN ] Update Progress: 668/2371 symbols completed. DV took 29.5s. Estimated remaining: 3h 35m 31s. Rate: 7.9 symbols/min [2025-09-29T18:24:35.425086] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:24:35.483957] [DEBUG] [LOCAL ] DXC: Loaded 50456 existing records from primary storage. [2025-09-29T18:24:35.484995] [INFO ] [MAIN ] DXC: Loaded 50456 existing records. [2025-09-29T18:24:35.557491] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-09-29T18:24:35.678322] [WARN ] [MAIN ] DXC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:24:35.678665] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-09-29T18:24:35.678736] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-09-29T18:24:35.679305] [DEBUG] [LOCAL ] DXC: Deleted primary data file. [2025-09-29T18:24:35.679368] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-09-29T18:24:36.050668] [INFO ] [REMOTE ] DXC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:24:36.268828] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-09-29T18:24:36.348093] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-09-29T18:24:36.584536] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-29T18:24:37.148088] [INFO ] [REMOTE ] DXC: Fetching primary data for 2024-12. [2025-09-29T18:24:37.310985] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-29T18:24:37.319616] [INFO ] [REMOTE ] DVA: Full fetch complete (59719 records). [2025-09-29T18:24:37.319798] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-09-29T18:24:37.737179] [DEBUG] [VALIDATOR ] DVA: All expected trading days are present. [2025-09-29T18:24:37.737309] [DEBUG] [VALIDATOR ] DVA: Primary data validation passed. [2025-09-29T18:24:37.738439] [INFO ] [MAIN ] DVA: Fetched primary data is valid. [2025-09-29T18:24:37.738534] [DEBUG] [LOCAL ] DVA: Saving primary data. [2025-09-29T18:24:37.740428] [DEBUG] [LOCAL ] DVA: Trimmed 59719 records to 41068 (keeping 200 days of data) [2025-09-29T18:24:37.960600] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-09-29T18:24:38.019324] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-29T18:24:38.059879] [DEBUG] [LOCAL ] DVA: Primary data saved (41068 records). [2025-09-29T18:24:38.060066] [INFO ] [MAIN ] DVA: Full history saved. [2025-09-29T18:24:38.060165] [INFO ] [MAIN ] Update Progress: 669/2371 symbols completed. DVA took 31.1s. Estimated remaining: 3h 35m 12s. Rate: 7.9 symbols/min [2025-09-29T18:24:38.238353] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:24:38.283479] [DEBUG] [LOCAL ] DXYZ: Loaded 37246 existing records from primary storage. [2025-09-29T18:24:38.284074] [INFO ] [MAIN ] DXYZ: Loaded 37246 existing records. [2025-09-29T18:24:38.470360] [WARN ] [MAIN ] DXYZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:24:38.471169] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-09-29T18:24:38.471224] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-09-29T18:24:38.471751] [DEBUG] [LOCAL ] DXYZ: Deleted primary data file. [2025-09-29T18:24:38.471812] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-09-29T18:24:38.753200] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-09-29T18:24:38.938144] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-29T18:24:38.944295] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:24:39.548146] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-01. [2025-09-29T18:24:39.855921] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-29T18:24:40.348139] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-09-29T18:24:40.774712] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-29T18:24:41.148172] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2024-12. [2025-09-29T18:24:41.381807] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-29T18:24:41.948235] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-09-29T18:24:42.748216] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-09-29T18:24:43.109899] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (2.76 seconds). [2025-09-29T18:24:43.548235] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-09-29T18:24:44.366922] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-09-29T18:24:44.376803] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-09-29T18:24:44.557492] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2024-12 (3.41 seconds). [2025-09-29T18:24:45.148116] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-01. [2025-09-29T18:24:45.313843] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-29T18:24:45.436622] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (2.69 seconds). [2025-09-29T18:24:45.448723] [INFO ] [REMOTE ] DVN: Full fetch complete (77376 records). [2025-09-29T18:24:45.448912] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-09-29T18:24:45.449819] [FATAL] [VALIDATOR ] DVN: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:24:45.449913] [FATAL] [MAIN ] DVN: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:24:45.449959] [WARN ] [MAIN ] DVN: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:24:45.450003] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-09-29T18:24:45.450064] [DEBUG] [LOCAL ] DVN: No primary data file found to delete. [2025-09-29T18:24:45.450105] [INFO ] [LOCAL ] DVN: Starting deletion of derivative data. [2025-09-29T18:24:45.450599] [DEBUG] [LOCAL ] DVN: Deleted derivative data file. [2025-09-29T18:24:45.450727] [INFO ] [MAIN ] Update Progress: 670/2371 symbols completed. DVN took 35.5s. Estimated remaining: 3h 35m 4s. Rate: 7.9 symbols/min [2025-09-29T18:24:45.631626] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:24:45.678285] [DEBUG] [LOCAL ] DY: Loaded 30160 existing records from primary storage. [2025-09-29T18:24:45.678719] [INFO ] [MAIN ] DY: Loaded 30160 existing records. [2025-09-29T18:24:45.886917] [WARN ] [MAIN ] DY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:24:45.887471] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-09-29T18:24:45.887943] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-09-29T18:24:45.888607] [DEBUG] [LOCAL ] DY: Deleted primary data file. [2025-09-29T18:24:45.888706] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-09-29T18:24:45.953780] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-09-29T18:24:46.363045] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-29T18:24:46.380872] [INFO ] [REMOTE ] DY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:24:46.748148] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-09-29T18:24:47.438994] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-29T18:24:47.548200] [INFO ] [REMOTE ] DY: Fetching primary data for 2024-12. [2025-09-29T18:24:47.923621] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-29T18:24:48.077365] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-29T18:24:48.348198] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-09-29T18:24:49.153616] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-09-29T18:24:49.174669] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-29T18:24:49.948111] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-01. [2025-09-29T18:24:50.050016] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-29T18:24:50.748115] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-09-29T18:24:51.064888] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-29T18:24:51.320780] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-29T18:24:51.548155] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-09-29T18:24:52.235607] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-29T18:24:52.348084] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-09-29T18:24:52.461369] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-29T18:24:53.148160] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-09-29T18:24:53.948209] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-09-29T18:24:54.748228] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-09-29T18:24:54.956710] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-09-29T18:24:55.548158] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-09-29T18:24:56.053565] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (2.91 seconds). [2025-09-29T18:24:56.348126] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-09-29T18:24:56.568948] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-29T18:24:57.148149] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-09-29T18:24:57.195849] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-29T18:24:57.238042] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (3.29 seconds). [2025-09-29T18:24:57.948123] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-09-29T18:24:58.179974] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-29T18:24:58.342425] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-29T18:24:58.748116] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-09-29T18:24:59.444343] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-29T18:24:59.455327] [INFO ] [REMOTE ] DXC: Full fetch complete (68964 records). [2025-09-29T18:24:59.455499] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-09-29T18:24:59.556952] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-09-29T18:24:59.862297] [DEBUG] [VALIDATOR ] DXC: All expected trading days are present. [2025-09-29T18:24:59.862425] [DEBUG] [VALIDATOR ] DXC: Primary data validation passed. [2025-09-29T18:24:59.863520] [INFO ] [MAIN ] DXC: Fetched primary data is valid. [2025-09-29T18:24:59.863597] [DEBUG] [LOCAL ] DXC: Saving primary data. [2025-09-29T18:24:59.867921] [DEBUG] [LOCAL ] DXC: Trimmed 68964 records to 49756 (keeping 200 days of data) [2025-09-29T18:25:00.191041] [DEBUG] [LOCAL ] DXC: Primary data saved (49756 records). [2025-09-29T18:25:00.191252] [INFO ] [MAIN ] DXC: Full history saved. [2025-09-29T18:25:00.191442] [INFO ] [MAIN ] Update Progress: 671/2371 symbols completed. DXC took 24.9s. Estimated remaining: 3h 35m 14s. Rate: 7.9 symbols/min [2025-09-29T18:25:00.352065] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-09-29T18:25:00.431590] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:25:00.492278] [DEBUG] [LOCAL ] E: Loaded 33848 existing records from primary storage. [2025-09-29T18:25:00.492906] [INFO ] [MAIN ] E: Loaded 33848 existing records. [2025-09-29T18:25:00.853801] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-29T18:25:00.883588] [WARN ] [MAIN ] E: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:25:00.886227] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-09-29T18:25:00.887192] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-09-29T18:25:00.897823] [DEBUG] [LOCAL ] E: Deleted primary data file. [2025-09-29T18:25:00.911028] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-09-29T18:25:00.918958] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-29T18:25:01.170448] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-09-29T18:25:01.513567] [INFO ] [REMOTE ] E: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:25:01.948215] [INFO ] [REMOTE ] E: Fetching primary data for 2024-12. [2025-09-29T18:25:02.294522] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-29T18:25:02.430386] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-29T18:25:02.748140] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-09-29T18:25:03.481825] [INFO ] [REMOTE ] E: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-29T18:25:03.548129] [INFO ] [REMOTE ] E: Fetching primary data for 2025-01. [2025-09-29T18:25:04.348192] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-09-29T18:25:05.056571] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-29T18:25:05.070860] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-09-29T18:25:05.089215] [INFO ] [REMOTE ] DX: Full fetch complete (75388 records). [2025-09-29T18:25:05.089419] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-09-29T18:25:05.153419] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-09-29T18:25:05.659110] [DEBUG] [VALIDATOR ] DX: All expected trading days are present. [2025-09-29T18:25:05.659210] [DEBUG] [VALIDATOR ] DX: Primary data validation passed. [2025-09-29T18:25:05.660434] [INFO ] [MAIN ] DX: Fetched primary data is valid. [2025-09-29T18:25:05.660535] [DEBUG] [LOCAL ] DX: Saving primary data. [2025-09-29T18:25:05.663402] [DEBUG] [LOCAL ] DX: Trimmed 75388 records to 52453 (keeping 200 days of data) [2025-09-29T18:25:05.964331] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-09-29T18:25:06.014937] [DEBUG] [LOCAL ] DX: Primary data saved (52453 records). [2025-09-29T18:25:06.015099] [INFO ] [MAIN ] DX: Full history saved. [2025-09-29T18:25:06.015238] [INFO ] [MAIN ] Update Progress: 672/2371 symbols completed. DX took 32.7s. Estimated remaining: 3h 35m 2s. Rate: 7.9 symbols/min [2025-09-29T18:25:06.207605] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:25:06.261747] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-29T18:25:06.288158] [DEBUG] [LOCAL ] EAF: Loaded 44158 existing records from primary storage. [2025-09-29T18:25:06.288746] [INFO ] [MAIN ] EAF: Loaded 44158 existing records. [2025-09-29T18:25:06.503024] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-29T18:25:06.506915] [WARN ] [MAIN ] EAF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:25:06.513532] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-09-29T18:25:06.513591] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-09-29T18:25:06.514413] [DEBUG] [LOCAL ] EAF: Deleted primary data file. [2025-09-29T18:25:06.514523] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-09-29T18:25:06.755550] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-09-29T18:25:06.890802] [INFO ] [REMOTE ] EAF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:25:07.330854] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-29T18:25:07.548172] [INFO ] [REMOTE ] EAF: Fetching primary data for 2024-12. [2025-09-29T18:25:08.147893] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-29T18:25:08.348113] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-09-29T18:25:09.148102] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-09-29T18:25:09.238239] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-29T18:25:09.948123] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-01. [2025-09-29T18:25:09.974538] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-29T18:25:09.981138] [INFO ] [REMOTE ] DY: Full fetch complete (44891 records). [2025-09-29T18:25:09.981267] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-09-29T18:25:10.398505] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-09-29T18:25:10.398701] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-09-29T18:25:10.399480] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-09-29T18:25:10.399573] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-09-29T18:25:10.401150] [DEBUG] [LOCAL ] DY: Trimmed 44891 records to 29395 (keeping 200 days of data) [2025-09-29T18:25:10.534551] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-29T18:25:10.649396] [DEBUG] [LOCAL ] DY: Primary data saved (29395 records). [2025-09-29T18:25:10.649552] [INFO ] [MAIN ] DY: Full history saved. [2025-09-29T18:25:10.649675] [INFO ] [MAIN ] Update Progress: 673/2371 symbols completed. DY took 25.2s. Estimated remaining: 3h 34m 47s. Rate: 7.9 symbols/min [2025-09-29T18:25:10.753237] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-09-29T18:25:10.834117] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:25:10.841180] [DEBUG] [LOCAL ] EAI: Loaded 4008 existing records from primary storage. [2025-09-29T18:25:10.841392] [INFO ] [MAIN ] EAI: Loaded 4008 existing records. [2025-09-29T18:25:11.033339] [WARN ] [MAIN ] EAI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:25:11.033569] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-09-29T18:25:11.033637] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-09-29T18:25:11.033885] [DEBUG] [LOCAL ] EAI: Deleted primary data file. [2025-09-29T18:25:11.033942] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-09-29T18:25:11.415716] [INFO ] [REMOTE ] EAI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:25:11.443300] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-29T18:25:11.548128] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-09-29T18:25:12.348139] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-09-29T18:25:12.956457] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-29T18:25:13.148110] [INFO ] [REMOTE ] EAI: Fetching primary data for 2024-12. [2025-09-29T18:25:13.298694] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-29T18:25:13.620406] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-29T18:25:13.750344] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-29T18:25:13.948120] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-09-29T18:25:14.748128] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-09-29T18:25:15.548126] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-01. [2025-09-29T18:25:15.878667] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-29T18:25:16.128288] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-29T18:25:16.153939] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-29T18:25:16.348127] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-09-29T18:25:17.148143] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-09-29T18:25:17.800682] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-29T18:25:17.948090] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-09-29T18:25:18.430112] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-29T18:25:18.584153] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-29T18:25:18.748132] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-09-29T18:25:19.548136] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-09-29T18:25:20.050548] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-29T18:25:20.348140] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-09-29T18:25:20.409342] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-29T18:25:21.148163] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-09-29T18:25:21.722694] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-29T18:25:21.948161] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-09-29T18:25:22.160000] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-29T18:25:22.748152] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-09-29T18:25:23.548109] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-09-29T18:25:23.642811] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-29T18:25:24.096938] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-29T18:25:24.348157] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-09-29T18:25:24.722151] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-29T18:25:24.730587] [INFO ] [REMOTE ] DXYZ: Full fetch complete (57823 records). [2025-09-29T18:25:24.730794] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-09-29T18:25:25.163981] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-09-29T18:25:25.186177] [DEBUG] [VALIDATOR ] DXYZ: All expected trading days are present. [2025-09-29T18:25:25.186287] [DEBUG] [VALIDATOR ] DXYZ: Primary data validation passed. [2025-09-29T18:25:25.187241] [INFO ] [MAIN ] DXYZ: Fetched primary data is valid. [2025-09-29T18:25:25.187340] [DEBUG] [LOCAL ] DXYZ: Saving primary data. [2025-09-29T18:25:25.189300] [DEBUG] [LOCAL ] DXYZ: Trimmed 57823 records to 36627 (keeping 200 days of data) [2025-09-29T18:25:25.426312] [DEBUG] [LOCAL ] DXYZ: Primary data saved (36627 records). [2025-09-29T18:25:25.426550] [INFO ] [MAIN ] DXYZ: Full history saved. [2025-09-29T18:25:25.426670] [INFO ] [MAIN ] Update Progress: 674/2371 symbols completed. DXYZ took 47.4s. Estimated remaining: 3h 34m 57s. Rate: 7.9 symbols/min [2025-09-29T18:25:25.621252] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:25:25.662042] [DEBUG] [LOCAL ] EARN: Loaded 30576 existing records from primary storage. [2025-09-29T18:25:25.662416] [INFO ] [MAIN ] EARN: Loaded 30576 existing records. [2025-09-29T18:25:25.804863] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-29T18:25:25.879262] [WARN ] [MAIN ] EARN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:25:25.879806] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-09-29T18:25:25.880021] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-09-29T18:25:25.880756] [DEBUG] [LOCAL ] EARN: Deleted primary data file. [2025-09-29T18:25:25.888946] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-09-29T18:25:25.953388] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-09-29T18:25:26.000025] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-29T18:25:26.313417] [INFO ] [REMOTE ] EARN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:25:26.588201] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-29T18:25:26.748136] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-09-29T18:25:27.548128] [INFO ] [REMOTE ] EARN: Fetching primary data for 2024-12. [2025-09-29T18:25:28.329784] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-29T18:25:28.348071] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-09-29T18:25:29.025056] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-29T18:25:29.148206] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-09-29T18:25:29.683027] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-29T18:25:29.948086] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-01. [2025-09-29T18:25:30.010294] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-29T18:25:30.011864] [INFO ] [REMOTE ] EAI: Full fetch complete (6162 records). [2025-09-29T18:25:30.011969] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-09-29T18:25:30.395528] [DEBUG] [VALIDATOR ] EAI: All expected trading days are present. [2025-09-29T18:25:30.395632] [DEBUG] [VALIDATOR ] EAI: Primary data validation passed. [2025-09-29T18:25:30.395870] [INFO ] [MAIN ] EAI: Fetched primary data is valid. [2025-09-29T18:25:30.395937] [DEBUG] [LOCAL ] EAI: Saving primary data. [2025-09-29T18:25:30.396356] [DEBUG] [LOCAL ] EAI: Trimmed 6162 records to 3960 (keeping 200 days of data) [2025-09-29T18:25:30.422831] [DEBUG] [LOCAL ] EAI: Primary data saved (3960 records). [2025-09-29T18:25:30.422974] [INFO ] [MAIN ] EAI: Full history saved. [2025-09-29T18:25:30.423083] [INFO ] [MAIN ] Update Progress: 675/2371 symbols completed. EAI took 19.8s. Estimated remaining: 3h 34m 43s. Rate: 7.9 symbols/min [2025-09-29T18:25:30.603071] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:25:30.665039] [DEBUG] [LOCAL ] EAT: Loaded 50542 existing records from primary storage. [2025-09-29T18:25:30.665391] [INFO ] [MAIN ] EAT: Loaded 50542 existing records. [2025-09-29T18:25:30.753232] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-09-29T18:25:30.859679] [WARN ] [MAIN ] EAT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:25:30.859975] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-09-29T18:25:30.860025] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-09-29T18:25:30.860635] [DEBUG] [LOCAL ] EAT: Deleted primary data file. [2025-09-29T18:25:30.860754] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-09-29T18:25:31.242874] [INFO ] [REMOTE ] EAT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:25:31.265413] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-29T18:25:31.548119] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-09-29T18:25:32.232218] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-29T18:25:32.239071] [INFO ] [REMOTE ] E: Full fetch complete (48295 records). [2025-09-29T18:25:32.239218] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-09-29T18:25:32.351391] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-09-29T18:25:32.651919] [DEBUG] [VALIDATOR ] E: All expected trading days are present. [2025-09-29T18:25:32.652192] [DEBUG] [VALIDATOR ] E: Primary data validation passed. [2025-09-29T18:25:32.652966] [INFO ] [MAIN ] E: Fetched primary data is valid. [2025-09-29T18:25:32.653052] [DEBUG] [LOCAL ] E: Saving primary data. [2025-09-29T18:25:32.654453] [DEBUG] [LOCAL ] E: Trimmed 48295 records to 33269 (keeping 200 days of data) [2025-09-29T18:25:32.874826] [DEBUG] [LOCAL ] E: Primary data saved (33269 records). [2025-09-29T18:25:32.875150] [INFO ] [MAIN ] E: Full history saved. [2025-09-29T18:25:32.875373] [INFO ] [MAIN ] Update Progress: 676/2371 symbols completed. E took 32.7s. Estimated remaining: 3h 34m 23s. Rate: 7.9 symbols/min [2025-09-29T18:25:33.052464] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-29T18:25:33.088999] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:25:33.130929] [DEBUG] [LOCAL ] EB: Loaded 38017 existing records from primary storage. [2025-09-29T18:25:33.131228] [INFO ] [MAIN ] EB: Loaded 38017 existing records. [2025-09-29T18:25:33.153332] [INFO ] [REMOTE ] EAT: Fetching primary data for 2024-12. [2025-09-29T18:25:33.335916] [WARN ] [MAIN ] EB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:25:33.336227] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-09-29T18:25:33.336304] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-09-29T18:25:33.336870] [DEBUG] [LOCAL ] EB: Deleted primary data file. [2025-09-29T18:25:33.336949] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-09-29T18:25:33.743973] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:25:33.948108] [INFO ] [REMOTE ] EB: Fetching primary data for 2024-12. [2025-09-29T18:25:34.190236] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-29T18:25:34.748105] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-09-29T18:25:34.963055] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-29T18:25:35.534137] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-29T18:25:35.548065] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-01. [2025-09-29T18:25:36.347920] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-29T18:25:36.348119] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-09-29T18:25:37.148087] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-09-29T18:25:37.493115] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-29T18:25:37.953239] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-09-29T18:25:37.966113] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-29T18:25:38.302757] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-29T18:25:38.748157] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-09-29T18:25:39.548106] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-09-29T18:25:39.639889] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-29T18:25:40.253236] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-29T18:25:40.348166] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-09-29T18:25:40.980622] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-29T18:25:41.148133] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-09-29T18:25:41.948123] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-09-29T18:25:42.270319] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-29T18:25:42.339176] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-29T18:25:42.748124] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-09-29T18:25:43.417401] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-29T18:25:43.548141] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-09-29T18:25:44.348115] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-09-29T18:25:44.630918] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-29T18:25:44.932012] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-29T18:25:44.938857] [INFO ] [REMOTE ] EAF: Full fetch complete (64053 records). [2025-09-29T18:25:44.939081] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-09-29T18:25:44.939955] [FATAL] [VALIDATOR ] EAF: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:25:44.940059] [FATAL] [MAIN ] EAF: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:25:44.940115] [WARN ] [MAIN ] EAF: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:25:44.940169] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-09-29T18:25:44.940238] [DEBUG] [LOCAL ] EAF: No primary data file found to delete. [2025-09-29T18:25:44.940291] [INFO ] [LOCAL ] EAF: Starting deletion of derivative data. [2025-09-29T18:25:44.941083] [DEBUG] [LOCAL ] EAF: Deleted derivative data file. [2025-09-29T18:25:44.941210] [INFO ] [MAIN ] Update Progress: 677/2371 symbols completed. EAF took 38.9s. Estimated remaining: 3h 34m 26s. Rate: 7.9 symbols/min [2025-09-29T18:25:45.148189] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-09-29T18:25:45.517197] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-29T18:25:45.948126] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-09-29T18:25:46.748174] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-09-29T18:25:47.043173] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-29T18:25:47.228104] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-29T18:25:47.548168] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-09-29T18:25:48.348093] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-09-29T18:25:48.403937] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-29T18:25:48.453145] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-29T18:25:49.148133] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-09-29T18:25:49.948149] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-09-29T18:25:50.522989] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-29T18:25:50.549621] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-29T18:25:50.554448] [INFO ] [REMOTE ] EARN: Full fetch complete (45844 records). [2025-09-29T18:25:50.554575] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-09-29T18:25:50.555367] [FATAL] [VALIDATOR ] EARN: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:25:50.555459] [FATAL] [MAIN ] EARN: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:25:50.555504] [WARN ] [MAIN ] EARN: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:25:50.555578] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-09-29T18:25:50.555669] [DEBUG] [LOCAL ] EARN: No primary data file found to delete. [2025-09-29T18:25:50.555729] [INFO ] [LOCAL ] EARN: Starting deletion of derivative data. [2025-09-29T18:25:50.556110] [DEBUG] [LOCAL ] EARN: Deleted derivative data file. [2025-09-29T18:25:50.556270] [INFO ] [MAIN ] Update Progress: 678/2371 symbols completed. EARN took 25.1s. Estimated remaining: 3h 34m 14s. Rate: 7.9 symbols/min [2025-09-29T18:25:50.748139] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-09-29T18:25:51.747845] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-29T18:25:51.757577] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-09-29T18:25:52.534016] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-29T18:25:52.544542] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-09-29T18:25:53.208416] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-29T18:25:53.217127] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-09-29T18:25:54.397870] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-29T18:25:54.409532] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-09-29T18:25:54.532150] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-29T18:25:54.748138] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-09-29T18:25:56.200077] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-29T18:25:56.211105] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-09-29T18:25:56.274829] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-29T18:25:56.348129] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-09-29T18:25:57.779464] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-29T18:25:57.788132] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-09-29T18:25:58.093990] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-29T18:25:58.104785] [INFO ] [REMOTE ] EAT: Full fetch complete (71860 records). [2025-09-29T18:25:58.104948] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-09-29T18:25:58.519945] [DEBUG] [VALIDATOR ] EAT: All expected trading days are present. [2025-09-29T18:25:58.520051] [DEBUG] [VALIDATOR ] EAT: Primary data validation passed. [2025-09-29T18:25:58.521057] [INFO ] [MAIN ] EAT: Fetched primary data is valid. [2025-09-29T18:25:58.521130] [DEBUG] [LOCAL ] EAT: Saving primary data. [2025-09-29T18:25:58.522667] [DEBUG] [LOCAL ] EAT: Trimmed 71860 records to 49769 (keeping 200 days of data) [2025-09-29T18:25:58.844557] [DEBUG] [LOCAL ] EAT: Primary data saved (49769 records). [2025-09-29T18:25:58.844726] [INFO ] [MAIN ] EAT: Full history saved. [2025-09-29T18:25:58.844823] [INFO ] [MAIN ] Update Progress: 679/2371 symbols completed. EAT took 28.4s. Estimated remaining: 3h 34m 8s. Rate: 7.9 symbols/min [2025-09-29T18:25:58.897038] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-29T18:25:58.903964] [INFO ] [REMOTE ] EB: Full fetch complete (56371 records). [2025-09-29T18:25:58.904094] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-09-29T18:25:59.297607] [DEBUG] [VALIDATOR ] EB: All expected trading days are present. [2025-09-29T18:25:59.297754] [DEBUG] [VALIDATOR ] EB: Primary data validation passed. [2025-09-29T18:25:59.298558] [INFO ] [MAIN ] EB: Fetched primary data is valid. [2025-09-29T18:25:59.298606] [DEBUG] [LOCAL ] EB: Saving primary data. [2025-09-29T18:25:59.299884] [DEBUG] [LOCAL ] EB: Trimmed 56371 records to 37261 (keeping 200 days of data) [2025-09-29T18:25:59.514551] [DEBUG] [LOCAL ] EB: Primary data saved (37261 records). [2025-09-29T18:25:59.514740] [INFO ] [MAIN ] EB: Full history saved. [2025-09-29T18:25:59.514836] [INFO ] [MAIN ] Update Progress: 680/2371 symbols completed. EB took 26.6s. Estimated remaining: 3h 33m 43s. Rate: 7.9 symbols/min [2025-09-29T18:26:00.289581] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:26:00.323208] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:26:00.318704] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:26:00.355771] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:26:00.393564] [DEBUG] [LOCAL ] EBF: Loaded 19635 existing records from primary storage. [2025-09-29T18:26:00.394140] [INFO ] [MAIN ] EBF: Loaded 19635 existing records. [2025-09-29T18:26:00.505994] [DEBUG] [LOCAL ] EBS: Loaded 47455 existing records from primary storage. [2025-09-29T18:26:00.552326] [INFO ] [MAIN ] EBS: Loaded 47455 existing records. [2025-09-29T18:26:00.596420] [DEBUG] [LOCAL ] EBR: Loaded 43731 existing records from primary storage. [2025-09-29T18:26:00.645104] [INFO ] [MAIN ] EBR: Loaded 43731 existing records. [2025-09-29T18:26:00.651809] [DEBUG] [LOCAL ] EC: Loaded 50056 existing records from primary storage. [2025-09-29T18:26:00.768072] [INFO ] [MAIN ] EC: Loaded 50056 existing records. [2025-09-29T18:26:00.878706] [WARN ] [MAIN ] EBF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:26:00.955542] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-09-29T18:26:00.977627] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-09-29T18:26:01.158675] [WARN ] [MAIN ] EBS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:26:01.173367] [DEBUG] [LOCAL ] EBF: Deleted primary data file. [2025-09-29T18:26:01.177856] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-09-29T18:26:01.219371] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-09-29T18:26:01.178086] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-09-29T18:26:01.219221] [WARN ] [MAIN ] EBR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:26:01.235062] [DEBUG] [LOCAL ] EBS: Deleted primary data file. [2025-09-29T18:26:01.309594] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-09-29T18:26:01.287957] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-09-29T18:26:01.380119] [WARN ] [MAIN ] EC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:26:01.388311] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-09-29T18:26:01.452113] [DEBUG] [LOCAL ] EBR: Deleted primary data file. [2025-09-29T18:26:01.457623] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-09-29T18:26:01.539295] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-09-29T18:26:01.655436] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-09-29T18:26:01.726283] [DEBUG] [LOCAL ] EC: Deleted primary data file. [2025-09-29T18:26:01.808177] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-09-29T18:26:02.528924] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:26:02.599286] [INFO ] [REMOTE ] EBF: Fetching primary data for 2024-12. [2025-09-29T18:26:02.672406] [INFO ] [REMOTE ] EBR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:26:02.703771] [INFO ] [REMOTE ] EBR: Fetching primary data for 2024-12. [2025-09-29T18:26:02.703084] [INFO ] [REMOTE ] EBS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:26:02.735059] [INFO ] [REMOTE ] EBS: Fetching primary data for 2024-12. [2025-09-29T18:26:02.930976] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:26:02.931321] [INFO ] [REMOTE ] EC: Fetching primary data for 2024-12. [2025-09-29T18:26:03.855419] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-29T18:26:03.859740] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-09-29T18:26:04.309203] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-29T18:26:04.319904] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-01. [2025-09-29T18:26:04.408996] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-29T18:26:04.419631] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-01. [2025-09-29T18:26:04.450212] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-29T18:26:04.460977] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-09-29T18:26:04.506288] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-29T18:26:04.510391] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-09-29T18:26:05.608052] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-29T18:26:05.612715] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-09-29T18:26:05.949250] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-29T18:26:05.959222] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-09-29T18:26:05.993267] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-29T18:26:06.080702] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-29T18:26:06.482913] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-29T18:26:06.748161] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-09-29T18:26:07.548168] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-09-29T18:26:07.914596] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-29T18:26:08.348129] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-09-29T18:26:08.799295] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-29T18:26:08.929142] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-29T18:26:09.148163] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-09-29T18:26:09.948098] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-09-29T18:26:10.214498] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-29T18:26:10.290067] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-29T18:26:10.748160] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-09-29T18:26:11.548086] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-09-29T18:26:11.651138] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-29T18:26:11.847350] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-29T18:26:12.348140] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-09-29T18:26:13.030959] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-29T18:26:13.148097] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-09-29T18:26:13.169263] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-29T18:26:13.948126] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-09-29T18:26:14.723982] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-29T18:26:14.748190] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-09-29T18:26:15.351123] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-29T18:26:15.548206] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-09-29T18:26:16.319812] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-29T18:26:16.348092] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-09-29T18:26:16.544609] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-29T18:26:17.148139] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-09-29T18:26:17.948107] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-09-29T18:26:18.438225] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-29T18:26:18.748135] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-09-29T18:26:18.837615] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-29T18:26:19.039591] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-29T18:26:19.548135] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-09-29T18:26:20.348092] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-09-29T18:26:20.479506] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-29T18:26:21.148120] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-09-29T18:26:21.448544] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-29T18:26:21.795627] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-29T18:26:21.948123] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-09-29T18:26:22.748096] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-09-29T18:26:22.873718] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-29T18:26:23.391597] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-29T18:26:23.548115] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-09-29T18:26:23.614477] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-29T18:26:23.618408] [INFO ] [REMOTE ] EBF: Full fetch complete (27368 records). [2025-09-29T18:26:23.618521] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-09-29T18:26:24.028747] [DEBUG] [VALIDATOR ] EBF: All expected trading days are present. [2025-09-29T18:26:24.028856] [DEBUG] [VALIDATOR ] EBF: Primary data validation passed. [2025-09-29T18:26:24.029474] [INFO ] [MAIN ] EBF: Fetched primary data is valid. [2025-09-29T18:26:24.029529] [DEBUG] [LOCAL ] EBF: Saving primary data. [2025-09-29T18:26:24.030586] [DEBUG] [LOCAL ] EBF: Trimmed 27368 records to 19222 (keeping 200 days of data) [2025-09-29T18:26:24.156332] [DEBUG] [LOCAL ] EBF: Primary data saved (19222 records). [2025-09-29T18:26:24.156542] [INFO ] [MAIN ] EBF: Full history saved. [2025-09-29T18:26:24.156672] [INFO ] [MAIN ] Update Progress: 681/2371 symbols completed. EBF took 24.6s. Estimated remaining: 3h 34m 18s. Rate: 7.9 symbols/min [2025-09-29T18:26:24.336169] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:26:24.348128] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-09-29T18:26:24.372454] [DEBUG] [LOCAL ] ECAT: Loaded 30092 existing records from primary storage. [2025-09-29T18:26:24.372792] [INFO ] [MAIN ] ECAT: Loaded 30092 existing records. [2025-09-29T18:26:24.554114] [WARN ] [MAIN ] ECAT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:26:24.554387] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-09-29T18:26:24.554441] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-09-29T18:26:24.554935] [DEBUG] [LOCAL ] ECAT: Deleted primary data file. [2025-09-29T18:26:24.555001] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-09-29T18:26:24.950492] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:26:25.134581] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-29T18:26:25.148066] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-09-29T18:26:25.743165] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-29T18:26:25.948131] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-09-29T18:26:26.748092] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-09-29T18:26:26.783517] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-29T18:26:27.328890] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-29T18:26:27.548131] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-09-29T18:26:28.348114] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2024-12. [2025-09-29T18:26:28.564390] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-29T18:26:28.574586] [INFO ] [REMOTE ] EC: Full fetch complete (71961 records). [2025-09-29T18:26:28.574779] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-09-29T18:26:28.997142] [DEBUG] [VALIDATOR ] EC: All expected trading days are present. [2025-09-29T18:26:28.997263] [DEBUG] [VALIDATOR ] EC: Primary data validation passed. [2025-09-29T18:26:28.998324] [INFO ] [MAIN ] EC: Fetched primary data is valid. [2025-09-29T18:26:28.998408] [DEBUG] [LOCAL ] EC: Saving primary data. [2025-09-29T18:26:29.024560] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-29T18:26:29.033741] [DEBUG] [LOCAL ] EC: Trimmed 71961 records to 49282 (keeping 200 days of data) [2025-09-29T18:26:29.034761] [INFO ] [REMOTE ] EBR: Full fetch complete (62739 records). [2025-09-29T18:26:29.035037] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-09-29T18:26:29.153191] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-09-29T18:26:29.574810] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-29T18:26:29.595525] [DEBUG] [VALIDATOR ] EBR: All expected trading days are present. [2025-09-29T18:26:29.603202] [DEBUG] [VALIDATOR ] EBR: Primary data validation passed. [2025-09-29T18:26:29.604743] [INFO ] [MAIN ] EBR: Fetched primary data is valid. [2025-09-29T18:26:29.605446] [DEBUG] [LOCAL ] EBR: Saving primary data. [2025-09-29T18:26:29.610321] [DEBUG] [LOCAL ] EBR: Trimmed 62739 records to 43035 (keeping 200 days of data) [2025-09-29T18:26:29.936581] [DEBUG] [LOCAL ] EC: Primary data saved (49282 records). [2025-09-29T18:26:29.936854] [INFO ] [MAIN ] EC: Full history saved. [2025-09-29T18:26:29.938513] [INFO ] [MAIN ] Update Progress: 682/2371 symbols completed. EC took 30.4s. Estimated remaining: 3h 34m 6s. Rate: 7.9 symbols/min [2025-09-29T18:26:29.986385] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-01. [2025-09-29T18:26:30.237110] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:26:30.272601] [DEBUG] [LOCAL ] EBR: Primary data saved (43035 records). [2025-09-29T18:26:30.272774] [INFO ] [MAIN ] EBR: Full history saved. [2025-09-29T18:26:30.272905] [INFO ] [MAIN ] Update Progress: 683/2371 symbols completed. EBR took 30.8s. Estimated remaining: 3h 33m 40s. Rate: 7.9 symbols/min [2025-09-29T18:26:30.504075] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:26:30.504474] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-09-29T18:26:30.504587] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-09-29T18:26:30.505750] [DEBUG] [LOCAL ] ECC: Loaded 44025 existing records from primary storage. [2025-09-29T18:26:30.506300] [INFO ] [MAIN ] ECC: Loaded 44025 existing records. [2025-09-29T18:26:30.522682] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-09-29T18:26:30.553821] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-09-29T18:26:30.589885] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-09-29T18:26:30.616903] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-09-29T18:26:30.803151] [WARN ] [MAIN ] ECC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:26:30.816692] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-09-29T18:26:30.816849] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-09-29T18:26:30.838160] [DEBUG] [LOCAL ] ECC: Deleted primary data file. [2025-09-29T18:26:30.870002] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-09-29T18:26:31.328159] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:26:31.328752] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2024-12. [2025-09-29T18:26:31.451521] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-29T18:26:31.554098] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-09-29T18:26:31.554021] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-29T18:26:31.606485] [INFO ] [REMOTE ] ECC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:26:31.740226] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-29T18:26:32.348122] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-09-29T18:26:33.148097] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-09-29T18:26:33.381626] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-29T18:26:33.391943] [INFO ] [REMOTE ] EBS: Full fetch complete (67360 records). [2025-09-29T18:26:33.392106] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-09-29T18:26:33.485225] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-29T18:26:33.605235] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-29T18:26:33.900595] [DEBUG] [VALIDATOR ] EBS: All expected trading days are present. [2025-09-29T18:26:33.900722] [DEBUG] [VALIDATOR ] EBS: Primary data validation passed. [2025-09-29T18:26:33.901597] [INFO ] [MAIN ] EBS: Fetched primary data is valid. [2025-09-29T18:26:33.901686] [DEBUG] [LOCAL ] EBS: Saving primary data. [2025-09-29T18:26:33.903270] [DEBUG] [LOCAL ] EBS: Trimmed 67360 records to 46678 (keeping 200 days of data) [2025-09-29T18:26:33.950753] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-09-29T18:26:34.186604] [DEBUG] [LOCAL ] EBS: Primary data saved (46678 records). [2025-09-29T18:26:34.186818] [INFO ] [MAIN ] EBS: Full history saved. [2025-09-29T18:26:34.186961] [INFO ] [MAIN ] Update Progress: 684/2371 symbols completed. EBS took 34.6s. Estimated remaining: 3h 33m 24s. Rate: 7.9 symbols/min [2025-09-29T18:26:34.379890] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:26:34.380218] [DEBUG] [LOCAL ] ECCU: No existing data file found in primary storage. [2025-09-29T18:26:34.380279] [WARN ] [MAIN ] ECCU: No existing data found, performing full refresh instead. [2025-09-29T18:26:34.380402] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-09-29T18:26:34.380448] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-09-29T18:26:34.380498] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-09-29T18:26:34.380532] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-09-29T18:26:34.752299] [INFO ] [REMOTE ] ECC: Fetching primary data for 2024-12. [2025-09-29T18:26:34.757704] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:26:35.548104] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2024-12. [2025-09-29T18:26:35.653077] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-29T18:26:35.797606] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2024-12 (0.25 seconds). [2025-09-29T18:26:36.348117] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-09-29T18:26:36.476193] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-29T18:26:37.148105] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-01. [2025-09-29T18:26:37.732372] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-29T18:26:37.948138] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-09-29T18:26:38.351148] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-29T18:26:38.565624] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-29T18:26:38.748092] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-09-29T18:26:39.548128] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-09-29T18:26:39.883184] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-29T18:26:40.348132] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-09-29T18:26:40.689403] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-29T18:26:40.689577] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-29T18:26:41.148136] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-09-29T18:26:41.948158] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-09-29T18:26:42.748116] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-09-29T18:26:42.785112] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-29T18:26:43.211814] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-29T18:26:43.531234] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-29T18:26:43.548133] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-09-29T18:26:44.052284] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-29T18:26:44.348132] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-09-29T18:26:45.148116] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-09-29T18:26:45.583297] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-29T18:26:45.921899] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-29T18:26:45.948071] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-09-29T18:26:46.748139] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-09-29T18:26:47.005516] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-09-29T18:26:47.340254] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-29T18:26:47.548135] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-09-29T18:26:48.348116] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-09-29T18:26:48.907078] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-29T18:26:49.148120] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-09-29T18:26:49.175563] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-29T18:26:49.491359] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-29T18:26:49.948119] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-09-29T18:26:50.280611] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-29T18:26:50.748129] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-09-29T18:26:51.192139] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-29T18:26:51.193041] [INFO ] [REMOTE ] ECCC: Full fetch complete (1281 records). [2025-09-29T18:26:51.193118] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-09-29T18:26:51.389367] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-29T18:26:51.389629] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:26:51.389721] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:26:51.389802] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-09-29T18:26:51.389883] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-09-29T18:26:51.389924] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-09-29T18:26:51.390037] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-09-29T18:26:51.390138] [INFO ] [MAIN ] Update Progress: 685/2371 symbols completed. ECCC took 21.1s. Estimated remaining: 3h 33m 40s. Rate: 7.9 symbols/min [2025-09-29T18:26:51.551520] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-09-29T18:26:51.576014] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:26:51.577198] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-09-29T18:26:51.577256] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-09-29T18:26:51.577391] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-09-29T18:26:51.577472] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-09-29T18:26:51.577550] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-09-29T18:26:51.577598] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-09-29T18:26:51.956689] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:26:52.348152] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2024-12. [2025-09-29T18:26:52.789390] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-29T18:26:53.148151] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-09-29T18:26:53.202373] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-29T18:26:53.212273] [INFO ] [REMOTE ] ECAT: Full fetch complete (42555 records). [2025-09-29T18:26:53.212463] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-09-29T18:26:53.213470] [FATAL] [VALIDATOR ] ECAT: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:26:53.213619] [FATAL] [MAIN ] ECAT: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:26:53.213703] [WARN ] [MAIN ] ECAT: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:26:53.213778] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-09-29T18:26:53.213928] [DEBUG] [LOCAL ] ECAT: No primary data file found to delete. [2025-09-29T18:26:53.213986] [INFO ] [LOCAL ] ECAT: Starting deletion of derivative data. [2025-09-29T18:26:53.214413] [DEBUG] [LOCAL ] ECAT: Deleted derivative data file. [2025-09-29T18:26:53.214546] [INFO ] [MAIN ] Update Progress: 686/2371 symbols completed. ECAT took 29.1s. Estimated remaining: 3h 33m 18s. Rate: 7.9 symbols/min [2025-09-29T18:26:53.395405] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:26:53.398387] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-09-29T18:26:53.398304] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.25 seconds). [2025-09-29T18:26:53.398493] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-09-29T18:26:53.398775] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-09-29T18:26:53.399878] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-09-29T18:26:53.399941] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-09-29T18:26:53.400005] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-09-29T18:26:53.761966] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:26:53.948207] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-09-29T18:26:54.320128] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-29T18:26:54.748104] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-09-29T18:26:55.548128] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2024-12. [2025-09-29T18:26:55.985398] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-29T18:26:56.348118] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-09-29T18:26:56.404675] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-29T18:26:56.810262] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-29T18:26:57.148146] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-09-29T18:26:57.569612] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-29T18:26:57.948242] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-09-29T18:26:58.291630] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-29T18:26:58.748156] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-09-29T18:26:59.190344] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-29T18:26:59.548137] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-09-29T18:27:00.007298] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-29T18:27:00.348128] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-09-29T18:27:00.833974] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-29T18:27:01.148128] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-09-29T18:27:01.620335] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-29T18:27:01.948205] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-09-29T18:27:02.748152] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-09-29T18:27:03.513330] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-29T18:27:03.546137] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-29T18:27:03.554501] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-09-29T18:27:03.885325] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-29T18:27:04.348146] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-09-29T18:27:04.757785] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-29T18:27:05.148117] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-09-29T18:27:05.948117] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-09-29T18:27:06.413281] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-29T18:27:06.748134] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-09-29T18:27:06.978240] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-29T18:27:07.118909] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-29T18:27:07.548156] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-09-29T18:27:08.090285] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-29T18:27:08.348136] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-09-29T18:27:08.696912] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-29T18:27:09.148131] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-09-29T18:27:09.948117] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-09-29T18:27:10.307069] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-29T18:27:10.748126] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-09-29T18:27:10.976444] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-29T18:27:11.339666] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-29T18:27:11.340631] [INFO ] [REMOTE ] ECCU: Full fetch complete (4460 records). [2025-09-29T18:27:11.340741] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-09-29T18:27:11.341173] [FATAL] [VALIDATOR ] ECCU: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:27:11.341258] [FATAL] [MAIN ] ECCU: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:27:11.341301] [WARN ] [MAIN ] ECCU: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:27:11.341339] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-09-29T18:27:11.341410] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-09-29T18:27:11.341466] [INFO ] [LOCAL ] ECCU: Starting deletion of derivative data. [2025-09-29T18:27:11.341510] [DEBUG] [LOCAL ] ECCU: No derivative data file found to delete. [2025-09-29T18:27:11.341572] [INFO ] [MAIN ] Update Progress: 687/2371 symbols completed. ECCU took 37.2s. Estimated remaining: 3h 33m 36s. Rate: 7.9 symbols/min [2025-09-29T18:27:11.531622] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:27:11.548127] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-09-29T18:27:11.589847] [DEBUG] [LOCAL ] ECG: Loaded 34619 existing records from primary storage. [2025-09-29T18:27:11.590203] [INFO ] [MAIN ] ECG: Loaded 34619 existing records. [2025-09-29T18:27:11.789102] [WARN ] [MAIN ] ECG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:27:11.789321] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-09-29T18:27:11.789370] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-09-29T18:27:11.789812] [DEBUG] [LOCAL ] ECG: Deleted primary data file. [2025-09-29T18:27:11.789873] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-09-29T18:27:12.067665] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-29T18:27:12.188022] [INFO ] [REMOTE ] ECG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:27:12.348123] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-09-29T18:27:12.622229] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-09-29T18:27:13.148119] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-09-29T18:27:13.948129] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-09-29T18:27:14.559516] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-29T18:27:14.560370] [INFO ] [REMOTE ] ECCW: Full fetch complete (1418 records). [2025-09-29T18:27:14.560442] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-09-29T18:27:14.560844] [FATAL] [VALIDATOR ] ECCW: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:27:14.560930] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:27:14.560975] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:27:14.561015] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-09-29T18:27:14.561074] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-09-29T18:27:14.561112] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-09-29T18:27:14.561152] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-09-29T18:27:14.561208] [INFO ] [MAIN ] Update Progress: 688/2371 symbols completed. ECCW took 23.2s. Estimated remaining: 3h 33m 18s. Rate: 7.9 symbols/min [2025-09-29T18:27:14.746268] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:27:14.748088] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-09-29T18:27:14.806920] [DEBUG] [LOCAL ] ECL: Loaded 47489 existing records from primary storage. [2025-09-29T18:27:14.807272] [INFO ] [MAIN ] ECL: Loaded 47489 existing records. [2025-09-29T18:27:14.999981] [WARN ] [MAIN ] ECL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:27:15.000280] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-09-29T18:27:15.000433] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-09-29T18:27:15.009967] [DEBUG] [LOCAL ] ECL: Deleted primary data file. [2025-09-29T18:27:15.024588] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-09-29T18:27:15.098229] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-29T18:27:15.109483] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-29T18:27:15.149986] [INFO ] [REMOTE ] ECC: Full fetch complete (60653 records). [2025-09-29T18:27:15.160842] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-09-29T18:27:15.199208] [FATAL] [VALIDATOR ] ECC: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:27:15.210921] [FATAL] [MAIN ] ECC: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:27:15.220695] [WARN ] [MAIN ] ECC: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:27:15.239519] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-09-29T18:27:15.275913] [DEBUG] [LOCAL ] ECC: No primary data file found to delete. [2025-09-29T18:27:15.315413] [INFO ] [LOCAL ] ECC: Starting deletion of derivative data. [2025-09-29T18:27:15.338472] [DEBUG] [LOCAL ] ECC: Deleted derivative data file. [2025-09-29T18:27:15.350088] [INFO ] [MAIN ] Update Progress: 689/2371 symbols completed. ECC took 45.4s. Estimated remaining: 3h 32m 54s. Rate: 7.9 symbols/min [2025-09-29T18:27:15.572849] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-09-29T18:27:15.586461] [INFO ] [REMOTE ] ECL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:27:15.690895] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:27:15.716490] [DEBUG] [LOCAL ] ECO: Loaded 18768 existing records from primary storage. [2025-09-29T18:27:15.716791] [INFO ] [MAIN ] ECO: Loaded 18768 existing records. [2025-09-29T18:27:15.914072] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:27:15.914286] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-09-29T18:27:15.914336] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-09-29T18:27:15.914668] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-09-29T18:27:15.914731] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-09-29T18:27:16.078853] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-29T18:27:16.294028] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:27:16.348142] [INFO ] [REMOTE ] ECG: Fetching primary data for 2024-12. [2025-09-29T18:27:17.148140] [INFO ] [REMOTE ] ECL: Fetching primary data for 2024-12. [2025-09-29T18:27:17.791585] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-29T18:27:17.948110] [INFO ] [REMOTE ] ECO: Fetching primary data for 2024-12. [2025-09-29T18:27:18.724708] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-29T18:27:18.748084] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-01. [2025-09-29T18:27:19.042686] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-29T18:27:19.548124] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-01. [2025-09-29T18:27:20.348120] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-09-29T18:27:20.445922] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-29T18:27:20.831962] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-29T18:27:21.096507] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-29T18:27:21.148119] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-09-29T18:27:21.948126] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-09-29T18:27:22.370890] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-29T18:27:22.748107] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-09-29T18:27:23.280185] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-29T18:27:23.548124] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-09-29T18:27:23.945816] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-29T18:27:23.946753] [INFO ] [REMOTE ] ECCX: Full fetch complete (1501 records). [2025-09-29T18:27:23.946827] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-09-29T18:27:23.947182] [FATAL] [VALIDATOR ] ECCX: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:27:23.947268] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:27:23.947375] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:27:23.947489] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-09-29T18:27:23.947568] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-09-29T18:27:23.947608] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-09-29T18:27:23.947680] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-09-29T18:27:23.947779] [INFO ] [MAIN ] Update Progress: 690/2371 symbols completed. ECCX took 30.7s. Estimated remaining: 3h 32m 48s. Rate: 7.9 symbols/min [2025-09-29T18:27:24.138484] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:27:24.197906] [DEBUG] [LOCAL ] ECVT: Loaded 43587 existing records from primary storage. [2025-09-29T18:27:24.198289] [INFO ] [MAIN ] ECVT: Loaded 43587 existing records. [2025-09-29T18:27:24.349092] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-09-29T18:27:24.387480] [WARN ] [MAIN ] ECVT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:27:24.388581] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-09-29T18:27:24.388675] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-09-29T18:27:24.397355] [DEBUG] [LOCAL ] ECVT: Deleted primary data file. [2025-09-29T18:27:24.411635] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-09-29T18:27:24.460606] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-29T18:27:24.810543] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:27:25.148144] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2024-12. [2025-09-29T18:27:25.568906] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-29T18:27:25.948113] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-09-29T18:27:26.657541] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-29T18:27:26.748113] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-01. [2025-09-29T18:27:27.553280] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-09-29T18:27:27.566074] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-29T18:27:28.122514] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-29T18:27:28.348109] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-09-29T18:27:28.684089] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-29T18:27:29.148107] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-09-29T18:27:29.726201] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-29T18:27:29.948111] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-09-29T18:27:30.748104] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-09-29T18:27:30.949537] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-29T18:27:31.077929] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-29T18:27:31.548115] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-09-29T18:27:32.239522] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-29T18:27:32.348116] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-09-29T18:27:33.148101] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-09-29T18:27:33.384486] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-29T18:27:33.727224] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-29T18:27:33.948114] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-09-29T18:27:34.734225] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-29T18:27:34.748071] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-09-29T18:27:35.082325] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-29T18:27:35.548166] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-09-29T18:27:36.348094] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-09-29T18:27:36.444600] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-29T18:27:36.475873] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-29T18:27:37.148108] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-09-29T18:27:37.635781] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-29T18:27:37.948151] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-09-29T18:27:38.595225] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-29T18:27:38.748110] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-09-29T18:27:39.382084] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-29T18:27:39.548105] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-09-29T18:27:40.332711] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-29T18:27:40.348068] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-09-29T18:27:40.929090] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-29T18:27:40.935436] [INFO ] [REMOTE ] ECG: Full fetch complete (51361 records). [2025-09-29T18:27:40.935545] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-09-29T18:27:41.162159] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-09-29T18:27:41.354819] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present. [2025-09-29T18:27:41.354937] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed. [2025-09-29T18:27:41.356261] [INFO ] [MAIN ] ECG: Fetched primary data is valid. [2025-09-29T18:27:41.356346] [DEBUG] [LOCAL ] ECG: Saving primary data. [2025-09-29T18:27:41.357751] [DEBUG] [LOCAL ] ECG: Trimmed 51361 records to 33936 (keeping 200 days of data) [2025-09-29T18:27:41.584679] [DEBUG] [LOCAL ] ECG: Primary data saved (33936 records). [2025-09-29T18:27:41.584855] [INFO ] [MAIN ] ECG: Full history saved. [2025-09-29T18:27:41.584978] [INFO ] [MAIN ] Update Progress: 691/2371 symbols completed. ECG took 30.2s. Estimated remaining: 3h 33m 5s. Rate: 7.9 symbols/min [2025-09-29T18:27:41.773532] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:27:41.842609] [DEBUG] [LOCAL ] ED: Loaded 53539 existing records from primary storage. [2025-09-29T18:27:41.843335] [INFO ] [MAIN ] ED: Loaded 53539 existing records. [2025-09-29T18:27:41.953995] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-09-29T18:27:42.049261] [WARN ] [MAIN ] ED: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:27:42.049707] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-09-29T18:27:42.049891] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-09-29T18:27:42.050952] [DEBUG] [LOCAL ] ED: Deleted primary data file. [2025-09-29T18:27:42.051036] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-09-29T18:27:42.361809] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-29T18:27:42.489717] [INFO ] [REMOTE ] ED: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:27:42.504480] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-29T18:27:42.748110] [INFO ] [REMOTE ] ED: Fetching primary data for 2024-12. [2025-09-29T18:27:43.548091] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-09-29T18:27:43.711268] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-29T18:27:44.348122] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-09-29T18:27:44.483570] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-29T18:27:45.148170] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-09-29T18:27:45.274806] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-29T18:27:45.865145] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-29T18:27:45.948128] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-01. [2025-09-29T18:27:46.216372] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-29T18:27:46.748112] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-09-29T18:27:47.548092] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-09-29T18:27:47.666238] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-29T18:27:47.838369] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-29T18:27:48.348115] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-09-29T18:27:48.864883] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-29T18:27:49.148130] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-09-29T18:27:49.579765] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-29T18:27:49.584094] [INFO ] [REMOTE ] ECO: Full fetch complete (29245 records). [2025-09-29T18:27:49.584222] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-09-29T18:27:49.961332] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-09-29T18:27:49.976518] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-09-29T18:27:49.976613] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-09-29T18:27:49.977244] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-09-29T18:27:49.977423] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-09-29T18:27:49.978300] [DEBUG] [LOCAL ] ECO: Trimmed 29245 records to 18367 (keeping 200 days of data) [2025-09-29T18:27:50.107122] [DEBUG] [LOCAL ] ECO: Primary data saved (18367 records). [2025-09-29T18:27:50.107286] [INFO ] [MAIN ] ECO: Full history saved. [2025-09-29T18:27:50.107399] [INFO ] [MAIN ] Update Progress: 692/2371 symbols completed. ECO took 34.8s. Estimated remaining: 3h 32m 60s. Rate: 7.9 symbols/min [2025-09-29T18:27:50.293935] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:27:50.324305] [DEBUG] [LOCAL ] EDD: Loaded 27470 existing records from primary storage. [2025-09-29T18:27:50.324596] [INFO ] [MAIN ] EDD: Loaded 27470 existing records. [2025-09-29T18:27:50.511555] [WARN ] [MAIN ] EDD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:27:50.511951] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-09-29T18:27:50.512039] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-09-29T18:27:50.512635] [DEBUG] [LOCAL ] EDD: Deleted primary data file. [2025-09-29T18:27:50.512742] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-09-29T18:27:50.699486] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-29T18:27:50.753689] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-09-29T18:27:50.934969] [INFO ] [REMOTE ] EDD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:27:51.548093] [INFO ] [REMOTE ] EDD: Fetching primary data for 2024-12. [2025-09-29T18:27:51.642896] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-29T18:27:51.653622] [INFO ] [REMOTE ] ECL: Full fetch complete (67847 records). [2025-09-29T18:27:51.653784] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-09-29T18:27:52.066868] [DEBUG] [VALIDATOR ] ECL: All expected trading days are present. [2025-09-29T18:27:52.066984] [DEBUG] [VALIDATOR ] ECL: Primary data validation passed. [2025-09-29T18:27:52.067947] [INFO ] [MAIN ] ECL: Fetched primary data is valid. [2025-09-29T18:27:52.068012] [DEBUG] [LOCAL ] ECL: Saving primary data. [2025-09-29T18:27:52.069310] [DEBUG] [LOCAL ] ECL: Trimmed 67847 records to 46782 (keeping 200 days of data) [2025-09-29T18:27:52.362292] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-09-29T18:27:52.389826] [DEBUG] [LOCAL ] ECL: Primary data saved (46782 records). [2025-09-29T18:27:52.389973] [INFO ] [MAIN ] ECL: Full history saved. [2025-09-29T18:27:52.391148] [INFO ] [MAIN ] Update Progress: 693/2371 symbols completed. ECL took 37.8s. Estimated remaining: 3h 32m 39s. Rate: 7.9 symbols/min [2025-09-29T18:27:52.587245] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:27:52.622989] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-29T18:27:52.645551] [DEBUG] [LOCAL ] EDF: Loaded 13627 existing records from primary storage. [2025-09-29T18:27:52.646001] [INFO ] [MAIN ] EDF: Loaded 13627 existing records. [2025-09-29T18:27:52.847414] [WARN ] [MAIN ] EDF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:27:52.859880] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-09-29T18:27:52.860881] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-09-29T18:27:52.860772] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-29T18:27:52.868295] [DEBUG] [LOCAL ] EDF: Deleted primary data file. [2025-09-29T18:27:52.868384] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-09-29T18:27:53.153317] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-01. [2025-09-29T18:27:53.222064] [INFO ] [REMOTE ] EDF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:27:53.948150] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-09-29T18:27:54.036637] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-29T18:27:54.048260] [INFO ] [REMOTE ] ECVT: Full fetch complete (59989 records). [2025-09-29T18:27:54.048477] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-09-29T18:27:54.427410] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-29T18:27:54.538299] [DEBUG] [VALIDATOR ] ECVT: All expected trading days are present. [2025-09-29T18:27:54.538414] [DEBUG] [VALIDATOR ] ECVT: Primary data validation passed. [2025-09-29T18:27:54.539422] [INFO ] [MAIN ] ECVT: Fetched primary data is valid. [2025-09-29T18:27:54.539514] [DEBUG] [LOCAL ] ECVT: Saving primary data. [2025-09-29T18:27:54.541323] [DEBUG] [LOCAL ] ECVT: Trimmed 59989 records to 42947 (keeping 200 days of data) [2025-09-29T18:27:54.748784] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-09-29T18:27:54.798919] [DEBUG] [LOCAL ] ECVT: Primary data saved (42947 records). [2025-09-29T18:27:54.799088] [INFO ] [MAIN ] ECVT: Full history saved. [2025-09-29T18:27:54.799208] [INFO ] [MAIN ] Update Progress: 694/2371 symbols completed. ECVT took 30.9s. Estimated remaining: 3h 32m 19s. Rate: 7.9 symbols/min [2025-09-29T18:27:54.993851] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:27:55.013875] [DEBUG] [LOCAL ] EDN: Loaded 18501 existing records from primary storage. [2025-09-29T18:27:55.014119] [INFO ] [MAIN ] EDN: Loaded 18501 existing records. [2025-09-29T18:27:55.194661] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:27:55.194912] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-09-29T18:27:55.194972] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-09-29T18:27:55.195272] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-09-29T18:27:55.195335] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-09-29T18:27:55.548815] [INFO ] [REMOTE ] EDF: Fetching primary data for 2024-12. [2025-09-29T18:27:55.589405] [INFO ] [REMOTE ] EDN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:27:55.676974] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-29T18:27:55.904338] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-29T18:27:56.348150] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-09-29T18:27:56.564881] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-29T18:27:57.148113] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-09-29T18:27:57.948166] [INFO ] [REMOTE ] EDN: Fetching primary data for 2024-12. [2025-09-29T18:27:58.229276] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-29T18:27:58.620498] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-29T18:27:58.748161] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-01. [2025-09-29T18:27:59.254537] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-29T18:27:59.548245] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-09-29T18:27:59.881521] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-29T18:28:00.348138] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-09-29T18:28:00.841343] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-29T18:28:01.148082] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-09-29T18:28:01.462067] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-29T18:28:01.948096] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-09-29T18:28:02.274261] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-29T18:28:02.748097] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-09-29T18:28:02.942273] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-29T18:28:03.548083] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-09-29T18:28:03.895998] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-29T18:28:04.348093] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-01. [2025-09-29T18:28:04.648321] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-29T18:28:05.148167] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-09-29T18:28:05.851338] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-29T18:28:05.948089] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-09-29T18:28:06.421305] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-29T18:28:06.748118] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-09-29T18:28:06.876673] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-29T18:28:07.548092] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-09-29T18:28:07.857508] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-29T18:28:08.348601] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-09-29T18:28:08.349967] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-29T18:28:09.148128] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-09-29T18:28:09.824978] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-29T18:28:09.831020] [INFO ] [REMOTE ] EDD: Full fetch complete (38951 records). [2025-09-29T18:28:09.831163] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-09-29T18:28:09.953229] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-09-29T18:28:10.234098] [DEBUG] [VALIDATOR ] EDD: All expected trading days are present. [2025-09-29T18:28:10.234296] [DEBUG] [VALIDATOR ] EDD: Primary data validation passed. [2025-09-29T18:28:10.234996] [INFO ] [MAIN ] EDD: Fetched primary data is valid. [2025-09-29T18:28:10.235060] [DEBUG] [LOCAL ] EDD: Saving primary data. [2025-09-29T18:28:10.236250] [DEBUG] [LOCAL ] EDD: Trimmed 38951 records to 27095 (keeping 200 days of data) [2025-09-29T18:28:10.331152] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-29T18:28:10.410035] [DEBUG] [LOCAL ] EDD: Primary data saved (27095 records). [2025-09-29T18:28:10.410189] [INFO ] [MAIN ] EDD: Full history saved. [2025-09-29T18:28:10.410316] [INFO ] [MAIN ] Update Progress: 695/2371 symbols completed. EDD took 20.3s. Estimated remaining: 3h 32m 31s. Rate: 7.9 symbols/min [2025-09-29T18:28:10.590328] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:28:10.645912] [DEBUG] [LOCAL ] EDU: Loaded 45666 existing records from primary storage. [2025-09-29T18:28:10.646306] [INFO ] [MAIN ] EDU: Loaded 45666 existing records. [2025-09-29T18:28:10.753749] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-09-29T18:28:10.844428] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:28:10.844636] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-09-29T18:28:10.844721] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-09-29T18:28:10.845208] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-09-29T18:28:10.845269] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-09-29T18:28:11.265507] [INFO ] [REMOTE ] EDU: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:28:11.278700] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-29T18:28:11.443462] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-29T18:28:11.548102] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-09-29T18:28:12.348117] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-09-29T18:28:13.148141] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-09-29T18:28:13.371044] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-29T18:28:13.374396] [INFO ] [REMOTE ] EDF: Full fetch complete (20983 records). [2025-09-29T18:28:13.374523] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-09-29T18:28:13.782216] [DEBUG] [VALIDATOR ] EDF: All expected trading days are present. [2025-09-29T18:28:13.782429] [DEBUG] [VALIDATOR ] EDF: Primary data validation passed. [2025-09-29T18:28:13.783126] [INFO ] [MAIN ] EDF: Fetched primary data is valid. [2025-09-29T18:28:13.783345] [DEBUG] [LOCAL ] EDF: Saving primary data. [2025-09-29T18:28:13.800943] [DEBUG] [LOCAL ] EDF: Trimmed 20983 records to 13397 (keeping 200 days of data) [2025-09-29T18:28:13.860135] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-09-29T18:28:13.867523] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-29T18:28:13.928175] [DEBUG] [LOCAL ] EDF: Primary data saved (13397 records). [2025-09-29T18:28:13.928332] [INFO ] [MAIN ] EDF: Full history saved. [2025-09-29T18:28:13.928422] [INFO ] [MAIN ] Update Progress: 696/2371 symbols completed. EDF took 21.5s. Estimated remaining: 3h 32m 13s. Rate: 7.9 symbols/min [2025-09-29T18:28:13.957603] [INFO ] [REMOTE ] EDU: Fetching primary data for 2024-12. [2025-09-29T18:28:14.107472] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:28:14.143357] [DEBUG] [LOCAL ] EE: Loaded 32973 existing records from primary storage. [2025-09-29T18:28:14.143708] [INFO ] [MAIN ] EE: Loaded 32973 existing records. [2025-09-29T18:28:14.336567] [WARN ] [MAIN ] EE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:28:14.336861] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-09-29T18:28:14.336919] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-09-29T18:28:14.337337] [DEBUG] [LOCAL ] EE: Deleted primary data file. [2025-09-29T18:28:14.337398] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-09-29T18:28:14.711991] [INFO ] [REMOTE ] EE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:28:14.748106] [INFO ] [REMOTE ] EE: Fetching primary data for 2024-12. [2025-09-29T18:28:15.548157] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-09-29T18:28:15.791963] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-29T18:28:15.933076] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-29T18:28:16.348122] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-09-29T18:28:17.148122] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-09-29T18:28:17.445760] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-29T18:28:17.501715] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-29T18:28:17.877851] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-29T18:28:17.948127] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-09-29T18:28:18.748105] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-01. [2025-09-29T18:28:19.025575] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-29T18:28:19.548117] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-09-29T18:28:20.348112] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-09-29T18:28:20.483322] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-29T18:28:21.148077] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-09-29T18:28:21.409845] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-29T18:28:21.527948] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-29T18:28:21.948131] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-09-29T18:28:22.513245] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-29T18:28:22.748128] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-09-29T18:28:23.548120] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-09-29T18:28:23.839858] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-29T18:28:24.177420] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-29T18:28:24.348158] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-09-29T18:28:24.790361] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-29T18:28:25.148135] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-09-29T18:28:25.736266] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-29T18:28:25.948114] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-09-29T18:28:26.748122] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-09-29T18:28:27.176505] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-29T18:28:27.188040] [INFO ] [REMOTE ] ED: Full fetch complete (76345 records). [2025-09-29T18:28:27.188271] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-09-29T18:28:27.529319] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-29T18:28:27.554357] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-09-29T18:28:27.658738] [DEBUG] [VALIDATOR ] ED: All expected trading days are present. [2025-09-29T18:28:27.658841] [DEBUG] [VALIDATOR ] ED: Primary data validation passed. [2025-09-29T18:28:27.659914] [INFO ] [MAIN ] ED: Fetched primary data is valid. [2025-09-29T18:28:27.659983] [DEBUG] [LOCAL ] ED: Saving primary data. [2025-09-29T18:28:27.661498] [DEBUG] [LOCAL ] ED: Trimmed 76345 records to 52759 (keeping 200 days of data) [2025-09-29T18:28:28.019119] [DEBUG] [LOCAL ] ED: Primary data saved (52759 records). [2025-09-29T18:28:28.019305] [INFO ] [MAIN ] ED: Full history saved. [2025-09-29T18:28:28.019405] [INFO ] [MAIN ] Update Progress: 697/2371 symbols completed. ED took 46.4s. Estimated remaining: 3h 32m 21s. Rate: 7.9 symbols/min [2025-09-29T18:28:28.202170] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:28:28.202384] [DEBUG] [LOCAL ] EEA: No existing data file found in primary storage. [2025-09-29T18:28:28.202441] [WARN ] [MAIN ] EEA: No existing data found, performing full refresh instead. [2025-09-29T18:28:28.202594] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-09-29T18:28:28.202691] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-09-29T18:28:28.202753] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-09-29T18:28:28.202789] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-09-29T18:28:28.356610] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-09-29T18:28:28.660582] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:28:28.672596] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-29T18:28:28.735547] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-29T18:28:29.148113] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-09-29T18:28:29.490224] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-29T18:28:29.948101] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-09-29T18:28:30.168285] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-29T18:28:30.748085] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-09-29T18:28:31.548122] [INFO ] [REMOTE ] EEA: Fetching primary data for 2024-12. [2025-09-29T18:28:31.653449] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-29T18:28:31.979589] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-29T18:28:32.096326] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-29T18:28:32.348106] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-09-29T18:28:33.148107] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-09-29T18:28:33.725342] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-29T18:28:33.758497] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-29T18:28:33.948135] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-09-29T18:28:34.748131] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-09-29T18:28:35.270996] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-29T18:28:35.276606] [INFO ] [REMOTE ] EDN: Full fetch complete (30361 records). [2025-09-29T18:28:35.276745] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-09-29T18:28:35.553228] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-09-29T18:28:35.670405] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-09-29T18:28:35.670485] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-09-29T18:28:35.671101] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-09-29T18:28:35.671165] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-09-29T18:28:35.671953] [DEBUG] [LOCAL ] EDN: Trimmed 30361 records to 18073 (keeping 200 days of data) [2025-09-29T18:28:35.786143] [DEBUG] [LOCAL ] EDN: Primary data saved (18073 records). [2025-09-29T18:28:35.786351] [INFO ] [MAIN ] EDN: Full history saved. [2025-09-29T18:28:35.786454] [INFO ] [MAIN ] Update Progress: 698/2371 symbols completed. EDN took 41.0s. Estimated remaining: 3h 32m 14s. Rate: 7.9 symbols/min [2025-09-29T18:28:35.974474] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:28:35.989540] [DEBUG] [LOCAL ] EEX: Loaded 12042 existing records from primary storage. [2025-09-29T18:28:35.990011] [INFO ] [MAIN ] EEX: Loaded 12042 existing records. [2025-09-29T18:28:36.193820] [WARN ] [MAIN ] EEX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:28:36.194187] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-09-29T18:28:36.194366] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-09-29T18:28:36.194818] [DEBUG] [LOCAL ] EEX: Deleted primary data file. [2025-09-29T18:28:36.207939] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-09-29T18:28:36.243461] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-29T18:28:36.262748] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-29T18:28:36.353220] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-09-29T18:28:36.644135] [INFO ] [REMOTE ] EEX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:28:37.148125] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-09-29T18:28:37.733340] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-29T18:28:37.948092] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-09-29T18:28:38.029838] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-29T18:28:38.613255] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-29T18:28:38.748144] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-09-29T18:28:39.548133] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-09-29T18:28:40.056933] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-29T18:28:40.189074] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-29T18:28:40.195476] [INFO ] [REMOTE ] EE: Full fetch complete (43571 records). [2025-09-29T18:28:40.195608] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-09-29T18:28:40.354571] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-09-29T18:28:40.598120] [DEBUG] [VALIDATOR ] EE: All expected trading days are present. [2025-09-29T18:28:40.598233] [DEBUG] [VALIDATOR ] EE: Primary data validation passed. [2025-09-29T18:28:40.598968] [INFO ] [MAIN ] EE: Fetched primary data is valid. [2025-09-29T18:28:40.599035] [DEBUG] [LOCAL ] EE: Saving primary data. [2025-09-29T18:28:40.600102] [DEBUG] [LOCAL ] EE: Trimmed 43571 records to 32516 (keeping 200 days of data) [2025-09-29T18:28:40.813674] [DEBUG] [LOCAL ] EE: Primary data saved (32516 records). [2025-09-29T18:28:40.813843] [INFO ] [MAIN ] EE: Full history saved. [2025-09-29T18:28:40.813949] [INFO ] [MAIN ] Update Progress: 699/2371 symbols completed. EE took 26.9s. Estimated remaining: 3h 32m 0s. Rate: 7.9 symbols/min [2025-09-29T18:28:40.997488] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:28:41.046690] [DEBUG] [LOCAL ] EFC: Loaded 46944 existing records from primary storage. [2025-09-29T18:28:41.047033] [INFO ] [MAIN ] EFC: Loaded 46944 existing records. [2025-09-29T18:28:41.150245] [INFO ] [REMOTE ] EEX: Fetching primary data for 2024-12. [2025-09-29T18:28:41.236310] [WARN ] [MAIN ] EFC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:28:41.236609] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-09-29T18:28:41.236687] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-09-29T18:28:41.237256] [DEBUG] [LOCAL ] EFC: Deleted primary data file. [2025-09-29T18:28:41.237320] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-09-29T18:28:41.625240] [INFO ] [REMOTE ] EFC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:28:41.948193] [INFO ] [REMOTE ] EFC: Fetching primary data for 2024-12. [2025-09-29T18:28:42.173973] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-29T18:28:42.331762] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-29T18:28:42.748144] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-01. [2025-09-29T18:28:43.548142] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-09-29T18:28:43.592227] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-29T18:28:43.812366] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-29T18:28:44.348157] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-09-29T18:28:44.848047] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-29T18:28:45.125426] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-29T18:28:45.148091] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-09-29T18:28:45.948119] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-09-29T18:28:46.576317] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-29T18:28:46.748122] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-09-29T18:28:46.971469] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-29T18:28:46.981095] [INFO ] [REMOTE ] EDU: Full fetch complete (66451 records). [2025-09-29T18:28:46.981223] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-09-29T18:28:47.158833] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-29T18:28:47.387811] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present. [2025-09-29T18:28:47.387931] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed. [2025-09-29T18:28:47.389059] [INFO ] [MAIN ] EDU: Fetched primary data is valid. [2025-09-29T18:28:47.389140] [DEBUG] [LOCAL ] EDU: Saving primary data. [2025-09-29T18:28:47.390682] [DEBUG] [LOCAL ] EDU: Trimmed 66451 records to 44931 (keeping 200 days of data) [2025-09-29T18:28:47.560222] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-09-29T18:28:47.663199] [DEBUG] [LOCAL ] EDU: Primary data saved (44931 records). [2025-09-29T18:28:47.663339] [INFO ] [MAIN ] EDU: Full history saved. [2025-09-29T18:28:47.663433] [INFO ] [MAIN ] Update Progress: 700/2371 symbols completed. EDU took 37.3s. Estimated remaining: 3h 31m 51s. Rate: 7.9 symbols/min [2025-09-29T18:28:47.842721] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:28:47.862458] [DEBUG] [LOCAL ] EFR: Loaded 14474 existing records from primary storage. [2025-09-29T18:28:47.862734] [INFO ] [MAIN ] EFR: Loaded 14474 existing records. [2025-09-29T18:28:48.009432] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-29T18:28:48.028599] [INFO ] [REMOTE ] EEA: Full fetch complete (3954 records). [2025-09-29T18:28:48.041636] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-09-29T18:28:48.165370] [WARN ] [MAIN ] EFR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:28:48.177769] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-09-29T18:28:48.177885] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-09-29T18:28:48.183637] [DEBUG] [LOCAL ] EFR: Deleted primary data file. [2025-09-29T18:28:48.194079] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-09-29T18:28:48.361010] [WARN ] [VALIDATOR ] EEA: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-29T18:28:48.356499] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-09-29T18:28:48.372266] [FATAL] [MAIN ] EEA: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:28:48.372396] [WARN ] [MAIN ] EEA: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:28:48.378395] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-09-29T18:28:48.383913] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-09-29T18:28:48.425889] [INFO ] [LOCAL ] EEA: Starting deletion of derivative data. [2025-09-29T18:28:48.443249] [DEBUG] [LOCAL ] EEA: No derivative data file found to delete. [2025-09-29T18:28:48.458973] [INFO ] [MAIN ] Update Progress: 701/2371 symbols completed. EEA took 20.4s. Estimated remaining: 3h 31m 27s. Rate: 7.9 symbols/min [2025-09-29T18:28:48.873755] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:28:48.869086] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:28:48.891366] [DEBUG] [LOCAL ] EFT: Loaded 12857 existing records from primary storage. [2025-09-29T18:28:48.891620] [INFO ] [MAIN ] EFT: Loaded 12857 existing records. [2025-09-29T18:28:49.106437] [WARN ] [MAIN ] EFT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:28:49.106725] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-09-29T18:28:49.106782] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-09-29T18:28:49.107351] [DEBUG] [LOCAL ] EFT: Deleted primary data file. [2025-09-29T18:28:49.107414] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-09-29T18:28:49.153259] [INFO ] [REMOTE ] EFR: Fetching primary data for 2024-12. [2025-09-29T18:28:49.427764] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-29T18:28:49.511820] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:28:49.948127] [INFO ] [REMOTE ] EFT: Fetching primary data for 2024-12. [2025-09-29T18:28:50.148278] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-29T18:28:50.748162] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-09-29T18:28:50.857835] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-29T18:28:51.548105] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-09-29T18:28:51.888390] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-29T18:28:52.348982] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-01. [2025-09-29T18:28:52.350875] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-29T18:28:53.148113] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-09-29T18:28:53.945755] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-29T18:28:53.948754] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-09-29T18:28:54.122377] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-29T18:28:54.427718] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-29T18:28:54.748178] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-09-29T18:28:55.548088] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-09-29T18:28:55.766024] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-29T18:28:56.323517] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-29T18:28:56.348087] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-09-29T18:28:56.936761] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-29T18:28:57.148135] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-09-29T18:28:57.948161] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-09-29T18:28:57.993460] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-29T18:28:58.471826] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-29T18:28:58.748150] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-09-29T18:28:59.548089] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-09-29T18:28:59.780597] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-29T18:29:00.348125] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-09-29T18:29:01.151965] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-09-29T18:29:01.157521] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-29T18:29:01.452699] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-29T18:29:01.948115] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-09-29T18:29:02.315699] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-29T18:29:02.748128] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-09-29T18:29:03.548126] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-09-29T18:29:03.595214] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-29T18:29:03.666557] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-29T18:29:04.348121] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-09-29T18:29:04.537492] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-29T18:29:05.148139] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-09-29T18:29:05.255772] [DEBUG] [REMOTE ] EFR: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-09-29T18:29:05.256250] [WARN ] [REMOTE ] EFR: No data returned for month 2025-07 [2025-09-29T18:29:05.256407] [FATAL] [REMOTE ] EFR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T18:29:05.256582] [FATAL] [MAIN ] EFR: Failed to fetch primary data. [2025-09-29T18:29:05.256703] [WARN ] [MAIN ] EFR: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T18:29:05.256816] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-09-29T18:29:05.256944] [DEBUG] [LOCAL ] EFR: No primary data file found to delete. [2025-09-29T18:29:05.257019] [INFO ] [LOCAL ] EFR: Starting deletion of derivative data. [2025-09-29T18:29:05.258081] [DEBUG] [LOCAL ] EFR: Deleted derivative data file. [2025-09-29T18:29:05.258233] [INFO ] [MAIN ] Update Progress: 702/2371 symbols completed. EFR took 17.6s. Estimated remaining: 3h 31m 41s. Rate: 7.9 symbols/min [2025-09-29T18:29:05.503578] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:29:05.561055] [DEBUG] [LOCAL ] EFX: Loaded 45419 existing records from primary storage. [2025-09-29T18:29:05.561419] [INFO ] [MAIN ] EFX: Loaded 45419 existing records. [2025-09-29T18:29:05.750947] [WARN ] [MAIN ] EFX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:29:05.751200] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-09-29T18:29:05.751257] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-09-29T18:29:05.752089] [DEBUG] [LOCAL ] EFX: Deleted primary data file. [2025-09-29T18:29:05.752152] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-09-29T18:29:05.953213] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-09-29T18:29:06.142249] [INFO ] [REMOTE ] EFX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:29:06.280707] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-29T18:29:06.748095] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-09-29T18:29:06.962454] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-29T18:29:07.548169] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-09-29T18:29:08.348111] [INFO ] [REMOTE ] EFX: Fetching primary data for 2024-12. [2025-09-29T18:29:08.484389] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-29T18:29:08.517020] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-29T18:29:09.148173] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-09-29T18:29:09.948136] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-09-29T18:29:10.071319] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-29T18:29:10.161119] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-29T18:29:10.748117] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-09-29T18:29:10.790567] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-29T18:29:11.459542] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-29T18:29:11.548152] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-09-29T18:29:12.297817] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-29T18:29:12.300146] [INFO ] [REMOTE ] EEX: Full fetch complete (19568 records). [2025-09-29T18:29:12.300251] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-09-29T18:29:12.356254] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-01. [2025-09-29T18:29:12.716263] [DEBUG] [VALIDATOR ] EEX: All expected trading days are present. [2025-09-29T18:29:12.716346] [DEBUG] [VALIDATOR ] EEX: Primary data validation passed. [2025-09-29T18:29:12.716910] [INFO ] [MAIN ] EEX: Fetched primary data is valid. [2025-09-29T18:29:12.716976] [DEBUG] [LOCAL ] EEX: Saving primary data. [2025-09-29T18:29:12.717744] [DEBUG] [LOCAL ] EEX: Trimmed 19568 records to 11665 (keeping 200 days of data) [2025-09-29T18:29:12.792698] [DEBUG] [LOCAL ] EEX: Primary data saved (11665 records). [2025-09-29T18:29:12.792848] [INFO ] [MAIN ] EEX: Full history saved. [2025-09-29T18:29:12.792932] [INFO ] [MAIN ] Update Progress: 703/2371 symbols completed. EEX took 37.0s. Estimated remaining: 3h 31m 34s. Rate: 7.9 symbols/min [2025-09-29T18:29:12.974450] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:29:13.018365] [DEBUG] [LOCAL ] EFXT: Loaded 29755 existing records from primary storage. [2025-09-29T18:29:13.018681] [INFO ] [MAIN ] EFXT: Loaded 29755 existing records. [2025-09-29T18:29:13.164541] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-09-29T18:29:13.208515] [WARN ] [MAIN ] EFXT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:29:13.208752] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-09-29T18:29:13.208804] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-09-29T18:29:13.209175] [DEBUG] [LOCAL ] EFXT: Deleted primary data file. [2025-09-29T18:29:13.209234] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-09-29T18:29:13.605167] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:29:13.948139] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2024-12. [2025-09-29T18:29:14.005766] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-29T18:29:14.748114] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-09-29T18:29:14.987906] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-29T18:29:15.311148] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-29T18:29:15.548126] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-09-29T18:29:16.348142] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-09-29T18:29:16.419583] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-29T18:29:17.148101] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-01. [2025-09-29T18:29:17.277269] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-29T18:29:17.471064] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-29T18:29:17.948134] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-09-29T18:29:18.581871] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-29T18:29:18.748125] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-09-29T18:29:19.548132] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-09-29T18:29:19.702778] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-29T18:29:20.348130] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-09-29T18:29:20.558358] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-29T18:29:20.615988] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-29T18:29:21.148119] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-09-29T18:29:21.948084] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-09-29T18:29:22.149226] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-29T18:29:22.748098] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-09-29T18:29:22.993353] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-29T18:29:23.003441] [INFO ] [REMOTE ] EFC: Full fetch complete (66349 records). [2025-09-29T18:29:23.003637] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-09-29T18:29:23.169085] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-29T18:29:23.186903] [INFO ] [REMOTE ] EFT: Full fetch complete (17506 records). [2025-09-29T18:29:23.209258] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-09-29T18:29:23.561836] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-09-29T18:29:23.713462] [DEBUG] [VALIDATOR ] EFC: All expected trading days are present. [2025-09-29T18:29:23.743735] [DEBUG] [VALIDATOR ] EFC: Primary data validation passed. [2025-09-29T18:29:23.765388] [INFO ] [MAIN ] EFC: Fetched primary data is valid. [2025-09-29T18:29:23.769087] [DEBUG] [LOCAL ] EFC: Saving primary data. [2025-09-29T18:29:23.826421] [DEBUG] [LOCAL ] EFC: Trimmed 66349 records to 46199 (keeping 200 days of data) [2025-09-29T18:29:23.862230] [DEBUG] [VALIDATOR ] EFT: All expected trading days are present. [2025-09-29T18:29:23.862599] [DEBUG] [VALIDATOR ] EFT: Primary data validation passed. [2025-09-29T18:29:23.862881] [INFO ] [MAIN ] EFT: Fetched primary data is valid. [2025-09-29T18:29:23.862941] [DEBUG] [LOCAL ] EFT: Saving primary data. [2025-09-29T18:29:23.863594] [DEBUG] [LOCAL ] EFT: Trimmed 17506 records to 12787 (keeping 200 days of data) [2025-09-29T18:29:24.065302] [DEBUG] [LOCAL ] EFT: Primary data saved (12787 records). [2025-09-29T18:29:24.065964] [INFO ] [MAIN ] EFT: Full history saved. [2025-09-29T18:29:24.067424] [INFO ] [MAIN ] Update Progress: 704/2371 symbols completed. EFT took 35.6s. Estimated remaining: 3h 31m 35s. Rate: 7.9 symbols/min [2025-09-29T18:29:24.277934] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:29:24.417938] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-29T18:29:24.444606] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-09-29T18:29:24.459548] [DEBUG] [LOCAL ] EG: Loaded 29024 existing records from primary storage. [2025-09-29T18:29:24.460557] [INFO ] [MAIN ] EG: Loaded 29024 existing records. [2025-09-29T18:29:24.671027] [WARN ] [MAIN ] EG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:29:24.672156] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-09-29T18:29:24.673160] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-09-29T18:29:24.675556] [DEBUG] [LOCAL ] EG: Deleted primary data file. [2025-09-29T18:29:24.676383] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-09-29T18:29:24.832598] [DEBUG] [LOCAL ] EFC: Primary data saved (46199 records). [2025-09-29T18:29:24.843262] [INFO ] [MAIN ] EFC: Full history saved. [2025-09-29T18:29:24.848908] [INFO ] [MAIN ] Update Progress: 705/2371 symbols completed. EFC took 44.0s. Estimated remaining: 3h 31m 11s. Rate: 7.9 symbols/min [2025-09-29T18:29:25.036844] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-29T18:29:25.159053] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-09-29T18:29:25.290966] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:29:25.330687] [INFO ] [REMOTE ] EG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:29:25.385060] [DEBUG] [LOCAL ] EGO: Loaded 52295 existing records from primary storage. [2025-09-29T18:29:25.385433] [INFO ] [MAIN ] EGO: Loaded 52295 existing records. [2025-09-29T18:29:25.580129] [WARN ] [MAIN ] EGO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:29:25.580343] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-09-29T18:29:25.580393] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-09-29T18:29:25.580989] [DEBUG] [LOCAL ] EGO: Deleted primary data file. [2025-09-29T18:29:25.581051] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-09-29T18:29:25.949938] [INFO ] [REMOTE ] EG: Fetching primary data for 2024-12. [2025-09-29T18:29:25.977365] [INFO ] [REMOTE ] EGO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:29:26.173763] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-29T18:29:26.582176] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-29T18:29:26.748116] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-09-29T18:29:27.214462] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-29T18:29:27.548119] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-01. [2025-09-29T18:29:28.348099] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-09-29T18:29:28.460846] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-29T18:29:28.972846] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-29T18:29:29.148109] [INFO ] [REMOTE ] EGO: Fetching primary data for 2024-12. [2025-09-29T18:29:29.609624] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-29T18:29:29.948118] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-09-29T18:29:30.748091] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-09-29T18:29:30.995368] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-29T18:29:31.235804] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-29T18:29:31.548148] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-01. [2025-09-29T18:29:32.348163] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-09-29T18:29:32.404880] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-29T18:29:33.125947] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-29T18:29:33.148130] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-09-29T18:29:33.615236] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-29T18:29:33.948189] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-09-29T18:29:34.748118] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-09-29T18:29:34.865065] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-29T18:29:34.874875] [INFO ] [REMOTE ] EFX: Full fetch complete (64370 records). [2025-09-29T18:29:34.875045] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-09-29T18:29:35.288588] [DEBUG] [VALIDATOR ] EFX: All expected trading days are present. [2025-09-29T18:29:35.288922] [DEBUG] [VALIDATOR ] EFX: Primary data validation passed. [2025-09-29T18:29:35.290378] [INFO ] [MAIN ] EFX: Fetched primary data is valid. [2025-09-29T18:29:35.290456] [DEBUG] [LOCAL ] EFX: Saving primary data. [2025-09-29T18:29:35.292879] [DEBUG] [LOCAL ] EFX: Trimmed 64370 records to 44588 (keeping 200 days of data) [2025-09-29T18:29:35.548399] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-09-29T18:29:35.605327] [DEBUG] [LOCAL ] EFX: Primary data saved (44588 records). [2025-09-29T18:29:35.605546] [INFO ] [MAIN ] EFX: Full history saved. [2025-09-29T18:29:35.605686] [INFO ] [MAIN ] Update Progress: 706/2371 symbols completed. EFX took 30.3s. Estimated remaining: 3h 31m 11s. Rate: 7.9 symbols/min [2025-09-29T18:29:35.810023] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:29:35.826622] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-29T18:29:35.879594] [DEBUG] [LOCAL ] EGP: Loaded 31536 existing records from primary storage. [2025-09-29T18:29:35.880110] [INFO ] [MAIN ] EGP: Loaded 31536 existing records. [2025-09-29T18:29:36.073231] [WARN ] [MAIN ] EGP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:29:36.073978] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-09-29T18:29:36.074042] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-09-29T18:29:36.075062] [DEBUG] [LOCAL ] EGP: Deleted primary data file. [2025-09-29T18:29:36.075124] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-09-29T18:29:36.212509] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-29T18:29:36.361060] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-09-29T18:29:36.506386] [INFO ] [REMOTE ] EGP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:29:37.080230] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-29T18:29:37.148148] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-09-29T18:29:37.948169] [INFO ] [REMOTE ] EGP: Fetching primary data for 2024-12. [2025-09-29T18:29:38.051331] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-29T18:29:38.058496] [INFO ] [REMOTE ] EFXT: Full fetch complete (44162 records). [2025-09-29T18:29:38.058711] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-09-29T18:29:38.499666] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-09-29T18:29:38.499891] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-09-29T18:29:38.500765] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-09-29T18:29:38.500904] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-09-29T18:29:38.502171] [DEBUG] [LOCAL ] EFXT: Trimmed 44162 records to 29190 (keeping 200 days of data) [2025-09-29T18:29:38.686180] [DEBUG] [LOCAL ] EFXT: Primary data saved (29190 records). [2025-09-29T18:29:38.686334] [INFO ] [MAIN ] EFXT: Full history saved. [2025-09-29T18:29:38.686424] [INFO ] [MAIN ] Update Progress: 707/2371 symbols completed. EFXT took 25.9s. Estimated remaining: 3h 30m 52s. Rate: 7.9 symbols/min [2025-09-29T18:29:38.754290] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-09-29T18:29:38.882612] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-29T18:29:38.904675] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:29:38.962718] [DEBUG] [LOCAL ] EGY: Loaded 42824 existing records from primary storage. [2025-09-29T18:29:38.963218] [INFO ] [MAIN ] EGY: Loaded 42824 existing records. [2025-09-29T18:29:39.187824] [WARN ] [MAIN ] EGY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:29:39.188263] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-09-29T18:29:39.188434] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-09-29T18:29:39.189059] [DEBUG] [LOCAL ] EGY: Deleted primary data file. [2025-09-29T18:29:39.189125] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-09-29T18:29:39.553285] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-09-29T18:29:39.574884] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-29T18:29:39.600904] [INFO ] [REMOTE ] EGY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:29:40.348142] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-01. [2025-09-29T18:29:40.663114] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-29T18:29:41.061324] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-29T18:29:41.148137] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-09-29T18:29:41.692683] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-29T18:29:41.948112] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-09-29T18:29:42.748109] [INFO ] [REMOTE ] EGY: Fetching primary data for 2024-12. [2025-09-29T18:29:42.981917] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-29T18:29:43.052762] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-29T18:29:43.548118] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-09-29T18:29:44.348143] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-09-29T18:29:44.495297] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-29T18:29:44.952264] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-29T18:29:45.148154] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-01. [2025-09-29T18:29:45.948098] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-09-29T18:29:46.034281] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-29T18:29:46.748101] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-09-29T18:29:47.102830] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-29T18:29:47.439160] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-29T18:29:47.548121] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-09-29T18:29:48.141021] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-29T18:29:48.348137] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-09-29T18:29:48.674976] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-29T18:29:49.148117] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-09-29T18:29:49.948098] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-09-29T18:29:50.066133] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-29T18:29:50.748170] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-09-29T18:29:50.953532] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-29T18:29:51.373541] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-29T18:29:51.548118] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-09-29T18:29:52.167863] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-29T18:29:52.348091] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-09-29T18:29:53.148129] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-09-29T18:29:53.506368] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-29T18:29:53.948092] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-09-29T18:29:53.979430] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-29T18:29:54.492576] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-29T18:29:54.748139] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-09-29T18:29:55.277041] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-29T18:29:55.548134] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-09-29T18:29:56.348127] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-09-29T18:29:56.506693] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-29T18:29:57.148170] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-09-29T18:29:57.461668] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-29T18:29:57.472812] [INFO ] [REMOTE ] EGO: Full fetch complete (73572 records). [2025-09-29T18:29:57.473031] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-09-29T18:29:57.820338] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-29T18:29:57.938108] [DEBUG] [VALIDATOR ] EGO: All expected trading days are present. [2025-09-29T18:29:57.938269] [DEBUG] [VALIDATOR ] EGO: Primary data validation passed. [2025-09-29T18:29:57.939308] [INFO ] [MAIN ] EGO: Fetched primary data is valid. [2025-09-29T18:29:57.939397] [DEBUG] [LOCAL ] EGO: Saving primary data. [2025-09-29T18:29:57.943994] [DEBUG] [LOCAL ] EGO: Trimmed 73572 records to 51568 (keeping 200 days of data) [2025-09-29T18:29:57.994523] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-09-29T18:29:58.269678] [DEBUG] [LOCAL ] EGO: Primary data saved (51568 records). [2025-09-29T18:29:58.269858] [INFO ] [MAIN ] EGO: Full history saved. [2025-09-29T18:29:58.269996] [INFO ] [MAIN ] Update Progress: 708/2371 symbols completed. EGO took 33.4s. Estimated remaining: 3h 31m 13s. Rate: 7.9 symbols/min [2025-09-29T18:29:58.453242] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:29:58.488397] [DEBUG] [LOCAL ] EHAB: Loaded 30257 existing records from primary storage. [2025-09-29T18:29:58.488856] [INFO ] [MAIN ] EHAB: Loaded 30257 existing records. [2025-09-29T18:29:58.681050] [WARN ] [MAIN ] EHAB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:29:58.681459] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-09-29T18:29:58.681612] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-09-29T18:29:58.682099] [DEBUG] [LOCAL ] EHAB: Deleted primary data file. [2025-09-29T18:29:58.682177] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-09-29T18:29:58.748396] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-09-29T18:29:58.983418] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-29T18:29:59.108229] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:29:59.555057] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2024-12. [2025-09-29T18:29:59.556210] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-29T18:29:59.563046] [INFO ] [REMOTE ] EG: Full fetch complete (43810 records). [2025-09-29T18:29:59.563156] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-09-29T18:29:59.966001] [DEBUG] [VALIDATOR ] EG: All expected trading days are present. [2025-09-29T18:29:59.966106] [DEBUG] [VALIDATOR ] EG: Primary data validation passed. [2025-09-29T18:29:59.966880] [INFO ] [MAIN ] EG: Fetched primary data is valid. [2025-09-29T18:29:59.966947] [DEBUG] [LOCAL ] EG: Saving primary data. [2025-09-29T18:29:59.968023] [DEBUG] [LOCAL ] EG: Trimmed 43810 records to 28398 (keeping 200 days of data) [2025-09-29T18:30:00.161823] [DEBUG] [LOCAL ] EG: Primary data saved (28398 records). [2025-09-29T18:30:00.162019] [INFO ] [MAIN ] EG: Full history saved. [2025-09-29T18:30:00.162135] [INFO ] [MAIN ] Update Progress: 709/2371 symbols completed. EG took 36.1s. Estimated remaining: 3h 30m 52s. Rate: 7.9 symbols/min [2025-09-29T18:30:00.418420] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:30:00.351838] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-09-29T18:30:00.455921] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-29T18:30:00.519416] [DEBUG] [LOCAL ] EHC: Loaded 41849 existing records from primary storage. [2025-09-29T18:30:00.519796] [INFO ] [MAIN ] EHC: Loaded 41849 existing records. [2025-09-29T18:30:00.826000] [WARN ] [MAIN ] EHC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:30:00.826388] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-09-29T18:30:00.826467] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-09-29T18:30:00.827181] [DEBUG] [LOCAL ] EHC: Deleted primary data file. [2025-09-29T18:30:00.827258] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-09-29T18:30:01.150913] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-09-29T18:30:01.188601] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-29T18:30:01.462721] [INFO ] [REMOTE ] EHC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:30:01.948095] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-01. [2025-09-29T18:30:02.328665] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-29T18:30:02.618298] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-29T18:30:02.748131] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-09-29T18:30:03.079787] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-29T18:30:03.548155] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-09-29T18:30:04.151748] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-29T18:30:04.158981] [INFO ] [REMOTE ] EGP: Full fetch complete (45368 records). [2025-09-29T18:30:04.159135] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-09-29T18:30:04.350006] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-09-29T18:30:04.620519] [DEBUG] [VALIDATOR ] EGP: All expected trading days are present. [2025-09-29T18:30:04.620774] [DEBUG] [VALIDATOR ] EGP: Primary data validation passed. [2025-09-29T18:30:04.621854] [INFO ] [MAIN ] EGP: Fetched primary data is valid. [2025-09-29T18:30:04.621963] [DEBUG] [LOCAL ] EGP: Saving primary data. [2025-09-29T18:30:04.623947] [DEBUG] [LOCAL ] EGP: Trimmed 45368 records to 30961 (keeping 200 days of data) [2025-09-29T18:30:04.795366] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-29T18:30:04.925498] [DEBUG] [LOCAL ] EGP: Primary data saved (30961 records). [2025-09-29T18:30:04.925688] [INFO ] [MAIN ] EGP: Full history saved. [2025-09-29T18:30:04.925796] [INFO ] [MAIN ] Update Progress: 710/2371 symbols completed. EGP took 29.3s. Estimated remaining: 3h 30m 38s. Rate: 7.9 symbols/min [2025-09-29T18:30:05.099687] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:30:05.114900] [DEBUG] [LOCAL ] EHI: Loaded 10472 existing records from primary storage. [2025-09-29T18:30:05.115168] [INFO ] [MAIN ] EHI: Loaded 10472 existing records. [2025-09-29T18:30:05.153297] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-09-29T18:30:05.304503] [WARN ] [MAIN ] EHI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:30:05.304779] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-09-29T18:30:05.304836] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-09-29T18:30:05.305185] [DEBUG] [LOCAL ] EHI: Deleted primary data file. [2025-09-29T18:30:05.305246] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-09-29T18:30:05.733635] [INFO ] [REMOTE ] EHI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:30:05.948161] [INFO ] [REMOTE ] EHI: Fetching primary data for 2024-12. [2025-09-29T18:30:06.064544] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-29T18:30:06.579757] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-29T18:30:06.701639] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-29T18:30:06.748128] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-09-29T18:30:07.548130] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-09-29T18:30:07.982058] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-29T18:30:08.348137] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-09-29T18:30:08.476199] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-29T18:30:09.148137] [INFO ] [REMOTE ] EHC: Fetching primary data for 2024-12. [2025-09-29T18:30:09.948108] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-09-29T18:30:10.162906] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-29T18:30:10.753419] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-09-29T18:30:10.765344] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-29T18:30:11.518099] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-29T18:30:11.548168] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-09-29T18:30:12.348109] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-01. [2025-09-29T18:30:12.490030] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-29T18:30:12.531856] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-29T18:30:12.540995] [INFO ] [REMOTE ] EGY: Full fetch complete (61549 records). [2025-09-29T18:30:12.541152] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-09-29T18:30:12.960893] [DEBUG] [VALIDATOR ] EGY: All expected trading days are present. [2025-09-29T18:30:12.961000] [DEBUG] [VALIDATOR ] EGY: Primary data validation passed. [2025-09-29T18:30:12.961867] [INFO ] [MAIN ] EGY: Fetched primary data is valid. [2025-09-29T18:30:12.961951] [DEBUG] [LOCAL ] EGY: Saving primary data. [2025-09-29T18:30:12.963397] [DEBUG] [LOCAL ] EGY: Trimmed 61549 records to 42167 (keeping 200 days of data) [2025-09-29T18:30:13.174474] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-09-29T18:30:13.226144] [DEBUG] [LOCAL ] EGY: Primary data saved (42167 records). [2025-09-29T18:30:13.226285] [INFO ] [MAIN ] EGY: Full history saved. [2025-09-29T18:30:13.226374] [INFO ] [MAIN ] Update Progress: 711/2371 symbols completed. EGY took 34.5s. Estimated remaining: 3h 30m 32s. Rate: 7.9 symbols/min [2025-09-29T18:30:13.405685] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:30:13.433312] [DEBUG] [LOCAL ] EIC: Loaded 24238 existing records from primary storage. [2025-09-29T18:30:13.433573] [INFO ] [MAIN ] EIC: Loaded 24238 existing records. [2025-09-29T18:30:13.629891] [WARN ] [MAIN ] EIC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:30:13.630253] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-09-29T18:30:13.630333] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-09-29T18:30:13.630776] [DEBUG] [LOCAL ] EIC: Deleted primary data file. [2025-09-29T18:30:13.630840] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-09-29T18:30:13.949061] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-09-29T18:30:14.050951] [INFO ] [REMOTE ] EIC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:30:14.054321] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-29T18:30:14.422762] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-29T18:30:14.748141] [INFO ] [REMOTE ] EIC: Fetching primary data for 2024-12. [2025-09-29T18:30:15.426504] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-29T18:30:15.548134] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-09-29T18:30:16.186582] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-29T18:30:16.348133] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-01. [2025-09-29T18:30:17.009876] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-29T18:30:17.148074] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-09-29T18:30:17.536096] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-29T18:30:17.948122] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-09-29T18:30:18.529093] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-29T18:30:18.748093] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-09-29T18:30:19.032405] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-29T18:30:19.548110] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-09-29T18:30:20.273158] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-29T18:30:20.348128] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-09-29T18:30:20.899039] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-29T18:30:21.148124] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-09-29T18:30:21.738341] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-29T18:30:21.743805] [INFO ] [REMOTE ] EHAB: Full fetch complete (41059 records). [2025-09-29T18:30:21.743937] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-09-29T18:30:21.744610] [FATAL] [VALIDATOR ] EHAB: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:30:21.744727] [FATAL] [MAIN ] EHAB: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:30:21.744781] [WARN ] [MAIN ] EHAB: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:30:21.744852] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-09-29T18:30:21.744920] [DEBUG] [LOCAL ] EHAB: No primary data file found to delete. [2025-09-29T18:30:21.744958] [INFO ] [LOCAL ] EHAB: Starting deletion of derivative data. [2025-09-29T18:30:21.745329] [DEBUG] [LOCAL ] EHAB: Deleted derivative data file. [2025-09-29T18:30:21.745444] [INFO ] [MAIN ] Update Progress: 712/2371 symbols completed. EHAB took 23.5s. Estimated remaining: 3h 30m 26s. Rate: 7.9 symbols/min [2025-09-29T18:30:21.930988] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:30:21.931182] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-09-29T18:30:21.931222] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-09-29T18:30:21.931336] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-09-29T18:30:21.931380] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-09-29T18:30:21.931423] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-09-29T18:30:21.931458] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-09-29T18:30:21.953201] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-09-29T18:30:22.259910] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-29T18:30:22.330183] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:30:22.748162] [INFO ] [REMOTE ] EICA: Fetching primary data for 2024-12. [2025-09-29T18:30:23.177690] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-29T18:30:23.306488] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-29T18:30:23.548118] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-09-29T18:30:24.009631] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-29T18:30:24.348121] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-09-29T18:30:25.148118] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-09-29T18:30:25.948108] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-09-29T18:30:26.015158] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-29T18:30:26.282501] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-29T18:30:26.748099] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-09-29T18:30:26.826077] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-29T18:30:27.101409] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-29T18:30:27.548109] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-09-29T18:30:27.852144] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-09-29T18:30:28.348117] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-09-29T18:30:28.665232] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-29T18:30:29.148107] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-09-29T18:30:29.485612] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-29T18:30:29.948161] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-09-29T18:30:30.748163] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-09-29T18:30:31.050228] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-29T18:30:31.548100] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-09-29T18:30:31.616911] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-29T18:30:32.348085] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-09-29T18:30:32.447576] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-29T18:30:33.148100] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-09-29T18:30:33.309732] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-29T18:30:33.948102] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-09-29T18:30:34.005126] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-29T18:30:34.602831] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-29T18:30:34.748163] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-09-29T18:30:35.285892] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-29T18:30:35.548124] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-09-29T18:30:36.348128] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-09-29T18:30:36.750889] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-29T18:30:36.755014] [INFO ] [REMOTE ] EIC: Full fetch complete (34976 records). [2025-09-29T18:30:36.755220] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-09-29T18:30:37.158233] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-09-29T18:30:37.180339] [DEBUG] [VALIDATOR ] EIC: All expected trading days are present. [2025-09-29T18:30:37.180454] [DEBUG] [VALIDATOR ] EIC: Primary data validation passed. [2025-09-29T18:30:37.181248] [INFO ] [MAIN ] EIC: Fetched primary data is valid. [2025-09-29T18:30:37.189266] [DEBUG] [LOCAL ] EIC: Saving primary data. [2025-09-29T18:30:37.191073] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-29T18:30:37.195539] [DEBUG] [LOCAL ] EIC: Trimmed 34976 records to 23686 (keeping 200 days of data) [2025-09-29T18:30:37.348925] [DEBUG] [LOCAL ] EIC: Primary data saved (23686 records). [2025-09-29T18:30:37.349057] [INFO ] [MAIN ] EIC: Full history saved. [2025-09-29T18:30:37.349142] [INFO ] [MAIN ] Update Progress: 713/2371 symbols completed. EIC took 24.1s. Estimated remaining: 3h 30m 37s. Rate: 7.9 symbols/min [2025-09-29T18:30:37.534141] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:30:37.536935] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-09-29T18:30:37.537063] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-29T18:30:37.537289] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-09-29T18:30:37.537516] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-09-29T18:30:37.537575] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-09-29T18:30:37.537622] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-09-29T18:30:37.537694] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-09-29T18:30:37.932864] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:30:37.948068] [INFO ] [REMOTE ] EICB: Fetching primary data for 2024-12. [2025-09-29T18:30:38.391598] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-29T18:30:38.748109] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-09-29T18:30:39.188616] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-29T18:30:39.189433] [INFO ] [REMOTE ] EICA: Full fetch complete (1274 records). [2025-09-29T18:30:39.189505] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-09-29T18:30:39.374054] [WARN ] [VALIDATOR ] EICA: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-29T18:30:39.374236] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:30:39.374307] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:30:39.374379] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-09-29T18:30:39.374443] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-09-29T18:30:39.374483] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-09-29T18:30:39.374539] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-09-29T18:30:39.374621] [INFO ] [MAIN ] Update Progress: 714/2371 symbols completed. EICA took 17.6s. Estimated remaining: 3h 30m 17s. Rate: 7.9 symbols/min [2025-09-29T18:30:39.553194] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-09-29T18:30:39.556339] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:30:39.568148] [DEBUG] [LOCAL ] EICC: Loaded 6245 existing records from primary storage. [2025-09-29T18:30:39.568826] [INFO ] [MAIN ] EICC: Loaded 6245 existing records. [2025-09-29T18:30:39.768009] [WARN ] [MAIN ] EICC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:30:39.768224] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-09-29T18:30:39.768273] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-09-29T18:30:39.768620] [DEBUG] [LOCAL ] EICC: Deleted primary data file. [2025-09-29T18:30:39.768721] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-09-29T18:30:40.141152] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:30:40.348117] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-09-29T18:30:41.148089] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-09-29T18:30:41.363747] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-29T18:30:41.482265] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-29T18:30:41.485349] [INFO ] [REMOTE ] EHI: Full fetch complete (16276 records). [2025-09-29T18:30:41.485434] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-09-29T18:30:41.797073] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-29T18:30:41.891027] [DEBUG] [VALIDATOR ] EHI: All expected trading days are present. [2025-09-29T18:30:41.891108] [DEBUG] [VALIDATOR ] EHI: Primary data validation passed. [2025-09-29T18:30:41.891519] [INFO ] [MAIN ] EHI: Fetched primary data is valid. [2025-09-29T18:30:41.891585] [DEBUG] [LOCAL ] EHI: Saving primary data. [2025-09-29T18:30:41.892182] [DEBUG] [LOCAL ] EHI: Trimmed 16276 records to 10420 (keeping 200 days of data) [2025-09-29T18:30:41.948327] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-09-29T18:30:41.960743] [DEBUG] [LOCAL ] EHI: Primary data saved (10420 records). [2025-09-29T18:30:41.960901] [INFO ] [MAIN ] EHI: Full history saved. [2025-09-29T18:30:41.960998] [INFO ] [MAIN ] Update Progress: 715/2371 symbols completed. EHI took 37.0s. Estimated remaining: 3h 29m 57s. Rate: 7.9 symbols/min [2025-09-29T18:30:42.148152] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:30:42.171857] [DEBUG] [LOCAL ] EIG: Loaded 20519 existing records from primary storage. [2025-09-29T18:30:42.172115] [INFO ] [MAIN ] EIG: Loaded 20519 existing records. [2025-09-29T18:30:42.374664] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:30:42.374976] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-09-29T18:30:42.375038] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-09-29T18:30:42.375401] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-09-29T18:30:42.375462] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-09-29T18:30:42.755181] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-09-29T18:30:42.761680] [INFO ] [REMOTE ] EIG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:30:43.185915] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-29T18:30:43.493610] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-29T18:30:43.548119] [INFO ] [REMOTE ] EICC: Fetching primary data for 2024-12. [2025-09-29T18:30:44.156823] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-29T18:30:44.348117] [INFO ] [REMOTE ] EIG: Fetching primary data for 2024-12. [2025-09-29T18:30:45.148188] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-09-29T18:30:45.395076] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-29T18:30:45.948142] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-01. [2025-09-29T18:30:46.382695] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-29T18:30:46.748095] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-09-29T18:30:46.893934] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-29T18:30:47.288772] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-29T18:30:47.548148] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-09-29T18:30:48.348132] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-09-29T18:30:48.448179] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-29T18:30:49.148148] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-09-29T18:30:49.714892] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-29T18:30:49.948164] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-09-29T18:30:50.134126] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-29T18:30:50.748151] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-09-29T18:30:51.254551] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-29T18:30:51.327345] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-29T18:30:51.548147] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-09-29T18:30:52.348145] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-09-29T18:30:52.689500] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-29T18:30:53.148154] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-09-29T18:30:53.848042] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-29T18:30:53.875520] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-29T18:30:53.886874] [INFO ] [REMOTE ] EHC: Full fetch complete (58800 records). [2025-09-29T18:30:53.887118] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-09-29T18:30:53.953229] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-09-29T18:30:54.322283] [DEBUG] [VALIDATOR ] EHC: All expected trading days are present. [2025-09-29T18:30:54.322496] [DEBUG] [VALIDATOR ] EHC: Primary data validation passed. [2025-09-29T18:30:54.323728] [INFO ] [MAIN ] EHC: Fetched primary data is valid. [2025-09-29T18:30:54.323874] [DEBUG] [LOCAL ] EHC: Saving primary data. [2025-09-29T18:30:54.325575] [DEBUG] [LOCAL ] EHC: Trimmed 58800 records to 41153 (keeping 200 days of data) [2025-09-29T18:30:54.611219] [DEBUG] [LOCAL ] EHC: Primary data saved (41153 records). [2025-09-29T18:30:54.611348] [INFO ] [MAIN ] EHC: Full history saved. [2025-09-29T18:30:54.611441] [INFO ] [MAIN ] Update Progress: 716/2371 symbols completed. EHC took 54.4s. Estimated remaining: 3h 30m 1s. Rate: 7.9 symbols/min [2025-09-29T18:30:54.757611] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-09-29T18:30:54.793389] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:30:54.859532] [DEBUG] [LOCAL ] EIX: Loaded 54113 existing records from primary storage. [2025-09-29T18:30:54.859919] [INFO ] [MAIN ] EIX: Loaded 54113 existing records. [2025-09-29T18:30:55.058252] [WARN ] [MAIN ] EIX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:30:55.058527] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-09-29T18:30:55.058679] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-09-29T18:30:55.059669] [DEBUG] [LOCAL ] EIX: Deleted primary data file. [2025-09-29T18:30:55.059737] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-09-29T18:30:55.190932] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-29T18:30:55.541729] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:30:55.542818] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-29T18:30:55.548097] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-09-29T18:30:56.220499] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-29T18:30:56.348120] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-09-29T18:30:57.148080] [INFO ] [REMOTE ] EIX: Fetching primary data for 2024-12. [2025-09-29T18:30:57.383168] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-29T18:30:57.948175] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-09-29T18:30:58.748596] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-09-29T18:30:58.748429] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-29T18:30:58.778504] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-29T18:30:59.354158] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-29T18:30:59.548113] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-09-29T18:31:00.245286] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-29T18:31:00.348163] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-09-29T18:31:01.148117] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-09-29T18:31:01.785999] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-29T18:31:01.948193] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-09-29T18:31:02.437824] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-29T18:31:02.682445] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-29T18:31:02.748139] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-09-29T18:31:03.219750] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-29T18:31:03.548142] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-09-29T18:31:03.883036] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-29T18:31:04.348097] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-09-29T18:31:05.039634] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-29T18:31:05.041966] [INFO ] [REMOTE ] EICC: Full fetch complete (8069 records). [2025-09-29T18:31:05.042094] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-09-29T18:31:05.042779] [FATAL] [VALIDATOR ] EICC: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:31:05.042930] [FATAL] [MAIN ] EICC: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:31:05.043002] [WARN ] [MAIN ] EICC: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:31:05.043108] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-09-29T18:31:05.043220] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-09-29T18:31:05.043282] [INFO ] [LOCAL ] EICC: Starting deletion of derivative data. [2025-09-29T18:31:05.043896] [DEBUG] [LOCAL ] EICC: Deleted derivative data file. [2025-09-29T18:31:05.044062] [INFO ] [MAIN ] Update Progress: 717/2371 symbols completed. EICC took 25.7s. Estimated remaining: 3h 30m 0s. Rate: 7.9 symbols/min [2025-09-29T18:31:05.148124] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-09-29T18:31:05.605129] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-29T18:31:05.948120] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-09-29T18:31:06.430790] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-29T18:31:06.748160] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-09-29T18:31:07.548203] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-09-29T18:31:08.070538] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-29T18:31:08.348127] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-09-29T18:31:09.148130] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-09-29T18:31:09.586073] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-29T18:31:09.613364] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-29T18:31:09.618586] [INFO ] [REMOTE ] EIG: Full fetch complete (27023 records). [2025-09-29T18:31:09.618759] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-09-29T18:31:09.708947] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-29T18:31:09.956458] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-09-29T18:31:10.116187] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-09-29T18:31:10.116291] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-09-29T18:31:10.116944] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-09-29T18:31:10.117028] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-09-29T18:31:10.120173] [DEBUG] [LOCAL ] EIG: Trimmed 27023 records to 20285 (keeping 200 days of data) [2025-09-29T18:31:10.260729] [DEBUG] [LOCAL ] EIG: Primary data saved (20285 records). [2025-09-29T18:31:10.260895] [INFO ] [MAIN ] EIG: Full history saved. [2025-09-29T18:31:10.260989] [INFO ] [MAIN ] Update Progress: 718/2371 symbols completed. EIG took 28.3s. Estimated remaining: 3h 29m 47s. Rate: 7.9 symbols/min [2025-09-29T18:31:10.748091] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-09-29T18:31:11.402112] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-29T18:31:11.403380] [INFO ] [REMOTE ] EICB: Full fetch complete (2701 records). [2025-09-29T18:31:11.403462] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-09-29T18:31:11.625067] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-29T18:31:11.625283] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:31:11.625374] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:31:11.625469] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-09-29T18:31:11.625567] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-09-29T18:31:11.625622] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-09-29T18:31:11.625756] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-09-29T18:31:11.625847] [INFO ] [MAIN ] Update Progress: 719/2371 symbols completed. EICB took 34.3s. Estimated remaining: 3h 29m 25s. Rate: 7.9 symbols/min [2025-09-29T18:31:12.028175] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-29T18:31:12.040452] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-09-29T18:31:14.041970] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-29T18:31:14.053965] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-09-29T18:31:15.995964] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-29T18:31:16.008844] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-09-29T18:31:17.966487] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-29T18:31:17.978356] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-09-29T18:31:20.204293] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-29T18:31:20.218493] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-09-29T18:31:22.101795] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-29T18:31:22.114481] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-09-29T18:31:24.104558] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-29T18:31:24.116636] [INFO ] [REMOTE ] EIX: Full fetch complete (76585 records). [2025-09-29T18:31:24.116860] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-09-29T18:31:24.117941] [FATAL] [VALIDATOR ] EIX: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:31:24.118046] [FATAL] [MAIN ] EIX: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:31:24.118092] [WARN ] [MAIN ] EIX: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:31:24.118131] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-09-29T18:31:24.118407] [DEBUG] [LOCAL ] EIX: No primary data file found to delete. [2025-09-29T18:31:24.118463] [INFO ] [LOCAL ] EIX: Starting deletion of derivative data. [2025-09-29T18:31:24.119128] [DEBUG] [LOCAL ] EIX: Deleted derivative data file. [2025-09-29T18:31:24.119246] [INFO ] [MAIN ] Update Progress: 720/2371 symbols completed. EIX took 29.5s. Estimated remaining: 3h 29m 29s. Rate: 7.9 symbols/min [2025-09-29T18:31:24.763181] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:31:24.762195] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:31:24.813298] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:31:24.873692] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:31:24.893180] [DEBUG] [LOCAL ] ELC: Loaded 3512 existing records from primary storage. [2025-09-29T18:31:24.893569] [INFO ] [MAIN ] ELC: Loaded 3512 existing records. [2025-09-29T18:31:25.167283] [WARN ] [MAIN ] ELC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:31:25.167589] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-09-29T18:31:25.167908] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-09-29T18:31:25.198904] [DEBUG] [LOCAL ] EL: Loaded 54177 existing records from primary storage. [2025-09-29T18:31:25.197527] [DEBUG] [LOCAL ] ELC: Deleted primary data file. [2025-09-29T18:31:25.197436] [DEBUG] [LOCAL ] ELAN: Loaded 53985 existing records from primary storage. [2025-09-29T18:31:25.199554] [INFO ] [MAIN ] EL: Loaded 54177 existing records. [2025-09-29T18:31:25.199384] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-09-29T18:31:25.226497] [INFO ] [MAIN ] ELAN: Loaded 53985 existing records. [2025-09-29T18:31:25.241930] [DEBUG] [LOCAL ] ELF: Loaded 53037 existing records from primary storage. [2025-09-29T18:31:25.317054] [INFO ] [MAIN ] ELF: Loaded 53037 existing records. [2025-09-29T18:31:25.792058] [WARN ] [MAIN ] EL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:31:25.968611] [WARN ] [MAIN ] ELF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:31:25.989238] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-09-29T18:31:26.055795] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:31:26.061935] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-09-29T18:31:26.072571] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-09-29T18:31:26.077970] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-09-29T18:31:26.072776] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-09-29T18:31:26.103922] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-09-29T18:31:26.116467] [DEBUG] [LOCAL ] EL: Deleted primary data file. [2025-09-29T18:31:26.128867] [DEBUG] [LOCAL ] ELF: Deleted primary data file. [2025-09-29T18:31:26.134280] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-09-29T18:31:26.134418] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-09-29T18:31:26.116522] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-09-29T18:31:26.139719] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-09-29T18:31:26.671043] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:31:26.792418] [INFO ] [REMOTE ] ELC: Fetching primary data for 2024-12. [2025-09-29T18:31:27.358800] [INFO ] [REMOTE ] EL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:31:27.385121] [INFO ] [REMOTE ] EL: Fetching primary data for 2024-12. [2025-09-29T18:31:27.496905] [INFO ] [REMOTE ] ELF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:31:27.497410] [INFO ] [REMOTE ] ELF: Fetching primary data for 2024-12. [2025-09-29T18:31:27.528108] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:31:27.528403] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2024-12. [2025-09-29T18:31:27.558534] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-29T18:31:27.560779] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-09-29T18:31:28.198980] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-29T18:31:28.200930] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-09-29T18:31:28.802321] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-29T18:31:28.803998] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-09-29T18:31:29.192733] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-29T18:31:29.204802] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-01. [2025-09-29T18:31:29.298447] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-29T18:31:29.310128] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-01. [2025-09-29T18:31:29.418061] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-29T18:31:29.419778] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-09-29T18:31:29.422698] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-29T18:31:29.436091] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-01. [2025-09-29T18:31:29.769092] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-29T18:31:29.770840] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-09-29T18:31:30.328609] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-29T18:31:30.330867] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-09-29T18:31:30.798055] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-29T18:31:30.814105] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-09-29T18:31:30.896899] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-29T18:31:30.898481] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-09-29T18:31:31.195429] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-29T18:31:31.225812] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-29T18:31:31.237084] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-09-29T18:31:31.238712] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-09-29T18:31:31.481720] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-29T18:31:31.483289] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-09-29T18:31:32.113868] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-29T18:31:32.115412] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-09-29T18:31:32.494964] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-29T18:31:32.511801] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-09-29T18:31:32.769492] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-29T18:31:32.770885] [INFO ] [REMOTE ] ELC: Full fetch complete (5100 records). [2025-09-29T18:31:32.770961] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-09-29T18:31:33.216773] [DEBUG] [VALIDATOR ] ELC: All expected trading days are present. [2025-09-29T18:31:33.216927] [DEBUG] [VALIDATOR ] ELC: Primary data validation passed. [2025-09-29T18:31:33.217581] [INFO ] [MAIN ] ELC: Fetched primary data is valid. [2025-09-29T18:31:33.217705] [DEBUG] [LOCAL ] ELC: Saving primary data. [2025-09-29T18:31:33.218557] [DEBUG] [LOCAL ] ELC: Trimmed 5100 records to 3481 (keeping 200 days of data) [2025-09-29T18:31:33.272518] [DEBUG] [LOCAL ] ELC: Primary data saved (3481 records). [2025-09-29T18:31:33.275537] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-29T18:31:33.273919] [INFO ] [MAIN ] ELC: Full history saved. [2025-09-29T18:31:33.275846] [INFO ] [MAIN ] Update Progress: 721/2371 symbols completed. ELC took 9.1s. Estimated remaining: 3h 29m 25s. Rate: 7.9 symbols/min [2025-09-29T18:31:33.292542] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-09-29T18:31:33.485834] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:31:33.521956] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-09-29T18:31:33.537038] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-09-29T18:31:33.595060] [DEBUG] [LOCAL ] ELME: Loaded 39817 existing records from primary storage. [2025-09-29T18:31:33.595431] [INFO ] [MAIN ] ELME: Loaded 39817 existing records. [2025-09-29T18:31:33.801206] [WARN ] [MAIN ] ELME: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:31:33.801521] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-09-29T18:31:33.801574] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-09-29T18:31:33.802184] [DEBUG] [LOCAL ] ELME: Deleted primary data file. [2025-09-29T18:31:33.802246] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-09-29T18:31:34.185161] [INFO ] [REMOTE ] ELME: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:31:34.185589] [INFO ] [REMOTE ] ELME: Fetching primary data for 2024-12. [2025-09-29T18:31:34.271085] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-29T18:31:34.748172] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-09-29T18:31:35.509197] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-29T18:31:35.548141] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-09-29T18:31:35.604769] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-29T18:31:35.972434] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-29T18:31:36.348122] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-09-29T18:31:37.148186] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-09-29T18:31:37.295032] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-09-29T18:31:37.380838] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-29T18:31:37.710246] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-29T18:31:37.948115] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-09-29T18:31:38.756609] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-09-29T18:31:38.762927] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-29T18:31:39.345004] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-29T18:31:39.548160] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-09-29T18:31:40.348140] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-09-29T18:31:41.123931] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-09-29T18:31:41.148070] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-09-29T18:31:41.719035] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-29T18:31:41.893044] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-29T18:31:41.948150] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-09-29T18:31:42.748159] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-09-29T18:31:43.205774] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-29T18:31:43.548131] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-09-29T18:31:43.791448] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-29T18:31:44.348173] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-09-29T18:31:44.954633] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-09-29T18:31:45.112912] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-29T18:31:45.148156] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-09-29T18:31:45.948132] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-09-29T18:31:46.023871] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-29T18:31:46.612952] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-29T18:31:46.748162] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-09-29T18:31:47.548173] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-09-29T18:31:47.862597] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-29T18:31:48.348184] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-09-29T18:31:49.128459] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-29T18:31:49.148112] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-09-29T18:31:49.469019] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-29T18:31:49.696853] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-29T18:31:49.948210] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-09-29T18:31:50.748137] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-09-29T18:31:51.043290] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-29T18:31:51.548148] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-09-29T18:31:51.777333] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-29T18:31:52.348140] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-09-29T18:31:52.876771] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-29T18:31:52.918490] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-29T18:31:53.148112] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-09-29T18:31:53.948147] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-09-29T18:31:54.390451] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-29T18:31:54.401986] [INFO ] [REMOTE ] EL: Full fetch complete (77326 records). [2025-09-29T18:31:54.402201] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-09-29T18:31:54.687293] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-29T18:31:54.751142] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-09-29T18:31:54.892997] [DEBUG] [VALIDATOR ] EL: All expected trading days are present. [2025-09-29T18:31:54.893131] [DEBUG] [VALIDATOR ] EL: Primary data validation passed. [2025-09-29T18:31:54.894702] [INFO ] [MAIN ] EL: Fetched primary data is valid. [2025-09-29T18:31:54.894795] [DEBUG] [LOCAL ] EL: Saving primary data. [2025-09-29T18:31:54.896456] [DEBUG] [LOCAL ] EL: Trimmed 77326 records to 53397 (keeping 200 days of data) [2025-09-29T18:31:55.279267] [DEBUG] [LOCAL ] EL: Primary data saved (53397 records). [2025-09-29T18:31:55.279471] [INFO ] [MAIN ] EL: Full history saved. [2025-09-29T18:31:55.279890] [INFO ] [MAIN ] Update Progress: 722/2371 symbols completed. EL took 31.2s. Estimated remaining: 3h 29m 50s. Rate: 7.9 symbols/min [2025-09-29T18:31:55.469174] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:31:55.501527] [DEBUG] [LOCAL ] ELP: Loaded 26107 existing records from primary storage. [2025-09-29T18:31:55.501851] [INFO ] [MAIN ] ELP: Loaded 26107 existing records. [2025-09-29T18:31:55.549226] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-09-29T18:31:55.716082] [WARN ] [MAIN ] ELP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:31:55.716578] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-09-29T18:31:55.716704] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-09-29T18:31:55.717304] [DEBUG] [LOCAL ] ELP: Deleted primary data file. [2025-09-29T18:31:55.717411] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-09-29T18:31:55.826353] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-29T18:31:55.898496] [INFO ] [REMOTE ] ELAN: Full fetch complete (76863 records). [2025-09-29T18:31:55.914202] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-09-29T18:31:56.501795] [INFO ] [REMOTE ] ELP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:31:56.519520] [INFO ] [REMOTE ] ELP: Fetching primary data for 2024-12. [2025-09-29T18:31:56.643353] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-09-29T18:31:56.643520] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-09-29T18:31:56.644564] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-09-29T18:31:56.644637] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-09-29T18:31:56.650008] [DEBUG] [LOCAL ] ELAN: Trimmed 76863 records to 53226 (keeping 200 days of data) [2025-09-29T18:31:57.005486] [DEBUG] [LOCAL ] ELAN: Primary data saved (53226 records). [2025-09-29T18:31:57.005700] [INFO ] [MAIN ] ELAN: Full history saved. [2025-09-29T18:31:57.005805] [INFO ] [MAIN ] Update Progress: 723/2371 symbols completed. ELAN took 32.9s. Estimated remaining: 3h 29m 29s. Rate: 7.9 symbols/min [2025-09-29T18:31:57.228351] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:31:57.232274] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-09-29T18:31:57.238165] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-09-29T18:31:57.233562] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-09-29T18:31:57.238708] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-09-29T18:31:57.248791] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-09-29T18:31:57.249608] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-09-29T18:31:57.249813] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-09-29T18:31:57.288895] [INFO ] [REMOTE ] ELF: Full fetch complete (75355 records). [2025-09-29T18:31:57.306245] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-09-29T18:31:57.503314] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-29T18:31:57.652817] [INFO ] [REMOTE ] ELME: Full fetch complete (55871 records). [2025-09-29T18:31:57.701438] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-09-29T18:31:58.332398] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-29T18:31:58.292238] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:31:58.366461] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-01. [2025-09-29T18:31:58.377862] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2024-12. [2025-09-29T18:31:58.481433] [DEBUG] [VALIDATOR ] ELF: All expected trading days are present. [2025-09-29T18:31:58.492732] [DEBUG] [VALIDATOR ] ELF: Primary data validation passed. [2025-09-29T18:31:58.494577] [INFO ] [MAIN ] ELF: Fetched primary data is valid. [2025-09-29T18:31:58.512264] [DEBUG] [LOCAL ] ELF: Saving primary data. [2025-09-29T18:31:58.585087] [DEBUG] [LOCAL ] ELF: Trimmed 75355 records to 52235 (keeping 200 days of data) [2025-09-29T18:31:58.784467] [DEBUG] [VALIDATOR ] ELME: All expected trading days are present. [2025-09-29T18:31:58.785572] [DEBUG] [VALIDATOR ] ELME: Primary data validation passed. [2025-09-29T18:31:58.786511] [INFO ] [MAIN ] ELME: Fetched primary data is valid. [2025-09-29T18:31:58.786884] [DEBUG] [LOCAL ] ELME: Saving primary data. [2025-09-29T18:31:58.791218] [DEBUG] [LOCAL ] ELME: Trimmed 55871 records to 39202 (keeping 200 days of data) [2025-09-29T18:31:59.028572] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-29T18:31:59.031355] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-09-29T18:31:59.304177] [DEBUG] [LOCAL ] ELME: Primary data saved (39202 records). [2025-09-29T18:31:59.305173] [INFO ] [MAIN ] ELME: Full history saved. [2025-09-29T18:31:59.305635] [INFO ] [MAIN ] Update Progress: 724/2371 symbols completed. ELME took 26.0s. Estimated remaining: 3h 29m 9s. Rate: 7.9 symbols/min [2025-09-29T18:31:59.437231] [DEBUG] [LOCAL ] ELF: Primary data saved (52235 records). [2025-09-29T18:31:59.443306] [INFO ] [MAIN ] ELF: Full history saved. [2025-09-29T18:31:59.453883] [INFO ] [MAIN ] Update Progress: 725/2371 symbols completed. ELF took 35.3s. Estimated remaining: 3h 28m 44s. Rate: 7.9 symbols/min [2025-09-29T18:31:59.560771] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-29T18:31:59.571386] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:31:59.616859] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-09-29T18:31:59.732835] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:31:59.750722] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-29T18:31:59.815277] [DEBUG] [LOCAL ] ELS: Loaded 50110 existing records from primary storage. [2025-09-29T18:31:59.815856] [INFO ] [MAIN ] ELS: Loaded 50110 existing records. [2025-09-29T18:32:00.017376] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-29T18:32:00.054536] [WARN ] [MAIN ] ELS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:32:00.056867] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-09-29T18:32:00.056988] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-09-29T18:32:00.074321] [DEBUG] [LOCAL ] ELS: Deleted primary data file. [2025-09-29T18:32:00.074240] [DEBUG] [LOCAL ] ELV: Loaded 51334 existing records from primary storage. [2025-09-29T18:32:00.074568] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-09-29T18:32:00.080086] [INFO ] [MAIN ] ELV: Loaded 51334 existing records. [2025-09-29T18:32:00.405765] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-09-29T18:32:00.635849] [WARN ] [MAIN ] ELV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:32:00.668418] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-09-29T18:32:00.681217] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-09-29T18:32:00.697966] [DEBUG] [LOCAL ] ELV: Deleted primary data file. [2025-09-29T18:32:00.708472] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-09-29T18:32:00.911366] [INFO ] [REMOTE ] ELS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:32:01.153343] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-09-29T18:32:01.212119] [INFO ] [REMOTE ] ELV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:32:01.556465] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-29T18:32:01.777742] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-29T18:32:01.948178] [INFO ] [REMOTE ] ELV: Fetching primary data for 2024-12. [2025-09-29T18:32:02.748126] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-09-29T18:32:03.548163] [INFO ] [REMOTE ] ELS: Fetching primary data for 2024-12. [2025-09-29T18:32:03.926914] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-29T18:32:03.968695] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-29T18:32:04.348134] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-09-29T18:32:04.772417] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-29T18:32:05.148082] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-09-29T18:32:05.562471] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-29T18:32:05.948151] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-01. [2025-09-29T18:32:06.389151] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-29T18:32:06.748172] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-09-29T18:32:07.313185] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-29T18:32:07.548117] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-09-29T18:32:08.332228] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-29T18:32:08.348088] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-09-29T18:32:09.148099] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-09-29T18:32:09.347339] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-29T18:32:09.587386] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-29T18:32:09.611172] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-29T18:32:09.948135] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-09-29T18:32:10.748164] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-01. [2025-09-29T18:32:11.548132] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-09-29T18:32:11.610783] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-29T18:32:12.348134] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-09-29T18:32:12.482456] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-29T18:32:12.853936] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-29T18:32:13.148119] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-09-29T18:32:13.948120] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-09-29T18:32:14.257391] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-29T18:32:14.261170] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-29T18:32:14.748114] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-09-29T18:32:15.548116] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-09-29T18:32:15.749815] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-29T18:32:15.851017] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-29T18:32:15.855894] [INFO ] [REMOTE ] ELP: Full fetch complete (37446 records). [2025-09-29T18:32:15.855988] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-09-29T18:32:15.942887] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-29T18:32:16.255939] [DEBUG] [VALIDATOR ] ELP: All expected trading days are present. [2025-09-29T18:32:16.256021] [DEBUG] [VALIDATOR ] ELP: Primary data validation passed. [2025-09-29T18:32:16.256775] [INFO ] [MAIN ] ELP: Fetched primary data is valid. [2025-09-29T18:32:16.256885] [DEBUG] [LOCAL ] ELP: Saving primary data. [2025-09-29T18:32:16.257865] [DEBUG] [LOCAL ] ELP: Trimmed 37446 records to 25746 (keeping 200 days of data) [2025-09-29T18:32:16.348687] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-09-29T18:32:16.413667] [DEBUG] [LOCAL ] ELP: Primary data saved (25746 records). [2025-09-29T18:32:16.413820] [INFO ] [MAIN ] ELP: Full history saved. [2025-09-29T18:32:16.413917] [INFO ] [MAIN ] Update Progress: 726/2371 symbols completed. ELP took 21.1s. Estimated remaining: 3h 28m 58s. Rate: 7.9 symbols/min [2025-09-29T18:32:16.605383] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:32:16.605740] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-09-29T18:32:16.605827] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-09-29T18:32:16.605996] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-09-29T18:32:16.606076] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-09-29T18:32:16.606178] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-09-29T18:32:16.606245] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-09-29T18:32:17.012000] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:32:17.148107] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-09-29T18:32:17.948083] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-09-29T18:32:18.093327] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-29T18:32:18.319681] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-29T18:32:18.753299] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-09-29T18:32:18.767929] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-29T18:32:19.118502] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-29T18:32:19.548123] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-09-29T18:32:20.348093] [INFO ] [REMOTE ] EMA: Fetching primary data for 2024-12. [2025-09-29T18:32:20.546131] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T18:32:20.546466] [WARN ] [REMOTE ] EMA: No data returned for month 2024-12 [2025-09-29T18:32:20.546603] [FATAL] [REMOTE ] EMA: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T18:32:20.546683] [FATAL] [MAIN ] EMA: Failed to fetch primary data. [2025-09-29T18:32:20.546751] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T18:32:20.546826] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-09-29T18:32:20.546893] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-09-29T18:32:20.546929] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-09-29T18:32:20.546987] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-09-29T18:32:20.547059] [INFO ] [MAIN ] Update Progress: 727/2371 symbols completed. EMA took 4.1s. Estimated remaining: 3h 28m 42s. Rate: 7.9 symbols/min [2025-09-29T18:32:20.728890] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:32:20.752526] [DEBUG] [LOCAL ] EMD: Loaded 21338 existing records from primary storage. [2025-09-29T18:32:20.752828] [INFO ] [MAIN ] EMD: Loaded 21338 existing records. [2025-09-29T18:32:20.953922] [WARN ] [MAIN ] EMD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:32:20.954258] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-09-29T18:32:20.954335] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-09-29T18:32:20.954825] [DEBUG] [LOCAL ] EMD: Deleted primary data file. [2025-09-29T18:32:20.954998] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-09-29T18:32:21.148100] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-09-29T18:32:21.388317] [INFO ] [REMOTE ] EMD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:32:21.421369] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-29T18:32:21.948106] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-09-29T18:32:22.749666] [INFO ] [REMOTE ] EMD: Fetching primary data for 2024-12. [2025-09-29T18:32:22.752328] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-29T18:32:23.548104] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-09-29T18:32:23.895797] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-29T18:32:24.021218] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-29T18:32:24.348111] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-01. [2025-09-29T18:32:25.148092] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-09-29T18:32:25.318437] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-29T18:32:25.376532] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-29T18:32:25.703288] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-29T18:32:25.704324] [INFO ] [REMOTE ] ELPC: Full fetch complete (1467 records). [2025-09-29T18:32:25.704419] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-09-29T18:32:25.906149] [WARN ] [VALIDATOR ] ELPC: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-29T18:32:25.906457] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:32:25.906536] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:32:25.906593] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-09-29T18:32:25.906689] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-09-29T18:32:25.906751] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-09-29T18:32:25.906814] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-09-29T18:32:25.906896] [INFO ] [MAIN ] Update Progress: 728/2371 symbols completed. ELPC took 28.9s. Estimated remaining: 3h 28m 30s. Rate: 7.9 symbols/min [2025-09-29T18:32:25.953185] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-09-29T18:32:26.087207] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:32:26.137104] [DEBUG] [LOCAL ] EME: Loaded 32035 existing records from primary storage. [2025-09-29T18:32:26.137492] [INFO ] [MAIN ] EME: Loaded 32035 existing records. [2025-09-29T18:32:26.328253] [WARN ] [MAIN ] EME: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:32:26.328606] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-09-29T18:32:26.328695] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-09-29T18:32:26.329250] [DEBUG] [LOCAL ] EME: Deleted primary data file. [2025-09-29T18:32:26.329311] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-09-29T18:32:26.709589] [INFO ] [REMOTE ] EME: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:32:26.748083] [INFO ] [REMOTE ] EME: Fetching primary data for 2024-12. [2025-09-29T18:32:27.548178] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-09-29T18:32:27.732474] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-29T18:32:27.812243] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-29T18:32:28.348116] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-01. [2025-09-29T18:32:29.148142] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-09-29T18:32:29.386010] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-29T18:32:29.948088] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-09-29T18:32:30.017523] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-29T18:32:30.748110] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-09-29T18:32:30.787792] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-29T18:32:30.799295] [INFO ] [REMOTE ] ELS: Full fetch complete (70631 records). [2025-09-29T18:32:30.799453] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-09-29T18:32:31.214145] [DEBUG] [VALIDATOR ] ELS: All expected trading days are present. [2025-09-29T18:32:31.214240] [DEBUG] [VALIDATOR ] ELS: Primary data validation passed. [2025-09-29T18:32:31.215162] [INFO ] [MAIN ] ELS: Fetched primary data is valid. [2025-09-29T18:32:31.215228] [DEBUG] [LOCAL ] ELS: Saving primary data. [2025-09-29T18:32:31.216675] [DEBUG] [LOCAL ] ELS: Trimmed 70631 records to 49379 (keeping 200 days of data) [2025-09-29T18:32:31.542351] [DEBUG] [LOCAL ] ELS: Primary data saved (49379 records). [2025-09-29T18:32:31.542536] [INFO ] [MAIN ] ELS: Full history saved. [2025-09-29T18:32:31.542639] [INFO ] [MAIN ] Update Progress: 729/2371 symbols completed. ELS took 32.2s. Estimated remaining: 3h 28m 18s. Rate: 7.9 symbols/min [2025-09-29T18:32:31.554466] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-09-29T18:32:31.722305] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:32:31.729957] [DEBUG] [LOCAL ] EMF: Loaded 3575 existing records from primary storage. [2025-09-29T18:32:31.730165] [INFO ] [MAIN ] EMF: Loaded 3575 existing records. [2025-09-29T18:32:31.921300] [WARN ] [MAIN ] EMF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:32:31.921956] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-09-29T18:32:31.922170] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-09-29T18:32:31.922488] [DEBUG] [LOCAL ] EMF: Deleted primary data file. [2025-09-29T18:32:31.922572] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-09-29T18:32:32.163594] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-29T18:32:32.349489] [INFO ] [REMOTE ] EMF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:32:32.349713] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-09-29T18:32:32.383417] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-09-29T18:32:32.875926] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-29T18:32:33.148122] [INFO ] [REMOTE ] EMF: Fetching primary data for 2024-12. [2025-09-29T18:32:33.925754] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-29T18:32:33.949316] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-09-29T18:32:33.952330] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-29T18:32:34.748150] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-09-29T18:32:35.548158] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-01. [2025-09-29T18:32:35.757027] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-29T18:32:36.348102] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-09-29T18:32:36.385525] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-29T18:32:36.710922] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-29T18:32:37.148124] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-09-29T18:32:37.937627] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-29T18:32:37.948079] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-09-29T18:32:38.261042] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-29T18:32:38.643506] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-29T18:32:38.748123] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-09-29T18:32:39.548126] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-09-29T18:32:40.348155] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-09-29T18:32:40.387354] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-29T18:32:41.137021] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-09-29T18:32:41.148206] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-09-29T18:32:41.150471] [INFO ] [REMOTE ] ELV: Full fetch complete (72826 records). [2025-09-29T18:32:41.150790] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-09-29T18:32:41.152084] [FATAL] [VALIDATOR ] ELV: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:32:41.152192] [FATAL] [MAIN ] ELV: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:32:41.152261] [WARN ] [MAIN ] ELV: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:32:41.152360] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-09-29T18:32:41.152460] [DEBUG] [LOCAL ] ELV: No primary data file found to delete. [2025-09-29T18:32:41.152520] [INFO ] [LOCAL ] ELV: Starting deletion of derivative data. [2025-09-29T18:32:41.153125] [DEBUG] [LOCAL ] ELV: Deleted derivative data file. [2025-09-29T18:32:41.153238] [INFO ] [MAIN ] Update Progress: 730/2371 symbols completed. ELV took 41.7s. Estimated remaining: 3h 28m 15s. Rate: 7.9 symbols/min [2025-09-29T18:32:41.369107] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:32:41.429709] [DEBUG] [LOCAL ] EMN: Loaded 51117 existing records from primary storage. [2025-09-29T18:32:41.430092] [INFO ] [MAIN ] EMN: Loaded 51117 existing records. [2025-09-29T18:32:41.646089] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:32:41.646696] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-09-29T18:32:41.646830] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-09-29T18:32:41.653855] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-29T18:32:41.653931] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-09-29T18:32:41.654857] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-09-29T18:32:41.950028] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-09-29T18:32:42.049698] [INFO ] [REMOTE ] EMN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:32:42.072464] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-29T18:32:42.430507] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-29T18:32:42.748131] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-09-29T18:32:43.161045] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-29T18:32:43.548132] [INFO ] [REMOTE ] EMN: Fetching primary data for 2024-12. [2025-09-29T18:32:44.348143] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-09-29T18:32:45.148128] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-09-29T18:32:45.336127] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-29T18:32:45.844424] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-29T18:32:45.948162] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-01. [2025-09-29T18:32:46.098938] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-29T18:32:46.748158] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-09-29T18:32:47.514349] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-29T18:32:47.548096] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-09-29T18:32:48.193486] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-29T18:32:48.348177] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-09-29T18:32:49.148124] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-09-29T18:32:49.192964] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-29T18:32:49.332695] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-29T18:32:49.713638] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-29T18:32:49.948128] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-09-29T18:32:50.748085] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-09-29T18:32:51.069364] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-29T18:32:51.233426] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-29T18:32:51.548109] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-09-29T18:32:52.348133] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-09-29T18:32:52.912099] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-29T18:32:53.148100] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-09-29T18:32:53.478512] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-29T18:32:53.948121] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-09-29T18:32:54.752571] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-09-29T18:32:54.757378] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-29T18:32:54.764968] [INFO ] [REMOTE ] EME: Full fetch complete (46707 records). [2025-09-29T18:32:54.765116] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-09-29T18:32:54.766002] [FATAL] [VALIDATOR ] EME: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:32:54.766112] [FATAL] [MAIN ] EME: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:32:54.766165] [WARN ] [MAIN ] EME: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:32:54.766238] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-09-29T18:32:54.766322] [DEBUG] [LOCAL ] EME: No primary data file found to delete. [2025-09-29T18:32:54.766379] [INFO ] [LOCAL ] EME: Starting deletion of derivative data. [2025-09-29T18:32:54.766999] [DEBUG] [LOCAL ] EME: Deleted derivative data file. [2025-09-29T18:32:54.767118] [INFO ] [MAIN ] Update Progress: 731/2371 symbols completed. EME took 28.9s. Estimated remaining: 3h 28m 20s. Rate: 7.9 symbols/min [2025-09-29T18:32:54.951462] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-29T18:32:54.973091] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:32:54.973245] [INFO ] [REMOTE ] EMF: Full fetch complete (7207 records). [2025-09-29T18:32:54.974102] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-09-29T18:32:55.138257] [DEBUG] [LOCAL ] EMO: Loaded 12656 existing records from primary storage. [2025-09-29T18:32:55.158200] [INFO ] [MAIN ] EMO: Loaded 12656 existing records. [2025-09-29T18:32:55.532732] [WARN ] [MAIN ] EMO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:32:55.548178] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-09-29T18:32:55.548298] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-09-29T18:32:55.549425] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-09-29T18:32:55.555242] [DEBUG] [LOCAL ] EMO: Deleted primary data file. [2025-09-29T18:32:55.557979] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-09-29T18:32:55.630707] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-09-29T18:32:55.646696] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-09-29T18:32:55.677635] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-09-29T18:32:55.688369] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-09-29T18:32:55.708807] [DEBUG] [LOCAL ] EMF: Trimmed 7207 records to 3445 (keeping 200 days of data) [2025-09-29T18:32:55.965668] [DEBUG] [LOCAL ] EMF: Primary data saved (3445 records). [2025-09-29T18:32:55.994468] [INFO ] [MAIN ] EMF: Full history saved. [2025-09-29T18:32:56.024991] [INFO ] [MAIN ] Update Progress: 732/2371 symbols completed. EMF took 24.5s. Estimated remaining: 3h 27m 59s. Rate: 7.9 symbols/min [2025-09-29T18:32:56.031253] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-29T18:32:56.126499] [INFO ] [REMOTE ] EMO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:32:56.132076] [INFO ] [REMOTE ] EMD: Full fetch complete (32273 records). [2025-09-29T18:32:56.165324] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-09-29T18:32:56.350763] [INFO ] [REMOTE ] EMO: Fetching primary data for 2024-12. [2025-09-29T18:32:56.390740] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:32:56.552601] [DEBUG] [LOCAL ] EMP: Loaded 3062 existing records from primary storage. [2025-09-29T18:32:56.563896] [INFO ] [MAIN ] EMP: Loaded 3062 existing records. [2025-09-29T18:32:56.870287] [DEBUG] [VALIDATOR ] EMD: All expected trading days are present. [2025-09-29T18:32:56.871403] [DEBUG] [VALIDATOR ] EMD: Primary data validation passed. [2025-09-29T18:32:56.872194] [INFO ] [MAIN ] EMD: Fetched primary data is valid. [2025-09-29T18:32:56.888848] [DEBUG] [LOCAL ] EMD: Saving primary data. [2025-09-29T18:32:56.895660] [WARN ] [MAIN ] EMP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:32:56.896045] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-09-29T18:32:56.896449] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-09-29T18:32:56.897035] [DEBUG] [LOCAL ] EMD: Trimmed 32273 records to 21085 (keeping 200 days of data) [2025-09-29T18:32:56.897376] [DEBUG] [LOCAL ] EMP: Deleted primary data file. [2025-09-29T18:32:56.897482] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-09-29T18:32:57.423816] [INFO ] [REMOTE ] EMP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:32:57.427225] [INFO ] [REMOTE ] EMP: Fetching primary data for 2024-12. [2025-09-29T18:32:57.472313] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-29T18:32:57.510625] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-29T18:32:57.510309] [DEBUG] [LOCAL ] EMD: Primary data saved (21085 records). [2025-09-29T18:32:57.514182] [INFO ] [MAIN ] EMD: Full history saved. [2025-09-29T18:32:57.514272] [INFO ] [MAIN ] Update Progress: 733/2371 symbols completed. EMD took 37.0s. Estimated remaining: 3h 27m 37s. Rate: 7.9 symbols/min [2025-09-29T18:32:57.695944] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:32:57.761692] [DEBUG] [LOCAL ] EMR: Loaded 54027 existing records from primary storage. [2025-09-29T18:32:57.762140] [INFO ] [MAIN ] EMR: Loaded 54027 existing records. [2025-09-29T18:32:57.948688] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-09-29T18:32:57.952863] [WARN ] [MAIN ] EMR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:32:57.953986] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-09-29T18:32:57.954046] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-09-29T18:32:57.955868] [DEBUG] [LOCAL ] EMR: Deleted primary data file. [2025-09-29T18:32:57.955930] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-09-29T18:32:58.260204] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-29T18:32:58.347960] [INFO ] [REMOTE ] EMR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:32:58.748161] [INFO ] [REMOTE ] EMR: Fetching primary data for 2024-12. [2025-09-29T18:32:59.548096] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-01. [2025-09-29T18:32:59.846532] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-29T18:33:00.077136] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-29T18:33:00.348114] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-09-29T18:33:00.612408] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-29T18:33:00.646846] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-29T18:33:01.148123] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-01. [2025-09-29T18:33:01.708543] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-29T18:33:01.948160] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-09-29T18:33:02.533015] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-29T18:33:02.748152] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-09-29T18:33:03.289253] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-29T18:33:03.548131] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-09-29T18:33:04.348132] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-09-29T18:33:05.124113] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-29T18:33:05.148117] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-09-29T18:33:05.321915] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-29T18:33:05.948120] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-09-29T18:33:05.998367] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-29T18:33:06.518180] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-29T18:33:06.748124] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-09-29T18:33:07.548112] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-09-29T18:33:08.156206] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-29T18:33:08.348139] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-09-29T18:33:08.432331] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-29T18:33:09.148146] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-01. [2025-09-29T18:33:09.568729] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-29T18:33:09.948120] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-09-29T18:33:10.748135] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-09-29T18:33:11.058573] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-29T18:33:11.305199] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-29T18:33:11.462880] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-29T18:33:11.548109] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-09-29T18:33:12.348126] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-09-29T18:33:12.923755] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-29T18:33:13.148140] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-09-29T18:33:13.323809] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-29T18:33:13.593296] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-29T18:33:13.948125] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-09-29T18:33:14.748086] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-09-29T18:33:15.444833] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-29T18:33:15.446354] [INFO ] [REMOTE ] EMP: Full fetch complete (4242 records). [2025-09-29T18:33:15.446465] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-09-29T18:33:15.446937] [FATAL] [VALIDATOR ] EMP: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:33:15.447018] [FATAL] [MAIN ] EMP: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:33:15.447086] [WARN ] [MAIN ] EMP: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:33:15.447159] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-09-29T18:33:15.447225] [DEBUG] [LOCAL ] EMP: No primary data file found to delete. [2025-09-29T18:33:15.447263] [INFO ] [LOCAL ] EMP: Starting deletion of derivative data. [2025-09-29T18:33:15.447737] [DEBUG] [LOCAL ] EMP: Deleted derivative data file. [2025-09-29T18:33:15.447832] [INFO ] [MAIN ] Update Progress: 734/2371 symbols completed. EMP took 19.4s. Estimated remaining: 3h 27m 53s. Rate: 7.9 symbols/min [2025-09-29T18:33:15.549251] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-09-29T18:33:15.646548] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:33:15.706608] [DEBUG] [LOCAL ] ENB: Loaded 54295 existing records from primary storage. [2025-09-29T18:33:15.707272] [INFO ] [MAIN ] ENB: Loaded 54295 existing records. [2025-09-29T18:33:15.850111] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-29T18:33:15.943935] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:33:15.944172] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-09-29T18:33:15.944221] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-09-29T18:33:15.945358] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-09-29T18:33:15.945418] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-09-29T18:33:16.309735] [INFO ] [REMOTE ] ENB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:33:16.348073] [INFO ] [REMOTE ] ENB: Fetching primary data for 2024-12. [2025-09-29T18:33:16.411099] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-29T18:33:17.148137] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-09-29T18:33:17.948113] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-09-29T18:33:18.478914] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-29T18:33:18.748120] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-01. [2025-09-29T18:33:19.010596] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-29T18:33:19.078675] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-29T18:33:19.548126] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-09-29T18:33:20.348075] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-09-29T18:33:20.556485] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-29T18:33:20.626958] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-29T18:33:21.148166] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-09-29T18:33:21.948147] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-09-29T18:33:22.294667] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-29T18:33:22.748166] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-09-29T18:33:22.828755] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-29T18:33:22.840850] [INFO ] [REMOTE ] EMN: Full fetch complete (72008 records). [2025-09-29T18:33:22.841040] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-09-29T18:33:23.289745] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-09-29T18:33:23.289847] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-09-29T18:33:23.290768] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-09-29T18:33:23.290843] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-09-29T18:33:23.293018] [DEBUG] [LOCAL ] EMN: Trimmed 72008 records to 50422 (keeping 200 days of data) [2025-09-29T18:33:23.548460] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-09-29T18:33:23.689805] [DEBUG] [LOCAL ] EMN: Primary data saved (50422 records). [2025-09-29T18:33:23.689967] [INFO ] [MAIN ] EMN: Full history saved. [2025-09-29T18:33:23.690111] [INFO ] [MAIN ] Update Progress: 735/2371 symbols completed. EMN took 42.5s. Estimated remaining: 3h 27m 46s. Rate: 7.9 symbols/min [2025-09-29T18:33:23.928461] [INFO ] [MAIN ] ENFY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:33:23.932196] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-29T18:33:23.949362] [DEBUG] [LOCAL ] ENFY: Loaded 3106 existing records from primary storage. [2025-09-29T18:33:23.949627] [INFO ] [MAIN ] ENFY: Loaded 3106 existing records. [2025-09-29T18:33:24.156597] [WARN ] [MAIN ] ENFY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:33:24.156910] [INFO ] [MAIN ] ENFY: Wiping existing primary data before full refresh. [2025-09-29T18:33:24.156974] [INFO ] [LOCAL ] ENFY: Starting deletion of primary data. [2025-09-29T18:33:24.157224] [DEBUG] [LOCAL ] ENFY: Deleted primary data file. [2025-09-29T18:33:24.157286] [INFO ] [MAIN ] ENFY: Starting full primary refresh. [2025-09-29T18:33:24.350121] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-09-29T18:33:24.605421] [INFO ] [REMOTE ] ENFY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:33:24.625939] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-29T18:33:24.631075] [INFO ] [REMOTE ] EMO: Full fetch complete (17004 records). [2025-09-29T18:33:24.631224] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-09-29T18:33:24.632520] [FATAL] [VALIDATOR ] EMO: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:33:24.661009] [FATAL] [MAIN ] EMO: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:33:24.661206] [WARN ] [MAIN ] EMO: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:33:24.664675] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-09-29T18:33:24.664846] [DEBUG] [LOCAL ] EMO: No primary data file found to delete. [2025-09-29T18:33:24.665430] [INFO ] [LOCAL ] EMO: Starting deletion of derivative data. [2025-09-29T18:33:24.667779] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-29T18:33:24.680125] [DEBUG] [LOCAL ] EMO: Deleted derivative data file. [2025-09-29T18:33:24.680722] [INFO ] [MAIN ] Update Progress: 736/2371 symbols completed. EMO took 29.9s. Estimated remaining: 3h 27m 24s. Rate: 7.9 symbols/min [2025-09-29T18:33:24.878025] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:33:24.923953] [DEBUG] [LOCAL ] ENIC: Loaded 36910 existing records from primary storage. [2025-09-29T18:33:24.924255] [INFO ] [MAIN ] ENIC: Loaded 36910 existing records. [2025-09-29T18:33:25.118940] [WARN ] [MAIN ] ENIC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:33:25.119184] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-09-29T18:33:25.119297] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-09-29T18:33:25.119915] [DEBUG] [LOCAL ] ENIC: Deleted primary data file. [2025-09-29T18:33:25.120003] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-09-29T18:33:25.154050] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-09-29T18:33:25.510786] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:33:25.948102] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2024-12. [2025-09-29T18:33:26.385227] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-29T18:33:26.605587] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-29T18:33:26.748335] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2024-12. [2025-09-29T18:33:27.047919] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-29T18:33:27.269168] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-29T18:33:27.548179] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-01. [2025-09-29T18:33:28.348134] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-09-29T18:33:28.964066] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-29T18:33:29.148131] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-01. [2025-09-29T18:33:29.908336] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-29T18:33:29.948081] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-09-29T18:33:30.491053] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-29T18:33:30.748344] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-02. [2025-09-29T18:33:31.125332] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-29T18:33:31.358171] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-29T18:33:31.548125] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-09-29T18:33:32.348121] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-03. [2025-09-29T18:33:32.864716] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-29T18:33:33.148101] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-04. [2025-09-29T18:33:33.510571] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-29T18:33:33.569448] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-29T18:33:33.948136] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-05. [2025-09-29T18:33:34.503854] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-29T18:33:34.748167] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-09-29T18:33:35.548147] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-09-29T18:33:36.118268] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-29T18:33:36.348155] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-06. [2025-09-29T18:33:36.967682] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-29T18:33:37.148137] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-07. [2025-09-29T18:33:37.374421] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-29T18:33:37.948152] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-09-29T18:33:37.998450] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-29T18:33:38.748160] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-09-29T18:33:39.456739] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-29T18:33:39.548133] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-09-29T18:33:40.348165] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-09-29T18:33:40.414147] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-29T18:33:41.109851] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-29T18:33:41.148100] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-09-29T18:33:41.948084] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-09-29T18:33:42.290363] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-29T18:33:42.301488] [INFO ] [REMOTE ] EMR: Full fetch complete (77108 records). [2025-09-29T18:33:42.301689] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-09-29T18:33:42.689609] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-29T18:33:42.753581] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-08. [2025-09-29T18:33:42.810536] [DEBUG] [VALIDATOR ] EMR: All expected trading days are present. [2025-09-29T18:33:42.810632] [DEBUG] [VALIDATOR ] EMR: Primary data validation passed. [2025-09-29T18:33:42.811774] [INFO ] [MAIN ] EMR: Fetched primary data is valid. [2025-09-29T18:33:42.811843] [DEBUG] [LOCAL ] EMR: Saving primary data. [2025-09-29T18:33:42.813448] [DEBUG] [LOCAL ] EMR: Trimmed 77108 records to 53249 (keeping 200 days of data) [2025-09-29T18:33:43.171407] [DEBUG] [LOCAL ] EMR: Primary data saved (53249 records). [2025-09-29T18:33:43.171562] [INFO ] [MAIN ] EMR: Full history saved. [2025-09-29T18:33:43.173357] [INFO ] [MAIN ] Update Progress: 737/2371 symbols completed. EMR took 45.7s. Estimated remaining: 3h 27m 41s. Rate: 7.9 symbols/min [2025-09-29T18:33:43.367073] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:33:43.371780] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-29T18:33:43.377303] [DEBUG] [LOCAL ] ENO: Loaded 1952 existing records from primary storage. [2025-09-29T18:33:43.377690] [INFO ] [MAIN ] ENO: Loaded 1952 existing records. [2025-09-29T18:33:43.551695] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-09-29T18:33:43.655164] [WARN ] [MAIN ] ENO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:33:43.655457] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-09-29T18:33:43.655525] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-09-29T18:33:43.655940] [DEBUG] [LOCAL ] ENO: Deleted primary data file. [2025-09-29T18:33:43.656011] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-09-29T18:33:43.882968] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-29T18:33:44.084082] [INFO ] [REMOTE ] ENO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:33:44.348133] [INFO ] [REMOTE ] ENO: Fetching primary data for 2024-12. [2025-09-29T18:33:44.769406] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-29T18:33:45.142409] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-29T18:33:45.148056] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-01. [2025-09-29T18:33:45.622723] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-29T18:33:45.948116] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-09-29T18:33:46.748133] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-09-29T18:33:47.202954] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-29T18:33:47.548135] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-09-29T18:33:47.877806] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-29T18:33:47.880076] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-29T18:33:48.348194] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-09-29T18:33:49.148140] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-09-29T18:33:49.865239] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-29T18:33:49.948139] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-09-29T18:33:50.748195] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-09-29T18:33:50.988018] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-29T18:33:51.341850] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-29T18:33:51.382052] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-29T18:33:51.390082] [INFO ] [REMOTE ] ENIC: Full fetch complete (51319 records). [2025-09-29T18:33:51.390245] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-09-29T18:33:51.553400] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-09-29T18:33:51.832129] [DEBUG] [VALIDATOR ] ENIC: All expected trading days are present. [2025-09-29T18:33:51.832226] [DEBUG] [VALIDATOR ] ENIC: Primary data validation passed. [2025-09-29T18:33:51.833111] [INFO ] [MAIN ] ENIC: Fetched primary data is valid. [2025-09-29T18:33:51.833183] [DEBUG] [LOCAL ] ENIC: Saving primary data. [2025-09-29T18:33:51.834498] [DEBUG] [LOCAL ] ENIC: Trimmed 51319 records to 36314 (keeping 200 days of data) [2025-09-29T18:33:52.058710] [DEBUG] [LOCAL ] ENIC: Primary data saved (36314 records). [2025-09-29T18:33:52.058926] [INFO ] [MAIN ] ENIC: Full history saved. [2025-09-29T18:33:52.059137] [INFO ] [MAIN ] Update Progress: 738/2371 symbols completed. ENIC took 27.4s. Estimated remaining: 3h 27m 36s. Rate: 7.9 symbols/min [2025-09-29T18:33:52.264691] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:33:52.309178] [DEBUG] [LOCAL ] ENOV: Loaded 45799 existing records from primary storage. [2025-09-29T18:33:52.309500] [INFO ] [MAIN ] ENOV: Loaded 45799 existing records. [2025-09-29T18:33:52.353535] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-09. [2025-09-29T18:33:52.496739] [WARN ] [MAIN ] ENOV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:33:52.496969] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-09-29T18:33:52.497018] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-09-29T18:33:52.497484] [DEBUG] [LOCAL ] ENOV: Deleted primary data file. [2025-09-29T18:33:52.497544] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-09-29T18:33:52.871395] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:33:53.148080] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-09-29T18:33:53.293824] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-29T18:33:53.295028] [INFO ] [REMOTE ] ENFY: Full fetch complete (5609 records). [2025-09-29T18:33:53.295099] [DEBUG] [VALIDATOR ] ENFY: Validating primary data. [2025-09-29T18:33:53.683505] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-29T18:33:53.683366] [DEBUG] [VALIDATOR ] ENFY: All expected trading days are present. [2025-09-29T18:33:53.685426] [DEBUG] [VALIDATOR ] ENFY: Primary data validation passed. [2025-09-29T18:33:53.685755] [INFO ] [MAIN ] ENFY: Fetched primary data is valid. [2025-09-29T18:33:53.685845] [DEBUG] [LOCAL ] ENFY: Saving primary data. [2025-09-29T18:33:53.686736] [DEBUG] [LOCAL ] ENFY: Trimmed 5609 records to 3090 (keeping 200 days of data) [2025-09-29T18:33:53.737163] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-29T18:33:53.749549] [INFO ] [REMOTE ] ENB: Full fetch complete (77492 records). [2025-09-29T18:33:53.750554] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-09-29T18:33:53.800414] [DEBUG] [LOCAL ] ENFY: Primary data saved (3090 records). [2025-09-29T18:33:53.857938] [INFO ] [MAIN ] ENFY: Full history saved. [2025-09-29T18:33:53.869728] [INFO ] [MAIN ] Update Progress: 739/2371 symbols completed. ENFY took 30.2s. Estimated remaining: 3h 27m 15s. Rate: 7.9 symbols/min [2025-09-29T18:33:53.955805] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2024-12. [2025-09-29T18:33:54.339713] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:33:54.405675] [DEBUG] [VALIDATOR ] ENB: All expected trading days are present. [2025-09-29T18:33:54.405790] [DEBUG] [VALIDATOR ] ENB: Primary data validation passed. [2025-09-29T18:33:54.406935] [INFO ] [MAIN ] ENB: Fetched primary data is valid. [2025-09-29T18:33:54.407117] [DEBUG] [LOCAL ] ENB: Saving primary data. [2025-09-29T18:33:54.408872] [DEBUG] [LOCAL ] ENB: Trimmed 77492 records to 53513 (keeping 200 days of data) [2025-09-29T18:33:54.556999] [DEBUG] [LOCAL ] ENR: Loaded 43336 existing records from primary storage. [2025-09-29T18:33:54.562041] [INFO ] [MAIN ] ENR: Loaded 43336 existing records. [2025-09-29T18:33:54.802618] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-09-29T18:33:54.839043] [WARN ] [MAIN ] ENR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:33:54.840521] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-09-29T18:33:54.867479] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-09-29T18:33:54.870886] [DEBUG] [LOCAL ] ENR: Deleted primary data file. [2025-09-29T18:33:54.871543] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-09-29T18:33:55.311721] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:33:55.404385] [DEBUG] [LOCAL ] ENB: Primary data saved (53513 records). [2025-09-29T18:33:55.404529] [INFO ] [MAIN ] ENB: Full history saved. [2025-09-29T18:33:55.404634] [INFO ] [MAIN ] Update Progress: 740/2371 symbols completed. ENB took 40.0s. Estimated remaining: 3h 26m 54s. Rate: 7.9 symbols/min [2025-09-29T18:33:55.494534] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-29T18:33:55.549959] [INFO ] [REMOTE ] ENR: Fetching primary data for 2024-12. [2025-09-29T18:33:55.609289] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:33:55.641320] [DEBUG] [LOCAL ] ENS: Loaded 29869 existing records from primary storage. [2025-09-29T18:33:55.641625] [INFO ] [MAIN ] ENS: Loaded 29869 existing records. [2025-09-29T18:33:55.832271] [WARN ] [MAIN ] ENS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:33:55.852868] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-09-29T18:33:55.854231] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-29T18:33:55.854319] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-09-29T18:33:55.863230] [DEBUG] [LOCAL ] ENS: Deleted primary data file. [2025-09-29T18:33:55.863297] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-09-29T18:33:56.249930] [INFO ] [REMOTE ] ENS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:33:56.348113] [INFO ] [REMOTE ] ENS: Fetching primary data for 2024-12. [2025-09-29T18:33:57.062372] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-29T18:33:57.148143] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-01. [2025-09-29T18:33:57.948140] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-09-29T18:33:58.052272] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-29T18:33:58.241173] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-09-29T18:33:58.717322] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-29T18:33:58.748167] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-09-29T18:33:59.180591] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-29T18:33:59.548108] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-01. [2025-09-29T18:34:00.348191] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-09-29T18:34:00.946559] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-29T18:34:01.148192] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-09-29T18:34:01.942579] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-29T18:34:01.953047] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-09-29T18:34:02.558696] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-29T18:34:02.748132] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-09-29T18:34:03.004004] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-29T18:34:03.548121] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-09-29T18:34:04.059833] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-29T18:34:04.348137] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-09-29T18:34:04.944540] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-29T18:34:05.148143] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-09-29T18:34:05.728194] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-29T18:34:05.948199] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-09-29T18:34:06.122426] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-29T18:34:06.123423] [INFO ] [REMOTE ] ENO: Full fetch complete (3113 records). [2025-09-29T18:34:06.123522] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-09-29T18:34:06.535009] [DEBUG] [VALIDATOR ] ENO: All expected trading days are present. [2025-09-29T18:34:06.535128] [DEBUG] [VALIDATOR ] ENO: Primary data validation passed. [2025-09-29T18:34:06.535288] [INFO ] [MAIN ] ENO: Fetched primary data is valid. [2025-09-29T18:34:06.535370] [DEBUG] [LOCAL ] ENO: Saving primary data. [2025-09-29T18:34:06.536002] [DEBUG] [LOCAL ] ENO: Trimmed 3113 records to 1914 (keeping 200 days of data) [2025-09-29T18:34:06.550695] [DEBUG] [LOCAL ] ENO: Primary data saved (1914 records). [2025-09-29T18:34:06.550881] [INFO ] [MAIN ] ENO: Full history saved. [2025-09-29T18:34:06.550995] [INFO ] [MAIN ] Update Progress: 741/2371 symbols completed. ENO took 23.4s. Estimated remaining: 3h 26m 54s. Rate: 7.9 symbols/min [2025-09-29T18:34:06.735518] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:34:06.748130] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-09-29T18:34:06.772419] [DEBUG] [LOCAL ] ENVA: Loaded 25914 existing records from primary storage. [2025-09-29T18:34:06.772781] [INFO ] [MAIN ] ENVA: Loaded 25914 existing records. [2025-09-29T18:34:06.972518] [WARN ] [MAIN ] ENVA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:34:06.972803] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-09-29T18:34:06.972893] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-09-29T18:34:06.973274] [DEBUG] [LOCAL ] ENVA: Deleted primary data file. [2025-09-29T18:34:06.973334] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-09-29T18:34:07.365926] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:34:07.548168] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-09-29T18:34:07.696723] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-29T18:34:08.348118] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-09-29T18:34:08.537171] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-29T18:34:08.649338] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-29T18:34:09.148091] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2024-12. [2025-09-29T18:34:09.850075] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-29T18:34:09.948117] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-09-29T18:34:10.505028] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-29T18:34:10.748119] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-01. [2025-09-29T18:34:11.183762] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-29T18:34:11.548104] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-09-29T18:34:11.847121] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-29T18:34:12.348108] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-09-29T18:34:12.858301] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-29T18:34:13.148118] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-09-29T18:34:13.915183] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-29T18:34:13.948099] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-09-29T18:34:14.585245] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-29T18:34:14.748112] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-09-29T18:34:15.548148] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-09-29T18:34:15.704859] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-29T18:34:16.348094] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-09-29T18:34:16.436424] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-29T18:34:16.866580] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-29T18:34:17.148112] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-09-29T18:34:17.948084] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-09-29T18:34:18.174503] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-29T18:34:18.480959] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-29T18:34:18.748128] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-09-29T18:34:19.548142] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-09-29T18:34:19.741718] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-29T18:34:20.349694] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-29T18:34:20.348210] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-09-29T18:34:21.031456] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-29T18:34:21.148211] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-09-29T18:34:21.703479] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-29T18:34:21.948124] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-09-29T18:34:22.149201] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-29T18:34:22.748859] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-09-29T18:34:22.748782] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-29T18:34:23.548130] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-09-29T18:34:23.952204] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-29T18:34:24.348112] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-09-29T18:34:25.148125] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-09-29T18:34:25.440663] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-29T18:34:25.451133] [INFO ] [REMOTE ] ENOV: Full fetch complete (63152 records). [2025-09-29T18:34:25.451329] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-09-29T18:34:25.872705] [DEBUG] [VALIDATOR ] ENOV: All expected trading days are present. [2025-09-29T18:34:25.872886] [DEBUG] [VALIDATOR ] ENOV: Primary data validation passed. [2025-09-29T18:34:25.873798] [INFO ] [MAIN ] ENOV: Fetched primary data is valid. [2025-09-29T18:34:25.873885] [DEBUG] [LOCAL ] ENOV: Saving primary data. [2025-09-29T18:34:25.892889] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-29T18:34:25.899733] [DEBUG] [LOCAL ] ENOV: Trimmed 63152 records to 45017 (keeping 200 days of data) [2025-09-29T18:34:25.900992] [INFO ] [REMOTE ] ENS: Full fetch complete (41837 records). [2025-09-29T18:34:25.901457] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-09-29T18:34:25.902248] [FATAL] [VALIDATOR ] ENS: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:34:25.902339] [FATAL] [MAIN ] ENS: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:34:25.902385] [WARN ] [MAIN ] ENS: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:34:25.902424] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-09-29T18:34:25.902484] [DEBUG] [LOCAL ] ENS: No primary data file found to delete. [2025-09-29T18:34:25.902538] [INFO ] [LOCAL ] ENS: Starting deletion of derivative data. [2025-09-29T18:34:25.903059] [DEBUG] [LOCAL ] ENS: Deleted derivative data file. [2025-09-29T18:34:25.903185] [INFO ] [MAIN ] Update Progress: 742/2371 symbols completed. ENS took 30.5s. Estimated remaining: 3h 27m 13s. Rate: 7.9 symbols/min [2025-09-29T18:34:25.957801] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-09-29T18:34:26.206287] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:34:26.333913] [DEBUG] [LOCAL ] EOD: Loaded 14232 existing records from primary storage. [2025-09-29T18:34:26.351317] [INFO ] [MAIN ] EOD: Loaded 14232 existing records. [2025-09-29T18:34:26.466721] [DEBUG] [LOCAL ] ENOV: Primary data saved (45017 records). [2025-09-29T18:34:26.472153] [INFO ] [MAIN ] ENOV: Full history saved. [2025-09-29T18:34:26.472321] [INFO ] [MAIN ] Update Progress: 743/2371 symbols completed. ENOV took 34.4s. Estimated remaining: 3h 26m 49s. Rate: 7.9 symbols/min [2025-09-29T18:34:26.703000] [WARN ] [MAIN ] EOD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:34:26.723818] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-09-29T18:34:26.729147] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-09-29T18:34:26.734468] [DEBUG] [LOCAL ] EOD: Deleted primary data file. [2025-09-29T18:34:26.734667] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-09-29T18:34:26.816850] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:34:26.912950] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-29T18:34:26.960075] [INFO ] [REMOTE ] ENR: Full fetch complete (58157 records). [2025-09-29T18:34:26.981763] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-09-29T18:34:27.059762] [FATAL] [VALIDATOR ] ENR: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:34:27.066114] [FATAL] [MAIN ] ENR: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:34:27.107721] [WARN ] [MAIN ] ENR: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:34:27.164193] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-09-29T18:34:27.164495] [DEBUG] [LOCAL ] ENR: No primary data file found to delete. [2025-09-29T18:34:27.164580] [INFO ] [LOCAL ] ENR: Starting deletion of derivative data. [2025-09-29T18:34:27.175511] [DEBUG] [LOCAL ] ENR: Deleted derivative data file. [2025-09-29T18:34:27.212273] [INFO ] [MAIN ] Update Progress: 744/2371 symbols completed. ENR took 33.3s. Estimated remaining: 3h 26m 27s. Rate: 7.9 symbols/min [2025-09-29T18:34:27.294774] [INFO ] [REMOTE ] EOD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:34:27.317267] [DEBUG] [LOCAL ] EOG: Loaded 54121 existing records from primary storage. [2025-09-29T18:34:27.328354] [INFO ] [REMOTE ] EOD: Fetching primary data for 2024-12. [2025-09-29T18:34:27.328515] [INFO ] [MAIN ] EOG: Loaded 54121 existing records. [2025-09-29T18:34:27.511706] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-29T18:34:27.609015] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-09-29T18:34:27.608305] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:34:27.695682] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:34:27.695974] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-09-29T18:34:27.696024] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-09-29T18:34:27.696520] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-09-29T18:34:27.696586] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-09-29T18:34:27.813707] [DEBUG] [LOCAL ] EOI: Loaded 10783 existing records from primary storage. [2025-09-29T18:34:27.814549] [INFO ] [MAIN ] EOI: Loaded 10783 existing records. [2025-09-29T18:34:28.162362] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:34:28.182282] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-09-29T18:34:28.202422] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-29T18:34:28.192049] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-09-29T18:34:28.221080] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-09-29T18:34:28.221185] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-09-29T18:34:28.353185] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-09-29T18:34:28.490954] [INFO ] [REMOTE ] EOG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:34:28.712796] [INFO ] [REMOTE ] EOI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:34:28.927536] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-29T18:34:29.148116] [INFO ] [REMOTE ] EOG: Fetching primary data for 2024-12. [2025-09-29T18:34:29.659013] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-29T18:34:29.948125] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-09-29T18:34:30.748149] [INFO ] [REMOTE ] EOI: Fetching primary data for 2024-12. [2025-09-29T18:34:31.332984] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-29T18:34:31.381793] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-29T18:34:31.548167] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-01. [2025-09-29T18:34:31.992931] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-29T18:34:32.348123] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-09-29T18:34:33.148118] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-09-29T18:34:33.431026] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-29T18:34:33.480326] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-29T18:34:33.486130] [INFO ] [REMOTE ] ENVA: Full fetch complete (36447 records). [2025-09-29T18:34:33.486309] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-09-29T18:34:33.486983] [FATAL] [VALIDATOR ] ENVA: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:34:33.487074] [FATAL] [MAIN ] ENVA: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:34:33.487148] [WARN ] [MAIN ] ENVA: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:34:33.487203] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-09-29T18:34:33.487265] [DEBUG] [LOCAL ] ENVA: No primary data file found to delete. [2025-09-29T18:34:33.487302] [INFO ] [LOCAL ] ENVA: Starting deletion of derivative data. [2025-09-29T18:34:33.487636] [DEBUG] [LOCAL ] ENVA: Deleted derivative data file. [2025-09-29T18:34:33.487780] [INFO ] [MAIN ] Update Progress: 745/2371 symbols completed. ENVA took 26.9s. Estimated remaining: 3h 26m 16s. Rate: 7.9 symbols/min [2025-09-29T18:34:33.691065] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:34:33.715287] [DEBUG] [LOCAL ] EOS: Loaded 15589 existing records from primary storage. [2025-09-29T18:34:33.715634] [INFO ] [MAIN ] EOS: Loaded 15589 existing records. [2025-09-29T18:34:33.939611] [WARN ] [MAIN ] EOS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:34:33.939952] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-09-29T18:34:33.940003] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-09-29T18:34:33.940329] [DEBUG] [LOCAL ] EOS: Deleted primary data file. [2025-09-29T18:34:33.940390] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-09-29T18:34:33.953591] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-01. [2025-09-29T18:34:34.090627] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-29T18:34:34.357637] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:34:34.748129] [INFO ] [REMOTE ] EOS: Fetching primary data for 2024-12. [2025-09-29T18:34:34.775927] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-29T18:34:35.548135] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-09-29T18:34:36.115884] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-29T18:34:36.348083] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-09-29T18:34:36.440182] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-29T18:34:37.148134] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-09-29T18:34:37.179626] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-29T18:34:37.948141] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-09-29T18:34:38.748167] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-09-29T18:34:38.808031] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-29T18:34:38.937808] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-29T18:34:39.548083] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-09-29T18:34:39.624928] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-29T18:34:40.348115] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-09-29T18:34:41.148144] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-09-29T18:34:41.344398] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-29T18:34:41.497119] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-29T18:34:41.950777] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-09-29T18:34:41.952776] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-29T18:34:42.703307] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-29T18:34:42.748157] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-09-29T18:34:43.548212] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-09-29T18:34:44.348182] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-09-29T18:34:44.768675] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-29T18:34:44.837178] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-29T18:34:45.148089] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-09-29T18:34:45.307048] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-29T18:34:45.948152] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-09-29T18:34:46.748125] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-09-29T18:34:47.097090] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-29T18:34:47.335739] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-29T18:34:47.552007] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-09-29T18:34:47.553231] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-29T18:34:48.348119] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-09-29T18:34:48.463729] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-29T18:34:49.148124] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-09-29T18:34:49.948115] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-09-29T18:34:49.981906] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-29T18:34:50.342221] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-29T18:34:50.748143] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-09-29T18:34:50.785736] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-29T18:34:51.548110] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-09-29T18:34:52.348097] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-09-29T18:34:52.499426] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-29T18:34:52.812418] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-29T18:34:53.148137] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-09-29T18:34:53.190869] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-29T18:34:53.948147] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-09-29T18:34:53.974333] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-29T18:34:54.748144] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-09-29T18:34:54.781174] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-29T18:34:55.548123] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-09-29T18:34:56.344903] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-29T18:34:56.348047] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-09-29T18:34:56.515900] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-29T18:34:57.148180] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-09-29T18:34:57.423216] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-29T18:34:57.427153] [INFO ] [REMOTE ] EOI: Full fetch complete (16110 records). [2025-09-29T18:34:57.427277] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-09-29T18:34:57.822665] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-09-29T18:34:57.822756] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-09-29T18:34:57.823172] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-09-29T18:34:57.823213] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-09-29T18:34:57.823780] [DEBUG] [LOCAL ] EOI: Trimmed 16110 records to 10661 (keeping 200 days of data) [2025-09-29T18:34:57.895639] [DEBUG] [LOCAL ] EOI: Primary data saved (10661 records). [2025-09-29T18:34:57.895818] [INFO ] [MAIN ] EOI: Full history saved. [2025-09-29T18:34:57.895906] [INFO ] [MAIN ] Update Progress: 746/2371 symbols completed. EOI took 30.6s. Estimated remaining: 3h 26m 45s. Rate: 7.9 symbols/min [2025-09-29T18:34:57.953272] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-09-29T18:34:58.086237] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:34:58.095392] [DEBUG] [LOCAL ] EOT: Loaded 6916 existing records from primary storage. [2025-09-29T18:34:58.095576] [INFO ] [MAIN ] EOT: Loaded 6916 existing records. [2025-09-29T18:34:58.218539] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-29T18:34:58.317248] [WARN ] [MAIN ] EOT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:34:58.317506] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-09-29T18:34:58.317563] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-09-29T18:34:58.317823] [DEBUG] [LOCAL ] EOT: Deleted primary data file. [2025-09-29T18:34:58.317882] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-09-29T18:34:58.696261] [INFO ] [REMOTE ] EOT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:34:58.748116] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-09-29T18:34:59.102242] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-29T18:34:59.548124] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-09-29T18:35:00.348117] [INFO ] [REMOTE ] EOT: Fetching primary data for 2024-12. [2025-09-29T18:35:00.586234] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-29T18:35:00.591883] [INFO ] [REMOTE ] EOD: Full fetch complete (20079 records). [2025-09-29T18:35:00.592140] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-09-29T18:35:00.972996] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-29T18:35:01.022903] [INFO ] [REMOTE ] EOG: Full fetch complete (77274 records). [2025-09-29T18:35:01.065679] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-09-29T18:35:01.066110] [DEBUG] [VALIDATOR ] EOD: All expected trading days are present. [2025-09-29T18:35:01.066446] [DEBUG] [VALIDATOR ] EOD: Primary data validation passed. [2025-09-29T18:35:01.067139] [INFO ] [MAIN ] EOD: Fetched primary data is valid. [2025-09-29T18:35:01.072859] [DEBUG] [LOCAL ] EOD: Saving primary data. [2025-09-29T18:35:01.150543] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-09-29T18:35:01.156000] [DEBUG] [LOCAL ] EOD: Trimmed 20079 records to 14134 (keeping 200 days of data) [2025-09-29T18:35:01.617777] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-09-29T18:35:01.617957] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-09-29T18:35:01.619376] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-09-29T18:35:01.624082] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-09-29T18:35:01.625538] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-29T18:35:01.632416] [DEBUG] [LOCAL ] EOG: Trimmed 77274 records to 53342 (keeping 200 days of data) [2025-09-29T18:35:01.744581] [DEBUG] [LOCAL ] EOD: Primary data saved (14134 records). [2025-09-29T18:35:01.746574] [INFO ] [MAIN ] EOD: Full history saved. [2025-09-29T18:35:01.747030] [INFO ] [MAIN ] Update Progress: 747/2371 symbols completed. EOD took 35.8s. Estimated remaining: 3h 26m 29s. Rate: 7.9 symbols/min [2025-09-29T18:35:01.948864] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-01. [2025-09-29T18:35:02.045148] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:35:02.100842] [DEBUG] [LOCAL ] EPAC: Loaded 27416 existing records from primary storage. [2025-09-29T18:35:02.173807] [INFO ] [MAIN ] EPAC: Loaded 27416 existing records. [2025-09-29T18:35:02.443144] [WARN ] [MAIN ] EPAC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:35:02.447509] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-09-29T18:35:02.450141] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-09-29T18:35:02.451685] [DEBUG] [LOCAL ] EPAC: Deleted primary data file. [2025-09-29T18:35:02.452229] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-09-29T18:35:02.873940] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-29T18:35:02.878132] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-29T18:35:02.883058] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-09-29T18:35:02.906127] [INFO ] [REMOTE ] EOS: Full fetch complete (23177 records). [2025-09-29T18:35:02.921076] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-09-29T18:35:02.968504] [DEBUG] [LOCAL ] EOG: Primary data saved (53342 records). [2025-09-29T18:35:03.011674] [INFO ] [MAIN ] EOG: Full history saved. [2025-09-29T18:35:03.019189] [INFO ] [MAIN ] Update Progress: 748/2371 symbols completed. EOG took 36.5s. Estimated remaining: 3h 26m 8s. Rate: 7.9 symbols/min [2025-09-29T18:35:03.078577] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:35:03.373098] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:35:03.558201] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2024-12. [2025-09-29T18:35:03.623010] [DEBUG] [VALIDATOR ] EOS: All expected trading days are present. [2025-09-29T18:35:03.623120] [DEBUG] [VALIDATOR ] EOS: Primary data validation passed. [2025-09-29T18:35:03.623722] [INFO ] [MAIN ] EOS: Fetched primary data is valid. [2025-09-29T18:35:03.623944] [DEBUG] [LOCAL ] EOS: Saving primary data. [2025-09-29T18:35:03.624773] [DEBUG] [LOCAL ] EOS: Trimmed 23177 records to 15244 (keeping 200 days of data) [2025-09-29T18:35:03.712442] [DEBUG] [LOCAL ] EPAM: Loaded 40450 existing records from primary storage. [2025-09-29T18:35:03.724509] [INFO ] [MAIN ] EPAM: Loaded 40450 existing records. [2025-09-29T18:35:03.730559] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-29T18:35:03.917972] [DEBUG] [LOCAL ] EOS: Primary data saved (15244 records). [2025-09-29T18:35:03.924768] [INFO ] [MAIN ] EOS: Full history saved. [2025-09-29T18:35:03.935962] [INFO ] [MAIN ] Update Progress: 749/2371 symbols completed. EOS took 30.4s. Estimated remaining: 3h 25m 46s. Rate: 7.9 symbols/min [2025-09-29T18:35:04.021131] [WARN ] [MAIN ] EPAM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:35:04.061073] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-09-29T18:35:04.072692] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-09-29T18:35:04.084158] [DEBUG] [LOCAL ] EPAM: Deleted primary data file. [2025-09-29T18:35:04.084270] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-09-29T18:35:04.239805] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:35:04.356112] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-09-29T18:35:04.576848] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:35:04.578492] [DEBUG] [LOCAL ] EPC: Loaded 40383 existing records from primary storage. [2025-09-29T18:35:04.578738] [INFO ] [MAIN ] EPC: Loaded 40383 existing records. [2025-09-29T18:35:04.770185] [WARN ] [MAIN ] EPC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:35:04.770395] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-09-29T18:35:04.770447] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-09-29T18:35:04.770884] [DEBUG] [LOCAL ] EPC: Deleted primary data file. [2025-09-29T18:35:04.770948] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-09-29T18:35:05.157163] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2024-12. [2025-09-29T18:35:05.181180] [INFO ] [REMOTE ] EPC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:35:05.189239] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-29T18:35:05.252897] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-29T18:35:05.948120] [INFO ] [REMOTE ] EPC: Fetching primary data for 2024-12. [2025-09-29T18:35:06.748149] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-09-29T18:35:06.942633] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-29T18:35:07.537995] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-29T18:35:07.548057] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-09-29T18:35:07.747755] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-29T18:35:07.989347] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-29T18:35:08.348144] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-09-29T18:35:08.942259] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-29T18:35:09.148112] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-01. [2025-09-29T18:35:09.948118] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-09-29T18:35:10.561554] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-29T18:35:10.748146] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-09-29T18:35:11.413738] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-29T18:35:11.493472] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-29T18:35:11.548127] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-09-29T18:35:12.348146] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-09-29T18:35:13.148717] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-09-29T18:35:13.149064] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-29T18:35:13.204748] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-29T18:35:13.948113] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-09-29T18:35:14.420570] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-29T18:35:14.748125] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-09-29T18:35:15.349862] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-29T18:35:15.548128] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-09-29T18:35:16.051404] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-29T18:35:16.348124] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-09-29T18:35:16.913811] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-29T18:35:16.915977] [INFO ] [REMOTE ] EOT: Full fetch complete (10747 records). [2025-09-29T18:35:16.916064] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-09-29T18:35:17.153419] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-09-29T18:35:17.332362] [DEBUG] [VALIDATOR ] EOT: All expected trading days are present. [2025-09-29T18:35:17.341338] [DEBUG] [VALIDATOR ] EOT: Primary data validation passed. [2025-09-29T18:35:17.348301] [INFO ] [MAIN ] EOT: Fetched primary data is valid. [2025-09-29T18:35:17.357399] [DEBUG] [LOCAL ] EOT: Saving primary data. [2025-09-29T18:35:17.359156] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-29T18:35:17.368697] [DEBUG] [LOCAL ] EOT: Trimmed 10747 records to 6885 (keeping 200 days of data) [2025-09-29T18:35:17.413191] [DEBUG] [LOCAL ] EOT: Primary data saved (6885 records). [2025-09-29T18:35:17.413342] [INFO ] [MAIN ] EOT: Full history saved. [2025-09-29T18:35:17.413441] [INFO ] [MAIN ] Update Progress: 750/2371 symbols completed. EOT took 19.5s. Estimated remaining: 3h 25m 51s. Rate: 7.9 symbols/min [2025-09-29T18:35:17.593542] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:35:17.658265] [DEBUG] [LOCAL ] EPD: Loaded 54389 existing records from primary storage. [2025-09-29T18:35:17.658629] [INFO ] [MAIN ] EPD: Loaded 54389 existing records. [2025-09-29T18:35:17.850184] [WARN ] [MAIN ] EPD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:35:17.850441] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-09-29T18:35:17.850493] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-09-29T18:35:17.851497] [DEBUG] [LOCAL ] EPD: Deleted primary data file. [2025-09-29T18:35:17.851561] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-09-29T18:35:17.953258] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-09-29T18:35:18.260298] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:35:18.748104] [INFO ] [REMOTE ] EPD: Fetching primary data for 2024-12. [2025-09-29T18:35:18.922205] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-29T18:35:19.548145] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-01. [2025-09-29T18:35:19.637070] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-29T18:35:20.348168] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-09-29T18:35:20.484217] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-29T18:35:21.094365] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-09-29T18:35:21.148126] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-09-29T18:35:21.870122] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-29T18:35:21.948121] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-09-29T18:35:22.342700] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-29T18:35:22.748136] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-09-29T18:35:23.389279] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-29T18:35:23.548151] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-09-29T18:35:24.348153] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-09-29T18:35:24.534558] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-29T18:35:25.148134] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-09-29T18:35:25.207861] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-29T18:35:25.697793] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-29T18:35:25.948154] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-09-29T18:35:26.613080] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-29T18:35:26.748117] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-09-29T18:35:27.358488] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-29T18:35:27.548181] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-09-29T18:35:28.202391] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-29T18:35:28.348142] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-09-29T18:35:28.619750] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-29T18:35:29.148142] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-09-29T18:35:29.948082] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-09-29T18:35:30.205086] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-29T18:35:30.214547] [INFO ] [REMOTE ] EPAM: Full fetch complete (56213 records). [2025-09-29T18:35:30.214740] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-09-29T18:35:30.680281] [DEBUG] [VALIDATOR ] EPAM: All expected trading days are present. [2025-09-29T18:35:30.680545] [DEBUG] [VALIDATOR ] EPAM: Primary data validation passed. [2025-09-29T18:35:30.681479] [INFO ] [MAIN ] EPAM: Fetched primary data is valid. [2025-09-29T18:35:30.681566] [DEBUG] [LOCAL ] EPAM: Saving primary data. [2025-09-29T18:35:30.707708] [DEBUG] [LOCAL ] EPAM: Trimmed 56213 records to 39831 (keeping 200 days of data) [2025-09-29T18:35:30.710117] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-29T18:35:30.769686] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-09-29T18:35:30.983491] [DEBUG] [LOCAL ] EPAM: Primary data saved (39831 records). [2025-09-29T18:35:30.983938] [INFO ] [MAIN ] EPAM: Full history saved. [2025-09-29T18:35:30.984258] [INFO ] [MAIN ] Update Progress: 751/2371 symbols completed. EPAM took 27.9s. Estimated remaining: 3h 25m 56s. Rate: 7.9 symbols/min [2025-09-29T18:35:31.191860] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:35:31.248932] [DEBUG] [LOCAL ] EPR: Loaded 44722 existing records from primary storage. [2025-09-29T18:35:31.249324] [INFO ] [MAIN ] EPR: Loaded 44722 existing records. [2025-09-29T18:35:31.446704] [WARN ] [MAIN ] EPR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:35:31.447015] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-09-29T18:35:31.447127] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-09-29T18:35:31.448084] [DEBUG] [LOCAL ] EPR: Deleted primary data file. [2025-09-29T18:35:31.448148] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-09-29T18:35:31.553301] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-09-29T18:35:31.876116] [INFO ] [REMOTE ] EPR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:35:31.912465] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-29T18:35:32.162166] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-29T18:35:32.348158] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-09-29T18:35:32.756093] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-29T18:35:33.148121] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-09-29T18:35:33.776426] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-29T18:35:33.948136] [INFO ] [REMOTE ] EPR: Fetching primary data for 2024-12. [2025-09-29T18:35:34.748127] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-09-29T18:35:34.783054] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-29T18:35:34.793673] [INFO ] [REMOTE ] EPC: Full fetch complete (56733 records). [2025-09-29T18:35:34.793878] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-09-29T18:35:35.217234] [DEBUG] [VALIDATOR ] EPC: All expected trading days are present. [2025-09-29T18:35:35.217355] [DEBUG] [VALIDATOR ] EPC: Primary data validation passed. [2025-09-29T18:35:35.218313] [INFO ] [MAIN ] EPC: Fetched primary data is valid. [2025-09-29T18:35:35.218381] [DEBUG] [LOCAL ] EPC: Saving primary data. [2025-09-29T18:35:35.219726] [DEBUG] [LOCAL ] EPC: Trimmed 56733 records to 39719 (keeping 200 days of data) [2025-09-29T18:35:35.509349] [DEBUG] [LOCAL ] EPC: Primary data saved (39719 records). [2025-09-29T18:35:35.509537] [INFO ] [MAIN ] EPC: Full history saved. [2025-09-29T18:35:35.509672] [INFO ] [MAIN ] Update Progress: 752/2371 symbols completed. EPC took 31.6s. Estimated remaining: 3h 25m 42s. Rate: 7.9 symbols/min [2025-09-29T18:35:35.557878] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-09-29T18:35:35.776288] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-29T18:35:35.864553] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:35:35.941726] [DEBUG] [LOCAL ] EPRT: Loaded 49306 existing records from primary storage. [2025-09-29T18:35:35.942303] [INFO ] [MAIN ] EPRT: Loaded 49306 existing records. [2025-09-29T18:35:36.244330] [WARN ] [MAIN ] EPRT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:35:36.244673] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-09-29T18:35:36.244759] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-09-29T18:35:36.246062] [DEBUG] [LOCAL ] EPRT: Deleted primary data file. [2025-09-29T18:35:36.246151] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-09-29T18:35:36.353461] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-01. [2025-09-29T18:35:36.782346] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:35:36.839855] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-29T18:35:36.840878] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-29T18:35:37.148105] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-09-29T18:35:37.588442] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-29T18:35:37.948136] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-09-29T18:35:38.748147] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-09-29T18:35:39.343045] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-29T18:35:39.413967] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-29T18:35:39.420123] [INFO ] [REMOTE ] EPAC: Full fetch complete (38905 records). [2025-09-29T18:35:39.420290] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-09-29T18:35:39.421907] [FATAL] [VALIDATOR ] EPAC: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:35:39.422032] [FATAL] [MAIN ] EPAC: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:35:39.422119] [WARN ] [MAIN ] EPAC: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:35:39.422167] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-09-29T18:35:39.422246] [DEBUG] [LOCAL ] EPAC: No primary data file found to delete. [2025-09-29T18:35:39.422304] [INFO ] [LOCAL ] EPAC: Starting deletion of derivative data. [2025-09-29T18:35:39.422711] [DEBUG] [LOCAL ] EPAC: Deleted derivative data file. [2025-09-29T18:35:39.422836] [INFO ] [MAIN ] Update Progress: 753/2371 symbols completed. EPAC took 37.7s. Estimated remaining: 3h 25m 26s. Rate: 7.9 symbols/min [2025-09-29T18:35:39.553236] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-09-29T18:35:39.610918] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:35:39.624083] [DEBUG] [LOCAL ] EQBK: Loaded 11050 existing records from primary storage. [2025-09-29T18:35:39.624398] [INFO ] [MAIN ] EQBK: Loaded 11050 existing records. [2025-09-29T18:35:39.813055] [WARN ] [MAIN ] EQBK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:35:39.813265] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-09-29T18:35:39.813313] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-09-29T18:35:39.813538] [DEBUG] [LOCAL ] EQBK: Deleted primary data file. [2025-09-29T18:35:39.813599] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-09-29T18:35:40.197173] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:35:40.318633] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-29T18:35:40.348122] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2024-12. [2025-09-29T18:35:41.148172] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-09-29T18:35:41.603210] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-29T18:35:41.952535] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2024-12. [2025-09-29T18:35:41.964801] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-29T18:35:42.444197] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-29T18:35:42.748167] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-09-29T18:35:42.876524] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-29T18:35:43.548114] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-09-29T18:35:44.348126] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-01. [2025-09-29T18:35:44.742948] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-29T18:35:45.112561] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-29T18:35:45.148123] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-01. [2025-09-29T18:35:45.882312] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-29T18:35:45.952419] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-09-29T18:35:45.956096] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-29T18:35:46.748132] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-09-29T18:35:47.548135] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-09-29T18:35:48.040200] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-29T18:35:48.060480] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-29T18:35:48.332259] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-29T18:35:48.348081] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-09-29T18:35:49.148177] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-09-29T18:35:49.899290] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-29T18:35:49.948113] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-09-29T18:35:50.005123] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-29T18:35:50.748157] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-09-29T18:35:51.548190] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-09-29T18:35:51.969076] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-29T18:35:52.016299] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-29T18:35:52.348123] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-09-29T18:35:53.148094] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-09-29T18:35:53.486250] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-29T18:35:53.948174] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-09-29T18:35:54.477295] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-29T18:35:54.489568] [INFO ] [REMOTE ] EPD: Full fetch complete (77641 records). [2025-09-29T18:35:54.489772] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-09-29T18:35:54.753947] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-09-29T18:35:54.945256] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-09-29T18:35:54.945775] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-09-29T18:35:54.948155] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-09-29T18:35:54.946996] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-29T18:35:54.956936] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-09-29T18:35:54.959354] [DEBUG] [LOCAL ] EPD: Trimmed 77641 records to 53610 (keeping 200 days of data) [2025-09-29T18:35:55.319782] [DEBUG] [LOCAL ] EPD: Primary data saved (53610 records). [2025-09-29T18:35:55.319921] [INFO ] [MAIN ] EPD: Full history saved. [2025-09-29T18:35:55.320036] [INFO ] [MAIN ] Update Progress: 754/2371 symbols completed. EPD took 37.9s. Estimated remaining: 3h 25m 36s. Rate: 7.9 symbols/min [2025-09-29T18:35:55.504213] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:35:55.534281] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-29T18:35:55.548060] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-09-29T18:35:55.600876] [DEBUG] [LOCAL ] EQH: Loaded 53435 existing records from primary storage. [2025-09-29T18:35:55.601304] [INFO ] [MAIN ] EQH: Loaded 53435 existing records. [2025-09-29T18:35:55.792935] [WARN ] [MAIN ] EQH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:35:55.793356] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-09-29T18:35:55.793418] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-09-29T18:35:55.793999] [DEBUG] [LOCAL ] EQH: Deleted primary data file. [2025-09-29T18:35:55.794067] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-09-29T18:35:55.948357] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-29T18:35:56.214711] [INFO ] [REMOTE ] EQH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:35:56.348113] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-09-29T18:35:57.158036] [INFO ] [REMOTE ] EQH: Fetching primary data for 2024-12. [2025-09-29T18:35:57.164323] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-29T18:35:57.948093] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-09-29T18:35:58.068913] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-29T18:35:58.748135] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-09-29T18:35:59.259080] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-29T18:35:59.456792] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-29T18:35:59.548087] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-01. [2025-09-29T18:35:59.715442] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-29T18:36:00.348131] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-09-29T18:36:01.148085] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-09-29T18:36:01.270832] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-29T18:36:01.288852] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-29T18:36:01.948123] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-09-29T18:36:02.748172] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-09-29T18:36:02.822219] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-29T18:36:02.866151] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-29T18:36:03.548133] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-09-29T18:36:04.275774] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-29T18:36:04.348085] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-09-29T18:36:04.484784] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-29T18:36:05.148124] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-09-29T18:36:05.948171] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-09-29T18:36:06.168286] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-29T18:36:06.171482] [INFO ] [REMOTE ] EQBK: Full fetch complete (15429 records). [2025-09-29T18:36:06.171563] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-09-29T18:36:06.604603] [DEBUG] [VALIDATOR ] EQBK: All expected trading days are present. [2025-09-29T18:36:06.604969] [DEBUG] [VALIDATOR ] EQBK: Primary data validation passed. [2025-09-29T18:36:06.606017] [INFO ] [MAIN ] EQBK: Fetched primary data is valid. [2025-09-29T18:36:06.607408] [DEBUG] [LOCAL ] EQBK: Saving primary data. [2025-09-29T18:36:06.607296] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-29T18:36:06.618103] [DEBUG] [LOCAL ] EQBK: Trimmed 15429 records to 10915 (keeping 200 days of data) [2025-09-29T18:36:06.618265] [INFO ] [REMOTE ] EPR: Full fetch complete (62876 records). [2025-09-29T18:36:06.618798] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-09-29T18:36:06.770448] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-09-29T18:36:07.139934] [DEBUG] [VALIDATOR ] EPR: All expected trading days are present. [2025-09-29T18:36:07.140333] [DEBUG] [VALIDATOR ] EPR: Primary data validation passed. [2025-09-29T18:36:07.142217] [INFO ] [MAIN ] EPR: Fetched primary data is valid. [2025-09-29T18:36:07.142311] [DEBUG] [LOCAL ] EPR: Saving primary data. [2025-09-29T18:36:07.144792] [DEBUG] [LOCAL ] EQBK: Primary data saved (10915 records). [2025-09-29T18:36:07.144969] [INFO ] [MAIN ] EQBK: Full history saved. [2025-09-29T18:36:07.145102] [INFO ] [MAIN ] Update Progress: 755/2371 symbols completed. EQBK took 27.7s. Estimated remaining: 3h 25m 38s. Rate: 7.9 symbols/min [2025-09-29T18:36:07.242274] [DEBUG] [LOCAL ] EPR: Trimmed 62876 records to 43933 (keeping 200 days of data) [2025-09-29T18:36:07.395809] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:36:07.606733] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-29T18:36:07.621450] [INFO ] [REMOTE ] EPRT: Full fetch complete (68700 records). [2025-09-29T18:36:07.636497] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-09-29T18:36:07.675126] [DEBUG] [LOCAL ] EQNR: Loaded 53809 existing records from primary storage. [2025-09-29T18:36:07.690574] [INFO ] [MAIN ] EQNR: Loaded 53809 existing records. [2025-09-29T18:36:08.106437] [WARN ] [MAIN ] EQNR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:36:08.121500] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-09-29T18:36:08.127296] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-09-29T18:36:08.153922] [DEBUG] [LOCAL ] EQNR: Deleted primary data file. [2025-09-29T18:36:08.161267] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-09-29T18:36:08.502410] [DEBUG] [VALIDATOR ] EPRT: All expected trading days are present. [2025-09-29T18:36:08.514039] [DEBUG] [VALIDATOR ] EPRT: Primary data validation passed. [2025-09-29T18:36:08.529086] [INFO ] [MAIN ] EPRT: Fetched primary data is valid. [2025-09-29T18:36:08.555939] [DEBUG] [LOCAL ] EPRT: Saving primary data. [2025-09-29T18:36:08.583168] [DEBUG] [LOCAL ] EPR: Primary data saved (43933 records). [2025-09-29T18:36:08.607112] [INFO ] [MAIN ] EPR: Full history saved. [2025-09-29T18:36:08.633282] [INFO ] [MAIN ] Update Progress: 756/2371 symbols completed. EPR took 37.6s. Estimated remaining: 3h 25m 17s. Rate: 7.9 symbols/min [2025-09-29T18:36:08.682339] [DEBUG] [LOCAL ] EPRT: Trimmed 68700 records to 48483 (keeping 200 days of data) [2025-09-29T18:36:09.031961] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:36:09.040528] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2024-12. [2025-09-29T18:36:09.123691] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:36:09.170936] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (2.40 seconds). [2025-09-29T18:36:09.196088] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-09-29T18:36:09.345371] [DEBUG] [LOCAL ] EQR: Loaded 52190 existing records from primary storage. [2025-09-29T18:36:09.349750] [INFO ] [MAIN ] EQR: Loaded 52190 existing records. [2025-09-29T18:36:09.601250] [WARN ] [MAIN ] EQR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:36:09.605765] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-09-29T18:36:09.606390] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-09-29T18:36:09.606899] [DEBUG] [LOCAL ] EQR: Deleted primary data file. [2025-09-29T18:36:09.608344] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-09-29T18:36:09.608297] [DEBUG] [LOCAL ] EPRT: Primary data saved (48483 records). [2025-09-29T18:36:09.653428] [INFO ] [MAIN ] EPRT: Full history saved. [2025-09-29T18:36:09.681959] [INFO ] [MAIN ] Update Progress: 757/2371 symbols completed. EPRT took 34.2s. Estimated remaining: 3h 24m 55s. Rate: 7.9 symbols/min [2025-09-29T18:36:09.981182] [INFO ] [REMOTE ] EQR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:36:09.981585] [INFO ] [REMOTE ] EQR: Fetching primary data for 2024-12. [2025-09-29T18:36:11.104275] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-29T18:36:11.115914] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-01. [2025-09-29T18:36:11.150827] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-29T18:36:11.162968] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-09-29T18:36:11.642083] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-29T18:36:11.652973] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-09-29T18:36:12.804414] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-29T18:36:12.816880] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-09-29T18:36:12.983758] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-29T18:36:13.108797] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-29T18:36:13.148075] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-09-29T18:36:13.948130] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-09-29T18:36:14.730194] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-29T18:36:14.748067] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-09-29T18:36:14.779047] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-29T18:36:15.548118] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-09-29T18:36:16.005713] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-29T18:36:16.359330] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-09-29T18:36:16.362423] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-29T18:36:17.148132] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-09-29T18:36:17.318351] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-29T18:36:17.948172] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-09-29T18:36:18.257920] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-29T18:36:18.748097] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-09-29T18:36:18.856283] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-29T18:36:19.379756] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-29T18:36:19.548155] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-09-29T18:36:20.208145] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-29T18:36:20.348163] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-09-29T18:36:21.148146] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-09-29T18:36:21.435309] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-29T18:36:21.948138] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-09-29T18:36:22.241526] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-29T18:36:22.748109] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-09-29T18:36:23.020078] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-29T18:36:23.520983] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-29T18:36:23.533920] [INFO ] [REMOTE ] EQH: Full fetch complete (75970 records). [2025-09-29T18:36:23.534094] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-09-29T18:36:23.534993] [FATAL] [VALIDATOR ] EQH: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:36:23.535090] [FATAL] [MAIN ] EQH: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:36:23.535134] [WARN ] [MAIN ] EQH: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:36:23.535175] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-09-29T18:36:23.535233] [DEBUG] [LOCAL ] EQH: No primary data file found to delete. [2025-09-29T18:36:23.535270] [INFO ] [LOCAL ] EQH: Starting deletion of derivative data. [2025-09-29T18:36:23.535956] [DEBUG] [LOCAL ] EQH: Deleted derivative data file. [2025-09-29T18:36:23.536064] [INFO ] [MAIN ] Update Progress: 758/2371 symbols completed. EQH took 28.2s. Estimated remaining: 3h 25m 1s. Rate: 7.9 symbols/min [2025-09-29T18:36:23.548070] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-09-29T18:36:24.295067] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-29T18:36:24.348077] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-09-29T18:36:25.225422] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-29T18:36:25.238498] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-09-29T18:36:26.374889] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-29T18:36:26.387555] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-09-29T18:36:26.636635] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-29T18:36:26.748154] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-09-29T18:36:28.065441] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-29T18:36:28.079416] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-09-29T18:36:28.584773] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-29T18:36:28.603405] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-09-29T18:36:30.468706] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-09-29T18:36:30.480723] [INFO ] [REMOTE ] EQNR: Full fetch complete (76780 records). [2025-09-29T18:36:30.480967] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-09-29T18:36:30.844686] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-09-29T18:36:30.899574] [INFO ] [REMOTE ] EQR: Full fetch complete (73894 records). [2025-09-29T18:36:30.921071] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-09-29T18:36:31.029722] [DEBUG] [VALIDATOR ] EQNR: All expected trading days are present. [2025-09-29T18:36:31.063538] [DEBUG] [VALIDATOR ] EQNR: Primary data validation passed. [2025-09-29T18:36:31.075400] [INFO ] [MAIN ] EQNR: Fetched primary data is valid. [2025-09-29T18:36:31.081218] [DEBUG] [LOCAL ] EQNR: Saving primary data. [2025-09-29T18:36:31.140318] [DEBUG] [LOCAL ] EQNR: Trimmed 76780 records to 53027 (keeping 200 days of data) [2025-09-29T18:36:31.498069] [DEBUG] [VALIDATOR ] EQR: All expected trading days are present. [2025-09-29T18:36:31.498461] [DEBUG] [VALIDATOR ] EQR: Primary data validation passed. [2025-09-29T18:36:31.499824] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-09-29T18:36:31.500451] [DEBUG] [LOCAL ] EQR: Saving primary data. [2025-09-29T18:36:31.505754] [DEBUG] [LOCAL ] EQR: Trimmed 73894 records to 51469 (keeping 200 days of data) [2025-09-29T18:36:31.981552] [DEBUG] [LOCAL ] EQR: Primary data saved (51469 records). [2025-09-29T18:36:31.982231] [INFO ] [MAIN ] EQR: Full history saved. [2025-09-29T18:36:31.982367] [INFO ] [MAIN ] Update Progress: 759/2371 symbols completed. EQR took 23.3s. Estimated remaining: 3h 24m 55s. Rate: 7.9 symbols/min [2025-09-29T18:36:32.066160] [DEBUG] [LOCAL ] EQNR: Primary data saved (53027 records). [2025-09-29T18:36:32.066329] [INFO ] [MAIN ] EQNR: Full history saved. [2025-09-29T18:36:32.066443] [INFO ] [MAIN ] Update Progress: 760/2371 symbols completed. EQNR took 24.9s. Estimated remaining: 3h 24m 31s. Rate: 7.9 symbols/min [2025-09-29T18:36:32.753008] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:36:32.783930] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:36:32.725105] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:36:32.817703] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-09-29T18:36:32.842888] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-09-29T18:36:32.842809] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:36:32.843435] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-09-29T18:36:32.843516] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-09-29T18:36:32.843690] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-09-29T18:36:32.844388] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-09-29T18:36:32.898002] [DEBUG] [LOCAL ] EQV: Loaded 2840 existing records from primary storage. [2025-09-29T18:36:32.907732] [INFO ] [MAIN ] EQV: Loaded 2840 existing records. [2025-09-29T18:36:33.275685] [DEBUG] [LOCAL ] ERJ: Loaded 51477 existing records from primary storage. [2025-09-29T18:36:33.312863] [INFO ] [MAIN ] ERJ: Loaded 51477 existing records. [2025-09-29T18:36:33.514307] [WARN ] [MAIN ] EQV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:36:33.528404] [DEBUG] [LOCAL ] EQT: Loaded 54462 existing records from primary storage. [2025-09-29T18:36:33.575358] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-09-29T18:36:33.575830] [INFO ] [MAIN ] EQT: Loaded 54462 existing records. [2025-09-29T18:36:33.602080] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-09-29T18:36:33.684054] [DEBUG] [LOCAL ] EQV: Deleted primary data file. [2025-09-29T18:36:33.728715] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:36:33.735064] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-09-29T18:36:33.756752] [INFO ] [REMOTE ] EQS: Fetching primary data for 2024-12. [2025-09-29T18:36:34.026233] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:36:34.050080] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:36:34.060800] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-09-29T18:36:34.066225] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-09-29T18:36:34.076844] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-09-29T18:36:34.076739] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-09-29T18:36:34.121086] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-09-29T18:36:34.112307] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-09-29T18:36:34.139843] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-09-29T18:36:34.148543] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-09-29T18:36:34.492021] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-29T18:36:34.524530] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-09-29T18:36:35.100121] [INFO ] [REMOTE ] EQV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:36:35.125208] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-29T18:36:35.130964] [INFO ] [REMOTE ] EQV: Fetching primary data for 2024-12. [2025-09-29T18:36:35.170345] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-09-29T18:36:35.312861] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:36:35.327928] [INFO ] [REMOTE ] EQT: Fetching primary data for 2024-12. [2025-09-29T18:36:35.354805] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:36:35.355235] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2024-12. [2025-09-29T18:36:35.647678] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-29T18:36:35.648703] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-09-29T18:36:35.993281] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-29T18:36:35.994347] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-09-29T18:36:36.158041] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-29T18:36:36.160374] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-01. [2025-09-29T18:36:36.312466] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-09-29T18:36:36.348083] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-09-29T18:36:36.708289] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-29T18:36:37.096705] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-29T18:36:37.156018] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-09-29T18:36:37.171325] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-29T18:36:37.437996] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-29T18:36:37.822122] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-29T18:36:37.948119] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-01. [2025-09-29T18:36:38.748137] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-09-29T18:36:39.548131] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-09-29T18:36:39.692450] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-29T18:36:40.091629] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-29T18:36:40.348086] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-09-29T18:36:40.881960] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-29T18:36:40.903896] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-29T18:36:41.148125] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-09-29T18:36:41.562254] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-29T18:36:41.948119] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-09-29T18:36:42.748116] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-09-29T18:36:43.237746] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-29T18:36:43.548113] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-09-29T18:36:43.694985] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-29T18:36:44.348127] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-09-29T18:36:44.906999] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-29T18:36:45.148114] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-09-29T18:36:45.239511] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-29T18:36:45.948170] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-09-29T18:36:46.341217] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-29T18:36:46.618596] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-29T18:36:46.748112] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-09-29T18:36:47.323925] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-29T18:36:47.548132] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-09-29T18:36:48.348111] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-09-29T18:36:49.148118] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-09-29T18:36:49.495772] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-29T18:36:49.706367] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-29T18:36:49.948114] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-09-29T18:36:50.298753] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-29T18:36:50.570386] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-29T18:36:50.748192] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-09-29T18:36:51.336576] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-29T18:36:51.337834] [INFO ] [REMOTE ] EQV: Full fetch complete (5769 records). [2025-09-29T18:36:51.337956] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-09-29T18:36:51.553335] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-09-29T18:36:51.747202] [DEBUG] [VALIDATOR ] EQV: All expected trading days are present. [2025-09-29T18:36:51.747318] [DEBUG] [VALIDATOR ] EQV: Primary data validation passed. [2025-09-29T18:36:51.747561] [INFO ] [MAIN ] EQV: Fetched primary data is valid. [2025-09-29T18:36:51.747628] [DEBUG] [LOCAL ] EQV: Saving primary data. [2025-09-29T18:36:51.748176] [DEBUG] [LOCAL ] EQV: Trimmed 5769 records to 2742 (keeping 200 days of data) [2025-09-29T18:36:51.764681] [DEBUG] [LOCAL ] EQV: Primary data saved (2742 records). [2025-09-29T18:36:51.764793] [INFO ] [MAIN ] EQV: Full history saved. [2025-09-29T18:36:51.764889] [INFO ] [MAIN ] Update Progress: 761/2371 symbols completed. EQV took 19.7s. Estimated remaining: 3h 24m 49s. Rate: 7.9 symbols/min [2025-09-29T18:36:51.942533] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:36:51.985370] [DEBUG] [LOCAL ] ERO: Loaded 41901 existing records from primary storage. [2025-09-29T18:36:51.985749] [INFO ] [MAIN ] ERO: Loaded 41901 existing records. [2025-09-29T18:36:52.180201] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:36:52.181320] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-09-29T18:36:52.181383] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-09-29T18:36:52.181848] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-09-29T18:36:52.181908] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-09-29T18:36:52.352794] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-09-29T18:36:52.486763] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-29T18:36:52.500852] [INFO ] [REMOTE ] EQS: Full fetch complete (2534 records). [2025-09-29T18:36:52.511736] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-09-29T18:36:52.707008] [INFO ] [REMOTE ] ERO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:36:52.793390] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-09-29T18:36:52.793632] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:36:52.793724] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:36:52.793797] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-09-29T18:36:52.793867] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-09-29T18:36:52.793926] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-09-29T18:36:52.793998] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-09-29T18:36:52.794074] [INFO ] [MAIN ] Update Progress: 762/2371 symbols completed. EQS took 20.7s. Estimated remaining: 3h 24m 28s. Rate: 7.9 symbols/min [2025-09-29T18:36:52.979019] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:36:53.036758] [DEBUG] [LOCAL ] ES: Loaded 53309 existing records from primary storage. [2025-09-29T18:36:53.037130] [INFO ] [MAIN ] ES: Loaded 53309 existing records. [2025-09-29T18:36:53.151563] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-09-29T18:36:53.241055] [WARN ] [MAIN ] ES: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:36:53.241281] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-09-29T18:36:53.241331] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-09-29T18:36:53.241970] [DEBUG] [LOCAL ] ES: Deleted primary data file. [2025-09-29T18:36:53.242031] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-09-29T18:36:53.674455] [INFO ] [REMOTE ] ES: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:36:53.948123] [INFO ] [REMOTE ] ES: Fetching primary data for 2024-12. [2025-09-29T18:36:54.249751] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-29T18:36:54.748090] [INFO ] [REMOTE ] ERO: Fetching primary data for 2024-12. [2025-09-29T18:36:55.261690] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-29T18:36:55.548156] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-09-29T18:36:55.680614] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-29T18:36:55.910436] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-29T18:36:56.348131] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-01. [2025-09-29T18:36:57.148197] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-09-29T18:36:57.615288] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-29T18:36:57.948127] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-09-29T18:36:58.748192] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-01. [2025-09-29T18:36:58.946002] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-01 (2.60 seconds). [2025-09-29T18:36:58.991423] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-29T18:36:59.548170] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-09-29T18:37:00.274335] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-29T18:37:00.348153] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-09-29T18:37:00.475804] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (2.53 seconds). [2025-09-29T18:37:01.148120] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-09-29T18:37:01.609308] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-29T18:37:01.948161] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-09-29T18:37:02.306714] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-29T18:37:02.748165] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-09-29T18:37:03.187796] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-29T18:37:03.548147] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-09-29T18:37:03.891172] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-29T18:37:03.977340] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-29T18:37:04.348166] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-09-29T18:37:05.148167] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-09-29T18:37:05.593343] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-29T18:37:05.948162] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-09-29T18:37:06.685493] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-29T18:37:06.696821] [INFO ] [REMOTE ] ERJ: Full fetch complete (72237 records). [2025-09-29T18:37:06.697026] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-09-29T18:37:06.758374] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-09-29T18:37:07.136392] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-09-29T18:37:07.136499] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-09-29T18:37:07.137542] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-09-29T18:37:07.137624] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-09-29T18:37:07.139154] [DEBUG] [LOCAL ] ERJ: Trimmed 72237 records to 50678 (keeping 200 days of data) [2025-09-29T18:37:07.393683] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-29T18:37:07.518196] [DEBUG] [LOCAL ] ERJ: Primary data saved (50678 records). [2025-09-29T18:37:07.518403] [INFO ] [MAIN ] ERJ: Full history saved. [2025-09-29T18:37:07.518517] [INFO ] [MAIN ] Update Progress: 763/2371 symbols completed. ERJ took 35.4s. Estimated remaining: 3h 24m 35s. Rate: 7.9 symbols/min [2025-09-29T18:37:07.554555] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-09-29T18:37:07.709596] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:37:07.739327] [DEBUG] [LOCAL ] ESAB: Loaded 26683 existing records from primary storage. [2025-09-29T18:37:07.739622] [INFO ] [MAIN ] ESAB: Loaded 26683 existing records. [2025-09-29T18:37:07.941766] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:37:07.941994] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-09-29T18:37:07.942043] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-09-29T18:37:07.942576] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-09-29T18:37:07.942638] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-09-29T18:37:08.341856] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:37:08.348075] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2024-12. [2025-09-29T18:37:08.539504] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (2.59 seconds). [2025-09-29T18:37:08.552962] [INFO ] [REMOTE ] EQT: Full fetch complete (77692 records). [2025-09-29T18:37:08.553142] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-09-29T18:37:08.998409] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-09-29T18:37:08.998585] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-09-29T18:37:08.999891] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-09-29T18:37:08.999973] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-09-29T18:37:09.013638] [DEBUG] [LOCAL ] EQT: Trimmed 77692 records to 53682 (keeping 200 days of data) [2025-09-29T18:37:09.037825] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-09-29T18:37:09.148327] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-09-29T18:37:09.309186] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-29T18:37:09.422958] [DEBUG] [LOCAL ] EQT: Primary data saved (53682 records). [2025-09-29T18:37:09.423120] [INFO ] [MAIN ] EQT: Full history saved. [2025-09-29T18:37:09.423251] [INFO ] [MAIN ] Update Progress: 764/2371 symbols completed. EQT took 37.4s. Estimated remaining: 3h 24m 15s. Rate: 7.9 symbols/min [2025-09-29T18:37:09.637148] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:37:09.653268] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-29T18:37:09.678807] [DEBUG] [LOCAL ] ESE: Loaded 16878 existing records from primary storage. [2025-09-29T18:37:09.679126] [INFO ] [MAIN ] ESE: Loaded 16878 existing records. [2025-09-29T18:37:09.929580] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:37:09.929907] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-09-29T18:37:09.929968] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-09-29T18:37:09.930499] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-09-29T18:37:09.930566] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-09-29T18:37:09.957121] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-09-29T18:37:10.413474] [INFO ] [REMOTE ] ESE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:37:10.691215] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-29T18:37:10.748110] [INFO ] [REMOTE ] ESE: Fetching primary data for 2024-12. [2025-09-29T18:37:11.475224] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-29T18:37:11.492945] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-29T18:37:11.548122] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-09-29T18:37:12.348121] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-09-29T18:37:13.148124] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-01. [2025-09-29T18:37:13.597176] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-29T18:37:13.897914] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-29T18:37:13.948058] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-09-29T18:37:14.454212] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-29T18:37:14.748093] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-09-29T18:37:15.074348] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-29T18:37:15.548111] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-09-29T18:37:16.198437] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-29T18:37:16.348112] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-01. [2025-09-29T18:37:16.977067] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-29T18:37:17.148177] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-09-29T18:37:17.948141] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-09-29T18:37:18.281157] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-29T18:37:18.748109] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-09-29T18:37:19.548112] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-09-29T18:37:20.057842] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-29T18:37:20.107242] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-29T18:37:20.174462] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-29T18:37:20.348133] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-09-29T18:37:20.397884] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (3.25 seconds). [2025-09-29T18:37:20.412076] [INFO ] [REMOTE ] ERO: Full fetch complete (59406 records). [2025-09-29T18:37:20.412278] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-09-29T18:37:20.867702] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-09-29T18:37:20.867794] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-09-29T18:37:20.868747] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-09-29T18:37:20.868843] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-09-29T18:37:20.870179] [DEBUG] [LOCAL ] ERO: Trimmed 59406 records to 41225 (keeping 200 days of data) [2025-09-29T18:37:21.125204] [DEBUG] [LOCAL ] ERO: Primary data saved (41225 records). [2025-09-29T18:37:21.125346] [INFO ] [MAIN ] ERO: Full history saved. [2025-09-29T18:37:21.125434] [INFO ] [MAIN ] Update Progress: 765/2371 symbols completed. ERO took 29.4s. Estimated remaining: 3h 24m 16s. Rate: 7.9 symbols/min [2025-09-29T18:37:21.158889] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-09-29T18:37:21.317350] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:37:21.370982] [DEBUG] [LOCAL ] ESI: Loaded 51566 existing records from primary storage. [2025-09-29T18:37:21.371366] [INFO ] [MAIN ] ESI: Loaded 51566 existing records. [2025-09-29T18:37:21.538931] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-29T18:37:21.589779] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:37:21.590045] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-09-29T18:37:21.590108] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-09-29T18:37:21.590817] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-09-29T18:37:21.590879] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-09-29T18:37:21.957626] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-09-29T18:37:21.963800] [INFO ] [REMOTE ] ESI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:37:22.534808] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-29T18:37:22.748185] [INFO ] [REMOTE ] ESI: Fetching primary data for 2024-12. [2025-09-29T18:37:23.243970] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-29T18:37:23.548130] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-09-29T18:37:24.348121] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-09-29T18:37:25.148124] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-09-29T18:37:25.336418] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-29T18:37:25.586130] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2024-12 (2.84 seconds). [2025-09-29T18:37:25.912140] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-29T18:37:25.948123] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-01. [2025-09-29T18:37:26.117044] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (2.57 seconds). [2025-09-29T18:37:26.748151] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-09-29T18:37:27.548168] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-09-29T18:37:28.118916] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-29T18:37:28.198844] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-09-29T18:37:28.348109] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-09-29T18:37:29.148133] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-09-29T18:37:29.449728] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-29T18:37:29.842462] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-29T18:37:29.948078] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-09-29T18:37:30.151544] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-29T18:37:30.748153] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-09-29T18:37:31.548084] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-09-29T18:37:31.675177] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-29T18:37:31.956409] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-29T18:37:32.348165] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-09-29T18:37:33.148162] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-09-29T18:37:33.554790] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-29T18:37:33.948147] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-09-29T18:37:34.104368] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-29T18:37:34.456261] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-29T18:37:34.748149] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-09-29T18:37:35.548145] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-09-29T18:37:36.134985] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-29T18:37:36.146567] [INFO ] [REMOTE ] ES: Full fetch complete (76172 records). [2025-09-29T18:37:36.146774] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-09-29T18:37:36.285156] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-29T18:37:36.326125] [INFO ] [REMOTE ] ESE: Full fetch complete (22243 records). [2025-09-29T18:37:36.335755] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-09-29T18:37:36.364867] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-09-29T18:37:36.762770] [DEBUG] [VALIDATOR ] ES: All expected trading days are present. [2025-09-29T18:37:36.840782] [DEBUG] [VALIDATOR ] ES: Primary data validation passed. [2025-09-29T18:37:36.847798] [INFO ] [MAIN ] ES: Fetched primary data is valid. [2025-09-29T18:37:36.877199] [DEBUG] [LOCAL ] ES: Saving primary data. [2025-09-29T18:37:36.942184] [DEBUG] [LOCAL ] ES: Trimmed 76172 records to 52538 (keeping 200 days of data) [2025-09-29T18:37:37.027346] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-09-29T18:37:37.027540] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-09-29T18:37:37.027941] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-09-29T18:37:37.028089] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-09-29T18:37:37.094437] [DEBUG] [LOCAL ] ESE: Trimmed 22243 records to 16687 (keeping 200 days of data) [2025-09-29T18:37:37.254155] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-29T18:37:37.272846] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-09-29T18:37:37.327300] [DEBUG] [LOCAL ] ESE: Primary data saved (16687 records). [2025-09-29T18:37:37.328395] [INFO ] [MAIN ] ESE: Full history saved. [2025-09-29T18:37:37.328843] [INFO ] [MAIN ] Update Progress: 766/2371 symbols completed. ESE took 27.9s. Estimated remaining: 3h 24m 27s. Rate: 7.9 symbols/min [2025-09-29T18:37:37.666195] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:37:37.819417] [DEBUG] [LOCAL ] ESNT: Loaded 39065 existing records from primary storage. [2025-09-29T18:37:37.824223] [INFO ] [MAIN ] ESNT: Loaded 39065 existing records. [2025-09-29T18:37:37.823102] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-29T18:37:37.948627] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-09-29T18:37:38.210249] [DEBUG] [LOCAL ] ES: Primary data saved (52538 records). [2025-09-29T18:37:38.210494] [INFO ] [MAIN ] ES: Full history saved. [2025-09-29T18:37:38.210609] [INFO ] [MAIN ] Update Progress: 767/2371 symbols completed. ES took 45.4s. Estimated remaining: 3h 24m 5s. Rate: 7.9 symbols/min [2025-09-29T18:37:38.249461] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:37:38.295002] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-09-29T18:37:38.295121] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-09-29T18:37:38.310442] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-09-29T18:37:38.321262] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-09-29T18:37:38.608434] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:37:38.988075] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:37:38.990496] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2024-12. [2025-09-29T18:37:38.993075] [DEBUG] [LOCAL ] ESRT: Loaded 47104 existing records from primary storage. [2025-09-29T18:37:38.993769] [INFO ] [MAIN ] ESRT: Loaded 47104 existing records. [2025-09-29T18:37:39.165273] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-29T18:37:39.237398] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:37:39.238093] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-09-29T18:37:39.238187] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-09-29T18:37:39.239182] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-09-29T18:37:39.239242] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-09-29T18:37:39.552718] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-09-29T18:37:39.636326] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:37:39.638684] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-29T18:37:39.647950] [INFO ] [REMOTE ] ESAB: Full fetch complete (35717 records). [2025-09-29T18:37:39.648254] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-09-29T18:37:40.044553] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-09-29T18:37:40.044669] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-09-29T18:37:40.045397] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-09-29T18:37:40.045442] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-09-29T18:37:40.046338] [DEBUG] [LOCAL ] ESAB: Trimmed 35717 records to 26158 (keeping 200 days of data) [2025-09-29T18:37:40.217679] [DEBUG] [LOCAL ] ESAB: Primary data saved (26158 records). [2025-09-29T18:37:40.217839] [INFO ] [MAIN ] ESAB: Full history saved. [2025-09-29T18:37:40.217936] [INFO ] [MAIN ] Update Progress: 768/2371 symbols completed. ESAB took 32.7s. Estimated remaining: 3h 23m 46s. Rate: 7.9 symbols/min [2025-09-29T18:37:40.353321] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2024-12. [2025-09-29T18:37:40.409090] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:37:40.441849] [DEBUG] [LOCAL ] ESS: Loaded 30441 existing records from primary storage. [2025-09-29T18:37:40.442140] [INFO ] [MAIN ] ESS: Loaded 30441 existing records. [2025-09-29T18:37:40.628379] [WARN ] [MAIN ] ESS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:37:40.628913] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-09-29T18:37:40.629148] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-09-29T18:37:40.630359] [DEBUG] [LOCAL ] ESS: Deleted primary data file. [2025-09-29T18:37:40.630432] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-09-29T18:37:40.813015] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-29T18:37:41.050520] [INFO ] [REMOTE ] ESS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:37:41.148087] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-09-29T18:37:41.431664] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-29T18:37:41.948155] [INFO ] [REMOTE ] ESS: Fetching primary data for 2024-12. [2025-09-29T18:37:42.188269] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-29T18:37:42.308296] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-29T18:37:42.748124] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-09-29T18:37:42.894395] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-29T18:37:43.548130] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-01. [2025-09-29T18:37:44.183423] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-29T18:37:44.348153] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-01. [2025-09-29T18:37:44.895415] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-29T18:37:45.148149] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-09-29T18:37:45.948695] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-29T18:37:45.948815] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-09-29T18:37:46.716310] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-29T18:37:46.748084] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-09-29T18:37:47.428149] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-29T18:37:47.548174] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-09-29T18:37:48.348109] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-09-29T18:37:48.632764] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-29T18:37:48.643462] [INFO ] [REMOTE ] ESI: Full fetch complete (72534 records). [2025-09-29T18:37:48.643628] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-09-29T18:37:49.148750] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-09-29T18:37:49.201789] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-09-29T18:37:49.201925] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-09-29T18:37:49.203078] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-09-29T18:37:49.203167] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-09-29T18:37:49.235345] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-29T18:37:49.245093] [DEBUG] [LOCAL ] ESI: Trimmed 72534 records to 50777 (keeping 200 days of data) [2025-09-29T18:37:49.498996] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-29T18:37:49.619594] [DEBUG] [LOCAL ] ESI: Primary data saved (50777 records). [2025-09-29T18:37:49.619769] [INFO ] [MAIN ] ESI: Full history saved. [2025-09-29T18:37:49.619887] [INFO ] [MAIN ] Update Progress: 769/2371 symbols completed. ESI took 28.5s. Estimated remaining: 3h 23m 42s. Rate: 7.9 symbols/min [2025-09-29T18:37:49.814804] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:37:49.868075] [DEBUG] [LOCAL ] ESTC: Loaded 50744 existing records from primary storage. [2025-09-29T18:37:49.868552] [INFO ] [MAIN ] ESTC: Loaded 50744 existing records. [2025-09-29T18:37:49.953285] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-09-29T18:37:50.065394] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:37:50.065697] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-09-29T18:37:50.065768] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-09-29T18:37:50.066432] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-09-29T18:37:50.066497] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-09-29T18:37:50.447411] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:37:50.467355] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-29T18:37:50.748124] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-09-29T18:37:51.548103] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-09-29T18:37:51.590417] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-29T18:37:51.653712] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-29T18:37:52.348120] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-09-29T18:37:52.719579] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-29T18:37:53.148129] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-09-29T18:37:53.948100] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-09-29T18:37:54.105197] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-29T18:37:54.748101] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-09-29T18:37:54.784924] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-29T18:37:55.426841] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-29T18:37:55.548100] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-09-29T18:37:56.231108] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-29T18:37:56.348123] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-09-29T18:37:56.721028] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-29T18:37:57.148132] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-09-29T18:37:57.879907] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-29T18:37:57.948106] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-09-29T18:37:58.516974] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-29T18:37:58.748139] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2024-12. [2025-09-29T18:37:59.548080] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-09-29T18:37:59.580480] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-29T18:38:00.348139] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-09-29T18:38:01.148219] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-09-29T18:38:01.162902] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-29T18:38:01.264528] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-09-29T18:38:01.948122] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-01. [2025-09-29T18:38:02.040566] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-29T18:38:02.564031] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-29T18:38:02.748129] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-09-29T18:38:03.325814] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-29T18:38:03.548147] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-09-29T18:38:04.348097] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-09-29T18:38:04.414956] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-29T18:38:04.423101] [INFO ] [REMOTE ] ESNT: Full fetch complete (57138 records). [2025-09-29T18:38:04.423247] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-09-29T18:38:04.858329] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present. [2025-09-29T18:38:04.858448] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed. [2025-09-29T18:38:04.859291] [INFO ] [MAIN ] ESNT: Fetched primary data is valid. [2025-09-29T18:38:04.859357] [DEBUG] [LOCAL ] ESNT: Saving primary data. [2025-09-29T18:38:04.860841] [DEBUG] [LOCAL ] ESNT: Trimmed 57138 records to 38376 (keeping 200 days of data) [2025-09-29T18:38:05.115599] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-29T18:38:05.148422] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-09-29T18:38:05.167019] [DEBUG] [LOCAL ] ESNT: Primary data saved (38376 records). [2025-09-29T18:38:05.167210] [INFO ] [MAIN ] ESNT: Full history saved. [2025-09-29T18:38:05.167346] [INFO ] [MAIN ] Update Progress: 770/2371 symbols completed. ESNT took 27.8s. Estimated remaining: 3h 23m 50s. Rate: 7.9 symbols/min [2025-09-29T18:38:05.352268] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:38:05.414557] [DEBUG] [LOCAL ] ET: Loaded 54569 existing records from primary storage. [2025-09-29T18:38:05.414997] [INFO ] [MAIN ] ET: Loaded 54569 existing records. [2025-09-29T18:38:05.609285] [WARN ] [MAIN ] ET: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:38:05.609512] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-09-29T18:38:05.609563] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-09-29T18:38:05.610365] [DEBUG] [LOCAL ] ET: Deleted primary data file. [2025-09-29T18:38:05.610426] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-09-29T18:38:05.953451] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-09-29T18:38:05.995950] [INFO ] [REMOTE ] ET: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:38:06.292038] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-29T18:38:06.302363] [INFO ] [REMOTE ] ESRT: Full fetch complete (66513 records). [2025-09-29T18:38:06.302537] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-09-29T18:38:06.720445] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-09-29T18:38:06.720542] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-09-29T18:38:06.721433] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-09-29T18:38:06.721499] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-09-29T18:38:06.722906] [DEBUG] [LOCAL ] ESRT: Trimmed 66513 records to 46398 (keeping 200 days of data) [2025-09-29T18:38:06.777049] [INFO ] [REMOTE ] ET: Fetching primary data for 2024-12. [2025-09-29T18:38:06.875462] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-29T18:38:07.070238] [DEBUG] [LOCAL ] ESRT: Primary data saved (46398 records). [2025-09-29T18:38:07.070482] [INFO ] [MAIN ] ESRT: Full history saved. [2025-09-29T18:38:07.070593] [INFO ] [MAIN ] Update Progress: 771/2371 symbols completed. ESRT took 28.9s. Estimated remaining: 3h 23m 31s. Rate: 7.9 symbols/min [2025-09-29T18:38:07.255127] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:38:07.272587] [DEBUG] [LOCAL ] ETB: Loaded 12181 existing records from primary storage. [2025-09-29T18:38:07.272901] [INFO ] [MAIN ] ETB: Loaded 12181 existing records. [2025-09-29T18:38:07.490846] [WARN ] [MAIN ] ETB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:38:07.491213] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-09-29T18:38:07.491680] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-09-29T18:38:07.493369] [DEBUG] [LOCAL ] ETB: Deleted primary data file. [2025-09-29T18:38:07.493298] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-29T18:38:07.493567] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-09-29T18:38:07.557308] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-09-29T18:38:07.889582] [INFO ] [REMOTE ] ETB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:38:08.348134] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-09-29T18:38:09.153560] [INFO ] [REMOTE ] ETB: Fetching primary data for 2024-12. [2025-09-29T18:38:09.180374] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2024-12 (2.40 seconds). [2025-09-29T18:38:09.391820] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-29T18:38:09.867275] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-29T18:38:09.874455] [INFO ] [REMOTE ] ESS: Full fetch complete (43426 records). [2025-09-29T18:38:09.874572] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-09-29T18:38:09.955042] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-09-29T18:38:10.280225] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-09-29T18:38:10.280312] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-09-29T18:38:10.281143] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-09-29T18:38:10.281211] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-09-29T18:38:10.282272] [DEBUG] [LOCAL ] ESS: Trimmed 43426 records to 30019 (keeping 200 days of data) [2025-09-29T18:38:10.389217] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-29T18:38:10.493134] [DEBUG] [LOCAL ] ESS: Primary data saved (30019 records). [2025-09-29T18:38:10.493313] [INFO ] [MAIN ] ESS: Full history saved. [2025-09-29T18:38:10.493428] [INFO ] [MAIN ] Update Progress: 772/2371 symbols completed. ESS took 30.3s. Estimated remaining: 3h 23m 15s. Rate: 7.9 symbols/min [2025-09-29T18:38:10.670024] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:38:10.698569] [DEBUG] [LOCAL ] ETD: Loaded 27661 existing records from primary storage. [2025-09-29T18:38:10.698900] [INFO ] [MAIN ] ETD: Loaded 27661 existing records. [2025-09-29T18:38:10.757864] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-01. [2025-09-29T18:38:10.893198] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:38:10.893410] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-09-29T18:38:10.893457] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-09-29T18:38:10.893905] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-09-29T18:38:10.893964] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-09-29T18:38:11.261036] [INFO ] [REMOTE ] ETD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:38:11.548134] [INFO ] [REMOTE ] ETD: Fetching primary data for 2024-12. [2025-09-29T18:38:12.155593] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-29T18:38:12.348171] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-09-29T18:38:12.827877] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-29T18:38:13.040637] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-09-29T18:38:13.148111] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-09-29T18:38:13.884945] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-29T18:38:13.948105] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-09-29T18:38:14.748139] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-01. [2025-09-29T18:38:15.277344] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-29T18:38:15.381977] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-29T18:38:15.548154] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-09-29T18:38:15.819183] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-29T18:38:16.348139] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-09-29T18:38:17.148084] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-09-29T18:38:17.356248] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-29T18:38:17.948066] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-09-29T18:38:18.348256] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-29T18:38:18.667519] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-09-29T18:38:18.748121] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-09-29T18:38:19.548134] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-01. [2025-09-29T18:38:19.721757] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-29T18:38:20.321303] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-29T18:38:20.348092] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-09-29T18:38:21.148180] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-09-29T18:38:21.185084] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-09-29T18:38:21.498684] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-29T18:38:21.948122] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-09-29T18:38:22.748144] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-09-29T18:38:22.852012] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-29T18:38:23.322037] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-29T18:38:23.333005] [INFO ] [REMOTE ] ESTC: Full fetch complete (71997 records). [2025-09-29T18:38:23.333175] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-09-29T18:38:23.553292] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-09-29T18:38:23.776093] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-09-29T18:38:23.776294] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-09-29T18:38:23.777391] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-09-29T18:38:23.777494] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-09-29T18:38:23.780137] [DEBUG] [LOCAL ] ESTC: Trimmed 71997 records to 49961 (keeping 200 days of data) [2025-09-29T18:38:24.061718] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-29T18:38:24.156452] [DEBUG] [LOCAL ] ESTC: Primary data saved (49961 records). [2025-09-29T18:38:24.156604] [INFO ] [MAIN ] ESTC: Full history saved. [2025-09-29T18:38:24.156719] [INFO ] [MAIN ] Update Progress: 773/2371 symbols completed. ESTC took 34.5s. Estimated remaining: 3h 23m 19s. Rate: 7.9 symbols/min [2025-09-29T18:38:24.344859] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:38:24.348267] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-09-29T18:38:24.370698] [DEBUG] [LOCAL ] ETG: Loaded 16710 existing records from primary storage. [2025-09-29T18:38:24.370977] [INFO ] [MAIN ] ETG: Loaded 16710 existing records. [2025-09-29T18:38:24.562049] [WARN ] [MAIN ] ETG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:38:24.562298] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-09-29T18:38:24.562349] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-09-29T18:38:24.562828] [DEBUG] [LOCAL ] ETG: Deleted primary data file. [2025-09-29T18:38:24.562893] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-09-29T18:38:24.939351] [INFO ] [REMOTE ] ETG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:38:25.148159] [INFO ] [REMOTE ] ETG: Fetching primary data for 2024-12. [2025-09-29T18:38:25.702726] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-29T18:38:25.948124] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-09-29T18:38:25.988719] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-09-29T18:38:26.596728] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-29T18:38:26.748170] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-09-29T18:38:27.087195] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-29T18:38:27.548178] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-09-29T18:38:27.896256] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-29T18:38:28.355006] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-09-29T18:38:28.361202] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-29T18:38:29.148130] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-09-29T18:38:29.333920] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-29T18:38:29.948209] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-09-29T18:38:30.309481] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-29T18:38:30.748165] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-09-29T18:38:31.201794] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-29T18:38:31.548134] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-09-29T18:38:31.859374] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-29T18:38:32.348109] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-09-29T18:38:33.148155] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-09-29T18:38:33.621586] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-29T18:38:33.902639] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-09-29T18:38:33.948146] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-09-29T18:38:34.127185] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-29T18:38:34.748088] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-09-29T18:38:35.130335] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-29T18:38:35.331239] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-29T18:38:35.548149] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-09-29T18:38:36.348147] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-09-29T18:38:37.058637] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-29T18:38:37.065511] [INFO ] [REMOTE ] ETD: Full fetch complete (38176 records). [2025-09-29T18:38:37.065699] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-09-29T18:38:37.153336] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-09-29T18:38:37.470119] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-09-29T18:38:37.470235] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-09-29T18:38:37.470925] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-09-29T18:38:37.470998] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-09-29T18:38:37.472104] [DEBUG] [LOCAL ] ETD: Trimmed 38176 records to 27396 (keeping 200 days of data) [2025-09-29T18:38:37.654140] [DEBUG] [LOCAL ] ETD: Primary data saved (27396 records). [2025-09-29T18:38:37.654289] [INFO ] [MAIN ] ETD: Full history saved. [2025-09-29T18:38:37.654387] [INFO ] [MAIN ] Update Progress: 774/2371 symbols completed. ETD took 27.2s. Estimated remaining: 3h 23m 24s. Rate: 7.9 symbols/min [2025-09-29T18:38:37.842239] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:38:37.864302] [DEBUG] [LOCAL ] ETJ: Loaded 16938 existing records from primary storage. [2025-09-29T18:38:37.864572] [INFO ] [MAIN ] ETJ: Loaded 16938 existing records. [2025-09-29T18:38:37.951331] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-09-29T18:38:38.067978] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:38:38.076947] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-09-29T18:38:38.077271] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-29T18:38:38.077386] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-09-29T18:38:38.081483] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-09-29T18:38:38.081560] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-09-29T18:38:38.489675] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:38:38.708900] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-09-29T18:38:38.748073] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-09-29T18:38:39.199571] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-29T18:38:39.548109] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-09-29T18:38:40.348141] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-09-29T18:38:40.547963] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-29T18:38:40.748576] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-29T18:38:41.148101] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2024-12. [2025-09-29T18:38:41.185272] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-29T18:38:41.948113] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-09-29T18:38:42.081185] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-29T18:38:42.748115] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-09-29T18:38:43.004220] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-29T18:38:43.548151] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-09-29T18:38:43.694805] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-29T18:38:43.698410] [INFO ] [REMOTE ] ETB: Full fetch complete (17947 records). [2025-09-29T18:38:43.698858] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-09-29T18:38:44.120494] [DEBUG] [VALIDATOR ] ETB: All expected trading days are present. [2025-09-29T18:38:44.120591] [DEBUG] [VALIDATOR ] ETB: Primary data validation passed. [2025-09-29T18:38:44.121042] [INFO ] [MAIN ] ETB: Fetched primary data is valid. [2025-09-29T18:38:44.121104] [DEBUG] [LOCAL ] ETB: Saving primary data. [2025-09-29T18:38:44.121786] [DEBUG] [LOCAL ] ETB: Trimmed 17947 records to 12084 (keeping 200 days of data) [2025-09-29T18:38:44.201176] [DEBUG] [LOCAL ] ETB: Primary data saved (12084 records). [2025-09-29T18:38:44.201355] [INFO ] [MAIN ] ETB: Full history saved. [2025-09-29T18:38:44.201462] [INFO ] [MAIN ] Update Progress: 775/2371 symbols completed. ETB took 37.1s. Estimated remaining: 3h 23m 14s. Rate: 7.9 symbols/min [2025-09-29T18:38:44.353292] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-09-29T18:38:44.382358] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:38:44.448800] [DEBUG] [LOCAL ] ETN: Loaded 53593 existing records from primary storage. [2025-09-29T18:38:44.449192] [INFO ] [MAIN ] ETN: Loaded 53593 existing records. [2025-09-29T18:38:44.591199] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-29T18:38:44.666773] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:38:44.666994] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-09-29T18:38:44.667044] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-09-29T18:38:44.668089] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-09-29T18:38:44.668156] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-09-29T18:38:45.070409] [INFO ] [REMOTE ] ETN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:38:45.148131] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-09-29T18:38:45.381364] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-29T18:38:45.948184] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-09-29T18:38:46.748167] [INFO ] [REMOTE ] ETN: Fetching primary data for 2024-12. [2025-09-29T18:38:47.052398] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-29T18:38:47.548175] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-09-29T18:38:47.764940] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-09-29T18:38:47.776700] [INFO ] [REMOTE ] ET: Full fetch complete (77955 records). [2025-09-29T18:38:47.776872] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-09-29T18:38:48.208110] [DEBUG] [VALIDATOR ] ET: All expected trading days are present. [2025-09-29T18:38:48.208500] [DEBUG] [VALIDATOR ] ET: Primary data validation passed. [2025-09-29T18:38:48.209831] [INFO ] [MAIN ] ET: Fetched primary data is valid. [2025-09-29T18:38:48.210158] [DEBUG] [LOCAL ] ET: Saving primary data. [2025-09-29T18:38:48.212485] [DEBUG] [LOCAL ] ET: Trimmed 77955 records to 53789 (keeping 200 days of data) [2025-09-29T18:38:48.356634] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-09-29T18:38:48.367469] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-29T18:38:48.613983] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-29T18:38:48.644473] [DEBUG] [LOCAL ] ET: Primary data saved (53789 records). [2025-09-29T18:38:48.644658] [INFO ] [MAIN ] ET: Full history saved. [2025-09-29T18:38:48.644770] [INFO ] [MAIN ] Update Progress: 776/2371 symbols completed. ET took 43.5s. Estimated remaining: 3h 22m 60s. Rate: 7.9 symbols/min [2025-09-29T18:38:48.838851] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:38:48.847253] [DEBUG] [LOCAL ] ETO: Loaded 6600 existing records from primary storage. [2025-09-29T18:38:48.847459] [INFO ] [MAIN ] ETO: Loaded 6600 existing records. [2025-09-29T18:38:49.048439] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:38:49.048781] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-09-29T18:38:49.048858] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-09-29T18:38:49.049415] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-09-29T18:38:49.049546] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-09-29T18:38:49.153248] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-09-29T18:38:49.448266] [INFO ] [REMOTE ] ETO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:38:49.459248] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-29T18:38:49.463265] [INFO ] [REMOTE ] ETG: Full fetch complete (24774 records). [2025-09-29T18:38:49.463508] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-09-29T18:38:49.886117] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present. [2025-09-29T18:38:49.886198] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed. [2025-09-29T18:38:49.886795] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-09-29T18:38:49.886858] [DEBUG] [LOCAL ] ETG: Saving primary data. [2025-09-29T18:38:49.887589] [DEBUG] [LOCAL ] ETG: Trimmed 24774 records to 16477 (keeping 200 days of data) [2025-09-29T18:38:49.960998] [INFO ] [REMOTE ] ETO: Fetching primary data for 2024-12. [2025-09-29T18:38:50.000940] [DEBUG] [LOCAL ] ETG: Primary data saved (16477 records). [2025-09-29T18:38:50.001096] [INFO ] [MAIN ] ETG: Full history saved. [2025-09-29T18:38:50.001186] [INFO ] [MAIN ] Update Progress: 777/2371 symbols completed. ETG took 25.8s. Estimated remaining: 3h 22m 39s. Rate: 7.9 symbols/min [2025-09-29T18:38:50.182808] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:38:50.241022] [DEBUG] [LOCAL ] ETR: Loaded 54001 existing records from primary storage. [2025-09-29T18:38:50.241415] [INFO ] [MAIN ] ETR: Loaded 54001 existing records. [2025-09-29T18:38:50.472775] [WARN ] [MAIN ] ETR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:38:50.474976] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-29T18:38:50.480820] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-09-29T18:38:50.481938] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-09-29T18:38:50.482684] [DEBUG] [LOCAL ] ETR: Deleted primary data file. [2025-09-29T18:38:50.482747] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-09-29T18:38:50.753247] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-09-29T18:38:50.864247] [INFO ] [REMOTE ] ETR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:38:51.088345] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-29T18:38:51.548114] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-01. [2025-09-29T18:38:52.310281] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-29T18:38:52.348099] [INFO ] [REMOTE ] ETR: Fetching primary data for 2024-12. [2025-09-29T18:38:52.868326] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-29T18:38:53.148115] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-09-29T18:38:53.777240] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-29T18:38:53.777687] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-29T18:38:53.948140] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-09-29T18:38:54.748110] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-01. [2025-09-29T18:38:54.854519] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-29T18:38:55.548135] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-09-29T18:38:56.348086] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-09-29T18:38:56.561425] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-29T18:38:56.593551] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-29T18:38:57.148119] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-09-29T18:38:57.948133] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-09-29T18:38:58.280927] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-29T18:38:58.505562] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-29T18:38:58.521789] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-29T18:38:58.748165] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-09-29T18:38:59.548112] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-09-29T18:38:59.572673] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-29T18:39:00.348091] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-09-29T18:39:00.553512] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-29T18:39:01.146491] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-29T18:39:01.148414] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-09-29T18:39:01.948119] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-09-29T18:39:02.748112] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-09-29T18:39:03.231167] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-29T18:39:03.548109] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-09-29T18:39:03.601075] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-29T18:39:03.909012] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-29T18:39:04.348108] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-09-29T18:39:05.148087] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-09-29T18:39:05.518868] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-29T18:39:05.901634] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-29T18:39:05.948093] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-09-29T18:39:06.162939] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-29T18:39:06.551119] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-29T18:39:06.748104] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-09-29T18:39:07.548111] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-09-29T18:39:08.348114] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-09-29T18:39:08.426064] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-29T18:39:09.144860] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-29T18:39:09.146774] [INFO ] [REMOTE ] ETO: Full fetch complete (9326 records). [2025-09-29T18:39:09.146851] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-09-29T18:39:09.158289] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-09-29T18:39:09.541984] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-09-29T18:39:09.542153] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-09-29T18:39:09.542459] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-09-29T18:39:09.542605] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-09-29T18:39:09.543420] [DEBUG] [LOCAL ] ETO: Trimmed 9326 records to 6496 (keeping 200 days of data) [2025-09-29T18:39:09.614476] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-29T18:39:09.638096] [DEBUG] [LOCAL ] ETO: Primary data saved (6496 records). [2025-09-29T18:39:09.638258] [INFO ] [MAIN ] ETO: Full history saved. [2025-09-29T18:39:09.638377] [INFO ] [MAIN ] Update Progress: 778/2371 symbols completed. ETO took 21.0s. Estimated remaining: 3h 22m 56s. Rate: 7.8 symbols/min [2025-09-29T18:39:09.829174] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:39:09.858324] [DEBUG] [LOCAL ] ETV: Loaded 21729 existing records from primary storage. [2025-09-29T18:39:09.858597] [INFO ] [MAIN ] ETV: Loaded 21729 existing records. [2025-09-29T18:39:09.954915] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-09-29T18:39:10.049140] [WARN ] [MAIN ] ETV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:39:10.049378] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-09-29T18:39:10.049427] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-09-29T18:39:10.049808] [DEBUG] [LOCAL ] ETV: Deleted primary data file. [2025-09-29T18:39:10.049869] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-09-29T18:39:10.390761] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-29T18:39:10.480326] [INFO ] [REMOTE ] ETV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:39:10.748164] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-09-29T18:39:11.548118] [INFO ] [REMOTE ] ETV: Fetching primary data for 2024-12. [2025-09-29T18:39:11.989850] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-29T18:39:12.001959] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-29T18:39:12.007360] [INFO ] [REMOTE ] ETJ: Full fetch complete (25140 records). [2025-09-29T18:39:12.007519] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-09-29T18:39:12.353245] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-09-29T18:39:12.438243] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-09-29T18:39:12.438345] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-09-29T18:39:12.439014] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-09-29T18:39:12.439100] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-09-29T18:39:12.441025] [DEBUG] [LOCAL ] ETJ: Trimmed 25140 records to 16684 (keeping 200 days of data) [2025-09-29T18:39:12.548935] [DEBUG] [LOCAL ] ETJ: Primary data saved (16684 records). [2025-09-29T18:39:12.549089] [INFO ] [MAIN ] ETJ: Full history saved. [2025-09-29T18:39:12.549178] [INFO ] [MAIN ] Update Progress: 779/2371 symbols completed. ETJ took 34.9s. Estimated remaining: 3h 22m 39s. Rate: 7.9 symbols/min [2025-09-29T18:39:12.742114] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:39:12.767800] [DEBUG] [LOCAL ] ETW: Loaded 25463 existing records from primary storage. [2025-09-29T18:39:12.768123] [INFO ] [MAIN ] ETW: Loaded 25463 existing records. [2025-09-29T18:39:12.961716] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:39:12.962028] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-09-29T18:39:12.962118] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-09-29T18:39:12.962625] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-09-29T18:39:12.962720] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-09-29T18:39:13.106411] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-29T18:39:13.161795] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-09-29T18:39:13.356996] [INFO ] [REMOTE ] ETW: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:39:13.948145] [INFO ] [REMOTE ] ETW: Fetching primary data for 2024-12. [2025-09-29T18:39:14.459473] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-29T18:39:14.748125] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-09-29T18:39:15.084696] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-29T18:39:15.252997] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-29T18:39:15.548108] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-09-29T18:39:16.348105] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-01. [2025-09-29T18:39:16.549879] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-29T18:39:17.148157] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-09-29T18:39:17.661539] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-29T18:39:17.711043] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-29T18:39:17.948146] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-09-29T18:39:18.748126] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-09-29T18:39:18.951523] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-29T18:39:19.250383] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-29T18:39:19.261552] [INFO ] [REMOTE ] ETR: Full fetch complete (77037 records). [2025-09-29T18:39:19.261745] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-09-29T18:39:19.553239] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-09-29T18:39:19.683441] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-09-29T18:39:19.683616] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-09-29T18:39:19.684782] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-09-29T18:39:19.684851] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-09-29T18:39:19.686387] [DEBUG] [LOCAL ] ETR: Trimmed 77037 records to 53220 (keeping 200 days of data) [2025-09-29T18:39:20.030176] [DEBUG] [LOCAL ] ETR: Primary data saved (53220 records). [2025-09-29T18:39:20.030347] [INFO ] [MAIN ] ETR: Full history saved. [2025-09-29T18:39:20.030446] [INFO ] [MAIN ] Update Progress: 780/2371 symbols completed. ETR took 30.0s. Estimated remaining: 3h 22m 31s. Rate: 7.9 symbols/min [2025-09-29T18:39:20.210217] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:39:20.218016] [DEBUG] [LOCAL ] ETX: Loaded 5028 existing records from primary storage. [2025-09-29T18:39:20.218225] [INFO ] [MAIN ] ETX: Loaded 5028 existing records. [2025-09-29T18:39:20.360627] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-09-29T18:39:20.406620] [WARN ] [MAIN ] ETX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:39:20.406941] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-09-29T18:39:20.407001] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-09-29T18:39:20.407231] [DEBUG] [LOCAL ] ETX: Deleted primary data file. [2025-09-29T18:39:20.407292] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-09-29T18:39:20.730782] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-29T18:39:20.827752] [INFO ] [REMOTE ] ETX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:39:20.999823] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-29T18:39:21.148065] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-09-29T18:39:21.544592] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-29T18:39:21.948114] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-09-29T18:39:22.748135] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-09-29T18:39:23.316670] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-29T18:39:23.424249] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-29T18:39:23.446943] [INFO ] [REMOTE ] ETN: Full fetch complete (76586 records). [2025-09-29T18:39:23.447327] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-09-29T18:39:23.508344] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-29T18:39:23.553315] [INFO ] [REMOTE ] ETX: Fetching primary data for 2024-12. [2025-09-29T18:39:24.109325] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-09-29T18:39:24.109468] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-09-29T18:39:24.110597] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-09-29T18:39:24.110714] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-09-29T18:39:24.112690] [DEBUG] [LOCAL ] ETN: Trimmed 76586 records to 52799 (keeping 200 days of data) [2025-09-29T18:39:24.363860] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-09-29T18:39:24.492247] [DEBUG] [LOCAL ] ETN: Primary data saved (52799 records). [2025-09-29T18:39:24.492528] [INFO ] [MAIN ] ETN: Full history saved. [2025-09-29T18:39:24.494426] [INFO ] [MAIN ] Update Progress: 781/2371 symbols completed. ETN took 40.3s. Estimated remaining: 3h 22m 17s. Rate: 7.9 symbols/min [2025-09-29T18:39:24.609454] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-29T18:39:24.687988] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:39:24.715441] [DEBUG] [LOCAL ] ETY: Loaded 23078 existing records from primary storage. [2025-09-29T18:39:24.715754] [INFO ] [MAIN ] ETY: Loaded 23078 existing records. [2025-09-29T18:39:24.907094] [WARN ] [MAIN ] ETY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:39:24.907334] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-09-29T18:39:24.907385] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-09-29T18:39:24.907834] [DEBUG] [LOCAL ] ETY: Deleted primary data file. [2025-09-29T18:39:24.907893] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-09-29T18:39:25.153260] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-01. [2025-09-29T18:39:25.292681] [INFO ] [REMOTE ] ETY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:39:25.472773] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-29T18:39:25.785568] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-29T18:39:25.948181] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-09-29T18:39:26.510335] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-29T18:39:26.748203] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-09-29T18:39:27.548148] [INFO ] [REMOTE ] ETY: Fetching primary data for 2024-12. [2025-09-29T18:39:27.783912] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-29T18:39:28.348151] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-09-29T18:39:29.110245] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-29T18:39:29.148109] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-09-29T18:39:29.335617] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-29T18:39:29.948188] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-09-29T18:39:30.401020] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-29T18:39:30.525602] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-29T18:39:30.748105] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-09-29T18:39:31.548096] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-09-29T18:39:31.887134] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-29T18:39:32.096420] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-29T18:39:32.348122] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-01. [2025-09-29T18:39:33.148110] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-09-29T18:39:33.451510] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-29T18:39:33.948114] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-09-29T18:39:34.383203] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-29T18:39:34.748103] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-09-29T18:39:35.084212] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-29T18:39:35.548121] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-09-29T18:39:35.940432] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-29T18:39:36.348129] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-09-29T18:39:36.772301] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-29T18:39:37.148140] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-09-29T18:39:37.361151] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-29T18:39:37.948063] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-09-29T18:39:38.341401] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-29T18:39:38.654228] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-29T18:39:38.748117] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-09-29T18:39:39.548103] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-09-29T18:39:39.972135] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-29T18:39:39.977331] [INFO ] [REMOTE ] ETV: Full fetch complete (31797 records). [2025-09-29T18:39:39.977503] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-09-29T18:39:40.376132] [DEBUG] [VALIDATOR ] ETV: All expected trading days are present. [2025-09-29T18:39:40.360574] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-09-29T18:39:40.377108] [DEBUG] [VALIDATOR ] ETV: Primary data validation passed. [2025-09-29T18:39:40.377882] [INFO ] [MAIN ] ETV: Fetched primary data is valid. [2025-09-29T18:39:40.377952] [DEBUG] [LOCAL ] ETV: Saving primary data. [2025-09-29T18:39:40.378947] [DEBUG] [LOCAL ] ETV: Trimmed 31797 records to 21450 (keeping 200 days of data) [2025-09-29T18:39:40.523872] [DEBUG] [LOCAL ] ETV: Primary data saved (21450 records). [2025-09-29T18:39:40.524012] [INFO ] [MAIN ] ETV: Full history saved. [2025-09-29T18:39:40.524100] [INFO ] [MAIN ] Update Progress: 782/2371 symbols completed. ETV took 30.9s. Estimated remaining: 3h 22m 26s. Rate: 7.8 symbols/min [2025-09-29T18:39:40.704338] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:39:40.725073] [DEBUG] [LOCAL ] EVC: Loaded 19415 existing records from primary storage. [2025-09-29T18:39:40.725327] [INFO ] [MAIN ] EVC: Loaded 19415 existing records. [2025-09-29T18:39:40.921974] [WARN ] [MAIN ] EVC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:39:40.931326] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-09-29T18:39:40.932504] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-29T18:39:40.931995] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-09-29T18:39:40.938757] [DEBUG] [LOCAL ] EVC: Deleted primary data file. [2025-09-29T18:39:40.939469] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-09-29T18:39:41.156131] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-09-29T18:39:41.254680] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-29T18:39:41.362187] [INFO ] [REMOTE ] EVC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:39:41.948115] [INFO ] [REMOTE ] EVC: Fetching primary data for 2024-12. [2025-09-29T18:39:42.355788] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-29T18:39:42.361077] [INFO ] [REMOTE ] ETW: Full fetch complete (36441 records). [2025-09-29T18:39:42.361190] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-09-29T18:39:42.753293] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-09-29T18:39:42.770136] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-09-29T18:39:42.770237] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-09-29T18:39:42.771129] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-09-29T18:39:42.771393] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-09-29T18:39:42.772432] [DEBUG] [LOCAL ] ETW: Trimmed 36441 records to 25073 (keeping 200 days of data) [2025-09-29T18:39:42.927380] [DEBUG] [LOCAL ] ETW: Primary data saved (25073 records). [2025-09-29T18:39:42.927575] [INFO ] [MAIN ] ETW: Full history saved. [2025-09-29T18:39:42.927754] [INFO ] [MAIN ] Update Progress: 783/2371 symbols completed. ETW took 30.4s. Estimated remaining: 3h 22m 8s. Rate: 7.9 symbols/min [2025-09-29T18:39:43.117253] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:39:43.137097] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-29T18:39:43.178693] [DEBUG] [LOCAL ] EVEX: Loaded 30549 existing records from primary storage. [2025-09-29T18:39:43.179095] [INFO ] [MAIN ] EVEX: Loaded 30549 existing records. [2025-09-29T18:39:43.379071] [WARN ] [MAIN ] EVEX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:39:43.379403] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-09-29T18:39:43.379465] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-09-29T18:39:43.380671] [DEBUG] [LOCAL ] EVEX: Deleted primary data file. [2025-09-29T18:39:43.380731] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-09-29T18:39:43.568508] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-09-29T18:39:43.769256] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:39:44.124687] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-29T18:39:44.348138] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-01. [2025-09-29T18:39:44.492796] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-29T18:39:45.148136] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-09-29T18:39:45.575541] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-29T18:39:45.636848] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-29T18:39:45.948114] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-09-29T18:39:46.700084] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-29T18:39:46.701947] [INFO ] [REMOTE ] ETX: Full fetch complete (7035 records). [2025-09-29T18:39:46.702037] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-09-29T18:39:46.753210] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-09-29T18:39:47.078727] [DEBUG] [VALIDATOR ] ETX: All expected trading days are present. [2025-09-29T18:39:47.078821] [DEBUG] [VALIDATOR ] ETX: Primary data validation passed. [2025-09-29T18:39:47.079014] [INFO ] [MAIN ] ETX: Fetched primary data is valid. [2025-09-29T18:39:47.079054] [DEBUG] [LOCAL ] ETX: Saving primary data. [2025-09-29T18:39:47.079470] [DEBUG] [LOCAL ] ETX: Trimmed 7035 records to 5023 (keeping 200 days of data) [2025-09-29T18:39:47.110695] [DEBUG] [LOCAL ] ETX: Primary data saved (5023 records). [2025-09-29T18:39:47.110806] [INFO ] [MAIN ] ETX: Full history saved. [2025-09-29T18:39:47.110890] [INFO ] [MAIN ] Update Progress: 784/2371 symbols completed. ETX took 27.1s. Estimated remaining: 3h 21m 53s. Rate: 7.9 symbols/min [2025-09-29T18:39:47.284398] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:39:47.295403] [DEBUG] [LOCAL ] EVF: Loaded 9501 existing records from primary storage. [2025-09-29T18:39:47.295626] [INFO ] [MAIN ] EVF: Loaded 9501 existing records. [2025-09-29T18:39:47.499638] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:39:47.499949] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-09-29T18:39:47.500000] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-09-29T18:39:47.500343] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-09-29T18:39:47.500410] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-09-29T18:39:47.559030] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2024-12. [2025-09-29T18:39:47.913035] [INFO ] [REMOTE ] EVF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:39:47.929285] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-29T18:39:48.348169] [INFO ] [REMOTE ] EVF: Fetching primary data for 2024-12. [2025-09-29T18:39:49.065958] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-29T18:39:49.148177] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-09-29T18:39:49.284683] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-29T18:39:49.946760] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-29T18:39:49.951158] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-01. [2025-09-29T18:39:50.591145] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-29T18:39:50.748090] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-09-29T18:39:51.548133] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-09-29T18:39:51.968603] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-29T18:39:52.137765] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-29T18:39:52.348109] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-09-29T18:39:53.148132] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-01. [2025-09-29T18:39:53.540873] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-29T18:39:53.948146] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-09-29T18:39:54.308294] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-29T18:39:54.698524] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-29T18:39:54.748079] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-09-29T18:39:55.548566] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-09-29T18:39:55.549591] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-29T18:39:56.348117] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-09-29T18:39:56.561945] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-29T18:39:57.051086] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-29T18:39:57.148124] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-09-29T18:39:57.948133] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-09-29T18:39:58.748120] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-09-29T18:39:59.548115] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-09-29T18:40:01.956852] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (4.81 seconds). [2025-09-29T18:40:01.961592] [INFO ] [REMOTE ] ETY: Full fetch complete (34101 records). [2025-09-29T18:40:01.961770] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-09-29T18:40:02.394099] [DEBUG] [VALIDATOR ] ETY: All expected trading days are present. [2025-09-29T18:40:02.394183] [DEBUG] [VALIDATOR ] ETY: Primary data validation passed. [2025-09-29T18:40:02.394810] [INFO ] [MAIN ] ETY: Fetched primary data is valid. [2025-09-29T18:40:02.394875] [DEBUG] [LOCAL ] ETY: Saving primary data. [2025-09-29T18:40:02.395801] [DEBUG] [LOCAL ] ETY: Trimmed 34101 records to 22661 (keeping 200 days of data) [2025-09-29T18:40:02.538880] [DEBUG] [LOCAL ] ETY: Primary data saved (22661 records). [2025-09-29T18:40:02.539017] [INFO ] [MAIN ] ETY: Full history saved. [2025-09-29T18:40:02.539106] [INFO ] [MAIN ] Update Progress: 785/2371 symbols completed. ETY took 38.0s. Estimated remaining: 3h 22m 2s. Rate: 7.9 symbols/min [2025-09-29T18:40:02.745498] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:40:02.758249] [DEBUG] [LOCAL ] EVG: Loaded 5862 existing records from primary storage. [2025-09-29T18:40:02.758622] [INFO ] [MAIN ] EVG: Loaded 5862 existing records. [2025-09-29T18:40:02.961696] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:40:02.962101] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-09-29T18:40:02.962193] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-09-29T18:40:02.962841] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-09-29T18:40:02.962915] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-09-29T18:40:03.392093] [INFO ] [REMOTE ] EVG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:40:03.392524] [INFO ] [REMOTE ] EVG: Fetching primary data for 2024-12. [2025-09-29T18:40:06.380277] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (8.43 seconds). [2025-09-29T18:40:06.383125] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-09-29T18:40:06.926527] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (7.38 seconds). [2025-09-29T18:40:06.932097] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-09-29T18:40:07.858061] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (9.11 seconds). [2025-09-29T18:40:07.866773] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-09-29T18:40:10.205970] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2024-12 (6.81 seconds). [2025-09-29T18:40:10.207921] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-01. [2025-09-29T18:40:11.196988] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (4.81 seconds). [2025-09-29T18:40:11.200828] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-09-29T18:40:12.280341] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (4.41 seconds). [2025-09-29T18:40:12.285722] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-09-29T18:40:12.503948] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-29T18:40:12.506875] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-09-29T18:40:13.072618] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-01 (2.86 seconds). [2025-09-29T18:40:13.074624] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-09-29T18:40:13.133571] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (6.20 seconds). [2025-09-29T18:40:13.139965] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-09-29T18:40:13.749090] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-29T18:40:13.753557] [INFO ] [REMOTE ] EVF: Full fetch complete (12132 records). [2025-09-29T18:40:13.753703] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-09-29T18:40:13.963958] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-29T18:40:13.997296] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-09-29T18:40:14.202316] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-29T18:40:14.241080] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-09-29T18:40:14.325564] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-29T18:40:14.368929] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-09-29T18:40:14.457949] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-29T18:40:14.458466] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-09-29T18:40:14.458628] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-09-29T18:40:14.461838] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-09-29T18:40:14.463349] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-09-29T18:40:14.463491] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-09-29T18:40:14.464616] [DEBUG] [LOCAL ] EVF: Trimmed 12132 records to 9377 (keeping 200 days of data) [2025-09-29T18:40:14.530130] [DEBUG] [LOCAL ] EVF: Primary data saved (9377 records). [2025-09-29T18:40:14.530299] [INFO ] [MAIN ] EVF: Full history saved. [2025-09-29T18:40:14.530416] [INFO ] [MAIN ] Update Progress: 786/2371 symbols completed. EVF took 27.4s. Estimated remaining: 3h 22m 3s. Rate: 7.8 symbols/min [2025-09-29T18:40:14.718311] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:40:14.770132] [DEBUG] [LOCAL ] EVH: Loaded 50111 existing records from primary storage. [2025-09-29T18:40:14.770566] [INFO ] [MAIN ] EVH: Loaded 50111 existing records. [2025-09-29T18:40:14.981608] [WARN ] [MAIN ] EVH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:40:14.981945] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-09-29T18:40:14.982155] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-09-29T18:40:14.983183] [DEBUG] [LOCAL ] EVH: Deleted primary data file. [2025-09-29T18:40:14.983253] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-09-29T18:40:15.102873] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-29T18:40:15.111423] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-09-29T18:40:15.397614] [INFO ] [REMOTE ] EVH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:40:15.398262] [INFO ] [REMOTE ] EVH: Fetching primary data for 2024-12. [2025-09-29T18:40:15.551501] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-29T18:40:15.557347] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-09-29T18:40:16.075724] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-29T18:40:16.079473] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-09-29T18:40:16.372590] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-29T18:40:16.379307] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-09-29T18:40:16.589831] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-29T18:40:16.594746] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-09-29T18:40:16.733745] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-29T18:40:16.735913] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-09-29T18:40:17.038386] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-29T18:40:17.148110] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-01. [2025-09-29T18:40:17.345401] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-29T18:40:17.842456] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-29T18:40:17.846440] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-29T18:40:17.948138] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-09-29T18:40:18.748085] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-09-29T18:40:19.072632] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-29T18:40:19.076363] [INFO ] [REMOTE ] EVC: Full fetch complete (30613 records). [2025-09-29T18:40:19.076479] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-09-29T18:40:19.077064] [FATAL] [VALIDATOR ] EVC: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:40:19.077171] [FATAL] [MAIN ] EVC: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:40:19.077239] [WARN ] [MAIN ] EVC: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:40:19.077314] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-09-29T18:40:19.077383] [DEBUG] [LOCAL ] EVC: No primary data file found to delete. [2025-09-29T18:40:19.077460] [INFO ] [LOCAL ] EVC: Starting deletion of derivative data. [2025-09-29T18:40:19.081581] [DEBUG] [LOCAL ] EVC: Deleted derivative data file. [2025-09-29T18:40:19.081767] [INFO ] [MAIN ] Update Progress: 787/2371 symbols completed. EVC took 38.6s. Estimated remaining: 3h 21m 49s. Rate: 7.8 symbols/min [2025-09-29T18:40:19.269438] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:40:19.284608] [DEBUG] [LOCAL ] EVN: Loaded 11217 existing records from primary storage. [2025-09-29T18:40:19.284907] [INFO ] [MAIN ] EVN: Loaded 11217 existing records. [2025-09-29T18:40:19.480990] [WARN ] [MAIN ] EVN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:40:19.481270] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-09-29T18:40:19.481403] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-09-29T18:40:19.482181] [DEBUG] [LOCAL ] EVN: Deleted primary data file. [2025-09-29T18:40:19.493611] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-09-29T18:40:19.553195] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-09-29T18:40:19.591188] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-09-29T18:40:19.931202] [INFO ] [REMOTE ] EVN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:40:20.348134] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-09-29T18:40:20.720820] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-29T18:40:21.100301] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-29T18:40:21.148122] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-09-29T18:40:21.948162] [INFO ] [REMOTE ] EVN: Fetching primary data for 2024-12. [2025-09-29T18:40:22.748126] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-09-29T18:40:22.831619] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-29T18:40:23.156318] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (2.81 seconds). [2025-09-29T18:40:23.276752] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-29T18:40:23.548110] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-09-29T18:40:24.348083] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-09-29T18:40:24.423772] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-29T18:40:24.425890] [INFO ] [REMOTE ] EVG: Full fetch complete (8023 records). [2025-09-29T18:40:24.426031] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-09-29T18:40:24.426618] [FATAL] [VALIDATOR ] EVG: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:40:24.426902] [FATAL] [MAIN ] EVG: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:40:24.439921] [WARN ] [MAIN ] EVG: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:40:24.463346] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-09-29T18:40:24.463467] [DEBUG] [LOCAL ] EVG: No primary data file found to delete. [2025-09-29T18:40:24.463812] [INFO ] [LOCAL ] EVG: Starting deletion of derivative data. [2025-09-29T18:40:24.466223] [DEBUG] [LOCAL ] EVG: Deleted derivative data file. [2025-09-29T18:40:24.466167] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-29T18:40:24.466580] [INFO ] [MAIN ] Update Progress: 788/2371 symbols completed. EVG took 21.9s. Estimated remaining: 3h 21m 37s. Rate: 7.9 symbols/min [2025-09-29T18:40:24.513955] [INFO ] [REMOTE ] EVEX: Full fetch complete (41385 records). [2025-09-29T18:40:24.569956] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-09-29T18:40:24.621873] [FATAL] [VALIDATOR ] EVEX: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:40:24.652929] [FATAL] [MAIN ] EVEX: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:40:24.669991] [WARN ] [MAIN ] EVEX: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:40:24.690519] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:40:24.690741] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-09-29T18:40:24.691184] [DEBUG] [LOCAL ] EVEX: No primary data file found to delete. [2025-09-29T18:40:24.691313] [INFO ] [LOCAL ] EVEX: Starting deletion of derivative data. [2025-09-29T18:40:24.692095] [DEBUG] [LOCAL ] EVEX: Deleted derivative data file. [2025-09-29T18:40:24.692231] [INFO ] [MAIN ] Update Progress: 789/2371 symbols completed. EVEX took 41.8s. Estimated remaining: 3h 21m 14s. Rate: 7.9 symbols/min [2025-09-29T18:40:24.914569] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:40:24.927366] [DEBUG] [LOCAL ] EVR: Loaded 35882 existing records from primary storage. [2025-09-29T18:40:24.927911] [INFO ] [MAIN ] EVR: Loaded 35882 existing records. [2025-09-29T18:40:25.067598] [DEBUG] [LOCAL ] EVT: Loaded 17270 existing records from primary storage. [2025-09-29T18:40:25.083299] [INFO ] [MAIN ] EVT: Loaded 17270 existing records. [2025-09-29T18:40:25.151511] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-01. [2025-09-29T18:40:25.206972] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:40:25.240539] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-09-29T18:40:25.256364] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-09-29T18:40:25.266387] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-09-29T18:40:25.276744] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-09-29T18:40:25.440209] [WARN ] [MAIN ] EVT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:40:25.467349] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-09-29T18:40:25.467469] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-09-29T18:40:25.484123] [DEBUG] [LOCAL ] EVT: Deleted primary data file. [2025-09-29T18:40:25.484266] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-09-29T18:40:26.035202] [INFO ] [REMOTE ] EVR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:40:26.079782] [INFO ] [REMOTE ] EVR: Fetching primary data for 2024-12. [2025-09-29T18:40:26.209831] [INFO ] [REMOTE ] EVT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:40:26.244797] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-29T18:40:26.272082] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-29T18:40:26.748120] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-09-29T18:40:27.410709] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-29T18:40:27.548129] [INFO ] [REMOTE ] EVT: Fetching primary data for 2024-12. [2025-09-29T18:40:28.348163] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-09-29T18:40:28.516288] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-29T18:40:28.648991] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-29T18:40:29.148121] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-09-29T18:40:29.179160] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-29T18:40:29.948148] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-09-29T18:40:30.723530] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-29T18:40:30.748067] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-09-29T18:40:30.854482] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-29T18:40:31.548151] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-01. [2025-09-29T18:40:32.242283] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-29T18:40:32.348116] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-09-29T18:40:33.063745] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-29T18:40:33.084123] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-29T18:40:33.148112] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-09-29T18:40:33.948115] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-09-29T18:40:34.600351] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-29T18:40:34.748110] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-09-29T18:40:35.548080] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-01. [2025-09-29T18:40:35.658762] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-29T18:40:36.301288] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-29T18:40:36.348117] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-09-29T18:40:36.626367] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-29T18:40:37.148121] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-09-29T18:40:37.175477] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-29T18:40:37.948123] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-09-29T18:40:38.735851] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-29T18:40:38.748081] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-09-29T18:40:39.065428] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-29T18:40:39.548155] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-09-29T18:40:39.563125] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-29T18:40:40.348121] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-09-29T18:40:40.697024] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-29T18:40:41.148141] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-09-29T18:40:41.319424] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-29T18:40:41.948126] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-09-29T18:40:42.748115] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-09-29T18:40:42.898217] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-29T18:40:42.897862] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-29T18:40:42.911808] [INFO ] [REMOTE ] EVN: Full fetch complete (17617 records). [2025-09-29T18:40:42.912473] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-09-29T18:40:43.308700] [DEBUG] [VALIDATOR ] EVN: All expected trading days are present. [2025-09-29T18:40:43.308797] [DEBUG] [VALIDATOR ] EVN: Primary data validation passed. [2025-09-29T18:40:43.309206] [INFO ] [MAIN ] EVN: Fetched primary data is valid. [2025-09-29T18:40:43.309248] [DEBUG] [LOCAL ] EVN: Saving primary data. [2025-09-29T18:40:43.309880] [DEBUG] [LOCAL ] EVN: Trimmed 17617 records to 11135 (keeping 200 days of data) [2025-09-29T18:40:43.385338] [DEBUG] [LOCAL ] EVN: Primary data saved (11135 records). [2025-09-29T18:40:43.385488] [INFO ] [MAIN ] EVN: Full history saved. [2025-09-29T18:40:43.385605] [INFO ] [MAIN ] Update Progress: 790/2371 symbols completed. EVN took 24.3s. Estimated remaining: 3h 21m 29s. Rate: 7.8 symbols/min [2025-09-29T18:40:43.553755] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-09-29T18:40:43.584466] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:40:43.600702] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-29T18:40:43.641444] [DEBUG] [LOCAL ] EVTC: Loaded 26745 existing records from primary storage. [2025-09-29T18:40:43.641768] [INFO ] [MAIN ] EVTC: Loaded 26745 existing records. [2025-09-29T18:40:43.832635] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:40:43.832892] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-09-29T18:40:43.832951] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-09-29T18:40:43.833423] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-09-29T18:40:43.833484] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-09-29T18:40:44.286089] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:40:44.348140] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-09-29T18:40:45.148088] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2024-12. [2025-09-29T18:40:45.470734] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-29T18:40:45.504073] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-29T18:40:45.503072] [INFO ] [REMOTE ] EVH: Full fetch complete (71793 records). [2025-09-29T18:40:45.510912] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-09-29T18:40:45.934250] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-09-29T18:40:45.934341] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-09-29T18:40:45.935368] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-09-29T18:40:45.935438] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-09-29T18:40:45.937019] [DEBUG] [LOCAL ] EVH: Trimmed 71793 records to 49370 (keeping 200 days of data) [2025-09-29T18:40:45.988370] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-09-29T18:40:46.240959] [DEBUG] [LOCAL ] EVH: Primary data saved (49370 records). [2025-09-29T18:40:46.241112] [INFO ] [MAIN ] EVH: Full history saved. [2025-09-29T18:40:46.241202] [INFO ] [MAIN ] Update Progress: 791/2371 symbols completed. EVH took 31.7s. Estimated remaining: 3h 21m 11s. Rate: 7.9 symbols/min [2025-09-29T18:40:46.428853] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:40:46.473772] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-29T18:40:46.504200] [DEBUG] [LOCAL ] EVTL: Loaded 38140 existing records from primary storage. [2025-09-29T18:40:46.505124] [INFO ] [MAIN ] EVTL: Loaded 38140 existing records. [2025-09-29T18:40:46.722939] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:40:46.723181] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-09-29T18:40:46.723233] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-09-29T18:40:46.723903] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-09-29T18:40:46.724208] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-09-29T18:40:46.748715] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-09-29T18:40:47.117218] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:40:47.137149] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-29T18:40:47.548146] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2024-12. [2025-09-29T18:40:48.215094] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-29T18:40:48.348121] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-09-29T18:40:48.788067] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-29T18:40:49.148168] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-09-29T18:40:49.414559] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-29T18:40:49.948201] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-09-29T18:40:50.571562] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-29T18:40:50.748144] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-09-29T18:40:51.069531] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-29T18:40:51.548132] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-09-29T18:40:51.760826] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-29T18:40:52.348124] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-09-29T18:40:52.622096] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-29T18:40:53.148118] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-09-29T18:40:53.948124] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-09-29T18:40:54.070822] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-29T18:40:54.225318] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-29T18:40:54.229912] [INFO ] [REMOTE ] EVT: Full fetch complete (25278 records). [2025-09-29T18:40:54.230824] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-09-29T18:40:54.630426] [DEBUG] [VALIDATOR ] EVT: All expected trading days are present. [2025-09-29T18:40:54.630574] [DEBUG] [VALIDATOR ] EVT: Primary data validation passed. [2025-09-29T18:40:54.631230] [INFO ] [MAIN ] EVT: Fetched primary data is valid. [2025-09-29T18:40:54.631299] [DEBUG] [LOCAL ] EVT: Saving primary data. [2025-09-29T18:40:54.634002] [DEBUG] [LOCAL ] EVT: Trimmed 25278 records to 16958 (keeping 200 days of data) [2025-09-29T18:40:54.747394] [DEBUG] [LOCAL ] EVT: Primary data saved (16958 records). [2025-09-29T18:40:54.747583] [INFO ] [MAIN ] EVT: Full history saved. [2025-09-29T18:40:54.747697] [INFO ] [MAIN ] Update Progress: 792/2371 symbols completed. EVT took 30.1s. Estimated remaining: 3h 21m 5s. Rate: 7.9 symbols/min [2025-09-29T18:40:54.759235] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-09-29T18:40:55.052177] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:40:55.084249] [DEBUG] [LOCAL ] EVTR: Loaded 23675 existing records from primary storage. [2025-09-29T18:40:55.084955] [INFO ] [MAIN ] EVTR: Loaded 23675 existing records. [2025-09-29T18:40:55.279290] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:40:55.302171] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-09-29T18:40:55.302560] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-09-29T18:40:55.305019] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-09-29T18:40:55.304921] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-29T18:40:55.305295] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-09-29T18:40:55.554636] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-09-29T18:40:55.739943] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:40:56.348102] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2024-12. [2025-09-29T18:40:56.460407] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-29T18:40:57.148107] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-09-29T18:40:57.219397] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-29T18:40:57.508412] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-29T18:40:57.948115] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-09-29T18:40:58.723203] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-29T18:40:58.748109] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-09-29T18:40:59.250993] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-29T18:40:59.548115] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-09-29T18:40:59.936376] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-29T18:41:00.348124] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-01. [2025-09-29T18:41:00.794340] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-29T18:41:01.148085] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-09-29T18:41:01.396184] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-29T18:41:01.948120] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-09-29T18:41:02.748097] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-09-29T18:41:02.830832] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-29T18:41:02.839127] [INFO ] [REMOTE ] EVR: Full fetch complete (50709 records). [2025-09-29T18:41:02.839334] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-09-29T18:41:03.161072] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-29T18:41:03.269743] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-09-29T18:41:03.269842] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-09-29T18:41:03.270698] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-09-29T18:41:03.270777] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-09-29T18:41:03.271997] [DEBUG] [LOCAL ] EVR: Trimmed 50709 records to 35058 (keeping 200 days of data) [2025-09-29T18:41:03.512943] [DEBUG] [LOCAL ] EVR: Primary data saved (35058 records). [2025-09-29T18:41:03.513094] [INFO ] [MAIN ] EVR: Full history saved. [2025-09-29T18:41:03.514211] [INFO ] [MAIN ] Update Progress: 793/2371 symbols completed. EVR took 39.0s. Estimated remaining: 3h 21m 0s. Rate: 7.9 symbols/min [2025-09-29T18:41:03.549059] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-09-29T18:41:03.706807] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:41:03.769564] [DEBUG] [LOCAL ] EW: Loaded 54176 existing records from primary storage. [2025-09-29T18:41:03.770101] [INFO ] [MAIN ] EW: Loaded 54176 existing records. [2025-09-29T18:41:03.955195] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:41:03.955753] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-09-29T18:41:03.955871] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-09-29T18:41:03.956751] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-09-29T18:41:03.956838] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-09-29T18:41:04.076387] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-29T18:41:04.342275] [INFO ] [REMOTE ] EW: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:41:04.348090] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-09-29T18:41:04.649610] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-29T18:41:05.148160] [INFO ] [REMOTE ] EW: Fetching primary data for 2024-12. [2025-09-29T18:41:05.374344] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-29T18:41:05.948161] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-09-29T18:41:06.748141] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-09-29T18:41:07.075727] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-29T18:41:07.124972] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-29T18:41:07.548175] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-09-29T18:41:08.309272] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-29T18:41:08.348102] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-09-29T18:41:08.668234] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-29T18:41:09.148191] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-09-29T18:41:09.948161] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-09-29T18:41:10.058033] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-29T18:41:10.354075] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-29T18:41:10.748109] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-09-29T18:41:11.221432] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-29T18:41:11.548191] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-01. [2025-09-29T18:41:11.853038] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-29T18:41:12.348215] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-09-29T18:41:13.148124] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-09-29T18:41:13.262241] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-29T18:41:13.600809] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-29T18:41:13.948105] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-09-29T18:41:14.748085] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-09-29T18:41:15.229501] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-29T18:41:15.352370] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-29T18:41:15.548109] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-09-29T18:41:16.348092] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-09-29T18:41:16.455697] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-29T18:41:16.852564] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-29T18:41:16.859349] [INFO ] [REMOTE ] EVTC: Full fetch complete (37841 records). [2025-09-29T18:41:16.859477] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-09-29T18:41:17.152316] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-09-29T18:41:17.336613] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-09-29T18:41:17.336768] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-09-29T18:41:17.337679] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-09-29T18:41:17.337766] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-09-29T18:41:17.355935] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-29T18:41:17.363515] [DEBUG] [LOCAL ] EVTC: Trimmed 37841 records to 26254 (keeping 200 days of data) [2025-09-29T18:41:17.539091] [DEBUG] [LOCAL ] EVTC: Primary data saved (26254 records). [2025-09-29T18:41:17.539273] [INFO ] [MAIN ] EVTC: Full history saved. [2025-09-29T18:41:17.539383] [INFO ] [MAIN ] Update Progress: 794/2371 symbols completed. EVTC took 34.2s. Estimated remaining: 3h 21m 5s. Rate: 7.8 symbols/min [2025-09-29T18:41:17.718458] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:41:17.768000] [DEBUG] [LOCAL ] EXG: Loaded 34725 existing records from primary storage. [2025-09-29T18:41:17.768323] [INFO ] [MAIN ] EXG: Loaded 34725 existing records. [2025-09-29T18:41:17.951840] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-09-29T18:41:17.951709] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:41:17.953482] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-09-29T18:41:17.953550] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-09-29T18:41:17.954122] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-09-29T18:41:17.954285] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-09-29T18:41:18.329444] [INFO ] [REMOTE ] EXG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:41:18.748125] [INFO ] [REMOTE ] EXG: Fetching primary data for 2024-12. [2025-09-29T18:41:18.981828] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-29T18:41:19.548139] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-09-29T18:41:19.949048] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-29T18:41:20.348189] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-09-29T18:41:20.431206] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-29T18:41:21.148171] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-01. [2025-09-29T18:41:21.708089] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-29T18:41:21.721131] [INFO ] [REMOTE ] EVTL: Full fetch complete (51258 records). [2025-09-29T18:41:21.721557] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-09-29T18:41:21.957108] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-09-29T18:41:22.169125] [DEBUG] [VALIDATOR ] EVTL: All expected trading days are present. [2025-09-29T18:41:22.169238] [DEBUG] [VALIDATOR ] EVTL: Primary data validation passed. [2025-09-29T18:41:22.170135] [INFO ] [MAIN ] EVTL: Fetched primary data is valid. [2025-09-29T18:41:22.170286] [DEBUG] [LOCAL ] EVTL: Saving primary data. [2025-09-29T18:41:22.171581] [DEBUG] [LOCAL ] EVTL: Trimmed 51258 records to 37802 (keeping 200 days of data) [2025-09-29T18:41:22.302906] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-29T18:41:22.438167] [DEBUG] [LOCAL ] EVTL: Primary data saved (37802 records). [2025-09-29T18:41:22.438335] [INFO ] [MAIN ] EVTL: Full history saved. [2025-09-29T18:41:22.438456] [INFO ] [MAIN ] Update Progress: 795/2371 symbols completed. EVTL took 36.2s. Estimated remaining: 3h 20m 52s. Rate: 7.8 symbols/min [2025-09-29T18:41:22.568589] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-29T18:41:22.655158] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:41:22.718360] [DEBUG] [LOCAL ] EXK: Loaded 53904 existing records from primary storage. [2025-09-29T18:41:22.718754] [INFO ] [MAIN ] EXK: Loaded 53904 existing records. [2025-09-29T18:41:22.753273] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-09-29T18:41:22.922347] [WARN ] [MAIN ] EXK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:41:22.922562] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-09-29T18:41:22.922664] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-09-29T18:41:22.923356] [DEBUG] [LOCAL ] EXK: Deleted primary data file. [2025-09-29T18:41:22.923418] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-09-29T18:41:23.307740] [INFO ] [REMOTE ] EXK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:41:23.548100] [INFO ] [REMOTE ] EXK: Fetching primary data for 2024-12. [2025-09-29T18:41:23.697362] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-29T18:41:23.704502] [INFO ] [REMOTE ] EVTR: Full fetch complete (32185 records). [2025-09-29T18:41:23.704603] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-09-29T18:41:24.106993] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-09-29T18:41:24.107107] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-09-29T18:41:24.107948] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-09-29T18:41:24.108032] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-09-29T18:41:24.109150] [DEBUG] [LOCAL ] EVTR: Trimmed 32185 records to 23510 (keeping 200 days of data) [2025-09-29T18:41:24.223153] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-29T18:41:24.288063] [DEBUG] [LOCAL ] EVTR: Primary data saved (23510 records). [2025-09-29T18:41:24.288197] [INFO ] [MAIN ] EVTR: Full history saved. [2025-09-29T18:41:24.288294] [INFO ] [MAIN ] Update Progress: 796/2371 symbols completed. EVTR took 29.5s. Estimated remaining: 3h 20m 33s. Rate: 7.9 symbols/min [2025-09-29T18:41:24.358144] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-09-29T18:41:24.470341] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:41:24.505687] [DEBUG] [LOCAL ] EXP: Loaded 30275 existing records from primary storage. [2025-09-29T18:41:24.506016] [INFO ] [MAIN ] EXP: Loaded 30275 existing records. [2025-09-29T18:41:24.695969] [WARN ] [MAIN ] EXP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:41:24.696191] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-09-29T18:41:24.696241] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-09-29T18:41:24.696674] [DEBUG] [LOCAL ] EXP: Deleted primary data file. [2025-09-29T18:41:24.696735] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-09-29T18:41:25.083008] [INFO ] [REMOTE ] EXP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:41:25.148120] [INFO ] [REMOTE ] EXP: Fetching primary data for 2024-12. [2025-09-29T18:41:25.387231] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-29T18:41:25.948206] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-01. [2025-09-29T18:41:26.357200] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-29T18:41:26.483268] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-29T18:41:26.748109] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-09-29T18:41:27.548133] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-01. [2025-09-29T18:41:27.709265] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-29T18:41:28.177599] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-29T18:41:28.348160] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-09-29T18:41:28.556787] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-29T18:41:29.148136] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-09-29T18:41:29.948099] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-09-29T18:41:30.137937] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-29T18:41:30.680995] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-29T18:41:30.748116] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-09-29T18:41:31.334877] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-29T18:41:31.548182] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-09-29T18:41:32.061048] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-29T18:41:32.348098] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-09-29T18:41:33.148184] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-09-29T18:41:33.220807] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-29T18:41:33.529576] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-29T18:41:33.948142] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-09-29T18:41:34.748097] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-09-29T18:41:35.036068] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-29T18:41:35.364306] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-29T18:41:35.548125] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-09-29T18:41:36.348115] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-09-29T18:41:36.602208] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-29T18:41:36.903803] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-29T18:41:37.148115] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-09-29T18:41:37.307065] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-29T18:41:37.948155] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-09-29T18:41:38.310770] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-29T18:41:38.748128] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-09-29T18:41:39.548131] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-09-29T18:41:40.037453] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-29T18:41:40.108781] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-29T18:41:40.348152] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-09-29T18:41:41.148106] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-09-29T18:41:41.206697] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-29T18:41:41.948092] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-09-29T18:41:42.177378] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-29T18:41:42.668223] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-29T18:41:42.748086] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-09-29T18:41:43.548119] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-09-29T18:41:43.816113] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-29T18:41:43.827425] [INFO ] [REMOTE ] EW: Full fetch complete (77348 records). [2025-09-29T18:41:43.827574] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-09-29T18:41:44.240909] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-09-29T18:41:44.241003] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-09-29T18:41:44.242118] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-09-29T18:41:44.242208] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-09-29T18:41:44.243862] [DEBUG] [LOCAL ] EW: Trimmed 77348 records to 53397 (keeping 200 days of data) [2025-09-29T18:41:44.348333] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-09-29T18:41:44.585199] [DEBUG] [LOCAL ] EW: Primary data saved (53397 records). [2025-09-29T18:41:44.585326] [INFO ] [MAIN ] EW: Full history saved. [2025-09-29T18:41:44.585430] [INFO ] [MAIN ] Update Progress: 797/2371 symbols completed. EW took 41.1s. Estimated remaining: 3h 20m 50s. Rate: 7.8 symbols/min [2025-09-29T18:41:44.779163] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-29T18:41:44.927271] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-29T18:41:45.148134] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-09-29T18:41:45.831729] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-29T18:41:45.948120] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-09-29T18:41:46.514036] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-29T18:41:46.521537] [INFO ] [REMOTE ] EXG: Full fetch complete (49947 records). [2025-09-29T18:41:46.521713] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-09-29T18:41:46.767218] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-09-29T18:41:46.938336] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-09-29T18:41:46.938427] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-09-29T18:41:46.939198] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-09-29T18:41:46.939265] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-09-29T18:41:46.940712] [DEBUG] [LOCAL ] EXG: Trimmed 49947 records to 34119 (keeping 200 days of data) [2025-09-29T18:41:47.170024] [DEBUG] [LOCAL ] EXG: Primary data saved (34119 records). [2025-09-29T18:41:47.170171] [INFO ] [MAIN ] EXG: Full history saved. [2025-09-29T18:41:47.170289] [INFO ] [MAIN ] Update Progress: 798/2371 symbols completed. EXG took 29.6s. Estimated remaining: 3h 20m 33s. Rate: 7.8 symbols/min [2025-09-29T18:41:47.308188] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-29T18:41:47.548181] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-09-29T18:41:48.536616] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-29T18:41:48.549977] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-09-29T18:41:48.876162] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-29T18:41:48.881996] [INFO ] [REMOTE ] EXP: Full fetch complete (42981 records). [2025-09-29T18:41:48.882095] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-09-29T18:41:49.286671] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-09-29T18:41:49.286771] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-09-29T18:41:49.287623] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-09-29T18:41:49.287721] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-09-29T18:41:49.289198] [DEBUG] [LOCAL ] EXP: Trimmed 42981 records to 29703 (keeping 200 days of data) [2025-09-29T18:41:49.482394] [DEBUG] [LOCAL ] EXP: Primary data saved (29703 records). [2025-09-29T18:41:49.482587] [INFO ] [MAIN ] EXP: Full history saved. [2025-09-29T18:41:49.482704] [INFO ] [MAIN ] Update Progress: 799/2371 symbols completed. EXP took 25.2s. Estimated remaining: 3h 20m 14s. Rate: 7.9 symbols/min [2025-09-29T18:41:50.399472] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-29T18:41:50.410829] [INFO ] [REMOTE ] EXK: Full fetch complete (76503 records). [2025-09-29T18:41:50.410992] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-09-29T18:41:50.835931] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present. [2025-09-29T18:41:50.836033] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed. [2025-09-29T18:41:50.837101] [INFO ] [MAIN ] EXK: Fetched primary data is valid. [2025-09-29T18:41:50.837171] [DEBUG] [LOCAL ] EXK: Saving primary data. [2025-09-29T18:41:50.838860] [DEBUG] [LOCAL ] EXK: Trimmed 76503 records to 53126 (keeping 200 days of data) [2025-09-29T18:41:51.159823] [DEBUG] [LOCAL ] EXK: Primary data saved (53126 records). [2025-09-29T18:41:51.160073] [INFO ] [MAIN ] EXK: Full history saved. [2025-09-29T18:41:51.160247] [INFO ] [MAIN ] Update Progress: 800/2371 symbols completed. EXK took 28.7s. Estimated remaining: 3h 19m 55s. Rate: 7.9 symbols/min [2025-09-29T18:41:51.714724] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:41:51.840584] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:41:51.885497] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:41:51.923838] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:41:52.032195] [DEBUG] [LOCAL ] EXR: Loaded 46080 existing records from primary storage. [2025-09-29T18:41:52.032889] [INFO ] [MAIN ] EXR: Loaded 46080 existing records. [2025-09-29T18:41:52.038803] [DEBUG] [LOCAL ] FAF: Loaded 42474 existing records from primary storage. [2025-09-29T18:41:52.078171] [INFO ] [MAIN ] FAF: Loaded 42474 existing records. [2025-09-29T18:41:52.151273] [DEBUG] [LOCAL ] EXPD: Loaded 48786 existing records from primary storage. [2025-09-29T18:41:52.204690] [INFO ] [MAIN ] EXPD: Loaded 48786 existing records. [2025-09-29T18:41:52.278281] [DEBUG] [LOCAL ] F: Loaded 54600 existing records from primary storage. [2025-09-29T18:41:52.299353] [INFO ] [MAIN ] F: Loaded 54600 existing records. [2025-09-29T18:41:52.643527] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:41:52.724764] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:41:52.721169] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-09-29T18:41:52.748312] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-09-29T18:41:52.748408] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-09-29T18:41:52.799615] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-09-29T18:41:52.838983] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-09-29T18:41:52.811691] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-09-29T18:41:52.869594] [WARN ] [MAIN ] EXPD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:41:52.848182] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-09-29T18:41:52.848032] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:41:52.869985] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-09-29T18:41:52.882162] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-09-29T18:41:52.882080] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-09-29T18:41:52.901730] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-09-29T18:41:52.870254] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-09-29T18:41:52.901577] [DEBUG] [LOCAL ] EXPD: Deleted primary data file. [2025-09-29T18:41:52.940937] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-09-29T18:41:52.963088] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-09-29T18:41:53.051357] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-09-29T18:41:54.258049] [INFO ] [REMOTE ] EXR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:41:54.284589] [INFO ] [REMOTE ] EXR: Fetching primary data for 2024-12. [2025-09-29T18:41:54.457417] [INFO ] [REMOTE ] FAF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:41:54.478460] [INFO ] [REMOTE ] FAF: Fetching primary data for 2024-12. [2025-09-29T18:41:54.536820] [INFO ] [REMOTE ] F: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:41:54.551546] [INFO ] [REMOTE ] F: Fetching primary data for 2024-12. [2025-09-29T18:41:54.551128] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:41:54.552866] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2024-12. [2025-09-29T18:41:55.876108] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-29T18:41:55.883762] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-01. [2025-09-29T18:41:56.224142] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-29T18:41:56.233876] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-01. [2025-09-29T18:41:56.354101] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-29T18:41:56.364584] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-01. [2025-09-29T18:41:56.522510] [INFO ] [REMOTE ] F: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-29T18:41:56.534312] [INFO ] [REMOTE ] F: Fetching primary data for 2025-01. [2025-09-29T18:41:57.215773] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-29T18:41:57.223571] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-09-29T18:41:57.427799] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-29T18:41:57.437968] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-09-29T18:41:58.037829] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-29T18:41:58.047532] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-09-29T18:41:58.754398] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-29T18:41:58.762482] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-09-29T18:41:58.941577] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-29T18:41:58.955686] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-09-29T18:41:59.088141] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-01 (2.55 seconds). [2025-09-29T18:41:59.548118] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-09-29T18:41:59.732713] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-29T18:42:00.000745] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-29T18:42:00.348118] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-09-29T18:42:00.646631] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-29T18:42:01.148108] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-09-29T18:42:01.948144] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-09-29T18:42:02.007019] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-09-29T18:42:02.089698] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-29T18:42:02.748150] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-09-29T18:42:02.996963] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-29T18:42:03.548136] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-09-29T18:42:03.718089] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-29T18:42:04.348101] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-09-29T18:42:05.148229] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-09-29T18:42:05.373128] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-29T18:42:05.722103] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (2.97 seconds). [2025-09-29T18:42:05.934168] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-29T18:42:05.948060] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-09-29T18:42:06.748129] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-09-29T18:42:06.827409] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-29T18:42:07.458486] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-29T18:42:07.548166] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-09-29T18:42:08.348166] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-09-29T18:42:09.148121] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-09-29T18:42:09.439201] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-29T18:42:09.486345] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.74 seconds). [2025-09-29T18:42:09.948868] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-09-29T18:42:09.955068] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-29T18:42:10.577683] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-29T18:42:10.748119] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-09-29T18:42:11.526814] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-29T18:42:11.548104] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-09-29T18:42:12.348097] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-09-29T18:42:13.148127] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-09-29T18:42:13.237168] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-29T18:42:13.367615] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (2.62 seconds). [2025-09-29T18:42:13.662631] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-29T18:42:13.948123] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-09-29T18:42:14.640748] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-29T18:42:14.748129] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-09-29T18:42:15.548130] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-09-29T18:42:16.348107] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-09-29T18:42:16.433213] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.49 seconds). [2025-09-29T18:42:16.521305] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-29T18:42:17.148123] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-09-29T18:42:17.277794] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-29T18:42:17.286449] [INFO ] [REMOTE ] FAF: Full fetch complete (57628 records). [2025-09-29T18:42:17.286610] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-09-29T18:42:17.702576] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-09-29T18:42:17.702727] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-09-29T18:42:17.703820] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-09-29T18:42:17.703921] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-09-29T18:42:17.705588] [DEBUG] [LOCAL ] FAF: Trimmed 57628 records to 41799 (keeping 200 days of data) [2025-09-29T18:42:17.841884] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-29T18:42:17.951804] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-09-29T18:42:18.041610] [DEBUG] [LOCAL ] FAF: Primary data saved (41799 records). [2025-09-29T18:42:18.041803] [INFO ] [MAIN ] FAF: Full history saved. [2025-09-29T18:42:18.041919] [INFO ] [MAIN ] Update Progress: 801/2371 symbols completed. FAF took 26.8s. Estimated remaining: 3h 20m 25s. Rate: 7.8 symbols/min [2025-09-29T18:42:18.303299] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:42:18.431721] [DEBUG] [LOCAL ] FBIN: Loaded 51061 existing records from primary storage. [2025-09-29T18:42:18.432375] [INFO ] [MAIN ] FBIN: Loaded 51061 existing records. [2025-09-29T18:42:18.754426] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:42:18.754815] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-09-29T18:42:18.755612] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-09-29T18:42:18.757316] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-09-29T18:42:18.759044] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-09-29T18:42:18.759151] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-09-29T18:42:18.970559] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-29T18:42:19.037107] [INFO ] [REMOTE ] EXR: Full fetch complete (65921 records). [2025-09-29T18:42:19.038828] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-09-29T18:42:19.428390] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:42:19.556730] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2024-12. [2025-09-29T18:42:19.713149] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-09-29T18:42:19.713347] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-09-29T18:42:19.714339] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-09-29T18:42:19.714407] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-09-29T18:42:19.717090] [DEBUG] [LOCAL ] EXR: Trimmed 65921 records to 45310 (keeping 200 days of data) [2025-09-29T18:42:19.996706] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-29T18:42:20.012462] [INFO ] [REMOTE ] EXPD: Full fetch complete (69266 records). [2025-09-29T18:42:20.013131] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-09-29T18:42:20.461771] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-09-29T18:42:20.462493] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-09-29T18:42:20.464621] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-09-29T18:42:20.465391] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-09-29T18:42:20.470897] [DEBUG] [LOCAL ] EXPD: Trimmed 69266 records to 48037 (keeping 200 days of data) [2025-09-29T18:42:20.635776] [DEBUG] [LOCAL ] EXR: Primary data saved (45310 records). [2025-09-29T18:42:20.637837] [INFO ] [MAIN ] EXR: Full history saved. [2025-09-29T18:42:20.638258] [INFO ] [MAIN ] Update Progress: 802/2371 symbols completed. EXR took 29.5s. Estimated remaining: 3h 20m 8s. Rate: 7.8 symbols/min [2025-09-29T18:42:20.898260] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:42:20.992817] [DEBUG] [LOCAL ] FBK: Loaded 26066 existing records from primary storage. [2025-09-29T18:42:20.993839] [INFO ] [MAIN ] FBK: Loaded 26066 existing records. [2025-09-29T18:42:21.122710] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-29T18:42:21.164447] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-01. [2025-09-29T18:42:21.286012] [DEBUG] [LOCAL ] EXPD: Primary data saved (48037 records). [2025-09-29T18:42:21.293331] [INFO ] [MAIN ] EXPD: Full history saved. [2025-09-29T18:42:21.292824] [WARN ] [MAIN ] FBK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:42:21.293915] [INFO ] [MAIN ] Update Progress: 803/2371 symbols completed. EXPD took 30.1s. Estimated remaining: 3h 19m 46s. Rate: 7.8 symbols/min [2025-09-29T18:42:21.294023] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-09-29T18:42:21.313946] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-09-29T18:42:21.332031] [DEBUG] [LOCAL ] FBK: Deleted primary data file. [2025-09-29T18:42:21.332228] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-09-29T18:42:21.673408] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:42:21.968623] [INFO ] [REMOTE ] FBK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:42:21.969245] [INFO ] [REMOTE ] FBK: Fetching primary data for 2024-12. [2025-09-29T18:42:21.983547] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (3.23 seconds). [2025-09-29T18:42:21.996923] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-09-29T18:42:22.015595] [DEBUG] [LOCAL ] FBP: Loaded 46874 existing records from primary storage. [2025-09-29T18:42:22.016066] [INFO ] [MAIN ] FBP: Loaded 46874 existing records. [2025-09-29T18:42:22.225391] [WARN ] [MAIN ] FBP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:42:22.225665] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-09-29T18:42:22.225732] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-09-29T18:42:22.226325] [DEBUG] [LOCAL ] FBP: Deleted primary data file. [2025-09-29T18:42:22.226387] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-09-29T18:42:22.657271] [INFO ] [REMOTE ] FBP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:42:22.748127] [INFO ] [REMOTE ] FBP: Fetching primary data for 2024-12. [2025-09-29T18:42:22.971512] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-29T18:42:22.987524] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-29T18:42:23.548158] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-09-29T18:42:24.348185] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-01. [2025-09-29T18:42:24.525392] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-29T18:42:24.628175] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (2.63 seconds). [2025-09-29T18:42:25.148162] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-01. [2025-09-29T18:42:25.196050] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-29T18:42:25.244221] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-29T18:42:25.948146] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-09-29T18:42:26.753297] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-09-29T18:42:26.759503] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-29T18:42:26.913853] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-29T18:42:27.548131] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-09-29T18:42:28.348165] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-09-29T18:42:29.067739] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-29T18:42:29.148122] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-09-29T18:42:29.693755] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (2.94 seconds). [2025-09-29T18:42:29.705526] [INFO ] [REMOTE ] F: Full fetch complete (77999 records). [2025-09-29T18:42:29.705743] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-09-29T18:42:29.963756] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-09-29T18:42:30.044754] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-29T18:42:30.158240] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-09-29T18:42:30.168998] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-09-29T18:42:30.189788] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-09-29T18:42:30.190680] [DEBUG] [LOCAL ] F: Saving primary data. [2025-09-29T18:42:30.192168] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-29T18:42:30.204882] [DEBUG] [LOCAL ] F: Trimmed 77999 records to 53820 (keeping 200 days of data) [2025-09-29T18:42:30.562537] [DEBUG] [LOCAL ] F: Primary data saved (53820 records). [2025-09-29T18:42:30.562731] [INFO ] [MAIN ] F: Full history saved. [2025-09-29T18:42:30.562836] [INFO ] [MAIN ] Update Progress: 804/2371 symbols completed. F took 39.4s. Estimated remaining: 3h 19m 42s. Rate: 7.8 symbols/min [2025-09-29T18:42:30.754355] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:42:30.752701] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-09-29T18:42:30.793741] [DEBUG] [LOCAL ] FBRT: Loaded 34985 existing records from primary storage. [2025-09-29T18:42:30.794067] [INFO ] [MAIN ] FBRT: Loaded 34985 existing records. [2025-09-29T18:42:30.986001] [WARN ] [MAIN ] FBRT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:42:30.986168] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-09-29T18:42:30.986215] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-09-29T18:42:30.986831] [DEBUG] [LOCAL ] FBRT: Deleted primary data file. [2025-09-29T18:42:30.986896] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-09-29T18:42:31.355440] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:42:31.548111] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2024-12. [2025-09-29T18:42:31.710007] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-29T18:42:32.215100] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-29T18:42:32.348145] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-09-29T18:42:32.698693] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-29T18:42:33.148143] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-09-29T18:42:33.942918] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-29T18:42:33.953923] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-01. [2025-09-29T18:42:34.748112] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-09-29T18:42:34.840987] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-29T18:42:35.228043] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-29T18:42:35.548121] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-09-29T18:42:36.348100] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-09-29T18:42:36.383603] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-29T18:42:37.148115] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-09-29T18:42:37.216989] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-29T18:42:37.885950] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-29T18:42:37.948130] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-09-29T18:42:38.748068] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-09-29T18:42:38.861294] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-29T18:42:38.969851] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-29T18:42:39.548151] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-09-29T18:42:40.089537] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-29T18:42:40.348087] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-09-29T18:42:41.019306] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-29T18:42:41.148122] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-09-29T18:42:41.948105] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-09-29T18:42:42.000178] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-29T18:42:42.261296] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-29T18:42:42.748121] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-09-29T18:42:43.046880] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-29T18:42:43.548128] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-09-29T18:42:44.076583] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-29T18:42:44.348123] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-09-29T18:42:45.148086] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-09-29T18:42:45.347916] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-29T18:42:45.416247] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-29T18:42:45.948155] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-09-29T18:42:46.748145] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-09-29T18:42:47.075607] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-29T18:42:47.087436] [INFO ] [REMOTE ] FBIN: Full fetch complete (72579 records). [2025-09-29T18:42:47.087629] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-09-29T18:42:47.422818] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-29T18:42:47.552524] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-09-29T18:42:47.578090] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-09-29T18:42:47.578183] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-09-29T18:42:47.579215] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-09-29T18:42:47.579410] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-09-29T18:42:47.580948] [DEBUG] [LOCAL ] FBIN: Trimmed 72579 records to 50319 (keeping 200 days of data) [2025-09-29T18:42:47.935383] [DEBUG] [LOCAL ] FBIN: Primary data saved (50319 records). [2025-09-29T18:42:47.935545] [INFO ] [MAIN ] FBIN: Full history saved. [2025-09-29T18:42:47.935681] [INFO ] [MAIN ] Update Progress: 805/2371 symbols completed. FBIN took 29.9s. Estimated remaining: 3h 19m 53s. Rate: 7.8 symbols/min [2025-09-29T18:42:48.134111] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:42:48.153227] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-29T18:42:48.159055] [INFO ] [REMOTE ] FBK: Full fetch complete (33108 records). [2025-09-29T18:42:48.159194] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-09-29T18:42:48.159906] [FATAL] [VALIDATOR ] FBK: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:42:48.159998] [FATAL] [MAIN ] FBK: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:42:48.160056] [WARN ] [MAIN ] FBK: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:42:48.160125] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-09-29T18:42:48.160194] [DEBUG] [LOCAL ] FBK: No primary data file found to delete. [2025-09-29T18:42:48.160236] [INFO ] [LOCAL ] FBK: Starting deletion of derivative data. [2025-09-29T18:42:48.160961] [DEBUG] [LOCAL ] FBK: Deleted derivative data file. [2025-09-29T18:42:48.161152] [INFO ] [MAIN ] Update Progress: 806/2371 symbols completed. FBK took 27.5s. Estimated remaining: 3h 19m 31s. Rate: 7.8 symbols/min [2025-09-29T18:42:48.283637] [DEBUG] [LOCAL ] FC: Loaded 15634 existing records from primary storage. [2025-09-29T18:42:48.289950] [INFO ] [MAIN ] FC: Loaded 15634 existing records. [2025-09-29T18:42:48.411375] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-09-29T18:42:48.447718] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:42:48.574771] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:42:48.575041] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-09-29T18:42:48.575090] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-09-29T18:42:48.575415] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-09-29T18:42:48.575476] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-09-29T18:42:48.779999] [DEBUG] [LOCAL ] FCF: Loaded 40237 existing records from primary storage. [2025-09-29T18:42:48.799292] [INFO ] [MAIN ] FCF: Loaded 40237 existing records. [2025-09-29T18:42:49.125292] [INFO ] [REMOTE ] FC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:42:49.168897] [INFO ] [REMOTE ] FC: Fetching primary data for 2024-12. [2025-09-29T18:42:49.204713] [WARN ] [MAIN ] FCF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:42:49.206335] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-09-29T18:42:49.206471] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-09-29T18:42:49.207454] [DEBUG] [LOCAL ] FCF: Deleted primary data file. [2025-09-29T18:42:49.207674] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-09-29T18:42:49.388308] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-29T18:42:49.789179] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-29T18:42:49.847517] [INFO ] [REMOTE ] FCF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:42:49.948148] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-09-29T18:42:50.315675] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-29T18:42:50.748131] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-01. [2025-09-29T18:42:51.548100] [INFO ] [REMOTE ] FCF: Fetching primary data for 2024-12. [2025-09-29T18:42:51.618600] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-29T18:42:51.827283] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-29T18:42:51.836373] [INFO ] [REMOTE ] FBP: Full fetch complete (66077 records). [2025-09-29T18:42:51.836501] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-09-29T18:42:51.837190] [FATAL] [VALIDATOR ] FBP: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:42:51.837284] [FATAL] [MAIN ] FBP: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:42:51.837329] [WARN ] [MAIN ] FBP: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:42:51.837377] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-09-29T18:42:51.837482] [DEBUG] [LOCAL ] FBP: No primary data file found to delete. [2025-09-29T18:42:51.837524] [INFO ] [LOCAL ] FBP: Starting deletion of derivative data. [2025-09-29T18:42:51.837947] [DEBUG] [LOCAL ] FBP: Deleted derivative data file. [2025-09-29T18:42:51.838045] [INFO ] [MAIN ] Update Progress: 807/2371 symbols completed. FBP took 30.5s. Estimated remaining: 3h 19m 16s. Rate: 7.8 symbols/min [2025-09-29T18:42:52.013327] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:42:52.045177] [DEBUG] [LOCAL ] FCN: Loaded 26559 existing records from primary storage. [2025-09-29T18:42:52.045441] [INFO ] [MAIN ] FCN: Loaded 26559 existing records. [2025-09-29T18:42:52.269888] [WARN ] [MAIN ] FCN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:42:52.270128] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-09-29T18:42:52.270204] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-09-29T18:42:52.270746] [DEBUG] [LOCAL ] FCN: Deleted primary data file. [2025-09-29T18:42:52.270810] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-09-29T18:42:52.353232] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-09-29T18:42:52.652572] [INFO ] [REMOTE ] FCN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:42:53.148118] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-09-29T18:42:53.197560] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-29T18:42:53.898500] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-29T18:42:53.948089] [INFO ] [REMOTE ] FCN: Fetching primary data for 2024-12. [2025-09-29T18:42:54.044937] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-29T18:42:54.748139] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-01. [2025-09-29T18:42:55.153699] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-29T18:42:55.548124] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-01. [2025-09-29T18:42:56.284557] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-29T18:42:56.348084] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-09-29T18:42:56.590932] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-29T18:42:57.148106] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-09-29T18:42:57.460961] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-29T18:42:57.948089] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-09-29T18:42:58.162534] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-29T18:42:58.748141] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-09-29T18:42:59.548119] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-09-29T18:42:59.601307] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-29T18:42:59.901975] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-29T18:43:00.348121] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-09-29T18:43:01.153302] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-09-29T18:43:01.170911] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-29T18:43:01.564109] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-29T18:43:01.948102] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-09-29T18:43:02.748090] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-09-29T18:43:02.939410] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-29T18:43:03.314496] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-29T18:43:03.548118] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-09-29T18:43:03.585271] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-29T18:43:04.348129] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-09-29T18:43:04.894066] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-29T18:43:05.148092] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-09-29T18:43:05.236594] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-29T18:43:05.948152] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-09-29T18:43:06.706863] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-29T18:43:06.714247] [INFO ] [REMOTE ] FBRT: Full fetch complete (48666 records). [2025-09-29T18:43:06.714408] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-09-29T18:43:06.753305] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-09-29T18:43:07.161610] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present. [2025-09-29T18:43:07.161836] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed. [2025-09-29T18:43:07.162626] [INFO ] [MAIN ] FBRT: Fetched primary data is valid. [2025-09-29T18:43:07.162739] [DEBUG] [LOCAL ] FBRT: Saving primary data. [2025-09-29T18:43:07.163940] [DEBUG] [LOCAL ] FBRT: Trimmed 48666 records to 34454 (keeping 200 days of data) [2025-09-29T18:43:07.309876] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-29T18:43:07.426342] [DEBUG] [LOCAL ] FBRT: Primary data saved (34454 records). [2025-09-29T18:43:07.426504] [INFO ] [MAIN ] FBRT: Full history saved. [2025-09-29T18:43:07.426664] [INFO ] [MAIN ] Update Progress: 808/2371 symbols completed. FBRT took 36.9s. Estimated remaining: 3h 19m 23s. Rate: 7.8 symbols/min [2025-09-29T18:43:07.548309] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-09-29T18:43:07.641974] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:43:07.657669] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-29T18:43:07.707888] [DEBUG] [LOCAL ] FCPT: Loaded 37955 existing records from primary storage. [2025-09-29T18:43:07.708401] [INFO ] [MAIN ] FCPT: Loaded 37955 existing records. [2025-09-29T18:43:07.920168] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:43:07.920459] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-09-29T18:43:07.920546] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-09-29T18:43:07.921186] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-09-29T18:43:07.921270] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-09-29T18:43:08.330562] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:43:08.348064] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2024-12. [2025-09-29T18:43:09.117356] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-29T18:43:09.148068] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-09-29T18:43:09.834549] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-29T18:43:09.948135] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-01. [2025-09-29T18:43:10.457273] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-29T18:43:10.748323] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-09-29T18:43:11.451356] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-29T18:43:11.548126] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-09-29T18:43:12.122557] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-29T18:43:12.348117] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-09-29T18:43:12.877153] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-29T18:43:13.148120] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-09-29T18:43:13.850309] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-29T18:43:13.948108] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-09-29T18:43:14.709579] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-29T18:43:14.748110] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-09-29T18:43:15.346057] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-29T18:43:15.548175] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-09-29T18:43:15.989358] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-29T18:43:16.348093] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-09-29T18:43:16.688089] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-29T18:43:17.148111] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-09-29T18:43:17.943070] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-29T18:43:17.950371] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-09-29T18:43:17.952398] [INFO ] [REMOTE ] FCF: Full fetch complete (58086 records). [2025-09-29T18:43:17.952528] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-09-29T18:43:18.352909] [DEBUG] [VALIDATOR ] FCF: All expected trading days are present. [2025-09-29T18:43:18.352988] [DEBUG] [VALIDATOR ] FCF: Primary data validation passed. [2025-09-29T18:43:18.353814] [INFO ] [MAIN ] FCF: Fetched primary data is valid. [2025-09-29T18:43:18.353893] [DEBUG] [LOCAL ] FCF: Saving primary data. [2025-09-29T18:43:18.355302] [DEBUG] [LOCAL ] FCF: Trimmed 58086 records to 39462 (keeping 200 days of data) [2025-09-29T18:43:18.617028] [DEBUG] [LOCAL ] FCF: Primary data saved (39462 records). [2025-09-29T18:43:18.617217] [INFO ] [MAIN ] FCF: Full history saved. [2025-09-29T18:43:18.617425] [INFO ] [MAIN ] Update Progress: 809/2371 symbols completed. FCF took 30.5s. Estimated remaining: 3h 19m 23s. Rate: 7.8 symbols/min [2025-09-29T18:43:18.749616] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-09-29T18:43:18.804230] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:43:18.805442] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-09-29T18:43:18.805553] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-09-29T18:43:18.805721] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-09-29T18:43:18.805779] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-09-29T18:43:18.805833] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-09-29T18:43:18.805869] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-09-29T18:43:19.107149] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-29T18:43:19.230208] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:43:19.494495] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-29T18:43:19.548082] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-09-29T18:43:19.885196] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-29T18:43:19.888908] [INFO ] [REMOTE ] FC: Full fetch complete (21623 records). [2025-09-29T18:43:19.889001] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-09-29T18:43:20.277866] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-09-29T18:43:20.277963] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-09-29T18:43:20.278443] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-09-29T18:43:20.278503] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-09-29T18:43:20.279261] [DEBUG] [LOCAL ] FC: Trimmed 21623 records to 15423 (keeping 200 days of data) [2025-09-29T18:43:20.348240] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2024-12. [2025-09-29T18:43:20.374287] [DEBUG] [LOCAL ] FC: Primary data saved (15423 records). [2025-09-29T18:43:20.374416] [INFO ] [MAIN ] FC: Full history saved. [2025-09-29T18:43:20.374513] [INFO ] [MAIN ] Update Progress: 810/2371 symbols completed. FC took 32.4s. Estimated remaining: 3h 19m 3s. Rate: 7.8 symbols/min [2025-09-29T18:43:20.552540] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:43:20.571189] [DEBUG] [LOCAL ] FCT: Loaded 14613 existing records from primary storage. [2025-09-29T18:43:20.571456] [INFO ] [MAIN ] FCT: Loaded 14613 existing records. [2025-09-29T18:43:20.683104] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-09-29T18:43:20.759509] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:43:20.759778] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-09-29T18:43:20.759829] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-09-29T18:43:20.760033] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-09-29T18:43:20.760092] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-09-29T18:43:21.154597] [INFO ] [REMOTE ] FCT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:43:21.151032] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-09-29T18:43:21.173442] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-29T18:43:21.948132] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-09-29T18:43:22.314067] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-29T18:43:22.748116] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-09-29T18:43:23.242546] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-29T18:43:23.548119] [INFO ] [REMOTE ] FCT: Fetching primary data for 2024-12. [2025-09-29T18:43:24.038123] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-29T18:43:24.043062] [INFO ] [REMOTE ] FCN: Full fetch complete (35561 records). [2025-09-29T18:43:24.043176] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-09-29T18:43:24.043827] [FATAL] [VALIDATOR ] FCN: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:43:24.043915] [FATAL] [MAIN ] FCN: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:43:24.043961] [WARN ] [MAIN ] FCN: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:43:24.044031] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-09-29T18:43:24.044099] [DEBUG] [LOCAL ] FCN: No primary data file found to delete. [2025-09-29T18:43:24.044150] [INFO ] [LOCAL ] FCN: Starting deletion of derivative data. [2025-09-29T18:43:24.044950] [DEBUG] [LOCAL ] FCN: Deleted derivative data file. [2025-09-29T18:43:24.045078] [INFO ] [MAIN ] Update Progress: 811/2371 symbols completed. FCN took 32.2s. Estimated remaining: 3h 18m 48s. Rate: 7.8 symbols/min [2025-09-29T18:43:24.222566] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:43:24.286155] [DEBUG] [LOCAL ] FCX: Loaded 54480 existing records from primary storage. [2025-09-29T18:43:24.286491] [INFO ] [MAIN ] FCX: Loaded 54480 existing records. [2025-09-29T18:43:24.353246] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-09-29T18:43:24.478158] [WARN ] [MAIN ] FCX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:43:24.478388] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-09-29T18:43:24.478444] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-09-29T18:43:24.479036] [DEBUG] [LOCAL ] FCX: Deleted primary data file. [2025-09-29T18:43:24.479099] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-09-29T18:43:24.880474] [INFO ] [REMOTE ] FCX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:43:24.891935] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-29T18:43:25.148144] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-01. [2025-09-29T18:43:25.641248] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-29T18:43:25.948156] [INFO ] [REMOTE ] FCX: Fetching primary data for 2024-12. [2025-09-29T18:43:26.129884] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-29T18:43:26.748163] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-09-29T18:43:27.184694] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-29T18:43:27.548133] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-09-29T18:43:27.967876] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-29T18:43:28.157964] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-29T18:43:28.348117] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-09-29T18:43:29.148160] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-09-29T18:43:29.750308] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-29T18:43:29.758479] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-29T18:43:29.948136] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-09-29T18:43:30.459106] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-29T18:43:30.748115] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-09-29T18:43:31.287195] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-29T18:43:31.548154] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-09-29T18:43:31.794450] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-09-29T18:43:32.348145] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-09-29T18:43:32.675172] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-29T18:43:33.148164] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-01. [2025-09-29T18:43:33.948121] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-09-29T18:43:34.748075] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-09-29T18:43:34.916758] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-29T18:43:35.210718] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-29T18:43:35.548118] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-09-29T18:43:36.208231] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-29T18:43:36.348131] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-09-29T18:43:36.566874] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-29T18:43:36.574998] [INFO ] [REMOTE ] FCPT: Full fetch complete (53493 records). [2025-09-29T18:43:36.575115] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-09-29T18:43:36.691592] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-29T18:43:36.992866] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-09-29T18:43:36.992981] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-09-29T18:43:36.993854] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-09-29T18:43:36.993922] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-09-29T18:43:36.995154] [DEBUG] [LOCAL ] FCPT: Trimmed 53493 records to 37247 (keeping 200 days of data) [2025-09-29T18:43:37.165544] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-09-29T18:43:37.230063] [DEBUG] [LOCAL ] FCPT: Primary data saved (37247 records). [2025-09-29T18:43:37.230217] [INFO ] [MAIN ] FCPT: Full history saved. [2025-09-29T18:43:37.230318] [INFO ] [MAIN ] Update Progress: 812/2371 symbols completed. FCPT took 29.8s. Estimated remaining: 3h 18m 51s. Rate: 7.8 symbols/min [2025-09-29T18:43:37.408429] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:43:37.443063] [DEBUG] [LOCAL ] FDP: Loaded 30760 existing records from primary storage. [2025-09-29T18:43:37.443374] [INFO ] [MAIN ] FDP: Loaded 30760 existing records. [2025-09-29T18:43:37.626879] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:43:37.627136] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-09-29T18:43:37.627193] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-09-29T18:43:37.628257] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-09-29T18:43:37.628320] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-09-29T18:43:37.953256] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-09-29T18:43:38.021966] [INFO ] [REMOTE ] FDP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:43:38.091101] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-29T18:43:38.748145] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-09-29T18:43:39.136520] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-29T18:43:39.548160] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-09-29T18:43:40.083710] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-29T18:43:40.348117] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-09-29T18:43:40.511022] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-29T18:43:41.148157] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-09-29T18:43:41.782862] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-29T18:43:41.783988] [INFO ] [REMOTE ] FCRX: Full fetch complete (1678 records). [2025-09-29T18:43:41.784064] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-09-29T18:43:41.957674] [INFO ] [REMOTE ] FDP: Fetching primary data for 2024-12. [2025-09-29T18:43:41.979991] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-09-29T18:43:41.980960] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:43:41.981049] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:43:41.981134] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-09-29T18:43:41.981197] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-09-29T18:43:41.981236] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-09-29T18:43:41.981278] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-09-29T18:43:41.981347] [INFO ] [MAIN ] Update Progress: 813/2371 symbols completed. FCRX took 23.4s. Estimated remaining: 3h 18m 38s. Rate: 7.8 symbols/min [2025-09-29T18:43:42.171010] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:43:42.200670] [DEBUG] [LOCAL ] FDS: Loaded 26759 existing records from primary storage. [2025-09-29T18:43:42.201108] [INFO ] [MAIN ] FDS: Loaded 26759 existing records. [2025-09-29T18:43:42.398452] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:43:42.398817] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-09-29T18:43:42.398965] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-09-29T18:43:42.399497] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-09-29T18:43:42.399563] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-09-29T18:43:42.761997] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-09-29T18:43:42.811103] [INFO ] [REMOTE ] FDS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:43:42.846026] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (2.50 seconds). [2025-09-29T18:43:43.438944] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-29T18:43:43.548115] [INFO ] [REMOTE ] FDS: Fetching primary data for 2024-12. [2025-09-29T18:43:43.829098] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-29T18:43:44.348113] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-01. [2025-09-29T18:43:44.625327] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-29T18:43:45.148137] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-01. [2025-09-29T18:43:45.533205] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-29T18:43:45.948166] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-09-29T18:43:46.483760] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-29T18:43:46.748147] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-09-29T18:43:47.121091] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-29T18:43:47.496863] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-29T18:43:47.548109] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-09-29T18:43:48.348107] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-09-29T18:43:48.843501] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-29T18:43:49.148112] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-09-29T18:43:49.250954] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-29T18:43:49.948100] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-09-29T18:43:50.748127] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-09-29T18:43:51.248893] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-29T18:43:51.288557] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-29T18:43:51.548162] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-09-29T18:43:51.830963] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-29T18:43:51.835486] [INFO ] [REMOTE ] FCT: Full fetch complete (21126 records). [2025-09-29T18:43:51.835637] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-09-29T18:43:52.260311] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-09-29T18:43:52.260410] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-09-29T18:43:52.261029] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-09-29T18:43:52.261097] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-09-29T18:43:52.261991] [DEBUG] [LOCAL ] FCT: Trimmed 21126 records to 14519 (keeping 200 days of data) [2025-09-29T18:43:52.348269] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-09-29T18:43:52.357151] [DEBUG] [LOCAL ] FCT: Primary data saved (14519 records). [2025-09-29T18:43:52.357284] [INFO ] [MAIN ] FCT: Full history saved. [2025-09-29T18:43:52.357370] [INFO ] [MAIN ] Update Progress: 814/2371 symbols completed. FCT took 32.0s. Estimated remaining: 3h 18m 36s. Rate: 7.8 symbols/min [2025-09-29T18:43:52.566709] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:43:52.627133] [DEBUG] [LOCAL ] FDX: Loaded 52362 existing records from primary storage. [2025-09-29T18:43:52.627524] [INFO ] [MAIN ] FDX: Loaded 52362 existing records. [2025-09-29T18:43:52.812254] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:43:52.812529] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-09-29T18:43:52.812579] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-09-29T18:43:52.813010] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-09-29T18:43:52.813072] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-09-29T18:43:53.154932] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-09-29T18:43:53.201286] [INFO ] [REMOTE ] FDX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:43:53.661400] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-29T18:43:53.864319] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-29T18:43:53.948106] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-09-29T18:43:54.491092] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-29T18:43:54.748142] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-09-29T18:43:55.398559] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-29T18:43:55.548123] [INFO ] [REMOTE ] FDX: Fetching primary data for 2024-12. [2025-09-29T18:43:56.008857] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-29T18:43:56.348108] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-09-29T18:43:57.148082] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-09-29T18:43:57.643885] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-29T18:43:57.948098] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-09-29T18:43:58.043632] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-29T18:43:58.332872] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-29T18:43:58.748081] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-09-29T18:43:58.828918] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-29T18:43:59.548117] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-01. [2025-09-29T18:44:00.348128] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-09-29T18:44:01.148146] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-09-29T18:44:01.260047] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-09-29T18:44:01.444730] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-29T18:44:01.635283] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-29T18:44:01.948095] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-09-29T18:44:02.156688] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-29T18:44:02.748154] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-09-29T18:44:03.548440] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-09-29T18:44:04.035393] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-29T18:44:04.194731] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-29T18:44:04.348168] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-09-29T18:44:05.148105] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-09-29T18:44:05.405495] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-29T18:44:05.810533] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-29T18:44:05.817051] [INFO ] [REMOTE ] FDP: Full fetch complete (42805 records). [2025-09-29T18:44:05.817196] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-09-29T18:44:05.953197] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-09-29T18:44:06.229489] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-09-29T18:44:06.229578] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-09-29T18:44:06.230379] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-09-29T18:44:06.230445] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-09-29T18:44:06.231752] [DEBUG] [LOCAL ] FDP: Trimmed 42805 records to 30255 (keeping 200 days of data) [2025-09-29T18:44:06.435207] [DEBUG] [LOCAL ] FDP: Primary data saved (30255 records). [2025-09-29T18:44:06.435405] [INFO ] [MAIN ] FDP: Full history saved. [2025-09-29T18:44:06.435512] [INFO ] [MAIN ] Update Progress: 815/2371 symbols completed. FDP took 29.2s. Estimated remaining: 3h 18m 40s. Rate: 7.8 symbols/min [2025-09-29T18:44:06.633723] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:44:06.658227] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-29T18:44:06.718993] [DEBUG] [LOCAL ] FE: Loaded 54208 existing records from primary storage. [2025-09-29T18:44:06.719407] [INFO ] [MAIN ] FE: Loaded 54208 existing records. [2025-09-29T18:44:06.756112] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-09-29T18:44:06.922844] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:44:06.923083] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-09-29T18:44:06.923133] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-09-29T18:44:06.923930] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-09-29T18:44:06.923991] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-09-29T18:44:07.314773] [INFO ] [REMOTE ] FE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:44:07.548117] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-09-29T18:44:07.861048] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-29T18:44:08.348170] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-09-29T18:44:09.148125] [INFO ] [REMOTE ] FE: Fetching primary data for 2024-12. [2025-09-29T18:44:09.205997] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-29T18:44:09.214211] [INFO ] [REMOTE ] FDS: Full fetch complete (37337 records). [2025-09-29T18:44:09.214387] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-09-29T18:44:09.400328] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (2.64 seconds). [2025-09-29T18:44:09.444635] [INFO ] [REMOTE ] FCX: Full fetch complete (77740 records). [2025-09-29T18:44:09.504343] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-09-29T18:44:09.824512] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-09-29T18:44:09.830744] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-09-29T18:44:09.860980] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-09-29T18:44:09.897973] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-09-29T18:44:09.996566] [DEBUG] [LOCAL ] FDS: Trimmed 37337 records to 26449 (keeping 200 days of data) [2025-09-29T18:44:10.229505] [DEBUG] [VALIDATOR ] FCX: All expected trading days are present. [2025-09-29T18:44:10.230134] [DEBUG] [VALIDATOR ] FCX: Primary data validation passed. [2025-09-29T18:44:10.234998] [INFO ] [MAIN ] FCX: Fetched primary data is valid. [2025-09-29T18:44:10.237135] [DEBUG] [LOCAL ] FCX: Saving primary data. [2025-09-29T18:44:10.245569] [DEBUG] [LOCAL ] FCX: Trimmed 77740 records to 53700 (keeping 200 days of data) [2025-09-29T18:44:10.402561] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-29T18:44:10.420146] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-09-29T18:44:10.481442] [DEBUG] [LOCAL ] FDS: Primary data saved (26449 records). [2025-09-29T18:44:10.482438] [INFO ] [MAIN ] FDS: Full history saved. [2025-09-29T18:44:10.482557] [INFO ] [MAIN ] Update Progress: 816/2371 symbols completed. FDS took 28.5s. Estimated remaining: 3h 18m 26s. Rate: 7.8 symbols/min [2025-09-29T18:44:10.686567] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:44:10.687449] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-09-29T18:44:10.688076] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-09-29T18:44:10.689288] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-09-29T18:44:10.689402] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-09-29T18:44:10.689976] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-09-29T18:44:10.690267] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-09-29T18:44:11.235426] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:44:11.236066] [INFO ] [REMOTE ] FENG: Fetching primary data for 2024-12. [2025-09-29T18:44:11.275314] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-29T18:44:11.379420] [DEBUG] [LOCAL ] FCX: Primary data saved (53700 records). [2025-09-29T18:44:11.379575] [INFO ] [MAIN ] FCX: Full history saved. [2025-09-29T18:44:11.379696] [INFO ] [MAIN ] Update Progress: 817/2371 symbols completed. FCX took 47.3s. Estimated remaining: 3h 18m 5s. Rate: 7.8 symbols/min [2025-09-29T18:44:11.548456] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-09-29T18:44:11.571224] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:44:11.630153] [DEBUG] [LOCAL ] FERG: Loaded 49691 existing records from primary storage. [2025-09-29T18:44:11.630498] [INFO ] [MAIN ] FERG: Loaded 49691 existing records. [2025-09-29T18:44:11.826051] [WARN ] [MAIN ] FERG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:44:11.826298] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-09-29T18:44:11.826370] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-09-29T18:44:11.827422] [DEBUG] [LOCAL ] FERG: Deleted primary data file. [2025-09-29T18:44:11.827487] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-09-29T18:44:12.018568] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-29T18:44:12.237590] [INFO ] [REMOTE ] FERG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:44:12.348116] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-09-29T18:44:12.442288] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-29T18:44:12.816371] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-29T18:44:13.148076] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-09-29T18:44:13.247115] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-29T18:44:13.471674] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-29T18:44:13.948143] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-09-29T18:44:14.748166] [INFO ] [REMOTE ] FERG: Fetching primary data for 2024-12. [2025-09-29T18:44:15.548122] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-09-29T18:44:15.961068] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-29T18:44:16.107415] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-29T18:44:16.348137] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-01. [2025-09-29T18:44:17.148093] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-09-29T18:44:17.591905] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-29T18:44:17.948173] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-09-29T18:44:18.114678] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-29T18:44:18.748145] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-09-29T18:44:18.820102] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-29T18:44:19.557032] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-09-29T18:44:19.564463] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-29T18:44:20.344721] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-29T18:44:20.353428] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-09-29T18:44:21.148120] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-09-29T18:44:21.555492] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-29T18:44:21.948142] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-09-29T18:44:22.407317] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-29T18:44:22.524382] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-29T18:44:22.748151] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-09-29T18:44:22.957021] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-29T18:44:23.548165] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-09-29T18:44:24.348117] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-09-29T18:44:25.021138] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-29T18:44:25.031595] [INFO ] [REMOTE ] FDX: Full fetch complete (74068 records). [2025-09-29T18:44:25.031807] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-09-29T18:44:25.032523] [FATAL] [VALIDATOR ] FDX: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:44:25.032628] [FATAL] [MAIN ] FDX: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:44:25.032716] [WARN ] [MAIN ] FDX: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:44:25.032791] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-09-29T18:44:25.032905] [DEBUG] [LOCAL ] FDX: No primary data file found to delete. [2025-09-29T18:44:25.032966] [INFO ] [LOCAL ] FDX: Starting deletion of derivative data. [2025-09-29T18:44:25.033522] [DEBUG] [LOCAL ] FDX: Deleted derivative data file. [2025-09-29T18:44:25.033623] [INFO ] [MAIN ] Update Progress: 818/2371 symbols completed. FDX took 32.7s. Estimated remaining: 3h 18m 9s. Rate: 7.8 symbols/min [2025-09-29T18:44:25.153275] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-09-29T18:44:25.220030] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:44:25.236925] [DEBUG] [LOCAL ] FET: Loaded 12984 existing records from primary storage. [2025-09-29T18:44:25.237193] [INFO ] [MAIN ] FET: Loaded 12984 existing records. [2025-09-29T18:44:25.439960] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:44:25.440675] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-09-29T18:44:25.440761] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-09-29T18:44:25.441253] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-09-29T18:44:25.441329] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-09-29T18:44:25.696111] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-29T18:44:25.790982] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-29T18:44:25.956472] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-09-29T18:44:25.959921] [INFO ] [REMOTE ] FET: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:44:26.004322] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-29T18:44:26.421779] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-29T18:44:26.748134] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-09-29T18:44:27.548168] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-09-29T18:44:28.348113] [INFO ] [REMOTE ] FET: Fetching primary data for 2024-12. [2025-09-29T18:44:28.463389] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-29T18:44:29.148103] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-09-29T18:44:29.233238] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-29T18:44:29.455450] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-29T18:44:29.493157] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-29T18:44:29.948121] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-01. [2025-09-29T18:44:30.748095] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-09-29T18:44:30.820300] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-29T18:44:31.548171] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-09-29T18:44:32.348124] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-09-29T18:44:32.422353] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-29T18:44:32.753246] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-29T18:44:33.148143] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-09-29T18:44:33.640338] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-29T18:44:33.948896] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-09-29T18:44:33.951970] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-29T18:44:34.748150] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-09-29T18:44:34.914322] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-29T18:44:35.548117] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-09-29T18:44:36.348093] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-09-29T18:44:36.426632] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-29T18:44:36.707341] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-29T18:44:37.148086] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-09-29T18:44:37.408153] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-29T18:44:37.948118] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-09-29T18:44:38.752963] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-09-29T18:44:38.759205] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-29T18:44:39.387431] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-29T18:44:39.388754] [INFO ] [REMOTE ] FENG: Full fetch complete (2244 records). [2025-09-29T18:44:39.388836] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-09-29T18:44:39.553223] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-09-29T18:44:39.589060] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-29T18:44:39.590518] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:44:39.590785] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:44:39.591186] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-09-29T18:44:39.591343] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-09-29T18:44:39.591596] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-09-29T18:44:39.591822] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-09-29T18:44:39.617077] [INFO ] [MAIN ] Update Progress: 819/2371 symbols completed. FENG took 29.1s. Estimated remaining: 3h 18m 14s. Rate: 7.8 symbols/min [2025-09-29T18:44:39.705455] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-29T18:44:39.750484] [INFO ] [REMOTE ] FE: Full fetch complete (77241 records). [2025-09-29T18:44:39.760925] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-09-29T18:44:39.864490] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:44:40.163761] [DEBUG] [LOCAL ] FF: Loaded 25768 existing records from primary storage. [2025-09-29T18:44:40.170487] [INFO ] [MAIN ] FF: Loaded 25768 existing records. [2025-09-29T18:44:40.354245] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-09-29T18:44:40.428818] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-09-29T18:44:40.429873] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-09-29T18:44:40.430969] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-09-29T18:44:40.436493] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-09-29T18:44:40.470579] [WARN ] [MAIN ] FF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:44:40.471770] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-09-29T18:44:40.471881] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-09-29T18:44:40.472565] [DEBUG] [LOCAL ] FF: Deleted primary data file. [2025-09-29T18:44:40.472745] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-09-29T18:44:40.472520] [DEBUG] [LOCAL ] FE: Trimmed 77241 records to 53427 (keeping 200 days of data) [2025-09-29T18:44:40.858434] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-29T18:44:40.990625] [INFO ] [REMOTE ] FF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:44:41.174344] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-09-29T18:44:41.237529] [DEBUG] [LOCAL ] FE: Primary data saved (53427 records). [2025-09-29T18:44:41.237943] [INFO ] [MAIN ] FE: Full history saved. [2025-09-29T18:44:41.238401] [INFO ] [MAIN ] Update Progress: 820/2371 symbols completed. FE took 34.8s. Estimated remaining: 3h 17m 55s. Rate: 7.8 symbols/min [2025-09-29T18:44:41.437753] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:44:41.448812] [DEBUG] [LOCAL ] FFA: Loaded 5800 existing records from primary storage. [2025-09-29T18:44:41.449124] [INFO ] [MAIN ] FFA: Loaded 5800 existing records. [2025-09-29T18:44:41.636414] [WARN ] [MAIN ] FFA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:44:41.636735] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-09-29T18:44:41.636803] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-09-29T18:44:41.637051] [DEBUG] [LOCAL ] FFA: Deleted primary data file. [2025-09-29T18:44:41.637111] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-09-29T18:44:41.948322] [INFO ] [REMOTE ] FF: Fetching primary data for 2024-12. [2025-09-29T18:44:42.014029] [INFO ] [REMOTE ] FFA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:44:42.024128] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-29T18:44:42.532107] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-29T18:44:42.542561] [INFO ] [REMOTE ] FERG: Full fetch complete (70998 records). [2025-09-29T18:44:42.542782] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-09-29T18:44:42.753177] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-09-29T18:44:42.953341] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-09-29T18:44:42.953430] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-09-29T18:44:42.954483] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-09-29T18:44:42.954592] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-09-29T18:44:42.956071] [DEBUG] [LOCAL ] FERG: Trimmed 70998 records to 48889 (keeping 200 days of data) [2025-09-29T18:44:43.274367] [DEBUG] [LOCAL ] FERG: Primary data saved (48889 records). [2025-09-29T18:44:43.274520] [INFO ] [MAIN ] FERG: Full history saved. [2025-09-29T18:44:43.276825] [INFO ] [MAIN ] Update Progress: 821/2371 symbols completed. FERG took 31.9s. Estimated remaining: 3h 17m 37s. Rate: 7.8 symbols/min [2025-09-29T18:44:43.458595] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:44:43.479320] [DEBUG] [LOCAL ] FFC: Loaded 16899 existing records from primary storage. [2025-09-29T18:44:43.479587] [INFO ] [MAIN ] FFC: Loaded 16899 existing records. [2025-09-29T18:44:43.557198] [INFO ] [REMOTE ] FFA: Fetching primary data for 2024-12. [2025-09-29T18:44:43.695910] [WARN ] [MAIN ] FFC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:44:43.696414] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-09-29T18:44:43.708244] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-29T18:44:43.708359] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-09-29T18:44:43.727281] [DEBUG] [LOCAL ] FFC: Deleted primary data file. [2025-09-29T18:44:43.728111] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-09-29T18:44:43.776529] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-29T18:44:44.104541] [INFO ] [REMOTE ] FFC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:44:44.293388] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-29T18:44:44.348126] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-01. [2025-09-29T18:44:44.897169] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-29T18:44:45.148133] [INFO ] [REMOTE ] FFC: Fetching primary data for 2024-12. [2025-09-29T18:44:45.948081] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-01. [2025-09-29T18:44:46.258447] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-29T18:44:46.748102] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-01. [2025-09-29T18:44:47.110335] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-29T18:44:47.548117] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-09-29T18:44:47.767701] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-29T18:44:48.348120] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-09-29T18:44:48.787346] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-29T18:44:49.148098] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-09-29T18:44:49.301995] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-29T18:44:49.948143] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-09-29T18:44:50.225590] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-29T18:44:50.519236] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-29T18:44:50.748108] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-09-29T18:44:51.548097] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-09-29T18:44:51.752059] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-29T18:44:52.183483] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-29T18:44:52.348120] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-09-29T18:44:53.148113] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-09-29T18:44:53.666456] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-29T18:44:53.814741] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-29T18:44:53.948107] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-09-29T18:44:54.748093] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-09-29T18:44:55.072289] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-29T18:44:55.078332] [INFO ] [REMOTE ] FET: Full fetch complete (18288 records). [2025-09-29T18:44:55.078424] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-09-29T18:44:55.472290] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-09-29T18:44:55.472377] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-09-29T18:44:55.472858] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-09-29T18:44:55.472924] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-09-29T18:44:55.473599] [DEBUG] [LOCAL ] FET: Trimmed 18288 records to 12877 (keeping 200 days of data) [2025-09-29T18:44:55.548145] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-09-29T18:44:55.558097] [DEBUG] [LOCAL ] FET: Primary data saved (12877 records). [2025-09-29T18:44:55.558611] [INFO ] [MAIN ] FET: Full history saved. [2025-09-29T18:44:55.558773] [INFO ] [MAIN ] Update Progress: 822/2371 symbols completed. FET took 30.5s. Estimated remaining: 3h 17m 38s. Rate: 7.8 symbols/min [2025-09-29T18:44:55.744968] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:44:55.788916] [DEBUG] [LOCAL ] FFWM: Loaded 36532 existing records from primary storage. [2025-09-29T18:44:55.789220] [INFO ] [MAIN ] FFWM: Loaded 36532 existing records. [2025-09-29T18:44:55.983895] [WARN ] [MAIN ] FFWM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:44:55.984240] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-09-29T18:44:55.984374] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-09-29T18:44:55.984936] [DEBUG] [LOCAL ] FFWM: Deleted primary data file. [2025-09-29T18:44:55.985000] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-09-29T18:44:56.207358] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-29T18:44:56.348993] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-09-29T18:44:56.409713] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:44:56.504309] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-29T18:44:57.148116] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2024-12. [2025-09-29T18:44:57.472893] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-29T18:44:57.948122] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-09-29T18:44:58.571316] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-29T18:44:58.572036] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-29T18:44:58.748104] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-09-29T18:44:59.548131] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-09-29T18:45:00.260064] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-29T18:45:00.348142] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-09-29T18:45:00.884303] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-29T18:45:01.148086] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-09-29T18:45:01.232179] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-29T18:45:01.948129] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-09-29T18:45:02.653752] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-29T18:45:02.748116] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-09-29T18:45:02.934405] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-29T18:45:03.356088] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-29T18:45:03.548128] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-09-29T18:45:04.236206] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-29T18:45:04.348101] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-09-29T18:45:05.148155] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-09-29T18:45:05.948114] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-09-29T18:45:05.987993] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-29T18:45:06.210615] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-29T18:45:06.634409] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-29T18:45:06.748130] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-09-29T18:45:07.548142] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-09-29T18:45:07.938912] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-29T18:45:08.348081] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-09-29T18:45:08.740306] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-29T18:45:09.148160] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-09-29T18:45:09.948097] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-09-29T18:45:10.139000] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-29T18:45:10.172073] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-29T18:45:10.748242] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-09-29T18:45:10.749921] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-29T18:45:10.751907] [INFO ] [REMOTE ] FFA: Full fetch complete (8276 records). [2025-09-29T18:45:10.751985] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-09-29T18:45:10.752395] [FATAL] [VALIDATOR ] FFA: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:45:10.752481] [FATAL] [MAIN ] FFA: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:45:10.752533] [WARN ] [MAIN ] FFA: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:45:10.752604] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-09-29T18:45:10.752707] [DEBUG] [LOCAL ] FFA: No primary data file found to delete. [2025-09-29T18:45:10.752764] [INFO ] [LOCAL ] FFA: Starting deletion of derivative data. [2025-09-29T18:45:10.753207] [DEBUG] [LOCAL ] FFA: Deleted derivative data file. [2025-09-29T18:45:10.753306] [INFO ] [MAIN ] Update Progress: 823/2371 symbols completed. FFA took 29.5s. Estimated remaining: 3h 17m 45s. Rate: 7.8 symbols/min [2025-09-29T18:45:10.941054] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:45:10.965905] [DEBUG] [LOCAL ] FG: Loaded 22819 existing records from primary storage. [2025-09-29T18:45:10.966189] [INFO ] [MAIN ] FG: Loaded 22819 existing records. [2025-09-29T18:45:11.153045] [WARN ] [MAIN ] FG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:45:11.153305] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-09-29T18:45:11.153355] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-09-29T18:45:11.153812] [DEBUG] [LOCAL ] FG: Deleted primary data file. [2025-09-29T18:45:11.153874] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-09-29T18:45:11.555841] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-09-29T18:45:11.562617] [INFO ] [REMOTE ] FG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:45:11.800132] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-29T18:45:12.348116] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-09-29T18:45:12.871772] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-29T18:45:12.876923] [INFO ] [REMOTE ] FF: Full fetch complete (36862 records). [2025-09-29T18:45:12.877084] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-09-29T18:45:13.153276] [INFO ] [REMOTE ] FG: Fetching primary data for 2024-12. [2025-09-29T18:45:13.286341] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-09-29T18:45:13.286437] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-09-29T18:45:13.287251] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-09-29T18:45:13.287319] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-09-29T18:45:13.288437] [DEBUG] [LOCAL ] FF: Trimmed 36862 records to 25233 (keeping 200 days of data) [2025-09-29T18:45:13.459537] [DEBUG] [LOCAL ] FF: Primary data saved (25233 records). [2025-09-29T18:45:13.459732] [INFO ] [MAIN ] FF: Full history saved. [2025-09-29T18:45:13.459860] [INFO ] [MAIN ] Update Progress: 824/2371 symbols completed. FF took 33.8s. Estimated remaining: 3h 17m 28s. Rate: 7.8 symbols/min [2025-09-29T18:45:13.678419] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:45:13.688274] [DEBUG] [LOCAL ] FGN: Loaded 3915 existing records from primary storage. [2025-09-29T18:45:13.688602] [INFO ] [MAIN ] FGN: Loaded 3915 existing records. [2025-09-29T18:45:13.865143] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-29T18:45:13.953366] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-09-29T18:45:14.052596] [WARN ] [MAIN ] FGN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:45:14.052958] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-09-29T18:45:14.053034] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-09-29T18:45:14.053314] [DEBUG] [LOCAL ] FGN: Deleted primary data file. [2025-09-29T18:45:14.053392] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-09-29T18:45:14.076145] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-29T18:45:14.604087] [INFO ] [REMOTE ] FGN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:45:14.748145] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-09-29T18:45:15.325275] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-29T18:45:15.548086] [INFO ] [REMOTE ] FGN: Fetching primary data for 2024-12. [2025-09-29T18:45:15.627169] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-29T18:45:16.297284] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-29T18:45:16.348179] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-09-29T18:45:17.148142] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-09-29T18:45:17.948118] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-09-29T18:45:18.317777] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-29T18:45:18.357736] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-29T18:45:18.683330] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-29T18:45:18.687563] [INFO ] [REMOTE ] FFC: Full fetch complete (24750 records). [2025-09-29T18:45:18.687708] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-09-29T18:45:18.753236] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-09-29T18:45:19.078213] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present. [2025-09-29T18:45:19.078295] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed. [2025-09-29T18:45:19.078849] [INFO ] [MAIN ] FFC: Fetched primary data is valid. [2025-09-29T18:45:19.078913] [DEBUG] [LOCAL ] FFC: Saving primary data. [2025-09-29T18:45:19.079710] [DEBUG] [LOCAL ] FFC: Trimmed 24750 records to 16759 (keeping 200 days of data) [2025-09-29T18:45:19.190321] [DEBUG] [LOCAL ] FFC: Primary data saved (16759 records). [2025-09-29T18:45:19.190470] [INFO ] [MAIN ] FFC: Full history saved. [2025-09-29T18:45:19.190556] [INFO ] [MAIN ] Update Progress: 825/2371 symbols completed. FFC took 35.9s. Estimated remaining: 3h 17m 16s. Rate: 7.8 symbols/min [2025-09-29T18:45:19.365464] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:45:19.365629] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-09-29T18:45:19.365735] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-09-29T18:45:19.365854] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-09-29T18:45:19.365929] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-09-29T18:45:19.366045] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-09-29T18:45:19.366101] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-09-29T18:45:19.552094] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-09-29T18:45:19.772584] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-29T18:45:19.807254] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:45:20.348121] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-09-29T18:45:21.148137] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-09-29T18:45:21.196490] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-29T18:45:21.344218] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-29T18:45:21.476040] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-29T18:45:21.948116] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-09-29T18:45:22.748124] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-09-29T18:45:23.099788] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-29T18:45:23.331849] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-29T18:45:23.548163] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-09-29T18:45:24.138135] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-29T18:45:24.348104] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-09-29T18:45:25.148125] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2024-12. [2025-09-29T18:45:25.344513] [DEBUG] [REMOTE ] FGSN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T18:45:25.344898] [WARN ] [REMOTE ] FGSN: No data returned for month 2024-12 [2025-09-29T18:45:25.345014] [FATAL] [REMOTE ] FGSN: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T18:45:25.345063] [FATAL] [MAIN ] FGSN: Failed to fetch primary data. [2025-09-29T18:45:25.345129] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T18:45:25.345204] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-09-29T18:45:25.345271] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-09-29T18:45:25.345308] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-09-29T18:45:25.345370] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-09-29T18:45:25.345442] [INFO ] [MAIN ] Update Progress: 826/2371 symbols completed. FGSN took 6.2s. Estimated remaining: 3h 17m 6s. Rate: 7.8 symbols/min [2025-09-29T18:45:25.544263] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:45:25.592917] [DEBUG] [LOCAL ] FHI: Loaded 41203 existing records from primary storage. [2025-09-29T18:45:25.593230] [INFO ] [MAIN ] FHI: Loaded 41203 existing records. [2025-09-29T18:45:25.758965] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-29T18:45:25.807756] [WARN ] [MAIN ] FHI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:45:25.807997] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-09-29T18:45:25.808049] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-09-29T18:45:25.808762] [DEBUG] [LOCAL ] FHI: Deleted primary data file. [2025-09-29T18:45:25.808826] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-09-29T18:45:25.954119] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-09-29T18:45:26.176072] [INFO ] [REMOTE ] FHI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:45:26.748141] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-09-29T18:45:27.074863] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-29T18:45:27.382697] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-29T18:45:27.548142] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-09-29T18:45:28.348132] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-09-29T18:45:28.598888] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-29T18:45:29.006876] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-29T18:45:29.148155] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-09-29T18:45:29.701455] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-29T18:45:29.948139] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-09-29T18:45:30.593827] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-29T18:45:30.748144] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-09-29T18:45:31.548178] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-09-29T18:45:32.065961] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-29T18:45:32.067281] [INFO ] [REMOTE ] FGN: Full fetch complete (5756 records). [2025-09-29T18:45:32.067360] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-09-29T18:45:32.351368] [INFO ] [REMOTE ] FHI: Fetching primary data for 2024-12. [2025-09-29T18:45:32.499182] [DEBUG] [VALIDATOR ] FGN: All expected trading days are present. [2025-09-29T18:45:32.499815] [DEBUG] [VALIDATOR ] FGN: Primary data validation passed. [2025-09-29T18:45:32.500794] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-29T18:45:32.507594] [INFO ] [MAIN ] FGN: Fetched primary data is valid. [2025-09-29T18:45:32.508369] [DEBUG] [LOCAL ] FGN: Saving primary data. [2025-09-29T18:45:32.509098] [INFO ] [REMOTE ] FFWM: Full fetch complete (51650 records). [2025-09-29T18:45:32.509606] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-09-29T18:45:32.509479] [DEBUG] [LOCAL ] FGN: Trimmed 5756 records to 3865 (keeping 200 days of data) [2025-09-29T18:45:32.699678] [DEBUG] [LOCAL ] FGN: Primary data saved (3865 records). [2025-09-29T18:45:32.715950] [INFO ] [MAIN ] FGN: Full history saved. [2025-09-29T18:45:32.716384] [INFO ] [MAIN ] Update Progress: 827/2371 symbols completed. FGN took 19.3s. Estimated remaining: 3h 16m 58s. Rate: 7.8 symbols/min [2025-09-29T18:45:33.144272] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:45:33.147106] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present. [2025-09-29T18:45:33.147211] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed. [2025-09-29T18:45:33.148340] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-09-29T18:45:33.148401] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-09-29T18:45:33.148483] [DEBUG] [LOCAL ] FFWM: Saving primary data. [2025-09-29T18:45:33.150985] [DEBUG] [LOCAL ] FFWM: Trimmed 51650 records to 35823 (keeping 200 days of data) [2025-09-29T18:45:33.371785] [DEBUG] [LOCAL ] FHN: Loaded 54148 existing records from primary storage. [2025-09-29T18:45:33.376173] [INFO ] [MAIN ] FHN: Loaded 54148 existing records. [2025-09-29T18:45:33.587320] [DEBUG] [LOCAL ] FFWM: Primary data saved (35823 records). [2025-09-29T18:45:33.609350] [WARN ] [MAIN ] FHN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:45:33.605212] [INFO ] [MAIN ] FFWM: Full history saved. [2025-09-29T18:45:33.609936] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-09-29T18:45:33.610214] [INFO ] [MAIN ] Update Progress: 828/2371 symbols completed. FFWM took 38.1s. Estimated remaining: 3h 16m 37s. Rate: 7.8 symbols/min [2025-09-29T18:45:33.610088] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-09-29T18:45:33.616320] [DEBUG] [LOCAL ] FHN: Deleted primary data file. [2025-09-29T18:45:33.655510] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-09-29T18:45:33.929546] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:45:34.174138] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-29T18:45:34.214472] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-01. [2025-09-29T18:45:34.284133] [INFO ] [REMOTE ] FHN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:45:34.297949] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-29T18:45:34.327693] [DEBUG] [LOCAL ] FI: Loaded 54281 existing records from primary storage. [2025-09-29T18:45:34.328471] [INFO ] [MAIN ] FI: Loaded 54281 existing records. [2025-09-29T18:45:34.567715] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:45:34.567995] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-09-29T18:45:34.568058] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-09-29T18:45:34.568839] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-09-29T18:45:34.568902] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-09-29T18:45:34.755610] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-09-29T18:45:35.037150] [INFO ] [REMOTE ] FI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:45:35.548197] [INFO ] [REMOTE ] FI: Fetching primary data for 2024-12. [2025-09-29T18:45:36.205294] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-29T18:45:36.348125] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-09-29T18:45:36.379866] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-29T18:45:36.384479] [INFO ] [REMOTE ] FG: Full fetch complete (27265 records). [2025-09-29T18:45:36.384607] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-09-29T18:45:36.385189] [FATAL] [VALIDATOR ] FG: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:45:36.385300] [FATAL] [MAIN ] FG: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:45:36.385346] [WARN ] [MAIN ] FG: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:45:36.385387] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-09-29T18:45:36.385447] [DEBUG] [LOCAL ] FG: No primary data file found to delete. [2025-09-29T18:45:36.385484] [INFO ] [LOCAL ] FG: Starting deletion of derivative data. [2025-09-29T18:45:36.386062] [DEBUG] [LOCAL ] FG: Deleted derivative data file. [2025-09-29T18:45:36.386162] [INFO ] [MAIN ] Update Progress: 829/2371 symbols completed. FG took 25.6s. Estimated remaining: 3h 16m 21s. Rate: 7.9 symbols/min [2025-09-29T18:45:36.578457] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:45:36.602372] [DEBUG] [LOCAL ] FICO: Loaded 20674 existing records from primary storage. [2025-09-29T18:45:36.602634] [INFO ] [MAIN ] FICO: Loaded 20674 existing records. [2025-09-29T18:45:36.810257] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:45:36.810505] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-09-29T18:45:36.810553] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-09-29T18:45:36.810861] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-09-29T18:45:36.810924] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-09-29T18:45:37.148889] [INFO ] [REMOTE ] FHN: Fetching primary data for 2024-12. [2025-09-29T18:45:37.215728] [INFO ] [REMOTE ] FICO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:45:37.252694] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-29T18:45:37.355165] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-29T18:45:37.948173] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-09-29T18:45:38.748157] [INFO ] [REMOTE ] FICO: Fetching primary data for 2024-12. [2025-09-29T18:45:38.982946] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-29T18:45:39.518970] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-29T18:45:39.548148] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-09-29T18:45:39.759537] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-29T18:45:40.348163] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-01. [2025-09-29T18:45:41.148166] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-09-29T18:45:41.445154] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-29T18:45:41.503812] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-29T18:45:41.948162] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-09-29T18:45:42.748147] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-09-29T18:45:42.811443] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-29T18:45:43.548123] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-09-29T18:45:43.688292] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-29T18:45:44.133858] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-29T18:45:44.348131] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-09-29T18:45:44.939418] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-29T18:45:45.148126] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-09-29T18:45:45.948092] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-09-29T18:45:46.345088] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-29T18:45:46.594726] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-29T18:45:46.748111] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-09-29T18:45:47.548116] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-09-29T18:45:47.614175] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-29T18:45:48.348123] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-09-29T18:45:48.697863] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-29T18:45:48.715449] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-29T18:45:49.148119] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-09-29T18:45:49.930217] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-29T18:45:49.948069] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-09-29T18:45:50.329471] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-29T18:45:50.748122] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-09-29T18:45:51.429161] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-29T18:45:51.548118] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-09-29T18:45:52.348128] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-09-29T18:45:52.714561] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-29T18:45:52.755771] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-29T18:45:53.148106] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-09-29T18:45:53.588423] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-29T18:45:53.597775] [INFO ] [REMOTE ] FHI: Full fetch complete (57527 records). [2025-09-29T18:45:53.597954] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-09-29T18:45:53.600456] [FATAL] [VALIDATOR ] FHI: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:45:53.600608] [FATAL] [MAIN ] FHI: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:45:53.600735] [WARN ] [MAIN ] FHI: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:45:53.600844] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-09-29T18:45:53.600963] [DEBUG] [LOCAL ] FHI: No primary data file found to delete. [2025-09-29T18:45:53.601049] [INFO ] [LOCAL ] FHI: Starting deletion of derivative data. [2025-09-29T18:45:53.601585] [DEBUG] [LOCAL ] FHI: Deleted derivative data file. [2025-09-29T18:45:53.601777] [INFO ] [MAIN ] Update Progress: 830/2371 symbols completed. FHI took 28.3s. Estimated remaining: 3h 16m 31s. Rate: 7.8 symbols/min [2025-09-29T18:45:53.793795] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:45:53.794010] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-09-29T18:45:53.794107] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-09-29T18:45:53.794236] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-09-29T18:45:53.794280] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-09-29T18:45:53.794324] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-09-29T18:45:53.794359] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-09-29T18:45:53.953200] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-09-29T18:45:54.184244] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:45:54.481750] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-29T18:45:54.748114] [INFO ] [REMOTE ] FIG: Fetching primary data for 2024-12. [2025-09-29T18:45:55.197014] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-29T18:45:55.548181] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-09-29T18:45:55.787780] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.24 seconds). [2025-09-29T18:45:55.918560] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-29T18:45:56.348124] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-09-29T18:45:56.687008] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-29T18:45:57.148110] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-09-29T18:45:57.948145] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-09-29T18:45:58.748158] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-09-29T18:45:58.984911] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-09-29T18:45:59.548121] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-09-29T18:45:59.693008] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-29T18:45:59.913262] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-29T18:46:00.021877] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (2.87 seconds). [2025-09-29T18:46:00.348125] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-09-29T18:46:00.809666] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-29T18:46:01.148143] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-09-29T18:46:01.948158] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-09-29T18:46:02.491610] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-29T18:46:02.748134] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-09-29T18:46:03.548122] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-09-29T18:46:03.751857] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-29T18:46:03.835044] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T18:46:03.835367] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-09-29T18:46:03.835487] [FATAL] [REMOTE ] FIG: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T18:46:03.835564] [FATAL] [MAIN ] FIG: Failed to fetch primary data. [2025-09-29T18:46:03.835628] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T18:46:03.835732] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-09-29T18:46:03.835828] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-09-29T18:46:03.835914] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-09-29T18:46:03.835997] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-09-29T18:46:03.836084] [INFO ] [MAIN ] Update Progress: 831/2371 symbols completed. FIG took 10.2s. Estimated remaining: 3h 16m 28s. Rate: 7.8 symbols/min [2025-09-29T18:46:04.036930] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:46:04.083193] [DEBUG] [LOCAL ] FIGS: Loaded 49651 existing records from primary storage. [2025-09-29T18:46:04.083535] [INFO ] [MAIN ] FIGS: Loaded 49651 existing records. [2025-09-29T18:46:04.283764] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-29T18:46:04.296839] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:46:04.303764] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-09-29T18:46:04.303850] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-09-29T18:46:04.304777] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-09-29T18:46:04.304840] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-09-29T18:46:04.353293] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-09-29T18:46:04.711827] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:46:05.148135] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-09-29T18:46:05.916682] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-29T18:46:05.948148] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2024-12. [2025-09-29T18:46:06.748149] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-09-29T18:46:07.245051] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-29T18:46:07.526345] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-29T18:46:07.548078] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-01. [2025-09-29T18:46:08.178747] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-29T18:46:08.183270] [INFO ] [REMOTE ] FICO: Full fetch complete (28414 records). [2025-09-29T18:46:08.183395] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-09-29T18:46:08.357166] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-09-29T18:46:08.593234] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-09-29T18:46:08.593331] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-09-29T18:46:08.594015] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-09-29T18:46:08.594144] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-09-29T18:46:08.595037] [DEBUG] [LOCAL ] FICO: Trimmed 28414 records to 20330 (keeping 200 days of data) [2025-09-29T18:46:08.737742] [DEBUG] [LOCAL ] FICO: Primary data saved (20330 records). [2025-09-29T18:46:08.737913] [INFO ] [MAIN ] FICO: Full history saved. [2025-09-29T18:46:08.738063] [INFO ] [MAIN ] Update Progress: 832/2371 symbols completed. FICO took 32.4s. Estimated remaining: 3h 16m 15s. Rate: 7.8 symbols/min [2025-09-29T18:46:08.940128] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:46:08.987472] [DEBUG] [LOCAL ] FIHL: Loaded 40851 existing records from primary storage. [2025-09-29T18:46:08.987851] [INFO ] [MAIN ] FIHL: Loaded 40851 existing records. [2025-09-29T18:46:09.152493] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-09-29T18:46:09.188884] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:46:09.190579] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-09-29T18:46:09.190778] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-09-29T18:46:09.191756] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-09-29T18:46:09.191856] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-09-29T18:46:09.320587] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-29T18:46:09.661616] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:46:09.948126] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-09-29T18:46:10.391908] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-29T18:46:10.748121] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-09-29T18:46:10.998956] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-29T18:46:11.224183] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-29T18:46:11.548175] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2024-12. [2025-09-29T18:46:12.348321] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-09-29T18:46:12.857406] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-29T18:46:12.922272] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-29T18:46:13.148172] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-09-29T18:46:13.948077] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-09-29T18:46:14.380844] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-29T18:46:14.393793] [INFO ] [REMOTE ] FHN: Full fetch complete (77280 records). [2025-09-29T18:46:14.393963] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-09-29T18:46:14.539491] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-29T18:46:14.754926] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-09-29T18:46:14.863913] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-09-29T18:46:14.864005] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-09-29T18:46:14.865105] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-09-29T18:46:14.865186] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-09-29T18:46:14.866891] [DEBUG] [LOCAL ] FHN: Trimmed 77280 records to 53366 (keeping 200 days of data) [2025-09-29T18:46:15.236090] [DEBUG] [LOCAL ] FHN: Primary data saved (53366 records). [2025-09-29T18:46:15.236378] [INFO ] [MAIN ] FHN: Full history saved. [2025-09-29T18:46:15.236521] [INFO ] [MAIN ] Update Progress: 833/2371 symbols completed. FHN took 42.5s. Estimated remaining: 3h 16m 5s. Rate: 7.8 symbols/min [2025-09-29T18:46:15.444246] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:46:15.454751] [DEBUG] [LOCAL ] FINS: Loaded 8309 existing records from primary storage. [2025-09-29T18:46:15.454979] [INFO ] [MAIN ] FINS: Loaded 8309 existing records. [2025-09-29T18:46:15.550590] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-09-29T18:46:15.649948] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:46:15.650255] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-09-29T18:46:15.650332] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-09-29T18:46:15.650870] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-09-29T18:46:15.650988] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-09-29T18:46:15.810019] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-29T18:46:16.074765] [INFO ] [REMOTE ] FINS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:46:16.348077] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-09-29T18:46:16.462667] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-29T18:46:17.121608] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-29T18:46:17.148144] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-09-29T18:46:17.953330] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-09-29T18:46:17.969159] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-29T18:46:18.748118] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-09-29T18:46:19.353890] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-29T18:46:19.366128] [INFO ] [REMOTE ] FI: Full fetch complete (77169 records). [2025-09-29T18:46:19.366371] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-09-29T18:46:19.566224] [INFO ] [REMOTE ] FINS: Fetching primary data for 2024-12. [2025-09-29T18:46:19.804680] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-29T18:46:19.858956] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-09-29T18:46:19.859043] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-09-29T18:46:19.860040] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-09-29T18:46:19.860109] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-09-29T18:46:19.861699] [DEBUG] [LOCAL ] FI: Trimmed 77169 records to 53497 (keeping 200 days of data) [2025-09-29T18:46:20.224168] [DEBUG] [LOCAL ] FI: Primary data saved (53497 records). [2025-09-29T18:46:20.224351] [INFO ] [MAIN ] FI: Full history saved. [2025-09-29T18:46:20.224474] [INFO ] [MAIN ] Update Progress: 834/2371 symbols completed. FI took 46.6s. Estimated remaining: 3h 15m 53s. Rate: 7.8 symbols/min [2025-09-29T18:46:20.351157] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-09-29T18:46:20.422560] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:46:20.468337] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-29T18:46:20.470931] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-29T18:46:20.525247] [DEBUG] [LOCAL ] FINV: Loaded 45772 existing records from primary storage. [2025-09-29T18:46:20.525626] [INFO ] [MAIN ] FINV: Loaded 45772 existing records. [2025-09-29T18:46:20.712944] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:46:20.713181] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-09-29T18:46:20.713230] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-09-29T18:46:20.713781] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-09-29T18:46:20.713840] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-09-29T18:46:21.098262] [INFO ] [REMOTE ] FINV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:46:21.148113] [INFO ] [REMOTE ] FINV: Fetching primary data for 2024-12. [2025-09-29T18:46:21.948151] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-09-29T18:46:22.009298] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-29T18:46:22.171001] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-29T18:46:22.748164] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-01. [2025-09-29T18:46:23.485831] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-29T18:46:23.548087] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-09-29T18:46:23.642367] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-29T18:46:24.348165] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-09-29T18:46:25.095348] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-29T18:46:25.148167] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-01. [2025-09-29T18:46:25.948111] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-09-29T18:46:26.103300] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-29T18:46:26.653825] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-29T18:46:26.658576] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-29T18:46:26.748126] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-09-29T18:46:27.548206] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-09-29T18:46:28.348138] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-09-29T18:46:28.500512] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-29T18:46:29.037157] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-29T18:46:29.148158] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-09-29T18:46:29.820136] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-29T18:46:29.948140] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-09-29T18:46:30.546824] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-29T18:46:30.748128] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-09-29T18:46:31.548159] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-09-29T18:46:31.811228] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-29T18:46:31.822113] [INFO ] [REMOTE ] FIGS: Full fetch complete (71058 records). [2025-09-29T18:46:31.822282] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-09-29T18:46:32.251007] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-09-29T18:46:32.251125] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-09-29T18:46:32.252084] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-09-29T18:46:32.252168] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-09-29T18:46:32.253761] [DEBUG] [LOCAL ] FIGS: Trimmed 71058 records to 48861 (keeping 200 days of data) [2025-09-29T18:46:32.353685] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-09-29T18:46:32.491166] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-29T18:46:32.584241] [DEBUG] [LOCAL ] FIGS: Primary data saved (48861 records). [2025-09-29T18:46:32.584383] [INFO ] [MAIN ] FIGS: Full history saved. [2025-09-29T18:46:32.584484] [INFO ] [MAIN ] Update Progress: 835/2371 symbols completed. FIGS took 28.7s. Estimated remaining: 3h 15m 54s. Rate: 7.8 symbols/min [2025-09-29T18:46:32.765277] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:46:32.792699] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-29T18:46:32.855971] [DEBUG] [LOCAL ] FIS: Loaded 54144 existing records from primary storage. [2025-09-29T18:46:32.856353] [INFO ] [MAIN ] FIS: Loaded 54144 existing records. [2025-09-29T18:46:32.989693] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-29T18:46:33.057813] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:46:33.058112] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-09-29T18:46:33.058173] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-09-29T18:46:33.058985] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-09-29T18:46:33.059069] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-09-29T18:46:33.153363] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-09-29T18:46:33.474836] [INFO ] [REMOTE ] FIS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:46:33.938864] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-29T18:46:33.948061] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-09-29T18:46:34.748150] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-09-29T18:46:34.782921] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-29T18:46:35.548170] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-09-29T18:46:36.348131] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-09-29T18:46:36.373583] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-29T18:46:36.458220] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-29T18:46:37.148122] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-09-29T18:46:37.948148] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-09-29T18:46:38.008229] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-29T18:46:38.017109] [INFO ] [REMOTE ] FIHL: Full fetch complete (55757 records). [2025-09-29T18:46:38.017276] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-09-29T18:46:38.432886] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-09-29T18:46:38.433012] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-09-29T18:46:38.433992] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-09-29T18:46:38.434061] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-09-29T18:46:38.435400] [DEBUG] [LOCAL ] FIHL: Trimmed 55757 records to 39998 (keeping 200 days of data) [2025-09-29T18:46:38.738963] [DEBUG] [LOCAL ] FIHL: Primary data saved (39998 records). [2025-09-29T18:46:38.740164] [INFO ] [MAIN ] FIHL: Full history saved. [2025-09-29T18:46:38.729798] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-29T18:46:38.741576] [INFO ] [MAIN ] Update Progress: 836/2371 symbols completed. FIHL took 30.0s. Estimated remaining: 3h 15m 44s. Rate: 7.8 symbols/min [2025-09-29T18:46:38.741187] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-29T18:46:38.781755] [INFO ] [REMOTE ] FIS: Fetching primary data for 2024-12. [2025-09-29T18:46:38.949820] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:46:38.989064] [DEBUG] [LOCAL ] FIX: Loaded 30763 existing records from primary storage. [2025-09-29T18:46:38.989380] [INFO ] [MAIN ] FIX: Loaded 30763 existing records. [2025-09-29T18:46:39.190749] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:46:39.191030] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-09-29T18:46:39.191082] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-09-29T18:46:39.191524] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-09-29T18:46:39.191585] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-09-29T18:46:39.553248] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-09-29T18:46:39.615597] [INFO ] [REMOTE ] FIX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:46:40.348126] [INFO ] [REMOTE ] FIX: Fetching primary data for 2024-12. [2025-09-29T18:46:40.614843] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-29T18:46:41.148138] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-01. [2025-09-29T18:46:41.193920] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-29T18:46:41.222962] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-29T18:46:41.948116] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-09-29T18:46:42.566050] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-29T18:46:42.748140] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-09-29T18:46:42.998835] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-29T18:46:43.548119] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-09-29T18:46:44.250981] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-29T18:46:44.348125] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-09-29T18:46:44.397024] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-29T18:46:44.399797] [INFO ] [REMOTE ] FINS: Full fetch complete (12431 records). [2025-09-29T18:46:44.399878] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-09-29T18:46:44.811463] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-09-29T18:46:44.811581] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-09-29T18:46:44.812105] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-09-29T18:46:44.812188] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-09-29T18:46:44.813022] [DEBUG] [LOCAL ] FINS: Trimmed 12431 records to 8262 (keeping 200 days of data) [2025-09-29T18:46:44.878625] [DEBUG] [LOCAL ] FINS: Primary data saved (8262 records). [2025-09-29T18:46:44.878807] [INFO ] [MAIN ] FINS: Full history saved. [2025-09-29T18:46:44.878901] [INFO ] [MAIN ] Update Progress: 837/2371 symbols completed. FINS took 29.6s. Estimated remaining: 3h 15m 33s. Rate: 7.8 symbols/min [2025-09-29T18:46:45.148133] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-09-29T18:46:45.948114] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-01. [2025-09-29T18:46:46.210847] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-29T18:46:46.748148] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-09-29T18:46:46.900377] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-29T18:46:47.030785] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-29T18:46:47.548115] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-09-29T18:46:48.348156] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-09-29T18:46:48.553714] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-29T18:46:48.563789] [INFO ] [REMOTE ] FINV: Full fetch complete (63517 records). [2025-09-29T18:46:48.563973] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-09-29T18:46:48.999861] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-09-29T18:46:48.999971] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-09-29T18:46:49.000899] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-09-29T18:46:49.001034] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-09-29T18:46:49.002751] [DEBUG] [LOCAL ] FINV: Trimmed 63517 records to 45191 (keeping 200 days of data) [2025-09-29T18:46:49.286114] [DEBUG] [LOCAL ] FINV: Primary data saved (45191 records). [2025-09-29T18:46:49.286292] [INFO ] [MAIN ] FINV: Full history saved. [2025-09-29T18:46:49.286402] [INFO ] [MAIN ] Update Progress: 838/2371 symbols completed. FINV took 29.1s. Estimated remaining: 3h 15m 20s. Rate: 7.8 symbols/min [2025-09-29T18:46:49.495082] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-29T18:46:49.507209] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-09-29T18:46:49.891087] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-29T18:46:49.948144] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-09-29T18:46:51.411903] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-29T18:46:51.425922] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-09-29T18:46:51.628580] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-29T18:46:51.637790] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-09-29T18:46:53.212912] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-29T18:46:53.225170] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-09-29T18:46:53.255530] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-29T18:46:53.264581] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-09-29T18:46:54.692474] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-29T18:46:54.699810] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-09-29T18:46:54.984381] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-29T18:46:54.996126] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-09-29T18:46:55.987068] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-29T18:46:55.993470] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-09-29T18:46:56.761405] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-29T18:46:56.773954] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-09-29T18:46:57.451916] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-29T18:46:57.459507] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-09-29T18:46:58.700684] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-29T18:46:58.710409] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-09-29T18:47:00.124188] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-29T18:47:00.130853] [INFO ] [REMOTE ] FIX: Full fetch complete (45609 records). [2025-09-29T18:47:00.131050] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-09-29T18:47:00.563687] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-09-29T18:47:00.563810] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-09-29T18:47:00.564771] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-09-29T18:47:00.564905] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-09-29T18:47:00.566550] [DEBUG] [LOCAL ] FIX: Trimmed 45609 records to 30013 (keeping 200 days of data) [2025-09-29T18:47:00.720196] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (3.95 seconds). [2025-09-29T18:47:00.735530] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-09-29T18:47:00.846685] [DEBUG] [LOCAL ] FIX: Primary data saved (30013 records). [2025-09-29T18:47:00.846842] [INFO ] [MAIN ] FIX: Full history saved. [2025-09-29T18:47:00.846949] [INFO ] [MAIN ] Update Progress: 839/2371 symbols completed. FIX took 22.1s. Estimated remaining: 3h 15m 19s. Rate: 7.8 symbols/min [2025-09-29T18:47:02.694118] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-29T18:47:02.705059] [INFO ] [REMOTE ] FIS: Full fetch complete (77176 records). [2025-09-29T18:47:02.705194] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-09-29T18:47:03.127083] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-09-29T18:47:03.127178] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-09-29T18:47:03.128374] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-09-29T18:47:03.128451] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-09-29T18:47:03.130063] [DEBUG] [LOCAL ] FIS: Trimmed 77176 records to 53364 (keeping 200 days of data) [2025-09-29T18:47:03.486142] [DEBUG] [LOCAL ] FIS: Primary data saved (53364 records). [2025-09-29T18:47:03.486811] [INFO ] [MAIN ] FIS: Full history saved. [2025-09-29T18:47:03.487037] [INFO ] [MAIN ] Update Progress: 840/2371 symbols completed. FIS took 30.9s. Estimated remaining: 3h 15m 2s. Rate: 7.8 symbols/min [2025-09-29T18:47:04.178887] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:47:04.180114] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:47:04.229617] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-09-29T18:47:04.229450] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:47:04.245746] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-09-29T18:47:04.249388] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-09-29T18:47:04.270502] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-09-29T18:47:04.270129] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:47:04.270765] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-09-29T18:47:04.270823] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-09-29T18:47:04.369705] [DEBUG] [LOCAL ] FLC: Loaded 5559 existing records from primary storage. [2025-09-29T18:47:04.398330] [INFO ] [MAIN ] FLC: Loaded 5559 existing records. [2025-09-29T18:47:04.583882] [DEBUG] [LOCAL ] FLNG: Loaded 34431 existing records from primary storage. [2025-09-29T18:47:04.650484] [INFO ] [MAIN ] FLNG: Loaded 34431 existing records. [2025-09-29T18:47:04.847051] [DEBUG] [LOCAL ] FLG: Loaded 54105 existing records from primary storage. [2025-09-29T18:47:04.884465] [INFO ] [MAIN ] FLG: Loaded 54105 existing records. [2025-09-29T18:47:04.904031] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:47:04.995572] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-09-29T18:47:05.103439] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-09-29T18:47:05.167143] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-09-29T18:47:05.167570] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-09-29T18:47:05.167060] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:47:05.242074] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2024-12. [2025-09-29T18:47:05.372793] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:47:05.422433] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-09-29T18:47:05.422320] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:47:05.436407] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-09-29T18:47:05.457639] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-09-29T18:47:05.461574] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-09-29T18:47:05.461778] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-09-29T18:47:05.467733] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-09-29T18:47:05.462279] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-09-29T18:47:05.478213] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-09-29T18:47:05.627881] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T18:47:05.706096] [WARN ] [REMOTE ] FIXT: No data returned for month 2024-12 [2025-09-29T18:47:05.798665] [FATAL] [REMOTE ] FIXT: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T18:47:05.894463] [FATAL] [MAIN ] FIXT: Failed to fetch primary data. [2025-09-29T18:47:06.002627] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T18:47:06.030038] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-09-29T18:47:06.120662] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-09-29T18:47:06.221102] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-09-29T18:47:06.258359] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-09-29T18:47:06.373449] [INFO ] [REMOTE ] FLC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:47:06.319696] [INFO ] [MAIN ] Update Progress: 841/2371 symbols completed. FIXT took 2.8s. Estimated remaining: 3h 14m 46s. Rate: 7.9 symbols/min [2025-09-29T18:47:06.399606] [INFO ] [REMOTE ] FLC: Fetching primary data for 2024-12. [2025-09-29T18:47:06.594958] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:47:06.635215] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2024-12. [2025-09-29T18:47:06.685384] [INFO ] [REMOTE ] FLG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:47:06.691219] [INFO ] [REMOTE ] FLG: Fetching primary data for 2024-12. [2025-09-29T18:47:06.762870] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:47:06.820399] [DEBUG] [LOCAL ] FLO: Loaded 52656 existing records from primary storage. [2025-09-29T18:47:06.820804] [INFO ] [MAIN ] FLO: Loaded 52656 existing records. [2025-09-29T18:47:07.004379] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:47:07.004775] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-09-29T18:47:07.004836] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-09-29T18:47:07.005880] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-09-29T18:47:07.005975] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-09-29T18:47:07.252313] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-29T18:47:07.277341] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-01. [2025-09-29T18:47:07.398094] [INFO ] [REMOTE ] FLO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:47:07.398434] [INFO ] [REMOTE ] FLO: Fetching primary data for 2024-12. [2025-09-29T18:47:07.982003] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-29T18:47:07.983975] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-09-29T18:47:08.187922] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-29T18:47:08.196379] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-09-29T18:47:08.329787] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-29T18:47:08.331372] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-09-29T18:47:08.512805] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-29T18:47:08.526609] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-01. [2025-09-29T18:47:09.071785] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-29T18:47:09.078162] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-29T18:47:09.079328] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-09-29T18:47:09.091579] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-01. [2025-09-29T18:47:09.720521] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-29T18:47:09.728512] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-09-29T18:47:09.782962] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-29T18:47:09.948135] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-09-29T18:47:10.033877] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-29T18:47:10.724451] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-29T18:47:10.750910] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-09-29T18:47:10.752608] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-29T18:47:11.264552] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-29T18:47:11.548115] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-09-29T18:47:12.107508] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-29T18:47:12.348110] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-09-29T18:47:13.069665] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-29T18:47:13.148087] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-09-29T18:47:13.948144] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-09-29T18:47:14.079202] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-29T18:47:14.559890] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-29T18:47:14.627171] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-29T18:47:14.748186] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-09-29T18:47:15.548172] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-09-29T18:47:16.212119] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-29T18:47:16.348139] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-09-29T18:47:16.492591] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-29T18:47:17.148154] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-09-29T18:47:17.728039] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-29T18:47:17.948134] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-09-29T18:47:18.593077] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-29T18:47:18.748120] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-09-29T18:47:19.312118] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-29T18:47:19.466404] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-29T18:47:19.548123] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-09-29T18:47:20.285300] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-29T18:47:20.287210] [INFO ] [REMOTE ] FLC: Full fetch complete (8011 records). [2025-09-29T18:47:20.287311] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-09-29T18:47:20.353256] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-09-29T18:47:20.696842] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-09-29T18:47:20.697000] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-09-29T18:47:20.697259] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-09-29T18:47:20.697342] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-09-29T18:47:20.698257] [DEBUG] [LOCAL ] FLC: Trimmed 8011 records to 5476 (keeping 200 days of data) [2025-09-29T18:47:20.734859] [DEBUG] [LOCAL ] FLC: Primary data saved (5476 records). [2025-09-29T18:47:20.735002] [INFO ] [MAIN ] FLC: Full history saved. [2025-09-29T18:47:20.735186] [INFO ] [MAIN ] Update Progress: 842/2371 symbols completed. FLC took 17.2s. Estimated remaining: 3h 14m 51s. Rate: 7.8 symbols/min [2025-09-29T18:47:20.910387] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:47:20.910568] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-09-29T18:47:20.910623] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-09-29T18:47:20.910779] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-09-29T18:47:20.910831] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-09-29T18:47:20.910899] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-09-29T18:47:20.910935] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-09-29T18:47:21.158106] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-09-29T18:47:21.283951] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:47:21.948168] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2024-12. [2025-09-29T18:47:21.985396] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-29T18:47:22.166709] [DEBUG] [REMOTE ] FLOC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T18:47:22.167162] [WARN ] [REMOTE ] FLOC: No data returned for month 2024-12 [2025-09-29T18:47:22.167298] [FATAL] [REMOTE ] FLOC: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T18:47:22.167420] [FATAL] [MAIN ] FLOC: Failed to fetch primary data. [2025-09-29T18:47:22.167525] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T18:47:22.167626] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-09-29T18:47:22.167776] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-09-29T18:47:22.167865] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-09-29T18:47:22.167968] [DEBUG] [LOCAL ] FLOC: No derivative data file found to delete. [2025-09-29T18:47:22.168076] [INFO ] [MAIN ] Update Progress: 843/2371 symbols completed. FLOC took 1.4s. Estimated remaining: 3h 14m 32s. Rate: 7.9 symbols/min [2025-09-29T18:47:22.362403] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:47:22.432907] [DEBUG] [LOCAL ] FLR: Loaded 53892 existing records from primary storage. [2025-09-29T18:47:22.433341] [INFO ] [MAIN ] FLR: Loaded 53892 existing records. [2025-09-29T18:47:22.627454] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:47:22.627983] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-09-29T18:47:22.628343] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-09-29T18:47:22.640152] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-09-29T18:47:22.640243] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-09-29T18:47:22.732700] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-29T18:47:22.761323] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-09-29T18:47:23.077332] [INFO ] [REMOTE ] FLR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:47:23.548110] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-09-29T18:47:24.348157] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-09-29T18:47:24.591543] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-29T18:47:25.044680] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-29T18:47:25.148160] [INFO ] [REMOTE ] FLR: Fetching primary data for 2024-12. [2025-09-29T18:47:25.843791] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-29T18:47:25.948109] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-09-29T18:47:26.748163] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-09-29T18:47:26.891638] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-29T18:47:27.122839] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-29T18:47:27.131530] [INFO ] [REMOTE ] FLNG: Full fetch complete (50784 records). [2025-09-29T18:47:27.131703] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-09-29T18:47:27.553827] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-09-29T18:47:27.573463] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-09-29T18:47:27.573594] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-09-29T18:47:27.575780] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-09-29T18:47:27.576023] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-09-29T18:47:27.577409] [DEBUG] [LOCAL ] FLNG: Trimmed 50784 records to 33774 (keeping 200 days of data) [2025-09-29T18:47:27.801878] [DEBUG] [LOCAL ] FLNG: Primary data saved (33774 records). [2025-09-29T18:47:27.802034] [INFO ] [MAIN ] FLNG: Full history saved. [2025-09-29T18:47:27.802126] [INFO ] [MAIN ] Update Progress: 844/2371 symbols completed. FLNG took 24.3s. Estimated remaining: 3h 14m 20s. Rate: 7.9 symbols/min [2025-09-29T18:47:27.981331] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:47:28.042851] [DEBUG] [LOCAL ] FLS: Loaded 50934 existing records from primary storage. [2025-09-29T18:47:28.043198] [INFO ] [MAIN ] FLS: Loaded 50934 existing records. [2025-09-29T18:47:28.242686] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:47:28.242896] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-09-29T18:47:28.242945] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-09-29T18:47:28.243597] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-09-29T18:47:28.243706] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-09-29T18:47:28.352840] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-01. [2025-09-29T18:47:28.631356] [INFO ] [REMOTE ] FLS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:47:28.662659] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-29T18:47:29.148114] [INFO ] [REMOTE ] FLS: Fetching primary data for 2024-12. [2025-09-29T18:47:29.468495] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-29T18:47:29.825132] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-29T18:47:29.948111] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-09-29T18:47:30.336611] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-29T18:47:30.748171] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-09-29T18:47:31.548167] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-01. [2025-09-29T18:47:31.629719] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-29T18:47:32.348128] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-09-29T18:47:32.783668] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-29T18:47:32.796347] [INFO ] [REMOTE ] FLO: Full fetch complete (74968 records). [2025-09-29T18:47:32.796530] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-09-29T18:47:33.149998] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-09-29T18:47:33.240344] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-09-29T18:47:33.240511] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-09-29T18:47:33.241546] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-09-29T18:47:33.241723] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-09-29T18:47:33.244168] [DEBUG] [LOCAL ] FLO: Trimmed 74968 records to 51900 (keeping 200 days of data) [2025-09-29T18:47:33.271430] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-29T18:47:33.616345] [DEBUG] [LOCAL ] FLO: Primary data saved (51900 records). [2025-09-29T18:47:33.616505] [INFO ] [MAIN ] FLO: Full history saved. [2025-09-29T18:47:33.616624] [INFO ] [MAIN ] Update Progress: 845/2371 symbols completed. FLO took 27.2s. Estimated remaining: 3h 14m 9s. Rate: 7.9 symbols/min [2025-09-29T18:47:33.809570] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:47:33.844315] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-29T18:47:33.901835] [DEBUG] [LOCAL ] FLUT: Loaded 51580 existing records from primary storage. [2025-09-29T18:47:33.902218] [INFO ] [MAIN ] FLUT: Loaded 51580 existing records. [2025-09-29T18:47:33.953252] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-09-29T18:47:34.100968] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:47:34.101219] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-09-29T18:47:34.101268] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-09-29T18:47:34.101823] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-09-29T18:47:34.101884] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-09-29T18:47:34.491141] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:47:34.748135] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-09-29T18:47:35.087837] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-29T18:47:35.548149] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-09-29T18:47:35.669037] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-29T18:47:36.195744] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-29T18:47:36.348104] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-09-29T18:47:37.022562] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-29T18:47:37.148115] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2024-12. [2025-09-29T18:47:37.948103] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-09-29T18:47:38.126251] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-29T18:47:38.748156] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-09-29T18:47:38.885755] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-29T18:47:39.548136] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-01. [2025-09-29T18:47:39.908815] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-29T18:47:40.353279] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-09-29T18:47:40.374566] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-29T18:47:41.148110] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-09-29T18:47:41.231630] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-29T18:47:41.948121] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-09-29T18:47:42.748198] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-09-29T18:47:42.824578] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-09-29T18:47:43.548136] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-09-29T18:47:44.587708] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (3.44 seconds). [2025-09-29T18:47:44.598219] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-09-29T18:47:44.643510] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (2.70 seconds). [2025-09-29T18:47:45.035276] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-29T18:47:45.148101] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-09-29T18:47:45.737269] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-29T18:47:45.948093] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-09-29T18:47:46.164596] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-29T18:47:46.748108] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-09-29T18:47:47.091807] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-29T18:47:47.548125] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-09-29T18:47:47.918249] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-29T18:47:48.348106] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-09-29T18:47:48.384494] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-29T18:47:49.148097] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-09-29T18:47:49.319125] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-29T18:47:49.948110] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-09-29T18:47:50.303192] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-29T18:47:50.314290] [INFO ] [REMOTE ] FLR: Full fetch complete (76373 records). [2025-09-29T18:47:50.314444] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-09-29T18:47:50.756815] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-09-29T18:47:50.760767] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-09-29T18:47:50.761613] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-09-29T18:47:50.762617] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-09-29T18:47:50.762834] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-09-29T18:47:50.765099] [DEBUG] [LOCAL ] FLR: Trimmed 76373 records to 53111 (keeping 200 days of data) [2025-09-29T18:47:51.139530] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-29T18:47:51.156683] [DEBUG] [LOCAL ] FLR: Primary data saved (53111 records). [2025-09-29T18:47:51.157319] [INFO ] [MAIN ] FLR: Full history saved. [2025-09-29T18:47:51.157461] [INFO ] [MAIN ] Update Progress: 846/2371 symbols completed. FLR took 29.0s. Estimated remaining: 3h 14m 20s. Rate: 7.8 symbols/min [2025-09-29T18:47:51.364802] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:47:51.398368] [DEBUG] [LOCAL ] FLXR: Loaded 20315 existing records from primary storage. [2025-09-29T18:47:51.399210] [INFO ] [MAIN ] FLXR: Loaded 20315 existing records. [2025-09-29T18:47:51.549553] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-09-29T18:47:51.788007] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:47:51.793664] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-29T18:47:51.794075] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-09-29T18:47:51.794260] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-09-29T18:47:51.809364] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-09-29T18:47:51.809531] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-09-29T18:47:52.299615] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:47:52.348084] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2024-12. [2025-09-29T18:47:52.600030] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-29T18:47:53.148143] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-09-29T18:47:53.178489] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-29T18:47:53.463543] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-29T18:47:53.475429] [INFO ] [REMOTE ] FLG: Full fetch complete (77296 records). [2025-09-29T18:47:53.475595] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-09-29T18:47:53.891066] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-09-29T18:47:53.891157] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-09-29T18:47:53.892233] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-09-29T18:47:53.892302] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-09-29T18:47:53.893982] [DEBUG] [LOCAL ] FLG: Trimmed 77296 records to 53325 (keeping 200 days of data) [2025-09-29T18:47:53.956881] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-01. [2025-09-29T18:47:54.252186] [DEBUG] [LOCAL ] FLG: Primary data saved (53325 records). [2025-09-29T18:47:54.252341] [INFO ] [MAIN ] FLG: Full history saved. [2025-09-29T18:47:54.252475] [INFO ] [MAIN ] Update Progress: 847/2371 symbols completed. FLG took 50.8s. Estimated remaining: 3h 14m 4s. Rate: 7.9 symbols/min [2025-09-29T18:47:54.434528] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:47:54.491494] [DEBUG] [LOCAL ] FMC: Loaded 52560 existing records from primary storage. [2025-09-29T18:47:54.491857] [INFO ] [MAIN ] FMC: Loaded 52560 existing records. [2025-09-29T18:47:54.687963] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:47:54.688346] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-09-29T18:47:54.688410] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-09-29T18:47:54.689014] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-09-29T18:47:54.689079] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-09-29T18:47:54.754330] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-09-29T18:47:55.036170] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-29T18:47:55.120500] [INFO ] [REMOTE ] FMC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:47:55.151051] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-29T18:47:55.162465] [INFO ] [REMOTE ] FLS: Full fetch complete (71476 records). [2025-09-29T18:47:55.162715] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-09-29T18:47:55.558916] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-09-29T18:47:55.583606] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-09-29T18:47:55.583765] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-09-29T18:47:55.584801] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-09-29T18:47:55.585045] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-09-29T18:47:55.586710] [DEBUG] [LOCAL ] FLS: Trimmed 71476 records to 50154 (keeping 200 days of data) [2025-09-29T18:47:55.931589] [DEBUG] [LOCAL ] FLS: Primary data saved (50154 records). [2025-09-29T18:47:55.931761] [INFO ] [MAIN ] FLS: Full history saved. [2025-09-29T18:47:55.931854] [INFO ] [MAIN ] Update Progress: 848/2371 symbols completed. FLS took 28.1s. Estimated remaining: 3h 13m 45s. Rate: 7.9 symbols/min [2025-09-29T18:47:56.116462] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:47:56.125535] [DEBUG] [LOCAL ] FMN: Loaded 6097 existing records from primary storage. [2025-09-29T18:47:56.125770] [INFO ] [MAIN ] FMN: Loaded 6097 existing records. [2025-09-29T18:47:56.318101] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:47:56.318434] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-09-29T18:47:56.318490] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-09-29T18:47:56.319232] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-09-29T18:47:56.319504] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-09-29T18:47:56.353890] [INFO ] [REMOTE ] FMC: Fetching primary data for 2024-12. [2025-09-29T18:47:56.699065] [INFO ] [REMOTE ] FMN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:47:57.148113] [INFO ] [REMOTE ] FMN: Fetching primary data for 2024-12. [2025-09-29T18:47:57.172881] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-29T18:47:57.540503] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (2.79 seconds). [2025-09-29T18:47:57.948160] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-09-29T18:47:58.503296] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-29T18:47:58.583698] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-29T18:47:58.748160] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-01. [2025-09-29T18:47:58.929991] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-29T18:47:59.548137] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-09-29T18:48:00.348133] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-09-29T18:48:00.485269] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-29T18:48:00.537342] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-29T18:48:01.148096] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-09-29T18:48:01.948112] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-01. [2025-09-29T18:48:01.949885] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-29T18:48:02.238119] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-29T18:48:02.460186] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-29T18:48:02.748156] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-09-29T18:48:03.548098] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-09-29T18:48:03.750794] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-29T18:48:04.303710] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-29T18:48:04.348126] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-09-29T18:48:05.148116] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-09-29T18:48:05.948156] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-09-29T18:48:06.355541] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-29T18:48:06.748172] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-09-29T18:48:06.972251] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-29T18:48:07.029486] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-29T18:48:07.548127] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-09-29T18:48:08.348093] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-09-29T18:48:08.421613] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-29T18:48:08.547068] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-29T18:48:09.148131] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-09-29T18:48:09.950601] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-09-29T18:48:09.951628] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-29T18:48:10.158156] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-29T18:48:10.748162] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-09-29T18:48:11.548128] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-09-29T18:48:12.348131] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-09-29T18:48:12.878938] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (2.93 seconds). [2025-09-29T18:48:12.895467] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-29T18:48:13.066781] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-09-29T18:48:13.077471] [INFO ] [REMOTE ] FLUT: Full fetch complete (72765 records). [2025-09-29T18:48:13.077607] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-09-29T18:48:13.148258] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-09-29T18:48:13.507956] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-09-29T18:48:13.508169] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-09-29T18:48:13.514378] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-09-29T18:48:13.523115] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-09-29T18:48:13.524839] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-29T18:48:13.532175] [DEBUG] [LOCAL ] FLUT: Trimmed 72765 records to 50763 (keeping 200 days of data) [2025-09-29T18:48:13.851054] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-29T18:48:13.876585] [DEBUG] [LOCAL ] FLUT: Primary data saved (50763 records). [2025-09-29T18:48:13.876756] [INFO ] [MAIN ] FLUT: Full history saved. [2025-09-29T18:48:13.876850] [INFO ] [MAIN ] Update Progress: 849/2371 symbols completed. FLUT took 40.3s. Estimated remaining: 3h 13m 56s. Rate: 7.8 symbols/min [2025-09-29T18:48:13.953224] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-09-29T18:48:14.047965] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:48:14.078055] [DEBUG] [LOCAL ] FMS: Loaded 30771 existing records from primary storage. [2025-09-29T18:48:14.078333] [INFO ] [MAIN ] FMS: Loaded 30771 existing records. [2025-09-29T18:48:14.267534] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:48:14.267906] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-09-29T18:48:14.267971] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-09-29T18:48:14.268367] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-09-29T18:48:14.268457] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-09-29T18:48:14.649919] [INFO ] [REMOTE ] FMS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:48:14.748138] [INFO ] [REMOTE ] FMS: Fetching primary data for 2024-12. [2025-09-29T18:48:15.548130] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-09-29T18:48:16.035983] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-29T18:48:16.348155] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-09-29T18:48:16.536440] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-29T18:48:16.938477] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-29T18:48:16.944271] [INFO ] [REMOTE ] FLXR: Full fetch complete (25290 records). [2025-09-29T18:48:16.944364] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-09-29T18:48:17.155440] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-09-29T18:48:17.375769] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-09-29T18:48:17.375852] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-09-29T18:48:17.376504] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-09-29T18:48:17.376547] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-09-29T18:48:17.377513] [DEBUG] [LOCAL ] FLXR: Trimmed 25290 records to 20158 (keeping 200 days of data) [2025-09-29T18:48:17.516471] [DEBUG] [LOCAL ] FLXR: Primary data saved (20158 records). [2025-09-29T18:48:17.516606] [INFO ] [MAIN ] FLXR: Full history saved. [2025-09-29T18:48:17.516745] [INFO ] [MAIN ] Update Progress: 850/2371 symbols completed. FLXR took 26.4s. Estimated remaining: 3h 13m 42s. Rate: 7.9 symbols/min [2025-09-29T18:48:17.708783] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:48:17.760729] [DEBUG] [LOCAL ] FMX: Loaded 41276 existing records from primary storage. [2025-09-29T18:48:17.761085] [INFO ] [MAIN ] FMX: Loaded 41276 existing records. [2025-09-29T18:48:17.943605] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:48:17.943881] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-09-29T18:48:17.943974] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-09-29T18:48:17.944664] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-09-29T18:48:17.944725] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-09-29T18:48:17.976237] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-09-29T18:48:18.331599] [INFO ] [REMOTE ] FMX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:48:18.363625] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-29T18:48:18.390499] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-29T18:48:18.471059] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-29T18:48:18.748182] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-09-29T18:48:19.322616] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-29T18:48:19.548125] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-09-29T18:48:20.348128] [INFO ] [REMOTE ] FMX: Fetching primary data for 2024-12. [2025-09-29T18:48:20.755085] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-29T18:48:21.148122] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-09-29T18:48:21.753901] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-29T18:48:21.889519] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-29T18:48:21.891316] [INFO ] [REMOTE ] FMN: Full fetch complete (10055 records). [2025-09-29T18:48:21.891410] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-09-29T18:48:21.953312] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-01. [2025-09-29T18:48:22.294444] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-09-29T18:48:22.294535] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-09-29T18:48:22.294827] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-09-29T18:48:22.294903] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-09-29T18:48:22.295363] [DEBUG] [LOCAL ] FMN: Trimmed 10055 records to 5776 (keeping 200 days of data) [2025-09-29T18:48:22.332987] [DEBUG] [LOCAL ] FMN: Primary data saved (5776 records). [2025-09-29T18:48:22.333156] [INFO ] [MAIN ] FMN: Full history saved. [2025-09-29T18:48:22.333303] [INFO ] [MAIN ] Update Progress: 851/2371 symbols completed. FMN took 26.4s. Estimated remaining: 3h 13m 29s. Rate: 7.9 symbols/min [2025-09-29T18:48:22.526056] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:48:22.531324] [DEBUG] [LOCAL ] FMY: Loaded 1400 existing records from primary storage. [2025-09-29T18:48:22.531516] [INFO ] [MAIN ] FMY: Loaded 1400 existing records. [2025-09-29T18:48:22.726866] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:48:22.727083] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-09-29T18:48:22.727134] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-09-29T18:48:22.727547] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-09-29T18:48:22.727634] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-09-29T18:48:22.759327] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-09-29T18:48:23.127472] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:48:23.413878] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-29T18:48:23.548124] [INFO ] [REMOTE ] FMY: Fetching primary data for 2024-12. [2025-09-29T18:48:23.892585] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-09-29T18:48:24.348106] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-09-29T18:48:24.625988] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-29T18:48:25.148129] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-09-29T18:48:25.906300] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-29T18:48:25.948070] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-09-29T18:48:26.748145] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-09-29T18:48:26.886470] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-29T18:48:27.500812] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-29T18:48:27.548096] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-09-29T18:48:28.168746] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-29T18:48:28.348080] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-09-29T18:48:28.768073] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-29T18:48:28.971222] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-29T18:48:29.148125] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-09-29T18:48:29.948166] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-09-29T18:48:30.382928] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-29T18:48:30.748110] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-09-29T18:48:31.153638] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-29T18:48:31.164887] [INFO ] [REMOTE ] FMC: Full fetch complete (75034 records). [2025-09-29T18:48:31.165067] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-09-29T18:48:31.556423] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-09-29T18:48:31.602132] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-09-29T18:48:31.602240] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-09-29T18:48:31.603452] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-09-29T18:48:31.603540] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-09-29T18:48:31.605251] [DEBUG] [LOCAL ] FMC: Trimmed 75034 records to 51780 (keeping 200 days of data) [2025-09-29T18:48:31.939260] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-29T18:48:31.952685] [DEBUG] [LOCAL ] FMC: Primary data saved (51780 records). [2025-09-29T18:48:31.952841] [INFO ] [MAIN ] FMC: Full history saved. [2025-09-29T18:48:31.952940] [INFO ] [MAIN ] Update Progress: 852/2371 symbols completed. FMC took 37.7s. Estimated remaining: 3h 13m 25s. Rate: 7.9 symbols/min [2025-09-29T18:48:32.131553] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:48:32.177262] [DEBUG] [LOCAL ] FN: Loaded 39795 existing records from primary storage. [2025-09-29T18:48:32.177680] [INFO ] [MAIN ] FN: Loaded 39795 existing records. [2025-09-29T18:48:32.348825] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-09-29T18:48:32.378953] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:48:32.380385] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-09-29T18:48:32.380458] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-09-29T18:48:32.389458] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-09-29T18:48:32.405255] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-09-29T18:48:32.407031] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-29T18:48:32.813624] [INFO ] [REMOTE ] FN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:48:32.818889] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-29T18:48:33.148114] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-09-29T18:48:33.948259] [INFO ] [REMOTE ] FN: Fetching primary data for 2024-12. [2025-09-29T18:48:34.569737] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-29T18:48:34.748174] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-09-29T18:48:35.397295] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-29T18:48:35.548112] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-09-29T18:48:35.938819] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-29T18:48:35.968561] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-29T18:48:36.348120] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-01. [2025-09-29T18:48:37.148125] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-09-29T18:48:37.830717] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-29T18:48:37.948149] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-09-29T18:48:38.314080] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-29T18:48:38.694527] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-29T18:48:38.748161] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-09-29T18:48:39.548135] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-09-29T18:48:39.978301] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-29T18:48:40.295056] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-29T18:48:40.348122] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-09-29T18:48:41.148174] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-09-29T18:48:41.651347] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-29T18:48:41.948102] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-09-29T18:48:42.071988] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-29T18:48:42.527627] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-29T18:48:42.528896] [INFO ] [REMOTE ] FMY: Full fetch complete (1975 records). [2025-09-29T18:48:42.529004] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-09-29T18:48:42.757061] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-09-29T18:48:42.943062] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-09-29T18:48:42.943165] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-09-29T18:48:42.943336] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-09-29T18:48:42.943401] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-09-29T18:48:42.943819] [DEBUG] [LOCAL ] FMY: Trimmed 1975 records to 1400 (keeping 200 days of data) [2025-09-29T18:48:42.954414] [DEBUG] [LOCAL ] FMY: Primary data saved (1400 records). [2025-09-29T18:48:42.954479] [INFO ] [MAIN ] FMY: Full history saved. [2025-09-29T18:48:42.954549] [INFO ] [MAIN ] Update Progress: 853/2371 symbols completed. FMY took 20.6s. Estimated remaining: 3h 13m 23s. Rate: 7.8 symbols/min [2025-09-29T18:48:43.129671] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:48:43.186985] [DEBUG] [LOCAL ] FNB: Loaded 53226 existing records from primary storage. [2025-09-29T18:48:43.187318] [INFO ] [MAIN ] FNB: Loaded 53226 existing records. [2025-09-29T18:48:43.374530] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:48:43.374810] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-09-29T18:48:43.374864] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-09-29T18:48:43.375596] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-09-29T18:48:43.375695] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-09-29T18:48:43.549144] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-09-29T18:48:43.786240] [INFO ] [REMOTE ] FNB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:48:44.348112] [INFO ] [REMOTE ] FNB: Fetching primary data for 2024-12. [2025-09-29T18:48:44.616111] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-29T18:48:45.148118] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-09-29T18:48:45.200902] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-29T18:48:45.948115] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-09-29T18:48:45.983441] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-29T18:48:46.619723] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-29T18:48:46.748115] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-09-29T18:48:46.803287] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-29T18:48:47.548117] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-09-29T18:48:48.213526] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-29T18:48:48.348110] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-09-29T18:48:48.369281] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-29T18:48:49.148117] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-09-29T18:48:49.762822] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-29T18:48:49.948114] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-09-29T18:48:50.155583] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-29T18:48:50.748109] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-01. [2025-09-29T18:48:51.264154] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-29T18:48:51.548101] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-09-29T18:48:52.215447] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-29T18:48:52.348144] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-09-29T18:48:53.148937] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-09-29T18:48:53.161449] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-29T18:48:53.948157] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-09-29T18:48:54.104275] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-29T18:48:54.118113] [INFO ] [REMOTE ] FMX: Full fetch complete (57657 records). [2025-09-29T18:48:54.118279] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-09-29T18:48:54.537096] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-09-29T18:48:54.537258] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-09-29T18:48:54.544580] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-09-29T18:48:54.555032] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-09-29T18:48:54.556978] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-29T18:48:54.564255] [INFO ] [REMOTE ] FMS: Full fetch complete (42383 records). [2025-09-29T18:48:54.564544] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-09-29T18:48:54.564819] [DEBUG] [LOCAL ] FMX: Trimmed 57657 records to 40666 (keeping 200 days of data) [2025-09-29T18:48:54.776675] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-09-29T18:48:55.092788] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-09-29T18:48:55.093706] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-09-29T18:48:55.095044] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-09-29T18:48:55.095620] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-09-29T18:48:55.099610] [DEBUG] [LOCAL ] FMS: Trimmed 42383 records to 30196 (keeping 200 days of data) [2025-09-29T18:48:55.418942] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-29T18:48:55.441084] [INFO ] [REMOTE ] FN: Full fetch complete (56346 records). [2025-09-29T18:48:55.446917] [DEBUG] [LOCAL ] FMS: Primary data saved (30196 records). [2025-09-29T18:48:55.447718] [INFO ] [MAIN ] FMS: Full history saved. [2025-09-29T18:48:55.448182] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-09-29T18:48:55.448833] [INFO ] [MAIN ] Update Progress: 854/2371 symbols completed. FMS took 41.6s. Estimated remaining: 3h 13m 24s. Rate: 7.8 symbols/min [2025-09-29T18:48:55.723348] [DEBUG] [LOCAL ] FMX: Primary data saved (40666 records). [2025-09-29T18:48:55.729303] [INFO ] [MAIN ] FMX: Full history saved. [2025-09-29T18:48:55.783145] [INFO ] [MAIN ] Update Progress: 855/2371 symbols completed. FMX took 38.3s. Estimated remaining: 3h 13m 3s. Rate: 7.9 symbols/min [2025-09-29T18:48:55.875630] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:48:56.236062] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:48:56.331328] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-09-29T18:48:56.331512] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-09-29T18:48:56.332523] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-09-29T18:48:56.332855] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-09-29T18:48:56.334473] [DEBUG] [LOCAL ] FN: Trimmed 56346 records to 38886 (keeping 200 days of data) [2025-09-29T18:48:56.445182] [DEBUG] [LOCAL ] FND: Loaded 52871 existing records from primary storage. [2025-09-29T18:48:56.456603] [INFO ] [MAIN ] FND: Loaded 52871 existing records. [2025-09-29T18:48:56.620680] [DEBUG] [LOCAL ] FNF: Loaded 49871 existing records from primary storage. [2025-09-29T18:48:56.658537] [INFO ] [MAIN ] FNF: Loaded 49871 existing records. [2025-09-29T18:48:56.666862] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-29T18:48:56.789523] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-09-29T18:48:56.815516] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:48:56.841490] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-09-29T18:48:56.859922] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-09-29T18:48:56.964758] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-09-29T18:48:56.970396] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-09-29T18:48:57.103939] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:48:57.163477] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-09-29T18:48:57.169105] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-09-29T18:48:57.181555] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-09-29T18:48:57.195860] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-09-29T18:48:57.558557] [DEBUG] [LOCAL ] FN: Primary data saved (38886 records). [2025-09-29T18:48:57.612921] [INFO ] [MAIN ] FN: Full history saved. [2025-09-29T18:48:57.646684] [INFO ] [MAIN ] Update Progress: 856/2371 symbols completed. FN took 25.7s. Estimated remaining: 3h 12m 46s. Rate: 7.9 symbols/min [2025-09-29T18:48:58.081008] [INFO ] [REMOTE ] FNF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:48:58.027503] [INFO ] [REMOTE ] FND: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:48:58.138739] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:48:58.135119] [INFO ] [REMOTE ] FNF: Fetching primary data for 2024-12. [2025-09-29T18:48:58.139058] [INFO ] [REMOTE ] FND: Fetching primary data for 2024-12. [2025-09-29T18:48:58.192241] [DEBUG] [LOCAL ] FNV: Loaded 47028 existing records from primary storage. [2025-09-29T18:48:58.192635] [INFO ] [MAIN ] FNV: Loaded 47028 existing records. [2025-09-29T18:48:58.390142] [WARN ] [MAIN ] FNV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:48:58.390429] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-09-29T18:48:58.390481] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-09-29T18:48:58.391190] [DEBUG] [LOCAL ] FNV: Deleted primary data file. [2025-09-29T18:48:58.391251] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-09-29T18:48:58.789039] [INFO ] [REMOTE ] FNV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:48:58.789565] [INFO ] [REMOTE ] FNV: Fetching primary data for 2024-12. [2025-09-29T18:48:58.824244] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-29T18:48:58.836626] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-09-29T18:48:59.686801] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-29T18:48:59.697031] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-01. [2025-09-29T18:48:59.848239] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-29T18:49:00.248385] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-29T18:49:00.348136] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-01. [2025-09-29T18:49:00.374269] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-29T18:49:01.148074] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-09-29T18:49:01.262482] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-29T18:49:01.948129] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-01. [2025-09-29T18:49:02.045584] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-29T18:49:02.748185] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-09-29T18:49:02.894860] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-29T18:49:03.548766] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-09-29T18:49:03.643093] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-29T18:49:04.080809] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-29T18:49:04.348142] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-09-29T18:49:05.148135] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-09-29T18:49:05.273367] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-29T18:49:05.893339] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-29T18:49:05.948128] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-09-29T18:49:06.748098] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-09-29T18:49:06.853245] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-29T18:49:07.548139] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-09-29T18:49:07.706448] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-29T18:49:08.348180] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-09-29T18:49:08.556483] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-29T18:49:09.048736] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-29T18:49:09.148177] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-09-29T18:49:09.948127] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-09-29T18:49:10.046637] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-29T18:49:10.748169] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-09-29T18:49:10.956769] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-29T18:49:11.548172] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-09-29T18:49:11.679013] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-29T18:49:12.348135] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-09-29T18:49:12.590591] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-29T18:49:13.148170] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-09-29T18:49:13.409409] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-29T18:49:13.948180] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-09-29T18:49:14.260495] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-29T18:49:14.377406] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-29T18:49:14.748130] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-09-29T18:49:15.548118] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-09-29T18:49:15.751749] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-29T18:49:15.886625] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-29T18:49:16.348130] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-09-29T18:49:17.143828] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-29T18:49:17.154044] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-09-29T18:49:17.948129] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-09-29T18:49:18.408955] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-29T18:49:18.420447] [INFO ] [REMOTE ] FNB: Full fetch complete (75791 records). [2025-09-29T18:49:18.420579] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-09-29T18:49:18.748268] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-09-29T18:49:18.852763] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-09-29T18:49:18.852879] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-09-29T18:49:18.853884] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-09-29T18:49:18.854071] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-09-29T18:49:18.870525] [DEBUG] [LOCAL ] FNB: Trimmed 75791 records to 52447 (keeping 200 days of data) [2025-09-29T18:49:18.884993] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-29T18:49:19.242289] [DEBUG] [LOCAL ] FNB: Primary data saved (52447 records). [2025-09-29T18:49:19.242520] [INFO ] [MAIN ] FNB: Full history saved. [2025-09-29T18:49:19.242626] [INFO ] [MAIN ] Update Progress: 857/2371 symbols completed. FNB took 36.3s. Estimated remaining: 3h 13m 3s. Rate: 7.8 symbols/min [2025-09-29T18:49:19.429863] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:49:19.446224] [DEBUG] [LOCAL ] FOA: Loaded 13484 existing records from primary storage. [2025-09-29T18:49:19.446462] [INFO ] [MAIN ] FOA: Loaded 13484 existing records. [2025-09-29T18:49:19.558501] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-09-29T18:49:19.658967] [WARN ] [MAIN ] FOA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:49:19.676695] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-09-29T18:49:19.676985] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-09-29T18:49:19.678887] [DEBUG] [LOCAL ] FOA: Deleted primary data file. [2025-09-29T18:49:19.678830] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-29T18:49:19.682581] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-09-29T18:49:20.076031] [INFO ] [REMOTE ] FOA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:49:20.348126] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-09-29T18:49:20.465820] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-29T18:49:21.148097] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-09-29T18:49:21.487361] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-29T18:49:21.953285] [INFO ] [REMOTE ] FOA: Fetching primary data for 2024-12. [2025-09-29T18:49:21.975094] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-29T18:49:22.671228] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-29T18:49:22.730114] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-29T18:49:22.748075] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-01. [2025-09-29T18:49:23.548161] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-09-29T18:49:23.824326] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-29T18:49:24.348150] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-09-29T18:49:25.148108] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-09-29T18:49:25.291498] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-29T18:49:25.948092] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-09-29T18:49:26.339101] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-29T18:49:26.348828] [INFO ] [REMOTE ] FNV: Full fetch complete (66141 records). [2025-09-29T18:49:26.348967] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-09-29T18:49:26.752565] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-09-29T18:49:26.784124] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-09-29T18:49:26.784242] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-09-29T18:49:26.785292] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-09-29T18:49:26.785504] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-09-29T18:49:26.787417] [DEBUG] [LOCAL ] FNV: Trimmed 66141 records to 46253 (keeping 200 days of data) [2025-09-29T18:49:26.917625] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-29T18:49:26.937242] [INFO ] [REMOTE ] FND: Full fetch complete (74438 records). [2025-09-29T18:49:26.943601] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-09-29T18:49:27.514187] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-09-29T18:49:27.514436] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-09-29T18:49:27.518227] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-09-29T18:49:27.523187] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-09-29T18:49:27.532550] [DEBUG] [LOCAL ] FND: Trimmed 74438 records to 52098 (keeping 200 days of data) [2025-09-29T18:49:27.663693] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-29T18:49:27.680221] [INFO ] [REMOTE ] FNF: Full fetch complete (69563 records). [2025-09-29T18:49:27.682710] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-09-29T18:49:27.976534] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-29T18:49:27.998864] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-09-29T18:49:28.183167] [DEBUG] [LOCAL ] FNV: Primary data saved (46253 records). [2025-09-29T18:49:28.201599] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-09-29T18:49:28.201957] [INFO ] [MAIN ] FNV: Full history saved. [2025-09-29T18:49:28.202538] [INFO ] [MAIN ] Update Progress: 858/2371 symbols completed. FNV took 30.5s. Estimated remaining: 3h 12m 57s. Rate: 7.8 symbols/min [2025-09-29T18:49:28.202670] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-09-29T18:49:28.204331] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-09-29T18:49:28.204922] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-09-29T18:49:28.296437] [DEBUG] [LOCAL ] FNF: Trimmed 69563 records to 49115 (keeping 200 days of data) [2025-09-29T18:49:28.557222] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:49:28.615390] [DEBUG] [LOCAL ] FOF: Loaded 8510 existing records from primary storage. [2025-09-29T18:49:28.620543] [INFO ] [MAIN ] FOF: Loaded 8510 existing records. [2025-09-29T18:49:29.025581] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:49:29.030209] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-09-29T18:49:29.031687] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-09-29T18:49:29.042787] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-09-29T18:49:29.045227] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-09-29T18:49:29.051434] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-29T18:49:29.101800] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-09-29T18:49:29.371823] [DEBUG] [LOCAL ] FND: Primary data saved (52098 records). [2025-09-29T18:49:29.376265] [INFO ] [MAIN ] FND: Full history saved. [2025-09-29T18:49:29.377050] [INFO ] [MAIN ] Update Progress: 859/2371 symbols completed. FND took 33.9s. Estimated remaining: 3h 12m 38s. Rate: 7.8 symbols/min [2025-09-29T18:49:29.545521] [INFO ] [REMOTE ] FOF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:49:29.565951] [INFO ] [REMOTE ] FOF: Fetching primary data for 2024-12. [2025-09-29T18:49:29.723610] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:49:29.762276] [DEBUG] [LOCAL ] FOR: Loaded 20362 existing records from primary storage. [2025-09-29T18:49:29.761636] [DEBUG] [LOCAL ] FNF: Primary data saved (49115 records). [2025-09-29T18:49:29.762428] [INFO ] [MAIN ] FNF: Full history saved. [2025-09-29T18:49:29.762682] [INFO ] [MAIN ] Update Progress: 860/2371 symbols completed. FNF took 33.9s. Estimated remaining: 3h 12m 18s. Rate: 7.9 symbols/min [2025-09-29T18:49:29.762835] [INFO ] [MAIN ] FOR: Loaded 20362 existing records. [2025-09-29T18:49:30.139686] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:49:30.163782] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:49:30.164387] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-09-29T18:49:30.175125] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-29T18:49:30.174023] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-09-29T18:49:30.179812] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-09-29T18:49:30.180029] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-09-29T18:49:30.180202] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-09-29T18:49:30.365775] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-29T18:49:30.533253] [DEBUG] [LOCAL ] FOUR: Loaded 50306 existing records from primary storage. [2025-09-29T18:49:30.544701] [INFO ] [MAIN ] FOUR: Loaded 50306 existing records. [2025-09-29T18:49:30.751448] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-01. [2025-09-29T18:49:30.765860] [INFO ] [REMOTE ] FOR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:49:30.855290] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:49:30.855593] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-09-29T18:49:30.855671] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-09-29T18:49:30.856208] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-09-29T18:49:30.856286] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-09-29T18:49:31.170473] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-29T18:49:31.263352] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:49:31.496094] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-29T18:49:31.548121] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-09-29T18:49:32.340165] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-29T18:49:32.348099] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2024-12. [2025-09-29T18:49:33.148152] [INFO ] [REMOTE ] FOR: Fetching primary data for 2024-12. [2025-09-29T18:49:33.948091] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-09-29T18:49:34.165531] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-29T18:49:34.187558] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-29T18:49:34.478263] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-29T18:49:34.748122] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-09-29T18:49:35.548101] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-01. [2025-09-29T18:49:35.571738] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-29T18:49:36.348111] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-09-29T18:49:36.787454] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-29T18:49:37.108712] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-29T18:49:37.148131] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-09-29T18:49:37.904224] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-29T18:49:37.948097] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-09-29T18:49:38.748117] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-01. [2025-09-29T18:49:38.788054] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-29T18:49:39.548116] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-09-29T18:49:40.348117] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-09-29T18:49:40.365449] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-29T18:49:40.443949] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-29T18:49:41.148090] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-09-29T18:49:41.213875] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-29T18:49:41.948083] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-09-29T18:49:42.182107] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-29T18:49:42.748117] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-09-29T18:49:43.548094] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-09-29T18:49:43.743345] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-29T18:49:43.809723] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-29T18:49:44.348120] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-09-29T18:49:44.384915] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-29T18:49:45.148135] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-09-29T18:49:45.948097] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-09-29T18:49:46.010029] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-29T18:49:46.266302] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-29T18:49:46.275887] [INFO ] [REMOTE ] FOA: Full fetch complete (22490 records). [2025-09-29T18:49:46.276039] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-09-29T18:49:46.664453] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present. [2025-09-29T18:49:46.664547] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed. [2025-09-29T18:49:46.665119] [INFO ] [MAIN ] FOA: Fetched primary data is valid. [2025-09-29T18:49:46.665186] [DEBUG] [LOCAL ] FOA: Saving primary data. [2025-09-29T18:49:46.665940] [DEBUG] [LOCAL ] FOA: Trimmed 22490 records to 13128 (keeping 200 days of data) [2025-09-29T18:49:46.749337] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-09-29T18:49:46.749212] [DEBUG] [LOCAL ] FOA: Primary data saved (13128 records). [2025-09-29T18:49:46.750596] [INFO ] [MAIN ] FOA: Full history saved. [2025-09-29T18:49:46.750765] [INFO ] [MAIN ] Update Progress: 861/2371 symbols completed. FOA took 27.5s. Estimated remaining: 3h 12m 27s. Rate: 7.8 symbols/min [2025-09-29T18:49:46.929076] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:49:46.951717] [DEBUG] [LOCAL ] FPF: Loaded 17998 existing records from primary storage. [2025-09-29T18:49:46.951988] [INFO ] [MAIN ] FPF: Loaded 17998 existing records. [2025-09-29T18:49:47.136264] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:49:47.136500] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-09-29T18:49:47.136557] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-09-29T18:49:47.136951] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-09-29T18:49:47.137010] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-09-29T18:49:47.534547] [INFO ] [REMOTE ] FPF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:49:47.543273] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-29T18:49:47.549529] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-09-29T18:49:47.552592] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-29T18:49:48.348106] [INFO ] [REMOTE ] FPF: Fetching primary data for 2024-12. [2025-09-29T18:49:49.148090] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-09-29T18:49:49.263548] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-29T18:49:49.427884] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-29T18:49:49.948056] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-01. [2025-09-29T18:49:50.226040] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-29T18:49:50.748177] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-09-29T18:49:50.924552] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-29T18:49:51.548135] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-09-29T18:49:51.655004] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-29T18:49:51.657867] [INFO ] [REMOTE ] FOF: Full fetch complete (11871 records). [2025-09-29T18:49:51.657967] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-09-29T18:49:52.085526] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-09-29T18:49:52.085611] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-09-29T18:49:52.086060] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-09-29T18:49:52.086125] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-09-29T18:49:52.086689] [DEBUG] [LOCAL ] FOF: Trimmed 11871 records to 8434 (keeping 200 days of data) [2025-09-29T18:49:52.145602] [DEBUG] [LOCAL ] FOF: Primary data saved (8434 records). [2025-09-29T18:49:52.145787] [INFO ] [MAIN ] FOF: Full history saved. [2025-09-29T18:49:52.145923] [INFO ] [MAIN ] Update Progress: 862/2371 symbols completed. FOF took 23.9s. Estimated remaining: 3h 12m 15s. Rate: 7.8 symbols/min [2025-09-29T18:49:52.329437] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:49:52.351163] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-09-29T18:49:52.352847] [DEBUG] [LOCAL ] FPH: Loaded 19890 existing records from primary storage. [2025-09-29T18:49:52.353163] [INFO ] [MAIN ] FPH: Loaded 19890 existing records. [2025-09-29T18:49:52.542682] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:49:52.542895] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-09-29T18:49:52.542945] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-09-29T18:49:52.543478] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-09-29T18:49:52.543545] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-09-29T18:49:52.909768] [INFO ] [REMOTE ] FPH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:49:53.148096] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-09-29T18:49:53.343405] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-29T18:49:53.391135] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-29T18:49:53.948080] [INFO ] [REMOTE ] FPH: Fetching primary data for 2024-12. [2025-09-29T18:49:54.314234] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-29T18:49:54.748150] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-09-29T18:49:55.110301] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-29T18:49:55.548213] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-01. [2025-09-29T18:49:56.348131] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-09-29T18:49:56.462047] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-29T18:49:56.743471] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-29T18:49:57.148117] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-09-29T18:49:57.343356] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-29T18:49:57.948105] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-09-29T18:49:58.114120] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-29T18:49:58.748118] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-09-29T18:49:59.548099] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-09-29T18:49:59.636344] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-29T18:49:59.697883] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-29T18:50:00.348129] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-09-29T18:50:00.622228] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-29T18:50:01.148200] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-09-29T18:50:01.948100] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-09-29T18:50:02.180815] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-29T18:50:02.495695] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-29T18:50:02.748102] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-09-29T18:50:03.102717] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-29T18:50:03.548070] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-09-29T18:50:03.643984] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-29T18:50:03.648368] [INFO ] [REMOTE ] FOR: Full fetch complete (29914 records). [2025-09-29T18:50:03.648493] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-09-29T18:50:04.054737] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-09-29T18:50:04.054824] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-09-29T18:50:04.055466] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-09-29T18:50:04.055528] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-09-29T18:50:04.056421] [DEBUG] [LOCAL ] FOR: Trimmed 29914 records to 19910 (keeping 200 days of data) [2025-09-29T18:50:04.192242] [DEBUG] [LOCAL ] FOR: Primary data saved (19910 records). [2025-09-29T18:50:04.192394] [INFO ] [MAIN ] FOR: Full history saved. [2025-09-29T18:50:04.192481] [INFO ] [MAIN ] Update Progress: 863/2371 symbols completed. FOR took 34.8s. Estimated remaining: 3h 12m 15s. Rate: 7.8 symbols/min [2025-09-29T18:50:04.374871] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:50:04.370323] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-09-29T18:50:04.426314] [DEBUG] [LOCAL ] FPI: Loaded 31525 existing records from primary storage. [2025-09-29T18:50:04.426756] [INFO ] [MAIN ] FPI: Loaded 31525 existing records. [2025-09-29T18:50:04.637920] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:50:04.638252] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-09-29T18:50:04.639003] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-09-29T18:50:04.639362] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-09-29T18:50:04.639429] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-09-29T18:50:05.000591] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-29T18:50:05.064000] [INFO ] [REMOTE ] FPI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:50:05.148098] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-09-29T18:50:05.356070] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-29T18:50:05.948162] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-09-29T18:50:06.125498] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-29T18:50:06.748149] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-09-29T18:50:06.974283] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-29T18:50:07.548096] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-09-29T18:50:07.943385] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-29T18:50:08.348129] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-09-29T18:50:09.148113] [INFO ] [REMOTE ] FPI: Fetching primary data for 2024-12. [2025-09-29T18:50:09.272111] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-29T18:50:09.472668] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-29T18:50:09.483591] [INFO ] [REMOTE ] FOUR: Full fetch complete (71959 records). [2025-09-29T18:50:09.483785] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-09-29T18:50:09.912046] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-09-29T18:50:09.912187] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-09-29T18:50:09.913478] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-09-29T18:50:09.913627] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-09-29T18:50:09.916627] [DEBUG] [LOCAL ] FOUR: Trimmed 71959 records to 49547 (keeping 200 days of data) [2025-09-29T18:50:09.978580] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-09-29T18:50:10.237594] [DEBUG] [LOCAL ] FOUR: Primary data saved (49547 records). [2025-09-29T18:50:10.237768] [INFO ] [MAIN ] FOUR: Full history saved. [2025-09-29T18:50:10.237864] [INFO ] [MAIN ] Update Progress: 864/2371 symbols completed. FOUR took 40.5s. Estimated remaining: 3h 12m 5s. Rate: 7.8 symbols/min [2025-09-29T18:50:10.414968] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:50:10.480838] [DEBUG] [LOCAL ] FR: Loaded 47174 existing records from primary storage. [2025-09-29T18:50:10.481313] [INFO ] [MAIN ] FR: Loaded 47174 existing records. [2025-09-29T18:50:10.673692] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:50:10.673939] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-09-29T18:50:10.673988] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-09-29T18:50:10.674713] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-09-29T18:50:10.674773] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-09-29T18:50:10.749917] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-09-29T18:50:11.115582] [INFO ] [REMOTE ] FR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:50:11.167318] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-29T18:50:11.166310] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-29T18:50:11.548142] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-01. [2025-09-29T18:50:11.852314] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-29T18:50:12.348117] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-09-29T18:50:12.699126] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-29T18:50:13.148122] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-09-29T18:50:13.259503] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-29T18:50:13.264053] [INFO ] [REMOTE ] FPF: Full fetch complete (26456 records). [2025-09-29T18:50:13.264220] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-09-29T18:50:13.694581] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-09-29T18:50:13.695371] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-09-29T18:50:13.696161] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-09-29T18:50:13.696232] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-09-29T18:50:13.697178] [DEBUG] [LOCAL ] FPF: Trimmed 26456 records to 17885 (keeping 200 days of data) [2025-09-29T18:50:13.820230] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-29T18:50:13.837013] [DEBUG] [LOCAL ] FPF: Primary data saved (17885 records). [2025-09-29T18:50:13.837176] [INFO ] [MAIN ] FPF: Full history saved. [2025-09-29T18:50:13.837268] [INFO ] [MAIN ] Update Progress: 865/2371 symbols completed. FPF took 27.1s. Estimated remaining: 3h 11m 50s. Rate: 7.9 symbols/min [2025-09-29T18:50:13.953242] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-09-29T18:50:14.023201] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:50:14.042612] [DEBUG] [LOCAL ] FRA: Loaded 14717 existing records from primary storage. [2025-09-29T18:50:14.042909] [INFO ] [MAIN ] FRA: Loaded 14717 existing records. [2025-09-29T18:50:14.244437] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:50:14.244750] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-09-29T18:50:14.244807] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-09-29T18:50:14.245240] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-09-29T18:50:14.245299] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-09-29T18:50:14.621631] [INFO ] [REMOTE ] FRA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:50:14.748156] [INFO ] [REMOTE ] FRA: Fetching primary data for 2024-12. [2025-09-29T18:50:15.115046] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-29T18:50:15.548125] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-09-29T18:50:15.846354] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-29T18:50:16.348162] [INFO ] [REMOTE ] FR: Fetching primary data for 2024-12. [2025-09-29T18:50:16.424617] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-29T18:50:16.429254] [INFO ] [REMOTE ] FPH: Full fetch complete (31420 records). [2025-09-29T18:50:16.429344] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-09-29T18:50:16.828317] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-09-29T18:50:16.828404] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-09-29T18:50:16.829052] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-09-29T18:50:16.829117] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-09-29T18:50:16.830066] [DEBUG] [LOCAL ] FPH: Trimmed 31420 records to 19569 (keeping 200 days of data) [2025-09-29T18:50:16.942425] [DEBUG] [LOCAL ] FPH: Primary data saved (19569 records). [2025-09-29T18:50:16.942596] [INFO ] [MAIN ] FPH: Full history saved. [2025-09-29T18:50:16.942762] [INFO ] [MAIN ] Update Progress: 866/2371 symbols completed. FPH took 24.8s. Estimated remaining: 3h 11m 34s. Rate: 7.9 symbols/min [2025-09-29T18:50:17.125011] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:50:17.146399] [DEBUG] [LOCAL ] FRGE: Loaded 18571 existing records from primary storage. [2025-09-29T18:50:17.146690] [INFO ] [MAIN ] FRGE: Loaded 18571 existing records. [2025-09-29T18:50:17.158118] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-01. [2025-09-29T18:50:17.345300] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:50:17.345583] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-09-29T18:50:17.345635] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-09-29T18:50:17.345984] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-09-29T18:50:17.346045] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-09-29T18:50:17.737298] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:50:17.767845] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-29T18:50:17.948129] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-01. [2025-09-29T18:50:18.118434] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-29T18:50:18.748113] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2024-12. [2025-09-29T18:50:19.267668] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-29T18:50:19.548129] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-09-29T18:50:20.210823] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-29T18:50:20.348119] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-01. [2025-09-29T18:50:21.104300] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-29T18:50:21.148082] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-09-29T18:50:21.363478] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-29T18:50:21.948148] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-09-29T18:50:22.748098] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-09-29T18:50:22.790767] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-29T18:50:23.301801] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-29T18:50:23.548100] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-09-29T18:50:23.778220] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-29T18:50:24.348175] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-09-29T18:50:25.148183] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-09-29T18:50:25.357091] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-29T18:50:25.642740] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-29T18:50:25.948099] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-09-29T18:50:26.100167] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-29T18:50:26.748136] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-09-29T18:50:27.537796] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-29T18:50:27.548181] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-09-29T18:50:27.582753] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-29T18:50:28.348112] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-09-29T18:50:28.924870] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-29T18:50:29.148126] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-09-29T18:50:29.859902] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-29T18:50:29.914576] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-29T18:50:29.948137] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-09-29T18:50:30.748129] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-09-29T18:50:31.304690] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-29T18:50:31.548163] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-09-29T18:50:32.348174] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-09-29T18:50:32.387860] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-29T18:50:33.023297] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-29T18:50:33.148092] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-09-29T18:50:33.306775] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-29T18:50:33.948082] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-09-29T18:50:34.198102] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-29T18:50:34.748146] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-09-29T18:50:35.228973] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-29T18:50:35.327509] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-29T18:50:35.548097] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-09-29T18:50:36.348108] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-09-29T18:50:37.135192] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-29T18:50:37.148069] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-09-29T18:50:37.726050] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-29T18:50:37.948100] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-09-29T18:50:38.260410] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-29T18:50:38.748119] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-09-29T18:50:39.548185] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-09-29T18:50:39.640275] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-29T18:50:39.757486] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-29T18:50:39.766748] [INFO ] [REMOTE ] FR: Full fetch complete (66579 records). [2025-09-29T18:50:39.766902] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-09-29T18:50:40.233456] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-09-29T18:50:40.233600] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-09-29T18:50:40.235456] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-09-29T18:50:40.235528] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-09-29T18:50:40.237230] [DEBUG] [LOCAL ] FR: Trimmed 66579 records to 46393 (keeping 200 days of data) [2025-09-29T18:50:40.342282] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-29T18:50:40.348096] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-09-29T18:50:40.564466] [DEBUG] [LOCAL ] FR: Primary data saved (46393 records). [2025-09-29T18:50:40.564693] [INFO ] [MAIN ] FR: Full history saved. [2025-09-29T18:50:40.564824] [INFO ] [MAIN ] Update Progress: 867/2371 symbols completed. FR took 30.3s. Estimated remaining: 3h 11m 54s. Rate: 7.8 symbols/min [2025-09-29T18:50:40.761631] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:50:40.826671] [DEBUG] [LOCAL ] FRO: Loaded 52603 existing records from primary storage. [2025-09-29T18:50:40.827071] [INFO ] [MAIN ] FRO: Loaded 52603 existing records. [2025-09-29T18:50:41.038776] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:50:41.039118] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-09-29T18:50:41.039182] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-09-29T18:50:41.039727] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-09-29T18:50:41.039790] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-09-29T18:50:41.153798] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-09-29T18:50:41.437165] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-29T18:50:41.441318] [INFO ] [REMOTE ] FRO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:50:41.445698] [INFO ] [REMOTE ] FRA: Full fetch complete (24098 records). [2025-09-29T18:50:41.445806] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-09-29T18:50:41.841484] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-09-29T18:50:41.841576] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-09-29T18:50:41.842102] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-09-29T18:50:41.842166] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-09-29T18:50:41.843871] [DEBUG] [LOCAL ] FRA: Trimmed 24098 records to 14517 (keeping 200 days of data) [2025-09-29T18:50:41.941012] [DEBUG] [LOCAL ] FRA: Primary data saved (14517 records). [2025-09-29T18:50:41.941172] [INFO ] [MAIN ] FRA: Full history saved. [2025-09-29T18:50:41.941259] [INFO ] [MAIN ] Update Progress: 868/2371 symbols completed. FRA took 28.1s. Estimated remaining: 3h 11m 36s. Rate: 7.8 symbols/min [2025-09-29T18:50:41.953193] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-09-29T18:50:42.128126] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:50:42.170837] [DEBUG] [LOCAL ] FRT: Loaded 42808 existing records from primary storage. [2025-09-29T18:50:42.171155] [INFO ] [MAIN ] FRT: Loaded 42808 existing records. [2025-09-29T18:50:42.357853] [WARN ] [MAIN ] FRT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:50:42.358069] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-09-29T18:50:42.358117] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-09-29T18:50:42.358511] [DEBUG] [LOCAL ] FRT: Deleted primary data file. [2025-09-29T18:50:42.358570] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-09-29T18:50:42.565937] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-29T18:50:42.760155] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-09-29T18:50:42.766999] [INFO ] [REMOTE ] FRT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:50:42.985830] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-29T18:50:43.548134] [INFO ] [REMOTE ] FRO: Fetching primary data for 2024-12. [2025-09-29T18:50:44.197485] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-29T18:50:44.204156] [INFO ] [REMOTE ] FPI: Full fetch complete (44176 records). [2025-09-29T18:50:44.204299] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-09-29T18:50:44.353220] [INFO ] [REMOTE ] FRT: Fetching primary data for 2024-12. [2025-09-29T18:50:44.604051] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present. [2025-09-29T18:50:44.604160] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed. [2025-09-29T18:50:44.605035] [INFO ] [MAIN ] FPI: Fetched primary data is valid. [2025-09-29T18:50:44.605103] [DEBUG] [LOCAL ] FPI: Saving primary data. [2025-09-29T18:50:44.606225] [DEBUG] [LOCAL ] FPI: Trimmed 44176 records to 31022 (keeping 200 days of data) [2025-09-29T18:50:44.806680] [DEBUG] [LOCAL ] FPI: Primary data saved (31022 records). [2025-09-29T18:50:44.806850] [INFO ] [MAIN ] FPI: Full history saved. [2025-09-29T18:50:44.806974] [INFO ] [MAIN ] Update Progress: 869/2371 symbols completed. FPI took 40.6s. Estimated remaining: 3h 11m 20s. Rate: 7.9 symbols/min [2025-09-29T18:50:45.003889] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:50:45.044080] [DEBUG] [LOCAL ] FSCO: Loaded 37725 existing records from primary storage. [2025-09-29T18:50:45.044385] [INFO ] [MAIN ] FSCO: Loaded 37725 existing records. [2025-09-29T18:50:45.152714] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-09-29T18:50:45.236597] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:50:45.236834] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-09-29T18:50:45.236884] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-09-29T18:50:45.237360] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-09-29T18:50:45.237438] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-09-29T18:50:45.630441] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:50:45.664189] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-29T18:50:45.948122] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-01. [2025-09-29T18:50:45.992691] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-29T18:50:46.160080] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-29T18:50:46.748113] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-01. [2025-09-29T18:50:47.548124] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-09-29T18:50:47.834298] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-29T18:50:48.287735] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-29T18:50:48.348168] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-09-29T18:50:48.481910] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-29T18:50:48.488101] [INFO ] [REMOTE ] FRGE: Full fetch complete (33216 records). [2025-09-29T18:50:48.488325] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-09-29T18:50:49.040594] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-09-29T18:50:49.040762] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-09-29T18:50:49.041554] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-09-29T18:50:49.041636] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-09-29T18:50:49.042692] [DEBUG] [LOCAL ] FRGE: Trimmed 33216 records to 17953 (keeping 200 days of data) [2025-09-29T18:50:49.149823] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2024-12. [2025-09-29T18:50:49.168399] [DEBUG] [LOCAL ] FRGE: Primary data saved (17953 records). [2025-09-29T18:50:49.168558] [INFO ] [MAIN ] FRGE: Full history saved. [2025-09-29T18:50:49.168690] [INFO ] [MAIN ] Update Progress: 870/2371 symbols completed. FRGE took 32.2s. Estimated remaining: 3h 11m 7s. Rate: 7.9 symbols/min [2025-09-29T18:50:49.373819] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:50:49.429125] [DEBUG] [LOCAL ] FSK: Loaded 50173 existing records from primary storage. [2025-09-29T18:50:49.429480] [INFO ] [MAIN ] FSK: Loaded 50173 existing records. [2025-09-29T18:50:49.651270] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:50:49.651624] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-09-29T18:50:49.651781] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-09-29T18:50:49.652293] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-09-29T18:50:49.652357] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-09-29T18:50:49.895522] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-29T18:50:49.951329] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-09-29T18:50:50.106661] [INFO ] [REMOTE ] FSK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:50:50.275079] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-29T18:50:50.748173] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-01. [2025-09-29T18:50:51.548115] [INFO ] [REMOTE ] FSK: Fetching primary data for 2024-12. [2025-09-29T18:50:51.629101] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-29T18:50:51.814404] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-29T18:50:52.348141] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-09-29T18:50:53.155004] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-09-29T18:50:53.161430] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-29T18:50:53.948084] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-01. [2025-09-29T18:50:54.291919] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-29T18:50:54.379977] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-29T18:50:54.748161] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-09-29T18:50:55.528005] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-29T18:50:55.548082] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-09-29T18:50:56.348097] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-09-29T18:50:56.440246] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-29T18:50:56.730478] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-29T18:50:57.148174] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-09-29T18:50:57.689067] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-29T18:50:57.948139] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-09-29T18:50:58.741069] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-29T18:50:58.749915] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-09-29T18:50:59.548124] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-09-29T18:50:59.875956] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-29T18:51:00.325525] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-29T18:51:00.348066] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-09-29T18:51:01.073772] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-29T18:51:01.148126] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-09-29T18:51:01.948161] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-09-29T18:51:02.164878] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-29T18:51:02.748194] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-09-29T18:51:03.048727] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-29T18:51:03.355929] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-29T18:51:03.548162] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-09-29T18:51:04.348135] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-09-29T18:51:04.427668] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-29T18:51:05.084435] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-29T18:51:05.148161] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-09-29T18:51:05.948156] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-09-29T18:51:06.491156] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-29T18:51:06.748121] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-09-29T18:51:06.805127] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-29T18:51:07.548130] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-09-29T18:51:07.602362] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-29T18:51:08.348086] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-09-29T18:51:08.644263] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-29T18:51:09.053426] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-29T18:51:09.148161] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-09-29T18:51:09.948101] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-09-29T18:51:10.024832] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-29T18:51:10.748129] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-09-29T18:51:11.054211] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-29T18:51:11.410617] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-29T18:51:11.548148] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-09-29T18:51:12.040848] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-29T18:51:12.049496] [INFO ] [REMOTE ] FRT: Full fetch complete (60253 records). [2025-09-29T18:51:12.049756] [DEBUG] [VALIDATOR ] FRT: Validating primary data. [2025-09-29T18:51:12.357290] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-09-29T18:51:12.482245] [DEBUG] [VALIDATOR ] FRT: All expected trading days are present. [2025-09-29T18:51:12.482344] [DEBUG] [VALIDATOR ] FRT: Primary data validation passed. [2025-09-29T18:51:12.483287] [INFO ] [MAIN ] FRT: Fetched primary data is valid. [2025-09-29T18:51:12.483354] [DEBUG] [LOCAL ] FRT: Saving primary data. [2025-09-29T18:51:12.484708] [DEBUG] [LOCAL ] FRT: Trimmed 60253 records to 42096 (keeping 200 days of data) [2025-09-29T18:51:12.751683] [DEBUG] [LOCAL ] FRT: Primary data saved (42096 records). [2025-09-29T18:51:12.751819] [INFO ] [MAIN ] FRT: Full history saved. [2025-09-29T18:51:12.751927] [INFO ] [MAIN ] Update Progress: 871/2371 symbols completed. FRT took 30.8s. Estimated remaining: 3h 11m 27s. Rate: 7.8 symbols/min [2025-09-29T18:51:12.935311] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:51:12.989486] [DEBUG] [LOCAL ] FSLY: Loaded 51989 existing records from primary storage. [2025-09-29T18:51:12.989886] [INFO ] [MAIN ] FSLY: Loaded 51989 existing records. [2025-09-29T18:51:13.151444] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-09-29T18:51:13.185152] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:51:13.185524] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-09-29T18:51:13.186884] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-09-29T18:51:13.187411] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-09-29T18:51:13.187475] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-09-29T18:51:13.577663] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:51:13.612891] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-29T18:51:13.624265] [INFO ] [REMOTE ] FRO: Full fetch complete (75342 records). [2025-09-29T18:51:13.624447] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-09-29T18:51:13.949802] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2024-12. [2025-09-29T18:51:14.053580] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-09-29T18:51:14.053736] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-09-29T18:51:14.054871] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-09-29T18:51:14.055010] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-09-29T18:51:14.056946] [DEBUG] [LOCAL ] FRO: Trimmed 75342 records to 51814 (keeping 200 days of data) [2025-09-29T18:51:14.315917] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-29T18:51:14.450407] [DEBUG] [LOCAL ] FRO: Primary data saved (51814 records). [2025-09-29T18:51:14.450564] [INFO ] [MAIN ] FRO: Full history saved. [2025-09-29T18:51:14.450712] [INFO ] [MAIN ] Update Progress: 872/2371 symbols completed. FRO took 33.9s. Estimated remaining: 3h 11m 9s. Rate: 7.8 symbols/min [2025-09-29T18:51:14.637257] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:51:14.690010] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-29T18:51:14.713981] [DEBUG] [LOCAL ] FSM: Loaded 54065 existing records from primary storage. [2025-09-29T18:51:14.714331] [INFO ] [MAIN ] FSM: Loaded 54065 existing records. [2025-09-29T18:51:14.753275] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-09-29T18:51:14.918857] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:51:14.919087] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-09-29T18:51:14.919135] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-09-29T18:51:14.919882] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-09-29T18:51:14.919943] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-09-29T18:51:15.312158] [INFO ] [REMOTE ] FSM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:51:15.548153] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-09-29T18:51:15.846250] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-29T18:51:16.348100] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-01. [2025-09-29T18:51:16.639334] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-29T18:51:16.760895] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-29T18:51:16.772034] [INFO ] [REMOTE ] FSK: Full fetch complete (71439 records). [2025-09-29T18:51:16.772206] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-09-29T18:51:17.176899] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-09-29T18:51:17.203069] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-09-29T18:51:17.203216] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-09-29T18:51:17.204197] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-09-29T18:51:17.204264] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-09-29T18:51:17.205969] [DEBUG] [LOCAL ] FSK: Trimmed 71439 records to 49406 (keeping 200 days of data) [2025-09-29T18:51:17.536075] [DEBUG] [LOCAL ] FSK: Primary data saved (49406 records). [2025-09-29T18:51:17.536223] [INFO ] [MAIN ] FSK: Full history saved. [2025-09-29T18:51:17.536311] [INFO ] [MAIN ] Update Progress: 873/2371 symbols completed. FSK took 28.4s. Estimated remaining: 3h 10m 53s. Rate: 7.8 symbols/min [2025-09-29T18:51:17.725438] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:51:17.763731] [DEBUG] [LOCAL ] FSS: Loaded 34888 existing records from primary storage. [2025-09-29T18:51:17.764029] [INFO ] [MAIN ] FSS: Loaded 34888 existing records. [2025-09-29T18:51:17.963530] [INFO ] [REMOTE ] FSM: Fetching primary data for 2024-12. [2025-09-29T18:51:17.970262] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:51:17.971638] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-09-29T18:51:17.971775] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-09-29T18:51:17.972789] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-09-29T18:51:17.972866] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-09-29T18:51:18.341534] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-29T18:51:18.424307] [INFO ] [REMOTE ] FSS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:51:18.748152] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-09-29T18:51:18.782486] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-29T18:51:19.548142] [INFO ] [REMOTE ] FSS: Fetching primary data for 2024-12. [2025-09-29T18:51:19.755954] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-29T18:51:20.348145] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-09-29T18:51:20.627286] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-29T18:51:20.832441] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-29T18:51:21.148126] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-09-29T18:51:21.948109] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-09-29T18:51:22.103540] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-29T18:51:22.112909] [INFO ] [REMOTE ] FSCO: Full fetch complete (54159 records). [2025-09-29T18:51:22.113079] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-09-29T18:51:22.635166] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-09-29T18:51:22.634954] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-29T18:51:22.635435] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-09-29T18:51:22.643393] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-09-29T18:51:22.644080] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-09-29T18:51:22.645740] [DEBUG] [LOCAL ] FSCO: Trimmed 54159 records to 37264 (keeping 200 days of data) [2025-09-29T18:51:22.748303] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-09-29T18:51:22.880763] [DEBUG] [LOCAL ] FSCO: Primary data saved (37264 records). [2025-09-29T18:51:22.880956] [INFO ] [MAIN ] FSCO: Full history saved. [2025-09-29T18:51:22.881062] [INFO ] [MAIN ] Update Progress: 874/2371 symbols completed. FSCO took 38.1s. Estimated remaining: 3h 10m 42s. Rate: 7.9 symbols/min [2025-09-29T18:51:23.067463] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:51:23.076990] [DEBUG] [LOCAL ] FT: Loaded 6432 existing records from primary storage. [2025-09-29T18:51:23.077205] [INFO ] [MAIN ] FT: Loaded 6432 existing records. [2025-09-29T18:51:23.260739] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:51:23.260997] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-09-29T18:51:23.261045] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-09-29T18:51:23.261242] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-09-29T18:51:23.261299] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-09-29T18:51:23.553329] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-01. [2025-09-29T18:51:23.688835] [INFO ] [REMOTE ] FT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:51:23.765478] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-29T18:51:24.113511] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-29T18:51:24.348118] [INFO ] [REMOTE ] FT: Fetching primary data for 2024-12. [2025-09-29T18:51:25.034757] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-29T18:51:25.148088] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-09-29T18:51:25.262447] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-29T18:51:25.948113] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-09-29T18:51:26.748087] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-01. [2025-09-29T18:51:26.893074] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-29T18:51:27.379797] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-29T18:51:27.548169] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-09-29T18:51:27.763384] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-29T18:51:28.136086] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-29T18:51:28.348119] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-09-29T18:51:28.782813] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-29T18:51:29.148141] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-09-29T18:51:29.948103] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-09-29T18:51:30.748112] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-09-29T18:51:30.919731] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-29T18:51:31.548086] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-09-29T18:51:31.871726] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-29T18:51:32.242616] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-29T18:51:32.348149] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-09-29T18:51:33.148102] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-09-29T18:51:33.320809] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-29T18:51:33.876599] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-29T18:51:33.948142] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-09-29T18:51:34.119303] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-29T18:51:34.748129] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-09-29T18:51:35.424192] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-29T18:51:35.548153] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-09-29T18:51:36.348153] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-09-29T18:51:36.484304] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-29T18:51:37.036979] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-29T18:51:37.064053] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-29T18:51:37.148108] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-09-29T18:51:37.948140] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-09-29T18:51:38.488303] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-29T18:51:38.748103] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-09-29T18:51:39.060277] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-29T18:51:39.548119] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-09-29T18:51:39.764912] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-29T18:51:40.348185] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-09-29T18:51:41.148175] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-09-29T18:51:41.393325] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-29T18:51:41.473391] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-29T18:51:41.948109] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-09-29T18:51:42.726896] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-29T18:51:42.748090] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-09-29T18:51:43.548136] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-09-29T18:51:43.732377] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-29T18:51:44.348144] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-09-29T18:51:44.359950] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-29T18:51:44.674769] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-29T18:51:45.148071] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-09-29T18:51:45.617546] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-29T18:51:45.853489] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-29T18:51:45.948116] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-09-29T18:51:46.748130] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-09-29T18:51:46.805155] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-29T18:51:46.808322] [INFO ] [REMOTE ] FT: Full fetch complete (9081 records). [2025-09-29T18:51:46.808466] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-09-29T18:51:47.211538] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-09-29T18:51:47.211623] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-09-29T18:51:47.211889] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-09-29T18:51:47.211943] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-09-29T18:51:47.212440] [DEBUG] [LOCAL ] FT: Trimmed 9081 records to 6436 (keeping 200 days of data) [2025-09-29T18:51:47.250213] [DEBUG] [LOCAL ] FT: Primary data saved (6436 records). [2025-09-29T18:51:47.250350] [INFO ] [MAIN ] FT: Full history saved. [2025-09-29T18:51:47.250436] [INFO ] [MAIN ] Update Progress: 875/2371 symbols completed. FT took 24.4s. Estimated remaining: 3h 11m 2s. Rate: 7.8 symbols/min [2025-09-29T18:51:47.425913] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:51:47.440886] [DEBUG] [LOCAL ] FTHY: Loaded 11947 existing records from primary storage. [2025-09-29T18:51:47.441226] [INFO ] [MAIN ] FTHY: Loaded 11947 existing records. [2025-09-29T18:51:47.553858] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-09-29T18:51:47.649964] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:51:47.650191] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-09-29T18:51:47.650241] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-09-29T18:51:47.650465] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-09-29T18:51:47.650525] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-09-29T18:51:48.048567] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:51:48.348106] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-09-29T18:51:48.636602] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-29T18:51:48.647821] [INFO ] [REMOTE ] FSLY: Full fetch complete (74893 records). [2025-09-29T18:51:48.648021] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-09-29T18:51:49.001025] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-29T18:51:49.051789] [INFO ] [REMOTE ] FSS: Full fetch complete (48304 records). [2025-09-29T18:51:49.054344] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-09-29T18:51:49.131436] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-09-29T18:51:49.165756] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-09-29T18:51:49.165691] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2024-12. [2025-09-29T18:51:49.185787] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-09-29T18:51:49.185909] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-09-29T18:51:49.242822] [DEBUG] [LOCAL ] FSLY: Trimmed 74893 records to 51193 (keeping 200 days of data) [2025-09-29T18:51:49.636134] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-09-29T18:51:49.636850] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-09-29T18:51:49.641986] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-09-29T18:51:49.644682] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-09-29T18:51:49.649738] [DEBUG] [LOCAL ] FSS: Trimmed 48304 records to 34208 (keeping 200 days of data) [2025-09-29T18:51:49.999871] [DEBUG] [LOCAL ] FSS: Primary data saved (34208 records). [2025-09-29T18:51:50.000700] [INFO ] [MAIN ] FSS: Full history saved. [2025-09-29T18:51:50.001157] [INFO ] [MAIN ] Update Progress: 876/2371 symbols completed. FSS took 32.5s. Estimated remaining: 3h 10m 46s. Rate: 7.8 symbols/min [2025-09-29T18:51:50.264154] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:51:50.291272] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-29T18:51:50.294986] [DEBUG] [LOCAL ] FSLY: Primary data saved (51193 records). [2025-09-29T18:51:50.299851] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-01. [2025-09-29T18:51:50.300319] [INFO ] [MAIN ] FSLY: Full history saved. [2025-09-29T18:51:50.302411] [INFO ] [MAIN ] Update Progress: 877/2371 symbols completed. FSLY took 37.6s. Estimated remaining: 3h 10m 26s. Rate: 7.8 symbols/min [2025-09-29T18:51:50.351407] [DEBUG] [LOCAL ] FTI: Loaded 54078 existing records from primary storage. [2025-09-29T18:51:50.351809] [INFO ] [MAIN ] FTI: Loaded 54078 existing records. [2025-09-29T18:51:50.546625] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:51:50.547025] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-09-29T18:51:50.547146] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-09-29T18:51:50.547844] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-09-29T18:51:50.547908] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-09-29T18:51:50.880780] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-09-29T18:51:50.915105] [INFO ] [REMOTE ] FSM: Full fetch complete (76735 records). [2025-09-29T18:51:50.931300] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-09-29T18:51:51.004290] [INFO ] [REMOTE ] FTI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:51:51.014677] [INFO ] [REMOTE ] FTI: Fetching primary data for 2024-12. [2025-09-29T18:51:51.130452] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-29T18:51:51.440030] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-09-29T18:51:51.440145] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-09-29T18:51:51.441242] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-09-29T18:51:51.441314] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-09-29T18:51:51.443000] [DEBUG] [LOCAL ] FSM: Trimmed 76735 records to 53287 (keeping 200 days of data) [2025-09-29T18:51:51.549399] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-09-29T18:51:51.770840] [DEBUG] [LOCAL ] FSM: Primary data saved (53287 records). [2025-09-29T18:51:51.771001] [INFO ] [MAIN ] FSM: Full history saved. [2025-09-29T18:51:51.771103] [INFO ] [MAIN ] Update Progress: 878/2371 symbols completed. FSM took 37.3s. Estimated remaining: 3h 10m 8s. Rate: 7.9 symbols/min [2025-09-29T18:51:52.339570] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-29T18:51:52.348120] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-09-29T18:51:52.811333] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-29T18:51:53.128693] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-29T18:51:53.148086] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-09-29T18:51:53.948139] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-01. [2025-09-29T18:51:54.208275] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-29T18:51:54.748159] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-09-29T18:51:55.529939] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-29T18:51:55.548064] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-09-29T18:51:55.681973] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-29T18:51:56.297387] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-29T18:51:56.348101] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-09-29T18:51:57.148138] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-09-29T18:51:57.915448] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-29T18:51:57.948077] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-09-29T18:51:58.148174] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-29T18:51:58.748132] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-09-29T18:51:58.929809] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-29T18:51:59.548092] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-09-29T18:52:00.524926] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-29T18:52:00.536768] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-09-29T18:52:00.559401] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-29T18:52:00.562510] [INFO ] [REMOTE ] FTHY: Full fetch complete (17559 records). [2025-09-29T18:52:00.562598] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-09-29T18:52:00.948301] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-09-29T18:52:00.948384] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-09-29T18:52:00.948827] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-09-29T18:52:00.948891] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-09-29T18:52:00.949473] [DEBUG] [LOCAL ] FTHY: Trimmed 17559 records to 11823 (keeping 200 days of data) [2025-09-29T18:52:01.029147] [DEBUG] [LOCAL ] FTHY: Primary data saved (11823 records). [2025-09-29T18:52:01.029317] [INFO ] [MAIN ] FTHY: Full history saved. [2025-09-29T18:52:01.029425] [INFO ] [MAIN ] Update Progress: 879/2371 symbols completed. FTHY took 13.8s. Estimated remaining: 3h 10m 3s. Rate: 7.9 symbols/min [2025-09-29T18:52:02.368583] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-29T18:52:02.380691] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-09-29T18:52:04.241191] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-29T18:52:04.252752] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-09-29T18:52:05.962354] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-29T18:52:05.974376] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-09-29T18:52:07.718414] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-29T18:52:07.731831] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-09-29T18:52:09.452931] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-29T18:52:09.465067] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-09-29T18:52:11.474913] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-29T18:52:11.486542] [INFO ] [REMOTE ] FTI: Full fetch complete (77126 records). [2025-09-29T18:52:11.486754] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-09-29T18:52:11.929439] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-09-29T18:52:11.929590] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-09-29T18:52:11.930669] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-09-29T18:52:11.930745] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-09-29T18:52:11.935806] [DEBUG] [LOCAL ] FTI: Trimmed 77126 records to 53297 (keeping 200 days of data) [2025-09-29T18:52:12.275596] [DEBUG] [LOCAL ] FTI: Primary data saved (53297 records). [2025-09-29T18:52:12.275772] [INFO ] [MAIN ] FTI: Full history saved. [2025-09-29T18:52:12.275916] [INFO ] [MAIN ] Update Progress: 880/2371 symbols completed. FTI took 22.3s. Estimated remaining: 3h 10m 2s. Rate: 7.8 symbols/min [2025-09-29T18:52:12.959093] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:52:12.998690] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:52:13.064858] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:52:13.062036] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:52:13.071210] [DEBUG] [LOCAL ] FTWO: Loaded 1837 existing records from primary storage. [2025-09-29T18:52:13.072534] [INFO ] [MAIN ] FTWO: Loaded 1837 existing records. [2025-09-29T18:52:13.293064] [DEBUG] [LOCAL ] FTK: Loaded 32755 existing records from primary storage. [2025-09-29T18:52:13.291464] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:52:13.304726] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-09-29T18:52:13.318110] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-09-29T18:52:13.305239] [INFO ] [MAIN ] FTK: Loaded 32755 existing records. [2025-09-29T18:52:13.323902] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-09-29T18:52:13.330431] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-09-29T18:52:13.575927] [DEBUG] [LOCAL ] FTS: Loaded 42695 existing records from primary storage. [2025-09-29T18:52:13.592639] [DEBUG] [LOCAL ] FTV: Loaded 53686 existing records from primary storage. [2025-09-29T18:52:13.613796] [INFO ] [MAIN ] FTS: Loaded 42695 existing records. [2025-09-29T18:52:13.655484] [INFO ] [MAIN ] FTV: Loaded 53686 existing records. [2025-09-29T18:52:13.948627] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:52:14.032507] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-09-29T18:52:14.066456] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-09-29T18:52:14.086792] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-09-29T18:52:14.093120] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-09-29T18:52:14.338569] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:52:14.404878] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-09-29T18:52:14.475785] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:52:14.498313] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:52:14.513997] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-09-29T18:52:14.514879] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-09-29T18:52:14.514764] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2024-12. [2025-09-29T18:52:14.531089] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-09-29T18:52:14.562246] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-09-29T18:52:14.571712] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-09-29T18:52:14.571793] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-09-29T18:52:14.674622] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-09-29T18:52:15.237259] [INFO ] [REMOTE ] FTK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:52:15.309826] [INFO ] [REMOTE ] FTK: Fetching primary data for 2024-12. [2025-09-29T18:52:15.391013] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-29T18:52:15.425976] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-01. [2025-09-29T18:52:15.643637] [INFO ] [REMOTE ] FTV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:52:15.645407] [INFO ] [REMOTE ] FTS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:52:15.645935] [INFO ] [REMOTE ] FTV: Fetching primary data for 2024-12. [2025-09-29T18:52:15.646288] [INFO ] [REMOTE ] FTS: Fetching primary data for 2024-12. [2025-09-29T18:52:16.078930] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-29T18:52:16.080843] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-09-29T18:52:16.536439] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-29T18:52:16.541227] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-09-29T18:52:16.767922] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-29T18:52:16.773054] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-09-29T18:52:17.017851] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-29T18:52:17.019257] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-09-29T18:52:17.202571] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-29T18:52:17.211883] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-01. [2025-09-29T18:52:17.404605] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-29T18:52:17.415594] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-09-29T18:52:17.447790] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-29T18:52:17.448941] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-09-29T18:52:17.819908] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-29T18:52:17.821213] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-09-29T18:52:17.844094] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-29T18:52:17.850157] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-09-29T18:52:18.131115] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-29T18:52:18.132711] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-09-29T18:52:18.633737] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-29T18:52:18.642339] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-09-29T18:52:18.804332] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-29T18:52:18.810959] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-29T18:52:18.811921] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-09-29T18:52:18.823970] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-09-29T18:52:19.803880] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-29T18:52:19.810491] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-09-29T18:52:20.117258] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-29T18:52:20.156120] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-29T18:52:20.348125] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-09-29T18:52:21.001965] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-29T18:52:21.148138] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-09-29T18:52:21.948075] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-09-29T18:52:22.042124] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-29T18:52:22.096611] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (3.96 seconds). [2025-09-29T18:52:22.425361] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-29T18:52:22.748112] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-09-29T18:52:23.091753] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-29T18:52:23.219926] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-29T18:52:23.548121] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-09-29T18:52:24.348159] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-09-29T18:52:25.148097] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-09-29T18:52:25.184888] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-29T18:52:25.910683] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-29T18:52:25.948128] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-09-29T18:52:26.748183] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-09-29T18:52:26.915014] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-29T18:52:27.292210] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-29T18:52:27.293586] [INFO ] [REMOTE ] FTWO: Full fetch complete (3456 records). [2025-09-29T18:52:27.293743] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-09-29T18:52:27.552783] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-09-29T18:52:27.702290] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-09-29T18:52:27.702810] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-09-29T18:52:27.704428] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-09-29T18:52:27.704263] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-29T18:52:27.704555] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-09-29T18:52:27.714882] [DEBUG] [LOCAL ] FTWO: Trimmed 3456 records to 1795 (keeping 200 days of data) [2025-09-29T18:52:27.726466] [DEBUG] [LOCAL ] FTWO: Primary data saved (1795 records). [2025-09-29T18:52:27.726537] [INFO ] [MAIN ] FTWO: Full history saved. [2025-09-29T18:52:27.726613] [INFO ] [MAIN ] Update Progress: 881/2371 symbols completed. FTWO took 15.4s. Estimated remaining: 3h 10m 7s. Rate: 7.8 symbols/min [2025-09-29T18:52:27.904868] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:52:27.964209] [DEBUG] [LOCAL ] FUBO: Loaded 54476 existing records from primary storage. [2025-09-29T18:52:27.964563] [INFO ] [MAIN ] FUBO: Loaded 54476 existing records. [2025-09-29T18:52:28.152618] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:52:28.152860] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-09-29T18:52:28.152989] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-09-29T18:52:28.153701] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-09-29T18:52:28.153763] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-09-29T18:52:28.353231] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-09-29T18:52:28.528301] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:52:29.131384] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-29T18:52:29.148088] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-09-29T18:52:29.490221] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-29T18:52:29.948115] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-09-29T18:52:30.551551] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-29T18:52:30.748159] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-09-29T18:52:31.548154] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2024-12. [2025-09-29T18:52:31.591287] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-29T18:52:32.342693] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-29T18:52:32.352202] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-09-29T18:52:33.148099] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-09-29T18:52:33.614513] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-29T18:52:33.622060] [INFO ] [REMOTE ] FTK: Full fetch complete (42784 records). [2025-09-29T18:52:33.622193] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-09-29T18:52:33.950505] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2024-12 (2.40 seconds). [2025-09-29T18:52:33.955981] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-09-29T18:52:34.086670] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-09-29T18:52:34.086767] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-09-29T18:52:34.087490] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-09-29T18:52:34.087552] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-09-29T18:52:34.090810] [DEBUG] [LOCAL ] FTK: Trimmed 42784 records to 32226 (keeping 200 days of data) [2025-09-29T18:52:34.290313] [DEBUG] [LOCAL ] FTK: Primary data saved (32226 records). [2025-09-29T18:52:34.290484] [INFO ] [MAIN ] FTK: Full history saved. [2025-09-29T18:52:34.290598] [INFO ] [MAIN ] Update Progress: 882/2371 symbols completed. FTK took 22.0s. Estimated remaining: 3h 9m 58s. Rate: 7.8 symbols/min [2025-09-29T18:52:34.474449] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:52:34.511207] [DEBUG] [LOCAL ] FUL: Loaded 33570 existing records from primary storage. [2025-09-29T18:52:34.511530] [INFO ] [MAIN ] FUL: Loaded 33570 existing records. [2025-09-29T18:52:34.707349] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:52:34.707820] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-09-29T18:52:34.707922] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-09-29T18:52:34.717845] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-09-29T18:52:34.733539] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-09-29T18:52:34.768618] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-01. [2025-09-29T18:52:34.776350] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-29T18:52:35.129022] [INFO ] [REMOTE ] FUL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:52:35.366489] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-29T18:52:35.548143] [INFO ] [REMOTE ] FUL: Fetching primary data for 2024-12. [2025-09-29T18:52:36.348162] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-09-29T18:52:36.742733] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-29T18:52:37.148096] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-09-29T18:52:37.414956] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-01 (2.65 seconds). [2025-09-29T18:52:37.948097] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-01. [2025-09-29T18:52:38.043966] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-29T18:52:38.053074] [INFO ] [REMOTE ] FTS: Full fetch complete (60138 records). [2025-09-29T18:52:38.053285] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-09-29T18:52:38.448765] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-09-29T18:52:38.448857] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-09-29T18:52:38.449701] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-09-29T18:52:38.449766] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-09-29T18:52:38.451045] [DEBUG] [LOCAL ] FTS: Trimmed 60138 records to 42097 (keeping 200 days of data) [2025-09-29T18:52:38.735514] [DEBUG] [LOCAL ] FTS: Primary data saved (42097 records). [2025-09-29T18:52:38.735876] [INFO ] [MAIN ] FTS: Full history saved. [2025-09-29T18:52:38.736038] [INFO ] [MAIN ] Update Progress: 883/2371 symbols completed. FTS took 26.5s. Estimated remaining: 3h 9m 45s. Rate: 7.8 symbols/min [2025-09-29T18:52:38.769465] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-09-29T18:52:38.919034] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:52:38.976303] [DEBUG] [LOCAL ] FUN: Loaded 52349 existing records from primary storage. [2025-09-29T18:52:38.976861] [INFO ] [MAIN ] FUN: Loaded 52349 existing records. [2025-09-29T18:52:39.221771] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:52:39.222463] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-09-29T18:52:39.222895] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-09-29T18:52:39.225893] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-29T18:52:39.236803] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-09-29T18:52:39.237890] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-09-29T18:52:39.374797] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-29T18:52:39.553568] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-09-29T18:52:39.667580] [INFO ] [REMOTE ] FUN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:52:40.348129] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-09-29T18:52:41.142579] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-09-29T18:52:41.153212] [INFO ] [REMOTE ] FUN: Fetching primary data for 2024-12. [2025-09-29T18:52:41.355790] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-29T18:52:41.750024] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-29T18:52:41.948130] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-09-29T18:52:42.754730] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-09-29T18:52:42.760589] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-29T18:52:43.020357] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-29T18:52:43.548132] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-09-29T18:52:44.348134] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-09-29T18:52:45.018476] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-29T18:52:45.064006] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-29T18:52:45.075716] [INFO ] [REMOTE ] FTV: Full fetch complete (76292 records). [2025-09-29T18:52:45.075902] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-09-29T18:52:45.153236] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-09-29T18:52:45.506791] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-09-29T18:52:45.506954] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-09-29T18:52:45.508074] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-09-29T18:52:45.508159] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-09-29T18:52:45.510047] [DEBUG] [LOCAL ] FTV: Trimmed 76292 records to 52922 (keeping 200 days of data) [2025-09-29T18:52:45.650219] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-29T18:52:45.926187] [DEBUG] [LOCAL ] FTV: Primary data saved (52922 records). [2025-09-29T18:52:45.926345] [INFO ] [MAIN ] FTV: Full history saved. [2025-09-29T18:52:45.926476] [INFO ] [MAIN ] Update Progress: 884/2371 symbols completed. FTV took 33.6s. Estimated remaining: 3h 9m 36s. Rate: 7.8 symbols/min [2025-09-29T18:52:45.956109] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-09-29T18:52:46.106942] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:52:46.134311] [DEBUG] [LOCAL ] FVR: Loaded 22328 existing records from primary storage. [2025-09-29T18:52:46.134589] [INFO ] [MAIN ] FVR: Loaded 22328 existing records. [2025-09-29T18:52:46.323526] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:52:46.323777] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-09-29T18:52:46.323827] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-09-29T18:52:46.324433] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-09-29T18:52:46.324509] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-09-29T18:52:46.718842] [INFO ] [REMOTE ] FVR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:52:46.744252] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-29T18:52:46.752540] [INFO ] [REMOTE ] FVR: Fetching primary data for 2024-12. [2025-09-29T18:52:47.548518] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-09-29T18:52:47.952977] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-29T18:52:48.256918] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-29T18:52:48.348083] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-01. [2025-09-29T18:52:48.884762] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-29T18:52:49.148085] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-09-29T18:52:49.367983] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-29T18:52:49.948130] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-09-29T18:52:50.748202] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-09-29T18:52:51.422398] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-09-29T18:52:51.503810] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-29T18:52:51.548094] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-09-29T18:52:51.673997] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-29T18:52:52.348125] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-09-29T18:52:53.070576] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-29T18:52:53.148080] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-09-29T18:52:53.261036] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-29T18:52:53.948146] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-09-29T18:52:54.748096] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-09-29T18:52:54.886774] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-29T18:52:55.026862] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-29T18:52:55.548146] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-09-29T18:52:55.663459] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-29T18:52:56.348123] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-09-29T18:52:57.148084] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-09-29T18:52:57.526309] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-29T18:52:57.948123] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-09-29T18:52:58.026059] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-29T18:52:58.076085] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-29T18:52:58.748123] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-09-29T18:52:59.548162] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-09-29T18:53:00.194934] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-29T18:53:00.348100] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-09-29T18:53:00.417800] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-29T18:53:00.454241] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-29T18:53:01.148198] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-09-29T18:53:01.948164] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-09-29T18:53:02.540305] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-29T18:53:02.712252] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-29T18:53:02.748151] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-09-29T18:53:02.890097] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-29T18:53:03.548147] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-09-29T18:53:03.788797] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-29T18:53:04.348135] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-09-29T18:53:05.148127] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-09-29T18:53:05.948145] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-09-29T18:53:06.151308] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (2.60 seconds). [2025-09-29T18:53:06.166366] [INFO ] [REMOTE ] FUBO: Full fetch complete (77761 records). [2025-09-29T18:53:06.166677] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-09-29T18:53:06.556395] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-29T18:53:06.612542] [INFO ] [REMOTE ] FUN: Full fetch complete (72737 records). [2025-09-29T18:53:06.653257] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-09-29T18:53:06.657431] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-09-29T18:53:06.658105] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-09-29T18:53:06.659189] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-09-29T18:53:06.659376] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-09-29T18:53:06.727697] [DEBUG] [LOCAL ] FUBO: Trimmed 77761 records to 53695 (keeping 200 days of data) [2025-09-29T18:53:07.009935] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-29T18:53:07.059851] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-09-29T18:53:07.176798] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-29T18:53:07.274539] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-09-29T18:53:07.274982] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-09-29T18:53:07.276049] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-09-29T18:53:07.277071] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-09-29T18:53:07.281451] [DEBUG] [LOCAL ] FUN: Trimmed 72737 records to 51585 (keeping 200 days of data) [2025-09-29T18:53:07.568930] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-09-29T18:53:07.820091] [DEBUG] [LOCAL ] FUN: Primary data saved (51585 records). [2025-09-29T18:53:07.821156] [INFO ] [MAIN ] FUN: Full history saved. [2025-09-29T18:53:07.821620] [INFO ] [MAIN ] Update Progress: 885/2371 symbols completed. FUN took 29.1s. Estimated remaining: 3h 9m 52s. Rate: 7.8 symbols/min [2025-09-29T18:53:07.887681] [DEBUG] [LOCAL ] FUBO: Primary data saved (53695 records). [2025-09-29T18:53:07.909555] [INFO ] [MAIN ] FUBO: Full history saved. [2025-09-29T18:53:07.927016] [INFO ] [MAIN ] Update Progress: 886/2371 symbols completed. FUBO took 40.2s. Estimated remaining: 3h 9m 32s. Rate: 7.8 symbols/min [2025-09-29T18:53:08.139134] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:53:08.215417] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:53:08.229487] [DEBUG] [LOCAL ] FXED: Loaded 1259 existing records from primary storage. [2025-09-29T18:53:08.246102] [INFO ] [MAIN ] FXED: Loaded 1259 existing records. [2025-09-29T18:53:08.286305] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-29T18:53:08.378052] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-09-29T18:53:08.447823] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-29T18:53:08.491966] [WARN ] [MAIN ] FXED: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:53:08.505045] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-09-29T18:53:08.504754] [INFO ] [REMOTE ] FVR: Full fetch complete (30288 records). [2025-09-29T18:53:08.505205] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-09-29T18:53:08.505468] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-09-29T18:53:08.506528] [DEBUG] [LOCAL ] FXED: Deleted primary data file. [2025-09-29T18:53:08.507038] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-09-29T18:53:08.506443] [DEBUG] [LOCAL ] FVRR: Loaded 40749 existing records from primary storage. [2025-09-29T18:53:08.531681] [INFO ] [MAIN ] FVRR: Loaded 40749 existing records. [2025-09-29T18:53:09.189207] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:53:09.316118] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-09-29T18:53:09.339872] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-09-29T18:53:09.389676] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-09-29T18:53:09.432696] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-09-29T18:53:09.482798] [INFO ] [REMOTE ] FXED: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:53:09.493732] [INFO ] [REMOTE ] FXED: Fetching primary data for 2024-12. [2025-09-29T18:53:09.618713] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-09-29T18:53:09.619602] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-09-29T18:53:09.641624] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-09-29T18:53:09.654819] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-09-29T18:53:09.710296] [DEBUG] [LOCAL ] FVR: Trimmed 30288 records to 21881 (keeping 200 days of data) [2025-09-29T18:53:10.016042] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-29T18:53:10.018764] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-29T18:53:10.039403] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-01. [2025-09-29T18:53:10.103084] [INFO ] [REMOTE ] FUL: Full fetch complete (47326 records). [2025-09-29T18:53:10.117006] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-09-29T18:53:10.136263] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:53:10.564757] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-29T18:53:10.671777] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-09-29T18:53:10.672175] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-09-29T18:53:10.672966] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-09-29T18:53:10.673047] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-09-29T18:53:10.675451] [DEBUG] [LOCAL ] FVR: Primary data saved (21881 records). [2025-09-29T18:53:10.675758] [INFO ] [MAIN ] FVR: Full history saved. [2025-09-29T18:53:10.675888] [DEBUG] [LOCAL ] FUL: Trimmed 47326 records to 33014 (keeping 200 days of data) [2025-09-29T18:53:10.676036] [INFO ] [MAIN ] Update Progress: 887/2371 symbols completed. FVR took 24.7s. Estimated remaining: 3h 9m 16s. Rate: 7.8 symbols/min [2025-09-29T18:53:10.753242] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-09-29T18:53:10.962684] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:53:11.091067] [DEBUG] [LOCAL ] G: Loaded 50547 existing records from primary storage. [2025-09-29T18:53:11.092557] [INFO ] [MAIN ] G: Loaded 50547 existing records. [2025-09-29T18:53:11.292049] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-29T18:53:11.298578] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:53:11.300974] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-09-29T18:53:11.301776] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-09-29T18:53:11.304677] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-09-29T18:53:11.305030] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-09-29T18:53:11.421323] [DEBUG] [LOCAL ] FUL: Primary data saved (33014 records). [2025-09-29T18:53:11.424356] [INFO ] [MAIN ] FUL: Full history saved. [2025-09-29T18:53:11.424540] [INFO ] [MAIN ] Update Progress: 888/2371 symbols completed. FUL took 37.1s. Estimated remaining: 3h 8m 57s. Rate: 7.8 symbols/min [2025-09-29T18:53:11.548286] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-09-29T18:53:11.860846] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:53:11.936914] [INFO ] [REMOTE ] G: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:53:11.961905] [DEBUG] [LOCAL ] GAB: Loaded 28493 existing records from primary storage. [2025-09-29T18:53:11.962206] [INFO ] [MAIN ] GAB: Loaded 28493 existing records. [2025-09-29T18:53:12.069188] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-29T18:53:12.151920] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:53:12.152187] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-09-29T18:53:12.152248] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-09-29T18:53:12.152672] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-09-29T18:53:12.152737] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-09-29T18:53:12.355004] [INFO ] [REMOTE ] G: Fetching primary data for 2024-12. [2025-09-29T18:53:12.523013] [INFO ] [REMOTE ] GAB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:53:13.148155] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2024-12. [2025-09-29T18:53:13.948175] [INFO ] [REMOTE ] GAB: Fetching primary data for 2024-12. [2025-09-29T18:53:14.245716] [INFO ] [REMOTE ] G: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-29T18:53:14.342080] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-29T18:53:14.748136] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-09-29T18:53:15.170348] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-29T18:53:15.201290] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-29T18:53:15.548120] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-01. [2025-09-29T18:53:16.348113] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-09-29T18:53:16.699731] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-29T18:53:17.154568] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-09-29T18:53:17.160445] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-29T18:53:17.948112] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-09-29T18:53:18.301193] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-29T18:53:18.748103] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-01. [2025-09-29T18:53:18.758317] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-29T18:53:19.548117] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-09-29T18:53:19.876609] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-29T18:53:20.348122] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-09-29T18:53:21.008943] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-29T18:53:21.148117] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-09-29T18:53:21.948226] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-09-29T18:53:22.001247] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-29T18:53:22.636495] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-29T18:53:22.748175] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-09-29T18:53:22.964699] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-29T18:53:23.237666] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-29T18:53:23.548168] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-09-29T18:53:24.348122] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-09-29T18:53:25.148145] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-09-29T18:53:25.228227] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-29T18:53:25.588398] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-29T18:53:25.769838] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-29T18:53:25.948112] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-09-29T18:53:26.748131] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-09-29T18:53:27.346795] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-29T18:53:27.347756] [INFO ] [REMOTE ] FXED: Full fetch complete (1801 records). [2025-09-29T18:53:27.347827] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-09-29T18:53:27.550907] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-09-29T18:53:27.610422] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-29T18:53:27.785147] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-09-29T18:53:27.785234] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-09-29T18:53:27.785343] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-09-29T18:53:27.785419] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-09-29T18:53:27.785808] [DEBUG] [LOCAL ] FXED: Trimmed 1801 records to 1240 (keeping 200 days of data) [2025-09-29T18:53:27.794558] [DEBUG] [LOCAL ] FXED: Primary data saved (1240 records). [2025-09-29T18:53:27.794621] [INFO ] [MAIN ] FXED: Full history saved. [2025-09-29T18:53:27.794747] [INFO ] [MAIN ] Update Progress: 889/2371 symbols completed. FXED took 19.9s. Estimated remaining: 3h 9m 4s. Rate: 7.8 symbols/min [2025-09-29T18:53:27.979035] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:53:27.985727] [DEBUG] [LOCAL ] GAM: Loaded 4174 existing records from primary storage. [2025-09-29T18:53:27.985966] [INFO ] [MAIN ] GAM: Loaded 4174 existing records. [2025-09-29T18:53:28.184687] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:53:28.184938] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-09-29T18:53:28.184988] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-09-29T18:53:28.185485] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-09-29T18:53:28.185546] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-09-29T18:53:28.353006] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-09-29T18:53:28.598311] [INFO ] [REMOTE ] GAM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:53:29.148113] [INFO ] [REMOTE ] GAM: Fetching primary data for 2024-12. [2025-09-29T18:53:29.948135] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-09-29T18:53:30.316962] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (2.77 seconds). [2025-09-29T18:53:30.748189] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-09-29T18:53:30.900540] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-29T18:53:31.548144] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-01. [2025-09-29T18:53:31.703793] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (3.35 seconds). [2025-09-29T18:53:32.007591] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-29T18:53:32.133560] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-29T18:53:32.348115] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-09-29T18:53:32.490574] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-29T18:53:33.148120] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-09-29T18:53:33.677953] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-29T18:53:33.948141] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-09-29T18:53:34.746145] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-29T18:53:34.757011] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-09-29T18:53:35.250985] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-29T18:53:35.432864] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-29T18:53:35.548122] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-09-29T18:53:36.022638] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-29T18:53:36.348119] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-09-29T18:53:36.953606] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-29T18:53:37.148113] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-09-29T18:53:37.948112] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-09-29T18:53:38.451390] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-29T18:53:38.748166] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-09-29T18:53:39.548086] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-09-29T18:53:39.583753] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-29T18:53:39.977582] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-29T18:53:40.256625] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-29T18:53:40.348168] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-09-29T18:53:41.148122] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-09-29T18:53:41.761279] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-29T18:53:41.948101] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-09-29T18:53:42.059028] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-29T18:53:42.748144] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-09-29T18:53:43.548137] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-09-29T18:53:44.006490] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-29T18:53:44.348126] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-09-29T18:53:44.462975] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-29T18:53:45.148110] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-09-29T18:53:45.769748] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-29T18:53:45.948114] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-09-29T18:53:46.109663] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (2.56 seconds). [2025-09-29T18:53:46.120558] [INFO ] [REMOTE ] G: Full fetch complete (71591 records). [2025-09-29T18:53:46.120744] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-09-29T18:53:46.304857] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-29T18:53:46.585776] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-29T18:53:46.586190] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-09-29T18:53:46.586366] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-09-29T18:53:46.588221] [INFO ] [REMOTE ] GAM: Full fetch complete (6816 records). [2025-09-29T18:53:46.589574] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-09-29T18:53:46.589444] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-09-29T18:53:46.627221] [DEBUG] [LOCAL ] G: Saving primary data. [2025-09-29T18:53:46.723103] [DEBUG] [LOCAL ] G: Trimmed 71591 records to 49797 (keeping 200 days of data) [2025-09-29T18:53:46.759137] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-09-29T18:53:47.120580] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-09-29T18:53:47.121215] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-09-29T18:53:47.125272] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-09-29T18:53:47.125616] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-09-29T18:53:47.131283] [DEBUG] [LOCAL ] GAM: Trimmed 6816 records to 4065 (keeping 200 days of data) [2025-09-29T18:53:47.170856] [DEBUG] [LOCAL ] GAM: Primary data saved (4065 records). [2025-09-29T18:53:47.170989] [INFO ] [MAIN ] GAM: Full history saved. [2025-09-29T18:53:47.171082] [INFO ] [MAIN ] Update Progress: 890/2371 symbols completed. GAM took 19.4s. Estimated remaining: 3h 9m 16s. Rate: 7.8 symbols/min [2025-09-29T18:53:47.452096] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:53:47.548288] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-09-29T18:53:47.581149] [DEBUG] [LOCAL ] GAP: Loaded 54435 existing records from primary storage. [2025-09-29T18:53:47.582496] [INFO ] [MAIN ] GAP: Loaded 54435 existing records. [2025-09-29T18:53:47.789919] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:53:47.785762] [DEBUG] [LOCAL ] G: Primary data saved (49797 records). [2025-09-29T18:53:47.790229] [INFO ] [MAIN ] G: Full history saved. [2025-09-29T18:53:47.790311] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-09-29T18:53:47.790442] [INFO ] [MAIN ] Update Progress: 891/2371 symbols completed. G took 37.1s. Estimated remaining: 3h 8m 56s. Rate: 7.8 symbols/min [2025-09-29T18:53:47.790527] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-09-29T18:53:47.870518] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-09-29T18:53:47.875858] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-09-29T18:53:48.143274] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:53:48.340408] [DEBUG] [LOCAL ] GATX: Loaded 18437 existing records from primary storage. [2025-09-29T18:53:48.371273] [INFO ] [MAIN ] GATX: Loaded 18437 existing records. [2025-09-29T18:53:48.430277] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:53:48.446604] [INFO ] [REMOTE ] GAP: Fetching primary data for 2024-12. [2025-09-29T18:53:48.604893] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:53:48.605213] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-09-29T18:53:48.605338] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-09-29T18:53:48.606070] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-09-29T18:53:48.606276] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-09-29T18:53:48.723684] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-29T18:53:48.789282] [INFO ] [REMOTE ] FVRR: Full fetch complete (58792 records). [2025-09-29T18:53:48.801368] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-29T18:53:48.827453] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-09-29T18:53:49.156930] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-09-29T18:53:49.320828] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:53:49.580382] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-09-29T18:53:49.580516] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-09-29T18:53:49.581491] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-09-29T18:53:49.581559] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-09-29T18:53:49.582944] [DEBUG] [LOCAL ] FVRR: Trimmed 58792 records to 40008 (keeping 200 days of data) [2025-09-29T18:53:49.832793] [DEBUG] [LOCAL ] FVRR: Primary data saved (40008 records). [2025-09-29T18:53:49.832922] [INFO ] [MAIN ] FVRR: Full history saved. [2025-09-29T18:53:49.833007] [INFO ] [MAIN ] Update Progress: 892/2371 symbols completed. FVRR took 42.0s. Estimated remaining: 3h 8m 40s. Rate: 7.8 symbols/min [2025-09-29T18:53:49.949962] [INFO ] [REMOTE ] GATX: Fetching primary data for 2024-12. [2025-09-29T18:53:50.027897] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:53:50.045818] [DEBUG] [LOCAL ] GBAB: Loaded 13142 existing records from primary storage. [2025-09-29T18:53:50.046076] [INFO ] [MAIN ] GBAB: Loaded 13142 existing records. [2025-09-29T18:53:50.243828] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:53:50.244120] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-09-29T18:53:50.244236] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-09-29T18:53:50.244775] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-09-29T18:53:50.244931] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-09-29T18:53:50.592235] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-29T18:53:50.679543] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:53:50.748110] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2024-12. [2025-09-29T18:53:50.780768] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-29T18:53:50.787899] [INFO ] [REMOTE ] GAB: Full fetch complete (39809 records). [2025-09-29T18:53:50.788034] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-09-29T18:53:51.170348] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-29T18:53:51.225670] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-09-29T18:53:51.225764] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-09-29T18:53:51.226456] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-09-29T18:53:51.226518] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-09-29T18:53:51.227614] [DEBUG] [LOCAL ] GAB: Trimmed 39809 records to 28038 (keeping 200 days of data) [2025-09-29T18:53:51.401599] [DEBUG] [LOCAL ] GAB: Primary data saved (28038 records). [2025-09-29T18:53:51.401868] [INFO ] [MAIN ] GAB: Full history saved. [2025-09-29T18:53:51.402002] [INFO ] [MAIN ] Update Progress: 893/2371 symbols completed. GAB took 40.0s. Estimated remaining: 3h 8m 22s. Rate: 7.8 symbols/min [2025-09-29T18:53:51.556162] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-09-29T18:53:51.583249] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:53:51.641381] [DEBUG] [LOCAL ] GBCI: Loaded 40720 existing records from primary storage. [2025-09-29T18:53:51.641732] [INFO ] [MAIN ] GBCI: Loaded 40720 existing records. [2025-09-29T18:53:51.842616] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:53:51.842851] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-09-29T18:53:51.842900] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-09-29T18:53:51.843323] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-09-29T18:53:51.843404] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-09-29T18:53:52.281169] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:53:52.283892] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-29T18:53:52.300432] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-29T18:53:52.348131] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-09-29T18:53:53.148142] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-01. [2025-09-29T18:53:53.261865] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-29T18:53:53.948092] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-09-29T18:53:54.009791] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-29T18:53:54.748155] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-09-29T18:53:55.548104] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2024-12. [2025-09-29T18:53:55.670263] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-29T18:53:56.348135] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-09-29T18:53:57.079151] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-09-29T18:53:57.148070] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-09-29T18:53:57.250176] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-29T18:53:57.460315] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-29T18:53:57.787890] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-29T18:53:57.948149] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-09-29T18:53:58.748117] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-09-29T18:53:59.490944] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-29T18:53:59.548115] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-09-29T18:53:59.725799] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-29T18:54:00.348114] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-09-29T18:54:00.389804] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-29T18:54:01.148125] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-09-29T18:54:01.948167] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-09-29T18:54:02.286631] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-29T18:54:02.311091] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-29T18:54:02.748136] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-09-29T18:54:03.443541] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-29T18:54:03.548160] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-09-29T18:54:04.348118] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-09-29T18:54:04.398695] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-29T18:54:04.654470] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-29T18:54:05.148266] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-09-29T18:54:05.447174] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-29T18:54:05.948134] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-09-29T18:54:06.070431] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-29T18:54:06.748133] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-09-29T18:54:07.548137] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-09-29T18:54:07.728196] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-29T18:54:07.925278] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-29T18:54:08.348096] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-09-29T18:54:08.548250] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-29T18:54:09.081924] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-29T18:54:09.148101] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-09-29T18:54:09.948122] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-09-29T18:54:10.748107] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-09-29T18:54:10.940930] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-29T18:54:11.088244] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-29T18:54:11.407728] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-29T18:54:11.548122] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-09-29T18:54:12.348099] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-09-29T18:54:12.414794] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-29T18:54:12.417963] [INFO ] [REMOTE ] GBAB: Full fetch complete (19995 records). [2025-09-29T18:54:12.418045] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-09-29T18:54:12.833103] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-09-29T18:54:12.833194] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-09-29T18:54:12.833632] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-09-29T18:54:12.833711] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-09-29T18:54:12.834346] [DEBUG] [LOCAL ] GBAB: Trimmed 19995 records to 13065 (keeping 200 days of data) [2025-09-29T18:54:12.918116] [DEBUG] [LOCAL ] GBAB: Primary data saved (13065 records). [2025-09-29T18:54:12.918271] [INFO ] [MAIN ] GBAB: Full history saved. [2025-09-29T18:54:12.918421] [INFO ] [MAIN ] Update Progress: 894/2371 symbols completed. GBAB took 23.1s. Estimated remaining: 3h 8m 37s. Rate: 7.8 symbols/min [2025-09-29T18:54:13.096461] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:54:13.096705] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-09-29T18:54:13.096763] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-09-29T18:54:13.096882] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-09-29T18:54:13.096925] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-09-29T18:54:13.096967] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-09-29T18:54:13.097001] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-09-29T18:54:13.153416] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-09-29T18:54:13.477380] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:54:13.858883] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-29T18:54:13.948138] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-09-29T18:54:14.412022] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-29T18:54:14.416984] [INFO ] [REMOTE ] GATX: Full fetch complete (25364 records). [2025-09-29T18:54:14.417166] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-09-29T18:54:14.760887] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-09-29T18:54:14.812355] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-09-29T18:54:14.812503] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-09-29T18:54:14.813143] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-09-29T18:54:14.813209] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-09-29T18:54:14.814157] [DEBUG] [LOCAL ] GATX: Trimmed 25364 records to 18170 (keeping 200 days of data) [2025-09-29T18:54:14.935344] [DEBUG] [LOCAL ] GATX: Primary data saved (18170 records). [2025-09-29T18:54:14.935506] [INFO ] [MAIN ] GATX: Full history saved. [2025-09-29T18:54:14.935599] [INFO ] [MAIN ] Update Progress: 895/2371 symbols completed. GATX took 27.1s. Estimated remaining: 3h 8m 20s. Rate: 7.8 symbols/min [2025-09-29T18:54:15.111712] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:54:15.153491] [DEBUG] [LOCAL ] GBTG: Loaded 40807 existing records from primary storage. [2025-09-29T18:54:15.153824] [INFO ] [MAIN ] GBTG: Loaded 40807 existing records. [2025-09-29T18:54:15.340723] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:54:15.341103] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-09-29T18:54:15.341255] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-09-29T18:54:15.342325] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-09-29T18:54:15.342421] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-09-29T18:54:15.558147] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2024-12. [2025-09-29T18:54:15.698227] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-29T18:54:15.789785] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:54:16.146114] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-29T18:54:16.348102] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-09-29T18:54:16.827457] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-29T18:54:17.148167] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2024-12. [2025-09-29T18:54:17.846233] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-29T18:54:17.948121] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-09-29T18:54:18.362914] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-29T18:54:18.671713] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-29T18:54:18.748131] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-09-29T18:54:19.548151] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-09-29T18:54:20.137901] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-29T18:54:20.348109] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-09-29T18:54:21.148091] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-09-29T18:54:21.421692] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-29T18:54:21.462245] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-29T18:54:21.888391] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-29T18:54:21.948088] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-09-29T18:54:22.748156] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-09-29T18:54:23.082155] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-29T18:54:23.446769] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-29T18:54:23.548132] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-01. [2025-09-29T18:54:24.348122] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-09-29T18:54:24.840897] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-29T18:54:25.148123] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-09-29T18:54:25.948092] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-09-29T18:54:25.981592] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-29T18:54:25.990406] [INFO ] [REMOTE ] GBCI: Full fetch complete (58062 records). [2025-09-29T18:54:25.990566] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-09-29T18:54:26.402384] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-09-29T18:54:26.402507] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-09-29T18:54:26.403565] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-09-29T18:54:26.410193] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-09-29T18:54:26.422707] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-29T18:54:26.431180] [DEBUG] [LOCAL ] GBCI: Trimmed 58062 records to 40061 (keeping 200 days of data) [2025-09-29T18:54:26.685802] [DEBUG] [LOCAL ] GBCI: Primary data saved (40061 records). [2025-09-29T18:54:26.685950] [INFO ] [MAIN ] GBCI: Full history saved. [2025-09-29T18:54:26.686056] [INFO ] [MAIN ] Update Progress: 896/2371 symbols completed. GBCI took 35.3s. Estimated remaining: 3h 8m 19s. Rate: 7.8 symbols/min [2025-09-29T18:54:26.755914] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-09-29T18:54:26.875986] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:54:26.908038] [DEBUG] [LOCAL ] GBX: Loaded 29497 existing records from primary storage. [2025-09-29T18:54:26.908326] [INFO ] [MAIN ] GBX: Loaded 29497 existing records. [2025-09-29T18:54:27.101248] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:54:27.101597] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-09-29T18:54:27.101691] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-09-29T18:54:27.102272] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-09-29T18:54:27.102330] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-09-29T18:54:27.288196] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-29T18:54:27.482567] [INFO ] [REMOTE ] GBX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:54:27.548103] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-09-29T18:54:27.761216] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-29T18:54:27.773278] [INFO ] [REMOTE ] GAP: Full fetch complete (77634 records). [2025-09-29T18:54:27.773457] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-09-29T18:54:28.208847] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-09-29T18:54:28.208945] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-09-29T18:54:28.210148] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-09-29T18:54:28.210219] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-09-29T18:54:28.214444] [DEBUG] [LOCAL ] GAP: Trimmed 77634 records to 53655 (keeping 200 days of data) [2025-09-29T18:54:28.348300] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-09-29T18:54:28.574870] [DEBUG] [LOCAL ] GAP: Primary data saved (53655 records). [2025-09-29T18:54:28.575023] [INFO ] [MAIN ] GAP: Full history saved. [2025-09-29T18:54:28.575124] [INFO ] [MAIN ] Update Progress: 897/2371 symbols completed. GAP took 41.4s. Estimated remaining: 3h 8m 2s. Rate: 7.8 symbols/min [2025-09-29T18:54:28.771714] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:54:28.819916] [DEBUG] [LOCAL ] GCI: Loaded 44828 existing records from primary storage. [2025-09-29T18:54:28.820284] [INFO ] [MAIN ] GCI: Loaded 44828 existing records. [2025-09-29T18:54:28.896005] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-29T18:54:29.029895] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:54:29.030244] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-09-29T18:54:29.030310] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-09-29T18:54:29.040193] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-09-29T18:54:29.052327] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-09-29T18:54:29.135888] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-29T18:54:29.161628] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-09-29T18:54:29.461487] [INFO ] [REMOTE ] GCI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:54:29.464818] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-29T18:54:29.948132] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-09-29T18:54:30.748107] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-09-29T18:54:30.994151] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-09-29T18:54:31.553837] [INFO ] [REMOTE ] GCI: Fetching primary data for 2024-12. [2025-09-29T18:54:31.563467] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-29T18:54:32.348111] [INFO ] [REMOTE ] GBX: Fetching primary data for 2024-12. [2025-09-29T18:54:33.091144] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-29T18:54:33.148089] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-09-29T18:54:33.457450] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-29T18:54:33.530788] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-29T18:54:33.948117] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-09-29T18:54:34.383917] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-29T18:54:34.385448] [INFO ] [REMOTE ] GBLI: Full fetch complete (1319 records). [2025-09-29T18:54:34.385609] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-09-29T18:54:34.593210] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 173 unique days, need 200 days [2025-09-29T18:54:34.593420] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:54:34.593493] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:54:34.593569] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-09-29T18:54:34.593687] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-09-29T18:54:34.593763] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-09-29T18:54:34.593824] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-09-29T18:54:34.593890] [INFO ] [MAIN ] Update Progress: 898/2371 symbols completed. GBLI took 21.7s. Estimated remaining: 3h 7m 52s. Rate: 7.8 symbols/min [2025-09-29T18:54:34.754529] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-01. [2025-09-29T18:54:34.783596] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:54:34.823049] [DEBUG] [LOCAL ] GCO: Loaded 25686 existing records from primary storage. [2025-09-29T18:54:34.823321] [INFO ] [MAIN ] GCO: Loaded 25686 existing records. [2025-09-29T18:54:35.036434] [WARN ] [MAIN ] GCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:54:35.036760] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-09-29T18:54:35.036837] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-09-29T18:54:35.037544] [DEBUG] [LOCAL ] GCO: Deleted primary data file. [2025-09-29T18:54:35.037619] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-09-29T18:54:35.553389] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-09-29T18:54:35.615620] [INFO ] [REMOTE ] GCO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:54:36.230015] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-29T18:54:36.348128] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-09-29T18:54:37.090404] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-29T18:54:37.148099] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-09-29T18:54:37.665412] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-29T18:54:37.948134] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-09-29T18:54:38.682779] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-29T18:54:38.748110] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-09-29T18:54:39.320755] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-29T18:54:39.548122] [INFO ] [REMOTE ] GCO: Fetching primary data for 2024-12. [2025-09-29T18:54:39.837997] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-29T18:54:40.348137] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-09-29T18:54:40.685313] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-29T18:54:41.148143] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-01. [2025-09-29T18:54:41.709133] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-29T18:54:41.948120] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-09-29T18:54:42.299733] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-29T18:54:42.748105] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-09-29T18:54:43.548095] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-09-29T18:54:43.577776] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-29T18:54:43.781167] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-29T18:54:44.348111] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-09-29T18:54:44.833588] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-29T18:54:45.148132] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-09-29T18:54:45.666414] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-29T18:54:45.948106] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-09-29T18:54:46.669760] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-29T18:54:46.748163] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-09-29T18:54:47.214481] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-29T18:54:47.548132] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-09-29T18:54:48.284529] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-29T18:54:48.348097] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-09-29T18:54:49.057897] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-29T18:54:49.148141] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-09-29T18:54:49.462369] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-29T18:54:49.948101] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-09-29T18:54:50.748147] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-09-29T18:54:50.796910] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-29T18:54:51.347091] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-29T18:54:51.548130] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-09-29T18:54:51.917060] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-29T18:54:52.348094] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-09-29T18:54:53.020152] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-29T18:54:53.028970] [INFO ] [REMOTE ] GBTG: Full fetch complete (56557 records). [2025-09-29T18:54:53.029113] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-09-29T18:54:53.153247] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-09-29T18:54:53.456633] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-29T18:54:53.455815] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-09-29T18:54:53.461835] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-09-29T18:54:53.463089] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-09-29T18:54:53.463514] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-09-29T18:54:53.464900] [DEBUG] [LOCAL ] GBTG: Trimmed 56557 records to 40026 (keeping 200 days of data) [2025-09-29T18:54:53.715697] [DEBUG] [LOCAL ] GBTG: Primary data saved (40026 records). [2025-09-29T18:54:53.715835] [INFO ] [MAIN ] GBTG: Full history saved. [2025-09-29T18:54:53.715935] [INFO ] [MAIN ] Update Progress: 899/2371 symbols completed. GBTG took 38.8s. Estimated remaining: 3h 8m 3s. Rate: 7.8 symbols/min [2025-09-29T18:54:53.902871] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:54:53.929257] [DEBUG] [LOCAL ] GCTS: Loaded 20060 existing records from primary storage. [2025-09-29T18:54:53.929531] [INFO ] [MAIN ] GCTS: Loaded 20060 existing records. [2025-09-29T18:54:53.953363] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-09-29T18:54:54.121882] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:54:54.122111] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-09-29T18:54:54.122161] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-09-29T18:54:54.122875] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-09-29T18:54:54.122945] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-09-29T18:54:54.510921] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:54:54.527372] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-29T18:54:54.748177] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-09-29T18:54:55.027754] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-29T18:54:55.548096] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2024-12. [2025-09-29T18:54:55.797489] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-29T18:54:56.347198] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-29T18:54:56.348809] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-09-29T18:54:57.148123] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-09-29T18:54:57.362433] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-29T18:54:57.948107] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-09-29T18:54:58.433262] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-29T18:54:58.438792] [INFO ] [REMOTE ] GCO: Full fetch complete (35660 records). [2025-09-29T18:54:58.438952] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-09-29T18:54:58.753239] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-09-29T18:54:58.912797] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-09-29T18:54:58.912890] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-09-29T18:54:58.913671] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-09-29T18:54:58.913736] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-09-29T18:54:58.914522] [DEBUG] [LOCAL ] GCO: Trimmed 35660 records to 24869 (keeping 200 days of data) [2025-09-29T18:54:59.033184] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-29T18:54:59.091422] [DEBUG] [LOCAL ] GCO: Primary data saved (24869 records). [2025-09-29T18:54:59.091561] [INFO ] [MAIN ] GCO: Full history saved. [2025-09-29T18:54:59.091670] [INFO ] [MAIN ] Update Progress: 900/2371 symbols completed. GCO took 24.5s. Estimated remaining: 3h 7m 51s. Rate: 7.8 symbols/min [2025-09-29T18:54:59.266762] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:54:59.276188] [DEBUG] [LOCAL ] GCV: Loaded 7333 existing records from primary storage. [2025-09-29T18:54:59.276391] [INFO ] [MAIN ] GCV: Loaded 7333 existing records. [2025-09-29T18:54:59.459029] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:54:59.459304] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-09-29T18:54:59.459396] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-09-29T18:54:59.459728] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-09-29T18:54:59.459788] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-09-29T18:54:59.553205] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-09-29T18:54:59.827986] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:55:00.294917] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-29T18:55:00.354896] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-09-29T18:55:00.357156] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-29T18:55:01.148170] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-09-29T18:55:01.877674] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-29T18:55:01.948180] [INFO ] [REMOTE ] GCV: Fetching primary data for 2024-12. [2025-09-29T18:55:02.555187] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-29T18:55:02.563307] [INFO ] [REMOTE ] GBX: Full fetch complete (42758 records). [2025-09-29T18:55:02.563483] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-09-29T18:55:02.694428] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-29T18:55:02.754718] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-01. [2025-09-29T18:55:03.013367] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-09-29T18:55:03.013488] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-09-29T18:55:03.014706] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-09-29T18:55:03.014775] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-09-29T18:55:03.015959] [DEBUG] [LOCAL ] GBX: Trimmed 42758 records to 29132 (keeping 200 days of data) [2025-09-29T18:55:03.207474] [DEBUG] [LOCAL ] GBX: Primary data saved (29132 records). [2025-09-29T18:55:03.207609] [INFO ] [MAIN ] GBX: Full history saved. [2025-09-29T18:55:03.207777] [INFO ] [MAIN ] Update Progress: 901/2371 symbols completed. GBX took 36.5s. Estimated remaining: 3h 7m 38s. Rate: 7.8 symbols/min [2025-09-29T18:55:03.327114] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-29T18:55:03.400520] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:55:03.452412] [DEBUG] [LOCAL ] GD: Loaded 47940 existing records from primary storage. [2025-09-29T18:55:03.452826] [INFO ] [MAIN ] GD: Loaded 47940 existing records. [2025-09-29T18:55:03.555069] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-09-29T18:55:03.651358] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:55:03.651691] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-09-29T18:55:03.651782] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-09-29T18:55:03.652941] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-09-29T18:55:03.653005] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-09-29T18:55:04.035039] [INFO ] [REMOTE ] GD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:55:04.228100] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-29T18:55:04.348096] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-09-29T18:55:05.040237] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-29T18:55:05.148119] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-09-29T18:55:05.948134] [INFO ] [REMOTE ] GD: Fetching primary data for 2024-12. [2025-09-29T18:55:06.154576] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-29T18:55:06.748135] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-09-29T18:55:07.548123] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-09-29T18:55:07.901123] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-29T18:55:08.348112] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-01. [2025-09-29T18:55:08.408405] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-29T18:55:08.419630] [INFO ] [REMOTE ] GCI: Full fetch complete (63182 records). [2025-09-29T18:55:08.419807] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-09-29T18:55:08.585478] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-29T18:55:08.907107] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-09-29T18:55:08.907199] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-09-29T18:55:08.908260] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-09-29T18:55:08.908332] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-09-29T18:55:08.909851] [DEBUG] [LOCAL ] GCI: Trimmed 63182 records to 44152 (keeping 200 days of data) [2025-09-29T18:55:09.148434] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-09-29T18:55:09.182379] [DEBUG] [LOCAL ] GCI: Primary data saved (44152 records). [2025-09-29T18:55:09.182551] [INFO ] [MAIN ] GCI: Full history saved. [2025-09-29T18:55:09.182802] [INFO ] [MAIN ] Update Progress: 902/2371 symbols completed. GCI took 40.6s. Estimated remaining: 3h 7m 28s. Rate: 7.8 symbols/min [2025-09-29T18:55:09.360132] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:55:09.412041] [DEBUG] [LOCAL ] GDDY: Loaded 50449 existing records from primary storage. [2025-09-29T18:55:09.412453] [INFO ] [MAIN ] GDDY: Loaded 50449 existing records. [2025-09-29T18:55:09.604605] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:55:09.604931] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-09-29T18:55:09.604982] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-09-29T18:55:09.605883] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-09-29T18:55:09.605963] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-09-29T18:55:09.952098] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-09-29T18:55:10.026522] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:55:10.114051] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-29T18:55:10.232590] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-29T18:55:10.553982] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-29T18:55:10.748149] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-09-29T18:55:11.548078] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-09-29T18:55:11.918426] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-29T18:55:12.193456] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-29T18:55:12.348128] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-09-29T18:55:13.148125] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-09-29T18:55:13.948083] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-09-29T18:55:14.214891] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-29T18:55:14.542418] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-29T18:55:14.596060] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-29T18:55:14.748188] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-09-29T18:55:15.548137] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2024-12. [2025-09-29T18:55:16.348113] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-09-29T18:55:16.560158] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-29T18:55:17.148077] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-09-29T18:55:17.188363] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-29T18:55:17.453148] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-29T18:55:17.948164] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-09-29T18:55:18.753202] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-01. [2025-09-29T18:55:18.771979] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-29T18:55:18.932960] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-29T18:55:19.548129] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-09-29T18:55:20.333514] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-29T18:55:20.348056] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-09-29T18:55:20.886171] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-29T18:55:20.891011] [INFO ] [REMOTE ] GCTS: Full fetch complete (26981 records). [2025-09-29T18:55:20.891135] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-09-29T18:55:21.155749] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-09-29T18:55:21.273970] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-09-29T18:55:21.274085] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-09-29T18:55:21.274780] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-09-29T18:55:21.274857] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-09-29T18:55:21.275622] [DEBUG] [LOCAL ] GCTS: Trimmed 26981 records to 19896 (keeping 200 days of data) [2025-09-29T18:55:21.394577] [DEBUG] [LOCAL ] GCTS: Primary data saved (19896 records). [2025-09-29T18:55:21.394760] [INFO ] [MAIN ] GCTS: Full history saved. [2025-09-29T18:55:21.394897] [INFO ] [MAIN ] Update Progress: 903/2371 symbols completed. GCTS took 27.7s. Estimated remaining: 3h 7m 27s. Rate: 7.8 symbols/min [2025-09-29T18:55:21.579446] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:55:21.586443] [DEBUG] [LOCAL ] GDIV: Loaded 3724 existing records from primary storage. [2025-09-29T18:55:21.586685] [INFO ] [MAIN ] GDIV: Loaded 3724 existing records. [2025-09-29T18:55:21.778563] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:55:21.778795] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-09-29T18:55:21.778846] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-09-29T18:55:21.779510] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-09-29T18:55:21.779572] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-09-29T18:55:21.949420] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-09-29T18:55:22.172124] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:55:22.222473] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-29T18:55:22.745166] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-29T18:55:22.748052] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-09-29T18:55:22.991322] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-29T18:55:23.553716] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-09-29T18:55:23.554727] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-29T18:55:24.348097] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-09-29T18:55:25.148147] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-09-29T18:55:25.206225] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-29T18:55:25.208820] [INFO ] [REMOTE ] GCV: Full fetch complete (9344 records). [2025-09-29T18:55:25.208905] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-09-29T18:55:25.522000] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-29T18:55:25.658696] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-09-29T18:55:25.658806] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-09-29T18:55:25.659080] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-09-29T18:55:25.659144] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-09-29T18:55:25.659820] [DEBUG] [LOCAL ] GCV: Trimmed 9344 records to 7301 (keeping 200 days of data) [2025-09-29T18:55:25.705332] [DEBUG] [LOCAL ] GCV: Primary data saved (7301 records). [2025-09-29T18:55:25.705486] [INFO ] [MAIN ] GCV: Full history saved. [2025-09-29T18:55:25.705580] [INFO ] [MAIN ] Update Progress: 904/2371 symbols completed. GCV took 26.6s. Estimated remaining: 3h 7m 14s. Rate: 7.8 symbols/min [2025-09-29T18:55:25.903741] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:55:25.908870] [DEBUG] [LOCAL ] GDL: Loaded 2572 existing records from primary storage. [2025-09-29T18:55:25.909121] [INFO ] [MAIN ] GDL: Loaded 2572 existing records. [2025-09-29T18:55:25.953674] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-09-29T18:55:26.099014] [WARN ] [MAIN ] GDL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:55:26.099233] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-09-29T18:55:26.099288] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-09-29T18:55:26.099555] [DEBUG] [LOCAL ] GDL: Deleted primary data file. [2025-09-29T18:55:26.099623] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-09-29T18:55:26.470967] [INFO ] [REMOTE ] GDL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:55:26.748082] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2024-12. [2025-09-29T18:55:26.853352] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-29T18:55:27.339214] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-29T18:55:27.548112] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-09-29T18:55:27.902038] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-29T18:55:28.348200] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-09-29T18:55:29.089075] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-29T18:55:29.148152] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-09-29T18:55:29.948118] [INFO ] [REMOTE ] GDL: Fetching primary data for 2024-12. [2025-09-29T18:55:30.103711] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-29T18:55:30.720420] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-29T18:55:30.754951] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-01. [2025-09-29T18:55:30.758072] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-29T18:55:31.132229] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-29T18:55:31.548153] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-09-29T18:55:31.969602] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-29T18:55:32.348160] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-09-29T18:55:33.148114] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-09-29T18:55:33.959932] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-01. [2025-09-29T18:55:33.967006] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-29T18:55:34.509351] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-29T18:55:34.748099] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-09-29T18:55:34.908692] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-29T18:55:34.918046] [INFO ] [REMOTE ] GD: Full fetch complete (70437 records). [2025-09-29T18:55:34.918216] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-09-29T18:55:35.324781] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-09-29T18:55:35.324880] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-09-29T18:55:35.325901] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-09-29T18:55:35.325968] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-09-29T18:55:35.327495] [DEBUG] [LOCAL ] GD: Trimmed 70437 records to 47179 (keeping 200 days of data) [2025-09-29T18:55:35.553767] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-09-29T18:55:35.644538] [DEBUG] [LOCAL ] GD: Primary data saved (47179 records). [2025-09-29T18:55:35.644720] [INFO ] [MAIN ] GD: Full history saved. [2025-09-29T18:55:35.644834] [INFO ] [MAIN ] Update Progress: 905/2371 symbols completed. GD took 32.4s. Estimated remaining: 3h 7m 10s. Rate: 7.8 symbols/min [2025-09-29T18:55:35.823391] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:55:35.832690] [DEBUG] [LOCAL ] GDO: Loaded 6076 existing records from primary storage. [2025-09-29T18:55:35.832960] [INFO ] [MAIN ] GDO: Loaded 6076 existing records. [2025-09-29T18:55:36.028323] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:55:36.028636] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-09-29T18:55:36.028721] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-09-29T18:55:36.029044] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-09-29T18:55:36.029105] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-09-29T18:55:36.151546] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-29T18:55:36.353225] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-09-29T18:55:36.432165] [INFO ] [REMOTE ] GDO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:55:36.467351] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-29T18:55:36.985893] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-29T18:55:37.148170] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-09-29T18:55:37.598761] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-29T18:55:37.948170] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-09-29T18:55:38.681080] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-29T18:55:38.748119] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-09-29T18:55:39.185174] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-29T18:55:39.548117] [INFO ] [REMOTE ] GDO: Fetching primary data for 2024-12. [2025-09-29T18:55:40.348124] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-09-29T18:55:40.383580] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-29T18:55:40.781679] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-29T18:55:41.148110] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-01. [2025-09-29T18:55:41.900584] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-29T18:55:41.948110] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-09-29T18:55:42.748115] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-09-29T18:55:43.421870] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-29T18:55:43.548102] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-09-29T18:55:43.706840] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-29T18:55:44.161410] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-29T18:55:44.348118] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-09-29T18:55:44.804997] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-29T18:55:45.148119] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-09-29T18:55:45.766761] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-29T18:55:45.948172] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-09-29T18:55:46.504753] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-29T18:55:46.748124] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-09-29T18:55:47.222873] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-29T18:55:47.548137] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-09-29T18:55:48.037912] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-29T18:55:48.348160] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-09-29T18:55:49.008916] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-29T18:55:49.010301] [INFO ] [REMOTE ] GDL: Full fetch complete (3627 records). [2025-09-29T18:55:49.010375] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-09-29T18:55:49.010794] [FATAL] [VALIDATOR ] GDL: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T18:55:49.010982] [FATAL] [MAIN ] GDL: Fetched primary data is invalid. Refusing to save it. [2025-09-29T18:55:49.011050] [WARN ] [MAIN ] GDL: Deleting existing primary and derivative data due to validation failure. [2025-09-29T18:55:49.011123] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-09-29T18:55:49.011189] [DEBUG] [LOCAL ] GDL: No primary data file found to delete. [2025-09-29T18:55:49.011253] [INFO ] [LOCAL ] GDL: Starting deletion of derivative data. [2025-09-29T18:55:49.011803] [DEBUG] [LOCAL ] GDL: Deleted derivative data file. [2025-09-29T18:55:49.011897] [INFO ] [MAIN ] Update Progress: 906/2371 symbols completed. GDL took 23.3s. Estimated remaining: 3h 7m 12s. Rate: 7.8 symbols/min [2025-09-29T18:55:49.153259] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-09-29T18:55:49.201526] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:55:49.249423] [DEBUG] [LOCAL ] GDOT: Loaded 39279 existing records from primary storage. [2025-09-29T18:55:49.249789] [INFO ] [MAIN ] GDOT: Loaded 39279 existing records. [2025-09-29T18:55:49.433417] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:55:49.433682] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-09-29T18:55:49.433744] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-09-29T18:55:49.434065] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-09-29T18:55:49.434124] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-09-29T18:55:49.816797] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:55:49.821691] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-29T18:55:49.948143] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2024-12. [2025-09-29T18:55:50.748090] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-09-29T18:55:51.225810] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-29T18:55:51.249818] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-29T18:55:51.548148] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-09-29T18:55:52.348140] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-09-29T18:55:53.148102] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-09-29T18:55:53.207338] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-29T18:55:53.249972] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-29T18:55:53.260520] [INFO ] [REMOTE ] GDDY: Full fetch complete (71266 records). [2025-09-29T18:55:53.260720] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-09-29T18:55:53.643142] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-29T18:55:53.677453] [INFO ] [REMOTE ] GDIV: Full fetch complete (5459 records). [2025-09-29T18:55:53.694896] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-09-29T18:55:53.695049] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-09-29T18:55:53.695350] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-09-29T18:55:53.758778] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-09-29T18:55:53.778390] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-09-29T18:55:53.833855] [DEBUG] [LOCAL ] GDDY: Trimmed 71266 records to 49651 (keeping 200 days of data) [2025-09-29T18:55:53.954559] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-01. [2025-09-29T18:55:54.200791] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-09-29T18:55:54.201409] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-09-29T18:55:54.202371] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-09-29T18:55:54.202769] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-09-29T18:55:54.204885] [DEBUG] [LOCAL ] GDIV: Trimmed 5459 records to 3642 (keeping 200 days of data) [2025-09-29T18:55:54.233919] [DEBUG] [LOCAL ] GDIV: Primary data saved (3642 records). [2025-09-29T18:55:54.234602] [INFO ] [MAIN ] GDIV: Full history saved. [2025-09-29T18:55:54.235259] [INFO ] [MAIN ] Update Progress: 907/2371 symbols completed. GDIV took 32.8s. Estimated remaining: 3h 7m 0s. Rate: 7.8 symbols/min [2025-09-29T18:55:54.449450] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:55:54.583220] [DEBUG] [LOCAL ] GDV: Loaded 19971 existing records from primary storage. [2025-09-29T18:55:54.584967] [INFO ] [MAIN ] GDV: Loaded 19971 existing records. [2025-09-29T18:55:54.749772] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-09-29T18:55:54.798110] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:55:54.799030] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-09-29T18:55:54.799412] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-09-29T18:55:54.800475] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-09-29T18:55:54.801268] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-09-29T18:55:55.203251] [INFO ] [REMOTE ] GDV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:55:55.278780] [DEBUG] [LOCAL ] GDDY: Primary data saved (49651 records). [2025-09-29T18:55:55.278945] [INFO ] [MAIN ] GDDY: Full history saved. [2025-09-29T18:55:55.279054] [INFO ] [MAIN ] Update Progress: 908/2371 symbols completed. GDDY took 46.1s. Estimated remaining: 3h 6m 42s. Rate: 7.8 symbols/min [2025-09-29T18:55:55.400528] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-29T18:55:55.439910] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-29T18:55:55.513701] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:55:55.551828] [INFO ] [REMOTE ] GDV: Fetching primary data for 2024-12. [2025-09-29T18:55:55.576359] [DEBUG] [LOCAL ] GE: Loaded 54493 existing records from primary storage. [2025-09-29T18:55:55.576776] [INFO ] [MAIN ] GE: Loaded 54493 existing records. [2025-09-29T18:55:55.764568] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:55:55.764856] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-09-29T18:55:55.764905] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-09-29T18:55:55.765733] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-09-29T18:55:55.765794] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-09-29T18:55:56.141067] [INFO ] [REMOTE ] GE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:55:56.348121] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-09-29T18:55:56.957149] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-29T18:55:57.051933] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-29T18:55:57.148092] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-01. [2025-09-29T18:55:57.948079] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-09-29T18:55:58.268896] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-29T18:55:58.563817] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-29T18:55:58.748148] [INFO ] [REMOTE ] GE: Fetching primary data for 2024-12. [2025-09-29T18:55:59.548151] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-09-29T18:56:00.270570] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-29T18:56:00.348135] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-09-29T18:56:01.120417] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-09-29T18:56:01.148075] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-01. [2025-09-29T18:56:01.948109] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-09-29T18:56:02.748181] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-09-29T18:56:02.922690] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-29T18:56:02.959301] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-29T18:56:03.023756] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (2.68 seconds). [2025-09-29T18:56:03.025624] [INFO ] [REMOTE ] GDO: Full fetch complete (9292 records). [2025-09-29T18:56:03.025731] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-09-29T18:56:03.417102] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-09-29T18:56:03.417227] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-09-29T18:56:03.417587] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-09-29T18:56:03.417640] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-09-29T18:56:03.418286] [DEBUG] [LOCAL ] GDO: Trimmed 9292 records to 5949 (keeping 200 days of data) [2025-09-29T18:56:03.458319] [DEBUG] [LOCAL ] GDO: Primary data saved (5949 records). [2025-09-29T18:56:03.458472] [INFO ] [MAIN ] GDO: Full history saved. [2025-09-29T18:56:03.458558] [INFO ] [MAIN ] Update Progress: 909/2371 symbols completed. GDO took 27.8s. Estimated remaining: 3h 6m 35s. Rate: 7.8 symbols/min [2025-09-29T18:56:03.553272] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-09-29T18:56:03.649454] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:56:03.671890] [DEBUG] [LOCAL ] GEF: Loaded 20965 existing records from primary storage. [2025-09-29T18:56:03.672211] [INFO ] [MAIN ] GEF: Loaded 20965 existing records. [2025-09-29T18:56:03.858463] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:56:03.858928] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-09-29T18:56:03.859073] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-09-29T18:56:03.860210] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-09-29T18:56:03.860276] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-09-29T18:56:04.061908] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-29T18:56:04.269561] [INFO ] [REMOTE ] GEF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:56:04.348123] [INFO ] [REMOTE ] GEF: Fetching primary data for 2024-12. [2025-09-29T18:56:04.709406] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-29T18:56:05.148099] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-09-29T18:56:05.349744] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-29T18:56:05.948102] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-09-29T18:56:06.748165] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-09-29T18:56:06.947298] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-29T18:56:07.205627] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-29T18:56:07.548178] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-01. [2025-09-29T18:56:08.349379] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-09-29T18:56:08.355526] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-29T18:56:08.385337] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-29T18:56:09.148181] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-09-29T18:56:09.421093] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-29T18:56:09.948147] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-09-29T18:56:10.748137] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-09-29T18:56:10.766672] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-29T18:56:11.212414] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-29T18:56:11.548176] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-09-29T18:56:11.743168] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-29T18:56:12.348170] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-09-29T18:56:12.995435] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-29T18:56:13.148131] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-09-29T18:56:13.554612] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-29T18:56:13.948166] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-09-29T18:56:14.748158] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-09-29T18:56:15.037955] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-29T18:56:15.361493] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-29T18:56:15.548159] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-09-29T18:56:15.656637] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-29T18:56:16.348079] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-09-29T18:56:16.581588] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-29T18:56:17.148165] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-09-29T18:56:17.269881] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-29T18:56:17.948117] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-09-29T18:56:18.748152] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-09-29T18:56:19.277728] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-29T18:56:19.418781] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-09-29T18:56:19.548116] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-09-29T18:56:19.701897] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-29T18:56:20.348134] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-09-29T18:56:21.148094] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-09-29T18:56:21.455589] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-29T18:56:21.594278] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-29T18:56:21.843787] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-29T18:56:21.847954] [INFO ] [REMOTE ] GDV: Full fetch complete (28711 records). [2025-09-29T18:56:21.848103] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-09-29T18:56:21.953407] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-09-29T18:56:22.254600] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-09-29T18:56:22.254732] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-09-29T18:56:22.255493] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-09-29T18:56:22.255560] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-09-29T18:56:22.256596] [DEBUG] [LOCAL ] GDV: Trimmed 28711 records to 19569 (keeping 200 days of data) [2025-09-29T18:56:22.384125] [DEBUG] [LOCAL ] GDV: Primary data saved (19569 records). [2025-09-29T18:56:22.384287] [INFO ] [MAIN ] GDV: Full history saved. [2025-09-29T18:56:22.384378] [INFO ] [MAIN ] Update Progress: 910/2371 symbols completed. GDV took 28.1s. Estimated remaining: 3h 6m 45s. Rate: 7.8 symbols/min [2025-09-29T18:56:22.565728] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:56:22.604115] [DEBUG] [LOCAL ] GEL: Loaded 34252 existing records from primary storage. [2025-09-29T18:56:22.604428] [INFO ] [MAIN ] GEL: Loaded 34252 existing records. [2025-09-29T18:56:22.753320] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-09-29T18:56:22.815190] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:56:22.815407] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-09-29T18:56:22.815457] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-09-29T18:56:22.815894] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-09-29T18:56:22.815956] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-09-29T18:56:23.193868] [INFO ] [REMOTE ] GEL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:56:23.548221] [INFO ] [REMOTE ] GEL: Fetching primary data for 2024-12. [2025-09-29T18:56:24.235404] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-29T18:56:24.357068] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-09-29T18:56:24.379418] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-09-29T18:56:25.148140] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-09-29T18:56:25.434722] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-29T18:56:25.829526] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-29T18:56:25.948105] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-09-29T18:56:26.200841] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-29T18:56:26.748115] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-09-29T18:56:27.159861] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-29T18:56:27.548123] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-09-29T18:56:28.348081] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-09-29T18:56:28.741269] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-29T18:56:28.746635] [INFO ] [REMOTE ] GEF: Full fetch complete (29378 records). [2025-09-29T18:56:28.746832] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-09-29T18:56:29.152785] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-01. [2025-09-29T18:56:29.168542] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-09-29T18:56:29.168684] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-09-29T18:56:29.169344] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-09-29T18:56:29.169482] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-09-29T18:56:29.170808] [DEBUG] [LOCAL ] GEF: Trimmed 29378 records to 20543 (keeping 200 days of data) [2025-09-29T18:56:29.315499] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (2.57 seconds). [2025-09-29T18:56:29.362131] [DEBUG] [LOCAL ] GEF: Primary data saved (20543 records). [2025-09-29T18:56:29.362260] [INFO ] [MAIN ] GEF: Full history saved. [2025-09-29T18:56:29.362352] [INFO ] [MAIN ] Update Progress: 911/2371 symbols completed. GEF took 25.9s. Estimated remaining: 3h 6m 37s. Rate: 7.8 symbols/min [2025-09-29T18:56:29.540509] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:56:29.594173] [DEBUG] [LOCAL ] GENI: Loaded 53679 existing records from primary storage. [2025-09-29T18:56:29.594588] [INFO ] [MAIN ] GENI: Loaded 53679 existing records. [2025-09-29T18:56:29.780407] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:56:29.780620] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-09-29T18:56:29.780701] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-09-29T18:56:29.781484] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-09-29T18:56:29.781545] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-09-29T18:56:29.964883] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-09-29T18:56:30.154939] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-29T18:56:30.196846] [INFO ] [REMOTE ] GDOT: Full fetch complete (52861 records). [2025-09-29T18:56:30.197043] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-09-29T18:56:30.196666] [INFO ] [REMOTE ] GENI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:56:30.639678] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-09-29T18:56:30.639826] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-09-29T18:56:30.640838] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-09-29T18:56:30.641004] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-09-29T18:56:30.671814] [DEBUG] [LOCAL ] GDOT: Trimmed 52861 records to 38421 (keeping 200 days of data) [2025-09-29T18:56:30.671629] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-29T18:56:30.769499] [INFO ] [REMOTE ] GENI: Fetching primary data for 2024-12. [2025-09-29T18:56:30.916271] [DEBUG] [LOCAL ] GDOT: Primary data saved (38421 records). [2025-09-29T18:56:30.916471] [INFO ] [MAIN ] GDOT: Full history saved. [2025-09-29T18:56:30.916576] [INFO ] [MAIN ] Update Progress: 912/2371 symbols completed. GDOT took 41.9s. Estimated remaining: 3h 6m 19s. Rate: 7.8 symbols/min [2025-09-29T18:56:31.098138] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:56:31.158738] [DEBUG] [LOCAL ] GEO: Loaded 52812 existing records from primary storage. [2025-09-29T18:56:31.159113] [INFO ] [MAIN ] GEO: Loaded 52812 existing records. [2025-09-29T18:56:31.346458] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:56:31.346754] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-09-29T18:56:31.346850] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-09-29T18:56:31.347985] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-09-29T18:56:31.348046] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-09-29T18:56:31.569738] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-09-29T18:56:31.733436] [INFO ] [REMOTE ] GEO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:56:32.346954] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-29T18:56:32.357451] [INFO ] [REMOTE ] GEO: Fetching primary data for 2024-12. [2025-09-29T18:56:32.429599] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-09-29T18:56:32.441674] [INFO ] [REMOTE ] GE: Full fetch complete (77780 records). [2025-09-29T18:56:32.441845] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-09-29T18:56:32.885373] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-09-29T18:56:32.904971] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-09-29T18:56:32.906387] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-09-29T18:56:32.906527] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-09-29T18:56:32.908694] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-29T18:56:32.917705] [DEBUG] [LOCAL ] GE: Trimmed 77780 records to 53713 (keeping 200 days of data) [2025-09-29T18:56:33.148446] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-01. [2025-09-29T18:56:33.274214] [DEBUG] [LOCAL ] GE: Primary data saved (53713 records). [2025-09-29T18:56:33.274366] [INFO ] [MAIN ] GE: Full history saved. [2025-09-29T18:56:33.274459] [INFO ] [MAIN ] Update Progress: 913/2371 symbols completed. GE took 38.0s. Estimated remaining: 3h 6m 3s. Rate: 7.8 symbols/min [2025-09-29T18:56:33.452489] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:56:33.506411] [DEBUG] [LOCAL ] GES: Loaded 40424 existing records from primary storage. [2025-09-29T18:56:33.506800] [INFO ] [MAIN ] GES: Loaded 40424 existing records. [2025-09-29T18:56:33.693166] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:56:33.693442] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-09-29T18:56:33.693493] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-09-29T18:56:33.694190] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-09-29T18:56:33.694254] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-09-29T18:56:33.956277] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-09-29T18:56:34.091788] [INFO ] [REMOTE ] GES: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:56:34.242446] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-29T18:56:34.727086] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-29T18:56:34.748067] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-09-29T18:56:35.107671] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-29T18:56:35.548115] [INFO ] [REMOTE ] GES: Fetching primary data for 2024-12. [2025-09-29T18:56:36.348078] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-09-29T18:56:36.388792] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-29T18:56:37.042216] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-29T18:56:37.148072] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-01. [2025-09-29T18:56:37.623112] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-29T18:56:37.948105] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-01. [2025-09-29T18:56:38.748184] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-09-29T18:56:39.087007] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-29T18:56:39.550628] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-09-29T18:56:39.557780] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-29T18:56:40.348123] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-09-29T18:56:40.470051] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-29T18:56:40.916350] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-29T18:56:41.148109] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-09-29T18:56:41.948075] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-09-29T18:56:42.135926] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-29T18:56:42.616500] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-29T18:56:42.748117] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-09-29T18:56:43.548147] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-09-29T18:56:43.851915] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-29T18:56:44.227299] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-29T18:56:44.348149] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-09-29T18:56:45.148187] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-09-29T18:56:45.685935] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-29T18:56:45.948212] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-09-29T18:56:46.150848] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-29T18:56:46.748113] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-09-29T18:56:46.975583] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-29T18:56:47.548281] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-09-29T18:56:47.779769] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-29T18:56:47.971531] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-29T18:56:48.348180] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-09-29T18:56:49.148102] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-09-29T18:56:49.317338] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-29T18:56:49.776001] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-29T18:56:49.948109] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-09-29T18:56:50.748124] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-09-29T18:56:51.037789] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-29T18:56:51.349364] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-29T18:56:51.548112] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-09-29T18:56:52.327625] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-29T18:56:52.348080] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-09-29T18:56:52.794242] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-29T18:56:52.800509] [INFO ] [REMOTE ] GEL: Full fetch complete (48583 records). [2025-09-29T18:56:52.800674] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-09-29T18:56:53.159844] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-09-29T18:56:53.216321] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-09-29T18:56:53.216415] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-09-29T18:56:53.217334] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-09-29T18:56:53.217402] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-09-29T18:56:53.218568] [DEBUG] [LOCAL ] GEL: Trimmed 48583 records to 33432 (keeping 200 days of data) [2025-09-29T18:56:53.436263] [DEBUG] [LOCAL ] GEL: Primary data saved (33432 records). [2025-09-29T18:56:53.436446] [INFO ] [MAIN ] GEL: Full history saved. [2025-09-29T18:56:53.436564] [INFO ] [MAIN ] Update Progress: 914/2371 symbols completed. GEL took 31.1s. Estimated remaining: 3h 6m 15s. Rate: 7.8 symbols/min [2025-09-29T18:56:53.615317] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:56:53.656870] [DEBUG] [LOCAL ] GETY: Loaded 36378 existing records from primary storage. [2025-09-29T18:56:53.657169] [INFO ] [MAIN ] GETY: Loaded 36378 existing records. [2025-09-29T18:56:53.852123] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:56:53.852562] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-09-29T18:56:53.852705] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-09-29T18:56:53.853428] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-09-29T18:56:53.853496] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-09-29T18:56:53.955788] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-09-29T18:56:54.263201] [INFO ] [REMOTE ] GETY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:56:54.268704] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-29T18:56:54.748119] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-09-29T18:56:54.980839] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-29T18:56:55.464569] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-29T18:56:55.548097] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-09-29T18:56:56.318826] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-29T18:56:56.348085] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-09-29T18:56:57.061072] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-29T18:56:57.148147] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-09-29T18:56:57.948122] [INFO ] [REMOTE ] GETY: Fetching primary data for 2024-12. [2025-09-29T18:56:58.327451] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-29T18:56:58.689102] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-29T18:56:58.748132] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-09-29T18:56:58.892506] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-29T18:56:59.548091] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-09-29T18:57:00.348124] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-09-29T18:57:00.400119] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-29T18:57:01.148093] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-09-29T18:57:01.565624] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-29T18:57:01.577777] [INFO ] [REMOTE ] GENI: Full fetch complete (75457 records). [2025-09-29T18:57:01.577976] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-09-29T18:57:01.949571] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-01. [2025-09-29T18:57:02.095686] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-09-29T18:57:02.095799] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-09-29T18:57:02.096910] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-09-29T18:57:02.096986] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-09-29T18:57:02.101597] [DEBUG] [LOCAL ] GENI: Trimmed 75457 records to 52916 (keeping 200 days of data) [2025-09-29T18:57:02.247846] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-29T18:57:02.260974] [INFO ] [REMOTE ] GEO: Full fetch complete (75476 records). [2025-09-29T18:57:02.265829] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-09-29T18:57:02.891625] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-09-29T18:57:02.891800] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-09-29T18:57:02.893371] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-29T18:57:02.894601] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-09-29T18:57:02.936972] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-09-29T18:57:02.963489] [INFO ] [REMOTE ] GES: Full fetch complete (59685 records). [2025-09-29T18:57:02.973752] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-09-29T18:57:02.995539] [DEBUG] [LOCAL ] GEO: Trimmed 75476 records to 51992 (keeping 200 days of data) [2025-09-29T18:57:03.037964] [DEBUG] [LOCAL ] GENI: Primary data saved (52916 records). [2025-09-29T18:57:03.067229] [INFO ] [MAIN ] GENI: Full history saved. [2025-09-29T18:57:03.133452] [INFO ] [MAIN ] Update Progress: 915/2371 symbols completed. GENI took 33.8s. Estimated remaining: 3h 6m 11s. Rate: 7.8 symbols/min [2025-09-29T18:57:03.621935] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:57:03.770607] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-09-29T18:57:03.770996] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-09-29T18:57:03.772452] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-09-29T18:57:03.772971] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-09-29T18:57:03.777801] [DEBUG] [LOCAL ] GES: Trimmed 59685 records to 39554 (keeping 200 days of data) [2025-09-29T18:57:04.066480] [DEBUG] [LOCAL ] GEV: Loaded 53878 existing records from primary storage. [2025-09-29T18:57:04.081419] [INFO ] [MAIN ] GEV: Loaded 53878 existing records. [2025-09-29T18:57:04.136567] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-09-29T18:57:04.266295] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-09-29T18:57:04.441080] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:57:04.443069] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-09-29T18:57:04.443497] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-09-29T18:57:04.445572] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-09-29T18:57:04.446285] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-09-29T18:57:04.930316] [INFO ] [REMOTE ] GEV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:57:04.931854] [INFO ] [REMOTE ] GEV: Fetching primary data for 2024-12. [2025-09-29T18:57:04.938682] [DEBUG] [LOCAL ] GES: Primary data saved (39554 records). [2025-09-29T18:57:04.940320] [INFO ] [MAIN ] GES: Full history saved. [2025-09-29T18:57:04.940787] [INFO ] [MAIN ] Update Progress: 916/2371 symbols completed. GES took 31.7s. Estimated remaining: 3h 5m 54s. Rate: 7.8 symbols/min [2025-09-29T18:57:05.134596] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:57:05.138113] [DEBUG] [LOCAL ] GEO: Primary data saved (51992 records). [2025-09-29T18:57:05.138342] [INFO ] [MAIN ] GEO: Full history saved. [2025-09-29T18:57:05.138467] [INFO ] [MAIN ] Update Progress: 917/2371 symbols completed. GEO took 34.2s. Estimated remaining: 3h 5m 34s. Rate: 7.8 symbols/min [2025-09-29T18:57:05.144722] [DEBUG] [LOCAL ] GF: Loaded 3220 existing records from primary storage. [2025-09-29T18:57:05.144988] [INFO ] [MAIN ] GF: Loaded 3220 existing records. [2025-09-29T18:57:05.332381] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:57:05.332618] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-09-29T18:57:05.332696] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-09-29T18:57:05.332881] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-09-29T18:57:05.332940] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-09-29T18:57:05.710214] [INFO ] [REMOTE ] GF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:57:05.710737] [INFO ] [REMOTE ] GF: Fetching primary data for 2024-12. [2025-09-29T18:57:05.952960] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-29T18:57:05.967288] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-09-29T18:57:06.092371] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-09-29T18:57:06.094802] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-01. [2025-09-29T18:57:06.711574] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-29T18:57:06.748131] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-09-29T18:57:07.064516] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-29T18:57:07.081619] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-29T18:57:07.508454] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-29T18:57:07.548159] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-01. [2025-09-29T18:57:08.348125] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-09-29T18:57:09.148159] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-09-29T18:57:09.842254] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-29T18:57:09.883508] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-29T18:57:09.948114] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-09-29T18:57:10.041090] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-01 (2.49 seconds). [2025-09-29T18:57:10.748131] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-09-29T18:57:11.548123] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-09-29T18:57:11.607581] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-29T18:57:11.887493] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-29T18:57:12.348124] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-09-29T18:57:12.937462] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-29T18:57:13.148085] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-09-29T18:57:13.305434] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (2.56 seconds). [2025-09-29T18:57:13.643904] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-29T18:57:13.948119] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-09-29T18:57:14.400457] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-29T18:57:14.748124] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-09-29T18:57:15.232712] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-29T18:57:15.548151] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-09-29T18:57:16.348107] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-09-29T18:57:16.939706] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-29T18:57:16.940671] [INFO ] [REMOTE ] GF: Full fetch complete (5259 records). [2025-09-29T18:57:16.940745] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-09-29T18:57:17.161003] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-09-29T18:57:17.262558] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-29T18:57:17.356718] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-09-29T18:57:17.356814] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-09-29T18:57:17.356990] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-09-29T18:57:17.357050] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-09-29T18:57:17.357461] [DEBUG] [LOCAL ] GF: Trimmed 5259 records to 3023 (keeping 200 days of data) [2025-09-29T18:57:17.376046] [DEBUG] [LOCAL ] GF: Primary data saved (3023 records). [2025-09-29T18:57:17.376115] [INFO ] [MAIN ] GF: Full history saved. [2025-09-29T18:57:17.376189] [INFO ] [MAIN ] Update Progress: 918/2371 symbols completed. GF took 12.4s. Estimated remaining: 3h 5m 34s. Rate: 7.8 symbols/min [2025-09-29T18:57:17.948095] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-09-29T18:57:19.392442] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-29T18:57:19.401465] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-09-29T18:57:19.549028] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-09-29T18:57:19.560895] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-09-29T18:57:20.380755] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-29T18:57:20.388848] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-09-29T18:57:21.909971] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-09-29T18:57:21.922332] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-09-29T18:57:21.953876] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-29T18:57:21.961524] [INFO ] [REMOTE ] GETY: Full fetch complete (55665 records). [2025-09-29T18:57:21.961688] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-09-29T18:57:22.383733] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-09-29T18:57:22.383909] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-09-29T18:57:22.384903] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-09-29T18:57:22.384983] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-09-29T18:57:22.386282] [DEBUG] [LOCAL ] GETY: Trimmed 55665 records to 35719 (keeping 200 days of data) [2025-09-29T18:57:22.607800] [DEBUG] [LOCAL ] GETY: Primary data saved (35719 records). [2025-09-29T18:57:22.607954] [INFO ] [MAIN ] GETY: Full history saved. [2025-09-29T18:57:22.608045] [INFO ] [MAIN ] Update Progress: 919/2371 symbols completed. GETY took 29.2s. Estimated remaining: 3h 5m 23s. Rate: 7.8 symbols/min [2025-09-29T18:57:24.271545] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-09-29T18:57:24.285994] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-09-29T18:57:26.498309] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-09-29T18:57:26.509521] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-09-29T18:57:28.900599] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-09-29T18:57:28.913279] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-09-29T18:57:31.342991] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-09-29T18:57:31.357051] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-09-29T18:57:33.963637] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (2.61 seconds). [2025-09-29T18:57:33.975123] [INFO ] [REMOTE ] GEV: Full fetch complete (76946 records). [2025-09-29T18:57:33.975278] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-09-29T18:57:34.391605] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-09-29T18:57:34.391727] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-09-29T18:57:34.392874] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-09-29T18:57:34.392949] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-09-29T18:57:34.394522] [DEBUG] [LOCAL ] GEV: Trimmed 76946 records to 53076 (keeping 200 days of data) [2025-09-29T18:57:34.747137] [DEBUG] [LOCAL ] GEV: Primary data saved (53076 records). [2025-09-29T18:57:34.747325] [INFO ] [MAIN ] GEV: Full history saved. [2025-09-29T18:57:34.747424] [INFO ] [MAIN ] Update Progress: 920/2371 symbols completed. GEV took 31.6s. Estimated remaining: 3h 5m 22s. Rate: 7.8 symbols/min [2025-09-29T18:57:35.387995] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:57:35.365211] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:57:35.526092] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:57:35.521942] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:57:35.550495] [DEBUG] [LOCAL ] GFR: Loaded 8572 existing records from primary storage. [2025-09-29T18:57:35.550985] [INFO ] [MAIN ] GFR: Loaded 8572 existing records. [2025-09-29T18:57:35.665634] [DEBUG] [LOCAL ] GFF: Loaded 31088 existing records from primary storage. [2025-09-29T18:57:35.703464] [INFO ] [MAIN ] GFF: Loaded 31088 existing records. [2025-09-29T18:57:35.868568] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:57:35.874678] [DEBUG] [LOCAL ] GFL: Loaded 48755 existing records from primary storage. [2025-09-29T18:57:35.880073] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-09-29T18:57:35.890597] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-09-29T18:57:35.898010] [DEBUG] [LOCAL ] GFI: Loaded 53887 existing records from primary storage. [2025-09-29T18:57:35.898405] [INFO ] [MAIN ] GFL: Loaded 48755 existing records. [2025-09-29T18:57:35.934219] [INFO ] [MAIN ] GFI: Loaded 53887 existing records. [2025-09-29T18:57:35.934080] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-09-29T18:57:36.020918] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-09-29T18:57:36.331762] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:57:36.415445] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-09-29T18:57:36.470005] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-09-29T18:57:36.534870] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:57:36.570765] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-09-29T18:57:36.583352] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-09-29T18:57:36.622273] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-09-29T18:57:36.636727] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:57:36.642315] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-09-29T18:57:36.642130] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-09-29T18:57:36.681265] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-09-29T18:57:36.750897] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-09-29T18:57:36.833560] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-09-29T18:57:36.850989] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-09-29T18:57:36.850898] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-09-29T18:57:37.153416] [INFO ] [REMOTE ] GFR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:57:37.193256] [INFO ] [REMOTE ] GFR: Fetching primary data for 2024-12. [2025-09-29T18:57:37.853162] [INFO ] [REMOTE ] GFF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:57:37.864508] [INFO ] [REMOTE ] GFF: Fetching primary data for 2024-12. [2025-09-29T18:57:37.992770] [INFO ] [REMOTE ] GFI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:57:38.007003] [INFO ] [REMOTE ] GFI: Fetching primary data for 2024-12. [2025-09-29T18:57:38.034095] [INFO ] [REMOTE ] GFL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:57:38.034700] [INFO ] [REMOTE ] GFL: Fetching primary data for 2024-12. [2025-09-29T18:57:38.136973] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-29T18:57:38.140543] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-09-29T18:57:38.914271] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-29T18:57:38.921772] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-01. [2025-09-29T18:57:38.922052] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-29T18:57:38.926415] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-09-29T18:57:39.518299] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-29T18:57:39.528097] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-01. [2025-09-29T18:57:39.718009] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-29T18:57:39.720435] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-09-29T18:57:39.826104] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-29T18:57:39.833050] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-09-29T18:57:39.882209] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-29T18:57:39.893560] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-01. [2025-09-29T18:57:40.247067] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-29T18:57:40.250440] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-09-29T18:57:41.042895] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-29T18:57:41.052526] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-09-29T18:57:41.158248] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-29T18:57:41.162374] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-09-29T18:57:41.183368] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-29T18:57:41.190597] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-09-29T18:57:41.570996] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-29T18:57:41.582010] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-09-29T18:57:41.664843] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-29T18:57:41.668128] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-09-29T18:57:42.281337] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-29T18:57:42.291252] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-09-29T18:57:42.297684] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-29T18:57:42.300081] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-09-29T18:57:42.626690] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-29T18:57:42.634853] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-09-29T18:57:42.913742] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-29T18:57:42.915926] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-09-29T18:57:43.122978] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-29T18:57:43.133758] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-09-29T18:57:43.590414] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-29T18:57:43.592480] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-09-29T18:57:43.715460] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-29T18:57:43.723950] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-09-29T18:57:43.797731] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-29T18:57:44.223858] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-29T18:57:44.225994] [INFO ] [REMOTE ] GFR: Full fetch complete (12632 records). [2025-09-29T18:57:44.226093] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-09-29T18:57:44.353257] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-09-29T18:57:44.631664] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-09-29T18:57:44.631793] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-09-29T18:57:44.632176] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-09-29T18:57:44.632251] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-09-29T18:57:44.632922] [DEBUG] [LOCAL ] GFR: Trimmed 12632 records to 8377 (keeping 200 days of data) [2025-09-29T18:57:44.682038] [DEBUG] [LOCAL ] GFR: Primary data saved (8377 records). [2025-09-29T18:57:44.682194] [INFO ] [MAIN ] GFR: Full history saved. [2025-09-29T18:57:44.682305] [INFO ] [MAIN ] Update Progress: 921/2371 symbols completed. GFR took 9.9s. Estimated remaining: 3h 5m 18s. Rate: 7.8 symbols/min [2025-09-29T18:57:44.875379] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:57:44.910526] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-29T18:57:44.968899] [DEBUG] [LOCAL ] GGB: Loaded 51813 existing records from primary storage. [2025-09-29T18:57:44.969360] [INFO ] [MAIN ] GGB: Loaded 51813 existing records. [2025-09-29T18:57:45.161555] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:57:45.162305] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-09-29T18:57:45.161708] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-09-29T18:57:45.162455] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-09-29T18:57:45.170786] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-09-29T18:57:45.183454] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-09-29T18:57:45.218887] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-29T18:57:45.569854] [INFO ] [REMOTE ] GGB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:57:45.948090] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-09-29T18:57:46.072041] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-29T18:57:46.748105] [INFO ] [REMOTE ] GGB: Fetching primary data for 2024-12. [2025-09-29T18:57:47.139398] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-29T18:57:47.352634] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-29T18:57:47.548159] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-09-29T18:57:48.146019] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-29T18:57:48.348121] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-01. [2025-09-29T18:57:48.902713] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-29T18:57:49.148126] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-09-29T18:57:49.948106] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-09-29T18:57:50.130344] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-29T18:57:50.161995] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-29T18:57:50.748163] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-09-29T18:57:51.548176] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-09-29T18:57:51.903362] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-29T18:57:52.348092] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-09-29T18:57:52.502433] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-29T18:57:53.039604] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-29T18:57:53.148112] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-09-29T18:57:53.512484] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-29T18:57:53.948109] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-09-29T18:57:54.750104] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-09-29T18:57:54.753432] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-29T18:57:55.436020] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-29T18:57:55.548155] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-09-29T18:57:56.348181] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-09-29T18:57:56.493413] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-29T18:57:57.148123] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-09-29T18:57:57.501694] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-29T18:57:57.578149] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-29T18:57:57.948121] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-09-29T18:57:58.617631] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-29T18:57:58.624685] [INFO ] [REMOTE ] GFF: Full fetch complete (44134 records). [2025-09-29T18:57:58.624825] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-09-29T18:57:58.753300] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-09-29T18:57:59.043414] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-09-29T18:57:59.043513] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-09-29T18:57:59.044338] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-09-29T18:57:59.044422] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-09-29T18:57:59.045598] [DEBUG] [LOCAL ] GFF: Trimmed 44134 records to 30447 (keeping 200 days of data) [2025-09-29T18:57:59.243274] [DEBUG] [LOCAL ] GFF: Primary data saved (30447 records). [2025-09-29T18:57:59.243418] [INFO ] [MAIN ] GFF: Full history saved. [2025-09-29T18:57:59.243517] [INFO ] [MAIN ] Update Progress: 922/2371 symbols completed. GFF took 24.5s. Estimated remaining: 3h 5m 21s. Rate: 7.8 symbols/min [2025-09-29T18:57:59.427015] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:57:59.470432] [DEBUG] [LOCAL ] GGG: Loaded 41580 existing records from primary storage. [2025-09-29T18:57:59.470827] [INFO ] [MAIN ] GGG: Loaded 41580 existing records. [2025-09-29T18:57:59.554803] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-09-29T18:57:59.674807] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:57:59.675170] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-09-29T18:57:59.675290] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-09-29T18:57:59.675738] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-09-29T18:57:59.675800] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-09-29T18:58:00.114624] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-29T18:58:00.158702] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:58:00.348132] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-09-29T18:58:00.613075] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-29T18:58:00.909590] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-29T18:58:00.919799] [INFO ] [REMOTE ] GFL: Full fetch complete (68882 records). [2025-09-29T18:58:00.919941] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-09-29T18:58:01.153209] [INFO ] [REMOTE ] GGG: Fetching primary data for 2024-12. [2025-09-29T18:58:01.321366] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-09-29T18:58:01.321455] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-09-29T18:58:01.322427] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-09-29T18:58:01.322496] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-09-29T18:58:01.323978] [DEBUG] [LOCAL ] GFL: Trimmed 68882 records to 47965 (keeping 200 days of data) [2025-09-29T18:58:01.630418] [DEBUG] [LOCAL ] GFL: Primary data saved (47965 records). [2025-09-29T18:58:01.630590] [INFO ] [MAIN ] GFL: Full history saved. [2025-09-29T18:58:01.630740] [INFO ] [MAIN ] Update Progress: 923/2371 symbols completed. GFL took 26.9s. Estimated remaining: 3h 5m 5s. Rate: 7.8 symbols/min [2025-09-29T18:58:01.803980] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:58:01.822511] [DEBUG] [LOCAL ] GGT: Loaded 14309 existing records from primary storage. [2025-09-29T18:58:01.822792] [INFO ] [MAIN ] GGT: Loaded 14309 existing records. [2025-09-29T18:58:01.953242] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-09-29T18:58:02.014210] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:58:02.014435] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-09-29T18:58:02.014488] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-09-29T18:58:02.014819] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-09-29T18:58:02.014880] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-09-29T18:58:02.433090] [INFO ] [REMOTE ] GGT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:58:02.685584] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-29T18:58:02.748114] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-09-29T18:58:02.790056] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-09-29T18:58:02.801634] [INFO ] [REMOTE ] GFI: Full fetch complete (76343 records). [2025-09-29T18:58:02.801862] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-09-29T18:58:03.225034] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-09-29T18:58:03.225125] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-09-29T18:58:03.226150] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-09-29T18:58:03.226217] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-09-29T18:58:03.227823] [DEBUG] [LOCAL ] GFI: Trimmed 76343 records to 53108 (keeping 200 days of data) [2025-09-29T18:58:03.548151] [INFO ] [REMOTE ] GGT: Fetching primary data for 2024-12. [2025-09-29T18:58:03.571373] [DEBUG] [LOCAL ] GFI: Primary data saved (53108 records). [2025-09-29T18:58:03.571531] [INFO ] [MAIN ] GFI: Full history saved. [2025-09-29T18:58:03.571671] [INFO ] [MAIN ] Update Progress: 924/2371 symbols completed. GFI took 28.8s. Estimated remaining: 3h 4m 48s. Rate: 7.8 symbols/min [2025-09-29T18:58:03.758032] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:58:03.791590] [DEBUG] [LOCAL ] GGZ: Loaded 2465 existing records from primary storage. [2025-09-29T18:58:03.792962] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-29T18:58:03.793320] [INFO ] [MAIN ] GGZ: Loaded 2465 existing records. [2025-09-29T18:58:03.991921] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:58:03.992176] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-09-29T18:58:03.992329] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-09-29T18:58:03.992603] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-09-29T18:58:03.992776] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-09-29T18:58:04.278119] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-29T18:58:04.352414] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-09-29T18:58:04.440854] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:58:04.442528] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-29T18:58:05.148119] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-01. [2025-09-29T18:58:05.947003] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-29T18:58:05.949048] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2024-12. [2025-09-29T18:58:06.068894] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-29T18:58:06.498362] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-29T18:58:06.748122] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-09-29T18:58:07.548164] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-09-29T18:58:08.298821] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-29T18:58:08.348128] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-09-29T18:58:08.524917] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-29T18:58:09.148122] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-01. [2025-09-29T18:58:09.471937] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-29T18:58:09.740009] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-29T18:58:09.948138] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-09-29T18:58:10.748141] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-09-29T18:58:11.375420] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-29T18:58:11.548151] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-09-29T18:58:12.348110] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-09-29T18:58:12.412783] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-29T18:58:12.549133] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-29T18:58:13.148120] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-09-29T18:58:13.687931] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-29T18:58:13.773851] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-29T18:58:13.948106] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-09-29T18:58:14.413628] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-29T18:58:14.748108] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-09-29T18:58:15.548126] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-09-29T18:58:16.348127] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-09-29T18:58:16.459963] [DEBUG] [REMOTE ] GGT: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-09-29T18:58:16.460272] [WARN ] [REMOTE ] GGT: No data returned for month 2025-06 [2025-09-29T18:58:16.460365] [FATAL] [REMOTE ] GGT: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T18:58:16.460456] [FATAL] [MAIN ] GGT: Failed to fetch primary data. [2025-09-29T18:58:16.460524] [WARN ] [MAIN ] GGT: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T18:58:16.460599] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-09-29T18:58:16.460690] [DEBUG] [LOCAL ] GGT: No primary data file found to delete. [2025-09-29T18:58:16.460749] [INFO ] [LOCAL ] GGT: Starting deletion of derivative data. [2025-09-29T18:58:16.461360] [DEBUG] [LOCAL ] GGT: Deleted derivative data file. [2025-09-29T18:58:16.461456] [INFO ] [MAIN ] Update Progress: 925/2371 symbols completed. GGT took 14.8s. Estimated remaining: 3h 4m 49s. Rate: 7.8 symbols/min [2025-09-29T18:58:16.641630] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:58:16.647274] [DEBUG] [LOCAL ] GHC: Loaded 2664 existing records from primary storage. [2025-09-29T18:58:16.647453] [INFO ] [MAIN ] GHC: Loaded 2664 existing records. [2025-09-29T18:58:16.837509] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:58:16.838026] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-09-29T18:58:16.838162] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-09-29T18:58:16.838579] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-09-29T18:58:16.838675] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-09-29T18:58:16.980068] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-29T18:58:17.034290] [INFO ] [REMOTE ] GGB: Full fetch complete (74006 records). [2025-09-29T18:58:17.045724] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-09-29T18:58:17.156095] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-09-29T18:58:17.431115] [INFO ] [REMOTE ] GHC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:58:17.704011] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-09-29T18:58:17.704145] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-09-29T18:58:17.705351] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-09-29T18:58:17.705450] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-09-29T18:58:17.738053] [DEBUG] [LOCAL ] GGB: Trimmed 74006 records to 51072 (keeping 200 days of data) [2025-09-29T18:58:17.740772] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-29T18:58:17.823164] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-29T18:58:17.971113] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-09-29T18:58:18.074615] [DEBUG] [LOCAL ] GGB: Primary data saved (51072 records). [2025-09-29T18:58:18.074790] [INFO ] [MAIN ] GGB: Full history saved. [2025-09-29T18:58:18.074895] [INFO ] [MAIN ] Update Progress: 926/2371 symbols completed. GGB took 33.4s. Estimated remaining: 3h 4m 32s. Rate: 7.8 symbols/min [2025-09-29T18:58:18.262330] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:58:18.268040] [DEBUG] [LOCAL ] GHG: Loaded 3226 existing records from primary storage. [2025-09-29T18:58:18.268223] [INFO ] [MAIN ] GHG: Loaded 3226 existing records. [2025-09-29T18:58:18.464896] [WARN ] [MAIN ] GHG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:58:18.465152] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-09-29T18:58:18.465204] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-09-29T18:58:18.465399] [DEBUG] [LOCAL ] GHG: Deleted primary data file. [2025-09-29T18:58:18.465459] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-09-29T18:58:18.638510] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-29T18:58:18.753305] [INFO ] [REMOTE ] GHC: Fetching primary data for 2024-12. [2025-09-29T18:58:18.864393] [INFO ] [REMOTE ] GHG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:58:19.197087] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-29T18:58:19.548129] [INFO ] [REMOTE ] GHG: Fetching primary data for 2024-12. [2025-09-29T18:58:20.016349] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-29T18:58:20.348116] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-09-29T18:58:20.964058] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-29T18:58:21.148085] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-09-29T18:58:21.596838] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-29T18:58:21.948103] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-01. [2025-09-29T18:58:22.374839] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-29T18:58:22.748113] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-09-29T18:58:23.182393] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-29T18:58:23.548126] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-09-29T18:58:24.348118] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-09-29T18:58:24.861205] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-29T18:58:25.125854] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-29T18:58:25.148185] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-09-29T18:58:25.602993] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-29T18:58:25.948124] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-09-29T18:58:26.523388] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-29T18:58:26.524744] [INFO ] [REMOTE ] GGZ: Full fetch complete (4161 records). [2025-09-29T18:58:26.524822] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-09-29T18:58:26.753238] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-09-29T18:58:26.914671] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-09-29T18:58:26.914763] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-09-29T18:58:26.914912] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-09-29T18:58:26.914953] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-09-29T18:58:26.915352] [DEBUG] [LOCAL ] GGZ: Trimmed 4161 records to 2412 (keeping 200 days of data) [2025-09-29T18:58:26.930724] [DEBUG] [LOCAL ] GGZ: Primary data saved (2412 records). [2025-09-29T18:58:26.930836] [INFO ] [MAIN ] GGZ: Full history saved. [2025-09-29T18:58:26.930925] [INFO ] [MAIN ] Update Progress: 927/2371 symbols completed. GGZ took 23.4s. Estimated remaining: 3h 4m 26s. Rate: 7.8 symbols/min [2025-09-29T18:58:27.113635] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:58:27.123400] [DEBUG] [LOCAL ] GHI: Loaded 6963 existing records from primary storage. [2025-09-29T18:58:27.123622] [INFO ] [MAIN ] GHI: Loaded 6963 existing records. [2025-09-29T18:58:27.313991] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:58:27.317934] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-09-29T18:58:27.317773] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-29T18:58:27.318105] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-09-29T18:58:27.319690] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-09-29T18:58:27.319758] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-09-29T18:58:27.556375] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-09-29T18:58:27.706450] [INFO ] [REMOTE ] GHI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:58:28.348129] [INFO ] [REMOTE ] GHI: Fetching primary data for 2024-12. [2025-09-29T18:58:29.049351] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-29T18:58:29.148115] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-09-29T18:58:29.698729] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-29T18:58:29.948103] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-09-29T18:58:30.492800] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-29T18:58:30.748103] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-09-29T18:58:31.548120] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-09-29T18:58:31.703146] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-29T18:58:32.111243] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2024-12 (3.76 seconds). [2025-09-29T18:58:32.348126] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-01. [2025-09-29T18:58:33.148097] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-09-29T18:58:33.174321] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-29T18:58:33.948124] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-09-29T18:58:34.034243] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-09-29T18:58:34.540135] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-29T18:58:34.748109] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-09-29T18:58:34.852427] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-29T18:58:35.507593] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-29T18:58:35.548117] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-09-29T18:58:36.258605] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-29T18:58:36.348118] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-09-29T18:58:36.851105] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-29T18:58:37.148143] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-09-29T18:58:37.735349] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-29T18:58:37.948112] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-09-29T18:58:38.552874] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-29T18:58:38.748116] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-09-29T18:58:39.548125] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-09-29T18:58:40.125009] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-29T18:58:40.164501] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-29T18:58:40.348111] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-09-29T18:58:41.148112] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-09-29T18:58:41.836304] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-29T18:58:41.873306] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-29T18:58:41.885765] [INFO ] [REMOTE ] GGG: Full fetch complete (59279 records). [2025-09-29T18:58:41.885974] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-09-29T18:58:41.953266] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-09-29T18:58:42.310426] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-09-29T18:58:42.310540] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-09-29T18:58:42.311423] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-09-29T18:58:42.311488] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-09-29T18:58:42.313017] [DEBUG] [LOCAL ] GGG: Trimmed 59279 records to 40907 (keeping 200 days of data) [2025-09-29T18:58:42.431549] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-29T18:58:42.592118] [DEBUG] [LOCAL ] GGG: Primary data saved (40907 records). [2025-09-29T18:58:42.592248] [INFO ] [MAIN ] GGG: Full history saved. [2025-09-29T18:58:42.592329] [INFO ] [MAIN ] Update Progress: 928/2371 symbols completed. GGG took 43.3s. Estimated remaining: 3h 4m 31s. Rate: 7.8 symbols/min [2025-09-29T18:58:42.753301] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-09-29T18:58:42.780613] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:58:42.788569] [DEBUG] [LOCAL ] GHLD: Loaded 4168 existing records from primary storage. [2025-09-29T18:58:42.788852] [INFO ] [MAIN ] GHLD: Loaded 4168 existing records. [2025-09-29T18:58:42.985200] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:58:42.985410] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-09-29T18:58:42.985494] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-09-29T18:58:42.985741] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-09-29T18:58:42.985809] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-09-29T18:58:43.374401] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:58:43.379960] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-29T18:58:43.548100] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2024-12. [2025-09-29T18:58:43.973021] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-29T18:58:44.348123] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-01. [2025-09-29T18:58:44.705548] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-29T18:58:45.148176] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-09-29T18:58:45.496324] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-29T18:58:45.948110] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-09-29T18:58:46.640274] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-29T18:58:46.748116] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-09-29T18:58:47.499328] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-29T18:58:47.548143] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-09-29T18:58:48.301909] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-29T18:58:48.348120] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-09-29T18:58:48.833562] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-29T18:58:49.148136] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-09-29T18:58:49.619961] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-29T18:58:49.948108] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-09-29T18:58:50.493103] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-29T18:58:50.748153] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-09-29T18:58:51.278088] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-29T18:58:51.548180] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-09-29T18:58:52.066501] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-29T18:58:52.348157] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-09-29T18:58:53.122779] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-29T18:58:53.148097] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-09-29T18:58:53.731305] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-29T18:58:53.948103] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-09-29T18:58:54.637725] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-29T18:58:54.748128] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-09-29T18:58:55.458944] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-29T18:58:55.548131] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-09-29T18:58:56.273850] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-29T18:58:56.275221] [INFO ] [REMOTE ] GHG: Full fetch complete (4010 records). [2025-09-29T18:58:56.275296] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-09-29T18:58:56.353327] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-09-29T18:58:56.678611] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present. [2025-09-29T18:58:56.678821] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed. [2025-09-29T18:58:56.678993] [INFO ] [MAIN ] GHG: Fetched primary data is valid. [2025-09-29T18:58:56.679037] [DEBUG] [LOCAL ] GHG: Saving primary data. [2025-09-29T18:58:56.679498] [DEBUG] [LOCAL ] GHG: Trimmed 4010 records to 3192 (keeping 200 days of data) [2025-09-29T18:58:56.698837] [DEBUG] [LOCAL ] GHG: Primary data saved (3192 records). [2025-09-29T18:58:56.698970] [INFO ] [MAIN ] GHG: Full history saved. [2025-09-29T18:58:56.699095] [INFO ] [MAIN ] Update Progress: 929/2371 symbols completed. GHG took 38.6s. Estimated remaining: 3h 4m 33s. Rate: 7.8 symbols/min [2025-09-29T18:58:56.882792] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:58:56.902166] [DEBUG] [LOCAL ] GHM: Loaded 14350 existing records from primary storage. [2025-09-29T18:58:56.902440] [INFO ] [MAIN ] GHM: Loaded 14350 existing records. [2025-09-29T18:58:57.093178] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:58:57.093387] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-09-29T18:58:57.093437] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-09-29T18:58:57.093773] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-09-29T18:58:57.093837] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-09-29T18:58:57.153369] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-09-29T18:58:57.304449] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-29T18:58:57.348711] [INFO ] [REMOTE ] GHI: Full fetch complete (11641 records). [2025-09-29T18:58:57.385668] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-09-29T18:58:57.680167] [INFO ] [REMOTE ] GHM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:58:57.925753] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-09-29T18:58:57.925840] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-09-29T18:58:57.926129] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-09-29T18:58:57.926169] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-09-29T18:58:57.926609] [DEBUG] [LOCAL ] GHI: Trimmed 11641 records to 6929 (keeping 200 days of data) [2025-09-29T18:58:57.956614] [INFO ] [REMOTE ] GHM: Fetching primary data for 2024-12. [2025-09-29T18:58:57.969894] [DEBUG] [LOCAL ] GHI: Primary data saved (6929 records). [2025-09-29T18:58:57.970005] [INFO ] [MAIN ] GHI: Full history saved. [2025-09-29T18:58:57.970085] [INFO ] [MAIN ] Update Progress: 930/2371 symbols completed. GHI took 31.0s. Estimated remaining: 3h 4m 15s. Rate: 7.8 symbols/min [2025-09-29T18:58:58.056909] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-29T18:58:58.080319] [INFO ] [REMOTE ] GHC: Full fetch complete (3289 records). [2025-09-29T18:58:58.084516] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-09-29T18:58:58.294767] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:58:58.561282] [DEBUG] [LOCAL ] GHY: Loaded 21190 existing records from primary storage. [2025-09-29T18:58:58.568908] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-09-29T18:58:58.569482] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-09-29T18:58:58.569386] [INFO ] [MAIN ] GHY: Loaded 21190 existing records. [2025-09-29T18:58:58.575492] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-09-29T18:58:58.575606] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-09-29T18:58:58.616098] [DEBUG] [LOCAL ] GHC: Trimmed 3289 records to 2660 (keeping 200 days of data) [2025-09-29T18:58:58.760738] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-29T18:58:58.758332] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-09-29T18:58:58.760264] [DEBUG] [LOCAL ] GHC: Primary data saved (2660 records). [2025-09-29T18:58:58.793630] [INFO ] [MAIN ] GHC: Full history saved. [2025-09-29T18:58:58.804512] [INFO ] [MAIN ] Update Progress: 931/2371 symbols completed. GHC took 42.3s. Estimated remaining: 3h 3m 57s. Rate: 7.8 symbols/min [2025-09-29T18:58:59.001394] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:58:59.027865] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-09-29T18:58:59.050229] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-09-29T18:58:59.077352] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:58:59.073902] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-09-29T18:58:59.077484] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-09-29T18:58:59.380631] [DEBUG] [LOCAL ] GIB: Loaded 32653 existing records from primary storage. [2025-09-29T18:58:59.403517] [INFO ] [MAIN ] GIB: Loaded 32653 existing records. [2025-09-29T18:58:59.550804] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-01. [2025-09-29T18:58:59.609364] [INFO ] [REMOTE ] GHY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:58:59.626929] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-29T18:58:59.692557] [INFO ] [REMOTE ] GHLD: Full fetch complete (4743 records). [2025-09-29T18:58:59.698438] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-09-29T18:58:59.698323] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:58:59.799294] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-09-29T18:58:59.801873] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-09-29T18:58:59.807672] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-09-29T18:58:59.812852] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-09-29T18:59:00.396223] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-09-29T18:59:00.385613] [INFO ] [REMOTE ] GHY: Fetching primary data for 2024-12. [2025-09-29T18:59:00.421107] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-09-29T18:59:00.463629] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-09-29T18:59:00.463344] [INFO ] [REMOTE ] GIB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:59:00.464535] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-09-29T18:59:00.465141] [DEBUG] [LOCAL ] GHLD: Trimmed 4743 records to 4162 (keeping 200 days of data) [2025-09-29T18:59:00.493427] [DEBUG] [LOCAL ] GHLD: Primary data saved (4162 records). [2025-09-29T18:59:00.493548] [INFO ] [MAIN ] GHLD: Full history saved. [2025-09-29T18:59:00.493660] [INFO ] [MAIN ] Update Progress: 932/2371 symbols completed. GHLD took 17.9s. Estimated remaining: 3h 3m 40s. Rate: 7.8 symbols/min [2025-09-29T18:59:00.612751] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-29T18:59:00.722740] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:59:00.740898] [DEBUG] [LOCAL ] GIC: Loaded 13796 existing records from primary storage. [2025-09-29T18:59:00.741143] [INFO ] [MAIN ] GIC: Loaded 13796 existing records. [2025-09-29T18:59:00.927350] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:59:00.927618] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-09-29T18:59:00.927702] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-09-29T18:59:00.928016] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-09-29T18:59:00.928075] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-09-29T18:59:01.153351] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-09-29T18:59:01.304561] [INFO ] [REMOTE ] GIC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:59:01.516343] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-29T18:59:01.947925] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-29T18:59:01.952608] [INFO ] [REMOTE ] GIB: Fetching primary data for 2024-12. [2025-09-29T18:59:02.748177] [INFO ] [REMOTE ] GIC: Fetching primary data for 2024-12. [2025-09-29T18:59:03.109564] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-29T18:59:03.548115] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-01. [2025-09-29T18:59:03.745165] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-29T18:59:04.348131] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-09-29T18:59:04.847555] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-29T18:59:05.148116] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-01. [2025-09-29T18:59:05.329708] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-29T18:59:05.948127] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-09-29T18:59:06.500271] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-29T18:59:06.748162] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-09-29T18:59:06.950448] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-29T18:59:07.548131] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-09-29T18:59:07.609390] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-29T18:59:08.236839] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-29T18:59:08.348130] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-09-29T18:59:09.139548] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-29T18:59:09.148059] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-09-29T18:59:09.948102] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-09-29T18:59:10.165385] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-29T18:59:10.748168] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-09-29T18:59:10.779770] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-29T18:59:11.548118] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-09-29T18:59:12.118132] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-29T18:59:12.161374] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-29T18:59:12.348122] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-09-29T18:59:13.148100] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-09-29T18:59:13.371782] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-29T18:59:13.948106] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-09-29T18:59:14.608985] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-29T18:59:14.748150] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-09-29T18:59:15.028333] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-29T18:59:15.548105] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-09-29T18:59:15.845062] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-29T18:59:16.348115] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-09-29T18:59:16.666234] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-29T18:59:17.148137] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-09-29T18:59:17.235786] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-29T18:59:17.948166] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-09-29T18:59:18.203597] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-29T18:59:18.207448] [INFO ] [REMOTE ] GHM: Full fetch complete (21668 records). [2025-09-29T18:59:18.207578] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-09-29T18:59:18.646952] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-09-29T18:59:18.647111] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-09-29T18:59:18.647687] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-09-29T18:59:18.647760] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-09-29T18:59:18.648447] [DEBUG] [LOCAL ] GHM: Trimmed 21668 records to 13966 (keeping 200 days of data) [2025-09-29T18:59:18.731844] [DEBUG] [LOCAL ] GHM: Primary data saved (13966 records). [2025-09-29T18:59:18.731986] [INFO ] [MAIN ] GHM: Full history saved. [2025-09-29T18:59:18.732114] [INFO ] [MAIN ] Update Progress: 933/2371 symbols completed. GHM took 22.0s. Estimated remaining: 3h 3m 49s. Rate: 7.8 symbols/min [2025-09-29T18:59:18.754207] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-09-29T18:59:18.918071] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:59:18.963292] [DEBUG] [LOCAL ] GIL: Loaded 43906 existing records from primary storage. [2025-09-29T18:59:18.963713] [INFO ] [MAIN ] GIL: Loaded 43906 existing records. [2025-09-29T18:59:19.150970] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:59:19.151197] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-09-29T18:59:19.151254] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-09-29T18:59:19.151850] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-09-29T18:59:19.151909] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-09-29T18:59:19.555463] [INFO ] [REMOTE ] GIL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:59:19.555709] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-09-29T18:59:19.586765] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-29T18:59:19.876940] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-29T18:59:20.348116] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-09-29T18:59:20.456110] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-29T18:59:21.113170] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-29T18:59:21.148082] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-09-29T18:59:21.948097] [INFO ] [REMOTE ] GIL: Fetching primary data for 2024-12. [2025-09-29T18:59:22.304600] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-29T18:59:22.748124] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-09-29T18:59:23.356458] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-29T18:59:23.548097] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-09-29T18:59:23.765167] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-29T18:59:24.348151] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-09-29T18:59:24.623106] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-29T18:59:25.148113] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-01. [2025-09-29T18:59:25.201438] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-29T18:59:25.206045] [INFO ] [REMOTE ] GHY: Full fetch complete (32225 records). [2025-09-29T18:59:25.206167] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-09-29T18:59:25.605048] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-09-29T18:59:25.605156] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-09-29T18:59:25.605914] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-09-29T18:59:25.605981] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-09-29T18:59:25.606831] [DEBUG] [LOCAL ] GHY: Trimmed 32225 records to 20963 (keeping 200 days of data) [2025-09-29T18:59:25.741630] [DEBUG] [LOCAL ] GHY: Primary data saved (20963 records). [2025-09-29T18:59:25.741787] [INFO ] [MAIN ] GHY: Full history saved. [2025-09-29T18:59:25.741875] [INFO ] [MAIN ] Update Progress: 934/2371 symbols completed. GHY took 27.8s. Estimated remaining: 3h 3m 40s. Rate: 7.8 symbols/min [2025-09-29T18:59:25.926685] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:59:25.948094] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-09-29T18:59:25.995844] [DEBUG] [LOCAL ] GIS: Loaded 54455 existing records from primary storage. [2025-09-29T18:59:25.996191] [INFO ] [MAIN ] GIS: Loaded 54455 existing records. [2025-09-29T18:59:26.187614] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:59:26.187861] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-09-29T18:59:26.187915] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-09-29T18:59:26.188877] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-09-29T18:59:26.188939] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-09-29T18:59:26.586505] [INFO ] [REMOTE ] GIS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:59:26.646759] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-29T18:59:26.748131] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-09-29T18:59:27.247465] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-29T18:59:27.548118] [INFO ] [REMOTE ] GIS: Fetching primary data for 2024-12. [2025-09-29T18:59:28.199340] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-29T18:59:28.348116] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-09-29T18:59:29.148140] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-09-29T18:59:29.237174] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-29T18:59:29.477083] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-29T18:59:29.948130] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-09-29T18:59:30.560160] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-29T18:59:30.748119] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-01. [2025-09-29T18:59:30.845275] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-29T18:59:31.548108] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-09-29T18:59:32.348117] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-09-29T18:59:32.462711] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-29T18:59:32.865365] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-29T18:59:33.148147] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-09-29T18:59:33.712965] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-29T18:59:33.948103] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-09-29T18:59:34.752563] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-09-29T18:59:34.758825] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-29T18:59:34.879115] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-29T18:59:34.882695] [INFO ] [REMOTE ] GIC: Full fetch complete (20239 records). [2025-09-29T18:59:34.882801] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-09-29T18:59:35.254214] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-09-29T18:59:35.254292] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-09-29T18:59:35.254752] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-09-29T18:59:35.254814] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-09-29T18:59:35.255379] [DEBUG] [LOCAL ] GIC: Trimmed 20239 records to 13539 (keeping 200 days of data) [2025-09-29T18:59:35.345055] [DEBUG] [LOCAL ] GIC: Primary data saved (13539 records). [2025-09-29T18:59:35.345209] [INFO ] [MAIN ] GIC: Full history saved. [2025-09-29T18:59:35.345305] [INFO ] [MAIN ] Update Progress: 935/2371 symbols completed. GIC took 34.9s. Estimated remaining: 3h 3m 36s. Rate: 7.8 symbols/min [2025-09-29T18:59:35.522209] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:59:35.555173] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-09-29T18:59:35.575635] [DEBUG] [LOCAL ] GKOS: Loaded 43585 existing records from primary storage. [2025-09-29T18:59:35.576019] [INFO ] [MAIN ] GKOS: Loaded 43585 existing records. [2025-09-29T18:59:35.761382] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:59:35.761614] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-09-29T18:59:35.761697] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-09-29T18:59:35.762093] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-09-29T18:59:35.762150] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-09-29T18:59:36.142966] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:59:36.348121] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-09-29T18:59:36.550217] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-29T18:59:36.984830] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-29T18:59:37.148122] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-09-29T18:59:37.440949] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-29T18:59:37.948095] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-09-29T18:59:38.748133] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-09-29T18:59:39.055084] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-29T18:59:39.465337] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-29T18:59:39.473038] [INFO ] [REMOTE ] GIB: Full fetch complete (45438 records). [2025-09-29T18:59:39.473187] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-09-29T18:59:39.553275] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2024-12. [2025-09-29T18:59:39.924575] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-09-29T18:59:39.924698] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-09-29T18:59:39.925552] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-09-29T18:59:39.925636] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-09-29T18:59:39.926913] [DEBUG] [LOCAL ] GIB: Trimmed 45438 records to 32054 (keeping 200 days of data) [2025-09-29T18:59:40.157637] [DEBUG] [LOCAL ] GIB: Primary data saved (32054 records). [2025-09-29T18:59:40.157807] [INFO ] [MAIN ] GIB: Full history saved. [2025-09-29T18:59:40.157920] [INFO ] [MAIN ] Update Progress: 936/2371 symbols completed. GIB took 41.4s. Estimated remaining: 3h 3m 24s. Rate: 7.8 symbols/min [2025-09-29T18:59:40.337104] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:59:40.348111] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-09-29T18:59:40.386552] [DEBUG] [LOCAL ] GL: Loaded 38382 existing records from primary storage. [2025-09-29T18:59:40.386887] [INFO ] [MAIN ] GL: Loaded 38382 existing records. [2025-09-29T18:59:40.578531] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:59:40.578797] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-09-29T18:59:40.578871] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-09-29T18:59:40.579389] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-09-29T18:59:40.579476] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-09-29T18:59:40.971181] [INFO ] [REMOTE ] GL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:59:41.001063] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-29T18:59:41.148128] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-09-29T18:59:41.948185] [INFO ] [REMOTE ] GL: Fetching primary data for 2024-12. [2025-09-29T18:59:42.939029] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2024-12 (3.39 seconds). [2025-09-29T18:59:42.946886] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-01. [2025-09-29T18:59:43.380168] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-29T18:59:43.556519] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-09-29T18:59:43.577083] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-29T18:59:43.704832] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (3.36 seconds). [2025-09-29T18:59:44.348084] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-01. [2025-09-29T18:59:44.380244] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-29T18:59:45.148127] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-09-29T18:59:45.228982] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-29T18:59:45.842637] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-29T18:59:45.948110] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-09-29T18:59:46.748112] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-09-29T18:59:47.217872] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-29T18:59:47.432297] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-29T18:59:47.548126] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-09-29T18:59:47.891319] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-29T18:59:48.348138] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-09-29T18:59:49.096704] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-29T18:59:49.148145] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-09-29T18:59:49.948148] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-09-29T18:59:50.043118] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-29T18:59:50.053133] [INFO ] [REMOTE ] GIL: Full fetch complete (61408 records). [2025-09-29T18:59:50.053286] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-09-29T18:59:50.453395] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-09-29T18:59:50.453535] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-09-29T18:59:50.454534] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-09-29T18:59:50.454602] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-09-29T18:59:50.455951] [DEBUG] [LOCAL ] GIL: Trimmed 61408 records to 43252 (keeping 200 days of data) [2025-09-29T18:59:50.748857] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-09-29T18:59:50.756378] [DEBUG] [LOCAL ] GIL: Primary data saved (43252 records). [2025-09-29T18:59:50.756569] [INFO ] [MAIN ] GIL: Full history saved. [2025-09-29T18:59:50.756737] [INFO ] [MAIN ] Update Progress: 937/2371 symbols completed. GIL took 32.0s. Estimated remaining: 3h 3m 20s. Rate: 7.8 symbols/min [2025-09-29T18:59:50.943758] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T18:59:51.003417] [DEBUG] [LOCAL ] GLOB: Loaded 48111 existing records from primary storage. [2025-09-29T18:59:51.003968] [INFO ] [MAIN ] GLOB: Loaded 48111 existing records. [2025-09-29T18:59:51.230467] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T18:59:51.231578] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-09-29T18:59:51.233446] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-09-29T18:59:51.233345] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-29T18:59:51.246075] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-09-29T18:59:51.246155] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-09-29T18:59:51.556920] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-09-29T18:59:51.652008] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T18:59:51.678576] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-29T18:59:52.348122] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2024-12. [2025-09-29T18:59:52.405094] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-29T18:59:53.148135] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-09-29T18:59:53.583709] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-29T18:59:53.926636] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-29T18:59:53.948122] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-01. [2025-09-29T18:59:54.759962] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-09-29T18:59:54.766628] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-29T18:59:55.360462] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-29T18:59:55.548109] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-09-29T18:59:56.057944] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-29T18:59:56.348134] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-09-29T18:59:57.109683] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-29T18:59:57.148130] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-09-29T18:59:57.846309] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-29T18:59:57.948126] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-09-29T18:59:58.748107] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-09-29T18:59:58.804009] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-29T18:59:59.435109] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-29T18:59:59.548134] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-09-29T19:00:00.224718] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-29T19:00:00.348118] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-09-29T19:00:01.148189] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-09-29T19:00:01.525499] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-29T19:00:01.539068] [INFO ] [REMOTE ] GIS: Full fetch complete (77652 records). [2025-09-29T19:00:01.539257] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-09-29T19:00:01.954122] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-09-29T19:00:02.024882] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-09-29T19:00:02.025007] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-09-29T19:00:02.026246] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-09-29T19:00:02.027094] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-09-29T19:00:02.029328] [DEBUG] [LOCAL ] GIS: Trimmed 77652 records to 53673 (keeping 200 days of data) [2025-09-29T19:00:02.165884] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-29T19:00:02.437813] [DEBUG] [LOCAL ] GIS: Primary data saved (53673 records). [2025-09-29T19:00:02.438626] [INFO ] [MAIN ] GIS: Full history saved. [2025-09-29T19:00:02.438877] [INFO ] [MAIN ] Update Progress: 938/2371 symbols completed. GIS took 36.7s. Estimated remaining: 3h 3m 19s. Rate: 7.8 symbols/min [2025-09-29T19:00:02.627967] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:00:02.642149] [DEBUG] [LOCAL ] GLP: Loaded 9585 existing records from primary storage. [2025-09-29T19:00:02.642419] [INFO ] [MAIN ] GLP: Loaded 9585 existing records. [2025-09-29T19:00:02.749762] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-09-29T19:00:02.857906] [WARN ] [MAIN ] GLP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:00:02.858247] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-09-29T19:00:02.858295] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-09-29T19:00:02.859096] [DEBUG] [LOCAL ] GLP: Deleted primary data file. [2025-09-29T19:00:02.859173] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-09-29T19:00:03.293298] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-29T19:00:03.334801] [INFO ] [REMOTE ] GLP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:00:03.548187] [INFO ] [REMOTE ] GLP: Fetching primary data for 2024-12. [2025-09-29T19:00:03.604048] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-29T19:00:04.348117] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-09-29T19:00:04.374459] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-29T19:00:04.911633] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-29T19:00:05.148128] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-09-29T19:00:05.948132] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-09-29T19:00:05.980790] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-29T19:00:06.458208] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-29T19:00:06.748132] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-09-29T19:00:06.891863] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-29T19:00:07.548138] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-09-29T19:00:08.348096] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-09-29T19:00:08.749716] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-29T19:00:08.945638] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-29T19:00:09.148138] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-09-29T19:00:09.500549] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-29T19:00:09.511552] [INFO ] [REMOTE ] GL: Full fetch complete (55392 records). [2025-09-29T19:00:09.511849] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-09-29T19:00:09.962510] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-09-29T19:00:09.966482] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-09-29T19:00:09.966607] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-09-29T19:00:09.967575] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-09-29T19:00:09.967670] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-09-29T19:00:09.970864] [DEBUG] [LOCAL ] GL: Trimmed 55392 records to 37753 (keeping 200 days of data) [2025-09-29T19:00:10.221489] [DEBUG] [LOCAL ] GL: Primary data saved (37753 records). [2025-09-29T19:00:10.221697] [INFO ] [MAIN ] GL: Full history saved. [2025-09-29T19:00:10.221812] [INFO ] [MAIN ] Update Progress: 939/2371 symbols completed. GL took 30.1s. Estimated remaining: 3h 3m 11s. Rate: 7.8 symbols/min [2025-09-29T19:00:10.410257] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:00:10.467154] [DEBUG] [LOCAL ] GLW: Loaded 54415 existing records from primary storage. [2025-09-29T19:00:10.467556] [INFO ] [MAIN ] GLW: Loaded 54415 existing records. [2025-09-29T19:00:10.651606] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:00:10.652009] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-09-29T19:00:10.652084] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-09-29T19:00:10.652806] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-09-29T19:00:10.652868] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-09-29T19:00:10.751091] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-09-29T19:00:10.843011] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-29T19:00:11.055686] [INFO ] [REMOTE ] GLW: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:00:11.081391] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-29T19:00:11.091047] [INFO ] [REMOTE ] GKOS: Full fetch complete (59877 records). [2025-09-29T19:00:11.091224] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-09-29T19:00:11.522515] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-09-29T19:00:11.522683] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-09-29T19:00:11.523556] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-09-29T19:00:11.523602] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-09-29T19:00:11.525108] [DEBUG] [LOCAL ] GKOS: Trimmed 59877 records to 42728 (keeping 200 days of data) [2025-09-29T19:00:11.576464] [INFO ] [REMOTE ] GLW: Fetching primary data for 2024-12. [2025-09-29T19:00:11.789277] [DEBUG] [LOCAL ] GKOS: Primary data saved (42728 records). [2025-09-29T19:00:11.789420] [INFO ] [MAIN ] GKOS: Full history saved. [2025-09-29T19:00:11.789510] [INFO ] [MAIN ] Update Progress: 940/2371 symbols completed. GKOS took 36.4s. Estimated remaining: 3h 2m 54s. Rate: 7.8 symbols/min [2025-09-29T19:00:11.975693] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:00:12.035136] [DEBUG] [LOCAL ] GM: Loaded 54508 existing records from primary storage. [2025-09-29T19:00:12.035561] [INFO ] [MAIN ] GM: Loaded 54508 existing records. [2025-09-29T19:00:12.230955] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:00:12.231430] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-09-29T19:00:12.231511] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-09-29T19:00:12.232313] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-09-29T19:00:12.232380] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-09-29T19:00:12.359988] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-09-29T19:00:12.632104] [INFO ] [REMOTE ] GM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:00:12.661513] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-29T19:00:13.148143] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-09-29T19:00:13.195718] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-29T19:00:13.515116] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-29T19:00:13.948165] [INFO ] [REMOTE ] GM: Fetching primary data for 2024-12. [2025-09-29T19:00:14.748125] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-01. [2025-09-29T19:00:14.916765] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-29T19:00:15.548143] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-09-29T19:00:16.105373] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-29T19:00:16.179914] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-29T19:00:16.348122] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-01. [2025-09-29T19:00:16.609926] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-29T19:00:17.148142] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-09-29T19:00:17.948107] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-09-29T19:00:18.494990] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-29T19:00:18.748160] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-09-29T19:00:18.921829] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-29T19:00:18.940632] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-29T19:00:19.548155] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-09-29T19:00:20.348137] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-09-29T19:00:20.933104] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-29T19:00:21.148121] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-09-29T19:00:21.335329] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-29T19:00:21.948107] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-09-29T19:00:22.576842] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (3.03 seconds). [2025-09-29T19:00:22.748141] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-09-29T19:00:23.239910] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-29T19:00:23.548132] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-09-29T19:00:24.348088] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-09-29T19:00:24.400984] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (3.25 seconds). [2025-09-29T19:00:24.411379] [INFO ] [REMOTE ] GLOB: Full fetch complete (63823 records). [2025-09-29T19:00:24.411554] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-09-29T19:00:24.583359] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-29T19:00:24.607441] [INFO ] [REMOTE ] GLP: Full fetch complete (14309 records). [2025-09-29T19:00:24.630779] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-09-29T19:00:25.025359] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-09-29T19:00:25.025625] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-09-29T19:00:25.057136] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-09-29T19:00:25.071187] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-09-29T19:00:25.167027] [DEBUG] [LOCAL ] GLOB: Trimmed 63823 records to 47508 (keeping 200 days of data) [2025-09-29T19:00:25.469300] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (2.72 seconds). [2025-09-29T19:00:25.482439] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present. [2025-09-29T19:00:25.483925] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed. [2025-09-29T19:00:25.484602] [INFO ] [MAIN ] GLP: Fetched primary data is valid. [2025-09-29T19:00:25.484754] [DEBUG] [LOCAL ] GLP: Saving primary data. [2025-09-29T19:00:25.496291] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-09-29T19:00:25.510615] [DEBUG] [LOCAL ] GLP: Trimmed 14309 records to 9348 (keeping 200 days of data) [2025-09-29T19:00:25.686313] [DEBUG] [LOCAL ] GLP: Primary data saved (9348 records). [2025-09-29T19:00:25.687703] [INFO ] [MAIN ] GLP: Full history saved. [2025-09-29T19:00:25.690434] [INFO ] [MAIN ] Update Progress: 941/2371 symbols completed. GLP took 23.3s. Estimated remaining: 3h 2m 56s. Rate: 7.8 symbols/min [2025-09-29T19:00:25.891494] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:00:25.946590] [DEBUG] [LOCAL ] GLOB: Primary data saved (47508 records). [2025-09-29T19:00:25.946791] [INFO ] [MAIN ] GLOB: Full history saved. [2025-09-29T19:00:25.946892] [INFO ] [MAIN ] Update Progress: 942/2371 symbols completed. GLOB took 35.2s. Estimated remaining: 3h 2m 37s. Rate: 7.8 symbols/min [2025-09-29T19:00:26.162788] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:00:26.184559] [DEBUG] [LOCAL ] GME: Loaded 54540 existing records from primary storage. [2025-09-29T19:00:26.184995] [INFO ] [MAIN ] GME: Loaded 54540 existing records. [2025-09-29T19:00:26.393051] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:00:26.394809] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-09-29T19:00:26.395079] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-09-29T19:00:26.415674] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-09-29T19:00:26.415536] [DEBUG] [LOCAL ] GMED: Loaded 49096 existing records from primary storage. [2025-09-29T19:00:26.415890] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-09-29T19:00:26.523299] [INFO ] [MAIN ] GMED: Loaded 49096 existing records. [2025-09-29T19:00:26.542430] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-29T19:00:26.616114] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-09-29T19:00:26.990391] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:00:27.030440] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-09-29T19:00:27.051547] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-09-29T19:00:27.100617] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-09-29T19:00:27.128288] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-09-29T19:00:27.135818] [INFO ] [REMOTE ] GME: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:00:27.168326] [INFO ] [REMOTE ] GME: Fetching primary data for 2024-12. [2025-09-29T19:00:27.777081] [INFO ] [REMOTE ] GMED: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:00:27.785914] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-29T19:00:27.786448] [INFO ] [REMOTE ] GMED: Fetching primary data for 2024-12. [2025-09-29T19:00:28.348105] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-09-29T19:00:28.699328] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-29T19:00:29.148153] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-09-29T19:00:29.298812] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-29T19:00:29.948167] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-01. [2025-09-29T19:00:30.060437] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2024-12 (2.89 seconds). [2025-09-29T19:00:30.108616] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-29T19:00:30.748131] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-09-29T19:00:31.068847] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-29T19:00:31.145442] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-29T19:00:31.548124] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-01. [2025-09-29T19:00:32.348130] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-09-29T19:00:32.743578] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-29T19:00:33.148118] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-09-29T19:00:33.661249] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-29T19:00:33.948099] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-09-29T19:00:34.116059] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-09-29T19:00:34.748150] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-09-29T19:00:35.548135] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-09-29T19:00:36.202305] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (3.05 seconds). [2025-09-29T19:00:36.348103] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-09-29T19:00:36.540251] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-09-29T19:00:37.148157] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-09-29T19:00:37.844201] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-09-29T19:00:37.948168] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-09-29T19:00:38.363580] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (3.62 seconds). [2025-09-29T19:00:38.391235] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-29T19:00:38.463519] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-29T19:00:38.748109] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-09-29T19:00:39.548098] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-09-29T19:00:39.998770] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-29T19:00:40.348175] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-09-29T19:00:40.400628] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-29T19:00:41.148138] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-09-29T19:00:41.368851] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-29T19:00:41.948176] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-09-29T19:00:42.419237] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-29T19:00:42.431082] [INFO ] [REMOTE ] GM: Full fetch complete (77821 records). [2025-09-29T19:00:42.431256] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-09-29T19:00:42.759041] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-09-29T19:00:42.877016] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-09-29T19:00:42.877131] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-09-29T19:00:42.878233] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-09-29T19:00:42.878327] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-09-29T19:00:42.879900] [DEBUG] [LOCAL ] GM: Trimmed 77821 records to 53728 (keeping 200 days of data) [2025-09-29T19:00:43.239141] [DEBUG] [LOCAL ] GM: Primary data saved (53728 records). [2025-09-29T19:00:43.239296] [INFO ] [MAIN ] GM: Full history saved. [2025-09-29T19:00:43.239412] [INFO ] [MAIN ] Update Progress: 943/2371 symbols completed. GM took 31.4s. Estimated remaining: 3h 2m 44s. Rate: 7.8 symbols/min [2025-09-29T19:00:43.426890] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:00:43.466818] [DEBUG] [LOCAL ] GMRE: Loaded 38133 existing records from primary storage. [2025-09-29T19:00:43.467126] [INFO ] [MAIN ] GMRE: Loaded 38133 existing records. [2025-09-29T19:00:43.672870] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:00:43.673269] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-09-29T19:00:43.673349] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-09-29T19:00:43.673763] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-09-29T19:00:43.673918] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-09-29T19:00:43.993596] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (2.85 seconds). [2025-09-29T19:00:44.054908] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-09-29T19:00:44.139552] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:00:44.179978] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-29T19:00:44.220906] [INFO ] [REMOTE ] GLW: Full fetch complete (77616 records). [2025-09-29T19:00:44.221427] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-09-29T19:00:44.223861] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-29T19:00:44.350198] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-09-29T19:00:44.781111] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-09-29T19:00:44.781240] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-09-29T19:00:44.782826] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-09-29T19:00:44.782991] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-09-29T19:00:44.785086] [DEBUG] [LOCAL ] GLW: Trimmed 77616 records to 53635 (keeping 200 days of data) [2025-09-29T19:00:45.146078] [DEBUG] [LOCAL ] GLW: Primary data saved (53635 records). [2025-09-29T19:00:45.146348] [INFO ] [MAIN ] GLW: Full history saved. [2025-09-29T19:00:45.146456] [INFO ] [MAIN ] Update Progress: 944/2371 symbols completed. GLW took 34.9s. Estimated remaining: 3h 2m 28s. Rate: 7.8 symbols/min [2025-09-29T19:00:45.151892] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2024-12. [2025-09-29T19:00:45.343266] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:00:45.363630] [DEBUG] [LOCAL ] GNE: Loaded 17940 existing records from primary storage. [2025-09-29T19:00:45.363958] [INFO ] [MAIN ] GNE: Loaded 17940 existing records. [2025-09-29T19:00:45.552668] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:00:45.552904] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-09-29T19:00:45.552953] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-09-29T19:00:45.553407] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-09-29T19:00:45.553467] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-09-29T19:00:45.938464] [INFO ] [REMOTE ] GNE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:00:45.948066] [INFO ] [REMOTE ] GNE: Fetching primary data for 2024-12. [2025-09-29T19:00:46.086986] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-29T19:00:46.635065] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-29T19:00:46.748129] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-09-29T19:00:47.033977] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.98 seconds). [2025-09-29T19:00:47.092797] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-29T19:00:47.548119] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-09-29T19:00:48.348097] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-01. [2025-09-29T19:00:48.494308] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-29T19:00:49.148134] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-09-29T19:00:49.726614] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-29T19:00:49.948094] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-09-29T19:00:50.064188] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-09-29T19:00:50.748155] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-01. [2025-09-29T19:00:50.847413] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-29T19:00:50.861098] [INFO ] [REMOTE ] GMED: Full fetch complete (69468 records). [2025-09-29T19:00:50.861253] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-09-29T19:00:51.137448] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-29T19:00:51.324690] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-09-29T19:00:51.324796] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-09-29T19:00:51.325881] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-09-29T19:00:51.325955] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-09-29T19:00:51.327515] [DEBUG] [LOCAL ] GMED: Trimmed 69468 records to 48347 (keeping 200 days of data) [2025-09-29T19:00:51.549475] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-09-29T19:00:51.558069] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-29T19:00:51.644964] [DEBUG] [LOCAL ] GMED: Primary data saved (48347 records). [2025-09-29T19:00:51.645116] [INFO ] [MAIN ] GMED: Full history saved. [2025-09-29T19:00:51.645206] [INFO ] [MAIN ] Update Progress: 945/2371 symbols completed. GMED took 25.7s. Estimated remaining: 3h 2m 18s. Rate: 7.8 symbols/min [2025-09-29T19:00:51.838208] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:00:51.881500] [DEBUG] [LOCAL ] GNK: Loaded 41039 existing records from primary storage. [2025-09-29T19:00:51.881840] [INFO ] [MAIN ] GNK: Loaded 41039 existing records. [2025-09-29T19:00:52.073680] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:00:52.073941] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-09-29T19:00:52.074011] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-09-29T19:00:52.074388] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-09-29T19:00:52.074447] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-09-29T19:00:52.353260] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-09-29T19:00:52.462895] [INFO ] [REMOTE ] GNK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:00:53.148152] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-09-29T19:00:53.842510] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-29T19:00:53.907538] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-29T19:00:53.948120] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-09-29T19:00:54.180589] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.63 seconds). [2025-09-29T19:00:54.748145] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-09-29T19:00:54.771233] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-29T19:00:55.548179] [INFO ] [REMOTE ] GNK: Fetching primary data for 2024-12. [2025-09-29T19:00:56.140353] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-29T19:00:56.348143] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-09-29T19:00:56.645614] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-29T19:00:57.148156] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-01. [2025-09-29T19:00:57.948146] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-09-29T19:00:58.605454] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-29T19:00:58.748104] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-09-29T19:00:58.941701] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-29T19:00:59.100220] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (2.75 seconds). [2025-09-29T19:00:59.548112] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-09-29T19:01:00.127121] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-29T19:01:00.348133] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-09-29T19:01:01.155872] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-09-29T19:01:01.172803] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-29T19:01:01.948120] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-09-29T19:01:01.981286] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-29T19:01:02.748166] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-09-29T19:01:03.049541] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-29T19:01:03.548156] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-09-29T19:01:04.348183] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-09-29T19:01:04.455917] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-29T19:01:04.562398] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (2.61 seconds). [2025-09-29T19:01:04.632527] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-29T19:01:05.148163] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-09-29T19:01:05.556182] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-29T19:01:05.948130] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-09-29T19:01:06.665830] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-29T19:01:06.748156] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-09-29T19:01:07.460884] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-29T19:01:07.548167] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-09-29T19:01:08.348184] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-09-29T19:01:09.049157] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-29T19:01:09.148121] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-09-29T19:01:09.501216] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (2.75 seconds). [2025-09-29T19:01:09.513043] [INFO ] [REMOTE ] GME: Full fetch complete (77920 records). [2025-09-29T19:01:09.513366] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-09-29T19:01:09.622595] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-29T19:01:09.952767] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-09-29T19:01:10.000209] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-09-29T19:01:10.000316] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-09-29T19:01:10.001631] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-09-29T19:01:10.001744] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-09-29T19:01:10.003838] [DEBUG] [LOCAL ] GME: Trimmed 77920 records to 53762 (keeping 200 days of data) [2025-09-29T19:01:10.358398] [DEBUG] [LOCAL ] GME: Primary data saved (53762 records). [2025-09-29T19:01:10.358608] [INFO ] [MAIN ] GME: Full history saved. [2025-09-29T19:01:10.358757] [INFO ] [MAIN ] Update Progress: 946/2371 symbols completed. GME took 44.7s. Estimated remaining: 3h 2m 27s. Rate: 7.8 symbols/min [2025-09-29T19:01:10.558806] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:01:10.608897] [DEBUG] [LOCAL ] GNL: Loaded 47785 existing records from primary storage. [2025-09-29T19:01:10.609235] [INFO ] [MAIN ] GNL: Loaded 47785 existing records. [2025-09-29T19:01:10.748534] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-09-29T19:01:10.854024] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:01:10.856537] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-09-29T19:01:10.856452] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-29T19:01:10.856669] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-09-29T19:01:10.865818] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-09-29T19:01:10.865890] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-09-29T19:01:11.257039] [INFO ] [REMOTE ] GNL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:01:11.482153] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-29T19:01:11.491400] [INFO ] [REMOTE ] GMRE: Full fetch complete (53572 records). [2025-09-29T19:01:11.491594] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-09-29T19:01:11.551513] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-09-29T19:01:11.846914] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-29T19:01:11.949458] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-09-29T19:01:11.949564] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-09-29T19:01:11.950500] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-09-29T19:01:11.950570] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-09-29T19:01:11.951851] [DEBUG] [LOCAL ] GMRE: Trimmed 53572 records to 37551 (keeping 200 days of data) [2025-09-29T19:01:12.193260] [DEBUG] [LOCAL ] GMRE: Primary data saved (37551 records). [2025-09-29T19:01:12.193426] [INFO ] [MAIN ] GMRE: Full history saved. [2025-09-29T19:01:12.193540] [INFO ] [MAIN ] Update Progress: 947/2371 symbols completed. GMRE took 29.0s. Estimated remaining: 3h 2m 11s. Rate: 7.8 symbols/min [2025-09-29T19:01:12.355230] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-09-29T19:01:12.384881] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:01:12.436909] [DEBUG] [LOCAL ] GNRC: Loaded 45886 existing records from primary storage. [2025-09-29T19:01:12.437327] [INFO ] [MAIN ] GNRC: Loaded 45886 existing records. [2025-09-29T19:01:12.628506] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:01:12.628775] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-09-29T19:01:12.628859] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-09-29T19:01:12.629317] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-09-29T19:01:12.629378] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-09-29T19:01:13.048447] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:01:13.077505] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-29T19:01:13.148135] [INFO ] [REMOTE ] GNL: Fetching primary data for 2024-12. [2025-09-29T19:01:13.485383] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-29T19:01:13.948115] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-09-29T19:01:14.652925] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-29T19:01:14.748150] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-09-29T19:01:15.262871] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-29T19:01:15.266988] [INFO ] [REMOTE ] GNE: Full fetch complete (22365 records). [2025-09-29T19:01:15.267098] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-09-29T19:01:15.553223] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-01. [2025-09-29T19:01:15.660171] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-09-29T19:01:15.660254] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-09-29T19:01:15.660804] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-09-29T19:01:15.660870] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-09-29T19:01:15.661539] [DEBUG] [LOCAL ] GNE: Trimmed 22365 records to 17740 (keeping 200 days of data) [2025-09-29T19:01:15.780834] [DEBUG] [LOCAL ] GNE: Primary data saved (17740 records). [2025-09-29T19:01:15.781003] [INFO ] [MAIN ] GNE: Full history saved. [2025-09-29T19:01:15.781096] [INFO ] [MAIN ] Update Progress: 948/2371 symbols completed. GNE took 30.6s. Estimated remaining: 3h 1m 57s. Rate: 7.8 symbols/min [2025-09-29T19:01:15.970701] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:01:15.981924] [DEBUG] [LOCAL ] GNT: Loaded 8177 existing records from primary storage. [2025-09-29T19:01:15.982176] [INFO ] [MAIN ] GNT: Loaded 8177 existing records. [2025-09-29T19:01:16.176008] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:01:16.176293] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-09-29T19:01:16.176343] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-09-29T19:01:16.176579] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-09-29T19:01:16.176638] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-09-29T19:01:16.356413] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2024-12. [2025-09-29T19:01:16.523106] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-29T19:01:16.592190] [INFO ] [REMOTE ] GNK: Full fetch complete (56988 records). [2025-09-29T19:01:16.596365] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-09-29T19:01:16.621043] [INFO ] [REMOTE ] GNT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:01:17.048430] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-09-29T19:01:17.048552] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-09-29T19:01:17.049579] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-09-29T19:01:17.049727] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-09-29T19:01:17.051217] [DEBUG] [LOCAL ] GNK: Trimmed 56988 records to 40282 (keeping 200 days of data) [2025-09-29T19:01:17.148331] [INFO ] [REMOTE ] GNT: Fetching primary data for 2024-12. [2025-09-29T19:01:17.315980] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-29T19:01:17.370945] [DEBUG] [LOCAL ] GNK: Primary data saved (40282 records). [2025-09-29T19:01:17.371119] [INFO ] [MAIN ] GNK: Full history saved. [2025-09-29T19:01:17.371243] [INFO ] [MAIN ] Update Progress: 949/2371 symbols completed. GNK took 25.7s. Estimated remaining: 3h 1m 40s. Rate: 7.8 symbols/min [2025-09-29T19:01:17.550760] [INFO ] [MAIN ] GNTY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:01:17.560823] [DEBUG] [LOCAL ] GNTY: Loaded 7353 existing records from primary storage. [2025-09-29T19:01:17.561085] [INFO ] [MAIN ] GNTY: Loaded 7353 existing records. [2025-09-29T19:01:17.757538] [WARN ] [MAIN ] GNTY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:01:17.757825] [INFO ] [MAIN ] GNTY: Wiping existing primary data before full refresh. [2025-09-29T19:01:17.757950] [INFO ] [LOCAL ] GNTY: Starting deletion of primary data. [2025-09-29T19:01:17.758267] [DEBUG] [LOCAL ] GNTY: Deleted primary data file. [2025-09-29T19:01:17.758338] [INFO ] [MAIN ] GNTY: Starting full primary refresh. [2025-09-29T19:01:17.874037] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-29T19:01:17.957283] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-09-29T19:01:18.161390] [INFO ] [REMOTE ] GNTY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:01:18.273897] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-29T19:01:18.748155] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2024-12. [2025-09-29T19:01:19.548193] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-01. [2025-09-29T19:01:19.581568] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-29T19:01:19.931836] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-29T19:01:20.348146] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-01. [2025-09-29T19:01:20.987826] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-29T19:01:21.148151] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-09-29T19:01:21.213338] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-29T19:01:21.948138] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-01. [2025-09-29T19:01:22.534407] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-29T19:01:22.722409] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-29T19:01:22.748094] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-09-29T19:01:23.548154] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-09-29T19:01:24.348126] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-02. [2025-09-29T19:01:24.651348] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-29T19:01:24.719580] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-29T19:01:24.982172] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-29T19:01:25.148140] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-09-29T19:01:25.948171] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-09-29T19:01:26.550673] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-29T19:01:26.749124] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-03. [2025-09-29T19:01:26.755202] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-29T19:01:27.359854] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-29T19:01:27.548117] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-04. [2025-09-29T19:01:28.056553] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-29T19:01:28.348125] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-05. [2025-09-29T19:01:28.934491] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-29T19:01:29.148122] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-09-29T19:01:29.948138] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-06. [2025-09-29T19:01:30.648807] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-29T19:01:30.748128] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-09-29T19:01:31.036780] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-29T19:01:31.548133] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-07. [2025-09-29T19:01:32.338216] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-29T19:01:32.348075] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-08. [2025-09-29T19:01:32.389573] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-29T19:01:33.148176] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-29T19:01:33.148300] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-09-29T19:01:33.948109] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-09-29T19:01:34.749573] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-29T19:01:34.749725] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-09-29T19:01:35.480920] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-29T19:01:35.548122] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-09-29T19:01:35.592553] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-29T19:01:36.348117] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-09-29T19:01:37.148180] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-09. [2025-09-29T19:01:37.282885] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-29T19:01:37.948697] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-29T19:01:37.950836] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-09-29T19:01:38.121813] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-29T19:01:38.124354] [INFO ] [REMOTE ] GNTY: Full fetch complete (10399 records). [2025-09-29T19:01:38.124477] [DEBUG] [VALIDATOR ] GNTY: Validating primary data. [2025-09-29T19:01:38.542423] [DEBUG] [VALIDATOR ] GNTY: All expected trading days are present. [2025-09-29T19:01:38.542511] [DEBUG] [VALIDATOR ] GNTY: Primary data validation passed. [2025-09-29T19:01:38.542813] [INFO ] [MAIN ] GNTY: Fetched primary data is valid. [2025-09-29T19:01:38.542932] [DEBUG] [LOCAL ] GNTY: Saving primary data. [2025-09-29T19:01:38.543461] [DEBUG] [LOCAL ] GNTY: Trimmed 10399 records to 7288 (keeping 200 days of data) [2025-09-29T19:01:38.597587] [DEBUG] [LOCAL ] GNTY: Primary data saved (7288 records). [2025-09-29T19:01:38.597766] [INFO ] [MAIN ] GNTY: Full history saved. [2025-09-29T19:01:38.597872] [INFO ] [MAIN ] Update Progress: 950/2371 symbols completed. GNTY took 21.2s. Estimated remaining: 3h 1m 53s. Rate: 7.8 symbols/min [2025-09-29T19:01:38.754373] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-09-29T19:01:38.784135] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:01:38.841418] [DEBUG] [LOCAL ] GNW: Loaded 52086 existing records from primary storage. [2025-09-29T19:01:38.841778] [INFO ] [MAIN ] GNW: Loaded 52086 existing records. [2025-09-29T19:01:39.032867] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:01:39.033101] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-09-29T19:01:39.033160] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-09-29T19:01:39.033812] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-09-29T19:01:39.033873] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-09-29T19:01:39.422855] [INFO ] [REMOTE ] GNW: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:01:39.495239] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-29T19:01:39.548112] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-09-29T19:01:40.348156] [INFO ] [REMOTE ] GNW: Fetching primary data for 2024-12. [2025-09-29T19:01:40.403302] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-29T19:01:41.079122] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-29T19:01:41.088689] [INFO ] [REMOTE ] GNL: Full fetch complete (68303 records). [2025-09-29T19:01:41.088837] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-09-29T19:01:41.157105] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-09-29T19:01:41.520104] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-09-29T19:01:41.520207] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-09-29T19:01:41.521602] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-09-29T19:01:41.521705] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-09-29T19:01:41.526141] [DEBUG] [LOCAL ] GNL: Trimmed 68303 records to 46945 (keeping 200 days of data) [2025-09-29T19:01:41.850882] [DEBUG] [LOCAL ] GNL: Primary data saved (46945 records). [2025-09-29T19:01:41.851044] [INFO ] [MAIN ] GNL: Full history saved. [2025-09-29T19:01:41.851159] [INFO ] [MAIN ] Update Progress: 951/2371 symbols completed. GNL took 31.5s. Estimated remaining: 3h 1m 39s. Rate: 7.8 symbols/min [2025-09-29T19:01:41.951808] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-09-29T19:01:42.044881] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:01:42.083617] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-29T19:01:42.137025] [DEBUG] [LOCAL ] GOF: Loaded 43374 existing records from primary storage. [2025-09-29T19:01:42.137390] [INFO ] [MAIN ] GOF: Loaded 43374 existing records. [2025-09-29T19:01:42.321239] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:01:42.321486] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-09-29T19:01:42.321536] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-09-29T19:01:42.322071] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-09-29T19:01:42.322133] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-09-29T19:01:42.701360] [INFO ] [REMOTE ] GOF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:01:42.748088] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-01. [2025-09-29T19:01:42.856780] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-29T19:01:42.949707] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-29T19:01:43.548161] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-09-29T19:01:44.279617] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-29T19:01:44.348109] [INFO ] [REMOTE ] GOF: Fetching primary data for 2024-12. [2025-09-29T19:01:44.441524] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-29T19:01:45.148185] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-09-29T19:01:45.948108] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-09-29T19:01:46.019343] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-29T19:01:46.748078] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-01. [2025-09-29T19:01:46.757420] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-29T19:01:46.796681] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-29T19:01:47.548124] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-09-29T19:01:48.343631] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-29T19:01:48.352504] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-09-29T19:01:49.138114] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-29T19:01:49.148059] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-09-29T19:01:49.360096] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-29T19:01:49.370375] [INFO ] [REMOTE ] GNRC: Full fetch complete (65331 records). [2025-09-29T19:01:49.370552] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-09-29T19:01:49.861451] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-09-29T19:01:49.861705] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-09-29T19:01:49.862727] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-09-29T19:01:49.862793] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-09-29T19:01:49.865469] [DEBUG] [LOCAL ] GNRC: Trimmed 65331 records to 45182 (keeping 200 days of data) [2025-09-29T19:01:49.968621] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-09-29T19:01:49.973631] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-29T19:01:50.193874] [DEBUG] [LOCAL ] GNRC: Primary data saved (45182 records). [2025-09-29T19:01:50.194046] [INFO ] [MAIN ] GNRC: Full history saved. [2025-09-29T19:01:50.194171] [INFO ] [MAIN ] Update Progress: 952/2371 symbols completed. GNRC took 38.0s. Estimated remaining: 3h 1m 32s. Rate: 7.8 symbols/min [2025-09-29T19:01:50.385027] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:01:50.425762] [DEBUG] [LOCAL ] GOLF: Loaded 32049 existing records from primary storage. [2025-09-29T19:01:50.426076] [INFO ] [MAIN ] GOLF: Loaded 32049 existing records. [2025-09-29T19:01:50.613165] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:01:50.613404] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-09-29T19:01:50.613454] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-09-29T19:01:50.613903] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-09-29T19:01:50.613964] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-09-29T19:01:50.757420] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-09-29T19:01:50.992721] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:01:51.548109] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-09-29T19:01:51.815915] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-29T19:01:52.353230] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-09-29T19:01:52.364855] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-29T19:01:52.614775] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-29T19:01:52.618188] [INFO ] [REMOTE ] GNT: Full fetch complete (10724 records). [2025-09-29T19:01:52.618316] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-09-29T19:01:53.025246] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-09-29T19:01:53.025337] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-09-29T19:01:53.025659] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-09-29T19:01:53.025734] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-09-29T19:01:53.026331] [DEBUG] [LOCAL ] GNT: Trimmed 10724 records to 8083 (keeping 200 days of data) [2025-09-29T19:01:53.087201] [DEBUG] [LOCAL ] GNT: Primary data saved (8083 records). [2025-09-29T19:01:53.087357] [INFO ] [MAIN ] GNT: Full history saved. [2025-09-29T19:01:53.087447] [INFO ] [MAIN ] Update Progress: 953/2371 symbols completed. GNT took 37.3s. Estimated remaining: 3h 1m 17s. Rate: 7.8 symbols/min [2025-09-29T19:01:53.159600] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-09-29T19:01:53.294949] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:01:53.370834] [DEBUG] [LOCAL ] GOOS: Loaded 46008 existing records from primary storage. [2025-09-29T19:01:53.371188] [INFO ] [MAIN ] GOOS: Loaded 46008 existing records. [2025-09-29T19:01:53.560191] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:01:53.560447] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-09-29T19:01:53.560509] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-09-29T19:01:53.561003] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-09-29T19:01:53.561065] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-09-29T19:01:53.965176] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2024-12. [2025-09-29T19:01:53.965082] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:01:54.015560] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-29T19:01:54.748164] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-09-29T19:01:55.034975] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-29T19:01:55.097127] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-29T19:01:55.548155] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-09-29T19:01:56.277822] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-29T19:01:56.348124] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2024-12. [2025-09-29T19:01:57.148131] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-09-29T19:01:57.243854] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-29T19:01:57.951495] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-09-29T19:01:57.956171] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-29T19:01:58.383740] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-29T19:01:58.748143] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-09-29T19:01:59.540266] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-29T19:01:59.550460] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-01. [2025-09-29T19:01:59.946662] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-29T19:02:00.348163] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-09-29T19:02:01.148112] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-09-29T19:02:01.513192] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-29T19:02:01.923347] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-29T19:02:01.948121] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-09-29T19:02:02.748199] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-09-29T19:02:02.978320] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-29T19:02:03.167595] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-29T19:02:03.548109] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-09-29T19:02:04.250018] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-29T19:02:04.348140] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-09-29T19:02:05.148111] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-09-29T19:02:05.187513] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-29T19:02:05.948133] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-09-29T19:02:06.093756] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-29T19:02:06.748136] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-09-29T19:02:06.883294] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-29T19:02:07.548174] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-09-29T19:02:07.773444] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-29T19:02:07.787524] [INFO ] [REMOTE ] GOF: Full fetch complete (62228 records). [2025-09-29T19:02:07.787842] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-09-29T19:02:08.222693] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-09-29T19:02:08.222812] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-09-29T19:02:08.223753] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-09-29T19:02:08.223831] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-09-29T19:02:08.225339] [DEBUG] [LOCAL ] GOF: Trimmed 62228 records to 42678 (keeping 200 days of data) [2025-09-29T19:02:08.350836] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-09-29T19:02:08.508131] [DEBUG] [LOCAL ] GOF: Primary data saved (42678 records). [2025-09-29T19:02:08.508277] [INFO ] [MAIN ] GOF: Full history saved. [2025-09-29T19:02:08.508377] [INFO ] [MAIN ] Update Progress: 954/2371 symbols completed. GOF took 26.7s. Estimated remaining: 3h 1m 21s. Rate: 7.8 symbols/min [2025-09-29T19:02:08.705364] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:02:08.750098] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-29T19:02:08.773343] [INFO ] [REMOTE ] GNW: Full fetch complete (73517 records). [2025-09-29T19:02:08.773553] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-09-29T19:02:08.927908] [DEBUG] [LOCAL ] GOTU: Loaded 39533 existing records from primary storage. [2025-09-29T19:02:08.943780] [INFO ] [MAIN ] GOTU: Loaded 39533 existing records. [2025-09-29T19:02:09.420435] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:02:09.498341] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-09-29T19:02:09.498438] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-09-29T19:02:09.499580] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-09-29T19:02:09.499680] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-09-29T19:02:09.498080] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-09-29T19:02:09.526020] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-09-29T19:02:09.528068] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-29T19:02:09.528261] [DEBUG] [LOCAL ] GNW: Trimmed 73517 records to 51334 (keeping 200 days of data) [2025-09-29T19:02:09.538292] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-09-29T19:02:09.537930] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-09-29T19:02:09.539325] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-09-29T19:02:10.084894] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:02:10.085828] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2024-12. [2025-09-29T19:02:10.129963] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-29T19:02:10.353423] [DEBUG] [LOCAL ] GNW: Primary data saved (51334 records). [2025-09-29T19:02:10.353585] [INFO ] [MAIN ] GNW: Full history saved. [2025-09-29T19:02:10.353698] [INFO ] [MAIN ] Update Progress: 955/2371 symbols completed. GNW took 31.8s. Estimated remaining: 3h 1m 5s. Rate: 7.8 symbols/min [2025-09-29T19:02:10.572282] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:02:10.632098] [DEBUG] [LOCAL ] GPC: Loaded 47289 existing records from primary storage. [2025-09-29T19:02:10.632480] [INFO ] [MAIN ] GPC: Loaded 47289 existing records. [2025-09-29T19:02:10.753971] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-09-29T19:02:10.847128] [WARN ] [MAIN ] GPC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:02:10.847432] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-09-29T19:02:10.847490] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-09-29T19:02:10.848043] [DEBUG] [LOCAL ] GPC: Deleted primary data file. [2025-09-29T19:02:10.848173] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-09-29T19:02:11.282573] [INFO ] [REMOTE ] GPC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:02:11.305031] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-29T19:02:11.548160] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-09-29T19:02:11.690607] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-29T19:02:12.348148] [INFO ] [REMOTE ] GPC: Fetching primary data for 2024-12. [2025-09-29T19:02:12.406163] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-29T19:02:12.766503] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-29T19:02:13.148151] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-09-29T19:02:13.948103] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-09-29T19:02:14.199946] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-29T19:02:14.456603] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-29T19:02:14.748168] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-01. [2025-09-29T19:02:15.548134] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-09-29T19:02:15.691261] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-29T19:02:16.348121] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-09-29T19:02:16.649615] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-29T19:02:16.963714] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-29T19:02:17.148117] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-09-29T19:02:17.913076] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-29T19:02:17.948098] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-09-29T19:02:18.755633] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-09-29T19:02:18.761704] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-29T19:02:19.213363] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-29T19:02:19.219678] [INFO ] [REMOTE ] GOLF: Full fetch complete (44960 records). [2025-09-29T19:02:19.219854] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-09-29T19:02:19.553221] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-09-29T19:02:19.646659] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-09-29T19:02:19.646757] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-09-29T19:02:19.647577] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-09-29T19:02:19.647639] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-09-29T19:02:19.648888] [DEBUG] [LOCAL ] GOLF: Trimmed 44960 records to 31352 (keeping 200 days of data) [2025-09-29T19:02:19.872238] [DEBUG] [LOCAL ] GOLF: Primary data saved (31352 records). [2025-09-29T19:02:19.872426] [INFO ] [MAIN ] GOLF: Full history saved. [2025-09-29T19:02:19.872551] [INFO ] [MAIN ] Update Progress: 956/2371 symbols completed. GOLF took 29.7s. Estimated remaining: 3h 0m 60s. Rate: 7.8 symbols/min [2025-09-29T19:02:20.078863] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:02:20.098833] [DEBUG] [LOCAL ] GPI: Loaded 15126 existing records from primary storage. [2025-09-29T19:02:20.099112] [INFO ] [MAIN ] GPI: Loaded 15126 existing records. [2025-09-29T19:02:20.309624] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:02:20.309872] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-09-29T19:02:20.309921] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-09-29T19:02:20.310151] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-09-29T19:02:20.310212] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-09-29T19:02:20.356810] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-09-29T19:02:20.751000] [INFO ] [REMOTE ] GPI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:02:20.786477] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-29T19:02:21.148116] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-09-29T19:02:21.492847] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-29T19:02:21.948127] [INFO ] [REMOTE ] GPI: Fetching primary data for 2024-12. [2025-09-29T19:02:22.124332] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-29T19:02:22.595264] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-29T19:02:22.612693] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-29T19:02:22.748123] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-09-29T19:02:23.548140] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-09-29T19:02:23.723846] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-29T19:02:24.348111] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-09-29T19:02:25.148088] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-09-29T19:02:25.367153] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-29T19:02:25.389347] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-29T19:02:25.948107] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-09-29T19:02:26.662231] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-29T19:02:26.713281] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-29T19:02:26.748126] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-09-29T19:02:27.548133] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-09-29T19:02:27.978762] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-29T19:02:28.348123] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-09-29T19:02:28.943984] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-29T19:02:29.148110] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-09-29T19:02:29.704784] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-29T19:02:29.948109] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-09-29T19:02:30.748195] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-09-29T19:02:31.061479] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-29T19:02:31.550339] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-09-29T19:02:31.557217] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-29T19:02:32.092184] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-29T19:02:32.348139] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-09-29T19:02:33.148115] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-09-29T19:02:33.275009] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-29T19:02:33.948163] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-09-29T19:02:34.372945] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-29T19:02:34.384363] [INFO ] [REMOTE ] GOOS: Full fetch complete (65690 records). [2025-09-29T19:02:34.384557] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-09-29T19:02:34.752501] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-09-29T19:02:34.848921] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-29T19:02:34.900552] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-09-29T19:02:34.901057] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-09-29T19:02:34.902399] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-09-29T19:02:34.902505] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-09-29T19:02:34.904221] [DEBUG] [LOCAL ] GOOS: Trimmed 65690 records to 45160 (keeping 200 days of data) [2025-09-29T19:02:35.175362] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-29T19:02:35.279340] [DEBUG] [LOCAL ] GOOS: Primary data saved (45160 records). [2025-09-29T19:02:35.279502] [INFO ] [MAIN ] GOOS: Full history saved. [2025-09-29T19:02:35.279595] [INFO ] [MAIN ] Update Progress: 957/2371 symbols completed. GOOS took 42.2s. Estimated remaining: 3h 1m 3s. Rate: 7.8 symbols/min [2025-09-29T19:02:35.548087] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-09-29T19:02:35.942132] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-29T19:02:36.348158] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-09-29T19:02:37.116417] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-29T19:02:37.124559] [INFO ] [REMOTE ] GOTU: Full fetch complete (59514 records). [2025-09-29T19:02:37.124717] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-09-29T19:02:37.158091] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-09-29T19:02:37.328256] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-29T19:02:37.586337] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-09-29T19:02:37.586456] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-09-29T19:02:37.587503] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-09-29T19:02:37.587573] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-09-29T19:02:37.589050] [DEBUG] [LOCAL ] GOTU: Trimmed 59514 records to 38697 (keeping 200 days of data) [2025-09-29T19:02:37.826591] [DEBUG] [LOCAL ] GOTU: Primary data saved (38697 records). [2025-09-29T19:02:37.826785] [INFO ] [MAIN ] GOTU: Full history saved. [2025-09-29T19:02:37.826885] [INFO ] [MAIN ] Update Progress: 958/2371 symbols completed. GOTU took 29.3s. Estimated remaining: 3h 0m 48s. Rate: 7.8 symbols/min [2025-09-29T19:02:37.948180] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-09-29T19:02:38.775375] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-29T19:02:38.780130] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-09-29T19:02:38.855193] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-29T19:02:39.548203] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-09-29T19:02:39.823078] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-29T19:02:40.348153] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-09-29T19:02:41.182728] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-29T19:02:41.186609] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-09-29T19:02:41.214321] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-29T19:02:41.948193] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-09-29T19:02:42.375306] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-29T19:02:42.378956] [INFO ] [REMOTE ] GPI: Full fetch complete (20990 records). [2025-09-29T19:02:42.379052] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-09-29T19:02:42.810335] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-09-29T19:02:42.810474] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-09-29T19:02:42.810952] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-09-29T19:02:42.811015] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-09-29T19:02:42.811986] [DEBUG] [LOCAL ] GPI: Trimmed 20990 records to 14808 (keeping 200 days of data) [2025-09-29T19:02:42.916963] [DEBUG] [LOCAL ] GPI: Primary data saved (14808 records). [2025-09-29T19:02:42.917204] [INFO ] [MAIN ] GPI: Full history saved. [2025-09-29T19:02:42.917316] [INFO ] [MAIN ] Update Progress: 959/2371 symbols completed. GPI took 23.0s. Estimated remaining: 3h 0m 37s. Rate: 7.8 symbols/min [2025-09-29T19:02:43.709970] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-29T19:02:43.720133] [INFO ] [REMOTE ] GPC: Full fetch complete (69006 records). [2025-09-29T19:02:43.720299] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-09-29T19:02:44.146060] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-09-29T19:02:44.146164] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-09-29T19:02:44.147265] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-09-29T19:02:44.147333] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-09-29T19:02:44.148932] [DEBUG] [LOCAL ] GPC: Trimmed 69006 records to 46447 (keeping 200 days of data) [2025-09-29T19:02:44.471383] [DEBUG] [LOCAL ] GPC: Primary data saved (46447 records). [2025-09-29T19:02:44.471549] [INFO ] [MAIN ] GPC: Full history saved. [2025-09-29T19:02:44.471675] [INFO ] [MAIN ] Update Progress: 960/2371 symbols completed. GPC took 34.1s. Estimated remaining: 3h 0m 20s. Rate: 7.8 symbols/min [2025-09-29T19:02:45.102366] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:02:45.256936] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:02:45.262240] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:02:45.283430] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:02:45.299146] [DEBUG] [LOCAL ] GPJA: Loaded 4140 existing records from primary storage. [2025-09-29T19:02:45.299589] [INFO ] [MAIN ] GPJA: Loaded 4140 existing records. [2025-09-29T19:02:45.496430] [DEBUG] [LOCAL ] GPMT: Loaded 26788 existing records from primary storage. [2025-09-29T19:02:45.556446] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:02:45.557926] [DEBUG] [LOCAL ] GPN: Loaded 52822 existing records from primary storage. [2025-09-29T19:02:45.558569] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-09-29T19:02:45.558476] [INFO ] [MAIN ] GPMT: Loaded 26788 existing records. [2025-09-29T19:02:45.558827] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-09-29T19:02:45.559452] [INFO ] [MAIN ] GPN: Loaded 52822 existing records. [2025-09-29T19:02:45.564762] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-09-29T19:02:45.604274] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-09-29T19:02:45.876236] [DEBUG] [LOCAL ] GPK: Loaded 53441 existing records from primary storage. [2025-09-29T19:02:45.965141] [INFO ] [MAIN ] GPK: Loaded 53441 existing records. [2025-09-29T19:02:46.135860] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:02:46.195980] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-09-29T19:02:46.275407] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-09-29T19:02:46.325825] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-09-29T19:02:46.297331] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:02:46.331232] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-09-29T19:02:46.383431] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-09-29T19:02:46.423472] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-09-29T19:02:46.570285] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-09-29T19:02:46.628742] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-09-29T19:02:46.724926] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:02:46.815285] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-09-29T19:02:46.913310] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-09-29T19:02:46.970516] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:02:46.986050] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2024-12. [2025-09-29T19:02:46.987729] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-09-29T19:02:47.059571] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-09-29T19:02:47.568282] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:02:47.623339] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2024-12. [2025-09-29T19:02:47.655117] [INFO ] [REMOTE ] GPN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:02:47.671871] [INFO ] [REMOTE ] GPN: Fetching primary data for 2024-12. [2025-09-29T19:02:47.853821] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-29T19:02:47.858946] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-01. [2025-09-29T19:02:47.947491] [INFO ] [REMOTE ] GPK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:02:47.947844] [INFO ] [REMOTE ] GPK: Fetching primary data for 2024-12. [2025-09-29T19:02:48.674321] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-29T19:02:48.677995] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-09-29T19:02:48.991194] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-29T19:02:48.999553] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-01. [2025-09-29T19:02:49.142677] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-29T19:02:49.144470] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-09-29T19:02:49.555033] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-29T19:02:49.566170] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-01. [2025-09-29T19:02:49.622824] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-29T19:02:49.739693] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-29T19:02:49.948138] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-01. [2025-09-29T19:02:50.157004] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-29T19:02:50.748082] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-09-29T19:02:51.245682] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-29T19:02:51.548157] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-09-29T19:02:51.593605] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-29T19:02:51.642800] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-29T19:02:52.348115] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-09-29T19:02:53.140117] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-29T19:02:53.149959] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-09-29T19:02:53.778741] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-29T19:02:53.948127] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-09-29T19:02:54.507382] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-29T19:02:54.748129] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-09-29T19:02:54.858462] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-29T19:02:55.548166] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-09-29T19:02:55.864579] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-29T19:02:56.348089] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-09-29T19:02:56.515444] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-29T19:02:57.148118] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-09-29T19:02:57.424851] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-29T19:02:57.948149] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-09-29T19:02:58.748083] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-09-29T19:02:58.922394] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-29T19:02:58.951924] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-29T19:02:59.548159] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-09-29T19:03:00.145057] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-29T19:03:00.348156] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-09-29T19:03:00.482605] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-29T19:03:00.961098] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-29T19:03:01.148152] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-09-29T19:03:01.756553] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-29T19:03:01.948180] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-09-29T19:03:02.606681] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-29T19:03:02.608795] [INFO ] [REMOTE ] GPJA: Full fetch complete (7260 records). [2025-09-29T19:03:02.608905] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-09-29T19:03:02.761819] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-09-29T19:03:03.040637] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-09-29T19:03:03.040781] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-09-29T19:03:03.041023] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-09-29T19:03:03.041068] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-09-29T19:03:03.041476] [DEBUG] [LOCAL ] GPJA: Trimmed 7260 records to 4097 (keeping 200 days of data) [2025-09-29T19:03:03.066592] [DEBUG] [LOCAL ] GPJA: Primary data saved (4097 records). [2025-09-29T19:03:03.066733] [INFO ] [MAIN ] GPJA: Full history saved. [2025-09-29T19:03:03.066828] [INFO ] [MAIN ] Update Progress: 961/2371 symbols completed. GPJA took 18.6s. Estimated remaining: 3h 0m 28s. Rate: 7.8 symbols/min [2025-09-29T19:03:03.249129] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:03:03.274184] [DEBUG] [LOCAL ] GPOR: Loaded 23328 existing records from primary storage. [2025-09-29T19:03:03.274459] [INFO ] [MAIN ] GPOR: Loaded 23328 existing records. [2025-09-29T19:03:03.461886] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:03:03.462132] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-09-29T19:03:03.462184] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-09-29T19:03:03.462523] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-09-29T19:03:03.462585] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-09-29T19:03:03.553323] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-09-29T19:03:03.848412] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:03:04.348113] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2024-12. [2025-09-29T19:03:04.614967] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-29T19:03:04.680805] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-29T19:03:05.149361] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-09-29T19:03:05.220633] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-29T19:03:05.948164] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-09-29T19:03:06.748085] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-01. [2025-09-29T19:03:06.836680] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-29T19:03:06.992389] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-29T19:03:07.548125] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-09-29T19:03:07.786871] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-29T19:03:08.348151] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-09-29T19:03:09.148105] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-09-29T19:03:09.540558] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-29T19:03:09.566950] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-29T19:03:09.948130] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-09-29T19:03:10.596036] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-29T19:03:10.748134] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-09-29T19:03:11.548124] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-09-29T19:03:11.889086] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-29T19:03:12.348129] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-09-29T19:03:12.497025] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-29T19:03:12.554958] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-29T19:03:13.008186] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-29T19:03:13.148139] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-09-29T19:03:13.948133] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-09-29T19:03:14.297244] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-29T19:03:14.748120] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-09-29T19:03:15.548086] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-09-29T19:03:15.913173] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-29T19:03:16.039149] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-29T19:03:16.348116] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-09-29T19:03:17.148180] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-09-29T19:03:17.361812] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-29T19:03:17.502719] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-29T19:03:17.948108] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-09-29T19:03:18.748094] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-09-29T19:03:18.910338] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-29T19:03:19.054033] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-29T19:03:19.551428] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-09-29T19:03:19.555240] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-29T19:03:19.560137] [INFO ] [REMOTE ] GPMT: Full fetch complete (37515 records). [2025-09-29T19:03:19.560316] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-09-29T19:03:19.991026] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-09-29T19:03:19.991269] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-09-29T19:03:19.992236] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-09-29T19:03:19.992311] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-09-29T19:03:19.993529] [DEBUG] [LOCAL ] GPMT: Trimmed 37515 records to 26288 (keeping 200 days of data) [2025-09-29T19:03:20.159071] [DEBUG] [LOCAL ] GPMT: Primary data saved (26288 records). [2025-09-29T19:03:20.159217] [INFO ] [MAIN ] GPMT: Full history saved. [2025-09-29T19:03:20.159339] [INFO ] [MAIN ] Update Progress: 962/2371 symbols completed. GPMT took 35.7s. Estimated remaining: 3h 0m 34s. Rate: 7.8 symbols/min [2025-09-29T19:03:20.340633] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:03:20.348087] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-09-29T19:03:20.386736] [DEBUG] [LOCAL ] GPRK: Loaded 39841 existing records from primary storage. [2025-09-29T19:03:20.387073] [INFO ] [MAIN ] GPRK: Loaded 39841 existing records. [2025-09-29T19:03:20.588236] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:03:20.588490] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-09-29T19:03:20.588539] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-09-29T19:03:20.589009] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-09-29T19:03:20.589067] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-09-29T19:03:20.987681] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:03:21.148131] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2024-12. [2025-09-29T19:03:21.396617] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-29T19:03:21.408070] [INFO ] [REMOTE ] GPK: Full fetch complete (75459 records). [2025-09-29T19:03:21.408266] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-09-29T19:03:21.851846] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-09-29T19:03:21.851991] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-09-29T19:03:21.853039] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-09-29T19:03:21.853113] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-09-29T19:03:21.854780] [DEBUG] [LOCAL ] GPK: Trimmed 75459 records to 52653 (keeping 200 days of data) [2025-09-29T19:03:21.948345] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-09-29T19:03:22.204337] [DEBUG] [LOCAL ] GPK: Primary data saved (52653 records). [2025-09-29T19:03:22.204485] [INFO ] [MAIN ] GPK: Full history saved. [2025-09-29T19:03:22.204582] [INFO ] [MAIN ] Update Progress: 963/2371 symbols completed. GPK took 37.7s. Estimated remaining: 3h 0m 18s. Rate: 7.8 symbols/min [2025-09-29T19:03:22.389639] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:03:22.418098] [DEBUG] [LOCAL ] GRBK: Loaded 27375 existing records from primary storage. [2025-09-29T19:03:22.418378] [INFO ] [MAIN ] GRBK: Loaded 27375 existing records. [2025-09-29T19:03:22.614791] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:03:22.615384] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-09-29T19:03:22.615716] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-09-29T19:03:22.643496] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-09-29T19:03:22.644011] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-09-29T19:03:22.645196] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-09-29T19:03:22.764945] [INFO ] [REMOTE ] GPN: Full fetch complete (74829 records). [2025-09-29T19:03:22.765323] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-09-29T19:03:22.871305] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-29T19:03:22.925706] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-01. [2025-09-29T19:03:23.312792] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:03:23.419268] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-29T19:03:23.554979] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2024-12. [2025-09-29T19:03:23.580327] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-09-29T19:03:23.580441] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-09-29T19:03:23.581546] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-09-29T19:03:23.581792] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-09-29T19:03:23.586773] [DEBUG] [LOCAL ] GPN: Trimmed 74829 records to 52049 (keeping 200 days of data) [2025-09-29T19:03:23.952476] [DEBUG] [LOCAL ] GPN: Primary data saved (52049 records). [2025-09-29T19:03:23.952624] [INFO ] [MAIN ] GPN: Full history saved. [2025-09-29T19:03:23.952745] [INFO ] [MAIN ] Update Progress: 964/2371 symbols completed. GPN took 39.5s. Estimated remaining: 3h 0m 2s. Rate: 7.8 symbols/min [2025-09-29T19:03:24.130551] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:03:24.142079] [DEBUG] [LOCAL ] GRC: Loaded 9061 existing records from primary storage. [2025-09-29T19:03:24.142337] [INFO ] [MAIN ] GRC: Loaded 9061 existing records. [2025-09-29T19:03:24.348683] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-09-29T19:03:24.352586] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:03:24.353613] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-09-29T19:03:24.353701] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-09-29T19:03:24.353964] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-09-29T19:03:24.354024] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-09-29T19:03:24.797078] [INFO ] [REMOTE ] GRC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:03:24.808874] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-29T19:03:24.837138] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-29T19:03:25.148115] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-09-29T19:03:25.948122] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-09-29T19:03:26.015397] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-29T19:03:26.022305] [INFO ] [REMOTE ] GPOR: Full fetch complete (34882 records). [2025-09-29T19:03:26.022505] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-09-29T19:03:26.443897] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-09-29T19:03:26.444009] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-09-29T19:03:26.444820] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-09-29T19:03:26.444901] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-09-29T19:03:26.445802] [DEBUG] [LOCAL ] GPOR: Trimmed 34882 records to 22983 (keeping 200 days of data) [2025-09-29T19:03:26.593604] [DEBUG] [LOCAL ] GPOR: Primary data saved (22983 records). [2025-09-29T19:03:26.593787] [INFO ] [MAIN ] GPOR: Full history saved. [2025-09-29T19:03:26.593937] [INFO ] [MAIN ] Update Progress: 965/2371 symbols completed. GPOR took 23.5s. Estimated remaining: 2h 59m 47s. Rate: 7.8 symbols/min [2025-09-29T19:03:26.761980] [INFO ] [REMOTE ] GRC: Fetching primary data for 2024-12. [2025-09-29T19:03:26.794388] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-29T19:03:26.816233] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:03:26.848206] [DEBUG] [LOCAL ] GRDN: Loaded 20178 existing records from primary storage. [2025-09-29T19:03:26.848474] [INFO ] [MAIN ] GRDN: Loaded 20178 existing records. [2025-09-29T19:03:27.034412] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:03:27.034732] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-09-29T19:03:27.034791] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-09-29T19:03:27.035058] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-09-29T19:03:27.035117] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-09-29T19:03:27.369873] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-29T19:03:27.432769] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:03:27.548103] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2024-12. [2025-09-29T19:03:27.689723] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-29T19:03:28.348118] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-09-29T19:03:28.619757] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-29T19:03:29.148130] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-09-29T19:03:29.879846] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-29T19:03:29.948096] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-01. [2025-09-29T19:03:29.979663] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-29T19:03:30.748105] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-09-29T19:03:30.799149] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-29T19:03:31.548073] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-09-29T19:03:32.023542] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-29T19:03:32.348156] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-09-29T19:03:32.404506] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-29T19:03:33.148127] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-09-29T19:03:33.868662] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-29T19:03:33.948163] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-01. [2025-09-29T19:03:34.010903] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-29T19:03:34.748154] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-09-29T19:03:34.748922] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-29T19:03:35.548136] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-09-29T19:03:36.013364] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-29T19:03:36.348113] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-09-29T19:03:36.371485] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-29T19:03:37.148150] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-09-29T19:03:37.467089] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-29T19:03:37.948106] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-09-29T19:03:38.676664] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-29T19:03:38.734373] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-29T19:03:38.748131] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-09-29T19:03:39.548105] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-09-29T19:03:39.552367] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-29T19:03:40.348122] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-09-29T19:03:40.796725] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-29T19:03:41.148134] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-09-29T19:03:41.237026] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-29T19:03:41.948126] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-09-29T19:03:42.691566] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-29T19:03:42.692375] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-29T19:03:42.748148] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-09-29T19:03:43.548118] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-09-29T19:03:44.098564] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-29T19:03:44.348122] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-09-29T19:03:44.480604] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-29T19:03:45.148175] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-09-29T19:03:45.809144] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-29T19:03:45.948117] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-09-29T19:03:45.972206] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-29T19:03:46.748160] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-09-29T19:03:47.548119] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-09-29T19:03:47.614019] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-29T19:03:47.633319] [INFO ] [REMOTE ] GPRK: Full fetch complete (57257 records). [2025-09-29T19:03:47.640423] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-09-29T19:03:47.642524] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-29T19:03:48.073304] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-09-29T19:03:48.073405] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-09-29T19:03:48.074287] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-09-29T19:03:48.074352] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-09-29T19:03:48.075579] [DEBUG] [LOCAL ] GPRK: Trimmed 57257 records to 39240 (keeping 200 days of data) [2025-09-29T19:03:48.320046] [DEBUG] [LOCAL ] GPRK: Primary data saved (39240 records). [2025-09-29T19:03:48.320203] [INFO ] [MAIN ] GPRK: Full history saved. [2025-09-29T19:03:48.320320] [INFO ] [MAIN ] Update Progress: 966/2371 symbols completed. GPRK took 28.2s. Estimated remaining: 2h 59m 60s. Rate: 7.8 symbols/min [2025-09-29T19:03:48.353233] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-09-29T19:03:48.512625] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:03:48.572064] [DEBUG] [LOCAL ] GRMN: Loaded 41798 existing records from primary storage. [2025-09-29T19:03:48.572417] [INFO ] [MAIN ] GRMN: Loaded 41798 existing records. [2025-09-29T19:03:48.763767] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:03:48.764236] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-09-29T19:03:48.770325] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-09-29T19:03:48.780743] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-09-29T19:03:48.781395] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-09-29T19:03:48.781315] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-29T19:03:49.158610] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-09-29T19:03:49.166636] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:03:49.526795] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-29T19:03:49.948116] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2024-12. [2025-09-29T19:03:50.385714] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-29T19:03:50.393593] [INFO ] [REMOTE ] GRBK: Full fetch complete (40575 records). [2025-09-29T19:03:50.393744] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-09-29T19:03:50.753967] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-09-29T19:03:50.788100] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-09-29T19:03:50.788181] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-09-29T19:03:50.789014] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-09-29T19:03:50.789081] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-09-29T19:03:50.790244] [DEBUG] [LOCAL ] GRBK: Trimmed 40575 records to 26896 (keeping 200 days of data) [2025-09-29T19:03:50.954785] [DEBUG] [LOCAL ] GRBK: Primary data saved (26896 records). [2025-09-29T19:03:50.954928] [INFO ] [MAIN ] GRBK: Full history saved. [2025-09-29T19:03:50.955040] [INFO ] [MAIN ] Update Progress: 967/2371 symbols completed. GRBK took 28.8s. Estimated remaining: 2h 59m 45s. Rate: 7.8 symbols/min [2025-09-29T19:03:51.146031] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:03:51.211609] [DEBUG] [LOCAL ] GRND: Loaded 50744 existing records from primary storage. [2025-09-29T19:03:51.211970] [INFO ] [MAIN ] GRND: Loaded 50744 existing records. [2025-09-29T19:03:51.408721] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:03:51.409030] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-09-29T19:03:51.409165] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-09-29T19:03:51.409752] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-09-29T19:03:51.409906] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-09-29T19:03:51.567221] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-09-29T19:03:51.676633] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-29T19:03:51.847951] [INFO ] [REMOTE ] GRND: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:03:51.850677] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-29T19:03:52.348166] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-09-29T19:03:52.710750] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-29T19:03:53.148127] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-01. [2025-09-29T19:03:53.219302] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-29T19:03:53.221868] [INFO ] [REMOTE ] GRC: Full fetch complete (13069 records). [2025-09-29T19:03:53.222084] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-09-29T19:03:53.601356] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-09-29T19:03:53.601468] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-09-29T19:03:53.601830] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-09-29T19:03:53.601899] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-09-29T19:03:53.602413] [DEBUG] [LOCAL ] GRC: Trimmed 13069 records to 8910 (keeping 200 days of data) [2025-09-29T19:03:53.662748] [DEBUG] [LOCAL ] GRC: Primary data saved (8910 records). [2025-09-29T19:03:53.662898] [INFO ] [MAIN ] GRC: Full history saved. [2025-09-29T19:03:53.662990] [INFO ] [MAIN ] Update Progress: 968/2371 symbols completed. GRC took 29.7s. Estimated remaining: 2h 59m 30s. Rate: 7.8 symbols/min [2025-09-29T19:03:53.855250] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:03:53.895624] [DEBUG] [LOCAL ] GRNT: Loaded 34235 existing records from primary storage. [2025-09-29T19:03:53.895987] [INFO ] [MAIN ] GRNT: Loaded 34235 existing records. [2025-09-29T19:03:53.956124] [INFO ] [REMOTE ] GRND: Fetching primary data for 2024-12. [2025-09-29T19:03:54.108923] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:03:54.109197] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-09-29T19:03:54.109302] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-09-29T19:03:54.109676] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-09-29T19:03:54.109768] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-09-29T19:03:54.506958] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:03:54.700443] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-29T19:03:54.748081] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-09-29T19:03:55.528228] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-29T19:03:55.548139] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2024-12. [2025-09-29T19:03:56.348074] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-01. [2025-09-29T19:03:56.480739] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-29T19:03:56.973626] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-29T19:03:57.148119] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-09-29T19:03:57.948093] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-09-29T19:03:57.981811] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-29T19:03:58.748132] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-01. [2025-09-29T19:03:58.806754] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-29T19:03:58.921215] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-29T19:03:59.548074] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-09-29T19:04:00.006585] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-29T19:04:00.348158] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-09-29T19:04:00.607947] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-29T19:04:01.148111] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-09-29T19:04:01.948146] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-09-29T19:04:02.101495] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-29T19:04:02.297042] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-29T19:04:02.748150] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-09-29T19:04:03.483639] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-29T19:04:03.548169] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-09-29T19:04:04.139117] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-29T19:04:04.348139] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-09-29T19:04:05.148138] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-09-29T19:04:05.350271] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-29T19:04:05.750790] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-29T19:04:05.757564] [INFO ] [REMOTE ] GRDN: Full fetch complete (26178 records). [2025-09-29T19:04:05.757743] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-09-29T19:04:05.955912] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-09-29T19:04:06.160135] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-09-29T19:04:06.160232] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-09-29T19:04:06.160944] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-09-29T19:04:06.161015] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-09-29T19:04:06.162117] [DEBUG] [LOCAL ] GRDN: Trimmed 26178 records to 20177 (keeping 200 days of data) [2025-09-29T19:04:06.302927] [DEBUG] [LOCAL ] GRDN: Primary data saved (20177 records). [2025-09-29T19:04:06.303062] [INFO ] [MAIN ] GRDN: Full history saved. [2025-09-29T19:04:06.303167] [INFO ] [MAIN ] Update Progress: 969/2371 symbols completed. GRDN took 39.7s. Estimated remaining: 2h 59m 29s. Rate: 7.8 symbols/min [2025-09-29T19:04:06.497870] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:04:06.523451] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-29T19:04:06.543590] [DEBUG] [LOCAL ] GROV: Loaded 9240 existing records from primary storage. [2025-09-29T19:04:06.543931] [INFO ] [MAIN ] GROV: Loaded 9240 existing records. [2025-09-29T19:04:06.745139] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:04:06.745389] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-09-29T19:04:06.745441] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-09-29T19:04:06.745636] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-09-29T19:04:06.745735] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-09-29T19:04:06.757572] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-09-29T19:04:07.144941] [INFO ] [REMOTE ] GROV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:04:07.547304] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-29T19:04:07.557165] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-09-29T19:04:08.348112] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-09-29T19:04:08.408003] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-29T19:04:08.986062] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-29T19:04:09.148161] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-09-29T19:04:09.948131] [INFO ] [REMOTE ] GROV: Fetching primary data for 2024-12. [2025-09-29T19:04:10.152722] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-29T19:04:10.550594] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-29T19:04:10.748133] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-01. [2025-09-29T19:04:10.820853] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-29T19:04:11.548149] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-09-29T19:04:11.692550] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-29T19:04:12.348136] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-09-29T19:04:13.102812] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-29T19:04:13.126259] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-29T19:04:13.148096] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-09-29T19:04:13.948122] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-09-29T19:04:14.065112] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-29T19:04:14.748157] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-09-29T19:04:15.238590] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-29T19:04:15.548328] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-09-29T19:04:16.348287] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-09-29T19:04:16.485082] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-29T19:04:16.493928] [INFO ] [REMOTE ] GRMN: Full fetch complete (59963 records). [2025-09-29T19:04:16.494099] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-09-29T19:04:16.909008] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-09-29T19:04:16.909131] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-09-29T19:04:16.910120] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-09-29T19:04:16.910207] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-09-29T19:04:16.911924] [DEBUG] [LOCAL ] GRMN: Trimmed 59963 records to 41096 (keeping 200 days of data) [2025-09-29T19:04:17.037176] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-29T19:04:17.155052] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-09-29T19:04:17.233005] [DEBUG] [LOCAL ] GRMN: Primary data saved (41096 records). [2025-09-29T19:04:17.233178] [INFO ] [MAIN ] GRMN: Full history saved. [2025-09-29T19:04:17.233272] [INFO ] [MAIN ] Update Progress: 970/2371 symbols completed. GRMN took 28.9s. Estimated remaining: 2h 59m 26s. Rate: 7.8 symbols/min [2025-09-29T19:04:17.416006] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:04:17.423628] [DEBUG] [LOCAL ] GRX: Loaded 4547 existing records from primary storage. [2025-09-29T19:04:17.423903] [INFO ] [MAIN ] GRX: Loaded 4547 existing records. [2025-09-29T19:04:17.624738] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:04:17.625509] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-09-29T19:04:17.625560] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-09-29T19:04:17.625778] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-09-29T19:04:17.625838] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-09-29T19:04:17.952560] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-09-29T19:04:17.984382] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-29T19:04:18.043142] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-29T19:04:18.115360] [INFO ] [REMOTE ] GRX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:04:18.748122] [INFO ] [REMOTE ] GRX: Fetching primary data for 2024-12. [2025-09-29T19:04:19.389141] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-29T19:04:19.548103] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-09-29T19:04:19.814381] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-29T19:04:20.134261] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-29T19:04:20.348130] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-09-29T19:04:21.148129] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-09-29T19:04:21.669949] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-29T19:04:21.907634] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-29T19:04:21.948100] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-09-29T19:04:22.678775] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-29T19:04:22.748121] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-09-29T19:04:23.548110] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-09-29T19:04:24.035267] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-29T19:04:24.252377] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-29T19:04:24.348111] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-09-29T19:04:24.981723] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-29T19:04:25.148137] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-09-29T19:04:25.948109] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-09-29T19:04:26.114499] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-29T19:04:26.523306] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-29T19:04:26.748108] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-09-29T19:04:27.366353] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-29T19:04:27.548107] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-09-29T19:04:28.103325] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-29T19:04:28.348128] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-09-29T19:04:28.991554] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-29T19:04:29.148123] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-09-29T19:04:29.761068] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-29T19:04:29.948118] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-09-29T19:04:30.748137] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-09-29T19:04:30.832658] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-29T19:04:30.834973] [INFO ] [REMOTE ] GRX: Full fetch complete (6541 records). [2025-09-29T19:04:30.835051] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-09-29T19:04:31.232511] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-09-29T19:04:31.232596] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-09-29T19:04:31.232820] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-09-29T19:04:31.232885] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-09-29T19:04:31.233364] [DEBUG] [LOCAL ] GRX: Trimmed 6541 records to 4569 (keeping 200 days of data) [2025-09-29T19:04:31.263088] [DEBUG] [LOCAL ] GRX: Primary data saved (4569 records). [2025-09-29T19:04:31.263237] [INFO ] [MAIN ] GRX: Full history saved. [2025-09-29T19:04:31.263330] [INFO ] [MAIN ] Update Progress: 971/2371 symbols completed. GRX took 14.0s. Estimated remaining: 2h 59m 28s. Rate: 7.8 symbols/min [2025-09-29T19:04:31.444456] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:04:31.502829] [DEBUG] [LOCAL ] GS: Loaded 52736 existing records from primary storage. [2025-09-29T19:04:31.503266] [INFO ] [MAIN ] GS: Loaded 52736 existing records. [2025-09-29T19:04:31.553229] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-09-29T19:04:31.698860] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:04:31.699180] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-09-29T19:04:31.699236] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-09-29T19:04:31.699875] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-09-29T19:04:31.699937] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-09-29T19:04:32.089632] [INFO ] [REMOTE ] GS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:04:32.348110] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-09-29T19:04:32.367621] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-29T19:04:32.675325] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-29T19:04:33.148148] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-09-29T19:04:33.865342] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-29T19:04:33.867275] [INFO ] [REMOTE ] GROV: Full fetch complete (14526 records). [2025-09-29T19:04:33.867356] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-09-29T19:04:33.950212] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-09-29T19:04:34.082424] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-29T19:04:34.198055] [INFO ] [REMOTE ] GRNT: Full fetch complete (48462 records). [2025-09-29T19:04:34.212815] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-09-29T19:04:34.424897] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-09-29T19:04:34.425446] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-09-29T19:04:34.431501] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-09-29T19:04:34.436756] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-09-29T19:04:34.470787] [DEBUG] [LOCAL ] GROV: Trimmed 14526 records to 9008 (keeping 200 days of data) [2025-09-29T19:04:34.773445] [INFO ] [REMOTE ] GS: Fetching primary data for 2024-12. [2025-09-29T19:04:34.788389] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-09-29T19:04:34.788834] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-09-29T19:04:34.789688] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-09-29T19:04:34.791520] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-09-29T19:04:34.797919] [DEBUG] [LOCAL ] GRNT: Trimmed 48462 records to 33708 (keeping 200 days of data) [2025-09-29T19:04:34.799752] [DEBUG] [LOCAL ] GROV: Primary data saved (9008 records). [2025-09-29T19:04:34.800022] [INFO ] [MAIN ] GROV: Full history saved. [2025-09-29T19:04:34.800157] [INFO ] [MAIN ] Update Progress: 972/2371 symbols completed. GROV took 28.5s. Estimated remaining: 2h 59m 14s. Rate: 7.8 symbols/min [2025-09-29T19:04:35.081010] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:04:35.139157] [DEBUG] [LOCAL ] GSBD: Loaded 39756 existing records from primary storage. [2025-09-29T19:04:35.143422] [INFO ] [MAIN ] GSBD: Loaded 39756 existing records. [2025-09-29T19:04:35.408672] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:04:35.409322] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-09-29T19:04:35.409804] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-09-29T19:04:35.410357] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-09-29T19:04:35.410420] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-09-29T19:04:35.838117] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:04:35.838248] [DEBUG] [LOCAL ] GRNT: Primary data saved (33708 records). [2025-09-29T19:04:35.838938] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2024-12. [2025-09-29T19:04:35.839258] [INFO ] [MAIN ] GRNT: Full history saved. [2025-09-29T19:04:35.839459] [INFO ] [MAIN ] Update Progress: 973/2371 symbols completed. GRNT took 42.2s. Estimated remaining: 2h 58m 57s. Rate: 7.8 symbols/min [2025-09-29T19:04:36.024266] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:04:36.055791] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-29T19:04:36.067315] [INFO ] [REMOTE ] GRND: Full fetch complete (70553 records). [2025-09-29T19:04:36.067486] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-09-29T19:04:36.424262] [DEBUG] [LOCAL ] GSK: Loaded 54272 existing records from primary storage. [2025-09-29T19:04:36.424752] [INFO ] [MAIN ] GSK: Loaded 54272 existing records. [2025-09-29T19:04:36.725896] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-09-29T19:04:36.766744] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:04:36.767276] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-09-29T19:04:36.769091] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-09-29T19:04:36.767669] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-09-29T19:04:36.769413] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-09-29T19:04:36.769804] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-09-29T19:04:36.770734] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-09-29T19:04:36.770926] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-09-29T19:04:36.818381] [DEBUG] [LOCAL ] GRND: Trimmed 70553 records to 49962 (keeping 200 days of data) [2025-09-29T19:04:37.186840] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-09-29T19:04:37.221567] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-01. [2025-09-29T19:04:37.311214] [INFO ] [REMOTE ] GSK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:04:37.311708] [INFO ] [REMOTE ] GSK: Fetching primary data for 2024-12. [2025-09-29T19:04:37.510040] [DEBUG] [LOCAL ] GRND: Primary data saved (49962 records). [2025-09-29T19:04:37.510196] [INFO ] [MAIN ] GRND: Full history saved. [2025-09-29T19:04:37.510303] [INFO ] [MAIN ] Update Progress: 974/2371 symbols completed. GRND took 46.6s. Estimated remaining: 2h 58m 41s. Rate: 7.8 symbols/min [2025-09-29T19:04:37.692097] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:04:37.727294] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-29T19:04:37.770779] [DEBUG] [LOCAL ] GSL: Loaded 33824 existing records from primary storage. [2025-09-29T19:04:37.771090] [INFO ] [MAIN ] GSL: Loaded 33824 existing records. [2025-09-29T19:04:37.953274] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-09-29T19:04:37.959260] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:04:37.960576] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-09-29T19:04:37.960718] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-09-29T19:04:37.961168] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-09-29T19:04:37.961231] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-09-29T19:04:38.408930] [INFO ] [REMOTE ] GSL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:04:38.748131] [INFO ] [REMOTE ] GSL: Fetching primary data for 2024-12. [2025-09-29T19:04:39.162469] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-29T19:04:39.444561] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-09-29T19:04:39.548164] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-09-29T19:04:39.663965] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-29T19:04:39.741351] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-29T19:04:40.348114] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-01. [2025-09-29T19:04:41.148117] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-01. [2025-09-29T19:04:41.547209] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-29T19:04:41.948135] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-09-29T19:04:42.135903] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-29T19:04:42.450609] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-29T19:04:42.748130] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-09-29T19:04:43.338088] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-29T19:04:43.548145] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-09-29T19:04:44.348136] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-09-29T19:04:44.539998] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-29T19:04:45.148125] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-09-29T19:04:45.697418] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-29T19:04:45.768514] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-29T19:04:45.948093] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-09-29T19:04:46.748118] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-09-29T19:04:47.196632] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-29T19:04:47.453605] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-29T19:04:47.548131] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-09-29T19:04:48.020882] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-29T19:04:48.348117] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-09-29T19:04:48.600386] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-29T19:04:49.148150] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-09-29T19:04:49.948137] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-09-29T19:04:50.471080] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-29T19:04:50.748144] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-09-29T19:04:51.097683] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-29T19:04:51.413424] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-29T19:04:51.548115] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-09-29T19:04:52.348121] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-09-29T19:04:52.834022] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-29T19:04:53.006306] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-29T19:04:53.148182] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-09-29T19:04:53.950299] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-09-29T19:04:53.956373] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-29T19:04:54.748089] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-09-29T19:04:54.781845] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-29T19:04:54.973133] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-29T19:04:55.548164] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-09-29T19:04:56.348109] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-09-29T19:04:56.634228] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-29T19:04:56.965306] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-29T19:04:57.148122] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-09-29T19:04:57.535921] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-29T19:04:57.948113] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-09-29T19:04:58.748122] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-09-29T19:04:58.966707] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-29T19:04:59.406916] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-29T19:04:59.548113] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-09-29T19:05:00.348117] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-09-29T19:05:01.018706] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-09-29T19:05:01.148167] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-09-29T19:05:01.275987] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-29T19:05:01.948140] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-09-29T19:05:02.542443] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-29T19:05:02.748169] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-09-29T19:05:03.543892] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-09-29T19:05:03.554834] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-09-29T19:05:03.879274] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-29T19:05:04.358137] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-09-29T19:05:04.380590] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-29T19:05:04.988790] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-29T19:05:04.996423] [INFO ] [REMOTE ] GSL: Full fetch complete (47899 records). [2025-09-29T19:05:04.996623] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-09-29T19:05:05.153328] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-09-29T19:05:05.441044] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-09-29T19:05:05.441134] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-09-29T19:05:05.442008] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-09-29T19:05:05.442089] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-09-29T19:05:05.443256] [DEBUG] [LOCAL ] GSL: Trimmed 47899 records to 33319 (keeping 200 days of data) [2025-09-29T19:05:05.670603] [DEBUG] [LOCAL ] GSL: Primary data saved (33319 records). [2025-09-29T19:05:05.670796] [INFO ] [MAIN ] GSL: Full history saved. [2025-09-29T19:05:05.670907] [INFO ] [MAIN ] Update Progress: 975/2371 symbols completed. GSL took 28.2s. Estimated remaining: 2h 59m 2s. Rate: 7.8 symbols/min [2025-09-29T19:05:05.859699] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:05:05.913523] [DEBUG] [LOCAL ] GTES: Loaded 51399 existing records from primary storage. [2025-09-29T19:05:05.913952] [INFO ] [MAIN ] GTES: Loaded 51399 existing records. [2025-09-29T19:05:05.959967] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-09-29T19:05:06.119802] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:05:06.120169] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-09-29T19:05:06.120264] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-09-29T19:05:06.120709] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-09-29T19:05:06.120945] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-09-29T19:05:06.501439] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-29T19:05:06.542816] [INFO ] [REMOTE ] GTES: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:05:06.544152] [INFO ] [REMOTE ] GSBD: Full fetch complete (58382 records). [2025-09-29T19:05:06.544413] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-09-29T19:05:06.751256] [INFO ] [REMOTE ] GTES: Fetching primary data for 2024-12. [2025-09-29T19:05:06.986778] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-09-29T19:05:06.986885] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-09-29T19:05:06.987883] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-09-29T19:05:06.987955] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-09-29T19:05:06.989332] [DEBUG] [LOCAL ] GSBD: Trimmed 58382 records to 39044 (keeping 200 days of data) [2025-09-29T19:05:07.293596] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-29T19:05:07.293771] [DEBUG] [LOCAL ] GSBD: Primary data saved (39044 records). [2025-09-29T19:05:07.294061] [INFO ] [MAIN ] GSBD: Full history saved. [2025-09-29T19:05:07.304261] [INFO ] [MAIN ] Update Progress: 976/2371 symbols completed. GSBD took 32.5s. Estimated remaining: 2h 58m 46s. Rate: 7.8 symbols/min [2025-09-29T19:05:07.341017] [INFO ] [REMOTE ] GS: Full fetch complete (75714 records). [2025-09-29T19:05:07.374992] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-09-29T19:05:07.621390] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:05:08.011009] [DEBUG] [LOCAL ] GTLS: Loaded 43461 existing records from primary storage. [2025-09-29T19:05:08.056157] [INFO ] [MAIN ] GTLS: Loaded 43461 existing records. [2025-09-29T19:05:08.068742] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-09-29T19:05:08.068926] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-09-29T19:05:08.071281] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-09-29T19:05:08.071555] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-09-29T19:05:08.193447] [DEBUG] [LOCAL ] GS: Trimmed 75714 records to 51915 (keeping 200 days of data) [2025-09-29T19:05:08.216190] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-29T19:05:08.399231] [INFO ] [REMOTE ] GSK: Full fetch complete (77470 records). [2025-09-29T19:05:08.451504] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-09-29T19:05:08.766844] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:05:08.784031] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-09-29T19:05:08.795293] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-09-29T19:05:08.807074] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-09-29T19:05:08.824137] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-09-29T19:05:09.433678] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2024-12 (2.68 seconds). [2025-09-29T19:05:09.499786] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-09-29T19:05:09.516919] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-09-29T19:05:09.594822] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-09-29T19:05:09.593553] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-01. [2025-09-29T19:05:09.616830] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-09-29T19:05:09.707899] [DEBUG] [LOCAL ] GSK: Trimmed 77470 records to 53491 (keeping 200 days of data) [2025-09-29T19:05:09.751905] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:05:09.808072] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2024-12. [2025-09-29T19:05:10.127784] [DEBUG] [LOCAL ] GS: Primary data saved (51915 records). [2025-09-29T19:05:10.130637] [INFO ] [MAIN ] GS: Full history saved. [2025-09-29T19:05:10.131023] [INFO ] [MAIN ] Update Progress: 977/2371 symbols completed. GS took 38.9s. Estimated remaining: 2h 58m 31s. Rate: 7.8 symbols/min [2025-09-29T19:05:10.386772] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:05:10.415581] [DEBUG] [LOCAL ] GSK: Primary data saved (53491 records). [2025-09-29T19:05:10.426006] [INFO ] [MAIN ] GSK: Full history saved. [2025-09-29T19:05:10.426183] [INFO ] [MAIN ] Update Progress: 978/2371 symbols completed. GSK took 34.6s. Estimated remaining: 2h 58m 13s. Rate: 7.8 symbols/min [2025-09-29T19:05:10.557438] [DEBUG] [LOCAL ] GTN: Loaded 46301 existing records from primary storage. [2025-09-29T19:05:10.584081] [INFO ] [MAIN ] GTN: Loaded 46301 existing records. [2025-09-29T19:05:10.762539] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:05:10.856750] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:05:10.857233] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-09-29T19:05:10.857332] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-09-29T19:05:10.865906] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-09-29T19:05:10.866045] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-09-29T19:05:10.989678] [DEBUG] [LOCAL ] GTY: Loaded 30796 existing records from primary storage. [2025-09-29T19:05:11.005820] [INFO ] [MAIN ] GTY: Loaded 30796 existing records. [2025-09-29T19:05:11.427194] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:05:11.468683] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-09-29T19:05:11.471732] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-09-29T19:05:11.492548] [INFO ] [REMOTE ] GTN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:05:11.492904] [INFO ] [REMOTE ] GTN: Fetching primary data for 2024-12. [2025-09-29T19:05:11.493503] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-09-29T19:05:11.494307] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-09-29T19:05:11.637672] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-29T19:05:11.746702] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-09-29T19:05:11.805535] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-29T19:05:11.859671] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-01. [2025-09-29T19:05:12.014805] [INFO ] [REMOTE ] GTY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:05:12.015141] [INFO ] [REMOTE ] GTY: Fetching primary data for 2024-12. [2025-09-29T19:05:13.243393] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-29T19:05:13.252957] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-09-29T19:05:13.305021] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-29T19:05:13.307007] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-29T19:05:13.323815] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-01. [2025-09-29T19:05:13.424618] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-29T19:05:13.948116] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-09-29T19:05:14.668764] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-29T19:05:14.739132] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-29T19:05:14.748063] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-09-29T19:05:15.236249] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-29T19:05:15.548153] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-09-29T19:05:16.345788] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-29T19:05:16.354578] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-01. [2025-09-29T19:05:17.148125] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-09-29T19:05:17.224254] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-29T19:05:17.336764] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-29T19:05:17.948132] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-09-29T19:05:18.748133] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-09-29T19:05:18.836007] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-29T19:05:19.548148] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-09-29T19:05:19.665116] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-29T19:05:20.005762] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-29T19:05:20.348111] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-09-29T19:05:20.953618] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-29T19:05:21.148114] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-09-29T19:05:21.850750] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-29T19:05:21.948113] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-09-29T19:05:22.733854] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-29T19:05:22.748070] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-09-29T19:05:23.346845] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-29T19:05:23.548126] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-09-29T19:05:24.331292] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-29T19:05:24.348076] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-09-29T19:05:25.148150] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-09-29T19:05:25.226811] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-29T19:05:25.948087] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-09-29T19:05:26.119637] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-29T19:05:26.748139] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-09-29T19:05:26.871863] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-29T19:05:27.009039] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-29T19:05:27.548105] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-09-29T19:05:27.929593] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-29T19:05:28.348117] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-09-29T19:05:28.841394] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-29T19:05:29.148166] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-09-29T19:05:29.950715] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-09-29T19:05:29.953413] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-29T19:05:30.371167] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-29T19:05:30.748154] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-09-29T19:05:31.550340] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-09-29T19:05:31.566024] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-29T19:05:32.099506] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-29T19:05:32.348144] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-09-29T19:05:33.148108] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-09-29T19:05:33.322016] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-29T19:05:33.331318] [INFO ] [REMOTE ] GTLS: Full fetch complete (61336 records). [2025-09-29T19:05:33.331449] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-09-29T19:05:33.756513] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-29T19:05:33.783881] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-09-29T19:05:33.784229] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-09-29T19:05:33.785361] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-09-29T19:05:33.785468] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-09-29T19:05:33.787809] [DEBUG] [LOCAL ] GTLS: Trimmed 61336 records to 42738 (keeping 200 days of data) [2025-09-29T19:05:33.976793] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-09-29T19:05:34.071959] [DEBUG] [LOCAL ] GTLS: Primary data saved (42738 records). [2025-09-29T19:05:34.072118] [INFO ] [MAIN ] GTLS: Full history saved. [2025-09-29T19:05:34.072225] [INFO ] [MAIN ] Update Progress: 979/2371 symbols completed. GTLS took 26.8s. Estimated remaining: 2h 58m 28s. Rate: 7.8 symbols/min [2025-09-29T19:05:34.250014] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:05:34.264250] [DEBUG] [LOCAL ] GUG: Loaded 12138 existing records from primary storage. [2025-09-29T19:05:34.264517] [INFO ] [MAIN ] GUG: Loaded 12138 existing records. [2025-09-29T19:05:34.453048] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:05:34.453305] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-09-29T19:05:34.453361] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-09-29T19:05:34.453612] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-09-29T19:05:34.453703] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-09-29T19:05:34.753553] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-09-29T19:05:34.854918] [INFO ] [REMOTE ] GUG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:05:34.889835] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-29T19:05:35.548130] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-09-29T19:05:35.641609] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-29T19:05:36.348154] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-09-29T19:05:36.375255] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-29T19:05:36.381541] [INFO ] [REMOTE ] GTY: Full fetch complete (43419 records). [2025-09-29T19:05:36.381684] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-09-29T19:05:36.778608] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-09-29T19:05:36.778732] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-09-29T19:05:36.779660] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-09-29T19:05:36.779731] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-09-29T19:05:36.780973] [DEBUG] [LOCAL ] GTY: Trimmed 43419 records to 30315 (keeping 200 days of data) [2025-09-29T19:05:36.989945] [DEBUG] [LOCAL ] GTY: Primary data saved (30315 records). [2025-09-29T19:05:36.990105] [INFO ] [MAIN ] GTY: Full history saved. [2025-09-29T19:05:36.990196] [INFO ] [MAIN ] Update Progress: 980/2371 symbols completed. GTY took 26.6s. Estimated remaining: 2h 58m 14s. Rate: 7.8 symbols/min [2025-09-29T19:05:37.158181] [INFO ] [REMOTE ] GUG: Fetching primary data for 2024-12. [2025-09-29T19:05:37.196940] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:05:37.229633] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-29T19:05:37.253999] [DEBUG] [LOCAL ] GUT: Loaded 15560 existing records from primary storage. [2025-09-29T19:05:37.254278] [INFO ] [MAIN ] GUT: Loaded 15560 existing records. [2025-09-29T19:05:37.448379] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:05:37.448629] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-09-29T19:05:37.448721] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-09-29T19:05:37.448997] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-09-29T19:05:37.449058] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-09-29T19:05:37.849954] [INFO ] [REMOTE ] GUT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:05:37.949443] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-09-29T19:05:37.952726] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-29T19:05:38.267187] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-29T19:05:38.748166] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-09-29T19:05:39.548127] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-01. [2025-09-29T19:05:39.825692] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-29T19:05:39.836876] [INFO ] [REMOTE ] GTES: Full fetch complete (73933 records). [2025-09-29T19:05:39.837020] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-09-29T19:05:40.267163] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-09-29T19:05:40.267340] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-09-29T19:05:40.268490] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-09-29T19:05:40.268562] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-09-29T19:05:40.270253] [DEBUG] [LOCAL ] GTES: Trimmed 73933 records to 50587 (keeping 200 days of data) [2025-09-29T19:05:40.357314] [INFO ] [REMOTE ] GUT: Fetching primary data for 2024-12. [2025-09-29T19:05:40.601806] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-29T19:05:40.628077] [INFO ] [REMOTE ] GTN: Full fetch complete (66426 records). [2025-09-29T19:05:40.627961] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-29T19:05:40.634717] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-09-29T19:05:40.753110] [DEBUG] [LOCAL ] GTES: Primary data saved (50587 records). [2025-09-29T19:05:40.753330] [INFO ] [MAIN ] GTES: Full history saved. [2025-09-29T19:05:40.753733] [INFO ] [MAIN ] Update Progress: 981/2371 symbols completed. GTES took 35.1s. Estimated remaining: 2h 58m 1s. Rate: 7.8 symbols/min [2025-09-29T19:05:41.165082] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:05:41.160965] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-09-29T19:05:41.274021] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-09-29T19:05:41.274394] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-09-29T19:05:41.275524] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-09-29T19:05:41.275621] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-09-29T19:05:41.277316] [DEBUG] [LOCAL ] GTN: Trimmed 66426 records to 45555 (keeping 200 days of data) [2025-09-29T19:05:41.404315] [DEBUG] [LOCAL ] GVA: Loaded 34030 existing records from primary storage. [2025-09-29T19:05:41.405522] [INFO ] [MAIN ] GVA: Loaded 34030 existing records. [2025-09-29T19:05:41.525168] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-29T19:05:41.627748] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:05:41.628781] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-09-29T19:05:41.629186] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-09-29T19:05:41.630166] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-09-29T19:05:41.630488] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-09-29T19:05:41.951803] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-01. [2025-09-29T19:05:42.088164] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-29T19:05:42.152876] [INFO ] [REMOTE ] GVA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:05:42.213416] [DEBUG] [LOCAL ] GTN: Primary data saved (45555 records). [2025-09-29T19:05:42.216851] [INFO ] [MAIN ] GTN: Full history saved. [2025-09-29T19:05:42.216998] [INFO ] [MAIN ] Update Progress: 982/2371 symbols completed. GTN took 32.1s. Estimated remaining: 2h 57m 44s. Rate: 7.8 symbols/min [2025-09-29T19:05:42.398417] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:05:42.416791] [DEBUG] [LOCAL ] GWH: Loaded 15825 existing records from primary storage. [2025-09-29T19:05:42.417054] [INFO ] [MAIN ] GWH: Loaded 15825 existing records. [2025-09-29T19:05:42.607474] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:05:42.607831] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-09-29T19:05:42.607893] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-09-29T19:05:42.608127] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-09-29T19:05:42.608194] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-09-29T19:05:42.755439] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-09-29T19:05:42.997140] [INFO ] [REMOTE ] GWH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:05:43.107346] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-29T19:05:43.548137] [INFO ] [REMOTE ] GWH: Fetching primary data for 2024-12. [2025-09-29T19:05:43.671732] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-29T19:05:44.348124] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-09-29T19:05:44.458820] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-29T19:05:45.148112] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-09-29T19:05:45.275020] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-29T19:05:45.935109] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-29T19:05:45.948073] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-09-29T19:05:46.748145] [INFO ] [REMOTE ] GVA: Fetching primary data for 2024-12. [2025-09-29T19:05:46.799493] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-29T19:05:47.548116] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-09-29T19:05:48.108276] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-29T19:05:48.348152] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-09-29T19:05:48.485978] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-29T19:05:49.148098] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-01. [2025-09-29T19:05:49.295018] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-29T19:05:49.948149] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-09-29T19:05:50.553626] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-29T19:05:50.708199] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-29T19:05:50.748111] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-09-29T19:05:51.548074] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-09-29T19:05:51.626854] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-29T19:05:52.348147] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-09-29T19:05:52.407469] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-29T19:05:53.148081] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-09-29T19:05:53.299359] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-29T19:05:53.948150] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-09-29T19:05:54.504631] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-29T19:05:54.748103] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-09-29T19:05:54.983783] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-29T19:05:55.445228] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-29T19:05:55.548143] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-09-29T19:05:56.348129] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-09-29T19:05:56.493975] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-29T19:05:57.148134] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-09-29T19:05:57.918532] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-29T19:05:57.948126] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-09-29T19:05:58.204687] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-29T19:05:58.748113] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-09-29T19:05:59.532633] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-29T19:05:59.548064] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-09-29T19:05:59.755577] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-29T19:06:00.348184] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-09-29T19:06:01.150162] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-09-29T19:06:01.155068] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-29T19:06:01.208740] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-29T19:06:01.948136] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-09-29T19:06:02.151587] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-29T19:06:02.748085] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-09-29T19:06:02.982584] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-29T19:06:03.483535] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-29T19:06:03.486799] [INFO ] [REMOTE ] GUG: Full fetch complete (19881 records). [2025-09-29T19:06:03.486890] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-09-29T19:06:03.553435] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-09-29T19:06:03.892511] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-09-29T19:06:03.892632] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-09-29T19:06:03.893094] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-09-29T19:06:03.893140] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-09-29T19:06:03.893843] [DEBUG] [LOCAL ] GUG: Trimmed 19881 records to 12025 (keeping 200 days of data) [2025-09-29T19:06:03.972885] [DEBUG] [LOCAL ] GUG: Primary data saved (12025 records). [2025-09-29T19:06:03.973037] [INFO ] [MAIN ] GUG: Full history saved. [2025-09-29T19:06:03.973124] [INFO ] [MAIN ] Update Progress: 983/2371 symbols completed. GUG took 29.9s. Estimated remaining: 2h 57m 56s. Rate: 7.8 symbols/min [2025-09-29T19:06:04.151669] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:06:04.195257] [DEBUG] [LOCAL ] GWRE: Loaded 41564 existing records from primary storage. [2025-09-29T19:06:04.195613] [INFO ] [MAIN ] GWRE: Loaded 41564 existing records. [2025-09-29T19:06:04.359518] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-09-29T19:06:04.408547] [WARN ] [MAIN ] GWRE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:06:04.408901] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-09-29T19:06:04.408989] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-09-29T19:06:04.409619] [DEBUG] [LOCAL ] GWRE: Deleted primary data file. [2025-09-29T19:06:04.409730] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-09-29T19:06:04.803742] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:06:04.817546] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-29T19:06:05.148112] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2024-12. [2025-09-29T19:06:05.469124] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-29T19:06:05.472946] [INFO ] [REMOTE ] GUT: Full fetch complete (22859 records). [2025-09-29T19:06:05.473077] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-09-29T19:06:05.871777] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-09-29T19:06:05.871858] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-09-29T19:06:05.872331] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-09-29T19:06:05.872371] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-09-29T19:06:05.873165] [DEBUG] [LOCAL ] GUT: Trimmed 22859 records to 15315 (keeping 200 days of data) [2025-09-29T19:06:05.948229] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-09-29T19:06:05.970169] [DEBUG] [LOCAL ] GUT: Primary data saved (15315 records). [2025-09-29T19:06:05.970335] [INFO ] [MAIN ] GUT: Full history saved. [2025-09-29T19:06:05.970434] [INFO ] [MAIN ] Update Progress: 984/2371 symbols completed. GUT took 29.0s. Estimated remaining: 2h 57m 41s. Rate: 7.8 symbols/min [2025-09-29T19:06:06.155132] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:06:06.184883] [DEBUG] [LOCAL ] GWW: Loaded 20108 existing records from primary storage. [2025-09-29T19:06:06.185165] [INFO ] [MAIN ] GWW: Loaded 20108 existing records. [2025-09-29T19:06:06.383304] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:06:06.383527] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-09-29T19:06:06.383575] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-09-29T19:06:06.384064] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-09-29T19:06:06.384127] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-09-29T19:06:06.751158] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-09-29T19:06:06.792536] [INFO ] [REMOTE ] GWW: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:06:06.932111] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-29T19:06:07.297495] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-29T19:06:07.548100] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-09-29T19:06:07.715220] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-29T19:06:08.348118] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-09-29T19:06:09.148134] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-09-29T19:06:09.355193] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-29T19:06:09.360831] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-29T19:06:09.948124] [INFO ] [REMOTE ] GWW: Fetching primary data for 2024-12. [2025-09-29T19:06:10.483341] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-29T19:06:10.748116] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-09-29T19:06:10.998840] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-29T19:06:11.548121] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-09-29T19:06:12.183919] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-29T19:06:12.188181] [INFO ] [REMOTE ] GWH: Full fetch complete (21047 records). [2025-09-29T19:06:12.188339] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-09-29T19:06:12.353226] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-01. [2025-09-29T19:06:12.581998] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-09-29T19:06:12.582084] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-09-29T19:06:12.582589] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-09-29T19:06:12.582634] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-09-29T19:06:12.583348] [DEBUG] [LOCAL ] GWH: Trimmed 21047 records to 15818 (keeping 200 days of data) [2025-09-29T19:06:12.681006] [DEBUG] [LOCAL ] GWH: Primary data saved (15818 records). [2025-09-29T19:06:12.681147] [INFO ] [MAIN ] GWH: Full history saved. [2025-09-29T19:06:12.681248] [INFO ] [MAIN ] Update Progress: 985/2371 symbols completed. GWH took 30.5s. Estimated remaining: 2h 57m 31s. Rate: 7.8 symbols/min [2025-09-29T19:06:12.870212] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:06:12.936399] [DEBUG] [LOCAL ] GXO: Loaded 48260 existing records from primary storage. [2025-09-29T19:06:12.936766] [INFO ] [MAIN ] GXO: Loaded 48260 existing records. [2025-09-29T19:06:13.130738] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-29T19:06:13.162682] [WARN ] [MAIN ] GXO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:06:13.148725] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-09-29T19:06:13.163229] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-09-29T19:06:13.163335] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-09-29T19:06:13.165191] [DEBUG] [LOCAL ] GXO: Deleted primary data file. [2025-09-29T19:06:13.165262] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-09-29T19:06:13.550103] [INFO ] [REMOTE ] GXO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:06:13.574998] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-29T19:06:13.948122] [INFO ] [REMOTE ] GXO: Fetching primary data for 2024-12. [2025-09-29T19:06:14.748099] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-09-29T19:06:14.827183] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-29T19:06:15.548155] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-09-29T19:06:15.606233] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-29T19:06:15.772515] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-29T19:06:16.348124] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-01. [2025-09-29T19:06:17.021048] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-29T19:06:17.148109] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-09-29T19:06:17.607689] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-29T19:06:17.948123] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-09-29T19:06:18.595439] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-29T19:06:18.602083] [INFO ] [REMOTE ] GVA: Full fetch complete (48648 records). [2025-09-29T19:06:18.602224] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-09-29T19:06:18.753185] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-09-29T19:06:19.042853] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-09-29T19:06:19.042953] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-09-29T19:06:19.043934] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-09-29T19:06:19.044188] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-09-29T19:06:19.045468] [DEBUG] [LOCAL ] GVA: Trimmed 48648 records to 33227 (keeping 200 days of data) [2025-09-29T19:06:19.177670] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-29T19:06:19.281733] [DEBUG] [LOCAL ] GVA: Primary data saved (33227 records). [2025-09-29T19:06:19.281881] [INFO ] [MAIN ] GVA: Full history saved. [2025-09-29T19:06:19.281967] [INFO ] [MAIN ] Update Progress: 986/2371 symbols completed. GVA took 38.5s. Estimated remaining: 2h 57m 22s. Rate: 7.8 symbols/min [2025-09-29T19:06:19.454907] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:06:19.458810] [DEBUG] [LOCAL ] GYLD: Loaded 1569 existing records from primary storage. [2025-09-29T19:06:19.458961] [INFO ] [MAIN ] GYLD: Loaded 1569 existing records. [2025-09-29T19:06:19.558164] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-09-29T19:06:19.654583] [WARN ] [MAIN ] GYLD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:06:19.654850] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-09-29T19:06:19.654904] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-09-29T19:06:19.655106] [DEBUG] [LOCAL ] GYLD: Deleted primary data file. [2025-09-29T19:06:19.655166] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-09-29T19:06:20.053218] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:06:20.167818] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-29T19:06:20.348108] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-09-29T19:06:20.430415] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-29T19:06:21.148137] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2024-12. [2025-09-29T19:06:21.505599] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-29T19:06:21.948091] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-09-29T19:06:22.146518] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-29T19:06:22.748126] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-01. [2025-09-29T19:06:23.113370] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-09-29T19:06:23.370292] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-29T19:06:23.548102] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-09-29T19:06:23.908211] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-29T19:06:24.348138] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-09-29T19:06:25.148109] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-09-29T19:06:25.390332] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-29T19:06:25.948113] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-09-29T19:06:26.748103] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-09-29T19:06:26.831877] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-29T19:06:26.979779] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-29T19:06:27.314749] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-29T19:06:27.548146] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-09-29T19:06:28.022114] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-29T19:06:28.348138] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-09-29T19:06:28.702006] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-29T19:06:29.148185] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-09-29T19:06:29.948106] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-09-29T19:06:30.291293] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-29T19:06:30.748161] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-09-29T19:06:31.548134] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-09-29T19:06:31.601793] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-29T19:06:31.977071] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-29T19:06:32.255773] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-29T19:06:32.348106] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-09-29T19:06:33.148179] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-09-29T19:06:33.590502] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-29T19:06:33.868915] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-29T19:06:33.948108] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-09-29T19:06:34.748128] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-09-29T19:06:35.186948] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-29T19:06:35.548127] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-09-29T19:06:35.619977] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-29T19:06:36.348128] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-09-29T19:06:37.125166] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-29T19:06:37.148075] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-09-29T19:06:37.948096] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-09-29T19:06:38.045272] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-29T19:06:38.697615] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-29T19:06:38.748083] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-09-29T19:06:39.318358] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-29T19:06:39.548141] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-09-29T19:06:40.179295] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-29T19:06:40.348123] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-09-29T19:06:41.148131] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-09-29T19:06:41.559371] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-29T19:06:41.569732] [INFO ] [REMOTE ] GXO: Full fetch complete (70021 records). [2025-09-29T19:06:41.569882] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-09-29T19:06:41.736485] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-29T19:06:41.762581] [INFO ] [REMOTE ] GWW: Full fetch complete (29272 records). [2025-09-29T19:06:41.800626] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-09-29T19:06:41.957844] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-09-29T19:06:42.242859] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-09-29T19:06:42.294221] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-09-29T19:06:42.309831] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-09-29T19:06:42.320694] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-09-29T19:06:42.383454] [DEBUG] [LOCAL ] GXO: Trimmed 70021 records to 47499 (keeping 200 days of data) [2025-09-29T19:06:42.492539] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-09-29T19:06:42.518989] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-09-29T19:06:42.519769] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-09-29T19:06:42.520134] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-09-29T19:06:42.523830] [DEBUG] [LOCAL ] GWW: Trimmed 29272 records to 19542 (keeping 200 days of data) [2025-09-29T19:06:42.602334] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-29T19:06:42.629261] [INFO ] [REMOTE ] GYLD: Full fetch complete (2060 records). [2025-09-29T19:06:42.631430] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-09-29T19:06:42.988254] [DEBUG] [LOCAL ] GWW: Primary data saved (19542 records). [2025-09-29T19:06:42.988548] [INFO ] [MAIN ] GWW: Full history saved. [2025-09-29T19:06:43.013948] [INFO ] [MAIN ] Update Progress: 987/2371 symbols completed. GWW took 37.0s. Estimated remaining: 2h 57m 37s. Rate: 7.8 symbols/min [2025-09-29T19:06:43.422293] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-09-29T19:06:43.406160] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-29T19:06:43.445363] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-09-29T19:06:43.444582] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:06:43.454776] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-09-29T19:06:43.455701] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-09-29T19:06:43.457475] [INFO ] [REMOTE ] GWRE: Full fetch complete (61201 records). [2025-09-29T19:06:43.458685] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-09-29T19:06:43.458193] [DEBUG] [LOCAL ] GYLD: Trimmed 2060 records to 1537 (keeping 200 days of data) [2025-09-29T19:06:43.511193] [DEBUG] [LOCAL ] GYLD: Primary data saved (1537 records). [2025-09-29T19:06:43.511472] [INFO ] [MAIN ] GYLD: Full history saved. [2025-09-29T19:06:43.517787] [INFO ] [MAIN ] Update Progress: 988/2371 symbols completed. GYLD took 24.2s. Estimated remaining: 2h 57m 19s. Rate: 7.8 symbols/min [2025-09-29T19:06:43.967336] [DEBUG] [LOCAL ] H: Loaded 45492 existing records from primary storage. [2025-09-29T19:06:43.969788] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:06:43.983263] [INFO ] [MAIN ] H: Loaded 45492 existing records. [2025-09-29T19:06:44.381134] [WARN ] [MAIN ] H: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:06:44.395249] [DEBUG] [LOCAL ] HAE: Loaded 40176 existing records from primary storage. [2025-09-29T19:06:44.405278] [INFO ] [MAIN ] HAE: Loaded 40176 existing records. [2025-09-29T19:06:44.405096] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-09-29T19:06:44.412489] [DEBUG] [LOCAL ] GXO: Primary data saved (47499 records). [2025-09-29T19:06:44.473277] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-09-29T19:06:44.502457] [INFO ] [MAIN ] GXO: Full history saved. [2025-09-29T19:06:44.532719] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-09-29T19:06:44.543267] [INFO ] [MAIN ] Update Progress: 989/2371 symbols completed. GXO took 31.9s. Estimated remaining: 2h 57m 2s. Rate: 7.8 symbols/min [2025-09-29T19:06:44.537999] [DEBUG] [LOCAL ] H: Deleted primary data file. [2025-09-29T19:06:44.548588] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-09-29T19:06:44.549956] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-09-29T19:06:44.548820] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-09-29T19:06:44.560706] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-09-29T19:06:44.806036] [DEBUG] [LOCAL ] GWRE: Trimmed 61201 records to 40718 (keeping 200 days of data) [2025-09-29T19:06:45.058846] [WARN ] [MAIN ] HAE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:06:45.123204] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-09-29T19:06:45.123020] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:06:45.142942] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-09-29T19:06:45.189102] [DEBUG] [LOCAL ] HAE: Deleted primary data file. [2025-09-29T19:06:45.215996] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-09-29T19:06:45.460097] [INFO ] [REMOTE ] H: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:06:45.466836] [INFO ] [REMOTE ] H: Fetching primary data for 2024-12. [2025-09-29T19:06:45.606401] [DEBUG] [LOCAL ] HAFN: Loaded 44189 existing records from primary storage. [2025-09-29T19:06:45.621453] [INFO ] [MAIN ] HAFN: Loaded 44189 existing records. [2025-09-29T19:06:45.942423] [INFO ] [REMOTE ] HAE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:06:45.991077] [INFO ] [REMOTE ] HAE: Fetching primary data for 2024-12. [2025-09-29T19:06:45.990787] [WARN ] [MAIN ] HAFN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:06:45.993834] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-09-29T19:06:45.996865] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-09-29T19:06:45.999117] [DEBUG] [LOCAL ] HAFN: Deleted primary data file. [2025-09-29T19:06:46.002301] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-09-29T19:06:46.445531] [DEBUG] [LOCAL ] GWRE: Primary data saved (40718 records). [2025-09-29T19:06:46.456200] [INFO ] [MAIN ] GWRE: Full history saved. [2025-09-29T19:06:46.461458] [INFO ] [MAIN ] Update Progress: 990/2371 symbols completed. GWRE took 42.5s. Estimated remaining: 2h 56m 47s. Rate: 7.8 symbols/min [2025-09-29T19:06:46.660617] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:06:46.694205] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2024-12. [2025-09-29T19:06:46.722961] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:06:46.786833] [DEBUG] [LOCAL ] HAL: Loaded 54498 existing records from primary storage. [2025-09-29T19:06:46.787194] [INFO ] [MAIN ] HAL: Loaded 54498 existing records. [2025-09-29T19:06:46.979160] [WARN ] [MAIN ] HAL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:06:46.979537] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-09-29T19:06:46.979703] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-09-29T19:06:46.980630] [DEBUG] [LOCAL ] HAL: Deleted primary data file. [2025-09-29T19:06:46.980721] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-09-29T19:06:47.107737] [INFO ] [REMOTE ] H: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-29T19:06:47.131383] [INFO ] [REMOTE ] H: Fetching primary data for 2025-01. [2025-09-29T19:06:47.391743] [INFO ] [REMOTE ] HAL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:06:47.392110] [INFO ] [REMOTE ] HAL: Fetching primary data for 2024-12. [2025-09-29T19:06:47.522030] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-29T19:06:47.529778] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-01. [2025-09-29T19:06:48.461277] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-29T19:06:48.472203] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-01. [2025-09-29T19:06:48.590128] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-29T19:06:48.602184] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-09-29T19:06:50.152761] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-29T19:06:50.161926] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-09-29T19:06:50.223230] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-29T19:06:50.233902] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-09-29T19:06:50.316322] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-01 (2.79 seconds). [2025-09-29T19:06:50.420881] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2024-12 (3.03 seconds). [2025-09-29T19:06:50.748176] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-09-29T19:06:51.548137] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-01. [2025-09-29T19:06:51.651122] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-29T19:06:52.350051] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-09-29T19:06:52.356482] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-29T19:06:52.408072] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-29T19:06:53.148190] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-09-29T19:06:53.403473] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-29T19:06:53.948120] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-09-29T19:06:54.082388] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-29T19:06:54.748140] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-09-29T19:06:54.872728] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-29T19:06:55.548156] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-09-29T19:06:55.628093] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-29T19:06:56.348133] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-09-29T19:06:56.541120] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-29T19:06:57.073983] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-29T19:06:57.148094] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-09-29T19:06:57.958695] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-09-29T19:06:57.984593] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-29T19:06:58.637970] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-29T19:06:58.748164] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-09-29T19:06:59.548110] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-09-29T19:06:59.897029] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-29T19:07:00.208225] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-29T19:07:00.348131] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-09-29T19:07:01.026258] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-29T19:07:01.148135] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-09-29T19:07:01.948184] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-09-29T19:07:02.364089] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-29T19:07:02.748155] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-09-29T19:07:02.808107] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-29T19:07:03.465222] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-29T19:07:03.548121] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-09-29T19:07:04.348121] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-09-29T19:07:04.765390] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-29T19:07:04.839102] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-29T19:07:05.148118] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-09-29T19:07:05.948136] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-09-29T19:07:06.157424] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-29T19:07:06.748109] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-09-29T19:07:06.802461] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-29T19:07:06.812489] [INFO ] [REMOTE ] HAE: Full fetch complete (58098 records). [2025-09-29T19:07:06.812607] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-09-29T19:07:07.237217] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present. [2025-09-29T19:07:07.237313] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed. [2025-09-29T19:07:07.238293] [INFO ] [MAIN ] HAE: Fetched primary data is valid. [2025-09-29T19:07:07.238360] [DEBUG] [LOCAL ] HAE: Saving primary data. [2025-09-29T19:07:07.239615] [DEBUG] [LOCAL ] HAE: Trimmed 58098 records to 39432 (keeping 200 days of data) [2025-09-29T19:07:07.488119] [DEBUG] [LOCAL ] HAE: Primary data saved (39432 records). [2025-09-29T19:07:07.488498] [INFO ] [MAIN ] HAE: Full history saved. [2025-09-29T19:07:07.488606] [INFO ] [MAIN ] Update Progress: 991/2371 symbols completed. HAE took 24.0s. Estimated remaining: 2h 56m 57s. Rate: 7.8 symbols/min [2025-09-29T19:07:07.551306] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-09-29T19:07:07.699629] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:07:07.725505] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-29T19:07:07.787017] [DEBUG] [LOCAL ] HASI: Loaded 47868 existing records from primary storage. [2025-09-29T19:07:07.787382] [INFO ] [MAIN ] HASI: Loaded 47868 existing records. [2025-09-29T19:07:07.976916] [WARN ] [MAIN ] HASI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:07:07.977202] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-09-29T19:07:07.977258] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-09-29T19:07:07.977740] [DEBUG] [LOCAL ] HASI: Deleted primary data file. [2025-09-29T19:07:07.977815] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-09-29T19:07:08.366594] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-09-29T19:07:08.372571] [INFO ] [REMOTE ] HASI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:07:08.572116] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-29T19:07:09.148104] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-09-29T19:07:09.616153] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-29T19:07:09.883305] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-29T19:07:09.948147] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-09-29T19:07:10.748152] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-09-29T19:07:10.907913] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-29T19:07:10.916852] [INFO ] [REMOTE ] H: Full fetch complete (61947 records). [2025-09-29T19:07:10.916974] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-09-29T19:07:11.317600] [DEBUG] [VALIDATOR ] H: All expected trading days are present. [2025-09-29T19:07:11.317713] [DEBUG] [VALIDATOR ] H: Primary data validation passed. [2025-09-29T19:07:11.318736] [INFO ] [MAIN ] H: Fetched primary data is valid. [2025-09-29T19:07:11.318802] [DEBUG] [LOCAL ] H: Saving primary data. [2025-09-29T19:07:11.320097] [DEBUG] [LOCAL ] H: Trimmed 61947 records to 44703 (keeping 200 days of data) [2025-09-29T19:07:11.553311] [INFO ] [REMOTE ] HASI: Fetching primary data for 2024-12. [2025-09-29T19:07:11.646059] [DEBUG] [LOCAL ] H: Primary data saved (44703 records). [2025-09-29T19:07:11.646219] [INFO ] [MAIN ] H: Full history saved. [2025-09-29T19:07:11.646354] [INFO ] [MAIN ] Update Progress: 992/2371 symbols completed. H took 28.6s. Estimated remaining: 2h 56m 45s. Rate: 7.8 symbols/min [2025-09-29T19:07:11.836490] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:07:11.920757] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-29T19:07:11.934152] [DEBUG] [LOCAL ] HAYW: Loaded 49444 existing records from primary storage. [2025-09-29T19:07:11.935607] [INFO ] [MAIN ] HAYW: Loaded 49444 existing records. [2025-09-29T19:07:12.125274] [WARN ] [MAIN ] HAYW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:07:12.125597] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-09-29T19:07:12.125741] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-09-29T19:07:12.134259] [DEBUG] [LOCAL ] HAYW: Deleted primary data file. [2025-09-29T19:07:12.147116] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-09-29T19:07:12.221470] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-29T19:07:12.356523] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-09-29T19:07:12.568888] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:07:13.148128] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-09-29T19:07:13.224618] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-29T19:07:13.948066] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-01. [2025-09-29T19:07:14.468580] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-29T19:07:14.748174] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2024-12. [2025-09-29T19:07:14.861474] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-29T19:07:14.870425] [INFO ] [REMOTE ] HAFN: Full fetch complete (65735 records). [2025-09-29T19:07:14.870586] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-09-29T19:07:15.281114] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-09-29T19:07:15.281203] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-09-29T19:07:15.282169] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-09-29T19:07:15.282238] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-09-29T19:07:15.283603] [DEBUG] [LOCAL ] HAFN: Trimmed 65735 records to 43393 (keeping 200 days of data) [2025-09-29T19:07:15.547774] [DEBUG] [LOCAL ] HAFN: Primary data saved (43393 records). [2025-09-29T19:07:15.547912] [INFO ] [MAIN ] HAFN: Full history saved. [2025-09-29T19:07:15.547999] [INFO ] [MAIN ] Update Progress: 993/2371 symbols completed. HAFN took 31.0s. Estimated remaining: 2h 56m 32s. Rate: 7.8 symbols/min [2025-09-29T19:07:15.548183] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-09-29T19:07:15.767932] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:07:15.770378] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-29T19:07:15.788156] [DEBUG] [LOCAL ] HBB: Loaded 6912 existing records from primary storage. [2025-09-29T19:07:15.788388] [INFO ] [MAIN ] HBB: Loaded 6912 existing records. [2025-09-29T19:07:15.990831] [WARN ] [MAIN ] HBB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:07:15.991285] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-09-29T19:07:15.991393] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-09-29T19:07:15.991832] [DEBUG] [LOCAL ] HBB: Deleted primary data file. [2025-09-29T19:07:15.992017] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-09-29T19:07:16.339950] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-29T19:07:16.350884] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-09-29T19:07:16.440119] [INFO ] [REMOTE ] HBB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:07:17.148133] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-01. [2025-09-29T19:07:17.504516] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-29T19:07:17.948163] [INFO ] [REMOTE ] HBB: Fetching primary data for 2024-12. [2025-09-29T19:07:18.033592] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-29T19:07:18.678833] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-29T19:07:18.737086] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-29T19:07:18.748072] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-01. [2025-09-29T19:07:19.451824] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-29T19:07:19.548103] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-09-29T19:07:20.348131] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-09-29T19:07:21.148121] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-09-29T19:07:21.814570] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-29T19:07:21.860545] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-29T19:07:21.874813] [INFO ] [REMOTE ] HAL: Full fetch complete (77766 records). [2025-09-29T19:07:21.875036] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-09-29T19:07:21.953210] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-09-29T19:07:22.284463] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-09-29T19:07:22.284573] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-09-29T19:07:22.285792] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-09-29T19:07:22.285883] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-09-29T19:07:22.288583] [DEBUG] [LOCAL ] HAL: Trimmed 77766 records to 53718 (keeping 200 days of data) [2025-09-29T19:07:22.630921] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-29T19:07:22.657702] [DEBUG] [LOCAL ] HAL: Primary data saved (53718 records). [2025-09-29T19:07:22.657910] [INFO ] [MAIN ] HAL: Full history saved. [2025-09-29T19:07:22.658203] [INFO ] [MAIN ] Update Progress: 994/2371 symbols completed. HAL took 36.2s. Estimated remaining: 2h 56m 23s. Rate: 7.8 symbols/min [2025-09-29T19:07:22.753637] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-09-29T19:07:22.871895] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-29T19:07:22.876685] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:07:22.945906] [DEBUG] [LOCAL ] HBI: Loaded 53769 existing records from primary storage. [2025-09-29T19:07:22.946272] [INFO ] [MAIN ] HBI: Loaded 53769 existing records. [2025-09-29T19:07:23.131274] [WARN ] [MAIN ] HBI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:07:23.131539] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-09-29T19:07:23.131589] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-09-29T19:07:23.132319] [DEBUG] [LOCAL ] HBI: Deleted primary data file. [2025-09-29T19:07:23.132448] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-09-29T19:07:23.435310] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-29T19:07:23.570335] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-09-29T19:07:23.575583] [INFO ] [REMOTE ] HBI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:07:24.348101] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-09-29T19:07:24.483183] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-29T19:07:25.148117] [INFO ] [REMOTE ] HBI: Fetching primary data for 2024-12. [2025-09-29T19:07:25.948094] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-09-29T19:07:26.069775] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-29T19:07:26.748115] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-09-29T19:07:26.763065] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-29T19:07:26.866908] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-29T19:07:27.548129] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-09-29T19:07:28.308461] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-29T19:07:28.348087] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-09-29T19:07:28.484724] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-29T19:07:29.148128] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-09-29T19:07:29.953227] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-01. [2025-09-29T19:07:29.967635] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-29T19:07:30.748085] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-09-29T19:07:30.929750] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-29T19:07:31.235837] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-29T19:07:31.548114] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-09-29T19:07:31.731934] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-29T19:07:32.348099] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-09-29T19:07:33.148078] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-09-29T19:07:33.183773] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-29T19:07:33.948203] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-09-29T19:07:34.025182] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-29T19:07:34.748174] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-09-29T19:07:34.796692] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-29T19:07:35.071056] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-29T19:07:35.486621] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-29T19:07:35.548170] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-09-29T19:07:36.348129] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-09-29T19:07:37.054181] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-29T19:07:37.056393] [INFO ] [REMOTE ] HBB: Full fetch complete (9747 records). [2025-09-29T19:07:37.056627] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-09-29T19:07:37.159953] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-09-29T19:07:37.508268] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-29T19:07:37.517914] [DEBUG] [VALIDATOR ] HBB: All expected trading days are present. [2025-09-29T19:07:37.529899] [DEBUG] [VALIDATOR ] HBB: Primary data validation passed. [2025-09-29T19:07:37.530875] [INFO ] [MAIN ] HBB: Fetched primary data is valid. [2025-09-29T19:07:37.531001] [DEBUG] [LOCAL ] HBB: Saving primary data. [2025-09-29T19:07:37.532025] [DEBUG] [LOCAL ] HBB: Trimmed 9747 records to 6697 (keeping 200 days of data) [2025-09-29T19:07:37.577954] [DEBUG] [LOCAL ] HBB: Primary data saved (6697 records). [2025-09-29T19:07:37.578120] [INFO ] [MAIN ] HBB: Full history saved. [2025-09-29T19:07:37.578230] [INFO ] [MAIN ] Update Progress: 995/2371 symbols completed. HBB took 22.0s. Estimated remaining: 2h 56m 26s. Rate: 7.8 symbols/min [2025-09-29T19:07:37.764100] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:07:37.815134] [DEBUG] [LOCAL ] HBM: Loaded 53683 existing records from primary storage. [2025-09-29T19:07:37.815482] [INFO ] [MAIN ] HBM: Loaded 53683 existing records. [2025-09-29T19:07:37.953280] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-09-29T19:07:38.012816] [WARN ] [MAIN ] HBM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:07:38.013191] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-09-29T19:07:38.013245] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-09-29T19:07:38.013835] [DEBUG] [LOCAL ] HBM: Deleted primary data file. [2025-09-29T19:07:38.013897] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-09-29T19:07:38.406932] [INFO ] [REMOTE ] HBM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:07:38.748105] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-09-29T19:07:38.952877] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-29T19:07:38.962926] [INFO ] [REMOTE ] HASI: Full fetch complete (68019 records). [2025-09-29T19:07:38.963108] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-09-29T19:07:39.370727] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-09-29T19:07:39.370835] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-09-29T19:07:39.371906] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-09-29T19:07:39.372020] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-09-29T19:07:39.373863] [DEBUG] [LOCAL ] HASI: Trimmed 68019 records to 47129 (keeping 200 days of data) [2025-09-29T19:07:39.405923] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-29T19:07:39.548431] [INFO ] [REMOTE ] HBM: Fetching primary data for 2024-12. [2025-09-29T19:07:39.725187] [DEBUG] [LOCAL ] HASI: Primary data saved (47129 records). [2025-09-29T19:07:39.725326] [INFO ] [MAIN ] HASI: Full history saved. [2025-09-29T19:07:39.725413] [INFO ] [MAIN ] Update Progress: 996/2371 symbols completed. HASI took 32.2s. Estimated remaining: 2h 56m 10s. Rate: 7.8 symbols/min [2025-09-29T19:07:39.914053] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:07:39.963537] [DEBUG] [LOCAL ] HCA: Loaded 47781 existing records from primary storage. [2025-09-29T19:07:39.963897] [INFO ] [MAIN ] HCA: Loaded 47781 existing records. [2025-09-29T19:07:40.157964] [WARN ] [MAIN ] HCA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:07:40.158415] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-09-29T19:07:40.158508] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-09-29T19:07:40.159045] [DEBUG] [LOCAL ] HCA: Deleted primary data file. [2025-09-29T19:07:40.159105] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-09-29T19:07:40.364425] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-09-29T19:07:40.625700] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-29T19:07:40.632517] [INFO ] [REMOTE ] HCA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:07:41.148093] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-09-29T19:07:41.281506] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-29T19:07:41.948105] [INFO ] [REMOTE ] HCA: Fetching primary data for 2024-12. [2025-09-29T19:07:42.167505] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-29T19:07:42.658673] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-29T19:07:42.748149] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-09-29T19:07:43.548104] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-09-29T19:07:43.631733] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-29T19:07:44.348108] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-01. [2025-09-29T19:07:44.485421] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-29T19:07:45.053069] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-29T19:07:45.148124] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-09-29T19:07:45.948127] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-09-29T19:07:46.374078] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-29T19:07:46.751275] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-09-29T19:07:46.760512] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-29T19:07:47.361314] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-29T19:07:47.548125] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-09-29T19:07:48.348117] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-09-29T19:07:48.555894] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-29T19:07:49.148156] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-09-29T19:07:49.274694] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-29T19:07:49.948132] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-09-29T19:07:50.083477] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-29T19:07:50.748147] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-09-29T19:07:50.828731] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-29T19:07:50.839725] [INFO ] [REMOTE ] HAYW: Full fetch complete (70936 records). [2025-09-29T19:07:50.839896] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-09-29T19:07:51.274305] [DEBUG] [VALIDATOR ] HAYW: All expected trading days are present. [2025-09-29T19:07:51.274431] [DEBUG] [VALIDATOR ] HAYW: Primary data validation passed. [2025-09-29T19:07:51.275979] [INFO ] [MAIN ] HAYW: Fetched primary data is valid. [2025-09-29T19:07:51.276059] [DEBUG] [LOCAL ] HAYW: Saving primary data. [2025-09-29T19:07:51.278088] [DEBUG] [LOCAL ] HAYW: Trimmed 70936 records to 48702 (keeping 200 days of data) [2025-09-29T19:07:51.556459] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-09-29T19:07:51.610618] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-29T19:07:51.635320] [DEBUG] [LOCAL ] HAYW: Primary data saved (48702 records). [2025-09-29T19:07:51.635478] [INFO ] [MAIN ] HAYW: Full history saved. [2025-09-29T19:07:51.635622] [INFO ] [MAIN ] Update Progress: 997/2371 symbols completed. HAYW took 40.0s. Estimated remaining: 2h 56m 9s. Rate: 7.8 symbols/min [2025-09-29T19:07:52.331314] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-29T19:07:52.348073] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-09-29T19:07:53.148133] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-09-29T19:07:53.505835] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-29T19:07:53.948101] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-09-29T19:07:54.139572] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-29T19:07:54.748168] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-09-29T19:07:54.811773] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-29T19:07:54.822859] [INFO ] [REMOTE ] HBI: Full fetch complete (76892 records). [2025-09-29T19:07:54.823016] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-09-29T19:07:55.244519] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-09-29T19:07:55.244638] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-09-29T19:07:55.245892] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-09-29T19:07:55.246420] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-09-29T19:07:55.248080] [DEBUG] [LOCAL ] HBI: Trimmed 76892 records to 52992 (keeping 200 days of data) [2025-09-29T19:07:55.555093] [DEBUG] [LOCAL ] HBI: Primary data saved (52992 records). [2025-09-29T19:07:55.555379] [INFO ] [MAIN ] HBI: Full history saved. [2025-09-29T19:07:55.555489] [INFO ] [MAIN ] Update Progress: 998/2371 symbols completed. HBI took 32.9s. Estimated remaining: 2h 55m 56s. Rate: 7.8 symbols/min [2025-09-29T19:07:55.779947] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-29T19:07:55.790925] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-09-29T19:07:56.168424] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-29T19:07:56.348127] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-09-29T19:07:57.503756] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-29T19:07:57.514807] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-09-29T19:07:58.137290] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-29T19:07:58.148772] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-09-29T19:07:58.923026] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-29T19:07:58.933357] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-09-29T19:07:59.911437] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-29T19:07:59.923624] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-09-29T19:08:00.811991] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-29T19:08:00.823518] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-09-29T19:08:01.375531] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-29T19:08:01.392581] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-09-29T19:08:02.278913] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-29T19:08:02.289055] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-09-29T19:08:03.492366] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-29T19:08:03.504626] [INFO ] [REMOTE ] HBM: Full fetch complete (76192 records). [2025-09-29T19:08:03.504901] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-09-29T19:08:03.937869] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present. [2025-09-29T19:08:03.938102] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed. [2025-09-29T19:08:03.939586] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-09-29T19:08:03.939787] [DEBUG] [LOCAL ] HBM: Saving primary data. [2025-09-29T19:08:03.941885] [DEBUG] [LOCAL ] HBM: Trimmed 76192 records to 52906 (keeping 200 days of data) [2025-09-29T19:08:04.081170] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-29T19:08:04.095971] [INFO ] [REMOTE ] HCA: Full fetch complete (68969 records). [2025-09-29T19:08:04.096809] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-09-29T19:08:04.922229] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-09-29T19:08:04.923200] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-09-29T19:08:04.926434] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-09-29T19:08:04.926972] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-09-29T19:08:04.951032] [DEBUG] [LOCAL ] HCA: Trimmed 68969 records to 46951 (keeping 200 days of data) [2025-09-29T19:08:05.216356] [DEBUG] [LOCAL ] HBM: Primary data saved (52906 records). [2025-09-29T19:08:05.217046] [INFO ] [MAIN ] HBM: Full history saved. [2025-09-29T19:08:05.217417] [INFO ] [MAIN ] Update Progress: 999/2371 symbols completed. HBM took 27.6s. Estimated remaining: 2h 55m 51s. Rate: 7.8 symbols/min [2025-09-29T19:08:05.422283] [DEBUG] [LOCAL ] HCA: Primary data saved (46951 records). [2025-09-29T19:08:05.422467] [INFO ] [MAIN ] HCA: Full history saved. [2025-09-29T19:08:05.422600] [INFO ] [MAIN ] Update Progress: 1000/2371 symbols completed. HCA took 25.7s. Estimated remaining: 2h 55m 33s. Rate: 7.8 symbols/min [2025-09-29T19:08:06.254525] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:08:06.261933] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:08:06.205949] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:08:06.291618] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-09-29T19:08:06.292144] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-09-29T19:08:06.291514] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:08:06.292545] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-09-29T19:08:06.292610] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-09-29T19:08:06.292692] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-09-29T19:08:06.292744] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-09-29T19:08:06.451301] [DEBUG] [LOCAL ] HCI: Loaded 14126 existing records from primary storage. [2025-09-29T19:08:06.480291] [INFO ] [MAIN ] HCI: Loaded 14126 existing records. [2025-09-29T19:08:06.754254] [DEBUG] [LOCAL ] HCC: Loaded 46057 existing records from primary storage. [2025-09-29T19:08:06.806815] [INFO ] [MAIN ] HCC: Loaded 46057 existing records. [2025-09-29T19:08:06.933140] [DEBUG] [LOCAL ] HD: Loaded 54283 existing records from primary storage. [2025-09-29T19:08:07.014328] [INFO ] [MAIN ] HD: Loaded 54283 existing records. [2025-09-29T19:08:07.129495] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:08:07.084407] [WARN ] [MAIN ] HCI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:08:07.157244] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2024-12. [2025-09-29T19:08:07.162603] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-09-29T19:08:07.212716] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-09-29T19:08:07.278803] [WARN ] [MAIN ] HCC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:08:07.272462] [DEBUG] [LOCAL ] HCI: Deleted primary data file. [2025-09-29T19:08:07.312944] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-09-29T19:08:07.354475] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-09-29T19:08:07.370853] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-09-29T19:08:07.424124] [DEBUG] [LOCAL ] HCC: Deleted primary data file. [2025-09-29T19:08:07.532218] [WARN ] [MAIN ] HD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:08:07.516081] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-09-29T19:08:07.562196] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-09-29T19:08:07.585979] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-09-29T19:08:07.670001] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-29T19:08:07.659455] [DEBUG] [LOCAL ] HD: Deleted primary data file. [2025-09-29T19:08:07.750324] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-09-29T19:08:07.750626] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-09-29T19:08:08.189483] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-29T19:08:08.285556] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-09-29T19:08:08.307545] [INFO ] [REMOTE ] HCI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:08:08.359173] [INFO ] [REMOTE ] HCI: Fetching primary data for 2024-12. [2025-09-29T19:08:08.635014] [INFO ] [REMOTE ] HCC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:08:08.635355] [INFO ] [REMOTE ] HCC: Fetching primary data for 2024-12. [2025-09-29T19:08:08.728323] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-29T19:08:08.735691] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-09-29T19:08:08.734711] [INFO ] [REMOTE ] HD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:08:08.736776] [INFO ] [REMOTE ] HD: Fetching primary data for 2024-12. [2025-09-29T19:08:09.084150] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-29T19:08:09.085169] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-09-29T19:08:09.309118] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.22 seconds). [2025-09-29T19:08:09.310008] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-09-29T19:08:09.536067] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-29T19:08:09.560937] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-09-29T19:08:09.948149] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-01. [2025-09-29T19:08:10.179474] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-29T19:08:10.472144] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-29T19:08:10.748181] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-01. [2025-09-29T19:08:10.864241] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-29T19:08:11.548148] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-09-29T19:08:12.211585] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-29T19:08:12.348122] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-09-29T19:08:12.383058] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-29T19:08:12.685474] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-29T19:08:13.148121] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-09-29T19:08:13.948118] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-09-29T19:08:14.189072] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-09-29T19:08:14.748138] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-09-29T19:08:14.835553] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-29T19:08:15.548095] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-09-29T19:08:15.613511] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-29T19:08:16.348110] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-09-29T19:08:17.045636] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-29T19:08:17.148136] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-01. [2025-09-29T19:08:17.309489] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-29T19:08:17.948100] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-09-29T19:08:18.272787] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-29T19:08:18.748136] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-09-29T19:08:19.211316] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-29T19:08:19.548116] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-09-29T19:08:19.702062] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-29T19:08:19.880055] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-29T19:08:19.880923] [INFO ] [REMOTE ] HCXY: Full fetch complete (584 records). [2025-09-29T19:08:19.881016] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-09-29T19:08:20.113564] [WARN ] [VALIDATOR ] HCXY: Validation failed - insufficient historical data. Have 165 unique days, need 200 days [2025-09-29T19:08:20.113775] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-09-29T19:08:20.113827] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-09-29T19:08:20.113896] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-09-29T19:08:20.113983] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-09-29T19:08:20.114040] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-09-29T19:08:20.114100] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-09-29T19:08:20.114183] [INFO ] [MAIN ] Update Progress: 1001/2371 symbols completed. HCXY took 14.7s. Estimated remaining: 2h 55m 35s. Rate: 7.8 symbols/min [2025-09-29T19:08:20.295922] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:08:20.357049] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-09-29T19:08:20.361974] [DEBUG] [LOCAL ] HDB: Loaded 52695 existing records from primary storage. [2025-09-29T19:08:20.362422] [INFO ] [MAIN ] HDB: Loaded 52695 existing records. [2025-09-29T19:08:20.569368] [WARN ] [MAIN ] HDB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:08:20.569881] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-09-29T19:08:20.569955] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-09-29T19:08:20.570626] [DEBUG] [LOCAL ] HDB: Deleted primary data file. [2025-09-29T19:08:20.570718] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-09-29T19:08:20.965970] [INFO ] [REMOTE ] HDB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:08:21.148131] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-09-29T19:08:21.644011] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-29T19:08:21.948116] [INFO ] [REMOTE ] HDB: Fetching primary data for 2024-12. [2025-09-29T19:08:22.748141] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-09-29T19:08:22.873561] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-29T19:08:23.548088] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-09-29T19:08:23.754318] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-29T19:08:24.348771] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-09-29T19:08:24.351860] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-29T19:08:24.551392] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-29T19:08:25.148104] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-09-29T19:08:25.948109] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-09-29T19:08:26.160356] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-29T19:08:26.518314] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-29T19:08:26.748179] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-01. [2025-09-29T19:08:27.263766] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-29T19:08:27.548157] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-09-29T19:08:28.348086] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-09-29T19:08:28.518763] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-29T19:08:29.149020] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-09-29T19:08:29.152175] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-29T19:08:29.948157] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-09-29T19:08:30.321207] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-29T19:08:30.324937] [INFO ] [REMOTE ] HCI: Full fetch complete (19402 records). [2025-09-29T19:08:30.325031] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-09-29T19:08:30.734894] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-09-29T19:08:30.735160] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-09-29T19:08:30.735952] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-09-29T19:08:30.747178] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-09-29T19:08:30.752527] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-09-29T19:08:30.768978] [DEBUG] [LOCAL ] HCI: Trimmed 19402 records to 13948 (keeping 200 days of data) [2025-09-29T19:08:30.771791] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-09-29T19:08:30.878052] [DEBUG] [LOCAL ] HCI: Primary data saved (13948 records). [2025-09-29T19:08:30.878264] [INFO ] [MAIN ] HCI: Full history saved. [2025-09-29T19:08:30.878372] [INFO ] [MAIN ] Update Progress: 1002/2371 symbols completed. HCI took 25.5s. Estimated remaining: 2h 55m 31s. Rate: 7.8 symbols/min [2025-09-29T19:08:31.063113] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:08:31.116521] [DEBUG] [LOCAL ] HE: Loaded 49870 existing records from primary storage. [2025-09-29T19:08:31.116976] [INFO ] [MAIN ] HE: Loaded 49870 existing records. [2025-09-29T19:08:31.300852] [WARN ] [MAIN ] HE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:08:31.301068] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-09-29T19:08:31.301118] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-09-29T19:08:31.301677] [DEBUG] [LOCAL ] HE: Deleted primary data file. [2025-09-29T19:08:31.301739] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-09-29T19:08:31.553792] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-09-29T19:08:31.691309] [INFO ] [REMOTE ] HE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:08:31.723515] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-29T19:08:32.348095] [INFO ] [REMOTE ] HE: Fetching primary data for 2024-12. [2025-09-29T19:08:32.468965] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-29T19:08:33.148137] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-09-29T19:08:33.886172] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-09-29T19:08:33.948106] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-09-29T19:08:34.193581] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-29T19:08:34.748223] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-01. [2025-09-29T19:08:35.030049] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-29T19:08:35.548133] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-09-29T19:08:35.591500] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-29T19:08:36.348093] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-09-29T19:08:36.629781] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-29T19:08:37.148122] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-09-29T19:08:37.175510] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-29T19:08:37.948120] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-09-29T19:08:38.479087] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-29T19:08:38.550300] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-29T19:08:38.748167] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-09-29T19:08:39.548087] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-09-29T19:08:39.672609] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-29T19:08:40.348097] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-09-29T19:08:40.505937] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-29T19:08:41.148103] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-09-29T19:08:41.292273] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-29T19:08:41.301962] [INFO ] [REMOTE ] HCC: Full fetch complete (64379 records). [2025-09-29T19:08:41.302129] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-09-29T19:08:41.754421] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-09-29T19:08:41.754524] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-09-29T19:08:41.755619] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-09-29T19:08:41.755714] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-09-29T19:08:41.757273] [DEBUG] [LOCAL ] HCC: Trimmed 64379 records to 45384 (keeping 200 days of data) [2025-09-29T19:08:41.955971] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-09-29T19:08:42.060115] [DEBUG] [LOCAL ] HCC: Primary data saved (45384 records). [2025-09-29T19:08:42.060266] [INFO ] [MAIN ] HCC: Full history saved. [2025-09-29T19:08:42.060364] [INFO ] [MAIN ] Update Progress: 1003/2371 symbols completed. HCC took 36.6s. Estimated remaining: 2h 55m 28s. Rate: 7.8 symbols/min [2025-09-29T19:08:42.246382] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:08:42.277255] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-29T19:08:42.324904] [DEBUG] [LOCAL ] HEI: Loaded 32846 existing records from primary storage. [2025-09-29T19:08:42.325215] [INFO ] [MAIN ] HEI: Loaded 32846 existing records. [2025-09-29T19:08:42.520383] [WARN ] [MAIN ] HEI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:08:42.520835] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-09-29T19:08:42.520927] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-09-29T19:08:42.521502] [DEBUG] [LOCAL ] HEI: Deleted primary data file. [2025-09-29T19:08:42.521600] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-09-29T19:08:42.755397] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-09-29T19:08:42.918766] [INFO ] [REMOTE ] HEI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:08:42.983556] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-29T19:08:43.548164] [INFO ] [REMOTE ] HEI: Fetching primary data for 2024-12. [2025-09-29T19:08:44.145624] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-29T19:08:44.160480] [INFO ] [REMOTE ] HD: Full fetch complete (77447 records). [2025-09-29T19:08:44.160780] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-09-29T19:08:44.349568] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-09-29T19:08:44.607232] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-09-29T19:08:44.607353] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-09-29T19:08:44.608462] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-09-29T19:08:44.608551] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-09-29T19:08:44.610932] [DEBUG] [LOCAL ] HD: Trimmed 77447 records to 53503 (keeping 200 days of data) [2025-09-29T19:08:44.740527] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-29T19:08:45.004573] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-29T19:08:45.036964] [DEBUG] [LOCAL ] HD: Primary data saved (53503 records). [2025-09-29T19:08:45.037112] [INFO ] [MAIN ] HD: Full history saved. [2025-09-29T19:08:45.037222] [INFO ] [MAIN ] Update Progress: 1004/2371 symbols completed. HD took 39.6s. Estimated remaining: 2h 55m 14s. Rate: 7.8 symbols/min [2025-09-29T19:08:45.153191] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-09-29T19:08:45.219052] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:08:45.231392] [DEBUG] [LOCAL ] HEQ: Loaded 6236 existing records from primary storage. [2025-09-29T19:08:45.231612] [INFO ] [MAIN ] HEQ: Loaded 6236 existing records. [2025-09-29T19:08:45.441482] [WARN ] [MAIN ] HEQ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:08:45.441737] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-09-29T19:08:45.441813] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-09-29T19:08:45.442066] [DEBUG] [LOCAL ] HEQ: Deleted primary data file. [2025-09-29T19:08:45.442159] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-09-29T19:08:45.857344] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:08:45.948080] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2024-12. [2025-09-29T19:08:46.178805] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-29T19:08:46.644751] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-29T19:08:46.748154] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-09-29T19:08:46.931903] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-29T19:08:47.548123] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-01. [2025-09-29T19:08:48.181320] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-29T19:08:48.296302] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-29T19:08:48.348121] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-09-29T19:08:49.148163] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-09-29T19:08:49.803387] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-29T19:08:49.954717] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-01. [2025-09-29T19:08:49.961287] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-29T19:08:50.748143] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-09-29T19:08:51.414693] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-29T19:08:51.483575] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-29T19:08:51.548154] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-09-29T19:08:52.348161] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-09-29T19:08:53.148116] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-09-29T19:08:53.461140] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-29T19:08:53.472242] [INFO ] [REMOTE ] HDB: Full fetch complete (75245 records). [2025-09-29T19:08:53.472382] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-09-29T19:08:53.667145] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-29T19:08:53.919510] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-09-29T19:08:53.919716] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-09-29T19:08:53.920838] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-09-29T19:08:53.920921] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-09-29T19:08:53.922632] [DEBUG] [LOCAL ] HDB: Trimmed 75245 records to 51912 (keeping 200 days of data) [2025-09-29T19:08:53.985602] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-09-29T19:08:54.073459] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-29T19:08:54.305475] [DEBUG] [LOCAL ] HDB: Primary data saved (51912 records). [2025-09-29T19:08:54.305706] [INFO ] [MAIN ] HDB: Full history saved. [2025-09-29T19:08:54.305823] [INFO ] [MAIN ] Update Progress: 1005/2371 symbols completed. HDB took 34.2s. Estimated remaining: 2h 55m 9s. Rate: 7.8 symbols/min [2025-09-29T19:08:54.485413] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:08:54.537832] [DEBUG] [LOCAL ] HESM: Loaded 48879 existing records from primary storage. [2025-09-29T19:08:54.538169] [INFO ] [MAIN ] HESM: Loaded 48879 existing records. [2025-09-29T19:08:54.719169] [WARN ] [MAIN ] HESM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:08:54.719422] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-09-29T19:08:54.719476] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-09-29T19:08:54.720106] [DEBUG] [LOCAL ] HESM: Deleted primary data file. [2025-09-29T19:08:54.720169] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-09-29T19:08:54.753240] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-09-29T19:08:55.126379] [INFO ] [REMOTE ] HESM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:08:55.398473] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-29T19:08:55.505775] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-29T19:08:55.548089] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-09-29T19:08:56.123509] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-29T19:08:56.348188] [INFO ] [REMOTE ] HESM: Fetching primary data for 2024-12. [2025-09-29T19:08:57.148169] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-09-29T19:08:57.827041] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-29T19:08:57.948875] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-29T19:08:57.948993] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-09-29T19:08:58.568071] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-29T19:08:58.748112] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-09-29T19:08:59.548144] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-09-29T19:08:59.644084] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-29T19:08:59.646505] [INFO ] [REMOTE ] HEQ: Full fetch complete (9192 records). [2025-09-29T19:08:59.646580] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-09-29T19:09:00.046632] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-09-29T19:09:00.046766] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-09-29T19:09:00.047240] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-09-29T19:09:00.047322] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-09-29T19:09:00.048294] [DEBUG] [LOCAL ] HEQ: Trimmed 9192 records to 6221 (keeping 200 days of data) [2025-09-29T19:09:00.091717] [DEBUG] [LOCAL ] HEQ: Primary data saved (6221 records). [2025-09-29T19:09:00.091899] [INFO ] [MAIN ] HEQ: Full history saved. [2025-09-29T19:09:00.092060] [INFO ] [MAIN ] Update Progress: 1006/2371 symbols completed. HEQ took 15.1s. Estimated remaining: 2h 54m 58s. Rate: 7.8 symbols/min [2025-09-29T19:09:00.269056] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:09:00.269275] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-09-29T19:09:00.269334] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-09-29T19:09:00.269448] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-09-29T19:09:00.269508] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-09-29T19:09:00.269554] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-09-29T19:09:00.269588] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-09-29T19:09:00.353230] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-09-29T19:09:00.657956] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:09:01.148107] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-09-29T19:09:01.334385] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-29T19:09:01.948141] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-09-29T19:09:02.266801] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-29T19:09:02.748096] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-09-29T19:09:02.850361] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-29T19:09:03.359390] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-29T19:09:03.548171] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-09-29T19:09:04.296414] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-29T19:09:04.348167] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-09-29T19:09:05.138353] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-29T19:09:05.148293] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-09-29T19:09:05.918909] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-29T19:09:05.948088] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-09-29T19:09:06.738865] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-29T19:09:06.749259] [INFO ] [REMOTE ] HF: Fetching primary data for 2024-12. [2025-09-29T19:09:07.076140] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-09-29T19:09:07.394542] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-29T19:09:07.548132] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-09-29T19:09:08.348128] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-09-29T19:09:09.148157] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-09-29T19:09:09.283764] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-29T19:09:09.294738] [INFO ] [REMOTE ] HE: Full fetch complete (72409 records). [2025-09-29T19:09:09.294902] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-09-29T19:09:09.698612] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-09-29T19:09:09.698789] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-09-29T19:09:09.699897] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-09-29T19:09:09.700025] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-09-29T19:09:09.719634] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-29T19:09:09.726336] [DEBUG] [LOCAL ] HE: Trimmed 72409 records to 49059 (keeping 200 days of data) [2025-09-29T19:09:09.948109] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-09-29T19:09:10.043977] [DEBUG] [LOCAL ] HE: Primary data saved (49059 records). [2025-09-29T19:09:10.044136] [INFO ] [MAIN ] HE: Full history saved. [2025-09-29T19:09:10.044247] [INFO ] [MAIN ] Update Progress: 1007/2371 symbols completed. HE took 39.2s. Estimated remaining: 2h 54m 54s. Rate: 7.8 symbols/min [2025-09-29T19:09:10.222715] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:09:10.222917] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-09-29T19:09:10.222958] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-09-29T19:09:10.223074] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-09-29T19:09:10.223117] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-09-29T19:09:10.223162] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-09-29T19:09:10.223196] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-09-29T19:09:10.610769] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:09:10.748149] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-09-29T19:09:10.928735] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-29T19:09:11.086301] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-29T19:09:11.387936] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-29T19:09:11.548129] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-09-29T19:09:12.348145] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-09-29T19:09:12.679058] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-29T19:09:13.039908] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-29T19:09:13.045811] [INFO ] [REMOTE ] HEI: Full fetch complete (48848 records). [2025-09-29T19:09:13.045919] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-09-29T19:09:13.151691] [INFO ] [REMOTE ] HFND: Fetching primary data for 2024-12. [2025-09-29T19:09:13.465233] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present. [2025-09-29T19:09:13.465384] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed. [2025-09-29T19:09:13.466340] [INFO ] [MAIN ] HEI: Fetched primary data is valid. [2025-09-29T19:09:13.466412] [DEBUG] [LOCAL ] HEI: Saving primary data. [2025-09-29T19:09:13.467568] [DEBUG] [LOCAL ] HEI: Trimmed 48848 records to 32223 (keeping 200 days of data) [2025-09-29T19:09:13.654582] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-29T19:09:13.696247] [DEBUG] [LOCAL ] HEI: Primary data saved (32223 records). [2025-09-29T19:09:13.696398] [INFO ] [MAIN ] HEI: Full history saved. [2025-09-29T19:09:13.696499] [INFO ] [MAIN ] Update Progress: 1008/2371 symbols completed. HEI took 31.6s. Estimated remaining: 2h 54m 40s. Rate: 7.8 symbols/min [2025-09-29T19:09:13.879244] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:09:13.900191] [DEBUG] [LOCAL ] HFRO: Loaded 17798 existing records from primary storage. [2025-09-29T19:09:13.900451] [INFO ] [MAIN ] HFRO: Loaded 17798 existing records. [2025-09-29T19:09:13.953633] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-09-29T19:09:14.102224] [WARN ] [MAIN ] HFRO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:09:14.102519] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-09-29T19:09:14.102577] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-09-29T19:09:14.102946] [DEBUG] [LOCAL ] HFRO: Deleted primary data file. [2025-09-29T19:09:14.103005] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-09-29T19:09:14.287940] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-29T19:09:14.484199] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:09:14.748110] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2024-12. [2025-09-29T19:09:15.548170] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-09-29T19:09:15.900826] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-29T19:09:15.933768] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-29T19:09:16.348114] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-09-29T19:09:17.148109] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-01. [2025-09-29T19:09:17.953809] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-09-29T19:09:17.967515] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-29T19:09:18.281814] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-29T19:09:18.299418] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-29T19:09:18.748111] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-09-29T19:09:19.548156] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-09-29T19:09:19.981620] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-29T19:09:20.356382] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-09-29T19:09:20.376264] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-29T19:09:20.615956] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-09-29T19:09:21.148110] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-09-29T19:09:21.411535] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-09-29T19:09:21.948111] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-09-29T19:09:22.200545] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-09-29T19:09:22.748115] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-09-29T19:09:23.005097] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-09-29T19:09:23.548145] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-09-29T19:09:24.348124] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-09-29T19:09:24.576097] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-09-29T19:09:25.148113] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-09-29T19:09:25.568122] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-29T19:09:25.769763] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-09-29T19:09:25.948126] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-09-29T19:09:26.748101] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-09-29T19:09:27.067691] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-29T19:09:27.548152] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-09-29T19:09:28.348074] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-09-29T19:09:28.552890] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-29T19:09:28.553433] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-29T19:09:28.736909] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-29T19:09:28.737664] [INFO ] [REMOTE ] HF: Full fetch complete (497 records). [2025-09-29T19:09:28.737751] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-09-29T19:09:28.738175] [FATAL] [VALIDATOR ] HF: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T19:09:28.738268] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-09-29T19:09:28.738312] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-09-29T19:09:28.738363] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-09-29T19:09:28.738443] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-09-29T19:09:28.738482] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-09-29T19:09:28.738523] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-09-29T19:09:28.738603] [INFO ] [MAIN ] Update Progress: 1009/2371 symbols completed. HF took 28.6s. Estimated remaining: 2h 54m 43s. Rate: 7.8 symbols/min [2025-09-29T19:09:28.936018] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:09:28.956297] [DEBUG] [LOCAL ] HGER: Loaded 13428 existing records from primary storage. [2025-09-29T19:09:28.956552] [INFO ] [MAIN ] HGER: Loaded 13428 existing records. [2025-09-29T19:09:29.156503] [WARN ] [MAIN ] HGER: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:09:29.156763] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-09-29T19:09:29.152484] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-09-29T19:09:29.158032] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-09-29T19:09:29.158610] [DEBUG] [LOCAL ] HGER: Deleted primary data file. [2025-09-29T19:09:29.158696] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-09-29T19:09:29.563978] [INFO ] [REMOTE ] HGER: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:09:29.948084] [INFO ] [REMOTE ] HGER: Fetching primary data for 2024-12. [2025-09-29T19:09:30.112218] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-29T19:09:30.653515] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-29T19:09:30.748110] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-09-29T19:09:31.474535] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-29T19:09:31.548112] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-09-29T19:09:32.150277] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-29T19:09:32.348109] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-09-29T19:09:33.080037] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-29T19:09:33.148085] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-09-29T19:09:33.489491] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-29T19:09:33.948125] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-09-29T19:09:34.748093] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-09-29T19:09:34.912920] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-29T19:09:35.548081] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-09-29T19:09:35.558172] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-29T19:09:36.348222] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-09-29T19:09:36.595110] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-29T19:09:36.968134] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-29T19:09:37.148167] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-09-29T19:09:37.483956] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-29T19:09:37.948112] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-09-29T19:09:38.360104] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-29T19:09:38.748144] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-09-29T19:09:39.529969] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-29T19:09:39.548139] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-09-29T19:09:40.040624] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-29T19:09:40.348138] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-09-29T19:09:41.148159] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-09-29T19:09:41.953252] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-09-29T19:09:41.972938] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-29T19:09:42.072083] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-29T19:09:42.574529] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-29T19:09:42.575504] [INFO ] [REMOTE ] HFND: Full fetch complete (1797 records). [2025-09-29T19:09:42.575578] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-09-29T19:09:42.753282] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-09-29T19:09:42.798126] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-29T19:09:42.799407] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-09-29T19:09:42.799501] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-09-29T19:09:42.799586] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-09-29T19:09:42.799730] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-09-29T19:09:42.799797] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-09-29T19:09:42.799863] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-09-29T19:09:42.799978] [INFO ] [MAIN ] Update Progress: 1010/2371 symbols completed. HFND took 32.8s. Estimated remaining: 2h 54m 44s. Rate: 7.8 symbols/min [2025-09-29T19:09:42.985739] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:09:43.000287] [DEBUG] [LOCAL ] HGLB: Loaded 9836 existing records from primary storage. [2025-09-29T19:09:43.000520] [INFO ] [MAIN ] HGLB: Loaded 9836 existing records. [2025-09-29T19:09:43.187669] [WARN ] [MAIN ] HGLB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:09:43.187900] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-09-29T19:09:43.187951] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-09-29T19:09:43.188271] [DEBUG] [LOCAL ] HGLB: Deleted primary data file. [2025-09-29T19:09:43.188334] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-09-29T19:09:43.556737] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-09-29T19:09:43.585511] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:09:43.946863] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-29T19:09:44.348136] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-09-29T19:09:45.148092] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-09-29T19:09:45.394463] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-29T19:09:45.405611] [INFO ] [REMOTE ] HESM: Full fetch complete (69043 records). [2025-09-29T19:09:45.405826] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-09-29T19:09:45.535440] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-29T19:09:45.571032] [INFO ] [REMOTE ] HFRO: Full fetch complete (28944 records). [2025-09-29T19:09:45.588843] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-09-29T19:09:45.950554] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2024-12. [2025-09-29T19:09:46.106123] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-29T19:09:46.167024] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-09-29T19:09:46.172354] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-09-29T19:09:46.181252] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-09-29T19:09:46.198565] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-09-29T19:09:46.259107] [DEBUG] [LOCAL ] HESM: Trimmed 69043 records to 48194 (keeping 200 days of data) [2025-09-29T19:09:46.386514] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-09-29T19:09:46.396192] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-09-29T19:09:46.396892] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-09-29T19:09:46.425931] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-09-29T19:09:46.434685] [DEBUG] [LOCAL ] HFRO: Trimmed 28944 records to 17595 (keeping 200 days of data) [2025-09-29T19:09:46.669670] [DEBUG] [LOCAL ] HFRO: Primary data saved (17595 records). [2025-09-29T19:09:46.670696] [INFO ] [MAIN ] HFRO: Full history saved. [2025-09-29T19:09:46.671714] [INFO ] [MAIN ] Update Progress: 1011/2371 symbols completed. HFRO took 33.0s. Estimated remaining: 2h 54m 31s. Rate: 7.8 symbols/min [2025-09-29T19:09:46.749301] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-09-29T19:09:46.879973] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:09:46.882203] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-29T19:09:46.913503] [DEBUG] [LOCAL ] HGTY: Loaded 13290 existing records from primary storage. [2025-09-29T19:09:46.916488] [INFO ] [MAIN ] HGTY: Loaded 13290 existing records. [2025-09-29T19:09:47.211353] [WARN ] [MAIN ] HGTY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:09:47.214417] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-09-29T19:09:47.214219] [DEBUG] [LOCAL ] HESM: Primary data saved (48194 records). [2025-09-29T19:09:47.214560] [INFO ] [MAIN ] HESM: Full history saved. [2025-09-29T19:09:47.214752] [INFO ] [MAIN ] Update Progress: 1012/2371 symbols completed. HESM took 52.9s. Estimated remaining: 2h 54m 13s. Rate: 7.8 symbols/min [2025-09-29T19:09:47.214810] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-09-29T19:09:47.237840] [DEBUG] [LOCAL ] HGTY: Deleted primary data file. [2025-09-29T19:09:47.276975] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-09-29T19:09:47.553836] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-01. [2025-09-29T19:09:47.563874] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:09:47.846444] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:09:47.863406] [DEBUG] [LOCAL ] HGV: Loaded 47426 existing records from primary storage. [2025-09-29T19:09:47.863962] [INFO ] [MAIN ] HGV: Loaded 47426 existing records. [2025-09-29T19:09:48.015472] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-29T19:09:48.065865] [INFO ] [REMOTE ] HGER: Full fetch complete (16557 records). [2025-09-29T19:09:48.092872] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-09-29T19:09:48.100670] [WARN ] [MAIN ] HGV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:09:48.106481] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-09-29T19:09:48.132686] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-09-29T19:09:48.189298] [DEBUG] [LOCAL ] HGV: Deleted primary data file. [2025-09-29T19:09:48.209323] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-09-29T19:09:48.373522] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2024-12. [2025-09-29T19:09:48.396841] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-29T19:09:49.123718] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present. [2025-09-29T19:09:49.144857] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed. [2025-09-29T19:09:49.149256] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-09-29T19:09:49.150157] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-09-29T19:09:49.151216] [DEBUG] [LOCAL ] HGER: Saving primary data. [2025-09-29T19:09:49.179504] [DEBUG] [LOCAL ] HGER: Trimmed 16557 records to 13386 (keeping 200 days of data) [2025-09-29T19:09:49.266552] [INFO ] [REMOTE ] HGV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:09:49.340185] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-29T19:09:49.366508] [DEBUG] [LOCAL ] HGER: Primary data saved (13386 records). [2025-09-29T19:09:49.366700] [INFO ] [MAIN ] HGER: Full history saved. [2025-09-29T19:09:49.366803] [INFO ] [MAIN ] Update Progress: 1013/2371 symbols completed. HGER took 20.6s. Estimated remaining: 2h 53m 58s. Rate: 7.8 symbols/min [2025-09-29T19:09:49.553802] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:09:49.590818] [DEBUG] [LOCAL ] HHH: Loaded 33042 existing records from primary storage. [2025-09-29T19:09:49.591113] [INFO ] [MAIN ] HHH: Loaded 33042 existing records. [2025-09-29T19:09:49.784425] [WARN ] [MAIN ] HHH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:09:49.784766] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-09-29T19:09:49.784823] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-09-29T19:09:49.785302] [DEBUG] [LOCAL ] HHH: Deleted primary data file. [2025-09-29T19:09:49.785372] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-09-29T19:09:49.952177] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-01. [2025-09-29T19:09:50.079395] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-29T19:09:50.174249] [INFO ] [REMOTE ] HHH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:09:50.748101] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-09-29T19:09:50.756804] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-29T19:09:51.545475] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-29T19:09:51.548466] [INFO ] [REMOTE ] HGV: Fetching primary data for 2024-12. [2025-09-29T19:09:52.348157] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-09-29T19:09:52.980905] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-29T19:09:53.148132] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-01. [2025-09-29T19:09:53.159028] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-29T19:09:53.948170] [INFO ] [REMOTE ] HHH: Fetching primary data for 2024-12. [2025-09-29T19:09:54.623566] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-29T19:09:54.748135] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-09-29T19:09:55.174425] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-29T19:09:55.548152] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-09-29T19:09:56.348156] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-01. [2025-09-29T19:09:57.148099] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-09-29T19:09:57.483929] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (2.74 seconds). [2025-09-29T19:09:57.846006] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-09-29T19:09:57.873541] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-29T19:09:57.948090] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-09-29T19:09:58.302198] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-29T19:09:58.745156] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-29T19:09:58.748088] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-09-29T19:09:59.538541] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-29T19:09:59.548054] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-09-29T19:10:00.303398] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-29T19:10:00.348088] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-09-29T19:10:01.148128] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-09-29T19:10:01.948088] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-09-29T19:10:02.049997] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-29T19:10:02.052952] [INFO ] [REMOTE ] HGLB: Full fetch complete (14454 records). [2025-09-29T19:10:02.053037] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-09-29T19:10:02.488138] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-29T19:10:02.517359] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-09-29T19:10:02.517928] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-09-29T19:10:02.527923] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-09-29T19:10:02.529881] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-09-29T19:10:02.540104] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-29T19:10:02.541193] [DEBUG] [LOCAL ] HGLB: Trimmed 14454 records to 9393 (keeping 200 days of data) [2025-09-29T19:10:02.608599] [DEBUG] [LOCAL ] HGLB: Primary data saved (9393 records). [2025-09-29T19:10:02.608822] [INFO ] [MAIN ] HGLB: Full history saved. [2025-09-29T19:10:02.608984] [INFO ] [MAIN ] Update Progress: 1014/2371 symbols completed. HGLB took 19.8s. Estimated remaining: 2h 53m 58s. Rate: 7.8 symbols/min [2025-09-29T19:10:02.761049] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-09-29T19:10:02.800587] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:10:02.849039] [DEBUG] [LOCAL ] HI: Loaded 35713 existing records from primary storage. [2025-09-29T19:10:02.849370] [INFO ] [MAIN ] HI: Loaded 35713 existing records. [2025-09-29T19:10:03.046221] [WARN ] [MAIN ] HI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:10:03.046498] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-09-29T19:10:03.046548] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-09-29T19:10:03.047066] [DEBUG] [LOCAL ] HI: Deleted primary data file. [2025-09-29T19:10:03.047162] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-09-29T19:10:03.423194] [INFO ] [REMOTE ] HI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:10:03.548093] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-09-29T19:10:04.348106] [INFO ] [REMOTE ] HI: Fetching primary data for 2024-12. [2025-09-29T19:10:04.397449] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-29T19:10:04.488742] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-29T19:10:05.148150] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-09-29T19:10:05.335377] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-29T19:10:05.948107] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-09-29T19:10:06.042207] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-29T19:10:06.748143] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-09-29T19:10:07.548115] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-09-29T19:10:08.202988] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-09-29T19:10:08.348114] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-09-29T19:10:08.972931] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-09-29T19:10:09.148137] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-09-29T19:10:09.889865] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-09-29T19:10:09.925828] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-29T19:10:09.948097] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-09-29T19:10:10.189496] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-29T19:10:10.735748] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-29T19:10:10.748071] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-09-29T19:10:11.548153] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-09-29T19:10:11.768713] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-29T19:10:12.348157] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-09-29T19:10:13.148085] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-09-29T19:10:13.183259] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-29T19:10:13.608806] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-29T19:10:13.613475] [INFO ] [REMOTE ] HGTY: Full fetch complete (17213 records). [2025-09-29T19:10:13.613589] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-09-29T19:10:13.953297] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-09-29T19:10:14.003595] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present. [2025-09-29T19:10:14.003724] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed. [2025-09-29T19:10:14.004163] [INFO ] [MAIN ] HGTY: Fetched primary data is valid. [2025-09-29T19:10:14.004208] [DEBUG] [LOCAL ] HGTY: Saving primary data. [2025-09-29T19:10:14.004981] [DEBUG] [LOCAL ] HGTY: Trimmed 17213 records to 13122 (keeping 200 days of data) [2025-09-29T19:10:14.086424] [DEBUG] [LOCAL ] HGTY: Primary data saved (13122 records). [2025-09-29T19:10:14.086588] [INFO ] [MAIN ] HGTY: Full history saved. [2025-09-29T19:10:14.086705] [INFO ] [MAIN ] Update Progress: 1015/2371 symbols completed. HGTY took 27.4s. Estimated remaining: 2h 53m 55s. Rate: 7.8 symbols/min [2025-09-29T19:10:14.274280] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:10:14.346606] [DEBUG] [LOCAL ] HIG: Loaded 51962 existing records from primary storage. [2025-09-29T19:10:14.347027] [INFO ] [MAIN ] HIG: Loaded 51962 existing records. [2025-09-29T19:10:14.547877] [WARN ] [MAIN ] HIG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:10:14.548229] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-09-29T19:10:14.548283] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-09-29T19:10:14.548896] [DEBUG] [LOCAL ] HIG: Deleted primary data file. [2025-09-29T19:10:14.549062] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-09-29T19:10:14.650518] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-29T19:10:14.760424] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-09-29T19:10:14.949495] [INFO ] [REMOTE ] HIG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:10:15.347676] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-29T19:10:15.548114] [INFO ] [REMOTE ] HIG: Fetching primary data for 2024-12. [2025-09-29T19:10:16.348102] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-09-29T19:10:16.519473] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-29T19:10:17.148128] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-09-29T19:10:17.300949] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-29T19:10:17.747947] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-29T19:10:17.948127] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-09-29T19:10:18.542036] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-29T19:10:18.551582] [INFO ] [REMOTE ] HGV: Full fetch complete (65731 records). [2025-09-29T19:10:18.551758] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-09-29T19:10:18.749928] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-09-29T19:10:18.980863] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-09-29T19:10:18.980981] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-09-29T19:10:18.987715] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-09-29T19:10:18.998431] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-09-29T19:10:19.000193] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-29T19:10:19.007482] [DEBUG] [LOCAL ] HGV: Trimmed 65731 records to 46645 (keeping 200 days of data) [2025-09-29T19:10:19.288174] [DEBUG] [LOCAL ] HGV: Primary data saved (46645 records). [2025-09-29T19:10:19.288329] [INFO ] [MAIN ] HGV: Full history saved. [2025-09-29T19:10:19.288422] [INFO ] [MAIN ] Update Progress: 1016/2371 symbols completed. HGV took 32.1s. Estimated remaining: 2h 53m 44s. Rate: 7.8 symbols/min [2025-09-29T19:10:19.473279] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:10:19.510685] [DEBUG] [LOCAL ] HII: Loaded 35728 existing records from primary storage. [2025-09-29T19:10:19.511000] [INFO ] [MAIN ] HII: Loaded 35728 existing records. [2025-09-29T19:10:19.555225] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-09-29T19:10:19.702870] [WARN ] [MAIN ] HII: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:10:19.703107] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-09-29T19:10:19.703157] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-09-29T19:10:19.703490] [DEBUG] [LOCAL ] HII: Deleted primary data file. [2025-09-29T19:10:19.703551] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-09-29T19:10:20.101195] [INFO ] [REMOTE ] HII: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:10:20.348112] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-01. [2025-09-29T19:10:20.396999] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-29T19:10:21.148125] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-09-29T19:10:21.955150] [INFO ] [REMOTE ] HII: Fetching primary data for 2024-12. [2025-09-29T19:10:21.979137] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-09-29T19:10:22.748082] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-09-29T19:10:23.081313] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-01 (2.73 seconds). [2025-09-29T19:10:23.548098] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-09-29T19:10:23.793177] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-29T19:10:23.895667] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-29T19:10:23.929418] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (2.78 seconds). [2025-09-29T19:10:24.348103] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-09-29T19:10:25.148161] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-09-29T19:10:25.195489] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-29T19:10:25.374285] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-29T19:10:25.948153] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-09-29T19:10:26.597004] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-29T19:10:26.748154] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-09-29T19:10:27.341183] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-29T19:10:27.548145] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-01. [2025-09-29T19:10:28.348144] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-09-29T19:10:28.568407] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-29T19:10:29.009795] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-29T19:10:29.148158] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-09-29T19:10:29.863923] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-29T19:10:29.948132] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-09-29T19:10:30.748219] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-09-29T19:10:30.891481] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-29T19:10:31.324634] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-29T19:10:31.332611] [INFO ] [REMOTE ] HHH: Full fetch complete (45335 records). [2025-09-29T19:10:31.332932] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-09-29T19:10:31.556356] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-09-29T19:10:31.750124] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-09-29T19:10:31.750233] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-09-29T19:10:31.751112] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-09-29T19:10:31.751178] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-09-29T19:10:31.752431] [DEBUG] [LOCAL ] HHH: Trimmed 45335 records to 32605 (keeping 200 days of data) [2025-09-29T19:10:31.968972] [DEBUG] [LOCAL ] HHH: Primary data saved (32605 records). [2025-09-29T19:10:31.969860] [INFO ] [MAIN ] HHH: Full history saved. [2025-09-29T19:10:31.970189] [INFO ] [MAIN ] Update Progress: 1017/2371 symbols completed. HHH took 42.6s. Estimated remaining: 2h 53m 43s. Rate: 7.8 symbols/min [2025-09-29T19:10:32.182107] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:10:32.244876] [DEBUG] [LOCAL ] HIMS: Loaded 54597 existing records from primary storage. [2025-09-29T19:10:32.245232] [INFO ] [MAIN ] HIMS: Loaded 54597 existing records. [2025-09-29T19:10:32.349110] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-09-29T19:10:32.456955] [WARN ] [MAIN ] HIMS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:10:32.458048] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-09-29T19:10:32.458298] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-09-29T19:10:32.459341] [DEBUG] [LOCAL ] HIMS: Deleted primary data file. [2025-09-29T19:10:32.459414] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-09-29T19:10:32.943818] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-29T19:10:32.949878] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:10:32.984700] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-29T19:10:33.148152] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-09-29T19:10:33.948080] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-09-29T19:10:34.130304] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-29T19:10:34.748117] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-09-29T19:10:34.907884] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-29T19:10:35.548515] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-09-29T19:10:35.551185] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-29T19:10:35.559682] [INFO ] [REMOTE ] HI: Full fetch complete (49856 records). [2025-09-29T19:10:35.559854] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-09-29T19:10:35.965073] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-09-29T19:10:35.965164] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-09-29T19:10:35.966191] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-09-29T19:10:35.966258] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-09-29T19:10:35.967449] [DEBUG] [LOCAL ] HI: Trimmed 49856 records to 35198 (keeping 200 days of data) [2025-09-29T19:10:36.191276] [DEBUG] [LOCAL ] HI: Primary data saved (35198 records). [2025-09-29T19:10:36.191416] [INFO ] [MAIN ] HI: Full history saved. [2025-09-29T19:10:36.191501] [INFO ] [MAIN ] Update Progress: 1018/2371 symbols completed. HI took 33.6s. Estimated remaining: 2h 53m 31s. Rate: 7.8 symbols/min [2025-09-29T19:10:36.371052] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2024-12. [2025-09-29T19:10:36.374667] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:10:36.403010] [DEBUG] [LOCAL ] HIO: Loaded 24107 existing records from primary storage. [2025-09-29T19:10:36.403306] [INFO ] [MAIN ] HIO: Loaded 24107 existing records. [2025-09-29T19:10:36.601910] [WARN ] [MAIN ] HIO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:10:36.602363] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-09-29T19:10:36.602527] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-09-29T19:10:36.603064] [DEBUG] [LOCAL ] HIO: Deleted primary data file. [2025-09-29T19:10:36.603129] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-09-29T19:10:36.989600] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-29T19:10:37.033071] [INFO ] [REMOTE ] HIO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:10:37.148099] [INFO ] [REMOTE ] HIO: Fetching primary data for 2024-12. [2025-09-29T19:10:37.383417] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-29T19:10:37.948158] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-09-29T19:10:38.331799] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-29T19:10:38.748099] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-01. [2025-09-29T19:10:38.804945] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-09-29T19:10:39.394692] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-29T19:10:39.548086] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-09-29T19:10:39.977401] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-29T19:10:40.348127] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-09-29T19:10:41.148110] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-09-29T19:10:41.435907] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-29T19:10:41.491122] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-29T19:10:41.948142] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-09-29T19:10:42.428899] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-29T19:10:42.748144] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-01. [2025-09-29T19:10:43.553199] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-09-29T19:10:43.573167] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-29T19:10:44.348153] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-09-29T19:10:44.831166] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-29T19:10:45.047269] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-29T19:10:45.148141] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-09-29T19:10:45.232542] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-29T19:10:45.948114] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-09-29T19:10:46.748124] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-09-29T19:10:47.418484] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-29T19:10:47.548122] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-09-29T19:10:47.701692] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (2.55 seconds). [2025-09-29T19:10:48.063393] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-29T19:10:48.348130] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-09-29T19:10:49.130705] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-29T19:10:49.139186] [INFO ] [REMOTE ] HII: Full fetch complete (53220 records). [2025-09-29T19:10:49.139346] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-09-29T19:10:49.153190] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-09-29T19:10:49.537594] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-29T19:10:49.590001] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-09-29T19:10:49.590091] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-09-29T19:10:49.591003] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-09-29T19:10:49.591077] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-09-29T19:10:49.592661] [DEBUG] [LOCAL ] HII: Trimmed 53220 records to 34805 (keeping 200 days of data) [2025-09-29T19:10:49.844414] [DEBUG] [LOCAL ] HII: Primary data saved (34805 records). [2025-09-29T19:10:49.844557] [INFO ] [MAIN ] HII: Full history saved. [2025-09-29T19:10:49.844676] [INFO ] [MAIN ] Update Progress: 1019/2371 symbols completed. HII took 30.6s. Estimated remaining: 2h 53m 31s. Rate: 7.8 symbols/min [2025-09-29T19:10:49.953291] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-09-29T19:10:50.030806] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:10:50.063286] [DEBUG] [LOCAL ] HIPO: Loaded 22774 existing records from primary storage. [2025-09-29T19:10:50.063580] [INFO ] [MAIN ] HIPO: Loaded 22774 existing records. [2025-09-29T19:10:50.267681] [WARN ] [MAIN ] HIPO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:10:50.267927] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-09-29T19:10:50.267986] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-09-29T19:10:50.268520] [DEBUG] [LOCAL ] HIPO: Deleted primary data file. [2025-09-29T19:10:50.268586] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-09-29T19:10:50.679490] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:10:50.748139] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2024-12. [2025-09-29T19:10:51.548155] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-09-29T19:10:51.763477] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-29T19:10:51.776277] [INFO ] [REMOTE ] HIG: Full fetch complete (73272 records). [2025-09-29T19:10:51.776473] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-09-29T19:10:52.275047] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (3.12 seconds). [2025-09-29T19:10:52.311551] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-09-29T19:10:52.311922] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-09-29T19:10:52.313107] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-09-29T19:10:52.313338] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-09-29T19:10:52.315708] [DEBUG] [LOCAL ] HIG: Trimmed 73272 records to 51212 (keeping 200 days of data) [2025-09-29T19:10:52.389611] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-09-29T19:10:52.690162] [DEBUG] [LOCAL ] HIG: Primary data saved (51212 records). [2025-09-29T19:10:52.690338] [INFO ] [MAIN ] HIG: Full history saved. [2025-09-29T19:10:52.690432] [INFO ] [MAIN ] Update Progress: 1020/2371 symbols completed. HIG took 38.6s. Estimated remaining: 2h 53m 17s. Rate: 7.8 symbols/min [2025-09-29T19:10:52.883440] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:10:52.938564] [DEBUG] [LOCAL ] HIW: Loaded 45329 existing records from primary storage. [2025-09-29T19:10:52.938960] [INFO ] [MAIN ] HIW: Loaded 45329 existing records. [2025-09-29T19:10:53.127007] [WARN ] [MAIN ] HIW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:10:53.127280] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-09-29T19:10:53.127332] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-09-29T19:10:53.127958] [DEBUG] [LOCAL ] HIW: Deleted primary data file. [2025-09-29T19:10:53.128059] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-09-29T19:10:53.530081] [INFO ] [REMOTE ] HIW: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:10:53.530466] [INFO ] [REMOTE ] HIW: Fetching primary data for 2024-12. [2025-09-29T19:10:54.078086] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2024-12 (3.33 seconds). [2025-09-29T19:10:54.083329] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-01. [2025-09-29T19:10:55.065295] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-29T19:10:55.076117] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-01. [2025-09-29T19:10:55.153942] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (2.76 seconds). [2025-09-29T19:10:55.187104] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-29T19:10:55.286572] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (3.74 seconds). [2025-09-29T19:10:55.548127] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-09-29T19:10:56.348122] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-09-29T19:10:56.638268] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-29T19:10:56.684336] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-29T19:10:57.148161] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-09-29T19:10:57.953444] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-09-29T19:10:57.962430] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-29T19:10:58.267138] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-29T19:10:58.748166] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-09-29T19:10:59.548126] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-09-29T19:11:00.317967] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-29T19:11:00.348095] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-09-29T19:11:00.450528] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-09-29T19:11:00.717365] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-29T19:11:01.148151] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-09-29T19:11:01.948140] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-09-29T19:11:02.251940] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-29T19:11:02.665218] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-09-29T19:11:02.748144] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-09-29T19:11:03.394288] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-29T19:11:03.401418] [INFO ] [REMOTE ] HIO: Full fetch complete (37023 records). [2025-09-29T19:11:03.401838] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-09-29T19:11:03.556044] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-09-29T19:11:03.839240] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-09-29T19:11:03.839362] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-09-29T19:11:03.840914] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-09-29T19:11:03.841017] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-09-29T19:11:03.842442] [DEBUG] [LOCAL ] HIO: Trimmed 37023 records to 23694 (keeping 200 days of data) [2025-09-29T19:11:04.024082] [DEBUG] [LOCAL ] HIO: Primary data saved (23694 records). [2025-09-29T19:11:04.024242] [INFO ] [MAIN ] HIO: Full history saved. [2025-09-29T19:11:04.024354] [INFO ] [MAIN ] Update Progress: 1021/2371 symbols completed. HIO took 27.8s. Estimated remaining: 2h 53m 14s. Rate: 7.8 symbols/min [2025-09-29T19:11:04.216614] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:11:04.242325] [DEBUG] [LOCAL ] HIX: Loaded 20714 existing records from primary storage. [2025-09-29T19:11:04.242630] [INFO ] [MAIN ] HIX: Loaded 20714 existing records. [2025-09-29T19:11:04.354346] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-09-29T19:11:04.450498] [WARN ] [MAIN ] HIX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:11:04.450763] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-09-29T19:11:04.450818] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-09-29T19:11:04.451217] [DEBUG] [LOCAL ] HIX: Deleted primary data file. [2025-09-29T19:11:04.451282] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-09-29T19:11:04.849679] [INFO ] [REMOTE ] HIX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:11:05.148076] [INFO ] [REMOTE ] HIX: Fetching primary data for 2024-12. [2025-09-29T19:11:05.440040] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-29T19:11:05.555129] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-29T19:11:05.907637] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (3.16 seconds). [2025-09-29T19:11:05.948079] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-09-29T19:11:06.084542] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-29T19:11:06.748125] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-01. [2025-09-29T19:11:07.548157] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-09-29T19:11:07.584418] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-29T19:11:07.719485] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-29T19:11:08.348166] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-09-29T19:11:08.929171] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-29T19:11:09.148142] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-09-29T19:11:09.948150] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-09-29T19:11:10.157116] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-29T19:11:10.748117] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-09-29T19:11:11.040535] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-09-29T19:11:11.110886] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-29T19:11:11.548166] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-09-29T19:11:12.248877] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-29T19:11:12.348147] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-09-29T19:11:13.148098] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-09-29T19:11:13.948073] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-09-29T19:11:13.987452] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-29T19:11:14.237112] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-29T19:11:14.348726] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.80 seconds). [2025-09-29T19:11:14.748103] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-09-29T19:11:14.990692] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-29T19:11:15.548132] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-09-29T19:11:16.348121] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-09-29T19:11:17.148114] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-09-29T19:11:17.396942] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-29T19:11:17.582911] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-29T19:11:17.588278] [INFO ] [REMOTE ] HIPO: Full fetch complete (31586 records). [2025-09-29T19:11:17.588533] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-09-29T19:11:17.948116] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-09-29T19:11:18.000350] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (3.25 seconds). [2025-09-29T19:11:18.081185] [INFO ] [REMOTE ] HIMS: Full fetch complete (77935 records). [2025-09-29T19:11:18.084775] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-29T19:11:18.084985] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-09-29T19:11:18.085140] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-09-29T19:11:18.085532] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-09-29T19:11:18.097572] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-09-29T19:11:18.125778] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-09-29T19:11:18.205926] [DEBUG] [LOCAL ] HIPO: Trimmed 31586 records to 22166 (keeping 200 days of data) [2025-09-29T19:11:18.644443] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-09-29T19:11:18.645097] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-09-29T19:11:18.646909] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-09-29T19:11:18.649391] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-09-29T19:11:18.655664] [DEBUG] [LOCAL ] HIMS: Trimmed 77935 records to 53817 (keeping 200 days of data) [2025-09-29T19:11:18.760810] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-09-29T19:11:18.774872] [DEBUG] [LOCAL ] HIPO: Primary data saved (22166 records). [2025-09-29T19:11:18.777001] [INFO ] [MAIN ] HIPO: Full history saved. [2025-09-29T19:11:18.786833] [INFO ] [MAIN ] Update Progress: 1022/2371 symbols completed. HIPO took 28.9s. Estimated remaining: 2h 53m 16s. Rate: 7.8 symbols/min [2025-09-29T19:11:18.986345] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:11:19.072412] [DEBUG] [LOCAL ] HKD: Loaded 18654 existing records from primary storage. [2025-09-29T19:11:19.100585] [INFO ] [MAIN ] HKD: Loaded 18654 existing records. [2025-09-29T19:11:19.323161] [WARN ] [MAIN ] HKD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:11:19.328172] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-09-29T19:11:19.328847] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-09-29T19:11:19.329546] [DEBUG] [LOCAL ] HKD: Deleted primary data file. [2025-09-29T19:11:19.329621] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-09-29T19:11:19.825010] [INFO ] [REMOTE ] HKD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:11:19.848787] [INFO ] [REMOTE ] HKD: Fetching primary data for 2024-12. [2025-09-29T19:11:19.871808] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-29T19:11:19.884852] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-29T19:11:19.896473] [DEBUG] [LOCAL ] HIMS: Primary data saved (53817 records). [2025-09-29T19:11:19.896598] [INFO ] [REMOTE ] HIW: Full fetch complete (64744 records). [2025-09-29T19:11:19.896933] [INFO ] [MAIN ] HIMS: Full history saved. [2025-09-29T19:11:19.896837] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-09-29T19:11:19.897141] [INFO ] [MAIN ] Update Progress: 1023/2371 symbols completed. HIMS took 47.9s. Estimated remaining: 2h 52m 59s. Rate: 7.8 symbols/min [2025-09-29T19:11:20.280776] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:11:20.348185] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-09-29T19:11:20.515706] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-09-29T19:11:20.515805] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-09-29T19:11:20.516910] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-09-29T19:11:20.517217] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-09-29T19:11:20.533161] [DEBUG] [LOCAL ] HIW: Trimmed 64744 records to 44565 (keeping 200 days of data) [2025-09-29T19:11:20.654332] [DEBUG] [LOCAL ] HL: Loaded 54451 existing records from primary storage. [2025-09-29T19:11:20.663711] [INFO ] [MAIN ] HL: Loaded 54451 existing records. [2025-09-29T19:11:20.878580] [WARN ] [MAIN ] HL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:11:20.879611] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-09-29T19:11:20.880034] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-09-29T19:11:20.882052] [DEBUG] [LOCAL ] HL: Deleted primary data file. [2025-09-29T19:11:20.882378] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-09-29T19:11:21.294929] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-29T19:11:21.317960] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-01. [2025-09-29T19:11:21.488673] [INFO ] [REMOTE ] HL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:11:21.472735] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-29T19:11:21.502436] [DEBUG] [LOCAL ] HIW: Primary data saved (44565 records). [2025-09-29T19:11:21.502602] [INFO ] [MAIN ] HIW: Full history saved. [2025-09-29T19:11:21.502769] [INFO ] [MAIN ] Update Progress: 1024/2371 symbols completed. HIW took 28.8s. Estimated remaining: 2h 52m 44s. Rate: 7.8 symbols/min [2025-09-29T19:11:21.684586] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:11:21.748835] [DEBUG] [LOCAL ] HLF: Loaded 49357 existing records from primary storage. [2025-09-29T19:11:21.749294] [INFO ] [MAIN ] HLF: Loaded 49357 existing records. [2025-09-29T19:11:21.962237] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-09-29T19:11:21.976775] [WARN ] [MAIN ] HLF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:11:21.978107] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-09-29T19:11:21.978159] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-09-29T19:11:21.978799] [DEBUG] [LOCAL ] HLF: Deleted primary data file. [2025-09-29T19:11:21.978860] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-09-29T19:11:22.377674] [INFO ] [REMOTE ] HLF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:11:22.537044] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-29T19:11:22.748085] [INFO ] [REMOTE ] HLF: Fetching primary data for 2024-12. [2025-09-29T19:11:23.151861] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-29T19:11:23.548123] [INFO ] [REMOTE ] HL: Fetching primary data for 2024-12. [2025-09-29T19:11:24.348092] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-09-29T19:11:24.544450] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-29T19:11:25.148115] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-09-29T19:11:25.428886] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-29T19:11:25.546054] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-29T19:11:25.948129] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-09-29T19:11:26.354303] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-29T19:11:26.748136] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-09-29T19:11:27.548095] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-01. [2025-09-29T19:11:27.905399] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-29T19:11:27.917569] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-29T19:11:27.923334] [INFO ] [REMOTE ] HIX: Full fetch complete (30587 records). [2025-09-29T19:11:27.923466] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-09-29T19:11:28.339950] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-09-29T19:11:28.340044] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-09-29T19:11:28.340812] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-09-29T19:11:28.340881] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-09-29T19:11:28.341915] [DEBUG] [LOCAL ] HIX: Trimmed 30587 records to 20488 (keeping 200 days of data) [2025-09-29T19:11:28.394940] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-09-29T19:11:28.476091] [DEBUG] [LOCAL ] HIX: Primary data saved (20488 records). [2025-09-29T19:11:28.476226] [INFO ] [MAIN ] HIX: Full history saved. [2025-09-29T19:11:28.476309] [INFO ] [MAIN ] Update Progress: 1025/2371 symbols completed. HIX took 24.5s. Estimated remaining: 2h 52m 35s. Rate: 7.8 symbols/min [2025-09-29T19:11:28.700791] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:11:28.741339] [DEBUG] [LOCAL ] HLI: Loaded 31573 existing records from primary storage. [2025-09-29T19:11:28.741613] [INFO ] [MAIN ] HLI: Loaded 31573 existing records. [2025-09-29T19:11:28.932193] [WARN ] [MAIN ] HLI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:11:28.932544] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-09-29T19:11:28.932604] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-09-29T19:11:28.933203] [DEBUG] [LOCAL ] HLI: Deleted primary data file. [2025-09-29T19:11:28.933263] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-09-29T19:11:29.153359] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-09-29T19:11:29.374426] [INFO ] [REMOTE ] HLI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:11:29.376585] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-29T19:11:29.948149] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-09-29T19:11:30.227103] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-29T19:11:30.269068] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-29T19:11:30.748160] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-09-29T19:11:31.553279] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-09-29T19:11:31.573490] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-29T19:11:32.348115] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-09-29T19:11:32.761433] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-29T19:11:32.788740] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-29T19:11:33.148127] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-09-29T19:11:33.688874] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-29T19:11:33.948118] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-09-29T19:11:34.748135] [INFO ] [REMOTE ] HLI: Fetching primary data for 2024-12. [2025-09-29T19:11:35.148390] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-29T19:11:35.548174] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-09-29T19:11:35.618974] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-29T19:11:35.749858] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-29T19:11:36.348156] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-09-29T19:11:36.554996] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-29T19:11:37.148194] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-09-29T19:11:37.948104] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-01. [2025-09-29T19:11:38.437214] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-29T19:11:38.497507] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-29T19:11:38.748149] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-09-29T19:11:38.975028] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-29T19:11:39.548167] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-09-29T19:11:40.348378] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-09-29T19:11:40.441715] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-29T19:11:40.692171] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-29T19:11:41.148148] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-09-29T19:11:41.531545] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-29T19:11:41.948149] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-09-29T19:11:42.128049] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-29T19:11:42.748151] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-09-29T19:11:43.548112] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-09-29T19:11:43.843663] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-29T19:11:44.127027] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-29T19:11:44.348116] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-09-29T19:11:45.148089] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-09-29T19:11:45.541090] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-29T19:11:45.763342] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-29T19:11:45.948133] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-09-29T19:11:46.606381] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-29T19:11:46.748140] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-09-29T19:11:47.284369] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-29T19:11:47.548506] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-09-29T19:11:48.154462] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-29T19:11:48.160059] [INFO ] [REMOTE ] HKD: Full fetch complete (28530 records). [2025-09-29T19:11:48.160217] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-09-29T19:11:48.348411] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-09-29T19:11:48.562958] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present. [2025-09-29T19:11:48.563041] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed. [2025-09-29T19:11:48.563739] [INFO ] [MAIN ] HKD: Fetched primary data is valid. [2025-09-29T19:11:48.563804] [DEBUG] [LOCAL ] HKD: Saving primary data. [2025-09-29T19:11:48.564698] [DEBUG] [LOCAL ] HKD: Trimmed 28530 records to 18306 (keeping 200 days of data) [2025-09-29T19:11:48.676097] [DEBUG] [LOCAL ] HKD: Primary data saved (18306 records). [2025-09-29T19:11:48.676340] [INFO ] [MAIN ] HKD: Full history saved. [2025-09-29T19:11:48.676495] [INFO ] [MAIN ] Update Progress: 1026/2371 symbols completed. HKD took 29.9s. Estimated remaining: 2h 52m 44s. Rate: 7.8 symbols/min [2025-09-29T19:11:48.863864] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:11:48.898563] [DEBUG] [LOCAL ] HLIO: Loaded 28490 existing records from primary storage. [2025-09-29T19:11:48.898889] [INFO ] [MAIN ] HLIO: Loaded 28490 existing records. [2025-09-29T19:11:49.096561] [WARN ] [MAIN ] HLIO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:11:49.096926] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-09-29T19:11:49.097093] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-09-29T19:11:49.097392] [DEBUG] [LOCAL ] HLIO: Deleted primary data file. [2025-09-29T19:11:49.097455] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-09-29T19:11:49.155165] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-09-29T19:11:49.531203] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:11:49.536885] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-29T19:11:49.737940] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-29T19:11:49.948135] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-09-29T19:11:50.748128] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2024-12. [2025-09-29T19:11:51.265021] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-29T19:11:51.339130] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-29T19:11:51.492547] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-29T19:11:51.548304] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-09-29T19:11:52.348165] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-09-29T19:11:53.148195] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-09-29T19:11:53.334896] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-29T19:11:53.344775] [INFO ] [REMOTE ] HLF: Full fetch complete (71298 records). [2025-09-29T19:11:53.344939] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-09-29T19:11:53.753666] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-09-29T19:11:53.753772] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-09-29T19:11:53.754789] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-09-29T19:11:53.754859] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-09-29T19:11:53.756349] [DEBUG] [LOCAL ] HLF: Trimmed 71298 records to 48569 (keeping 200 days of data) [2025-09-29T19:11:53.958800] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-01. [2025-09-29T19:11:54.050220] [DEBUG] [LOCAL ] HLF: Primary data saved (48569 records). [2025-09-29T19:11:54.050368] [INFO ] [MAIN ] HLF: Full history saved. [2025-09-29T19:11:54.050463] [INFO ] [MAIN ] Update Progress: 1027/2371 symbols completed. HLF took 32.5s. Estimated remaining: 2h 52m 33s. Rate: 7.8 symbols/min [2025-09-29T19:11:54.250045] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:11:54.290810] [DEBUG] [LOCAL ] HLLY: Loaded 33911 existing records from primary storage. [2025-09-29T19:11:54.291139] [INFO ] [MAIN ] HLLY: Loaded 33911 existing records. [2025-09-29T19:11:54.484150] [WARN ] [MAIN ] HLLY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:11:54.485054] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-09-29T19:11:54.485476] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-09-29T19:11:54.496880] [DEBUG] [LOCAL ] HLLY: Deleted primary data file. [2025-09-29T19:11:54.515281] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-09-29T19:11:54.523579] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-29T19:11:54.579063] [INFO ] [REMOTE ] HL: Full fetch complete (77654 records). [2025-09-29T19:11:54.602863] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-09-29T19:11:54.677669] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-29T19:11:54.770179] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-09-29T19:11:55.324074] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-29T19:11:55.318006] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:11:55.433561] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-09-29T19:11:55.433685] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-09-29T19:11:55.434906] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-09-29T19:11:55.434978] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-09-29T19:11:55.436729] [DEBUG] [LOCAL ] HL: Trimmed 77654 records to 53671 (keeping 200 days of data) [2025-09-29T19:11:55.550030] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-09-29T19:11:55.777496] [DEBUG] [LOCAL ] HL: Primary data saved (53671 records). [2025-09-29T19:11:55.777704] [INFO ] [MAIN ] HL: Full history saved. [2025-09-29T19:11:55.777807] [INFO ] [MAIN ] Update Progress: 1028/2371 symbols completed. HL took 35.9s. Estimated remaining: 2h 52m 18s. Rate: 7.8 symbols/min [2025-09-29T19:11:55.960391] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:11:56.021559] [DEBUG] [LOCAL ] HLN: Loaded 53861 existing records from primary storage. [2025-09-29T19:11:56.021940] [INFO ] [MAIN ] HLN: Loaded 53861 existing records. [2025-09-29T19:11:56.221078] [WARN ] [MAIN ] HLN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:11:56.238740] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-09-29T19:11:56.241690] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-09-29T19:11:56.242398] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-29T19:11:56.249025] [DEBUG] [LOCAL ] HLN: Deleted primary data file. [2025-09-29T19:11:56.249587] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-09-29T19:11:56.358152] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2024-12. [2025-09-29T19:11:56.620471] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-29T19:11:56.668017] [INFO ] [REMOTE ] HLN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:11:57.148132] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-09-29T19:11:57.732197] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-29T19:11:57.948177] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-09-29T19:11:58.111560] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-29T19:11:58.117950] [INFO ] [REMOTE ] HLI: Full fetch complete (45369 records). [2025-09-29T19:11:58.118064] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-09-29T19:11:58.548635] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-09-29T19:11:58.548773] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-09-29T19:11:58.549806] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-09-29T19:11:58.549901] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-09-29T19:11:58.551173] [DEBUG] [LOCAL ] HLI: Trimmed 45369 records to 30942 (keeping 200 days of data) [2025-09-29T19:11:58.750750] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-01. [2025-09-29T19:11:58.764523] [DEBUG] [LOCAL ] HLI: Primary data saved (30942 records). [2025-09-29T19:11:58.764661] [INFO ] [MAIN ] HLI: Full history saved. [2025-09-29T19:11:58.764781] [INFO ] [MAIN ] Update Progress: 1029/2371 symbols completed. HLI took 30.3s. Estimated remaining: 2h 52m 4s. Rate: 7.8 symbols/min [2025-09-29T19:11:58.964812] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:11:59.021677] [DEBUG] [LOCAL ] HLT: Loaded 51450 existing records from primary storage. [2025-09-29T19:11:59.022016] [INFO ] [MAIN ] HLT: Loaded 51450 existing records. [2025-09-29T19:11:59.217509] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-29T19:11:59.238176] [WARN ] [MAIN ] HLT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:11:59.243473] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-09-29T19:11:59.243551] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-09-29T19:11:59.244429] [DEBUG] [LOCAL ] HLT: Deleted primary data file. [2025-09-29T19:11:59.244491] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-09-29T19:11:59.550025] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-09-29T19:11:59.639416] [INFO ] [REMOTE ] HLT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:11:59.980635] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-29T19:12:00.348125] [INFO ] [REMOTE ] HLT: Fetching primary data for 2024-12. [2025-09-29T19:12:01.025229] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-29T19:12:01.148158] [INFO ] [REMOTE ] HLN: Fetching primary data for 2024-12. [2025-09-29T19:12:01.948115] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-09-29T19:12:02.122760] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-29T19:12:02.534835] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-29T19:12:02.748145] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-01. [2025-09-29T19:12:02.877246] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-29T19:12:03.548118] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-09-29T19:12:04.211726] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-29T19:12:04.348142] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-09-29T19:12:04.690479] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-29T19:12:05.148159] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-09-29T19:12:05.719231] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-29T19:12:05.948115] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-09-29T19:12:06.757113] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-09-29T19:12:06.777186] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-29T19:12:07.309941] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-29T19:12:07.548108] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-01. [2025-09-29T19:12:07.883737] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-29T19:12:08.348118] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-09-29T19:12:09.148126] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-09-29T19:12:09.375673] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-29T19:12:09.893076] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-29T19:12:09.948071] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-09-29T19:12:10.627315] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-29T19:12:10.748146] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-09-29T19:12:11.548122] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-09-29T19:12:12.025819] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-29T19:12:12.115774] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-29T19:12:12.348118] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-09-29T19:12:12.909009] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-29T19:12:13.148119] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-09-29T19:12:13.298298] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-29T19:12:13.303274] [INFO ] [REMOTE ] HLIO: Full fetch complete (36234 records). [2025-09-29T19:12:13.303405] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-09-29T19:12:13.726710] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-09-29T19:12:13.726849] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-09-29T19:12:13.727749] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-09-29T19:12:13.727815] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-09-29T19:12:13.728712] [DEBUG] [LOCAL ] HLIO: Trimmed 36234 records to 27930 (keeping 200 days of data) [2025-09-29T19:12:13.910451] [DEBUG] [LOCAL ] HLIO: Primary data saved (27930 records). [2025-09-29T19:12:13.910611] [INFO ] [MAIN ] HLIO: Full history saved. [2025-09-29T19:12:13.910737] [INFO ] [MAIN ] Update Progress: 1030/2371 symbols completed. HLIO took 25.2s. Estimated remaining: 2h 52m 6s. Rate: 7.8 symbols/min [2025-09-29T19:12:13.956906] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-09-29T19:12:14.098266] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:12:14.146715] [DEBUG] [LOCAL ] HLX: Loaded 48650 existing records from primary storage. [2025-09-29T19:12:14.147046] [INFO ] [MAIN ] HLX: Loaded 48650 existing records. [2025-09-29T19:12:14.341177] [WARN ] [MAIN ] HLX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:12:14.341483] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-09-29T19:12:14.341549] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-09-29T19:12:14.342178] [DEBUG] [LOCAL ] HLX: Deleted primary data file. [2025-09-29T19:12:14.342241] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-09-29T19:12:14.740816] [INFO ] [REMOTE ] HLX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:12:14.748069] [INFO ] [REMOTE ] HLX: Fetching primary data for 2024-12. [2025-09-29T19:12:14.805237] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-29T19:12:15.548109] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-09-29T19:12:15.920470] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-29T19:12:16.295749] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-29T19:12:16.348116] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-01. [2025-09-29T19:12:17.148111] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-09-29T19:12:17.291570] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-29T19:12:17.517119] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-29T19:12:17.948129] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-09-29T19:12:18.748096] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-09-29T19:12:18.908783] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-29T19:12:19.548090] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-09-29T19:12:19.956313] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-29T19:12:20.204252] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-29T19:12:20.348113] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-09-29T19:12:21.120033] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-29T19:12:21.148115] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-09-29T19:12:21.948105] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-09-29T19:12:22.183161] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-29T19:12:22.263989] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-29T19:12:22.748136] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-09-29T19:12:23.289110] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-29T19:12:23.548130] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-09-29T19:12:23.823951] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-29T19:12:24.348178] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-09-29T19:12:25.148088] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-09-29T19:12:25.259572] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-29T19:12:25.948073] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-09-29T19:12:26.070526] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-29T19:12:26.748100] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-09-29T19:12:26.952387] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-29T19:12:27.548084] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-09-29T19:12:28.016740] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-29T19:12:28.028797] [INFO ] [REMOTE ] HLN: Full fetch complete (76780 records). [2025-09-29T19:12:28.028980] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-09-29T19:12:28.356365] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-09-29T19:12:28.449033] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-09-29T19:12:28.449143] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-09-29T19:12:28.450457] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-09-29T19:12:28.450541] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-09-29T19:12:28.452438] [DEBUG] [LOCAL ] HLN: Trimmed 76780 records to 53085 (keeping 200 days of data) [2025-09-29T19:12:28.717830] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-29T19:12:28.841962] [DEBUG] [LOCAL ] HLN: Primary data saved (53085 records). [2025-09-29T19:12:28.842111] [INFO ] [MAIN ] HLN: Full history saved. [2025-09-29T19:12:28.842200] [INFO ] [MAIN ] Update Progress: 1031/2371 symbols completed. HLN took 33.1s. Estimated remaining: 2h 52m 7s. Rate: 7.8 symbols/min [2025-09-29T19:12:29.061039] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:12:29.063861] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-29T19:12:29.128905] [DEBUG] [LOCAL ] HMC: Loaded 47500 existing records from primary storage. [2025-09-29T19:12:29.129234] [INFO ] [MAIN ] HMC: Loaded 47500 existing records. [2025-09-29T19:12:29.160342] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-09-29T19:12:29.318815] [WARN ] [MAIN ] HMC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:12:29.319026] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-09-29T19:12:29.319075] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-09-29T19:12:29.319872] [DEBUG] [LOCAL ] HMC: Deleted primary data file. [2025-09-29T19:12:29.319936] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-09-29T19:12:29.725261] [INFO ] [REMOTE ] HMC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:12:29.930465] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-29T19:12:29.948069] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-09-29T19:12:30.712637] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-29T19:12:30.748152] [INFO ] [REMOTE ] HMC: Fetching primary data for 2024-12. [2025-09-29T19:12:31.447728] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-29T19:12:31.455967] [INFO ] [REMOTE ] HLLY: Full fetch complete (46095 records). [2025-09-29T19:12:31.456139] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-09-29T19:12:31.556371] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-09-29T19:12:31.892228] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-09-29T19:12:31.892353] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-09-29T19:12:31.893337] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-09-29T19:12:31.893455] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-09-29T19:12:31.894687] [DEBUG] [LOCAL ] HLLY: Trimmed 46095 records to 33226 (keeping 200 days of data) [2025-09-29T19:12:32.088810] [DEBUG] [LOCAL ] HLLY: Primary data saved (33226 records). [2025-09-29T19:12:32.088977] [INFO ] [MAIN ] HLLY: Full history saved. [2025-09-29T19:12:32.089076] [INFO ] [MAIN ] Update Progress: 1032/2371 symbols completed. HLLY took 38.0s. Estimated remaining: 2h 51m 54s. Rate: 7.8 symbols/min [2025-09-29T19:12:32.272039] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:12:32.297637] [DEBUG] [LOCAL ] HMN: Loaded 23671 existing records from primary storage. [2025-09-29T19:12:32.297967] [INFO ] [MAIN ] HMN: Loaded 23671 existing records. [2025-09-29T19:12:32.352289] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-09-29T19:12:32.515671] [WARN ] [MAIN ] HMN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:12:32.516064] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-09-29T19:12:32.516158] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-09-29T19:12:32.516733] [DEBUG] [LOCAL ] HMN: Deleted primary data file. [2025-09-29T19:12:32.516800] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-09-29T19:12:32.929273] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-29T19:12:32.977408] [INFO ] [REMOTE ] HMN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:12:33.168884] [INFO ] [REMOTE ] HMN: Fetching primary data for 2024-12. [2025-09-29T19:12:33.190208] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-29T19:12:33.885404] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-29T19:12:33.921472] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-29T19:12:33.948141] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-01. [2025-09-29T19:12:34.748159] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-01. [2025-09-29T19:12:34.930730] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-29T19:12:35.548166] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-09-29T19:12:36.348122] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-09-29T19:12:36.596585] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-29T19:12:36.819183] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-29T19:12:37.148158] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-09-29T19:12:37.896531] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-29T19:12:37.907266] [INFO ] [REMOTE ] HLT: Full fetch complete (73407 records). [2025-09-29T19:12:37.907412] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-09-29T19:12:37.953219] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-09-29T19:12:38.330191] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-09-29T19:12:38.330321] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-09-29T19:12:38.331474] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-09-29T19:12:38.331542] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-09-29T19:12:38.333073] [DEBUG] [LOCAL ] HLT: Trimmed 73407 records to 50632 (keeping 200 days of data) [2025-09-29T19:12:38.680334] [DEBUG] [LOCAL ] HLT: Primary data saved (50632 records). [2025-09-29T19:12:38.680495] [INFO ] [MAIN ] HLT: Full history saved. [2025-09-29T19:12:38.680604] [INFO ] [MAIN ] Update Progress: 1033/2371 symbols completed. HLT took 39.9s. Estimated remaining: 2h 51m 45s. Rate: 7.8 symbols/min [2025-09-29T19:12:38.750426] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-09-29T19:12:38.865837] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:12:38.924835] [DEBUG] [LOCAL ] HMY: Loaded 53914 existing records from primary storage. [2025-09-29T19:12:38.925171] [INFO ] [MAIN ] HMY: Loaded 53914 existing records. [2025-09-29T19:12:39.144986] [WARN ] [MAIN ] HMY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:12:39.147657] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-29T19:12:39.156909] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-09-29T19:12:39.157553] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-09-29T19:12:39.158220] [DEBUG] [LOCAL ] HMY: Deleted primary data file. [2025-09-29T19:12:39.158287] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-09-29T19:12:39.536462] [INFO ] [REMOTE ] HMY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:12:39.548122] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-09-29T19:12:39.859357] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-29T19:12:39.909742] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-29T19:12:40.348134] [INFO ] [REMOTE ] HMY: Fetching primary data for 2024-12. [2025-09-29T19:12:41.148148] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-09-29T19:12:41.379867] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-29T19:12:41.948160] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-09-29T19:12:42.402550] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-29T19:12:42.454328] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-29T19:12:42.748169] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-09-29T19:12:43.548175] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-09-29T19:12:43.688309] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-29T19:12:43.698972] [INFO ] [REMOTE ] HLX: Full fetch complete (69201 records). [2025-09-29T19:12:43.699151] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-09-29T19:12:44.283001] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present. [2025-09-29T19:12:44.283142] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed. [2025-09-29T19:12:44.286453] [INFO ] [MAIN ] HLX: Fetched primary data is valid. [2025-09-29T19:12:44.286743] [DEBUG] [LOCAL ] HLX: Saving primary data. [2025-09-29T19:12:44.288978] [DEBUG] [LOCAL ] HLX: Trimmed 69201 records to 47869 (keeping 200 days of data) [2025-09-29T19:12:44.368561] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-09-29T19:12:44.760516] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-29T19:12:44.774319] [DEBUG] [LOCAL ] HLX: Primary data saved (47869 records). [2025-09-29T19:12:44.775585] [INFO ] [MAIN ] HLX: Full history saved. [2025-09-29T19:12:44.775739] [INFO ] [MAIN ] Update Progress: 1034/2371 symbols completed. HLX took 30.9s. Estimated remaining: 2h 51m 35s. Rate: 7.8 symbols/min [2025-09-29T19:12:44.988883] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:12:45.010149] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-29T19:12:45.009319] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-09-29T19:12:45.016376] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-09-29T19:12:45.017046] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-09-29T19:12:45.017420] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-29T19:12:45.017485] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-29T19:12:45.017541] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-09-29T19:12:45.153235] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-09-29T19:12:45.402167] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:12:45.948082] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-09-29T19:12:46.254933] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-29T19:12:46.322697] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-29T19:12:46.748152] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-09-29T19:12:47.548194] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-09-29T19:12:47.808558] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-29T19:12:48.348096] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-09-29T19:12:48.465209] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-29T19:12:48.750151] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-29T19:12:49.148121] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-09-29T19:12:49.948096] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2024-12. [2025-09-29T19:12:50.161100] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T19:12:50.161424] [WARN ] [REMOTE ] HNGE: No data returned for month 2024-12 [2025-09-29T19:12:50.161546] [FATAL] [REMOTE ] HNGE: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T19:12:50.161616] [FATAL] [MAIN ] HNGE: Failed to fetch primary data. [2025-09-29T19:12:50.161707] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T19:12:50.161800] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-29T19:12:50.161905] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-29T19:12:50.161961] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-09-29T19:12:50.162024] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-09-29T19:12:50.162104] [INFO ] [MAIN ] Update Progress: 1035/2371 symbols completed. HNGE took 5.4s. Estimated remaining: 2h 51m 24s. Rate: 7.8 symbols/min [2025-09-29T19:12:50.327860] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-29T19:12:50.362722] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:12:50.434110] [DEBUG] [LOCAL ] HNI: Loaded 29386 existing records from primary storage. [2025-09-29T19:12:50.434569] [INFO ] [MAIN ] HNI: Loaded 29386 existing records. [2025-09-29T19:12:50.496116] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-29T19:12:50.658025] [WARN ] [MAIN ] HNI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:12:50.658244] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-09-29T19:12:50.658293] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-09-29T19:12:50.658587] [DEBUG] [LOCAL ] HNI: Deleted primary data file. [2025-09-29T19:12:50.658683] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-09-29T19:12:50.753296] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-09-29T19:12:51.055843] [INFO ] [REMOTE ] HNI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:12:51.548128] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-09-29T19:12:52.348162] [INFO ] [REMOTE ] HNI: Fetching primary data for 2024-12. [2025-09-29T19:12:52.696984] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-29T19:12:52.701890] [INFO ] [REMOTE ] HMN: Full fetch complete (31644 records). [2025-09-29T19:12:52.701987] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-09-29T19:12:53.136972] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-09-29T19:12:53.136882] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-29T19:12:53.137136] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-09-29T19:12:53.148934] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-09-29T19:12:53.148877] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-09-29T19:12:53.150297] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-09-29T19:12:53.151558] [DEBUG] [LOCAL ] HMN: Trimmed 31644 records to 23360 (keeping 200 days of data) [2025-09-29T19:12:53.316415] [DEBUG] [LOCAL ] HMN: Primary data saved (23360 records). [2025-09-29T19:12:53.316755] [INFO ] [MAIN ] HMN: Full history saved. [2025-09-29T19:12:53.325463] [INFO ] [MAIN ] Update Progress: 1036/2371 symbols completed. HMN took 21.2s. Estimated remaining: 2h 51m 11s. Rate: 7.8 symbols/min [2025-09-29T19:12:53.370891] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-29T19:12:53.523701] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:12:53.584290] [DEBUG] [LOCAL ] HOG: Loaded 51958 existing records from primary storage. [2025-09-29T19:12:53.584624] [INFO ] [MAIN ] HOG: Loaded 51958 existing records. [2025-09-29T19:12:53.772840] [WARN ] [MAIN ] HOG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:12:53.773072] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-09-29T19:12:53.773120] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-09-29T19:12:53.773794] [DEBUG] [LOCAL ] HOG: Deleted primary data file. [2025-09-29T19:12:53.773855] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-09-29T19:12:53.948522] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-09-29T19:12:54.179596] [INFO ] [REMOTE ] HOG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:12:54.752290] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-01. [2025-09-29T19:12:54.758081] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-29T19:12:55.548156] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-09-29T19:12:55.926389] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-29T19:12:55.985857] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-29T19:12:56.348158] [INFO ] [REMOTE ] HOG: Fetching primary data for 2024-12. [2025-09-29T19:12:57.148154] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-09-29T19:12:57.430144] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-29T19:12:57.948126] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-09-29T19:12:58.024025] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-29T19:12:58.398134] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-29T19:12:58.748146] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-09-29T19:12:59.548835] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-01. [2025-09-29T19:12:59.553513] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-29T19:13:00.348163] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-09-29T19:13:00.724798] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-29T19:13:00.869562] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-29T19:13:01.148108] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-09-29T19:13:01.948102] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-09-29T19:13:02.132602] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-29T19:13:02.142944] [INFO ] [REMOTE ] HMC: Full fetch complete (69484 records). [2025-09-29T19:13:02.143084] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-09-29T19:13:02.573302] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-09-29T19:13:02.573385] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-09-29T19:13:02.574564] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-09-29T19:13:02.574631] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-09-29T19:13:02.578623] [DEBUG] [LOCAL ] HMC: Trimmed 69484 records to 46704 (keeping 200 days of data) [2025-09-29T19:13:02.749031] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-09-29T19:13:02.873020] [DEBUG] [LOCAL ] HMC: Primary data saved (46704 records). [2025-09-29T19:13:02.873203] [INFO ] [MAIN ] HMC: Full history saved. [2025-09-29T19:13:02.873298] [INFO ] [MAIN ] Update Progress: 1037/2371 symbols completed. HMC took 34.0s. Estimated remaining: 2h 51m 5s. Rate: 7.8 symbols/min [2025-09-29T19:13:02.943063] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-29T19:13:03.135858] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-29T19:13:03.548198] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-09-29T19:13:04.348117] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-09-29T19:13:04.530158] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-29T19:13:04.742629] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-29T19:13:05.148112] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-09-29T19:13:05.948104] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-09-29T19:13:06.223740] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-29T19:13:06.576549] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-29T19:13:06.748116] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-09-29T19:13:07.548152] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-09-29T19:13:07.839999] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-29T19:13:07.911302] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-29T19:13:08.348118] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-09-29T19:13:09.148104] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-09-29T19:13:09.352747] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-29T19:13:09.687752] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-29T19:13:09.705112] [INFO ] [REMOTE ] HMY: Full fetch complete (76670 records). [2025-09-29T19:13:09.705330] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-09-29T19:13:09.953357] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-09-29T19:13:10.179184] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-09-29T19:13:10.179363] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-09-29T19:13:10.181180] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-09-29T19:13:10.181283] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-09-29T19:13:10.183162] [DEBUG] [LOCAL ] HMY: Trimmed 76670 records to 53136 (keeping 200 days of data) [2025-09-29T19:13:10.552059] [DEBUG] [LOCAL ] HMY: Primary data saved (53136 records). [2025-09-29T19:13:10.552230] [INFO ] [MAIN ] HMY: Full history saved. [2025-09-29T19:13:10.552355] [INFO ] [MAIN ] Update Progress: 1038/2371 symbols completed. HMY took 31.9s. Estimated remaining: 2h 50m 58s. Rate: 7.8 symbols/min [2025-09-29T19:13:10.862324] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-29T19:13:10.874100] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-09-29T19:13:11.480839] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-29T19:13:11.548141] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-09-29T19:13:13.587287] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (2.71 seconds). [2025-09-29T19:13:13.603465] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-09-29T19:13:14.760486] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (3.21 seconds). [2025-09-29T19:13:14.769106] [INFO ] [REMOTE ] HNI: Full fetch complete (41498 records). [2025-09-29T19:13:14.769215] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-09-29T19:13:15.183440] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-09-29T19:13:15.183548] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-09-29T19:13:15.184552] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-09-29T19:13:15.184679] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-09-29T19:13:15.185833] [DEBUG] [LOCAL ] HNI: Trimmed 41498 records to 29037 (keeping 200 days of data) [2025-09-29T19:13:15.392459] [DEBUG] [LOCAL ] HNI: Primary data saved (29037 records). [2025-09-29T19:13:15.392714] [INFO ] [MAIN ] HNI: Full history saved. [2025-09-29T19:13:15.392853] [INFO ] [MAIN ] Update Progress: 1039/2371 symbols completed. HNI took 25.2s. Estimated remaining: 2h 50m 46s. Rate: 7.8 symbols/min [2025-09-29T19:13:15.776125] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-29T19:13:15.786877] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-09-29T19:13:17.643406] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-29T19:13:17.655711] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-09-29T19:13:19.416115] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-29T19:13:19.428062] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-09-29T19:13:21.282558] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-29T19:13:21.293818] [INFO ] [REMOTE ] HOG: Full fetch complete (74225 records). [2025-09-29T19:13:21.294012] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-09-29T19:13:21.714607] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-09-29T19:13:21.714749] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-09-29T19:13:21.716216] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-09-29T19:13:21.716294] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-09-29T19:13:21.718836] [DEBUG] [LOCAL ] HOG: Trimmed 74225 records to 51157 (keeping 200 days of data) [2025-09-29T19:13:22.059125] [DEBUG] [LOCAL ] HOG: Primary data saved (51157 records). [2025-09-29T19:13:22.059283] [INFO ] [MAIN ] HOG: Full history saved. [2025-09-29T19:13:22.059420] [INFO ] [MAIN ] Update Progress: 1040/2371 symbols completed. HOG took 28.7s. Estimated remaining: 2h 50m 37s. Rate: 7.8 symbols/min [2025-09-29T19:13:22.669007] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:13:22.718232] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:13:22.842525] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:13:22.873280] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:13:22.880631] [DEBUG] [LOCAL ] HOV: Loaded 13975 existing records from primary storage. [2025-09-29T19:13:22.880989] [INFO ] [MAIN ] HOV: Loaded 13975 existing records. [2025-09-29T19:13:23.046560] [DEBUG] [LOCAL ] HOMB: Loaded 44272 existing records from primary storage. [2025-09-29T19:13:23.088240] [INFO ] [MAIN ] HOMB: Loaded 44272 existing records. [2025-09-29T19:13:23.204101] [DEBUG] [LOCAL ] HOUS: Loaded 44903 existing records from primary storage. [2025-09-29T19:13:23.210854] [WARN ] [MAIN ] HOV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:13:23.217391] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-09-29T19:13:23.222729] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-09-29T19:13:23.228966] [INFO ] [MAIN ] HOUS: Loaded 44903 existing records. [2025-09-29T19:13:23.254993] [DEBUG] [LOCAL ] HOV: Deleted primary data file. [2025-09-29T19:13:23.281750] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-09-29T19:13:23.464958] [DEBUG] [LOCAL ] HP: Loaded 52313 existing records from primary storage. [2025-09-29T19:13:23.594406] [INFO ] [MAIN ] HP: Loaded 52313 existing records. [2025-09-29T19:13:23.751599] [WARN ] [MAIN ] HOMB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:13:23.885816] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-09-29T19:13:23.917012] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-09-29T19:13:23.873836] [WARN ] [MAIN ] HOUS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:13:23.962281] [DEBUG] [LOCAL ] HOMB: Deleted primary data file. [2025-09-29T19:13:23.938029] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-09-29T19:13:23.968270] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-09-29T19:13:24.016725] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-09-29T19:13:24.164421] [DEBUG] [LOCAL ] HOUS: Deleted primary data file. [2025-09-29T19:13:24.206738] [WARN ] [MAIN ] HP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:13:24.232992] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-09-29T19:13:24.248616] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-09-29T19:13:24.248908] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-09-29T19:13:24.450691] [INFO ] [REMOTE ] HOV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:13:24.472748] [INFO ] [REMOTE ] HOV: Fetching primary data for 2024-12. [2025-09-29T19:13:24.429931] [DEBUG] [LOCAL ] HP: Deleted primary data file. [2025-09-29T19:13:24.504690] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-09-29T19:13:25.183117] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:13:25.193413] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2024-12. [2025-09-29T19:13:25.363072] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:13:25.375338] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2024-12. [2025-09-29T19:13:25.464786] [INFO ] [REMOTE ] HP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:13:25.465158] [INFO ] [REMOTE ] HP: Fetching primary data for 2024-12. [2025-09-29T19:13:25.787715] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-29T19:13:25.791539] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-01. [2025-09-29T19:13:27.653580] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-29T19:13:27.658561] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-09-29T19:13:27.849539] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-09-29T19:13:27.858786] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-01. [2025-09-29T19:13:27.889122] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2024-12 (2.70 seconds). [2025-09-29T19:13:27.898441] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-01. [2025-09-29T19:13:28.121962] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2024-12 (2.66 seconds). [2025-09-29T19:13:28.134416] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-01. [2025-09-29T19:13:28.277634] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-29T19:13:28.280808] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-09-29T19:13:29.305011] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-29T19:13:29.321118] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-09-29T19:13:29.322776] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-29T19:13:29.333969] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-09-29T19:13:29.542638] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-29T19:13:29.552945] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-09-29T19:13:29.633750] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-29T19:13:29.643997] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-09-29T19:13:30.373250] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-29T19:13:30.377264] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-09-29T19:13:30.623837] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-29T19:13:30.633039] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-09-29T19:13:30.759072] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-29T19:13:30.767406] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-09-29T19:13:31.176376] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-29T19:13:31.179505] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-09-29T19:13:31.423825] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-29T19:13:31.434761] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-09-29T19:13:31.870997] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-29T19:13:31.875424] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-09-29T19:13:32.009383] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-29T19:13:32.019752] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-09-29T19:13:32.193116] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-29T19:13:32.348169] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-09-29T19:13:32.839132] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-29T19:13:33.023214] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-29T19:13:33.148127] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-09-29T19:13:33.354447] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-29T19:13:33.540293] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-29T19:13:33.948174] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-09-29T19:13:34.748086] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-09-29T19:13:34.951281] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-29T19:13:35.008730] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-29T19:13:35.548133] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-09-29T19:13:36.307040] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-29T19:13:36.348193] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-09-29T19:13:37.148142] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-09-29T19:13:37.527708] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-29T19:13:37.622764] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-29T19:13:37.626364] [INFO ] [REMOTE ] HOV: Full fetch complete (19399 records). [2025-09-29T19:13:37.626465] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-09-29T19:13:37.953189] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-09-29T19:13:38.070946] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-09-29T19:13:38.071035] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-09-29T19:13:38.071519] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-09-29T19:13:38.071560] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-09-29T19:13:38.072258] [DEBUG] [LOCAL ] HOV: Trimmed 19399 records to 13801 (keeping 200 days of data) [2025-09-29T19:13:38.158384] [DEBUG] [LOCAL ] HOV: Primary data saved (13801 records). [2025-09-29T19:13:38.158527] [INFO ] [MAIN ] HOV: Full history saved. [2025-09-29T19:13:38.158620] [INFO ] [MAIN ] Update Progress: 1041/2371 symbols completed. HOV took 16.1s. Estimated remaining: 2h 50m 40s. Rate: 7.8 symbols/min [2025-09-29T19:13:38.346378] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:13:38.407878] [DEBUG] [LOCAL ] HPE: Loaded 54477 existing records from primary storage. [2025-09-29T19:13:38.408224] [INFO ] [MAIN ] HPE: Loaded 54477 existing records. [2025-09-29T19:13:38.612557] [WARN ] [MAIN ] HPE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:13:38.613435] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-09-29T19:13:38.613523] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-09-29T19:13:38.614326] [DEBUG] [LOCAL ] HPE: Deleted primary data file. [2025-09-29T19:13:38.614416] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-09-29T19:13:38.752483] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-09-29T19:13:38.856437] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-29T19:13:39.069349] [INFO ] [REMOTE ] HPE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:13:39.316110] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-29T19:13:39.548168] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-09-29T19:13:40.205060] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-29T19:13:40.348153] [INFO ] [REMOTE ] HPE: Fetching primary data for 2024-12. [2025-09-29T19:13:41.123367] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-29T19:13:41.148089] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-09-29T19:13:41.948087] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-09-29T19:13:42.410631] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-29T19:13:42.722022] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-29T19:13:42.748114] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-09-29T19:13:43.129720] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-29T19:13:43.548152] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-09-29T19:13:44.326244] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-29T19:13:44.348089] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-09-29T19:13:44.845335] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-29T19:13:45.148149] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-09-29T19:13:45.953231] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-01. [2025-09-29T19:13:45.969793] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-29T19:13:45.980052] [INFO ] [REMOTE ] HOMB: Full fetch complete (63890 records). [2025-09-29T19:13:45.980231] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-09-29T19:13:46.376891] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-09-29T19:13:46.376987] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-09-29T19:13:46.378114] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-09-29T19:13:46.378195] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-09-29T19:13:46.379663] [DEBUG] [LOCAL ] HOMB: Trimmed 63890 records to 43516 (keeping 200 days of data) [2025-09-29T19:13:46.660101] [DEBUG] [LOCAL ] HOMB: Primary data saved (43516 records). [2025-09-29T19:13:46.660291] [INFO ] [MAIN ] HOMB: Full history saved. [2025-09-29T19:13:46.660484] [INFO ] [MAIN ] Update Progress: 1042/2371 symbols completed. HOMB took 24.6s. Estimated remaining: 2h 50m 34s. Rate: 7.8 symbols/min [2025-09-29T19:13:46.758248] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-09-29T19:13:46.850088] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:13:46.860261] [DEBUG] [LOCAL ] HPF: Loaded 7388 existing records from primary storage. [2025-09-29T19:13:46.860499] [INFO ] [MAIN ] HPF: Loaded 7388 existing records. [2025-09-29T19:13:47.046326] [WARN ] [MAIN ] HPF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:13:47.046680] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-09-29T19:13:47.046803] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-09-29T19:13:47.047093] [DEBUG] [LOCAL ] HPF: Deleted primary data file. [2025-09-29T19:13:47.047160] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-09-29T19:13:47.209326] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-29T19:13:47.525468] [INFO ] [REMOTE ] HPF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:13:47.548087] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-09-29T19:13:48.016531] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-29T19:13:48.348110] [INFO ] [REMOTE ] HPF: Fetching primary data for 2024-12. [2025-09-29T19:13:48.396760] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-29T19:13:48.919098] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-29T19:13:48.930197] [INFO ] [REMOTE ] HP: Full fetch complete (73936 records). [2025-09-29T19:13:48.930364] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-09-29T19:13:49.150024] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-29T19:13:49.149389] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-09-29T19:13:49.365607] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-09-29T19:13:49.365733] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-09-29T19:13:49.366872] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-09-29T19:13:49.366952] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-09-29T19:13:49.368581] [DEBUG] [LOCAL ] HP: Trimmed 73936 records to 51572 (keeping 200 days of data) [2025-09-29T19:13:49.704013] [DEBUG] [LOCAL ] HP: Primary data saved (51572 records). [2025-09-29T19:13:49.704158] [INFO ] [MAIN ] HP: Full history saved. [2025-09-29T19:13:49.704247] [INFO ] [MAIN ] Update Progress: 1043/2371 symbols completed. HP took 27.6s. Estimated remaining: 2h 50m 20s. Rate: 7.8 symbols/min [2025-09-29T19:13:49.878271] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:13:49.891120] [DEBUG] [LOCAL ] HPI: Loaded 10339 existing records from primary storage. [2025-09-29T19:13:49.891325] [INFO ] [MAIN ] HPI: Loaded 10339 existing records. [2025-09-29T19:13:49.960031] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-09-29T19:13:50.080450] [WARN ] [MAIN ] HPI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:13:50.080681] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-09-29T19:13:50.080740] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-09-29T19:13:50.080931] [DEBUG] [LOCAL ] HPI: Deleted primary data file. [2025-09-29T19:13:50.080989] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-09-29T19:13:50.452377] [INFO ] [REMOTE ] HPI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:13:50.748112] [INFO ] [REMOTE ] HPI: Fetching primary data for 2024-12. [2025-09-29T19:13:51.119303] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-29T19:13:51.129835] [INFO ] [REMOTE ] HOUS: Full fetch complete (63169 records). [2025-09-29T19:13:51.130001] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-09-29T19:13:51.257147] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-29T19:13:51.558339] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-09-29T19:13:51.554877] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-01. [2025-09-29T19:13:51.559066] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-09-29T19:13:51.561297] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-09-29T19:13:51.561493] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-09-29T19:13:51.563052] [DEBUG] [LOCAL ] HOUS: Trimmed 63169 records to 44315 (keeping 200 days of data) [2025-09-29T19:13:51.835198] [DEBUG] [LOCAL ] HOUS: Primary data saved (44315 records). [2025-09-29T19:13:51.835338] [INFO ] [MAIN ] HOUS: Full history saved. [2025-09-29T19:13:51.835436] [INFO ] [MAIN ] Update Progress: 1044/2371 symbols completed. HOUS took 29.8s. Estimated remaining: 2h 50m 5s. Rate: 7.8 symbols/min [2025-09-29T19:13:52.022375] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:13:52.057390] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-29T19:13:52.124056] [DEBUG] [LOCAL ] HPP: Loaded 51595 existing records from primary storage. [2025-09-29T19:13:52.124512] [INFO ] [MAIN ] HPP: Loaded 51595 existing records. [2025-09-29T19:13:52.355415] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-09-29T19:13:52.362323] [WARN ] [MAIN ] HPP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:13:52.363750] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-09-29T19:13:52.363816] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-09-29T19:13:52.364241] [DEBUG] [LOCAL ] HPP: Deleted primary data file. [2025-09-29T19:13:52.364304] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-09-29T19:13:52.481971] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-29T19:13:52.769788] [INFO ] [REMOTE ] HPP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:13:53.148149] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-09-29T19:13:53.948170] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-09-29T19:13:53.967473] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-29T19:13:54.477848] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-29T19:13:54.549738] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-29T19:13:54.748183] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-09-29T19:13:55.461880] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-29T19:13:55.548104] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-09-29T19:13:56.348406] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-09-29T19:13:56.348808] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-29T19:13:57.148104] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-09-29T19:13:57.810353] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-29T19:13:57.948142] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-09-29T19:13:58.616006] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-29T19:13:58.710769] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-29T19:13:58.748097] [INFO ] [REMOTE ] HPP: Fetching primary data for 2024-12. [2025-09-29T19:13:59.548119] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-09-29T19:14:00.318131] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-29T19:14:00.348104] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-09-29T19:14:00.431032] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-29T19:14:01.148097] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-09-29T19:14:01.227993] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-29T19:14:01.948135] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-09-29T19:14:02.748122] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-09-29T19:14:02.765417] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-29T19:14:03.198415] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-29T19:14:03.475444] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-29T19:14:03.548117] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-01. [2025-09-29T19:14:04.348119] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-09-29T19:14:05.148103] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-09-29T19:14:05.280965] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-29T19:14:05.855325] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-29T19:14:05.948096] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-09-29T19:14:06.288898] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-29T19:14:06.748122] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-09-29T19:14:07.551128] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-09-29T19:14:07.557029] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-29T19:14:08.348136] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-09-29T19:14:08.583601] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-29T19:14:08.588187] [INFO ] [REMOTE ] HPI: Full fetch complete (13632 records). [2025-09-29T19:14:08.588346] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-09-29T19:14:08.918264] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-29T19:14:09.014171] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-09-29T19:14:09.014280] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-09-29T19:14:09.014741] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-09-29T19:14:09.014913] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-09-29T19:14:09.015938] [DEBUG] [LOCAL ] HPI: Trimmed 13632 records to 10210 (keeping 200 days of data) [2025-09-29T19:14:09.101198] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-09-29T19:14:09.133081] [DEBUG] [LOCAL ] HPI: Primary data saved (10210 records). [2025-09-29T19:14:09.133233] [INFO ] [MAIN ] HPI: Full history saved. [2025-09-29T19:14:09.133322] [INFO ] [MAIN ] Update Progress: 1045/2371 symbols completed. HPI took 19.4s. Estimated remaining: 2h 50m 10s. Rate: 7.8 symbols/min [2025-09-29T19:14:09.156619] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-09-29T19:14:09.319488] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:14:09.381360] [DEBUG] [LOCAL ] HPQ: Loaded 54448 existing records from primary storage. [2025-09-29T19:14:09.381748] [INFO ] [MAIN ] HPQ: Loaded 54448 existing records. [2025-09-29T19:14:09.575469] [WARN ] [MAIN ] HPQ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:14:09.575717] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-09-29T19:14:09.575790] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-09-29T19:14:09.576424] [DEBUG] [LOCAL ] HPQ: Deleted primary data file. [2025-09-29T19:14:09.576488] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-09-29T19:14:09.950935] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-09-29T19:14:09.958219] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:14:10.021595] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-29T19:14:10.748110] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-09-29T19:14:11.508043] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-29T19:14:11.542930] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-29T19:14:11.553306] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-09-29T19:14:12.282244] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-29T19:14:12.348096] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-09-29T19:14:13.148149] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-09-29T19:14:13.948122] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2024-12. [2025-09-29T19:14:14.687578] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-29T19:14:14.690081] [INFO ] [REMOTE ] HPF: Full fetch complete (10853 records). [2025-09-29T19:14:14.690161] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-09-29T19:14:14.764269] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-09-29T19:14:15.149327] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-09-29T19:14:15.149971] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-09-29T19:14:15.152683] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-29T19:14:15.153241] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-09-29T19:14:15.157989] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-09-29T19:14:15.166686] [DEBUG] [LOCAL ] HPF: Trimmed 10853 records to 7335 (keeping 200 days of data) [2025-09-29T19:14:15.216509] [DEBUG] [LOCAL ] HPF: Primary data saved (7335 records). [2025-09-29T19:14:15.216704] [INFO ] [MAIN ] HPF: Full history saved. [2025-09-29T19:14:15.216814] [INFO ] [MAIN ] Update Progress: 1046/2371 symbols completed. HPF took 28.6s. Estimated remaining: 2h 50m 0s. Rate: 7.8 symbols/min [2025-09-29T19:14:15.400042] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:14:15.415902] [DEBUG] [LOCAL ] HPS: Loaded 10277 existing records from primary storage. [2025-09-29T19:14:15.416210] [INFO ] [MAIN ] HPS: Loaded 10277 existing records. [2025-09-29T19:14:15.549595] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-09-29T19:14:15.624461] [WARN ] [MAIN ] HPS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:14:15.624953] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-09-29T19:14:15.625122] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-09-29T19:14:15.625525] [DEBUG] [LOCAL ] HPS: Deleted primary data file. [2025-09-29T19:14:15.625587] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-09-29T19:14:16.021894] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-29T19:14:16.099404] [INFO ] [REMOTE ] HPS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:14:16.348101] [INFO ] [REMOTE ] HPS: Fetching primary data for 2024-12. [2025-09-29T19:14:16.508738] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-29T19:14:16.861156] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-29T19:14:17.148100] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-01. [2025-09-29T19:14:17.290621] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-29T19:14:17.948148] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-09-29T19:14:18.098582] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-29T19:14:18.748141] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-09-29T19:14:19.548130] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-01. [2025-09-29T19:14:20.094265] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-29T19:14:20.105957] [INFO ] [REMOTE ] HPE: Full fetch complete (77732 records). [2025-09-29T19:14:20.106141] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-09-29T19:14:20.351947] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-09-29T19:14:20.540835] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-09-29T19:14:20.540960] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-09-29T19:14:20.542162] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-09-29T19:14:20.542310] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-09-29T19:14:20.555920] [DEBUG] [LOCAL ] HPE: Trimmed 77732 records to 53697 (keeping 200 days of data) [2025-09-29T19:14:20.678559] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-29T19:14:20.964627] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-29T19:14:20.999749] [DEBUG] [LOCAL ] HPE: Primary data saved (53697 records). [2025-09-29T19:14:20.999909] [INFO ] [MAIN ] HPE: Full history saved. [2025-09-29T19:14:21.000028] [INFO ] [MAIN ] Update Progress: 1047/2371 symbols completed. HPE took 42.8s. Estimated remaining: 2h 49m 50s. Rate: 7.8 symbols/min [2025-09-29T19:14:21.153778] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-09-29T19:14:21.183243] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:14:21.209326] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-29T19:14:21.222300] [DEBUG] [LOCAL ] HQH: Loaded 25387 existing records from primary storage. [2025-09-29T19:14:21.222610] [INFO ] [MAIN ] HQH: Loaded 25387 existing records. [2025-09-29T19:14:21.402269] [WARN ] [MAIN ] HQH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:14:21.402508] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-09-29T19:14:21.402558] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-09-29T19:14:21.402804] [DEBUG] [LOCAL ] HQH: Deleted primary data file. [2025-09-29T19:14:21.402863] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-09-29T19:14:21.769229] [INFO ] [REMOTE ] HQH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:14:21.948123] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-09-29T19:14:22.748145] [INFO ] [REMOTE ] HQH: Fetching primary data for 2024-12. [2025-09-29T19:14:22.792518] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-29T19:14:22.971124] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-29T19:14:23.548149] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-09-29T19:14:23.994881] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-29T19:14:24.290399] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-29T19:14:24.348114] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-09-29T19:14:25.148153] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-01. [2025-09-29T19:14:25.948078] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-09-29T19:14:26.169917] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-29T19:14:26.334765] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-29T19:14:26.748134] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-09-29T19:14:27.548111] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-09-29T19:14:27.627157] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-29T19:14:27.872871] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-29T19:14:28.283571] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-29T19:14:28.348122] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-09-29T19:14:29.111514] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-29T19:14:29.148195] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-09-29T19:14:29.948089] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-09-29T19:14:30.262831] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-29T19:14:30.748145] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-09-29T19:14:31.548132] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-09-29T19:14:31.670628] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-29T19:14:31.753954] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-29T19:14:31.765517] [INFO ] [REMOTE ] HPP: Full fetch complete (73369 records). [2025-09-29T19:14:31.765797] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-09-29T19:14:32.194387] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present. [2025-09-29T19:14:32.194492] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed. [2025-09-29T19:14:32.195663] [INFO ] [MAIN ] HPP: Fetched primary data is valid. [2025-09-29T19:14:32.195736] [DEBUG] [LOCAL ] HPP: Saving primary data. [2025-09-29T19:14:32.197356] [DEBUG] [LOCAL ] HPP: Trimmed 73369 records to 50872 (keeping 200 days of data) [2025-09-29T19:14:32.366773] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-09-29T19:14:32.511547] [DEBUG] [LOCAL ] HPP: Primary data saved (50872 records). [2025-09-29T19:14:32.511758] [INFO ] [MAIN ] HPP: Full history saved. [2025-09-29T19:14:32.511856] [INFO ] [MAIN ] Update Progress: 1048/2371 symbols completed. HPP took 40.7s. Estimated remaining: 2h 49m 47s. Rate: 7.8 symbols/min [2025-09-29T19:14:32.702690] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:14:32.723280] [DEBUG] [LOCAL ] HQL: Loaded 16206 existing records from primary storage. [2025-09-29T19:14:32.723544] [INFO ] [MAIN ] HQL: Loaded 16206 existing records. [2025-09-29T19:14:32.912478] [WARN ] [MAIN ] HQL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:14:32.913450] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-09-29T19:14:32.913502] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-09-29T19:14:32.913771] [DEBUG] [LOCAL ] HQL: Deleted primary data file. [2025-09-29T19:14:32.913830] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-09-29T19:14:33.157998] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-09-29T19:14:33.313780] [INFO ] [REMOTE ] HQL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:14:33.466019] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-29T19:14:33.498118] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-29T19:14:33.725332] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-29T19:14:33.948128] [INFO ] [REMOTE ] HQL: Fetching primary data for 2024-12. [2025-09-29T19:14:34.748138] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-09-29T19:14:34.941267] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-29T19:14:35.548157] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-09-29T19:14:36.348075] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-09-29T19:14:36.508348] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-29T19:14:36.830336] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-29T19:14:37.148118] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-09-29T19:14:37.223229] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-29T19:14:37.226136] [INFO ] [REMOTE ] HPS: Full fetch complete (15167 records). [2025-09-29T19:14:37.226215] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-09-29T19:14:37.623160] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-09-29T19:14:37.623252] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-09-29T19:14:37.623622] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-09-29T19:14:37.623697] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-09-29T19:14:37.624279] [DEBUG] [LOCAL ] HPS: Trimmed 15167 records to 10187 (keeping 200 days of data) [2025-09-29T19:14:37.695196] [DEBUG] [LOCAL ] HPS: Primary data saved (10187 records). [2025-09-29T19:14:37.695326] [INFO ] [MAIN ] HPS: Full history saved. [2025-09-29T19:14:37.695610] [INFO ] [MAIN ] Update Progress: 1049/2371 symbols completed. HPS took 22.5s. Estimated remaining: 2h 49m 36s. Rate: 7.8 symbols/min [2025-09-29T19:14:37.894065] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:14:37.950542] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-09-29T19:14:37.955227] [DEBUG] [LOCAL ] HR: Loaded 52716 existing records from primary storage. [2025-09-29T19:14:37.955597] [INFO ] [MAIN ] HR: Loaded 52716 existing records. [2025-09-29T19:14:38.167699] [WARN ] [MAIN ] HR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:14:38.169373] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-29T19:14:38.169638] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-09-29T19:14:38.173747] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-09-29T19:14:38.175037] [DEBUG] [LOCAL ] HR: Deleted primary data file. [2025-09-29T19:14:38.175103] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-09-29T19:14:38.554010] [INFO ] [REMOTE ] HR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:14:38.748135] [INFO ] [REMOTE ] HR: Fetching primary data for 2024-12. [2025-09-29T19:14:39.548141] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-09-29T19:14:40.050999] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-29T19:14:40.348140] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-09-29T19:14:40.493409] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-29T19:14:40.577396] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-29T19:14:41.148114] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-09-29T19:14:41.660553] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-29T19:14:41.948118] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-01. [2025-09-29T19:14:42.129250] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-29T19:14:42.748109] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-09-29T19:14:43.548096] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-09-29T19:14:43.720167] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-29T19:14:43.729270] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-29T19:14:44.348117] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-09-29T19:14:45.148117] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-09-29T19:14:45.356671] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-29T19:14:45.358814] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-29T19:14:45.948139] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-09-29T19:14:45.982261] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-29T19:14:46.748131] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-09-29T19:14:47.039243] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-29T19:14:47.548146] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-09-29T19:14:48.348087] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-09-29T19:14:48.745446] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-29T19:14:49.065472] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-29T19:14:49.148083] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-09-29T19:14:49.182347] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-29T19:14:49.948102] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-09-29T19:14:50.748162] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-09-29T19:14:50.946219] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-29T19:14:51.107591] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-29T19:14:51.548137] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-09-29T19:14:52.348173] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-09-29T19:14:52.560489] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-29T19:14:52.616289] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-29T19:14:52.622038] [INFO ] [REMOTE ] HQH: Full fetch complete (37376 records). [2025-09-29T19:14:52.622178] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-09-29T19:14:53.014075] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-09-29T19:14:53.014170] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-09-29T19:14:53.014913] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-09-29T19:14:53.014977] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-09-29T19:14:53.015986] [DEBUG] [LOCAL ] HQH: Trimmed 37376 records to 25061 (keeping 200 days of data) [2025-09-29T19:14:53.158756] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-09-29T19:14:53.180921] [DEBUG] [LOCAL ] HQH: Primary data saved (25061 records). [2025-09-29T19:14:53.181065] [INFO ] [MAIN ] HQH: Full history saved. [2025-09-29T19:14:53.181167] [INFO ] [MAIN ] Update Progress: 1050/2371 symbols completed. HQH took 32.2s. Estimated remaining: 2h 49m 38s. Rate: 7.8 symbols/min [2025-09-29T19:14:53.358995] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:14:53.411813] [DEBUG] [LOCAL ] HRB: Loaded 49275 existing records from primary storage. [2025-09-29T19:14:53.412149] [INFO ] [MAIN ] HRB: Loaded 49275 existing records. [2025-09-29T19:14:53.612312] [WARN ] [MAIN ] HRB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:14:53.612518] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-09-29T19:14:53.612567] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-09-29T19:14:53.613135] [DEBUG] [LOCAL ] HRB: Deleted primary data file. [2025-09-29T19:14:53.613194] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-09-29T19:14:53.952612] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-09-29T19:14:53.987793] [INFO ] [REMOTE ] HRB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:14:54.159940] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-29T19:14:54.213301] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-29T19:14:54.748151] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-09-29T19:14:55.548104] [INFO ] [REMOTE ] HRB: Fetching primary data for 2024-12. [2025-09-29T19:14:56.098319] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-29T19:14:56.110320] [INFO ] [REMOTE ] HPQ: Full fetch complete (77668 records). [2025-09-29T19:14:56.110485] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-09-29T19:14:56.354099] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-09-29T19:14:56.482240] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-29T19:14:56.585523] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-09-29T19:14:56.585615] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-09-29T19:14:56.586724] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-09-29T19:14:56.586793] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-09-29T19:14:56.588420] [DEBUG] [LOCAL ] HPQ: Trimmed 77668 records to 53668 (keeping 200 days of data) [2025-09-29T19:14:56.941402] [DEBUG] [LOCAL ] HPQ: Primary data saved (53668 records). [2025-09-29T19:14:56.941570] [INFO ] [MAIN ] HPQ: Full history saved. [2025-09-29T19:14:56.941700] [INFO ] [MAIN ] Update Progress: 1051/2371 symbols completed. HPQ took 47.8s. Estimated remaining: 2h 49m 26s. Rate: 7.8 symbols/min [2025-09-29T19:14:57.127823] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:14:57.148093] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-09-29T19:14:57.165059] [DEBUG] [LOCAL ] HRI: Loaded 33507 existing records from primary storage. [2025-09-29T19:14:57.165370] [INFO ] [MAIN ] HRI: Loaded 33507 existing records. [2025-09-29T19:14:57.360481] [WARN ] [MAIN ] HRI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:14:57.360831] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-09-29T19:14:57.375358] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-09-29T19:14:57.386866] [DEBUG] [LOCAL ] HRI: Deleted primary data file. [2025-09-29T19:14:57.387380] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-09-29T19:14:57.394801] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-29T19:14:57.568167] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-29T19:14:57.591395] [INFO ] [REMOTE ] HQL: Full fetch complete (24516 records). [2025-09-29T19:14:57.627933] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-09-29T19:14:57.959993] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-01. [2025-09-29T19:14:57.972440] [INFO ] [REMOTE ] HRI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:14:58.245815] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-09-29T19:14:58.245914] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-09-29T19:14:58.246485] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-09-29T19:14:58.246531] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-09-29T19:14:58.247607] [DEBUG] [LOCAL ] HQL: Trimmed 24516 records to 15953 (keeping 200 days of data) [2025-09-29T19:14:58.355297] [DEBUG] [LOCAL ] HQL: Primary data saved (15953 records). [2025-09-29T19:14:58.355441] [INFO ] [MAIN ] HQL: Full history saved. [2025-09-29T19:14:58.355549] [INFO ] [MAIN ] Update Progress: 1052/2371 symbols completed. HQL took 25.8s. Estimated remaining: 2h 49m 10s. Rate: 7.8 symbols/min [2025-09-29T19:14:58.545033] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:14:58.604816] [DEBUG] [LOCAL ] HRL: Loaded 53855 existing records from primary storage. [2025-09-29T19:14:58.605218] [INFO ] [MAIN ] HRL: Loaded 53855 existing records. [2025-09-29T19:14:58.761079] [INFO ] [REMOTE ] HRI: Fetching primary data for 2024-12. [2025-09-29T19:14:58.800764] [WARN ] [MAIN ] HRL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:14:58.802044] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-09-29T19:14:58.802235] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-09-29T19:14:58.802870] [DEBUG] [LOCAL ] HRL: Deleted primary data file. [2025-09-29T19:14:58.803105] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-09-29T19:14:58.955876] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-29T19:14:59.216092] [INFO ] [REMOTE ] HRL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:14:59.548124] [INFO ] [REMOTE ] HRL: Fetching primary data for 2024-12. [2025-09-29T19:14:59.598425] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-29T19:15:00.077860] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-29T19:15:00.348129] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-09-29T19:15:01.148127] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-09-29T19:15:01.535331] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-29T19:15:01.948198] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-01. [2025-09-29T19:15:01.996784] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-29T19:15:02.748085] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-01. [2025-09-29T19:15:03.151518] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-29T19:15:03.222299] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-29T19:15:03.548113] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-09-29T19:15:04.348137] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-09-29T19:15:04.565422] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-29T19:15:05.148084] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-09-29T19:15:05.351999] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-29T19:15:05.948113] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-09-29T19:15:06.105029] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-29T19:15:06.748130] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-09-29T19:15:06.972552] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-29T19:15:07.407664] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-29T19:15:07.418881] [INFO ] [REMOTE ] HR: Full fetch complete (74847 records). [2025-09-29T19:15:07.419060] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-09-29T19:15:07.553288] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-09-29T19:15:07.871207] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-09-29T19:15:07.871297] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-09-29T19:15:07.872406] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-09-29T19:15:07.872473] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-09-29T19:15:07.875218] [DEBUG] [LOCAL ] HR: Trimmed 74847 records to 51953 (keeping 200 days of data) [2025-09-29T19:15:08.123110] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-29T19:15:08.247106] [DEBUG] [LOCAL ] HR: Primary data saved (51953 records). [2025-09-29T19:15:08.247256] [INFO ] [MAIN ] HR: Full history saved. [2025-09-29T19:15:08.247342] [INFO ] [MAIN ] Update Progress: 1053/2371 symbols completed. HR took 30.6s. Estimated remaining: 2h 49m 5s. Rate: 7.8 symbols/min [2025-09-29T19:15:08.353939] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-09-29T19:15:08.453994] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:15:08.489542] [DEBUG] [LOCAL ] HRTG: Loaded 33658 existing records from primary storage. [2025-09-29T19:15:08.489892] [INFO ] [MAIN ] HRTG: Loaded 33658 existing records. [2025-09-29T19:15:08.681208] [WARN ] [MAIN ] HRTG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:15:08.681414] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-09-29T19:15:08.681498] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-09-29T19:15:08.681818] [DEBUG] [LOCAL ] HRTG: Deleted primary data file. [2025-09-29T19:15:08.681876] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-09-29T19:15:09.055903] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:15:09.148105] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2024-12. [2025-09-29T19:15:09.410711] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-29T19:15:09.892192] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-29T19:15:09.948115] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-09-29T19:15:10.264745] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-29T19:15:10.748112] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-09-29T19:15:11.548126] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-01. [2025-09-29T19:15:11.845217] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-29T19:15:11.927411] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-29T19:15:12.348112] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-09-29T19:15:12.632319] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-29T19:15:13.148096] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-09-29T19:15:13.948119] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-09-29T19:15:14.371458] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-29T19:15:14.721397] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-29T19:15:14.748109] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-09-29T19:15:15.548114] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-09-29T19:15:15.689687] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-29T19:15:15.785811] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-29T19:15:16.348139] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-09-29T19:15:17.148127] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-09-29T19:15:17.386010] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-29T19:15:17.702181] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-29T19:15:17.948167] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-09-29T19:15:18.753222] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-09-29T19:15:18.770129] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-29T19:15:19.354718] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-29T19:15:19.548123] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-09-29T19:15:20.348074] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-09-29T19:15:20.843195] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-29T19:15:20.893024] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-29T19:15:21.008705] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-29T19:15:21.148151] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-09-29T19:15:21.948153] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-09-29T19:15:22.318506] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-29T19:15:22.748146] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-09-29T19:15:23.329281] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-29T19:15:23.548134] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-09-29T19:15:24.348102] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-09-29T19:15:24.653413] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-29T19:15:25.100497] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-29T19:15:25.107466] [INFO ] [REMOTE ] HRI: Full fetch complete (46162 records). [2025-09-29T19:15:25.107588] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-09-29T19:15:25.153270] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-09-29T19:15:25.520814] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present. [2025-09-29T19:15:25.520905] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed. [2025-09-29T19:15:25.521721] [INFO ] [MAIN ] HRI: Fetched primary data is valid. [2025-09-29T19:15:25.521791] [DEBUG] [LOCAL ] HRI: Saving primary data. [2025-09-29T19:15:25.522822] [DEBUG] [LOCAL ] HRI: Trimmed 46162 records to 32840 (keeping 200 days of data) [2025-09-29T19:15:25.696904] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-29T19:15:25.805764] [DEBUG] [LOCAL ] HRI: Primary data saved (32840 records). [2025-09-29T19:15:25.805962] [INFO ] [MAIN ] HRI: Full history saved. [2025-09-29T19:15:25.806092] [INFO ] [MAIN ] Update Progress: 1054/2371 symbols completed. HRI took 28.9s. Estimated remaining: 2h 49m 10s. Rate: 7.8 symbols/min [2025-09-29T19:15:25.956690] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-09-29T19:15:25.984072] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:15:26.042287] [DEBUG] [LOCAL ] HSBC: Loaded 51868 existing records from primary storage. [2025-09-29T19:15:26.042629] [INFO ] [MAIN ] HSBC: Loaded 51868 existing records. [2025-09-29T19:15:26.228052] [WARN ] [MAIN ] HSBC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:15:26.228383] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-09-29T19:15:26.228435] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-09-29T19:15:26.228975] [DEBUG] [LOCAL ] HSBC: Deleted primary data file. [2025-09-29T19:15:26.229062] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-09-29T19:15:26.614477] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:15:26.637005] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-29T19:15:26.748161] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-09-29T19:15:27.548079] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-09-29T19:15:27.581853] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-29T19:15:27.592267] [INFO ] [REMOTE ] HRB: Full fetch complete (69780 records). [2025-09-29T19:15:27.592435] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-09-29T19:15:28.008677] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-09-29T19:15:28.008771] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-09-29T19:15:28.009827] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-09-29T19:15:28.009895] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-09-29T19:15:28.012318] [DEBUG] [LOCAL ] HRB: Trimmed 69780 records to 48501 (keeping 200 days of data) [2025-09-29T19:15:28.348587] [DEBUG] [LOCAL ] HRB: Primary data saved (48501 records). [2025-09-29T19:15:28.348445] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2024-12. [2025-09-29T19:15:28.349068] [INFO ] [MAIN ] HRB: Full history saved. [2025-09-29T19:15:28.349216] [INFO ] [MAIN ] Update Progress: 1055/2371 symbols completed. HRB took 35.2s. Estimated remaining: 2h 48m 56s. Rate: 7.8 symbols/min [2025-09-29T19:15:28.532700] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:15:28.552337] [DEBUG] [LOCAL ] HSHP: Loaded 15773 existing records from primary storage. [2025-09-29T19:15:28.552845] [INFO ] [MAIN ] HSHP: Loaded 15773 existing records. [2025-09-29T19:15:28.754430] [WARN ] [MAIN ] HSHP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:15:28.754793] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-09-29T19:15:28.754917] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-09-29T19:15:28.755265] [DEBUG] [LOCAL ] HSHP: Deleted primary data file. [2025-09-29T19:15:28.755447] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-09-29T19:15:29.039560] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-09-29T19:15:29.123682] [INFO ] [REMOTE ] HRL: Full fetch complete (76679 records). [2025-09-29T19:15:29.128188] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-09-29T19:15:29.296439] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:15:29.329510] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2024-12. [2025-09-29T19:15:29.358955] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-29T19:15:29.709390] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present. [2025-09-29T19:15:29.709476] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed. [2025-09-29T19:15:29.710515] [INFO ] [MAIN ] HRL: Fetched primary data is valid. [2025-09-29T19:15:29.710583] [DEBUG] [LOCAL ] HRL: Saving primary data. [2025-09-29T19:15:29.712144] [DEBUG] [LOCAL ] HRL: Trimmed 76679 records to 53074 (keeping 200 days of data) [2025-09-29T19:15:29.948345] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-09-29T19:15:30.068978] [DEBUG] [LOCAL ] HRL: Primary data saved (53074 records). [2025-09-29T19:15:30.069199] [INFO ] [MAIN ] HRL: Full history saved. [2025-09-29T19:15:30.069300] [INFO ] [MAIN ] Update Progress: 1056/2371 symbols completed. HRL took 31.7s. Estimated remaining: 2h 48m 40s. Rate: 7.8 symbols/min [2025-09-29T19:15:30.249571] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:15:30.307373] [DEBUG] [LOCAL ] HSY: Loaded 51161 existing records from primary storage. [2025-09-29T19:15:30.307715] [INFO ] [MAIN ] HSY: Loaded 51161 existing records. [2025-09-29T19:15:30.490873] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-29T19:15:30.537086] [WARN ] [MAIN ] HSY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:15:30.537614] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-09-29T19:15:30.537796] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-09-29T19:15:30.547771] [DEBUG] [LOCAL ] HSY: Deleted primary data file. [2025-09-29T19:15:30.554589] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-09-29T19:15:30.628760] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-09-29T19:15:30.754476] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-01. [2025-09-29T19:15:30.974466] [INFO ] [REMOTE ] HSY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:15:31.390907] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-29T19:15:31.548179] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-09-29T19:15:32.348095] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-09-29T19:15:32.395026] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-29T19:15:32.949955] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-29T19:15:33.148130] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-09-29T19:15:33.319845] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-29T19:15:33.948136] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-09-29T19:15:34.376480] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-29T19:15:34.748118] [INFO ] [REMOTE ] HSY: Fetching primary data for 2024-12. [2025-09-29T19:15:35.548099] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-09-29T19:15:35.813802] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-29T19:15:36.348121] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-09-29T19:15:36.700060] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-29T19:15:37.105031] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-29T19:15:37.112690] [INFO ] [REMOTE ] HRTG: Full fetch complete (42678 records). [2025-09-29T19:15:37.112853] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-09-29T19:15:37.153329] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-09-29T19:15:37.525014] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-09-29T19:15:37.525095] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-09-29T19:15:37.526028] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-09-29T19:15:37.526094] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-09-29T19:15:37.527129] [DEBUG] [LOCAL ] HRTG: Trimmed 42678 records to 33324 (keeping 200 days of data) [2025-09-29T19:15:37.749467] [DEBUG] [LOCAL ] HRTG: Primary data saved (33324 records). [2025-09-29T19:15:37.749716] [INFO ] [MAIN ] HRTG: Full history saved. [2025-09-29T19:15:37.749820] [INFO ] [MAIN ] Update Progress: 1057/2371 symbols completed. HRTG took 29.5s. Estimated remaining: 2h 48m 33s. Rate: 7.8 symbols/min [2025-09-29T19:15:37.953709] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-01. [2025-09-29T19:15:37.963299] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:15:37.964734] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-09-29T19:15:37.964900] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-09-29T19:15:37.965069] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-09-29T19:15:37.965135] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-09-29T19:15:37.965210] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-09-29T19:15:37.965266] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-09-29T19:15:38.408059] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-29T19:15:38.564073] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-29T19:15:38.710433] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:15:38.748187] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-09-29T19:15:39.548117] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-09-29T19:15:39.929161] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-29T19:15:40.348178] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-09-29T19:15:40.593529] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-29T19:15:41.109486] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-29T19:15:41.148138] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-09-29T19:15:41.948159] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-09-29T19:15:42.206290] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-29T19:15:42.230481] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-29T19:15:42.748155] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-09-29T19:15:43.548122] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-09-29T19:15:43.622576] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-29T19:15:43.875574] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-29T19:15:44.348151] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-09-29T19:15:45.156954] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-09-29T19:15:45.163505] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-29T19:15:45.948101] [INFO ] [REMOTE ] HTB: Fetching primary data for 2024-12. [2025-09-29T19:15:46.156917] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T19:15:46.157222] [WARN ] [REMOTE ] HTB: No data returned for month 2024-12 [2025-09-29T19:15:46.157340] [FATAL] [REMOTE ] HTB: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T19:15:46.157447] [FATAL] [MAIN ] HTB: Failed to fetch primary data. [2025-09-29T19:15:46.157536] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T19:15:46.157634] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-09-29T19:15:46.157741] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-09-29T19:15:46.157788] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-09-29T19:15:46.157855] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-09-29T19:15:46.157929] [INFO ] [MAIN ] Update Progress: 1058/2371 symbols completed. HTB took 8.4s. Estimated remaining: 2h 48m 26s. Rate: 7.8 symbols/min [2025-09-29T19:15:46.353983] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:15:46.350575] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-29T19:15:46.388865] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-29T19:15:46.410067] [DEBUG] [LOCAL ] HTD: Loaded 13754 existing records from primary storage. [2025-09-29T19:15:46.410304] [INFO ] [MAIN ] HTD: Loaded 13754 existing records. [2025-09-29T19:15:46.597722] [WARN ] [MAIN ] HTD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:15:46.597961] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-09-29T19:15:46.598009] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-09-29T19:15:46.598332] [DEBUG] [LOCAL ] HTD: Deleted primary data file. [2025-09-29T19:15:46.598392] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-09-29T19:15:46.753251] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-09-29T19:15:46.987162] [INFO ] [REMOTE ] HTD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:15:47.548164] [INFO ] [REMOTE ] HTD: Fetching primary data for 2024-12. [2025-09-29T19:15:48.348089] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-09-29T19:15:48.495326] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-29T19:15:48.734800] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-29T19:15:49.148122] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-09-29T19:15:49.948114] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-09-29T19:15:49.987951] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-29T19:15:50.144978] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-29T19:15:50.748126] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-09-29T19:15:51.548140] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-09-29T19:15:51.831675] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-29T19:15:52.348083] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-09-29T19:15:52.662095] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-29T19:15:52.858315] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-29T19:15:53.148091] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-09-29T19:15:53.350619] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-29T19:15:53.948169] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-09-29T19:15:54.748139] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-09-29T19:15:54.825850] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-29T19:15:55.179829] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-29T19:15:55.192984] [INFO ] [REMOTE ] HSBC: Full fetch complete (73677 records). [2025-09-29T19:15:55.193172] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-09-29T19:15:55.553319] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-09-29T19:15:55.637718] [DEBUG] [VALIDATOR ] HSBC: All expected trading days are present. [2025-09-29T19:15:55.637835] [DEBUG] [VALIDATOR ] HSBC: Primary data validation passed. [2025-09-29T19:15:55.639056] [INFO ] [MAIN ] HSBC: Fetched primary data is valid. [2025-09-29T19:15:55.639155] [DEBUG] [LOCAL ] HSBC: Saving primary data. [2025-09-29T19:15:55.649870] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-29T19:15:55.655574] [DEBUG] [LOCAL ] HSBC: Trimmed 73677 records to 51077 (keeping 200 days of data) [2025-09-29T19:15:55.991749] [DEBUG] [LOCAL ] HSBC: Primary data saved (51077 records). [2025-09-29T19:15:55.991907] [INFO ] [MAIN ] HSBC: Full history saved. [2025-09-29T19:15:55.991996] [INFO ] [MAIN ] Update Progress: 1059/2371 symbols completed. HSBC took 30.2s. Estimated remaining: 2h 48m 21s. Rate: 7.8 symbols/min [2025-09-29T19:15:56.184376] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:15:56.184856] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-09-29T19:15:56.185230] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-09-29T19:15:56.185454] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-09-29T19:15:56.185514] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-09-29T19:15:56.185565] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-09-29T19:15:56.185602] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-09-29T19:15:56.349221] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-09-29T19:15:56.561750] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:15:57.148120] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2024-12. [2025-09-29T19:15:57.402168] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-29T19:15:57.476344] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-09-29T19:15:57.580136] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-29T19:15:57.584256] [INFO ] [REMOTE ] HSHP: Full fetch complete (23450 records). [2025-09-29T19:15:57.584350] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-09-29T19:15:57.961331] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-09-29T19:15:57.989114] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-09-29T19:15:57.989193] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-09-29T19:15:57.989689] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-09-29T19:15:57.989750] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-09-29T19:15:57.990412] [DEBUG] [LOCAL ] HSHP: Trimmed 23450 records to 15287 (keeping 200 days of data) [2025-09-29T19:15:58.082471] [DEBUG] [LOCAL ] HSHP: Primary data saved (15287 records). [2025-09-29T19:15:58.082639] [INFO ] [MAIN ] HSHP: Full history saved. [2025-09-29T19:15:58.082767] [INFO ] [MAIN ] Update Progress: 1060/2371 symbols completed. HSHP took 29.7s. Estimated remaining: 2h 48m 6s. Rate: 7.8 symbols/min [2025-09-29T19:15:58.265565] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:15:58.311038] [DEBUG] [LOCAL ] HTGC: Loaded 48222 existing records from primary storage. [2025-09-29T19:15:58.311363] [INFO ] [MAIN ] HTGC: Loaded 48222 existing records. [2025-09-29T19:15:58.393816] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-29T19:15:58.494558] [WARN ] [MAIN ] HTGC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:15:58.494847] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-09-29T19:15:58.494900] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-09-29T19:15:58.495177] [DEBUG] [LOCAL ] HTGC: Deleted primary data file. [2025-09-29T19:15:58.495238] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-09-29T19:15:58.753310] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-09-29T19:15:58.868680] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:15:59.548161] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-09-29T19:15:59.715194] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-29T19:16:00.348137] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2024-12. [2025-09-29T19:16:01.148123] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-09-29T19:16:01.640896] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-29T19:16:01.856215] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-29T19:16:01.948096] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-09-29T19:16:02.047794] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-29T19:16:02.748125] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-09-29T19:16:02.827218] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-29T19:16:03.069845] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-29T19:16:03.548088] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-09-29T19:16:03.861317] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-29T19:16:04.348116] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-01. [2025-09-29T19:16:05.148140] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-09-29T19:16:05.948106] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-09-29T19:16:06.012178] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-29T19:16:06.189596] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-29T19:16:06.748120] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-09-29T19:16:07.548082] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-09-29T19:16:07.759692] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-29T19:16:08.348112] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-09-29T19:16:08.402073] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-29T19:16:08.453080] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-29T19:16:08.750780] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-29T19:16:09.148102] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-09-29T19:16:09.948116] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-09-29T19:16:10.748102] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-09-29T19:16:11.116727] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-29T19:16:11.120398] [INFO ] [REMOTE ] HTD: Full fetch complete (18970 records). [2025-09-29T19:16:11.120484] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-09-29T19:16:11.470872] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-09-29T19:16:11.509358] [INFO ] [REMOTE ] HSY: Full fetch complete (73757 records). [2025-09-29T19:16:11.553775] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-09-29T19:16:11.553925] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-09-29T19:16:11.579864] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-09-29T19:16:11.587254] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-09-29T19:16:11.600029] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-09-29T19:16:11.624484] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-09-29T19:16:11.688828] [DEBUG] [LOCAL ] HTD: Trimmed 18970 records to 13657 (keeping 200 days of data) [2025-09-29T19:16:12.102402] [DEBUG] [LOCAL ] HTD: Primary data saved (13657 records). [2025-09-29T19:16:12.121088] [INFO ] [MAIN ] HTD: Full history saved. [2025-09-29T19:16:12.145530] [INFO ] [MAIN ] Update Progress: 1061/2371 symbols completed. HTD took 26.0s. Estimated remaining: 2h 48m 6s. Rate: 7.8 symbols/min [2025-09-29T19:16:12.146159] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-09-29T19:16:12.218854] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-09-29T19:16:12.253130] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-09-29T19:16:12.257740] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-09-29T19:16:12.337639] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:16:12.337972] [DEBUG] [LOCAL ] HSY: Trimmed 73757 records to 50371 (keeping 200 days of data) [2025-09-29T19:16:12.455450] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-29T19:16:12.457789] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-09-29T19:16:12.502387] [DEBUG] [LOCAL ] HTH: Loaded 32696 existing records from primary storage. [2025-09-29T19:16:12.503492] [INFO ] [MAIN ] HTH: Loaded 32696 existing records. [2025-09-29T19:16:12.562436] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-29T19:16:12.748748] [WARN ] [MAIN ] HTH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:16:12.752001] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-09-29T19:16:12.754413] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-09-29T19:16:12.756470] [DEBUG] [LOCAL ] HTH: Deleted primary data file. [2025-09-29T19:16:12.757034] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-09-29T19:16:12.820208] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-29T19:16:13.153168] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-09-29T19:16:13.291777] [INFO ] [REMOTE ] HTH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:16:13.379624] [DEBUG] [LOCAL ] HSY: Primary data saved (50371 records). [2025-09-29T19:16:13.379799] [INFO ] [MAIN ] HSY: Full history saved. [2025-09-29T19:16:13.379888] [INFO ] [MAIN ] Update Progress: 1062/2371 symbols completed. HSY took 43.3s. Estimated remaining: 2h 47m 51s. Rate: 7.8 symbols/min [2025-09-29T19:16:13.466409] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-29T19:16:13.561538] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:16:13.605694] [DEBUG] [LOCAL ] HUBB: Loaded 37650 existing records from primary storage. [2025-09-29T19:16:13.606028] [INFO ] [MAIN ] HUBB: Loaded 37650 existing records. [2025-09-29T19:16:13.803299] [WARN ] [MAIN ] HUBB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:16:13.803563] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-09-29T19:16:13.803614] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-09-29T19:16:13.804181] [DEBUG] [LOCAL ] HUBB: Deleted primary data file. [2025-09-29T19:16:13.804262] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-09-29T19:16:13.963851] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-09-29T19:16:14.209543] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:16:14.748169] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2024-12. [2025-09-29T19:16:15.548190] [INFO ] [REMOTE ] HTH: Fetching primary data for 2024-12. [2025-09-29T19:16:15.793597] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-29T19:16:16.040549] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-29T19:16:16.348128] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-01. [2025-09-29T19:16:16.708630] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-29T19:16:17.148108] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-09-29T19:16:17.456419] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-29T19:16:17.837300] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-29T19:16:17.948121] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-09-29T19:16:18.336708] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-29T19:16:18.337473] [INFO ] [REMOTE ] HTFC: Full fetch complete (842 records). [2025-09-29T19:16:18.337579] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-09-29T19:16:18.523889] [WARN ] [VALIDATOR ] HTFC: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-09-29T19:16:18.524074] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-09-29T19:16:18.524144] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-09-29T19:16:18.524230] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-09-29T19:16:18.524319] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-09-29T19:16:18.524371] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-09-29T19:16:18.524443] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-09-29T19:16:18.524575] [INFO ] [MAIN ] Update Progress: 1063/2371 symbols completed. HTFC took 22.5s. Estimated remaining: 2h 47m 40s. Rate: 7.8 symbols/min [2025-09-29T19:16:18.706099] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:16:18.746777] [DEBUG] [LOCAL ] HUBS: Loaded 39953 existing records from primary storage. [2025-09-29T19:16:18.747118] [INFO ] [MAIN ] HUBS: Loaded 39953 existing records. [2025-09-29T19:16:18.758278] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-01. [2025-09-29T19:16:18.943416] [WARN ] [MAIN ] HUBS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:16:18.943689] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-09-29T19:16:18.943768] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-09-29T19:16:18.944096] [DEBUG] [LOCAL ] HUBS: Deleted primary data file. [2025-09-29T19:16:18.944158] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-09-29T19:16:19.335405] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:16:19.548163] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-09-29T19:16:20.008735] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-29T19:16:20.348137] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-09-29T19:16:21.148125] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-09-29T19:16:21.221222] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-29T19:16:21.948149] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-09-29T19:16:22.135245] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-29T19:16:22.534576] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-29T19:16:22.748161] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2024-12. [2025-09-29T19:16:23.548193] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-09-29T19:16:24.169477] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-29T19:16:24.348133] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-01. [2025-09-29T19:16:24.734490] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-29T19:16:25.046440] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (3.10 seconds). [2025-09-29T19:16:25.148125] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-09-29T19:16:25.914231] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-29T19:16:25.948122] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-09-29T19:16:26.383272] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-29T19:16:26.748186] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-09-29T19:16:27.068204] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-29T19:16:27.548185] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-09-29T19:16:28.348079] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-09-29T19:16:28.408577] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-29T19:16:28.802843] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-29T19:16:29.148106] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-09-29T19:16:29.954773] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-09-29T19:16:29.971917] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-29T19:16:30.748134] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-09-29T19:16:30.849844] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-29T19:16:30.859995] [INFO ] [REMOTE ] HTGC: Full fetch complete (68196 records). [2025-09-29T19:16:30.860230] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-09-29T19:16:31.414426] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present. [2025-09-29T19:16:31.414590] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed. [2025-09-29T19:16:31.416814] [INFO ] [MAIN ] HTGC: Fetched primary data is valid. [2025-09-29T19:16:31.429598] [DEBUG] [LOCAL ] HTGC: Saving primary data. [2025-09-29T19:16:31.457472] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-29T19:16:31.453972] [DEBUG] [LOCAL ] HTGC: Trimmed 68196 records to 47424 (keeping 200 days of data) [2025-09-29T19:16:31.549951] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-09-29T19:16:31.889049] [DEBUG] [LOCAL ] HTGC: Primary data saved (47424 records). [2025-09-29T19:16:31.889258] [INFO ] [MAIN ] HTGC: Full history saved. [2025-09-29T19:16:31.889426] [INFO ] [MAIN ] Update Progress: 1064/2371 symbols completed. HTGC took 33.8s. Estimated remaining: 2h 47m 39s. Rate: 7.8 symbols/min [2025-09-29T19:16:32.176144] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:16:32.211840] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-29T19:16:32.253357] [DEBUG] [LOCAL ] HUM: Loaded 49568 existing records from primary storage. [2025-09-29T19:16:32.253719] [INFO ] [MAIN ] HUM: Loaded 49568 existing records. [2025-09-29T19:16:32.358354] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-09-29T19:16:32.446790] [WARN ] [MAIN ] HUM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:16:32.447018] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-09-29T19:16:32.447111] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-09-29T19:16:32.447705] [DEBUG] [LOCAL ] HUM: Deleted primary data file. [2025-09-29T19:16:32.447781] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-09-29T19:16:32.842044] [INFO ] [REMOTE ] HUM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:16:33.095236] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-29T19:16:33.148115] [INFO ] [REMOTE ] HUM: Fetching primary data for 2024-12. [2025-09-29T19:16:33.948102] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-09-29T19:16:34.121075] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-29T19:16:34.748095] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-09-29T19:16:34.913701] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-29T19:16:35.363400] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-29T19:16:35.548139] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-09-29T19:16:36.131903] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-29T19:16:36.348155] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-09-29T19:16:37.148115] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-09-29T19:16:37.188185] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-29T19:16:37.921415] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-29T19:16:37.948094] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-09-29T19:16:38.469718] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-29T19:16:38.748138] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-09-29T19:16:39.440883] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-29T19:16:39.548160] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-09-29T19:16:40.107002] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-29T19:16:40.348141] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-09-29T19:16:41.148133] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-09-29T19:16:41.308054] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-29T19:16:41.874512] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-29T19:16:41.948157] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-09-29T19:16:42.708208] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-29T19:16:42.718578] [INFO ] [REMOTE ] HUBB: Full fetch complete (53719 records). [2025-09-29T19:16:42.718786] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-09-29T19:16:42.754111] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-09-29T19:16:43.178825] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-09-29T19:16:43.178956] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-09-29T19:16:43.179974] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-09-29T19:16:43.180048] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-09-29T19:16:43.181370] [DEBUG] [LOCAL ] HUBB: Trimmed 53719 records to 36843 (keeping 200 days of data) [2025-09-29T19:16:43.431239] [DEBUG] [LOCAL ] HUBB: Primary data saved (36843 records). [2025-09-29T19:16:43.431397] [INFO ] [MAIN ] HUBB: Full history saved. [2025-09-29T19:16:43.431502] [INFO ] [MAIN ] Update Progress: 1065/2371 symbols completed. HUBB took 30.1s. Estimated remaining: 2h 47m 36s. Rate: 7.8 symbols/min [2025-09-29T19:16:43.553579] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-09-29T19:16:43.637771] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:16:43.701351] [DEBUG] [LOCAL ] HUN: Loaded 53976 existing records from primary storage. [2025-09-29T19:16:43.701762] [INFO ] [MAIN ] HUN: Loaded 53976 existing records. [2025-09-29T19:16:43.896468] [WARN ] [MAIN ] HUN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:16:43.906333] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-09-29T19:16:43.919534] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-09-29T19:16:43.923351] [DEBUG] [LOCAL ] HUN: Deleted primary data file. [2025-09-29T19:16:43.923420] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-09-29T19:16:43.924751] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-29T19:16:44.333402] [INFO ] [REMOTE ] HUN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:16:44.351239] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-09-29T19:16:44.364700] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-29T19:16:44.946610] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-29T19:16:45.148114] [INFO ] [REMOTE ] HUN: Fetching primary data for 2024-12. [2025-09-29T19:16:45.948088] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-09-29T19:16:46.099985] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-29T19:16:46.108162] [INFO ] [REMOTE ] HUBS: Full fetch complete (55312 records). [2025-09-29T19:16:46.108279] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-09-29T19:16:46.536853] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-09-29T19:16:46.537000] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-09-29T19:16:46.537914] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-09-29T19:16:46.537980] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-09-29T19:16:46.539076] [DEBUG] [LOCAL ] HUBS: Trimmed 55312 records to 39200 (keeping 200 days of data) [2025-09-29T19:16:46.756275] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-09-29T19:16:46.799696] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-29T19:16:46.848114] [DEBUG] [LOCAL ] HUBS: Primary data saved (39200 records). [2025-09-29T19:16:46.848287] [INFO ] [MAIN ] HUBS: Full history saved. [2025-09-29T19:16:46.848382] [INFO ] [MAIN ] Update Progress: 1066/2371 symbols completed. HUBS took 28.3s. Estimated remaining: 2h 47m 23s. Rate: 7.8 symbols/min [2025-09-29T19:16:47.061801] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:16:47.109963] [DEBUG] [LOCAL ] HUYA: Loaded 44956 existing records from primary storage. [2025-09-29T19:16:47.110360] [INFO ] [MAIN ] HUYA: Loaded 44956 existing records. [2025-09-29T19:16:47.317134] [WARN ] [MAIN ] HUYA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:16:47.317523] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-09-29T19:16:47.317741] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-09-29T19:16:47.325006] [DEBUG] [LOCAL ] HUYA: Deleted primary data file. [2025-09-29T19:16:47.337869] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-09-29T19:16:47.389314] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-29T19:16:47.553979] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-01. [2025-09-29T19:16:47.742259] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:16:48.348069] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-09-29T19:16:48.617681] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-29T19:16:49.148087] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-09-29T19:16:49.217684] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-29T19:16:49.579184] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-29T19:16:49.948144] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-09-29T19:16:50.748185] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2024-12. [2025-09-29T19:16:51.119167] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-29T19:16:51.239723] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-29T19:16:51.548137] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-09-29T19:16:52.219839] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-29T19:16:52.348162] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-09-29T19:16:53.148095] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-09-29T19:16:53.329249] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-29T19:16:53.736211] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-29T19:16:53.742902] [INFO ] [REMOTE ] HTH: Full fetch complete (46691 records). [2025-09-29T19:16:53.743041] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-09-29T19:16:53.956362] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-01. [2025-09-29T19:16:54.159474] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present. [2025-09-29T19:16:54.159603] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed. [2025-09-29T19:16:54.160590] [INFO ] [MAIN ] HTH: Fetched primary data is valid. [2025-09-29T19:16:54.160695] [DEBUG] [LOCAL ] HTH: Saving primary data. [2025-09-29T19:16:54.161898] [DEBUG] [LOCAL ] HTH: Trimmed 46691 records to 32136 (keeping 200 days of data) [2025-09-29T19:16:54.384459] [DEBUG] [LOCAL ] HTH: Primary data saved (32136 records). [2025-09-29T19:16:54.384618] [INFO ] [MAIN ] HTH: Full history saved. [2025-09-29T19:16:54.384764] [INFO ] [MAIN ] Update Progress: 1067/2371 symbols completed. HTH took 42.2s. Estimated remaining: 2h 47m 15s. Rate: 7.8 symbols/min [2025-09-29T19:16:54.577994] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:16:54.603744] [DEBUG] [LOCAL ] HVT: Loaded 16133 existing records from primary storage. [2025-09-29T19:16:54.604054] [INFO ] [MAIN ] HVT: Loaded 16133 existing records. [2025-09-29T19:16:54.753259] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-09-29T19:16:54.801295] [WARN ] [MAIN ] HVT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:16:54.801933] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-09-29T19:16:54.802012] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-09-29T19:16:54.802566] [DEBUG] [LOCAL ] HVT: Deleted primary data file. [2025-09-29T19:16:54.802635] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-09-29T19:16:55.256878] [INFO ] [REMOTE ] HVT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:16:55.259155] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-29T19:16:55.548123] [INFO ] [REMOTE ] HVT: Fetching primary data for 2024-12. [2025-09-29T19:16:55.613284] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-29T19:16:56.348137] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-09-29T19:16:56.746019] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-29T19:16:56.769360] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-29T19:16:57.148113] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-01. [2025-09-29T19:16:57.802516] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-29T19:16:57.948121] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-09-29T19:16:58.149007] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-29T19:16:58.748161] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-09-29T19:16:59.548087] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-09-29T19:16:59.601239] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-29T19:17:00.348127] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-09-29T19:17:00.643239] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-29T19:17:01.148139] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-09-29T19:17:01.486157] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-29T19:17:01.612568] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-29T19:17:01.948156] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-09-29T19:17:02.748152] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-09-29T19:17:02.912623] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-29T19:17:03.548143] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-09-29T19:17:03.683193] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-29T19:17:03.903905] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-29T19:17:04.348118] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-09-29T19:17:05.148087] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-09-29T19:17:05.398332] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-29T19:17:05.948139] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-09-29T19:17:06.439161] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-29T19:17:06.450157] [INFO ] [REMOTE ] HUM: Full fetch complete (70958 records). [2025-09-29T19:17:06.450301] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-09-29T19:17:06.753905] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-09-29T19:17:06.891574] [DEBUG] [VALIDATOR ] HUM: All expected trading days are present. [2025-09-29T19:17:06.891865] [DEBUG] [VALIDATOR ] HUM: Primary data validation passed. [2025-09-29T19:17:06.893002] [INFO ] [MAIN ] HUM: Fetched primary data is valid. [2025-09-29T19:17:06.902527] [DEBUG] [LOCAL ] HUM: Saving primary data. [2025-09-29T19:17:06.924169] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-29T19:17:06.934437] [DEBUG] [LOCAL ] HUM: Trimmed 70958 records to 48801 (keeping 200 days of data) [2025-09-29T19:17:07.277564] [DEBUG] [LOCAL ] HUM: Primary data saved (48801 records). [2025-09-29T19:17:07.277742] [INFO ] [MAIN ] HUM: Full history saved. [2025-09-29T19:17:07.277851] [INFO ] [MAIN ] Update Progress: 1068/2371 symbols completed. HUM took 35.4s. Estimated remaining: 2h 47m 14s. Rate: 7.8 symbols/min [2025-09-29T19:17:07.465906] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:17:07.475705] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-29T19:17:07.537549] [DEBUG] [LOCAL ] HWM: Loaded 53767 existing records from primary storage. [2025-09-29T19:17:07.537938] [INFO ] [MAIN ] HWM: Loaded 53767 existing records. [2025-09-29T19:17:07.553179] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-09-29T19:17:07.731628] [WARN ] [MAIN ] HWM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:17:07.731884] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-09-29T19:17:07.731932] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-09-29T19:17:07.732405] [DEBUG] [LOCAL ] HWM: Deleted primary data file. [2025-09-29T19:17:07.732463] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-09-29T19:17:08.118133] [INFO ] [REMOTE ] HWM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:17:08.348104] [INFO ] [REMOTE ] HWM: Fetching primary data for 2024-12. [2025-09-29T19:17:08.538567] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-29T19:17:08.647779] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-29T19:17:09.148107] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-09-29T19:17:09.948122] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-09-29T19:17:10.004973] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-29T19:17:10.050423] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-29T19:17:10.748105] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-09-29T19:17:11.420420] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-29T19:17:11.548108] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-09-29T19:17:12.348121] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-09-29T19:17:12.708696] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-29T19:17:13.148105] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-09-29T19:17:13.473915] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-29T19:17:13.485406] [INFO ] [REMOTE ] HUN: Full fetch complete (76607 records). [2025-09-29T19:17:13.485590] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-09-29T19:17:13.911271] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-09-29T19:17:13.911578] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-09-29T19:17:13.921977] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-09-29T19:17:13.927911] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-09-29T19:17:13.939817] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-29T19:17:13.948350] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-09-29T19:17:13.949744] [DEBUG] [LOCAL ] HUN: Trimmed 76607 records to 53195 (keeping 200 days of data) [2025-09-29T19:17:14.303306] [DEBUG] [LOCAL ] HUN: Primary data saved (53195 records). [2025-09-29T19:17:14.303485] [INFO ] [MAIN ] HUN: Full history saved. [2025-09-29T19:17:14.303579] [INFO ] [MAIN ] Update Progress: 1069/2371 symbols completed. HUN took 30.9s. Estimated remaining: 2h 47m 5s. Rate: 7.8 symbols/min [2025-09-29T19:17:14.484128] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:17:14.533450] [DEBUG] [LOCAL ] HXL: Loaded 46661 existing records from primary storage. [2025-09-29T19:17:14.533862] [INFO ] [MAIN ] HXL: Loaded 46661 existing records. [2025-09-29T19:17:14.722503] [WARN ] [MAIN ] HXL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:17:14.723165] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-09-29T19:17:14.723397] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-09-29T19:17:14.723804] [DEBUG] [LOCAL ] HXL: Deleted primary data file. [2025-09-29T19:17:14.723870] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-09-29T19:17:14.757198] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-09-29T19:17:14.906526] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-29T19:17:15.140771] [INFO ] [REMOTE ] HXL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:17:15.170725] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-29T19:17:15.548151] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-09-29T19:17:16.348133] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-09-29T19:17:16.410764] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-29T19:17:17.148151] [INFO ] [REMOTE ] HXL: Fetching primary data for 2024-12. [2025-09-29T19:17:17.298510] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-29T19:17:17.547928] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-29T19:17:17.948100] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-09-29T19:17:18.555621] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-29T19:17:18.748133] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-09-29T19:17:19.548151] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-09-29T19:17:19.823857] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-29T19:17:20.260035] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-29T19:17:20.348100] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-09-29T19:17:20.601120] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-29T19:17:20.604779] [INFO ] [REMOTE ] HVT: Full fetch complete (23483 records). [2025-09-29T19:17:20.604899] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-09-29T19:17:20.987207] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-09-29T19:17:20.987311] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-09-29T19:17:20.987843] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-09-29T19:17:20.987906] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-09-29T19:17:20.988577] [DEBUG] [LOCAL ] HVT: Trimmed 23483 records to 15684 (keeping 200 days of data) [2025-09-29T19:17:21.085366] [DEBUG] [LOCAL ] HVT: Primary data saved (15684 records). [2025-09-29T19:17:21.085516] [INFO ] [MAIN ] HVT: Full history saved. [2025-09-29T19:17:21.085600] [INFO ] [MAIN ] Update Progress: 1070/2371 symbols completed. HVT took 26.7s. Estimated remaining: 2h 46m 57s. Rate: 7.8 symbols/min [2025-09-29T19:17:21.153249] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-09-29T19:17:21.265311] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:17:21.279858] [DEBUG] [LOCAL ] HY: Loaded 10192 existing records from primary storage. [2025-09-29T19:17:21.280091] [INFO ] [MAIN ] HY: Loaded 10192 existing records. [2025-09-29T19:17:21.496387] [WARN ] [MAIN ] HY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:17:21.497070] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-09-29T19:17:21.497145] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-09-29T19:17:21.497562] [DEBUG] [LOCAL ] HY: Deleted primary data file. [2025-09-29T19:17:21.497622] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-09-29T19:17:21.877538] [INFO ] [REMOTE ] HY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:17:21.948140] [INFO ] [REMOTE ] HY: Fetching primary data for 2024-12. [2025-09-29T19:17:22.373855] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-29T19:17:22.748109] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-01. [2025-09-29T19:17:22.826095] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-29T19:17:22.902855] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-29T19:17:22.913506] [INFO ] [REMOTE ] HUYA: Full fetch complete (63662 records). [2025-09-29T19:17:22.913733] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-09-29T19:17:23.320817] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-09-29T19:17:23.320954] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-09-29T19:17:23.322254] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-09-29T19:17:23.322350] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-09-29T19:17:23.324248] [DEBUG] [LOCAL ] HUYA: Trimmed 63662 records to 44246 (keeping 200 days of data) [2025-09-29T19:17:23.565917] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-09-29T19:17:23.638147] [DEBUG] [LOCAL ] HUYA: Primary data saved (44246 records). [2025-09-29T19:17:23.638352] [INFO ] [MAIN ] HUYA: Full history saved. [2025-09-29T19:17:23.638503] [INFO ] [MAIN ] Update Progress: 1071/2371 symbols completed. HUYA took 36.8s. Estimated remaining: 2h 46m 43s. Rate: 7.8 symbols/min [2025-09-29T19:17:23.905140] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:17:23.905392] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-09-29T19:17:23.905468] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-09-29T19:17:23.905630] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-09-29T19:17:23.905771] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-29T19:17:23.905859] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-09-29T19:17:23.905921] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-09-29T19:17:24.358540] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-09-29T19:17:24.394123] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-29T19:17:24.541506] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:17:25.070912] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-29T19:17:25.148087] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2024-12. [2025-09-29T19:17:25.419330] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-29T19:17:25.498048] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-29T19:17:25.948109] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-09-29T19:17:26.748147] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-09-29T19:17:27.548117] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-09-29T19:17:28.139611] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-29T19:17:28.214799] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-29T19:17:28.329103] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-29T19:17:28.348062] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-09-29T19:17:29.148122] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-09-29T19:17:29.948168] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-09-29T19:17:30.256332] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-09-29T19:17:30.748103] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-09-29T19:17:30.800715] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-09-29T19:17:30.888701] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-29T19:17:30.992247] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-09-29T19:17:31.548114] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-09-29T19:17:31.788369] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-09-29T19:17:32.348129] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-09-29T19:17:32.662663] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-09-29T19:17:33.148140] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-09-29T19:17:33.948149] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-09-29T19:17:34.291946] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-29T19:17:34.748093] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-09-29T19:17:34.968879] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-29T19:17:35.548125] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-09-29T19:17:36.348094] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-09-29T19:17:36.427287] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-29T19:17:36.466215] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-29T19:17:37.148127] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-09-29T19:17:37.469856] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-29T19:17:37.948156] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-09-29T19:17:38.618238] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-29T19:17:38.631425] [INFO ] [REMOTE ] HWM: Full fetch complete (76632 records). [2025-09-29T19:17:38.631625] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-09-29T19:17:38.753233] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-09-29T19:17:39.062195] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-09-29T19:17:39.062277] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-09-29T19:17:39.063331] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-09-29T19:17:39.063397] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-09-29T19:17:39.065413] [DEBUG] [LOCAL ] HWM: Trimmed 76632 records to 52984 (keeping 200 days of data) [2025-09-29T19:17:39.271498] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-29T19:17:39.438897] [DEBUG] [LOCAL ] HWM: Primary data saved (52984 records). [2025-09-29T19:17:39.439061] [INFO ] [MAIN ] HWM: Full history saved. [2025-09-29T19:17:39.439198] [INFO ] [MAIN ] Update Progress: 1072/2371 symbols completed. HWM took 32.2s. Estimated remaining: 2h 46m 45s. Rate: 7.8 symbols/min [2025-09-29T19:17:39.551218] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-09-29T19:17:39.622547] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:17:39.623047] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-09-29T19:17:39.623731] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-09-29T19:17:39.623924] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-09-29T19:17:39.623984] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-09-29T19:17:39.624552] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-09-29T19:17:39.624720] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-09-29T19:17:39.991563] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-29T19:17:40.124553] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:17:40.348099] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2024-12. [2025-09-29T19:17:40.446834] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-29T19:17:40.697691] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-29T19:17:41.148171] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-09-29T19:17:41.948179] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-09-29T19:17:42.173808] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-09-29T19:17:42.754663] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-09-29T19:17:42.773966] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-29T19:17:43.548148] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-09-29T19:17:43.594387] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-29T19:17:43.872028] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-29T19:17:43.872837] [INFO ] [REMOTE ] HYAC: Full fetch complete (864 records). [2025-09-29T19:17:43.872910] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-09-29T19:17:43.873260] [FATAL] [VALIDATOR ] HYAC: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T19:17:43.873368] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-09-29T19:17:43.873440] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-09-29T19:17:43.873574] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-29T19:17:43.873729] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-09-29T19:17:43.873792] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-09-29T19:17:43.873891] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-09-29T19:17:43.873983] [INFO ] [MAIN ] Update Progress: 1073/2371 symbols completed. HYAC took 20.2s. Estimated remaining: 2h 46m 33s. Rate: 7.8 symbols/min [2025-09-29T19:17:44.050989] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:17:44.068182] [DEBUG] [LOCAL ] HYI: Loaded 9254 existing records from primary storage. [2025-09-29T19:17:44.068401] [INFO ] [MAIN ] HYI: Loaded 9254 existing records. [2025-09-29T19:17:44.252691] [WARN ] [MAIN ] HYI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:17:44.252898] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-09-29T19:17:44.252948] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-09-29T19:17:44.253261] [DEBUG] [LOCAL ] HYI: Deleted primary data file. [2025-09-29T19:17:44.253320] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-09-29T19:17:44.355400] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-09-29T19:17:44.644368] [INFO ] [REMOTE ] HYI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:17:45.148111] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-09-29T19:17:45.948107] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-09-29T19:17:46.029887] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-29T19:17:46.047512] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-29T19:17:46.281219] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-29T19:17:46.748139] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-09-29T19:17:46.990794] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-09-29T19:17:47.548145] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-09-29T19:17:48.348116] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-09-29T19:17:49.115200] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-29T19:17:49.148065] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-09-29T19:17:49.162318] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-29T19:17:49.948105] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-09-29T19:17:50.180679] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-09-29T19:17:50.748089] [INFO ] [REMOTE ] HYI: Fetching primary data for 2024-12. [2025-09-29T19:17:50.874562] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-29T19:17:50.888947] [INFO ] [REMOTE ] HXL: Full fetch complete (66235 records). [2025-09-29T19:17:50.889146] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-09-29T19:17:51.326574] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-09-29T19:17:51.326744] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-09-29T19:17:51.327850] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-09-29T19:17:51.327926] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-09-29T19:17:51.329372] [DEBUG] [LOCAL ] HXL: Trimmed 66235 records to 45991 (keeping 200 days of data) [2025-09-29T19:17:51.480283] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-29T19:17:51.548559] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-09-29T19:17:51.654933] [DEBUG] [LOCAL ] HXL: Primary data saved (45991 records). [2025-09-29T19:17:51.655081] [INFO ] [MAIN ] HXL: Full history saved. [2025-09-29T19:17:51.655189] [INFO ] [MAIN ] Update Progress: 1074/2371 symbols completed. HXL took 37.4s. Estimated remaining: 2h 46m 26s. Rate: 7.8 symbols/min [2025-09-29T19:17:51.834969] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:17:51.871870] [DEBUG] [LOCAL ] HYT: Loaded 33853 existing records from primary storage. [2025-09-29T19:17:51.872166] [INFO ] [MAIN ] HYT: Loaded 33853 existing records. [2025-09-29T19:17:51.946026] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-29T19:17:52.060275] [WARN ] [MAIN ] HYT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:17:52.060512] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-09-29T19:17:52.060562] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-09-29T19:17:52.060891] [DEBUG] [LOCAL ] HYT: Deleted primary data file. [2025-09-29T19:17:52.060953] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-09-29T19:17:52.353444] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-01. [2025-09-29T19:17:52.437768] [INFO ] [REMOTE ] HYT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:17:53.148128] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-09-29T19:17:53.191982] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-29T19:17:53.471247] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-29T19:17:53.948258] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-09-29T19:17:54.713486] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-29T19:17:54.748131] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-09-29T19:17:55.548125] [INFO ] [REMOTE ] HYT: Fetching primary data for 2024-12. [2025-09-29T19:17:55.919853] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-29T19:17:55.923220] [INFO ] [REMOTE ] HY: Full fetch complete (15186 records). [2025-09-29T19:17:55.923305] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-09-29T19:17:56.328397] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-09-29T19:17:56.328475] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-09-29T19:17:56.328823] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-09-29T19:17:56.328885] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-09-29T19:17:56.329402] [DEBUG] [LOCAL ] HY: Trimmed 15186 records to 9987 (keeping 200 days of data) [2025-09-29T19:17:56.359808] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-09-29T19:17:56.399768] [DEBUG] [LOCAL ] HY: Primary data saved (9987 records). [2025-09-29T19:17:56.399892] [INFO ] [MAIN ] HY: Full history saved. [2025-09-29T19:17:56.399988] [INFO ] [MAIN ] Update Progress: 1075/2371 symbols completed. HY took 35.3s. Estimated remaining: 2h 46m 14s. Rate: 7.8 symbols/min [2025-09-29T19:17:56.584414] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:17:56.592017] [DEBUG] [LOCAL ] HYTR: Loaded 3208 existing records from primary storage. [2025-09-29T19:17:56.592266] [INFO ] [MAIN ] HYTR: Loaded 3208 existing records. [2025-09-29T19:17:56.805519] [WARN ] [MAIN ] HYTR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:17:56.806098] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-09-29T19:17:56.806279] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-09-29T19:17:56.806584] [DEBUG] [LOCAL ] HYTR: Deleted primary data file. [2025-09-29T19:17:56.806698] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-09-29T19:17:56.960691] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-29T19:17:57.153244] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-09-29T19:17:57.235180] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:17:57.236992] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-29T19:17:57.588255] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-29T19:17:57.948094] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-09-29T19:17:58.308961] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-29T19:17:58.748126] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-09-29T19:17:59.077615] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-29T19:17:59.548124] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-09-29T19:17:59.888687] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-29T19:17:59.889421] [INFO ] [REMOTE ] HYBX: Full fetch complete (794 records). [2025-09-29T19:17:59.889493] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-09-29T19:18:00.085837] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-29T19:18:00.086032] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-09-29T19:18:00.086107] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-09-29T19:18:00.086186] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-09-29T19:18:00.086261] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-09-29T19:18:00.086304] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-09-29T19:18:00.086376] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-09-29T19:18:00.086458] [INFO ] [MAIN ] Update Progress: 1076/2371 symbols completed. HYBX took 20.6s. Estimated remaining: 2h 46m 2s. Rate: 7.8 symbols/min [2025-09-29T19:18:00.279519] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:18:00.316279] [DEBUG] [LOCAL ] HZO: Loaded 29733 existing records from primary storage. [2025-09-29T19:18:00.316626] [INFO ] [MAIN ] HZO: Loaded 29733 existing records. [2025-09-29T19:18:00.353237] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2024-12. [2025-09-29T19:18:00.509986] [WARN ] [MAIN ] HZO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:18:00.510231] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-09-29T19:18:00.510291] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-09-29T19:18:00.510723] [DEBUG] [LOCAL ] HZO: Deleted primary data file. [2025-09-29T19:18:00.510788] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-09-29T19:18:00.915565] [INFO ] [REMOTE ] HZO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:18:00.919188] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-29T19:18:01.148163] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-01. [2025-09-29T19:18:01.653016] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-29T19:18:01.948141] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-09-29T19:18:02.749819] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-01. [2025-09-29T19:18:02.751084] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-29T19:18:03.548112] [INFO ] [REMOTE ] HZO: Fetching primary data for 2024-12. [2025-09-29T19:18:03.936808] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-29T19:18:04.348108] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-09-29T19:18:04.642464] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-29T19:18:05.092273] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-29T19:18:05.148094] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-01. [2025-09-29T19:18:05.948099] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-09-29T19:18:06.421196] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-29T19:18:06.748158] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-09-29T19:18:07.217328] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-29T19:18:07.548107] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-09-29T19:18:08.197669] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-29T19:18:08.201233] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-29T19:18:08.348113] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-09-29T19:18:08.896036] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-29T19:18:09.148112] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-09-29T19:18:09.948116] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-09-29T19:18:10.609056] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-29T19:18:10.715508] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-29T19:18:10.748098] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-09-29T19:18:11.309421] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-29T19:18:11.548101] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-09-29T19:18:12.100175] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-29T19:18:12.348127] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-09-29T19:18:13.148112] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-09-29T19:18:13.725981] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-29T19:18:13.948141] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-09-29T19:18:14.325395] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-29T19:18:14.748152] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-09-29T19:18:15.066008] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-29T19:18:15.490050] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-29T19:18:15.548139] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-09-29T19:18:16.348155] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-09-29T19:18:16.380276] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-29T19:18:16.832840] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-29T19:18:17.148170] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-09-29T19:18:17.630002] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-29T19:18:17.948147] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-09-29T19:18:18.748213] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-09-29T19:18:19.313276] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-29T19:18:19.314688] [INFO ] [REMOTE ] HYTR: Full fetch complete (4486 records). [2025-09-29T19:18:19.314858] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-09-29T19:18:19.450290] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-29T19:18:19.553737] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-09-29T19:18:19.733371] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-09-29T19:18:19.733462] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-09-29T19:18:19.733660] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-09-29T19:18:19.733733] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-09-29T19:18:19.734158] [DEBUG] [LOCAL ] HYTR: Trimmed 4486 records to 3140 (keeping 200 days of data) [2025-09-29T19:18:19.755915] [DEBUG] [LOCAL ] HYTR: Primary data saved (3140 records). [2025-09-29T19:18:19.756053] [INFO ] [MAIN ] HYTR: Full history saved. [2025-09-29T19:18:19.756149] [INFO ] [MAIN ] Update Progress: 1077/2371 symbols completed. HYTR took 23.4s. Estimated remaining: 2h 46m 9s. Rate: 7.8 symbols/min [2025-09-29T19:18:20.348186] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-09-29T19:18:20.937463] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-29T19:18:21.148137] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-09-29T19:18:21.643815] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-29T19:18:21.948196] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-09-29T19:18:22.376434] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-29T19:18:22.748135] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-09-29T19:18:23.409928] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-29T19:18:23.548154] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-09-29T19:18:24.070727] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-29T19:18:24.125528] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-29T19:18:24.348151] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-09-29T19:18:25.148171] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-09-29T19:18:25.561769] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-29T19:18:25.948142] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-09-29T19:18:25.985754] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-29T19:18:25.988249] [INFO ] [REMOTE ] HYI: Full fetch complete (13223 records). [2025-09-29T19:18:25.988330] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-09-29T19:18:26.368217] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-09-29T19:18:26.368324] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-09-29T19:18:26.368717] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-09-29T19:18:26.368784] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-09-29T19:18:26.369777] [DEBUG] [LOCAL ] HYI: Trimmed 13223 records to 9292 (keeping 200 days of data) [2025-09-29T19:18:26.449585] [DEBUG] [LOCAL ] HYI: Primary data saved (9292 records). [2025-09-29T19:18:26.449793] [INFO ] [MAIN ] HYI: Full history saved. [2025-09-29T19:18:26.449938] [INFO ] [MAIN ] Update Progress: 1078/2371 symbols completed. HYI took 42.6s. Estimated remaining: 2h 45m 60s. Rate: 7.8 symbols/min [2025-09-29T19:18:26.748154] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-09-29T19:18:27.231774] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-29T19:18:27.237889] [INFO ] [REMOTE ] HZO: Full fetch complete (40868 records). [2025-09-29T19:18:27.237998] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-09-29T19:18:27.646123] [DEBUG] [VALIDATOR ] HZO: All expected trading days are present. [2025-09-29T19:18:27.646242] [DEBUG] [VALIDATOR ] HZO: Primary data validation passed. [2025-09-29T19:18:27.647157] [INFO ] [MAIN ] HZO: Fetched primary data is valid. [2025-09-29T19:18:27.647225] [DEBUG] [LOCAL ] HZO: Saving primary data. [2025-09-29T19:18:27.648304] [DEBUG] [LOCAL ] HZO: Trimmed 40868 records to 29189 (keeping 200 days of data) [2025-09-29T19:18:27.826395] [DEBUG] [LOCAL ] HZO: Primary data saved (29189 records). [2025-09-29T19:18:27.826542] [INFO ] [MAIN ] HZO: Full history saved. [2025-09-29T19:18:27.826631] [INFO ] [MAIN ] Update Progress: 1079/2371 symbols completed. HZO took 27.7s. Estimated remaining: 2h 45m 44s. Rate: 7.8 symbols/min [2025-09-29T19:18:28.229301] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-29T19:18:28.237770] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-09-29T19:18:29.833251] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-29T19:18:29.840291] [INFO ] [REMOTE ] HYT: Full fetch complete (47230 records). [2025-09-29T19:18:29.840422] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-09-29T19:18:30.249378] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present. [2025-09-29T19:18:30.249471] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed. [2025-09-29T19:18:30.250374] [INFO ] [MAIN ] HYT: Fetched primary data is valid. [2025-09-29T19:18:30.250456] [DEBUG] [LOCAL ] HYT: Saving primary data. [2025-09-29T19:18:30.251562] [DEBUG] [LOCAL ] HYT: Trimmed 47230 records to 33536 (keeping 200 days of data) [2025-09-29T19:18:30.470114] [DEBUG] [LOCAL ] HYT: Primary data saved (33536 records). [2025-09-29T19:18:30.470271] [INFO ] [MAIN ] HYT: Full history saved. [2025-09-29T19:18:30.470392] [INFO ] [MAIN ] Update Progress: 1080/2371 symbols completed. HYT took 38.8s. Estimated remaining: 2h 45m 31s. Rate: 7.8 symbols/min [2025-09-29T19:18:31.060882] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:18:31.187588] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:18:31.238694] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:18:31.276132] [DEBUG] [LOCAL ] IAE: Loaded 6104 existing records from primary storage. [2025-09-29T19:18:31.280233] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:18:31.280757] [INFO ] [MAIN ] IAE: Loaded 6104 existing records. [2025-09-29T19:18:31.483730] [WARN ] [MAIN ] IAE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:18:31.484902] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-09-29T19:18:31.485185] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-09-29T19:18:31.500674] [DEBUG] [LOCAL ] IAE: Deleted primary data file. [2025-09-29T19:18:31.500766] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-09-29T19:18:31.693211] [DEBUG] [LOCAL ] IBN: Loaded 53654 existing records from primary storage. [2025-09-29T19:18:31.691864] [DEBUG] [LOCAL ] IAG: Loaded 54225 existing records from primary storage. [2025-09-29T19:18:31.714943] [INFO ] [MAIN ] IBN: Loaded 53654 existing records. [2025-09-29T19:18:31.760489] [INFO ] [MAIN ] IAG: Loaded 54225 existing records. [2025-09-29T19:18:31.834834] [DEBUG] [LOCAL ] IBM: Loaded 54416 existing records from primary storage. [2025-09-29T19:18:31.985764] [INFO ] [MAIN ] IBM: Loaded 54416 existing records. [2025-09-29T19:18:32.442051] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:18:32.445368] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:18:32.479124] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-09-29T19:18:32.488944] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-09-29T19:18:32.489047] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-09-29T19:18:32.545682] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-09-29T19:18:32.549558] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-09-29T19:18:32.578639] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-09-29T19:18:32.622318] [INFO ] [REMOTE ] IAE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:18:32.615687] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-09-29T19:18:32.675005] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-09-29T19:18:32.648551] [INFO ] [REMOTE ] IAE: Fetching primary data for 2024-12. [2025-09-29T19:18:32.704206] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:18:32.740979] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-09-29T19:18:32.792049] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-09-29T19:18:32.822960] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-09-29T19:18:32.861676] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-09-29T19:18:33.761638] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-29T19:18:33.770992] [INFO ] [REMOTE ] IAG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:18:33.784317] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-09-29T19:18:33.784849] [INFO ] [REMOTE ] IAG: Fetching primary data for 2024-12. [2025-09-29T19:18:33.838887] [INFO ] [REMOTE ] IBN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:18:33.845956] [INFO ] [REMOTE ] IBN: Fetching primary data for 2024-12. [2025-09-29T19:18:33.927558] [INFO ] [REMOTE ] IBM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:18:33.927987] [INFO ] [REMOTE ] IBM: Fetching primary data for 2024-12. [2025-09-29T19:18:34.500983] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-29T19:18:34.503447] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-09-29T19:18:35.111021] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-29T19:18:35.113208] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-09-29T19:18:35.733269] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-29T19:18:35.746059] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-09-29T19:18:35.753303] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-29T19:18:35.755925] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-09-29T19:18:36.017750] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-09-29T19:18:36.028608] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-01. [2025-09-29T19:18:36.154566] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-29T19:18:36.348107] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-01. [2025-09-29T19:18:36.387777] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-29T19:18:37.148146] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-09-29T19:18:37.606965] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-29T19:18:37.720425] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-29T19:18:37.853289] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-29T19:18:37.948156] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-09-29T19:18:38.591291] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-29T19:18:38.748113] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-09-29T19:18:38.915983] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-09-29T19:18:39.548178] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-09-29T19:18:40.348123] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-09-29T19:18:40.496205] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-29T19:18:40.774731] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-29T19:18:41.023948] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-29T19:18:41.148104] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-09-29T19:18:41.803991] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-29T19:18:41.948114] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-09-29T19:18:42.748115] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-09-29T19:18:43.548118] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-09-29T19:18:43.577540] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-29T19:18:43.580034] [INFO ] [REMOTE ] IAE: Full fetch complete (8675 records). [2025-09-29T19:18:43.580108] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-09-29T19:18:44.011255] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-09-29T19:18:44.015029] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-09-29T19:18:44.015412] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-09-29T19:18:44.015770] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-09-29T19:18:44.019226] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-29T19:18:44.019696] [DEBUG] [LOCAL ] IAE: Trimmed 8675 records to 6041 (keeping 200 days of data) [2025-09-29T19:18:44.073456] [DEBUG] [LOCAL ] IAE: Primary data saved (6041 records). [2025-09-29T19:18:44.073692] [INFO ] [MAIN ] IAE: Full history saved. [2025-09-29T19:18:44.073840] [INFO ] [MAIN ] Update Progress: 1081/2371 symbols completed. IAE took 13.6s. Estimated remaining: 2h 45m 30s. Rate: 7.8 symbols/min [2025-09-29T19:18:44.256707] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:18:44.296400] [DEBUG] [LOCAL ] IBP: Loaded 29584 existing records from primary storage. [2025-09-29T19:18:44.296775] [INFO ] [MAIN ] IBP: Loaded 29584 existing records. [2025-09-29T19:18:44.353278] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-09-29T19:18:44.521980] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:18:44.522218] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-09-29T19:18:44.522265] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-09-29T19:18:44.522552] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-09-29T19:18:44.522612] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-09-29T19:18:44.905580] [INFO ] [REMOTE ] IBP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:18:45.148085] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-09-29T19:18:45.434790] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-29T19:18:45.948177] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-09-29T19:18:46.326059] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-29T19:18:46.760154] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-09-29T19:18:46.765944] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-29T19:18:47.548119] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-09-29T19:18:47.818328] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-29T19:18:48.348088] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-09-29T19:18:48.617246] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-29T19:18:49.148099] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-09-29T19:18:49.329942] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-29T19:18:49.948119] [INFO ] [REMOTE ] IBP: Fetching primary data for 2024-12. [2025-09-29T19:18:50.618007] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-29T19:18:50.748136] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-09-29T19:18:50.901499] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-29T19:18:50.983695] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-29T19:18:51.548178] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-09-29T19:18:52.348135] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-09-29T19:18:52.634344] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-29T19:18:52.830489] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-29T19:18:53.148119] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-09-29T19:18:53.948106] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-09-29T19:18:54.255915] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-29T19:18:54.335491] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-29T19:18:54.748116] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-09-29T19:18:55.548108] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-09-29T19:18:55.791624] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-29T19:18:56.104696] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-29T19:18:56.348152] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-09-29T19:18:57.148153] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-09-29T19:18:57.745192] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-29T19:18:57.948135] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-09-29T19:18:58.212987] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-29T19:18:58.748181] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-09-29T19:18:58.951605] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-29T19:18:59.287863] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-29T19:18:59.548126] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-09-29T19:19:00.348120] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-09-29T19:19:01.148146] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-09-29T19:19:01.444865] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (2.70 seconds). [2025-09-29T19:19:01.624470] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-29T19:19:01.636080] [INFO ] [REMOTE ] IBN: Full fetch complete (76282 records). [2025-09-29T19:19:01.636213] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-09-29T19:19:01.948489] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-09-29T19:19:02.055787] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-09-29T19:19:02.055876] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-09-29T19:19:02.056922] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-09-29T19:19:02.056988] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-09-29T19:19:02.058458] [DEBUG] [LOCAL ] IBN: Trimmed 76282 records to 52868 (keeping 200 days of data) [2025-09-29T19:19:02.434765] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-29T19:19:02.454353] [DEBUG] [LOCAL ] IBN: Primary data saved (52868 records). [2025-09-29T19:19:02.454516] [INFO ] [MAIN ] IBN: Full history saved. [2025-09-29T19:19:02.454678] [INFO ] [MAIN ] Update Progress: 1082/2371 symbols completed. IBN took 32.0s. Estimated remaining: 2h 45m 35s. Rate: 7.8 symbols/min [2025-09-29T19:19:02.586498] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-29T19:19:02.667063] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:19:02.708720] [DEBUG] [LOCAL ] IBTA: Loaded 38445 existing records from primary storage. [2025-09-29T19:19:02.709060] [INFO ] [MAIN ] IBTA: Loaded 38445 existing records. [2025-09-29T19:19:02.753391] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-09-29T19:19:02.900881] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:19:02.901142] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-09-29T19:19:02.901191] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-09-29T19:19:02.901502] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-09-29T19:19:02.901561] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-09-29T19:19:03.272379] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:19:03.548101] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2024-12. [2025-09-29T19:19:04.026799] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-29T19:19:04.103094] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-29T19:19:04.348107] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-09-29T19:19:04.851284] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-29T19:19:05.148171] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-09-29T19:19:05.948130] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-09-29T19:19:06.480348] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-29T19:19:06.748074] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-09-29T19:19:06.899681] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-29T19:19:07.001923] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (2.65 seconds). [2025-09-29T19:19:07.014364] [INFO ] [REMOTE ] IBM: Full fetch complete (77620 records). [2025-09-29T19:19:07.014531] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-09-29T19:19:07.438206] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-09-29T19:19:07.438289] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-09-29T19:19:07.439352] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-09-29T19:19:07.439420] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-09-29T19:19:07.440899] [DEBUG] [LOCAL ] IBM: Trimmed 77620 records to 53636 (keeping 200 days of data) [2025-09-29T19:19:07.548277] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-09-29T19:19:07.803444] [DEBUG] [LOCAL ] IBM: Primary data saved (53636 records). [2025-09-29T19:19:07.803733] [INFO ] [MAIN ] IBM: Full history saved. [2025-09-29T19:19:07.803858] [INFO ] [MAIN ] Update Progress: 1083/2371 symbols completed. IBM took 37.3s. Estimated remaining: 2h 45m 24s. Rate: 7.8 symbols/min [2025-09-29T19:19:07.996771] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:19:08.061872] [DEBUG] [LOCAL ] ICE: Loaded 53800 existing records from primary storage. [2025-09-29T19:19:08.062236] [INFO ] [MAIN ] ICE: Loaded 53800 existing records. [2025-09-29T19:19:08.272479] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-29T19:19:08.278835] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:19:08.284020] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-09-29T19:19:08.284351] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-09-29T19:19:08.285351] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-09-29T19:19:08.285418] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-09-29T19:19:08.354215] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-09-29T19:19:08.662306] [INFO ] [REMOTE ] ICE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:19:09.073528] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-29T19:19:09.148129] [INFO ] [REMOTE ] ICE: Fetching primary data for 2024-12. [2025-09-29T19:19:09.948118] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-09-29T19:19:10.363167] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-29T19:19:10.748094] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-09-29T19:19:11.019718] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-29T19:19:11.416912] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-29T19:19:11.423621] [INFO ] [REMOTE ] IBP: Full fetch complete (41193 records). [2025-09-29T19:19:11.423796] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-09-29T19:19:11.553278] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-01. [2025-09-29T19:19:11.843989] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-09-29T19:19:11.844100] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-09-29T19:19:11.845003] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-09-29T19:19:11.845071] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-09-29T19:19:11.846204] [DEBUG] [LOCAL ] IBP: Trimmed 41193 records to 29054 (keeping 200 days of data) [2025-09-29T19:19:12.048618] [DEBUG] [LOCAL ] IBP: Primary data saved (29054 records). [2025-09-29T19:19:12.048840] [INFO ] [MAIN ] IBP: Full history saved. [2025-09-29T19:19:12.048967] [INFO ] [MAIN ] Update Progress: 1084/2371 symbols completed. IBP took 28.0s. Estimated remaining: 2h 45m 13s. Rate: 7.8 symbols/min [2025-09-29T19:19:12.273509] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:19:12.321586] [DEBUG] [LOCAL ] ICL: Loaded 39135 existing records from primary storage. [2025-09-29T19:19:12.321966] [INFO ] [MAIN ] ICL: Loaded 39135 existing records. [2025-09-29T19:19:12.355475] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-09-29T19:19:12.521583] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:19:12.522028] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-09-29T19:19:12.522124] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-09-29T19:19:12.522514] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-09-29T19:19:12.522577] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-09-29T19:19:12.919152] [INFO ] [REMOTE ] ICL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:19:12.950918] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-29T19:19:12.962314] [INFO ] [REMOTE ] IAG: Full fetch complete (77230 records). [2025-09-29T19:19:12.962474] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-09-29T19:19:13.150742] [INFO ] [REMOTE ] ICL: Fetching primary data for 2024-12. [2025-09-29T19:19:13.384529] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-09-29T19:19:13.384711] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-09-29T19:19:13.385958] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-09-29T19:19:13.386063] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-09-29T19:19:13.387878] [DEBUG] [LOCAL ] IAG: Trimmed 77230 records to 53448 (keeping 200 days of data) [2025-09-29T19:19:13.631183] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-29T19:19:13.781071] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-29T19:19:13.805025] [DEBUG] [LOCAL ] IAG: Primary data saved (53448 records). [2025-09-29T19:19:13.805182] [INFO ] [MAIN ] IAG: Full history saved. [2025-09-29T19:19:13.805290] [INFO ] [MAIN ] Update Progress: 1085/2371 symbols completed. IAG took 43.3s. Estimated remaining: 2h 44m 58s. Rate: 7.8 symbols/min [2025-09-29T19:19:13.957039] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-09-29T19:19:13.984408] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:19:14.033597] [DEBUG] [LOCAL ] IDA: Loaded 32398 existing records from primary storage. [2025-09-29T19:19:14.034016] [INFO ] [MAIN ] IDA: Loaded 32398 existing records. [2025-09-29T19:19:14.230076] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:19:14.230360] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-09-29T19:19:14.230410] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-09-29T19:19:14.231516] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-09-29T19:19:14.231580] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-09-29T19:19:14.632480] [INFO ] [REMOTE ] IDA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:19:14.753223] [INFO ] [REMOTE ] IDA: Fetching primary data for 2024-12. [2025-09-29T19:19:14.768983] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-29T19:19:15.548099] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-01. [2025-09-29T19:19:15.634098] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-29T19:19:16.005750] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-29T19:19:16.348152] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-09-29T19:19:17.043574] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-29T19:19:17.148126] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-09-29T19:19:17.948147] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-09-29T19:19:18.086675] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-29T19:19:18.659416] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-29T19:19:18.748116] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-09-29T19:19:19.130432] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-29T19:19:19.548165] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-01. [2025-09-29T19:19:20.348117] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-09-29T19:19:20.399489] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-29T19:19:20.495289] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-29T19:19:21.148122] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-09-29T19:19:21.948127] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-09-29T19:19:22.349236] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-29T19:19:22.516018] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-29T19:19:22.748120] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-09-29T19:19:23.129369] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-29T19:19:23.548162] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-09-29T19:19:23.629933] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-29T19:19:24.348126] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-09-29T19:19:24.579542] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-29T19:19:25.148177] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-09-29T19:19:25.563585] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-29T19:19:25.948129] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-09-29T19:19:26.426955] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-29T19:19:26.748243] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-09-29T19:19:27.548158] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-09-29T19:19:27.624720] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-29T19:19:28.252138] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-29T19:19:28.348085] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-09-29T19:19:28.434241] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-29T19:19:29.148105] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-09-29T19:19:29.412812] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-29T19:19:29.948151] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-09-29T19:19:30.755626] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-09-29T19:19:30.761785] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-29T19:19:31.424678] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-29T19:19:31.548195] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-09-29T19:19:32.348124] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-09-29T19:19:32.685166] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-29T19:19:33.134474] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-29T19:19:33.148081] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-09-29T19:19:33.304871] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-29T19:19:33.948102] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-09-29T19:19:34.412404] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-29T19:19:34.748219] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-09-29T19:19:35.548209] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-09-29T19:19:35.780699] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-29T19:19:36.305106] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-29T19:19:36.311709] [INFO ] [REMOTE ] IDA: Full fetch complete (44749 records). [2025-09-29T19:19:36.311960] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-09-29T19:19:36.357259] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-09-29T19:19:36.699974] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-09-29T19:19:36.700111] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-09-29T19:19:36.701541] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-09-29T19:19:36.701609] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-09-29T19:19:36.703095] [DEBUG] [LOCAL ] IDA: Trimmed 44749 records to 31989 (keeping 200 days of data) [2025-09-29T19:19:36.942403] [DEBUG] [LOCAL ] IDA: Primary data saved (31989 records). [2025-09-29T19:19:36.942626] [INFO ] [MAIN ] IDA: Full history saved. [2025-09-29T19:19:36.942801] [INFO ] [MAIN ] Update Progress: 1086/2371 symbols completed. IDA took 23.1s. Estimated remaining: 2h 45m 8s. Rate: 7.8 symbols/min [2025-09-29T19:19:37.124607] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:19:37.148639] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-09-29T19:19:37.162406] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-29T19:19:37.176820] [DEBUG] [LOCAL ] IDE: Loaded 8755 existing records from primary storage. [2025-09-29T19:19:37.177433] [INFO ] [MAIN ] IDE: Loaded 8755 existing records. [2025-09-29T19:19:37.220103] [INFO ] [REMOTE ] IBTA: Full fetch complete (50649 records). [2025-09-29T19:19:37.246746] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-09-29T19:19:37.523459] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:19:37.542916] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-09-29T19:19:37.587448] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-09-29T19:19:37.668427] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-09-29T19:19:37.688164] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-09-29T19:19:37.925138] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-09-29T19:19:37.950397] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-09-29T19:19:37.963160] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-09-29T19:19:37.992983] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-09-29T19:19:38.093995] [DEBUG] [LOCAL ] IBTA: Trimmed 50649 records to 37651 (keeping 200 days of data) [2025-09-29T19:19:38.281490] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-29T19:19:38.303869] [INFO ] [REMOTE ] IDE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:19:38.314359] [INFO ] [REMOTE ] IDE: Fetching primary data for 2024-12. [2025-09-29T19:19:38.456990] [DEBUG] [LOCAL ] IBTA: Primary data saved (37651 records). [2025-09-29T19:19:38.457173] [INFO ] [MAIN ] IBTA: Full history saved. [2025-09-29T19:19:38.457267] [INFO ] [MAIN ] Update Progress: 1087/2371 symbols completed. IBTA took 36.0s. Estimated remaining: 2h 44m 53s. Rate: 7.8 symbols/min [2025-09-29T19:19:38.679707] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:19:38.701377] [DEBUG] [LOCAL ] IDT: Loaded 17885 existing records from primary storage. [2025-09-29T19:19:38.701725] [INFO ] [MAIN ] IDT: Loaded 17885 existing records. [2025-09-29T19:19:38.748826] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-09-29T19:19:38.904404] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:19:38.904957] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-09-29T19:19:38.905022] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-09-29T19:19:38.905592] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-09-29T19:19:38.905683] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-09-29T19:19:39.200321] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-29T19:19:39.267882] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-29T19:19:39.349133] [INFO ] [REMOTE ] IDT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:19:39.548117] [INFO ] [REMOTE ] IDT: Fetching primary data for 2024-12. [2025-09-29T19:19:40.348155] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-01. [2025-09-29T19:19:40.403430] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-29T19:19:40.411763] [INFO ] [REMOTE ] ICL: Full fetch complete (56003 records). [2025-09-29T19:19:40.411978] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-09-29T19:19:40.473444] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-29T19:19:40.842123] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-09-29T19:19:40.842209] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-09-29T19:19:40.843243] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-09-29T19:19:40.843309] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-09-29T19:19:40.846218] [DEBUG] [LOCAL ] ICL: Trimmed 56003 records to 38401 (keeping 200 days of data) [2025-09-29T19:19:41.077078] [DEBUG] [LOCAL ] ICL: Primary data saved (38401 records). [2025-09-29T19:19:41.077234] [INFO ] [MAIN ] ICL: Full history saved. [2025-09-29T19:19:41.077321] [INFO ] [MAIN ] Update Progress: 1088/2371 symbols completed. ICL took 29.0s. Estimated remaining: 2h 44m 40s. Rate: 7.8 symbols/min [2025-09-29T19:19:41.155905] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-01. [2025-09-29T19:19:41.224840] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-29T19:19:41.277795] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:19:41.321798] [DEBUG] [LOCAL ] IEX: Loaded 38978 existing records from primary storage. [2025-09-29T19:19:41.322153] [INFO ] [MAIN ] IEX: Loaded 38978 existing records. [2025-09-29T19:19:41.510491] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:19:41.510755] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-09-29T19:19:41.510810] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-09-29T19:19:41.511147] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-09-29T19:19:41.511208] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-09-29T19:19:41.882300] [INFO ] [REMOTE ] IEX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:19:41.948100] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-09-29T19:19:42.033713] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-29T19:19:42.748129] [INFO ] [REMOTE ] IEX: Fetching primary data for 2024-12. [2025-09-29T19:19:43.548093] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-09-29T19:19:43.737409] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-29T19:19:44.180783] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-29T19:19:44.301269] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-29T19:19:44.348115] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-01. [2025-09-29T19:19:45.148163] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-09-29T19:19:45.712047] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-29T19:19:45.907988] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-29T19:19:45.948095] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-09-29T19:19:46.748089] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-09-29T19:19:46.994181] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-29T19:19:47.548142] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-09-29T19:19:48.348140] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-09-29T19:19:48.628115] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-29T19:19:48.639894] [INFO ] [REMOTE ] ICE: Full fetch complete (76768 records). [2025-09-29T19:19:48.640082] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-09-29T19:19:49.089671] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-09-29T19:19:49.092248] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-09-29T19:19:49.093516] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-09-29T19:19:49.093874] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-09-29T19:19:49.095740] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-29T19:19:49.104287] [DEBUG] [LOCAL ] ICE: Trimmed 76768 records to 53015 (keeping 200 days of data) [2025-09-29T19:19:49.173815] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-09-29T19:19:49.351572] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-29T19:19:49.481822] [DEBUG] [LOCAL ] ICE: Primary data saved (53015 records). [2025-09-29T19:19:49.481972] [INFO ] [MAIN ] ICE: Full history saved. [2025-09-29T19:19:49.482115] [INFO ] [MAIN ] Update Progress: 1089/2371 symbols completed. ICE took 41.7s. Estimated remaining: 2h 44m 33s. Rate: 7.8 symbols/min [2025-09-29T19:19:49.656777] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:19:49.713080] [DEBUG] [LOCAL ] IFF: Loaded 51727 existing records from primary storage. [2025-09-29T19:19:49.713424] [INFO ] [MAIN ] IFF: Loaded 51727 existing records. [2025-09-29T19:19:49.902612] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:19:49.902836] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-09-29T19:19:49.902884] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-09-29T19:19:49.903954] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-09-29T19:19:49.904014] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-09-29T19:19:49.950017] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-09-29T19:19:50.005500] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-29T19:19:50.278854] [INFO ] [REMOTE ] IFF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:19:50.748175] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-09-29T19:19:51.008689] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-29T19:19:51.548139] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-09-29T19:19:52.037303] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-29T19:19:52.311225] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-29T19:19:52.348124] [INFO ] [REMOTE ] IFF: Fetching primary data for 2024-12. [2025-09-29T19:19:53.148115] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-09-29T19:19:53.948130] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-09-29T19:19:53.981797] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-29T19:19:54.266581] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-29T19:19:54.746069] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-29T19:19:54.748587] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-09-29T19:19:55.548122] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-09-29T19:19:56.348156] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-01. [2025-09-29T19:19:56.434837] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-29T19:19:56.468480] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-29T19:19:57.148116] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-09-29T19:19:57.948083] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-09-29T19:19:58.135529] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-29T19:19:58.212421] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-29T19:19:58.748131] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-09-29T19:19:59.419143] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-29T19:19:59.423423] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-29T19:19:59.548098] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-09-29T19:20:00.348142] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-09-29T19:20:01.148111] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-09-29T19:20:01.212880] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-29T19:20:01.472369] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-29T19:20:01.948104] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-09-29T19:20:02.709133] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-29T19:20:02.748144] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-09-29T19:20:03.548119] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-09-29T19:20:03.758469] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-29T19:20:03.775873] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-29T19:20:04.348115] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-09-29T19:20:04.973617] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-29T19:20:05.148123] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-09-29T19:20:05.871989] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-29T19:20:05.948130] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-09-29T19:20:06.405856] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-29T19:20:06.410427] [INFO ] [REMOTE ] IDT: Full fetch complete (22508 records). [2025-09-29T19:20:06.410562] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-09-29T19:20:06.753328] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-09-29T19:20:06.801862] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-09-29T19:20:06.801970] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-09-29T19:20:06.802866] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-09-29T19:20:06.803111] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-09-29T19:20:06.803991] [DEBUG] [LOCAL ] IDT: Trimmed 22508 records to 17684 (keeping 200 days of data) [2025-09-29T19:20:06.925206] [DEBUG] [LOCAL ] IDT: Primary data saved (17684 records). [2025-09-29T19:20:06.925346] [INFO ] [MAIN ] IDT: Full history saved. [2025-09-29T19:20:06.925436] [INFO ] [MAIN ] Update Progress: 1090/2371 symbols completed. IDT took 28.5s. Estimated remaining: 2h 44m 37s. Rate: 7.8 symbols/min [2025-09-29T19:20:07.111711] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:20:07.141577] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-29T19:20:07.165793] [DEBUG] [LOCAL ] IFN: Loaded 18475 existing records from primary storage. [2025-09-29T19:20:07.166086] [INFO ] [MAIN ] IFN: Loaded 18475 existing records. [2025-09-29T19:20:07.370153] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:20:07.370482] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-09-29T19:20:07.370532] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-09-29T19:20:07.371064] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-09-29T19:20:07.371141] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-09-29T19:20:07.556740] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-09-29T19:20:07.758765] [INFO ] [REMOTE ] IFN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:20:08.324288] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-29T19:20:08.348086] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-09-29T19:20:08.595598] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-29T19:20:08.599262] [INFO ] [REMOTE ] IDE: Full fetch complete (12805 records). [2025-09-29T19:20:08.599394] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-09-29T19:20:09.050929] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-09-29T19:20:09.051051] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-09-29T19:20:09.051445] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-09-29T19:20:09.051589] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-09-29T19:20:09.052468] [DEBUG] [LOCAL ] IDE: Trimmed 12805 records to 8697 (keeping 200 days of data) [2025-09-29T19:20:09.115716] [DEBUG] [LOCAL ] IDE: Primary data saved (8697 records). [2025-09-29T19:20:09.115868] [INFO ] [MAIN ] IDE: Full history saved. [2025-09-29T19:20:09.115990] [INFO ] [MAIN ] Update Progress: 1091/2371 symbols completed. IDE took 32.2s. Estimated remaining: 2h 44m 22s. Rate: 7.8 symbols/min [2025-09-29T19:20:09.153280] [INFO ] [REMOTE ] IFN: Fetching primary data for 2024-12. [2025-09-29T19:20:09.303797] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:20:09.332472] [DEBUG] [LOCAL ] IFS: Loaded 23359 existing records from primary storage. [2025-09-29T19:20:09.332806] [INFO ] [MAIN ] IFS: Loaded 23359 existing records. [2025-09-29T19:20:09.529914] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:20:09.530224] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-09-29T19:20:09.530304] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-09-29T19:20:09.530771] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-09-29T19:20:09.530843] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-09-29T19:20:09.913135] [INFO ] [REMOTE ] IFS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:20:09.936353] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-29T19:20:09.945070] [INFO ] [REMOTE ] IEX: Full fetch complete (53355 records). [2025-09-29T19:20:09.945218] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-09-29T19:20:09.957232] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-09-29T19:20:10.349959] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-09-29T19:20:10.350099] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-09-29T19:20:10.350987] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-09-29T19:20:10.351071] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-09-29T19:20:10.366618] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-29T19:20:10.373213] [DEBUG] [LOCAL ] IEX: Trimmed 53355 records to 38289 (keeping 200 days of data) [2025-09-29T19:20:10.659407] [DEBUG] [LOCAL ] IEX: Primary data saved (38289 records). [2025-09-29T19:20:10.659600] [INFO ] [MAIN ] IEX: Full history saved. [2025-09-29T19:20:10.659758] [INFO ] [MAIN ] Update Progress: 1092/2371 symbols completed. IEX took 29.6s. Estimated remaining: 2h 44m 8s. Rate: 7.8 symbols/min [2025-09-29T19:20:10.755766] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-09-29T19:20:10.851719] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:20:10.864447] [DEBUG] [LOCAL ] IGA: Loaded 9779 existing records from primary storage. [2025-09-29T19:20:10.864804] [INFO ] [MAIN ] IGA: Loaded 9779 existing records. [2025-09-29T19:20:11.073815] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:20:11.074027] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-09-29T19:20:11.074077] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-09-29T19:20:11.074289] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-09-29T19:20:11.074350] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-09-29T19:20:11.470382] [INFO ] [REMOTE ] IGA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:20:11.548112] [INFO ] [REMOTE ] IGA: Fetching primary data for 2024-12. [2025-09-29T19:20:11.732759] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-29T19:20:11.955007] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-29T19:20:12.263733] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-29T19:20:12.348131] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-09-29T19:20:13.148120] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-09-29T19:20:13.948124] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-01. [2025-09-29T19:20:14.202543] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-29T19:20:14.244453] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-29T19:20:14.499162] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-29T19:20:14.748107] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-09-29T19:20:15.548102] [INFO ] [REMOTE ] IFS: Fetching primary data for 2024-12. [2025-09-29T19:20:15.819877] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-29T19:20:16.348084] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-09-29T19:20:16.501497] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-29T19:20:17.081453] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-29T19:20:17.148162] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-09-29T19:20:17.948168] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-09-29T19:20:18.216780] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-29T19:20:18.691807] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-29T19:20:18.748195] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-09-29T19:20:19.548128] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-01. [2025-09-29T19:20:20.348138] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-09-29T19:20:20.486749] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-29T19:20:20.563358] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-29T19:20:21.148093] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-09-29T19:20:21.286299] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-29T19:20:21.948115] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-09-29T19:20:22.239769] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-29T19:20:22.678749] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-29T19:20:22.748179] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-09-29T19:20:23.548115] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-09-29T19:20:24.348143] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-09-29T19:20:24.590096] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-29T19:20:24.602015] [INFO ] [REMOTE ] IFF: Full fetch complete (72933 records). [2025-09-29T19:20:24.602222] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-09-29T19:20:24.808078] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-29T19:20:25.088346] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-29T19:20:25.088502] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-09-29T19:20:25.091098] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-09-29T19:20:25.092630] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-09-29T19:20:25.092724] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-09-29T19:20:25.094169] [DEBUG] [LOCAL ] IFF: Trimmed 72933 records to 50976 (keeping 200 days of data) [2025-09-29T19:20:25.152461] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-09-29T19:20:25.440014] [DEBUG] [LOCAL ] IFF: Primary data saved (50976 records). [2025-09-29T19:20:25.440182] [INFO ] [MAIN ] IFF: Full history saved. [2025-09-29T19:20:25.440298] [INFO ] [MAIN ] Update Progress: 1093/2371 symbols completed. IFF took 36.0s. Estimated remaining: 2h 44m 8s. Rate: 7.8 symbols/min [2025-09-29T19:20:25.616967] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:20:25.636322] [DEBUG] [LOCAL ] IGD: Loaded 19170 existing records from primary storage. [2025-09-29T19:20:25.636696] [INFO ] [MAIN ] IGD: Loaded 19170 existing records. [2025-09-29T19:20:25.841886] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:20:25.842785] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-09-29T19:20:25.842867] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-09-29T19:20:25.843254] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-09-29T19:20:25.843320] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-09-29T19:20:25.953191] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-09-29T19:20:26.304672] [INFO ] [REMOTE ] IGD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:20:26.305989] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-29T19:20:26.748146] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-09-29T19:20:26.859297] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-29T19:20:27.548121] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-09-29T19:20:27.707879] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-29T19:20:27.983993] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-29T19:20:28.348166] [INFO ] [REMOTE ] IGD: Fetching primary data for 2024-12. [2025-09-29T19:20:29.148150] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-09-29T19:20:29.304860] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-29T19:20:29.948096] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-09-29T19:20:30.095348] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-29T19:20:30.748082] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-09-29T19:20:31.151560] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-29T19:20:31.548153] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-09-29T19:20:31.799031] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-29T19:20:32.348109] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-09-29T19:20:32.397801] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-29T19:20:33.148120] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-01. [2025-09-29T19:20:33.232276] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-29T19:20:33.234976] [INFO ] [REMOTE ] IGA: Full fetch complete (13608 records). [2025-09-29T19:20:33.235056] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-09-29T19:20:33.624442] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-09-29T19:20:33.624543] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-09-29T19:20:33.624917] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-09-29T19:20:33.624999] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-09-29T19:20:33.625515] [DEBUG] [LOCAL ] IGA: Trimmed 13608 records to 9733 (keeping 200 days of data) [2025-09-29T19:20:33.687856] [DEBUG] [LOCAL ] IGA: Primary data saved (9733 records). [2025-09-29T19:20:33.688007] [INFO ] [MAIN ] IGA: Full history saved. [2025-09-29T19:20:33.688116] [INFO ] [MAIN ] Update Progress: 1094/2371 symbols completed. IGA took 23.0s. Estimated remaining: 2h 44m 1s. Rate: 7.8 symbols/min [2025-09-29T19:20:33.868376] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:20:33.875135] [DEBUG] [LOCAL ] IGI: Loaded 3756 existing records from primary storage. [2025-09-29T19:20:33.875348] [INFO ] [MAIN ] IGI: Loaded 3756 existing records. [2025-09-29T19:20:33.951318] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-09-29T19:20:34.084501] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:20:34.084950] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-09-29T19:20:34.085026] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-09-29T19:20:34.085354] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-09-29T19:20:34.085414] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-09-29T19:20:34.421124] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-29T19:20:34.521275] [INFO ] [REMOTE ] IGI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:20:34.748164] [INFO ] [REMOTE ] IGI: Fetching primary data for 2024-12. [2025-09-29T19:20:34.952898] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-29T19:20:35.116192] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-09-29T19:20:35.548172] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-09-29T19:20:36.348127] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-09-29T19:20:36.754384] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-29T19:20:36.760203] [INFO ] [REMOTE ] IFN: Full fetch complete (29049 records). [2025-09-29T19:20:36.760396] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-09-29T19:20:37.153252] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-01. [2025-09-29T19:20:37.154157] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-09-29T19:20:37.155199] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-09-29T19:20:37.155939] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-09-29T19:20:37.156008] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-09-29T19:20:37.156836] [DEBUG] [LOCAL ] IFN: Trimmed 29049 records to 18221 (keeping 200 days of data) [2025-09-29T19:20:37.271019] [DEBUG] [LOCAL ] IFN: Primary data saved (18221 records). [2025-09-29T19:20:37.271176] [INFO ] [MAIN ] IFN: Full history saved. [2025-09-29T19:20:37.271263] [INFO ] [MAIN ] Update Progress: 1095/2371 symbols completed. IFN took 30.3s. Estimated remaining: 2h 43m 49s. Rate: 7.8 symbols/min [2025-09-29T19:20:37.475089] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:20:37.476390] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-29T19:20:37.515109] [DEBUG] [LOCAL ] IGR: Loaded 30882 existing records from primary storage. [2025-09-29T19:20:37.515450] [INFO ] [MAIN ] IGR: Loaded 30882 existing records. [2025-09-29T19:20:37.687620] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-29T19:20:37.708442] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:20:37.710786] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-09-29T19:20:37.710843] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-09-29T19:20:37.711129] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-09-29T19:20:37.711190] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-09-29T19:20:37.957068] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-09-29T19:20:38.095422] [INFO ] [REMOTE ] IGR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:20:38.446256] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-29T19:20:38.748140] [INFO ] [REMOTE ] IGR: Fetching primary data for 2024-12. [2025-09-29T19:20:39.548127] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-09-29T19:20:40.188520] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-29T19:20:40.253019] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-29T19:20:40.348145] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-09-29T19:20:40.942142] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-29T19:20:41.148165] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-01. [2025-09-29T19:20:41.948114] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-09-29T19:20:42.537331] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-29T19:20:42.748138] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-09-29T19:20:43.032105] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-29T19:20:43.291962] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-29T19:20:43.548123] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-09-29T19:20:44.167224] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-29T19:20:44.348131] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-09-29T19:20:44.901914] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-29T19:20:45.148139] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-09-29T19:20:45.948124] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-09-29T19:20:46.207795] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-29T19:20:46.550704] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-29T19:20:46.748128] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-09-29T19:20:47.346954] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-29T19:20:47.548169] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-09-29T19:20:48.348118] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-09-29T19:20:48.693473] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-29T19:20:49.148125] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-09-29T19:20:49.617054] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-29T19:20:49.948115] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-09-29T19:20:50.155072] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-29T19:20:50.748080] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-09-29T19:20:50.897602] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-29T19:20:51.397171] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-29T19:20:51.398610] [INFO ] [REMOTE ] IGI: Full fetch complete (5232 records). [2025-09-29T19:20:51.398710] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-09-29T19:20:51.557494] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-09-29T19:20:51.831939] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-09-29T19:20:51.832024] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-09-29T19:20:51.832209] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-09-29T19:20:51.832301] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-09-29T19:20:51.832873] [DEBUG] [LOCAL ] IGI: Trimmed 5232 records to 3620 (keeping 200 days of data) [2025-09-29T19:20:51.857728] [DEBUG] [LOCAL ] IGI: Primary data saved (3620 records). [2025-09-29T19:20:51.857896] [INFO ] [MAIN ] IGI: Full history saved. [2025-09-29T19:20:51.858002] [INFO ] [MAIN ] Update Progress: 1096/2371 symbols completed. IGI took 18.2s. Estimated remaining: 2h 43m 49s. Rate: 7.8 symbols/min [2025-09-29T19:20:52.042453] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:20:52.048856] [DEBUG] [LOCAL ] IH: Loaded 3450 existing records from primary storage. [2025-09-29T19:20:52.049063] [INFO ] [MAIN ] IH: Loaded 3450 existing records. [2025-09-29T19:20:52.263454] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:20:52.263771] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-09-29T19:20:52.263829] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-09-29T19:20:52.264007] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-09-29T19:20:52.264096] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-09-29T19:20:52.353267] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-09-29T19:20:52.673277] [INFO ] [REMOTE ] IH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:20:52.856921] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-29T19:20:52.862923] [INFO ] [REMOTE ] IFS: Full fetch complete (31544 records). [2025-09-29T19:20:52.863040] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-09-29T19:20:53.153292] [INFO ] [REMOTE ] IH: Fetching primary data for 2024-12. [2025-09-29T19:20:53.268415] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-09-29T19:20:53.268508] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-09-29T19:20:53.269187] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-09-29T19:20:53.269255] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-09-29T19:20:53.270261] [DEBUG] [LOCAL ] IFS: Trimmed 31544 records to 22930 (keeping 200 days of data) [2025-09-29T19:20:53.409599] [DEBUG] [LOCAL ] IFS: Primary data saved (22930 records). [2025-09-29T19:20:53.409764] [INFO ] [MAIN ] IFS: Full history saved. [2025-09-29T19:20:53.409859] [INFO ] [MAIN ] Update Progress: 1097/2371 symbols completed. IFS took 44.3s. Estimated remaining: 2h 43m 34s. Rate: 7.8 symbols/min [2025-09-29T19:20:53.606270] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:20:53.616833] [DEBUG] [LOCAL ] IHD: Loaded 7225 existing records from primary storage. [2025-09-29T19:20:53.617131] [INFO ] [MAIN ] IHD: Loaded 7225 existing records. [2025-09-29T19:20:53.675691] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-29T19:20:53.842178] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-29T19:20:53.846624] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:20:53.853526] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-09-29T19:20:53.853977] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-09-29T19:20:53.854541] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-09-29T19:20:53.854608] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-09-29T19:20:53.953324] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-01. [2025-09-29T19:20:54.242705] [INFO ] [REMOTE ] IHD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:20:54.439681] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-29T19:20:54.748139] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-09-29T19:20:55.335035] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-29T19:20:55.548122] [INFO ] [REMOTE ] IHD: Fetching primary data for 2024-12. [2025-09-29T19:20:56.329249] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-29T19:20:56.348076] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-01. [2025-09-29T19:20:57.148130] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-09-29T19:20:57.205573] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-29T19:20:57.948119] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-09-29T19:20:58.163785] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-29T19:20:58.748116] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-09-29T19:20:59.290241] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-29T19:20:59.548136] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-09-29T19:20:59.856339] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-29T19:21:00.348138] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-09-29T19:21:00.889011] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-29T19:21:01.117635] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-29T19:21:01.148081] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-09-29T19:21:01.631946] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-29T19:21:01.948111] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-09-29T19:21:02.686414] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-29T19:21:02.748110] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-09-29T19:21:03.503520] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-29T19:21:03.548089] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-09-29T19:21:04.209539] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-29T19:21:04.348110] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-09-29T19:21:05.149328] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-09-29T19:21:05.150839] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-29T19:21:05.948199] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-09-29T19:21:06.711228] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-29T19:21:06.748117] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-09-29T19:21:06.947999] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-29T19:21:07.548134] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-09-29T19:21:08.036902] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-29T19:21:08.348090] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-09-29T19:21:08.585604] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-29T19:21:08.591542] [INFO ] [REMOTE ] IGD: Full fetch complete (29587 records). [2025-09-29T19:21:08.591709] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-09-29T19:21:09.003541] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-09-29T19:21:09.003629] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-09-29T19:21:09.004279] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-09-29T19:21:09.004333] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-09-29T19:21:09.005205] [DEBUG] [LOCAL ] IGD: Trimmed 29587 records to 18910 (keeping 200 days of data) [2025-09-29T19:21:09.120537] [DEBUG] [LOCAL ] IGD: Primary data saved (18910 records). [2025-09-29T19:21:09.120715] [INFO ] [MAIN ] IGD: Full history saved. [2025-09-29T19:21:09.120815] [INFO ] [MAIN ] Update Progress: 1098/2371 symbols completed. IGD took 43.7s. Estimated remaining: 2h 43m 36s. Rate: 7.8 symbols/min [2025-09-29T19:21:09.153218] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-09-29T19:21:09.299882] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:21:09.330395] [DEBUG] [LOCAL ] IHG: Loaded 24977 existing records from primary storage. [2025-09-29T19:21:09.330697] [INFO ] [MAIN ] IHG: Loaded 24977 existing records. [2025-09-29T19:21:09.532692] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:21:09.533318] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-09-29T19:21:09.533391] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-09-29T19:21:09.533844] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-09-29T19:21:09.533907] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-09-29T19:21:09.666236] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-29T19:21:09.948520] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-09-29T19:21:09.944439] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-29T19:21:09.950935] [INFO ] [REMOTE ] IHG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:21:09.958968] [INFO ] [REMOTE ] IGR: Full fetch complete (45785 records). [2025-09-29T19:21:09.959067] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-09-29T19:21:10.359227] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-09-29T19:21:10.359324] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-09-29T19:21:10.360166] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-09-29T19:21:10.360231] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-09-29T19:21:10.361366] [DEBUG] [LOCAL ] IGR: Trimmed 45785 records to 30457 (keeping 200 days of data) [2025-09-29T19:21:10.553813] [DEBUG] [LOCAL ] IGR: Primary data saved (30457 records). [2025-09-29T19:21:10.553971] [INFO ] [MAIN ] IGR: Full history saved. [2025-09-29T19:21:10.554078] [INFO ] [MAIN ] Update Progress: 1099/2371 symbols completed. IGR took 33.3s. Estimated remaining: 2h 43m 21s. Rate: 7.8 symbols/min [2025-09-29T19:21:10.748085] [INFO ] [REMOTE ] IHG: Fetching primary data for 2024-12. [2025-09-29T19:21:10.749690] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:21:10.757320] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-29T19:21:10.798016] [DEBUG] [LOCAL ] IHS: Loaded 39400 existing records from primary storage. [2025-09-29T19:21:10.798323] [INFO ] [MAIN ] IHS: Loaded 39400 existing records. [2025-09-29T19:21:10.985354] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:21:10.985585] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-09-29T19:21:10.985669] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-09-29T19:21:10.986164] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-09-29T19:21:10.986224] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-09-29T19:21:11.385288] [INFO ] [REMOTE ] IHS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:21:11.548176] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-09-29T19:21:11.791269] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-29T19:21:11.939542] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-29T19:21:12.348109] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-01. [2025-09-29T19:21:13.148131] [INFO ] [REMOTE ] IHS: Fetching primary data for 2024-12. [2025-09-29T19:21:13.378858] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-29T19:21:13.948160] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-09-29T19:21:14.456300] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-29T19:21:14.658582] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-29T19:21:14.748170] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-09-29T19:21:15.296817] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-29T19:21:15.548121] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-09-29T19:21:16.259393] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-29T19:21:16.348113] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-09-29T19:21:17.026319] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-29T19:21:17.148121] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-09-29T19:21:17.948104] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-01. [2025-09-29T19:21:18.268321] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-29T19:21:18.748130] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-09-29T19:21:19.177840] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-29T19:21:19.548090] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-09-29T19:21:19.631246] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-29T19:21:20.350994] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-09-29T19:21:20.354527] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-29T19:21:20.357209] [INFO ] [REMOTE ] IHD: Full fetch complete (11813 records). [2025-09-29T19:21:20.357308] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-09-29T19:21:20.762764] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-09-29T19:21:20.762847] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-09-29T19:21:20.763128] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-09-29T19:21:20.763168] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-09-29T19:21:20.763628] [DEBUG] [LOCAL ] IHD: Trimmed 11813 records to 6922 (keeping 200 days of data) [2025-09-29T19:21:20.806467] [DEBUG] [LOCAL ] IHD: Primary data saved (6922 records). [2025-09-29T19:21:20.806617] [INFO ] [MAIN ] IHD: Full history saved. [2025-09-29T19:21:20.806761] [INFO ] [MAIN ] Update Progress: 1100/2371 symbols completed. IHD took 27.4s. Estimated remaining: 2h 43m 16s. Rate: 7.8 symbols/min [2025-09-29T19:21:20.988021] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:21:20.996521] [DEBUG] [LOCAL ] IIF: Loaded 5787 existing records from primary storage. [2025-09-29T19:21:20.996759] [INFO ] [MAIN ] IIF: Loaded 5787 existing records. [2025-09-29T19:21:21.153716] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-09-29T19:21:21.190351] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:21:21.190999] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-09-29T19:21:21.192152] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-09-29T19:21:21.192369] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-09-29T19:21:21.192438] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-09-29T19:21:21.609105] [INFO ] [REMOTE ] IIF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:21:21.627697] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-29T19:21:21.916776] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-29T19:21:21.918749] [INFO ] [REMOTE ] IH: Full fetch complete (4965 records). [2025-09-29T19:21:21.918857] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-09-29T19:21:21.953225] [INFO ] [REMOTE ] IIF: Fetching primary data for 2024-12. [2025-09-29T19:21:22.302226] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-09-29T19:21:22.302308] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-09-29T19:21:22.302453] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-09-29T19:21:22.302492] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-09-29T19:21:22.303163] [DEBUG] [LOCAL ] IH: Trimmed 4965 records to 3313 (keeping 200 days of data) [2025-09-29T19:21:22.325099] [DEBUG] [LOCAL ] IH: Primary data saved (3313 records). [2025-09-29T19:21:22.325233] [INFO ] [MAIN ] IH: Full history saved. [2025-09-29T19:21:22.325346] [INFO ] [MAIN ] Update Progress: 1101/2371 symbols completed. IH took 30.5s. Estimated remaining: 2h 43m 1s. Rate: 7.8 symbols/min [2025-09-29T19:21:22.504069] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:21:22.526051] [DEBUG] [LOCAL ] IIIN: Loaded 16828 existing records from primary storage. [2025-09-29T19:21:22.526334] [INFO ] [MAIN ] IIIN: Loaded 16828 existing records. [2025-09-29T19:21:22.718231] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:21:22.718519] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-09-29T19:21:22.718610] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-09-29T19:21:22.718973] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-09-29T19:21:22.719035] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-09-29T19:21:22.753202] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-09-29T19:21:22.846902] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-29T19:21:23.126802] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:21:23.548180] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-01. [2025-09-29T19:21:24.245956] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-29T19:21:24.348128] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-09-29T19:21:24.429547] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-29T19:21:25.148124] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2024-12. [2025-09-29T19:21:25.375734] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-29T19:21:25.948124] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-09-29T19:21:26.265998] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-29T19:21:26.680816] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-29T19:21:26.748080] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-09-29T19:21:27.318735] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-29T19:21:27.548132] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-01. [2025-09-29T19:21:28.348099] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-09-29T19:21:28.675757] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-29T19:21:29.148140] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-09-29T19:21:29.937701] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-29T19:21:29.952355] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-09-29T19:21:29.956454] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-29T19:21:30.748157] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-09-29T19:21:31.024131] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-29T19:21:31.412584] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-29T19:21:31.548189] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-09-29T19:21:32.348123] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-09-29T19:21:32.768146] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-29T19:21:33.148098] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-09-29T19:21:33.374167] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-29T19:21:33.948167] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-09-29T19:21:34.324357] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-29T19:21:34.748123] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-09-29T19:21:35.429462] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-29T19:21:35.548209] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-09-29T19:21:35.551552] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-29T19:21:36.348119] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-09-29T19:21:36.799751] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-29T19:21:36.804678] [INFO ] [REMOTE ] IHG: Full fetch complete (33699 records). [2025-09-29T19:21:36.804816] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-09-29T19:21:37.153277] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-09-29T19:21:37.236733] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-09-29T19:21:37.236858] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-09-29T19:21:37.237682] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-09-29T19:21:37.237749] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-09-29T19:21:37.238763] [DEBUG] [LOCAL ] IHG: Trimmed 33699 records to 24500 (keeping 200 days of data) [2025-09-29T19:21:37.414671] [DEBUG] [LOCAL ] IHG: Primary data saved (24500 records). [2025-09-29T19:21:37.414830] [INFO ] [MAIN ] IHG: Full history saved. [2025-09-29T19:21:37.414959] [INFO ] [MAIN ] Update Progress: 1102/2371 symbols completed. IHG took 28.3s. Estimated remaining: 2h 43m 2s. Rate: 7.8 symbols/min [2025-09-29T19:21:37.612755] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:21:37.634611] [DEBUG] [LOCAL ] IIM: Loaded 16102 existing records from primary storage. [2025-09-29T19:21:37.634915] [INFO ] [MAIN ] IIM: Loaded 16102 existing records. [2025-09-29T19:21:37.855053] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:21:37.855552] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-09-29T19:21:37.855729] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-09-29T19:21:37.856094] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-09-29T19:21:37.856216] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-09-29T19:21:37.959979] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-09-29T19:21:38.075864] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-29T19:21:38.331548] [INFO ] [REMOTE ] IIM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:21:38.342949] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-29T19:21:38.712593] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-29T19:21:38.748153] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-09-29T19:21:39.548112] [INFO ] [REMOTE ] IIM: Fetching primary data for 2024-12. [2025-09-29T19:21:40.184802] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-29T19:21:40.348161] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-09-29T19:21:40.562888] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-29T19:21:41.148088] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-01. [2025-09-29T19:21:41.306773] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-29T19:21:41.948100] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-09-29T19:21:42.211162] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-29T19:21:42.748128] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-09-29T19:21:43.368555] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-29T19:21:43.548126] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-09-29T19:21:43.618987] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-29T19:21:44.327964] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-29T19:21:44.348084] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-09-29T19:21:45.054219] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-29T19:21:45.148161] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-09-29T19:21:45.948139] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-09-29T19:21:46.208358] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-29T19:21:46.645250] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-29T19:21:46.646688] [INFO ] [REMOTE ] IIF: Full fetch complete (9489 records). [2025-09-29T19:21:46.646794] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-09-29T19:21:46.753172] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-09-29T19:21:47.110630] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-09-29T19:21:47.110748] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-09-29T19:21:47.110991] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-09-29T19:21:47.111033] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-09-29T19:21:47.111635] [DEBUG] [LOCAL ] IIF: Trimmed 9489 records to 5715 (keeping 200 days of data) [2025-09-29T19:21:47.150369] [DEBUG] [LOCAL ] IIF: Primary data saved (5715 records). [2025-09-29T19:21:47.150512] [INFO ] [MAIN ] IIF: Full history saved. [2025-09-29T19:21:47.150600] [INFO ] [MAIN ] Update Progress: 1103/2371 symbols completed. IIF took 26.3s. Estimated remaining: 2h 42m 56s. Rate: 7.8 symbols/min [2025-09-29T19:21:47.358556] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:21:47.398371] [DEBUG] [LOCAL ] IIPR: Loaded 30052 existing records from primary storage. [2025-09-29T19:21:47.398699] [INFO ] [MAIN ] IIPR: Loaded 30052 existing records. [2025-09-29T19:21:47.558381] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-09-29T19:21:47.601016] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:21:47.602064] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-09-29T19:21:47.602115] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-09-29T19:21:47.602881] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-09-29T19:21:47.602954] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-09-29T19:21:47.987572] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:21:48.237872] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-29T19:21:48.348132] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-09-29T19:21:48.558082] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-29T19:21:49.148138] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-09-29T19:21:49.788610] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-29T19:21:49.795768] [INFO ] [REMOTE ] IHS: Full fetch complete (52025 records). [2025-09-29T19:21:49.795959] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-09-29T19:21:49.957434] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-09-29T19:21:50.278408] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-09-29T19:21:50.284156] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-09-29T19:21:50.294601] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-09-29T19:21:50.296219] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-09-29T19:21:50.296129] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-29T19:21:50.303495] [DEBUG] [LOCAL ] IHS: Trimmed 52025 records to 38991 (keeping 200 days of data) [2025-09-29T19:21:50.554247] [DEBUG] [LOCAL ] IHS: Primary data saved (38991 records). [2025-09-29T19:21:50.554404] [INFO ] [MAIN ] IHS: Full history saved. [2025-09-29T19:21:50.554515] [INFO ] [MAIN ] Update Progress: 1104/2371 symbols completed. IHS took 40.0s. Estimated remaining: 2h 42m 44s. Rate: 7.8 symbols/min [2025-09-29T19:21:50.739524] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:21:50.748154] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-09-29T19:21:50.748683] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-29T19:21:50.753726] [INFO ] [REMOTE ] IIIN: Full fetch complete (25069 records). [2025-09-29T19:21:50.753840] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-09-29T19:21:51.088346] [DEBUG] [LOCAL ] IMAX: Loaded 43382 existing records from primary storage. [2025-09-29T19:21:51.112129] [INFO ] [MAIN ] IMAX: Loaded 43382 existing records. [2025-09-29T19:21:51.397682] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-09-29T19:21:51.401006] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-09-29T19:21:51.406502] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-09-29T19:21:51.408759] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-09-29T19:21:51.435024] [DEBUG] [LOCAL ] IIIN: Trimmed 25069 records to 16511 (keeping 200 days of data) [2025-09-29T19:21:51.434803] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:21:51.435734] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-09-29T19:21:51.435836] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-09-29T19:21:51.436590] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-09-29T19:21:51.436707] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-09-29T19:21:51.553628] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2024-12. [2025-09-29T19:21:51.950310] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-29T19:21:51.969362] [DEBUG] [LOCAL ] IIIN: Primary data saved (16511 records). [2025-09-29T19:21:51.997214] [INFO ] [MAIN ] IIIN: Full history saved. [2025-09-29T19:21:52.007181] [INFO ] [MAIN ] Update Progress: 1105/2371 symbols completed. IIIN took 29.7s. Estimated remaining: 2h 42m 29s. Rate: 7.8 symbols/min [2025-09-29T19:21:52.014631] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:21:52.213489] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:21:52.269768] [DEBUG] [LOCAL ] INFA: Loaded 50602 existing records from primary storage. [2025-09-29T19:21:52.270127] [INFO ] [MAIN ] INFA: Loaded 50602 existing records. [2025-09-29T19:21:52.354745] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2024-12. [2025-09-29T19:21:52.477446] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:21:52.477772] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-09-29T19:21:52.477848] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-09-29T19:21:52.478235] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-09-29T19:21:52.478297] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-09-29T19:21:52.890121] [INFO ] [REMOTE ] INFA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:21:53.082439] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-29T19:21:53.148124] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-01. [2025-09-29T19:21:53.847244] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-29T19:21:53.948130] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-09-29T19:21:54.734292] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-29T19:21:54.748076] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-09-29T19:21:55.044466] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-29T19:21:55.548137] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-09-29T19:21:56.062726] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-29T19:21:56.080410] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-29T19:21:56.348115] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-09-29T19:21:57.148106] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-01. [2025-09-29T19:21:57.842008] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-29T19:21:57.948131] [INFO ] [REMOTE ] INFA: Fetching primary data for 2024-12. [2025-09-29T19:21:58.605917] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-29T19:21:58.748111] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-09-29T19:21:59.548126] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-09-29T19:21:59.652719] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-29T19:22:00.220624] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-29T19:22:00.348113] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-09-29T19:22:00.536136] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-29T19:22:01.148108] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-09-29T19:22:01.865549] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-29T19:22:01.948075] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-09-29T19:22:02.716564] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-29T19:22:02.748111] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-09-29T19:22:03.548141] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-09-29T19:22:03.661689] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-29T19:22:04.324818] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-29T19:22:04.348069] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-09-29T19:22:04.493715] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-29T19:22:05.148192] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-09-29T19:22:05.948142] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-09-29T19:22:06.069234] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-29T19:22:06.369932] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-29T19:22:06.748138] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-09-29T19:22:07.429028] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-29T19:22:07.548119] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-09-29T19:22:08.122949] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-29T19:22:08.348196] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-09-29T19:22:08.542288] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-29T19:22:09.148128] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-09-29T19:22:09.645237] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-29T19:22:09.948093] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-09-29T19:22:10.019835] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-29T19:22:10.026523] [INFO ] [REMOTE ] IIM: Full fetch complete (25301 records). [2025-09-29T19:22:10.026751] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-09-29T19:22:10.442977] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-09-29T19:22:10.443072] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-09-29T19:22:10.443824] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-09-29T19:22:10.443887] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-09-29T19:22:10.444976] [DEBUG] [LOCAL ] IIM: Trimmed 25301 records to 15934 (keeping 200 days of data) [2025-09-29T19:22:10.560587] [DEBUG] [LOCAL ] IIM: Primary data saved (15934 records). [2025-09-29T19:22:10.561355] [INFO ] [MAIN ] IIM: Full history saved. [2025-09-29T19:22:10.561545] [INFO ] [MAIN ] Update Progress: 1106/2371 symbols completed. IIM took 33.1s. Estimated remaining: 2h 42m 34s. Rate: 7.8 symbols/min [2025-09-29T19:22:10.751115] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-09-29T19:22:10.751012] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:22:10.819856] [DEBUG] [LOCAL ] INFY: Loaded 54378 existing records from primary storage. [2025-09-29T19:22:10.820276] [INFO ] [MAIN ] INFY: Loaded 54378 existing records. [2025-09-29T19:22:11.014090] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:22:11.014412] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-09-29T19:22:11.014467] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-09-29T19:22:11.015308] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-09-29T19:22:11.015395] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-09-29T19:22:11.400934] [INFO ] [REMOTE ] INFY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:22:11.446556] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-29T19:22:11.548132] [INFO ] [REMOTE ] INFY: Fetching primary data for 2024-12. [2025-09-29T19:22:12.202230] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-29T19:22:12.348164] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-09-29T19:22:13.148134] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-09-29T19:22:13.385151] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-29T19:22:13.948160] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-01. [2025-09-29T19:22:14.007436] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-29T19:22:14.016574] [INFO ] [REMOTE ] IIPR: Full fetch complete (44303 records). [2025-09-29T19:22:14.016813] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-09-29T19:22:14.468351] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-09-29T19:22:14.468705] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-09-29T19:22:14.469665] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-09-29T19:22:14.469855] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-09-29T19:22:14.471392] [DEBUG] [LOCAL ] IIPR: Trimmed 44303 records to 29651 (keeping 200 days of data) [2025-09-29T19:22:14.602374] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-29T19:22:14.709333] [DEBUG] [LOCAL ] IIPR: Primary data saved (29651 records). [2025-09-29T19:22:14.709484] [INFO ] [MAIN ] IIPR: Full history saved. [2025-09-29T19:22:14.709637] [INFO ] [MAIN ] Update Progress: 1107/2371 symbols completed. IIPR took 27.6s. Estimated remaining: 2h 42m 22s. Rate: 7.8 symbols/min [2025-09-29T19:22:14.754398] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-09-29T19:22:14.893932] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:22:14.960607] [DEBUG] [LOCAL ] ING: Loaded 51537 existing records from primary storage. [2025-09-29T19:22:14.960987] [INFO ] [MAIN ] ING: Loaded 51537 existing records. [2025-09-29T19:22:15.148516] [WARN ] [MAIN ] ING: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:22:15.148769] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-09-29T19:22:15.148823] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-09-29T19:22:15.149614] [DEBUG] [LOCAL ] ING: Deleted primary data file. [2025-09-29T19:22:15.149714] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-09-29T19:22:15.553566] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-09-29T19:22:15.557968] [INFO ] [REMOTE ] ING: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:22:15.749579] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-29T19:22:16.348116] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-09-29T19:22:16.552165] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-29T19:22:17.148121] [INFO ] [REMOTE ] ING: Fetching primary data for 2024-12. [2025-09-29T19:22:17.216407] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-29T19:22:17.948157] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-09-29T19:22:18.192600] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-29T19:22:18.748151] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-09-29T19:22:18.951342] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-29T19:22:19.548150] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-01. [2025-09-29T19:22:19.820523] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-29T19:22:20.293501] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-29T19:22:20.348141] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-09-29T19:22:21.148122] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-09-29T19:22:21.320391] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-29T19:22:21.565134] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-29T19:22:21.948169] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-09-29T19:22:22.717218] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-29T19:22:22.726695] [INFO ] [REMOTE ] IMAX: Full fetch complete (59683 records). [2025-09-29T19:22:22.726885] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-09-29T19:22:22.753691] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-09-29T19:22:23.172072] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-09-29T19:22:23.172167] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-09-29T19:22:23.173097] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-09-29T19:22:23.173166] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-09-29T19:22:23.174581] [DEBUG] [LOCAL ] IMAX: Trimmed 59683 records to 42742 (keeping 200 days of data) [2025-09-29T19:22:23.443070] [DEBUG] [LOCAL ] IMAX: Primary data saved (42742 records). [2025-09-29T19:22:23.443252] [INFO ] [MAIN ] IMAX: Full history saved. [2025-09-29T19:22:23.443376] [INFO ] [MAIN ] Update Progress: 1108/2371 symbols completed. IMAX took 32.9s. Estimated remaining: 2h 42m 15s. Rate: 7.8 symbols/min [2025-09-29T19:22:23.553332] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-09-29T19:22:23.656617] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:22:23.688468] [DEBUG] [LOCAL ] INGM: Loaded 29224 existing records from primary storage. [2025-09-29T19:22:23.688819] [INFO ] [MAIN ] INGM: Loaded 29224 existing records. [2025-09-29T19:22:23.888616] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:22:23.888947] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-09-29T19:22:23.889027] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-09-29T19:22:23.889584] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-09-29T19:22:23.889718] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-09-29T19:22:24.219866] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-09-29T19:22:24.343137] [INFO ] [REMOTE ] INGM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:22:24.353402] [INFO ] [REMOTE ] INGM: Fetching primary data for 2024-12. [2025-09-29T19:22:24.375629] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-29T19:22:25.153198] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-09-29T19:22:25.172620] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-29T19:22:25.672112] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-29T19:22:25.948164] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-01. [2025-09-29T19:22:26.748078] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-09-29T19:22:27.095467] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-29T19:22:27.151211] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-29T19:22:27.548095] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-09-29T19:22:28.348112] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-09-29T19:22:28.505536] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-29T19:22:28.830224] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-29T19:22:29.148197] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-09-29T19:22:29.948129] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-09-29T19:22:30.164318] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-29T19:22:30.626832] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-29T19:22:30.748126] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-09-29T19:22:31.548165] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-09-29T19:22:31.599085] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-29T19:22:32.348148] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-09-29T19:22:32.481471] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-29T19:22:33.148202] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-09-29T19:22:33.368408] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-29T19:22:33.381541] [INFO ] [REMOTE ] INFA: Full fetch complete (71623 records). [2025-09-29T19:22:33.381766] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-09-29T19:22:33.890367] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-09-29T19:22:33.890697] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-09-29T19:22:33.892222] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-09-29T19:22:33.892447] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-09-29T19:22:33.894957] [DEBUG] [LOCAL ] INFA: Trimmed 71623 records to 49743 (keeping 200 days of data) [2025-09-29T19:22:33.979122] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-09-29T19:22:34.046299] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-29T19:22:34.318626] [DEBUG] [LOCAL ] INFA: Primary data saved (49743 records). [2025-09-29T19:22:34.318821] [INFO ] [MAIN ] INFA: Full history saved. [2025-09-29T19:22:34.318971] [INFO ] [MAIN ] Update Progress: 1109/2371 symbols completed. INFA took 42.3s. Estimated remaining: 2h 42m 11s. Rate: 7.8 symbols/min [2025-09-29T19:22:34.527763] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:22:34.569585] [DEBUG] [LOCAL ] INGR: Loaded 33913 existing records from primary storage. [2025-09-29T19:22:34.570048] [INFO ] [MAIN ] INGR: Loaded 33913 existing records. [2025-09-29T19:22:34.767872] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:22:34.760535] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-09-29T19:22:34.769996] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-09-29T19:22:34.770068] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-09-29T19:22:34.770418] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-09-29T19:22:34.770479] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-09-29T19:22:35.204327] [INFO ] [REMOTE ] INGR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:22:35.239544] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-29T19:22:35.380434] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-29T19:22:35.548130] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-09-29T19:22:36.236567] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-29T19:22:36.348164] [INFO ] [REMOTE ] INGR: Fetching primary data for 2024-12. [2025-09-29T19:22:36.833535] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-29T19:22:37.148111] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-09-29T19:22:37.695200] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-29T19:22:37.948118] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-09-29T19:22:38.748085] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-01. [2025-09-29T19:22:39.143287] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-29T19:22:39.548147] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-09-29T19:22:39.670148] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-29T19:22:40.212601] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-29T19:22:40.348154] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-09-29T19:22:41.148081] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-09-29T19:22:41.264588] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-29T19:22:41.280368] [INFO ] [REMOTE ] INFY: Full fetch complete (77543 records). [2025-09-29T19:22:41.280557] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-09-29T19:22:41.756339] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-09-29T19:22:41.756465] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-09-29T19:22:41.757753] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-09-29T19:22:41.757899] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-09-29T19:22:41.759758] [DEBUG] [LOCAL ] INFY: Trimmed 77543 records to 53598 (keeping 200 days of data) [2025-09-29T19:22:41.951099] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-09-29T19:22:42.118603] [DEBUG] [LOCAL ] INFY: Primary data saved (53598 records). [2025-09-29T19:22:42.118772] [INFO ] [MAIN ] INFY: Full history saved. [2025-09-29T19:22:42.118903] [INFO ] [MAIN ] Update Progress: 1110/2371 symbols completed. INFY took 31.6s. Estimated remaining: 2h 42m 4s. Rate: 7.8 symbols/min [2025-09-29T19:22:42.271121] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-29T19:22:42.356261] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:22:42.373000] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-29T19:22:42.424725] [DEBUG] [LOCAL ] INN: Loaded 42433 existing records from primary storage. [2025-09-29T19:22:42.425128] [INFO ] [MAIN ] INN: Loaded 42433 existing records. [2025-09-29T19:22:42.628005] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:22:42.628293] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-09-29T19:22:42.628346] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-09-29T19:22:42.628826] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-09-29T19:22:42.628888] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-09-29T19:22:42.753235] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-09-29T19:22:43.021845] [INFO ] [REMOTE ] INN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:22:43.503493] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-29T19:22:43.548114] [INFO ] [REMOTE ] INN: Fetching primary data for 2024-12. [2025-09-29T19:22:43.616474] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-29T19:22:44.348152] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-09-29T19:22:44.976339] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-29T19:22:45.148115] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-09-29T19:22:45.527775] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-29T19:22:45.948109] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-01. [2025-09-29T19:22:46.748107] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-09-29T19:22:46.980098] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-29T19:22:47.275094] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-29T19:22:47.548124] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-09-29T19:22:48.000180] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-29T19:22:48.006369] [INFO ] [REMOTE ] INGM: Full fetch complete (42409 records). [2025-09-29T19:22:48.006480] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-09-29T19:22:48.353297] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-09-29T19:22:48.471336] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-09-29T19:22:48.471417] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-09-29T19:22:48.472256] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-09-29T19:22:48.472322] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-09-29T19:22:48.473275] [DEBUG] [LOCAL ] INGM: Trimmed 42409 records to 28641 (keeping 200 days of data) [2025-09-29T19:22:48.657393] [DEBUG] [LOCAL ] INGM: Primary data saved (28641 records). [2025-09-29T19:22:48.657547] [INFO ] [MAIN ] INGM: Full history saved. [2025-09-29T19:22:48.657695] [INFO ] [MAIN ] Update Progress: 1111/2371 symbols completed. INGM took 25.2s. Estimated remaining: 2h 41m 55s. Rate: 7.8 symbols/min [2025-09-29T19:22:48.840903] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:22:48.841101] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-09-29T19:22:48.841153] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-09-29T19:22:48.841269] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-09-29T19:22:48.841319] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-09-29T19:22:48.841370] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-09-29T19:22:48.841405] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-09-29T19:22:49.153344] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-09-29T19:22:49.235303] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:22:49.543508] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-29T19:22:49.554453] [INFO ] [REMOTE ] ING: Full fetch complete (73635 records). [2025-09-29T19:22:49.554618] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-09-29T19:22:49.963810] [INFO ] [REMOTE ] INR: Fetching primary data for 2024-12. [2025-09-29T19:22:49.972308] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-29T19:22:50.030383] [DEBUG] [VALIDATOR ] ING: All expected trading days are present. [2025-09-29T19:22:50.038185] [DEBUG] [VALIDATOR ] ING: Primary data validation passed. [2025-09-29T19:22:50.040043] [INFO ] [MAIN ] ING: Fetched primary data is valid. [2025-09-29T19:22:50.040194] [DEBUG] [LOCAL ] ING: Saving primary data. [2025-09-29T19:22:50.042165] [DEBUG] [LOCAL ] ING: Trimmed 73635 records to 50745 (keeping 200 days of data) [2025-09-29T19:22:50.292743] [DEBUG] [REMOTE ] INR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T19:22:50.293833] [WARN ] [REMOTE ] INR: No data returned for month 2024-12 [2025-09-29T19:22:50.294251] [FATAL] [REMOTE ] INR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T19:22:50.295124] [FATAL] [MAIN ] INR: Failed to fetch primary data. [2025-09-29T19:22:50.298127] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T19:22:50.298254] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-09-29T19:22:50.298332] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-09-29T19:22:50.298372] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-09-29T19:22:50.298430] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-09-29T19:22:50.298509] [INFO ] [MAIN ] Update Progress: 1112/2371 symbols completed. INR took 1.6s. Estimated remaining: 2h 41m 40s. Rate: 7.8 symbols/min [2025-09-29T19:22:50.528185] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:22:50.546931] [DEBUG] [LOCAL ] ING: Primary data saved (50745 records). [2025-09-29T19:22:50.547129] [INFO ] [MAIN ] ING: Full history saved. [2025-09-29T19:22:50.547238] [INFO ] [MAIN ] Update Progress: 1113/2371 symbols completed. ING took 35.8s. Estimated remaining: 2h 41m 24s. Rate: 7.8 symbols/min [2025-09-29T19:22:50.711848] [DEBUG] [LOCAL ] INSP: Loaded 37492 existing records from primary storage. [2025-09-29T19:22:50.753319] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-09-29T19:22:50.742471] [INFO ] [MAIN ] INSP: Loaded 37492 existing records. [2025-09-29T19:22:50.774538] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:22:51.049125] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:22:51.051565] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-09-29T19:22:51.051675] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-09-29T19:22:51.051259] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-29T19:22:51.074585] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-09-29T19:22:51.075349] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-09-29T19:22:51.076041] [DEBUG] [LOCAL ] INSW: Loaded 40831 existing records from primary storage. [2025-09-29T19:22:51.122202] [INFO ] [MAIN ] INSW: Loaded 40831 existing records. [2025-09-29T19:22:51.535124] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:22:51.557724] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-09-29T19:22:51.557288] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-09-29T19:22:51.570182] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-09-29T19:22:51.598227] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-09-29T19:22:51.603483] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-09-29T19:22:51.821237] [INFO ] [REMOTE ] INSP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:22:52.124044] [INFO ] [REMOTE ] INSW: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:22:52.233950] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-29T19:22:52.348114] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-09-29T19:22:53.148133] [INFO ] [REMOTE ] INSW: Fetching primary data for 2024-12. [2025-09-29T19:22:53.948158] [INFO ] [REMOTE ] INSP: Fetching primary data for 2024-12. [2025-09-29T19:23:05.538350] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (13.19 seconds). [2025-09-29T19:23:05.575524] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-09-29T19:23:05.578869] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2024-12 (12.43 seconds). [2025-09-29T19:23:05.589771] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-01. [2025-09-29T19:23:05.613910] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2024-12 (11.67 seconds). [2025-09-29T19:23:05.622215] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-01. [2025-09-29T19:23:05.712249] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (14.15 seconds). [2025-09-29T19:23:05.719994] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-09-29T19:23:07.054316] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-29T19:23:07.062724] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-09-29T19:23:07.090878] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-29T19:23:07.099359] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-09-29T19:23:07.434150] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-29T19:23:07.444187] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-09-29T19:23:07.526823] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-29T19:23:07.538886] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-09-29T19:23:08.017120] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-29T19:23:08.024622] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-09-29T19:23:08.603077] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-29T19:23:08.610889] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-09-29T19:23:09.118473] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-29T19:23:09.128774] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-09-29T19:23:09.153060] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-29T19:23:09.163302] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-09-29T19:23:09.211072] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-29T19:23:09.218702] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-09-29T19:23:09.601589] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-29T19:23:09.609495] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-09-29T19:23:10.466902] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-29T19:23:10.476780] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-09-29T19:23:10.539939] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-29T19:23:10.548821] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-09-29T19:23:10.609739] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-29T19:23:10.617912] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-09-29T19:23:10.648030] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-29T19:23:10.658826] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-09-29T19:23:12.188496] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-29T19:23:12.218045] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-09-29T19:23:12.220761] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-29T19:23:12.228974] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-09-29T19:23:12.263017] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-29T19:23:12.275567] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-09-29T19:23:12.301554] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-29T19:23:12.310679] [INFO ] [REMOTE ] INGR: Full fetch complete (50014 records). [2025-09-29T19:23:12.310924] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-09-29T19:23:12.736419] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-09-29T19:23:12.736623] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-09-29T19:23:12.737668] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-09-29T19:23:12.737735] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-09-29T19:23:12.739213] [DEBUG] [LOCAL ] INGR: Trimmed 50014 records to 33254 (keeping 200 days of data) [2025-09-29T19:23:12.961808] [DEBUG] [LOCAL ] INGR: Primary data saved (33254 records). [2025-09-29T19:23:12.961977] [INFO ] [MAIN ] INGR: Full history saved. [2025-09-29T19:23:12.962114] [INFO ] [MAIN ] Update Progress: 1114/2371 symbols completed. INGR took 38.6s. Estimated remaining: 2h 41m 33s. Rate: 7.8 symbols/min [2025-09-29T19:23:13.148978] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:23:13.210401] [DEBUG] [LOCAL ] INVH: Loaded 53918 existing records from primary storage. [2025-09-29T19:23:13.210846] [INFO ] [MAIN ] INVH: Loaded 53918 existing records. [2025-09-29T19:23:13.416766] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:23:13.417197] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-09-29T19:23:13.417272] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-09-29T19:23:13.418730] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-09-29T19:23:13.418794] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-09-29T19:23:13.816968] [INFO ] [REMOTE ] INVH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:23:13.835435] [INFO ] [REMOTE ] INVH: Fetching primary data for 2024-12. [2025-09-29T19:23:13.837194] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-29T19:23:13.865849] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-09-29T19:23:13.868971] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-29T19:23:13.878527] [INFO ] [REMOTE ] INN: Full fetch complete (57819 records). [2025-09-29T19:23:13.878730] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-09-29T19:23:14.168006] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-29T19:23:14.239596] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-09-29T19:23:14.339223] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-09-29T19:23:14.339305] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-09-29T19:23:14.340272] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-09-29T19:23:14.340339] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-09-29T19:23:14.341633] [DEBUG] [LOCAL ] INN: Trimmed 57819 records to 41816 (keeping 200 days of data) [2025-09-29T19:23:14.592954] [DEBUG] [LOCAL ] INN: Primary data saved (41816 records). [2025-09-29T19:23:14.593092] [INFO ] [MAIN ] INN: Full history saved. [2025-09-29T19:23:14.593179] [INFO ] [MAIN ] Update Progress: 1115/2371 symbols completed. INN took 32.5s. Estimated remaining: 2h 41m 18s. Rate: 7.8 symbols/min [2025-09-29T19:23:14.772430] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:23:14.803838] [DEBUG] [LOCAL ] INVX: Loaded 29366 existing records from primary storage. [2025-09-29T19:23:14.804143] [INFO ] [MAIN ] INVX: Loaded 29366 existing records. [2025-09-29T19:23:14.992750] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:23:14.993024] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-09-29T19:23:14.993076] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-09-29T19:23:14.993626] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-09-29T19:23:14.993737] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-09-29T19:23:15.487203] [INFO ] [REMOTE ] INVX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:23:15.488029] [INFO ] [REMOTE ] INVX: Fetching primary data for 2024-12. [2025-09-29T19:23:15.524816] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-29T19:23:15.541931] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-09-29T19:23:15.603110] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-29T19:23:15.620273] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-01. [2025-09-29T19:23:15.851174] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-29T19:23:16.348192] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-09-29T19:23:16.993375] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-29T19:23:17.148112] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-01. [2025-09-29T19:23:17.375908] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-29T19:23:17.421341] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-29T19:23:17.469939] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-29T19:23:17.948148] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-09-29T19:23:18.542493] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-29T19:23:18.748161] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-09-29T19:23:19.182156] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-29T19:23:19.548174] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-09-29T19:23:20.348082] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-09-29T19:23:20.436243] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-29T19:23:20.445688] [INFO ] [REMOTE ] INSP: Full fetch complete (52717 records). [2025-09-29T19:23:20.445843] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-09-29T19:23:20.874079] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-09-29T19:23:20.874270] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-09-29T19:23:20.875521] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-09-29T19:23:20.875613] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-09-29T19:23:20.898550] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-29T19:23:20.909296] [DEBUG] [LOCAL ] INSP: Trimmed 52717 records to 36932 (keeping 200 days of data) [2025-09-29T19:23:21.148388] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-09-29T19:23:21.153314] [DEBUG] [LOCAL ] INSP: Primary data saved (36932 records). [2025-09-29T19:23:21.153406] [INFO ] [MAIN ] INSP: Full history saved. [2025-09-29T19:23:21.153582] [INFO ] [MAIN ] Update Progress: 1116/2371 symbols completed. INSP took 30.9s. Estimated remaining: 2h 41m 9s. Rate: 7.8 symbols/min [2025-09-29T19:23:21.343620] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:23:21.405577] [DEBUG] [LOCAL ] IONQ: Loaded 54568 existing records from primary storage. [2025-09-29T19:23:21.406085] [INFO ] [MAIN ] IONQ: Loaded 54568 existing records. [2025-09-29T19:23:21.601578] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:23:21.601855] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-09-29T19:23:21.601915] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-09-29T19:23:21.602541] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-09-29T19:23:21.602600] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-09-29T19:23:21.950480] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-09-29T19:23:21.992185] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:23:22.187534] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-29T19:23:22.421715] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-29T19:23:22.748117] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-09-29T19:23:23.510093] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-29T19:23:23.548169] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-09-29T19:23:24.262073] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-29T19:23:24.348126] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-09-29T19:23:25.124684] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-29T19:23:25.133075] [INFO ] [REMOTE ] INSW: Full fetch complete (60678 records). [2025-09-29T19:23:25.133199] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-09-29T19:23:25.155067] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2024-12. [2025-09-29T19:23:25.550136] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-09-29T19:23:25.550235] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-09-29T19:23:25.551221] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-09-29T19:23:25.551288] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-09-29T19:23:25.552692] [DEBUG] [LOCAL ] INSW: Trimmed 60678 records to 40136 (keeping 200 days of data) [2025-09-29T19:23:25.704124] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-29T19:23:25.878530] [DEBUG] [LOCAL ] INSW: Primary data saved (40136 records). [2025-09-29T19:23:25.878744] [INFO ] [MAIN ] INSW: Full history saved. [2025-09-29T19:23:25.878841] [INFO ] [MAIN ] Update Progress: 1117/2371 symbols completed. INSW took 35.3s. Estimated remaining: 2h 40m 58s. Rate: 7.8 symbols/min [2025-09-29T19:23:25.948117] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-09-29T19:23:26.748179] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-09-29T19:23:27.784626] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-29T19:23:27.797375] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-09-29T19:23:27.961834] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2024-12 (2.81 seconds). [2025-09-29T19:23:28.014054] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-29T19:23:28.348107] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-09-29T19:23:29.148189] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-01. [2025-09-29T19:23:29.518184] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-29T19:23:29.551798] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-29T19:23:29.948133] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-09-29T19:23:30.748155] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-09-29T19:23:31.717979] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-29T19:23:31.729840] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-09-29T19:23:31.748963] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-29T19:23:31.903271] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-01 (2.76 seconds). [2025-09-29T19:23:32.348150] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-09-29T19:23:33.148135] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-09-29T19:23:33.600676] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-29T19:23:33.948131] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-09-29T19:23:34.415990] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-29T19:23:34.422164] [INFO ] [REMOTE ] INVX: Full fetch complete (44294 records). [2025-09-29T19:23:34.422376] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-09-29T19:23:34.845060] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-09-29T19:23:34.845313] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-09-29T19:23:34.846370] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-09-29T19:23:34.846517] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-09-29T19:23:34.848532] [DEBUG] [LOCAL ] INVX: Trimmed 44294 records to 29009 (keeping 200 days of data) [2025-09-29T19:23:35.035093] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (2.69 seconds). [2025-09-29T19:23:35.066621] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-09-29T19:23:35.082203] [DEBUG] [LOCAL ] INVX: Primary data saved (29009 records). [2025-09-29T19:23:35.082775] [INFO ] [MAIN ] INVX: Full history saved. [2025-09-29T19:23:35.082892] [INFO ] [MAIN ] Update Progress: 1118/2371 symbols completed. INVX took 20.5s. Estimated remaining: 2h 40m 52s. Rate: 7.8 symbols/min [2025-09-29T19:23:35.398086] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-29T19:23:35.548133] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-09-29T19:23:37.623122] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-29T19:23:37.636075] [INFO ] [REMOTE ] INVH: Full fetch complete (76724 records). [2025-09-29T19:23:37.636219] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-09-29T19:23:38.116240] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-09-29T19:23:38.116404] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-09-29T19:23:38.117615] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-09-29T19:23:38.117713] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-09-29T19:23:38.149568] [DEBUG] [LOCAL ] INVH: Trimmed 76724 records to 53135 (keeping 200 days of data) [2025-09-29T19:23:38.151461] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (3.08 seconds). [2025-09-29T19:23:38.164349] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-09-29T19:23:38.530097] [DEBUG] [LOCAL ] INVH: Primary data saved (53135 records). [2025-09-29T19:23:38.530456] [INFO ] [MAIN ] INVH: Full history saved. [2025-09-29T19:23:38.530554] [INFO ] [MAIN ] Update Progress: 1119/2371 symbols completed. INVH took 25.6s. Estimated remaining: 2h 40m 40s. Rate: 7.8 symbols/min [2025-09-29T19:23:40.880949] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (2.72 seconds). [2025-09-29T19:23:40.892502] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-09-29T19:23:43.620788] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.73 seconds). [2025-09-29T19:23:43.636387] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-09-29T19:23:46.311377] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (2.67 seconds). [2025-09-29T19:23:46.323609] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-09-29T19:23:49.125015] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (2.80 seconds). [2025-09-29T19:23:49.137429] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-09-29T19:23:51.924078] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.79 seconds). [2025-09-29T19:23:51.936605] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-09-29T19:23:54.891683] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.96 seconds). [2025-09-29T19:23:54.903548] [INFO ] [REMOTE ] IONQ: Full fetch complete (77968 records). [2025-09-29T19:23:54.903771] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-09-29T19:23:55.341576] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-09-29T19:23:55.341686] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-09-29T19:23:55.342810] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-09-29T19:23:55.342876] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-09-29T19:23:55.344373] [DEBUG] [LOCAL ] IONQ: Trimmed 77968 records to 53788 (keeping 200 days of data) [2025-09-29T19:23:55.695611] [DEBUG] [LOCAL ] IONQ: Primary data saved (53788 records). [2025-09-29T19:23:55.695786] [INFO ] [MAIN ] IONQ: Full history saved. [2025-09-29T19:23:55.695873] [INFO ] [MAIN ] Update Progress: 1120/2371 symbols completed. IONQ took 34.5s. Estimated remaining: 2h 40m 42s. Rate: 7.8 symbols/min [2025-09-29T19:23:56.407308] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:23:56.436373] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:23:56.447926] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:23:56.467597] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:23:56.490995] [DEBUG] [LOCAL ] IPI: Loaded 21704 existing records from primary storage. [2025-09-29T19:23:56.491378] [INFO ] [MAIN ] IPI: Loaded 21704 existing records. [2025-09-29T19:23:56.752019] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:23:56.768994] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-09-29T19:23:56.769138] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-09-29T19:23:56.770563] [DEBUG] [LOCAL ] IOT: Loaded 54249 existing records from primary storage. [2025-09-29T19:23:56.771163] [INFO ] [MAIN ] IOT: Loaded 54249 existing records. [2025-09-29T19:23:56.803343] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-09-29T19:23:56.814013] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-09-29T19:23:56.797042] [DEBUG] [LOCAL ] IPG: Loaded 54110 existing records from primary storage. [2025-09-29T19:23:56.841400] [DEBUG] [LOCAL ] IP: Loaded 54093 existing records from primary storage. [2025-09-29T19:23:56.835468] [INFO ] [MAIN ] IPG: Loaded 54110 existing records. [2025-09-29T19:23:56.881039] [INFO ] [MAIN ] IP: Loaded 54093 existing records. [2025-09-29T19:23:57.388178] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:23:57.460445] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-09-29T19:23:57.482416] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-09-29T19:23:57.585490] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-09-29T19:23:57.650403] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:23:57.672699] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-09-29T19:23:57.771118] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-09-29T19:23:57.796472] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:23:57.816525] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-09-29T19:23:57.807514] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-09-29T19:23:57.831154] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-09-29T19:23:57.836534] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-09-29T19:23:57.841923] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-09-29T19:23:57.890478] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-09-29T19:23:57.906141] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-09-29T19:23:58.107371] [INFO ] [REMOTE ] IPI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:23:58.128299] [INFO ] [REMOTE ] IPI: Fetching primary data for 2024-12. [2025-09-29T19:23:58.877262] [INFO ] [REMOTE ] IOT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:23:58.969993] [INFO ] [REMOTE ] IOT: Fetching primary data for 2024-12. [2025-09-29T19:23:58.964474] [INFO ] [REMOTE ] IPG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:23:58.991817] [INFO ] [REMOTE ] IPG: Fetching primary data for 2024-12. [2025-09-29T19:23:59.049296] [INFO ] [REMOTE ] IP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:23:59.049601] [INFO ] [REMOTE ] IP: Fetching primary data for 2024-12. [2025-09-29T19:23:59.252337] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-29T19:23:59.256314] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-01. [2025-09-29T19:24:00.272308] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-29T19:24:00.276824] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-09-29T19:24:00.743634] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-29T19:24:00.755222] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-01. [2025-09-29T19:24:01.089932] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-29T19:24:01.108768] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-29T19:24:01.113195] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-01. [2025-09-29T19:24:01.127029] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-01. [2025-09-29T19:24:01.129204] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-29T19:24:01.134405] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-09-29T19:24:02.246257] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-29T19:24:02.251805] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-09-29T19:24:02.545564] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-29T19:24:02.556583] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-09-29T19:24:02.868205] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-29T19:24:02.880397] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-09-29T19:24:02.935849] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-29T19:24:02.947631] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-09-29T19:24:03.340638] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-29T19:24:03.346197] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-09-29T19:24:04.013631] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-29T19:24:04.024316] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-09-29T19:24:04.184340] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-29T19:24:04.190906] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-09-29T19:24:04.355693] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-29T19:24:04.367546] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-09-29T19:24:04.753043] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-29T19:24:04.769608] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-09-29T19:24:05.191903] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-29T19:24:05.196908] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-09-29T19:24:06.129713] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-29T19:24:06.142236] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-09-29T19:24:06.199236] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-29T19:24:06.210908] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-09-29T19:24:06.274264] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-29T19:24:06.279151] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-09-29T19:24:06.662320] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-29T19:24:06.675237] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-09-29T19:24:07.394229] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-29T19:24:07.399895] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-09-29T19:24:08.051792] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-29T19:24:08.067370] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-09-29T19:24:08.110130] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-29T19:24:08.128581] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-09-29T19:24:08.172002] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-29T19:24:08.184977] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-09-29T19:24:08.571882] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-29T19:24:08.580183] [INFO ] [REMOTE ] IPI: Full fetch complete (29335 records). [2025-09-29T19:24:08.580389] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-09-29T19:24:09.188864] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-09-29T19:24:09.188986] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-09-29T19:24:09.190038] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-09-29T19:24:09.190120] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-09-29T19:24:09.191182] [DEBUG] [LOCAL ] IPI: Trimmed 29335 records to 21413 (keeping 200 days of data) [2025-09-29T19:24:09.338477] [DEBUG] [LOCAL ] IPI: Primary data saved (21413 records). [2025-09-29T19:24:09.338626] [INFO ] [MAIN ] IPI: Full history saved. [2025-09-29T19:24:09.338755] [INFO ] [MAIN ] Update Progress: 1121/2371 symbols completed. IPI took 13.6s. Estimated remaining: 2h 40m 41s. Rate: 7.8 symbols/min [2025-09-29T19:24:09.535878] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:24:09.558745] [DEBUG] [LOCAL ] IQI: Loaded 18161 existing records from primary storage. [2025-09-29T19:24:09.559098] [INFO ] [MAIN ] IQI: Loaded 18161 existing records. [2025-09-29T19:24:09.757532] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:24:09.757982] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-09-29T19:24:09.758036] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-09-29T19:24:09.758379] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-09-29T19:24:09.758481] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-09-29T19:24:10.221882] [INFO ] [REMOTE ] IQI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:24:10.223005] [INFO ] [REMOTE ] IQI: Fetching primary data for 2024-12. [2025-09-29T19:24:10.227768] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-29T19:24:10.242261] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-09-29T19:24:10.293291] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-29T19:24:10.340781] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-09-29T19:24:10.343925] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-29T19:24:10.356635] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-09-29T19:24:11.300246] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-29T19:24:11.305350] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-01. [2025-09-29T19:24:12.049904] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-29T19:24:12.061911] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-09-29T19:24:12.121827] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-29T19:24:12.133808] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-09-29T19:24:12.198192] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-29T19:24:12.210585] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-09-29T19:24:12.340079] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-29T19:24:12.344845] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-09-29T19:24:13.391215] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-29T19:24:13.397390] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-09-29T19:24:13.795827] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-29T19:24:13.808942] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-09-29T19:24:13.929747] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-29T19:24:13.942534] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-09-29T19:24:14.031303] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-29T19:24:14.043607] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-09-29T19:24:14.355287] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-29T19:24:14.361441] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-09-29T19:24:15.392913] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-29T19:24:15.399173] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-09-29T19:24:15.529270] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-29T19:24:15.548078] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-09-29T19:24:15.617159] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-29T19:24:15.675857] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-29T19:24:15.963191] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-29T19:24:16.348146] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-09-29T19:24:17.148121] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-09-29T19:24:17.326184] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-29T19:24:17.761185] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-29T19:24:17.772228] [INFO ] [REMOTE ] IOT: Full fetch complete (77381 records). [2025-09-29T19:24:17.772420] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-09-29T19:24:17.957594] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-09-29T19:24:18.196283] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-09-29T19:24:18.196374] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-09-29T19:24:18.197489] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-09-29T19:24:18.197570] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-09-29T19:24:18.199266] [DEBUG] [LOCAL ] IOT: Trimmed 77381 records to 53470 (keeping 200 days of data) [2025-09-29T19:24:18.522478] [DEBUG] [LOCAL ] IOT: Primary data saved (53470 records). [2025-09-29T19:24:18.522624] [INFO ] [MAIN ] IOT: Full history saved. [2025-09-29T19:24:18.522755] [INFO ] [MAIN ] Update Progress: 1122/2371 symbols completed. IOT took 22.8s. Estimated remaining: 2h 40m 35s. Rate: 7.8 symbols/min [2025-09-29T19:24:18.741087] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:24:18.748088] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-09-29T19:24:18.796264] [DEBUG] [LOCAL ] IQV: Loaded 50895 existing records from primary storage. [2025-09-29T19:24:18.796672] [INFO ] [MAIN ] IQV: Loaded 50895 existing records. [2025-09-29T19:24:18.993327] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:24:18.993713] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-09-29T19:24:18.993818] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-09-29T19:24:18.994671] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-09-29T19:24:18.994754] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-09-29T19:24:19.308120] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-29T19:24:19.357499] [INFO ] [REMOTE ] IP: Full fetch complete (77060 records). [2025-09-29T19:24:19.369687] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-29T19:24:19.380270] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-09-29T19:24:19.494584] [INFO ] [REMOTE ] IQV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:24:19.556012] [INFO ] [REMOTE ] IQV: Fetching primary data for 2024-12. [2025-09-29T19:24:19.870283] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-09-29T19:24:19.870408] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-09-29T19:24:19.871620] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-09-29T19:24:19.871733] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-09-29T19:24:19.873549] [DEBUG] [LOCAL ] IP: Trimmed 77060 records to 53313 (keeping 200 days of data) [2025-09-29T19:24:20.228318] [DEBUG] [LOCAL ] IP: Primary data saved (53313 records). [2025-09-29T19:24:20.228501] [INFO ] [MAIN ] IP: Full history saved. [2025-09-29T19:24:20.228598] [INFO ] [MAIN ] Update Progress: 1123/2371 symbols completed. IP took 24.5s. Estimated remaining: 2h 40m 21s. Rate: 7.8 symbols/min [2025-09-29T19:24:20.353208] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-09-29T19:24:20.408492] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:24:20.460390] [DEBUG] [LOCAL ] IR: Loaded 53470 existing records from primary storage. [2025-09-29T19:24:20.460784] [INFO ] [MAIN ] IR: Loaded 53470 existing records. [2025-09-29T19:24:20.654379] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:24:20.654667] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-09-29T19:24:20.654777] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-09-29T19:24:20.655265] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-09-29T19:24:20.655326] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-09-29T19:24:20.957575] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-29T19:24:21.019255] [INFO ] [REMOTE ] IPG: Full fetch complete (77254 records). [2025-09-29T19:24:21.034783] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-09-29T19:24:21.138522] [INFO ] [REMOTE ] IR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:24:21.163013] [INFO ] [REMOTE ] IR: Fetching primary data for 2024-12. [2025-09-29T19:24:21.558585] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-29T19:24:21.588217] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-09-29T19:24:21.598904] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-09-29T19:24:21.600538] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-09-29T19:24:21.601224] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-09-29T19:24:21.615891] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-29T19:24:21.621693] [DEBUG] [LOCAL ] IPG: Trimmed 77254 records to 53330 (keeping 200 days of data) [2025-09-29T19:24:21.958609] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-09-29T19:24:21.984826] [DEBUG] [LOCAL ] IPG: Primary data saved (53330 records). [2025-09-29T19:24:21.984983] [INFO ] [MAIN ] IPG: Full history saved. [2025-09-29T19:24:21.985077] [INFO ] [MAIN ] Update Progress: 1124/2371 symbols completed. IPG took 26.3s. Estimated remaining: 2h 40m 7s. Rate: 7.8 symbols/min [2025-09-29T19:24:22.167458] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:24:22.217154] [DEBUG] [LOCAL ] IRM: Loaded 50159 existing records from primary storage. [2025-09-29T19:24:22.217530] [INFO ] [MAIN ] IRM: Loaded 50159 existing records. [2025-09-29T19:24:22.400093] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:24:22.400324] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-09-29T19:24:22.400374] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-09-29T19:24:22.400828] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-09-29T19:24:22.400889] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-09-29T19:24:22.752691] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-01. [2025-09-29T19:24:22.830198] [INFO ] [REMOTE ] IRM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:24:22.950201] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-29T19:24:23.195250] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-29T19:24:23.199437] [INFO ] [REMOTE ] IQI: Full fetch complete (27177 records). [2025-09-29T19:24:23.199559] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-09-29T19:24:23.556746] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-01. [2025-09-29T19:24:23.642873] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-09-29T19:24:23.642959] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-09-29T19:24:23.643586] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-09-29T19:24:23.643630] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-09-29T19:24:23.644500] [DEBUG] [LOCAL ] IQI: Trimmed 27177 records to 18003 (keeping 200 days of data) [2025-09-29T19:24:23.758065] [DEBUG] [LOCAL ] IQI: Primary data saved (18003 records). [2025-09-29T19:24:23.758221] [INFO ] [MAIN ] IQI: Full history saved. [2025-09-29T19:24:23.758308] [INFO ] [MAIN ] Update Progress: 1125/2371 symbols completed. IQI took 14.4s. Estimated remaining: 2h 39m 52s. Rate: 7.8 symbols/min [2025-09-29T19:24:23.941584] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:24:23.966668] [DEBUG] [LOCAL ] IRS: Loaded 22136 existing records from primary storage. [2025-09-29T19:24:23.966954] [INFO ] [MAIN ] IRS: Loaded 22136 existing records. [2025-09-29T19:24:24.178188] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:24:24.178601] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-09-29T19:24:24.178702] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-09-29T19:24:24.178995] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-09-29T19:24:24.179055] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-09-29T19:24:24.359347] [INFO ] [REMOTE ] IRM: Fetching primary data for 2024-12. [2025-09-29T19:24:24.573413] [INFO ] [REMOTE ] IRS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:24:24.607205] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-29T19:24:25.148084] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-09-29T19:24:25.259028] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-29T19:24:25.948102] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-09-29T19:24:26.272781] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-29T19:24:26.748130] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-01. [2025-09-29T19:24:26.775875] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-29T19:24:27.227699] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-29T19:24:27.548179] [INFO ] [REMOTE ] IRS: Fetching primary data for 2024-12. [2025-09-29T19:24:28.348102] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-09-29T19:24:28.542188] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-29T19:24:28.851238] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-29T19:24:29.148105] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-09-29T19:24:29.948124] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-09-29T19:24:30.140132] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-29T19:24:30.748131] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-09-29T19:24:30.878722] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-29T19:24:31.548125] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-09-29T19:24:31.705038] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-29T19:24:32.348091] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-09-29T19:24:32.515208] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-29T19:24:33.148099] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-09-29T19:24:33.350529] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-29T19:24:33.948086] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-01. [2025-09-29T19:24:34.155172] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-29T19:24:34.748140] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-09-29T19:24:35.089391] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-29T19:24:35.193193] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-29T19:24:35.548105] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-09-29T19:24:36.348105] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-09-29T19:24:36.545027] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-29T19:24:37.148185] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-09-29T19:24:37.291864] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-29T19:24:37.948089] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-09-29T19:24:38.122785] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-29T19:24:38.168297] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-29T19:24:38.748132] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-09-29T19:24:39.548167] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-09-29T19:24:39.634620] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-29T19:24:40.348147] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-09-29T19:24:40.574630] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-29T19:24:40.602304] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-29T19:24:41.148108] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-09-29T19:24:41.923205] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-29T19:24:41.948087] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-09-29T19:24:42.748123] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-09-29T19:24:42.921138] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-29T19:24:42.946750] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-29T19:24:43.548174] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-09-29T19:24:44.354227] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-09-29T19:24:44.373617] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-29T19:24:45.148117] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-09-29T19:24:45.377919] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-29T19:24:45.948086] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-09-29T19:24:46.308233] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-29T19:24:46.319929] [INFO ] [REMOTE ] IR: Full fetch complete (76145 records). [2025-09-29T19:24:46.320089] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-09-29T19:24:46.755817] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-09-29T19:24:46.756923] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-09-29T19:24:46.758042] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-09-29T19:24:46.759378] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-09-29T19:24:46.759816] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-09-29T19:24:46.761392] [DEBUG] [LOCAL ] IR: Trimmed 76145 records to 52686 (keeping 200 days of data) [2025-09-29T19:24:47.023407] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-29T19:24:47.147382] [DEBUG] [LOCAL ] IR: Primary data saved (52686 records). [2025-09-29T19:24:47.147531] [INFO ] [MAIN ] IR: Full history saved. [2025-09-29T19:24:47.147623] [INFO ] [MAIN ] Update Progress: 1126/2371 symbols completed. IR took 26.9s. Estimated remaining: 2h 40m 2s. Rate: 7.8 symbols/min [2025-09-29T19:24:47.322983] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:24:47.376371] [DEBUG] [LOCAL ] IRT: Loaded 51146 existing records from primary storage. [2025-09-29T19:24:47.376733] [INFO ] [MAIN ] IRT: Loaded 51146 existing records. [2025-09-29T19:24:47.553751] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-09-29T19:24:47.560475] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:24:47.562427] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-09-29T19:24:47.562685] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-09-29T19:24:47.563218] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-09-29T19:24:47.563324] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-09-29T19:24:47.921560] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-29T19:24:48.020417] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-29T19:24:48.028947] [INFO ] [REMOTE ] IRT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:24:48.348143] [INFO ] [REMOTE ] IRT: Fetching primary data for 2024-12. [2025-09-29T19:24:49.002588] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-29T19:24:49.148134] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-09-29T19:24:49.951841] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-09-29T19:24:49.955758] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-29T19:24:50.015785] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-29T19:24:50.748110] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-09-29T19:24:51.548145] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-01. [2025-09-29T19:24:51.687059] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-29T19:24:51.696918] [INFO ] [REMOTE ] IQV: Full fetch complete (72225 records). [2025-09-29T19:24:51.697081] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-09-29T19:24:52.133759] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-09-29T19:24:52.133890] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-09-29T19:24:52.135121] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-09-29T19:24:52.135207] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-09-29T19:24:52.136797] [DEBUG] [LOCAL ] IQV: Trimmed 72225 records to 50103 (keeping 200 days of data) [2025-09-29T19:24:52.351745] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-09-29T19:24:52.457924] [DEBUG] [LOCAL ] IQV: Primary data saved (50103 records). [2025-09-29T19:24:52.458069] [INFO ] [MAIN ] IQV: Full history saved. [2025-09-29T19:24:52.458169] [INFO ] [MAIN ] Update Progress: 1127/2371 symbols completed. IQV took 33.9s. Estimated remaining: 2h 39m 52s. Rate: 7.8 symbols/min [2025-09-29T19:24:52.641294] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:24:52.672876] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-29T19:24:52.688508] [INFO ] [REMOTE ] IRM: Full fetch complete (72255 records). [2025-09-29T19:24:52.688870] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-09-29T19:24:52.763775] [DEBUG] [LOCAL ] ISD: Loaded 15803 existing records from primary storage. [2025-09-29T19:24:52.806604] [INFO ] [MAIN ] ISD: Loaded 15803 existing records. [2025-09-29T19:24:53.071457] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-29T19:24:53.151412] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-09-29T19:24:53.290785] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:24:53.307057] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-09-29T19:24:53.312341] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-09-29T19:24:53.374162] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-09-29T19:24:53.377417] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-09-29T19:24:53.443162] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-09-29T19:24:53.471488] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-09-29T19:24:53.491271] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-09-29T19:24:53.506269] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-09-29T19:24:53.583975] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-29T19:24:53.622891] [DEBUG] [LOCAL ] IRM: Trimmed 72255 records to 49362 (keeping 200 days of data) [2025-09-29T19:24:53.956829] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-09-29T19:24:53.964244] [INFO ] [REMOTE ] ISD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:24:54.194001] [DEBUG] [LOCAL ] IRM: Primary data saved (49362 records). [2025-09-29T19:24:54.194174] [INFO ] [MAIN ] IRM: Full history saved. [2025-09-29T19:24:54.194295] [INFO ] [MAIN ] Update Progress: 1128/2371 symbols completed. IRM took 32.2s. Estimated remaining: 2h 39m 37s. Rate: 7.8 symbols/min [2025-09-29T19:24:54.397541] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:24:54.440309] [DEBUG] [LOCAL ] IT: Loaded 42234 existing records from primary storage. [2025-09-29T19:24:54.440630] [INFO ] [MAIN ] IT: Loaded 42234 existing records. [2025-09-29T19:24:54.640041] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:24:54.640293] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-09-29T19:24:54.640447] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-09-29T19:24:54.641050] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-09-29T19:24:54.641114] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-09-29T19:24:54.752370] [INFO ] [REMOTE ] ISD: Fetching primary data for 2024-12. [2025-09-29T19:24:55.028909] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-29T19:24:55.101564] [INFO ] [REMOTE ] IT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:24:55.244260] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-29T19:24:55.548133] [INFO ] [REMOTE ] IT: Fetching primary data for 2024-12. [2025-09-29T19:24:55.728832] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-29T19:24:56.348119] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-09-29T19:24:56.900778] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-29T19:24:57.148119] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-01. [2025-09-29T19:24:57.948085] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-09-29T19:24:57.969216] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-29T19:24:57.976770] [INFO ] [REMOTE ] IRS: Full fetch complete (32254 records). [2025-09-29T19:24:57.976877] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-09-29T19:24:58.387142] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-09-29T19:24:58.387390] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-09-29T19:24:58.388291] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-09-29T19:24:58.388359] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-09-29T19:24:58.389340] [DEBUG] [LOCAL ] IRS: Trimmed 32254 records to 21787 (keeping 200 days of data) [2025-09-29T19:24:58.520019] [DEBUG] [LOCAL ] IRS: Primary data saved (21787 records). [2025-09-29T19:24:58.520154] [INFO ] [MAIN ] IRS: Full history saved. [2025-09-29T19:24:58.520237] [INFO ] [MAIN ] Update Progress: 1129/2371 symbols completed. IRS took 34.8s. Estimated remaining: 2h 39m 26s. Rate: 7.8 symbols/min [2025-09-29T19:24:58.645937] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-29T19:24:58.726498] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:24:58.748104] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-09-29T19:24:58.762375] [DEBUG] [LOCAL ] ITGR: Loaded 31996 existing records from primary storage. [2025-09-29T19:24:58.762686] [INFO ] [MAIN ] ITGR: Loaded 31996 existing records. [2025-09-29T19:24:58.945033] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:24:58.945244] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-09-29T19:24:58.945291] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-09-29T19:24:58.945681] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-09-29T19:24:58.945740] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-09-29T19:24:59.326829] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:24:59.548156] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-01. [2025-09-29T19:24:59.715681] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-29T19:25:00.182804] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-29T19:25:00.326720] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-29T19:25:00.348157] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-09-29T19:25:01.148186] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-09-29T19:25:01.918305] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-29T19:25:01.948093] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-09-29T19:25:02.647665] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-29T19:25:02.748158] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2024-12. [2025-09-29T19:25:02.912411] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-29T19:25:03.548171] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-09-29T19:25:03.788267] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-29T19:25:04.348100] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-09-29T19:25:04.500749] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-29T19:25:05.148143] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-09-29T19:25:05.948091] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-09-29T19:25:06.020497] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-29T19:25:06.186102] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-29T19:25:06.748114] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-09-29T19:25:07.513128] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-29T19:25:07.548128] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-09-29T19:25:07.749110] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-29T19:25:08.348164] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-09-29T19:25:09.092729] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-29T19:25:09.148091] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-09-29T19:25:09.300976] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-29T19:25:09.948121] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-09-29T19:25:10.633743] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-29T19:25:10.748147] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-09-29T19:25:11.548084] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-01. [2025-09-29T19:25:11.588513] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-29T19:25:12.307611] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-29T19:25:12.354843] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-09-29T19:25:12.358401] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-29T19:25:13.148103] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-09-29T19:25:13.294829] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-29T19:25:13.948116] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-09-29T19:25:14.748141] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-09-29T19:25:14.937401] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-29T19:25:14.939981] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-29T19:25:15.548154] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-09-29T19:25:15.618465] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-29T19:25:16.348130] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-09-29T19:25:17.148114] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-09-29T19:25:17.370663] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-29T19:25:17.630498] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-29T19:25:17.948156] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-09-29T19:25:18.084101] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-29T19:25:18.748158] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-09-29T19:25:19.548114] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-09-29T19:25:19.568329] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-29T19:25:19.571968] [INFO ] [REMOTE ] ISD: Full fetch complete (23981 records). [2025-09-29T19:25:19.572058] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-09-29T19:25:19.998423] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-09-29T19:25:19.998598] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-09-29T19:25:19.999293] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-09-29T19:25:19.999466] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-09-29T19:25:20.001958] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-29T19:25:20.002449] [DEBUG] [LOCAL ] ISD: Trimmed 23981 records to 15526 (keeping 200 days of data) [2025-09-29T19:25:20.014406] [INFO ] [REMOTE ] IRT: Full fetch complete (72514 records). [2025-09-29T19:25:20.014617] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-09-29T19:25:20.277303] [DEBUG] [LOCAL ] ISD: Primary data saved (15526 records). [2025-09-29T19:25:20.304451] [INFO ] [MAIN ] ISD: Full history saved. [2025-09-29T19:25:20.321136] [INFO ] [MAIN ] Update Progress: 1130/2371 symbols completed. ISD took 27.9s. Estimated remaining: 2h 39m 34s. Rate: 7.8 symbols/min [2025-09-29T19:25:20.353288] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-09-29T19:25:20.707223] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:25:20.748031] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-09-29T19:25:20.748117] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-09-29T19:25:20.749307] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-09-29T19:25:20.749504] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-09-29T19:25:20.751331] [DEBUG] [LOCAL ] IRT: Trimmed 72514 records to 50393 (keeping 200 days of data) [2025-09-29T19:25:20.966127] [DEBUG] [LOCAL ] ITT: Loaded 33511 existing records from primary storage. [2025-09-29T19:25:20.996181] [INFO ] [MAIN ] ITT: Loaded 33511 existing records. [2025-09-29T19:25:21.215199] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:25:21.216512] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-09-29T19:25:21.217238] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-09-29T19:25:21.218897] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-09-29T19:25:21.219813] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-09-29T19:25:21.452207] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-29T19:25:21.540381] [INFO ] [REMOTE ] IT: Full fetch complete (55738 records). [2025-09-29T19:25:21.554087] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-09-29T19:25:21.830869] [INFO ] [REMOTE ] ITT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:25:21.845102] [INFO ] [REMOTE ] ITT: Fetching primary data for 2024-12. [2025-09-29T19:25:22.114795] [DEBUG] [LOCAL ] IRT: Primary data saved (50393 records). [2025-09-29T19:25:22.120300] [INFO ] [MAIN ] IRT: Full history saved. [2025-09-29T19:25:22.144570] [INFO ] [MAIN ] Update Progress: 1131/2371 symbols completed. IRT took 35.0s. Estimated remaining: 2h 39m 20s. Rate: 7.8 symbols/min [2025-09-29T19:25:22.235620] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-29T19:25:22.244391] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-09-29T19:25:22.275747] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-09-29T19:25:22.275609] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-09-29T19:25:22.296198] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-09-29T19:25:22.323243] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-09-29T19:25:22.381439] [DEBUG] [LOCAL ] IT: Trimmed 55738 records to 41834 (keeping 200 days of data) [2025-09-29T19:25:22.548732] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:25:22.681906] [DEBUG] [LOCAL ] ITUB: Loaded 54084 existing records from primary storage. [2025-09-29T19:25:22.709718] [INFO ] [MAIN ] ITUB: Loaded 54084 existing records. [2025-09-29T19:25:22.914430] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:25:22.915968] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-09-29T19:25:22.916677] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-09-29T19:25:22.918227] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-09-29T19:25:22.918594] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-09-29T19:25:23.271045] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-29T19:25:23.289491] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-01. [2025-09-29T19:25:23.386900] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:25:23.390002] [DEBUG] [LOCAL ] IT: Primary data saved (41834 records). [2025-09-29T19:25:23.390072] [INFO ] [MAIN ] IT: Full history saved. [2025-09-29T19:25:23.390154] [INFO ] [MAIN ] Update Progress: 1132/2371 symbols completed. IT took 29.2s. Estimated remaining: 2h 39m 5s. Rate: 7.8 symbols/min [2025-09-29T19:25:23.552190] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2024-12. [2025-09-29T19:25:23.574503] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:25:23.621413] [DEBUG] [LOCAL ] ITW: Loaded 46782 existing records from primary storage. [2025-09-29T19:25:23.621743] [INFO ] [MAIN ] ITW: Loaded 46782 existing records. [2025-09-29T19:25:23.810697] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:25:23.811053] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-09-29T19:25:23.811157] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-09-29T19:25:23.818344] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-09-29T19:25:23.830444] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-09-29T19:25:23.837158] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-29T19:25:24.213586] [INFO ] [REMOTE ] ITW: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:25:24.348119] [INFO ] [REMOTE ] ITW: Fetching primary data for 2024-12. [2025-09-29T19:25:24.674724] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-29T19:25:25.153220] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-09-29T19:25:25.168918] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-29T19:25:25.911086] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-29T19:25:25.948113] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-01. [2025-09-29T19:25:26.439097] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-29T19:25:26.748167] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-09-29T19:25:27.548089] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-09-29T19:25:27.602599] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-29T19:25:28.106868] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-29T19:25:28.348168] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-01. [2025-09-29T19:25:28.971728] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-29T19:25:29.148137] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-09-29T19:25:29.948132] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-09-29T19:25:30.163470] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-29T19:25:30.568632] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-29T19:25:30.748110] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-09-29T19:25:31.016368] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-29T19:25:31.548151] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-09-29T19:25:32.348091] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-09-29T19:25:32.414037] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-29T19:25:33.148091] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-09-29T19:25:33.176961] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-29T19:25:33.696431] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-29T19:25:33.703256] [INFO ] [REMOTE ] ITGR: Full fetch complete (41631 records). [2025-09-29T19:25:33.703370] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-09-29T19:25:33.954237] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-09-29T19:25:34.161971] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-09-29T19:25:34.162064] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-09-29T19:25:34.162882] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-09-29T19:25:34.162946] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-09-29T19:25:34.164141] [DEBUG] [LOCAL ] ITGR: Trimmed 41631 records to 31645 (keeping 200 days of data) [2025-09-29T19:25:34.389252] [DEBUG] [LOCAL ] ITGR: Primary data saved (31645 records). [2025-09-29T19:25:34.389613] [INFO ] [MAIN ] ITGR: Full history saved. [2025-09-29T19:25:34.389928] [INFO ] [MAIN ] Update Progress: 1133/2371 symbols completed. ITGR took 35.9s. Estimated remaining: 2h 39m 1s. Rate: 7.8 symbols/min [2025-09-29T19:25:34.584993] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:25:34.641711] [DEBUG] [LOCAL ] IVR: Loaded 48557 existing records from primary storage. [2025-09-29T19:25:34.642276] [INFO ] [MAIN ] IVR: Loaded 48557 existing records. [2025-09-29T19:25:34.748530] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-09-29T19:25:34.840276] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:25:34.840701] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-09-29T19:25:34.840823] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-09-29T19:25:34.841223] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-09-29T19:25:34.841350] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-09-29T19:25:35.133726] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-29T19:25:35.308975] [INFO ] [REMOTE ] IVR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:25:35.548133] [INFO ] [REMOTE ] IVR: Fetching primary data for 2024-12. [2025-09-29T19:25:35.802224] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-29T19:25:36.348102] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-09-29T19:25:36.566060] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-29T19:25:37.148122] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-09-29T19:25:37.285600] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-29T19:25:37.948124] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-01. [2025-09-29T19:25:38.182152] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-29T19:25:38.748108] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-09-29T19:25:39.052173] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-29T19:25:39.548084] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-09-29T19:25:39.692783] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-29T19:25:40.286928] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-29T19:25:40.348134] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-09-29T19:25:41.148093] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-09-29T19:25:41.234543] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-29T19:25:41.621046] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-29T19:25:41.948126] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-09-29T19:25:42.748125] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-09-29T19:25:42.925636] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-29T19:25:43.548084] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-09-29T19:25:43.590478] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-29T19:25:44.321889] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-29T19:25:44.348103] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-09-29T19:25:45.148132] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-09-29T19:25:45.311529] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-29T19:25:45.948110] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-09-29T19:25:46.065636] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-29T19:25:46.145339] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-29T19:25:46.748113] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-09-29T19:25:47.548102] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-09-29T19:25:47.742569] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-29T19:25:48.348161] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-09-29T19:25:48.791362] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-29T19:25:48.794054] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-29T19:25:49.148132] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-09-29T19:25:49.799405] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-29T19:25:49.948137] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-09-29T19:25:50.748124] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-09-29T19:25:50.796342] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-29T19:25:51.305282] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-29T19:25:51.312040] [INFO ] [REMOTE ] ITT: Full fetch complete (46974 records). [2025-09-29T19:25:51.312170] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-09-29T19:25:51.553853] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-09-29T19:25:51.729986] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-09-29T19:25:51.730074] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-09-29T19:25:51.730989] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-09-29T19:25:51.731056] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-09-29T19:25:51.732184] [DEBUG] [LOCAL ] ITT: Trimmed 46974 records to 32914 (keeping 200 days of data) [2025-09-29T19:25:51.954512] [DEBUG] [LOCAL ] ITT: Primary data saved (32914 records). [2025-09-29T19:25:51.954692] [INFO ] [MAIN ] ITT: Full history saved. [2025-09-29T19:25:51.954814] [INFO ] [MAIN ] Update Progress: 1134/2371 symbols completed. ITT took 31.6s. Estimated remaining: 2h 39m 4s. Rate: 7.8 symbols/min [2025-09-29T19:25:52.165989] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:25:52.207895] [DEBUG] [LOCAL ] IVT: Loaded 31325 existing records from primary storage. [2025-09-29T19:25:52.208318] [INFO ] [MAIN ] IVT: Loaded 31325 existing records. [2025-09-29T19:25:52.353271] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-09-29T19:25:52.417491] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:25:52.417947] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-09-29T19:25:52.418005] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-09-29T19:25:52.418357] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-09-29T19:25:52.418417] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-09-29T19:25:52.812335] [INFO ] [REMOTE ] IVT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:25:52.844323] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-29T19:25:53.148133] [INFO ] [REMOTE ] IVT: Fetching primary data for 2024-12. [2025-09-29T19:25:53.314199] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-29T19:25:53.328527] [INFO ] [REMOTE ] ITUB: Full fetch complete (77173 records). [2025-09-29T19:25:53.328754] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-09-29T19:25:53.964832] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-09-29T19:25:53.973418] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-09-29T19:25:53.973667] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-09-29T19:25:53.975356] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-09-29T19:25:53.975580] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-09-29T19:25:53.977793] [DEBUG] [LOCAL ] ITUB: Trimmed 77173 records to 53318 (keeping 200 days of data) [2025-09-29T19:25:54.126580] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-29T19:25:54.139806] [INFO ] [REMOTE ] ITW: Full fetch complete (66395 records). [2025-09-29T19:25:54.140841] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-09-29T19:25:54.414979] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-29T19:25:54.723730] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-09-29T19:25:54.723813] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-09-29T19:25:54.724951] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-09-29T19:25:54.725297] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-09-29T19:25:54.732876] [DEBUG] [LOCAL ] ITW: Trimmed 66395 records to 45913 (keeping 200 days of data) [2025-09-29T19:25:54.793934] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-01. [2025-09-29T19:25:55.085720] [DEBUG] [LOCAL ] ITUB: Primary data saved (53318 records). [2025-09-29T19:25:55.086386] [INFO ] [MAIN ] ITUB: Full history saved. [2025-09-29T19:25:55.086812] [INFO ] [MAIN ] Update Progress: 1135/2371 symbols completed. ITUB took 32.9s. Estimated remaining: 2h 38m 51s. Rate: 7.8 symbols/min [2025-09-29T19:25:55.280663] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:25:55.356100] [DEBUG] [LOCAL ] ITW: Primary data saved (45913 records). [2025-09-29T19:25:55.356255] [INFO ] [MAIN ] ITW: Full history saved. [2025-09-29T19:25:55.356346] [INFO ] [MAIN ] Update Progress: 1136/2371 symbols completed. ITW took 32.0s. Estimated remaining: 2h 38m 35s. Rate: 7.8 symbols/min [2025-09-29T19:25:55.487868] [DEBUG] [LOCAL ] IVZ: Loaded 53908 existing records from primary storage. [2025-09-29T19:25:55.508692] [INFO ] [MAIN ] IVZ: Loaded 53908 existing records. [2025-09-29T19:25:55.610754] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:25:55.765972] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:25:55.766551] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-09-29T19:25:55.766930] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-09-29T19:25:55.767408] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-09-29T19:25:55.777165] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-09-29T19:25:55.884531] [DEBUG] [LOCAL ] IX: Loaded 22926 existing records from primary storage. [2025-09-29T19:25:55.902439] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-29T19:25:55.902813] [INFO ] [MAIN ] IX: Loaded 22926 existing records. [2025-09-29T19:25:55.981279] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-09-29T19:25:56.348698] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:25:56.364882] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-09-29T19:25:56.365007] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-09-29T19:25:56.395793] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-29T19:25:56.394092] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-09-29T19:25:56.441965] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:25:56.448485] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-09-29T19:25:56.454237] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2024-12. [2025-09-29T19:25:56.834462] [INFO ] [REMOTE ] IX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:25:57.148114] [INFO ] [REMOTE ] IX: Fetching primary data for 2024-12. [2025-09-29T19:25:57.787189] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-29T19:25:57.874437] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-29T19:25:57.924047] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-29T19:25:57.948071] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-01. [2025-09-29T19:25:58.748126] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-09-29T19:25:59.548091] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-09-29T19:25:59.712727] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-29T19:26:00.066000] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-29T19:26:00.081110] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-29T19:26:00.348133] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-09-29T19:26:01.148137] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-09-29T19:26:01.740232] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-29T19:26:01.754754] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-29T19:26:01.948152] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-09-29T19:26:02.748160] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-09-29T19:26:03.163994] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-29T19:26:03.548129] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-09-29T19:26:03.945761] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-29T19:26:04.348143] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-09-29T19:26:05.148190] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-09-29T19:26:05.233395] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-29T19:26:05.948151] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-09-29T19:26:05.974672] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-29T19:26:06.514975] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-29T19:26:06.748136] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-09-29T19:26:07.548099] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-09-29T19:26:07.877265] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-29T19:26:08.348084] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-09-29T19:26:08.621766] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-29T19:26:08.669743] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-29T19:26:09.153291] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-09-29T19:26:09.161589] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-29T19:26:09.948111] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-09-29T19:26:10.571260] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-29T19:26:10.748160] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-09-29T19:26:11.548161] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-09-29T19:26:11.900466] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-29T19:26:12.051613] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-29T19:26:12.348163] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-09-29T19:26:13.148106] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-09-29T19:26:13.317040] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-29T19:26:13.948118] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-09-29T19:26:14.172560] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-29T19:26:14.528022] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-29T19:26:14.535294] [INFO ] [REMOTE ] IVT: Full fetch complete (45492 records). [2025-09-29T19:26:14.535442] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-09-29T19:26:14.758195] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-09-29T19:26:14.873579] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-29T19:26:14.981023] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-09-29T19:26:14.981096] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-09-29T19:26:14.981982] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-09-29T19:26:14.982046] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-09-29T19:26:14.983080] [DEBUG] [LOCAL ] IVT: Trimmed 45492 records to 30671 (keeping 200 days of data) [2025-09-29T19:26:15.177093] [DEBUG] [LOCAL ] IVT: Primary data saved (30671 records). [2025-09-29T19:26:15.177238] [INFO ] [MAIN ] IVT: Full history saved. [2025-09-29T19:26:15.177323] [INFO ] [MAIN ] Update Progress: 1137/2371 symbols completed. IVT took 23.2s. Estimated remaining: 2h 38m 41s. Rate: 7.8 symbols/min [2025-09-29T19:26:15.375781] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:26:15.429366] [DEBUG] [LOCAL ] J: Loaded 40873 existing records from primary storage. [2025-09-29T19:26:15.429773] [INFO ] [MAIN ] J: Loaded 40873 existing records. [2025-09-29T19:26:15.553273] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-09-29T19:26:15.618911] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:26:15.619130] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-09-29T19:26:15.619178] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-09-29T19:26:15.619696] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-09-29T19:26:15.619757] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-09-29T19:26:15.988243] [INFO ] [REMOTE ] J: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:26:16.348183] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-09-29T19:26:16.795276] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-29T19:26:16.807018] [INFO ] [REMOTE ] IVR: Full fetch complete (69020 records). [2025-09-29T19:26:16.807198] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-09-29T19:26:17.165485] [INFO ] [REMOTE ] J: Fetching primary data for 2024-12. [2025-09-29T19:26:17.226793] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-09-29T19:26:17.226915] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-09-29T19:26:17.228062] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-09-29T19:26:17.228530] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-09-29T19:26:17.230711] [DEBUG] [LOCAL ] IVR: Trimmed 69020 records to 47835 (keeping 200 days of data) [2025-09-29T19:26:17.378470] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-29T19:26:17.397019] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-29T19:26:17.617042] [DEBUG] [LOCAL ] IVR: Primary data saved (47835 records). [2025-09-29T19:26:17.617203] [INFO ] [MAIN ] IVR: Full history saved. [2025-09-29T19:26:17.617293] [INFO ] [MAIN ] Update Progress: 1138/2371 symbols completed. IVR took 43.2s. Estimated remaining: 2h 38m 27s. Rate: 7.8 symbols/min [2025-09-29T19:26:17.799561] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:26:17.845575] [DEBUG] [LOCAL ] JBGS: Loaded 43089 existing records from primary storage. [2025-09-29T19:26:17.845929] [INFO ] [MAIN ] JBGS: Loaded 43089 existing records. [2025-09-29T19:26:17.950778] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-09-29T19:26:18.034181] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:26:18.034425] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-09-29T19:26:18.034477] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-09-29T19:26:18.034778] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-09-29T19:26:18.034838] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-09-29T19:26:18.431158] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:26:18.466188] [INFO ] [REMOTE ] J: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-29T19:26:18.748152] [INFO ] [REMOTE ] J: Fetching primary data for 2025-01. [2025-09-29T19:26:19.548124] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-09-29T19:26:19.907273] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-29T19:26:20.132285] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-29T19:26:20.348106] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-09-29T19:26:20.532227] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-29T19:26:21.148136] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2024-12. [2025-09-29T19:26:21.948122] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-09-29T19:26:22.095459] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-29T19:26:22.549638] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-29T19:26:22.748150] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-09-29T19:26:23.091670] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-29T19:26:23.095630] [INFO ] [REMOTE ] IX: Full fetch complete (27106 records). [2025-09-29T19:26:23.095761] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-09-29T19:26:23.483826] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-09-29T19:26:23.483950] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-09-29T19:26:23.484516] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-09-29T19:26:23.484562] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-09-29T19:26:23.485501] [DEBUG] [LOCAL ] IX: Trimmed 27106 records to 22541 (keeping 200 days of data) [2025-09-29T19:26:23.568835] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-01. [2025-09-29T19:26:23.625021] [DEBUG] [LOCAL ] IX: Primary data saved (22541 records). [2025-09-29T19:26:23.625170] [INFO ] [MAIN ] IX: Full history saved. [2025-09-29T19:26:23.625260] [INFO ] [MAIN ] Update Progress: 1139/2371 symbols completed. IX took 28.3s. Estimated remaining: 2h 38m 18s. Rate: 7.8 symbols/min [2025-09-29T19:26:23.817733] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:26:23.863047] [DEBUG] [LOCAL ] JBI: Loaded 44362 existing records from primary storage. [2025-09-29T19:26:23.863384] [INFO ] [MAIN ] JBI: Loaded 44362 existing records. [2025-09-29T19:26:24.069820] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:26:24.070109] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-09-29T19:26:24.070169] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-09-29T19:26:24.070438] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-09-29T19:26:24.070507] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-09-29T19:26:24.357840] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-09-29T19:26:24.456895] [INFO ] [REMOTE ] JBI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:26:24.651040] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-29T19:26:24.663172] [INFO ] [REMOTE ] IVZ: Full fetch complete (76767 records). [2025-09-29T19:26:24.663486] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-09-29T19:26:24.775608] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-29T19:26:25.148603] [INFO ] [REMOTE ] JBI: Fetching primary data for 2024-12. [2025-09-29T19:26:25.169153] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-09-29T19:26:25.169248] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-09-29T19:26:25.170354] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-09-29T19:26:25.170423] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-09-29T19:26:25.172251] [DEBUG] [LOCAL ] IVZ: Trimmed 76767 records to 53127 (keeping 200 days of data) [2025-09-29T19:26:25.527494] [DEBUG] [LOCAL ] IVZ: Primary data saved (53127 records). [2025-09-29T19:26:25.527687] [INFO ] [MAIN ] IVZ: Full history saved. [2025-09-29T19:26:25.527807] [INFO ] [MAIN ] Update Progress: 1140/2371 symbols completed. IVZ took 30.4s. Estimated remaining: 2h 38m 4s. Rate: 7.8 symbols/min [2025-09-29T19:26:25.715295] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:26:25.772622] [DEBUG] [LOCAL ] JBL: Loaded 49145 existing records from primary storage. [2025-09-29T19:26:25.772996] [INFO ] [MAIN ] JBL: Loaded 49145 existing records. [2025-09-29T19:26:25.966949] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-09-29T19:26:25.966832] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:26:25.968558] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-09-29T19:26:25.968693] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-09-29T19:26:25.969871] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-09-29T19:26:25.969988] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-09-29T19:26:26.171591] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-29T19:26:26.415551] [INFO ] [REMOTE ] JBL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:26:26.446329] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-29T19:26:26.748135] [INFO ] [REMOTE ] JBL: Fetching primary data for 2024-12. [2025-09-29T19:26:27.398425] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-29T19:26:27.548141] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-09-29T19:26:28.348122] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-09-29T19:26:28.520674] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-29T19:26:29.051025] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-29T19:26:29.148124] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-01. [2025-09-29T19:26:29.923334] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-29T19:26:29.948078] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-09-29T19:26:30.695332] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-29T19:26:30.748120] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-09-29T19:26:31.176920] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-29T19:26:31.548135] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-09-29T19:26:32.208513] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-29T19:26:32.348114] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-01. [2025-09-29T19:26:33.075252] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-29T19:26:33.148094] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-09-29T19:26:33.948098] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-09-29T19:26:34.144378] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-29T19:26:34.748112] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-09-29T19:26:34.838446] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-29T19:26:35.464117] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-29T19:26:35.548128] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-09-29T19:26:36.023128] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-29T19:26:36.348195] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-09-29T19:26:37.010191] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-29T19:26:37.148112] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-09-29T19:26:37.948152] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-09-29T19:26:37.992548] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-29T19:26:38.754614] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-09-29T19:26:38.772570] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-29T19:26:39.253344] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-29T19:26:39.548127] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-09-29T19:26:40.270388] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-29T19:26:40.348134] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-09-29T19:26:40.958867] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-29T19:26:41.148128] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-09-29T19:26:41.776730] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-29T19:26:41.948085] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-09-29T19:26:42.744915] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-29T19:26:42.755336] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-09-29T19:26:43.259788] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-29T19:26:43.268380] [INFO ] [REMOTE ] J: Full fetch complete (59092 records). [2025-09-29T19:26:43.268534] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-09-29T19:26:43.553310] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-09-29T19:26:43.712149] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-09-29T19:26:43.712262] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-09-29T19:26:43.713299] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-09-29T19:26:43.713394] [DEBUG] [LOCAL ] J: Saving primary data. [2025-09-29T19:26:43.714913] [DEBUG] [LOCAL ] J: Trimmed 59092 records to 40155 (keeping 200 days of data) [2025-09-29T19:26:44.005845] [DEBUG] [LOCAL ] J: Primary data saved (40155 records). [2025-09-29T19:26:44.005973] [INFO ] [MAIN ] J: Full history saved. [2025-09-29T19:26:44.006074] [INFO ] [MAIN ] Update Progress: 1141/2371 symbols completed. J took 28.8s. Estimated remaining: 2h 38m 8s. Rate: 7.8 symbols/min [2025-09-29T19:26:44.195218] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:26:44.225514] [DEBUG] [LOCAL ] JBND: Loaded 26051 existing records from primary storage. [2025-09-29T19:26:44.225852] [INFO ] [MAIN ] JBND: Loaded 26051 existing records. [2025-09-29T19:26:44.352054] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-09-29T19:26:44.439188] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:26:44.439439] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-09-29T19:26:44.439513] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-09-29T19:26:44.440118] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-09-29T19:26:44.440812] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-09-29T19:26:44.721171] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-29T19:26:44.914809] [INFO ] [REMOTE ] JBND: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:26:45.144535] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-29T19:26:45.157742] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-09-29T19:26:45.948075] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-09-29T19:26:46.116090] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-29T19:26:46.125060] [INFO ] [REMOTE ] JBGS: Full fetch complete (59119 records). [2025-09-29T19:26:46.125230] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-09-29T19:26:46.560248] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-09-29T19:26:46.560360] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-09-29T19:26:46.561469] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-09-29T19:26:46.561714] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-09-29T19:26:46.563136] [DEBUG] [LOCAL ] JBGS: Trimmed 59119 records to 42397 (keeping 200 days of data) [2025-09-29T19:26:46.752081] [INFO ] [REMOTE ] JBND: Fetching primary data for 2024-12. [2025-09-29T19:26:46.844743] [DEBUG] [LOCAL ] JBGS: Primary data saved (42397 records). [2025-09-29T19:26:46.844870] [INFO ] [MAIN ] JBGS: Full history saved. [2025-09-29T19:26:46.844974] [INFO ] [MAIN ] Update Progress: 1142/2371 symbols completed. JBGS took 29.2s. Estimated remaining: 2h 37m 55s. Rate: 7.8 symbols/min [2025-09-29T19:26:47.053830] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:26:47.053996] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-09-29T19:26:47.052071] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-29T19:26:47.054096] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-09-29T19:26:47.063795] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-09-29T19:26:47.064192] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-09-29T19:26:47.064287] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-09-29T19:26:47.064756] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-09-29T19:26:47.448323] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:26:47.553240] [INFO ] [REMOTE ] JBS: Fetching primary data for 2024-12. [2025-09-29T19:26:47.572538] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-29T19:26:47.780451] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T19:26:47.780841] [WARN ] [REMOTE ] JBS: No data returned for month 2024-12 [2025-09-29T19:26:47.780934] [FATAL] [REMOTE ] JBS: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T19:26:47.780989] [FATAL] [MAIN ] JBS: Failed to fetch primary data. [2025-09-29T19:26:47.781049] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T19:26:47.781128] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-09-29T19:26:47.781196] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-09-29T19:26:47.781248] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-09-29T19:26:47.781334] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-09-29T19:26:47.781405] [INFO ] [MAIN ] Update Progress: 1143/2371 symbols completed. JBS took 0.9s. Estimated remaining: 2h 37m 40s. Rate: 7.8 symbols/min [2025-09-29T19:26:47.933531] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-29T19:26:47.992899] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:26:47.993065] [DEBUG] [LOCAL ] JBTM: No existing data file found in primary storage. [2025-09-29T19:26:47.993137] [WARN ] [MAIN ] JBTM: No existing data found, performing full refresh instead. [2025-09-29T19:26:47.993312] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-09-29T19:26:47.993385] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-09-29T19:26:47.993454] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-09-29T19:26:47.993506] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-09-29T19:26:48.357969] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-09-29T19:26:48.392885] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:26:49.148112] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-09-29T19:26:49.948104] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2024-12. [2025-09-29T19:26:50.122698] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-29T19:26:50.138467] [DEBUG] [REMOTE ] JBTM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T19:26:50.138943] [WARN ] [REMOTE ] JBTM: No data returned for month 2024-12 [2025-09-29T19:26:50.139038] [FATAL] [REMOTE ] JBTM: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T19:26:50.139092] [FATAL] [MAIN ] JBTM: Failed to fetch primary data. [2025-09-29T19:26:50.139153] [WARN ] [MAIN ] JBTM: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T19:26:50.139228] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-09-29T19:26:50.139295] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-09-29T19:26:50.139370] [INFO ] [LOCAL ] JBTM: Starting deletion of derivative data. [2025-09-29T19:26:50.139494] [DEBUG] [LOCAL ] JBTM: No derivative data file found to delete. [2025-09-29T19:26:50.139593] [INFO ] [MAIN ] Update Progress: 1144/2371 symbols completed. JBTM took 2.4s. Estimated remaining: 2h 37m 26s. Rate: 7.8 symbols/min [2025-09-29T19:26:50.325540] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:26:50.352720] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-29T19:26:50.365485] [DEBUG] [LOCAL ] JCE: Loaded 6591 existing records from primary storage. [2025-09-29T19:26:50.365733] [INFO ] [MAIN ] JCE: Loaded 6591 existing records. [2025-09-29T19:26:50.554901] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:26:50.555137] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-09-29T19:26:50.555187] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-09-29T19:26:50.555425] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-09-29T19:26:50.555484] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-09-29T19:26:50.751603] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-09-29T19:26:50.950494] [INFO ] [REMOTE ] JCE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:26:51.548111] [INFO ] [REMOTE ] JCE: Fetching primary data for 2024-12. [2025-09-29T19:26:52.289914] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-29T19:26:52.348116] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-09-29T19:26:52.792127] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-29T19:26:53.148122] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-01. [2025-09-29T19:26:53.811077] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-29T19:26:53.890431] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-29T19:26:53.948081] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-09-29T19:26:54.748116] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-09-29T19:26:55.318213] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-29T19:26:55.415962] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-29T19:26:55.548151] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-09-29T19:26:56.144942] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-29T19:26:56.348146] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-09-29T19:26:57.055532] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-29T19:26:57.148161] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-09-29T19:26:57.948131] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-09-29T19:26:58.642983] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-29T19:26:58.651537] [INFO ] [REMOTE ] JBI: Full fetch complete (64431 records). [2025-09-29T19:26:58.651772] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-09-29T19:26:58.757502] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-09-29T19:26:59.090734] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-09-29T19:26:59.090842] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-09-29T19:26:59.092034] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-09-29T19:26:59.092107] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-09-29T19:26:59.093686] [DEBUG] [LOCAL ] JBI: Trimmed 64431 records to 43571 (keeping 200 days of data) [2025-09-29T19:26:59.370741] [DEBUG] [LOCAL ] JBI: Primary data saved (43571 records). [2025-09-29T19:26:59.370885] [INFO ] [MAIN ] JBI: Full history saved. [2025-09-29T19:26:59.370980] [INFO ] [MAIN ] Update Progress: 1145/2371 symbols completed. JBI took 35.7s. Estimated remaining: 2h 37m 20s. Rate: 7.8 symbols/min [2025-09-29T19:26:59.489047] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-29T19:26:59.548885] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-09-29T19:26:59.572283] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:26:59.630245] [DEBUG] [LOCAL ] JCI: Loaded 54327 existing records from primary storage. [2025-09-29T19:26:59.630616] [INFO ] [MAIN ] JCI: Loaded 54327 existing records. [2025-09-29T19:26:59.821717] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:26:59.822086] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-09-29T19:26:59.822151] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-09-29T19:26:59.832583] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-09-29T19:26:59.846875] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-09-29T19:26:59.926484] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-29T19:27:00.068103] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-29T19:27:00.265133] [INFO ] [REMOTE ] JCI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:27:00.348114] [INFO ] [REMOTE ] JCI: Fetching primary data for 2024-12. [2025-09-29T19:27:01.148126] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-09-29T19:27:01.948140] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-01. [2025-09-29T19:27:02.105753] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-29T19:27:02.748094] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-01. [2025-09-29T19:27:02.884974] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-29T19:27:03.097416] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-29T19:27:03.112391] [INFO ] [REMOTE ] JBL: Full fetch complete (70218 records). [2025-09-29T19:27:03.112568] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-09-29T19:27:03.515489] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-09-29T19:27:03.515575] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-09-29T19:27:03.516710] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-09-29T19:27:03.516782] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-09-29T19:27:03.518466] [DEBUG] [LOCAL ] JBL: Trimmed 70218 records to 48388 (keeping 200 days of data) [2025-09-29T19:27:03.575063] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-09-29T19:27:03.845898] [DEBUG] [LOCAL ] JBL: Primary data saved (48388 records). [2025-09-29T19:27:03.846039] [INFO ] [MAIN ] JBL: Full history saved. [2025-09-29T19:27:03.846136] [INFO ] [MAIN ] Update Progress: 1146/2371 symbols completed. JBL took 38.3s. Estimated remaining: 2h 37m 9s. Rate: 7.8 symbols/min [2025-09-29T19:27:04.027113] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:27:04.085791] [DEBUG] [LOCAL ] JEF: Loaded 50763 existing records from primary storage. [2025-09-29T19:27:04.086166] [INFO ] [MAIN ] JEF: Loaded 50763 existing records. [2025-09-29T19:27:04.278055] [WARN ] [MAIN ] JEF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:27:04.278505] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-09-29T19:27:04.278626] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-09-29T19:27:04.279028] [DEBUG] [LOCAL ] JEF: Deleted primary data file. [2025-09-29T19:27:04.279102] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-09-29T19:27:04.353928] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-09-29T19:27:04.408635] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-29T19:27:04.756727] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-29T19:27:04.803371] [INFO ] [REMOTE ] JEF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:27:05.148225] [INFO ] [REMOTE ] JEF: Fetching primary data for 2024-12. [2025-09-29T19:27:05.523976] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-29T19:27:05.948132] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-09-29T19:27:06.748110] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-09-29T19:27:06.803618] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-29T19:27:07.402868] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-29T19:27:07.548123] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-01. [2025-09-29T19:27:07.650369] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-29T19:27:08.348128] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-09-29T19:27:09.148138] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-09-29T19:27:09.357928] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-29T19:27:09.749729] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-29T19:27:09.948086] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-09-29T19:27:10.180559] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-29T19:27:10.183277] [INFO ] [REMOTE ] JCE: Full fetch complete (9188 records). [2025-09-29T19:27:10.183366] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-09-29T19:27:10.558943] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-09-29T19:27:10.559027] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-09-29T19:27:10.559271] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-09-29T19:27:10.559313] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-09-29T19:27:10.559862] [DEBUG] [LOCAL ] JCE: Trimmed 9188 records to 6576 (keeping 200 days of data) [2025-09-29T19:27:10.602671] [DEBUG] [LOCAL ] JCE: Primary data saved (6576 records). [2025-09-29T19:27:10.602808] [INFO ] [MAIN ] JCE: Full history saved. [2025-09-29T19:27:10.602894] [INFO ] [MAIN ] Update Progress: 1147/2371 symbols completed. JCE took 20.5s. Estimated remaining: 2h 37m 0s. Rate: 7.8 symbols/min [2025-09-29T19:27:10.758437] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-09-29T19:27:10.789133] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:27:10.839621] [DEBUG] [LOCAL ] JELD: Loaded 46791 existing records from primary storage. [2025-09-29T19:27:10.839976] [INFO ] [MAIN ] JELD: Loaded 46791 existing records. [2025-09-29T19:27:11.023062] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:27:11.023311] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-09-29T19:27:11.023372] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-09-29T19:27:11.023746] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-09-29T19:27:11.023806] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-09-29T19:27:11.406297] [INFO ] [REMOTE ] JELD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:27:11.548117] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-09-29T19:27:11.870994] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-29T19:27:12.348105] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-09-29T19:27:12.443043] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-29T19:27:12.609882] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-29T19:27:13.148127] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-09-29T19:27:13.948085] [INFO ] [REMOTE ] JELD: Fetching primary data for 2024-12. [2025-09-29T19:27:14.122809] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-29T19:27:14.270049] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-29T19:27:14.748152] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-09-29T19:27:15.031417] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-29T19:27:15.548147] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-01. [2025-09-29T19:27:16.357069] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-09-29T19:27:16.364086] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-29T19:27:16.908456] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-29T19:27:17.148091] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-09-29T19:27:17.462063] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-29T19:27:17.948132] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-09-29T19:27:18.748122] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-09-29T19:27:18.936447] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-29T19:27:19.004365] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-29T19:27:19.548114] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-09-29T19:27:20.124370] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-29T19:27:20.348137] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-09-29T19:27:20.488351] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-29T19:27:21.148148] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-09-29T19:27:21.860346] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-29T19:27:21.948117] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-09-29T19:27:22.748083] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-09-29T19:27:22.945142] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-29T19:27:23.191226] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-29T19:27:23.548155] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-09-29T19:27:24.348125] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-09-29T19:27:24.413428] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-29T19:27:24.474298] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-29T19:27:25.148121] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-09-29T19:27:25.754682] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-29T19:27:25.948124] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-09-29T19:27:26.748107] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-09-29T19:27:26.869839] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-29T19:27:27.556800] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-09-29T19:27:27.578692] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-29T19:27:28.257716] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-29T19:27:28.264982] [INFO ] [REMOTE ] JBND: Full fetch complete (33848 records). [2025-09-29T19:27:28.265108] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-09-29T19:27:28.353291] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-09-29T19:27:28.666320] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-09-29T19:27:28.666412] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-09-29T19:27:28.667206] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-09-29T19:27:28.667271] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-09-29T19:27:28.668172] [DEBUG] [LOCAL ] JBND: Trimmed 33848 records to 25760 (keeping 200 days of data) [2025-09-29T19:27:28.836574] [DEBUG] [LOCAL ] JBND: Primary data saved (25760 records). [2025-09-29T19:27:28.836740] [INFO ] [MAIN ] JBND: Full history saved. [2025-09-29T19:27:28.836879] [INFO ] [MAIN ] Update Progress: 1148/2371 symbols completed. JBND took 44.8s. Estimated remaining: 2h 37m 4s. Rate: 7.8 symbols/min [2025-09-29T19:27:29.033324] [INFO ] [MAIN ] JEQ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:27:29.044070] [DEBUG] [LOCAL ] JEQ: Loaded 9336 existing records from primary storage. [2025-09-29T19:27:29.044322] [INFO ] [MAIN ] JEQ: Loaded 9336 existing records. [2025-09-29T19:27:29.159989] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-09-29T19:27:29.262114] [WARN ] [MAIN ] JEQ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:27:29.262461] [INFO ] [MAIN ] JEQ: Wiping existing primary data before full refresh. [2025-09-29T19:27:29.262519] [INFO ] [LOCAL ] JEQ: Starting deletion of primary data. [2025-09-29T19:27:29.262753] [DEBUG] [LOCAL ] JEQ: Deleted primary data file. [2025-09-29T19:27:29.262813] [INFO ] [MAIN ] JEQ: Starting full primary refresh. [2025-09-29T19:27:29.671586] [INFO ] [REMOTE ] JEQ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:27:29.705897] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-29T19:27:29.948101] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-09-29T19:27:30.050322] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-29T19:27:30.237019] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-29T19:27:30.748143] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2024-12. [2025-09-29T19:27:31.355448] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-29T19:27:31.548114] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-01. [2025-09-29T19:27:31.829877] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-29T19:27:32.023322] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-29T19:27:32.348129] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-09-29T19:27:33.148116] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-09-29T19:27:33.948103] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-02. [2025-09-29T19:27:34.324383] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-29T19:27:34.336162] [INFO ] [REMOTE ] JCI: Full fetch complete (77412 records). [2025-09-29T19:27:34.336326] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-09-29T19:27:34.756090] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-09-29T19:27:34.763295] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-09-29T19:27:34.765552] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-09-29T19:27:34.766964] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-09-29T19:27:34.769595] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-29T19:27:34.771419] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-09-29T19:27:34.802733] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-29T19:27:34.812561] [DEBUG] [LOCAL ] JCI: Trimmed 77412 records to 53544 (keeping 200 days of data) [2025-09-29T19:27:35.183934] [DEBUG] [LOCAL ] JCI: Primary data saved (53544 records). [2025-09-29T19:27:35.184191] [INFO ] [MAIN ] JCI: Full history saved. [2025-09-29T19:27:35.184293] [INFO ] [MAIN ] Update Progress: 1149/2371 symbols completed. JCI took 35.8s. Estimated remaining: 2h 36m 55s. Rate: 7.8 symbols/min [2025-09-29T19:27:35.358606] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:27:35.389209] [DEBUG] [LOCAL ] JFR: Loaded 30975 existing records from primary storage. [2025-09-29T19:27:35.389565] [INFO ] [MAIN ] JFR: Loaded 30975 existing records. [2025-09-29T19:27:35.549335] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-09-29T19:27:35.580013] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:27:35.580226] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-09-29T19:27:35.580275] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-09-29T19:27:35.580549] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-09-29T19:27:35.580611] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-09-29T19:27:35.964895] [INFO ] [REMOTE ] JFR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:27:36.348137] [INFO ] [REMOTE ] JFR: Fetching primary data for 2024-12. [2025-09-29T19:27:36.752217] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-29T19:27:36.763128] [INFO ] [REMOTE ] JEF: Full fetch complete (72906 records). [2025-09-29T19:27:36.763273] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-09-29T19:27:37.168493] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-03. [2025-09-29T19:27:37.262381] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-09-29T19:27:37.264541] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-09-29T19:27:37.265623] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-09-29T19:27:37.264473] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-29T19:27:37.275746] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-09-29T19:27:37.279322] [DEBUG] [LOCAL ] JEF: Trimmed 72906 records to 49996 (keeping 200 days of data) [2025-09-29T19:27:37.423056] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-29T19:27:37.670170] [DEBUG] [LOCAL ] JEF: Primary data saved (49996 records). [2025-09-29T19:27:37.670323] [INFO ] [MAIN ] JEF: Full history saved. [2025-09-29T19:27:37.670414] [INFO ] [MAIN ] Update Progress: 1150/2371 symbols completed. JEF took 33.8s. Estimated remaining: 2h 36m 41s. Rate: 7.8 symbols/min [2025-09-29T19:27:37.849990] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:27:37.864040] [DEBUG] [LOCAL ] JGH: Loaded 11064 existing records from primary storage. [2025-09-29T19:27:37.864298] [INFO ] [MAIN ] JGH: Loaded 11064 existing records. [2025-09-29T19:27:37.953208] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-09-29T19:27:38.059725] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:27:38.060000] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-09-29T19:27:38.060052] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-09-29T19:27:38.060270] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-09-29T19:27:38.060331] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-09-29T19:27:38.212621] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-29T19:27:38.468750] [INFO ] [REMOTE ] JGH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:27:38.748129] [INFO ] [REMOTE ] JGH: Fetching primary data for 2024-12. [2025-09-29T19:27:39.547544] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-29T19:27:39.549873] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-01. [2025-09-29T19:27:39.945822] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-29T19:27:39.955530] [INFO ] [REMOTE ] JELD: Full fetch complete (63790 records). [2025-09-29T19:27:39.955732] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-09-29T19:27:40.353542] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-01. [2025-09-29T19:27:40.354474] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-09-29T19:27:40.354813] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-09-29T19:27:40.356562] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-09-29T19:27:40.356749] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-09-29T19:27:40.358180] [DEBUG] [LOCAL ] JELD: Trimmed 63790 records to 46097 (keeping 200 days of data) [2025-09-29T19:27:40.631178] [DEBUG] [LOCAL ] JELD: Primary data saved (46097 records). [2025-09-29T19:27:40.631359] [INFO ] [MAIN ] JELD: Full history saved. [2025-09-29T19:27:40.631477] [INFO ] [MAIN ] Update Progress: 1151/2371 symbols completed. JELD took 30.0s. Estimated remaining: 2h 36m 29s. Rate: 7.8 symbols/min [2025-09-29T19:27:40.811798] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:27:40.858025] [DEBUG] [LOCAL ] JHG: Loaded 48497 existing records from primary storage. [2025-09-29T19:27:40.858341] [INFO ] [MAIN ] JHG: Loaded 48497 existing records. [2025-09-29T19:27:41.076450] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-29T19:27:41.080522] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:27:41.089051] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-09-29T19:27:41.089375] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-09-29T19:27:41.090458] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-09-29T19:27:41.090531] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-09-29T19:27:41.165261] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-09-29T19:27:41.183574] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-29T19:27:41.482541] [INFO ] [REMOTE ] JHG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:27:41.948111] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-04. [2025-09-29T19:27:42.697340] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-29T19:27:42.749027] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-09-29T19:27:42.753841] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-29T19:27:43.396389] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-29T19:27:43.548115] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-05. [2025-09-29T19:27:44.337276] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-29T19:27:44.348055] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-06. [2025-09-29T19:27:44.964967] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-29T19:27:45.148104] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-09-29T19:27:45.948111] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-07. [2025-09-29T19:27:46.748216] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-09-29T19:27:46.833839] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-29T19:27:47.114838] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-29T19:27:47.548121] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-08. [2025-09-29T19:27:48.162988] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-29T19:27:48.185503] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-29T19:27:48.348110] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-09. [2025-09-29T19:27:49.148117] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-09-29T19:27:49.175477] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-29T19:27:49.177926] [INFO ] [REMOTE ] JEQ: Full fetch complete (11706 records). [2025-09-29T19:27:49.178007] [DEBUG] [VALIDATOR ] JEQ: Validating primary data. [2025-09-29T19:27:49.557282] [DEBUG] [VALIDATOR ] JEQ: All expected trading days are present. [2025-09-29T19:27:49.557457] [DEBUG] [VALIDATOR ] JEQ: Primary data validation passed. [2025-09-29T19:27:49.557800] [INFO ] [MAIN ] JEQ: Fetched primary data is valid. [2025-09-29T19:27:49.557865] [DEBUG] [LOCAL ] JEQ: Saving primary data. [2025-09-29T19:27:49.558626] [DEBUG] [LOCAL ] JEQ: Trimmed 11706 records to 8974 (keeping 200 days of data) [2025-09-29T19:27:49.618005] [DEBUG] [LOCAL ] JEQ: Primary data saved (8974 records). [2025-09-29T19:27:49.618148] [INFO ] [MAIN ] JEQ: Full history saved. [2025-09-29T19:27:49.618243] [INFO ] [MAIN ] Update Progress: 1152/2371 symbols completed. JEQ took 20.8s. Estimated remaining: 2h 36m 22s. Rate: 7.8 symbols/min [2025-09-29T19:27:49.802587] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:27:49.809389] [DEBUG] [LOCAL ] JHI: Loaded 3641 existing records from primary storage. [2025-09-29T19:27:49.809591] [INFO ] [MAIN ] JHI: Loaded 3641 existing records. [2025-09-29T19:27:49.952931] [INFO ] [REMOTE ] JHG: Fetching primary data for 2024-12. [2025-09-29T19:27:49.996406] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:27:50.005878] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-29T19:27:50.005942] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-09-29T19:27:50.009371] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-09-29T19:27:50.009889] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-09-29T19:27:50.009950] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-09-29T19:27:50.390963] [INFO ] [REMOTE ] JHI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:27:50.748347] [INFO ] [REMOTE ] JHI: Fetching primary data for 2024-12. [2025-09-29T19:27:51.339596] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-29T19:27:51.548115] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-09-29T19:27:51.592368] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-29T19:27:52.311823] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-29T19:27:52.348111] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-01. [2025-09-29T19:27:53.148108] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-09-29T19:27:53.894969] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-29T19:27:53.914611] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-29T19:27:53.948073] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-09-29T19:27:54.748114] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-09-29T19:27:55.443117] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-29T19:27:55.473579] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-29T19:27:55.548145] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-09-29T19:27:56.348114] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-09-29T19:27:56.946512] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-29T19:27:57.148176] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-09-29T19:27:57.472295] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-29T19:27:57.749638] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-29T19:27:57.948161] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-09-29T19:27:58.729567] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-29T19:27:58.748070] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-09-29T19:27:59.539820] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-29T19:27:59.548057] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-09-29T19:28:00.348119] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-09-29T19:28:00.636758] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-29T19:28:00.640172] [INFO ] [REMOTE ] JGH: Full fetch complete (14907 records). [2025-09-29T19:28:00.640249] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-09-29T19:28:01.012967] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-09-29T19:28:01.013044] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-09-29T19:28:01.013411] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-09-29T19:28:01.013473] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-09-29T19:28:01.014006] [DEBUG] [LOCAL ] JGH: Trimmed 14907 records to 10966 (keeping 200 days of data) [2025-09-29T19:28:01.085747] [DEBUG] [LOCAL ] JGH: Primary data saved (10966 records). [2025-09-29T19:28:01.085892] [INFO ] [MAIN ] JGH: Full history saved. [2025-09-29T19:28:01.085977] [INFO ] [MAIN ] Update Progress: 1153/2371 symbols completed. JGH took 23.4s. Estimated remaining: 2h 36m 19s. Rate: 7.8 symbols/min [2025-09-29T19:28:01.153306] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-09-29T19:28:01.264908] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:28:01.270916] [DEBUG] [LOCAL ] JHS: Loaded 2878 existing records from primary storage. [2025-09-29T19:28:01.271116] [INFO ] [MAIN ] JHS: Loaded 2878 existing records. [2025-09-29T19:28:01.465000] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:28:01.465233] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-09-29T19:28:01.465287] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-09-29T19:28:01.465526] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-09-29T19:28:01.465586] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-09-29T19:28:01.853074] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-29T19:28:01.906364] [INFO ] [REMOTE ] JHS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:28:01.948149] [INFO ] [REMOTE ] JHS: Fetching primary data for 2024-12. [2025-09-29T19:28:02.427499] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-29T19:28:02.748106] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-09-29T19:28:02.787954] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-29T19:28:03.548112] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-09-29T19:28:03.599135] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-29T19:28:04.157873] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-29T19:28:04.348113] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-09-29T19:28:05.148109] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-09-29T19:28:05.730099] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-29T19:28:05.948163] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-09-29T19:28:06.011674] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-29T19:28:06.748139] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-09-29T19:28:07.317154] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-29T19:28:07.548134] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-09-29T19:28:07.965183] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-29T19:28:08.348116] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-09-29T19:28:08.697253] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-29T19:28:08.854242] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-29T19:28:09.148151] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-09-29T19:28:09.714026] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-29T19:28:09.948182] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-09-29T19:28:10.401063] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-29T19:28:10.748157] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-09-29T19:28:11.548175] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-09-29T19:28:12.094637] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-29T19:28:12.183114] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-29T19:28:12.190485] [INFO ] [REMOTE ] JFR: Full fetch complete (48251 records). [2025-09-29T19:28:12.190634] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-09-29T19:28:12.354960] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-09-29T19:28:12.608220] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-09-29T19:28:12.608330] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-09-29T19:28:12.609218] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-09-29T19:28:12.609282] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-09-29T19:28:12.610598] [DEBUG] [LOCAL ] JFR: Trimmed 48251 records to 30591 (keeping 200 days of data) [2025-09-29T19:28:12.817158] [DEBUG] [LOCAL ] JFR: Primary data saved (30591 records). [2025-09-29T19:28:12.817342] [INFO ] [MAIN ] JFR: Full history saved. [2025-09-29T19:28:12.817482] [INFO ] [MAIN ] Update Progress: 1154/2371 symbols completed. JFR took 37.6s. Estimated remaining: 2h 36m 15s. Rate: 7.8 symbols/min [2025-09-29T19:28:13.008014] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:28:13.062009] [DEBUG] [LOCAL ] JHX: Loaded 51216 existing records from primary storage. [2025-09-29T19:28:13.062357] [INFO ] [MAIN ] JHX: Loaded 51216 existing records. [2025-09-29T19:28:13.153769] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-09-29T19:28:13.249065] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:28:13.249356] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-09-29T19:28:13.249423] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-09-29T19:28:13.251281] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-09-29T19:28:13.251344] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-09-29T19:28:13.620071] [INFO ] [REMOTE ] JHX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:28:13.673323] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-29T19:28:13.948126] [INFO ] [REMOTE ] JHX: Fetching primary data for 2024-12. [2025-09-29T19:28:14.119381] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-29T19:28:14.533179] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-29T19:28:14.748174] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-01. [2025-09-29T19:28:15.548166] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-09-29T19:28:15.786620] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-29T19:28:15.894414] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-29T19:28:16.348117] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-09-29T19:28:17.148092] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-09-29T19:28:17.169155] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-29T19:28:17.703705] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-29T19:28:17.948129] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-09-29T19:28:18.748116] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-09-29T19:28:19.210602] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-29T19:28:19.308111] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-29T19:28:19.548127] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-09-29T19:28:20.108539] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-29T19:28:20.348134] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-09-29T19:28:20.839205] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-29T19:28:21.148115] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-09-29T19:28:21.610724] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-29T19:28:21.948116] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-09-29T19:28:22.650489] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-29T19:28:22.652173] [INFO ] [REMOTE ] JHI: Full fetch complete (5283 records). [2025-09-29T19:28:22.652247] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-09-29T19:28:22.756770] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-09-29T19:28:23.029050] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-09-29T19:28:23.029134] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-09-29T19:28:23.029310] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-09-29T19:28:23.029352] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-09-29T19:28:23.029972] [DEBUG] [LOCAL ] JHI: Trimmed 5283 records to 3586 (keeping 200 days of data) [2025-09-29T19:28:23.054391] [DEBUG] [LOCAL ] JHI: Primary data saved (3586 records). [2025-09-29T19:28:23.054533] [INFO ] [MAIN ] JHI: Full history saved. [2025-09-29T19:28:23.054619] [INFO ] [MAIN ] Update Progress: 1155/2371 symbols completed. JHI took 33.4s. Estimated remaining: 2h 36m 10s. Rate: 7.8 symbols/min [2025-09-29T19:28:23.226161] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:28:23.248788] [DEBUG] [LOCAL ] JILL: Loaded 16931 existing records from primary storage. [2025-09-29T19:28:23.249033] [INFO ] [MAIN ] JILL: Loaded 16931 existing records. [2025-09-29T19:28:23.360831] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-29T19:28:23.441182] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:28:23.441420] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-09-29T19:28:23.441468] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-09-29T19:28:23.441845] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-09-29T19:28:23.441905] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-09-29T19:28:23.553189] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-09-29T19:28:23.814702] [INFO ] [REMOTE ] JILL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:28:24.255127] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-29T19:28:24.258102] [INFO ] [REMOTE ] JHS: Full fetch complete (4438 records). [2025-09-29T19:28:24.258246] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-09-29T19:28:24.353271] [INFO ] [REMOTE ] JILL: Fetching primary data for 2024-12. [2025-09-29T19:28:24.669908] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-09-29T19:28:24.669993] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-09-29T19:28:24.670144] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-09-29T19:28:24.670187] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-09-29T19:28:24.670617] [DEBUG] [LOCAL ] JHS: Trimmed 4438 records to 2826 (keeping 200 days of data) [2025-09-29T19:28:24.690287] [DEBUG] [LOCAL ] JHS: Primary data saved (2826 records). [2025-09-29T19:28:24.690437] [INFO ] [MAIN ] JHS: Full history saved. [2025-09-29T19:28:24.690524] [INFO ] [MAIN ] Update Progress: 1156/2371 symbols completed. JHS took 23.6s. Estimated remaining: 2h 35m 56s. Rate: 7.8 symbols/min [2025-09-29T19:28:24.869133] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:28:24.925392] [DEBUG] [LOCAL ] JKS: Loaded 40672 existing records from primary storage. [2025-09-29T19:28:24.925727] [INFO ] [MAIN ] JKS: Loaded 40672 existing records. [2025-09-29T19:28:25.110154] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:28:25.110387] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-09-29T19:28:25.110436] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-09-29T19:28:25.110921] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-09-29T19:28:25.110982] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-09-29T19:28:25.153375] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-09-29T19:28:25.448594] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-29T19:28:25.516380] [INFO ] [REMOTE ] JKS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:28:25.948162] [INFO ] [REMOTE ] JKS: Fetching primary data for 2024-12. [2025-09-29T19:28:26.748089] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-09-29T19:28:26.994396] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-29T19:28:27.548122] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-01. [2025-09-29T19:28:27.653748] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-29T19:28:27.936410] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-29T19:28:28.348142] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-09-29T19:28:28.412775] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-29T19:28:29.148121] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-09-29T19:28:29.790692] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-29T19:28:29.948096] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-09-29T19:28:29.960529] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-29T19:28:30.748168] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-09-29T19:28:31.548104] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-09-29T19:28:31.614047] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-29T19:28:31.625532] [INFO ] [REMOTE ] JHG: Full fetch complete (68314 records). [2025-09-29T19:28:31.625733] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-09-29T19:28:32.041330] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-09-29T19:28:32.041489] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-09-29T19:28:32.042577] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-09-29T19:28:32.042672] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-09-29T19:28:32.044265] [DEBUG] [LOCAL ] JHG: Trimmed 68314 records to 47709 (keeping 200 days of data) [2025-09-29T19:28:32.361101] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-09-29T19:28:32.395520] [DEBUG] [LOCAL ] JHG: Primary data saved (47709 records). [2025-09-29T19:28:32.395730] [INFO ] [MAIN ] JHG: Full history saved. [2025-09-29T19:28:32.395889] [INFO ] [MAIN ] Update Progress: 1157/2371 symbols completed. JHG took 51.8s. Estimated remaining: 2h 35m 48s. Rate: 7.8 symbols/min [2025-09-29T19:28:32.466809] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-29T19:28:33.123792] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-29T19:28:33.148117] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-09-29T19:28:33.739391] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-29T19:28:33.948099] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-09-29T19:28:34.748122] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-09-29T19:28:35.012795] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-29T19:28:35.520587] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-29T19:28:35.548089] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-09-29T19:28:35.808256] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-29T19:28:36.348166] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-09-29T19:28:37.148197] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-09-29T19:28:37.292986] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-29T19:28:37.326526] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-29T19:28:37.948149] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-09-29T19:28:38.748130] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-09-29T19:28:39.334219] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-29T19:28:39.373735] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-29T19:28:39.548087] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-09-29T19:28:39.775817] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-29T19:28:40.348119] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-09-29T19:28:41.148142] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-09-29T19:28:41.367683] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-29T19:28:41.897911] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-29T19:28:41.948114] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-09-29T19:28:42.044338] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-29T19:28:42.748139] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-09-29T19:28:43.548133] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-09-29T19:28:43.663955] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-29T19:28:43.852042] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-29T19:28:43.863342] [INFO ] [REMOTE ] JHX: Full fetch complete (57925 records). [2025-09-29T19:28:43.863477] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-09-29T19:28:44.258362] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-09-29T19:28:44.258461] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-09-29T19:28:44.259476] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-09-29T19:28:44.259555] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-09-29T19:28:44.260932] [DEBUG] [LOCAL ] JHX: Trimmed 57925 records to 51295 (keeping 200 days of data) [2025-09-29T19:28:44.352006] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-09-29T19:28:44.596403] [DEBUG] [LOCAL ] JHX: Primary data saved (51295 records). [2025-09-29T19:28:44.596560] [INFO ] [MAIN ] JHX: Full history saved. [2025-09-29T19:28:44.596677] [INFO ] [MAIN ] Update Progress: 1158/2371 symbols completed. JHX took 31.8s. Estimated remaining: 2h 35m 45s. Rate: 7.8 symbols/min [2025-09-29T19:28:45.116589] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-29T19:28:45.148127] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-09-29T19:28:45.574172] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-29T19:28:45.578515] [INFO ] [REMOTE ] JILL: Full fetch complete (22959 records). [2025-09-29T19:28:45.578616] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-09-29T19:28:45.963121] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-09-29T19:28:45.963204] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-09-29T19:28:45.963760] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-09-29T19:28:45.963824] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-09-29T19:28:45.964483] [DEBUG] [LOCAL ] JILL: Trimmed 22959 records to 16701 (keeping 200 days of data) [2025-09-29T19:28:46.078239] [DEBUG] [LOCAL ] JILL: Primary data saved (16701 records). [2025-09-29T19:28:46.078391] [INFO ] [MAIN ] JILL: Full history saved. [2025-09-29T19:28:46.078491] [INFO ] [MAIN ] Update Progress: 1159/2371 symbols completed. JILL took 23.0s. Estimated remaining: 2h 35m 31s. Rate: 7.8 symbols/min [2025-09-29T19:28:46.529965] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-29T19:28:46.538087] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-09-29T19:28:48.256374] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-29T19:28:48.264793] [INFO ] [REMOTE ] JKS: Full fetch complete (59175 records). [2025-09-29T19:28:48.264955] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-09-29T19:28:48.674555] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-09-29T19:28:48.674678] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-09-29T19:28:48.675713] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-09-29T19:28:48.675792] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-09-29T19:28:48.677254] [DEBUG] [LOCAL ] JKS: Trimmed 59175 records to 40106 (keeping 200 days of data) [2025-09-29T19:28:48.939432] [DEBUG] [LOCAL ] JKS: Primary data saved (40106 records). [2025-09-29T19:28:48.939562] [INFO ] [MAIN ] JKS: Full history saved. [2025-09-29T19:28:48.939699] [INFO ] [MAIN ] Update Progress: 1160/2371 symbols completed. JKS took 24.2s. Estimated remaining: 2h 35m 18s. Rate: 7.8 symbols/min [2025-09-29T19:28:49.800479] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:28:49.903244] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:28:49.910914] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:28:49.911510] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-09-29T19:28:49.911580] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-09-29T19:28:49.911735] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-09-29T19:28:49.911795] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-09-29T19:28:49.911847] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-09-29T19:28:49.911886] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-09-29T19:28:49.994126] [DEBUG] [LOCAL ] JLS: Loaded 4142 existing records from primary storage. [2025-09-29T19:28:50.001863] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:28:50.012830] [INFO ] [MAIN ] JLS: Loaded 4142 existing records. [2025-09-29T19:28:50.432167] [DEBUG] [LOCAL ] JLL: Loaded 32458 existing records from primary storage. [2025-09-29T19:28:50.501205] [INFO ] [MAIN ] JLL: Loaded 32458 existing records. [2025-09-29T19:28:50.542276] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:28:50.604615] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-09-29T19:28:50.615067] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-09-29T19:28:50.674167] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-09-29T19:28:50.655107] [DEBUG] [LOCAL ] JMIA: Loaded 51279 existing records from primary storage. [2025-09-29T19:28:50.679638] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-09-29T19:28:50.713006] [INFO ] [MAIN ] JMIA: Loaded 51279 existing records. [2025-09-29T19:28:51.009703] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:28:51.083325] [INFO ] [REMOTE ] JMM: Fetching primary data for 2024-12. [2025-09-29T19:28:51.403445] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:28:51.439848] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-09-29T19:28:51.494111] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-09-29T19:28:51.560041] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-09-29T19:28:51.573129] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-09-29T19:28:51.602291] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:28:51.645086] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-29T19:28:51.655568] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-09-29T19:28:51.690518] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-09-29T19:28:51.690596] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-09-29T19:28:51.748335] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-09-29T19:28:51.770118] [INFO ] [REMOTE ] JLS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:28:51.783578] [INFO ] [REMOTE ] JLS: Fetching primary data for 2024-12. [2025-09-29T19:28:51.792902] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-09-29T19:28:52.164638] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-29T19:28:52.190163] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-09-29T19:28:52.478243] [INFO ] [REMOTE ] JLL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:28:52.506143] [INFO ] [REMOTE ] JLL: Fetching primary data for 2024-12. [2025-09-29T19:28:52.513514] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-29T19:28:52.546603] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-01. [2025-09-29T19:28:52.544094] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:28:52.548212] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2024-12. [2025-09-29T19:28:52.696749] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-29T19:28:52.697955] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-09-29T19:28:53.036181] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-29T19:28:53.046483] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-29T19:28:53.148107] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-09-29T19:28:53.767737] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-29T19:28:53.769508] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-29T19:28:53.948122] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-09-29T19:28:54.264738] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-29T19:28:54.492225] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-29T19:28:54.748145] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-09-29T19:28:55.353347] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-29T19:28:55.548117] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-09-29T19:28:56.188211] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-29T19:28:56.348149] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-01. [2025-09-29T19:28:57.148169] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-01. [2025-09-29T19:28:57.563319] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-29T19:28:57.948132] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-09-29T19:28:58.386406] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-29T19:28:58.748282] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-09-29T19:28:58.905728] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-29T19:28:59.377392] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-29T19:28:59.548135] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-09-29T19:29:00.016246] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-29T19:29:00.348112] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-09-29T19:29:00.965027] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-29T19:29:01.148110] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-09-29T19:29:01.948155] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-09-29T19:29:02.524079] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-29T19:29:02.748108] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-09-29T19:29:03.001779] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-29T19:29:03.548128] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-09-29T19:29:03.730901] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-29T19:29:04.012192] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-29T19:29:04.348139] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-09-29T19:29:05.148148] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-09-29T19:29:05.627044] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-29T19:29:05.707585] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-29T19:29:05.948112] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-09-29T19:29:06.748150] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-09-29T19:29:07.338233] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-29T19:29:07.339794] [INFO ] [REMOTE ] JLS: Full fetch complete (5826 records). [2025-09-29T19:29:07.339896] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-09-29T19:29:07.553015] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-09-29T19:29:07.751365] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-09-29T19:29:07.751600] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-09-29T19:29:07.751938] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-09-29T19:29:07.752088] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-09-29T19:29:07.753044] [DEBUG] [LOCAL ] JLS: Trimmed 5826 records to 4105 (keeping 200 days of data) [2025-09-29T19:29:07.805636] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-29T19:29:07.826002] [DEBUG] [LOCAL ] JLS: Primary data saved (4105 records). [2025-09-29T19:29:07.826170] [INFO ] [MAIN ] JLS: Full history saved. [2025-09-29T19:29:07.826267] [INFO ] [MAIN ] Update Progress: 1161/2371 symbols completed. JLS took 18.9s. Estimated remaining: 2h 35m 22s. Rate: 7.8 symbols/min [2025-09-29T19:29:08.027315] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:29:08.088014] [DEBUG] [LOCAL ] JNJ: Loaded 54533 existing records from primary storage. [2025-09-29T19:29:08.088398] [INFO ] [MAIN ] JNJ: Loaded 54533 existing records. [2025-09-29T19:29:08.299057] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:29:08.299294] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-09-29T19:29:08.299343] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-09-29T19:29:08.299596] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-09-29T19:29:08.299687] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-09-29T19:29:08.354848] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-09-29T19:29:08.672947] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:29:08.872562] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-29T19:29:09.148115] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2024-12. [2025-09-29T19:29:09.193788] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-29T19:29:09.948141] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-09-29T19:29:10.748124] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-09-29T19:29:11.429564] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-09-29T19:29:11.548172] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-09-29T19:29:11.692683] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-29T19:29:12.047526] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-29T19:29:12.048492] [INFO ] [REMOTE ] JMM: Full fetch complete (2291 records). [2025-09-29T19:29:12.048565] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-09-29T19:29:12.233841] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-29T19:29:12.266663] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-09-29T19:29:12.274027] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-09-29T19:29:12.274495] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-09-29T19:29:12.274590] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-09-29T19:29:12.274708] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-09-29T19:29:12.274762] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-09-29T19:29:12.274824] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-09-29T19:29:12.274908] [INFO ] [MAIN ] Update Progress: 1162/2371 symbols completed. JMM took 23.3s. Estimated remaining: 2h 35m 11s. Rate: 7.8 symbols/min [2025-09-29T19:29:12.353338] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-09-29T19:29:12.454861] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:29:12.510254] [DEBUG] [LOCAL ] JOBY: Loaded 54579 existing records from primary storage. [2025-09-29T19:29:12.510617] [INFO ] [MAIN ] JOBY: Loaded 54579 existing records. [2025-09-29T19:29:12.731740] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:29:12.731965] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-09-29T19:29:12.732017] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-09-29T19:29:12.732389] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-09-29T19:29:12.732447] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-09-29T19:29:13.100778] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:29:13.148084] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2024-12. [2025-09-29T19:29:13.707170] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-29T19:29:13.948126] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-09-29T19:29:14.748137] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-09-29T19:29:15.548201] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-01. [2025-09-29T19:29:15.772446] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2024-12 (2.62 seconds). [2025-09-29T19:29:15.820526] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-29T19:29:16.115553] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-29T19:29:16.348135] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-09-29T19:29:17.148142] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-01. [2025-09-29T19:29:17.678430] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-29T19:29:17.945377] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-01 (2.40 seconds). [2025-09-29T19:29:17.955398] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-09-29T19:29:18.748135] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-09-29T19:29:19.475231] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-09-29T19:29:19.475954] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-29T19:29:19.495218] [INFO ] [REMOTE ] JLL: Full fetch complete (44817 records). [2025-09-29T19:29:19.495388] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-09-29T19:29:19.554753] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-09-29T19:29:19.898031] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-09-29T19:29:19.898116] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-09-29T19:29:19.898931] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-09-29T19:29:19.899009] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-09-29T19:29:19.900012] [DEBUG] [LOCAL ] JLL: Trimmed 44817 records to 31761 (keeping 200 days of data) [2025-09-29T19:29:20.113618] [DEBUG] [LOCAL ] JLL: Primary data saved (31761 records). [2025-09-29T19:29:20.113804] [INFO ] [MAIN ] JLL: Full history saved. [2025-09-29T19:29:20.113913] [INFO ] [MAIN ] Update Progress: 1163/2371 symbols completed. JLL took 31.2s. Estimated remaining: 2h 35m 4s. Rate: 7.8 symbols/min [2025-09-29T19:29:20.291325] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:29:20.315774] [DEBUG] [LOCAL ] JOE: Loaded 24860 existing records from primary storage. [2025-09-29T19:29:20.316157] [INFO ] [MAIN ] JOE: Loaded 24860 existing records. [2025-09-29T19:29:20.348428] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-09-29T19:29:20.516827] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:29:20.537805] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-09-29T19:29:20.538098] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-09-29T19:29:20.540294] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-29T19:29:20.540375] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-09-29T19:29:20.550870] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-09-29T19:29:20.931514] [INFO ] [REMOTE ] JOE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:29:21.148162] [INFO ] [REMOTE ] JOE: Fetching primary data for 2024-12. [2025-09-29T19:29:21.948136] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-09-29T19:29:22.030629] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-09-29T19:29:22.312683] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-29T19:29:22.584834] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-09-29T19:29:22.748135] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-09-29T19:29:23.548135] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-01. [2025-09-29T19:29:23.706815] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-29T19:29:24.348141] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-09-29T19:29:24.866374] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-29T19:29:25.122305] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-09-29T19:29:25.148170] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-09-29T19:29:25.948147] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-09-29T19:29:26.345638] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-29T19:29:26.748126] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-09-29T19:29:27.000753] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-29T19:29:27.437626] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-29T19:29:27.548146] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-09-29T19:29:28.348103] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-09-29T19:29:28.552995] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-29T19:29:28.564460] [INFO ] [REMOTE ] JMIA: Full fetch complete (73256 records). [2025-09-29T19:29:28.564613] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-09-29T19:29:28.972254] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-09-29T19:29:28.972339] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-09-29T19:29:28.973377] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-09-29T19:29:28.973442] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-09-29T19:29:28.974987] [DEBUG] [LOCAL ] JMIA: Trimmed 73256 records to 50591 (keeping 200 days of data) [2025-09-29T19:29:29.149717] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-09-29T19:29:29.283637] [DEBUG] [LOCAL ] JMIA: Primary data saved (50591 records). [2025-09-29T19:29:29.283847] [INFO ] [MAIN ] JMIA: Full history saved. [2025-09-29T19:29:29.283940] [INFO ] [MAIN ] Update Progress: 1164/2371 symbols completed. JMIA took 40.3s. Estimated remaining: 2h 34m 58s. Rate: 7.8 symbols/min [2025-09-29T19:29:29.460773] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:29:29.471718] [DEBUG] [LOCAL ] JOF: Loaded 7177 existing records from primary storage. [2025-09-29T19:29:29.472074] [INFO ] [MAIN ] JOF: Loaded 7177 existing records. [2025-09-29T19:29:29.665906] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:29:29.666249] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-09-29T19:29:29.666306] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-09-29T19:29:29.672578] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-09-29T19:29:29.682598] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-09-29T19:29:29.755980] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-29T19:29:29.955078] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-09-29T19:29:30.084775] [INFO ] [REMOTE ] JOF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:29:30.122300] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (2.57 seconds). [2025-09-29T19:29:30.748103] [INFO ] [REMOTE ] JOF: Fetching primary data for 2024-12. [2025-09-29T19:29:31.342237] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-29T19:29:31.398271] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-29T19:29:31.447346] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-29T19:29:31.548164] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-09-29T19:29:32.348138] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-01. [2025-09-29T19:29:32.761300] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-29T19:29:32.994346] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-29T19:29:33.148111] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-09-29T19:29:33.948151] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-09-29T19:29:34.526318] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-29T19:29:34.748114] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-09-29T19:29:35.439949] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-29T19:29:35.513939] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-29T19:29:35.548076] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-09-29T19:29:36.348135] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-09-29T19:29:37.142741] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-29T19:29:37.148059] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-09-29T19:29:37.742833] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-29T19:29:37.948117] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-09-29T19:29:38.073375] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (2.53 seconds). [2025-09-29T19:29:38.590905] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-29T19:29:38.748110] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-09-29T19:29:39.548122] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-09-29T19:29:39.868418] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-29T19:29:40.348104] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-09-29T19:29:41.148117] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-09-29T19:29:41.513883] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-29T19:29:41.920829] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-29T19:29:41.948127] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-09-29T19:29:42.048974] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-09-29T19:29:42.748172] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-09-29T19:29:43.119748] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-29T19:29:43.206482] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-29T19:29:43.548115] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-09-29T19:29:44.348137] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-09-29T19:29:45.148143] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-09-29T19:29:45.791105] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-29T19:29:45.948113] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-09-29T19:29:46.045142] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-29T19:29:46.047527] [INFO ] [REMOTE ] JOF: Full fetch complete (9536 records). [2025-09-29T19:29:46.047692] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-09-29T19:29:46.454785] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-09-29T19:29:46.454880] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-09-29T19:29:46.455142] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-09-29T19:29:46.455210] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-09-29T19:29:46.455829] [DEBUG] [LOCAL ] JOF: Trimmed 9536 records to 7056 (keeping 200 days of data) [2025-09-29T19:29:46.500776] [DEBUG] [LOCAL ] JOF: Primary data saved (7056 records). [2025-09-29T19:29:46.500987] [INFO ] [MAIN ] JOF: Full history saved. [2025-09-29T19:29:46.501209] [INFO ] [MAIN ] Update Progress: 1165/2371 symbols completed. JOF took 17.2s. Estimated remaining: 2h 34m 60s. Rate: 7.8 symbols/min [2025-09-29T19:29:46.690060] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:29:46.728995] [DEBUG] [LOCAL ] JPC: Loaded 37620 existing records from primary storage. [2025-09-29T19:29:46.729310] [INFO ] [MAIN ] JPC: Loaded 37620 existing records. [2025-09-29T19:29:46.760970] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-09-29T19:29:46.924997] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:29:46.925419] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-09-29T19:29:46.925508] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-09-29T19:29:46.926139] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-09-29T19:29:46.926203] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-09-29T19:29:47.124680] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.78 seconds). [2025-09-29T19:29:47.362986] [INFO ] [REMOTE ] JPC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:29:47.548106] [INFO ] [REMOTE ] JPC: Fetching primary data for 2024-12. [2025-09-29T19:29:48.132853] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-29T19:29:48.277922] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-29T19:29:48.283200] [INFO ] [REMOTE ] JOE: Full fetch complete (36145 records). [2025-09-29T19:29:48.283325] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-09-29T19:29:48.353232] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-09-29T19:29:48.683172] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-09-29T19:29:48.683280] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-09-29T19:29:48.684023] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-09-29T19:29:48.684087] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-09-29T19:29:48.685070] [DEBUG] [LOCAL ] JOE: Trimmed 36145 records to 24232 (keeping 200 days of data) [2025-09-29T19:29:48.840601] [DEBUG] [LOCAL ] JOE: Primary data saved (24232 records). [2025-09-29T19:29:48.840762] [INFO ] [MAIN ] JOE: Full history saved. [2025-09-29T19:29:48.840872] [INFO ] [MAIN ] Update Progress: 1166/2371 symbols completed. JOE took 28.7s. Estimated remaining: 2h 34m 46s. Rate: 7.8 symbols/min [2025-09-29T19:29:49.019273] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:29:49.083593] [DEBUG] [LOCAL ] JPM: Loaded 54574 existing records from primary storage. [2025-09-29T19:29:49.084084] [INFO ] [MAIN ] JPM: Loaded 54574 existing records. [2025-09-29T19:29:49.158478] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-09-29T19:29:49.240499] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-29T19:29:49.323001] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:29:49.323249] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-09-29T19:29:49.323297] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-09-29T19:29:49.323812] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-09-29T19:29:49.323872] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-09-29T19:29:49.739796] [INFO ] [REMOTE ] JPM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:29:49.948112] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-01. [2025-09-29T19:29:50.748147] [INFO ] [REMOTE ] JPM: Fetching primary data for 2024-12. [2025-09-29T19:29:50.820119] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-09-29T19:29:51.361427] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-29T19:29:51.548119] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-09-29T19:29:52.270217] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (3.11 seconds). [2025-09-29T19:29:52.281735] [INFO ] [REMOTE ] JOBY: Full fetch complete (77971 records). [2025-09-29T19:29:52.281887] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-09-29T19:29:52.355700] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-09-29T19:29:52.727840] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-09-29T19:29:52.727996] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-09-29T19:29:52.729391] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-09-29T19:29:52.729630] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-09-29T19:29:52.731814] [DEBUG] [LOCAL ] JOBY: Trimmed 77971 records to 53799 (keeping 200 days of data) [2025-09-29T19:29:52.852837] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-29T19:29:53.116287] [DEBUG] [LOCAL ] JOBY: Primary data saved (53799 records). [2025-09-29T19:29:53.116432] [INFO ] [MAIN ] JOBY: Full history saved. [2025-09-29T19:29:53.116517] [INFO ] [MAIN ] Update Progress: 1167/2371 symbols completed. JOBY took 40.8s. Estimated remaining: 2h 34m 35s. Rate: 7.8 symbols/min [2025-09-29T19:29:53.148961] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-01. [2025-09-29T19:29:53.301098] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:29:53.337815] [DEBUG] [LOCAL ] JQC: Loaded 34194 existing records from primary storage. [2025-09-29T19:29:53.338107] [INFO ] [MAIN ] JQC: Loaded 34194 existing records. [2025-09-29T19:29:53.554011] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:29:53.554544] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-09-29T19:29:53.554621] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-09-29T19:29:53.555212] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-09-29T19:29:53.555275] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-09-29T19:29:53.925096] [INFO ] [REMOTE ] JQC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:29:53.948105] [INFO ] [REMOTE ] JQC: Fetching primary data for 2024-12. [2025-09-29T19:29:54.925823] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (2.57 seconds). [2025-09-29T19:29:54.933949] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-09-29T19:29:55.026341] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (3.48 seconds). [2025-09-29T19:29:55.146449] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-29T19:29:55.305028] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-09-29T19:29:55.548128] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-09-29T19:29:56.348202] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-01. [2025-09-29T19:29:56.491809] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-29T19:29:57.148154] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-09-29T19:29:57.751937] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-29T19:29:57.857605] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-29T19:29:57.873463] [INFO ] [REMOTE ] JNJ: Full fetch complete (77855 records). [2025-09-29T19:29:57.873758] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-09-29T19:29:57.956281] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-09-29T19:29:58.290856] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-09-29T19:29:58.290951] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-09-29T19:29:58.292280] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-09-29T19:29:58.292378] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-09-29T19:29:58.293970] [DEBUG] [LOCAL ] JNJ: Trimmed 77855 records to 53753 (keeping 200 days of data) [2025-09-29T19:29:58.656955] [DEBUG] [LOCAL ] JNJ: Primary data saved (53753 records). [2025-09-29T19:29:58.657143] [INFO ] [MAIN ] JNJ: Full history saved. [2025-09-29T19:29:58.657249] [INFO ] [MAIN ] Update Progress: 1168/2371 symbols completed. JNJ took 50.8s. Estimated remaining: 2h 34m 25s. Rate: 7.8 symbols/min [2025-09-29T19:29:58.751567] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-09-29T19:29:58.862148] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:29:58.873615] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-29T19:29:58.897814] [DEBUG] [LOCAL ] JRI: Loaded 15068 existing records from primary storage. [2025-09-29T19:29:58.898111] [INFO ] [MAIN ] JRI: Loaded 15068 existing records. [2025-09-29T19:29:59.089343] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:29:59.089692] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-09-29T19:29:59.089780] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-09-29T19:29:59.090201] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-09-29T19:29:59.090262] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-09-29T19:29:59.456005] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-29T19:29:59.546343] [INFO ] [REMOTE ] JRI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:29:59.548074] [INFO ] [REMOTE ] JRI: Fetching primary data for 2024-12. [2025-09-29T19:30:00.348131] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-09-29T19:30:00.493002] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-29T19:30:00.939605] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-29T19:30:01.148160] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-01. [2025-09-29T19:30:01.758793] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-29T19:30:01.948137] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-09-29T19:30:02.228825] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-29T19:30:02.748156] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-09-29T19:30:03.548132] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-09-29T19:30:03.819476] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-29T19:30:04.348143] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-09-29T19:30:04.527068] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-09-29T19:30:05.153939] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-09-29T19:30:05.174523] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-29T19:30:05.259488] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-29T19:30:05.948120] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-09-29T19:30:06.748175] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-09-29T19:30:07.370169] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-29T19:30:07.548160] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-09-29T19:30:07.702511] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-09-29T19:30:08.240303] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-29T19:30:08.348081] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-09-29T19:30:08.502596] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-29T19:30:09.148229] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-09-29T19:30:09.948113] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-09-29T19:30:10.129730] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-29T19:30:10.686521] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-09-29T19:30:10.748103] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-09-29T19:30:11.456317] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-29T19:30:11.548168] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-09-29T19:30:11.897371] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-29T19:30:12.348122] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-09-29T19:30:12.976910] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-29T19:30:13.108328] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-29T19:30:13.148152] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-09-29T19:30:13.948097] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-09-29T19:30:14.088104] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-29T19:30:14.748119] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-09-29T19:30:15.548128] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-09-29T19:30:16.288107] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-09-29T19:30:16.349519] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-09-29T19:30:16.354592] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-29T19:30:16.363749] [INFO ] [REMOTE ] JPC: Full fetch complete (55727 records). [2025-09-29T19:30:16.364024] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-09-29T19:30:16.502562] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-29T19:30:16.787086] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-09-29T19:30:16.787173] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-09-29T19:30:16.788188] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-09-29T19:30:16.788254] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-09-29T19:30:16.789427] [DEBUG] [LOCAL ] JPC: Trimmed 55727 records to 37088 (keeping 200 days of data) [2025-09-29T19:30:17.013497] [DEBUG] [LOCAL ] JPC: Primary data saved (37088 records). [2025-09-29T19:30:17.013673] [INFO ] [MAIN ] JPC: Full history saved. [2025-09-29T19:30:17.013805] [INFO ] [MAIN ] Update Progress: 1169/2371 symbols completed. JPC took 30.5s. Estimated remaining: 2h 34m 29s. Rate: 7.8 symbols/min [2025-09-29T19:30:17.163305] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-09-29T19:30:17.196602] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:30:17.210133] [DEBUG] [LOCAL ] JRS: Loaded 11250 existing records from primary storage. [2025-09-29T19:30:17.210380] [INFO ] [MAIN ] JRS: Loaded 11250 existing records. [2025-09-29T19:30:17.393530] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:30:17.393872] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-09-29T19:30:17.395153] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-09-29T19:30:17.395374] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-09-29T19:30:17.395433] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-09-29T19:30:17.770218] [INFO ] [REMOTE ] JRS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:30:17.948147] [INFO ] [REMOTE ] JRS: Fetching primary data for 2024-12. [2025-09-29T19:30:18.082306] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-29T19:30:18.748161] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-09-29T19:30:18.773199] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-29T19:30:18.984992] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (2.64 seconds). [2025-09-29T19:30:19.548132] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-09-29T19:30:20.249397] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-29T19:30:20.348102] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-09-29T19:30:20.746510] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-29T19:30:20.751112] [INFO ] [REMOTE ] JRI: Full fetch complete (23145 records). [2025-09-29T19:30:20.751230] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-09-29T19:30:21.142100] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-09-29T19:30:21.142195] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-09-29T19:30:21.142797] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-09-29T19:30:21.142862] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-09-29T19:30:21.143586] [DEBUG] [LOCAL ] JRI: Trimmed 23145 records to 14768 (keeping 200 days of data) [2025-09-29T19:30:21.148131] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-09-29T19:30:21.233342] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-29T19:30:21.260913] [DEBUG] [LOCAL ] JRI: Primary data saved (14768 records). [2025-09-29T19:30:21.261095] [INFO ] [MAIN ] JRI: Full history saved. [2025-09-29T19:30:21.261262] [INFO ] [MAIN ] Update Progress: 1170/2371 symbols completed. JRI took 22.6s. Estimated remaining: 2h 34m 17s. Rate: 7.8 symbols/min [2025-09-29T19:30:21.446395] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:30:21.498957] [DEBUG] [LOCAL ] JXN: Loaded 46558 existing records from primary storage. [2025-09-29T19:30:21.499325] [INFO ] [MAIN ] JXN: Loaded 46558 existing records. [2025-09-29T19:30:21.701890] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:30:21.702135] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-09-29T19:30:21.702185] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-09-29T19:30:21.702846] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-09-29T19:30:21.702917] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-09-29T19:30:21.953305] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-09-29T19:30:22.098516] [INFO ] [REMOTE ] JXN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:30:22.632369] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-29T19:30:22.748085] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-09-29T19:30:23.548131] [INFO ] [REMOTE ] JXN: Fetching primary data for 2024-12. [2025-09-29T19:30:23.757542] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-29T19:30:23.764664] [INFO ] [REMOTE ] JQC: Full fetch complete (48848 records). [2025-09-29T19:30:23.764780] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-09-29T19:30:24.184496] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-09-29T19:30:24.184797] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-09-29T19:30:24.185762] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-09-29T19:30:24.185909] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-09-29T19:30:24.187075] [DEBUG] [LOCAL ] JQC: Trimmed 48848 records to 33913 (keeping 200 days of data) [2025-09-29T19:30:24.356252] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-09-29T19:30:24.423783] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-09-29T19:30:24.456570] [DEBUG] [LOCAL ] JQC: Primary data saved (33913 records). [2025-09-29T19:30:24.456768] [INFO ] [MAIN ] JQC: Full history saved. [2025-09-29T19:30:24.456883] [INFO ] [MAIN ] Update Progress: 1171/2371 symbols completed. JQC took 31.3s. Estimated remaining: 2h 34m 5s. Rate: 7.8 symbols/min [2025-09-29T19:30:24.652012] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:30:24.703665] [DEBUG] [LOCAL ] K: Loaded 50637 existing records from primary storage. [2025-09-29T19:30:24.703982] [INFO ] [MAIN ] K: Loaded 50637 existing records. [2025-09-29T19:30:24.886320] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:30:24.886678] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-09-29T19:30:24.886741] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-09-29T19:30:24.886989] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-09-29T19:30:24.887067] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-09-29T19:30:25.170703] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-09-29T19:30:25.299378] [INFO ] [REMOTE ] K: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:30:25.299914] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-29T19:30:25.327284] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-29T19:30:25.948128] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-09-29T19:30:26.748108] [INFO ] [REMOTE ] K: Fetching primary data for 2024-12. [2025-09-29T19:30:26.809201] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-29T19:30:27.548136] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-01. [2025-09-29T19:30:27.677773] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (2.51 seconds). [2025-09-29T19:30:27.689728] [INFO ] [REMOTE ] JPM: Full fetch complete (77892 records). [2025-09-29T19:30:27.689928] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-09-29T19:30:28.133059] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-09-29T19:30:28.133152] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-09-29T19:30:28.134343] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-09-29T19:30:28.134419] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-09-29T19:30:28.136181] [DEBUG] [LOCAL ] JPM: Trimmed 77892 records to 53794 (keeping 200 days of data) [2025-09-29T19:30:28.349350] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-09-29T19:30:28.521732] [INFO ] [REMOTE ] K: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-29T19:30:28.556378] [DEBUG] [LOCAL ] JPM: Primary data saved (53794 records). [2025-09-29T19:30:28.556549] [INFO ] [MAIN ] JPM: Full history saved. [2025-09-29T19:30:28.556705] [INFO ] [MAIN ] Update Progress: 1172/2371 symbols completed. JPM took 39.7s. Estimated remaining: 2h 33m 54s. Rate: 7.8 symbols/min [2025-09-29T19:30:28.735421] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:30:28.755321] [DEBUG] [LOCAL ] KAI: Loaded 13729 existing records from primary storage. [2025-09-29T19:30:28.755574] [INFO ] [MAIN ] KAI: Loaded 13729 existing records. [2025-09-29T19:30:28.954115] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:30:28.961828] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-09-29T19:30:28.962823] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-09-29T19:30:28.963117] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-29T19:30:28.965968] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-09-29T19:30:28.966951] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-09-29T19:30:29.166711] [INFO ] [REMOTE ] K: Fetching primary data for 2025-01. [2025-09-29T19:30:29.237450] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-29T19:30:29.389055] [INFO ] [REMOTE ] KAI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:30:29.948114] [INFO ] [REMOTE ] KAI: Fetching primary data for 2024-12. [2025-09-29T19:30:30.692867] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-29T19:30:30.748107] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-09-29T19:30:30.828316] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-29T19:30:31.548151] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-09-29T19:30:31.599335] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-29T19:30:32.348130] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-09-29T19:30:33.111320] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-29T19:30:33.148110] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-09-29T19:30:33.321260] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-29T19:30:33.948152] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-09-29T19:30:34.748087] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-09-29T19:30:34.941963] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-29T19:30:35.549982] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-09-29T19:30:35.549526] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-29T19:30:35.562341] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-29T19:30:36.348113] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-09-29T19:30:36.507219] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-29T19:30:37.148129] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-09-29T19:30:37.948106] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-09-29T19:30:38.007253] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-29T19:30:38.063688] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-29T19:30:38.748114] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-09-29T19:30:39.062023] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-29T19:30:39.548120] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-09-29T19:30:40.348126] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-09-29T19:30:40.523544] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-29T19:30:40.558720] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-29T19:30:41.148105] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-09-29T19:30:41.305296] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-29T19:30:41.948125] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-09-29T19:30:42.748094] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-09-29T19:30:42.940679] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-29T19:30:42.962735] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-29T19:30:43.548134] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-09-29T19:30:44.348084] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-09-29T19:30:44.526357] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-29T19:30:44.603441] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-29T19:30:45.148109] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-09-29T19:30:45.956864] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-09-29T19:30:45.975358] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-29T19:30:46.748098] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-09-29T19:30:46.892611] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-29T19:30:46.929141] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-29T19:30:47.548129] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-09-29T19:30:48.251024] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-29T19:30:48.348085] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-09-29T19:30:48.505699] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-29T19:30:48.510252] [INFO ] [REMOTE ] JRS: Full fetch complete (16197 records). [2025-09-29T19:30:48.510349] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-09-29T19:30:48.912853] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-09-29T19:30:48.913070] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-09-29T19:30:48.913503] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-09-29T19:30:48.913581] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-09-29T19:30:48.914256] [DEBUG] [LOCAL ] JRS: Trimmed 16197 records to 11178 (keeping 200 days of data) [2025-09-29T19:30:48.974305] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-29T19:30:49.000560] [DEBUG] [LOCAL ] JRS: Primary data saved (11178 records). [2025-09-29T19:30:49.000722] [INFO ] [MAIN ] JRS: Full history saved. [2025-09-29T19:30:49.000818] [INFO ] [MAIN ] Update Progress: 1173/2371 symbols completed. JRS took 32.0s. Estimated remaining: 2h 33m 59s. Rate: 7.8 symbols/min [2025-09-29T19:30:49.153678] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-09-29T19:30:49.182189] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:30:49.228476] [DEBUG] [LOCAL ] KAR: Loaded 40411 existing records from primary storage. [2025-09-29T19:30:49.228848] [INFO ] [MAIN ] KAR: Loaded 40411 existing records. [2025-09-29T19:30:49.413010] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:30:49.413234] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-09-29T19:30:49.413306] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-09-29T19:30:49.413671] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-09-29T19:30:49.413747] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-09-29T19:30:49.799217] [INFO ] [REMOTE ] KAR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:30:49.948077] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-09-29T19:30:50.096236] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-29T19:30:50.099379] [INFO ] [REMOTE ] KAI: Full fetch complete (18875 records). [2025-09-29T19:30:50.099463] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-09-29T19:30:50.512799] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-09-29T19:30:50.512905] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-09-29T19:30:50.513360] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-09-29T19:30:50.513405] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-09-29T19:30:50.514026] [DEBUG] [LOCAL ] KAI: Trimmed 18875 records to 13338 (keeping 200 days of data) [2025-09-29T19:30:50.604041] [DEBUG] [LOCAL ] KAI: Primary data saved (13338 records). [2025-09-29T19:30:50.604251] [INFO ] [MAIN ] KAI: Full history saved. [2025-09-29T19:30:50.604359] [INFO ] [MAIN ] Update Progress: 1174/2371 symbols completed. KAI took 22.0s. Estimated remaining: 2h 33m 45s. Rate: 7.8 symbols/min [2025-09-29T19:30:50.757465] [INFO ] [REMOTE ] KAR: Fetching primary data for 2024-12. [2025-09-29T19:30:50.796317] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:30:50.824618] [DEBUG] [LOCAL ] KB: Loaded 24453 existing records from primary storage. [2025-09-29T19:30:50.824926] [INFO ] [MAIN ] KB: Loaded 24453 existing records. [2025-09-29T19:30:51.012975] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:30:51.013415] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-09-29T19:30:51.013515] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-09-29T19:30:51.014251] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-09-29T19:30:51.014333] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-09-29T19:30:51.410634] [INFO ] [REMOTE ] KB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:30:51.542910] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-29T19:30:51.552506] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-09-29T19:30:52.353409] [INFO ] [REMOTE ] KB: Fetching primary data for 2024-12. [2025-09-29T19:30:52.373899] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-29T19:30:52.833846] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-29T19:30:53.148165] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-01. [2025-09-29T19:30:53.642018] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-29T19:30:53.948141] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-09-29T19:30:54.452498] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-29T19:30:54.748180] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-09-29T19:30:55.548100] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-09-29T19:30:55.712277] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-29T19:30:55.748593] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-29T19:30:56.348242] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-09-29T19:30:57.148083] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-01. [2025-09-29T19:30:57.257635] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-29T19:30:57.267110] [INFO ] [REMOTE ] JXN: Full fetch complete (65337 records). [2025-09-29T19:30:57.267280] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-09-29T19:30:57.672351] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-09-29T19:30:57.672610] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-09-29T19:30:57.673821] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-09-29T19:30:57.673947] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-09-29T19:30:57.675345] [DEBUG] [LOCAL ] JXN: Trimmed 65337 records to 45731 (keeping 200 days of data) [2025-09-29T19:30:57.822949] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-29T19:30:57.948184] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-09-29T19:30:58.017706] [DEBUG] [LOCAL ] JXN: Primary data saved (45731 records). [2025-09-29T19:30:58.017916] [INFO ] [MAIN ] JXN: Full history saved. [2025-09-29T19:30:58.018100] [INFO ] [MAIN ] Update Progress: 1175/2371 symbols completed. JXN took 36.8s. Estimated remaining: 2h 33m 37s. Rate: 7.8 symbols/min [2025-09-29T19:30:58.205548] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:30:58.230279] [DEBUG] [LOCAL ] KBDC: Loaded 21252 existing records from primary storage. [2025-09-29T19:30:58.230552] [INFO ] [MAIN ] KBDC: Loaded 21252 existing records. [2025-09-29T19:30:58.379192] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-29T19:30:58.450619] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:30:58.450860] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-09-29T19:30:58.450924] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-09-29T19:30:58.451274] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-09-29T19:30:58.451334] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-09-29T19:30:58.751565] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-09-29T19:30:58.837822] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:30:59.548187] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2024-12. [2025-09-29T19:30:59.964300] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-29T19:30:59.975770] [INFO ] [REMOTE ] K: Full fetch complete (72008 records). [2025-09-29T19:30:59.981095] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-09-29T19:30:59.989963] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-29T19:31:00.357847] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-09-29T19:31:00.419986] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-09-29T19:31:00.420183] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-09-29T19:31:00.421309] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-09-29T19:31:00.421376] [DEBUG] [LOCAL ] K: Saving primary data. [2025-09-29T19:31:00.423050] [DEBUG] [LOCAL ] K: Trimmed 72008 records to 49924 (keeping 200 days of data) [2025-09-29T19:31:00.528582] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-29T19:31:00.780070] [DEBUG] [LOCAL ] K: Primary data saved (49924 records). [2025-09-29T19:31:00.780245] [INFO ] [MAIN ] K: Full history saved. [2025-09-29T19:31:00.780383] [INFO ] [MAIN ] Update Progress: 1176/2371 symbols completed. K took 36.3s. Estimated remaining: 2h 33m 24s. Rate: 7.8 symbols/min [2025-09-29T19:31:01.000294] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:31:01.048894] [DEBUG] [LOCAL ] KBH: Loaded 49678 existing records from primary storage. [2025-09-29T19:31:01.049223] [INFO ] [MAIN ] KBH: Loaded 49678 existing records. [2025-09-29T19:31:01.152036] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-09-29T19:31:01.291467] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:31:01.291776] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-09-29T19:31:01.291855] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-09-29T19:31:01.292221] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-09-29T19:31:01.292299] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-09-29T19:31:01.794356] [INFO ] [REMOTE ] KBH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:31:01.921858] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-29T19:31:01.948088] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-09-29T19:31:02.544972] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-29T19:31:02.748115] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-09-29T19:31:03.436407] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-29T19:31:03.548117] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-09-29T19:31:03.755013] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-29T19:31:04.348160] [INFO ] [REMOTE ] KBH: Fetching primary data for 2024-12. [2025-09-29T19:31:04.765001] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-29T19:31:05.148162] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-09-29T19:31:05.948167] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-09-29T19:31:06.302777] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-29T19:31:06.390679] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-29T19:31:06.748153] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-09-29T19:31:07.409968] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-29T19:31:07.429472] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-29T19:31:07.548168] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-09-29T19:31:08.348109] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-01. [2025-09-29T19:31:08.806911] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-29T19:31:09.148158] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-09-29T19:31:09.948138] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-09-29T19:31:10.199635] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-29T19:31:10.525162] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-29T19:31:10.748129] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-09-29T19:31:11.328867] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-29T19:31:11.548161] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-09-29T19:31:11.880706] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-29T19:31:12.348150] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-09-29T19:31:12.639158] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-29T19:31:13.148138] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-09-29T19:31:13.932730] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-29T19:31:13.948053] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-09-29T19:31:14.328304] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-29T19:31:14.332812] [INFO ] [REMOTE ] KB: Full fetch complete (34206 records). [2025-09-29T19:31:14.332957] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-09-29T19:31:14.723110] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-09-29T19:31:14.723235] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-09-29T19:31:14.723959] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-09-29T19:31:14.724023] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-09-29T19:31:14.724989] [DEBUG] [LOCAL ] KB: Trimmed 34206 records to 24026 (keeping 200 days of data) [2025-09-29T19:31:14.783672] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-09-29T19:31:14.889432] [DEBUG] [LOCAL ] KB: Primary data saved (24026 records). [2025-09-29T19:31:14.889571] [INFO ] [MAIN ] KB: Full history saved. [2025-09-29T19:31:14.889700] [INFO ] [MAIN ] Update Progress: 1177/2371 symbols completed. KB took 24.3s. Estimated remaining: 2h 33m 23s. Rate: 7.8 symbols/min [2025-09-29T19:31:15.071817] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:31:15.116051] [DEBUG] [LOCAL ] KBR: Loaded 48899 existing records from primary storage. [2025-09-29T19:31:15.116401] [INFO ] [MAIN ] KBR: Loaded 48899 existing records. [2025-09-29T19:31:15.309037] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:31:15.309250] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-09-29T19:31:15.309300] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-09-29T19:31:15.309564] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-09-29T19:31:15.309775] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-09-29T19:31:15.550251] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-09-29T19:31:15.718054] [INFO ] [REMOTE ] KBR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:31:15.730125] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-29T19:31:16.031221] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-29T19:31:16.348122] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-09-29T19:31:17.154414] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-09-29T19:31:17.159703] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-29T19:31:17.371735] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-29T19:31:17.948113] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-09-29T19:31:18.748135] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-09-29T19:31:18.947363] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-29T19:31:18.957069] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-29T19:31:18.957209] [INFO ] [REMOTE ] KAR: Full fetch complete (56758 records). [2025-09-29T19:31:18.961927] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-09-29T19:31:19.384964] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-09-29T19:31:19.385068] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-09-29T19:31:19.386098] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-09-29T19:31:19.386165] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-09-29T19:31:19.387438] [DEBUG] [LOCAL ] KAR: Trimmed 56758 records to 39817 (keeping 200 days of data) [2025-09-29T19:31:19.559105] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-09-29T19:31:19.637865] [DEBUG] [LOCAL ] KAR: Primary data saved (39817 records). [2025-09-29T19:31:19.638028] [INFO ] [MAIN ] KAR: Full history saved. [2025-09-29T19:31:19.638155] [INFO ] [MAIN ] Update Progress: 1178/2371 symbols completed. KAR took 30.6s. Estimated remaining: 2h 33m 12s. Rate: 7.8 symbols/min [2025-09-29T19:31:19.841138] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:31:19.893139] [DEBUG] [LOCAL ] KD: Loaded 53068 existing records from primary storage. [2025-09-29T19:31:19.893553] [INFO ] [MAIN ] KD: Loaded 53068 existing records. [2025-09-29T19:31:20.087024] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:31:20.087304] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-09-29T19:31:20.087359] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-09-29T19:31:20.087730] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-09-29T19:31:20.087792] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-09-29T19:31:20.350538] [INFO ] [REMOTE ] KBR: Fetching primary data for 2024-12. [2025-09-29T19:31:20.487105] [INFO ] [REMOTE ] KD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:31:20.669373] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-29T19:31:20.705572] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-29T19:31:21.148123] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-09-29T19:31:21.953220] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-09-29T19:31:21.972193] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-29T19:31:22.748153] [INFO ] [REMOTE ] KD: Fetching primary data for 2024-12. [2025-09-29T19:31:23.548129] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-01. [2025-09-29T19:31:23.715695] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-29T19:31:24.348129] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-09-29T19:31:24.454543] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-29T19:31:24.822151] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-29T19:31:25.148131] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-09-29T19:31:25.565887] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (4.42 seconds). [2025-09-29T19:31:25.956608] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-09-29T19:31:25.963008] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-29T19:31:26.495667] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-29T19:31:26.748157] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-09-29T19:31:27.485846] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-29T19:31:27.492688] [INFO ] [REMOTE ] KBDC: Full fetch complete (28492 records). [2025-09-29T19:31:27.492859] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-09-29T19:31:27.558590] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-01. [2025-09-29T19:31:27.901165] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-09-29T19:31:27.901271] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-09-29T19:31:27.901946] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-09-29T19:31:27.902021] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-09-29T19:31:27.902764] [DEBUG] [LOCAL ] KBDC: Trimmed 28492 records to 20926 (keeping 200 days of data) [2025-09-29T19:31:28.037756] [DEBUG] [LOCAL ] KBDC: Primary data saved (20926 records). [2025-09-29T19:31:28.037890] [INFO ] [MAIN ] KBDC: Full history saved. [2025-09-29T19:31:28.037975] [INFO ] [MAIN ] Update Progress: 1179/2371 symbols completed. KBDC took 30.0s. Estimated remaining: 2h 33m 5s. Rate: 7.8 symbols/min [2025-09-29T19:31:28.220336] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:31:28.228378] [DEBUG] [LOCAL ] KEN: Loaded 4784 existing records from primary storage. [2025-09-29T19:31:28.228605] [INFO ] [MAIN ] KEN: Loaded 4784 existing records. [2025-09-29T19:31:28.351284] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-09-29T19:31:28.434235] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:31:28.434977] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-09-29T19:31:28.435055] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-09-29T19:31:28.435390] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-09-29T19:31:28.435482] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-09-29T19:31:28.640255] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-29T19:31:28.894973] [INFO ] [REMOTE ] KEN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:31:29.008330] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-29T19:31:29.148112] [INFO ] [REMOTE ] KEN: Fetching primary data for 2024-12. [2025-09-29T19:31:29.620626] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-29T19:31:29.948086] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-09-29T19:31:30.148336] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-29T19:31:30.748100] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-01. [2025-09-29T19:31:31.380830] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-29T19:31:31.548132] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-09-29T19:31:31.654505] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-29T19:31:32.348104] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-09-29T19:31:33.116512] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-29T19:31:33.148109] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-09-29T19:31:33.257781] [DEBUG] [REMOTE ] KBR: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-09-29T19:31:33.258199] [WARN ] [REMOTE ] KBR: No data returned for month 2025-05 [2025-09-29T19:31:33.258307] [FATAL] [REMOTE ] KBR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T19:31:33.258391] [FATAL] [MAIN ] KBR: Failed to fetch primary data. [2025-09-29T19:31:33.258458] [WARN ] [MAIN ] KBR: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T19:31:33.258529] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-09-29T19:31:33.258601] [DEBUG] [LOCAL ] KBR: No primary data file found to delete. [2025-09-29T19:31:33.258670] [INFO ] [LOCAL ] KBR: Starting deletion of derivative data. [2025-09-29T19:31:33.259462] [DEBUG] [LOCAL ] KBR: Deleted derivative data file. [2025-09-29T19:31:33.259556] [INFO ] [MAIN ] Update Progress: 1180/2371 symbols completed. KBR took 18.4s. Estimated remaining: 2h 32m 55s. Rate: 7.8 symbols/min [2025-09-29T19:31:33.444111] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:31:33.476792] [DEBUG] [LOCAL ] KEP: Loaded 31169 existing records from primary storage. [2025-09-29T19:31:33.477116] [INFO ] [MAIN ] KEP: Loaded 31169 existing records. [2025-09-29T19:31:33.699860] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:31:33.700144] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-09-29T19:31:33.700201] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-09-29T19:31:33.700548] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-09-29T19:31:33.700624] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-09-29T19:31:33.951465] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-09-29T19:31:34.106632] [INFO ] [REMOTE ] KEP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:31:34.175588] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-29T19:31:34.439255] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-29T19:31:34.748119] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-09-29T19:31:35.548117] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-09-29T19:31:36.348152] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-09-29T19:31:36.507955] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-29T19:31:36.839467] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-29T19:31:37.148093] [INFO ] [REMOTE ] KEP: Fetching primary data for 2024-12. [2025-09-29T19:31:37.352383] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-29T19:31:37.948119] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-09-29T19:31:38.466545] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-29T19:31:38.748143] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-09-29T19:31:39.548113] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-09-29T19:31:39.683302] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-29T19:31:40.348084] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-09-29T19:31:40.383965] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-29T19:31:40.423038] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-29T19:31:41.148133] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-09-29T19:31:41.512967] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-29T19:31:41.948113] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-09-29T19:31:42.748136] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-09-29T19:31:43.002137] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-29T19:31:43.025405] [INFO ] [REMOTE ] KBH: Full fetch complete (70743 records). [2025-09-29T19:31:43.025722] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-09-29T19:31:43.027099] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-29T19:31:43.425913] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-29T19:31:43.503824] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-09-29T19:31:43.503976] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-09-29T19:31:43.505412] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-09-29T19:31:43.505530] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-09-29T19:31:43.507747] [DEBUG] [LOCAL ] KBH: Trimmed 70743 records to 48938 (keeping 200 days of data) [2025-09-29T19:31:43.563784] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-09-29T19:31:43.824660] [DEBUG] [LOCAL ] KBH: Primary data saved (48938 records). [2025-09-29T19:31:43.824843] [INFO ] [MAIN ] KBH: Full history saved. [2025-09-29T19:31:43.824937] [INFO ] [MAIN ] Update Progress: 1181/2371 symbols completed. KBH took 43.0s. Estimated remaining: 2h 32m 50s. Rate: 7.8 symbols/min [2025-09-29T19:31:44.008124] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:31:44.048560] [DEBUG] [LOCAL ] KEX: Loaded 38712 existing records from primary storage. [2025-09-29T19:31:44.048924] [INFO ] [MAIN ] KEX: Loaded 38712 existing records. [2025-09-29T19:31:44.237166] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:31:44.237471] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-09-29T19:31:44.237531] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-09-29T19:31:44.237792] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-09-29T19:31:44.237852] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-09-29T19:31:44.353267] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-09-29T19:31:44.620697] [INFO ] [REMOTE ] KEX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:31:45.004165] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-29T19:31:45.148138] [INFO ] [REMOTE ] KEX: Fetching primary data for 2024-12. [2025-09-29T19:31:45.435551] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-29T19:31:45.948132] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-09-29T19:31:46.654164] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-29T19:31:46.748107] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-09-29T19:31:47.157876] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-29T19:31:47.381492] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-29T19:31:47.548091] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-09-29T19:31:48.261958] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-29T19:31:48.348109] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-01. [2025-09-29T19:31:49.148118] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-09-29T19:31:49.913706] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-29T19:31:49.917222] [INFO ] [REMOTE ] KEN: Full fetch complete (5949 records). [2025-09-29T19:31:49.917098] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-29T19:31:49.917410] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-09-29T19:31:49.953228] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-09-29T19:31:50.325060] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-09-29T19:31:50.325137] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-09-29T19:31:50.325309] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-09-29T19:31:50.325347] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-09-29T19:31:50.325809] [DEBUG] [LOCAL ] KEN: Trimmed 5949 records to 4731 (keeping 200 days of data) [2025-09-29T19:31:50.354537] [DEBUG] [LOCAL ] KEN: Primary data saved (4731 records). [2025-09-29T19:31:50.354688] [INFO ] [MAIN ] KEN: Full history saved. [2025-09-29T19:31:50.354788] [INFO ] [MAIN ] Update Progress: 1182/2371 symbols completed. KEN took 22.3s. Estimated remaining: 2h 32m 41s. Rate: 7.8 symbols/min [2025-09-29T19:31:50.534586] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:31:50.534783] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-09-29T19:31:50.534829] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-09-29T19:31:50.534940] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-09-29T19:31:50.534984] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-09-29T19:31:50.535092] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-09-29T19:31:50.535144] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-09-29T19:31:50.754728] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-09-29T19:31:50.919298] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:31:51.206063] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-29T19:31:51.548155] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-09-29T19:31:52.348127] [INFO ] [REMOTE ] KEY: Fetching primary data for 2024-12. [2025-09-29T19:31:52.691095] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-29T19:31:52.910761] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-29T19:31:53.148122] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-09-29T19:31:53.948155] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-09-29T19:31:54.178660] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-29T19:31:54.458619] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-29T19:31:54.748136] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-09-29T19:31:55.548113] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-09-29T19:31:55.599564] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-29T19:31:56.270850] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-29T19:31:56.348207] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-09-29T19:31:57.016008] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-29T19:31:57.148144] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-09-29T19:31:57.823561] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-29T19:31:57.948146] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-09-29T19:31:58.625362] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-29T19:31:58.748167] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-09-29T19:31:59.548107] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-09-29T19:31:59.786893] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-29T19:32:00.348153] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-09-29T19:32:00.625681] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-29T19:32:00.637177] [INFO ] [REMOTE ] KD: Full fetch complete (75628 records). [2025-09-29T19:32:00.637346] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-09-29T19:32:01.072425] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-09-29T19:32:01.072615] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-09-29T19:32:01.073775] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-09-29T19:32:01.073860] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-09-29T19:32:01.075424] [DEBUG] [LOCAL ] KD: Trimmed 75628 records to 52300 (keeping 200 days of data) [2025-09-29T19:32:01.163249] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-09-29T19:32:01.223817] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-29T19:32:01.449591] [DEBUG] [LOCAL ] KD: Primary data saved (52300 records). [2025-09-29T19:32:01.449764] [INFO ] [MAIN ] KD: Full history saved. [2025-09-29T19:32:01.449860] [INFO ] [MAIN ] Update Progress: 1183/2371 symbols completed. KD took 41.8s. Estimated remaining: 2h 32m 37s. Rate: 7.8 symbols/min [2025-09-29T19:32:01.635620] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:32:01.697041] [DEBUG] [LOCAL ] KEYS: Loaded 43955 existing records from primary storage. [2025-09-29T19:32:01.697411] [INFO ] [MAIN ] KEYS: Loaded 43955 existing records. [2025-09-29T19:32:01.934803] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:32:01.935192] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-09-29T19:32:01.935301] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-09-29T19:32:01.935915] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-09-29T19:32:01.936010] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-09-29T19:32:01.974747] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-09-29T19:32:02.316478] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-29T19:32:02.419488] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:32:02.625309] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-29T19:32:02.748141] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2024-12. [2025-09-29T19:32:03.381489] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-29T19:32:03.548173] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-09-29T19:32:04.296915] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-29T19:32:04.348140] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-09-29T19:32:04.965376] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-29T19:32:04.971741] [INFO ] [REMOTE ] KEP: Full fetch complete (41571 records). [2025-09-29T19:32:04.971865] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-09-29T19:32:05.164268] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-09-29T19:32:05.395108] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-09-29T19:32:05.395272] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-09-29T19:32:05.396245] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-09-29T19:32:05.396315] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-09-29T19:32:05.397564] [DEBUG] [LOCAL ] KEP: Trimmed 41571 records to 30817 (keeping 200 days of data) [2025-09-29T19:32:05.595688] [DEBUG] [LOCAL ] KEP: Primary data saved (30817 records). [2025-09-29T19:32:05.595858] [INFO ] [MAIN ] KEP: Full history saved. [2025-09-29T19:32:05.595981] [INFO ] [MAIN ] Update Progress: 1184/2371 symbols completed. KEP took 32.3s. Estimated remaining: 2h 32m 26s. Rate: 7.8 symbols/min [2025-09-29T19:32:05.798493] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:32:05.804059] [DEBUG] [LOCAL ] KF: Loaded 2486 existing records from primary storage. [2025-09-29T19:32:05.804272] [INFO ] [MAIN ] KF: Loaded 2486 existing records. [2025-09-29T19:32:05.956115] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-01. [2025-09-29T19:32:06.007160] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:32:06.007720] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-09-29T19:32:06.007929] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-09-29T19:32:06.008314] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-09-29T19:32:06.008513] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-09-29T19:32:06.364636] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-29T19:32:06.486722] [INFO ] [REMOTE ] KF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:32:06.718573] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-29T19:32:06.748113] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-09-29T19:32:07.548149] [INFO ] [REMOTE ] KF: Fetching primary data for 2024-12. [2025-09-29T19:32:07.641301] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-29T19:32:08.187325] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-29T19:32:08.237924] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-29T19:32:08.348133] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-09-29T19:32:09.148210] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-09-29T19:32:09.948130] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-09-29T19:32:10.302406] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-29T19:32:10.748080] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-01. [2025-09-29T19:32:10.925499] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-29T19:32:10.935501] [INFO ] [REMOTE ] KEX: Full fetch complete (55667 records). [2025-09-29T19:32:10.935633] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-09-29T19:32:11.275035] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-29T19:32:11.380340] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-09-29T19:32:11.380543] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-09-29T19:32:11.381833] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-09-29T19:32:11.381950] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-09-29T19:32:11.407472] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-29T19:32:11.416907] [DEBUG] [LOCAL ] KEX: Trimmed 55667 records to 38072 (keeping 200 days of data) [2025-09-29T19:32:11.549016] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-09-29T19:32:11.664950] [DEBUG] [LOCAL ] KEX: Primary data saved (38072 records). [2025-09-29T19:32:11.665114] [INFO ] [MAIN ] KEX: Full history saved. [2025-09-29T19:32:11.665220] [INFO ] [MAIN ] Update Progress: 1185/2371 symbols completed. KEX took 27.8s. Estimated remaining: 2h 32m 16s. Rate: 7.8 symbols/min [2025-09-29T19:32:11.850806] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:32:11.873214] [DEBUG] [LOCAL ] KFRC: Loaded 19766 existing records from primary storage. [2025-09-29T19:32:11.873505] [INFO ] [MAIN ] KFRC: Loaded 19766 existing records. [2025-09-29T19:32:12.072816] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:32:12.073110] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-09-29T19:32:12.073165] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-09-29T19:32:12.073438] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-09-29T19:32:12.073498] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-09-29T19:32:12.353289] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-09-29T19:32:12.498907] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:32:13.148121] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-09-29T19:32:13.599106] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-29T19:32:13.603033] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-29T19:32:13.948143] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2024-12. [2025-09-29T19:32:14.084245] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-29T19:32:14.748114] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-09-29T19:32:15.035848] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-29T19:32:15.226224] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-29T19:32:15.548116] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-01. [2025-09-29T19:32:16.348122] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-09-29T19:32:16.394911] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-29T19:32:16.845499] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-29T19:32:17.148167] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-09-29T19:32:17.752906] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-29T19:32:17.948172] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-09-29T19:32:18.748128] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-09-29T19:32:18.842235] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-29T19:32:19.548169] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-09-29T19:32:20.108968] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-29T19:32:20.348128] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-09-29T19:32:20.567544] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-29T19:32:20.776215] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-29T19:32:21.148145] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-09-29T19:32:21.608154] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-29T19:32:21.948137] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-09-29T19:32:22.748146] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-09-29T19:32:22.968384] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-29T19:32:23.342408] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-29T19:32:23.343542] [INFO ] [REMOTE ] KF: Full fetch complete (3641 records). [2025-09-29T19:32:23.343630] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-09-29T19:32:23.556155] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-09-29T19:32:23.772551] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-09-29T19:32:23.772631] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-09-29T19:32:23.772821] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-09-29T19:32:23.772888] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-09-29T19:32:23.773418] [DEBUG] [LOCAL ] KF: Trimmed 3641 records to 2467 (keeping 200 days of data) [2025-09-29T19:32:23.791142] [DEBUG] [LOCAL ] KF: Primary data saved (2467 records). [2025-09-29T19:32:23.791282] [INFO ] [MAIN ] KF: Full history saved. [2025-09-29T19:32:23.791422] [INFO ] [MAIN ] Update Progress: 1186/2371 symbols completed. KF took 18.2s. Estimated remaining: 2h 32m 13s. Rate: 7.8 symbols/min [2025-09-29T19:32:23.984291] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:32:23.995092] [DEBUG] [LOCAL ] KFS: Loaded 8471 existing records from primary storage. [2025-09-29T19:32:23.995381] [INFO ] [MAIN ] KFS: Loaded 8471 existing records. [2025-09-29T19:32:24.192001] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:32:24.192321] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-09-29T19:32:24.192383] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-09-29T19:32:24.192733] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-09-29T19:32:24.192794] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-09-29T19:32:24.357497] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-09-29T19:32:24.601058] [INFO ] [REMOTE ] KFS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:32:25.148097] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-09-29T19:32:25.319460] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-29T19:32:25.948133] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-09-29T19:32:26.234863] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-29T19:32:26.290093] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-29T19:32:26.748162] [INFO ] [REMOTE ] KFS: Fetching primary data for 2024-12. [2025-09-29T19:32:27.346026] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-29T19:32:27.548169] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-09-29T19:32:27.603478] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-29T19:32:28.348153] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-09-29T19:32:28.570875] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-29T19:32:29.148147] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-09-29T19:32:29.775253] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-29T19:32:29.948118] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-01. [2025-09-29T19:32:30.621996] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-29T19:32:30.748090] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-09-29T19:32:31.078454] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-29T19:32:31.548116] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-09-29T19:32:31.847850] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-29T19:32:32.348139] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-09-29T19:32:33.003722] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-29T19:32:33.119439] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-29T19:32:33.148076] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-09-29T19:32:33.948122] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-09-29T19:32:34.748160] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-09-29T19:32:34.778144] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-29T19:32:35.465223] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-29T19:32:35.548166] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-09-29T19:32:36.218022] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-29T19:32:36.228869] [INFO ] [REMOTE ] KEY: Full fetch complete (77257 records). [2025-09-29T19:32:36.229056] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-09-29T19:32:36.353249] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-09-29T19:32:36.445833] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-29T19:32:36.446840] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-09-29T19:32:36.446925] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-09-29T19:32:36.447043] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-09-29T19:32:36.447186] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-09-29T19:32:36.447247] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-09-29T19:32:36.447314] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-09-29T19:32:36.447429] [INFO ] [MAIN ] Update Progress: 1187/2371 symbols completed. KEY took 46.1s. Estimated remaining: 2h 32m 10s. Rate: 7.8 symbols/min [2025-09-29T19:32:36.632586] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:32:36.668505] [DEBUG] [LOCAL ] KFY: Loaded 31057 existing records from primary storage. [2025-09-29T19:32:36.668870] [INFO ] [MAIN ] KFY: Loaded 31057 existing records. [2025-09-29T19:32:36.854606] [WARN ] [MAIN ] KFY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:32:36.855005] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-09-29T19:32:36.855058] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-09-29T19:32:36.855380] [DEBUG] [LOCAL ] KFY: Deleted primary data file. [2025-09-29T19:32:36.855441] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-09-29T19:32:37.153295] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-09-29T19:32:37.224180] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-29T19:32:37.402105] [INFO ] [REMOTE ] KFY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:32:37.443504] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-29T19:32:37.455971] [INFO ] [REMOTE ] KEYS: Full fetch complete (62923 records). [2025-09-29T19:32:37.456193] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-09-29T19:32:37.960277] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-09-29T19:32:38.031020] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-09-29T19:32:38.031262] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-09-29T19:32:38.032678] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-09-29T19:32:38.032768] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-09-29T19:32:38.034509] [DEBUG] [LOCAL ] KEYS: Trimmed 62923 records to 43195 (keeping 200 days of data) [2025-09-29T19:32:38.177726] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-29T19:32:38.369335] [DEBUG] [LOCAL ] KEYS: Primary data saved (43195 records). [2025-09-29T19:32:38.369471] [INFO ] [MAIN ] KEYS: Full history saved. [2025-09-29T19:32:38.369569] [INFO ] [MAIN ] Update Progress: 1188/2371 symbols completed. KEYS took 36.9s. Estimated remaining: 2h 31m 57s. Rate: 7.8 symbols/min [2025-09-29T19:32:38.568563] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:32:38.636569] [DEBUG] [LOCAL ] KGC: Loaded 54479 existing records from primary storage. [2025-09-29T19:32:38.637052] [INFO ] [MAIN ] KGC: Loaded 54479 existing records. [2025-09-29T19:32:38.751010] [INFO ] [REMOTE ] KFY: Fetching primary data for 2024-12. [2025-09-29T19:32:38.849783] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-29T19:32:38.849166] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:32:38.852991] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-09-29T19:32:38.853408] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-09-29T19:32:38.853919] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-09-29T19:32:38.853979] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-09-29T19:32:39.238546] [INFO ] [REMOTE ] KGC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:32:39.548144] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-09-29T19:32:40.089604] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-29T19:32:40.348132] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-01. [2025-09-29T19:32:40.365472] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-29T19:32:41.148122] [INFO ] [REMOTE ] KGC: Fetching primary data for 2024-12. [2025-09-29T19:32:41.571220] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-29T19:32:41.948123] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-09-29T19:32:42.748090] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-09-29T19:32:42.764283] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-29T19:32:42.845336] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-29T19:32:43.548069] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-09-29T19:32:44.001748] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-29T19:32:44.340433] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-29T19:32:44.348081] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-01. [2025-09-29T19:32:45.148140] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-09-29T19:32:45.948136] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-09-29T19:32:46.427531] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-29T19:32:46.717931] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-29T19:32:46.723542] [INFO ] [REMOTE ] KFRC: Full fetch complete (25509 records). [2025-09-29T19:32:46.723734] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-09-29T19:32:46.757574] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-09-29T19:32:47.039784] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-29T19:32:47.056115] [INFO ] [REMOTE ] KFS: Full fetch complete (10548 records). [2025-09-29T19:32:47.072468] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-09-29T19:32:47.266501] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-09-29T19:32:47.266664] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-09-29T19:32:47.267339] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-09-29T19:32:47.267782] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-09-29T19:32:47.314992] [DEBUG] [LOCAL ] KFRC: Trimmed 25509 records to 19512 (keeping 200 days of data) [2025-09-29T19:32:47.551806] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-09-29T19:32:47.656756] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-09-29T19:32:47.657330] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-09-29T19:32:47.659870] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-09-29T19:32:47.660789] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-09-29T19:32:47.664056] [DEBUG] [LOCAL ] KFS: Trimmed 10548 records to 8440 (keeping 200 days of data) [2025-09-29T19:32:47.728764] [DEBUG] [LOCAL ] KFS: Primary data saved (8440 records). [2025-09-29T19:32:47.729759] [INFO ] [MAIN ] KFS: Full history saved. [2025-09-29T19:32:47.730260] [INFO ] [MAIN ] Update Progress: 1189/2371 symbols completed. KFS took 23.9s. Estimated remaining: 2h 31m 51s. Rate: 7.8 symbols/min [2025-09-29T19:32:47.923381] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:32:47.929795] [DEBUG] [LOCAL ] KFRC: Primary data saved (19512 records). [2025-09-29T19:32:47.929954] [INFO ] [MAIN ] KFRC: Full history saved. [2025-09-29T19:32:47.930044] [INFO ] [MAIN ] Update Progress: 1190/2371 symbols completed. KFRC took 36.3s. Estimated remaining: 2h 31m 36s. Rate: 7.8 symbols/min [2025-09-29T19:32:48.111412] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:32:48.143854] [DEBUG] [LOCAL ] KGS: Loaded 46487 existing records from primary storage. [2025-09-29T19:32:48.144281] [INFO ] [MAIN ] KGS: Loaded 46487 existing records. [2025-09-29T19:32:48.350581] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:32:48.350840] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-09-29T19:32:48.350891] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-09-29T19:32:48.352319] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-09-29T19:32:48.352388] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-09-29T19:32:48.483676] [DEBUG] [LOCAL ] KIM: Loaded 53831 existing records from primary storage. [2025-09-29T19:32:48.499787] [INFO ] [MAIN ] KIM: Loaded 53831 existing records. [2025-09-29T19:32:48.882263] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:32:48.934040] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-09-29T19:32:48.937783] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-09-29T19:32:48.941632] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-09-29T19:32:48.966722] [INFO ] [REMOTE ] KGS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:32:48.981240] [INFO ] [REMOTE ] KGS: Fetching primary data for 2024-12. [2025-09-29T19:32:48.980954] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-09-29T19:32:49.007733] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-29T19:32:49.146188] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-09-29T19:32:49.151757] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-09-29T19:32:49.438698] [INFO ] [REMOTE ] KIM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:32:49.948160] [INFO ] [REMOTE ] KIM: Fetching primary data for 2024-12. [2025-09-29T19:32:50.593721] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-29T19:32:50.631858] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-29T19:32:50.748160] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-09-29T19:32:51.548106] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-09-29T19:32:51.736303] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-29T19:32:52.136926] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-29T19:32:52.348111] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-09-29T19:32:53.158245] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-01. [2025-09-29T19:32:53.181145] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-29T19:32:53.572829] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-29T19:32:53.948115] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-09-29T19:32:54.432453] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-29T19:32:54.748127] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-09-29T19:32:55.548161] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-09-29T19:32:56.232596] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-29T19:32:56.282441] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-29T19:32:56.348074] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-09-29T19:32:56.908761] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-29T19:32:57.148117] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-09-29T19:32:57.948142] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-09-29T19:32:58.247997] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-29T19:32:58.748138] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-09-29T19:32:58.804915] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-29T19:32:59.348582] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-29T19:32:59.548157] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-09-29T19:33:00.343139] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-29T19:33:00.354959] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-01. [2025-09-29T19:33:00.670077] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-29T19:33:01.148157] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-09-29T19:33:01.948148] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-09-29T19:33:02.172150] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-29T19:33:02.748566] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-09-29T19:33:03.279188] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-29T19:33:03.548169] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-09-29T19:33:03.651634] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-29T19:33:03.659548] [INFO ] [REMOTE ] KFY: Full fetch complete (43583 records). [2025-09-29T19:33:03.659808] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-09-29T19:33:04.071040] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-09-29T19:33:04.071272] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-09-29T19:33:04.072358] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-09-29T19:33:04.072432] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-09-29T19:33:04.073617] [DEBUG] [LOCAL ] KFY: Trimmed 43583 records to 30178 (keeping 200 days of data) [2025-09-29T19:33:04.270149] [DEBUG] [LOCAL ] KFY: Primary data saved (30178 records). [2025-09-29T19:33:04.270311] [INFO ] [MAIN ] KFY: Full history saved. [2025-09-29T19:33:04.270405] [INFO ] [MAIN ] Update Progress: 1191/2371 symbols completed. KFY took 27.8s. Estimated remaining: 2h 31m 37s. Rate: 7.8 symbols/min [2025-09-29T19:33:04.353722] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-09-29T19:33:04.465218] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:33:04.512054] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-29T19:33:04.542764] [DEBUG] [LOCAL ] KIO: Loaded 21625 existing records from primary storage. [2025-09-29T19:33:04.543079] [INFO ] [MAIN ] KIO: Loaded 21625 existing records. [2025-09-29T19:33:04.728608] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:33:04.729044] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-09-29T19:33:04.729132] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-09-29T19:33:04.729476] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-09-29T19:33:04.729569] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-09-29T19:33:05.104250] [INFO ] [REMOTE ] KIO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:33:05.148126] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-09-29T19:33:05.671914] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-29T19:33:05.741964] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-29T19:33:05.948126] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-09-29T19:33:06.562864] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-29T19:33:06.748133] [INFO ] [REMOTE ] KIO: Fetching primary data for 2024-12. [2025-09-29T19:33:07.555680] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-09-29T19:33:07.575768] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-29T19:33:07.625680] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-29T19:33:08.348102] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-01. [2025-09-29T19:33:09.148126] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-09-29T19:33:09.408176] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-29T19:33:09.444949] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-29T19:33:09.948112] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-09-29T19:33:10.748156] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-09-29T19:33:11.454013] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-29T19:33:11.498476] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-09-29T19:33:11.511188] [INFO ] [REMOTE ] KGC: Full fetch complete (77696 records). [2025-09-29T19:33:11.511425] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-09-29T19:33:11.553279] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-09-29T19:33:11.938522] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-09-29T19:33:11.938621] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-09-29T19:33:11.939814] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-09-29T19:33:11.939882] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-09-29T19:33:11.941420] [DEBUG] [LOCAL ] KGC: Trimmed 77696 records to 53699 (keeping 200 days of data) [2025-09-29T19:33:12.297378] [DEBUG] [LOCAL ] KGC: Primary data saved (53699 records). [2025-09-29T19:33:12.297526] [INFO ] [MAIN ] KGC: Full history saved. [2025-09-29T19:33:12.297608] [INFO ] [MAIN ] Update Progress: 1192/2371 symbols completed. KGC took 33.9s. Estimated remaining: 2h 31m 29s. Rate: 7.8 symbols/min [2025-09-29T19:33:12.357231] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-09-29T19:33:12.483040] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:33:12.517106] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-29T19:33:12.586586] [DEBUG] [LOCAL ] KKR: Loaded 54281 existing records from primary storage. [2025-09-29T19:33:12.586977] [INFO ] [MAIN ] KKR: Loaded 54281 existing records. [2025-09-29T19:33:12.776484] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:33:12.776808] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-09-29T19:33:12.776944] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-09-29T19:33:12.777481] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-09-29T19:33:12.777542] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-09-29T19:33:13.156105] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-09-29T19:33:13.159518] [INFO ] [REMOTE ] KKR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:33:13.197952] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-29T19:33:13.245560] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-29T19:33:13.948110] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-09-29T19:33:14.748120] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-09-29T19:33:14.961284] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-29T19:33:15.548145] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-09-29T19:33:15.713488] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-29T19:33:15.844567] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-29T19:33:16.348124] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-09-29T19:33:17.148099] [INFO ] [REMOTE ] KKR: Fetching primary data for 2024-12. [2025-09-29T19:33:17.443122] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-29T19:33:17.613352] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-29T19:33:17.948115] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-09-29T19:33:18.748110] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-09-29T19:33:19.052447] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-29T19:33:19.107994] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-29T19:33:19.548202] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-01. [2025-09-29T19:33:20.348093] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-09-29T19:33:20.755030] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-29T19:33:20.767557] [INFO ] [REMOTE ] KGS: Full fetch complete (66232 records). [2025-09-29T19:33:20.767749] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-09-29T19:33:21.148176] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-09-29T19:33:21.188998] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-09-29T19:33:21.189433] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-09-29T19:33:21.190722] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-09-29T19:33:21.190922] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-09-29T19:33:21.192377] [DEBUG] [LOCAL ] KGS: Trimmed 66232 records to 45714 (keeping 200 days of data) [2025-09-29T19:33:21.541414] [DEBUG] [LOCAL ] KGS: Primary data saved (45714 records). [2025-09-29T19:33:21.543924] [INFO ] [MAIN ] KGS: Full history saved. [2025-09-29T19:33:21.543692] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-29T19:33:21.544189] [INFO ] [MAIN ] Update Progress: 1193/2371 symbols completed. KGS took 33.8s. Estimated remaining: 2h 31m 23s. Rate: 7.8 symbols/min [2025-09-29T19:33:21.735960] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:33:21.745150] [DEBUG] [LOCAL ] KKRS: Loaded 5801 existing records from primary storage. [2025-09-29T19:33:21.745365] [INFO ] [MAIN ] KKRS: Loaded 5801 existing records. [2025-09-29T19:33:21.937692] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:33:21.937932] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-09-29T19:33:21.937981] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-09-29T19:33:21.938196] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-09-29T19:33:21.938254] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-09-29T19:33:21.960884] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-09-29T19:33:22.262200] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-29T19:33:22.358796] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:33:22.391038] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-29T19:33:22.748110] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-09-29T19:33:23.548087] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-09-29T19:33:23.888723] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-29T19:33:23.903752] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-29T19:33:24.348104] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-09-29T19:33:25.148136] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-09-29T19:33:25.462035] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-29T19:33:25.521526] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-29T19:33:25.532569] [INFO ] [REMOTE ] KIM: Full fetch complete (76826 records). [2025-09-29T19:33:25.532804] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-09-29T19:33:25.953685] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2024-12. [2025-09-29T19:33:25.957941] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-09-29T19:33:25.959179] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-09-29T19:33:25.960512] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-09-29T19:33:25.960630] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-09-29T19:33:25.962282] [DEBUG] [LOCAL ] KIM: Trimmed 76826 records to 53047 (keeping 200 days of data) [2025-09-29T19:33:26.316019] [DEBUG] [LOCAL ] KIM: Primary data saved (53047 records). [2025-09-29T19:33:26.316177] [INFO ] [MAIN ] KIM: Full history saved. [2025-09-29T19:33:26.316305] [INFO ] [MAIN ] Update Progress: 1194/2371 symbols completed. KIM took 38.4s. Estimated remaining: 2h 31m 12s. Rate: 7.8 symbols/min [2025-09-29T19:33:26.502492] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:33:26.508679] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-09-29T19:33:26.508567] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-29T19:33:26.508916] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-09-29T19:33:26.511410] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-09-29T19:33:26.511480] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-09-29T19:33:26.511543] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-09-29T19:33:26.511597] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-09-29T19:33:26.754290] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-09-29T19:33:26.912839] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:33:26.950408] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-29T19:33:27.548116] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2024-12. [2025-09-29T19:33:27.771878] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T19:33:27.772253] [WARN ] [REMOTE ] KKRT: No data returned for month 2024-12 [2025-09-29T19:33:27.772356] [FATAL] [REMOTE ] KKRT: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T19:33:27.772404] [FATAL] [MAIN ] KKRT: Failed to fetch primary data. [2025-09-29T19:33:27.772464] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T19:33:27.772557] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-09-29T19:33:27.772639] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-09-29T19:33:27.772740] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-09-29T19:33:27.772821] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-09-29T19:33:27.772891] [INFO ] [MAIN ] Update Progress: 1195/2371 symbols completed. KKRT took 1.5s. Estimated remaining: 2h 30m 58s. Rate: 7.8 symbols/min [2025-09-29T19:33:27.950535] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:33:27.950931] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-09-29T19:33:27.950991] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-09-29T19:33:27.951105] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-09-29T19:33:27.951161] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-09-29T19:33:27.951205] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-09-29T19:33:27.951241] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-09-29T19:33:28.250937] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-29T19:33:28.278461] [INFO ] [REMOTE ] KIO: Full fetch complete (31011 records). [2025-09-29T19:33:28.288949] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-09-29T19:33:28.361526] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-09-29T19:33:28.405125] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:33:28.765983] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-09-29T19:33:28.766075] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-09-29T19:33:28.766745] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-09-29T19:33:28.766811] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-09-29T19:33:28.767615] [DEBUG] [LOCAL ] KIO: Trimmed 31011 records to 21347 (keeping 200 days of data) [2025-09-29T19:33:28.905896] [DEBUG] [LOCAL ] KIO: Primary data saved (21347 records). [2025-09-29T19:33:28.906029] [INFO ] [MAIN ] KIO: Full history saved. [2025-09-29T19:33:28.906138] [INFO ] [MAIN ] Update Progress: 1196/2371 symbols completed. KIO took 24.6s. Estimated remaining: 2h 30m 44s. Rate: 7.8 symbols/min [2025-09-29T19:33:29.123363] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:33:29.148122] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2024-12. [2025-09-29T19:33:29.161215] [DEBUG] [LOCAL ] KLC: Loaded 37107 existing records from primary storage. [2025-09-29T19:33:29.161502] [INFO ] [MAIN ] KLC: Loaded 37107 existing records. [2025-09-29T19:33:29.419747] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T19:33:29.419389] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:33:29.420326] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-09-29T19:33:29.420432] [WARN ] [REMOTE ] KLAR: No data returned for month 2024-12 [2025-09-29T19:33:29.420673] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-09-29T19:33:29.420770] [FATAL] [REMOTE ] KLAR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T19:33:29.420922] [FATAL] [MAIN ] KLAR: Failed to fetch primary data. [2025-09-29T19:33:29.420994] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T19:33:29.421086] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-09-29T19:33:29.421162] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-09-29T19:33:29.421203] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-09-29T19:33:29.421244] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-09-29T19:33:29.421454] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-09-29T19:33:29.421502] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-09-29T19:33:29.421714] [INFO ] [MAIN ] Update Progress: 1197/2371 symbols completed. KLAR took 1.6s. Estimated remaining: 2h 30m 30s. Rate: 7.8 symbols/min [2025-09-29T19:33:29.951903] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-01. [2025-09-29T19:33:29.976537] [INFO ] [REMOTE ] KLC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:33:30.472033] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-29T19:33:30.549102] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-29T19:33:30.748113] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-09-29T19:33:31.548135] [INFO ] [REMOTE ] KLC: Fetching primary data for 2024-12. [2025-09-29T19:33:32.348126] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-09-29T19:33:32.780205] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-29T19:33:32.780466] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-29T19:33:32.827910] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-29T19:33:33.148145] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-09-29T19:33:33.948120] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-09-29T19:33:34.625113] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-29T19:33:34.748130] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-09-29T19:33:34.968407] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-29T19:33:35.548124] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-01. [2025-09-29T19:33:35.556435] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-29T19:33:36.348100] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-09-29T19:33:36.852975] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-29T19:33:37.045459] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-29T19:33:37.148118] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-09-29T19:33:37.766814] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-29T19:33:37.948121] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-09-29T19:33:38.433300] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-29T19:33:38.748117] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-09-29T19:33:39.548140] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-09-29T19:33:39.859015] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-29T19:33:40.348138] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-09-29T19:33:40.947799] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-29T19:33:41.148126] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-09-29T19:33:41.583015] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-29T19:33:41.807560] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-29T19:33:41.809139] [INFO ] [REMOTE ] KKRS: Full fetch complete (8000 records). [2025-09-29T19:33:41.809242] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-09-29T19:33:41.956604] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-09-29T19:33:42.199731] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-09-29T19:33:42.199822] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-09-29T19:33:42.200066] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-09-29T19:33:42.200128] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-09-29T19:33:42.200599] [DEBUG] [LOCAL ] KKRS: Trimmed 8000 records to 5769 (keeping 200 days of data) [2025-09-29T19:33:42.238843] [DEBUG] [LOCAL ] KKRS: Primary data saved (5769 records). [2025-09-29T19:33:42.238995] [INFO ] [MAIN ] KKRS: Full history saved. [2025-09-29T19:33:42.239147] [INFO ] [MAIN ] Update Progress: 1198/2371 symbols completed. KKRS took 20.7s. Estimated remaining: 2h 30m 27s. Rate: 7.8 symbols/min [2025-09-29T19:33:42.748130] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-09-29T19:33:43.400376] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-29T19:33:43.548121] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-09-29T19:33:44.712975] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-29T19:33:44.725417] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-09-29T19:33:45.064485] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-29T19:33:45.148160] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-09-29T19:33:46.572898] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-29T19:33:46.581571] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-09-29T19:33:47.024535] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-09-29T19:33:47.038615] [INFO ] [REMOTE ] KKR: Full fetch complete (77442 records). [2025-09-29T19:33:47.038834] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-09-29T19:33:47.463391] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-09-29T19:33:47.463482] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-09-29T19:33:47.464768] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-09-29T19:33:47.464847] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-09-29T19:33:47.466458] [DEBUG] [LOCAL ] KKR: Trimmed 77442 records to 53500 (keeping 200 days of data) [2025-09-29T19:33:47.830528] [DEBUG] [LOCAL ] KKR: Primary data saved (53500 records). [2025-09-29T19:33:47.830751] [INFO ] [MAIN ] KKR: Full history saved. [2025-09-29T19:33:47.830907] [INFO ] [MAIN ] Update Progress: 1199/2371 symbols completed. KKR took 35.5s. Estimated remaining: 2h 30m 17s. Rate: 7.8 symbols/min [2025-09-29T19:33:48.007158] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-29T19:33:48.014881] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-09-29T19:33:49.352727] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-29T19:33:49.361004] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-09-29T19:33:50.899169] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-29T19:33:50.907769] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-09-29T19:33:52.546419] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-29T19:33:52.555065] [INFO ] [REMOTE ] KLC: Full fetch complete (50704 records). [2025-09-29T19:33:52.555211] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-09-29T19:33:53.050225] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-09-29T19:33:53.050313] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-09-29T19:33:53.051278] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-09-29T19:33:53.051393] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-09-29T19:33:53.052579] [DEBUG] [LOCAL ] KLC: Trimmed 50704 records to 36594 (keeping 200 days of data) [2025-09-29T19:33:53.276449] [DEBUG] [LOCAL ] KLC: Primary data saved (36594 records). [2025-09-29T19:33:53.276615] [INFO ] [MAIN ] KLC: Full history saved. [2025-09-29T19:33:53.276772] [INFO ] [MAIN ] Update Progress: 1200/2371 symbols completed. KLC took 24.4s. Estimated remaining: 2h 30m 7s. Rate: 7.8 symbols/min [2025-09-29T19:33:53.977298] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:33:54.004812] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:33:54.073887] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:33:54.092306] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:33:54.105671] [DEBUG] [LOCAL ] KMPB: Loaded 3646 existing records from primary storage. [2025-09-29T19:33:54.106301] [INFO ] [MAIN ] KMPB: Loaded 3646 existing records. [2025-09-29T19:33:54.346462] [DEBUG] [LOCAL ] KMPR: Loaded 39117 existing records from primary storage. [2025-09-29T19:33:54.347253] [DEBUG] [LOCAL ] KMT: Loaded 43687 existing records from primary storage. [2025-09-29T19:33:54.391561] [INFO ] [MAIN ] KMPR: Loaded 39117 existing records. [2025-09-29T19:33:54.391310] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:33:54.391980] [INFO ] [MAIN ] KMT: Loaded 43687 existing records. [2025-09-29T19:33:54.397333] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-09-29T19:33:54.424259] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-09-29T19:33:54.509615] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-09-29T19:33:54.555499] [DEBUG] [LOCAL ] KMI: Loaded 54473 existing records from primary storage. [2025-09-29T19:33:54.591824] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-09-29T19:33:54.597320] [INFO ] [MAIN ] KMI: Loaded 54473 existing records. [2025-09-29T19:33:55.029100] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:33:55.015538] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:33:55.056470] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-09-29T19:33:55.057325] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-09-29T19:33:55.062606] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-09-29T19:33:55.083426] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-09-29T19:33:55.146526] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-09-29T19:33:55.189820] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-09-29T19:33:55.189704] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-09-29T19:33:55.229136] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-09-29T19:33:55.295706] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:33:55.345305] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-09-29T19:33:55.355761] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-09-29T19:33:55.466062] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-09-29T19:33:55.523414] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-09-29T19:33:55.904499] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:33:55.963922] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2024-12. [2025-09-29T19:33:56.358159] [INFO ] [REMOTE ] KMT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:33:56.417191] [INFO ] [REMOTE ] KMT: Fetching primary data for 2024-12. [2025-09-29T19:33:56.557614] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:33:56.571041] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2024-12. [2025-09-29T19:33:56.667410] [INFO ] [REMOTE ] KMI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:33:56.667849] [INFO ] [REMOTE ] KMI: Fetching primary data for 2024-12. [2025-09-29T19:33:56.719458] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-29T19:33:56.720964] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-01. [2025-09-29T19:33:57.209497] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-29T19:33:57.211779] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-09-29T19:33:57.658459] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-29T19:33:57.659796] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-09-29T19:33:58.138137] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-29T19:33:58.144159] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-01. [2025-09-29T19:33:58.232521] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-29T19:33:58.232365] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-29T19:33:58.237637] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-09-29T19:33:58.243323] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-01. [2025-09-29T19:33:58.781903] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-29T19:33:58.783830] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-09-29T19:33:58.817068] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-29T19:33:58.829235] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-01. [2025-09-29T19:33:59.250598] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-29T19:33:59.252361] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-09-29T19:33:59.269575] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-29T19:33:59.548122] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-09-29T19:33:59.690917] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-29T19:33:59.773964] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-29T19:34:00.348099] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-09-29T19:34:00.923279] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-29T19:34:00.925502] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-29T19:34:01.001413] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-29T19:34:01.148162] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-09-29T19:34:01.794921] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-29T19:34:01.948118] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-09-29T19:34:02.748151] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-09-29T19:34:03.291392] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-29T19:34:03.548151] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-09-29T19:34:04.123011] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-29T19:34:04.348106] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-09-29T19:34:05.148097] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-09-29T19:34:05.651152] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-29T19:34:05.740093] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-29T19:34:05.741430] [INFO ] [REMOTE ] KMPB: Full fetch complete (4973 records). [2025-09-29T19:34:05.741524] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-09-29T19:34:05.953263] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-09-29T19:34:06.141373] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-09-29T19:34:06.141497] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-09-29T19:34:06.141716] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-09-29T19:34:06.141872] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-09-29T19:34:06.142564] [DEBUG] [LOCAL ] KMPB: Trimmed 4973 records to 3626 (keeping 200 days of data) [2025-09-29T19:34:06.185886] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-29T19:34:06.201391] [DEBUG] [LOCAL ] KMPB: Primary data saved (3626 records). [2025-09-29T19:34:06.201509] [INFO ] [MAIN ] KMPB: Full history saved. [2025-09-29T19:34:06.201588] [INFO ] [MAIN ] Update Progress: 1201/2371 symbols completed. KMPB took 12.9s. Estimated remaining: 2h 30m 5s. Rate: 7.8 symbols/min [2025-09-29T19:34:06.372134] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:34:06.425353] [DEBUG] [LOCAL ] KMX: Loaded 53897 existing records from primary storage. [2025-09-29T19:34:06.425732] [INFO ] [MAIN ] KMX: Loaded 53897 existing records. [2025-09-29T19:34:06.605150] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:34:06.605397] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-09-29T19:34:06.605446] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-09-29T19:34:06.605780] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-09-29T19:34:06.605840] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-09-29T19:34:06.755327] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-09-29T19:34:06.986916] [INFO ] [REMOTE ] KMX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:34:07.457776] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-29T19:34:07.548102] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-09-29T19:34:08.348117] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-09-29T19:34:08.636584] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-29T19:34:08.982256] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-29T19:34:09.148141] [INFO ] [REMOTE ] KMX: Fetching primary data for 2024-12. [2025-09-29T19:34:09.948136] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-09-29T19:34:10.009806] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-29T19:34:10.748144] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-09-29T19:34:11.157050] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-29T19:34:11.461744] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-29T19:34:11.548155] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-09-29T19:34:12.348076] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-09-29T19:34:12.824704] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-29T19:34:12.961621] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-29T19:34:13.148121] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-09-29T19:34:13.919959] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-29T19:34:13.948087] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-09-29T19:34:14.748092] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-09-29T19:34:14.789415] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-29T19:34:15.420857] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-29T19:34:15.548131] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-09-29T19:34:16.348082] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-09-29T19:34:16.395985] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-29T19:34:17.148093] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-09-29T19:34:17.214893] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-29T19:34:17.828755] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-29T19:34:17.838363] [INFO ] [REMOTE ] KMPR: Full fetch complete (51204 records). [2025-09-29T19:34:17.838498] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-09-29T19:34:17.953226] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-01. [2025-09-29T19:34:18.258474] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-09-29T19:34:18.258615] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-09-29T19:34:18.259716] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-09-29T19:34:18.259807] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-09-29T19:34:18.261181] [DEBUG] [LOCAL ] KMPR: Trimmed 51204 records to 38685 (keeping 200 days of data) [2025-09-29T19:34:18.504852] [DEBUG] [LOCAL ] KMPR: Primary data saved (38685 records). [2025-09-29T19:34:18.505003] [INFO ] [MAIN ] KMPR: Full history saved. [2025-09-29T19:34:18.505091] [INFO ] [MAIN ] Update Progress: 1202/2371 symbols completed. KMPR took 25.2s. Estimated remaining: 2h 30m 1s. Rate: 7.8 symbols/min [2025-09-29T19:34:18.692226] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:34:18.734798] [DEBUG] [LOCAL ] KN: Loaded 39393 existing records from primary storage. [2025-09-29T19:34:18.735117] [INFO ] [MAIN ] KN: Loaded 39393 existing records. [2025-09-29T19:34:18.768952] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-09-29T19:34:18.927578] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:34:18.927969] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-09-29T19:34:18.928055] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-09-29T19:34:18.928476] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-09-29T19:34:18.928541] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-09-29T19:34:19.260821] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-29T19:34:19.373012] [INFO ] [REMOTE ] KN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:34:19.548136] [INFO ] [REMOTE ] KN: Fetching primary data for 2024-12. [2025-09-29T19:34:19.717436] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-29T19:34:20.001514] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-29T19:34:20.348099] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-09-29T19:34:20.494307] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-29T19:34:21.148154] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-09-29T19:34:21.670680] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-29T19:34:21.948109] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-09-29T19:34:22.748110] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-09-29T19:34:23.263609] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-29T19:34:23.304167] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-29T19:34:23.313232] [INFO ] [REMOTE ] KMT: Full fetch complete (62065 records). [2025-09-29T19:34:23.313424] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-09-29T19:34:23.554830] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-09-29T19:34:23.737286] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-09-29T19:34:23.737397] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-09-29T19:34:23.738421] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-09-29T19:34:23.738491] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-09-29T19:34:23.739928] [DEBUG] [LOCAL ] KMT: Trimmed 62065 records to 42985 (keeping 200 days of data) [2025-09-29T19:34:24.018712] [DEBUG] [LOCAL ] KMT: Primary data saved (42985 records). [2025-09-29T19:34:24.018893] [INFO ] [MAIN ] KMT: Full history saved. [2025-09-29T19:34:24.021916] [INFO ] [MAIN ] Update Progress: 1203/2371 symbols completed. KMT took 30.7s. Estimated remaining: 2h 29m 52s. Rate: 7.8 symbols/min [2025-09-29T19:34:24.202031] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:34:24.244965] [DEBUG] [LOCAL ] KNF: Loaded 36435 existing records from primary storage. [2025-09-29T19:34:24.245281] [INFO ] [MAIN ] KNF: Loaded 36435 existing records. [2025-09-29T19:34:24.351041] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-09-29T19:34:24.457379] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:34:24.457703] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-09-29T19:34:24.457786] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-09-29T19:34:24.458302] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-09-29T19:34:24.458383] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-09-29T19:34:24.941172] [INFO ] [REMOTE ] KNF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:34:24.936471] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-29T19:34:25.029167] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-29T19:34:25.148117] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-09-29T19:34:25.948090] [INFO ] [REMOTE ] KNF: Fetching primary data for 2024-12. [2025-09-29T19:34:26.224274] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-29T19:34:26.260128] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-29T19:34:26.748151] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-09-29T19:34:27.430011] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-29T19:34:27.548107] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-01. [2025-09-29T19:34:28.348096] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-09-29T19:34:28.617024] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-29T19:34:28.735610] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-29T19:34:29.148127] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-09-29T19:34:29.885830] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-29T19:34:29.948123] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-09-29T19:34:30.748087] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-09-29T19:34:31.059438] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-29T19:34:31.229202] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-29T19:34:31.548070] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-09-29T19:34:32.023856] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-29T19:34:32.348119] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-09-29T19:34:32.750305] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-29T19:34:33.148107] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-09-29T19:34:33.948095] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-09-29T19:34:34.391838] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-29T19:34:34.403983] [INFO ] [REMOTE ] KMI: Full fetch complete (77764 records). [2025-09-29T19:34:34.404160] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-09-29T19:34:34.748686] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-09-29T19:34:34.854905] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-09-29T19:34:34.855031] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-09-29T19:34:34.856445] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-09-29T19:34:34.856681] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-09-29T19:34:34.858428] [DEBUG] [LOCAL ] KMI: Trimmed 77764 records to 53693 (keeping 200 days of data) [2025-09-29T19:34:35.005734] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-29T19:34:35.248898] [DEBUG] [LOCAL ] KMI: Primary data saved (53693 records). [2025-09-29T19:34:35.249066] [INFO ] [MAIN ] KMI: Full history saved. [2025-09-29T19:34:35.249187] [INFO ] [MAIN ] Update Progress: 1204/2371 symbols completed. KMI took 42.0s. Estimated remaining: 2h 29m 47s. Rate: 7.8 symbols/min [2025-09-29T19:34:35.451830] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:34:35.475010] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-29T19:34:35.492408] [DEBUG] [LOCAL ] KNOP: Loaded 10274 existing records from primary storage. [2025-09-29T19:34:35.492725] [INFO ] [MAIN ] KNOP: Loaded 10274 existing records. [2025-09-29T19:34:35.555539] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-09-29T19:34:35.704619] [WARN ] [MAIN ] KNOP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:34:35.705046] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-09-29T19:34:35.705172] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-09-29T19:34:35.706229] [DEBUG] [LOCAL ] KNOP: Deleted primary data file. [2025-09-29T19:34:35.706309] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-09-29T19:34:36.069239] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-29T19:34:36.159286] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:34:36.348118] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2024-12. [2025-09-29T19:34:37.121974] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-29T19:34:37.148080] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-09-29T19:34:37.334817] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-29T19:34:37.948118] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-09-29T19:34:38.560455] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-29T19:34:38.748112] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-09-29T19:34:39.428153] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-29T19:34:39.548126] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-01. [2025-09-29T19:34:40.313383] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-29T19:34:40.312888] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-29T19:34:40.330811] [INFO ] [REMOTE ] KN: Full fetch complete (56375 records). [2025-09-29T19:34:40.331036] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-09-29T19:34:40.353197] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-09-29T19:34:40.761424] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-09-29T19:34:40.761522] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-09-29T19:34:40.762547] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-09-29T19:34:40.762620] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-09-29T19:34:40.764100] [DEBUG] [LOCAL ] KN: Trimmed 56375 records to 38615 (keeping 200 days of data) [2025-09-29T19:34:40.991813] [DEBUG] [LOCAL ] KN: Primary data saved (38615 records). [2025-09-29T19:34:40.991971] [INFO ] [MAIN ] KN: Full history saved. [2025-09-29T19:34:40.992057] [INFO ] [MAIN ] Update Progress: 1205/2371 symbols completed. KN took 22.5s. Estimated remaining: 2h 29m 38s. Rate: 7.8 symbols/min [2025-09-29T19:34:41.168117] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-09-29T19:34:41.171753] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:34:41.193493] [DEBUG] [LOCAL ] KNSL: Loaded 18372 existing records from primary storage. [2025-09-29T19:34:41.193795] [INFO ] [MAIN ] KNSL: Loaded 18372 existing records. [2025-09-29T19:34:41.389003] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:34:41.389295] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-09-29T19:34:41.389353] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-09-29T19:34:41.389626] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-09-29T19:34:41.389716] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-09-29T19:34:41.771011] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:34:41.948091] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-09-29T19:34:42.309396] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-29T19:34:42.566271] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-29T19:34:42.751625] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-09-29T19:34:42.754849] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-29T19:34:43.548180] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2024-12. [2025-09-29T19:34:44.348095] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-09-29T19:34:44.548254] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-29T19:34:44.737576] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-29T19:34:45.148152] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-01. [2025-09-29T19:34:45.418605] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-29T19:34:45.948129] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-09-29T19:34:46.374039] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-29T19:34:46.748159] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-09-29T19:34:46.859916] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-29T19:34:47.548161] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-09-29T19:34:47.650717] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-29T19:34:48.348114] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-09-29T19:34:49.013193] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-29T19:34:49.063684] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-29T19:34:49.148129] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-09-29T19:34:49.948134] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-09-29T19:34:50.748163] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-09-29T19:34:51.150514] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-29T19:34:51.369750] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-29T19:34:51.380817] [INFO ] [REMOTE ] KMX: Full fetch complete (75983 records). [2025-09-29T19:34:51.380992] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-09-29T19:34:51.556488] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-09-29T19:34:51.841018] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-09-29T19:34:51.841174] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-09-29T19:34:51.842328] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-09-29T19:34:51.842506] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-09-29T19:34:51.851851] [DEBUG] [LOCAL ] KMX: Trimmed 75983 records to 53147 (keeping 200 days of data) [2025-09-29T19:34:51.866874] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-29T19:34:52.201726] [DEBUG] [LOCAL ] KMX: Primary data saved (53147 records). [2025-09-29T19:34:52.201948] [INFO ] [MAIN ] KMX: Full history saved. [2025-09-29T19:34:52.202109] [INFO ] [MAIN ] Update Progress: 1206/2371 symbols completed. KMX took 46.0s. Estimated remaining: 2h 29m 33s. Rate: 7.8 symbols/min [2025-09-29T19:34:52.348696] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-29T19:34:52.348160] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-09-29T19:34:52.410545] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:34:52.463100] [DEBUG] [LOCAL ] KNTK: Loaded 46794 existing records from primary storage. [2025-09-29T19:34:52.463410] [INFO ] [MAIN ] KNTK: Loaded 46794 existing records. [2025-09-29T19:34:52.647860] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:34:52.648115] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-09-29T19:34:52.648171] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-09-29T19:34:52.648788] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-09-29T19:34:52.648849] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-09-29T19:34:53.053190] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:34:53.148181] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2024-12. [2025-09-29T19:34:53.400064] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-29T19:34:53.948141] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-09-29T19:34:54.547611] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-29T19:34:54.748130] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-09-29T19:34:54.797979] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-29T19:34:55.548102] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-01. [2025-09-29T19:34:55.780277] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-29T19:34:56.348123] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-09-29T19:34:57.117948] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-29T19:34:57.148075] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-09-29T19:34:57.556348] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-29T19:34:57.948176] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-09-29T19:34:58.677444] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-29T19:34:58.693739] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-29T19:34:58.748149] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-09-29T19:34:59.376774] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-29T19:34:59.548124] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-09-29T19:35:00.348110] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-09-29T19:35:00.400626] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-29T19:35:01.148178] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-09-29T19:35:01.948168] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-09-29T19:35:02.201334] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-29T19:35:02.212501] [INFO ] [REMOTE ] KNF: Full fetch complete (50597 records). [2025-09-29T19:35:02.212676] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-09-29T19:35:02.624854] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-09-29T19:35:02.625001] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-09-29T19:35:02.625912] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-09-29T19:35:02.625994] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-09-29T19:35:02.627570] [DEBUG] [LOCAL ] KNF: Trimmed 50597 records to 35771 (keeping 200 days of data) [2025-09-29T19:35:02.750924] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-09-29T19:35:02.874775] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-29T19:35:02.902239] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-29T19:35:02.908570] [INFO ] [REMOTE ] KNSL: Full fetch complete (26643 records). [2025-09-29T19:35:02.908978] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-09-29T19:35:03.229723] [DEBUG] [LOCAL ] KNF: Primary data saved (35771 records). [2025-09-29T19:35:03.229901] [INFO ] [MAIN ] KNF: Full history saved. [2025-09-29T19:35:03.230319] [INFO ] [MAIN ] Update Progress: 1207/2371 symbols completed. KNF took 39.2s. Estimated remaining: 2h 29m 29s. Rate: 7.8 symbols/min [2025-09-29T19:35:03.412909] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-09-29T19:35:03.418131] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-09-29T19:35:03.442202] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-09-29T19:35:03.447954] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-09-29T19:35:03.519353] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:35:03.518417] [DEBUG] [LOCAL ] KNSL: Trimmed 26643 records to 18116 (keeping 200 days of data) [2025-09-29T19:35:03.575485] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-09-29T19:35:03.625133] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-29T19:35:03.673173] [DEBUG] [LOCAL ] KNSL: Primary data saved (18116 records). [2025-09-29T19:35:03.687032] [INFO ] [MAIN ] KNSL: Full history saved. [2025-09-29T19:35:03.687198] [INFO ] [MAIN ] Update Progress: 1208/2371 symbols completed. KNSL took 22.7s. Estimated remaining: 2h 29m 14s. Rate: 7.8 symbols/min [2025-09-29T19:35:03.748921] [DEBUG] [LOCAL ] KNX: Loaded 53363 existing records from primary storage. [2025-09-29T19:35:03.778268] [INFO ] [MAIN ] KNX: Loaded 53363 existing records. [2025-09-29T19:35:04.039290] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:35:04.053351] [DEBUG] [LOCAL ] KO: No existing data file found in primary storage. [2025-09-29T19:35:04.055274] [WARN ] [MAIN ] KO: No existing data found, performing full refresh instead. [2025-09-29T19:35:04.076475] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-09-29T19:35:04.076608] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-09-29T19:35:04.080053] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:35:04.080351] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-09-29T19:35:04.080444] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-09-29T19:35:04.080548] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-09-29T19:35:04.085814] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-09-29T19:35:04.157174] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-09-29T19:35:04.168994] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-09-29T19:35:04.351550] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-09-29T19:35:04.821538] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:35:04.908570] [INFO ] [REMOTE ] KNX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:35:05.148120] [INFO ] [REMOTE ] KNX: Fetching primary data for 2024-12. [2025-09-29T19:35:05.248881] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-29T19:35:05.522832] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-29T19:35:05.526945] [INFO ] [REMOTE ] KNOP: Full fetch complete (14711 records). [2025-09-29T19:35:05.527109] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-09-29T19:35:05.916766] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-09-29T19:35:05.916849] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-09-29T19:35:05.917230] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-09-29T19:35:05.917293] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-09-29T19:35:05.917879] [DEBUG] [LOCAL ] KNOP: Trimmed 14711 records to 10275 (keeping 200 days of data) [2025-09-29T19:35:05.968630] [INFO ] [REMOTE ] KO: Fetching primary data for 2024-12. [2025-09-29T19:35:05.999283] [DEBUG] [LOCAL ] KNOP: Primary data saved (10275 records). [2025-09-29T19:35:05.999483] [INFO ] [MAIN ] KNOP: Full history saved. [2025-09-29T19:35:05.999607] [INFO ] [MAIN ] Update Progress: 1209/2371 symbols completed. KNOP took 30.8s. Estimated remaining: 2h 29m 1s. Rate: 7.8 symbols/min [2025-09-29T19:35:06.208255] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:35:06.258064] [DEBUG] [LOCAL ] KODK: Loaded 44025 existing records from primary storage. [2025-09-29T19:35:06.258394] [INFO ] [MAIN ] KODK: Loaded 44025 existing records. [2025-09-29T19:35:06.448227] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:35:06.448471] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-09-29T19:35:06.448520] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-09-29T19:35:06.449439] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-09-29T19:35:06.449506] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-09-29T19:35:06.754783] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-09-29T19:35:06.847275] [INFO ] [REMOTE ] KODK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:35:06.899852] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-29T19:35:07.548102] [INFO ] [REMOTE ] KODK: Fetching primary data for 2024-12. [2025-09-29T19:35:08.172284] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-29T19:35:08.348119] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-01. [2025-09-29T19:35:08.519200] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2024-12 (2.55 seconds). [2025-09-29T19:35:09.148151] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-09-29T19:35:09.385471] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-29T19:35:09.710772] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-29T19:35:09.948122] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-09-29T19:35:10.748169] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-09-29T19:35:11.549250] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-09-29T19:35:11.556386] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-29T19:35:11.643599] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (2.50 seconds). [2025-09-29T19:35:12.036564] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-29T19:35:12.348101] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-09-29T19:35:13.148119] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-09-29T19:35:13.237814] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-29T19:35:13.948149] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-09-29T19:35:14.121286] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-29T19:35:14.748116] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-09-29T19:35:15.478772] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-29T19:35:15.548142] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-09-29T19:35:15.598147] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-09-29T19:35:16.348164] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-09-29T19:35:16.651899] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-29T19:35:17.155387] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-09-29T19:35:17.174826] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-29T19:35:17.948180] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-09-29T19:35:18.113847] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-29T19:35:18.748121] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-09-29T19:35:18.849637] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-29T19:35:19.548168] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-09-29T19:35:19.650479] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-29T19:35:20.348096] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-09-29T19:35:20.474817] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-29T19:35:21.148117] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-09-29T19:35:21.950482] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-09-29T19:35:21.953514] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-29T19:35:22.214937] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.67 seconds). [2025-09-29T19:35:22.748153] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-09-29T19:35:22.918825] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-29T19:35:23.548152] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-09-29T19:35:23.940035] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-29T19:35:23.952448] [INFO ] [REMOTE ] KNTK: Full fetch complete (64365 records). [2025-09-29T19:35:23.952600] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-09-29T19:35:24.351239] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-09-29T19:35:24.404418] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-09-29T19:35:24.404773] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-09-29T19:35:24.406346] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-09-29T19:35:24.407747] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-09-29T19:35:24.407634] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-29T19:35:24.418694] [DEBUG] [LOCAL ] KNTK: Trimmed 64365 records to 46082 (keeping 200 days of data) [2025-09-29T19:35:24.711832] [DEBUG] [LOCAL ] KNTK: Primary data saved (46082 records). [2025-09-29T19:35:24.711968] [INFO ] [MAIN ] KNTK: Full history saved. [2025-09-29T19:35:24.712054] [INFO ] [MAIN ] Update Progress: 1210/2371 symbols completed. KNTK took 32.5s. Estimated remaining: 2h 29m 4s. Rate: 7.8 symbols/min [2025-09-29T19:35:24.896123] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:35:24.932143] [DEBUG] [LOCAL ] KOF: Loaded 26219 existing records from primary storage. [2025-09-29T19:35:24.932479] [INFO ] [MAIN ] KOF: Loaded 26219 existing records. [2025-09-29T19:35:25.133790] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:35:25.134019] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-09-29T19:35:25.134069] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-09-29T19:35:25.134900] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-09-29T19:35:25.134962] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-09-29T19:35:25.170047] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-09-29T19:35:25.533978] [INFO ] [REMOTE ] KOF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:35:25.948118] [INFO ] [REMOTE ] KOF: Fetching primary data for 2024-12. [2025-09-29T19:35:26.111711] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.56 seconds). [2025-09-29T19:35:26.162839] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-29T19:35:26.748142] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-09-29T19:35:26.861394] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-29T19:35:27.115085] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-29T19:35:27.548261] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-01. [2025-09-29T19:35:28.348095] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-09-29T19:35:28.453255] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-29T19:35:28.574245] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-29T19:35:29.148124] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-09-29T19:35:29.948130] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-09-29T19:35:30.514192] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-29T19:35:30.748136] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-09-29T19:35:31.029168] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (2.68 seconds). [2025-09-29T19:35:31.563008] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-09-29T19:35:31.575368] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-29T19:35:31.591935] [INFO ] [REMOTE ] KNX: Full fetch complete (75764 records). [2025-09-29T19:35:31.592206] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-09-29T19:35:32.022839] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-29T19:35:32.085890] [INFO ] [REMOTE ] KODK: Full fetch complete (63471 records). [2025-09-29T19:35:32.086144] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-09-29T19:35:32.367045] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-09-29T19:35:32.576259] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-09-29T19:35:32.589492] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-09-29T19:35:32.644259] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-09-29T19:35:32.662709] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-09-29T19:35:32.776957] [DEBUG] [LOCAL ] KNX: Trimmed 75764 records to 52588 (keeping 200 days of data) [2025-09-29T19:35:32.781971] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-09-29T19:35:32.782569] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-09-29T19:35:32.783430] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-09-29T19:35:32.783581] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-09-29T19:35:32.867037] [DEBUG] [LOCAL ] KODK: Trimmed 63471 records to 43409 (keeping 200 days of data) [2025-09-29T19:35:32.868845] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-29T19:35:33.148402] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-09-29T19:35:33.412997] [DEBUG] [LOCAL ] KODK: Primary data saved (43409 records). [2025-09-29T19:35:33.413730] [INFO ] [MAIN ] KODK: Full history saved. [2025-09-29T19:35:33.414168] [INFO ] [MAIN ] Update Progress: 1211/2371 symbols completed. KODK took 27.4s. Estimated remaining: 2h 28m 58s. Rate: 7.8 symbols/min [2025-09-29T19:35:33.530813] [DEBUG] [LOCAL ] KNX: Primary data saved (52588 records). [2025-09-29T19:35:33.546747] [INFO ] [MAIN ] KNX: Full history saved. [2025-09-29T19:35:33.552021] [INFO ] [MAIN ] Update Progress: 1212/2371 symbols completed. KNX took 30.3s. Estimated remaining: 2h 28m 43s. Rate: 7.8 symbols/min [2025-09-29T19:35:33.646682] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:35:33.806483] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:35:33.814398] [DEBUG] [LOCAL ] KOP: Loaded 18066 existing records from primary storage. [2025-09-29T19:35:33.814838] [INFO ] [MAIN ] KOP: Loaded 18066 existing records. [2025-09-29T19:35:33.901742] [DEBUG] [LOCAL ] KORE: Loaded 2010 existing records from primary storage. [2025-09-29T19:35:33.921958] [INFO ] [MAIN ] KORE: Loaded 2010 existing records. [2025-09-29T19:35:34.119574] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:35:34.166008] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-09-29T19:35:34.176288] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-09-29T19:35:34.205394] [WARN ] [MAIN ] KORE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:35:34.205823] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-09-29T19:35:34.206108] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-09-29T19:35:34.212326] [DEBUG] [LOCAL ] KORE: Deleted primary data file. [2025-09-29T19:35:34.212254] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-09-29T19:35:34.219220] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-09-29T19:35:34.232970] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-09-29T19:35:34.314965] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-29T19:35:34.409137] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-09-29T19:35:35.004471] [INFO ] [REMOTE ] KORE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:35:35.010131] [INFO ] [REMOTE ] KORE: Fetching primary data for 2024-12. [2025-09-29T19:35:35.070885] [INFO ] [REMOTE ] KOP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:35:35.108897] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.74 seconds). [2025-09-29T19:35:35.517752] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-29T19:35:35.548129] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-09-29T19:35:36.225427] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-29T19:35:36.348109] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-09-29T19:35:37.148114] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-09-29T19:35:37.216376] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-29T19:35:37.948090] [INFO ] [REMOTE ] KOP: Fetching primary data for 2024-12. [2025-09-29T19:35:38.351632] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-29T19:35:38.589439] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (3.04 seconds). [2025-09-29T19:35:38.748116] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-09-29T19:35:38.848006] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-29T19:35:39.548108] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-09-29T19:35:40.108094] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-29T19:35:40.348130] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-01. [2025-09-29T19:35:41.148113] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-09-29T19:35:41.343247] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-29T19:35:41.434925] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.69 seconds). [2025-09-29T19:35:41.625539] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-29T19:35:41.948136] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-09-29T19:35:42.317204] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-29T19:35:42.748138] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-09-29T19:35:43.548162] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-09-29T19:35:44.072719] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-29T19:35:44.072569] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-29T19:35:44.348200] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-09-29T19:35:44.789081] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-29T19:35:45.148129] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-09-29T19:35:45.948121] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-09-29T19:35:46.520216] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-29T19:35:46.748144] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-09-29T19:35:47.548142] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-09-29T19:35:47.687880] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-29T19:35:47.739126] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (2.59 seconds). [2025-09-29T19:35:47.749801] [INFO ] [REMOTE ] KO: Full fetch complete (77214 records). [2025-09-29T19:35:47.749981] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-09-29T19:35:47.976906] [WARN ] [VALIDATOR ] KO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-29T19:35:47.977827] [FATAL] [MAIN ] KO: Fetched primary data is invalid. Refusing to save it. [2025-09-29T19:35:47.977904] [WARN ] [MAIN ] KO: Deleting existing primary and derivative data due to validation failure. [2025-09-29T19:35:47.977979] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-09-29T19:35:47.978053] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-09-29T19:35:47.978104] [INFO ] [LOCAL ] KO: Starting deletion of derivative data. [2025-09-29T19:35:47.978207] [DEBUG] [LOCAL ] KO: No derivative data file found to delete. [2025-09-29T19:35:47.978313] [INFO ] [MAIN ] Update Progress: 1213/2371 symbols completed. KO took 44.3s. Estimated remaining: 2h 28m 41s. Rate: 7.8 symbols/min [2025-09-29T19:35:48.065823] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-29T19:35:48.172865] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:35:48.240898] [DEBUG] [LOCAL ] KOS: Loaded 53828 existing records from primary storage. [2025-09-29T19:35:48.241310] [INFO ] [MAIN ] KOS: Loaded 53828 existing records. [2025-09-29T19:35:48.349511] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-09-29T19:35:48.438016] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:35:48.438255] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-09-29T19:35:48.438303] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-09-29T19:35:48.438591] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-09-29T19:35:48.438685] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-09-29T19:35:48.808102] [INFO ] [REMOTE ] KOS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:35:49.148125] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-09-29T19:35:49.515427] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-29T19:35:49.783234] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-29T19:35:49.784499] [INFO ] [REMOTE ] KORE: Full fetch complete (6017 records). [2025-09-29T19:35:49.784584] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-09-29T19:35:49.955784] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-09-29T19:35:50.198734] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-09-29T19:35:50.198833] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-09-29T19:35:50.199009] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-09-29T19:35:50.199061] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-09-29T19:35:50.199678] [DEBUG] [LOCAL ] KORE: Trimmed 6017 records to 1992 (keeping 200 days of data) [2025-09-29T19:35:50.211940] [DEBUG] [LOCAL ] KORE: Primary data saved (1992 records). [2025-09-29T19:35:50.212068] [INFO ] [MAIN ] KORE: Full history saved. [2025-09-29T19:35:50.212178] [INFO ] [MAIN ] Update Progress: 1214/2371 symbols completed. KORE took 16.6s. Estimated remaining: 2h 28m 28s. Rate: 7.8 symbols/min [2025-09-29T19:35:50.396194] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:35:50.450145] [DEBUG] [LOCAL ] KR: Loaded 54461 existing records from primary storage. [2025-09-29T19:35:50.450482] [INFO ] [MAIN ] KR: Loaded 54461 existing records. [2025-09-29T19:35:50.650262] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:35:50.650577] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-09-29T19:35:50.650638] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-09-29T19:35:50.650998] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-09-29T19:35:50.651058] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-09-29T19:35:50.753391] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-09-29T19:35:51.071623] [INFO ] [REMOTE ] KR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:35:51.088919] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-29T19:35:51.548130] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-09-29T19:35:51.895837] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-29T19:35:52.348121] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-09-29T19:35:52.492471] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-29T19:35:53.052433] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-29T19:35:53.148124] [INFO ] [REMOTE ] KOS: Fetching primary data for 2024-12. [2025-09-29T19:35:53.948142] [INFO ] [REMOTE ] KR: Fetching primary data for 2024-12. [2025-09-29T19:35:54.748129] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-09-29T19:35:54.810105] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-29T19:35:55.548139] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-01. [2025-09-29T19:35:55.655427] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-29T19:35:55.846941] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-29T19:35:56.348156] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-09-29T19:35:57.153258] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-01. [2025-09-29T19:35:57.173574] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-29T19:35:57.400817] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-29T19:35:57.948140] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-09-29T19:35:58.748129] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-09-29T19:35:59.007445] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-29T19:35:59.548101] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-09-29T19:35:59.648947] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-29T19:36:00.151470] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-29T19:36:00.157575] [INFO ] [REMOTE ] KOF: Full fetch complete (36994 records). [2025-09-29T19:36:00.157739] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-09-29T19:36:00.353205] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-09-29T19:36:00.567284] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-09-29T19:36:00.567374] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-09-29T19:36:00.568188] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-09-29T19:36:00.568253] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-09-29T19:36:00.569423] [DEBUG] [LOCAL ] KOF: Trimmed 36994 records to 25940 (keeping 200 days of data) [2025-09-29T19:36:00.742307] [DEBUG] [LOCAL ] KOF: Primary data saved (25940 records). [2025-09-29T19:36:00.742462] [INFO ] [MAIN ] KOF: Full history saved. [2025-09-29T19:36:00.742551] [INFO ] [MAIN ] Update Progress: 1215/2371 symbols completed. KOF took 36.0s. Estimated remaining: 2h 28m 23s. Rate: 7.8 symbols/min [2025-09-29T19:36:00.925741] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:36:00.973039] [DEBUG] [LOCAL ] KRC: Loaded 49114 existing records from primary storage. [2025-09-29T19:36:00.973387] [INFO ] [MAIN ] KRC: Loaded 49114 existing records. [2025-09-29T19:36:01.148088] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-09-29T19:36:01.171495] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:36:01.172419] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-09-29T19:36:01.172483] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-09-29T19:36:01.172932] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-09-29T19:36:01.172994] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-09-29T19:36:01.569148] [INFO ] [REMOTE ] KRC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:36:01.598858] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-29T19:36:01.948126] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-09-29T19:36:02.273259] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-29T19:36:02.291917] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-29T19:36:02.748152] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-09-29T19:36:03.548140] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-09-29T19:36:03.911813] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-29T19:36:03.916410] [INFO ] [REMOTE ] KOP: Full fetch complete (25438 records). [2025-09-29T19:36:03.916496] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-09-29T19:36:04.277208] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-29T19:36:04.351879] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-09-29T19:36:04.352088] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-09-29T19:36:04.352260] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-09-29T19:36:04.353859] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-09-29T19:36:04.353927] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-09-29T19:36:04.354724] [DEBUG] [LOCAL ] KOP: Trimmed 25438 records to 17654 (keeping 200 days of data) [2025-09-29T19:36:04.467519] [DEBUG] [LOCAL ] KOP: Primary data saved (17654 records). [2025-09-29T19:36:04.467721] [INFO ] [MAIN ] KOP: Full history saved. [2025-09-29T19:36:04.467847] [INFO ] [MAIN ] Update Progress: 1216/2371 symbols completed. KOP took 31.1s. Estimated remaining: 2h 28m 12s. Rate: 7.8 symbols/min [2025-09-29T19:36:04.656523] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:36:04.694423] [DEBUG] [LOCAL ] KREF: Loaded 37767 existing records from primary storage. [2025-09-29T19:36:04.694840] [INFO ] [MAIN ] KREF: Loaded 37767 existing records. [2025-09-29T19:36:04.893126] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:36:04.893530] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-09-29T19:36:04.893684] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-09-29T19:36:04.893928] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-09-29T19:36:04.893987] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-09-29T19:36:05.155527] [INFO ] [REMOTE ] KRC: Fetching primary data for 2024-12. [2025-09-29T19:36:05.297636] [INFO ] [REMOTE ] KREF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:36:05.331387] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-29T19:36:05.948128] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-09-29T19:36:06.484427] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-29T19:36:06.748107] [INFO ] [REMOTE ] KREF: Fetching primary data for 2024-12. [2025-09-29T19:36:06.819356] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-29T19:36:07.553239] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-01. [2025-09-29T19:36:07.572607] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-29T19:36:08.115569] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-29T19:36:08.348132] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-09-29T19:36:09.152162] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-09-29T19:36:09.160249] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-29T19:36:09.640218] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-29T19:36:09.948117] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-09-29T19:36:10.748142] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-09-29T19:36:10.818308] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-29T19:36:11.179528] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-29T19:36:11.548124] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-09-29T19:36:12.348120] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-09-29T19:36:13.148078] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-09-29T19:36:13.327087] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-29T19:36:13.492758] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (2.74 seconds). [2025-09-29T19:36:13.948147] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-09-29T19:36:14.268512] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-29T19:36:14.740055] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-29T19:36:14.751301] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-09-29T19:36:15.548114] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-09-29T19:36:15.601467] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-29T19:36:16.316734] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-29T19:36:16.348110] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-09-29T19:36:17.148089] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-09-29T19:36:17.481372] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-29T19:36:17.864701] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-29T19:36:17.948103] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-09-29T19:36:18.748136] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-09-29T19:36:18.948398] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-29T19:36:19.548170] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-09-29T19:36:19.842488] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-29T19:36:20.348092] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-09-29T19:36:20.421504] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-29T19:36:21.037155] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-29T19:36:21.148116] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-09-29T19:36:21.948117] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-09-29T19:36:22.640519] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-29T19:36:22.748100] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-09-29T19:36:22.840302] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-09-29T19:36:22.851695] [INFO ] [REMOTE ] KR: Full fetch complete (77678 records). [2025-09-29T19:36:22.851905] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-09-29T19:36:23.277276] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-09-29T19:36:23.277443] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-09-29T19:36:23.278873] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-09-29T19:36:23.278957] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-09-29T19:36:23.280970] [DEBUG] [LOCAL ] KR: Trimmed 77678 records to 53681 (keeping 200 days of data) [2025-09-29T19:36:23.426668] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-29T19:36:23.553327] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-09-29T19:36:23.689803] [DEBUG] [LOCAL ] KR: Primary data saved (53681 records). [2025-09-29T19:36:23.689971] [INFO ] [MAIN ] KR: Full history saved. [2025-09-29T19:36:23.690073] [INFO ] [MAIN ] Update Progress: 1217/2371 symbols completed. KR took 33.5s. Estimated remaining: 2h 28m 15s. Rate: 7.8 symbols/min [2025-09-29T19:36:23.872829] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:36:23.919874] [DEBUG] [LOCAL ] KRG: Loaded 49859 existing records from primary storage. [2025-09-29T19:36:23.920821] [INFO ] [MAIN ] KRG: Loaded 49859 existing records. [2025-09-29T19:36:24.102073] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:36:24.102333] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-09-29T19:36:24.102380] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-09-29T19:36:24.102801] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-09-29T19:36:24.102859] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-09-29T19:36:24.356976] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-09-29T19:36:24.512841] [INFO ] [REMOTE ] KRG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:36:24.772508] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-29T19:36:24.784383] [INFO ] [REMOTE ] KOS: Full fetch complete (76833 records). [2025-09-29T19:36:24.784597] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-09-29T19:36:25.153377] [INFO ] [REMOTE ] KRG: Fetching primary data for 2024-12. [2025-09-29T19:36:25.321445] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-29T19:36:25.490522] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-09-29T19:36:25.490707] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-09-29T19:36:25.492130] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-09-29T19:36:25.492213] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-09-29T19:36:25.493996] [DEBUG] [LOCAL ] KOS: Trimmed 76833 records to 53047 (keeping 200 days of data) [2025-09-29T19:36:25.807143] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-29T19:36:25.929352] [DEBUG] [LOCAL ] KOS: Primary data saved (53047 records). [2025-09-29T19:36:25.929504] [INFO ] [MAIN ] KOS: Full history saved. [2025-09-29T19:36:25.929592] [INFO ] [MAIN ] Update Progress: 1218/2371 symbols completed. KOS took 38.0s. Estimated remaining: 2h 28m 2s. Rate: 7.8 symbols/min [2025-09-29T19:36:25.953315] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-09-29T19:36:26.122689] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:36:26.122927] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-09-29T19:36:26.122984] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-09-29T19:36:26.123098] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-09-29T19:36:26.123174] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-09-29T19:36:26.123239] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-09-29T19:36:26.123274] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-09-29T19:36:26.518969] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:36:26.550007] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-29T19:36:26.748175] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2024-12. [2025-09-29T19:36:26.964089] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T19:36:26.964427] [WARN ] [REMOTE ] KRMN: No data returned for month 2024-12 [2025-09-29T19:36:26.964520] [FATAL] [REMOTE ] KRMN: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T19:36:26.964568] [FATAL] [MAIN ] KRMN: Failed to fetch primary data. [2025-09-29T19:36:26.964605] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T19:36:26.964694] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-09-29T19:36:26.964783] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-09-29T19:36:26.964841] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-09-29T19:36:26.964902] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-09-29T19:36:26.964973] [INFO ] [MAIN ] Update Progress: 1219/2371 symbols completed. KRMN took 1.0s. Estimated remaining: 2h 27m 48s. Rate: 7.8 symbols/min [2025-09-29T19:36:27.152867] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:36:27.177380] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-29T19:36:27.186375] [INFO ] [REMOTE ] KREF: Full fetch complete (52173 records). [2025-09-29T19:36:27.186545] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-09-29T19:36:27.326997] [DEBUG] [LOCAL ] KRO: Loaded 26448 existing records from primary storage. [2025-09-29T19:36:27.328080] [INFO ] [MAIN ] KRO: Loaded 26448 existing records. [2025-09-29T19:36:27.551754] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-09-29T19:36:27.696980] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:36:27.725697] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-09-29T19:36:27.748888] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-09-29T19:36:27.749388] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-09-29T19:36:27.759965] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-09-29T19:36:27.961157] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-09-29T19:36:27.966721] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-09-29T19:36:27.978169] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-09-29T19:36:27.988551] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-09-29T19:36:28.111472] [DEBUG] [LOCAL ] KREF: Trimmed 52173 records to 37243 (keeping 200 days of data) [2025-09-29T19:36:28.350266] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-01. [2025-09-29T19:36:28.390893] [INFO ] [REMOTE ] KRO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:36:28.559862] [DEBUG] [LOCAL ] KREF: Primary data saved (37243 records). [2025-09-29T19:36:28.560011] [INFO ] [MAIN ] KREF: Full history saved. [2025-09-29T19:36:28.560094] [INFO ] [MAIN ] Update Progress: 1220/2371 symbols completed. KREF took 24.1s. Estimated remaining: 2h 27m 35s. Rate: 7.8 symbols/min [2025-09-29T19:36:28.892554] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:36:28.940459] [DEBUG] [LOCAL ] KRP: Loaded 37947 existing records from primary storage. [2025-09-29T19:36:28.940821] [INFO ] [MAIN ] KRP: Loaded 37947 existing records. [2025-09-29T19:36:29.136208] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:36:29.136550] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-09-29T19:36:29.136720] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-09-29T19:36:29.137243] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-09-29T19:36:29.137307] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-09-29T19:36:29.158216] [INFO ] [REMOTE ] KRO: Fetching primary data for 2024-12. [2025-09-29T19:36:29.404792] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-29T19:36:29.600223] [INFO ] [REMOTE ] KRP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:36:29.948089] [INFO ] [REMOTE ] KRP: Fetching primary data for 2024-12. [2025-09-29T19:36:29.987420] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-29T19:36:30.300877] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-29T19:36:30.748126] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-09-29T19:36:30.905095] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-29T19:36:31.548136] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-09-29T19:36:32.311686] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-29T19:36:32.348171] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-09-29T19:36:33.148140] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-01. [2025-09-29T19:36:33.236719] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-29T19:36:33.948170] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-09-29T19:36:34.062604] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-29T19:36:34.213086] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-29T19:36:34.748125] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-09-29T19:36:35.161189] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-29T19:36:35.548124] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-09-29T19:36:36.348130] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-09-29T19:36:36.515586] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-29T19:36:36.554049] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-29T19:36:37.148109] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-09-29T19:36:37.926090] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-29T19:36:37.948081] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-09-29T19:36:38.271223] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-29T19:36:38.748116] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-09-29T19:36:39.548076] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-09-29T19:36:39.732013] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-29T19:36:39.742943] [INFO ] [REMOTE ] KRC: Full fetch complete (69777 records). [2025-09-29T19:36:39.743125] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-09-29T19:36:40.170925] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-09-29T19:36:40.171129] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-09-29T19:36:40.172245] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-09-29T19:36:40.172328] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-09-29T19:36:40.173715] [DEBUG] [LOCAL ] KRC: Trimmed 69777 records to 48355 (keeping 200 days of data) [2025-09-29T19:36:40.291113] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-29T19:36:40.381286] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-09-29T19:36:40.504685] [DEBUG] [LOCAL ] KRC: Primary data saved (48355 records). [2025-09-29T19:36:40.504846] [INFO ] [MAIN ] KRC: Full history saved. [2025-09-29T19:36:40.504955] [INFO ] [MAIN ] Update Progress: 1221/2371 symbols completed. KRC took 39.8s. Estimated remaining: 2h 27m 31s. Rate: 7.8 symbols/min [2025-09-29T19:36:40.684212] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:36:40.737846] [DEBUG] [LOCAL ] KSS: Loaded 54385 existing records from primary storage. [2025-09-29T19:36:40.738272] [INFO ] [MAIN ] KSS: Loaded 54385 existing records. [2025-09-29T19:36:40.936602] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:36:40.936984] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-09-29T19:36:40.937073] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-09-29T19:36:40.937387] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-09-29T19:36:40.937451] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-09-29T19:36:41.153980] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-09-29T19:36:41.329562] [INFO ] [REMOTE ] KSS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:36:41.376066] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-29T19:36:41.387610] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-29T19:36:41.948115] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-09-29T19:36:42.748091] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-09-29T19:36:42.840982] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-29T19:36:43.205296] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-29T19:36:43.548126] [INFO ] [REMOTE ] KSS: Fetching primary data for 2024-12. [2025-09-29T19:36:44.348109] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-09-29T19:36:44.393523] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-29T19:36:45.148098] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-09-29T19:36:45.631527] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-29T19:36:45.796572] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-29T19:36:45.948109] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-09-29T19:36:46.748142] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-09-29T19:36:47.260105] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-29T19:36:47.548100] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-09-29T19:36:47.904137] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-29T19:36:47.975470] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-29T19:36:48.348140] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-09-29T19:36:48.904127] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-29T19:36:49.148149] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-09-29T19:36:49.480268] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-29T19:36:49.948124] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-09-29T19:36:50.748137] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-09-29T19:36:51.123042] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-29T19:36:51.548104] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-09-29T19:36:51.817705] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-29T19:36:51.831741] [INFO ] [REMOTE ] KRG: Full fetch complete (71094 records). [2025-09-29T19:36:51.831919] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-09-29T19:36:52.278487] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-09-29T19:36:52.279264] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-09-29T19:36:52.280841] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-09-29T19:36:52.281102] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-09-29T19:36:52.321577] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-29T19:36:52.323335] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-29T19:36:52.337582] [DEBUG] [LOCAL ] KRG: Trimmed 71094 records to 49153 (keeping 200 days of data) [2025-09-29T19:36:52.396685] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-09-29T19:36:52.661293] [DEBUG] [LOCAL ] KRG: Primary data saved (49153 records). [2025-09-29T19:36:52.661458] [INFO ] [MAIN ] KRG: Full history saved. [2025-09-29T19:36:52.661573] [INFO ] [MAIN ] Update Progress: 1222/2371 symbols completed. KRG took 29.0s. Estimated remaining: 2h 27m 28s. Rate: 7.8 symbols/min [2025-09-29T19:36:52.852601] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:36:52.898585] [DEBUG] [LOCAL ] KT: Loaded 46336 existing records from primary storage. [2025-09-29T19:36:52.898947] [INFO ] [MAIN ] KT: Loaded 46336 existing records. [2025-09-29T19:36:53.086808] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:36:53.087104] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-09-29T19:36:53.087172] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-09-29T19:36:53.087638] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-09-29T19:36:53.087764] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-09-29T19:36:53.153325] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-09-29T19:36:53.466332] [INFO ] [REMOTE ] KT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:36:53.663874] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-29T19:36:53.948144] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-09-29T19:36:54.748166] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-09-29T19:36:55.254119] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-29T19:36:55.324869] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-29T19:36:55.548141] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-09-29T19:36:55.777859] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-29T19:36:56.348156] [INFO ] [REMOTE ] KT: Fetching primary data for 2024-12. [2025-09-29T19:36:56.927084] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-29T19:36:56.933681] [INFO ] [REMOTE ] KRO: Full fetch complete (34883 records). [2025-09-29T19:36:56.933848] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-09-29T19:36:57.154057] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-09-29T19:36:57.340797] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-09-29T19:36:57.340893] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-09-29T19:36:57.341719] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-09-29T19:36:57.341785] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-09-29T19:36:57.342848] [DEBUG] [LOCAL ] KRO: Trimmed 34883 records to 26010 (keeping 200 days of data) [2025-09-29T19:36:57.502346] [DEBUG] [LOCAL ] KRO: Primary data saved (26010 records). [2025-09-29T19:36:57.502515] [INFO ] [MAIN ] KRO: Full history saved. [2025-09-29T19:36:57.502627] [INFO ] [MAIN ] Update Progress: 1223/2371 symbols completed. KRO took 30.5s. Estimated remaining: 2h 27m 17s. Rate: 7.8 symbols/min [2025-09-29T19:36:57.690209] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:36:57.730114] [DEBUG] [LOCAL ] KTB: Loaded 41738 existing records from primary storage. [2025-09-29T19:36:57.730430] [INFO ] [MAIN ] KTB: Loaded 41738 existing records. [2025-09-29T19:36:57.932284] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:36:57.932526] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-09-29T19:36:57.932686] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-09-29T19:36:57.933065] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-09-29T19:36:57.933135] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-09-29T19:36:57.966146] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-09-29T19:36:58.103112] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-29T19:36:58.360041] [INFO ] [REMOTE ] KTB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:36:58.663349] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-29T19:36:58.670896] [INFO ] [REMOTE ] KRP: Full fetch complete (54850 records). [2025-09-29T19:36:58.671072] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-09-29T19:36:58.753207] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-01. [2025-09-29T19:36:59.073934] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-09-29T19:36:59.074037] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-09-29T19:36:59.075134] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-09-29T19:36:59.075206] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-09-29T19:36:59.077129] [DEBUG] [LOCAL ] KRP: Trimmed 54850 records to 37163 (keeping 200 days of data) [2025-09-29T19:36:59.320953] [DEBUG] [LOCAL ] KRP: Primary data saved (37163 records). [2025-09-29T19:36:59.321103] [INFO ] [MAIN ] KRP: Full history saved. [2025-09-29T19:36:59.321189] [INFO ] [MAIN ] Update Progress: 1224/2371 symbols completed. KRP took 30.8s. Estimated remaining: 2h 27m 4s. Rate: 7.8 symbols/min [2025-09-29T19:36:59.502910] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:36:59.520001] [DEBUG] [LOCAL ] KTF: Loaded 13065 existing records from primary storage. [2025-09-29T19:36:59.520237] [INFO ] [MAIN ] KTF: Loaded 13065 existing records. [2025-09-29T19:36:59.552835] [INFO ] [REMOTE ] KTB: Fetching primary data for 2024-12. [2025-09-29T19:36:59.717524] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:36:59.717774] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-09-29T19:36:59.717829] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-09-29T19:36:59.718166] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-09-29T19:36:59.718228] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-09-29T19:37:00.103485] [INFO ] [REMOTE ] KTF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:37:00.140001] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-29T19:37:00.355171] [INFO ] [REMOTE ] KTF: Fetching primary data for 2024-12. [2025-09-29T19:37:00.374376] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-29T19:37:01.155412] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-09-29T19:37:01.157925] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-29T19:37:01.390348] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-29T19:37:01.948116] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-01. [2025-09-29T19:37:02.753231] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-09-29T19:37:02.769354] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-29T19:37:03.291135] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-29T19:37:03.306127] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-29T19:37:03.548113] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-09-29T19:37:04.327864] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-29T19:37:04.348099] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-09-29T19:37:05.148170] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-09-29T19:37:05.353463] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-29T19:37:05.948116] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-09-29T19:37:06.748118] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-09-29T19:37:07.334109] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-29T19:37:07.408087] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-29T19:37:07.548165] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-09-29T19:37:08.281321] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-29T19:37:08.348114] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-09-29T19:37:08.601690] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-29T19:37:09.148110] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-09-29T19:37:09.953451] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-09-29T19:37:09.959118] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-29T19:37:10.748076] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-09-29T19:37:10.828937] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-29T19:37:11.092770] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-29T19:37:11.548113] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-09-29T19:37:12.351531] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-09-29T19:37:12.357145] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-29T19:37:12.448379] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-29T19:37:13.148149] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-09-29T19:37:13.948130] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-09-29T19:37:14.604776] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-29T19:37:14.748091] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-09-29T19:37:14.801065] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-29T19:37:14.931933] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-29T19:37:15.548145] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-09-29T19:37:16.245584] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-29T19:37:16.348132] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-09-29T19:37:17.123530] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-29T19:37:17.148433] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-09-29T19:37:17.152016] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-29T19:37:17.948188] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-09-29T19:37:18.683723] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-29T19:37:18.748173] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-09-29T19:37:19.548112] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-09-29T19:37:20.103172] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-29T19:37:20.250712] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-29T19:37:20.348118] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-09-29T19:37:20.457392] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-29T19:37:20.460110] [INFO ] [REMOTE ] KTF: Full fetch complete (18040 records). [2025-09-29T19:37:20.460216] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-09-29T19:37:20.873754] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-09-29T19:37:20.873830] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-09-29T19:37:20.874236] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-09-29T19:37:20.874306] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-09-29T19:37:20.874931] [DEBUG] [LOCAL ] KTF: Trimmed 18040 records to 12803 (keeping 200 days of data) [2025-09-29T19:37:20.954847] [DEBUG] [LOCAL ] KTF: Primary data saved (12803 records). [2025-09-29T19:37:20.954994] [INFO ] [MAIN ] KTF: Full history saved. [2025-09-29T19:37:20.955080] [INFO ] [MAIN ] Update Progress: 1225/2371 symbols completed. KTF took 21.6s. Estimated remaining: 2h 27m 9s. Rate: 7.8 symbols/min [2025-09-29T19:37:21.135706] [INFO ] [MAIN ] KUKE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:37:21.135932] [DEBUG] [LOCAL ] KUKE: No existing data file found in primary storage. [2025-09-29T19:37:21.135985] [WARN ] [MAIN ] KUKE: No existing data found, performing full refresh instead. [2025-09-29T19:37:21.136097] [INFO ] [MAIN ] KUKE: Wiping existing primary data before full refresh. [2025-09-29T19:37:21.136139] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-09-29T19:37:21.136182] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-09-29T19:37:21.136216] [INFO ] [MAIN ] KUKE: Starting full primary refresh. [2025-09-29T19:37:21.157369] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-09-29T19:37:21.525956] [INFO ] [REMOTE ] KUKE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:37:21.948113] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2024-12. [2025-09-29T19:37:22.503568] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-29T19:37:22.515816] [INFO ] [REMOTE ] KSS: Full fetch complete (77637 records). [2025-09-29T19:37:22.515994] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-09-29T19:37:22.582056] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-29T19:37:22.753268] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-01. [2025-09-29T19:37:22.970298] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-09-29T19:37:22.970419] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-09-29T19:37:22.971944] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-09-29T19:37:22.972045] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-09-29T19:37:22.998724] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-29T19:37:23.008406] [DEBUG] [LOCAL ] KSS: Trimmed 77637 records to 53605 (keeping 200 days of data) [2025-09-29T19:37:23.358175] [DEBUG] [LOCAL ] KSS: Primary data saved (53605 records). [2025-09-29T19:37:23.358357] [INFO ] [MAIN ] KSS: Full history saved. [2025-09-29T19:37:23.358468] [INFO ] [MAIN ] Update Progress: 1226/2371 symbols completed. KSS took 42.9s. Estimated remaining: 2h 26m 57s. Rate: 7.8 symbols/min [2025-09-29T19:37:23.552242] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:37:23.548260] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-09-29T19:37:23.617739] [DEBUG] [LOCAL ] KVUE: Loaded 54447 existing records from primary storage. [2025-09-29T19:37:23.618129] [INFO ] [MAIN ] KVUE: Loaded 54447 existing records. [2025-09-29T19:37:23.851530] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:37:23.852158] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-09-29T19:37:23.852373] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-09-29T19:37:23.864054] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-29T19:37:23.869716] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-09-29T19:37:23.869811] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-09-29T19:37:24.242020] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:37:24.348137] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-02. [2025-09-29T19:37:25.129100] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-29T19:37:25.148065] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-03. [2025-09-29T19:37:25.256467] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-29T19:37:25.781958] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-29T19:37:25.948125] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2024-12. [2025-09-29T19:37:26.748125] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-09-29T19:37:27.548097] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-04. [2025-09-29T19:37:27.638698] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-29T19:37:28.110169] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-29T19:37:28.332061] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-29T19:37:28.348113] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-05. [2025-09-29T19:37:28.800521] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-29T19:37:29.148117] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-06. [2025-09-29T19:37:29.479051] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-29T19:37:29.948109] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-07. [2025-09-29T19:37:30.379866] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-29T19:37:30.748121] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-01. [2025-09-29T19:37:31.548115] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-09-29T19:37:32.348133] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-09-29T19:37:32.575739] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-29T19:37:33.124352] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-29T19:37:33.148078] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-09-29T19:37:33.948122] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-08. [2025-09-29T19:37:34.422221] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-29T19:37:34.432639] [INFO ] [REMOTE ] KT: Full fetch complete (66718 records). [2025-09-29T19:37:34.432841] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-09-29T19:37:34.552196] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-29T19:37:34.750201] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-09. [2025-09-29T19:37:34.743573] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-29T19:37:34.824577] [INFO ] [REMOTE ] KTB: Full fetch complete (57773 records). [2025-09-29T19:37:34.825159] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-09-29T19:37:35.032980] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-09-29T19:37:35.036049] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-09-29T19:37:35.037838] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-09-29T19:37:35.048507] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-09-29T19:37:35.118330] [DEBUG] [LOCAL ] KT: Trimmed 66718 records to 45650 (keeping 200 days of data) [2025-09-29T19:37:35.452142] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-09-29T19:37:35.452746] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-09-29T19:37:35.454340] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-09-29T19:37:35.454433] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-09-29T19:37:35.459886] [DEBUG] [LOCAL ] KTB: Trimmed 57773 records to 41099 (keeping 200 days of data) [2025-09-29T19:37:35.563885] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-09-29T19:37:35.730220] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-29T19:37:35.734469] [INFO ] [REMOTE ] KUKE: Full fetch complete (8251 records). [2025-09-29T19:37:35.735112] [DEBUG] [VALIDATOR ] KUKE: Validating primary data. [2025-09-29T19:37:36.082374] [WARN ] [VALIDATOR ] KUKE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-29T19:37:36.084885] [FATAL] [MAIN ] KUKE: Fetched primary data is invalid. Refusing to save it. [2025-09-29T19:37:36.086129] [WARN ] [MAIN ] KUKE: Deleting existing primary and derivative data due to validation failure. [2025-09-29T19:37:36.087574] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-09-29T19:37:36.088082] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-09-29T19:37:36.088395] [INFO ] [LOCAL ] KUKE: Starting deletion of derivative data. [2025-09-29T19:37:36.089685] [DEBUG] [LOCAL ] KUKE: No derivative data file found to delete. [2025-09-29T19:37:36.090544] [INFO ] [MAIN ] Update Progress: 1227/2371 symbols completed. KUKE took 15.1s. Estimated remaining: 2h 26m 54s. Rate: 7.8 symbols/min [2025-09-29T19:37:36.363237] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:37:36.368919] [DEBUG] [LOCAL ] KT: Primary data saved (45650 records). [2025-09-29T19:37:36.369743] [INFO ] [MAIN ] KT: Full history saved. [2025-09-29T19:37:36.370433] [INFO ] [MAIN ] Update Progress: 1228/2371 symbols completed. KT took 43.7s. Estimated remaining: 2h 26m 39s. Rate: 7.8 symbols/min [2025-09-29T19:37:36.579325] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:37:36.613297] [DEBUG] [LOCAL ] KTB: Primary data saved (41099 records). [2025-09-29T19:37:36.614329] [DEBUG] [LOCAL ] KVYO: Loaded 50696 existing records from primary storage. [2025-09-29T19:37:36.614619] [INFO ] [MAIN ] KTB: Full history saved. [2025-09-29T19:37:36.614984] [INFO ] [MAIN ] Update Progress: 1229/2371 symbols completed. KTB took 39.1s. Estimated remaining: 2h 26m 24s. Rate: 7.8 symbols/min [2025-09-29T19:37:36.615175] [INFO ] [MAIN ] KVYO: Loaded 50696 existing records. [2025-09-29T19:37:36.950587] [DEBUG] [LOCAL ] KW: Loaded 41236 existing records from primary storage. [2025-09-29T19:37:36.989438] [INFO ] [MAIN ] KW: Loaded 41236 existing records. [2025-09-29T19:37:37.048411] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:37:37.044843] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:37:37.081187] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-09-29T19:37:37.086581] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-09-29T19:37:37.104184] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-09-29T19:37:37.129626] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-09-29T19:37:37.361389] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:37:37.368002] [DEBUG] [LOCAL ] KWR: Loaded 16931 existing records from primary storage. [2025-09-29T19:37:37.368138] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-09-29T19:37:37.368502] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-09-29T19:37:37.368621] [INFO ] [MAIN ] KWR: Loaded 16931 existing records. [2025-09-29T19:37:37.443397] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-09-29T19:37:37.581961] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-09-29T19:37:37.897350] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:37:37.957412] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-09-29T19:37:37.973257] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-09-29T19:37:38.012037] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-09-29T19:37:37.957272] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-09-29T19:37:38.024943] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-09-29T19:37:38.024831] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:37:38.098888] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2024-12. [2025-09-29T19:37:38.123244] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-09-29T19:37:38.593297] [INFO ] [REMOTE ] KW: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:37:38.618457] [INFO ] [REMOTE ] KW: Fetching primary data for 2024-12. [2025-09-29T19:37:38.706893] [INFO ] [REMOTE ] KWR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:37:38.748159] [INFO ] [REMOTE ] KWR: Fetching primary data for 2024-12. [2025-09-29T19:37:39.737171] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-29T19:37:39.741109] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-01. [2025-09-29T19:37:40.006437] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-29T19:37:40.086974] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-29T19:37:40.126975] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-29T19:37:40.348124] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-01. [2025-09-29T19:37:40.786743] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-29T19:37:41.148137] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-09-29T19:37:41.827334] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-29T19:37:41.948156] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-09-29T19:37:42.748125] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-01. [2025-09-29T19:37:42.939156] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-29T19:37:43.042901] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-29T19:37:43.548127] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-09-29T19:37:44.202880] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-29T19:37:44.348089] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-09-29T19:37:44.583903] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-29T19:37:45.148120] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-09-29T19:37:45.910998] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-29T19:37:45.948065] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-09-29T19:37:46.505062] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-29T19:37:46.748137] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-09-29T19:37:47.260016] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-29T19:37:47.548142] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-09-29T19:37:48.348110] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-09-29T19:37:48.635788] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-29T19:37:49.138378] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-29T19:37:49.149038] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-09-29T19:37:49.199376] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-29T19:37:49.948153] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-09-29T19:37:50.748108] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-09-29T19:37:50.991981] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-29T19:37:51.043391] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-29T19:37:51.548172] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-09-29T19:37:52.194039] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-29T19:37:52.348137] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-09-29T19:37:53.010835] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-29T19:37:53.148107] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-09-29T19:37:53.544391] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-29T19:37:53.948124] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-09-29T19:37:54.748109] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-09-29T19:37:55.065305] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-29T19:37:55.548161] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-09-29T19:37:55.608060] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-29T19:37:56.353185] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-09-29T19:37:56.371711] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-29T19:37:56.425278] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-29T19:37:57.148089] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-09-29T19:37:57.952842] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-09-29T19:37:57.959432] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-29T19:37:58.236546] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-29T19:37:58.748120] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-09-29T19:37:59.548099] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-09-29T19:37:59.830274] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-29T19:37:59.880999] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-29T19:38:00.190397] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-29T19:38:00.348166] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-09-29T19:38:01.148144] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-09-29T19:38:01.948085] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-09-29T19:38:02.158945] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-29T19:38:02.162485] [INFO ] [REMOTE ] KWR: Full fetch complete (23940 records). [2025-09-29T19:38:02.162668] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-09-29T19:38:02.516337] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-29T19:38:02.612125] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-09-29T19:38:02.612214] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-09-29T19:38:02.612773] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-09-29T19:38:02.612855] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-09-29T19:38:02.613585] [DEBUG] [LOCAL ] KWR: Trimmed 23940 records to 16635 (keeping 200 days of data) [2025-09-29T19:38:02.726636] [DEBUG] [LOCAL ] KWR: Primary data saved (16635 records). [2025-09-29T19:38:02.726817] [INFO ] [MAIN ] KWR: Full history saved. [2025-09-29T19:38:02.726919] [INFO ] [MAIN ] Update Progress: 1230/2371 symbols completed. KWR took 26.1s. Estimated remaining: 2h 26m 34s. Rate: 7.8 symbols/min [2025-09-29T19:38:02.758955] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-09-29T19:38:02.921181] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:38:02.961576] [DEBUG] [LOCAL ] KYN: Loaded 30432 existing records from primary storage. [2025-09-29T19:38:02.961913] [INFO ] [MAIN ] KYN: Loaded 30432 existing records. [2025-09-29T19:38:03.179962] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:38:03.180381] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-09-29T19:38:03.180475] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-09-29T19:38:03.181005] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-09-29T19:38:03.181096] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-09-29T19:38:03.388091] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-29T19:38:03.553250] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-09-29T19:38:03.615918] [INFO ] [REMOTE ] KYN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:38:04.348134] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-09-29T19:38:04.852919] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-29T19:38:04.864202] [INFO ] [REMOTE ] KVYO: Full fetch complete (71507 records). [2025-09-29T19:38:04.864375] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-09-29T19:38:05.154147] [INFO ] [REMOTE ] KYN: Fetching primary data for 2024-12. [2025-09-29T19:38:05.277383] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-29T19:38:05.410872] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-09-29T19:38:05.410984] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-09-29T19:38:05.412441] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-09-29T19:38:05.412522] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-09-29T19:38:05.414410] [DEBUG] [LOCAL ] KVYO: Trimmed 71507 records to 49993 (keeping 200 days of data) [2025-09-29T19:38:05.822472] [DEBUG] [LOCAL ] KVYO: Primary data saved (49993 records). [2025-09-29T19:38:05.822711] [INFO ] [MAIN ] KVYO: Full history saved. [2025-09-29T19:38:05.822849] [INFO ] [MAIN ] Update Progress: 1231/2371 symbols completed. KVYO took 29.7s. Estimated remaining: 2h 26m 22s. Rate: 7.8 symbols/min [2025-09-29T19:38:05.953268] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-09-29T19:38:06.009430] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:38:06.057469] [DEBUG] [LOCAL ] L: Loaded 41562 existing records from primary storage. [2025-09-29T19:38:06.057881] [INFO ] [MAIN ] L: Loaded 41562 existing records. [2025-09-29T19:38:06.248154] [WARN ] [MAIN ] L: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:38:06.248396] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-09-29T19:38:06.248456] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-09-29T19:38:06.248896] [DEBUG] [LOCAL ] L: Deleted primary data file. [2025-09-29T19:38:06.248957] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-09-29T19:38:06.649489] [INFO ] [REMOTE ] L: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:38:06.748171] [INFO ] [REMOTE ] L: Fetching primary data for 2024-12. [2025-09-29T19:38:06.895484] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (2.55 seconds). [2025-09-29T19:38:06.927435] [INFO ] [REMOTE ] KVUE: Full fetch complete (77673 records). [2025-09-29T19:38:06.928280] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-29T19:38:06.935586] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-09-29T19:38:07.367433] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-09-29T19:38:07.367553] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-09-29T19:38:07.368819] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-09-29T19:38:07.368939] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-09-29T19:38:07.370613] [DEBUG] [LOCAL ] KVUE: Trimmed 77673 records to 53667 (keeping 200 days of data) [2025-09-29T19:38:07.561054] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-01. [2025-09-29T19:38:07.623888] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-29T19:38:07.634828] [INFO ] [REMOTE ] KW: Full fetch complete (57006 records). [2025-09-29T19:38:07.635830] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-09-29T19:38:08.109024] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-09-29T19:38:08.110055] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-09-29T19:38:08.111356] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-09-29T19:38:08.112601] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-09-29T19:38:08.124773] [DEBUG] [LOCAL ] KW: Trimmed 57006 records to 40567 (keeping 200 days of data) [2025-09-29T19:38:08.145257] [INFO ] [REMOTE ] L: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-29T19:38:08.352045] [INFO ] [REMOTE ] L: Fetching primary data for 2025-01. [2025-09-29T19:38:08.374065] [DEBUG] [LOCAL ] KVUE: Primary data saved (53667 records). [2025-09-29T19:38:08.374785] [INFO ] [MAIN ] KVUE: Full history saved. [2025-09-29T19:38:08.374919] [INFO ] [MAIN ] Update Progress: 1232/2371 symbols completed. KVUE took 45.0s. Estimated remaining: 2h 26m 9s. Rate: 7.8 symbols/min [2025-09-29T19:38:08.661993] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:38:08.734469] [DEBUG] [LOCAL ] LAC: Loaded 53091 existing records from primary storage. [2025-09-29T19:38:08.734583] [DEBUG] [LOCAL ] KW: Primary data saved (40567 records). [2025-09-29T19:38:08.735118] [INFO ] [MAIN ] LAC: Loaded 53091 existing records. [2025-09-29T19:38:08.734996] [INFO ] [MAIN ] KW: Full history saved. [2025-09-29T19:38:08.779990] [INFO ] [MAIN ] Update Progress: 1233/2371 symbols completed. KW took 32.4s. Estimated remaining: 2h 25m 55s. Rate: 7.8 symbols/min [2025-09-29T19:38:09.038570] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:38:09.048738] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-09-29T19:38:09.091438] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-09-29T19:38:09.121346] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:38:09.122128] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-09-29T19:38:09.122303] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-09-29T19:38:09.272693] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-29T19:38:09.368305] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-09-29T19:38:09.350116] [DEBUG] [LOCAL ] LAD: Loaded 24089 existing records from primary storage. [2025-09-29T19:38:09.408740] [INFO ] [MAIN ] LAD: Loaded 24089 existing records. [2025-09-29T19:38:09.735502] [INFO ] [REMOTE ] LAC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:38:09.799999] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:38:09.800280] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-09-29T19:38:09.800430] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-09-29T19:38:09.800721] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-09-29T19:38:09.800794] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-09-29T19:38:09.951441] [INFO ] [REMOTE ] LAC: Fetching primary data for 2024-12. [2025-09-29T19:38:10.125564] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-29T19:38:10.248175] [INFO ] [REMOTE ] LAD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:38:10.748136] [INFO ] [REMOTE ] LAD: Fetching primary data for 2024-12. [2025-09-29T19:38:10.784084] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-29T19:38:11.548166] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-09-29T19:38:11.968102] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-29T19:38:12.284966] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-09-29T19:38:12.348124] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-01. [2025-09-29T19:38:12.753174] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-29T19:38:13.148092] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-01. [2025-09-29T19:38:13.833486] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-29T19:38:13.948124] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-09-29T19:38:14.748128] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-09-29T19:38:15.162898] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-29T19:38:15.188897] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-29T19:38:15.548119] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-09-29T19:38:16.136871] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-29T19:38:16.348121] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-09-29T19:38:17.148141] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-09-29T19:38:17.197533] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-29T19:38:17.647166] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-29T19:38:17.948122] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-09-29T19:38:18.534061] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-29T19:38:18.748140] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-09-29T19:38:19.548125] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-09-29T19:38:19.599875] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-29T19:38:20.348101] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-09-29T19:38:20.599377] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-29T19:38:21.044841] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-29T19:38:21.148143] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-09-29T19:38:21.629623] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-29T19:38:21.948139] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-09-29T19:38:22.748176] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-09-29T19:38:23.159912] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-29T19:38:23.316172] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-29T19:38:23.534120] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-29T19:38:23.548067] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-09-29T19:38:24.348079] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-09-29T19:38:24.662820] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-29T19:38:25.148096] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-09-29T19:38:25.569087] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-29T19:38:25.948152] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-09-29T19:38:26.748115] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-09-29T19:38:27.085779] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-29T19:38:27.286486] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-29T19:38:27.548141] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-09-29T19:38:27.726926] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-29T19:38:28.348173] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-09-29T19:38:29.148127] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-09-29T19:38:29.738537] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-29T19:38:29.855328] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-29T19:38:29.948112] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-09-29T19:38:30.419522] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-29T19:38:30.748129] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-09-29T19:38:31.238344] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-29T19:38:31.548112] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-09-29T19:38:32.118207] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-29T19:38:32.348117] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-09-29T19:38:32.868071] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-29T19:38:32.873192] [INFO ] [REMOTE ] LAD: Full fetch complete (35392 records). [2025-09-29T19:38:32.873280] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-09-29T19:38:33.157827] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-09-29T19:38:33.274987] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-09-29T19:38:33.275075] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-09-29T19:38:33.275799] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-09-29T19:38:33.275875] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-09-29T19:38:33.276768] [DEBUG] [LOCAL ] LAD: Trimmed 35392 records to 23520 (keeping 200 days of data) [2025-09-29T19:38:33.431504] [DEBUG] [LOCAL ] LAD: Primary data saved (23520 records). [2025-09-29T19:38:33.431622] [INFO ] [MAIN ] LAD: Full history saved. [2025-09-29T19:38:33.431744] [INFO ] [MAIN ] Update Progress: 1234/2371 symbols completed. LAD took 24.6s. Estimated remaining: 2h 26m 3s. Rate: 7.8 symbols/min [2025-09-29T19:38:33.611334] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:38:33.639852] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-29T19:38:33.687511] [DEBUG] [LOCAL ] LADR: Loaded 39204 existing records from primary storage. [2025-09-29T19:38:33.687972] [INFO ] [MAIN ] LADR: Loaded 39204 existing records. [2025-09-29T19:38:33.887748] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:38:33.887993] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-09-29T19:38:33.888104] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-09-29T19:38:33.888587] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-09-29T19:38:33.888683] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-09-29T19:38:33.953276] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-09-29T19:38:34.278719] [INFO ] [REMOTE ] LADR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:38:34.748120] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-09-29T19:38:35.074511] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-29T19:38:35.548123] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-09-29T19:38:35.748378] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-29T19:38:35.757151] [INFO ] [REMOTE ] L: Full fetch complete (59552 records). [2025-09-29T19:38:35.757274] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-09-29T19:38:36.182629] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-29T19:38:36.206593] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-09-29T19:38:36.206713] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-09-29T19:38:36.207928] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-09-29T19:38:36.208021] [DEBUG] [LOCAL ] L: Saving primary data. [2025-09-29T19:38:36.208139] [INFO ] [REMOTE ] KYN: Full fetch complete (44675 records). [2025-09-29T19:38:36.208363] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-09-29T19:38:36.318535] [DEBUG] [LOCAL ] L: Trimmed 59552 records to 40928 (keeping 200 days of data) [2025-09-29T19:38:36.387630] [INFO ] [REMOTE ] LADR: Fetching primary data for 2024-12. [2025-09-29T19:38:36.733477] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-09-29T19:38:36.733874] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-09-29T19:38:36.734900] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-09-29T19:38:36.734985] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-09-29T19:38:36.738994] [DEBUG] [LOCAL ] KYN: Trimmed 44675 records to 30077 (keeping 200 days of data) [2025-09-29T19:38:37.093695] [DEBUG] [LOCAL ] L: Primary data saved (40928 records). [2025-09-29T19:38:37.094448] [INFO ] [MAIN ] L: Full history saved. [2025-09-29T19:38:37.094921] [INFO ] [MAIN ] Update Progress: 1235/2371 symbols completed. L took 31.3s. Estimated remaining: 2h 25m 51s. Rate: 7.8 symbols/min [2025-09-29T19:38:37.160026] [DEBUG] [LOCAL ] KYN: Primary data saved (30077 records). [2025-09-29T19:38:37.182053] [INFO ] [MAIN ] KYN: Full history saved. [2025-09-29T19:38:37.211223] [INFO ] [MAIN ] Update Progress: 1236/2371 symbols completed. KYN took 34.5s. Estimated remaining: 2h 25m 37s. Rate: 7.8 symbols/min [2025-09-29T19:38:37.383193] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:38:37.498219] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:38:37.500951] [DEBUG] [LOCAL ] LANV: Loaded 2851 existing records from primary storage. [2025-09-29T19:38:37.501024] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-09-29T19:38:37.501208] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-09-29T19:38:37.501603] [INFO ] [MAIN ] LANV: Loaded 2851 existing records. [2025-09-29T19:38:37.501766] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-09-29T19:38:37.502028] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-09-29T19:38:37.502170] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-09-29T19:38:37.523619] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-09-29T19:38:37.986804] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:38:38.080856] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-09-29T19:38:38.091070] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-09-29T19:38:38.100951] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-09-29T19:38:38.120908] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-09-29T19:38:38.136799] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-09-29T19:38:38.187838] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-29T19:38:38.200988] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-09-29T19:38:38.249362] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:38:38.260250] [INFO ] [REMOTE ] LAR: Fetching primary data for 2024-12. [2025-09-29T19:38:38.551254] [DEBUG] [REMOTE ] LAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T19:38:38.577833] [WARN ] [REMOTE ] LAR: No data returned for month 2024-12 [2025-09-29T19:38:38.607964] [INFO ] [REMOTE ] LANV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:38:38.608087] [FATAL] [REMOTE ] LAR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T19:38:38.608382] [FATAL] [MAIN ] LAR: Failed to fetch primary data. [2025-09-29T19:38:38.608775] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T19:38:38.608866] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-09-29T19:38:38.608945] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-09-29T19:38:38.609035] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-09-29T19:38:38.609110] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-09-29T19:38:38.609192] [INFO ] [MAIN ] Update Progress: 1237/2371 symbols completed. LAR took 1.4s. Estimated remaining: 2h 25m 23s. Rate: 7.8 symbols/min [2025-09-29T19:38:38.748117] [INFO ] [REMOTE ] LANV: Fetching primary data for 2024-12. [2025-09-29T19:38:39.315122] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-29T19:38:39.548163] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-01. [2025-09-29T19:38:40.158368] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-29T19:38:40.348137] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-01. [2025-09-29T19:38:40.922424] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-29T19:38:40.923584] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-29T19:38:41.148129] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-09-29T19:38:41.948118] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-09-29T19:38:42.748158] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-09-29T19:38:43.305786] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-29T19:38:43.371260] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-29T19:38:43.426215] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-29T19:38:43.437777] [INFO ] [REMOTE ] LAC: Full fetch complete (75975 records). [2025-09-29T19:38:43.437951] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-09-29T19:38:43.553262] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-09-29T19:38:43.881891] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-09-29T19:38:43.882004] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-09-29T19:38:43.883223] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-09-29T19:38:43.883296] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-09-29T19:38:43.885001] [DEBUG] [LOCAL ] LAC: Trimmed 75975 records to 52321 (keeping 200 days of data) [2025-09-29T19:38:44.160409] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-29T19:38:44.203374] [DEBUG] [LOCAL ] LAC: Primary data saved (52321 records). [2025-09-29T19:38:44.203530] [INFO ] [MAIN ] LAC: Full history saved. [2025-09-29T19:38:44.203619] [INFO ] [MAIN ] Update Progress: 1238/2371 symbols completed. LAC took 35.8s. Estimated remaining: 2h 25m 14s. Rate: 7.8 symbols/min [2025-09-29T19:38:44.348164] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-09-29T19:38:44.804482] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-29T19:38:45.148118] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-09-29T19:38:45.592870] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-29T19:38:45.948125] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-09-29T19:38:46.590303] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-29T19:38:46.748161] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-09-29T19:38:47.214766] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-29T19:38:47.548145] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-09-29T19:38:48.348107] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-09-29T19:38:48.923197] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-29T19:38:49.030714] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-29T19:38:49.148140] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-09-29T19:38:49.806701] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-29T19:38:49.808305] [INFO ] [REMOTE ] LANV: Full fetch complete (4410 records). [2025-09-29T19:38:49.808378] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-09-29T19:38:49.963666] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-09-29T19:38:50.193412] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-09-29T19:38:50.193490] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-09-29T19:38:50.193728] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-09-29T19:38:50.193814] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-09-29T19:38:50.194177] [DEBUG] [LOCAL ] LANV: Trimmed 4410 records to 2823 (keeping 200 days of data) [2025-09-29T19:38:50.209671] [DEBUG] [LOCAL ] LANV: Primary data saved (2823 records). [2025-09-29T19:38:50.209752] [INFO ] [MAIN ] LANV: Full history saved. [2025-09-29T19:38:50.209828] [INFO ] [MAIN ] Update Progress: 1239/2371 symbols completed. LANV took 13.1s. Estimated remaining: 2h 25m 5s. Rate: 7.8 symbols/min [2025-09-29T19:38:51.650464] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-29T19:38:51.660574] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-09-29T19:38:53.119927] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-29T19:38:53.128109] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-09-29T19:38:54.539123] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-29T19:38:54.548012] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-09-29T19:38:56.072435] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-29T19:38:56.082279] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-09-29T19:38:57.463058] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-29T19:38:57.471600] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-09-29T19:38:59.189057] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-29T19:38:59.197380] [INFO ] [REMOTE ] LADR: Full fetch complete (55168 records). [2025-09-29T19:38:59.197513] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-09-29T19:38:59.594008] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-09-29T19:38:59.594148] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-09-29T19:38:59.595209] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-09-29T19:38:59.595277] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-09-29T19:38:59.596722] [DEBUG] [LOCAL ] LADR: Trimmed 55168 records to 38625 (keeping 200 days of data) [2025-09-29T19:38:59.839235] [DEBUG] [LOCAL ] LADR: Primary data saved (38625 records). [2025-09-29T19:38:59.839389] [INFO ] [MAIN ] LADR: Full history saved. [2025-09-29T19:38:59.839486] [INFO ] [MAIN ] Update Progress: 1240/2371 symbols completed. LADR took 26.4s. Estimated remaining: 2h 24m 59s. Rate: 7.8 symbols/min [2025-09-29T19:39:00.473501] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:39:00.528833] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:39:00.574299] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:39:00.650024] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:39:00.681460] [DEBUG] [LOCAL ] LAW: Loaded 14171 existing records from primary storage. [2025-09-29T19:39:00.681840] [INFO ] [MAIN ] LAW: Loaded 14171 existing records. [2025-09-29T19:39:00.809985] [DEBUG] [LOCAL ] LAZ: Loaded 45784 existing records from primary storage. [2025-09-29T19:39:00.852057] [INFO ] [MAIN ] LAZ: Loaded 45784 existing records. [2025-09-29T19:39:00.884161] [DEBUG] [LOCAL ] LB: Loaded 38116 existing records from primary storage. [2025-09-29T19:39:00.957090] [DEBUG] [LOCAL ] LBRT: Loaded 53695 existing records from primary storage. [2025-09-29T19:39:00.968348] [INFO ] [MAIN ] LB: Loaded 38116 existing records. [2025-09-29T19:39:00.994916] [INFO ] [MAIN ] LBRT: Loaded 53695 existing records. [2025-09-29T19:39:01.204734] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:39:01.324750] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-09-29T19:39:01.369734] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-09-29T19:39:01.414048] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-09-29T19:39:01.508228] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:39:01.555152] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-09-29T19:39:01.555015] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:39:01.550521] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-09-29T19:39:01.561328] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-09-29T19:39:01.568427] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-09-29T19:39:01.606457] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-09-29T19:39:01.606353] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-09-29T19:39:01.606617] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-09-29T19:39:01.660453] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-09-29T19:39:01.719318] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-09-29T19:39:01.858121] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:39:01.933549] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-09-29T19:39:01.947713] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-09-29T19:39:01.986840] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-09-29T19:39:01.992189] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-09-29T19:39:02.921439] [INFO ] [REMOTE ] LAW: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:39:02.982432] [INFO ] [REMOTE ] LAW: Fetching primary data for 2024-12. [2025-09-29T19:39:03.159917] [INFO ] [REMOTE ] LB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:39:03.171224] [INFO ] [REMOTE ] LB: Fetching primary data for 2024-12. [2025-09-29T19:39:03.342958] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:39:03.346775] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:39:03.347190] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2024-12. [2025-09-29T19:39:03.347430] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2024-12. [2025-09-29T19:39:04.090494] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-29T19:39:04.094781] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-09-29T19:39:04.784663] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-29T19:39:04.795671] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-01. [2025-09-29T19:39:04.870861] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-29T19:39:04.880251] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-01. [2025-09-29T19:39:04.946709] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-29T19:39:04.959188] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-01. [2025-09-29T19:39:04.979999] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-29T19:39:04.983483] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-09-29T19:39:05.538330] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-29T19:39:05.542246] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-09-29T19:39:06.046418] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-29T19:39:06.049775] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-09-29T19:39:06.325196] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-29T19:39:06.341692] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-09-29T19:39:06.620532] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-29T19:39:06.631255] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-09-29T19:39:06.684456] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-29T19:39:06.693966] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-09-29T19:39:06.912315] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-29T19:39:06.915565] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-09-29T19:39:07.865052] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-29T19:39:07.869347] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-09-29T19:39:07.898566] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-29T19:39:07.909532] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-09-29T19:39:07.937527] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-29T19:39:07.968634] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-29T19:39:08.348119] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-09-29T19:39:08.767989] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-29T19:39:09.148077] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-09-29T19:39:09.660280] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-29T19:39:09.948153] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-09-29T19:39:10.041527] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-29T19:39:10.743420] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-29T19:39:10.753228] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-09-29T19:39:10.907771] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-29T19:39:11.548135] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-09-29T19:39:12.348120] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-09-29T19:39:12.716923] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-29T19:39:13.089268] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-29T19:39:13.148089] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-09-29T19:39:13.331050] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-29T19:39:13.948125] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-09-29T19:39:14.748124] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-09-29T19:39:14.856374] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-29T19:39:15.061560] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-29T19:39:15.065576] [INFO ] [REMOTE ] LAW: Full fetch complete (20624 records). [2025-09-29T19:39:15.065734] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-09-29T19:39:15.480631] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-09-29T19:39:15.480747] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-09-29T19:39:15.481194] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-09-29T19:39:15.481238] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-09-29T19:39:15.481950] [DEBUG] [LOCAL ] LAW: Trimmed 20624 records to 13949 (keeping 200 days of data) [2025-09-29T19:39:15.548733] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-09-29T19:39:15.563281] [DEBUG] [LOCAL ] LAW: Primary data saved (13949 records). [2025-09-29T19:39:15.563450] [INFO ] [MAIN ] LAW: Full history saved. [2025-09-29T19:39:15.563558] [INFO ] [MAIN ] Update Progress: 1241/2371 symbols completed. LAW took 15.7s. Estimated remaining: 2h 24m 58s. Rate: 7.8 symbols/min [2025-09-29T19:39:15.748258] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:39:15.802590] [DEBUG] [LOCAL ] LC: Loaded 48605 existing records from primary storage. [2025-09-29T19:39:15.802987] [INFO ] [MAIN ] LC: Loaded 48605 existing records. [2025-09-29T19:39:16.001405] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:39:16.002131] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-09-29T19:39:16.002317] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-09-29T19:39:16.003165] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-09-29T19:39:16.003242] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-09-29T19:39:16.353794] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-09-29T19:39:16.407914] [INFO ] [REMOTE ] LC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:39:16.414930] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-29T19:39:17.148141] [INFO ] [REMOTE ] LC: Fetching primary data for 2024-12. [2025-09-29T19:39:17.324036] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-29T19:39:17.948094] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-09-29T19:39:18.097156] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-29T19:39:18.748087] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-09-29T19:39:18.915437] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-29T19:39:19.548116] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-01. [2025-09-29T19:39:19.817035] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-29T19:39:20.348167] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-09-29T19:39:20.408023] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-29T19:39:20.934088] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-29T19:39:21.148179] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-09-29T19:39:21.948099] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-09-29T19:39:22.338161] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-29T19:39:22.619848] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-29T19:39:22.748114] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-09-29T19:39:23.335961] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-29T19:39:23.548121] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-09-29T19:39:24.346958] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-29T19:39:24.356555] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-09-29T19:39:24.901686] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-29T19:39:25.148119] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-09-29T19:39:25.948125] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-09-29T19:39:26.478021] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-29T19:39:26.490162] [INFO ] [REMOTE ] LBRT: Full fetch complete (76543 records). [2025-09-29T19:39:26.490387] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-09-29T19:39:26.752597] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-09-29T19:39:26.912829] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-29T19:39:26.974479] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-09-29T19:39:26.974564] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-09-29T19:39:26.975820] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-09-29T19:39:26.975891] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-09-29T19:39:26.977564] [DEBUG] [LOCAL ] LBRT: Trimmed 76543 records to 52915 (keeping 200 days of data) [2025-09-29T19:39:27.332883] [DEBUG] [LOCAL ] LBRT: Primary data saved (52915 records). [2025-09-29T19:39:27.333042] [INFO ] [MAIN ] LBRT: Full history saved. [2025-09-29T19:39:27.333165] [INFO ] [MAIN ] Update Progress: 1242/2371 symbols completed. LBRT took 27.5s. Estimated remaining: 2h 24m 54s. Rate: 7.8 symbols/min [2025-09-29T19:39:27.521262] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:39:27.548112] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-09-29T19:39:27.560854] [DEBUG] [LOCAL ] LCII: Loaded 28900 existing records from primary storage. [2025-09-29T19:39:27.561429] [INFO ] [MAIN ] LCII: Loaded 28900 existing records. [2025-09-29T19:39:27.768130] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:39:27.768555] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-09-29T19:39:27.768617] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-09-29T19:39:27.801498] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-29T19:39:27.799296] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-09-29T19:39:27.811929] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-09-29T19:39:28.215145] [INFO ] [REMOTE ] LCII: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:39:28.241480] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-29T19:39:28.348126] [INFO ] [REMOTE ] LCII: Fetching primary data for 2024-12. [2025-09-29T19:39:29.011064] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-29T19:39:29.019236] [INFO ] [REMOTE ] LB: Full fetch complete (55870 records). [2025-09-29T19:39:29.019405] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-09-29T19:39:29.153232] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-09-29T19:39:29.475452] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-09-29T19:39:29.475664] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-09-29T19:39:29.476722] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-09-29T19:39:29.476891] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-09-29T19:39:29.496686] [DEBUG] [LOCAL ] LB: Trimmed 55870 records to 37552 (keeping 200 days of data) [2025-09-29T19:39:29.496498] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-29T19:39:29.756869] [DEBUG] [LOCAL ] LB: Primary data saved (37552 records). [2025-09-29T19:39:29.757053] [INFO ] [MAIN ] LB: Full history saved. [2025-09-29T19:39:29.757163] [INFO ] [MAIN ] Update Progress: 1243/2371 symbols completed. LB took 29.9s. Estimated remaining: 2h 24m 42s. Rate: 7.8 symbols/min [2025-09-29T19:39:29.944449] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:39:29.948118] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-09-29T19:39:29.993538] [DEBUG] [LOCAL ] LDI: Loaded 44776 existing records from primary storage. [2025-09-29T19:39:29.993881] [INFO ] [MAIN ] LDI: Loaded 44776 existing records. [2025-09-29T19:39:30.189588] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:39:30.189862] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-09-29T19:39:30.189913] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-09-29T19:39:30.190330] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-09-29T19:39:30.190390] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-09-29T19:39:30.582818] [INFO ] [REMOTE ] LDI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:39:30.748124] [INFO ] [REMOTE ] LDI: Fetching primary data for 2024-12. [2025-09-29T19:39:30.795374] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-29T19:39:31.548102] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-09-29T19:39:31.695934] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-29T19:39:31.705962] [INFO ] [REMOTE ] LAZ: Full fetch complete (65854 records). [2025-09-29T19:39:31.706156] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-09-29T19:39:32.022808] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-29T19:39:32.152595] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-09-29T19:39:32.152739] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-09-29T19:39:32.154253] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-09-29T19:39:32.154327] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-09-29T19:39:32.157425] [DEBUG] [LOCAL ] LAZ: Trimmed 65854 records to 44983 (keeping 200 days of data) [2025-09-29T19:39:32.358182] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-01. [2025-09-29T19:39:32.485452] [DEBUG] [LOCAL ] LAZ: Primary data saved (44983 records). [2025-09-29T19:39:32.485702] [INFO ] [MAIN ] LAZ: Full history saved. [2025-09-29T19:39:32.485838] [INFO ] [MAIN ] Update Progress: 1244/2371 symbols completed. LAZ took 32.6s. Estimated remaining: 2h 24m 30s. Rate: 7.8 symbols/min [2025-09-29T19:39:32.695526] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:39:32.752835] [DEBUG] [LOCAL ] LDOS: Loaded 46407 existing records from primary storage. [2025-09-29T19:39:32.753338] [INFO ] [MAIN ] LDOS: Loaded 46407 existing records. [2025-09-29T19:39:32.941962] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:39:32.942284] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-09-29T19:39:32.942341] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-09-29T19:39:32.943010] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-09-29T19:39:32.943074] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-09-29T19:39:33.161881] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-01. [2025-09-29T19:39:33.311220] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:39:33.343534] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-29T19:39:33.698191] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-29T19:39:33.948077] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-09-29T19:39:34.356519] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-29T19:39:34.748126] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-09-29T19:39:35.354142] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-29T19:39:35.548116] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-09-29T19:39:36.348112] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-09-29T19:39:36.394291] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-29T19:39:37.060379] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-29T19:39:37.148135] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-09-29T19:39:37.656946] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-29T19:39:37.948151] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-09-29T19:39:38.555632] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-29T19:39:38.748119] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-09-29T19:39:39.548161] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-09-29T19:39:39.625195] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-29T19:39:39.970063] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-29T19:39:40.348124] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-09-29T19:39:40.931702] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-29T19:39:41.148150] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2024-12. [2025-09-29T19:39:41.914812] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-29T19:39:41.948134] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-09-29T19:39:42.748137] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-09-29T19:39:42.806283] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-29T19:39:43.477616] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-29T19:39:43.548153] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-09-29T19:39:44.278328] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-29T19:39:44.348169] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-01. [2025-09-29T19:39:44.828260] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-29T19:39:45.148154] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-09-29T19:39:45.948081] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-09-29T19:39:46.129715] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-29T19:39:46.376561] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-29T19:39:46.748171] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-09-29T19:39:47.548143] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-09-29T19:39:47.620324] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-29T19:39:48.348138] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-09-29T19:39:48.615854] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-29T19:39:49.148087] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-09-29T19:39:49.241617] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-29T19:39:49.486974] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-29T19:39:49.948117] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-09-29T19:39:50.518774] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-29T19:39:50.748124] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-09-29T19:39:51.548121] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-09-29T19:39:51.970451] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-29T19:39:51.984522] [INFO ] [REMOTE ] LDI: Full fetch complete (60374 records). [2025-09-29T19:39:51.984700] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-09-29T19:39:52.355719] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-09-29T19:39:52.406444] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-09-29T19:39:52.406916] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-09-29T19:39:52.408053] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-09-29T19:39:52.408217] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-09-29T19:39:52.409620] [DEBUG] [LOCAL ] LDI: Trimmed 60374 records to 44119 (keeping 200 days of data) [2025-09-29T19:39:52.704010] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-29T19:39:52.705822] [DEBUG] [LOCAL ] LDI: Primary data saved (44119 records). [2025-09-29T19:39:52.717185] [INFO ] [MAIN ] LDI: Full history saved. [2025-09-29T19:39:52.717700] [INFO ] [MAIN ] Update Progress: 1245/2371 symbols completed. LDI took 23.0s. Estimated remaining: 2h 24m 33s. Rate: 7.8 symbols/min [2025-09-29T19:39:52.897510] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:39:52.915286] [DEBUG] [LOCAL ] LDP: Loaded 13128 existing records from primary storage. [2025-09-29T19:39:52.915569] [INFO ] [MAIN ] LDP: Loaded 13128 existing records. [2025-09-29T19:39:53.103971] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:39:53.104276] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-09-29T19:39:53.104458] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-09-29T19:39:53.104820] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-09-29T19:39:53.104884] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-09-29T19:39:53.170673] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-09-29T19:39:53.539597] [INFO ] [REMOTE ] LDP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:39:53.563441] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-29T19:39:53.580993] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-29T19:39:53.587971] [INFO ] [REMOTE ] LC: Full fetch complete (70491 records). [2025-09-29T19:39:53.588400] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-09-29T19:39:53.961733] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-09-29T19:39:54.025298] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-09-29T19:39:54.025413] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-09-29T19:39:54.026529] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-09-29T19:39:54.026599] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-09-29T19:39:54.030898] [DEBUG] [LOCAL ] LC: Trimmed 70491 records to 47828 (keeping 200 days of data) [2025-09-29T19:39:54.327326] [DEBUG] [LOCAL ] LC: Primary data saved (47828 records). [2025-09-29T19:39:54.327491] [INFO ] [MAIN ] LC: Full history saved. [2025-09-29T19:39:54.327639] [INFO ] [MAIN ] Update Progress: 1246/2371 symbols completed. LC took 38.8s. Estimated remaining: 2h 24m 20s. Rate: 7.8 symbols/min [2025-09-29T19:39:54.510554] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:39:54.559176] [DEBUG] [LOCAL ] LEA: Loaded 42464 existing records from primary storage. [2025-09-29T19:39:54.559503] [INFO ] [MAIN ] LEA: Loaded 42464 existing records. [2025-09-29T19:39:54.746242] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:39:54.746767] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-09-29T19:39:54.746895] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-09-29T19:39:54.747445] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-09-29T19:39:54.747506] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-09-29T19:39:54.768782] [INFO ] [REMOTE ] LDP: Fetching primary data for 2024-12. [2025-09-29T19:39:55.125767] [INFO ] [REMOTE ] LEA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:39:55.201769] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-29T19:39:55.355906] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-29T19:39:55.361119] [INFO ] [REMOTE ] LCII: Full fetch complete (39117 records). [2025-09-29T19:39:55.361302] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-09-29T19:39:55.557462] [INFO ] [REMOTE ] LEA: Fetching primary data for 2024-12. [2025-09-29T19:39:55.774483] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-29T19:39:55.793261] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-09-29T19:39:55.793348] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-09-29T19:39:55.794310] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-09-29T19:39:55.794379] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-09-29T19:39:55.795388] [DEBUG] [LOCAL ] LCII: Trimmed 39117 records to 28223 (keeping 200 days of data) [2025-09-29T19:39:55.976225] [DEBUG] [LOCAL ] LCII: Primary data saved (28223 records). [2025-09-29T19:39:55.976428] [INFO ] [MAIN ] LCII: Full history saved. [2025-09-29T19:39:55.976528] [INFO ] [MAIN ] Update Progress: 1247/2371 symbols completed. LCII took 28.6s. Estimated remaining: 2h 24m 7s. Rate: 7.8 symbols/min [2025-09-29T19:39:56.153015] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:39:56.206766] [DEBUG] [LOCAL ] LEG: Loaded 51130 existing records from primary storage. [2025-09-29T19:39:56.207462] [INFO ] [MAIN ] LEG: Loaded 51130 existing records. [2025-09-29T19:39:56.353276] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-01. [2025-09-29T19:39:56.394237] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:39:56.394455] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-09-29T19:39:56.394504] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-09-29T19:39:56.395212] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-09-29T19:39:56.395273] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-09-29T19:39:56.805043] [INFO ] [REMOTE ] LEG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:39:57.148099] [INFO ] [REMOTE ] LEG: Fetching primary data for 2024-12. [2025-09-29T19:39:57.227695] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-29T19:39:57.343760] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-29T19:39:57.948160] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-09-29T19:39:58.748092] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-09-29T19:39:58.826707] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-29T19:39:58.909543] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-29T19:39:59.548117] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-01. [2025-09-29T19:40:00.348122] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-01. [2025-09-29T19:40:00.781127] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-29T19:40:01.148138] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-09-29T19:40:01.248384] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-29T19:40:01.898908] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-29T19:40:01.948170] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-09-29T19:40:01.987600] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-29T19:40:02.748175] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-09-29T19:40:03.548159] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-09-29T19:40:03.830404] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-29T19:40:04.204084] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-29T19:40:04.348138] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-09-29T19:40:04.387444] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-29T19:40:05.148125] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-09-29T19:40:05.275513] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-29T19:40:05.948157] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-09-29T19:40:06.711149] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-29T19:40:06.748129] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-09-29T19:40:06.964536] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-29T19:40:07.548093] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-09-29T19:40:07.691604] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-29T19:40:08.348128] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-09-29T19:40:09.052344] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-29T19:40:09.148149] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-09-29T19:40:09.881849] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-29T19:40:09.948102] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-09-29T19:40:10.095471] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-29T19:40:10.748155] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-09-29T19:40:11.450371] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-29T19:40:11.548142] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-09-29T19:40:12.348116] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-09-29T19:40:12.393484] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-29T19:40:13.148192] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-09-29T19:40:13.202236] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-29T19:40:13.948102] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-09-29T19:40:14.018615] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-29T19:40:14.748127] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-09-29T19:40:14.850140] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-29T19:40:15.467159] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-29T19:40:15.470346] [INFO ] [REMOTE ] LDP: Full fetch complete (19461 records). [2025-09-29T19:40:15.470465] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-09-29T19:40:15.548162] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-09-29T19:40:15.811403] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-29T19:40:15.910487] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-09-29T19:40:15.910576] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-09-29T19:40:15.911046] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-09-29T19:40:15.911120] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-09-29T19:40:15.911752] [DEBUG] [LOCAL ] LDP: Trimmed 19461 records to 12962 (keeping 200 days of data) [2025-09-29T19:40:15.992960] [DEBUG] [LOCAL ] LDP: Primary data saved (12962 records). [2025-09-29T19:40:15.993136] [INFO ] [MAIN ] LDP: Full history saved. [2025-09-29T19:40:15.993242] [INFO ] [MAIN ] Update Progress: 1248/2371 symbols completed. LDP took 23.3s. Estimated remaining: 2h 24m 10s. Rate: 7.8 symbols/min [2025-09-29T19:40:16.177206] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:40:16.241720] [DEBUG] [LOCAL ] LEN: Loaded 53967 existing records from primary storage. [2025-09-29T19:40:16.242100] [INFO ] [MAIN ] LEN: Loaded 53967 existing records. [2025-09-29T19:40:16.353236] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-09-29T19:40:16.437344] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:40:16.437630] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-09-29T19:40:16.437733] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-09-29T19:40:16.438220] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-09-29T19:40:16.438294] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-09-29T19:40:16.804969] [INFO ] [REMOTE ] LEN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:40:17.148094] [INFO ] [REMOTE ] LEN: Fetching primary data for 2024-12. [2025-09-29T19:40:17.517471] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-29T19:40:17.948088] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-09-29T19:40:18.236888] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-29T19:40:18.246918] [INFO ] [REMOTE ] LDOS: Full fetch complete (67731 records). [2025-09-29T19:40:18.247099] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-09-29T19:40:18.660954] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-09-29T19:40:18.661216] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-09-29T19:40:18.662291] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-09-29T19:40:18.662368] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-09-29T19:40:18.664003] [DEBUG] [LOCAL ] LDOS: Trimmed 67731 records to 45633 (keeping 200 days of data) [2025-09-29T19:40:18.761713] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-09-29T19:40:18.969913] [DEBUG] [LOCAL ] LDOS: Primary data saved (45633 records). [2025-09-29T19:40:18.970051] [INFO ] [MAIN ] LDOS: Full history saved. [2025-09-29T19:40:18.970149] [INFO ] [MAIN ] Update Progress: 1249/2371 symbols completed. LDOS took 46.5s. Estimated remaining: 2h 23m 58s. Rate: 7.8 symbols/min [2025-09-29T19:40:19.151493] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:40:19.184472] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-29T19:40:19.209445] [DEBUG] [LOCAL ] LEO: Loaded 17785 existing records from primary storage. [2025-09-29T19:40:19.209757] [INFO ] [MAIN ] LEO: Loaded 17785 existing records. [2025-09-29T19:40:19.407635] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:40:19.408532] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-09-29T19:40:19.408596] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-09-29T19:40:19.408940] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-09-29T19:40:19.409004] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-09-29T19:40:19.551351] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-01. [2025-09-29T19:40:19.651254] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-29T19:40:19.848329] [INFO ] [REMOTE ] LEO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:40:20.348091] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-09-29T19:40:20.500447] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-29T19:40:21.148127] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-09-29T19:40:21.884329] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-09-29T19:40:21.948069] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-09-29T19:40:22.061174] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-29T19:40:22.070350] [INFO ] [REMOTE ] LEA: Full fetch complete (60930 records). [2025-09-29T19:40:22.070486] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-09-29T19:40:22.486514] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-09-29T19:40:22.486612] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-09-29T19:40:22.487631] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-09-29T19:40:22.487718] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-09-29T19:40:22.488999] [DEBUG] [LOCAL ] LEA: Trimmed 60930 records to 41756 (keeping 200 days of data) [2025-09-29T19:40:22.748438] [INFO ] [REMOTE ] LEO: Fetching primary data for 2024-12. [2025-09-29T19:40:22.796351] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-29T19:40:22.795204] [DEBUG] [LOCAL ] LEA: Primary data saved (41756 records). [2025-09-29T19:40:22.806375] [INFO ] [MAIN ] LEA: Full history saved. [2025-09-29T19:40:22.806947] [INFO ] [MAIN ] Update Progress: 1250/2371 symbols completed. LEA took 28.5s. Estimated remaining: 2h 23m 47s. Rate: 7.8 symbols/min [2025-09-29T19:40:22.983387] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:40:23.047267] [DEBUG] [LOCAL ] LEVI: Loaded 52306 existing records from primary storage. [2025-09-29T19:40:23.047604] [INFO ] [MAIN ] LEVI: Loaded 52306 existing records. [2025-09-29T19:40:23.240889] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:40:23.241100] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-09-29T19:40:23.241157] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-09-29T19:40:23.241920] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-09-29T19:40:23.241992] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-09-29T19:40:23.549757] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-09-29T19:40:23.637429] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:40:23.668096] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-29T19:40:23.891830] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-29T19:40:24.348113] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2024-12. [2025-09-29T19:40:25.148130] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-09-29T19:40:25.355992] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-29T19:40:25.852601] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-29T19:40:25.948089] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-01. [2025-09-29T19:40:26.748117] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-01. [2025-09-29T19:40:27.168735] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-29T19:40:27.548085] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-09-29T19:40:27.702631] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-29T19:40:27.779444] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-29T19:40:28.348121] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-09-29T19:40:29.148120] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-09-29T19:40:29.432227] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-29T19:40:29.956987] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-09-29T19:40:29.962565] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-29T19:40:30.718958] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-29T19:40:30.748127] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-09-29T19:40:31.118757] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-29T19:40:31.548092] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-09-29T19:40:32.348105] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-09-29T19:40:32.430275] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-29T19:40:33.148092] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-09-29T19:40:33.421218] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-29T19:40:33.458373] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-29T19:40:33.948104] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-09-29T19:40:34.717160] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-29T19:40:34.748069] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-09-29T19:40:35.138311] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-29T19:40:35.548104] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-09-29T19:40:36.348082] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-09-29T19:40:36.417448] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-29T19:40:36.523552] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-29T19:40:37.148132] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-09-29T19:40:37.948123] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-09-29T19:40:38.015398] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-29T19:40:38.025886] [INFO ] [REMOTE ] LEG: Full fetch complete (73201 records). [2025-09-29T19:40:38.026037] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-09-29T19:40:38.447110] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-09-29T19:40:38.447252] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-09-29T19:40:38.448317] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-09-29T19:40:38.448426] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-09-29T19:40:38.449956] [DEBUG] [LOCAL ] LEG: Trimmed 73201 records to 50337 (keeping 200 days of data) [2025-09-29T19:40:38.753298] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-09-29T19:40:38.775978] [DEBUG] [LOCAL ] LEG: Primary data saved (50337 records). [2025-09-29T19:40:38.776222] [INFO ] [MAIN ] LEG: Full history saved. [2025-09-29T19:40:38.776386] [INFO ] [MAIN ] Update Progress: 1251/2371 symbols completed. LEG took 42.8s. Estimated remaining: 2h 23m 47s. Rate: 7.8 symbols/min [2025-09-29T19:40:38.965181] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:40:38.984837] [DEBUG] [LOCAL ] LFT: Loaded 18286 existing records from primary storage. [2025-09-29T19:40:38.985101] [INFO ] [MAIN ] LFT: Loaded 18286 existing records. [2025-09-29T19:40:39.116859] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-29T19:40:39.207566] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:40:39.208042] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-09-29T19:40:39.208110] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-09-29T19:40:39.218355] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-09-29T19:40:39.236037] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-09-29T19:40:39.243327] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-29T19:40:39.557318] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-09-29T19:40:39.642214] [INFO ] [REMOTE ] LFT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:40:40.348151] [INFO ] [REMOTE ] LFT: Fetching primary data for 2024-12. [2025-09-29T19:40:40.466696] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-29T19:40:40.589381] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-29T19:40:41.148136] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-09-29T19:40:41.347627] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-29T19:40:41.948119] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-09-29T19:40:42.748117] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-09-29T19:40:42.883900] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-29T19:40:43.003158] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-29T19:40:43.548137] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-09-29T19:40:44.348130] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-01. [2025-09-29T19:40:44.626826] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-29T19:40:44.630809] [INFO ] [REMOTE ] LEO: Full fetch complete (27114 records). [2025-09-29T19:40:44.630932] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-09-29T19:40:45.033467] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-09-29T19:40:45.033748] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-09-29T19:40:45.034372] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-09-29T19:40:45.034468] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-09-29T19:40:45.035345] [DEBUG] [LOCAL ] LEO: Trimmed 27114 records to 17498 (keeping 200 days of data) [2025-09-29T19:40:45.143442] [DEBUG] [LOCAL ] LEO: Primary data saved (17498 records). [2025-09-29T19:40:45.143599] [INFO ] [MAIN ] LEO: Full history saved. [2025-09-29T19:40:45.143718] [INFO ] [MAIN ] Update Progress: 1252/2371 symbols completed. LEO took 26.2s. Estimated remaining: 2h 23m 38s. Rate: 7.8 symbols/min [2025-09-29T19:40:45.159381] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-09-29T19:40:45.292560] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-09-29T19:40:45.365442] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-29T19:40:45.396126] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:40:45.411046] [DEBUG] [LOCAL ] LGI: Loaded 10137 existing records from primary storage. [2025-09-29T19:40:45.411277] [INFO ] [MAIN ] LGI: Loaded 10137 existing records. [2025-09-29T19:40:45.596116] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:40:45.596327] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-09-29T19:40:45.596377] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-09-29T19:40:45.596621] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-09-29T19:40:45.596713] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-09-29T19:40:45.957870] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-09-29T19:40:45.964391] [INFO ] [REMOTE ] LGI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:40:46.748091] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-09-29T19:40:46.820520] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-29T19:40:47.325418] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-29T19:40:47.548149] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-09-29T19:40:48.348086] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-09-29T19:40:48.509874] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-29T19:40:48.925802] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-29T19:40:49.148142] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-09-29T19:40:49.763986] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-29T19:40:49.775527] [INFO ] [REMOTE ] LEN: Full fetch complete (77039 records). [2025-09-29T19:40:49.775721] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-09-29T19:40:49.953832] [INFO ] [REMOTE ] LGI: Fetching primary data for 2024-12. [2025-09-29T19:40:50.202984] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-09-29T19:40:50.203093] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-09-29T19:40:50.204295] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-09-29T19:40:50.204365] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-09-29T19:40:50.206062] [DEBUG] [LOCAL ] LEN: Trimmed 77039 records to 53195 (keeping 200 days of data) [2025-09-29T19:40:50.563088] [DEBUG] [LOCAL ] LEN: Primary data saved (53195 records). [2025-09-29T19:40:50.563233] [INFO ] [MAIN ] LEN: Full history saved. [2025-09-29T19:40:50.563324] [INFO ] [MAIN ] Update Progress: 1253/2371 symbols completed. LEN took 34.6s. Estimated remaining: 2h 23m 28s. Rate: 7.8 symbols/min [2025-09-29T19:40:50.741231] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:40:50.748106] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-09-29T19:40:50.783457] [DEBUG] [LOCAL ] LH: Loaded 38660 existing records from primary storage. [2025-09-29T19:40:50.783776] [INFO ] [MAIN ] LH: Loaded 38660 existing records. [2025-09-29T19:40:50.975928] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:40:50.976288] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-09-29T19:40:50.976400] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-09-29T19:40:50.976908] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-09-29T19:40:50.976974] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-09-29T19:40:51.118292] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-29T19:40:51.182678] [INFO ] [REMOTE ] LEVI: Full fetch complete (74423 records). [2025-09-29T19:40:51.192317] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-09-29T19:40:51.409005] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-29T19:40:51.557412] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-01. [2025-09-29T19:40:51.621493] [INFO ] [REMOTE ] LH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:40:51.680584] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-29T19:40:51.939751] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-09-29T19:40:51.939841] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-09-29T19:40:51.941004] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-09-29T19:40:51.941073] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-09-29T19:40:51.942589] [DEBUG] [LOCAL ] LEVI: Trimmed 74423 records to 51512 (keeping 200 days of data) [2025-09-29T19:40:52.267452] [DEBUG] [LOCAL ] LEVI: Primary data saved (51512 records). [2025-09-29T19:40:52.267719] [INFO ] [MAIN ] LEVI: Full history saved. [2025-09-29T19:40:52.267823] [INFO ] [MAIN ] Update Progress: 1254/2371 symbols completed. LEVI took 29.5s. Estimated remaining: 2h 23m 15s. Rate: 7.8 symbols/min [2025-09-29T19:40:52.353549] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-09-29T19:40:52.452220] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:40:52.453256] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-29T19:40:52.507246] [DEBUG] [LOCAL ] LHX: Loaded 49413 existing records from primary storage. [2025-09-29T19:40:52.507561] [INFO ] [MAIN ] LHX: Loaded 49413 existing records. [2025-09-29T19:40:52.690188] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:40:52.690390] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-09-29T19:40:52.690445] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-09-29T19:40:52.691131] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-09-29T19:40:52.691198] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-09-29T19:40:53.074147] [INFO ] [REMOTE ] LHX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:40:53.148127] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-09-29T19:40:53.395321] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-29T19:40:53.904780] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-29T19:40:53.948111] [INFO ] [REMOTE ] LH: Fetching primary data for 2024-12. [2025-09-29T19:40:54.748116] [INFO ] [REMOTE ] LHX: Fetching primary data for 2024-12. [2025-09-29T19:40:55.548118] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-09-29T19:40:55.581102] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-29T19:40:56.319809] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-29T19:40:56.348109] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-09-29T19:40:56.414315] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-29T19:40:57.148089] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-09-29T19:40:57.157871] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-29T19:40:57.948141] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-09-29T19:40:58.303037] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-29T19:40:58.748116] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-09-29T19:40:58.809627] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-29T19:40:59.548119] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-01. [2025-09-29T19:40:59.808023] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-29T19:41:00.348126] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-09-29T19:41:01.148128] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-01. [2025-09-29T19:41:01.254395] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-29T19:41:01.488585] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-29T19:41:01.948136] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-09-29T19:41:02.579136] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-29T19:41:02.748173] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-09-29T19:41:03.496890] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-29T19:41:03.548133] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-09-29T19:41:03.630596] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-29T19:41:04.348118] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-09-29T19:41:04.638221] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-29T19:41:05.148169] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-09-29T19:41:05.948164] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-09-29T19:41:06.155914] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-29T19:41:06.233342] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-29T19:41:06.748193] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-09-29T19:41:07.278862] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-29T19:41:07.548125] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-09-29T19:41:08.273631] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-29T19:41:08.348100] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-09-29T19:41:08.364447] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-29T19:41:08.366630] [INFO ] [REMOTE ] LGI: Full fetch complete (14321 records). [2025-09-29T19:41:08.366738] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-09-29T19:41:08.754322] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-09-29T19:41:08.754435] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-09-29T19:41:08.754859] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-09-29T19:41:08.754937] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-09-29T19:41:08.755598] [DEBUG] [LOCAL ] LGI: Trimmed 14321 records to 9870 (keeping 200 days of data) [2025-09-29T19:41:08.819270] [DEBUG] [LOCAL ] LGI: Primary data saved (9870 records). [2025-09-29T19:41:08.819409] [INFO ] [MAIN ] LGI: Full history saved. [2025-09-29T19:41:08.819508] [INFO ] [MAIN ] Update Progress: 1255/2371 symbols completed. LGI took 23.7s. Estimated remaining: 2h 23m 15s. Rate: 7.8 symbols/min [2025-09-29T19:41:08.999549] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:41:09.035218] [DEBUG] [LOCAL ] LII: Loaded 28648 existing records from primary storage. [2025-09-29T19:41:09.035871] [INFO ] [MAIN ] LII: Loaded 28648 existing records. [2025-09-29T19:41:09.153205] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-09-29T19:41:09.241111] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:41:09.242076] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-09-29T19:41:09.242230] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-09-29T19:41:09.242791] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-09-29T19:41:09.242876] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-09-29T19:41:09.482132] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-29T19:41:09.548998] [INFO ] [REMOTE ] LFT: Full fetch complete (24053 records). [2025-09-29T19:41:09.566839] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-09-29T19:41:09.794500] [INFO ] [REMOTE ] LII: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:41:09.953317] [INFO ] [REMOTE ] LII: Fetching primary data for 2024-12. [2025-09-29T19:41:10.113526] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-09-29T19:41:10.113748] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-09-29T19:41:10.114380] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-09-29T19:41:10.114427] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-09-29T19:41:10.115389] [DEBUG] [LOCAL ] LFT: Trimmed 24053 records to 18238 (keeping 200 days of data) [2025-09-29T19:41:10.241755] [DEBUG] [LOCAL ] LFT: Primary data saved (18238 records). [2025-09-29T19:41:10.241918] [INFO ] [MAIN ] LFT: Full history saved. [2025-09-29T19:41:10.242070] [INFO ] [MAIN ] Update Progress: 1256/2371 symbols completed. LFT took 31.5s. Estimated remaining: 2h 23m 2s. Rate: 7.8 symbols/min [2025-09-29T19:41:10.430544] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:41:10.472594] [DEBUG] [LOCAL ] LION: Loaded 43950 existing records from primary storage. [2025-09-29T19:41:10.472944] [INFO ] [MAIN ] LION: Loaded 43950 existing records. [2025-09-29T19:41:10.665910] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:41:10.666122] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-09-29T19:41:10.666170] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-09-29T19:41:10.666484] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-09-29T19:41:10.666544] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-09-29T19:41:10.752602] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-09-29T19:41:11.073760] [INFO ] [REMOTE ] LION: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:41:11.107445] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-29T19:41:11.202082] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-29T19:41:11.548139] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-09-29T19:41:12.348157] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-01. [2025-09-29T19:41:12.412070] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-29T19:41:13.148080] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-09-29T19:41:13.429754] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-29T19:41:13.780103] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-29T19:41:13.948110] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-09-29T19:41:14.748090] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-09-29T19:41:14.853114] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-29T19:41:14.954147] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-29T19:41:15.548142] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-09-29T19:41:16.348095] [INFO ] [REMOTE ] LION: Fetching primary data for 2024-12. [2025-09-29T19:41:16.623874] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-29T19:41:17.086395] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-29T19:41:17.140507] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-29T19:41:17.148061] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-01. [2025-09-29T19:41:17.948120] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-09-29T19:41:18.220948] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-29T19:41:18.748120] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-09-29T19:41:19.393026] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-29T19:41:19.548105] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-09-29T19:41:20.206795] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-29T19:41:20.348113] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-09-29T19:41:21.150549] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-09-29T19:41:21.153260] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-29T19:41:21.948125] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-09-29T19:41:22.119337] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-29T19:41:22.661613] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-29T19:41:22.748128] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-09-29T19:41:23.031763] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-29T19:41:23.548155] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-09-29T19:41:24.047982] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-29T19:41:24.348127] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-09-29T19:41:25.010291] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-29T19:41:25.148119] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-09-29T19:41:25.948739] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-09-29T19:41:26.182795] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-29T19:41:26.193398] [INFO ] [REMOTE ] LHX: Full fetch complete (70794 records). [2025-09-29T19:41:26.193596] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-09-29T19:41:26.606413] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-29T19:41:26.675000] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-09-29T19:41:26.675091] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-09-29T19:41:26.676778] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-09-29T19:41:26.676902] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-09-29T19:41:26.677993] [INFO ] [REMOTE ] LH: Full fetch complete (54867 records). [2025-09-29T19:41:26.678250] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-09-29T19:41:26.679112] [DEBUG] [LOCAL ] LHX: Trimmed 70794 records to 48649 (keeping 200 days of data) [2025-09-29T19:41:26.751716] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-09-29T19:41:27.154586] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-29T19:41:27.263712] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-09-29T19:41:27.264075] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-09-29T19:41:27.265510] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-09-29T19:41:27.265841] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-09-29T19:41:27.270068] [DEBUG] [LOCAL ] LH: Trimmed 54867 records to 37834 (keeping 200 days of data) [2025-09-29T19:41:27.589198] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-09-29T19:41:27.676983] [DEBUG] [LOCAL ] LH: Primary data saved (37834 records). [2025-09-29T19:41:27.679159] [INFO ] [MAIN ] LH: Full history saved. [2025-09-29T19:41:27.681786] [INFO ] [MAIN ] Update Progress: 1257/2371 symbols completed. LH took 37.1s. Estimated remaining: 2h 23m 3s. Rate: 7.8 symbols/min [2025-09-29T19:41:27.918020] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:41:27.949250] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-29T19:41:27.947546] [DEBUG] [LOCAL ] LITB: Loaded 4436 existing records from primary storage. [2025-09-29T19:41:27.955109] [INFO ] [MAIN ] LITB: Loaded 4436 existing records. [2025-09-29T19:41:28.068986] [DEBUG] [LOCAL ] LHX: Primary data saved (48649 records). [2025-09-29T19:41:28.069198] [INFO ] [MAIN ] LHX: Full history saved. [2025-09-29T19:41:28.069717] [INFO ] [MAIN ] Update Progress: 1258/2371 symbols completed. LHX took 35.8s. Estimated remaining: 2h 22m 49s. Rate: 7.8 symbols/min [2025-09-29T19:41:28.281371] [WARN ] [MAIN ] LITB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:41:28.292062] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-09-29T19:41:28.292185] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-09-29T19:41:28.318082] [DEBUG] [LOCAL ] LITB: Deleted primary data file. [2025-09-29T19:41:28.327817] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-09-29T19:41:28.353677] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-09-29T19:41:28.355165] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:41:28.786818] [INFO ] [REMOTE ] LITB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:41:28.789159] [DEBUG] [LOCAL ] LLY: Loaded 54064 existing records from primary storage. [2025-09-29T19:41:28.789669] [INFO ] [MAIN ] LLY: Loaded 54064 existing records. [2025-09-29T19:41:28.991347] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:41:28.991636] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-09-29T19:41:28.997768] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-09-29T19:41:29.009588] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-29T19:41:29.009639] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-09-29T19:41:29.016339] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-09-29T19:41:29.165109] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-09-29T19:41:29.398475] [INFO ] [REMOTE ] LLY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:41:29.705436] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-29T19:41:29.948134] [INFO ] [REMOTE ] LITB: Fetching primary data for 2024-12. [2025-09-29T19:41:30.542794] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-29T19:41:30.748125] [INFO ] [REMOTE ] LLY: Fetching primary data for 2024-12. [2025-09-29T19:41:30.930604] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-29T19:41:31.548126] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-09-29T19:41:32.348111] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-01. [2025-09-29T19:41:32.806888] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-29T19:41:32.918976] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-29T19:41:33.148113] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-09-29T19:41:33.405616] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2024-12 (2.66 seconds). [2025-09-29T19:41:33.469823] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-29T19:41:33.948115] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-09-29T19:41:34.748109] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-09-29T19:41:35.432353] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-29T19:41:35.484688] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-29T19:41:35.491864] [INFO ] [REMOTE ] LII: Full fetch complete (41239 records). [2025-09-29T19:41:35.492065] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-09-29T19:41:35.556497] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-09-29T19:41:35.922985] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-09-29T19:41:35.923084] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-09-29T19:41:35.924015] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-09-29T19:41:35.924087] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-09-29T19:41:35.925342] [DEBUG] [LOCAL ] LII: Trimmed 41239 records to 27955 (keeping 200 days of data) [2025-09-29T19:41:36.142997] [DEBUG] [LOCAL ] LII: Primary data saved (27955 records). [2025-09-29T19:41:36.143156] [INFO ] [MAIN ] LII: Full history saved. [2025-09-29T19:41:36.143281] [INFO ] [MAIN ] Update Progress: 1259/2371 symbols completed. LII took 27.3s. Estimated remaining: 2h 22m 41s. Rate: 7.8 symbols/min [2025-09-29T19:41:36.348291] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-01. [2025-09-29T19:41:36.352280] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:41:36.397229] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-29T19:41:36.418085] [DEBUG] [LOCAL ] LMND: Loaded 52647 existing records from primary storage. [2025-09-29T19:41:36.418461] [INFO ] [MAIN ] LMND: Loaded 52647 existing records. [2025-09-29T19:41:36.607168] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:41:36.607439] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-09-29T19:41:36.607491] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-09-29T19:41:36.608081] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-09-29T19:41:36.608145] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-09-29T19:41:37.004249] [INFO ] [REMOTE ] LMND: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:41:37.148163] [INFO ] [REMOTE ] LMND: Fetching primary data for 2024-12. [2025-09-29T19:41:37.948133] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-09-29T19:41:38.482912] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-29T19:41:38.749219] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-09-29T19:41:38.752439] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-01 (2.40 seconds). [2025-09-29T19:41:38.859358] [DEBUG] [REMOTE ] LITB: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-09-29T19:41:38.859771] [WARN ] [REMOTE ] LITB: No data returned for month 2025-06 [2025-09-29T19:41:38.859866] [FATAL] [REMOTE ] LITB: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T19:41:38.859948] [FATAL] [MAIN ] LITB: Failed to fetch primary data. [2025-09-29T19:41:38.860013] [WARN ] [MAIN ] LITB: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T19:41:38.860092] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-09-29T19:41:38.860176] [DEBUG] [LOCAL ] LITB: No primary data file found to delete. [2025-09-29T19:41:38.860234] [INFO ] [LOCAL ] LITB: Starting deletion of derivative data. [2025-09-29T19:41:38.860667] [DEBUG] [LOCAL ] LITB: Deleted derivative data file. [2025-09-29T19:41:38.860758] [INFO ] [MAIN ] Update Progress: 1260/2371 symbols completed. LITB took 11.2s. Estimated remaining: 2h 22m 29s. Rate: 7.8 symbols/min [2025-09-29T19:41:39.052226] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:41:39.121147] [DEBUG] [LOCAL ] LMT: Loaded 50608 existing records from primary storage. [2025-09-29T19:41:39.121825] [INFO ] [MAIN ] LMT: Loaded 50608 existing records. [2025-09-29T19:41:39.317770] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:41:39.318276] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-09-29T19:41:39.318364] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-09-29T19:41:39.319815] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-09-29T19:41:39.319905] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-09-29T19:41:39.478588] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-09-29T19:41:39.560262] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-01. [2025-09-29T19:41:39.778827] [INFO ] [REMOTE ] LMT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:41:40.348185] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-09-29T19:41:41.058986] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-29T19:41:41.148088] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-09-29T19:41:41.948090] [INFO ] [REMOTE ] LMT: Fetching primary data for 2024-12. [2025-09-29T19:41:42.070465] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-29T19:41:42.748138] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-09-29T19:41:43.129079] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-29T19:41:43.548096] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-09-29T19:41:43.976906] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-29T19:41:44.348109] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-01. [2025-09-29T19:41:45.127316] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (2.38 seconds). [2025-09-29T19:41:45.148072] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-09-29T19:41:45.214899] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-29T19:41:45.948204] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-09-29T19:41:46.566137] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-09-29T19:41:46.748127] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-09-29T19:41:47.410615] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-29T19:41:47.502370] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-09-29T19:41:47.548078] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-09-29T19:41:48.348094] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-09-29T19:41:48.508728] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-29T19:41:49.148122] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-09-29T19:41:49.948149] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-09-29T19:41:50.037940] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-09-29T19:41:50.230794] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-29T19:41:50.748215] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-09-29T19:41:51.304580] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-29T19:41:51.386524] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-29T19:41:51.396980] [INFO ] [REMOTE ] LION: Full fetch complete (54641 records). [2025-09-29T19:41:51.397137] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-09-29T19:41:51.553744] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-09-29T19:41:51.806951] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-09-29T19:41:51.807077] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-09-29T19:41:51.808212] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-09-29T19:41:51.808291] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-09-29T19:41:51.811157] [DEBUG] [LOCAL ] LION: Trimmed 54641 records to 43772 (keeping 200 days of data) [2025-09-29T19:41:52.077260] [DEBUG] [LOCAL ] LION: Primary data saved (43772 records). [2025-09-29T19:41:52.077508] [INFO ] [MAIN ] LION: Full history saved. [2025-09-29T19:41:52.077708] [INFO ] [MAIN ] Update Progress: 1261/2371 symbols completed. LION took 41.8s. Estimated remaining: 2h 22m 27s. Rate: 7.8 symbols/min [2025-09-29T19:41:52.259804] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:41:52.314686] [DEBUG] [LOCAL ] LNC: Loaded 52369 existing records from primary storage. [2025-09-29T19:41:52.315034] [INFO ] [MAIN ] LNC: Loaded 52369 existing records. [2025-09-29T19:41:52.359529] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-09-29T19:41:52.541596] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:41:52.542275] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-09-29T19:41:52.542369] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-09-29T19:41:52.542967] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-09-29T19:41:52.543036] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-09-29T19:41:52.934795] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-29T19:41:52.988308] [INFO ] [REMOTE ] LNC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:41:53.148121] [INFO ] [REMOTE ] LNC: Fetching primary data for 2024-12. [2025-09-29T19:41:53.820483] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-29T19:41:53.948238] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-09-29T19:41:54.748103] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-09-29T19:41:54.797012] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-29T19:41:54.921773] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (2.56 seconds). [2025-09-29T19:41:55.548127] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-01. [2025-09-29T19:41:56.068605] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-29T19:41:56.348119] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-09-29T19:41:56.706296] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-29T19:41:57.148105] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-09-29T19:41:57.200088] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-29T19:41:57.948133] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-09-29T19:41:58.612037] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-09-29T19:41:58.748162] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-09-29T19:41:59.555242] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-09-29T19:41:59.577552] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-09-29T19:41:59.986597] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-29T19:42:00.348145] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-09-29T19:42:01.026968] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-29T19:42:01.148145] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-09-29T19:42:01.382005] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-09-29T19:42:01.948264] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-09-29T19:42:02.522744] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-29T19:42:02.748184] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-09-29T19:42:02.888716] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-29T19:42:03.548114] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-09-29T19:42:04.348075] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-09-29T19:42:04.549260] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-09-29T19:42:04.741633] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-29T19:42:05.148128] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-09-29T19:42:05.696880] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-29T19:42:05.948099] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-09-29T19:42:06.168187] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-29T19:42:06.748159] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-09-29T19:42:07.424907] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-29T19:42:07.436157] [INFO ] [REMOTE ] LMND: Full fetch complete (75303 records). [2025-09-29T19:42:07.436334] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-09-29T19:42:07.552162] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-09-29T19:42:07.896395] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-09-29T19:42:07.896804] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-09-29T19:42:07.899140] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-09-29T19:42:07.899267] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-09-29T19:42:07.901072] [DEBUG] [LOCAL ] LMND: Trimmed 75303 records to 51875 (keeping 200 days of data) [2025-09-29T19:42:08.169790] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-29T19:42:08.182465] [INFO ] [REMOTE ] LMT: Full fetch complete (72506 records). [2025-09-29T19:42:08.183440] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-09-29T19:42:08.714703] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present. [2025-09-29T19:42:08.715608] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed. [2025-09-29T19:42:08.717078] [INFO ] [MAIN ] LMT: Fetched primary data is valid. [2025-09-29T19:42:08.722104] [DEBUG] [LOCAL ] LMT: Saving primary data. [2025-09-29T19:42:08.765764] [DEBUG] [LOCAL ] LMT: Trimmed 72506 records to 49839 (keeping 200 days of data) [2025-09-29T19:42:08.769923] [DEBUG] [LOCAL ] LMND: Primary data saved (51875 records). [2025-09-29T19:42:08.771231] [INFO ] [MAIN ] LMND: Full history saved. [2025-09-29T19:42:08.772976] [INFO ] [MAIN ] Update Progress: 1262/2371 symbols completed. LMND took 32.6s. Estimated remaining: 2h 22m 27s. Rate: 7.8 symbols/min [2025-09-29T19:42:08.772675] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-29T19:42:08.976410] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-09-29T19:42:09.077680] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:42:09.088557] [DEBUG] [LOCAL ] LND: Loaded 5013 existing records from primary storage. [2025-09-29T19:42:09.089483] [INFO ] [MAIN ] LND: Loaded 5013 existing records. [2025-09-29T19:42:09.300952] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:42:09.301851] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-09-29T19:42:09.302516] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-09-29T19:42:09.303462] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-09-29T19:42:09.303916] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-09-29T19:42:09.712394] [INFO ] [REMOTE ] LND: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:42:09.713481] [INFO ] [REMOTE ] LND: Fetching primary data for 2024-12. [2025-09-29T19:42:09.914506] [DEBUG] [LOCAL ] LMT: Primary data saved (49839 records). [2025-09-29T19:42:09.914707] [INFO ] [MAIN ] LMT: Full history saved. [2025-09-29T19:42:09.914832] [INFO ] [MAIN ] Update Progress: 1263/2371 symbols completed. LMT took 31.1s. Estimated remaining: 2h 22m 13s. Rate: 7.8 symbols/min [2025-09-29T19:42:10.108107] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:42:10.164045] [DEBUG] [LOCAL ] LNG: Loaded 52224 existing records from primary storage. [2025-09-29T19:42:10.164447] [INFO ] [MAIN ] LNG: Loaded 52224 existing records. [2025-09-29T19:42:10.404973] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:42:10.405378] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-09-29T19:42:10.405454] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-09-29T19:42:10.416530] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-09-29T19:42:10.432118] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-09-29T19:42:10.501470] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (2.95 seconds). [2025-09-29T19:42:10.553000] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-09-29T19:42:10.862999] [INFO ] [REMOTE ] LNG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:42:10.863589] [INFO ] [REMOTE ] LNG: Fetching primary data for 2024-12. [2025-09-29T19:42:10.864070] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-29T19:42:10.898335] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-29T19:42:11.548153] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-09-29T19:42:12.348126] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-01. [2025-09-29T19:42:12.646875] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-29T19:42:12.974360] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-29T19:42:13.148149] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-01. [2025-09-29T19:42:13.364528] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-29T19:42:13.410637] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (2.86 seconds). [2025-09-29T19:42:13.429831] [INFO ] [REMOTE ] LLY: Full fetch complete (77259 records). [2025-09-29T19:42:13.430075] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-09-29T19:42:13.867213] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-09-29T19:42:13.867307] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-09-29T19:42:13.868483] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-09-29T19:42:13.868566] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-09-29T19:42:13.870208] [DEBUG] [LOCAL ] LLY: Trimmed 77259 records to 53280 (keeping 200 days of data) [2025-09-29T19:42:13.948123] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-09-29T19:42:14.252500] [DEBUG] [LOCAL ] LLY: Primary data saved (53280 records). [2025-09-29T19:42:14.252711] [INFO ] [MAIN ] LLY: Full history saved. [2025-09-29T19:42:14.252817] [INFO ] [MAIN ] Update Progress: 1264/2371 symbols completed. LLY took 46.2s. Estimated remaining: 2h 22m 3s. Rate: 7.8 symbols/min [2025-09-29T19:42:14.437084] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:42:14.455291] [DEBUG] [LOCAL ] LNN: Loaded 11404 existing records from primary storage. [2025-09-29T19:42:14.455551] [INFO ] [MAIN ] LNN: Loaded 11404 existing records. [2025-09-29T19:42:14.656927] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:42:14.657201] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-09-29T19:42:14.657307] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-09-29T19:42:14.657566] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-09-29T19:42:14.657627] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-09-29T19:42:14.753441] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-09-29T19:42:14.777179] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-29T19:42:15.064187] [INFO ] [REMOTE ] LNN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:42:15.096873] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-29T19:42:15.548170] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-09-29T19:42:16.167760] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-29T19:42:16.348163] [INFO ] [REMOTE ] LNN: Fetching primary data for 2024-12. [2025-09-29T19:42:16.507875] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-29T19:42:17.122773] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-29T19:42:17.148186] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-09-29T19:42:17.948123] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-09-29T19:42:18.709072] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-29T19:42:18.748117] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-09-29T19:42:18.965158] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-29T19:42:18.976189] [INFO ] [REMOTE ] LNC: Full fetch complete (74149 records). [2025-09-29T19:42:18.976366] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-09-29T19:42:19.388573] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-29T19:42:19.438378] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-09-29T19:42:19.438481] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-09-29T19:42:19.439746] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-09-29T19:42:19.439816] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-09-29T19:42:19.441962] [DEBUG] [LOCAL ] LNC: Trimmed 74149 records to 51612 (keeping 200 days of data) [2025-09-29T19:42:19.549970] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-09-29T19:42:19.798090] [DEBUG] [LOCAL ] LNC: Primary data saved (51612 records). [2025-09-29T19:42:19.798241] [INFO ] [MAIN ] LNC: Full history saved. [2025-09-29T19:42:19.798327] [INFO ] [MAIN ] Update Progress: 1265/2371 symbols completed. LNC took 27.7s. Estimated remaining: 2h 21m 53s. Rate: 7.8 symbols/min [2025-09-29T19:42:19.999728] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:42:20.044960] [DEBUG] [LOCAL ] LOAR: Loaded 42150 existing records from primary storage. [2025-09-29T19:42:20.045286] [INFO ] [MAIN ] LOAR: Loaded 42150 existing records. [2025-09-29T19:42:20.237813] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-29T19:42:20.243748] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:42:20.245937] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-09-29T19:42:20.246940] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-09-29T19:42:20.247353] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-09-29T19:42:20.247414] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-09-29T19:42:20.353592] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-01. [2025-09-29T19:42:20.643469] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:42:21.148131] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2024-12. [2025-09-29T19:42:21.253708] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-29T19:42:21.948133] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-09-29T19:42:22.473581] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-29T19:42:22.727859] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-29T19:42:22.748108] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-09-29T19:42:23.548120] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-09-29T19:42:24.348125] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-09-29T19:42:24.378014] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-29T19:42:24.632675] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-29T19:42:25.021179] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-29T19:42:25.148116] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-01. [2025-09-29T19:42:25.948124] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-09-29T19:42:26.534854] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-29T19:42:26.609073] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-29T19:42:26.748107] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-09-29T19:42:27.445877] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-29T19:42:27.447415] [INFO ] [REMOTE ] LND: Full fetch complete (8553 records). [2025-09-29T19:42:27.447491] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-09-29T19:42:27.553217] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-09-29T19:42:27.838833] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-09-29T19:42:27.838942] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-09-29T19:42:27.839181] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-09-29T19:42:27.839226] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-09-29T19:42:27.839704] [DEBUG] [LOCAL ] LND: Trimmed 8553 records to 4918 (keeping 200 days of data) [2025-09-29T19:42:27.868143] [DEBUG] [LOCAL ] LND: Primary data saved (4918 records). [2025-09-29T19:42:27.868250] [INFO ] [MAIN ] LND: Full history saved. [2025-09-29T19:42:27.868388] [INFO ] [MAIN ] Update Progress: 1266/2371 symbols completed. LND took 19.1s. Estimated remaining: 2h 21m 46s. Rate: 7.8 symbols/min [2025-09-29T19:42:28.051694] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:42:28.083747] [DEBUG] [LOCAL ] LOB: Loaded 27886 existing records from primary storage. [2025-09-29T19:42:28.084062] [INFO ] [MAIN ] LOB: Loaded 27886 existing records. [2025-09-29T19:42:28.276806] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:42:28.277089] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-09-29T19:42:28.277153] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-09-29T19:42:28.277497] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-09-29T19:42:28.277558] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-09-29T19:42:28.356754] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-09-29T19:42:28.670464] [INFO ] [REMOTE ] LOB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:42:28.871132] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-29T19:42:29.148117] [INFO ] [REMOTE ] LOB: Fetching primary data for 2024-12. [2025-09-29T19:42:29.399060] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-29T19:42:29.948108] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-09-29T19:42:30.140560] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-29T19:42:30.741327] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-29T19:42:30.748050] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-09-29T19:42:31.548122] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-09-29T19:42:31.649875] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-29T19:42:32.348132] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-01. [2025-09-29T19:42:32.914243] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-29T19:42:33.118424] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-29T19:42:33.148084] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-09-29T19:42:33.948133] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-09-29T19:42:34.221260] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-29T19:42:34.748134] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-09-29T19:42:35.548100] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-09-29T19:42:35.810612] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-29T19:42:36.253635] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-29T19:42:36.348092] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-09-29T19:42:36.505741] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-29T19:42:37.148155] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-09-29T19:42:37.948159] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-09-29T19:42:38.272991] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-29T19:42:38.748103] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-09-29T19:42:38.964055] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-29T19:42:39.204148] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-29T19:42:39.219143] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-29T19:42:39.548134] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-09-29T19:42:40.348168] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-09-29T19:42:41.085129] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-29T19:42:41.148150] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-09-29T19:42:41.787787] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-29T19:42:41.948125] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-09-29T19:42:42.294222] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-29T19:42:42.748080] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-09-29T19:42:42.987482] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-29T19:42:42.990174] [INFO ] [REMOTE ] LNN: Full fetch complete (15608 records). [2025-09-29T19:42:42.990258] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-09-29T19:42:43.372285] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-09-29T19:42:43.372428] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-09-29T19:42:43.372851] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-09-29T19:42:43.372928] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-09-29T19:42:43.373481] [DEBUG] [LOCAL ] LNN: Trimmed 15608 records to 11213 (keeping 200 days of data) [2025-09-29T19:42:43.450554] [DEBUG] [LOCAL ] LNN: Primary data saved (11213 records). [2025-09-29T19:42:43.450735] [INFO ] [MAIN ] LNN: Full history saved. [2025-09-29T19:42:43.450832] [INFO ] [MAIN ] Update Progress: 1267/2371 symbols completed. LNN took 29.2s. Estimated remaining: 2h 21m 45s. Rate: 7.8 symbols/min [2025-09-29T19:42:43.555464] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-09-29T19:42:43.631249] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:42:43.637991] [DEBUG] [LOCAL ] LOCL: Loaded 3644 existing records from primary storage. [2025-09-29T19:42:43.638189] [INFO ] [MAIN ] LOCL: Loaded 3644 existing records. [2025-09-29T19:42:43.823857] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:42:43.824146] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-09-29T19:42:43.824198] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-09-29T19:42:43.824370] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-09-29T19:42:43.824430] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-09-29T19:42:44.212778] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:42:44.348119] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2024-12. [2025-09-29T19:42:44.648127] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-29T19:42:44.725706] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-29T19:42:44.774115] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-29T19:42:45.148097] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-09-29T19:42:45.948136] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-09-29T19:42:46.326180] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-29T19:42:46.748132] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-01. [2025-09-29T19:42:47.186909] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-29T19:42:47.548125] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-09-29T19:42:47.981807] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-29T19:42:48.348142] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-09-29T19:42:48.728599] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-29T19:42:49.148164] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-09-29T19:42:49.948118] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-09-29T19:42:50.241553] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-09-29T19:42:50.264035] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-29T19:42:50.303305] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-29T19:42:50.748147] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-09-29T19:42:51.548147] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-09-29T19:42:52.348129] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-09-29T19:42:52.671711] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-29T19:42:52.782791] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-29T19:42:52.804342] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-29T19:42:52.812368] [INFO ] [REMOTE ] LOB: Full fetch complete (37784 records). [2025-09-29T19:42:52.812552] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-09-29T19:42:53.153323] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-09-29T19:42:53.294471] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-09-29T19:42:53.294561] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-09-29T19:42:53.295461] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-09-29T19:42:53.295530] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-09-29T19:42:53.296601] [DEBUG] [LOCAL ] LOB: Trimmed 37784 records to 27432 (keeping 200 days of data) [2025-09-29T19:42:53.471291] [DEBUG] [LOCAL ] LOB: Primary data saved (27432 records). [2025-09-29T19:42:53.471454] [INFO ] [MAIN ] LOB: Full history saved. [2025-09-29T19:42:53.471558] [INFO ] [MAIN ] Update Progress: 1268/2371 symbols completed. LOB took 25.6s. Estimated remaining: 2h 21m 39s. Rate: 7.8 symbols/min [2025-09-29T19:42:53.645034] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:42:53.682151] [DEBUG] [LOCAL ] LOMA: Loaded 32576 existing records from primary storage. [2025-09-29T19:42:53.682434] [INFO ] [MAIN ] LOMA: Loaded 32576 existing records. [2025-09-29T19:42:53.918902] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:42:53.919371] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-09-29T19:42:53.919437] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-09-29T19:42:53.919855] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-09-29T19:42:53.919916] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-09-29T19:42:53.953740] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-09-29T19:42:54.044756] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-29T19:42:54.332309] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:42:54.748104] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-09-29T19:42:55.250790] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-29T19:42:55.548114] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2024-12. [2025-09-29T19:42:55.901746] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-29T19:42:55.913032] [INFO ] [REMOTE ] LNG: Full fetch complete (74689 records). [2025-09-29T19:42:55.913198] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-09-29T19:42:56.328543] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-09-29T19:42:56.328661] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-09-29T19:42:56.329751] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-09-29T19:42:56.329818] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-09-29T19:42:56.331359] [DEBUG] [LOCAL ] LNG: Trimmed 74689 records to 51428 (keeping 200 days of data) [2025-09-29T19:42:56.390746] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-09-29T19:42:56.675851] [DEBUG] [LOCAL ] LNG: Primary data saved (51428 records). [2025-09-29T19:42:56.676040] [INFO ] [MAIN ] LNG: Full history saved. [2025-09-29T19:42:56.676147] [INFO ] [MAIN ] Update Progress: 1269/2371 symbols completed. LNG took 46.8s. Estimated remaining: 2h 21m 28s. Rate: 7.8 symbols/min [2025-09-29T19:42:56.880560] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:42:56.895843] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-29T19:42:56.945201] [DEBUG] [LOCAL ] LOW: Loaded 53721 existing records from primary storage. [2025-09-29T19:42:56.945553] [INFO ] [MAIN ] LOW: Loaded 53721 existing records. [2025-09-29T19:42:57.149540] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-09-29T19:42:57.169565] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-29T19:42:57.173550] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:42:57.183981] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-09-29T19:42:57.184166] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-09-29T19:42:57.185076] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-09-29T19:42:57.185138] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-09-29T19:42:57.583566] [INFO ] [REMOTE ] LOW: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:42:57.588079] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-29T19:42:57.948126] [INFO ] [REMOTE ] LOW: Fetching primary data for 2024-12. [2025-09-29T19:42:58.748170] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-01. [2025-09-29T19:42:59.548113] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-09-29T19:42:59.857511] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-29T19:42:59.891685] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-29T19:43:00.348130] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-09-29T19:43:01.148116] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-09-29T19:43:01.294961] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-29T19:43:01.586496] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-29T19:43:01.711140] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-29T19:43:01.948123] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-09-29T19:43:02.748134] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-09-29T19:43:03.548158] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-09-29T19:43:03.692950] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-29T19:43:03.702515] [INFO ] [REMOTE ] LOAR: Full fetch complete (56475 records). [2025-09-29T19:43:03.702718] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-09-29T19:43:04.143157] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-09-29T19:43:04.151723] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-09-29T19:43:04.153523] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-09-29T19:43:04.154803] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-09-29T19:43:04.154695] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-29T19:43:04.164166] [DEBUG] [LOCAL ] LOAR: Trimmed 56475 records to 41633 (keeping 200 days of data) [2025-09-29T19:43:04.266832] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-29T19:43:04.269631] [INFO ] [REMOTE ] LOCL: Full fetch complete (4779 records). [2025-09-29T19:43:04.270868] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-09-29T19:43:04.353710] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-09-29T19:43:04.823290] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-09-29T19:43:04.823785] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-09-29T19:43:04.824572] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-09-29T19:43:04.834070] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-09-29T19:43:04.837559] [DEBUG] [LOCAL ] LOCL: Trimmed 4779 records to 3631 (keeping 200 days of data) [2025-09-29T19:43:04.882414] [DEBUG] [LOCAL ] LOCL: Primary data saved (3631 records). [2025-09-29T19:43:04.883806] [DEBUG] [LOCAL ] LOAR: Primary data saved (41633 records). [2025-09-29T19:43:04.883973] [INFO ] [MAIN ] LOAR: Full history saved. [2025-09-29T19:43:04.884149] [INFO ] [MAIN ] Update Progress: 1270/2371 symbols completed. LOAR took 45.1s. Estimated remaining: 2h 21m 20s. Rate: 7.8 symbols/min [2025-09-29T19:43:04.884233] [INFO ] [MAIN ] LOCL: Full history saved. [2025-09-29T19:43:04.918682] [INFO ] [MAIN ] Update Progress: 1271/2371 symbols completed. LOCL took 21.4s. Estimated remaining: 2h 21m 6s. Rate: 7.8 symbols/min [2025-09-29T19:43:05.150435] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-01. [2025-09-29T19:43:05.207159] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:43:05.268842] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:43:05.309933] [DEBUG] [LOCAL ] LPL: Loaded 26305 existing records from primary storage. [2025-09-29T19:43:05.310340] [INFO ] [MAIN ] LPL: Loaded 26305 existing records. [2025-09-29T19:43:05.441682] [DEBUG] [LOCAL ] LPG: Loaded 40536 existing records from primary storage. [2025-09-29T19:43:05.484231] [INFO ] [MAIN ] LPG: Loaded 40536 existing records. [2025-09-29T19:43:05.579498] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:43:05.599056] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-09-29T19:43:05.604381] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-09-29T19:43:05.646701] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-09-29T19:43:05.668597] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-09-29T19:43:05.787390] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:43:05.825991] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-09-29T19:43:05.849334] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-09-29T19:43:05.861412] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-09-29T19:43:05.894707] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-09-29T19:43:05.940706] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-29T19:43:06.046863] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-09-29T19:43:06.437552] [INFO ] [REMOTE ] LPL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:43:06.598079] [INFO ] [REMOTE ] LPG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:43:06.748090] [INFO ] [REMOTE ] LPL: Fetching primary data for 2024-12. [2025-09-29T19:43:07.150699] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-29T19:43:07.180255] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-29T19:43:07.548150] [INFO ] [REMOTE ] LPG: Fetching primary data for 2024-12. [2025-09-29T19:43:08.222334] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-29T19:43:08.348118] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-09-29T19:43:08.800475] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-29T19:43:09.148941] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-01. [2025-09-29T19:43:09.948096] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-01. [2025-09-29T19:43:10.119660] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-29T19:43:10.748084] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-09-29T19:43:10.812809] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-29T19:43:10.857810] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-29T19:43:11.548239] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-09-29T19:43:12.348151] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-09-29T19:43:12.552749] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-29T19:43:12.782145] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-29T19:43:13.148120] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-09-29T19:43:13.566749] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-29T19:43:13.948120] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-09-29T19:43:14.748140] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-03. [2025-09-29T19:43:15.201622] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-29T19:43:15.544784] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-29T19:43:15.553724] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-09-29T19:43:15.598843] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-29T19:43:16.348126] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-09-29T19:43:16.842795] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-29T19:43:17.148160] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-04. [2025-09-29T19:43:17.948084] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-09-29T19:43:18.324634] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-29T19:43:18.442985] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-29T19:43:18.748133] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-05. [2025-09-29T19:43:19.467167] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-29T19:43:19.519180] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-29T19:43:19.548104] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-06. [2025-09-29T19:43:20.348107] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-09-29T19:43:20.536292] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-29T19:43:21.148112] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-09-29T19:43:21.693418] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-29T19:43:21.948119] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-09-29T19:43:22.748089] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-07. [2025-09-29T19:43:22.831571] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-29T19:43:23.532790] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-29T19:43:23.548054] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-09-29T19:43:23.624751] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-29T19:43:24.348122] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-09-29T19:43:25.008793] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-29T19:43:25.148109] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-09-29T19:43:25.824217] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-29T19:43:25.948119] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-08. [2025-09-29T19:43:26.611580] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-29T19:43:26.748118] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-09-29T19:43:27.548123] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-07. [2025-09-29T19:43:27.616055] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-29T19:43:28.348118] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-09-29T19:43:28.402844] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-29T19:43:28.412295] [INFO ] [REMOTE ] LOMA: Full fetch complete (48142 records). [2025-09-29T19:43:28.412520] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-09-29T19:43:28.816468] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-09-29T19:43:28.816552] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-09-29T19:43:28.817670] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-09-29T19:43:28.817737] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-09-29T19:43:28.818909] [DEBUG] [LOCAL ] LOMA: Trimmed 48142 records to 32012 (keeping 200 days of data) [2025-09-29T19:43:29.028669] [DEBUG] [LOCAL ] LOMA: Primary data saved (32012 records). [2025-09-29T19:43:29.028860] [INFO ] [MAIN ] LOMA: Full history saved. [2025-09-29T19:43:29.028990] [INFO ] [MAIN ] Update Progress: 1272/2371 symbols completed. LOMA took 35.6s. Estimated remaining: 2h 21m 12s. Rate: 7.8 symbols/min [2025-09-29T19:43:29.150127] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-09-29T19:43:29.222375] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:43:29.270988] [DEBUG] [LOCAL ] LPX: Loaded 40311 existing records from primary storage. [2025-09-29T19:43:29.271484] [INFO ] [MAIN ] LPX: Loaded 40311 existing records. [2025-09-29T19:43:29.464592] [WARN ] [MAIN ] LPX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:43:29.465097] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-09-29T19:43:29.465192] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-09-29T19:43:29.465677] [DEBUG] [LOCAL ] LPX: Deleted primary data file. [2025-09-29T19:43:29.465743] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-09-29T19:43:29.738281] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-29T19:43:29.913695] [INFO ] [REMOTE ] LPX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:43:29.935248] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-29T19:43:29.943213] [INFO ] [REMOTE ] LPL: Full fetch complete (35029 records). [2025-09-29T19:43:29.943302] [DEBUG] [VALIDATOR ] LPL: Validating primary data. [2025-09-29T19:43:29.954968] [INFO ] [REMOTE ] LPX: Fetching primary data for 2024-12. [2025-09-29T19:43:30.331600] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present. [2025-09-29T19:43:30.331725] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed. [2025-09-29T19:43:30.332432] [INFO ] [MAIN ] LPL: Fetched primary data is valid. [2025-09-29T19:43:30.332474] [DEBUG] [LOCAL ] LPL: Saving primary data. [2025-09-29T19:43:30.333311] [DEBUG] [LOCAL ] LPL: Trimmed 35029 records to 26121 (keeping 200 days of data) [2025-09-29T19:43:30.488876] [DEBUG] [LOCAL ] LPL: Primary data saved (26121 records). [2025-09-29T19:43:30.489012] [INFO ] [MAIN ] LPL: Full history saved. [2025-09-29T19:43:30.489128] [INFO ] [MAIN ] Update Progress: 1273/2371 symbols completed. LPL took 25.5s. Estimated remaining: 2h 20m 59s. Rate: 7.8 symbols/min [2025-09-29T19:43:30.672830] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:43:30.700067] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-29T19:43:30.751080] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-08. [2025-09-29T19:43:30.752225] [DEBUG] [LOCAL ] LRN: Loaded 40503 existing records from primary storage. [2025-09-29T19:43:30.753449] [INFO ] [MAIN ] LRN: Loaded 40503 existing records. [2025-09-29T19:43:30.942377] [WARN ] [MAIN ] LRN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:43:30.942570] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-09-29T19:43:30.942619] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-09-29T19:43:30.943240] [DEBUG] [LOCAL ] LRN: Deleted primary data file. [2025-09-29T19:43:30.943299] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-09-29T19:43:31.321393] [INFO ] [REMOTE ] LRN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:43:31.351728] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-29T19:43:31.548111] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-01. [2025-09-29T19:43:32.348112] [INFO ] [REMOTE ] LRN: Fetching primary data for 2024-12. [2025-09-29T19:43:32.833632] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-29T19:43:33.058192] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-29T19:43:33.148127] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-02. [2025-09-29T19:43:33.873410] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-29T19:43:33.948119] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-01. [2025-09-29T19:43:34.360948] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-29T19:43:34.748115] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-03. [2025-09-29T19:43:35.554040] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-09-29T19:43:35.566760] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-29T19:43:36.184785] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-29T19:43:36.348157] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-09-29T19:43:37.113903] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-29T19:43:37.122846] [INFO ] [REMOTE ] LPG: Full fetch complete (59725 records). [2025-09-29T19:43:37.123006] [DEBUG] [VALIDATOR ] LPG: Validating primary data. [2025-09-29T19:43:37.156987] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-02. [2025-09-29T19:43:37.544137] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present. [2025-09-29T19:43:37.544252] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed. [2025-09-29T19:43:37.545360] [INFO ] [MAIN ] LPG: Fetched primary data is valid. [2025-09-29T19:43:37.545428] [DEBUG] [LOCAL ] LPG: Saving primary data. [2025-09-29T19:43:37.548799] [DEBUG] [LOCAL ] LPG: Trimmed 59725 records to 39930 (keeping 200 days of data) [2025-09-29T19:43:37.805546] [DEBUG] [LOCAL ] LPG: Primary data saved (39930 records). [2025-09-29T19:43:37.805717] [INFO ] [MAIN ] LPG: Full history saved. [2025-09-29T19:43:37.805814] [INFO ] [MAIN ] Update Progress: 1274/2371 symbols completed. LPG took 32.9s. Estimated remaining: 2h 20m 51s. Rate: 7.8 symbols/min [2025-09-29T19:43:37.955593] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-04. [2025-09-29T19:43:37.991416] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:43:38.039433] [DEBUG] [LOCAL ] LSPD: Loaded 43782 existing records from primary storage. [2025-09-29T19:43:38.039773] [INFO ] [MAIN ] LSPD: Loaded 43782 existing records. [2025-09-29T19:43:38.227441] [WARN ] [MAIN ] LSPD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:43:38.227843] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-09-29T19:43:38.228042] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-09-29T19:43:38.228571] [DEBUG] [LOCAL ] LSPD: Deleted primary data file. [2025-09-29T19:43:38.228633] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-09-29T19:43:38.652891] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:43:38.655050] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-29T19:43:38.667481] [INFO ] [REMOTE ] LOW: Full fetch complete (76500 records). [2025-09-29T19:43:38.667770] [DEBUG] [VALIDATOR ] LOW: Validating primary data. [2025-09-29T19:43:38.779772] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2024-12. [2025-09-29T19:43:38.828592] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-29T19:43:39.147327] [DEBUG] [VALIDATOR ] LOW: All expected trading days are present. [2025-09-29T19:43:39.147421] [DEBUG] [VALIDATOR ] LOW: Primary data validation passed. [2025-09-29T19:43:39.148582] [INFO ] [MAIN ] LOW: Fetched primary data is valid. [2025-09-29T19:43:39.148687] [DEBUG] [LOCAL ] LOW: Saving primary data. [2025-09-29T19:43:39.150383] [DEBUG] [LOCAL ] LOW: Trimmed 76500 records to 52947 (keeping 200 days of data) [2025-09-29T19:43:39.514968] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-29T19:43:39.543084] [DEBUG] [LOCAL ] LOW: Primary data saved (52947 records). [2025-09-29T19:43:39.543256] [INFO ] [MAIN ] LOW: Full history saved. [2025-09-29T19:43:39.543342] [INFO ] [MAIN ] Update Progress: 1275/2371 symbols completed. LOW took 42.9s. Estimated remaining: 2h 20m 38s. Rate: 7.8 symbols/min [2025-09-29T19:43:39.558516] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-05. [2025-09-29T19:43:39.754315] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:43:39.787492] [DEBUG] [LOCAL ] LTC: Loaded 30478 existing records from primary storage. [2025-09-29T19:43:39.787834] [INFO ] [MAIN ] LTC: Loaded 30478 existing records. [2025-09-29T19:43:39.991548] [WARN ] [MAIN ] LTC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:43:39.992098] [INFO ] [MAIN ] LTC: Wiping existing primary data before full refresh. [2025-09-29T19:43:39.992330] [INFO ] [LOCAL ] LTC: Starting deletion of primary data. [2025-09-29T19:43:39.993615] [DEBUG] [LOCAL ] LTC: Deleted primary data file. [2025-09-29T19:43:39.993814] [INFO ] [MAIN ] LTC: Starting full primary refresh. [2025-09-29T19:43:40.139867] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-29T19:43:40.353232] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-03. [2025-09-29T19:43:40.420118] [INFO ] [REMOTE ] LTC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:43:41.065165] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-29T19:43:41.148120] [INFO ] [REMOTE ] LTC: Fetching primary data for 2024-12. [2025-09-29T19:43:41.948129] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-06. [2025-09-29T19:43:42.007513] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-29T19:43:42.522405] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-29T19:43:42.748154] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-01. [2025-09-29T19:43:43.548136] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-01. [2025-09-29T19:43:43.621511] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-29T19:43:43.957895] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-29T19:43:44.348127] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-02. [2025-09-29T19:43:44.992906] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-29T19:43:45.148123] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-04. [2025-09-29T19:43:45.594483] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-29T19:43:45.948120] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-02. [2025-09-29T19:43:46.748094] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-03. [2025-09-29T19:43:46.786797] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-29T19:43:47.495067] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-29T19:43:47.548145] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-03. [2025-09-29T19:43:47.663234] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-29T19:43:48.348126] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-07. [2025-09-29T19:43:49.153250] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-04. [2025-09-29T19:43:49.170273] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-29T19:43:49.906361] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-29T19:43:49.948124] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-08. [2025-09-29T19:43:50.473587] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-29T19:43:50.748128] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-05. [2025-09-29T19:43:51.475763] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-29T19:43:51.548147] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-09. [2025-09-29T19:43:52.324319] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-29T19:43:52.348090] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-06. [2025-09-29T19:43:53.111593] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-29T19:43:53.120236] [INFO ] [REMOTE ] LPX: Full fetch complete (58683 records). [2025-09-29T19:43:53.120456] [DEBUG] [VALIDATOR ] LPX: Validating primary data. [2025-09-29T19:43:53.155128] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-04. [2025-09-29T19:43:53.531968] [DEBUG] [VALIDATOR ] LPX: All expected trading days are present. [2025-09-29T19:43:53.532077] [DEBUG] [VALIDATOR ] LPX: Primary data validation passed. [2025-09-29T19:43:53.533166] [INFO ] [MAIN ] LPX: Fetched primary data is valid. [2025-09-29T19:43:53.533246] [DEBUG] [LOCAL ] LPX: Saving primary data. [2025-09-29T19:43:53.534606] [DEBUG] [LOCAL ] LPX: Trimmed 58683 records to 39661 (keeping 200 days of data) [2025-09-29T19:43:53.807845] [DEBUG] [LOCAL ] LPX: Primary data saved (39661 records). [2025-09-29T19:43:53.808064] [INFO ] [MAIN ] LPX: Full history saved. [2025-09-29T19:43:53.808197] [INFO ] [MAIN ] Update Progress: 1276/2371 symbols completed. LPX took 24.8s. Estimated remaining: 2h 20m 36s. Rate: 7.8 symbols/min [2025-09-29T19:43:53.961294] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-05. [2025-09-29T19:43:53.997782] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:43:54.027105] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-29T19:43:54.087047] [DEBUG] [LOCAL ] LTH: Loaded 52563 existing records from primary storage. [2025-09-29T19:43:54.087404] [INFO ] [MAIN ] LTH: Loaded 52563 existing records. [2025-09-29T19:43:54.273062] [WARN ] [MAIN ] LTH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:43:54.273343] [INFO ] [MAIN ] LTH: Wiping existing primary data before full refresh. [2025-09-29T19:43:54.273397] [INFO ] [LOCAL ] LTH: Starting deletion of primary data. [2025-09-29T19:43:54.274057] [DEBUG] [LOCAL ] LTH: Deleted primary data file. [2025-09-29T19:43:54.274142] [INFO ] [MAIN ] LTH: Starting full primary refresh. [2025-09-29T19:43:54.663431] [INFO ] [REMOTE ] LTH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:43:54.734038] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-29T19:43:54.748097] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-07. [2025-09-29T19:43:55.377772] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-29T19:43:55.548145] [INFO ] [REMOTE ] LTH: Fetching primary data for 2024-12. [2025-09-29T19:43:56.204806] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-29T19:43:56.348115] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-08. [2025-09-29T19:43:57.148116] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-05. [2025-09-29T19:43:57.848124] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-09-29T19:43:57.950875] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-01. [2025-09-29T19:43:57.955767] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-29T19:43:58.261970] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-29T19:43:58.748127] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-06. [2025-09-29T19:43:59.553177] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-06. [2025-09-29T19:43:59.566831] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-29T19:43:59.626806] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-29T19:44:00.348114] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-02. [2025-09-29T19:44:01.148146] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-07. [2025-09-29T19:44:01.303145] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-29T19:44:01.948172] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-09. [2025-09-29T19:44:02.025399] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-29T19:44:02.754030] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-07. [2025-09-29T19:44:02.771207] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-29T19:44:03.548089] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-08. [2025-09-29T19:44:03.802100] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-29T19:44:03.810406] [INFO ] [REMOTE ] LRN: Full fetch complete (58425 records). [2025-09-29T19:44:03.810600] [DEBUG] [VALIDATOR ] LRN: Validating primary data. [2025-09-29T19:44:04.243444] [DEBUG] [VALIDATOR ] LRN: All expected trading days are present. [2025-09-29T19:44:04.243562] [DEBUG] [VALIDATOR ] LRN: Primary data validation passed. [2025-09-29T19:44:04.244748] [INFO ] [MAIN ] LRN: Fetched primary data is valid. [2025-09-29T19:44:04.244887] [DEBUG] [LOCAL ] LRN: Saving primary data. [2025-09-29T19:44:04.254867] [DEBUG] [LOCAL ] LRN: Trimmed 58425 records to 39826 (keeping 200 days of data) [2025-09-29T19:44:04.273572] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-29T19:44:04.371616] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-08. [2025-09-29T19:44:04.541941] [DEBUG] [LOCAL ] LRN: Primary data saved (39826 records). [2025-09-29T19:44:04.542133] [INFO ] [MAIN ] LRN: Full history saved. [2025-09-29T19:44:04.542229] [INFO ] [MAIN ] Update Progress: 1277/2371 symbols completed. LRN took 34.1s. Estimated remaining: 2h 20m 31s. Rate: 7.8 symbols/min [2025-09-29T19:44:04.876636] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-29T19:44:05.148120] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-09. [2025-09-29T19:44:05.810230] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-29T19:44:05.948106] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-09. [2025-09-29T19:44:06.719249] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-29T19:44:06.726080] [INFO ] [REMOTE ] LTC: Full fetch complete (43254 records). [2025-09-29T19:44:06.726233] [DEBUG] [VALIDATOR ] LTC: Validating primary data. [2025-09-29T19:44:06.761302] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-03. [2025-09-29T19:44:07.160876] [DEBUG] [VALIDATOR ] LTC: All expected trading days are present. [2025-09-29T19:44:07.160963] [DEBUG] [VALIDATOR ] LTC: Primary data validation passed. [2025-09-29T19:44:07.161771] [INFO ] [MAIN ] LTC: Fetched primary data is valid. [2025-09-29T19:44:07.161835] [DEBUG] [LOCAL ] LTC: Saving primary data. [2025-09-29T19:44:07.162894] [DEBUG] [LOCAL ] LTC: Trimmed 43254 records to 29954 (keeping 200 days of data) [2025-09-29T19:44:07.348307] [DEBUG] [LOCAL ] LTC: Primary data saved (29954 records). [2025-09-29T19:44:07.348449] [INFO ] [MAIN ] LTC: Full history saved. [2025-09-29T19:44:07.348534] [INFO ] [MAIN ] Update Progress: 1278/2371 symbols completed. LTC took 27.8s. Estimated remaining: 2h 20m 19s. Rate: 7.8 symbols/min [2025-09-29T19:44:07.545312] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-29T19:44:07.554345] [INFO ] [REMOTE ] LSPD: Full fetch complete (61551 records). [2025-09-29T19:44:07.554522] [DEBUG] [VALIDATOR ] LSPD: Validating primary data. [2025-09-29T19:44:07.961179] [DEBUG] [VALIDATOR ] LSPD: All expected trading days are present. [2025-09-29T19:44:07.961281] [DEBUG] [VALIDATOR ] LSPD: Primary data validation passed. [2025-09-29T19:44:07.962278] [INFO ] [MAIN ] LSPD: Fetched primary data is valid. [2025-09-29T19:44:07.962345] [DEBUG] [LOCAL ] LSPD: Saving primary data. [2025-09-29T19:44:07.963805] [DEBUG] [LOCAL ] LSPD: Trimmed 61551 records to 42949 (keeping 200 days of data) [2025-09-29T19:44:08.229076] [DEBUG] [LOCAL ] LSPD: Primary data saved (42949 records). [2025-09-29T19:44:08.229219] [INFO ] [MAIN ] LSPD: Full history saved. [2025-09-29T19:44:08.229306] [INFO ] [MAIN ] Update Progress: 1279/2371 symbols completed. LSPD took 30.4s. Estimated remaining: 2h 20m 6s. Rate: 7.8 symbols/min [2025-09-29T19:44:08.386692] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-29T19:44:08.398533] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-04. [2025-09-29T19:44:10.124775] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-29T19:44:10.136374] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-05. [2025-09-29T19:44:11.834326] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-29T19:44:11.845787] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-06. [2025-09-29T19:44:13.442027] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-29T19:44:13.453585] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-07. [2025-09-29T19:44:15.235922] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-29T19:44:15.248313] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-08. [2025-09-29T19:44:16.962906] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-29T19:44:16.974379] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-09. [2025-09-29T19:44:18.915072] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-29T19:44:18.925751] [INFO ] [REMOTE ] LTH: Full fetch complete (74068 records). [2025-09-29T19:44:18.925905] [DEBUG] [VALIDATOR ] LTH: Validating primary data. [2025-09-29T19:44:19.335747] [DEBUG] [VALIDATOR ] LTH: All expected trading days are present. [2025-09-29T19:44:19.335891] [DEBUG] [VALIDATOR ] LTH: Primary data validation passed. [2025-09-29T19:44:19.336961] [INFO ] [MAIN ] LTH: Fetched primary data is valid. [2025-09-29T19:44:19.337053] [DEBUG] [LOCAL ] LTH: Saving primary data. [2025-09-29T19:44:19.338525] [DEBUG] [LOCAL ] LTH: Trimmed 74068 records to 51770 (keeping 200 days of data) [2025-09-29T19:44:19.655824] [DEBUG] [LOCAL ] LTH: Primary data saved (51770 records). [2025-09-29T19:44:19.655988] [INFO ] [MAIN ] LTH: Full history saved. [2025-09-29T19:44:19.656093] [INFO ] [MAIN ] Update Progress: 1280/2371 symbols completed. LTH took 25.8s. Estimated remaining: 2h 20m 1s. Rate: 7.8 symbols/min [2025-09-29T19:44:20.339905] [INFO ] [MAIN ] LUMN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:44:20.282737] [INFO ] [MAIN ] LTM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:44:20.404284] [INFO ] [MAIN ] LU: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:44:20.425351] [INFO ] [MAIN ] LUCK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:44:20.425952] [DEBUG] [LOCAL ] LUCK: No existing data file found in primary storage. [2025-09-29T19:44:20.426014] [WARN ] [MAIN ] LUCK: No existing data found, performing full refresh instead. [2025-09-29T19:44:20.426112] [INFO ] [MAIN ] LUCK: Wiping existing primary data before full refresh. [2025-09-29T19:44:20.426150] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-09-29T19:44:20.426193] [DEBUG] [LOCAL ] LUCK: No primary data file found to delete. [2025-09-29T19:44:20.426226] [INFO ] [MAIN ] LUCK: Starting full primary refresh. [2025-09-29T19:44:20.744975] [DEBUG] [LOCAL ] LTM: Loaded 37076 existing records from primary storage. [2025-09-29T19:44:20.813480] [DEBUG] [LOCAL ] LU: Loaded 49679 existing records from primary storage. [2025-09-29T19:44:20.814293] [INFO ] [MAIN ] LTM: Loaded 37076 existing records. [2025-09-29T19:44:20.815069] [DEBUG] [LOCAL ] LUMN: Loaded 54414 existing records from primary storage. [2025-09-29T19:44:20.821043] [INFO ] [MAIN ] LUMN: Loaded 54414 existing records. [2025-09-29T19:44:20.821230] [INFO ] [MAIN ] LU: Loaded 49679 existing records. [2025-09-29T19:44:21.317456] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:44:21.471637] [WARN ] [MAIN ] LU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:44:21.390856] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2024-12. [2025-09-29T19:44:21.527512] [INFO ] [MAIN ] LU: Wiping existing primary data before full refresh. [2025-09-29T19:44:21.524983] [WARN ] [MAIN ] LTM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:44:21.528845] [INFO ] [MAIN ] LTM: Wiping existing primary data before full refresh. [2025-09-29T19:44:21.528937] [INFO ] [LOCAL ] LTM: Starting deletion of primary data. [2025-09-29T19:44:21.528667] [INFO ] [LOCAL ] LU: Starting deletion of primary data. [2025-09-29T19:44:21.550890] [WARN ] [MAIN ] LUMN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:44:21.551583] [INFO ] [MAIN ] LUMN: Wiping existing primary data before full refresh. [2025-09-29T19:44:21.551687] [INFO ] [LOCAL ] LUMN: Starting deletion of primary data. [2025-09-29T19:44:21.551952] [DEBUG] [LOCAL ] LU: Deleted primary data file. [2025-09-29T19:44:21.552061] [INFO ] [MAIN ] LU: Starting full primary refresh. [2025-09-29T19:44:21.563586] [DEBUG] [LOCAL ] LTM: Deleted primary data file. [2025-09-29T19:44:21.585554] [INFO ] [MAIN ] LTM: Starting full primary refresh. [2025-09-29T19:44:21.564017] [DEBUG] [LOCAL ] LUMN: Deleted primary data file. [2025-09-29T19:44:21.653861] [INFO ] [MAIN ] LUMN: Starting full primary refresh. [2025-09-29T19:44:22.672465] [INFO ] [REMOTE ] LTM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:44:22.708207] [INFO ] [REMOTE ] LTM: Fetching primary data for 2024-12. [2025-09-29T19:44:22.748267] [INFO ] [REMOTE ] LU: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:44:22.775024] [INFO ] [REMOTE ] LU: Fetching primary data for 2024-12. [2025-09-29T19:44:22.817420] [INFO ] [REMOTE ] LUMN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:44:22.823237] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2024-12. [2025-09-29T19:44:22.833543] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-29T19:44:22.839036] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-01. [2025-09-29T19:44:23.864403] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-29T19:44:23.869390] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-01. [2025-09-29T19:44:24.121889] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-29T19:44:24.132511] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-01. [2025-09-29T19:44:24.211837] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-29T19:44:24.219900] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-09-29T19:44:24.904668] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-29T19:44:24.916581] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-01. [2025-09-29T19:44:24.973241] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-29T19:44:24.978728] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-02. [2025-09-29T19:44:25.515318] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-29T19:44:25.525964] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-02. [2025-09-29T19:44:25.556140] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-29T19:44:25.563684] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-09-29T19:44:26.101089] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-29T19:44:26.106853] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-03. [2025-09-29T19:44:26.501103] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-29T19:44:26.512836] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-02. [2025-09-29T19:44:26.795591] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-29T19:44:26.802782] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-09-29T19:44:26.957399] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-29T19:44:26.964135] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-04. [2025-09-29T19:44:27.252960] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-29T19:44:27.263428] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-03. [2025-09-29T19:44:27.830488] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-29T19:44:27.837359] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-09-29T19:44:28.123810] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-29T19:44:28.134908] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-03. [2025-09-29T19:44:28.231965] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-29T19:44:28.238683] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-05. [2025-09-29T19:44:29.071208] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-29T19:44:29.083381] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-04. [2025-09-29T19:44:29.129078] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-29T19:44:29.148087] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-09-29T19:44:29.498818] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-29T19:44:29.948124] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-06. [2025-09-29T19:44:30.090089] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-29T19:44:30.373034] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-29T19:44:30.401932] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-29T19:44:30.748120] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-09-29T19:44:30.991150] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-29T19:44:31.548100] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-07. [2025-09-29T19:44:31.709865] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-29T19:44:32.348114] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-09-29T19:44:32.953420] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-29T19:44:33.148167] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-08. [2025-09-29T19:44:33.315528] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-29T19:44:33.948141] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-05. [2025-09-29T19:44:34.735432] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-29T19:44:34.748075] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-09. [2025-09-29T19:44:35.548145] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-09-29T19:44:35.594513] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-29T19:44:36.348088] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-04. [2025-09-29T19:44:36.582464] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-29T19:44:36.592537] [INFO ] [REMOTE ] LTM: Full fetch complete (47472 records). [2025-09-29T19:44:36.592743] [DEBUG] [VALIDATOR ] LTM: Validating primary data. [2025-09-29T19:44:36.926872] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-29T19:44:36.983603] [INFO ] [REMOTE ] LUCK: Full fetch complete (40922 records). [2025-09-29T19:44:36.995808] [DEBUG] [VALIDATOR ] LUCK: Validating primary data. [2025-09-29T19:44:37.127432] [DEBUG] [VALIDATOR ] LTM: All expected trading days are present. [2025-09-29T19:44:37.139858] [DEBUG] [VALIDATOR ] LTM: Primary data validation passed. [2025-09-29T19:44:37.140847] [INFO ] [MAIN ] LTM: Fetched primary data is valid. [2025-09-29T19:44:37.140946] [DEBUG] [LOCAL ] LTM: Saving primary data. [2025-09-29T19:44:37.152664] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-06. [2025-09-29T19:44:37.206828] [DEBUG] [LOCAL ] LTM: Trimmed 47472 records to 36751 (keeping 200 days of data) [2025-09-29T19:44:37.242555] [WARN ] [VALIDATOR ] LUCK: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-29T19:44:37.243230] [FATAL] [MAIN ] LUCK: Fetched primary data is invalid. Refusing to save it. [2025-09-29T19:44:37.243304] [WARN ] [MAIN ] LUCK: Deleting existing primary and derivative data due to validation failure. [2025-09-29T19:44:37.243354] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-09-29T19:44:37.243413] [DEBUG] [LOCAL ] LUCK: No primary data file found to delete. [2025-09-29T19:44:37.243451] [INFO ] [LOCAL ] LUCK: Starting deletion of derivative data. [2025-09-29T19:44:37.243529] [DEBUG] [LOCAL ] LUCK: No derivative data file found to delete. [2025-09-29T19:44:37.292395] [INFO ] [MAIN ] Update Progress: 1281/2371 symbols completed. LUCK took 17.6s. Estimated remaining: 2h 20m 2s. Rate: 7.8 symbols/min [2025-09-29T19:44:37.527699] [INFO ] [MAIN ] LUV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:44:37.686259] [DEBUG] [LOCAL ] LTM: Primary data saved (36751 records). [2025-09-29T19:44:37.701091] [INFO ] [MAIN ] LTM: Full history saved. [2025-09-29T19:44:37.702424] [INFO ] [MAIN ] Update Progress: 1282/2371 symbols completed. LTM took 18.0s. Estimated remaining: 2h 19m 48s. Rate: 7.8 symbols/min [2025-09-29T19:44:37.771263] [DEBUG] [LOCAL ] LUV: Loaded 54469 existing records from primary storage. [2025-09-29T19:44:37.791766] [INFO ] [MAIN ] LUV: Loaded 54469 existing records. [2025-09-29T19:44:38.021367] [INFO ] [MAIN ] LUXE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:44:38.031661] [DEBUG] [LOCAL ] LUXE: No existing data file found in primary storage. [2025-09-29T19:44:38.042136] [WARN ] [MAIN ] LUXE: No existing data found, performing full refresh instead. [2025-09-29T19:44:38.074510] [INFO ] [MAIN ] LUXE: Wiping existing primary data before full refresh. [2025-09-29T19:44:38.074692] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-09-29T19:44:38.080688] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-09-29T19:44:38.080789] [INFO ] [MAIN ] LUXE: Starting full primary refresh. [2025-09-29T19:44:38.176196] [WARN ] [MAIN ] LUV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:44:38.191627] [INFO ] [MAIN ] LUV: Wiping existing primary data before full refresh. [2025-09-29T19:44:38.198315] [INFO ] [LOCAL ] LUV: Starting deletion of primary data. [2025-09-29T19:44:38.227234] [DEBUG] [LOCAL ] LUV: Deleted primary data file. [2025-09-29T19:44:38.238544] [INFO ] [MAIN ] LUV: Starting full primary refresh. [2025-09-29T19:44:38.819396] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-09-29T19:44:38.846795] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:44:38.877189] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2024-12. [2025-09-29T19:44:38.878937] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-05. [2025-09-29T19:44:38.967757] [INFO ] [REMOTE ] LUV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:44:38.999352] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-29T19:44:39.140197] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T19:44:39.140583] [WARN ] [REMOTE ] LUXE: No data returned for month 2024-12 [2025-09-29T19:44:39.140729] [FATAL] [REMOTE ] LUXE: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T19:44:39.140850] [FATAL] [MAIN ] LUXE: Failed to fetch primary data. [2025-09-29T19:44:39.140937] [WARN ] [MAIN ] LUXE: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T19:44:39.141037] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-09-29T19:44:39.141122] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-09-29T19:44:39.141160] [INFO ] [LOCAL ] LUXE: Starting deletion of derivative data. [2025-09-29T19:44:39.141200] [DEBUG] [LOCAL ] LUXE: No derivative data file found to delete. [2025-09-29T19:44:39.141248] [INFO ] [MAIN ] Update Progress: 1283/2371 symbols completed. LUXE took 1.4s. Estimated remaining: 2h 19m 35s. Rate: 7.8 symbols/min [2025-09-29T19:44:39.315968] [INFO ] [MAIN ] LVS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:44:39.373765] [DEBUG] [LOCAL ] LVS: Loaded 54342 existing records from primary storage. [2025-09-29T19:44:39.374130] [INFO ] [MAIN ] LVS: Loaded 54342 existing records. [2025-09-29T19:44:39.554104] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-07. [2025-09-29T19:44:39.559760] [WARN ] [MAIN ] LVS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:44:39.561055] [INFO ] [MAIN ] LVS: Wiping existing primary data before full refresh. [2025-09-29T19:44:39.561106] [INFO ] [LOCAL ] LVS: Starting deletion of primary data. [2025-09-29T19:44:39.561699] [DEBUG] [LOCAL ] LVS: Deleted primary data file. [2025-09-29T19:44:39.561865] [INFO ] [MAIN ] LVS: Starting full primary refresh. [2025-09-29T19:44:39.948065] [INFO ] [REMOTE ] LVS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:44:40.348158] [INFO ] [REMOTE ] LVS: Fetching primary data for 2024-12. [2025-09-29T19:44:41.070328] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-29T19:44:41.148110] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-06. [2025-09-29T19:44:41.272817] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-29T19:44:41.948159] [INFO ] [REMOTE ] LUV: Fetching primary data for 2024-12. [2025-09-29T19:44:42.186294] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-29T19:44:42.758166] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-08. [2025-09-29T19:44:42.788507] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-29T19:44:43.548151] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-07. [2025-09-29T19:44:44.204603] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-09-29T19:44:44.348100] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-01. [2025-09-29T19:44:44.494710] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-29T19:44:45.148137] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-09. [2025-09-29T19:44:45.558789] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-29T19:44:45.948105] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-01. [2025-09-29T19:44:46.280028] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-29T19:44:46.726732] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-29T19:44:46.737429] [INFO ] [REMOTE ] LU: Full fetch complete (70407 records). [2025-09-29T19:44:46.737617] [DEBUG] [VALIDATOR ] LU: Validating primary data. [2025-09-29T19:44:46.753325] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-02. [2025-09-29T19:44:47.157357] [DEBUG] [VALIDATOR ] LU: All expected trading days are present. [2025-09-29T19:44:47.157458] [DEBUG] [VALIDATOR ] LU: Primary data validation passed. [2025-09-29T19:44:47.158666] [INFO ] [MAIN ] LU: Fetched primary data is valid. [2025-09-29T19:44:47.158734] [DEBUG] [LOCAL ] LU: Saving primary data. [2025-09-29T19:44:47.160527] [DEBUG] [LOCAL ] LU: Trimmed 70407 records to 48923 (keeping 200 days of data) [2025-09-29T19:44:47.442189] [DEBUG] [LOCAL ] LU: Primary data saved (48923 records). [2025-09-29T19:44:47.442326] [INFO ] [MAIN ] LU: Full history saved. [2025-09-29T19:44:47.442428] [INFO ] [MAIN ] Update Progress: 1284/2371 symbols completed. LU took 27.8s. Estimated remaining: 2h 19m 28s. Rate: 7.8 symbols/min [2025-09-29T19:44:47.550669] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-08. [2025-09-29T19:44:47.661420] [INFO ] [MAIN ] LVWR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:44:47.680560] [DEBUG] [LOCAL ] LVWR: Loaded 17668 existing records from primary storage. [2025-09-29T19:44:47.681084] [INFO ] [MAIN ] LVWR: Loaded 17668 existing records. [2025-09-29T19:44:47.885856] [WARN ] [MAIN ] LVWR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:44:47.886413] [INFO ] [MAIN ] LVWR: Wiping existing primary data before full refresh. [2025-09-29T19:44:47.905969] [INFO ] [LOCAL ] LVWR: Starting deletion of primary data. [2025-09-29T19:44:47.916935] [DEBUG] [LOCAL ] LVWR: Deleted primary data file. [2025-09-29T19:44:47.917315] [INFO ] [MAIN ] LVWR: Starting full primary refresh. [2025-09-29T19:44:47.918461] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-29T19:44:48.308297] [INFO ] [REMOTE ] LVWR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:44:48.348131] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2024-12. [2025-09-29T19:44:48.719333] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-29T19:44:48.927617] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-29T19:44:49.148130] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-01. [2025-09-29T19:44:49.714843] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-29T19:44:49.713039] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-29T19:44:49.948145] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-02. [2025-09-29T19:44:50.529788] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-29T19:44:50.748139] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-02. [2025-09-29T19:44:51.548109] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-03. [2025-09-29T19:44:52.117081] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-29T19:44:52.348130] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-04. [2025-09-29T19:44:52.567325] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-29T19:44:52.880146] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-29T19:44:53.148119] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-03. [2025-09-29T19:44:53.948121] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-09. [2025-09-29T19:44:54.748342] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-03. [2025-09-29T19:44:55.117601] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-29T19:44:55.548178] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-04. [2025-09-29T19:44:55.999452] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-29T19:44:56.011229] [INFO ] [REMOTE ] LUMN: Full fetch complete (77635 records). [2025-09-29T19:44:56.011415] [DEBUG] [VALIDATOR ] LUMN: Validating primary data. [2025-09-29T19:44:56.353216] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-05. [2025-09-29T19:44:56.436194] [DEBUG] [VALIDATOR ] LUMN: All expected trading days are present. [2025-09-29T19:44:56.436302] [DEBUG] [VALIDATOR ] LUMN: Primary data validation passed. [2025-09-29T19:44:56.437605] [INFO ] [MAIN ] LUMN: Fetched primary data is valid. [2025-09-29T19:44:56.437794] [DEBUG] [LOCAL ] LUMN: Saving primary data. [2025-09-29T19:44:56.439529] [DEBUG] [LOCAL ] LUMN: Trimmed 77635 records to 53634 (keeping 200 days of data) [2025-09-29T19:44:56.765624] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-29T19:44:56.802372] [DEBUG] [LOCAL ] LUMN: Primary data saved (53634 records). [2025-09-29T19:44:56.802525] [INFO ] [MAIN ] LUMN: Full history saved. [2025-09-29T19:44:56.802626] [INFO ] [MAIN ] Update Progress: 1285/2371 symbols completed. LUMN took 37.1s. Estimated remaining: 2h 19m 22s. Rate: 7.8 symbols/min [2025-09-29T19:44:56.976805] [INFO ] [MAIN ] LW: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:44:57.031929] [DEBUG] [LOCAL ] LW: Loaded 51915 existing records from primary storage. [2025-09-29T19:44:57.032267] [INFO ] [MAIN ] LW: Loaded 51915 existing records. [2025-09-29T19:44:57.153192] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-04. [2025-09-29T19:44:57.233402] [WARN ] [MAIN ] LW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:44:57.233619] [INFO ] [MAIN ] LW: Wiping existing primary data before full refresh. [2025-09-29T19:44:57.233715] [INFO ] [LOCAL ] LW: Starting deletion of primary data. [2025-09-29T19:44:57.234588] [DEBUG] [LOCAL ] LW: Deleted primary data file. [2025-09-29T19:44:57.234717] [INFO ] [MAIN ] LW: Starting full primary refresh. [2025-09-29T19:44:57.593469] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-29T19:44:57.631279] [INFO ] [REMOTE ] LW: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:44:57.704075] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-29T19:44:57.948138] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-05. [2025-09-29T19:44:58.748142] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-06. [2025-09-29T19:44:58.835838] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-29T19:44:59.548152] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-05. [2025-09-29T19:44:59.975239] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-29T19:45:00.117973] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-29T19:45:00.348118] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-06. [2025-09-29T19:45:01.148145] [INFO ] [REMOTE ] LW: Fetching primary data for 2024-12. [2025-09-29T19:45:01.548134] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-29T19:45:01.948185] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-06. [2025-09-29T19:45:02.352168] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-29T19:45:02.748108] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-07. [2025-09-29T19:45:03.259207] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-29T19:45:03.548174] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-01. [2025-09-29T19:45:03.756984] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-29T19:45:03.808463] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-29T19:45:04.348126] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-08. [2025-09-29T19:45:05.148085] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-07. [2025-09-29T19:45:05.202818] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-29T19:45:05.245945] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-29T19:45:05.948126] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-07. [2025-09-29T19:45:06.748136] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-09. [2025-09-29T19:45:07.159966] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-29T19:45:07.548119] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-08. [2025-09-29T19:45:07.853253] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-29T19:45:07.857789] [INFO ] [REMOTE ] LVWR: Full fetch complete (19884 records). [2025-09-29T19:45:07.857923] [DEBUG] [VALIDATOR ] LVWR: Validating primary data. [2025-09-29T19:45:08.285931] [DEBUG] [VALIDATOR ] LVWR: All expected trading days are present. [2025-09-29T19:45:08.286252] [DEBUG] [VALIDATOR ] LVWR: Primary data validation passed. [2025-09-29T19:45:08.287338] [INFO ] [MAIN ] LVWR: Fetched primary data is valid. [2025-09-29T19:45:08.289001] [DEBUG] [LOCAL ] LVWR: Saving primary data. [2025-09-29T19:45:08.288904] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-09-29T19:45:08.302466] [DEBUG] [LOCAL ] LVWR: Trimmed 19884 records to 17628 (keeping 200 days of data) [2025-09-29T19:45:08.351134] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-02. [2025-09-29T19:45:08.408160] [DEBUG] [LOCAL ] LVWR: Primary data saved (17628 records). [2025-09-29T19:45:08.408313] [INFO ] [MAIN ] LVWR: Full history saved. [2025-09-29T19:45:08.408416] [INFO ] [MAIN ] Update Progress: 1286/2371 symbols completed. LVWR took 21.0s. Estimated remaining: 2h 19m 17s. Rate: 7.8 symbols/min [2025-09-29T19:45:08.597785] [INFO ] [MAIN ] LXFR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:45:08.619571] [DEBUG] [LOCAL ] LXFR: Loaded 17259 existing records from primary storage. [2025-09-29T19:45:08.619856] [INFO ] [MAIN ] LXFR: Loaded 17259 existing records. [2025-09-29T19:45:08.804952] [WARN ] [MAIN ] LXFR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:45:08.805186] [INFO ] [MAIN ] LXFR: Wiping existing primary data before full refresh. [2025-09-29T19:45:08.805234] [INFO ] [LOCAL ] LXFR: Starting deletion of primary data. [2025-09-29T19:45:08.805589] [DEBUG] [LOCAL ] LXFR: Deleted primary data file. [2025-09-29T19:45:08.805676] [INFO ] [MAIN ] LXFR: Starting full primary refresh. [2025-09-29T19:45:09.163624] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-08. [2025-09-29T19:45:09.201380] [INFO ] [REMOTE ] LXFR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:45:09.371914] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-29T19:45:09.948100] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2024-12. [2025-09-29T19:45:10.187353] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-29T19:45:10.748084] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-03. [2025-09-29T19:45:10.801365] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-29T19:45:10.907966] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-29T19:45:11.548111] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-01. [2025-09-29T19:45:12.348116] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-09. [2025-09-29T19:45:12.543867] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-29T19:45:12.608982] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-29T19:45:13.148107] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-02. [2025-09-29T19:45:13.948136] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-04. [2025-09-29T19:45:14.228703] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-29T19:45:14.632038] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-29T19:45:14.644029] [INFO ] [REMOTE ] LUV: Full fetch complete (77727 records). [2025-09-29T19:45:14.644226] [DEBUG] [VALIDATOR ] LUV: Validating primary data. [2025-09-29T19:45:14.753270] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-03. [2025-09-29T19:45:15.093570] [DEBUG] [VALIDATOR ] LUV: All expected trading days are present. [2025-09-29T19:45:15.093709] [DEBUG] [VALIDATOR ] LUV: Primary data validation passed. [2025-09-29T19:45:15.094816] [INFO ] [MAIN ] LUV: Fetched primary data is valid. [2025-09-29T19:45:15.094909] [DEBUG] [LOCAL ] LUV: Saving primary data. [2025-09-29T19:45:15.099143] [DEBUG] [LOCAL ] LUV: Trimmed 77727 records to 53689 (keeping 200 days of data) [2025-09-29T19:45:15.464738] [DEBUG] [LOCAL ] LUV: Primary data saved (53689 records). [2025-09-29T19:45:15.464913] [INFO ] [MAIN ] LUV: Full history saved. [2025-09-29T19:45:15.465068] [INFO ] [MAIN ] Update Progress: 1287/2371 symbols completed. LUV took 38.2s. Estimated remaining: 2h 19m 9s. Rate: 7.8 symbols/min [2025-09-29T19:45:15.550717] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-09. [2025-09-29T19:45:15.664133] [INFO ] [MAIN ] LXP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:45:15.728216] [DEBUG] [LOCAL ] LXP: Loaded 51361 existing records from primary storage. [2025-09-29T19:45:15.728829] [INFO ] [MAIN ] LXP: Loaded 51361 existing records. [2025-09-29T19:45:15.959611] [WARN ] [MAIN ] LXP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:45:15.961378] [INFO ] [MAIN ] LXP: Wiping existing primary data before full refresh. [2025-09-29T19:45:15.961634] [INFO ] [LOCAL ] LXP: Starting deletion of primary data. [2025-09-29T19:45:15.961314] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-29T19:45:15.992488] [DEBUG] [LOCAL ] LXP: Deleted primary data file. [2025-09-29T19:45:15.996099] [INFO ] [MAIN ] LXP: Starting full primary refresh. [2025-09-29T19:45:16.073399] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-29T19:45:16.356701] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-04. [2025-09-29T19:45:16.400933] [INFO ] [REMOTE ] LXP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:45:17.148100] [INFO ] [REMOTE ] LXP: Fetching primary data for 2024-12. [2025-09-29T19:45:17.515012] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-29T19:45:17.527180] [INFO ] [REMOTE ] LVS: Full fetch complete (77513 records). [2025-09-29T19:45:17.527374] [DEBUG] [VALIDATOR ] LVS: Validating primary data. [2025-09-29T19:45:17.748637] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-29T19:45:17.959813] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-05. [2025-09-29T19:45:17.987740] [DEBUG] [VALIDATOR ] LVS: All expected trading days are present. [2025-09-29T19:45:17.987832] [DEBUG] [VALIDATOR ] LVS: Primary data validation passed. [2025-09-29T19:45:17.989109] [INFO ] [MAIN ] LVS: Fetched primary data is valid. [2025-09-29T19:45:17.989176] [DEBUG] [LOCAL ] LVS: Saving primary data. [2025-09-29T19:45:17.990866] [DEBUG] [LOCAL ] LVS: Trimmed 77513 records to 53564 (keeping 200 days of data) [2025-09-29T19:45:18.358491] [DEBUG] [LOCAL ] LVS: Primary data saved (53564 records). [2025-09-29T19:45:18.358673] [INFO ] [MAIN ] LVS: Full history saved. [2025-09-29T19:45:18.358781] [INFO ] [MAIN ] Update Progress: 1288/2371 symbols completed. LVS took 39.2s. Estimated remaining: 2h 18m 57s. Rate: 7.8 symbols/min [2025-09-29T19:45:18.545310] [INFO ] [MAIN ] LXU: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:45:18.579407] [DEBUG] [LOCAL ] LXU: Loaded 32354 existing records from primary storage. [2025-09-29T19:45:18.579731] [INFO ] [MAIN ] LXU: Loaded 32354 existing records. [2025-09-29T19:45:18.767321] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-05. [2025-09-29T19:45:18.776602] [WARN ] [MAIN ] LXU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:45:18.777084] [INFO ] [MAIN ] LXU: Wiping existing primary data before full refresh. [2025-09-29T19:45:18.777257] [INFO ] [LOCAL ] LXU: Starting deletion of primary data. [2025-09-29T19:45:18.806339] [DEBUG] [LOCAL ] LXU: Deleted primary data file. [2025-09-29T19:45:18.806578] [INFO ] [MAIN ] LXU: Starting full primary refresh. [2025-09-29T19:45:18.879243] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-29T19:45:19.217433] [INFO ] [REMOTE ] LXU: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:45:19.548086] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-01. [2025-09-29T19:45:19.733722] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-29T19:45:19.818239] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-29T19:45:20.348121] [INFO ] [REMOTE ] LXU: Fetching primary data for 2024-12. [2025-09-29T19:45:21.148126] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-06. [2025-09-29T19:45:21.231254] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-29T19:45:21.296426] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-29T19:45:21.948108] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-01. [2025-09-29T19:45:22.238014] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-29T19:45:22.748149] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-02. [2025-09-29T19:45:23.111704] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-29T19:45:23.548117] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-02. [2025-09-29T19:45:24.348114] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-06. [2025-09-29T19:45:24.417856] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-29T19:45:24.773788] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-29T19:45:25.148111] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-03. [2025-09-29T19:45:25.805753] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-29T19:45:25.948126] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-07. [2025-09-29T19:45:26.463728] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-29T19:45:26.748544] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-04. [2025-09-29T19:45:27.142401] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-29T19:45:27.548106] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-08. [2025-09-29T19:45:28.348112] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-03. [2025-09-29T19:45:28.549777] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-29T19:45:28.626744] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-29T19:45:29.148168] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-07. [2025-09-29T19:45:29.889246] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-29T19:45:29.948101] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-04. [2025-09-29T19:45:30.748155] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-05. [2025-09-29T19:45:31.143743] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-29T19:45:31.548198] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-08. [2025-09-29T19:45:31.725678] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-29T19:45:31.802802] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-29T19:45:32.348136] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-09. [2025-09-29T19:45:33.148084] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-05. [2025-09-29T19:45:33.237999] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-29T19:45:33.440858] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-29T19:45:33.444778] [INFO ] [REMOTE ] LXFR: Full fetch complete (25128 records). [2025-09-29T19:45:33.444915] [DEBUG] [VALIDATOR ] LXFR: Validating primary data. [2025-09-29T19:45:33.846275] [DEBUG] [VALIDATOR ] LXFR: All expected trading days are present. [2025-09-29T19:45:33.846359] [DEBUG] [VALIDATOR ] LXFR: Primary data validation passed. [2025-09-29T19:45:33.846950] [INFO ] [MAIN ] LXFR: Fetched primary data is valid. [2025-09-29T19:45:33.847015] [DEBUG] [LOCAL ] LXFR: Saving primary data. [2025-09-29T19:45:33.847839] [DEBUG] [LOCAL ] LXFR: Trimmed 25128 records to 16896 (keeping 200 days of data) [2025-09-29T19:45:33.952880] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-06. [2025-09-29T19:45:33.962870] [DEBUG] [LOCAL ] LXFR: Primary data saved (16896 records). [2025-09-29T19:45:33.963042] [INFO ] [MAIN ] LXFR: Full history saved. [2025-09-29T19:45:33.963151] [INFO ] [MAIN ] Update Progress: 1289/2371 symbols completed. LXFR took 25.6s. Estimated remaining: 2h 18m 56s. Rate: 7.8 symbols/min [2025-09-29T19:45:34.146032] [INFO ] [MAIN ] LYB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:45:34.219323] [DEBUG] [LOCAL ] LYB: Loaded 54379 existing records from primary storage. [2025-09-29T19:45:34.219715] [INFO ] [MAIN ] LYB: Loaded 54379 existing records. [2025-09-29T19:45:34.424866] [WARN ] [MAIN ] LYB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:45:34.425119] [INFO ] [MAIN ] LYB: Wiping existing primary data before full refresh. [2025-09-29T19:45:34.425306] [INFO ] [LOCAL ] LYB: Starting deletion of primary data. [2025-09-29T19:45:34.426030] [DEBUG] [LOCAL ] LYB: Deleted primary data file. [2025-09-29T19:45:34.426093] [INFO ] [MAIN ] LYB: Starting full primary refresh. [2025-09-29T19:45:34.748360] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-09. [2025-09-29T19:45:34.812797] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-29T19:45:34.903528] [INFO ] [REMOTE ] LYB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:45:35.233942] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-29T19:45:35.548152] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-06. [2025-09-29T19:45:36.348094] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-07. [2025-09-29T19:45:36.626385] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-29T19:45:36.637975] [INFO ] [REMOTE ] LW: Full fetch complete (74639 records). [2025-09-29T19:45:36.638146] [DEBUG] [VALIDATOR ] LW: Validating primary data. [2025-09-29T19:45:37.069411] [DEBUG] [VALIDATOR ] LW: All expected trading days are present. [2025-09-29T19:45:37.069531] [DEBUG] [VALIDATOR ] LW: Primary data validation passed. [2025-09-29T19:45:37.070687] [INFO ] [MAIN ] LW: Fetched primary data is valid. [2025-09-29T19:45:37.070805] [DEBUG] [LOCAL ] LW: Saving primary data. [2025-09-29T19:45:37.073422] [DEBUG] [LOCAL ] LW: Trimmed 74639 records to 51154 (keeping 200 days of data) [2025-09-29T19:45:37.155834] [INFO ] [REMOTE ] LYB: Fetching primary data for 2024-12. [2025-09-29T19:45:37.158807] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-29T19:45:37.450809] [DEBUG] [LOCAL ] LW: Primary data saved (51154 records). [2025-09-29T19:45:37.451144] [INFO ] [MAIN ] LW: Full history saved. [2025-09-29T19:45:37.451267] [INFO ] [MAIN ] Update Progress: 1290/2371 symbols completed. LW took 40.6s. Estimated remaining: 2h 18m 45s. Rate: 7.8 symbols/min [2025-09-29T19:45:37.640248] [INFO ] [MAIN ] LYG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:45:37.694724] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-29T19:45:37.722695] [DEBUG] [LOCAL ] LYG: Loaded 53606 existing records from primary storage. [2025-09-29T19:45:37.723046] [INFO ] [MAIN ] LYG: Loaded 53606 existing records. [2025-09-29T19:45:37.909672] [WARN ] [MAIN ] LYG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:45:37.909924] [INFO ] [MAIN ] LYG: Wiping existing primary data before full refresh. [2025-09-29T19:45:37.909973] [INFO ] [LOCAL ] LYG: Starting deletion of primary data. [2025-09-29T19:45:37.910543] [DEBUG] [LOCAL ] LYG: Deleted primary data file. [2025-09-29T19:45:37.910602] [INFO ] [MAIN ] LYG: Starting full primary refresh. [2025-09-29T19:45:37.953266] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-07. [2025-09-29T19:45:38.325120] [INFO ] [REMOTE ] LYG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:45:38.748120] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-08. [2025-09-29T19:45:39.233353] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-29T19:45:39.548098] [INFO ] [REMOTE ] LYG: Fetching primary data for 2024-12. [2025-09-29T19:45:39.824090] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-29T19:45:40.072398] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-29T19:45:40.348153] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-08. [2025-09-29T19:45:41.148109] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-09. [2025-09-29T19:45:41.390890] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-29T19:45:41.948094] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-01. [2025-09-29T19:45:42.130091] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-29T19:45:42.188124] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-29T19:45:42.194186] [INFO ] [REMOTE ] LXU: Full fetch complete (44886 records). [2025-09-29T19:45:42.194325] [DEBUG] [VALIDATOR ] LXU: Validating primary data. [2025-09-29T19:45:42.602027] [DEBUG] [VALIDATOR ] LXU: All expected trading days are present. [2025-09-29T19:45:42.602109] [DEBUG] [VALIDATOR ] LXU: Primary data validation passed. [2025-09-29T19:45:42.603034] [INFO ] [MAIN ] LXU: Fetched primary data is valid. [2025-09-29T19:45:42.603100] [DEBUG] [LOCAL ] LXU: Saving primary data. [2025-09-29T19:45:42.604151] [DEBUG] [LOCAL ] LXU: Trimmed 44886 records to 31780 (keeping 200 days of data) [2025-09-29T19:45:42.751446] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-01. [2025-09-29T19:45:42.789779] [DEBUG] [LOCAL ] LXU: Primary data saved (31780 records). [2025-09-29T19:45:42.789912] [INFO ] [MAIN ] LXU: Full history saved. [2025-09-29T19:45:42.790009] [INFO ] [MAIN ] Update Progress: 1291/2371 symbols completed. LXU took 24.4s. Estimated remaining: 2h 18m 35s. Rate: 7.8 symbols/min [2025-09-29T19:45:42.969519] [INFO ] [MAIN ] LYV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:45:43.024606] [DEBUG] [LOCAL ] LYV: Loaded 51906 existing records from primary storage. [2025-09-29T19:45:43.025040] [INFO ] [MAIN ] LYV: Loaded 51906 existing records. [2025-09-29T19:45:43.209825] [WARN ] [MAIN ] LYV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:45:43.210059] [INFO ] [MAIN ] LYV: Wiping existing primary data before full refresh. [2025-09-29T19:45:43.210107] [INFO ] [LOCAL ] LYV: Starting deletion of primary data. [2025-09-29T19:45:43.210825] [DEBUG] [LOCAL ] LYV: Deleted primary data file. [2025-09-29T19:45:43.210885] [INFO ] [MAIN ] LYV: Starting full primary refresh. [2025-09-29T19:45:43.553488] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-09. [2025-09-29T19:45:43.596925] [INFO ] [REMOTE ] LYV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:45:43.896571] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-29T19:45:44.348159] [INFO ] [REMOTE ] LYV: Fetching primary data for 2024-12. [2025-09-29T19:45:44.747802] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-29T19:45:45.148150] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-02. [2025-09-29T19:45:45.424388] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-29T19:45:45.435066] [INFO ] [REMOTE ] LXP: Full fetch complete (72499 records). [2025-09-29T19:45:45.435229] [DEBUG] [VALIDATOR ] LXP: Validating primary data. [2025-09-29T19:45:45.868407] [DEBUG] [VALIDATOR ] LXP: All expected trading days are present. [2025-09-29T19:45:45.868612] [DEBUG] [VALIDATOR ] LXP: Primary data validation passed. [2025-09-29T19:45:45.869891] [INFO ] [MAIN ] LXP: Fetched primary data is valid. [2025-09-29T19:45:45.870009] [DEBUG] [LOCAL ] LXP: Saving primary data. [2025-09-29T19:45:45.872267] [DEBUG] [LOCAL ] LXP: Trimmed 72499 records to 50667 (keeping 200 days of data) [2025-09-29T19:45:45.951236] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-02. [2025-09-29T19:45:45.996507] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-29T19:45:46.231133] [DEBUG] [LOCAL ] LXP: Primary data saved (50667 records). [2025-09-29T19:45:46.231296] [INFO ] [MAIN ] LXP: Full history saved. [2025-09-29T19:45:46.231389] [INFO ] [MAIN ] Update Progress: 1292/2371 symbols completed. LXP took 30.8s. Estimated remaining: 2h 18m 24s. Rate: 7.8 symbols/min [2025-09-29T19:45:46.427467] [INFO ] [MAIN ] LZB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:45:46.467793] [DEBUG] [LOCAL ] LZB: Loaded 36113 existing records from primary storage. [2025-09-29T19:45:46.468099] [INFO ] [MAIN ] LZB: Loaded 36113 existing records. [2025-09-29T19:45:46.652931] [WARN ] [MAIN ] LZB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:45:46.653141] [INFO ] [MAIN ] LZB: Wiping existing primary data before full refresh. [2025-09-29T19:45:46.653190] [INFO ] [LOCAL ] LZB: Starting deletion of primary data. [2025-09-29T19:45:46.653739] [DEBUG] [LOCAL ] LZB: Deleted primary data file. [2025-09-29T19:45:46.653805] [INFO ] [MAIN ] LZB: Starting full primary refresh. [2025-09-29T19:45:46.755051] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-01. [2025-09-29T19:45:47.049156] [INFO ] [REMOTE ] LZB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:45:47.076042] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-29T19:45:47.408207] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-29T19:45:47.548082] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-03. [2025-09-29T19:45:48.348126] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-03. [2025-09-29T19:45:48.514171] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-29T19:45:49.148119] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-02. [2025-09-29T19:45:49.477976] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-29T19:45:49.800219] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-29T19:45:49.948095] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-04. [2025-09-29T19:45:50.748120] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-04. [2025-09-29T19:45:50.810091] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-29T19:45:51.548097] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-03. [2025-09-29T19:45:51.709295] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-29T19:45:52.348128] [INFO ] [REMOTE ] LZB: Fetching primary data for 2024-12. [2025-09-29T19:45:52.567147] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-29T19:45:53.148065] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-05. [2025-09-29T19:45:53.511715] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-29T19:45:53.700236] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-29T19:45:53.948119] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-05. [2025-09-29T19:45:54.748174] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-01. [2025-09-29T19:45:54.964182] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-29T19:45:55.548096] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-06. [2025-09-29T19:45:55.778063] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-29T19:45:55.832724] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-29T19:45:56.348129] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-06. [2025-09-29T19:45:57.148144] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-02. [2025-09-29T19:45:57.282185] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-29T19:45:57.948123] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-07. [2025-09-29T19:45:58.202173] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-29T19:45:58.643008] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-29T19:45:58.748166] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-03. [2025-09-29T19:45:59.548145] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-07. [2025-09-29T19:45:59.767757] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-29T19:46:00.240439] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-29T19:46:00.348113] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-08. [2025-09-29T19:46:01.148173] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-04. [2025-09-29T19:46:01.530907] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-29T19:46:01.948090] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-08. [2025-09-29T19:46:02.041959] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-29T19:46:02.651294] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-29T19:46:02.748111] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-04. [2025-09-29T19:46:03.548151] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-05. [2025-09-29T19:46:03.795691] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-29T19:46:04.175398] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-29T19:46:04.348158] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-05. [2025-09-29T19:46:04.925269] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-29T19:46:05.148119] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-09. [2025-09-29T19:46:05.948159] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-09. [2025-09-29T19:46:06.250502] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-29T19:46:06.748440] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-06. [2025-09-29T19:46:07.118979] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-29T19:46:07.130026] [INFO ] [REMOTE ] LYG: Full fetch complete (76037 records). [2025-09-29T19:46:07.130277] [DEBUG] [VALIDATOR ] LYG: Validating primary data. [2025-09-29T19:46:07.557167] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-06. [2025-09-29T19:46:07.584441] [DEBUG] [VALIDATOR ] LYG: All expected trading days are present. [2025-09-29T19:46:07.585828] [DEBUG] [VALIDATOR ] LYG: Primary data validation passed. [2025-09-29T19:46:07.587998] [INFO ] [MAIN ] LYG: Fetched primary data is valid. [2025-09-29T19:46:07.588175] [DEBUG] [LOCAL ] LYG: Saving primary data. [2025-09-29T19:46:07.589850] [DEBUG] [LOCAL ] LYG: Trimmed 76037 records to 52817 (keeping 200 days of data) [2025-09-29T19:46:07.913881] [DEBUG] [LOCAL ] LYG: Primary data saved (52817 records). [2025-09-29T19:46:07.914053] [INFO ] [MAIN ] LYG: Full history saved. [2025-09-29T19:46:07.914180] [INFO ] [MAIN ] Update Progress: 1293/2371 symbols completed. LYG took 30.5s. Estimated remaining: 2h 18m 28s. Rate: 7.8 symbols/min [2025-09-29T19:46:08.102434] [INFO ] [MAIN ] LZM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:46:08.118253] [DEBUG] [LOCAL ] LZM: Loaded 13905 existing records from primary storage. [2025-09-29T19:46:08.118500] [INFO ] [MAIN ] LZM: Loaded 13905 existing records. [2025-09-29T19:46:08.318614] [WARN ] [MAIN ] LZM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:46:08.319104] [INFO ] [MAIN ] LZM: Wiping existing primary data before full refresh. [2025-09-29T19:46:08.319309] [INFO ] [LOCAL ] LZM: Starting deletion of primary data. [2025-09-29T19:46:08.319872] [DEBUG] [LOCAL ] LZM: Deleted primary data file. [2025-09-29T19:46:08.319964] [INFO ] [MAIN ] LZM: Starting full primary refresh. [2025-09-29T19:46:08.660827] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-29T19:46:08.729592] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-07. [2025-09-29T19:46:08.762255] [INFO ] [REMOTE ] LZM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:46:08.801876] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-09 (2.85 seconds). [2025-09-29T19:46:08.813771] [INFO ] [REMOTE ] LYB: Full fetch complete (77456 records). [2025-09-29T19:46:08.813959] [DEBUG] [VALIDATOR ] LYB: Validating primary data. [2025-09-29T19:46:09.149511] [INFO ] [REMOTE ] LZM: Fetching primary data for 2024-12. [2025-09-29T19:46:09.278064] [DEBUG] [VALIDATOR ] LYB: All expected trading days are present. [2025-09-29T19:46:09.278918] [DEBUG] [VALIDATOR ] LYB: Primary data validation passed. [2025-09-29T19:46:09.280202] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-29T19:46:09.281611] [INFO ] [MAIN ] LYB: Fetched primary data is valid. [2025-09-29T19:46:09.290229] [DEBUG] [LOCAL ] LYB: Saving primary data. [2025-09-29T19:46:09.292243] [DEBUG] [LOCAL ] LYB: Trimmed 77456 records to 53599 (keeping 200 days of data) [2025-09-29T19:46:09.639661] [DEBUG] [LOCAL ] LYB: Primary data saved (53599 records). [2025-09-29T19:46:09.639813] [INFO ] [MAIN ] LYB: Full history saved. [2025-09-29T19:46:09.639924] [INFO ] [MAIN ] Update Progress: 1294/2371 symbols completed. LYB took 35.7s. Estimated remaining: 2h 18m 15s. Rate: 7.8 symbols/min [2025-09-29T19:46:09.831067] [INFO ] [MAIN ] M: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:46:09.880743] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-29T19:46:09.900477] [DEBUG] [LOCAL ] M: Loaded 54315 existing records from primary storage. [2025-09-29T19:46:09.900845] [INFO ] [MAIN ] M: Loaded 54315 existing records. [2025-09-29T19:46:09.959547] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-07. [2025-09-29T19:46:10.123896] [WARN ] [MAIN ] M: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:46:10.124460] [INFO ] [MAIN ] M: Wiping existing primary data before full refresh. [2025-09-29T19:46:10.124542] [INFO ] [LOCAL ] M: Starting deletion of primary data. [2025-09-29T19:46:10.125192] [DEBUG] [LOCAL ] M: Deleted primary data file. [2025-09-29T19:46:10.125301] [INFO ] [MAIN ] M: Starting full primary refresh. [2025-09-29T19:46:10.469427] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-29T19:46:10.565178] [INFO ] [REMOTE ] M: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:46:10.748153] [INFO ] [REMOTE ] M: Fetching primary data for 2024-12. [2025-09-29T19:46:11.287975] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-29T19:46:11.548158] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-01. [2025-09-29T19:46:12.348103] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-08. [2025-09-29T19:46:12.382344] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-29T19:46:12.587593] [INFO ] [REMOTE ] M: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-29T19:46:13.148113] [INFO ] [REMOTE ] M: Fetching primary data for 2025-01. [2025-09-29T19:46:13.948127] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-02. [2025-09-29T19:46:14.128734] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-29T19:46:14.705543] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-29T19:46:14.748117] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-08. [2025-09-29T19:46:15.003912] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-29T19:46:15.548131] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-03. [2025-09-29T19:46:15.865828] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-29T19:46:16.348127] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-09. [2025-09-29T19:46:16.486448] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-29T19:46:17.148098] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-04. [2025-09-29T19:46:17.746960] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-29T19:46:17.754771] [INFO ] [REMOTE ] LZB: Full fetch complete (50437 records). [2025-09-29T19:46:17.754880] [DEBUG] [VALIDATOR ] LZB: Validating primary data. [2025-09-29T19:46:17.953981] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-09. [2025-09-29T19:46:18.191075] [DEBUG] [VALIDATOR ] LZB: All expected trading days are present. [2025-09-29T19:46:18.190938] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-29T19:46:18.191289] [DEBUG] [VALIDATOR ] LZB: Primary data validation passed. [2025-09-29T19:46:18.197555] [INFO ] [MAIN ] LZB: Fetched primary data is valid. [2025-09-29T19:46:18.197666] [DEBUG] [LOCAL ] LZB: Saving primary data. [2025-09-29T19:46:18.199157] [DEBUG] [LOCAL ] LZB: Trimmed 50437 records to 35586 (keeping 200 days of data) [2025-09-29T19:46:18.424079] [DEBUG] [LOCAL ] LZB: Primary data saved (35586 records). [2025-09-29T19:46:18.424229] [INFO ] [MAIN ] LZB: Full history saved. [2025-09-29T19:46:18.424316] [INFO ] [MAIN ] Update Progress: 1295/2371 symbols completed. LZB took 32.2s. Estimated remaining: 2h 18m 9s. Rate: 7.8 symbols/min [2025-09-29T19:46:18.608327] [INFO ] [MAIN ] MA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:46:18.674254] [DEBUG] [LOCAL ] MA: Loaded 53329 existing records from primary storage. [2025-09-29T19:46:18.674611] [INFO ] [MAIN ] MA: Loaded 53329 existing records. [2025-09-29T19:46:18.753251] [INFO ] [REMOTE ] M: Fetching primary data for 2025-02. [2025-09-29T19:46:18.865736] [WARN ] [MAIN ] MA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:46:18.865960] [INFO ] [MAIN ] MA: Wiping existing primary data before full refresh. [2025-09-29T19:46:18.866010] [INFO ] [LOCAL ] MA: Starting deletion of primary data. [2025-09-29T19:46:18.866563] [DEBUG] [LOCAL ] MA: Deleted primary data file. [2025-09-29T19:46:18.866624] [INFO ] [MAIN ] MA: Starting full primary refresh. [2025-09-29T19:46:19.278083] [INFO ] [REMOTE ] MA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:46:19.548118] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-05. [2025-09-29T19:46:19.908834] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-29T19:46:19.919958] [INFO ] [REMOTE ] LYV: Full fetch complete (73649 records). [2025-09-29T19:46:19.920130] [DEBUG] [VALIDATOR ] LYV: Validating primary data. [2025-09-29T19:46:20.355096] [INFO ] [REMOTE ] MA: Fetching primary data for 2024-12. [2025-09-29T19:46:20.360297] [DEBUG] [VALIDATOR ] LYV: All expected trading days are present. [2025-09-29T19:46:20.361333] [DEBUG] [VALIDATOR ] LYV: Primary data validation passed. [2025-09-29T19:46:20.362574] [INFO ] [MAIN ] LYV: Fetched primary data is valid. [2025-09-29T19:46:20.362770] [DEBUG] [LOCAL ] LYV: Saving primary data. [2025-09-29T19:46:20.365258] [DEBUG] [LOCAL ] LYV: Trimmed 73649 records to 51121 (keeping 200 days of data) [2025-09-29T19:46:20.518739] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-29T19:46:20.547013] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-29T19:46:20.754489] [DEBUG] [LOCAL ] LYV: Primary data saved (51121 records). [2025-09-29T19:46:20.754693] [INFO ] [MAIN ] LYV: Full history saved. [2025-09-29T19:46:20.754820] [INFO ] [MAIN ] Update Progress: 1296/2371 symbols completed. LYV took 38.0s. Estimated remaining: 2h 17m 56s. Rate: 7.8 symbols/min [2025-09-29T19:46:20.940782] [INFO ] [MAIN ] MAA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:46:20.991597] [DEBUG] [LOCAL ] MAA: Loaded 43354 existing records from primary storage. [2025-09-29T19:46:20.992000] [INFO ] [MAIN ] MAA: Loaded 43354 existing records. [2025-09-29T19:46:21.156838] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-06. [2025-09-29T19:46:21.193123] [WARN ] [MAIN ] MAA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:46:21.193444] [INFO ] [MAIN ] MAA: Wiping existing primary data before full refresh. [2025-09-29T19:46:21.193519] [INFO ] [LOCAL ] MAA: Starting deletion of primary data. [2025-09-29T19:46:21.194179] [DEBUG] [LOCAL ] MAA: Deleted primary data file. [2025-09-29T19:46:21.194242] [INFO ] [MAIN ] MAA: Starting full primary refresh. [2025-09-29T19:46:21.610011] [INFO ] [REMOTE ] MAA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:46:21.948136] [INFO ] [REMOTE ] MAA: Fetching primary data for 2024-12. [2025-09-29T19:46:22.006687] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-29T19:46:22.260145] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-29T19:46:22.748118] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-07. [2025-09-29T19:46:23.489602] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-29T19:46:23.548126] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-01. [2025-09-29T19:46:23.578128] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-29T19:46:24.348117] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-08. [2025-09-29T19:46:25.152553] [INFO ] [REMOTE ] M: Fetching primary data for 2025-03. [2025-09-29T19:46:25.167622] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-29T19:46:25.166131] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-29T19:46:25.948162] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-02. [2025-09-29T19:46:26.748309] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-09. [2025-09-29T19:46:27.137358] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-29T19:46:27.531745] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-29T19:46:27.548072] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-03. [2025-09-29T19:46:27.940813] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-29T19:46:27.945424] [INFO ] [REMOTE ] LZM: Full fetch complete (18128 records). [2025-09-29T19:46:27.945621] [DEBUG] [VALIDATOR ] LZM: Validating primary data. [2025-09-29T19:46:28.352313] [INFO ] [REMOTE ] M: Fetching primary data for 2025-04. [2025-09-29T19:46:28.363112] [DEBUG] [VALIDATOR ] LZM: All expected trading days are present. [2025-09-29T19:46:28.363283] [DEBUG] [VALIDATOR ] LZM: Primary data validation passed. [2025-09-29T19:46:28.363929] [INFO ] [MAIN ] LZM: Fetched primary data is valid. [2025-09-29T19:46:28.364000] [DEBUG] [LOCAL ] LZM: Saving primary data. [2025-09-29T19:46:28.364621] [DEBUG] [LOCAL ] LZM: Trimmed 18128 records to 13838 (keeping 200 days of data) [2025-09-29T19:46:28.445879] [DEBUG] [LOCAL ] LZM: Primary data saved (13838 records). [2025-09-29T19:46:28.446033] [INFO ] [MAIN ] LZM: Full history saved. [2025-09-29T19:46:28.446121] [INFO ] [MAIN ] Update Progress: 1297/2371 symbols completed. LZM took 20.5s. Estimated remaining: 2h 17m 49s. Rate: 7.8 symbols/min [2025-09-29T19:46:28.620566] [INFO ] [MAIN ] MAC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:46:28.681601] [DEBUG] [LOCAL ] MAC: Loaded 50469 existing records from primary storage. [2025-09-29T19:46:28.681997] [INFO ] [MAIN ] MAC: Loaded 50469 existing records. [2025-09-29T19:46:28.870467] [WARN ] [MAIN ] MAC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:46:28.870767] [INFO ] [MAIN ] MAC: Wiping existing primary data before full refresh. [2025-09-29T19:46:28.870878] [INFO ] [LOCAL ] MAC: Starting deletion of primary data. [2025-09-29T19:46:28.871678] [DEBUG] [LOCAL ] MAC: Deleted primary data file. [2025-09-29T19:46:28.871743] [INFO ] [MAIN ] MAC: Starting full primary refresh. [2025-09-29T19:46:29.162582] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-01. [2025-09-29T19:46:29.283405] [INFO ] [REMOTE ] MAC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:46:29.285678] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-29T19:46:29.948155] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-04. [2025-09-29T19:46:30.157601] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-29T19:46:30.748085] [INFO ] [REMOTE ] MAC: Fetching primary data for 2024-12. [2025-09-29T19:46:31.248338] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-29T19:46:31.548124] [INFO ] [REMOTE ] M: Fetching primary data for 2025-05. [2025-09-29T19:46:31.664292] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-29T19:46:32.181233] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-29T19:46:32.348113] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-01. [2025-09-29T19:46:33.148168] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-02. [2025-09-29T19:46:33.581147] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-29T19:46:33.948130] [INFO ] [REMOTE ] M: Fetching primary data for 2025-06. [2025-09-29T19:46:33.995340] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-29T19:46:34.748122] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-05. [2025-09-29T19:46:35.002203] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-29T19:46:35.548160] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-03. [2025-09-29T19:46:35.924968] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-29T19:46:36.348164] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-02. [2025-09-29T19:46:36.419549] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-29T19:46:37.148151] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-06. [2025-09-29T19:46:37.516261] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-29T19:46:37.915360] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-29T19:46:37.948077] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-03. [2025-09-29T19:46:38.429947] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-29T19:46:38.748184] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-04. [2025-09-29T19:46:39.301983] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-29T19:46:39.548136] [INFO ] [REMOTE ] M: Fetching primary data for 2025-07. [2025-09-29T19:46:40.348081] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-07. [2025-09-29T19:46:40.894935] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-29T19:46:41.148109] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-04. [2025-09-29T19:46:41.403696] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-29T19:46:41.722522] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-29T19:46:41.948103] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-08. [2025-09-29T19:46:42.748166] [INFO ] [REMOTE ] M: Fetching primary data for 2025-08. [2025-09-29T19:46:42.973058] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-29T19:46:43.509197] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-29T19:46:43.548080] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-09. [2025-09-29T19:46:44.348102] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-05. [2025-09-29T19:46:44.639744] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-29T19:46:45.148164] [INFO ] [REMOTE ] M: Fetching primary data for 2025-09. [2025-09-29T19:46:45.342107] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-29T19:46:45.350703] [INFO ] [REMOTE ] MAA: Full fetch complete (61019 records). [2025-09-29T19:46:45.350821] [DEBUG] [VALIDATOR ] MAA: Validating primary data. [2025-09-29T19:46:45.760725] [DEBUG] [VALIDATOR ] MAA: All expected trading days are present. [2025-09-29T19:46:45.760817] [DEBUG] [VALIDATOR ] MAA: Primary data validation passed. [2025-09-29T19:46:45.761741] [INFO ] [MAIN ] MAA: Fetched primary data is valid. [2025-09-29T19:46:45.761805] [DEBUG] [LOCAL ] MAA: Saving primary data. [2025-09-29T19:46:45.763040] [DEBUG] [LOCAL ] MAA: Trimmed 61019 records to 42690 (keeping 200 days of data) [2025-09-29T19:46:45.960160] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-05. [2025-09-29T19:46:46.043067] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-29T19:46:46.090529] [DEBUG] [LOCAL ] MAA: Primary data saved (42690 records). [2025-09-29T19:46:46.090697] [INFO ] [MAIN ] MAA: Full history saved. [2025-09-29T19:46:46.090798] [INFO ] [MAIN ] Update Progress: 1298/2371 symbols completed. MAA took 25.3s. Estimated remaining: 2h 17m 49s. Rate: 7.8 symbols/min [2025-09-29T19:46:46.275458] [INFO ] [MAIN ] MAGN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:46:46.315107] [DEBUG] [LOCAL ] MAGN: Loaded 35466 existing records from primary storage. [2025-09-29T19:46:46.315505] [INFO ] [MAIN ] MAGN: Loaded 35466 existing records. [2025-09-29T19:46:46.521127] [WARN ] [MAIN ] MAGN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:46:46.521369] [INFO ] [MAIN ] MAGN: Wiping existing primary data before full refresh. [2025-09-29T19:46:46.521438] [INFO ] [LOCAL ] MAGN: Starting deletion of primary data. [2025-09-29T19:46:46.521968] [DEBUG] [LOCAL ] MAGN: Deleted primary data file. [2025-09-29T19:46:46.522031] [INFO ] [MAIN ] MAGN: Starting full primary refresh. [2025-09-29T19:46:46.748723] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-06. [2025-09-29T19:46:46.908079] [INFO ] [REMOTE ] MAGN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:46:46.942547] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-29T19:46:46.954014] [INFO ] [REMOTE ] M: Full fetch complete (77522 records). [2025-09-29T19:46:46.954177] [DEBUG] [VALIDATOR ] M: Validating primary data. [2025-09-29T19:46:47.387806] [DEBUG] [VALIDATOR ] M: All expected trading days are present. [2025-09-29T19:46:47.387900] [DEBUG] [VALIDATOR ] M: Primary data validation passed. [2025-09-29T19:46:47.389006] [INFO ] [MAIN ] M: Fetched primary data is valid. [2025-09-29T19:46:47.389079] [DEBUG] [LOCAL ] M: Saving primary data. [2025-09-29T19:46:47.390862] [DEBUG] [LOCAL ] M: Trimmed 77522 records to 53537 (keeping 200 days of data) [2025-09-29T19:46:47.588869] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2024-12. [2025-09-29T19:46:47.768006] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-29T19:46:47.802762] [DEBUG] [LOCAL ] M: Primary data saved (53537 records). [2025-09-29T19:46:47.802898] [INFO ] [MAIN ] M: Full history saved. [2025-09-29T19:46:47.803018] [INFO ] [MAIN ] Update Progress: 1299/2371 symbols completed. M took 38.2s. Estimated remaining: 2h 17m 37s. Rate: 7.8 symbols/min [2025-09-29T19:46:47.976454] [INFO ] [MAIN ] MAIN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:46:48.023077] [DEBUG] [LOCAL ] MAIN: Loaded 41929 existing records from primary storage. [2025-09-29T19:46:48.023428] [INFO ] [MAIN ] MAIN: Loaded 41929 existing records. [2025-09-29T19:46:48.213449] [WARN ] [MAIN ] MAIN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:46:48.213703] [INFO ] [MAIN ] MAIN: Wiping existing primary data before full refresh. [2025-09-29T19:46:48.213766] [INFO ] [LOCAL ] MAIN: Starting deletion of primary data. [2025-09-29T19:46:48.214340] [DEBUG] [LOCAL ] MAIN: Deleted primary data file. [2025-09-29T19:46:48.214431] [INFO ] [MAIN ] MAIN: Starting full primary refresh. [2025-09-29T19:46:48.353256] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-06. [2025-09-29T19:46:48.611485] [INFO ] [REMOTE ] MAIN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:46:48.806337] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-29T19:46:49.047564] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-29T19:46:49.148078] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-07. [2025-09-29T19:46:49.948124] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-01. [2025-09-29T19:46:50.134992] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-29T19:46:50.748161] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2024-12. [2025-09-29T19:46:51.200475] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-29T19:46:51.297673] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-29T19:46:51.548120] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-02. [2025-09-29T19:46:52.116574] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-29T19:46:52.348142] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-01. [2025-09-29T19:46:52.907557] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-29T19:46:53.148121] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-08. [2025-09-29T19:46:53.663582] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-29T19:46:53.948123] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-03. [2025-09-29T19:46:54.748130] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-02. [2025-09-29T19:46:55.200601] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-29T19:46:55.261953] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-29T19:46:55.548140] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-07. [2025-09-29T19:46:56.094577] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-29T19:46:56.348146] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-09. [2025-09-29T19:46:57.148094] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-03. [2025-09-29T19:46:57.250122] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-29T19:46:57.948124] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-04. [2025-09-29T19:46:58.631973] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-29T19:46:58.647784] [INFO ] [REMOTE ] MA: Full fetch complete (76254 records). [2025-09-29T19:46:58.648170] [DEBUG] [VALIDATOR ] MA: Validating primary data. [2025-09-29T19:46:58.749495] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-08. [2025-09-29T19:46:59.194466] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-29T19:46:59.402080] [DEBUG] [VALIDATOR ] MA: All expected trading days are present. [2025-09-29T19:46:59.402188] [DEBUG] [VALIDATOR ] MA: Primary data validation passed. [2025-09-29T19:46:59.403875] [INFO ] [MAIN ] MA: Fetched primary data is valid. [2025-09-29T19:46:59.403998] [DEBUG] [LOCAL ] MA: Saving primary data. [2025-09-29T19:46:59.406113] [DEBUG] [LOCAL ] MA: Trimmed 76254 records to 52540 (keeping 200 days of data) [2025-09-29T19:46:59.548834] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-04. [2025-09-29T19:46:59.551671] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-29T19:46:59.833587] [DEBUG] [LOCAL ] MA: Primary data saved (52540 records). [2025-09-29T19:46:59.833766] [INFO ] [MAIN ] MA: Full history saved. [2025-09-29T19:46:59.833867] [INFO ] [MAIN ] Update Progress: 1300/2371 symbols completed. MA took 41.4s. Estimated remaining: 2h 17m 32s. Rate: 7.8 symbols/min [2025-09-29T19:47:00.021906] [INFO ] [MAIN ] MAN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:47:00.076774] [DEBUG] [LOCAL ] MAN: Loaded 44216 existing records from primary storage. [2025-09-29T19:47:00.077178] [INFO ] [MAIN ] MAN: Loaded 44216 existing records. [2025-09-29T19:47:00.275386] [WARN ] [MAIN ] MAN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:47:00.275761] [INFO ] [MAIN ] MAN: Wiping existing primary data before full refresh. [2025-09-29T19:47:00.275819] [INFO ] [LOCAL ] MAN: Starting deletion of primary data. [2025-09-29T19:47:00.276437] [DEBUG] [LOCAL ] MAN: Deleted primary data file. [2025-09-29T19:47:00.276511] [INFO ] [MAIN ] MAN: Starting full primary refresh. [2025-09-29T19:47:00.353261] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-05. [2025-09-29T19:47:00.673737] [INFO ] [REMOTE ] MAN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:47:00.703967] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-29T19:47:01.148092] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-09. [2025-09-29T19:47:01.339797] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-29T19:47:01.752882] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-29T19:47:01.948123] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-05. [2025-09-29T19:47:02.748126] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-06. [2025-09-29T19:47:03.286901] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-29T19:47:03.297363] [INFO ] [REMOTE ] MAC: Full fetch complete (71457 records). [2025-09-29T19:47:03.297522] [DEBUG] [VALIDATOR ] MAC: Validating primary data. [2025-09-29T19:47:03.550805] [INFO ] [REMOTE ] MAN: Fetching primary data for 2024-12. [2025-09-29T19:47:03.742498] [DEBUG] [VALIDATOR ] MAC: All expected trading days are present. [2025-09-29T19:47:03.742639] [DEBUG] [VALIDATOR ] MAC: Primary data validation passed. [2025-09-29T19:47:03.743759] [INFO ] [MAIN ] MAC: Fetched primary data is valid. [2025-09-29T19:47:03.743844] [DEBUG] [LOCAL ] MAC: Saving primary data. [2025-09-29T19:47:03.745386] [DEBUG] [LOCAL ] MAC: Trimmed 71457 records to 49693 (keeping 200 days of data) [2025-09-29T19:47:03.874304] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-29T19:47:04.102118] [DEBUG] [LOCAL ] MAC: Primary data saved (49693 records). [2025-09-29T19:47:04.102271] [INFO ] [MAIN ] MAC: Full history saved. [2025-09-29T19:47:04.102360] [INFO ] [MAIN ] Update Progress: 1301/2371 symbols completed. MAC took 35.7s. Estimated remaining: 2h 17m 22s. Rate: 7.8 symbols/min [2025-09-29T19:47:04.281667] [INFO ] [MAIN ] MANU: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:47:04.304223] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-29T19:47:04.338805] [DEBUG] [LOCAL ] MANU: Loaded 27544 existing records from primary storage. [2025-09-29T19:47:04.339119] [INFO ] [MAIN ] MANU: Loaded 27544 existing records. [2025-09-29T19:47:04.353313] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-06. [2025-09-29T19:47:04.532564] [WARN ] [MAIN ] MANU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:47:04.532798] [INFO ] [MAIN ] MANU: Wiping existing primary data before full refresh. [2025-09-29T19:47:04.532848] [INFO ] [LOCAL ] MANU: Starting deletion of primary data. [2025-09-29T19:47:04.533110] [DEBUG] [LOCAL ] MANU: Deleted primary data file. [2025-09-29T19:47:04.533168] [INFO ] [MAIN ] MANU: Starting full primary refresh. [2025-09-29T19:47:04.918589] [INFO ] [REMOTE ] MANU: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:47:05.148127] [INFO ] [REMOTE ] MANU: Fetching primary data for 2024-12. [2025-09-29T19:47:05.215461] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-29T19:47:05.948132] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-01. [2025-09-29T19:47:06.010830] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-29T19:47:06.104598] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-29T19:47:06.748133] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-07. [2025-09-29T19:47:07.236789] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-29T19:47:07.548114] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-02. [2025-09-29T19:47:08.348096] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-07. [2025-09-29T19:47:08.399633] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-29T19:47:09.031177] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-29T19:47:09.148095] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-01. [2025-09-29T19:47:09.773608] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-29T19:47:09.948121] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-08. [2025-09-29T19:47:09.976562] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-29T19:47:10.748135] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-08. [2025-09-29T19:47:11.337941] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-29T19:47:11.548136] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-09. [2025-09-29T19:47:12.348093] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-02. [2025-09-29T19:47:12.408916] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-29T19:47:13.000533] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-29T19:47:13.008325] [INFO ] [REMOTE ] MAGN: Full fetch complete (50920 records). [2025-09-29T19:47:13.008464] [DEBUG] [VALIDATOR ] MAGN: Validating primary data. [2025-09-29T19:47:13.158343] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-03. [2025-09-29T19:47:13.393624] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-29T19:47:13.451235] [DEBUG] [VALIDATOR ] MAGN: All expected trading days are present. [2025-09-29T19:47:13.451356] [DEBUG] [VALIDATOR ] MAGN: Primary data validation passed. [2025-09-29T19:47:13.452352] [INFO ] [MAIN ] MAGN: Fetched primary data is valid. [2025-09-29T19:47:13.452422] [DEBUG] [LOCAL ] MAGN: Saving primary data. [2025-09-29T19:47:13.453634] [DEBUG] [LOCAL ] MAGN: Trimmed 50920 records to 34851 (keeping 200 days of data) [2025-09-29T19:47:13.671407] [DEBUG] [LOCAL ] MAGN: Primary data saved (34851 records). [2025-09-29T19:47:13.671559] [INFO ] [MAIN ] MAGN: Full history saved. [2025-09-29T19:47:13.671670] [INFO ] [MAIN ] Update Progress: 1302/2371 symbols completed. MAGN took 27.6s. Estimated remaining: 2h 17m 16s. Rate: 7.8 symbols/min [2025-09-29T19:47:13.851169] [INFO ] [MAIN ] MAS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:47:13.914772] [DEBUG] [LOCAL ] MAS: Loaded 53102 existing records from primary storage. [2025-09-29T19:47:13.915148] [INFO ] [MAIN ] MAS: Loaded 53102 existing records. [2025-09-29T19:47:13.953218] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-09. [2025-09-29T19:47:14.110116] [WARN ] [MAIN ] MAS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:47:14.110294] [INFO ] [MAIN ] MAS: Wiping existing primary data before full refresh. [2025-09-29T19:47:14.110344] [INFO ] [LOCAL ] MAS: Starting deletion of primary data. [2025-09-29T19:47:14.110961] [DEBUG] [LOCAL ] MAS: Deleted primary data file. [2025-09-29T19:47:14.111022] [INFO ] [MAIN ] MAS: Starting full primary refresh. [2025-09-29T19:47:14.482724] [INFO ] [REMOTE ] MAS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:47:14.748077] [INFO ] [REMOTE ] MAS: Fetching primary data for 2024-12. [2025-09-29T19:47:14.785723] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-29T19:47:15.548089] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-03. [2025-09-29T19:47:15.867879] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-29T19:47:15.877184] [INFO ] [REMOTE ] MAIN: Full fetch complete (59700 records). [2025-09-29T19:47:15.877366] [DEBUG] [VALIDATOR ] MAIN: Validating primary data. [2025-09-29T19:47:16.310251] [DEBUG] [VALIDATOR ] MAIN: All expected trading days are present. [2025-09-29T19:47:16.310451] [DEBUG] [VALIDATOR ] MAIN: Primary data validation passed. [2025-09-29T19:47:16.311520] [INFO ] [MAIN ] MAIN: Fetched primary data is valid. [2025-09-29T19:47:16.311669] [DEBUG] [LOCAL ] MAIN: Saving primary data. [2025-09-29T19:47:16.313447] [DEBUG] [LOCAL ] MAIN: Trimmed 59700 records to 41208 (keeping 200 days of data) [2025-09-29T19:47:16.391258] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-04. [2025-09-29T19:47:16.435075] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-29T19:47:16.627108] [DEBUG] [LOCAL ] MAIN: Primary data saved (41208 records). [2025-09-29T19:47:16.627249] [INFO ] [MAIN ] MAIN: Full history saved. [2025-09-29T19:47:16.627335] [INFO ] [MAIN ] Update Progress: 1303/2371 symbols completed. MAIN took 28.8s. Estimated remaining: 2h 17m 4s. Rate: 7.8 symbols/min [2025-09-29T19:47:16.814505] [INFO ] [MAIN ] MATV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:47:16.841284] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-29T19:47:16.880262] [DEBUG] [LOCAL ] MATV: Loaded 37964 existing records from primary storage. [2025-09-29T19:47:16.880573] [INFO ] [MAIN ] MATV: Loaded 37964 existing records. [2025-09-29T19:47:17.073598] [WARN ] [MAIN ] MATV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:47:17.073877] [INFO ] [MAIN ] MATV: Wiping existing primary data before full refresh. [2025-09-29T19:47:17.073930] [INFO ] [LOCAL ] MATV: Starting deletion of primary data. [2025-09-29T19:47:17.074553] [DEBUG] [LOCAL ] MATV: Deleted primary data file. [2025-09-29T19:47:17.074620] [INFO ] [MAIN ] MATV: Starting full primary refresh. [2025-09-29T19:47:17.153285] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-01. [2025-09-29T19:47:17.448741] [INFO ] [REMOTE ] MATV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:47:17.948109] [INFO ] [REMOTE ] MATV: Fetching primary data for 2024-12. [2025-09-29T19:47:18.087453] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-29T19:47:18.748111] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-04. [2025-09-29T19:47:18.810772] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-29T19:47:19.372250] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-29T19:47:19.548128] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-01. [2025-09-29T19:47:19.937123] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-29T19:47:20.348112] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-02. [2025-09-29T19:47:20.930686] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-29T19:47:21.148114] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-05. [2025-09-29T19:47:21.948133] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-05. [2025-09-29T19:47:22.006254] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-29T19:47:22.289518] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-29T19:47:22.748119] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-03. [2025-09-29T19:47:23.298550] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-29T19:47:23.548134] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-06. [2025-09-29T19:47:24.348129] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-06. [2025-09-29T19:47:24.507558] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-29T19:47:24.990449] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-29T19:47:25.148099] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-07. [2025-09-29T19:47:25.775465] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-29T19:47:25.948165] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-07. [2025-09-29T19:47:26.172074] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-29T19:47:26.748125] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-02. [2025-09-29T19:47:27.265570] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-29T19:47:27.548123] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-08. [2025-09-29T19:47:28.093861] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-29T19:47:28.348147] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-04. [2025-09-29T19:47:29.132573] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-29T19:47:29.148061] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-09. [2025-09-29T19:47:29.948146] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-08. [2025-09-29T19:47:30.123061] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-29T19:47:30.397709] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-29T19:47:30.406987] [INFO ] [REMOTE ] MAN: Full fetch complete (62039 records). [2025-09-29T19:47:30.407158] [DEBUG] [VALIDATOR ] MAN: Validating primary data. [2025-09-29T19:47:30.765509] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-05. [2025-09-29T19:47:30.829504] [DEBUG] [VALIDATOR ] MAN: All expected trading days are present. [2025-09-29T19:47:30.829615] [DEBUG] [VALIDATOR ] MAN: Primary data validation passed. [2025-09-29T19:47:30.830753] [INFO ] [MAIN ] MAN: Fetched primary data is valid. [2025-09-29T19:47:30.830924] [DEBUG] [LOCAL ] MAN: Saving primary data. [2025-09-29T19:47:30.832618] [DEBUG] [LOCAL ] MAN: Trimmed 62039 records to 43536 (keeping 200 days of data) [2025-09-29T19:47:31.090423] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-29T19:47:31.137976] [DEBUG] [LOCAL ] MAN: Primary data saved (43536 records). [2025-09-29T19:47:31.138337] [INFO ] [MAIN ] MAN: Full history saved. [2025-09-29T19:47:31.138606] [INFO ] [MAIN ] Update Progress: 1304/2371 symbols completed. MAN took 31.3s. Estimated remaining: 2h 17m 2s. Rate: 7.8 symbols/min [2025-09-29T19:47:31.321227] [INFO ] [MAIN ] MATX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:47:31.362746] [DEBUG] [LOCAL ] MATX: Loaded 31851 existing records from primary storage. [2025-09-29T19:47:31.363102] [INFO ] [MAIN ] MATX: Loaded 31851 existing records. [2025-09-29T19:47:31.551727] [WARN ] [MAIN ] MATX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:47:31.551948] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-03. [2025-09-29T19:47:31.554124] [INFO ] [MAIN ] MATX: Wiping existing primary data before full refresh. [2025-09-29T19:47:31.554207] [INFO ] [LOCAL ] MATX: Starting deletion of primary data. [2025-09-29T19:47:31.554673] [DEBUG] [LOCAL ] MATX: Deleted primary data file. [2025-09-29T19:47:31.554736] [INFO ] [MAIN ] MATX: Starting full primary refresh. [2025-09-29T19:47:31.935130] [INFO ] [REMOTE ] MATX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:47:32.348094] [INFO ] [REMOTE ] MATX: Fetching primary data for 2024-12. [2025-09-29T19:47:32.610984] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-29T19:47:32.777082] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-29T19:47:33.148127] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-04. [2025-09-29T19:47:33.462781] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-29T19:47:33.948216] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-09. [2025-09-29T19:47:34.684976] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-29T19:47:34.748115] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-05. [2025-09-29T19:47:35.497158] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-29T19:47:35.506202] [INFO ] [REMOTE ] MANU: Full fetch complete (38202 records). [2025-09-29T19:47:35.506334] [DEBUG] [VALIDATOR ] MANU: Validating primary data. [2025-09-29T19:47:35.553315] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-06. [2025-09-29T19:47:35.910180] [DEBUG] [VALIDATOR ] MANU: All expected trading days are present. [2025-09-29T19:47:35.910277] [DEBUG] [VALIDATOR ] MANU: Primary data validation passed. [2025-09-29T19:47:35.911160] [INFO ] [MAIN ] MANU: Fetched primary data is valid. [2025-09-29T19:47:35.911227] [DEBUG] [LOCAL ] MANU: Saving primary data. [2025-09-29T19:47:35.913997] [DEBUG] [LOCAL ] MANU: Trimmed 38202 records to 27013 (keeping 200 days of data) [2025-09-29T19:47:36.088111] [DEBUG] [LOCAL ] MANU: Primary data saved (27013 records). [2025-09-29T19:47:36.088257] [INFO ] [MAIN ] MANU: Full history saved. [2025-09-29T19:47:36.088342] [INFO ] [MAIN ] Update Progress: 1305/2371 symbols completed. MANU took 32.0s. Estimated remaining: 2h 16m 52s. Rate: 7.8 symbols/min [2025-09-29T19:47:36.261452] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-29T19:47:36.344970] [INFO ] [MAIN ] MAX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:47:36.348076] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-06. [2025-09-29T19:47:36.383026] [DEBUG] [LOCAL ] MAX: Loaded 31209 existing records from primary storage. [2025-09-29T19:47:36.383311] [INFO ] [MAIN ] MAX: Loaded 31209 existing records. [2025-09-29T19:47:36.574945] [WARN ] [MAIN ] MAX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:47:36.575157] [INFO ] [MAIN ] MAX: Wiping existing primary data before full refresh. [2025-09-29T19:47:36.575207] [INFO ] [LOCAL ] MAX: Starting deletion of primary data. [2025-09-29T19:47:36.575635] [DEBUG] [LOCAL ] MAX: Deleted primary data file. [2025-09-29T19:47:36.575738] [INFO ] [MAIN ] MAX: Starting full primary refresh. [2025-09-29T19:47:36.946599] [INFO ] [REMOTE ] MAX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:47:37.148105] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-01. [2025-09-29T19:47:37.243128] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-29T19:47:37.820229] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-29T19:47:37.948120] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-07. [2025-09-29T19:47:38.339894] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-29T19:47:38.748148] [INFO ] [REMOTE ] MAX: Fetching primary data for 2024-12. [2025-09-29T19:47:39.548134] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-07. [2025-09-29T19:47:39.806445] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-29T19:47:39.841081] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-29T19:47:40.348111] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-01. [2025-09-29T19:47:40.923934] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-29T19:47:41.148111] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-02. [2025-09-29T19:47:41.698268] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-29T19:47:41.948155] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-02. [2025-09-29T19:47:42.189196] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-29T19:47:42.748163] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-08. [2025-09-29T19:47:43.242129] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-29T19:47:43.548137] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-03. [2025-09-29T19:47:44.298968] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-29T19:47:44.348072] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-09. [2025-09-29T19:47:44.935835] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-29T19:47:45.148125] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-08. [2025-09-29T19:47:45.543589] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-29T19:47:45.550574] [INFO ] [REMOTE ] MATV: Full fetch complete (52473 records). [2025-09-29T19:47:45.550741] [DEBUG] [VALIDATOR ] MATV: Validating primary data. [2025-09-29T19:47:45.950718] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-03. [2025-09-29T19:47:45.965312] [DEBUG] [VALIDATOR ] MATV: All expected trading days are present. [2025-09-29T19:47:45.965407] [DEBUG] [VALIDATOR ] MATV: Primary data validation passed. [2025-09-29T19:47:45.966306] [INFO ] [MAIN ] MATV: Fetched primary data is valid. [2025-09-29T19:47:45.966494] [DEBUG] [LOCAL ] MATV: Saving primary data. [2025-09-29T19:47:45.968458] [DEBUG] [LOCAL ] MATV: Trimmed 52473 records to 37051 (keeping 200 days of data) [2025-09-29T19:47:46.210904] [DEBUG] [LOCAL ] MATV: Primary data saved (37051 records). [2025-09-29T19:47:46.211068] [INFO ] [MAIN ] MATV: Full history saved. [2025-09-29T19:47:46.211173] [INFO ] [MAIN ] Update Progress: 1306/2371 symbols completed. MATV took 29.6s. Estimated remaining: 2h 16m 46s. Rate: 7.8 symbols/min [2025-09-29T19:47:46.395975] [INFO ] [MAIN ] MBC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:47:46.445440] [DEBUG] [LOCAL ] MBC: Loaded 43803 existing records from primary storage. [2025-09-29T19:47:46.445804] [INFO ] [MAIN ] MBC: Loaded 43803 existing records. [2025-09-29T19:47:46.635050] [WARN ] [MAIN ] MBC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:47:46.635270] [INFO ] [MAIN ] MBC: Wiping existing primary data before full refresh. [2025-09-29T19:47:46.635341] [INFO ] [LOCAL ] MBC: Starting deletion of primary data. [2025-09-29T19:47:46.636045] [DEBUG] [LOCAL ] MBC: Deleted primary data file. [2025-09-29T19:47:46.636111] [INFO ] [MAIN ] MBC: Starting full primary refresh. [2025-09-29T19:47:46.750354] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-04. [2025-09-29T19:47:47.020207] [INFO ] [REMOTE ] MBC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:47:47.050869] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-29T19:47:47.290609] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-29T19:47:47.548115] [INFO ] [REMOTE ] MBC: Fetching primary data for 2024-12. [2025-09-29T19:47:48.253285] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-29T19:47:48.348119] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-09. [2025-09-29T19:47:49.005826] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-29T19:47:49.148165] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-01. [2025-09-29T19:47:49.948152] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-04. [2025-09-29T19:47:50.269146] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-29T19:47:50.280416] [INFO ] [REMOTE ] MAS: Full fetch complete (74826 records). [2025-09-29T19:47:50.280564] [DEBUG] [VALIDATOR ] MAS: Validating primary data. [2025-09-29T19:47:50.744304] [DEBUG] [VALIDATOR ] MAS: All expected trading days are present. [2025-09-29T19:47:50.744747] [DEBUG] [VALIDATOR ] MAS: Primary data validation passed. [2025-09-29T19:47:50.746712] [INFO ] [MAIN ] MAS: Fetched primary data is valid. [2025-09-29T19:47:50.748640] [DEBUG] [LOCAL ] MAS: Saving primary data. [2025-09-29T19:47:50.748556] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-29T19:47:50.758242] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-05. [2025-09-29T19:47:50.762929] [DEBUG] [LOCAL ] MAS: Trimmed 74826 records to 52336 (keeping 200 days of data) [2025-09-29T19:47:51.202892] [DEBUG] [LOCAL ] MAS: Primary data saved (52336 records). [2025-09-29T19:47:51.203098] [INFO ] [MAIN ] MAS: Full history saved. [2025-09-29T19:47:51.203227] [INFO ] [MAIN ] Update Progress: 1307/2371 symbols completed. MAS took 37.5s. Estimated remaining: 2h 16m 36s. Rate: 7.8 symbols/min [2025-09-29T19:47:51.488345] [INFO ] [MAIN ] MBI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:47:51.523021] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-29T19:47:51.555100] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-02. [2025-09-29T19:47:51.559947] [DEBUG] [LOCAL ] MBI: Loaded 24930 existing records from primary storage. [2025-09-29T19:47:51.560540] [INFO ] [MAIN ] MBI: Loaded 24930 existing records. [2025-09-29T19:47:51.855995] [WARN ] [MAIN ] MBI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:47:51.856221] [INFO ] [MAIN ] MBI: Wiping existing primary data before full refresh. [2025-09-29T19:47:51.856270] [INFO ] [LOCAL ] MBI: Starting deletion of primary data. [2025-09-29T19:47:51.856593] [DEBUG] [LOCAL ] MBI: Deleted primary data file. [2025-09-29T19:47:51.856702] [INFO ] [MAIN ] MBI: Starting full primary refresh. [2025-09-29T19:47:52.257638] [INFO ] [REMOTE ] MBI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:47:52.260116] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-29T19:47:52.348092] [INFO ] [REMOTE ] MBI: Fetching primary data for 2024-12. [2025-09-29T19:47:53.061414] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-29T19:47:53.148092] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-06. [2025-09-29T19:47:53.607104] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-29T19:47:53.948078] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-01. [2025-09-29T19:47:53.999179] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-29T19:47:54.748149] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-03. [2025-09-29T19:47:55.177209] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-29T19:47:55.548104] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-02. [2025-09-29T19:47:56.320300] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-29T19:47:56.348141] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-04. [2025-09-29T19:47:56.677589] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-29T19:47:57.148117] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-07. [2025-09-29T19:47:57.887181] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-29T19:47:57.948074] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-05. [2025-09-29T19:47:57.983298] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-29T19:47:58.748148] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-03. [2025-09-29T19:47:59.449101] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-29T19:47:59.548088] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-08. [2025-09-29T19:47:59.878672] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-29T19:48:00.348149] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-04. [2025-09-29T19:48:01.012696] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-29T19:48:01.148130] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-05. [2025-09-29T19:48:01.884142] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-29T19:48:01.948161] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-05. [2025-09-29T19:48:02.652388] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-29T19:48:02.748113] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-09. [2025-09-29T19:48:03.127123] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-29T19:48:03.548107] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-06. [2025-09-29T19:48:04.325023] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-29T19:48:04.332809] [INFO ] [REMOTE ] MAX: Full fetch complete (45266 records). [2025-09-29T19:48:04.332957] [DEBUG] [VALIDATOR ] MAX: Validating primary data. [2025-09-29T19:48:04.355867] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-06. [2025-09-29T19:48:04.750086] [DEBUG] [VALIDATOR ] MAX: All expected trading days are present. [2025-09-29T19:48:04.750248] [DEBUG] [VALIDATOR ] MAX: Primary data validation passed. [2025-09-29T19:48:04.751304] [INFO ] [MAIN ] MAX: Fetched primary data is valid. [2025-09-29T19:48:04.751390] [DEBUG] [LOCAL ] MAX: Saving primary data. [2025-09-29T19:48:04.765232] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-29T19:48:04.771093] [DEBUG] [LOCAL ] MAX: Trimmed 45266 records to 30602 (keeping 200 days of data) [2025-09-29T19:48:04.954574] [DEBUG] [LOCAL ] MAX: Primary data saved (30602 records). [2025-09-29T19:48:04.954761] [INFO ] [MAIN ] MAX: Full history saved. [2025-09-29T19:48:04.954859] [INFO ] [MAIN ] Update Progress: 1308/2371 symbols completed. MAX took 28.9s. Estimated remaining: 2h 16m 34s. Rate: 7.8 symbols/min [2025-09-29T19:48:05.128372] [INFO ] [MAIN ] MC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:48:05.156333] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-06. [2025-09-29T19:48:05.175525] [DEBUG] [LOCAL ] MC: Loaded 44878 existing records from primary storage. [2025-09-29T19:48:05.175888] [INFO ] [MAIN ] MC: Loaded 44878 existing records. [2025-09-29T19:48:05.359324] [WARN ] [MAIN ] MC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:48:05.359581] [INFO ] [MAIN ] MC: Wiping existing primary data before full refresh. [2025-09-29T19:48:05.359681] [INFO ] [LOCAL ] MC: Starting deletion of primary data. [2025-09-29T19:48:05.360166] [DEBUG] [LOCAL ] MC: Deleted primary data file. [2025-09-29T19:48:05.360226] [INFO ] [MAIN ] MC: Starting full primary refresh. [2025-09-29T19:48:05.740062] [INFO ] [REMOTE ] MC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:48:05.953224] [INFO ] [REMOTE ] MC: Fetching primary data for 2024-12. [2025-09-29T19:48:05.969246] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-29T19:48:06.486112] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-29T19:48:06.748130] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-07. [2025-09-29T19:48:07.014034] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-29T19:48:07.548123] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-07. [2025-09-29T19:48:08.196189] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-29T19:48:08.348119] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-08. [2025-09-29T19:48:09.120974] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-29T19:48:09.148077] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-07. [2025-09-29T19:48:09.696775] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-29T19:48:09.948116] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-01. [2025-09-29T19:48:10.209034] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-29T19:48:10.748145] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-08. [2025-09-29T19:48:11.431618] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-29T19:48:11.548135] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-08. [2025-09-29T19:48:12.261775] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-29T19:48:12.348128] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-09. [2025-09-29T19:48:13.151715] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-02. [2025-09-29T19:48:13.158279] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-29T19:48:13.684176] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-29T19:48:13.690269] [INFO ] [REMOTE ] MBI: Full fetch complete (36532 records). [2025-09-29T19:48:13.690410] [DEBUG] [VALIDATOR ] MBI: Validating primary data. [2025-09-29T19:48:13.953363] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-09. [2025-09-29T19:48:14.094238] [DEBUG] [VALIDATOR ] MBI: All expected trading days are present. [2025-09-29T19:48:14.094321] [DEBUG] [VALIDATOR ] MBI: Primary data validation passed. [2025-09-29T19:48:14.095157] [INFO ] [MAIN ] MBI: Fetched primary data is valid. [2025-09-29T19:48:14.095223] [DEBUG] [LOCAL ] MBI: Saving primary data. [2025-09-29T19:48:14.096501] [DEBUG] [LOCAL ] MBI: Trimmed 36532 records to 24353 (keeping 200 days of data) [2025-09-29T19:48:14.234015] [DEBUG] [LOCAL ] MBI: Primary data saved (24353 records). [2025-09-29T19:48:14.234183] [INFO ] [MAIN ] MBI: Full history saved. [2025-09-29T19:48:14.234281] [INFO ] [MAIN ] Update Progress: 1309/2371 symbols completed. MBI took 23.0s. Estimated remaining: 2h 16m 27s. Rate: 7.8 symbols/min [2025-09-29T19:48:14.416024] [INFO ] [MAIN ] MCB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:48:14.430109] [DEBUG] [LOCAL ] MCB: Loaded 11834 existing records from primary storage. [2025-09-29T19:48:14.430417] [INFO ] [MAIN ] MCB: Loaded 11834 existing records. [2025-09-29T19:48:14.622249] [WARN ] [MAIN ] MCB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:48:14.622555] [INFO ] [MAIN ] MCB: Wiping existing primary data before full refresh. [2025-09-29T19:48:14.622743] [INFO ] [LOCAL ] MCB: Starting deletion of primary data. [2025-09-29T19:48:14.623173] [DEBUG] [LOCAL ] MCB: Deleted primary data file. [2025-09-29T19:48:14.623255] [INFO ] [MAIN ] MCB: Starting full primary refresh. [2025-09-29T19:48:14.751733] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-09. [2025-09-29T19:48:15.018675] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-29T19:48:15.052516] [INFO ] [REMOTE ] MCB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:48:15.548092] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-03. [2025-09-29T19:48:15.667685] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-29T19:48:15.677984] [INFO ] [REMOTE ] MBC: Full fetch complete (62765 records). [2025-09-29T19:48:15.678136] [DEBUG] [VALIDATOR ] MBC: Validating primary data. [2025-09-29T19:48:16.170846] [DEBUG] [VALIDATOR ] MBC: All expected trading days are present. [2025-09-29T19:48:16.171087] [DEBUG] [VALIDATOR ] MBC: Primary data validation passed. [2025-09-29T19:48:16.172615] [INFO ] [MAIN ] MBC: Fetched primary data is valid. [2025-09-29T19:48:16.172753] [DEBUG] [LOCAL ] MBC: Saving primary data. [2025-09-29T19:48:16.174323] [DEBUG] [LOCAL ] MBC: Trimmed 62765 records to 43180 (keeping 200 days of data) [2025-09-29T19:48:16.308994] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-29T19:48:16.317015] [INFO ] [REMOTE ] MATX: Full fetch complete (42485 records). [2025-09-29T19:48:16.317970] [DEBUG] [VALIDATOR ] MATX: Validating primary data. [2025-09-29T19:48:16.352504] [INFO ] [REMOTE ] MCB: Fetching primary data for 2024-12. [2025-09-29T19:48:16.847778] [DEBUG] [VALIDATOR ] MATX: All expected trading days are present. [2025-09-29T19:48:16.848132] [DEBUG] [VALIDATOR ] MATX: Primary data validation passed. [2025-09-29T19:48:16.849368] [INFO ] [MAIN ] MATX: Fetched primary data is valid. [2025-09-29T19:48:16.849932] [DEBUG] [LOCAL ] MATX: Saving primary data. [2025-09-29T19:48:16.853477] [DEBUG] [LOCAL ] MATX: Trimmed 42485 records to 31452 (keeping 200 days of data) [2025-09-29T19:48:16.998774] [DEBUG] [LOCAL ] MBC: Primary data saved (43180 records). [2025-09-29T19:48:17.001833] [INFO ] [MAIN ] MBC: Full history saved. [2025-09-29T19:48:17.003113] [INFO ] [MAIN ] Update Progress: 1310/2371 symbols completed. MBC took 30.8s. Estimated remaining: 2h 16m 15s. Rate: 7.8 symbols/min [2025-09-29T19:48:17.111956] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-29T19:48:17.152528] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-01. [2025-09-29T19:48:17.231562] [INFO ] [MAIN ] MCD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:48:17.234844] [DEBUG] [LOCAL ] MCD: No existing data file found in primary storage. [2025-09-29T19:48:17.235691] [WARN ] [MAIN ] MCD: No existing data found, performing full refresh instead. [2025-09-29T19:48:17.236213] [INFO ] [MAIN ] MCD: Wiping existing primary data before full refresh. [2025-09-29T19:48:17.236289] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-09-29T19:48:17.236374] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-09-29T19:48:17.237667] [INFO ] [MAIN ] MCD: Starting full primary refresh. [2025-09-29T19:48:17.389354] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-29T19:48:17.779069] [INFO ] [REMOTE ] MCD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:48:17.787521] [DEBUG] [LOCAL ] MATX: Primary data saved (31452 records). [2025-09-29T19:48:17.787702] [INFO ] [MAIN ] MATX: Full history saved. [2025-09-29T19:48:17.787809] [INFO ] [MAIN ] Update Progress: 1311/2371 symbols completed. MATX took 46.6s. Estimated remaining: 2h 16m 2s. Rate: 7.8 symbols/min [2025-09-29T19:48:17.964317] [INFO ] [MAIN ] MCI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:48:17.961767] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-04. [2025-09-29T19:48:17.974606] [DEBUG] [LOCAL ] MCI: Loaded 6477 existing records from primary storage. [2025-09-29T19:48:17.974872] [INFO ] [MAIN ] MCI: Loaded 6477 existing records. [2025-09-29T19:48:18.146572] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-29T19:48:18.188555] [WARN ] [MAIN ] MCI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:48:18.188826] [INFO ] [MAIN ] MCI: Wiping existing primary data before full refresh. [2025-09-29T19:48:18.188876] [INFO ] [LOCAL ] MCI: Starting deletion of primary data. [2025-09-29T19:48:18.189080] [DEBUG] [LOCAL ] MCI: Deleted primary data file. [2025-09-29T19:48:18.189138] [INFO ] [MAIN ] MCI: Starting full primary refresh. [2025-09-29T19:48:18.567317] [INFO ] [REMOTE ] MCI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:48:18.748119] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-02. [2025-09-29T19:48:19.548107] [INFO ] [REMOTE ] MCD: Fetching primary data for 2024-12. [2025-09-29T19:48:19.663987] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-29T19:48:19.755286] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-29T19:48:20.348124] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-05. [2025-09-29T19:48:21.148120] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-03. [2025-09-29T19:48:21.372883] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-29T19:48:21.948101] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-01. [2025-09-29T19:48:21.979918] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-29T19:48:22.094746] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-29T19:48:22.748110] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-04. [2025-09-29T19:48:23.548107] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-06. [2025-09-29T19:48:23.752042] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-29T19:48:24.046272] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-29T19:48:24.348106] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-05. [2025-09-29T19:48:25.150695] [INFO ] [REMOTE ] MCI: Fetching primary data for 2024-12. [2025-09-29T19:48:25.157487] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-29T19:48:25.180754] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-29T19:48:25.795280] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-29T19:48:25.948147] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-02. [2025-09-29T19:48:26.748145] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-01. [2025-09-29T19:48:27.548139] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-07. [2025-09-29T19:48:27.573505] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-29T19:48:27.917988] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-29T19:48:28.348188] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-02. [2025-09-29T19:48:29.094153] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-29T19:48:29.131326] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-29T19:48:29.148096] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-03. [2025-09-29T19:48:29.904856] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-29T19:48:29.948116] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-06. [2025-09-29T19:48:30.571779] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-29T19:48:30.748125] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-03. [2025-09-29T19:48:31.548159] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-08. [2025-09-29T19:48:32.348085] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-04. [2025-09-29T19:48:32.743151] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-29T19:48:32.859499] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-29T19:48:33.055727] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-29T19:48:33.148125] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-07. [2025-09-29T19:48:33.825801] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-29T19:48:33.948121] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-08. [2025-09-29T19:48:34.639141] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-29T19:48:34.748120] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-09. [2025-09-29T19:48:35.548120] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-05. [2025-09-29T19:48:35.655417] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-29T19:48:35.658853] [INFO ] [REMOTE ] MCB: Full fetch complete (16338 records). [2025-09-29T19:48:35.658962] [DEBUG] [VALIDATOR ] MCB: Validating primary data. [2025-09-29T19:48:36.076502] [DEBUG] [VALIDATOR ] MCB: All expected trading days are present. [2025-09-29T19:48:36.076679] [DEBUG] [VALIDATOR ] MCB: Primary data validation passed. [2025-09-29T19:48:36.077106] [INFO ] [MAIN ] MCB: Fetched primary data is valid. [2025-09-29T19:48:36.077225] [DEBUG] [LOCAL ] MCB: Saving primary data. [2025-09-29T19:48:36.078906] [DEBUG] [LOCAL ] MCB: Trimmed 16338 records to 11659 (keeping 200 days of data) [2025-09-29T19:48:36.156403] [DEBUG] [LOCAL ] MCB: Primary data saved (11659 records). [2025-09-29T19:48:36.156561] [INFO ] [MAIN ] MCB: Full history saved. [2025-09-29T19:48:36.156669] [INFO ] [MAIN ] Update Progress: 1312/2371 symbols completed. MCB took 21.9s. Estimated remaining: 2h 16m 3s. Rate: 7.8 symbols/min [2025-09-29T19:48:36.337548] [INFO ] [MAIN ] MCK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:48:36.345481] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-29T19:48:36.348343] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-04. [2025-09-29T19:48:36.392682] [DEBUG] [LOCAL ] MCK: Loaded 39985 existing records from primary storage. [2025-09-29T19:48:36.393038] [INFO ] [MAIN ] MCK: Loaded 39985 existing records. [2025-09-29T19:48:36.604453] [WARN ] [MAIN ] MCK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:48:36.604789] [INFO ] [MAIN ] MCK: Wiping existing primary data before full refresh. [2025-09-29T19:48:36.604895] [INFO ] [LOCAL ] MCK: Starting deletion of primary data. [2025-09-29T19:48:36.605723] [DEBUG] [LOCAL ] MCK: Deleted primary data file. [2025-09-29T19:48:36.605786] [INFO ] [MAIN ] MCK: Starting full primary refresh. [2025-09-29T19:48:37.011006] [INFO ] [REMOTE ] MCK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:48:37.148158] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-09. [2025-09-29T19:48:37.948132] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-06. [2025-09-29T19:48:38.607462] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-29T19:48:38.660566] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-29T19:48:38.671561] [INFO ] [REMOTE ] MC: Full fetch complete (62391 records). [2025-09-29T19:48:38.671776] [DEBUG] [VALIDATOR ] MC: Validating primary data. [2025-09-29T19:48:38.753203] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-05. [2025-09-29T19:48:38.779047] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-29T19:48:39.108924] [DEBUG] [VALIDATOR ] MC: All expected trading days are present. [2025-09-29T19:48:39.109020] [DEBUG] [VALIDATOR ] MC: Primary data validation passed. [2025-09-29T19:48:39.110083] [INFO ] [MAIN ] MC: Fetched primary data is valid. [2025-09-29T19:48:39.110150] [DEBUG] [LOCAL ] MC: Saving primary data. [2025-09-29T19:48:39.111639] [DEBUG] [LOCAL ] MC: Trimmed 62391 records to 44106 (keeping 200 days of data) [2025-09-29T19:48:39.394174] [DEBUG] [LOCAL ] MC: Primary data saved (44106 records). [2025-09-29T19:48:39.394317] [INFO ] [MAIN ] MC: Full history saved. [2025-09-29T19:48:39.394404] [INFO ] [MAIN ] Update Progress: 1313/2371 symbols completed. MC took 34.4s. Estimated remaining: 2h 15m 52s. Rate: 7.8 symbols/min [2025-09-29T19:48:39.564549] [INFO ] [REMOTE ] MCK: Fetching primary data for 2024-12. [2025-09-29T19:48:39.568283] [INFO ] [MAIN ] MCN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:48:39.581442] [DEBUG] [LOCAL ] MCN: Loaded 8231 existing records from primary storage. [2025-09-29T19:48:39.582264] [INFO ] [MAIN ] MCN: Loaded 8231 existing records. [2025-09-29T19:48:39.772044] [WARN ] [MAIN ] MCN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:48:39.772283] [INFO ] [MAIN ] MCN: Wiping existing primary data before full refresh. [2025-09-29T19:48:39.772331] [INFO ] [LOCAL ] MCN: Starting deletion of primary data. [2025-09-29T19:48:39.772566] [DEBUG] [LOCAL ] MCN: Deleted primary data file. [2025-09-29T19:48:39.772636] [INFO ] [MAIN ] MCN: Starting full primary refresh. [2025-09-29T19:48:40.167636] [INFO ] [REMOTE ] MCN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:48:40.348134] [INFO ] [REMOTE ] MCN: Fetching primary data for 2024-12. [2025-09-29T19:48:40.831717] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-29T19:48:40.889311] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-29T19:48:41.060132] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-29T19:48:41.148161] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-01. [2025-09-29T19:48:41.882227] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-29T19:48:41.948112] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-07. [2025-09-29T19:48:42.554841] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-29T19:48:42.748211] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-02. [2025-09-29T19:48:43.460946] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-29T19:48:43.548212] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-03. [2025-09-29T19:48:44.238685] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-29T19:48:44.348132] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-04. [2025-09-29T19:48:45.148121] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-08. [2025-09-29T19:48:45.192719] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-29T19:48:45.738661] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-29T19:48:45.948152] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-05. [2025-09-29T19:48:46.748144] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-01. [2025-09-29T19:48:46.836978] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-29T19:48:47.548135] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-06. [2025-09-29T19:48:48.329259] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-29T19:48:48.348055] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-07. [2025-09-29T19:48:48.438133] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-29T19:48:49.019253] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-29T19:48:49.148123] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-02. [2025-09-29T19:48:49.948112] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-09. [2025-09-29T19:48:50.679243] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-29T19:48:50.688109] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-29T19:48:50.691870] [INFO ] [REMOTE ] MCI: Full fetch complete (9926 records). [2025-09-29T19:48:50.691981] [DEBUG] [VALIDATOR ] MCI: Validating primary data. [2025-09-29T19:48:50.753198] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-03. [2025-09-29T19:48:51.088627] [DEBUG] [VALIDATOR ] MCI: All expected trading days are present. [2025-09-29T19:48:51.088787] [DEBUG] [VALIDATOR ] MCI: Primary data validation passed. [2025-09-29T19:48:51.089112] [INFO ] [MAIN ] MCI: Fetched primary data is valid. [2025-09-29T19:48:51.089188] [DEBUG] [LOCAL ] MCI: Saving primary data. [2025-09-29T19:48:51.089785] [DEBUG] [LOCAL ] MCI: Trimmed 9926 records to 6387 (keeping 200 days of data) [2025-09-29T19:48:51.131614] [DEBUG] [LOCAL ] MCI: Primary data saved (6387 records). [2025-09-29T19:48:51.131781] [INFO ] [MAIN ] MCI: Full history saved. [2025-09-29T19:48:51.131896] [INFO ] [MAIN ] Update Progress: 1314/2371 symbols completed. MCI took 33.3s. Estimated remaining: 2h 15m 47s. Rate: 7.8 symbols/min [2025-09-29T19:48:51.313143] [INFO ] [MAIN ] MCO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:48:51.365316] [DEBUG] [LOCAL ] MCO: Loaded 40102 existing records from primary storage. [2025-09-29T19:48:51.365687] [INFO ] [MAIN ] MCO: Loaded 40102 existing records. [2025-09-29T19:48:51.554980] [WARN ] [MAIN ] MCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:48:51.550904] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-08. [2025-09-29T19:48:51.556612] [INFO ] [MAIN ] MCO: Wiping existing primary data before full refresh. [2025-09-29T19:48:51.556758] [INFO ] [LOCAL ] MCO: Starting deletion of primary data. [2025-09-29T19:48:51.557346] [DEBUG] [LOCAL ] MCO: Deleted primary data file. [2025-09-29T19:48:51.557427] [INFO ] [MAIN ] MCO: Starting full primary refresh. [2025-09-29T19:48:51.982878] [INFO ] [REMOTE ] MCO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:48:52.280474] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-29T19:48:52.348157] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-09. [2025-09-29T19:48:52.409392] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-29T19:48:53.148118] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-06. [2025-09-29T19:48:53.225515] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-29T19:48:53.227467] [INFO ] [REMOTE ] MCN: Full fetch complete (11579 records). [2025-09-29T19:48:53.227542] [DEBUG] [VALIDATOR ] MCN: Validating primary data. [2025-09-29T19:48:53.625968] [DEBUG] [VALIDATOR ] MCN: All expected trading days are present. [2025-09-29T19:48:53.626073] [DEBUG] [VALIDATOR ] MCN: Primary data validation passed. [2025-09-29T19:48:53.626405] [INFO ] [MAIN ] MCN: Fetched primary data is valid. [2025-09-29T19:48:53.626459] [DEBUG] [LOCAL ] MCN: Saving primary data. [2025-09-29T19:48:53.627189] [DEBUG] [LOCAL ] MCN: Trimmed 11579 records to 8133 (keeping 200 days of data) [2025-09-29T19:48:53.688195] [DEBUG] [LOCAL ] MCN: Primary data saved (8133 records). [2025-09-29T19:48:53.688384] [INFO ] [MAIN ] MCN: Full history saved. [2025-09-29T19:48:53.688503] [INFO ] [MAIN ] Update Progress: 1315/2371 symbols completed. MCN took 14.3s. Estimated remaining: 2h 15m 35s. Rate: 7.8 symbols/min [2025-09-29T19:48:53.880900] [INFO ] [MAIN ] MCR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:48:53.894437] [DEBUG] [LOCAL ] MCR: Loaded 8858 existing records from primary storage. [2025-09-29T19:48:53.894760] [INFO ] [MAIN ] MCR: Loaded 8858 existing records. [2025-09-29T19:48:53.953342] [INFO ] [REMOTE ] MCO: Fetching primary data for 2024-12. [2025-09-29T19:48:54.151867] [WARN ] [MAIN ] MCR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:48:54.152072] [INFO ] [MAIN ] MCR: Wiping existing primary data before full refresh. [2025-09-29T19:48:54.152126] [INFO ] [LOCAL ] MCR: Starting deletion of primary data. [2025-09-29T19:48:54.152447] [DEBUG] [LOCAL ] MCR: Deleted primary data file. [2025-09-29T19:48:54.152506] [INFO ] [MAIN ] MCR: Starting full primary refresh. [2025-09-29T19:48:54.515713] [INFO ] [REMOTE ] MCR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:48:54.748161] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-04. [2025-09-29T19:48:55.359813] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-29T19:48:55.474545] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-09-29T19:48:55.548101] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-07. [2025-09-29T19:48:56.348117] [INFO ] [REMOTE ] MCR: Fetching primary data for 2024-12. [2025-09-29T19:48:56.524987] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-29T19:48:57.148123] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-05. [2025-09-29T19:48:57.167878] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-29T19:48:57.948220] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-01. [2025-09-29T19:48:57.951233] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-09-29T19:48:58.750109] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-01. [2025-09-29T19:48:58.755115] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-29T19:48:58.792769] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-29T19:48:59.548105] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-08. [2025-09-29T19:49:00.248594] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-29T19:49:00.348117] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-02. [2025-09-29T19:49:01.148148] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-02. [2025-09-29T19:49:01.439180] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-29T19:49:01.667978] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-29T19:49:01.912018] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-29T19:49:01.948141] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-03. [2025-09-29T19:49:02.748145] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-09. [2025-09-29T19:49:03.334373] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-29T19:49:03.548097] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-04. [2025-09-29T19:49:04.348127] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-06. [2025-09-29T19:49:04.955502] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-29T19:49:04.966439] [INFO ] [REMOTE ] MCD: Full fetch complete (77031 records). [2025-09-29T19:49:04.966974] [DEBUG] [VALIDATOR ] MCD: Validating primary data. [2025-09-29T19:49:05.148185] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-03. [2025-09-29T19:49:05.204224] [WARN ] [VALIDATOR ] MCD: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-29T19:49:05.206243] [FATAL] [MAIN ] MCD: Fetched primary data is invalid. Refusing to save it. [2025-09-29T19:49:05.206415] [WARN ] [MAIN ] MCD: Deleting existing primary and derivative data due to validation failure. [2025-09-29T19:49:05.206622] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-09-29T19:49:05.206884] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-09-29T19:49:05.207098] [INFO ] [LOCAL ] MCD: Starting deletion of derivative data. [2025-09-29T19:49:05.207245] [DEBUG] [LOCAL ] MCD: No derivative data file found to delete. [2025-09-29T19:49:05.207436] [INFO ] [MAIN ] Update Progress: 1316/2371 symbols completed. MCD took 48.2s. Estimated remaining: 2h 15m 31s. Rate: 7.8 symbols/min [2025-09-29T19:49:05.411271] [INFO ] [MAIN ] MCS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:49:05.427490] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-29T19:49:05.463939] [DEBUG] [LOCAL ] MCS: Loaded 21454 existing records from primary storage. [2025-09-29T19:49:05.464215] [INFO ] [MAIN ] MCS: Loaded 21454 existing records. [2025-09-29T19:49:05.671191] [WARN ] [MAIN ] MCS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:49:05.671760] [INFO ] [MAIN ] MCS: Wiping existing primary data before full refresh. [2025-09-29T19:49:05.671912] [INFO ] [LOCAL ] MCS: Starting deletion of primary data. [2025-09-29T19:49:05.673265] [DEBUG] [LOCAL ] MCS: Deleted primary data file. [2025-09-29T19:49:05.673333] [INFO ] [MAIN ] MCS: Starting full primary refresh. [2025-09-29T19:49:05.951251] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-05. [2025-09-29T19:49:05.984128] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-29T19:49:06.096366] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-29T19:49:06.133325] [INFO ] [REMOTE ] MCS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:49:06.748107] [INFO ] [REMOTE ] MCS: Fetching primary data for 2024-12. [2025-09-29T19:49:07.548129] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-07. [2025-09-29T19:49:07.914728] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-29T19:49:08.059604] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-29T19:49:08.348118] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-01. [2025-09-29T19:49:08.708509] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-29T19:49:09.148138] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-06. [2025-09-29T19:49:09.373761] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-29T19:49:09.948124] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-02. [2025-09-29T19:49:10.564981] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-29T19:49:10.748166] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-04. [2025-09-29T19:49:10.998404] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-29T19:49:11.524729] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-29T19:49:11.548093] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-07. [2025-09-29T19:49:12.348107] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-08. [2025-09-29T19:49:13.127403] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-29T19:49:13.148118] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-03. [2025-09-29T19:49:13.948130] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-08. [2025-09-29T19:49:14.024385] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-29T19:49:14.358153] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-29T19:49:14.748109] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-09. [2025-09-29T19:49:15.467545] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-29T19:49:15.548082] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-09. [2025-09-29T19:49:16.348121] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-04. [2025-09-29T19:49:16.518303] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-29T19:49:16.526699] [INFO ] [REMOTE ] MCK: Full fetch complete (57385 records). [2025-09-29T19:49:16.526920] [DEBUG] [VALIDATOR ] MCK: Validating primary data. [2025-09-29T19:49:16.940477] [DEBUG] [VALIDATOR ] MCK: All expected trading days are present. [2025-09-29T19:49:16.940632] [DEBUG] [VALIDATOR ] MCK: Primary data validation passed. [2025-09-29T19:49:16.941852] [INFO ] [MAIN ] MCK: Fetched primary data is valid. [2025-09-29T19:49:16.941998] [DEBUG] [LOCAL ] MCK: Saving primary data. [2025-09-29T19:49:16.943951] [DEBUG] [LOCAL ] MCK: Trimmed 57385 records to 39218 (keeping 200 days of data) [2025-09-29T19:49:17.089849] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-29T19:49:17.100974] [INFO ] [REMOTE ] MCO: Full fetch complete (56759 records). [2025-09-29T19:49:17.102201] [DEBUG] [VALIDATOR ] MCO: Validating primary data. [2025-09-29T19:49:17.149882] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-05. [2025-09-29T19:49:17.662474] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-29T19:49:17.668608] [DEBUG] [VALIDATOR ] MCO: All expected trading days are present. [2025-09-29T19:49:17.669149] [DEBUG] [VALIDATOR ] MCO: Primary data validation passed. [2025-09-29T19:49:17.671581] [INFO ] [MAIN ] MCO: Fetched primary data is valid. [2025-09-29T19:49:17.673510] [DEBUG] [LOCAL ] MCO: Saving primary data. [2025-09-29T19:49:17.682265] [DEBUG] [LOCAL ] MCO: Trimmed 56759 records to 39341 (keeping 200 days of data) [2025-09-29T19:49:17.795225] [DEBUG] [LOCAL ] MCK: Primary data saved (39218 records). [2025-09-29T19:49:17.798275] [INFO ] [MAIN ] MCK: Full history saved. [2025-09-29T19:49:17.799370] [INFO ] [MAIN ] Update Progress: 1317/2371 symbols completed. MCK took 41.6s. Estimated remaining: 2h 15m 27s. Rate: 7.8 symbols/min [2025-09-29T19:49:17.948170] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-05. [2025-09-29T19:49:17.965530] [DEBUG] [LOCAL ] MCO: Primary data saved (39341 records). [2025-09-29T19:49:17.965697] [INFO ] [MAIN ] MCO: Full history saved. [2025-09-29T19:49:17.965797] [INFO ] [MAIN ] Update Progress: 1318/2371 symbols completed. MCO took 26.8s. Estimated remaining: 2h 15m 13s. Rate: 7.8 symbols/min [2025-09-29T19:49:18.015015] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-29T19:49:18.748097] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-06. [2025-09-29T19:49:19.067537] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-29T19:49:19.510694] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-29T19:49:19.548110] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-07. [2025-09-29T19:49:20.348122] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-06. [2025-09-29T19:49:20.354945] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-29T19:49:21.148119] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-08. [2025-09-29T19:49:21.464380] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-29T19:49:21.948123] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-07. [2025-09-29T19:49:21.975892] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-29T19:49:22.748122] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-09. [2025-09-29T19:49:23.090718] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-29T19:49:23.304790] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-29T19:49:23.306771] [INFO ] [REMOTE ] MCR: Full fetch complete (14207 records). [2025-09-29T19:49:23.306851] [DEBUG] [VALIDATOR ] MCR: Validating primary data. [2025-09-29T19:49:23.553182] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-08. [2025-09-29T19:49:23.731361] [DEBUG] [VALIDATOR ] MCR: All expected trading days are present. [2025-09-29T19:49:23.731453] [DEBUG] [VALIDATOR ] MCR: Primary data validation passed. [2025-09-29T19:49:23.731845] [INFO ] [MAIN ] MCR: Fetched primary data is valid. [2025-09-29T19:49:23.731912] [DEBUG] [LOCAL ] MCR: Saving primary data. [2025-09-29T19:49:23.732573] [DEBUG] [LOCAL ] MCR: Trimmed 14207 records to 8763 (keeping 200 days of data) [2025-09-29T19:49:23.785703] [DEBUG] [LOCAL ] MCR: Primary data saved (8763 records). [2025-09-29T19:49:23.785855] [INFO ] [MAIN ] MCR: Full history saved. [2025-09-29T19:49:23.785970] [INFO ] [MAIN ] Update Progress: 1319/2371 symbols completed. MCR took 30.1s. Estimated remaining: 2h 15m 4s. Rate: 7.8 symbols/min [2025-09-29T19:49:24.821248] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-29T19:49:24.827435] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-09. [2025-09-29T19:49:26.008836] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-29T19:49:26.013681] [INFO ] [REMOTE ] MCS: Full fetch complete (30358 records). [2025-09-29T19:49:26.013788] [DEBUG] [VALIDATOR ] MCS: Validating primary data. [2025-09-29T19:49:26.404063] [DEBUG] [VALIDATOR ] MCS: All expected trading days are present. [2025-09-29T19:49:26.404160] [DEBUG] [VALIDATOR ] MCS: Primary data validation passed. [2025-09-29T19:49:26.404784] [INFO ] [MAIN ] MCS: Fetched primary data is valid. [2025-09-29T19:49:26.404847] [DEBUG] [LOCAL ] MCS: Saving primary data. [2025-09-29T19:49:26.405606] [DEBUG] [LOCAL ] MCS: Trimmed 30358 records to 20946 (keeping 200 days of data) [2025-09-29T19:49:26.536721] [DEBUG] [LOCAL ] MCS: Primary data saved (20946 records). [2025-09-29T19:49:26.536853] [INFO ] [MAIN ] MCS: Full history saved. [2025-09-29T19:49:26.536935] [INFO ] [MAIN ] Update Progress: 1320/2371 symbols completed. MCS took 21.3s. Estimated remaining: 2h 14m 52s. Rate: 7.8 symbols/min [2025-09-29T19:49:27.076558] [INFO ] [MAIN ] MD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:49:27.306261] [INFO ] [MAIN ] MDST: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:49:27.307220] [INFO ] [MAIN ] MCY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:49:27.309892] [INFO ] [MAIN ] MDT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:49:27.324242] [DEBUG] [LOCAL ] MDST: Loaded 5688 existing records from primary storage. [2025-09-29T19:49:27.324757] [INFO ] [MAIN ] MDST: Loaded 5688 existing records. [2025-09-29T19:49:27.483283] [DEBUG] [LOCAL ] MD: Loaded 39064 existing records from primary storage. [2025-09-29T19:49:27.494338] [INFO ] [MAIN ] MD: Loaded 39064 existing records. [2025-09-29T19:49:27.512160] [DEBUG] [LOCAL ] MCY: Loaded 25345 existing records from primary storage. [2025-09-29T19:49:27.572773] [INFO ] [MAIN ] MCY: Loaded 25345 existing records. [2025-09-29T19:49:27.674783] [WARN ] [MAIN ] MDST: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:49:27.726806] [INFO ] [MAIN ] MDST: Wiping existing primary data before full refresh. [2025-09-29T19:49:27.742540] [INFO ] [LOCAL ] MDST: Starting deletion of primary data. [2025-09-29T19:49:27.783404] [DEBUG] [LOCAL ] MDST: Deleted primary data file. [2025-09-29T19:49:27.813291] [INFO ] [MAIN ] MDST: Starting full primary refresh. [2025-09-29T19:49:27.825549] [DEBUG] [LOCAL ] MDT: Loaded 54458 existing records from primary storage. [2025-09-29T19:49:27.893377] [INFO ] [MAIN ] MDT: Loaded 54458 existing records. [2025-09-29T19:49:28.231908] [WARN ] [MAIN ] MCY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:49:28.269691] [INFO ] [MAIN ] MCY: Wiping existing primary data before full refresh. [2025-09-29T19:49:28.357913] [INFO ] [LOCAL ] MCY: Starting deletion of primary data. [2025-09-29T19:49:28.335967] [WARN ] [MAIN ] MD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:49:28.398511] [DEBUG] [LOCAL ] MCY: Deleted primary data file. [2025-09-29T19:49:28.466888] [INFO ] [MAIN ] MD: Wiping existing primary data before full refresh. [2025-09-29T19:49:28.472275] [INFO ] [LOCAL ] MD: Starting deletion of primary data. [2025-09-29T19:49:28.472208] [INFO ] [MAIN ] MCY: Starting full primary refresh. [2025-09-29T19:49:28.550041] [WARN ] [MAIN ] MDT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:49:28.567516] [INFO ] [MAIN ] MDT: Wiping existing primary data before full refresh. [2025-09-29T19:49:28.562142] [DEBUG] [LOCAL ] MD: Deleted primary data file. [2025-09-29T19:49:28.573527] [INFO ] [LOCAL ] MDT: Starting deletion of primary data. [2025-09-29T19:49:28.573432] [INFO ] [MAIN ] MD: Starting full primary refresh. [2025-09-29T19:49:28.687931] [DEBUG] [LOCAL ] MDT: Deleted primary data file. [2025-09-29T19:49:28.814569] [INFO ] [REMOTE ] MDST: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:49:28.825583] [INFO ] [MAIN ] MDT: Starting full primary refresh. [2025-09-29T19:49:28.851935] [INFO ] [REMOTE ] MDST: Fetching primary data for 2024-12. [2025-09-29T19:49:29.539675] [INFO ] [REMOTE ] MCY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:49:29.596079] [INFO ] [REMOTE ] MCY: Fetching primary data for 2024-12. [2025-09-29T19:49:29.730870] [INFO ] [REMOTE ] MD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:49:29.742845] [INFO ] [REMOTE ] MD: Fetching primary data for 2024-12. [2025-09-29T19:49:29.748239] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-29T19:49:29.772510] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-01. [2025-09-29T19:49:29.829440] [INFO ] [REMOTE ] MDT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:49:29.829815] [INFO ] [REMOTE ] MDT: Fetching primary data for 2024-12. [2025-09-29T19:49:30.433004] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-29T19:49:30.435137] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-02. [2025-09-29T19:49:30.988987] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-29T19:49:30.995150] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-01. [2025-09-29T19:49:31.097663] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-29T19:49:31.099814] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-03. [2025-09-29T19:49:31.305047] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-29T19:49:31.548087] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-01. [2025-09-29T19:49:31.713950] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-29T19:49:31.746833] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-29T19:49:32.255476] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-29T19:49:32.348137] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-01. [2025-09-29T19:49:32.872575] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-29T19:49:33.148151] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-04. [2025-09-29T19:49:33.671117] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-29T19:49:33.948116] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-05. [2025-09-29T19:49:34.294488] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-29T19:49:34.365872] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-29T19:49:34.748159] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-02. [2025-09-29T19:49:35.548116] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-02. [2025-09-29T19:49:36.150067] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-29T19:49:36.348151] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-03. [2025-09-29T19:49:37.148146] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-06. [2025-09-29T19:49:37.284915] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-29T19:49:37.804960] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-29T19:49:37.828072] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-29T19:49:37.948178] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-04. [2025-09-29T19:49:38.748124] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-03. [2025-09-29T19:49:39.463356] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-29T19:49:39.548152] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-02. [2025-09-29T19:49:40.348126] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-05. [2025-09-29T19:49:40.577887] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-29T19:49:40.650313] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-29T19:49:41.148122] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-04. [2025-09-29T19:49:41.855992] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-29T19:49:41.948145] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-06. [2025-09-29T19:49:42.748150] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-03. [2025-09-29T19:49:43.163554] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-29T19:49:43.311958] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-29T19:49:43.548136] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-07. [2025-09-29T19:49:44.178470] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-29T19:49:44.268466] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-29T19:49:44.348158] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-08. [2025-09-29T19:49:44.967574] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-29T19:49:45.148161] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-09. [2025-09-29T19:49:45.948162] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-07. [2025-09-29T19:49:46.035113] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-29T19:49:46.037692] [INFO ] [REMOTE ] MDST: Full fetch complete (8561 records). [2025-09-29T19:49:46.037772] [DEBUG] [VALIDATOR ] MDST: Validating primary data. [2025-09-29T19:49:46.412338] [DEBUG] [VALIDATOR ] MDST: All expected trading days are present. [2025-09-29T19:49:46.412426] [DEBUG] [VALIDATOR ] MDST: Primary data validation passed. [2025-09-29T19:49:46.412680] [INFO ] [MAIN ] MDST: Fetched primary data is valid. [2025-09-29T19:49:46.412799] [DEBUG] [LOCAL ] MDST: Saving primary data. [2025-09-29T19:49:46.413401] [DEBUG] [LOCAL ] MDST: Trimmed 8561 records to 5616 (keeping 200 days of data) [2025-09-29T19:49:46.449473] [DEBUG] [LOCAL ] MDST: Primary data saved (5616 records). [2025-09-29T19:49:46.449615] [INFO ] [MAIN ] MDST: Full history saved. [2025-09-29T19:49:46.449735] [INFO ] [MAIN ] Update Progress: 1321/2371 symbols completed. MDST took 19.9s. Estimated remaining: 2h 14m 54s. Rate: 7.8 symbols/min [2025-09-29T19:49:46.629019] [INFO ] [MAIN ] MDU: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:49:46.683717] [DEBUG] [LOCAL ] MDU: Loaded 48643 existing records from primary storage. [2025-09-29T19:49:46.684080] [INFO ] [MAIN ] MDU: Loaded 48643 existing records. [2025-09-29T19:49:46.753325] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-04. [2025-09-29T19:49:46.883002] [WARN ] [MAIN ] MDU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:49:46.883272] [INFO ] [MAIN ] MDU: Wiping existing primary data before full refresh. [2025-09-29T19:49:46.883321] [INFO ] [LOCAL ] MDU: Starting deletion of primary data. [2025-09-29T19:49:46.883984] [DEBUG] [LOCAL ] MDU: Deleted primary data file. [2025-09-29T19:49:46.884046] [INFO ] [MAIN ] MDU: Starting full primary refresh. [2025-09-29T19:49:47.261162] [INFO ] [REMOTE ] MDU: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:49:47.437974] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-29T19:49:47.548139] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-08. [2025-09-29T19:49:47.708414] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-29T19:49:48.348116] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-05. [2025-09-29T19:49:48.720696] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-29T19:49:49.148129] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-05. [2025-09-29T19:49:49.572899] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-29T19:49:49.948166] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-06. [2025-09-29T19:49:50.748100] [INFO ] [REMOTE ] MDU: Fetching primary data for 2024-12. [2025-09-29T19:49:50.974351] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-29T19:49:51.062132] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-29T19:49:51.548122] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-07. [2025-09-29T19:49:52.348124] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-06. [2025-09-29T19:49:52.427798] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-29T19:49:52.464125] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-29T19:49:53.148227] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-08. [2025-09-29T19:49:53.953284] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-01. [2025-09-29T19:49:53.976527] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-29T19:49:54.240314] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-29T19:49:54.748164] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-07. [2025-09-29T19:49:55.548104] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-09. [2025-09-29T19:49:55.619703] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-29T19:49:56.348108] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-02. [2025-09-29T19:49:56.802795] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-29T19:49:57.102002] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-29T19:49:57.109913] [INFO ] [REMOTE ] MD: Full fetch complete (55165 records). [2025-09-29T19:49:57.110084] [DEBUG] [VALIDATOR ] MD: Validating primary data. [2025-09-29T19:49:57.156260] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-08. [2025-09-29T19:49:57.511520] [DEBUG] [VALIDATOR ] MD: All expected trading days are present. [2025-09-29T19:49:57.511628] [DEBUG] [VALIDATOR ] MD: Primary data validation passed. [2025-09-29T19:49:57.512547] [INFO ] [MAIN ] MD: Fetched primary data is valid. [2025-09-29T19:49:57.512595] [DEBUG] [LOCAL ] MD: Saving primary data. [2025-09-29T19:49:57.513774] [DEBUG] [LOCAL ] MD: Trimmed 55165 records to 38420 (keeping 200 days of data) [2025-09-29T19:49:57.745438] [DEBUG] [LOCAL ] MD: Primary data saved (38420 records). [2025-09-29T19:49:57.745587] [INFO ] [MAIN ] MD: Full history saved. [2025-09-29T19:49:57.745695] [INFO ] [MAIN ] Update Progress: 1322/2371 symbols completed. MD took 31.2s. Estimated remaining: 2h 14m 50s. Rate: 7.8 symbols/min [2025-09-29T19:49:57.948353] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-09. [2025-09-29T19:49:57.968046] [INFO ] [MAIN ] MDV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:49:58.003728] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-29T19:49:58.020879] [DEBUG] [LOCAL ] MDV: Loaded 8733 existing records from primary storage. [2025-09-29T19:49:58.021217] [INFO ] [MAIN ] MDV: Loaded 8733 existing records. [2025-09-29T19:49:58.226779] [WARN ] [MAIN ] MDV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:49:58.227082] [INFO ] [MAIN ] MDV: Wiping existing primary data before full refresh. [2025-09-29T19:49:58.227140] [INFO ] [LOCAL ] MDV: Starting deletion of primary data. [2025-09-29T19:49:58.227423] [DEBUG] [LOCAL ] MDV: Deleted primary data file. [2025-09-29T19:49:58.227481] [INFO ] [MAIN ] MDV: Starting full primary refresh. [2025-09-29T19:49:58.611091] [INFO ] [REMOTE ] MDV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:49:58.748084] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-03. [2025-09-29T19:49:59.215265] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-29T19:49:59.242404] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-29T19:49:59.248464] [INFO ] [REMOTE ] MCY: Full fetch complete (41555 records). [2025-09-29T19:49:59.248703] [DEBUG] [VALIDATOR ] MCY: Validating primary data. [2025-09-29T19:49:59.553342] [INFO ] [REMOTE ] MDV: Fetching primary data for 2024-12. [2025-09-29T19:49:59.656459] [DEBUG] [VALIDATOR ] MCY: All expected trading days are present. [2025-09-29T19:49:59.656551] [DEBUG] [VALIDATOR ] MCY: Primary data validation passed. [2025-09-29T19:49:59.657493] [INFO ] [MAIN ] MCY: Fetched primary data is valid. [2025-09-29T19:49:59.657578] [DEBUG] [LOCAL ] MCY: Saving primary data. [2025-09-29T19:49:59.658802] [DEBUG] [LOCAL ] MCY: Trimmed 41555 records to 24642 (keeping 200 days of data) [2025-09-29T19:49:59.817931] [DEBUG] [LOCAL ] MCY: Primary data saved (24642 records). [2025-09-29T19:49:59.818064] [INFO ] [MAIN ] MCY: Full history saved. [2025-09-29T19:49:59.818147] [INFO ] [MAIN ] Update Progress: 1323/2371 symbols completed. MCY took 33.3s. Estimated remaining: 2h 14m 37s. Rate: 7.8 symbols/min [2025-09-29T19:49:59.996435] [INFO ] [MAIN ] MEC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:50:00.018341] [DEBUG] [LOCAL ] MEC: Loaded 16695 existing records from primary storage. [2025-09-29T19:50:00.018579] [INFO ] [MAIN ] MEC: Loaded 16695 existing records. [2025-09-29T19:50:00.209994] [WARN ] [MAIN ] MEC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:50:00.210272] [INFO ] [MAIN ] MEC: Wiping existing primary data before full refresh. [2025-09-29T19:50:00.210362] [INFO ] [LOCAL ] MEC: Starting deletion of primary data. [2025-09-29T19:50:00.210755] [DEBUG] [LOCAL ] MEC: Deleted primary data file. [2025-09-29T19:50:00.210816] [INFO ] [MAIN ] MEC: Starting full primary refresh. [2025-09-29T19:50:00.356974] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-09. [2025-09-29T19:50:00.341415] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-29T19:50:00.593758] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-29T19:50:00.693767] [INFO ] [REMOTE ] MEC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:50:01.148100] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-01. [2025-09-29T19:50:01.818024] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-29T19:50:01.948135] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-02. [2025-09-29T19:50:02.533369] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-29T19:50:02.546233] [INFO ] [REMOTE ] MDT: Full fetch complete (77699 records). [2025-09-29T19:50:02.546424] [DEBUG] [VALIDATOR ] MDT: Validating primary data. [2025-09-29T19:50:02.718976] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-29T19:50:02.753260] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-04. [2025-09-29T19:50:03.066820] [DEBUG] [VALIDATOR ] MDT: All expected trading days are present. [2025-09-29T19:50:03.066921] [DEBUG] [VALIDATOR ] MDT: Primary data validation passed. [2025-09-29T19:50:03.068192] [INFO ] [MAIN ] MDT: Fetched primary data is valid. [2025-09-29T19:50:03.068291] [DEBUG] [LOCAL ] MDT: Saving primary data. [2025-09-29T19:50:03.069985] [DEBUG] [LOCAL ] MDT: Trimmed 77699 records to 53678 (keeping 200 days of data) [2025-09-29T19:50:03.455707] [DEBUG] [LOCAL ] MDT: Primary data saved (53678 records). [2025-09-29T19:50:03.455933] [INFO ] [MAIN ] MDT: Full history saved. [2025-09-29T19:50:03.456083] [INFO ] [MAIN ] Update Progress: 1324/2371 symbols completed. MDT took 36.9s. Estimated remaining: 2h 14m 26s. Rate: 7.8 symbols/min [2025-09-29T19:50:03.553236] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-03. [2025-09-29T19:50:03.640756] [INFO ] [MAIN ] MED: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:50:03.667278] [DEBUG] [LOCAL ] MED: Loaded 22043 existing records from primary storage. [2025-09-29T19:50:03.667550] [INFO ] [MAIN ] MED: Loaded 22043 existing records. [2025-09-29T19:50:03.852075] [WARN ] [MAIN ] MED: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:50:03.852309] [INFO ] [MAIN ] MED: Wiping existing primary data before full refresh. [2025-09-29T19:50:03.852360] [INFO ] [LOCAL ] MED: Starting deletion of primary data. [2025-09-29T19:50:03.852697] [DEBUG] [LOCAL ] MED: Deleted primary data file. [2025-09-29T19:50:03.852758] [INFO ] [MAIN ] MED: Starting full primary refresh. [2025-09-29T19:50:04.247979] [INFO ] [REMOTE ] MED: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:50:04.348094] [INFO ] [REMOTE ] MEC: Fetching primary data for 2024-12. [2025-09-29T19:50:04.454596] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-29T19:50:04.863804] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-29T19:50:05.148144] [INFO ] [REMOTE ] MED: Fetching primary data for 2024-12. [2025-09-29T19:50:05.324213] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-29T19:50:05.948148] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-01. [2025-09-29T19:50:06.315490] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-29T19:50:06.748123] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-05. [2025-09-29T19:50:06.842617] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-29T19:50:07.548101] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-02. [2025-09-29T19:50:08.318196] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-29T19:50:08.348089] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-03. [2025-09-29T19:50:08.516391] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-29T19:50:09.148125] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-06. [2025-09-29T19:50:09.340198] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-29T19:50:09.948113] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-04. [2025-09-29T19:50:10.739631] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-29T19:50:10.748916] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-04. [2025-09-29T19:50:10.883265] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-29T19:50:11.513811] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-29T19:50:11.548137] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-01. [2025-09-29T19:50:12.348151] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-05. [2025-09-29T19:50:12.656607] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-29T19:50:13.148091] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-05. [2025-09-29T19:50:13.342614] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-29T19:50:13.699162] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-29T19:50:13.948117] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-02. [2025-09-29T19:50:14.748090] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-07. [2025-09-29T19:50:15.126432] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-29T19:50:15.548099] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-03. [2025-09-29T19:50:16.348154] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-06. [2025-09-29T19:50:16.396209] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-29T19:50:16.770742] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-29T19:50:17.148104] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-08. [2025-09-29T19:50:17.332012] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-29T19:50:17.948119] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-04. [2025-09-29T19:50:18.748098] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-07. [2025-09-29T19:50:18.872058] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-29T19:50:19.185154] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-29T19:50:19.548114] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-05. [2025-09-29T19:50:19.873164] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-29T19:50:20.348127] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-06. [2025-09-29T19:50:20.734856] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-29T19:50:21.149703] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-06. [2025-09-29T19:50:21.154943] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-29T19:50:21.948105] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-07. [2025-09-29T19:50:22.278947] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-29T19:50:22.748093] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-09. [2025-09-29T19:50:22.772003] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-29T19:50:23.548124] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-07. [2025-09-29T19:50:24.348103] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-08. [2025-09-29T19:50:24.630317] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-29T19:50:24.640811] [INFO ] [REMOTE ] MDU: Full fetch complete (70328 records). [2025-09-29T19:50:24.641011] [DEBUG] [VALIDATOR ] MDU: Validating primary data. [2025-09-29T19:50:24.862963] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-29T19:50:25.117567] [DEBUG] [VALIDATOR ] MDU: All expected trading days are present. [2025-09-29T19:50:25.117762] [DEBUG] [VALIDATOR ] MDU: Primary data validation passed. [2025-09-29T19:50:25.118881] [INFO ] [MAIN ] MDU: Fetched primary data is valid. [2025-09-29T19:50:25.119044] [DEBUG] [LOCAL ] MDU: Saving primary data. [2025-09-29T19:50:25.121536] [DEBUG] [LOCAL ] MDU: Trimmed 70328 records to 47900 (keeping 200 days of data) [2025-09-29T19:50:25.186725] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-08. [2025-09-29T19:50:25.379107] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-29T19:50:25.491971] [DEBUG] [LOCAL ] MDU: Primary data saved (47900 records). [2025-09-29T19:50:25.492215] [INFO ] [MAIN ] MDU: Full history saved. [2025-09-29T19:50:25.492411] [INFO ] [MAIN ] Update Progress: 1325/2371 symbols completed. MDU took 39.0s. Estimated remaining: 2h 14m 30s. Rate: 7.8 symbols/min [2025-09-29T19:50:25.660988] [INFO ] [MAIN ] MEG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:50:25.706134] [DEBUG] [LOCAL ] MEG: Loaded 32426 existing records from primary storage. [2025-09-29T19:50:25.706595] [INFO ] [MAIN ] MEG: Loaded 32426 existing records. [2025-09-29T19:50:25.906072] [WARN ] [MAIN ] MEG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:50:25.906361] [INFO ] [MAIN ] MEG: Wiping existing primary data before full refresh. [2025-09-29T19:50:25.906424] [INFO ] [LOCAL ] MEG: Starting deletion of primary data. [2025-09-29T19:50:25.906833] [DEBUG] [LOCAL ] MEG: Deleted primary data file. [2025-09-29T19:50:25.906895] [INFO ] [MAIN ] MEG: Starting full primary refresh. [2025-09-29T19:50:25.953298] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-09. [2025-09-29T19:50:26.293895] [INFO ] [REMOTE ] MEG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:50:26.311125] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-29T19:50:26.748137] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-09. [2025-09-29T19:50:26.884119] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-29T19:50:26.887975] [INFO ] [REMOTE ] MEC: Full fetch complete (22757 records). [2025-09-29T19:50:26.888065] [DEBUG] [VALIDATOR ] MEC: Validating primary data. [2025-09-29T19:50:27.275232] [DEBUG] [VALIDATOR ] MEC: All expected trading days are present. [2025-09-29T19:50:27.275382] [DEBUG] [VALIDATOR ] MEC: Primary data validation passed. [2025-09-29T19:50:27.275905] [INFO ] [MAIN ] MEC: Fetched primary data is valid. [2025-09-29T19:50:27.275971] [DEBUG] [LOCAL ] MEC: Saving primary data. [2025-09-29T19:50:27.276767] [DEBUG] [LOCAL ] MEC: Trimmed 22757 records to 16296 (keeping 200 days of data) [2025-09-29T19:50:27.388775] [DEBUG] [LOCAL ] MEC: Primary data saved (16296 records). [2025-09-29T19:50:27.388948] [INFO ] [MAIN ] MEC: Full history saved. [2025-09-29T19:50:27.389073] [INFO ] [MAIN ] Update Progress: 1326/2371 symbols completed. MEC took 27.6s. Estimated remaining: 2h 14m 18s. Rate: 7.8 symbols/min [2025-09-29T19:50:27.565032] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-08. [2025-09-29T19:50:27.568542] [INFO ] [MAIN ] MEGI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:50:27.585436] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-29T19:50:27.591019] [INFO ] [REMOTE ] MED: Full fetch complete (32746 records). [2025-09-29T19:50:27.591167] [DEBUG] [VALIDATOR ] MED: Validating primary data. [2025-09-29T19:50:27.730125] [DEBUG] [LOCAL ] MEGI: Loaded 20630 existing records from primary storage. [2025-09-29T19:50:27.745882] [INFO ] [MAIN ] MEGI: Loaded 20630 existing records. [2025-09-29T19:50:28.120123] [WARN ] [MAIN ] MEGI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:50:28.131291] [INFO ] [MAIN ] MEGI: Wiping existing primary data before full refresh. [2025-09-29T19:50:28.136814] [INFO ] [LOCAL ] MEGI: Starting deletion of primary data. [2025-09-29T19:50:28.142342] [DEBUG] [LOCAL ] MEGI: Deleted primary data file. [2025-09-29T19:50:28.152688] [INFO ] [MAIN ] MEGI: Starting full primary refresh. [2025-09-29T19:50:28.291321] [DEBUG] [VALIDATOR ] MED: All expected trading days are present. [2025-09-29T19:50:28.339898] [DEBUG] [VALIDATOR ] MED: Primary data validation passed. [2025-09-29T19:50:28.340919] [INFO ] [MAIN ] MED: Fetched primary data is valid. [2025-09-29T19:50:28.345232] [DEBUG] [LOCAL ] MED: Saving primary data. [2025-09-29T19:50:28.351309] [INFO ] [REMOTE ] MEG: Fetching primary data for 2024-12. [2025-09-29T19:50:28.401267] [DEBUG] [LOCAL ] MED: Trimmed 32746 records to 21598 (keeping 200 days of data) [2025-09-29T19:50:28.414290] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-29T19:50:28.744714] [INFO ] [REMOTE ] MEGI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:50:28.784629] [DEBUG] [LOCAL ] MED: Primary data saved (21598 records). [2025-09-29T19:50:28.784789] [INFO ] [MAIN ] MED: Full history saved. [2025-09-29T19:50:28.784876] [INFO ] [MAIN ] Update Progress: 1327/2371 symbols completed. MED took 25.3s. Estimated remaining: 2h 14m 5s. Rate: 7.8 symbols/min [2025-09-29T19:50:28.956700] [INFO ] [MAIN ] MEI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:50:28.996553] [DEBUG] [LOCAL ] MEI: Loaded 32933 existing records from primary storage. [2025-09-29T19:50:28.996888] [INFO ] [MAIN ] MEI: Loaded 32933 existing records. [2025-09-29T19:50:29.160186] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-09. [2025-09-29T19:50:29.184725] [WARN ] [MAIN ] MEI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:50:29.185028] [INFO ] [MAIN ] MEI: Wiping existing primary data before full refresh. [2025-09-29T19:50:29.185088] [INFO ] [LOCAL ] MEI: Starting deletion of primary data. [2025-09-29T19:50:29.185537] [DEBUG] [LOCAL ] MEI: Deleted primary data file. [2025-09-29T19:50:29.185629] [INFO ] [MAIN ] MEI: Starting full primary refresh. [2025-09-29T19:50:29.642610] [INFO ] [REMOTE ] MEI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:50:29.862441] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-29T19:50:29.948131] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2024-12. [2025-09-29T19:50:29.969342] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-29T19:50:29.971167] [INFO ] [REMOTE ] MDV: Full fetch complete (11588 records). [2025-09-29T19:50:29.971244] [DEBUG] [VALIDATOR ] MDV: Validating primary data. [2025-09-29T19:50:30.350919] [DEBUG] [VALIDATOR ] MDV: All expected trading days are present. [2025-09-29T19:50:30.351018] [DEBUG] [VALIDATOR ] MDV: Primary data validation passed. [2025-09-29T19:50:30.351336] [INFO ] [MAIN ] MDV: Fetched primary data is valid. [2025-09-29T19:50:30.351379] [DEBUG] [LOCAL ] MDV: Saving primary data. [2025-09-29T19:50:30.351922] [DEBUG] [LOCAL ] MDV: Trimmed 11588 records to 8553 (keeping 200 days of data) [2025-09-29T19:50:30.410035] [DEBUG] [LOCAL ] MDV: Primary data saved (8553 records). [2025-09-29T19:50:30.410179] [INFO ] [MAIN ] MDV: Full history saved. [2025-09-29T19:50:30.410294] [INFO ] [MAIN ] Update Progress: 1328/2371 symbols completed. MDV took 32.7s. Estimated remaining: 2h 13m 53s. Rate: 7.8 symbols/min [2025-09-29T19:50:30.595211] [INFO ] [MAIN ] MET: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:50:30.664252] [DEBUG] [LOCAL ] MET: Loaded 54089 existing records from primary storage. [2025-09-29T19:50:30.664623] [INFO ] [MAIN ] MET: Loaded 54089 existing records. [2025-09-29T19:50:30.753277] [INFO ] [REMOTE ] MEI: Fetching primary data for 2024-12. [2025-09-29T19:50:30.875127] [WARN ] [MAIN ] MET: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:50:30.875479] [INFO ] [MAIN ] MET: Wiping existing primary data before full refresh. [2025-09-29T19:50:30.875607] [INFO ] [LOCAL ] MET: Starting deletion of primary data. [2025-09-29T19:50:30.876149] [DEBUG] [LOCAL ] MET: Deleted primary data file. [2025-09-29T19:50:30.876210] [INFO ] [MAIN ] MET: Starting full primary refresh. [2025-09-29T19:50:31.276324] [INFO ] [REMOTE ] MET: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:50:31.288321] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-29T19:50:31.548135] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-01. [2025-09-29T19:50:32.207919] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-29T19:50:32.348085] [INFO ] [REMOTE ] MET: Fetching primary data for 2024-12. [2025-09-29T19:50:32.590889] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-29T19:50:33.148125] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-02. [2025-09-29T19:50:33.948103] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-01. [2025-09-29T19:50:34.036740] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-29T19:50:34.091226] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-29T19:50:34.748122] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-03. [2025-09-29T19:50:35.370865] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-29T19:50:35.548115] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-02. [2025-09-29T19:50:35.808368] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-29T19:50:36.348151] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-01. [2025-09-29T19:50:36.865869] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-29T19:50:37.148160] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-04. [2025-09-29T19:50:37.266978] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-29T19:50:37.948105] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-03. [2025-09-29T19:50:38.175804] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-29T19:50:38.748121] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-01. [2025-09-29T19:50:39.415262] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-29T19:50:39.548104] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-02. [2025-09-29T19:50:40.348092] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-05. [2025-09-29T19:50:40.409041] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-29T19:50:40.688365] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-29T19:50:41.148097] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-02. [2025-09-29T19:50:41.444890] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-29T19:50:41.948124] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-06. [2025-09-29T19:50:42.753226] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-03. [2025-09-29T19:50:42.768328] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-29T19:50:42.998121] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-29T19:50:43.548097] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-03. [2025-09-29T19:50:44.221383] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-29T19:50:44.348182] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-04. [2025-09-29T19:50:45.148154] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-04. [2025-09-29T19:50:45.422903] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-29T19:50:45.911585] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-29T19:50:45.948142] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-07. [2025-09-29T19:50:46.529719] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-29T19:50:46.748224] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-04. [2025-09-29T19:50:47.165233] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-29T19:50:47.548136] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-05. [2025-09-29T19:50:48.348131] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-08. [2025-09-29T19:50:48.608840] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-29T19:50:48.675728] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-29T19:50:49.148131] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-06. [2025-09-29T19:50:49.433797] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-29T19:50:49.948318] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-09. [2025-09-29T19:50:50.400371] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-29T19:50:50.748127] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-05. [2025-09-29T19:50:51.059932] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-29T19:50:51.066183] [INFO ] [REMOTE ] MEGI: Full fetch complete (30547 records). [2025-09-29T19:50:51.066293] [DEBUG] [VALIDATOR ] MEGI: Validating primary data. [2025-09-29T19:50:51.478795] [DEBUG] [VALIDATOR ] MEGI: All expected trading days are present. [2025-09-29T19:50:51.478881] [DEBUG] [VALIDATOR ] MEGI: Primary data validation passed. [2025-09-29T19:50:51.479555] [INFO ] [MAIN ] MEGI: Fetched primary data is valid. [2025-09-29T19:50:51.479598] [DEBUG] [LOCAL ] MEGI: Saving primary data. [2025-09-29T19:50:51.480538] [DEBUG] [LOCAL ] MEGI: Trimmed 30547 records to 20146 (keeping 200 days of data) [2025-09-29T19:50:51.569953] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-07. [2025-09-29T19:50:51.615311] [DEBUG] [LOCAL ] MEGI: Primary data saved (20146 records). [2025-09-29T19:50:51.615449] [INFO ] [MAIN ] MEGI: Full history saved. [2025-09-29T19:50:51.615531] [INFO ] [MAIN ] Update Progress: 1329/2371 symbols completed. MEGI took 24.2s. Estimated remaining: 2h 13m 55s. Rate: 7.8 symbols/min [2025-09-29T19:50:51.806490] [INFO ] [MAIN ] MFA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:50:51.866029] [DEBUG] [LOCAL ] MFA: Loaded 46019 existing records from primary storage. [2025-09-29T19:50:51.866384] [INFO ] [MAIN ] MFA: Loaded 46019 existing records. [2025-09-29T19:50:52.068514] [WARN ] [MAIN ] MFA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:50:52.068859] [INFO ] [MAIN ] MFA: Wiping existing primary data before full refresh. [2025-09-29T19:50:52.068970] [INFO ] [LOCAL ] MFA: Starting deletion of primary data. [2025-09-29T19:50:52.069548] [DEBUG] [LOCAL ] MFA: Deleted primary data file. [2025-09-29T19:50:52.069612] [INFO ] [MAIN ] MFA: Starting full primary refresh. [2025-09-29T19:50:52.197102] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-29T19:50:52.353271] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-06. [2025-09-29T19:50:52.476381] [INFO ] [REMOTE ] MFA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:50:53.153735] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-05. [2025-09-29T19:50:53.175114] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-29T19:50:53.656336] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-29T19:50:53.948138] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-07. [2025-09-29T19:50:54.748102] [INFO ] [REMOTE ] MFA: Fetching primary data for 2024-12. [2025-09-29T19:50:55.069901] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-29T19:50:55.098875] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-29T19:50:55.548102] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-08. [2025-09-29T19:50:56.348124] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-06. [2025-09-29T19:50:56.443267] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-29T19:50:56.939060] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-29T19:50:57.148115] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-01. [2025-09-29T19:50:57.863779] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-29T19:50:57.948127] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-07. [2025-09-29T19:50:58.703911] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-29T19:50:58.748108] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-09. [2025-09-29T19:50:59.548099] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-02. [2025-09-29T19:50:59.749308] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-29T19:50:59.800924] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-29T19:50:59.808496] [INFO ] [REMOTE ] MEG: Full fetch complete (48060 records). [2025-09-29T19:50:59.808621] [DEBUG] [VALIDATOR ] MEG: Validating primary data. [2025-09-29T19:51:00.207218] [DEBUG] [VALIDATOR ] MEG: All expected trading days are present. [2025-09-29T19:51:00.207306] [DEBUG] [VALIDATOR ] MEG: Primary data validation passed. [2025-09-29T19:51:00.208285] [INFO ] [MAIN ] MEG: Fetched primary data is valid. [2025-09-29T19:51:00.208373] [DEBUG] [LOCAL ] MEG: Saving primary data. [2025-09-29T19:51:00.209499] [DEBUG] [LOCAL ] MEG: Trimmed 48060 records to 31838 (keeping 200 days of data) [2025-09-29T19:51:00.371898] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-08. [2025-09-29T19:51:00.417842] [DEBUG] [LOCAL ] MEG: Primary data saved (31838 records). [2025-09-29T19:51:00.417991] [INFO ] [MAIN ] MEG: Full history saved. [2025-09-29T19:51:00.418089] [INFO ] [MAIN ] Update Progress: 1330/2371 symbols completed. MEG took 34.9s. Estimated remaining: 2h 13m 49s. Rate: 7.8 symbols/min [2025-09-29T19:51:00.603215] [INFO ] [MAIN ] MFAN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:51:00.611904] [DEBUG] [LOCAL ] MFAN: Loaded 4331 existing records from primary storage. [2025-09-29T19:51:00.612128] [INFO ] [MAIN ] MFAN: Loaded 4331 existing records. [2025-09-29T19:51:00.809200] [WARN ] [MAIN ] MFAN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:51:00.809743] [INFO ] [MAIN ] MFAN: Wiping existing primary data before full refresh. [2025-09-29T19:51:00.809807] [INFO ] [LOCAL ] MFAN: Starting deletion of primary data. [2025-09-29T19:51:00.810254] [DEBUG] [LOCAL ] MFAN: Deleted primary data file. [2025-09-29T19:51:00.810315] [INFO ] [MAIN ] MFAN: Starting full primary refresh. [2025-09-29T19:51:01.150893] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-08. [2025-09-29T19:51:01.214765] [INFO ] [REMOTE ] MFAN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:51:01.243327] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-29T19:51:01.860416] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-29T19:51:01.948157] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-03. [2025-09-29T19:51:02.748147] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-09. [2025-09-29T19:51:03.130789] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-29T19:51:03.548102] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2024-12. [2025-09-29T19:51:03.611546] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-29T19:51:04.011676] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-29T19:51:04.014702] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-29T19:51:04.022407] [INFO ] [REMOTE ] MEI: Full fetch complete (45491 records). [2025-09-29T19:51:04.022594] [DEBUG] [VALIDATOR ] MEI: Validating primary data. [2025-09-29T19:51:04.353229] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-01. [2025-09-29T19:51:04.422197] [DEBUG] [VALIDATOR ] MEI: All expected trading days are present. [2025-09-29T19:51:04.422294] [DEBUG] [VALIDATOR ] MEI: Primary data validation passed. [2025-09-29T19:51:04.423153] [INFO ] [MAIN ] MEI: Fetched primary data is valid. [2025-09-29T19:51:04.423231] [DEBUG] [LOCAL ] MEI: Saving primary data. [2025-09-29T19:51:04.424450] [DEBUG] [LOCAL ] MEI: Trimmed 45491 records to 32162 (keeping 200 days of data) [2025-09-29T19:51:04.623467] [DEBUG] [LOCAL ] MEI: Primary data saved (32162 records). [2025-09-29T19:51:04.623692] [INFO ] [MAIN ] MEI: Full history saved. [2025-09-29T19:51:04.623843] [INFO ] [MAIN ] Update Progress: 1331/2371 symbols completed. MEI took 35.8s. Estimated remaining: 2h 13m 38s. Rate: 7.8 symbols/min [2025-09-29T19:51:04.804005] [INFO ] [MAIN ] MFAO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:51:04.811012] [DEBUG] [LOCAL ] MFAO: Loaded 3853 existing records from primary storage. [2025-09-29T19:51:04.811268] [INFO ] [MAIN ] MFAO: Loaded 3853 existing records. [2025-09-29T19:51:05.036521] [WARN ] [MAIN ] MFAO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:51:05.040931] [INFO ] [MAIN ] MFAO: Wiping existing primary data before full refresh. [2025-09-29T19:51:05.040768] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-29T19:51:05.041038] [INFO ] [LOCAL ] MFAO: Starting deletion of primary data. [2025-09-29T19:51:05.042899] [DEBUG] [LOCAL ] MFAO: Deleted primary data file. [2025-09-29T19:51:05.042965] [INFO ] [MAIN ] MFAO: Starting full primary refresh. [2025-09-29T19:51:05.150005] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-02. [2025-09-29T19:51:05.432545] [INFO ] [REMOTE ] MFAO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:51:05.657978] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-29T19:51:05.948118] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2024-12. [2025-09-29T19:51:06.481582] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-29T19:51:06.748114] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-09. [2025-09-29T19:51:07.548122] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-04. [2025-09-29T19:51:08.348099] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-03. [2025-09-29T19:51:08.703783] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-29T19:51:08.715122] [INFO ] [REMOTE ] MET: Full fetch complete (77117 records). [2025-09-29T19:51:08.715273] [DEBUG] [VALIDATOR ] MET: Validating primary data. [2025-09-29T19:51:09.064795] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-29T19:51:09.149048] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-01. [2025-09-29T19:51:09.170264] [DEBUG] [VALIDATOR ] MET: All expected trading days are present. [2025-09-29T19:51:09.171980] [DEBUG] [VALIDATOR ] MET: Primary data validation passed. [2025-09-29T19:51:09.173307] [INFO ] [MAIN ] MET: Fetched primary data is valid. [2025-09-29T19:51:09.173544] [DEBUG] [LOCAL ] MET: Saving primary data. [2025-09-29T19:51:09.175568] [DEBUG] [LOCAL ] MET: Trimmed 77117 records to 53311 (keeping 200 days of data) [2025-09-29T19:51:09.315182] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-29T19:51:09.572186] [DEBUG] [LOCAL ] MET: Primary data saved (53311 records). [2025-09-29T19:51:09.572344] [INFO ] [MAIN ] MET: Full history saved. [2025-09-29T19:51:09.572436] [INFO ] [MAIN ] Update Progress: 1332/2371 symbols completed. MET took 39.2s. Estimated remaining: 2h 13m 28s. Rate: 7.8 symbols/min [2025-09-29T19:51:09.759128] [INFO ] [MAIN ] MFC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:51:09.774035] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-29T19:51:09.818060] [DEBUG] [LOCAL ] MFC: Loaded 52000 existing records from primary storage. [2025-09-29T19:51:09.818429] [INFO ] [MAIN ] MFC: Loaded 52000 existing records. [2025-09-29T19:51:09.960366] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-05. [2025-09-29T19:51:10.009933] [WARN ] [MAIN ] MFC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:51:10.010136] [INFO ] [MAIN ] MFC: Wiping existing primary data before full refresh. [2025-09-29T19:51:10.010186] [INFO ] [LOCAL ] MFC: Starting deletion of primary data. [2025-09-29T19:51:10.010782] [DEBUG] [LOCAL ] MFC: Deleted primary data file. [2025-09-29T19:51:10.010843] [INFO ] [MAIN ] MFC: Starting full primary refresh. [2025-09-29T19:51:10.397594] [INFO ] [REMOTE ] MFC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:51:10.748102] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-04. [2025-09-29T19:51:11.368016] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-29T19:51:11.548088] [INFO ] [REMOTE ] MFC: Fetching primary data for 2024-12. [2025-09-29T19:51:11.722104] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-29T19:51:12.348162] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-05. [2025-09-29T19:51:12.966429] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-29T19:51:12.997661] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-29T19:51:13.148132] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-01. [2025-09-29T19:51:13.948118] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-06. [2025-09-29T19:51:14.748169] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-02. [2025-09-29T19:51:14.910909] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-29T19:51:15.061702] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-29T19:51:15.326317] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-29T19:51:15.548118] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-02. [2025-09-29T19:51:16.348126] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-06. [2025-09-29T19:51:16.754406] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-29T19:51:17.157228] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-07. [2025-09-29T19:51:17.163245] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-29T19:51:17.885478] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-29T19:51:17.948087] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-08. [2025-09-29T19:51:18.362526] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-29T19:51:18.748116] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-07. [2025-09-29T19:51:19.548107] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-09. [2025-09-29T19:51:20.344545] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-29T19:51:20.346022] [INFO ] [REMOTE ] MFAN: Full fetch complete (5615 records). [2025-09-29T19:51:20.346120] [DEBUG] [VALIDATOR ] MFAN: Validating primary data. [2025-09-29T19:51:20.357985] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-03. [2025-09-29T19:51:20.577215] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-29T19:51:20.802955] [DEBUG] [VALIDATOR ] MFAN: All expected trading days are present. [2025-09-29T19:51:20.803100] [DEBUG] [VALIDATOR ] MFAN: Primary data validation passed. [2025-09-29T19:51:20.803297] [INFO ] [MAIN ] MFAN: Fetched primary data is valid. [2025-09-29T19:51:20.803404] [DEBUG] [LOCAL ] MFAN: Saving primary data. [2025-09-29T19:51:20.803883] [DEBUG] [LOCAL ] MFAN: Trimmed 5615 records to 4198 (keeping 200 days of data) [2025-09-29T19:51:20.830181] [DEBUG] [LOCAL ] MFAN: Primary data saved (4198 records). [2025-09-29T19:51:20.830303] [INFO ] [MAIN ] MFAN: Full history saved. [2025-09-29T19:51:20.830388] [INFO ] [MAIN ] Update Progress: 1333/2371 symbols completed. MFAN took 20.4s. Estimated remaining: 2h 13m 23s. Rate: 7.8 symbols/min [2025-09-29T19:51:21.002937] [INFO ] [MAIN ] MFG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:51:21.053259] [DEBUG] [LOCAL ] MFG: Loaded 49748 existing records from primary storage. [2025-09-29T19:51:21.053567] [INFO ] [MAIN ] MFG: Loaded 49748 existing records. [2025-09-29T19:51:21.153255] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-08. [2025-09-29T19:51:21.241770] [WARN ] [MAIN ] MFG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:51:21.242063] [INFO ] [MAIN ] MFG: Wiping existing primary data before full refresh. [2025-09-29T19:51:21.242120] [INFO ] [LOCAL ] MFG: Starting deletion of primary data. [2025-09-29T19:51:21.242528] [DEBUG] [LOCAL ] MFG: Deleted primary data file. [2025-09-29T19:51:21.242588] [INFO ] [MAIN ] MFG: Starting full primary refresh. [2025-09-29T19:51:21.629917] [INFO ] [REMOTE ] MFG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:51:21.948113] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-03. [2025-09-29T19:51:22.167708] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-29T19:51:22.409952] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-29T19:51:22.739509] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-29T19:51:22.749114] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-04. [2025-09-29T19:51:23.548143] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-04. [2025-09-29T19:51:24.174151] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-29T19:51:24.348126] [INFO ] [REMOTE ] MFG: Fetching primary data for 2024-12. [2025-09-29T19:51:24.573224] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-29T19:51:25.148118] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-05. [2025-09-29T19:51:25.719208] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-29T19:51:25.810498] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-29T19:51:25.948162] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-09. [2025-09-29T19:51:26.748093] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-05. [2025-09-29T19:51:27.548122] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-01. [2025-09-29T19:51:27.785470] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-29T19:51:27.796344] [INFO ] [REMOTE ] MFA: Full fetch complete (65062 records). [2025-09-29T19:51:27.796492] [DEBUG] [VALIDATOR ] MFA: Validating primary data. [2025-09-29T19:51:28.282940] [DEBUG] [VALIDATOR ] MFA: All expected trading days are present. [2025-09-29T19:51:28.283158] [DEBUG] [VALIDATOR ] MFA: Primary data validation passed. [2025-09-29T19:51:28.284417] [INFO ] [MAIN ] MFA: Fetched primary data is valid. [2025-09-29T19:51:28.284514] [DEBUG] [LOCAL ] MFA: Saving primary data. [2025-09-29T19:51:28.286187] [DEBUG] [LOCAL ] MFA: Trimmed 65062 records to 45387 (keeping 200 days of data) [2025-09-29T19:51:28.349105] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-06. [2025-09-29T19:51:28.383340] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-29T19:51:28.608638] [DEBUG] [LOCAL ] MFA: Primary data saved (45387 records). [2025-09-29T19:51:28.608806] [INFO ] [MAIN ] MFA: Full history saved. [2025-09-29T19:51:28.608912] [INFO ] [MAIN ] Update Progress: 1334/2371 symbols completed. MFA took 37.0s. Estimated remaining: 2h 13m 16s. Rate: 7.8 symbols/min [2025-09-29T19:51:28.789240] [INFO ] [MAIN ] MFM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:51:28.806518] [DEBUG] [LOCAL ] MFM: Loaded 14390 existing records from primary storage. [2025-09-29T19:51:28.806793] [INFO ] [MAIN ] MFM: Loaded 14390 existing records. [2025-09-29T19:51:28.946446] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-29T19:51:29.011665] [WARN ] [MAIN ] MFM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:51:29.011861] [INFO ] [MAIN ] MFM: Wiping existing primary data before full refresh. [2025-09-29T19:51:29.011907] [INFO ] [LOCAL ] MFM: Starting deletion of primary data. [2025-09-29T19:51:29.012155] [DEBUG] [LOCAL ] MFM: Deleted primary data file. [2025-09-29T19:51:29.012213] [INFO ] [MAIN ] MFM: Starting full primary refresh. [2025-09-29T19:51:29.160574] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-07. [2025-09-29T19:51:29.349803] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-29T19:51:29.433763] [INFO ] [REMOTE ] MFM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:51:29.782744] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-29T19:51:29.948349] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-08. [2025-09-29T19:51:30.517387] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-29T19:51:30.748147] [INFO ] [REMOTE ] MFM: Fetching primary data for 2024-12. [2025-09-29T19:51:31.548104] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-02. [2025-09-29T19:51:31.561545] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-29T19:51:32.348130] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-06. [2025-09-29T19:51:33.084347] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-29T19:51:33.148161] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-01. [2025-09-29T19:51:33.860151] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-29T19:51:33.948109] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-02. [2025-09-29T19:51:33.992820] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-29T19:51:34.748139] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-07. [2025-09-29T19:51:34.782793] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-29T19:51:35.548120] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-03. [2025-09-29T19:51:36.348108] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-03. [2025-09-29T19:51:36.463838] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-29T19:51:37.148089] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-09. [2025-09-29T19:51:37.200966] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-29T19:51:37.280122] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-29T19:51:37.561942] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-29T19:51:37.563309] [INFO ] [REMOTE ] MFAO: Full fetch complete (5251 records). [2025-09-29T19:51:37.563438] [DEBUG] [VALIDATOR ] MFAO: Validating primary data. [2025-09-29T19:51:37.951000] [DEBUG] [VALIDATOR ] MFAO: All expected trading days are present. [2025-09-29T19:51:37.950792] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-04. [2025-09-29T19:51:37.951890] [DEBUG] [VALIDATOR ] MFAO: Primary data validation passed. [2025-09-29T19:51:37.952082] [INFO ] [MAIN ] MFAO: Fetched primary data is valid. [2025-09-29T19:51:37.952154] [DEBUG] [LOCAL ] MFAO: Saving primary data. [2025-09-29T19:51:37.952570] [DEBUG] [LOCAL ] MFAO: Trimmed 5251 records to 3789 (keeping 200 days of data) [2025-09-29T19:51:37.978808] [DEBUG] [LOCAL ] MFAO: Primary data saved (3789 records). [2025-09-29T19:51:37.978910] [INFO ] [MAIN ] MFAO: Full history saved. [2025-09-29T19:51:37.978999] [INFO ] [MAIN ] Update Progress: 1335/2371 symbols completed. MFAO took 33.4s. Estimated remaining: 2h 13m 9s. Rate: 7.8 symbols/min [2025-09-29T19:51:38.159849] [INFO ] [MAIN ] MFSB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:51:38.160053] [DEBUG] [LOCAL ] MFSB: No existing data file found in primary storage. [2025-09-29T19:51:38.160095] [WARN ] [MAIN ] MFSB: No existing data found, performing full refresh instead. [2025-09-29T19:51:38.160278] [INFO ] [MAIN ] MFSB: Wiping existing primary data before full refresh. [2025-09-29T19:51:38.160328] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-09-29T19:51:38.160371] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-09-29T19:51:38.160406] [INFO ] [MAIN ] MFSB: Starting full primary refresh. [2025-09-29T19:51:38.546818] [INFO ] [REMOTE ] MFSB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:51:38.748174] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-08. [2025-09-29T19:51:39.548153] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-04. [2025-09-29T19:51:39.760167] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-29T19:51:40.173148] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-29T19:51:40.348139] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2024-12. [2025-09-29T19:51:40.646175] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2024-12 (0.30 seconds). [2025-09-29T19:51:40.648000] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-29T19:51:41.148155] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-09. [2025-09-29T19:51:41.948129] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-05. [2025-09-29T19:51:42.748095] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-01. [2025-09-29T19:51:42.811086] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-29T19:51:43.005715] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-29T19:51:43.016511] [INFO ] [REMOTE ] MFC: Full fetch complete (74201 records). [2025-09-29T19:51:43.016688] [DEBUG] [VALIDATOR ] MFC: Validating primary data. [2025-09-29T19:51:43.115123] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-09-29T19:51:43.430793] [DEBUG] [VALIDATOR ] MFC: All expected trading days are present. [2025-09-29T19:51:43.430884] [DEBUG] [VALIDATOR ] MFC: Primary data validation passed. [2025-09-29T19:51:43.432029] [INFO ] [MAIN ] MFC: Fetched primary data is valid. [2025-09-29T19:51:43.432096] [DEBUG] [LOCAL ] MFC: Saving primary data. [2025-09-29T19:51:43.433673] [DEBUG] [LOCAL ] MFC: Trimmed 74201 records to 51201 (keeping 200 days of data) [2025-09-29T19:51:43.548349] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-02. [2025-09-29T19:51:43.770420] [DEBUG] [LOCAL ] MFC: Primary data saved (51201 records). [2025-09-29T19:51:43.770578] [INFO ] [MAIN ] MFC: Full history saved. [2025-09-29T19:51:43.770690] [INFO ] [MAIN ] Update Progress: 1336/2371 symbols completed. MFC took 34.2s. Estimated remaining: 2h 13m 0s. Rate: 7.8 symbols/min [2025-09-29T19:51:43.843668] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-29T19:51:43.957911] [INFO ] [MAIN ] MFSG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:51:43.966698] [DEBUG] [LOCAL ] MFSG: Loaded 5267 existing records from primary storage. [2025-09-29T19:51:43.966930] [INFO ] [MAIN ] MFSG: Loaded 5267 existing records. [2025-09-29T19:51:44.153161] [WARN ] [MAIN ] MFSG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:51:44.153380] [INFO ] [MAIN ] MFSG: Wiping existing primary data before full refresh. [2025-09-29T19:51:44.153429] [INFO ] [LOCAL ] MFSG: Starting deletion of primary data. [2025-09-29T19:51:44.153743] [DEBUG] [LOCAL ] MFSG: Deleted primary data file. [2025-09-29T19:51:44.153802] [INFO ] [MAIN ] MFSG: Starting full primary refresh. [2025-09-29T19:51:44.356432] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-05. [2025-09-29T19:51:44.521187] [INFO ] [REMOTE ] MFSG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:51:45.148143] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-03. [2025-09-29T19:51:45.469373] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-29T19:51:45.948108] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-04. [2025-09-29T19:51:46.163290] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-29T19:51:46.285593] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-29T19:51:46.748159] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-05. [2025-09-29T19:51:47.012479] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-09-29T19:51:47.548092] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-06. [2025-09-29T19:51:47.953802] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-29T19:51:48.348108] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-06. [2025-09-29T19:51:48.935434] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-29T19:51:49.148165] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-06. [2025-09-29T19:51:49.948115] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-07. [2025-09-29T19:51:50.366060] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-29T19:51:50.712223] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-29T19:51:50.748155] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-07. [2025-09-29T19:51:51.548107] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-08. [2025-09-29T19:51:52.014539] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-29T19:51:52.348083] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-07. [2025-09-29T19:51:52.410245] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-29T19:51:53.148118] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-09. [2025-09-29T19:51:53.346509] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-29T19:51:53.877953] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-29T19:51:53.879298] [INFO ] [REMOTE ] MFSB: Full fetch complete (1628 records). [2025-09-29T19:51:53.879405] [DEBUG] [VALIDATOR ] MFSB: Validating primary data. [2025-09-29T19:51:53.953272] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2024-12. [2025-09-29T19:51:54.069616] [WARN ] [VALIDATOR ] MFSB: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-09-29T19:51:54.069819] [FATAL] [MAIN ] MFSB: Fetched primary data is invalid. Refusing to save it. [2025-09-29T19:51:54.069890] [WARN ] [MAIN ] MFSB: Deleting existing primary and derivative data due to validation failure. [2025-09-29T19:51:54.069942] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-09-29T19:51:54.069998] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-09-29T19:51:54.070034] [INFO ] [LOCAL ] MFSB: Starting deletion of derivative data. [2025-09-29T19:51:54.070088] [DEBUG] [LOCAL ] MFSB: No derivative data file found to delete. [2025-09-29T19:51:54.070168] [INFO ] [MAIN ] Update Progress: 1337/2371 symbols completed. MFSB took 16.1s. Estimated remaining: 2h 12m 54s. Rate: 7.8 symbols/min [2025-09-29T19:51:54.245756] [INFO ] [MAIN ] MFSI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:51:54.263185] [DEBUG] [LOCAL ] MFSI: Loaded 11358 existing records from primary storage. [2025-09-29T19:51:54.263430] [INFO ] [MAIN ] MFSI: Loaded 11358 existing records. [2025-09-29T19:51:54.376521] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-29T19:51:54.460232] [WARN ] [MAIN ] MFSI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:51:54.460549] [INFO ] [MAIN ] MFSI: Wiping existing primary data before full refresh. [2025-09-29T19:51:54.460610] [INFO ] [LOCAL ] MFSI: Starting deletion of primary data. [2025-09-29T19:51:54.460943] [DEBUG] [LOCAL ] MFSI: Deleted primary data file. [2025-09-29T19:51:54.461003] [INFO ] [MAIN ] MFSI: Starting full primary refresh. [2025-09-29T19:51:54.755365] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-08. [2025-09-29T19:51:54.857156] [INFO ] [REMOTE ] MFSI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:51:55.548096] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-08. [2025-09-29T19:51:55.576459] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-29T19:51:56.348167] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-09. [2025-09-29T19:51:57.148094] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2024-12. [2025-09-29T19:51:57.288542] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-29T19:51:57.308241] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-29T19:51:57.311638] [INFO ] [REMOTE ] MFM: Full fetch complete (19288 records). [2025-09-29T19:51:57.311754] [DEBUG] [VALIDATOR ] MFM: Validating primary data. [2025-09-29T19:51:57.572188] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-29T19:51:57.710540] [DEBUG] [VALIDATOR ] MFM: All expected trading days are present. [2025-09-29T19:51:57.710630] [DEBUG] [VALIDATOR ] MFM: Primary data validation passed. [2025-09-29T19:51:57.711107] [INFO ] [MAIN ] MFM: Fetched primary data is valid. [2025-09-29T19:51:57.711157] [DEBUG] [LOCAL ] MFM: Saving primary data. [2025-09-29T19:51:57.711807] [DEBUG] [LOCAL ] MFM: Trimmed 19288 records to 14381 (keeping 200 days of data) [2025-09-29T19:51:57.801148] [DEBUG] [LOCAL ] MFM: Primary data saved (14381 records). [2025-09-29T19:51:57.801298] [INFO ] [MAIN ] MFM: Full history saved. [2025-09-29T19:51:57.801384] [INFO ] [MAIN ] Update Progress: 1338/2371 symbols completed. MFM took 29.2s. Estimated remaining: 2h 12m 44s. Rate: 7.8 symbols/min [2025-09-29T19:51:57.953264] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-01. [2025-09-29T19:51:57.982898] [INFO ] [MAIN ] MFSV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:51:57.988520] [DEBUG] [LOCAL ] MFSV: Loaded 2514 existing records from primary storage. [2025-09-29T19:51:57.989358] [INFO ] [MAIN ] MFSV: Loaded 2514 existing records. [2025-09-29T19:51:58.190556] [WARN ] [MAIN ] MFSV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:51:58.190843] [INFO ] [MAIN ] MFSV: Wiping existing primary data before full refresh. [2025-09-29T19:51:58.190897] [INFO ] [LOCAL ] MFSV: Starting deletion of primary data. [2025-09-29T19:51:58.191124] [DEBUG] [LOCAL ] MFSV: Deleted primary data file. [2025-09-29T19:51:58.191183] [INFO ] [MAIN ] MFSV: Starting full primary refresh. [2025-09-29T19:51:58.591592] [INFO ] [REMOTE ] MFSV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:51:58.597446] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-29T19:51:58.748171] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-01. [2025-09-29T19:51:59.175456] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-29T19:51:59.548106] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-02. [2025-09-29T19:51:59.988663] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-29T19:52:00.348153] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-09. [2025-09-29T19:52:01.148120] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-02. [2025-09-29T19:52:01.726234] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-29T19:52:01.948125] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-03. [2025-09-29T19:52:02.119191] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-29T19:52:02.129871] [INFO ] [REMOTE ] MFG: Full fetch complete (68710 records). [2025-09-29T19:52:02.130034] [DEBUG] [VALIDATOR ] MFG: Validating primary data. [2025-09-29T19:52:02.480048] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-29T19:52:02.575188] [DEBUG] [VALIDATOR ] MFG: All expected trading days are present. [2025-09-29T19:52:02.575320] [DEBUG] [VALIDATOR ] MFG: Primary data validation passed. [2025-09-29T19:52:02.576581] [INFO ] [MAIN ] MFG: Fetched primary data is valid. [2025-09-29T19:52:02.576857] [DEBUG] [LOCAL ] MFG: Saving primary data. [2025-09-29T19:52:02.578452] [DEBUG] [LOCAL ] MFG: Trimmed 68710 records to 49118 (keeping 200 days of data) [2025-09-29T19:52:02.751364] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2024-12. [2025-09-29T19:52:02.875858] [DEBUG] [LOCAL ] MFG: Primary data saved (49118 records). [2025-09-29T19:52:02.876048] [INFO ] [MAIN ] MFG: Full history saved. [2025-09-29T19:52:02.876176] [INFO ] [MAIN ] Update Progress: 1339/2371 symbols completed. MFG took 42.0s. Estimated remaining: 2h 12m 34s. Rate: 7.8 symbols/min [2025-09-29T19:52:03.057860] [INFO ] [MAIN ] MG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:52:03.077104] [DEBUG] [LOCAL ] MG: Loaded 16832 existing records from primary storage. [2025-09-29T19:52:03.077362] [INFO ] [MAIN ] MG: Loaded 16832 existing records. [2025-09-29T19:52:03.189527] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-29T19:52:03.278079] [WARN ] [MAIN ] MG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:52:03.278457] [INFO ] [MAIN ] MG: Wiping existing primary data before full refresh. [2025-09-29T19:52:03.278519] [INFO ] [LOCAL ] MG: Starting deletion of primary data. [2025-09-29T19:52:03.279388] [DEBUG] [LOCAL ] MG: Deleted primary data file. [2025-09-29T19:52:03.279458] [INFO ] [MAIN ] MG: Starting full primary refresh. [2025-09-29T19:52:03.553230] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-04. [2025-09-29T19:52:03.664019] [INFO ] [REMOTE ] MG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:52:04.339376] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-29T19:52:04.348060] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-05. [2025-09-29T19:52:05.148186] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-03. [2025-09-29T19:52:05.182730] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-29T19:52:05.598427] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-29T19:52:05.948132] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-06. [2025-09-29T19:52:06.503242] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-29T19:52:06.748146] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-04. [2025-09-29T19:52:07.337348] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-29T19:52:07.548125] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-05. [2025-09-29T19:52:08.122957] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-29T19:52:08.348122] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-07. [2025-09-29T19:52:09.148094] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-01. [2025-09-29T19:52:09.267509] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-29T19:52:09.514975] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-09-29T19:52:09.948112] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-06. [2025-09-29T19:52:10.577909] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-29T19:52:10.748127] [INFO ] [REMOTE ] MG: Fetching primary data for 2024-12. [2025-09-29T19:52:11.548100] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-07. [2025-09-29T19:52:11.777638] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-29T19:52:12.140143] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-29T19:52:12.348116] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-08. [2025-09-29T19:52:12.960877] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-29T19:52:13.148110] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-02. [2025-09-29T19:52:13.578349] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-29T19:52:13.948116] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-03. [2025-09-29T19:52:14.379834] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-29T19:52:14.748108] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-09. [2025-09-29T19:52:15.548123] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-08. [2025-09-29T19:52:15.608638] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-29T19:52:15.612002] [INFO ] [REMOTE ] MFSG: Full fetch complete (5963 records). [2025-09-29T19:52:15.612164] [DEBUG] [VALIDATOR ] MFSG: Validating primary data. [2025-09-29T19:52:16.053268] [DEBUG] [VALIDATOR ] MFSG: All expected trading days are present. [2025-09-29T19:52:16.053368] [DEBUG] [VALIDATOR ] MFSG: Primary data validation passed. [2025-09-29T19:52:16.053555] [INFO ] [MAIN ] MFSG: Fetched primary data is valid. [2025-09-29T19:52:16.053597] [DEBUG] [LOCAL ] MFSG: Saving primary data. [2025-09-29T19:52:16.054120] [DEBUG] [LOCAL ] MFSG: Trimmed 5963 records to 5270 (keeping 200 days of data) [2025-09-29T19:52:16.089701] [DEBUG] [LOCAL ] MFSG: Primary data saved (5270 records). [2025-09-29T19:52:16.089828] [INFO ] [MAIN ] MFSG: Full history saved. [2025-09-29T19:52:16.089911] [INFO ] [MAIN ] Update Progress: 1340/2371 symbols completed. MFSG took 32.3s. Estimated remaining: 2h 12m 30s. Rate: 7.8 symbols/min [2025-09-29T19:52:16.303898] [INFO ] [MAIN ] MGA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:52:16.348166] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-01. [2025-09-29T19:52:16.366890] [DEBUG] [LOCAL ] MGA: Loaded 51414 existing records from primary storage. [2025-09-29T19:52:16.367347] [INFO ] [MAIN ] MGA: Loaded 51414 existing records. [2025-09-29T19:52:16.513433] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-29T19:52:16.588818] [WARN ] [MAIN ] MGA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:52:16.589075] [INFO ] [MAIN ] MGA: Wiping existing primary data before full refresh. [2025-09-29T19:52:16.589148] [INFO ] [LOCAL ] MGA: Starting deletion of primary data. [2025-09-29T19:52:16.589711] [DEBUG] [LOCAL ] MGA: Deleted primary data file. [2025-09-29T19:52:16.589774] [INFO ] [MAIN ] MGA: Starting full primary refresh. [2025-09-29T19:52:16.970138] [INFO ] [REMOTE ] MGA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:52:17.148084] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-09. [2025-09-29T19:52:17.358260] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-29T19:52:17.948088] [INFO ] [REMOTE ] MGA: Fetching primary data for 2024-12. [2025-09-29T19:52:18.230943] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-29T19:52:18.234893] [INFO ] [REMOTE ] MFSI: Full fetch complete (13473 records). [2025-09-29T19:52:18.235012] [DEBUG] [VALIDATOR ] MFSI: Validating primary data. [2025-09-29T19:52:18.626282] [DEBUG] [VALIDATOR ] MFSI: All expected trading days are present. [2025-09-29T19:52:18.626367] [DEBUG] [VALIDATOR ] MFSI: Primary data validation passed. [2025-09-29T19:52:18.626738] [INFO ] [MAIN ] MFSI: Fetched primary data is valid. [2025-09-29T19:52:18.626803] [DEBUG] [LOCAL ] MFSI: Saving primary data. [2025-09-29T19:52:18.627423] [DEBUG] [LOCAL ] MFSI: Trimmed 13473 records to 11308 (keeping 200 days of data) [2025-09-29T19:52:18.701232] [DEBUG] [LOCAL ] MFSI: Primary data saved (11308 records). [2025-09-29T19:52:18.701382] [INFO ] [MAIN ] MFSI: Full history saved. [2025-09-29T19:52:18.701501] [INFO ] [MAIN ] Update Progress: 1341/2371 symbols completed. MFSI took 24.6s. Estimated remaining: 2h 12m 19s. Rate: 7.8 symbols/min [2025-09-29T19:52:18.760395] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-04. [2025-09-29T19:52:18.890721] [INFO ] [MAIN ] MGF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:52:18.900013] [DEBUG] [LOCAL ] MGF: Loaded 4186 existing records from primary storage. [2025-09-29T19:52:18.900230] [INFO ] [MAIN ] MGF: Loaded 4186 existing records. [2025-09-29T19:52:19.091875] [WARN ] [MAIN ] MGF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:52:19.092216] [INFO ] [MAIN ] MGF: Wiping existing primary data before full refresh. [2025-09-29T19:52:19.092294] [INFO ] [LOCAL ] MGF: Starting deletion of primary data. [2025-09-29T19:52:19.092544] [DEBUG] [LOCAL ] MGF: Deleted primary data file. [2025-09-29T19:52:19.092608] [INFO ] [MAIN ] MGF: Starting full primary refresh. [2025-09-29T19:52:19.322666] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-29T19:52:19.496069] [INFO ] [REMOTE ] MGF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:52:19.554934] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-05. [2025-09-29T19:52:19.575785] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-29T19:52:20.006957] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-29T19:52:20.348111] [INFO ] [REMOTE ] MGF: Fetching primary data for 2024-12. [2025-09-29T19:52:20.951992] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-29T19:52:21.148156] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-06. [2025-09-29T19:52:21.586291] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-29T19:52:21.948125] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-01. [2025-09-29T19:52:22.510820] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-29T19:52:22.748131] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-02. [2025-09-29T19:52:23.212242] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-29T19:52:23.548160] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-03. [2025-09-29T19:52:24.183236] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-29T19:52:24.348116] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-02. [2025-09-29T19:52:25.148139] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-07. [2025-09-29T19:52:25.162209] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-29T19:52:25.591373] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-29T19:52:25.948139] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-04. [2025-09-29T19:52:26.543235] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-29T19:52:26.748142] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-05. [2025-09-29T19:52:27.363366] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-29T19:52:27.548116] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-08. [2025-09-29T19:52:28.152001] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-29T19:52:28.348135] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-06. [2025-09-29T19:52:28.909041] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-29T19:52:29.148124] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-09. [2025-09-29T19:52:29.948884] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-01. [2025-09-29T19:52:29.950503] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-29T19:52:29.953924] [INFO ] [REMOTE ] MFSV: Full fetch complete (3131 records). [2025-09-29T19:52:29.954047] [DEBUG] [VALIDATOR ] MFSV: Validating primary data. [2025-09-29T19:52:30.331182] [DEBUG] [VALIDATOR ] MFSV: All expected trading days are present. [2025-09-29T19:52:30.331264] [DEBUG] [VALIDATOR ] MFSV: Primary data validation passed. [2025-09-29T19:52:30.331393] [INFO ] [MAIN ] MFSV: Fetched primary data is valid. [2025-09-29T19:52:30.331489] [DEBUG] [LOCAL ] MFSV: Saving primary data. [2025-09-29T19:52:30.331897] [DEBUG] [LOCAL ] MFSV: Trimmed 3131 records to 2499 (keeping 200 days of data) [2025-09-29T19:52:30.347462] [DEBUG] [LOCAL ] MFSV: Primary data saved (2499 records). [2025-09-29T19:52:30.347552] [INFO ] [MAIN ] MFSV: Full history saved. [2025-09-29T19:52:30.347635] [INFO ] [MAIN ] Update Progress: 1342/2371 symbols completed. MFSV took 32.5s. Estimated remaining: 2h 12m 14s. Rate: 7.8 symbols/min [2025-09-29T19:52:30.521440] [INFO ] [MAIN ] MGM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:52:30.587184] [DEBUG] [LOCAL ] MGM: Loaded 54388 existing records from primary storage. [2025-09-29T19:52:30.587538] [INFO ] [MAIN ] MGM: Loaded 54388 existing records. [2025-09-29T19:52:30.753990] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-03. [2025-09-29T19:52:30.781796] [WARN ] [MAIN ] MGM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:52:30.782090] [INFO ] [MAIN ] MGM: Wiping existing primary data before full refresh. [2025-09-29T19:52:30.782990] [INFO ] [LOCAL ] MGM: Starting deletion of primary data. [2025-09-29T19:52:30.783716] [DEBUG] [LOCAL ] MGM: Deleted primary data file. [2025-09-29T19:52:30.783858] [INFO ] [MAIN ] MGM: Starting full primary refresh. [2025-09-29T19:52:31.161823] [INFO ] [REMOTE ] MGM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:52:31.548192] [INFO ] [REMOTE ] MGM: Fetching primary data for 2024-12. [2025-09-29T19:52:31.714345] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-29T19:52:31.758155] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-29T19:52:32.348178] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-04. [2025-09-29T19:52:33.148143] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-02. [2025-09-29T19:52:33.530281] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-29T19:52:33.575071] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-29T19:52:33.948119] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-05. [2025-09-29T19:52:34.472636] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-29T19:52:34.588575] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-29T19:52:34.748128] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-03. [2025-09-29T19:52:35.548163] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-07. [2025-09-29T19:52:36.169041] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-29T19:52:36.348091] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-01. [2025-09-29T19:52:36.545704] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-29T19:52:37.148128] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-08. [2025-09-29T19:52:37.758283] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-29T19:52:37.948111] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-04. [2025-09-29T19:52:38.242053] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-29T19:52:38.748152] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-06. [2025-09-29T19:52:39.548096] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-09. [2025-09-29T19:52:39.810383] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-29T19:52:39.809944] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-29T19:52:40.340914] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-29T19:52:40.342377] [INFO ] [REMOTE ] MGF: Full fetch complete (5838 records). [2025-09-29T19:52:40.342451] [DEBUG] [VALIDATOR ] MGF: Validating primary data. [2025-09-29T19:52:40.354043] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-05. [2025-09-29T19:52:40.725854] [DEBUG] [VALIDATOR ] MGF: All expected trading days are present. [2025-09-29T19:52:40.725945] [DEBUG] [VALIDATOR ] MGF: Primary data validation passed. [2025-09-29T19:52:40.726127] [INFO ] [MAIN ] MGF: Fetched primary data is valid. [2025-09-29T19:52:40.726222] [DEBUG] [LOCAL ] MGF: Saving primary data. [2025-09-29T19:52:40.726637] [DEBUG] [LOCAL ] MGF: Trimmed 5838 records to 4186 (keeping 200 days of data) [2025-09-29T19:52:40.754779] [DEBUG] [LOCAL ] MGF: Primary data saved (4186 records). [2025-09-29T19:52:40.754903] [INFO ] [MAIN ] MGF: Full history saved. [2025-09-29T19:52:40.754995] [INFO ] [MAIN ] Update Progress: 1343/2371 symbols completed. MGF took 22.1s. Estimated remaining: 2h 12m 8s. Rate: 7.8 symbols/min [2025-09-29T19:52:40.948164] [INFO ] [MAIN ] MGR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:52:40.958247] [DEBUG] [LOCAL ] MGR: Loaded 5675 existing records from primary storage. [2025-09-29T19:52:40.958491] [INFO ] [MAIN ] MGR: Loaded 5675 existing records. [2025-09-29T19:52:41.152526] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-02. [2025-09-29T19:52:41.156725] [WARN ] [MAIN ] MGR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:52:41.157674] [INFO ] [MAIN ] MGR: Wiping existing primary data before full refresh. [2025-09-29T19:52:41.157739] [INFO ] [LOCAL ] MGR: Starting deletion of primary data. [2025-09-29T19:52:41.157948] [DEBUG] [LOCAL ] MGR: Deleted primary data file. [2025-09-29T19:52:41.158010] [INFO ] [MAIN ] MGR: Starting full primary refresh. [2025-09-29T19:52:41.549034] [INFO ] [REMOTE ] MGR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:52:41.948095] [INFO ] [REMOTE ] MGR: Fetching primary data for 2024-12. [2025-09-29T19:52:42.127941] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-29T19:52:42.748123] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-06. [2025-09-29T19:52:42.759500] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-29T19:52:43.017576] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-29T19:52:43.548161] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-07. [2025-09-29T19:52:44.349109] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-01. [2025-09-29T19:52:44.349021] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-29T19:52:44.476873] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-29T19:52:44.961431] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-29T19:52:45.148113] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-07. [2025-09-29T19:52:45.948113] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-03. [2025-09-29T19:52:46.748124] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-02. [2025-09-29T19:52:46.979362] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-29T19:52:47.369173] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-29T19:52:47.548088] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-08. [2025-09-29T19:52:47.745371] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-29T19:52:48.348127] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-08. [2025-09-29T19:52:48.445685] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-29T19:52:49.148144] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-09. [2025-09-29T19:52:49.859082] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-29T19:52:49.948093] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-09. [2025-09-29T19:52:50.171890] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-29T19:52:50.175714] [INFO ] [REMOTE ] MG: Full fetch complete (24010 records). [2025-09-29T19:52:50.175849] [DEBUG] [VALIDATOR ] MG: Validating primary data. [2025-09-29T19:52:50.580206] [DEBUG] [VALIDATOR ] MG: All expected trading days are present. [2025-09-29T19:52:50.580291] [DEBUG] [VALIDATOR ] MG: Primary data validation passed. [2025-09-29T19:52:50.580879] [INFO ] [MAIN ] MG: Fetched primary data is valid. [2025-09-29T19:52:50.580965] [DEBUG] [LOCAL ] MG: Saving primary data. [2025-09-29T19:52:50.582766] [DEBUG] [LOCAL ] MG: Trimmed 24010 records to 16410 (keeping 200 days of data) [2025-09-29T19:52:50.699519] [DEBUG] [LOCAL ] MG: Primary data saved (16410 records). [2025-09-29T19:52:50.699676] [INFO ] [MAIN ] MG: Full history saved. [2025-09-29T19:52:50.699828] [INFO ] [MAIN ] Update Progress: 1344/2371 symbols completed. MG took 47.8s. Estimated remaining: 2h 12m 2s. Rate: 7.8 symbols/min [2025-09-29T19:52:50.757549] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-04. [2025-09-29T19:52:50.881064] [INFO ] [MAIN ] MGRB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:52:50.888216] [DEBUG] [LOCAL ] MGRB: Loaded 4102 existing records from primary storage. [2025-09-29T19:52:50.888447] [INFO ] [MAIN ] MGRB: Loaded 4102 existing records. [2025-09-29T19:52:51.078025] [WARN ] [MAIN ] MGRB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:52:51.078260] [INFO ] [MAIN ] MGRB: Wiping existing primary data before full refresh. [2025-09-29T19:52:51.078309] [INFO ] [LOCAL ] MGRB: Starting deletion of primary data. [2025-09-29T19:52:51.078524] [DEBUG] [LOCAL ] MGRB: Deleted primary data file. [2025-09-29T19:52:51.078586] [INFO ] [MAIN ] MGRB: Starting full primary refresh. [2025-09-29T19:52:51.481256] [INFO ] [REMOTE ] MGRB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:52:51.548094] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2024-12. [2025-09-29T19:52:51.663057] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-29T19:52:51.674244] [INFO ] [REMOTE ] MGA: Full fetch complete (73720 records). [2025-09-29T19:52:51.674406] [DEBUG] [VALIDATOR ] MGA: Validating primary data. [2025-09-29T19:52:52.043999] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-29T19:52:52.100411] [DEBUG] [VALIDATOR ] MGA: All expected trading days are present. [2025-09-29T19:52:52.100571] [DEBUG] [VALIDATOR ] MGA: Primary data validation passed. [2025-09-29T19:52:52.101906] [INFO ] [MAIN ] MGA: Fetched primary data is valid. [2025-09-29T19:52:52.101988] [DEBUG] [LOCAL ] MGA: Saving primary data. [2025-09-29T19:52:52.103596] [DEBUG] [LOCAL ] MGA: Trimmed 73720 records to 50645 (keeping 200 days of data) [2025-09-29T19:52:52.348339] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-03. [2025-09-29T19:52:52.437001] [DEBUG] [LOCAL ] MGA: Primary data saved (50645 records). [2025-09-29T19:52:52.437178] [INFO ] [MAIN ] MGA: Full history saved. [2025-09-29T19:52:52.437270] [INFO ] [MAIN ] Update Progress: 1345/2371 symbols completed. MGA took 36.3s. Estimated remaining: 2h 11m 50s. Rate: 7.8 symbols/min [2025-09-29T19:52:52.621741] [INFO ] [MAIN ] MGRD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:52:52.658997] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-29T19:52:52.657493] [DEBUG] [LOCAL ] MGRD: Loaded 2231 existing records from primary storage. [2025-09-29T19:52:52.670797] [INFO ] [MAIN ] MGRD: Loaded 2231 existing records. [2025-09-29T19:52:52.877885] [WARN ] [MAIN ] MGRD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:52:52.878701] [INFO ] [MAIN ] MGRD: Wiping existing primary data before full refresh. [2025-09-29T19:52:52.878794] [INFO ] [LOCAL ] MGRD: Starting deletion of primary data. [2025-09-29T19:52:52.879218] [DEBUG] [LOCAL ] MGRD: Deleted primary data file. [2025-09-29T19:52:52.879294] [INFO ] [MAIN ] MGRD: Starting full primary refresh. [2025-09-29T19:52:53.012038] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-29T19:52:53.153183] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-04. [2025-09-29T19:52:53.275282] [INFO ] [REMOTE ] MGRD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:52:53.896763] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-29T19:52:53.948106] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-05. [2025-09-29T19:52:54.514206] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-29T19:52:54.748145] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-06. [2025-09-29T19:52:55.359946] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-29T19:52:55.548136] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-05. [2025-09-29T19:52:56.348135] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2024-12. [2025-09-29T19:52:56.900543] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-29T19:52:57.148092] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-07. [2025-09-29T19:52:57.412723] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-29T19:52:57.590488] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-29T19:52:57.948129] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-06. [2025-09-29T19:52:58.748137] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-01. [2025-09-29T19:52:59.332630] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-29T19:52:59.548171] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-08. [2025-09-29T19:52:59.776971] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-29T19:53:00.148524] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-29T19:53:00.348141] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-09. [2025-09-29T19:53:01.096530] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-29T19:53:01.098210] [INFO ] [REMOTE ] MGR: Full fetch complete (8300 records). [2025-09-29T19:53:01.098285] [DEBUG] [VALIDATOR ] MGR: Validating primary data. [2025-09-29T19:53:01.153430] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-07. [2025-09-29T19:53:01.513705] [DEBUG] [VALIDATOR ] MGR: All expected trading days are present. [2025-09-29T19:53:01.513812] [DEBUG] [VALIDATOR ] MGR: Primary data validation passed. [2025-09-29T19:53:01.514207] [INFO ] [MAIN ] MGR: Fetched primary data is valid. [2025-09-29T19:53:01.514299] [DEBUG] [LOCAL ] MGR: Saving primary data. [2025-09-29T19:53:01.514868] [DEBUG] [LOCAL ] MGR: Trimmed 8300 records to 5598 (keeping 200 days of data) [2025-09-29T19:53:01.550448] [DEBUG] [LOCAL ] MGR: Primary data saved (5598 records). [2025-09-29T19:53:01.550587] [INFO ] [MAIN ] MGR: Full history saved. [2025-09-29T19:53:01.550703] [INFO ] [MAIN ] Update Progress: 1346/2371 symbols completed. MGR took 20.8s. Estimated remaining: 2h 11m 43s. Rate: 7.8 symbols/min [2025-09-29T19:53:01.730923] [INFO ] [MAIN ] MGRE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:53:01.740965] [DEBUG] [LOCAL ] MGRE: Loaded 6684 existing records from primary storage. [2025-09-29T19:53:01.741214] [INFO ] [MAIN ] MGRE: Loaded 6684 existing records. [2025-09-29T19:53:01.952069] [WARN ] [MAIN ] MGRE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:53:01.952221] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-01. [2025-09-29T19:53:01.953742] [INFO ] [MAIN ] MGRE: Wiping existing primary data before full refresh. [2025-09-29T19:53:01.953808] [INFO ] [LOCAL ] MGRE: Starting deletion of primary data. [2025-09-29T19:53:01.954094] [DEBUG] [LOCAL ] MGRE: Deleted primary data file. [2025-09-29T19:53:01.954171] [INFO ] [MAIN ] MGRE: Starting full primary refresh. [2025-09-29T19:53:02.331084] [INFO ] [REMOTE ] MGRE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:53:02.558608] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-29T19:53:02.748134] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-02. [2025-09-29T19:53:03.100411] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-29T19:53:03.313223] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-29T19:53:03.548111] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-02. [2025-09-29T19:53:04.064633] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-29T19:53:04.348129] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-08. [2025-09-29T19:53:05.148135] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-03. [2025-09-29T19:53:05.614081] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-29T19:53:05.948095] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-03. [2025-09-29T19:53:06.027554] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-29T19:53:06.266889] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-29T19:53:06.748171] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2024-12. [2025-09-29T19:53:07.201186] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-29T19:53:07.548112] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-04. [2025-09-29T19:53:08.160576] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-29T19:53:08.348119] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-09. [2025-09-29T19:53:09.148110] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-01. [2025-09-29T19:53:09.774868] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-29T19:53:09.948133] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-02. [2025-09-29T19:53:10.354999] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-29T19:53:10.366350] [INFO ] [REMOTE ] MGM: Full fetch complete (77601 records). [2025-09-29T19:53:10.366504] [DEBUG] [VALIDATOR ] MGM: Validating primary data. [2025-09-29T19:53:10.696166] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-29T19:53:10.753200] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-03. [2025-09-29T19:53:10.810418] [DEBUG] [VALIDATOR ] MGM: All expected trading days are present. [2025-09-29T19:53:10.810538] [DEBUG] [VALIDATOR ] MGM: Primary data validation passed. [2025-09-29T19:53:10.811687] [INFO ] [MAIN ] MGM: Fetched primary data is valid. [2025-09-29T19:53:10.811773] [DEBUG] [LOCAL ] MGM: Saving primary data. [2025-09-29T19:53:10.813801] [DEBUG] [LOCAL ] MGM: Trimmed 77601 records to 53608 (keeping 200 days of data) [2025-09-29T19:53:11.158087] [DEBUG] [LOCAL ] MGM: Primary data saved (53608 records). [2025-09-29T19:53:11.158335] [INFO ] [MAIN ] MGM: Full history saved. [2025-09-29T19:53:11.158467] [INFO ] [MAIN ] Update Progress: 1347/2371 symbols completed. MGM took 40.8s. Estimated remaining: 2h 11m 37s. Rate: 7.8 symbols/min [2025-09-29T19:53:11.337145] [INFO ] [MAIN ] MGY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:53:11.379997] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-29T19:53:11.405440] [DEBUG] [LOCAL ] MGY: Loaded 53195 existing records from primary storage. [2025-09-29T19:53:11.405820] [INFO ] [MAIN ] MGY: Loaded 53195 existing records. [2025-09-29T19:53:11.553257] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-04. [2025-09-29T19:53:11.594945] [WARN ] [MAIN ] MGY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:53:11.595251] [INFO ] [MAIN ] MGY: Wiping existing primary data before full refresh. [2025-09-29T19:53:11.595302] [INFO ] [LOCAL ] MGY: Starting deletion of primary data. [2025-09-29T19:53:11.595873] [DEBUG] [LOCAL ] MGY: Deleted primary data file. [2025-09-29T19:53:11.595957] [INFO ] [MAIN ] MGY: Starting full primary refresh. [2025-09-29T19:53:11.982956] [INFO ] [REMOTE ] MGY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:53:12.108935] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-29T19:53:12.348120] [INFO ] [REMOTE ] MGY: Fetching primary data for 2024-12. [2025-09-29T19:53:13.148129] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-05. [2025-09-29T19:53:13.641854] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-29T19:53:13.948143] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-04. [2025-09-29T19:53:14.073895] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-29T19:53:14.664720] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-29T19:53:14.748125] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-01. [2025-09-29T19:53:15.548117] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-05. [2025-09-29T19:53:16.193194] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-29T19:53:16.348121] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-06. [2025-09-29T19:53:16.450312] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-29T19:53:16.925818] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-29T19:53:17.148107] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-07. [2025-09-29T19:53:17.711750] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-29T19:53:17.948107] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-08. [2025-09-29T19:53:18.504230] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-29T19:53:18.748108] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-05. [2025-09-29T19:53:19.378491] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-29T19:53:19.548134] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-06. [2025-09-29T19:53:20.285406] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-29T19:53:20.348105] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-09. [2025-09-29T19:53:20.918190] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-29T19:53:20.919954] [INFO ] [REMOTE ] MGRB: Full fetch complete (6200 records). [2025-09-29T19:53:20.920077] [DEBUG] [VALIDATOR ] MGRB: Validating primary data. [2025-09-29T19:53:21.153218] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-07. [2025-09-29T19:53:21.289577] [DEBUG] [VALIDATOR ] MGRB: All expected trading days are present. [2025-09-29T19:53:21.289699] [DEBUG] [VALIDATOR ] MGRB: Primary data validation passed. [2025-09-29T19:53:21.289890] [INFO ] [MAIN ] MGRB: Fetched primary data is valid. [2025-09-29T19:53:21.289932] [DEBUG] [LOCAL ] MGRB: Saving primary data. [2025-09-29T19:53:21.290309] [DEBUG] [LOCAL ] MGRB: Trimmed 6200 records to 4057 (keeping 200 days of data) [2025-09-29T19:53:21.317172] [DEBUG] [LOCAL ] MGRB: Primary data saved (4057 records). [2025-09-29T19:53:21.317287] [INFO ] [MAIN ] MGRB: Full history saved. [2025-09-29T19:53:21.317392] [INFO ] [MAIN ] Update Progress: 1348/2371 symbols completed. MGRB took 30.6s. Estimated remaining: 2h 11m 31s. Rate: 7.8 symbols/min [2025-09-29T19:53:21.496982] [INFO ] [MAIN ] MH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:53:21.497417] [DEBUG] [LOCAL ] MH: No existing data file found in primary storage. [2025-09-29T19:53:21.497503] [WARN ] [MAIN ] MH: No existing data found, performing full refresh instead. [2025-09-29T19:53:21.497685] [INFO ] [MAIN ] MH: Wiping existing primary data before full refresh. [2025-09-29T19:53:21.497743] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-09-29T19:53:21.497789] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-09-29T19:53:21.497825] [INFO ] [MAIN ] MH: Starting full primary refresh. [2025-09-29T19:53:21.917763] [INFO ] [REMOTE ] MH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:53:21.933509] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-29T19:53:21.948055] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-08. [2025-09-29T19:53:22.557960] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-29T19:53:22.748128] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-06. [2025-09-29T19:53:23.264854] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-29T19:53:23.548126] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-02. [2025-09-29T19:53:24.348153] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-09. [2025-09-29T19:53:25.082190] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-29T19:53:25.084731] [INFO ] [REMOTE ] MGRE: Full fetch complete (9425 records). [2025-09-29T19:53:25.084847] [DEBUG] [VALIDATOR ] MGRE: Validating primary data. [2025-09-29T19:53:25.152800] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-07. [2025-09-29T19:53:25.334347] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-29T19:53:25.574615] [DEBUG] [VALIDATOR ] MGRE: All expected trading days are present. [2025-09-29T19:53:25.574740] [DEBUG] [VALIDATOR ] MGRE: Primary data validation passed. [2025-09-29T19:53:25.575020] [INFO ] [MAIN ] MGRE: Fetched primary data is valid. [2025-09-29T19:53:25.575100] [DEBUG] [LOCAL ] MGRE: Saving primary data. [2025-09-29T19:53:25.575605] [DEBUG] [LOCAL ] MGRE: Trimmed 9425 records to 6643 (keeping 200 days of data) [2025-09-29T19:53:25.618531] [DEBUG] [LOCAL ] MGRE: Primary data saved (6643 records). [2025-09-29T19:53:25.618694] [INFO ] [MAIN ] MGRE: Full history saved. [2025-09-29T19:53:25.618806] [INFO ] [MAIN ] Update Progress: 1349/2371 symbols completed. MGRE took 24.1s. Estimated remaining: 2h 11m 21s. Rate: 7.8 symbols/min [2025-09-29T19:53:25.691427] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-29T19:53:25.804811] [INFO ] [MAIN ] MHD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:53:25.821864] [DEBUG] [LOCAL ] MHD: Loaded 12297 existing records from primary storage. [2025-09-29T19:53:25.822101] [INFO ] [MAIN ] MHD: Loaded 12297 existing records. [2025-09-29T19:53:25.953292] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-03. [2025-09-29T19:53:26.010038] [WARN ] [MAIN ] MHD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:53:26.010565] [INFO ] [MAIN ] MHD: Wiping existing primary data before full refresh. [2025-09-29T19:53:26.010700] [INFO ] [LOCAL ] MHD: Starting deletion of primary data. [2025-09-29T19:53:26.011158] [DEBUG] [LOCAL ] MHD: Deleted primary data file. [2025-09-29T19:53:26.011220] [INFO ] [MAIN ] MHD: Starting full primary refresh. [2025-09-29T19:53:26.376746] [INFO ] [REMOTE ] MHD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:53:26.748156] [INFO ] [REMOTE ] MHD: Fetching primary data for 2024-12. [2025-09-29T19:53:27.548093] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-08. [2025-09-29T19:53:27.671739] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-29T19:53:27.746691] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-29T19:53:27.981305] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-29T19:53:28.348129] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-01. [2025-09-29T19:53:29.148125] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-04. [2025-09-29T19:53:29.326543] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-29T19:53:29.948190] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-09. [2025-09-29T19:53:30.498226] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-29T19:53:30.499225] [INFO ] [REMOTE ] MGRD: Full fetch complete (3478 records). [2025-09-29T19:53:30.499298] [DEBUG] [VALIDATOR ] MGRD: Validating primary data. [2025-09-29T19:53:30.753403] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-02. [2025-09-29T19:53:30.927134] [DEBUG] [VALIDATOR ] MGRD: All expected trading days are present. [2025-09-29T19:53:30.927249] [DEBUG] [VALIDATOR ] MGRD: Primary data validation passed. [2025-09-29T19:53:30.927468] [INFO ] [MAIN ] MGRD: Fetched primary data is valid. [2025-09-29T19:53:30.927580] [DEBUG] [LOCAL ] MGRD: Saving primary data. [2025-09-29T19:53:30.928135] [DEBUG] [LOCAL ] MGRD: Trimmed 3478 records to 2194 (keeping 200 days of data) [2025-09-29T19:53:30.974019] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-29T19:53:30.986509] [DEBUG] [LOCAL ] MGRD: Primary data saved (2194 records). [2025-09-29T19:53:30.987156] [INFO ] [MAIN ] MGRD: Full history saved. [2025-09-29T19:53:30.987298] [INFO ] [MAIN ] Update Progress: 1350/2371 symbols completed. MGRD took 38.5s. Estimated remaining: 2h 11m 12s. Rate: 7.8 symbols/min [2025-09-29T19:53:31.171980] [INFO ] [MAIN ] MHF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:53:31.185130] [DEBUG] [LOCAL ] MHF: Loaded 8713 existing records from primary storage. [2025-09-29T19:53:31.185373] [INFO ] [MAIN ] MHF: Loaded 8713 existing records. [2025-09-29T19:53:31.375828] [WARN ] [MAIN ] MHF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:53:31.376219] [INFO ] [MAIN ] MHF: Wiping existing primary data before full refresh. [2025-09-29T19:53:31.376267] [INFO ] [LOCAL ] MHF: Starting deletion of primary data. [2025-09-29T19:53:31.376494] [DEBUG] [LOCAL ] MHF: Deleted primary data file. [2025-09-29T19:53:31.376553] [INFO ] [MAIN ] MHF: Starting full primary refresh. [2025-09-29T19:53:31.552097] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-05. [2025-09-29T19:53:31.711067] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-29T19:53:31.790936] [INFO ] [REMOTE ] MHF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:53:32.348124] [INFO ] [REMOTE ] MHF: Fetching primary data for 2024-12. [2025-09-29T19:53:33.109611] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-29T19:53:33.148070] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-01. [2025-09-29T19:53:33.489318] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-29T19:53:33.921504] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-29T19:53:33.948186] [INFO ] [REMOTE ] MH: Fetching primary data for 2024-12. [2025-09-29T19:53:34.139061] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T19:53:34.139446] [WARN ] [REMOTE ] MH: No data returned for month 2024-12 [2025-09-29T19:53:34.139543] [FATAL] [REMOTE ] MH: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T19:53:34.139598] [FATAL] [MAIN ] MH: Failed to fetch primary data. [2025-09-29T19:53:34.139695] [WARN ] [MAIN ] MH: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T19:53:34.139797] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-09-29T19:53:34.139941] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-09-29T19:53:34.140011] [INFO ] [LOCAL ] MH: Starting deletion of derivative data. [2025-09-29T19:53:34.140084] [DEBUG] [LOCAL ] MH: No derivative data file found to delete. [2025-09-29T19:53:34.140156] [INFO ] [MAIN ] Update Progress: 1351/2371 symbols completed. MH took 12.8s. Estimated remaining: 2h 11m 0s. Rate: 7.8 symbols/min [2025-09-29T19:53:34.324581] [INFO ] [MAIN ] MHK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:53:34.378846] [DEBUG] [LOCAL ] MHK: Loaded 43076 existing records from primary storage. [2025-09-29T19:53:34.379175] [INFO ] [MAIN ] MHK: Loaded 43076 existing records. [2025-09-29T19:53:34.576676] [WARN ] [MAIN ] MHK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:53:34.576990] [INFO ] [MAIN ] MHK: Wiping existing primary data before full refresh. [2025-09-29T19:53:34.577104] [INFO ] [LOCAL ] MHK: Starting deletion of primary data. [2025-09-29T19:53:34.577693] [DEBUG] [LOCAL ] MHK: Deleted primary data file. [2025-09-29T19:53:34.577754] [INFO ] [MAIN ] MHK: Starting full primary refresh. [2025-09-29T19:53:34.752607] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-06. [2025-09-29T19:53:34.984069] [INFO ] [REMOTE ] MHK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:53:35.548157] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-02. [2025-09-29T19:53:36.348140] [INFO ] [REMOTE ] MHK: Fetching primary data for 2024-12. [2025-09-29T19:53:36.368040] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-29T19:53:36.518598] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-29T19:53:37.148130] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-07. [2025-09-29T19:53:37.788335] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-29T19:53:37.948158] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-03. [2025-09-29T19:53:38.666308] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-29T19:53:38.748132] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-01. [2025-09-29T19:53:38.873907] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-29T19:53:39.548130] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-04. [2025-09-29T19:53:40.297222] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-29T19:53:40.301606] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-29T19:53:40.348077] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-05. [2025-09-29T19:53:40.978599] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-29T19:53:41.148235] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-03. [2025-09-29T19:53:41.950403] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-08. [2025-09-29T19:53:41.954194] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-29T19:53:42.748121] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-06. [2025-09-29T19:53:43.548178] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-02. [2025-09-29T19:53:43.691378] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-29T19:53:43.726403] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-29T19:53:44.348155] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-04. [2025-09-29T19:53:45.073359] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-29T19:53:45.148108] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-03. [2025-09-29T19:53:45.317002] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-29T19:53:45.948166] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-09. [2025-09-29T19:53:46.748084] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-07. [2025-09-29T19:53:46.787757] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-29T19:53:47.548126] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-04. [2025-09-29T19:53:47.587878] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-29T19:53:47.809861] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-29T19:53:47.820917] [INFO ] [REMOTE ] MGY: Full fetch complete (75582 records). [2025-09-29T19:53:47.821081] [DEBUG] [VALIDATOR ] MGY: Validating primary data. [2025-09-29T19:53:48.247905] [DEBUG] [VALIDATOR ] MGY: All expected trading days are present. [2025-09-29T19:53:48.248030] [DEBUG] [VALIDATOR ] MGY: Primary data validation passed. [2025-09-29T19:53:48.249322] [INFO ] [MAIN ] MGY: Fetched primary data is valid. [2025-09-29T19:53:48.249405] [DEBUG] [LOCAL ] MGY: Saving primary data. [2025-09-29T19:53:48.252251] [DEBUG] [LOCAL ] MGY: Trimmed 75582 records to 52421 (keeping 200 days of data) [2025-09-29T19:53:48.348091] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-08. [2025-09-29T19:53:48.595241] [DEBUG] [LOCAL ] MGY: Primary data saved (52421 records). [2025-09-29T19:53:48.595398] [INFO ] [MAIN ] MGY: Full history saved. [2025-09-29T19:53:48.595490] [INFO ] [MAIN ] Update Progress: 1352/2371 symbols completed. MGY took 37.4s. Estimated remaining: 2h 10m 58s. Rate: 7.8 symbols/min [2025-09-29T19:53:48.797999] [INFO ] [MAIN ] MHLA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:53:48.798312] [DEBUG] [LOCAL ] MHLA: No existing data file found in primary storage. [2025-09-29T19:53:48.798372] [WARN ] [MAIN ] MHLA: No existing data found, performing full refresh instead. [2025-09-29T19:53:48.798510] [INFO ] [MAIN ] MHLA: Wiping existing primary data before full refresh. [2025-09-29T19:53:48.798606] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-09-29T19:53:48.798711] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-09-29T19:53:48.798798] [INFO ] [MAIN ] MHLA: Starting full primary refresh. [2025-09-29T19:53:49.152553] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-05. [2025-09-29T19:53:49.207945] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-29T19:53:49.207493] [INFO ] [REMOTE ] MHLA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:53:49.237937] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-29T19:53:49.948142] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2024-12. [2025-09-29T19:53:50.001921] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-29T19:53:50.453284] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-29T19:53:50.748134] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-01. [2025-09-29T19:53:51.092973] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-29T19:53:51.548164] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-06. [2025-09-29T19:53:52.348102] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-05. [2025-09-29T19:53:52.416509] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-29T19:53:53.148200] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-02. [2025-09-29T19:53:53.549523] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-29T19:53:53.823887] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-29T19:53:53.948151] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-03. [2025-09-29T19:53:54.293350] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-29T19:53:54.748130] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-07. [2025-09-29T19:53:55.548135] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-06. [2025-09-29T19:53:55.648404] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-29T19:53:56.348128] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-09. [2025-09-29T19:53:57.069398] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-29T19:53:57.148095] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-07. [2025-09-29T19:53:57.273953] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-29T19:53:57.276547] [INFO ] [REMOTE ] MHF: Full fetch complete (12724 records). [2025-09-29T19:53:57.276634] [DEBUG] [VALIDATOR ] MHF: Validating primary data. [2025-09-29T19:53:57.663295] [DEBUG] [VALIDATOR ] MHF: All expected trading days are present. [2025-09-29T19:53:57.663383] [DEBUG] [VALIDATOR ] MHF: Primary data validation passed. [2025-09-29T19:53:57.663796] [INFO ] [MAIN ] MHF: Fetched primary data is valid. [2025-09-29T19:53:57.663867] [DEBUG] [LOCAL ] MHF: Saving primary data. [2025-09-29T19:53:57.664463] [DEBUG] [LOCAL ] MHF: Trimmed 12724 records to 8646 (keeping 200 days of data) [2025-09-29T19:53:57.721511] [DEBUG] [LOCAL ] MHF: Primary data saved (8646 records). [2025-09-29T19:53:57.721687] [INFO ] [MAIN ] MHF: Full history saved. [2025-09-29T19:53:57.721794] [INFO ] [MAIN ] Update Progress: 1353/2371 symbols completed. MHF took 26.7s. Estimated remaining: 2h 10m 51s. Rate: 7.8 symbols/min [2025-09-29T19:53:57.901080] [INFO ] [MAIN ] MHN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:53:57.912750] [DEBUG] [LOCAL ] MHN: Loaded 7867 existing records from primary storage. [2025-09-29T19:53:57.912972] [INFO ] [MAIN ] MHN: Loaded 7867 existing records. [2025-09-29T19:53:57.956691] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-04. [2025-09-29T19:53:58.110296] [WARN ] [MAIN ] MHN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:53:58.110616] [INFO ] [MAIN ] MHN: Wiping existing primary data before full refresh. [2025-09-29T19:53:58.110730] [INFO ] [LOCAL ] MHN: Starting deletion of primary data. [2025-09-29T19:53:58.111090] [DEBUG] [LOCAL ] MHN: Deleted primary data file. [2025-09-29T19:53:58.111171] [INFO ] [MAIN ] MHN: Starting full primary refresh. [2025-09-29T19:53:58.491802] [INFO ] [REMOTE ] MHN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:53:58.700428] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-29T19:53:58.741826] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-29T19:53:58.751965] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-08. [2025-09-29T19:53:59.548103] [INFO ] [REMOTE ] MHN: Fetching primary data for 2024-12. [2025-09-29T19:53:59.604078] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-29T19:54:00.348112] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-09. [2025-09-29T19:54:00.595814] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-29T19:54:01.148119] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-01. [2025-09-29T19:54:01.450356] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-29T19:54:01.453935] [INFO ] [REMOTE ] MHD: Full fetch complete (18821 records). [2025-09-29T19:54:01.454015] [DEBUG] [VALIDATOR ] MHD: Validating primary data. [2025-09-29T19:54:01.856099] [DEBUG] [VALIDATOR ] MHD: All expected trading days are present. [2025-09-29T19:54:01.856217] [DEBUG] [VALIDATOR ] MHD: Primary data validation passed. [2025-09-29T19:54:01.856991] [INFO ] [MAIN ] MHD: Fetched primary data is valid. [2025-09-29T19:54:01.857103] [DEBUG] [LOCAL ] MHD: Saving primary data. [2025-09-29T19:54:01.857770] [DEBUG] [LOCAL ] MHD: Trimmed 18821 records to 12230 (keeping 200 days of data) [2025-09-29T19:54:01.941179] [DEBUG] [LOCAL ] MHD: Primary data saved (12230 records). [2025-09-29T19:54:01.941322] [INFO ] [MAIN ] MHD: Full history saved. [2025-09-29T19:54:01.941410] [INFO ] [MAIN ] Update Progress: 1354/2371 symbols completed. MHD took 36.3s. Estimated remaining: 2h 10m 41s. Rate: 7.8 symbols/min [2025-09-29T19:54:01.953233] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-05. [2025-09-29T19:54:02.067182] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-29T19:54:02.155509] [INFO ] [MAIN ] MHO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:54:02.189850] [DEBUG] [LOCAL ] MHO: Loaded 24650 existing records from primary storage. [2025-09-29T19:54:02.190156] [INFO ] [MAIN ] MHO: Loaded 24650 existing records. [2025-09-29T19:54:02.418968] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-29T19:54:02.422954] [WARN ] [MAIN ] MHO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:54:02.423208] [INFO ] [MAIN ] MHO: Wiping existing primary data before full refresh. [2025-09-29T19:54:02.423270] [INFO ] [LOCAL ] MHO: Starting deletion of primary data. [2025-09-29T19:54:02.425347] [DEBUG] [LOCAL ] MHO: Deleted primary data file. [2025-09-29T19:54:02.425409] [INFO ] [MAIN ] MHO: Starting full primary refresh. [2025-09-29T19:54:02.753264] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-02. [2025-09-29T19:54:02.813593] [INFO ] [REMOTE ] MHO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:54:03.541524] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-29T19:54:03.548055] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-03. [2025-09-29T19:54:04.307827] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-29T19:54:04.348096] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-08. [2025-09-29T19:54:05.148122] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-06. [2025-09-29T19:54:05.494520] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-29T19:54:05.882325] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-29T19:54:05.948111] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-04. [2025-09-29T19:54:06.748100] [INFO ] [REMOTE ] MHO: Fetching primary data for 2024-12. [2025-09-29T19:54:06.784487] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-29T19:54:07.548106] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-05. [2025-09-29T19:54:08.111239] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-29T19:54:08.293012] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-29T19:54:08.348114] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-01. [2025-09-29T19:54:09.148116] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-06. [2025-09-29T19:54:09.673082] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-29T19:54:09.793198] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-29T19:54:09.948257] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-07. [2025-09-29T19:54:10.748105] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-09. [2025-09-29T19:54:10.799302] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-29T19:54:11.548115] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-02. [2025-09-29T19:54:12.348125] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-07. [2025-09-29T19:54:12.492259] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-29T19:54:12.501546] [INFO ] [REMOTE ] MHK: Full fetch complete (60724 records). [2025-09-29T19:54:12.501710] [DEBUG] [VALIDATOR ] MHK: Validating primary data. [2025-09-29T19:54:12.613136] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-09-29T19:54:12.919607] [DEBUG] [VALIDATOR ] MHK: All expected trading days are present. [2025-09-29T19:54:12.919760] [DEBUG] [VALIDATOR ] MHK: Primary data validation passed. [2025-09-29T19:54:12.921043] [INFO ] [MAIN ] MHK: Fetched primary data is valid. [2025-09-29T19:54:12.921215] [DEBUG] [LOCAL ] MHK: Saving primary data. [2025-09-29T19:54:12.922662] [DEBUG] [LOCAL ] MHK: Trimmed 60724 records to 42333 (keeping 200 days of data) [2025-09-29T19:54:13.040598] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-29T19:54:13.167303] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-03. [2025-09-29T19:54:13.222627] [DEBUG] [LOCAL ] MHK: Primary data saved (42333 records). [2025-09-29T19:54:13.222800] [INFO ] [MAIN ] MHK: Full history saved. [2025-09-29T19:54:13.222895] [INFO ] [MAIN ] Update Progress: 1355/2371 symbols completed. MHK took 39.1s. Estimated remaining: 2h 10m 36s. Rate: 7.8 symbols/min [2025-09-29T19:54:13.402443] [INFO ] [MAIN ] MIAX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:54:13.402674] [DEBUG] [LOCAL ] MIAX: No existing data file found in primary storage. [2025-09-29T19:54:13.402731] [WARN ] [MAIN ] MIAX: No existing data found, performing full refresh instead. [2025-09-29T19:54:13.402844] [INFO ] [MAIN ] MIAX: Wiping existing primary data before full refresh. [2025-09-29T19:54:13.402887] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-09-29T19:54:13.402935] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-09-29T19:54:13.403012] [INFO ] [MAIN ] MIAX: Starting full primary refresh. [2025-09-29T19:54:13.777786] [INFO ] [REMOTE ] MIAX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:54:13.948122] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2024-12. [2025-09-29T19:54:14.152605] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T19:54:14.153030] [WARN ] [REMOTE ] MIAX: No data returned for month 2024-12 [2025-09-29T19:54:14.153126] [FATAL] [REMOTE ] MIAX: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T19:54:14.153174] [FATAL] [MAIN ] MIAX: Failed to fetch primary data. [2025-09-29T19:54:14.153212] [WARN ] [MAIN ] MIAX: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T19:54:14.153281] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-09-29T19:54:14.153349] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-09-29T19:54:14.153388] [INFO ] [LOCAL ] MIAX: Starting deletion of derivative data. [2025-09-29T19:54:14.153429] [DEBUG] [LOCAL ] MIAX: No derivative data file found to delete. [2025-09-29T19:54:14.153478] [INFO ] [MAIN ] Update Progress: 1356/2371 symbols completed. MIAX took 0.9s. Estimated remaining: 2h 10m 23s. Rate: 7.8 symbols/min [2025-09-29T19:54:14.349792] [INFO ] [MAIN ] MIN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:54:14.378261] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-29T19:54:14.399924] [DEBUG] [LOCAL ] MIN: Loaded 13224 existing records from primary storage. [2025-09-29T19:54:14.400210] [INFO ] [MAIN ] MIN: Loaded 13224 existing records. [2025-09-29T19:54:14.594626] [WARN ] [MAIN ] MIN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:54:14.594913] [INFO ] [MAIN ] MIN: Wiping existing primary data before full refresh. [2025-09-29T19:54:14.594964] [INFO ] [LOCAL ] MIN: Starting deletion of primary data. [2025-09-29T19:54:14.595340] [DEBUG] [LOCAL ] MIN: Deleted primary data file. [2025-09-29T19:54:14.595404] [INFO ] [MAIN ] MIN: Starting full primary refresh. [2025-09-29T19:54:14.753320] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-04. [2025-09-29T19:54:14.982002] [INFO ] [REMOTE ] MIN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:54:15.548121] [INFO ] [REMOTE ] MIN: Fetching primary data for 2024-12. [2025-09-29T19:54:16.010974] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-29T19:54:16.348108] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-05. [2025-09-29T19:54:16.484328] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-29T19:54:17.148178] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-08. [2025-09-29T19:54:17.461898] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-29T19:54:17.513208] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-29T19:54:17.948166] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-06. [2025-09-29T19:54:18.748128] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-09. [2025-09-29T19:54:19.008239] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-29T19:54:19.208442] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-29T19:54:19.209362] [INFO ] [REMOTE ] MHLA: Full fetch complete (1550 records). [2025-09-29T19:54:19.209436] [DEBUG] [VALIDATOR ] MHLA: Validating primary data. [2025-09-29T19:54:19.411155] [WARN ] [VALIDATOR ] MHLA: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-29T19:54:19.411372] [FATAL] [MAIN ] MHLA: Fetched primary data is invalid. Refusing to save it. [2025-09-29T19:54:19.411445] [WARN ] [MAIN ] MHLA: Deleting existing primary and derivative data due to validation failure. [2025-09-29T19:54:19.411518] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-09-29T19:54:19.411586] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-09-29T19:54:19.411625] [INFO ] [LOCAL ] MHLA: Starting deletion of derivative data. [2025-09-29T19:54:19.411735] [DEBUG] [LOCAL ] MHLA: No derivative data file found to delete. [2025-09-29T19:54:19.411822] [INFO ] [MAIN ] Update Progress: 1357/2371 symbols completed. MHLA took 30.8s. Estimated remaining: 2h 10m 13s. Rate: 7.8 symbols/min [2025-09-29T19:54:19.548141] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-01. [2025-09-29T19:54:20.348157] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-07. [2025-09-29T19:54:20.385878] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-29T19:54:21.148155] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-08. [2025-09-29T19:54:21.625709] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-29T19:54:21.878955] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-29T19:54:21.948131] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-08. [2025-09-29T19:54:22.748138] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-09. [2025-09-29T19:54:23.226881] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-29T19:54:23.548122] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-09. [2025-09-29T19:54:23.574777] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-29T19:54:23.577218] [INFO ] [REMOTE ] MHN: Full fetch complete (11828 records). [2025-09-29T19:54:23.577304] [DEBUG] [VALIDATOR ] MHN: Validating primary data. [2025-09-29T19:54:24.015154] [DEBUG] [VALIDATOR ] MHN: All expected trading days are present. [2025-09-29T19:54:24.015305] [DEBUG] [VALIDATOR ] MHN: Primary data validation passed. [2025-09-29T19:54:24.015703] [INFO ] [MAIN ] MHN: Fetched primary data is valid. [2025-09-29T19:54:24.015782] [DEBUG] [LOCAL ] MHN: Saving primary data. [2025-09-29T19:54:24.016319] [DEBUG] [LOCAL ] MHN: Trimmed 11828 records to 7704 (keeping 200 days of data) [2025-09-29T19:54:24.078939] [DEBUG] [LOCAL ] MHN: Primary data saved (7704 records). [2025-09-29T19:54:24.079138] [INFO ] [MAIN ] MHN: Full history saved. [2025-09-29T19:54:24.079287] [INFO ] [MAIN ] Update Progress: 1358/2371 symbols completed. MHN took 26.4s. Estimated remaining: 2h 10m 3s. Rate: 7.8 symbols/min [2025-09-29T19:54:24.348149] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-02. [2025-09-29T19:54:24.880917] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-29T19:54:24.886733] [INFO ] [REMOTE ] MHO: Full fetch complete (37412 records). [2025-09-29T19:54:24.886891] [DEBUG] [VALIDATOR ] MHO: Validating primary data. [2025-09-29T19:54:25.134590] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-29T19:54:25.175461] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-03. [2025-09-29T19:54:25.323556] [DEBUG] [VALIDATOR ] MHO: All expected trading days are present. [2025-09-29T19:54:25.323668] [DEBUG] [VALIDATOR ] MHO: Primary data validation passed. [2025-09-29T19:54:25.324524] [INFO ] [MAIN ] MHO: Fetched primary data is valid. [2025-09-29T19:54:25.324578] [DEBUG] [LOCAL ] MHO: Saving primary data. [2025-09-29T19:54:25.325497] [DEBUG] [LOCAL ] MHO: Trimmed 37412 records to 24091 (keeping 200 days of data) [2025-09-29T19:54:25.488329] [DEBUG] [LOCAL ] MHO: Primary data saved (24091 records). [2025-09-29T19:54:25.488495] [INFO ] [MAIN ] MHO: Full history saved. [2025-09-29T19:54:25.488596] [INFO ] [MAIN ] Update Progress: 1359/2371 symbols completed. MHO took 23.5s. Estimated remaining: 2h 9m 51s. Rate: 7.8 symbols/min [2025-09-29T19:54:26.069028] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-29T19:54:26.071806] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-04. [2025-09-29T19:54:26.941170] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-29T19:54:26.944689] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-05. [2025-09-29T19:54:27.723085] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-29T19:54:27.726471] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-06. [2025-09-29T19:54:28.564992] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-29T19:54:28.568804] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-07. [2025-09-29T19:54:29.615401] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-29T19:54:29.620914] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-08. [2025-09-29T19:54:30.527149] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-29T19:54:30.531192] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-09. [2025-09-29T19:54:31.464560] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-29T19:54:31.467247] [INFO ] [REMOTE ] MIN: Full fetch complete (17709 records). [2025-09-29T19:54:31.467329] [DEBUG] [VALIDATOR ] MIN: Validating primary data. [2025-09-29T19:54:31.858162] [DEBUG] [VALIDATOR ] MIN: All expected trading days are present. [2025-09-29T19:54:31.858249] [DEBUG] [VALIDATOR ] MIN: Primary data validation passed. [2025-09-29T19:54:31.858735] [INFO ] [MAIN ] MIN: Fetched primary data is valid. [2025-09-29T19:54:31.858801] [DEBUG] [LOCAL ] MIN: Saving primary data. [2025-09-29T19:54:31.859440] [DEBUG] [LOCAL ] MIN: Trimmed 17709 records to 13101 (keeping 200 days of data) [2025-09-29T19:54:31.951982] [DEBUG] [LOCAL ] MIN: Primary data saved (13101 records). [2025-09-29T19:54:31.952173] [INFO ] [MAIN ] MIN: Full history saved. [2025-09-29T19:54:31.952277] [INFO ] [MAIN ] Update Progress: 1360/2371 symbols completed. MIN took 17.8s. Estimated remaining: 2h 9m 42s. Rate: 7.8 symbols/min [2025-09-29T19:54:32.671241] [INFO ] [MAIN ] MIR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:54:32.567767] [INFO ] [MAIN ] MITP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:54:32.698731] [INFO ] [MAIN ] MITT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:54:32.723177] [INFO ] [MAIN ] MITN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:54:32.724111] [DEBUG] [LOCAL ] MITN: No existing data file found in primary storage. [2025-09-29T19:54:32.724219] [WARN ] [MAIN ] MITN: No existing data found, performing full refresh instead. [2025-09-29T19:54:32.725360] [INFO ] [MAIN ] MITN: Wiping existing primary data before full refresh. [2025-09-29T19:54:32.725517] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-09-29T19:54:32.728677] [DEBUG] [LOCAL ] MITP: Loaded 2467 existing records from primary storage. [2025-09-29T19:54:32.729029] [INFO ] [MAIN ] MITP: Loaded 2467 existing records. [2025-09-29T19:54:32.725720] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-09-29T19:54:32.734674] [INFO ] [MAIN ] MITN: Starting full primary refresh. [2025-09-29T19:54:32.995251] [DEBUG] [LOCAL ] MITT: Loaded 23379 existing records from primary storage. [2025-09-29T19:54:32.997222] [INFO ] [MAIN ] MITT: Loaded 23379 existing records. [2025-09-29T19:54:33.260436] [DEBUG] [LOCAL ] MIR: Loaded 51622 existing records from primary storage. [2025-09-29T19:54:33.247558] [WARN ] [MAIN ] MITP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:54:33.324696] [INFO ] [MAIN ] MIR: Loaded 51622 existing records. [2025-09-29T19:54:33.374621] [INFO ] [MAIN ] MITP: Wiping existing primary data before full refresh. [2025-09-29T19:54:33.386877] [INFO ] [LOCAL ] MITP: Starting deletion of primary data. [2025-09-29T19:54:33.499744] [DEBUG] [LOCAL ] MITP: Deleted primary data file. [2025-09-29T19:54:33.555767] [INFO ] [MAIN ] MITP: Starting full primary refresh. [2025-09-29T19:54:33.629894] [WARN ] [MAIN ] MITT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:54:33.693016] [INFO ] [MAIN ] MITT: Wiping existing primary data before full refresh. [2025-09-29T19:54:33.795808] [INFO ] [LOCAL ] MITT: Starting deletion of primary data. [2025-09-29T19:54:33.871720] [INFO ] [REMOTE ] MITN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:54:33.898103] [INFO ] [REMOTE ] MITN: Fetching primary data for 2024-12. [2025-09-29T19:54:33.867896] [DEBUG] [LOCAL ] MITT: Deleted primary data file. [2025-09-29T19:54:33.928606] [INFO ] [MAIN ] MITT: Starting full primary refresh. [2025-09-29T19:54:34.076403] [WARN ] [MAIN ] MIR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:54:34.108725] [INFO ] [MAIN ] MIR: Wiping existing primary data before full refresh. [2025-09-29T19:54:34.155751] [INFO ] [LOCAL ] MIR: Starting deletion of primary data. [2025-09-29T19:54:34.210340] [DEBUG] [LOCAL ] MIR: Deleted primary data file. [2025-09-29T19:54:34.210495] [INFO ] [MAIN ] MIR: Starting full primary refresh. [2025-09-29T19:54:34.497206] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-29T19:54:34.514398] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-01. [2025-09-29T19:54:35.134207] [INFO ] [REMOTE ] MITP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:54:35.161031] [INFO ] [REMOTE ] MITP: Fetching primary data for 2024-12. [2025-09-29T19:54:35.228284] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-29T19:54:35.271041] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-02. [2025-09-29T19:54:35.284995] [INFO ] [REMOTE ] MITT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:54:35.291508] [INFO ] [REMOTE ] MITT: Fetching primary data for 2024-12. [2025-09-29T19:54:35.377083] [INFO ] [REMOTE ] MIR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:54:35.377459] [INFO ] [REMOTE ] MIR: Fetching primary data for 2024-12. [2025-09-29T19:54:35.799405] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-29T19:54:35.800691] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-03. [2025-09-29T19:54:35.837590] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-29T19:54:36.342694] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-29T19:54:36.348062] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-04. [2025-09-29T19:54:36.588085] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-29T19:54:36.923151] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-29T19:54:37.122227] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-29T19:54:37.148131] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-05. [2025-09-29T19:54:37.554465] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-29T19:54:37.948130] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-01. [2025-09-29T19:54:38.748142] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-01. [2025-09-29T19:54:39.548107] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-06. [2025-09-29T19:54:39.677405] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-29T19:54:39.805176] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-09-29T19:54:39.934305] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-29T19:54:40.348104] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-01. [2025-09-29T19:54:40.773439] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-29T19:54:41.148156] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-02. [2025-09-29T19:54:41.629276] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-29T19:54:41.948144] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-03. [2025-09-29T19:54:42.386962] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-29T19:54:42.748134] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-07. [2025-09-29T19:54:43.072385] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-29T19:54:43.548151] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-04. [2025-09-29T19:54:43.925937] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-29T19:54:44.348109] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-05. [2025-09-29T19:54:44.908128] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-29T19:54:45.148148] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-06. [2025-09-29T19:54:45.580174] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-29T19:54:45.948129] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-07. [2025-09-29T19:54:46.373579] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-29T19:54:46.748120] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-08. [2025-09-29T19:54:47.229475] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-29T19:54:47.548119] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-08. [2025-09-29T19:54:47.979008] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-29T19:54:48.348148] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-09. [2025-09-29T19:54:48.919831] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-29T19:54:48.921197] [INFO ] [REMOTE ] MITP: Full fetch complete (3349 records). [2025-09-29T19:54:48.921344] [DEBUG] [VALIDATOR ] MITP: Validating primary data. [2025-09-29T19:54:49.153274] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-09. [2025-09-29T19:54:49.313304] [DEBUG] [VALIDATOR ] MITP: All expected trading days are present. [2025-09-29T19:54:49.313423] [DEBUG] [VALIDATOR ] MITP: Primary data validation passed. [2025-09-29T19:54:49.313559] [INFO ] [MAIN ] MITP: Fetched primary data is valid. [2025-09-29T19:54:49.313630] [DEBUG] [LOCAL ] MITP: Saving primary data. [2025-09-29T19:54:49.314077] [DEBUG] [LOCAL ] MITP: Trimmed 3349 records to 2411 (keeping 200 days of data) [2025-09-29T19:54:49.331881] [DEBUG] [LOCAL ] MITP: Primary data saved (2411 records). [2025-09-29T19:54:49.332006] [INFO ] [MAIN ] MITP: Full history saved. [2025-09-29T19:54:49.332110] [INFO ] [MAIN ] Update Progress: 1361/2371 symbols completed. MITP took 17.4s. Estimated remaining: 2h 9m 42s. Rate: 7.8 symbols/min [2025-09-29T19:54:49.506760] [INFO ] [MAIN ] MIY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:54:49.518729] [DEBUG] [LOCAL ] MIY: Loaded 6084 existing records from primary storage. [2025-09-29T19:54:49.518958] [INFO ] [MAIN ] MIY: Loaded 6084 existing records. [2025-09-29T19:54:49.711700] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-29T19:54:49.711481] [WARN ] [MAIN ] MIY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:54:49.712062] [INFO ] [MAIN ] MIY: Wiping existing primary data before full refresh. [2025-09-29T19:54:49.713121] [INFO ] [REMOTE ] MITN: Full fetch complete (2306 records). [2025-09-29T19:54:49.713322] [DEBUG] [VALIDATOR ] MITN: Validating primary data. [2025-09-29T19:54:49.713242] [INFO ] [LOCAL ] MIY: Starting deletion of primary data. [2025-09-29T19:54:49.774909] [DEBUG] [LOCAL ] MIY: Deleted primary data file. [2025-09-29T19:54:49.796693] [INFO ] [MAIN ] MIY: Starting full primary refresh. [2025-09-29T19:54:49.951335] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-02. [2025-09-29T19:54:50.091510] [WARN ] [VALIDATOR ] MITN: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-29T19:54:50.126105] [FATAL] [MAIN ] MITN: Fetched primary data is invalid. Refusing to save it. [2025-09-29T19:54:50.137636] [WARN ] [MAIN ] MITN: Deleting existing primary and derivative data due to validation failure. [2025-09-29T19:54:50.186700] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-09-29T19:54:50.216100] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-09-29T19:54:50.232069] [INFO ] [LOCAL ] MITN: Starting deletion of derivative data. [2025-09-29T19:54:50.242637] [DEBUG] [LOCAL ] MITN: No derivative data file found to delete. [2025-09-29T19:54:50.248473] [INFO ] [MAIN ] Update Progress: 1362/2371 symbols completed. MITN took 18.3s. Estimated remaining: 2h 9m 29s. Rate: 7.8 symbols/min [2025-09-29T19:54:50.431547] [INFO ] [REMOTE ] MIY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:54:50.515574] [INFO ] [MAIN ] MKC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:54:50.590438] [DEBUG] [LOCAL ] MKC: Loaded 53204 existing records from primary storage. [2025-09-29T19:54:50.590830] [INFO ] [MAIN ] MKC: Loaded 53204 existing records. [2025-09-29T19:54:50.756793] [INFO ] [REMOTE ] MIY: Fetching primary data for 2024-12. [2025-09-29T19:54:50.781581] [WARN ] [MAIN ] MKC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:54:50.781863] [INFO ] [MAIN ] MKC: Wiping existing primary data before full refresh. [2025-09-29T19:54:50.781910] [INFO ] [LOCAL ] MKC: Starting deletion of primary data. [2025-09-29T19:54:50.783436] [DEBUG] [LOCAL ] MKC: Deleted primary data file. [2025-09-29T19:54:50.783603] [INFO ] [MAIN ] MKC: Starting full primary refresh. [2025-09-29T19:54:51.144227] [INFO ] [REMOTE ] MKC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:54:51.548088] [INFO ] [REMOTE ] MKC: Fetching primary data for 2024-12. [2025-09-29T19:54:51.567307] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-29T19:54:51.637795] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-29T19:54:52.348153] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-02. [2025-09-29T19:54:53.148083] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-03. [2025-09-29T19:54:53.262422] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-29T19:54:53.474413] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-29T19:54:53.948157] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-01. [2025-09-29T19:54:54.748107] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-03. [2025-09-29T19:54:54.805740] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-29T19:54:54.839023] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-29T19:54:55.548188] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-04. [2025-09-29T19:54:56.039302] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-29T19:54:56.348163] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-01. [2025-09-29T19:54:57.148099] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-04. [2025-09-29T19:54:57.232878] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-29T19:54:57.948115] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-02. [2025-09-29T19:54:57.996981] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-29T19:54:58.455828] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-29T19:54:58.500574] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-29T19:54:58.748118] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-03. [2025-09-29T19:54:59.362479] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-29T19:54:59.548108] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-05. [2025-09-29T19:55:00.348107] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-04. [2025-09-29T19:55:01.023426] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-29T19:55:01.148155] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-02. [2025-09-29T19:55:01.224175] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-29T19:55:01.948150] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-05. [2025-09-29T19:55:02.748119] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-05. [2025-09-29T19:55:02.855691] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-29T19:55:02.900421] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-29T19:55:03.339859] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-29T19:55:03.548114] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-06. [2025-09-29T19:55:04.211436] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-29T19:55:04.348139] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-06. [2025-09-29T19:55:05.148113] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-06. [2025-09-29T19:55:05.948133] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-03. [2025-09-29T19:55:06.022706] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-29T19:55:06.363416] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-29T19:55:06.748151] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-07. [2025-09-29T19:55:07.548091] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-07. [2025-09-29T19:55:07.987008] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-29T19:55:08.028201] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-29T19:55:08.348109] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-08. [2025-09-29T19:55:09.148157] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-04. [2025-09-29T19:55:09.351929] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-29T19:55:09.563042] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-29T19:55:09.948137] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-09. [2025-09-29T19:55:10.748113] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-08. [2025-09-29T19:55:11.058578] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-29T19:55:11.229726] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-29T19:55:11.234683] [INFO ] [REMOTE ] MITT: Full fetch complete (34964 records). [2025-09-29T19:55:11.234795] [DEBUG] [VALIDATOR ] MITT: Validating primary data. [2025-09-29T19:55:11.548449] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-05. [2025-09-29T19:55:11.648179] [DEBUG] [VALIDATOR ] MITT: All expected trading days are present. [2025-09-29T19:55:11.648299] [DEBUG] [VALIDATOR ] MITT: Primary data validation passed. [2025-09-29T19:55:11.649308] [INFO ] [MAIN ] MITT: Fetched primary data is valid. [2025-09-29T19:55:11.649382] [DEBUG] [LOCAL ] MITT: Saving primary data. [2025-09-29T19:55:11.650405] [DEBUG] [LOCAL ] MITT: Trimmed 34964 records to 22903 (keeping 200 days of data) [2025-09-29T19:55:11.800377] [DEBUG] [LOCAL ] MITT: Primary data saved (22903 records). [2025-09-29T19:55:11.800517] [INFO ] [MAIN ] MITT: Full history saved. [2025-09-29T19:55:11.800606] [INFO ] [MAIN ] Update Progress: 1363/2371 symbols completed. MITT took 39.8s. Estimated remaining: 2h 9m 32s. Rate: 7.8 symbols/min [2025-09-29T19:55:11.975828] [INFO ] [MAIN ] MKL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:55:12.018382] [DEBUG] [LOCAL ] MKL: Loaded 34588 existing records from primary storage. [2025-09-29T19:55:12.018771] [INFO ] [MAIN ] MKL: Loaded 34588 existing records. [2025-09-29T19:55:12.251537] [WARN ] [MAIN ] MKL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:55:12.251813] [INFO ] [MAIN ] MKL: Wiping existing primary data before full refresh. [2025-09-29T19:55:12.251862] [INFO ] [LOCAL ] MKL: Starting deletion of primary data. [2025-09-29T19:55:12.252224] [DEBUG] [LOCAL ] MKL: Deleted primary data file. [2025-09-29T19:55:12.252285] [INFO ] [MAIN ] MKL: Starting full primary refresh. [2025-09-29T19:55:12.354428] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-07. [2025-09-29T19:55:12.630999] [INFO ] [REMOTE ] MKL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:55:12.660838] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-29T19:55:13.148086] [INFO ] [REMOTE ] MKL: Fetching primary data for 2024-12. [2025-09-29T19:55:13.164341] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-29T19:55:13.315964] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-29T19:55:13.948117] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-06. [2025-09-29T19:55:14.213459] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-29T19:55:14.748117] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-01. [2025-09-29T19:55:15.528907] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-29T19:55:15.548085] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-07. [2025-09-29T19:55:16.179375] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-29T19:55:16.348118] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-08. [2025-09-29T19:55:16.967076] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-29T19:55:17.148107] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-09. [2025-09-29T19:55:17.264974] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-29T19:55:17.948164] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-08. [2025-09-29T19:55:18.748141] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-02. [2025-09-29T19:55:19.249357] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-29T19:55:19.260506] [INFO ] [REMOTE ] MIR: Full fetch complete (73418 records). [2025-09-29T19:55:19.260740] [DEBUG] [VALIDATOR ] MIR: Validating primary data. [2025-09-29T19:55:19.553180] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-09. [2025-09-29T19:55:19.690123] [DEBUG] [VALIDATOR ] MIR: All expected trading days are present. [2025-09-29T19:55:19.690233] [DEBUG] [VALIDATOR ] MIR: Primary data validation passed. [2025-09-29T19:55:19.691399] [INFO ] [MAIN ] MIR: Fetched primary data is valid. [2025-09-29T19:55:19.691485] [DEBUG] [LOCAL ] MIR: Saving primary data. [2025-09-29T19:55:19.693536] [DEBUG] [LOCAL ] MIR: Trimmed 73418 records to 50898 (keeping 200 days of data) [2025-09-29T19:55:19.726827] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-29T19:55:20.058892] [DEBUG] [LOCAL ] MIR: Primary data saved (50898 records). [2025-09-29T19:55:20.059153] [INFO ] [MAIN ] MIR: Full history saved. [2025-09-29T19:55:20.059300] [INFO ] [MAIN ] Update Progress: 1364/2371 symbols completed. MIR took 48.1s. Estimated remaining: 2h 9m 24s. Rate: 7.8 symbols/min [2025-09-29T19:55:20.260873] [INFO ] [MAIN ] MLI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:55:20.262821] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-29T19:55:20.324502] [DEBUG] [LOCAL ] MLI: Loaded 44447 existing records from primary storage. [2025-09-29T19:55:20.324886] [INFO ] [MAIN ] MLI: Loaded 44447 existing records. [2025-09-29T19:55:20.355540] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-09. [2025-09-29T19:55:20.443437] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-29T19:55:20.452928] [INFO ] [REMOTE ] MIY: Full fetch complete (9030 records). [2025-09-29T19:55:20.463458] [DEBUG] [VALIDATOR ] MIY: Validating primary data. [2025-09-29T19:55:20.610575] [WARN ] [MAIN ] MLI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:55:20.653814] [INFO ] [MAIN ] MLI: Wiping existing primary data before full refresh. [2025-09-29T19:55:20.659046] [INFO ] [LOCAL ] MLI: Starting deletion of primary data. [2025-09-29T19:55:20.687448] [DEBUG] [LOCAL ] MLI: Deleted primary data file. [2025-09-29T19:55:20.687572] [INFO ] [MAIN ] MLI: Starting full primary refresh. [2025-09-29T19:55:21.162075] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-03. [2025-09-29T19:55:21.281889] [DEBUG] [VALIDATOR ] MIY: All expected trading days are present. [2025-09-29T19:55:21.286393] [DEBUG] [VALIDATOR ] MIY: Primary data validation passed. [2025-09-29T19:55:21.286759] [INFO ] [MAIN ] MIY: Fetched primary data is valid. [2025-09-29T19:55:21.292598] [DEBUG] [LOCAL ] MIY: Saving primary data. [2025-09-29T19:55:21.308785] [DEBUG] [LOCAL ] MIY: Trimmed 9030 records to 5996 (keeping 200 days of data) [2025-09-29T19:55:21.412850] [INFO ] [REMOTE ] MLI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:55:21.421830] [DEBUG] [LOCAL ] MIY: Primary data saved (5996 records). [2025-09-29T19:55:21.422029] [INFO ] [MAIN ] MIY: Full history saved. [2025-09-29T19:55:21.422204] [INFO ] [MAIN ] Update Progress: 1365/2371 symbols completed. MIY took 32.1s. Estimated remaining: 2h 9m 12s. Rate: 7.8 symbols/min [2025-09-29T19:55:21.600780] [INFO ] [MAIN ] MLM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:55:21.643921] [DEBUG] [LOCAL ] MLM: Loaded 31068 existing records from primary storage. [2025-09-29T19:55:21.644224] [INFO ] [MAIN ] MLM: Loaded 31068 existing records. [2025-09-29T19:55:21.842030] [WARN ] [MAIN ] MLM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:55:21.842246] [INFO ] [MAIN ] MLM: Wiping existing primary data before full refresh. [2025-09-29T19:55:21.842297] [INFO ] [LOCAL ] MLM: Starting deletion of primary data. [2025-09-29T19:55:21.842864] [DEBUG] [LOCAL ] MLM: Deleted primary data file. [2025-09-29T19:55:21.842930] [INFO ] [MAIN ] MLM: Starting full primary refresh. [2025-09-29T19:55:21.949464] [INFO ] [REMOTE ] MLI: Fetching primary data for 2024-12. [2025-09-29T19:55:22.234366] [INFO ] [REMOTE ] MLM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:55:22.267894] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-29T19:55:22.280353] [INFO ] [REMOTE ] MKC: Full fetch complete (75548 records). [2025-09-29T19:55:22.280524] [DEBUG] [VALIDATOR ] MKC: Validating primary data. [2025-09-29T19:55:22.753748] [INFO ] [REMOTE ] MLM: Fetching primary data for 2024-12. [2025-09-29T19:55:22.775250] [DEBUG] [VALIDATOR ] MKC: All expected trading days are present. [2025-09-29T19:55:22.775564] [DEBUG] [VALIDATOR ] MKC: Primary data validation passed. [2025-09-29T19:55:22.776957] [INFO ] [MAIN ] MKC: Fetched primary data is valid. [2025-09-29T19:55:22.777839] [DEBUG] [LOCAL ] MKC: Saving primary data. [2025-09-29T19:55:22.786819] [DEBUG] [LOCAL ] MKC: Trimmed 75548 records to 52432 (keeping 200 days of data) [2025-09-29T19:55:22.801113] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-29T19:55:23.145408] [DEBUG] [LOCAL ] MKC: Primary data saved (52432 records). [2025-09-29T19:55:23.145568] [INFO ] [MAIN ] MKC: Full history saved. [2025-09-29T19:55:23.145713] [INFO ] [MAIN ] Update Progress: 1366/2371 symbols completed. MKC took 32.9s. Estimated remaining: 2h 8m 60s. Rate: 7.8 symbols/min [2025-09-29T19:55:23.334546] [INFO ] [MAIN ] MLNK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:55:23.371383] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-29T19:55:23.401170] [DEBUG] [LOCAL ] MLNK: Loaded 25921 existing records from primary storage. [2025-09-29T19:55:23.401549] [INFO ] [MAIN ] MLNK: Loaded 25921 existing records. [2025-09-29T19:55:23.555531] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-01. [2025-09-29T19:55:23.589855] [WARN ] [MAIN ] MLNK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:55:23.590335] [INFO ] [MAIN ] MLNK: Wiping existing primary data before full refresh. [2025-09-29T19:55:23.590434] [INFO ] [LOCAL ] MLNK: Starting deletion of primary data. [2025-09-29T19:55:23.590890] [DEBUG] [LOCAL ] MLNK: Deleted primary data file. [2025-09-29T19:55:23.590966] [INFO ] [MAIN ] MLNK: Starting full primary refresh. [2025-09-29T19:55:23.987588] [INFO ] [REMOTE ] MLNK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:55:24.098081] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-29T19:55:24.348122] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-01. [2025-09-29T19:55:25.150098] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2024-12. [2025-09-29T19:55:25.155720] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-29T19:55:25.779402] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-29T19:55:25.938746] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-29T19:55:25.948077] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-01. [2025-09-29T19:55:26.748197] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-04. [2025-09-29T19:55:27.104524] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-29T19:55:27.548118] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-02. [2025-09-29T19:55:28.321147] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-29T19:55:28.348091] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-02. [2025-09-29T19:55:28.570017] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-29T19:55:29.148166] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-02. [2025-09-29T19:55:29.754526] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-29T19:55:29.948173] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-03. [2025-09-29T19:55:30.303237] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-29T19:55:30.748139] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-03. [2025-09-29T19:55:31.548099] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-05. [2025-09-29T19:55:31.603460] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-29T19:55:31.911089] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-29T19:55:32.348153] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-04. [2025-09-29T19:55:32.614735] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-29T19:55:33.148153] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-03. [2025-09-29T19:55:33.859573] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-29T19:55:33.948129] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-04. [2025-09-29T19:55:34.404196] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-29T19:55:34.748112] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-05. [2025-09-29T19:55:35.557567] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-04. [2025-09-29T19:55:35.580922] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-29T19:55:36.202490] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-29T19:55:36.348127] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-06. [2025-09-29T19:55:36.771725] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-29T19:55:37.148087] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-05. [2025-09-29T19:55:37.612055] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-29T19:55:37.948123] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-06. [2025-09-29T19:55:38.613114] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-29T19:55:38.748157] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-07. [2025-09-29T19:55:39.333391] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-29T19:55:39.548156] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-06. [2025-09-29T19:55:40.093403] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-29T19:55:40.348132] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-05. [2025-09-29T19:55:41.007098] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-29T19:55:41.148131] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-07. [2025-09-29T19:55:41.532934] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-29T19:55:41.948152] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-07. [2025-09-29T19:55:42.748103] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-06. [2025-09-29T19:55:42.863832] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-29T19:55:43.283321] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-29T19:55:43.548164] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-08. [2025-09-29T19:55:43.881062] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-29T19:55:44.348118] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-07. [2025-09-29T19:55:45.048272] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-29T19:55:45.148138] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-08. [2025-09-29T19:55:45.405173] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-29T19:55:45.948129] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-08. [2025-09-29T19:55:46.050368] [DEBUG] [REMOTE ] MLM: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-09-29T19:55:46.050717] [WARN ] [REMOTE ] MLM: No data returned for month 2025-08 [2025-09-29T19:55:46.050810] [FATAL] [REMOTE ] MLM: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T19:55:46.050897] [FATAL] [MAIN ] MLM: Failed to fetch primary data. [2025-09-29T19:55:46.050963] [WARN ] [MAIN ] MLM: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T19:55:46.051074] [INFO ] [LOCAL ] MLM: Starting deletion of primary data. [2025-09-29T19:55:46.051170] [DEBUG] [LOCAL ] MLM: No primary data file found to delete. [2025-09-29T19:55:46.051259] [INFO ] [LOCAL ] MLM: Starting deletion of derivative data. [2025-09-29T19:55:46.052165] [DEBUG] [LOCAL ] MLM: Deleted derivative data file. [2025-09-29T19:55:46.052310] [INFO ] [MAIN ] Update Progress: 1367/2371 symbols completed. MLM took 24.6s. Estimated remaining: 2h 9m 3s. Rate: 7.8 symbols/min [2025-09-29T19:55:46.242685] [INFO ] [MAIN ] MLP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:55:46.248751] [DEBUG] [LOCAL ] MLP: Loaded 3120 existing records from primary storage. [2025-09-29T19:55:46.248960] [INFO ] [MAIN ] MLP: Loaded 3120 existing records. [2025-09-29T19:55:46.437527] [WARN ] [MAIN ] MLP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:55:46.437849] [INFO ] [MAIN ] MLP: Wiping existing primary data before full refresh. [2025-09-29T19:55:46.437940] [INFO ] [LOCAL ] MLP: Starting deletion of primary data. [2025-09-29T19:55:46.438133] [DEBUG] [LOCAL ] MLP: Deleted primary data file. [2025-09-29T19:55:46.438193] [INFO ] [MAIN ] MLP: Starting full primary refresh. [2025-09-29T19:55:46.752895] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-09. [2025-09-29T19:55:46.815546] [INFO ] [REMOTE ] MLP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:55:46.835730] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-29T19:55:47.548155] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-08. [2025-09-29T19:55:48.348161] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-09. [2025-09-29T19:55:48.468449] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-29T19:55:48.478456] [INFO ] [REMOTE ] MLI: Full fetch complete (63549 records). [2025-09-29T19:55:48.478680] [DEBUG] [VALIDATOR ] MLI: Validating primary data. [2025-09-29T19:55:48.901056] [DEBUG] [VALIDATOR ] MLI: All expected trading days are present. [2025-09-29T19:55:48.907923] [DEBUG] [VALIDATOR ] MLI: Primary data validation passed. [2025-09-29T19:55:48.920458] [INFO ] [MAIN ] MLI: Fetched primary data is valid. [2025-09-29T19:55:48.922553] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-29T19:55:48.921281] [DEBUG] [LOCAL ] MLI: Saving primary data. [2025-09-29T19:55:48.931408] [DEBUG] [LOCAL ] MLI: Trimmed 63549 records to 43645 (keeping 200 days of data) [2025-09-29T19:55:49.157883] [INFO ] [REMOTE ] MLP: Fetching primary data for 2024-12. [2025-09-29T19:55:49.222814] [DEBUG] [LOCAL ] MLI: Primary data saved (43645 records). [2025-09-29T19:55:49.222992] [INFO ] [MAIN ] MLI: Full history saved. [2025-09-29T19:55:49.223100] [INFO ] [MAIN ] Update Progress: 1368/2371 symbols completed. MLI took 29.2s. Estimated remaining: 2h 8m 52s. Rate: 7.8 symbols/min [2025-09-29T19:55:49.407467] [INFO ] [MAIN ] MLR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:55:49.423882] [DEBUG] [LOCAL ] MLR: Loaded 12982 existing records from primary storage. [2025-09-29T19:55:49.424121] [INFO ] [MAIN ] MLR: Loaded 12982 existing records. [2025-09-29T19:55:49.611285] [WARN ] [MAIN ] MLR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:55:49.611481] [INFO ] [MAIN ] MLR: Wiping existing primary data before full refresh. [2025-09-29T19:55:49.611535] [INFO ] [LOCAL ] MLR: Starting deletion of primary data. [2025-09-29T19:55:49.611840] [DEBUG] [LOCAL ] MLR: Deleted primary data file. [2025-09-29T19:55:49.611901] [INFO ] [MAIN ] MLR: Starting full primary refresh. [2025-09-29T19:55:49.872900] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-29T19:55:49.961280] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-09. [2025-09-29T19:55:49.999632] [INFO ] [REMOTE ] MLR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:55:50.019350] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-29T19:55:50.026619] [INFO ] [REMOTE ] MKL: Full fetch complete (49607 records). [2025-09-29T19:55:50.026795] [DEBUG] [VALIDATOR ] MKL: Validating primary data. [2025-09-29T19:55:50.444901] [DEBUG] [VALIDATOR ] MKL: All expected trading days are present. [2025-09-29T19:55:50.445008] [DEBUG] [VALIDATOR ] MKL: Primary data validation passed. [2025-09-29T19:55:50.446027] [INFO ] [MAIN ] MKL: Fetched primary data is valid. [2025-09-29T19:55:50.446091] [DEBUG] [LOCAL ] MKL: Saving primary data. [2025-09-29T19:55:50.447261] [DEBUG] [LOCAL ] MKL: Trimmed 49607 records to 34012 (keeping 200 days of data) [2025-09-29T19:55:50.668857] [DEBUG] [LOCAL ] MKL: Primary data saved (34012 records). [2025-09-29T19:55:50.669008] [INFO ] [MAIN ] MKL: Full history saved. [2025-09-29T19:55:50.669141] [INFO ] [MAIN ] Update Progress: 1369/2371 symbols completed. MKL took 38.9s. Estimated remaining: 2h 8m 40s. Rate: 7.8 symbols/min [2025-09-29T19:55:50.753290] [INFO ] [REMOTE ] MLR: Fetching primary data for 2024-12. [2025-09-29T19:55:50.857736] [INFO ] [MAIN ] MMC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:55:50.920059] [DEBUG] [LOCAL ] MMC: Loaded 52551 existing records from primary storage. [2025-09-29T19:55:50.920400] [INFO ] [MAIN ] MMC: Loaded 52551 existing records. [2025-09-29T19:55:51.110024] [WARN ] [MAIN ] MMC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:55:51.110330] [INFO ] [MAIN ] MMC: Wiping existing primary data before full refresh. [2025-09-29T19:55:51.110386] [INFO ] [LOCAL ] MMC: Starting deletion of primary data. [2025-09-29T19:55:51.110928] [DEBUG] [LOCAL ] MMC: Deleted primary data file. [2025-09-29T19:55:51.110990] [INFO ] [MAIN ] MMC: Starting full primary refresh. [2025-09-29T19:55:51.528194] [INFO ] [REMOTE ] MMC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:55:51.531205] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-29T19:55:51.538026] [INFO ] [REMOTE ] MLNK: Full fetch complete (35859 records). [2025-09-29T19:55:51.538141] [DEBUG] [VALIDATOR ] MLNK: Validating primary data. [2025-09-29T19:55:51.553347] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-01. [2025-09-29T19:55:51.725737] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-29T19:55:51.963033] [DEBUG] [VALIDATOR ] MLNK: All expected trading days are present. [2025-09-29T19:55:51.963128] [DEBUG] [VALIDATOR ] MLNK: Primary data validation passed. [2025-09-29T19:55:51.963943] [INFO ] [MAIN ] MLNK: Fetched primary data is valid. [2025-09-29T19:55:51.964010] [DEBUG] [LOCAL ] MLNK: Saving primary data. [2025-09-29T19:55:51.965015] [DEBUG] [LOCAL ] MLNK: Trimmed 35859 records to 25428 (keeping 200 days of data) [2025-09-29T19:55:52.121106] [DEBUG] [LOCAL ] MLNK: Primary data saved (25428 records). [2025-09-29T19:55:52.121323] [INFO ] [MAIN ] MLNK: Full history saved. [2025-09-29T19:55:52.121468] [INFO ] [MAIN ] Update Progress: 1370/2371 symbols completed. MLNK took 29.0s. Estimated remaining: 2h 8m 28s. Rate: 7.8 symbols/min [2025-09-29T19:55:52.237145] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-29T19:55:52.308037] [INFO ] [MAIN ] MMD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:55:52.327197] [DEBUG] [LOCAL ] MMD: Loaded 11435 existing records from primary storage. [2025-09-29T19:55:52.327448] [INFO ] [MAIN ] MMD: Loaded 11435 existing records. [2025-09-29T19:55:52.357791] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-01. [2025-09-29T19:55:52.532907] [WARN ] [MAIN ] MMD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:55:52.533137] [INFO ] [MAIN ] MMD: Wiping existing primary data before full refresh. [2025-09-29T19:55:52.533198] [INFO ] [LOCAL ] MMD: Starting deletion of primary data. [2025-09-29T19:55:52.533457] [DEBUG] [LOCAL ] MMD: Deleted primary data file. [2025-09-29T19:55:52.533516] [INFO ] [MAIN ] MMD: Starting full primary refresh. [2025-09-29T19:55:52.936176] [INFO ] [REMOTE ] MMD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:55:53.148111] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-02. [2025-09-29T19:55:53.390764] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-29T19:55:53.501307] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-29T19:55:53.948151] [INFO ] [REMOTE ] MMD: Fetching primary data for 2024-12. [2025-09-29T19:55:54.748161] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-02. [2025-09-29T19:55:54.879968] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-29T19:55:55.548151] [INFO ] [REMOTE ] MMC: Fetching primary data for 2024-12. [2025-09-29T19:55:55.580203] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-29T19:55:56.348122] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-03. [2025-09-29T19:55:56.849334] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-29T19:55:57.148111] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-01. [2025-09-29T19:55:57.254247] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-29T19:55:57.948097] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-01. [2025-09-29T19:55:58.041019] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-29T19:55:58.748190] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-02. [2025-09-29T19:55:59.548083] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-03. [2025-09-29T19:55:59.561886] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-29T19:55:59.684009] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-29T19:56:00.348146] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-02. [2025-09-29T19:56:00.485717] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-29T19:56:01.148118] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-03. [2025-09-29T19:56:01.948101] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-04. [2025-09-29T19:56:01.988301] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-29T19:56:02.017492] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-29T19:56:02.748088] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-04. [2025-09-29T19:56:03.025948] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-29T19:56:03.437182] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-29T19:56:03.548176] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-04. [2025-09-29T19:56:04.215227] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-29T19:56:04.348118] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-05. [2025-09-29T19:56:04.966434] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-29T19:56:05.148136] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-06. [2025-09-29T19:56:05.614909] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-29T19:56:05.948134] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-07. [2025-09-29T19:56:06.439623] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-29T19:56:06.748115] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-05. [2025-09-29T19:56:07.473023] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-29T19:56:07.548099] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-03. [2025-09-29T19:56:08.348118] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-05. [2025-09-29T19:56:09.148097] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-06. [2025-09-29T19:56:09.203683] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-29T19:56:09.393865] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-29T19:56:09.896179] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-29T19:56:09.948091] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-07. [2025-09-29T19:56:10.724121] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-29T19:56:10.748077] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-08. [2025-09-29T19:56:11.548123] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-06. [2025-09-29T19:56:11.577631] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-29T19:56:12.314925] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-29T19:56:12.348086] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-07. [2025-09-29T19:56:13.148122] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-08. [2025-09-29T19:56:13.174688] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-29T19:56:13.623328] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-29T19:56:13.948141] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-09. [2025-09-29T19:56:14.748147] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-09. [2025-09-29T19:56:14.851485] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-29T19:56:14.854963] [INFO ] [REMOTE ] MMD: Full fetch complete (18042 records). [2025-09-29T19:56:14.855110] [DEBUG] [VALIDATOR ] MMD: Validating primary data. [2025-09-29T19:56:15.240602] [DEBUG] [VALIDATOR ] MMD: All expected trading days are present. [2025-09-29T19:56:15.240739] [DEBUG] [VALIDATOR ] MMD: Primary data validation passed. [2025-09-29T19:56:15.241185] [INFO ] [MAIN ] MMD: Fetched primary data is valid. [2025-09-29T19:56:15.241239] [DEBUG] [LOCAL ] MMD: Saving primary data. [2025-09-29T19:56:15.241839] [DEBUG] [LOCAL ] MMD: Trimmed 18042 records to 11387 (keeping 200 days of data) [2025-09-29T19:56:15.315982] [DEBUG] [LOCAL ] MMD: Primary data saved (11387 records). [2025-09-29T19:56:15.316132] [INFO ] [MAIN ] MMD: Full history saved. [2025-09-29T19:56:15.316220] [INFO ] [MAIN ] Update Progress: 1371/2371 symbols completed. MMD took 23.2s. Estimated remaining: 2h 8m 31s. Rate: 7.8 symbols/min [2025-09-29T19:56:15.417209] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-29T19:56:15.430989] [INFO ] [REMOTE ] MLP: Full fetch complete (4586 records). [2025-09-29T19:56:15.441757] [DEBUG] [VALIDATOR ] MLP: Validating primary data. [2025-09-29T19:56:15.554905] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-04. [2025-09-29T19:56:15.587204] [INFO ] [MAIN ] MMI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:56:15.781171] [DEBUG] [LOCAL ] MMI: Loaded 15452 existing records from primary storage. [2025-09-29T19:56:15.822981] [INFO ] [MAIN ] MMI: Loaded 15452 existing records. [2025-09-29T19:56:16.065479] [DEBUG] [VALIDATOR ] MLP: All expected trading days are present. [2025-09-29T19:56:16.075871] [DEBUG] [VALIDATOR ] MLP: Primary data validation passed. [2025-09-29T19:56:16.089913] [INFO ] [MAIN ] MLP: Fetched primary data is valid. [2025-09-29T19:56:16.101008] [DEBUG] [LOCAL ] MLP: Saving primary data. [2025-09-29T19:56:16.133787] [DEBUG] [LOCAL ] MLP: Trimmed 4586 records to 2991 (keeping 200 days of data) [2025-09-29T19:56:16.133684] [WARN ] [MAIN ] MMI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:56:16.134017] [INFO ] [MAIN ] MMI: Wiping existing primary data before full refresh. [2025-09-29T19:56:16.134369] [INFO ] [LOCAL ] MMI: Starting deletion of primary data. [2025-09-29T19:56:16.134684] [DEBUG] [LOCAL ] MMI: Deleted primary data file. [2025-09-29T19:56:16.141509] [INFO ] [MAIN ] MMI: Starting full primary refresh. [2025-09-29T19:56:16.302128] [DEBUG] [LOCAL ] MLP: Primary data saved (2991 records). [2025-09-29T19:56:16.323979] [INFO ] [MAIN ] MLP: Full history saved. [2025-09-29T19:56:16.358551] [INFO ] [MAIN ] Update Progress: 1372/2371 symbols completed. MLP took 30.3s. Estimated remaining: 2h 8m 19s. Rate: 7.8 symbols/min [2025-09-29T19:56:16.358381] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-08. [2025-09-29T19:56:16.737516] [INFO ] [REMOTE ] MMI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:56:16.740961] [INFO ] [MAIN ] MMID: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:56:16.741397] [DEBUG] [LOCAL ] MMID: No existing data file found in primary storage. [2025-09-29T19:56:16.741458] [WARN ] [MAIN ] MMID: No existing data found, performing full refresh instead. [2025-09-29T19:56:16.741594] [INFO ] [MAIN ] MMID: Wiping existing primary data before full refresh. [2025-09-29T19:56:16.741690] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-09-29T19:56:16.741758] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-09-29T19:56:16.741793] [INFO ] [MAIN ] MMID: Starting full primary refresh. [2025-09-29T19:56:17.140553] [INFO ] [REMOTE ] MMID: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:56:17.148064] [INFO ] [REMOTE ] MMI: Fetching primary data for 2024-12. [2025-09-29T19:56:17.473596] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-29T19:56:17.479894] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-29T19:56:17.929522] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-29T19:56:17.948069] [INFO ] [REMOTE ] MMID: Fetching primary data for 2024-12. [2025-09-29T19:56:18.181916] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T19:56:18.182273] [WARN ] [REMOTE ] MMID: No data returned for month 2024-12 [2025-09-29T19:56:18.182368] [FATAL] [REMOTE ] MMID: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T19:56:18.182417] [FATAL] [MAIN ] MMID: Failed to fetch primary data. [2025-09-29T19:56:18.182453] [WARN ] [MAIN ] MMID: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T19:56:18.182521] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-09-29T19:56:18.182587] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-09-29T19:56:18.182627] [INFO ] [LOCAL ] MMID: Starting deletion of derivative data. [2025-09-29T19:56:18.182712] [DEBUG] [LOCAL ] MMID: No derivative data file found to delete. [2025-09-29T19:56:18.182772] [INFO ] [MAIN ] Update Progress: 1373/2371 symbols completed. MMID took 1.8s. Estimated remaining: 2h 8m 7s. Rate: 7.8 symbols/min [2025-09-29T19:56:18.365405] [INFO ] [MAIN ] MMKT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:56:18.365610] [DEBUG] [LOCAL ] MMKT: No existing data file found in primary storage. [2025-09-29T19:56:18.365677] [WARN ] [MAIN ] MMKT: No existing data found, performing full refresh instead. [2025-09-29T19:56:18.365806] [INFO ] [MAIN ] MMKT: Wiping existing primary data before full refresh. [2025-09-29T19:56:18.365849] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-09-29T19:56:18.365891] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-09-29T19:56:18.365924] [INFO ] [MAIN ] MMKT: Starting full primary refresh. [2025-09-29T19:56:18.752694] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-09. [2025-09-29T19:56:18.757369] [INFO ] [REMOTE ] MMKT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:56:19.548155] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-05. [2025-09-29T19:56:19.850722] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-29T19:56:19.854372] [INFO ] [REMOTE ] MLR: Full fetch complete (18628 records). [2025-09-29T19:56:19.854495] [DEBUG] [VALIDATOR ] MLR: Validating primary data. [2025-09-29T19:56:20.266065] [DEBUG] [VALIDATOR ] MLR: All expected trading days are present. [2025-09-29T19:56:20.266181] [DEBUG] [VALIDATOR ] MLR: Primary data validation passed. [2025-09-29T19:56:20.266703] [INFO ] [MAIN ] MLR: Fetched primary data is valid. [2025-09-29T19:56:20.266771] [DEBUG] [LOCAL ] MLR: Saving primary data. [2025-09-29T19:56:20.267514] [DEBUG] [LOCAL ] MLR: Trimmed 18628 records to 12553 (keeping 200 days of data) [2025-09-29T19:56:20.348295] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2024-12. [2025-09-29T19:56:20.359067] [DEBUG] [LOCAL ] MLR: Primary data saved (12553 records). [2025-09-29T19:56:20.359242] [INFO ] [MAIN ] MLR: Full history saved. [2025-09-29T19:56:20.359352] [INFO ] [MAIN ] Update Progress: 1374/2371 symbols completed. MLR took 31.1s. Estimated remaining: 2h 7m 55s. Rate: 7.8 symbols/min [2025-09-29T19:56:20.546870] [INFO ] [MAIN ] MMM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:56:20.615001] [DEBUG] [LOCAL ] MMM: Loaded 53995 existing records from primary storage. [2025-09-29T19:56:20.615345] [INFO ] [MAIN ] MMM: Loaded 53995 existing records. [2025-09-29T19:56:20.823872] [WARN ] [MAIN ] MMM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:56:20.827747] [INFO ] [MAIN ] MMM: Wiping existing primary data before full refresh. [2025-09-29T19:56:20.827557] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-29T19:56:20.827923] [INFO ] [LOCAL ] MMM: Starting deletion of primary data. [2025-09-29T19:56:20.830109] [DEBUG] [LOCAL ] MMM: Deleted primary data file. [2025-09-29T19:56:20.830200] [INFO ] [MAIN ] MMM: Starting full primary refresh. [2025-09-29T19:56:21.150493] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-01. [2025-09-29T19:56:21.232398] [INFO ] [REMOTE ] MMM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:56:21.263417] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-29T19:56:21.948142] [INFO ] [REMOTE ] MMM: Fetching primary data for 2024-12. [2025-09-29T19:56:22.095179] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-29T19:56:22.748131] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-06. [2025-09-29T19:56:23.548141] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-02. [2025-09-29T19:56:23.927487] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-29T19:56:24.212701] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-29T19:56:24.348119] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-01. [2025-09-29T19:56:24.520997] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-29T19:56:25.148170] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-07. [2025-09-29T19:56:25.948095] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-03. [2025-09-29T19:56:26.364437] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-29T19:56:26.748108] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-01. [2025-09-29T19:56:26.884366] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-29T19:56:27.027367] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-01 (0.28 seconds). [2025-09-29T19:56:27.068260] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-29T19:56:27.548213] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-04. [2025-09-29T19:56:28.348104] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-02. [2025-09-29T19:56:28.702957] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-29T19:56:28.843486] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-29T19:56:29.148117] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-08. [2025-09-29T19:56:29.948154] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-03. [2025-09-29T19:56:30.383030] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-29T19:56:30.748096] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-05. [2025-09-29T19:56:30.905030] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-29T19:56:31.416682] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-29T19:56:31.548133] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-06. [2025-09-29T19:56:32.348139] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-09. [2025-09-29T19:56:32.516206] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-29T19:56:33.148154] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-02. [2025-09-29T19:56:33.948121] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-04. [2025-09-29T19:56:34.307973] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-29T19:56:34.319087] [INFO ] [REMOTE ] MMC: Full fetch complete (74732 records). [2025-09-29T19:56:34.319237] [DEBUG] [VALIDATOR ] MMC: Validating primary data. [2025-09-29T19:56:34.419619] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-29T19:56:34.743949] [DEBUG] [VALIDATOR ] MMC: All expected trading days are present. [2025-09-29T19:56:34.744052] [DEBUG] [VALIDATOR ] MMC: Primary data validation passed. [2025-09-29T19:56:34.745142] [INFO ] [MAIN ] MMC: Fetched primary data is valid. [2025-09-29T19:56:34.745219] [DEBUG] [LOCAL ] MMC: Saving primary data. [2025-09-29T19:56:34.746998] [DEBUG] [LOCAL ] MMC: Trimmed 74732 records to 51782 (keeping 200 days of data) [2025-09-29T19:56:34.807863] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-05. [2025-09-29T19:56:35.016210] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-29T19:56:35.132395] [DEBUG] [LOCAL ] MMC: Primary data saved (51782 records). [2025-09-29T19:56:35.132559] [INFO ] [MAIN ] MMC: Full history saved. [2025-09-29T19:56:35.132672] [INFO ] [MAIN ] Update Progress: 1375/2371 symbols completed. MMC took 44.5s. Estimated remaining: 2h 7m 53s. Rate: 7.8 symbols/min [2025-09-29T19:56:35.270435] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-29T19:56:35.358381] [INFO ] [MAIN ] MMS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:56:35.398340] [DEBUG] [LOCAL ] MMS: Loaded 34398 existing records from primary storage. [2025-09-29T19:56:35.398690] [INFO ] [MAIN ] MMS: Loaded 34398 existing records. [2025-09-29T19:56:35.556222] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-07. [2025-09-29T19:56:35.602035] [WARN ] [MAIN ] MMS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:56:35.602441] [INFO ] [MAIN ] MMS: Wiping existing primary data before full refresh. [2025-09-29T19:56:35.602497] [INFO ] [LOCAL ] MMS: Starting deletion of primary data. [2025-09-29T19:56:35.602901] [DEBUG] [LOCAL ] MMS: Deleted primary data file. [2025-09-29T19:56:35.602961] [INFO ] [MAIN ] MMS: Starting full primary refresh. [2025-09-29T19:56:35.971483] [INFO ] [REMOTE ] MMS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:56:36.348093] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-03. [2025-09-29T19:56:36.485794] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-29T19:56:37.148156] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-08. [2025-09-29T19:56:37.948127] [INFO ] [REMOTE ] MMS: Fetching primary data for 2024-12. [2025-09-29T19:56:38.062047] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-29T19:56:38.395395] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-29T19:56:38.748121] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-09. [2025-09-29T19:56:39.510069] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-29T19:56:39.548089] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-04. [2025-09-29T19:56:39.758409] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-29T19:56:39.761497] [INFO ] [REMOTE ] MMI: Full fetch complete (21023 records). [2025-09-29T19:56:39.761636] [DEBUG] [VALIDATOR ] MMI: Validating primary data. [2025-09-29T19:56:40.180422] [DEBUG] [VALIDATOR ] MMI: All expected trading days are present. [2025-09-29T19:56:40.180574] [DEBUG] [VALIDATOR ] MMI: Primary data validation passed. [2025-09-29T19:56:40.181165] [INFO ] [MAIN ] MMI: Fetched primary data is valid. [2025-09-29T19:56:40.181254] [DEBUG] [LOCAL ] MMI: Saving primary data. [2025-09-29T19:56:40.182039] [DEBUG] [LOCAL ] MMI: Trimmed 21023 records to 15142 (keeping 200 days of data) [2025-09-29T19:56:40.290355] [DEBUG] [LOCAL ] MMI: Primary data saved (15142 records). [2025-09-29T19:56:40.290549] [INFO ] [MAIN ] MMI: Full history saved. [2025-09-29T19:56:40.290719] [INFO ] [MAIN ] Update Progress: 1376/2371 symbols completed. MMI took 25.0s. Estimated remaining: 2h 7m 43s. Rate: 7.8 symbols/min [2025-09-29T19:56:40.353232] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-01. [2025-09-29T19:56:40.560048] [INFO ] [MAIN ] MMT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:56:40.575509] [DEBUG] [LOCAL ] MMT: Loaded 10987 existing records from primary storage. [2025-09-29T19:56:40.575787] [INFO ] [MAIN ] MMT: Loaded 10987 existing records. [2025-09-29T19:56:40.784592] [WARN ] [MAIN ] MMT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:56:40.785009] [INFO ] [MAIN ] MMT: Wiping existing primary data before full refresh. [2025-09-29T19:56:40.785061] [INFO ] [LOCAL ] MMT: Starting deletion of primary data. [2025-09-29T19:56:40.785265] [DEBUG] [LOCAL ] MMT: Deleted primary data file. [2025-09-29T19:56:40.785324] [INFO ] [MAIN ] MMT: Starting full primary refresh. [2025-09-29T19:56:41.154793] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-06. [2025-09-29T19:56:41.181903] [INFO ] [REMOTE ] MMT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:56:41.606823] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-29T19:56:41.621172] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-29T19:56:41.709956] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-29T19:56:41.948133] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-05. [2025-09-29T19:56:42.748191] [INFO ] [REMOTE ] MMT: Fetching primary data for 2024-12. [2025-09-29T19:56:43.548091] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-07. [2025-09-29T19:56:43.603368] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-29T19:56:43.699550] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-29T19:56:43.799083] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-09-29T19:56:44.348119] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-08. [2025-09-29T19:56:44.958793] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-29T19:56:45.148175] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-06. [2025-09-29T19:56:45.948125] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-09. [2025-09-29T19:56:46.396542] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-29T19:56:46.397460] [INFO ] [REMOTE ] MMKT: Full fetch complete (2098 records). [2025-09-29T19:56:46.397534] [DEBUG] [VALIDATOR ] MMKT: Validating primary data. [2025-09-29T19:56:46.587929] [WARN ] [VALIDATOR ] MMKT: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-29T19:56:46.588153] [FATAL] [MAIN ] MMKT: Fetched primary data is invalid. Refusing to save it. [2025-09-29T19:56:46.588226] [WARN ] [MAIN ] MMKT: Deleting existing primary and derivative data due to validation failure. [2025-09-29T19:56:46.588300] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-09-29T19:56:46.588365] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-09-29T19:56:46.588402] [INFO ] [LOCAL ] MMKT: Starting deletion of derivative data. [2025-09-29T19:56:46.588450] [DEBUG] [LOCAL ] MMKT: No derivative data file found to delete. [2025-09-29T19:56:46.588523] [INFO ] [MAIN ] Update Progress: 1377/2371 symbols completed. MMKT took 28.4s. Estimated remaining: 2h 7m 34s. Rate: 7.8 symbols/min [2025-09-29T19:56:46.765992] [INFO ] [MAIN ] MMU: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:56:46.766064] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-01. [2025-09-29T19:56:46.785903] [DEBUG] [LOCAL ] MMU: Loaded 17156 existing records from primary storage. [2025-09-29T19:56:46.786225] [INFO ] [MAIN ] MMU: Loaded 17156 existing records. [2025-09-29T19:56:46.985623] [WARN ] [MAIN ] MMU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:56:46.985918] [INFO ] [MAIN ] MMU: Wiping existing primary data before full refresh. [2025-09-29T19:56:46.985967] [INFO ] [LOCAL ] MMU: Starting deletion of primary data. [2025-09-29T19:56:46.986321] [DEBUG] [LOCAL ] MMU: Deleted primary data file. [2025-09-29T19:56:46.986380] [INFO ] [MAIN ] MMU: Starting full primary refresh. [2025-09-29T19:56:47.330034] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-29T19:56:47.456228] [INFO ] [REMOTE ] MMU: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:56:47.548112] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-07. [2025-09-29T19:56:47.579154] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-29T19:56:48.348117] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-02. [2025-09-29T19:56:49.148079] [INFO ] [REMOTE ] MMU: Fetching primary data for 2024-12. [2025-09-29T19:56:49.659610] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-29T19:56:49.777309] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-29T19:56:49.834264] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-29T19:56:49.948098] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-03. [2025-09-29T19:56:50.748136] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-02. [2025-09-29T19:56:51.270282] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-29T19:56:51.515083] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-29T19:56:51.548096] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-04. [2025-09-29T19:56:52.348131] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-03. [2025-09-29T19:56:53.081010] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-29T19:56:53.148125] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-05. [2025-09-29T19:56:53.270224] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-29T19:56:53.948123] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-04. [2025-09-29T19:56:54.144603] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-29T19:56:54.730556] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-29T19:56:54.748057] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-05. [2025-09-29T19:56:55.503621] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-29T19:56:55.548139] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-01. [2025-09-29T19:56:56.293872] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-29T19:56:56.348094] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-08. [2025-09-29T19:56:57.148115] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-06. [2025-09-29T19:56:57.910397] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-29T19:56:57.948095] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-07. [2025-09-29T19:56:58.335587] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-29T19:56:58.748132] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-02. [2025-09-29T19:56:58.935146] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-29T19:56:59.548121] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-06. [2025-09-29T19:56:59.781334] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-29T19:57:00.348129] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-08. [2025-09-29T19:57:01.043475] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-29T19:57:01.148193] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-09. [2025-09-29T19:57:01.305162] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-29T19:57:01.948113] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-07. [2025-09-29T19:57:02.748083] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-09. [2025-09-29T19:57:03.178247] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-29T19:57:03.189773] [INFO ] [REMOTE ] MMM: Full fetch complete (77122 records). [2025-09-29T19:57:03.189917] [DEBUG] [VALIDATOR ] MMM: Validating primary data. [2025-09-29T19:57:03.554628] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-03. [2025-09-29T19:57:03.626155] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-29T19:57:03.684074] [DEBUG] [VALIDATOR ] MMM: All expected trading days are present. [2025-09-29T19:57:03.690873] [DEBUG] [VALIDATOR ] MMM: Primary data validation passed. [2025-09-29T19:57:03.692236] [INFO ] [MAIN ] MMM: Fetched primary data is valid. [2025-09-29T19:57:03.693965] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-29T19:57:03.693601] [DEBUG] [LOCAL ] MMM: Saving primary data. [2025-09-29T19:57:03.698458] [INFO ] [REMOTE ] MMT: Full fetch complete (16220 records). [2025-09-29T19:57:03.698675] [DEBUG] [VALIDATOR ] MMT: Validating primary data. [2025-09-29T19:57:03.784821] [DEBUG] [LOCAL ] MMM: Trimmed 77122 records to 53201 (keeping 200 days of data) [2025-09-29T19:57:04.202540] [DEBUG] [VALIDATOR ] MMT: All expected trading days are present. [2025-09-29T19:57:04.203507] [DEBUG] [VALIDATOR ] MMT: Primary data validation passed. [2025-09-29T19:57:04.204348] [INFO ] [MAIN ] MMT: Fetched primary data is valid. [2025-09-29T19:57:04.205145] [DEBUG] [LOCAL ] MMT: Saving primary data. [2025-09-29T19:57:04.207409] [DEBUG] [LOCAL ] MMT: Trimmed 16220 records to 10929 (keeping 200 days of data) [2025-09-29T19:57:04.352292] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-08. [2025-09-29T19:57:04.397166] [DEBUG] [LOCAL ] MMT: Primary data saved (10929 records). [2025-09-29T19:57:04.397558] [INFO ] [MAIN ] MMT: Full history saved. [2025-09-29T19:57:04.397972] [INFO ] [MAIN ] Update Progress: 1378/2371 symbols completed. MMT took 24.1s. Estimated remaining: 2h 7m 34s. Rate: 7.8 symbols/min [2025-09-29T19:57:04.587415] [INFO ] [MAIN ] MNR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:57:04.625150] [DEBUG] [LOCAL ] MNR: Loaded 24918 existing records from primary storage. [2025-09-29T19:57:04.627087] [INFO ] [MAIN ] MNR: Loaded 24918 existing records. [2025-09-29T19:57:04.765439] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-29T19:57:04.922817] [WARN ] [MAIN ] MNR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:57:04.924671] [INFO ] [MAIN ] MNR: Wiping existing primary data before full refresh. [2025-09-29T19:57:04.925074] [INFO ] [LOCAL ] MNR: Starting deletion of primary data. [2025-09-29T19:57:04.926493] [DEBUG] [LOCAL ] MNR: Deleted primary data file. [2025-09-29T19:57:04.926937] [INFO ] [MAIN ] MNR: Starting full primary refresh. [2025-09-29T19:57:05.160845] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-04. [2025-09-29T19:57:05.379742] [INFO ] [REMOTE ] MNR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:57:05.385636] [DEBUG] [LOCAL ] MMM: Primary data saved (53201 records). [2025-09-29T19:57:05.385806] [INFO ] [MAIN ] MMM: Full history saved. [2025-09-29T19:57:05.385907] [INFO ] [MAIN ] Update Progress: 1379/2371 symbols completed. MMM took 45.0s. Estimated remaining: 2h 7m 21s. Rate: 7.8 symbols/min [2025-09-29T19:57:05.572177] [INFO ] [MAIN ] MNSO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:57:05.620837] [DEBUG] [LOCAL ] MNSO: Loaded 45049 existing records from primary storage. [2025-09-29T19:57:05.621158] [INFO ] [MAIN ] MNSO: Loaded 45049 existing records. [2025-09-29T19:57:05.828682] [WARN ] [MAIN ] MNSO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:57:05.829110] [INFO ] [MAIN ] MNSO: Wiping existing primary data before full refresh. [2025-09-29T19:57:05.829214] [INFO ] [LOCAL ] MNSO: Starting deletion of primary data. [2025-09-29T19:57:05.830061] [DEBUG] [LOCAL ] MNSO: Deleted primary data file. [2025-09-29T19:57:05.830251] [INFO ] [MAIN ] MNSO: Starting full primary refresh. [2025-09-29T19:57:05.938584] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-29T19:57:05.958191] [INFO ] [REMOTE ] MNR: Fetching primary data for 2024-12. [2025-09-29T19:57:06.253111] [INFO ] [REMOTE ] MNSO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:57:06.302915] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-29T19:57:06.748115] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-05. [2025-09-29T19:57:07.387773] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-29T19:57:07.548131] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-01. [2025-09-29T19:57:07.623200] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-29T19:57:08.348107] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-09. [2025-09-29T19:57:08.643142] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-29T19:57:09.148107] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-02. [2025-09-29T19:57:09.920260] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-29T19:57:09.928207] [INFO ] [REMOTE ] MMS: Full fetch complete (52132 records). [2025-09-29T19:57:09.928355] [DEBUG] [VALIDATOR ] MMS: Validating primary data. [2025-09-29T19:57:09.953269] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-06. [2025-09-29T19:57:10.356480] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-29T19:57:10.383855] [DEBUG] [VALIDATOR ] MMS: All expected trading days are present. [2025-09-29T19:57:10.383957] [DEBUG] [VALIDATOR ] MMS: Primary data validation passed. [2025-09-29T19:57:10.385092] [INFO ] [MAIN ] MMS: Fetched primary data is valid. [2025-09-29T19:57:10.385162] [DEBUG] [LOCAL ] MMS: Saving primary data. [2025-09-29T19:57:10.389224] [DEBUG] [LOCAL ] MMS: Trimmed 52132 records to 33771 (keeping 200 days of data) [2025-09-29T19:57:10.622420] [DEBUG] [LOCAL ] MMS: Primary data saved (33771 records). [2025-09-29T19:57:10.622750] [INFO ] [MAIN ] MMS: Full history saved. [2025-09-29T19:57:10.622862] [INFO ] [MAIN ] Update Progress: 1380/2371 symbols completed. MMS took 35.5s. Estimated remaining: 2h 7m 12s. Rate: 7.8 symbols/min [2025-09-29T19:57:10.753268] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2024-12. [2025-09-29T19:57:10.810143] [INFO ] [MAIN ] MNTN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:57:10.810553] [DEBUG] [LOCAL ] MNTN: No existing data file found in primary storage. [2025-09-29T19:57:10.810613] [WARN ] [MAIN ] MNTN: No existing data found, performing full refresh instead. [2025-09-29T19:57:10.810768] [INFO ] [MAIN ] MNTN: Wiping existing primary data before full refresh. [2025-09-29T19:57:10.810816] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-09-29T19:57:10.810865] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-09-29T19:57:10.810898] [INFO ] [MAIN ] MNTN: Starting full primary refresh. [2025-09-29T19:57:11.013280] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-29T19:57:11.212542] [INFO ] [REMOTE ] MNTN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:57:11.548116] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2024-12. [2025-09-29T19:57:11.764304] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T19:57:11.764633] [WARN ] [REMOTE ] MNTN: No data returned for month 2024-12 [2025-09-29T19:57:11.764750] [FATAL] [REMOTE ] MNTN: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T19:57:11.764803] [FATAL] [MAIN ] MNTN: Failed to fetch primary data. [2025-09-29T19:57:11.764866] [WARN ] [MAIN ] MNTN: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T19:57:11.764941] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-09-29T19:57:11.765007] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-09-29T19:57:11.765044] [INFO ] [LOCAL ] MNTN: Starting deletion of derivative data. [2025-09-29T19:57:11.765109] [DEBUG] [LOCAL ] MNTN: No derivative data file found to delete. [2025-09-29T19:57:11.765179] [INFO ] [MAIN ] Update Progress: 1381/2371 symbols completed. MNTN took 1.1s. Estimated remaining: 2h 6m 60s. Rate: 7.8 symbols/min [2025-09-29T19:57:11.942805] [INFO ] [MAIN ] MO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:57:11.943019] [DEBUG] [LOCAL ] MO: No existing data file found in primary storage. [2025-09-29T19:57:11.943077] [WARN ] [MAIN ] MO: No existing data found, performing full refresh instead. [2025-09-29T19:57:11.943192] [INFO ] [MAIN ] MO: Wiping existing primary data before full refresh. [2025-09-29T19:57:11.943235] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-09-29T19:57:11.943278] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-09-29T19:57:11.943312] [INFO ] [MAIN ] MO: Starting full primary refresh. [2025-09-29T19:57:12.321385] [INFO ] [REMOTE ] MO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:57:12.348071] [INFO ] [REMOTE ] MO: Fetching primary data for 2024-12. [2025-09-29T19:57:12.551876] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-29T19:57:13.148114] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-07. [2025-09-29T19:57:13.948157] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-01. [2025-09-29T19:57:14.043950] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-29T19:57:14.748165] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-08. [2025-09-29T19:57:14.884185] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2024-12 (2.54 seconds). [2025-09-29T19:57:15.553193] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-03. [2025-09-29T19:57:15.571414] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-29T19:57:15.834768] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-29T19:57:16.348124] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-01. [2025-09-29T19:57:16.685921] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-29T19:57:17.148153] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-09. [2025-09-29T19:57:17.948159] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-02. [2025-09-29T19:57:18.241042] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-29T19:57:18.246282] [INFO ] [REMOTE ] MMU: Full fetch complete (25723 records). [2025-09-29T19:57:18.246586] [DEBUG] [VALIDATOR ] MMU: Validating primary data. [2025-09-29T19:57:18.660141] [DEBUG] [VALIDATOR ] MMU: All expected trading days are present. [2025-09-29T19:57:18.660371] [DEBUG] [VALIDATOR ] MMU: Primary data validation passed. [2025-09-29T19:57:18.661090] [INFO ] [MAIN ] MMU: Fetched primary data is valid. [2025-09-29T19:57:18.661193] [DEBUG] [LOCAL ] MMU: Saving primary data. [2025-09-29T19:57:18.694328] [DEBUG] [LOCAL ] MMU: Trimmed 25723 records to 16811 (keeping 200 days of data) [2025-09-29T19:57:18.696414] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-09-29T19:57:18.756607] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-02. [2025-09-29T19:57:18.825214] [DEBUG] [LOCAL ] MMU: Primary data saved (16811 records). [2025-09-29T19:57:18.825370] [INFO ] [MAIN ] MMU: Full history saved. [2025-09-29T19:57:18.825480] [INFO ] [MAIN ] Update Progress: 1382/2371 symbols completed. MMU took 32.2s. Estimated remaining: 2h 6m 51s. Rate: 7.8 symbols/min [2025-09-29T19:57:19.012870] [INFO ] [MAIN ] MOD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:57:19.065821] [DEBUG] [LOCAL ] MOD: Loaded 46169 existing records from primary storage. [2025-09-29T19:57:19.066156] [INFO ] [MAIN ] MOD: Loaded 46169 existing records. [2025-09-29T19:57:19.249252] [WARN ] [MAIN ] MOD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:57:19.249496] [INFO ] [MAIN ] MOD: Wiping existing primary data before full refresh. [2025-09-29T19:57:19.249544] [INFO ] [LOCAL ] MOD: Starting deletion of primary data. [2025-09-29T19:57:19.250085] [DEBUG] [LOCAL ] MOD: Deleted primary data file. [2025-09-29T19:57:19.250146] [INFO ] [MAIN ] MOD: Starting full primary refresh. [2025-09-29T19:57:19.548094] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-04. [2025-09-29T19:57:19.662751] [INFO ] [REMOTE ] MOD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:57:19.679445] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-29T19:57:20.348104] [INFO ] [REMOTE ] MOD: Fetching primary data for 2024-12. [2025-09-29T19:57:20.643499] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-29T19:57:20.920519] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-09-29T19:57:21.148155] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-05. [2025-09-29T19:57:21.900809] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-29T19:57:21.948086] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-01. [2025-09-29T19:57:22.439314] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-29T19:57:22.748143] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-03. [2025-09-29T19:57:23.550035] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-03. [2025-09-29T19:57:23.553631] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-29T19:57:24.348121] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-06. [2025-09-29T19:57:24.521478] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-29T19:57:25.148115] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-04. [2025-09-29T19:57:25.692802] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-29T19:57:25.812411] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-29T19:57:25.948123] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-07. [2025-09-29T19:57:26.748077] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-02. [2025-09-29T19:57:26.952095] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-29T19:57:27.078708] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-29T19:57:27.548130] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-04. [2025-09-29T19:57:28.243342] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-29T19:57:28.348117] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-03. [2025-09-29T19:57:29.148203] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-05. [2025-09-29T19:57:29.953889] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-08. [2025-09-29T19:57:29.972155] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-09-29T19:57:30.176746] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-29T19:57:30.748119] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-05. [2025-09-29T19:57:30.898493] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-29T19:57:31.149843] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-29T19:57:31.548194] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-06. [2025-09-29T19:57:32.348182] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-04. [2025-09-29T19:57:32.800725] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-29T19:57:33.134225] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-29T19:57:33.148084] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-07. [2025-09-29T19:57:33.948105] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-06. [2025-09-29T19:57:34.107001] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-29T19:57:34.748089] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-09. [2025-09-29T19:57:34.918121] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-29T19:57:35.548169] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-08. [2025-09-29T19:57:35.871888] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-29T19:57:35.877168] [INFO ] [REMOTE ] MNR: Full fetch complete (36867 records). [2025-09-29T19:57:35.877333] [DEBUG] [VALIDATOR ] MNR: Validating primary data. [2025-09-29T19:57:36.293866] [DEBUG] [VALIDATOR ] MNR: All expected trading days are present. [2025-09-29T19:57:36.294053] [DEBUG] [VALIDATOR ] MNR: Primary data validation passed. [2025-09-29T19:57:36.294860] [INFO ] [MAIN ] MNR: Fetched primary data is valid. [2025-09-29T19:57:36.304775] [DEBUG] [LOCAL ] MNR: Saving primary data. [2025-09-29T19:57:36.323815] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-09-29T19:57:36.327825] [DEBUG] [LOCAL ] MNR: Trimmed 36867 records to 24542 (keeping 200 days of data) [2025-09-29T19:57:36.398454] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-07. [2025-09-29T19:57:36.502688] [DEBUG] [LOCAL ] MNR: Primary data saved (24542 records). [2025-09-29T19:57:36.502824] [INFO ] [MAIN ] MNR: Full history saved. [2025-09-29T19:57:36.502909] [INFO ] [MAIN ] Update Progress: 1383/2371 symbols completed. MNR took 32.1s. Estimated remaining: 2h 6m 51s. Rate: 7.8 symbols/min [2025-09-29T19:57:36.684555] [INFO ] [MAIN ] MODG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:57:36.741386] [DEBUG] [LOCAL ] MODG: Loaded 52353 existing records from primary storage. [2025-09-29T19:57:36.741806] [INFO ] [MAIN ] MODG: Loaded 52353 existing records. [2025-09-29T19:57:36.925129] [WARN ] [MAIN ] MODG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:57:36.925330] [INFO ] [MAIN ] MODG: Wiping existing primary data before full refresh. [2025-09-29T19:57:36.925377] [INFO ] [LOCAL ] MODG: Starting deletion of primary data. [2025-09-29T19:57:36.925891] [DEBUG] [LOCAL ] MODG: Deleted primary data file. [2025-09-29T19:57:36.925952] [INFO ] [MAIN ] MODG: Starting full primary refresh. [2025-09-29T19:57:37.152439] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-05. [2025-09-29T19:57:37.313092] [INFO ] [REMOTE ] MODG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:57:37.340475] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-29T19:57:37.948140] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-09. [2025-09-29T19:57:38.748183] [INFO ] [REMOTE ] MODG: Fetching primary data for 2024-12. [2025-09-29T19:57:38.936509] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-09-29T19:57:38.981545] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-29T19:57:39.548098] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-08. [2025-09-29T19:57:39.985559] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-29T19:57:39.995627] [INFO ] [REMOTE ] MNSO: Full fetch complete (64230 records). [2025-09-29T19:57:39.995801] [DEBUG] [VALIDATOR ] MNSO: Validating primary data. [2025-09-29T19:57:40.350789] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-06. [2025-09-29T19:57:40.399808] [DEBUG] [VALIDATOR ] MNSO: All expected trading days are present. [2025-09-29T19:57:40.400027] [DEBUG] [VALIDATOR ] MNSO: Primary data validation passed. [2025-09-29T19:57:40.401237] [INFO ] [MAIN ] MNSO: Fetched primary data is valid. [2025-09-29T19:57:40.401395] [DEBUG] [LOCAL ] MNSO: Saving primary data. [2025-09-29T19:57:40.435286] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-29T19:57:40.446108] [DEBUG] [LOCAL ] MNSO: Trimmed 64230 records to 44433 (keeping 200 days of data) [2025-09-29T19:57:40.725060] [DEBUG] [LOCAL ] MNSO: Primary data saved (44433 records). [2025-09-29T19:57:40.725204] [INFO ] [MAIN ] MNSO: Full history saved. [2025-09-29T19:57:40.725291] [INFO ] [MAIN ] Update Progress: 1384/2371 symbols completed. MNSO took 35.3s. Estimated remaining: 2h 6m 41s. Rate: 7.8 symbols/min [2025-09-29T19:57:40.900124] [INFO ] [MAIN ] MOH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:57:40.952749] [DEBUG] [LOCAL ] MOH: Loaded 42444 existing records from primary storage. [2025-09-29T19:57:40.953083] [INFO ] [MAIN ] MOH: Loaded 42444 existing records. [2025-09-29T19:57:41.138316] [WARN ] [MAIN ] MOH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:57:41.138586] [INFO ] [MAIN ] MOH: Wiping existing primary data before full refresh. [2025-09-29T19:57:41.138742] [INFO ] [LOCAL ] MOH: Starting deletion of primary data. [2025-09-29T19:57:41.139404] [DEBUG] [LOCAL ] MOH: Deleted primary data file. [2025-09-29T19:57:41.139465] [INFO ] [MAIN ] MOH: Starting full primary refresh. [2025-09-29T19:57:41.172335] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-01. [2025-09-29T19:57:41.593505] [INFO ] [REMOTE ] MOH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:57:41.627231] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-29T19:57:41.928250] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-29T19:57:41.948088] [INFO ] [REMOTE ] MOH: Fetching primary data for 2024-12. [2025-09-29T19:57:42.719295] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-29T19:57:42.748091] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-07. [2025-09-29T19:57:43.371074] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-29T19:57:43.548143] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-09. [2025-09-29T19:57:44.348087] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-01. [2025-09-29T19:57:44.542964] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-29T19:57:45.148126] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-02. [2025-09-29T19:57:45.803854] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-29T19:57:45.815378] [INFO ] [REMOTE ] MO: Full fetch complete (77495 records). [2025-09-29T19:57:45.815594] [DEBUG] [VALIDATOR ] MO: Validating primary data. [2025-09-29T19:57:45.948499] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-08. [2025-09-29T19:57:46.035292] [WARN ] [VALIDATOR ] MO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-29T19:57:46.036260] [FATAL] [MAIN ] MO: Fetched primary data is invalid. Refusing to save it. [2025-09-29T19:57:46.036390] [WARN ] [MAIN ] MO: Deleting existing primary and derivative data due to validation failure. [2025-09-29T19:57:46.036541] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-09-29T19:57:46.036748] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-09-29T19:57:46.036862] [INFO ] [LOCAL ] MO: Starting deletion of derivative data. [2025-09-29T19:57:46.047611] [DEBUG] [LOCAL ] MO: No derivative data file found to delete. [2025-09-29T19:57:46.054101] [INFO ] [MAIN ] Update Progress: 1385/2371 symbols completed. MO took 34.3s. Estimated remaining: 2h 6m 31s. Rate: 7.8 symbols/min [2025-09-29T19:57:46.100754] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-29T19:57:46.239703] [INFO ] [MAIN ] MOS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:57:46.294774] [DEBUG] [LOCAL ] MOS: Loaded 54284 existing records from primary storage. [2025-09-29T19:57:46.295127] [INFO ] [MAIN ] MOS: Loaded 54284 existing records. [2025-09-29T19:57:46.488074] [WARN ] [MAIN ] MOS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:57:46.488367] [INFO ] [MAIN ] MOS: Wiping existing primary data before full refresh. [2025-09-29T19:57:46.488442] [INFO ] [LOCAL ] MOS: Starting deletion of primary data. [2025-09-29T19:57:46.489333] [DEBUG] [LOCAL ] MOS: Deleted primary data file. [2025-09-29T19:57:46.489396] [INFO ] [MAIN ] MOS: Starting full primary refresh. [2025-09-29T19:57:46.749773] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-02. [2025-09-29T19:57:46.886129] [INFO ] [REMOTE ] MOS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:57:46.915634] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-29T19:57:47.198972] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-29T19:57:47.548144] [INFO ] [REMOTE ] MOS: Fetching primary data for 2024-12. [2025-09-29T19:57:48.348097] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-09. [2025-09-29T19:57:48.397366] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-29T19:57:49.148111] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-03. [2025-09-29T19:57:49.402273] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-29T19:57:49.948131] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-03. [2025-09-29T19:57:50.104869] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-29T19:57:50.114350] [INFO ] [REMOTE ] MOD: Full fetch complete (66337 records). [2025-09-29T19:57:50.114534] [DEBUG] [VALIDATOR ] MOD: Validating primary data. [2025-09-29T19:57:50.553689] [DEBUG] [VALIDATOR ] MOD: All expected trading days are present. [2025-09-29T19:57:50.553873] [DEBUG] [VALIDATOR ] MOD: Primary data validation passed. [2025-09-29T19:57:50.554911] [INFO ] [MAIN ] MOD: Fetched primary data is valid. [2025-09-29T19:57:50.554979] [DEBUG] [LOCAL ] MOD: Saving primary data. [2025-09-29T19:57:50.556446] [DEBUG] [LOCAL ] MOD: Trimmed 66337 records to 45386 (keeping 200 days of data) [2025-09-29T19:57:50.770898] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-01. [2025-09-29T19:57:50.874120] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-29T19:57:50.890155] [DEBUG] [LOCAL ] MOD: Primary data saved (45386 records). [2025-09-29T19:57:50.890361] [INFO ] [MAIN ] MOD: Full history saved. [2025-09-29T19:57:50.890491] [INFO ] [MAIN ] Update Progress: 1386/2371 symbols completed. MOD took 32.1s. Estimated remaining: 2h 6m 21s. Rate: 7.8 symbols/min [2025-09-29T19:57:51.087172] [INFO ] [MAIN ] MOV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:57:51.111757] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-29T19:57:51.140992] [DEBUG] [LOCAL ] MOV: Loaded 22417 existing records from primary storage. [2025-09-29T19:57:51.141252] [INFO ] [MAIN ] MOV: Loaded 22417 existing records. [2025-09-29T19:57:51.324243] [WARN ] [MAIN ] MOV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:57:51.324510] [INFO ] [MAIN ] MOV: Wiping existing primary data before full refresh. [2025-09-29T19:57:51.324562] [INFO ] [LOCAL ] MOV: Starting deletion of primary data. [2025-09-29T19:57:51.324953] [DEBUG] [LOCAL ] MOV: Deleted primary data file. [2025-09-29T19:57:51.325015] [INFO ] [MAIN ] MOV: Starting full primary refresh. [2025-09-29T19:57:51.553581] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-04. [2025-09-29T19:57:51.701270] [INFO ] [REMOTE ] MOV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:57:52.348135] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-04. [2025-09-29T19:57:52.469381] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-29T19:57:53.148099] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-02. [2025-09-29T19:57:53.231936] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-29T19:57:53.948188] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-05. [2025-09-29T19:57:54.182294] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-29T19:57:54.748165] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-05. [2025-09-29T19:57:54.835219] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-29T19:57:55.491579] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-29T19:57:55.548168] [INFO ] [REMOTE ] MOV: Fetching primary data for 2024-12. [2025-09-29T19:57:56.348152] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-03. [2025-09-29T19:57:56.466919] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-29T19:57:56.510559] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-29T19:57:57.148113] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-06. [2025-09-29T19:57:57.904454] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-29T19:57:57.948070] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-04. [2025-09-29T19:57:58.748118] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-06. [2025-09-29T19:57:58.925033] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-29T19:57:59.548138] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-07. [2025-09-29T19:57:59.831852] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-29T19:57:59.903339] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-29T19:58:00.348118] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-05. [2025-09-29T19:58:01.148132] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-07. [2025-09-29T19:58:01.387923] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-29T19:58:01.948121] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-08. [2025-09-29T19:58:02.221438] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-29T19:58:02.748184] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-01. [2025-09-29T19:58:03.180819] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-29T19:58:03.253180] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-29T19:58:03.442079] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-29T19:58:03.548092] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-02. [2025-09-29T19:58:04.348131] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-06. [2025-09-29T19:58:04.659954] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-29T19:58:05.148115] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-03. [2025-09-29T19:58:05.948134] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-08. [2025-09-29T19:58:06.233335] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-29T19:58:06.261091] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-29T19:58:06.748113] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-07. [2025-09-29T19:58:07.548108] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-09. [2025-09-29T19:58:07.730924] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-29T19:58:08.348113] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-04. [2025-09-29T19:58:08.614371] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-29T19:58:09.049876] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-29T19:58:09.060777] [INFO ] [REMOTE ] MODG: Full fetch complete (74772 records). [2025-09-29T19:58:09.061004] [DEBUG] [VALIDATOR ] MODG: Validating primary data. [2025-09-29T19:58:09.156218] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-08. [2025-09-29T19:58:09.495677] [DEBUG] [VALIDATOR ] MODG: All expected trading days are present. [2025-09-29T19:58:09.495907] [DEBUG] [VALIDATOR ] MODG: Primary data validation passed. [2025-09-29T19:58:09.497405] [INFO ] [MAIN ] MODG: Fetched primary data is valid. [2025-09-29T19:58:09.497528] [DEBUG] [LOCAL ] MODG: Saving primary data. [2025-09-29T19:58:09.517021] [DEBUG] [LOCAL ] MODG: Trimmed 74772 records to 51575 (keeping 200 days of data) [2025-09-29T19:58:09.518824] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-29T19:58:09.844975] [DEBUG] [LOCAL ] MODG: Primary data saved (51575 records). [2025-09-29T19:58:09.845172] [INFO ] [MAIN ] MODG: Full history saved. [2025-09-29T19:58:09.845413] [INFO ] [MAIN ] Update Progress: 1387/2371 symbols completed. MODG took 33.3s. Estimated remaining: 2h 6m 22s. Rate: 7.8 symbols/min [2025-09-29T19:58:09.953636] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-09. [2025-09-29T19:58:10.036668] [INFO ] [MAIN ] MP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:58:10.100280] [DEBUG] [LOCAL ] MP: Loaded 54444 existing records from primary storage. [2025-09-29T19:58:10.100635] [INFO ] [MAIN ] MP: Loaded 54444 existing records. [2025-09-29T19:58:10.298253] [WARN ] [MAIN ] MP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:58:10.298495] [INFO ] [MAIN ] MP: Wiping existing primary data before full refresh. [2025-09-29T19:58:10.298545] [INFO ] [LOCAL ] MP: Starting deletion of primary data. [2025-09-29T19:58:10.299139] [DEBUG] [LOCAL ] MP: Deleted primary data file. [2025-09-29T19:58:10.299217] [INFO ] [MAIN ] MP: Starting full primary refresh. [2025-09-29T19:58:10.694286] [INFO ] [REMOTE ] MP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:58:10.748111] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-05. [2025-09-29T19:58:11.034339] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-29T19:58:11.535569] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-29T19:58:11.546008] [INFO ] [REMOTE ] MOH: Full fetch complete (58394 records). [2025-09-29T19:58:11.546199] [DEBUG] [VALIDATOR ] MOH: Validating primary data. [2025-09-29T19:58:11.552685] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-09. [2025-09-29T19:58:12.004663] [DEBUG] [VALIDATOR ] MOH: All expected trading days are present. [2025-09-29T19:58:12.005352] [DEBUG] [VALIDATOR ] MOH: Primary data validation passed. [2025-09-29T19:58:12.006029] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-29T19:58:12.007170] [INFO ] [MAIN ] MOH: Fetched primary data is valid. [2025-09-29T19:58:12.012553] [DEBUG] [LOCAL ] MOH: Saving primary data. [2025-09-29T19:58:12.014171] [DEBUG] [LOCAL ] MOH: Trimmed 58394 records to 41824 (keeping 200 days of data) [2025-09-29T19:58:12.280204] [DEBUG] [LOCAL ] MOH: Primary data saved (41824 records). [2025-09-29T19:58:12.280364] [INFO ] [MAIN ] MOH: Full history saved. [2025-09-29T19:58:12.280449] [INFO ] [MAIN ] Update Progress: 1388/2371 symbols completed. MOH took 31.6s. Estimated remaining: 2h 6m 10s. Rate: 7.8 symbols/min [2025-09-29T19:58:12.353248] [INFO ] [REMOTE ] MP: Fetching primary data for 2024-12. [2025-09-29T19:58:12.463737] [INFO ] [MAIN ] MPA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:58:12.472939] [DEBUG] [LOCAL ] MPA: Loaded 5268 existing records from primary storage. [2025-09-29T19:58:12.473164] [INFO ] [MAIN ] MPA: Loaded 5268 existing records. [2025-09-29T19:58:12.666187] [WARN ] [MAIN ] MPA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:58:12.666442] [INFO ] [MAIN ] MPA: Wiping existing primary data before full refresh. [2025-09-29T19:58:12.666493] [INFO ] [LOCAL ] MPA: Starting deletion of primary data. [2025-09-29T19:58:12.666862] [DEBUG] [LOCAL ] MPA: Deleted primary data file. [2025-09-29T19:58:12.666924] [INFO ] [MAIN ] MPA: Starting full primary refresh. [2025-09-29T19:58:13.030982] [INFO ] [REMOTE ] MPA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:58:13.148167] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-06. [2025-09-29T19:58:13.684024] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-29T19:58:13.695381] [INFO ] [REMOTE ] MOS: Full fetch complete (77452 records). [2025-09-29T19:58:13.695572] [DEBUG] [VALIDATOR ] MOS: Validating primary data. [2025-09-29T19:58:13.953284] [INFO ] [REMOTE ] MPA: Fetching primary data for 2024-12. [2025-09-29T19:58:14.119322] [DEBUG] [VALIDATOR ] MOS: All expected trading days are present. [2025-09-29T19:58:14.119430] [DEBUG] [VALIDATOR ] MOS: Primary data validation passed. [2025-09-29T19:58:14.120543] [INFO ] [MAIN ] MOS: Fetched primary data is valid. [2025-09-29T19:58:14.120624] [DEBUG] [LOCAL ] MOS: Saving primary data. [2025-09-29T19:58:14.122355] [DEBUG] [LOCAL ] MOS: Trimmed 77452 records to 53505 (keeping 200 days of data) [2025-09-29T19:58:14.250102] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-29T19:58:14.422599] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-29T19:58:14.566025] [DEBUG] [LOCAL ] MOS: Primary data saved (53505 records). [2025-09-29T19:58:14.566177] [INFO ] [MAIN ] MOS: Full history saved. [2025-09-29T19:58:14.566261] [INFO ] [MAIN ] Update Progress: 1389/2371 symbols completed. MOS took 28.5s. Estimated remaining: 2h 5m 59s. Rate: 7.8 symbols/min [2025-09-29T19:58:14.707812] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-29T19:58:14.757418] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-07. [2025-09-29T19:58:14.761517] [INFO ] [MAIN ] MPC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:58:14.821015] [DEBUG] [LOCAL ] MPC: Loaded 52889 existing records from primary storage. [2025-09-29T19:58:14.821355] [INFO ] [MAIN ] MPC: Loaded 52889 existing records. [2025-09-29T19:58:15.010677] [WARN ] [MAIN ] MPC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:58:15.010939] [INFO ] [MAIN ] MPC: Wiping existing primary data before full refresh. [2025-09-29T19:58:15.010998] [INFO ] [LOCAL ] MPC: Starting deletion of primary data. [2025-09-29T19:58:15.011871] [DEBUG] [LOCAL ] MPC: Deleted primary data file. [2025-09-29T19:58:15.011932] [INFO ] [MAIN ] MPC: Starting full primary refresh. [2025-09-29T19:58:15.414238] [INFO ] [REMOTE ] MPC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:58:15.548139] [INFO ] [REMOTE ] MPC: Fetching primary data for 2024-12. [2025-09-29T19:58:15.759433] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-29T19:58:16.348168] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-01. [2025-09-29T19:58:17.039954] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-29T19:58:17.148102] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-02. [2025-09-29T19:58:17.383919] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-29T19:58:17.734007] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-29T19:58:17.948126] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-01. [2025-09-29T19:58:18.748182] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-01. [2025-09-29T19:58:19.548136] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-08. [2025-09-29T19:58:19.808904] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-29T19:58:20.127171] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-29T19:58:20.348116] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-02. [2025-09-29T19:58:20.607693] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-29T19:58:21.148168] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-09. [2025-09-29T19:58:21.953485] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-03. [2025-09-29T19:58:21.988240] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-29T19:58:22.309358] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-29T19:58:22.314820] [INFO ] [REMOTE ] MOV: Full fetch complete (30659 records). [2025-09-29T19:58:22.315014] [DEBUG] [VALIDATOR ] MOV: Validating primary data. [2025-09-29T19:58:22.625887] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-29T19:58:22.729351] [DEBUG] [VALIDATOR ] MOV: All expected trading days are present. [2025-09-29T19:58:22.729439] [DEBUG] [VALIDATOR ] MOV: Primary data validation passed. [2025-09-29T19:58:22.730187] [INFO ] [MAIN ] MOV: Fetched primary data is valid. [2025-09-29T19:58:22.730252] [DEBUG] [LOCAL ] MOV: Saving primary data. [2025-09-29T19:58:22.731201] [DEBUG] [LOCAL ] MOV: Trimmed 30659 records to 22031 (keeping 200 days of data) [2025-09-29T19:58:22.784555] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-04. [2025-09-29T19:58:22.878967] [DEBUG] [LOCAL ] MOV: Primary data saved (22031 records). [2025-09-29T19:58:22.879106] [INFO ] [MAIN ] MOV: Full history saved. [2025-09-29T19:58:22.879194] [INFO ] [MAIN ] Update Progress: 1390/2371 symbols completed. MOV took 32.0s. Estimated remaining: 2h 5m 52s. Rate: 7.8 symbols/min [2025-09-29T19:58:23.062611] [INFO ] [MAIN ] MPLX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:58:23.115137] [DEBUG] [LOCAL ] MPLX: Loaded 51491 existing records from primary storage. [2025-09-29T19:58:23.115465] [INFO ] [MAIN ] MPLX: Loaded 51491 existing records. [2025-09-29T19:58:23.304676] [WARN ] [MAIN ] MPLX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:58:23.305012] [INFO ] [MAIN ] MPLX: Wiping existing primary data before full refresh. [2025-09-29T19:58:23.305081] [INFO ] [LOCAL ] MPLX: Starting deletion of primary data. [2025-09-29T19:58:23.305434] [DEBUG] [LOCAL ] MPLX: Deleted primary data file. [2025-09-29T19:58:23.305501] [INFO ] [MAIN ] MPLX: Starting full primary refresh. [2025-09-29T19:58:23.550916] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-03. [2025-09-29T19:58:23.597212] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-29T19:58:23.762106] [INFO ] [REMOTE ] MPLX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:58:24.348154] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-05. [2025-09-29T19:58:24.970251] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-29T19:58:25.148124] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-06. [2025-09-29T19:58:25.479541] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-29T19:58:25.755955] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-29T19:58:25.948124] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-07. [2025-09-29T19:58:26.551982] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-29T19:58:26.748155] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-02. [2025-09-29T19:58:27.548163] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2024-12. [2025-09-29T19:58:28.348125] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-04. [2025-09-29T19:58:28.702243] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-29T19:58:29.148132] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-03. [2025-09-29T19:58:29.319376] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-29T19:58:29.948134] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-08. [2025-09-29T19:58:30.132970] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-29T19:58:30.543132] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-29T19:58:30.748118] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-09. [2025-09-29T19:58:31.122107] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-29T19:58:31.196001] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-29T19:58:31.197677] [INFO ] [REMOTE ] MPA: Full fetch complete (7117 records). [2025-09-29T19:58:31.197756] [DEBUG] [VALIDATOR ] MPA: Validating primary data. [2025-09-29T19:58:31.552374] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-01. [2025-09-29T19:58:31.585419] [DEBUG] [VALIDATOR ] MPA: All expected trading days are present. [2025-09-29T19:58:31.585522] [DEBUG] [VALIDATOR ] MPA: Primary data validation passed. [2025-09-29T19:58:31.585769] [INFO ] [MAIN ] MPA: Fetched primary data is valid. [2025-09-29T19:58:31.585845] [DEBUG] [LOCAL ] MPA: Saving primary data. [2025-09-29T19:58:31.586305] [DEBUG] [LOCAL ] MPA: Trimmed 7117 records to 5231 (keeping 200 days of data) [2025-09-29T19:58:31.621732] [DEBUG] [LOCAL ] MPA: Primary data saved (5231 records). [2025-09-29T19:58:31.621842] [INFO ] [MAIN ] MPA: Full history saved. [2025-09-29T19:58:31.621930] [INFO ] [MAIN ] Update Progress: 1391/2371 symbols completed. MPA took 19.3s. Estimated remaining: 2h 5m 45s. Rate: 7.8 symbols/min [2025-09-29T19:58:31.796098] [INFO ] [MAIN ] MPV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:58:31.804443] [DEBUG] [LOCAL ] MPV: Loaded 5098 existing records from primary storage. [2025-09-29T19:58:31.804675] [INFO ] [MAIN ] MPV: Loaded 5098 existing records. [2025-09-29T19:58:31.992097] [WARN ] [MAIN ] MPV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:58:31.992392] [INFO ] [MAIN ] MPV: Wiping existing primary data before full refresh. [2025-09-29T19:58:31.992456] [INFO ] [LOCAL ] MPV: Starting deletion of primary data. [2025-09-29T19:58:31.992783] [DEBUG] [LOCAL ] MPV: Deleted primary data file. [2025-09-29T19:58:31.992844] [INFO ] [MAIN ] MPV: Starting full primary refresh. [2025-09-29T19:58:32.349450] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-04. [2025-09-29T19:58:32.374883] [INFO ] [REMOTE ] MPV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:58:33.148131] [INFO ] [REMOTE ] MPV: Fetching primary data for 2024-12. [2025-09-29T19:58:33.391082] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-29T19:58:33.769256] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-29T19:58:33.948142] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-02. [2025-09-29T19:58:34.353541] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-29T19:58:34.748231] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-05. [2025-09-29T19:58:35.318080] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-29T19:58:35.548116] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-03. [2025-09-29T19:58:36.348078] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-01. [2025-09-29T19:58:36.522043] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-29T19:58:36.993633] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-29T19:58:37.148090] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-02. [2025-09-29T19:58:37.271475] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-29T19:58:37.845953] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-29T19:58:37.948102] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-03. [2025-09-29T19:58:38.690153] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-29T19:58:38.748105] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-06. [2025-09-29T19:58:39.548132] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-04. [2025-09-29T19:58:40.192721] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-29T19:58:40.348110] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-05. [2025-09-29T19:58:40.531394] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-29T19:58:41.148153] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-04. [2025-09-29T19:58:41.948122] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-05. [2025-09-29T19:58:42.559972] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-29T19:58:42.578159] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-29T19:58:42.748100] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-06. [2025-09-29T19:58:42.939373] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-29T19:58:43.379504] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-29T19:58:43.548102] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-07. [2025-09-29T19:58:44.123220] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-29T19:58:44.348147] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-06. [2025-09-29T19:58:45.148126] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-07. [2025-09-29T19:58:45.948125] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-08. [2025-09-29T19:58:46.540113] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-29T19:58:46.748694] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-09. [2025-09-29T19:58:46.774414] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-09-29T19:58:47.028792] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-29T19:58:47.333911] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-29T19:58:47.335403] [INFO ] [REMOTE ] MPV: Full fetch complete (8051 records). [2025-09-29T19:58:47.335476] [DEBUG] [VALIDATOR ] MPV: Validating primary data. [2025-09-29T19:58:47.554319] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-07. [2025-09-29T19:58:47.713248] [DEBUG] [VALIDATOR ] MPV: All expected trading days are present. [2025-09-29T19:58:47.713334] [DEBUG] [VALIDATOR ] MPV: Primary data validation passed. [2025-09-29T19:58:47.713529] [INFO ] [MAIN ] MPV: Fetched primary data is valid. [2025-09-29T19:58:47.713570] [DEBUG] [LOCAL ] MPV: Saving primary data. [2025-09-29T19:58:47.714142] [DEBUG] [LOCAL ] MPV: Trimmed 8051 records to 4996 (keeping 200 days of data) [2025-09-29T19:58:47.746014] [DEBUG] [LOCAL ] MPV: Primary data saved (4996 records). [2025-09-29T19:58:47.746165] [INFO ] [MAIN ] MPV: Full history saved. [2025-09-29T19:58:47.746259] [INFO ] [MAIN ] Update Progress: 1392/2371 symbols completed. MPV took 16.1s. Estimated remaining: 2h 5m 43s. Rate: 7.8 symbols/min [2025-09-29T19:58:47.928207] [INFO ] [MAIN ] MPW: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:58:47.985216] [DEBUG] [LOCAL ] MPW: Loaded 54275 existing records from primary storage. [2025-09-29T19:58:47.985604] [INFO ] [MAIN ] MPW: Loaded 54275 existing records. [2025-09-29T19:58:48.173178] [WARN ] [MAIN ] MPW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:58:48.173436] [INFO ] [MAIN ] MPW: Wiping existing primary data before full refresh. [2025-09-29T19:58:48.173483] [INFO ] [LOCAL ] MPW: Starting deletion of primary data. [2025-09-29T19:58:48.173802] [DEBUG] [LOCAL ] MPW: Deleted primary data file. [2025-09-29T19:58:48.173871] [INFO ] [MAIN ] MPW: Starting full primary refresh. [2025-09-29T19:58:48.360531] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-05. [2025-09-29T19:58:48.569774] [INFO ] [REMOTE ] MPW: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:58:49.148111] [INFO ] [REMOTE ] MPW: Fetching primary data for 2024-12. [2025-09-29T19:58:49.948125] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-08. [2025-09-29T19:58:50.317502] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-07 (2.76 seconds). [2025-09-29T19:58:50.348058] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-29T19:58:50.748112] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-08. [2025-09-29T19:58:51.220749] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-29T19:58:51.548085] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-06. [2025-09-29T19:58:51.729600] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-29T19:58:52.348133] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-09. [2025-09-29T19:58:53.148113] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-01. [2025-09-29T19:58:53.191624] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-29T19:58:53.428470] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-08 (2.68 seconds). [2025-09-29T19:58:53.942889] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-29T19:58:53.954237] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-09. [2025-09-29T19:58:53.956833] [INFO ] [REMOTE ] MPC: Full fetch complete (75885 records). [2025-09-29T19:58:53.957082] [DEBUG] [VALIDATOR ] MPC: Validating primary data. [2025-09-29T19:58:54.395321] [DEBUG] [VALIDATOR ] MPC: All expected trading days are present. [2025-09-29T19:58:54.395410] [DEBUG] [VALIDATOR ] MPC: Primary data validation passed. [2025-09-29T19:58:54.396500] [INFO ] [MAIN ] MPC: Fetched primary data is valid. [2025-09-29T19:58:54.396568] [DEBUG] [LOCAL ] MPC: Saving primary data. [2025-09-29T19:58:54.398194] [DEBUG] [LOCAL ] MPC: Trimmed 75885 records to 52108 (keeping 200 days of data) [2025-09-29T19:58:54.748363] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-07. [2025-09-29T19:58:54.753330] [DEBUG] [LOCAL ] MPC: Primary data saved (52108 records). [2025-09-29T19:58:54.754461] [INFO ] [MAIN ] MPC: Full history saved. [2025-09-29T19:58:54.754570] [INFO ] [MAIN ] Update Progress: 1393/2371 symbols completed. MPC took 40.2s. Estimated remaining: 2h 5m 35s. Rate: 7.8 symbols/min [2025-09-29T19:58:54.931300] [INFO ] [MAIN ] MPX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:58:54.938722] [DEBUG] [LOCAL ] MPX: Loaded 4213 existing records from primary storage. [2025-09-29T19:58:54.938920] [INFO ] [MAIN ] MPX: Loaded 4213 existing records. [2025-09-29T19:58:55.130545] [WARN ] [MAIN ] MPX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:58:55.130979] [INFO ] [MAIN ] MPX: Wiping existing primary data before full refresh. [2025-09-29T19:58:55.131055] [INFO ] [LOCAL ] MPX: Starting deletion of primary data. [2025-09-29T19:58:55.131770] [DEBUG] [LOCAL ] MPX: Deleted primary data file. [2025-09-29T19:58:55.131912] [INFO ] [MAIN ] MPX: Starting full primary refresh. [2025-09-29T19:58:55.408910] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-09-29T19:58:55.555681] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-02. [2025-09-29T19:58:55.605030] [INFO ] [REMOTE ] MPX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:58:56.348108] [INFO ] [REMOTE ] MPX: Fetching primary data for 2024-12. [2025-09-29T19:58:56.492468] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-29T19:58:56.824074] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-09 (2.87 seconds). [2025-09-29T19:58:56.835582] [INFO ] [REMOTE ] MP: Full fetch complete (77305 records). [2025-09-29T19:58:56.835785] [DEBUG] [VALIDATOR ] MP: Validating primary data. [2025-09-29T19:58:56.950833] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-29T19:58:57.153226] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-01. [2025-09-29T19:58:57.267943] [DEBUG] [VALIDATOR ] MP: All expected trading days are present. [2025-09-29T19:58:57.268048] [DEBUG] [VALIDATOR ] MP: Primary data validation passed. [2025-09-29T19:58:57.269156] [INFO ] [MAIN ] MP: Fetched primary data is valid. [2025-09-29T19:58:57.269248] [DEBUG] [LOCAL ] MP: Saving primary data. [2025-09-29T19:58:57.270972] [DEBUG] [LOCAL ] MP: Trimmed 77305 records to 53669 (keeping 200 days of data) [2025-09-29T19:58:57.520893] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-29T19:58:57.632205] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-29T19:58:57.662366] [DEBUG] [LOCAL ] MP: Primary data saved (53669 records). [2025-09-29T19:58:57.662497] [INFO ] [MAIN ] MP: Full history saved. [2025-09-29T19:58:57.662595] [INFO ] [MAIN ] Update Progress: 1394/2371 symbols completed. MP took 47.8s. Estimated remaining: 2h 5m 24s. Rate: 7.8 symbols/min [2025-09-29T19:58:57.849829] [INFO ] [MAIN ] MQT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:58:57.862023] [DEBUG] [LOCAL ] MQT: Loaded 8523 existing records from primary storage. [2025-09-29T19:58:57.862249] [INFO ] [MAIN ] MQT: Loaded 8523 existing records. [2025-09-29T19:58:57.953211] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-03. [2025-09-29T19:58:58.047955] [WARN ] [MAIN ] MQT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:58:58.048161] [INFO ] [MAIN ] MQT: Wiping existing primary data before full refresh. [2025-09-29T19:58:58.048209] [INFO ] [LOCAL ] MQT: Starting deletion of primary data. [2025-09-29T19:58:58.048454] [DEBUG] [LOCAL ] MQT: Deleted primary data file. [2025-09-29T19:58:58.048513] [INFO ] [MAIN ] MQT: Starting full primary refresh. [2025-09-29T19:58:58.416156] [INFO ] [REMOTE ] MQT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:58:58.748124] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-08. [2025-09-29T19:58:59.548149] [INFO ] [REMOTE ] MQT: Fetching primary data for 2024-12. [2025-09-29T19:58:59.965737] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-29T19:59:00.314515] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-29T19:59:00.348118] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-02. [2025-09-29T19:59:00.567538] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-29T19:59:01.028424] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-29T19:59:01.148125] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-04. [2025-09-29T19:59:01.948140] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-09. [2025-09-29T19:59:02.748106] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-03. [2025-09-29T19:59:03.142228] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-29T19:59:03.344923] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-29T19:59:03.360397] [INFO ] [REMOTE ] MPLX: Full fetch complete (74050 records). [2025-09-29T19:59:03.361063] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-29T19:59:03.362492] [DEBUG] [VALIDATOR ] MPLX: Validating primary data. [2025-09-29T19:59:03.551103] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-05. [2025-09-29T19:59:03.783119] [DEBUG] [VALIDATOR ] MPLX: All expected trading days are present. [2025-09-29T19:59:03.783394] [DEBUG] [VALIDATOR ] MPLX: Primary data validation passed. [2025-09-29T19:59:03.784486] [INFO ] [MAIN ] MPLX: Fetched primary data is valid. [2025-09-29T19:59:03.784555] [DEBUG] [LOCAL ] MPLX: Saving primary data. [2025-09-29T19:59:03.786222] [DEBUG] [LOCAL ] MPLX: Trimmed 74050 records to 50731 (keeping 200 days of data) [2025-09-29T19:59:04.111300] [DEBUG] [LOCAL ] MPLX: Primary data saved (50731 records). [2025-09-29T19:59:04.111459] [INFO ] [MAIN ] MPLX: Full history saved. [2025-09-29T19:59:04.111610] [INFO ] [MAIN ] Update Progress: 1395/2371 symbols completed. MPLX took 41.2s. Estimated remaining: 2h 5m 15s. Rate: 7.8 symbols/min [2025-09-29T19:59:04.291613] [INFO ] [MAIN ] MQY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:59:04.310977] [DEBUG] [LOCAL ] MQY: Loaded 16979 existing records from primary storage. [2025-09-29T19:59:04.311246] [INFO ] [MAIN ] MQY: Loaded 16979 existing records. [2025-09-29T19:59:04.354346] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-04. [2025-09-29T19:59:04.495348] [WARN ] [MAIN ] MQY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:59:04.495609] [INFO ] [MAIN ] MQY: Wiping existing primary data before full refresh. [2025-09-29T19:59:04.495687] [INFO ] [LOCAL ] MQY: Starting deletion of primary data. [2025-09-29T19:59:04.495894] [DEBUG] [LOCAL ] MQY: Deleted primary data file. [2025-09-29T19:59:04.495951] [INFO ] [MAIN ] MQY: Starting full primary refresh. [2025-09-29T19:59:04.868529] [INFO ] [REMOTE ] MQY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:59:04.959969] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-29T19:59:05.148142] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-05. [2025-09-29T19:59:05.459812] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-29T19:59:05.743820] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-29T19:59:05.948092] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-06. [2025-09-29T19:59:06.748125] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-06. [2025-09-29T19:59:07.413679] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-29T19:59:07.548119] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-01. [2025-09-29T19:59:07.903897] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-29T19:59:08.348124] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-07. [2025-09-29T19:59:08.380484] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-29T19:59:08.955224] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-29T19:59:09.148109] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-02. [2025-09-29T19:59:09.897834] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-29T19:59:09.948110] [INFO ] [REMOTE ] MQY: Fetching primary data for 2024-12. [2025-09-29T19:59:10.748083] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-03. [2025-09-29T19:59:11.077351] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-29T19:59:11.189635] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-29T19:59:11.548115] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-01. [2025-09-29T19:59:12.348079] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-07. [2025-09-29T19:59:12.697020] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-29T19:59:13.148120] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-02. [2025-09-29T19:59:13.948122] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-04. [2025-09-29T19:59:14.093402] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-29T19:59:14.389746] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-29T19:59:14.748120] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-08. [2025-09-29T19:59:14.900906] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-29T19:59:15.155983] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-29T19:59:15.548191] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-03. [2025-09-29T19:59:16.348122] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-09. [2025-09-29T19:59:16.626090] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-29T19:59:17.025757] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-29T19:59:17.028040] [INFO ] [REMOTE ] MPX: Full fetch complete (6777 records). [2025-09-29T19:59:17.028137] [DEBUG] [VALIDATOR ] MPX: Validating primary data. [2025-09-29T19:59:17.153285] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-08. [2025-09-29T19:59:17.423217] [DEBUG] [VALIDATOR ] MPX: All expected trading days are present. [2025-09-29T19:59:17.423318] [DEBUG] [VALIDATOR ] MPX: Primary data validation passed. [2025-09-29T19:59:17.423523] [INFO ] [MAIN ] MPX: Fetched primary data is valid. [2025-09-29T19:59:17.423566] [DEBUG] [LOCAL ] MPX: Saving primary data. [2025-09-29T19:59:17.424092] [DEBUG] [LOCAL ] MPX: Trimmed 6777 records to 4085 (keeping 200 days of data) [2025-09-29T19:59:17.452055] [DEBUG] [LOCAL ] MPX: Primary data saved (4085 records). [2025-09-29T19:59:17.452180] [INFO ] [MAIN ] MPX: Full history saved. [2025-09-29T19:59:17.452301] [INFO ] [MAIN ] Update Progress: 1396/2371 symbols completed. MPX took 22.7s. Estimated remaining: 2h 5m 11s. Rate: 7.8 symbols/min [2025-09-29T19:59:17.628636] [INFO ] [MAIN ] MRC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:59:17.676882] [DEBUG] [LOCAL ] MRC: Loaded 38128 existing records from primary storage. [2025-09-29T19:59:17.677250] [INFO ] [MAIN ] MRC: Loaded 38128 existing records. [2025-09-29T19:59:17.872727] [WARN ] [MAIN ] MRC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:59:17.872969] [INFO ] [MAIN ] MRC: Wiping existing primary data before full refresh. [2025-09-29T19:59:17.873028] [INFO ] [LOCAL ] MRC: Starting deletion of primary data. [2025-09-29T19:59:17.873404] [DEBUG] [LOCAL ] MRC: Deleted primary data file. [2025-09-29T19:59:17.873466] [INFO ] [MAIN ] MRC: Starting full primary refresh. [2025-09-29T19:59:17.953222] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-05. [2025-09-29T19:59:18.261550] [INFO ] [REMOTE ] MRC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:59:18.587136] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-29T19:59:18.748139] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-06. [2025-09-29T19:59:19.182341] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-29T19:59:19.454504] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-29T19:59:19.548159] [INFO ] [REMOTE ] MRC: Fetching primary data for 2024-12. [2025-09-29T19:59:20.348131] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-09. [2025-09-29T19:59:20.858787] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-29T19:59:21.148154] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-01. [2025-09-29T19:59:21.948124] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-07. [2025-09-29T19:59:22.454955] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-29T19:59:22.466978] [INFO ] [REMOTE ] MPW: Full fetch complete (77518 records). [2025-09-29T19:59:22.467188] [DEBUG] [VALIDATOR ] MPW: Validating primary data. [2025-09-29T19:59:22.686760] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-29T19:59:22.718526] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-29T19:59:22.751498] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-08. [2025-09-29T19:59:22.957992] [DEBUG] [VALIDATOR ] MPW: All expected trading days are present. [2025-09-29T19:59:22.958087] [DEBUG] [VALIDATOR ] MPW: Primary data validation passed. [2025-09-29T19:59:22.959198] [INFO ] [MAIN ] MPW: Fetched primary data is valid. [2025-09-29T19:59:22.959268] [DEBUG] [LOCAL ] MPW: Saving primary data. [2025-09-29T19:59:22.960843] [DEBUG] [LOCAL ] MPW: Trimmed 77518 records to 53495 (keeping 200 days of data) [2025-09-29T19:59:23.327572] [DEBUG] [LOCAL ] MPW: Primary data saved (53495 records). [2025-09-29T19:59:23.327744] [INFO ] [MAIN ] MPW: Full history saved. [2025-09-29T19:59:23.327851] [INFO ] [MAIN ] Update Progress: 1397/2371 symbols completed. MPW took 35.6s. Estimated remaining: 2h 5m 2s. Rate: 7.8 symbols/min [2025-09-29T19:59:23.475932] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-29T19:59:23.548126] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-04. [2025-09-29T19:59:24.348086] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-09. [2025-09-29T19:59:24.563581] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-29T19:59:25.148086] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-05. [2025-09-29T19:59:25.216989] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-29T19:59:25.219572] [INFO ] [REMOTE ] MQT: Full fetch complete (13348 records). [2025-09-29T19:59:25.219672] [DEBUG] [VALIDATOR ] MQT: Validating primary data. [2025-09-29T19:59:25.593079] [DEBUG] [VALIDATOR ] MQT: All expected trading days are present. [2025-09-29T19:59:25.593177] [DEBUG] [VALIDATOR ] MQT: Primary data validation passed. [2025-09-29T19:59:25.593679] [INFO ] [MAIN ] MQT: Fetched primary data is valid. [2025-09-29T19:59:25.593746] [DEBUG] [LOCAL ] MQT: Saving primary data. [2025-09-29T19:59:25.594427] [DEBUG] [LOCAL ] MQT: Trimmed 13348 records to 8558 (keeping 200 days of data) [2025-09-29T19:59:25.653284] [DEBUG] [LOCAL ] MQT: Primary data saved (8558 records). [2025-09-29T19:59:25.653435] [INFO ] [MAIN ] MQT: Full history saved. [2025-09-29T19:59:25.653527] [INFO ] [MAIN ] Update Progress: 1398/2371 symbols completed. MQT took 28.0s. Estimated remaining: 2h 4m 51s. Rate: 7.8 symbols/min [2025-09-29T19:59:25.842325] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-29T19:59:25.948123] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-02. [2025-09-29T19:59:26.748171] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-06. [2025-09-29T19:59:27.345067] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-29T19:59:27.376345] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-29T19:59:27.548111] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-03. [2025-09-29T19:59:28.348129] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-07. [2025-09-29T19:59:28.752148] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-29T19:59:29.148175] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-04. [2025-09-29T19:59:29.369239] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-29T19:59:29.948143] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-08. [2025-09-29T19:59:30.718818] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-29T19:59:30.748071] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-05. [2025-09-29T19:59:30.903144] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-29T19:59:31.548167] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-09. [2025-09-29T19:59:31.860315] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-29T19:59:32.348089] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-06. [2025-09-29T19:59:32.636663] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-29T19:59:32.641345] [INFO ] [REMOTE ] MQY: Full fetch complete (27112 records). [2025-09-29T19:59:32.641432] [DEBUG] [VALIDATOR ] MQY: Validating primary data. [2025-09-29T19:59:33.012895] [DEBUG] [VALIDATOR ] MQY: All expected trading days are present. [2025-09-29T19:59:33.012974] [DEBUG] [VALIDATOR ] MQY: Primary data validation passed. [2025-09-29T19:59:33.013536] [INFO ] [MAIN ] MQY: Fetched primary data is valid. [2025-09-29T19:59:33.013577] [DEBUG] [LOCAL ] MQY: Saving primary data. [2025-09-29T19:59:33.014250] [DEBUG] [LOCAL ] MQY: Trimmed 27112 records to 16850 (keeping 200 days of data) [2025-09-29T19:59:33.127088] [DEBUG] [LOCAL ] MQY: Primary data saved (16850 records). [2025-09-29T19:59:33.127233] [INFO ] [MAIN ] MQY: Full history saved. [2025-09-29T19:59:33.127314] [INFO ] [MAIN ] Update Progress: 1399/2371 symbols completed. MQY took 29.0s. Estimated remaining: 2h 4m 43s. Rate: 7.8 symbols/min [2025-09-29T19:59:33.646494] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-29T19:59:33.654370] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-07. [2025-09-29T19:59:35.193754] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-29T19:59:35.203930] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-08. [2025-09-29T19:59:36.572460] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-29T19:59:36.581137] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-09. [2025-09-29T19:59:38.118683] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-29T19:59:38.126867] [INFO ] [REMOTE ] MRC: Full fetch complete (54793 records). [2025-09-29T19:59:38.127044] [DEBUG] [VALIDATOR ] MRC: Validating primary data. [2025-09-29T19:59:38.540142] [DEBUG] [VALIDATOR ] MRC: All expected trading days are present. [2025-09-29T19:59:38.540227] [DEBUG] [VALIDATOR ] MRC: Primary data validation passed. [2025-09-29T19:59:38.541241] [INFO ] [MAIN ] MRC: Fetched primary data is valid. [2025-09-29T19:59:38.541311] [DEBUG] [LOCAL ] MRC: Saving primary data. [2025-09-29T19:59:38.542572] [DEBUG] [LOCAL ] MRC: Trimmed 54793 records to 37586 (keeping 200 days of data) [2025-09-29T19:59:38.781117] [DEBUG] [LOCAL ] MRC: Primary data saved (37586 records). [2025-09-29T19:59:38.781269] [INFO ] [MAIN ] MRC: Full history saved. [2025-09-29T19:59:38.781374] [INFO ] [MAIN ] Update Progress: 1400/2371 symbols completed. MRC took 21.3s. Estimated remaining: 2h 4m 34s. Rate: 7.8 symbols/min [2025-09-29T19:59:39.417448] [INFO ] [MAIN ] MRP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:59:39.452423] [DEBUG] [LOCAL ] MRP: No existing data file found in primary storage. [2025-09-29T19:59:39.452492] [WARN ] [MAIN ] MRP: No existing data found, performing full refresh instead. [2025-09-29T19:59:39.452719] [INFO ] [MAIN ] MRP: Wiping existing primary data before full refresh. [2025-09-29T19:59:39.452776] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-09-29T19:59:39.452827] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-09-29T19:59:39.452861] [INFO ] [MAIN ] MRP: Starting full primary refresh. [2025-09-29T19:59:39.525357] [INFO ] [MAIN ] MRK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:59:39.610282] [INFO ] [MAIN ] MSA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:59:39.645221] [INFO ] [MAIN ] MS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:59:39.865776] [DEBUG] [LOCAL ] MSA: Loaded 18988 existing records from primary storage. [2025-09-29T19:59:39.913536] [INFO ] [MAIN ] MSA: Loaded 18988 existing records. [2025-09-29T19:59:40.110318] [DEBUG] [LOCAL ] MRK: Loaded 54569 existing records from primary storage. [2025-09-29T19:59:40.154441] [INFO ] [REMOTE ] MRP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:59:40.160435] [INFO ] [REMOTE ] MRP: Fetching primary data for 2024-12. [2025-09-29T19:59:40.170849] [INFO ] [MAIN ] MRK: Loaded 54569 existing records. [2025-09-29T19:59:40.171563] [DEBUG] [LOCAL ] MS: Loaded 54472 existing records from primary storage. [2025-09-29T19:59:40.253231] [WARN ] [MAIN ] MSA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:59:40.264865] [INFO ] [MAIN ] MS: Loaded 54472 existing records. [2025-09-29T19:59:40.254135] [INFO ] [MAIN ] MSA: Wiping existing primary data before full refresh. [2025-09-29T19:59:40.321726] [INFO ] [LOCAL ] MSA: Starting deletion of primary data. [2025-09-29T19:59:40.383873] [DEBUG] [LOCAL ] MSA: Deleted primary data file. [2025-09-29T19:59:40.391372] [INFO ] [MAIN ] MSA: Starting full primary refresh. [2025-09-29T19:59:40.485151] [DEBUG] [REMOTE ] MRP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T19:59:40.610325] [WARN ] [REMOTE ] MRP: No data returned for month 2024-12 [2025-09-29T19:59:40.698619] [WARN ] [MAIN ] MS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:59:40.670242] [FATAL] [REMOTE ] MRP: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T19:59:40.720767] [FATAL] [MAIN ] MRP: Failed to fetch primary data. [2025-09-29T19:59:40.724639] [INFO ] [MAIN ] MS: Wiping existing primary data before full refresh. [2025-09-29T19:59:40.728007] [WARN ] [MAIN ] MRP: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T19:59:40.738532] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-09-29T19:59:40.743884] [INFO ] [LOCAL ] MS: Starting deletion of primary data. [2025-09-29T19:59:40.744131] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-09-29T19:59:40.749384] [INFO ] [LOCAL ] MRP: Starting deletion of derivative data. [2025-09-29T19:59:40.781696] [DEBUG] [LOCAL ] MRP: No derivative data file found to delete. [2025-09-29T19:59:40.815517] [INFO ] [MAIN ] Update Progress: 1401/2371 symbols completed. MRP took 2.0s. Estimated remaining: 2h 4m 22s. Rate: 7.8 symbols/min [2025-09-29T19:59:40.809183] [WARN ] [MAIN ] MRK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:59:40.827825] [INFO ] [MAIN ] MRK: Wiping existing primary data before full refresh. [2025-09-29T19:59:40.805492] [DEBUG] [LOCAL ] MS: Deleted primary data file. [2025-09-29T19:59:40.877891] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-09-29T19:59:40.953926] [INFO ] [MAIN ] MS: Starting full primary refresh. [2025-09-29T19:59:40.964677] [DEBUG] [LOCAL ] MRK: Deleted primary data file. [2025-09-29T19:59:41.021820] [INFO ] [MAIN ] MRK: Starting full primary refresh. [2025-09-29T19:59:41.439801] [INFO ] [MAIN ] MSB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T19:59:41.547232] [INFO ] [REMOTE ] MSA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:59:41.570737] [INFO ] [REMOTE ] MSA: Fetching primary data for 2024-12. [2025-09-29T19:59:41.624784] [DEBUG] [LOCAL ] MSB: Loaded 7895 existing records from primary storage. [2025-09-29T19:59:41.725247] [INFO ] [MAIN ] MSB: Loaded 7895 existing records. [2025-09-29T19:59:42.138794] [INFO ] [REMOTE ] MS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:59:42.179691] [INFO ] [REMOTE ] MS: Fetching primary data for 2024-12. [2025-09-29T19:59:42.252007] [WARN ] [MAIN ] MSB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T19:59:42.258554] [INFO ] [MAIN ] MSB: Wiping existing primary data before full refresh. [2025-09-29T19:59:42.270068] [INFO ] [LOCAL ] MSB: Starting deletion of primary data. [2025-09-29T19:59:42.291069] [INFO ] [REMOTE ] MRK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:59:42.291456] [DEBUG] [LOCAL ] MSB: Deleted primary data file. [2025-09-29T19:59:42.291413] [INFO ] [REMOTE ] MRK: Fetching primary data for 2024-12. [2025-09-29T19:59:42.292294] [INFO ] [MAIN ] MSB: Starting full primary refresh. [2025-09-29T19:59:42.668678] [INFO ] [REMOTE ] MSB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T19:59:42.668980] [INFO ] [REMOTE ] MSB: Fetching primary data for 2024-12. [2025-09-29T19:59:42.806535] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-29T19:59:42.810537] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-01. [2025-09-29T19:59:43.380766] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-29T19:59:43.382834] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-01. [2025-09-29T19:59:43.655993] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-29T19:59:43.659828] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-02. [2025-09-29T19:59:43.927783] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-29T19:59:43.940022] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-01. [2025-09-29T19:59:44.004378] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-29T19:59:44.016828] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-01. [2025-09-29T19:59:44.578682] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-29T19:59:44.582486] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-02. [2025-09-29T19:59:44.632435] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-29T19:59:44.636460] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-03. [2025-09-29T19:59:45.185068] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-29T19:59:45.188263] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-03. [2025-09-29T19:59:45.598543] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-29T19:59:45.948155] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-04. [2025-09-29T19:59:46.120290] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-29T19:59:46.309711] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-29T19:59:46.509307] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-09-29T19:59:46.748119] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-02. [2025-09-29T19:59:46.835210] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-29T19:59:47.548130] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-05. [2025-09-29T19:59:48.348104] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-02. [2025-09-29T19:59:48.658866] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-29T19:59:48.921550] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-29T19:59:49.148148] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-06. [2025-09-29T19:59:49.948104] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-04. [2025-09-29T19:59:50.111131] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-29T19:59:50.152504] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-29T19:59:50.732052] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-29T19:59:50.748091] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-03. [2025-09-29T19:59:51.548104] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-05. [2025-09-29T19:59:52.291499] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-29T19:59:52.348139] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-07. [2025-09-29T19:59:52.850675] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-29T19:59:53.148104] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-06. [2025-09-29T19:59:53.364532] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-29T19:59:53.919251] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-29T19:59:53.948150] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-07. [2025-09-29T19:59:54.748146] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-04. [2025-09-29T19:59:54.824426] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-29T19:59:55.548115] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-03. [2025-09-29T19:59:56.348091] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-08. [2025-09-29T19:59:56.840497] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-29T19:59:57.148106] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-05. [2025-09-29T19:59:57.164443] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-29T19:59:57.689184] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-29T19:59:57.948114] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-08. [2025-09-29T19:59:58.748129] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-04. [2025-09-29T19:59:58.881256] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-29T19:59:59.084319] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-29T19:59:59.548124] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-09. [2025-09-29T20:00:00.348095] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-06. [2025-09-29T20:00:00.727139] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-29T20:00:00.732281] [INFO ] [REMOTE ] MSA: Full fetch complete (25766 records). [2025-09-29T20:00:00.732380] [DEBUG] [VALIDATOR ] MSA: Validating primary data. [2025-09-29T20:00:01.163879] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-09. [2025-09-29T20:00:01.180364] [DEBUG] [VALIDATOR ] MSA: All expected trading days are present. [2025-09-29T20:00:01.181687] [DEBUG] [VALIDATOR ] MSA: Primary data validation passed. [2025-09-29T20:00:01.182464] [INFO ] [MAIN ] MSA: Fetched primary data is valid. [2025-09-29T20:00:01.182557] [DEBUG] [LOCAL ] MSA: Saving primary data. [2025-09-29T20:00:01.183924] [DEBUG] [LOCAL ] MSA: Trimmed 25766 records to 18823 (keeping 200 days of data) [2025-09-29T20:00:01.334194] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-09-29T20:00:01.382796] [DEBUG] [LOCAL ] MSA: Primary data saved (18823 records). [2025-09-29T20:00:01.382959] [INFO ] [MAIN ] MSA: Full history saved. [2025-09-29T20:00:01.383071] [INFO ] [MAIN ] Update Progress: 1402/2371 symbols completed. MSA took 22.6s. Estimated remaining: 2h 4m 23s. Rate: 7.8 symbols/min [2025-09-29T20:00:01.579034] [INFO ] [MAIN ] MSC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:00:01.579248] [DEBUG] [LOCAL ] MSC: No existing data file found in primary storage. [2025-09-29T20:00:01.579341] [WARN ] [MAIN ] MSC: No existing data found, performing full refresh instead. [2025-09-29T20:00:01.579500] [INFO ] [MAIN ] MSC: Wiping existing primary data before full refresh. [2025-09-29T20:00:01.579545] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-09-29T20:00:01.579589] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-09-29T20:00:01.579623] [INFO ] [MAIN ] MSC: Starting full primary refresh. [2025-09-29T20:00:01.958803] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-05. [2025-09-29T20:00:02.006929] [INFO ] [REMOTE ] MSC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:00:02.321055] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-29T20:00:02.350068] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-29T20:00:02.352556] [INFO ] [REMOTE ] MSB: Full fetch complete (12936 records). [2025-09-29T20:00:02.352706] [DEBUG] [VALIDATOR ] MSB: Validating primary data. [2025-09-29T20:00:02.761720] [INFO ] [REMOTE ] MSC: Fetching primary data for 2024-12. [2025-09-29T20:00:02.814556] [DEBUG] [VALIDATOR ] MSB: All expected trading days are present. [2025-09-29T20:00:02.814682] [DEBUG] [VALIDATOR ] MSB: Primary data validation passed. [2025-09-29T20:00:02.815048] [INFO ] [MAIN ] MSB: Fetched primary data is valid. [2025-09-29T20:00:02.815107] [DEBUG] [LOCAL ] MSB: Saving primary data. [2025-09-29T20:00:02.816750] [DEBUG] [LOCAL ] MSB: Trimmed 12936 records to 7854 (keeping 200 days of data) [2025-09-29T20:00:02.872848] [DEBUG] [LOCAL ] MSB: Primary data saved (7854 records). [2025-09-29T20:00:02.873055] [INFO ] [MAIN ] MSB: Full history saved. [2025-09-29T20:00:02.873190] [INFO ] [MAIN ] Update Progress: 1403/2371 symbols completed. MSB took 22.0s. Estimated remaining: 2h 4m 11s. Rate: 7.8 symbols/min [2025-09-29T20:00:03.086535] [INFO ] [MAIN ] MSCI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:00:03.163309] [DEBUG] [LOCAL ] MSCI: Loaded 35351 existing records from primary storage. [2025-09-29T20:00:03.163701] [INFO ] [MAIN ] MSCI: Loaded 35351 existing records. [2025-09-29T20:00:03.233610] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-29T20:00:03.384716] [WARN ] [MAIN ] MSCI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:00:03.385034] [INFO ] [MAIN ] MSCI: Wiping existing primary data before full refresh. [2025-09-29T20:00:03.385085] [INFO ] [LOCAL ] MSCI: Starting deletion of primary data. [2025-09-29T20:00:03.385516] [DEBUG] [LOCAL ] MSCI: Deleted primary data file. [2025-09-29T20:00:03.385604] [INFO ] [MAIN ] MSCI: Starting full primary refresh. [2025-09-29T20:00:03.553200] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-07. [2025-09-29T20:00:03.812775] [INFO ] [REMOTE ] MSCI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:00:04.348104] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-01. [2025-09-29T20:00:04.545517] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-05 (2.59 seconds). [2025-09-29T20:00:04.912198] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-29T20:00:05.148081] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-02. [2025-09-29T20:00:05.406381] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-29T20:00:05.682175] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-29T20:00:05.948108] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-08. [2025-09-29T20:00:06.748147] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-06. [2025-09-29T20:00:07.548115] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-03. [2025-09-29T20:00:07.837109] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-09-29T20:00:07.897915] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-29T20:00:08.348157] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-09. [2025-09-29T20:00:08.976929] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-29T20:00:09.148146] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2024-12. [2025-09-29T20:00:09.948161] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-07. [2025-09-29T20:00:10.436288] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-29T20:00:10.448053] [INFO ] [REMOTE ] MS: Full fetch complete (77719 records). [2025-09-29T20:00:10.448261] [DEBUG] [VALIDATOR ] MS: Validating primary data. [2025-09-29T20:00:10.752460] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-04. [2025-09-29T20:00:10.915131] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-29T20:00:10.947409] [DEBUG] [VALIDATOR ] MS: All expected trading days are present. [2025-09-29T20:00:10.948315] [DEBUG] [VALIDATOR ] MS: Primary data validation passed. [2025-09-29T20:00:10.949508] [INFO ] [MAIN ] MS: Fetched primary data is valid. [2025-09-29T20:00:10.949589] [DEBUG] [LOCAL ] MS: Saving primary data. [2025-09-29T20:00:10.951202] [DEBUG] [LOCAL ] MS: Trimmed 77719 records to 53692 (keeping 200 days of data) [2025-09-29T20:00:11.198951] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-29T20:00:11.314571] [DEBUG] [LOCAL ] MS: Primary data saved (53692 records). [2025-09-29T20:00:11.314760] [INFO ] [MAIN ] MS: Full history saved. [2025-09-29T20:00:11.314951] [INFO ] [MAIN ] Update Progress: 1404/2371 symbols completed. MS took 32.5s. Estimated remaining: 2h 4m 4s. Rate: 7.8 symbols/min [2025-09-29T20:00:11.504344] [INFO ] [MAIN ] MSD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:00:11.522569] [DEBUG] [LOCAL ] MSD: Loaded 15775 existing records from primary storage. [2025-09-29T20:00:11.522882] [INFO ] [MAIN ] MSD: Loaded 15775 existing records. [2025-09-29T20:00:11.555244] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-05. [2025-09-29T20:00:11.719410] [WARN ] [MAIN ] MSD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:00:11.719624] [INFO ] [MAIN ] MSD: Wiping existing primary data before full refresh. [2025-09-29T20:00:11.719708] [INFO ] [LOCAL ] MSD: Starting deletion of primary data. [2025-09-29T20:00:11.719992] [DEBUG] [LOCAL ] MSD: Deleted primary data file. [2025-09-29T20:00:11.720052] [INFO ] [MAIN ] MSD: Starting full primary refresh. [2025-09-29T20:00:12.013159] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-29T20:00:12.123823] [INFO ] [REMOTE ] MSD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:00:12.287497] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-09-29T20:00:12.348096] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-08. [2025-09-29T20:00:13.148157] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-01. [2025-09-29T20:00:13.948129] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-06. [2025-09-29T20:00:14.275177] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-29T20:00:14.341092] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-29T20:00:14.556326] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-29T20:00:14.748113] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-07. [2025-09-29T20:00:15.232734] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-29T20:00:15.548119] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-09. [2025-09-29T20:00:16.348136] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-08. [2025-09-29T20:00:16.717455] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-29T20:00:17.148124] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-09. [2025-09-29T20:00:17.814258] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-29T20:00:17.815555] [INFO ] [REMOTE ] MSC: Full fetch complete (2525 records). [2025-09-29T20:00:17.815632] [DEBUG] [VALIDATOR ] MSC: Validating primary data. [2025-09-29T20:00:17.957919] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-02. [2025-09-29T20:00:18.066057] [WARN ] [VALIDATOR ] MSC: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-09-29T20:00:18.066270] [FATAL] [MAIN ] MSC: Fetched primary data is invalid. Refusing to save it. [2025-09-29T20:00:18.066341] [WARN ] [MAIN ] MSC: Deleting existing primary and derivative data due to validation failure. [2025-09-29T20:00:18.066391] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-09-29T20:00:18.066452] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-09-29T20:00:18.066501] [INFO ] [LOCAL ] MSC: Starting deletion of derivative data. [2025-09-29T20:00:18.066588] [DEBUG] [LOCAL ] MSC: No derivative data file found to delete. [2025-09-29T20:00:18.066691] [INFO ] [MAIN ] Update Progress: 1405/2371 symbols completed. MSC took 16.7s. Estimated remaining: 2h 3m 56s. Rate: 7.8 symbols/min [2025-09-29T20:00:18.299947] [INFO ] [MAIN ] MSDL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:00:18.345872] [DEBUG] [LOCAL ] MSDL: Loaded 38645 existing records from primary storage. [2025-09-29T20:00:18.346187] [INFO ] [MAIN ] MSDL: Loaded 38645 existing records. [2025-09-29T20:00:18.538533] [WARN ] [MAIN ] MSDL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:00:18.538835] [INFO ] [MAIN ] MSDL: Wiping existing primary data before full refresh. [2025-09-29T20:00:18.538920] [INFO ] [LOCAL ] MSDL: Starting deletion of primary data. [2025-09-29T20:00:18.539341] [DEBUG] [LOCAL ] MSDL: Deleted primary data file. [2025-09-29T20:00:18.539401] [INFO ] [MAIN ] MSDL: Starting full primary refresh. [2025-09-29T20:00:18.773746] [INFO ] [REMOTE ] MSD: Fetching primary data for 2024-12. [2025-09-29T20:00:18.935680] [INFO ] [REMOTE ] MSDL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:00:19.548134] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2024-12. [2025-09-29T20:00:19.661911] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-29T20:00:19.667840] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-29T20:00:19.766761] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-09 (4.22 seconds). [2025-09-29T20:00:19.782485] [INFO ] [REMOTE ] MRK: Full fetch complete (77857 records). [2025-09-29T20:00:19.782752] [DEBUG] [VALIDATOR ] MRK: Validating primary data. [2025-09-29T20:00:20.255518] [DEBUG] [VALIDATOR ] MRK: All expected trading days are present. [2025-09-29T20:00:20.255697] [DEBUG] [VALIDATOR ] MRK: Primary data validation passed. [2025-09-29T20:00:20.257001] [INFO ] [MAIN ] MRK: Fetched primary data is valid. [2025-09-29T20:00:20.257132] [DEBUG] [LOCAL ] MRK: Saving primary data. [2025-09-29T20:00:20.258833] [DEBUG] [LOCAL ] MRK: Trimmed 77857 records to 53789 (keeping 200 days of data) [2025-09-29T20:00:20.353438] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-01. [2025-09-29T20:00:20.627043] [DEBUG] [LOCAL ] MRK: Primary data saved (53789 records). [2025-09-29T20:00:20.627202] [INFO ] [MAIN ] MRK: Full history saved. [2025-09-29T20:00:20.627330] [INFO ] [MAIN ] Update Progress: 1406/2371 symbols completed. MRK took 41.8s. Estimated remaining: 2h 3m 45s. Rate: 7.8 symbols/min [2025-09-29T20:00:20.847973] [INFO ] [MAIN ] MSGE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:00:20.888348] [DEBUG] [LOCAL ] MSGE: Loaded 27513 existing records from primary storage. [2025-09-29T20:00:20.888744] [INFO ] [MAIN ] MSGE: Loaded 27513 existing records. [2025-09-29T20:00:21.090306] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-29T20:00:21.145113] [WARN ] [MAIN ] MSGE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:00:21.145354] [INFO ] [MAIN ] MSGE: Wiping existing primary data before full refresh. [2025-09-29T20:00:21.145413] [INFO ] [LOCAL ] MSGE: Starting deletion of primary data. [2025-09-29T20:00:21.145833] [DEBUG] [LOCAL ] MSGE: Deleted primary data file. [2025-09-29T20:00:21.145894] [INFO ] [MAIN ] MSGE: Starting full primary refresh. [2025-09-29T20:00:21.157474] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-01. [2025-09-29T20:00:21.410109] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-29T20:00:21.575292] [INFO ] [REMOTE ] MSGE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:00:21.948140] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-02. [2025-09-29T20:00:22.348904] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-29T20:00:22.748097] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-03. [2025-09-29T20:00:22.912450] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-29T20:00:23.548111] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-03. [2025-09-29T20:00:24.258620] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-29T20:00:24.348168] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-02. [2025-09-29T20:00:24.410891] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-29T20:00:25.148141] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-04. [2025-09-29T20:00:25.835503] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-29T20:00:25.948104] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-03. [2025-09-29T20:00:26.027196] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-29T20:00:26.748150] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2024-12. [2025-09-29T20:00:27.521551] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-29T20:00:27.548079] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-04. [2025-09-29T20:00:28.072457] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-29T20:00:28.348157] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-01. [2025-09-29T20:00:29.148120] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-05. [2025-09-29T20:00:29.489815] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-29T20:00:29.622102] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-29T20:00:29.948133] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-05. [2025-09-29T20:00:30.112042] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-29T20:00:30.748162] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-06. [2025-09-29T20:00:31.318021] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-29T20:00:31.342572] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-29T20:00:31.548157] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-02. [2025-09-29T20:00:32.348101] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-07. [2025-09-29T20:00:32.650400] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-29T20:00:33.148164] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-03. [2025-09-29T20:00:33.428413] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-29T20:00:33.948095] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-06. [2025-09-29T20:00:34.442562] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-29T20:00:34.748138] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-04. [2025-09-29T20:00:35.240103] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-29T20:00:35.548114] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-04. [2025-09-29T20:00:35.971057] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-29T20:00:36.348117] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-08. [2025-09-29T20:00:36.966523] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-29T20:00:37.148092] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-05. [2025-09-29T20:00:37.443329] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-29T20:00:37.948141] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-07. [2025-09-29T20:00:38.480141] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-29T20:00:38.748133] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-05. [2025-09-29T20:00:39.260606] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-29T20:00:39.548122] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-06. [2025-09-29T20:00:39.838386] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-29T20:00:40.348116] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-06. [2025-09-29T20:00:41.007922] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-29T20:00:41.148141] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-09. [2025-09-29T20:00:41.517847] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-29T20:00:41.948187] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-07. [2025-09-29T20:00:42.192195] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-29T20:00:42.196522] [INFO ] [REMOTE ] MSD: Full fetch complete (22292 records). [2025-09-29T20:00:42.196616] [DEBUG] [VALIDATOR ] MSD: Validating primary data. [2025-09-29T20:00:42.597135] [DEBUG] [VALIDATOR ] MSD: All expected trading days are present. [2025-09-29T20:00:42.597231] [DEBUG] [VALIDATOR ] MSD: Primary data validation passed. [2025-09-29T20:00:42.597853] [INFO ] [MAIN ] MSD: Fetched primary data is valid. [2025-09-29T20:00:42.597929] [DEBUG] [LOCAL ] MSD: Saving primary data. [2025-09-29T20:00:42.598687] [DEBUG] [LOCAL ] MSD: Trimmed 22292 records to 15734 (keeping 200 days of data) [2025-09-29T20:00:42.691106] [DEBUG] [LOCAL ] MSD: Primary data saved (15734 records). [2025-09-29T20:00:42.691264] [INFO ] [MAIN ] MSD: Full history saved. [2025-09-29T20:00:42.691355] [INFO ] [MAIN ] Update Progress: 1407/2371 symbols completed. MSD took 31.4s. Estimated remaining: 2h 3m 47s. Rate: 7.8 symbols/min [2025-09-29T20:00:42.757740] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-07. [2025-09-29T20:00:42.872299] [INFO ] [MAIN ] MSGS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:00:42.890869] [DEBUG] [LOCAL ] MSGS: Loaded 17318 existing records from primary storage. [2025-09-29T20:00:42.891147] [INFO ] [MAIN ] MSGS: Loaded 17318 existing records. [2025-09-29T20:00:43.092220] [WARN ] [MAIN ] MSGS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:00:43.092523] [INFO ] [MAIN ] MSGS: Wiping existing primary data before full refresh. [2025-09-29T20:00:43.092680] [INFO ] [LOCAL ] MSGS: Starting deletion of primary data. [2025-09-29T20:00:43.093194] [DEBUG] [LOCAL ] MSGS: Deleted primary data file. [2025-09-29T20:00:43.093338] [INFO ] [MAIN ] MSGS: Starting full primary refresh. [2025-09-29T20:00:43.206720] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-29T20:00:43.511329] [INFO ] [REMOTE ] MSGS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:00:43.548085] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2024-12. [2025-09-29T20:00:44.217081] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-29T20:00:44.348139] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-08. [2025-09-29T20:00:44.392917] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-29T20:00:45.148120] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-01. [2025-09-29T20:00:45.496220] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-29T20:00:45.951957] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-08. [2025-09-29T20:00:45.956104] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-29T20:00:46.748144] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-02. [2025-09-29T20:00:47.461469] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-29T20:00:47.548130] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-08. [2025-09-29T20:00:47.843747] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-29T20:00:48.348137] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-03. [2025-09-29T20:00:49.148084] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-09. [2025-09-29T20:00:49.189338] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-29T20:00:49.419511] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-29T20:00:49.948121] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-04. [2025-09-29T20:00:50.748088] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-09. [2025-09-29T20:00:50.938564] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-29T20:00:50.947381] [INFO ] [REMOTE ] MSCI: Full fetch complete (50430 records). [2025-09-29T20:00:50.947519] [DEBUG] [VALIDATOR ] MSCI: Validating primary data. [2025-09-29T20:00:51.085398] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-29T20:00:51.384423] [DEBUG] [VALIDATOR ] MSCI: All expected trading days are present. [2025-09-29T20:00:51.384524] [DEBUG] [VALIDATOR ] MSCI: Primary data validation passed. [2025-09-29T20:00:51.385524] [INFO ] [MAIN ] MSCI: Fetched primary data is valid. [2025-09-29T20:00:51.385593] [DEBUG] [LOCAL ] MSCI: Saving primary data. [2025-09-29T20:00:51.386882] [DEBUG] [LOCAL ] MSCI: Trimmed 50430 records to 34572 (keeping 200 days of data) [2025-09-29T20:00:51.567522] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-09. [2025-09-29T20:00:51.634233] [DEBUG] [LOCAL ] MSCI: Primary data saved (34572 records). [2025-09-29T20:00:51.634418] [INFO ] [MAIN ] MSCI: Full history saved. [2025-09-29T20:00:51.634533] [INFO ] [MAIN ] Update Progress: 1408/2371 symbols completed. MSCI took 48.8s. Estimated remaining: 2h 3m 40s. Rate: 7.8 symbols/min [2025-09-29T20:00:51.817717] [INFO ] [MAIN ] MSI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:00:51.864609] [DEBUG] [LOCAL ] MSI: Loaded 41128 existing records from primary storage. [2025-09-29T20:00:51.865006] [INFO ] [MAIN ] MSI: Loaded 41128 existing records. [2025-09-29T20:00:52.061250] [WARN ] [MAIN ] MSI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:00:52.061774] [INFO ] [MAIN ] MSI: Wiping existing primary data before full refresh. [2025-09-29T20:00:52.061885] [INFO ] [LOCAL ] MSI: Starting deletion of primary data. [2025-09-29T20:00:52.062217] [DEBUG] [LOCAL ] MSI: Deleted primary data file. [2025-09-29T20:00:52.062343] [INFO ] [MAIN ] MSI: Starting full primary refresh. [2025-09-29T20:00:52.204703] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-29T20:00:52.274084] [INFO ] [REMOTE ] MSGE: Full fetch complete (40170 records). [2025-09-29T20:00:52.275632] [DEBUG] [VALIDATOR ] MSGE: Validating primary data. [2025-09-29T20:00:52.378433] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-05. [2025-09-29T20:00:52.711270] [INFO ] [REMOTE ] MSI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:00:52.942157] [DEBUG] [VALIDATOR ] MSGE: All expected trading days are present. [2025-09-29T20:00:52.942271] [DEBUG] [VALIDATOR ] MSGE: Primary data validation passed. [2025-09-29T20:00:52.943255] [INFO ] [MAIN ] MSGE: Fetched primary data is valid. [2025-09-29T20:00:52.943344] [DEBUG] [LOCAL ] MSGE: Saving primary data. [2025-09-29T20:00:52.944484] [DEBUG] [LOCAL ] MSGE: Trimmed 40170 records to 26891 (keeping 200 days of data) [2025-09-29T20:00:53.100529] [DEBUG] [LOCAL ] MSGE: Primary data saved (26891 records). [2025-09-29T20:00:53.100916] [INFO ] [MAIN ] MSGE: Full history saved. [2025-09-29T20:00:53.101130] [INFO ] [MAIN ] Update Progress: 1409/2371 symbols completed. MSGE took 32.5s. Estimated remaining: 2h 3m 28s. Rate: 7.8 symbols/min [2025-09-29T20:00:53.161332] [INFO ] [REMOTE ] MSI: Fetching primary data for 2024-12. [2025-09-29T20:00:53.320908] [INFO ] [MAIN ] MSIF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:00:53.316745] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-29T20:00:53.329821] [DEBUG] [LOCAL ] MSIF: No existing data file found in primary storage. [2025-09-29T20:00:53.330312] [WARN ] [MAIN ] MSIF: No existing data found, performing full refresh instead. [2025-09-29T20:00:53.330442] [INFO ] [MAIN ] MSIF: Wiping existing primary data before full refresh. [2025-09-29T20:00:53.330488] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-09-29T20:00:53.330557] [INFO ] [REMOTE ] MSDL: Full fetch complete (54681 records). [2025-09-29T20:00:53.330886] [DEBUG] [VALIDATOR ] MSDL: Validating primary data. [2025-09-29T20:00:53.330804] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-09-29T20:00:53.331188] [INFO ] [MAIN ] MSIF: Starting full primary refresh. [2025-09-29T20:00:53.658708] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-29T20:00:53.953426] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-06. [2025-09-29T20:00:54.211521] [INFO ] [REMOTE ] MSIF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:00:54.231760] [DEBUG] [VALIDATOR ] MSDL: All expected trading days are present. [2025-09-29T20:00:54.231886] [DEBUG] [VALIDATOR ] MSDL: Primary data validation passed. [2025-09-29T20:00:54.233403] [INFO ] [MAIN ] MSDL: Fetched primary data is valid. [2025-09-29T20:00:54.233476] [DEBUG] [LOCAL ] MSDL: Saving primary data. [2025-09-29T20:00:54.235290] [DEBUG] [LOCAL ] MSDL: Trimmed 54681 records to 38124 (keeping 200 days of data) [2025-09-29T20:00:54.503264] [DEBUG] [LOCAL ] MSDL: Primary data saved (38124 records). [2025-09-29T20:00:54.503501] [INFO ] [MAIN ] MSDL: Full history saved. [2025-09-29T20:00:54.503631] [INFO ] [MAIN ] Update Progress: 1410/2371 symbols completed. MSDL took 36.4s. Estimated remaining: 2h 3m 16s. Rate: 7.8 symbols/min [2025-09-29T20:00:54.745861] [INFO ] [MAIN ] MSM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:00:54.759808] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2024-12. [2025-09-29T20:00:54.783975] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-29T20:00:54.827882] [DEBUG] [LOCAL ] MSM: Loaded 36004 existing records from primary storage. [2025-09-29T20:00:54.828230] [INFO ] [MAIN ] MSM: Loaded 36004 existing records. [2025-09-29T20:00:55.017409] [DEBUG] [REMOTE ] MSIF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T20:00:55.017116] [WARN ] [MAIN ] MSM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:00:55.018084] [INFO ] [MAIN ] MSM: Wiping existing primary data before full refresh. [2025-09-29T20:00:55.018361] [INFO ] [LOCAL ] MSM: Starting deletion of primary data. [2025-09-29T20:00:55.018193] [WARN ] [REMOTE ] MSIF: No data returned for month 2024-12 [2025-09-29T20:00:55.018529] [FATAL] [REMOTE ] MSIF: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T20:00:55.018612] [FATAL] [MAIN ] MSIF: Failed to fetch primary data. [2025-09-29T20:00:55.018699] [WARN ] [MAIN ] MSIF: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T20:00:55.018800] [DEBUG] [LOCAL ] MSM: Deleted primary data file. [2025-09-29T20:00:55.018894] [INFO ] [MAIN ] MSM: Starting full primary refresh. [2025-09-29T20:00:55.018772] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-09-29T20:00:55.024728] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-09-29T20:00:55.063116] [INFO ] [LOCAL ] MSIF: Starting deletion of derivative data. [2025-09-29T20:00:55.100990] [DEBUG] [LOCAL ] MSIF: No derivative data file found to delete. [2025-09-29T20:00:55.123075] [INFO ] [MAIN ] Update Progress: 1411/2371 symbols completed. MSIF took 2.0s. Estimated remaining: 2h 3m 3s. Rate: 7.8 symbols/min [2025-09-29T20:00:55.395915] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-29T20:00:55.548196] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-01. [2025-09-29T20:00:55.575047] [INFO ] [MAIN ] MT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:00:55.640414] [INFO ] [REMOTE ] MSM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:00:55.693791] [DEBUG] [LOCAL ] MT: Loaded 51417 existing records from primary storage. [2025-09-29T20:00:55.694302] [INFO ] [MAIN ] MT: Loaded 51417 existing records. [2025-09-29T20:00:55.894820] [WARN ] [MAIN ] MT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:00:55.895040] [INFO ] [MAIN ] MT: Wiping existing primary data before full refresh. [2025-09-29T20:00:55.895091] [INFO ] [LOCAL ] MT: Starting deletion of primary data. [2025-09-29T20:00:55.895388] [DEBUG] [LOCAL ] MT: Deleted primary data file. [2025-09-29T20:00:55.895450] [INFO ] [MAIN ] MT: Starting full primary refresh. [2025-09-29T20:00:56.277799] [INFO ] [REMOTE ] MT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:00:56.348119] [INFO ] [REMOTE ] MT: Fetching primary data for 2024-12. [2025-09-29T20:00:57.148085] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-07. [2025-09-29T20:00:57.243787] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-29T20:00:57.948123] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-02. [2025-09-29T20:00:58.181893] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-29T20:00:58.200417] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-29T20:00:58.748154] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-08. [2025-09-29T20:00:59.493275] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-29T20:00:59.548123] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-03. [2025-09-29T20:00:59.830043] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-29T20:01:00.348127] [INFO ] [REMOTE ] MSM: Fetching primary data for 2024-12. [2025-09-29T20:01:01.153275] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-01. [2025-09-29T20:01:01.169397] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-29T20:01:01.948155] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-09. [2025-09-29T20:01:02.026325] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-29T20:01:02.594208] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-29T20:01:02.748123] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-02. [2025-09-29T20:01:03.252253] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-29T20:01:03.257630] [INFO ] [REMOTE ] MSGS: Full fetch complete (22806 records). [2025-09-29T20:01:03.257794] [DEBUG] [VALIDATOR ] MSGS: Validating primary data. [2025-09-29T20:01:03.553421] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-04. [2025-09-29T20:01:03.693626] [DEBUG] [VALIDATOR ] MSGS: All expected trading days are present. [2025-09-29T20:01:03.693768] [DEBUG] [VALIDATOR ] MSGS: Primary data validation passed. [2025-09-29T20:01:03.694309] [INFO ] [MAIN ] MSGS: Fetched primary data is valid. [2025-09-29T20:01:03.694356] [DEBUG] [LOCAL ] MSGS: Saving primary data. [2025-09-29T20:01:03.695214] [DEBUG] [LOCAL ] MSGS: Trimmed 22806 records to 17098 (keeping 200 days of data) [2025-09-29T20:01:03.807276] [DEBUG] [LOCAL ] MSGS: Primary data saved (17098 records). [2025-09-29T20:01:03.807430] [INFO ] [MAIN ] MSGS: Full history saved. [2025-09-29T20:01:03.807534] [INFO ] [MAIN ] Update Progress: 1412/2371 symbols completed. MSGS took 21.1s. Estimated remaining: 2h 2m 56s. Rate: 7.8 symbols/min [2025-09-29T20:01:03.991924] [INFO ] [MAIN ] MTAL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:01:04.031799] [DEBUG] [LOCAL ] MTAL: Loaded 37002 existing records from primary storage. [2025-09-29T20:01:04.032108] [INFO ] [MAIN ] MTAL: Loaded 37002 existing records. [2025-09-29T20:01:04.229624] [WARN ] [MAIN ] MTAL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:01:04.229953] [INFO ] [MAIN ] MTAL: Wiping existing primary data before full refresh. [2025-09-29T20:01:04.230056] [INFO ] [LOCAL ] MTAL: Starting deletion of primary data. [2025-09-29T20:01:04.230574] [DEBUG] [LOCAL ] MTAL: Deleted primary data file. [2025-09-29T20:01:04.230722] [INFO ] [MAIN ] MTAL: Starting full primary refresh. [2025-09-29T20:01:04.356858] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-01. [2025-09-29T20:01:04.387745] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-29T20:01:04.678998] [INFO ] [REMOTE ] MTAL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:01:05.148079] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2024-12. [2025-09-29T20:01:05.503421] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-29T20:01:05.879033] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-29T20:01:05.948085] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-02. [2025-09-29T20:01:06.244226] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-29T20:01:06.748116] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-01. [2025-09-29T20:01:07.287621] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-29T20:01:07.548156] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-03. [2025-09-29T20:01:07.861675] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-29T20:01:08.348148] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-05. [2025-09-29T20:01:09.016426] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-29T20:01:09.148134] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-03. [2025-09-29T20:01:09.960912] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-04. [2025-09-29T20:01:09.982678] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-29T20:01:10.748138] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-06. [2025-09-29T20:01:11.061068] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-29T20:01:11.516497] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-29T20:01:11.548079] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-05. [2025-09-29T20:01:12.301317] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-29T20:01:12.348126] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-07. [2025-09-29T20:01:13.000179] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-29T20:01:13.148145] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-02. [2025-09-29T20:01:13.924236] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-29T20:01:13.948070] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-08. [2025-09-29T20:01:14.231222] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-29T20:01:14.748151] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-06. [2025-09-29T20:01:15.361949] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-29T20:01:15.548174] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-03. [2025-09-29T20:01:16.223891] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-29T20:01:16.348146] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-09. [2025-09-29T20:01:17.000479] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-29T20:01:17.148117] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-07. [2025-09-29T20:01:17.655066] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-29T20:01:17.663787] [INFO ] [REMOTE ] MSI: Full fetch complete (58439 records). [2025-09-29T20:01:17.663998] [DEBUG] [VALIDATOR ] MSI: Validating primary data. [2025-09-29T20:01:17.953386] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-04. [2025-09-29T20:01:18.080484] [DEBUG] [VALIDATOR ] MSI: All expected trading days are present. [2025-09-29T20:01:18.080596] [DEBUG] [VALIDATOR ] MSI: Primary data validation passed. [2025-09-29T20:01:18.081844] [INFO ] [MAIN ] MSI: Fetched primary data is valid. [2025-09-29T20:01:18.081976] [DEBUG] [LOCAL ] MSI: Saving primary data. [2025-09-29T20:01:18.083378] [DEBUG] [LOCAL ] MSI: Trimmed 58439 records to 40336 (keeping 200 days of data) [2025-09-29T20:01:18.359981] [DEBUG] [LOCAL ] MSI: Primary data saved (40336 records). [2025-09-29T20:01:18.360123] [INFO ] [MAIN ] MSI: Full history saved. [2025-09-29T20:01:18.360222] [INFO ] [MAIN ] Update Progress: 1413/2371 symbols completed. MSI took 26.7s. Estimated remaining: 2h 2m 53s. Rate: 7.8 symbols/min [2025-09-29T20:01:18.630326] [INFO ] [MAIN ] MTB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:01:18.706245] [DEBUG] [LOCAL ] MTB: Loaded 47562 existing records from primary storage. [2025-09-29T20:01:18.706751] [INFO ] [MAIN ] MTB: Loaded 47562 existing records. [2025-09-29T20:01:18.753325] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-04. [2025-09-29T20:01:18.963443] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-29T20:01:19.074752] [WARN ] [MAIN ] MTB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:01:19.075870] [INFO ] [MAIN ] MTB: Wiping existing primary data before full refresh. [2025-09-29T20:01:19.075948] [INFO ] [LOCAL ] MTB: Starting deletion of primary data. [2025-09-29T20:01:19.076627] [DEBUG] [LOCAL ] MTB: Deleted primary data file. [2025-09-29T20:01:19.076747] [INFO ] [MAIN ] MTB: Starting full primary refresh. [2025-09-29T20:01:19.557249] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-08. [2025-09-29T20:01:19.589745] [INFO ] [REMOTE ] MTB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:01:19.608761] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-29T20:01:20.348089] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-05. [2025-09-29T20:01:20.649217] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-29T20:01:21.153313] [INFO ] [REMOTE ] MTB: Fetching primary data for 2024-12. [2025-09-29T20:01:21.167128] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-29T20:01:21.649929] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-29T20:01:21.948130] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-09. [2025-09-29T20:01:22.748154] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-06. [2025-09-29T20:01:22.898808] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-29T20:01:23.548158] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-05. [2025-09-29T20:01:23.625007] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-29T20:01:23.635260] [INFO ] [REMOTE ] MSM: Full fetch complete (52124 records). [2025-09-29T20:01:23.635518] [DEBUG] [VALIDATOR ] MSM: Validating primary data. [2025-09-29T20:01:23.895891] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-29T20:01:24.111566] [DEBUG] [VALIDATOR ] MSM: All expected trading days are present. [2025-09-29T20:01:24.111701] [DEBUG] [VALIDATOR ] MSM: Primary data validation passed. [2025-09-29T20:01:24.112737] [INFO ] [MAIN ] MSM: Fetched primary data is valid. [2025-09-29T20:01:24.112805] [DEBUG] [LOCAL ] MSM: Saving primary data. [2025-09-29T20:01:24.114622] [DEBUG] [LOCAL ] MSM: Trimmed 52124 records to 35446 (keeping 200 days of data) [2025-09-29T20:01:24.348106] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-07. [2025-09-29T20:01:24.371347] [DEBUG] [LOCAL ] MSM: Primary data saved (35446 records). [2025-09-29T20:01:24.371481] [INFO ] [MAIN ] MSM: Full history saved. [2025-09-29T20:01:24.371609] [INFO ] [MAIN ] Update Progress: 1414/2371 symbols completed. MSM took 29.9s. Estimated remaining: 2h 2m 45s. Rate: 7.8 symbols/min [2025-09-29T20:01:24.552266] [INFO ] [MAIN ] MTD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:01:24.570441] [DEBUG] [LOCAL ] MTD: Loaded 15342 existing records from primary storage. [2025-09-29T20:01:24.570708] [INFO ] [MAIN ] MTD: Loaded 15342 existing records. [2025-09-29T20:01:24.766079] [WARN ] [MAIN ] MTD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:01:24.766338] [INFO ] [MAIN ] MTD: Wiping existing primary data before full refresh. [2025-09-29T20:01:24.766398] [INFO ] [LOCAL ] MTD: Starting deletion of primary data. [2025-09-29T20:01:24.766737] [DEBUG] [LOCAL ] MTD: Deleted primary data file. [2025-09-29T20:01:24.766800] [INFO ] [MAIN ] MTD: Starting full primary refresh. [2025-09-29T20:01:25.148860] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-01. [2025-09-29T20:01:25.152634] [INFO ] [REMOTE ] MTD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:01:25.225082] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-29T20:01:25.476935] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-29T20:01:25.948158] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-08. [2025-09-29T20:01:26.748150] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-06. [2025-09-29T20:01:26.900445] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-29T20:01:27.503559] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-29T20:01:27.548141] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-02. [2025-09-29T20:01:28.351982] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-09. [2025-09-29T20:01:28.357773] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-29T20:01:29.117928] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-29T20:01:29.148096] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-03. [2025-09-29T20:01:29.948133] [INFO ] [REMOTE ] MTD: Fetching primary data for 2024-12. [2025-09-29T20:01:30.011190] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-29T20:01:30.021940] [INFO ] [REMOTE ] MTAL: Full fetch complete (47341 records). [2025-09-29T20:01:30.022143] [DEBUG] [VALIDATOR ] MTAL: Validating primary data. [2025-09-29T20:01:30.426711] [DEBUG] [VALIDATOR ] MTAL: All expected trading days are present. [2025-09-29T20:01:30.426802] [DEBUG] [VALIDATOR ] MTAL: Primary data validation passed. [2025-09-29T20:01:30.427680] [INFO ] [MAIN ] MTAL: Fetched primary data is valid. [2025-09-29T20:01:30.427746] [DEBUG] [LOCAL ] MTAL: Saving primary data. [2025-09-29T20:01:30.428814] [DEBUG] [LOCAL ] MTAL: Trimmed 47341 records to 36514 (keeping 200 days of data) [2025-09-29T20:01:30.665741] [DEBUG] [LOCAL ] MTAL: Primary data saved (36514 records). [2025-09-29T20:01:30.665921] [INFO ] [MAIN ] MTAL: Full history saved. [2025-09-29T20:01:30.666024] [INFO ] [MAIN ] Update Progress: 1415/2371 symbols completed. MTAL took 26.9s. Estimated remaining: 2h 2m 36s. Rate: 7.8 symbols/min [2025-09-29T20:01:30.754230] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-07. [2025-09-29T20:01:30.858054] [INFO ] [MAIN ] MTDR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:01:30.890915] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-29T20:01:30.912740] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-29T20:01:30.961750] [DEBUG] [LOCAL ] MTDR: Loaded 52316 existing records from primary storage. [2025-09-29T20:01:30.962077] [INFO ] [MAIN ] MTDR: Loaded 52316 existing records. [2025-09-29T20:01:31.146707] [WARN ] [MAIN ] MTDR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:01:31.146991] [INFO ] [MAIN ] MTDR: Wiping existing primary data before full refresh. [2025-09-29T20:01:31.147074] [INFO ] [LOCAL ] MTDR: Starting deletion of primary data. [2025-09-29T20:01:31.147573] [DEBUG] [LOCAL ] MTDR: Deleted primary data file. [2025-09-29T20:01:31.147632] [INFO ] [MAIN ] MTDR: Starting full primary refresh. [2025-09-29T20:01:31.535634] [INFO ] [REMOTE ] MTDR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:01:31.548142] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-04. [2025-09-29T20:01:32.348136] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2024-12. [2025-09-29T20:01:32.716204] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-29T20:01:33.148167] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-01. [2025-09-29T20:01:33.344787] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-29T20:01:33.948149] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-08. [2025-09-29T20:01:34.041593] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-29T20:01:34.059990] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-29T20:01:34.748122] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-01. [2025-09-29T20:01:35.421386] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-29T20:01:35.548172] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-05. [2025-09-29T20:01:36.349345] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-09. [2025-09-29T20:01:36.352343] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-29T20:01:37.111996] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-29T20:01:37.148137] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-06. [2025-09-29T20:01:37.948120] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-02. [2025-09-29T20:01:38.228872] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-29T20:01:38.239367] [INFO ] [REMOTE ] MT: Full fetch complete (73451 records). [2025-09-29T20:01:38.239542] [DEBUG] [VALIDATOR ] MT: Validating primary data. [2025-09-29T20:01:38.711439] [DEBUG] [VALIDATOR ] MT: All expected trading days are present. [2025-09-29T20:01:38.711579] [DEBUG] [VALIDATOR ] MT: Primary data validation passed. [2025-09-29T20:01:38.712874] [INFO ] [MAIN ] MT: Fetched primary data is valid. [2025-09-29T20:01:38.712983] [DEBUG] [LOCAL ] MT: Saving primary data. [2025-09-29T20:01:38.725236] [DEBUG] [LOCAL ] MT: Trimmed 73451 records to 50612 (keeping 200 days of data) [2025-09-29T20:01:38.746989] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-29T20:01:38.756907] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-02. [2025-09-29T20:01:39.079903] [DEBUG] [LOCAL ] MT: Primary data saved (50612 records). [2025-09-29T20:01:39.080059] [INFO ] [MAIN ] MT: Full history saved. [2025-09-29T20:01:39.080174] [INFO ] [MAIN ] Update Progress: 1416/2371 symbols completed. MT took 44.0s. Estimated remaining: 2h 2m 29s. Rate: 7.8 symbols/min [2025-09-29T20:01:39.270413] [INFO ] [MAIN ] MTG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:01:39.332100] [DEBUG] [LOCAL ] MTG: Loaded 52091 existing records from primary storage. [2025-09-29T20:01:39.332446] [INFO ] [MAIN ] MTG: Loaded 52091 existing records. [2025-09-29T20:01:39.524905] [WARN ] [MAIN ] MTG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:01:39.525337] [INFO ] [MAIN ] MTG: Wiping existing primary data before full refresh. [2025-09-29T20:01:39.525551] [INFO ] [LOCAL ] MTG: Starting deletion of primary data. [2025-09-29T20:01:39.526486] [DEBUG] [LOCAL ] MTG: Deleted primary data file. [2025-09-29T20:01:39.526565] [INFO ] [MAIN ] MTG: Starting full primary refresh. [2025-09-29T20:01:39.555738] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-07. [2025-09-29T20:01:39.785455] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-29T20:01:39.907908] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-29T20:01:39.994680] [INFO ] [REMOTE ] MTG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:01:40.348110] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-03. [2025-09-29T20:01:41.148121] [INFO ] [REMOTE ] MTG: Fetching primary data for 2024-12. [2025-09-29T20:01:41.457937] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-29T20:01:41.948144] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-03. [2025-09-29T20:01:42.093157] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-29T20:01:42.588532] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-29T20:01:42.740479] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-29T20:01:42.750474] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-08. [2025-09-29T20:01:43.548140] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-01. [2025-09-29T20:01:44.353247] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-04. [2025-09-29T20:01:44.372587] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-29T20:01:44.922133] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-29T20:01:45.148186] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-02. [2025-09-29T20:01:45.678955] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-29T20:01:45.948152] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-05. [2025-09-29T20:01:46.748070] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-09. [2025-09-29T20:01:46.868775] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-29T20:01:47.172464] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-29T20:01:47.548155] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-03. [2025-09-29T20:01:48.348120] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-04. [2025-09-29T20:01:48.421435] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-29T20:01:48.433530] [INFO ] [REMOTE ] MTB: Full fetch complete (68262 records). [2025-09-29T20:01:48.433717] [DEBUG] [VALIDATOR ] MTB: Validating primary data. [2025-09-29T20:01:48.864233] [DEBUG] [VALIDATOR ] MTB: All expected trading days are present. [2025-09-29T20:01:48.864483] [DEBUG] [VALIDATOR ] MTB: Primary data validation passed. [2025-09-29T20:01:48.865821] [INFO ] [MAIN ] MTB: Fetched primary data is valid. [2025-09-29T20:01:48.866046] [DEBUG] [LOCAL ] MTB: Saving primary data. [2025-09-29T20:01:48.868462] [DEBUG] [LOCAL ] MTB: Trimmed 68262 records to 46781 (keeping 200 days of data) [2025-09-29T20:01:49.037236] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-29T20:01:49.150975] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-06. [2025-09-29T20:01:49.231563] [DEBUG] [LOCAL ] MTB: Primary data saved (46781 records). [2025-09-29T20:01:49.231778] [INFO ] [MAIN ] MTB: Full history saved. [2025-09-29T20:01:49.231907] [INFO ] [MAIN ] Update Progress: 1417/2371 symbols completed. MTB took 30.9s. Estimated remaining: 2h 2m 23s. Rate: 7.8 symbols/min [2025-09-29T20:01:49.435268] [INFO ] [MAIN ] MTH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:01:49.485369] [DEBUG] [LOCAL ] MTH: Loaded 44547 existing records from primary storage. [2025-09-29T20:01:49.485736] [INFO ] [MAIN ] MTH: Loaded 44547 existing records. [2025-09-29T20:01:49.672664] [WARN ] [MAIN ] MTH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:01:49.672896] [INFO ] [MAIN ] MTH: Wiping existing primary data before full refresh. [2025-09-29T20:01:49.672961] [INFO ] [LOCAL ] MTH: Starting deletion of primary data. [2025-09-29T20:01:49.673357] [DEBUG] [LOCAL ] MTH: Deleted primary data file. [2025-09-29T20:01:49.673418] [INFO ] [MAIN ] MTH: Starting full primary refresh. [2025-09-29T20:01:49.955283] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-04. [2025-09-29T20:01:50.055163] [INFO ] [REMOTE ] MTH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:01:50.179568] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-29T20:01:50.185041] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-29T20:01:50.748142] [INFO ] [REMOTE ] MTH: Fetching primary data for 2024-12. [2025-09-29T20:01:51.548107] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-07. [2025-09-29T20:01:51.651858] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-29T20:01:52.220766] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-29T20:01:52.348111] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-05. [2025-09-29T20:01:52.572165] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-29T20:01:53.148144] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-08. [2025-09-29T20:01:53.874182] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-29T20:01:53.948134] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-01. [2025-09-29T20:01:54.111553] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-29T20:01:54.748147] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-09. [2025-09-29T20:01:55.548102] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-06. [2025-09-29T20:01:55.656423] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-29T20:01:55.943525] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-29T20:01:55.946172] [INFO ] [REMOTE ] MTD: Full fetch complete (20966 records). [2025-09-29T20:01:55.946295] [DEBUG] [VALIDATOR ] MTD: Validating primary data. [2025-09-29T20:01:56.354340] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-05. [2025-09-29T20:01:56.355076] [DEBUG] [VALIDATOR ] MTD: All expected trading days are present. [2025-09-29T20:01:56.355158] [DEBUG] [VALIDATOR ] MTD: Primary data validation passed. [2025-09-29T20:01:56.355756] [INFO ] [MAIN ] MTD: Fetched primary data is valid. [2025-09-29T20:01:56.356570] [DEBUG] [LOCAL ] MTD: Saving primary data. [2025-09-29T20:01:56.358413] [DEBUG] [LOCAL ] MTD: Trimmed 20966 records to 15072 (keeping 200 days of data) [2025-09-29T20:01:56.468886] [DEBUG] [LOCAL ] MTD: Primary data saved (15072 records). [2025-09-29T20:01:56.469039] [INFO ] [MAIN ] MTD: Full history saved. [2025-09-29T20:01:56.469190] [INFO ] [MAIN ] Update Progress: 1418/2371 symbols completed. MTD took 32.1s. Estimated remaining: 2h 2m 15s. Rate: 7.8 symbols/min [2025-09-29T20:01:56.655060] [INFO ] [MAIN ] MTN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:01:56.704021] [DEBUG] [LOCAL ] MTN: Loaded 39607 existing records from primary storage. [2025-09-29T20:01:56.704341] [INFO ] [MAIN ] MTN: Loaded 39607 existing records. [2025-09-29T20:01:56.901884] [WARN ] [MAIN ] MTN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:01:56.902120] [INFO ] [MAIN ] MTN: Wiping existing primary data before full refresh. [2025-09-29T20:01:56.902170] [INFO ] [LOCAL ] MTN: Starting deletion of primary data. [2025-09-29T20:01:56.902508] [DEBUG] [LOCAL ] MTN: Deleted primary data file. [2025-09-29T20:01:56.902570] [INFO ] [MAIN ] MTN: Starting full primary refresh. [2025-09-29T20:01:57.154333] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-02. [2025-09-29T20:01:57.327249] [INFO ] [REMOTE ] MTN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:01:57.357224] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-29T20:01:57.948151] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-07. [2025-09-29T20:01:58.116530] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-29T20:01:58.748093] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-06. [2025-09-29T20:01:58.848509] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-29T20:01:59.548121] [INFO ] [REMOTE ] MTN: Fetching primary data for 2024-12. [2025-09-29T20:01:59.851843] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-29T20:02:00.348095] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-03. [2025-09-29T20:02:00.406183] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-29T20:02:01.148122] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-07. [2025-09-29T20:02:01.268186] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-29T20:02:01.948113] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-01. [2025-09-29T20:02:02.014623] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-29T20:02:02.748082] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-04. [2025-09-29T20:02:03.111186] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-29T20:02:03.548124] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-08. [2025-09-29T20:02:03.627006] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-29T20:02:04.348152] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-08. [2025-09-29T20:02:04.414124] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-29T20:02:05.148106] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-02. [2025-09-29T20:02:05.348888] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-29T20:02:05.948151] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-09. [2025-09-29T20:02:06.016378] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-29T20:02:06.538876] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-29T20:02:06.748202] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-03. [2025-09-29T20:02:07.548130] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-05. [2025-09-29T20:02:07.824632] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-29T20:02:07.835609] [INFO ] [REMOTE ] MTDR: Full fetch complete (73432 records). [2025-09-29T20:02:07.835835] [DEBUG] [VALIDATOR ] MTDR: Validating primary data. [2025-09-29T20:02:08.290904] [DEBUG] [VALIDATOR ] MTDR: All expected trading days are present. [2025-09-29T20:02:08.291099] [DEBUG] [VALIDATOR ] MTDR: Primary data validation passed. [2025-09-29T20:02:08.292216] [INFO ] [MAIN ] MTDR: Fetched primary data is valid. [2025-09-29T20:02:08.292300] [DEBUG] [LOCAL ] MTDR: Saving primary data. [2025-09-29T20:02:08.293880] [DEBUG] [LOCAL ] MTDR: Trimmed 73432 records to 51558 (keeping 200 days of data) [2025-09-29T20:02:08.358756] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-09. [2025-09-29T20:02:08.437569] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-29T20:02:08.687788] [DEBUG] [LOCAL ] MTDR: Primary data saved (51558 records). [2025-09-29T20:02:08.687966] [INFO ] [MAIN ] MTDR: Full history saved. [2025-09-29T20:02:08.688126] [INFO ] [MAIN ] Update Progress: 1419/2371 symbols completed. MTDR took 38.0s. Estimated remaining: 2h 2m 10s. Rate: 7.8 symbols/min [2025-09-29T20:02:08.877724] [INFO ] [MAIN ] MTR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:02:08.878031] [DEBUG] [LOCAL ] MTR: No existing data file found in primary storage. [2025-09-29T20:02:08.878185] [WARN ] [MAIN ] MTR: No existing data found, performing full refresh instead. [2025-09-29T20:02:08.878488] [INFO ] [MAIN ] MTR: Wiping existing primary data before full refresh. [2025-09-29T20:02:08.878551] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-09-29T20:02:08.878599] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-09-29T20:02:08.878633] [INFO ] [MAIN ] MTR: Starting full primary refresh. [2025-09-29T20:02:09.163679] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-04. [2025-09-29T20:02:09.309576] [INFO ] [REMOTE ] MTR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:02:09.338520] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-29T20:02:09.948101] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-06. [2025-09-29T20:02:10.394692] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-29T20:02:10.408892] [INFO ] [REMOTE ] MTG: Full fetch complete (74033 records). [2025-09-29T20:02:10.409071] [DEBUG] [VALIDATOR ] MTG: Validating primary data. [2025-09-29T20:02:10.751569] [INFO ] [REMOTE ] MTR: Fetching primary data for 2024-12. [2025-09-29T20:02:10.832301] [DEBUG] [VALIDATOR ] MTG: All expected trading days are present. [2025-09-29T20:02:10.832409] [DEBUG] [VALIDATOR ] MTG: Primary data validation passed. [2025-09-29T20:02:10.833531] [INFO ] [MAIN ] MTG: Fetched primary data is valid. [2025-09-29T20:02:10.833617] [DEBUG] [LOCAL ] MTG: Saving primary data. [2025-09-29T20:02:10.844496] [DEBUG] [LOCAL ] MTG: Trimmed 74033 records to 51299 (keeping 200 days of data) [2025-09-29T20:02:10.862373] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-29T20:02:11.141825] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-29T20:02:11.275117] [DEBUG] [LOCAL ] MTG: Primary data saved (51299 records). [2025-09-29T20:02:11.275483] [INFO ] [MAIN ] MTG: Full history saved. [2025-09-29T20:02:11.275633] [INFO ] [MAIN ] Update Progress: 1420/2371 symbols completed. MTG took 32.2s. Estimated remaining: 2h 1m 59s. Rate: 7.8 symbols/min [2025-09-29T20:02:11.381413] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-29T20:02:11.475730] [INFO ] [MAIN ] MTRN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:02:11.506344] [DEBUG] [LOCAL ] MTRN: Loaded 18303 existing records from primary storage. [2025-09-29T20:02:11.506821] [INFO ] [MAIN ] MTRN: Loaded 18303 existing records. [2025-09-29T20:02:11.553401] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-01. [2025-09-29T20:02:11.787060] [WARN ] [MAIN ] MTRN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:02:11.787513] [INFO ] [MAIN ] MTRN: Wiping existing primary data before full refresh. [2025-09-29T20:02:11.787596] [INFO ] [LOCAL ] MTRN: Starting deletion of primary data. [2025-09-29T20:02:11.788266] [DEBUG] [LOCAL ] MTRN: Deleted primary data file. [2025-09-29T20:02:11.788354] [INFO ] [MAIN ] MTRN: Starting full primary refresh. [2025-09-29T20:02:12.196494] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-29T20:02:12.325411] [INFO ] [REMOTE ] MTRN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:02:12.348173] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-07. [2025-09-29T20:02:13.148132] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-05. [2025-09-29T20:02:13.948395] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2024-12. [2025-09-29T20:02:14.669273] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-29T20:02:14.748121] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-06. [2025-09-29T20:02:14.772174] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-29T20:02:15.548204] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-01. [2025-09-29T20:02:16.294752] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-29T20:02:16.297854] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-29T20:02:16.358897] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-02. [2025-09-29T20:02:16.391982] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-07 (4.04 seconds). [2025-09-29T20:02:17.148190] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-07. [2025-09-29T20:02:17.334975] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-29T20:02:17.948150] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-08. [2025-09-29T20:02:18.748137] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-03. [2025-09-29T20:02:18.800504] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-29T20:02:19.217326] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-29T20:02:19.548138] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-09. [2025-09-29T20:02:19.795263] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-29T20:02:20.348122] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-02. [2025-09-29T20:02:20.703896] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-29T20:02:21.145983] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-29T20:02:21.155481] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-04. [2025-09-29T20:02:21.158098] [INFO ] [REMOTE ] MTH: Full fetch complete (63069 records). [2025-09-29T20:02:21.158345] [DEBUG] [VALIDATOR ] MTH: Validating primary data. [2025-09-29T20:02:21.566670] [DEBUG] [VALIDATOR ] MTH: All expected trading days are present. [2025-09-29T20:02:21.566781] [DEBUG] [VALIDATOR ] MTH: Primary data validation passed. [2025-09-29T20:02:21.567959] [INFO ] [MAIN ] MTH: Fetched primary data is valid. [2025-09-29T20:02:21.568031] [DEBUG] [LOCAL ] MTH: Saving primary data. [2025-09-29T20:02:21.569908] [DEBUG] [LOCAL ] MTH: Trimmed 63069 records to 43822 (keeping 200 days of data) [2025-09-29T20:02:21.879241] [DEBUG] [LOCAL ] MTH: Primary data saved (43822 records). [2025-09-29T20:02:21.879442] [INFO ] [MAIN ] MTH: Full history saved. [2025-09-29T20:02:21.879568] [INFO ] [MAIN ] Update Progress: 1421/2371 symbols completed. MTH took 32.6s. Estimated remaining: 2h 1m 53s. Rate: 7.8 symbols/min [2025-09-29T20:02:21.953257] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-03. [2025-09-29T20:02:22.083205] [INFO ] [MAIN ] MTUS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:02:22.121127] [DEBUG] [LOCAL ] MTUS: Loaded 28984 existing records from primary storage. [2025-09-29T20:02:22.121587] [INFO ] [MAIN ] MTUS: Loaded 28984 existing records. [2025-09-29T20:02:22.322193] [WARN ] [MAIN ] MTUS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:02:22.334050] [INFO ] [MAIN ] MTUS: Wiping existing primary data before full refresh. [2025-09-29T20:02:22.334751] [INFO ] [LOCAL ] MTUS: Starting deletion of primary data. [2025-09-29T20:02:22.335192] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-29T20:02:22.339416] [DEBUG] [LOCAL ] MTUS: Deleted primary data file. [2025-09-29T20:02:22.340372] [INFO ] [MAIN ] MTUS: Starting full primary refresh. [2025-09-29T20:02:22.451302] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-29T20:02:22.750076] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-08. [2025-09-29T20:02:22.784222] [INFO ] [REMOTE ] MTUS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:02:23.548173] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-04. [2025-09-29T20:02:24.151837] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-29T20:02:24.177764] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-29T20:02:24.348124] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-05. [2025-09-29T20:02:25.148118] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2024-12. [2025-09-29T20:02:25.541722] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-29T20:02:25.948163] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-06. [2025-09-29T20:02:26.546747] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-29T20:02:26.748122] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-01. [2025-09-29T20:02:26.968930] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-29T20:02:27.548130] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-07. [2025-09-29T20:02:27.996706] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-29T20:02:28.348165] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-05. [2025-09-29T20:02:28.695142] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-29T20:02:28.788744] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-29T20:02:29.148130] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-06. [2025-09-29T20:02:29.949000] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-02. [2025-09-29T20:02:29.953945] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-29T20:02:30.748152] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-09. [2025-09-29T20:02:31.035385] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-29T20:02:31.548151] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-03. [2025-09-29T20:02:32.348127] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-07. [2025-09-29T20:02:32.428768] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-29T20:02:32.437670] [INFO ] [REMOTE ] MTN: Full fetch complete (56038 records). [2025-09-29T20:02:32.437901] [DEBUG] [VALIDATOR ] MTN: Validating primary data. [2025-09-29T20:02:32.848815] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-29T20:02:32.870426] [DEBUG] [VALIDATOR ] MTN: All expected trading days are present. [2025-09-29T20:02:32.872259] [DEBUG] [VALIDATOR ] MTN: Primary data validation passed. [2025-09-29T20:02:32.874203] [INFO ] [MAIN ] MTN: Fetched primary data is valid. [2025-09-29T20:02:32.874332] [DEBUG] [LOCAL ] MTN: Saving primary data. [2025-09-29T20:02:32.875681] [DEBUG] [LOCAL ] MTN: Trimmed 56038 records to 38902 (keeping 200 days of data) [2025-09-29T20:02:33.148353] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-08. [2025-09-29T20:02:33.175713] [DEBUG] [LOCAL ] MTN: Primary data saved (38902 records). [2025-09-29T20:02:33.176114] [INFO ] [MAIN ] MTN: Full history saved. [2025-09-29T20:02:33.178199] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-29T20:02:33.177233] [INFO ] [MAIN ] Update Progress: 1422/2371 symbols completed. MTN took 36.7s. Estimated remaining: 2h 1m 48s. Rate: 7.8 symbols/min [2025-09-29T20:02:33.397016] [INFO ] [MAIN ] MTW: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:02:33.427526] [DEBUG] [LOCAL ] MTW: Loaded 26888 existing records from primary storage. [2025-09-29T20:02:33.427925] [INFO ] [MAIN ] MTW: Loaded 26888 existing records. [2025-09-29T20:02:33.557845] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-29T20:02:33.638930] [WARN ] [MAIN ] MTW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:02:33.639223] [INFO ] [MAIN ] MTW: Wiping existing primary data before full refresh. [2025-09-29T20:02:33.639288] [INFO ] [LOCAL ] MTW: Starting deletion of primary data. [2025-09-29T20:02:33.639608] [DEBUG] [LOCAL ] MTW: Deleted primary data file. [2025-09-29T20:02:33.639721] [INFO ] [MAIN ] MTW: Starting full primary refresh. [2025-09-29T20:02:33.953268] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-08. [2025-09-29T20:02:34.043621] [INFO ] [REMOTE ] MTW: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:02:34.748132] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-09. [2025-09-29T20:02:35.010810] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-29T20:02:35.191224] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-29T20:02:35.192081] [INFO ] [REMOTE ] MTR: Full fetch complete (2542 records). [2025-09-29T20:02:35.192156] [DEBUG] [VALIDATOR ] MTR: Validating primary data. [2025-09-29T20:02:35.387212] [WARN ] [VALIDATOR ] MTR: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-29T20:02:35.387445] [FATAL] [MAIN ] MTR: Fetched primary data is invalid. Refusing to save it. [2025-09-29T20:02:35.387519] [WARN ] [MAIN ] MTR: Deleting existing primary and derivative data due to validation failure. [2025-09-29T20:02:35.387594] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-09-29T20:02:35.387690] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-09-29T20:02:35.387760] [INFO ] [LOCAL ] MTR: Starting deletion of derivative data. [2025-09-29T20:02:35.387830] [DEBUG] [LOCAL ] MTR: No derivative data file found to delete. [2025-09-29T20:02:35.387907] [INFO ] [MAIN ] Update Progress: 1423/2371 symbols completed. MTR took 26.7s. Estimated remaining: 2h 1m 37s. Rate: 7.8 symbols/min [2025-09-29T20:02:35.548192] [INFO ] [REMOTE ] MTW: Fetching primary data for 2024-12. [2025-09-29T20:02:35.571259] [INFO ] [MAIN ] MTX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:02:35.596974] [DEBUG] [LOCAL ] MTX: Loaded 23150 existing records from primary storage. [2025-09-29T20:02:35.597294] [INFO ] [MAIN ] MTX: Loaded 23150 existing records. [2025-09-29T20:02:35.788933] [WARN ] [MAIN ] MTX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:02:35.789214] [INFO ] [MAIN ] MTX: Wiping existing primary data before full refresh. [2025-09-29T20:02:35.789270] [INFO ] [LOCAL ] MTX: Starting deletion of primary data. [2025-09-29T20:02:35.789565] [DEBUG] [LOCAL ] MTX: Deleted primary data file. [2025-09-29T20:02:35.789625] [INFO ] [MAIN ] MTX: Starting full primary refresh. [2025-09-29T20:02:36.184931] [INFO ] [REMOTE ] MTX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:02:36.348141] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-09. [2025-09-29T20:02:36.801755] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-29T20:02:37.148157] [INFO ] [REMOTE ] MTX: Fetching primary data for 2024-12. [2025-09-29T20:02:37.170094] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-29T20:02:37.174144] [INFO ] [REMOTE ] MTRN: Full fetch complete (23442 records). [2025-09-29T20:02:37.174297] [DEBUG] [VALIDATOR ] MTRN: Validating primary data. [2025-09-29T20:02:37.569899] [DEBUG] [VALIDATOR ] MTRN: All expected trading days are present. [2025-09-29T20:02:37.569984] [DEBUG] [VALIDATOR ] MTRN: Primary data validation passed. [2025-09-29T20:02:37.570531] [INFO ] [MAIN ] MTRN: Fetched primary data is valid. [2025-09-29T20:02:37.570577] [DEBUG] [LOCAL ] MTRN: Saving primary data. [2025-09-29T20:02:37.571324] [DEBUG] [LOCAL ] MTRN: Trimmed 23442 records to 18039 (keeping 200 days of data) [2025-09-29T20:02:37.702023] [DEBUG] [LOCAL ] MTRN: Primary data saved (18039 records). [2025-09-29T20:02:37.702189] [INFO ] [MAIN ] MTRN: Full history saved. [2025-09-29T20:02:37.702305] [INFO ] [MAIN ] Update Progress: 1424/2371 symbols completed. MTRN took 26.4s. Estimated remaining: 2h 1m 25s. Rate: 7.8 symbols/min [2025-09-29T20:02:37.897879] [INFO ] [MAIN ] MTZ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:02:37.955134] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-01. [2025-09-29T20:02:37.959845] [DEBUG] [LOCAL ] MTZ: Loaded 43922 existing records from primary storage. [2025-09-29T20:02:37.960359] [INFO ] [MAIN ] MTZ: Loaded 43922 existing records. [2025-09-29T20:02:38.175915] [WARN ] [MAIN ] MTZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:02:38.181906] [INFO ] [MAIN ] MTZ: Wiping existing primary data before full refresh. [2025-09-29T20:02:38.189702] [INFO ] [LOCAL ] MTZ: Starting deletion of primary data. [2025-09-29T20:02:38.190455] [DEBUG] [LOCAL ] MTZ: Deleted primary data file. [2025-09-29T20:02:38.191162] [INFO ] [MAIN ] MTZ: Starting full primary refresh. [2025-09-29T20:02:38.191079] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-29T20:02:38.601278] [INFO ] [REMOTE ] MTZ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:02:38.748147] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-04. [2025-09-29T20:02:38.977125] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-29T20:02:39.548172] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-02. [2025-09-29T20:02:40.148252] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-29T20:02:40.313788] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-29T20:02:40.348165] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-03. [2025-09-29T20:02:41.148132] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-05. [2025-09-29T20:02:41.485906] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-29T20:02:41.948128] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-01. [2025-09-29T20:02:42.528906] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-29T20:02:42.748159] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-06. [2025-09-29T20:02:43.027498] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-29T20:02:43.548154] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-02. [2025-09-29T20:02:43.966261] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-29T20:02:44.348107] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2024-12. [2025-09-29T20:02:44.661109] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-29T20:02:45.148113] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-03. [2025-09-29T20:02:45.929622] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-29T20:02:45.948070] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-04. [2025-09-29T20:02:46.120609] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-29T20:02:46.748123] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-01. [2025-09-29T20:02:47.372504] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-29T20:02:47.548144] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-05. [2025-09-29T20:02:48.188207] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-29T20:02:48.348142] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-04. [2025-09-29T20:02:48.941725] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-29T20:02:49.148096] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-06. [2025-09-29T20:02:49.187507] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-29T20:02:49.948118] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-07. [2025-09-29T20:02:50.384171] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-29T20:02:50.748123] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-07. [2025-09-29T20:02:51.274294] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-29T20:02:51.548130] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-08. [2025-09-29T20:02:51.865523] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-29T20:02:52.348107] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-08. [2025-09-29T20:02:52.682096] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-29T20:02:53.148131] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-09. [2025-09-29T20:02:53.672739] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-29T20:02:53.948113] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-05. [2025-09-29T20:02:54.387812] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-29T20:02:54.395223] [INFO ] [REMOTE ] MTUS: Full fetch complete (42504 records). [2025-09-29T20:02:54.395393] [DEBUG] [VALIDATOR ] MTUS: Validating primary data. [2025-09-29T20:02:54.753209] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-02. [2025-09-29T20:02:54.834632] [DEBUG] [VALIDATOR ] MTUS: All expected trading days are present. [2025-09-29T20:02:54.834764] [DEBUG] [VALIDATOR ] MTUS: Primary data validation passed. [2025-09-29T20:02:54.835682] [INFO ] [MAIN ] MTUS: Fetched primary data is valid. [2025-09-29T20:02:54.835764] [DEBUG] [LOCAL ] MTUS: Saving primary data. [2025-09-29T20:02:54.836984] [DEBUG] [LOCAL ] MTUS: Trimmed 42504 records to 28394 (keeping 200 days of data) [2025-09-29T20:02:55.016693] [DEBUG] [LOCAL ] MTUS: Primary data saved (28394 records). [2025-09-29T20:02:55.016846] [INFO ] [MAIN ] MTUS: Full history saved. [2025-09-29T20:02:55.016937] [INFO ] [MAIN ] Update Progress: 1425/2371 symbols completed. MTUS took 33.1s. Estimated remaining: 2h 1m 24s. Rate: 7.8 symbols/min [2025-09-29T20:02:55.205700] [INFO ] [MAIN ] MUA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:02:55.215277] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-29T20:02:55.233556] [DEBUG] [LOCAL ] MUA: Loaded 12391 existing records from primary storage. [2025-09-29T20:02:55.233844] [INFO ] [MAIN ] MUA: Loaded 12391 existing records. [2025-09-29T20:02:55.424965] [WARN ] [MAIN ] MUA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:02:55.425227] [INFO ] [MAIN ] MUA: Wiping existing primary data before full refresh. [2025-09-29T20:02:55.425277] [INFO ] [LOCAL ] MUA: Starting deletion of primary data. [2025-09-29T20:02:55.425501] [DEBUG] [LOCAL ] MUA: Deleted primary data file. [2025-09-29T20:02:55.425565] [INFO ] [MAIN ] MUA: Starting full primary refresh. [2025-09-29T20:02:55.553225] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-09. [2025-09-29T20:02:55.810900] [INFO ] [REMOTE ] MUA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:02:56.348095] [INFO ] [REMOTE ] MUA: Fetching primary data for 2024-12. [2025-09-29T20:02:56.423953] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-29T20:02:56.916941] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-29T20:02:56.925782] [INFO ] [REMOTE ] MTW: Full fetch complete (38401 records). [2025-09-29T20:02:56.926034] [DEBUG] [VALIDATOR ] MTW: Validating primary data. [2025-09-29T20:02:57.153945] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-06. [2025-09-29T20:02:57.264979] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-29T20:02:57.350088] [DEBUG] [VALIDATOR ] MTW: All expected trading days are present. [2025-09-29T20:02:57.350181] [DEBUG] [VALIDATOR ] MTW: Primary data validation passed. [2025-09-29T20:02:57.351075] [INFO ] [MAIN ] MTW: Fetched primary data is valid. [2025-09-29T20:02:57.351144] [DEBUG] [LOCAL ] MTW: Saving primary data. [2025-09-29T20:02:57.352177] [DEBUG] [LOCAL ] MTW: Trimmed 38401 records to 26431 (keeping 200 days of data) [2025-09-29T20:02:57.512294] [DEBUG] [LOCAL ] MTW: Primary data saved (26431 records). [2025-09-29T20:02:57.512442] [INFO ] [MAIN ] MTW: Full history saved. [2025-09-29T20:02:57.512529] [INFO ] [MAIN ] Update Progress: 1426/2371 symbols completed. MTW took 24.3s. Estimated remaining: 2h 1m 13s. Rate: 7.8 symbols/min [2025-09-29T20:02:57.697755] [INFO ] [MAIN ] MUC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:02:57.722803] [DEBUG] [LOCAL ] MUC: Loaded 20721 existing records from primary storage. [2025-09-29T20:02:57.723065] [INFO ] [MAIN ] MUC: Loaded 20721 existing records. [2025-09-29T20:02:57.904312] [WARN ] [MAIN ] MUC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:02:57.904546] [INFO ] [MAIN ] MUC: Wiping existing primary data before full refresh. [2025-09-29T20:02:57.904596] [INFO ] [LOCAL ] MUC: Starting deletion of primary data. [2025-09-29T20:02:57.904960] [DEBUG] [LOCAL ] MUC: Deleted primary data file. [2025-09-29T20:02:57.905019] [INFO ] [MAIN ] MUC: Starting full primary refresh. [2025-09-29T20:02:57.959847] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-03. [2025-09-29T20:02:58.290458] [INFO ] [REMOTE ] MUC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:02:58.304700] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-29T20:02:58.748164] [INFO ] [REMOTE ] MUC: Fetching primary data for 2024-12. [2025-09-29T20:02:59.548108] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-07. [2025-09-29T20:02:59.814136] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-29T20:02:59.964042] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-29T20:03:00.348119] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-01. [2025-09-29T20:03:01.020182] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-29T20:03:01.148100] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-08. [2025-09-29T20:03:01.443017] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-29T20:03:01.939232] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-29T20:03:01.948081] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-02. [2025-09-29T20:03:02.748091] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-09. [2025-09-29T20:03:02.994937] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-29T20:03:03.548100] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-01. [2025-09-29T20:03:03.858046] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-29T20:03:03.863313] [INFO ] [REMOTE ] MTX: Full fetch complete (31206 records). [2025-09-29T20:03:03.863520] [DEBUG] [VALIDATOR ] MTX: Validating primary data. [2025-09-29T20:03:04.315125] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-29T20:03:04.348251] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-02. [2025-09-29T20:03:04.431441] [DEBUG] [VALIDATOR ] MTX: All expected trading days are present. [2025-09-29T20:03:04.431582] [DEBUG] [VALIDATOR ] MTX: Primary data validation passed. [2025-09-29T20:03:04.433347] [INFO ] [MAIN ] MTX: Fetched primary data is valid. [2025-09-29T20:03:04.433443] [DEBUG] [LOCAL ] MTX: Saving primary data. [2025-09-29T20:03:04.435126] [DEBUG] [LOCAL ] MTX: Trimmed 31206 records to 22808 (keeping 200 days of data) [2025-09-29T20:03:04.649765] [DEBUG] [LOCAL ] MTX: Primary data saved (22808 records). [2025-09-29T20:03:04.649963] [INFO ] [MAIN ] MTX: Full history saved. [2025-09-29T20:03:04.650115] [INFO ] [MAIN ] Update Progress: 1427/2371 symbols completed. MTX took 29.3s. Estimated remaining: 2h 1m 5s. Rate: 7.8 symbols/min [2025-09-29T20:03:05.001520] [INFO ] [MAIN ] MUE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:03:05.017920] [DEBUG] [LOCAL ] MUE: Loaded 12092 existing records from primary storage. [2025-09-29T20:03:05.018459] [INFO ] [MAIN ] MUE: Loaded 12092 existing records. [2025-09-29T20:03:05.153277] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-03. [2025-09-29T20:03:05.234060] [WARN ] [MAIN ] MUE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:03:05.234357] [INFO ] [MAIN ] MUE: Wiping existing primary data before full refresh. [2025-09-29T20:03:05.234426] [INFO ] [LOCAL ] MUE: Starting deletion of primary data. [2025-09-29T20:03:05.234730] [DEBUG] [LOCAL ] MUE: Deleted primary data file. [2025-09-29T20:03:05.234807] [INFO ] [MAIN ] MUE: Starting full primary refresh. [2025-09-29T20:03:05.437588] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-29T20:03:05.646476] [INFO ] [REMOTE ] MUE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:03:05.948083] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-04. [2025-09-29T20:03:06.245164] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-29T20:03:06.748169] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-04. [2025-09-29T20:03:07.538752] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-29T20:03:07.548189] [INFO ] [REMOTE ] MUE: Fetching primary data for 2024-12. [2025-09-29T20:03:07.793142] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-29T20:03:08.348086] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-05. [2025-09-29T20:03:08.521863] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-29T20:03:09.035962] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-29T20:03:09.148144] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-06. [2025-09-29T20:03:09.948089] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-03. [2025-09-29T20:03:10.185037] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-29T20:03:10.748136] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-07. [2025-09-29T20:03:10.888516] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-29T20:03:11.548160] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-01. [2025-09-29T20:03:11.888383] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-29T20:03:12.316381] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-29T20:03:12.348133] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-02. [2025-09-29T20:03:13.065635] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-29T20:03:13.148145] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-03. [2025-09-29T20:03:13.948122] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-05. [2025-09-29T20:03:13.997121] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-29T20:03:14.748360] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-08. [2025-09-29T20:03:15.548135] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-04. [2025-09-29T20:03:15.589618] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-29T20:03:15.890250] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-29T20:03:16.348129] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-04. [2025-09-29T20:03:16.456073] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-29T20:03:17.148109] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-09. [2025-09-29T20:03:17.202657] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-29T20:03:17.948116] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-05. [2025-09-29T20:03:18.427638] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-29T20:03:18.433403] [INFO ] [REMOTE ] MUC: Full fetch complete (30239 records). [2025-09-29T20:03:18.433542] [DEBUG] [VALIDATOR ] MUC: Validating primary data. [2025-09-29T20:03:18.753263] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-05. [2025-09-29T20:03:18.868544] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-29T20:03:18.871568] [DEBUG] [VALIDATOR ] MUC: All expected trading days are present. [2025-09-29T20:03:18.871989] [DEBUG] [VALIDATOR ] MUC: Primary data validation passed. [2025-09-29T20:03:18.872737] [INFO ] [MAIN ] MUC: Fetched primary data is valid. [2025-09-29T20:03:18.872841] [DEBUG] [LOCAL ] MUC: Saving primary data. [2025-09-29T20:03:18.873736] [DEBUG] [LOCAL ] MUC: Trimmed 30239 records to 20497 (keeping 200 days of data) [2025-09-29T20:03:19.009941] [DEBUG] [LOCAL ] MUC: Primary data saved (20497 records). [2025-09-29T20:03:19.010161] [INFO ] [MAIN ] MUC: Full history saved. [2025-09-29T20:03:19.010266] [INFO ] [MAIN ] Update Progress: 1428/2371 symbols completed. MUC took 21.5s. Estimated remaining: 2h 1m 1s. Rate: 7.8 symbols/min [2025-09-29T20:03:19.198436] [INFO ] [MAIN ] MUFG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:03:19.265972] [DEBUG] [LOCAL ] MUFG: Loaded 53341 existing records from primary storage. [2025-09-29T20:03:19.266431] [INFO ] [MAIN ] MUFG: Loaded 53341 existing records. [2025-09-29T20:03:19.458552] [WARN ] [MAIN ] MUFG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:03:19.467171] [INFO ] [MAIN ] MUFG: Wiping existing primary data before full refresh. [2025-09-29T20:03:19.467456] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-29T20:03:19.467674] [INFO ] [LOCAL ] MUFG: Starting deletion of primary data. [2025-09-29T20:03:19.471216] [DEBUG] [LOCAL ] MUFG: Deleted primary data file. [2025-09-29T20:03:19.471290] [INFO ] [MAIN ] MUFG: Starting full primary refresh. [2025-09-29T20:03:19.553216] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-06. [2025-09-29T20:03:19.850138] [INFO ] [REMOTE ] MUFG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:03:20.348094] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-06. [2025-09-29T20:03:20.525053] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-29T20:03:21.148127] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-07. [2025-09-29T20:03:21.804553] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-29T20:03:21.906515] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-29T20:03:21.948153] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-06. [2025-09-29T20:03:22.748169] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-08. [2025-09-29T20:03:22.919779] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-29T20:03:23.412280] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-29T20:03:23.548205] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-07. [2025-09-29T20:03:24.348158] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2024-12. [2025-09-29T20:03:25.148159] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-07. [2025-09-29T20:03:25.196908] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-29T20:03:25.948110] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-09. [2025-09-29T20:03:25.983917] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-29T20:03:26.361111] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-29T20:03:26.748119] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-01. [2025-09-29T20:03:26.885939] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-29T20:03:26.892053] [INFO ] [REMOTE ] MUE: Full fetch complete (16190 records). [2025-09-29T20:03:26.892219] [DEBUG] [VALIDATOR ] MUE: Validating primary data. [2025-09-29T20:03:27.303224] [DEBUG] [VALIDATOR ] MUE: All expected trading days are present. [2025-09-29T20:03:27.303315] [DEBUG] [VALIDATOR ] MUE: Primary data validation passed. [2025-09-29T20:03:27.303725] [INFO ] [MAIN ] MUE: Fetched primary data is valid. [2025-09-29T20:03:27.303797] [DEBUG] [LOCAL ] MUE: Saving primary data. [2025-09-29T20:03:27.305232] [DEBUG] [LOCAL ] MUE: Trimmed 16190 records to 11961 (keeping 200 days of data) [2025-09-29T20:03:27.386842] [DEBUG] [LOCAL ] MUE: Primary data saved (11961 records). [2025-09-29T20:03:27.386999] [INFO ] [MAIN ] MUE: Full history saved. [2025-09-29T20:03:27.387158] [INFO ] [MAIN ] Update Progress: 1429/2371 symbols completed. MUE took 22.7s. Estimated remaining: 2h 0m 54s. Rate: 7.8 symbols/min [2025-09-29T20:03:27.554524] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-08. [2025-09-29T20:03:27.591297] [INFO ] [MAIN ] MUJ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:03:27.610113] [DEBUG] [LOCAL ] MUJ: Loaded 13473 existing records from primary storage. [2025-09-29T20:03:27.610424] [INFO ] [MAIN ] MUJ: Loaded 13473 existing records. [2025-09-29T20:03:27.801494] [WARN ] [MAIN ] MUJ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:03:27.801797] [INFO ] [MAIN ] MUJ: Wiping existing primary data before full refresh. [2025-09-29T20:03:27.801861] [INFO ] [LOCAL ] MUJ: Starting deletion of primary data. [2025-09-29T20:03:27.802119] [DEBUG] [LOCAL ] MUJ: Deleted primary data file. [2025-09-29T20:03:27.802180] [INFO ] [MAIN ] MUJ: Starting full primary refresh. [2025-09-29T20:03:28.181601] [INFO ] [REMOTE ] MUJ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:03:28.348152] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-08. [2025-09-29T20:03:28.404884] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-29T20:03:28.554848] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-29T20:03:29.148122] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2024-12. [2025-09-29T20:03:29.918905] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-29T20:03:29.948090] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-09. [2025-09-29T20:03:30.020154] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-29T20:03:30.748159] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-02. [2025-09-29T20:03:31.548134] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-09. [2025-09-29T20:03:31.640159] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-29T20:03:31.649119] [INFO ] [REMOTE ] MTZ: Full fetch complete (63319 records). [2025-09-29T20:03:31.649268] [DEBUG] [VALIDATOR ] MTZ: Validating primary data. [2025-09-29T20:03:32.068245] [DEBUG] [VALIDATOR ] MTZ: All expected trading days are present. [2025-09-29T20:03:32.068362] [DEBUG] [VALIDATOR ] MTZ: Primary data validation passed. [2025-09-29T20:03:32.069508] [INFO ] [MAIN ] MTZ: Fetched primary data is valid. [2025-09-29T20:03:32.069595] [DEBUG] [LOCAL ] MTZ: Saving primary data. [2025-09-29T20:03:32.071238] [DEBUG] [LOCAL ] MTZ: Trimmed 63319 records to 43082 (keeping 200 days of data) [2025-09-29T20:03:32.233571] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-29T20:03:32.348301] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-01. [2025-09-29T20:03:32.410871] [DEBUG] [LOCAL ] MTZ: Primary data saved (43082 records). [2025-09-29T20:03:32.411036] [INFO ] [MAIN ] MTZ: Full history saved. [2025-09-29T20:03:32.411165] [INFO ] [MAIN ] Update Progress: 1430/2371 symbols completed. MTZ took 54.7s. Estimated remaining: 2h 0m 45s. Rate: 7.8 symbols/min [2025-09-29T20:03:32.538164] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-29T20:03:32.577845] [INFO ] [REMOTE ] MUA: Full fetch complete (18740 records). [2025-09-29T20:03:32.586342] [DEBUG] [VALIDATOR ] MUA: Validating primary data. [2025-09-29T20:03:32.605213] [INFO ] [MAIN ] MUR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:03:33.026688] [DEBUG] [LOCAL ] MUR: Loaded 53705 existing records from primary storage. [2025-09-29T20:03:33.037239] [DEBUG] [VALIDATOR ] MUA: All expected trading days are present. [2025-09-29T20:03:33.037359] [INFO ] [MAIN ] MUR: Loaded 53705 existing records. [2025-09-29T20:03:33.037465] [DEBUG] [VALIDATOR ] MUA: Primary data validation passed. [2025-09-29T20:03:33.071061] [INFO ] [MAIN ] MUA: Fetched primary data is valid. [2025-09-29T20:03:33.082371] [DEBUG] [LOCAL ] MUA: Saving primary data. [2025-09-29T20:03:33.143414] [DEBUG] [LOCAL ] MUA: Trimmed 18740 records to 12245 (keeping 200 days of data) [2025-09-29T20:03:33.149684] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-03. [2025-09-29T20:03:33.286402] [WARN ] [MAIN ] MUR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:03:33.287921] [INFO ] [MAIN ] MUR: Wiping existing primary data before full refresh. [2025-09-29T20:03:33.288632] [INFO ] [LOCAL ] MUR: Starting deletion of primary data. [2025-09-29T20:03:33.289521] [DEBUG] [LOCAL ] MUR: Deleted primary data file. [2025-09-29T20:03:33.290453] [INFO ] [MAIN ] MUR: Starting full primary refresh. [2025-09-29T20:03:33.446496] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-29T20:03:33.712736] [INFO ] [REMOTE ] MUR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:03:33.718235] [DEBUG] [LOCAL ] MUA: Primary data saved (12245 records). [2025-09-29T20:03:33.718323] [INFO ] [MAIN ] MUA: Full history saved. [2025-09-29T20:03:33.718418] [INFO ] [MAIN ] Update Progress: 1431/2371 symbols completed. MUA took 38.7s. Estimated remaining: 2h 0m 33s. Rate: 7.8 symbols/min [2025-09-29T20:03:33.891036] [INFO ] [MAIN ] MUSA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:03:33.921831] [DEBUG] [LOCAL ] MUSA: Loaded 25221 existing records from primary storage. [2025-09-29T20:03:33.922110] [INFO ] [MAIN ] MUSA: Loaded 25221 existing records. [2025-09-29T20:03:33.953178] [INFO ] [REMOTE ] MUR: Fetching primary data for 2024-12. [2025-09-29T20:03:34.108954] [WARN ] [MAIN ] MUSA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:03:34.109148] [INFO ] [MAIN ] MUSA: Wiping existing primary data before full refresh. [2025-09-29T20:03:34.109196] [INFO ] [LOCAL ] MUSA: Starting deletion of primary data. [2025-09-29T20:03:34.109949] [DEBUG] [LOCAL ] MUSA: Deleted primary data file. [2025-09-29T20:03:34.110019] [INFO ] [MAIN ] MUSA: Starting full primary refresh. [2025-09-29T20:03:34.485132] [INFO ] [REMOTE ] MUSA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:03:34.748088] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-02. [2025-09-29T20:03:35.229380] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-29T20:03:35.516359] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-29T20:03:35.548102] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2024-12. [2025-09-29T20:03:35.773630] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-29T20:03:36.348102] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-01. [2025-09-29T20:03:36.441393] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-29T20:03:37.148156] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-04. [2025-09-29T20:03:37.948135] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-01. [2025-09-29T20:03:38.155863] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-29T20:03:38.748163] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-03. [2025-09-29T20:03:39.058168] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-29T20:03:39.084070] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-29T20:03:39.384960] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-29T20:03:39.548144] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-05. [2025-09-29T20:03:40.348160] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-02. [2025-09-29T20:03:41.148127] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-04. [2025-09-29T20:03:41.494382] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-29T20:03:41.948129] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-02. [2025-09-29T20:03:42.080501] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-29T20:03:42.113381] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-29T20:03:42.748146] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-05. [2025-09-29T20:03:43.227324] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-29T20:03:43.548101] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-03. [2025-09-29T20:03:43.586924] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-29T20:03:44.348148] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-06. [2025-09-29T20:03:45.148152] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-06. [2025-09-29T20:03:45.254968] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-29T20:03:45.369062] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-29T20:03:45.948126] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-07. [2025-09-29T20:03:46.748146] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-03. [2025-09-29T20:03:46.846232] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-29T20:03:46.962881] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-29T20:03:47.548124] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-07. [2025-09-29T20:03:47.979905] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-29T20:03:48.348132] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-04. [2025-09-29T20:03:49.046974] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-29T20:03:49.148119] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-04. [2025-09-29T20:03:49.871064] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-29T20:03:49.948131] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-08. [2025-09-29T20:03:50.320482] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-29T20:03:50.748134] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-08. [2025-09-29T20:03:50.953685] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-29T20:03:51.548105] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-09. [2025-09-29T20:03:52.348095] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-05. [2025-09-29T20:03:52.509958] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-29T20:03:52.513557] [INFO ] [REMOTE ] MUJ: Full fetch complete (20288 records). [2025-09-29T20:03:52.513668] [DEBUG] [VALIDATOR ] MUJ: Validating primary data. [2025-09-29T20:03:52.869242] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-29T20:03:52.970325] [DEBUG] [VALIDATOR ] MUJ: All expected trading days are present. [2025-09-29T20:03:52.970411] [DEBUG] [VALIDATOR ] MUJ: Primary data validation passed. [2025-09-29T20:03:52.970916] [INFO ] [MAIN ] MUJ: Fetched primary data is valid. [2025-09-29T20:03:52.970984] [DEBUG] [LOCAL ] MUJ: Saving primary data. [2025-09-29T20:03:52.971686] [DEBUG] [LOCAL ] MUJ: Trimmed 20288 records to 13159 (keeping 200 days of data) [2025-09-29T20:03:53.062359] [DEBUG] [LOCAL ] MUJ: Primary data saved (13159 records). [2025-09-29T20:03:53.062521] [INFO ] [MAIN ] MUJ: Full history saved. [2025-09-29T20:03:53.062627] [INFO ] [MAIN ] Update Progress: 1432/2371 symbols completed. MUJ took 25.7s. Estimated remaining: 2h 0m 33s. Rate: 7.8 symbols/min [2025-09-29T20:03:53.153289] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-05. [2025-09-29T20:03:53.254191] [INFO ] [MAIN ] MUSE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:03:53.254418] [DEBUG] [LOCAL ] MUSE: No existing data file found in primary storage. [2025-09-29T20:03:53.254475] [WARN ] [MAIN ] MUSE: No existing data found, performing full refresh instead. [2025-09-29T20:03:53.254593] [INFO ] [MAIN ] MUSE: Wiping existing primary data before full refresh. [2025-09-29T20:03:53.254635] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-09-29T20:03:53.254724] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-09-29T20:03:53.254808] [INFO ] [MAIN ] MUSE: Starting full primary refresh. [2025-09-29T20:03:53.676797] [INFO ] [REMOTE ] MUSE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:03:53.948387] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-09. [2025-09-29T20:03:54.112919] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-29T20:03:54.585535] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-29T20:03:54.748124] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-06. [2025-09-29T20:03:55.511623] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-29T20:03:55.523148] [INFO ] [REMOTE ] MUFG: Full fetch complete (75483 records). [2025-09-29T20:03:55.523354] [DEBUG] [VALIDATOR ] MUFG: Validating primary data. [2025-09-29T20:03:55.553325] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2024-12. [2025-09-29T20:03:55.899754] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-29T20:03:56.023904] [DEBUG] [VALIDATOR ] MUFG: All expected trading days are present. [2025-09-29T20:03:56.024006] [DEBUG] [VALIDATOR ] MUFG: Primary data validation passed. [2025-09-29T20:03:56.025231] [INFO ] [MAIN ] MUFG: Fetched primary data is valid. [2025-09-29T20:03:56.025305] [DEBUG] [LOCAL ] MUFG: Saving primary data. [2025-09-29T20:03:56.026986] [DEBUG] [LOCAL ] MUFG: Trimmed 75483 records to 52580 (keeping 200 days of data) [2025-09-29T20:03:56.348713] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-01. [2025-09-29T20:03:56.530831] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-29T20:03:56.570355] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T20:03:56.570780] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-01 [2025-09-29T20:03:56.570942] [FATAL] [REMOTE ] MUSE: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T20:03:56.571023] [FATAL] [MAIN ] MUSE: Failed to fetch primary data. [2025-09-29T20:03:56.571067] [WARN ] [MAIN ] MUSE: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T20:03:56.571109] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-09-29T20:03:56.571175] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-09-29T20:03:56.571218] [INFO ] [LOCAL ] MUSE: Starting deletion of derivative data. [2025-09-29T20:03:56.571290] [DEBUG] [LOCAL ] MUSE: No derivative data file found to delete. [2025-09-29T20:03:56.571392] [INFO ] [MAIN ] Update Progress: 1433/2371 symbols completed. MUSE took 3.5s. Estimated remaining: 2h 0m 22s. Rate: 7.8 symbols/min [2025-09-29T20:03:56.717131] [DEBUG] [LOCAL ] MUFG: Primary data saved (52580 records). [2025-09-29T20:03:56.729399] [INFO ] [MAIN ] MUFG: Full history saved. [2025-09-29T20:03:56.747722] [INFO ] [MAIN ] Update Progress: 1434/2371 symbols completed. MUFG took 37.7s. Estimated remaining: 2h 0m 10s. Rate: 7.8 symbols/min [2025-09-29T20:03:57.034928] [INFO ] [MAIN ] MUX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:03:57.154709] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-07. [2025-09-29T20:03:57.159637] [INFO ] [MAIN ] MVF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:03:57.197758] [DEBUG] [LOCAL ] MUX: Loaded 43253 existing records from primary storage. [2025-09-29T20:03:57.198363] [INFO ] [MAIN ] MUX: Loaded 43253 existing records. [2025-09-29T20:03:57.278999] [DEBUG] [LOCAL ] MVF: Loaded 12921 existing records from primary storage. [2025-09-29T20:03:57.302349] [INFO ] [MAIN ] MVF: Loaded 12921 existing records. [2025-09-29T20:03:57.546911] [WARN ] [MAIN ] MUX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:03:57.582299] [INFO ] [MAIN ] MUX: Wiping existing primary data before full refresh. [2025-09-29T20:03:57.604560] [INFO ] [LOCAL ] MUX: Starting deletion of primary data. [2025-09-29T20:03:57.604440] [WARN ] [MAIN ] MVF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:03:57.604836] [INFO ] [MAIN ] MVF: Wiping existing primary data before full refresh. [2025-09-29T20:03:57.604883] [INFO ] [LOCAL ] MVF: Starting deletion of primary data. [2025-09-29T20:03:57.605114] [DEBUG] [LOCAL ] MVF: Deleted primary data file. [2025-09-29T20:03:57.605254] [INFO ] [MAIN ] MVF: Starting full primary refresh. [2025-09-29T20:03:57.605181] [DEBUG] [LOCAL ] MUX: Deleted primary data file. [2025-09-29T20:03:57.605398] [INFO ] [MAIN ] MUX: Starting full primary refresh. [2025-09-29T20:03:57.949259] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-06. [2025-09-29T20:03:58.456104] [INFO ] [REMOTE ] MUX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:03:58.471232] [INFO ] [REMOTE ] MVF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:03:58.634977] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-29T20:03:58.748157] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-08. [2025-09-29T20:03:59.228781] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-29T20:03:59.548164] [INFO ] [REMOTE ] MVF: Fetching primary data for 2024-12. [2025-09-29T20:04:00.348134] [INFO ] [REMOTE ] MUX: Fetching primary data for 2024-12. [2025-09-29T20:04:00.409171] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-29T20:04:00.587811] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-29T20:04:01.148170] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-09. [2025-09-29T20:04:01.879039] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-29T20:04:01.948173] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-01. [2025-09-29T20:04:02.748092] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-07. [2025-09-29T20:04:03.007382] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-29T20:04:03.019247] [INFO ] [REMOTE ] MUR: Full fetch complete (76448 records). [2025-09-29T20:04:03.019416] [DEBUG] [VALIDATOR ] MUR: Validating primary data. [2025-09-29T20:04:03.462812] [DEBUG] [VALIDATOR ] MUR: All expected trading days are present. [2025-09-29T20:04:03.462977] [DEBUG] [VALIDATOR ] MUR: Primary data validation passed. [2025-09-29T20:04:03.464253] [INFO ] [MAIN ] MUR: Fetched primary data is valid. [2025-09-29T20:04:03.466922] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-29T20:04:03.465244] [DEBUG] [LOCAL ] MUR: Saving primary data. [2025-09-29T20:04:03.479508] [DEBUG] [LOCAL ] MUR: Trimmed 76448 records to 52928 (keeping 200 days of data) [2025-09-29T20:04:03.569752] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-01. [2025-09-29T20:04:03.838196] [DEBUG] [LOCAL ] MUR: Primary data saved (52928 records). [2025-09-29T20:04:03.838415] [INFO ] [MAIN ] MUR: Full history saved. [2025-09-29T20:04:03.838555] [INFO ] [MAIN ] Update Progress: 1435/2371 symbols completed. MUR took 31.4s. Estimated remaining: 2h 0m 2s. Rate: 7.8 symbols/min [2025-09-29T20:04:04.046606] [INFO ] [MAIN ] MVO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:04:04.073003] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-29T20:04:04.086088] [DEBUG] [LOCAL ] MVO: Loaded 9140 existing records from primary storage. [2025-09-29T20:04:04.086455] [INFO ] [MAIN ] MVO: Loaded 9140 existing records. [2025-09-29T20:04:04.301266] [WARN ] [MAIN ] MVO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:04:04.301635] [INFO ] [MAIN ] MVO: Wiping existing primary data before full refresh. [2025-09-29T20:04:04.301729] [INFO ] [LOCAL ] MVO: Starting deletion of primary data. [2025-09-29T20:04:04.302184] [DEBUG] [LOCAL ] MVO: Deleted primary data file. [2025-09-29T20:04:04.302261] [INFO ] [MAIN ] MVO: Starting full primary refresh. [2025-09-29T20:04:04.358732] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-08. [2025-09-29T20:04:04.466319] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-29T20:04:04.699588] [INFO ] [REMOTE ] MVO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:04:05.148128] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-02. [2025-09-29T20:04:05.567106] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-29T20:04:05.948149] [INFO ] [REMOTE ] MVO: Fetching primary data for 2024-12. [2025-09-29T20:04:05.966962] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-29T20:04:06.735045] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-29T20:04:06.748113] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-09. [2025-09-29T20:04:07.548170] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-01. [2025-09-29T20:04:08.083753] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-29T20:04:08.089140] [INFO ] [REMOTE ] MUSA: Full fetch complete (35112 records). [2025-09-29T20:04:08.089262] [DEBUG] [VALIDATOR ] MUSA: Validating primary data. [2025-09-29T20:04:08.350129] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-02. [2025-09-29T20:04:08.500881] [DEBUG] [VALIDATOR ] MUSA: All expected trading days are present. [2025-09-29T20:04:08.501047] [DEBUG] [VALIDATOR ] MUSA: Primary data validation passed. [2025-09-29T20:04:08.502119] [INFO ] [MAIN ] MUSA: Fetched primary data is valid. [2025-09-29T20:04:08.502224] [DEBUG] [LOCAL ] MUSA: Saving primary data. [2025-09-29T20:04:08.503433] [DEBUG] [LOCAL ] MUSA: Trimmed 35112 records to 24753 (keeping 200 days of data) [2025-09-29T20:04:08.635719] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-29T20:04:08.715729] [DEBUG] [LOCAL ] MUSA: Primary data saved (24753 records). [2025-09-29T20:04:08.715904] [INFO ] [MAIN ] MUSA: Full history saved. [2025-09-29T20:04:08.716013] [INFO ] [MAIN ] Update Progress: 1436/2371 symbols completed. MUSA took 35.0s. Estimated remaining: 1h 59m 52s. Rate: 7.8 symbols/min [2025-09-29T20:04:08.903196] [INFO ] [MAIN ] MVT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:04:08.915790] [DEBUG] [LOCAL ] MVT: Loaded 10355 existing records from primary storage. [2025-09-29T20:04:08.916015] [INFO ] [MAIN ] MVT: Loaded 10355 existing records. [2025-09-29T20:04:09.107002] [WARN ] [MAIN ] MVT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:04:09.107271] [INFO ] [MAIN ] MVT: Wiping existing primary data before full refresh. [2025-09-29T20:04:09.107328] [INFO ] [LOCAL ] MVT: Starting deletion of primary data. [2025-09-29T20:04:09.107521] [DEBUG] [LOCAL ] MVT: Deleted primary data file. [2025-09-29T20:04:09.107581] [INFO ] [MAIN ] MVT: Starting full primary refresh. [2025-09-29T20:04:09.153224] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-02. [2025-09-29T20:04:09.487916] [INFO ] [REMOTE ] MVT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:04:09.867770] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-29T20:04:09.948097] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-03. [2025-09-29T20:04:10.021028] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-29T20:04:10.748152] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-03. [2025-09-29T20:04:11.515551] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-29T20:04:11.548092] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-04. [2025-09-29T20:04:11.674439] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-29T20:04:12.348296] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-04. [2025-09-29T20:04:13.095566] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-29T20:04:13.137147] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-29T20:04:13.148133] [INFO ] [REMOTE ] MVT: Fetching primary data for 2024-12. [2025-09-29T20:04:13.948117] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-05. [2025-09-29T20:04:14.143378] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-29T20:04:14.748129] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-05. [2025-09-29T20:04:15.468612] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-29T20:04:15.489850] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-29T20:04:15.548148] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-06. [2025-09-29T20:04:16.348124] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-03. [2025-09-29T20:04:16.488777] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-29T20:04:17.148089] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-01. [2025-09-29T20:04:17.300928] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-29T20:04:17.930519] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-29T20:04:17.948109] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-02. [2025-09-29T20:04:18.643632] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-29T20:04:18.748118] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-03. [2025-09-29T20:04:19.548156] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-04. [2025-09-29T20:04:19.649425] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-29T20:04:20.333806] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-29T20:04:20.348108] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-07. [2025-09-29T20:04:21.148126] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-05. [2025-09-29T20:04:21.266294] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-29T20:04:21.861674] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-29T20:04:21.948136] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-06. [2025-09-29T20:04:22.748173] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-04. [2025-09-29T20:04:23.475877] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-29T20:04:23.548125] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-08. [2025-09-29T20:04:23.638060] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-29T20:04:24.348199] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-07. [2025-09-29T20:04:24.373741] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-29T20:04:25.148154] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-05. [2025-09-29T20:04:25.914781] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-29T20:04:25.948069] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-08. [2025-09-29T20:04:25.976196] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-29T20:04:26.748131] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-06. [2025-09-29T20:04:27.552875] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-09. [2025-09-29T20:04:27.559441] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-29T20:04:27.754353] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-29T20:04:28.348124] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-09. [2025-09-29T20:04:28.591180] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-29T20:04:28.594898] [INFO ] [REMOTE ] MVF: Full fetch complete (19135 records). [2025-09-29T20:04:28.595013] [DEBUG] [VALIDATOR ] MVF: Validating primary data. [2025-09-29T20:04:28.985288] [DEBUG] [VALIDATOR ] MVF: All expected trading days are present. [2025-09-29T20:04:28.985370] [DEBUG] [VALIDATOR ] MVF: Primary data validation passed. [2025-09-29T20:04:28.985848] [INFO ] [MAIN ] MVF: Fetched primary data is valid. [2025-09-29T20:04:28.985911] [DEBUG] [LOCAL ] MVF: Saving primary data. [2025-09-29T20:04:28.986621] [DEBUG] [LOCAL ] MVF: Trimmed 19135 records to 12865 (keeping 200 days of data) [2025-09-29T20:04:29.066013] [DEBUG] [LOCAL ] MVF: Primary data saved (12865 records). [2025-09-29T20:04:29.066157] [INFO ] [MAIN ] MVF: Full history saved. [2025-09-29T20:04:29.066255] [INFO ] [MAIN ] Update Progress: 1437/2371 symbols completed. MVF took 32.3s. Estimated remaining: 1h 59m 53s. Rate: 7.8 symbols/min [2025-09-29T20:04:29.148143] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-06. [2025-09-29T20:04:29.926624] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-29T20:04:29.948119] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-07. [2025-09-29T20:04:30.280960] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-29T20:04:30.294634] [INFO ] [REMOTE ] MUX: Full fetch complete (59067 records). [2025-09-29T20:04:30.294912] [DEBUG] [VALIDATOR ] MUX: Validating primary data. [2025-09-29T20:04:30.725585] [DEBUG] [VALIDATOR ] MUX: All expected trading days are present. [2025-09-29T20:04:30.725721] [DEBUG] [VALIDATOR ] MUX: Primary data validation passed. [2025-09-29T20:04:30.726773] [INFO ] [MAIN ] MUX: Fetched primary data is valid. [2025-09-29T20:04:30.726838] [DEBUG] [LOCAL ] MUX: Saving primary data. [2025-09-29T20:04:30.728217] [DEBUG] [LOCAL ] MUX: Trimmed 59067 records to 42714 (keeping 200 days of data) [2025-09-29T20:04:30.779807] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-07. [2025-09-29T20:04:30.864297] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-29T20:04:31.007587] [DEBUG] [LOCAL ] MUX: Primary data saved (42714 records). [2025-09-29T20:04:31.007758] [INFO ] [MAIN ] MUX: Full history saved. [2025-09-29T20:04:31.007867] [INFO ] [MAIN ] Update Progress: 1438/2371 symbols completed. MUX took 34.4s. Estimated remaining: 1h 59m 41s. Rate: 7.8 symbols/min [2025-09-29T20:04:31.543028] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-29T20:04:31.548071] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-08. [2025-09-29T20:04:32.289636] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-29T20:04:32.348102] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-09. [2025-09-29T20:04:33.148110] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-08. [2025-09-29T20:04:33.296843] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-29T20:04:33.299778] [INFO ] [REMOTE ] MVT: Full fetch complete (14680 records). [2025-09-29T20:04:33.299866] [DEBUG] [VALIDATOR ] MVT: Validating primary data. [2025-09-29T20:04:33.704430] [DEBUG] [VALIDATOR ] MVT: All expected trading days are present. [2025-09-29T20:04:33.704542] [DEBUG] [VALIDATOR ] MVT: Primary data validation passed. [2025-09-29T20:04:33.704984] [INFO ] [MAIN ] MVT: Fetched primary data is valid. [2025-09-29T20:04:33.705048] [DEBUG] [LOCAL ] MVT: Saving primary data. [2025-09-29T20:04:33.705567] [DEBUG] [LOCAL ] MVT: Trimmed 14680 records to 10243 (keeping 200 days of data) [2025-09-29T20:04:33.771411] [DEBUG] [LOCAL ] MVT: Primary data saved (10243 records). [2025-09-29T20:04:33.771558] [INFO ] [MAIN ] MVT: Full history saved. [2025-09-29T20:04:33.771667] [INFO ] [MAIN ] Update Progress: 1439/2371 symbols completed. MVT took 25.1s. Estimated remaining: 1h 59m 30s. Rate: 7.8 symbols/min [2025-09-29T20:04:33.869471] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-29T20:04:33.948146] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-09. [2025-09-29T20:04:34.683561] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-29T20:04:34.685887] [INFO ] [REMOTE ] MVO: Full fetch complete (14423 records). [2025-09-29T20:04:34.685965] [DEBUG] [VALIDATOR ] MVO: Validating primary data. [2025-09-29T20:04:35.087673] [DEBUG] [VALIDATOR ] MVO: All expected trading days are present. [2025-09-29T20:04:35.087777] [DEBUG] [VALIDATOR ] MVO: Primary data validation passed. [2025-09-29T20:04:35.088111] [INFO ] [MAIN ] MVO: Fetched primary data is valid. [2025-09-29T20:04:35.088179] [DEBUG] [LOCAL ] MVO: Saving primary data. [2025-09-29T20:04:35.088788] [DEBUG] [LOCAL ] MVO: Trimmed 14423 records to 9024 (keeping 200 days of data) [2025-09-29T20:04:35.146754] [DEBUG] [LOCAL ] MVO: Primary data saved (9024 records). [2025-09-29T20:04:35.146909] [INFO ] [MAIN ] MVO: Full history saved. [2025-09-29T20:04:35.147007] [INFO ] [MAIN ] Update Progress: 1440/2371 symbols completed. MVO took 31.3s. Estimated remaining: 1h 59m 19s. Rate: 7.8 symbols/min [2025-09-29T20:04:35.760043] [INFO ] [MAIN ] MWA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:04:35.854117] [INFO ] [MAIN ] MXE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:04:35.908494] [INFO ] [MAIN ] MX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:04:35.905609] [DEBUG] [LOCAL ] MXE: No existing data file found in primary storage. [2025-09-29T20:04:35.892728] [INFO ] [MAIN ] MXF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:04:35.908754] [WARN ] [MAIN ] MXE: No existing data found, performing full refresh instead. [2025-09-29T20:04:35.909708] [INFO ] [MAIN ] MXE: Wiping existing primary data before full refresh. [2025-09-29T20:04:35.909795] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-09-29T20:04:35.909884] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-09-29T20:04:35.909964] [INFO ] [MAIN ] MXE: Starting full primary refresh. [2025-09-29T20:04:35.998134] [DEBUG] [LOCAL ] MXF: Loaded 5984 existing records from primary storage. [2025-09-29T20:04:36.039177] [INFO ] [MAIN ] MXF: Loaded 5984 existing records. [2025-09-29T20:04:36.087142] [DEBUG] [LOCAL ] MX: Loaded 23379 existing records from primary storage. [2025-09-29T20:04:36.158778] [INFO ] [MAIN ] MX: Loaded 23379 existing records. [2025-09-29T20:04:36.473204] [DEBUG] [LOCAL ] MWA: Loaded 47633 existing records from primary storage. [2025-09-29T20:04:36.553433] [INFO ] [MAIN ] MWA: Loaded 47633 existing records. [2025-09-29T20:04:36.783631] [INFO ] [REMOTE ] MXE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:04:36.838970] [WARN ] [MAIN ] MXF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:04:36.888784] [INFO ] [MAIN ] MXF: Wiping existing primary data before full refresh. [2025-09-29T20:04:36.878070] [INFO ] [REMOTE ] MXE: Fetching primary data for 2024-12. [2025-09-29T20:04:36.877481] [WARN ] [MAIN ] MX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:04:36.901935] [INFO ] [LOCAL ] MXF: Starting deletion of primary data. [2025-09-29T20:04:36.906776] [INFO ] [MAIN ] MX: Wiping existing primary data before full refresh. [2025-09-29T20:04:36.912466] [DEBUG] [LOCAL ] MXF: Deleted primary data file. [2025-09-29T20:04:36.918045] [INFO ] [MAIN ] MXF: Starting full primary refresh. [2025-09-29T20:04:36.918165] [INFO ] [LOCAL ] MX: Starting deletion of primary data. [2025-09-29T20:04:36.978287] [DEBUG] [LOCAL ] MX: Deleted primary data file. [2025-09-29T20:04:37.039058] [WARN ] [MAIN ] MWA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:04:37.039173] [INFO ] [MAIN ] MX: Starting full primary refresh. [2025-09-29T20:04:37.066335] [INFO ] [MAIN ] MWA: Wiping existing primary data before full refresh. [2025-09-29T20:04:37.146517] [INFO ] [LOCAL ] MWA: Starting deletion of primary data. [2025-09-29T20:04:37.201322] [DEBUG] [LOCAL ] MWA: Deleted primary data file. [2025-09-29T20:04:37.260202] [INFO ] [MAIN ] MWA: Starting full primary refresh. [2025-09-29T20:04:37.480790] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-29T20:04:37.516304] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-01. [2025-09-29T20:04:37.954281] [INFO ] [REMOTE ] MXF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:04:38.001125] [INFO ] [REMOTE ] MXF: Fetching primary data for 2024-12. [2025-09-29T20:04:38.117987] [INFO ] [REMOTE ] MX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:04:38.159809] [INFO ] [REMOTE ] MX: Fetching primary data for 2024-12. [2025-09-29T20:04:38.250075] [INFO ] [REMOTE ] MWA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:04:38.253203] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-29T20:04:38.254563] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-02. [2025-09-29T20:04:38.694959] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-29T20:04:38.748128] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-03. [2025-09-29T20:04:38.914497] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-29T20:04:39.054555] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-29T20:04:39.073866] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-29T20:04:39.548122] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-01. [2025-09-29T20:04:40.261164] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-29T20:04:40.348114] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-01. [2025-09-29T20:04:41.148148] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-02. [2025-09-29T20:04:41.170574] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-29T20:04:41.948128] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-02. [2025-09-29T20:04:42.215130] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-29T20:04:42.706193] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-29T20:04:42.748113] [INFO ] [REMOTE ] MWA: Fetching primary data for 2024-12. [2025-09-29T20:04:43.548151] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-03. [2025-09-29T20:04:44.276368] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-29T20:04:44.348108] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-01. [2025-09-29T20:04:44.747436] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-29T20:04:45.148178] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-03. [2025-09-29T20:04:45.948113] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-04. [2025-09-29T20:04:46.015853] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-29T20:04:46.078872] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-29T20:04:46.319444] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-29T20:04:46.748135] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-04. [2025-09-29T20:04:47.548126] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-04. [2025-09-29T20:04:47.995474] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-29T20:04:48.326929] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-29T20:04:48.348080] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-05. [2025-09-29T20:04:49.148096] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-05. [2025-09-29T20:04:49.296274] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-29T20:04:49.504325] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-29T20:04:49.948107] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-06. [2025-09-29T20:04:50.551371] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-29T20:04:50.748111] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-05. [2025-09-29T20:04:51.548105] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-07. [2025-09-29T20:04:51.924866] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-29T20:04:52.062152] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-29T20:04:52.348131] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-08. [2025-09-29T20:04:52.906103] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-29T20:04:53.148153] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-09. [2025-09-29T20:04:53.909615] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-29T20:04:53.910701] [INFO ] [REMOTE ] MXE: Full fetch complete (2666 records). [2025-09-29T20:04:53.910772] [DEBUG] [VALIDATOR ] MXE: Validating primary data. [2025-09-29T20:04:53.953376] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-02. [2025-09-29T20:04:54.131763] [WARN ] [VALIDATOR ] MXE: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-29T20:04:54.132012] [FATAL] [MAIN ] MXE: Fetched primary data is invalid. Refusing to save it. [2025-09-29T20:04:54.132082] [WARN ] [MAIN ] MXE: Deleting existing primary and derivative data due to validation failure. [2025-09-29T20:04:54.132155] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-09-29T20:04:54.132247] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-09-29T20:04:54.132300] [INFO ] [LOCAL ] MXE: Starting deletion of derivative data. [2025-09-29T20:04:54.132369] [DEBUG] [LOCAL ] MXE: No derivative data file found to delete. [2025-09-29T20:04:54.132475] [INFO ] [MAIN ] Update Progress: 1441/2371 symbols completed. MXE took 19.0s. Estimated remaining: 1h 59m 18s. Rate: 7.8 symbols/min [2025-09-29T20:04:54.313061] [INFO ] [MAIN ] MYD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:04:54.332392] [DEBUG] [LOCAL ] MYD: Loaded 13946 existing records from primary storage. [2025-09-29T20:04:54.332727] [INFO ] [MAIN ] MYD: Loaded 13946 existing records. [2025-09-29T20:04:54.521233] [WARN ] [MAIN ] MYD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:04:54.521472] [INFO ] [MAIN ] MYD: Wiping existing primary data before full refresh. [2025-09-29T20:04:54.521522] [INFO ] [LOCAL ] MYD: Starting deletion of primary data. [2025-09-29T20:04:54.521815] [DEBUG] [LOCAL ] MYD: Deleted primary data file. [2025-09-29T20:04:54.521878] [INFO ] [MAIN ] MYD: Starting full primary refresh. [2025-09-29T20:04:54.756356] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-06. [2025-09-29T20:04:54.902233] [INFO ] [REMOTE ] MYD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:04:55.548131] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-06. [2025-09-29T20:04:55.932728] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-29T20:04:55.979063] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-29T20:04:56.202608] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-29T20:04:56.348131] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-07. [2025-09-29T20:04:57.148141] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-03. [2025-09-29T20:04:57.393420] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-29T20:04:57.948148] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-07. [2025-09-29T20:04:58.554791] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-29T20:04:58.748087] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-08. [2025-09-29T20:04:59.071227] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-29T20:04:59.231887] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-29T20:04:59.548152] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-04. [2025-09-29T20:05:00.348115] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-08. [2025-09-29T20:05:01.148084] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-09. [2025-09-29T20:05:01.494076] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-29T20:05:01.564335] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-29T20:05:01.728096] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-29T20:05:01.729330] [INFO ] [REMOTE ] MXF: Full fetch complete (10299 records). [2025-09-29T20:05:01.729405] [DEBUG] [VALIDATOR ] MXF: Validating primary data. [2025-09-29T20:05:01.953685] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-09. [2025-09-29T20:05:02.150444] [DEBUG] [VALIDATOR ] MXF: All expected trading days are present. [2025-09-29T20:05:02.150536] [DEBUG] [VALIDATOR ] MXF: Primary data validation passed. [2025-09-29T20:05:02.150841] [INFO ] [MAIN ] MXF: Fetched primary data is valid. [2025-09-29T20:05:02.150905] [DEBUG] [LOCAL ] MXF: Saving primary data. [2025-09-29T20:05:02.151413] [DEBUG] [LOCAL ] MXF: Trimmed 10299 records to 5828 (keeping 200 days of data) [2025-09-29T20:05:02.195596] [DEBUG] [LOCAL ] MXF: Primary data saved (5828 records). [2025-09-29T20:05:02.195864] [INFO ] [MAIN ] MXF: Full history saved. [2025-09-29T20:05:02.195971] [INFO ] [MAIN ] Update Progress: 1442/2371 symbols completed. MXF took 27.0s. Estimated remaining: 1h 59m 11s. Rate: 7.8 symbols/min [2025-09-29T20:05:02.374924] [INFO ] [MAIN ] MYE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:05:02.409669] [DEBUG] [LOCAL ] MYE: Loaded 25346 existing records from primary storage. [2025-09-29T20:05:02.409950] [INFO ] [MAIN ] MYE: Loaded 25346 existing records. [2025-09-29T20:05:02.602438] [WARN ] [MAIN ] MYE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:05:02.602713] [INFO ] [MAIN ] MYE: Wiping existing primary data before full refresh. [2025-09-29T20:05:02.602854] [INFO ] [LOCAL ] MYE: Starting deletion of primary data. [2025-09-29T20:05:02.603351] [DEBUG] [LOCAL ] MYE: Deleted primary data file. [2025-09-29T20:05:02.603415] [INFO ] [MAIN ] MYE: Starting full primary refresh. [2025-09-29T20:05:02.753236] [INFO ] [REMOTE ] MYD: Fetching primary data for 2024-12. [2025-09-29T20:05:03.068041] [INFO ] [REMOTE ] MYE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:05:03.357371] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-29T20:05:03.363104] [INFO ] [REMOTE ] MX: Full fetch complete (31872 records). [2025-09-29T20:05:03.363279] [DEBUG] [VALIDATOR ] MX: Validating primary data. [2025-09-29T20:05:03.553291] [INFO ] [REMOTE ] MYE: Fetching primary data for 2024-12. [2025-09-29T20:05:03.777618] [DEBUG] [VALIDATOR ] MX: All expected trading days are present. [2025-09-29T20:05:03.777751] [DEBUG] [VALIDATOR ] MX: Primary data validation passed. [2025-09-29T20:05:03.778444] [INFO ] [MAIN ] MX: Fetched primary data is valid. [2025-09-29T20:05:03.778507] [DEBUG] [LOCAL ] MX: Saving primary data. [2025-09-29T20:05:03.779302] [DEBUG] [LOCAL ] MX: Trimmed 31872 records to 22922 (keeping 200 days of data) [2025-09-29T20:05:03.922995] [DEBUG] [LOCAL ] MX: Primary data saved (22922 records). [2025-09-29T20:05:03.923128] [INFO ] [MAIN ] MX: Full history saved. [2025-09-29T20:05:03.923217] [INFO ] [MAIN ] Update Progress: 1443/2371 symbols completed. MX took 28.8s. Estimated remaining: 1h 58m 59s. Rate: 7.8 symbols/min [2025-09-29T20:05:04.067423] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-29T20:05:04.124937] [INFO ] [MAIN ] MYI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:05:04.148137] [DEBUG] [LOCAL ] MYI: Loaded 19636 existing records from primary storage. [2025-09-29T20:05:04.148403] [INFO ] [MAIN ] MYI: Loaded 19636 existing records. [2025-09-29T20:05:04.352097] [WARN ] [MAIN ] MYI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:05:04.352230] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-01. [2025-09-29T20:05:04.353774] [INFO ] [MAIN ] MYI: Wiping existing primary data before full refresh. [2025-09-29T20:05:04.353839] [INFO ] [LOCAL ] MYI: Starting deletion of primary data. [2025-09-29T20:05:04.354141] [DEBUG] [LOCAL ] MYI: Deleted primary data file. [2025-09-29T20:05:04.354202] [INFO ] [MAIN ] MYI: Starting full primary refresh. [2025-09-29T20:05:04.740818] [INFO ] [REMOTE ] MYI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:05:04.934533] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-29T20:05:05.148159] [INFO ] [REMOTE ] MYI: Fetching primary data for 2024-12. [2025-09-29T20:05:05.255788] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-29T20:05:05.948139] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-02. [2025-09-29T20:05:06.429113] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-29T20:05:06.748138] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-05. [2025-09-29T20:05:06.856902] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-29T20:05:07.548151] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-01. [2025-09-29T20:05:08.348146] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-03. [2025-09-29T20:05:08.494216] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-29T20:05:08.553617] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-29T20:05:09.148148] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-01. [2025-09-29T20:05:09.353228] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-29T20:05:09.948089] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-06. [2025-09-29T20:05:10.343398] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-29T20:05:10.748136] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-02. [2025-09-29T20:05:11.548120] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-02. [2025-09-29T20:05:11.614082] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-29T20:05:11.651429] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-29T20:05:12.348125] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-03. [2025-09-29T20:05:12.635372] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-29T20:05:13.148140] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-07. [2025-09-29T20:05:13.192034] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-29T20:05:13.948109] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-04. [2025-09-29T20:05:14.520633] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-29T20:05:14.671899] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-29T20:05:14.748162] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-04. [2025-09-29T20:05:15.548162] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-05. [2025-09-29T20:05:15.885165] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-29T20:05:16.348124] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-03. [2025-09-29T20:05:16.495507] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-29T20:05:17.148133] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-05. [2025-09-29T20:05:17.657507] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-29T20:05:17.948103] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-08. [2025-09-29T20:05:18.072369] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-29T20:05:18.748120] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-06. [2025-09-29T20:05:19.497416] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-29T20:05:19.548539] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-04. [2025-09-29T20:05:19.550403] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-29T20:05:20.348133] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-06. [2025-09-29T20:05:20.940091] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-29T20:05:21.148096] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-07. [2025-09-29T20:05:21.158123] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-29T20:05:21.948152] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-09. [2025-09-29T20:05:22.233741] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-29T20:05:22.748155] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-05. [2025-09-29T20:05:23.548189] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-07. [2025-09-29T20:05:23.678299] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-29T20:05:23.687806] [INFO ] [REMOTE ] MWA: Full fetch complete (67748 records). [2025-09-29T20:05:23.687978] [DEBUG] [VALIDATOR ] MWA: Validating primary data. [2025-09-29T20:05:24.134715] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-29T20:05:24.163690] [DEBUG] [VALIDATOR ] MWA: All expected trading days are present. [2025-09-29T20:05:24.164120] [DEBUG] [VALIDATOR ] MWA: Primary data validation passed. [2025-09-29T20:05:24.165143] [INFO ] [MAIN ] MWA: Fetched primary data is valid. [2025-09-29T20:05:24.165207] [DEBUG] [LOCAL ] MWA: Saving primary data. [2025-09-29T20:05:24.166550] [DEBUG] [LOCAL ] MWA: Trimmed 67748 records to 46764 (keeping 200 days of data) [2025-09-29T20:05:24.357560] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-06. [2025-09-29T20:05:24.408702] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-29T20:05:24.494045] [DEBUG] [LOCAL ] MWA: Primary data saved (46764 records). [2025-09-29T20:05:24.494188] [INFO ] [MAIN ] MWA: Full history saved. [2025-09-29T20:05:24.494286] [INFO ] [MAIN ] Update Progress: 1444/2371 symbols completed. MWA took 49.3s. Estimated remaining: 1h 58m 60s. Rate: 7.8 symbols/min [2025-09-29T20:05:24.673735] [INFO ] [MAIN ] MYN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:05:24.686396] [DEBUG] [LOCAL ] MYN: Loaded 10324 existing records from primary storage. [2025-09-29T20:05:24.686695] [INFO ] [MAIN ] MYN: Loaded 10324 existing records. [2025-09-29T20:05:24.877350] [WARN ] [MAIN ] MYN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:05:24.877561] [INFO ] [MAIN ] MYN: Wiping existing primary data before full refresh. [2025-09-29T20:05:24.877610] [INFO ] [LOCAL ] MYN: Starting deletion of primary data. [2025-09-29T20:05:24.877858] [DEBUG] [LOCAL ] MYN: Deleted primary data file. [2025-09-29T20:05:24.877918] [INFO ] [MAIN ] MYN: Starting full primary refresh. [2025-09-29T20:05:25.153201] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-08. [2025-09-29T20:05:25.245498] [INFO ] [REMOTE ] MYN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:05:25.633018] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-29T20:05:25.948147] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-07. [2025-09-29T20:05:25.970731] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-29T20:05:26.748144] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-09. [2025-09-29T20:05:27.060011] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-29T20:05:27.488085] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-29T20:05:27.492992] [INFO ] [REMOTE ] MYD: Full fetch complete (20803 records). [2025-09-29T20:05:27.493165] [DEBUG] [VALIDATOR ] MYD: Validating primary data. [2025-09-29T20:05:27.553286] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-08. [2025-09-29T20:05:27.930935] [DEBUG] [VALIDATOR ] MYD: All expected trading days are present. [2025-09-29T20:05:27.931016] [DEBUG] [VALIDATOR ] MYD: Primary data validation passed. [2025-09-29T20:05:27.931548] [INFO ] [MAIN ] MYD: Fetched primary data is valid. [2025-09-29T20:05:27.931598] [DEBUG] [LOCAL ] MYD: Saving primary data. [2025-09-29T20:05:27.932223] [DEBUG] [LOCAL ] MYD: Trimmed 20803 records to 13769 (keeping 200 days of data) [2025-09-29T20:05:28.023720] [DEBUG] [LOCAL ] MYD: Primary data saved (13769 records). [2025-09-29T20:05:28.023877] [INFO ] [MAIN ] MYD: Full history saved. [2025-09-29T20:05:28.023966] [INFO ] [MAIN ] Update Progress: 1445/2371 symbols completed. MYD took 33.9s. Estimated remaining: 1h 58m 49s. Rate: 7.8 symbols/min [2025-09-29T20:05:28.201415] [INFO ] [MAIN ] NABL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:05:28.240316] [DEBUG] [LOCAL ] NABL: Loaded 40294 existing records from primary storage. [2025-09-29T20:05:28.240712] [INFO ] [MAIN ] NABL: Loaded 40294 existing records. [2025-09-29T20:05:28.356846] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-08. [2025-09-29T20:05:28.445064] [WARN ] [MAIN ] NABL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:05:28.445381] [INFO ] [MAIN ] NABL: Wiping existing primary data before full refresh. [2025-09-29T20:05:28.445457] [INFO ] [LOCAL ] NABL: Starting deletion of primary data. [2025-09-29T20:05:28.445911] [DEBUG] [LOCAL ] NABL: Deleted primary data file. [2025-09-29T20:05:28.445973] [INFO ] [MAIN ] NABL: Starting full primary refresh. [2025-09-29T20:05:28.823581] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-29T20:05:28.870618] [INFO ] [REMOTE ] NABL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:05:29.148131] [INFO ] [REMOTE ] NABL: Fetching primary data for 2024-12. [2025-09-29T20:05:29.423531] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-29T20:05:29.948150] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-09. [2025-09-29T20:05:30.446580] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-29T20:05:30.748125] [INFO ] [REMOTE ] MYN: Fetching primary data for 2024-12. [2025-09-29T20:05:31.090601] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-29T20:05:31.095671] [INFO ] [REMOTE ] MYE: Full fetch complete (36635 records). [2025-09-29T20:05:31.095827] [DEBUG] [VALIDATOR ] MYE: Validating primary data. [2025-09-29T20:05:31.484832] [DEBUG] [VALIDATOR ] MYE: All expected trading days are present. [2025-09-29T20:05:31.484927] [DEBUG] [VALIDATOR ] MYE: Primary data validation passed. [2025-09-29T20:05:31.485734] [INFO ] [MAIN ] MYE: Fetched primary data is valid. [2025-09-29T20:05:31.485803] [DEBUG] [LOCAL ] MYE: Saving primary data. [2025-09-29T20:05:31.486985] [DEBUG] [LOCAL ] MYE: Trimmed 36635 records to 24717 (keeping 200 days of data) [2025-09-29T20:05:31.550824] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-01. [2025-09-29T20:05:31.665122] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-29T20:05:31.674102] [DEBUG] [LOCAL ] MYE: Primary data saved (24717 records). [2025-09-29T20:05:31.674254] [INFO ] [MAIN ] MYE: Full history saved. [2025-09-29T20:05:31.674363] [INFO ] [MAIN ] Update Progress: 1446/2371 symbols completed. MYE took 29.5s. Estimated remaining: 1h 58m 39s. Rate: 7.8 symbols/min [2025-09-29T20:05:31.873022] [INFO ] [MAIN ] NAC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:05:31.901050] [DEBUG] [LOCAL ] NAC: Loaded 25076 existing records from primary storage. [2025-09-29T20:05:31.901376] [INFO ] [MAIN ] NAC: Loaded 25076 existing records. [2025-09-29T20:05:32.092717] [WARN ] [MAIN ] NAC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:05:32.092967] [INFO ] [MAIN ] NAC: Wiping existing primary data before full refresh. [2025-09-29T20:05:32.093018] [INFO ] [LOCAL ] NAC: Starting deletion of primary data. [2025-09-29T20:05:32.093374] [DEBUG] [LOCAL ] NAC: Deleted primary data file. [2025-09-29T20:05:32.093434] [INFO ] [MAIN ] NAC: Starting full primary refresh. [2025-09-29T20:05:32.360508] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-09. [2025-09-29T20:05:32.489217] [INFO ] [REMOTE ] NAC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:05:32.802100] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-29T20:05:33.148138] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-02. [2025-09-29T20:05:33.667499] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-29T20:05:33.672734] [INFO ] [REMOTE ] MYI: Full fetch complete (29551 records). [2025-09-29T20:05:33.672834] [DEBUG] [VALIDATOR ] MYI: Validating primary data. [2025-09-29T20:05:33.953241] [INFO ] [REMOTE ] NAC: Fetching primary data for 2024-12. [2025-09-29T20:05:34.080566] [DEBUG] [VALIDATOR ] MYI: All expected trading days are present. [2025-09-29T20:05:34.080912] [DEBUG] [VALIDATOR ] MYI: Primary data validation passed. [2025-09-29T20:05:34.081638] [INFO ] [MAIN ] MYI: Fetched primary data is valid. [2025-09-29T20:05:34.081733] [DEBUG] [LOCAL ] MYI: Saving primary data. [2025-09-29T20:05:34.082763] [DEBUG] [LOCAL ] MYI: Trimmed 29551 records to 19380 (keeping 200 days of data) [2025-09-29T20:05:34.214472] [DEBUG] [LOCAL ] MYI: Primary data saved (19380 records). [2025-09-29T20:05:34.214626] [INFO ] [MAIN ] MYI: Full history saved. [2025-09-29T20:05:34.214761] [INFO ] [MAIN ] Update Progress: 1447/2371 symbols completed. MYI took 30.3s. Estimated remaining: 1h 58m 28s. Rate: 7.8 symbols/min [2025-09-29T20:05:34.406779] [INFO ] [MAIN ] NAD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:05:34.447956] [DEBUG] [LOCAL ] NAD: Loaded 34318 existing records from primary storage. [2025-09-29T20:05:34.448298] [INFO ] [MAIN ] NAD: Loaded 34318 existing records. [2025-09-29T20:05:34.630295] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-29T20:05:34.741929] [WARN ] [MAIN ] NAD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:05:34.742214] [INFO ] [MAIN ] NAD: Wiping existing primary data before full refresh. [2025-09-29T20:05:34.742274] [INFO ] [LOCAL ] NAD: Starting deletion of primary data. [2025-09-29T20:05:34.742522] [DEBUG] [LOCAL ] NAD: Deleted primary data file. [2025-09-29T20:05:34.742584] [INFO ] [MAIN ] NAD: Starting full primary refresh. [2025-09-29T20:05:34.754134] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-01. [2025-09-29T20:05:35.143851] [INFO ] [REMOTE ] NAD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:05:35.317583] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-29T20:05:35.548133] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-01. [2025-09-29T20:05:35.649845] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-29T20:05:36.348144] [INFO ] [REMOTE ] NAD: Fetching primary data for 2024-12. [2025-09-29T20:05:36.685843] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-29T20:05:37.148125] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-02. [2025-09-29T20:05:37.630428] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-29T20:05:37.948107] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-02. [2025-09-29T20:05:38.174964] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-29T20:05:38.743947] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-29T20:05:38.748068] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-03. [2025-09-29T20:05:39.548101] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-03. [2025-09-29T20:05:39.574771] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-29T20:05:40.348110] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-01. [2025-09-29T20:05:41.148123] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-03. [2025-09-29T20:05:41.209601] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-29T20:05:41.659264] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-29T20:05:41.948117] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-04. [2025-09-29T20:05:42.433312] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-29T20:05:42.748090] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-04. [2025-09-29T20:05:42.796678] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-29T20:05:43.548108] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-05. [2025-09-29T20:05:44.085021] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-29T20:05:44.304570] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-29T20:05:44.348117] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-05. [2025-09-29T20:05:45.148127] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-04. [2025-09-29T20:05:45.476193] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-29T20:05:45.948122] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-02. [2025-09-29T20:05:46.662479] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-29T20:05:46.748068] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-06. [2025-09-29T20:05:47.067143] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-29T20:05:47.548116] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-03. [2025-09-29T20:05:47.584756] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-29T20:05:48.348105] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-07. [2025-09-29T20:05:48.906811] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-29T20:05:49.148105] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-04. [2025-09-29T20:05:49.198877] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-29T20:05:49.948131] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-06. [2025-09-29T20:05:50.577093] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-29T20:05:50.748038] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-08. [2025-09-29T20:05:51.112394] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-29T20:05:51.546985] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-29T20:05:51.550586] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-05. [2025-09-29T20:05:52.348120] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-09. [2025-09-29T20:05:53.021099] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-29T20:05:53.148137] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-05. [2025-09-29T20:05:53.261603] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-29T20:05:53.264501] [INFO ] [REMOTE ] MYN: Full fetch complete (15469 records). [2025-09-29T20:05:53.264580] [DEBUG] [VALIDATOR ] MYN: Validating primary data. [2025-09-29T20:05:53.645221] [DEBUG] [VALIDATOR ] MYN: All expected trading days are present. [2025-09-29T20:05:53.645302] [DEBUG] [VALIDATOR ] MYN: Primary data validation passed. [2025-09-29T20:05:53.645701] [INFO ] [MAIN ] MYN: Fetched primary data is valid. [2025-09-29T20:05:53.646108] [DEBUG] [LOCAL ] MYN: Saving primary data. [2025-09-29T20:05:53.646864] [DEBUG] [LOCAL ] MYN: Trimmed 15469 records to 10052 (keeping 200 days of data) [2025-09-29T20:05:53.717708] [DEBUG] [LOCAL ] MYN: Primary data saved (10052 records). [2025-09-29T20:05:53.717868] [INFO ] [MAIN ] MYN: Full history saved. [2025-09-29T20:05:53.718002] [INFO ] [MAIN ] Update Progress: 1448/2371 symbols completed. MYN took 29.2s. Estimated remaining: 1h 58m 28s. Rate: 7.8 symbols/min [2025-09-29T20:05:53.890554] [INFO ] [MAIN ] NAN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:05:53.906288] [DEBUG] [LOCAL ] NAN: Loaded 9084 existing records from primary storage. [2025-09-29T20:05:53.906558] [INFO ] [MAIN ] NAN: Loaded 9084 existing records. [2025-09-29T20:05:53.953310] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-07. [2025-09-29T20:05:54.096295] [WARN ] [MAIN ] NAN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:05:54.096510] [INFO ] [MAIN ] NAN: Wiping existing primary data before full refresh. [2025-09-29T20:05:54.096560] [INFO ] [LOCAL ] NAN: Starting deletion of primary data. [2025-09-29T20:05:54.096859] [DEBUG] [LOCAL ] NAN: Deleted primary data file. [2025-09-29T20:05:54.096921] [INFO ] [MAIN ] NAN: Starting full primary refresh. [2025-09-29T20:05:54.484701] [INFO ] [REMOTE ] NAN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:05:54.741424] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-29T20:05:54.751159] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-06. [2025-09-29T20:05:54.799449] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-29T20:05:55.548127] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-06. [2025-09-29T20:05:56.066275] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-29T20:05:56.348144] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-07. [2025-09-29T20:05:56.996054] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-29T20:05:57.148121] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-07. [2025-09-29T20:05:57.815235] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-29T20:05:57.948106] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-08. [2025-09-29T20:05:58.663109] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-29T20:05:58.748089] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-08. [2025-09-29T20:05:58.932503] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-29T20:05:59.548141] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-09. [2025-09-29T20:06:00.221296] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-29T20:06:00.348168] [INFO ] [REMOTE ] NAN: Fetching primary data for 2024-12. [2025-09-29T20:06:01.042982] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-29T20:06:01.051589] [INFO ] [REMOTE ] NAC: Full fetch complete (36327 records). [2025-09-29T20:06:01.051779] [DEBUG] [VALIDATOR ] NAC: Validating primary data. [2025-09-29T20:06:01.153360] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-08. [2025-09-29T20:06:01.539135] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-29T20:06:01.558436] [DEBUG] [VALIDATOR ] NAC: All expected trading days are present. [2025-09-29T20:06:01.558510] [DEBUG] [VALIDATOR ] NAC: Primary data validation passed. [2025-09-29T20:06:01.559370] [INFO ] [MAIN ] NAC: Fetched primary data is valid. [2025-09-29T20:06:01.559438] [DEBUG] [LOCAL ] NAC: Saving primary data. [2025-09-29T20:06:01.560399] [DEBUG] [LOCAL ] NAC: Trimmed 36327 records to 24774 (keeping 200 days of data) [2025-09-29T20:06:01.731165] [DEBUG] [LOCAL ] NAC: Primary data saved (24774 records). [2025-09-29T20:06:01.731315] [INFO ] [MAIN ] NAC: Full history saved. [2025-09-29T20:06:01.731402] [INFO ] [MAIN ] Update Progress: 1449/2371 symbols completed. NAC took 30.1s. Estimated remaining: 1h 58m 20s. Rate: 7.8 symbols/min [2025-09-29T20:06:01.919815] [INFO ] [MAIN ] NAT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:06:01.956265] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-01. [2025-09-29T20:06:01.978405] [DEBUG] [LOCAL ] NAT: Loaded 49859 existing records from primary storage. [2025-09-29T20:06:01.978823] [INFO ] [MAIN ] NAT: Loaded 49859 existing records. [2025-09-29T20:06:02.179903] [WARN ] [MAIN ] NAT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:06:02.180147] [INFO ] [MAIN ] NAT: Wiping existing primary data before full refresh. [2025-09-29T20:06:02.180196] [INFO ] [LOCAL ] NAT: Starting deletion of primary data. [2025-09-29T20:06:02.180677] [DEBUG] [LOCAL ] NAT: Deleted primary data file. [2025-09-29T20:06:02.180738] [INFO ] [MAIN ] NAT: Starting full primary refresh. [2025-09-29T20:06:02.593026] [INFO ] [REMOTE ] NAT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:06:02.614172] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-29T20:06:02.748126] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-09. [2025-09-29T20:06:02.781139] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-29T20:06:03.548119] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-02. [2025-09-29T20:06:04.216307] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-29T20:06:04.223797] [INFO ] [REMOTE ] NAD: Full fetch complete (50007 records). [2025-09-29T20:06:04.223960] [DEBUG] [VALIDATOR ] NAD: Validating primary data. [2025-09-29T20:06:04.349478] [INFO ] [REMOTE ] NAT: Fetching primary data for 2024-12. [2025-09-29T20:06:04.558499] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-29T20:06:04.678714] [DEBUG] [VALIDATOR ] NAD: All expected trading days are present. [2025-09-29T20:06:04.678807] [DEBUG] [VALIDATOR ] NAD: Primary data validation passed. [2025-09-29T20:06:04.679724] [INFO ] [MAIN ] NAD: Fetched primary data is valid. [2025-09-29T20:06:04.679790] [DEBUG] [LOCAL ] NAD: Saving primary data. [2025-09-29T20:06:04.680920] [DEBUG] [LOCAL ] NAD: Trimmed 50007 records to 33881 (keeping 200 days of data) [2025-09-29T20:06:04.903055] [DEBUG] [LOCAL ] NAD: Primary data saved (33881 records). [2025-09-29T20:06:04.903198] [INFO ] [MAIN ] NAD: Full history saved. [2025-09-29T20:06:04.903282] [INFO ] [MAIN ] Update Progress: 1450/2371 symbols completed. NAD took 30.7s. Estimated remaining: 1h 58m 10s. Rate: 7.8 symbols/min [2025-09-29T20:06:05.075959] [INFO ] [MAIN ] NATL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:06:05.114159] [DEBUG] [LOCAL ] NATL: Loaded 33367 existing records from primary storage. [2025-09-29T20:06:05.114444] [INFO ] [MAIN ] NATL: Loaded 33367 existing records. [2025-09-29T20:06:05.153275] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-09. [2025-09-29T20:06:05.296892] [WARN ] [MAIN ] NATL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:06:05.297123] [INFO ] [MAIN ] NATL: Wiping existing primary data before full refresh. [2025-09-29T20:06:05.297177] [INFO ] [LOCAL ] NATL: Starting deletion of primary data. [2025-09-29T20:06:05.297576] [DEBUG] [LOCAL ] NATL: Deleted primary data file. [2025-09-29T20:06:05.297687] [INFO ] [MAIN ] NATL: Starting full primary refresh. [2025-09-29T20:06:05.666465] [INFO ] [REMOTE ] NATL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:06:05.948142] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-03. [2025-09-29T20:06:06.086344] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-29T20:06:06.748097] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-01. [2025-09-29T20:06:06.787838] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-29T20:06:06.786603] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-29T20:06:06.799443] [INFO ] [REMOTE ] NABL: Full fetch complete (56696 records). [2025-09-29T20:06:06.799572] [DEBUG] [VALIDATOR ] NABL: Validating primary data. [2025-09-29T20:06:07.250446] [DEBUG] [VALIDATOR ] NABL: All expected trading days are present. [2025-09-29T20:06:07.250538] [DEBUG] [VALIDATOR ] NABL: Primary data validation passed. [2025-09-29T20:06:07.251597] [INFO ] [MAIN ] NABL: Fetched primary data is valid. [2025-09-29T20:06:07.251689] [DEBUG] [LOCAL ] NABL: Saving primary data. [2025-09-29T20:06:07.254786] [DEBUG] [LOCAL ] NABL: Trimmed 56696 records to 39507 (keeping 200 days of data) [2025-09-29T20:06:07.492898] [DEBUG] [LOCAL ] NABL: Primary data saved (39507 records). [2025-09-29T20:06:07.493061] [INFO ] [MAIN ] NABL: Full history saved. [2025-09-29T20:06:07.493178] [INFO ] [MAIN ] Update Progress: 1451/2371 symbols completed. NABL took 39.5s. Estimated remaining: 1h 57m 59s. Rate: 7.8 symbols/min [2025-09-29T20:06:07.555967] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-04. [2025-09-29T20:06:07.683569] [INFO ] [MAIN ] NAZ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:06:07.688946] [DEBUG] [LOCAL ] NAZ: Loaded 2703 existing records from primary storage. [2025-09-29T20:06:07.689156] [INFO ] [MAIN ] NAZ: Loaded 2703 existing records. [2025-09-29T20:06:07.874337] [WARN ] [MAIN ] NAZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:06:07.874843] [INFO ] [MAIN ] NAZ: Wiping existing primary data before full refresh. [2025-09-29T20:06:07.874939] [INFO ] [LOCAL ] NAZ: Starting deletion of primary data. [2025-09-29T20:06:07.875156] [DEBUG] [LOCAL ] NAZ: Deleted primary data file. [2025-09-29T20:06:07.875218] [INFO ] [MAIN ] NAZ: Starting full primary refresh. [2025-09-29T20:06:08.289981] [INFO ] [REMOTE ] NAZ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:06:08.348121] [INFO ] [REMOTE ] NATL: Fetching primary data for 2024-12. [2025-09-29T20:06:08.414999] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-29T20:06:08.641121] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-29T20:06:09.148104] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-02. [2025-09-29T20:06:09.308005] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-29T20:06:09.948130] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-05. [2025-09-29T20:06:10.748111] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2024-12. [2025-09-29T20:06:10.763343] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-29T20:06:10.843991] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-29T20:06:11.348969] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-29T20:06:11.548157] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-06. [2025-09-29T20:06:12.197227] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-29T20:06:12.348137] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-03. [2025-09-29T20:06:13.148118] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-01. [2025-09-29T20:06:13.948104] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-07. [2025-09-29T20:06:14.230176] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-29T20:06:14.308942] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-29T20:06:14.748159] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-04. [2025-09-29T20:06:14.802950] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-29T20:06:15.548119] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-08. [2025-09-29T20:06:16.323559] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-29T20:06:16.348084] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-09. [2025-09-29T20:06:16.510943] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-29T20:06:17.148106] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-05. [2025-09-29T20:06:17.344843] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-29T20:06:17.347238] [INFO ] [REMOTE ] NAN: Full fetch complete (13892 records). [2025-09-29T20:06:17.347326] [DEBUG] [VALIDATOR ] NAN: Validating primary data. [2025-09-29T20:06:17.713273] [DEBUG] [VALIDATOR ] NAN: All expected trading days are present. [2025-09-29T20:06:17.713353] [DEBUG] [VALIDATOR ] NAN: Primary data validation passed. [2025-09-29T20:06:17.713785] [INFO ] [MAIN ] NAN: Fetched primary data is valid. [2025-09-29T20:06:17.713851] [DEBUG] [LOCAL ] NAN: Saving primary data. [2025-09-29T20:06:17.714339] [DEBUG] [LOCAL ] NAN: Trimmed 13892 records to 8966 (keeping 200 days of data) [2025-09-29T20:06:17.769722] [DEBUG] [LOCAL ] NAN: Primary data saved (8966 records). [2025-09-29T20:06:17.769861] [INFO ] [MAIN ] NAN: Full history saved. [2025-09-29T20:06:17.769960] [INFO ] [MAIN ] Update Progress: 1452/2371 symbols completed. NAN took 24.1s. Estimated remaining: 1h 57m 53s. Rate: 7.8 symbols/min [2025-09-29T20:06:17.945353] [INFO ] [MAIN ] NBB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:06:17.948107] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-02. [2025-09-29T20:06:17.958511] [DEBUG] [LOCAL ] NBB: Loaded 8967 existing records from primary storage. [2025-09-29T20:06:17.958787] [INFO ] [MAIN ] NBB: Loaded 8967 existing records. [2025-09-29T20:06:18.143005] [WARN ] [MAIN ] NBB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:06:18.143234] [INFO ] [MAIN ] NBB: Wiping existing primary data before full refresh. [2025-09-29T20:06:18.143283] [INFO ] [LOCAL ] NBB: Starting deletion of primary data. [2025-09-29T20:06:18.143509] [DEBUG] [LOCAL ] NBB: Deleted primary data file. [2025-09-29T20:06:18.143567] [INFO ] [MAIN ] NBB: Starting full primary refresh. [2025-09-29T20:06:18.501969] [INFO ] [REMOTE ] NBB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:06:18.748094] [INFO ] [REMOTE ] NBB: Fetching primary data for 2024-12. [2025-09-29T20:06:18.917499] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-29T20:06:19.097267] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-29T20:06:19.548102] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-01. [2025-09-29T20:06:19.844256] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-29T20:06:20.027562] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-29T20:06:20.348160] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-02. [2025-09-29T20:06:20.930110] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-29T20:06:21.148168] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-06. [2025-09-29T20:06:21.948149] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-03. [2025-09-29T20:06:22.516427] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-29T20:06:22.748187] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-04. [2025-09-29T20:06:22.917388] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-29T20:06:23.237795] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-29T20:06:23.548120] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-01. [2025-09-29T20:06:24.353720] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-03. [2025-09-29T20:06:24.354872] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-29T20:06:25.148135] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-02. [2025-09-29T20:06:25.693431] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-29T20:06:25.698017] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-29T20:06:25.948111] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-03. [2025-09-29T20:06:26.708540] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-29T20:06:26.748100] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-04. [2025-09-29T20:06:27.530310] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-29T20:06:27.548116] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-07. [2025-09-29T20:06:28.348091] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-04. [2025-09-29T20:06:29.148154] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-05. [2025-09-29T20:06:29.207167] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-29T20:06:29.618462] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-29T20:06:29.665157] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-29T20:06:29.948123] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-06. [2025-09-29T20:06:30.259338] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-29T20:06:30.748112] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-05. [2025-09-29T20:06:31.508163] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-29T20:06:31.548110] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-07. [2025-09-29T20:06:32.140212] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-29T20:06:32.348119] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-08. [2025-09-29T20:06:32.933445] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-29T20:06:33.148109] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-09. [2025-09-29T20:06:33.819741] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-29T20:06:33.821203] [INFO ] [REMOTE ] NAZ: Full fetch complete (4412 records). [2025-09-29T20:06:33.821279] [DEBUG] [VALIDATOR ] NAZ: Validating primary data. [2025-09-29T20:06:33.953186] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-08. [2025-09-29T20:06:34.202130] [DEBUG] [VALIDATOR ] NAZ: All expected trading days are present. [2025-09-29T20:06:34.202216] [DEBUG] [VALIDATOR ] NAZ: Primary data validation passed. [2025-09-29T20:06:34.202367] [INFO ] [MAIN ] NAZ: Fetched primary data is valid. [2025-09-29T20:06:34.202407] [DEBUG] [LOCAL ] NAZ: Saving primary data. [2025-09-29T20:06:34.202813] [DEBUG] [LOCAL ] NAZ: Trimmed 4412 records to 2642 (keeping 200 days of data) [2025-09-29T20:06:34.220226] [DEBUG] [LOCAL ] NAZ: Primary data saved (2642 records). [2025-09-29T20:06:34.220374] [INFO ] [MAIN ] NAZ: Full history saved. [2025-09-29T20:06:34.220497] [INFO ] [MAIN ] Update Progress: 1453/2371 symbols completed. NAZ took 26.7s. Estimated remaining: 1h 57m 51s. Rate: 7.8 symbols/min [2025-09-29T20:06:34.397432] [INFO ] [MAIN ] NBHC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:06:34.421769] [DEBUG] [LOCAL ] NBHC: Loaded 23530 existing records from primary storage. [2025-09-29T20:06:34.422050] [INFO ] [MAIN ] NBHC: Loaded 23530 existing records. [2025-09-29T20:06:34.606598] [WARN ] [MAIN ] NBHC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:06:34.606859] [INFO ] [MAIN ] NBHC: Wiping existing primary data before full refresh. [2025-09-29T20:06:34.606910] [INFO ] [LOCAL ] NBHC: Starting deletion of primary data. [2025-09-29T20:06:34.607442] [DEBUG] [LOCAL ] NBHC: Deleted primary data file. [2025-09-29T20:06:34.607508] [INFO ] [MAIN ] NBHC: Starting full primary refresh. [2025-09-29T20:06:34.755325] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-06. [2025-09-29T20:06:34.983278] [INFO ] [REMOTE ] NBHC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:06:35.548075] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2024-12. [2025-09-29T20:06:35.562548] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-29T20:06:35.885999] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-29T20:06:36.348116] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-09. [2025-09-29T20:06:36.599856] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-29T20:06:37.148138] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-07. [2025-09-29T20:06:37.712744] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-29T20:06:37.904432] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-29T20:06:37.914895] [INFO ] [REMOTE ] NAT: Full fetch complete (72147 records). [2025-09-29T20:06:37.915026] [DEBUG] [VALIDATOR ] NAT: Validating primary data. [2025-09-29T20:06:37.957110] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-01. [2025-09-29T20:06:38.331823] [DEBUG] [VALIDATOR ] NAT: All expected trading days are present. [2025-09-29T20:06:38.331913] [DEBUG] [VALIDATOR ] NAT: Primary data validation passed. [2025-09-29T20:06:38.333081] [INFO ] [MAIN ] NAT: Fetched primary data is valid. [2025-09-29T20:06:38.333150] [DEBUG] [LOCAL ] NAT: Saving primary data. [2025-09-29T20:06:38.337532] [DEBUG] [LOCAL ] NAT: Trimmed 72147 records to 49122 (keeping 200 days of data) [2025-09-29T20:06:38.639348] [DEBUG] [LOCAL ] NAT: Primary data saved (49122 records). [2025-09-29T20:06:38.639526] [INFO ] [MAIN ] NAT: Full history saved. [2025-09-29T20:06:38.639662] [INFO ] [MAIN ] Update Progress: 1454/2371 symbols completed. NAT took 36.9s. Estimated remaining: 1h 57m 41s. Rate: 7.8 symbols/min [2025-09-29T20:06:38.753278] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-05. [2025-09-29T20:06:38.821061] [INFO ] [MAIN ] NBR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:06:38.861084] [DEBUG] [LOCAL ] NBR: Loaded 35286 existing records from primary storage. [2025-09-29T20:06:38.861382] [INFO ] [MAIN ] NBR: Loaded 35286 existing records. [2025-09-29T20:06:39.051361] [WARN ] [MAIN ] NBR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:06:39.051666] [INFO ] [MAIN ] NBR: Wiping existing primary data before full refresh. [2025-09-29T20:06:39.051728] [INFO ] [LOCAL ] NBR: Starting deletion of primary data. [2025-09-29T20:06:39.052231] [DEBUG] [LOCAL ] NBR: Deleted primary data file. [2025-09-29T20:06:39.052305] [INFO ] [MAIN ] NBR: Starting full primary refresh. [2025-09-29T20:06:39.340944] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-29T20:06:39.452233] [INFO ] [REMOTE ] NBR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:06:39.548131] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-02. [2025-09-29T20:06:40.042717] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-29T20:06:40.169825] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-29T20:06:40.348118] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-06. [2025-09-29T20:06:41.148088] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-08. [2025-09-29T20:06:41.597543] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-29T20:06:41.941085] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-29T20:06:41.948058] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-09. [2025-09-29T20:06:42.748084] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-03. [2025-09-29T20:06:42.819609] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-29T20:06:42.822133] [INFO ] [REMOTE ] NBB: Full fetch complete (13796 records). [2025-09-29T20:06:42.822220] [DEBUG] [VALIDATOR ] NBB: Validating primary data. [2025-09-29T20:06:43.209392] [DEBUG] [VALIDATOR ] NBB: All expected trading days are present. [2025-09-29T20:06:43.209474] [DEBUG] [VALIDATOR ] NBB: Primary data validation passed. [2025-09-29T20:06:43.209844] [INFO ] [MAIN ] NBB: Fetched primary data is valid. [2025-09-29T20:06:43.209910] [DEBUG] [LOCAL ] NBB: Saving primary data. [2025-09-29T20:06:43.210403] [DEBUG] [LOCAL ] NBB: Trimmed 13796 records to 8939 (keeping 200 days of data) [2025-09-29T20:06:43.267542] [DEBUG] [LOCAL ] NBB: Primary data saved (8939 records). [2025-09-29T20:06:43.267718] [INFO ] [MAIN ] NBB: Full history saved. [2025-09-29T20:06:43.267820] [INFO ] [MAIN ] Update Progress: 1455/2371 symbols completed. NBB took 25.5s. Estimated remaining: 1h 57m 31s. Rate: 7.8 symbols/min [2025-09-29T20:06:43.447055] [INFO ] [MAIN ] NBXG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:06:43.474274] [DEBUG] [LOCAL ] NBXG: Loaded 22794 existing records from primary storage. [2025-09-29T20:06:43.474597] [INFO ] [MAIN ] NBXG: Loaded 22794 existing records. [2025-09-29T20:06:43.553027] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-07. [2025-09-29T20:06:43.664331] [WARN ] [MAIN ] NBXG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:06:43.664554] [INFO ] [MAIN ] NBXG: Wiping existing primary data before full refresh. [2025-09-29T20:06:43.664605] [INFO ] [LOCAL ] NBXG: Starting deletion of primary data. [2025-09-29T20:06:43.665198] [DEBUG] [LOCAL ] NBXG: Deleted primary data file. [2025-09-29T20:06:43.665261] [INFO ] [MAIN ] NBXG: Starting full primary refresh. [2025-09-29T20:06:44.041036] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-29T20:06:44.070541] [INFO ] [REMOTE ] NBXG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:06:44.348118] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-04. [2025-09-29T20:06:44.928370] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-29T20:06:45.148119] [INFO ] [REMOTE ] NBR: Fetching primary data for 2024-12. [2025-09-29T20:06:45.545906] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-29T20:06:45.948118] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-05. [2025-09-29T20:06:46.555847] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-29T20:06:46.748095] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-08. [2025-09-29T20:06:46.944802] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-29T20:06:47.548115] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-01. [2025-09-29T20:06:48.346425] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-29T20:06:48.355125] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-06. [2025-09-29T20:06:48.869081] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-29T20:06:49.148109] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-09. [2025-09-29T20:06:49.344558] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-29T20:06:49.948113] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2024-12. [2025-09-29T20:06:50.379854] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-29T20:06:50.387457] [INFO ] [REMOTE ] NATL: Full fetch complete (45686 records). [2025-09-29T20:06:50.387599] [DEBUG] [VALIDATOR ] NATL: Validating primary data. [2025-09-29T20:06:50.753232] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-07. [2025-09-29T20:06:50.833844] [DEBUG] [VALIDATOR ] NATL: All expected trading days are present. [2025-09-29T20:06:50.834663] [DEBUG] [VALIDATOR ] NATL: Primary data validation passed. [2025-09-29T20:06:50.835748] [INFO ] [MAIN ] NATL: Fetched primary data is valid. [2025-09-29T20:06:50.835815] [DEBUG] [LOCAL ] NATL: Saving primary data. [2025-09-29T20:06:50.837000] [DEBUG] [LOCAL ] NATL: Trimmed 45686 records to 32751 (keeping 200 days of data) [2025-09-29T20:06:51.050080] [DEBUG] [LOCAL ] NATL: Primary data saved (32751 records). [2025-09-29T20:06:51.050307] [INFO ] [MAIN ] NATL: Full history saved. [2025-09-29T20:06:51.050458] [INFO ] [MAIN ] Update Progress: 1456/2371 symbols completed. NATL took 46.1s. Estimated remaining: 1h 57m 24s. Rate: 7.8 symbols/min [2025-09-29T20:06:51.263451] [INFO ] [MAIN ] NC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:06:51.259953] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-29T20:06:51.273164] [DEBUG] [LOCAL ] NC: Loaded 1933 existing records from primary storage. [2025-09-29T20:06:51.273355] [INFO ] [MAIN ] NC: Loaded 1933 existing records. [2025-09-29T20:06:51.463451] [WARN ] [MAIN ] NC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:06:51.463683] [INFO ] [MAIN ] NC: Wiping existing primary data before full refresh. [2025-09-29T20:06:51.463743] [INFO ] [LOCAL ] NC: Starting deletion of primary data. [2025-09-29T20:06:51.463934] [DEBUG] [LOCAL ] NC: Deleted primary data file. [2025-09-29T20:06:51.463992] [INFO ] [MAIN ] NC: Starting full primary refresh. [2025-09-29T20:06:51.553293] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-02. [2025-09-29T20:06:51.853114] [INFO ] [REMOTE ] NC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:06:52.033331] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-29T20:06:52.348158] [INFO ] [REMOTE ] NC: Fetching primary data for 2024-12. [2025-09-29T20:06:52.891471] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-29T20:06:52.894126] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-29T20:06:53.148198] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-08. [2025-09-29T20:06:53.948166] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-03. [2025-09-29T20:06:54.304165] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-29T20:06:54.748093] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-09. [2025-09-29T20:06:55.327225] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-29T20:06:55.548139] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-01. [2025-09-29T20:06:55.949922] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-29T20:06:55.955712] [INFO ] [REMOTE ] NBHC: Full fetch complete (32072 records). [2025-09-29T20:06:55.955807] [DEBUG] [VALIDATOR ] NBHC: Validating primary data. [2025-09-29T20:06:56.271372] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-29T20:06:56.353473] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-04. [2025-09-29T20:06:56.368945] [DEBUG] [VALIDATOR ] NBHC: All expected trading days are present. [2025-09-29T20:06:56.369049] [DEBUG] [VALIDATOR ] NBHC: Primary data validation passed. [2025-09-29T20:06:56.369862] [INFO ] [MAIN ] NBHC: Fetched primary data is valid. [2025-09-29T20:06:56.369929] [DEBUG] [LOCAL ] NBHC: Saving primary data. [2025-09-29T20:06:56.370789] [DEBUG] [LOCAL ] NBHC: Trimmed 32072 records to 23140 (keeping 200 days of data) [2025-09-29T20:06:56.537699] [DEBUG] [LOCAL ] NBHC: Primary data saved (23140 records). [2025-09-29T20:06:56.537837] [INFO ] [MAIN ] NBHC: Full history saved. [2025-09-29T20:06:56.537925] [INFO ] [MAIN ] Update Progress: 1457/2371 symbols completed. NBHC took 22.3s. Estimated remaining: 1h 57m 14s. Rate: 7.8 symbols/min [2025-09-29T20:06:56.749484] [INFO ] [MAIN ] NCA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:06:56.762502] [DEBUG] [LOCAL ] NCA: Loaded 10178 existing records from primary storage. [2025-09-29T20:06:56.762774] [INFO ] [MAIN ] NCA: Loaded 10178 existing records. [2025-09-29T20:06:56.960760] [WARN ] [MAIN ] NCA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:06:56.962438] [INFO ] [MAIN ] NCA: Wiping existing primary data before full refresh. [2025-09-29T20:06:56.962557] [INFO ] [LOCAL ] NCA: Starting deletion of primary data. [2025-09-29T20:06:56.963317] [DEBUG] [LOCAL ] NCA: Deleted primary data file. [2025-09-29T20:06:56.963398] [INFO ] [MAIN ] NCA: Starting full primary refresh. [2025-09-29T20:06:57.153485] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-01. [2025-09-29T20:06:57.354708] [INFO ] [REMOTE ] NCA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:06:57.766150] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-29T20:06:57.948159] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-02. [2025-09-29T20:06:58.277145] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-29T20:06:58.416251] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-29T20:06:58.748139] [INFO ] [REMOTE ] NCA: Fetching primary data for 2024-12. [2025-09-29T20:06:59.548178] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-03. [2025-09-29T20:06:59.619617] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-29T20:07:00.182552] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-29T20:07:00.348136] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-04. [2025-09-29T20:07:00.993131] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-29T20:07:01.148168] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-01. [2025-09-29T20:07:01.933600] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-29T20:07:01.948078] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-02. [2025-09-29T20:07:02.748086] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-05. [2025-09-29T20:07:02.757236] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-29T20:07:03.255071] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-29T20:07:03.548157] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-03. [2025-09-29T20:07:04.292315] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-29T20:07:04.348124] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-02. [2025-09-29T20:07:05.148114] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-05. [2025-09-29T20:07:05.415474] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-29T20:07:05.948161] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-03. [2025-09-29T20:07:06.603943] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-29T20:07:06.748129] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-06. [2025-09-29T20:07:07.126804] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-29T20:07:07.548124] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-04. [2025-09-29T20:07:07.902339] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-29T20:07:08.348133] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-07. [2025-09-29T20:07:08.526687] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-29T20:07:09.148117] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-05. [2025-09-29T20:07:09.847863] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-29T20:07:09.873634] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-29T20:07:09.948112] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-06. [2025-09-29T20:07:10.748090] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-06. [2025-09-29T20:07:10.855449] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-29T20:07:11.382980] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-29T20:07:11.548129] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-04. [2025-09-29T20:07:12.348122] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-07. [2025-09-29T20:07:12.780993] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-29T20:07:12.791728] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-29T20:07:13.148112] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-05. [2025-09-29T20:07:13.948108] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-07. [2025-09-29T20:07:14.251346] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-29T20:07:14.748099] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-08. [2025-09-29T20:07:14.813195] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-29T20:07:15.548113] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-08. [2025-09-29T20:07:16.227501] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-29T20:07:16.252412] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-29T20:07:16.348114] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-09. [2025-09-29T20:07:17.148120] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-06. [2025-09-29T20:07:17.858113] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-29T20:07:17.866815] [INFO ] [REMOTE ] NBR: Full fetch complete (49554 records). [2025-09-29T20:07:17.866980] [DEBUG] [VALIDATOR ] NBR: Validating primary data. [2025-09-29T20:07:17.949881] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-08. [2025-09-29T20:07:18.276160] [DEBUG] [VALIDATOR ] NBR: All expected trading days are present. [2025-09-29T20:07:18.276267] [DEBUG] [VALIDATOR ] NBR: Primary data validation passed. [2025-09-29T20:07:18.277296] [INFO ] [MAIN ] NBR: Fetched primary data is valid. [2025-09-29T20:07:18.277386] [DEBUG] [LOCAL ] NBR: Saving primary data. [2025-09-29T20:07:18.278570] [DEBUG] [LOCAL ] NBR: Trimmed 49554 records to 34782 (keeping 200 days of data) [2025-09-29T20:07:18.395170] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-29T20:07:18.504156] [DEBUG] [LOCAL ] NBR: Primary data saved (34782 records). [2025-09-29T20:07:18.504317] [INFO ] [MAIN ] NBR: Full history saved. [2025-09-29T20:07:18.504458] [INFO ] [MAIN ] Update Progress: 1458/2371 symbols completed. NBR took 39.9s. Estimated remaining: 1h 57m 16s. Rate: 7.8 symbols/min [2025-09-29T20:07:18.685982] [INFO ] [MAIN ] NCDL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:07:18.699969] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-29T20:07:18.725293] [DEBUG] [LOCAL ] NCDL: Loaded 21828 existing records from primary storage. [2025-09-29T20:07:18.725575] [INFO ] [MAIN ] NCDL: Loaded 21828 existing records. [2025-09-29T20:07:18.755999] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-09. [2025-09-29T20:07:18.919388] [WARN ] [MAIN ] NCDL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:07:18.919692] [INFO ] [MAIN ] NCDL: Wiping existing primary data before full refresh. [2025-09-29T20:07:18.919769] [INFO ] [LOCAL ] NCDL: Starting deletion of primary data. [2025-09-29T20:07:18.920091] [DEBUG] [LOCAL ] NCDL: Deleted primary data file. [2025-09-29T20:07:18.920154] [INFO ] [MAIN ] NCDL: Starting full primary refresh. [2025-09-29T20:07:19.283188] [INFO ] [REMOTE ] NCDL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:07:19.548076] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-07. [2025-09-29T20:07:19.811344] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-29T20:07:19.814183] [INFO ] [REMOTE ] NCA: Full fetch complete (15559 records). [2025-09-29T20:07:19.814316] [DEBUG] [VALIDATOR ] NCA: Validating primary data. [2025-09-29T20:07:20.281453] [DEBUG] [VALIDATOR ] NCA: All expected trading days are present. [2025-09-29T20:07:20.281532] [DEBUG] [VALIDATOR ] NCA: Primary data validation passed. [2025-09-29T20:07:20.281887] [INFO ] [MAIN ] NCA: Fetched primary data is valid. [2025-09-29T20:07:20.281948] [DEBUG] [LOCAL ] NCA: Saving primary data. [2025-09-29T20:07:20.282454] [DEBUG] [LOCAL ] NCA: Trimmed 15559 records to 10176 (keeping 200 days of data) [2025-09-29T20:07:20.348814] [DEBUG] [LOCAL ] NCA: Primary data saved (10176 records). [2025-09-29T20:07:20.349283] [INFO ] [MAIN ] NCA: Full history saved. [2025-09-29T20:07:20.348972] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2024-12. [2025-09-29T20:07:20.350594] [INFO ] [MAIN ] Update Progress: 1459/2371 symbols completed. NCA took 23.8s. Estimated remaining: 1h 57m 4s. Rate: 7.8 symbols/min [2025-09-29T20:07:20.552879] [INFO ] [MAIN ] NCLH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:07:20.618242] [DEBUG] [LOCAL ] NCLH: Loaded 54533 existing records from primary storage. [2025-09-29T20:07:20.618606] [INFO ] [MAIN ] NCLH: Loaded 54533 existing records. [2025-09-29T20:07:20.835115] [WARN ] [MAIN ] NCLH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:07:20.836471] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-29T20:07:20.836660] [INFO ] [MAIN ] NCLH: Wiping existing primary data before full refresh. [2025-09-29T20:07:20.842713] [INFO ] [LOCAL ] NCLH: Starting deletion of primary data. [2025-09-29T20:07:20.843499] [DEBUG] [LOCAL ] NCLH: Deleted primary data file. [2025-09-29T20:07:20.843576] [INFO ] [MAIN ] NCLH: Starting full primary refresh. [2025-09-29T20:07:21.153219] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-09. [2025-09-29T20:07:21.221783] [INFO ] [REMOTE ] NCLH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:07:21.750464] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-29T20:07:21.843787] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-29T20:07:21.844833] [INFO ] [REMOTE ] NC: Full fetch complete (2701 records). [2025-09-29T20:07:21.844907] [DEBUG] [VALIDATOR ] NC: Validating primary data. [2025-09-29T20:07:21.951684] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-08. [2025-09-29T20:07:22.230341] [DEBUG] [VALIDATOR ] NC: All expected trading days are present. [2025-09-29T20:07:22.230429] [DEBUG] [VALIDATOR ] NC: Primary data validation passed. [2025-09-29T20:07:22.230553] [INFO ] [MAIN ] NC: Fetched primary data is valid. [2025-09-29T20:07:22.230615] [DEBUG] [LOCAL ] NC: Saving primary data. [2025-09-29T20:07:22.231004] [DEBUG] [LOCAL ] NC: Trimmed 2701 records to 1913 (keeping 200 days of data) [2025-09-29T20:07:22.243113] [DEBUG] [LOCAL ] NC: Primary data saved (1913 records). [2025-09-29T20:07:22.243187] [INFO ] [MAIN ] NC: Full history saved. [2025-09-29T20:07:22.243273] [INFO ] [MAIN ] Update Progress: 1460/2371 symbols completed. NC took 31.2s. Estimated remaining: 1h 56m 53s. Rate: 7.8 symbols/min [2025-09-29T20:07:22.420363] [INFO ] [MAIN ] NCV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:07:22.437149] [DEBUG] [LOCAL ] NCV: Loaded 13602 existing records from primary storage. [2025-09-29T20:07:22.437413] [INFO ] [MAIN ] NCV: Loaded 13602 existing records. [2025-09-29T20:07:22.633769] [WARN ] [MAIN ] NCV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:07:22.634007] [INFO ] [MAIN ] NCV: Wiping existing primary data before full refresh. [2025-09-29T20:07:22.634059] [INFO ] [LOCAL ] NCV: Starting deletion of primary data. [2025-09-29T20:07:22.634327] [DEBUG] [LOCAL ] NCV: Deleted primary data file. [2025-09-29T20:07:22.634387] [INFO ] [MAIN ] NCV: Starting full primary refresh. [2025-09-29T20:07:22.753321] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-01. [2025-09-29T20:07:23.023022] [INFO ] [REMOTE ] NCV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:07:23.122894] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-29T20:07:23.548174] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-09. [2025-09-29T20:07:24.083616] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-29T20:07:24.348146] [INFO ] [REMOTE ] NCV: Fetching primary data for 2024-12. [2025-09-29T20:07:24.676097] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-29T20:07:24.680463] [INFO ] [REMOTE ] NBXG: Full fetch complete (33011 records). [2025-09-29T20:07:24.680571] [DEBUG] [VALIDATOR ] NBXG: Validating primary data. [2025-09-29T20:07:25.091759] [DEBUG] [VALIDATOR ] NBXG: All expected trading days are present. [2025-09-29T20:07:25.091858] [DEBUG] [VALIDATOR ] NBXG: Primary data validation passed. [2025-09-29T20:07:25.092691] [INFO ] [MAIN ] NBXG: Fetched primary data is valid. [2025-09-29T20:07:25.092767] [DEBUG] [LOCAL ] NBXG: Saving primary data. [2025-09-29T20:07:25.093690] [DEBUG] [LOCAL ] NBXG: Trimmed 33011 records to 22289 (keeping 200 days of data) [2025-09-29T20:07:25.163237] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-02. [2025-09-29T20:07:25.256248] [DEBUG] [LOCAL ] NBXG: Primary data saved (22289 records). [2025-09-29T20:07:25.256405] [INFO ] [MAIN ] NBXG: Full history saved. [2025-09-29T20:07:25.256520] [INFO ] [MAIN ] Update Progress: 1461/2371 symbols completed. NBXG took 42.0s. Estimated remaining: 1h 56m 42s. Rate: 7.8 symbols/min [2025-09-29T20:07:25.435732] [INFO ] [MAIN ] NCZ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:07:25.451516] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-29T20:07:25.467730] [DEBUG] [LOCAL ] NCZ: Loaded 11998 existing records from primary storage. [2025-09-29T20:07:25.467966] [INFO ] [MAIN ] NCZ: Loaded 11998 existing records. [2025-09-29T20:07:25.653091] [WARN ] [MAIN ] NCZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:07:25.653355] [INFO ] [MAIN ] NCZ: Wiping existing primary data before full refresh. [2025-09-29T20:07:25.653410] [INFO ] [LOCAL ] NCZ: Starting deletion of primary data. [2025-09-29T20:07:25.653699] [DEBUG] [LOCAL ] NCZ: Deleted primary data file. [2025-09-29T20:07:25.653760] [INFO ] [MAIN ] NCZ: Starting full primary refresh. [2025-09-29T20:07:25.957892] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-01. [2025-09-29T20:07:26.046552] [INFO ] [REMOTE ] NCZ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:07:26.235812] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-29T20:07:26.748096] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-03. [2025-09-29T20:07:27.061610] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-29T20:07:27.548122] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-02. [2025-09-29T20:07:27.903761] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-29T20:07:28.348091] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2024-12. [2025-09-29T20:07:28.698276] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-29T20:07:29.148095] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2024-12. [2025-09-29T20:07:29.475216] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-29T20:07:29.948096] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-04. [2025-09-29T20:07:30.748163] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-01. [2025-09-29T20:07:31.114216] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-29T20:07:31.184701] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-29T20:07:31.548151] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-05. [2025-09-29T20:07:31.684985] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-29T20:07:32.348149] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-01. [2025-09-29T20:07:32.610935] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-29T20:07:33.148131] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-03. [2025-09-29T20:07:33.948071] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-02. [2025-09-29T20:07:34.090257] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-29T20:07:34.233014] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-29T20:07:34.748141] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-06. [2025-09-29T20:07:35.152186] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-29T20:07:35.548091] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-02. [2025-09-29T20:07:35.627991] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-29T20:07:36.348125] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-04. [2025-09-29T20:07:37.148096] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-03. [2025-09-29T20:07:37.276041] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-29T20:07:37.471031] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-29T20:07:37.948143] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-03. [2025-09-29T20:07:38.042141] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-29T20:07:38.748103] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-04. [2025-09-29T20:07:39.548088] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-05. [2025-09-29T20:07:39.709358] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-29T20:07:40.107021] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-29T20:07:40.348111] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-04. [2025-09-29T20:07:40.397950] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-29T20:07:41.148104] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-06. [2025-09-29T20:07:41.920389] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-29T20:07:41.948076] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-07. [2025-09-29T20:07:42.365208] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-29T20:07:42.748100] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-05. [2025-09-29T20:07:42.934464] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-29T20:07:43.548121] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-07. [2025-09-29T20:07:44.348115] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-05. [2025-09-29T20:07:44.577099] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-29T20:07:44.766692] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-29T20:07:45.148151] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-08. [2025-09-29T20:07:45.288701] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-29T20:07:45.783228] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-29T20:07:45.948163] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-08. [2025-09-29T20:07:46.748079] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-09. [2025-09-29T20:07:47.058434] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-29T20:07:47.548149] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-06. [2025-09-29T20:07:47.863677] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-29T20:07:47.870938] [INFO ] [REMOTE ] NCDL: Full fetch complete (33025 records). [2025-09-29T20:07:47.871166] [DEBUG] [VALIDATOR ] NCDL: Validating primary data. [2025-09-29T20:07:48.253726] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-29T20:07:48.270784] [DEBUG] [VALIDATOR ] NCDL: All expected trading days are present. [2025-09-29T20:07:48.274448] [DEBUG] [VALIDATOR ] NCDL: Primary data validation passed. [2025-09-29T20:07:48.276385] [INFO ] [MAIN ] NCDL: Fetched primary data is valid. [2025-09-29T20:07:48.276497] [DEBUG] [LOCAL ] NCDL: Saving primary data. [2025-09-29T20:07:48.277602] [DEBUG] [LOCAL ] NCDL: Trimmed 33025 records to 21474 (keeping 200 days of data) [2025-09-29T20:07:48.369802] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-06. [2025-09-29T20:07:48.422451] [DEBUG] [LOCAL ] NCDL: Primary data saved (21474 records). [2025-09-29T20:07:48.422604] [INFO ] [MAIN ] NCDL: Full history saved. [2025-09-29T20:07:48.422723] [INFO ] [MAIN ] Update Progress: 1462/2371 symbols completed. NCDL took 29.9s. Estimated remaining: 1h 56m 44s. Rate: 7.8 symbols/min [2025-09-29T20:07:48.610669] [INFO ] [MAIN ] NDMO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:07:48.629785] [DEBUG] [LOCAL ] NDMO: Loaded 16978 existing records from primary storage. [2025-09-29T20:07:48.630056] [INFO ] [MAIN ] NDMO: Loaded 16978 existing records. [2025-09-29T20:07:48.817588] [WARN ] [MAIN ] NDMO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:07:48.817822] [INFO ] [MAIN ] NDMO: Wiping existing primary data before full refresh. [2025-09-29T20:07:48.817869] [INFO ] [LOCAL ] NDMO: Starting deletion of primary data. [2025-09-29T20:07:48.818115] [DEBUG] [LOCAL ] NDMO: Deleted primary data file. [2025-09-29T20:07:48.818174] [INFO ] [MAIN ] NDMO: Starting full primary refresh. [2025-09-29T20:07:49.153294] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-07. [2025-09-29T20:07:49.210015] [INFO ] [REMOTE ] NDMO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:07:49.948144] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2024-12. [2025-09-29T20:07:50.181129] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-29T20:07:50.485542] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-29T20:07:50.748127] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-07. [2025-09-29T20:07:51.091732] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-29T20:07:51.548173] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-08. [2025-09-29T20:07:52.335600] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-29T20:07:52.348072] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-09. [2025-09-29T20:07:52.735606] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-29T20:07:53.148127] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-09. [2025-09-29T20:07:53.326522] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-29T20:07:53.329889] [INFO ] [REMOTE ] NCZ: Full fetch complete (21518 records). [2025-09-29T20:07:53.329981] [DEBUG] [VALIDATOR ] NCZ: Validating primary data. [2025-09-29T20:07:53.723390] [DEBUG] [VALIDATOR ] NCZ: All expected trading days are present. [2025-09-29T20:07:53.723481] [DEBUG] [VALIDATOR ] NCZ: Primary data validation passed. [2025-09-29T20:07:53.724007] [INFO ] [MAIN ] NCZ: Fetched primary data is valid. [2025-09-29T20:07:53.724071] [DEBUG] [LOCAL ] NCZ: Saving primary data. [2025-09-29T20:07:53.724887] [DEBUG] [LOCAL ] NCZ: Trimmed 21518 records to 11850 (keeping 200 days of data) [2025-09-29T20:07:53.813786] [DEBUG] [LOCAL ] NCZ: Primary data saved (11850 records). [2025-09-29T20:07:53.813961] [INFO ] [MAIN ] NCZ: Full history saved. [2025-09-29T20:07:53.814087] [INFO ] [MAIN ] Update Progress: 1463/2371 symbols completed. NCZ took 28.6s. Estimated remaining: 1h 56m 35s. Rate: 7.8 symbols/min [2025-09-29T20:07:53.952727] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-01. [2025-09-29T20:07:54.005886] [INFO ] [MAIN ] NE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:07:54.063520] [DEBUG] [LOCAL ] NE: Loaded 53157 existing records from primary storage. [2025-09-29T20:07:54.063912] [INFO ] [MAIN ] NE: Loaded 53157 existing records. [2025-09-29T20:07:54.217833] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-29T20:07:54.250776] [INFO ] [REMOTE ] NCV: Full fetch complete (22960 records). [2025-09-29T20:07:54.277670] [DEBUG] [VALIDATOR ] NCV: Validating primary data. [2025-09-29T20:07:54.283573] [WARN ] [MAIN ] NE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:07:54.284124] [INFO ] [MAIN ] NE: Wiping existing primary data before full refresh. [2025-09-29T20:07:54.330961] [INFO ] [LOCAL ] NE: Starting deletion of primary data. [2025-09-29T20:07:54.371185] [DEBUG] [LOCAL ] NE: Deleted primary data file. [2025-09-29T20:07:54.395075] [INFO ] [MAIN ] NE: Starting full primary refresh. [2025-09-29T20:07:54.774820] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-08. [2025-09-29T20:07:55.052403] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-29T20:07:55.092073] [DEBUG] [VALIDATOR ] NCV: All expected trading days are present. [2025-09-29T20:07:55.106922] [DEBUG] [VALIDATOR ] NCV: Primary data validation passed. [2025-09-29T20:07:55.109365] [INFO ] [MAIN ] NCV: Fetched primary data is valid. [2025-09-29T20:07:55.116987] [DEBUG] [LOCAL ] NCV: Saving primary data. [2025-09-29T20:07:55.131008] [INFO ] [REMOTE ] NE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:07:55.131606] [DEBUG] [LOCAL ] NCV: Trimmed 22960 records to 13489 (keeping 200 days of data) [2025-09-29T20:07:55.217903] [DEBUG] [LOCAL ] NCV: Primary data saved (13489 records). [2025-09-29T20:07:55.218051] [INFO ] [MAIN ] NCV: Full history saved. [2025-09-29T20:07:55.218139] [INFO ] [MAIN ] Update Progress: 1464/2371 symbols completed. NCV took 33.0s. Estimated remaining: 1h 56m 24s. Rate: 7.8 symbols/min [2025-09-29T20:07:55.401208] [INFO ] [MAIN ] NEA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:07:55.439996] [DEBUG] [LOCAL ] NEA: Loaded 35808 existing records from primary storage. [2025-09-29T20:07:55.440294] [INFO ] [MAIN ] NEA: Loaded 35808 existing records. [2025-09-29T20:07:55.553216] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-02. [2025-09-29T20:07:55.633298] [WARN ] [MAIN ] NEA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:07:55.633580] [INFO ] [MAIN ] NEA: Wiping existing primary data before full refresh. [2025-09-29T20:07:55.633677] [INFO ] [LOCAL ] NEA: Starting deletion of primary data. [2025-09-29T20:07:55.634003] [DEBUG] [LOCAL ] NEA: Deleted primary data file. [2025-09-29T20:07:55.634065] [INFO ] [MAIN ] NEA: Starting full primary refresh. [2025-09-29T20:07:56.031252] [INFO ] [REMOTE ] NEA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:07:56.348101] [INFO ] [REMOTE ] NE: Fetching primary data for 2024-12. [2025-09-29T20:07:56.467440] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-29T20:07:56.966435] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-29T20:07:57.148125] [INFO ] [REMOTE ] NEA: Fetching primary data for 2024-12. [2025-09-29T20:07:57.948097] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-03. [2025-09-29T20:07:58.123351] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-29T20:07:58.285138] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-29T20:07:58.489871] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-29T20:07:58.748106] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-09. [2025-09-29T20:07:59.548153] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-04. [2025-09-29T20:08:00.326830] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-29T20:08:00.348082] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-05. [2025-09-29T20:08:00.810544] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-29T20:08:00.822005] [INFO ] [REMOTE ] NCLH: Full fetch complete (77809 records). [2025-09-29T20:08:00.822185] [DEBUG] [VALIDATOR ] NCLH: Validating primary data. [2025-09-29T20:08:01.151765] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-01. [2025-09-29T20:08:01.257936] [DEBUG] [VALIDATOR ] NCLH: All expected trading days are present. [2025-09-29T20:08:01.258108] [DEBUG] [VALIDATOR ] NCLH: Primary data validation passed. [2025-09-29T20:08:01.259367] [INFO ] [MAIN ] NCLH: Fetched primary data is valid. [2025-09-29T20:08:01.259483] [DEBUG] [LOCAL ] NCLH: Saving primary data. [2025-09-29T20:08:01.261191] [DEBUG] [LOCAL ] NCLH: Trimmed 77809 records to 53753 (keeping 200 days of data) [2025-09-29T20:08:01.357543] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-29T20:08:01.612589] [DEBUG] [LOCAL ] NCLH: Primary data saved (53753 records). [2025-09-29T20:08:01.612768] [INFO ] [MAIN ] NCLH: Full history saved. [2025-09-29T20:08:01.612863] [INFO ] [MAIN ] Update Progress: 1465/2371 symbols completed. NCLH took 41.3s. Estimated remaining: 1h 56m 15s. Rate: 7.8 symbols/min [2025-09-29T20:08:01.791785] [INFO ] [MAIN ] NEE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:08:01.857275] [DEBUG] [LOCAL ] NEE: Loaded 54487 existing records from primary storage. [2025-09-29T20:08:01.857817] [INFO ] [MAIN ] NEE: Loaded 54487 existing records. [2025-09-29T20:08:01.955188] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-06. [2025-09-29T20:08:02.059871] [WARN ] [MAIN ] NEE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:08:02.060120] [INFO ] [MAIN ] NEE: Wiping existing primary data before full refresh. [2025-09-29T20:08:02.060167] [INFO ] [LOCAL ] NEE: Starting deletion of primary data. [2025-09-29T20:08:02.060752] [DEBUG] [LOCAL ] NEE: Deleted primary data file. [2025-09-29T20:08:02.060813] [INFO ] [MAIN ] NEE: Starting full primary refresh. [2025-09-29T20:08:02.439748] [INFO ] [REMOTE ] NEE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:08:02.655253] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-29T20:08:02.748084] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-01. [2025-09-29T20:08:02.822311] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-29T20:08:03.548113] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-07. [2025-09-29T20:08:04.353219] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-02. [2025-09-29T20:08:04.371740] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-29T20:08:04.513098] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-29T20:08:05.148096] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-02. [2025-09-29T20:08:05.282101] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-29T20:08:05.948150] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-08. [2025-09-29T20:08:06.748088] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-03. [2025-09-29T20:08:06.787679] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-29T20:08:06.983825] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-29T20:08:07.548133] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-09. [2025-09-29T20:08:08.142885] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-29T20:08:08.348114] [INFO ] [REMOTE ] NEE: Fetching primary data for 2024-12. [2025-09-29T20:08:08.640310] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-29T20:08:08.645235] [INFO ] [REMOTE ] NDMO: Full fetch complete (25039 records). [2025-09-29T20:08:08.645331] [DEBUG] [VALIDATOR ] NDMO: Validating primary data. [2025-09-29T20:08:09.047250] [DEBUG] [VALIDATOR ] NDMO: All expected trading days are present. [2025-09-29T20:08:09.047386] [DEBUG] [VALIDATOR ] NDMO: Primary data validation passed. [2025-09-29T20:08:09.048019] [INFO ] [MAIN ] NDMO: Fetched primary data is valid. [2025-09-29T20:08:09.048085] [DEBUG] [LOCAL ] NDMO: Saving primary data. [2025-09-29T20:08:09.048949] [DEBUG] [LOCAL ] NDMO: Trimmed 25039 records to 16873 (keeping 200 days of data) [2025-09-29T20:08:09.148539] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-03. [2025-09-29T20:08:09.167254] [DEBUG] [LOCAL ] NDMO: Primary data saved (16873 records). [2025-09-29T20:08:09.167398] [INFO ] [MAIN ] NDMO: Full history saved. [2025-09-29T20:08:09.167488] [INFO ] [MAIN ] Update Progress: 1466/2371 symbols completed. NDMO took 20.7s. Estimated remaining: 1h 56m 7s. Rate: 7.8 symbols/min [2025-09-29T20:08:09.354137] [INFO ] [MAIN ] NEM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:08:09.414377] [DEBUG] [LOCAL ] NEM: Loaded 54488 existing records from primary storage. [2025-09-29T20:08:09.414754] [INFO ] [MAIN ] NEM: Loaded 54488 existing records. [2025-09-29T20:08:09.610615] [WARN ] [MAIN ] NEM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:08:09.610874] [INFO ] [MAIN ] NEM: Wiping existing primary data before full refresh. [2025-09-29T20:08:09.610936] [INFO ] [LOCAL ] NEM: Starting deletion of primary data. [2025-09-29T20:08:09.611235] [DEBUG] [LOCAL ] NEM: Deleted primary data file. [2025-09-29T20:08:09.611296] [INFO ] [MAIN ] NEM: Starting full primary refresh. [2025-09-29T20:08:09.955800] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-04. [2025-09-29T20:08:10.004522] [INFO ] [REMOTE ] NEM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:08:10.215753] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-29T20:08:10.748185] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-01. [2025-09-29T20:08:10.980093] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-29T20:08:11.163366] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-29T20:08:11.548180] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-05. [2025-09-29T20:08:12.348136] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-04. [2025-09-29T20:08:12.950964] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-09-29T20:08:13.036402] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-29T20:08:13.148100] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-06. [2025-09-29T20:08:13.948101] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-02. [2025-09-29T20:08:14.183146] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-29T20:08:14.452631] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-29T20:08:14.748138] [INFO ] [REMOTE ] NEM: Fetching primary data for 2024-12. [2025-09-29T20:08:15.548077] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-05. [2025-09-29T20:08:15.907785] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-29T20:08:16.348163] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-03. [2025-09-29T20:08:16.981288] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-29T20:08:17.148112] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-07. [2025-09-29T20:08:17.392443] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-29T20:08:17.948127] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-06. [2025-09-29T20:08:18.328764] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-29T20:08:18.585962] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-29T20:08:18.748131] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-08. [2025-09-29T20:08:19.548096] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-04. [2025-09-29T20:08:19.656894] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-29T20:08:20.120971] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-29T20:08:20.348137] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-01. [2025-09-29T20:08:21.148140] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-09. [2025-09-29T20:08:21.550486] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-29T20:08:21.948135] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-05. [2025-09-29T20:08:22.305042] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-29T20:08:22.610783] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-29T20:08:22.618481] [INFO ] [REMOTE ] NEA: Full fetch complete (52233 records). [2025-09-29T20:08:22.618618] [DEBUG] [VALIDATOR ] NEA: Validating primary data. [2025-09-29T20:08:22.762744] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-02. [2025-09-29T20:08:23.016568] [DEBUG] [VALIDATOR ] NEA: All expected trading days are present. [2025-09-29T20:08:23.016691] [DEBUG] [VALIDATOR ] NEA: Primary data validation passed. [2025-09-29T20:08:23.017714] [INFO ] [MAIN ] NEA: Fetched primary data is valid. [2025-09-29T20:08:23.017779] [DEBUG] [LOCAL ] NEA: Saving primary data. [2025-09-29T20:08:23.018977] [DEBUG] [LOCAL ] NEA: Trimmed 52233 records to 35357 (keeping 200 days of data) [2025-09-29T20:08:23.246623] [DEBUG] [LOCAL ] NEA: Primary data saved (35357 records). [2025-09-29T20:08:23.246816] [INFO ] [MAIN ] NEA: Full history saved. [2025-09-29T20:08:23.246923] [INFO ] [MAIN ] Update Progress: 1467/2371 symbols completed. NEA took 28.0s. Estimated remaining: 1h 56m 4s. Rate: 7.8 symbols/min [2025-09-29T20:08:23.425532] [INFO ] [MAIN ] NET: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:08:23.484730] [DEBUG] [LOCAL ] NET: Loaded 53808 existing records from primary storage. [2025-09-29T20:08:23.485169] [INFO ] [MAIN ] NET: Loaded 53808 existing records. [2025-09-29T20:08:23.557584] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-07. [2025-09-29T20:08:23.714948] [WARN ] [MAIN ] NET: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:08:23.715557] [INFO ] [MAIN ] NET: Wiping existing primary data before full refresh. [2025-09-29T20:08:23.715842] [INFO ] [LOCAL ] NET: Starting deletion of primary data. [2025-09-29T20:08:23.716392] [DEBUG] [LOCAL ] NET: Deleted primary data file. [2025-09-29T20:08:23.716456] [INFO ] [MAIN ] NET: Starting full primary refresh. [2025-09-29T20:08:24.098619] [INFO ] [REMOTE ] NET: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:08:24.134211] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-29T20:08:24.348113] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-06. [2025-09-29T20:08:24.727898] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-29T20:08:25.148157] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-03. [2025-09-29T20:08:25.200236] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-29T20:08:25.948119] [INFO ] [REMOTE ] NET: Fetching primary data for 2024-12. [2025-09-29T20:08:26.337492] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-29T20:08:26.748103] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-07. [2025-09-29T20:08:27.383857] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-29T20:08:27.548127] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-08. [2025-09-29T20:08:27.630260] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-29T20:08:28.348116] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-01. [2025-09-29T20:08:28.929532] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-29T20:08:29.148099] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-08. [2025-09-29T20:08:29.453755] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-29T20:08:29.948084] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-04. [2025-09-29T20:08:30.026318] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-29T20:08:30.748094] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-09. [2025-09-29T20:08:31.548218] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-02. [2025-09-29T20:08:31.858906] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-08 (2.71 seconds). [2025-09-29T20:08:32.191399] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-29T20:08:32.348121] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-09. [2025-09-29T20:08:32.681716] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-29T20:08:32.692715] [INFO ] [REMOTE ] NE: Full fetch complete (75424 records). [2025-09-29T20:08:32.692878] [DEBUG] [VALIDATOR ] NE: Validating primary data. [2025-09-29T20:08:33.098074] [DEBUG] [VALIDATOR ] NE: All expected trading days are present. [2025-09-29T20:08:33.098169] [DEBUG] [VALIDATOR ] NE: Primary data validation passed. [2025-09-29T20:08:33.099283] [INFO ] [MAIN ] NE: Fetched primary data is valid. [2025-09-29T20:08:33.099359] [DEBUG] [LOCAL ] NE: Saving primary data. [2025-09-29T20:08:33.100906] [DEBUG] [LOCAL ] NE: Trimmed 75424 records to 52378 (keeping 200 days of data) [2025-09-29T20:08:33.154985] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-05. [2025-09-29T20:08:33.460727] [DEBUG] [LOCAL ] NE: Primary data saved (52378 records). [2025-09-29T20:08:33.460991] [INFO ] [MAIN ] NE: Full history saved. [2025-09-29T20:08:33.461413] [INFO ] [MAIN ] Update Progress: 1468/2371 symbols completed. NE took 39.6s. Estimated remaining: 1h 55m 57s. Rate: 7.8 symbols/min [2025-09-29T20:08:33.654355] [INFO ] [MAIN ] NEU: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:08:33.693452] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-29T20:08:33.709083] [DEBUG] [LOCAL ] NEU: Loaded 8259 existing records from primary storage. [2025-09-29T20:08:33.709581] [INFO ] [MAIN ] NEU: Loaded 8259 existing records. [2025-09-29T20:08:33.903283] [WARN ] [MAIN ] NEU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:08:33.903538] [INFO ] [MAIN ] NEU: Wiping existing primary data before full refresh. [2025-09-29T20:08:33.903598] [INFO ] [LOCAL ] NEU: Starting deletion of primary data. [2025-09-29T20:08:33.904991] [DEBUG] [LOCAL ] NEU: Deleted primary data file. [2025-09-29T20:08:33.905055] [INFO ] [MAIN ] NEU: Starting full primary refresh. [2025-09-29T20:08:33.962636] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-03. [2025-09-29T20:08:34.279002] [INFO ] [REMOTE ] NEU: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:08:34.748121] [INFO ] [REMOTE ] NEU: Fetching primary data for 2024-12. [2025-09-29T20:08:34.839818] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-09-29T20:08:34.851771] [INFO ] [REMOTE ] NEE: Full fetch complete (77759 records). [2025-09-29T20:08:34.851940] [DEBUG] [VALIDATOR ] NEE: Validating primary data. [2025-09-29T20:08:35.268274] [DEBUG] [VALIDATOR ] NEE: All expected trading days are present. [2025-09-29T20:08:35.268480] [DEBUG] [VALIDATOR ] NEE: Primary data validation passed. [2025-09-29T20:08:35.269758] [INFO ] [MAIN ] NEE: Fetched primary data is valid. [2025-09-29T20:08:35.269947] [DEBUG] [LOCAL ] NEE: Saving primary data. [2025-09-29T20:08:35.274270] [DEBUG] [LOCAL ] NEE: Trimmed 77759 records to 53707 (keeping 200 days of data) [2025-09-29T20:08:35.371231] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-29T20:08:35.554536] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-01. [2025-09-29T20:08:35.566625] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-09-29T20:08:35.683621] [DEBUG] [LOCAL ] NEE: Primary data saved (53707 records). [2025-09-29T20:08:35.683816] [INFO ] [MAIN ] NEE: Full history saved. [2025-09-29T20:08:35.684006] [INFO ] [MAIN ] Update Progress: 1469/2371 symbols completed. NEE took 34.1s. Estimated remaining: 1h 55m 46s. Rate: 7.8 symbols/min [2025-09-29T20:08:35.878779] [INFO ] [MAIN ] NEUE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:08:35.883792] [DEBUG] [LOCAL ] NEUE: Loaded 2271 existing records from primary storage. [2025-09-29T20:08:35.883959] [INFO ] [MAIN ] NEUE: Loaded 2271 existing records. [2025-09-29T20:08:36.079811] [WARN ] [MAIN ] NEUE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:08:36.080037] [INFO ] [MAIN ] NEUE: Wiping existing primary data before full refresh. [2025-09-29T20:08:36.080168] [INFO ] [LOCAL ] NEUE: Starting deletion of primary data. [2025-09-29T20:08:36.080427] [DEBUG] [LOCAL ] NEUE: Deleted primary data file. [2025-09-29T20:08:36.080495] [INFO ] [MAIN ] NEUE: Starting full primary refresh. [2025-09-29T20:08:36.314818] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-29T20:08:36.351833] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-06. [2025-09-29T20:08:36.491882] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-09-29T20:08:36.517826] [INFO ] [REMOTE ] NEUE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:08:37.148122] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2024-12. [2025-09-29T20:08:37.865550] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-29T20:08:37.948144] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-02. [2025-09-29T20:08:38.591636] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-29T20:08:38.613484] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-29T20:08:38.748113] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-04. [2025-09-29T20:08:39.548125] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-01. [2025-09-29T20:08:40.126953] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-29T20:08:40.348105] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-02. [2025-09-29T20:08:40.803061] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-29T20:08:40.811028] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-29T20:08:41.148115] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-03. [2025-09-29T20:08:41.872712] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-29T20:08:41.948111] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-04. [2025-09-29T20:08:42.324031] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-29T20:08:42.748115] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-05. [2025-09-29T20:08:43.180751] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-29T20:08:43.548125] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-05. [2025-09-29T20:08:44.348088] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-07. [2025-09-29T20:08:45.148132] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-03. [2025-09-29T20:08:45.805052] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-29T20:08:45.824171] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-29T20:08:45.948099] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-04. [2025-09-29T20:08:46.307158] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-29T20:08:46.748102] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-06. [2025-09-29T20:08:46.767860] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-29T20:08:47.186148] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-29T20:08:47.548111] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-07. [2025-09-29T20:08:47.980085] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-29T20:08:48.348162] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-08. [2025-09-29T20:08:49.148140] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-05. [2025-09-29T20:08:49.778328] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-29T20:08:49.948122] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-06. [2025-09-29T20:08:50.455455] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-29T20:08:50.748144] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-06. [2025-09-29T20:08:51.002868] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-29T20:08:51.548123] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-08. [2025-09-29T20:08:51.980263] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-29T20:08:52.348141] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-09. [2025-09-29T20:08:52.696609] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-29T20:08:52.957254] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-29T20:08:52.958325] [INFO ] [REMOTE ] NEUE: Full fetch complete (4028 records). [2025-09-29T20:08:52.958414] [DEBUG] [VALIDATOR ] NEUE: Validating primary data. [2025-09-29T20:08:53.155091] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-07. [2025-09-29T20:08:53.336026] [DEBUG] [VALIDATOR ] NEUE: All expected trading days are present. [2025-09-29T20:08:53.336115] [DEBUG] [VALIDATOR ] NEUE: Primary data validation passed. [2025-09-29T20:08:53.336254] [INFO ] [MAIN ] NEUE: Fetched primary data is valid. [2025-09-29T20:08:53.336294] [DEBUG] [LOCAL ] NEUE: Saving primary data. [2025-09-29T20:08:53.336665] [DEBUG] [LOCAL ] NEUE: Trimmed 4028 records to 2207 (keeping 200 days of data) [2025-09-29T20:08:53.349540] [DEBUG] [LOCAL ] NEUE: Primary data saved (2207 records). [2025-09-29T20:08:53.349613] [INFO ] [MAIN ] NEUE: Full history saved. [2025-09-29T20:08:53.349739] [INFO ] [MAIN ] Update Progress: 1470/2371 symbols completed. NEUE took 17.7s. Estimated remaining: 1h 55m 45s. Rate: 7.8 symbols/min [2025-09-29T20:08:53.530762] [INFO ] [MAIN ] NEXA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:08:53.539704] [DEBUG] [LOCAL ] NEXA: Loaded 4307 existing records from primary storage. [2025-09-29T20:08:53.539925] [INFO ] [MAIN ] NEXA: Loaded 4307 existing records. [2025-09-29T20:08:53.730974] [WARN ] [MAIN ] NEXA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:08:53.731226] [INFO ] [MAIN ] NEXA: Wiping existing primary data before full refresh. [2025-09-29T20:08:53.731345] [INFO ] [LOCAL ] NEXA: Starting deletion of primary data. [2025-09-29T20:08:53.731548] [DEBUG] [LOCAL ] NEXA: Deleted primary data file. [2025-09-29T20:08:53.731607] [INFO ] [MAIN ] NEXA: Starting full primary refresh. [2025-09-29T20:08:53.953876] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-07. [2025-09-29T20:08:54.129879] [INFO ] [REMOTE ] NEXA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:08:54.130353] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-29T20:08:54.748115] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2024-12. [2025-09-29T20:08:55.551902] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-08. [2025-09-29T20:08:55.554336] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-29T20:08:56.213562] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-29T20:08:56.348092] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-09. [2025-09-29T20:08:56.492201] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-29T20:08:57.148147] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-08. [2025-09-29T20:08:57.948143] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-01. [2025-09-29T20:08:58.748084] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-09. [2025-09-29T20:08:58.785294] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-29T20:08:58.820835] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-09-29T20:08:58.832511] [INFO ] [REMOTE ] NEM: Full fetch complete (77749 records). [2025-09-29T20:08:58.832728] [DEBUG] [VALIDATOR ] NEM: Validating primary data. [2025-09-29T20:08:59.255873] [DEBUG] [VALIDATOR ] NEM: All expected trading days are present. [2025-09-29T20:08:59.255990] [DEBUG] [VALIDATOR ] NEM: Primary data validation passed. [2025-09-29T20:08:59.257343] [INFO ] [MAIN ] NEM: Fetched primary data is valid. [2025-09-29T20:08:59.257463] [DEBUG] [LOCAL ] NEM: Saving primary data. [2025-09-29T20:08:59.259344] [DEBUG] [LOCAL ] NEM: Trimmed 77749 records to 53708 (keeping 200 days of data) [2025-09-29T20:08:59.352748] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-29T20:08:59.548294] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-02. [2025-09-29T20:08:59.650308] [DEBUG] [LOCAL ] NEM: Primary data saved (53708 records). [2025-09-29T20:08:59.650465] [INFO ] [MAIN ] NEM: Full history saved. [2025-09-29T20:08:59.650566] [INFO ] [MAIN ] Update Progress: 1471/2371 symbols completed. NEM took 50.5s. Estimated remaining: 1h 55m 36s. Rate: 7.8 symbols/min [2025-09-29T20:08:59.770536] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-29T20:08:59.788511] [INFO ] [REMOTE ] NEU: Full fetch complete (10394 records). [2025-09-29T20:08:59.815461] [DEBUG] [VALIDATOR ] NEU: Validating primary data. [2025-09-29T20:08:59.888343] [INFO ] [MAIN ] NFG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:09:00.234832] [DEBUG] [LOCAL ] NFG: Loaded 39084 existing records from primary storage. [2025-09-29T20:09:00.265933] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-29T20:09:00.274423] [INFO ] [MAIN ] NFG: Loaded 39084 existing records. [2025-09-29T20:09:00.274713] [DEBUG] [VALIDATOR ] NEU: All expected trading days are present. [2025-09-29T20:09:00.297389] [DEBUG] [VALIDATOR ] NEU: Primary data validation passed. [2025-09-29T20:09:00.310296] [INFO ] [MAIN ] NEU: Fetched primary data is valid. [2025-09-29T20:09:00.322729] [DEBUG] [LOCAL ] NEU: Saving primary data. [2025-09-29T20:09:00.356897] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-03. [2025-09-29T20:09:00.387855] [DEBUG] [LOCAL ] NEU: Trimmed 10394 records to 8230 (keeping 200 days of data) [2025-09-29T20:09:00.521727] [WARN ] [MAIN ] NFG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:09:00.522254] [INFO ] [MAIN ] NFG: Wiping existing primary data before full refresh. [2025-09-29T20:09:00.527666] [INFO ] [LOCAL ] NFG: Starting deletion of primary data. [2025-09-29T20:09:00.530245] [DEBUG] [LOCAL ] NFG: Deleted primary data file. [2025-09-29T20:09:00.530559] [INFO ] [MAIN ] NFG: Starting full primary refresh. [2025-09-29T20:09:00.778524] [DEBUG] [LOCAL ] NEU: Primary data saved (8230 records). [2025-09-29T20:09:00.783975] [INFO ] [MAIN ] NEU: Full history saved. [2025-09-29T20:09:00.809171] [INFO ] [MAIN ] Update Progress: 1472/2371 symbols completed. NEU took 27.3s. Estimated remaining: 1h 55m 24s. Rate: 7.8 symbols/min [2025-09-29T20:09:00.905971] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-29T20:09:01.059294] [INFO ] [REMOTE ] NFG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:09:01.124579] [INFO ] [MAIN ] NFJ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:09:01.149239] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-04. [2025-09-29T20:09:01.149957] [DEBUG] [LOCAL ] NFJ: Loaded 20592 existing records from primary storage. [2025-09-29T20:09:01.151171] [INFO ] [MAIN ] NFJ: Loaded 20592 existing records. [2025-09-29T20:09:01.335925] [WARN ] [MAIN ] NFJ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:09:01.336160] [INFO ] [MAIN ] NFJ: Wiping existing primary data before full refresh. [2025-09-29T20:09:01.336210] [INFO ] [LOCAL ] NFJ: Starting deletion of primary data. [2025-09-29T20:09:01.336517] [DEBUG] [LOCAL ] NFJ: Deleted primary data file. [2025-09-29T20:09:01.336578] [INFO ] [MAIN ] NFJ: Starting full primary refresh. [2025-09-29T20:09:01.720090] [INFO ] [REMOTE ] NFJ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:09:01.917395] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-29T20:09:01.948075] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-05. [2025-09-29T20:09:02.583025] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-29T20:09:02.748113] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-09. [2025-09-29T20:09:03.548121] [INFO ] [REMOTE ] NFG: Fetching primary data for 2024-12. [2025-09-29T20:09:04.348138] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2024-12. [2025-09-29T20:09:04.819824] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-29T20:09:04.830938] [INFO ] [REMOTE ] NET: Full fetch complete (76835 records). [2025-09-29T20:09:04.831072] [DEBUG] [VALIDATOR ] NET: Validating primary data. [2025-09-29T20:09:05.157424] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-06. [2025-09-29T20:09:05.170795] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-29T20:09:05.285284] [DEBUG] [VALIDATOR ] NET: All expected trading days are present. [2025-09-29T20:09:05.285373] [DEBUG] [VALIDATOR ] NET: Primary data validation passed. [2025-09-29T20:09:05.286584] [INFO ] [MAIN ] NET: Fetched primary data is valid. [2025-09-29T20:09:05.286679] [DEBUG] [LOCAL ] NET: Saving primary data. [2025-09-29T20:09:05.288350] [DEBUG] [LOCAL ] NET: Trimmed 76835 records to 53016 (keeping 200 days of data) [2025-09-29T20:09:05.546951] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-29T20:09:05.670674] [DEBUG] [LOCAL ] NET: Primary data saved (53016 records). [2025-09-29T20:09:05.670839] [INFO ] [MAIN ] NET: Full history saved. [2025-09-29T20:09:05.670981] [INFO ] [MAIN ] Update Progress: 1473/2371 symbols completed. NET took 42.4s. Estimated remaining: 1h 55m 15s. Rate: 7.8 symbols/min [2025-09-29T20:09:05.813087] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-29T20:09:05.870986] [INFO ] [MAIN ] NGG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:09:05.919429] [DEBUG] [LOCAL ] NGG: Loaded 46809 existing records from primary storage. [2025-09-29T20:09:05.919800] [INFO ] [MAIN ] NGG: Loaded 46809 existing records. [2025-09-29T20:09:05.953247] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-01. [2025-09-29T20:09:06.120697] [WARN ] [MAIN ] NGG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:09:06.120945] [INFO ] [MAIN ] NGG: Wiping existing primary data before full refresh. [2025-09-29T20:09:06.120994] [INFO ] [LOCAL ] NGG: Starting deletion of primary data. [2025-09-29T20:09:06.121278] [DEBUG] [LOCAL ] NGG: Deleted primary data file. [2025-09-29T20:09:06.121337] [INFO ] [MAIN ] NGG: Starting full primary refresh. [2025-09-29T20:09:06.497860] [INFO ] [REMOTE ] NGG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:09:06.748115] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-07. [2025-09-29T20:09:07.359155] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-29T20:09:07.548075] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-08. [2025-09-29T20:09:07.581986] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-29T20:09:07.862317] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-29T20:09:08.348125] [INFO ] [REMOTE ] NGG: Fetching primary data for 2024-12. [2025-09-29T20:09:09.148149] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-02. [2025-09-29T20:09:09.915293] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-29T20:09:09.948081] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-01. [2025-09-29T20:09:10.625011] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-29T20:09:10.748112] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-03. [2025-09-29T20:09:11.531524] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-29T20:09:11.548150] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-01. [2025-09-29T20:09:12.185821] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-29T20:09:12.348132] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-02. [2025-09-29T20:09:12.670829] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-29T20:09:13.148125] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-09. [2025-09-29T20:09:13.880285] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-29T20:09:13.882629] [INFO ] [REMOTE ] NEXA: Full fetch complete (7606 records). [2025-09-29T20:09:13.882914] [DEBUG] [VALIDATOR ] NEXA: Validating primary data. [2025-09-29T20:09:13.956198] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-04. [2025-09-29T20:09:14.052477] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-29T20:09:14.312403] [DEBUG] [VALIDATOR ] NEXA: All expected trading days are present. [2025-09-29T20:09:14.312491] [DEBUG] [VALIDATOR ] NEXA: Primary data validation passed. [2025-09-29T20:09:14.312729] [INFO ] [MAIN ] NEXA: Fetched primary data is valid. [2025-09-29T20:09:14.312795] [DEBUG] [LOCAL ] NEXA: Saving primary data. [2025-09-29T20:09:14.313214] [DEBUG] [LOCAL ] NEXA: Trimmed 7606 records to 4289 (keeping 200 days of data) [2025-09-29T20:09:14.338829] [DEBUG] [LOCAL ] NEXA: Primary data saved (4289 records). [2025-09-29T20:09:14.338936] [INFO ] [MAIN ] NEXA: Full history saved. [2025-09-29T20:09:14.339019] [INFO ] [MAIN ] Update Progress: 1474/2371 symbols completed. NEXA took 21.0s. Estimated remaining: 1h 55m 8s. Rate: 7.8 symbols/min [2025-09-29T20:09:14.525310] [INFO ] [MAIN ] NGL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:09:14.561157] [DEBUG] [LOCAL ] NGL: Loaded 30754 existing records from primary storage. [2025-09-29T20:09:14.561461] [INFO ] [MAIN ] NGL: Loaded 30754 existing records. [2025-09-29T20:09:14.757238] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-02. [2025-09-29T20:09:14.763584] [WARN ] [MAIN ] NGL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:09:14.764548] [INFO ] [MAIN ] NGL: Wiping existing primary data before full refresh. [2025-09-29T20:09:14.764605] [INFO ] [LOCAL ] NGL: Starting deletion of primary data. [2025-09-29T20:09:14.764947] [DEBUG] [LOCAL ] NGL: Deleted primary data file. [2025-09-29T20:09:14.765008] [INFO ] [MAIN ] NGL: Starting full primary refresh. [2025-09-29T20:09:15.166720] [INFO ] [REMOTE ] NGL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:09:15.356534] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-29T20:09:15.548141] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-05. [2025-09-29T20:09:15.878015] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-29T20:09:16.348128] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-03. [2025-09-29T20:09:16.967725] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-29T20:09:17.148143] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-06. [2025-09-29T20:09:17.415833] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-29T20:09:17.948164] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-03. [2025-09-29T20:09:18.450948] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-29T20:09:18.748101] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-07. [2025-09-29T20:09:19.548154] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-04. [2025-09-29T20:09:19.595637] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-29T20:09:20.306718] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-29T20:09:20.348119] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-08. [2025-09-29T20:09:20.732398] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-29T20:09:21.148111] [INFO ] [REMOTE ] NGL: Fetching primary data for 2024-12. [2025-09-29T20:09:21.774573] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-29T20:09:21.948166] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-04. [2025-09-29T20:09:22.187838] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-29T20:09:22.748113] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-01. [2025-09-29T20:09:23.548114] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-09. [2025-09-29T20:09:23.722763] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-29T20:09:23.766472] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-29T20:09:24.348192] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-05. [2025-09-29T20:09:25.016474] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-29T20:09:25.024282] [INFO ] [REMOTE ] NFG: Full fetch complete (56827 records). [2025-09-29T20:09:25.024483] [DEBUG] [VALIDATOR ] NFG: Validating primary data. [2025-09-29T20:09:25.153238] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-05. [2025-09-29T20:09:25.445704] [DEBUG] [VALIDATOR ] NFG: All expected trading days are present. [2025-09-29T20:09:25.445854] [DEBUG] [VALIDATOR ] NFG: Primary data validation passed. [2025-09-29T20:09:25.447725] [INFO ] [MAIN ] NFG: Fetched primary data is valid. [2025-09-29T20:09:25.447799] [DEBUG] [LOCAL ] NFG: Saving primary data. [2025-09-29T20:09:25.451404] [DEBUG] [LOCAL ] NFG: Trimmed 56827 records to 38473 (keeping 200 days of data) [2025-09-29T20:09:25.724721] [DEBUG] [LOCAL ] NFG: Primary data saved (38473 records). [2025-09-29T20:09:25.724893] [INFO ] [MAIN ] NFG: Full history saved. [2025-09-29T20:09:25.725045] [INFO ] [MAIN ] Update Progress: 1475/2371 symbols completed. NFG took 26.1s. Estimated remaining: 1h 55m 2s. Rate: 7.8 symbols/min [2025-09-29T20:09:25.918934] [INFO ] [MAIN ] NGS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:09:25.948795] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-02. [2025-09-29T20:09:25.951778] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-29T20:09:25.972464] [DEBUG] [LOCAL ] NGS: Loaded 11682 existing records from primary storage. [2025-09-29T20:09:25.972765] [INFO ] [MAIN ] NGS: Loaded 11682 existing records. [2025-09-29T20:09:26.174407] [WARN ] [MAIN ] NGS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:09:26.174829] [INFO ] [MAIN ] NGS: Wiping existing primary data before full refresh. [2025-09-29T20:09:26.174891] [INFO ] [LOCAL ] NGS: Starting deletion of primary data. [2025-09-29T20:09:26.175106] [DEBUG] [LOCAL ] NGS: Deleted primary data file. [2025-09-29T20:09:26.175165] [INFO ] [MAIN ] NGS: Starting full primary refresh. [2025-09-29T20:09:26.330683] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-29T20:09:26.591970] [INFO ] [REMOTE ] NGS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:09:26.748108] [INFO ] [REMOTE ] NGS: Fetching primary data for 2024-12. [2025-09-29T20:09:27.046459] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-29T20:09:27.548128] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-03. [2025-09-29T20:09:27.618520] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-29T20:09:28.348095] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-06. [2025-09-29T20:09:28.810570] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-29T20:09:29.148107] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-01. [2025-09-29T20:09:29.410424] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-29T20:09:29.754356] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-29T20:09:29.948130] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-02. [2025-09-29T20:09:30.684836] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-29T20:09:30.748107] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-06. [2025-09-29T20:09:31.548123] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-03. [2025-09-29T20:09:32.317900] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-29T20:09:32.348078] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-07. [2025-09-29T20:09:32.454066] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-29T20:09:33.148110] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-04. [2025-09-29T20:09:33.948143] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-04. [2025-09-29T20:09:34.146220] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-29T20:09:34.189303] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-29T20:09:34.748120] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-08. [2025-09-29T20:09:35.169021] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-29T20:09:35.548117] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-05. [2025-09-29T20:09:36.272898] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-29T20:09:36.348104] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-09. [2025-09-29T20:09:36.368840] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-29T20:09:37.148143] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-06. [2025-09-29T20:09:37.948155] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-05. [2025-09-29T20:09:37.991056] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-29T20:09:38.001481] [INFO ] [REMOTE ] NGG: Full fetch complete (66432 records). [2025-09-29T20:09:38.001764] [DEBUG] [VALIDATOR ] NGG: Validating primary data. [2025-09-29T20:09:38.012402] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-29T20:09:38.434116] [DEBUG] [VALIDATOR ] NGG: All expected trading days are present. [2025-09-29T20:09:38.434214] [DEBUG] [VALIDATOR ] NGG: Primary data validation passed. [2025-09-29T20:09:38.435304] [INFO ] [MAIN ] NGG: Fetched primary data is valid. [2025-09-29T20:09:38.435372] [DEBUG] [LOCAL ] NGG: Saving primary data. [2025-09-29T20:09:38.436861] [DEBUG] [LOCAL ] NGG: Trimmed 66432 records to 46169 (keeping 200 days of data) [2025-09-29T20:09:38.748521] [DEBUG] [LOCAL ] NGG: Primary data saved (46169 records). [2025-09-29T20:09:38.748729] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-07. [2025-09-29T20:09:38.749166] [INFO ] [MAIN ] NGG: Full history saved. [2025-09-29T20:09:38.750620] [INFO ] [MAIN ] Update Progress: 1476/2371 symbols completed. NGG took 33.1s. Estimated remaining: 1h 54m 58s. Rate: 7.8 symbols/min [2025-09-29T20:09:38.941005] [INFO ] [MAIN ] NGVC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:09:38.966454] [DEBUG] [LOCAL ] NGVC: Loaded 22650 existing records from primary storage. [2025-09-29T20:09:38.966855] [INFO ] [MAIN ] NGVC: Loaded 22650 existing records. [2025-09-29T20:09:39.095636] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-29T20:09:39.185936] [WARN ] [MAIN ] NGVC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:09:39.186257] [INFO ] [MAIN ] NGVC: Wiping existing primary data before full refresh. [2025-09-29T20:09:39.186311] [INFO ] [LOCAL ] NGVC: Starting deletion of primary data. [2025-09-29T20:09:39.186610] [DEBUG] [LOCAL ] NGVC: Deleted primary data file. [2025-09-29T20:09:39.186712] [INFO ] [MAIN ] NGVC: Starting full primary refresh. [2025-09-29T20:09:39.567312] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-07. [2025-09-29T20:09:39.573085] [INFO ] [REMOTE ] NGVC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:09:39.591528] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-29T20:09:40.348117] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-06. [2025-09-29T20:09:40.688574] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-29T20:09:41.148115] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2024-12. [2025-09-29T20:09:41.775767] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-29T20:09:41.948126] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-08. [2025-09-29T20:09:42.145938] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-29T20:09:42.749020] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-01. [2025-09-29T20:09:42.750946] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-29T20:09:43.548110] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-08. [2025-09-29T20:09:43.762390] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-29T20:09:44.348103] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-09. [2025-09-29T20:09:44.531165] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-29T20:09:45.148084] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-09. [2025-09-29T20:09:45.267965] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-29T20:09:45.270488] [INFO ] [REMOTE ] NGS: Full fetch complete (17232 records). [2025-09-29T20:09:45.270592] [DEBUG] [VALIDATOR ] NGS: Validating primary data. [2025-09-29T20:09:45.695477] [DEBUG] [VALIDATOR ] NGS: All expected trading days are present. [2025-09-29T20:09:45.695583] [DEBUG] [VALIDATOR ] NGS: Primary data validation passed. [2025-09-29T20:09:45.696043] [INFO ] [MAIN ] NGS: Fetched primary data is valid. [2025-09-29T20:09:45.696118] [DEBUG] [LOCAL ] NGS: Saving primary data. [2025-09-29T20:09:45.696790] [DEBUG] [LOCAL ] NGS: Trimmed 17232 records to 11523 (keeping 200 days of data) [2025-09-29T20:09:45.778414] [DEBUG] [LOCAL ] NGS: Primary data saved (11523 records). [2025-09-29T20:09:45.778594] [INFO ] [MAIN ] NGS: Full history saved. [2025-09-29T20:09:45.778749] [INFO ] [MAIN ] Update Progress: 1477/2371 symbols completed. NGS took 20.1s. Estimated remaining: 1h 54m 50s. Rate: 7.8 symbols/min [2025-09-29T20:09:45.948102] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-02. [2025-09-29T20:09:46.277990] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-29T20:09:46.282328] [INFO ] [REMOTE ] NFJ: Full fetch complete (30587 records). [2025-09-29T20:09:46.282451] [DEBUG] [VALIDATOR ] NFJ: Validating primary data. [2025-09-29T20:09:46.690691] [DEBUG] [VALIDATOR ] NFJ: All expected trading days are present. [2025-09-29T20:09:46.690793] [DEBUG] [VALIDATOR ] NFJ: Primary data validation passed. [2025-09-29T20:09:46.691528] [INFO ] [MAIN ] NFJ: Fetched primary data is valid. [2025-09-29T20:09:46.691572] [DEBUG] [LOCAL ] NFJ: Saving primary data. [2025-09-29T20:09:46.692555] [DEBUG] [LOCAL ] NFJ: Trimmed 30587 records to 20308 (keeping 200 days of data) [2025-09-29T20:09:46.749541] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-07. [2025-09-29T20:09:46.831127] [DEBUG] [LOCAL ] NFJ: Primary data saved (20308 records). [2025-09-29T20:09:46.831507] [INFO ] [MAIN ] NFJ: Full history saved. [2025-09-29T20:09:46.831626] [INFO ] [MAIN ] Update Progress: 1478/2371 symbols completed. NFJ took 46.0s. Estimated remaining: 1h 54m 38s. Rate: 7.8 symbols/min [2025-09-29T20:09:47.073004] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-29T20:09:47.548181] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-03. [2025-09-29T20:09:48.252175] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-29T20:09:48.348136] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-08. [2025-09-29T20:09:48.684759] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-29T20:09:49.148177] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-04. [2025-09-29T20:09:49.762415] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-29T20:09:49.948131] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-09. [2025-09-29T20:09:50.221755] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-29T20:09:50.748142] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-05. [2025-09-29T20:09:51.468372] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-29T20:09:51.475734] [INFO ] [REMOTE ] NGL: Full fetch complete (41216 records). [2025-09-29T20:09:51.475855] [DEBUG] [VALIDATOR ] NGL: Validating primary data. [2025-09-29T20:09:51.888834] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-29T20:09:51.918565] [DEBUG] [VALIDATOR ] NGL: All expected trading days are present. [2025-09-29T20:09:51.918769] [DEBUG] [VALIDATOR ] NGL: Primary data validation passed. [2025-09-29T20:09:51.920023] [INFO ] [MAIN ] NGL: Fetched primary data is valid. [2025-09-29T20:09:51.920114] [DEBUG] [LOCAL ] NGL: Saving primary data. [2025-09-29T20:09:51.920774] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-06. [2025-09-29T20:09:51.923522] [DEBUG] [LOCAL ] NGL: Trimmed 41216 records to 30336 (keeping 200 days of data) [2025-09-29T20:09:52.104023] [DEBUG] [LOCAL ] NGL: Primary data saved (30336 records). [2025-09-29T20:09:52.104178] [INFO ] [MAIN ] NGL: Full history saved. [2025-09-29T20:09:52.104348] [INFO ] [MAIN ] Update Progress: 1479/2371 symbols completed. NGL took 37.8s. Estimated remaining: 1h 54m 29s. Rate: 7.8 symbols/min [2025-09-29T20:09:53.087530] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-29T20:09:53.093577] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-07. [2025-09-29T20:09:54.275869] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-29T20:09:54.281778] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-08. [2025-09-29T20:09:55.176516] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-29T20:09:55.182471] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-09. [2025-09-29T20:09:56.436262] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-29T20:09:56.441625] [INFO ] [REMOTE ] NGVC: Full fetch complete (30439 records). [2025-09-29T20:09:56.441831] [DEBUG] [VALIDATOR ] NGVC: Validating primary data. [2025-09-29T20:09:56.852598] [DEBUG] [VALIDATOR ] NGVC: All expected trading days are present. [2025-09-29T20:09:56.852735] [DEBUG] [VALIDATOR ] NGVC: Primary data validation passed. [2025-09-29T20:09:56.853453] [INFO ] [MAIN ] NGVC: Fetched primary data is valid. [2025-09-29T20:09:56.853500] [DEBUG] [LOCAL ] NGVC: Saving primary data. [2025-09-29T20:09:56.854569] [DEBUG] [LOCAL ] NGVC: Trimmed 30439 records to 22321 (keeping 200 days of data) [2025-09-29T20:09:56.996239] [DEBUG] [LOCAL ] NGVC: Primary data saved (22321 records). [2025-09-29T20:09:56.996374] [INFO ] [MAIN ] NGVC: Full history saved. [2025-09-29T20:09:56.996487] [INFO ] [MAIN ] Update Progress: 1480/2371 symbols completed. NGVC took 18.2s. Estimated remaining: 1h 54m 20s. Rate: 7.8 symbols/min [2025-09-29T20:09:57.718776] [INFO ] [MAIN ] NHI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:09:57.690812] [INFO ] [MAIN ] NGVT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:09:57.752817] [INFO ] [MAIN ] NI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:09:57.773156] [INFO ] [MAIN ] NIC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:09:57.797797] [DEBUG] [LOCAL ] NIC: Loaded 9026 existing records from primary storage. [2025-09-29T20:09:57.806753] [INFO ] [MAIN ] NIC: Loaded 9026 existing records. [2025-09-29T20:09:57.828497] [DEBUG] [LOCAL ] NGVT: Loaded 24631 existing records from primary storage. [2025-09-29T20:09:57.856131] [INFO ] [MAIN ] NGVT: Loaded 24631 existing records. [2025-09-29T20:09:57.867180] [DEBUG] [LOCAL ] NHI: Loaded 22283 existing records from primary storage. [2025-09-29T20:09:57.881569] [INFO ] [MAIN ] NHI: Loaded 22283 existing records. [2025-09-29T20:09:58.281765] [DEBUG] [LOCAL ] NI: Loaded 54201 existing records from primary storage. [2025-09-29T20:09:58.349801] [INFO ] [MAIN ] NI: Loaded 54201 existing records. [2025-09-29T20:09:58.380246] [WARN ] [MAIN ] NGVT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:09:58.449078] [WARN ] [MAIN ] NIC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:09:58.454391] [INFO ] [MAIN ] NGVT: Wiping existing primary data before full refresh. [2025-09-29T20:09:58.470208] [INFO ] [MAIN ] NIC: Wiping existing primary data before full refresh. [2025-09-29T20:09:58.485341] [INFO ] [LOCAL ] NGVT: Starting deletion of primary data. [2025-09-29T20:09:58.492323] [INFO ] [LOCAL ] NIC: Starting deletion of primary data. [2025-09-29T20:09:58.531243] [WARN ] [MAIN ] NHI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:09:58.539548] [DEBUG] [LOCAL ] NGVT: Deleted primary data file. [2025-09-29T20:09:58.531634] [INFO ] [MAIN ] NHI: Wiping existing primary data before full refresh. [2025-09-29T20:09:58.549329] [INFO ] [MAIN ] NGVT: Starting full primary refresh. [2025-09-29T20:09:58.539496] [DEBUG] [LOCAL ] NIC: Deleted primary data file. [2025-09-29T20:09:58.560070] [INFO ] [LOCAL ] NHI: Starting deletion of primary data. [2025-09-29T20:09:58.601128] [INFO ] [MAIN ] NIC: Starting full primary refresh. [2025-09-29T20:09:58.728844] [DEBUG] [LOCAL ] NHI: Deleted primary data file. [2025-09-29T20:09:58.742380] [INFO ] [MAIN ] NHI: Starting full primary refresh. [2025-09-29T20:09:59.067746] [WARN ] [MAIN ] NI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:09:59.090803] [INFO ] [MAIN ] NI: Wiping existing primary data before full refresh. [2025-09-29T20:09:59.152602] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-09-29T20:09:59.249262] [DEBUG] [LOCAL ] NI: Deleted primary data file. [2025-09-29T20:09:59.287132] [INFO ] [MAIN ] NI: Starting full primary refresh. [2025-09-29T20:09:59.923991] [INFO ] [REMOTE ] NGVT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:10:00.011992] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2024-12. [2025-09-29T20:10:00.099940] [INFO ] [REMOTE ] NIC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:10:00.117419] [INFO ] [REMOTE ] NIC: Fetching primary data for 2024-12. [2025-09-29T20:10:00.193161] [INFO ] [REMOTE ] NHI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:10:00.208237] [INFO ] [REMOTE ] NHI: Fetching primary data for 2024-12. [2025-09-29T20:10:00.352242] [INFO ] [REMOTE ] NI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:10:00.352589] [INFO ] [REMOTE ] NI: Fetching primary data for 2024-12. [2025-09-29T20:10:01.041730] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-29T20:10:01.044103] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-01. [2025-09-29T20:10:01.311713] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-29T20:10:01.316665] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-01. [2025-09-29T20:10:01.395579] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-29T20:10:01.400967] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-01. [2025-09-29T20:10:01.771079] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-29T20:10:01.773425] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-02. [2025-09-29T20:10:02.168697] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-29T20:10:02.180282] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-01. [2025-09-29T20:10:02.429984] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-29T20:10:02.434970] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-02. [2025-09-29T20:10:02.548603] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-29T20:10:02.617274] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-29T20:10:02.748167] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-02. [2025-09-29T20:10:03.548091] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-03. [2025-09-29T20:10:03.619550] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-29T20:10:03.694404] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-29T20:10:03.826061] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-29T20:10:04.348146] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-03. [2025-09-29T20:10:04.439853] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-29T20:10:05.148175] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-02. [2025-09-29T20:10:05.789255] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-29T20:10:05.948087] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-03. [2025-09-29T20:10:06.681223] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-29T20:10:06.748096] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-03. [2025-09-29T20:10:07.237443] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-29T20:10:07.548145] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-04. [2025-09-29T20:10:08.348098] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-04. [2025-09-29T20:10:08.399797] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-29T20:10:08.655898] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-29T20:10:09.148119] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-05. [2025-09-29T20:10:09.565823] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-29T20:10:09.948201] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-04. [2025-09-29T20:10:09.978348] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-29T20:10:10.748184] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-06. [2025-09-29T20:10:11.526704] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-29T20:10:11.548107] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-05. [2025-09-29T20:10:11.878850] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-29T20:10:12.348132] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-05. [2025-09-29T20:10:12.660015] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-29T20:10:13.148153] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-06. [2025-09-29T20:10:13.948097] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-04. [2025-09-29T20:10:14.131159] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-29T20:10:14.276496] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-29T20:10:14.748115] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-07. [2025-09-29T20:10:15.233903] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-29T20:10:15.548147] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-06. [2025-09-29T20:10:15.606151] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-29T20:10:16.348099] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-08. [2025-09-29T20:10:17.148142] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-07. [2025-09-29T20:10:17.277688] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-29T20:10:17.481117] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-29T20:10:17.705796] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-29T20:10:17.948134] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-09. [2025-09-29T20:10:18.748138] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-05. [2025-09-29T20:10:19.168456] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-29T20:10:19.173218] [INFO ] [REMOTE ] NHI: Full fetch complete (31582 records). [2025-09-29T20:10:19.173335] [DEBUG] [VALIDATOR ] NHI: Validating primary data. [2025-09-29T20:10:19.551033] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-07. [2025-09-29T20:10:19.584302] [DEBUG] [VALIDATOR ] NHI: All expected trading days are present. [2025-09-29T20:10:19.584490] [DEBUG] [VALIDATOR ] NHI: Primary data validation passed. [2025-09-29T20:10:19.585315] [INFO ] [MAIN ] NHI: Fetched primary data is valid. [2025-09-29T20:10:19.585402] [DEBUG] [LOCAL ] NHI: Saving primary data. [2025-09-29T20:10:19.586305] [DEBUG] [LOCAL ] NHI: Trimmed 31582 records to 21861 (keeping 200 days of data) [2025-09-29T20:10:19.739881] [DEBUG] [LOCAL ] NHI: Primary data saved (21861 records). [2025-09-29T20:10:19.740029] [INFO ] [MAIN ] NHI: Full history saved. [2025-09-29T20:10:19.740113] [INFO ] [MAIN ] Update Progress: 1481/2371 symbols completed. NHI took 22.7s. Estimated remaining: 1h 54m 21s. Rate: 7.8 symbols/min [2025-09-29T20:10:19.963676] [INFO ] [MAIN ] NIE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:10:19.984814] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-29T20:10:20.001145] [DEBUG] [LOCAL ] NIE: Loaded 11869 existing records from primary storage. [2025-09-29T20:10:20.001392] [INFO ] [MAIN ] NIE: Loaded 11869 existing records. [2025-09-29T20:10:20.212396] [WARN ] [MAIN ] NIE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:10:20.212753] [INFO ] [MAIN ] NIE: Wiping existing primary data before full refresh. [2025-09-29T20:10:20.212808] [INFO ] [LOCAL ] NIE: Starting deletion of primary data. [2025-09-29T20:10:20.213049] [DEBUG] [LOCAL ] NIE: Deleted primary data file. [2025-09-29T20:10:20.213110] [INFO ] [MAIN ] NIE: Starting full primary refresh. [2025-09-29T20:10:20.361213] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-06. [2025-09-29T20:10:20.608998] [INFO ] [REMOTE ] NIE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:10:21.148084] [INFO ] [REMOTE ] NIE: Fetching primary data for 2024-12. [2025-09-29T20:10:21.429893] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-29T20:10:21.473516] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-29T20:10:21.948131] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-07. [2025-09-29T20:10:22.162668] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-29T20:10:22.748125] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-08. [2025-09-29T20:10:22.962268] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-29T20:10:23.548130] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-01. [2025-09-29T20:10:24.248098] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-29T20:10:24.348087] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-08. [2025-09-29T20:10:24.553754] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-29T20:10:25.092002] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-29T20:10:25.148146] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-02. [2025-09-29T20:10:25.870610] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-29T20:10:25.948102] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-03. [2025-09-29T20:10:26.748116] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-08. [2025-09-29T20:10:26.855477] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-29T20:10:27.548119] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-04. [2025-09-29T20:10:28.020845] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-29T20:10:28.348125] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-09. [2025-09-29T20:10:28.449259] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-29T20:10:28.941403] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-29T20:10:28.943825] [INFO ] [REMOTE ] NIC: Full fetch complete (12148 records). [2025-09-29T20:10:28.943925] [DEBUG] [VALIDATOR ] NIC: Validating primary data. [2025-09-29T20:10:29.153231] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-05. [2025-09-29T20:10:29.333581] [DEBUG] [VALIDATOR ] NIC: All expected trading days are present. [2025-09-29T20:10:29.333715] [DEBUG] [VALIDATOR ] NIC: Primary data validation passed. [2025-09-29T20:10:29.334047] [INFO ] [MAIN ] NIC: Fetched primary data is valid. [2025-09-29T20:10:29.334091] [DEBUG] [LOCAL ] NIC: Saving primary data. [2025-09-29T20:10:29.334717] [DEBUG] [LOCAL ] NIC: Trimmed 12148 records to 8914 (keeping 200 days of data) [2025-09-29T20:10:29.393298] [DEBUG] [LOCAL ] NIC: Primary data saved (8914 records). [2025-09-29T20:10:29.393452] [INFO ] [MAIN ] NIC: Full history saved. [2025-09-29T20:10:29.393539] [INFO ] [MAIN ] Update Progress: 1482/2371 symbols completed. NIC took 32.4s. Estimated remaining: 1h 54m 14s. Rate: 7.8 symbols/min [2025-09-29T20:10:29.575666] [INFO ] [MAIN ] NIM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:10:29.584767] [DEBUG] [LOCAL ] NIM: Loaded 4149 existing records from primary storage. [2025-09-29T20:10:29.585027] [INFO ] [MAIN ] NIM: Loaded 4149 existing records. [2025-09-29T20:10:29.778090] [WARN ] [MAIN ] NIM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:10:29.778319] [INFO ] [MAIN ] NIM: Wiping existing primary data before full refresh. [2025-09-29T20:10:29.778407] [INFO ] [LOCAL ] NIM: Starting deletion of primary data. [2025-09-29T20:10:29.778688] [DEBUG] [LOCAL ] NIM: Deleted primary data file. [2025-09-29T20:10:29.778747] [INFO ] [MAIN ] NIM: Starting full primary refresh. [2025-09-29T20:10:29.950231] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-09. [2025-09-29T20:10:30.072348] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-29T20:10:30.192823] [INFO ] [REMOTE ] NIM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:10:30.748116] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-09. [2025-09-29T20:10:31.243337] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-29T20:10:31.251059] [INFO ] [REMOTE ] NGVT: Full fetch complete (34427 records). [2025-09-29T20:10:31.251224] [DEBUG] [VALIDATOR ] NGVT: Validating primary data. [2025-09-29T20:10:31.559388] [INFO ] [REMOTE ] NIM: Fetching primary data for 2024-12. [2025-09-29T20:10:31.688625] [DEBUG] [VALIDATOR ] NGVT: All expected trading days are present. [2025-09-29T20:10:31.688769] [DEBUG] [VALIDATOR ] NGVT: Primary data validation passed. [2025-09-29T20:10:31.689499] [INFO ] [MAIN ] NGVT: Fetched primary data is valid. [2025-09-29T20:10:31.689575] [DEBUG] [LOCAL ] NGVT: Saving primary data. [2025-09-29T20:10:31.690409] [DEBUG] [LOCAL ] NGVT: Trimmed 34427 records to 24102 (keeping 200 days of data) [2025-09-29T20:10:31.841911] [DEBUG] [LOCAL ] NGVT: Primary data saved (24102 records). [2025-09-29T20:10:31.842053] [INFO ] [MAIN ] NGVT: Full history saved. [2025-09-29T20:10:31.842163] [INFO ] [MAIN ] Update Progress: 1483/2371 symbols completed. NGVT took 34.8s. Estimated remaining: 1h 54m 3s. Rate: 7.8 symbols/min [2025-09-29T20:10:32.023223] [INFO ] [MAIN ] NINE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:10:32.058942] [DEBUG] [LOCAL ] NINE: Loaded 28624 existing records from primary storage. [2025-09-29T20:10:32.059273] [INFO ] [MAIN ] NINE: Loaded 28624 existing records. [2025-09-29T20:10:32.254546] [WARN ] [MAIN ] NINE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:10:32.254876] [INFO ] [MAIN ] NINE: Wiping existing primary data before full refresh. [2025-09-29T20:10:32.254947] [INFO ] [LOCAL ] NINE: Starting deletion of primary data. [2025-09-29T20:10:32.255208] [DEBUG] [LOCAL ] NINE: Deleted primary data file. [2025-09-29T20:10:32.255275] [INFO ] [MAIN ] NINE: Starting full primary refresh. [2025-09-29T20:10:32.353490] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-06. [2025-09-29T20:10:32.415866] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-29T20:10:32.654124] [INFO ] [REMOTE ] NINE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:10:32.687172] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-29T20:10:32.698323] [INFO ] [REMOTE ] NI: Full fetch complete (77266 records). [2025-09-29T20:10:32.698464] [DEBUG] [VALIDATOR ] NI: Validating primary data. [2025-09-29T20:10:33.131711] [DEBUG] [VALIDATOR ] NI: All expected trading days are present. [2025-09-29T20:10:33.131892] [DEBUG] [VALIDATOR ] NI: Primary data validation passed. [2025-09-29T20:10:33.133227] [INFO ] [MAIN ] NI: Fetched primary data is valid. [2025-09-29T20:10:33.133382] [DEBUG] [LOCAL ] NI: Saving primary data. [2025-09-29T20:10:33.135202] [DEBUG] [LOCAL ] NI: Trimmed 77266 records to 53420 (keeping 200 days of data) [2025-09-29T20:10:33.191257] [INFO ] [REMOTE ] NINE: Fetching primary data for 2024-12. [2025-09-29T20:10:33.243981] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-29T20:10:33.494151] [DEBUG] [LOCAL ] NI: Primary data saved (53420 records). [2025-09-29T20:10:33.494329] [INFO ] [MAIN ] NI: Full history saved. [2025-09-29T20:10:33.494449] [INFO ] [MAIN ] Update Progress: 1484/2371 symbols completed. NI took 36.5s. Estimated remaining: 1h 53m 52s. Rate: 7.8 symbols/min [2025-09-29T20:10:33.672983] [INFO ] [MAIN ] NIO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:10:33.733717] [DEBUG] [LOCAL ] NIO: Loaded 54582 existing records from primary storage. [2025-09-29T20:10:33.734072] [INFO ] [MAIN ] NIO: Loaded 54582 existing records. [2025-09-29T20:10:33.922113] [WARN ] [MAIN ] NIO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:10:33.922321] [INFO ] [MAIN ] NIO: Wiping existing primary data before full refresh. [2025-09-29T20:10:33.922376] [INFO ] [LOCAL ] NIO: Starting deletion of primary data. [2025-09-29T20:10:33.922810] [DEBUG] [LOCAL ] NIO: Deleted primary data file. [2025-09-29T20:10:33.922874] [INFO ] [MAIN ] NIO: Starting full primary refresh. [2025-09-29T20:10:33.948494] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-07. [2025-09-29T20:10:34.340483] [INFO ] [REMOTE ] NIO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:10:34.749310] [INFO ] [REMOTE ] NIO: Fetching primary data for 2024-12. [2025-09-29T20:10:34.765149] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-29T20:10:34.784226] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-29T20:10:35.548122] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-08. [2025-09-29T20:10:36.195099] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-29T20:10:36.348114] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-01. [2025-09-29T20:10:36.837555] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-29T20:10:37.148089] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-02. [2025-09-29T20:10:37.328287] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2024-12 (2.58 seconds). [2025-09-29T20:10:37.821136] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-29T20:10:37.948107] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-03. [2025-09-29T20:10:38.672911] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-29T20:10:38.748092] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-04. [2025-09-29T20:10:39.333075] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-29T20:10:39.548085] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-01. [2025-09-29T20:10:40.348173] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-01. [2025-09-29T20:10:41.148135] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-05. [2025-09-29T20:10:41.801235] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-29T20:10:41.948108] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-06. [2025-09-29T20:10:41.983327] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-09-29T20:10:42.166136] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-29T20:10:42.328582] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-29T20:10:42.748108] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-07. [2025-09-29T20:10:43.298896] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-29T20:10:43.548119] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-09. [2025-09-29T20:10:44.348122] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-02. [2025-09-29T20:10:44.433772] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-29T20:10:44.436900] [INFO ] [REMOTE ] NIE: Full fetch complete (16500 records). [2025-09-29T20:10:44.437008] [DEBUG] [VALIDATOR ] NIE: Validating primary data. [2025-09-29T20:10:44.837005] [DEBUG] [VALIDATOR ] NIE: All expected trading days are present. [2025-09-29T20:10:44.837235] [DEBUG] [VALIDATOR ] NIE: Primary data validation passed. [2025-09-29T20:10:44.837661] [INFO ] [MAIN ] NIE: Fetched primary data is valid. [2025-09-29T20:10:44.837726] [DEBUG] [LOCAL ] NIE: Saving primary data. [2025-09-29T20:10:44.838363] [DEBUG] [LOCAL ] NIE: Trimmed 16500 records to 11756 (keeping 200 days of data) [2025-09-29T20:10:44.921731] [DEBUG] [LOCAL ] NIE: Primary data saved (11756 records). [2025-09-29T20:10:44.921888] [INFO ] [MAIN ] NIE: Full history saved. [2025-09-29T20:10:44.922019] [INFO ] [MAIN ] Update Progress: 1485/2371 symbols completed. NIE took 25.2s. Estimated remaining: 1h 53m 47s. Rate: 7.8 symbols/min [2025-09-29T20:10:45.100943] [INFO ] [MAIN ] NIQ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:10:45.101168] [DEBUG] [LOCAL ] NIQ: No existing data file found in primary storage. [2025-09-29T20:10:45.101247] [WARN ] [MAIN ] NIQ: No existing data found, performing full refresh instead. [2025-09-29T20:10:45.101360] [INFO ] [MAIN ] NIQ: Wiping existing primary data before full refresh. [2025-09-29T20:10:45.101404] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-09-29T20:10:45.101449] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-09-29T20:10:45.101482] [INFO ] [MAIN ] NIQ: Starting full primary refresh. [2025-09-29T20:10:45.153309] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-08. [2025-09-29T20:10:45.487018] [INFO ] [REMOTE ] NIQ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:10:45.655106] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-29T20:10:45.948123] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-02. [2025-09-29T20:10:46.748117] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2024-12. [2025-09-29T20:10:46.801763] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-09-29T20:10:46.946738] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T20:10:46.947108] [WARN ] [REMOTE ] NIQ: No data returned for month 2024-12 [2025-09-29T20:10:46.947204] [FATAL] [REMOTE ] NIQ: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T20:10:46.947279] [FATAL] [MAIN ] NIQ: Failed to fetch primary data. [2025-09-29T20:10:46.947361] [WARN ] [MAIN ] NIQ: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T20:10:46.947454] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-09-29T20:10:46.947559] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-09-29T20:10:46.947625] [INFO ] [LOCAL ] NIQ: Starting deletion of derivative data. [2025-09-29T20:10:46.947753] [DEBUG] [LOCAL ] NIQ: No derivative data file found to delete. [2025-09-29T20:10:46.947853] [INFO ] [MAIN ] Update Progress: 1486/2371 symbols completed. NIQ took 2.0s. Estimated remaining: 1h 53m 36s. Rate: 7.8 symbols/min [2025-09-29T20:10:47.129718] [INFO ] [MAIN ] NJR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:10:47.173932] [DEBUG] [LOCAL ] NJR: Loaded 38739 existing records from primary storage. [2025-09-29T20:10:47.174231] [INFO ] [MAIN ] NJR: Loaded 38739 existing records. [2025-09-29T20:10:47.372180] [WARN ] [MAIN ] NJR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:10:47.377887] [INFO ] [MAIN ] NJR: Wiping existing primary data before full refresh. [2025-09-29T20:10:47.387579] [INFO ] [LOCAL ] NJR: Starting deletion of primary data. [2025-09-29T20:10:47.388835] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-29T20:10:47.388905] [DEBUG] [LOCAL ] NJR: Deleted primary data file. [2025-09-29T20:10:47.394816] [INFO ] [MAIN ] NJR: Starting full primary refresh. [2025-09-29T20:10:47.554120] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-09. [2025-09-29T20:10:47.794423] [INFO ] [REMOTE ] NJR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:10:48.219348] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-29T20:10:48.220750] [INFO ] [REMOTE ] NIM: Full fetch complete (6805 records). [2025-09-29T20:10:48.220855] [DEBUG] [VALIDATOR ] NIM: Validating primary data. [2025-09-29T20:10:48.353249] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-03. [2025-09-29T20:10:48.621874] [DEBUG] [VALIDATOR ] NIM: All expected trading days are present. [2025-09-29T20:10:48.621957] [DEBUG] [VALIDATOR ] NIM: Primary data validation passed. [2025-09-29T20:10:48.622209] [INFO ] [MAIN ] NIM: Fetched primary data is valid. [2025-09-29T20:10:48.622269] [DEBUG] [LOCAL ] NIM: Saving primary data. [2025-09-29T20:10:48.622853] [DEBUG] [LOCAL ] NIM: Trimmed 6805 records to 4102 (keeping 200 days of data) [2025-09-29T20:10:48.649625] [DEBUG] [LOCAL ] NIM: Primary data saved (4102 records). [2025-09-29T20:10:48.649784] [INFO ] [MAIN ] NIM: Full history saved. [2025-09-29T20:10:48.649881] [INFO ] [MAIN ] Update Progress: 1487/2371 symbols completed. NIM took 19.3s. Estimated remaining: 1h 53m 24s. Rate: 7.8 symbols/min [2025-09-29T20:10:48.837468] [INFO ] [MAIN ] NKE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:10:48.837719] [DEBUG] [LOCAL ] NKE: No existing data file found in primary storage. [2025-09-29T20:10:48.837770] [WARN ] [MAIN ] NKE: No existing data found, performing full refresh instead. [2025-09-29T20:10:48.837886] [INFO ] [MAIN ] NKE: Wiping existing primary data before full refresh. [2025-09-29T20:10:48.837928] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-09-29T20:10:48.837972] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-09-29T20:10:48.838005] [INFO ] [MAIN ] NKE: Starting full primary refresh. [2025-09-29T20:10:49.153315] [INFO ] [REMOTE ] NJR: Fetching primary data for 2024-12. [2025-09-29T20:10:49.236014] [INFO ] [REMOTE ] NKE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:10:49.805989] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-29T20:10:49.948114] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-04. [2025-09-29T20:10:50.575566] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-29T20:10:50.748140] [INFO ] [REMOTE ] NKE: Fetching primary data for 2024-12. [2025-09-29T20:10:51.305365] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-29T20:10:51.548129] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-01. [2025-09-29T20:10:52.348168] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-05. [2025-09-29T20:10:53.019549] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-29T20:10:53.148089] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-02. [2025-09-29T20:10:53.333743] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2024-12 (2.59 seconds). [2025-09-29T20:10:53.389960] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-29T20:10:53.948172] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-06. [2025-09-29T20:10:54.559397] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-29T20:10:54.748141] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-03. [2025-09-29T20:10:55.548167] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-03. [2025-09-29T20:10:55.829288] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-29T20:10:56.348109] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-01. [2025-09-29T20:10:57.137798] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-29T20:10:57.148072] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-04. [2025-09-29T20:10:57.598260] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-03 (2.85 seconds). [2025-09-29T20:10:57.948117] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-04. [2025-09-29T20:10:58.620153] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-29T20:10:58.732769] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-09-29T20:10:58.748063] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-02. [2025-09-29T20:10:59.548142] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-07. [2025-09-29T20:11:00.348132] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-05. [2025-09-29T20:11:00.603302] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-04 (2.66 seconds). [2025-09-29T20:11:01.126820] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-29T20:11:01.148081] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-08. [2025-09-29T20:11:01.321406] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-02 (2.57 seconds). [2025-09-29T20:11:01.719970] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-29T20:11:01.948145] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-06. [2025-09-29T20:11:02.390522] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-29T20:11:02.748116] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-03. [2025-09-29T20:11:03.365135] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-29T20:11:03.548172] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-07. [2025-09-29T20:11:04.348130] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-09. [2025-09-29T20:11:05.073409] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-29T20:11:05.148095] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-08. [2025-09-29T20:11:05.300185] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-09-29T20:11:05.669973] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-29T20:11:05.675080] [INFO ] [REMOTE ] NINE: Full fetch complete (44091 records). [2025-09-29T20:11:05.675228] [DEBUG] [VALIDATOR ] NINE: Validating primary data. [2025-09-29T20:11:05.954826] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-04. [2025-09-29T20:11:06.098076] [DEBUG] [VALIDATOR ] NINE: All expected trading days are present. [2025-09-29T20:11:06.098180] [DEBUG] [VALIDATOR ] NINE: Primary data validation passed. [2025-09-29T20:11:06.099209] [INFO ] [MAIN ] NINE: Fetched primary data is valid. [2025-09-29T20:11:06.099282] [DEBUG] [LOCAL ] NINE: Saving primary data. [2025-09-29T20:11:06.100736] [DEBUG] [LOCAL ] NINE: Trimmed 44091 records to 28246 (keeping 200 days of data) [2025-09-29T20:11:06.288451] [DEBUG] [LOCAL ] NINE: Primary data saved (28246 records). [2025-09-29T20:11:06.288612] [INFO ] [MAIN ] NINE: Full history saved. [2025-09-29T20:11:06.288768] [INFO ] [MAIN ] Update Progress: 1488/2371 symbols completed. NINE took 34.4s. Estimated remaining: 1h 53m 23s. Rate: 7.8 symbols/min [2025-09-29T20:11:06.480885] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-29T20:11:06.515052] [INFO ] [MAIN ] NKX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:11:06.536324] [DEBUG] [LOCAL ] NKX: Loaded 13801 existing records from primary storage. [2025-09-29T20:11:06.536580] [INFO ] [MAIN ] NKX: Loaded 13801 existing records. [2025-09-29T20:11:06.733901] [WARN ] [MAIN ] NKX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:11:06.734163] [INFO ] [MAIN ] NKX: Wiping existing primary data before full refresh. [2025-09-29T20:11:06.734231] [INFO ] [LOCAL ] NKX: Starting deletion of primary data. [2025-09-29T20:11:06.734504] [DEBUG] [LOCAL ] NKX: Deleted primary data file. [2025-09-29T20:11:06.734563] [INFO ] [MAIN ] NKX: Starting full primary refresh. [2025-09-29T20:11:06.755919] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-09. [2025-09-29T20:11:07.119882] [INFO ] [REMOTE ] NKX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:11:07.548158] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-05. [2025-09-29T20:11:08.348116] [INFO ] [REMOTE ] NKX: Fetching primary data for 2024-12. [2025-09-29T20:11:08.490825] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-29T20:11:08.500334] [INFO ] [REMOTE ] NJR: Full fetch complete (54559 records). [2025-09-29T20:11:08.500467] [DEBUG] [VALIDATOR ] NJR: Validating primary data. [2025-09-29T20:11:08.970719] [DEBUG] [VALIDATOR ] NJR: All expected trading days are present. [2025-09-29T20:11:08.974583] [DEBUG] [VALIDATOR ] NJR: Primary data validation passed. [2025-09-29T20:11:08.976102] [INFO ] [MAIN ] NJR: Fetched primary data is valid. [2025-09-29T20:11:08.977000] [DEBUG] [LOCAL ] NJR: Saving primary data. [2025-09-29T20:11:08.979068] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-04 (3.02 seconds). [2025-09-29T20:11:09.001535] [DEBUG] [LOCAL ] NJR: Trimmed 54559 records to 38049 (keeping 200 days of data) [2025-09-29T20:11:09.008908] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-29T20:11:09.148158] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-01. [2025-09-29T20:11:09.271413] [DEBUG] [LOCAL ] NJR: Primary data saved (38049 records). [2025-09-29T20:11:09.271582] [INFO ] [MAIN ] NJR: Full history saved. [2025-09-29T20:11:09.271727] [INFO ] [MAIN ] Update Progress: 1489/2371 symbols completed. NJR took 22.3s. Estimated remaining: 1h 53m 12s. Rate: 7.8 symbols/min [2025-09-29T20:11:09.453363] [INFO ] [MAIN ] NL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:11:09.453553] [DEBUG] [LOCAL ] NL: No existing data file found in primary storage. [2025-09-29T20:11:09.453593] [WARN ] [MAIN ] NL: No existing data found, performing full refresh instead. [2025-09-29T20:11:09.453733] [INFO ] [MAIN ] NL: Wiping existing primary data before full refresh. [2025-09-29T20:11:09.453781] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-09-29T20:11:09.453830] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-09-29T20:11:09.453899] [INFO ] [MAIN ] NL: Starting full primary refresh. [2025-09-29T20:11:09.845003] [INFO ] [REMOTE ] NL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:11:09.948106] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-05. [2025-09-29T20:11:10.003972] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-29T20:11:10.120663] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-05 (2.57 seconds). [2025-09-29T20:11:10.748117] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-06. [2025-09-29T20:11:11.548111] [INFO ] [REMOTE ] NL: Fetching primary data for 2024-12. [2025-09-29T20:11:12.146261] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-29T20:11:12.348097] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-01. [2025-09-29T20:11:12.655200] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-05 (2.71 seconds). [2025-09-29T20:11:12.965396] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-29T20:11:13.148131] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-06. [2025-09-29T20:11:13.182921] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-09-29T20:11:13.948116] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-07. [2025-09-29T20:11:14.748163] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-02. [2025-09-29T20:11:15.548154] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-02. [2025-09-29T20:11:15.607792] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-29T20:11:15.609954] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-09-29T20:11:16.160909] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-29T20:11:16.348110] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-03. [2025-09-29T20:11:16.541488] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-09-29T20:11:16.861786] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-29T20:11:17.148122] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-07. [2025-09-29T20:11:17.948122] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-08. [2025-09-29T20:11:18.748145] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-04. [2025-09-29T20:11:19.426801] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-29T20:11:19.548092] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-05. [2025-09-29T20:11:19.771240] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-09-29T20:11:20.138161] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-29T20:11:20.348151] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-06. [2025-09-29T20:11:20.560427] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-08 (2.61 seconds). [2025-09-29T20:11:20.825383] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-29T20:11:21.148118] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-07. [2025-09-29T20:11:21.569872] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-29T20:11:21.948142] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-08. [2025-09-29T20:11:22.748122] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-03. [2025-09-29T20:11:23.548171] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-08. [2025-09-29T20:11:23.649272] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-29T20:11:24.139344] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-29T20:11:24.265340] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-29T20:11:24.348137] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-09. [2025-09-29T20:11:25.148116] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-04. [2025-09-29T20:11:25.948103] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-09. [2025-09-29T20:11:26.130711] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-29T20:11:26.748117] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-05. [2025-09-29T20:11:26.755230] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-29T20:11:26.757498] [INFO ] [REMOTE ] NL: Full fetch complete (6904 records). [2025-09-29T20:11:26.757608] [DEBUG] [VALIDATOR ] NL: Validating primary data. [2025-09-29T20:11:26.955202] [WARN ] [VALIDATOR ] NL: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-29T20:11:26.955554] [FATAL] [MAIN ] NL: Fetched primary data is invalid. Refusing to save it. [2025-09-29T20:11:26.955738] [WARN ] [MAIN ] NL: Deleting existing primary and derivative data due to validation failure. [2025-09-29T20:11:26.955860] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-09-29T20:11:26.956031] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-09-29T20:11:26.956211] [INFO ] [LOCAL ] NL: Starting deletion of derivative data. [2025-09-29T20:11:26.956376] [DEBUG] [LOCAL ] NL: No derivative data file found to delete. [2025-09-29T20:11:26.956773] [INFO ] [MAIN ] Update Progress: 1490/2371 symbols completed. NL took 17.7s. Estimated remaining: 1h 53m 10s. Rate: 7.8 symbols/min [2025-09-29T20:11:27.139059] [INFO ] [MAIN ] NLOP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:11:27.171920] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-09 (2.82 seconds). [2025-09-29T20:11:27.186044] [INFO ] [REMOTE ] NKE: Full fetch complete (77197 records). [2025-09-29T20:11:27.186282] [DEBUG] [VALIDATOR ] NKE: Validating primary data. [2025-09-29T20:11:27.269439] [DEBUG] [LOCAL ] NLOP: Loaded 11997 existing records from primary storage. [2025-09-29T20:11:27.292213] [INFO ] [MAIN ] NLOP: Loaded 11997 existing records. [2025-09-29T20:11:27.549592] [WARN ] [VALIDATOR ] NKE: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-29T20:11:27.555118] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-09. [2025-09-29T20:11:27.613286] [FATAL] [MAIN ] NKE: Fetched primary data is invalid. Refusing to save it. [2025-09-29T20:11:27.624230] [WARN ] [MAIN ] NKE: Deleting existing primary and derivative data due to validation failure. [2025-09-29T20:11:27.615834] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-29T20:11:27.632955] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-09-29T20:11:27.630579] [WARN ] [MAIN ] NLOP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:11:27.633116] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-09-29T20:11:27.634075] [INFO ] [LOCAL ] NKE: Starting deletion of derivative data. [2025-09-29T20:11:27.634242] [DEBUG] [LOCAL ] NKE: No derivative data file found to delete. [2025-09-29T20:11:27.634165] [INFO ] [MAIN ] NLOP: Wiping existing primary data before full refresh. [2025-09-29T20:11:27.634328] [INFO ] [MAIN ] Update Progress: 1491/2371 symbols completed. NKE took 39.0s. Estimated remaining: 1h 52m 58s. Rate: 7.8 symbols/min [2025-09-29T20:11:27.667280] [INFO ] [LOCAL ] NLOP: Starting deletion of primary data. [2025-09-29T20:11:27.721249] [DEBUG] [LOCAL ] NLOP: Deleted primary data file. [2025-09-29T20:11:27.744340] [INFO ] [MAIN ] NLOP: Starting full primary refresh. [2025-09-29T20:11:27.993410] [INFO ] [MAIN ] NLY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:11:28.261546] [INFO ] [REMOTE ] NLOP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:11:28.283904] [DEBUG] [LOCAL ] NLY: Loaded 54358 existing records from primary storage. [2025-09-29T20:11:28.284270] [INFO ] [MAIN ] NLY: Loaded 54358 existing records. [2025-09-29T20:11:28.353285] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2024-12. [2025-09-29T20:11:28.466443] [WARN ] [MAIN ] NLY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:11:28.466639] [INFO ] [MAIN ] NLY: Wiping existing primary data before full refresh. [2025-09-29T20:11:28.466721] [INFO ] [LOCAL ] NLY: Starting deletion of primary data. [2025-09-29T20:11:28.467038] [DEBUG] [LOCAL ] NLY: Deleted primary data file. [2025-09-29T20:11:28.467131] [INFO ] [MAIN ] NLY: Starting full primary refresh. [2025-09-29T20:11:28.843206] [INFO ] [REMOTE ] NLY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:11:29.148121] [INFO ] [REMOTE ] NLY: Fetching primary data for 2024-12. [2025-09-29T20:11:29.260525] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-29T20:11:29.948090] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-01. [2025-09-29T20:11:30.410977] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-09 (2.86 seconds). [2025-09-29T20:11:30.423183] [INFO ] [REMOTE ] NIO: Full fetch complete (77974 records). [2025-09-29T20:11:30.423361] [DEBUG] [VALIDATOR ] NIO: Validating primary data. [2025-09-29T20:11:30.753040] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-06. [2025-09-29T20:11:30.841170] [DEBUG] [VALIDATOR ] NIO: All expected trading days are present. [2025-09-29T20:11:30.841730] [DEBUG] [VALIDATOR ] NIO: Primary data validation passed. [2025-09-29T20:11:30.843180] [INFO ] [MAIN ] NIO: Fetched primary data is valid. [2025-09-29T20:11:30.843403] [DEBUG] [LOCAL ] NIO: Saving primary data. [2025-09-29T20:11:30.846781] [DEBUG] [LOCAL ] NIO: Trimmed 77974 records to 53802 (keeping 200 days of data) [2025-09-29T20:11:30.954337] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-29T20:11:31.137303] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-29T20:11:31.241857] [DEBUG] [LOCAL ] NIO: Primary data saved (53802 records). [2025-09-29T20:11:31.242013] [INFO ] [MAIN ] NIO: Full history saved. [2025-09-29T20:11:31.242105] [INFO ] [MAIN ] Update Progress: 1492/2371 symbols completed. NIO took 57.7s. Estimated remaining: 1h 52m 48s. Rate: 7.8 symbols/min [2025-09-29T20:11:31.421753] [INFO ] [MAIN ] NMAI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:11:31.441464] [DEBUG] [LOCAL ] NMAI: Loaded 13181 existing records from primary storage. [2025-09-29T20:11:31.441794] [INFO ] [MAIN ] NMAI: Loaded 13181 existing records. [2025-09-29T20:11:31.550732] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-01. [2025-09-29T20:11:31.652310] [WARN ] [MAIN ] NMAI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:11:31.652518] [INFO ] [MAIN ] NMAI: Wiping existing primary data before full refresh. [2025-09-29T20:11:31.652567] [INFO ] [LOCAL ] NMAI: Starting deletion of primary data. [2025-09-29T20:11:31.652925] [DEBUG] [LOCAL ] NMAI: Deleted primary data file. [2025-09-29T20:11:31.652985] [INFO ] [MAIN ] NMAI: Starting full primary refresh. [2025-09-29T20:11:31.997900] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-29T20:11:32.056941] [INFO ] [REMOTE ] NMAI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:11:32.348121] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-07. [2025-09-29T20:11:33.148162] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2024-12. [2025-09-29T20:11:33.294606] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-29T20:11:33.363918] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-29T20:11:33.948113] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-08. [2025-09-29T20:11:34.088887] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-29T20:11:34.748116] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-02. [2025-09-29T20:11:34.767091] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-29T20:11:35.548132] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-01. [2025-09-29T20:11:36.348103] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-09. [2025-09-29T20:11:36.477591] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-29T20:11:36.514237] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-29T20:11:37.148105] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-02. [2025-09-29T20:11:37.232119] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-29T20:11:37.235548] [INFO ] [REMOTE ] NKX: Full fetch complete (19352 records). [2025-09-29T20:11:37.235627] [DEBUG] [VALIDATOR ] NKX: Validating primary data. [2025-09-29T20:11:37.644988] [DEBUG] [VALIDATOR ] NKX: All expected trading days are present. [2025-09-29T20:11:37.645109] [DEBUG] [VALIDATOR ] NKX: Primary data validation passed. [2025-09-29T20:11:37.645616] [INFO ] [MAIN ] NKX: Fetched primary data is valid. [2025-09-29T20:11:37.645722] [DEBUG] [LOCAL ] NKX: Saving primary data. [2025-09-29T20:11:37.646488] [DEBUG] [LOCAL ] NKX: Trimmed 19352 records to 13526 (keeping 200 days of data) [2025-09-29T20:11:37.740388] [DEBUG] [LOCAL ] NKX: Primary data saved (13526 records). [2025-09-29T20:11:37.740592] [INFO ] [MAIN ] NKX: Full history saved. [2025-09-29T20:11:37.741054] [INFO ] [MAIN ] Update Progress: 1493/2371 symbols completed. NKX took 31.5s. Estimated remaining: 1h 52m 40s. Rate: 7.8 symbols/min [2025-09-29T20:11:37.919045] [INFO ] [MAIN ] NMAX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:11:37.919210] [DEBUG] [LOCAL ] NMAX: No existing data file found in primary storage. [2025-09-29T20:11:37.919250] [WARN ] [MAIN ] NMAX: No existing data found, performing full refresh instead. [2025-09-29T20:11:37.919403] [INFO ] [MAIN ] NMAX: Wiping existing primary data before full refresh. [2025-09-29T20:11:37.919473] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-09-29T20:11:37.919534] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-09-29T20:11:37.919569] [INFO ] [MAIN ] NMAX: Starting full primary refresh. [2025-09-29T20:11:37.952542] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-02. [2025-09-29T20:11:38.039879] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-29T20:11:38.307236] [INFO ] [REMOTE ] NMAX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:11:38.748100] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-03. [2025-09-29T20:11:38.819235] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-29T20:11:39.548076] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-03. [2025-09-29T20:11:39.626915] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-29T20:11:40.202423] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-29T20:11:40.348129] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-04. [2025-09-29T20:11:41.148118] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2024-12. [2025-09-29T20:11:41.347702] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-29T20:11:41.356925] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T20:11:41.357193] [WARN ] [REMOTE ] NMAX: No data returned for month 2024-12 [2025-09-29T20:11:41.357286] [FATAL] [REMOTE ] NMAX: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T20:11:41.357355] [FATAL] [MAIN ] NMAX: Failed to fetch primary data. [2025-09-29T20:11:41.357420] [WARN ] [MAIN ] NMAX: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T20:11:41.357491] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-09-29T20:11:41.357558] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-09-29T20:11:41.357596] [INFO ] [LOCAL ] NMAX: Starting deletion of derivative data. [2025-09-29T20:11:41.357732] [DEBUG] [LOCAL ] NMAX: No derivative data file found to delete. [2025-09-29T20:11:41.357789] [INFO ] [MAIN ] Update Progress: 1494/2371 symbols completed. NMAX took 3.6s. Estimated remaining: 1h 52m 30s. Rate: 7.8 symbols/min [2025-09-29T20:11:41.546489] [INFO ] [MAIN ] NMCO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:11:41.568771] [DEBUG] [LOCAL ] NMCO: Loaded 16803 existing records from primary storage. [2025-09-29T20:11:41.569061] [INFO ] [MAIN ] NMCO: Loaded 16803 existing records. [2025-09-29T20:11:41.775120] [WARN ] [MAIN ] NMCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:11:41.775405] [INFO ] [MAIN ] NMCO: Wiping existing primary data before full refresh. [2025-09-29T20:11:41.775497] [INFO ] [LOCAL ] NMCO: Starting deletion of primary data. [2025-09-29T20:11:41.775852] [DEBUG] [LOCAL ] NMCO: Deleted primary data file. [2025-09-29T20:11:41.775927] [INFO ] [MAIN ] NMCO: Starting full primary refresh. [2025-09-29T20:11:41.961367] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-03. [2025-09-29T20:11:42.170214] [INFO ] [REMOTE ] NMCO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:11:42.748139] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-04. [2025-09-29T20:11:43.548186] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-05. [2025-09-29T20:11:43.597270] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-29T20:11:44.123581] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-29T20:11:44.341589] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-29T20:11:44.348062] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-06. [2025-09-29T20:11:44.920034] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-29T20:11:45.148141] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-05. [2025-09-29T20:11:45.921516] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-29T20:11:45.948078] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-06. [2025-09-29T20:11:46.748105] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2024-12. [2025-09-29T20:11:46.847929] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-29T20:11:47.548134] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-07. [2025-09-29T20:11:47.887404] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-29T20:11:48.316226] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-29T20:11:48.348138] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-08. [2025-09-29T20:11:49.148143] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-04. [2025-09-29T20:11:49.280181] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-29T20:11:49.948133] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-01. [2025-09-29T20:11:50.748142] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-09. [2025-09-29T20:11:50.840891] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-29T20:11:51.316406] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-29T20:11:51.392344] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-29T20:11:51.395619] [INFO ] [REMOTE ] NLOP: Full fetch complete (17734 records). [2025-09-29T20:11:51.395763] [DEBUG] [VALIDATOR ] NLOP: Validating primary data. [2025-09-29T20:11:51.553184] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-07. [2025-09-29T20:11:51.811890] [DEBUG] [VALIDATOR ] NLOP: All expected trading days are present. [2025-09-29T20:11:51.812024] [DEBUG] [VALIDATOR ] NLOP: Primary data validation passed. [2025-09-29T20:11:51.812806] [INFO ] [MAIN ] NLOP: Fetched primary data is valid. [2025-09-29T20:11:51.812913] [DEBUG] [LOCAL ] NLOP: Saving primary data. [2025-09-29T20:11:51.814391] [DEBUG] [LOCAL ] NLOP: Trimmed 17734 records to 11780 (keeping 200 days of data) [2025-09-29T20:11:51.893926] [DEBUG] [LOCAL ] NLOP: Primary data saved (11780 records). [2025-09-29T20:11:51.894078] [INFO ] [MAIN ] NLOP: Full history saved. [2025-09-29T20:11:51.894216] [INFO ] [MAIN ] Update Progress: 1495/2371 symbols completed. NLOP took 24.9s. Estimated remaining: 1h 52m 24s. Rate: 7.8 symbols/min [2025-09-29T20:11:52.082493] [INFO ] [MAIN ] NMG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:11:52.093811] [DEBUG] [LOCAL ] NMG: Loaded 7913 existing records from primary storage. [2025-09-29T20:11:52.094046] [INFO ] [MAIN ] NMG: Loaded 7913 existing records. [2025-09-29T20:11:52.289980] [WARN ] [MAIN ] NMG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:11:52.290272] [INFO ] [MAIN ] NMG: Wiping existing primary data before full refresh. [2025-09-29T20:11:52.290327] [INFO ] [LOCAL ] NMG: Starting deletion of primary data. [2025-09-29T20:11:52.290616] [DEBUG] [LOCAL ] NMG: Deleted primary data file. [2025-09-29T20:11:52.290723] [INFO ] [MAIN ] NMG: Starting full primary refresh. [2025-09-29T20:11:52.354402] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-02. [2025-09-29T20:11:52.670742] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-29T20:11:52.701129] [INFO ] [REMOTE ] NMG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:11:53.148117] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-08. [2025-09-29T20:11:53.213357] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-29T20:11:53.948112] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-03. [2025-09-29T20:11:54.072498] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-29T20:11:54.745816] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-29T20:11:54.749266] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-05. [2025-09-29T20:11:55.548124] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-04. [2025-09-29T20:11:56.348087] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-09. [2025-09-29T20:11:56.672283] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-29T20:11:56.806899] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-29T20:11:57.148079] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-06. [2025-09-29T20:11:57.315033] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-29T20:11:57.318471] [INFO ] [REMOTE ] NMAI: Full fetch complete (19941 records). [2025-09-29T20:11:57.318574] [DEBUG] [VALIDATOR ] NMAI: Validating primary data. [2025-09-29T20:11:57.698379] [DEBUG] [VALIDATOR ] NMAI: All expected trading days are present. [2025-09-29T20:11:57.698462] [DEBUG] [VALIDATOR ] NMAI: Primary data validation passed. [2025-09-29T20:11:57.698964] [INFO ] [MAIN ] NMAI: Fetched primary data is valid. [2025-09-29T20:11:57.699040] [DEBUG] [LOCAL ] NMAI: Saving primary data. [2025-09-29T20:11:57.699966] [DEBUG] [LOCAL ] NMAI: Trimmed 19941 records to 12900 (keeping 200 days of data) [2025-09-29T20:11:57.786431] [DEBUG] [LOCAL ] NMAI: Primary data saved (12900 records). [2025-09-29T20:11:57.786629] [INFO ] [MAIN ] NMAI: Full history saved. [2025-09-29T20:11:57.786758] [INFO ] [MAIN ] Update Progress: 1496/2371 symbols completed. NMAI took 26.5s. Estimated remaining: 1h 52m 15s. Rate: 7.8 symbols/min [2025-09-29T20:11:57.965887] [INFO ] [MAIN ] NMI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:11:57.961710] [INFO ] [REMOTE ] NMG: Fetching primary data for 2024-12. [2025-09-29T20:11:57.975074] [DEBUG] [LOCAL ] NMI: Loaded 4091 existing records from primary storage. [2025-09-29T20:11:57.975296] [INFO ] [MAIN ] NMI: Loaded 4091 existing records. [2025-09-29T20:11:58.179625] [WARN ] [MAIN ] NMI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:11:58.179863] [INFO ] [MAIN ] NMI: Wiping existing primary data before full refresh. [2025-09-29T20:11:58.179913] [INFO ] [LOCAL ] NMI: Starting deletion of primary data. [2025-09-29T20:11:58.180154] [DEBUG] [LOCAL ] NMI: Deleted primary data file. [2025-09-29T20:11:58.180213] [INFO ] [MAIN ] NMI: Starting full primary refresh. [2025-09-29T20:11:58.555674] [INFO ] [REMOTE ] NMI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:11:58.748101] [INFO ] [REMOTE ] NMI: Fetching primary data for 2024-12. [2025-09-29T20:11:58.936851] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-29T20:11:59.015951] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-29T20:11:59.424499] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-29T20:11:59.548136] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-05. [2025-09-29T20:12:00.348110] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-01. [2025-09-29T20:12:00.475802] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-29T20:12:01.148110] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-07. [2025-09-29T20:12:01.307101] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-29T20:12:01.948111] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-06. [2025-09-29T20:12:02.748094] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-02. [2025-09-29T20:12:02.908502] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-29T20:12:03.047457] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-29T20:12:03.164982] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-29T20:12:03.548108] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-03. [2025-09-29T20:12:04.244112] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-29T20:12:04.348130] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-07. [2025-09-29T20:12:05.148122] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-04. [2025-09-29T20:12:05.297093] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-29T20:12:05.920933] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-29T20:12:05.948075] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-05. [2025-09-29T20:12:06.657027] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-29T20:12:06.748086] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-08. [2025-09-29T20:12:07.548120] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-06. [2025-09-29T20:12:07.752715] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-29T20:12:08.190019] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-29T20:12:08.348161] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-08. [2025-09-29T20:12:09.148129] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-09. [2025-09-29T20:12:09.948110] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-07. [2025-09-29T20:12:10.242546] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-29T20:12:10.255320] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-29T20:12:10.261191] [INFO ] [REMOTE ] NMCO: Full fetch complete (24464 records). [2025-09-29T20:12:10.261338] [DEBUG] [VALIDATOR ] NMCO: Validating primary data. [2025-09-29T20:12:10.665102] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-29T20:12:10.698466] [DEBUG] [VALIDATOR ] NMCO: All expected trading days are present. [2025-09-29T20:12:10.698547] [DEBUG] [VALIDATOR ] NMCO: Primary data validation passed. [2025-09-29T20:12:10.699146] [INFO ] [MAIN ] NMCO: Fetched primary data is valid. [2025-09-29T20:12:10.699212] [DEBUG] [LOCAL ] NMCO: Saving primary data. [2025-09-29T20:12:10.699941] [DEBUG] [LOCAL ] NMCO: Trimmed 24464 records to 16721 (keeping 200 days of data) [2025-09-29T20:12:10.751385] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-08. [2025-09-29T20:12:10.816427] [DEBUG] [LOCAL ] NMCO: Primary data saved (16721 records). [2025-09-29T20:12:10.816780] [INFO ] [MAIN ] NMCO: Full history saved. [2025-09-29T20:12:10.816933] [INFO ] [MAIN ] Update Progress: 1497/2371 symbols completed. NMCO took 29.5s. Estimated remaining: 1h 52m 10s. Rate: 7.8 symbols/min [2025-09-29T20:12:11.008549] [INFO ] [MAIN ] NMM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:12:11.027407] [DEBUG] [LOCAL ] NMM: Loaded 14470 existing records from primary storage. [2025-09-29T20:12:11.027711] [INFO ] [MAIN ] NMM: Loaded 14470 existing records. [2025-09-29T20:12:11.219915] [WARN ] [MAIN ] NMM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:12:11.220163] [INFO ] [MAIN ] NMM: Wiping existing primary data before full refresh. [2025-09-29T20:12:11.220215] [INFO ] [LOCAL ] NMM: Starting deletion of primary data. [2025-09-29T20:12:11.220478] [DEBUG] [LOCAL ] NMM: Deleted primary data file. [2025-09-29T20:12:11.220538] [INFO ] [MAIN ] NMM: Starting full primary refresh. [2025-09-29T20:12:11.536159] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-29T20:12:11.548741] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-09. [2025-09-29T20:12:11.622864] [INFO ] [REMOTE ] NMM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:12:12.348124] [INFO ] [REMOTE ] NMM: Fetching primary data for 2024-12. [2025-09-29T20:12:13.148080] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-09. [2025-09-29T20:12:13.368255] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-29T20:12:13.677686] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-29T20:12:13.689008] [INFO ] [REMOTE ] NLY: Full fetch complete (77566 records). [2025-09-29T20:12:13.689152] [DEBUG] [VALIDATOR ] NLY: Validating primary data. [2025-09-29T20:12:13.953318] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-01. [2025-09-29T20:12:14.130717] [DEBUG] [VALIDATOR ] NLY: All expected trading days are present. [2025-09-29T20:12:14.130843] [DEBUG] [VALIDATOR ] NLY: Primary data validation passed. [2025-09-29T20:12:14.132212] [INFO ] [MAIN ] NLY: Fetched primary data is valid. [2025-09-29T20:12:14.132285] [DEBUG] [LOCAL ] NLY: Saving primary data. [2025-09-29T20:12:14.134003] [DEBUG] [LOCAL ] NLY: Trimmed 77566 records to 53580 (keeping 200 days of data) [2025-09-29T20:12:14.243111] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-29T20:12:14.247088] [INFO ] [REMOTE ] NMG: Full fetch complete (13208 records). [2025-09-29T20:12:14.247455] [DEBUG] [VALIDATOR ] NMG: Validating primary data. [2025-09-29T20:12:14.646603] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-29T20:12:14.685000] [DEBUG] [VALIDATOR ] NMG: All expected trading days are present. [2025-09-29T20:12:14.687906] [DEBUG] [VALIDATOR ] NMG: Primary data validation passed. [2025-09-29T20:12:14.688587] [INFO ] [MAIN ] NMG: Fetched primary data is valid. [2025-09-29T20:12:14.689201] [DEBUG] [LOCAL ] NMG: Saving primary data. [2025-09-29T20:12:14.691442] [DEBUG] [LOCAL ] NMG: Trimmed 13208 records to 8008 (keeping 200 days of data) [2025-09-29T20:12:14.748101] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-02. [2025-09-29T20:12:14.749133] [DEBUG] [LOCAL ] NMG: Primary data saved (8008 records). [2025-09-29T20:12:14.751575] [INFO ] [MAIN ] NMG: Full history saved. [2025-09-29T20:12:14.752073] [INFO ] [MAIN ] Update Progress: 1498/2371 symbols completed. NMG took 22.9s. Estimated remaining: 1h 52m 0s. Rate: 7.8 symbols/min [2025-09-29T20:12:15.051668] [INFO ] [MAIN ] NMR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:12:15.182966] [DEBUG] [LOCAL ] NMR: Loaded 35569 existing records from primary storage. [2025-09-29T20:12:15.184539] [INFO ] [MAIN ] NMR: Loaded 35569 existing records. [2025-09-29T20:12:15.391687] [WARN ] [MAIN ] NMR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:12:15.395867] [INFO ] [MAIN ] NMR: Wiping existing primary data before full refresh. [2025-09-29T20:12:15.395984] [INFO ] [LOCAL ] NMR: Starting deletion of primary data. [2025-09-29T20:12:15.400382] [DEBUG] [LOCAL ] NMR: Deleted primary data file. [2025-09-29T20:12:15.401825] [INFO ] [MAIN ] NMR: Starting full primary refresh. [2025-09-29T20:12:15.402418] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-29T20:12:15.552415] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-01. [2025-09-29T20:12:15.593685] [DEBUG] [LOCAL ] NLY: Primary data saved (53580 records). [2025-09-29T20:12:15.614706] [INFO ] [MAIN ] NLY: Full history saved. [2025-09-29T20:12:15.623427] [INFO ] [MAIN ] Update Progress: 1499/2371 symbols completed. NLY took 48.0s. Estimated remaining: 1h 51m 49s. Rate: 7.8 symbols/min [2025-09-29T20:12:15.997140] [INFO ] [REMOTE ] NMR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:12:16.019677] [INFO ] [MAIN ] NMS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:12:16.025334] [DEBUG] [LOCAL ] NMS: Loaded 2893 existing records from primary storage. [2025-09-29T20:12:16.025517] [INFO ] [MAIN ] NMS: Loaded 2893 existing records. [2025-09-29T20:12:16.214951] [WARN ] [MAIN ] NMS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:12:16.215163] [INFO ] [MAIN ] NMS: Wiping existing primary data before full refresh. [2025-09-29T20:12:16.215212] [INFO ] [LOCAL ] NMS: Starting deletion of primary data. [2025-09-29T20:12:16.215425] [DEBUG] [LOCAL ] NMS: Deleted primary data file. [2025-09-29T20:12:16.215485] [INFO ] [MAIN ] NMS: Starting full primary refresh. [2025-09-29T20:12:16.361966] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-03. [2025-09-29T20:12:16.641943] [INFO ] [REMOTE ] NMS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:12:16.655151] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-29T20:12:16.938162] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-29T20:12:17.148135] [INFO ] [REMOTE ] NMS: Fetching primary data for 2024-12. [2025-09-29T20:12:17.597764] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-29T20:12:17.948120] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-01. [2025-09-29T20:12:18.416689] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-29T20:12:18.748122] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-02. [2025-09-29T20:12:19.291276] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-29T20:12:19.548116] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-03. [2025-09-29T20:12:20.002139] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-29T20:12:20.348150] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-02. [2025-09-29T20:12:21.148125] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-04. [2025-09-29T20:12:21.358485] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-29T20:12:21.601194] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-29T20:12:21.948104] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-03. [2025-09-29T20:12:22.748126] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-04. [2025-09-29T20:12:22.917477] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-29T20:12:23.325059] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-29T20:12:23.548131] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-05. [2025-09-29T20:12:24.121125] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-29T20:12:24.348111] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-06. [2025-09-29T20:12:24.818261] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-29T20:12:25.148129] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-05. [2025-09-29T20:12:25.755522] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-29T20:12:25.948105] [INFO ] [REMOTE ] NMR: Fetching primary data for 2024-12. [2025-09-29T20:12:26.748073] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-04. [2025-09-29T20:12:27.211272] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-29T20:12:27.548094] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-06. [2025-09-29T20:12:27.810294] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-29T20:12:28.053894] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-29T20:12:28.348086] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-07. [2025-09-29T20:12:28.959130] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-29T20:12:29.148112] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-07. [2025-09-29T20:12:29.676865] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-29T20:12:29.948143] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-01. [2025-09-29T20:12:30.748125] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-08. [2025-09-29T20:12:31.424139] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-29T20:12:31.437235] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-29T20:12:31.548117] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-02. [2025-09-29T20:12:32.348143] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-08. [2025-09-29T20:12:32.909108] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-29T20:12:32.933861] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-29T20:12:33.148116] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-09. [2025-09-29T20:12:33.766389] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-29T20:12:33.767722] [INFO ] [REMOTE ] NMS: Full fetch complete (4025 records). [2025-09-29T20:12:33.767799] [DEBUG] [VALIDATOR ] NMS: Validating primary data. [2025-09-29T20:12:33.951392] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-05. [2025-09-29T20:12:34.147192] [DEBUG] [VALIDATOR ] NMS: All expected trading days are present. [2025-09-29T20:12:34.147277] [DEBUG] [VALIDATOR ] NMS: Primary data validation passed. [2025-09-29T20:12:34.147410] [INFO ] [MAIN ] NMS: Fetched primary data is valid. [2025-09-29T20:12:34.147450] [DEBUG] [LOCAL ] NMS: Saving primary data. [2025-09-29T20:12:34.148007] [DEBUG] [LOCAL ] NMS: Trimmed 4025 records to 2854 (keeping 200 days of data) [2025-09-29T20:12:34.166970] [DEBUG] [LOCAL ] NMS: Primary data saved (2854 records). [2025-09-29T20:12:34.167105] [INFO ] [MAIN ] NMS: Full history saved. [2025-09-29T20:12:34.167241] [INFO ] [MAIN ] Update Progress: 1500/2371 symbols completed. NMS took 18.5s. Estimated remaining: 1h 51m 47s. Rate: 7.8 symbols/min [2025-09-29T20:12:34.347238] [INFO ] [MAIN ] NMT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:12:34.353544] [DEBUG] [LOCAL ] NMT: Loaded 2884 existing records from primary storage. [2025-09-29T20:12:34.353780] [INFO ] [MAIN ] NMT: Loaded 2884 existing records. [2025-09-29T20:12:34.549288] [WARN ] [MAIN ] NMT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:12:34.549544] [INFO ] [MAIN ] NMT: Wiping existing primary data before full refresh. [2025-09-29T20:12:34.549594] [INFO ] [LOCAL ] NMT: Starting deletion of primary data. [2025-09-29T20:12:34.549988] [DEBUG] [LOCAL ] NMT: Deleted primary data file. [2025-09-29T20:12:34.550049] [INFO ] [MAIN ] NMT: Starting full primary refresh. [2025-09-29T20:12:34.754487] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-09. [2025-09-29T20:12:34.937264] [INFO ] [REMOTE ] NMT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:12:34.945929] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-29T20:12:35.523739] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-29T20:12:35.525226] [INFO ] [REMOTE ] NMI: Full fetch complete (6150 records). [2025-09-29T20:12:35.525299] [DEBUG] [VALIDATOR ] NMI: Validating primary data. [2025-09-29T20:12:35.554851] [INFO ] [REMOTE ] NMT: Fetching primary data for 2024-12. [2025-09-29T20:12:35.903599] [DEBUG] [VALIDATOR ] NMI: All expected trading days are present. [2025-09-29T20:12:35.903708] [DEBUG] [VALIDATOR ] NMI: Primary data validation passed. [2025-09-29T20:12:35.903880] [INFO ] [MAIN ] NMI: Fetched primary data is valid. [2025-09-29T20:12:35.903921] [DEBUG] [LOCAL ] NMI: Saving primary data. [2025-09-29T20:12:35.904313] [DEBUG] [LOCAL ] NMI: Trimmed 6150 records to 4049 (keeping 200 days of data) [2025-09-29T20:12:35.928916] [DEBUG] [LOCAL ] NMI: Primary data saved (4049 records). [2025-09-29T20:12:35.929016] [INFO ] [MAIN ] NMI: Full history saved. [2025-09-29T20:12:35.929095] [INFO ] [MAIN ] Update Progress: 1501/2371 symbols completed. NMI took 38.1s. Estimated remaining: 1h 51m 36s. Rate: 7.8 symbols/min [2025-09-29T20:12:36.103095] [INFO ] [MAIN ] NMZ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:12:36.130007] [DEBUG] [LOCAL ] NMZ: Loaded 21872 existing records from primary storage. [2025-09-29T20:12:36.130448] [INFO ] [MAIN ] NMZ: Loaded 21872 existing records. [2025-09-29T20:12:36.246039] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-29T20:12:36.327316] [WARN ] [MAIN ] NMZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:12:36.327576] [INFO ] [MAIN ] NMZ: Wiping existing primary data before full refresh. [2025-09-29T20:12:36.327689] [INFO ] [LOCAL ] NMZ: Starting deletion of primary data. [2025-09-29T20:12:36.328056] [DEBUG] [LOCAL ] NMZ: Deleted primary data file. [2025-09-29T20:12:36.328114] [INFO ] [MAIN ] NMZ: Starting full primary refresh. [2025-09-29T20:12:36.357242] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-03. [2025-09-29T20:12:36.701837] [INFO ] [REMOTE ] NMZ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:12:37.148116] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-01. [2025-09-29T20:12:37.608347] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-29T20:12:37.886160] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-29T20:12:37.948095] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-06. [2025-09-29T20:12:38.748113] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2024-12. [2025-09-29T20:12:39.000832] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-29T20:12:39.548084] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-07. [2025-09-29T20:12:39.943107] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-29T20:12:40.348142] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-01. [2025-09-29T20:12:40.439492] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-29T20:12:41.148154] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-08. [2025-09-29T20:12:41.500247] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-29T20:12:41.948083] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-02. [2025-09-29T20:12:42.323674] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-29T20:12:42.447325] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-29T20:12:42.748128] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-02. [2025-09-29T20:12:43.548193] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-03. [2025-09-29T20:12:43.808699] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-29T20:12:44.029789] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-29T20:12:44.348127] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-04. [2025-09-29T20:12:44.922092] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-29T20:12:45.148126] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-05. [2025-09-29T20:12:45.723846] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-29T20:12:45.948134] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-03. [2025-09-29T20:12:46.748118] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-09. [2025-09-29T20:12:46.977858] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-29T20:12:47.548171] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-04. [2025-09-29T20:12:47.737835] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-29T20:12:47.741325] [INFO ] [REMOTE ] NMM: Full fetch complete (22165 records). [2025-09-29T20:12:47.741410] [DEBUG] [VALIDATOR ] NMM: Validating primary data. [2025-09-29T20:12:48.143461] [DEBUG] [VALIDATOR ] NMM: All expected trading days are present. [2025-09-29T20:12:48.143580] [DEBUG] [VALIDATOR ] NMM: Primary data validation passed. [2025-09-29T20:12:48.144147] [INFO ] [MAIN ] NMM: Fetched primary data is valid. [2025-09-29T20:12:48.144216] [DEBUG] [LOCAL ] NMM: Saving primary data. [2025-09-29T20:12:48.145123] [DEBUG] [LOCAL ] NMM: Trimmed 22165 records to 14289 (keeping 200 days of data) [2025-09-29T20:12:48.238081] [DEBUG] [LOCAL ] NMM: Primary data saved (14289 records). [2025-09-29T20:12:48.238231] [INFO ] [MAIN ] NMM: Full history saved. [2025-09-29T20:12:48.238316] [INFO ] [MAIN ] Update Progress: 1502/2371 symbols completed. NMM took 37.4s. Estimated remaining: 1h 51m 31s. Rate: 7.8 symbols/min [2025-09-29T20:12:48.351014] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-04. [2025-09-29T20:12:48.430489] [INFO ] [MAIN ] NNI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:12:48.446604] [DEBUG] [LOCAL ] NNI: Loaded 10159 existing records from primary storage. [2025-09-29T20:12:48.446897] [INFO ] [MAIN ] NNI: Loaded 10159 existing records. [2025-09-29T20:12:48.640347] [WARN ] [MAIN ] NNI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:12:48.640555] [INFO ] [MAIN ] NNI: Wiping existing primary data before full refresh. [2025-09-29T20:12:48.640604] [INFO ] [LOCAL ] NNI: Starting deletion of primary data. [2025-09-29T20:12:48.640947] [DEBUG] [LOCAL ] NNI: Deleted primary data file. [2025-09-29T20:12:48.641008] [INFO ] [MAIN ] NNI: Starting full primary refresh. [2025-09-29T20:12:49.008974] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-29T20:12:49.074811] [INFO ] [REMOTE ] NNI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:12:49.148101] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-06. [2025-09-29T20:12:49.648538] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-29T20:12:49.948136] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-05. [2025-09-29T20:12:49.996750] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-29T20:12:50.748138] [INFO ] [REMOTE ] NNI: Fetching primary data for 2024-12. [2025-09-29T20:12:51.023286] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-29T20:12:51.523771] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-29T20:12:51.548117] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-01. [2025-09-29T20:12:52.206344] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-29T20:12:52.348130] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-02. [2025-09-29T20:12:53.096552] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-29T20:12:53.148106] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-06. [2025-09-29T20:12:53.948109] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-07. [2025-09-29T20:12:54.234679] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-29T20:12:54.402521] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-29T20:12:54.748124] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-08. [2025-09-29T20:12:55.289882] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-29T20:12:55.548086] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-07. [2025-09-29T20:12:56.348138] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-09. [2025-09-29T20:12:56.765250] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-29T20:12:57.074145] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-29T20:12:57.075386] [INFO ] [REMOTE ] NMT: Full fetch complete (4171 records). [2025-09-29T20:12:57.075460] [DEBUG] [VALIDATOR ] NMT: Validating primary data. [2025-09-29T20:12:57.153279] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-03. [2025-09-29T20:12:57.457792] [DEBUG] [VALIDATOR ] NMT: All expected trading days are present. [2025-09-29T20:12:57.457936] [DEBUG] [VALIDATOR ] NMT: Primary data validation passed. [2025-09-29T20:12:57.458087] [INFO ] [MAIN ] NMT: Fetched primary data is valid. [2025-09-29T20:12:57.458129] [DEBUG] [LOCAL ] NMT: Saving primary data. [2025-09-29T20:12:57.458496] [DEBUG] [LOCAL ] NMT: Trimmed 4171 records to 2846 (keeping 200 days of data) [2025-09-29T20:12:57.478992] [DEBUG] [LOCAL ] NMT: Primary data saved (2846 records). [2025-09-29T20:12:57.479124] [INFO ] [MAIN ] NMT: Full history saved. [2025-09-29T20:12:57.479229] [INFO ] [MAIN ] Update Progress: 1503/2371 symbols completed. NMT took 23.3s. Estimated remaining: 1h 51m 24s. Rate: 7.8 symbols/min [2025-09-29T20:12:57.652205] [INFO ] [MAIN ] NNN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:12:57.707292] [DEBUG] [LOCAL ] NNN: Loaded 49151 existing records from primary storage. [2025-09-29T20:12:57.707622] [INFO ] [MAIN ] NNN: Loaded 49151 existing records. [2025-09-29T20:12:57.903622] [WARN ] [MAIN ] NNN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:12:57.903915] [INFO ] [MAIN ] NNN: Wiping existing primary data before full refresh. [2025-09-29T20:12:57.903974] [INFO ] [LOCAL ] NNN: Starting deletion of primary data. [2025-09-29T20:12:57.904396] [DEBUG] [LOCAL ] NNN: Deleted primary data file. [2025-09-29T20:12:57.904479] [INFO ] [MAIN ] NNN: Starting full primary refresh. [2025-09-29T20:12:57.948210] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-08. [2025-09-29T20:12:57.995348] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-29T20:12:58.297101] [INFO ] [REMOTE ] NNN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:12:58.748143] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-04. [2025-09-29T20:12:59.000401] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-29T20:12:59.539680] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-29T20:12:59.548056] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-05. [2025-09-29T20:13:00.348100] [INFO ] [REMOTE ] NNN: Fetching primary data for 2024-12. [2025-09-29T20:13:00.417732] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-29T20:13:01.148159] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-05. [2025-09-29T20:13:01.948111] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-06. [2025-09-29T20:13:02.011256] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-29T20:13:02.719961] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-29T20:13:02.743759] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-29T20:13:02.751102] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-07. [2025-09-29T20:13:03.548181] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-06. [2025-09-29T20:13:03.652749] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-29T20:13:04.348159] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-08. [2025-09-29T20:13:04.857954] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-29T20:13:05.148123] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-09. [2025-09-29T20:13:05.221315] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-29T20:13:05.948103] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-09. [2025-09-29T20:13:06.323109] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-29T20:13:06.328188] [INFO ] [REMOTE ] NMZ: Full fetch complete (31951 records). [2025-09-29T20:13:06.328273] [DEBUG] [VALIDATOR ] NMZ: Validating primary data. [2025-09-29T20:13:06.716165] [DEBUG] [VALIDATOR ] NMZ: All expected trading days are present. [2025-09-29T20:13:06.716326] [DEBUG] [VALIDATOR ] NMZ: Primary data validation passed. [2025-09-29T20:13:06.717117] [INFO ] [MAIN ] NMZ: Fetched primary data is valid. [2025-09-29T20:13:06.717182] [DEBUG] [LOCAL ] NMZ: Saving primary data. [2025-09-29T20:13:06.718086] [DEBUG] [LOCAL ] NMZ: Trimmed 31951 records to 21748 (keeping 200 days of data) [2025-09-29T20:13:06.773855] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-01. [2025-09-29T20:13:06.862552] [DEBUG] [LOCAL ] NMZ: Primary data saved (21748 records). [2025-09-29T20:13:06.862723] [INFO ] [MAIN ] NMZ: Full history saved. [2025-09-29T20:13:06.862833] [INFO ] [MAIN ] Update Progress: 1504/2371 symbols completed. NMZ took 30.9s. Estimated remaining: 1h 51m 18s. Rate: 7.8 symbols/min [2025-09-29T20:13:07.002318] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-29T20:13:07.026342] [INFO ] [REMOTE ] NNI: Full fetch complete (12776 records). [2025-09-29T20:13:07.058099] [DEBUG] [VALIDATOR ] NNI: Validating primary data. [2025-09-29T20:13:07.094699] [INFO ] [MAIN ] NNY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:13:07.234693] [DEBUG] [LOCAL ] NNY: Loaded 5750 existing records from primary storage. [2025-09-29T20:13:07.245544] [INFO ] [MAIN ] NNY: Loaded 5750 existing records. [2025-09-29T20:13:07.550726] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-07. [2025-09-29T20:13:07.669671] [WARN ] [MAIN ] NNY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:13:07.702842] [INFO ] [MAIN ] NNY: Wiping existing primary data before full refresh. [2025-09-29T20:13:07.739855] [DEBUG] [VALIDATOR ] NNI: All expected trading days are present. [2025-09-29T20:13:07.739636] [INFO ] [LOCAL ] NNY: Starting deletion of primary data. [2025-09-29T20:13:07.739995] [DEBUG] [VALIDATOR ] NNI: Primary data validation passed. [2025-09-29T20:13:07.740362] [INFO ] [MAIN ] NNI: Fetched primary data is valid. [2025-09-29T20:13:07.740435] [DEBUG] [LOCAL ] NNI: Saving primary data. [2025-09-29T20:13:07.740885] [DEBUG] [LOCAL ] NNY: Deleted primary data file. [2025-09-29T20:13:07.741162] [INFO ] [MAIN ] NNY: Starting full primary refresh. [2025-09-29T20:13:07.746580] [DEBUG] [LOCAL ] NNI: Trimmed 12776 records to 10094 (keeping 200 days of data) [2025-09-29T20:13:08.190624] [INFO ] [REMOTE ] NNY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:13:08.199711] [DEBUG] [LOCAL ] NNI: Primary data saved (10094 records). [2025-09-29T20:13:08.199877] [INFO ] [MAIN ] NNI: Full history saved. [2025-09-29T20:13:08.199990] [INFO ] [MAIN ] Update Progress: 1505/2371 symbols completed. NNI took 20.0s. Estimated remaining: 1h 51m 6s. Rate: 7.8 symbols/min [2025-09-29T20:13:08.351183] [INFO ] [REMOTE ] NNY: Fetching primary data for 2024-12. [2025-09-29T20:13:08.378616] [INFO ] [MAIN ] NOA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:13:08.400706] [DEBUG] [LOCAL ] NOA: Loaded 16497 existing records from primary storage. [2025-09-29T20:13:08.400996] [INFO ] [MAIN ] NOA: Loaded 16497 existing records. [2025-09-29T20:13:08.603297] [WARN ] [MAIN ] NOA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:13:08.604224] [INFO ] [MAIN ] NOA: Wiping existing primary data before full refresh. [2025-09-29T20:13:08.604378] [INFO ] [LOCAL ] NOA: Starting deletion of primary data. [2025-09-29T20:13:08.604997] [DEBUG] [LOCAL ] NOA: Deleted primary data file. [2025-09-29T20:13:08.605074] [INFO ] [MAIN ] NOA: Starting full primary refresh. [2025-09-29T20:13:08.901104] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-29T20:13:09.061570] [INFO ] [REMOTE ] NOA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:13:09.154350] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-02. [2025-09-29T20:13:09.177469] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-29T20:13:09.179132] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-29T20:13:09.948116] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-01. [2025-09-29T20:13:10.553573] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-29T20:13:10.748114] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-08. [2025-09-29T20:13:10.781153] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-29T20:13:11.548161] [INFO ] [REMOTE ] NOA: Fetching primary data for 2024-12. [2025-09-29T20:13:12.195996] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-29T20:13:12.348108] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-09. [2025-09-29T20:13:12.362876] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-29T20:13:13.148141] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-01. [2025-09-29T20:13:13.821043] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-29T20:13:13.828483] [INFO ] [REMOTE ] NMR: Full fetch complete (50327 records). [2025-09-29T20:13:13.828630] [DEBUG] [VALIDATOR ] NMR: Validating primary data. [2025-09-29T20:13:13.953175] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-02. [2025-09-29T20:13:14.157254] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-29T20:13:14.241707] [DEBUG] [VALIDATOR ] NMR: All expected trading days are present. [2025-09-29T20:13:14.241799] [DEBUG] [VALIDATOR ] NMR: Primary data validation passed. [2025-09-29T20:13:14.242787] [INFO ] [MAIN ] NMR: Fetched primary data is valid. [2025-09-29T20:13:14.242853] [DEBUG] [LOCAL ] NMR: Saving primary data. [2025-09-29T20:13:14.246044] [DEBUG] [LOCAL ] NMR: Trimmed 50327 records to 34961 (keeping 200 days of data) [2025-09-29T20:13:14.461035] [DEBUG] [LOCAL ] NMR: Primary data saved (34961 records). [2025-09-29T20:13:14.461179] [INFO ] [MAIN ] NMR: Full history saved. [2025-09-29T20:13:14.461278] [INFO ] [MAIN ] Update Progress: 1506/2371 symbols completed. NMR took 59.7s. Estimated remaining: 1h 50m 58s. Rate: 7.8 symbols/min [2025-09-29T20:13:14.647856] [INFO ] [MAIN ] NOAH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:13:14.654481] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-29T20:13:14.677532] [DEBUG] [LOCAL ] NOAH: Loaded 20358 existing records from primary storage. [2025-09-29T20:13:14.677860] [INFO ] [MAIN ] NOAH: Loaded 20358 existing records. [2025-09-29T20:13:14.753296] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-02. [2025-09-29T20:13:14.877843] [WARN ] [MAIN ] NOAH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:13:14.878062] [INFO ] [MAIN ] NOAH: Wiping existing primary data before full refresh. [2025-09-29T20:13:14.878111] [INFO ] [LOCAL ] NOAH: Starting deletion of primary data. [2025-09-29T20:13:14.878396] [DEBUG] [LOCAL ] NOAH: Deleted primary data file. [2025-09-29T20:13:14.878457] [INFO ] [MAIN ] NOAH: Starting full primary refresh. [2025-09-29T20:13:15.250860] [INFO ] [REMOTE ] NOAH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:13:15.548123] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2024-12. [2025-09-29T20:13:15.724118] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-29T20:13:16.348127] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-03. [2025-09-29T20:13:16.920539] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-29T20:13:16.972994] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-29T20:13:17.148193] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-01. [2025-09-29T20:13:17.947271] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-29T20:13:17.950633] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-04. [2025-09-29T20:13:18.741204] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-29T20:13:18.748087] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-05. [2025-09-29T20:13:19.352605] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-29T20:13:19.548148] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-03. [2025-09-29T20:13:20.348099] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-06. [2025-09-29T20:13:20.633171] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-29T20:13:20.988202] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-29T20:13:21.148140] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-07. [2025-09-29T20:13:21.623858] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-29T20:13:21.948135] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-08. [2025-09-29T20:13:22.598921] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-29T20:13:22.748089] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-02. [2025-09-29T20:13:23.548134] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-09. [2025-09-29T20:13:23.738761] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-29T20:13:24.276068] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-29T20:13:24.278077] [INFO ] [REMOTE ] NNY: Full fetch complete (8837 records). [2025-09-29T20:13:24.278215] [DEBUG] [VALIDATOR ] NNY: Validating primary data. [2025-09-29T20:13:24.356842] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-03. [2025-09-29T20:13:24.683760] [DEBUG] [VALIDATOR ] NNY: All expected trading days are present. [2025-09-29T20:13:24.683844] [DEBUG] [VALIDATOR ] NNY: Primary data validation passed. [2025-09-29T20:13:24.684090] [INFO ] [MAIN ] NNY: Fetched primary data is valid. [2025-09-29T20:13:24.684130] [DEBUG] [LOCAL ] NNY: Saving primary data. [2025-09-29T20:13:24.684572] [DEBUG] [LOCAL ] NNY: Trimmed 8837 records to 5683 (keeping 200 days of data) [2025-09-29T20:13:24.719992] [DEBUG] [LOCAL ] NNY: Primary data saved (5683 records). [2025-09-29T20:13:24.720151] [INFO ] [MAIN ] NNY: Full history saved. [2025-09-29T20:13:24.720280] [INFO ] [MAIN ] Update Progress: 1507/2371 symbols completed. NNY took 17.9s. Estimated remaining: 1h 50m 52s. Rate: 7.8 symbols/min [2025-09-29T20:13:24.901923] [INFO ] [MAIN ] NOC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:13:24.970787] [DEBUG] [LOCAL ] NOC: Loaded 43141 existing records from primary storage. [2025-09-29T20:13:24.971143] [INFO ] [MAIN ] NOC: Loaded 43141 existing records. [2025-09-29T20:13:25.159241] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-04. [2025-09-29T20:13:25.165429] [WARN ] [MAIN ] NOC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:13:25.166452] [INFO ] [MAIN ] NOC: Wiping existing primary data before full refresh. [2025-09-29T20:13:25.166509] [INFO ] [LOCAL ] NOC: Starting deletion of primary data. [2025-09-29T20:13:25.167295] [DEBUG] [LOCAL ] NOC: Deleted primary data file. [2025-09-29T20:13:25.167396] [INFO ] [MAIN ] NOC: Starting full primary refresh. [2025-09-29T20:13:25.595553] [INFO ] [REMOTE ] NOC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:13:25.948118] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-03. [2025-09-29T20:13:26.049302] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-29T20:13:26.338991] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-29T20:13:26.570366] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-29T20:13:26.748110] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-04. [2025-09-29T20:13:27.548123] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-04. [2025-09-29T20:13:27.976717] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-29T20:13:28.348125] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-05. [2025-09-29T20:13:29.148100] [INFO ] [REMOTE ] NOC: Fetching primary data for 2024-12. [2025-09-29T20:13:29.261201] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-29T20:13:29.291051] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-29T20:13:29.948107] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-05. [2025-09-29T20:13:30.748098] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-06. [2025-09-29T20:13:30.776489] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-29T20:13:31.548135] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-05. [2025-09-29T20:13:31.599224] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-29T20:13:31.601548] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-29T20:13:32.348094] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-07. [2025-09-29T20:13:32.421758] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-29T20:13:33.148124] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-06. [2025-09-29T20:13:33.211146] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-29T20:13:33.948092] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-08. [2025-09-29T20:13:34.253402] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-29T20:13:34.748115] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-07. [2025-09-29T20:13:34.836437] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-29T20:13:35.548148] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-01. [2025-09-29T20:13:35.744528] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-29T20:13:36.348120] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-06. [2025-09-29T20:13:37.148090] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-08. [2025-09-29T20:13:37.184815] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-29T20:13:37.932415] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-29T20:13:37.948067] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-07. [2025-09-29T20:13:38.218859] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-29T20:13:38.748107] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-02. [2025-09-29T20:13:39.548094] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-09. [2025-09-29T20:13:39.683573] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-29T20:13:40.095298] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-29T20:13:40.348107] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-08. [2025-09-29T20:13:40.713894] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-29T20:13:40.719129] [INFO ] [REMOTE ] NOAH: Full fetch complete (28658 records). [2025-09-29T20:13:40.719230] [DEBUG] [VALIDATOR ] NOAH: Validating primary data. [2025-09-29T20:13:41.116532] [DEBUG] [VALIDATOR ] NOAH: All expected trading days are present. [2025-09-29T20:13:41.116618] [DEBUG] [VALIDATOR ] NOAH: Primary data validation passed. [2025-09-29T20:13:41.117422] [INFO ] [MAIN ] NOAH: Fetched primary data is valid. [2025-09-29T20:13:41.117488] [DEBUG] [LOCAL ] NOAH: Saving primary data. [2025-09-29T20:13:41.118589] [DEBUG] [LOCAL ] NOAH: Trimmed 28658 records to 20185 (keeping 200 days of data) [2025-09-29T20:13:41.174762] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-03. [2025-09-29T20:13:41.259286] [DEBUG] [LOCAL ] NOAH: Primary data saved (20185 records). [2025-09-29T20:13:41.259424] [INFO ] [MAIN ] NOAH: Full history saved. [2025-09-29T20:13:41.259553] [INFO ] [MAIN ] Update Progress: 1508/2371 symbols completed. NOAH took 26.8s. Estimated remaining: 1h 50m 49s. Rate: 7.8 symbols/min [2025-09-29T20:13:41.444083] [INFO ] [MAIN ] NOG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:13:41.502673] [DEBUG] [LOCAL ] NOG: Loaded 51932 existing records from primary storage. [2025-09-29T20:13:41.503711] [INFO ] [MAIN ] NOG: Loaded 51932 existing records. [2025-09-29T20:13:41.700938] [WARN ] [MAIN ] NOG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:13:41.701219] [INFO ] [MAIN ] NOG: Wiping existing primary data before full refresh. [2025-09-29T20:13:41.701277] [INFO ] [LOCAL ] NOG: Starting deletion of primary data. [2025-09-29T20:13:41.701620] [DEBUG] [LOCAL ] NOG: Deleted primary data file. [2025-09-29T20:13:41.701717] [INFO ] [MAIN ] NOG: Starting full primary refresh. [2025-09-29T20:13:41.955101] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-09. [2025-09-29T20:13:42.114271] [INFO ] [REMOTE ] NOG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:13:42.144794] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-29T20:13:42.748097] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-09. [2025-09-29T20:13:43.020339] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-29T20:13:43.150812] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-29T20:13:43.154635] [INFO ] [REMOTE ] NOA: Full fetch complete (21840 records). [2025-09-29T20:13:43.154759] [DEBUG] [VALIDATOR ] NOA: Validating primary data. [2025-09-29T20:13:43.561910] [DEBUG] [VALIDATOR ] NOA: All expected trading days are present. [2025-09-29T20:13:43.559875] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-04. [2025-09-29T20:13:43.563129] [DEBUG] [VALIDATOR ] NOA: Primary data validation passed. [2025-09-29T20:13:43.563742] [INFO ] [MAIN ] NOA: Fetched primary data is valid. [2025-09-29T20:13:43.563820] [DEBUG] [LOCAL ] NOA: Saving primary data. [2025-09-29T20:13:43.564970] [DEBUG] [LOCAL ] NOA: Trimmed 21840 records to 16234 (keeping 200 days of data) [2025-09-29T20:13:43.683868] [DEBUG] [LOCAL ] NOA: Primary data saved (16234 records). [2025-09-29T20:13:43.684048] [INFO ] [MAIN ] NOA: Full history saved. [2025-09-29T20:13:43.684143] [INFO ] [MAIN ] Update Progress: 1509/2371 symbols completed. NOA took 35.5s. Estimated remaining: 1h 50m 38s. Rate: 7.8 symbols/min [2025-09-29T20:13:43.873796] [INFO ] [MAIN ] NOK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:13:43.940932] [DEBUG] [LOCAL ] NOK: Loaded 54401 existing records from primary storage. [2025-09-29T20:13:43.941310] [INFO ] [MAIN ] NOK: Loaded 54401 existing records. [2025-09-29T20:13:44.136749] [WARN ] [MAIN ] NOK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:13:44.137203] [INFO ] [MAIN ] NOK: Wiping existing primary data before full refresh. [2025-09-29T20:13:44.137284] [INFO ] [LOCAL ] NOK: Starting deletion of primary data. [2025-09-29T20:13:44.137706] [DEBUG] [LOCAL ] NOK: Deleted primary data file. [2025-09-29T20:13:44.137766] [INFO ] [MAIN ] NOK: Starting full primary refresh. [2025-09-29T20:13:44.350505] [INFO ] [REMOTE ] NOG: Fetching primary data for 2024-12. [2025-09-29T20:13:44.566809] [INFO ] [REMOTE ] NOK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:13:44.599307] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-29T20:13:44.610241] [INFO ] [REMOTE ] NNN: Full fetch complete (70248 records). [2025-09-29T20:13:44.610406] [DEBUG] [VALIDATOR ] NNN: Validating primary data. [2025-09-29T20:13:45.022409] [DEBUG] [VALIDATOR ] NNN: All expected trading days are present. [2025-09-29T20:13:45.022501] [DEBUG] [VALIDATOR ] NNN: Primary data validation passed. [2025-09-29T20:13:45.023629] [INFO ] [MAIN ] NNN: Fetched primary data is valid. [2025-09-29T20:13:45.023716] [DEBUG] [LOCAL ] NNN: Saving primary data. [2025-09-29T20:13:45.025237] [DEBUG] [LOCAL ] NNN: Trimmed 70248 records to 48364 (keeping 200 days of data) [2025-09-29T20:13:45.148360] [INFO ] [REMOTE ] NOK: Fetching primary data for 2024-12. [2025-09-29T20:13:45.358936] [DEBUG] [LOCAL ] NNN: Primary data saved (48364 records). [2025-09-29T20:13:45.359080] [INFO ] [MAIN ] NNN: Full history saved. [2025-09-29T20:13:45.359202] [INFO ] [MAIN ] Update Progress: 1510/2371 symbols completed. NNN took 47.9s. Estimated remaining: 1h 50m 27s. Rate: 7.8 symbols/min [2025-09-29T20:13:45.559381] [INFO ] [MAIN ] NOM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:13:45.559600] [DEBUG] [LOCAL ] NOM: No existing data file found in primary storage. [2025-09-29T20:13:45.559802] [WARN ] [MAIN ] NOM: No existing data found, performing full refresh instead. [2025-09-29T20:13:45.560094] [INFO ] [MAIN ] NOM: Wiping existing primary data before full refresh. [2025-09-29T20:13:45.560302] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-09-29T20:13:45.560366] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-09-29T20:13:45.560405] [INFO ] [MAIN ] NOM: Starting full primary refresh. [2025-09-29T20:13:45.674517] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-29T20:13:45.954799] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-05. [2025-09-29T20:13:46.013191] [INFO ] [REMOTE ] NOM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:13:46.059971] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-29T20:13:46.748141] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-01. [2025-09-29T20:13:47.224946] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-29T20:13:47.387139] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-29T20:13:47.548133] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-01. [2025-09-29T20:13:48.348104] [INFO ] [REMOTE ] NOM: Fetching primary data for 2024-12. [2025-09-29T20:13:48.384510] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-29T20:13:48.804460] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-29T20:13:49.148134] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-06. [2025-09-29T20:13:49.395921] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-29T20:13:49.948099] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-02. [2025-09-29T20:13:50.603027] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-29T20:13:50.748157] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-01. [2025-09-29T20:13:51.087437] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-29T20:13:51.553964] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-02. [2025-09-29T20:13:51.578858] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-29T20:13:51.949713] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-29T20:13:52.348108] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-03. [2025-09-29T20:13:52.790048] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-29T20:13:53.148151] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-02. [2025-09-29T20:13:53.948151] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-03. [2025-09-29T20:13:54.748123] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-04. [2025-09-29T20:13:55.092817] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-29T20:13:55.108354] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-29T20:13:55.329203] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-29T20:13:55.548106] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-03. [2025-09-29T20:13:56.348113] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-05. [2025-09-29T20:13:56.719727] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-29T20:13:57.148119] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-04. [2025-09-29T20:13:57.948118] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-06. [2025-09-29T20:13:58.206258] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-09-29T20:13:58.422794] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-03 (2.87 seconds). [2025-09-29T20:13:58.597179] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-29T20:13:58.748164] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-07. [2025-09-29T20:13:59.548156] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-07. [2025-09-29T20:13:59.979881] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-29T20:14:00.348147] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-08. [2025-09-29T20:14:00.683190] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-29T20:14:00.758257] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-29T20:14:01.148157] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-05. [2025-09-29T20:14:01.948185] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-08. [2025-09-29T20:14:02.748123] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-09. [2025-09-29T20:14:02.952718] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-29T20:14:03.351611] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-29T20:14:03.352702] [INFO ] [REMOTE ] NOM: Full fetch complete (1622 records). [2025-09-29T20:14:03.352781] [DEBUG] [VALIDATOR ] NOM: Validating primary data. [2025-09-29T20:14:03.559931] [WARN ] [VALIDATOR ] NOM: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-09-29T20:14:03.560532] [FATAL] [MAIN ] NOM: Fetched primary data is invalid. Refusing to save it. [2025-09-29T20:14:03.552033] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-04. [2025-09-29T20:14:03.561961] [WARN ] [MAIN ] NOM: Deleting existing primary and derivative data due to validation failure. [2025-09-29T20:14:03.562189] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-09-29T20:14:03.562300] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-09-29T20:14:03.562450] [INFO ] [LOCAL ] NOM: Starting deletion of derivative data. [2025-09-29T20:14:03.562759] [DEBUG] [LOCAL ] NOM: No derivative data file found to delete. [2025-09-29T20:14:03.562875] [INFO ] [MAIN ] Update Progress: 1511/2371 symbols completed. NOM took 18.2s. Estimated remaining: 1h 50m 25s. Rate: 7.8 symbols/min [2025-09-29T20:14:03.740529] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-29T20:14:03.829307] [INFO ] [MAIN ] NOMD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:14:03.880101] [DEBUG] [LOCAL ] NOMD: Loaded 42016 existing records from primary storage. [2025-09-29T20:14:03.880452] [INFO ] [MAIN ] NOMD: Loaded 42016 existing records. [2025-09-29T20:14:04.066667] [WARN ] [MAIN ] NOMD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:14:04.066879] [INFO ] [MAIN ] NOMD: Wiping existing primary data before full refresh. [2025-09-29T20:14:04.066928] [INFO ] [LOCAL ] NOMD: Starting deletion of primary data. [2025-09-29T20:14:04.067562] [DEBUG] [LOCAL ] NOMD: Deleted primary data file. [2025-09-29T20:14:04.067623] [INFO ] [MAIN ] NOMD: Starting full primary refresh. [2025-09-29T20:14:04.355351] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-06. [2025-09-29T20:14:04.463976] [INFO ] [REMOTE ] NOMD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:14:05.148125] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2024-12. [2025-09-29T20:14:05.805838] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-29T20:14:05.948119] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-05. [2025-09-29T20:14:06.102788] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-29T20:14:06.602741] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-29T20:14:06.748139] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-07. [2025-09-29T20:14:07.548099] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-09. [2025-09-29T20:14:07.992103] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-29T20:14:08.348126] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-01. [2025-09-29T20:14:08.497506] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-29T20:14:09.148128] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-08. [2025-09-29T20:14:09.292779] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-29T20:14:09.300773] [INFO ] [REMOTE ] NOC: Full fetch complete (61982 records). [2025-09-29T20:14:09.300915] [DEBUG] [VALIDATOR ] NOC: Validating primary data. [2025-09-29T20:14:09.763081] [DEBUG] [VALIDATOR ] NOC: All expected trading days are present. [2025-09-29T20:14:09.759331] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-29T20:14:09.771589] [DEBUG] [VALIDATOR ] NOC: Primary data validation passed. [2025-09-29T20:14:09.773437] [INFO ] [MAIN ] NOC: Fetched primary data is valid. [2025-09-29T20:14:09.773926] [DEBUG] [LOCAL ] NOC: Saving primary data. [2025-09-29T20:14:09.775586] [DEBUG] [LOCAL ] NOC: Trimmed 61982 records to 42285 (keeping 200 days of data) [2025-09-29T20:14:09.994186] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-06. [2025-09-29T20:14:10.093634] [DEBUG] [LOCAL ] NOC: Primary data saved (42285 records). [2025-09-29T20:14:10.094059] [INFO ] [MAIN ] NOC: Full history saved. [2025-09-29T20:14:10.094229] [INFO ] [MAIN ] Update Progress: 1512/2371 symbols completed. NOC took 45.4s. Estimated remaining: 1h 50m 17s. Rate: 7.8 symbols/min [2025-09-29T20:14:10.281221] [INFO ] [MAIN ] NOTE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:14:10.325405] [DEBUG] [LOCAL ] NOTE: Loaded 43143 existing records from primary storage. [2025-09-29T20:14:10.325872] [INFO ] [MAIN ] NOTE: Loaded 43143 existing records. [2025-09-29T20:14:10.513873] [WARN ] [MAIN ] NOTE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:14:10.514326] [INFO ] [MAIN ] NOTE: Wiping existing primary data before full refresh. [2025-09-29T20:14:10.514434] [INFO ] [LOCAL ] NOTE: Starting deletion of primary data. [2025-09-29T20:14:10.515286] [DEBUG] [LOCAL ] NOTE: Deleted primary data file. [2025-09-29T20:14:10.515367] [INFO ] [MAIN ] NOTE: Starting full primary refresh. [2025-09-29T20:14:10.751419] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-02. [2025-09-29T20:14:10.932455] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-29T20:14:10.938929] [INFO ] [REMOTE ] NOTE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:14:11.548090] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-09. [2025-09-29T20:14:11.971613] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-29T20:14:12.152945] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-29T20:14:12.348145] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-07. [2025-09-29T20:14:13.148541] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2024-12. [2025-09-29T20:14:13.425664] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-29T20:14:13.436275] [INFO ] [REMOTE ] NOG: Full fetch complete (73765 records). [2025-09-29T20:14:13.436475] [DEBUG] [VALIDATOR ] NOG: Validating primary data. [2025-09-29T20:14:13.848521] [DEBUG] [VALIDATOR ] NOG: All expected trading days are present. [2025-09-29T20:14:13.848617] [DEBUG] [VALIDATOR ] NOG: Primary data validation passed. [2025-09-29T20:14:13.849719] [INFO ] [MAIN ] NOG: Fetched primary data is valid. [2025-09-29T20:14:13.849818] [DEBUG] [LOCAL ] NOG: Saving primary data. [2025-09-29T20:14:13.851397] [DEBUG] [LOCAL ] NOG: Trimmed 73765 records to 51168 (keeping 200 days of data) [2025-09-29T20:14:13.949707] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-03. [2025-09-29T20:14:14.197191] [DEBUG] [LOCAL ] NOG: Primary data saved (51168 records). [2025-09-29T20:14:14.197394] [INFO ] [MAIN ] NOG: Full history saved. [2025-09-29T20:14:14.197578] [INFO ] [MAIN ] Update Progress: 1513/2371 symbols completed. NOG took 32.9s. Estimated remaining: 1h 50m 7s. Rate: 7.8 symbols/min [2025-09-29T20:14:14.385959] [INFO ] [MAIN ] NOV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:14:14.448677] [DEBUG] [LOCAL ] NOV: Loaded 53961 existing records from primary storage. [2025-09-29T20:14:14.449028] [INFO ] [MAIN ] NOV: Loaded 53961 existing records. [2025-09-29T20:14:14.646964] [WARN ] [MAIN ] NOV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:14:14.647399] [INFO ] [MAIN ] NOV: Wiping existing primary data before full refresh. [2025-09-29T20:14:14.647461] [INFO ] [LOCAL ] NOV: Starting deletion of primary data. [2025-09-29T20:14:14.658221] [DEBUG] [LOCAL ] NOV: Deleted primary data file. [2025-09-29T20:14:14.675832] [INFO ] [MAIN ] NOV: Starting full primary refresh. [2025-09-29T20:14:14.747975] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-09-29T20:14:14.833703] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-08. [2025-09-29T20:14:15.092556] [INFO ] [REMOTE ] NOV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:14:15.121937] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-29T20:14:15.452311] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-29T20:14:15.548087] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-04. [2025-09-29T20:14:16.348117] [INFO ] [REMOTE ] NOV: Fetching primary data for 2024-12. [2025-09-29T20:14:16.978689] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-29T20:14:17.074191] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-29T20:14:17.148087] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-09. [2025-09-29T20:14:17.948107] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-05. [2025-09-29T20:14:18.068325] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-29T20:14:18.748121] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-01. [2025-09-29T20:14:19.195437] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-29T20:14:19.250379] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-29T20:14:19.261807] [INFO ] [REMOTE ] NOK: Full fetch complete (77635 records). [2025-09-29T20:14:19.261984] [DEBUG] [VALIDATOR ] NOK: Validating primary data. [2025-09-29T20:14:19.553296] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-06. [2025-09-29T20:14:19.687295] [DEBUG] [VALIDATOR ] NOK: All expected trading days are present. [2025-09-29T20:14:19.687411] [DEBUG] [VALIDATOR ] NOK: Primary data validation passed. [2025-09-29T20:14:19.688696] [INFO ] [MAIN ] NOK: Fetched primary data is valid. [2025-09-29T20:14:19.688765] [DEBUG] [LOCAL ] NOK: Saving primary data. [2025-09-29T20:14:19.693433] [DEBUG] [LOCAL ] NOK: Trimmed 77635 records to 53621 (keeping 200 days of data) [2025-09-29T20:14:20.040042] [DEBUG] [LOCAL ] NOK: Primary data saved (53621 records). [2025-09-29T20:14:20.040190] [INFO ] [MAIN ] NOK: Full history saved. [2025-09-29T20:14:20.040276] [INFO ] [MAIN ] Update Progress: 1514/2371 symbols completed. NOK took 36.4s. Estimated remaining: 1h 49m 59s. Rate: 7.8 symbols/min [2025-09-29T20:14:20.226738] [INFO ] [MAIN ] NOW: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:14:20.279090] [DEBUG] [LOCAL ] NOW: Loaded 49444 existing records from primary storage. [2025-09-29T20:14:20.279464] [INFO ] [MAIN ] NOW: Loaded 49444 existing records. [2025-09-29T20:14:20.351738] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-01. [2025-09-29T20:14:20.486349] [WARN ] [MAIN ] NOW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:14:20.486584] [INFO ] [MAIN ] NOW: Wiping existing primary data before full refresh. [2025-09-29T20:14:20.486636] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-09-29T20:14:20.487037] [DEBUG] [LOCAL ] NOW: Deleted primary data file. [2025-09-29T20:14:20.487140] [INFO ] [MAIN ] NOW: Starting full primary refresh. [2025-09-29T20:14:20.940812] [INFO ] [REMOTE ] NOW: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:14:20.942695] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-09-29T20:14:21.062108] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-29T20:14:21.148124] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-07. [2025-09-29T20:14:21.948115] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-02. [2025-09-29T20:14:22.160252] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-29T20:14:22.632212] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-29T20:14:22.748161] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-08. [2025-09-29T20:14:23.548086] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-02. [2025-09-29T20:14:23.585344] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-29T20:14:24.195806] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-29T20:14:24.348118] [INFO ] [REMOTE ] NOW: Fetching primary data for 2024-12. [2025-09-29T20:14:25.148120] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-03. [2025-09-29T20:14:25.322763] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-29T20:14:25.948152] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-03. [2025-09-29T20:14:26.241804] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-29T20:14:26.748324] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-09. [2025-09-29T20:14:26.751713] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-29T20:14:27.548124] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-04. [2025-09-29T20:14:27.785467] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-29T20:14:28.348088] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-04. [2025-09-29T20:14:28.382026] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-29T20:14:28.392042] [INFO ] [REMOTE ] NOMD: Full fetch complete (58978 records). [2025-09-29T20:14:28.392200] [DEBUG] [VALIDATOR ] NOMD: Validating primary data. [2025-09-29T20:14:28.798822] [DEBUG] [VALIDATOR ] NOMD: All expected trading days are present. [2025-09-29T20:14:28.798995] [DEBUG] [VALIDATOR ] NOMD: Primary data validation passed. [2025-09-29T20:14:28.800055] [INFO ] [MAIN ] NOMD: Fetched primary data is valid. [2025-09-29T20:14:28.800146] [DEBUG] [LOCAL ] NOMD: Saving primary data. [2025-09-29T20:14:28.801608] [DEBUG] [LOCAL ] NOMD: Trimmed 58978 records to 41391 (keeping 200 days of data) [2025-09-29T20:14:29.131688] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-29T20:14:29.148096] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-01. [2025-09-29T20:14:29.169144] [DEBUG] [LOCAL ] NOMD: Primary data saved (41391 records). [2025-09-29T20:14:29.169318] [INFO ] [MAIN ] NOMD: Full history saved. [2025-09-29T20:14:29.169445] [INFO ] [MAIN ] Update Progress: 1515/2371 symbols completed. NOMD took 25.6s. Estimated remaining: 1h 49m 52s. Rate: 7.8 symbols/min [2025-09-29T20:14:29.404533] [INFO ] [MAIN ] NPB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:14:29.404804] [DEBUG] [LOCAL ] NPB: No existing data file found in primary storage. [2025-09-29T20:14:29.404869] [WARN ] [MAIN ] NPB: No existing data found, performing full refresh instead. [2025-09-29T20:14:29.405036] [INFO ] [MAIN ] NPB: Wiping existing primary data before full refresh. [2025-09-29T20:14:29.405102] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-09-29T20:14:29.405157] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-09-29T20:14:29.405198] [INFO ] [MAIN ] NPB: Starting full primary refresh. [2025-09-29T20:14:29.949636] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-05. [2025-09-29T20:14:29.978080] [INFO ] [REMOTE ] NPB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:14:30.298936] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-29T20:14:30.748122] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-05. [2025-09-29T20:14:31.249903] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-29T20:14:31.548116] [INFO ] [REMOTE ] NPB: Fetching primary data for 2024-12. [2025-09-29T20:14:31.712762] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-29T20:14:31.768557] [DEBUG] [REMOTE ] NPB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T20:14:31.768954] [WARN ] [REMOTE ] NPB: No data returned for month 2024-12 [2025-09-29T20:14:31.769051] [FATAL] [REMOTE ] NPB: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T20:14:31.769100] [FATAL] [MAIN ] NPB: Failed to fetch primary data. [2025-09-29T20:14:31.769135] [WARN ] [MAIN ] NPB: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T20:14:31.769205] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-09-29T20:14:31.769274] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-09-29T20:14:31.769317] [INFO ] [LOCAL ] NPB: Starting deletion of derivative data. [2025-09-29T20:14:31.769359] [DEBUG] [LOCAL ] NPB: No derivative data file found to delete. [2025-09-29T20:14:31.769408] [INFO ] [MAIN ] Update Progress: 1516/2371 symbols completed. NPB took 2.6s. Estimated remaining: 1h 49m 41s. Rate: 7.8 symbols/min [2025-09-29T20:14:31.955760] [INFO ] [MAIN ] NPCT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:14:31.973441] [DEBUG] [LOCAL ] NPCT: Loaded 17114 existing records from primary storage. [2025-09-29T20:14:31.973717] [INFO ] [MAIN ] NPCT: Loaded 17114 existing records. [2025-09-29T20:14:32.158424] [WARN ] [MAIN ] NPCT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:14:32.158744] [INFO ] [MAIN ] NPCT: Wiping existing primary data before full refresh. [2025-09-29T20:14:32.158799] [INFO ] [LOCAL ] NPCT: Starting deletion of primary data. [2025-09-29T20:14:32.159107] [DEBUG] [LOCAL ] NPCT: Deleted primary data file. [2025-09-29T20:14:32.159166] [INFO ] [MAIN ] NPCT: Starting full primary refresh. [2025-09-29T20:14:32.353579] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-02. [2025-09-29T20:14:32.560711] [INFO ] [REMOTE ] NPCT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:14:32.591727] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-29T20:14:33.148125] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2024-12. [2025-09-29T20:14:33.948138] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-06. [2025-09-29T20:14:34.196368] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-29T20:14:34.481721] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-29T20:14:34.748111] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-03. [2025-09-29T20:14:35.548118] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-01. [2025-09-29T20:14:35.669933] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-29T20:14:36.348132] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-06. [2025-09-29T20:14:36.639946] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-29T20:14:36.713033] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-29T20:14:37.148111] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-04. [2025-09-29T20:14:37.930448] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-29T20:14:37.948078] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-07. [2025-09-29T20:14:38.748122] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-07. [2025-09-29T20:14:39.438788] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-29T20:14:39.548098] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-05. [2025-09-29T20:14:39.756375] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-29T20:14:40.149197] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-29T20:14:40.348124] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-02. [2025-09-29T20:14:41.148102] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-08. [2025-09-29T20:14:41.305877] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-29T20:14:41.695093] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-29T20:14:41.948119] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-03. [2025-09-29T20:14:42.748081] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-08. [2025-09-29T20:14:42.840529] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-29T20:14:42.914838] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-29T20:14:43.548119] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-09. [2025-09-29T20:14:44.348095] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-06. [2025-09-29T20:14:44.570514] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-29T20:14:44.861718] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-29T20:14:44.868149] [INFO ] [REMOTE ] NOTE: Full fetch complete (64058 records). [2025-09-29T20:14:44.868278] [DEBUG] [VALIDATOR ] NOTE: Validating primary data. [2025-09-29T20:14:45.153263] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-09. [2025-09-29T20:14:45.292267] [DEBUG] [VALIDATOR ] NOTE: All expected trading days are present. [2025-09-29T20:14:45.292388] [DEBUG] [VALIDATOR ] NOTE: Primary data validation passed. [2025-09-29T20:14:45.293419] [INFO ] [MAIN ] NOTE: Fetched primary data is valid. [2025-09-29T20:14:45.293506] [DEBUG] [LOCAL ] NOTE: Saving primary data. [2025-09-29T20:14:45.294822] [DEBUG] [LOCAL ] NOTE: Trimmed 64058 records to 42302 (keeping 200 days of data) [2025-09-29T20:14:45.568588] [DEBUG] [LOCAL ] NOTE: Primary data saved (42302 records). [2025-09-29T20:14:45.568855] [INFO ] [MAIN ] NOTE: Full history saved. [2025-09-29T20:14:45.568963] [INFO ] [MAIN ] Update Progress: 1517/2371 symbols completed. NOTE took 35.5s. Estimated remaining: 1h 49m 37s. Rate: 7.8 symbols/min [2025-09-29T20:14:45.948087] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-04. [2025-09-29T20:14:46.193201] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-29T20:14:46.748104] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-07. [2025-09-29T20:14:46.896423] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-29T20:14:46.907939] [INFO ] [REMOTE ] NOV: Full fetch complete (76986 records). [2025-09-29T20:14:46.908096] [DEBUG] [VALIDATOR ] NOV: Validating primary data. [2025-09-29T20:14:47.029150] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-29T20:14:47.338637] [DEBUG] [VALIDATOR ] NOV: All expected trading days are present. [2025-09-29T20:14:47.338768] [DEBUG] [VALIDATOR ] NOV: Primary data validation passed. [2025-09-29T20:14:47.340034] [INFO ] [MAIN ] NOV: Fetched primary data is valid. [2025-09-29T20:14:47.340105] [DEBUG] [LOCAL ] NOV: Saving primary data. [2025-09-29T20:14:47.341683] [DEBUG] [LOCAL ] NOV: Trimmed 76986 records to 53181 (keeping 200 days of data) [2025-09-29T20:14:47.548217] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-05. [2025-09-29T20:14:47.706311] [DEBUG] [LOCAL ] NOV: Primary data saved (53181 records). [2025-09-29T20:14:47.706462] [INFO ] [MAIN ] NOV: Full history saved. [2025-09-29T20:14:47.706579] [INFO ] [MAIN ] Update Progress: 1518/2371 symbols completed. NOV took 33.5s. Estimated remaining: 1h 49m 26s. Rate: 7.8 symbols/min [2025-09-29T20:14:48.593049] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-29T20:14:48.598665] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-06. [2025-09-29T20:14:48.963388] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-29T20:14:49.148125] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-08. [2025-09-29T20:14:49.675202] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-29T20:14:49.948103] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-07. [2025-09-29T20:14:50.700227] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-29T20:14:50.748063] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-08. [2025-09-29T20:14:51.268631] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-29T20:14:51.548145] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-09. [2025-09-29T20:14:51.668555] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-29T20:14:52.348161] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-09. [2025-09-29T20:14:53.417191] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-29T20:14:53.421108] [INFO ] [REMOTE ] NPCT: Full fetch complete (25244 records). [2025-09-29T20:14:53.421226] [DEBUG] [VALIDATOR ] NPCT: Validating primary data. [2025-09-29T20:14:53.832254] [DEBUG] [VALIDATOR ] NPCT: All expected trading days are present. [2025-09-29T20:14:53.832472] [DEBUG] [VALIDATOR ] NPCT: Primary data validation passed. [2025-09-29T20:14:53.833164] [INFO ] [MAIN ] NPCT: Fetched primary data is valid. [2025-09-29T20:14:53.833303] [DEBUG] [LOCAL ] NPCT: Saving primary data. [2025-09-29T20:14:53.860435] [DEBUG] [LOCAL ] NPCT: Trimmed 25244 records to 16956 (keeping 200 days of data) [2025-09-29T20:14:53.863816] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-09-29T20:14:53.947955] [INFO ] [REMOTE ] NOW: Full fetch complete (70721 records). [2025-09-29T20:14:53.949786] [DEBUG] [VALIDATOR ] NOW: Validating primary data. [2025-09-29T20:14:54.398470] [DEBUG] [VALIDATOR ] NOW: All expected trading days are present. [2025-09-29T20:14:54.399059] [DEBUG] [VALIDATOR ] NOW: Primary data validation passed. [2025-09-29T20:14:54.400493] [INFO ] [MAIN ] NOW: Fetched primary data is valid. [2025-09-29T20:14:54.401077] [DEBUG] [LOCAL ] NOW: Saving primary data. [2025-09-29T20:14:54.405800] [DEBUG] [LOCAL ] NOW: Trimmed 70721 records to 48581 (keeping 200 days of data) [2025-09-29T20:14:54.504369] [DEBUG] [LOCAL ] NPCT: Primary data saved (16956 records). [2025-09-29T20:14:54.504811] [INFO ] [MAIN ] NPCT: Full history saved. [2025-09-29T20:14:54.505248] [INFO ] [MAIN ] Update Progress: 1519/2371 symbols completed. NPCT took 22.7s. Estimated remaining: 1h 49m 18s. Rate: 7.8 symbols/min [2025-09-29T20:14:54.732737] [DEBUG] [LOCAL ] NOW: Primary data saved (48581 records). [2025-09-29T20:14:54.732876] [INFO ] [MAIN ] NOW: Full history saved. [2025-09-29T20:14:54.732959] [INFO ] [MAIN ] Update Progress: 1520/2371 symbols completed. NOW took 34.7s. Estimated remaining: 1h 49m 6s. Rate: 7.8 symbols/min [2025-09-29T20:14:55.390881] [INFO ] [MAIN ] NPKI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:14:55.390056] [INFO ] [MAIN ] NPO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:14:55.419121] [INFO ] [MAIN ] NPK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:14:55.445573] [DEBUG] [LOCAL ] NPKI: No existing data file found in primary storage. [2025-09-29T20:14:55.474991] [INFO ] [MAIN ] NPFD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:14:55.475315] [WARN ] [MAIN ] NPKI: No existing data found, performing full refresh instead. [2025-09-29T20:14:55.476540] [INFO ] [MAIN ] NPKI: Wiping existing primary data before full refresh. [2025-09-29T20:14:55.476734] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-09-29T20:14:55.476929] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-09-29T20:14:55.476973] [INFO ] [MAIN ] NPKI: Starting full primary refresh. [2025-09-29T20:14:55.605551] [DEBUG] [LOCAL ] NPO: Loaded 13019 existing records from primary storage. [2025-09-29T20:14:55.605858] [DEBUG] [LOCAL ] NPFD: Loaded 9814 existing records from primary storage. [2025-09-29T20:14:55.606343] [DEBUG] [LOCAL ] NPK: Loaded 8120 existing records from primary storage. [2025-09-29T20:14:55.612381] [INFO ] [MAIN ] NPFD: Loaded 9814 existing records. [2025-09-29T20:14:55.612208] [INFO ] [MAIN ] NPK: Loaded 8120 existing records. [2025-09-29T20:14:55.627908] [INFO ] [MAIN ] NPO: Loaded 13019 existing records. [2025-09-29T20:14:56.394100] [WARN ] [MAIN ] NPO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:14:56.368334] [WARN ] [MAIN ] NPFD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:14:56.445352] [INFO ] [MAIN ] NPFD: Wiping existing primary data before full refresh. [2025-09-29T20:14:56.426831] [INFO ] [MAIN ] NPO: Wiping existing primary data before full refresh. [2025-09-29T20:14:56.453495] [WARN ] [MAIN ] NPK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:14:56.470727] [INFO ] [MAIN ] NPK: Wiping existing primary data before full refresh. [2025-09-29T20:14:56.476089] [INFO ] [REMOTE ] NPKI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:14:56.476485] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2024-12. [2025-09-29T20:14:56.476193] [INFO ] [LOCAL ] NPO: Starting deletion of primary data. [2025-09-29T20:14:56.453664] [INFO ] [LOCAL ] NPFD: Starting deletion of primary data. [2025-09-29T20:14:56.476604] [INFO ] [LOCAL ] NPK: Starting deletion of primary data. [2025-09-29T20:14:56.477788] [DEBUG] [LOCAL ] NPFD: Deleted primary data file. [2025-09-29T20:14:56.477843] [DEBUG] [LOCAL ] NPO: Deleted primary data file. [2025-09-29T20:14:56.477937] [DEBUG] [LOCAL ] NPK: Deleted primary data file. [2025-09-29T20:14:56.478022] [INFO ] [MAIN ] NPFD: Starting full primary refresh. [2025-09-29T20:14:56.478105] [INFO ] [MAIN ] NPO: Starting full primary refresh. [2025-09-29T20:14:56.478214] [INFO ] [MAIN ] NPK: Starting full primary refresh. [2025-09-29T20:14:57.570730] [INFO ] [REMOTE ] NPO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:14:57.605860] [INFO ] [REMOTE ] NPO: Fetching primary data for 2024-12. [2025-09-29T20:14:57.606672] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-29T20:14:57.708080] [INFO ] [REMOTE ] NPFD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:14:57.713505] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2024-12. [2025-09-29T20:14:57.714103] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-01. [2025-09-29T20:14:57.713035] [INFO ] [REMOTE ] NPK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:14:57.716231] [INFO ] [REMOTE ] NPK: Fetching primary data for 2024-12. [2025-09-29T20:14:58.621312] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-29T20:14:58.624858] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-01. [2025-09-29T20:14:58.649008] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-29T20:14:58.652308] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-01. [2025-09-29T20:14:58.707381] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-29T20:14:58.748083] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-01. [2025-09-29T20:14:58.932574] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-29T20:14:59.400599] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-29T20:14:59.410365] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-29T20:14:59.505681] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-29T20:14:59.548116] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-02. [2025-09-29T20:15:00.348112] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-02. [2025-09-29T20:15:00.493559] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-29T20:15:01.148152] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-03. [2025-09-29T20:15:01.791608] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-29T20:15:01.948161] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-03. [2025-09-29T20:15:01.981311] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-29T20:15:02.748155] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-02. [2025-09-29T20:15:03.366670] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-29T20:15:03.367476] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-29T20:15:03.548160] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-02. [2025-09-29T20:15:04.348102] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-04. [2025-09-29T20:15:04.483878] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-29T20:15:05.148175] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-04. [2025-09-29T20:15:05.932300] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-29T20:15:05.948621] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-03. [2025-09-29T20:15:05.952027] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-29T20:15:06.748096] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-03. [2025-09-29T20:15:06.896867] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-29T20:15:07.548124] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-05. [2025-09-29T20:15:07.731467] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-29T20:15:08.118830] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-29T20:15:08.348120] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-06. [2025-09-29T20:15:09.079472] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-29T20:15:09.148107] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-04. [2025-09-29T20:15:09.888730] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-29T20:15:09.948141] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-05. [2025-09-29T20:15:10.409792] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-29T20:15:10.748129] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-05. [2025-09-29T20:15:11.548112] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-07. [2025-09-29T20:15:12.265538] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-29T20:15:12.348093] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-06. [2025-09-29T20:15:12.422178] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-29T20:15:12.899374] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-29T20:15:13.148119] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-06. [2025-09-29T20:15:13.948147] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-04. [2025-09-29T20:15:14.616907] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-29T20:15:14.748132] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-07. [2025-09-29T20:15:15.066000] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-29T20:15:15.322351] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-29T20:15:15.548159] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-05. [2025-09-29T20:15:16.348083] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-08. [2025-09-29T20:15:16.664820] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-29T20:15:16.863578] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-29T20:15:17.148127] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-06. [2025-09-29T20:15:17.948114] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-08. [2025-09-29T20:15:17.973183] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-29T20:15:18.748159] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-09. [2025-09-29T20:15:18.761548] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-29T20:15:19.548138] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-09. [2025-09-29T20:15:19.686892] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-29T20:15:19.690208] [INFO ] [REMOTE ] NPFD: Full fetch complete (14821 records). [2025-09-29T20:15:19.690289] [DEBUG] [VALIDATOR ] NPFD: Validating primary data. [2025-09-29T20:15:20.073276] [DEBUG] [VALIDATOR ] NPFD: All expected trading days are present. [2025-09-29T20:15:20.073361] [DEBUG] [VALIDATOR ] NPFD: Primary data validation passed. [2025-09-29T20:15:20.073704] [INFO ] [MAIN ] NPFD: Fetched primary data is valid. [2025-09-29T20:15:20.073766] [DEBUG] [LOCAL ] NPFD: Saving primary data. [2025-09-29T20:15:20.074251] [DEBUG] [LOCAL ] NPFD: Trimmed 14821 records to 9726 (keeping 200 days of data) [2025-09-29T20:15:20.139989] [DEBUG] [LOCAL ] NPFD: Primary data saved (9726 records). [2025-09-29T20:15:20.140185] [INFO ] [MAIN ] NPFD: Full history saved. [2025-09-29T20:15:20.140311] [INFO ] [MAIN ] Update Progress: 1521/2371 symbols completed. NPFD took 25.4s. Estimated remaining: 1h 49m 8s. Rate: 7.8 symbols/min [2025-09-29T20:15:20.315771] [INFO ] [MAIN ] NPV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:15:20.322831] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-29T20:15:20.324840] [INFO ] [REMOTE ] NPK: Full fetch complete (10835 records). [2025-09-29T20:15:20.324918] [DEBUG] [VALIDATOR ] NPK: Validating primary data. [2025-09-29T20:15:20.356332] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-07. [2025-09-29T20:15:20.454323] [DEBUG] [LOCAL ] NPV: Loaded 5070 existing records from primary storage. [2025-09-29T20:15:20.470256] [INFO ] [MAIN ] NPV: Loaded 5070 existing records. [2025-09-29T20:15:20.946302] [WARN ] [MAIN ] NPV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:15:20.961290] [INFO ] [MAIN ] NPV: Wiping existing primary data before full refresh. [2025-09-29T20:15:20.986363] [INFO ] [LOCAL ] NPV: Starting deletion of primary data. [2025-09-29T20:15:20.986584] [DEBUG] [VALIDATOR ] NPK: All expected trading days are present. [2025-09-29T20:15:20.986638] [DEBUG] [VALIDATOR ] NPK: Primary data validation passed. [2025-09-29T20:15:20.987009] [DEBUG] [LOCAL ] NPV: Deleted primary data file. [2025-09-29T20:15:20.986969] [INFO ] [MAIN ] NPK: Fetched primary data is valid. [2025-09-29T20:15:20.987114] [INFO ] [MAIN ] NPV: Starting full primary refresh. [2025-09-29T20:15:21.018926] [DEBUG] [LOCAL ] NPK: Saving primary data. [2025-09-29T20:15:21.088784] [DEBUG] [LOCAL ] NPK: Trimmed 10835 records to 7996 (keeping 200 days of data) [2025-09-29T20:15:21.163491] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-07. [2025-09-29T20:15:21.452048] [DEBUG] [LOCAL ] NPK: Primary data saved (7996 records). [2025-09-29T20:15:21.459125] [INFO ] [REMOTE ] NPV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:15:21.459407] [INFO ] [MAIN ] NPK: Full history saved. [2025-09-29T20:15:21.459871] [INFO ] [MAIN ] Update Progress: 1522/2371 symbols completed. NPK took 26.7s. Estimated remaining: 1h 48m 57s. Rate: 7.8 symbols/min [2025-09-29T20:15:21.707210] [INFO ] [MAIN ] NPWR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:15:21.792592] [DEBUG] [LOCAL ] NPWR: Loaded 43857 existing records from primary storage. [2025-09-29T20:15:21.793211] [INFO ] [MAIN ] NPWR: Loaded 43857 existing records. [2025-09-29T20:15:21.945162] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-29T20:15:21.968434] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-08. [2025-09-29T20:15:22.020243] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-29T20:15:22.181374] [WARN ] [MAIN ] NPWR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:15:22.181699] [INFO ] [MAIN ] NPWR: Wiping existing primary data before full refresh. [2025-09-29T20:15:22.181769] [INFO ] [LOCAL ] NPWR: Starting deletion of primary data. [2025-09-29T20:15:22.182265] [DEBUG] [LOCAL ] NPWR: Deleted primary data file. [2025-09-29T20:15:22.182359] [INFO ] [MAIN ] NPWR: Starting full primary refresh. [2025-09-29T20:15:22.675113] [INFO ] [REMOTE ] NPWR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:15:22.748118] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-08. [2025-09-29T20:15:23.010521] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-29T20:15:23.548150] [INFO ] [REMOTE ] NPV: Fetching primary data for 2024-12. [2025-09-29T20:15:24.225479] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-29T20:15:24.258403] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-29T20:15:24.348119] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-01. [2025-09-29T20:15:24.939071] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-29T20:15:25.148134] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-09. [2025-09-29T20:15:25.948100] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-09. [2025-09-29T20:15:26.246785] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-29T20:15:26.249967] [INFO ] [REMOTE ] NPO: Full fetch complete (17938 records). [2025-09-29T20:15:26.250072] [DEBUG] [VALIDATOR ] NPO: Validating primary data. [2025-09-29T20:15:26.642989] [DEBUG] [VALIDATOR ] NPO: All expected trading days are present. [2025-09-29T20:15:26.643083] [DEBUG] [VALIDATOR ] NPO: Primary data validation passed. [2025-09-29T20:15:26.643565] [INFO ] [MAIN ] NPO: Fetched primary data is valid. [2025-09-29T20:15:26.643608] [DEBUG] [LOCAL ] NPO: Saving primary data. [2025-09-29T20:15:26.644326] [DEBUG] [LOCAL ] NPO: Trimmed 17938 records to 12875 (keeping 200 days of data) [2025-09-29T20:15:26.741740] [DEBUG] [LOCAL ] NPO: Primary data saved (12875 records). [2025-09-29T20:15:26.741899] [INFO ] [MAIN ] NPO: Full history saved. [2025-09-29T20:15:26.741984] [INFO ] [MAIN ] Update Progress: 1523/2371 symbols completed. NPO took 32.0s. Estimated remaining: 1h 48m 48s. Rate: 7.8 symbols/min [2025-09-29T20:15:26.753533] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2024-12. [2025-09-29T20:15:26.922365] [INFO ] [MAIN ] NQP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:15:26.936026] [DEBUG] [LOCAL ] NQP: Loaded 9406 existing records from primary storage. [2025-09-29T20:15:26.936248] [INFO ] [MAIN ] NQP: Loaded 9406 existing records. [2025-09-29T20:15:27.135577] [WARN ] [MAIN ] NQP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:15:27.136151] [INFO ] [MAIN ] NQP: Wiping existing primary data before full refresh. [2025-09-29T20:15:27.136224] [INFO ] [LOCAL ] NQP: Starting deletion of primary data. [2025-09-29T20:15:27.136515] [DEBUG] [LOCAL ] NQP: Deleted primary data file. [2025-09-29T20:15:27.136575] [INFO ] [MAIN ] NQP: Starting full primary refresh. [2025-09-29T20:15:27.514346] [INFO ] [REMOTE ] NQP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:15:27.540394] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-29T20:15:27.548101] [INFO ] [REMOTE ] NQP: Fetching primary data for 2024-12. [2025-09-29T20:15:27.550720] [INFO ] [REMOTE ] NPKI: Full fetch complete (53766 records). [2025-09-29T20:15:27.550911] [DEBUG] [VALIDATOR ] NPKI: Validating primary data. [2025-09-29T20:15:27.770818] [WARN ] [VALIDATOR ] NPKI: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-09-29T20:15:27.772832] [FATAL] [MAIN ] NPKI: Fetched primary data is invalid. Refusing to save it. [2025-09-29T20:15:27.773007] [WARN ] [MAIN ] NPKI: Deleting existing primary and derivative data due to validation failure. [2025-09-29T20:15:27.773099] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-09-29T20:15:27.773270] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-09-29T20:15:27.773468] [INFO ] [LOCAL ] NPKI: Starting deletion of derivative data. [2025-09-29T20:15:27.773543] [DEBUG] [LOCAL ] NPKI: No derivative data file found to delete. [2025-09-29T20:15:27.773702] [INFO ] [MAIN ] Update Progress: 1524/2371 symbols completed. NPKI took 33.0s. Estimated remaining: 1h 48m 36s. Rate: 7.8 symbols/min [2025-09-29T20:15:27.962852] [INFO ] [MAIN ] NRDY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:15:28.002295] [DEBUG] [LOCAL ] NRDY: Loaded 33402 existing records from primary storage. [2025-09-29T20:15:28.003329] [INFO ] [MAIN ] NRDY: Loaded 33402 existing records. [2025-09-29T20:15:28.208913] [WARN ] [MAIN ] NRDY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:15:28.226196] [INFO ] [MAIN ] NRDY: Wiping existing primary data before full refresh. [2025-09-29T20:15:28.227690] [INFO ] [LOCAL ] NRDY: Starting deletion of primary data. [2025-09-29T20:15:28.228687] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-29T20:15:28.237674] [DEBUG] [LOCAL ] NRDY: Deleted primary data file. [2025-09-29T20:15:28.238417] [INFO ] [MAIN ] NRDY: Starting full primary refresh. [2025-09-29T20:15:28.293322] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-29T20:15:28.353207] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-01. [2025-09-29T20:15:28.647193] [INFO ] [REMOTE ] NRDY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:15:29.148121] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-01. [2025-09-29T20:15:29.739468] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-29T20:15:29.767319] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-29T20:15:29.948111] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-02. [2025-09-29T20:15:30.686832] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-29T20:15:30.748102] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-02. [2025-09-29T20:15:31.548107] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-03. [2025-09-29T20:15:32.056522] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-29T20:15:32.348108] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2024-12. [2025-09-29T20:15:32.449500] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-29T20:15:33.148116] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-02. [2025-09-29T20:15:33.949488] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-29T20:15:33.949292] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-04. [2025-09-29T20:15:34.271474] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-29T20:15:34.748129] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-03. [2025-09-29T20:15:34.761979] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-29T20:15:35.548135] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-05. [2025-09-29T20:15:36.348153] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-03. [2025-09-29T20:15:36.424481] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-29T20:15:36.462041] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-29T20:15:36.955242] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-29T20:15:37.148129] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-04. [2025-09-29T20:15:37.535840] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-29T20:15:37.948151] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-05. [2025-09-29T20:15:38.643693] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-29T20:15:38.748137] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-06. [2025-09-29T20:15:39.553062] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-29T20:15:39.551810] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-04. [2025-09-29T20:15:40.348146] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-07. [2025-09-29T20:15:41.080987] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-29T20:15:41.131836] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-29T20:15:41.148072] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-08. [2025-09-29T20:15:41.909322] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-29T20:15:41.948121] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-05. [2025-09-29T20:15:42.748132] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-06. [2025-09-29T20:15:43.342998] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-29T20:15:43.529274] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-29T20:15:43.548095] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-07. [2025-09-29T20:15:44.221784] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-29T20:15:44.348130] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-01. [2025-09-29T20:15:45.148174] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-06. [2025-09-29T20:15:45.849338] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-29T20:15:45.948157] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-08. [2025-09-29T20:15:46.621721] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-29T20:15:46.748162] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-09. [2025-09-29T20:15:46.950087] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-29T20:15:47.548153] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-07. [2025-09-29T20:15:47.671087] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-29T20:15:47.673892] [INFO ] [REMOTE ] NQP: Full fetch complete (13494 records). [2025-09-29T20:15:47.673983] [DEBUG] [VALIDATOR ] NQP: Validating primary data. [2025-09-29T20:15:48.068730] [DEBUG] [VALIDATOR ] NQP: All expected trading days are present. [2025-09-29T20:15:48.068819] [DEBUG] [VALIDATOR ] NQP: Primary data validation passed. [2025-09-29T20:15:48.069126] [INFO ] [MAIN ] NQP: Fetched primary data is valid. [2025-09-29T20:15:48.069167] [DEBUG] [LOCAL ] NQP: Saving primary data. [2025-09-29T20:15:48.069757] [DEBUG] [LOCAL ] NQP: Trimmed 13494 records to 9279 (keeping 200 days of data) [2025-09-29T20:15:48.132424] [DEBUG] [LOCAL ] NQP: Primary data saved (9279 records). [2025-09-29T20:15:48.132574] [INFO ] [MAIN ] NQP: Full history saved. [2025-09-29T20:15:48.132686] [INFO ] [MAIN ] Update Progress: 1525/2371 symbols completed. NQP took 21.4s. Estimated remaining: 1h 48m 36s. Rate: 7.8 symbols/min [2025-09-29T20:15:48.312566] [INFO ] [MAIN ] NREF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:15:48.322677] [DEBUG] [LOCAL ] NREF: Loaded 7957 existing records from primary storage. [2025-09-29T20:15:48.322945] [INFO ] [MAIN ] NREF: Loaded 7957 existing records. [2025-09-29T20:15:48.354164] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-02. [2025-09-29T20:15:48.513201] [WARN ] [MAIN ] NREF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:15:48.513451] [INFO ] [MAIN ] NREF: Wiping existing primary data before full refresh. [2025-09-29T20:15:48.513502] [INFO ] [LOCAL ] NREF: Starting deletion of primary data. [2025-09-29T20:15:48.513818] [DEBUG] [LOCAL ] NREF: Deleted primary data file. [2025-09-29T20:15:48.513878] [INFO ] [MAIN ] NREF: Starting full primary refresh. [2025-09-29T20:15:48.929100] [INFO ] [REMOTE ] NREF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:15:49.156001] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-09. [2025-09-29T20:15:49.176992] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-29T20:15:49.816137] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-29T20:15:49.948126] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-08. [2025-09-29T20:15:49.992938] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-29T20:15:49.994981] [INFO ] [REMOTE ] NPV: Full fetch complete (6909 records). [2025-09-29T20:15:49.995059] [DEBUG] [VALIDATOR ] NPV: Validating primary data. [2025-09-29T20:15:50.381159] [DEBUG] [VALIDATOR ] NPV: All expected trading days are present. [2025-09-29T20:15:50.381240] [DEBUG] [VALIDATOR ] NPV: Primary data validation passed. [2025-09-29T20:15:50.381481] [INFO ] [MAIN ] NPV: Fetched primary data is valid. [2025-09-29T20:15:50.381549] [DEBUG] [LOCAL ] NPV: Saving primary data. [2025-09-29T20:15:50.382000] [DEBUG] [LOCAL ] NPV: Trimmed 6909 records to 5045 (keeping 200 days of data) [2025-09-29T20:15:50.413993] [DEBUG] [LOCAL ] NPV: Primary data saved (5045 records). [2025-09-29T20:15:50.414108] [INFO ] [MAIN ] NPV: Full history saved. [2025-09-29T20:15:50.414215] [INFO ] [MAIN ] Update Progress: 1526/2371 symbols completed. NPV took 30.3s. Estimated remaining: 1h 48m 25s. Rate: 7.8 symbols/min [2025-09-29T20:15:50.596867] [INFO ] [MAIN ] NRG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:15:50.689510] [DEBUG] [LOCAL ] NRG: Loaded 53697 existing records from primary storage. [2025-09-29T20:15:50.689998] [INFO ] [MAIN ] NRG: Loaded 53697 existing records. [2025-09-29T20:15:50.753257] [INFO ] [REMOTE ] NREF: Fetching primary data for 2024-12. [2025-09-29T20:15:50.893620] [WARN ] [MAIN ] NRG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:15:50.893875] [INFO ] [MAIN ] NRG: Wiping existing primary data before full refresh. [2025-09-29T20:15:50.893928] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-09-29T20:15:50.894723] [DEBUG] [LOCAL ] NRG: Deleted primary data file. [2025-09-29T20:15:50.894784] [INFO ] [MAIN ] NRG: Starting full primary refresh. [2025-09-29T20:15:51.292756] [INFO ] [REMOTE ] NRG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:15:51.472140] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-29T20:15:51.548135] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-09. [2025-09-29T20:15:51.625872] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-29T20:15:52.348171] [INFO ] [REMOTE ] NRG: Fetching primary data for 2024-12. [2025-09-29T20:15:53.148166] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-01. [2025-09-29T20:15:53.245204] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-29T20:15:53.253877] [INFO ] [REMOTE ] NPWR: Full fetch complete (59296 records). [2025-09-29T20:15:53.254051] [DEBUG] [VALIDATOR ] NPWR: Validating primary data. [2025-09-29T20:15:53.685593] [DEBUG] [VALIDATOR ] NPWR: All expected trading days are present. [2025-09-29T20:15:53.685830] [DEBUG] [VALIDATOR ] NPWR: Primary data validation passed. [2025-09-29T20:15:53.687112] [INFO ] [MAIN ] NPWR: Fetched primary data is valid. [2025-09-29T20:15:53.687216] [DEBUG] [LOCAL ] NPWR: Saving primary data. [2025-09-29T20:15:53.689196] [DEBUG] [LOCAL ] NPWR: Trimmed 59296 records to 43014 (keeping 200 days of data) [2025-09-29T20:15:53.815262] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-29T20:15:53.817952] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-29T20:15:53.960863] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-02. [2025-09-29T20:15:54.036344] [DEBUG] [LOCAL ] NPWR: Primary data saved (43014 records). [2025-09-29T20:15:54.036498] [INFO ] [MAIN ] NPWR: Full history saved. [2025-09-29T20:15:54.036602] [INFO ] [MAIN ] Update Progress: 1527/2371 symbols completed. NPWR took 32.6s. Estimated remaining: 1h 48m 15s. Rate: 7.8 symbols/min [2025-09-29T20:15:54.276011] [INFO ] [MAIN ] NRGV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:15:54.332681] [DEBUG] [LOCAL ] NRGV: Loaded 43716 existing records from primary storage. [2025-09-29T20:15:54.333076] [INFO ] [MAIN ] NRGV: Loaded 43716 existing records. [2025-09-29T20:15:54.533852] [WARN ] [MAIN ] NRGV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:15:54.534169] [INFO ] [MAIN ] NRGV: Wiping existing primary data before full refresh. [2025-09-29T20:15:54.534237] [INFO ] [LOCAL ] NRGV: Starting deletion of primary data. [2025-09-29T20:15:54.534571] [DEBUG] [LOCAL ] NRGV: Deleted primary data file. [2025-09-29T20:15:54.534631] [INFO ] [MAIN ] NRGV: Starting full primary refresh. [2025-09-29T20:15:54.647162] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-29T20:15:54.753313] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-03. [2025-09-29T20:15:54.923130] [INFO ] [REMOTE ] NRGV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:15:55.548161] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-03. [2025-09-29T20:15:56.060243] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-29T20:15:56.353240] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-01. [2025-09-29T20:15:56.364625] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-29T20:15:57.148155] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-04. [2025-09-29T20:15:57.948157] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2024-12. [2025-09-29T20:15:58.341234] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-29T20:15:58.463204] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-29T20:15:58.748121] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-05. [2025-09-29T20:15:59.548167] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-02. [2025-09-29T20:15:59.692150] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-29T20:16:00.188487] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-29T20:16:00.348125] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-06. [2025-09-29T20:16:01.148119] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-01. [2025-09-29T20:16:01.305671] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-29T20:16:01.444745] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-29T20:16:01.948133] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-03. [2025-09-29T20:16:02.753227] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-07. [2025-09-29T20:16:02.768279] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-29T20:16:03.548098] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-02. [2025-09-29T20:16:03.910623] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-29T20:16:04.265566] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-29T20:16:04.348140] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-04. [2025-09-29T20:16:04.886019] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-29T20:16:05.071176] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-29T20:16:05.148169] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-03. [2025-09-29T20:16:05.948098] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-04. [2025-09-29T20:16:06.748158] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-05. [2025-09-29T20:16:06.793982] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-29T20:16:07.458557] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-29T20:16:07.548140] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-06. [2025-09-29T20:16:07.794308] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-29T20:16:08.348183] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-04. [2025-09-29T20:16:08.445665] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-29T20:16:09.148155] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-07. [2025-09-29T20:16:09.948088] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-08. [2025-09-29T20:16:09.998633] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-29T20:16:10.145295] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-29T20:16:10.748118] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-05. [2025-09-29T20:16:11.328865] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-29T20:16:11.548165] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-09. [2025-09-29T20:16:12.348145] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-05. [2025-09-29T20:16:12.467952] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-29T20:16:12.911762] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-29T20:16:12.918822] [INFO ] [REMOTE ] NRDY: Full fetch complete (51824 records). [2025-09-29T20:16:12.918973] [DEBUG] [VALIDATOR ] NRDY: Validating primary data. [2025-09-29T20:16:13.157407] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-06. [2025-09-29T20:16:13.340420] [DEBUG] [VALIDATOR ] NRDY: All expected trading days are present. [2025-09-29T20:16:13.340510] [DEBUG] [VALIDATOR ] NRDY: Primary data validation passed. [2025-09-29T20:16:13.341499] [INFO ] [MAIN ] NRDY: Fetched primary data is valid. [2025-09-29T20:16:13.341596] [DEBUG] [LOCAL ] NRDY: Saving primary data. [2025-09-29T20:16:13.342834] [DEBUG] [LOCAL ] NRDY: Trimmed 51824 records to 32658 (keeping 200 days of data) [2025-09-29T20:16:13.556669] [DEBUG] [LOCAL ] NRDY: Primary data saved (32658 records). [2025-09-29T20:16:13.556834] [INFO ] [MAIN ] NRDY: Full history saved. [2025-09-29T20:16:13.556923] [INFO ] [MAIN ] Update Progress: 1528/2371 symbols completed. NRDY took 45.8s. Estimated remaining: 1h 48m 14s. Rate: 7.8 symbols/min [2025-09-29T20:16:13.745742] [INFO ] [MAIN ] NRK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:16:13.772316] [DEBUG] [LOCAL ] NRK: Loaded 19991 existing records from primary storage. [2025-09-29T20:16:13.773029] [INFO ] [MAIN ] NRK: Loaded 19991 existing records. [2025-09-29T20:16:13.960101] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-08. [2025-09-29T20:16:13.983583] [WARN ] [MAIN ] NRK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:16:13.983958] [INFO ] [MAIN ] NRK: Wiping existing primary data before full refresh. [2025-09-29T20:16:13.984017] [INFO ] [LOCAL ] NRK: Starting deletion of primary data. [2025-09-29T20:16:13.984317] [DEBUG] [LOCAL ] NRK: Deleted primary data file. [2025-09-29T20:16:13.984376] [INFO ] [MAIN ] NRK: Starting full primary refresh. [2025-09-29T20:16:14.460288] [INFO ] [REMOTE ] NRK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:16:14.526926] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-29T20:16:14.590187] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-29T20:16:14.605437] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-29T20:16:14.748137] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-07. [2025-09-29T20:16:15.548142] [INFO ] [REMOTE ] NRK: Fetching primary data for 2024-12. [2025-09-29T20:16:16.348096] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-09. [2025-09-29T20:16:16.529068] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-29T20:16:16.822397] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-29T20:16:16.945777] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-29T20:16:16.948499] [INFO ] [REMOTE ] NREF: Full fetch complete (10855 records). [2025-09-29T20:16:16.948581] [DEBUG] [VALIDATOR ] NREF: Validating primary data. [2025-09-29T20:16:17.153216] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-01. [2025-09-29T20:16:17.363152] [DEBUG] [VALIDATOR ] NREF: All expected trading days are present. [2025-09-29T20:16:17.363235] [DEBUG] [VALIDATOR ] NREF: Primary data validation passed. [2025-09-29T20:16:17.363563] [INFO ] [MAIN ] NREF: Fetched primary data is valid. [2025-09-29T20:16:17.363628] [DEBUG] [LOCAL ] NREF: Saving primary data. [2025-09-29T20:16:17.364234] [DEBUG] [LOCAL ] NREF: Trimmed 10855 records to 7859 (keeping 200 days of data) [2025-09-29T20:16:17.418399] [DEBUG] [LOCAL ] NREF: Primary data saved (7859 records). [2025-09-29T20:16:17.418551] [INFO ] [MAIN ] NREF: Full history saved. [2025-09-29T20:16:17.418638] [INFO ] [MAIN ] Update Progress: 1529/2371 symbols completed. NREF took 29.3s. Estimated remaining: 1h 48m 4s. Rate: 7.8 symbols/min [2025-09-29T20:16:17.609028] [INFO ] [MAIN ] NRP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:16:17.617252] [DEBUG] [LOCAL ] NRP: Loaded 4114 existing records from primary storage. [2025-09-29T20:16:17.617499] [INFO ] [MAIN ] NRP: Loaded 4114 existing records. [2025-09-29T20:16:17.816862] [WARN ] [MAIN ] NRP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:16:17.817108] [INFO ] [MAIN ] NRP: Wiping existing primary data before full refresh. [2025-09-29T20:16:17.817168] [INFO ] [LOCAL ] NRP: Starting deletion of primary data. [2025-09-29T20:16:17.817435] [DEBUG] [LOCAL ] NRP: Deleted primary data file. [2025-09-29T20:16:17.817498] [INFO ] [MAIN ] NRP: Starting full primary refresh. [2025-09-29T20:16:17.953227] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-06. [2025-09-29T20:16:18.217538] [INFO ] [REMOTE ] NRP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:16:18.382567] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-29T20:16:18.748135] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-02. [2025-09-29T20:16:19.548105] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-08. [2025-09-29T20:16:19.813252] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-29T20:16:19.940514] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-29T20:16:20.348115] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-03. [2025-09-29T20:16:21.075506] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-29T20:16:21.100379] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-29T20:16:21.148103] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-09. [2025-09-29T20:16:21.948131] [INFO ] [REMOTE ] NRP: Fetching primary data for 2024-12. [2025-09-29T20:16:22.748104] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-07. [2025-09-29T20:16:22.918104] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-29T20:16:23.044205] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-29T20:16:23.054440] [INFO ] [REMOTE ] NRGV: Full fetch complete (62035 records). [2025-09-29T20:16:23.054562] [DEBUG] [VALIDATOR ] NRGV: Validating primary data. [2025-09-29T20:16:23.484975] [DEBUG] [VALIDATOR ] NRGV: All expected trading days are present. [2025-09-29T20:16:23.485160] [DEBUG] [VALIDATOR ] NRGV: Primary data validation passed. [2025-09-29T20:16:23.486268] [INFO ] [MAIN ] NRGV: Fetched primary data is valid. [2025-09-29T20:16:23.486342] [DEBUG] [LOCAL ] NRGV: Saving primary data. [2025-09-29T20:16:23.488056] [DEBUG] [LOCAL ] NRGV: Trimmed 62035 records to 43174 (keeping 200 days of data) [2025-09-29T20:16:23.550901] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-01. [2025-09-29T20:16:23.775273] [DEBUG] [LOCAL ] NRGV: Primary data saved (43174 records). [2025-09-29T20:16:23.775457] [INFO ] [MAIN ] NRGV: Full history saved. [2025-09-29T20:16:23.775553] [INFO ] [MAIN ] Update Progress: 1530/2371 symbols completed. NRGV took 29.7s. Estimated remaining: 1h 47m 56s. Rate: 7.8 symbols/min [2025-09-29T20:16:23.971547] [INFO ] [MAIN ] NRT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:16:23.979435] [DEBUG] [LOCAL ] NRT: Loaded 4994 existing records from primary storage. [2025-09-29T20:16:23.979705] [INFO ] [MAIN ] NRT: Loaded 4994 existing records. [2025-09-29T20:16:24.181672] [WARN ] [MAIN ] NRT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:16:24.182022] [INFO ] [MAIN ] NRT: Wiping existing primary data before full refresh. [2025-09-29T20:16:24.182101] [INFO ] [LOCAL ] NRT: Starting deletion of primary data. [2025-09-29T20:16:24.182349] [DEBUG] [LOCAL ] NRT: Deleted primary data file. [2025-09-29T20:16:24.182410] [INFO ] [MAIN ] NRT: Starting full primary refresh. [2025-09-29T20:16:24.298775] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-29T20:16:24.358115] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-02. [2025-09-29T20:16:24.590295] [INFO ] [REMOTE ] NRT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:16:24.959873] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-29T20:16:25.131312] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-29T20:16:25.148053] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-03. [2025-09-29T20:16:25.827612] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-29T20:16:25.948122] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-08. [2025-09-29T20:16:26.748150] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-04. [2025-09-29T20:16:27.548114] [INFO ] [REMOTE ] NRT: Fetching primary data for 2024-12. [2025-09-29T20:16:27.583337] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-29T20:16:27.950271] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-29T20:16:28.259787] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-29T20:16:28.348116] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-04. [2025-09-29T20:16:29.148075] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-09. [2025-09-29T20:16:29.529314] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-29T20:16:29.699582] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-29T20:16:29.710434] [INFO ] [REMOTE ] NRG: Full fetch complete (76190 records). [2025-09-29T20:16:29.710591] [DEBUG] [VALIDATOR ] NRG: Validating primary data. [2025-09-29T20:16:29.711398] [FATAL] [VALIDATOR ] NRG: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T20:16:29.711517] [FATAL] [MAIN ] NRG: Fetched primary data is invalid. Refusing to save it. [2025-09-29T20:16:29.711566] [WARN ] [MAIN ] NRG: Deleting existing primary and derivative data due to validation failure. [2025-09-29T20:16:29.711675] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-09-29T20:16:29.711761] [DEBUG] [LOCAL ] NRG: No primary data file found to delete. [2025-09-29T20:16:29.711807] [INFO ] [LOCAL ] NRG: Starting deletion of derivative data. [2025-09-29T20:16:29.712311] [DEBUG] [LOCAL ] NRG: Deleted derivative data file. [2025-09-29T20:16:29.712417] [INFO ] [MAIN ] Update Progress: 1531/2371 symbols completed. NRG took 39.3s. Estimated remaining: 1h 47m 47s. Rate: 7.8 symbols/min [2025-09-29T20:16:29.889035] [INFO ] [MAIN ] NRUC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:16:29.894675] [DEBUG] [LOCAL ] NRUC: Loaded 3136 existing records from primary storage. [2025-09-29T20:16:29.894865] [INFO ] [MAIN ] NRUC: Loaded 3136 existing records. [2025-09-29T20:16:29.956480] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-05. [2025-09-29T20:16:30.083193] [WARN ] [MAIN ] NRUC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:16:30.083410] [INFO ] [MAIN ] NRUC: Wiping existing primary data before full refresh. [2025-09-29T20:16:30.083459] [INFO ] [LOCAL ] NRUC: Starting deletion of primary data. [2025-09-29T20:16:30.083678] [DEBUG] [LOCAL ] NRUC: Deleted primary data file. [2025-09-29T20:16:30.083773] [INFO ] [MAIN ] NRUC: Starting full primary refresh. [2025-09-29T20:16:30.465452] [INFO ] [REMOTE ] NRUC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:16:30.748099] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-05. [2025-09-29T20:16:31.099946] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-29T20:16:31.398451] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-29T20:16:31.548118] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-06. [2025-09-29T20:16:32.208561] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-29T20:16:32.348145] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-06. [2025-09-29T20:16:33.148139] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-07. [2025-09-29T20:16:33.402972] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-29T20:16:33.890734] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-29T20:16:33.948103] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-08. [2025-09-29T20:16:34.533907] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-29T20:16:34.748135] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-07. [2025-09-29T20:16:35.548180] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-09. [2025-09-29T20:16:35.946455] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-29T20:16:36.227578] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-29T20:16:36.229554] [INFO ] [REMOTE ] NRP: Full fetch complete (6510 records). [2025-09-29T20:16:36.229818] [DEBUG] [VALIDATOR ] NRP: Validating primary data. [2025-09-29T20:16:36.353295] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-01. [2025-09-29T20:16:36.633964] [DEBUG] [VALIDATOR ] NRP: All expected trading days are present. [2025-09-29T20:16:36.634045] [DEBUG] [VALIDATOR ] NRP: Primary data validation passed. [2025-09-29T20:16:36.634235] [INFO ] [MAIN ] NRP: Fetched primary data is valid. [2025-09-29T20:16:36.634312] [DEBUG] [LOCAL ] NRP: Saving primary data. [2025-09-29T20:16:36.634793] [DEBUG] [LOCAL ] NRP: Trimmed 6510 records to 4053 (keeping 200 days of data) [2025-09-29T20:16:36.662889] [DEBUG] [LOCAL ] NRP: Primary data saved (4053 records). [2025-09-29T20:16:36.663060] [INFO ] [MAIN ] NRP: Full history saved. [2025-09-29T20:16:36.663208] [INFO ] [MAIN ] Update Progress: 1532/2371 symbols completed. NRP took 19.2s. Estimated remaining: 1h 47m 39s. Rate: 7.8 symbols/min [2025-09-29T20:16:36.844510] [INFO ] [MAIN ] NSA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:16:36.909515] [DEBUG] [LOCAL ] NSA: Loaded 45528 existing records from primary storage. [2025-09-29T20:16:36.909853] [INFO ] [MAIN ] NSA: Loaded 45528 existing records. [2025-09-29T20:16:37.153459] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2024-12. [2025-09-29T20:16:37.160173] [WARN ] [MAIN ] NSA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:16:37.161490] [INFO ] [MAIN ] NSA: Wiping existing primary data before full refresh. [2025-09-29T20:16:37.161575] [INFO ] [LOCAL ] NSA: Starting deletion of primary data. [2025-09-29T20:16:37.162248] [DEBUG] [LOCAL ] NSA: Deleted primary data file. [2025-09-29T20:16:37.162353] [INFO ] [MAIN ] NSA: Starting full primary refresh. [2025-09-29T20:16:37.328130] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-29T20:16:37.948720] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-08. [2025-09-29T20:16:38.025041] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-29T20:16:38.164145] [INFO ] [REMOTE ] NSA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:16:38.748137] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-01. [2025-09-29T20:16:39.190432] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-29T20:16:39.411023] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-29T20:16:39.548167] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-09. [2025-09-29T20:16:40.348128] [INFO ] [REMOTE ] NSA: Fetching primary data for 2024-12. [2025-09-29T20:16:40.771085] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-29T20:16:40.777456] [INFO ] [REMOTE ] NRK: Full fetch complete (27757 records). [2025-09-29T20:16:40.777636] [DEBUG] [VALIDATOR ] NRK: Validating primary data. [2025-09-29T20:16:41.153271] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-02. [2025-09-29T20:16:41.226723] [DEBUG] [VALIDATOR ] NRK: All expected trading days are present. [2025-09-29T20:16:41.226826] [DEBUG] [VALIDATOR ] NRK: Primary data validation passed. [2025-09-29T20:16:41.228004] [INFO ] [MAIN ] NRK: Fetched primary data is valid. [2025-09-29T20:16:41.228204] [DEBUG] [LOCAL ] NRK: Saving primary data. [2025-09-29T20:16:41.229302] [DEBUG] [LOCAL ] NRK: Trimmed 27757 records to 19832 (keeping 200 days of data) [2025-09-29T20:16:41.358968] [DEBUG] [LOCAL ] NRK: Primary data saved (19832 records). [2025-09-29T20:16:41.359129] [INFO ] [MAIN ] NRK: Full history saved. [2025-09-29T20:16:41.359239] [INFO ] [MAIN ] Update Progress: 1533/2371 symbols completed. NRK took 27.8s. Estimated remaining: 1h 47m 30s. Rate: 7.8 symbols/min [2025-09-29T20:16:41.557572] [INFO ] [MAIN ] NSC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:16:41.616681] [DEBUG] [LOCAL ] NSC: Loaded 49879 existing records from primary storage. [2025-09-29T20:16:41.617045] [INFO ] [MAIN ] NSC: Loaded 49879 existing records. [2025-09-29T20:16:41.821053] [WARN ] [MAIN ] NSC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:16:41.821276] [INFO ] [MAIN ] NSC: Wiping existing primary data before full refresh. [2025-09-29T20:16:41.821325] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-09-29T20:16:41.822161] [DEBUG] [LOCAL ] NSC: Deleted primary data file. [2025-09-29T20:16:41.822243] [INFO ] [MAIN ] NSC: Starting full primary refresh. [2025-09-29T20:16:41.949229] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-02. [2025-09-29T20:16:42.065721] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-29T20:16:42.283705] [INFO ] [REMOTE ] NSC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:16:42.300603] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-29T20:16:42.725042] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-29T20:16:42.748071] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-03. [2025-09-29T20:16:43.394891] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-29T20:16:43.548128] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-04. [2025-09-29T20:16:44.250688] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-29T20:16:44.348158] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-01. [2025-09-29T20:16:45.148184] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-03. [2025-09-29T20:16:45.836003] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-29T20:16:45.874340] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-29T20:16:45.948162] [INFO ] [REMOTE ] NSC: Fetching primary data for 2024-12. [2025-09-29T20:16:46.748122] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-05. [2025-09-29T20:16:47.414422] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-29T20:16:47.548167] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-06. [2025-09-29T20:16:47.780668] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-29T20:16:48.075626] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-29T20:16:48.348130] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-07. [2025-09-29T20:16:48.885885] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-29T20:16:49.148115] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-02. [2025-09-29T20:16:49.948144] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-04. [2025-09-29T20:16:50.753298] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-08. [2025-09-29T20:16:50.767944] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-29T20:16:50.835018] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-29T20:16:51.353938] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-29T20:16:51.548177] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-05. [2025-09-29T20:16:52.334365] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-29T20:16:52.348075] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-06. [2025-09-29T20:16:52.998545] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-29T20:16:53.148137] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-01. [2025-09-29T20:16:53.948146] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-03. [2025-09-29T20:16:54.748120] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-09. [2025-09-29T20:16:54.930041] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-29T20:16:55.313850] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-29T20:16:55.315188] [INFO ] [REMOTE ] NRUC: Full fetch complete (5554 records). [2025-09-29T20:16:55.315288] [DEBUG] [VALIDATOR ] NRUC: Validating primary data. [2025-09-29T20:16:55.553243] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-02. [2025-09-29T20:16:55.755379] [DEBUG] [VALIDATOR ] NRUC: All expected trading days are present. [2025-09-29T20:16:55.755582] [DEBUG] [VALIDATOR ] NRUC: Primary data validation passed. [2025-09-29T20:16:55.756541] [INFO ] [MAIN ] NRUC: Fetched primary data is valid. [2025-09-29T20:16:55.757629] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-29T20:16:55.757772] [DEBUG] [LOCAL ] NRUC: Saving primary data. [2025-09-29T20:16:55.768272] [DEBUG] [LOCAL ] NRUC: Trimmed 5554 records to 3083 (keeping 200 days of data) [2025-09-29T20:16:55.790664] [DEBUG] [LOCAL ] NRUC: Primary data saved (3083 records). [2025-09-29T20:16:55.790817] [INFO ] [MAIN ] NRUC: Full history saved. [2025-09-29T20:16:55.790947] [INFO ] [MAIN ] Update Progress: 1534/2371 symbols completed. NRUC took 26.1s. Estimated remaining: 1h 47m 25s. Rate: 7.8 symbols/min [2025-09-29T20:16:55.973782] [INFO ] [MAIN ] NSP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:16:56.020929] [DEBUG] [LOCAL ] NSP: Loaded 35480 existing records from primary storage. [2025-09-29T20:16:56.021290] [INFO ] [MAIN ] NSP: Loaded 35480 existing records. [2025-09-29T20:16:56.208593] [WARN ] [MAIN ] NSP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:16:56.208897] [INFO ] [MAIN ] NSP: Wiping existing primary data before full refresh. [2025-09-29T20:16:56.208974] [INFO ] [LOCAL ] NSP: Starting deletion of primary data. [2025-09-29T20:16:56.209393] [DEBUG] [LOCAL ] NSP: Deleted primary data file. [2025-09-29T20:16:56.209469] [INFO ] [MAIN ] NSP: Starting full primary refresh. [2025-09-29T20:16:56.357581] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-07. [2025-09-29T20:16:56.587928] [INFO ] [REMOTE ] NSP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:16:57.085853] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-29T20:16:57.148136] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-08. [2025-09-29T20:16:57.362137] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-29T20:16:57.889880] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-29T20:16:57.948127] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-09. [2025-09-29T20:16:58.647993] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-29T20:16:58.649662] [INFO ] [REMOTE ] NRT: Full fetch complete (8043 records). [2025-09-29T20:16:58.649854] [DEBUG] [VALIDATOR ] NRT: Validating primary data. [2025-09-29T20:16:58.753293] [INFO ] [REMOTE ] NSP: Fetching primary data for 2024-12. [2025-09-29T20:16:59.045580] [DEBUG] [VALIDATOR ] NRT: All expected trading days are present. [2025-09-29T20:16:59.045688] [DEBUG] [VALIDATOR ] NRT: Primary data validation passed. [2025-09-29T20:16:59.045943] [INFO ] [MAIN ] NRT: Fetched primary data is valid. [2025-09-29T20:16:59.045987] [DEBUG] [LOCAL ] NRT: Saving primary data. [2025-09-29T20:16:59.046462] [DEBUG] [LOCAL ] NRT: Trimmed 8043 records to 4946 (keeping 200 days of data) [2025-09-29T20:16:59.077083] [DEBUG] [LOCAL ] NRT: Primary data saved (4946 records). [2025-09-29T20:16:59.077231] [INFO ] [MAIN ] NRT: Full history saved. [2025-09-29T20:16:59.077329] [INFO ] [MAIN ] Update Progress: 1535/2371 symbols completed. NRT took 35.3s. Estimated remaining: 1h 47m 15s. Rate: 7.8 symbols/min [2025-09-29T20:16:59.264002] [INFO ] [MAIN ] NTB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:16:59.287141] [DEBUG] [LOCAL ] NTB: Loaded 20927 existing records from primary storage. [2025-09-29T20:16:59.287445] [INFO ] [MAIN ] NTB: Loaded 20927 existing records. [2025-09-29T20:16:59.492522] [WARN ] [MAIN ] NTB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:16:59.492803] [INFO ] [MAIN ] NTB: Wiping existing primary data before full refresh. [2025-09-29T20:16:59.492866] [INFO ] [LOCAL ] NTB: Starting deletion of primary data. [2025-09-29T20:16:59.493174] [DEBUG] [LOCAL ] NTB: Deleted primary data file. [2025-09-29T20:16:59.493244] [INFO ] [MAIN ] NTB: Starting full primary refresh. [2025-09-29T20:16:59.561210] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-03. [2025-09-29T20:16:59.890287] [INFO ] [REMOTE ] NTB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:17:00.242158] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-29T20:17:00.348126] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-01. [2025-09-29T20:17:01.148163] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-04. [2025-09-29T20:17:01.603801] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-29T20:17:01.862849] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-29T20:17:01.948149] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-02. [2025-09-29T20:17:02.440050] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-29T20:17:02.748134] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-04. [2025-09-29T20:17:03.392189] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-29T20:17:03.548142] [INFO ] [REMOTE ] NTB: Fetching primary data for 2024-12. [2025-09-29T20:17:04.348115] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-03. [2025-09-29T20:17:04.705821] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-29T20:17:04.808570] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-29T20:17:05.148158] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-05. [2025-09-29T20:17:05.948088] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-05. [2025-09-29T20:17:06.023235] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-29T20:17:06.621943] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-29T20:17:06.748158] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-01. [2025-09-29T20:17:07.330464] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-29T20:17:07.548134] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-06. [2025-09-29T20:17:08.045068] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-29T20:17:08.348177] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-02. [2025-09-29T20:17:09.148159] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-06. [2025-09-29T20:17:09.286688] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-29T20:17:09.612050] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-29T20:17:09.948118] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-07. [2025-09-29T20:17:10.748129] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-03. [2025-09-29T20:17:10.872404] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-29T20:17:11.548143] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-07. [2025-09-29T20:17:11.887810] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-29T20:17:12.172191] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-29T20:17:12.348115] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-04. [2025-09-29T20:17:13.148149] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-08. [2025-09-29T20:17:13.244218] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-29T20:17:13.463455] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-29T20:17:13.948107] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-08. [2025-09-29T20:17:14.748115] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-04. [2025-09-29T20:17:14.888800] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-29T20:17:15.548088] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-05. [2025-09-29T20:17:15.653530] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-29T20:17:16.329931] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-29T20:17:16.348078] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-05. [2025-09-29T20:17:16.643826] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-29T20:17:17.148191] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-09. [2025-09-29T20:17:17.883676] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-29T20:17:17.961584] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-06. [2025-09-29T20:17:17.984741] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-29T20:17:17.994563] [INFO ] [REMOTE ] NSC: Full fetch complete (70733 records). [2025-09-29T20:17:17.994750] [DEBUG] [VALIDATOR ] NSC: Validating primary data. [2025-09-29T20:17:17.995491] [FATAL] [VALIDATOR ] NSC: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T20:17:17.995579] [FATAL] [MAIN ] NSC: Fetched primary data is invalid. Refusing to save it. [2025-09-29T20:17:17.995623] [WARN ] [MAIN ] NSC: Deleting existing primary and derivative data due to validation failure. [2025-09-29T20:17:17.995702] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-09-29T20:17:17.995772] [DEBUG] [LOCAL ] NSC: No primary data file found to delete. [2025-09-29T20:17:17.995808] [INFO ] [LOCAL ] NSC: Starting deletion of derivative data. [2025-09-29T20:17:17.996353] [DEBUG] [LOCAL ] NSC: Deleted derivative data file. [2025-09-29T20:17:17.996453] [INFO ] [MAIN ] Update Progress: 1536/2371 symbols completed. NSC took 36.6s. Estimated remaining: 1h 47m 14s. Rate: 7.8 symbols/min [2025-09-29T20:17:18.173273] [INFO ] [MAIN ] NTEST: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:17:18.173531] [DEBUG] [LOCAL ] NTEST: No existing data file found in primary storage. [2025-09-29T20:17:18.173588] [WARN ] [MAIN ] NTEST: No existing data found, performing full refresh instead. [2025-09-29T20:17:18.173767] [INFO ] [MAIN ] NTEST: Wiping existing primary data before full refresh. [2025-09-29T20:17:18.173820] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-09-29T20:17:18.173864] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-09-29T20:17:18.173897] [INFO ] [MAIN ] NTEST: Starting full primary refresh. [2025-09-29T20:17:18.564734] [INFO ] [REMOTE ] NTEST: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:17:18.748135] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-09. [2025-09-29T20:17:19.478306] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-29T20:17:19.548125] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-06. [2025-09-29T20:17:20.352248] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-07. [2025-09-29T20:17:20.358178] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-29T20:17:20.368724] [INFO ] [REMOTE ] NSA: Full fetch complete (61889 records). [2025-09-29T20:17:20.369011] [DEBUG] [VALIDATOR ] NSA: Validating primary data. [2025-09-29T20:17:20.801107] [DEBUG] [VALIDATOR ] NSA: All expected trading days are present. [2025-09-29T20:17:20.802109] [DEBUG] [VALIDATOR ] NSA: Primary data validation passed. [2025-09-29T20:17:20.804622] [INFO ] [MAIN ] NSA: Fetched primary data is valid. [2025-09-29T20:17:20.803213] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-29T20:17:20.804856] [DEBUG] [LOCAL ] NSA: Saving primary data. [2025-09-29T20:17:20.811621] [DEBUG] [LOCAL ] NSA: Trimmed 61889 records to 44760 (keeping 200 days of data) [2025-09-29T20:17:21.115314] [DEBUG] [LOCAL ] NSA: Primary data saved (44760 records). [2025-09-29T20:17:21.115467] [INFO ] [MAIN ] NSA: Full history saved. [2025-09-29T20:17:21.115576] [INFO ] [MAIN ] Update Progress: 1537/2371 symbols completed. NSA took 44.5s. Estimated remaining: 1h 47m 4s. Rate: 7.8 symbols/min [2025-09-29T20:17:21.153289] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-07. [2025-09-29T20:17:21.296870] [INFO ] [MAIN ] NTR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:17:21.350704] [DEBUG] [LOCAL ] NTR: Loaded 53356 existing records from primary storage. [2025-09-29T20:17:21.351070] [INFO ] [MAIN ] NTR: Loaded 53356 existing records. [2025-09-29T20:17:21.532317] [WARN ] [MAIN ] NTR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:17:21.532533] [INFO ] [MAIN ] NTR: Wiping existing primary data before full refresh. [2025-09-29T20:17:21.532605] [INFO ] [LOCAL ] NTR: Starting deletion of primary data. [2025-09-29T20:17:21.532915] [DEBUG] [LOCAL ] NTR: Deleted primary data file. [2025-09-29T20:17:21.532975] [INFO ] [MAIN ] NTR: Starting full primary refresh. [2025-09-29T20:17:21.952067] [INFO ] [REMOTE ] NTR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:17:21.952407] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2024-12. [2025-09-29T20:17:21.978374] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-29T20:17:22.000592] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-29T20:17:22.262268] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2024-12 (0.31 seconds). [2025-09-29T20:17:22.748117] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-08. [2025-09-29T20:17:23.548118] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-01. [2025-09-29T20:17:23.861996] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-29T20:17:24.030004] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-29T20:17:24.348132] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-02. [2025-09-29T20:17:24.561700] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-02 (0.21 seconds). [2025-09-29T20:17:25.148190] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-08. [2025-09-29T20:17:25.948137] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-03. [2025-09-29T20:17:26.091921] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-03 (0.14 seconds). [2025-09-29T20:17:26.705667] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-29T20:17:26.748092] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-09. [2025-09-29T20:17:27.548112] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-04. [2025-09-29T20:17:27.700606] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-04 (0.15 seconds). [2025-09-29T20:17:28.345233] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-29T20:17:28.348171] [INFO ] [REMOTE ] NTR: Fetching primary data for 2024-12. [2025-09-29T20:17:28.354967] [INFO ] [REMOTE ] NSP: Full fetch complete (49549 records). [2025-09-29T20:17:28.355118] [DEBUG] [VALIDATOR ] NSP: Validating primary data. [2025-09-29T20:17:28.766634] [DEBUG] [VALIDATOR ] NSP: All expected trading days are present. [2025-09-29T20:17:28.766806] [DEBUG] [VALIDATOR ] NSP: Primary data validation passed. [2025-09-29T20:17:28.767933] [INFO ] [MAIN ] NSP: Fetched primary data is valid. [2025-09-29T20:17:28.768014] [DEBUG] [LOCAL ] NSP: Saving primary data. [2025-09-29T20:17:28.769205] [DEBUG] [LOCAL ] NSP: Trimmed 49549 records to 34896 (keeping 200 days of data) [2025-09-29T20:17:29.008873] [DEBUG] [LOCAL ] NSP: Primary data saved (34896 records). [2025-09-29T20:17:29.009033] [INFO ] [MAIN ] NSP: Full history saved. [2025-09-29T20:17:29.009137] [INFO ] [MAIN ] Update Progress: 1538/2371 symbols completed. NSP took 33.2s. Estimated remaining: 1h 46m 56s. Rate: 7.8 symbols/min [2025-09-29T20:17:29.157550] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-09. [2025-09-29T20:17:29.193592] [INFO ] [MAIN ] NTST: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:17:29.238736] [DEBUG] [LOCAL ] NTST: Loaded 44211 existing records from primary storage. [2025-09-29T20:17:29.239080] [INFO ] [MAIN ] NTST: Loaded 44211 existing records. [2025-09-29T20:17:29.436837] [WARN ] [MAIN ] NTST: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:17:29.437139] [INFO ] [MAIN ] NTST: Wiping existing primary data before full refresh. [2025-09-29T20:17:29.437198] [INFO ] [LOCAL ] NTST: Starting deletion of primary data. [2025-09-29T20:17:29.437557] [DEBUG] [LOCAL ] NTST: Deleted primary data file. [2025-09-29T20:17:29.437617] [INFO ] [MAIN ] NTST: Starting full primary refresh. [2025-09-29T20:17:29.822855] [INFO ] [REMOTE ] NTST: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:17:29.948148] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-05. [2025-09-29T20:17:30.285679] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-29T20:17:30.326146] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-29T20:17:30.330629] [INFO ] [REMOTE ] NTB: Full fetch complete (30819 records). [2025-09-29T20:17:30.330761] [DEBUG] [VALIDATOR ] NTB: Validating primary data. [2025-09-29T20:17:30.536108] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-29T20:17:30.738043] [DEBUG] [VALIDATOR ] NTB: All expected trading days are present. [2025-09-29T20:17:30.738135] [DEBUG] [VALIDATOR ] NTB: Primary data validation passed. [2025-09-29T20:17:30.738846] [INFO ] [MAIN ] NTB: Fetched primary data is valid. [2025-09-29T20:17:30.738913] [DEBUG] [LOCAL ] NTB: Saving primary data. [2025-09-29T20:17:30.740131] [DEBUG] [LOCAL ] NTB: Trimmed 30819 records to 20433 (keeping 200 days of data) [2025-09-29T20:17:30.793329] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-06. [2025-09-29T20:17:30.872712] [DEBUG] [LOCAL ] NTB: Primary data saved (20433 records). [2025-09-29T20:17:30.872854] [INFO ] [MAIN ] NTB: Full history saved. [2025-09-29T20:17:30.872939] [INFO ] [MAIN ] Update Progress: 1539/2371 symbols completed. NTB took 31.8s. Estimated remaining: 1h 46m 45s. Rate: 7.8 symbols/min [2025-09-29T20:17:31.059483] [INFO ] [MAIN ] NU: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:17:31.122469] [DEBUG] [LOCAL ] NU: Loaded 54526 existing records from primary storage. [2025-09-29T20:17:31.122908] [INFO ] [MAIN ] NU: Loaded 54526 existing records. [2025-09-29T20:17:31.236986] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-29T20:17:31.324120] [WARN ] [MAIN ] NU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:17:31.324377] [INFO ] [MAIN ] NU: Wiping existing primary data before full refresh. [2025-09-29T20:17:31.324428] [INFO ] [LOCAL ] NU: Starting deletion of primary data. [2025-09-29T20:17:31.324706] [DEBUG] [LOCAL ] NU: Deleted primary data file. [2025-09-29T20:17:31.324767] [INFO ] [MAIN ] NU: Starting full primary refresh. [2025-09-29T20:17:31.553346] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-01. [2025-09-29T20:17:31.722916] [INFO ] [REMOTE ] NU: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:17:32.348162] [INFO ] [REMOTE ] NU: Fetching primary data for 2024-12. [2025-09-29T20:17:33.148123] [INFO ] [REMOTE ] NTST: Fetching primary data for 2024-12. [2025-09-29T20:17:33.455799] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-29T20:17:33.948158] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-07. [2025-09-29T20:17:34.490973] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-29T20:17:34.655841] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-29T20:17:34.748153] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-08. [2025-09-29T20:17:34.958489] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2024-12 (2.61 seconds). [2025-09-29T20:17:35.004494] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-09-29T20:17:35.548141] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-02. [2025-09-29T20:17:36.348132] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-01. [2025-09-29T20:17:37.105359] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-29T20:17:37.148088] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-03. [2025-09-29T20:17:37.381436] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-29T20:17:37.948128] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-09. [2025-09-29T20:17:38.260858] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-29T20:17:38.261626] [INFO ] [REMOTE ] NTEST: Full fetch complete (1985 records). [2025-09-29T20:17:38.261731] [DEBUG] [VALIDATOR ] NTEST: Validating primary data. [2025-09-29T20:17:38.262110] [FATAL] [VALIDATOR ] NTEST: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T20:17:38.262198] [FATAL] [MAIN ] NTEST: Fetched primary data is invalid. Refusing to save it. [2025-09-29T20:17:38.262243] [WARN ] [MAIN ] NTEST: Deleting existing primary and derivative data due to validation failure. [2025-09-29T20:17:38.262314] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-09-29T20:17:38.262421] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-09-29T20:17:38.262475] [INFO ] [LOCAL ] NTEST: Starting deletion of derivative data. [2025-09-29T20:17:38.262519] [DEBUG] [LOCAL ] NTEST: No derivative data file found to delete. [2025-09-29T20:17:38.262575] [INFO ] [MAIN ] Update Progress: 1540/2371 symbols completed. NTEST took 20.3s. Estimated remaining: 1h 46m 37s. Rate: 7.8 symbols/min [2025-09-29T20:17:38.451955] [INFO ] [MAIN ] NUE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:17:38.452167] [DEBUG] [LOCAL ] NUE: No existing data file found in primary storage. [2025-09-29T20:17:38.452219] [WARN ] [MAIN ] NUE: No existing data found, performing full refresh instead. [2025-09-29T20:17:38.452334] [INFO ] [MAIN ] NUE: Wiping existing primary data before full refresh. [2025-09-29T20:17:38.452378] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-09-29T20:17:38.452423] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-09-29T20:17:38.452458] [INFO ] [MAIN ] NUE: Starting full primary refresh. [2025-09-29T20:17:38.752489] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-02. [2025-09-29T20:17:38.837719] [INFO ] [REMOTE ] NUE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:17:39.065692] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-29T20:17:39.548166] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-04. [2025-09-29T20:17:40.193088] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-29T20:17:40.348140] [INFO ] [REMOTE ] NUE: Fetching primary data for 2024-12. [2025-09-29T20:17:41.148112] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-01. [2025-09-29T20:17:41.431676] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-29T20:17:41.948135] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-05. [2025-09-29T20:17:42.594316] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-09-29T20:17:42.748094] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-03. [2025-09-29T20:17:43.296984] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-29T20:17:43.548099] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-01. [2025-09-29T20:17:43.786274] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-29T20:17:43.912140] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-29T20:17:44.348123] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-06. [2025-09-29T20:17:44.593612] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-29T20:17:45.148172] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-02. [2025-09-29T20:17:45.948124] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-02. [2025-09-29T20:17:46.246044] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-29T20:17:46.748141] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-07. [2025-09-29T20:17:46.930325] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-29T20:17:47.532482] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-02 (2.38 seconds). [2025-09-29T20:17:47.548091] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-03. [2025-09-29T20:17:48.348123] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-03. [2025-09-29T20:17:48.458348] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-29T20:17:49.148122] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-08. [2025-09-29T20:17:49.209550] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-29T20:17:49.585342] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-29T20:17:49.948147] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-04. [2025-09-29T20:17:50.748119] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-04. [2025-09-29T20:17:51.084168] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-29T20:17:51.548334] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-04. [2025-09-29T20:17:51.680213] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-29T20:17:52.348121] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-05. [2025-09-29T20:17:52.531855] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-29T20:17:53.117779] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-29T20:17:53.148075] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-05. [2025-09-29T20:17:53.558318] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-29T20:17:53.948152] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-09. [2025-09-29T20:17:54.748125] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-06. [2025-09-29T20:17:55.440579] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-09-29T20:17:55.548225] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-06. [2025-09-29T20:17:56.348136] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-05. [2025-09-29T20:17:56.392109] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-29T20:17:57.148127] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-07. [2025-09-29T20:17:57.339457] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-29T20:17:57.710296] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-29T20:17:57.948118] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-07. [2025-09-29T20:17:58.748145] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-06. [2025-09-29T20:17:58.849460] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-29T20:17:59.474391] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-09 (5.53 seconds). [2025-09-29T20:17:59.486009] [INFO ] [REMOTE ] NTR: Full fetch complete (76310 records). [2025-09-29T20:17:59.486200] [DEBUG] [VALIDATOR ] NTR: Validating primary data. [2025-09-29T20:17:59.553408] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-08. [2025-09-29T20:17:59.939674] [DEBUG] [VALIDATOR ] NTR: All expected trading days are present. [2025-09-29T20:17:59.939884] [DEBUG] [VALIDATOR ] NTR: Primary data validation passed. [2025-09-29T20:17:59.941428] [INFO ] [MAIN ] NTR: Fetched primary data is valid. [2025-09-29T20:17:59.941748] [DEBUG] [LOCAL ] NTR: Saving primary data. [2025-09-29T20:17:59.972874] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-29T20:17:59.983595] [DEBUG] [LOCAL ] NTR: Trimmed 76310 records to 52580 (keeping 200 days of data) [2025-09-29T20:18:00.347723] [DEBUG] [LOCAL ] NTR: Primary data saved (52580 records). [2025-09-29T20:18:00.347880] [INFO ] [MAIN ] NTR: Full history saved. [2025-09-29T20:18:00.347981] [INFO ] [MAIN ] Update Progress: 1541/2371 symbols completed. NTR took 39.2s. Estimated remaining: 1h 46m 37s. Rate: 7.8 symbols/min [2025-09-29T20:18:00.348200] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-07. [2025-09-29T20:18:00.573864] [INFO ] [MAIN ] NUS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:18:00.577315] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-09-29T20:18:00.633406] [DEBUG] [LOCAL ] NUS: Loaded 37005 existing records from primary storage. [2025-09-29T20:18:00.633740] [INFO ] [MAIN ] NUS: Loaded 37005 existing records. [2025-09-29T20:18:00.825576] [WARN ] [MAIN ] NUS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:18:00.825918] [INFO ] [MAIN ] NUS: Wiping existing primary data before full refresh. [2025-09-29T20:18:00.825976] [INFO ] [LOCAL ] NUS: Starting deletion of primary data. [2025-09-29T20:18:00.826406] [DEBUG] [LOCAL ] NUS: Deleted primary data file. [2025-09-29T20:18:00.826466] [INFO ] [MAIN ] NUS: Starting full primary refresh. [2025-09-29T20:18:01.150952] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-08. [2025-09-29T20:18:01.212726] [INFO ] [REMOTE ] NUS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:18:01.301231] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-29T20:18:01.414059] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-29T20:18:01.948132] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-09. [2025-09-29T20:18:02.748140] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-08. [2025-09-29T20:18:03.548354] [INFO ] [REMOTE ] NUS: Fetching primary data for 2024-12. [2025-09-29T20:18:03.663577] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-08 (2.51 seconds). [2025-09-29T20:18:03.724220] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-29T20:18:03.738852] [INFO ] [REMOTE ] NTST: Full fetch complete (60934 records). [2025-09-29T20:18:03.739106] [DEBUG] [VALIDATOR ] NTST: Validating primary data. [2025-09-29T20:18:03.883764] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-29T20:18:04.194515] [DEBUG] [VALIDATOR ] NTST: All expected trading days are present. [2025-09-29T20:18:04.194616] [DEBUG] [VALIDATOR ] NTST: Primary data validation passed. [2025-09-29T20:18:04.196001] [INFO ] [MAIN ] NTST: Fetched primary data is valid. [2025-09-29T20:18:04.196072] [DEBUG] [LOCAL ] NTST: Saving primary data. [2025-09-29T20:18:04.197482] [DEBUG] [LOCAL ] NTST: Trimmed 60934 records to 43486 (keeping 200 days of data) [2025-09-29T20:18:04.391949] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-09. [2025-09-29T20:18:04.490604] [DEBUG] [LOCAL ] NTST: Primary data saved (43486 records). [2025-09-29T20:18:04.490770] [INFO ] [MAIN ] NTST: Full history saved. [2025-09-29T20:18:04.490874] [INFO ] [MAIN ] Update Progress: 1542/2371 symbols completed. NTST took 35.5s. Estimated remaining: 1h 46m 28s. Rate: 7.8 symbols/min [2025-09-29T20:18:04.673967] [INFO ] [MAIN ] NUV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:18:04.698915] [DEBUG] [LOCAL ] NUV: Loaded 23576 existing records from primary storage. [2025-09-29T20:18:04.699202] [INFO ] [MAIN ] NUV: Loaded 23576 existing records. [2025-09-29T20:18:04.898669] [WARN ] [MAIN ] NUV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:18:04.898889] [INFO ] [MAIN ] NUV: Wiping existing primary data before full refresh. [2025-09-29T20:18:04.898962] [INFO ] [LOCAL ] NUV: Starting deletion of primary data. [2025-09-29T20:18:04.899419] [DEBUG] [LOCAL ] NUV: Deleted primary data file. [2025-09-29T20:18:04.899495] [INFO ] [MAIN ] NUV: Starting full primary refresh. [2025-09-29T20:18:05.156313] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-09. [2025-09-29T20:18:05.372057] [INFO ] [REMOTE ] NUV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:18:05.390417] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-29T20:18:05.426883] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-29T20:18:05.437180] [INFO ] [REMOTE ] NUE: Full fetch complete (74521 records). [2025-09-29T20:18:05.437355] [DEBUG] [VALIDATOR ] NUE: Validating primary data. [2025-09-29T20:18:05.438219] [FATAL] [VALIDATOR ] NUE: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T20:18:05.438323] [FATAL] [MAIN ] NUE: Fetched primary data is invalid. Refusing to save it. [2025-09-29T20:18:05.438369] [WARN ] [MAIN ] NUE: Deleting existing primary and derivative data due to validation failure. [2025-09-29T20:18:05.438411] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-09-29T20:18:05.438471] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-09-29T20:18:05.438509] [INFO ] [LOCAL ] NUE: Starting deletion of derivative data. [2025-09-29T20:18:05.438572] [DEBUG] [LOCAL ] NUE: No derivative data file found to delete. [2025-09-29T20:18:05.438682] [INFO ] [MAIN ] Update Progress: 1543/2371 symbols completed. NUE took 27.2s. Estimated remaining: 1h 46m 16s. Rate: 7.8 symbols/min [2025-09-29T20:18:05.621805] [INFO ] [MAIN ] NUVB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:18:05.673899] [DEBUG] [LOCAL ] NUVB: Loaded 51998 existing records from primary storage. [2025-09-29T20:18:05.674374] [INFO ] [MAIN ] NUVB: Loaded 51998 existing records. [2025-09-29T20:18:05.863620] [WARN ] [MAIN ] NUVB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:18:05.863856] [INFO ] [MAIN ] NUVB: Wiping existing primary data before full refresh. [2025-09-29T20:18:05.863909] [INFO ] [LOCAL ] NUVB: Starting deletion of primary data. [2025-09-29T20:18:05.864256] [DEBUG] [LOCAL ] NUVB: Deleted primary data file. [2025-09-29T20:18:05.864318] [INFO ] [MAIN ] NUVB: Starting full primary refresh. [2025-09-29T20:18:05.957982] [INFO ] [REMOTE ] NUV: Fetching primary data for 2024-12. [2025-09-29T20:18:06.240092] [INFO ] [REMOTE ] NUVB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:18:06.748150] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2024-12. [2025-09-29T20:18:07.324109] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-29T20:18:07.529516] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-09-29T20:18:07.540882] [INFO ] [REMOTE ] NU: Full fetch complete (77880 records). [2025-09-29T20:18:07.541041] [DEBUG] [VALIDATOR ] NU: Validating primary data. [2025-09-29T20:18:07.553413] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-01. [2025-09-29T20:18:07.946341] [DEBUG] [VALIDATOR ] NU: All expected trading days are present. [2025-09-29T20:18:07.946427] [DEBUG] [VALIDATOR ] NU: Primary data validation passed. [2025-09-29T20:18:07.947637] [INFO ] [MAIN ] NU: Fetched primary data is valid. [2025-09-29T20:18:07.947728] [DEBUG] [LOCAL ] NU: Saving primary data. [2025-09-29T20:18:07.949330] [DEBUG] [LOCAL ] NU: Trimmed 77880 records to 53746 (keeping 200 days of data) [2025-09-29T20:18:08.321812] [DEBUG] [LOCAL ] NU: Primary data saved (53746 records). [2025-09-29T20:18:08.322165] [INFO ] [MAIN ] NU: Full history saved. [2025-09-29T20:18:08.322534] [INFO ] [MAIN ] Update Progress: 1544/2371 symbols completed. NU took 37.4s. Estimated remaining: 1h 46m 6s. Rate: 7.8 symbols/min [2025-09-29T20:18:08.357796] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-01. [2025-09-29T20:18:08.521356] [INFO ] [MAIN ] NUW: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:18:08.578138] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-29T20:18:08.575906] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-29T20:18:08.599680] [DEBUG] [LOCAL ] NUW: Loaded 7512 existing records from primary storage. [2025-09-29T20:18:08.599992] [INFO ] [MAIN ] NUW: Loaded 7512 existing records. [2025-09-29T20:18:08.796069] [WARN ] [MAIN ] NUW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:18:08.796357] [INFO ] [MAIN ] NUW: Wiping existing primary data before full refresh. [2025-09-29T20:18:08.796444] [INFO ] [LOCAL ] NUW: Starting deletion of primary data. [2025-09-29T20:18:08.796711] [DEBUG] [LOCAL ] NUW: Deleted primary data file. [2025-09-29T20:18:08.796774] [INFO ] [MAIN ] NUW: Starting full primary refresh. [2025-09-29T20:18:09.153209] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-02. [2025-09-29T20:18:09.235096] [INFO ] [REMOTE ] NUW: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:18:09.948098] [INFO ] [REMOTE ] NUW: Fetching primary data for 2024-12. [2025-09-29T20:18:10.017287] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-29T20:18:10.358306] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-29T20:18:10.748105] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-03. [2025-09-29T20:18:10.835713] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-29T20:18:11.548714] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-01. [2025-09-29T20:18:11.949919] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-29T20:18:12.348154] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-04. [2025-09-29T20:18:13.148115] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-01. [2025-09-29T20:18:13.236165] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-29T20:18:13.694063] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-29T20:18:13.948097] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-02. [2025-09-29T20:18:14.129090] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-29T20:18:14.748153] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-02. [2025-09-29T20:18:15.550232] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-02. [2025-09-29T20:18:15.553030] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-29T20:18:16.348198] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-05. [2025-09-29T20:18:16.374786] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-29T20:18:16.456863] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-29T20:18:17.148166] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-03. [2025-09-29T20:18:17.270232] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-29T20:18:17.948136] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-03. [2025-09-29T20:18:18.748131] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-06. [2025-09-29T20:18:19.553734] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-03. [2025-09-29T20:18:19.584353] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-09-29T20:18:19.619917] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-29T20:18:20.207852] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-29T20:18:20.348114] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-04. [2025-09-29T20:18:20.452746] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-29T20:18:21.148136] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-04. [2025-09-29T20:18:21.941049] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-29T20:18:21.950409] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-04. [2025-09-29T20:18:22.748116] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-05. [2025-09-29T20:18:22.963089] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-29T20:18:23.000154] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-29T20:18:23.548129] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-05. [2025-09-29T20:18:23.901469] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-29T20:18:24.348117] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-07. [2025-09-29T20:18:25.153227] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-05. [2025-09-29T20:18:25.172496] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-29T20:18:25.587380] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-29T20:18:25.715970] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-29T20:18:25.948162] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-06. [2025-09-29T20:18:26.748156] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-06. [2025-09-29T20:18:27.313617] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-29T20:18:27.548142] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-08. [2025-09-29T20:18:28.348097] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-06. [2025-09-29T20:18:28.657847] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-29T20:18:28.723904] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-29T20:18:29.123033] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-29T20:18:29.148099] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-07. [2025-09-29T20:18:29.948146] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-09. [2025-09-29T20:18:29.964701] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-29T20:18:30.748089] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-07. [2025-09-29T20:18:31.061130] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-29T20:18:31.066332] [INFO ] [REMOTE ] NUV: Full fetch complete (34366 records). [2025-09-29T20:18:31.066441] [DEBUG] [VALIDATOR ] NUV: Validating primary data. [2025-09-29T20:18:31.471018] [DEBUG] [VALIDATOR ] NUV: All expected trading days are present. [2025-09-29T20:18:31.471101] [DEBUG] [VALIDATOR ] NUV: Primary data validation passed. [2025-09-29T20:18:31.471894] [INFO ] [MAIN ] NUV: Fetched primary data is valid. [2025-09-29T20:18:31.471959] [DEBUG] [LOCAL ] NUV: Saving primary data. [2025-09-29T20:18:31.472783] [DEBUG] [LOCAL ] NUV: Trimmed 34366 records to 23326 (keeping 200 days of data) [2025-09-29T20:18:31.560925] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-07. [2025-09-29T20:18:31.622922] [DEBUG] [LOCAL ] NUV: Primary data saved (23326 records). [2025-09-29T20:18:31.623259] [INFO ] [MAIN ] NUV: Full history saved. [2025-09-29T20:18:31.623370] [INFO ] [MAIN ] Update Progress: 1545/2371 symbols completed. NUV took 27.1s. Estimated remaining: 1h 46m 7s. Rate: 7.8 symbols/min [2025-09-29T20:18:31.822407] [INFO ] [MAIN ] NVG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:18:31.856037] [DEBUG] [LOCAL ] NVG: Loaded 27703 existing records from primary storage. [2025-09-29T20:18:31.856324] [INFO ] [MAIN ] NVG: Loaded 27703 existing records. [2025-09-29T20:18:32.037285] [WARN ] [MAIN ] NVG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:18:32.037534] [INFO ] [MAIN ] NVG: Wiping existing primary data before full refresh. [2025-09-29T20:18:32.037603] [INFO ] [LOCAL ] NVG: Starting deletion of primary data. [2025-09-29T20:18:32.038122] [DEBUG] [LOCAL ] NVG: Deleted primary data file. [2025-09-29T20:18:32.038186] [INFO ] [MAIN ] NVG: Starting full primary refresh. [2025-09-29T20:18:32.353248] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-08. [2025-09-29T20:18:32.426189] [INFO ] [REMOTE ] NVG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:18:32.880117] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-29T20:18:33.041486] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-29T20:18:33.065608] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-29T20:18:33.148104] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-09. [2025-09-29T20:18:33.877541] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-29T20:18:33.879904] [INFO ] [REMOTE ] NUW: Full fetch complete (11720 records). [2025-09-29T20:18:33.879981] [DEBUG] [VALIDATOR ] NUW: Validating primary data. [2025-09-29T20:18:33.953333] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-08. [2025-09-29T20:18:34.286292] [DEBUG] [VALIDATOR ] NUW: All expected trading days are present. [2025-09-29T20:18:34.286380] [DEBUG] [VALIDATOR ] NUW: Primary data validation passed. [2025-09-29T20:18:34.286697] [INFO ] [MAIN ] NUW: Fetched primary data is valid. [2025-09-29T20:18:34.286761] [DEBUG] [LOCAL ] NUW: Saving primary data. [2025-09-29T20:18:34.287424] [DEBUG] [LOCAL ] NUW: Trimmed 11720 records to 7406 (keeping 200 days of data) [2025-09-29T20:18:34.340241] [DEBUG] [LOCAL ] NUW: Primary data saved (7406 records). [2025-09-29T20:18:34.340393] [INFO ] [MAIN ] NUW: Full history saved. [2025-09-29T20:18:34.340483] [INFO ] [MAIN ] Update Progress: 1546/2371 symbols completed. NUW took 26.0s. Estimated remaining: 1h 45m 56s. Rate: 7.8 symbols/min [2025-09-29T20:18:34.525899] [INFO ] [MAIN ] NVGS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:18:34.563152] [DEBUG] [LOCAL ] NVGS: Loaded 31403 existing records from primary storage. [2025-09-29T20:18:34.563446] [INFO ] [MAIN ] NVGS: Loaded 31403 existing records. [2025-09-29T20:18:34.753506] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-08. [2025-09-29T20:18:34.753357] [WARN ] [MAIN ] NVGS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:18:34.754527] [INFO ] [MAIN ] NVGS: Wiping existing primary data before full refresh. [2025-09-29T20:18:34.754578] [INFO ] [LOCAL ] NVGS: Starting deletion of primary data. [2025-09-29T20:18:34.754816] [DEBUG] [LOCAL ] NVGS: Deleted primary data file. [2025-09-29T20:18:34.754875] [INFO ] [MAIN ] NVGS: Starting full primary refresh. [2025-09-29T20:18:35.137428] [INFO ] [REMOTE ] NVGS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:18:35.548152] [INFO ] [REMOTE ] NVG: Fetching primary data for 2024-12. [2025-09-29T20:18:35.886966] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-29T20:18:36.349196] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-29T20:18:36.348257] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-09. [2025-09-29T20:18:37.050723] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-29T20:18:37.148201] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-01. [2025-09-29T20:18:37.948070] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2024-12. [2025-09-29T20:18:38.473123] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-29T20:18:38.501790] [INFO ] [REMOTE ] NUVB: Full fetch complete (72697 records). [2025-09-29T20:18:38.503357] [DEBUG] [VALIDATOR ] NUVB: Validating primary data. [2025-09-29T20:18:38.503219] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-29T20:18:38.755275] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-02. [2025-09-29T20:18:38.940691] [DEBUG] [VALIDATOR ] NUVB: All expected trading days are present. [2025-09-29T20:18:38.940850] [DEBUG] [VALIDATOR ] NUVB: Primary data validation passed. [2025-09-29T20:18:38.942076] [INFO ] [MAIN ] NUVB: Fetched primary data is valid. [2025-09-29T20:18:38.942145] [DEBUG] [LOCAL ] NUVB: Saving primary data. [2025-09-29T20:18:38.943819] [DEBUG] [LOCAL ] NUVB: Trimmed 72697 records to 51242 (keeping 200 days of data) [2025-09-29T20:18:39.177513] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-29T20:18:39.287787] [DEBUG] [LOCAL ] NUVB: Primary data saved (51242 records). [2025-09-29T20:18:39.287941] [INFO ] [MAIN ] NUVB: Full history saved. [2025-09-29T20:18:39.288032] [INFO ] [MAIN ] Update Progress: 1547/2371 symbols completed. NUVB took 33.8s. Estimated remaining: 1h 45m 47s. Rate: 7.8 symbols/min [2025-09-29T20:18:39.465781] [INFO ] [MAIN ] NVO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:18:39.520480] [DEBUG] [LOCAL ] NVO: Loaded 54564 existing records from primary storage. [2025-09-29T20:18:39.520854] [INFO ] [MAIN ] NVO: Loaded 54564 existing records. [2025-09-29T20:18:39.553250] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-01. [2025-09-29T20:18:39.717845] [WARN ] [MAIN ] NVO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:18:39.718099] [INFO ] [MAIN ] NVO: Wiping existing primary data before full refresh. [2025-09-29T20:18:39.718186] [INFO ] [LOCAL ] NVO: Starting deletion of primary data. [2025-09-29T20:18:39.718545] [DEBUG] [LOCAL ] NVO: Deleted primary data file. [2025-09-29T20:18:39.718615] [INFO ] [MAIN ] NVO: Starting full primary refresh. [2025-09-29T20:18:40.102748] [INFO ] [REMOTE ] NVO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:18:40.169192] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-29T20:18:40.348085] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-03. [2025-09-29T20:18:40.896962] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-29T20:18:41.148116] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-02. [2025-09-29T20:18:41.598896] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-29T20:18:41.948159] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-09. [2025-09-29T20:18:42.389314] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-29T20:18:42.748249] [INFO ] [REMOTE ] NVO: Fetching primary data for 2024-12. [2025-09-29T20:18:43.021299] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-29T20:18:43.030835] [INFO ] [REMOTE ] NUS: Full fetch complete (53898 records). [2025-09-29T20:18:43.031011] [DEBUG] [VALIDATOR ] NUS: Validating primary data. [2025-09-29T20:18:43.438731] [DEBUG] [VALIDATOR ] NUS: All expected trading days are present. [2025-09-29T20:18:43.438821] [DEBUG] [VALIDATOR ] NUS: Primary data validation passed. [2025-09-29T20:18:43.439734] [INFO ] [MAIN ] NUS: Fetched primary data is valid. [2025-09-29T20:18:43.439798] [DEBUG] [LOCAL ] NUS: Saving primary data. [2025-09-29T20:18:43.441271] [DEBUG] [LOCAL ] NUS: Trimmed 53898 records to 36394 (keeping 200 days of data) [2025-09-29T20:18:43.548619] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-03. [2025-09-29T20:18:43.687419] [DEBUG] [LOCAL ] NUS: Primary data saved (36394 records). [2025-09-29T20:18:43.687583] [INFO ] [MAIN ] NUS: Full history saved. [2025-09-29T20:18:43.687726] [INFO ] [MAIN ] Update Progress: 1548/2371 symbols completed. NUS took 43.3s. Estimated remaining: 1h 45m 38s. Rate: 7.8 symbols/min [2025-09-29T20:18:43.871049] [INFO ] [MAIN ] NVR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:18:43.892681] [DEBUG] [LOCAL ] NVR: Loaded 19323 existing records from primary storage. [2025-09-29T20:18:43.892975] [INFO ] [MAIN ] NVR: Loaded 19323 existing records. [2025-09-29T20:18:44.079188] [WARN ] [MAIN ] NVR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:18:44.079460] [INFO ] [MAIN ] NVR: Wiping existing primary data before full refresh. [2025-09-29T20:18:44.079510] [INFO ] [LOCAL ] NVR: Starting deletion of primary data. [2025-09-29T20:18:44.079816] [DEBUG] [LOCAL ] NVR: Deleted primary data file. [2025-09-29T20:18:44.079878] [INFO ] [MAIN ] NVR: Starting full primary refresh. [2025-09-29T20:18:44.353275] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-04. [2025-09-29T20:18:44.486963] [INFO ] [REMOTE ] NVR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:18:44.993907] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-29T20:18:45.148086] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-04. [2025-09-29T20:18:45.491340] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2024-12 (2.74 seconds). [2025-09-29T20:18:45.803792] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-29T20:18:45.948135] [INFO ] [REMOTE ] NVR: Fetching primary data for 2024-12. [2025-09-29T20:18:46.172835] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-29T20:18:46.748132] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-05. [2025-09-29T20:18:46.821772] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-29T20:18:47.548156] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-01. [2025-09-29T20:18:48.166441] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-29T20:18:48.348112] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-06. [2025-09-29T20:18:48.806541] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-29T20:18:49.148141] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-01. [2025-09-29T20:18:49.935563] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-29T20:18:49.948064] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-07. [2025-09-29T20:18:50.748167] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-02. [2025-09-29T20:18:51.526142] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-29T20:18:51.548085] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-08. [2025-09-29T20:18:51.621844] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-01 (2.47 seconds). [2025-09-29T20:18:51.819266] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-29T20:18:52.348127] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-02. [2025-09-29T20:18:52.960129] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-29T20:18:53.148117] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-05. [2025-09-29T20:18:53.948157] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-09. [2025-09-29T20:18:54.403894] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-29T20:18:54.510819] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-09-29T20:18:54.748125] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-03. [2025-09-29T20:18:54.764830] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-29T20:18:54.770278] [INFO ] [REMOTE ] NVGS: Full fetch complete (41487 records). [2025-09-29T20:18:54.770426] [DEBUG] [VALIDATOR ] NVGS: Validating primary data. [2025-09-29T20:18:55.187511] [DEBUG] [VALIDATOR ] NVGS: All expected trading days are present. [2025-09-29T20:18:55.187639] [DEBUG] [VALIDATOR ] NVGS: Primary data validation passed. [2025-09-29T20:18:55.189125] [INFO ] [MAIN ] NVGS: Fetched primary data is valid. [2025-09-29T20:18:55.189240] [DEBUG] [LOCAL ] NVGS: Saving primary data. [2025-09-29T20:18:55.190388] [DEBUG] [LOCAL ] NVGS: Trimmed 41487 records to 30869 (keeping 200 days of data) [2025-09-29T20:18:55.403186] [DEBUG] [LOCAL ] NVGS: Primary data saved (30869 records). [2025-09-29T20:18:55.403336] [INFO ] [MAIN ] NVGS: Full history saved. [2025-09-29T20:18:55.403419] [INFO ] [MAIN ] Update Progress: 1549/2371 symbols completed. NVGS took 21.1s. Estimated remaining: 1h 45m 32s. Rate: 7.8 symbols/min [2025-09-29T20:18:55.551543] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-03. [2025-09-29T20:18:55.578055] [INFO ] [MAIN ] NVRI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:18:55.615250] [DEBUG] [LOCAL ] NVRI: Loaded 39367 existing records from primary storage. [2025-09-29T20:18:55.615567] [INFO ] [MAIN ] NVRI: Loaded 39367 existing records. [2025-09-29T20:18:55.804328] [WARN ] [MAIN ] NVRI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:18:55.804595] [INFO ] [MAIN ] NVRI: Wiping existing primary data before full refresh. [2025-09-29T20:18:55.804683] [INFO ] [LOCAL ] NVRI: Starting deletion of primary data. [2025-09-29T20:18:55.805081] [DEBUG] [LOCAL ] NVRI: Deleted primary data file. [2025-09-29T20:18:55.805150] [INFO ] [MAIN ] NVRI: Starting full primary refresh. [2025-09-29T20:18:56.202558] [INFO ] [REMOTE ] NVRI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:18:56.348108] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2024-12. [2025-09-29T20:18:56.888801] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-29T20:18:57.148108] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-06. [2025-09-29T20:18:57.578720] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-03 (2.83 seconds). [2025-09-29T20:18:57.920115] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-29T20:18:57.948113] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-04. [2025-09-29T20:18:58.394707] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-29T20:18:58.748113] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-01. [2025-09-29T20:18:59.548112] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-04. [2025-09-29T20:19:00.206458] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-29T20:19:00.348125] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-02. [2025-09-29T20:19:00.797204] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-04 (2.85 seconds). [2025-09-29T20:19:00.903212] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-29T20:19:01.148116] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-05. [2025-09-29T20:19:01.871490] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-29T20:19:01.948094] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-05. [2025-09-29T20:19:02.313816] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-29T20:19:02.748200] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-03. [2025-09-29T20:19:03.548138] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-06. [2025-09-29T20:19:04.348135] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-07. [2025-09-29T20:19:04.436803] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-29T20:19:04.759760] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-29T20:19:04.840914] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-05 (2.89 seconds). [2025-09-29T20:19:05.148138] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-04. [2025-09-29T20:19:05.345074] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-29T20:19:05.948125] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-06. [2025-09-29T20:19:06.521823] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-29T20:19:06.748148] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-07. [2025-09-29T20:19:07.548139] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-05. [2025-09-29T20:19:07.914396] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-29T20:19:08.348118] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-08. [2025-09-29T20:19:08.625112] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-06 (2.68 seconds). [2025-09-29T20:19:09.153444] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-08. [2025-09-29T20:19:09.155960] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-29T20:19:09.657959] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-29T20:19:09.948172] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-06. [2025-09-29T20:19:10.133087] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-29T20:19:10.748118] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-09. [2025-09-29T20:19:11.447317] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-29T20:19:11.548136] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-07. [2025-09-29T20:19:11.832072] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-29T20:19:11.836217] [INFO ] [REMOTE ] NVR: Full fetch complete (29705 records). [2025-09-29T20:19:11.836371] [DEBUG] [VALIDATOR ] NVR: Validating primary data. [2025-09-29T20:19:12.236608] [DEBUG] [VALIDATOR ] NVR: All expected trading days are present. [2025-09-29T20:19:12.236738] [DEBUG] [VALIDATOR ] NVR: Primary data validation passed. [2025-09-29T20:19:12.237502] [INFO ] [MAIN ] NVR: Fetched primary data is valid. [2025-09-29T20:19:12.237582] [DEBUG] [LOCAL ] NVR: Saving primary data. [2025-09-29T20:19:12.238454] [DEBUG] [LOCAL ] NVR: Trimmed 29705 records to 18774 (keeping 200 days of data) [2025-09-29T20:19:12.348273] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-07. [2025-09-29T20:19:12.375778] [DEBUG] [LOCAL ] NVR: Primary data saved (18774 records). [2025-09-29T20:19:12.375949] [INFO ] [MAIN ] NVR: Full history saved. [2025-09-29T20:19:12.376164] [INFO ] [MAIN ] Update Progress: 1550/2371 symbols completed. NVR took 28.7s. Estimated remaining: 1h 45m 29s. Rate: 7.8 symbols/min [2025-09-29T20:19:12.574266] [INFO ] [MAIN ] NVS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:19:12.641755] [DEBUG] [LOCAL ] NVS: Loaded 52338 existing records from primary storage. [2025-09-29T20:19:12.642102] [INFO ] [MAIN ] NVS: Loaded 52338 existing records. [2025-09-29T20:19:12.891172] [WARN ] [MAIN ] NVS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:19:12.891566] [INFO ] [MAIN ] NVS: Wiping existing primary data before full refresh. [2025-09-29T20:19:12.891757] [INFO ] [LOCAL ] NVS: Starting deletion of primary data. [2025-09-29T20:19:12.892708] [DEBUG] [LOCAL ] NVS: Deleted primary data file. [2025-09-29T20:19:12.892789] [INFO ] [MAIN ] NVS: Starting full primary refresh. [2025-09-29T20:19:13.151275] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-09. [2025-09-29T20:19:13.195109] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-29T20:19:13.352463] [INFO ] [REMOTE ] NVS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:19:13.948152] [INFO ] [REMOTE ] NVS: Fetching primary data for 2024-12. [2025-09-29T20:19:14.692051] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-29T20:19:14.698612] [INFO ] [REMOTE ] NVG: Full fetch complete (40735 records). [2025-09-29T20:19:14.698767] [DEBUG] [VALIDATOR ] NVG: Validating primary data. [2025-09-29T20:19:14.754603] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-08. [2025-09-29T20:19:15.123211] [DEBUG] [VALIDATOR ] NVG: All expected trading days are present. [2025-09-29T20:19:15.123335] [DEBUG] [VALIDATOR ] NVG: Primary data validation passed. [2025-09-29T20:19:15.124488] [INFO ] [MAIN ] NVG: Fetched primary data is valid. [2025-09-29T20:19:15.124684] [DEBUG] [LOCAL ] NVG: Saving primary data. [2025-09-29T20:19:15.126747] [DEBUG] [LOCAL ] NVG: Trimmed 40735 records to 27366 (keeping 200 days of data) [2025-09-29T20:19:15.272878] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-07 (2.92 seconds). [2025-09-29T20:19:15.384818] [DEBUG] [LOCAL ] NVG: Primary data saved (27366 records). [2025-09-29T20:19:15.384989] [INFO ] [MAIN ] NVG: Full history saved. [2025-09-29T20:19:15.385150] [INFO ] [MAIN ] Update Progress: 1551/2371 symbols completed. NVG took 43.8s. Estimated remaining: 1h 45m 19s. Rate: 7.8 symbols/min [2025-09-29T20:19:15.548455] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-08. [2025-09-29T20:19:15.572736] [INFO ] [MAIN ] NVST: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:19:15.626317] [DEBUG] [LOCAL ] NVST: Loaded 52381 existing records from primary storage. [2025-09-29T20:19:15.626737] [INFO ] [MAIN ] NVST: Loaded 52381 existing records. [2025-09-29T20:19:15.821730] [WARN ] [MAIN ] NVST: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:19:15.821996] [INFO ] [MAIN ] NVST: Wiping existing primary data before full refresh. [2025-09-29T20:19:15.822074] [INFO ] [LOCAL ] NVST: Starting deletion of primary data. [2025-09-29T20:19:15.822384] [DEBUG] [LOCAL ] NVST: Deleted primary data file. [2025-09-29T20:19:15.822503] [INFO ] [MAIN ] NVST: Starting full primary refresh. [2025-09-29T20:19:16.171898] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-09-29T20:19:16.252528] [INFO ] [REMOTE ] NVST: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:19:16.348091] [INFO ] [REMOTE ] NVST: Fetching primary data for 2024-12. [2025-09-29T20:19:16.524549] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-29T20:19:17.148110] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-09. [2025-09-29T20:19:17.948092] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-01. [2025-09-29T20:19:18.168173] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-29T20:19:18.398241] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-08 (2.85 seconds). [2025-09-29T20:19:18.748079] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-09. [2025-09-29T20:19:18.832468] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-29T20:19:18.841616] [INFO ] [REMOTE ] NVRI: Full fetch complete (55868 records). [2025-09-29T20:19:18.841804] [DEBUG] [VALIDATOR ] NVRI: Validating primary data. [2025-09-29T20:19:19.258439] [DEBUG] [VALIDATOR ] NVRI: All expected trading days are present. [2025-09-29T20:19:19.258528] [DEBUG] [VALIDATOR ] NVRI: Primary data validation passed. [2025-09-29T20:19:19.259628] [INFO ] [MAIN ] NVRI: Fetched primary data is valid. [2025-09-29T20:19:19.259717] [DEBUG] [LOCAL ] NVRI: Saving primary data. [2025-09-29T20:19:19.261001] [DEBUG] [LOCAL ] NVRI: Trimmed 55868 records to 38743 (keeping 200 days of data) [2025-09-29T20:19:19.524150] [DEBUG] [LOCAL ] NVRI: Primary data saved (38743 records). [2025-09-29T20:19:19.524310] [INFO ] [MAIN ] NVRI: Full history saved. [2025-09-29T20:19:19.524418] [INFO ] [MAIN ] Update Progress: 1552/2371 symbols completed. NVRI took 24.1s. Estimated remaining: 1h 45m 10s. Rate: 7.8 symbols/min [2025-09-29T20:19:19.558968] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-01. [2025-09-29T20:19:19.724389] [INFO ] [MAIN ] NVT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:19:19.764234] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-29T20:19:19.822908] [DEBUG] [LOCAL ] NVT: Loaded 52330 existing records from primary storage. [2025-09-29T20:19:19.823282] [INFO ] [MAIN ] NVT: Loaded 52330 existing records. [2025-09-29T20:19:20.019715] [WARN ] [MAIN ] NVT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:19:20.019935] [INFO ] [MAIN ] NVT: Wiping existing primary data before full refresh. [2025-09-29T20:19:20.020029] [INFO ] [LOCAL ] NVT: Starting deletion of primary data. [2025-09-29T20:19:20.020611] [DEBUG] [LOCAL ] NVT: Deleted primary data file. [2025-09-29T20:19:20.020713] [INFO ] [MAIN ] NVT: Starting full primary refresh. [2025-09-29T20:19:20.357608] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-02. [2025-09-29T20:19:20.408327] [INFO ] [REMOTE ] NVT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:19:21.148113] [INFO ] [REMOTE ] NVT: Fetching primary data for 2024-12. [2025-09-29T20:19:21.279036] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-29T20:19:21.372031] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-09-29T20:19:21.383073] [INFO ] [REMOTE ] NVO: Full fetch complete (77955 records). [2025-09-29T20:19:21.383230] [DEBUG] [VALIDATOR ] NVO: Validating primary data. [2025-09-29T20:19:21.854512] [DEBUG] [VALIDATOR ] NVO: All expected trading days are present. [2025-09-29T20:19:21.854631] [DEBUG] [VALIDATOR ] NVO: Primary data validation passed. [2025-09-29T20:19:21.855886] [INFO ] [MAIN ] NVO: Fetched primary data is valid. [2025-09-29T20:19:21.855955] [DEBUG] [LOCAL ] NVO: Saving primary data. [2025-09-29T20:19:21.857620] [DEBUG] [LOCAL ] NVO: Trimmed 77955 records to 53784 (keeping 200 days of data) [2025-09-29T20:19:21.951851] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-02. [2025-09-29T20:19:22.228911] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-29T20:19:22.254340] [DEBUG] [LOCAL ] NVO: Primary data saved (53784 records). [2025-09-29T20:19:22.254494] [INFO ] [MAIN ] NVO: Full history saved. [2025-09-29T20:19:22.254621] [INFO ] [MAIN ] Update Progress: 1553/2371 symbols completed. NVO took 43.0s. Estimated remaining: 1h 44m 59s. Rate: 7.8 symbols/min [2025-09-29T20:19:22.436090] [INFO ] [MAIN ] NWG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:19:22.498777] [DEBUG] [LOCAL ] NWG: Loaded 52318 existing records from primary storage. [2025-09-29T20:19:22.499132] [INFO ] [MAIN ] NWG: Loaded 52318 existing records. [2025-09-29T20:19:22.700245] [WARN ] [MAIN ] NWG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:19:22.700747] [INFO ] [MAIN ] NWG: Wiping existing primary data before full refresh. [2025-09-29T20:19:22.700803] [INFO ] [LOCAL ] NWG: Starting deletion of primary data. [2025-09-29T20:19:22.701310] [DEBUG] [LOCAL ] NWG: Deleted primary data file. [2025-09-29T20:19:22.701373] [INFO ] [MAIN ] NWG: Starting full primary refresh. [2025-09-29T20:19:22.771514] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-03. [2025-09-29T20:19:23.087573] [INFO ] [REMOTE ] NWG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:19:23.115585] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-29T20:19:23.548104] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-01. [2025-09-29T20:19:23.741802] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-29T20:19:24.348113] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-03. [2025-09-29T20:19:24.794435] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-29T20:19:25.148081] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-04. [2025-09-29T20:19:25.343809] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-29T20:19:25.948142] [INFO ] [REMOTE ] NWG: Fetching primary data for 2024-12. [2025-09-29T20:19:26.177418] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-29T20:19:26.742143] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-29T20:19:26.753435] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-02. [2025-09-29T20:19:27.423038] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-29T20:19:27.548134] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-01. [2025-09-29T20:19:28.348097] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-05. [2025-09-29T20:19:28.422718] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-29T20:19:29.148118] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-03. [2025-09-29T20:19:29.392954] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-29T20:19:29.948086] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-02. [2025-09-29T20:19:30.142591] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-29T20:19:30.748107] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-04. [2025-09-29T20:19:30.997790] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-29T20:19:31.548168] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-06. [2025-09-29T20:19:31.688457] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-29T20:19:32.348141] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-04. [2025-09-29T20:19:32.604351] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-29T20:19:33.148140] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-03. [2025-09-29T20:19:33.296725] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-29T20:19:33.948159] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-05. [2025-09-29T20:19:34.192601] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-29T20:19:34.748088] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-07. [2025-09-29T20:19:35.181117] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-29T20:19:35.274837] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-29T20:19:35.548125] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-06. [2025-09-29T20:19:36.348078] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-05. [2025-09-29T20:19:36.848924] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-29T20:19:37.148104] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-08. [2025-09-29T20:19:37.280090] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-29T20:19:37.685730] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-29T20:19:37.948131] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-04. [2025-09-29T20:19:38.748138] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-07. [2025-09-29T20:19:38.807625] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-29T20:19:39.548090] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-06. [2025-09-29T20:19:39.792988] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-29T20:19:40.348106] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-05. [2025-09-29T20:19:40.657244] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-29T20:19:41.148121] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-09. [2025-09-29T20:19:41.423128] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-29T20:19:41.948164] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-08. [2025-09-29T20:19:42.308560] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-29T20:19:42.748085] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-06. [2025-09-29T20:19:43.152542] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-29T20:19:43.163115] [INFO ] [REMOTE ] NVS: Full fetch complete (74767 records). [2025-09-29T20:19:43.163259] [DEBUG] [VALIDATOR ] NVS: Validating primary data. [2025-09-29T20:19:43.559857] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-07. [2025-09-29T20:19:43.589888] [DEBUG] [VALIDATOR ] NVS: All expected trading days are present. [2025-09-29T20:19:43.590007] [DEBUG] [VALIDATOR ] NVS: Primary data validation passed. [2025-09-29T20:19:43.591270] [INFO ] [MAIN ] NVS: Fetched primary data is valid. [2025-09-29T20:19:43.591343] [DEBUG] [LOCAL ] NVS: Saving primary data. [2025-09-29T20:19:43.593392] [DEBUG] [LOCAL ] NVS: Trimmed 74767 records to 51549 (keeping 200 days of data) [2025-09-29T20:19:43.932244] [DEBUG] [LOCAL ] NVS: Primary data saved (51549 records). [2025-09-29T20:19:43.932379] [INFO ] [MAIN ] NVS: Full history saved. [2025-09-29T20:19:43.932492] [INFO ] [MAIN ] Update Progress: 1554/2371 symbols completed. NVS took 31.6s. Estimated remaining: 1h 44m 59s. Rate: 7.8 symbols/min [2025-09-29T20:19:44.137900] [INFO ] [MAIN ] NWN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:19:44.171978] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-29T20:19:44.203438] [DEBUG] [LOCAL ] NWN: Loaded 27222 existing records from primary storage. [2025-09-29T20:19:44.203877] [INFO ] [MAIN ] NWN: Loaded 27222 existing records. [2025-09-29T20:19:44.363800] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-09. [2025-09-29T20:19:44.407604] [WARN ] [MAIN ] NWN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:19:44.408089] [INFO ] [MAIN ] NWN: Wiping existing primary data before full refresh. [2025-09-29T20:19:44.408373] [INFO ] [LOCAL ] NWN: Starting deletion of primary data. [2025-09-29T20:19:44.408694] [DEBUG] [LOCAL ] NWN: Deleted primary data file. [2025-09-29T20:19:44.408824] [INFO ] [MAIN ] NWN: Starting full primary refresh. [2025-09-29T20:19:44.614695] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-29T20:19:44.839341] [INFO ] [REMOTE ] NWN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:19:45.148080] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-07. [2025-09-29T20:19:45.572510] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-29T20:19:45.948116] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-08. [2025-09-29T20:19:46.219213] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-29T20:19:46.230347] [INFO ] [REMOTE ] NVST: Full fetch complete (74066 records). [2025-09-29T20:19:46.230506] [DEBUG] [VALIDATOR ] NVST: Validating primary data. [2025-09-29T20:19:46.666676] [DEBUG] [VALIDATOR ] NVST: All expected trading days are present. [2025-09-29T20:19:46.666780] [DEBUG] [VALIDATOR ] NVST: Primary data validation passed. [2025-09-29T20:19:46.668044] [INFO ] [MAIN ] NVST: Fetched primary data is valid. [2025-09-29T20:19:46.668115] [DEBUG] [LOCAL ] NVST: Saving primary data. [2025-09-29T20:19:46.669837] [DEBUG] [LOCAL ] NVST: Trimmed 74066 records to 51609 (keeping 200 days of data) [2025-09-29T20:19:46.760587] [INFO ] [REMOTE ] NWN: Fetching primary data for 2024-12. [2025-09-29T20:19:47.005176] [DEBUG] [LOCAL ] NVST: Primary data saved (51609 records). [2025-09-29T20:19:47.005365] [INFO ] [MAIN ] NVST: Full history saved. [2025-09-29T20:19:47.005468] [INFO ] [MAIN ] Update Progress: 1555/2371 symbols completed. NVST took 31.6s. Estimated remaining: 1h 44m 49s. Rate: 7.8 symbols/min [2025-09-29T20:19:47.207223] [INFO ] [MAIN ] NX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:19:47.231366] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-29T20:19:47.277871] [DEBUG] [LOCAL ] NX: Loaded 33894 existing records from primary storage. [2025-09-29T20:19:47.278166] [INFO ] [MAIN ] NX: Loaded 33894 existing records. [2025-09-29T20:19:47.472065] [WARN ] [MAIN ] NX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:19:47.472415] [INFO ] [MAIN ] NX: Wiping existing primary data before full refresh. [2025-09-29T20:19:47.472471] [INFO ] [LOCAL ] NX: Starting deletion of primary data. [2025-09-29T20:19:47.472856] [DEBUG] [LOCAL ] NX: Deleted primary data file. [2025-09-29T20:19:47.472915] [INFO ] [MAIN ] NX: Starting full primary refresh. [2025-09-29T20:19:47.548345] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-08. [2025-09-29T20:19:47.887571] [INFO ] [REMOTE ] NX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:19:47.917853] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-29T20:19:48.022178] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-29T20:19:48.348119] [INFO ] [REMOTE ] NX: Fetching primary data for 2024-12. [2025-09-29T20:19:49.148102] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-09. [2025-09-29T20:19:49.405424] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-29T20:19:49.773763] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-29T20:19:49.948146] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-01. [2025-09-29T20:19:50.748098] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-09. [2025-09-29T20:19:51.147859] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-29T20:19:51.159060] [INFO ] [REMOTE ] NVT: Full fetch complete (74523 records). [2025-09-29T20:19:51.159290] [DEBUG] [VALIDATOR ] NVT: Validating primary data. [2025-09-29T20:19:51.260754] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-29T20:19:51.553301] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-01. [2025-09-29T20:19:51.614748] [DEBUG] [VALIDATOR ] NVT: All expected trading days are present. [2025-09-29T20:19:51.614844] [DEBUG] [VALIDATOR ] NVT: Primary data validation passed. [2025-09-29T20:19:51.615967] [INFO ] [MAIN ] NVT: Fetched primary data is valid. [2025-09-29T20:19:51.616032] [DEBUG] [LOCAL ] NVT: Saving primary data. [2025-09-29T20:19:51.617665] [DEBUG] [LOCAL ] NVT: Trimmed 74523 records to 51518 (keeping 200 days of data) [2025-09-29T20:19:51.962997] [DEBUG] [LOCAL ] NVT: Primary data saved (51518 records). [2025-09-29T20:19:51.963174] [INFO ] [MAIN ] NVT: Full history saved. [2025-09-29T20:19:51.963279] [INFO ] [MAIN ] Update Progress: 1556/2371 symbols completed. NVT took 32.4s. Estimated remaining: 1h 44m 40s. Rate: 7.8 symbols/min [2025-09-29T20:19:52.143181] [INFO ] [MAIN ] NXC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:19:52.150515] [DEBUG] [LOCAL ] NXC: Loaded 4313 existing records from primary storage. [2025-09-29T20:19:52.150742] [INFO ] [MAIN ] NXC: Loaded 4313 existing records. [2025-09-29T20:19:52.341723] [WARN ] [MAIN ] NXC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:19:52.342273] [INFO ] [MAIN ] NXC: Wiping existing primary data before full refresh. [2025-09-29T20:19:52.342468] [INFO ] [LOCAL ] NXC: Starting deletion of primary data. [2025-09-29T20:19:52.342914] [DEBUG] [LOCAL ] NXC: Deleted primary data file. [2025-09-29T20:19:52.342976] [INFO ] [MAIN ] NXC: Starting full primary refresh. [2025-09-29T20:19:52.374751] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-02. [2025-09-29T20:19:52.766783] [INFO ] [REMOTE ] NXC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:19:52.770331] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-29T20:19:52.783529] [INFO ] [REMOTE ] NWG: Full fetch complete (73258 records). [2025-09-29T20:19:52.783800] [DEBUG] [VALIDATOR ] NWG: Validating primary data. [2025-09-29T20:19:52.980886] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-29T20:19:53.151023] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-02. [2025-09-29T20:19:53.261447] [DEBUG] [VALIDATOR ] NWG: All expected trading days are present. [2025-09-29T20:19:53.261728] [DEBUG] [VALIDATOR ] NWG: Primary data validation passed. [2025-09-29T20:19:53.262940] [INFO ] [MAIN ] NWG: Fetched primary data is valid. [2025-09-29T20:19:53.263009] [DEBUG] [LOCAL ] NWG: Saving primary data. [2025-09-29T20:19:53.264802] [DEBUG] [LOCAL ] NWG: Trimmed 73258 records to 51537 (keeping 200 days of data) [2025-09-29T20:19:53.605572] [DEBUG] [LOCAL ] NWG: Primary data saved (51537 records). [2025-09-29T20:19:53.605764] [INFO ] [MAIN ] NWG: Full history saved. [2025-09-29T20:19:53.605920] [INFO ] [MAIN ] Update Progress: 1557/2371 symbols completed. NWG took 31.4s. Estimated remaining: 1h 44m 29s. Rate: 7.8 symbols/min [2025-09-29T20:19:53.914004] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-29T20:19:53.948130] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-03. [2025-09-29T20:19:54.341626] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-29T20:19:54.748170] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-03. [2025-09-29T20:19:55.307358] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-29T20:19:55.548179] [INFO ] [REMOTE ] NXC: Fetching primary data for 2024-12. [2025-09-29T20:19:55.961688] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-29T20:19:56.269148] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-29T20:19:56.348114] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-01. [2025-09-29T20:19:56.868237] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-29T20:19:57.148119] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-04. [2025-09-29T20:19:57.948127] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-04. [2025-09-29T20:19:58.602421] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-29T20:19:58.748151] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-02. [2025-09-29T20:19:59.390721] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-29T20:19:59.437180] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-29T20:19:59.548092] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-05. [2025-09-29T20:20:00.348150] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-05. [2025-09-29T20:20:01.149205] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-03. [2025-09-29T20:20:01.151927] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-29T20:20:01.940327] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-29T20:20:01.949043] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-29T20:20:01.948115] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-06. [2025-09-29T20:20:02.748165] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-06. [2025-09-29T20:20:03.469142] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-29T20:20:03.548122] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-04. [2025-09-29T20:20:04.284355] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-29T20:20:04.348094] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-05. [2025-09-29T20:20:04.368527] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-29T20:20:05.067686] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-29T20:20:05.148156] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-07. [2025-09-29T20:20:05.948166] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-06. [2025-09-29T20:20:06.582922] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-29T20:20:06.583755] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-29T20:20:06.748115] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-07. [2025-09-29T20:20:07.515284] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-29T20:20:07.548149] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-08. [2025-09-29T20:20:08.150823] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-29T20:20:08.348112] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-09. [2025-09-29T20:20:09.086548] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-29T20:20:09.088353] [INFO ] [REMOTE ] NXC: Full fetch complete (6010 records). [2025-09-29T20:20:09.088438] [DEBUG] [VALIDATOR ] NXC: Validating primary data. [2025-09-29T20:20:09.154883] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-08. [2025-09-29T20:20:09.478100] [DEBUG] [VALIDATOR ] NXC: All expected trading days are present. [2025-09-29T20:20:09.478207] [DEBUG] [VALIDATOR ] NXC: Primary data validation passed. [2025-09-29T20:20:09.478424] [INFO ] [MAIN ] NXC: Fetched primary data is valid. [2025-09-29T20:20:09.478480] [DEBUG] [LOCAL ] NXC: Saving primary data. [2025-09-29T20:20:09.478922] [DEBUG] [LOCAL ] NXC: Trimmed 6010 records to 4221 (keeping 200 days of data) [2025-09-29T20:20:09.505709] [DEBUG] [LOCAL ] NXC: Primary data saved (4221 records). [2025-09-29T20:20:09.505828] [INFO ] [MAIN ] NXC: Full history saved. [2025-09-29T20:20:09.505911] [INFO ] [MAIN ] Update Progress: 1558/2371 symbols completed. NXC took 17.5s. Estimated remaining: 1h 44m 25s. Rate: 7.8 symbols/min [2025-09-29T20:20:09.948191] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-07. [2025-09-29T20:20:10.606805] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-29T20:20:10.748127] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-09. [2025-09-29T20:20:11.051533] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-29T20:20:11.548121] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-08. [2025-09-29T20:20:12.372807] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-29T20:20:12.382208] [INFO ] [REMOTE ] NX: Full fetch complete (48468 records). [2025-09-29T20:20:12.382386] [DEBUG] [VALIDATOR ] NX: Validating primary data. [2025-09-29T20:20:12.806078] [DEBUG] [VALIDATOR ] NX: All expected trading days are present. [2025-09-29T20:20:12.806307] [DEBUG] [VALIDATOR ] NX: Primary data validation passed. [2025-09-29T20:20:12.807242] [INFO ] [MAIN ] NX: Fetched primary data is valid. [2025-09-29T20:20:12.807397] [DEBUG] [LOCAL ] NX: Saving primary data. [2025-09-29T20:20:12.808725] [DEBUG] [LOCAL ] NX: Trimmed 48468 records to 33165 (keeping 200 days of data) [2025-09-29T20:20:12.914829] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-29T20:20:12.922597] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-09. [2025-09-29T20:20:13.049062] [DEBUG] [LOCAL ] NX: Primary data saved (33165 records). [2025-09-29T20:20:13.049230] [INFO ] [MAIN ] NX: Full history saved. [2025-09-29T20:20:13.049319] [INFO ] [MAIN ] Update Progress: 1559/2371 symbols completed. NX took 26.0s. Estimated remaining: 1h 44m 15s. Rate: 7.8 symbols/min [2025-09-29T20:20:14.113128] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-29T20:20:14.119104] [INFO ] [REMOTE ] NWN: Full fetch complete (37196 records). [2025-09-29T20:20:14.119250] [DEBUG] [VALIDATOR ] NWN: Validating primary data. [2025-09-29T20:20:14.519630] [DEBUG] [VALIDATOR ] NWN: All expected trading days are present. [2025-09-29T20:20:14.519790] [DEBUG] [VALIDATOR ] NWN: Primary data validation passed. [2025-09-29T20:20:14.520633] [INFO ] [MAIN ] NWN: Fetched primary data is valid. [2025-09-29T20:20:14.520732] [DEBUG] [LOCAL ] NWN: Saving primary data. [2025-09-29T20:20:14.521604] [DEBUG] [LOCAL ] NWN: Trimmed 37196 records to 26774 (keeping 200 days of data) [2025-09-29T20:20:14.696178] [DEBUG] [LOCAL ] NWN: Primary data saved (26774 records). [2025-09-29T20:20:14.696364] [INFO ] [MAIN ] NWN: Full history saved. [2025-09-29T20:20:14.696553] [INFO ] [MAIN ] Update Progress: 1560/2371 symbols completed. NWN took 30.8s. Estimated remaining: 1h 44m 5s. Rate: 7.8 symbols/min [2025-09-29T20:20:15.332611] [INFO ] [MAIN ] NXE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:20:15.418616] [INFO ] [MAIN ] NXDT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:20:15.385867] [INFO ] [MAIN ] NXG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:20:15.474331] [INFO ] [MAIN ] NXDR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:20:15.474665] [DEBUG] [LOCAL ] NXDR: No existing data file found in primary storage. [2025-09-29T20:20:15.474824] [WARN ] [MAIN ] NXDR: No existing data found, performing full refresh instead. [2025-09-29T20:20:15.474959] [INFO ] [MAIN ] NXDR: Wiping existing primary data before full refresh. [2025-09-29T20:20:15.475012] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-09-29T20:20:15.475080] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-09-29T20:20:15.475116] [INFO ] [MAIN ] NXDR: Starting full primary refresh. [2025-09-29T20:20:15.577801] [DEBUG] [LOCAL ] NXG: Loaded 10647 existing records from primary storage. [2025-09-29T20:20:15.607892] [INFO ] [MAIN ] NXG: Loaded 10647 existing records. [2025-09-29T20:20:15.609496] [DEBUG] [LOCAL ] NXDT: Loaded 16531 existing records from primary storage. [2025-09-29T20:20:15.648679] [INFO ] [MAIN ] NXDT: Loaded 16531 existing records. [2025-09-29T20:20:15.901082] [DEBUG] [LOCAL ] NXE: Loaded 53762 existing records from primary storage. [2025-09-29T20:20:15.945070] [INFO ] [MAIN ] NXE: Loaded 53762 existing records. [2025-09-29T20:20:16.250872] [WARN ] [MAIN ] NXG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:20:16.358198] [INFO ] [MAIN ] NXG: Wiping existing primary data before full refresh. [2025-09-29T20:20:16.460115] [INFO ] [LOCAL ] NXG: Starting deletion of primary data. [2025-09-29T20:20:16.439345] [WARN ] [MAIN ] NXDT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:20:16.487268] [INFO ] [REMOTE ] NXDR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:20:16.497950] [DEBUG] [LOCAL ] NXG: Deleted primary data file. [2025-09-29T20:20:16.503507] [INFO ] [MAIN ] NXDT: Wiping existing primary data before full refresh. [2025-09-29T20:20:16.508923] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2024-12. [2025-09-29T20:20:16.531377] [INFO ] [MAIN ] NXG: Starting full primary refresh. [2025-09-29T20:20:16.536890] [INFO ] [LOCAL ] NXDT: Starting deletion of primary data. [2025-09-29T20:20:16.565847] [DEBUG] [LOCAL ] NXDT: Deleted primary data file. [2025-09-29T20:20:16.616869] [INFO ] [MAIN ] NXDT: Starting full primary refresh. [2025-09-29T20:20:16.616715] [WARN ] [MAIN ] NXE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:20:16.668103] [INFO ] [MAIN ] NXE: Wiping existing primary data before full refresh. [2025-09-29T20:20:16.677090] [INFO ] [LOCAL ] NXE: Starting deletion of primary data. [2025-09-29T20:20:16.761041] [DEBUG] [LOCAL ] NXE: Deleted primary data file. [2025-09-29T20:20:16.761246] [INFO ] [MAIN ] NXE: Starting full primary refresh. [2025-09-29T20:20:16.931523] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T20:20:17.066843] [WARN ] [REMOTE ] NXDR: No data returned for month 2024-12 [2025-09-29T20:20:17.109728] [FATAL] [REMOTE ] NXDR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T20:20:17.189941] [FATAL] [MAIN ] NXDR: Failed to fetch primary data. [2025-09-29T20:20:17.254802] [WARN ] [MAIN ] NXDR: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T20:20:17.288335] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-09-29T20:20:17.309186] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-09-29T20:20:17.364706] [INFO ] [LOCAL ] NXDR: Starting deletion of derivative data. [2025-09-29T20:20:17.450488] [DEBUG] [LOCAL ] NXDR: No derivative data file found to delete. [2025-09-29T20:20:17.478973] [INFO ] [MAIN ] Update Progress: 1561/2371 symbols completed. NXDR took 2.8s. Estimated remaining: 1h 43m 54s. Rate: 7.8 symbols/min [2025-09-29T20:20:17.768260] [INFO ] [REMOTE ] NXG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:20:17.876883] [INFO ] [REMOTE ] NXG: Fetching primary data for 2024-12. [2025-09-29T20:20:18.001168] [INFO ] [REMOTE ] NXDT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:20:18.036059] [INFO ] [MAIN ] NXJ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:20:18.071679] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2024-12. [2025-09-29T20:20:18.075493] [INFO ] [REMOTE ] NXE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:20:18.075902] [INFO ] [REMOTE ] NXE: Fetching primary data for 2024-12. [2025-09-29T20:20:18.100374] [DEBUG] [LOCAL ] NXJ: Loaded 15066 existing records from primary storage. [2025-09-29T20:20:18.100665] [INFO ] [MAIN ] NXJ: Loaded 15066 existing records. [2025-09-29T20:20:18.284181] [WARN ] [MAIN ] NXJ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:20:18.284415] [INFO ] [MAIN ] NXJ: Wiping existing primary data before full refresh. [2025-09-29T20:20:18.284463] [INFO ] [LOCAL ] NXJ: Starting deletion of primary data. [2025-09-29T20:20:18.284721] [DEBUG] [LOCAL ] NXJ: Deleted primary data file. [2025-09-29T20:20:18.284781] [INFO ] [MAIN ] NXJ: Starting full primary refresh. [2025-09-29T20:20:18.664255] [INFO ] [REMOTE ] NXJ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:20:18.664624] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2024-12. [2025-09-29T20:20:18.850975] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-29T20:20:18.853776] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-01. [2025-09-29T20:20:19.300341] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-29T20:20:19.305799] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-01. [2025-09-29T20:20:19.436700] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-29T20:20:19.443566] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-29T20:20:19.448405] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-01. [2025-09-29T20:20:19.548126] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-02. [2025-09-29T20:20:19.969419] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-29T20:20:20.348105] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-01. [2025-09-29T20:20:20.419486] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-29T20:20:20.421763] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-29T20:20:20.438454] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-29T20:20:21.148329] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-02. [2025-09-29T20:20:21.948122] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-02. [2025-09-29T20:20:22.062814] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-29T20:20:22.137325] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-29T20:20:22.748102] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-03. [2025-09-29T20:20:22.841367] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-29T20:20:23.548094] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-03. [2025-09-29T20:20:23.672948] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-29T20:20:24.348161] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-04. [2025-09-29T20:20:24.384914] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-29T20:20:25.148120] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-03. [2025-09-29T20:20:25.223344] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-29T20:20:25.948088] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-05. [2025-09-29T20:20:26.350261] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-29T20:20:26.727175] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-29T20:20:26.748089] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-06. [2025-09-29T20:20:27.548092] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-04. [2025-09-29T20:20:27.659100] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-29T20:20:28.348184] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-02. [2025-09-29T20:20:28.697893] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-29T20:20:29.148205] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-04. [2025-09-29T20:20:29.948128] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-07. [2025-09-29T20:20:30.144684] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-29T20:20:30.199795] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-29T20:20:30.621242] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-29T20:20:30.748171] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-05. [2025-09-29T20:20:31.548121] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-08. [2025-09-29T20:20:31.781852] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-29T20:20:32.348126] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-06. [2025-09-29T20:20:32.473583] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-29T20:20:33.148100] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-09. [2025-09-29T20:20:33.356526] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-29T20:20:33.948112] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-07. [2025-09-29T20:20:34.189933] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-29T20:20:34.192850] [INFO ] [REMOTE ] NXG: Full fetch complete (14417 records). [2025-09-29T20:20:34.192931] [DEBUG] [VALIDATOR ] NXG: Validating primary data. [2025-09-29T20:20:34.611112] [DEBUG] [VALIDATOR ] NXG: All expected trading days are present. [2025-09-29T20:20:34.611211] [DEBUG] [VALIDATOR ] NXG: Primary data validation passed. [2025-09-29T20:20:34.611688] [INFO ] [MAIN ] NXG: Fetched primary data is valid. [2025-09-29T20:20:34.611760] [DEBUG] [LOCAL ] NXG: Saving primary data. [2025-09-29T20:20:34.612554] [DEBUG] [LOCAL ] NXG: Trimmed 14417 records to 10411 (keeping 200 days of data) [2025-09-29T20:20:34.680748] [DEBUG] [LOCAL ] NXG: Primary data saved (10411 records). [2025-09-29T20:20:34.680897] [INFO ] [MAIN ] NXG: Full history saved. [2025-09-29T20:20:34.680988] [INFO ] [MAIN ] Update Progress: 1562/2371 symbols completed. NXG took 19.9s. Estimated remaining: 1h 43m 52s. Rate: 7.8 symbols/min [2025-09-29T20:20:34.753365] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-03. [2025-09-29T20:20:34.875205] [INFO ] [MAIN ] NXN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:20:34.880546] [DEBUG] [LOCAL ] NXN: Loaded 2376 existing records from primary storage. [2025-09-29T20:20:34.880759] [INFO ] [MAIN ] NXN: Loaded 2376 existing records. [2025-09-29T20:20:35.067233] [WARN ] [MAIN ] NXN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:20:35.067513] [INFO ] [MAIN ] NXN: Wiping existing primary data before full refresh. [2025-09-29T20:20:35.067565] [INFO ] [LOCAL ] NXN: Starting deletion of primary data. [2025-09-29T20:20:35.067770] [DEBUG] [LOCAL ] NXN: Deleted primary data file. [2025-09-29T20:20:35.067831] [INFO ] [MAIN ] NXN: Starting full primary refresh. [2025-09-29T20:20:35.324172] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-29T20:20:35.502035] [INFO ] [REMOTE ] NXN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:20:35.548102] [INFO ] [REMOTE ] NXN: Fetching primary data for 2024-12. [2025-09-29T20:20:36.219052] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-29T20:20:36.348097] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-01. [2025-09-29T20:20:36.651115] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-29T20:20:36.864040] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-29T20:20:37.148118] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-08. [2025-09-29T20:20:37.948097] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-02. [2025-09-29T20:20:38.241051] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-29T20:20:38.550151] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-29T20:20:38.748095] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-04. [2025-09-29T20:20:39.548137] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-03. [2025-09-29T20:20:40.109507] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-29T20:20:40.348124] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-05. [2025-09-29T20:20:40.744402] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-29T20:20:41.148153] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-09. [2025-09-29T20:20:41.389623] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-29T20:20:41.876930] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-29T20:20:41.880435] [INFO ] [REMOTE ] NXJ: Full fetch complete (20993 records). [2025-09-29T20:20:41.880578] [DEBUG] [VALIDATOR ] NXJ: Validating primary data. [2025-09-29T20:20:41.953339] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-05. [2025-09-29T20:20:42.280740] [DEBUG] [VALIDATOR ] NXJ: All expected trading days are present. [2025-09-29T20:20:42.280830] [DEBUG] [VALIDATOR ] NXJ: Primary data validation passed. [2025-09-29T20:20:42.281340] [INFO ] [MAIN ] NXJ: Fetched primary data is valid. [2025-09-29T20:20:42.281391] [DEBUG] [LOCAL ] NXJ: Saving primary data. [2025-09-29T20:20:42.282104] [DEBUG] [LOCAL ] NXJ: Trimmed 20993 records to 14931 (keeping 200 days of data) [2025-09-29T20:20:42.380530] [DEBUG] [LOCAL ] NXJ: Primary data saved (14931 records). [2025-09-29T20:20:42.380707] [INFO ] [MAIN ] NXJ: Full history saved. [2025-09-29T20:20:42.380817] [INFO ] [MAIN ] Update Progress: 1563/2371 symbols completed. NXJ took 24.9s. Estimated remaining: 1h 43m 44s. Rate: 7.8 symbols/min [2025-09-29T20:20:42.561381] [INFO ] [MAIN ] NXP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:20:42.576163] [DEBUG] [LOCAL ] NXP: Loaded 12465 existing records from primary storage. [2025-09-29T20:20:42.576404] [INFO ] [MAIN ] NXP: Loaded 12465 existing records. [2025-09-29T20:20:42.767089] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-06. [2025-09-29T20:20:42.774277] [WARN ] [MAIN ] NXP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:20:42.774589] [INFO ] [MAIN ] NXP: Wiping existing primary data before full refresh. [2025-09-29T20:20:42.774675] [INFO ] [LOCAL ] NXP: Starting deletion of primary data. [2025-09-29T20:20:42.774951] [DEBUG] [LOCAL ] NXP: Deleted primary data file. [2025-09-29T20:20:42.775011] [INFO ] [MAIN ] NXP: Starting full primary refresh. [2025-09-29T20:20:43.160685] [INFO ] [REMOTE ] NXP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:20:43.548087] [INFO ] [REMOTE ] NXP: Fetching primary data for 2024-12. [2025-09-29T20:20:43.752489] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-29T20:20:44.001092] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-29T20:20:44.231507] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-29T20:20:44.348150] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-07. [2025-09-29T20:20:45.148102] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-04. [2025-09-29T20:20:45.449431] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-29T20:20:45.584560] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-29T20:20:45.948116] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-08. [2025-09-29T20:20:46.748165] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-05. [2025-09-29T20:20:47.006173] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-29T20:20:47.402155] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-29T20:20:47.548093] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-01. [2025-09-29T20:20:48.348136] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-06. [2025-09-29T20:20:48.410050] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-29T20:20:49.148167] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-02. [2025-09-29T20:20:49.948100] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-06. [2025-09-29T20:20:50.057789] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-29T20:20:50.313511] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-29T20:20:50.748154] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-07. [2025-09-29T20:20:50.768290] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-29T20:20:51.548145] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-07. [2025-09-29T20:20:52.107376] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-29T20:20:52.348169] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-09. [2025-09-29T20:20:52.708006] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-29T20:20:53.148128] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-08. [2025-09-29T20:20:53.238073] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-29T20:20:53.241545] [INFO ] [REMOTE ] NXDT: Full fetch complete (25542 records). [2025-09-29T20:20:53.241684] [DEBUG] [VALIDATOR ] NXDT: Validating primary data. [2025-09-29T20:20:53.683865] [DEBUG] [VALIDATOR ] NXDT: All expected trading days are present. [2025-09-29T20:20:53.684128] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-29T20:20:53.684214] [DEBUG] [VALIDATOR ] NXDT: Primary data validation passed. [2025-09-29T20:20:53.685265] [INFO ] [MAIN ] NXDT: Fetched primary data is valid. [2025-09-29T20:20:53.685387] [DEBUG] [LOCAL ] NXDT: Saving primary data. [2025-09-29T20:20:53.689123] [DEBUG] [LOCAL ] NXDT: Trimmed 25542 records to 16219 (keeping 200 days of data) [2025-09-29T20:20:53.800293] [DEBUG] [LOCAL ] NXDT: Primary data saved (16219 records). [2025-09-29T20:20:53.800459] [INFO ] [MAIN ] NXDT: Full history saved. [2025-09-29T20:20:53.800564] [INFO ] [MAIN ] Update Progress: 1564/2371 symbols completed. NXDT took 39.1s. Estimated remaining: 1h 43m 38s. Rate: 7.8 symbols/min [2025-09-29T20:20:53.960077] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-08. [2025-09-29T20:20:53.997385] [INFO ] [MAIN ] NXRT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:20:54.022749] [DEBUG] [LOCAL ] NXRT: Loaded 19307 existing records from primary storage. [2025-09-29T20:20:54.023040] [INFO ] [MAIN ] NXRT: Loaded 19307 existing records. [2025-09-29T20:20:54.219964] [WARN ] [MAIN ] NXRT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:20:54.220201] [INFO ] [MAIN ] NXRT: Wiping existing primary data before full refresh. [2025-09-29T20:20:54.220259] [INFO ] [LOCAL ] NXRT: Starting deletion of primary data. [2025-09-29T20:20:54.220517] [DEBUG] [LOCAL ] NXRT: Deleted primary data file. [2025-09-29T20:20:54.220580] [INFO ] [MAIN ] NXRT: Starting full primary refresh. [2025-09-29T20:20:54.639717] [INFO ] [REMOTE ] NXRT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:20:54.748160] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2024-12. [2025-09-29T20:20:55.548161] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-03. [2025-09-29T20:20:55.792864] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-29T20:20:55.974360] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-29T20:20:56.348147] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-01. [2025-09-29T20:20:56.528747] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-29T20:20:57.148130] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-09. [2025-09-29T20:20:57.324047] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-29T20:20:57.532815] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-29T20:20:57.533901] [INFO ] [REMOTE ] NXN: Full fetch complete (3670 records). [2025-09-29T20:20:57.533985] [DEBUG] [VALIDATOR ] NXN: Validating primary data. [2025-09-29T20:20:57.919254] [DEBUG] [VALIDATOR ] NXN: All expected trading days are present. [2025-09-29T20:20:57.919337] [DEBUG] [VALIDATOR ] NXN: Primary data validation passed. [2025-09-29T20:20:57.919473] [INFO ] [MAIN ] NXN: Fetched primary data is valid. [2025-09-29T20:20:57.919516] [DEBUG] [LOCAL ] NXN: Saving primary data. [2025-09-29T20:20:57.920028] [DEBUG] [LOCAL ] NXN: Trimmed 3670 records to 2325 (keeping 200 days of data) [2025-09-29T20:20:57.934593] [DEBUG] [LOCAL ] NXN: Primary data saved (2325 records). [2025-09-29T20:20:57.934740] [INFO ] [MAIN ] NXN: Full history saved. [2025-09-29T20:20:57.934835] [INFO ] [MAIN ] Update Progress: 1565/2371 symbols completed. NXN took 23.3s. Estimated remaining: 1h 43m 29s. Rate: 7.8 symbols/min [2025-09-29T20:20:57.953239] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-02. [2025-09-29T20:20:58.122840] [INFO ] [MAIN ] NYC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:20:58.123048] [DEBUG] [LOCAL ] NYC: No existing data file found in primary storage. [2025-09-29T20:20:58.123089] [WARN ] [MAIN ] NYC: No existing data found, performing full refresh instead. [2025-09-29T20:20:58.123208] [INFO ] [MAIN ] NYC: Wiping existing primary data before full refresh. [2025-09-29T20:20:58.123254] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-09-29T20:20:58.123343] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-09-29T20:20:58.123414] [INFO ] [MAIN ] NYC: Starting full primary refresh. [2025-09-29T20:20:58.511523] [INFO ] [REMOTE ] NYC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:20:58.748141] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-04. [2025-09-29T20:20:59.257024] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-29T20:20:59.548154] [INFO ] [REMOTE ] NYC: Fetching primary data for 2024-12. [2025-09-29T20:20:59.746014] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-29T20:20:59.981904] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-29T20:21:00.348129] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-05. [2025-09-29T20:21:01.005060] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-29T20:21:01.148173] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-06. [2025-09-29T20:21:01.948126] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-09. [2025-09-29T20:21:02.175270] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-29T20:21:02.748165] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-01. [2025-09-29T20:21:03.190208] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-29T20:21:03.548133] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-07. [2025-09-29T20:21:03.849773] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-29T20:21:03.863562] [INFO ] [REMOTE ] NXE: Full fetch complete (76672 records). [2025-09-29T20:21:03.863825] [DEBUG] [VALIDATOR ] NXE: Validating primary data. [2025-09-29T20:21:04.297019] [DEBUG] [VALIDATOR ] NXE: All expected trading days are present. [2025-09-29T20:21:04.297220] [DEBUG] [VALIDATOR ] NXE: Primary data validation passed. [2025-09-29T20:21:04.298637] [INFO ] [MAIN ] NXE: Fetched primary data is valid. [2025-09-29T20:21:04.298734] [DEBUG] [LOCAL ] NXE: Saving primary data. [2025-09-29T20:21:04.300324] [DEBUG] [LOCAL ] NXE: Trimmed 76672 records to 52987 (keeping 200 days of data) [2025-09-29T20:21:04.351818] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-03. [2025-09-29T20:21:04.619109] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-29T20:21:04.648895] [DEBUG] [LOCAL ] NXE: Primary data saved (52987 records). [2025-09-29T20:21:04.649062] [INFO ] [MAIN ] NXE: Full history saved. [2025-09-29T20:21:04.652435] [INFO ] [MAIN ] Update Progress: 1566/2371 symbols completed. NXE took 49.9s. Estimated remaining: 1h 43m 20s. Rate: 7.8 symbols/min [2025-09-29T20:21:04.836664] [INFO ] [MAIN ] NYT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:21:04.900695] [DEBUG] [LOCAL ] NYT: Loaded 50645 existing records from primary storage. [2025-09-29T20:21:04.901076] [INFO ] [MAIN ] NYT: Loaded 50645 existing records. [2025-09-29T20:21:05.085137] [WARN ] [MAIN ] NYT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:21:05.085444] [INFO ] [MAIN ] NYT: Wiping existing primary data before full refresh. [2025-09-29T20:21:05.085493] [INFO ] [LOCAL ] NYT: Starting deletion of primary data. [2025-09-29T20:21:05.085869] [DEBUG] [LOCAL ] NYT: Deleted primary data file. [2025-09-29T20:21:05.085930] [INFO ] [MAIN ] NYT: Starting full primary refresh. [2025-09-29T20:21:05.152894] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-02. [2025-09-29T20:21:05.415434] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-29T20:21:05.488684] [INFO ] [REMOTE ] NYT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:21:05.495448] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-29T20:21:05.948126] [INFO ] [REMOTE ] NYT: Fetching primary data for 2024-12. [2025-09-29T20:21:06.748133] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-08. [2025-09-29T20:21:07.484580] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-29T20:21:07.548167] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-03. [2025-09-29T20:21:07.697850] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-29T20:21:07.857979] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-29T20:21:08.348176] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-09. [2025-09-29T20:21:09.148086] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-04. [2025-09-29T20:21:09.367767] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-29T20:21:09.371279] [INFO ] [REMOTE ] NXP: Full fetch complete (16737 records). [2025-09-29T20:21:09.371372] [DEBUG] [VALIDATOR ] NXP: Validating primary data. [2025-09-29T20:21:09.772055] [DEBUG] [VALIDATOR ] NXP: All expected trading days are present. [2025-09-29T20:21:09.772151] [DEBUG] [VALIDATOR ] NXP: Primary data validation passed. [2025-09-29T20:21:09.772581] [INFO ] [MAIN ] NXP: Fetched primary data is valid. [2025-09-29T20:21:09.772694] [DEBUG] [LOCAL ] NXP: Saving primary data. [2025-09-29T20:21:09.773529] [DEBUG] [LOCAL ] NXP: Trimmed 16737 records to 12362 (keeping 200 days of data) [2025-09-29T20:21:09.861703] [DEBUG] [LOCAL ] NXP: Primary data saved (12362 records). [2025-09-29T20:21:09.861855] [INFO ] [MAIN ] NXP: Full history saved. [2025-09-29T20:21:09.861971] [INFO ] [MAIN ] Update Progress: 1567/2371 symbols completed. NXP took 27.5s. Estimated remaining: 1h 43m 11s. Rate: 7.8 symbols/min [2025-09-29T20:21:09.950294] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-04. [2025-09-29T20:21:10.058387] [INFO ] [MAIN ] NZF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:21:10.098714] [DEBUG] [LOCAL ] NZF: Loaded 29361 existing records from primary storage. [2025-09-29T20:21:10.099018] [INFO ] [MAIN ] NZF: Loaded 29361 existing records. [2025-09-29T20:21:10.303783] [WARN ] [MAIN ] NZF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:21:10.304251] [INFO ] [MAIN ] NZF: Wiping existing primary data before full refresh. [2025-09-29T20:21:10.304361] [INFO ] [LOCAL ] NZF: Starting deletion of primary data. [2025-09-29T20:21:10.310041] [DEBUG] [LOCAL ] NZF: Deleted primary data file. [2025-09-29T20:21:10.318780] [INFO ] [MAIN ] NZF: Starting full primary refresh. [2025-09-29T20:21:10.319318] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-29T20:21:10.458114] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-29T20:21:10.753231] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-05. [2025-09-29T20:21:10.786701] [INFO ] [REMOTE ] NZF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:21:11.548084] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-01. [2025-09-29T20:21:11.861006] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-29T20:21:12.348163] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-06. [2025-09-29T20:21:13.148164] [INFO ] [REMOTE ] NZF: Fetching primary data for 2024-12. [2025-09-29T20:21:13.287605] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-29T20:21:13.320518] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-29T20:21:13.948200] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-05. [2025-09-29T20:21:14.332067] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-29T20:21:14.748120] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-07. [2025-09-29T20:21:14.793111] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-29T20:21:15.548131] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-01. [2025-09-29T20:21:15.973699] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-29T20:21:16.348115] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-08. [2025-09-29T20:21:17.007399] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-29T20:21:17.148117] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-02. [2025-09-29T20:21:17.533092] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-29T20:21:17.948111] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-06. [2025-09-29T20:21:18.188953] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-29T20:21:18.596850] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-29T20:21:18.748114] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-03. [2025-09-29T20:21:19.548117] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-07. [2025-09-29T20:21:20.028738] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-29T20:21:20.246790] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-29T20:21:20.348370] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-08. [2025-09-29T20:21:20.564889] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-09-29T20:21:21.148147] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-02. [2025-09-29T20:21:21.948126] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-09. [2025-09-29T20:21:22.557665] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-29T20:21:22.558782] [INFO ] [REMOTE ] NYC: Full fetch complete (1914 records). [2025-09-29T20:21:22.558858] [DEBUG] [VALIDATOR ] NYC: Validating primary data. [2025-09-29T20:21:22.559338] [FATAL] [VALIDATOR ] NYC: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T20:21:22.559435] [FATAL] [MAIN ] NYC: Fetched primary data is invalid. Refusing to save it. [2025-09-29T20:21:22.559480] [WARN ] [MAIN ] NYC: Deleting existing primary and derivative data due to validation failure. [2025-09-29T20:21:22.559521] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-09-29T20:21:22.559600] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-09-29T20:21:22.559685] [INFO ] [LOCAL ] NYC: Starting deletion of derivative data. [2025-09-29T20:21:22.559755] [DEBUG] [LOCAL ] NYC: No derivative data file found to delete. [2025-09-29T20:21:22.559815] [INFO ] [MAIN ] Update Progress: 1568/2371 symbols completed. NYC took 24.6s. Estimated remaining: 1h 43m 6s. Rate: 7.8 symbols/min [2025-09-29T20:21:22.758130] [INFO ] [MAIN ] O: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:21:22.753145] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-09. [2025-09-29T20:21:22.758509] [DEBUG] [LOCAL ] O: No existing data file found in primary storage. [2025-09-29T20:21:22.758682] [WARN ] [MAIN ] O: No existing data found, performing full refresh instead. [2025-09-29T20:21:22.759604] [INFO ] [MAIN ] O: Wiping existing primary data before full refresh. [2025-09-29T20:21:22.759685] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-09-29T20:21:22.759929] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-09-29T20:21:22.760052] [INFO ] [MAIN ] O: Starting full primary refresh. [2025-09-29T20:21:23.199848] [INFO ] [REMOTE ] O: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:21:23.195408] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-29T20:21:23.548185] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-03. [2025-09-29T20:21:23.888967] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-29T20:21:23.894090] [INFO ] [REMOTE ] NXRT: Full fetch complete (25308 records). [2025-09-29T20:21:23.894294] [DEBUG] [VALIDATOR ] NXRT: Validating primary data. [2025-09-29T20:21:24.315187] [DEBUG] [VALIDATOR ] NXRT: All expected trading days are present. [2025-09-29T20:21:24.315303] [DEBUG] [VALIDATOR ] NXRT: Primary data validation passed. [2025-09-29T20:21:24.315942] [INFO ] [MAIN ] NXRT: Fetched primary data is valid. [2025-09-29T20:21:24.316025] [DEBUG] [LOCAL ] NXRT: Saving primary data. [2025-09-29T20:21:24.316901] [DEBUG] [LOCAL ] NXRT: Trimmed 25308 records to 19043 (keeping 200 days of data) [2025-09-29T20:21:24.369691] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-04. [2025-09-29T20:21:24.455359] [DEBUG] [LOCAL ] NXRT: Primary data saved (19043 records). [2025-09-29T20:21:24.455522] [INFO ] [MAIN ] NXRT: Full history saved. [2025-09-29T20:21:24.455629] [INFO ] [MAIN ] Update Progress: 1569/2371 symbols completed. NXRT took 30.7s. Estimated remaining: 1h 42m 56s. Rate: 7.8 symbols/min [2025-09-29T20:21:24.643619] [INFO ] [MAIN ] OBDC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:21:24.708164] [DEBUG] [LOCAL ] OBDC: Loaded 52426 existing records from primary storage. [2025-09-29T20:21:24.708712] [INFO ] [MAIN ] OBDC: Loaded 52426 existing records. [2025-09-29T20:21:24.971771] [WARN ] [MAIN ] OBDC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:21:24.972060] [INFO ] [MAIN ] OBDC: Wiping existing primary data before full refresh. [2025-09-29T20:21:24.972148] [INFO ] [LOCAL ] OBDC: Starting deletion of primary data. [2025-09-29T20:21:24.972709] [DEBUG] [LOCAL ] OBDC: Deleted primary data file. [2025-09-29T20:21:24.972774] [INFO ] [MAIN ] OBDC: Starting full primary refresh. [2025-09-29T20:21:25.153304] [INFO ] [REMOTE ] O: Fetching primary data for 2024-12. [2025-09-29T20:21:25.392378] [INFO ] [REMOTE ] OBDC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:21:25.426329] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-29T20:21:25.928690] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-29T20:21:25.948081] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-05. [2025-09-29T20:21:26.070281] [INFO ] [REMOTE ] O: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-29T20:21:26.748113] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2024-12. [2025-09-29T20:21:26.978919] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-29T20:21:27.548140] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-04. [2025-09-29T20:21:28.348113] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-06. [2025-09-29T20:21:28.632238] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-29T20:21:29.148174] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-01. [2025-09-29T20:21:29.494416] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-29T20:21:29.728745] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-29T20:21:29.948115] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-05. [2025-09-29T20:21:30.748170] [INFO ] [REMOTE ] O: Fetching primary data for 2025-01. [2025-09-29T20:21:31.548137] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-07. [2025-09-29T20:21:31.615551] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-01 (2.47 seconds). [2025-09-29T20:21:31.828181] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-29T20:21:31.922306] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-29T20:21:32.348159] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-06. [2025-09-29T20:21:32.918576] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-29T20:21:33.148163] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-02. [2025-09-29T20:21:33.948145] [INFO ] [REMOTE ] O: Fetching primary data for 2025-02. [2025-09-29T20:21:34.156229] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-29T20:21:34.752302] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-07. [2025-09-29T20:21:34.759436] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-29T20:21:34.845473] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-29T20:21:35.548129] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-03. [2025-09-29T20:21:36.348178] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-08. [2025-09-29T20:21:36.634151] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-29T20:21:37.148086] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-08. [2025-09-29T20:21:37.447220] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-29T20:21:37.485444] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-29T20:21:37.948122] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-09. [2025-09-29T20:21:38.748156] [INFO ] [REMOTE ] O: Fetching primary data for 2025-03. [2025-09-29T20:21:39.065722] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-29T20:21:39.368299] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-29T20:21:39.375635] [INFO ] [REMOTE ] NZF: Full fetch complete (43522 records). [2025-09-29T20:21:39.375852] [DEBUG] [VALIDATOR ] NZF: Validating primary data. [2025-09-29T20:21:39.552073] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-04. [2025-09-29T20:21:39.810451] [DEBUG] [VALIDATOR ] NZF: All expected trading days are present. [2025-09-29T20:21:39.810572] [DEBUG] [VALIDATOR ] NZF: Primary data validation passed. [2025-09-29T20:21:39.811724] [INFO ] [MAIN ] NZF: Fetched primary data is valid. [2025-09-29T20:21:39.811847] [DEBUG] [LOCAL ] NZF: Saving primary data. [2025-09-29T20:21:39.813329] [DEBUG] [LOCAL ] NZF: Trimmed 43522 records to 28963 (keeping 200 days of data) [2025-09-29T20:21:39.939416] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-29T20:21:40.051534] [DEBUG] [LOCAL ] NZF: Primary data saved (28963 records). [2025-09-29T20:21:40.051731] [INFO ] [MAIN ] NZF: Full history saved. [2025-09-29T20:21:40.051869] [INFO ] [MAIN ] Update Progress: 1570/2371 symbols completed. NZF took 30.2s. Estimated remaining: 1h 42m 52s. Rate: 7.8 symbols/min [2025-09-29T20:21:40.231996] [INFO ] [MAIN ] OBK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:21:40.249985] [DEBUG] [LOCAL ] OBK: Loaded 16512 existing records from primary storage. [2025-09-29T20:21:40.250230] [INFO ] [MAIN ] OBK: Loaded 16512 existing records. [2025-09-29T20:21:40.353936] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-09. [2025-09-29T20:21:40.438913] [WARN ] [MAIN ] OBK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:21:40.439153] [INFO ] [MAIN ] OBK: Wiping existing primary data before full refresh. [2025-09-29T20:21:40.439204] [INFO ] [LOCAL ] OBK: Starting deletion of primary data. [2025-09-29T20:21:40.439497] [DEBUG] [LOCAL ] OBK: Deleted primary data file. [2025-09-29T20:21:40.439558] [INFO ] [MAIN ] OBK: Starting full primary refresh. [2025-09-29T20:21:40.821878] [INFO ] [REMOTE ] OBK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:21:41.148103] [INFO ] [REMOTE ] OBK: Fetching primary data for 2024-12. [2025-09-29T20:21:41.659020] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-29T20:21:41.948186] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-05. [2025-09-29T20:21:42.164290] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-29T20:21:42.174559] [INFO ] [REMOTE ] NYT: Full fetch complete (72077 records). [2025-09-29T20:21:42.174745] [DEBUG] [VALIDATOR ] NYT: Validating primary data. [2025-09-29T20:21:42.388635] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-29T20:21:42.621327] [DEBUG] [VALIDATOR ] NYT: All expected trading days are present. [2025-09-29T20:21:42.621424] [DEBUG] [VALIDATOR ] NYT: Primary data validation passed. [2025-09-29T20:21:42.622682] [INFO ] [MAIN ] NYT: Fetched primary data is valid. [2025-09-29T20:21:42.622767] [DEBUG] [LOCAL ] NYT: Saving primary data. [2025-09-29T20:21:42.624334] [DEBUG] [LOCAL ] NYT: Trimmed 72077 records to 49852 (keeping 200 days of data) [2025-09-29T20:21:42.748400] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-01. [2025-09-29T20:21:42.963468] [DEBUG] [LOCAL ] NYT: Primary data saved (49852 records). [2025-09-29T20:21:42.963631] [INFO ] [MAIN ] NYT: Full history saved. [2025-09-29T20:21:42.963790] [INFO ] [MAIN ] Update Progress: 1571/2371 symbols completed. NYT took 38.3s. Estimated remaining: 1h 42m 42s. Rate: 7.8 symbols/min [2025-09-29T20:21:43.139801] [INFO ] [MAIN ] OC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:21:43.190369] [DEBUG] [LOCAL ] OC: Loaded 45369 existing records from primary storage. [2025-09-29T20:21:43.190719] [INFO ] [MAIN ] OC: Loaded 45369 existing records. [2025-09-29T20:21:43.382755] [WARN ] [MAIN ] OC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:21:43.382973] [INFO ] [MAIN ] OC: Wiping existing primary data before full refresh. [2025-09-29T20:21:43.383022] [INFO ] [LOCAL ] OC: Starting deletion of primary data. [2025-09-29T20:21:43.383536] [DEBUG] [LOCAL ] OC: Deleted primary data file. [2025-09-29T20:21:43.383636] [INFO ] [MAIN ] OC: Starting full primary refresh. [2025-09-29T20:21:43.553990] [INFO ] [REMOTE ] O: Fetching primary data for 2025-04. [2025-09-29T20:21:43.694900] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-29T20:21:43.816450] [INFO ] [REMOTE ] OC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:21:43.847468] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-29T20:21:44.348074] [INFO ] [REMOTE ] OC: Fetching primary data for 2024-12. [2025-09-29T20:21:44.613629] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-29T20:21:45.148161] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-06. [2025-09-29T20:21:45.948536] [INFO ] [REMOTE ] O: Fetching primary data for 2025-05. [2025-09-29T20:21:45.951542] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-29T20:21:46.748093] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-02. [2025-09-29T20:21:46.834394] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-29T20:21:46.963678] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-29T20:21:47.477471] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-29T20:21:47.548158] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-03. [2025-09-29T20:21:48.348141] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-07. [2025-09-29T20:21:48.687638] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-29T20:21:49.148122] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-04. [2025-09-29T20:21:49.958103] [INFO ] [REMOTE ] O: Fetching primary data for 2025-06. [2025-09-29T20:21:49.965623] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-29T20:21:49.995894] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-29T20:21:50.748123] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-05. [2025-09-29T20:21:50.934010] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-29T20:21:51.548158] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-08. [2025-09-29T20:21:51.823101] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-29T20:21:52.348118] [INFO ] [REMOTE ] O: Fetching primary data for 2025-07. [2025-09-29T20:21:53.148087] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-01. [2025-09-29T20:21:53.301441] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-29T20:21:53.499187] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-29T20:21:53.948152] [INFO ] [REMOTE ] O: Fetching primary data for 2025-08. [2025-09-29T20:21:54.618814] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-29T20:21:54.748090] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-02. [2025-09-29T20:21:54.816855] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-29T20:21:55.548113] [INFO ] [REMOTE ] O: Fetching primary data for 2025-09. [2025-09-29T20:21:56.348085] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-06. [2025-09-29T20:21:56.476529] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-29T20:21:56.487747] [INFO ] [REMOTE ] O: Full fetch complete (77170 records). [2025-09-29T20:21:56.487948] [DEBUG] [VALIDATOR ] O: Validating primary data. [2025-09-29T20:21:56.488893] [FATAL] [VALIDATOR ] O: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T20:21:56.489002] [FATAL] [MAIN ] O: Fetched primary data is invalid. Refusing to save it. [2025-09-29T20:21:56.489077] [WARN ] [MAIN ] O: Deleting existing primary and derivative data due to validation failure. [2025-09-29T20:21:56.489159] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-09-29T20:21:56.489239] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-09-29T20:21:56.489283] [INFO ] [LOCAL ] O: Starting deletion of derivative data. [2025-09-29T20:21:56.489344] [DEBUG] [LOCAL ] O: No derivative data file found to delete. [2025-09-29T20:21:56.489434] [INFO ] [MAIN ] Update Progress: 1572/2371 symbols completed. O took 33.9s. Estimated remaining: 1h 42m 37s. Rate: 7.8 symbols/min [2025-09-29T20:21:56.712451] [INFO ] [MAIN ] OCFT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:21:56.715492] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-29T20:21:56.737083] [DEBUG] [LOCAL ] OCFT: Loaded 8916 existing records from primary storage. [2025-09-29T20:21:56.737333] [INFO ] [MAIN ] OCFT: Loaded 8916 existing records. [2025-09-29T20:21:56.938790] [WARN ] [MAIN ] OCFT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:21:56.939181] [INFO ] [MAIN ] OCFT: Wiping existing primary data before full refresh. [2025-09-29T20:21:56.939273] [INFO ] [LOCAL ] OCFT: Starting deletion of primary data. [2025-09-29T20:21:56.939605] [DEBUG] [LOCAL ] OCFT: Deleted primary data file. [2025-09-29T20:21:56.939699] [INFO ] [MAIN ] OCFT: Starting full primary refresh. [2025-09-29T20:21:57.153250] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-03. [2025-09-29T20:21:57.347273] [INFO ] [REMOTE ] OCFT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:21:57.472129] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-29T20:21:57.948166] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2024-12. [2025-09-29T20:21:58.573064] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-29T20:21:58.748115] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-01. [2025-09-29T20:21:59.005377] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-29T20:21:59.432582] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-29T20:21:59.548160] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-04. [2025-09-29T20:21:59.655227] [DEBUG] [REMOTE ] OC: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-09-29T20:21:59.655718] [WARN ] [REMOTE ] OC: No data returned for month 2025-04 [2025-09-29T20:21:59.655861] [FATAL] [REMOTE ] OC: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T20:21:59.656056] [FATAL] [MAIN ] OC: Failed to fetch primary data. [2025-09-29T20:21:59.656141] [WARN ] [MAIN ] OC: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T20:21:59.656235] [INFO ] [LOCAL ] OC: Starting deletion of primary data. [2025-09-29T20:21:59.656316] [DEBUG] [LOCAL ] OC: No primary data file found to delete. [2025-09-29T20:21:59.656363] [INFO ] [LOCAL ] OC: Starting deletion of derivative data. [2025-09-29T20:21:59.657190] [DEBUG] [LOCAL ] OC: Deleted derivative data file. [2025-09-29T20:21:59.657306] [INFO ] [MAIN ] Update Progress: 1573/2371 symbols completed. OC took 16.7s. Estimated remaining: 1h 42m 27s. Rate: 7.8 symbols/min [2025-09-29T20:21:59.861602] [INFO ] [MAIN ] ODC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:21:59.877774] [DEBUG] [LOCAL ] ODC: Loaded 8633 existing records from primary storage. [2025-09-29T20:21:59.878071] [INFO ] [MAIN ] ODC: Loaded 8633 existing records. [2025-09-29T20:22:00.077769] [WARN ] [MAIN ] ODC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:22:00.078017] [INFO ] [MAIN ] ODC: Wiping existing primary data before full refresh. [2025-09-29T20:22:00.078066] [INFO ] [LOCAL ] ODC: Starting deletion of primary data. [2025-09-29T20:22:00.078307] [DEBUG] [LOCAL ] ODC: Deleted primary data file. [2025-09-29T20:22:00.078365] [INFO ] [MAIN ] ODC: Starting full primary refresh. [2025-09-29T20:22:00.353311] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-07. [2025-09-29T20:22:00.466251] [INFO ] [REMOTE ] ODC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:22:01.148139] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-02. [2025-09-29T20:22:01.511837] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-29T20:22:01.947263] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-29T20:22:01.949383] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-08. [2025-09-29T20:22:02.748130] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-09. [2025-09-29T20:22:03.027568] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-29T20:22:03.548138] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-09. [2025-09-29T20:22:04.199350] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-29T20:22:04.212881] [INFO ] [REMOTE ] OBDC: Full fetch complete (74914 records). [2025-09-29T20:22:04.213072] [DEBUG] [VALIDATOR ] OBDC: Validating primary data. [2025-09-29T20:22:04.353289] [INFO ] [REMOTE ] ODC: Fetching primary data for 2024-12. [2025-09-29T20:22:04.673734] [DEBUG] [VALIDATOR ] OBDC: All expected trading days are present. [2025-09-29T20:22:04.673582] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-29T20:22:04.674052] [DEBUG] [VALIDATOR ] OBDC: Primary data validation passed. [2025-09-29T20:22:04.679377] [INFO ] [MAIN ] OBDC: Fetched primary data is valid. [2025-09-29T20:22:04.679475] [DEBUG] [LOCAL ] OBDC: Saving primary data. [2025-09-29T20:22:04.680215] [INFO ] [REMOTE ] OBK: Full fetch complete (23958 records). [2025-09-29T20:22:04.680371] [DEBUG] [VALIDATOR ] OBK: Validating primary data. [2025-09-29T20:22:04.798828] [DEBUG] [LOCAL ] OBDC: Trimmed 74914 records to 51654 (keeping 200 days of data) [2025-09-29T20:22:05.153065] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-03. [2025-09-29T20:22:05.239397] [DEBUG] [VALIDATOR ] OBK: All expected trading days are present. [2025-09-29T20:22:05.241441] [DEBUG] [VALIDATOR ] OBK: Primary data validation passed. [2025-09-29T20:22:05.241329] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-29T20:22:05.244348] [INFO ] [MAIN ] OBK: Fetched primary data is valid. [2025-09-29T20:22:05.246626] [DEBUG] [LOCAL ] OBK: Saving primary data. [2025-09-29T20:22:05.257566] [DEBUG] [LOCAL ] OBK: Trimmed 23958 records to 16211 (keeping 200 days of data) [2025-09-29T20:22:05.480068] [DEBUG] [LOCAL ] OBK: Primary data saved (16211 records). [2025-09-29T20:22:05.480696] [INFO ] [MAIN ] OBK: Full history saved. [2025-09-29T20:22:05.481623] [INFO ] [MAIN ] Update Progress: 1574/2371 symbols completed. OBK took 25.4s. Estimated remaining: 1h 42m 18s. Rate: 7.8 symbols/min [2025-09-29T20:22:05.746859] [INFO ] [MAIN ] ODV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:22:05.793181] [DEBUG] [LOCAL ] OBDC: Primary data saved (51654 records). [2025-09-29T20:22:05.793803] [DEBUG] [LOCAL ] ODV: Loaded 26258 existing records from primary storage. [2025-09-29T20:22:05.793980] [INFO ] [MAIN ] OBDC: Full history saved. [2025-09-29T20:22:05.794144] [INFO ] [MAIN ] Update Progress: 1575/2371 symbols completed. OBDC took 41.3s. Estimated remaining: 1h 42m 7s. Rate: 7.8 symbols/min [2025-09-29T20:22:05.827691] [INFO ] [MAIN ] ODV: Loaded 26258 existing records. [2025-09-29T20:22:05.962172] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-01. [2025-09-29T20:22:06.127884] [INFO ] [MAIN ] OEC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:22:06.225238] [WARN ] [MAIN ] ODV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:22:06.225997] [INFO ] [MAIN ] ODV: Wiping existing primary data before full refresh. [2025-09-29T20:22:06.226308] [INFO ] [LOCAL ] ODV: Starting deletion of primary data. [2025-09-29T20:22:06.226708] [DEBUG] [LOCAL ] ODV: Deleted primary data file. [2025-09-29T20:22:06.241908] [INFO ] [MAIN ] ODV: Starting full primary refresh. [2025-09-29T20:22:06.275597] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-29T20:22:06.592733] [DEBUG] [LOCAL ] OEC: Loaded 37689 existing records from primary storage. [2025-09-29T20:22:06.649744] [INFO ] [MAIN ] OEC: Loaded 37689 existing records. [2025-09-29T20:22:06.749740] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-04. [2025-09-29T20:22:06.833215] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-29T20:22:07.062700] [INFO ] [REMOTE ] ODV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:22:07.136197] [WARN ] [MAIN ] OEC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:22:07.136465] [INFO ] [MAIN ] OEC: Wiping existing primary data before full refresh. [2025-09-29T20:22:07.136541] [INFO ] [LOCAL ] OEC: Starting deletion of primary data. [2025-09-29T20:22:07.136902] [DEBUG] [LOCAL ] OEC: Deleted primary data file. [2025-09-29T20:22:07.136979] [INFO ] [MAIN ] OEC: Starting full primary refresh. [2025-09-29T20:22:07.544703] [INFO ] [REMOTE ] OEC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:22:07.548050] [INFO ] [REMOTE ] OEC: Fetching primary data for 2024-12. [2025-09-29T20:22:07.698459] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-29T20:22:08.348116] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-02. [2025-09-29T20:22:09.044707] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-29T20:22:09.056337] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-29T20:22:09.148119] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-03. [2025-09-29T20:22:09.948145] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-05. [2025-09-29T20:22:10.090060] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-29T20:22:10.748136] [INFO ] [REMOTE ] ODV: Fetching primary data for 2024-12. [2025-09-29T20:22:10.782946] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-29T20:22:11.548080] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-01. [2025-09-29T20:22:11.901737] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-29T20:22:12.348106] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-01. [2025-09-29T20:22:12.948345] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-29T20:22:13.148116] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-04. [2025-09-29T20:22:13.241164] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-29T20:22:13.948109] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-06. [2025-09-29T20:22:14.018184] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-29T20:22:14.748116] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-02. [2025-09-29T20:22:14.764742] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-29T20:22:15.548083] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-07. [2025-09-29T20:22:15.621207] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-29T20:22:16.348122] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-03. [2025-09-29T20:22:16.432661] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-29T20:22:17.148104] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-05. [2025-09-29T20:22:17.383371] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-29T20:22:17.948079] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-08. [2025-09-29T20:22:18.145601] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-29T20:22:18.606542] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-29T20:22:18.748149] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-09. [2025-09-29T20:22:19.382401] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-29T20:22:19.383972] [INFO ] [REMOTE ] OCFT: Full fetch complete (11779 records). [2025-09-29T20:22:19.384047] [DEBUG] [VALIDATOR ] OCFT: Validating primary data. [2025-09-29T20:22:19.569176] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-04. [2025-09-29T20:22:19.795724] [DEBUG] [VALIDATOR ] OCFT: All expected trading days are present. [2025-09-29T20:22:19.795848] [DEBUG] [VALIDATOR ] OCFT: Primary data validation passed. [2025-09-29T20:22:19.796205] [INFO ] [MAIN ] OCFT: Fetched primary data is valid. [2025-09-29T20:22:19.796269] [DEBUG] [LOCAL ] OCFT: Saving primary data. [2025-09-29T20:22:19.796983] [DEBUG] [LOCAL ] OCFT: Trimmed 11779 records to 8542 (keeping 200 days of data) [2025-09-29T20:22:19.856550] [DEBUG] [LOCAL ] OCFT: Primary data saved (8542 records). [2025-09-29T20:22:19.856758] [INFO ] [MAIN ] OCFT: Full history saved. [2025-09-29T20:22:19.856903] [INFO ] [MAIN ] Update Progress: 1576/2371 symbols completed. OCFT took 23.4s. Estimated remaining: 1h 42m 2s. Rate: 7.8 symbols/min [2025-09-29T20:22:20.056334] [INFO ] [MAIN ] OFG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:22:20.081385] [DEBUG] [LOCAL ] OFG: Loaded 22393 existing records from primary storage. [2025-09-29T20:22:20.081692] [INFO ] [MAIN ] OFG: Loaded 22393 existing records. [2025-09-29T20:22:20.268517] [WARN ] [MAIN ] OFG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:22:20.268772] [INFO ] [MAIN ] OFG: Wiping existing primary data before full refresh. [2025-09-29T20:22:20.268846] [INFO ] [LOCAL ] OFG: Starting deletion of primary data. [2025-09-29T20:22:20.269124] [DEBUG] [LOCAL ] OFG: Deleted primary data file. [2025-09-29T20:22:20.269183] [INFO ] [MAIN ] OFG: Starting full primary refresh. [2025-09-29T20:22:20.353226] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-02. [2025-09-29T20:22:20.665237] [INFO ] [REMOTE ] OFG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:22:20.876925] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-29T20:22:21.148133] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-06. [2025-09-29T20:22:21.908851] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-29T20:22:21.948075] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-03. [2025-09-29T20:22:22.095892] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-29T20:22:22.748114] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-05. [2025-09-29T20:22:23.519760] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-29T20:22:23.548095] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-04. [2025-09-29T20:22:23.986226] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-29T20:22:24.348109] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-06. [2025-09-29T20:22:25.148084] [INFO ] [REMOTE ] OFG: Fetching primary data for 2024-12. [2025-09-29T20:22:25.259975] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-29T20:22:25.451904] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-29T20:22:25.948151] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-05. [2025-09-29T20:22:26.473005] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-29T20:22:26.748131] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-01. [2025-09-29T20:22:27.487519] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-29T20:22:27.548124] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-07. [2025-09-29T20:22:28.213183] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-29T20:22:28.348133] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-02. [2025-09-29T20:22:28.908827] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-29T20:22:29.148125] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-06. [2025-09-29T20:22:29.774052] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-29T20:22:29.948119] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-03. [2025-09-29T20:22:30.671837] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-29T20:22:30.748110] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-07. [2025-09-29T20:22:31.066808] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-29T20:22:31.548126] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-07. [2025-09-29T20:22:32.216688] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-29T20:22:32.348170] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-08. [2025-09-29T20:22:32.403961] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-29T20:22:33.148131] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-08. [2025-09-29T20:22:33.940958] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-29T20:22:33.949393] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-04. [2025-09-29T20:22:33.991020] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-29T20:22:34.748169] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-09. [2025-09-29T20:22:35.342831] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-29T20:22:35.548133] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-05. [2025-09-29T20:22:35.611339] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-29T20:22:35.614189] [INFO ] [REMOTE ] ODC: Full fetch complete (10994 records). [2025-09-29T20:22:35.614283] [DEBUG] [VALIDATOR ] ODC: Validating primary data. [2025-09-29T20:22:36.016590] [DEBUG] [VALIDATOR ] ODC: All expected trading days are present. [2025-09-29T20:22:36.016735] [DEBUG] [VALIDATOR ] ODC: Primary data validation passed. [2025-09-29T20:22:36.017121] [INFO ] [MAIN ] ODC: Fetched primary data is valid. [2025-09-29T20:22:36.017203] [DEBUG] [LOCAL ] ODC: Saving primary data. [2025-09-29T20:22:36.017897] [DEBUG] [LOCAL ] ODC: Trimmed 10994 records to 8441 (keeping 200 days of data) [2025-09-29T20:22:36.074418] [DEBUG] [LOCAL ] ODC: Primary data saved (8441 records). [2025-09-29T20:22:36.074565] [INFO ] [MAIN ] ODC: Full history saved. [2025-09-29T20:22:36.074768] [INFO ] [MAIN ] Update Progress: 1577/2371 symbols completed. ODC took 36.4s. Estimated remaining: 1h 41m 59s. Rate: 7.8 symbols/min [2025-09-29T20:22:36.292287] [INFO ] [MAIN ] OGE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:22:36.341995] [DEBUG] [LOCAL ] OGE: Loaded 47046 existing records from primary storage. [2025-09-29T20:22:36.342365] [INFO ] [MAIN ] OGE: Loaded 47046 existing records. [2025-09-29T20:22:36.354303] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-09. [2025-09-29T20:22:36.552981] [WARN ] [MAIN ] OGE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:22:36.553267] [INFO ] [MAIN ] OGE: Wiping existing primary data before full refresh. [2025-09-29T20:22:36.553326] [INFO ] [LOCAL ] OGE: Starting deletion of primary data. [2025-09-29T20:22:36.553798] [DEBUG] [LOCAL ] OGE: Deleted primary data file. [2025-09-29T20:22:36.553863] [INFO ] [MAIN ] OGE: Starting full primary refresh. [2025-09-29T20:22:36.927291] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-29T20:22:36.967013] [INFO ] [REMOTE ] OGE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:22:37.148138] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-06. [2025-09-29T20:22:37.819720] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-29T20:22:37.827740] [INFO ] [REMOTE ] OEC: Full fetch complete (52609 records). [2025-09-29T20:22:37.827924] [DEBUG] [VALIDATOR ] OEC: Validating primary data. [2025-09-29T20:22:37.953224] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-08. [2025-09-29T20:22:38.252913] [DEBUG] [VALIDATOR ] OEC: All expected trading days are present. [2025-09-29T20:22:38.253043] [DEBUG] [VALIDATOR ] OEC: Primary data validation passed. [2025-09-29T20:22:38.254207] [INFO ] [MAIN ] OEC: Fetched primary data is valid. [2025-09-29T20:22:38.254300] [DEBUG] [LOCAL ] OEC: Saving primary data. [2025-09-29T20:22:38.255574] [DEBUG] [LOCAL ] OEC: Trimmed 52609 records to 37066 (keeping 200 days of data) [2025-09-29T20:22:38.371131] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-29T20:22:38.516053] [DEBUG] [LOCAL ] OEC: Primary data saved (37066 records). [2025-09-29T20:22:38.516211] [INFO ] [MAIN ] OEC: Full history saved. [2025-09-29T20:22:38.516321] [INFO ] [MAIN ] Update Progress: 1578/2371 symbols completed. OEC took 32.7s. Estimated remaining: 1h 41m 49s. Rate: 7.8 symbols/min [2025-09-29T20:22:38.731576] [INFO ] [MAIN ] OGN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:22:38.748141] [INFO ] [REMOTE ] OGE: Fetching primary data for 2024-12. [2025-09-29T20:22:38.804781] [DEBUG] [LOCAL ] OGN: Loaded 53882 existing records from primary storage. [2025-09-29T20:22:38.805247] [INFO ] [MAIN ] OGN: Loaded 53882 existing records. [2025-09-29T20:22:39.017310] [WARN ] [MAIN ] OGN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:22:39.017537] [INFO ] [MAIN ] OGN: Wiping existing primary data before full refresh. [2025-09-29T20:22:39.017586] [INFO ] [LOCAL ] OGN: Starting deletion of primary data. [2025-09-29T20:22:39.018079] [DEBUG] [LOCAL ] OGN: Deleted primary data file. [2025-09-29T20:22:39.018140] [INFO ] [MAIN ] OGN: Starting full primary refresh. [2025-09-29T20:22:39.418334] [INFO ] [REMOTE ] OGN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:22:39.548146] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-07. [2025-09-29T20:22:39.630181] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-29T20:22:40.353229] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-09. [2025-09-29T20:22:40.376308] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-29T20:22:40.677864] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-29T20:22:41.148168] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-01. [2025-09-29T20:22:41.948086] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-08. [2025-09-29T20:22:41.978272] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-29T20:22:41.987087] [INFO ] [REMOTE ] ODV: Full fetch complete (32573 records). [2025-09-29T20:22:41.987227] [DEBUG] [VALIDATOR ] ODV: Validating primary data. [2025-09-29T20:22:42.393036] [DEBUG] [VALIDATOR ] ODV: All expected trading days are present. [2025-09-29T20:22:42.393119] [DEBUG] [VALIDATOR ] ODV: Primary data validation passed. [2025-09-29T20:22:42.393829] [INFO ] [MAIN ] ODV: Fetched primary data is valid. [2025-09-29T20:22:42.393892] [DEBUG] [LOCAL ] ODV: Saving primary data. [2025-09-29T20:22:42.394766] [DEBUG] [LOCAL ] ODV: Trimmed 32573 records to 26437 (keeping 200 days of data) [2025-09-29T20:22:42.555203] [DEBUG] [LOCAL ] ODV: Primary data saved (26437 records). [2025-09-29T20:22:42.555342] [INFO ] [MAIN ] ODV: Full history saved. [2025-09-29T20:22:42.555433] [INFO ] [MAIN ] Update Progress: 1579/2371 symbols completed. ODV took 37.1s. Estimated remaining: 1h 41m 39s. Rate: 7.8 symbols/min [2025-09-29T20:22:42.744100] [INFO ] [MAIN ] OGS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:22:42.748094] [INFO ] [REMOTE ] OGN: Fetching primary data for 2024-12. [2025-09-29T20:22:42.795099] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-29T20:22:42.816225] [DEBUG] [LOCAL ] OGS: Loaded 34591 existing records from primary storage. [2025-09-29T20:22:42.816529] [INFO ] [MAIN ] OGS: Loaded 34591 existing records. [2025-09-29T20:22:43.005577] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-29T20:22:43.037713] [WARN ] [MAIN ] OGS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:22:43.044631] [INFO ] [MAIN ] OGS: Wiping existing primary data before full refresh. [2025-09-29T20:22:43.045186] [INFO ] [LOCAL ] OGS: Starting deletion of primary data. [2025-09-29T20:22:43.045585] [DEBUG] [LOCAL ] OGS: Deleted primary data file. [2025-09-29T20:22:43.045741] [INFO ] [MAIN ] OGS: Starting full primary refresh. [2025-09-29T20:22:43.439224] [INFO ] [REMOTE ] OGS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:22:43.548111] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-02. [2025-09-29T20:22:44.348122] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-09. [2025-09-29T20:22:44.655281] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-29T20:22:45.148130] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-01. [2025-09-29T20:22:45.206941] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-29T20:22:45.423052] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-29T20:22:45.427337] [INFO ] [REMOTE ] OFG: Full fetch complete (34412 records). [2025-09-29T20:22:45.427441] [DEBUG] [VALIDATOR ] OFG: Validating primary data. [2025-09-29T20:22:45.836762] [DEBUG] [VALIDATOR ] OFG: All expected trading days are present. [2025-09-29T20:22:45.836847] [DEBUG] [VALIDATOR ] OFG: Primary data validation passed. [2025-09-29T20:22:45.837626] [INFO ] [MAIN ] OFG: Fetched primary data is valid. [2025-09-29T20:22:45.837718] [DEBUG] [LOCAL ] OFG: Saving primary data. [2025-09-29T20:22:45.838785] [DEBUG] [LOCAL ] OFG: Trimmed 34412 records to 21736 (keeping 200 days of data) [2025-09-29T20:22:45.949840] [INFO ] [REMOTE ] OGS: Fetching primary data for 2024-12. [2025-09-29T20:22:45.984391] [DEBUG] [LOCAL ] OFG: Primary data saved (21736 records). [2025-09-29T20:22:45.984545] [INFO ] [MAIN ] OFG: Full history saved. [2025-09-29T20:22:45.984639] [INFO ] [MAIN ] Update Progress: 1580/2371 symbols completed. OFG took 26.1s. Estimated remaining: 1h 41m 29s. Rate: 7.8 symbols/min [2025-09-29T20:22:46.205257] [INFO ] [MAIN ] OHI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:22:46.264051] [DEBUG] [LOCAL ] OHI: Loaded 52824 existing records from primary storage. [2025-09-29T20:22:46.264385] [INFO ] [MAIN ] OHI: Loaded 52824 existing records. [2025-09-29T20:22:46.485398] [WARN ] [MAIN ] OHI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:22:46.485669] [INFO ] [MAIN ] OHI: Wiping existing primary data before full refresh. [2025-09-29T20:22:46.485750] [INFO ] [LOCAL ] OHI: Starting deletion of primary data. [2025-09-29T20:22:46.486109] [DEBUG] [LOCAL ] OHI: Deleted primary data file. [2025-09-29T20:22:46.486179] [INFO ] [MAIN ] OHI: Starting full primary refresh. [2025-09-29T20:22:46.755550] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-03. [2025-09-29T20:22:46.897476] [INFO ] [REMOTE ] OHI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:22:46.979783] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-29T20:22:47.173994] [DEBUG] [REMOTE ] OGE: Error fetching primary data for 2025-03: Server request status code is 503. [2025-09-29T20:22:47.174342] [WARN ] [REMOTE ] OGE: No data returned for month 2025-03 [2025-09-29T20:22:47.174436] [FATAL] [REMOTE ] OGE: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T20:22:47.174526] [FATAL] [MAIN ] OGE: Failed to fetch primary data. [2025-09-29T20:22:47.174590] [WARN ] [MAIN ] OGE: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T20:22:47.174692] [INFO ] [LOCAL ] OGE: Starting deletion of primary data. [2025-09-29T20:22:47.174768] [DEBUG] [LOCAL ] OGE: No primary data file found to delete. [2025-09-29T20:22:47.174807] [INFO ] [LOCAL ] OGE: Starting deletion of derivative data. [2025-09-29T20:22:47.175451] [DEBUG] [LOCAL ] OGE: Deleted derivative data file. [2025-09-29T20:22:47.175545] [INFO ] [MAIN ] Update Progress: 1581/2371 symbols completed. OGE took 11.1s. Estimated remaining: 1h 41m 18s. Rate: 7.8 symbols/min [2025-09-29T20:22:47.364075] [INFO ] [MAIN ] OI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:22:47.383124] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-29T20:22:47.440447] [DEBUG] [LOCAL ] OI: Loaded 48011 existing records from primary storage. [2025-09-29T20:22:47.440835] [INFO ] [MAIN ] OI: Loaded 48011 existing records. [2025-09-29T20:22:47.553202] [INFO ] [REMOTE ] OHI: Fetching primary data for 2024-12. [2025-09-29T20:22:47.667734] [WARN ] [MAIN ] OI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:22:47.667972] [INFO ] [MAIN ] OI: Wiping existing primary data before full refresh. [2025-09-29T20:22:47.668022] [INFO ] [LOCAL ] OI: Starting deletion of primary data. [2025-09-29T20:22:47.668284] [DEBUG] [LOCAL ] OI: Deleted primary data file. [2025-09-29T20:22:47.668345] [INFO ] [MAIN ] OI: Starting full primary refresh. [2025-09-29T20:22:48.061422] [INFO ] [REMOTE ] OI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:22:48.348123] [INFO ] [REMOTE ] OI: Fetching primary data for 2024-12. [2025-09-29T20:22:49.148084] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-01. [2025-09-29T20:22:49.500084] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-29T20:22:49.791685] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-29T20:22:49.948134] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-01. [2025-09-29T20:22:50.547122] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-29T20:22:50.748159] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-02. [2025-09-29T20:22:51.548151] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-02. [2025-09-29T20:22:51.704736] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-29T20:22:52.159775] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-29T20:22:52.348123] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-03. [2025-09-29T20:22:53.148152] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-02. [2025-09-29T20:22:53.948163] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-01. [2025-09-29T20:23:05.770857] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-02 (12.62 seconds). [2025-09-29T20:23:05.780582] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-03. [2025-09-29T20:23:06.035194] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-03 (13.69 seconds). [2025-09-29T20:23:06.043404] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-04. [2025-09-29T20:23:07.367856] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-02 (15.82 seconds). [2025-09-29T20:23:07.405414] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-29T20:23:07.415806] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-05. [2025-09-29T20:23:07.415467] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-03. [2025-09-29T20:23:07.635779] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-29T20:23:07.647472] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-04. [2025-09-29T20:23:08.001184] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-01 (14.05 seconds). [2025-09-29T20:23:08.013990] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-02. [2025-09-29T20:23:09.083457] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-29T20:23:09.093163] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-06. [2025-09-29T20:23:09.481783] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-29T20:23:09.493991] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-04. [2025-09-29T20:23:09.539687] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-29T20:23:09.550866] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-05. [2025-09-29T20:23:10.154930] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-09-29T20:23:10.165567] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-03. [2025-09-29T20:23:11.309624] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-29T20:23:11.320861] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-06. [2025-09-29T20:23:11.633138] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-06 (2.54 seconds). [2025-09-29T20:23:11.641150] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-07. [2025-09-29T20:23:11.698467] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-29T20:23:11.710275] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-05. [2025-09-29T20:23:12.134739] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-29T20:23:12.146575] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-04. [2025-09-29T20:23:12.978238] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-29T20:23:12.988801] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-07. [2025-09-29T20:23:13.203408] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-29T20:23:13.211854] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-08. [2025-09-29T20:23:13.527196] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-29T20:23:13.539167] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-06. [2025-09-29T20:23:13.973495] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-29T20:23:13.985162] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-05. [2025-09-29T20:23:14.849886] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-29T20:23:14.882396] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-08. [2025-09-29T20:23:14.885628] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-29T20:23:14.894814] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-09. [2025-09-29T20:23:15.047729] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-29T20:23:15.060013] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-07. [2025-09-29T20:23:15.717521] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-29T20:23:15.729351] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-06. [2025-09-29T20:23:16.235101] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-29T20:23:16.242208] [INFO ] [REMOTE ] OGS: Full fetch complete (47999 records). [2025-09-29T20:23:16.242346] [DEBUG] [VALIDATOR ] OGS: Validating primary data. [2025-09-29T20:23:16.645232] [DEBUG] [VALIDATOR ] OGS: All expected trading days are present. [2025-09-29T20:23:16.645440] [DEBUG] [VALIDATOR ] OGS: Primary data validation passed. [2025-09-29T20:23:16.646511] [INFO ] [MAIN ] OGS: Fetched primary data is valid. [2025-09-29T20:23:16.646598] [DEBUG] [LOCAL ] OGS: Saving primary data. [2025-09-29T20:23:16.648160] [DEBUG] [LOCAL ] OGS: Trimmed 47999 records to 34112 (keeping 200 days of data) [2025-09-29T20:23:16.790152] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-29T20:23:16.803731] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-09. [2025-09-29T20:23:16.922432] [DEBUG] [LOCAL ] OGS: Primary data saved (34112 records). [2025-09-29T20:23:16.922593] [INFO ] [MAIN ] OGS: Full history saved. [2025-09-29T20:23:16.922755] [INFO ] [MAIN ] Update Progress: 1582/2371 symbols completed. OGS took 34.4s. Estimated remaining: 1h 41m 22s. Rate: 7.8 symbols/min [2025-09-29T20:23:17.105804] [INFO ] [MAIN ] OIA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:23:17.142903] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-29T20:23:17.160606] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-08. [2025-09-29T20:23:17.168226] [DEBUG] [LOCAL ] OIA: Loaded 14218 existing records from primary storage. [2025-09-29T20:23:17.168528] [INFO ] [MAIN ] OIA: Loaded 14218 existing records. [2025-09-29T20:23:17.365852] [WARN ] [MAIN ] OIA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:23:17.366103] [INFO ] [MAIN ] OIA: Wiping existing primary data before full refresh. [2025-09-29T20:23:17.366162] [INFO ] [LOCAL ] OIA: Starting deletion of primary data. [2025-09-29T20:23:17.366389] [DEBUG] [LOCAL ] OIA: Deleted primary data file. [2025-09-29T20:23:17.366451] [INFO ] [MAIN ] OIA: Starting full primary refresh. [2025-09-29T20:23:17.759940] [INFO ] [REMOTE ] OIA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:23:17.760304] [INFO ] [REMOTE ] OIA: Fetching primary data for 2024-12. [2025-09-29T20:23:17.792956] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-29T20:23:17.804004] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-07. [2025-09-29T20:23:18.556971] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-29T20:23:18.566931] [INFO ] [REMOTE ] OI: Full fetch complete (68146 records). [2025-09-29T20:23:18.567117] [DEBUG] [VALIDATOR ] OI: Validating primary data. [2025-09-29T20:23:18.819398] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-29T20:23:18.844241] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-01. [2025-09-29T20:23:19.020325] [DEBUG] [VALIDATOR ] OI: All expected trading days are present. [2025-09-29T20:23:19.020514] [DEBUG] [VALIDATOR ] OI: Primary data validation passed. [2025-09-29T20:23:19.021969] [INFO ] [MAIN ] OI: Fetched primary data is valid. [2025-09-29T20:23:19.022084] [DEBUG] [LOCAL ] OI: Saving primary data. [2025-09-29T20:23:19.023778] [DEBUG] [LOCAL ] OI: Trimmed 68146 records to 47163 (keeping 200 days of data) [2025-09-29T20:23:19.167798] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-29T20:23:19.193106] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-09. [2025-09-29T20:23:19.363180] [DEBUG] [LOCAL ] OI: Primary data saved (47163 records). [2025-09-29T20:23:19.363360] [INFO ] [MAIN ] OI: Full history saved. [2025-09-29T20:23:19.363504] [INFO ] [MAIN ] Update Progress: 1583/2371 symbols completed. OI took 32.2s. Estimated remaining: 1h 41m 11s. Rate: 7.8 symbols/min [2025-09-29T20:23:19.555531] [INFO ] [MAIN ] OII: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:23:19.593190] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-29T20:23:19.605264] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-08. [2025-09-29T20:23:19.640722] [DEBUG] [LOCAL ] OII: Loaded 43406 existing records from primary storage. [2025-09-29T20:23:19.641036] [INFO ] [MAIN ] OII: Loaded 43406 existing records. [2025-09-29T20:23:19.834536] [WARN ] [MAIN ] OII: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:23:19.834954] [INFO ] [MAIN ] OII: Wiping existing primary data before full refresh. [2025-09-29T20:23:19.835085] [INFO ] [LOCAL ] OII: Starting deletion of primary data. [2025-09-29T20:23:19.835382] [DEBUG] [LOCAL ] OII: Deleted primary data file. [2025-09-29T20:23:19.835441] [INFO ] [MAIN ] OII: Starting full primary refresh. [2025-09-29T20:23:19.967022] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-29T20:23:20.002584] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-02. [2025-09-29T20:23:20.226997] [INFO ] [REMOTE ] OII: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:23:20.227541] [INFO ] [REMOTE ] OII: Fetching primary data for 2024-12. [2025-09-29T20:23:20.820735] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-29T20:23:20.833009] [INFO ] [REMOTE ] OGN: Full fetch complete (76813 records). [2025-09-29T20:23:20.833172] [DEBUG] [VALIDATOR ] OGN: Validating primary data. [2025-09-29T20:23:21.256745] [DEBUG] [VALIDATOR ] OGN: All expected trading days are present. [2025-09-29T20:23:21.256856] [DEBUG] [VALIDATOR ] OGN: Primary data validation passed. [2025-09-29T20:23:21.258562] [INFO ] [MAIN ] OGN: Fetched primary data is valid. [2025-09-29T20:23:21.258703] [DEBUG] [LOCAL ] OGN: Saving primary data. [2025-09-29T20:23:21.261339] [DEBUG] [LOCAL ] OGN: Trimmed 76813 records to 53096 (keeping 200 days of data) [2025-09-29T20:23:21.274538] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-29T20:23:21.279366] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-03. [2025-09-29T20:23:21.575074] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-29T20:23:21.589160] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-09. [2025-09-29T20:23:21.684358] [DEBUG] [LOCAL ] OGN: Primary data saved (53096 records). [2025-09-29T20:23:21.684614] [INFO ] [MAIN ] OGN: Full history saved. [2025-09-29T20:23:21.684773] [INFO ] [MAIN ] Update Progress: 1584/2371 symbols completed. OGN took 43.2s. Estimated remaining: 1h 41m 1s. Rate: 7.8 symbols/min [2025-09-29T20:23:21.868558] [INFO ] [MAIN ] OIS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:23:21.895940] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-29T20:23:21.905524] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-01. [2025-09-29T20:23:21.942312] [DEBUG] [LOCAL ] OIS: Loaded 41135 existing records from primary storage. [2025-09-29T20:23:21.942637] [INFO ] [MAIN ] OIS: Loaded 41135 existing records. [2025-09-29T20:23:22.136227] [WARN ] [MAIN ] OIS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:23:22.136513] [INFO ] [MAIN ] OIS: Wiping existing primary data before full refresh. [2025-09-29T20:23:22.136589] [INFO ] [LOCAL ] OIS: Starting deletion of primary data. [2025-09-29T20:23:22.136964] [DEBUG] [LOCAL ] OIS: Deleted primary data file. [2025-09-29T20:23:22.137025] [INFO ] [MAIN ] OIS: Starting full primary refresh. [2025-09-29T20:23:22.253263] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-29T20:23:22.283727] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-04. [2025-09-29T20:23:22.533491] [INFO ] [REMOTE ] OIS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:23:22.748160] [INFO ] [REMOTE ] OIS: Fetching primary data for 2024-12. [2025-09-29T20:23:23.304127] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-29T20:23:23.341211] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-29T20:23:23.349502] [INFO ] [REMOTE ] OHI: Full fetch complete (75110 records). [2025-09-29T20:23:23.351052] [DEBUG] [VALIDATOR ] OHI: Validating primary data. [2025-09-29T20:23:23.465467] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-29T20:23:23.571192] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-02. [2025-09-29T20:23:23.817014] [DEBUG] [VALIDATOR ] OHI: All expected trading days are present. [2025-09-29T20:23:23.817158] [DEBUG] [VALIDATOR ] OHI: Primary data validation passed. [2025-09-29T20:23:23.818582] [INFO ] [MAIN ] OHI: Fetched primary data is valid. [2025-09-29T20:23:23.818871] [DEBUG] [LOCAL ] OHI: Saving primary data. [2025-09-29T20:23:23.840803] [DEBUG] [LOCAL ] OHI: Trimmed 75110 records to 52015 (keeping 200 days of data) [2025-09-29T20:23:23.842924] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-29T20:23:24.199007] [DEBUG] [LOCAL ] OHI: Primary data saved (52015 records). [2025-09-29T20:23:24.199169] [INFO ] [MAIN ] OHI: Full history saved. [2025-09-29T20:23:24.199278] [INFO ] [MAIN ] Update Progress: 1585/2371 symbols completed. OHI took 38.2s. Estimated remaining: 1h 40m 51s. Rate: 7.8 symbols/min [2025-09-29T20:23:24.362236] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-01. [2025-09-29T20:23:24.398708] [INFO ] [MAIN ] OKE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:23:24.460713] [DEBUG] [LOCAL ] OKE: Loaded 54316 existing records from primary storage. [2025-09-29T20:23:24.461093] [INFO ] [MAIN ] OKE: Loaded 54316 existing records. [2025-09-29T20:23:24.678422] [WARN ] [MAIN ] OKE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:23:24.678691] [INFO ] [MAIN ] OKE: Wiping existing primary data before full refresh. [2025-09-29T20:23:24.678756] [INFO ] [LOCAL ] OKE: Starting deletion of primary data. [2025-09-29T20:23:24.679277] [DEBUG] [LOCAL ] OKE: Deleted primary data file. [2025-09-29T20:23:24.679338] [INFO ] [MAIN ] OKE: Starting full primary refresh. [2025-09-29T20:23:25.094515] [INFO ] [REMOTE ] OKE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:23:25.119472] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-29T20:23:25.148093] [INFO ] [REMOTE ] OKE: Fetching primary data for 2024-12. [2025-09-29T20:23:25.931696] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-29T20:23:25.948083] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-02. [2025-09-29T20:23:26.748130] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-03. [2025-09-29T20:23:27.130606] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-29T20:23:27.189410] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-29T20:23:27.548180] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-05. [2025-09-29T20:23:28.182067] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-29T20:23:28.223329] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-29T20:23:28.348112] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-03. [2025-09-29T20:23:29.148118] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-06. [2025-09-29T20:23:29.948519] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-29T20:23:29.948636] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-04. [2025-09-29T20:23:29.994108] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-29T20:23:30.748154] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-07. [2025-09-29T20:23:31.548129] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-04. [2025-09-29T20:23:31.781401] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-29T20:23:31.808547] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-29T20:23:32.348351] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-08. [2025-09-29T20:23:33.148120] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-05. [2025-09-29T20:23:33.265880] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-29T20:23:33.465525] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-29T20:23:33.948161] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-09. [2025-09-29T20:23:34.679984] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-29T20:23:34.748126] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-05. [2025-09-29T20:23:34.947416] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-29T20:23:34.951088] [INFO ] [REMOTE ] OIA: Full fetch complete (21311 records). [2025-09-29T20:23:34.951167] [DEBUG] [VALIDATOR ] OIA: Validating primary data. [2025-09-29T20:23:35.371566] [DEBUG] [VALIDATOR ] OIA: All expected trading days are present. [2025-09-29T20:23:35.371688] [DEBUG] [VALIDATOR ] OIA: Primary data validation passed. [2025-09-29T20:23:35.372389] [INFO ] [MAIN ] OIA: Fetched primary data is valid. [2025-09-29T20:23:35.372488] [DEBUG] [LOCAL ] OIA: Saving primary data. [2025-09-29T20:23:35.373322] [DEBUG] [LOCAL ] OIA: Trimmed 21311 records to 13902 (keeping 200 days of data) [2025-09-29T20:23:35.464608] [DEBUG] [LOCAL ] OIA: Primary data saved (13902 records). [2025-09-29T20:23:35.464819] [INFO ] [MAIN ] OIA: Full history saved. [2025-09-29T20:23:35.464944] [INFO ] [MAIN ] Update Progress: 1586/2371 symbols completed. OIA took 18.5s. Estimated remaining: 1h 40m 45s. Rate: 7.8 symbols/min [2025-09-29T20:23:35.558867] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-06. [2025-09-29T20:23:35.708427] [INFO ] [MAIN ] OKLO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:23:35.773564] [DEBUG] [LOCAL ] OKLO: Loaded 54599 existing records from primary storage. [2025-09-29T20:23:35.774074] [INFO ] [MAIN ] OKLO: Loaded 54599 existing records. [2025-09-29T20:23:35.982466] [WARN ] [MAIN ] OKLO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:23:35.982709] [INFO ] [MAIN ] OKLO: Wiping existing primary data before full refresh. [2025-09-29T20:23:35.982767] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-09-29T20:23:35.983158] [DEBUG] [LOCAL ] OKLO: Deleted primary data file. [2025-09-29T20:23:35.983217] [INFO ] [MAIN ] OKLO: Starting full primary refresh. [2025-09-29T20:23:36.355737] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-01. [2025-09-29T20:23:36.402411] [INFO ] [REMOTE ] OKLO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:23:36.429268] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-29T20:23:37.134321] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-29T20:23:37.148084] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-07. [2025-09-29T20:23:37.948150] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-06. [2025-09-29T20:23:38.743778] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-01 (2.39 seconds). [2025-09-29T20:23:38.754136] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2024-12. [2025-09-29T20:23:38.831890] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-29T20:23:39.519595] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-29T20:23:39.548117] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-08. [2025-09-29T20:23:40.348127] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-02. [2025-09-29T20:23:41.140325] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-29T20:23:41.149176] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-07. [2025-09-29T20:23:41.472280] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2024-12 (2.72 seconds). [2025-09-29T20:23:41.960548] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-01. [2025-09-29T20:23:41.966946] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-29T20:23:42.753193] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-09. [2025-09-29T20:23:42.766061] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-29T20:23:43.548121] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-08. [2025-09-29T20:23:44.319284] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-29T20:23:44.328683] [INFO ] [REMOTE ] OII: Full fetch complete (62008 records). [2025-09-29T20:23:44.328853] [DEBUG] [VALIDATOR ] OII: Validating primary data. [2025-09-29T20:23:44.363865] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-03. [2025-09-29T20:23:44.777620] [DEBUG] [VALIDATOR ] OII: All expected trading days are present. [2025-09-29T20:23:44.777956] [DEBUG] [VALIDATOR ] OII: Primary data validation passed. [2025-09-29T20:23:44.779687] [INFO ] [MAIN ] OII: Fetched primary data is valid. [2025-09-29T20:23:44.779815] [DEBUG] [LOCAL ] OII: Saving primary data. [2025-09-29T20:23:44.782766] [DEBUG] [LOCAL ] OII: Trimmed 62008 records to 42631 (keeping 200 days of data) [2025-09-29T20:23:45.034751] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-01 (3.07 seconds). [2025-09-29T20:23:45.094064] [DEBUG] [LOCAL ] OII: Primary data saved (42631 records). [2025-09-29T20:23:45.094241] [INFO ] [MAIN ] OII: Full history saved. [2025-09-29T20:23:45.094350] [INFO ] [MAIN ] Update Progress: 1587/2371 symbols completed. OII took 25.7s. Estimated remaining: 1h 40m 38s. Rate: 7.8 symbols/min [2025-09-29T20:23:45.156031] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-02. [2025-09-29T20:23:45.297223] [INFO ] [MAIN ] OLN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:23:45.322036] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-29T20:23:45.383933] [DEBUG] [LOCAL ] OLN: Loaded 52512 existing records from primary storage. [2025-09-29T20:23:45.384376] [INFO ] [MAIN ] OLN: Loaded 52512 existing records. [2025-09-29T20:23:45.585339] [WARN ] [MAIN ] OLN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:23:45.585605] [INFO ] [MAIN ] OLN: Wiping existing primary data before full refresh. [2025-09-29T20:23:45.585689] [INFO ] [LOCAL ] OLN: Starting deletion of primary data. [2025-09-29T20:23:45.586111] [DEBUG] [LOCAL ] OLN: Deleted primary data file. [2025-09-29T20:23:45.586171] [INFO ] [MAIN ] OLN: Starting full primary refresh. [2025-09-29T20:23:45.955573] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-09. [2025-09-29T20:23:45.971309] [INFO ] [REMOTE ] OLN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:23:46.350460] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-29T20:23:46.748143] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-04. [2025-09-29T20:23:47.503443] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-29T20:23:47.511150] [INFO ] [REMOTE ] OIS: Full fetch complete (57058 records). [2025-09-29T20:23:47.511325] [DEBUG] [VALIDATOR ] OIS: Validating primary data. [2025-09-29T20:23:47.561698] [INFO ] [REMOTE ] OLN: Fetching primary data for 2024-12. [2025-09-29T20:23:47.938760] [DEBUG] [VALIDATOR ] OIS: All expected trading days are present. [2025-09-29T20:23:47.939092] [DEBUG] [VALIDATOR ] OIS: Primary data validation passed. [2025-09-29T20:23:47.940097] [INFO ] [MAIN ] OIS: Fetched primary data is valid. [2025-09-29T20:23:47.940214] [DEBUG] [LOCAL ] OIS: Saving primary data. [2025-09-29T20:23:47.942024] [DEBUG] [LOCAL ] OIS: Trimmed 57058 records to 40448 (keeping 200 days of data) [2025-09-29T20:23:47.971792] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-02 (2.82 seconds). [2025-09-29T20:23:48.222756] [DEBUG] [LOCAL ] OIS: Primary data saved (40448 records). [2025-09-29T20:23:48.222890] [INFO ] [MAIN ] OIS: Full history saved. [2025-09-29T20:23:48.223034] [INFO ] [MAIN ] Update Progress: 1588/2371 symbols completed. OIS took 26.5s. Estimated remaining: 1h 40m 28s. Rate: 7.8 symbols/min [2025-09-29T20:23:48.353219] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-03. [2025-09-29T20:23:48.447556] [INFO ] [MAIN ] OLP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:23:48.461026] [DEBUG] [LOCAL ] OLP: Loaded 9963 existing records from primary storage. [2025-09-29T20:23:48.461293] [INFO ] [MAIN ] OLP: Loaded 9963 existing records. [2025-09-29T20:23:48.650990] [WARN ] [MAIN ] OLP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:23:48.651282] [INFO ] [MAIN ] OLP: Wiping existing primary data before full refresh. [2025-09-29T20:23:48.651333] [INFO ] [LOCAL ] OLP: Starting deletion of primary data. [2025-09-29T20:23:48.651797] [DEBUG] [LOCAL ] OLP: Deleted primary data file. [2025-09-29T20:23:48.651859] [INFO ] [MAIN ] OLP: Starting full primary refresh. [2025-09-29T20:23:49.044131] [INFO ] [REMOTE ] OLP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:23:49.079507] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-29T20:23:49.148085] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-05. [2025-09-29T20:23:49.413930] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-29T20:23:49.948125] [INFO ] [REMOTE ] OLP: Fetching primary data for 2024-12. [2025-09-29T20:23:50.748105] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-01. [2025-09-29T20:23:50.928862] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-29T20:23:50.955056] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-29T20:23:51.010030] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-03 (2.66 seconds). [2025-09-29T20:23:51.548162] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-04. [2025-09-29T20:23:52.348162] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-01. [2025-09-29T20:23:52.653341] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-29T20:23:53.148159] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-02. [2025-09-29T20:23:53.231117] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-29T20:23:53.948096] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-06. [2025-09-29T20:23:54.347190] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-04 (2.80 seconds). [2025-09-29T20:23:54.748128] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-05. [2025-09-29T20:23:54.888692] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-29T20:23:55.548117] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-03. [2025-09-29T20:23:55.935182] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-29T20:23:56.348121] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-02. [2025-09-29T20:23:57.148107] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-07. [2025-09-29T20:23:57.177413] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-29T20:23:57.350625] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-29T20:23:57.573209] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-05 (2.83 seconds). [2025-09-29T20:23:57.948129] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-03. [2025-09-29T20:23:58.748133] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-06. [2025-09-29T20:23:59.019986] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-29T20:23:59.188231] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-29T20:23:59.548190] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-04. [2025-09-29T20:24:00.348117] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-08. [2025-09-29T20:24:01.148118] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-04. [2025-09-29T20:24:01.508276] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-06 (2.76 seconds). [2025-09-29T20:24:01.562201] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-29T20:24:01.752075] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-29T20:24:01.943968] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-29T20:24:01.953592] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-07. [2025-09-29T20:24:02.748118] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-09. [2025-09-29T20:24:03.548116] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-05. [2025-09-29T20:24:04.348123] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-05. [2025-09-29T20:24:04.733503] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-29T20:24:04.745148] [INFO ] [REMOTE ] OKE: Full fetch complete (77486 records). [2025-09-29T20:24:04.745299] [DEBUG] [VALIDATOR ] OKE: Validating primary data. [2025-09-29T20:24:05.201630] [DEBUG] [VALIDATOR ] OKE: All expected trading days are present. [2025-09-29T20:24:05.207283] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-07 (3.25 seconds). [2025-09-29T20:24:05.205860] [DEBUG] [VALIDATOR ] OKE: Primary data validation passed. [2025-09-29T20:24:05.211120] [INFO ] [MAIN ] OKE: Fetched primary data is valid. [2025-09-29T20:24:05.222084] [DEBUG] [LOCAL ] OKE: Saving primary data. [2025-09-29T20:24:05.222946] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-08. [2025-09-29T20:24:05.227730] [DEBUG] [LOCAL ] OKE: Trimmed 77486 records to 53536 (keeping 200 days of data) [2025-09-29T20:24:05.354113] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-29T20:24:05.508291] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-29T20:24:05.640850] [DEBUG] [LOCAL ] OKE: Primary data saved (53536 records). [2025-09-29T20:24:05.641006] [INFO ] [MAIN ] OKE: Full history saved. [2025-09-29T20:24:05.641125] [INFO ] [MAIN ] Update Progress: 1589/2371 symbols completed. OKE took 41.4s. Estimated remaining: 1h 40m 25s. Rate: 7.8 symbols/min [2025-09-29T20:24:05.826024] [INFO ] [MAIN ] OMC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:24:05.882086] [DEBUG] [LOCAL ] OMC: Loaded 54068 existing records from primary storage. [2025-09-29T20:24:05.882462] [INFO ] [MAIN ] OMC: Loaded 54068 existing records. [2025-09-29T20:24:05.954736] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-06. [2025-09-29T20:24:06.083213] [WARN ] [MAIN ] OMC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:24:06.083540] [INFO ] [MAIN ] OMC: Wiping existing primary data before full refresh. [2025-09-29T20:24:06.083611] [INFO ] [LOCAL ] OMC: Starting deletion of primary data. [2025-09-29T20:24:06.084053] [DEBUG] [LOCAL ] OMC: Deleted primary data file. [2025-09-29T20:24:06.084132] [INFO ] [MAIN ] OMC: Starting full primary refresh. [2025-09-29T20:24:06.499844] [INFO ] [REMOTE ] OMC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:24:06.726398] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-29T20:24:06.748067] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-07. [2025-09-29T20:24:07.548121] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-06. [2025-09-29T20:24:07.836598] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-29T20:24:08.104899] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-08 (2.88 seconds). [2025-09-29T20:24:08.348116] [INFO ] [REMOTE ] OMC: Fetching primary data for 2024-12. [2025-09-29T20:24:09.148131] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-09. [2025-09-29T20:24:09.394840] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-29T20:24:09.948081] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-08. [2025-09-29T20:24:10.124301] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-29T20:24:10.235236] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-29T20:24:10.245836] [INFO ] [REMOTE ] OKLO: Full fetch complete (77603 records). [2025-09-29T20:24:10.246104] [DEBUG] [VALIDATOR ] OKLO: Validating primary data. [2025-09-29T20:24:10.247166] [FATAL] [VALIDATOR ] OKLO: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T20:24:10.247289] [FATAL] [MAIN ] OKLO: Fetched primary data is invalid. Refusing to save it. [2025-09-29T20:24:10.247335] [WARN ] [MAIN ] OKLO: Deleting existing primary and derivative data due to validation failure. [2025-09-29T20:24:10.247404] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-09-29T20:24:10.247471] [DEBUG] [LOCAL ] OKLO: No primary data file found to delete. [2025-09-29T20:24:10.247509] [INFO ] [LOCAL ] OKLO: Starting deletion of derivative data. [2025-09-29T20:24:10.247914] [DEBUG] [LOCAL ] OKLO: Deleted derivative data file. [2025-09-29T20:24:10.248019] [INFO ] [MAIN ] Update Progress: 1590/2371 symbols completed. OKLO took 34.8s. Estimated remaining: 1h 40m 16s. Rate: 7.8 symbols/min [2025-09-29T20:24:10.446003] [INFO ] [MAIN ] OMF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:24:10.495185] [DEBUG] [LOCAL ] OMF: Loaded 46898 existing records from primary storage. [2025-09-29T20:24:10.495534] [INFO ] [MAIN ] OMF: Loaded 46898 existing records. [2025-09-29T20:24:10.714712] [WARN ] [MAIN ] OMF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:24:10.715063] [INFO ] [MAIN ] OMF: Wiping existing primary data before full refresh. [2025-09-29T20:24:10.715146] [INFO ] [LOCAL ] OMF: Starting deletion of primary data. [2025-09-29T20:24:10.715432] [DEBUG] [LOCAL ] OMF: Deleted primary data file. [2025-09-29T20:24:10.715492] [INFO ] [MAIN ] OMF: Starting full primary refresh. [2025-09-29T20:24:10.753612] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-01. [2025-09-29T20:24:11.019206] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-29T20:24:11.156288] [INFO ] [REMOTE ] OMF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:24:11.548126] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-07. [2025-09-29T20:24:12.348154] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-09. [2025-09-29T20:24:12.709323] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-29T20:24:13.148080] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-02. [2025-09-29T20:24:13.225988] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-29T20:24:13.229198] [INFO ] [REMOTE ] OLP: Full fetch complete (14154 records). [2025-09-29T20:24:13.229287] [DEBUG] [VALIDATOR ] OLP: Validating primary data. [2025-09-29T20:24:13.621984] [DEBUG] [VALIDATOR ] OLP: All expected trading days are present. [2025-09-29T20:24:13.622150] [DEBUG] [VALIDATOR ] OLP: Primary data validation passed. [2025-09-29T20:24:13.622545] [INFO ] [MAIN ] OLP: Fetched primary data is valid. [2025-09-29T20:24:13.622619] [DEBUG] [LOCAL ] OLP: Saving primary data. [2025-09-29T20:24:13.623531] [DEBUG] [LOCAL ] OLP: Trimmed 14154 records to 9852 (keeping 200 days of data) [2025-09-29T20:24:13.721787] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-29T20:24:13.744835] [DEBUG] [LOCAL ] OLP: Primary data saved (9852 records). [2025-09-29T20:24:13.744990] [INFO ] [MAIN ] OLP: Full history saved. [2025-09-29T20:24:13.745104] [INFO ] [MAIN ] Update Progress: 1591/2371 symbols completed. OLP took 25.5s. Estimated remaining: 1h 40m 6s. Rate: 7.8 symbols/min [2025-09-29T20:24:13.921788] [INFO ] [MAIN ] OMI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:24:13.948142] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-08. [2025-09-29T20:24:13.965229] [DEBUG] [LOCAL ] OMI: Loaded 46583 existing records from primary storage. [2025-09-29T20:24:13.965552] [INFO ] [MAIN ] OMI: Loaded 46583 existing records. [2025-09-29T20:24:14.156599] [WARN ] [MAIN ] OMI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:24:14.156868] [INFO ] [MAIN ] OMI: Wiping existing primary data before full refresh. [2025-09-29T20:24:14.156965] [INFO ] [LOCAL ] OMI: Starting deletion of primary data. [2025-09-29T20:24:14.157248] [DEBUG] [LOCAL ] OMI: Deleted primary data file. [2025-09-29T20:24:14.157308] [INFO ] [MAIN ] OMI: Starting full primary refresh. [2025-09-29T20:24:14.539703] [INFO ] [REMOTE ] OMI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:24:14.724559] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-29T20:24:14.748082] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-03. [2025-09-29T20:24:15.548137] [INFO ] [REMOTE ] OMF: Fetching primary data for 2024-12. [2025-09-29T20:24:15.780617] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-29T20:24:16.348130] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-09. [2025-09-29T20:24:16.871120] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-29T20:24:17.148096] [INFO ] [REMOTE ] OMI: Fetching primary data for 2024-12. [2025-09-29T20:24:17.283480] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-29T20:24:17.948109] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-01. [2025-09-29T20:24:18.194377] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-29T20:24:18.205775] [INFO ] [REMOTE ] OLN: Full fetch complete (74643 records). [2025-09-29T20:24:18.205966] [DEBUG] [VALIDATOR ] OLN: Validating primary data. [2025-09-29T20:24:18.656874] [DEBUG] [VALIDATOR ] OLN: All expected trading days are present. [2025-09-29T20:24:18.657031] [DEBUG] [VALIDATOR ] OLN: Primary data validation passed. [2025-09-29T20:24:18.658399] [INFO ] [MAIN ] OLN: Fetched primary data is valid. [2025-09-29T20:24:18.658596] [DEBUG] [LOCAL ] OLN: Saving primary data. [2025-09-29T20:24:18.682062] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-29T20:24:18.690078] [DEBUG] [LOCAL ] OLN: Trimmed 74643 records to 51761 (keeping 200 days of data) [2025-09-29T20:24:18.755076] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-01. [2025-09-29T20:24:19.042412] [DEBUG] [LOCAL ] OLN: Primary data saved (51761 records). [2025-09-29T20:24:19.042562] [INFO ] [MAIN ] OLN: Full history saved. [2025-09-29T20:24:19.042690] [INFO ] [MAIN ] Update Progress: 1592/2371 symbols completed. OLN took 33.9s. Estimated remaining: 1h 39m 57s. Rate: 7.8 symbols/min [2025-09-29T20:24:19.224051] [INFO ] [MAIN ] ONIT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:24:19.234376] [DEBUG] [LOCAL ] ONIT: Loaded 7871 existing records from primary storage. [2025-09-29T20:24:19.234619] [INFO ] [MAIN ] ONIT: Loaded 7871 existing records. [2025-09-29T20:24:19.427952] [WARN ] [MAIN ] ONIT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:24:19.428503] [INFO ] [MAIN ] ONIT: Wiping existing primary data before full refresh. [2025-09-29T20:24:19.428629] [INFO ] [LOCAL ] ONIT: Starting deletion of primary data. [2025-09-29T20:24:19.429001] [DEBUG] [LOCAL ] ONIT: Deleted primary data file. [2025-09-29T20:24:19.429066] [INFO ] [MAIN ] ONIT: Starting full primary refresh. [2025-09-29T20:24:19.549145] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-04. [2025-09-29T20:24:19.827112] [INFO ] [REMOTE ] ONIT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:24:19.857632] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-29T20:24:20.219932] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-29T20:24:20.348125] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2024-12. [2025-09-29T20:24:20.973454] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-29T20:24:21.148108] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-02. [2025-09-29T20:24:21.411846] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-29T20:24:21.948107] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-05. [2025-09-29T20:24:22.748131] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-02. [2025-09-29T20:24:22.808858] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-29T20:24:23.548161] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-03. [2025-09-29T20:24:23.797329] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-29T20:24:24.107873] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-29T20:24:24.348127] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-01. [2025-09-29T20:24:25.148138] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-03. [2025-09-29T20:24:25.165304] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-29T20:24:25.511286] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-29T20:24:25.948127] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-02. [2025-09-29T20:24:26.748149] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-04. [2025-09-29T20:24:26.796307] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-29T20:24:26.835591] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-29T20:24:27.548145] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-04. [2025-09-29T20:24:28.348149] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-03. [2025-09-29T20:24:28.806778] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-29T20:24:29.148110] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-05. [2025-09-29T20:24:29.195529] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-29T20:24:29.325345] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-29T20:24:29.948160] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-04. [2025-09-29T20:24:30.517450] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-29T20:24:30.748173] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-06. [2025-09-29T20:24:30.986304] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-29T20:24:31.548150] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-05. [2025-09-29T20:24:32.348161] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-05. [2025-09-29T20:24:32.677827] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-29T20:24:32.786842] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-29T20:24:32.899613] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-29T20:24:33.148177] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-06. [2025-09-29T20:24:33.948125] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-06. [2025-09-29T20:24:34.753208] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-06. [2025-09-29T20:24:34.769996] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-29T20:24:35.548131] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-07. [2025-09-29T20:24:35.606982] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-29T20:24:35.664552] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-29T20:24:36.348144] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-07. [2025-09-29T20:24:37.148111] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-07. [2025-09-29T20:24:37.440743] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-29T20:24:37.947100] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-29T20:24:37.955927] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-07. [2025-09-29T20:24:38.559925] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-29T20:24:38.753214] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-08. [2025-09-29T20:24:38.774863] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-29T20:24:39.548120] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-08. [2025-09-29T20:24:40.348106] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-08. [2025-09-29T20:24:40.484280] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-29T20:24:41.148092] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-09. [2025-09-29T20:24:41.177556] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-29T20:24:41.643944] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-29T20:24:41.948104] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-09. [2025-09-29T20:24:42.748133] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-09. [2025-09-29T20:24:42.871991] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-29T20:24:42.882764] [INFO ] [REMOTE ] OMI: Full fetch complete (64168 records). [2025-09-29T20:24:42.882907] [DEBUG] [VALIDATOR ] OMI: Validating primary data. [2025-09-29T20:24:43.283603] [DEBUG] [VALIDATOR ] OMI: All expected trading days are present. [2025-09-29T20:24:43.283727] [DEBUG] [VALIDATOR ] OMI: Primary data validation passed. [2025-09-29T20:24:43.284780] [INFO ] [MAIN ] OMI: Fetched primary data is valid. [2025-09-29T20:24:43.284845] [DEBUG] [LOCAL ] OMI: Saving primary data. [2025-09-29T20:24:43.286203] [DEBUG] [LOCAL ] OMI: Trimmed 64168 records to 45834 (keeping 200 days of data) [2025-09-29T20:24:43.553311] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-08. [2025-09-29T20:24:43.567585] [DEBUG] [LOCAL ] OMI: Primary data saved (45834 records). [2025-09-29T20:24:43.567777] [INFO ] [MAIN ] OMI: Full history saved. [2025-09-29T20:24:43.567920] [INFO ] [MAIN ] Update Progress: 1593/2371 symbols completed. OMI took 29.8s. Estimated remaining: 1h 39m 58s. Rate: 7.8 symbols/min [2025-09-29T20:24:43.763156] [INFO ] [MAIN ] ONL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:24:43.770811] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-29T20:24:43.773552] [INFO ] [REMOTE ] ONIT: Full fetch complete (11147 records). [2025-09-29T20:24:43.773755] [DEBUG] [VALIDATOR ] ONIT: Validating primary data. [2025-09-29T20:24:43.928055] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-29T20:24:43.996516] [INFO ] [REMOTE ] OMC: Full fetch complete (76980 records). [2025-09-29T20:24:44.033423] [DEBUG] [LOCAL ] ONL: Loaded 31806 existing records from primary storage. [2025-09-29T20:24:44.042973] [DEBUG] [VALIDATOR ] OMC: Validating primary data. [2025-09-29T20:24:44.072920] [INFO ] [MAIN ] ONL: Loaded 31806 existing records. [2025-09-29T20:24:44.515002] [DEBUG] [VALIDATOR ] ONIT: All expected trading days are present. [2025-09-29T20:24:44.577973] [DEBUG] [VALIDATOR ] ONIT: Primary data validation passed. [2025-09-29T20:24:44.603777] [INFO ] [MAIN ] ONIT: Fetched primary data is valid. [2025-09-29T20:24:44.682953] [DEBUG] [LOCAL ] ONIT: Saving primary data. [2025-09-29T20:24:44.694947] [WARN ] [MAIN ] ONL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:24:44.695906] [INFO ] [MAIN ] ONL: Wiping existing primary data before full refresh. [2025-09-29T20:24:44.707133] [DEBUG] [LOCAL ] ONIT: Trimmed 11147 records to 7730 (keeping 200 days of data) [2025-09-29T20:24:44.717324] [INFO ] [LOCAL ] ONL: Starting deletion of primary data. [2025-09-29T20:24:44.762690] [DEBUG] [LOCAL ] ONL: Deleted primary data file. [2025-09-29T20:24:44.801222] [INFO ] [MAIN ] ONL: Starting full primary refresh. [2025-09-29T20:24:45.168117] [DEBUG] [VALIDATOR ] OMC: All expected trading days are present. [2025-09-29T20:24:45.168304] [DEBUG] [VALIDATOR ] OMC: Primary data validation passed. [2025-09-29T20:24:45.171517] [INFO ] [MAIN ] OMC: Fetched primary data is valid. [2025-09-29T20:24:45.192988] [DEBUG] [LOCAL ] OMC: Saving primary data. [2025-09-29T20:24:45.173822] [DEBUG] [LOCAL ] ONIT: Primary data saved (7730 records). [2025-09-29T20:24:45.213686] [INFO ] [MAIN ] ONIT: Full history saved. [2025-09-29T20:24:45.254574] [INFO ] [MAIN ] Update Progress: 1594/2371 symbols completed. ONIT took 26.2s. Estimated remaining: 1h 39m 47s. Rate: 7.8 symbols/min [2025-09-29T20:24:45.290530] [DEBUG] [LOCAL ] OMC: Trimmed 76980 records to 53288 (keeping 200 days of data) [2025-09-29T20:24:45.613360] [INFO ] [REMOTE ] ONL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:24:45.635416] [INFO ] [REMOTE ] ONL: Fetching primary data for 2024-12. [2025-09-29T20:24:45.674704] [INFO ] [MAIN ] ONON: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:24:45.710110] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-29T20:24:45.722327] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-09. [2025-09-29T20:24:45.776214] [DEBUG] [LOCAL ] ONON: Loaded 54392 existing records from primary storage. [2025-09-29T20:24:45.782064] [INFO ] [MAIN ] ONON: Loaded 54392 existing records. [2025-09-29T20:24:46.086686] [WARN ] [MAIN ] ONON: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:24:46.087792] [INFO ] [MAIN ] ONON: Wiping existing primary data before full refresh. [2025-09-29T20:24:46.088470] [INFO ] [LOCAL ] ONON: Starting deletion of primary data. [2025-09-29T20:24:46.089094] [DEBUG] [LOCAL ] ONON: Deleted primary data file. [2025-09-29T20:24:46.089426] [INFO ] [MAIN ] ONON: Starting full primary refresh. [2025-09-29T20:24:46.538180] [INFO ] [REMOTE ] ONON: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:24:46.544202] [INFO ] [REMOTE ] ONON: Fetching primary data for 2024-12. [2025-09-29T20:24:46.649175] [DEBUG] [LOCAL ] OMC: Primary data saved (53288 records). [2025-09-29T20:24:46.650097] [INFO ] [MAIN ] OMC: Full history saved. [2025-09-29T20:24:46.650281] [INFO ] [MAIN ] Update Progress: 1595/2371 symbols completed. OMC took 41.0s. Estimated remaining: 1h 39m 36s. Rate: 7.8 symbols/min [2025-09-29T20:24:46.834068] [INFO ] [MAIN ] ONTF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:24:46.855000] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-29T20:24:46.862748] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-01. [2025-09-29T20:24:46.881397] [DEBUG] [LOCAL ] ONTF: Loaded 23187 existing records from primary storage. [2025-09-29T20:24:46.881693] [INFO ] [MAIN ] ONTF: Loaded 23187 existing records. [2025-09-29T20:24:47.072129] [WARN ] [MAIN ] ONTF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:24:47.072361] [INFO ] [MAIN ] ONTF: Wiping existing primary data before full refresh. [2025-09-29T20:24:47.072411] [INFO ] [LOCAL ] ONTF: Starting deletion of primary data. [2025-09-29T20:24:47.072622] [DEBUG] [LOCAL ] ONTF: Deleted primary data file. [2025-09-29T20:24:47.072713] [INFO ] [MAIN ] ONTF: Starting full primary refresh. [2025-09-29T20:24:47.462447] [INFO ] [REMOTE ] ONTF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:24:47.486389] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-29T20:24:47.495847] [INFO ] [REMOTE ] OMF: Full fetch complete (66746 records). [2025-09-29T20:24:47.495977] [DEBUG] [VALIDATOR ] OMF: Validating primary data. [2025-09-29T20:24:47.553190] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2024-12. [2025-09-29T20:24:47.932727] [DEBUG] [VALIDATOR ] OMF: All expected trading days are present. [2025-09-29T20:24:47.932838] [DEBUG] [VALIDATOR ] OMF: Primary data validation passed. [2025-09-29T20:24:47.933960] [INFO ] [MAIN ] OMF: Fetched primary data is valid. [2025-09-29T20:24:47.934109] [DEBUG] [LOCAL ] OMF: Saving primary data. [2025-09-29T20:24:47.935491] [DEBUG] [LOCAL ] OMF: Trimmed 66746 records to 46132 (keeping 200 days of data) [2025-09-29T20:24:48.186241] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-29T20:24:48.259329] [DEBUG] [LOCAL ] OMF: Primary data saved (46132 records). [2025-09-29T20:24:48.259478] [INFO ] [MAIN ] OMF: Full history saved. [2025-09-29T20:24:48.259578] [INFO ] [MAIN ] Update Progress: 1596/2371 symbols completed. OMF took 38.0s. Estimated remaining: 1h 39m 26s. Rate: 7.8 symbols/min [2025-09-29T20:24:48.354877] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-02. [2025-09-29T20:24:48.446545] [INFO ] [MAIN ] ONTO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:24:48.463699] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-29T20:24:48.505423] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-29T20:24:48.551712] [DEBUG] [LOCAL ] ONTO: Loaded 47339 existing records from primary storage. [2025-09-29T20:24:48.552039] [INFO ] [MAIN ] ONTO: Loaded 47339 existing records. [2025-09-29T20:24:48.744218] [WARN ] [MAIN ] ONTO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:24:48.744479] [INFO ] [MAIN ] ONTO: Wiping existing primary data before full refresh. [2025-09-29T20:24:48.744527] [INFO ] [LOCAL ] ONTO: Starting deletion of primary data. [2025-09-29T20:24:48.744800] [DEBUG] [LOCAL ] ONTO: Deleted primary data file. [2025-09-29T20:24:48.744863] [INFO ] [MAIN ] ONTO: Starting full primary refresh. [2025-09-29T20:24:49.145667] [INFO ] [REMOTE ] ONTO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:24:49.148144] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-01. [2025-09-29T20:24:49.430734] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-29T20:24:49.948119] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2024-12. [2025-09-29T20:24:50.263100] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-29T20:24:50.748141] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-03. [2025-09-29T20:24:51.248265] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-29T20:24:51.548134] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-01. [2025-09-29T20:24:52.348098] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-02. [2025-09-29T20:24:52.372444] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-29T20:24:53.148120] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-01. [2025-09-29T20:24:53.420072] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-29T20:24:53.673272] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-29T20:24:53.948158] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-03. [2025-09-29T20:24:54.748093] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-04. [2025-09-29T20:24:54.874383] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-29T20:24:55.215874] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-29T20:24:55.548109] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-02. [2025-09-29T20:24:55.915381] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-29T20:24:56.348155] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-05. [2025-09-29T20:24:57.148084] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-04. [2025-09-29T20:24:57.429881] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-29T20:24:57.882825] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-29T20:24:57.955466] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-06. [2025-09-29T20:24:57.957939] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-29T20:24:58.748147] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-02. [2025-09-29T20:24:59.490296] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-29T20:24:59.548108] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-07. [2025-09-29T20:25:00.348082] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-03. [2025-09-29T20:25:00.470955] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-29T20:25:00.842587] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-29T20:25:01.148176] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-05. [2025-09-29T20:25:01.948143] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-03. [2025-09-29T20:25:02.352731] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-29T20:25:02.748114] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-06. [2025-09-29T20:25:02.786821] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-09-29T20:25:03.548139] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-04. [2025-09-29T20:25:03.757564] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-29T20:25:04.071991] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-29T20:25:04.348174] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-08. [2025-09-29T20:25:05.148153] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-04. [2025-09-29T20:25:05.579162] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-29T20:25:05.693575] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-29T20:25:05.948111] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-09. [2025-09-29T20:25:06.748142] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-07. [2025-09-29T20:25:06.986899] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-29T20:25:07.191696] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-29T20:25:07.197002] [INFO ] [REMOTE ] ONL: Full fetch complete (43354 records). [2025-09-29T20:25:07.197180] [DEBUG] [VALIDATOR ] ONL: Validating primary data. [2025-09-29T20:25:07.553182] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-05. [2025-09-29T20:25:07.624940] [DEBUG] [VALIDATOR ] ONL: All expected trading days are present. [2025-09-29T20:25:07.625130] [DEBUG] [VALIDATOR ] ONL: Primary data validation passed. [2025-09-29T20:25:07.626248] [INFO ] [MAIN ] ONL: Fetched primary data is valid. [2025-09-29T20:25:07.626341] [DEBUG] [LOCAL ] ONL: Saving primary data. [2025-09-29T20:25:07.627803] [DEBUG] [LOCAL ] ONL: Trimmed 43354 records to 30907 (keeping 200 days of data) [2025-09-29T20:25:07.753816] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-29T20:25:07.844926] [DEBUG] [LOCAL ] ONL: Primary data saved (30907 records). [2025-09-29T20:25:07.845118] [INFO ] [MAIN ] ONL: Full history saved. [2025-09-29T20:25:07.845224] [INFO ] [MAIN ] Update Progress: 1597/2371 symbols completed. ONL took 24.3s. Estimated remaining: 1h 39m 24s. Rate: 7.8 symbols/min [2025-09-29T20:25:08.348114] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-08. [2025-09-29T20:25:09.148125] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-05. [2025-09-29T20:25:09.615809] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-29T20:25:09.867912] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-09-29T20:25:09.948140] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-06. [2025-09-29T20:25:10.748114] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-09. [2025-09-29T20:25:10.961841] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-29T20:25:11.548126] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-06. [2025-09-29T20:25:11.880224] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-29T20:25:11.937337] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-29T20:25:11.942972] [INFO ] [REMOTE ] ONTF: Full fetch complete (31559 records). [2025-09-29T20:25:11.943081] [DEBUG] [VALIDATOR ] ONTF: Validating primary data. [2025-09-29T20:25:12.353325] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-07. [2025-09-29T20:25:12.394236] [DEBUG] [VALIDATOR ] ONTF: All expected trading days are present. [2025-09-29T20:25:12.394325] [DEBUG] [VALIDATOR ] ONTF: Primary data validation passed. [2025-09-29T20:25:12.395010] [INFO ] [MAIN ] ONTF: Fetched primary data is valid. [2025-09-29T20:25:12.395080] [DEBUG] [LOCAL ] ONTF: Saving primary data. [2025-09-29T20:25:12.396297] [DEBUG] [LOCAL ] ONTF: Trimmed 31559 records to 22638 (keeping 200 days of data) [2025-09-29T20:25:12.540247] [DEBUG] [LOCAL ] ONTF: Primary data saved (22638 records). [2025-09-29T20:25:12.540603] [INFO ] [MAIN ] ONTF: Full history saved. [2025-09-29T20:25:12.540760] [INFO ] [MAIN ] Update Progress: 1598/2371 symbols completed. ONTF took 25.9s. Estimated remaining: 1h 39m 15s. Rate: 7.8 symbols/min [2025-09-29T20:25:13.350807] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-29T20:25:13.362948] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-07. [2025-09-29T20:25:14.571505] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-29T20:25:14.587800] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-08. [2025-09-29T20:25:15.392610] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-29T20:25:15.403234] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-08. [2025-09-29T20:25:16.839907] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-29T20:25:16.852200] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-09. [2025-09-29T20:25:17.223609] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-29T20:25:17.233960] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-09. [2025-09-29T20:25:18.979293] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-29T20:25:19.016036] [INFO ] [REMOTE ] ONON: Full fetch complete (77565 records). [2025-09-29T20:25:19.016459] [DEBUG] [VALIDATOR ] ONON: Validating primary data. [2025-09-29T20:25:19.018514] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-29T20:25:19.096743] [INFO ] [REMOTE ] ONTO: Full fetch complete (65817 records). [2025-09-29T20:25:19.116975] [DEBUG] [VALIDATOR ] ONTO: Validating primary data. [2025-09-29T20:25:19.907574] [DEBUG] [VALIDATOR ] ONON: All expected trading days are present. [2025-09-29T20:25:19.924188] [DEBUG] [VALIDATOR ] ONON: Primary data validation passed. [2025-09-29T20:25:19.925700] [DEBUG] [VALIDATOR ] ONTO: All expected trading days are present. [2025-09-29T20:25:19.925604] [INFO ] [MAIN ] ONON: Fetched primary data is valid. [2025-09-29T20:25:19.925804] [DEBUG] [VALIDATOR ] ONTO: Primary data validation passed. [2025-09-29T20:25:19.925952] [DEBUG] [LOCAL ] ONON: Saving primary data. [2025-09-29T20:25:19.927008] [INFO ] [MAIN ] ONTO: Fetched primary data is valid. [2025-09-29T20:25:19.927405] [DEBUG] [LOCAL ] ONTO: Saving primary data. [2025-09-29T20:25:19.929196] [DEBUG] [LOCAL ] ONON: Trimmed 77565 records to 53612 (keeping 200 days of data) [2025-09-29T20:25:19.929819] [DEBUG] [LOCAL ] ONTO: Trimmed 65817 records to 46628 (keeping 200 days of data) [2025-09-29T20:25:20.550964] [DEBUG] [LOCAL ] ONTO: Primary data saved (46628 records). [2025-09-29T20:25:20.551799] [INFO ] [MAIN ] ONTO: Full history saved. [2025-09-29T20:25:20.552207] [INFO ] [MAIN ] Update Progress: 1599/2371 symbols completed. ONTO took 32.3s. Estimated remaining: 1h 39m 7s. Rate: 7.8 symbols/min [2025-09-29T20:25:20.554002] [DEBUG] [LOCAL ] ONON: Primary data saved (53612 records). [2025-09-29T20:25:20.554101] [INFO ] [MAIN ] ONON: Full history saved. [2025-09-29T20:25:20.554211] [INFO ] [MAIN ] Update Progress: 1600/2371 symbols completed. ONON took 35.3s. Estimated remaining: 1h 38m 56s. Rate: 7.8 symbols/min [2025-09-29T20:25:21.226180] [INFO ] [MAIN ] OPFI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:25:21.342263] [INFO ] [MAIN ] OPP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:25:21.347599] [INFO ] [MAIN ] OOMA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:25:21.344678] [INFO ] [MAIN ] OPAD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:25:21.376215] [DEBUG] [LOCAL ] OPP: Loaded 11678 existing records from primary storage. [2025-09-29T20:25:21.376885] [INFO ] [MAIN ] OPP: Loaded 11678 existing records. [2025-09-29T20:25:21.441833] [DEBUG] [LOCAL ] OOMA: Loaded 19260 existing records from primary storage. [2025-09-29T20:25:21.448590] [INFO ] [MAIN ] OOMA: Loaded 19260 existing records. [2025-09-29T20:25:21.487511] [DEBUG] [LOCAL ] OPAD: Loaded 20793 existing records from primary storage. [2025-09-29T20:25:21.521093] [INFO ] [MAIN ] OPAD: Loaded 20793 existing records. [2025-09-29T20:25:21.615126] [DEBUG] [LOCAL ] OPFI: Loaded 47258 existing records from primary storage. [2025-09-29T20:25:21.693284] [INFO ] [MAIN ] OPFI: Loaded 47258 existing records. [2025-09-29T20:25:21.872078] [WARN ] [MAIN ] OPP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:25:21.927434] [INFO ] [MAIN ] OPP: Wiping existing primary data before full refresh. [2025-09-29T20:25:21.963601] [INFO ] [LOCAL ] OPP: Starting deletion of primary data. [2025-09-29T20:25:22.103868] [WARN ] [MAIN ] OOMA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:25:22.115328] [DEBUG] [LOCAL ] OPP: Deleted primary data file. [2025-09-29T20:25:22.162165] [INFO ] [MAIN ] OPP: Starting full primary refresh. [2025-09-29T20:25:22.177961] [INFO ] [MAIN ] OOMA: Wiping existing primary data before full refresh. [2025-09-29T20:25:22.244618] [INFO ] [LOCAL ] OOMA: Starting deletion of primary data. [2025-09-29T20:25:22.309922] [DEBUG] [LOCAL ] OOMA: Deleted primary data file. [2025-09-29T20:25:22.394955] [WARN ] [MAIN ] OPAD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:25:22.385847] [INFO ] [MAIN ] OOMA: Starting full primary refresh. [2025-09-29T20:25:22.412075] [INFO ] [MAIN ] OPAD: Wiping existing primary data before full refresh. [2025-09-29T20:25:22.479743] [WARN ] [MAIN ] OPFI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:25:22.494470] [INFO ] [LOCAL ] OPAD: Starting deletion of primary data. [2025-09-29T20:25:22.521221] [INFO ] [MAIN ] OPFI: Wiping existing primary data before full refresh. [2025-09-29T20:25:22.562842] [DEBUG] [LOCAL ] OPAD: Deleted primary data file. [2025-09-29T20:25:22.607367] [INFO ] [LOCAL ] OPFI: Starting deletion of primary data. [2025-09-29T20:25:22.637184] [INFO ] [MAIN ] OPAD: Starting full primary refresh. [2025-09-29T20:25:22.665571] [DEBUG] [LOCAL ] OPFI: Deleted primary data file. [2025-09-29T20:25:22.791848] [INFO ] [MAIN ] OPFI: Starting full primary refresh. [2025-09-29T20:25:23.374304] [INFO ] [REMOTE ] OPP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:25:23.422030] [INFO ] [REMOTE ] OPP: Fetching primary data for 2024-12. [2025-09-29T20:25:23.500058] [INFO ] [REMOTE ] OOMA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:25:23.589244] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2024-12. [2025-09-29T20:25:23.979745] [INFO ] [REMOTE ] OPFI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:25:24.002129] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2024-12. [2025-09-29T20:25:24.001786] [INFO ] [REMOTE ] OPAD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:25:24.003761] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2024-12. [2025-09-29T20:25:24.771217] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-29T20:25:24.776086] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-01. [2025-09-29T20:25:24.832042] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-29T20:25:24.834571] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-01. [2025-09-29T20:25:24.931488] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-29T20:25:24.936185] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-01. [2025-09-29T20:25:25.535159] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-29T20:25:25.537196] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-02. [2025-09-29T20:25:25.549436] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-29T20:25:25.576083] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-02. [2025-09-29T20:25:25.577945] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-29T20:25:25.587826] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-01. [2025-09-29T20:25:25.707215] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-29T20:25:25.712773] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-02. [2025-09-29T20:25:26.244846] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-29T20:25:26.247084] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-03. [2025-09-29T20:25:26.511708] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-29T20:25:26.748116] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-03. [2025-09-29T20:25:26.834730] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-29T20:25:26.946097] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-29T20:25:27.548111] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-04. [2025-09-29T20:25:27.614563] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-29T20:25:27.649129] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-29T20:25:28.348148] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-03. [2025-09-29T20:25:28.370022] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-29T20:25:29.148136] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-02. [2025-09-29T20:25:29.394557] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-29T20:25:29.948132] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-04. [2025-09-29T20:25:30.748116] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-04. [2025-09-29T20:25:31.185495] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-29T20:25:31.218614] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-29T20:25:31.548116] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-03. [2025-09-29T20:25:31.764678] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-29T20:25:32.348151] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-05. [2025-09-29T20:25:33.148110] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-05. [2025-09-29T20:25:33.439349] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-29T20:25:33.948099] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-04. [2025-09-29T20:25:34.556890] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-29T20:25:34.748184] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-05. [2025-09-29T20:25:35.021617] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-29T20:25:35.548108] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-06. [2025-09-29T20:25:35.676223] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-29T20:25:35.787733] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-29T20:25:36.348144] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-06. [2025-09-29T20:25:36.554618] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-29T20:25:36.935134] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-29T20:25:37.148131] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-05. [2025-09-29T20:25:37.948117] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-07. [2025-09-29T20:25:38.748163] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-07. [2025-09-29T20:25:38.979621] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-29T20:25:39.018245] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-29T20:25:39.548121] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-06. [2025-09-29T20:25:39.974582] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-29T20:25:40.348115] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-08. [2025-09-29T20:25:41.148095] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-08. [2025-09-29T20:25:41.327225] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-29T20:25:41.569317] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-29T20:25:41.948081] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-09. [2025-09-29T20:25:42.097728] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-29T20:25:42.700932] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-29T20:25:42.705335] [INFO ] [REMOTE ] OOMA: Full fetch complete (26000 records). [2025-09-29T20:25:42.705454] [DEBUG] [VALIDATOR ] OOMA: Validating primary data. [2025-09-29T20:25:42.753285] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-06. [2025-09-29T20:25:43.119430] [DEBUG] [VALIDATOR ] OOMA: All expected trading days are present. [2025-09-29T20:25:43.119536] [DEBUG] [VALIDATOR ] OOMA: Primary data validation passed. [2025-09-29T20:25:43.120192] [INFO ] [MAIN ] OOMA: Fetched primary data is valid. [2025-09-29T20:25:43.120271] [DEBUG] [LOCAL ] OOMA: Saving primary data. [2025-09-29T20:25:43.121040] [DEBUG] [LOCAL ] OOMA: Trimmed 26000 records to 18881 (keeping 200 days of data) [2025-09-29T20:25:43.248153] [DEBUG] [LOCAL ] OOMA: Primary data saved (18881 records). [2025-09-29T20:25:43.248589] [INFO ] [MAIN ] OOMA: Full history saved. [2025-09-29T20:25:43.248972] [INFO ] [MAIN ] Update Progress: 1601/2371 symbols completed. OOMA took 22.7s. Estimated remaining: 1h 38m 55s. Rate: 7.8 symbols/min [2025-09-29T20:25:43.434086] [INFO ] [MAIN ] OPY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:25:43.434266] [DEBUG] [LOCAL ] OPY: No existing data file found in primary storage. [2025-09-29T20:25:43.434321] [WARN ] [MAIN ] OPY: No existing data found, performing full refresh instead. [2025-09-29T20:25:43.434446] [INFO ] [MAIN ] OPY: Wiping existing primary data before full refresh. [2025-09-29T20:25:43.434498] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-09-29T20:25:43.434565] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-09-29T20:25:43.434601] [INFO ] [MAIN ] OPY: Starting full primary refresh. [2025-09-29T20:25:43.553093] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-07. [2025-09-29T20:25:43.688418] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-29T20:25:43.821533] [INFO ] [REMOTE ] OPY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:25:44.348122] [INFO ] [REMOTE ] OPY: Fetching primary data for 2024-12. [2025-09-29T20:25:44.836858] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-29T20:25:45.148113] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-01. [2025-09-29T20:25:45.552460] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-29T20:25:45.757923] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-29T20:25:45.948113] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-08. [2025-09-29T20:25:46.748119] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-07. [2025-09-29T20:25:47.548118] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-09. [2025-09-29T20:25:47.726518] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-29T20:25:47.840138] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-29T20:25:48.348130] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-08. [2025-09-29T20:25:48.897988] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-29T20:25:48.900788] [INFO ] [REMOTE ] OPP: Full fetch complete (17489 records). [2025-09-29T20:25:48.900886] [DEBUG] [VALIDATOR ] OPP: Validating primary data. [2025-09-29T20:25:49.159276] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-02. [2025-09-29T20:25:49.287941] [DEBUG] [VALIDATOR ] OPP: All expected trading days are present. [2025-09-29T20:25:49.288021] [DEBUG] [VALIDATOR ] OPP: Primary data validation passed. [2025-09-29T20:25:49.288444] [INFO ] [MAIN ] OPP: Fetched primary data is valid. [2025-09-29T20:25:49.288492] [DEBUG] [LOCAL ] OPP: Saving primary data. [2025-09-29T20:25:49.289112] [DEBUG] [LOCAL ] OPP: Trimmed 17489 records to 11581 (keeping 200 days of data) [2025-09-29T20:25:49.363061] [DEBUG] [LOCAL ] OPP: Primary data saved (11581 records). [2025-09-29T20:25:49.363207] [INFO ] [MAIN ] OPP: Full history saved. [2025-09-29T20:25:49.363327] [INFO ] [MAIN ] Update Progress: 1602/2371 symbols completed. OPP took 28.8s. Estimated remaining: 1h 38m 47s. Rate: 7.8 symbols/min [2025-09-29T20:25:49.546663] [INFO ] [MAIN ] OR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:25:49.593998] [DEBUG] [LOCAL ] OR: Loaded 46786 existing records from primary storage. [2025-09-29T20:25:49.594355] [INFO ] [MAIN ] OR: Loaded 46786 existing records. [2025-09-29T20:25:49.765415] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-29T20:25:49.792369] [WARN ] [MAIN ] OR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:25:49.793504] [INFO ] [MAIN ] OR: Wiping existing primary data before full refresh. [2025-09-29T20:25:49.793556] [INFO ] [LOCAL ] OR: Starting deletion of primary data. [2025-09-29T20:25:49.793933] [DEBUG] [LOCAL ] OR: Deleted primary data file. [2025-09-29T20:25:49.793995] [INFO ] [MAIN ] OR: Starting full primary refresh. [2025-09-29T20:25:49.949594] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-03. [2025-09-29T20:25:50.195125] [INFO ] [REMOTE ] OR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:25:50.358491] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-29T20:25:50.589109] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-29T20:25:50.748159] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-09. [2025-09-29T20:25:51.548163] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-04. [2025-09-29T20:25:52.157526] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-29T20:25:52.348123] [INFO ] [REMOTE ] OR: Fetching primary data for 2024-12. [2025-09-29T20:25:52.984933] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-09-29T20:25:52.996422] [INFO ] [REMOTE ] OPAD: Full fetch complete (24167 records). [2025-09-29T20:25:52.996559] [DEBUG] [VALIDATOR ] OPAD: Validating primary data. [2025-09-29T20:25:53.153175] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-05. [2025-09-29T20:25:53.393079] [DEBUG] [VALIDATOR ] OPAD: All expected trading days are present. [2025-09-29T20:25:53.393161] [DEBUG] [VALIDATOR ] OPAD: Primary data validation passed. [2025-09-29T20:25:53.393765] [INFO ] [MAIN ] OPAD: Fetched primary data is valid. [2025-09-29T20:25:53.393831] [DEBUG] [LOCAL ] OPAD: Saving primary data. [2025-09-29T20:25:53.394549] [DEBUG] [LOCAL ] OPAD: Trimmed 24167 records to 21052 (keeping 200 days of data) [2025-09-29T20:25:53.522715] [DEBUG] [LOCAL ] OPAD: Primary data saved (21052 records). [2025-09-29T20:25:53.522854] [INFO ] [MAIN ] OPAD: Full history saved. [2025-09-29T20:25:53.522967] [INFO ] [MAIN ] Update Progress: 1603/2371 symbols completed. OPAD took 33.0s. Estimated remaining: 1h 38m 37s. Rate: 7.8 symbols/min [2025-09-29T20:25:53.755148] [INFO ] [MAIN ] ORA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:25:53.804151] [DEBUG] [LOCAL ] ORA: Loaded 33001 existing records from primary storage. [2025-09-29T20:25:53.804690] [INFO ] [MAIN ] ORA: Loaded 33001 existing records. [2025-09-29T20:25:53.921857] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-29T20:25:53.950963] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-09. [2025-09-29T20:25:54.021448] [WARN ] [MAIN ] ORA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:25:54.021887] [INFO ] [MAIN ] ORA: Wiping existing primary data before full refresh. [2025-09-29T20:25:54.022010] [INFO ] [LOCAL ] ORA: Starting deletion of primary data. [2025-09-29T20:25:54.030788] [DEBUG] [LOCAL ] ORA: Deleted primary data file. [2025-09-29T20:25:54.036938] [INFO ] [MAIN ] ORA: Starting full primary refresh. [2025-09-29T20:25:54.119564] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-29T20:25:54.431631] [INFO ] [REMOTE ] ORA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:25:54.748119] [INFO ] [REMOTE ] ORA: Fetching primary data for 2024-12. [2025-09-29T20:25:55.548101] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-01. [2025-09-29T20:25:55.729086] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-29T20:25:55.739386] [INFO ] [REMOTE ] OPFI: Full fetch complete (67701 records). [2025-09-29T20:25:55.739527] [DEBUG] [VALIDATOR ] OPFI: Validating primary data. [2025-09-29T20:25:56.150164] [DEBUG] [VALIDATOR ] OPFI: All expected trading days are present. [2025-09-29T20:25:56.150254] [DEBUG] [VALIDATOR ] OPFI: Primary data validation passed. [2025-09-29T20:25:56.151277] [INFO ] [MAIN ] OPFI: Fetched primary data is valid. [2025-09-29T20:25:56.151342] [DEBUG] [LOCAL ] OPFI: Saving primary data. [2025-09-29T20:25:56.152831] [DEBUG] [LOCAL ] OPFI: Trimmed 67701 records to 46507 (keeping 200 days of data) [2025-09-29T20:25:56.368141] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-06. [2025-09-29T20:25:56.424771] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-29T20:25:56.485679] [DEBUG] [LOCAL ] OPFI: Primary data saved (46507 records). [2025-09-29T20:25:56.485844] [INFO ] [MAIN ] OPFI: Full history saved. [2025-09-29T20:25:56.485954] [INFO ] [MAIN ] Update Progress: 1604/2371 symbols completed. OPFI took 35.9s. Estimated remaining: 1h 38m 27s. Rate: 7.8 symbols/min [2025-09-29T20:25:56.665319] [INFO ] [MAIN ] ORC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:25:56.728053] [DEBUG] [LOCAL ] ORC: Loaded 53083 existing records from primary storage. [2025-09-29T20:25:56.728425] [INFO ] [MAIN ] ORC: Loaded 53083 existing records. [2025-09-29T20:25:56.924788] [WARN ] [MAIN ] ORC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:25:56.939199] [INFO ] [MAIN ] ORC: Wiping existing primary data before full refresh. [2025-09-29T20:25:56.951678] [INFO ] [LOCAL ] ORC: Starting deletion of primary data. [2025-09-29T20:25:56.956401] [DEBUG] [LOCAL ] ORC: Deleted primary data file. [2025-09-29T20:25:56.957404] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-29T20:25:56.957700] [INFO ] [MAIN ] ORC: Starting full primary refresh. [2025-09-29T20:25:56.964106] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-29T20:25:57.151631] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-07. [2025-09-29T20:25:57.342286] [INFO ] [REMOTE ] ORC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:25:57.887595] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-29T20:25:57.948177] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-01. [2025-09-29T20:25:58.748203] [INFO ] [REMOTE ] ORC: Fetching primary data for 2024-12. [2025-09-29T20:25:59.548116] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-02. [2025-09-29T20:25:59.589914] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-29T20:26:00.348177] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-02. [2025-09-29T20:26:00.815954] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-29T20:26:01.148133] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-01. [2025-09-29T20:26:01.185961] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-29T20:26:01.932465] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-29T20:26:01.948075] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-03. [2025-09-29T20:26:02.748078] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-08. [2025-09-29T20:26:03.251105] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-29T20:26:03.283063] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-29T20:26:03.534435] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-29T20:26:03.548066] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-04. [2025-09-29T20:26:04.348123] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-02. [2025-09-29T20:26:05.148114] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-03. [2025-09-29T20:26:05.276343] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-29T20:26:05.948097] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-05. [2025-09-29T20:26:06.245138] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-29T20:26:06.459637] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-29T20:26:06.748130] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-04. [2025-09-29T20:26:07.392015] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-29T20:26:07.548111] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-06. [2025-09-29T20:26:08.348133] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-09. [2025-09-29T20:26:08.506183] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-29T20:26:08.528702] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-09 (0.18 seconds). [2025-09-29T20:26:08.531615] [INFO ] [REMOTE ] OPY: Full fetch complete (9973 records). [2025-09-29T20:26:08.531740] [DEBUG] [VALIDATOR ] OPY: Validating primary data. [2025-09-29T20:26:08.532284] [FATAL] [VALIDATOR ] OPY: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T20:26:08.532371] [FATAL] [MAIN ] OPY: Fetched primary data is invalid. Refusing to save it. [2025-09-29T20:26:08.532420] [WARN ] [MAIN ] OPY: Deleting existing primary and derivative data due to validation failure. [2025-09-29T20:26:08.532473] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-09-29T20:26:08.532574] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-09-29T20:26:08.532634] [INFO ] [LOCAL ] OPY: Starting deletion of derivative data. [2025-09-29T20:26:08.532725] [DEBUG] [LOCAL ] OPY: No derivative data file found to delete. [2025-09-29T20:26:08.532791] [INFO ] [MAIN ] Update Progress: 1605/2371 symbols completed. OPY took 25.3s. Estimated remaining: 1h 38m 22s. Rate: 7.8 symbols/min [2025-09-29T20:26:08.725159] [INFO ] [MAIN ] ORCL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:26:08.725361] [DEBUG] [LOCAL ] ORCL: No existing data file found in primary storage. [2025-09-29T20:26:08.725417] [WARN ] [MAIN ] ORCL: No existing data found, performing full refresh instead. [2025-09-29T20:26:08.725532] [INFO ] [MAIN ] ORCL: Wiping existing primary data before full refresh. [2025-09-29T20:26:08.725575] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-09-29T20:26:08.725624] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-09-29T20:26:08.725693] [INFO ] [MAIN ] ORCL: Starting full primary refresh. [2025-09-29T20:26:09.130238] [INFO ] [REMOTE ] ORCL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:26:09.150545] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-05. [2025-09-29T20:26:09.153784] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-29T20:26:09.948106] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-07. [2025-09-29T20:26:10.748123] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-03. [2025-09-29T20:26:10.919247] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-29T20:26:11.505300] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-29T20:26:11.548080] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-08. [2025-09-29T20:26:12.348113] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2024-12. [2025-09-29T20:26:12.775548] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-29T20:26:13.050764] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-29T20:26:13.148101] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-09. [2025-09-29T20:26:13.544200] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-29T20:26:13.948130] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-04. [2025-09-29T20:26:14.708857] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-29T20:26:14.715871] [INFO ] [REMOTE ] ORA: Full fetch complete (49265 records). [2025-09-29T20:26:14.715993] [DEBUG] [VALIDATOR ] ORA: Validating primary data. [2025-09-29T20:26:14.753202] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-01. [2025-09-29T20:26:15.122250] [DEBUG] [VALIDATOR ] ORA: All expected trading days are present. [2025-09-29T20:26:15.122338] [DEBUG] [VALIDATOR ] ORA: Primary data validation passed. [2025-09-29T20:26:15.123205] [INFO ] [MAIN ] ORA: Fetched primary data is valid. [2025-09-29T20:26:15.123271] [DEBUG] [LOCAL ] ORA: Saving primary data. [2025-09-29T20:26:15.124385] [DEBUG] [LOCAL ] ORA: Trimmed 49265 records to 32437 (keeping 200 days of data) [2025-09-29T20:26:15.349205] [DEBUG] [LOCAL ] ORA: Primary data saved (32437 records). [2025-09-29T20:26:15.349373] [INFO ] [MAIN ] ORA: Full history saved. [2025-09-29T20:26:15.349471] [INFO ] [MAIN ] Update Progress: 1606/2371 symbols completed. ORA took 21.8s. Estimated remaining: 1h 38m 13s. Rate: 7.8 symbols/min [2025-09-29T20:26:15.535479] [INFO ] [MAIN ] ORI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:26:15.535735] [DEBUG] [LOCAL ] ORI: No existing data file found in primary storage. [2025-09-29T20:26:15.535794] [WARN ] [MAIN ] ORI: No existing data found, performing full refresh instead. [2025-09-29T20:26:15.535977] [INFO ] [MAIN ] ORI: Wiping existing primary data before full refresh. [2025-09-29T20:26:15.536037] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-09-29T20:26:15.536085] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-09-29T20:26:15.536240] [INFO ] [MAIN ] ORI: Starting full primary refresh. [2025-09-29T20:26:15.560746] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-06. [2025-09-29T20:26:15.957496] [INFO ] [REMOTE ] ORI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:26:15.992608] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-29T20:26:16.277411] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-29T20:26:16.348116] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-05. [2025-09-29T20:26:17.148078] [INFO ] [REMOTE ] ORI: Fetching primary data for 2024-12. [2025-09-29T20:26:17.320113] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-29T20:26:17.948129] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-07. [2025-09-29T20:26:18.148623] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-29T20:26:18.606856] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-29T20:26:18.748114] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-06. [2025-09-29T20:26:19.548170] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-02. [2025-09-29T20:26:19.632944] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-29T20:26:20.348124] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-08. [2025-09-29T20:26:20.663517] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-29T20:26:20.850118] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-29T20:26:21.148121] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-03. [2025-09-29T20:26:21.772902] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-29T20:26:21.948112] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-04. [2025-09-29T20:26:22.091057] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-29T20:26:22.748136] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-07. [2025-09-29T20:26:22.917034] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-29T20:26:23.548134] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-05. [2025-09-29T20:26:24.348145] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-01. [2025-09-29T20:26:24.400740] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-29T20:26:24.826264] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-29T20:26:24.879550] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-29T20:26:25.148149] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-08. [2025-09-29T20:26:25.948103] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-02. [2025-09-29T20:26:26.748114] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-06. [2025-09-29T20:26:26.927819] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-29T20:26:27.321864] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-29T20:26:27.436178] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-29T20:26:27.548164] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-07. [2025-09-29T20:26:28.348178] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-09. [2025-09-29T20:26:28.594719] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-29T20:26:29.148154] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-09. [2025-09-29T20:26:29.933093] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-29T20:26:29.943905] [INFO ] [REMOTE ] OR: Full fetch complete (65251 records). [2025-09-29T20:26:29.944087] [DEBUG] [VALIDATOR ] OR: Validating primary data. [2025-09-29T20:26:29.956559] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-08. [2025-09-29T20:26:30.376298] [DEBUG] [VALIDATOR ] OR: All expected trading days are present. [2025-09-29T20:26:30.376419] [DEBUG] [VALIDATOR ] OR: Primary data validation passed. [2025-09-29T20:26:30.377551] [INFO ] [MAIN ] OR: Fetched primary data is valid. [2025-09-29T20:26:30.377618] [DEBUG] [LOCAL ] OR: Saving primary data. [2025-09-29T20:26:30.380140] [DEBUG] [LOCAL ] OR: Trimmed 65251 records to 46068 (keeping 200 days of data) [2025-09-29T20:26:30.687875] [DEBUG] [LOCAL ] OR: Primary data saved (46068 records). [2025-09-29T20:26:30.688030] [INFO ] [MAIN ] OR: Full history saved. [2025-09-29T20:26:30.688136] [INFO ] [MAIN ] Update Progress: 1607/2371 symbols completed. OR took 41.3s. Estimated remaining: 1h 38m 9s. Rate: 7.8 symbols/min [2025-09-29T20:26:30.748434] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-03. [2025-09-29T20:26:30.885913] [INFO ] [MAIN ] ORN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:26:30.923830] [DEBUG] [LOCAL ] ORN: Loaded 31979 existing records from primary storage. [2025-09-29T20:26:30.924209] [INFO ] [MAIN ] ORN: Loaded 31979 existing records. [2025-09-29T20:26:31.116885] [WARN ] [MAIN ] ORN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:26:31.117494] [INFO ] [MAIN ] ORN: Wiping existing primary data before full refresh. [2025-09-29T20:26:31.117556] [INFO ] [LOCAL ] ORN: Starting deletion of primary data. [2025-09-29T20:26:31.129167] [DEBUG] [LOCAL ] ORN: Deleted primary data file. [2025-09-29T20:26:31.148188] [INFO ] [MAIN ] ORN: Starting full primary refresh. [2025-09-29T20:26:31.171727] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-29T20:26:31.548458] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-09. [2025-09-29T20:26:31.556816] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-09-29T20:26:31.657335] [INFO ] [REMOTE ] ORN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:26:31.680863] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-29T20:26:31.679125] [INFO ] [REMOTE ] ORC: Full fetch complete (75293 records). [2025-09-29T20:26:31.691625] [DEBUG] [VALIDATOR ] ORC: Validating primary data. [2025-09-29T20:26:32.140692] [DEBUG] [VALIDATOR ] ORC: All expected trading days are present. [2025-09-29T20:26:32.140893] [DEBUG] [VALIDATOR ] ORC: Primary data validation passed. [2025-09-29T20:26:32.142243] [INFO ] [MAIN ] ORC: Fetched primary data is valid. [2025-09-29T20:26:32.142365] [DEBUG] [LOCAL ] ORC: Saving primary data. [2025-09-29T20:26:32.143977] [DEBUG] [LOCAL ] ORC: Trimmed 75293 records to 52330 (keeping 200 days of data) [2025-09-29T20:26:32.359357] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-04. [2025-09-29T20:26:32.497599] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-29T20:26:32.512786] [INFO ] [REMOTE ] ORCL: Full fetch complete (77142 records). [2025-09-29T20:26:32.514124] [DEBUG] [VALIDATOR ] ORCL: Validating primary data. [2025-09-29T20:26:32.515851] [FATAL] [VALIDATOR ] ORCL: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T20:26:32.518785] [FATAL] [MAIN ] ORCL: Fetched primary data is invalid. Refusing to save it. [2025-09-29T20:26:32.522569] [WARN ] [MAIN ] ORCL: Deleting existing primary and derivative data due to validation failure. [2025-09-29T20:26:32.522950] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-09-29T20:26:32.523390] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-09-29T20:26:32.523831] [INFO ] [LOCAL ] ORCL: Starting deletion of derivative data. [2025-09-29T20:26:32.524544] [DEBUG] [LOCAL ] ORCL: No derivative data file found to delete. [2025-09-29T20:26:32.525304] [INFO ] [MAIN ] Update Progress: 1608/2371 symbols completed. ORCL took 24.0s. Estimated remaining: 1h 37m 59s. Rate: 7.8 symbols/min [2025-09-29T20:26:32.527901] [DEBUG] [LOCAL ] ORC: Primary data saved (52330 records). [2025-09-29T20:26:32.528153] [INFO ] [MAIN ] ORC: Full history saved. [2025-09-29T20:26:32.556735] [INFO ] [MAIN ] Update Progress: 1609/2371 symbols completed. ORC took 36.1s. Estimated remaining: 1h 37m 48s. Rate: 7.8 symbols/min [2025-09-29T20:26:32.907632] [INFO ] [MAIN ] OSCR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:26:32.911159] [INFO ] [MAIN ] OSK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:26:32.911594] [DEBUG] [LOCAL ] OSK: No existing data file found in primary storage. [2025-09-29T20:26:32.911668] [WARN ] [MAIN ] OSK: No existing data found, performing full refresh instead. [2025-09-29T20:26:32.911786] [INFO ] [MAIN ] OSK: Wiping existing primary data before full refresh. [2025-09-29T20:26:32.911865] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-09-29T20:26:32.911931] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-09-29T20:26:32.911967] [INFO ] [MAIN ] OSK: Starting full primary refresh. [2025-09-29T20:26:33.158069] [INFO ] [REMOTE ] ORN: Fetching primary data for 2024-12. [2025-09-29T20:26:33.344814] [INFO ] [REMOTE ] OSK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:26:33.347221] [DEBUG] [LOCAL ] OSCR: Loaded 54502 existing records from primary storage. [2025-09-29T20:26:33.348050] [INFO ] [MAIN ] OSCR: Loaded 54502 existing records. [2025-09-29T20:26:33.577384] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-29T20:26:33.581359] [WARN ] [MAIN ] OSCR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:26:33.592556] [INFO ] [MAIN ] OSCR: Wiping existing primary data before full refresh. [2025-09-29T20:26:33.592830] [INFO ] [LOCAL ] OSCR: Starting deletion of primary data. [2025-09-29T20:26:33.593460] [DEBUG] [LOCAL ] OSCR: Deleted primary data file. [2025-09-29T20:26:33.593550] [INFO ] [MAIN ] OSCR: Starting full primary refresh. [2025-09-29T20:26:33.949616] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-05. [2025-09-29T20:26:33.974195] [INFO ] [REMOTE ] OSCR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:26:34.544358] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-29T20:26:34.748106] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2024-12. [2025-09-29T20:26:34.855794] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-29T20:26:35.548157] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-01. [2025-09-29T20:26:36.348107] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-06. [2025-09-29T20:26:36.697344] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-29T20:26:36.734712] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-29T20:26:37.148126] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-02. [2025-09-29T20:26:37.223342] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-29T20:26:37.948110] [INFO ] [REMOTE ] OSK: Fetching primary data for 2024-12. [2025-09-29T20:26:38.228922] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-29T20:26:38.733624] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-29T20:26:38.748057] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-01. [2025-09-29T20:26:39.548091] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-03. [2025-09-29T20:26:39.616231] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-29T20:26:40.348127] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-02. [2025-09-29T20:26:40.726204] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-29T20:26:41.148159] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-01. [2025-09-29T20:26:41.324914] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-29T20:26:41.948111] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-04. [2025-09-29T20:26:42.748172] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-03. [2025-09-29T20:26:43.010709] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-29T20:26:43.072639] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-29T20:26:43.548124] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-07. [2025-09-29T20:26:43.713266] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-29T20:26:44.348151] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-02. [2025-09-29T20:26:44.588553] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-29T20:26:45.148163] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-08. [2025-09-29T20:26:45.948099] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-05. [2025-09-29T20:26:45.991152] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-29T20:26:46.420401] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-29T20:26:46.748120] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-04. [2025-09-29T20:26:47.282827] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-29T20:26:47.339926] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-29T20:26:47.548109] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-06. [2025-09-29T20:26:48.348114] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-03. [2025-09-29T20:26:48.789625] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-29T20:26:49.148153] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-07. [2025-09-29T20:26:49.948112] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-09. [2025-09-29T20:26:50.689519] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-09-29T20:26:50.748693] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-04. [2025-09-29T20:26:50.757297] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-29T20:26:50.912937] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-29T20:26:50.925943] [INFO ] [REMOTE ] ORI: Full fetch complete (69864 records). [2025-09-29T20:26:50.926170] [DEBUG] [VALIDATOR ] ORI: Validating primary data. [2025-09-29T20:26:50.927349] [FATAL] [VALIDATOR ] ORI: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T20:26:50.927508] [FATAL] [MAIN ] ORI: Fetched primary data is invalid. Refusing to save it. [2025-09-29T20:26:50.927585] [WARN ] [MAIN ] ORI: Deleting existing primary and derivative data due to validation failure. [2025-09-29T20:26:50.927736] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-09-29T20:26:50.927845] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-09-29T20:26:50.927904] [INFO ] [LOCAL ] ORI: Starting deletion of derivative data. [2025-09-29T20:26:50.927951] [DEBUG] [LOCAL ] ORI: No derivative data file found to delete. [2025-09-29T20:26:50.928079] [INFO ] [MAIN ] Update Progress: 1610/2371 symbols completed. ORI took 35.6s. Estimated remaining: 1h 37m 45s. Rate: 7.8 symbols/min [2025-09-29T20:26:51.178127] [INFO ] [MAIN ] OTF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:26:51.178322] [DEBUG] [LOCAL ] OTF: No existing data file found in primary storage. [2025-09-29T20:26:51.178387] [WARN ] [MAIN ] OTF: No existing data found, performing full refresh instead. [2025-09-29T20:26:51.178553] [INFO ] [MAIN ] OTF: Wiping existing primary data before full refresh. [2025-09-29T20:26:51.178614] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-09-29T20:26:51.178695] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-09-29T20:26:51.178746] [INFO ] [MAIN ] OTF: Starting full primary refresh. [2025-09-29T20:26:51.553284] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-05. [2025-09-29T20:26:51.624088] [INFO ] [REMOTE ] OTF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:26:52.348124] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-08. [2025-09-29T20:26:52.383037] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-29T20:26:52.598950] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-29T20:26:53.148142] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-06. [2025-09-29T20:26:53.932336] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-29T20:26:53.948109] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-07. [2025-09-29T20:26:54.023514] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-29T20:26:54.748097] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-05. [2025-09-29T20:26:54.831309] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-29T20:26:55.548124] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-08. [2025-09-29T20:26:56.348097] [INFO ] [REMOTE ] OTF: Fetching primary data for 2024-12. [2025-09-29T20:26:56.495071] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T20:26:56.497241] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-29T20:26:56.497336] [WARN ] [REMOTE ] OTF: No data returned for month 2024-12 [2025-09-29T20:26:56.506629] [FATAL] [REMOTE ] OTF: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T20:26:56.507234] [FATAL] [MAIN ] OTF: Failed to fetch primary data. [2025-09-29T20:26:56.507314] [WARN ] [MAIN ] OTF: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T20:26:56.507419] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-09-29T20:26:56.507877] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-09-29T20:26:56.507936] [INFO ] [LOCAL ] OTF: Starting deletion of derivative data. [2025-09-29T20:26:56.507985] [DEBUG] [LOCAL ] OTF: No derivative data file found to delete. [2025-09-29T20:26:56.508039] [INFO ] [MAIN ] Update Progress: 1611/2371 symbols completed. OTF took 5.6s. Estimated remaining: 1h 37m 36s. Rate: 7.8 symbols/min [2025-09-29T20:26:56.694382] [INFO ] [MAIN ] OTIS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:26:56.772665] [DEBUG] [LOCAL ] OTIS: Loaded 53481 existing records from primary storage. [2025-09-29T20:26:56.773040] [INFO ] [MAIN ] OTIS: Loaded 53481 existing records. [2025-09-29T20:26:56.972053] [WARN ] [MAIN ] OTIS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:26:56.972336] [INFO ] [MAIN ] OTIS: Wiping existing primary data before full refresh. [2025-09-29T20:26:56.972433] [INFO ] [LOCAL ] OTIS: Starting deletion of primary data. [2025-09-29T20:26:56.973045] [DEBUG] [LOCAL ] OTIS: Deleted primary data file. [2025-09-29T20:26:56.973108] [INFO ] [MAIN ] OTIS: Starting full primary refresh. [2025-09-29T20:26:57.156953] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-09. [2025-09-29T20:26:57.381425] [INFO ] [REMOTE ] OTIS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:26:57.415688] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-05 (2.67 seconds). [2025-09-29T20:26:57.948133] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-06. [2025-09-29T20:26:58.606925] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-29T20:26:58.617100] [INFO ] [REMOTE ] ORN: Full fetch complete (45667 records). [2025-09-29T20:26:58.617333] [DEBUG] [VALIDATOR ] ORN: Validating primary data. [2025-09-29T20:26:58.753421] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-09. [2025-09-29T20:26:59.059006] [DEBUG] [VALIDATOR ] ORN: All expected trading days are present. [2025-09-29T20:26:59.059146] [DEBUG] [VALIDATOR ] ORN: Primary data validation passed. [2025-09-29T20:26:59.060217] [INFO ] [MAIN ] ORN: Fetched primary data is valid. [2025-09-29T20:26:59.060288] [DEBUG] [LOCAL ] ORN: Saving primary data. [2025-09-29T20:26:59.061603] [DEBUG] [LOCAL ] ORN: Trimmed 45667 records to 31200 (keeping 200 days of data) [2025-09-29T20:26:59.247671] [DEBUG] [LOCAL ] ORN: Primary data saved (31200 records). [2025-09-29T20:26:59.247838] [INFO ] [MAIN ] ORN: Full history saved. [2025-09-29T20:26:59.247944] [INFO ] [MAIN ] Update Progress: 1612/2371 symbols completed. ORN took 28.6s. Estimated remaining: 1h 37m 26s. Rate: 7.8 symbols/min [2025-09-29T20:26:59.435188] [INFO ] [MAIN ] OUT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:26:59.459978] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-29T20:26:59.468880] [INFO ] [REMOTE ] OSK: Full fetch complete (61102 records). [2025-09-29T20:26:59.469068] [DEBUG] [VALIDATOR ] OSK: Validating primary data. [2025-09-29T20:26:59.469827] [FATAL] [VALIDATOR ] OSK: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T20:26:59.470202] [FATAL] [MAIN ] OSK: Fetched primary data is invalid. Refusing to save it. [2025-09-29T20:26:59.470305] [WARN ] [MAIN ] OSK: Deleting existing primary and derivative data due to validation failure. [2025-09-29T20:26:59.470380] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-09-29T20:26:59.470453] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-09-29T20:26:59.470490] [INFO ] [LOCAL ] OSK: Starting deletion of derivative data. [2025-09-29T20:26:59.470535] [DEBUG] [LOCAL ] OSK: No derivative data file found to delete. [2025-09-29T20:26:59.470626] [INFO ] [MAIN ] Update Progress: 1613/2371 symbols completed. OSK took 26.9s. Estimated remaining: 1h 37m 15s. Rate: 7.8 symbols/min [2025-09-29T20:26:59.553782] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2024-12. [2025-09-29T20:26:59.670051] [INFO ] [MAIN ] OVV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:26:59.692961] [DEBUG] [LOCAL ] OUT: Loaded 48630 existing records from primary storage. [2025-09-29T20:26:59.693289] [INFO ] [MAIN ] OUT: Loaded 48630 existing records. [2025-09-29T20:26:59.908708] [WARN ] [MAIN ] OUT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:26:59.908987] [INFO ] [MAIN ] OUT: Wiping existing primary data before full refresh. [2025-09-29T20:26:59.909048] [INFO ] [LOCAL ] OUT: Starting deletion of primary data. [2025-09-29T20:26:59.909367] [DEBUG] [LOCAL ] OUT: Deleted primary data file. [2025-09-29T20:26:59.909449] [INFO ] [MAIN ] OUT: Starting full primary refresh. [2025-09-29T20:27:00.039286] [DEBUG] [LOCAL ] OVV: Loaded 54295 existing records from primary storage. [2025-09-29T20:27:00.055394] [INFO ] [MAIN ] OVV: Loaded 54295 existing records. [2025-09-29T20:27:00.491249] [WARN ] [MAIN ] OVV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:27:00.491700] [INFO ] [MAIN ] OVV: Wiping existing primary data before full refresh. [2025-09-29T20:27:00.513022] [INFO ] [LOCAL ] OVV: Starting deletion of primary data. [2025-09-29T20:27:00.543584] [DEBUG] [LOCAL ] OVV: Deleted primary data file. [2025-09-29T20:27:00.577394] [INFO ] [REMOTE ] OUT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:27:00.577502] [INFO ] [MAIN ] OVV: Starting full primary refresh. [2025-09-29T20:27:00.577897] [INFO ] [REMOTE ] OUT: Fetching primary data for 2024-12. [2025-09-29T20:27:00.815476] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-06 (2.87 seconds). [2025-09-29T20:27:01.021089] [INFO ] [REMOTE ] OVV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:27:01.123285] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-29T20:27:01.148065] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-01. [2025-09-29T20:27:01.948113] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-07. [2025-09-29T20:27:02.397137] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-29T20:27:02.621415] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-29T20:27:02.748123] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-01. [2025-09-29T20:27:03.548127] [INFO ] [REMOTE ] OVV: Fetching primary data for 2024-12. [2025-09-29T20:27:04.348126] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-02. [2025-09-29T20:27:04.530453] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-29T20:27:04.933466] [DEBUG] [REMOTE ] OTIS: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-09-29T20:27:04.933844] [WARN ] [REMOTE ] OTIS: No data returned for month 2025-02 [2025-09-29T20:27:04.934006] [FATAL] [REMOTE ] OTIS: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T20:27:04.934095] [FATAL] [MAIN ] OTIS: Failed to fetch primary data. [2025-09-29T20:27:04.934161] [WARN ] [MAIN ] OTIS: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T20:27:04.934233] [INFO ] [LOCAL ] OTIS: Starting deletion of primary data. [2025-09-29T20:27:04.934329] [DEBUG] [LOCAL ] OTIS: No primary data file found to delete. [2025-09-29T20:27:04.934390] [INFO ] [LOCAL ] OTIS: Starting deletion of derivative data. [2025-09-29T20:27:04.935095] [DEBUG] [LOCAL ] OTIS: Deleted derivative data file. [2025-09-29T20:27:04.935213] [INFO ] [MAIN ] Update Progress: 1614/2371 symbols completed. OTIS took 8.4s. Estimated remaining: 1h 37m 6s. Rate: 7.8 symbols/min [2025-09-29T20:27:05.103487] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-07 (3.16 seconds). [2025-09-29T20:27:05.152241] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-02. [2025-09-29T20:27:05.185140] [INFO ] [MAIN ] OWL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:27:05.244200] [DEBUG] [LOCAL ] OWL: Loaded 54335 existing records from primary storage. [2025-09-29T20:27:05.244537] [INFO ] [MAIN ] OWL: Loaded 54335 existing records. [2025-09-29T20:27:05.446117] [WARN ] [MAIN ] OWL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:27:05.446569] [INFO ] [MAIN ] OWL: Wiping existing primary data before full refresh. [2025-09-29T20:27:05.446748] [INFO ] [LOCAL ] OWL: Starting deletion of primary data. [2025-09-29T20:27:05.447496] [DEBUG] [LOCAL ] OWL: Deleted primary data file. [2025-09-29T20:27:05.447565] [INFO ] [MAIN ] OWL: Starting full primary refresh. [2025-09-29T20:27:05.790177] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-29T20:27:05.884284] [INFO ] [REMOTE ] OWL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:27:05.948091] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-01. [2025-09-29T20:27:06.748152] [INFO ] [REMOTE ] OWL: Fetching primary data for 2024-12. [2025-09-29T20:27:06.914474] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-29T20:27:07.548091] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-03. [2025-09-29T20:27:07.793013] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-29T20:27:08.348092] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-02. [2025-09-29T20:27:08.595676] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-29T20:27:09.038392] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-29T20:27:09.148121] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-08. [2025-09-29T20:27:09.948119] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-01. [2025-09-29T20:27:10.248357] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-29T20:27:10.748128] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-04. [2025-09-29T20:27:11.529160] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-29T20:27:11.548096] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-02. [2025-09-29T20:27:11.973759] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-08 (2.83 seconds). [2025-09-29T20:27:12.348118] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-09. [2025-09-29T20:27:12.570808] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-29T20:27:13.148101] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-03. [2025-09-29T20:27:13.406331] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-29T20:27:13.948133] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-03. [2025-09-29T20:27:14.748137] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-05. [2025-09-29T20:27:15.098330] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-09 (2.75 seconds). [2025-09-29T20:27:15.109824] [INFO ] [REMOTE ] OSCR: Full fetch complete (77490 records). [2025-09-29T20:27:15.110112] [DEBUG] [VALIDATOR ] OSCR: Validating primary data. [2025-09-29T20:27:15.302115] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-29T20:27:15.548332] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-04. [2025-09-29T20:27:15.593223] [DEBUG] [VALIDATOR ] OSCR: All expected trading days are present. [2025-09-29T20:27:15.593344] [DEBUG] [VALIDATOR ] OSCR: Primary data validation passed. [2025-09-29T20:27:15.594597] [INFO ] [MAIN ] OSCR: Fetched primary data is valid. [2025-09-29T20:27:15.594699] [DEBUG] [LOCAL ] OSCR: Saving primary data. [2025-09-29T20:27:15.596425] [DEBUG] [LOCAL ] OSCR: Trimmed 77490 records to 53722 (keeping 200 days of data) [2025-09-29T20:27:15.896500] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-29T20:27:16.017400] [DEBUG] [LOCAL ] OSCR: Primary data saved (53722 records). [2025-09-29T20:27:16.017611] [INFO ] [MAIN ] OSCR: Full history saved. [2025-09-29T20:27:16.017760] [INFO ] [MAIN ] Update Progress: 1615/2371 symbols completed. OSCR took 43.5s. Estimated remaining: 1h 37m 0s. Rate: 7.8 symbols/min [2025-09-29T20:27:16.201478] [INFO ] [MAIN ] OWLT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:27:16.211970] [DEBUG] [LOCAL ] OWLT: Loaded 9099 existing records from primary storage. [2025-09-29T20:27:16.212182] [INFO ] [MAIN ] OWLT: Loaded 9099 existing records. [2025-09-29T20:27:16.365291] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-04. [2025-09-29T20:27:16.407024] [WARN ] [MAIN ] OWLT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:27:16.411135] [INFO ] [MAIN ] OWLT: Wiping existing primary data before full refresh. [2025-09-29T20:27:16.411260] [INFO ] [LOCAL ] OWLT: Starting deletion of primary data. [2025-09-29T20:27:16.411520] [DEBUG] [LOCAL ] OWLT: Deleted primary data file. [2025-09-29T20:27:16.411580] [INFO ] [MAIN ] OWLT: Starting full primary refresh. [2025-09-29T20:27:16.773754] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-29T20:27:16.846923] [INFO ] [REMOTE ] OWLT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:27:17.148104] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-06. [2025-09-29T20:27:17.539754] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-29T20:27:17.948104] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-05. [2025-09-29T20:27:18.176842] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-29T20:27:18.748084] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-05. [2025-09-29T20:27:18.840608] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-29T20:27:19.548121] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2024-12. [2025-09-29T20:27:20.015128] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-29T20:27:20.352294] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-07. [2025-09-29T20:27:20.353311] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-29T20:27:20.798252] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-29T20:27:21.148136] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-01. [2025-09-29T20:27:21.865191] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-29T20:27:21.869020] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-29T20:27:21.948098] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-06. [2025-09-29T20:27:22.748123] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-08. [2025-09-29T20:27:23.548100] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-06. [2025-09-29T20:27:23.862338] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-29T20:27:24.176156] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-29T20:27:24.348127] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-02. [2025-09-29T20:27:24.868595] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-29T20:27:25.148100] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-09. [2025-09-29T20:27:25.414494] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-29T20:27:25.948099] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-07. [2025-09-29T20:27:26.755393] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-03. [2025-09-29T20:27:26.761019] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-29T20:27:26.771546] [INFO ] [REMOTE ] OUT: Full fetch complete (68964 records). [2025-09-29T20:27:26.771744] [DEBUG] [VALIDATOR ] OUT: Validating primary data. [2025-09-29T20:27:27.179328] [DEBUG] [VALIDATOR ] OUT: All expected trading days are present. [2025-09-29T20:27:27.179462] [DEBUG] [VALIDATOR ] OUT: Primary data validation passed. [2025-09-29T20:27:27.180520] [INFO ] [MAIN ] OUT: Fetched primary data is valid. [2025-09-29T20:27:27.180586] [DEBUG] [LOCAL ] OUT: Saving primary data. [2025-09-29T20:27:27.182022] [DEBUG] [LOCAL ] OUT: Trimmed 68964 records to 47841 (keeping 200 days of data) [2025-09-29T20:27:27.488825] [DEBUG] [LOCAL ] OUT: Primary data saved (47841 records). [2025-09-29T20:27:27.488977] [INFO ] [MAIN ] OUT: Full history saved. [2025-09-29T20:27:27.489063] [INFO ] [MAIN ] Update Progress: 1616/2371 symbols completed. OUT took 28.2s. Estimated remaining: 1h 36m 54s. Rate: 7.8 symbols/min [2025-09-29T20:27:27.555088] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-07. [2025-09-29T20:27:27.668102] [INFO ] [MAIN ] OXM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:27:27.675784] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-29T20:27:27.711485] [DEBUG] [LOCAL ] OXM: Loaded 33928 existing records from primary storage. [2025-09-29T20:27:27.711836] [INFO ] [MAIN ] OXM: Loaded 33928 existing records. [2025-09-29T20:27:27.907497] [WARN ] [MAIN ] OXM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:27:27.907937] [INFO ] [MAIN ] OXM: Wiping existing primary data before full refresh. [2025-09-29T20:27:27.908011] [INFO ] [LOCAL ] OXM: Starting deletion of primary data. [2025-09-29T20:27:27.908520] [DEBUG] [LOCAL ] OXM: Deleted primary data file. [2025-09-29T20:27:27.908578] [INFO ] [MAIN ] OXM: Starting full primary refresh. [2025-09-29T20:27:28.284950] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-09-29T20:27:28.329447] [INFO ] [REMOTE ] OXM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:27:28.348071] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-08. [2025-09-29T20:27:29.148111] [INFO ] [REMOTE ] OXM: Fetching primary data for 2024-12. [2025-09-29T20:27:29.571315] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-29T20:27:29.948100] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-04. [2025-09-29T20:27:30.245217] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-29T20:27:30.696828] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-29T20:27:30.722343] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-29T20:27:30.748070] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-01. [2025-09-29T20:27:31.548126] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-09. [2025-09-29T20:27:32.113096] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-29T20:27:32.348118] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-05. [2025-09-29T20:27:32.839887] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-29T20:27:33.148124] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-02. [2025-09-29T20:27:33.419370] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-29T20:27:33.430780] [INFO ] [REMOTE ] OVV: Full fetch complete (77317 records). [2025-09-29T20:27:33.430967] [DEBUG] [VALIDATOR ] OVV: Validating primary data. [2025-09-29T20:27:33.865234] [DEBUG] [VALIDATOR ] OVV: All expected trading days are present. [2025-09-29T20:27:33.865360] [DEBUG] [VALIDATOR ] OVV: Primary data validation passed. [2025-09-29T20:27:33.866601] [INFO ] [MAIN ] OVV: Fetched primary data is valid. [2025-09-29T20:27:33.866691] [DEBUG] [LOCAL ] OVV: Saving primary data. [2025-09-29T20:27:33.868349] [DEBUG] [LOCAL ] OVV: Trimmed 77317 records to 53519 (keeping 200 days of data) [2025-09-29T20:27:33.963256] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-06. [2025-09-29T20:27:34.209352] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-29T20:27:34.265322] [DEBUG] [LOCAL ] OVV: Primary data saved (53519 records). [2025-09-29T20:27:34.265484] [INFO ] [MAIN ] OVV: Full history saved. [2025-09-29T20:27:34.265589] [INFO ] [MAIN ] Update Progress: 1617/2371 symbols completed. OVV took 34.8s. Estimated remaining: 1h 36m 46s. Rate: 7.8 symbols/min [2025-09-29T20:27:34.445240] [INFO ] [MAIN ] OXY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:27:34.445415] [DEBUG] [LOCAL ] OXY: No existing data file found in primary storage. [2025-09-29T20:27:34.445455] [WARN ] [MAIN ] OXY: No existing data found, performing full refresh instead. [2025-09-29T20:27:34.445573] [INFO ] [MAIN ] OXY: Wiping existing primary data before full refresh. [2025-09-29T20:27:34.445616] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-09-29T20:27:34.445696] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-09-29T20:27:34.445746] [INFO ] [MAIN ] OXY: Starting full primary refresh. [2025-09-29T20:27:34.753278] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-03. [2025-09-29T20:27:34.818252] [INFO ] [REMOTE ] OXY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:27:35.113491] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-29T20:27:35.548126] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-08. [2025-09-29T20:27:36.309509] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-29T20:27:36.348107] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-04. [2025-09-29T20:27:37.148128] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-07. [2025-09-29T20:27:37.208709] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-29T20:27:37.672466] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-29T20:27:37.948083] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-09. [2025-09-29T20:27:38.035435] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-29T20:27:38.748118] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-08. [2025-09-29T20:27:39.548169] [INFO ] [REMOTE ] OXY: Fetching primary data for 2024-12. [2025-09-29T20:27:39.639050] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-29T20:27:39.658085] [INFO ] [REMOTE ] OWL: Full fetch complete (77529 records). [2025-09-29T20:27:39.659108] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-29T20:27:39.659217] [DEBUG] [VALIDATOR ] OWL: Validating primary data. [2025-09-29T20:27:40.064962] [DEBUG] [VALIDATOR ] OWL: All expected trading days are present. [2025-09-29T20:27:40.065070] [DEBUG] [VALIDATOR ] OWL: Primary data validation passed. [2025-09-29T20:27:40.066341] [INFO ] [MAIN ] OWL: Fetched primary data is valid. [2025-09-29T20:27:40.066426] [DEBUG] [LOCAL ] OWL: Saving primary data. [2025-09-29T20:27:40.068377] [DEBUG] [LOCAL ] OWL: Trimmed 77529 records to 53555 (keeping 200 days of data) [2025-09-29T20:27:40.349255] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-09. [2025-09-29T20:27:40.440584] [DEBUG] [LOCAL ] OWL: Primary data saved (53555 records). [2025-09-29T20:27:40.440775] [INFO ] [MAIN ] OWL: Full history saved. [2025-09-29T20:27:40.440908] [INFO ] [MAIN ] Update Progress: 1618/2371 symbols completed. OWL took 35.5s. Estimated remaining: 1h 36m 38s. Rate: 7.8 symbols/min [2025-09-29T20:27:40.621696] [INFO ] [MAIN ] PAAS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:27:40.686958] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-29T20:27:40.716952] [DEBUG] [LOCAL ] PAAS: Loaded 54383 existing records from primary storage. [2025-09-29T20:27:40.717403] [INFO ] [MAIN ] PAAS: Loaded 54383 existing records. [2025-09-29T20:27:40.911062] [WARN ] [MAIN ] PAAS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:27:40.911298] [INFO ] [MAIN ] PAAS: Wiping existing primary data before full refresh. [2025-09-29T20:27:40.911349] [INFO ] [LOCAL ] PAAS: Starting deletion of primary data. [2025-09-29T20:27:40.911740] [DEBUG] [LOCAL ] PAAS: Deleted primary data file. [2025-09-29T20:27:40.911813] [INFO ] [MAIN ] PAAS: Starting full primary refresh. [2025-09-29T20:27:41.153329] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-01. [2025-09-29T20:27:41.313533] [INFO ] [REMOTE ] PAAS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:27:41.314228] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-29T20:27:41.317556] [INFO ] [REMOTE ] OWLT: Full fetch complete (11604 records). [2025-09-29T20:27:41.317681] [DEBUG] [VALIDATOR ] OWLT: Validating primary data. [2025-09-29T20:27:41.709134] [DEBUG] [VALIDATOR ] OWLT: All expected trading days are present. [2025-09-29T20:27:41.709217] [DEBUG] [VALIDATOR ] OWLT: Primary data validation passed. [2025-09-29T20:27:41.709486] [INFO ] [MAIN ] OWLT: Fetched primary data is valid. [2025-09-29T20:27:41.709526] [DEBUG] [LOCAL ] OWLT: Saving primary data. [2025-09-29T20:27:41.710070] [DEBUG] [LOCAL ] OWLT: Trimmed 11604 records to 8898 (keeping 200 days of data) [2025-09-29T20:27:41.764964] [DEBUG] [LOCAL ] OWLT: Primary data saved (8898 records). [2025-09-29T20:27:41.765120] [INFO ] [MAIN ] OWLT: Full history saved. [2025-09-29T20:27:41.765284] [INFO ] [MAIN ] Update Progress: 1619/2371 symbols completed. OWLT took 25.7s. Estimated remaining: 1h 36m 27s. Rate: 7.8 symbols/min [2025-09-29T20:27:41.945394] [INFO ] [MAIN ] PAC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:27:41.948123] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2024-12. [2025-09-29T20:27:41.959743] [DEBUG] [LOCAL ] PAC: Loaded 11725 existing records from primary storage. [2025-09-29T20:27:41.959998] [INFO ] [MAIN ] PAC: Loaded 11725 existing records. [2025-09-29T20:27:42.151566] [WARN ] [MAIN ] PAC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:27:42.151904] [INFO ] [MAIN ] PAC: Wiping existing primary data before full refresh. [2025-09-29T20:27:42.151983] [INFO ] [LOCAL ] PAC: Starting deletion of primary data. [2025-09-29T20:27:42.152383] [DEBUG] [LOCAL ] PAC: Deleted primary data file. [2025-09-29T20:27:42.152446] [INFO ] [MAIN ] PAC: Starting full primary refresh. [2025-09-29T20:27:42.573875] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-29T20:27:42.571902] [INFO ] [REMOTE ] PAC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:27:42.748105] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-05. [2025-09-29T20:27:43.548078] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-02. [2025-09-29T20:27:44.068738] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-29T20:27:44.161055] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-29T20:27:44.197688] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-29T20:27:44.348114] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-03. [2025-09-29T20:27:45.136418] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-29T20:27:45.148054] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-04. [2025-09-29T20:27:45.948110] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-06. [2025-09-29T20:27:46.281777] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-29T20:27:46.748115] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-01. [2025-09-29T20:27:47.171835] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-29T20:27:47.548148] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-07. [2025-09-29T20:27:48.348125] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-05. [2025-09-29T20:27:48.711580] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-29T20:27:48.790098] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-29T20:27:49.148085] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-02. [2025-09-29T20:27:49.225181] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-29T20:27:49.948103] [INFO ] [REMOTE ] PAC: Fetching primary data for 2024-12. [2025-09-29T20:27:50.748113] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-06. [2025-09-29T20:27:51.027383] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-29T20:27:51.067901] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-29T20:27:51.548153] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-01. [2025-09-29T20:27:51.703896] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-29T20:27:52.348086] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-08. [2025-09-29T20:27:52.426019] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-29T20:27:53.148126] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-07. [2025-09-29T20:27:53.701313] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-29T20:27:53.948153] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-09. [2025-09-29T20:27:54.199685] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-29T20:27:54.748141] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-02. [2025-09-29T20:27:55.311877] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-29T20:27:55.319692] [INFO ] [REMOTE ] OXM: Full fetch complete (46339 records). [2025-09-29T20:27:55.319823] [DEBUG] [VALIDATOR ] OXM: Validating primary data. [2025-09-29T20:27:55.563578] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-03. [2025-09-29T20:27:55.611947] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-29T20:27:55.748086] [DEBUG] [VALIDATOR ] OXM: All expected trading days are present. [2025-09-29T20:27:55.748173] [DEBUG] [VALIDATOR ] OXM: Primary data validation passed. [2025-09-29T20:27:55.749142] [INFO ] [MAIN ] OXM: Fetched primary data is valid. [2025-09-29T20:27:55.749207] [DEBUG] [LOCAL ] OXM: Saving primary data. [2025-09-29T20:27:55.750238] [DEBUG] [LOCAL ] OXM: Trimmed 46339 records to 33382 (keeping 200 days of data) [2025-09-29T20:27:55.969598] [DEBUG] [LOCAL ] OXM: Primary data saved (33382 records). [2025-09-29T20:27:55.969768] [INFO ] [MAIN ] OXM: Full history saved. [2025-09-29T20:27:55.969872] [INFO ] [MAIN ] Update Progress: 1620/2371 symbols completed. OXM took 28.5s. Estimated remaining: 1h 36m 22s. Rate: 7.8 symbols/min [2025-09-29T20:27:56.152736] [INFO ] [MAIN ] PACK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:27:56.184712] [DEBUG] [LOCAL ] PACK: Loaded 32471 existing records from primary storage. [2025-09-29T20:27:56.185009] [INFO ] [MAIN ] PACK: Loaded 32471 existing records. [2025-09-29T20:27:56.352721] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-03. [2025-09-29T20:27:56.389760] [WARN ] [MAIN ] PACK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:27:56.390270] [INFO ] [MAIN ] PACK: Wiping existing primary data before full refresh. [2025-09-29T20:27:56.390340] [INFO ] [LOCAL ] PACK: Starting deletion of primary data. [2025-09-29T20:27:56.390615] [DEBUG] [LOCAL ] PACK: Deleted primary data file. [2025-09-29T20:27:56.390736] [INFO ] [MAIN ] PACK: Starting full primary refresh. [2025-09-29T20:27:56.784525] [INFO ] [REMOTE ] PACK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:27:57.148135] [INFO ] [REMOTE ] PACK: Fetching primary data for 2024-12. [2025-09-29T20:27:57.395407] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-29T20:27:57.810424] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-09-29T20:27:57.948145] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-04. [2025-09-29T20:27:58.297052] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-29T20:27:58.748114] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-04. [2025-09-29T20:27:59.548151] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-08. [2025-09-29T20:27:59.837388] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-29T20:28:00.172390] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-29T20:28:00.348116] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-05. [2025-09-29T20:28:00.522303] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-29T20:28:01.148210] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-05. [2025-09-29T20:28:01.948191] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-09. [2025-09-29T20:28:02.207216] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-29T20:28:02.472056] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-29T20:28:02.748100] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-01. [2025-09-29T20:28:02.839292] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-29T20:28:02.849612] [INFO ] [REMOTE ] OXY: Full fetch complete (77180 records). [2025-09-29T20:28:02.849847] [DEBUG] [VALIDATOR ] OXY: Validating primary data. [2025-09-29T20:28:02.851144] [FATAL] [VALIDATOR ] OXY: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T20:28:02.851287] [FATAL] [MAIN ] OXY: Fetched primary data is invalid. Refusing to save it. [2025-09-29T20:28:02.851357] [WARN ] [MAIN ] OXY: Deleting existing primary and derivative data due to validation failure. [2025-09-29T20:28:02.851432] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-09-29T20:28:02.851503] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-09-29T20:28:02.851541] [INFO ] [LOCAL ] OXY: Starting deletion of derivative data. [2025-09-29T20:28:02.851580] [DEBUG] [LOCAL ] OXY: No derivative data file found to delete. [2025-09-29T20:28:02.851684] [INFO ] [MAIN ] Update Progress: 1621/2371 symbols completed. OXY took 28.6s. Estimated remaining: 1h 36m 14s. Rate: 7.8 symbols/min [2025-09-29T20:28:03.029702] [INFO ] [MAIN ] PACS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:28:03.072258] [DEBUG] [LOCAL ] PACS: Loaded 34761 existing records from primary storage. [2025-09-29T20:28:03.072577] [INFO ] [MAIN ] PACS: Loaded 34761 existing records. [2025-09-29T20:28:03.260485] [WARN ] [MAIN ] PACS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:28:03.260750] [INFO ] [MAIN ] PACS: Wiping existing primary data before full refresh. [2025-09-29T20:28:03.260842] [INFO ] [LOCAL ] PACS: Starting deletion of primary data. [2025-09-29T20:28:03.261134] [DEBUG] [LOCAL ] PACS: Deleted primary data file. [2025-09-29T20:28:03.261194] [INFO ] [MAIN ] PACS: Starting full primary refresh. [2025-09-29T20:28:03.553258] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-06. [2025-09-29T20:28:03.677577] [INFO ] [REMOTE ] PACS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:28:03.977944] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-29T20:28:04.348078] [INFO ] [REMOTE ] PACS: Fetching primary data for 2024-12. [2025-09-29T20:28:04.500754] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-29T20:28:05.148114] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-07. [2025-09-29T20:28:05.767696] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-29T20:28:05.920860] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-29T20:28:05.948119] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-02. [2025-09-29T20:28:06.748121] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-01. [2025-09-29T20:28:07.237864] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-29T20:28:07.548133] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-06. [2025-09-29T20:28:08.015134] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-29T20:28:08.348131] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-08. [2025-09-29T20:28:09.148088] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-03. [2025-09-29T20:28:09.229592] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-29T20:28:09.741428] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-29T20:28:09.948108] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-09. [2025-09-29T20:28:10.217091] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-29T20:28:10.748105] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-02. [2025-09-29T20:28:10.809065] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-29T20:28:10.811702] [INFO ] [REMOTE ] PAC: Full fetch complete (16444 records). [2025-09-29T20:28:10.811779] [DEBUG] [VALIDATOR ] PAC: Validating primary data. [2025-09-29T20:28:11.194278] [DEBUG] [VALIDATOR ] PAC: All expected trading days are present. [2025-09-29T20:28:11.194359] [DEBUG] [VALIDATOR ] PAC: Primary data validation passed. [2025-09-29T20:28:11.194784] [INFO ] [MAIN ] PAC: Fetched primary data is valid. [2025-09-29T20:28:11.194848] [DEBUG] [LOCAL ] PAC: Saving primary data. [2025-09-29T20:28:11.195384] [DEBUG] [LOCAL ] PAC: Trimmed 16444 records to 11581 (keeping 200 days of data) [2025-09-29T20:28:11.281781] [DEBUG] [LOCAL ] PAC: Primary data saved (11581 records). [2025-09-29T20:28:11.281933] [INFO ] [MAIN ] PAC: Full history saved. [2025-09-29T20:28:11.282063] [INFO ] [MAIN ] Update Progress: 1622/2371 symbols completed. PAC took 29.5s. Estimated remaining: 1h 36m 7s. Rate: 7.8 symbols/min [2025-09-29T20:28:11.456984] [INFO ] [MAIN ] PAG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:28:11.480428] [DEBUG] [LOCAL ] PAG: Loaded 22217 existing records from primary storage. [2025-09-29T20:28:11.480745] [INFO ] [MAIN ] PAG: Loaded 22217 existing records. [2025-09-29T20:28:11.553350] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-04. [2025-09-29T20:28:11.677419] [WARN ] [MAIN ] PAG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:28:11.677624] [INFO ] [MAIN ] PAG: Wiping existing primary data before full refresh. [2025-09-29T20:28:11.677749] [INFO ] [LOCAL ] PAG: Starting deletion of primary data. [2025-09-29T20:28:11.678016] [DEBUG] [LOCAL ] PAG: Deleted primary data file. [2025-09-29T20:28:11.678074] [INFO ] [MAIN ] PAG: Starting full primary refresh. [2025-09-29T20:28:12.064180] [INFO ] [REMOTE ] PAG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:28:12.221352] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-29T20:28:12.348144] [INFO ] [REMOTE ] PAG: Fetching primary data for 2024-12. [2025-09-29T20:28:13.136021] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-29T20:28:13.148057] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-05. [2025-09-29T20:28:13.482759] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-29T20:28:13.948162] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-03. [2025-09-29T20:28:14.600869] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-29T20:28:14.748160] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-07. [2025-09-29T20:28:15.353038] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-29T20:28:15.548144] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-01. [2025-09-29T20:28:16.348106] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-06. [2025-09-29T20:28:16.850635] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-29T20:28:16.864053] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-29T20:28:17.148171] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-02. [2025-09-29T20:28:17.318636] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-29T20:28:17.948119] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-04. [2025-09-29T20:28:18.006894] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-29T20:28:18.748149] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-03. [2025-09-29T20:28:19.526016] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-29T20:28:19.548076] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-05. [2025-09-29T20:28:19.983864] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-29T20:28:20.348116] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-07. [2025-09-29T20:28:20.874100] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-29T20:28:21.148267] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-08. [2025-09-29T20:28:21.671881] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-29T20:28:21.948119] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-06. [2025-09-29T20:28:22.748165] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-04. [2025-09-29T20:28:23.253124] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-29T20:28:23.285811] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-29T20:28:23.548167] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-09. [2025-09-29T20:28:24.225534] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-29T20:28:24.348154] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-05. [2025-09-29T20:28:25.148145] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-08. [2025-09-29T20:28:25.838274] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-09-29T20:28:25.850217] [INFO ] [REMOTE ] PAAS: Full fetch complete (77383 records). [2025-09-29T20:28:25.850387] [DEBUG] [VALIDATOR ] PAAS: Validating primary data. [2025-09-29T20:28:25.955018] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-07. [2025-09-29T20:28:26.295349] [DEBUG] [VALIDATOR ] PAAS: All expected trading days are present. [2025-09-29T20:28:26.295455] [DEBUG] [VALIDATOR ] PAAS: Primary data validation passed. [2025-09-29T20:28:26.296763] [INFO ] [MAIN ] PAAS: Fetched primary data is valid. [2025-09-29T20:28:26.296847] [DEBUG] [LOCAL ] PAAS: Saving primary data. [2025-09-29T20:28:26.298785] [DEBUG] [LOCAL ] PAAS: Trimmed 77383 records to 53603 (keeping 200 days of data) [2025-09-29T20:28:26.681191] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-29T20:28:26.719214] [DEBUG] [LOCAL ] PAAS: Primary data saved (53603 records). [2025-09-29T20:28:26.719370] [INFO ] [MAIN ] PAAS: Full history saved. [2025-09-29T20:28:26.719464] [INFO ] [MAIN ] Update Progress: 1623/2371 symbols completed. PAAS took 46.3s. Estimated remaining: 1h 36m 3s. Rate: 7.8 symbols/min [2025-09-29T20:28:26.754292] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-09. [2025-09-29T20:28:26.903593] [INFO ] [MAIN ] PAGS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:28:26.957917] [DEBUG] [LOCAL ] PAGS: Loaded 53447 existing records from primary storage. [2025-09-29T20:28:26.958255] [INFO ] [MAIN ] PAGS: Loaded 53447 existing records. [2025-09-29T20:28:27.159899] [WARN ] [MAIN ] PAGS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:28:27.160370] [INFO ] [MAIN ] PAGS: Wiping existing primary data before full refresh. [2025-09-29T20:28:27.160440] [INFO ] [LOCAL ] PAGS: Starting deletion of primary data. [2025-09-29T20:28:27.166247] [DEBUG] [LOCAL ] PAGS: Deleted primary data file. [2025-09-29T20:28:27.173120] [INFO ] [MAIN ] PAGS: Starting full primary refresh. [2025-09-29T20:28:27.223251] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-05 (2.88 seconds). [2025-09-29T20:28:27.585448] [INFO ] [REMOTE ] PAGS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:28:27.560420] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-06. [2025-09-29T20:28:27.611998] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-29T20:28:28.231900] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-29T20:28:28.239433] [INFO ] [REMOTE ] PACK: Full fetch complete (43697 records). [2025-09-29T20:28:28.239573] [DEBUG] [VALIDATOR ] PACK: Validating primary data. [2025-09-29T20:28:28.353232] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-08. [2025-09-29T20:28:28.641455] [DEBUG] [VALIDATOR ] PACK: All expected trading days are present. [2025-09-29T20:28:28.641535] [DEBUG] [VALIDATOR ] PACK: Primary data validation passed. [2025-09-29T20:28:28.642359] [INFO ] [MAIN ] PACK: Fetched primary data is valid. [2025-09-29T20:28:28.642422] [DEBUG] [LOCAL ] PACK: Saving primary data. [2025-09-29T20:28:28.643409] [DEBUG] [LOCAL ] PACK: Trimmed 43697 records to 31769 (keeping 200 days of data) [2025-09-29T20:28:28.835695] [DEBUG] [LOCAL ] PACK: Primary data saved (31769 records). [2025-09-29T20:28:28.835838] [INFO ] [MAIN ] PACK: Full history saved. [2025-09-29T20:28:28.835937] [INFO ] [MAIN ] Update Progress: 1624/2371 symbols completed. PACK took 32.9s. Estimated remaining: 1h 35m 52s. Rate: 7.8 symbols/min [2025-09-29T20:28:28.987595] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-29T20:28:29.042271] [INFO ] [MAIN ] PAI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:28:29.047496] [DEBUG] [LOCAL ] PAI: Loaded 2758 existing records from primary storage. [2025-09-29T20:28:29.047690] [INFO ] [MAIN ] PAI: Loaded 2758 existing records. [2025-09-29T20:28:29.154202] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2024-12. [2025-09-29T20:28:29.239029] [WARN ] [MAIN ] PAI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:28:29.239310] [INFO ] [MAIN ] PAI: Wiping existing primary data before full refresh. [2025-09-29T20:28:29.239366] [INFO ] [LOCAL ] PAI: Starting deletion of primary data. [2025-09-29T20:28:29.239526] [DEBUG] [LOCAL ] PAI: Deleted primary data file. [2025-09-29T20:28:29.239584] [INFO ] [MAIN ] PAI: Starting full primary refresh. [2025-09-29T20:28:29.628372] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-29T20:28:29.650404] [INFO ] [REMOTE ] PAI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:28:29.948172] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-09. [2025-09-29T20:28:30.748281] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-07. [2025-09-29T20:28:31.080001] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-29T20:28:31.548090] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-01. [2025-09-29T20:28:31.578502] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-29T20:28:31.587440] [INFO ] [REMOTE ] PACS: Full fetch complete (50755 records). [2025-09-29T20:28:31.587575] [DEBUG] [VALIDATOR ] PACS: Validating primary data. [2025-09-29T20:28:32.007006] [DEBUG] [VALIDATOR ] PACS: All expected trading days are present. [2025-09-29T20:28:32.007170] [DEBUG] [VALIDATOR ] PACS: Primary data validation passed. [2025-09-29T20:28:32.008233] [INFO ] [MAIN ] PACS: Fetched primary data is valid. [2025-09-29T20:28:32.008325] [DEBUG] [LOCAL ] PACS: Saving primary data. [2025-09-29T20:28:32.023864] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-29T20:28:32.030080] [DEBUG] [LOCAL ] PACS: Trimmed 50755 records to 34371 (keeping 200 days of data) [2025-09-29T20:28:32.241978] [DEBUG] [LOCAL ] PACS: Primary data saved (34371 records). [2025-09-29T20:28:32.242133] [INFO ] [MAIN ] PACS: Full history saved. [2025-09-29T20:28:32.242227] [INFO ] [MAIN ] Update Progress: 1625/2371 symbols completed. PACS took 29.4s. Estimated remaining: 1h 35m 43s. Rate: 7.8 symbols/min [2025-09-29T20:28:32.352754] [INFO ] [REMOTE ] PAI: Fetching primary data for 2024-12. [2025-09-29T20:28:32.432028] [INFO ] [MAIN ] PAII: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:28:32.432221] [DEBUG] [LOCAL ] PAII: No existing data file found in primary storage. [2025-09-29T20:28:32.432279] [WARN ] [MAIN ] PAII: No existing data found, performing full refresh instead. [2025-09-29T20:28:32.432392] [INFO ] [MAIN ] PAII: Wiping existing primary data before full refresh. [2025-09-29T20:28:32.432435] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-09-29T20:28:32.432483] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-09-29T20:28:32.432563] [INFO ] [MAIN ] PAII: Starting full primary refresh. [2025-09-29T20:28:32.818772] [INFO ] [REMOTE ] PAII: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:28:33.023723] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-29T20:28:33.148088] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-01. [2025-09-29T20:28:33.603979] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-29T20:28:33.828406] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-29T20:28:33.948115] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-02. [2025-09-29T20:28:34.498241] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-29T20:28:34.748152] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-02. [2025-09-29T20:28:35.548162] [INFO ] [REMOTE ] PAII: Fetching primary data for 2024-12. [2025-09-29T20:28:35.892498] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T20:28:35.892856] [WARN ] [REMOTE ] PAII: No data returned for month 2024-12 [2025-09-29T20:28:35.892961] [FATAL] [REMOTE ] PAII: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T20:28:35.893009] [FATAL] [MAIN ] PAII: Failed to fetch primary data. [2025-09-29T20:28:35.893045] [WARN ] [MAIN ] PAII: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T20:28:35.893087] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-09-29T20:28:35.893146] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-09-29T20:28:35.893182] [INFO ] [LOCAL ] PAII: Starting deletion of derivative data. [2025-09-29T20:28:35.893223] [DEBUG] [LOCAL ] PAII: No derivative data file found to delete. [2025-09-29T20:28:35.893285] [INFO ] [MAIN ] Update Progress: 1626/2371 symbols completed. PAII took 3.7s. Estimated remaining: 1h 35m 33s. Rate: 7.8 symbols/min [2025-09-29T20:28:36.075573] [INFO ] [MAIN ] PAM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:28:36.103425] [DEBUG] [LOCAL ] PAM: Loaded 28420 existing records from primary storage. [2025-09-29T20:28:36.103718] [INFO ] [MAIN ] PAM: Loaded 28420 existing records. [2025-09-29T20:28:36.293518] [WARN ] [MAIN ] PAM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:28:36.293764] [INFO ] [MAIN ] PAM: Wiping existing primary data before full refresh. [2025-09-29T20:28:36.293819] [INFO ] [LOCAL ] PAM: Starting deletion of primary data. [2025-09-29T20:28:36.294144] [DEBUG] [LOCAL ] PAM: Deleted primary data file. [2025-09-29T20:28:36.294204] [INFO ] [MAIN ] PAM: Starting full primary refresh. [2025-09-29T20:28:36.359738] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-03. [2025-09-29T20:28:36.699872] [INFO ] [REMOTE ] PAM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:28:36.736573] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-29T20:28:36.996359] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-29T20:28:37.148169] [INFO ] [REMOTE ] PAM: Fetching primary data for 2024-12. [2025-09-29T20:28:37.948127] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-03. [2025-09-29T20:28:38.660707] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-29T20:28:38.748122] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-01. [2025-09-29T20:28:39.548168] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-08. [2025-09-29T20:28:39.972800] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-29T20:28:40.233620] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-29T20:28:40.348129] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-02. [2025-09-29T20:28:40.905975] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-29T20:28:41.148130] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-04. [2025-09-29T20:28:41.749728] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-29T20:28:41.791331] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-29T20:28:41.948143] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-04. [2025-09-29T20:28:42.748153] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-03. [2025-09-29T20:28:43.548156] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-05. [2025-09-29T20:28:43.883824] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-29T20:28:44.024615] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-29T20:28:44.069211] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-29T20:28:44.348117] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-04. [2025-09-29T20:28:45.148144] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-09. [2025-09-29T20:28:45.948094] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-05. [2025-09-29T20:28:46.317542] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-29T20:28:46.581595] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-29T20:28:46.585632] [INFO ] [REMOTE ] PAG: Full fetch complete (30139 records). [2025-09-29T20:28:46.585767] [DEBUG] [VALIDATOR ] PAG: Validating primary data. [2025-09-29T20:28:46.749391] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-05. [2025-09-29T20:28:46.973081] [DEBUG] [VALIDATOR ] PAG: All expected trading days are present. [2025-09-29T20:28:46.973166] [DEBUG] [VALIDATOR ] PAG: Primary data validation passed. [2025-09-29T20:28:46.973872] [INFO ] [MAIN ] PAG: Fetched primary data is valid. [2025-09-29T20:28:46.973935] [DEBUG] [LOCAL ] PAG: Saving primary data. [2025-09-29T20:28:46.974731] [DEBUG] [LOCAL ] PAG: Trimmed 30139 records to 21760 (keeping 200 days of data) [2025-09-29T20:28:47.131913] [DEBUG] [LOCAL ] PAG: Primary data saved (21760 records). [2025-09-29T20:28:47.132043] [INFO ] [MAIN ] PAG: Full history saved. [2025-09-29T20:28:47.132164] [INFO ] [MAIN ] Update Progress: 1627/2371 symbols completed. PAG took 35.8s. Estimated remaining: 1h 35m 27s. Rate: 7.8 symbols/min [2025-09-29T20:28:47.314305] [INFO ] [MAIN ] PAR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:28:47.348079] [DEBUG] [LOCAL ] PAR: Loaded 33188 existing records from primary storage. [2025-09-29T20:28:47.348395] [INFO ] [MAIN ] PAR: Loaded 33188 existing records. [2025-09-29T20:28:47.548816] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-06. [2025-09-29T20:28:47.553117] [WARN ] [MAIN ] PAR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:28:47.554326] [INFO ] [MAIN ] PAR: Wiping existing primary data before full refresh. [2025-09-29T20:28:47.554382] [INFO ] [LOCAL ] PAR: Starting deletion of primary data. [2025-09-29T20:28:47.554636] [DEBUG] [LOCAL ] PAR: Deleted primary data file. [2025-09-29T20:28:47.554727] [INFO ] [MAIN ] PAR: Starting full primary refresh. [2025-09-29T20:28:47.944255] [INFO ] [REMOTE ] PAR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:28:48.086372] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-29T20:28:48.130827] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-29T20:28:48.178130] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-29T20:28:48.348133] [INFO ] [REMOTE ] PAR: Fetching primary data for 2024-12. [2025-09-29T20:28:49.148125] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-07. [2025-09-29T20:28:49.543853] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-29T20:28:49.663826] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-29T20:28:49.948135] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-06. [2025-09-29T20:28:50.748162] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-06. [2025-09-29T20:28:51.548087] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-08. [2025-09-29T20:28:51.726102] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-29T20:28:51.790220] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-29T20:28:52.348115] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-07. [2025-09-29T20:28:52.833078] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-29T20:28:53.148114] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-07. [2025-09-29T20:28:53.634043] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-29T20:28:53.948173] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-09. [2025-09-29T20:28:54.384781] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-29T20:28:54.399972] [INFO ] [REMOTE ] PAI: Full fetch complete (4120 records). [2025-09-29T20:28:54.400189] [DEBUG] [VALIDATOR ] PAI: Validating primary data. [2025-09-29T20:28:54.753400] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-01. [2025-09-29T20:28:54.945959] [DEBUG] [VALIDATOR ] PAI: All expected trading days are present. [2025-09-29T20:28:54.946070] [DEBUG] [VALIDATOR ] PAI: Primary data validation passed. [2025-09-29T20:28:54.946310] [INFO ] [MAIN ] PAI: Fetched primary data is valid. [2025-09-29T20:28:54.946439] [DEBUG] [LOCAL ] PAI: Saving primary data. [2025-09-29T20:28:54.947169] [DEBUG] [LOCAL ] PAI: Trimmed 4120 records to 2720 (keeping 200 days of data) [2025-09-29T20:28:54.966596] [DEBUG] [LOCAL ] PAI: Primary data saved (2720 records). [2025-09-29T20:28:54.966772] [INFO ] [MAIN ] PAI: Full history saved. [2025-09-29T20:28:54.966906] [INFO ] [MAIN ] Update Progress: 1628/2371 symbols completed. PAI took 26.1s. Estimated remaining: 1h 35m 19s. Rate: 7.8 symbols/min [2025-09-29T20:28:55.167204] [INFO ] [MAIN ] PARR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:28:55.203404] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-29T20:28:55.262429] [DEBUG] [LOCAL ] PARR: Loaded 49062 existing records from primary storage. [2025-09-29T20:28:55.262824] [INFO ] [MAIN ] PARR: Loaded 49062 existing records. [2025-09-29T20:28:55.463107] [WARN ] [MAIN ] PARR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:28:55.463552] [INFO ] [MAIN ] PARR: Wiping existing primary data before full refresh. [2025-09-29T20:28:55.463613] [INFO ] [LOCAL ] PARR: Starting deletion of primary data. [2025-09-29T20:28:55.464247] [DEBUG] [LOCAL ] PARR: Deleted primary data file. [2025-09-29T20:28:55.464324] [INFO ] [MAIN ] PARR: Starting full primary refresh. [2025-09-29T20:28:55.553195] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-08. [2025-09-29T20:28:55.863063] [INFO ] [REMOTE ] PARR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:28:56.312879] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-29T20:28:56.348068] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-02. [2025-09-29T20:28:56.947839] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-29T20:28:57.148120] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-08. [2025-09-29T20:28:57.761805] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-29T20:28:57.948113] [INFO ] [REMOTE ] PARR: Fetching primary data for 2024-12. [2025-09-29T20:28:58.748089] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-09. [2025-09-29T20:28:58.932990] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-29T20:28:59.547974] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-29T20:28:59.548174] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-09. [2025-09-29T20:28:59.776184] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-29T20:28:59.788754] [INFO ] [REMOTE ] PAM: Full fetch complete (41995 records). [2025-09-29T20:28:59.789011] [DEBUG] [VALIDATOR ] PAM: Validating primary data. [2025-09-29T20:29:00.187200] [DEBUG] [VALIDATOR ] PAM: All expected trading days are present. [2025-09-29T20:29:00.187286] [DEBUG] [VALIDATOR ] PAM: Primary data validation passed. [2025-09-29T20:29:00.188191] [INFO ] [MAIN ] PAM: Fetched primary data is valid. [2025-09-29T20:29:00.188268] [DEBUG] [LOCAL ] PAM: Saving primary data. [2025-09-29T20:29:00.189240] [DEBUG] [LOCAL ] PAM: Trimmed 41995 records to 28012 (keeping 200 days of data) [2025-09-29T20:29:00.348117] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-01. [2025-09-29T20:29:00.364813] [DEBUG] [LOCAL ] PAM: Primary data saved (28012 records). [2025-09-29T20:29:00.365006] [INFO ] [MAIN ] PAM: Full history saved. [2025-09-29T20:29:00.365113] [INFO ] [MAIN ] Update Progress: 1629/2371 symbols completed. PAM took 24.5s. Estimated remaining: 1h 35m 11s. Rate: 7.8 symbols/min [2025-09-29T20:29:00.542052] [INFO ] [MAIN ] PATH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:29:00.600755] [DEBUG] [LOCAL ] PATH: Loaded 54457 existing records from primary storage. [2025-09-29T20:29:00.601168] [INFO ] [MAIN ] PATH: Loaded 54457 existing records. [2025-09-29T20:29:00.827557] [WARN ] [MAIN ] PATH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:29:00.827819] [INFO ] [MAIN ] PATH: Wiping existing primary data before full refresh. [2025-09-29T20:29:00.827891] [INFO ] [LOCAL ] PATH: Starting deletion of primary data. [2025-09-29T20:29:00.828219] [DEBUG] [LOCAL ] PATH: Deleted primary data file. [2025-09-29T20:29:00.828281] [INFO ] [MAIN ] PATH: Starting full primary refresh. [2025-09-29T20:29:01.152555] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-03. [2025-09-29T20:29:01.228782] [INFO ] [REMOTE ] PATH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:29:01.332080] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-29T20:29:01.343563] [INFO ] [REMOTE ] PAGS: Full fetch complete (76328 records). [2025-09-29T20:29:01.343752] [DEBUG] [VALIDATOR ] PAGS: Validating primary data. [2025-09-29T20:29:01.781037] [DEBUG] [VALIDATOR ] PAGS: All expected trading days are present. [2025-09-29T20:29:01.781293] [DEBUG] [VALIDATOR ] PAGS: Primary data validation passed. [2025-09-29T20:29:01.782453] [INFO ] [MAIN ] PAGS: Fetched primary data is valid. [2025-09-29T20:29:01.782530] [DEBUG] [LOCAL ] PAGS: Saving primary data. [2025-09-29T20:29:01.786483] [DEBUG] [LOCAL ] PAGS: Trimmed 76328 records to 52691 (keeping 200 days of data) [2025-09-29T20:29:01.962517] [INFO ] [REMOTE ] PATH: Fetching primary data for 2024-12. [2025-09-29T20:29:02.046457] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-29T20:29:02.154478] [DEBUG] [LOCAL ] PAGS: Primary data saved (52691 records). [2025-09-29T20:29:02.154613] [INFO ] [MAIN ] PAGS: Full history saved. [2025-09-29T20:29:02.154756] [INFO ] [MAIN ] Update Progress: 1630/2371 symbols completed. PAGS took 35.4s. Estimated remaining: 1h 35m 0s. Rate: 7.8 symbols/min [2025-09-29T20:29:02.329749] [INFO ] [MAIN ] PAXS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:29:02.351558] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-29T20:29:02.472997] [DEBUG] [LOCAL ] PAXS: Loaded 21210 existing records from primary storage. [2025-09-29T20:29:02.473305] [INFO ] [MAIN ] PAXS: Loaded 21210 existing records. [2025-09-29T20:29:02.666519] [WARN ] [MAIN ] PAXS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:29:02.666807] [INFO ] [MAIN ] PAXS: Wiping existing primary data before full refresh. [2025-09-29T20:29:02.666905] [INFO ] [LOCAL ] PAXS: Starting deletion of primary data. [2025-09-29T20:29:02.667160] [DEBUG] [LOCAL ] PAXS: Deleted primary data file. [2025-09-29T20:29:02.667219] [INFO ] [MAIN ] PAXS: Starting full primary refresh. [2025-09-29T20:29:02.753239] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-02. [2025-09-29T20:29:03.057808] [INFO ] [REMOTE ] PAXS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:29:03.548088] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-04. [2025-09-29T20:29:04.351219] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2024-12. [2025-09-29T20:29:04.370941] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-29T20:29:04.549290] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2024-12 (2.59 seconds). [2025-09-29T20:29:04.991018] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-29T20:29:05.148113] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-05. [2025-09-29T20:29:05.457697] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-29T20:29:05.948118] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-01. [2025-09-29T20:29:06.598139] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-29T20:29:06.748115] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-01. [2025-09-29T20:29:07.070288] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-29T20:29:07.548121] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-02. [2025-09-29T20:29:08.250831] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-29T20:29:08.348103] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-03. [2025-09-29T20:29:08.788827] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-29T20:29:09.136681] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-29T20:29:09.148063] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-04. [2025-09-29T20:29:09.948108] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-06. [2025-09-29T20:29:10.380997] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-29T20:29:10.748179] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-03. [2025-09-29T20:29:11.225047] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-29T20:29:11.548158] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-07. [2025-09-29T20:29:12.348149] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-05. [2025-09-29T20:29:12.454315] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-29T20:29:12.633000] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-29T20:29:13.148089] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-02. [2025-09-29T20:29:13.164428] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-29T20:29:13.948161] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-04. [2025-09-29T20:29:14.748158] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-06. [2025-09-29T20:29:15.522291] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-09-29T20:29:15.548073] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-03. [2025-09-29T20:29:15.752453] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-29T20:29:15.942167] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-29T20:29:16.348126] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-07. [2025-09-29T20:29:17.148148] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-05. [2025-09-29T20:29:17.600253] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-29T20:29:17.948093] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-08. [2025-09-29T20:29:18.060989] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-09-29T20:29:18.748147] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-08. [2025-09-29T20:29:18.861777] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-29T20:29:19.051765] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-29T20:29:19.548160] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-04. [2025-09-29T20:29:20.355307] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-06. [2025-09-29T20:29:20.372320] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-29T20:29:21.148124] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-09. [2025-09-29T20:29:21.526013] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-29T20:29:21.603325] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-29T20:29:21.948120] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-05. [2025-09-29T20:29:22.646049] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-29T20:29:22.654932] [INFO ] [REMOTE ] PAR: Full fetch complete (47445 records). [2025-09-29T20:29:22.655087] [DEBUG] [VALIDATOR ] PAR: Validating primary data. [2025-09-29T20:29:22.753539] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-09. [2025-09-29T20:29:23.048462] [DEBUG] [VALIDATOR ] PAR: All expected trading days are present. [2025-09-29T20:29:23.048551] [DEBUG] [VALIDATOR ] PAR: Primary data validation passed. [2025-09-29T20:29:23.049525] [INFO ] [MAIN ] PAR: Fetched primary data is valid. [2025-09-29T20:29:23.049594] [DEBUG] [LOCAL ] PAR: Saving primary data. [2025-09-29T20:29:23.050781] [DEBUG] [LOCAL ] PAR: Trimmed 47445 records to 32589 (keeping 200 days of data) [2025-09-29T20:29:23.258068] [DEBUG] [LOCAL ] PAR: Primary data saved (32589 records). [2025-09-29T20:29:23.258253] [INFO ] [MAIN ] PAR: Full history saved. [2025-09-29T20:29:23.258379] [INFO ] [MAIN ] Update Progress: 1631/2371 symbols completed. PAR took 36.1s. Estimated remaining: 1h 34m 59s. Rate: 7.8 symbols/min [2025-09-29T20:29:23.440843] [INFO ] [MAIN ] PAY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:29:23.477778] [DEBUG] [LOCAL ] PAY: Loaded 38892 existing records from primary storage. [2025-09-29T20:29:23.478112] [INFO ] [MAIN ] PAY: Loaded 38892 existing records. [2025-09-29T20:29:23.549961] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-07. [2025-09-29T20:29:23.677422] [WARN ] [MAIN ] PAY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:29:23.677710] [INFO ] [MAIN ] PAY: Wiping existing primary data before full refresh. [2025-09-29T20:29:23.677797] [INFO ] [LOCAL ] PAY: Starting deletion of primary data. [2025-09-29T20:29:23.678043] [DEBUG] [LOCAL ] PAY: Deleted primary data file. [2025-09-29T20:29:23.678101] [INFO ] [MAIN ] PAY: Starting full primary refresh. [2025-09-29T20:29:23.908681] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-29T20:29:23.970673] [INFO ] [REMOTE ] PAXS: Full fetch complete (31045 records). [2025-09-29T20:29:23.989866] [DEBUG] [VALIDATOR ] PAXS: Validating primary data. [2025-09-29T20:29:24.179700] [INFO ] [REMOTE ] PAY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:29:24.352045] [INFO ] [REMOTE ] PAY: Fetching primary data for 2024-12. [2025-09-29T20:29:24.526009] [DEBUG] [VALIDATOR ] PAXS: All expected trading days are present. [2025-09-29T20:29:24.555524] [DEBUG] [VALIDATOR ] PAXS: Primary data validation passed. [2025-09-29T20:29:24.556327] [INFO ] [MAIN ] PAXS: Fetched primary data is valid. [2025-09-29T20:29:24.556601] [DEBUG] [LOCAL ] PAXS: Saving primary data. [2025-09-29T20:29:24.558706] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-05 (2.61 seconds). [2025-09-29T20:29:24.571217] [DEBUG] [LOCAL ] PAXS: Trimmed 31045 records to 20778 (keeping 200 days of data) [2025-09-29T20:29:24.721934] [DEBUG] [LOCAL ] PAXS: Primary data saved (20778 records). [2025-09-29T20:29:24.722046] [INFO ] [MAIN ] PAXS: Full history saved. [2025-09-29T20:29:24.722132] [INFO ] [MAIN ] Update Progress: 1632/2371 symbols completed. PAXS took 22.6s. Estimated remaining: 1h 34m 48s. Rate: 7.8 symbols/min [2025-09-29T20:29:24.909033] [INFO ] [MAIN ] PAYC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:29:24.946026] [DEBUG] [LOCAL ] PAYC: Loaded 36903 existing records from primary storage. [2025-09-29T20:29:24.946317] [INFO ] [MAIN ] PAYC: Loaded 36903 existing records. [2025-09-29T20:29:25.137270] [WARN ] [MAIN ] PAYC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:29:25.137524] [INFO ] [MAIN ] PAYC: Wiping existing primary data before full refresh. [2025-09-29T20:29:25.137583] [INFO ] [LOCAL ] PAYC: Starting deletion of primary data. [2025-09-29T20:29:25.137844] [DEBUG] [LOCAL ] PAYC: Deleted primary data file. [2025-09-29T20:29:25.137903] [INFO ] [MAIN ] PAYC: Starting full primary refresh. [2025-09-29T20:29:25.153210] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-06. [2025-09-29T20:29:25.592370] [INFO ] [REMOTE ] PAYC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:29:25.595416] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-29T20:29:25.627449] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-29T20:29:25.948117] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-01. [2025-09-29T20:29:26.748112] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2024-12. [2025-09-29T20:29:27.280934] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-29T20:29:27.422083] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-29T20:29:27.548117] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-02. [2025-09-29T20:29:28.320192] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-29T20:29:28.348070] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-01. [2025-09-29T20:29:28.435402] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-29T20:29:29.148149] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-07. [2025-09-29T20:29:29.829605] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-29T20:29:29.948131] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-02. [2025-09-29T20:29:30.748092] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-08. [2025-09-29T20:29:31.553716] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-03. [2025-09-29T20:29:31.557414] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-09-29T20:29:31.654213] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-29T20:29:32.348097] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-08. [2025-09-29T20:29:32.500322] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-29T20:29:32.804822] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-29T20:29:33.148111] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-04. [2025-09-29T20:29:33.948153] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-09. [2025-09-29T20:29:34.609615] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-29T20:29:34.731771] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-09-29T20:29:34.748070] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-09. [2025-09-29T20:29:35.548095] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-05. [2025-09-29T20:29:35.751529] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-29T20:29:35.761810] [INFO ] [REMOTE ] PARR: Full fetch complete (68741 records). [2025-09-29T20:29:35.761961] [DEBUG] [VALIDATOR ] PARR: Validating primary data. [2025-09-29T20:29:36.165705] [DEBUG] [VALIDATOR ] PARR: All expected trading days are present. [2025-09-29T20:29:36.165797] [DEBUG] [VALIDATOR ] PARR: Primary data validation passed. [2025-09-29T20:29:36.166830] [INFO ] [MAIN ] PARR: Fetched primary data is valid. [2025-09-29T20:29:36.166893] [DEBUG] [LOCAL ] PARR: Saving primary data. [2025-09-29T20:29:36.168337] [DEBUG] [LOCAL ] PARR: Trimmed 68741 records to 48354 (keeping 200 days of data) [2025-09-29T20:29:36.352944] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-03. [2025-09-29T20:29:36.474594] [DEBUG] [LOCAL ] PARR: Primary data saved (48354 records). [2025-09-29T20:29:36.474786] [INFO ] [MAIN ] PARR: Full history saved. [2025-09-29T20:29:36.474891] [INFO ] [MAIN ] Update Progress: 1633/2371 symbols completed. PARR took 41.5s. Estimated remaining: 1h 34m 42s. Rate: 7.8 symbols/min [2025-09-29T20:29:36.709326] [INFO ] [MAIN ] PB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:29:36.767844] [DEBUG] [LOCAL ] PB: Loaded 42025 existing records from primary storage. [2025-09-29T20:29:36.768347] [INFO ] [MAIN ] PB: Loaded 42025 existing records. [2025-09-29T20:29:37.086872] [WARN ] [MAIN ] PB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:29:37.087471] [INFO ] [MAIN ] PB: Wiping existing primary data before full refresh. [2025-09-29T20:29:37.087707] [INFO ] [LOCAL ] PB: Starting deletion of primary data. [2025-09-29T20:29:37.088361] [DEBUG] [LOCAL ] PB: Deleted primary data file. [2025-09-29T20:29:37.088999] [INFO ] [MAIN ] PB: Starting full primary refresh. [2025-09-29T20:29:37.225525] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-29T20:29:37.281447] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-06. [2025-09-29T20:29:37.356030] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-09 (2.61 seconds). [2025-09-29T20:29:37.443529] [INFO ] [REMOTE ] PATH: Full fetch complete (77764 records). [2025-09-29T20:29:37.455785] [DEBUG] [VALIDATOR ] PATH: Validating primary data. [2025-09-29T20:29:37.747501] [INFO ] [REMOTE ] PB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:29:37.957385] [INFO ] [REMOTE ] PB: Fetching primary data for 2024-12. [2025-09-29T20:29:38.000855] [DEBUG] [VALIDATOR ] PATH: All expected trading days are present. [2025-09-29T20:29:38.001032] [DEBUG] [VALIDATOR ] PATH: Primary data validation passed. [2025-09-29T20:29:38.002318] [INFO ] [MAIN ] PATH: Fetched primary data is valid. [2025-09-29T20:29:38.002596] [DEBUG] [LOCAL ] PATH: Saving primary data. [2025-09-29T20:29:38.004373] [DEBUG] [LOCAL ] PATH: Trimmed 77764 records to 53677 (keeping 200 days of data) [2025-09-29T20:29:38.247373] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-29T20:29:38.379843] [DEBUG] [LOCAL ] PATH: Primary data saved (53677 records). [2025-09-29T20:29:38.379992] [INFO ] [MAIN ] PATH: Full history saved. [2025-09-29T20:29:38.380095] [INFO ] [MAIN ] Update Progress: 1634/2371 symbols completed. PATH took 38.0s. Estimated remaining: 1h 34m 32s. Rate: 7.8 symbols/min [2025-09-29T20:29:38.572307] [INFO ] [MAIN ] PBA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:29:38.620700] [DEBUG] [LOCAL ] PBA: Loaded 49665 existing records from primary storage. [2025-09-29T20:29:38.621047] [INFO ] [MAIN ] PBA: Loaded 49665 existing records. [2025-09-29T20:29:38.754178] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-04. [2025-09-29T20:29:38.818780] [WARN ] [MAIN ] PBA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:29:38.818976] [INFO ] [MAIN ] PBA: Wiping existing primary data before full refresh. [2025-09-29T20:29:38.819024] [INFO ] [LOCAL ] PBA: Starting deletion of primary data. [2025-09-29T20:29:38.819425] [DEBUG] [LOCAL ] PBA: Deleted primary data file. [2025-09-29T20:29:38.819484] [INFO ] [MAIN ] PBA: Starting full primary refresh. [2025-09-29T20:29:39.224697] [INFO ] [REMOTE ] PBA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:29:39.227133] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-29T20:29:39.548111] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-07. [2025-09-29T20:29:39.588086] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-29T20:29:40.054302] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-29T20:29:40.348170] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-05. [2025-09-29T20:29:41.157226] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-01. [2025-09-29T20:29:41.162903] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-29T20:29:41.899127] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-29T20:29:41.948171] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-06. [2025-09-29T20:29:42.682421] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-29T20:29:42.748137] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-02. [2025-09-29T20:29:43.431618] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-29T20:29:43.548094] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-07. [2025-09-29T20:29:44.348116] [INFO ] [REMOTE ] PBA: Fetching primary data for 2024-12. [2025-09-29T20:29:45.148285] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-08. [2025-09-29T20:29:45.262048] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-29T20:29:45.469710] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-02 (2.72 seconds). [2025-09-29T20:29:45.948134] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-08. [2025-09-29T20:29:46.190422] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-29T20:29:46.748190] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-01. [2025-09-29T20:29:47.428403] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-09-29T20:29:47.511161] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-29T20:29:47.548127] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-09. [2025-09-29T20:29:48.084508] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-29T20:29:48.348151] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-02. [2025-09-29T20:29:48.729313] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-29T20:29:48.738092] [INFO ] [REMOTE ] PAY: Full fetch complete (53285 records). [2025-09-29T20:29:48.738217] [DEBUG] [VALIDATOR ] PAY: Validating primary data. [2025-09-29T20:29:49.156842] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-09. [2025-09-29T20:29:49.177213] [DEBUG] [VALIDATOR ] PAY: All expected trading days are present. [2025-09-29T20:29:49.177337] [DEBUG] [VALIDATOR ] PAY: Primary data validation passed. [2025-09-29T20:29:49.178278] [INFO ] [MAIN ] PAY: Fetched primary data is valid. [2025-09-29T20:29:49.178439] [DEBUG] [LOCAL ] PAY: Saving primary data. [2025-09-29T20:29:49.179816] [DEBUG] [LOCAL ] PAY: Trimmed 53285 records to 38117 (keeping 200 days of data) [2025-09-29T20:29:49.414205] [DEBUG] [LOCAL ] PAY: Primary data saved (38117 records). [2025-09-29T20:29:49.414352] [INFO ] [MAIN ] PAY: Full history saved. [2025-09-29T20:29:49.414437] [INFO ] [MAIN ] Update Progress: 1635/2371 symbols completed. PAY took 26.2s. Estimated remaining: 1h 34m 26s. Rate: 7.8 symbols/min [2025-09-29T20:29:49.592867] [INFO ] [MAIN ] PBF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:29:49.647428] [DEBUG] [LOCAL ] PBF: Loaded 53866 existing records from primary storage. [2025-09-29T20:29:49.647834] [INFO ] [MAIN ] PBF: Loaded 53866 existing records. [2025-09-29T20:29:49.855578] [WARN ] [MAIN ] PBF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:29:49.856054] [INFO ] [MAIN ] PBF: Wiping existing primary data before full refresh. [2025-09-29T20:29:49.856154] [INFO ] [LOCAL ] PBF: Starting deletion of primary data. [2025-09-29T20:29:49.856879] [DEBUG] [LOCAL ] PBF: Deleted primary data file. [2025-09-29T20:29:49.856944] [INFO ] [MAIN ] PBF: Starting full primary refresh. [2025-09-29T20:29:49.955064] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-03. [2025-09-29T20:29:50.241751] [INFO ] [REMOTE ] PBF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:29:50.271179] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-29T20:29:50.753743] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-03. [2025-09-29T20:29:50.756299] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-29T20:29:50.764832] [INFO ] [REMOTE ] PAYC: Full fetch complete (52955 records). [2025-09-29T20:29:50.765001] [DEBUG] [VALIDATOR ] PAYC: Validating primary data. [2025-09-29T20:29:51.181097] [DEBUG] [VALIDATOR ] PAYC: All expected trading days are present. [2025-09-29T20:29:51.181298] [DEBUG] [VALIDATOR ] PAYC: Primary data validation passed. [2025-09-29T20:29:51.182527] [INFO ] [MAIN ] PAYC: Fetched primary data is valid. [2025-09-29T20:29:51.182685] [DEBUG] [LOCAL ] PAYC: Saving primary data. [2025-09-29T20:29:51.184330] [DEBUG] [LOCAL ] PAYC: Trimmed 52955 records to 36232 (keeping 200 days of data) [2025-09-29T20:29:51.302341] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-29T20:29:51.458621] [DEBUG] [LOCAL ] PAYC: Primary data saved (36232 records). [2025-09-29T20:29:51.458797] [INFO ] [MAIN ] PAYC: Full history saved. [2025-09-29T20:29:51.461057] [INFO ] [MAIN ] Update Progress: 1636/2371 symbols completed. PAYC took 26.7s. Estimated remaining: 1h 34m 16s. Rate: 7.8 symbols/min [2025-09-29T20:29:51.557135] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-04. [2025-09-29T20:29:51.645366] [INFO ] [MAIN ] PBH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:29:51.683283] [DEBUG] [LOCAL ] PBH: Loaded 32156 existing records from primary storage. [2025-09-29T20:29:51.683571] [INFO ] [MAIN ] PBH: Loaded 32156 existing records. [2025-09-29T20:29:51.887022] [WARN ] [MAIN ] PBH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:29:51.887429] [INFO ] [MAIN ] PBH: Wiping existing primary data before full refresh. [2025-09-29T20:29:51.887480] [INFO ] [LOCAL ] PBH: Starting deletion of primary data. [2025-09-29T20:29:51.887908] [DEBUG] [LOCAL ] PBH: Deleted primary data file. [2025-09-29T20:29:51.887982] [INFO ] [MAIN ] PBH: Starting full primary refresh. [2025-09-29T20:29:52.260174] [INFO ] [REMOTE ] PBH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:29:52.348089] [INFO ] [REMOTE ] PBH: Fetching primary data for 2024-12. [2025-09-29T20:29:52.570235] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-29T20:29:52.878794] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-29T20:29:53.078246] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-29T20:29:53.148086] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-01. [2025-09-29T20:29:53.948131] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-05. [2025-09-29T20:29:54.438267] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-29T20:29:54.748136] [INFO ] [REMOTE ] PBF: Fetching primary data for 2024-12. [2025-09-29T20:29:55.437258] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-29T20:29:55.548123] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-06. [2025-09-29T20:29:56.348093] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-02. [2025-09-29T20:29:56.521419] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-29T20:29:57.136296] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-29T20:29:57.148059] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-07. [2025-09-29T20:29:57.227856] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-29T20:29:57.948132] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-04. [2025-09-29T20:29:58.748110] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-03. [2025-09-29T20:29:58.787366] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-29T20:29:59.548141] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-08. [2025-09-29T20:29:59.783072] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-29T20:30:00.275635] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-29T20:30:00.348152] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-04. [2025-09-29T20:30:01.148130] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-05. [2025-09-29T20:30:01.245254] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-29T20:30:01.948158] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-09. [2025-09-29T20:30:02.014923] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-29T20:30:02.748092] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-05. [2025-09-29T20:30:02.857696] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-29T20:30:03.548198] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-06. [2025-09-29T20:30:03.785454] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-29T20:30:03.795125] [INFO ] [REMOTE ] PB: Full fetch complete (58273 records). [2025-09-29T20:30:03.795268] [DEBUG] [VALIDATOR ] PB: Validating primary data. [2025-09-29T20:30:04.215273] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-29T20:30:04.260275] [DEBUG] [VALIDATOR ] PB: All expected trading days are present. [2025-09-29T20:30:04.260364] [DEBUG] [VALIDATOR ] PB: Primary data validation passed. [2025-09-29T20:30:04.261378] [INFO ] [MAIN ] PB: Fetched primary data is valid. [2025-09-29T20:30:04.261451] [DEBUG] [LOCAL ] PB: Saving primary data. [2025-09-29T20:30:04.262703] [DEBUG] [LOCAL ] PB: Trimmed 58273 records to 41341 (keeping 200 days of data) [2025-09-29T20:30:04.353836] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-06. [2025-09-29T20:30:04.527727] [DEBUG] [LOCAL ] PB: Primary data saved (41341 records). [2025-09-29T20:30:04.527885] [INFO ] [MAIN ] PB: Full history saved. [2025-09-29T20:30:04.527974] [INFO ] [MAIN ] Update Progress: 1637/2371 symbols completed. PB took 28.1s. Estimated remaining: 1h 34m 10s. Rate: 7.8 symbols/min [2025-09-29T20:30:05.148124] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-01. [2025-09-29T20:30:05.212535] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-29T20:30:05.467502] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-29T20:30:05.948110] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-07. [2025-09-29T20:30:06.748120] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-07. [2025-09-29T20:30:06.998188] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-29T20:30:07.041269] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-29T20:30:07.548115] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-02. [2025-09-29T20:30:08.348101] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-08. [2025-09-29T20:30:08.511694] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-29T20:30:09.142808] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-29T20:30:09.152866] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-08. [2025-09-29T20:30:09.561522] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-29T20:30:09.948124] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-03. [2025-09-29T20:30:10.748073] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-09. [2025-09-29T20:30:10.939987] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-29T20:30:11.548123] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-09. [2025-09-29T20:30:11.942107] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-29T20:30:11.979514] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-29T20:30:11.987758] [INFO ] [REMOTE ] PBH: Full fetch complete (43252 records). [2025-09-29T20:30:11.987900] [DEBUG] [VALIDATOR ] PBH: Validating primary data. [2025-09-29T20:30:12.353245] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-04. [2025-09-29T20:30:12.410849] [DEBUG] [VALIDATOR ] PBH: All expected trading days are present. [2025-09-29T20:30:12.410973] [DEBUG] [VALIDATOR ] PBH: Primary data validation passed. [2025-09-29T20:30:12.411890] [INFO ] [MAIN ] PBH: Fetched primary data is valid. [2025-09-29T20:30:12.411958] [DEBUG] [LOCAL ] PBH: Saving primary data. [2025-09-29T20:30:12.413412] [DEBUG] [LOCAL ] PBH: Trimmed 43252 records to 31703 (keeping 200 days of data) [2025-09-29T20:30:12.613366] [DEBUG] [LOCAL ] PBH: Primary data saved (31703 records). [2025-09-29T20:30:12.613513] [INFO ] [MAIN ] PBH: Full history saved. [2025-09-29T20:30:12.613599] [INFO ] [MAIN ] Update Progress: 1638/2371 symbols completed. PBH took 21.2s. Estimated remaining: 1h 34m 3s. Rate: 7.8 symbols/min [2025-09-29T20:30:13.390175] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-29T20:30:13.401182] [INFO ] [REMOTE ] PBA: Full fetch complete (71459 records). [2025-09-29T20:30:13.401361] [DEBUG] [VALIDATOR ] PBA: Validating primary data. [2025-09-29T20:30:13.817216] [DEBUG] [VALIDATOR ] PBA: All expected trading days are present. [2025-09-29T20:30:13.817357] [DEBUG] [VALIDATOR ] PBA: Primary data validation passed. [2025-09-29T20:30:13.818686] [INFO ] [MAIN ] PBA: Fetched primary data is valid. [2025-09-29T20:30:13.818820] [DEBUG] [LOCAL ] PBA: Saving primary data. [2025-09-29T20:30:13.820624] [DEBUG] [LOCAL ] PBA: Trimmed 71459 records to 48910 (keeping 200 days of data) [2025-09-29T20:30:13.963382] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-29T20:30:13.991741] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-05. [2025-09-29T20:30:14.227499] [DEBUG] [LOCAL ] PBA: Primary data saved (48910 records). [2025-09-29T20:30:14.227734] [INFO ] [MAIN ] PBA: Full history saved. [2025-09-29T20:30:14.227837] [INFO ] [MAIN ] Update Progress: 1639/2371 symbols completed. PBA took 35.8s. Estimated remaining: 1h 33m 52s. Rate: 7.8 symbols/min [2025-09-29T20:30:16.017603] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-29T20:30:16.029756] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-06. [2025-09-29T20:30:17.830478] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-29T20:30:17.841590] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-07. [2025-09-29T20:30:19.749093] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-29T20:30:19.761096] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-08. [2025-09-29T20:30:21.726995] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-29T20:30:21.738891] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-09. [2025-09-29T20:30:25.953334] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-09 (4.21 seconds). [2025-09-29T20:30:25.964638] [INFO ] [REMOTE ] PBF: Full fetch complete (76586 records). [2025-09-29T20:30:25.964858] [DEBUG] [VALIDATOR ] PBF: Validating primary data. [2025-09-29T20:30:26.391748] [DEBUG] [VALIDATOR ] PBF: All expected trading days are present. [2025-09-29T20:30:26.391841] [DEBUG] [VALIDATOR ] PBF: Primary data validation passed. [2025-09-29T20:30:26.392954] [INFO ] [MAIN ] PBF: Fetched primary data is valid. [2025-09-29T20:30:26.393019] [DEBUG] [LOCAL ] PBF: Saving primary data. [2025-09-29T20:30:26.394471] [DEBUG] [LOCAL ] PBF: Trimmed 76586 records to 53095 (keeping 200 days of data) [2025-09-29T20:30:26.744730] [DEBUG] [LOCAL ] PBF: Primary data saved (53095 records). [2025-09-29T20:30:26.744906] [INFO ] [MAIN ] PBF: Full history saved. [2025-09-29T20:30:26.745059] [INFO ] [MAIN ] Update Progress: 1640/2371 symbols completed. PBF took 37.3s. Estimated remaining: 1h 33m 47s. Rate: 7.8 symbols/min [2025-09-29T20:30:27.462313] [INFO ] [MAIN ] PCF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:30:27.468503] [INFO ] [MAIN ] PBI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:30:27.401408] [INFO ] [MAIN ] PBR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:30:27.492702] [INFO ] [MAIN ] PBT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:30:27.505196] [DEBUG] [LOCAL ] PCF: Loaded 8720 existing records from primary storage. [2025-09-29T20:30:27.505549] [INFO ] [MAIN ] PCF: Loaded 8720 existing records. [2025-09-29T20:30:27.628765] [DEBUG] [LOCAL ] PBT: Loaded 17533 existing records from primary storage. [2025-09-29T20:30:27.640061] [INFO ] [MAIN ] PBT: Loaded 17533 existing records. [2025-09-29T20:30:27.803183] [WARN ] [MAIN ] PCF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:30:27.861468] [INFO ] [MAIN ] PCF: Wiping existing primary data before full refresh. [2025-09-29T20:30:27.883770] [DEBUG] [LOCAL ] PBI: Loaded 50788 existing records from primary storage. [2025-09-29T20:30:27.861742] [INFO ] [LOCAL ] PCF: Starting deletion of primary data. [2025-09-29T20:30:27.898216] [DEBUG] [LOCAL ] PCF: Deleted primary data file. [2025-09-29T20:30:27.903886] [INFO ] [MAIN ] PCF: Starting full primary refresh. [2025-09-29T20:30:27.898420] [INFO ] [MAIN ] PBI: Loaded 50788 existing records. [2025-09-29T20:30:28.178737] [WARN ] [MAIN ] PBT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:30:28.229336] [DEBUG] [LOCAL ] PBR: Loaded 54492 existing records from primary storage. [2025-09-29T20:30:28.245332] [INFO ] [MAIN ] PBT: Wiping existing primary data before full refresh. [2025-09-29T20:30:28.279577] [INFO ] [LOCAL ] PBT: Starting deletion of primary data. [2025-09-29T20:30:28.304152] [INFO ] [MAIN ] PBR: Loaded 54492 existing records. [2025-09-29T20:30:28.326190] [DEBUG] [LOCAL ] PBT: Deleted primary data file. [2025-09-29T20:30:28.363762] [INFO ] [MAIN ] PBT: Starting full primary refresh. [2025-09-29T20:30:28.597026] [WARN ] [MAIN ] PBI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:30:28.697565] [INFO ] [MAIN ] PBI: Wiping existing primary data before full refresh. [2025-09-29T20:30:28.767272] [INFO ] [LOCAL ] PBI: Starting deletion of primary data. [2025-09-29T20:30:28.814222] [DEBUG] [LOCAL ] PBI: Deleted primary data file. [2025-09-29T20:30:28.829512] [INFO ] [MAIN ] PBI: Starting full primary refresh. [2025-09-29T20:30:28.998468] [WARN ] [MAIN ] PBR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:30:29.139036] [INFO ] [MAIN ] PBR: Wiping existing primary data before full refresh. [2025-09-29T20:30:29.199860] [INFO ] [REMOTE ] PCF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:30:29.209189] [INFO ] [LOCAL ] PBR: Starting deletion of primary data. [2025-09-29T20:30:29.230462] [INFO ] [REMOTE ] PCF: Fetching primary data for 2024-12. [2025-09-29T20:30:29.281345] [DEBUG] [LOCAL ] PBR: Deleted primary data file. [2025-09-29T20:30:29.303591] [INFO ] [MAIN ] PBR: Starting full primary refresh. [2025-09-29T20:30:29.630453] [INFO ] [REMOTE ] PBT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:30:29.691997] [INFO ] [REMOTE ] PBT: Fetching primary data for 2024-12. [2025-09-29T20:30:29.873160] [INFO ] [REMOTE ] PBI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:30:29.915247] [INFO ] [REMOTE ] PBI: Fetching primary data for 2024-12. [2025-09-29T20:30:30.086148] [INFO ] [REMOTE ] PBR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:30:30.086478] [INFO ] [REMOTE ] PBR: Fetching primary data for 2024-12. [2025-09-29T20:30:30.470166] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-29T20:30:30.474510] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-01. [2025-09-29T20:30:30.968153] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-29T20:30:30.973174] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-01. [2025-09-29T20:30:31.137520] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-29T20:30:31.140452] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-02. [2025-09-29T20:30:31.865022] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-29T20:30:31.876461] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-01. [2025-09-29T20:30:31.901478] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-29T20:30:31.906192] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-02. [2025-09-29T20:30:32.115400] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-29T20:30:32.118545] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-03. [2025-09-29T20:30:32.451374] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2024-12 (2.36 seconds). [2025-09-29T20:30:32.462880] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-01. [2025-09-29T20:30:33.073156] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-29T20:30:33.077698] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-29T20:30:33.078631] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-03. [2025-09-29T20:30:33.083007] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-04. [2025-09-29T20:30:33.384510] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-29T20:30:33.394961] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-02. [2025-09-29T20:30:33.812883] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-29T20:30:33.816034] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-05. [2025-09-29T20:30:33.829159] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-29T20:30:33.834061] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-04. [2025-09-29T20:30:34.377674] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-29T20:30:34.380253] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-06. [2025-09-29T20:30:34.478728] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-29T20:30:34.482712] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-05. [2025-09-29T20:30:34.628885] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-09-29T20:30:34.640101] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-02. [2025-09-29T20:30:35.177457] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-29T20:30:35.180857] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-07. [2025-09-29T20:30:35.219001] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-29T20:30:35.230664] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-03. [2025-09-29T20:30:35.540743] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-29T20:30:35.545026] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-06. [2025-09-29T20:30:36.131849] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-29T20:30:36.135666] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-08. [2025-09-29T20:30:36.442889] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-29T20:30:36.453795] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-03. [2025-09-29T20:30:36.666326] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-29T20:30:36.670268] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-09. [2025-09-29T20:30:36.745725] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-29T20:30:36.783288] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-29T20:30:37.148133] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-04. [2025-09-29T20:30:37.597526] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-29T20:30:37.601011] [INFO ] [REMOTE ] PCF: Full fetch complete (14243 records). [2025-09-29T20:30:37.601185] [DEBUG] [VALIDATOR ] PCF: Validating primary data. [2025-09-29T20:30:37.958115] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-07. [2025-09-29T20:30:37.995906] [DEBUG] [VALIDATOR ] PCF: All expected trading days are present. [2025-09-29T20:30:37.995995] [DEBUG] [VALIDATOR ] PCF: Primary data validation passed. [2025-09-29T20:30:37.996423] [INFO ] [MAIN ] PCF: Fetched primary data is valid. [2025-09-29T20:30:37.996489] [DEBUG] [LOCAL ] PCF: Saving primary data. [2025-09-29T20:30:37.997083] [DEBUG] [LOCAL ] PCF: Trimmed 14243 records to 8692 (keeping 200 days of data) [2025-09-29T20:30:38.060734] [DEBUG] [LOCAL ] PCF: Primary data saved (8692 records). [2025-09-29T20:30:38.060880] [INFO ] [MAIN ] PCF: Full history saved. [2025-09-29T20:30:38.061073] [INFO ] [MAIN ] Update Progress: 1641/2371 symbols completed. PCF took 11.3s. Estimated remaining: 1h 33m 41s. Rate: 7.8 symbols/min [2025-09-29T20:30:38.238588] [INFO ] [MAIN ] PCG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:30:38.304915] [DEBUG] [LOCAL ] PCG: Loaded 54498 existing records from primary storage. [2025-09-29T20:30:38.305283] [INFO ] [MAIN ] PCG: Loaded 54498 existing records. [2025-09-29T20:30:38.500695] [WARN ] [MAIN ] PCG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:30:38.501349] [INFO ] [MAIN ] PCG: Wiping existing primary data before full refresh. [2025-09-29T20:30:38.501481] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-09-29T20:30:38.502009] [DEBUG] [LOCAL ] PCG: Deleted primary data file. [2025-09-29T20:30:38.502072] [INFO ] [MAIN ] PCG: Starting full primary refresh. [2025-09-29T20:30:39.049774] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-29T20:30:39.048118] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-29T20:30:39.065316] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-03 (2.61 seconds). [2025-09-29T20:30:39.111557] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-08. [2025-09-29T20:30:39.126030] [INFO ] [REMOTE ] PCG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:30:39.548186] [INFO ] [REMOTE ] PCG: Fetching primary data for 2024-12. [2025-09-29T20:30:40.295984] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-29T20:30:40.348146] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-05. [2025-09-29T20:30:41.148103] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-09. [2025-09-29T20:30:41.622617] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-29T20:30:41.948105] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-01. [2025-09-29T20:30:42.141968] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-29T20:30:42.231433] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-29T20:30:42.235732] [INFO ] [REMOTE ] PBT: Full fetch complete (25287 records). [2025-09-29T20:30:42.235859] [DEBUG] [VALIDATOR ] PBT: Validating primary data. [2025-09-29T20:30:42.633425] [DEBUG] [VALIDATOR ] PBT: All expected trading days are present. [2025-09-29T20:30:42.633510] [DEBUG] [VALIDATOR ] PBT: Primary data validation passed. [2025-09-29T20:30:42.634146] [INFO ] [MAIN ] PBT: Fetched primary data is valid. [2025-09-29T20:30:42.634212] [DEBUG] [LOCAL ] PBT: Saving primary data. [2025-09-29T20:30:42.635346] [DEBUG] [LOCAL ] PBT: Trimmed 25287 records to 17219 (keeping 200 days of data) [2025-09-29T20:30:42.748115] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-04. [2025-09-29T20:30:42.748384] [DEBUG] [LOCAL ] PBT: Primary data saved (17219 records). [2025-09-29T20:30:42.749359] [INFO ] [MAIN ] PBT: Full history saved. [2025-09-29T20:30:42.749480] [INFO ] [MAIN ] Update Progress: 1642/2371 symbols completed. PBT took 16.0s. Estimated remaining: 1h 33m 32s. Rate: 7.8 symbols/min [2025-09-29T20:30:42.928882] [INFO ] [MAIN ] PCM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:30:42.938330] [DEBUG] [LOCAL ] PCM: Loaded 6857 existing records from primary storage. [2025-09-29T20:30:42.938526] [INFO ] [MAIN ] PCM: Loaded 6857 existing records. [2025-09-29T20:30:43.121149] [WARN ] [MAIN ] PCM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:30:43.121377] [INFO ] [MAIN ] PCM: Wiping existing primary data before full refresh. [2025-09-29T20:30:43.121476] [INFO ] [LOCAL ] PCM: Starting deletion of primary data. [2025-09-29T20:30:43.121785] [DEBUG] [LOCAL ] PCM: Deleted primary data file. [2025-09-29T20:30:43.121846] [INFO ] [MAIN ] PCM: Starting full primary refresh. [2025-09-29T20:30:43.494490] [INFO ] [REMOTE ] PCM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:30:43.548087] [INFO ] [REMOTE ] PCM: Fetching primary data for 2024-12. [2025-09-29T20:30:43.864626] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-29T20:30:44.319319] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-29T20:30:44.348100] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-06. [2025-09-29T20:30:45.088889] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-29T20:30:45.148103] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-05. [2025-09-29T20:30:45.948119] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-01. [2025-09-29T20:30:46.199445] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-29T20:30:46.528583] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-29T20:30:46.748170] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-02. [2025-09-29T20:30:47.378308] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-29T20:30:47.548175] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-07. [2025-09-29T20:30:48.348173] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-02. [2025-09-29T20:30:48.726760] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-29T20:30:49.013953] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-29T20:30:49.148118] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-03. [2025-09-29T20:30:49.429291] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-29T20:30:49.948148] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-03. [2025-09-29T20:30:50.724811] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-29T20:30:50.757839] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-04. [2025-09-29T20:30:50.779552] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-29T20:30:51.548105] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-08. [2025-09-29T20:30:51.588409] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-29T20:30:52.348135] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-05. [2025-09-29T20:30:53.052631] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-29T20:30:53.148093] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-06. [2025-09-29T20:30:53.348724] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-29T20:30:53.948121] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-06. [2025-09-29T20:30:54.749366] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-04. [2025-09-29T20:30:54.750967] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-29T20:30:55.384617] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-29T20:30:55.548111] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-07. [2025-09-29T20:30:56.348100] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-09. [2025-09-29T20:30:56.617867] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-29T20:30:57.153218] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-07. [2025-09-29T20:30:57.171260] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-29T20:30:57.946883] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-29T20:30:57.948705] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-05. [2025-09-29T20:30:58.055758] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-29T20:30:58.066447] [INFO ] [REMOTE ] PBI: Full fetch complete (72046 records). [2025-09-29T20:30:58.066665] [DEBUG] [VALIDATOR ] PBI: Validating primary data. [2025-09-29T20:30:58.518903] [DEBUG] [VALIDATOR ] PBI: All expected trading days are present. [2025-09-29T20:30:58.519012] [DEBUG] [VALIDATOR ] PBI: Primary data validation passed. [2025-09-29T20:30:58.520283] [INFO ] [MAIN ] PBI: Fetched primary data is valid. [2025-09-29T20:30:58.520355] [DEBUG] [LOCAL ] PBI: Saving primary data. [2025-09-29T20:30:58.521930] [DEBUG] [LOCAL ] PBI: Trimmed 72046 records to 50003 (keeping 200 days of data) [2025-09-29T20:30:58.748235] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-08. [2025-09-29T20:30:58.845339] [DEBUG] [LOCAL ] PBI: Primary data saved (50003 records). [2025-09-29T20:30:58.845481] [INFO ] [MAIN ] PBI: Full history saved. [2025-09-29T20:30:58.845595] [INFO ] [MAIN ] Update Progress: 1643/2371 symbols completed. PBI took 32.1s. Estimated remaining: 1h 33m 28s. Rate: 7.8 symbols/min [2025-09-29T20:30:59.036715] [INFO ] [MAIN ] PCN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:30:59.064524] [DEBUG] [LOCAL ] PCN: Loaded 24709 existing records from primary storage. [2025-09-29T20:30:59.064822] [INFO ] [MAIN ] PCN: Loaded 24709 existing records. [2025-09-29T20:30:59.251154] [WARN ] [MAIN ] PCN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:30:59.251352] [INFO ] [MAIN ] PCN: Wiping existing primary data before full refresh. [2025-09-29T20:30:59.251401] [INFO ] [LOCAL ] PCN: Starting deletion of primary data. [2025-09-29T20:30:59.251822] [DEBUG] [LOCAL ] PCN: Deleted primary data file. [2025-09-29T20:30:59.251883] [INFO ] [MAIN ] PCN: Starting full primary refresh. [2025-09-29T20:30:59.551950] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-08. [2025-09-29T20:30:59.591169] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-29T20:30:59.681300] [INFO ] [REMOTE ] PCN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:30:59.912594] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-29T20:31:00.348120] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-06. [2025-09-29T20:31:01.148089] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-09. [2025-09-29T20:31:01.481151] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-29T20:31:01.948090] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-09. [2025-09-29T20:31:02.070008] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-29T20:31:02.072786] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-29T20:31:02.076142] [INFO ] [REMOTE ] PCM: Full fetch complete (10419 records). [2025-09-29T20:31:02.088282] [DEBUG] [VALIDATOR ] PCM: Validating primary data. [2025-09-29T20:31:02.489738] [DEBUG] [VALIDATOR ] PCM: All expected trading days are present. [2025-09-29T20:31:02.489831] [DEBUG] [VALIDATOR ] PCM: Primary data validation passed. [2025-09-29T20:31:02.490105] [INFO ] [MAIN ] PCM: Fetched primary data is valid. [2025-09-29T20:31:02.490148] [DEBUG] [LOCAL ] PCM: Saving primary data. [2025-09-29T20:31:02.490738] [DEBUG] [LOCAL ] PCM: Trimmed 10419 records to 6781 (keeping 200 days of data) [2025-09-29T20:31:02.536029] [DEBUG] [LOCAL ] PCM: Primary data saved (6781 records). [2025-09-29T20:31:02.536232] [INFO ] [MAIN ] PCM: Full history saved. [2025-09-29T20:31:02.536420] [INFO ] [MAIN ] Update Progress: 1644/2371 symbols completed. PCM took 19.8s. Estimated remaining: 1h 33m 18s. Rate: 7.8 symbols/min [2025-09-29T20:31:02.761487] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-07. [2025-09-29T20:31:02.767604] [INFO ] [MAIN ] PCOR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:31:02.823766] [DEBUG] [LOCAL ] PCOR: Loaded 48849 existing records from primary storage. [2025-09-29T20:31:02.824119] [INFO ] [MAIN ] PCOR: Loaded 48849 existing records. [2025-09-29T20:31:03.021252] [WARN ] [MAIN ] PCOR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:31:03.021522] [INFO ] [MAIN ] PCOR: Wiping existing primary data before full refresh. [2025-09-29T20:31:03.021571] [INFO ] [LOCAL ] PCOR: Starting deletion of primary data. [2025-09-29T20:31:03.022036] [DEBUG] [LOCAL ] PCOR: Deleted primary data file. [2025-09-29T20:31:03.022097] [INFO ] [MAIN ] PCOR: Starting full primary refresh. [2025-09-29T20:31:03.398322] [INFO ] [REMOTE ] PCOR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:31:03.548126] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2024-12. [2025-09-29T20:31:04.158798] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-29T20:31:04.170083] [INFO ] [REMOTE ] PBR: Full fetch complete (77776 records). [2025-09-29T20:31:04.170266] [DEBUG] [VALIDATOR ] PBR: Validating primary data. [2025-09-29T20:31:04.356430] [INFO ] [REMOTE ] PCN: Fetching primary data for 2024-12. [2025-09-29T20:31:04.598985] [DEBUG] [VALIDATOR ] PBR: All expected trading days are present. [2025-09-29T20:31:04.599071] [DEBUG] [VALIDATOR ] PBR: Primary data validation passed. [2025-09-29T20:31:04.600363] [INFO ] [MAIN ] PBR: Fetched primary data is valid. [2025-09-29T20:31:04.600431] [DEBUG] [LOCAL ] PBR: Saving primary data. [2025-09-29T20:31:04.604327] [DEBUG] [LOCAL ] PBR: Trimmed 77776 records to 53712 (keeping 200 days of data) [2025-09-29T20:31:05.002522] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-29T20:31:05.038913] [DEBUG] [LOCAL ] PBR: Primary data saved (53712 records). [2025-09-29T20:31:05.039177] [INFO ] [MAIN ] PBR: Full history saved. [2025-09-29T20:31:05.039400] [INFO ] [MAIN ] Update Progress: 1645/2371 symbols completed. PBR took 38.3s. Estimated remaining: 1h 33m 8s. Rate: 7.8 symbols/min [2025-09-29T20:31:05.148582] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-08. [2025-09-29T20:31:05.261325] [INFO ] [MAIN ] PCQ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:31:05.256375] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-29T20:31:05.291152] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-29T20:31:05.306638] [DEBUG] [LOCAL ] PCQ: Loaded 12298 existing records from primary storage. [2025-09-29T20:31:05.306927] [INFO ] [MAIN ] PCQ: Loaded 12298 existing records. [2025-09-29T20:31:05.491576] [WARN ] [MAIN ] PCQ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:31:05.491823] [INFO ] [MAIN ] PCQ: Wiping existing primary data before full refresh. [2025-09-29T20:31:05.491879] [INFO ] [LOCAL ] PCQ: Starting deletion of primary data. [2025-09-29T20:31:05.492131] [DEBUG] [LOCAL ] PCQ: Deleted primary data file. [2025-09-29T20:31:05.492196] [INFO ] [MAIN ] PCQ: Starting full primary refresh. [2025-09-29T20:31:05.940949] [INFO ] [REMOTE ] PCQ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:31:05.948065] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2024-12. [2025-09-29T20:31:06.748115] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-01. [2025-09-29T20:31:06.849722] [DEBUG] [REMOTE ] PCOR: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-09-29T20:31:06.850044] [WARN ] [REMOTE ] PCOR: No data returned for month 2025-01 [2025-09-29T20:31:06.850136] [FATAL] [REMOTE ] PCOR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T20:31:06.850217] [FATAL] [MAIN ] PCOR: Failed to fetch primary data. [2025-09-29T20:31:06.850280] [WARN ] [MAIN ] PCOR: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T20:31:06.850352] [INFO ] [LOCAL ] PCOR: Starting deletion of primary data. [2025-09-29T20:31:06.850423] [DEBUG] [LOCAL ] PCOR: No primary data file found to delete. [2025-09-29T20:31:06.850459] [INFO ] [LOCAL ] PCOR: Starting deletion of derivative data. [2025-09-29T20:31:06.851054] [DEBUG] [LOCAL ] PCOR: Deleted derivative data file. [2025-09-29T20:31:06.851143] [INFO ] [MAIN ] Update Progress: 1646/2371 symbols completed. PCOR took 4.3s. Estimated remaining: 1h 32m 58s. Rate: 7.8 symbols/min [2025-09-29T20:31:07.040398] [INFO ] [MAIN ] PD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:31:07.098610] [DEBUG] [LOCAL ] PD: Loaded 48580 existing records from primary storage. [2025-09-29T20:31:07.098982] [INFO ] [MAIN ] PD: Loaded 48580 existing records. [2025-09-29T20:31:07.180213] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-29T20:31:07.309875] [WARN ] [MAIN ] PD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:31:07.310326] [INFO ] [MAIN ] PD: Wiping existing primary data before full refresh. [2025-09-29T20:31:07.310602] [INFO ] [LOCAL ] PD: Starting deletion of primary data. [2025-09-29T20:31:07.311028] [DEBUG] [LOCAL ] PD: Deleted primary data file. [2025-09-29T20:31:07.311095] [INFO ] [MAIN ] PD: Starting full primary refresh. [2025-09-29T20:31:07.460598] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-29T20:31:07.556823] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-01. [2025-09-29T20:31:07.789936] [INFO ] [REMOTE ] PD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:31:08.328336] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-29T20:31:08.348071] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-02. [2025-09-29T20:31:09.148143] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-09. [2025-09-29T20:31:09.242138] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-29T20:31:09.948087] [INFO ] [REMOTE ] PD: Fetching primary data for 2024-12. [2025-09-29T20:31:10.080965] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-29T20:31:10.091923] [INFO ] [REMOTE ] PCG: Full fetch complete (77345 records). [2025-09-29T20:31:10.092123] [DEBUG] [VALIDATOR ] PCG: Validating primary data. [2025-09-29T20:31:10.093240] [FATAL] [VALIDATOR ] PCG: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T20:31:10.093376] [FATAL] [MAIN ] PCG: Fetched primary data is invalid. Refusing to save it. [2025-09-29T20:31:10.093425] [WARN ] [MAIN ] PCG: Deleting existing primary and derivative data due to validation failure. [2025-09-29T20:31:10.093480] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-09-29T20:31:10.093563] [DEBUG] [LOCAL ] PCG: No primary data file found to delete. [2025-09-29T20:31:10.093622] [INFO ] [LOCAL ] PCG: Starting deletion of derivative data. [2025-09-29T20:31:10.094150] [DEBUG] [LOCAL ] PCG: Deleted derivative data file. [2025-09-29T20:31:10.094276] [INFO ] [MAIN ] Update Progress: 1647/2371 symbols completed. PCG took 32.0s. Estimated remaining: 1h 32m 48s. Rate: 7.8 symbols/min [2025-09-29T20:31:10.296908] [INFO ] [MAIN ] PDCC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:31:10.297115] [DEBUG] [LOCAL ] PDCC: No existing data file found in primary storage. [2025-09-29T20:31:10.297171] [WARN ] [MAIN ] PDCC: No existing data found, performing full refresh instead. [2025-09-29T20:31:10.297317] [INFO ] [MAIN ] PDCC: Wiping existing primary data before full refresh. [2025-09-29T20:31:10.297390] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-09-29T20:31:10.297454] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-09-29T20:31:10.297491] [INFO ] [MAIN ] PDCC: Starting full primary refresh. [2025-09-29T20:31:10.682492] [INFO ] [REMOTE ] PDCC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:31:10.748152] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-03. [2025-09-29T20:31:11.548092] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-01. [2025-09-29T20:31:11.659384] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-29T20:31:11.736756] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-29T20:31:12.348098] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-04. [2025-09-29T20:31:12.522142] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-29T20:31:13.148163] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-01. [2025-09-29T20:31:13.380439] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-29T20:31:13.948180] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2024-12. [2025-09-29T20:31:14.112480] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2024-12 (0.16 seconds). [2025-09-29T20:31:14.697130] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-29T20:31:14.748115] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-02. [2025-09-29T20:31:15.548119] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-05. [2025-09-29T20:31:16.338155] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-29T20:31:16.348058] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-03. [2025-09-29T20:31:16.466757] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-29T20:31:17.148124] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-01. [2025-09-29T20:31:17.544566] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-29T20:31:17.803954] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-29T20:31:17.948160] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-02. [2025-09-29T20:31:18.444119] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-29T20:31:18.748159] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-06. [2025-09-29T20:31:19.548159] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-04. [2025-09-29T20:31:19.638156] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-29T20:31:20.348153] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-03. [2025-09-29T20:31:20.685384] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-29T20:31:21.110225] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-29T20:31:21.148132] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-07. [2025-09-29T20:31:21.948147] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-04. [2025-09-29T20:31:22.037197] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-29T20:31:22.688120] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-29T20:31:22.748130] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-02. [2025-09-29T20:31:23.548169] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-08. [2025-09-29T20:31:23.971508] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-29T20:31:24.348139] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-05. [2025-09-29T20:31:24.674111] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-29T20:31:25.148115] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-09. [2025-09-29T20:31:25.948164] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-05. [2025-09-29T20:31:26.142067] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-29T20:31:26.173347] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-09-29T20:31:26.192135] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-29T20:31:26.195801] [INFO ] [REMOTE ] PCQ: Full fetch complete (17566 records). [2025-09-29T20:31:26.195927] [DEBUG] [VALIDATOR ] PCQ: Validating primary data. [2025-09-29T20:31:26.593663] [DEBUG] [VALIDATOR ] PCQ: All expected trading days are present. [2025-09-29T20:31:26.593817] [DEBUG] [VALIDATOR ] PCQ: Primary data validation passed. [2025-09-29T20:31:26.594263] [INFO ] [MAIN ] PCQ: Fetched primary data is valid. [2025-09-29T20:31:26.594346] [DEBUG] [LOCAL ] PCQ: Saving primary data. [2025-09-29T20:31:26.595069] [DEBUG] [LOCAL ] PCQ: Trimmed 17566 records to 12253 (keeping 200 days of data) [2025-09-29T20:31:26.678407] [DEBUG] [LOCAL ] PCQ: Primary data saved (12253 records). [2025-09-29T20:31:26.678683] [INFO ] [MAIN ] PCQ: Full history saved. [2025-09-29T20:31:26.678827] [INFO ] [MAIN ] Update Progress: 1648/2371 symbols completed. PCQ took 21.6s. Estimated remaining: 1h 32m 45s. Rate: 7.8 symbols/min [2025-09-29T20:31:26.753345] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-06. [2025-09-29T20:31:26.880477] [INFO ] [MAIN ] PDI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:31:26.943718] [DEBUG] [LOCAL ] PDI: Loaded 50909 existing records from primary storage. [2025-09-29T20:31:26.944170] [INFO ] [MAIN ] PDI: Loaded 50909 existing records. [2025-09-29T20:31:27.140214] [WARN ] [MAIN ] PDI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:31:27.142301] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-29T20:31:27.143468] [INFO ] [MAIN ] PDI: Wiping existing primary data before full refresh. [2025-09-29T20:31:27.143529] [INFO ] [LOCAL ] PDI: Starting deletion of primary data. [2025-09-29T20:31:27.143922] [DEBUG] [LOCAL ] PDI: Deleted primary data file. [2025-09-29T20:31:27.143999] [INFO ] [MAIN ] PDI: Starting full primary refresh. [2025-09-29T20:31:27.521312] [INFO ] [REMOTE ] PDI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:31:27.548125] [INFO ] [REMOTE ] PDI: Fetching primary data for 2024-12. [2025-09-29T20:31:28.348155] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-06. [2025-09-29T20:31:29.148140] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-07. [2025-09-29T20:31:29.485002] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-29T20:31:29.948161] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-01. [2025-09-29T20:31:29.982632] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-29T20:31:30.032011] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-29T20:31:30.748156] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-07. [2025-09-29T20:31:31.548175] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-08. [2025-09-29T20:31:31.947987] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-29T20:31:32.007637] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-29T20:31:32.312835] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-29T20:31:32.348082] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-09. [2025-09-29T20:31:32.552093] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-09 (0.20 seconds). [2025-09-29T20:31:32.552904] [INFO ] [REMOTE ] PDCC: Full fetch complete (1338 records). [2025-09-29T20:31:32.552976] [DEBUG] [VALIDATOR ] PDCC: Validating primary data. [2025-09-29T20:31:32.553368] [FATAL] [VALIDATOR ] PDCC: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T20:31:32.553452] [FATAL] [MAIN ] PDCC: Fetched primary data is invalid. Refusing to save it. [2025-09-29T20:31:32.553495] [WARN ] [MAIN ] PDCC: Deleting existing primary and derivative data due to validation failure. [2025-09-29T20:31:32.553533] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-09-29T20:31:32.553589] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-09-29T20:31:32.553636] [INFO ] [LOCAL ] PDCC: Starting deletion of derivative data. [2025-09-29T20:31:32.553740] [DEBUG] [LOCAL ] PDCC: No derivative data file found to delete. [2025-09-29T20:31:32.553837] [INFO ] [MAIN ] Update Progress: 1649/2371 symbols completed. PDCC took 22.5s. Estimated remaining: 1h 32m 36s. Rate: 7.8 symbols/min [2025-09-29T20:31:32.730128] [INFO ] [MAIN ] PDM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:31:32.770225] [DEBUG] [LOCAL ] PDM: Loaded 40354 existing records from primary storage. [2025-09-29T20:31:32.770522] [INFO ] [MAIN ] PDM: Loaded 40354 existing records. [2025-09-29T20:31:32.949097] [WARN ] [MAIN ] PDM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:31:32.949300] [INFO ] [MAIN ] PDM: Wiping existing primary data before full refresh. [2025-09-29T20:31:32.949347] [INFO ] [LOCAL ] PDM: Starting deletion of primary data. [2025-09-29T20:31:32.949609] [DEBUG] [LOCAL ] PDM: Deleted primary data file. [2025-09-29T20:31:32.949703] [INFO ] [MAIN ] PDM: Starting full primary refresh. [2025-09-29T20:31:33.153275] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-03. [2025-09-29T20:31:33.319195] [INFO ] [REMOTE ] PDM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:31:33.948171] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-02. [2025-09-29T20:31:34.509566] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-29T20:31:34.748151] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-08. [2025-09-29T20:31:35.548103] [INFO ] [REMOTE ] PDM: Fetching primary data for 2024-12. [2025-09-29T20:31:35.741760] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-29T20:31:36.348131] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-03. [2025-09-29T20:31:36.641193] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-29T20:31:37.102002] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-29T20:31:37.148066] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-01. [2025-09-29T20:31:37.948104] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-09. [2025-09-29T20:31:38.007974] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-29T20:31:38.709843] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-29T20:31:38.748150] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-02. [2025-09-29T20:31:39.548156] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-04. [2025-09-29T20:31:39.613623] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-29T20:31:39.624638] [INFO ] [REMOTE ] PD: Full fetch complete (67615 records). [2025-09-29T20:31:39.624845] [DEBUG] [VALIDATOR ] PD: Validating primary data. [2025-09-29T20:31:40.074551] [DEBUG] [VALIDATOR ] PD: All expected trading days are present. [2025-09-29T20:31:40.074748] [DEBUG] [VALIDATOR ] PD: Primary data validation passed. [2025-09-29T20:31:40.076158] [INFO ] [MAIN ] PD: Fetched primary data is valid. [2025-09-29T20:31:40.076248] [DEBUG] [LOCAL ] PD: Saving primary data. [2025-09-29T20:31:40.078347] [DEBUG] [LOCAL ] PD: Trimmed 67615 records to 47885 (keeping 200 days of data) [2025-09-29T20:31:40.192722] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-29T20:31:40.348210] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-03. [2025-09-29T20:31:40.416810] [DEBUG] [LOCAL ] PD: Primary data saved (47885 records). [2025-09-29T20:31:40.416978] [INFO ] [MAIN ] PD: Full history saved. [2025-09-29T20:31:40.417114] [INFO ] [MAIN ] Update Progress: 1650/2371 symbols completed. PD took 33.6s. Estimated remaining: 1h 32m 28s. Rate: 7.8 symbols/min [2025-09-29T20:31:40.600526] [INFO ] [MAIN ] PDO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:31:40.636800] [DEBUG] [LOCAL ] PDO: Loaded 32146 existing records from primary storage. [2025-09-29T20:31:40.637180] [INFO ] [MAIN ] PDO: Loaded 32146 existing records. [2025-09-29T20:31:40.827514] [WARN ] [MAIN ] PDO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:31:40.827779] [INFO ] [MAIN ] PDO: Wiping existing primary data before full refresh. [2025-09-29T20:31:40.827832] [INFO ] [LOCAL ] PDO: Starting deletion of primary data. [2025-09-29T20:31:40.828219] [DEBUG] [LOCAL ] PDO: Deleted primary data file. [2025-09-29T20:31:40.828309] [INFO ] [MAIN ] PDO: Starting full primary refresh. [2025-09-29T20:31:41.162176] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-04. [2025-09-29T20:31:41.208347] [INFO ] [REMOTE ] PDO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:31:41.620146] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-29T20:31:41.906990] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-29T20:31:41.948135] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-04. [2025-09-29T20:31:42.553774] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-29T20:31:42.748168] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-05. [2025-09-29T20:31:43.277769] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-29T20:31:43.548135] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-05. [2025-09-29T20:31:44.348143] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-05. [2025-09-29T20:31:44.661778] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-29T20:31:45.148077] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-06. [2025-09-29T20:31:45.237613] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-29T20:31:45.552309] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-29T20:31:45.948156] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-06. [2025-09-29T20:31:46.748167] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-06. [2025-09-29T20:31:46.957249] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-29T20:31:47.481116] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-29T20:31:47.548143] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-07. [2025-09-29T20:31:47.593528] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-29T20:31:48.348122] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-07. [2025-09-29T20:31:49.148307] [INFO ] [REMOTE ] PDO: Fetching primary data for 2024-12. [2025-09-29T20:31:49.431588] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-29T20:31:49.647863] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-29T20:31:49.948143] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-07. [2025-09-29T20:31:50.748132] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-08. [2025-09-29T20:31:50.896087] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-29T20:31:51.525332] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-29T20:31:51.548068] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-08. [2025-09-29T20:31:52.348116] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-01. [2025-09-29T20:31:52.704753] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-29T20:31:53.106567] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-29T20:31:53.148096] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-09. [2025-09-29T20:31:53.948121] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-08. [2025-09-29T20:31:53.974938] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-29T20:31:54.477948] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-29T20:31:54.486472] [INFO ] [REMOTE ] PDM: Full fetch complete (57350 records). [2025-09-29T20:31:54.486690] [DEBUG] [VALIDATOR ] PDM: Validating primary data. [2025-09-29T20:31:54.760253] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-02. [2025-09-29T20:31:54.907422] [DEBUG] [VALIDATOR ] PDM: All expected trading days are present. [2025-09-29T20:31:54.907519] [DEBUG] [VALIDATOR ] PDM: Primary data validation passed. [2025-09-29T20:31:54.908581] [INFO ] [MAIN ] PDM: Fetched primary data is valid. [2025-09-29T20:31:54.908681] [DEBUG] [LOCAL ] PDM: Saving primary data. [2025-09-29T20:31:54.909972] [DEBUG] [LOCAL ] PDM: Trimmed 57350 records to 39713 (keeping 200 days of data) [2025-09-29T20:31:55.167836] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-29T20:31:55.182202] [DEBUG] [LOCAL ] PDM: Primary data saved (39713 records). [2025-09-29T20:31:55.182342] [INFO ] [MAIN ] PDM: Full history saved. [2025-09-29T20:31:55.182425] [INFO ] [MAIN ] Update Progress: 1651/2371 symbols completed. PDM took 22.6s. Estimated remaining: 1h 32m 24s. Rate: 7.8 symbols/min [2025-09-29T20:31:55.365498] [INFO ] [MAIN ] PDS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:31:55.388314] [DEBUG] [LOCAL ] PDS: Loaded 18297 existing records from primary storage. [2025-09-29T20:31:55.388574] [INFO ] [MAIN ] PDS: Loaded 18297 existing records. [2025-09-29T20:31:55.553236] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-09. [2025-09-29T20:31:55.587135] [WARN ] [MAIN ] PDS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:31:55.587513] [INFO ] [MAIN ] PDS: Wiping existing primary data before full refresh. [2025-09-29T20:31:55.587590] [INFO ] [LOCAL ] PDS: Starting deletion of primary data. [2025-09-29T20:31:55.587979] [DEBUG] [LOCAL ] PDS: Deleted primary data file. [2025-09-29T20:31:55.588040] [INFO ] [MAIN ] PDS: Starting full primary refresh. [2025-09-29T20:31:55.971410] [INFO ] [REMOTE ] PDS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:31:56.271422] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-29T20:31:56.348074] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-03. [2025-09-29T20:31:56.968421] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-29T20:31:56.977456] [INFO ] [REMOTE ] PCN: Full fetch complete (34036 records). [2025-09-29T20:31:56.977606] [DEBUG] [VALIDATOR ] PCN: Validating primary data. [2025-09-29T20:31:57.155945] [INFO ] [REMOTE ] PDS: Fetching primary data for 2024-12. [2025-09-29T20:31:57.402762] [DEBUG] [VALIDATOR ] PCN: All expected trading days are present. [2025-09-29T20:31:57.402921] [DEBUG] [VALIDATOR ] PCN: Primary data validation passed. [2025-09-29T20:31:57.403631] [INFO ] [MAIN ] PCN: Fetched primary data is valid. [2025-09-29T20:31:57.403713] [DEBUG] [LOCAL ] PCN: Saving primary data. [2025-09-29T20:31:57.404755] [DEBUG] [LOCAL ] PCN: Trimmed 34036 records to 24404 (keeping 200 days of data) [2025-09-29T20:31:57.570900] [DEBUG] [LOCAL ] PCN: Primary data saved (24404 records). [2025-09-29T20:31:57.571043] [INFO ] [MAIN ] PCN: Full history saved. [2025-09-29T20:31:57.571151] [INFO ] [MAIN ] Update Progress: 1652/2371 symbols completed. PCN took 58.7s. Estimated remaining: 1h 32m 14s. Rate: 7.8 symbols/min [2025-09-29T20:31:57.753739] [INFO ] [MAIN ] PDT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:31:57.775357] [DEBUG] [LOCAL ] PDT: Loaded 17549 existing records from primary storage. [2025-09-29T20:31:57.775610] [INFO ] [MAIN ] PDT: Loaded 17549 existing records. [2025-09-29T20:31:57.953193] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-09. [2025-09-29T20:31:57.979056] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-29T20:31:58.004895] [WARN ] [MAIN ] PDT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:31:58.014988] [INFO ] [MAIN ] PDT: Wiping existing primary data before full refresh. [2025-09-29T20:31:58.015099] [INFO ] [LOCAL ] PDT: Starting deletion of primary data. [2025-09-29T20:31:58.015563] [DEBUG] [LOCAL ] PDT: Deleted primary data file. [2025-09-29T20:31:58.015629] [INFO ] [MAIN ] PDT: Starting full primary refresh. [2025-09-29T20:31:58.408576] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-29T20:31:58.471180] [INFO ] [REMOTE ] PDT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:31:58.748135] [INFO ] [REMOTE ] PDT: Fetching primary data for 2024-12. [2025-09-29T20:31:59.548140] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-01. [2025-09-29T20:32:00.000952] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-29T20:32:00.012022] [INFO ] [REMOTE ] PDI: Full fetch complete (73036 records). [2025-09-29T20:32:00.012192] [DEBUG] [VALIDATOR ] PDI: Validating primary data. [2025-09-29T20:32:00.313478] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-29T20:32:00.355704] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-01. [2025-09-29T20:32:00.473292] [DEBUG] [VALIDATOR ] PDI: All expected trading days are present. [2025-09-29T20:32:00.473447] [DEBUG] [VALIDATOR ] PDI: Primary data validation passed. [2025-09-29T20:32:00.474716] [INFO ] [MAIN ] PDI: Fetched primary data is valid. [2025-09-29T20:32:00.474788] [DEBUG] [LOCAL ] PDI: Saving primary data. [2025-09-29T20:32:00.476478] [DEBUG] [LOCAL ] PDI: Trimmed 73036 records to 50108 (keeping 200 days of data) [2025-09-29T20:32:00.718519] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-29T20:32:00.829146] [DEBUG] [LOCAL ] PDI: Primary data saved (50108 records). [2025-09-29T20:32:00.829302] [INFO ] [MAIN ] PDI: Full history saved. [2025-09-29T20:32:00.829393] [INFO ] [MAIN ] Update Progress: 1653/2371 symbols completed. PDI took 34.2s. Estimated remaining: 1h 32m 4s. Rate: 7.8 symbols/min [2025-09-29T20:32:01.012565] [INFO ] [MAIN ] PDX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:32:01.033692] [DEBUG] [LOCAL ] PDX: Loaded 14514 existing records from primary storage. [2025-09-29T20:32:01.034017] [INFO ] [MAIN ] PDX: Loaded 14514 existing records. [2025-09-29T20:32:01.155808] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-04. [2025-09-29T20:32:01.275343] [WARN ] [MAIN ] PDX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:32:01.275877] [INFO ] [MAIN ] PDX: Wiping existing primary data before full refresh. [2025-09-29T20:32:01.275943] [INFO ] [LOCAL ] PDX: Starting deletion of primary data. [2025-09-29T20:32:01.276327] [DEBUG] [LOCAL ] PDX: Deleted primary data file. [2025-09-29T20:32:01.276389] [INFO ] [MAIN ] PDX: Starting full primary refresh. [2025-09-29T20:32:01.534504] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-29T20:32:01.773228] [INFO ] [REMOTE ] PDX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:32:01.948110] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-02. [2025-09-29T20:32:02.748117] [INFO ] [REMOTE ] PDX: Fetching primary data for 2024-12. [2025-09-29T20:32:02.829149] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-29T20:32:02.850403] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-29T20:32:03.548116] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-05. [2025-09-29T20:32:03.958319] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-29T20:32:04.348173] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-02. [2025-09-29T20:32:04.907481] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-29T20:32:05.105337] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-29T20:32:05.148178] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-03. [2025-09-29T20:32:05.948141] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-03. [2025-09-29T20:32:06.305915] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-29T20:32:06.748153] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-04. [2025-09-29T20:32:07.247560] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-29T20:32:07.548169] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-04. [2025-09-29T20:32:08.075539] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-29T20:32:08.348140] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-05. [2025-09-29T20:32:08.616062] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-29T20:32:09.148121] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-05. [2025-09-29T20:32:09.464971] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-29T20:32:09.948164] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-06. [2025-09-29T20:32:10.204240] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-29T20:32:10.748152] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-06. [2025-09-29T20:32:11.158569] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-29T20:32:11.548078] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-06. [2025-09-29T20:32:11.855829] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-29T20:32:12.348136] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-01. [2025-09-29T20:32:12.985455] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-29T20:32:13.148171] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-07. [2025-09-29T20:32:13.674810] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-29T20:32:13.948124] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-02. [2025-09-29T20:32:14.552867] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-29T20:32:14.748091] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-08. [2025-09-29T20:32:15.039012] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-29T20:32:15.548129] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-07. [2025-09-29T20:32:16.334624] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-29T20:32:16.348140] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-03. [2025-09-29T20:32:16.713939] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-29T20:32:17.001468] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-29T20:32:17.148146] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-08. [2025-09-29T20:32:17.948093] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-09. [2025-09-29T20:32:18.318547] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-29T20:32:18.748158] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-07. [2025-09-29T20:32:19.261098] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-29T20:32:19.267941] [INFO ] [REMOTE ] PDO: Full fetch complete (47789 records). [2025-09-29T20:32:19.268050] [DEBUG] [VALIDATOR ] PDO: Validating primary data. [2025-09-29T20:32:19.557708] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-09. [2025-09-29T20:32:19.685687] [DEBUG] [VALIDATOR ] PDO: All expected trading days are present. [2025-09-29T20:32:19.685865] [DEBUG] [VALIDATOR ] PDO: Primary data validation passed. [2025-09-29T20:32:19.686911] [INFO ] [MAIN ] PDO: Fetched primary data is valid. [2025-09-29T20:32:19.686992] [DEBUG] [LOCAL ] PDO: Saving primary data. [2025-09-29T20:32:19.688370] [DEBUG] [LOCAL ] PDO: Trimmed 47789 records to 31451 (keeping 200 days of data) [2025-09-29T20:32:19.918082] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-29T20:32:19.924674] [DEBUG] [LOCAL ] PDO: Primary data saved (31451 records). [2025-09-29T20:32:19.925312] [INFO ] [MAIN ] PDO: Full history saved. [2025-09-29T20:32:19.925845] [INFO ] [MAIN ] Update Progress: 1654/2371 symbols completed. PDO took 39.5s. Estimated remaining: 1h 32m 1s. Rate: 7.8 symbols/min [2025-09-29T20:32:20.119071] [INFO ] [MAIN ] PEB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:32:20.173500] [DEBUG] [LOCAL ] PEB: Loaded 51448 existing records from primary storage. [2025-09-29T20:32:20.173853] [INFO ] [MAIN ] PEB: Loaded 51448 existing records. [2025-09-29T20:32:20.359217] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-04. [2025-09-29T20:32:20.365536] [WARN ] [MAIN ] PEB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:32:20.366781] [INFO ] [MAIN ] PEB: Wiping existing primary data before full refresh. [2025-09-29T20:32:20.366887] [INFO ] [LOCAL ] PEB: Starting deletion of primary data. [2025-09-29T20:32:20.372796] [DEBUG] [LOCAL ] PEB: Deleted primary data file. [2025-09-29T20:32:20.377628] [INFO ] [MAIN ] PEB: Starting full primary refresh. [2025-09-29T20:32:20.378707] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-29T20:32:20.445242] [INFO ] [REMOTE ] PDT: Full fetch complete (25144 records). [2025-09-29T20:32:20.460585] [DEBUG] [VALIDATOR ] PDT: Validating primary data. [2025-09-29T20:32:21.151968] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-08. [2025-09-29T20:32:21.185543] [INFO ] [REMOTE ] PEB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:32:21.231407] [DEBUG] [VALIDATOR ] PDT: All expected trading days are present. [2025-09-29T20:32:21.231833] [DEBUG] [VALIDATOR ] PDT: Primary data validation passed. [2025-09-29T20:32:21.232555] [INFO ] [MAIN ] PDT: Fetched primary data is valid. [2025-09-29T20:32:21.232638] [DEBUG] [LOCAL ] PDT: Saving primary data. [2025-09-29T20:32:21.233763] [DEBUG] [LOCAL ] PDT: Trimmed 25144 records to 17301 (keeping 200 days of data) [2025-09-29T20:32:21.346825] [DEBUG] [LOCAL ] PDT: Primary data saved (17301 records). [2025-09-29T20:32:21.347022] [INFO ] [MAIN ] PDT: Full history saved. [2025-09-29T20:32:21.347196] [INFO ] [MAIN ] Update Progress: 1655/2371 symbols completed. PDT took 23.8s. Estimated remaining: 1h 31m 51s. Rate: 7.8 symbols/min [2025-09-29T20:32:21.543530] [INFO ] [MAIN ] PEG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:32:21.558329] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-29T20:32:21.619818] [DEBUG] [LOCAL ] PEG: Loaded 53893 existing records from primary storage. [2025-09-29T20:32:21.620146] [INFO ] [MAIN ] PEG: Loaded 53893 existing records. [2025-09-29T20:32:21.804910] [WARN ] [MAIN ] PEG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:32:21.805199] [INFO ] [MAIN ] PEG: Wiping existing primary data before full refresh. [2025-09-29T20:32:21.805250] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-09-29T20:32:21.805970] [DEBUG] [LOCAL ] PEG: Deleted primary data file. [2025-09-29T20:32:21.806030] [INFO ] [MAIN ] PEG: Starting full primary refresh. [2025-09-29T20:32:21.953233] [INFO ] [REMOTE ] PEB: Fetching primary data for 2024-12. [2025-09-29T20:32:22.210098] [INFO ] [REMOTE ] PEG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:32:22.237111] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-29T20:32:22.748131] [INFO ] [REMOTE ] PEG: Fetching primary data for 2024-12. [2025-09-29T20:32:23.548128] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-05. [2025-09-29T20:32:23.761629] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-29T20:32:24.162510] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-29T20:32:24.348113] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-09. [2025-09-29T20:32:24.581012] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-29T20:32:25.148097] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-01. [2025-09-29T20:32:25.291139] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-29T20:32:25.294457] [INFO ] [REMOTE ] PDS: Full fetch complete (25600 records). [2025-09-29T20:32:25.294539] [DEBUG] [VALIDATOR ] PDS: Validating primary data. [2025-09-29T20:32:25.678562] [DEBUG] [VALIDATOR ] PDS: All expected trading days are present. [2025-09-29T20:32:25.678661] [DEBUG] [VALIDATOR ] PDS: Primary data validation passed. [2025-09-29T20:32:25.679209] [INFO ] [MAIN ] PDS: Fetched primary data is valid. [2025-09-29T20:32:25.679252] [DEBUG] [LOCAL ] PDS: Saving primary data. [2025-09-29T20:32:25.679955] [DEBUG] [LOCAL ] PDS: Trimmed 25600 records to 17807 (keeping 200 days of data) [2025-09-29T20:32:25.790783] [DEBUG] [LOCAL ] PDS: Primary data saved (17807 records). [2025-09-29T20:32:25.790928] [INFO ] [MAIN ] PDS: Full history saved. [2025-09-29T20:32:25.791014] [INFO ] [MAIN ] Update Progress: 1656/2371 symbols completed. PDS took 30.6s. Estimated remaining: 1h 31m 42s. Rate: 7.8 symbols/min [2025-09-29T20:32:25.962566] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-01. [2025-09-29T20:32:25.966423] [INFO ] [MAIN ] PEN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:32:26.003943] [DEBUG] [LOCAL ] PEN: Loaded 30842 existing records from primary storage. [2025-09-29T20:32:26.004221] [INFO ] [MAIN ] PEN: Loaded 30842 existing records. [2025-09-29T20:32:26.204104] [WARN ] [MAIN ] PEN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:32:26.204564] [INFO ] [MAIN ] PEN: Wiping existing primary data before full refresh. [2025-09-29T20:32:26.204659] [INFO ] [LOCAL ] PEN: Starting deletion of primary data. [2025-09-29T20:32:26.205038] [DEBUG] [LOCAL ] PEN: Deleted primary data file. [2025-09-29T20:32:26.205100] [INFO ] [MAIN ] PEN: Starting full primary refresh. [2025-09-29T20:32:26.581845] [INFO ] [REMOTE ] PEN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:32:26.748114] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-06. [2025-09-29T20:32:27.091320] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-29T20:32:27.548128] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-02. [2025-09-29T20:32:27.626981] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-29T20:32:27.803176] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-29T20:32:28.348140] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-07. [2025-09-29T20:32:29.148128] [INFO ] [REMOTE ] PEN: Fetching primary data for 2024-12. [2025-09-29T20:32:29.213635] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-29T20:32:29.465765] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-29T20:32:29.948083] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-08. [2025-09-29T20:32:30.288502] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-29T20:32:30.748098] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-02. [2025-09-29T20:32:30.858968] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-29T20:32:31.548132] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-09. [2025-09-29T20:32:32.348105] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-03. [2025-09-29T20:32:32.461841] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-29T20:32:32.480793] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-29T20:32:32.484298] [INFO ] [REMOTE ] PDX: Full fetch complete (24577 records). [2025-09-29T20:32:32.484425] [DEBUG] [VALIDATOR ] PDX: Validating primary data. [2025-09-29T20:32:32.891273] [DEBUG] [VALIDATOR ] PDX: All expected trading days are present. [2025-09-29T20:32:32.891363] [DEBUG] [VALIDATOR ] PDX: Primary data validation passed. [2025-09-29T20:32:32.891973] [INFO ] [MAIN ] PDX: Fetched primary data is valid. [2025-09-29T20:32:32.892041] [DEBUG] [LOCAL ] PDX: Saving primary data. [2025-09-29T20:32:32.892866] [DEBUG] [LOCAL ] PDX: Trimmed 24577 records to 14358 (keeping 200 days of data) [2025-09-29T20:32:32.992072] [DEBUG] [LOCAL ] PDX: Primary data saved (14358 records). [2025-09-29T20:32:32.992229] [INFO ] [MAIN ] PDX: Full history saved. [2025-09-29T20:32:32.992363] [INFO ] [MAIN ] Update Progress: 1657/2371 symbols completed. PDX took 32.2s. Estimated remaining: 1h 31m 34s. Rate: 7.8 symbols/min [2025-09-29T20:32:33.155058] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-03. [2025-09-29T20:32:33.185543] [INFO ] [MAIN ] PEO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:32:33.202257] [DEBUG] [LOCAL ] PEO: Loaded 10999 existing records from primary storage. [2025-09-29T20:32:33.202504] [INFO ] [MAIN ] PEO: Loaded 10999 existing records. [2025-09-29T20:32:33.399596] [WARN ] [MAIN ] PEO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:32:33.399874] [INFO ] [MAIN ] PEO: Wiping existing primary data before full refresh. [2025-09-29T20:32:33.399923] [INFO ] [LOCAL ] PEO: Starting deletion of primary data. [2025-09-29T20:32:33.400243] [DEBUG] [LOCAL ] PEO: Deleted primary data file. [2025-09-29T20:32:33.400302] [INFO ] [MAIN ] PEO: Starting full primary refresh. [2025-09-29T20:32:33.803164] [INFO ] [REMOTE ] PEO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:32:33.948127] [INFO ] [REMOTE ] PEO: Fetching primary data for 2024-12. [2025-09-29T20:32:34.263408] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-29T20:32:34.748147] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-04. [2025-09-29T20:32:34.878161] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-29T20:32:35.053169] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-29T20:32:35.548133] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-01. [2025-09-29T20:32:36.348083] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-01. [2025-09-29T20:32:36.603716] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-29T20:32:36.761140] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-29T20:32:37.148111] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-02. [2025-09-29T20:32:37.559721] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-29T20:32:37.948098] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-04. [2025-09-29T20:32:37.990478] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-29T20:32:38.748161] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-03. [2025-09-29T20:32:39.548119] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-05. [2025-09-29T20:32:39.590841] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-29T20:32:39.845930] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-29T20:32:40.348126] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-04. [2025-09-29T20:32:41.148117] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-02. [2025-09-29T20:32:41.247386] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-29T20:32:41.382575] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-29T20:32:41.948210] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-05. [2025-09-29T20:32:42.717462] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-29T20:32:42.748086] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-06. [2025-09-29T20:32:43.548102] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-05. [2025-09-29T20:32:43.844587] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-29T20:32:44.127172] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-29T20:32:44.348111] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-06. [2025-09-29T20:32:44.800420] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-29T20:32:45.148099] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-07. [2025-09-29T20:32:45.278674] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-29T20:32:45.948118] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-07. [2025-09-29T20:32:46.748083] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-06. [2025-09-29T20:32:47.018841] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-29T20:32:47.070462] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-29T20:32:47.548147] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-08. [2025-09-29T20:32:48.348134] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-03. [2025-09-29T20:32:48.393943] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-29T20:32:48.479753] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-29T20:32:49.148146] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-07. [2025-09-29T20:32:49.866560] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-29T20:32:49.948148] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-09. [2025-09-29T20:32:50.748116] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-08. [2025-09-29T20:32:50.791999] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-29T20:32:50.794792] [INFO ] [REMOTE ] PEO: Full fetch complete (16395 records). [2025-09-29T20:32:50.794869] [DEBUG] [VALIDATOR ] PEO: Validating primary data. [2025-09-29T20:32:51.236944] [DEBUG] [VALIDATOR ] PEO: All expected trading days are present. [2025-09-29T20:32:51.237142] [DEBUG] [VALIDATOR ] PEO: Primary data validation passed. [2025-09-29T20:32:51.237688] [INFO ] [MAIN ] PEO: Fetched primary data is valid. [2025-09-29T20:32:51.238356] [DEBUG] [LOCAL ] PEO: Saving primary data. [2025-09-29T20:32:51.239696] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-29T20:32:51.252741] [DEBUG] [LOCAL ] PEO: Trimmed 16395 records to 10930 (keeping 200 days of data) [2025-09-29T20:32:51.326742] [DEBUG] [LOCAL ] PEO: Primary data saved (10930 records). [2025-09-29T20:32:51.326890] [INFO ] [MAIN ] PEO: Full history saved. [2025-09-29T20:32:51.326975] [INFO ] [MAIN ] Update Progress: 1658/2371 symbols completed. PEO took 18.3s. Estimated remaining: 1h 31m 31s. Rate: 7.8 symbols/min [2025-09-29T20:32:51.505178] [INFO ] [MAIN ] PERF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:32:51.522352] [DEBUG] [LOCAL ] PERF: Loaded 14231 existing records from primary storage. [2025-09-29T20:32:51.522594] [INFO ] [MAIN ] PERF: Loaded 14231 existing records. [2025-09-29T20:32:51.554452] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-08. [2025-09-29T20:32:51.729728] [WARN ] [MAIN ] PERF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:32:51.729962] [INFO ] [MAIN ] PERF: Wiping existing primary data before full refresh. [2025-09-29T20:32:51.730031] [INFO ] [LOCAL ] PERF: Starting deletion of primary data. [2025-09-29T20:32:51.730356] [DEBUG] [LOCAL ] PERF: Deleted primary data file. [2025-09-29T20:32:51.730417] [INFO ] [MAIN ] PERF: Starting full primary refresh. [2025-09-29T20:32:52.092933] [INFO ] [REMOTE ] PERF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:32:52.348091] [INFO ] [REMOTE ] PERF: Fetching primary data for 2024-12. [2025-09-29T20:32:52.620008] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-29T20:32:53.148090] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-09. [2025-09-29T20:32:53.272488] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-29T20:32:53.508297] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-29T20:32:53.948100] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-01. [2025-09-29T20:32:54.039459] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-29T20:32:54.050571] [INFO ] [REMOTE ] PEG: Full fetch complete (76290 records). [2025-09-29T20:32:54.050837] [DEBUG] [VALIDATOR ] PEG: Validating primary data. [2025-09-29T20:32:54.051627] [FATAL] [VALIDATOR ] PEG: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T20:32:54.051758] [FATAL] [MAIN ] PEG: Fetched primary data is invalid. Refusing to save it. [2025-09-29T20:32:54.051820] [WARN ] [MAIN ] PEG: Deleting existing primary and derivative data due to validation failure. [2025-09-29T20:32:54.051906] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-09-29T20:32:54.051985] [DEBUG] [LOCAL ] PEG: No primary data file found to delete. [2025-09-29T20:32:54.052023] [INFO ] [LOCAL ] PEG: Starting deletion of derivative data. [2025-09-29T20:32:54.052731] [DEBUG] [LOCAL ] PEG: Deleted derivative data file. [2025-09-29T20:32:54.052868] [INFO ] [MAIN ] Update Progress: 1659/2371 symbols completed. PEG took 32.7s. Estimated remaining: 1h 31m 21s. Rate: 7.8 symbols/min [2025-09-29T20:32:54.243856] [INFO ] [MAIN ] PEW: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:32:54.244050] [DEBUG] [LOCAL ] PEW: No existing data file found in primary storage. [2025-09-29T20:32:54.244087] [WARN ] [MAIN ] PEW: No existing data found, performing full refresh instead. [2025-09-29T20:32:54.244292] [INFO ] [MAIN ] PEW: Wiping existing primary data before full refresh. [2025-09-29T20:32:54.244340] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-09-29T20:32:54.244417] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-09-29T20:32:54.244456] [INFO ] [MAIN ] PEW: Starting full primary refresh. [2025-09-29T20:32:54.632235] [INFO ] [REMOTE ] PEW: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:32:54.748092] [INFO ] [REMOTE ] PEW: Fetching primary data for 2024-12. [2025-09-29T20:32:54.972887] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-29T20:32:55.001168] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T20:32:55.001488] [WARN ] [REMOTE ] PEW: No data returned for month 2024-12 [2025-09-29T20:32:55.001579] [FATAL] [REMOTE ] PEW: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T20:32:55.001633] [FATAL] [MAIN ] PEW: Failed to fetch primary data. [2025-09-29T20:32:55.001722] [WARN ] [MAIN ] PEW: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T20:32:55.001798] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-09-29T20:32:55.001865] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-09-29T20:32:55.001904] [INFO ] [LOCAL ] PEW: Starting deletion of derivative data. [2025-09-29T20:32:55.001946] [DEBUG] [LOCAL ] PEW: No derivative data file found to delete. [2025-09-29T20:32:55.001994] [INFO ] [MAIN ] Update Progress: 1660/2371 symbols completed. PEW took 0.9s. Estimated remaining: 1h 31m 10s. Rate: 7.8 symbols/min [2025-09-29T20:32:55.194825] [INFO ] [MAIN ] PFD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:32:55.203731] [DEBUG] [LOCAL ] PFD: Loaded 5199 existing records from primary storage. [2025-09-29T20:32:55.203968] [INFO ] [MAIN ] PFD: Loaded 5199 existing records. [2025-09-29T20:32:55.385217] [WARN ] [MAIN ] PFD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:32:55.385432] [INFO ] [MAIN ] PFD: Wiping existing primary data before full refresh. [2025-09-29T20:32:55.385526] [INFO ] [LOCAL ] PFD: Starting deletion of primary data. [2025-09-29T20:32:55.385875] [DEBUG] [LOCAL ] PFD: Deleted primary data file. [2025-09-29T20:32:55.385935] [INFO ] [MAIN ] PFD: Starting full primary refresh. [2025-09-29T20:32:55.548190] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-02. [2025-09-29T20:32:55.755564] [INFO ] [REMOTE ] PFD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:32:56.348116] [INFO ] [REMOTE ] PFD: Fetching primary data for 2024-12. [2025-09-29T20:32:56.878302] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-29T20:32:56.988030] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-29T20:32:57.148082] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-04. [2025-09-29T20:32:57.948110] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-03. [2025-09-29T20:32:58.748078] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-01. [2025-09-29T20:32:58.758319] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-29T20:32:58.787601] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-29T20:32:59.233311] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-29T20:32:59.548120] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-04. [2025-09-29T20:33:00.348107] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-02. [2025-09-29T20:33:00.409307] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-29T20:33:01.036135] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-29T20:33:01.148113] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-05. [2025-09-29T20:33:01.948118] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-09. [2025-09-29T20:33:02.748132] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-05. [2025-09-29T20:33:02.754589] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-29T20:33:03.548093] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-06. [2025-09-29T20:33:03.699470] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-29T20:33:03.792260] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-29T20:33:03.803812] [INFO ] [REMOTE ] PEB: Full fetch complete (72791 records). [2025-09-29T20:33:03.803989] [DEBUG] [VALIDATOR ] PEB: Validating primary data. [2025-09-29T20:33:04.234910] [DEBUG] [VALIDATOR ] PEB: All expected trading days are present. [2025-09-29T20:33:04.235000] [DEBUG] [VALIDATOR ] PEB: Primary data validation passed. [2025-09-29T20:33:04.236053] [INFO ] [MAIN ] PEB: Fetched primary data is valid. [2025-09-29T20:33:04.236123] [DEBUG] [LOCAL ] PEB: Saving primary data. [2025-09-29T20:33:04.237593] [DEBUG] [LOCAL ] PEB: Trimmed 72791 records to 50664 (keeping 200 days of data) [2025-09-29T20:33:04.348386] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-06. [2025-09-29T20:33:04.576575] [DEBUG] [LOCAL ] PEB: Primary data saved (50664 records). [2025-09-29T20:33:04.576768] [INFO ] [MAIN ] PEB: Full history saved. [2025-09-29T20:33:04.576864] [INFO ] [MAIN ] Update Progress: 1661/2371 symbols completed. PEB took 44.7s. Estimated remaining: 1h 31m 4s. Rate: 7.8 symbols/min [2025-09-29T20:33:04.804633] [INFO ] [MAIN ] PFE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:33:04.868103] [DEBUG] [LOCAL ] PFE: Loaded 54593 existing records from primary storage. [2025-09-29T20:33:04.868450] [INFO ] [MAIN ] PFE: Loaded 54593 existing records. [2025-09-29T20:33:05.059665] [WARN ] [MAIN ] PFE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:33:05.076532] [INFO ] [MAIN ] PFE: Wiping existing primary data before full refresh. [2025-09-29T20:33:05.076633] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-09-29T20:33:05.077988] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-29T20:33:05.083979] [DEBUG] [LOCAL ] PFE: Deleted primary data file. [2025-09-29T20:33:05.084511] [INFO ] [MAIN ] PFE: Starting full primary refresh. [2025-09-29T20:33:05.153215] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-07. [2025-09-29T20:33:05.467226] [INFO ] [REMOTE ] PFE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:33:05.507638] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-29T20:33:05.948126] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-03. [2025-09-29T20:33:06.364135] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-29T20:33:06.635211] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-29T20:33:06.748117] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-07. [2025-09-29T20:33:07.548145] [INFO ] [REMOTE ] PFE: Fetching primary data for 2024-12. [2025-09-29T20:33:08.005403] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-29T20:33:08.348139] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-08. [2025-09-29T20:33:09.148116] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-08. [2025-09-29T20:33:09.422857] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-29T20:33:09.948115] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-09. [2025-09-29T20:33:10.296203] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2024-12 (2.75 seconds). [2025-09-29T20:33:10.335871] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-29T20:33:10.579594] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-29T20:33:10.582778] [INFO ] [REMOTE ] PERF: Full fetch complete (21862 records). [2025-09-29T20:33:10.582856] [DEBUG] [VALIDATOR ] PERF: Validating primary data. [2025-09-29T20:33:10.753462] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-01. [2025-09-29T20:33:10.983765] [DEBUG] [VALIDATOR ] PERF: All expected trading days are present. [2025-09-29T20:33:10.983849] [DEBUG] [VALIDATOR ] PERF: Primary data validation passed. [2025-09-29T20:33:10.984405] [INFO ] [MAIN ] PERF: Fetched primary data is valid. [2025-09-29T20:33:10.984472] [DEBUG] [LOCAL ] PERF: Saving primary data. [2025-09-29T20:33:10.985163] [DEBUG] [LOCAL ] PERF: Trimmed 21862 records to 14019 (keeping 200 days of data) [2025-09-29T20:33:11.066857] [DEBUG] [LOCAL ] PERF: Primary data saved (14019 records). [2025-09-29T20:33:11.066996] [INFO ] [MAIN ] PERF: Full history saved. [2025-09-29T20:33:11.067104] [INFO ] [MAIN ] Update Progress: 1662/2371 symbols completed. PERF took 19.7s. Estimated remaining: 1h 30m 55s. Rate: 7.8 symbols/min [2025-09-29T20:33:11.246032] [INFO ] [MAIN ] PFGC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:33:11.296856] [DEBUG] [LOCAL ] PFGC: Loaded 47650 existing records from primary storage. [2025-09-29T20:33:11.297272] [INFO ] [MAIN ] PFGC: Loaded 47650 existing records. [2025-09-29T20:33:11.486318] [WARN ] [MAIN ] PFGC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:33:11.486542] [INFO ] [MAIN ] PFGC: Wiping existing primary data before full refresh. [2025-09-29T20:33:11.486589] [INFO ] [LOCAL ] PFGC: Starting deletion of primary data. [2025-09-29T20:33:11.486973] [DEBUG] [LOCAL ] PFGC: Deleted primary data file. [2025-09-29T20:33:11.487040] [INFO ] [MAIN ] PFGC: Starting full primary refresh. [2025-09-29T20:33:11.553209] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-04. [2025-09-29T20:33:11.858632] [INFO ] [REMOTE ] PFGC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:33:12.285904] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-29T20:33:12.348129] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-05. [2025-09-29T20:33:13.148132] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2024-12. [2025-09-29T20:33:13.213247] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-09-29T20:33:13.235418] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-29T20:33:13.948135] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-06. [2025-09-29T20:33:14.648101] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-29T20:33:14.748221] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-09. [2025-09-29T20:33:14.749124] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-29T20:33:15.548081] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-01. [2025-09-29T20:33:15.659862] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-29T20:33:15.666471] [INFO ] [REMOTE ] PEN: Full fetch complete (44171 records). [2025-09-29T20:33:15.666617] [DEBUG] [VALIDATOR ] PEN: Validating primary data. [2025-09-29T20:33:16.060185] [DEBUG] [VALIDATOR ] PEN: All expected trading days are present. [2025-09-29T20:33:16.060277] [DEBUG] [VALIDATOR ] PEN: Primary data validation passed. [2025-09-29T20:33:16.061289] [INFO ] [MAIN ] PEN: Fetched primary data is valid. [2025-09-29T20:33:16.061362] [DEBUG] [LOCAL ] PEN: Saving primary data. [2025-09-29T20:33:16.062443] [DEBUG] [LOCAL ] PEN: Trimmed 44171 records to 30229 (keeping 200 days of data) [2025-09-29T20:33:16.281340] [DEBUG] [LOCAL ] PEN: Primary data saved (30229 records). [2025-09-29T20:33:16.281618] [INFO ] [MAIN ] PEN: Full history saved. [2025-09-29T20:33:16.281755] [INFO ] [MAIN ] Update Progress: 1663/2371 symbols completed. PEN took 50.5s. Estimated remaining: 1h 30m 47s. Rate: 7.8 symbols/min [2025-09-29T20:33:16.353226] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-02. [2025-09-29T20:33:16.465666] [INFO ] [MAIN ] PFH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:33:16.476294] [DEBUG] [LOCAL ] PFH: Loaded 6911 existing records from primary storage. [2025-09-29T20:33:16.476505] [INFO ] [MAIN ] PFH: Loaded 6911 existing records. [2025-09-29T20:33:16.656840] [WARN ] [MAIN ] PFH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:33:16.657164] [INFO ] [MAIN ] PFH: Wiping existing primary data before full refresh. [2025-09-29T20:33:16.657220] [INFO ] [LOCAL ] PFH: Starting deletion of primary data. [2025-09-29T20:33:16.657539] [DEBUG] [LOCAL ] PFH: Deleted primary data file. [2025-09-29T20:33:16.657600] [INFO ] [MAIN ] PFH: Starting full primary refresh. [2025-09-29T20:33:17.029957] [INFO ] [REMOTE ] PFH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:33:17.148116] [INFO ] [REMOTE ] PFH: Fetching primary data for 2024-12. [2025-09-29T20:33:17.181122] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-29T20:33:17.948145] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-07. [2025-09-29T20:33:18.131414] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-29T20:33:18.751369] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-02. [2025-09-29T20:33:18.761050] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-29T20:33:18.767691] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-02 (2.41 seconds). [2025-09-29T20:33:19.548129] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-03. [2025-09-29T20:33:20.348120] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-01. [2025-09-29T20:33:20.737615] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-29T20:33:21.134723] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-29T20:33:21.148061] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-02. [2025-09-29T20:33:21.940548] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-29T20:33:21.948056] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-03. [2025-09-29T20:33:22.281117] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-03 (2.73 seconds). [2025-09-29T20:33:22.748083] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-03. [2025-09-29T20:33:22.823793] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-29T20:33:23.548141] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-04. [2025-09-29T20:33:24.018017] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-29T20:33:24.348106] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-08. [2025-09-29T20:33:25.080932] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-29T20:33:25.148139] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-04. [2025-09-29T20:33:25.948164] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-04. [2025-09-29T20:33:26.303501] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-04 (2.76 seconds). [2025-09-29T20:33:26.728283] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-29T20:33:26.748071] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-05. [2025-09-29T20:33:26.786539] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-29T20:33:27.548111] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-05. [2025-09-29T20:33:28.348172] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-09. [2025-09-29T20:33:29.069314] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-29T20:33:29.071317] [INFO ] [REMOTE ] PFD: Full fetch complete (7425 records). [2025-09-29T20:33:29.071406] [DEBUG] [VALIDATOR ] PFD: Validating primary data. [2025-09-29T20:33:29.152053] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-05. [2025-09-29T20:33:29.454983] [DEBUG] [VALIDATOR ] PFD: All expected trading days are present. [2025-09-29T20:33:29.455115] [DEBUG] [VALIDATOR ] PFD: Primary data validation passed. [2025-09-29T20:33:29.455446] [INFO ] [MAIN ] PFD: Fetched primary data is valid. [2025-09-29T20:33:29.455539] [DEBUG] [LOCAL ] PFD: Saving primary data. [2025-09-29T20:33:29.456212] [DEBUG] [LOCAL ] PFD: Trimmed 7425 records to 5130 (keeping 200 days of data) [2025-09-29T20:33:29.532871] [DEBUG] [LOCAL ] PFD: Primary data saved (5130 records). [2025-09-29T20:33:29.533586] [INFO ] [MAIN ] PFD: Full history saved. [2025-09-29T20:33:29.533760] [INFO ] [MAIN ] Update Progress: 1664/2371 symbols completed. PFD took 34.5s. Estimated remaining: 1h 30m 41s. Rate: 7.8 symbols/min [2025-09-29T20:33:29.536255] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-05 (2.79 seconds). [2025-09-29T20:33:29.743843] [INFO ] [MAIN ] PFL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:33:29.762993] [DEBUG] [LOCAL ] PFL: Loaded 13959 existing records from primary storage. [2025-09-29T20:33:29.763238] [INFO ] [MAIN ] PFL: Loaded 13959 existing records. [2025-09-29T20:33:29.949423] [WARN ] [MAIN ] PFL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:33:29.949567] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-06. [2025-09-29T20:33:29.950864] [INFO ] [MAIN ] PFL: Wiping existing primary data before full refresh. [2025-09-29T20:33:29.950967] [INFO ] [LOCAL ] PFL: Starting deletion of primary data. [2025-09-29T20:33:29.951412] [DEBUG] [LOCAL ] PFL: Deleted primary data file. [2025-09-29T20:33:29.951528] [INFO ] [MAIN ] PFL: Starting full primary refresh. [2025-09-29T20:33:30.071315] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-29T20:33:30.381286] [INFO ] [REMOTE ] PFL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:33:30.394892] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-05 (2.85 seconds). [2025-09-29T20:33:30.748178] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-06. [2025-09-29T20:33:31.548155] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-06. [2025-09-29T20:33:31.749493] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-29T20:33:32.348123] [INFO ] [REMOTE ] PFL: Fetching primary data for 2024-12. [2025-09-29T20:33:32.578367] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-29T20:33:33.134094] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-29T20:33:33.148066] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-01. [2025-09-29T20:33:33.581474] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-06 (2.83 seconds). [2025-09-29T20:33:33.910430] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-29T20:33:33.948132] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-02. [2025-09-29T20:33:34.748182] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-07. [2025-09-29T20:33:34.965669] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-29T20:33:35.548170] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-07. [2025-09-29T20:33:36.348114] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-03. [2025-09-29T20:33:37.148095] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-07. [2025-09-29T20:33:37.235928] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-29T20:33:37.279876] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-29T20:33:37.720209] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-29T20:33:37.756507] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-07 (3.01 seconds). [2025-09-29T20:33:37.948119] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-04. [2025-09-29T20:33:38.748190] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-08. [2025-09-29T20:33:39.107193] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-29T20:33:39.548166] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-08. [2025-09-29T20:33:40.294895] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-29T20:33:40.348070] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-09. [2025-09-29T20:33:41.148121] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-08. [2025-09-29T20:33:41.928143] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-29T20:33:41.948075] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-09. [2025-09-29T20:33:42.021711] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-29T20:33:42.032030] [INFO ] [REMOTE ] PFGC: Full fetch complete (67216 records). [2025-09-29T20:33:42.032194] [DEBUG] [VALIDATOR ] PFGC: Validating primary data. [2025-09-29T20:33:42.454565] [DEBUG] [VALIDATOR ] PFGC: All expected trading days are present. [2025-09-29T20:33:42.454667] [DEBUG] [VALIDATOR ] PFGC: Primary data validation passed. [2025-09-29T20:33:42.455749] [INFO ] [MAIN ] PFGC: Fetched primary data is valid. [2025-09-29T20:33:42.455877] [DEBUG] [LOCAL ] PFGC: Saving primary data. [2025-09-29T20:33:42.457459] [DEBUG] [LOCAL ] PFGC: Trimmed 67216 records to 46839 (keeping 200 days of data) [2025-09-29T20:33:42.586703] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-08 (3.04 seconds). [2025-09-29T20:33:42.611886] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-29T20:33:42.615220] [INFO ] [REMOTE ] PFH: Full fetch complete (10623 records). [2025-09-29T20:33:42.616016] [DEBUG] [VALIDATOR ] PFH: Validating primary data. [2025-09-29T20:33:42.749909] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-05. [2025-09-29T20:33:43.035747] [DEBUG] [VALIDATOR ] PFH: All expected trading days are present. [2025-09-29T20:33:43.036354] [DEBUG] [VALIDATOR ] PFH: Primary data validation passed. [2025-09-29T20:33:43.039282] [INFO ] [MAIN ] PFH: Fetched primary data is valid. [2025-09-29T20:33:43.039371] [DEBUG] [LOCAL ] PFH: Saving primary data. [2025-09-29T20:33:43.089791] [DEBUG] [LOCAL ] PFH: Trimmed 10623 records to 6838 (keeping 200 days of data) [2025-09-29T20:33:43.172779] [DEBUG] [LOCAL ] PFH: Primary data saved (6838 records). [2025-09-29T20:33:43.173276] [INFO ] [MAIN ] PFH: Full history saved. [2025-09-29T20:33:43.173963] [INFO ] [MAIN ] Update Progress: 1665/2371 symbols completed. PFH took 26.9s. Estimated remaining: 1h 30m 36s. Rate: 7.8 symbols/min [2025-09-29T20:33:43.362623] [INFO ] [MAIN ] PFLT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:33:43.458163] [DEBUG] [LOCAL ] PFLT: Loaded 44333 existing records from primary storage. [2025-09-29T20:33:43.467287] [INFO ] [MAIN ] PFLT: Loaded 44333 existing records. [2025-09-29T20:33:43.481580] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-29T20:33:43.507937] [DEBUG] [LOCAL ] PFGC: Primary data saved (46839 records). [2025-09-29T20:33:43.509768] [INFO ] [MAIN ] PFGC: Full history saved. [2025-09-29T20:33:43.524218] [INFO ] [MAIN ] Update Progress: 1666/2371 symbols completed. PFGC took 32.5s. Estimated remaining: 1h 30m 25s. Rate: 7.8 symbols/min [2025-09-29T20:33:43.552865] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-06. [2025-09-29T20:33:43.838858] [WARN ] [MAIN ] PFLT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:33:43.859780] [INFO ] [MAIN ] PFLT: Wiping existing primary data before full refresh. [2025-09-29T20:33:43.859887] [INFO ] [LOCAL ] PFLT: Starting deletion of primary data. [2025-09-29T20:33:43.859697] [INFO ] [MAIN ] PFN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:33:43.860598] [DEBUG] [LOCAL ] PFLT: Deleted primary data file. [2025-09-29T20:33:43.860719] [INFO ] [MAIN ] PFLT: Starting full primary refresh. [2025-09-29T20:33:44.075327] [DEBUG] [LOCAL ] PFN: Loaded 21992 existing records from primary storage. [2025-09-29T20:33:44.163113] [INFO ] [MAIN ] PFN: Loaded 21992 existing records. [2025-09-29T20:33:44.353560] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-09. [2025-09-29T20:33:44.414609] [INFO ] [REMOTE ] PFLT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:33:44.472673] [WARN ] [MAIN ] PFN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:33:44.473006] [INFO ] [MAIN ] PFN: Wiping existing primary data before full refresh. [2025-09-29T20:33:44.473067] [INFO ] [LOCAL ] PFN: Starting deletion of primary data. [2025-09-29T20:33:44.473819] [DEBUG] [LOCAL ] PFN: Deleted primary data file. [2025-09-29T20:33:44.473894] [INFO ] [MAIN ] PFN: Starting full primary refresh. [2025-09-29T20:33:44.809059] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-29T20:33:44.869788] [INFO ] [REMOTE ] PFN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:33:45.148153] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2024-12. [2025-09-29T20:33:45.362949] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-29T20:33:45.373839] [INFO ] [REMOTE ] PFE: Full fetch complete (77589 records). [2025-09-29T20:33:45.374040] [DEBUG] [VALIDATOR ] PFE: Validating primary data. [2025-09-29T20:33:45.374962] [FATAL] [VALIDATOR ] PFE: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T20:33:45.375053] [FATAL] [MAIN ] PFE: Fetched primary data is invalid. Refusing to save it. [2025-09-29T20:33:45.375098] [WARN ] [MAIN ] PFE: Deleting existing primary and derivative data due to validation failure. [2025-09-29T20:33:45.375140] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-09-29T20:33:45.375200] [DEBUG] [LOCAL ] PFE: No primary data file found to delete. [2025-09-29T20:33:45.375249] [INFO ] [LOCAL ] PFE: Starting deletion of derivative data. [2025-09-29T20:33:45.375783] [DEBUG] [LOCAL ] PFE: Deleted derivative data file. [2025-09-29T20:33:45.375897] [INFO ] [MAIN ] Update Progress: 1667/2371 symbols completed. PFE took 40.8s. Estimated remaining: 1h 30m 15s. Rate: 7.8 symbols/min [2025-09-29T20:33:45.555121] [INFO ] [MAIN ] PFO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:33:45.564168] [DEBUG] [LOCAL ] PFO: Loaded 5948 existing records from primary storage. [2025-09-29T20:33:45.564394] [INFO ] [MAIN ] PFO: Loaded 5948 existing records. [2025-09-29T20:33:45.751593] [WARN ] [MAIN ] PFO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:33:45.751877] [INFO ] [MAIN ] PFO: Wiping existing primary data before full refresh. [2025-09-29T20:33:45.751930] [INFO ] [LOCAL ] PFO: Starting deletion of primary data. [2025-09-29T20:33:45.752149] [DEBUG] [LOCAL ] PFO: Deleted primary data file. [2025-09-29T20:33:45.752228] [INFO ] [MAIN ] PFO: Starting full primary refresh. [2025-09-29T20:33:45.958085] [INFO ] [REMOTE ] PFN: Fetching primary data for 2024-12. [2025-09-29T20:33:46.136874] [INFO ] [REMOTE ] PFO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:33:46.748133] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-07. [2025-09-29T20:33:47.265507] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-29T20:33:47.327684] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-29T20:33:47.548112] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-01. [2025-09-29T20:33:47.968048] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-29T20:33:48.348141] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-08. [2025-09-29T20:33:48.634270] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-29T20:33:49.148872] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-01. [2025-09-29T20:33:49.153905] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-29T20:33:49.948161] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-09. [2025-09-29T20:33:50.663879] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-29T20:33:50.748082] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-02. [2025-09-29T20:33:51.019029] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-29T20:33:51.023680] [INFO ] [REMOTE ] PFL: Full fetch complete (20116 records). [2025-09-29T20:33:51.023807] [DEBUG] [VALIDATOR ] PFL: Validating primary data. [2025-09-29T20:33:51.447751] [DEBUG] [VALIDATOR ] PFL: All expected trading days are present. [2025-09-29T20:33:51.447867] [DEBUG] [VALIDATOR ] PFL: Primary data validation passed. [2025-09-29T20:33:51.448581] [INFO ] [MAIN ] PFL: Fetched primary data is valid. [2025-09-29T20:33:51.448697] [DEBUG] [LOCAL ] PFL: Saving primary data. [2025-09-29T20:33:51.449426] [DEBUG] [LOCAL ] PFL: Trimmed 20116 records to 13656 (keeping 200 days of data) [2025-09-29T20:33:51.549692] [INFO ] [REMOTE ] PFO: Fetching primary data for 2024-12. [2025-09-29T20:33:51.550096] [DEBUG] [LOCAL ] PFL: Primary data saved (13656 records). [2025-09-29T20:33:51.551545] [INFO ] [MAIN ] PFL: Full history saved. [2025-09-29T20:33:51.551784] [INFO ] [MAIN ] Update Progress: 1668/2371 symbols completed. PFL took 22.0s. Estimated remaining: 1h 30m 7s. Rate: 7.8 symbols/min [2025-09-29T20:33:51.734612] [INFO ] [MAIN ] PFS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:33:51.784887] [DEBUG] [LOCAL ] PFS: Loaded 36188 existing records from primary storage. [2025-09-29T20:33:51.785320] [INFO ] [MAIN ] PFS: Loaded 36188 existing records. [2025-09-29T20:33:51.969514] [WARN ] [MAIN ] PFS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:33:51.969832] [INFO ] [MAIN ] PFS: Wiping existing primary data before full refresh. [2025-09-29T20:33:51.969889] [INFO ] [LOCAL ] PFS: Starting deletion of primary data. [2025-09-29T20:33:51.970551] [DEBUG] [LOCAL ] PFS: Deleted primary data file. [2025-09-29T20:33:51.970613] [INFO ] [MAIN ] PFS: Starting full primary refresh. [2025-09-29T20:33:52.339966] [INFO ] [REMOTE ] PFS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:33:52.353189] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-02. [2025-09-29T20:33:52.368664] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-29T20:33:52.695698] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-29T20:33:53.148178] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-01. [2025-09-29T20:33:53.518020] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-29T20:33:53.846781] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-29T20:33:53.948121] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-03. [2025-09-29T20:33:54.748148] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-03. [2025-09-29T20:33:55.438579] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-29T20:33:55.548108] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-02. [2025-09-29T20:33:55.918890] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-29T20:33:56.221185] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-29T20:33:56.348110] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-03. [2025-09-29T20:33:57.073541] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-29T20:33:57.148109] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-04. [2025-09-29T20:33:57.859920] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-29T20:33:57.948119] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-04. [2025-09-29T20:33:58.748117] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-04. [2025-09-29T20:33:59.548118] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-05. [2025-09-29T20:33:59.869197] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-29T20:33:59.928378] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-29T20:34:00.280582] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-29T20:34:00.348097] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-05. [2025-09-29T20:34:01.148091] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-05. [2025-09-29T20:34:01.532134] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-29T20:34:01.948118] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-06. [2025-09-29T20:34:02.701075] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-29T20:34:02.748100] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-06. [2025-09-29T20:34:02.894325] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-29T20:34:03.548126] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-06. [2025-09-29T20:34:03.896000] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-29T20:34:04.348150] [INFO ] [REMOTE ] PFS: Fetching primary data for 2024-12. [2025-09-29T20:34:05.148139] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-07. [2025-09-29T20:34:05.295902] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-29T20:34:05.770346] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-29T20:34:05.896545] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-29T20:34:05.948108] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-07. [2025-09-29T20:34:06.748172] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-08. [2025-09-29T20:34:06.949307] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-29T20:34:07.548172] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-08. [2025-09-29T20:34:07.563254] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-29T20:34:08.348124] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-09. [2025-09-29T20:34:08.521474] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-29T20:34:09.148106] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-09. [2025-09-29T20:34:09.325975] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-29T20:34:09.328619] [INFO ] [REMOTE ] PFO: Full fetch complete (7895 records). [2025-09-29T20:34:09.328728] [DEBUG] [VALIDATOR ] PFO: Validating primary data. [2025-09-29T20:34:09.712134] [DEBUG] [VALIDATOR ] PFO: All expected trading days are present. [2025-09-29T20:34:09.712264] [DEBUG] [VALIDATOR ] PFO: Primary data validation passed. [2025-09-29T20:34:09.712499] [INFO ] [MAIN ] PFO: Fetched primary data is valid. [2025-09-29T20:34:09.712545] [DEBUG] [LOCAL ] PFO: Saving primary data. [2025-09-29T20:34:09.713047] [DEBUG] [LOCAL ] PFO: Trimmed 7895 records to 5913 (keeping 200 days of data) [2025-09-29T20:34:09.750915] [DEBUG] [LOCAL ] PFO: Primary data saved (5913 records). [2025-09-29T20:34:09.751066] [INFO ] [MAIN ] PFO: Full history saved. [2025-09-29T20:34:09.751176] [INFO ] [MAIN ] Update Progress: 1669/2371 symbols completed. PFO took 24.4s. Estimated remaining: 1h 30m 4s. Rate: 7.8 symbols/min [2025-09-29T20:34:09.931302] [INFO ] [MAIN ] PFSI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:34:09.950617] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-01. [2025-09-29T20:34:09.965706] [DEBUG] [LOCAL ] PFSI: Loaded 29259 existing records from primary storage. [2025-09-29T20:34:09.966032] [INFO ] [MAIN ] PFSI: Loaded 29259 existing records. [2025-09-29T20:34:10.164055] [WARN ] [MAIN ] PFSI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:34:10.164274] [INFO ] [MAIN ] PFSI: Wiping existing primary data before full refresh. [2025-09-29T20:34:10.164325] [INFO ] [LOCAL ] PFSI: Starting deletion of primary data. [2025-09-29T20:34:10.164721] [DEBUG] [LOCAL ] PFSI: Deleted primary data file. [2025-09-29T20:34:10.164805] [INFO ] [MAIN ] PFSI: Starting full primary refresh. [2025-09-29T20:34:10.541763] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-29T20:34:10.571761] [INFO ] [REMOTE ] PFN: Full fetch complete (30799 records). [2025-09-29T20:34:10.577702] [DEBUG] [VALIDATOR ] PFN: Validating primary data. [2025-09-29T20:34:10.577556] [INFO ] [REMOTE ] PFSI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:34:10.759535] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2024-12. [2025-09-29T20:34:10.976142] [DEBUG] [VALIDATOR ] PFN: All expected trading days are present. [2025-09-29T20:34:10.976236] [DEBUG] [VALIDATOR ] PFN: Primary data validation passed. [2025-09-29T20:34:10.977038] [INFO ] [MAIN ] PFN: Fetched primary data is valid. [2025-09-29T20:34:10.977148] [DEBUG] [LOCAL ] PFN: Saving primary data. [2025-09-29T20:34:10.978177] [DEBUG] [LOCAL ] PFN: Trimmed 30799 records to 21645 (keeping 200 days of data) [2025-09-29T20:34:11.109510] [DEBUG] [LOCAL ] PFN: Primary data saved (21645 records). [2025-09-29T20:34:11.109674] [INFO ] [MAIN ] PFN: Full history saved. [2025-09-29T20:34:11.109782] [INFO ] [MAIN ] Update Progress: 1670/2371 symbols completed. PFN took 27.6s. Estimated remaining: 1h 29m 53s. Rate: 7.8 symbols/min [2025-09-29T20:34:11.299142] [INFO ] [MAIN ] PG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:34:11.365419] [DEBUG] [LOCAL ] PG: Loaded 54532 existing records from primary storage. [2025-09-29T20:34:11.365873] [INFO ] [MAIN ] PG: Loaded 54532 existing records. [2025-09-29T20:34:11.550380] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-07. [2025-09-29T20:34:11.556491] [WARN ] [MAIN ] PG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:34:11.558530] [INFO ] [MAIN ] PG: Wiping existing primary data before full refresh. [2025-09-29T20:34:11.571526] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-09-29T20:34:11.581848] [DEBUG] [LOCAL ] PG: Deleted primary data file. [2025-09-29T20:34:11.581780] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-29T20:34:11.582052] [INFO ] [MAIN ] PG: Starting full primary refresh. [2025-09-29T20:34:11.993814] [INFO ] [REMOTE ] PG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:34:12.022230] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-29T20:34:12.348134] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-02. [2025-09-29T20:34:13.148108] [INFO ] [REMOTE ] PG: Fetching primary data for 2024-12. [2025-09-29T20:34:13.395182] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-29T20:34:13.893507] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-29T20:34:13.948123] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-03. [2025-09-29T20:34:14.748125] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-08. [2025-09-29T20:34:15.325912] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-29T20:34:15.507241] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2024-12 (2.36 seconds). [2025-09-29T20:34:15.548163] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-01. [2025-09-29T20:34:16.333376] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-29T20:34:16.348058] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-09. [2025-09-29T20:34:17.071717] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-29T20:34:17.148107] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-02. [2025-09-29T20:34:17.948167] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-01. [2025-09-29T20:34:18.149314] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-29T20:34:18.160986] [INFO ] [REMOTE ] PFLT: Full fetch complete (63592 records). [2025-09-29T20:34:18.161395] [DEBUG] [VALIDATOR ] PFLT: Validating primary data. [2025-09-29T20:34:18.615865] [DEBUG] [VALIDATOR ] PFLT: All expected trading days are present. [2025-09-29T20:34:18.616020] [DEBUG] [VALIDATOR ] PFLT: Primary data validation passed. [2025-09-29T20:34:18.617862] [INFO ] [MAIN ] PFLT: Fetched primary data is valid. [2025-09-29T20:34:18.619236] [DEBUG] [LOCAL ] PFLT: Saving primary data. [2025-09-29T20:34:18.619136] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-29T20:34:18.627126] [DEBUG] [LOCAL ] PFLT: Trimmed 63592 records to 43669 (keeping 200 days of data) [2025-09-29T20:34:18.749898] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-03. [2025-09-29T20:34:18.914104] [DEBUG] [LOCAL ] PFLT: Primary data saved (43669 records). [2025-09-29T20:34:18.914263] [INFO ] [MAIN ] PFLT: Full history saved. [2025-09-29T20:34:18.914393] [INFO ] [MAIN ] Update Progress: 1671/2371 symbols completed. PFLT took 35.7s. Estimated remaining: 1h 29m 46s. Rate: 7.8 symbols/min [2025-09-29T20:34:19.100755] [INFO ] [MAIN ] PGP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:34:19.108542] [DEBUG] [LOCAL ] PGP: Loaded 5515 existing records from primary storage. [2025-09-29T20:34:19.108796] [INFO ] [MAIN ] PGP: Loaded 5515 existing records. [2025-09-29T20:34:19.285753] [WARN ] [MAIN ] PGP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:34:19.285987] [INFO ] [MAIN ] PGP: Wiping existing primary data before full refresh. [2025-09-29T20:34:19.286035] [INFO ] [LOCAL ] PGP: Starting deletion of primary data. [2025-09-29T20:34:19.286240] [DEBUG] [LOCAL ] PGP: Deleted primary data file. [2025-09-29T20:34:19.286298] [INFO ] [MAIN ] PGP: Starting full primary refresh. [2025-09-29T20:34:19.553285] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-04. [2025-09-29T20:34:19.661990] [INFO ] [REMOTE ] PGP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:34:20.145101] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-09-29T20:34:20.248137] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-29T20:34:20.348080] [INFO ] [REMOTE ] PGP: Fetching primary data for 2024-12. [2025-09-29T20:34:21.148130] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-04. [2025-09-29T20:34:21.223086] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-29T20:34:21.326300] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-29T20:34:21.948111] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-01. [2025-09-29T20:34:22.499779] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-29T20:34:22.695860] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-29T20:34:22.748123] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-05. [2025-09-29T20:34:23.548146] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-05. [2025-09-29T20:34:24.233187] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-29T20:34:24.348119] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-06. [2025-09-29T20:34:24.907253] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-29T20:34:25.148161] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-02. [2025-09-29T20:34:25.882861] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-29T20:34:25.948092] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-07. [2025-09-29T20:34:26.748164] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-06. [2025-09-29T20:34:27.281378] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-29T20:34:27.548267] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-03. [2025-09-29T20:34:27.640662] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-29T20:34:27.988572] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-29T20:34:28.348138] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-08. [2025-09-29T20:34:29.148144] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-02. [2025-09-29T20:34:29.861847] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-29T20:34:29.862928] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-29T20:34:29.907314] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-09-29T20:34:29.948114] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-04. [2025-09-29T20:34:30.748157] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-03. [2025-09-29T20:34:31.401426] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-29T20:34:31.548176] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-07. [2025-09-29T20:34:32.348095] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-04. [2025-09-29T20:34:32.399745] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-29T20:34:32.959866] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-29T20:34:33.148105] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-05. [2025-09-29T20:34:33.221861] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-29T20:34:33.948143] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-09. [2025-09-29T20:34:34.748170] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-08. [2025-09-29T20:34:35.372995] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-29T20:34:35.381544] [INFO ] [REMOTE ] PFS: Full fetch complete (51708 records). [2025-09-29T20:34:35.381739] [DEBUG] [VALIDATOR ] PFS: Validating primary data. [2025-09-29T20:34:35.552429] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-05. [2025-09-29T20:34:35.831019] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-05 (2.68 seconds). [2025-09-29T20:34:35.834390] [DEBUG] [VALIDATOR ] PFS: All expected trading days are present. [2025-09-29T20:34:35.845470] [DEBUG] [VALIDATOR ] PFS: Primary data validation passed. [2025-09-29T20:34:35.847219] [INFO ] [MAIN ] PFS: Fetched primary data is valid. [2025-09-29T20:34:35.847690] [DEBUG] [LOCAL ] PFS: Saving primary data. [2025-09-29T20:34:35.848836] [DEBUG] [LOCAL ] PFS: Trimmed 51708 records to 35575 (keeping 200 days of data) [2025-09-29T20:34:36.082529] [DEBUG] [LOCAL ] PFS: Primary data saved (35575 records). [2025-09-29T20:34:36.082703] [INFO ] [MAIN ] PFS: Full history saved. [2025-09-29T20:34:36.082814] [INFO ] [MAIN ] Update Progress: 1672/2371 symbols completed. PFS took 44.5s. Estimated remaining: 1h 29m 42s. Rate: 7.8 symbols/min [2025-09-29T20:34:36.214596] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-29T20:34:36.230385] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-29T20:34:36.312860] [INFO ] [MAIN ] PGR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:34:36.359704] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-06. [2025-09-29T20:34:36.383777] [DEBUG] [LOCAL ] PGR: Loaded 53757 existing records from primary storage. [2025-09-29T20:34:36.384131] [INFO ] [MAIN ] PGR: Loaded 53757 existing records. [2025-09-29T20:34:36.578837] [WARN ] [MAIN ] PGR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:34:36.579105] [INFO ] [MAIN ] PGR: Wiping existing primary data before full refresh. [2025-09-29T20:34:36.579176] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-09-29T20:34:36.581265] [DEBUG] [LOCAL ] PGR: Deleted primary data file. [2025-09-29T20:34:36.581330] [INFO ] [MAIN ] PGR: Starting full primary refresh. [2025-09-29T20:34:36.970514] [INFO ] [REMOTE ] PGR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:34:37.094143] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-29T20:34:37.148127] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-09. [2025-09-29T20:34:37.948132] [INFO ] [REMOTE ] PGR: Fetching primary data for 2024-12. [2025-09-29T20:34:38.622257] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-29T20:34:38.629966] [INFO ] [REMOTE ] PFSI: Full fetch complete (40774 records). [2025-09-29T20:34:38.630120] [DEBUG] [VALIDATOR ] PFSI: Validating primary data. [2025-09-29T20:34:38.753212] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-06. [2025-09-29T20:34:39.032372] [DEBUG] [VALIDATOR ] PFSI: All expected trading days are present. [2025-09-29T20:34:39.032465] [DEBUG] [VALIDATOR ] PFSI: Primary data validation passed. [2025-09-29T20:34:39.033533] [INFO ] [MAIN ] PFSI: Fetched primary data is valid. [2025-09-29T20:34:39.033603] [DEBUG] [LOCAL ] PFSI: Saving primary data. [2025-09-29T20:34:39.034842] [DEBUG] [LOCAL ] PFSI: Trimmed 40774 records to 28694 (keeping 200 days of data) [2025-09-29T20:34:39.225384] [DEBUG] [LOCAL ] PFSI: Primary data saved (28694 records). [2025-09-29T20:34:39.225520] [INFO ] [MAIN ] PFSI: Full history saved. [2025-09-29T20:34:39.225608] [INFO ] [MAIN ] Update Progress: 1673/2371 symbols completed. PFSI took 29.5s. Estimated remaining: 1h 29m 32s. Rate: 7.8 symbols/min [2025-09-29T20:34:39.414680] [INFO ] [MAIN ] PGRE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:34:39.459970] [DEBUG] [LOCAL ] PGRE: Loaded 47177 existing records from primary storage. [2025-09-29T20:34:39.460277] [INFO ] [MAIN ] PGRE: Loaded 47177 existing records. [2025-09-29T20:34:39.553624] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-07. [2025-09-29T20:34:39.650218] [WARN ] [MAIN ] PGRE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:34:39.650440] [INFO ] [MAIN ] PGRE: Wiping existing primary data before full refresh. [2025-09-29T20:34:39.650491] [INFO ] [LOCAL ] PGRE: Starting deletion of primary data. [2025-09-29T20:34:39.651022] [DEBUG] [LOCAL ] PGRE: Deleted primary data file. [2025-09-29T20:34:39.651085] [INFO ] [MAIN ] PGRE: Starting full primary refresh. [2025-09-29T20:34:40.034043] [INFO ] [REMOTE ] PGRE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:34:40.160710] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-29T20:34:40.162413] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-29T20:34:40.348120] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-01. [2025-09-29T20:34:41.112040] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-09-29T20:34:41.148135] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-07. [2025-09-29T20:34:41.948135] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2024-12. [2025-09-29T20:34:42.331806] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-29T20:34:42.748127] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-08. [2025-09-29T20:34:43.548129] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-02. [2025-09-29T20:34:43.634669] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-29T20:34:43.686742] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-29T20:34:43.690899] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-09-29T20:34:44.348123] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-08. [2025-09-29T20:34:45.148088] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-01. [2025-09-29T20:34:45.462154] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-29T20:34:45.948108] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-09. [2025-09-29T20:34:46.345486] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-29T20:34:46.750446] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-03. [2025-09-29T20:34:46.771454] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-29T20:34:46.774315] [INFO ] [REMOTE ] PGP: Full fetch complete (7813 records). [2025-09-29T20:34:46.776045] [DEBUG] [VALIDATOR ] PGP: Validating primary data. [2025-09-29T20:34:46.775891] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-29T20:34:47.155779] [DEBUG] [VALIDATOR ] PGP: All expected trading days are present. [2025-09-29T20:34:47.155861] [DEBUG] [VALIDATOR ] PGP: Primary data validation passed. [2025-09-29T20:34:47.156069] [INFO ] [MAIN ] PGP: Fetched primary data is valid. [2025-09-29T20:34:47.156110] [DEBUG] [LOCAL ] PGP: Saving primary data. [2025-09-29T20:34:47.156537] [DEBUG] [LOCAL ] PGP: Trimmed 7813 records to 5454 (keeping 200 days of data) [2025-09-29T20:34:47.189908] [DEBUG] [LOCAL ] PGP: Primary data saved (5454 records). [2025-09-29T20:34:47.190052] [INFO ] [MAIN ] PGP: Full history saved. [2025-09-29T20:34:47.190141] [INFO ] [MAIN ] Update Progress: 1674/2371 symbols completed. PGP took 28.3s. Estimated remaining: 1h 29m 25s. Rate: 7.8 symbols/min [2025-09-29T20:34:47.372585] [INFO ] [MAIN ] PGZ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:34:47.382058] [DEBUG] [LOCAL ] PGZ: Loaded 5440 existing records from primary storage. [2025-09-29T20:34:47.382273] [INFO ] [MAIN ] PGZ: Loaded 5440 existing records. [2025-09-29T20:34:47.562442] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-09. [2025-09-29T20:34:47.586091] [WARN ] [MAIN ] PGZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:34:47.586525] [INFO ] [MAIN ] PGZ: Wiping existing primary data before full refresh. [2025-09-29T20:34:47.587848] [INFO ] [LOCAL ] PGZ: Starting deletion of primary data. [2025-09-29T20:34:47.588289] [DEBUG] [LOCAL ] PGZ: Deleted primary data file. [2025-09-29T20:34:47.588355] [INFO ] [MAIN ] PGZ: Starting full primary refresh. [2025-09-29T20:34:47.969375] [INFO ] [REMOTE ] PGZ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:34:48.348128] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-02. [2025-09-29T20:34:48.541508] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-29T20:34:48.552592] [INFO ] [REMOTE ] PG: Full fetch complete (77395 records). [2025-09-29T20:34:48.552808] [DEBUG] [VALIDATOR ] PG: Validating primary data. [2025-09-29T20:34:48.553631] [FATAL] [VALIDATOR ] PG: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T20:34:48.553747] [FATAL] [MAIN ] PG: Fetched primary data is invalid. Refusing to save it. [2025-09-29T20:34:48.553791] [WARN ] [MAIN ] PG: Deleting existing primary and derivative data due to validation failure. [2025-09-29T20:34:48.553832] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-09-29T20:34:48.553940] [DEBUG] [LOCAL ] PG: No primary data file found to delete. [2025-09-29T20:34:48.554016] [INFO ] [LOCAL ] PG: Starting deletion of derivative data. [2025-09-29T20:34:48.554570] [DEBUG] [LOCAL ] PG: Deleted derivative data file. [2025-09-29T20:34:48.558151] [INFO ] [MAIN ] Update Progress: 1675/2371 symbols completed. PG took 37.4s. Estimated remaining: 1h 29m 14s. Rate: 7.8 symbols/min [2025-09-29T20:34:48.742150] [INFO ] [MAIN ] PH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:34:48.788595] [DEBUG] [LOCAL ] PH: Loaded 39166 existing records from primary storage. [2025-09-29T20:34:48.788972] [INFO ] [MAIN ] PH: Loaded 39166 existing records. [2025-09-29T20:34:48.990910] [WARN ] [MAIN ] PH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:34:48.991398] [INFO ] [MAIN ] PH: Wiping existing primary data before full refresh. [2025-09-29T20:34:48.991459] [INFO ] [LOCAL ] PH: Starting deletion of primary data. [2025-09-29T20:34:48.991867] [DEBUG] [LOCAL ] PH: Deleted primary data file. [2025-09-29T20:34:48.991926] [INFO ] [MAIN ] PH: Starting full primary refresh. [2025-09-29T20:34:49.151453] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2024-12. [2025-09-29T20:34:49.312170] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-03 (2.56 seconds). [2025-09-29T20:34:49.457899] [INFO ] [REMOTE ] PH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:34:49.708499] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-29T20:34:49.948112] [INFO ] [REMOTE ] PH: Fetching primary data for 2024-12. [2025-09-29T20:34:50.374124] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-29T20:34:50.748124] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-01. [2025-09-29T20:34:51.548135] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-04. [2025-09-29T20:34:51.663695] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-29T20:34:51.707862] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-29T20:34:52.348111] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-01. [2025-09-29T20:34:53.148120] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-03. [2025-09-29T20:34:53.725296] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-29T20:34:53.948086] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-05. [2025-09-29T20:34:53.994102] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-29T20:34:54.753241] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-02. [2025-09-29T20:34:54.771728] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-29T20:34:55.214943] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-29T20:34:55.548080] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-04. [2025-09-29T20:34:56.049683] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-29T20:34:56.348108] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-02. [2025-09-29T20:34:57.148089] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-06. [2025-09-29T20:34:57.353387] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-29T20:34:57.749387] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-29T20:34:57.948107] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-05. [2025-09-29T20:34:58.748081] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-03. [2025-09-29T20:34:59.101151] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-29T20:34:59.548091] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-07. [2025-09-29T20:34:59.715325] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-29T20:35:00.348105] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-06. [2025-09-29T20:35:00.640748] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-29T20:35:01.148118] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-03. [2025-09-29T20:35:01.606438] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-29T20:35:01.689868] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-29T20:35:01.948113] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-04. [2025-09-29T20:35:02.259227] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-29T20:35:02.748125] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-04. [2025-09-29T20:35:03.492565] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-29T20:35:03.548108] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-05. [2025-09-29T20:35:03.939601] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-29T20:35:04.306590] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-29T20:35:04.348138] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-08. [2025-09-29T20:35:05.148156] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-06. [2025-09-29T20:35:05.846443] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-29T20:35:05.950853] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-07. [2025-09-29T20:35:05.954381] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-29T20:35:06.748160] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-05. [2025-09-29T20:35:07.548120] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-09. [2025-09-29T20:35:07.862214] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-29T20:35:08.348087] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-08. [2025-09-29T20:35:08.521600] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-29T20:35:08.534308] [INFO ] [REMOTE ] PGR: Full fetch complete (76218 records). [2025-09-29T20:35:08.556832] [DEBUG] [VALIDATOR ] PGR: Validating primary data. [2025-09-29T20:35:08.569059] [FATAL] [VALIDATOR ] PGR: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T20:35:08.571660] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-29T20:35:08.570027] [FATAL] [MAIN ] PGR: Fetched primary data is invalid. Refusing to save it. [2025-09-29T20:35:08.580240] [WARN ] [MAIN ] PGR: Deleting existing primary and derivative data due to validation failure. [2025-09-29T20:35:08.580933] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-09-29T20:35:08.581409] [DEBUG] [LOCAL ] PGR: No primary data file found to delete. [2025-09-29T20:35:08.581471] [INFO ] [LOCAL ] PGR: Starting deletion of derivative data. [2025-09-29T20:35:08.582068] [DEBUG] [LOCAL ] PGR: Deleted derivative data file. [2025-09-29T20:35:08.582237] [INFO ] [MAIN ] Update Progress: 1676/2371 symbols completed. PGR took 32.5s. Estimated remaining: 1h 29m 12s. Rate: 7.8 symbols/min [2025-09-29T20:35:08.762886] [INFO ] [MAIN ] PHD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:35:08.775111] [DEBUG] [LOCAL ] PHD: Loaded 10098 existing records from primary storage. [2025-09-29T20:35:08.775351] [INFO ] [MAIN ] PHD: Loaded 10098 existing records. [2025-09-29T20:35:08.963615] [WARN ] [MAIN ] PHD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:35:08.963871] [INFO ] [MAIN ] PHD: Wiping existing primary data before full refresh. [2025-09-29T20:35:08.963964] [INFO ] [LOCAL ] PHD: Starting deletion of primary data. [2025-09-29T20:35:08.964478] [DEBUG] [LOCAL ] PHD: Deleted primary data file. [2025-09-29T20:35:08.964537] [INFO ] [MAIN ] PHD: Starting full primary refresh. [2025-09-29T20:35:09.152593] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-06. [2025-09-29T20:35:09.357787] [INFO ] [REMOTE ] PHD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:35:09.948145] [INFO ] [REMOTE ] PHD: Fetching primary data for 2024-12. [2025-09-29T20:35:10.084878] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-29T20:35:10.748147] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-09. [2025-09-29T20:35:10.909291] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-29T20:35:11.179298] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-29T20:35:11.548123] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-07. [2025-09-29T20:35:12.348147] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-01. [2025-09-29T20:35:12.504842] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-29T20:35:12.517223] [INFO ] [REMOTE ] PGRE: Full fetch complete (63670 records). [2025-09-29T20:35:12.517407] [DEBUG] [VALIDATOR ] PGRE: Validating primary data. [2025-09-29T20:35:13.001873] [DEBUG] [VALIDATOR ] PGRE: All expected trading days are present. [2025-09-29T20:35:13.001973] [DEBUG] [VALIDATOR ] PGRE: Primary data validation passed. [2025-09-29T20:35:13.003168] [INFO ] [MAIN ] PGRE: Fetched primary data is valid. [2025-09-29T20:35:13.003245] [DEBUG] [LOCAL ] PGRE: Saving primary data. [2025-09-29T20:35:13.004692] [DEBUG] [LOCAL ] PGRE: Trimmed 63670 records to 46603 (keeping 200 days of data) [2025-09-29T20:35:13.171565] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-07. [2025-09-29T20:35:13.239060] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-29T20:35:13.311628] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-29T20:35:13.326436] [DEBUG] [LOCAL ] PGRE: Primary data saved (46603 records). [2025-09-29T20:35:13.326559] [INFO ] [MAIN ] PGRE: Full history saved. [2025-09-29T20:35:13.326674] [INFO ] [MAIN ] Update Progress: 1677/2371 symbols completed. PGRE took 34.1s. Estimated remaining: 1h 29m 3s. Rate: 7.8 symbols/min [2025-09-29T20:35:13.948089] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-08. [2025-09-29T20:35:14.027736] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-29T20:35:14.748150] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-08. [2025-09-29T20:35:15.548154] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-02. [2025-09-29T20:35:15.662117] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-29T20:35:15.688578] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-29T20:35:16.348087] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-09. [2025-09-29T20:35:16.491728] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-29T20:35:17.119451] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-29T20:35:17.121313] [INFO ] [REMOTE ] PGZ: Full fetch complete (9010 records). [2025-09-29T20:35:17.121395] [DEBUG] [VALIDATOR ] PGZ: Validating primary data. [2025-09-29T20:35:17.153245] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-03. [2025-09-29T20:35:17.503323] [DEBUG] [VALIDATOR ] PGZ: All expected trading days are present. [2025-09-29T20:35:17.503435] [DEBUG] [VALIDATOR ] PGZ: Primary data validation passed. [2025-09-29T20:35:17.503728] [INFO ] [MAIN ] PGZ: Fetched primary data is valid. [2025-09-29T20:35:17.503796] [DEBUG] [LOCAL ] PGZ: Saving primary data. [2025-09-29T20:35:17.504527] [DEBUG] [LOCAL ] PGZ: Trimmed 9010 records to 5422 (keeping 200 days of data) [2025-09-29T20:35:17.539254] [DEBUG] [LOCAL ] PGZ: Primary data saved (5422 records). [2025-09-29T20:35:17.539401] [INFO ] [MAIN ] PGZ: Full history saved. [2025-09-29T20:35:17.539487] [INFO ] [MAIN ] Update Progress: 1678/2371 symbols completed. PGZ took 30.3s. Estimated remaining: 1h 28m 54s. Rate: 7.8 symbols/min [2025-09-29T20:35:17.948158] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-09. [2025-09-29T20:35:18.204073] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-29T20:35:18.748105] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-04. [2025-09-29T20:35:19.507546] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-29T20:35:19.522978] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-29T20:35:19.522633] [INFO ] [REMOTE ] PH: Full fetch complete (56531 records). [2025-09-29T20:35:19.526108] [DEBUG] [VALIDATOR ] PH: Validating primary data. [2025-09-29T20:35:19.560639] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-05. [2025-09-29T20:35:19.943798] [DEBUG] [VALIDATOR ] PH: All expected trading days are present. [2025-09-29T20:35:19.943887] [DEBUG] [VALIDATOR ] PH: Primary data validation passed. [2025-09-29T20:35:19.944891] [INFO ] [MAIN ] PH: Fetched primary data is valid. [2025-09-29T20:35:19.944955] [DEBUG] [LOCAL ] PH: Saving primary data. [2025-09-29T20:35:19.946324] [DEBUG] [LOCAL ] PH: Trimmed 56531 records to 38362 (keeping 200 days of data) [2025-09-29T20:35:20.214976] [DEBUG] [LOCAL ] PH: Primary data saved (38362 records). [2025-09-29T20:35:20.215320] [INFO ] [MAIN ] PH: Full history saved. [2025-09-29T20:35:20.219943] [INFO ] [MAIN ] Update Progress: 1679/2371 symbols completed. PH took 31.7s. Estimated remaining: 1h 28m 44s. Rate: 7.8 symbols/min [2025-09-29T20:35:20.548863] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-29T20:35:20.552100] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-06. [2025-09-29T20:35:21.406729] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-29T20:35:21.409869] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-07. [2025-09-29T20:35:22.412610] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-29T20:35:22.416340] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-08. [2025-09-29T20:35:23.258103] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-29T20:35:23.261134] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-09. [2025-09-29T20:35:24.225670] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-29T20:35:24.229258] [INFO ] [REMOTE ] PHD: Full fetch complete (14355 records). [2025-09-29T20:35:24.229385] [DEBUG] [VALIDATOR ] PHD: Validating primary data. [2025-09-29T20:35:24.611884] [DEBUG] [VALIDATOR ] PHD: All expected trading days are present. [2025-09-29T20:35:24.611972] [DEBUG] [VALIDATOR ] PHD: Primary data validation passed. [2025-09-29T20:35:24.612307] [INFO ] [MAIN ] PHD: Fetched primary data is valid. [2025-09-29T20:35:24.612347] [DEBUG] [LOCAL ] PHD: Saving primary data. [2025-09-29T20:35:24.612916] [DEBUG] [LOCAL ] PHD: Trimmed 14355 records to 10144 (keeping 200 days of data) [2025-09-29T20:35:24.680491] [DEBUG] [LOCAL ] PHD: Primary data saved (10144 records). [2025-09-29T20:35:24.680667] [INFO ] [MAIN ] PHD: Full history saved. [2025-09-29T20:35:24.680806] [INFO ] [MAIN ] Update Progress: 1680/2371 symbols completed. PHD took 16.1s. Estimated remaining: 1h 28m 35s. Rate: 7.8 symbols/min [2025-09-29T20:35:25.208325] [INFO ] [MAIN ] PHK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:35:25.341968] [INFO ] [MAIN ] PHG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:35:25.446532] [INFO ] [MAIN ] PHI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:35:25.485998] [INFO ] [MAIN ] PHIN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:35:25.499995] [DEBUG] [LOCAL ] PHK: Loaded 26792 existing records from primary storage. [2025-09-29T20:35:25.500325] [INFO ] [MAIN ] PHK: Loaded 26792 existing records. [2025-09-29T20:35:25.631356] [DEBUG] [LOCAL ] PHI: Loaded 15230 existing records from primary storage. [2025-09-29T20:35:25.659524] [INFO ] [MAIN ] PHI: Loaded 15230 existing records. [2025-09-29T20:35:25.831032] [DEBUG] [LOCAL ] PHG: Loaded 46835 existing records from primary storage. [2025-09-29T20:35:25.865250] [DEBUG] [LOCAL ] PHIN: Loaded 33541 existing records from primary storage. [2025-09-29T20:35:25.873229] [INFO ] [MAIN ] PHIN: Loaded 33541 existing records. [2025-09-29T20:35:25.872242] [WARN ] [MAIN ] PHK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:35:25.878743] [INFO ] [MAIN ] PHK: Wiping existing primary data before full refresh. [2025-09-29T20:35:25.884266] [INFO ] [LOCAL ] PHK: Starting deletion of primary data. [2025-09-29T20:35:25.884141] [INFO ] [MAIN ] PHG: Loaded 46835 existing records. [2025-09-29T20:35:25.905099] [DEBUG] [LOCAL ] PHK: Deleted primary data file. [2025-09-29T20:35:25.983875] [INFO ] [MAIN ] PHK: Starting full primary refresh. [2025-09-29T20:35:26.117422] [WARN ] [MAIN ] PHI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:35:26.281507] [INFO ] [MAIN ] PHI: Wiping existing primary data before full refresh. [2025-09-29T20:35:26.361968] [INFO ] [LOCAL ] PHI: Starting deletion of primary data. [2025-09-29T20:35:26.492277] [WARN ] [MAIN ] PHIN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:35:26.527396] [DEBUG] [LOCAL ] PHI: Deleted primary data file. [2025-09-29T20:35:26.535386] [INFO ] [MAIN ] PHIN: Wiping existing primary data before full refresh. [2025-09-29T20:35:26.553091] [INFO ] [MAIN ] PHI: Starting full primary refresh. [2025-09-29T20:35:26.601441] [INFO ] [LOCAL ] PHIN: Starting deletion of primary data. [2025-09-29T20:35:26.648779] [DEBUG] [LOCAL ] PHIN: Deleted primary data file. [2025-09-29T20:35:26.659336] [INFO ] [MAIN ] PHIN: Starting full primary refresh. [2025-09-29T20:35:26.662857] [WARN ] [MAIN ] PHG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:35:26.741863] [INFO ] [MAIN ] PHG: Wiping existing primary data before full refresh. [2025-09-29T20:35:26.779722] [INFO ] [LOCAL ] PHG: Starting deletion of primary data. [2025-09-29T20:35:26.843622] [DEBUG] [LOCAL ] PHG: Deleted primary data file. [2025-09-29T20:35:26.864793] [INFO ] [MAIN ] PHG: Starting full primary refresh. [2025-09-29T20:35:27.311974] [INFO ] [REMOTE ] PHK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:35:27.362861] [INFO ] [REMOTE ] PHK: Fetching primary data for 2024-12. [2025-09-29T20:35:27.761900] [INFO ] [REMOTE ] PHI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:35:27.783976] [INFO ] [REMOTE ] PHI: Fetching primary data for 2024-12. [2025-09-29T20:35:27.993377] [INFO ] [REMOTE ] PHIN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:35:27.997803] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2024-12. [2025-09-29T20:35:28.022979] [INFO ] [REMOTE ] PHG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:35:28.023327] [INFO ] [REMOTE ] PHG: Fetching primary data for 2024-12. [2025-09-29T20:35:29.166218] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-29T20:35:29.170165] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-01. [2025-09-29T20:35:29.254568] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-29T20:35:29.260890] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-01. [2025-09-29T20:35:29.416426] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-29T20:35:29.426127] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-01. [2025-09-29T20:35:29.672674] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-29T20:35:29.680723] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-01. [2025-09-29T20:35:29.847915] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-29T20:35:29.948167] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-02. [2025-09-29T20:35:30.460484] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-29T20:35:30.748075] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-02. [2025-09-29T20:35:30.868157] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-29T20:35:31.055379] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-29T20:35:31.121986] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-29T20:35:31.548170] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-03. [2025-09-29T20:35:31.990412] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-29T20:35:32.348108] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-02. [2025-09-29T20:35:32.659364] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-29T20:35:33.148123] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-02. [2025-09-29T20:35:33.948083] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-03. [2025-09-29T20:35:34.055378] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-29T20:35:34.254728] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-29T20:35:34.748117] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-03. [2025-09-29T20:35:35.518301] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-29T20:35:35.548088] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-04. [2025-09-29T20:35:36.301451] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-29T20:35:36.348082] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-04. [2025-09-29T20:35:36.579759] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-29T20:35:37.148186] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-04. [2025-09-29T20:35:37.948178] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-03. [2025-09-29T20:35:38.077616] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-29T20:35:38.609392] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-29T20:35:38.748144] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-05. [2025-09-29T20:35:39.548146] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-05. [2025-09-29T20:35:39.694787] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-29T20:35:40.221372] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-29T20:35:40.348122] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-05. [2025-09-29T20:35:40.543158] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-29T20:35:41.148126] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-06. [2025-09-29T20:35:41.293880] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-29T20:35:41.948127] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-04. [2025-09-29T20:35:42.257329] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-29T20:35:42.748125] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-06. [2025-09-29T20:35:43.548105] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-07. [2025-09-29T20:35:43.710841] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-29T20:35:43.760469] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-29T20:35:44.348115] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-07. [2025-09-29T20:35:45.053550] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-29T20:35:45.149111] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-06. [2025-09-29T20:35:45.152124] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-29T20:35:45.948139] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-08. [2025-09-29T20:35:46.099390] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-29T20:35:46.748118] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-07. [2025-09-29T20:35:47.000399] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-29T20:35:47.548122] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-05. [2025-09-29T20:35:47.707852] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-29T20:35:48.348125] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-08. [2025-09-29T20:35:49.148083] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-08. [2025-09-29T20:35:49.325842] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-29T20:35:49.395494] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-29T20:35:49.948117] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-09. [2025-09-29T20:35:50.452609] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-29T20:35:50.748113] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-09. [2025-09-29T20:35:50.839159] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-29T20:35:50.844222] [INFO ] [REMOTE ] PHI: Full fetch complete (20869 records). [2025-09-29T20:35:50.844345] [DEBUG] [VALIDATOR ] PHI: Validating primary data. [2025-09-29T20:35:51.233517] [DEBUG] [VALIDATOR ] PHI: All expected trading days are present. [2025-09-29T20:35:51.233706] [DEBUG] [VALIDATOR ] PHI: Primary data validation passed. [2025-09-29T20:35:51.234263] [INFO ] [MAIN ] PHI: Fetched primary data is valid. [2025-09-29T20:35:51.234329] [DEBUG] [LOCAL ] PHI: Saving primary data. [2025-09-29T20:35:51.235884] [DEBUG] [LOCAL ] PHI: Trimmed 20869 records to 14967 (keeping 200 days of data) [2025-09-29T20:35:51.338745] [DEBUG] [LOCAL ] PHI: Primary data saved (14967 records). [2025-09-29T20:35:51.338933] [INFO ] [MAIN ] PHI: Full history saved. [2025-09-29T20:35:51.339052] [INFO ] [MAIN ] Update Progress: 1681/2371 symbols completed. PHI took 26.7s. Estimated remaining: 1h 28m 35s. Rate: 7.8 symbols/min [2025-09-29T20:35:51.512887] [INFO ] [MAIN ] PHM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:35:51.560748] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-09. [2025-09-29T20:35:51.585564] [DEBUG] [LOCAL ] PHM: Loaded 52386 existing records from primary storage. [2025-09-29T20:35:51.585952] [INFO ] [MAIN ] PHM: Loaded 52386 existing records. [2025-09-29T20:35:51.785251] [WARN ] [MAIN ] PHM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:35:51.785705] [INFO ] [MAIN ] PHM: Wiping existing primary data before full refresh. [2025-09-29T20:35:51.785766] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-09-29T20:35:51.786723] [DEBUG] [LOCAL ] PHM: Deleted primary data file. [2025-09-29T20:35:51.786798] [INFO ] [MAIN ] PHM: Starting full primary refresh. [2025-09-29T20:35:52.074182] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-29T20:35:52.137773] [INFO ] [REMOTE ] PHK: Full fetch complete (39330 records). [2025-09-29T20:35:52.148711] [DEBUG] [VALIDATOR ] PHK: Validating primary data. [2025-09-29T20:35:52.303884] [INFO ] [REMOTE ] PHM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:35:52.353185] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-06. [2025-09-29T20:35:52.639158] [DEBUG] [VALIDATOR ] PHK: All expected trading days are present. [2025-09-29T20:35:52.639247] [DEBUG] [VALIDATOR ] PHK: Primary data validation passed. [2025-09-29T20:35:52.640061] [INFO ] [MAIN ] PHK: Fetched primary data is valid. [2025-09-29T20:35:52.640125] [DEBUG] [LOCAL ] PHK: Saving primary data. [2025-09-29T20:35:52.641107] [DEBUG] [LOCAL ] PHK: Trimmed 39330 records to 26245 (keeping 200 days of data) [2025-09-29T20:35:52.803796] [DEBUG] [LOCAL ] PHK: Primary data saved (26245 records). [2025-09-29T20:35:52.804124] [INFO ] [MAIN ] PHK: Full history saved. [2025-09-29T20:35:52.804258] [INFO ] [MAIN ] Update Progress: 1682/2371 symbols completed. PHK took 28.1s. Estimated remaining: 1h 28m 25s. Rate: 7.8 symbols/min [2025-09-29T20:35:52.998314] [INFO ] [MAIN ] PHR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:35:53.019606] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-29T20:35:53.027814] [INFO ] [REMOTE ] PHIN: Full fetch complete (48111 records). [2025-09-29T20:35:53.027957] [DEBUG] [VALIDATOR ] PHIN: Validating primary data. [2025-09-29T20:35:53.152414] [INFO ] [REMOTE ] PHM: Fetching primary data for 2024-12. [2025-09-29T20:35:53.263023] [DEBUG] [LOCAL ] PHR: Loaded 38045 existing records from primary storage. [2025-09-29T20:35:53.307252] [INFO ] [MAIN ] PHR: Loaded 38045 existing records. [2025-09-29T20:35:53.671377] [WARN ] [MAIN ] PHR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:35:53.684607] [DEBUG] [VALIDATOR ] PHIN: All expected trading days are present. [2025-09-29T20:35:53.684833] [DEBUG] [VALIDATOR ] PHIN: Primary data validation passed. [2025-09-29T20:35:53.685037] [INFO ] [MAIN ] PHR: Wiping existing primary data before full refresh. [2025-09-29T20:35:53.686446] [INFO ] [MAIN ] PHIN: Fetched primary data is valid. [2025-09-29T20:35:53.686600] [DEBUG] [LOCAL ] PHIN: Saving primary data. [2025-09-29T20:35:53.686862] [INFO ] [LOCAL ] PHR: Starting deletion of primary data. [2025-09-29T20:35:53.687300] [DEBUG] [LOCAL ] PHR: Deleted primary data file. [2025-09-29T20:35:53.687500] [INFO ] [MAIN ] PHR: Starting full primary refresh. [2025-09-29T20:35:53.760231] [DEBUG] [LOCAL ] PHIN: Trimmed 48111 records to 32759 (keeping 200 days of data) [2025-09-29T20:35:54.279128] [INFO ] [REMOTE ] PHR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:35:54.283713] [INFO ] [REMOTE ] PHR: Fetching primary data for 2024-12. [2025-09-29T20:35:54.295737] [DEBUG] [LOCAL ] PHIN: Primary data saved (32759 records). [2025-09-29T20:35:54.296069] [INFO ] [MAIN ] PHIN: Full history saved. [2025-09-29T20:35:54.297325] [INFO ] [MAIN ] Update Progress: 1683/2371 symbols completed. PHIN took 29.6s. Estimated remaining: 1h 28m 14s. Rate: 7.8 symbols/min [2025-09-29T20:35:54.412765] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-29T20:35:54.522277] [INFO ] [MAIN ] PII: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:35:54.569787] [DEBUG] [LOCAL ] PII: Loaded 49815 existing records from primary storage. [2025-09-29T20:35:54.570126] [INFO ] [MAIN ] PII: Loaded 49815 existing records. [2025-09-29T20:35:54.750122] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-07. [2025-09-29T20:35:54.761562] [WARN ] [MAIN ] PII: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:35:54.762667] [INFO ] [MAIN ] PII: Wiping existing primary data before full refresh. [2025-09-29T20:35:54.762739] [INFO ] [LOCAL ] PII: Starting deletion of primary data. [2025-09-29T20:35:54.763121] [DEBUG] [LOCAL ] PII: Deleted primary data file. [2025-09-29T20:35:54.763182] [INFO ] [MAIN ] PII: Starting full primary refresh. [2025-09-29T20:35:55.144484] [INFO ] [REMOTE ] PII: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:35:55.229201] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-29T20:35:55.548076] [INFO ] [REMOTE ] PII: Fetching primary data for 2024-12. [2025-09-29T20:35:55.960972] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-29T20:35:56.348116] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-01. [2025-09-29T20:35:56.779254] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-29T20:35:57.148104] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-08. [2025-09-29T20:35:57.352135] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-29T20:35:57.948089] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-01. [2025-09-29T20:35:58.261030] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-29T20:35:58.748085] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-02. [2025-09-29T20:35:58.849279] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-29T20:35:59.375426] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-29T20:35:59.548107] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-09. [2025-09-29T20:36:00.348105] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-02. [2025-09-29T20:36:00.619280] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-29T20:36:00.847089] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-29T20:36:00.857139] [INFO ] [REMOTE ] PHG: Full fetch complete (65717 records). [2025-09-29T20:36:00.857449] [DEBUG] [VALIDATOR ] PHG: Validating primary data. [2025-09-29T20:36:01.155591] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-01. [2025-09-29T20:36:01.289955] [DEBUG] [VALIDATOR ] PHG: All expected trading days are present. [2025-09-29T20:36:01.290074] [DEBUG] [VALIDATOR ] PHG: Primary data validation passed. [2025-09-29T20:36:01.291280] [INFO ] [MAIN ] PHG: Fetched primary data is valid. [2025-09-29T20:36:01.291367] [DEBUG] [LOCAL ] PHG: Saving primary data. [2025-09-29T20:36:01.293054] [DEBUG] [LOCAL ] PHG: Trimmed 65717 records to 46113 (keeping 200 days of data) [2025-09-29T20:36:01.591735] [DEBUG] [LOCAL ] PHG: Primary data saved (46113 records). [2025-09-29T20:36:01.591927] [INFO ] [MAIN ] PHG: Full history saved. [2025-09-29T20:36:01.592065] [INFO ] [MAIN ] Update Progress: 1684/2371 symbols completed. PHG took 36.9s. Estimated remaining: 1h 28m 7s. Rate: 7.8 symbols/min [2025-09-29T20:36:01.780427] [INFO ] [MAIN ] PIM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:36:01.806883] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-29T20:36:01.819425] [DEBUG] [LOCAL ] PIM: Loaded 4814 existing records from primary storage. [2025-09-29T20:36:01.819727] [INFO ] [MAIN ] PIM: Loaded 4814 existing records. [2025-09-29T20:36:01.953208] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-03. [2025-09-29T20:36:02.019126] [WARN ] [MAIN ] PIM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:36:02.019353] [INFO ] [MAIN ] PIM: Wiping existing primary data before full refresh. [2025-09-29T20:36:02.019403] [INFO ] [LOCAL ] PIM: Starting deletion of primary data. [2025-09-29T20:36:02.019713] [DEBUG] [LOCAL ] PIM: Deleted primary data file. [2025-09-29T20:36:02.019790] [INFO ] [MAIN ] PIM: Starting full primary refresh. [2025-09-29T20:36:02.401549] [INFO ] [REMOTE ] PIM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:36:02.750541] [INFO ] [REMOTE ] PIM: Fetching primary data for 2024-12. [2025-09-29T20:36:02.759026] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-29T20:36:03.333938] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-29T20:36:03.548131] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-04. [2025-09-29T20:36:03.812770] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-29T20:36:04.348147] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-02. [2025-09-29T20:36:05.104757] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-29T20:36:05.148131] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-05. [2025-09-29T20:36:05.948114] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-01. [2025-09-29T20:36:06.239562] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-29T20:36:06.427847] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-29T20:36:06.631540] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-29T20:36:06.748116] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-02. [2025-09-29T20:36:07.366908] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-29T20:36:07.548166] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-06. [2025-09-29T20:36:08.348117] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-03. [2025-09-29T20:36:08.985809] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-29T20:36:09.099728] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-29T20:36:09.148131] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-03. [2025-09-29T20:36:09.948137] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-07. [2025-09-29T20:36:10.748089] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-04. [2025-09-29T20:36:11.257454] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-29T20:36:11.475251] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-29T20:36:11.475456] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-29T20:36:11.548155] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-05. [2025-09-29T20:36:12.038096] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-29T20:36:12.348152] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-06. [2025-09-29T20:36:12.899220] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-29T20:36:13.148143] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-04. [2025-09-29T20:36:13.948169] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-03. [2025-09-29T20:36:14.748101] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-08. [2025-09-29T20:36:15.030148] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-29T20:36:15.548078] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-05. [2025-09-29T20:36:15.674130] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-29T20:36:16.348092] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-07. [2025-09-29T20:36:16.401121] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-29T20:36:17.092991] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-29T20:36:17.148111] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-08. [2025-09-29T20:36:17.446299] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-29T20:36:17.665625] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-29T20:36:17.948162] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-09. [2025-09-29T20:36:18.748136] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-09. [2025-09-29T20:36:19.483246] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-29T20:36:19.485482] [INFO ] [REMOTE ] PIM: Full fetch complete (6569 records). [2025-09-29T20:36:19.485571] [DEBUG] [VALIDATOR ] PIM: Validating primary data. [2025-09-29T20:36:19.552419] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-04. [2025-09-29T20:36:19.847942] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-29T20:36:19.904779] [INFO ] [REMOTE ] PHR: Full fetch complete (52514 records). [2025-09-29T20:36:19.921542] [DEBUG] [VALIDATOR ] PHR: Validating primary data. [2025-09-29T20:36:19.930353] [DEBUG] [VALIDATOR ] PIM: All expected trading days are present. [2025-09-29T20:36:19.946680] [DEBUG] [VALIDATOR ] PIM: Primary data validation passed. [2025-09-29T20:36:19.963755] [INFO ] [MAIN ] PIM: Fetched primary data is valid. [2025-09-29T20:36:19.975547] [DEBUG] [LOCAL ] PIM: Saving primary data. [2025-09-29T20:36:20.028360] [DEBUG] [LOCAL ] PIM: Trimmed 6569 records to 4773 (keeping 200 days of data) [2025-09-29T20:36:20.132617] [DEBUG] [LOCAL ] PIM: Primary data saved (4773 records). [2025-09-29T20:36:20.149738] [INFO ] [MAIN ] PIM: Full history saved. [2025-09-29T20:36:20.149889] [INFO ] [MAIN ] Update Progress: 1685/2371 symbols completed. PIM took 18.6s. Estimated remaining: 1h 28m 3s. Rate: 7.8 symbols/min [2025-09-29T20:36:20.353744] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-06. [2025-09-29T20:36:20.516481] [INFO ] [MAIN ] PINE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:36:20.559816] [DEBUG] [VALIDATOR ] PHR: All expected trading days are present. [2025-09-29T20:36:20.560025] [DEBUG] [VALIDATOR ] PHR: Primary data validation passed. [2025-09-29T20:36:20.561165] [INFO ] [MAIN ] PHR: Fetched primary data is valid. [2025-09-29T20:36:20.561357] [DEBUG] [LOCAL ] PHR: Saving primary data. [2025-09-29T20:36:20.562719] [DEBUG] [LOCAL ] PHR: Trimmed 52514 records to 37457 (keeping 200 days of data) [2025-09-29T20:36:20.664948] [DEBUG] [LOCAL ] PINE: Loaded 14365 existing records from primary storage. [2025-09-29T20:36:20.665853] [INFO ] [MAIN ] PINE: Loaded 14365 existing records. [2025-09-29T20:36:20.875846] [WARN ] [MAIN ] PINE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:36:20.883721] [INFO ] [MAIN ] PINE: Wiping existing primary data before full refresh. [2025-09-29T20:36:20.890906] [INFO ] [LOCAL ] PINE: Starting deletion of primary data. [2025-09-29T20:36:20.891284] [DEBUG] [LOCAL ] PINE: Deleted primary data file. [2025-09-29T20:36:20.891348] [INFO ] [MAIN ] PINE: Starting full primary refresh. [2025-09-29T20:36:21.391905] [INFO ] [REMOTE ] PINE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:36:21.394970] [INFO ] [REMOTE ] PINE: Fetching primary data for 2024-12. [2025-09-29T20:36:21.412521] [DEBUG] [LOCAL ] PHR: Primary data saved (37457 records). [2025-09-29T20:36:21.412765] [INFO ] [MAIN ] PHR: Full history saved. [2025-09-29T20:36:21.412913] [INFO ] [MAIN ] Update Progress: 1686/2371 symbols completed. PHR took 28.6s. Estimated remaining: 1h 27m 53s. Rate: 7.8 symbols/min [2025-09-29T20:36:21.602523] [INFO ] [MAIN ] PINS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:36:21.640456] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-29T20:36:21.706835] [DEBUG] [LOCAL ] PINS: Loaded 54473 existing records from primary storage. [2025-09-29T20:36:21.707210] [INFO ] [MAIN ] PINS: Loaded 54473 existing records. [2025-09-29T20:36:21.899494] [WARN ] [MAIN ] PINS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:36:21.899904] [INFO ] [MAIN ] PINS: Wiping existing primary data before full refresh. [2025-09-29T20:36:21.900050] [INFO ] [LOCAL ] PINS: Starting deletion of primary data. [2025-09-29T20:36:21.900701] [DEBUG] [LOCAL ] PINS: Deleted primary data file. [2025-09-29T20:36:21.900768] [INFO ] [MAIN ] PINS: Starting full primary refresh. [2025-09-29T20:36:21.966309] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-05. [2025-09-29T20:36:22.127348] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-29T20:36:22.350431] [INFO ] [REMOTE ] PINS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:36:22.470849] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-29T20:36:22.748140] [INFO ] [REMOTE ] PINS: Fetching primary data for 2024-12. [2025-09-29T20:36:23.548158] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-01. [2025-09-29T20:36:23.806820] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-29T20:36:24.348100] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-06. [2025-09-29T20:36:24.579133] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-29T20:36:24.747588] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-29T20:36:25.148144] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-02. [2025-09-29T20:36:25.825125] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-29T20:36:25.948121] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-07. [2025-09-29T20:36:26.748133] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-01. [2025-09-29T20:36:27.548141] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-07. [2025-09-29T20:36:27.695282] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-29T20:36:28.348085] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-08. [2025-09-29T20:36:28.465283] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-02 (3.32 seconds). [2025-09-29T20:36:28.705679] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-29T20:36:29.019529] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-29T20:36:29.148113] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-08. [2025-09-29T20:36:29.948146] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-03. [2025-09-29T20:36:30.214081] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-29T20:36:30.562247] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-29T20:36:30.748216] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-09. [2025-09-29T20:36:31.082172] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-29T20:36:31.548160] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-09. [2025-09-29T20:36:32.348132] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-04. [2025-09-29T20:36:32.394403] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-29T20:36:32.405916] [INFO ] [REMOTE ] PHM: Full fetch complete (74654 records). [2025-09-29T20:36:32.406126] [DEBUG] [VALIDATOR ] PHM: Validating primary data. [2025-09-29T20:36:32.407093] [FATAL] [VALIDATOR ] PHM: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T20:36:32.407194] [FATAL] [MAIN ] PHM: Fetched primary data is invalid. Refusing to save it. [2025-09-29T20:36:32.407265] [WARN ] [MAIN ] PHM: Deleting existing primary and derivative data due to validation failure. [2025-09-29T20:36:32.407348] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-09-29T20:36:32.407445] [DEBUG] [LOCAL ] PHM: No primary data file found to delete. [2025-09-29T20:36:32.407526] [INFO ] [LOCAL ] PHM: Starting deletion of derivative data. [2025-09-29T20:36:32.408366] [DEBUG] [LOCAL ] PHM: Deleted derivative data file. [2025-09-29T20:36:32.408537] [INFO ] [MAIN ] Update Progress: 1687/2371 symbols completed. PHM took 41.1s. Estimated remaining: 1h 27m 47s. Rate: 7.8 symbols/min [2025-09-29T20:36:32.677357] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-29T20:36:32.679136] [INFO ] [MAIN ] PIPR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:36:32.689830] [INFO ] [REMOTE ] PII: Full fetch complete (71141 records). [2025-09-29T20:36:32.689994] [DEBUG] [VALIDATOR ] PII: Validating primary data. [2025-09-29T20:36:32.951450] [DEBUG] [LOCAL ] PIPR: Loaded 15331 existing records from primary storage. [2025-09-29T20:36:33.005557] [INFO ] [MAIN ] PIPR: Loaded 15331 existing records. [2025-09-29T20:36:33.158980] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-02. [2025-09-29T20:36:33.345821] [DEBUG] [VALIDATOR ] PII: All expected trading days are present. [2025-09-29T20:36:33.382063] [WARN ] [MAIN ] PIPR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:36:33.382383] [INFO ] [MAIN ] PIPR: Wiping existing primary data before full refresh. [2025-09-29T20:36:33.382465] [INFO ] [LOCAL ] PIPR: Starting deletion of primary data. [2025-09-29T20:36:33.377878] [DEBUG] [VALIDATOR ] PII: Primary data validation passed. [2025-09-29T20:36:33.384002] [INFO ] [MAIN ] PII: Fetched primary data is valid. [2025-09-29T20:36:33.384187] [DEBUG] [LOCAL ] PII: Saving primary data. [2025-09-29T20:36:33.384464] [DEBUG] [LOCAL ] PIPR: Deleted primary data file. [2025-09-29T20:36:33.384545] [INFO ] [MAIN ] PIPR: Starting full primary refresh. [2025-09-29T20:36:33.467007] [DEBUG] [LOCAL ] PII: Trimmed 71141 records to 49021 (keeping 200 days of data) [2025-09-29T20:36:33.632160] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-29T20:36:33.892747] [INFO ] [REMOTE ] PIPR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:36:33.971380] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-05. [2025-09-29T20:36:34.098489] [DEBUG] [LOCAL ] PII: Primary data saved (49021 records). [2025-09-29T20:36:34.098633] [INFO ] [MAIN ] PII: Full history saved. [2025-09-29T20:36:34.098767] [INFO ] [MAIN ] Update Progress: 1688/2371 symbols completed. PII took 39.8s. Estimated remaining: 1h 27m 37s. Rate: 7.8 symbols/min [2025-09-29T20:36:34.267845] [INFO ] [MAIN ] PJT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:36:34.291359] [DEBUG] [LOCAL ] PJT: Loaded 22579 existing records from primary storage. [2025-09-29T20:36:34.291610] [INFO ] [MAIN ] PJT: Loaded 22579 existing records. [2025-09-29T20:36:34.468376] [WARN ] [MAIN ] PJT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:36:34.468611] [INFO ] [MAIN ] PJT: Wiping existing primary data before full refresh. [2025-09-29T20:36:34.468690] [INFO ] [LOCAL ] PJT: Starting deletion of primary data. [2025-09-29T20:36:34.469002] [DEBUG] [LOCAL ] PJT: Deleted primary data file. [2025-09-29T20:36:34.469063] [INFO ] [MAIN ] PJT: Starting full primary refresh. [2025-09-29T20:36:34.753305] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2024-12. [2025-09-29T20:36:34.860749] [INFO ] [REMOTE ] PJT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:36:34.872325] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-29T20:36:35.293402] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-29T20:36:35.548159] [INFO ] [REMOTE ] PJT: Fetching primary data for 2024-12. [2025-09-29T20:36:36.071701] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-29T20:36:36.348165] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-03. [2025-09-29T20:36:36.658775] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-29T20:36:37.148170] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-06. [2025-09-29T20:36:37.948123] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-01. [2025-09-29T20:36:38.031357] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-29T20:36:38.419299] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-29T20:36:38.651414] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-29T20:36:38.748200] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-01. [2025-09-29T20:36:39.548104] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-07. [2025-09-29T20:36:39.958816] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-29T20:36:40.348085] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-02. [2025-09-29T20:36:40.410502] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-29T20:36:41.148164] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-04. [2025-09-29T20:36:41.192128] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-29T20:36:41.948109] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-08. [2025-09-29T20:36:42.748093] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-02. [2025-09-29T20:36:42.869587] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-29T20:36:43.293203] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-29T20:36:43.548126] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-09. [2025-09-29T20:36:43.715174] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-29T20:36:44.202238] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-29T20:36:44.205475] [INFO ] [REMOTE ] PINE: Full fetch complete (21085 records). [2025-09-29T20:36:44.205564] [DEBUG] [VALIDATOR ] PINE: Validating primary data. [2025-09-29T20:36:44.359276] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-03. [2025-09-29T20:36:44.597949] [DEBUG] [VALIDATOR ] PINE: All expected trading days are present. [2025-09-29T20:36:44.598036] [DEBUG] [VALIDATOR ] PINE: Primary data validation passed. [2025-09-29T20:36:44.598476] [INFO ] [MAIN ] PINE: Fetched primary data is valid. [2025-09-29T20:36:44.598517] [DEBUG] [LOCAL ] PINE: Saving primary data. [2025-09-29T20:36:44.599153] [DEBUG] [LOCAL ] PINE: Trimmed 21085 records to 14067 (keeping 200 days of data) [2025-09-29T20:36:44.690704] [DEBUG] [LOCAL ] PINE: Primary data saved (14067 records). [2025-09-29T20:36:44.690894] [INFO ] [MAIN ] PINE: Full history saved. [2025-09-29T20:36:44.690991] [INFO ] [MAIN ] Update Progress: 1689/2371 symbols completed. PINE took 24.5s. Estimated remaining: 1h 27m 30s. Rate: 7.8 symbols/min [2025-09-29T20:36:44.866174] [INFO ] [MAIN ] PK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:36:44.922996] [DEBUG] [LOCAL ] PK: Loaded 53626 existing records from primary storage. [2025-09-29T20:36:44.923340] [INFO ] [MAIN ] PK: Loaded 53626 existing records. [2025-09-29T20:36:45.109541] [WARN ] [MAIN ] PK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:36:45.109839] [INFO ] [MAIN ] PK: Wiping existing primary data before full refresh. [2025-09-29T20:36:45.109891] [INFO ] [LOCAL ] PK: Starting deletion of primary data. [2025-09-29T20:36:45.110248] [DEBUG] [LOCAL ] PK: Deleted primary data file. [2025-09-29T20:36:45.110310] [INFO ] [MAIN ] PK: Starting full primary refresh. [2025-09-29T20:36:45.156348] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-03. [2025-09-29T20:36:45.504425] [INFO ] [REMOTE ] PK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:36:45.515249] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-29T20:36:45.948119] [INFO ] [REMOTE ] PK: Fetching primary data for 2024-12. [2025-09-29T20:36:46.576030] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-29T20:36:46.748127] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-04. [2025-09-29T20:36:47.548120] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-04. [2025-09-29T20:36:47.913491] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-29T20:36:47.978938] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-29T20:36:48.348127] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-05. [2025-09-29T20:36:48.519544] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-29T20:36:49.148115] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-01. [2025-09-29T20:36:49.516007] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-29T20:36:49.948120] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-06. [2025-09-29T20:36:50.748161] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-05. [2025-09-29T20:36:50.897272] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-29T20:36:50.949440] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-29T20:36:51.548122] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-05. [2025-09-29T20:36:51.835376] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-29T20:36:52.348115] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-07. [2025-09-29T20:36:53.148082] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-06. [2025-09-29T20:36:53.464061] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-29T20:36:53.650065] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-29T20:36:53.948084] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-08. [2025-09-29T20:36:54.337525] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-29T20:36:54.748117] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-02. [2025-09-29T20:36:54.947412] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-29T20:36:55.548163] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-07. [2025-09-29T20:36:56.196278] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-29T20:36:56.348112] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-06. [2025-09-29T20:36:56.787412] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-29T20:36:57.148111] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-09. [2025-09-29T20:36:57.948116] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-03. [2025-09-29T20:36:58.161472] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-29T20:36:58.166217] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-29T20:36:58.176093] [INFO ] [REMOTE ] PIPR: Full fetch complete (20432 records). [2025-09-29T20:36:58.176377] [DEBUG] [VALIDATOR ] PIPR: Validating primary data. [2025-09-29T20:36:58.585082] [DEBUG] [VALIDATOR ] PIPR: All expected trading days are present. [2025-09-29T20:36:58.585204] [DEBUG] [VALIDATOR ] PIPR: Primary data validation passed. [2025-09-29T20:36:58.585766] [INFO ] [MAIN ] PIPR: Fetched primary data is valid. [2025-09-29T20:36:58.585831] [DEBUG] [LOCAL ] PIPR: Saving primary data. [2025-09-29T20:36:58.586765] [DEBUG] [LOCAL ] PIPR: Trimmed 20432 records to 14914 (keeping 200 days of data) [2025-09-29T20:36:58.684484] [DEBUG] [LOCAL ] PIPR: Primary data saved (14914 records). [2025-09-29T20:36:58.684636] [INFO ] [MAIN ] PIPR: Full history saved. [2025-09-29T20:36:58.684762] [INFO ] [MAIN ] Update Progress: 1690/2371 symbols completed. PIPR took 26.3s. Estimated remaining: 1h 27m 25s. Rate: 7.8 symbols/min [2025-09-29T20:36:58.753254] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-08. [2025-09-29T20:36:58.863761] [INFO ] [MAIN ] PKE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:36:58.878573] [DEBUG] [LOCAL ] PKE: Loaded 12775 existing records from primary storage. [2025-09-29T20:36:58.878857] [INFO ] [MAIN ] PKE: Loaded 12775 existing records. [2025-09-29T20:36:59.062990] [WARN ] [MAIN ] PKE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:36:59.063162] [INFO ] [MAIN ] PKE: Wiping existing primary data before full refresh. [2025-09-29T20:36:59.063209] [INFO ] [LOCAL ] PKE: Starting deletion of primary data. [2025-09-29T20:36:59.063390] [DEBUG] [LOCAL ] PKE: Deleted primary data file. [2025-09-29T20:36:59.063449] [INFO ] [MAIN ] PKE: Starting full primary refresh. [2025-09-29T20:36:59.436701] [INFO ] [REMOTE ] PKE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:36:59.548072] [INFO ] [REMOTE ] PKE: Fetching primary data for 2024-12. [2025-09-29T20:36:59.734983] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-29T20:36:59.762359] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-29T20:37:00.348107] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-07. [2025-09-29T20:37:00.841216] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-29T20:37:01.148111] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-04. [2025-09-29T20:37:01.948178] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-09. [2025-09-29T20:37:02.544790] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-29T20:37:02.629965] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-29T20:37:02.633787] [INFO ] [REMOTE ] PJT: Full fetch complete (31946 records). [2025-09-29T20:37:02.633887] [DEBUG] [VALIDATOR ] PJT: Validating primary data. [2025-09-29T20:37:02.753148] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-01. [2025-09-29T20:37:03.044558] [DEBUG] [VALIDATOR ] PJT: All expected trading days are present. [2025-09-29T20:37:03.055522] [DEBUG] [VALIDATOR ] PJT: Primary data validation passed. [2025-09-29T20:37:03.066772] [INFO ] [MAIN ] PJT: Fetched primary data is valid. [2025-09-29T20:37:03.078036] [DEBUG] [LOCAL ] PJT: Saving primary data. [2025-09-29T20:37:03.084975] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-29T20:37:03.085129] [DEBUG] [LOCAL ] PJT: Trimmed 31946 records to 21931 (keeping 200 days of data) [2025-09-29T20:37:03.238039] [DEBUG] [LOCAL ] PJT: Primary data saved (21931 records). [2025-09-29T20:37:03.238175] [INFO ] [MAIN ] PJT: Full history saved. [2025-09-29T20:37:03.238261] [INFO ] [MAIN ] Update Progress: 1691/2371 symbols completed. PJT took 29.1s. Estimated remaining: 1h 27m 16s. Rate: 7.8 symbols/min [2025-09-29T20:37:03.412284] [INFO ] [MAIN ] PKG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:37:03.455751] [DEBUG] [LOCAL ] PKG: Loaded 39785 existing records from primary storage. [2025-09-29T20:37:03.456157] [INFO ] [MAIN ] PKG: Loaded 39785 existing records. [2025-09-29T20:37:03.550855] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-08. [2025-09-29T20:37:03.664212] [WARN ] [MAIN ] PKG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:37:03.664440] [INFO ] [MAIN ] PKG: Wiping existing primary data before full refresh. [2025-09-29T20:37:03.664491] [INFO ] [LOCAL ] PKG: Starting deletion of primary data. [2025-09-29T20:37:03.664993] [DEBUG] [LOCAL ] PKG: Deleted primary data file. [2025-09-29T20:37:03.665055] [INFO ] [MAIN ] PKG: Starting full primary refresh. [2025-09-29T20:37:03.833759] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-29T20:37:04.068015] [INFO ] [REMOTE ] PKG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:37:04.348109] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-02. [2025-09-29T20:37:05.148120] [INFO ] [REMOTE ] PKG: Fetching primary data for 2024-12. [2025-09-29T20:37:05.279047] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-29T20:37:05.416624] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-29T20:37:05.948121] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-03. [2025-09-29T20:37:06.752111] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-09. [2025-09-29T20:37:06.768799] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-29T20:37:06.824516] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-29T20:37:07.548138] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-04. [2025-09-29T20:37:08.293039] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-29T20:37:08.348105] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-05. [2025-09-29T20:37:08.406814] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-29T20:37:08.418158] [INFO ] [REMOTE ] PINS: Full fetch complete (77738 records). [2025-09-29T20:37:08.418346] [DEBUG] [VALIDATOR ] PINS: Validating primary data. [2025-09-29T20:37:08.853045] [DEBUG] [VALIDATOR ] PINS: All expected trading days are present. [2025-09-29T20:37:08.853162] [DEBUG] [VALIDATOR ] PINS: Primary data validation passed. [2025-09-29T20:37:08.854514] [INFO ] [MAIN ] PINS: Fetched primary data is valid. [2025-09-29T20:37:08.854583] [DEBUG] [LOCAL ] PINS: Saving primary data. [2025-09-29T20:37:08.856333] [DEBUG] [LOCAL ] PINS: Trimmed 77738 records to 53693 (keeping 200 days of data) [2025-09-29T20:37:09.078679] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-29T20:37:09.156501] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-05. [2025-09-29T20:37:09.211116] [DEBUG] [LOCAL ] PINS: Primary data saved (53693 records). [2025-09-29T20:37:09.211314] [INFO ] [MAIN ] PINS: Full history saved. [2025-09-29T20:37:09.211419] [INFO ] [MAIN ] Update Progress: 1692/2371 symbols completed. PINS took 47.8s. Estimated remaining: 1h 27m 7s. Rate: 7.8 symbols/min [2025-09-29T20:37:09.410189] [INFO ] [MAIN ] PKST: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:37:09.430548] [DEBUG] [LOCAL ] PKST: Loaded 19461 existing records from primary storage. [2025-09-29T20:37:09.430912] [INFO ] [MAIN ] PKST: Loaded 19461 existing records. [2025-09-29T20:37:09.626131] [WARN ] [MAIN ] PKST: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:37:09.626412] [INFO ] [MAIN ] PKST: Wiping existing primary data before full refresh. [2025-09-29T20:37:09.626484] [INFO ] [LOCAL ] PKST: Starting deletion of primary data. [2025-09-29T20:37:09.626898] [DEBUG] [LOCAL ] PKST: Deleted primary data file. [2025-09-29T20:37:09.626959] [INFO ] [MAIN ] PKST: Starting full primary refresh. [2025-09-29T20:37:09.953324] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-01. [2025-09-29T20:37:10.016366] [INFO ] [REMOTE ] PKST: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:37:10.748129] [INFO ] [REMOTE ] PKST: Fetching primary data for 2024-12. [2025-09-29T20:37:11.038498] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-29T20:37:11.548151] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-06. [2025-09-29T20:37:11.820980] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-29T20:37:12.263317] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-29T20:37:12.348101] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-06. [2025-09-29T20:37:12.573341] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-29T20:37:13.148121] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-02. [2025-09-29T20:37:13.948103] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-01. [2025-09-29T20:37:14.230082] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-29T20:37:14.748120] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-07. [2025-09-29T20:37:14.889099] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-29T20:37:15.072950] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-29T20:37:15.548167] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-07. [2025-09-29T20:37:15.989534] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-29T20:37:16.348120] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-08. [2025-09-29T20:37:17.148085] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-02. [2025-09-29T20:37:17.474666] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-29T20:37:17.475983] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-29T20:37:17.948116] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-03. [2025-09-29T20:37:18.015048] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-29T20:37:18.748132] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-08. [2025-09-29T20:37:19.548137] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-03. [2025-09-29T20:37:19.606599] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-29T20:37:20.348120] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-04. [2025-09-29T20:37:20.710037] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-29T20:37:20.905593] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-29T20:37:21.148133] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-09. [2025-09-29T20:37:21.882923] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-29T20:37:21.912872] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-29T20:37:21.916378] [INFO ] [REMOTE ] PKE: Full fetch complete (17087 records). [2025-09-29T20:37:21.916464] [DEBUG] [VALIDATOR ] PKE: Validating primary data. [2025-09-29T20:37:21.953260] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-04. [2025-09-29T20:37:22.296316] [DEBUG] [VALIDATOR ] PKE: All expected trading days are present. [2025-09-29T20:37:22.296411] [DEBUG] [VALIDATOR ] PKE: Primary data validation passed. [2025-09-29T20:37:22.296867] [INFO ] [MAIN ] PKE: Fetched primary data is valid. [2025-09-29T20:37:22.296930] [DEBUG] [LOCAL ] PKE: Saving primary data. [2025-09-29T20:37:22.297569] [DEBUG] [LOCAL ] PKE: Trimmed 17087 records to 12743 (keeping 200 days of data) [2025-09-29T20:37:22.375911] [DEBUG] [LOCAL ] PKE: Primary data saved (12743 records). [2025-09-29T20:37:22.376067] [INFO ] [MAIN ] PKE: Full history saved. [2025-09-29T20:37:22.376172] [INFO ] [MAIN ] Update Progress: 1693/2371 symbols completed. PKE took 23.7s. Estimated remaining: 1h 27m 2s. Rate: 7.8 symbols/min [2025-09-29T20:37:22.561281] [INFO ] [MAIN ] PKX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:37:22.590272] [DEBUG] [LOCAL ] PKX: Loaded 25141 existing records from primary storage. [2025-09-29T20:37:22.590565] [INFO ] [MAIN ] PKX: Loaded 25141 existing records. [2025-09-29T20:37:22.757713] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-09. [2025-09-29T20:37:22.782626] [WARN ] [MAIN ] PKX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:37:22.783106] [INFO ] [MAIN ] PKX: Wiping existing primary data before full refresh. [2025-09-29T20:37:22.783161] [INFO ] [LOCAL ] PKX: Starting deletion of primary data. [2025-09-29T20:37:22.783575] [DEBUG] [LOCAL ] PKX: Deleted primary data file. [2025-09-29T20:37:22.783638] [INFO ] [MAIN ] PKX: Starting full primary refresh. [2025-09-29T20:37:23.269763] [INFO ] [REMOTE ] PKX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:37:23.293425] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-29T20:37:23.548181] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-05. [2025-09-29T20:37:24.348111] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-05. [2025-09-29T20:37:24.516023] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-29T20:37:24.527527] [INFO ] [REMOTE ] PK: Full fetch complete (76370 records). [2025-09-29T20:37:24.527738] [DEBUG] [VALIDATOR ] PK: Validating primary data. [2025-09-29T20:37:24.728415] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-29T20:37:24.960101] [DEBUG] [VALIDATOR ] PK: All expected trading days are present. [2025-09-29T20:37:24.960180] [DEBUG] [VALIDATOR ] PK: Primary data validation passed. [2025-09-29T20:37:24.961285] [INFO ] [MAIN ] PK: Fetched primary data is valid. [2025-09-29T20:37:24.961354] [DEBUG] [LOCAL ] PK: Saving primary data. [2025-09-29T20:37:24.962836] [DEBUG] [LOCAL ] PK: Trimmed 76370 records to 52830 (keeping 200 days of data) [2025-09-29T20:37:25.149250] [INFO ] [REMOTE ] PKX: Fetching primary data for 2024-12. [2025-09-29T20:37:25.288214] [DEBUG] [LOCAL ] PK: Primary data saved (52830 records). [2025-09-29T20:37:25.288359] [INFO ] [MAIN ] PK: Full history saved. [2025-09-29T20:37:25.288443] [INFO ] [MAIN ] Update Progress: 1694/2371 symbols completed. PK took 40.6s. Estimated remaining: 1h 26m 52s. Rate: 7.8 symbols/min [2025-09-29T20:37:25.486777] [INFO ] [MAIN ] PL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:37:25.549013] [DEBUG] [LOCAL ] PL: Loaded 53894 existing records from primary storage. [2025-09-29T20:37:25.549330] [INFO ] [MAIN ] PL: Loaded 53894 existing records. [2025-09-29T20:37:25.748136] [WARN ] [MAIN ] PL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:37:25.748485] [INFO ] [MAIN ] PL: Wiping existing primary data before full refresh. [2025-09-29T20:37:25.748591] [INFO ] [LOCAL ] PL: Starting deletion of primary data. [2025-09-29T20:37:25.749098] [DEBUG] [LOCAL ] PL: Deleted primary data file. [2025-09-29T20:37:25.749260] [INFO ] [MAIN ] PL: Starting full primary refresh. [2025-09-29T20:37:25.952953] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-06. [2025-09-29T20:37:26.073593] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-29T20:37:26.196954] [INFO ] [REMOTE ] PL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:37:26.694096] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-29T20:37:26.748077] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-01. [2025-09-29T20:37:27.132185] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-29T20:37:27.548148] [INFO ] [REMOTE ] PL: Fetching primary data for 2024-12. [2025-09-29T20:37:28.009206] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-29T20:37:28.348156] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-02. [2025-09-29T20:37:29.148151] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-07. [2025-09-29T20:37:29.948139] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-06. [2025-09-29T20:37:29.999504] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-09-29T20:37:30.134501] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-29T20:37:30.263032] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-29T20:37:30.748154] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-01. [2025-09-29T20:37:31.548127] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-08. [2025-09-29T20:37:31.618227] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-29T20:37:32.348121] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-03. [2025-09-29T20:37:32.674985] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-29T20:37:33.034262] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-29T20:37:33.148112] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-07. [2025-09-29T20:37:33.925298] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-29T20:37:33.948113] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-02. [2025-09-29T20:37:34.756036] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-09. [2025-09-29T20:37:34.758906] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-29T20:37:35.548161] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-04. [2025-09-29T20:37:35.877803] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-29T20:37:35.882222] [INFO ] [REMOTE ] PKST: Full fetch complete (29674 records). [2025-09-29T20:37:35.882374] [DEBUG] [VALIDATOR ] PKST: Validating primary data. [2025-09-29T20:37:36.268327] [DEBUG] [VALIDATOR ] PKST: All expected trading days are present. [2025-09-29T20:37:36.268503] [DEBUG] [VALIDATOR ] PKST: Primary data validation passed. [2025-09-29T20:37:36.269303] [INFO ] [MAIN ] PKST: Fetched primary data is valid. [2025-09-29T20:37:36.269369] [DEBUG] [LOCAL ] PKST: Saving primary data. [2025-09-29T20:37:36.270171] [DEBUG] [LOCAL ] PKST: Trimmed 29674 records to 18985 (keeping 200 days of data) [2025-09-29T20:37:36.351875] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-08. [2025-09-29T20:37:36.392406] [DEBUG] [LOCAL ] PKST: Primary data saved (18985 records). [2025-09-29T20:37:36.392565] [INFO ] [MAIN ] PKST: Full history saved. [2025-09-29T20:37:36.392698] [INFO ] [MAIN ] Update Progress: 1695/2371 symbols completed. PKST took 27.2s. Estimated remaining: 1h 26m 46s. Rate: 7.8 symbols/min [2025-09-29T20:37:36.570997] [INFO ] [MAIN ] PLD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:37:36.642033] [DEBUG] [LOCAL ] PLD: Loaded 54226 existing records from primary storage. [2025-09-29T20:37:36.642781] [INFO ] [MAIN ] PLD: Loaded 54226 existing records. [2025-09-29T20:37:36.837178] [WARN ] [MAIN ] PLD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:37:36.837872] [INFO ] [MAIN ] PLD: Wiping existing primary data before full refresh. [2025-09-29T20:37:36.837948] [INFO ] [LOCAL ] PLD: Starting deletion of primary data. [2025-09-29T20:37:36.838474] [DEBUG] [LOCAL ] PLD: Deleted primary data file. [2025-09-29T20:37:36.838534] [INFO ] [MAIN ] PLD: Starting full primary refresh. [2025-09-29T20:37:37.215019] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-29T20:37:37.258749] [INFO ] [REMOTE ] PLD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:37:37.259305] [INFO ] [REMOTE ] PLD: Fetching primary data for 2024-12. [2025-09-29T20:37:37.356117] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-02 (3.41 seconds). [2025-09-29T20:37:37.936431] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-29T20:37:37.948069] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-09. [2025-09-29T20:37:38.748086] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-03. [2025-09-29T20:37:38.842864] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-29T20:37:39.491117] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-29T20:37:39.501788] [INFO ] [REMOTE ] PKG: Full fetch complete (57545 records). [2025-09-29T20:37:39.501980] [DEBUG] [VALIDATOR ] PKG: Validating primary data. [2025-09-29T20:37:39.553228] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-05. [2025-09-29T20:37:39.939049] [DEBUG] [VALIDATOR ] PKG: All expected trading days are present. [2025-09-29T20:37:39.939149] [DEBUG] [VALIDATOR ] PKG: Primary data validation passed. [2025-09-29T20:37:39.940249] [INFO ] [MAIN ] PKG: Fetched primary data is valid. [2025-09-29T20:37:39.940320] [DEBUG] [LOCAL ] PKG: Saving primary data. [2025-09-29T20:37:39.941633] [DEBUG] [LOCAL ] PKG: Trimmed 57545 records to 39062 (keeping 200 days of data) [2025-09-29T20:37:40.210467] [DEBUG] [LOCAL ] PKG: Primary data saved (39062 records). [2025-09-29T20:37:40.210686] [INFO ] [MAIN ] PKG: Full history saved. [2025-09-29T20:37:40.212057] [INFO ] [MAIN ] Update Progress: 1696/2371 symbols completed. PKG took 37.0s. Estimated remaining: 1h 26m 37s. Rate: 7.8 symbols/min [2025-09-29T20:37:40.358469] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-01. [2025-09-29T20:37:40.394526] [INFO ] [MAIN ] PLNT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:37:40.450672] [DEBUG] [LOCAL ] PLNT: Loaded 49144 existing records from primary storage. [2025-09-29T20:37:40.451035] [INFO ] [MAIN ] PLNT: Loaded 49144 existing records. [2025-09-29T20:37:40.652046] [WARN ] [MAIN ] PLNT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:37:40.652745] [INFO ] [MAIN ] PLNT: Wiping existing primary data before full refresh. [2025-09-29T20:37:40.652881] [INFO ] [LOCAL ] PLNT: Starting deletion of primary data. [2025-09-29T20:37:40.653271] [DEBUG] [LOCAL ] PLNT: Deleted primary data file. [2025-09-29T20:37:40.653334] [INFO ] [MAIN ] PLNT: Starting full primary refresh. [2025-09-29T20:37:41.019027] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-29T20:37:41.057377] [INFO ] [REMOTE ] PLNT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:37:41.094782] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-09-29T20:37:41.148108] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-06. [2025-09-29T20:37:41.948132] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-04. [2025-09-29T20:37:42.085084] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-29T20:37:42.369009] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-29T20:37:42.748111] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-07. [2025-09-29T20:37:43.548127] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-02. [2025-09-29T20:37:44.003132] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-29T20:37:44.058311] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-29T20:37:44.348114] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-05. [2025-09-29T20:37:45.051851] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-29T20:37:45.148140] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-03. [2025-09-29T20:37:45.948072] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2024-12. [2025-09-29T20:37:46.459067] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-29T20:37:46.748122] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-08. [2025-09-29T20:37:47.165359] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-29T20:37:47.548108] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-04. [2025-09-29T20:37:47.750416] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-29T20:37:47.868457] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-29T20:37:48.348112] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-09. [2025-09-29T20:37:49.148085] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-01. [2025-09-29T20:37:49.489091] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-29T20:37:49.696910] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-29T20:37:49.702504] [INFO ] [REMOTE ] PKX: Full fetch complete (37353 records). [2025-09-29T20:37:49.702598] [DEBUG] [VALIDATOR ] PKX: Validating primary data. [2025-09-29T20:37:49.953496] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-05. [2025-09-29T20:37:50.096390] [DEBUG] [VALIDATOR ] PKX: All expected trading days are present. [2025-09-29T20:37:50.096479] [DEBUG] [VALIDATOR ] PKX: Primary data validation passed. [2025-09-29T20:37:50.097348] [INFO ] [MAIN ] PKX: Fetched primary data is valid. [2025-09-29T20:37:50.097412] [DEBUG] [LOCAL ] PKX: Saving primary data. [2025-09-29T20:37:50.098314] [DEBUG] [LOCAL ] PKX: Trimmed 37353 records to 24464 (keeping 200 days of data) [2025-09-29T20:37:50.275405] [DEBUG] [LOCAL ] PKX: Primary data saved (24464 records). [2025-09-29T20:37:50.275555] [INFO ] [MAIN ] PKX: Full history saved. [2025-09-29T20:37:50.275696] [INFO ] [MAIN ] Update Progress: 1697/2371 symbols completed. PKX took 27.9s. Estimated remaining: 1h 26m 30s. Rate: 7.8 symbols/min [2025-09-29T20:37:50.454052] [INFO ] [MAIN ] PLOW: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:37:50.477447] [DEBUG] [LOCAL ] PLOW: Loaded 20792 existing records from primary storage. [2025-09-29T20:37:50.477725] [INFO ] [MAIN ] PLOW: Loaded 20792 existing records. [2025-09-29T20:37:50.675912] [WARN ] [MAIN ] PLOW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:37:50.676243] [INFO ] [MAIN ] PLOW: Wiping existing primary data before full refresh. [2025-09-29T20:37:50.676339] [INFO ] [LOCAL ] PLOW: Starting deletion of primary data. [2025-09-29T20:37:50.676838] [DEBUG] [LOCAL ] PLOW: Deleted primary data file. [2025-09-29T20:37:50.676950] [INFO ] [MAIN ] PLOW: Starting full primary refresh. [2025-09-29T20:37:50.748613] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-06. [2025-09-29T20:37:51.005063] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-29T20:37:51.117216] [INFO ] [REMOTE ] PLOW: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:37:51.548123] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2024-12. [2025-09-29T20:37:52.091101] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-29T20:37:52.348152] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-06. [2025-09-29T20:37:52.748137] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-29T20:37:52.871915] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-29T20:37:53.148141] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-07. [2025-09-29T20:37:53.948110] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-01. [2025-09-29T20:37:53.983593] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-29T20:37:54.748135] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-07. [2025-09-29T20:37:55.270955] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-29T20:37:55.548119] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-02. [2025-09-29T20:37:55.707180] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-09-29T20:37:56.348136] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-02. [2025-09-29T20:37:56.417406] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-29T20:37:56.638387] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-29T20:37:57.148125] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-03. [2025-09-29T20:37:57.948113] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-08. [2025-09-29T20:37:58.034497] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-29T20:37:58.086926] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-29T20:37:58.748165] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-04. [2025-09-29T20:37:59.548190] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-08. [2025-09-29T20:37:59.773436] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-29T20:37:59.855897] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-29T20:38:00.348141] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-09. [2025-09-29T20:38:01.148183] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-05. [2025-09-29T20:38:01.677240] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-29T20:38:01.948151] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-09. [2025-09-29T20:38:02.391282] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-29T20:38:02.748116] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-03. [2025-09-29T20:38:02.827170] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-09-29T20:38:02.838527] [INFO ] [REMOTE ] PL: Full fetch complete (76947 records). [2025-09-29T20:38:02.838722] [DEBUG] [VALIDATOR ] PL: Validating primary data. [2025-09-29T20:38:03.252476] [DEBUG] [VALIDATOR ] PL: All expected trading days are present. [2025-09-29T20:38:03.252566] [DEBUG] [VALIDATOR ] PL: Primary data validation passed. [2025-09-29T20:38:03.253866] [INFO ] [MAIN ] PL: Fetched primary data is valid. [2025-09-29T20:38:03.253960] [DEBUG] [LOCAL ] PL: Saving primary data. [2025-09-29T20:38:03.255575] [DEBUG] [LOCAL ] PL: Trimmed 76947 records to 53119 (keeping 200 days of data) [2025-09-29T20:38:03.559102] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-06. [2025-09-29T20:38:03.597155] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-29T20:38:03.611728] [INFO ] [REMOTE ] PLD: Full fetch complete (77381 records). [2025-09-29T20:38:03.612827] [DEBUG] [VALIDATOR ] PLD: Validating primary data. [2025-09-29T20:38:03.816063] [DEBUG] [LOCAL ] PL: Primary data saved (53119 records). [2025-09-29T20:38:03.835510] [INFO ] [MAIN ] PL: Full history saved. [2025-09-29T20:38:03.840801] [INFO ] [MAIN ] Update Progress: 1698/2371 symbols completed. PL took 38.6s. Estimated remaining: 1h 26m 25s. Rate: 7.8 symbols/min [2025-09-29T20:38:04.253373] [INFO ] [MAIN ] PLYM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:38:04.253582] [DEBUG] [VALIDATOR ] PLD: All expected trading days are present. [2025-09-29T20:38:04.254176] [DEBUG] [VALIDATOR ] PLD: Primary data validation passed. [2025-09-29T20:38:04.255377] [INFO ] [MAIN ] PLD: Fetched primary data is valid. [2025-09-29T20:38:04.255465] [DEBUG] [LOCAL ] PLD: Saving primary data. [2025-09-29T20:38:04.258120] [DEBUG] [LOCAL ] PLD: Trimmed 77381 records to 53437 (keeping 200 days of data) [2025-09-29T20:38:04.394607] [DEBUG] [LOCAL ] PLYM: Loaded 33884 existing records from primary storage. [2025-09-29T20:38:04.397783] [INFO ] [MAIN ] PLYM: Loaded 33884 existing records. [2025-09-29T20:38:04.620319] [WARN ] [MAIN ] PLYM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:38:04.624808] [INFO ] [MAIN ] PLYM: Wiping existing primary data before full refresh. [2025-09-29T20:38:04.626358] [INFO ] [LOCAL ] PLYM: Starting deletion of primary data. [2025-09-29T20:38:04.627819] [DEBUG] [LOCAL ] PLYM: Deleted primary data file. [2025-09-29T20:38:04.628001] [INFO ] [MAIN ] PLYM: Starting full primary refresh. [2025-09-29T20:38:04.764053] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-29T20:38:04.916096] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-29T20:38:04.905151] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-04. [2025-09-29T20:38:05.161517] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-07. [2025-09-29T20:38:05.218032] [INFO ] [REMOTE ] PLYM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:38:05.351134] [DEBUG] [LOCAL ] PLD: Primary data saved (53437 records). [2025-09-29T20:38:05.351333] [INFO ] [MAIN ] PLD: Full history saved. [2025-09-29T20:38:05.351467] [INFO ] [MAIN ] Update Progress: 1699/2371 symbols completed. PLD took 29.0s. Estimated remaining: 1h 26m 14s. Rate: 7.8 symbols/min [2025-09-29T20:38:05.538842] [INFO ] [MAIN ] PM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:38:05.606629] [DEBUG] [LOCAL ] PM: Loaded 54445 existing records from primary storage. [2025-09-29T20:38:05.607037] [INFO ] [MAIN ] PM: Loaded 54445 existing records. [2025-09-29T20:38:05.794236] [WARN ] [MAIN ] PM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:38:05.794533] [INFO ] [MAIN ] PM: Wiping existing primary data before full refresh. [2025-09-29T20:38:05.794589] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-09-29T20:38:05.795217] [DEBUG] [LOCAL ] PM: Deleted primary data file. [2025-09-29T20:38:05.795277] [INFO ] [MAIN ] PM: Starting full primary refresh. [2025-09-29T20:38:05.953233] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2024-12. [2025-09-29T20:38:06.184493] [INFO ] [REMOTE ] PM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:38:06.199421] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-29T20:38:06.710494] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-29T20:38:06.748088] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-08. [2025-09-29T20:38:07.507092] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-29T20:38:07.548099] [INFO ] [REMOTE ] PM: Fetching primary data for 2024-12. [2025-09-29T20:38:07.866058] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-29T20:38:08.348138] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-09. [2025-09-29T20:38:09.148089] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-05. [2025-09-29T20:38:09.466681] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-29T20:38:09.470831] [INFO ] [REMOTE ] PLOW: Full fetch complete (28783 records). [2025-09-29T20:38:09.471027] [DEBUG] [VALIDATOR ] PLOW: Validating primary data. [2025-09-29T20:38:09.808590] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-09-29T20:38:09.932736] [DEBUG] [VALIDATOR ] PLOW: All expected trading days are present. [2025-09-29T20:38:09.932822] [DEBUG] [VALIDATOR ] PLOW: Primary data validation passed. [2025-09-29T20:38:09.933469] [INFO ] [MAIN ] PLOW: Fetched primary data is valid. [2025-09-29T20:38:09.933511] [DEBUG] [LOCAL ] PLOW: Saving primary data. [2025-09-29T20:38:09.934316] [DEBUG] [LOCAL ] PLOW: Trimmed 28783 records to 20412 (keeping 200 days of data) [2025-09-29T20:38:09.991405] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-01. [2025-09-29T20:38:10.072147] [DEBUG] [LOCAL ] PLOW: Primary data saved (20412 records). [2025-09-29T20:38:10.072279] [INFO ] [MAIN ] PLOW: Full history saved. [2025-09-29T20:38:10.072359] [INFO ] [MAIN ] Update Progress: 1700/2371 symbols completed. PLOW took 19.8s. Estimated remaining: 1h 26m 6s. Rate: 7.8 symbols/min [2025-09-29T20:38:10.247518] [INFO ] [MAIN ] PML: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:38:10.270217] [DEBUG] [LOCAL ] PML: Loaded 20999 existing records from primary storage. [2025-09-29T20:38:10.270489] [INFO ] [MAIN ] PML: Loaded 20999 existing records. [2025-09-29T20:38:10.453792] [WARN ] [MAIN ] PML: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:38:10.454062] [INFO ] [MAIN ] PML: Wiping existing primary data before full refresh. [2025-09-29T20:38:10.454113] [INFO ] [LOCAL ] PML: Starting deletion of primary data. [2025-09-29T20:38:10.454425] [DEBUG] [LOCAL ] PML: Deleted primary data file. [2025-09-29T20:38:10.454484] [INFO ] [MAIN ] PML: Starting full primary refresh. [2025-09-29T20:38:10.751954] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-01. [2025-09-29T20:38:10.882257] [INFO ] [REMOTE ] PML: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:38:10.919593] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-29T20:38:11.548108] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-06. [2025-09-29T20:38:12.060083] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-29T20:38:12.189134] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-29T20:38:12.348132] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-02. [2025-09-29T20:38:13.148118] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-02. [2025-09-29T20:38:13.189772] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-29T20:38:13.948128] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-07. [2025-09-29T20:38:14.088134] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-29T20:38:14.209783] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-29T20:38:14.748165] [INFO ] [REMOTE ] PML: Fetching primary data for 2024-12. [2025-09-29T20:38:15.544669] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-29T20:38:15.559511] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-03. [2025-09-29T20:38:16.058525] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-29T20:38:16.348173] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-03. [2025-09-29T20:38:17.148113] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-08. [2025-09-29T20:38:17.660505] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-29T20:38:17.662434] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-29T20:38:17.948156] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-04. [2025-09-29T20:38:18.536812] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-29T20:38:18.748119] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-04. [2025-09-29T20:38:19.548163] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-01. [2025-09-29T20:38:19.911532] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-29T20:38:20.208402] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-29T20:38:20.343887] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-29T20:38:20.348099] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-05. [2025-09-29T20:38:21.148172] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-02. [2025-09-29T20:38:21.948130] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-05. [2025-09-29T20:38:22.315480] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-29T20:38:22.572157] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-29T20:38:22.748166] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-06. [2025-09-29T20:38:23.338678] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-29T20:38:23.548149] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-03. [2025-09-29T20:38:24.261009] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-29T20:38:24.348139] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-09. [2025-09-29T20:38:24.738185] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-29T20:38:25.148124] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-07. [2025-09-29T20:38:25.377287] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-29T20:38:25.387115] [INFO ] [REMOTE ] PLNT: Full fetch complete (70255 records). [2025-09-29T20:38:25.387287] [DEBUG] [VALIDATOR ] PLNT: Validating primary data. [2025-09-29T20:38:25.797904] [DEBUG] [VALIDATOR ] PLNT: All expected trading days are present. [2025-09-29T20:38:25.798028] [DEBUG] [VALIDATOR ] PLNT: Primary data validation passed. [2025-09-29T20:38:25.799272] [INFO ] [MAIN ] PLNT: Fetched primary data is valid. [2025-09-29T20:38:25.799360] [DEBUG] [LOCAL ] PLNT: Saving primary data. [2025-09-29T20:38:25.801440] [DEBUG] [LOCAL ] PLNT: Trimmed 70255 records to 48343 (keeping 200 days of data) [2025-09-29T20:38:25.986777] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-04. [2025-09-29T20:38:26.122148] [DEBUG] [LOCAL ] PLNT: Primary data saved (48343 records). [2025-09-29T20:38:26.122331] [INFO ] [MAIN ] PLNT: Full history saved. [2025-09-29T20:38:26.122440] [INFO ] [MAIN ] Update Progress: 1701/2371 symbols completed. PLNT took 45.9s. Estimated remaining: 1h 26m 1s. Rate: 7.8 symbols/min [2025-09-29T20:38:26.301212] [INFO ] [MAIN ] PMM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:38:26.314489] [DEBUG] [LOCAL ] PMM: Loaded 10760 existing records from primary storage. [2025-09-29T20:38:26.314770] [INFO ] [MAIN ] PMM: Loaded 10760 existing records. [2025-09-29T20:38:26.509388] [WARN ] [MAIN ] PMM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:38:26.509740] [INFO ] [MAIN ] PMM: Wiping existing primary data before full refresh. [2025-09-29T20:38:26.509801] [INFO ] [LOCAL ] PMM: Starting deletion of primary data. [2025-09-29T20:38:26.510023] [DEBUG] [LOCAL ] PMM: Deleted primary data file. [2025-09-29T20:38:26.510096] [INFO ] [MAIN ] PMM: Starting full primary refresh. [2025-09-29T20:38:26.754379] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-06. [2025-09-29T20:38:26.909377] [INFO ] [REMOTE ] PMM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:38:27.241905] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-29T20:38:27.548126] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-05. [2025-09-29T20:38:27.616972] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-09-29T20:38:28.136114] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-29T20:38:28.348107] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-08. [2025-09-29T20:38:28.620908] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-29T20:38:29.148124] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-07. [2025-09-29T20:38:29.948167] [INFO ] [REMOTE ] PMM: Fetching primary data for 2024-12. [2025-09-29T20:38:30.053249] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-29T20:38:30.516844] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-29T20:38:30.748173] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-08. [2025-09-29T20:38:31.308255] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-29T20:38:31.548112] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-01. [2025-09-29T20:38:32.326321] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-29T20:38:32.348085] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-02. [2025-09-29T20:38:32.464140] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-29T20:38:33.148115] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-09. [2025-09-29T20:38:33.485202] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-29T20:38:33.948128] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-06. [2025-09-29T20:38:34.168095] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-29T20:38:34.178542] [INFO ] [REMOTE ] PM: Full fetch complete (77312 records). [2025-09-29T20:38:34.178719] [DEBUG] [VALIDATOR ] PM: Validating primary data. [2025-09-29T20:38:34.179696] [FATAL] [VALIDATOR ] PM: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T20:38:34.179788] [FATAL] [MAIN ] PM: Fetched primary data is invalid. Refusing to save it. [2025-09-29T20:38:34.179855] [WARN ] [MAIN ] PM: Deleting existing primary and derivative data due to validation failure. [2025-09-29T20:38:34.179924] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-09-29T20:38:34.179992] [DEBUG] [LOCAL ] PM: No primary data file found to delete. [2025-09-29T20:38:34.180043] [INFO ] [LOCAL ] PM: Starting deletion of derivative data. [2025-09-29T20:38:34.180704] [DEBUG] [LOCAL ] PM: Deleted derivative data file. [2025-09-29T20:38:34.180837] [INFO ] [MAIN ] Update Progress: 1702/2371 symbols completed. PM took 28.8s. Estimated remaining: 1h 25m 54s. Rate: 7.8 symbols/min [2025-09-29T20:38:34.360267] [INFO ] [MAIN ] PMO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:38:34.372535] [DEBUG] [LOCAL ] PMO: Loaded 10547 existing records from primary storage. [2025-09-29T20:38:34.372813] [INFO ] [MAIN ] PMO: Loaded 10547 existing records. [2025-09-29T20:38:34.563231] [WARN ] [MAIN ] PMO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:38:34.563456] [INFO ] [MAIN ] PMO: Wiping existing primary data before full refresh. [2025-09-29T20:38:34.563509] [INFO ] [LOCAL ] PMO: Starting deletion of primary data. [2025-09-29T20:38:34.563740] [DEBUG] [LOCAL ] PMO: Deleted primary data file. [2025-09-29T20:38:34.563802] [INFO ] [MAIN ] PMO: Starting full primary refresh. [2025-09-29T20:38:34.757837] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-09. [2025-09-29T20:38:34.956464] [INFO ] [REMOTE ] PMO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:38:34.968792] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-29T20:38:35.548110] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-07. [2025-09-29T20:38:36.335192] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-29T20:38:36.344019] [INFO ] [REMOTE ] PLYM: Full fetch complete (46864 records). [2025-09-29T20:38:36.344185] [DEBUG] [VALIDATOR ] PLYM: Validating primary data. [2025-09-29T20:38:36.356482] [INFO ] [REMOTE ] PMO: Fetching primary data for 2024-12. [2025-09-29T20:38:36.791987] [DEBUG] [VALIDATOR ] PLYM: All expected trading days are present. [2025-09-29T20:38:36.799558] [DEBUG] [VALIDATOR ] PLYM: Primary data validation passed. [2025-09-29T20:38:36.800879] [INFO ] [MAIN ] PLYM: Fetched primary data is valid. [2025-09-29T20:38:36.800967] [DEBUG] [LOCAL ] PLYM: Saving primary data. [2025-09-29T20:38:36.802445] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-29T20:38:36.808544] [DEBUG] [LOCAL ] PLYM: Trimmed 46864 records to 33468 (keeping 200 days of data) [2025-09-29T20:38:37.029288] [DEBUG] [LOCAL ] PLYM: Primary data saved (33468 records). [2025-09-29T20:38:37.029510] [INFO ] [MAIN ] PLYM: Full history saved. [2025-09-29T20:38:37.029676] [INFO ] [MAIN ] Update Progress: 1703/2371 symbols completed. PLYM took 33.2s. Estimated remaining: 1h 25m 44s. Rate: 7.8 symbols/min [2025-09-29T20:38:37.149212] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-03. [2025-09-29T20:38:37.227282] [INFO ] [MAIN ] PMT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:38:37.280665] [DEBUG] [LOCAL ] PMT: Loaded 40798 existing records from primary storage. [2025-09-29T20:38:37.280972] [INFO ] [MAIN ] PMT: Loaded 40798 existing records. [2025-09-29T20:38:37.462917] [WARN ] [MAIN ] PMT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:38:37.463124] [INFO ] [MAIN ] PMT: Wiping existing primary data before full refresh. [2025-09-29T20:38:37.463170] [INFO ] [LOCAL ] PMT: Starting deletion of primary data. [2025-09-29T20:38:37.463509] [DEBUG] [LOCAL ] PMT: Deleted primary data file. [2025-09-29T20:38:37.463579] [INFO ] [MAIN ] PMT: Starting full primary refresh. [2025-09-29T20:38:37.630140] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-29T20:38:37.889329] [INFO ] [REMOTE ] PMT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:38:37.948095] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-01. [2025-09-29T20:38:38.256078] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-29T20:38:38.748086] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-04. [2025-09-29T20:38:38.775202] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-29T20:38:39.447749] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-29T20:38:39.548122] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-08. [2025-09-29T20:38:40.348094] [INFO ] [REMOTE ] PMT: Fetching primary data for 2024-12. [2025-09-29T20:38:40.742046] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-29T20:38:41.148126] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-05. [2025-09-29T20:38:41.777529] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-29T20:38:41.939158] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-29T20:38:41.948137] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-01. [2025-09-29T20:38:42.748128] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-09. [2025-09-29T20:38:43.471875] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-29T20:38:43.548114] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-06. [2025-09-29T20:38:44.043215] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-29T20:38:44.049415] [INFO ] [REMOTE ] PML: Full fetch complete (29902 records). [2025-09-29T20:38:44.049567] [DEBUG] [VALIDATOR ] PML: Validating primary data. [2025-09-29T20:38:44.350682] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-02. [2025-09-29T20:38:44.456697] [DEBUG] [VALIDATOR ] PML: All expected trading days are present. [2025-09-29T20:38:44.456571] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-29T20:38:44.460216] [DEBUG] [VALIDATOR ] PML: Primary data validation passed. [2025-09-29T20:38:44.461206] [INFO ] [MAIN ] PML: Fetched primary data is valid. [2025-09-29T20:38:44.461275] [DEBUG] [LOCAL ] PML: Saving primary data. [2025-09-29T20:38:44.462163] [DEBUG] [LOCAL ] PML: Trimmed 29902 records to 20988 (keeping 200 days of data) [2025-09-29T20:38:44.599465] [DEBUG] [LOCAL ] PML: Primary data saved (20988 records). [2025-09-29T20:38:44.599601] [INFO ] [MAIN ] PML: Full history saved. [2025-09-29T20:38:44.599722] [INFO ] [MAIN ] Update Progress: 1704/2371 symbols completed. PML took 34.5s. Estimated remaining: 1h 25m 36s. Rate: 7.8 symbols/min [2025-09-29T20:38:44.816208] [INFO ] [MAIN ] PMTU: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:38:44.816357] [DEBUG] [LOCAL ] PMTU: No existing data file found in primary storage. [2025-09-29T20:38:44.816417] [WARN ] [MAIN ] PMTU: No existing data found, performing full refresh instead. [2025-09-29T20:38:44.816518] [INFO ] [MAIN ] PMTU: Wiping existing primary data before full refresh. [2025-09-29T20:38:44.816557] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-09-29T20:38:44.816601] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-09-29T20:38:44.816638] [INFO ] [MAIN ] PMTU: Starting full primary refresh. [2025-09-29T20:38:45.155083] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-02. [2025-09-29T20:38:45.199877] [INFO ] [REMOTE ] PMTU: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:38:45.779293] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-29T20:38:45.920772] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-29T20:38:45.948080] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-03. [2025-09-29T20:38:46.748106] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-07. [2025-09-29T20:38:46.875080] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-29T20:38:47.548110] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-03. [2025-09-29T20:38:47.562777] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-29T20:38:48.348144] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-04. [2025-09-29T20:38:49.119846] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-29T20:38:49.148072] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-04. [2025-09-29T20:38:49.169605] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-29T20:38:49.948114] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-05. [2025-09-29T20:38:50.577098] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-29T20:38:50.748105] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2024-12. [2025-09-29T20:38:50.989672] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2024-12 (0.24 seconds). [2025-09-29T20:38:50.991402] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-29T20:38:51.548112] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-08. [2025-09-29T20:38:52.348136] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-05. [2025-09-29T20:38:52.374943] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-29T20:38:53.148137] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-06. [2025-09-29T20:38:53.642366] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-29T20:38:53.669159] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-29T20:38:53.948114] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-09. [2025-09-29T20:38:54.510249] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-29T20:38:54.513196] [INFO ] [REMOTE ] PMM: Full fetch complete (18311 records). [2025-09-29T20:38:54.513302] [DEBUG] [VALIDATOR ] PMM: Validating primary data. [2025-09-29T20:38:54.753225] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-01. [2025-09-29T20:38:54.904031] [DEBUG] [VALIDATOR ] PMM: All expected trading days are present. [2025-09-29T20:38:54.904112] [DEBUG] [VALIDATOR ] PMM: Primary data validation passed. [2025-09-29T20:38:54.904551] [INFO ] [MAIN ] PMM: Fetched primary data is valid. [2025-09-29T20:38:54.904629] [DEBUG] [LOCAL ] PMM: Saving primary data. [2025-09-29T20:38:54.905229] [DEBUG] [LOCAL ] PMM: Trimmed 18311 records to 10617 (keeping 200 days of data) [2025-09-29T20:38:54.970908] [DEBUG] [LOCAL ] PMM: Primary data saved (10617 records). [2025-09-29T20:38:54.971053] [INFO ] [MAIN ] PMM: Full history saved. [2025-09-29T20:38:54.971137] [INFO ] [MAIN ] Update Progress: 1705/2371 symbols completed. PMM took 28.8s. Estimated remaining: 1h 25m 30s. Rate: 7.8 symbols/min [2025-09-29T20:38:55.147154] [INFO ] [MAIN ] PMTV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:38:55.147388] [DEBUG] [LOCAL ] PMTV: No existing data file found in primary storage. [2025-09-29T20:38:55.147472] [WARN ] [MAIN ] PMTV: No existing data found, performing full refresh instead. [2025-09-29T20:38:55.147604] [INFO ] [MAIN ] PMTV: Wiping existing primary data before full refresh. [2025-09-29T20:38:55.147727] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-09-29T20:38:55.147802] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-09-29T20:38:55.147890] [INFO ] [MAIN ] PMTV: Starting full primary refresh. [2025-09-29T20:38:55.256471] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-29T20:38:55.534737] [INFO ] [REMOTE ] PMTV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:38:55.548101] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2024-12. [2025-09-29T20:38:55.824983] [DEBUG] [REMOTE ] PMTV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T20:38:55.825312] [WARN ] [REMOTE ] PMTV: No data returned for month 2024-12 [2025-09-29T20:38:55.825405] [FATAL] [REMOTE ] PMTV: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T20:38:55.825509] [FATAL] [MAIN ] PMTV: Failed to fetch primary data. [2025-09-29T20:38:55.825575] [WARN ] [MAIN ] PMTV: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T20:38:55.825669] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-09-29T20:38:55.825758] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-09-29T20:38:55.825800] [INFO ] [LOCAL ] PMTV: Starting deletion of derivative data. [2025-09-29T20:38:55.825843] [DEBUG] [LOCAL ] PMTV: No derivative data file found to delete. [2025-09-29T20:38:55.825891] [INFO ] [MAIN ] Update Progress: 1706/2371 symbols completed. PMTV took 0.9s. Estimated remaining: 1h 25m 19s. Rate: 7.8 symbols/min [2025-09-29T20:38:56.028150] [INFO ] [MAIN ] PMTW: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:38:56.028347] [DEBUG] [LOCAL ] PMTW: No existing data file found in primary storage. [2025-09-29T20:38:56.028412] [WARN ] [MAIN ] PMTW: No existing data found, performing full refresh instead. [2025-09-29T20:38:56.028564] [INFO ] [MAIN ] PMTW: Wiping existing primary data before full refresh. [2025-09-29T20:38:56.028607] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-09-29T20:38:56.028689] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-09-29T20:38:56.028766] [INFO ] [MAIN ] PMTW: Starting full primary refresh. [2025-09-29T20:38:56.353265] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-02. [2025-09-29T20:38:56.409262] [INFO ] [REMOTE ] PMTW: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:38:56.764320] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-29T20:38:57.148103] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2024-12. [2025-09-29T20:38:57.405157] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T20:38:57.405474] [WARN ] [REMOTE ] PMTW: No data returned for month 2024-12 [2025-09-29T20:38:57.405572] [FATAL] [REMOTE ] PMTW: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T20:38:57.405667] [FATAL] [MAIN ] PMTW: Failed to fetch primary data. [2025-09-29T20:38:57.405745] [WARN ] [MAIN ] PMTW: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T20:38:57.405816] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-09-29T20:38:57.405891] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-09-29T20:38:57.405932] [INFO ] [LOCAL ] PMTW: Starting deletion of derivative data. [2025-09-29T20:38:57.405975] [DEBUG] [LOCAL ] PMTW: No derivative data file found to delete. [2025-09-29T20:38:57.406023] [INFO ] [MAIN ] Update Progress: 1707/2371 symbols completed. PMTW took 1.6s. Estimated remaining: 1h 25m 9s. Rate: 7.8 symbols/min [2025-09-29T20:38:57.589474] [INFO ] [MAIN ] PNC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:38:57.662869] [DEBUG] [LOCAL ] PNC: Loaded 53000 existing records from primary storage. [2025-09-29T20:38:57.663242] [INFO ] [MAIN ] PNC: Loaded 53000 existing records. [2025-09-29T20:38:57.851281] [WARN ] [MAIN ] PNC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:38:57.851531] [INFO ] [MAIN ] PNC: Wiping existing primary data before full refresh. [2025-09-29T20:38:57.851584] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-09-29T20:38:57.852098] [DEBUG] [LOCAL ] PNC: Deleted primary data file. [2025-09-29T20:38:57.852159] [INFO ] [MAIN ] PNC: Starting full primary refresh. [2025-09-29T20:38:57.953191] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-07. [2025-09-29T20:38:58.226198] [INFO ] [REMOTE ] PNC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:38:58.748096] [INFO ] [REMOTE ] PNC: Fetching primary data for 2024-12. [2025-09-29T20:38:58.768305] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-29T20:38:59.548190] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-06. [2025-09-29T20:39:00.348083] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-08. [2025-09-29T20:39:00.409423] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-29T20:39:00.948591] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-29T20:39:01.139231] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-29T20:39:01.148063] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-07. [2025-09-29T20:39:01.948171] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-03. [2025-09-29T20:39:02.346097] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-29T20:39:02.748157] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-04. [2025-09-29T20:39:02.905236] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-29T20:39:03.079796] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-29T20:39:03.548156] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-09. [2025-09-29T20:39:04.348083] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-05. [2025-09-29T20:39:04.414310] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-29T20:39:04.416777] [INFO ] [REMOTE ] PMO: Full fetch complete (17390 records). [2025-09-29T20:39:04.416890] [DEBUG] [VALIDATOR ] PMO: Validating primary data. [2025-09-29T20:39:04.692390] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-29T20:39:04.815135] [DEBUG] [VALIDATOR ] PMO: All expected trading days are present. [2025-09-29T20:39:04.815229] [DEBUG] [VALIDATOR ] PMO: Primary data validation passed. [2025-09-29T20:39:04.815673] [INFO ] [MAIN ] PMO: Fetched primary data is valid. [2025-09-29T20:39:04.815738] [DEBUG] [LOCAL ] PMO: Saving primary data. [2025-09-29T20:39:04.816298] [DEBUG] [LOCAL ] PMO: Trimmed 17390 records to 10477 (keeping 200 days of data) [2025-09-29T20:39:04.881872] [DEBUG] [LOCAL ] PMO: Primary data saved (10477 records). [2025-09-29T20:39:04.882016] [INFO ] [MAIN ] PMO: Full history saved. [2025-09-29T20:39:04.882103] [INFO ] [MAIN ] Update Progress: 1708/2371 symbols completed. PMO took 30.7s. Estimated remaining: 1h 25m 1s. Rate: 7.8 symbols/min [2025-09-29T20:39:05.060733] [INFO ] [MAIN ] PNI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:39:05.070374] [DEBUG] [LOCAL ] PNI: Loaded 6782 existing records from primary storage. [2025-09-29T20:39:05.070583] [INFO ] [MAIN ] PNI: Loaded 6782 existing records. [2025-09-29T20:39:05.153301] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-08. [2025-09-29T20:39:05.271503] [WARN ] [MAIN ] PNI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:39:05.271766] [INFO ] [MAIN ] PNI: Wiping existing primary data before full refresh. [2025-09-29T20:39:05.271819] [INFO ] [LOCAL ] PNI: Starting deletion of primary data. [2025-09-29T20:39:05.272061] [DEBUG] [LOCAL ] PNI: Deleted primary data file. [2025-09-29T20:39:05.272120] [INFO ] [MAIN ] PNI: Starting full primary refresh. [2025-09-29T20:39:05.650073] [INFO ] [REMOTE ] PNI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:39:05.948137] [INFO ] [REMOTE ] PNI: Fetching primary data for 2024-12. [2025-09-29T20:39:06.753192] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-01. [2025-09-29T20:39:06.764589] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-29T20:39:07.001532] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-29T20:39:07.548125] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-09. [2025-09-29T20:39:08.348161] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-01. [2025-09-29T20:39:08.726496] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-29T20:39:08.735398] [INFO ] [REMOTE ] PMT: Full fetch complete (58177 records). [2025-09-29T20:39:08.735599] [DEBUG] [VALIDATOR ] PMT: Validating primary data. [2025-09-29T20:39:09.018522] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-09-29T20:39:09.060765] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-29T20:39:09.152557] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-02. [2025-09-29T20:39:09.260129] [DEBUG] [VALIDATOR ] PMT: All expected trading days are present. [2025-09-29T20:39:09.260226] [DEBUG] [VALIDATOR ] PMT: Primary data validation passed. [2025-09-29T20:39:09.261175] [INFO ] [MAIN ] PMT: Fetched primary data is valid. [2025-09-29T20:39:09.261243] [DEBUG] [LOCAL ] PMT: Saving primary data. [2025-09-29T20:39:09.262568] [DEBUG] [LOCAL ] PMT: Trimmed 58177 records to 40058 (keeping 200 days of data) [2025-09-29T20:39:09.559822] [DEBUG] [LOCAL ] PMT: Primary data saved (40058 records). [2025-09-29T20:39:09.559949] [INFO ] [MAIN ] PMT: Full history saved. [2025-09-29T20:39:09.560028] [INFO ] [MAIN ] Update Progress: 1709/2371 symbols completed. PMT took 32.5s. Estimated remaining: 1h 24m 52s. Rate: 7.8 symbols/min [2025-09-29T20:39:09.748598] [INFO ] [MAIN ] PNNT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:39:09.784490] [DEBUG] [LOCAL ] PNNT: Loaded 33337 existing records from primary storage. [2025-09-29T20:39:09.784812] [INFO ] [MAIN ] PNNT: Loaded 33337 existing records. [2025-09-29T20:39:09.974149] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-06. [2025-09-29T20:39:09.982447] [WARN ] [MAIN ] PNNT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:39:09.983357] [INFO ] [MAIN ] PNNT: Wiping existing primary data before full refresh. [2025-09-29T20:39:09.983412] [INFO ] [LOCAL ] PNNT: Starting deletion of primary data. [2025-09-29T20:39:09.983818] [DEBUG] [LOCAL ] PNNT: Deleted primary data file. [2025-09-29T20:39:09.983879] [INFO ] [MAIN ] PNNT: Starting full primary refresh. [2025-09-29T20:39:10.367729] [INFO ] [REMOTE ] PNNT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:39:10.403389] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-29T20:39:10.713290] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-29T20:39:10.748128] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2024-12. [2025-09-29T20:39:11.548152] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-07. [2025-09-29T20:39:12.047250] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-29T20:39:12.348106] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-08. [2025-09-29T20:39:12.562093] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-29T20:39:12.641889] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-09-29T20:39:13.148122] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-09. [2025-09-29T20:39:13.364205] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-09 (0.22 seconds). [2025-09-29T20:39:13.365093] [INFO ] [REMOTE ] PMTU: Full fetch complete (1233 records). [2025-09-29T20:39:13.365168] [DEBUG] [VALIDATOR ] PMTU: Validating primary data. [2025-09-29T20:39:13.365578] [FATAL] [VALIDATOR ] PMTU: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T20:39:13.365730] [FATAL] [MAIN ] PMTU: Fetched primary data is invalid. Refusing to save it. [2025-09-29T20:39:13.365795] [WARN ] [MAIN ] PMTU: Deleting existing primary and derivative data due to validation failure. [2025-09-29T20:39:13.365865] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-09-29T20:39:13.365960] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-09-29T20:39:13.366020] [INFO ] [LOCAL ] PMTU: Starting deletion of derivative data. [2025-09-29T20:39:13.366086] [DEBUG] [LOCAL ] PMTU: No derivative data file found to delete. [2025-09-29T20:39:13.366166] [INFO ] [MAIN ] Update Progress: 1710/2371 symbols completed. PMTU took 28.8s. Estimated remaining: 1h 24m 43s. Rate: 7.8 symbols/min [2025-09-29T20:39:13.552324] [INFO ] [MAIN ] PNR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:39:13.614924] [DEBUG] [LOCAL ] PNR: Loaded 48589 existing records from primary storage. [2025-09-29T20:39:13.615469] [INFO ] [MAIN ] PNR: Loaded 48589 existing records. [2025-09-29T20:39:13.813602] [WARN ] [MAIN ] PNR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:39:13.813933] [INFO ] [MAIN ] PNR: Wiping existing primary data before full refresh. [2025-09-29T20:39:13.813994] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-09-29T20:39:13.814465] [DEBUG] [LOCAL ] PNR: Deleted primary data file. [2025-09-29T20:39:13.814556] [INFO ] [MAIN ] PNR: Starting full primary refresh. [2025-09-29T20:39:13.961527] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-03. [2025-09-29T20:39:14.198841] [INFO ] [REMOTE ] PNR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:39:14.748167] [INFO ] [REMOTE ] PNR: Fetching primary data for 2024-12. [2025-09-29T20:39:15.548113] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-02. [2025-09-29T20:39:16.103908] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-29T20:39:16.334021] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-29T20:39:16.348136] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-03. [2025-09-29T20:39:16.874062] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-29T20:39:17.070340] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-29T20:39:17.148111] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-04. [2025-09-29T20:39:17.948083] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-01. [2025-09-29T20:39:18.025783] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-29T20:39:18.748153] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-05. [2025-09-29T20:39:19.305086] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-29T20:39:19.548150] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-02. [2025-09-29T20:39:19.558884] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-29T20:39:20.348121] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-04. [2025-09-29T20:39:20.791284] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-29T20:39:21.148108] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-03. [2025-09-29T20:39:21.948091] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-01. [2025-09-29T20:39:22.312428] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-29T20:39:22.401340] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-29T20:39:22.748152] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-04. [2025-09-29T20:39:23.359124] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-29T20:39:23.548116] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-02. [2025-09-29T20:39:24.348119] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-05. [2025-09-29T20:39:24.464276] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-29T20:39:25.148147] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-05. [2025-09-29T20:39:25.258133] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-29T20:39:25.948193] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-03. [2025-09-29T20:39:26.340678] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-29T20:39:26.432488] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-29T20:39:26.748144] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-06. [2025-09-29T20:39:27.549857] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-06. [2025-09-29T20:39:27.564182] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-29T20:39:28.348185] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-04. [2025-09-29T20:39:28.634332] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-29T20:39:29.068320] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-29T20:39:29.148171] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-06. [2025-09-29T20:39:29.608866] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-29T20:39:29.953269] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-07. [2025-09-29T20:39:29.966704] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-29T20:39:30.465427] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-29T20:39:30.748109] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-08. [2025-09-29T20:39:31.548085] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-07. [2025-09-29T20:39:31.622097] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-29T20:39:32.348112] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-07. [2025-09-29T20:39:32.743076] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-29T20:39:33.148118] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-09. [2025-09-29T20:39:33.672334] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-29T20:39:33.674769] [INFO ] [REMOTE ] PNI: Full fetch complete (9919 records). [2025-09-29T20:39:33.674852] [DEBUG] [VALIDATOR ] PNI: Validating primary data. [2025-09-29T20:39:33.955595] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-08. [2025-09-29T20:39:34.076891] [DEBUG] [VALIDATOR ] PNI: All expected trading days are present. [2025-09-29T20:39:34.077155] [DEBUG] [VALIDATOR ] PNI: Primary data validation passed. [2025-09-29T20:39:34.077471] [INFO ] [MAIN ] PNI: Fetched primary data is valid. [2025-09-29T20:39:34.077516] [DEBUG] [LOCAL ] PNI: Saving primary data. [2025-09-29T20:39:34.078020] [DEBUG] [LOCAL ] PNI: Trimmed 9919 records to 6771 (keeping 200 days of data) [2025-09-29T20:39:34.121935] [DEBUG] [LOCAL ] PNI: Primary data saved (6771 records). [2025-09-29T20:39:34.122085] [INFO ] [MAIN ] PNI: Full history saved. [2025-09-29T20:39:34.122190] [INFO ] [MAIN ] Update Progress: 1711/2371 symbols completed. PNI took 29.2s. Estimated remaining: 1h 24m 41s. Rate: 7.8 symbols/min [2025-09-29T20:39:34.304008] [INFO ] [MAIN ] PNW: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:39:34.340397] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-29T20:39:34.401000] [DEBUG] [LOCAL ] PNW: Loaded 46531 existing records from primary storage. [2025-09-29T20:39:34.401401] [INFO ] [MAIN ] PNW: Loaded 46531 existing records. [2025-09-29T20:39:34.591956] [WARN ] [MAIN ] PNW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:39:34.592266] [INFO ] [MAIN ] PNW: Wiping existing primary data before full refresh. [2025-09-29T20:39:34.592317] [INFO ] [LOCAL ] PNW: Starting deletion of primary data. [2025-09-29T20:39:34.593110] [DEBUG] [LOCAL ] PNW: Deleted primary data file. [2025-09-29T20:39:34.593175] [INFO ] [MAIN ] PNW: Starting full primary refresh. [2025-09-29T20:39:34.755525] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-05. [2025-09-29T20:39:35.014965] [INFO ] [REMOTE ] PNW: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:39:35.080719] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-29T20:39:35.548114] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-08. [2025-09-29T20:39:36.348081] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-09. [2025-09-29T20:39:36.534476] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-29T20:39:37.120987] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-29T20:39:37.148073] [INFO ] [REMOTE ] PNW: Fetching primary data for 2024-12. [2025-09-29T20:39:37.433526] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-29T20:39:37.441206] [INFO ] [REMOTE ] PNNT: Full fetch complete (47263 records). [2025-09-29T20:39:37.441370] [DEBUG] [VALIDATOR ] PNNT: Validating primary data. [2025-09-29T20:39:37.840888] [DEBUG] [VALIDATOR ] PNNT: All expected trading days are present. [2025-09-29T20:39:37.840969] [DEBUG] [VALIDATOR ] PNNT: Primary data validation passed. [2025-09-29T20:39:37.841927] [INFO ] [MAIN ] PNNT: Fetched primary data is valid. [2025-09-29T20:39:37.841991] [DEBUG] [LOCAL ] PNNT: Saving primary data. [2025-09-29T20:39:37.843017] [DEBUG] [LOCAL ] PNNT: Trimmed 47263 records to 32747 (keeping 200 days of data) [2025-09-29T20:39:37.948352] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-09. [2025-09-29T20:39:38.042092] [DEBUG] [LOCAL ] PNNT: Primary data saved (32747 records). [2025-09-29T20:39:38.042232] [INFO ] [MAIN ] PNNT: Full history saved. [2025-09-29T20:39:38.042324] [INFO ] [MAIN ] Update Progress: 1712/2371 symbols completed. PNNT took 28.5s. Estimated remaining: 1h 24m 31s. Rate: 7.8 symbols/min [2025-09-29T20:39:38.251894] [INFO ] [MAIN ] POR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:39:38.313086] [DEBUG] [LOCAL ] POR: Loaded 47706 existing records from primary storage. [2025-09-29T20:39:38.313545] [INFO ] [MAIN ] POR: Loaded 47706 existing records. [2025-09-29T20:39:38.505679] [WARN ] [MAIN ] POR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:39:38.505935] [INFO ] [MAIN ] POR: Wiping existing primary data before full refresh. [2025-09-29T20:39:38.506008] [INFO ] [LOCAL ] POR: Starting deletion of primary data. [2025-09-29T20:39:38.506716] [DEBUG] [LOCAL ] POR: Deleted primary data file. [2025-09-29T20:39:38.506778] [INFO ] [MAIN ] POR: Starting full primary refresh. [2025-09-29T20:39:38.752030] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-06. [2025-09-29T20:39:38.944011] [INFO ] [REMOTE ] POR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:39:38.985033] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-29T20:39:39.031042] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-29T20:39:39.041948] [INFO ] [REMOTE ] PNC: Full fetch complete (75122 records). [2025-09-29T20:39:39.042194] [DEBUG] [VALIDATOR ] PNC: Validating primary data. [2025-09-29T20:39:39.043125] [FATAL] [VALIDATOR ] PNC: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T20:39:39.043217] [FATAL] [MAIN ] PNC: Fetched primary data is invalid. Refusing to save it. [2025-09-29T20:39:39.043265] [WARN ] [MAIN ] PNC: Deleting existing primary and derivative data due to validation failure. [2025-09-29T20:39:39.043384] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-09-29T20:39:39.043472] [DEBUG] [LOCAL ] PNC: No primary data file found to delete. [2025-09-29T20:39:39.043510] [INFO ] [LOCAL ] PNC: Starting deletion of derivative data. [2025-09-29T20:39:39.044116] [DEBUG] [LOCAL ] PNC: Deleted derivative data file. [2025-09-29T20:39:39.047056] [INFO ] [MAIN ] Update Progress: 1713/2371 symbols completed. PNC took 41.6s. Estimated remaining: 1h 24m 21s. Rate: 7.8 symbols/min [2025-09-29T20:39:39.224211] [INFO ] [MAIN ] POST: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:39:39.273119] [DEBUG] [LOCAL ] POST: Loaded 39494 existing records from primary storage. [2025-09-29T20:39:39.273460] [INFO ] [MAIN ] POST: Loaded 39494 existing records. [2025-09-29T20:39:39.467838] [WARN ] [MAIN ] POST: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:39:39.468066] [INFO ] [MAIN ] POST: Wiping existing primary data before full refresh. [2025-09-29T20:39:39.468114] [INFO ] [LOCAL ] POST: Starting deletion of primary data. [2025-09-29T20:39:39.468910] [DEBUG] [LOCAL ] POST: Deleted primary data file. [2025-09-29T20:39:39.468974] [INFO ] [MAIN ] POST: Starting full primary refresh. [2025-09-29T20:39:39.553281] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-01. [2025-09-29T20:39:39.847355] [INFO ] [REMOTE ] POST: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:39:40.197266] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-29T20:39:40.348104] [INFO ] [REMOTE ] POST: Fetching primary data for 2024-12. [2025-09-29T20:39:41.148100] [INFO ] [REMOTE ] POR: Fetching primary data for 2024-12. [2025-09-29T20:39:41.281341] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-29T20:39:41.703817] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-29T20:39:41.948117] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-07. [2025-09-29T20:39:42.748097] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-02. [2025-09-29T20:39:42.954236] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-29T20:39:43.548081] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-01. [2025-09-29T20:39:43.924596] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-29T20:39:44.161565] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-29T20:39:44.348123] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-01. [2025-09-29T20:39:44.997994] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-29T20:39:45.148143] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-03. [2025-09-29T20:39:45.773299] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-29T20:39:45.948119] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-02. [2025-09-29T20:39:46.748139] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-08. [2025-09-29T20:39:47.060399] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-29T20:39:47.182732] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-29T20:39:47.548117] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-03. [2025-09-29T20:39:48.348108] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-02. [2025-09-29T20:39:48.583750] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-29T20:39:48.794493] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-29T20:39:49.148124] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-04. [2025-09-29T20:39:49.948116] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-04. [2025-09-29T20:39:50.034243] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-29T20:39:50.748120] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-03. [2025-09-29T20:39:50.872953] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-29T20:39:51.548098] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-05. [2025-09-29T20:39:51.973865] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-29T20:39:52.348115] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-09. [2025-09-29T20:39:52.557028] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-29T20:39:53.133825] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-29T20:39:53.148069] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-04. [2025-09-29T20:39:53.230945] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-29T20:39:53.241814] [INFO ] [REMOTE ] PNR: Full fetch complete (68876 records). [2025-09-29T20:39:53.241967] [DEBUG] [VALIDATOR ] PNR: Validating primary data. [2025-09-29T20:39:53.242892] [FATAL] [VALIDATOR ] PNR: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T20:39:53.242986] [FATAL] [MAIN ] PNR: Fetched primary data is invalid. Refusing to save it. [2025-09-29T20:39:53.243033] [WARN ] [MAIN ] PNR: Deleting existing primary and derivative data due to validation failure. [2025-09-29T20:39:53.243073] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-09-29T20:39:53.243163] [DEBUG] [LOCAL ] PNR: No primary data file found to delete. [2025-09-29T20:39:53.243223] [INFO ] [LOCAL ] PNR: Starting deletion of derivative data. [2025-09-29T20:39:53.243632] [DEBUG] [LOCAL ] PNR: Deleted derivative data file. [2025-09-29T20:39:53.243781] [INFO ] [MAIN ] Update Progress: 1714/2371 symbols completed. PNR took 39.9s. Estimated remaining: 1h 24m 16s. Rate: 7.8 symbols/min [2025-09-29T20:39:53.422283] [INFO ] [MAIN ] PPG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:39:53.495210] [DEBUG] [LOCAL ] PPG: Loaded 51455 existing records from primary storage. [2025-09-29T20:39:53.495569] [INFO ] [MAIN ] PPG: Loaded 51455 existing records. [2025-09-29T20:39:53.701935] [WARN ] [MAIN ] PPG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:39:53.702176] [INFO ] [MAIN ] PPG: Wiping existing primary data before full refresh. [2025-09-29T20:39:53.702226] [INFO ] [LOCAL ] PPG: Starting deletion of primary data. [2025-09-29T20:39:53.703123] [DEBUG] [LOCAL ] PPG: Deleted primary data file. [2025-09-29T20:39:53.703186] [INFO ] [MAIN ] PPG: Starting full primary refresh. [2025-09-29T20:39:53.953256] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-06. [2025-09-29T20:39:54.073597] [INFO ] [REMOTE ] PPG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:39:54.748130] [INFO ] [REMOTE ] PPG: Fetching primary data for 2024-12. [2025-09-29T20:39:54.886010] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-29T20:39:55.293383] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-29T20:39:55.548131] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-07. [2025-09-29T20:39:56.348089] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-05. [2025-09-29T20:39:56.539503] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-29T20:39:57.156211] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-01. [2025-09-29T20:39:57.174254] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-29T20:39:57.948127] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-05. [2025-09-29T20:39:58.001336] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-29T20:39:58.748119] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-08. [2025-09-29T20:39:58.880423] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-29T20:39:59.377695] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-29T20:39:59.548114] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-06. [2025-09-29T20:40:00.353308] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-02. [2025-09-29T20:40:00.366127] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-29T20:40:00.878335] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-29T20:40:01.148180] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-09. [2025-09-29T20:40:01.948112] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-06. [2025-09-29T20:40:02.153581] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-29T20:40:02.403399] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-29T20:40:02.412930] [INFO ] [REMOTE ] POST: Full fetch complete (55929 records). [2025-09-29T20:40:02.413092] [DEBUG] [VALIDATOR ] POST: Validating primary data. [2025-09-29T20:40:02.753246] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-03. [2025-09-29T20:40:02.833173] [DEBUG] [VALIDATOR ] POST: All expected trading days are present. [2025-09-29T20:40:02.833259] [DEBUG] [VALIDATOR ] POST: Primary data validation passed. [2025-09-29T20:40:02.834194] [INFO ] [MAIN ] POST: Fetched primary data is valid. [2025-09-29T20:40:02.834258] [DEBUG] [LOCAL ] POST: Saving primary data. [2025-09-29T20:40:02.835613] [DEBUG] [LOCAL ] POST: Trimmed 55929 records to 38818 (keeping 200 days of data) [2025-09-29T20:40:03.091187] [DEBUG] [LOCAL ] POST: Primary data saved (38818 records). [2025-09-29T20:40:03.091332] [INFO ] [MAIN ] POST: Full history saved. [2025-09-29T20:40:03.091435] [INFO ] [MAIN ] Update Progress: 1715/2371 symbols completed. POST took 24.0s. Estimated remaining: 1h 24m 9s. Rate: 7.8 symbols/min [2025-09-29T20:40:03.271686] [INFO ] [MAIN ] PPL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:40:03.337830] [DEBUG] [LOCAL ] PPL: Loaded 54285 existing records from primary storage. [2025-09-29T20:40:03.338195] [INFO ] [MAIN ] PPL: Loaded 54285 existing records. [2025-09-29T20:40:03.535971] [WARN ] [MAIN ] PPL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:40:03.536292] [INFO ] [MAIN ] PPL: Wiping existing primary data before full refresh. [2025-09-29T20:40:03.536431] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-09-29T20:40:03.537034] [DEBUG] [LOCAL ] PPL: Deleted primary data file. [2025-09-29T20:40:03.537123] [INFO ] [MAIN ] PPL: Starting full primary refresh. [2025-09-29T20:40:03.559415] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-07. [2025-09-29T20:40:03.893712] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-29T20:40:03.985370] [INFO ] [REMOTE ] PPL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:40:04.348116] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-07. [2025-09-29T20:40:04.509912] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-29T20:40:05.148130] [INFO ] [REMOTE ] PPL: Fetching primary data for 2024-12. [2025-09-29T20:40:05.427435] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-29T20:40:05.950218] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-08. [2025-09-29T20:40:05.956352] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-29T20:40:06.748560] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-08. [2025-09-29T20:40:06.751676] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-29T20:40:07.305367] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-29T20:40:07.548123] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-01. [2025-09-29T20:40:08.066601] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-29T20:40:08.348166] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-09. [2025-09-29T20:40:09.148119] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-09. [2025-09-29T20:40:09.515581] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-29T20:40:09.948092] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-04. [2025-09-29T20:40:10.056074] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-29T20:40:10.066083] [INFO ] [REMOTE ] POR: Full fetch complete (68299 records). [2025-09-29T20:40:10.066242] [DEBUG] [VALIDATOR ] POR: Validating primary data. [2025-09-29T20:40:10.477555] [DEBUG] [VALIDATOR ] POR: All expected trading days are present. [2025-09-29T20:40:10.477700] [DEBUG] [VALIDATOR ] POR: Primary data validation passed. [2025-09-29T20:40:10.479798] [INFO ] [MAIN ] POR: Fetched primary data is valid. [2025-09-29T20:40:10.479874] [DEBUG] [LOCAL ] POR: Saving primary data. [2025-09-29T20:40:10.481551] [DEBUG] [LOCAL ] POR: Trimmed 68299 records to 46997 (keeping 200 days of data) [2025-09-29T20:40:10.752304] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-02. [2025-09-29T20:40:10.809033] [DEBUG] [LOCAL ] POR: Primary data saved (46997 records). [2025-09-29T20:40:10.809328] [INFO ] [MAIN ] POR: Full history saved. [2025-09-29T20:40:10.809546] [INFO ] [MAIN ] Update Progress: 1716/2371 symbols completed. POR took 32.8s. Estimated remaining: 1h 24m 1s. Rate: 7.8 symbols/min [2025-09-29T20:40:10.951669] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-29T20:40:11.019411] [INFO ] [REMOTE ] PNW: Full fetch complete (66099 records). [2025-09-29T20:40:11.037194] [DEBUG] [VALIDATOR ] PNW: Validating primary data. [2025-09-29T20:40:11.038846] [INFO ] [MAIN ] PPT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:40:11.256250] [DEBUG] [LOCAL ] PPT: Loaded 20342 existing records from primary storage. [2025-09-29T20:40:11.281616] [INFO ] [MAIN ] PPT: Loaded 20342 existing records. [2025-09-29T20:40:11.644838] [WARN ] [MAIN ] PPT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:40:11.704951] [DEBUG] [VALIDATOR ] PNW: All expected trading days are present. [2025-09-29T20:40:11.705362] [INFO ] [MAIN ] PPT: Wiping existing primary data before full refresh. [2025-09-29T20:40:11.705228] [DEBUG] [VALIDATOR ] PNW: Primary data validation passed. [2025-09-29T20:40:11.706582] [INFO ] [MAIN ] PNW: Fetched primary data is valid. [2025-09-29T20:40:11.706807] [INFO ] [LOCAL ] PPT: Starting deletion of primary data. [2025-09-29T20:40:11.706960] [DEBUG] [LOCAL ] PNW: Saving primary data. [2025-09-29T20:40:11.707370] [DEBUG] [LOCAL ] PPT: Deleted primary data file. [2025-09-29T20:40:11.707450] [INFO ] [MAIN ] PPT: Starting full primary refresh. [2025-09-29T20:40:11.769696] [DEBUG] [LOCAL ] PNW: Trimmed 66099 records to 45786 (keeping 200 days of data) [2025-09-29T20:40:12.240473] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-29T20:40:12.308212] [INFO ] [REMOTE ] PPT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:40:12.310123] [INFO ] [REMOTE ] PPT: Fetching primary data for 2024-12. [2025-09-29T20:40:12.372774] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-05. [2025-09-29T20:40:12.497115] [DEBUG] [LOCAL ] PNW: Primary data saved (45786 records). [2025-09-29T20:40:12.497328] [INFO ] [MAIN ] PNW: Full history saved. [2025-09-29T20:40:12.497487] [INFO ] [MAIN ] Update Progress: 1717/2371 symbols completed. PNW took 38.4s. Estimated remaining: 1h 23m 51s. Rate: 7.8 symbols/min [2025-09-29T20:40:12.563080] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-29T20:40:13.148132] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-03. [2025-09-29T20:40:13.776899] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-29T20:40:13.948148] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-01. [2025-09-29T20:40:14.240294] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-29T20:40:14.748094] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-06. [2025-09-29T20:40:14.820659] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-29T20:40:15.110231] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-29T20:40:15.548135] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-02. [2025-09-29T20:40:16.335189] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-29T20:40:16.348064] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-07. [2025-09-29T20:40:16.662146] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-29T20:40:17.148148] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-03. [2025-09-29T20:40:17.948237] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-04. [2025-09-29T20:40:18.336092] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-29T20:40:18.374478] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-29T20:40:18.748154] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-04. [2025-09-29T20:40:19.548130] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-08. [2025-09-29T20:40:19.833274] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-29T20:40:20.090795] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-29T20:40:20.348158] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-05. [2025-09-29T20:40:21.148172] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-05. [2025-09-29T20:40:21.449780] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-29T20:40:21.520329] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-29T20:40:21.948160] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-06. [2025-09-29T20:40:22.748134] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-09. [2025-09-29T20:40:22.823422] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-29T20:40:22.861455] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-29T20:40:23.548129] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-07. [2025-09-29T20:40:24.348103] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-06. [2025-09-29T20:40:24.485073] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-29T20:40:24.588351] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-29T20:40:24.599577] [INFO ] [REMOTE ] PPG: Full fetch complete (73771 records). [2025-09-29T20:40:24.599803] [DEBUG] [VALIDATOR ] PPG: Validating primary data. [2025-09-29T20:40:25.006219] [DEBUG] [VALIDATOR ] PPG: All expected trading days are present. [2025-09-29T20:40:25.006316] [DEBUG] [VALIDATOR ] PPG: Primary data validation passed. [2025-09-29T20:40:25.007509] [INFO ] [MAIN ] PPG: Fetched primary data is valid. [2025-09-29T20:40:25.007582] [DEBUG] [LOCAL ] PPG: Saving primary data. [2025-09-29T20:40:25.009325] [DEBUG] [LOCAL ] PPG: Trimmed 73771 records to 50704 (keeping 200 days of data) [2025-09-29T20:40:25.203727] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-08. [2025-09-29T20:40:25.351965] [DEBUG] [LOCAL ] PPG: Primary data saved (50704 records). [2025-09-29T20:40:25.352222] [INFO ] [MAIN ] PPG: Full history saved. [2025-09-29T20:40:25.352412] [INFO ] [MAIN ] Update Progress: 1718/2371 symbols completed. PPG took 32.1s. Estimated remaining: 1h 23m 46s. Rate: 7.8 symbols/min [2025-09-29T20:40:26.260181] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-29T20:40:26.269461] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-29T20:40:26.280516] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-09. [2025-09-29T20:40:26.748179] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-07. [2025-09-29T20:40:27.317134] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-29T20:40:27.321772] [INFO ] [REMOTE ] PPT: Full fetch complete (29257 records). [2025-09-29T20:40:27.321884] [DEBUG] [VALIDATOR ] PPT: Validating primary data. [2025-09-29T20:40:27.722444] [DEBUG] [VALIDATOR ] PPT: All expected trading days are present. [2025-09-29T20:40:27.722563] [DEBUG] [VALIDATOR ] PPT: Primary data validation passed. [2025-09-29T20:40:27.723560] [INFO ] [MAIN ] PPT: Fetched primary data is valid. [2025-09-29T20:40:27.723630] [DEBUG] [LOCAL ] PPT: Saving primary data. [2025-09-29T20:40:27.724771] [DEBUG] [LOCAL ] PPT: Trimmed 29257 records to 19892 (keeping 200 days of data) [2025-09-29T20:40:27.859303] [DEBUG] [LOCAL ] PPT: Primary data saved (19892 records). [2025-09-29T20:40:27.859484] [INFO ] [MAIN ] PPT: Full history saved. [2025-09-29T20:40:27.859659] [INFO ] [MAIN ] Update Progress: 1719/2371 symbols completed. PPT took 17.0s. Estimated remaining: 1h 23m 36s. Rate: 7.8 symbols/min [2025-09-29T20:40:28.790817] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-29T20:40:28.803003] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-08. [2025-09-29T20:40:30.726310] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-29T20:40:30.739944] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-09. [2025-09-29T20:40:32.612339] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-29T20:40:32.623601] [INFO ] [REMOTE ] PPL: Full fetch complete (77026 records). [2025-09-29T20:40:32.623799] [DEBUG] [VALIDATOR ] PPL: Validating primary data. [2025-09-29T20:40:32.624879] [FATAL] [VALIDATOR ] PPL: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T20:40:32.624981] [FATAL] [MAIN ] PPL: Fetched primary data is invalid. Refusing to save it. [2025-09-29T20:40:32.625028] [WARN ] [MAIN ] PPL: Deleting existing primary and derivative data due to validation failure. [2025-09-29T20:40:32.625075] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-09-29T20:40:32.625198] [DEBUG] [LOCAL ] PPL: No primary data file found to delete. [2025-09-29T20:40:32.625259] [INFO ] [LOCAL ] PPL: Starting deletion of derivative data. [2025-09-29T20:40:32.625748] [DEBUG] [LOCAL ] PPL: Deleted derivative data file. [2025-09-29T20:40:32.625859] [INFO ] [MAIN ] Update Progress: 1720/2371 symbols completed. PPL took 29.5s. Estimated remaining: 1h 23m 27s. Rate: 7.8 symbols/min [2025-09-29T20:40:33.266408] [INFO ] [MAIN ] PRA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:40:33.296866] [INFO ] [MAIN ] PRCS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:40:33.377933] [DEBUG] [LOCAL ] PRCS: No existing data file found in primary storage. [2025-09-29T20:40:33.408488] [INFO ] [MAIN ] PR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:40:33.425134] [WARN ] [MAIN ] PRCS: No existing data found, performing full refresh instead. [2025-09-29T20:40:33.425860] [INFO ] [MAIN ] PRCS: Wiping existing primary data before full refresh. [2025-09-29T20:40:33.426004] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-09-29T20:40:33.424719] [INFO ] [MAIN ] PRG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:40:33.426175] [DEBUG] [LOCAL ] PRCS: No primary data file found to delete. [2025-09-29T20:40:33.426911] [INFO ] [MAIN ] PRCS: Starting full primary refresh. [2025-09-29T20:40:33.629985] [DEBUG] [LOCAL ] PRA: Loaded 35243 existing records from primary storage. [2025-09-29T20:40:33.669804] [INFO ] [MAIN ] PRA: Loaded 35243 existing records. [2025-09-29T20:40:33.670467] [DEBUG] [LOCAL ] PRG: Loaded 30420 existing records from primary storage. [2025-09-29T20:40:33.745343] [INFO ] [MAIN ] PRG: Loaded 30420 existing records. [2025-09-29T20:40:34.021663] [DEBUG] [LOCAL ] PR: Loaded 54389 existing records from primary storage. [2025-09-29T20:40:34.070543] [INFO ] [MAIN ] PR: Loaded 54389 existing records. [2025-09-29T20:40:34.278277] [WARN ] [MAIN ] PRA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:40:34.371511] [INFO ] [MAIN ] PRA: Wiping existing primary data before full refresh. [2025-09-29T20:40:34.372389] [INFO ] [LOCAL ] PRA: Starting deletion of primary data. [2025-09-29T20:40:34.408374] [DEBUG] [LOCAL ] PRA: Deleted primary data file. [2025-09-29T20:40:34.411781] [INFO ] [MAIN ] PRA: Starting full primary refresh. [2025-09-29T20:40:34.376085] [WARN ] [MAIN ] PRG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:40:34.420978] [INFO ] [REMOTE ] PRCS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:40:34.448851] [INFO ] [MAIN ] PRG: Wiping existing primary data before full refresh. [2025-09-29T20:40:34.476062] [INFO ] [LOCAL ] PRG: Starting deletion of primary data. [2025-09-29T20:40:34.470515] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2024-12. [2025-09-29T20:40:34.504865] [DEBUG] [LOCAL ] PRG: Deleted primary data file. [2025-09-29T20:40:34.523004] [INFO ] [MAIN ] PRG: Starting full primary refresh. [2025-09-29T20:40:34.671046] [WARN ] [MAIN ] PR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:40:34.742766] [INFO ] [MAIN ] PR: Wiping existing primary data before full refresh. [2025-09-29T20:40:34.787458] [INFO ] [LOCAL ] PR: Starting deletion of primary data. [2025-09-29T20:40:34.834389] [DEBUG] [LOCAL ] PR: Deleted primary data file. [2025-09-29T20:40:34.840942] [INFO ] [MAIN ] PR: Starting full primary refresh. [2025-09-29T20:40:35.074895] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-29T20:40:35.148209] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-01. [2025-09-29T20:40:35.561125] [INFO ] [REMOTE ] PRA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:40:35.610585] [INFO ] [REMOTE ] PRA: Fetching primary data for 2024-12. [2025-09-29T20:40:35.751444] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-29T20:40:35.787211] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-02. [2025-09-29T20:40:35.835168] [INFO ] [REMOTE ] PRG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:40:35.835554] [INFO ] [REMOTE ] PRG: Fetching primary data for 2024-12. [2025-09-29T20:40:35.921456] [INFO ] [REMOTE ] PR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:40:35.921858] [INFO ] [REMOTE ] PR: Fetching primary data for 2024-12. [2025-09-29T20:40:36.174839] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-29T20:40:36.176330] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-03. [2025-09-29T20:40:36.604700] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-29T20:40:36.606044] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-04. [2025-09-29T20:40:36.843367] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-29T20:40:36.848838] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-01. [2025-09-29T20:40:36.905549] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-29T20:40:36.911676] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-09-29T20:40:36.916185] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-01. [2025-09-29T20:40:37.148143] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-05. [2025-09-29T20:40:37.537451] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-29T20:40:37.581405] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-29T20:40:37.795039] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-29T20:40:37.948139] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-06. [2025-09-29T20:40:38.026351] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-29T20:40:38.490724] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-29T20:40:38.748128] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-07. [2025-09-29T20:40:39.235421] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-29T20:40:39.548112] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-08. [2025-09-29T20:40:39.733846] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-08 (0.19 seconds). [2025-09-29T20:40:40.348142] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-01. [2025-09-29T20:40:41.148113] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-02. [2025-09-29T20:40:41.948085] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-09. [2025-09-29T20:40:42.195887] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-29T20:40:42.238887] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-09-29T20:40:42.239906] [INFO ] [REMOTE ] PRCS: Full fetch complete (3804 records). [2025-09-29T20:40:42.239995] [DEBUG] [VALIDATOR ] PRCS: Validating primary data. [2025-09-29T20:40:42.240467] [FATAL] [VALIDATOR ] PRCS: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T20:40:42.240560] [FATAL] [MAIN ] PRCS: Fetched primary data is invalid. Refusing to save it. [2025-09-29T20:40:42.240605] [WARN ] [MAIN ] PRCS: Deleting existing primary and derivative data due to validation failure. [2025-09-29T20:40:42.240789] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-09-29T20:40:42.240881] [DEBUG] [LOCAL ] PRCS: No primary data file found to delete. [2025-09-29T20:40:42.240940] [INFO ] [LOCAL ] PRCS: Starting deletion of derivative data. [2025-09-29T20:40:42.240997] [DEBUG] [LOCAL ] PRCS: No derivative data file found to delete. [2025-09-29T20:40:42.241083] [INFO ] [MAIN ] Update Progress: 1721/2371 symbols completed. PRCS took 9.6s. Estimated remaining: 1h 23m 20s. Rate: 7.8 symbols/min [2025-09-29T20:40:42.426825] [INFO ] [MAIN ] PRGO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:40:42.478161] [DEBUG] [LOCAL ] PRGO: Loaded 47634 existing records from primary storage. [2025-09-29T20:40:42.478525] [INFO ] [MAIN ] PRGO: Loaded 47634 existing records. [2025-09-29T20:40:42.670809] [WARN ] [MAIN ] PRGO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:40:42.671242] [INFO ] [MAIN ] PRGO: Wiping existing primary data before full refresh. [2025-09-29T20:40:42.671355] [INFO ] [LOCAL ] PRGO: Starting deletion of primary data. [2025-09-29T20:40:42.679054] [DEBUG] [LOCAL ] PRGO: Deleted primary data file. [2025-09-29T20:40:42.688941] [INFO ] [MAIN ] PRGO: Starting full primary refresh. [2025-09-29T20:40:42.752534] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-02. [2025-09-29T20:40:42.754062] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-29T20:40:43.086367] [INFO ] [REMOTE ] PRGO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:40:43.548126] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2024-12. [2025-09-29T20:40:44.342086] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-29T20:40:44.352136] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-03. [2025-09-29T20:40:45.148080] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-03. [2025-09-29T20:40:45.640502] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-29T20:40:45.720900] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-29T20:40:45.948142] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-01. [2025-09-29T20:40:46.748088] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-04. [2025-09-29T20:40:46.842470] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-29T20:40:47.521525] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-29T20:40:47.548105] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-02. [2025-09-29T20:40:48.309226] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-29T20:40:48.348073] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-05. [2025-09-29T20:40:48.867201] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-29T20:40:49.148102] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-03. [2025-09-29T20:40:49.858848] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-29T20:40:49.948104] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-06. [2025-09-29T20:40:50.637874] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-29T20:40:50.748139] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-04. [2025-09-29T20:40:51.030473] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-29T20:40:51.548163] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-04. [2025-09-29T20:40:52.348088] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-02. [2025-09-29T20:40:52.458867] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-29T20:40:53.136855] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-29T20:40:53.148081] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-05. [2025-09-29T20:40:53.584179] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-29T20:40:53.948159] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-07. [2025-09-29T20:40:54.652272] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-29T20:40:54.748116] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-03. [2025-09-29T20:40:55.096457] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-29T20:40:55.548215] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-08. [2025-09-29T20:40:56.214812] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-29T20:40:56.348129] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-04. [2025-09-29T20:40:56.616505] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-29T20:40:57.148147] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-09. [2025-09-29T20:40:57.667019] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-29T20:40:57.948108] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-05. [2025-09-29T20:40:58.226153] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-29T20:40:58.231909] [INFO ] [REMOTE ] PRG: Full fetch complete (44163 records). [2025-09-29T20:40:58.232005] [DEBUG] [VALIDATOR ] PRG: Validating primary data. [2025-09-29T20:40:58.626617] [DEBUG] [VALIDATOR ] PRG: All expected trading days are present. [2025-09-29T20:40:58.626775] [DEBUG] [VALIDATOR ] PRG: Primary data validation passed. [2025-09-29T20:40:58.627636] [INFO ] [MAIN ] PRG: Fetched primary data is valid. [2025-09-29T20:40:58.627736] [DEBUG] [LOCAL ] PRG: Saving primary data. [2025-09-29T20:40:58.628805] [DEBUG] [LOCAL ] PRG: Trimmed 44163 records to 29834 (keeping 200 days of data) [2025-09-29T20:40:58.748762] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-05. [2025-09-29T20:40:58.824739] [DEBUG] [LOCAL ] PRG: Primary data saved (29834 records). [2025-09-29T20:40:58.825034] [INFO ] [MAIN ] PRG: Full history saved. [2025-09-29T20:40:58.825202] [INFO ] [MAIN ] Update Progress: 1722/2371 symbols completed. PRG took 26.2s. Estimated remaining: 1h 23m 16s. Rate: 7.8 symbols/min [2025-09-29T20:40:59.010230] [INFO ] [MAIN ] PRH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:40:59.018461] [DEBUG] [LOCAL ] PRH: Loaded 4908 existing records from primary storage. [2025-09-29T20:40:59.018722] [INFO ] [MAIN ] PRH: Loaded 4908 existing records. [2025-09-29T20:40:59.204911] [WARN ] [MAIN ] PRH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:40:59.205196] [INFO ] [MAIN ] PRH: Wiping existing primary data before full refresh. [2025-09-29T20:40:59.205327] [INFO ] [LOCAL ] PRH: Starting deletion of primary data. [2025-09-29T20:40:59.205556] [DEBUG] [LOCAL ] PRH: Deleted primary data file. [2025-09-29T20:40:59.205615] [INFO ] [MAIN ] PRH: Starting full primary refresh. [2025-09-29T20:40:59.553067] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-06. [2025-09-29T20:40:59.580847] [INFO ] [REMOTE ] PRH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:40:59.839425] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-29T20:41:00.278111] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-29T20:41:00.348108] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-06. [2025-09-29T20:41:01.148097] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-06. [2025-09-29T20:41:01.288454] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-29T20:41:01.948212] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-07. [2025-09-29T20:41:02.302453] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-29T20:41:02.553171] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-29T20:41:02.748112] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-07. [2025-09-29T20:41:03.548092] [INFO ] [REMOTE ] PRH: Fetching primary data for 2024-12. [2025-09-29T20:41:03.738071] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-29T20:41:04.357549] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-07. [2025-09-29T20:41:04.359494] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-29T20:41:04.491416] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-29T20:41:05.148098] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-08. [2025-09-29T20:41:05.948119] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-01. [2025-09-29T20:41:06.168409] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-29T20:41:06.459723] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-29T20:41:06.637912] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-29T20:41:06.748132] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-08. [2025-09-29T20:41:07.548134] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-02. [2025-09-29T20:41:08.212744] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-29T20:41:08.348139] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-09. [2025-09-29T20:41:08.397639] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-29T20:41:09.148128] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-03. [2025-09-29T20:41:09.430206] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-29T20:41:09.436516] [INFO ] [REMOTE ] PRA: Full fetch complete (43509 records). [2025-09-29T20:41:09.436660] [DEBUG] [VALIDATOR ] PRA: Validating primary data. [2025-09-29T20:41:09.841571] [DEBUG] [VALIDATOR ] PRA: All expected trading days are present. [2025-09-29T20:41:09.841729] [DEBUG] [VALIDATOR ] PRA: Primary data validation passed. [2025-09-29T20:41:09.842736] [INFO ] [MAIN ] PRA: Fetched primary data is valid. [2025-09-29T20:41:09.842802] [DEBUG] [LOCAL ] PRA: Saving primary data. [2025-09-29T20:41:09.843980] [DEBUG] [LOCAL ] PRA: Trimmed 43509 records to 34933 (keeping 200 days of data) [2025-09-29T20:41:09.948132] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-08. [2025-09-29T20:41:09.979989] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-29T20:41:10.102847] [DEBUG] [LOCAL ] PRA: Primary data saved (34933 records). [2025-09-29T20:41:10.103009] [INFO ] [MAIN ] PRA: Full history saved. [2025-09-29T20:41:10.103149] [INFO ] [MAIN ] Update Progress: 1723/2371 symbols completed. PRA took 37.5s. Estimated remaining: 1h 23m 10s. Rate: 7.8 symbols/min [2025-09-29T20:41:10.356970] [INFO ] [MAIN ] PRI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:41:10.385854] [DEBUG] [LOCAL ] PRI: Loaded 18636 existing records from primary storage. [2025-09-29T20:41:10.386209] [INFO ] [MAIN ] PRI: Loaded 18636 existing records. [2025-09-29T20:41:10.698132] [WARN ] [MAIN ] PRI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:41:10.698488] [INFO ] [MAIN ] PRI: Wiping existing primary data before full refresh. [2025-09-29T20:41:10.698562] [INFO ] [LOCAL ] PRI: Starting deletion of primary data. [2025-09-29T20:41:10.699022] [DEBUG] [LOCAL ] PRI: Deleted primary data file. [2025-09-29T20:41:10.699100] [INFO ] [MAIN ] PRI: Starting full primary refresh. [2025-09-29T20:41:10.753461] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-09. [2025-09-29T20:41:11.147836] [INFO ] [REMOTE ] PRI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:41:11.548146] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-04. [2025-09-29T20:41:11.834790] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-29T20:41:12.338276] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-29T20:41:12.348085] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-05. [2025-09-29T20:41:12.535915] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-29T20:41:12.551990] [INFO ] [REMOTE ] PRGO: Full fetch complete (68418 records). [2025-09-29T20:41:12.552193] [DEBUG] [VALIDATOR ] PRGO: Validating primary data. [2025-09-29T20:41:12.985577] [DEBUG] [VALIDATOR ] PRGO: All expected trading days are present. [2025-09-29T20:41:12.985729] [DEBUG] [VALIDATOR ] PRGO: Primary data validation passed. [2025-09-29T20:41:12.986972] [INFO ] [MAIN ] PRGO: Fetched primary data is valid. [2025-09-29T20:41:12.987054] [DEBUG] [LOCAL ] PRGO: Saving primary data. [2025-09-29T20:41:12.988601] [DEBUG] [LOCAL ] PRGO: Trimmed 68418 records to 46914 (keeping 200 days of data) [2025-09-29T20:41:13.172348] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-09. [2025-09-29T20:41:13.220565] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-29T20:41:13.305363] [DEBUG] [LOCAL ] PRGO: Primary data saved (46914 records). [2025-09-29T20:41:13.305521] [INFO ] [MAIN ] PRGO: Full history saved. [2025-09-29T20:41:13.305613] [INFO ] [MAIN ] Update Progress: 1724/2371 symbols completed. PRGO took 31.1s. Estimated remaining: 1h 23m 0s. Rate: 7.8 symbols/min [2025-09-29T20:41:13.487895] [INFO ] [MAIN ] PRIM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:41:13.536388] [DEBUG] [LOCAL ] PRIM: Loaded 45072 existing records from primary storage. [2025-09-29T20:41:13.536915] [INFO ] [MAIN ] PRIM: Loaded 45072 existing records. [2025-09-29T20:41:13.749186] [WARN ] [MAIN ] PRIM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:41:13.749424] [INFO ] [MAIN ] PRIM: Wiping existing primary data before full refresh. [2025-09-29T20:41:13.749473] [INFO ] [LOCAL ] PRIM: Starting deletion of primary data. [2025-09-29T20:41:13.749994] [DEBUG] [LOCAL ] PRIM: Deleted primary data file. [2025-09-29T20:41:13.750054] [INFO ] [MAIN ] PRIM: Starting full primary refresh. [2025-09-29T20:41:13.954606] [INFO ] [REMOTE ] PRI: Fetching primary data for 2024-12. [2025-09-29T20:41:14.144401] [INFO ] [REMOTE ] PRIM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:41:14.748144] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2024-12. [2025-09-29T20:41:15.060804] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-29T20:41:15.073115] [INFO ] [REMOTE ] PR: Full fetch complete (77595 records). [2025-09-29T20:41:15.073325] [DEBUG] [VALIDATOR ] PR: Validating primary data. [2025-09-29T20:41:15.407191] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-29T20:41:15.505052] [DEBUG] [VALIDATOR ] PR: All expected trading days are present. [2025-09-29T20:41:15.505156] [DEBUG] [VALIDATOR ] PR: Primary data validation passed. [2025-09-29T20:41:15.506433] [INFO ] [MAIN ] PR: Fetched primary data is valid. [2025-09-29T20:41:15.506511] [DEBUG] [LOCAL ] PR: Saving primary data. [2025-09-29T20:41:15.508234] [DEBUG] [LOCAL ] PR: Trimmed 77595 records to 53609 (keeping 200 days of data) [2025-09-29T20:41:15.571310] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-06. [2025-09-29T20:41:15.872670] [DEBUG] [LOCAL ] PR: Primary data saved (53609 records). [2025-09-29T20:41:15.872863] [INFO ] [MAIN ] PR: Full history saved. [2025-09-29T20:41:15.872981] [INFO ] [MAIN ] Update Progress: 1725/2371 symbols completed. PR took 43.2s. Estimated remaining: 1h 22m 51s. Rate: 7.8 symbols/min [2025-09-29T20:41:16.053477] [INFO ] [MAIN ] PRKS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:41:16.100795] [DEBUG] [LOCAL ] PRKS: Loaded 43308 existing records from primary storage. [2025-09-29T20:41:16.101114] [INFO ] [MAIN ] PRKS: Loaded 43308 existing records. [2025-09-29T20:41:16.293007] [WARN ] [MAIN ] PRKS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:41:16.293486] [INFO ] [MAIN ] PRKS: Wiping existing primary data before full refresh. [2025-09-29T20:41:16.293567] [INFO ] [LOCAL ] PRKS: Starting deletion of primary data. [2025-09-29T20:41:16.294802] [DEBUG] [LOCAL ] PRKS: Deleted primary data file. [2025-09-29T20:41:16.294866] [INFO ] [MAIN ] PRKS: Starting full primary refresh. [2025-09-29T20:41:16.353391] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-01. [2025-09-29T20:41:16.378093] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-29T20:41:16.707684] [INFO ] [REMOTE ] PRKS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:41:16.734922] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-29T20:41:17.148172] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2024-12. [2025-09-29T20:41:17.331490] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-29T20:41:17.948157] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-02. [2025-09-29T20:41:18.595941] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-29T20:41:18.748131] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-07. [2025-09-29T20:41:18.877824] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-29T20:41:19.450618] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-29T20:41:19.548164] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-01. [2025-09-29T20:41:20.348137] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-03. [2025-09-29T20:41:21.132472] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-29T20:41:21.148052] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-02. [2025-09-29T20:41:21.550712] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-29T20:41:21.948102] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-04. [2025-09-29T20:41:22.432446] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-29T20:41:22.748138] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-01. [2025-09-29T20:41:22.894127] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-29T20:41:23.548162] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-03. [2025-09-29T20:41:24.332714] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-29T20:41:24.348136] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-08. [2025-09-29T20:41:24.986603] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-29T20:41:25.148144] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-02. [2025-09-29T20:41:25.262040] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-29T20:41:25.948117] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-09. [2025-09-29T20:41:26.541267] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-29T20:41:26.542532] [INFO ] [REMOTE ] PRH: Full fetch complete (7624 records). [2025-09-29T20:41:26.542622] [DEBUG] [VALIDATOR ] PRH: Validating primary data. [2025-09-29T20:41:26.752709] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-04. [2025-09-29T20:41:26.951943] [DEBUG] [VALIDATOR ] PRH: All expected trading days are present. [2025-09-29T20:41:26.952094] [DEBUG] [VALIDATOR ] PRH: Primary data validation passed. [2025-09-29T20:41:26.952360] [INFO ] [MAIN ] PRH: Fetched primary data is valid. [2025-09-29T20:41:26.952430] [DEBUG] [LOCAL ] PRH: Saving primary data. [2025-09-29T20:41:26.964336] [DEBUG] [LOCAL ] PRH: Trimmed 7624 records to 4770 (keeping 200 days of data) [2025-09-29T20:41:26.983307] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-29T20:41:27.024235] [DEBUG] [LOCAL ] PRH: Primary data saved (4770 records). [2025-09-29T20:41:27.024386] [INFO ] [MAIN ] PRH: Full history saved. [2025-09-29T20:41:27.024504] [INFO ] [MAIN ] Update Progress: 1726/2371 symbols completed. PRH took 28.2s. Estimated remaining: 1h 22m 44s. Rate: 7.8 symbols/min [2025-09-29T20:41:27.205772] [INFO ] [MAIN ] PRLB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:41:27.228576] [DEBUG] [LOCAL ] PRLB: Loaded 20919 existing records from primary storage. [2025-09-29T20:41:27.228899] [INFO ] [MAIN ] PRLB: Loaded 20919 existing records. [2025-09-29T20:41:27.411574] [WARN ] [MAIN ] PRLB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:41:27.411815] [INFO ] [MAIN ] PRLB: Wiping existing primary data before full refresh. [2025-09-29T20:41:27.411948] [INFO ] [LOCAL ] PRLB: Starting deletion of primary data. [2025-09-29T20:41:27.412316] [DEBUG] [LOCAL ] PRLB: Deleted primary data file. [2025-09-29T20:41:27.412383] [INFO ] [MAIN ] PRLB: Starting full primary refresh. [2025-09-29T20:41:27.553287] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-05. [2025-09-29T20:41:27.814030] [INFO ] [REMOTE ] PRLB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:41:28.348134] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-03. [2025-09-29T20:41:28.564571] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-29T20:41:28.750085] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-29T20:41:29.148183] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-05. [2025-09-29T20:41:29.948112] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-06. [2025-09-29T20:41:30.063947] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-29T20:41:30.445242] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-29T20:41:30.748114] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2024-12. [2025-09-29T20:41:30.958121] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-29T20:41:31.548092] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-07. [2025-09-29T20:41:31.761854] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-29T20:41:32.348084] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-01. [2025-09-29T20:41:32.366871] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-29T20:41:33.148114] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-08. [2025-09-29T20:41:33.547687] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-29T20:41:33.948112] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-02. [2025-09-29T20:41:34.201323] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-29T20:41:34.748141] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-04. [2025-09-29T20:41:35.232872] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-29T20:41:35.548146] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-03. [2025-09-29T20:41:36.348104] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-06. [2025-09-29T20:41:36.459921] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-29T20:41:36.493466] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-29T20:41:37.148152] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-04. [2025-09-29T20:41:37.669745] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-29T20:41:37.948124] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-07. [2025-09-29T20:41:38.748134] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-05. [2025-09-29T20:41:38.881380] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-29T20:41:39.533447] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-29T20:41:39.548055] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-08. [2025-09-29T20:41:39.969118] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-29T20:41:40.348128] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-05. [2025-09-29T20:41:40.961351] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-29T20:41:41.148115] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-09. [2025-09-29T20:41:41.578711] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-29T20:41:41.948090] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-09. [2025-09-29T20:41:42.174576] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-29T20:41:42.178935] [INFO ] [REMOTE ] PRI: Full fetch complete (25721 records). [2025-09-29T20:41:42.179073] [DEBUG] [VALIDATOR ] PRI: Validating primary data. [2025-09-29T20:41:42.563526] [DEBUG] [VALIDATOR ] PRI: All expected trading days are present. [2025-09-29T20:41:42.563676] [DEBUG] [VALIDATOR ] PRI: Primary data validation passed. [2025-09-29T20:41:42.564243] [INFO ] [MAIN ] PRI: Fetched primary data is valid. [2025-09-29T20:41:42.564287] [DEBUG] [LOCAL ] PRI: Saving primary data. [2025-09-29T20:41:42.565244] [DEBUG] [LOCAL ] PRI: Trimmed 25721 records to 18275 (keeping 200 days of data) [2025-09-29T20:41:42.684144] [DEBUG] [LOCAL ] PRI: Primary data saved (18275 records). [2025-09-29T20:41:42.684352] [INFO ] [MAIN ] PRI: Full history saved. [2025-09-29T20:41:42.684451] [INFO ] [MAIN ] Update Progress: 1727/2371 symbols completed. PRI took 32.6s. Estimated remaining: 1h 22m 39s. Rate: 7.8 symbols/min [2025-09-29T20:41:42.753247] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-06. [2025-09-29T20:41:42.869300] [INFO ] [MAIN ] PRM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:41:42.919441] [DEBUG] [LOCAL ] PRM: Loaded 45298 existing records from primary storage. [2025-09-29T20:41:42.919787] [INFO ] [MAIN ] PRM: Loaded 45298 existing records. [2025-09-29T20:41:43.125587] [WARN ] [MAIN ] PRM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:41:43.126149] [INFO ] [MAIN ] PRM: Wiping existing primary data before full refresh. [2025-09-29T20:41:43.126213] [INFO ] [LOCAL ] PRM: Starting deletion of primary data. [2025-09-29T20:41:43.126814] [DEBUG] [LOCAL ] PRM: Deleted primary data file. [2025-09-29T20:41:43.126876] [INFO ] [MAIN ] PRM: Starting full primary refresh. [2025-09-29T20:41:43.514863] [INFO ] [REMOTE ] PRM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:41:43.547850] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-29T20:41:43.556503] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-06. [2025-09-29T20:41:43.558978] [INFO ] [REMOTE ] PRKS: Full fetch complete (61138 records). [2025-09-29T20:41:43.559114] [DEBUG] [VALIDATOR ] PRKS: Validating primary data. [2025-09-29T20:41:43.995511] [DEBUG] [VALIDATOR ] PRKS: All expected trading days are present. [2025-09-29T20:41:43.995726] [DEBUG] [VALIDATOR ] PRKS: Primary data validation passed. [2025-09-29T20:41:43.996877] [INFO ] [MAIN ] PRKS: Fetched primary data is valid. [2025-09-29T20:41:43.996942] [DEBUG] [LOCAL ] PRKS: Saving primary data. [2025-09-29T20:41:43.998289] [DEBUG] [LOCAL ] PRKS: Trimmed 61138 records to 42559 (keeping 200 days of data) [2025-09-29T20:41:44.253921] [DEBUG] [LOCAL ] PRKS: Primary data saved (42559 records). [2025-09-29T20:41:44.254082] [INFO ] [MAIN ] PRKS: Full history saved. [2025-09-29T20:41:44.254263] [INFO ] [MAIN ] Update Progress: 1728/2371 symbols completed. PRKS took 28.4s. Estimated remaining: 1h 22m 30s. Rate: 7.8 symbols/min [2025-09-29T20:41:44.367221] [INFO ] [REMOTE ] PRM: Fetching primary data for 2024-12. [2025-09-29T20:41:44.452331] [INFO ] [MAIN ] PRMB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:41:44.481995] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-29T20:41:44.542825] [DEBUG] [LOCAL ] PRMB: Loaded 53928 existing records from primary storage. [2025-09-29T20:41:44.543195] [INFO ] [MAIN ] PRMB: Loaded 53928 existing records. [2025-09-29T20:41:44.743665] [WARN ] [MAIN ] PRMB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:41:44.744013] [INFO ] [MAIN ] PRMB: Wiping existing primary data before full refresh. [2025-09-29T20:41:44.749281] [INFO ] [LOCAL ] PRMB: Starting deletion of primary data. [2025-09-29T20:41:44.758499] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-29T20:41:44.762959] [DEBUG] [LOCAL ] PRMB: Deleted primary data file. [2025-09-29T20:41:44.763599] [INFO ] [MAIN ] PRMB: Starting full primary refresh. [2025-09-29T20:41:45.135260] [INFO ] [REMOTE ] PRMB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:41:45.148106] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-07. [2025-09-29T20:41:45.683166] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-29T20:41:45.948077] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-01. [2025-09-29T20:41:46.236316] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-29T20:41:46.748112] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-08. [2025-09-29T20:41:47.548130] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-07. [2025-09-29T20:41:47.614796] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-29T20:41:47.884237] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-29T20:41:48.348109] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-02. [2025-09-29T20:41:49.117674] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-29T20:41:49.148078] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-08. [2025-09-29T20:41:49.727538] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-29T20:41:49.948153] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-09. [2025-09-29T20:41:50.559569] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-29T20:41:50.746933] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-29T20:41:50.750988] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2024-12. [2025-09-29T20:41:50.752897] [INFO ] [REMOTE ] PRLB: Full fetch complete (30833 records). [2025-09-29T20:41:50.753027] [DEBUG] [VALIDATOR ] PRLB: Validating primary data. [2025-09-29T20:41:51.173035] [DEBUG] [VALIDATOR ] PRLB: All expected trading days are present. [2025-09-29T20:41:51.173131] [DEBUG] [VALIDATOR ] PRLB: Primary data validation passed. [2025-09-29T20:41:51.173920] [INFO ] [MAIN ] PRLB: Fetched primary data is valid. [2025-09-29T20:41:51.173989] [DEBUG] [LOCAL ] PRLB: Saving primary data. [2025-09-29T20:41:51.174984] [DEBUG] [LOCAL ] PRLB: Trimmed 30833 records to 20527 (keeping 200 days of data) [2025-09-29T20:41:51.307204] [DEBUG] [LOCAL ] PRLB: Primary data saved (20527 records). [2025-09-29T20:41:51.307337] [INFO ] [MAIN ] PRLB: Full history saved. [2025-09-29T20:41:51.307422] [INFO ] [MAIN ] Update Progress: 1729/2371 symbols completed. PRLB took 24.3s. Estimated remaining: 1h 22m 22s. Rate: 7.8 symbols/min [2025-09-29T20:41:51.484506] [INFO ] [MAIN ] PRO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:41:51.526564] [DEBUG] [LOCAL ] PRO: Loaded 38444 existing records from primary storage. [2025-09-29T20:41:51.526890] [INFO ] [MAIN ] PRO: Loaded 38444 existing records. [2025-09-29T20:41:51.558206] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-03. [2025-09-29T20:41:51.717032] [WARN ] [MAIN ] PRO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:41:51.717338] [INFO ] [MAIN ] PRO: Wiping existing primary data before full refresh. [2025-09-29T20:41:51.717391] [INFO ] [LOCAL ] PRO: Starting deletion of primary data. [2025-09-29T20:41:51.718205] [DEBUG] [LOCAL ] PRO: Deleted primary data file. [2025-09-29T20:41:51.718280] [INFO ] [MAIN ] PRO: Starting full primary refresh. [2025-09-29T20:41:52.122194] [INFO ] [REMOTE ] PRO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:41:52.348107] [INFO ] [REMOTE ] PRO: Fetching primary data for 2024-12. [2025-09-29T20:41:52.690394] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-29T20:41:53.148134] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-09. [2025-09-29T20:41:53.221663] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-29T20:41:53.383572] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-29T20:41:53.948156] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-01. [2025-09-29T20:41:54.748108] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-04. [2025-09-29T20:41:54.827997] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-29T20:41:54.839013] [INFO ] [REMOTE ] PRIM: Full fetch complete (63351 records). [2025-09-29T20:41:54.839184] [DEBUG] [VALIDATOR ] PRIM: Validating primary data. [2025-09-29T20:41:55.262842] [DEBUG] [VALIDATOR ] PRIM: All expected trading days are present. [2025-09-29T20:41:55.263023] [DEBUG] [VALIDATOR ] PRIM: Primary data validation passed. [2025-09-29T20:41:55.264170] [INFO ] [MAIN ] PRIM: Fetched primary data is valid. [2025-09-29T20:41:55.264281] [DEBUG] [LOCAL ] PRIM: Saving primary data. [2025-09-29T20:41:55.266123] [DEBUG] [LOCAL ] PRIM: Trimmed 63351 records to 44317 (keeping 200 days of data) [2025-09-29T20:41:55.389327] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-29T20:41:55.548355] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-02. [2025-09-29T20:41:55.596455] [DEBUG] [LOCAL ] PRIM: Primary data saved (44317 records). [2025-09-29T20:41:55.596599] [INFO ] [MAIN ] PRIM: Full history saved. [2025-09-29T20:41:55.596760] [INFO ] [MAIN ] Update Progress: 1730/2371 symbols completed. PRIM took 42.3s. Estimated remaining: 1h 22m 13s. Rate: 7.8 symbols/min [2025-09-29T20:41:55.782668] [INFO ] [MAIN ] PRSU: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:41:55.782877] [DEBUG] [LOCAL ] PRSU: No existing data file found in primary storage. [2025-09-29T20:41:55.782934] [WARN ] [MAIN ] PRSU: No existing data found, performing full refresh instead. [2025-09-29T20:41:55.783065] [INFO ] [MAIN ] PRSU: Wiping existing primary data before full refresh. [2025-09-29T20:41:55.783119] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-09-29T20:41:55.783188] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-09-29T20:41:55.783224] [INFO ] [MAIN ] PRSU: Starting full primary refresh. [2025-09-29T20:41:56.222386] [INFO ] [REMOTE ] PRSU: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:41:56.348092] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-01. [2025-09-29T20:41:56.570728] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-29T20:41:57.038773] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-29T20:41:57.148119] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-05. [2025-09-29T20:41:57.584480] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-29T20:41:57.948162] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-02. [2025-09-29T20:41:58.748078] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-03. [2025-09-29T20:41:58.812709] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-29T20:41:59.217612] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-29T20:41:59.548124] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-06. [2025-09-29T20:42:00.348084] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-03. [2025-09-29T20:42:00.708701] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-29T20:42:01.148149] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2024-12. [2025-09-29T20:42:01.208948] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-29T20:42:01.277608] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-29T20:42:01.473283] [DEBUG] [REMOTE ] PRSU: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T20:42:01.473638] [WARN ] [REMOTE ] PRSU: No data returned for month 2024-12 [2025-09-29T20:42:01.473757] [FATAL] [REMOTE ] PRSU: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T20:42:01.473804] [FATAL] [MAIN ] PRSU: Failed to fetch primary data. [2025-09-29T20:42:01.473839] [WARN ] [MAIN ] PRSU: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T20:42:01.473903] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-09-29T20:42:01.474076] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-09-29T20:42:01.474147] [INFO ] [LOCAL ] PRSU: Starting deletion of derivative data. [2025-09-29T20:42:01.474221] [DEBUG] [LOCAL ] PRSU: No derivative data file found to delete. [2025-09-29T20:42:01.474326] [INFO ] [MAIN ] Update Progress: 1731/2371 symbols completed. PRSU took 5.9s. Estimated remaining: 1h 22m 4s. Rate: 7.8 symbols/min [2025-09-29T20:42:01.675938] [INFO ] [MAIN ] PRT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:42:01.688242] [DEBUG] [LOCAL ] PRT: Loaded 5402 existing records from primary storage. [2025-09-29T20:42:01.688492] [INFO ] [MAIN ] PRT: Loaded 5402 existing records. [2025-09-29T20:42:01.892709] [WARN ] [MAIN ] PRT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:42:01.892937] [INFO ] [MAIN ] PRT: Wiping existing primary data before full refresh. [2025-09-29T20:42:01.892988] [INFO ] [LOCAL ] PRT: Starting deletion of primary data. [2025-09-29T20:42:01.893329] [DEBUG] [LOCAL ] PRT: Deleted primary data file. [2025-09-29T20:42:01.893394] [INFO ] [MAIN ] PRT: Starting full primary refresh. [2025-09-29T20:42:01.953373] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-04. [2025-09-29T20:42:02.290146] [INFO ] [REMOTE ] PRT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:42:02.748184] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-07. [2025-09-29T20:42:03.548119] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-04. [2025-09-29T20:42:03.577722] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-29T20:42:04.348139] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-05. [2025-09-29T20:42:04.444825] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-29T20:42:05.083864] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-29T20:42:05.148153] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-08. [2025-09-29T20:42:05.548977] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-29T20:42:05.948136] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-06. [2025-09-29T20:42:06.748163] [INFO ] [REMOTE ] PRT: Fetching primary data for 2024-12. [2025-09-29T20:42:06.915138] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-29T20:42:07.287546] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-29T20:42:07.548176] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-01. [2025-09-29T20:42:07.674941] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-29T20:42:08.177354] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-29T20:42:08.348122] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-02. [2025-09-29T20:42:09.136380] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-29T20:42:09.148057] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-03. [2025-09-29T20:42:09.795709] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-29T20:42:09.948134] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-09. [2025-09-29T20:42:10.748167] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-04. [2025-09-29T20:42:11.296492] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-29T20:42:11.548159] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-05. [2025-09-29T20:42:11.709791] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-29T20:42:11.720867] [INFO ] [REMOTE ] PRM: Full fetch complete (64420 records). [2025-09-29T20:42:11.721129] [DEBUG] [VALIDATOR ] PRM: Validating primary data. [2025-09-29T20:42:12.091568] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-29T20:42:12.198940] [DEBUG] [VALIDATOR ] PRM: All expected trading days are present. [2025-09-29T20:42:12.199048] [DEBUG] [VALIDATOR ] PRM: Primary data validation passed. [2025-09-29T20:42:12.200388] [INFO ] [MAIN ] PRM: Fetched primary data is valid. [2025-09-29T20:42:12.200481] [DEBUG] [LOCAL ] PRM: Saving primary data. [2025-09-29T20:42:12.202584] [DEBUG] [LOCAL ] PRM: Trimmed 64420 records to 44611 (keeping 200 days of data) [2025-09-29T20:42:12.350373] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-06. [2025-09-29T20:42:12.526227] [DEBUG] [LOCAL ] PRM: Primary data saved (44611 records). [2025-09-29T20:42:12.526375] [INFO ] [MAIN ] PRM: Full history saved. [2025-09-29T20:42:12.526465] [INFO ] [MAIN ] Update Progress: 1732/2371 symbols completed. PRM took 29.8s. Estimated remaining: 1h 21m 58s. Rate: 7.8 symbols/min [2025-09-29T20:42:12.710637] [INFO ] [MAIN ] PRU: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:42:12.771195] [DEBUG] [LOCAL ] PRU: Loaded 52204 existing records from primary storage. [2025-09-29T20:42:12.771533] [INFO ] [MAIN ] PRU: Loaded 52204 existing records. [2025-09-29T20:42:12.956752] [WARN ] [MAIN ] PRU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:42:12.956986] [INFO ] [MAIN ] PRU: Wiping existing primary data before full refresh. [2025-09-29T20:42:12.957102] [INFO ] [LOCAL ] PRU: Starting deletion of primary data. [2025-09-29T20:42:12.957603] [DEBUG] [LOCAL ] PRU: Deleted primary data file. [2025-09-29T20:42:12.957700] [INFO ] [MAIN ] PRU: Starting full primary refresh. [2025-09-29T20:42:13.148609] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-07. [2025-09-29T20:42:13.222404] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-29T20:42:13.362430] [INFO ] [REMOTE ] PRU: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:42:13.948136] [INFO ] [REMOTE ] PRU: Fetching primary data for 2024-12. [2025-09-29T20:42:14.753213] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-05. [2025-09-29T20:42:14.768256] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-29T20:42:15.548164] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-08. [2025-09-29T20:42:15.716156] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-29T20:42:16.335906] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-29T20:42:16.348059] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-06. [2025-09-29T20:42:16.834037] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-29T20:42:17.148240] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-07. [2025-09-29T20:42:17.826667] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-29T20:42:17.948090] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-08. [2025-09-29T20:42:18.135332] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-29T20:42:18.678420] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-29T20:42:18.748147] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-09. [2025-09-29T20:42:19.548160] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-07. [2025-09-29T20:42:20.348139] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-01. [2025-09-29T20:42:20.415444] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-29T20:42:20.424997] [INFO ] [REMOTE ] PRO: Full fetch complete (51698 records). [2025-09-29T20:42:20.425232] [DEBUG] [VALIDATOR ] PRO: Validating primary data. [2025-09-29T20:42:20.877243] [DEBUG] [VALIDATOR ] PRO: All expected trading days are present. [2025-09-29T20:42:20.877365] [DEBUG] [VALIDATOR ] PRO: Primary data validation passed. [2025-09-29T20:42:20.878405] [INFO ] [MAIN ] PRO: Fetched primary data is valid. [2025-09-29T20:42:20.878472] [DEBUG] [LOCAL ] PRO: Saving primary data. [2025-09-29T20:42:20.880060] [DEBUG] [LOCAL ] PRO: Trimmed 51698 records to 38051 (keeping 200 days of data) [2025-09-29T20:42:21.139812] [DEBUG] [LOCAL ] PRO: Primary data saved (38051 records). [2025-09-29T20:42:21.140078] [INFO ] [MAIN ] PRO: Full history saved. [2025-09-29T20:42:21.140321] [INFO ] [MAIN ] Update Progress: 1733/2371 symbols completed. PRO took 29.8s. Estimated remaining: 1h 21m 50s. Rate: 7.8 symbols/min [2025-09-29T20:42:21.154134] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-09. [2025-09-29T20:42:21.379264] [INFO ] [MAIN ] PRVS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:42:21.359826] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-29T20:42:21.392282] [DEBUG] [LOCAL ] PRVS: No existing data file found in primary storage. [2025-09-29T20:42:21.392813] [WARN ] [MAIN ] PRVS: No existing data found, performing full refresh instead. [2025-09-29T20:42:21.392994] [INFO ] [MAIN ] PRVS: Wiping existing primary data before full refresh. [2025-09-29T20:42:21.393053] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-09-29T20:42:21.393113] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-09-29T20:42:21.393150] [INFO ] [MAIN ] PRVS: Starting full primary refresh. [2025-09-29T20:42:21.768403] [INFO ] [REMOTE ] PRVS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:42:21.948080] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2024-12. [2025-09-29T20:42:21.980968] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-29T20:42:21.998136] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-29T20:42:22.000043] [INFO ] [REMOTE ] PRT: Full fetch complete (9136 records). [2025-09-29T20:42:22.000118] [DEBUG] [VALIDATOR ] PRT: Validating primary data. [2025-09-29T20:42:22.366723] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-29T20:42:22.405116] [DEBUG] [VALIDATOR ] PRT: All expected trading days are present. [2025-09-29T20:42:22.405218] [DEBUG] [VALIDATOR ] PRT: Primary data validation passed. [2025-09-29T20:42:22.405629] [INFO ] [MAIN ] PRT: Fetched primary data is valid. [2025-09-29T20:42:22.405729] [DEBUG] [LOCAL ] PRT: Saving primary data. [2025-09-29T20:42:22.406346] [DEBUG] [LOCAL ] PRT: Trimmed 9136 records to 5310 (keeping 200 days of data) [2025-09-29T20:42:22.442102] [DEBUG] [LOCAL ] PRT: Primary data saved (5310 records). [2025-09-29T20:42:22.442255] [INFO ] [MAIN ] PRT: Full history saved. [2025-09-29T20:42:22.442412] [INFO ] [MAIN ] Update Progress: 1734/2371 symbols completed. PRT took 21.0s. Estimated remaining: 1h 21m 40s. Rate: 7.8 symbols/min [2025-09-29T20:42:22.626743] [INFO ] [MAIN ] PSA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:42:22.686185] [DEBUG] [LOCAL ] PSA: Loaded 42474 existing records from primary storage. [2025-09-29T20:42:22.686509] [INFO ] [MAIN ] PSA: Loaded 42474 existing records. [2025-09-29T20:42:22.753347] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-01. [2025-09-29T20:42:22.872389] [WARN ] [MAIN ] PSA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:42:22.872735] [INFO ] [MAIN ] PSA: Wiping existing primary data before full refresh. [2025-09-29T20:42:22.872829] [INFO ] [LOCAL ] PSA: Starting deletion of primary data. [2025-09-29T20:42:22.873854] [DEBUG] [LOCAL ] PSA: Deleted primary data file. [2025-09-29T20:42:22.873939] [INFO ] [MAIN ] PSA: Starting full primary refresh. [2025-09-29T20:42:23.250506] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-29T20:42:23.257321] [INFO ] [REMOTE ] PSA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:42:23.548122] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-02. [2025-09-29T20:42:24.069786] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-29T20:42:24.348129] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-03. [2025-09-29T20:42:24.637539] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-09-29T20:42:25.148126] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-04. [2025-09-29T20:42:25.481444] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-29T20:42:25.948095] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-08. [2025-09-29T20:42:26.748173] [INFO ] [REMOTE ] PSA: Fetching primary data for 2024-12. [2025-09-29T20:42:27.548072] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-02. [2025-09-29T20:42:27.804837] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-29T20:42:28.348159] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-09. [2025-09-29T20:42:28.397588] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-29T20:42:29.148121] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-01. [2025-09-29T20:42:29.237409] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-29T20:42:29.741815] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-29T20:42:29.752870] [INFO ] [REMOTE ] PRMB: Full fetch complete (76071 records). [2025-09-29T20:42:29.753040] [DEBUG] [VALIDATOR ] PRMB: Validating primary data. [2025-09-29T20:42:29.963589] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-03. [2025-09-29T20:42:30.524463] [DEBUG] [VALIDATOR ] PRMB: All expected trading days are present. [2025-09-29T20:42:30.524729] [DEBUG] [VALIDATOR ] PRMB: Primary data validation passed. [2025-09-29T20:42:30.526204] [INFO ] [MAIN ] PRMB: Fetched primary data is valid. [2025-09-29T20:42:30.526320] [DEBUG] [LOCAL ] PRMB: Saving primary data. [2025-09-29T20:42:30.528403] [DEBUG] [LOCAL ] PRMB: Trimmed 76071 records to 53145 (keeping 200 days of data) [2025-09-29T20:42:30.728072] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-29T20:42:30.749071] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-02. [2025-09-29T20:42:31.105918] [DEBUG] [LOCAL ] PRMB: Primary data saved (53145 records). [2025-09-29T20:42:31.106096] [INFO ] [MAIN ] PRMB: Full history saved. [2025-09-29T20:42:31.106229] [INFO ] [MAIN ] Update Progress: 1735/2371 symbols completed. PRMB took 46.9s. Estimated remaining: 1h 21m 33s. Rate: 7.8 symbols/min [2025-09-29T20:42:31.516521] [INFO ] [MAIN ] PSBD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:42:31.528995] [DEBUG] [LOCAL ] PSBD: Loaded 7130 existing records from primary storage. [2025-09-29T20:42:31.529246] [INFO ] [MAIN ] PSBD: Loaded 7130 existing records. [2025-09-29T20:42:31.554635] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-05. [2025-09-29T20:42:31.795734] [WARN ] [MAIN ] PSBD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:42:31.796028] [INFO ] [MAIN ] PSBD: Wiping existing primary data before full refresh. [2025-09-29T20:42:31.796201] [INFO ] [LOCAL ] PSBD: Starting deletion of primary data. [2025-09-29T20:42:31.796735] [DEBUG] [LOCAL ] PSBD: Deleted primary data file. [2025-09-29T20:42:31.796826] [INFO ] [MAIN ] PSBD: Starting full primary refresh. [2025-09-29T20:42:31.913848] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-29T20:42:32.183849] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-29T20:42:32.278396] [INFO ] [REMOTE ] PSBD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:42:32.298798] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-29T20:42:32.348051] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2024-12. [2025-09-29T20:42:33.117739] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-29T20:42:33.148077] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-03. [2025-09-29T20:42:33.948129] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-01. [2025-09-29T20:42:34.748121] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-06. [2025-09-29T20:42:34.802503] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-29T20:42:34.817911] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-29T20:42:35.054028] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-29T20:42:35.548106] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-02. [2025-09-29T20:42:36.081556] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-29T20:42:36.348114] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-04. [2025-09-29T20:42:37.148188] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-04. [2025-09-29T20:42:37.948105] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-07. [2025-09-29T20:42:38.143483] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-29T20:42:38.300930] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-29T20:42:38.748117] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-08. [2025-09-29T20:42:39.106703] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-29T20:42:39.201963] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-29T20:42:39.548148] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-05. [2025-09-29T20:42:40.348439] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-09. [2025-09-29T20:42:40.613930] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-09-29T20:42:40.614790] [INFO ] [REMOTE ] PRVS: Full fetch complete (1271 records). [2025-09-29T20:42:40.614877] [DEBUG] [VALIDATOR ] PRVS: Validating primary data. [2025-09-29T20:42:40.615303] [FATAL] [VALIDATOR ] PRVS: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T20:42:40.615392] [FATAL] [MAIN ] PRVS: Fetched primary data is invalid. Refusing to save it. [2025-09-29T20:42:40.615440] [WARN ] [MAIN ] PRVS: Deleting existing primary and derivative data due to validation failure. [2025-09-29T20:42:40.615481] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-09-29T20:42:40.615539] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-09-29T20:42:40.615589] [INFO ] [LOCAL ] PRVS: Starting deletion of derivative data. [2025-09-29T20:42:40.615683] [DEBUG] [LOCAL ] PRVS: No derivative data file found to delete. [2025-09-29T20:42:40.615771] [INFO ] [MAIN ] Update Progress: 1736/2371 symbols completed. PRVS took 19.5s. Estimated remaining: 1h 21m 26s. Rate: 7.8 symbols/min [2025-09-29T20:42:40.797476] [INFO ] [MAIN ] PSF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:42:40.810360] [DEBUG] [LOCAL ] PSF: Loaded 6990 existing records from primary storage. [2025-09-29T20:42:40.810613] [INFO ] [MAIN ] PSF: Loaded 6990 existing records. [2025-09-29T20:42:41.003301] [WARN ] [MAIN ] PSF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:42:41.003674] [INFO ] [MAIN ] PSF: Wiping existing primary data before full refresh. [2025-09-29T20:42:41.003762] [INFO ] [LOCAL ] PSF: Starting deletion of primary data. [2025-09-29T20:42:41.004091] [DEBUG] [LOCAL ] PSF: Deleted primary data file. [2025-09-29T20:42:41.004159] [INFO ] [MAIN ] PSF: Starting full primary refresh. [2025-09-29T20:42:41.155436] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-05. [2025-09-29T20:42:41.204521] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-29T20:42:41.448370] [INFO ] [REMOTE ] PSF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:42:41.948111] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-03. [2025-09-29T20:42:42.663510] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-29T20:42:42.748093] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-04. [2025-09-29T20:42:42.865631] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-29T20:42:43.549934] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-06. [2025-09-29T20:42:43.555446] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-29T20:42:44.348111] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-05. [2025-09-29T20:42:45.066813] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-29T20:42:45.148106] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-06. [2025-09-29T20:42:45.381956] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-29T20:42:45.822807] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-29T20:42:45.948107] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-07. [2025-09-29T20:42:46.514760] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-29T20:42:46.748175] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-07. [2025-09-29T20:42:47.548141] [INFO ] [REMOTE ] PSF: Fetching primary data for 2024-12. [2025-09-29T20:42:48.348114] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-08. [2025-09-29T20:42:48.644761] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-29T20:42:48.798677] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-29T20:42:48.982435] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-29T20:42:49.148132] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-01. [2025-09-29T20:42:49.781612] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-29T20:42:49.948153] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-08. [2025-09-29T20:42:50.748168] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-09. [2025-09-29T20:42:51.326338] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-29T20:42:51.328848] [INFO ] [REMOTE ] PSBD: Full fetch complete (9378 records). [2025-09-29T20:42:51.329064] [DEBUG] [VALIDATOR ] PSBD: Validating primary data. [2025-09-29T20:42:51.553469] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-06. [2025-09-29T20:42:51.726703] [DEBUG] [VALIDATOR ] PSBD: All expected trading days are present. [2025-09-29T20:42:51.726901] [DEBUG] [VALIDATOR ] PSBD: Primary data validation passed. [2025-09-29T20:42:51.727356] [INFO ] [MAIN ] PSBD: Fetched primary data is valid. [2025-09-29T20:42:51.727481] [DEBUG] [LOCAL ] PSBD: Saving primary data. [2025-09-29T20:42:51.728273] [DEBUG] [LOCAL ] PSBD: Trimmed 9378 records to 7045 (keeping 200 days of data) [2025-09-29T20:42:51.805165] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-29T20:42:51.829084] [DEBUG] [LOCAL ] PSBD: Primary data saved (7045 records). [2025-09-29T20:42:51.829235] [INFO ] [MAIN ] PSBD: Full history saved. [2025-09-29T20:42:51.829329] [INFO ] [MAIN ] Update Progress: 1737/2371 symbols completed. PSBD took 20.7s. Estimated remaining: 1h 21m 20s. Rate: 7.8 symbols/min [2025-09-29T20:42:52.018557] [INFO ] [MAIN ] PSFE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:42:52.056443] [DEBUG] [LOCAL ] PSFE: Loaded 30702 existing records from primary storage. [2025-09-29T20:42:52.056818] [INFO ] [MAIN ] PSFE: Loaded 30702 existing records. [2025-09-29T20:42:52.288992] [WARN ] [MAIN ] PSFE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:42:52.289208] [INFO ] [MAIN ] PSFE: Wiping existing primary data before full refresh. [2025-09-29T20:42:52.289257] [INFO ] [LOCAL ] PSFE: Starting deletion of primary data. [2025-09-29T20:42:52.289837] [DEBUG] [LOCAL ] PSFE: Deleted primary data file. [2025-09-29T20:42:52.289899] [INFO ] [MAIN ] PSFE: Starting full primary refresh. [2025-09-29T20:42:52.357209] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-02. [2025-09-29T20:42:52.680556] [INFO ] [REMOTE ] PSFE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:42:53.148094] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2024-12. [2025-09-29T20:42:53.186953] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-29T20:42:53.220776] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-29T20:42:53.948143] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-09. [2025-09-29T20:42:54.548949] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-29T20:42:54.748132] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-07. [2025-09-29T20:42:55.371316] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-29T20:42:55.382726] [INFO ] [REMOTE ] PRU: Full fetch complete (74293 records). [2025-09-29T20:42:55.382897] [DEBUG] [VALIDATOR ] PRU: Validating primary data. [2025-09-29T20:42:55.552989] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-01. [2025-09-29T20:42:55.824554] [DEBUG] [VALIDATOR ] PRU: All expected trading days are present. [2025-09-29T20:42:55.824699] [DEBUG] [VALIDATOR ] PRU: Primary data validation passed. [2025-09-29T20:42:55.825907] [INFO ] [MAIN ] PRU: Fetched primary data is valid. [2025-09-29T20:42:55.825980] [DEBUG] [LOCAL ] PRU: Saving primary data. [2025-09-29T20:42:55.827769] [DEBUG] [LOCAL ] PRU: Trimmed 74293 records to 51419 (keeping 200 days of data) [2025-09-29T20:42:56.181085] [DEBUG] [LOCAL ] PRU: Primary data saved (51419 records). [2025-09-29T20:42:56.181221] [INFO ] [MAIN ] PRU: Full history saved. [2025-09-29T20:42:56.181312] [INFO ] [MAIN ] Update Progress: 1738/2371 symbols completed. PRU took 43.7s. Estimated remaining: 1h 21m 11s. Rate: 7.8 symbols/min [2025-09-29T20:42:56.350186] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-03. [2025-09-29T20:42:56.372386] [INFO ] [MAIN ] PSN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:42:56.400094] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-29T20:42:56.456262] [DEBUG] [LOCAL ] PSN: Loaded 46808 existing records from primary storage. [2025-09-29T20:42:56.456575] [INFO ] [MAIN ] PSN: Loaded 46808 existing records. [2025-09-29T20:42:56.644917] [WARN ] [MAIN ] PSN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:42:56.645136] [INFO ] [MAIN ] PSN: Wiping existing primary data before full refresh. [2025-09-29T20:42:56.645266] [INFO ] [LOCAL ] PSN: Starting deletion of primary data. [2025-09-29T20:42:56.646028] [DEBUG] [LOCAL ] PSN: Deleted primary data file. [2025-09-29T20:42:56.646101] [INFO ] [MAIN ] PSN: Starting full primary refresh. [2025-09-29T20:42:56.970157] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-29T20:42:57.025767] [INFO ] [REMOTE ] PSN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:42:57.045568] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-29T20:42:57.148110] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-02. [2025-09-29T20:42:57.948145] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-04. [2025-09-29T20:42:58.546007] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-29T20:42:58.646492] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-29T20:42:58.748149] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-05. [2025-09-29T20:42:59.388776] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-29T20:42:59.548159] [INFO ] [REMOTE ] PSN: Fetching primary data for 2024-12. [2025-09-29T20:43:00.348127] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-06. [2025-09-29T20:43:01.070784] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-29T20:43:01.101341] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-29T20:43:01.148109] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-07. [2025-09-29T20:43:01.642067] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-29T20:43:01.948118] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-01. [2025-09-29T20:43:02.748169] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-08. [2025-09-29T20:43:03.548138] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-08. [2025-09-29T20:43:04.189164] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-29T20:43:04.369565] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-09. [2025-09-29T20:43:04.392970] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-09-29T20:43:04.443018] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-29T20:43:05.148079] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-03. [2025-09-29T20:43:05.234609] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-29T20:43:05.237317] [INFO ] [REMOTE ] PSF: Full fetch complete (9792 records). [2025-09-29T20:43:05.237411] [DEBUG] [VALIDATOR ] PSF: Validating primary data. [2025-09-29T20:43:05.621728] [DEBUG] [VALIDATOR ] PSF: All expected trading days are present. [2025-09-29T20:43:05.621812] [DEBUG] [VALIDATOR ] PSF: Primary data validation passed. [2025-09-29T20:43:05.622048] [INFO ] [MAIN ] PSF: Fetched primary data is valid. [2025-09-29T20:43:05.622088] [DEBUG] [LOCAL ] PSF: Saving primary data. [2025-09-29T20:43:05.622546] [DEBUG] [LOCAL ] PSF: Trimmed 9792 records to 6845 (keeping 200 days of data) [2025-09-29T20:43:05.665992] [DEBUG] [LOCAL ] PSF: Primary data saved (6845 records). [2025-09-29T20:43:05.666131] [INFO ] [MAIN ] PSF: Full history saved. [2025-09-29T20:43:05.666216] [INFO ] [MAIN ] Update Progress: 1739/2371 symbols completed. PSF took 25.1s. Estimated remaining: 1h 21m 4s. Rate: 7.8 symbols/min [2025-09-29T20:43:05.846402] [INFO ] [MAIN ] PSO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:43:05.895671] [DEBUG] [LOCAL ] PSO: Loaded 37751 existing records from primary storage. [2025-09-29T20:43:05.895992] [INFO ] [MAIN ] PSO: Loaded 37751 existing records. [2025-09-29T20:43:05.953921] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-09. [2025-09-29T20:43:06.088267] [WARN ] [MAIN ] PSO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:43:06.088501] [INFO ] [MAIN ] PSO: Wiping existing primary data before full refresh. [2025-09-29T20:43:06.088560] [INFO ] [LOCAL ] PSO: Starting deletion of primary data. [2025-09-29T20:43:06.089066] [DEBUG] [LOCAL ] PSO: Deleted primary data file. [2025-09-29T20:43:06.089126] [INFO ] [MAIN ] PSO: Starting full primary refresh. [2025-09-29T20:43:06.458004] [INFO ] [REMOTE ] PSO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:43:06.477425] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-29T20:43:06.748115] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-04. [2025-09-29T20:43:07.457565] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-29T20:43:07.467227] [INFO ] [REMOTE ] PSA: Full fetch complete (59302 records). [2025-09-29T20:43:07.467418] [DEBUG] [VALIDATOR ] PSA: Validating primary data. [2025-09-29T20:43:07.553236] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-02. [2025-09-29T20:43:07.897438] [DEBUG] [VALIDATOR ] PSA: All expected trading days are present. [2025-09-29T20:43:07.897560] [DEBUG] [VALIDATOR ] PSA: Primary data validation passed. [2025-09-29T20:43:07.898611] [INFO ] [MAIN ] PSA: Fetched primary data is valid. [2025-09-29T20:43:07.898706] [DEBUG] [LOCAL ] PSA: Saving primary data. [2025-09-29T20:43:07.900709] [DEBUG] [LOCAL ] PSA: Trimmed 59302 records to 41781 (keeping 200 days of data) [2025-09-29T20:43:08.170445] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-29T20:43:08.228070] [DEBUG] [LOCAL ] PSA: Primary data saved (41781 records). [2025-09-29T20:43:08.228222] [INFO ] [MAIN ] PSA: Full history saved. [2025-09-29T20:43:08.228324] [INFO ] [MAIN ] Update Progress: 1740/2371 symbols completed. PSA took 45.8s. Estimated remaining: 1h 20m 54s. Rate: 7.8 symbols/min [2025-09-29T20:43:08.353284] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-05. [2025-09-29T20:43:08.414209] [INFO ] [MAIN ] PSQH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:43:08.457746] [DEBUG] [LOCAL ] PSQH: Loaded 35426 existing records from primary storage. [2025-09-29T20:43:08.458066] [INFO ] [MAIN ] PSQH: Loaded 35426 existing records. [2025-09-29T20:43:08.645150] [WARN ] [MAIN ] PSQH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:43:08.645364] [INFO ] [MAIN ] PSQH: Wiping existing primary data before full refresh. [2025-09-29T20:43:08.645412] [INFO ] [LOCAL ] PSQH: Starting deletion of primary data. [2025-09-29T20:43:08.645923] [DEBUG] [LOCAL ] PSQH: Deleted primary data file. [2025-09-29T20:43:08.645983] [INFO ] [MAIN ] PSQH: Starting full primary refresh. [2025-09-29T20:43:09.014221] [INFO ] [REMOTE ] PSQH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:43:09.148100] [INFO ] [REMOTE ] PSO: Fetching primary data for 2024-12. [2025-09-29T20:43:09.279531] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-29T20:43:09.461546] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-29T20:43:09.948122] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-06. [2025-09-29T20:43:10.192363] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-29T20:43:10.748161] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-01. [2025-09-29T20:43:10.998000] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-29T20:43:11.548124] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-03. [2025-09-29T20:43:12.080346] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-29T20:43:12.348139] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-07. [2025-09-29T20:43:13.148109] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2024-12. [2025-09-29T20:43:13.286540] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-29T20:43:13.845687] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-29T20:43:13.948157] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-02. [2025-09-29T20:43:14.748185] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-08. [2025-09-29T20:43:15.184079] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-29T20:43:15.227816] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-29T20:43:15.548186] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-01. [2025-09-29T20:43:15.856419] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-29T20:43:16.348135] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-03. [2025-09-29T20:43:17.148114] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-09. [2025-09-29T20:43:17.315507] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-29T20:43:17.949285] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-04. [2025-09-29T20:43:17.960506] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-29T20:43:18.299171] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-29T20:43:18.307539] [INFO ] [REMOTE ] PSFE: Full fetch complete (43068 records). [2025-09-29T20:43:18.307722] [DEBUG] [VALIDATOR ] PSFE: Validating primary data. [2025-09-29T20:43:18.700672] [DEBUG] [VALIDATOR ] PSFE: All expected trading days are present. [2025-09-29T20:43:18.700769] [DEBUG] [VALIDATOR ] PSFE: Primary data validation passed. [2025-09-29T20:43:18.701692] [INFO ] [MAIN ] PSFE: Fetched primary data is valid. [2025-09-29T20:43:18.701756] [DEBUG] [LOCAL ] PSFE: Saving primary data. [2025-09-29T20:43:18.702883] [DEBUG] [LOCAL ] PSFE: Trimmed 43068 records to 30137 (keeping 200 days of data) [2025-09-29T20:43:18.753404] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-04. [2025-09-29T20:43:18.890068] [DEBUG] [LOCAL ] PSFE: Primary data saved (30137 records). [2025-09-29T20:43:18.890215] [INFO ] [MAIN ] PSFE: Full history saved. [2025-09-29T20:43:18.890300] [INFO ] [MAIN ] Update Progress: 1741/2371 symbols completed. PSFE took 27.1s. Estimated remaining: 1h 20m 47s. Rate: 7.8 symbols/min [2025-09-29T20:43:19.080844] [INFO ] [MAIN ] PSTG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:43:19.139523] [DEBUG] [LOCAL ] PSTG: Loaded 53626 existing records from primary storage. [2025-09-29T20:43:19.139895] [INFO ] [MAIN ] PSTG: Loaded 53626 existing records. [2025-09-29T20:43:19.337303] [WARN ] [MAIN ] PSTG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:43:19.337547] [INFO ] [MAIN ] PSTG: Wiping existing primary data before full refresh. [2025-09-29T20:43:19.337607] [INFO ] [LOCAL ] PSTG: Starting deletion of primary data. [2025-09-29T20:43:19.338488] [DEBUG] [LOCAL ] PSTG: Deleted primary data file. [2025-09-29T20:43:19.338550] [INFO ] [MAIN ] PSTG: Starting full primary refresh. [2025-09-29T20:43:19.553796] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-02. [2025-09-29T20:43:19.718578] [INFO ] [REMOTE ] PSTG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:43:19.977586] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-29T20:43:20.117118] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-29T20:43:20.348076] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-05. [2025-09-29T20:43:21.148153] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2024-12. [2025-09-29T20:43:21.262864] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-29T20:43:21.518712] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-29T20:43:21.948153] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-06. [2025-09-29T20:43:22.748127] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-05. [2025-09-29T20:43:23.304899] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-29T20:43:23.450749] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-29T20:43:23.548141] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-01. [2025-09-29T20:43:24.259463] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-29T20:43:24.348163] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-06. [2025-09-29T20:43:25.148071] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-07. [2025-09-29T20:43:25.352573] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-29T20:43:25.611415] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-29T20:43:25.948135] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-02. [2025-09-29T20:43:26.429621] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-29T20:43:26.748160] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-03. [2025-09-29T20:43:27.548107] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-07. [2025-09-29T20:43:27.738923] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-29T20:43:28.149198] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-29T20:43:28.348116] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-04. [2025-09-29T20:43:29.148117] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-08. [2025-09-29T20:43:29.218200] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-29T20:43:29.706384] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-29T20:43:29.948119] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-05. [2025-09-29T20:43:30.646334] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-29T20:43:30.748118] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-09. [2025-09-29T20:43:31.548127] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-03. [2025-09-29T20:43:31.628858] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-29T20:43:32.168754] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-29T20:43:32.175908] [INFO ] [REMOTE ] PSO: Full fetch complete (51799 records). [2025-09-29T20:43:32.176037] [DEBUG] [VALIDATOR ] PSO: Validating primary data. [2025-09-29T20:43:32.356786] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-08. [2025-09-29T20:43:32.579448] [DEBUG] [VALIDATOR ] PSO: All expected trading days are present. [2025-09-29T20:43:32.579546] [DEBUG] [VALIDATOR ] PSO: Primary data validation passed. [2025-09-29T20:43:32.580470] [INFO ] [MAIN ] PSO: Fetched primary data is valid. [2025-09-29T20:43:32.580536] [DEBUG] [LOCAL ] PSO: Saving primary data. [2025-09-29T20:43:32.581870] [DEBUG] [LOCAL ] PSO: Trimmed 51799 records to 37066 (keeping 200 days of data) [2025-09-29T20:43:32.820998] [DEBUG] [LOCAL ] PSO: Primary data saved (37066 records). [2025-09-29T20:43:32.821150] [INFO ] [MAIN ] PSO: Full history saved. [2025-09-29T20:43:32.821256] [INFO ] [MAIN ] Update Progress: 1742/2371 symbols completed. PSO took 27.2s. Estimated remaining: 1h 20m 42s. Rate: 7.8 symbols/min [2025-09-29T20:43:32.996464] [INFO ] [MAIN ] PSTL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:43:33.020358] [DEBUG] [LOCAL ] PSTL: Loaded 20585 existing records from primary storage. [2025-09-29T20:43:33.020623] [INFO ] [MAIN ] PSTL: Loaded 20585 existing records. [2025-09-29T20:43:33.160209] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-06. [2025-09-29T20:43:33.225921] [WARN ] [MAIN ] PSTL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:43:33.226327] [INFO ] [MAIN ] PSTL: Wiping existing primary data before full refresh. [2025-09-29T20:43:33.227952] [INFO ] [LOCAL ] PSTL: Starting deletion of primary data. [2025-09-29T20:43:33.228586] [DEBUG] [LOCAL ] PSTL: Deleted primary data file. [2025-09-29T20:43:33.228677] [INFO ] [MAIN ] PSTL: Starting full primary refresh. [2025-09-29T20:43:33.614137] [INFO ] [REMOTE ] PSTL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:43:33.648542] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-29T20:43:33.948093] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-04. [2025-09-29T20:43:34.047233] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-29T20:43:34.748146] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2024-12. [2025-09-29T20:43:34.798274] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-29T20:43:35.548114] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-07. [2025-09-29T20:43:35.806919] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-29T20:43:35.871435] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-29T20:43:36.348168] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-01. [2025-09-29T20:43:37.038453] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-29T20:43:37.148106] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-08. [2025-09-29T20:43:37.438292] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-29T20:43:37.948122] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-09. [2025-09-29T20:43:38.529562] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-29T20:43:38.748119] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-05. [2025-09-29T20:43:39.536600] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-29T20:43:39.547059] [INFO ] [REMOTE ] PSN: Full fetch complete (66854 records). [2025-09-29T20:43:39.547296] [DEBUG] [VALIDATOR ] PSN: Validating primary data. [2025-09-29T20:43:39.553395] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-02. [2025-09-29T20:43:39.965235] [DEBUG] [VALIDATOR ] PSN: All expected trading days are present. [2025-09-29T20:43:39.965329] [DEBUG] [VALIDATOR ] PSN: Primary data validation passed. [2025-09-29T20:43:39.966510] [INFO ] [MAIN ] PSN: Fetched primary data is valid. [2025-09-29T20:43:39.966583] [DEBUG] [LOCAL ] PSN: Saving primary data. [2025-09-29T20:43:39.968384] [DEBUG] [LOCAL ] PSN: Trimmed 66854 records to 46058 (keeping 200 days of data) [2025-09-29T20:43:40.257729] [DEBUG] [LOCAL ] PSN: Primary data saved (46058 records). [2025-09-29T20:43:40.257862] [INFO ] [MAIN ] PSN: Full history saved. [2025-09-29T20:43:40.257980] [INFO ] [MAIN ] Update Progress: 1743/2371 symbols completed. PSN took 44.1s. Estimated remaining: 1h 20m 34s. Rate: 7.8 symbols/min [2025-09-29T20:43:40.356992] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-09. [2025-09-29T20:43:40.446601] [INFO ] [MAIN ] PSX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:43:40.496302] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-29T20:43:40.560541] [DEBUG] [LOCAL ] PSX: Loaded 53912 existing records from primary storage. [2025-09-29T20:43:40.560914] [INFO ] [MAIN ] PSX: Loaded 53912 existing records. [2025-09-29T20:43:40.745293] [WARN ] [MAIN ] PSX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:43:40.745618] [INFO ] [MAIN ] PSX: Wiping existing primary data before full refresh. [2025-09-29T20:43:40.745747] [INFO ] [LOCAL ] PSX: Starting deletion of primary data. [2025-09-29T20:43:40.751542] [DEBUG] [LOCAL ] PSX: Deleted primary data file. [2025-09-29T20:43:40.758081] [INFO ] [MAIN ] PSX: Starting full primary refresh. [2025-09-29T20:43:40.830299] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-29T20:43:41.149079] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-03. [2025-09-29T20:43:41.148968] [INFO ] [REMOTE ] PSX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:43:41.926733] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-29T20:43:41.936441] [INFO ] [REMOTE ] PSQH: Full fetch complete (53739 records). [2025-09-29T20:43:41.936598] [DEBUG] [VALIDATOR ] PSQH: Validating primary data. [2025-09-29T20:43:41.953209] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-06. [2025-09-29T20:43:42.095952] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-29T20:43:42.400155] [DEBUG] [VALIDATOR ] PSQH: All expected trading days are present. [2025-09-29T20:43:42.400244] [DEBUG] [VALIDATOR ] PSQH: Primary data validation passed. [2025-09-29T20:43:42.401350] [INFO ] [MAIN ] PSQH: Fetched primary data is valid. [2025-09-29T20:43:42.401417] [DEBUG] [LOCAL ] PSQH: Saving primary data. [2025-09-29T20:43:42.403330] [DEBUG] [LOCAL ] PSQH: Trimmed 53739 records to 34827 (keeping 200 days of data) [2025-09-29T20:43:42.605146] [DEBUG] [LOCAL ] PSQH: Primary data saved (34827 records). [2025-09-29T20:43:42.605283] [INFO ] [MAIN ] PSQH: Full history saved. [2025-09-29T20:43:42.605392] [INFO ] [MAIN ] Update Progress: 1744/2371 symbols completed. PSQH took 34.4s. Estimated remaining: 1h 20m 25s. Rate: 7.8 symbols/min [2025-09-29T20:43:42.753610] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-04. [2025-09-29T20:43:42.781966] [INFO ] [MAIN ] PTA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:43:42.803018] [DEBUG] [LOCAL ] PTA: Loaded 15299 existing records from primary storage. [2025-09-29T20:43:42.803273] [INFO ] [MAIN ] PTA: Loaded 15299 existing records. [2025-09-29T20:43:42.993183] [WARN ] [MAIN ] PTA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:43:42.993409] [INFO ] [MAIN ] PTA: Wiping existing primary data before full refresh. [2025-09-29T20:43:42.993463] [INFO ] [LOCAL ] PTA: Starting deletion of primary data. [2025-09-29T20:43:42.994272] [DEBUG] [LOCAL ] PTA: Deleted primary data file. [2025-09-29T20:43:42.994335] [INFO ] [MAIN ] PTA: Starting full primary refresh. [2025-09-29T20:43:43.364009] [INFO ] [REMOTE ] PTA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:43:43.548124] [INFO ] [REMOTE ] PTA: Fetching primary data for 2024-12. [2025-09-29T20:43:43.834325] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-29T20:43:43.932063] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-29T20:43:44.348130] [INFO ] [REMOTE ] PSX: Fetching primary data for 2024-12. [2025-09-29T20:43:44.423976] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-29T20:43:45.148114] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-05. [2025-09-29T20:43:45.948086] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-07. [2025-09-29T20:43:46.124876] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-29T20:43:46.469868] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-29T20:43:46.748159] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-01. [2025-09-29T20:43:47.516888] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-29T20:43:47.548082] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-06. [2025-09-29T20:43:47.701482] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-29T20:43:48.341918] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-29T20:43:48.348055] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-07. [2025-09-29T20:43:49.148117] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-02. [2025-09-29T20:43:49.443908] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-29T20:43:49.788543] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-29T20:43:49.948151] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-08. [2025-09-29T20:43:50.748151] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-08. [2025-09-29T20:43:51.548091] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-03. [2025-09-29T20:43:51.586769] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-29T20:43:51.921794] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-29T20:43:52.348138] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-09. [2025-09-29T20:43:52.483436] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-29T20:43:53.148103] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-01. [2025-09-29T20:43:53.399936] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-29T20:43:53.404520] [INFO ] [REMOTE ] PSTL: Full fetch complete (29585 records). [2025-09-29T20:43:53.404632] [DEBUG] [VALIDATOR ] PSTL: Validating primary data. [2025-09-29T20:43:53.850211] [DEBUG] [VALIDATOR ] PSTL: All expected trading days are present. [2025-09-29T20:43:53.850301] [DEBUG] [VALIDATOR ] PSTL: Primary data validation passed. [2025-09-29T20:43:53.850953] [INFO ] [MAIN ] PSTL: Fetched primary data is valid. [2025-09-29T20:43:53.851018] [DEBUG] [LOCAL ] PSTL: Saving primary data. [2025-09-29T20:43:53.851877] [DEBUG] [LOCAL ] PSTL: Trimmed 29585 records to 20077 (keeping 200 days of data) [2025-09-29T20:43:53.950291] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-04. [2025-09-29T20:43:53.993075] [DEBUG] [LOCAL ] PSTL: Primary data saved (20077 records). [2025-09-29T20:43:53.993217] [INFO ] [MAIN ] PSTL: Full history saved. [2025-09-29T20:43:53.993326] [INFO ] [MAIN ] Update Progress: 1745/2371 symbols completed. PSTL took 21.2s. Estimated remaining: 1h 20m 18s. Rate: 7.8 symbols/min [2025-09-29T20:43:54.178282] [INFO ] [MAIN ] PTY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:43:54.222056] [DEBUG] [LOCAL ] PTY: Loaded 37902 existing records from primary storage. [2025-09-29T20:43:54.222385] [INFO ] [MAIN ] PTY: Loaded 37902 existing records. [2025-09-29T20:43:54.421034] [WARN ] [MAIN ] PTY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:43:54.421254] [INFO ] [MAIN ] PTY: Wiping existing primary data before full refresh. [2025-09-29T20:43:54.421302] [INFO ] [LOCAL ] PTY: Starting deletion of primary data. [2025-09-29T20:43:54.421787] [DEBUG] [LOCAL ] PTY: Deleted primary data file. [2025-09-29T20:43:54.421867] [INFO ] [MAIN ] PTY: Starting full primary refresh. [2025-09-29T20:43:54.748095] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-09. [2025-09-29T20:43:54.848685] [INFO ] [REMOTE ] PTY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:43:54.962856] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-29T20:43:55.081559] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-29T20:43:55.548157] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-02. [2025-09-29T20:43:56.343869] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-29T20:43:56.353903] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-05. [2025-09-29T20:43:56.356465] [INFO ] [REMOTE ] PSTG: Full fetch complete (76546 records). [2025-09-29T20:43:56.356602] [DEBUG] [VALIDATOR ] PSTG: Validating primary data. [2025-09-29T20:43:56.766631] [DEBUG] [VALIDATOR ] PSTG: All expected trading days are present. [2025-09-29T20:43:56.766768] [DEBUG] [VALIDATOR ] PSTG: Primary data validation passed. [2025-09-29T20:43:56.767922] [INFO ] [MAIN ] PSTG: Fetched primary data is valid. [2025-09-29T20:43:56.767994] [DEBUG] [LOCAL ] PSTG: Saving primary data. [2025-09-29T20:43:56.769437] [DEBUG] [LOCAL ] PSTG: Trimmed 76546 records to 52845 (keeping 200 days of data) [2025-09-29T20:43:57.090938] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-29T20:43:57.114287] [DEBUG] [LOCAL ] PSTG: Primary data saved (52845 records). [2025-09-29T20:43:57.114435] [INFO ] [MAIN ] PSTG: Full history saved. [2025-09-29T20:43:57.114597] [INFO ] [MAIN ] Update Progress: 1746/2371 symbols completed. PSTG took 38.2s. Estimated remaining: 1h 20m 9s. Rate: 7.8 symbols/min [2025-09-29T20:43:57.149615] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-06. [2025-09-29T20:43:57.296219] [INFO ] [MAIN ] PUK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:43:57.343718] [DEBUG] [LOCAL ] PUK: Loaded 45565 existing records from primary storage. [2025-09-29T20:43:57.344055] [INFO ] [MAIN ] PUK: Loaded 45565 existing records. [2025-09-29T20:43:57.539171] [WARN ] [MAIN ] PUK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:43:57.539606] [INFO ] [MAIN ] PUK: Wiping existing primary data before full refresh. [2025-09-29T20:43:57.539779] [INFO ] [LOCAL ] PUK: Starting deletion of primary data. [2025-09-29T20:43:57.549759] [DEBUG] [LOCAL ] PUK: Deleted primary data file. [2025-09-29T20:43:57.566557] [INFO ] [MAIN ] PUK: Starting full primary refresh. [2025-09-29T20:43:57.641368] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-29T20:43:57.958768] [INFO ] [REMOTE ] PTY: Fetching primary data for 2024-12. [2025-09-29T20:43:57.980294] [INFO ] [REMOTE ] PUK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:43:58.187030] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-29T20:43:58.748144] [INFO ] [REMOTE ] PUK: Fetching primary data for 2024-12. [2025-09-29T20:43:59.491170] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-29T20:43:59.548085] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-01. [2025-09-29T20:44:00.346792] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-29T20:44:00.355514] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-03. [2025-09-29T20:44:01.148087] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-07. [2025-09-29T20:44:01.289720] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-29T20:44:01.932858] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-29T20:44:01.948073] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-04. [2025-09-29T20:44:01.979035] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-29T20:44:02.748099] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-02. [2025-09-29T20:44:03.548167] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-08. [2025-09-29T20:44:04.021446] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-29T20:44:04.077020] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-29T20:44:04.167366] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-29T20:44:04.348128] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-03. [2025-09-29T20:44:05.148108] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-05. [2025-09-29T20:44:05.600856] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-29T20:44:05.948154] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-09. [2025-09-29T20:44:06.748284] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-01. [2025-09-29T20:44:06.946058] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-29T20:44:06.951631] [INFO ] [REMOTE ] PTA: Full fetch complete (23514 records). [2025-09-29T20:44:06.951825] [DEBUG] [VALIDATOR ] PTA: Validating primary data. [2025-09-29T20:44:07.384431] [DEBUG] [VALIDATOR ] PTA: All expected trading days are present. [2025-09-29T20:44:07.384611] [DEBUG] [VALIDATOR ] PTA: Primary data validation passed. [2025-09-29T20:44:07.385623] [INFO ] [MAIN ] PTA: Fetched primary data is valid. [2025-09-29T20:44:07.385863] [DEBUG] [LOCAL ] PTA: Saving primary data. [2025-09-29T20:44:07.399525] [DEBUG] [LOCAL ] PTA: Trimmed 23514 records to 14948 (keeping 200 days of data) [2025-09-29T20:44:07.425403] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-29T20:44:07.548356] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-06. [2025-09-29T20:44:07.578143] [DEBUG] [LOCAL ] PTA: Primary data saved (14948 records). [2025-09-29T20:44:07.578311] [INFO ] [MAIN ] PTA: Full history saved. [2025-09-29T20:44:07.578419] [INFO ] [MAIN ] Update Progress: 1747/2371 symbols completed. PTA took 25.0s. Estimated remaining: 1h 20m 2s. Rate: 7.8 symbols/min [2025-09-29T20:44:07.797046] [INFO ] [MAIN ] PUMP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:44:07.870763] [DEBUG] [LOCAL ] PUMP: Loaded 50160 existing records from primary storage. [2025-09-29T20:44:07.871279] [INFO ] [MAIN ] PUMP: Loaded 50160 existing records. [2025-09-29T20:44:08.175192] [WARN ] [MAIN ] PUMP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:44:08.175620] [INFO ] [MAIN ] PUMP: Wiping existing primary data before full refresh. [2025-09-29T20:44:08.175733] [INFO ] [LOCAL ] PUMP: Starting deletion of primary data. [2025-09-29T20:44:08.176383] [DEBUG] [LOCAL ] PUMP: Deleted primary data file. [2025-09-29T20:44:08.176463] [INFO ] [MAIN ] PUMP: Starting full primary refresh. [2025-09-29T20:44:08.372589] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-04. [2025-09-29T20:44:08.675391] [INFO ] [REMOTE ] PUMP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:44:08.711200] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-29T20:44:09.148079] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2024-12. [2025-09-29T20:44:09.351904] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-29T20:44:09.863686] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-29T20:44:09.948165] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-07. [2025-09-29T20:44:10.651463] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-29T20:44:10.748174] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-01. [2025-09-29T20:44:11.548136] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-02. [2025-09-29T20:44:11.867579] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-29T20:44:11.979150] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-29T20:44:12.348142] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-02. [2025-09-29T20:44:13.148100] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-05. [2025-09-29T20:44:13.236945] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-29T20:44:13.948179] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-03. [2025-09-29T20:44:14.158987] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-29T20:44:14.678154] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-29T20:44:14.748096] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-03. [2025-09-29T20:44:15.548128] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-08. [2025-09-29T20:44:15.889369] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-29T20:44:16.336438] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-29T20:44:16.348075] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-04. [2025-09-29T20:44:17.148130] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-04. [2025-09-29T20:44:17.468592] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-29T20:44:17.948144] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-09. [2025-09-29T20:44:18.200573] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-29T20:44:18.629519] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-29T20:44:18.748141] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-06. [2025-09-29T20:44:19.548092] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-05. [2025-09-29T20:44:19.886814] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-29T20:44:19.897927] [INFO ] [REMOTE ] PSX: Full fetch complete (77059 records). [2025-09-29T20:44:19.898093] [DEBUG] [VALIDATOR ] PSX: Validating primary data. [2025-09-29T20:44:20.330829] [DEBUG] [VALIDATOR ] PSX: All expected trading days are present. [2025-09-29T20:44:20.331048] [DEBUG] [VALIDATOR ] PSX: Primary data validation passed. [2025-09-29T20:44:20.332439] [INFO ] [MAIN ] PSX: Fetched primary data is valid. [2025-09-29T20:44:20.341794] [DEBUG] [LOCAL ] PSX: Saving primary data. [2025-09-29T20:44:20.353512] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-05. [2025-09-29T20:44:20.360395] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-29T20:44:20.369454] [DEBUG] [LOCAL ] PSX: Trimmed 77059 records to 53131 (keeping 200 days of data) [2025-09-29T20:44:20.732004] [DEBUG] [LOCAL ] PSX: Primary data saved (53131 records). [2025-09-29T20:44:20.732177] [INFO ] [MAIN ] PSX: Full history saved. [2025-09-29T20:44:20.732297] [INFO ] [MAIN ] Update Progress: 1748/2371 symbols completed. PSX took 40.5s. Estimated remaining: 1h 19m 56s. Rate: 7.8 symbols/min [2025-09-29T20:44:20.921798] [INFO ] [MAIN ] PVH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:44:20.981200] [DEBUG] [LOCAL ] PVH: Loaded 51137 existing records from primary storage. [2025-09-29T20:44:20.981615] [INFO ] [MAIN ] PVH: Loaded 51137 existing records. [2025-09-29T20:44:21.167823] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-07. [2025-09-29T20:44:21.194084] [WARN ] [MAIN ] PVH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:44:21.195959] [INFO ] [MAIN ] PVH: Wiping existing primary data before full refresh. [2025-09-29T20:44:21.196096] [INFO ] [LOCAL ] PVH: Starting deletion of primary data. [2025-09-29T20:44:21.197055] [DEBUG] [LOCAL ] PVH: Deleted primary data file. [2025-09-29T20:44:21.197249] [INFO ] [MAIN ] PVH: Starting full primary refresh. [2025-09-29T20:44:21.429199] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-29T20:44:21.643571] [INFO ] [REMOTE ] PVH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:44:21.948133] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-06. [2025-09-29T20:44:22.014745] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-29T20:44:22.748092] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-06. [2025-09-29T20:44:22.793303] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-29T20:44:23.548126] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-08. [2025-09-29T20:44:23.623222] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-29T20:44:24.113830] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-29T20:44:24.348134] [INFO ] [REMOTE ] PVH: Fetching primary data for 2024-12. [2025-09-29T20:44:24.664284] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-29T20:44:25.148107] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-09. [2025-09-29T20:44:25.737463] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-29T20:44:25.948114] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-07. [2025-09-29T20:44:26.642824] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-29T20:44:26.651044] [INFO ] [REMOTE ] PTY: Full fetch complete (53815 records). [2025-09-29T20:44:26.651208] [DEBUG] [VALIDATOR ] PTY: Validating primary data. [2025-09-29T20:44:26.755418] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-01. [2025-09-29T20:44:27.068286] [DEBUG] [VALIDATOR ] PTY: All expected trading days are present. [2025-09-29T20:44:27.068374] [DEBUG] [VALIDATOR ] PTY: Primary data validation passed. [2025-09-29T20:44:27.069455] [INFO ] [MAIN ] PTY: Fetched primary data is valid. [2025-09-29T20:44:27.069536] [DEBUG] [LOCAL ] PTY: Saving primary data. [2025-09-29T20:44:27.070826] [DEBUG] [LOCAL ] PTY: Trimmed 53815 records to 37300 (keeping 200 days of data) [2025-09-29T20:44:27.315415] [DEBUG] [LOCAL ] PTY: Primary data saved (37300 records). [2025-09-29T20:44:27.315576] [INFO ] [MAIN ] PTY: Full history saved. [2025-09-29T20:44:27.315705] [INFO ] [MAIN ] Update Progress: 1749/2371 symbols completed. PTY took 33.3s. Estimated remaining: 1h 19m 48s. Rate: 7.8 symbols/min [2025-09-29T20:44:27.490698] [INFO ] [MAIN ] PVL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:44:27.500713] [DEBUG] [LOCAL ] PVL: Loaded 4819 existing records from primary storage. [2025-09-29T20:44:27.500967] [INFO ] [MAIN ] PVL: Loaded 4819 existing records. [2025-09-29T20:44:27.559797] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-07. [2025-09-29T20:44:27.698563] [WARN ] [MAIN ] PVL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:44:27.698950] [INFO ] [MAIN ] PVL: Wiping existing primary data before full refresh. [2025-09-29T20:44:27.699108] [INFO ] [LOCAL ] PVL: Starting deletion of primary data. [2025-09-29T20:44:27.699464] [DEBUG] [LOCAL ] PVL: Deleted primary data file. [2025-09-29T20:44:27.699625] [INFO ] [MAIN ] PVL: Starting full primary refresh. [2025-09-29T20:44:28.027695] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-29T20:44:28.125158] [INFO ] [REMOTE ] PVL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:44:28.348107] [INFO ] [REMOTE ] PVL: Fetching primary data for 2024-12. [2025-09-29T20:44:28.892385] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-09-29T20:44:29.152457] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-02. [2025-09-29T20:44:29.153375] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-29T20:44:29.578139] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-29T20:44:29.948123] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-08. [2025-09-29T20:44:30.748145] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-01. [2025-09-29T20:44:30.812407] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-29T20:44:31.432740] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-29T20:44:31.548150] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-02. [2025-09-29T20:44:31.717216] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-29T20:44:32.281488] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-29T20:44:32.348127] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-09. [2025-09-29T20:44:33.148098] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-03. [2025-09-29T20:44:33.900107] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-29T20:44:33.948089] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-03. [2025-09-29T20:44:34.054665] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-29T20:44:34.065174] [INFO ] [REMOTE ] PUMP: Full fetch complete (71854 records). [2025-09-29T20:44:34.065343] [DEBUG] [VALIDATOR ] PUMP: Validating primary data. [2025-09-29T20:44:34.501334] [DEBUG] [VALIDATOR ] PUMP: All expected trading days are present. [2025-09-29T20:44:34.501456] [DEBUG] [VALIDATOR ] PUMP: Primary data validation passed. [2025-09-29T20:44:34.502761] [INFO ] [MAIN ] PUMP: Fetched primary data is valid. [2025-09-29T20:44:34.502846] [DEBUG] [LOCAL ] PUMP: Saving primary data. [2025-09-29T20:44:34.504496] [DEBUG] [LOCAL ] PUMP: Trimmed 71854 records to 49364 (keeping 200 days of data) [2025-09-29T20:44:34.757013] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-04. [2025-09-29T20:44:34.792871] [DEBUG] [LOCAL ] PUMP: Primary data saved (49364 records). [2025-09-29T20:44:34.793007] [INFO ] [MAIN ] PUMP: Full history saved. [2025-09-29T20:44:34.793158] [INFO ] [MAIN ] Update Progress: 1750/2371 symbols completed. PUMP took 27.2s. Estimated remaining: 1h 19m 41s. Rate: 7.8 symbols/min [2025-09-29T20:44:34.966792] [INFO ] [MAIN ] PWR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:44:35.022498] [DEBUG] [LOCAL ] PWR: Loaded 48047 existing records from primary storage. [2025-09-29T20:44:35.022909] [INFO ] [MAIN ] PWR: Loaded 48047 existing records. [2025-09-29T20:44:35.212025] [WARN ] [MAIN ] PWR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:44:35.212575] [INFO ] [MAIN ] PWR: Wiping existing primary data before full refresh. [2025-09-29T20:44:35.212788] [INFO ] [LOCAL ] PWR: Starting deletion of primary data. [2025-09-29T20:44:35.217561] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-29T20:44:35.217961] [DEBUG] [LOCAL ] PWR: Deleted primary data file. [2025-09-29T20:44:35.219447] [INFO ] [MAIN ] PWR: Starting full primary refresh. [2025-09-29T20:44:35.549948] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-08. [2025-09-29T20:44:35.628110] [INFO ] [REMOTE ] PWR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:44:35.745167] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-29T20:44:36.348117] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-05. [2025-09-29T20:44:36.993313] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-29T20:44:37.148149] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-06. [2025-09-29T20:44:37.271057] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-29T20:44:37.915455] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-29T20:44:37.948072] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-07. [2025-09-29T20:44:38.423898] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-29T20:44:38.748112] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-08. [2025-09-29T20:44:39.389161] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-29T20:44:39.548118] [INFO ] [REMOTE ] PWR: Fetching primary data for 2024-12. [2025-09-29T20:44:40.348128] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-09. [2025-09-29T20:44:41.061715] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-29T20:44:41.063323] [INFO ] [REMOTE ] PVL: Full fetch complete (7559 records). [2025-09-29T20:44:41.063401] [DEBUG] [VALIDATOR ] PVL: Validating primary data. [2025-09-29T20:44:41.153195] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-09. [2025-09-29T20:44:41.387976] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-29T20:44:41.480730] [DEBUG] [VALIDATOR ] PVL: All expected trading days are present. [2025-09-29T20:44:41.480822] [DEBUG] [VALIDATOR ] PVL: Primary data validation passed. [2025-09-29T20:44:41.481090] [INFO ] [MAIN ] PVL: Fetched primary data is valid. [2025-09-29T20:44:41.481136] [DEBUG] [LOCAL ] PVL: Saving primary data. [2025-09-29T20:44:41.481554] [DEBUG] [LOCAL ] PVL: Trimmed 7559 records to 4750 (keeping 200 days of data) [2025-09-29T20:44:41.509998] [DEBUG] [LOCAL ] PVL: Primary data saved (4750 records). [2025-09-29T20:44:41.510131] [INFO ] [MAIN ] PVL: Full history saved. [2025-09-29T20:44:41.510221] [INFO ] [MAIN ] Update Progress: 1751/2371 symbols completed. PVL took 14.2s. Estimated remaining: 1h 19m 33s. Rate: 7.8 symbols/min [2025-09-29T20:44:41.692484] [INFO ] [MAIN ] PX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:44:41.729592] [DEBUG] [LOCAL ] PX: Loaded 35085 existing records from primary storage. [2025-09-29T20:44:41.729932] [INFO ] [MAIN ] PX: Loaded 35085 existing records. [2025-09-29T20:44:41.912159] [WARN ] [MAIN ] PX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:44:41.912384] [INFO ] [MAIN ] PX: Wiping existing primary data before full refresh. [2025-09-29T20:44:41.912437] [INFO ] [LOCAL ] PX: Starting deletion of primary data. [2025-09-29T20:44:41.912909] [DEBUG] [LOCAL ] PX: Deleted primary data file. [2025-09-29T20:44:41.912969] [INFO ] [MAIN ] PX: Starting full primary refresh. [2025-09-29T20:44:41.954411] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-01. [2025-09-29T20:44:42.289037] [INFO ] [REMOTE ] PX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:44:42.748132] [INFO ] [REMOTE ] PX: Fetching primary data for 2024-12. [2025-09-29T20:44:42.878310] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-29T20:44:42.888108] [INFO ] [REMOTE ] PUK: Full fetch complete (65157 records). [2025-09-29T20:44:42.888267] [DEBUG] [VALIDATOR ] PUK: Validating primary data. [2025-09-29T20:44:43.304953] [DEBUG] [VALIDATOR ] PUK: All expected trading days are present. [2025-09-29T20:44:43.305057] [DEBUG] [VALIDATOR ] PUK: Primary data validation passed. [2025-09-29T20:44:43.306205] [INFO ] [MAIN ] PUK: Fetched primary data is valid. [2025-09-29T20:44:43.306271] [DEBUG] [LOCAL ] PUK: Saving primary data. [2025-09-29T20:44:43.307853] [DEBUG] [LOCAL ] PUK: Trimmed 65157 records to 44780 (keeping 200 days of data) [2025-09-29T20:44:43.549573] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-04. [2025-09-29T20:44:43.613350] [DEBUG] [LOCAL ] PUK: Primary data saved (44780 records). [2025-09-29T20:44:43.613574] [INFO ] [MAIN ] PUK: Full history saved. [2025-09-29T20:44:43.613708] [INFO ] [MAIN ] Update Progress: 1752/2371 symbols completed. PUK took 46.5s. Estimated remaining: 1h 19m 23s. Rate: 7.8 symbols/min [2025-09-29T20:44:43.828121] [INFO ] [MAIN ] QBTS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:44:43.844692] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-29T20:44:43.920694] [DEBUG] [LOCAL ] QBTS: Loaded 54526 existing records from primary storage. [2025-09-29T20:44:43.921106] [INFO ] [MAIN ] QBTS: Loaded 54526 existing records. [2025-09-29T20:44:44.114971] [WARN ] [MAIN ] QBTS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:44:44.115360] [INFO ] [MAIN ] QBTS: Wiping existing primary data before full refresh. [2025-09-29T20:44:44.115420] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-09-29T20:44:44.116207] [DEBUG] [LOCAL ] QBTS: Deleted primary data file. [2025-09-29T20:44:44.116271] [INFO ] [MAIN ] QBTS: Starting full primary refresh. [2025-09-29T20:44:44.354191] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-02. [2025-09-29T20:44:44.492608] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-29T20:44:44.522635] [INFO ] [REMOTE ] QBTS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:44:45.149180] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2024-12. [2025-09-29T20:44:45.162957] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-29T20:44:45.948075] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-01. [2025-09-29T20:44:46.299086] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-29T20:44:46.748159] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-03. [2025-09-29T20:44:47.375001] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-29T20:44:47.548153] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-05. [2025-09-29T20:44:47.855675] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2024-12 (2.71 seconds). [2025-09-29T20:44:48.348130] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-01. [2025-09-29T20:44:48.781032] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-29T20:44:49.148091] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-02. [2025-09-29T20:44:49.403901] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-29T20:44:49.948162] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-04. [2025-09-29T20:44:50.165325] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-29T20:44:50.748137] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-06. [2025-09-29T20:44:51.062344] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-01 (2.71 seconds). [2025-09-29T20:44:51.548157] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-02. [2025-09-29T20:44:51.962767] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-29T20:44:52.348160] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-03. [2025-09-29T20:44:52.722450] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-29T20:44:53.148098] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-07. [2025-09-29T20:44:53.828093] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-29T20:44:53.948102] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-05. [2025-09-29T20:44:54.004698] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-09-29T20:44:54.748128] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-03. [2025-09-29T20:44:54.962458] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-29T20:44:55.500515] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-29T20:44:55.548102] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-06. [2025-09-29T20:44:56.348125] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-08. [2025-09-29T20:44:57.148090] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-04. [2025-09-29T20:44:57.303272] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-29T20:44:57.528203] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-03 (2.78 seconds). [2025-09-29T20:44:57.860937] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-29T20:44:57.948159] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-09. [2025-09-29T20:44:58.368798] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-29T20:44:58.748130] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-05. [2025-09-29T20:44:59.235321] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-29T20:44:59.245731] [INFO ] [REMOTE ] PVH: Full fetch complete (70697 records). [2025-09-29T20:44:59.245909] [DEBUG] [VALIDATOR ] PVH: Validating primary data. [2025-09-29T20:44:59.557224] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-04. [2025-09-29T20:44:59.660481] [DEBUG] [VALIDATOR ] PVH: All expected trading days are present. [2025-09-29T20:44:59.660668] [DEBUG] [VALIDATOR ] PVH: Primary data validation passed. [2025-09-29T20:44:59.662061] [INFO ] [MAIN ] PVH: Fetched primary data is valid. [2025-09-29T20:44:59.662282] [DEBUG] [LOCAL ] PVH: Saving primary data. [2025-09-29T20:44:59.664169] [DEBUG] [LOCAL ] PVH: Trimmed 70697 records to 50416 (keeping 200 days of data) [2025-09-29T20:44:59.781699] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-29T20:45:00.019305] [DEBUG] [LOCAL ] PVH: Primary data saved (50416 records). [2025-09-29T20:45:00.019465] [INFO ] [MAIN ] PVH: Full history saved. [2025-09-29T20:45:00.019607] [INFO ] [MAIN ] Update Progress: 1753/2371 symbols completed. PVH took 39.3s. Estimated remaining: 1h 19m 18s. Rate: 7.8 symbols/min [2025-09-29T20:45:00.265331] [INFO ] [MAIN ] QD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:45:00.297149] [DEBUG] [LOCAL ] QD: Loaded 28475 existing records from primary storage. [2025-09-29T20:45:00.297484] [INFO ] [MAIN ] QD: Loaded 28475 existing records. [2025-09-29T20:45:00.353334] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-07. [2025-09-29T20:45:00.512699] [WARN ] [MAIN ] QD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:45:00.513016] [INFO ] [MAIN ] QD: Wiping existing primary data before full refresh. [2025-09-29T20:45:00.513071] [INFO ] [LOCAL ] QD: Starting deletion of primary data. [2025-09-29T20:45:00.513418] [DEBUG] [LOCAL ] QD: Deleted primary data file. [2025-09-29T20:45:00.513487] [INFO ] [MAIN ] QD: Starting full primary refresh. [2025-09-29T20:45:01.041916] [INFO ] [REMOTE ] QD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:45:01.148186] [INFO ] [REMOTE ] QD: Fetching primary data for 2024-12. [2025-09-29T20:45:01.948097] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-06. [2025-09-29T20:45:02.373353] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-29T20:45:02.418327] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-04 (2.86 seconds). [2025-09-29T20:45:02.458490] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-29T20:45:02.748151] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-05. [2025-09-29T20:45:03.404996] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-29T20:45:03.548171] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-01. [2025-09-29T20:45:04.348124] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-07. [2025-09-29T20:45:04.683168] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-29T20:45:05.148106] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-08. [2025-09-29T20:45:05.256041] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-09-29T20:45:05.948103] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-06. [2025-09-29T20:45:05.987449] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-29T20:45:06.636743] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-29T20:45:06.748144] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-08. [2025-09-29T20:45:07.548166] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-09. [2025-09-29T20:45:08.265286] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-29T20:45:08.348129] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-09. [2025-09-29T20:45:08.529272] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-06 (2.58 seconds). [2025-09-29T20:45:09.148099] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-07. [2025-09-29T20:45:09.582014] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-29T20:45:09.588756] [INFO ] [REMOTE ] PX: Full fetch complete (51012 records). [2025-09-29T20:45:09.588926] [DEBUG] [VALIDATOR ] PX: Validating primary data. [2025-09-29T20:45:09.956061] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-02. [2025-09-29T20:45:09.940515] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-09-29T20:45:10.016378] [INFO ] [REMOTE ] PWR: Full fetch complete (69048 records). [2025-09-29T20:45:10.054438] [DEBUG] [VALIDATOR ] PWR: Validating primary data. [2025-09-29T20:45:10.153767] [DEBUG] [VALIDATOR ] PX: All expected trading days are present. [2025-09-29T20:45:10.165591] [DEBUG] [VALIDATOR ] PX: Primary data validation passed. [2025-09-29T20:45:10.190027] [INFO ] [MAIN ] PX: Fetched primary data is valid. [2025-09-29T20:45:10.195936] [DEBUG] [LOCAL ] PX: Saving primary data. [2025-09-29T20:45:10.253217] [DEBUG] [LOCAL ] PX: Trimmed 51012 records to 34549 (keeping 200 days of data) [2025-09-29T20:45:10.612768] [DEBUG] [VALIDATOR ] PWR: All expected trading days are present. [2025-09-29T20:45:10.613718] [DEBUG] [VALIDATOR ] PWR: Primary data validation passed. [2025-09-29T20:45:10.615909] [INFO ] [MAIN ] PWR: Fetched primary data is valid. [2025-09-29T20:45:10.616028] [DEBUG] [LOCAL ] PWR: Saving primary data. [2025-09-29T20:45:10.620446] [DEBUG] [LOCAL ] PWR: Trimmed 69048 records to 47204 (keeping 200 days of data) [2025-09-29T20:45:10.964681] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-29T20:45:10.976826] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-03. [2025-09-29T20:45:11.005930] [DEBUG] [LOCAL ] PX: Primary data saved (34549 records). [2025-09-29T20:45:11.006869] [INFO ] [MAIN ] PX: Full history saved. [2025-09-29T20:45:11.007411] [INFO ] [MAIN ] Update Progress: 1754/2371 symbols completed. PX took 29.5s. Estimated remaining: 1h 19m 12s. Rate: 7.8 symbols/min [2025-09-29T20:45:11.196964] [INFO ] [MAIN ] QGEN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:45:11.269423] [DEBUG] [LOCAL ] PWR: Primary data saved (47204 records). [2025-09-29T20:45:11.269739] [INFO ] [MAIN ] PWR: Full history saved. [2025-09-29T20:45:11.269863] [INFO ] [MAIN ] Update Progress: 1755/2371 symbols completed. PWR took 36.5s. Estimated remaining: 1h 19m 1s. Rate: 7.8 symbols/min [2025-09-29T20:45:11.457155] [DEBUG] [LOCAL ] QGEN: Loaded 49874 existing records from primary storage. [2025-09-29T20:45:11.472601] [INFO ] [MAIN ] QGEN: Loaded 49874 existing records. [2025-09-29T20:45:11.566337] [INFO ] [MAIN ] QS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:45:11.682713] [WARN ] [MAIN ] QGEN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:45:11.683518] [INFO ] [MAIN ] QGEN: Wiping existing primary data before full refresh. [2025-09-29T20:45:11.683715] [INFO ] [LOCAL ] QGEN: Starting deletion of primary data. [2025-09-29T20:45:11.684377] [DEBUG] [LOCAL ] QGEN: Deleted primary data file. [2025-09-29T20:45:11.684755] [INFO ] [MAIN ] QGEN: Starting full primary refresh. [2025-09-29T20:45:12.017978] [DEBUG] [LOCAL ] QS: Loaded 54522 existing records from primary storage. [2025-09-29T20:45:12.037508] [INFO ] [MAIN ] QS: Loaded 54522 existing records. [2025-09-29T20:45:12.213297] [INFO ] [REMOTE ] QGEN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:45:12.222908] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2024-12. [2025-09-29T20:45:12.329138] [WARN ] [MAIN ] QS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:45:12.374419] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-29T20:45:12.373128] [INFO ] [MAIN ] QS: Wiping existing primary data before full refresh. [2025-09-29T20:45:12.378106] [INFO ] [LOCAL ] QS: Starting deletion of primary data. [2025-09-29T20:45:12.385391] [DEBUG] [LOCAL ] QS: Deleted primary data file. [2025-09-29T20:45:12.387768] [INFO ] [MAIN ] QS: Starting full primary refresh. [2025-09-29T20:45:12.387639] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-07 (3.24 seconds). [2025-09-29T20:45:12.388430] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-04. [2025-09-29T20:45:12.775622] [INFO ] [REMOTE ] QS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:45:13.148121] [INFO ] [REMOTE ] QS: Fetching primary data for 2024-12. [2025-09-29T20:45:13.628787] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-29T20:45:13.944175] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-29T20:45:13.953434] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-08. [2025-09-29T20:45:14.748200] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-05. [2025-09-29T20:45:15.469607] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-09-29T20:45:15.548072] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-01. [2025-09-29T20:45:16.074565] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-29T20:45:16.348087] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-06. [2025-09-29T20:45:16.480070] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-09-29T20:45:17.148139] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-09. [2025-09-29T20:45:17.510228] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-29T20:45:17.771585] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-09-29T20:45:17.948104] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-01. [2025-09-29T20:45:18.087969] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-29T20:45:18.099071] [INFO ] [REMOTE ] QBTS: Full fetch complete (77533 records). [2025-09-29T20:45:18.099227] [DEBUG] [VALIDATOR ] QBTS: Validating primary data. [2025-09-29T20:45:18.100116] [FATAL] [VALIDATOR ] QBTS: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T20:45:18.100210] [FATAL] [MAIN ] QBTS: Fetched primary data is invalid. Refusing to save it. [2025-09-29T20:45:18.100257] [WARN ] [MAIN ] QBTS: Deleting existing primary and derivative data due to validation failure. [2025-09-29T20:45:18.100298] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-09-29T20:45:18.100359] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-09-29T20:45:18.100397] [INFO ] [LOCAL ] QBTS: Starting deletion of derivative data. [2025-09-29T20:45:18.101197] [DEBUG] [LOCAL ] QBTS: Deleted derivative data file. [2025-09-29T20:45:18.101301] [INFO ] [MAIN ] Update Progress: 1756/2371 symbols completed. QBTS took 34.5s. Estimated remaining: 1h 18m 53s. Rate: 7.8 symbols/min [2025-09-29T20:45:18.275925] [INFO ] [MAIN ] QSR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:45:18.330628] [DEBUG] [LOCAL ] QSR: Loaded 53178 existing records from primary storage. [2025-09-29T20:45:18.330990] [INFO ] [MAIN ] QSR: Loaded 53178 existing records. [2025-09-29T20:45:18.518374] [WARN ] [MAIN ] QSR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:45:18.518605] [INFO ] [MAIN ] QSR: Wiping existing primary data before full refresh. [2025-09-29T20:45:18.518689] [INFO ] [LOCAL ] QSR: Starting deletion of primary data. [2025-09-29T20:45:18.519158] [DEBUG] [LOCAL ] QSR: Deleted primary data file. [2025-09-29T20:45:18.519219] [INFO ] [MAIN ] QSR: Starting full primary refresh. [2025-09-29T20:45:18.756042] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-07. [2025-09-29T20:45:18.908801] [INFO ] [REMOTE ] QSR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:45:19.380948] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-29T20:45:19.548121] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-02. [2025-09-29T20:45:19.977292] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-29T20:45:20.348152] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-08. [2025-09-29T20:45:21.148168] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-02. [2025-09-29T20:45:21.213478] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-29T20:45:21.465450] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-29T20:45:21.948124] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-03. [2025-09-29T20:45:22.748159] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-09. [2025-09-29T20:45:23.548104] [INFO ] [REMOTE ] QSR: Fetching primary data for 2024-12. [2025-09-29T20:45:23.650425] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-09-29T20:45:23.744802] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-29T20:45:23.841718] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-29T20:45:23.848299] [INFO ] [REMOTE ] QD: Full fetch complete (40550 records). [2025-09-29T20:45:23.848412] [DEBUG] [VALIDATOR ] QD: Validating primary data. [2025-09-29T20:45:24.253135] [DEBUG] [VALIDATOR ] QD: All expected trading days are present. [2025-09-29T20:45:24.253231] [DEBUG] [VALIDATOR ] QD: Primary data validation passed. [2025-09-29T20:45:24.254173] [INFO ] [MAIN ] QD: Fetched primary data is valid. [2025-09-29T20:45:24.254241] [DEBUG] [LOCAL ] QD: Saving primary data. [2025-09-29T20:45:24.255423] [DEBUG] [LOCAL ] QD: Trimmed 40550 records to 28038 (keeping 200 days of data) [2025-09-29T20:45:24.348293] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-03. [2025-09-29T20:45:24.426151] [DEBUG] [LOCAL ] QD: Primary data saved (28038 records). [2025-09-29T20:45:24.426308] [INFO ] [MAIN ] QD: Full history saved. [2025-09-29T20:45:24.426406] [INFO ] [MAIN ] Update Progress: 1757/2371 symbols completed. QD took 24.4s. Estimated remaining: 1h 18m 45s. Rate: 7.8 symbols/min [2025-09-29T20:45:25.148107] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-04. [2025-09-29T20:45:25.467944] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-29T20:45:25.948160] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-01. [2025-09-29T20:45:26.588707] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-29T20:45:26.691479] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-29T20:45:26.748071] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-05. [2025-09-29T20:45:27.444168] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-29T20:45:27.548095] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-02. [2025-09-29T20:45:28.348215] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-04. [2025-09-29T20:45:28.628279] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-29T20:45:28.939138] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-29T20:45:29.148139] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-03. [2025-09-29T20:45:29.948118] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-06. [2025-09-29T20:45:30.756747] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-09-29T20:45:30.770170] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-05. [2025-09-29T20:45:31.094798] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-29T20:45:31.548149] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-04. [2025-09-29T20:45:31.743751] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-29T20:45:32.348139] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-07. [2025-09-29T20:45:33.077864] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-09-29T20:45:33.148077] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-06. [2025-09-29T20:45:33.389917] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-29T20:45:33.948162] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-05. [2025-09-29T20:45:34.273120] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-29T20:45:34.748086] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-08. [2025-09-29T20:45:34.946821] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-29T20:45:35.548073] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-07. [2025-09-29T20:45:35.881738] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-29T20:45:36.348078] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-06. [2025-09-29T20:45:36.478504] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-29T20:45:37.148113] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-09. [2025-09-29T20:45:38.211470] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-29T20:45:38.223251] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-07. [2025-09-29T20:45:38.297575] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-07 (2.75 seconds). [2025-09-29T20:45:38.748118] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-08. [2025-09-29T20:45:38.886259] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-29T20:45:38.897979] [INFO ] [REMOTE ] QGEN: Full fetch complete (70137 records). [2025-09-29T20:45:38.898172] [DEBUG] [VALIDATOR ] QGEN: Validating primary data. [2025-09-29T20:45:39.344991] [DEBUG] [VALIDATOR ] QGEN: All expected trading days are present. [2025-09-29T20:45:39.345120] [DEBUG] [VALIDATOR ] QGEN: Primary data validation passed. [2025-09-29T20:45:39.346571] [INFO ] [MAIN ] QGEN: Fetched primary data is valid. [2025-09-29T20:45:39.346680] [DEBUG] [LOCAL ] QGEN: Saving primary data. [2025-09-29T20:45:39.348298] [DEBUG] [LOCAL ] QGEN: Trimmed 70137 records to 49070 (keeping 200 days of data) [2025-09-29T20:45:39.680028] [DEBUG] [LOCAL ] QGEN: Primary data saved (49070 records). [2025-09-29T20:45:39.680256] [INFO ] [MAIN ] QGEN: Full history saved. [2025-09-29T20:45:39.680398] [INFO ] [MAIN ] Update Progress: 1758/2371 symbols completed. QGEN took 28.7s. Estimated remaining: 1h 18m 40s. Rate: 7.8 symbols/min [2025-09-29T20:45:40.075177] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-29T20:45:40.087231] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-08. [2025-09-29T20:45:41.238893] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-09-29T20:45:41.251283] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-09. [2025-09-29T20:45:42.003941] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-29T20:45:42.016098] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-09. [2025-09-29T20:45:43.855633] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-09 (2.60 seconds). [2025-09-29T20:45:43.868455] [INFO ] [REMOTE ] QS: Full fetch complete (77883 records). [2025-09-29T20:45:43.868614] [DEBUG] [VALIDATOR ] QS: Validating primary data. [2025-09-29T20:45:44.039634] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-29T20:45:44.140804] [INFO ] [REMOTE ] QSR: Full fetch complete (75823 records). [2025-09-29T20:45:44.210818] [DEBUG] [VALIDATOR ] QSR: Validating primary data. [2025-09-29T20:45:44.556815] [DEBUG] [VALIDATOR ] QS: All expected trading days are present. [2025-09-29T20:45:44.606899] [DEBUG] [VALIDATOR ] QS: Primary data validation passed. [2025-09-29T20:45:44.643217] [INFO ] [MAIN ] QS: Fetched primary data is valid. [2025-09-29T20:45:44.660414] [DEBUG] [LOCAL ] QS: Saving primary data. [2025-09-29T20:45:44.723282] [DEBUG] [LOCAL ] QS: Trimmed 77883 records to 53742 (keeping 200 days of data) [2025-09-29T20:45:44.842361] [DEBUG] [VALIDATOR ] QSR: All expected trading days are present. [2025-09-29T20:45:44.870850] [DEBUG] [VALIDATOR ] QSR: Primary data validation passed. [2025-09-29T20:45:44.872950] [INFO ] [MAIN ] QSR: Fetched primary data is valid. [2025-09-29T20:45:44.873721] [DEBUG] [LOCAL ] QSR: Saving primary data. [2025-09-29T20:45:44.881538] [DEBUG] [LOCAL ] QSR: Trimmed 75823 records to 52403 (keeping 200 days of data) [2025-09-29T20:45:45.374540] [DEBUG] [LOCAL ] QS: Primary data saved (53742 records). [2025-09-29T20:45:45.374730] [INFO ] [MAIN ] QS: Full history saved. [2025-09-29T20:45:45.374841] [INFO ] [MAIN ] Update Progress: 1759/2371 symbols completed. QS took 34.1s. Estimated remaining: 1h 18m 32s. Rate: 7.8 symbols/min [2025-09-29T20:45:45.456793] [DEBUG] [LOCAL ] QSR: Primary data saved (52403 records). [2025-09-29T20:45:45.456950] [INFO ] [MAIN ] QSR: Full history saved. [2025-09-29T20:45:45.457040] [INFO ] [MAIN ] Update Progress: 1760/2371 symbols completed. QSR took 27.4s. Estimated remaining: 1h 18m 21s. Rate: 7.8 symbols/min [2025-09-29T20:45:46.082395] [INFO ] [MAIN ] QVCD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:45:46.210201] [INFO ] [MAIN ] QUAD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:45:46.252009] [INFO ] [MAIN ] QTWO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:45:46.253348] [INFO ] [MAIN ] QVCC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:45:46.259142] [DEBUG] [LOCAL ] QVCD: Loaded 4542 existing records from primary storage. [2025-09-29T20:45:46.260777] [INFO ] [MAIN ] QVCD: Loaded 4542 existing records. [2025-09-29T20:45:46.389264] [DEBUG] [LOCAL ] QVCC: Loaded 9018 existing records from primary storage. [2025-09-29T20:45:46.419303] [INFO ] [MAIN ] QVCC: Loaded 9018 existing records. [2025-09-29T20:45:46.420152] [DEBUG] [LOCAL ] QUAD: Loaded 23938 existing records from primary storage. [2025-09-29T20:45:46.503392] [INFO ] [MAIN ] QUAD: Loaded 23938 existing records. [2025-09-29T20:45:46.544997] [WARN ] [MAIN ] QVCD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:45:46.614830] [INFO ] [MAIN ] QVCD: Wiping existing primary data before full refresh. [2025-09-29T20:45:46.637920] [DEBUG] [LOCAL ] QTWO: Loaded 39754 existing records from primary storage. [2025-09-29T20:45:46.648528] [INFO ] [LOCAL ] QVCD: Starting deletion of primary data. [2025-09-29T20:45:46.654247] [INFO ] [MAIN ] QTWO: Loaded 39754 existing records. [2025-09-29T20:45:46.701036] [DEBUG] [LOCAL ] QVCD: Deleted primary data file. [2025-09-29T20:45:46.729562] [INFO ] [MAIN ] QVCD: Starting full primary refresh. [2025-09-29T20:45:47.017818] [WARN ] [MAIN ] QVCC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:45:47.154409] [INFO ] [MAIN ] QVCC: Wiping existing primary data before full refresh. [2025-09-29T20:45:47.175386] [INFO ] [LOCAL ] QVCC: Starting deletion of primary data. [2025-09-29T20:45:47.201057] [DEBUG] [LOCAL ] QVCC: Deleted primary data file. [2025-09-29T20:45:47.195475] [WARN ] [MAIN ] QUAD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:45:47.249011] [INFO ] [MAIN ] QUAD: Wiping existing primary data before full refresh. [2025-09-29T20:45:47.249185] [INFO ] [LOCAL ] QUAD: Starting deletion of primary data. [2025-09-29T20:45:47.250098] [INFO ] [MAIN ] QVCC: Starting full primary refresh. [2025-09-29T20:45:47.286166] [WARN ] [MAIN ] QTWO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:45:47.286255] [DEBUG] [LOCAL ] QUAD: Deleted primary data file. [2025-09-29T20:45:47.319774] [INFO ] [MAIN ] QUAD: Starting full primary refresh. [2025-09-29T20:45:47.320054] [INFO ] [MAIN ] QTWO: Wiping existing primary data before full refresh. [2025-09-29T20:45:47.403201] [INFO ] [LOCAL ] QTWO: Starting deletion of primary data. [2025-09-29T20:45:47.456089] [DEBUG] [LOCAL ] QTWO: Deleted primary data file. [2025-09-29T20:45:47.505183] [INFO ] [MAIN ] QTWO: Starting full primary refresh. [2025-09-29T20:45:48.344497] [INFO ] [REMOTE ] QVCD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:45:48.421474] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2024-12. [2025-09-29T20:45:48.570168] [INFO ] [REMOTE ] QVCC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:45:48.612825] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2024-12. [2025-09-29T20:45:48.720932] [INFO ] [REMOTE ] QUAD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:45:48.742197] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2024-12. [2025-09-29T20:45:48.805851] [INFO ] [REMOTE ] QTWO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:45:48.806226] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2024-12. [2025-09-29T20:45:49.447527] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-29T20:45:49.449345] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-01. [2025-09-29T20:45:49.680625] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-29T20:45:49.683525] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-01. [2025-09-29T20:45:49.983996] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-29T20:45:49.990374] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-01. [2025-09-29T20:45:50.094635] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-29T20:45:50.096246] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-02. [2025-09-29T20:45:50.296117] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-29T20:45:50.305387] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-01. [2025-09-29T20:45:50.366709] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-29T20:45:50.368728] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-02. [2025-09-29T20:45:50.464526] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-29T20:45:50.465868] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-03. [2025-09-29T20:45:51.001997] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-29T20:45:51.004032] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-03. [2025-09-29T20:45:51.067861] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-29T20:45:51.189110] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-29T20:45:51.548092] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-02. [2025-09-29T20:45:51.616352] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-29T20:45:51.854205] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-29T20:45:52.348155] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-04. [2025-09-29T20:45:52.859364] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-29T20:45:53.143344] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-29T20:45:53.148076] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-05. [2025-09-29T20:45:53.867274] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-29T20:45:53.948176] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-06. [2025-09-29T20:45:54.748101] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-02. [2025-09-29T20:45:54.810506] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-29T20:45:55.548128] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-07. [2025-09-29T20:45:56.214288] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-29T20:45:56.280208] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-29T20:45:56.348133] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-08. [2025-09-29T20:45:57.131418] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-29T20:45:57.148105] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-09. [2025-09-29T20:45:57.783039] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-29T20:45:57.785278] [INFO ] [REMOTE ] QVCC: Full fetch complete (12006 records). [2025-09-29T20:45:57.785481] [DEBUG] [VALIDATOR ] QVCC: Validating primary data. [2025-09-29T20:45:57.952506] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-04. [2025-09-29T20:45:58.177717] [DEBUG] [VALIDATOR ] QVCC: All expected trading days are present. [2025-09-29T20:45:58.177802] [DEBUG] [VALIDATOR ] QVCC: Primary data validation passed. [2025-09-29T20:45:58.178126] [INFO ] [MAIN ] QVCC: Fetched primary data is valid. [2025-09-29T20:45:58.178187] [DEBUG] [LOCAL ] QVCC: Saving primary data. [2025-09-29T20:45:58.178793] [DEBUG] [LOCAL ] QVCC: Trimmed 12006 records to 8934 (keeping 200 days of data) [2025-09-29T20:45:58.239488] [DEBUG] [LOCAL ] QVCC: Primary data saved (8934 records). [2025-09-29T20:45:58.239638] [INFO ] [MAIN ] QVCC: Full history saved. [2025-09-29T20:45:58.239812] [INFO ] [MAIN ] Update Progress: 1761/2371 symbols completed. QVCC took 12.8s. Estimated remaining: 1h 18m 15s. Rate: 7.8 symbols/min [2025-09-29T20:45:58.429461] [INFO ] [MAIN ] QXO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:45:58.497986] [DEBUG] [LOCAL ] QXO: Loaded 53964 existing records from primary storage. [2025-09-29T20:45:58.498333] [INFO ] [MAIN ] QXO: Loaded 53964 existing records. [2025-09-29T20:45:58.686407] [WARN ] [MAIN ] QXO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:45:58.686617] [INFO ] [MAIN ] QXO: Wiping existing primary data before full refresh. [2025-09-29T20:45:58.686708] [INFO ] [LOCAL ] QXO: Starting deletion of primary data. [2025-09-29T20:45:58.687218] [DEBUG] [LOCAL ] QXO: Deleted primary data file. [2025-09-29T20:45:58.687279] [INFO ] [MAIN ] QXO: Starting full primary refresh. [2025-09-29T20:45:58.753221] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-03. [2025-09-29T20:45:58.810246] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-29T20:45:59.076344] [INFO ] [REMOTE ] QXO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:45:59.548163] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-03. [2025-09-29T20:46:00.348156] [INFO ] [REMOTE ] QXO: Fetching primary data for 2024-12. [2025-09-29T20:46:00.493475] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-29T20:46:00.716046] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-29T20:46:01.148155] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-04. [2025-09-29T20:46:01.948127] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-05. [2025-09-29T20:46:02.198126] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-29T20:46:02.740156] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-29T20:46:02.748328] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-01. [2025-09-29T20:46:02.843262] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-29T20:46:03.548162] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-06. [2025-09-29T20:46:04.265242] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-29T20:46:04.348131] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-07. [2025-09-29T20:46:04.506049] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-29T20:46:04.982355] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-29T20:46:05.148142] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-05. [2025-09-29T20:46:05.948133] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-02. [2025-09-29T20:46:06.510022] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-29T20:46:06.748175] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-08. [2025-09-29T20:46:07.482908] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-29T20:46:07.548130] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-06. [2025-09-29T20:46:07.626218] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-29T20:46:08.348151] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-03. [2025-09-29T20:46:08.833242] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-29T20:46:09.148095] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-07. [2025-09-29T20:46:09.915199] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-29T20:46:09.948080] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-04. [2025-09-29T20:46:10.587803] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-29T20:46:10.748166] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-04. [2025-09-29T20:46:11.548120] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-09. [2025-09-29T20:46:11.824352] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-29T20:46:11.882824] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-29T20:46:11.969479] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-29T20:46:11.970710] [INFO ] [REMOTE ] QVCD: Full fetch complete (6167 records). [2025-09-29T20:46:11.970782] [DEBUG] [VALIDATOR ] QVCD: Validating primary data. [2025-09-29T20:46:12.353521] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-05. [2025-09-29T20:46:12.363842] [DEBUG] [VALIDATOR ] QVCD: All expected trading days are present. [2025-09-29T20:46:12.363912] [DEBUG] [VALIDATOR ] QVCD: Primary data validation passed. [2025-09-29T20:46:12.364100] [INFO ] [MAIN ] QVCD: Fetched primary data is valid. [2025-09-29T20:46:12.364142] [DEBUG] [LOCAL ] QVCD: Saving primary data. [2025-09-29T20:46:12.364918] [DEBUG] [LOCAL ] QVCD: Trimmed 6167 records to 4498 (keeping 200 days of data) [2025-09-29T20:46:12.394030] [DEBUG] [LOCAL ] QVCD: Primary data saved (4498 records). [2025-09-29T20:46:12.394193] [INFO ] [MAIN ] QVCD: Full history saved. [2025-09-29T20:46:12.394302] [INFO ] [MAIN ] Update Progress: 1762/2371 symbols completed. QVCD took 26.9s. Estimated remaining: 1h 18m 10s. Rate: 7.8 symbols/min [2025-09-29T20:46:12.577027] [INFO ] [MAIN ] R: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:46:12.608672] [DEBUG] [LOCAL ] R: Loaded 29775 existing records from primary storage. [2025-09-29T20:46:12.609117] [INFO ] [MAIN ] R: Loaded 29775 existing records. [2025-09-29T20:46:12.806502] [WARN ] [MAIN ] R: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:46:12.806782] [INFO ] [MAIN ] R: Wiping existing primary data before full refresh. [2025-09-29T20:46:12.806867] [INFO ] [LOCAL ] R: Starting deletion of primary data. [2025-09-29T20:46:12.807126] [DEBUG] [LOCAL ] R: Deleted primary data file. [2025-09-29T20:46:12.807186] [INFO ] [MAIN ] R: Starting full primary refresh. [2025-09-29T20:46:13.153216] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-08. [2025-09-29T20:46:13.200496] [INFO ] [REMOTE ] R: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:46:13.948087] [INFO ] [REMOTE ] R: Fetching primary data for 2024-12. [2025-09-29T20:46:14.415053] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-29T20:46:14.491807] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-29T20:46:14.748189] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-06. [2025-09-29T20:46:15.180964] [INFO ] [REMOTE ] R: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-29T20:46:15.548149] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-05. [2025-09-29T20:46:16.348116] [INFO ] [REMOTE ] R: Fetching primary data for 2025-01. [2025-09-29T20:46:16.815274] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-29T20:46:16.884382] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-29T20:46:17.148140] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-07. [2025-09-29T20:46:17.330835] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-29T20:46:17.948153] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-06. [2025-09-29T20:46:18.748089] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-09. [2025-09-29T20:46:19.109953] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-29T20:46:19.286910] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-29T20:46:19.548107] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-07. [2025-09-29T20:46:20.348095] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-08. [2025-09-29T20:46:20.384930] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-29T20:46:20.398771] [INFO ] [REMOTE ] QTWO: Full fetch complete (57288 records). [2025-09-29T20:46:20.398945] [DEBUG] [VALIDATOR ] QTWO: Validating primary data. [2025-09-29T20:46:20.858361] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-29T20:46:20.857506] [DEBUG] [VALIDATOR ] QTWO: All expected trading days are present. [2025-09-29T20:46:20.858536] [DEBUG] [VALIDATOR ] QTWO: Primary data validation passed. [2025-09-29T20:46:20.864783] [INFO ] [MAIN ] QTWO: Fetched primary data is valid. [2025-09-29T20:46:20.865201] [DEBUG] [LOCAL ] QTWO: Saving primary data. [2025-09-29T20:46:20.866422] [DEBUG] [LOCAL ] QTWO: Trimmed 57288 records to 38996 (keeping 200 days of data) [2025-09-29T20:46:21.130390] [DEBUG] [LOCAL ] QTWO: Primary data saved (38996 records). [2025-09-29T20:46:21.130540] [INFO ] [MAIN ] QTWO: Full history saved. [2025-09-29T20:46:21.130678] [INFO ] [MAIN ] Update Progress: 1763/2371 symbols completed. QTWO took 35.7s. Estimated remaining: 1h 18m 3s. Rate: 7.8 symbols/min [2025-09-29T20:46:21.153279] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-08. [2025-09-29T20:46:21.329503] [INFO ] [MAIN ] RA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:46:21.354923] [DEBUG] [LOCAL ] RA: Loaded 22045 existing records from primary storage. [2025-09-29T20:46:21.355198] [INFO ] [MAIN ] RA: Loaded 22045 existing records. [2025-09-29T20:46:21.546992] [WARN ] [MAIN ] RA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:46:21.547257] [INFO ] [MAIN ] RA: Wiping existing primary data before full refresh. [2025-09-29T20:46:21.547311] [INFO ] [LOCAL ] RA: Starting deletion of primary data. [2025-09-29T20:46:21.547709] [DEBUG] [LOCAL ] RA: Deleted primary data file. [2025-09-29T20:46:21.547771] [INFO ] [MAIN ] RA: Starting full primary refresh. [2025-09-29T20:46:21.931924] [INFO ] [REMOTE ] RA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:46:21.948094] [INFO ] [REMOTE ] RA: Fetching primary data for 2024-12. [2025-09-29T20:46:22.506962] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-29T20:46:22.566447] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-29T20:46:22.748121] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-09. [2025-09-29T20:46:23.378924] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-29T20:46:23.548164] [INFO ] [REMOTE ] R: Fetching primary data for 2025-02. [2025-09-29T20:46:23.791183] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-29T20:46:23.795542] [INFO ] [REMOTE ] QUAD: Full fetch complete (34519 records). [2025-09-29T20:46:23.795703] [DEBUG] [VALIDATOR ] QUAD: Validating primary data. [2025-09-29T20:46:24.201294] [DEBUG] [VALIDATOR ] QUAD: All expected trading days are present. [2025-09-29T20:46:24.201389] [DEBUG] [VALIDATOR ] QUAD: Primary data validation passed. [2025-09-29T20:46:24.202189] [INFO ] [MAIN ] QUAD: Fetched primary data is valid. [2025-09-29T20:46:24.202256] [DEBUG] [LOCAL ] QUAD: Saving primary data. [2025-09-29T20:46:24.203284] [DEBUG] [LOCAL ] QUAD: Trimmed 34519 records to 23399 (keeping 200 days of data) [2025-09-29T20:46:24.350726] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-01. [2025-09-29T20:46:24.365275] [DEBUG] [LOCAL ] QUAD: Primary data saved (23399 records). [2025-09-29T20:46:24.365480] [INFO ] [MAIN ] QUAD: Full history saved. [2025-09-29T20:46:24.365619] [INFO ] [MAIN ] Update Progress: 1764/2371 symbols completed. QUAD took 38.9s. Estimated remaining: 1h 17m 53s. Rate: 7.8 symbols/min [2025-09-29T20:46:24.548183] [INFO ] [MAIN ] RACE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:46:24.591244] [DEBUG] [LOCAL ] RACE: Loaded 33300 existing records from primary storage. [2025-09-29T20:46:24.591635] [INFO ] [MAIN ] RACE: Loaded 33300 existing records. [2025-09-29T20:46:24.778887] [WARN ] [MAIN ] RACE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:46:24.779280] [INFO ] [MAIN ] RACE: Wiping existing primary data before full refresh. [2025-09-29T20:46:24.779432] [INFO ] [LOCAL ] RACE: Starting deletion of primary data. [2025-09-29T20:46:24.779757] [DEBUG] [LOCAL ] RACE: Deleted primary data file. [2025-09-29T20:46:24.779820] [INFO ] [MAIN ] RACE: Starting full primary refresh. [2025-09-29T20:46:25.150716] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-29T20:46:25.150841] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-09. [2025-09-29T20:46:25.186573] [INFO ] [REMOTE ] RACE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:46:25.237351] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-29T20:46:25.948116] [INFO ] [REMOTE ] RACE: Fetching primary data for 2024-12. [2025-09-29T20:46:26.748081] [INFO ] [REMOTE ] R: Fetching primary data for 2025-03. [2025-09-29T20:46:27.288395] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-29T20:46:27.299403] [INFO ] [REMOTE ] QXO: Full fetch complete (75503 records). [2025-09-29T20:46:27.299548] [DEBUG] [VALIDATOR ] QXO: Validating primary data. [2025-09-29T20:46:27.550561] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-02. [2025-09-29T20:46:27.630731] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-29T20:46:27.750454] [DEBUG] [VALIDATOR ] QXO: All expected trading days are present. [2025-09-29T20:46:27.750532] [DEBUG] [VALIDATOR ] QXO: Primary data validation passed. [2025-09-29T20:46:27.751865] [INFO ] [MAIN ] QXO: Fetched primary data is valid. [2025-09-29T20:46:27.751970] [DEBUG] [LOCAL ] QXO: Saving primary data. [2025-09-29T20:46:27.753675] [DEBUG] [LOCAL ] QXO: Trimmed 75503 records to 53206 (keeping 200 days of data) [2025-09-29T20:46:28.099619] [DEBUG] [LOCAL ] QXO: Primary data saved (53206 records). [2025-09-29T20:46:28.099903] [INFO ] [MAIN ] QXO: Full history saved. [2025-09-29T20:46:28.100092] [INFO ] [MAIN ] Update Progress: 1765/2371 symbols completed. QXO took 29.9s. Estimated remaining: 1h 17m 44s. Rate: 7.8 symbols/min [2025-09-29T20:46:28.281034] [INFO ] [MAIN ] RAMP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:46:28.307725] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-29T20:46:28.348441] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-01. [2025-09-29T20:46:28.350279] [DEBUG] [LOCAL ] RAMP: Loaded 38208 existing records from primary storage. [2025-09-29T20:46:28.350552] [INFO ] [MAIN ] RAMP: Loaded 38208 existing records. [2025-09-29T20:46:28.540397] [WARN ] [MAIN ] RAMP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:46:28.540612] [INFO ] [MAIN ] RAMP: Wiping existing primary data before full refresh. [2025-09-29T20:46:28.540690] [INFO ] [LOCAL ] RAMP: Starting deletion of primary data. [2025-09-29T20:46:28.541063] [DEBUG] [LOCAL ] RAMP: Deleted primary data file. [2025-09-29T20:46:28.541123] [INFO ] [MAIN ] RAMP: Starting full primary refresh. [2025-09-29T20:46:28.910349] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-29T20:46:28.940447] [INFO ] [REMOTE ] RAMP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:46:29.148098] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2024-12. [2025-09-29T20:46:29.948085] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-03. [2025-09-29T20:46:30.038626] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-29T20:46:30.591404] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-29T20:46:30.748153] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-02. [2025-09-29T20:46:31.243215] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-29T20:46:31.548131] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-04. [2025-09-29T20:46:32.125957] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-29T20:46:32.348109] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-03. [2025-09-29T20:46:32.832222] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-29T20:46:33.148122] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-01. [2025-09-29T20:46:33.821760] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-29T20:46:33.948117] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-04. [2025-09-29T20:46:34.660182] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-29T20:46:34.748129] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-02. [2025-09-29T20:46:35.548130] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-05. [2025-09-29T20:46:35.830213] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-29T20:46:36.150281] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-29T20:46:36.348139] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-05. [2025-09-29T20:46:36.606116] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-29T20:46:37.148119] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-06. [2025-09-29T20:46:37.948117] [INFO ] [REMOTE ] R: Fetching primary data for 2025-04. [2025-09-29T20:46:38.023414] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-29T20:46:38.338888] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-29T20:46:38.748116] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-06. [2025-09-29T20:46:39.548138] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-07. [2025-09-29T20:46:39.644575] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-29T20:46:40.145091] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-29T20:46:40.348146] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-07. [2025-09-29T20:46:40.928957] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-29T20:46:41.148159] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-03. [2025-09-29T20:46:41.890290] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-29T20:46:41.948135] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-08. [2025-09-29T20:46:42.454345] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-29T20:46:42.748121] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-04. [2025-09-29T20:46:43.152976] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-29T20:46:43.548143] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-08. [2025-09-29T20:46:44.349517] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-09. [2025-09-29T20:46:44.354392] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-29T20:46:45.148123] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-05. [2025-09-29T20:46:45.184308] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-29T20:46:45.216022] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-29T20:46:45.220810] [INFO ] [REMOTE ] RA: Full fetch complete (31979 records). [2025-09-29T20:46:45.220906] [DEBUG] [VALIDATOR ] RA: Validating primary data. [2025-09-29T20:46:45.646998] [DEBUG] [VALIDATOR ] RA: All expected trading days are present. [2025-09-29T20:46:45.647385] [DEBUG] [VALIDATOR ] RA: Primary data validation passed. [2025-09-29T20:46:45.648178] [INFO ] [MAIN ] RA: Fetched primary data is valid. [2025-09-29T20:46:45.648269] [DEBUG] [LOCAL ] RA: Saving primary data. [2025-09-29T20:46:45.649380] [DEBUG] [LOCAL ] RA: Trimmed 31979 records to 21729 (keeping 200 days of data) [2025-09-29T20:46:45.800420] [DEBUG] [LOCAL ] RA: Primary data saved (21729 records). [2025-09-29T20:46:45.800556] [INFO ] [MAIN ] RA: Full history saved. [2025-09-29T20:46:45.800801] [INFO ] [MAIN ] Update Progress: 1766/2371 symbols completed. RA took 24.7s. Estimated remaining: 1h 17m 40s. Rate: 7.8 symbols/min [2025-09-29T20:46:45.956963] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-09. [2025-09-29T20:46:45.995268] [INFO ] [MAIN ] RBA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:46:46.046719] [DEBUG] [LOCAL ] RBA: Loaded 46598 existing records from primary storage. [2025-09-29T20:46:46.047054] [INFO ] [MAIN ] RBA: Loaded 46598 existing records. [2025-09-29T20:46:46.235362] [WARN ] [MAIN ] RBA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:46:46.235592] [INFO ] [MAIN ] RBA: Wiping existing primary data before full refresh. [2025-09-29T20:46:46.235664] [INFO ] [LOCAL ] RBA: Starting deletion of primary data. [2025-09-29T20:46:46.236191] [DEBUG] [LOCAL ] RBA: Deleted primary data file. [2025-09-29T20:46:46.236266] [INFO ] [MAIN ] RBA: Starting full primary refresh. [2025-09-29T20:46:46.621250] [INFO ] [REMOTE ] RBA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:46:46.731285] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-29T20:46:46.748068] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-06. [2025-09-29T20:46:47.308435] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-29T20:46:47.315173] [INFO ] [REMOTE ] RACE: Full fetch complete (47568 records). [2025-09-29T20:46:47.315297] [DEBUG] [VALIDATOR ] RACE: Validating primary data. [2025-09-29T20:46:47.553288] [INFO ] [REMOTE ] RBA: Fetching primary data for 2024-12. [2025-09-29T20:46:47.719683] [DEBUG] [VALIDATOR ] RACE: All expected trading days are present. [2025-09-29T20:46:47.720425] [DEBUG] [VALIDATOR ] RACE: Primary data validation passed. [2025-09-29T20:46:47.721499] [INFO ] [MAIN ] RACE: Fetched primary data is valid. [2025-09-29T20:46:47.721567] [DEBUG] [LOCAL ] RACE: Saving primary data. [2025-09-29T20:46:47.722734] [DEBUG] [LOCAL ] RACE: Trimmed 47568 records to 32637 (keeping 200 days of data) [2025-09-29T20:46:47.939421] [DEBUG] [LOCAL ] RACE: Primary data saved (32637 records). [2025-09-29T20:46:47.939576] [INFO ] [MAIN ] RACE: Full history saved. [2025-09-29T20:46:47.939703] [INFO ] [MAIN ] Update Progress: 1767/2371 symbols completed. RACE took 23.6s. Estimated remaining: 1h 17m 30s. Rate: 7.8 symbols/min [2025-09-29T20:46:48.121278] [INFO ] [MAIN ] RBC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:46:48.138941] [DEBUG] [LOCAL ] RBC: Loaded 15326 existing records from primary storage. [2025-09-29T20:46:48.139184] [INFO ] [MAIN ] RBC: Loaded 15326 existing records. [2025-09-29T20:46:48.264936] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-29T20:46:48.356534] [WARN ] [MAIN ] RBC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:46:48.352264] [INFO ] [REMOTE ] R: Fetching primary data for 2025-05. [2025-09-29T20:46:48.357933] [INFO ] [MAIN ] RBC: Wiping existing primary data before full refresh. [2025-09-29T20:46:48.358002] [INFO ] [LOCAL ] RBC: Starting deletion of primary data. [2025-09-29T20:46:48.358238] [DEBUG] [LOCAL ] RBC: Deleted primary data file. [2025-09-29T20:46:48.358300] [INFO ] [MAIN ] RBC: Starting full primary refresh. [2025-09-29T20:46:48.732321] [INFO ] [REMOTE ] RBC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:46:49.137440] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-29T20:46:49.148061] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-01. [2025-09-29T20:46:49.664984] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-29T20:46:49.948123] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-07. [2025-09-29T20:46:50.564679] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-29T20:46:50.748120] [INFO ] [REMOTE ] R: Fetching primary data for 2025-06. [2025-09-29T20:46:51.405414] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-29T20:46:51.548129] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-02. [2025-09-29T20:46:51.748474] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-29T20:46:52.348143] [INFO ] [REMOTE ] R: Fetching primary data for 2025-07. [2025-09-29T20:46:53.148126] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-08. [2025-09-29T20:46:53.212713] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-29T20:46:53.744210] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-29T20:46:53.948165] [INFO ] [REMOTE ] R: Fetching primary data for 2025-08. [2025-09-29T20:46:54.520961] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-29T20:46:54.748158] [INFO ] [REMOTE ] RBC: Fetching primary data for 2024-12. [2025-09-29T20:46:55.232716] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-29T20:46:55.548151] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-03. [2025-09-29T20:46:56.157756] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-29T20:46:56.348168] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-09. [2025-09-29T20:46:57.148115] [INFO ] [REMOTE ] R: Fetching primary data for 2025-09. [2025-09-29T20:46:57.346766] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-29T20:46:57.859912] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-29T20:46:57.868006] [INFO ] [REMOTE ] RAMP: Full fetch complete (53257 records). [2025-09-29T20:46:57.868141] [DEBUG] [VALIDATOR ] RAMP: Validating primary data. [2025-09-29T20:46:57.953215] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-01. [2025-09-29T20:46:58.285383] [DEBUG] [VALIDATOR ] RAMP: All expected trading days are present. [2025-09-29T20:46:58.285505] [DEBUG] [VALIDATOR ] RAMP: Primary data validation passed. [2025-09-29T20:46:58.286584] [INFO ] [MAIN ] RAMP: Fetched primary data is valid. [2025-09-29T20:46:58.286796] [DEBUG] [LOCAL ] RAMP: Saving primary data. [2025-09-29T20:46:58.288337] [DEBUG] [LOCAL ] RAMP: Trimmed 53257 records to 37464 (keeping 200 days of data) [2025-09-29T20:46:58.395010] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-29T20:46:58.402306] [INFO ] [REMOTE ] R: Full fetch complete (42155 records). [2025-09-29T20:46:58.403007] [DEBUG] [VALIDATOR ] R: Validating primary data. [2025-09-29T20:46:58.752926] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-04. [2025-09-29T20:46:58.830814] [DEBUG] [VALIDATOR ] R: All expected trading days are present. [2025-09-29T20:46:58.831164] [DEBUG] [VALIDATOR ] R: Primary data validation passed. [2025-09-29T20:46:58.832822] [INFO ] [MAIN ] R: Fetched primary data is valid. [2025-09-29T20:46:58.833248] [DEBUG] [LOCAL ] R: Saving primary data. [2025-09-29T20:46:58.837564] [DEBUG] [LOCAL ] R: Trimmed 42155 records to 29166 (keeping 200 days of data) [2025-09-29T20:46:59.038738] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-29T20:46:59.097437] [DEBUG] [LOCAL ] RAMP: Primary data saved (37464 records). [2025-09-29T20:46:59.098516] [INFO ] [MAIN ] RAMP: Full history saved. [2025-09-29T20:46:59.098691] [INFO ] [MAIN ] Update Progress: 1768/2371 symbols completed. RAMP took 31.0s. Estimated remaining: 1h 17m 24s. Rate: 7.8 symbols/min [2025-09-29T20:46:59.292613] [INFO ] [MAIN ] RBLX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:46:59.369040] [DEBUG] [LOCAL ] R: Primary data saved (29166 records). [2025-09-29T20:46:59.369226] [INFO ] [MAIN ] R: Full history saved. [2025-09-29T20:46:59.369387] [INFO ] [MAIN ] Update Progress: 1769/2371 symbols completed. R took 47.0s. Estimated remaining: 1h 17m 14s. Rate: 7.8 symbols/min [2025-09-29T20:46:59.516737] [DEBUG] [LOCAL ] RBLX: Loaded 54496 existing records from primary storage. [2025-09-29T20:46:59.543338] [INFO ] [MAIN ] RBLX: Loaded 54496 existing records. [2025-09-29T20:46:59.569864] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-02. [2025-09-29T20:46:59.571411] [INFO ] [MAIN ] RBOT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:46:59.691909] [DEBUG] [LOCAL ] RBOT: Loaded 5223 existing records from primary storage. [2025-09-29T20:46:59.694796] [INFO ] [MAIN ] RBOT: Loaded 5223 existing records. [2025-09-29T20:46:59.891923] [WARN ] [MAIN ] RBLX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:46:59.921381] [INFO ] [MAIN ] RBLX: Wiping existing primary data before full refresh. [2025-09-29T20:46:59.935000] [INFO ] [LOCAL ] RBLX: Starting deletion of primary data. [2025-09-29T20:46:59.950544] [DEBUG] [LOCAL ] RBLX: Deleted primary data file. [2025-09-29T20:46:59.960594] [INFO ] [MAIN ] RBLX: Starting full primary refresh. [2025-09-29T20:46:59.963940] [WARN ] [MAIN ] RBOT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:46:59.969409] [INFO ] [MAIN ] RBOT: Wiping existing primary data before full refresh. [2025-09-29T20:47:00.023264] [INFO ] [LOCAL ] RBOT: Starting deletion of primary data. [2025-09-29T20:47:00.051090] [DEBUG] [LOCAL ] RBOT: Deleted primary data file. [2025-09-29T20:47:00.071610] [INFO ] [MAIN ] RBOT: Starting full primary refresh. [2025-09-29T20:47:00.697186] [INFO ] [REMOTE ] RBLX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:47:00.702832] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2024-12. [2025-09-29T20:47:00.817805] [INFO ] [REMOTE ] RBOT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:47:00.857307] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-29T20:47:00.863574] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-29T20:47:01.148123] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-03. [2025-09-29T20:47:01.948110] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-05. [2025-09-29T20:47:02.084501] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-29T20:47:02.748152] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-04. [2025-09-29T20:47:03.175506] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-09-29T20:47:03.548182] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-01. [2025-09-29T20:47:03.706197] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-29T20:47:03.746523] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-29T20:47:04.348133] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-05. [2025-09-29T20:47:05.148128] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-06. [2025-09-29T20:47:05.528787] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-29T20:47:05.874525] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-09-29T20:47:05.948099] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-06. [2025-09-29T20:47:06.569264] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-29T20:47:06.748092] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-07. [2025-09-29T20:47:07.006967] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-29T20:47:07.548120] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-07. [2025-09-29T20:47:08.348087] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-02. [2025-09-29T20:47:08.506465] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-29T20:47:08.529104] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-29T20:47:09.148134] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-08. [2025-09-29T20:47:09.948128] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2024-12. [2025-09-29T20:47:10.318731] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-29T20:47:10.498572] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-29T20:47:10.748118] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-03. [2025-09-29T20:47:10.891145] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-29T20:47:11.548138] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-09. [2025-09-29T20:47:12.348109] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-08. [2025-09-29T20:47:12.638983] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-29T20:47:12.643272] [INFO ] [REMOTE ] RBC: Full fetch complete (21943 records). [2025-09-29T20:47:12.643366] [DEBUG] [VALIDATOR ] RBC: Validating primary data. [2025-09-29T20:47:13.032909] [DEBUG] [VALIDATOR ] RBC: All expected trading days are present. [2025-09-29T20:47:13.033033] [DEBUG] [VALIDATOR ] RBC: Primary data validation passed. [2025-09-29T20:47:13.033629] [INFO ] [MAIN ] RBC: Fetched primary data is valid. [2025-09-29T20:47:13.033728] [DEBUG] [LOCAL ] RBC: Saving primary data. [2025-09-29T20:47:13.034415] [DEBUG] [LOCAL ] RBC: Trimmed 21943 records to 15132 (keeping 200 days of data) [2025-09-29T20:47:13.134254] [DEBUG] [LOCAL ] RBC: Primary data saved (15132 records). [2025-09-29T20:47:13.134387] [INFO ] [MAIN ] RBC: Full history saved. [2025-09-29T20:47:13.134515] [INFO ] [MAIN ] Update Progress: 1770/2371 symbols completed. RBC took 25.2s. Estimated remaining: 1h 17m 8s. Rate: 7.8 symbols/min [2025-09-29T20:47:13.166666] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-01. [2025-09-29T20:47:13.310465] [INFO ] [MAIN ] RBRK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:47:13.363829] [DEBUG] [LOCAL ] RBRK: Loaded 53892 existing records from primary storage. [2025-09-29T20:47:13.364193] [INFO ] [MAIN ] RBRK: Loaded 53892 existing records. [2025-09-29T20:47:13.554785] [WARN ] [MAIN ] RBRK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:47:13.555507] [INFO ] [MAIN ] RBRK: Wiping existing primary data before full refresh. [2025-09-29T20:47:13.555638] [INFO ] [LOCAL ] RBRK: Starting deletion of primary data. [2025-09-29T20:47:13.556396] [DEBUG] [LOCAL ] RBRK: Deleted primary data file. [2025-09-29T20:47:13.556457] [INFO ] [MAIN ] RBRK: Starting full primary refresh. [2025-09-29T20:47:13.783092] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-03 (3.03 seconds). [2025-09-29T20:47:13.951585] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-04. [2025-09-29T20:47:14.015989] [INFO ] [REMOTE ] RBRK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:47:14.045613] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-29T20:47:14.127886] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-29T20:47:14.748156] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-09. [2025-09-29T20:47:15.548129] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-02. [2025-09-29T20:47:16.348132] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2024-12. [2025-09-29T20:47:16.365737] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-29T20:47:16.415914] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-09-29T20:47:16.459813] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-29T20:47:16.469530] [INFO ] [REMOTE ] RBA: Full fetch complete (65547 records). [2025-09-29T20:47:16.469709] [DEBUG] [VALIDATOR ] RBA: Validating primary data. [2025-09-29T20:47:16.872048] [DEBUG] [VALIDATOR ] RBA: All expected trading days are present. [2025-09-29T20:47:16.872152] [DEBUG] [VALIDATOR ] RBA: Primary data validation passed. [2025-09-29T20:47:16.873190] [INFO ] [MAIN ] RBA: Fetched primary data is valid. [2025-09-29T20:47:16.873272] [DEBUG] [LOCAL ] RBA: Saving primary data. [2025-09-29T20:47:16.874601] [DEBUG] [LOCAL ] RBA: Trimmed 65547 records to 45859 (keeping 200 days of data) [2025-09-29T20:47:17.154244] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-05. [2025-09-29T20:47:17.179493] [DEBUG] [LOCAL ] RBA: Primary data saved (45859 records). [2025-09-29T20:47:17.179734] [INFO ] [MAIN ] RBA: Full history saved. [2025-09-29T20:47:17.179836] [INFO ] [MAIN ] Update Progress: 1771/2371 symbols completed. RBA took 31.4s. Estimated remaining: 1h 16m 59s. Rate: 7.8 symbols/min [2025-09-29T20:47:17.380940] [INFO ] [MAIN ] RC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:47:17.424916] [DEBUG] [LOCAL ] RC: Loaded 49676 existing records from primary storage. [2025-09-29T20:47:17.425301] [INFO ] [MAIN ] RC: Loaded 49676 existing records. [2025-09-29T20:47:17.613048] [WARN ] [MAIN ] RC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:47:17.613326] [INFO ] [MAIN ] RC: Wiping existing primary data before full refresh. [2025-09-29T20:47:17.613378] [INFO ] [LOCAL ] RC: Starting deletion of primary data. [2025-09-29T20:47:17.613677] [DEBUG] [LOCAL ] RC: Deleted primary data file. [2025-09-29T20:47:17.613737] [INFO ] [MAIN ] RC: Starting full primary refresh. [2025-09-29T20:47:18.011179] [INFO ] [REMOTE ] RC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:47:17.961923] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-03. [2025-09-29T20:47:18.229862] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-29T20:47:18.748133] [INFO ] [REMOTE ] RC: Fetching primary data for 2024-12. [2025-09-29T20:47:18.799639] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-29T20:47:19.359846] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-29T20:47:19.548121] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-06. [2025-09-29T20:47:20.348150] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-01. [2025-09-29T20:47:21.022032] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-09-29T20:47:21.148130] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-04. [2025-09-29T20:47:21.908407] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-09-29T20:47:21.945375] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-29T20:47:21.948066] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-05. [2025-09-29T20:47:21.997678] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-29T20:47:22.568782] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-29T20:47:22.748147] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-06. [2025-09-29T20:47:23.297463] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-29T20:47:23.548127] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-07. [2025-09-29T20:47:24.348105] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-02. [2025-09-29T20:47:24.355281] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-29T20:47:25.148115] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-01. [2025-09-29T20:47:25.948122] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-07. [2025-09-29T20:47:26.166085] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-29T20:47:26.748130] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-08. [2025-09-29T20:47:26.963812] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-29T20:47:27.548131] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-03. [2025-09-29T20:47:27.596926] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-29T20:47:28.348129] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-02. [2025-09-29T20:47:28.660468] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-07 (2.71 seconds). [2025-09-29T20:47:29.148107] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-08. [2025-09-29T20:47:29.653882] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-29T20:47:29.948123] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-04. [2025-09-29T20:47:30.078523] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-29T20:47:30.748158] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-03. [2025-09-29T20:47:31.548126] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-09. [2025-09-29T20:47:31.692479] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-08 (2.54 seconds). [2025-09-29T20:47:32.004211] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-29T20:47:32.176400] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-29T20:47:32.178557] [INFO ] [REMOTE ] RBOT: Full fetch complete (8517 records). [2025-09-29T20:47:32.178628] [DEBUG] [VALIDATOR ] RBOT: Validating primary data. [2025-09-29T20:47:32.354538] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-09. [2025-09-29T20:47:32.583752] [DEBUG] [VALIDATOR ] RBOT: All expected trading days are present. [2025-09-29T20:47:32.584035] [DEBUG] [VALIDATOR ] RBOT: Primary data validation passed. [2025-09-29T20:47:32.584402] [INFO ] [MAIN ] RBOT: Fetched primary data is valid. [2025-09-29T20:47:32.584513] [DEBUG] [LOCAL ] RBOT: Saving primary data. [2025-09-29T20:47:32.585377] [DEBUG] [LOCAL ] RBOT: Trimmed 8517 records to 5172 (keeping 200 days of data) [2025-09-29T20:47:32.618072] [DEBUG] [LOCAL ] RBOT: Primary data saved (5172 records). [2025-09-29T20:47:32.618200] [INFO ] [MAIN ] RBOT: Full history saved. [2025-09-29T20:47:32.618289] [INFO ] [MAIN ] Update Progress: 1772/2371 symbols completed. RBOT took 33.2s. Estimated remaining: 1h 16m 54s. Rate: 7.8 symbols/min [2025-09-29T20:47:32.769660] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-29T20:47:32.855480] [INFO ] [MAIN ] RCB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:47:32.855681] [DEBUG] [LOCAL ] RCB: No existing data file found in primary storage. [2025-09-29T20:47:32.855740] [WARN ] [MAIN ] RCB: No existing data found, performing full refresh instead. [2025-09-29T20:47:32.855857] [INFO ] [MAIN ] RCB: Wiping existing primary data before full refresh. [2025-09-29T20:47:32.855901] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-09-29T20:47:32.855944] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-09-29T20:47:32.855978] [INFO ] [MAIN ] RCB: Starting full primary refresh. [2025-09-29T20:47:33.149171] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-05. [2025-09-29T20:47:33.233133] [INFO ] [REMOTE ] RCB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:47:33.948129] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-04. [2025-09-29T20:47:34.748151] [INFO ] [REMOTE ] RCB: Fetching primary data for 2024-12. [2025-09-29T20:47:34.848684] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-09-29T20:47:34.859951] [INFO ] [REMOTE ] RBLX: Full fetch complete (77779 records). [2025-09-29T20:47:34.860121] [DEBUG] [VALIDATOR ] RBLX: Validating primary data. [2025-09-29T20:47:35.203103] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-29T20:47:35.295352] [DEBUG] [VALIDATOR ] RBLX: All expected trading days are present. [2025-09-29T20:47:35.295501] [DEBUG] [VALIDATOR ] RBLX: Primary data validation passed. [2025-09-29T20:47:35.296847] [INFO ] [MAIN ] RBLX: Fetched primary data is valid. [2025-09-29T20:47:35.296915] [DEBUG] [LOCAL ] RBLX: Saving primary data. [2025-09-29T20:47:35.298860] [DEBUG] [LOCAL ] RBLX: Trimmed 77779 records to 53716 (keeping 200 days of data) [2025-09-29T20:47:35.421308] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-09-29T20:47:35.556751] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-01. [2025-09-29T20:47:35.590020] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-29T20:47:35.730014] [DEBUG] [LOCAL ] RBLX: Primary data saved (53716 records). [2025-09-29T20:47:35.730162] [INFO ] [MAIN ] RBLX: Full history saved. [2025-09-29T20:47:35.730296] [INFO ] [MAIN ] Update Progress: 1773/2371 symbols completed. RBLX took 36.6s. Estimated remaining: 1h 16m 45s. Rate: 7.8 symbols/min [2025-09-29T20:47:35.933948] [INFO ] [MAIN ] RCD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:47:35.934230] [DEBUG] [LOCAL ] RCD: No existing data file found in primary storage. [2025-09-29T20:47:35.934292] [WARN ] [MAIN ] RCD: No existing data found, performing full refresh instead. [2025-09-29T20:47:35.934433] [INFO ] [MAIN ] RCD: Wiping existing primary data before full refresh. [2025-09-29T20:47:35.934499] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-09-29T20:47:35.934590] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-09-29T20:47:35.934688] [INFO ] [MAIN ] RCD: Starting full primary refresh. [2025-09-29T20:47:36.013852] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-29T20:47:36.360725] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-06. [2025-09-29T20:47:36.407148] [INFO ] [REMOTE ] RCD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:47:37.148117] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-05. [2025-09-29T20:47:37.948110] [INFO ] [REMOTE ] RCD: Fetching primary data for 2024-12. [2025-09-29T20:47:38.564980] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-29T20:47:38.585611] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-29T20:47:38.748116] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-01. [2025-09-29T20:47:38.913514] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-29T20:47:39.219522] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-29T20:47:39.548112] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-06. [2025-09-29T20:47:40.348120] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-02. [2025-09-29T20:47:40.914390] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-29T20:47:41.148088] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-07. [2025-09-29T20:47:41.310601] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-29T20:47:41.948141] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-07. [2025-09-29T20:47:42.748129] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-03. [2025-09-29T20:47:43.221831] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-29T20:47:43.264212] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-29T20:47:43.475168] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-29T20:47:43.548143] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-08. [2025-09-29T20:47:44.348175] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-04. [2025-09-29T20:47:44.737201] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-29T20:47:45.148142] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-02. [2025-09-29T20:47:45.386307] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-29T20:47:45.538452] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-29T20:47:45.948146] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-05. [2025-09-29T20:47:46.370405] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-29T20:47:46.748138] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-08. [2025-09-29T20:47:47.548177] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-09. [2025-09-29T20:47:48.348102] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-03. [2025-09-29T20:47:48.532222] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-29T20:47:48.728285] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-29T20:47:49.148134] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-09. [2025-09-29T20:47:49.327715] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-29T20:47:49.338267] [INFO ] [REMOTE ] RC: Full fetch complete (70829 records). [2025-09-29T20:47:49.338434] [DEBUG] [VALIDATOR ] RC: Validating primary data. [2025-09-29T20:47:49.753595] [DEBUG] [VALIDATOR ] RC: All expected trading days are present. [2025-09-29T20:47:49.753745] [DEBUG] [VALIDATOR ] RC: Primary data validation passed. [2025-09-29T20:47:49.754862] [INFO ] [MAIN ] RC: Fetched primary data is valid. [2025-09-29T20:47:49.754926] [DEBUG] [LOCAL ] RC: Saving primary data. [2025-09-29T20:47:49.756323] [DEBUG] [LOCAL ] RC: Trimmed 70829 records to 48910 (keeping 200 days of data) [2025-09-29T20:47:49.963754] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-04. [2025-09-29T20:47:50.055498] [DEBUG] [LOCAL ] RC: Primary data saved (48910 records). [2025-09-29T20:47:50.055675] [INFO ] [MAIN ] RC: Full history saved. [2025-09-29T20:47:50.055823] [INFO ] [MAIN ] Update Progress: 1774/2371 symbols completed. RC took 32.9s. Estimated remaining: 1h 16m 39s. Rate: 7.8 symbols/min [2025-09-29T20:47:50.232985] [INFO ] [MAIN ] RCI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:47:50.279066] [DEBUG] [LOCAL ] RCI: Loaded 49383 existing records from primary storage. [2025-09-29T20:47:50.279402] [INFO ] [MAIN ] RCI: Loaded 49383 existing records. [2025-09-29T20:47:50.453796] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-29T20:47:50.474328] [WARN ] [MAIN ] RCI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:47:50.477066] [INFO ] [MAIN ] RCI: Wiping existing primary data before full refresh. [2025-09-29T20:47:50.477172] [INFO ] [LOCAL ] RCI: Starting deletion of primary data. [2025-09-29T20:47:50.477432] [DEBUG] [LOCAL ] RCI: Deleted primary data file. [2025-09-29T20:47:50.477494] [INFO ] [MAIN ] RCI: Starting full primary refresh. [2025-09-29T20:47:50.756702] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-05. [2025-09-29T20:47:50.866998] [INFO ] [REMOTE ] RCI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:47:51.225928] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-29T20:47:51.237590] [INFO ] [REMOTE ] RBRK: Full fetch complete (76524 records). [2025-09-29T20:47:51.237776] [DEBUG] [VALIDATOR ] RBRK: Validating primary data. [2025-09-29T20:47:51.352167] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-29T20:47:51.553384] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-06. [2025-09-29T20:47:51.670603] [DEBUG] [VALIDATOR ] RBRK: All expected trading days are present. [2025-09-29T20:47:51.670729] [DEBUG] [VALIDATOR ] RBRK: Primary data validation passed. [2025-09-29T20:47:51.671989] [INFO ] [MAIN ] RBRK: Fetched primary data is valid. [2025-09-29T20:47:51.672058] [DEBUG] [LOCAL ] RBRK: Saving primary data. [2025-09-29T20:47:51.673635] [DEBUG] [LOCAL ] RBRK: Trimmed 76524 records to 53123 (keeping 200 days of data) [2025-09-29T20:47:51.866726] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-29T20:47:52.024149] [DEBUG] [LOCAL ] RBRK: Primary data saved (53123 records). [2025-09-29T20:47:52.024846] [INFO ] [MAIN ] RBRK: Full history saved. [2025-09-29T20:47:52.025103] [INFO ] [MAIN ] Update Progress: 1775/2371 symbols completed. RBRK took 38.9s. Estimated remaining: 1h 16m 30s. Rate: 7.8 symbols/min [2025-09-29T20:47:52.198731] [INFO ] [MAIN ] RCL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:47:52.261457] [DEBUG] [LOCAL ] RCL: Loaded 52876 existing records from primary storage. [2025-09-29T20:47:52.261823] [INFO ] [MAIN ] RCL: Loaded 52876 existing records. [2025-09-29T20:47:52.353239] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-06. [2025-09-29T20:47:52.447341] [WARN ] [MAIN ] RCL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:47:52.447553] [INFO ] [MAIN ] RCL: Wiping existing primary data before full refresh. [2025-09-29T20:47:52.447601] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-09-29T20:47:52.448667] [DEBUG] [LOCAL ] RCL: Deleted primary data file. [2025-09-29T20:47:52.448731] [INFO ] [MAIN ] RCL: Starting full primary refresh. [2025-09-29T20:47:52.819259] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-29T20:47:52.825891] [INFO ] [REMOTE ] RCL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:47:53.148113] [INFO ] [REMOTE ] RCL: Fetching primary data for 2024-12. [2025-09-29T20:47:53.948132] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-07. [2025-09-29T20:47:54.306051] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-29T20:47:54.748121] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-07. [2025-09-29T20:47:55.124560] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-29T20:47:55.237760] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-29T20:47:55.548129] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-01. [2025-09-29T20:47:56.348176] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-08. [2025-09-29T20:47:56.771729] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-29T20:47:57.148088] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-09. [2025-09-29T20:47:57.462853] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-29T20:47:57.465972] [INFO ] [REMOTE ] RCB: Full fetch complete (3743 records). [2025-09-29T20:47:57.465846] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-29T20:47:57.466132] [DEBUG] [VALIDATOR ] RCB: Validating primary data. [2025-09-29T20:47:57.478148] [FATAL] [VALIDATOR ] RCB: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T20:47:57.478890] [FATAL] [MAIN ] RCB: Fetched primary data is invalid. Refusing to save it. [2025-09-29T20:47:57.479310] [WARN ] [MAIN ] RCB: Deleting existing primary and derivative data due to validation failure. [2025-09-29T20:47:57.479399] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-09-29T20:47:57.479472] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-09-29T20:47:57.479511] [INFO ] [LOCAL ] RCB: Starting deletion of derivative data. [2025-09-29T20:47:57.479571] [DEBUG] [LOCAL ] RCB: No derivative data file found to delete. [2025-09-29T20:47:57.479689] [INFO ] [MAIN ] Update Progress: 1776/2371 symbols completed. RCB took 24.9s. Estimated remaining: 1h 16m 21s. Rate: 7.8 symbols/min [2025-09-29T20:47:57.657171] [INFO ] [MAIN ] RCS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:47:57.670863] [DEBUG] [LOCAL ] RCS: Loaded 11593 existing records from primary storage. [2025-09-29T20:47:57.671107] [INFO ] [MAIN ] RCS: Loaded 11593 existing records. [2025-09-29T20:47:57.867767] [WARN ] [MAIN ] RCS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:47:57.867995] [INFO ] [MAIN ] RCS: Wiping existing primary data before full refresh. [2025-09-29T20:47:57.868041] [INFO ] [LOCAL ] RCS: Starting deletion of primary data. [2025-09-29T20:47:57.868338] [DEBUG] [LOCAL ] RCS: Deleted primary data file. [2025-09-29T20:47:57.868396] [INFO ] [MAIN ] RCS: Starting full primary refresh. [2025-09-29T20:47:57.953255] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-02. [2025-09-29T20:47:58.261095] [INFO ] [REMOTE ] RCS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:47:58.748137] [INFO ] [REMOTE ] RCS: Fetching primary data for 2024-12. [2025-09-29T20:47:59.548132] [INFO ] [REMOTE ] RCI: Fetching primary data for 2024-12. [2025-09-29T20:47:59.627767] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-29T20:48:00.011594] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-29T20:48:00.348120] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-01. [2025-09-29T20:48:01.148287] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-08. [2025-09-29T20:48:01.151546] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-29T20:48:01.624718] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-29T20:48:01.638231] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-29T20:48:01.948160] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-01. [2025-09-29T20:48:02.748126] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-02. [2025-09-29T20:48:03.548090] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-09. [2025-09-29T20:48:03.782534] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-29T20:48:03.829772] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-29T20:48:03.952364] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-29T20:48:03.953906] [INFO ] [REMOTE ] RCD: Full fetch complete (6867 records). [2025-09-29T20:48:03.953987] [DEBUG] [VALIDATOR ] RCD: Validating primary data. [2025-09-29T20:48:03.954371] [FATAL] [VALIDATOR ] RCD: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T20:48:03.954455] [FATAL] [MAIN ] RCD: Fetched primary data is invalid. Refusing to save it. [2025-09-29T20:48:03.954499] [WARN ] [MAIN ] RCD: Deleting existing primary and derivative data due to validation failure. [2025-09-29T20:48:03.954540] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-09-29T20:48:03.954636] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-09-29T20:48:03.954933] [INFO ] [LOCAL ] RCD: Starting deletion of derivative data. [2025-09-29T20:48:03.955001] [DEBUG] [LOCAL ] RCD: No derivative data file found to delete. [2025-09-29T20:48:03.955059] [INFO ] [MAIN ] Update Progress: 1777/2371 symbols completed. RCD took 28.2s. Estimated remaining: 1h 16m 13s. Rate: 7.8 symbols/min [2025-09-29T20:48:04.129906] [INFO ] [MAIN ] RCUS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:48:04.174486] [DEBUG] [LOCAL ] RCUS: Loaded 43206 existing records from primary storage. [2025-09-29T20:48:04.174884] [INFO ] [MAIN ] RCUS: Loaded 43206 existing records. [2025-09-29T20:48:04.364230] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-03. [2025-09-29T20:48:04.407103] [WARN ] [MAIN ] RCUS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:48:04.408319] [INFO ] [MAIN ] RCUS: Wiping existing primary data before full refresh. [2025-09-29T20:48:04.408375] [INFO ] [LOCAL ] RCUS: Starting deletion of primary data. [2025-09-29T20:48:04.408778] [DEBUG] [LOCAL ] RCUS: Deleted primary data file. [2025-09-29T20:48:04.408842] [INFO ] [MAIN ] RCUS: Starting full primary refresh. [2025-09-29T20:48:04.811614] [INFO ] [REMOTE ] RCUS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:48:05.148132] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-02. [2025-09-29T20:48:05.375158] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-29T20:48:05.948133] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2024-12. [2025-09-29T20:48:06.748100] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-03. [2025-09-29T20:48:06.909039] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-29T20:48:07.100961] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-29T20:48:07.548157] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-04. [2025-09-29T20:48:08.348132] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-03. [2025-09-29T20:48:08.527524] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-29T20:48:08.998815] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-09-29T20:48:09.148163] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-04. [2025-09-29T20:48:09.948098] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-05. [2025-09-29T20:48:10.156622] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-29T20:48:10.748095] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-04. [2025-09-29T20:48:10.925404] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-29T20:48:11.117727] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-29T20:48:11.548167] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-05. [2025-09-29T20:48:12.348096] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-06. [2025-09-29T20:48:12.592970] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-29T20:48:13.148075] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-05. [2025-09-29T20:48:13.270302] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-29T20:48:13.409527] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-29T20:48:13.948123] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-07. [2025-09-29T20:48:14.748172] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-06. [2025-09-29T20:48:14.902962] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-29T20:48:15.059470] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-29T20:48:15.548175] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-08. [2025-09-29T20:48:16.338828] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-29T20:48:16.348081] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-09. [2025-09-29T20:48:16.526452] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-29T20:48:17.148142] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-01. [2025-09-29T20:48:17.226750] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-29T20:48:17.230322] [INFO ] [REMOTE ] RCS: Full fetch complete (19106 records). [2025-09-29T20:48:17.230705] [DEBUG] [VALIDATOR ] RCS: Validating primary data. [2025-09-29T20:48:17.616851] [DEBUG] [VALIDATOR ] RCS: All expected trading days are present. [2025-09-29T20:48:17.616954] [DEBUG] [VALIDATOR ] RCS: Primary data validation passed. [2025-09-29T20:48:17.617502] [INFO ] [MAIN ] RCS: Fetched primary data is valid. [2025-09-29T20:48:17.617569] [DEBUG] [LOCAL ] RCS: Saving primary data. [2025-09-29T20:48:17.618314] [DEBUG] [LOCAL ] RCS: Trimmed 19106 records to 11451 (keeping 200 days of data) [2025-09-29T20:48:17.698152] [DEBUG] [LOCAL ] RCS: Primary data saved (11451 records). [2025-09-29T20:48:17.698400] [INFO ] [MAIN ] RCS: Full history saved. [2025-09-29T20:48:17.698576] [INFO ] [MAIN ] Update Progress: 1778/2371 symbols completed. RCS took 20.2s. Estimated remaining: 1h 16m 7s. Rate: 7.8 symbols/min [2025-09-29T20:48:17.886418] [INFO ] [MAIN ] RDDT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:48:17.947314] [DEBUG] [LOCAL ] RDDT: Loaded 54563 existing records from primary storage. [2025-09-29T20:48:17.947724] [INFO ] [MAIN ] RDDT: Loaded 54563 existing records. [2025-09-29T20:48:17.959336] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-06. [2025-09-29T20:48:18.154358] [WARN ] [MAIN ] RDDT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:48:18.154706] [INFO ] [MAIN ] RDDT: Wiping existing primary data before full refresh. [2025-09-29T20:48:18.154778] [INFO ] [LOCAL ] RDDT: Starting deletion of primary data. [2025-09-29T20:48:18.155102] [DEBUG] [LOCAL ] RDDT: Deleted primary data file. [2025-09-29T20:48:18.155165] [INFO ] [MAIN ] RDDT: Starting full primary refresh. [2025-09-29T20:48:18.548092] [INFO ] [REMOTE ] RDDT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:48:18.692354] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-29T20:48:18.748074] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-02. [2025-09-29T20:48:19.494100] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-29T20:48:19.548096] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-07. [2025-09-29T20:48:20.340821] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-29T20:48:20.348854] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-07. [2025-09-29T20:48:21.148182] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2024-12. [2025-09-29T20:48:21.274099] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-29T20:48:21.948136] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-03. [2025-09-29T20:48:22.583587] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-29T20:48:22.748122] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-08. [2025-09-29T20:48:23.337364] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-29T20:48:23.548121] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-04. [2025-09-29T20:48:23.679318] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2024-12 (2.53 seconds). [2025-09-29T20:48:24.348162] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-01. [2025-09-29T20:48:24.762772] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-29T20:48:25.148159] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-09. [2025-09-29T20:48:25.202583] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-29T20:48:25.730589] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-29T20:48:25.740979] [INFO ] [REMOTE ] RCL: Full fetch complete (75030 records). [2025-09-29T20:48:25.741155] [DEBUG] [VALIDATOR ] RCL: Validating primary data. [2025-09-29T20:48:25.742032] [FATAL] [VALIDATOR ] RCL: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T20:48:25.742133] [FATAL] [MAIN ] RCL: Fetched primary data is invalid. Refusing to save it. [2025-09-29T20:48:25.742180] [WARN ] [MAIN ] RCL: Deleting existing primary and derivative data due to validation failure. [2025-09-29T20:48:25.742226] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-09-29T20:48:25.742313] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-09-29T20:48:25.742371] [INFO ] [LOCAL ] RCL: Starting deletion of derivative data. [2025-09-29T20:48:25.743093] [DEBUG] [LOCAL ] RCL: Deleted derivative data file. [2025-09-29T20:48:25.746345] [INFO ] [MAIN ] Update Progress: 1779/2371 symbols completed. RCL took 33.7s. Estimated remaining: 1h 15m 60s. Rate: 7.8 symbols/min [2025-09-29T20:48:25.940835] [INFO ] [MAIN ] RDN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:48:25.948146] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-05. [2025-09-29T20:48:26.000521] [DEBUG] [LOCAL ] RDN: Loaded 45976 existing records from primary storage. [2025-09-29T20:48:26.000891] [INFO ] [MAIN ] RDN: Loaded 45976 existing records. [2025-09-29T20:48:26.186670] [WARN ] [MAIN ] RDN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:48:26.186918] [INFO ] [MAIN ] RDN: Wiping existing primary data before full refresh. [2025-09-29T20:48:26.186967] [INFO ] [LOCAL ] RDN: Starting deletion of primary data. [2025-09-29T20:48:26.187329] [DEBUG] [LOCAL ] RDN: Deleted primary data file. [2025-09-29T20:48:26.187406] [INFO ] [MAIN ] RDN: Starting full primary refresh. [2025-09-29T20:48:26.573214] [INFO ] [REMOTE ] RDN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:48:26.748132] [INFO ] [REMOTE ] RDN: Fetching primary data for 2024-12. [2025-09-29T20:48:26.863745] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-01 (2.52 seconds). [2025-09-29T20:48:27.428638] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-29T20:48:27.548118] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-02. [2025-09-29T20:48:28.348327] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-08. [2025-09-29T20:48:28.417509] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-29T20:48:29.148123] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-06. [2025-09-29T20:48:29.948089] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-01. [2025-09-29T20:48:30.051397] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-09-29T20:48:30.136814] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-29T20:48:30.748135] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-09. [2025-09-29T20:48:30.801922] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-29T20:48:31.433402] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-29T20:48:31.548103] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-02. [2025-09-29T20:48:32.355159] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-03. [2025-09-29T20:48:32.373993] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-29T20:48:32.386380] [INFO ] [REMOTE ] RCI: Full fetch complete (70505 records). [2025-09-29T20:48:32.386548] [DEBUG] [VALIDATOR ] RCI: Validating primary data. [2025-09-29T20:48:32.820383] [DEBUG] [VALIDATOR ] RCI: All expected trading days are present. [2025-09-29T20:48:32.820475] [DEBUG] [VALIDATOR ] RCI: Primary data validation passed. [2025-09-29T20:48:32.821750] [INFO ] [MAIN ] RCI: Fetched primary data is valid. [2025-09-29T20:48:32.821822] [DEBUG] [LOCAL ] RCI: Saving primary data. [2025-09-29T20:48:32.823328] [DEBUG] [LOCAL ] RCI: Trimmed 70505 records to 48607 (keeping 200 days of data) [2025-09-29T20:48:33.148197] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-07. [2025-09-29T20:48:33.151076] [DEBUG] [LOCAL ] RCI: Primary data saved (48607 records). [2025-09-29T20:48:33.151151] [INFO ] [MAIN ] RCI: Full history saved. [2025-09-29T20:48:33.151275] [INFO ] [MAIN ] Update Progress: 1780/2371 symbols completed. RCI took 43.1s. Estimated remaining: 1h 15m 52s. Rate: 7.8 symbols/min [2025-09-29T20:48:33.332054] [INFO ] [MAIN ] RDW: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:48:33.360432] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-29T20:48:33.428402] [DEBUG] [LOCAL ] RDW: Loaded 52794 existing records from primary storage. [2025-09-29T20:48:33.428767] [INFO ] [MAIN ] RDW: Loaded 52794 existing records. [2025-09-29T20:48:33.609121] [WARN ] [MAIN ] RDW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:48:33.609353] [INFO ] [MAIN ] RDW: Wiping existing primary data before full refresh. [2025-09-29T20:48:33.609403] [INFO ] [LOCAL ] RDW: Starting deletion of primary data. [2025-09-29T20:48:33.609882] [DEBUG] [LOCAL ] RDW: Deleted primary data file. [2025-09-29T20:48:33.609943] [INFO ] [MAIN ] RDW: Starting full primary refresh. [2025-09-29T20:48:33.953327] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-03. [2025-09-29T20:48:33.986033] [INFO ] [REMOTE ] RDW: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:48:34.708798] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-29T20:48:34.748119] [INFO ] [REMOTE ] RDW: Fetching primary data for 2024-12. [2025-09-29T20:48:34.831833] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-09-29T20:48:35.548114] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-04. [2025-09-29T20:48:35.847382] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-29T20:48:36.348087] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-04. [2025-09-29T20:48:36.776849] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-29T20:48:37.148105] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-01. [2025-09-29T20:48:37.948087] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-08. [2025-09-29T20:48:38.015712] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-29T20:48:38.300054] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-04 (2.75 seconds). [2025-09-29T20:48:38.748115] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-05. [2025-09-29T20:48:39.451169] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-09-29T20:48:39.537247] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-29T20:48:39.548071] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-09. [2025-09-29T20:48:40.348093] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-05. [2025-09-29T20:48:40.425997] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-29T20:48:40.892980] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-29T20:48:40.901856] [INFO ] [REMOTE ] RCUS: Full fetch complete (60166 records). [2025-09-29T20:48:40.902043] [DEBUG] [VALIDATOR ] RCUS: Validating primary data. [2025-09-29T20:48:41.153217] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-02. [2025-09-29T20:48:41.309597] [DEBUG] [VALIDATOR ] RCUS: All expected trading days are present. [2025-09-29T20:48:41.309729] [DEBUG] [VALIDATOR ] RCUS: Primary data validation passed. [2025-09-29T20:48:41.310784] [INFO ] [MAIN ] RCUS: Fetched primary data is valid. [2025-09-29T20:48:41.310867] [DEBUG] [LOCAL ] RCUS: Saving primary data. [2025-09-29T20:48:41.312209] [DEBUG] [LOCAL ] RCUS: Trimmed 60166 records to 42401 (keeping 200 days of data) [2025-09-29T20:48:41.579501] [DEBUG] [LOCAL ] RCUS: Primary data saved (42401 records). [2025-09-29T20:48:41.579692] [INFO ] [MAIN ] RCUS: Full history saved. [2025-09-29T20:48:41.579848] [INFO ] [MAIN ] Update Progress: 1781/2371 symbols completed. RCUS took 37.6s. Estimated remaining: 1h 15m 45s. Rate: 7.8 symbols/min [2025-09-29T20:48:41.789310] [INFO ] [MAIN ] RDY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:48:41.845784] [DEBUG] [LOCAL ] RDY: Loaded 47418 existing records from primary storage. [2025-09-29T20:48:41.846133] [INFO ] [MAIN ] RDY: Loaded 47418 existing records. [2025-09-29T20:48:41.950020] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-06. [2025-09-29T20:48:42.034109] [WARN ] [MAIN ] RDY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:48:42.034373] [INFO ] [MAIN ] RDY: Wiping existing primary data before full refresh. [2025-09-29T20:48:42.034422] [INFO ] [LOCAL ] RDY: Starting deletion of primary data. [2025-09-29T20:48:42.035260] [DEBUG] [LOCAL ] RDY: Deleted primary data file. [2025-09-29T20:48:42.035320] [INFO ] [MAIN ] RDY: Starting full primary refresh. [2025-09-29T20:48:42.409692] [INFO ] [REMOTE ] RDY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:48:42.748165] [INFO ] [REMOTE ] RDY: Fetching primary data for 2024-12. [2025-09-29T20:48:43.032508] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-29T20:48:43.112307] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-05 (2.76 seconds). [2025-09-29T20:48:43.548099] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-03. [2025-09-29T20:48:43.655468] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-29T20:48:44.348171] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-07. [2025-09-29T20:48:44.577256] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-29T20:48:45.148080] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-01. [2025-09-29T20:48:45.525390] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-29T20:48:45.948097] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-04. [2025-09-29T20:48:45.983317] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-29T20:48:46.563132] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-29T20:48:46.748110] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-08. [2025-09-29T20:48:47.548148] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-02. [2025-09-29T20:48:47.961494] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-29T20:48:48.266438] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-29T20:48:48.348268] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-05. [2025-09-29T20:48:49.148147] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-06. [2025-09-29T20:48:49.277444] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-29T20:48:49.948198] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-03. [2025-09-29T20:48:50.553148] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-29T20:48:50.748151] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-06. [2025-09-29T20:48:51.398611] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-29T20:48:51.548120] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-09. [2025-09-29T20:48:51.679204] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-29T20:48:52.348158] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-04. [2025-09-29T20:48:52.831831] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-29T20:48:53.109968] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-29T20:48:53.119095] [INFO ] [REMOTE ] RDN: Full fetch complete (65939 records). [2025-09-29T20:48:53.119288] [DEBUG] [VALIDATOR ] RDN: Validating primary data. [2025-09-29T20:48:53.153255] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-07. [2025-09-29T20:48:53.560142] [DEBUG] [VALIDATOR ] RDN: All expected trading days are present. [2025-09-29T20:48:53.560290] [DEBUG] [VALIDATOR ] RDN: Primary data validation passed. [2025-09-29T20:48:53.561915] [INFO ] [MAIN ] RDN: Fetched primary data is valid. [2025-09-29T20:48:53.562046] [DEBUG] [LOCAL ] RDN: Saving primary data. [2025-09-29T20:48:53.564053] [DEBUG] [LOCAL ] RDN: Trimmed 65939 records to 45150 (keeping 200 days of data) [2025-09-29T20:48:53.897241] [DEBUG] [LOCAL ] RDN: Primary data saved (45150 records). [2025-09-29T20:48:53.897394] [INFO ] [MAIN ] RDN: Full history saved. [2025-09-29T20:48:53.897510] [INFO ] [MAIN ] Update Progress: 1782/2371 symbols completed. RDN took 28.2s. Estimated remaining: 1h 15m 38s. Rate: 7.8 symbols/min [2025-09-29T20:48:53.954232] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-07. [2025-09-29T20:48:54.079929] [INFO ] [MAIN ] RELX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:48:54.136106] [DEBUG] [LOCAL ] RELX: Loaded 48567 existing records from primary storage. [2025-09-29T20:48:54.136440] [INFO ] [MAIN ] RELX: Loaded 48567 existing records. [2025-09-29T20:48:54.359982] [WARN ] [MAIN ] RELX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:48:54.361050] [INFO ] [MAIN ] RELX: Wiping existing primary data before full refresh. [2025-09-29T20:48:54.362770] [INFO ] [LOCAL ] RELX: Starting deletion of primary data. [2025-09-29T20:48:54.362633] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-29T20:48:54.373133] [DEBUG] [LOCAL ] RELX: Deleted primary data file. [2025-09-29T20:48:54.373249] [INFO ] [MAIN ] RELX: Starting full primary refresh. [2025-09-29T20:48:54.748750] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-05. [2025-09-29T20:48:54.748545] [INFO ] [REMOTE ] RELX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:48:55.548233] [INFO ] [REMOTE ] RELX: Fetching primary data for 2024-12. [2025-09-29T20:48:55.721861] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-09-29T20:48:56.348090] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-08. [2025-09-29T20:48:56.459713] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-29T20:48:56.726504] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-07 (2.77 seconds). [2025-09-29T20:48:56.949354] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-29T20:48:57.148133] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-01. [2025-09-29T20:48:57.948149] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-06. [2025-09-29T20:48:58.706519] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-29T20:48:58.748097] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-02. [2025-09-29T20:48:58.784764] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-09-29T20:48:59.216080] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-29T20:48:59.548119] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-08. [2025-09-29T20:49:00.348119] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-07. [2025-09-29T20:49:00.393979] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-29T20:49:01.148155] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-03. [2025-09-29T20:49:01.948139] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-09. [2025-09-29T20:49:02.097678] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-29T20:49:02.360956] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-08 (2.81 seconds). [2025-09-29T20:49:02.507222] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-29T20:49:02.748139] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-08. [2025-09-29T20:49:03.548155] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-09. [2025-09-29T20:49:04.348103] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-04. [2025-09-29T20:49:04.423249] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-29T20:49:04.465961] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-09-29T20:49:04.477009] [INFO ] [REMOTE ] RDW: Full fetch complete (74594 records). [2025-09-29T20:49:04.477195] [DEBUG] [VALIDATOR ] RDW: Validating primary data. [2025-09-29T20:49:04.883134] [DEBUG] [VALIDATOR ] RDW: All expected trading days are present. [2025-09-29T20:49:04.883310] [DEBUG] [VALIDATOR ] RDW: Primary data validation passed. [2025-09-29T20:49:04.886507] [INFO ] [MAIN ] RDW: Fetched primary data is valid. [2025-09-29T20:49:04.886590] [DEBUG] [LOCAL ] RDW: Saving primary data. [2025-09-29T20:49:04.889180] [DEBUG] [LOCAL ] RDW: Trimmed 74594 records to 52017 (keeping 200 days of data) [2025-09-29T20:49:05.149708] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-09. [2025-09-29T20:49:05.228620] [DEBUG] [LOCAL ] RDW: Primary data saved (52017 records). [2025-09-29T20:49:05.228878] [INFO ] [MAIN ] RDW: Full history saved. [2025-09-29T20:49:05.229019] [INFO ] [MAIN ] Update Progress: 1783/2371 symbols completed. RDW took 32.1s. Estimated remaining: 1h 15m 32s. Rate: 7.8 symbols/min [2025-09-29T20:49:05.404761] [INFO ] [MAIN ] RERE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:49:05.457102] [DEBUG] [LOCAL ] RERE: Loaded 41690 existing records from primary storage. [2025-09-29T20:49:05.457570] [INFO ] [MAIN ] RERE: Loaded 41690 existing records. [2025-09-29T20:49:05.649215] [WARN ] [MAIN ] RERE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:49:05.649556] [INFO ] [MAIN ] RERE: Wiping existing primary data before full refresh. [2025-09-29T20:49:05.649623] [INFO ] [LOCAL ] RERE: Starting deletion of primary data. [2025-09-29T20:49:05.650039] [DEBUG] [LOCAL ] RERE: Deleted primary data file. [2025-09-29T20:49:05.650102] [INFO ] [MAIN ] RERE: Starting full primary refresh. [2025-09-29T20:49:06.028551] [INFO ] [REMOTE ] RERE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:49:06.029117] [INFO ] [REMOTE ] RERE: Fetching primary data for 2024-12. [2025-09-29T20:49:06.061540] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-29T20:49:06.266008] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-09 (2.72 seconds). [2025-09-29T20:49:06.277235] [INFO ] [REMOTE ] RDDT: Full fetch complete (77888 records). [2025-09-29T20:49:06.277405] [DEBUG] [VALIDATOR ] RDDT: Validating primary data. [2025-09-29T20:49:06.741209] [DEBUG] [VALIDATOR ] RDDT: All expected trading days are present. [2025-09-29T20:49:06.741455] [DEBUG] [VALIDATOR ] RDDT: Primary data validation passed. [2025-09-29T20:49:06.742850] [INFO ] [MAIN ] RDDT: Fetched primary data is valid. [2025-09-29T20:49:06.742930] [DEBUG] [LOCAL ] RDDT: Saving primary data. [2025-09-29T20:49:06.744519] [DEBUG] [LOCAL ] RDDT: Trimmed 77888 records to 53781 (keeping 200 days of data) [2025-09-29T20:49:06.748111] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-05. [2025-09-29T20:49:06.869559] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-29T20:49:06.880573] [INFO ] [REMOTE ] RDY: Full fetch complete (68967 records). [2025-09-29T20:49:06.881362] [DEBUG] [VALIDATOR ] RDY: Validating primary data. [2025-09-29T20:49:07.316408] [DEBUG] [VALIDATOR ] RDY: All expected trading days are present. [2025-09-29T20:49:07.318114] [DEBUG] [VALIDATOR ] RDY: Primary data validation passed. [2025-09-29T20:49:07.320331] [INFO ] [MAIN ] RDY: Fetched primary data is valid. [2025-09-29T20:49:07.321059] [DEBUG] [LOCAL ] RDY: Saving primary data. [2025-09-29T20:49:07.325781] [DEBUG] [LOCAL ] RDY: Trimmed 68967 records to 46769 (keeping 200 days of data) [2025-09-29T20:49:07.575894] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-29T20:49:07.588085] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-01. [2025-09-29T20:49:07.889313] [DEBUG] [LOCAL ] RDDT: Primary data saved (53781 records). [2025-09-29T20:49:07.889865] [INFO ] [MAIN ] RDDT: Full history saved. [2025-09-29T20:49:07.890544] [INFO ] [MAIN ] Update Progress: 1784/2371 symbols completed. RDDT took 50.2s. Estimated remaining: 1h 15m 23s. Rate: 7.8 symbols/min [2025-09-29T20:49:08.120023] [INFO ] [MAIN ] RES: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:49:08.130910] [DEBUG] [LOCAL ] RDY: Primary data saved (46769 records). [2025-09-29T20:49:08.131073] [INFO ] [MAIN ] RDY: Full history saved. [2025-09-29T20:49:08.131214] [INFO ] [MAIN ] Update Progress: 1785/2371 symbols completed. RDY took 26.6s. Estimated remaining: 1h 15m 12s. Rate: 7.8 symbols/min [2025-09-29T20:49:08.345137] [INFO ] [MAIN ] REVG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:49:08.362841] [DEBUG] [LOCAL ] RES: Loaded 48190 existing records from primary storage. [2025-09-29T20:49:08.363255] [INFO ] [MAIN ] RES: Loaded 48190 existing records. [2025-09-29T20:49:08.574611] [WARN ] [MAIN ] RES: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:49:08.575179] [INFO ] [MAIN ] RES: Wiping existing primary data before full refresh. [2025-09-29T20:49:08.575273] [INFO ] [LOCAL ] RES: Starting deletion of primary data. [2025-09-29T20:49:08.575915] [DEBUG] [LOCAL ] RES: Deleted primary data file. [2025-09-29T20:49:08.576063] [INFO ] [MAIN ] RES: Starting full primary refresh. [2025-09-29T20:49:08.661565] [DEBUG] [LOCAL ] REVG: Loaded 41461 existing records from primary storage. [2025-09-29T20:49:08.680307] [INFO ] [MAIN ] REVG: Loaded 41461 existing records. [2025-09-29T20:49:08.857449] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-29T20:49:09.027860] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-06. [2025-09-29T20:49:09.118226] [WARN ] [MAIN ] REVG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:49:09.147363] [INFO ] [MAIN ] REVG: Wiping existing primary data before full refresh. [2025-09-29T20:49:09.147851] [INFO ] [LOCAL ] REVG: Starting deletion of primary data. [2025-09-29T20:49:09.158900] [DEBUG] [LOCAL ] REVG: Deleted primary data file. [2025-09-29T20:49:09.169400] [INFO ] [MAIN ] REVG: Starting full primary refresh. [2025-09-29T20:49:09.267528] [INFO ] [REMOTE ] RES: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:49:09.309383] [INFO ] [REMOTE ] RES: Fetching primary data for 2024-12. [2025-09-29T20:49:09.364045] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-29T20:49:09.636719] [INFO ] [REMOTE ] REVG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:49:09.948112] [INFO ] [REMOTE ] REVG: Fetching primary data for 2024-12. [2025-09-29T20:49:10.748089] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-02. [2025-09-29T20:49:10.796119] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-29T20:49:11.028003] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-29T20:49:11.473188] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-29T20:49:11.548137] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-01. [2025-09-29T20:49:12.156075] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-29T20:49:12.348131] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-01. [2025-09-29T20:49:12.884530] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-29T20:49:13.148131] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-07. [2025-09-29T20:49:13.576045] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-29T20:49:13.948123] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-02. [2025-09-29T20:49:14.748112] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-03. [2025-09-29T20:49:14.956978] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-29T20:49:15.411761] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-29T20:49:15.548130] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-02. [2025-09-29T20:49:16.182794] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-29T20:49:16.348113] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-03. [2025-09-29T20:49:16.858974] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-29T20:49:17.148147] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-04. [2025-09-29T20:49:17.846728] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-29T20:49:17.948135] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-04. [2025-09-29T20:49:18.621177] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-29T20:49:18.748112] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-05. [2025-09-29T20:49:19.309592] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-29T20:49:19.548127] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-05. [2025-09-29T20:49:20.210098] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-29T20:49:20.348103] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-06. [2025-09-29T20:49:20.958501] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-29T20:49:21.148133] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-08. [2025-09-29T20:49:21.667613] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-29T20:49:21.948110] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-03. [2025-09-29T20:49:22.748131] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-06. [2025-09-29T20:49:22.889926] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-29T20:49:23.548089] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-07. [2025-09-29T20:49:23.658900] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-29T20:49:24.348114] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-04. [2025-09-29T20:49:24.394476] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-29T20:49:25.148116] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-09. [2025-09-29T20:49:25.272929] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-29T20:49:25.721174] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-29T20:49:25.948121] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-05. [2025-09-29T20:49:26.560850] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-29T20:49:26.571450] [INFO ] [REMOTE ] RELX: Full fetch complete (67160 records). [2025-09-29T20:49:26.571601] [DEBUG] [VALIDATOR ] RELX: Validating primary data. [2025-09-29T20:49:26.753210] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-08. [2025-09-29T20:49:26.983152] [DEBUG] [VALIDATOR ] RELX: All expected trading days are present. [2025-09-29T20:49:26.983249] [DEBUG] [VALIDATOR ] RELX: Primary data validation passed. [2025-09-29T20:49:26.984404] [INFO ] [MAIN ] RELX: Fetched primary data is valid. [2025-09-29T20:49:26.984487] [DEBUG] [LOCAL ] RELX: Saving primary data. [2025-09-29T20:49:26.986254] [DEBUG] [LOCAL ] RELX: Trimmed 67160 records to 47858 (keeping 200 days of data) [2025-09-29T20:49:27.294090] [DEBUG] [LOCAL ] RELX: Primary data saved (47858 records). [2025-09-29T20:49:27.294241] [INFO ] [MAIN ] RELX: Full history saved. [2025-09-29T20:49:27.294328] [INFO ] [MAIN ] Update Progress: 1786/2371 symbols completed. RELX took 33.4s. Estimated remaining: 1h 15m 8s. Rate: 7.8 symbols/min [2025-09-29T20:49:27.481712] [INFO ] [MAIN ] REX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:49:27.509699] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-29T20:49:27.531970] [DEBUG] [LOCAL ] REX: Loaded 14221 existing records from primary storage. [2025-09-29T20:49:27.532220] [INFO ] [MAIN ] REX: Loaded 14221 existing records. [2025-09-29T20:49:27.554204] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-07. [2025-09-29T20:49:27.736097] [WARN ] [MAIN ] REX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:49:27.736329] [INFO ] [MAIN ] REX: Wiping existing primary data before full refresh. [2025-09-29T20:49:27.736380] [INFO ] [LOCAL ] REX: Starting deletion of primary data. [2025-09-29T20:49:27.736676] [DEBUG] [LOCAL ] REX: Deleted primary data file. [2025-09-29T20:49:27.736737] [INFO ] [MAIN ] REX: Starting full primary refresh. [2025-09-29T20:49:28.116749] [INFO ] [REMOTE ] REX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:49:28.255602] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-29T20:49:28.348084] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-09. [2025-09-29T20:49:29.124153] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-29T20:49:29.148066] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-08. [2025-09-29T20:49:29.904137] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-29T20:49:29.913870] [INFO ] [REMOTE ] RERE: Full fetch complete (57437 records). [2025-09-29T20:49:29.914011] [DEBUG] [VALIDATOR ] RERE: Validating primary data. [2025-09-29T20:49:29.953247] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-06. [2025-09-29T20:49:30.331624] [DEBUG] [VALIDATOR ] RERE: All expected trading days are present. [2025-09-29T20:49:30.331745] [DEBUG] [VALIDATOR ] RERE: Primary data validation passed. [2025-09-29T20:49:30.332935] [INFO ] [MAIN ] RERE: Fetched primary data is valid. [2025-09-29T20:49:30.333011] [DEBUG] [LOCAL ] RERE: Saving primary data. [2025-09-29T20:49:30.334488] [DEBUG] [LOCAL ] RERE: Trimmed 57437 records to 41027 (keeping 200 days of data) [2025-09-29T20:49:30.585185] [DEBUG] [LOCAL ] RERE: Primary data saved (41027 records). [2025-09-29T20:49:30.585320] [INFO ] [MAIN ] RERE: Full history saved. [2025-09-29T20:49:30.585409] [INFO ] [MAIN ] Update Progress: 1787/2371 symbols completed. RERE took 25.4s. Estimated remaining: 1h 14m 59s. Rate: 7.8 symbols/min [2025-09-29T20:49:30.770914] [INFO ] [REMOTE ] REX: Fetching primary data for 2024-12. [2025-09-29T20:49:30.778022] [INFO ] [MAIN ] REXR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:49:30.806454] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-29T20:49:30.867803] [DEBUG] [LOCAL ] REXR: Loaded 52852 existing records from primary storage. [2025-09-29T20:49:30.868150] [INFO ] [MAIN ] REXR: Loaded 52852 existing records. [2025-09-29T20:49:31.053691] [WARN ] [MAIN ] REXR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:49:31.053907] [INFO ] [MAIN ] REXR: Wiping existing primary data before full refresh. [2025-09-29T20:49:31.053957] [INFO ] [LOCAL ] REXR: Starting deletion of primary data. [2025-09-29T20:49:31.054551] [DEBUG] [LOCAL ] REXR: Deleted primary data file. [2025-09-29T20:49:31.054611] [INFO ] [MAIN ] REXR: Starting full primary refresh. [2025-09-29T20:49:31.429995] [INFO ] [REMOTE ] REXR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:49:31.548102] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-09. [2025-09-29T20:49:31.742824] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-29T20:49:31.813402] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-29T20:49:32.348092] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-01. [2025-09-29T20:49:33.148079] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-07. [2025-09-29T20:49:33.250713] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-29T20:49:33.260016] [INFO ] [REMOTE ] REVG: Full fetch complete (58364 records). [2025-09-29T20:49:33.260133] [DEBUG] [VALIDATOR ] REVG: Validating primary data. [2025-09-29T20:49:33.441062] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-29T20:49:33.691499] [DEBUG] [VALIDATOR ] REVG: All expected trading days are present. [2025-09-29T20:49:33.691635] [DEBUG] [VALIDATOR ] REVG: Primary data validation passed. [2025-09-29T20:49:33.692953] [INFO ] [MAIN ] REVG: Fetched primary data is valid. [2025-09-29T20:49:33.693028] [DEBUG] [LOCAL ] REVG: Saving primary data. [2025-09-29T20:49:33.694699] [DEBUG] [LOCAL ] REVG: Trimmed 58364 records to 40770 (keeping 200 days of data) [2025-09-29T20:49:33.948377] [INFO ] [REMOTE ] REXR: Fetching primary data for 2024-12. [2025-09-29T20:49:33.968485] [DEBUG] [LOCAL ] REVG: Primary data saved (40770 records). [2025-09-29T20:49:33.968626] [INFO ] [MAIN ] REVG: Full history saved. [2025-09-29T20:49:33.968776] [INFO ] [MAIN ] Update Progress: 1788/2371 symbols completed. REVG took 25.8s. Estimated remaining: 1h 14m 50s. Rate: 7.8 symbols/min [2025-09-29T20:49:34.151044] [INFO ] [MAIN ] REZI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:49:34.203050] [DEBUG] [LOCAL ] REZI: Loaded 47576 existing records from primary storage. [2025-09-29T20:49:34.203399] [INFO ] [MAIN ] REZI: Loaded 47576 existing records. [2025-09-29T20:49:34.392825] [WARN ] [MAIN ] REZI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:49:34.393112] [INFO ] [MAIN ] REZI: Wiping existing primary data before full refresh. [2025-09-29T20:49:34.393164] [INFO ] [LOCAL ] REZI: Starting deletion of primary data. [2025-09-29T20:49:34.393530] [DEBUG] [LOCAL ] REZI: Deleted primary data file. [2025-09-29T20:49:34.393588] [INFO ] [MAIN ] REZI: Starting full primary refresh. [2025-09-29T20:49:34.762711] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-02. [2025-09-29T20:49:34.768724] [INFO ] [REMOTE ] REZI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:49:34.798925] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-29T20:49:35.548089] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-08. [2025-09-29T20:49:35.763325] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-29T20:49:35.801532] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-29T20:49:36.348119] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-03. [2025-09-29T20:49:37.148124] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-01. [2025-09-29T20:49:37.179284] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-29T20:49:37.296600] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-29T20:49:37.948114] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-04. [2025-09-29T20:49:38.748158] [INFO ] [REMOTE ] REZI: Fetching primary data for 2024-12. [2025-09-29T20:49:38.881584] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-29T20:49:38.938559] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-29T20:49:39.548121] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-05. [2025-09-29T20:49:40.311237] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-29T20:49:40.353238] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-09. [2025-09-29T20:49:40.362754] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-29T20:49:41.148220] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-02. [2025-09-29T20:49:41.948133] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-01. [2025-09-29T20:49:42.002925] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-29T20:49:42.013029] [INFO ] [REMOTE ] RES: Full fetch complete (69038 records). [2025-09-29T20:49:42.013187] [DEBUG] [VALIDATOR ] RES: Validating primary data. [2025-09-29T20:49:42.428027] [DEBUG] [VALIDATOR ] RES: All expected trading days are present. [2025-09-29T20:49:42.428151] [DEBUG] [VALIDATOR ] RES: Primary data validation passed. [2025-09-29T20:49:42.429340] [INFO ] [MAIN ] RES: Fetched primary data is valid. [2025-09-29T20:49:42.429409] [DEBUG] [LOCAL ] RES: Saving primary data. [2025-09-29T20:49:42.430820] [DEBUG] [LOCAL ] RES: Trimmed 69038 records to 47471 (keeping 200 days of data) [2025-09-29T20:49:42.708893] [DEBUG] [LOCAL ] RES: Primary data saved (47471 records). [2025-09-29T20:49:42.709027] [INFO ] [MAIN ] RES: Full history saved. [2025-09-29T20:49:42.709112] [INFO ] [MAIN ] Update Progress: 1789/2371 symbols completed. RES took 34.8s. Estimated remaining: 1h 14m 43s. Rate: 7.8 symbols/min [2025-09-29T20:49:42.753225] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-06. [2025-09-29T20:49:42.892407] [INFO ] [MAIN ] RF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:49:42.946592] [DEBUG] [LOCAL ] RF: Loaded 54410 existing records from primary storage. [2025-09-29T20:49:42.947097] [INFO ] [MAIN ] RF: Loaded 54410 existing records. [2025-09-29T20:49:43.159956] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-29T20:49:43.183188] [WARN ] [MAIN ] RF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:49:43.192581] [INFO ] [MAIN ] RF: Wiping existing primary data before full refresh. [2025-09-29T20:49:43.193324] [INFO ] [LOCAL ] RF: Starting deletion of primary data. [2025-09-29T20:49:43.194764] [DEBUG] [LOCAL ] RF: Deleted primary data file. [2025-09-29T20:49:43.194830] [INFO ] [MAIN ] RF: Starting full primary refresh. [2025-09-29T20:49:43.566097] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-03. [2025-09-29T20:49:43.595628] [INFO ] [REMOTE ] RF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:49:43.620631] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-29T20:49:43.621865] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-29T20:49:44.348126] [INFO ] [REMOTE ] RF: Fetching primary data for 2024-12. [2025-09-29T20:49:45.148088] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-02. [2025-09-29T20:49:45.397962] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-29T20:49:45.948109] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-04. [2025-09-29T20:49:46.018543] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-29T20:49:46.194196] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-29T20:49:46.748131] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-03. [2025-09-29T20:49:47.548127] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-07. [2025-09-29T20:49:47.746605] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-29T20:49:48.306248] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-29T20:49:48.346063] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-29T20:49:48.349379] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-04. [2025-09-29T20:49:49.148142] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-01. [2025-09-29T20:49:49.781062] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-29T20:49:49.948122] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-05. [2025-09-29T20:49:50.748174] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-08. [2025-09-29T20:49:50.944352] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-29T20:49:51.548085] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-02. [2025-09-29T20:49:51.620077] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-29T20:49:51.969950] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-29T20:49:52.348103] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-05. [2025-09-29T20:49:53.080404] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-29T20:49:53.148166] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-09. [2025-09-29T20:49:53.703427] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-29T20:49:53.948170] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-03. [2025-09-29T20:49:54.198956] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-29T20:49:54.203525] [INFO ] [REMOTE ] REX: Full fetch complete (21069 records). [2025-09-29T20:49:54.203666] [DEBUG] [VALIDATOR ] REX: Validating primary data. [2025-09-29T20:49:54.590588] [DEBUG] [VALIDATOR ] REX: All expected trading days are present. [2025-09-29T20:49:54.590708] [DEBUG] [VALIDATOR ] REX: Primary data validation passed. [2025-09-29T20:49:54.591203] [INFO ] [MAIN ] REX: Fetched primary data is valid. [2025-09-29T20:49:54.591301] [DEBUG] [LOCAL ] REX: Saving primary data. [2025-09-29T20:49:54.592116] [DEBUG] [LOCAL ] REX: Trimmed 21069 records to 14051 (keeping 200 days of data) [2025-09-29T20:49:54.680513] [DEBUG] [LOCAL ] REX: Primary data saved (14051 records). [2025-09-29T20:49:54.680690] [INFO ] [MAIN ] REX: Full history saved. [2025-09-29T20:49:54.680805] [INFO ] [MAIN ] Update Progress: 1790/2371 symbols completed. REX took 27.4s. Estimated remaining: 1h 14m 37s. Rate: 7.8 symbols/min [2025-09-29T20:49:54.756487] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-06. [2025-09-29T20:49:54.862058] [INFO ] [MAIN ] RFI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:49:54.876723] [DEBUG] [LOCAL ] RFI: Loaded 10550 existing records from primary storage. [2025-09-29T20:49:54.876979] [INFO ] [MAIN ] RFI: Loaded 10550 existing records. [2025-09-29T20:49:55.060527] [WARN ] [MAIN ] RFI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:49:55.060870] [INFO ] [MAIN ] RFI: Wiping existing primary data before full refresh. [2025-09-29T20:49:55.060922] [INFO ] [LOCAL ] RFI: Starting deletion of primary data. [2025-09-29T20:49:55.061237] [DEBUG] [LOCAL ] RFI: Deleted primary data file. [2025-09-29T20:49:55.061296] [INFO ] [MAIN ] RFI: Starting full primary refresh. [2025-09-29T20:49:55.428581] [INFO ] [REMOTE ] RFI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:49:55.548108] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-06. [2025-09-29T20:49:55.840166] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-29T20:49:56.348118] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-04. [2025-09-29T20:49:56.444443] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-29T20:49:57.035472] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-29T20:49:57.148154] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-07. [2025-09-29T20:49:57.948081] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-07. [2025-09-29T20:49:58.080521] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-29T20:49:58.748095] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-05. [2025-09-29T20:49:58.835700] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-29T20:49:59.548082] [INFO ] [REMOTE ] RFI: Fetching primary data for 2024-12. [2025-09-29T20:49:59.648146] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-29T20:50:00.348075] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-08. [2025-09-29T20:50:00.365375] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-29T20:50:01.148087] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-01. [2025-09-29T20:50:01.329477] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-05 (2.58 seconds). [2025-09-29T20:50:01.811737] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-29T20:50:01.948152] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-08. [2025-09-29T20:50:02.144082] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-29T20:50:02.748181] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-09. [2025-09-29T20:50:03.548153] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-02. [2025-09-29T20:50:03.929603] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-29T20:50:04.348184] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-09. [2025-09-29T20:50:04.480360] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-29T20:50:04.723570] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-29T20:50:04.734504] [INFO ] [REMOTE ] REXR: Full fetch complete (75116 records). [2025-09-29T20:50:04.734666] [DEBUG] [VALIDATOR ] REXR: Validating primary data. [2025-09-29T20:50:05.161242] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-06. [2025-09-29T20:50:05.187930] [DEBUG] [VALIDATOR ] REXR: All expected trading days are present. [2025-09-29T20:50:05.188030] [DEBUG] [VALIDATOR ] REXR: Primary data validation passed. [2025-09-29T20:50:05.189297] [INFO ] [MAIN ] REXR: Fetched primary data is valid. [2025-09-29T20:50:05.189368] [DEBUG] [LOCAL ] REXR: Saving primary data. [2025-09-29T20:50:05.190989] [DEBUG] [LOCAL ] REXR: Trimmed 75116 records to 52096 (keeping 200 days of data) [2025-09-29T20:50:05.543134] [DEBUG] [LOCAL ] REXR: Primary data saved (52096 records). [2025-09-29T20:50:05.543531] [INFO ] [MAIN ] REXR: Full history saved. [2025-09-29T20:50:05.543919] [INFO ] [MAIN ] Update Progress: 1791/2371 symbols completed. REXR took 35.0s. Estimated remaining: 1h 14m 30s. Rate: 7.8 symbols/min [2025-09-29T20:50:05.735004] [INFO ] [MAIN ] RFL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:50:05.754972] [DEBUG] [LOCAL ] RFL: Loaded 11051 existing records from primary storage. [2025-09-29T20:50:05.755274] [INFO ] [MAIN ] RFL: Loaded 11051 existing records. [2025-09-29T20:50:05.948426] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-03. [2025-09-29T20:50:05.954940] [WARN ] [MAIN ] RFL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:50:05.957245] [INFO ] [MAIN ] RFL: Wiping existing primary data before full refresh. [2025-09-29T20:50:05.957432] [INFO ] [LOCAL ] RFL: Starting deletion of primary data. [2025-09-29T20:50:05.958099] [DEBUG] [LOCAL ] RFL: Deleted primary data file. [2025-09-29T20:50:05.958163] [INFO ] [MAIN ] RFL: Starting full primary refresh. [2025-09-29T20:50:06.417758] [INFO ] [REMOTE ] RFL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:50:06.411151] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-29T20:50:06.430143] [INFO ] [REMOTE ] REZI: Full fetch complete (65844 records). [2025-09-29T20:50:06.430275] [DEBUG] [VALIDATOR ] REZI: Validating primary data. [2025-09-29T20:50:06.753173] [INFO ] [REMOTE ] RFL: Fetching primary data for 2024-12. [2025-09-29T20:50:06.855022] [DEBUG] [VALIDATOR ] REZI: All expected trading days are present. [2025-09-29T20:50:06.855180] [DEBUG] [VALIDATOR ] REZI: Primary data validation passed. [2025-09-29T20:50:06.856375] [INFO ] [MAIN ] REZI: Fetched primary data is valid. [2025-09-29T20:50:06.856445] [DEBUG] [LOCAL ] REZI: Saving primary data. [2025-09-29T20:50:06.858023] [DEBUG] [LOCAL ] REZI: Trimmed 65844 records to 46908 (keeping 200 days of data) [2025-09-29T20:50:07.072318] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-29T20:50:07.153747] [DEBUG] [LOCAL ] REZI: Primary data saved (46908 records). [2025-09-29T20:50:07.153892] [INFO ] [MAIN ] REZI: Full history saved. [2025-09-29T20:50:07.153995] [INFO ] [MAIN ] Update Progress: 1792/2371 symbols completed. REZI took 33.2s. Estimated remaining: 1h 14m 20s. Rate: 7.8 symbols/min [2025-09-29T20:50:07.343235] [INFO ] [MAIN ] RFM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:50:07.354818] [DEBUG] [LOCAL ] RFM: Loaded 4196 existing records from primary storage. [2025-09-29T20:50:07.355049] [INFO ] [MAIN ] RFM: Loaded 4196 existing records. [2025-09-29T20:50:07.432369] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-29T20:50:07.557700] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-04. [2025-09-29T20:50:07.566293] [WARN ] [MAIN ] RFM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:50:07.566746] [INFO ] [MAIN ] RFM: Wiping existing primary data before full refresh. [2025-09-29T20:50:07.566848] [INFO ] [LOCAL ] RFM: Starting deletion of primary data. [2025-09-29T20:50:07.567404] [DEBUG] [LOCAL ] RFM: Deleted primary data file. [2025-09-29T20:50:07.567485] [INFO ] [MAIN ] RFM: Starting full primary refresh. [2025-09-29T20:50:07.711009] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-06 (2.55 seconds). [2025-09-29T20:50:08.006756] [INFO ] [REMOTE ] RFM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:50:08.294282] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-29T20:50:08.348100] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-05. [2025-09-29T20:50:09.148103] [INFO ] [REMOTE ] RFM: Fetching primary data for 2024-12. [2025-09-29T20:50:09.224372] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-29T20:50:09.948090] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-06. [2025-09-29T20:50:10.004986] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-29T20:50:10.748134] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-07. [2025-09-29T20:50:10.866754] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-29T20:50:11.548137] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-01. [2025-09-29T20:50:12.239981] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-29T20:50:12.348096] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-02. [2025-09-29T20:50:12.718817] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-29T20:50:12.761431] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-29T20:50:13.148112] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-03. [2025-09-29T20:50:13.667702] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-29T20:50:13.948151] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-01. [2025-09-29T20:50:14.563864] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-29T20:50:14.748123] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-08. [2025-09-29T20:50:15.548124] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-02. [2025-09-29T20:50:16.209779] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-29T20:50:16.348121] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-07. [2025-09-29T20:50:17.148129] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-04. [2025-09-29T20:50:17.241879] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-09-29T20:50:17.948160] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-03. [2025-09-29T20:50:18.126822] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-29T20:50:18.280744] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-29T20:50:18.613666] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-29T20:50:18.748126] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-04. [2025-09-29T20:50:19.468465] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-29T20:50:19.548139] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-09. [2025-09-29T20:50:20.348098] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-08. [2025-09-29T20:50:21.148089] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-05. [2025-09-29T20:50:21.252985] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-29T20:50:21.393210] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-29T20:50:21.404497] [INFO ] [REMOTE ] RF: Full fetch complete (77626 records). [2025-09-29T20:50:21.404702] [DEBUG] [VALIDATOR ] RF: Validating primary data. [2025-09-29T20:50:21.798586] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-29T20:50:21.847820] [DEBUG] [VALIDATOR ] RF: All expected trading days are present. [2025-09-29T20:50:21.847921] [DEBUG] [VALIDATOR ] RF: Primary data validation passed. [2025-09-29T20:50:21.849316] [INFO ] [MAIN ] RF: Fetched primary data is valid. [2025-09-29T20:50:21.849391] [DEBUG] [LOCAL ] RF: Saving primary data. [2025-09-29T20:50:21.850970] [DEBUG] [LOCAL ] RF: Trimmed 77626 records to 53630 (keeping 200 days of data) [2025-09-29T20:50:21.948567] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-05. [2025-09-29T20:50:22.199211] [DEBUG] [LOCAL ] RF: Primary data saved (53630 records). [2025-09-29T20:50:22.199402] [INFO ] [MAIN ] RF: Full history saved. [2025-09-29T20:50:22.199505] [INFO ] [MAIN ] Update Progress: 1793/2371 symbols completed. RF took 39.5s. Estimated remaining: 1h 14m 15s. Rate: 7.8 symbols/min [2025-09-29T20:50:22.384534] [INFO ] [MAIN ] RFMZ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:50:22.396718] [DEBUG] [LOCAL ] RFMZ: Loaded 8822 existing records from primary storage. [2025-09-29T20:50:22.396958] [INFO ] [MAIN ] RFMZ: Loaded 8822 existing records. [2025-09-29T20:50:22.582675] [WARN ] [MAIN ] RFMZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:50:22.582911] [INFO ] [MAIN ] RFMZ: Wiping existing primary data before full refresh. [2025-09-29T20:50:22.582960] [INFO ] [LOCAL ] RFMZ: Starting deletion of primary data. [2025-09-29T20:50:22.583139] [DEBUG] [LOCAL ] RFMZ: Deleted primary data file. [2025-09-29T20:50:22.583198] [INFO ] [MAIN ] RFMZ: Starting full primary refresh. [2025-09-29T20:50:22.763922] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-09. [2025-09-29T20:50:22.874284] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-29T20:50:22.970240] [INFO ] [REMOTE ] RFMZ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:50:23.548138] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-06. [2025-09-29T20:50:23.726489] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-29T20:50:23.729254] [INFO ] [REMOTE ] RFI: Full fetch complete (15773 records). [2025-09-29T20:50:23.729351] [DEBUG] [VALIDATOR ] RFI: Validating primary data. [2025-09-29T20:50:24.154715] [DEBUG] [VALIDATOR ] RFI: All expected trading days are present. [2025-09-29T20:50:24.154820] [DEBUG] [VALIDATOR ] RFI: Primary data validation passed. [2025-09-29T20:50:24.155272] [INFO ] [MAIN ] RFI: Fetched primary data is valid. [2025-09-29T20:50:24.155336] [DEBUG] [LOCAL ] RFI: Saving primary data. [2025-09-29T20:50:24.155898] [DEBUG] [LOCAL ] RFI: Trimmed 15773 records to 10468 (keeping 200 days of data) [2025-09-29T20:50:24.224890] [DEBUG] [LOCAL ] RFI: Primary data saved (10468 records). [2025-09-29T20:50:24.225045] [INFO ] [MAIN ] RFI: Full history saved. [2025-09-29T20:50:24.225134] [INFO ] [MAIN ] Update Progress: 1794/2371 symbols completed. RFI took 29.5s. Estimated remaining: 1h 14m 5s. Rate: 7.8 symbols/min [2025-09-29T20:50:24.353293] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2024-12. [2025-09-29T20:50:24.424790] [INFO ] [MAIN ] RGA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:50:24.470724] [DEBUG] [LOCAL ] RGA: Loaded 30535 existing records from primary storage. [2025-09-29T20:50:24.471066] [INFO ] [MAIN ] RGA: Loaded 30535 existing records. [2025-09-29T20:50:24.676797] [WARN ] [MAIN ] RGA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:50:24.677217] [INFO ] [MAIN ] RGA: Wiping existing primary data before full refresh. [2025-09-29T20:50:24.677294] [INFO ] [LOCAL ] RGA: Starting deletion of primary data. [2025-09-29T20:50:24.677638] [DEBUG] [LOCAL ] RGA: Deleted primary data file. [2025-09-29T20:50:24.677747] [INFO ] [MAIN ] RGA: Starting full primary refresh. [2025-09-29T20:50:24.885104] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-29T20:50:25.084952] [INFO ] [REMOTE ] RGA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:50:25.148102] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-07. [2025-09-29T20:50:25.495973] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-29T20:50:25.948125] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-06. [2025-09-29T20:50:26.056951] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-29T20:50:26.544956] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-29T20:50:26.748101] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-07. [2025-09-29T20:50:27.416876] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-29T20:50:27.548112] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-08. [2025-09-29T20:50:28.348110] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-01. [2025-09-29T20:50:28.357539] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-29T20:50:29.148113] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-08. [2025-09-29T20:50:29.253875] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-29T20:50:29.788623] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-29T20:50:29.948112] [INFO ] [REMOTE ] RGA: Fetching primary data for 2024-12. [2025-09-29T20:50:30.748134] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-09. [2025-09-29T20:50:31.411385] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-29T20:50:31.413629] [INFO ] [REMOTE ] RFM: Full fetch complete (5910 records). [2025-09-29T20:50:31.413866] [DEBUG] [VALIDATOR ] RFM: Validating primary data. [2025-09-29T20:50:31.552341] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-02. [2025-09-29T20:50:31.713767] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-29T20:50:31.834033] [DEBUG] [VALIDATOR ] RFM: All expected trading days are present. [2025-09-29T20:50:31.834117] [DEBUG] [VALIDATOR ] RFM: Primary data validation passed. [2025-09-29T20:50:31.834314] [INFO ] [MAIN ] RFM: Fetched primary data is valid. [2025-09-29T20:50:31.834354] [DEBUG] [LOCAL ] RFM: Saving primary data. [2025-09-29T20:50:31.834820] [DEBUG] [LOCAL ] RFM: Trimmed 5910 records to 4158 (keeping 200 days of data) [2025-09-29T20:50:31.863108] [DEBUG] [LOCAL ] RFM: Primary data saved (4158 records). [2025-09-29T20:50:31.863248] [INFO ] [MAIN ] RFM: Full history saved. [2025-09-29T20:50:31.863368] [INFO ] [MAIN ] Update Progress: 1795/2371 symbols completed. RFM took 24.7s. Estimated remaining: 1h 13m 58s. Rate: 7.8 symbols/min [2025-09-29T20:50:32.045477] [INFO ] [MAIN ] RGR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:50:32.068097] [DEBUG] [LOCAL ] RGR: Loaded 20706 existing records from primary storage. [2025-09-29T20:50:32.068392] [INFO ] [MAIN ] RGR: Loaded 20706 existing records. [2025-09-29T20:50:32.269163] [WARN ] [MAIN ] RGR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:50:32.269422] [INFO ] [MAIN ] RGR: Wiping existing primary data before full refresh. [2025-09-29T20:50:32.269477] [INFO ] [LOCAL ] RGR: Starting deletion of primary data. [2025-09-29T20:50:32.269873] [DEBUG] [LOCAL ] RGR: Deleted primary data file. [2025-09-29T20:50:32.269935] [INFO ] [MAIN ] RGR: Starting full primary refresh. [2025-09-29T20:50:32.353202] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-09. [2025-09-29T20:50:32.651968] [INFO ] [REMOTE ] RGR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:50:33.148127] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-01. [2025-09-29T20:50:33.547538] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-29T20:50:33.571799] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-29T20:50:33.575619] [INFO ] [REMOTE ] RFL: Full fetch complete (12890 records). [2025-09-29T20:50:33.575750] [DEBUG] [VALIDATOR ] RFL: Validating primary data. [2025-09-29T20:50:33.950047] [INFO ] [REMOTE ] RGR: Fetching primary data for 2024-12. [2025-09-29T20:50:33.958771] [DEBUG] [VALIDATOR ] RFL: All expected trading days are present. [2025-09-29T20:50:33.958861] [DEBUG] [VALIDATOR ] RFL: Primary data validation passed. [2025-09-29T20:50:33.959170] [INFO ] [MAIN ] RFL: Fetched primary data is valid. [2025-09-29T20:50:33.959210] [DEBUG] [LOCAL ] RFL: Saving primary data. [2025-09-29T20:50:33.959971] [DEBUG] [LOCAL ] RFL: Trimmed 12890 records to 11077 (keeping 200 days of data) [2025-09-29T20:50:34.030161] [DEBUG] [LOCAL ] RFL: Primary data saved (11077 records). [2025-09-29T20:50:34.030310] [INFO ] [MAIN ] RFL: Full history saved. [2025-09-29T20:50:34.030397] [INFO ] [MAIN ] Update Progress: 1796/2371 symbols completed. RFL took 28.5s. Estimated remaining: 1h 13m 48s. Rate: 7.8 symbols/min [2025-09-29T20:50:34.209179] [INFO ] [MAIN ] RGT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:50:34.215487] [DEBUG] [LOCAL ] RGT: Loaded 2885 existing records from primary storage. [2025-09-29T20:50:34.215749] [INFO ] [MAIN ] RGT: Loaded 2885 existing records. [2025-09-29T20:50:34.404798] [WARN ] [MAIN ] RGT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:50:34.405214] [INFO ] [MAIN ] RGT: Wiping existing primary data before full refresh. [2025-09-29T20:50:34.405352] [INFO ] [LOCAL ] RGT: Starting deletion of primary data. [2025-09-29T20:50:34.405638] [DEBUG] [LOCAL ] RGT: Deleted primary data file. [2025-09-29T20:50:34.405730] [INFO ] [MAIN ] RGT: Starting full primary refresh. [2025-09-29T20:50:34.748485] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-03. [2025-09-29T20:50:34.755088] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-29T20:50:34.835916] [INFO ] [REMOTE ] RGT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:50:35.198165] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-29T20:50:35.548085] [INFO ] [REMOTE ] RGT: Fetching primary data for 2024-12. [2025-09-29T20:50:35.679403] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-29T20:50:36.234316] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-29T20:50:36.348117] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-04. [2025-09-29T20:50:37.148148] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-01. [2025-09-29T20:50:37.276321] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-29T20:50:37.948150] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-02. [2025-09-29T20:50:38.290850] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-29T20:50:38.748142] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-02. [2025-09-29T20:50:39.548153] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-05. [2025-09-29T20:50:39.603456] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-29T20:50:39.880671] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-29T20:50:40.348156] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-01. [2025-09-29T20:50:40.386116] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-29T20:50:40.828047] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-29T20:50:41.148104] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-06. [2025-09-29T20:50:41.852123] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-29T20:50:41.948112] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-02. [2025-09-29T20:50:42.485184] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-29T20:50:42.748163] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-03. [2025-09-29T20:50:43.548161] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-03. [2025-09-29T20:50:44.348149] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-07. [2025-09-29T20:50:44.491750] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-29T20:50:45.148079] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-04. [2025-09-29T20:50:45.222062] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-29T20:50:45.458611] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-29T20:50:45.948106] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-08. [2025-09-29T20:50:46.706759] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-29T20:50:46.748093] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-05. [2025-09-29T20:50:46.785619] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-29T20:50:47.548153] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-03. [2025-09-29T20:50:48.314554] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-29T20:50:48.348100] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-04. [2025-09-29T20:50:48.628421] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-29T20:50:48.841234] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-29T20:50:49.148132] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-05. [2025-09-29T20:50:49.713198] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-29T20:50:49.948110] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-04. [2025-09-29T20:50:50.748177] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-06. [2025-09-29T20:50:50.985194] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-29T20:50:51.548178] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-09. [2025-09-29T20:50:52.053635] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-29T20:50:52.105666] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-29T20:50:52.108420] [INFO ] [REMOTE ] RFMZ: Full fetch complete (12791 records). [2025-09-29T20:50:52.108500] [DEBUG] [VALIDATOR ] RFMZ: Validating primary data. [2025-09-29T20:50:52.355937] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-07. [2025-09-29T20:50:52.528416] [DEBUG] [VALIDATOR ] RFMZ: All expected trading days are present. [2025-09-29T20:50:52.528522] [DEBUG] [VALIDATOR ] RFMZ: Primary data validation passed. [2025-09-29T20:50:52.529077] [INFO ] [MAIN ] RFMZ: Fetched primary data is valid. [2025-09-29T20:50:52.529156] [DEBUG] [LOCAL ] RFMZ: Saving primary data. [2025-09-29T20:50:52.529751] [DEBUG] [LOCAL ] RFMZ: Trimmed 12791 records to 8794 (keeping 200 days of data) [2025-09-29T20:50:52.587790] [DEBUG] [LOCAL ] RFMZ: Primary data saved (8794 records). [2025-09-29T20:50:52.587937] [INFO ] [MAIN ] RFMZ: Full history saved. [2025-09-29T20:50:52.588053] [INFO ] [MAIN ] Update Progress: 1797/2371 symbols completed. RFMZ took 30.4s. Estimated remaining: 1h 13m 44s. Rate: 7.8 symbols/min [2025-09-29T20:50:53.148117] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-05. [2025-09-29T20:50:53.751965] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-29T20:50:53.948161] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-08. [2025-09-29T20:50:54.420428] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-29T20:50:54.748256] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-06. [2025-09-29T20:50:55.342345] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-29T20:50:55.548116] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-06. [2025-09-29T20:50:55.951300] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-29T20:50:56.209998] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-29T20:50:56.348124] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-07. [2025-09-29T20:50:57.148103] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-07. [2025-09-29T20:50:57.543276] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-29T20:50:57.769183] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-29T20:50:57.948124] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-08. [2025-09-29T20:50:58.451736] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-29T20:50:58.748158] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-09. [2025-09-29T20:50:59.269371] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-29T20:50:59.270506] [INFO ] [REMOTE ] RGT: Full fetch complete (4146 records). [2025-09-29T20:50:59.270600] [DEBUG] [VALIDATOR ] RGT: Validating primary data. [2025-09-29T20:50:59.553240] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-09. [2025-09-29T20:50:59.668932] [DEBUG] [VALIDATOR ] RGT: All expected trading days are present. [2025-09-29T20:50:59.669028] [DEBUG] [VALIDATOR ] RGT: Primary data validation passed. [2025-09-29T20:50:59.669202] [INFO ] [MAIN ] RGT: Fetched primary data is valid. [2025-09-29T20:50:59.669273] [DEBUG] [LOCAL ] RGT: Saving primary data. [2025-09-29T20:50:59.669759] [DEBUG] [LOCAL ] RGT: Trimmed 4146 records to 2805 (keeping 200 days of data) [2025-09-29T20:50:59.689742] [DEBUG] [LOCAL ] RGT: Primary data saved (2805 records). [2025-09-29T20:50:59.689905] [INFO ] [MAIN ] RGT: Full history saved. [2025-09-29T20:50:59.690051] [INFO ] [MAIN ] Update Progress: 1798/2371 symbols completed. RGT took 25.7s. Estimated remaining: 1h 13m 36s. Rate: 7.8 symbols/min [2025-09-29T20:51:00.348113] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-08. [2025-09-29T20:51:01.144515] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-29T20:51:01.152793] [INFO ] [REMOTE ] RGA: Full fetch complete (45615 records). [2025-09-29T20:51:01.152981] [DEBUG] [VALIDATOR ] RGA: Validating primary data. [2025-09-29T20:51:01.579353] [DEBUG] [VALIDATOR ] RGA: All expected trading days are present. [2025-09-29T20:51:01.579510] [DEBUG] [VALIDATOR ] RGA: Primary data validation passed. [2025-09-29T20:51:01.580530] [INFO ] [MAIN ] RGA: Fetched primary data is valid. [2025-09-29T20:51:01.580610] [DEBUG] [LOCAL ] RGA: Saving primary data. [2025-09-29T20:51:01.597957] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-29T20:51:01.603882] [DEBUG] [LOCAL ] RGA: Trimmed 45615 records to 29809 (keeping 200 days of data) [2025-09-29T20:51:01.605050] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-09. [2025-09-29T20:51:01.839015] [DEBUG] [LOCAL ] RGA: Primary data saved (29809 records). [2025-09-29T20:51:01.839286] [INFO ] [MAIN ] RGA: Full history saved. [2025-09-29T20:51:01.842708] [INFO ] [MAIN ] Update Progress: 1799/2371 symbols completed. RGA took 37.6s. Estimated remaining: 1h 13m 27s. Rate: 7.8 symbols/min [2025-09-29T20:51:02.773876] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-29T20:51:02.779467] [INFO ] [REMOTE ] RGR: Full fetch complete (28673 records). [2025-09-29T20:51:02.779609] [DEBUG] [VALIDATOR ] RGR: Validating primary data. [2025-09-29T20:51:03.175966] [DEBUG] [VALIDATOR ] RGR: All expected trading days are present. [2025-09-29T20:51:03.176083] [DEBUG] [VALIDATOR ] RGR: Primary data validation passed. [2025-09-29T20:51:03.176797] [INFO ] [MAIN ] RGR: Fetched primary data is valid. [2025-09-29T20:51:03.176903] [DEBUG] [LOCAL ] RGR: Saving primary data. [2025-09-29T20:51:03.177752] [DEBUG] [LOCAL ] RGR: Trimmed 28673 records to 20577 (keeping 200 days of data) [2025-09-29T20:51:03.313555] [DEBUG] [LOCAL ] RGR: Primary data saved (20577 records). [2025-09-29T20:51:03.313711] [INFO ] [MAIN ] RGR: Full history saved. [2025-09-29T20:51:03.313835] [INFO ] [MAIN ] Update Progress: 1800/2371 symbols completed. RGR took 31.5s. Estimated remaining: 1h 13m 17s. Rate: 7.8 symbols/min [2025-09-29T20:51:03.896843] [INFO ] [MAIN ] RHI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:51:04.037888] [INFO ] [MAIN ] RHLD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:51:04.078968] [DEBUG] [LOCAL ] RHLD: No existing data file found in primary storage. [2025-09-29T20:51:04.081770] [INFO ] [MAIN ] RH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:51:04.083385] [INFO ] [MAIN ] RHP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:51:04.083718] [WARN ] [MAIN ] RHLD: No existing data found, performing full refresh instead. [2025-09-29T20:51:04.084883] [INFO ] [MAIN ] RHLD: Wiping existing primary data before full refresh. [2025-09-29T20:51:04.084968] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-09-29T20:51:04.085067] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-09-29T20:51:04.085128] [INFO ] [MAIN ] RHLD: Starting full primary refresh. [2025-09-29T20:51:04.414536] [DEBUG] [LOCAL ] RHI: Loaded 49995 existing records from primary storage. [2025-09-29T20:51:04.457200] [INFO ] [MAIN ] RHI: Loaded 49995 existing records. [2025-09-29T20:51:04.493414] [DEBUG] [LOCAL ] RH: Loaded 48340 existing records from primary storage. [2025-09-29T20:51:04.510771] [DEBUG] [LOCAL ] RHP: Loaded 42305 existing records from primary storage. [2025-09-29T20:51:04.516754] [INFO ] [MAIN ] RH: Loaded 48340 existing records. [2025-09-29T20:51:04.586981] [INFO ] [MAIN ] RHP: Loaded 42305 existing records. [2025-09-29T20:51:04.776262] [INFO ] [REMOTE ] RHLD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:51:04.830886] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2024-12. [2025-09-29T20:51:05.177925] [WARN ] [MAIN ] RHI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:51:05.249111] [WARN ] [MAIN ] RHP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:51:05.225845] [WARN ] [MAIN ] RH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:51:05.250183] [INFO ] [MAIN ] RHP: Wiping existing primary data before full refresh. [2025-09-29T20:51:05.250938] [DEBUG] [REMOTE ] RHLD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T20:51:05.250623] [INFO ] [MAIN ] RH: Wiping existing primary data before full refresh. [2025-09-29T20:51:05.251379] [INFO ] [LOCAL ] RHP: Starting deletion of primary data. [2025-09-29T20:51:05.250450] [INFO ] [MAIN ] RHI: Wiping existing primary data before full refresh. [2025-09-29T20:51:05.251586] [WARN ] [REMOTE ] RHLD: No data returned for month 2024-12 [2025-09-29T20:51:05.251822] [INFO ] [LOCAL ] RHI: Starting deletion of primary data. [2025-09-29T20:51:05.251886] [INFO ] [LOCAL ] RH: Starting deletion of primary data. [2025-09-29T20:51:05.252218] [FATAL] [REMOTE ] RHLD: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T20:51:05.252524] [FATAL] [MAIN ] RHLD: Failed to fetch primary data. [2025-09-29T20:51:05.252637] [DEBUG] [LOCAL ] RHP: Deleted primary data file. [2025-09-29T20:51:05.252785] [INFO ] [MAIN ] RHP: Starting full primary refresh. [2025-09-29T20:51:05.258067] [DEBUG] [LOCAL ] RH: Deleted primary data file. [2025-09-29T20:51:05.258326] [WARN ] [MAIN ] RHLD: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T20:51:05.258004] [DEBUG] [LOCAL ] RHI: Deleted primary data file. [2025-09-29T20:51:05.258422] [INFO ] [MAIN ] RH: Starting full primary refresh. [2025-09-29T20:51:05.258627] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-09-29T20:51:05.292549] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-09-29T20:51:05.297978] [INFO ] [LOCAL ] RHLD: Starting deletion of derivative data. [2025-09-29T20:51:05.287228] [INFO ] [MAIN ] RHI: Starting full primary refresh. [2025-09-29T20:51:05.377592] [DEBUG] [LOCAL ] RHLD: No derivative data file found to delete. [2025-09-29T20:51:05.449446] [INFO ] [MAIN ] Update Progress: 1801/2371 symbols completed. RHLD took 2.1s. Estimated remaining: 1h 13m 7s. Rate: 7.8 symbols/min [2025-09-29T20:51:06.387065] [INFO ] [MAIN ] RIG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:51:06.531749] [INFO ] [REMOTE ] RH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:51:06.585837] [INFO ] [REMOTE ] RH: Fetching primary data for 2024-12. [2025-09-29T20:51:06.620157] [INFO ] [REMOTE ] RHP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:51:06.652109] [INFO ] [REMOTE ] RHP: Fetching primary data for 2024-12. [2025-09-29T20:51:06.786612] [INFO ] [REMOTE ] RHI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:51:06.787031] [INFO ] [REMOTE ] RHI: Fetching primary data for 2024-12. [2025-09-29T20:51:06.788377] [DEBUG] [LOCAL ] RIG: Loaded 54449 existing records from primary storage. [2025-09-29T20:51:06.789506] [INFO ] [MAIN ] RIG: Loaded 54449 existing records. [2025-09-29T20:51:06.986576] [WARN ] [MAIN ] RIG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:51:06.986847] [INFO ] [MAIN ] RIG: Wiping existing primary data before full refresh. [2025-09-29T20:51:06.986904] [INFO ] [LOCAL ] RIG: Starting deletion of primary data. [2025-09-29T20:51:06.987212] [DEBUG] [LOCAL ] RIG: Deleted primary data file. [2025-09-29T20:51:06.987276] [INFO ] [MAIN ] RIG: Starting full primary refresh. [2025-09-29T20:51:07.376604] [INFO ] [REMOTE ] RIG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:51:07.376997] [INFO ] [REMOTE ] RIG: Fetching primary data for 2024-12. [2025-09-29T20:51:08.254885] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-29T20:51:08.264299] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-01. [2025-09-29T20:51:08.367284] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-29T20:51:08.376849] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-01. [2025-09-29T20:51:08.517196] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-29T20:51:08.526263] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-01. [2025-09-29T20:51:09.457456] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-29T20:51:09.464979] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-02. [2025-09-29T20:51:09.566629] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-29T20:51:09.578497] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-01. [2025-09-29T20:51:10.029302] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-29T20:51:10.038148] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-02. [2025-09-29T20:51:10.273610] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-29T20:51:10.748168] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-02. [2025-09-29T20:51:10.949854] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-29T20:51:11.482863] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-29T20:51:11.548140] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-02. [2025-09-29T20:51:11.588900] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-29T20:51:12.226797] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-29T20:51:12.348167] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-03. [2025-09-29T20:51:13.148116] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-03. [2025-09-29T20:51:13.505396] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-29T20:51:13.948126] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-03. [2025-09-29T20:51:14.091385] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-29T20:51:14.748133] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-03. [2025-09-29T20:51:15.140544] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-29T20:51:15.523851] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-29T20:51:15.548088] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-04. [2025-09-29T20:51:16.348126] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-04. [2025-09-29T20:51:16.831488] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-29T20:51:17.008490] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-29T20:51:17.148070] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-05. [2025-09-29T20:51:17.948089] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-04. [2025-09-29T20:51:18.322786] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-29T20:51:18.748121] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-04. [2025-09-29T20:51:18.901263] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-29T20:51:19.548140] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-05. [2025-09-29T20:51:20.207718] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-29T20:51:20.348143] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-05. [2025-09-29T20:51:21.009219] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-29T20:51:21.148105] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-06. [2025-09-29T20:51:21.273168] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-29T20:51:21.948098] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-06. [2025-09-29T20:51:22.364701] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-29T20:51:22.509289] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-29T20:51:22.748148] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-07. [2025-09-29T20:51:23.490203] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-29T20:51:23.548118] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-06. [2025-09-29T20:51:24.283437] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-29T20:51:24.348122] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-08. [2025-09-29T20:51:25.148117] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-05. [2025-09-29T20:51:25.693155] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-29T20:51:25.948127] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-07. [2025-09-29T20:51:25.983879] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-29T20:51:26.748111] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-07. [2025-09-29T20:51:27.149764] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-29T20:51:27.548124] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-06. [2025-09-29T20:51:27.761621] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-29T20:51:28.348097] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-09. [2025-09-29T20:51:28.894436] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-29T20:51:29.148080] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-08. [2025-09-29T20:51:29.603073] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-29T20:51:29.842098] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-29T20:51:29.850267] [INFO ] [REMOTE ] RHP: Full fetch complete (58017 records). [2025-09-29T20:51:29.850420] [DEBUG] [VALIDATOR ] RHP: Validating primary data. [2025-09-29T20:51:29.955442] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-07. [2025-09-29T20:51:30.261942] [DEBUG] [VALIDATOR ] RHP: All expected trading days are present. [2025-09-29T20:51:30.262057] [DEBUG] [VALIDATOR ] RHP: Primary data validation passed. [2025-09-29T20:51:30.263171] [INFO ] [MAIN ] RHP: Fetched primary data is valid. [2025-09-29T20:51:30.263254] [DEBUG] [LOCAL ] RHP: Saving primary data. [2025-09-29T20:51:30.264811] [DEBUG] [LOCAL ] RHP: Trimmed 58017 records to 41395 (keeping 200 days of data) [2025-09-29T20:51:30.521388] [DEBUG] [LOCAL ] RHP: Primary data saved (41395 records). [2025-09-29T20:51:30.521525] [INFO ] [MAIN ] RHP: Full history saved. [2025-09-29T20:51:30.522587] [INFO ] [MAIN ] Update Progress: 1802/2371 symbols completed. RHP took 27.2s. Estimated remaining: 1h 13m 5s. Rate: 7.8 symbols/min [2025-09-29T20:51:30.713894] [INFO ] [MAIN ] RIO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:51:30.751319] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-08. [2025-09-29T20:51:30.775190] [DEBUG] [LOCAL ] RIO: Loaded 54173 existing records from primary storage. [2025-09-29T20:51:30.775543] [INFO ] [MAIN ] RIO: Loaded 54173 existing records. [2025-09-29T20:51:30.975398] [WARN ] [MAIN ] RIO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:51:30.975800] [INFO ] [MAIN ] RIO: Wiping existing primary data before full refresh. [2025-09-29T20:51:30.975886] [INFO ] [LOCAL ] RIO: Starting deletion of primary data. [2025-09-29T20:51:30.976629] [DEBUG] [LOCAL ] RIO: Deleted primary data file. [2025-09-29T20:51:30.976736] [INFO ] [MAIN ] RIO: Starting full primary refresh. [2025-09-29T20:51:31.175602] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-29T20:51:31.409506] [INFO ] [REMOTE ] RIO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:51:31.548114] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-09. [2025-09-29T20:51:32.118364] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-29T20:51:32.348096] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-08. [2025-09-29T20:51:32.530872] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-29T20:51:33.148185] [INFO ] [REMOTE ] RIO: Fetching primary data for 2024-12. [2025-09-29T20:51:33.446282] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-29T20:51:33.456126] [INFO ] [REMOTE ] RH: Full fetch complete (65744 records). [2025-09-29T20:51:33.456282] [DEBUG] [VALIDATOR ] RH: Validating primary data. [2025-09-29T20:51:33.864065] [DEBUG] [VALIDATOR ] RH: All expected trading days are present. [2025-09-29T20:51:33.864191] [DEBUG] [VALIDATOR ] RH: Primary data validation passed. [2025-09-29T20:51:33.865380] [INFO ] [MAIN ] RH: Fetched primary data is valid. [2025-09-29T20:51:33.865451] [DEBUG] [LOCAL ] RH: Saving primary data. [2025-09-29T20:51:33.866910] [DEBUG] [LOCAL ] RH: Trimmed 65744 records to 47622 (keeping 200 days of data) [2025-09-29T20:51:33.958128] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-09. [2025-09-29T20:51:34.176319] [DEBUG] [LOCAL ] RH: Primary data saved (47622 records). [2025-09-29T20:51:34.176540] [INFO ] [MAIN ] RH: Full history saved. [2025-09-29T20:51:34.176829] [INFO ] [MAIN ] Update Progress: 1803/2371 symbols completed. RH took 30.9s. Estimated remaining: 1h 12m 56s. Rate: 7.8 symbols/min [2025-09-29T20:51:34.398271] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-29T20:51:34.413736] [INFO ] [MAIN ] RITM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:51:34.475560] [DEBUG] [LOCAL ] RITM: Loaded 53589 existing records from primary storage. [2025-09-29T20:51:34.475974] [INFO ] [MAIN ] RITM: Loaded 53589 existing records. [2025-09-29T20:51:34.662525] [WARN ] [MAIN ] RITM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:51:34.662765] [INFO ] [MAIN ] RITM: Wiping existing primary data before full refresh. [2025-09-29T20:51:34.662821] [INFO ] [LOCAL ] RITM: Starting deletion of primary data. [2025-09-29T20:51:34.663453] [DEBUG] [LOCAL ] RITM: Deleted primary data file. [2025-09-29T20:51:34.663515] [INFO ] [MAIN ] RITM: Starting full primary refresh. [2025-09-29T20:51:34.753402] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-09. [2025-09-29T20:51:35.055834] [INFO ] [REMOTE ] RITM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:51:35.280036] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-29T20:51:35.354548] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-29T20:51:35.365311] [INFO ] [REMOTE ] RHI: Full fetch complete (69943 records). [2025-09-29T20:51:35.365494] [DEBUG] [VALIDATOR ] RHI: Validating primary data. [2025-09-29T20:51:35.557242] [INFO ] [REMOTE ] RITM: Fetching primary data for 2024-12. [2025-09-29T20:51:35.808496] [DEBUG] [VALIDATOR ] RHI: All expected trading days are present. [2025-09-29T20:51:35.808624] [DEBUG] [VALIDATOR ] RHI: Primary data validation passed. [2025-09-29T20:51:35.809947] [INFO ] [MAIN ] RHI: Fetched primary data is valid. [2025-09-29T20:51:35.810028] [DEBUG] [LOCAL ] RHI: Saving primary data. [2025-09-29T20:51:35.811676] [DEBUG] [LOCAL ] RHI: Trimmed 69943 records to 49231 (keeping 200 days of data) [2025-09-29T20:51:36.138891] [DEBUG] [LOCAL ] RHI: Primary data saved (49231 records). [2025-09-29T20:51:36.139048] [INFO ] [MAIN ] RHI: Full history saved. [2025-09-29T20:51:36.139133] [INFO ] [MAIN ] Update Progress: 1804/2371 symbols completed. RHI took 32.8s. Estimated remaining: 1h 12m 47s. Rate: 7.8 symbols/min [2025-09-29T20:51:36.330619] [INFO ] [MAIN ] RIV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:51:36.344832] [DEBUG] [LOCAL ] RIV: Loaded 12193 existing records from primary storage. [2025-09-29T20:51:36.345084] [INFO ] [MAIN ] RIV: Loaded 12193 existing records. [2025-09-29T20:51:36.377499] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-01. [2025-09-29T20:51:36.548737] [WARN ] [MAIN ] RIV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:51:36.549056] [INFO ] [MAIN ] RIV: Wiping existing primary data before full refresh. [2025-09-29T20:51:36.549112] [INFO ] [LOCAL ] RIV: Starting deletion of primary data. [2025-09-29T20:51:36.549308] [DEBUG] [LOCAL ] RIV: Deleted primary data file. [2025-09-29T20:51:36.549367] [INFO ] [MAIN ] RIV: Starting full primary refresh. [2025-09-29T20:51:36.947280] [INFO ] [REMOTE ] RIV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:51:36.979730] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-29T20:51:36.991453] [INFO ] [REMOTE ] RIG: Full fetch complete (77706 records). [2025-09-29T20:51:36.991676] [DEBUG] [VALIDATOR ] RIG: Validating primary data. [2025-09-29T20:51:37.158699] [INFO ] [REMOTE ] RIV: Fetching primary data for 2024-12. [2025-09-29T20:51:37.417200] [DEBUG] [VALIDATOR ] RIG: All expected trading days are present. [2025-09-29T20:51:37.417305] [DEBUG] [VALIDATOR ] RIG: Primary data validation passed. [2025-09-29T20:51:37.418578] [INFO ] [MAIN ] RIG: Fetched primary data is valid. [2025-09-29T20:51:37.418678] [DEBUG] [LOCAL ] RIG: Saving primary data. [2025-09-29T20:51:37.420441] [DEBUG] [LOCAL ] RIG: Trimmed 77706 records to 53670 (keeping 200 days of data) [2025-09-29T20:51:37.762008] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-09-29T20:51:37.789316] [DEBUG] [LOCAL ] RIG: Primary data saved (53670 records). [2025-09-29T20:51:37.789455] [INFO ] [MAIN ] RIG: Full history saved. [2025-09-29T20:51:37.789538] [INFO ] [MAIN ] Update Progress: 1805/2371 symbols completed. RIG took 32.3s. Estimated remaining: 1h 12m 37s. Rate: 7.8 symbols/min [2025-09-29T20:51:37.954107] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-01. [2025-09-29T20:51:37.985516] [INFO ] [MAIN ] RJF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:51:37.997053] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-29T20:51:38.053537] [DEBUG] [LOCAL ] RJF: Loaded 47804 existing records from primary storage. [2025-09-29T20:51:38.053934] [INFO ] [MAIN ] RJF: Loaded 47804 existing records. [2025-09-29T20:51:38.238787] [WARN ] [MAIN ] RJF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:51:38.239003] [INFO ] [MAIN ] RJF: Wiping existing primary data before full refresh. [2025-09-29T20:51:38.239052] [INFO ] [LOCAL ] RJF: Starting deletion of primary data. [2025-09-29T20:51:38.239366] [DEBUG] [LOCAL ] RJF: Deleted primary data file. [2025-09-29T20:51:38.239427] [INFO ] [MAIN ] RJF: Starting full primary refresh. [2025-09-29T20:51:38.626585] [INFO ] [REMOTE ] RJF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:51:38.660065] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-09-29T20:51:38.748160] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-02. [2025-09-29T20:51:39.548136] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-01. [2025-09-29T20:51:39.957919] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-29T20:51:40.348145] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-02. [2025-09-29T20:51:40.462081] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-29T20:51:40.822278] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-29T20:51:41.148107] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-02. [2025-09-29T20:51:41.948113] [INFO ] [REMOTE ] RJF: Fetching primary data for 2024-12. [2025-09-29T20:51:42.071222] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-29T20:51:42.091689] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-29T20:51:42.748154] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-03. [2025-09-29T20:51:43.548161] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-03. [2025-09-29T20:51:43.700704] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-29T20:51:44.348220] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-01. [2025-09-29T20:51:44.475813] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-29T20:51:44.540630] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-29T20:51:45.148150] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-03. [2025-09-29T20:51:45.948112] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-04. [2025-09-29T20:51:46.161748] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-29T20:51:46.748093] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-02. [2025-09-29T20:51:46.830706] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-29T20:51:47.208209] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-29T20:51:47.548161] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-04. [2025-09-29T20:51:48.348086] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-04. [2025-09-29T20:51:48.431576] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-29T20:51:49.148115] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-03. [2025-09-29T20:51:49.564692] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-29T20:51:49.948112] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-05. [2025-09-29T20:51:50.449769] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-29T20:51:50.748148] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-05. [2025-09-29T20:51:51.012259] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-29T20:51:51.548158] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-04. [2025-09-29T20:51:52.111956] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-29T20:51:52.348136] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-06. [2025-09-29T20:51:52.762332] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-29T20:51:53.148084] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-06. [2025-09-29T20:51:53.467915] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-29T20:51:53.948137] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-05. [2025-09-29T20:51:54.000839] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-29T20:51:54.748147] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-05. [2025-09-29T20:51:54.769994] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-29T20:51:55.038441] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-29T20:51:55.548120] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-06. [2025-09-29T20:51:56.144843] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-29T20:51:56.348097] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-07. [2025-09-29T20:51:56.489442] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-29T20:51:57.148109] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-07. [2025-09-29T20:51:57.948129] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-07. [2025-09-29T20:51:58.214287] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-29T20:51:58.255906] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-29T20:51:58.748160] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-06. [2025-09-29T20:51:59.548154] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-08. [2025-09-29T20:52:00.061961] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-29T20:52:00.348163] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-08. [2025-09-29T20:52:00.442795] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-29T20:52:00.586521] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-29T20:52:01.148123] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-08. [2025-09-29T20:52:01.948133] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-09. [2025-09-29T20:52:02.578978] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-29T20:52:02.748107] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-07. [2025-09-29T20:52:03.108309] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-29T20:52:03.114263] [INFO ] [REMOTE ] RIV: Full fetch complete (17442 records). [2025-09-29T20:52:03.114408] [DEBUG] [VALIDATOR ] RIV: Validating primary data. [2025-09-29T20:52:03.562601] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-09. [2025-09-29T20:52:03.566867] [DEBUG] [VALIDATOR ] RIV: All expected trading days are present. [2025-09-29T20:52:03.567157] [DEBUG] [VALIDATOR ] RIV: Primary data validation passed. [2025-09-29T20:52:03.569065] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-09-29T20:52:03.569542] [INFO ] [MAIN ] RIV: Fetched primary data is valid. [2025-09-29T20:52:03.569862] [DEBUG] [LOCAL ] RIV: Saving primary data. [2025-09-29T20:52:03.582114] [DEBUG] [LOCAL ] RIV: Trimmed 17442 records to 12068 (keeping 200 days of data) [2025-09-29T20:52:03.661097] [DEBUG] [LOCAL ] RIV: Primary data saved (12068 records). [2025-09-29T20:52:03.661236] [INFO ] [MAIN ] RIV: Full history saved. [2025-09-29T20:52:03.661345] [INFO ] [MAIN ] Update Progress: 1806/2371 symbols completed. RIV took 27.5s. Estimated remaining: 1h 12m 35s. Rate: 7.8 symbols/min [2025-09-29T20:52:03.842464] [INFO ] [MAIN ] RKT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:52:03.903631] [DEBUG] [LOCAL ] RKT: Loaded 54501 existing records from primary storage. [2025-09-29T20:52:03.904046] [INFO ] [MAIN ] RKT: Loaded 54501 existing records. [2025-09-29T20:52:04.094732] [WARN ] [MAIN ] RKT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:52:04.094931] [INFO ] [MAIN ] RKT: Wiping existing primary data before full refresh. [2025-09-29T20:52:04.094980] [INFO ] [LOCAL ] RKT: Starting deletion of primary data. [2025-09-29T20:52:04.095361] [DEBUG] [LOCAL ] RKT: Deleted primary data file. [2025-09-29T20:52:04.095447] [INFO ] [MAIN ] RKT: Starting full primary refresh. [2025-09-29T20:52:04.354419] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-09. [2025-09-29T20:52:04.484636] [INFO ] [REMOTE ] RKT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:52:04.519575] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-29T20:52:05.148129] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-08. [2025-09-29T20:52:05.673160] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-29T20:52:05.684963] [INFO ] [REMOTE ] RIO: Full fetch complete (77354 records). [2025-09-29T20:52:05.685150] [DEBUG] [VALIDATOR ] RIO: Validating primary data. [2025-09-29T20:52:05.955735] [INFO ] [REMOTE ] RKT: Fetching primary data for 2024-12. [2025-09-29T20:52:06.139933] [DEBUG] [VALIDATOR ] RIO: All expected trading days are present. [2025-09-29T20:52:06.140055] [DEBUG] [VALIDATOR ] RIO: Primary data validation passed. [2025-09-29T20:52:06.141490] [INFO ] [MAIN ] RIO: Fetched primary data is valid. [2025-09-29T20:52:06.141602] [DEBUG] [LOCAL ] RIO: Saving primary data. [2025-09-29T20:52:06.185042] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-29T20:52:06.183636] [DEBUG] [LOCAL ] RIO: Trimmed 77354 records to 53394 (keeping 200 days of data) [2025-09-29T20:52:06.196518] [INFO ] [REMOTE ] RITM: Full fetch complete (76559 records). [2025-09-29T20:52:06.196698] [DEBUG] [VALIDATOR ] RITM: Validating primary data. [2025-09-29T20:52:06.756632] [DEBUG] [VALIDATOR ] RITM: All expected trading days are present. [2025-09-29T20:52:06.758437] [DEBUG] [VALIDATOR ] RITM: Primary data validation passed. [2025-09-29T20:52:06.760466] [INFO ] [MAIN ] RITM: Fetched primary data is valid. [2025-09-29T20:52:06.764491] [DEBUG] [LOCAL ] RITM: Saving primary data. [2025-09-29T20:52:06.777862] [DEBUG] [LOCAL ] RITM: Trimmed 76559 records to 52816 (keeping 200 days of data) [2025-09-29T20:52:07.069414] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-29T20:52:07.085634] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-09. [2025-09-29T20:52:07.305998] [DEBUG] [LOCAL ] RIO: Primary data saved (53394 records). [2025-09-29T20:52:07.306798] [INFO ] [MAIN ] RIO: Full history saved. [2025-09-29T20:52:07.307237] [INFO ] [MAIN ] Update Progress: 1807/2371 symbols completed. RIO took 36.8s. Estimated remaining: 1h 12m 26s. Rate: 7.8 symbols/min [2025-09-29T20:52:07.496070] [INFO ] [MAIN ] RL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:52:07.600805] [DEBUG] [LOCAL ] RITM: Primary data saved (52816 records). [2025-09-29T20:52:07.601519] [INFO ] [MAIN ] RITM: Full history saved. [2025-09-29T20:52:07.601723] [INFO ] [MAIN ] Update Progress: 1808/2371 symbols completed. RITM took 33.4s. Estimated remaining: 1h 12m 16s. Rate: 7.8 symbols/min [2025-09-29T20:52:07.683170] [DEBUG] [LOCAL ] RL: Loaded 41998 existing records from primary storage. [2025-09-29T20:52:07.700239] [INFO ] [MAIN ] RL: Loaded 41998 existing records. [2025-09-29T20:52:07.903507] [INFO ] [MAIN ] RLI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:52:07.990353] [WARN ] [MAIN ] RL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:52:07.991192] [INFO ] [MAIN ] RL: Wiping existing primary data before full refresh. [2025-09-29T20:52:07.991246] [INFO ] [LOCAL ] RL: Starting deletion of primary data. [2025-09-29T20:52:07.991864] [DEBUG] [LOCAL ] RL: Deleted primary data file. [2025-09-29T20:52:07.992986] [INFO ] [MAIN ] RL: Starting full primary refresh. [2025-09-29T20:52:08.275385] [DEBUG] [LOCAL ] RLI: Loaded 33794 existing records from primary storage. [2025-09-29T20:52:08.292991] [INFO ] [MAIN ] RLI: Loaded 33794 existing records. [2025-09-29T20:52:08.559279] [INFO ] [REMOTE ] RL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:52:08.586939] [INFO ] [REMOTE ] RL: Fetching primary data for 2024-12. [2025-09-29T20:52:08.652021] [WARN ] [MAIN ] RLI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:52:08.669990] [INFO ] [MAIN ] RLI: Wiping existing primary data before full refresh. [2025-09-29T20:52:08.683972] [INFO ] [LOCAL ] RLI: Starting deletion of primary data. [2025-09-29T20:52:08.684496] [DEBUG] [LOCAL ] RLI: Deleted primary data file. [2025-09-29T20:52:08.684801] [INFO ] [MAIN ] RLI: Starting full primary refresh. [2025-09-29T20:52:08.691890] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2024-12 (2.74 seconds). [2025-09-29T20:52:08.753339] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-01. [2025-09-29T20:52:09.036661] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-29T20:52:09.093521] [INFO ] [REMOTE ] RJF: Full fetch complete (68411 records). [2025-09-29T20:52:09.113034] [DEBUG] [VALIDATOR ] RJF: Validating primary data. [2025-09-29T20:52:09.137974] [INFO ] [REMOTE ] RLI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:52:09.170910] [INFO ] [REMOTE ] RLI: Fetching primary data for 2024-12. [2025-09-29T20:52:09.557484] [DEBUG] [VALIDATOR ] RJF: All expected trading days are present. [2025-09-29T20:52:09.557588] [DEBUG] [VALIDATOR ] RJF: Primary data validation passed. [2025-09-29T20:52:09.558728] [INFO ] [MAIN ] RJF: Fetched primary data is valid. [2025-09-29T20:52:09.558796] [DEBUG] [LOCAL ] RJF: Saving primary data. [2025-09-29T20:52:09.560297] [DEBUG] [LOCAL ] RJF: Trimmed 68411 records to 47030 (keeping 200 days of data) [2025-09-29T20:52:09.874809] [DEBUG] [LOCAL ] RJF: Primary data saved (47030 records). [2025-09-29T20:52:09.875116] [INFO ] [MAIN ] RJF: Full history saved. [2025-09-29T20:52:09.877546] [INFO ] [MAIN ] Update Progress: 1809/2371 symbols completed. RJF took 32.1s. Estimated remaining: 1h 12m 7s. Rate: 7.8 symbols/min [2025-09-29T20:52:10.063248] [INFO ] [MAIN ] RLJ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:52:10.117935] [DEBUG] [LOCAL ] RLJ: Loaded 48922 existing records from primary storage. [2025-09-29T20:52:10.118308] [INFO ] [MAIN ] RLJ: Loaded 48922 existing records. [2025-09-29T20:52:10.309956] [WARN ] [MAIN ] RLJ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:52:10.310837] [INFO ] [MAIN ] RLJ: Wiping existing primary data before full refresh. [2025-09-29T20:52:10.311763] [INFO ] [LOCAL ] RLJ: Starting deletion of primary data. [2025-09-29T20:52:10.312496] [DEBUG] [LOCAL ] RLJ: Deleted primary data file. [2025-09-29T20:52:10.312559] [INFO ] [MAIN ] RLJ: Starting full primary refresh. [2025-09-29T20:52:10.424287] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-29T20:52:10.460809] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-01. [2025-09-29T20:52:10.796954] [INFO ] [REMOTE ] RLJ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:52:10.812548] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2024-12. [2025-09-29T20:52:10.816713] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-29T20:52:10.832416] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-29T20:52:11.548183] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-02. [2025-09-29T20:52:12.134081] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-29T20:52:12.348128] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-02. [2025-09-29T20:52:12.417192] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-29T20:52:13.148113] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-01. [2025-09-29T20:52:13.389496] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-29T20:52:13.513849] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-29T20:52:13.948110] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-01. [2025-09-29T20:52:14.748136] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-03. [2025-09-29T20:52:14.845953] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-29T20:52:15.539898] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-29T20:52:15.549245] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-02. [2025-09-29T20:52:16.348067] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-02. [2025-09-29T20:52:16.542276] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-29T20:52:16.798186] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-29T20:52:17.148142] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-03. [2025-09-29T20:52:17.948084] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-03. [2025-09-29T20:52:17.979368] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-29T20:52:18.596401] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-29T20:52:18.748130] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-04. [2025-09-29T20:52:19.548113] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-04. [2025-09-29T20:52:19.853626] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-29T20:52:20.348095] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-04. [2025-09-29T20:52:20.484138] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-29T20:52:21.148169] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-05. [2025-09-29T20:52:21.722200] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-29T20:52:21.948162] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-05. [2025-09-29T20:52:22.228293] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-29T20:52:22.522708] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-29T20:52:22.748109] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-03. [2025-09-29T20:52:23.548111] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-06. [2025-09-29T20:52:24.044906] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-29T20:52:24.348104] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-05. [2025-09-29T20:52:24.557387] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-29T20:52:25.148095] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-06. [2025-09-29T20:52:25.253504] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-29T20:52:25.839292] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-29T20:52:25.948109] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-06. [2025-09-29T20:52:26.748099] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-07. [2025-09-29T20:52:27.146511] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-29T20:52:27.221992] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-29T20:52:27.548109] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-04. [2025-09-29T20:52:28.348079] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-07. [2025-09-29T20:52:28.383696] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-29T20:52:29.148114] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-07. [2025-09-29T20:52:29.361119] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-29T20:52:29.948114] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-05. [2025-09-29T20:52:30.749134] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-08. [2025-09-29T20:52:30.766901] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-09-29T20:52:30.815085] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-29T20:52:31.548093] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-08. [2025-09-29T20:52:31.668338] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-29T20:52:31.906451] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-29T20:52:32.348110] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-06. [2025-09-29T20:52:33.148125] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-09. [2025-09-29T20:52:33.891484] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-09-29T20:52:33.948081] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-09. [2025-09-29T20:52:34.039541] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-29T20:52:34.433812] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-29T20:52:34.441336] [INFO ] [REMOTE ] RLI: Full fetch complete (46633 records). [2025-09-29T20:52:34.441472] [DEBUG] [VALIDATOR ] RLI: Validating primary data. [2025-09-29T20:52:34.748862] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-07. [2025-09-29T20:52:34.845274] [DEBUG] [VALIDATOR ] RLI: All expected trading days are present. [2025-09-29T20:52:34.845370] [DEBUG] [VALIDATOR ] RLI: Primary data validation passed. [2025-09-29T20:52:34.846263] [INFO ] [MAIN ] RLI: Fetched primary data is valid. [2025-09-29T20:52:34.846331] [DEBUG] [LOCAL ] RLI: Saving primary data. [2025-09-29T20:52:34.847522] [DEBUG] [LOCAL ] RLI: Trimmed 46633 records to 33377 (keeping 200 days of data) [2025-09-29T20:52:35.054225] [DEBUG] [LOCAL ] RLI: Primary data saved (33377 records). [2025-09-29T20:52:35.054377] [INFO ] [MAIN ] RLI: Full history saved. [2025-09-29T20:52:35.054462] [INFO ] [MAIN ] Update Progress: 1810/2371 symbols completed. RLI took 27.4s. Estimated remaining: 1h 12m 4s. Rate: 7.8 symbols/min [2025-09-29T20:52:35.223374] [INFO ] [MAIN ] RLTY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:52:35.238409] [DEBUG] [LOCAL ] RLTY: Loaded 11255 existing records from primary storage. [2025-09-29T20:52:35.238671] [INFO ] [MAIN ] RLTY: Loaded 11255 existing records. [2025-09-29T20:52:35.418610] [WARN ] [MAIN ] RLTY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:52:35.418865] [INFO ] [MAIN ] RLTY: Wiping existing primary data before full refresh. [2025-09-29T20:52:35.418916] [INFO ] [LOCAL ] RLTY: Starting deletion of primary data. [2025-09-29T20:52:35.419945] [DEBUG] [LOCAL ] RLTY: Deleted primary data file. [2025-09-29T20:52:35.420006] [INFO ] [MAIN ] RLTY: Starting full primary refresh. [2025-09-29T20:52:35.561285] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-08. [2025-09-29T20:52:35.793219] [INFO ] [REMOTE ] RLTY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:52:36.036527] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-29T20:52:36.048091] [INFO ] [REMOTE ] RKT: Full fetch complete (77372 records). [2025-09-29T20:52:36.048298] [DEBUG] [VALIDATOR ] RKT: Validating primary data. [2025-09-29T20:52:36.363872] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2024-12. [2025-09-29T20:52:36.404904] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-29T20:52:36.518636] [DEBUG] [VALIDATOR ] RKT: All expected trading days are present. [2025-09-29T20:52:36.518773] [DEBUG] [VALIDATOR ] RKT: Primary data validation passed. [2025-09-29T20:52:36.520077] [INFO ] [MAIN ] RKT: Fetched primary data is valid. [2025-09-29T20:52:36.520980] [DEBUG] [LOCAL ] RKT: Saving primary data. [2025-09-29T20:52:36.522778] [DEBUG] [LOCAL ] RKT: Trimmed 77372 records to 53721 (keeping 200 days of data) [2025-09-29T20:52:36.889824] [DEBUG] [LOCAL ] RKT: Primary data saved (53721 records). [2025-09-29T20:52:36.889988] [INFO ] [MAIN ] RKT: Full history saved. [2025-09-29T20:52:36.890133] [INFO ] [MAIN ] Update Progress: 1811/2371 symbols completed. RKT took 33.2s. Estimated remaining: 1h 11m 55s. Rate: 7.8 symbols/min [2025-09-29T20:52:37.118597] [INFO ] [MAIN ] RLX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:52:37.149185] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-08. [2025-09-29T20:52:37.205100] [DEBUG] [LOCAL ] RLX: Loaded 48987 existing records from primary storage. [2025-09-29T20:52:37.205883] [INFO ] [MAIN ] RLX: Loaded 48987 existing records. [2025-09-29T20:52:37.459024] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-29T20:52:37.554380] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-29T20:52:37.605525] [WARN ] [MAIN ] RLX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:52:37.605827] [INFO ] [MAIN ] RLX: Wiping existing primary data before full refresh. [2025-09-29T20:52:37.605903] [INFO ] [LOCAL ] RLX: Starting deletion of primary data. [2025-09-29T20:52:37.607231] [DEBUG] [LOCAL ] RLX: Deleted primary data file. [2025-09-29T20:52:37.607316] [INFO ] [MAIN ] RLX: Starting full primary refresh. [2025-09-29T20:52:37.953447] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-09. [2025-09-29T20:52:38.078464] [INFO ] [REMOTE ] RLX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:52:38.748147] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-01. [2025-09-29T20:52:38.887719] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-29T20:52:39.516187] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-29T20:52:39.519394] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-29T20:52:39.532428] [INFO ] [REMOTE ] RL: Full fetch complete (59813 records). [2025-09-29T20:52:39.532616] [DEBUG] [VALIDATOR ] RL: Validating primary data. [2025-09-29T20:52:39.555863] [INFO ] [REMOTE ] RLX: Fetching primary data for 2024-12. [2025-09-29T20:52:39.960236] [DEBUG] [VALIDATOR ] RL: All expected trading days are present. [2025-09-29T20:52:39.960321] [DEBUG] [VALIDATOR ] RL: Primary data validation passed. [2025-09-29T20:52:39.961417] [INFO ] [MAIN ] RL: Fetched primary data is valid. [2025-09-29T20:52:39.961489] [DEBUG] [LOCAL ] RL: Saving primary data. [2025-09-29T20:52:39.962797] [DEBUG] [LOCAL ] RL: Trimmed 59813 records to 41166 (keeping 200 days of data) [2025-09-29T20:52:40.232833] [DEBUG] [LOCAL ] RL: Primary data saved (41166 records). [2025-09-29T20:52:40.232999] [INFO ] [MAIN ] RL: Full history saved. [2025-09-29T20:52:40.233156] [INFO ] [MAIN ] Update Progress: 1812/2371 symbols completed. RL took 32.9s. Estimated remaining: 1h 11m 46s. Rate: 7.8 symbols/min [2025-09-29T20:52:40.353328] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-02. [2025-09-29T20:52:40.414019] [INFO ] [MAIN ] RM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:52:40.424047] [DEBUG] [LOCAL ] RM: Loaded 7734 existing records from primary storage. [2025-09-29T20:52:40.424271] [INFO ] [MAIN ] RM: Loaded 7734 existing records. [2025-09-29T20:52:40.611000] [WARN ] [MAIN ] RM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:52:40.611230] [INFO ] [MAIN ] RM: Wiping existing primary data before full refresh. [2025-09-29T20:52:40.611279] [INFO ] [LOCAL ] RM: Starting deletion of primary data. [2025-09-29T20:52:40.611479] [DEBUG] [LOCAL ] RM: Deleted primary data file. [2025-09-29T20:52:40.611542] [INFO ] [MAIN ] RM: Starting full primary refresh. [2025-09-29T20:52:40.982343] [INFO ] [REMOTE ] RM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:52:41.148150] [INFO ] [REMOTE ] RM: Fetching primary data for 2024-12. [2025-09-29T20:52:41.403828] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-29T20:52:41.459212] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-29T20:52:41.948123] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-01. [2025-09-29T20:52:41.955202] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-29T20:52:42.748143] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-03. [2025-09-29T20:52:43.548135] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-01. [2025-09-29T20:52:43.647143] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-29T20:52:43.680909] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-29T20:52:44.348098] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-02. [2025-09-29T20:52:44.390902] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-29T20:52:45.148156] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-04. [2025-09-29T20:52:45.948126] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-02. [2025-09-29T20:52:46.089583] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-29T20:52:46.108996] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-29T20:52:46.748093] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-05. [2025-09-29T20:52:46.785727] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-29T20:52:47.548152] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-09. [2025-09-29T20:52:47.604699] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-29T20:52:48.348122] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-03. [2025-09-29T20:52:49.060500] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-29T20:52:49.073541] [INFO ] [REMOTE ] RLJ: Full fetch complete (69163 records). [2025-09-29T20:52:49.073714] [DEBUG] [VALIDATOR ] RLJ: Validating primary data. [2025-09-29T20:52:49.155231] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-06. [2025-09-29T20:52:49.487925] [DEBUG] [VALIDATOR ] RLJ: All expected trading days are present. [2025-09-29T20:52:49.488033] [DEBUG] [VALIDATOR ] RLJ: Primary data validation passed. [2025-09-29T20:52:49.489261] [INFO ] [MAIN ] RLJ: Fetched primary data is valid. [2025-09-29T20:52:49.489342] [DEBUG] [LOCAL ] RLJ: Saving primary data. [2025-09-29T20:52:49.493603] [DEBUG] [LOCAL ] RLJ: Trimmed 69163 records to 48129 (keeping 200 days of data) [2025-09-29T20:52:49.801513] [DEBUG] [LOCAL ] RLJ: Primary data saved (48129 records). [2025-09-29T20:52:49.801728] [INFO ] [MAIN ] RLJ: Full history saved. [2025-09-29T20:52:49.801853] [INFO ] [MAIN ] Update Progress: 1813/2371 symbols completed. RLJ took 39.9s. Estimated remaining: 1h 11m 39s. Rate: 7.8 symbols/min [2025-09-29T20:52:49.950348] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-03. [2025-09-29T20:52:49.987723] [INFO ] [MAIN ] RMAX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:52:50.016271] [DEBUG] [LOCAL ] RMAX: Loaded 22121 existing records from primary storage. [2025-09-29T20:52:50.016738] [INFO ] [MAIN ] RMAX: Loaded 22121 existing records. [2025-09-29T20:52:50.201104] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-29T20:52:50.235203] [WARN ] [MAIN ] RMAX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:52:50.238919] [INFO ] [MAIN ] RMAX: Wiping existing primary data before full refresh. [2025-09-29T20:52:50.239162] [INFO ] [LOCAL ] RMAX: Starting deletion of primary data. [2025-09-29T20:52:50.239888] [DEBUG] [LOCAL ] RMAX: Deleted primary data file. [2025-09-29T20:52:50.239953] [INFO ] [MAIN ] RMAX: Starting full primary refresh. [2025-09-29T20:52:50.631003] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-29T20:52:50.652377] [INFO ] [REMOTE ] RMAX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:52:50.748123] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-07. [2025-09-29T20:52:50.805938] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-29T20:52:51.548153] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-04. [2025-09-29T20:52:51.693820] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-29T20:52:52.348130] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2024-12. [2025-09-29T20:52:52.547947] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-29T20:52:53.148155] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-05. [2025-09-29T20:52:53.466938] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-29T20:52:53.669483] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-29T20:52:53.948115] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-01. [2025-09-29T20:52:54.748154] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-06. [2025-09-29T20:52:55.002516] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-29T20:52:55.485600] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-29T20:52:55.548153] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-04. [2025-09-29T20:52:56.348144] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-02. [2025-09-29T20:52:57.137487] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-29T20:52:57.148144] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-07. [2025-09-29T20:52:57.469944] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-29T20:52:57.946274] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-29T20:52:57.948276] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-05. [2025-09-29T20:52:58.748112] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-08. [2025-09-29T20:52:59.548125] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-08. [2025-09-29T20:52:59.596961] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-29T20:52:59.608346] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-29T20:53:00.348109] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-03. [2025-09-29T20:53:00.438202] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-29T20:53:01.148078] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-09. [2025-09-29T20:53:01.542097] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-29T20:53:01.951389] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-09. [2025-09-29T20:53:01.952386] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-29T20:53:01.955573] [INFO ] [REMOTE ] RM: Full fetch complete (11556 records). [2025-09-29T20:53:01.955676] [DEBUG] [VALIDATOR ] RM: Validating primary data. [2025-09-29T20:53:02.356907] [DEBUG] [VALIDATOR ] RM: All expected trading days are present. [2025-09-29T20:53:02.357255] [DEBUG] [VALIDATOR ] RM: Primary data validation passed. [2025-09-29T20:53:02.357589] [INFO ] [MAIN ] RM: Fetched primary data is valid. [2025-09-29T20:53:02.357678] [DEBUG] [LOCAL ] RM: Saving primary data. [2025-09-29T20:53:02.358268] [DEBUG] [LOCAL ] RM: Trimmed 11556 records to 7558 (keeping 200 days of data) [2025-09-29T20:53:02.414054] [DEBUG] [LOCAL ] RM: Primary data saved (7558 records). [2025-09-29T20:53:02.414196] [INFO ] [MAIN ] RM: Full history saved. [2025-09-29T20:53:02.414329] [INFO ] [MAIN ] Update Progress: 1814/2371 symbols completed. RM took 22.2s. Estimated remaining: 1h 11m 32s. Rate: 7.8 symbols/min [2025-09-29T20:53:02.595493] [INFO ] [MAIN ] RMD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:53:02.647284] [DEBUG] [LOCAL ] RMD: Loaded 42855 existing records from primary storage. [2025-09-29T20:53:02.647600] [INFO ] [MAIN ] RMD: Loaded 42855 existing records. [2025-09-29T20:53:02.753518] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-06. [2025-09-29T20:53:02.840769] [WARN ] [MAIN ] RMD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:53:02.841062] [INFO ] [MAIN ] RMD: Wiping existing primary data before full refresh. [2025-09-29T20:53:02.841133] [INFO ] [LOCAL ] RMD: Starting deletion of primary data. [2025-09-29T20:53:02.841947] [DEBUG] [LOCAL ] RMD: Deleted primary data file. [2025-09-29T20:53:02.842025] [INFO ] [MAIN ] RMD: Starting full primary refresh. [2025-09-29T20:53:02.960987] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-29T20:53:03.005667] [INFO ] [REMOTE ] RLTY: Full fetch complete (18199 records). [2025-09-29T20:53:03.011572] [DEBUG] [VALIDATOR ] RLTY: Validating primary data. [2025-09-29T20:53:03.483582] [INFO ] [REMOTE ] RMD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:53:03.554540] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-04. [2025-09-29T20:53:03.696272] [DEBUG] [VALIDATOR ] RLTY: All expected trading days are present. [2025-09-29T20:53:03.696356] [DEBUG] [VALIDATOR ] RLTY: Primary data validation passed. [2025-09-29T20:53:03.696878] [INFO ] [MAIN ] RLTY: Fetched primary data is valid. [2025-09-29T20:53:03.696943] [DEBUG] [LOCAL ] RLTY: Saving primary data. [2025-09-29T20:53:03.697578] [DEBUG] [LOCAL ] RLTY: Trimmed 18199 records to 11119 (keeping 200 days of data) [2025-09-29T20:53:03.771318] [DEBUG] [LOCAL ] RLTY: Primary data saved (11119 records). [2025-09-29T20:53:03.771468] [INFO ] [MAIN ] RLTY: Full history saved. [2025-09-29T20:53:03.771590] [INFO ] [MAIN ] Update Progress: 1815/2371 symbols completed. RLTY took 28.7s. Estimated remaining: 1h 11m 23s. Rate: 7.8 symbols/min [2025-09-29T20:53:03.947020] [INFO ] [MAIN ] RMI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:53:03.954976] [DEBUG] [LOCAL ] RMI: Loaded 4716 existing records from primary storage. [2025-09-29T20:53:03.955161] [INFO ] [MAIN ] RMI: Loaded 4716 existing records. [2025-09-29T20:53:04.145977] [WARN ] [MAIN ] RMI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:53:04.146199] [INFO ] [MAIN ] RMI: Wiping existing primary data before full refresh. [2025-09-29T20:53:04.146249] [INFO ] [LOCAL ] RMI: Starting deletion of primary data. [2025-09-29T20:53:04.146466] [DEBUG] [LOCAL ] RMI: Deleted primary data file. [2025-09-29T20:53:04.146526] [INFO ] [MAIN ] RMI: Starting full primary refresh. [2025-09-29T20:53:04.366995] [INFO ] [REMOTE ] RMD: Fetching primary data for 2024-12. [2025-09-29T20:53:04.539737] [INFO ] [REMOTE ] RMI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:53:04.625908] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-29T20:53:04.762210] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-29T20:53:05.148111] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-05. [2025-09-29T20:53:05.668495] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-29T20:53:05.948144] [INFO ] [REMOTE ] RMI: Fetching primary data for 2024-12. [2025-09-29T20:53:06.445671] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-29T20:53:06.717666] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-29T20:53:06.748098] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-01. [2025-09-29T20:53:07.548161] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-01. [2025-09-29T20:53:08.201780] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-29T20:53:08.348109] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-02. [2025-09-29T20:53:08.468020] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-29T20:53:08.798880] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-29T20:53:09.148154] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-03. [2025-09-29T20:53:09.809023] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-29T20:53:09.948114] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-04. [2025-09-29T20:53:10.603595] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-29T20:53:10.748151] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-07. [2025-09-29T20:53:11.548170] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-05. [2025-09-29T20:53:12.194832] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-29T20:53:12.348082] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-02. [2025-09-29T20:53:12.518886] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-29T20:53:13.148111] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-06. [2025-09-29T20:53:13.948088] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-06. [2025-09-29T20:53:14.056615] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-29T20:53:14.325138] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-29T20:53:14.526561] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-29T20:53:14.748121] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-03. [2025-09-29T20:53:15.548123] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-07. [2025-09-29T20:53:16.348135] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-07. [2025-09-29T20:53:16.497772] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-29T20:53:16.838796] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-29T20:53:16.997573] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-29T20:53:17.148126] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-08. [2025-09-29T20:53:17.932611] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-29T20:53:17.948070] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-09. [2025-09-29T20:53:18.608410] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-29T20:53:18.610529] [INFO ] [REMOTE ] RMI: Full fetch complete (6323 records). [2025-09-29T20:53:18.610609] [DEBUG] [VALIDATOR ] RMI: Validating primary data. [2025-09-29T20:53:18.753593] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-08. [2025-09-29T20:53:18.985357] [DEBUG] [VALIDATOR ] RMI: All expected trading days are present. [2025-09-29T20:53:18.985456] [DEBUG] [VALIDATOR ] RMI: Primary data validation passed. [2025-09-29T20:53:18.985792] [INFO ] [MAIN ] RMI: Fetched primary data is valid. [2025-09-29T20:53:18.985859] [DEBUG] [LOCAL ] RMI: Saving primary data. [2025-09-29T20:53:18.986345] [DEBUG] [LOCAL ] RMI: Trimmed 6323 records to 4681 (keeping 200 days of data) [2025-09-29T20:53:19.015556] [DEBUG] [LOCAL ] RMI: Primary data saved (4681 records). [2025-09-29T20:53:19.015718] [INFO ] [MAIN ] RMI: Full history saved. [2025-09-29T20:53:19.015823] [INFO ] [MAIN ] Update Progress: 1816/2371 symbols completed. RMI took 15.2s. Estimated remaining: 1h 11m 17s. Rate: 7.8 symbols/min [2025-09-29T20:53:19.193720] [INFO ] [MAIN ] RMM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:53:19.207826] [DEBUG] [LOCAL ] RMM: Loaded 10624 existing records from primary storage. [2025-09-29T20:53:19.208059] [INFO ] [MAIN ] RMM: Loaded 10624 existing records. [2025-09-29T20:53:19.390302] [WARN ] [MAIN ] RMM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:53:19.390545] [INFO ] [MAIN ] RMM: Wiping existing primary data before full refresh. [2025-09-29T20:53:19.390594] [INFO ] [LOCAL ] RMM: Starting deletion of primary data. [2025-09-29T20:53:19.390806] [DEBUG] [LOCAL ] RMM: Deleted primary data file. [2025-09-29T20:53:19.390867] [INFO ] [MAIN ] RMM: Starting full primary refresh. [2025-09-29T20:53:19.550881] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-04. [2025-09-29T20:53:19.760314] [INFO ] [REMOTE ] RMM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:53:20.348093] [INFO ] [REMOTE ] RMM: Fetching primary data for 2024-12. [2025-09-29T20:53:20.508348] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-29T20:53:21.148095] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-09. [2025-09-29T20:53:21.245906] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-29T20:53:21.608018] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-29T20:53:21.948103] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-05. [2025-09-29T20:53:22.748120] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-08. [2025-09-29T20:53:22.879738] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-29T20:53:22.890165] [INFO ] [REMOTE ] RLX: Full fetch complete (70326 records). [2025-09-29T20:53:22.890316] [DEBUG] [VALIDATOR ] RLX: Validating primary data. [2025-09-29T20:53:23.299687] [DEBUG] [VALIDATOR ] RLX: All expected trading days are present. [2025-09-29T20:53:23.299892] [DEBUG] [VALIDATOR ] RLX: Primary data validation passed. [2025-09-29T20:53:23.301002] [INFO ] [MAIN ] RLX: Fetched primary data is valid. [2025-09-29T20:53:23.301069] [DEBUG] [LOCAL ] RLX: Saving primary data. [2025-09-29T20:53:23.302468] [DEBUG] [LOCAL ] RLX: Trimmed 70326 records to 48326 (keeping 200 days of data) [2025-09-29T20:53:23.553157] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-01. [2025-09-29T20:53:23.558228] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-29T20:53:23.650887] [DEBUG] [LOCAL ] RLX: Primary data saved (48326 records). [2025-09-29T20:53:23.651047] [INFO ] [MAIN ] RLX: Full history saved. [2025-09-29T20:53:23.651174] [INFO ] [MAIN ] Update Progress: 1817/2371 symbols completed. RLX took 46.8s. Estimated remaining: 1h 11m 9s. Rate: 7.8 symbols/min [2025-09-29T20:53:23.833680] [INFO ] [MAIN ] RMMZ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:53:23.842183] [DEBUG] [LOCAL ] RMMZ: Loaded 4875 existing records from primary storage. [2025-09-29T20:53:23.842424] [INFO ] [MAIN ] RMMZ: Loaded 4875 existing records. [2025-09-29T20:53:24.036206] [WARN ] [MAIN ] RMMZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:53:24.036546] [INFO ] [MAIN ] RMMZ: Wiping existing primary data before full refresh. [2025-09-29T20:53:24.036824] [INFO ] [LOCAL ] RMMZ: Starting deletion of primary data. [2025-09-29T20:53:24.037258] [DEBUG] [LOCAL ] RMMZ: Deleted primary data file. [2025-09-29T20:53:24.037348] [INFO ] [MAIN ] RMMZ: Starting full primary refresh. [2025-09-29T20:53:24.127714] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-29T20:53:24.351254] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-09. [2025-09-29T20:53:24.405689] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-29T20:53:24.479263] [INFO ] [REMOTE ] RMMZ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:53:25.148099] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-06. [2025-09-29T20:53:25.561218] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-29T20:53:25.566128] [INFO ] [REMOTE ] RMAX: Full fetch complete (29732 records). [2025-09-29T20:53:25.566225] [DEBUG] [VALIDATOR ] RMAX: Validating primary data. [2025-09-29T20:53:25.953702] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2024-12. [2025-09-29T20:53:25.984422] [DEBUG] [VALIDATOR ] RMAX: All expected trading days are present. [2025-09-29T20:53:25.984513] [DEBUG] [VALIDATOR ] RMAX: Primary data validation passed. [2025-09-29T20:53:25.985260] [INFO ] [MAIN ] RMAX: Fetched primary data is valid. [2025-09-29T20:53:25.985329] [DEBUG] [LOCAL ] RMAX: Saving primary data. [2025-09-29T20:53:25.986170] [DEBUG] [LOCAL ] RMAX: Trimmed 29732 records to 21510 (keeping 200 days of data) [2025-09-29T20:53:26.116470] [DEBUG] [LOCAL ] RMAX: Primary data saved (21510 records). [2025-09-29T20:53:26.116600] [INFO ] [MAIN ] RMAX: Full history saved. [2025-09-29T20:53:26.116703] [INFO ] [MAIN ] Update Progress: 1818/2371 symbols completed. RMAX took 36.3s. Estimated remaining: 1h 10m 59s. Rate: 7.8 symbols/min [2025-09-29T20:53:26.294543] [INFO ] [MAIN ] RMT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:53:26.314514] [DEBUG] [LOCAL ] RMT: Loaded 17682 existing records from primary storage. [2025-09-29T20:53:26.314813] [INFO ] [MAIN ] RMT: Loaded 17682 existing records. [2025-09-29T20:53:26.502427] [WARN ] [MAIN ] RMT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:53:26.502771] [INFO ] [MAIN ] RMT: Wiping existing primary data before full refresh. [2025-09-29T20:53:26.502897] [INFO ] [LOCAL ] RMT: Starting deletion of primary data. [2025-09-29T20:53:26.503185] [DEBUG] [LOCAL ] RMT: Deleted primary data file. [2025-09-29T20:53:26.503244] [INFO ] [MAIN ] RMT: Starting full primary refresh. [2025-09-29T20:53:26.756247] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-02. [2025-09-29T20:53:26.888107] [INFO ] [REMOTE ] RMT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:53:26.890715] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-29T20:53:26.916085] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-29T20:53:27.548126] [INFO ] [REMOTE ] RMT: Fetching primary data for 2024-12. [2025-09-29T20:53:27.592238] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-29T20:53:28.348111] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-03. [2025-09-29T20:53:28.878302] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-29T20:53:29.148185] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-01. [2025-09-29T20:53:29.387304] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-29T20:53:29.948122] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-07. [2025-09-29T20:53:30.013889] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-29T20:53:30.748122] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-02. [2025-09-29T20:53:31.295756] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-29T20:53:31.548108] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-03. [2025-09-29T20:53:31.684859] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-29T20:53:32.273517] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-29T20:53:32.348141] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-04. [2025-09-29T20:53:33.091680] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-29T20:53:33.148120] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-05. [2025-09-29T20:53:33.841043] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-29T20:53:33.948154] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-04. [2025-09-29T20:53:34.748136] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-01. [2025-09-29T20:53:34.839474] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-29T20:53:35.548136] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-05. [2025-09-29T20:53:35.878158] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-29T20:53:36.281327] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-29T20:53:36.348123] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-06. [2025-09-29T20:53:37.058148] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-29T20:53:37.148106] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-07. [2025-09-29T20:53:37.948084] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-02. [2025-09-29T20:53:38.007108] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-29T20:53:38.748106] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-08. [2025-09-29T20:53:38.883034] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-29T20:53:39.548111] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-03. [2025-09-29T20:53:40.348097] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-06. [2025-09-29T20:53:40.461283] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-29T20:53:40.589328] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-29T20:53:40.976745] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-29T20:53:41.148135] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-07. [2025-09-29T20:53:41.741940] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-29T20:53:41.948111] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-09. [2025-09-29T20:53:42.748113] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-08. [2025-09-29T20:53:43.482392] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-29T20:53:43.552628] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-08. [2025-09-29T20:53:43.555432] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-29T20:53:43.564266] [INFO ] [REMOTE ] RMD: Full fetch complete (61107 records). [2025-09-29T20:53:43.564431] [DEBUG] [VALIDATOR ] RMD: Validating primary data. [2025-09-29T20:53:43.954838] [DEBUG] [VALIDATOR ] RMD: All expected trading days are present. [2025-09-29T20:53:43.954922] [DEBUG] [VALIDATOR ] RMD: Primary data validation passed. [2025-09-29T20:53:43.956026] [INFO ] [MAIN ] RMD: Fetched primary data is valid. [2025-09-29T20:53:43.956094] [DEBUG] [LOCAL ] RMD: Saving primary data. [2025-09-29T20:53:43.957762] [DEBUG] [LOCAL ] RMD: Trimmed 61107 records to 42059 (keeping 200 days of data) [2025-09-29T20:53:44.229030] [DEBUG] [LOCAL ] RMD: Primary data saved (42059 records). [2025-09-29T20:53:44.229160] [INFO ] [MAIN ] RMD: Full history saved. [2025-09-29T20:53:44.229258] [INFO ] [MAIN ] Update Progress: 1819/2371 symbols completed. RMD took 41.8s. Estimated remaining: 1h 10m 55s. Rate: 7.8 symbols/min [2025-09-29T20:53:44.353227] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-09. [2025-09-29T20:53:44.412689] [INFO ] [MAIN ] RNG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:53:44.463023] [DEBUG] [LOCAL ] RNG: Loaded 48830 existing records from primary storage. [2025-09-29T20:53:44.463404] [INFO ] [MAIN ] RNG: Loaded 48830 existing records. [2025-09-29T20:53:44.591386] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-29T20:53:44.663783] [WARN ] [MAIN ] RNG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:53:44.663992] [INFO ] [MAIN ] RNG: Wiping existing primary data before full refresh. [2025-09-29T20:53:44.664041] [INFO ] [LOCAL ] RNG: Starting deletion of primary data. [2025-09-29T20:53:44.664456] [DEBUG] [LOCAL ] RNG: Deleted primary data file. [2025-09-29T20:53:44.664521] [INFO ] [MAIN ] RNG: Starting full primary refresh. [2025-09-29T20:53:45.044427] [INFO ] [REMOTE ] RNG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:53:45.049433] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-29T20:53:45.051222] [INFO ] [REMOTE ] RMMZ: Full fetch complete (7127 records). [2025-09-29T20:53:45.051299] [DEBUG] [VALIDATOR ] RMMZ: Validating primary data. [2025-09-29T20:53:45.153682] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-04. [2025-09-29T20:53:45.429442] [DEBUG] [VALIDATOR ] RMMZ: All expected trading days are present. [2025-09-29T20:53:45.429522] [DEBUG] [VALIDATOR ] RMMZ: Primary data validation passed. [2025-09-29T20:53:45.429785] [INFO ] [MAIN ] RMMZ: Fetched primary data is valid. [2025-09-29T20:53:45.429850] [DEBUG] [LOCAL ] RMMZ: Saving primary data. [2025-09-29T20:53:45.430269] [DEBUG] [LOCAL ] RMMZ: Trimmed 7127 records to 4827 (keeping 200 days of data) [2025-09-29T20:53:45.460672] [DEBUG] [LOCAL ] RMMZ: Primary data saved (4827 records). [2025-09-29T20:53:45.460808] [INFO ] [MAIN ] RMMZ: Full history saved. [2025-09-29T20:53:45.460894] [INFO ] [MAIN ] Update Progress: 1820/2371 symbols completed. RMMZ took 21.8s. Estimated remaining: 1h 10m 45s. Rate: 7.8 symbols/min [2025-09-29T20:53:45.635604] [INFO ] [MAIN ] RNGR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:53:45.658847] [DEBUG] [LOCAL ] RNGR: Loaded 20653 existing records from primary storage. [2025-09-29T20:53:45.659113] [INFO ] [MAIN ] RNGR: Loaded 20653 existing records. [2025-09-29T20:53:45.844427] [WARN ] [MAIN ] RNGR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:53:45.844663] [INFO ] [MAIN ] RNGR: Wiping existing primary data before full refresh. [2025-09-29T20:53:45.844727] [INFO ] [LOCAL ] RNGR: Starting deletion of primary data. [2025-09-29T20:53:45.845009] [DEBUG] [LOCAL ] RNGR: Deleted primary data file. [2025-09-29T20:53:45.845069] [INFO ] [MAIN ] RNGR: Starting full primary refresh. [2025-09-29T20:53:45.953236] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-09. [2025-09-29T20:53:46.251936] [INFO ] [REMOTE ] RNGR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:53:46.326138] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-29T20:53:46.748116] [INFO ] [REMOTE ] RNG: Fetching primary data for 2024-12. [2025-09-29T20:53:46.992207] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-29T20:53:46.995821] [INFO ] [REMOTE ] RMM: Full fetch complete (15068 records). [2025-09-29T20:53:46.995943] [DEBUG] [VALIDATOR ] RMM: Validating primary data. [2025-09-29T20:53:47.380475] [DEBUG] [VALIDATOR ] RMM: All expected trading days are present. [2025-09-29T20:53:47.380589] [DEBUG] [VALIDATOR ] RMM: Primary data validation passed. [2025-09-29T20:53:47.381023] [INFO ] [MAIN ] RMM: Fetched primary data is valid. [2025-09-29T20:53:47.381092] [DEBUG] [LOCAL ] RMM: Saving primary data. [2025-09-29T20:53:47.381758] [DEBUG] [LOCAL ] RMM: Trimmed 15068 records to 10536 (keeping 200 days of data) [2025-09-29T20:53:47.448067] [DEBUG] [LOCAL ] RMM: Primary data saved (10536 records). [2025-09-29T20:53:47.448210] [INFO ] [MAIN ] RMM: Full history saved. [2025-09-29T20:53:47.448310] [INFO ] [MAIN ] Update Progress: 1821/2371 symbols completed. RMM took 28.4s. Estimated remaining: 1h 10m 36s. Rate: 7.8 symbols/min [2025-09-29T20:53:47.553472] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-05. [2025-09-29T20:53:47.634062] [INFO ] [MAIN ] RNP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:53:47.654364] [DEBUG] [LOCAL ] RNP: Loaded 15940 existing records from primary storage. [2025-09-29T20:53:47.654638] [INFO ] [MAIN ] RNP: Loaded 15940 existing records. [2025-09-29T20:53:47.838514] [WARN ] [MAIN ] RNP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:53:47.838801] [INFO ] [MAIN ] RNP: Wiping existing primary data before full refresh. [2025-09-29T20:53:47.838871] [INFO ] [LOCAL ] RNP: Starting deletion of primary data. [2025-09-29T20:53:47.839138] [DEBUG] [LOCAL ] RNP: Deleted primary data file. [2025-09-29T20:53:47.839196] [INFO ] [MAIN ] RNP: Starting full primary refresh. [2025-09-29T20:53:48.215362] [INFO ] [REMOTE ] RNP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:53:48.348129] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2024-12. [2025-09-29T20:53:48.470334] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-29T20:53:48.733037] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-29T20:53:49.148115] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-01. [2025-09-29T20:53:49.592901] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-29T20:53:49.948154] [INFO ] [REMOTE ] RNP: Fetching primary data for 2024-12. [2025-09-29T20:53:50.748156] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-06. [2025-09-29T20:53:50.837807] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-29T20:53:51.283366] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-29T20:53:51.548155] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-02. [2025-09-29T20:53:51.785749] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-29T20:53:52.348099] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-07. [2025-09-29T20:53:53.149592] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-01. [2025-09-29T20:53:53.153766] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-29T20:53:53.541803] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-29T20:53:53.948138] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-03. [2025-09-29T20:53:54.315687] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-29T20:53:54.748152] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-08. [2025-09-29T20:53:55.548126] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-02. [2025-09-29T20:53:55.728467] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-29T20:53:55.766175] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-29T20:53:56.348088] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-04. [2025-09-29T20:53:56.653464] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-29T20:53:57.148121] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-03. [2025-09-29T20:53:57.948094] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-01. [2025-09-29T20:53:58.110170] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-29T20:53:58.190456] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-29T20:53:58.748120] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-04. [2025-09-29T20:53:58.786035] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-29T20:53:59.548089] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-02. [2025-09-29T20:53:59.910518] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-29T20:54:00.348161] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-05. [2025-09-29T20:54:00.688617] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-29T20:54:01.148146] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-09. [2025-09-29T20:54:01.948097] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-03. [2025-09-29T20:54:02.126058] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-29T20:54:02.129935] [INFO ] [REMOTE ] RMT: Full fetch complete (25472 records). [2025-09-29T20:54:02.130061] [DEBUG] [VALIDATOR ] RMT: Validating primary data. [2025-09-29T20:54:02.567970] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-29T20:54:02.607956] [DEBUG] [VALIDATOR ] RMT: All expected trading days are present. [2025-09-29T20:54:02.608593] [DEBUG] [VALIDATOR ] RMT: Primary data validation passed. [2025-09-29T20:54:02.609324] [INFO ] [MAIN ] RMT: Fetched primary data is valid. [2025-09-29T20:54:02.609432] [DEBUG] [LOCAL ] RMT: Saving primary data. [2025-09-29T20:54:02.610708] [DEBUG] [LOCAL ] RMT: Trimmed 25472 records to 17362 (keeping 200 days of data) [2025-09-29T20:54:02.721870] [DEBUG] [LOCAL ] RMT: Primary data saved (17362 records). [2025-09-29T20:54:02.722070] [INFO ] [MAIN ] RMT: Full history saved. [2025-09-29T20:54:02.722170] [INFO ] [MAIN ] Update Progress: 1822/2371 symbols completed. RMT took 36.6s. Estimated remaining: 1h 10m 30s. Rate: 7.8 symbols/min [2025-09-29T20:54:02.755920] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-05. [2025-09-29T20:54:02.916494] [INFO ] [MAIN ] RNR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:54:02.933585] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-29T20:54:02.975853] [DEBUG] [LOCAL ] RNR: Loaded 34623 existing records from primary storage. [2025-09-29T20:54:02.976216] [INFO ] [MAIN ] RNR: Loaded 34623 existing records. [2025-09-29T20:54:03.164144] [WARN ] [MAIN ] RNR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:54:03.164366] [INFO ] [MAIN ] RNR: Wiping existing primary data before full refresh. [2025-09-29T20:54:03.164414] [INFO ] [LOCAL ] RNR: Starting deletion of primary data. [2025-09-29T20:54:03.164951] [DEBUG] [LOCAL ] RNR: Deleted primary data file. [2025-09-29T20:54:03.165013] [INFO ] [MAIN ] RNR: Starting full primary refresh. [2025-09-29T20:54:03.540474] [INFO ] [REMOTE ] RNR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:54:03.548071] [INFO ] [REMOTE ] RNR: Fetching primary data for 2024-12. [2025-09-29T20:54:03.890981] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-29T20:54:04.348115] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-06. [2025-09-29T20:54:05.151381] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-04. [2025-09-29T20:54:05.158382] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-29T20:54:05.395759] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-29T20:54:05.948158] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-01. [2025-09-29T20:54:06.306255] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-29T20:54:06.748134] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-06. [2025-09-29T20:54:07.516449] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-29T20:54:07.548133] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-02. [2025-09-29T20:54:08.322388] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-29T20:54:08.348070] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-07. [2025-09-29T20:54:09.148088] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-05. [2025-09-29T20:54:09.237950] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-29T20:54:09.738374] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-29T20:54:09.948120] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-07. [2025-09-29T20:54:10.009288] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-29T20:54:10.748138] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-06. [2025-09-29T20:54:11.061587] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-29T20:54:11.548157] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-08. [2025-09-29T20:54:12.155538] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-29T20:54:12.348122] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-07. [2025-09-29T20:54:13.148113] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-03. [2025-09-29T20:54:13.325399] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-29T20:54:13.374498] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-29T20:54:13.948108] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-08. [2025-09-29T20:54:14.748141] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-08. [2025-09-29T20:54:15.003105] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-29T20:54:15.298086] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-29T20:54:15.548130] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-09. [2025-09-29T20:54:15.725981] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-29T20:54:16.348114] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-09. [2025-09-29T20:54:16.448590] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-29T20:54:16.456377] [INFO ] [REMOTE ] RNGR: Full fetch complete (28292 records). [2025-09-29T20:54:16.456208] [DEBUG] [REMOTE ] RNP: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-09-29T20:54:16.456864] [DEBUG] [VALIDATOR ] RNGR: Validating primary data. [2025-09-29T20:54:16.456976] [WARN ] [REMOTE ] RNP: No data returned for month 2025-09 [2025-09-29T20:54:16.462989] [FATAL] [REMOTE ] RNP: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T20:54:16.487058] [FATAL] [MAIN ] RNP: Failed to fetch primary data. [2025-09-29T20:54:16.495681] [WARN ] [MAIN ] RNP: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T20:54:16.522913] [INFO ] [LOCAL ] RNP: Starting deletion of primary data. [2025-09-29T20:54:16.539327] [DEBUG] [LOCAL ] RNP: No primary data file found to delete. [2025-09-29T20:54:16.549511] [INFO ] [LOCAL ] RNP: Starting deletion of derivative data. [2025-09-29T20:54:16.584922] [DEBUG] [LOCAL ] RNP: Deleted derivative data file. [2025-09-29T20:54:16.596108] [INFO ] [MAIN ] Update Progress: 1823/2371 symbols completed. RNP took 29.1s. Estimated remaining: 1h 10m 25s. Rate: 7.8 symbols/min [2025-09-29T20:54:16.936348] [INFO ] [MAIN ] RNST: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:54:17.143786] [DEBUG] [VALIDATOR ] RNGR: All expected trading days are present. [2025-09-29T20:54:17.143890] [DEBUG] [VALIDATOR ] RNGR: Primary data validation passed. [2025-09-29T20:54:17.144579] [INFO ] [MAIN ] RNGR: Fetched primary data is valid. [2025-09-29T20:54:17.144680] [DEBUG] [LOCAL ] RNGR: Saving primary data. [2025-09-29T20:54:17.145728] [DEBUG] [LOCAL ] RNGR: Trimmed 28292 records to 20343 (keeping 200 days of data) [2025-09-29T20:54:17.198394] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-09. [2025-09-29T20:54:17.252108] [DEBUG] [LOCAL ] RNST: Loaded 37619 existing records from primary storage. [2025-09-29T20:54:17.255449] [INFO ] [MAIN ] RNST: Loaded 37619 existing records. [2025-09-29T20:54:17.465457] [WARN ] [MAIN ] RNST: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:54:17.467747] [INFO ] [MAIN ] RNST: Wiping existing primary data before full refresh. [2025-09-29T20:54:17.468094] [INFO ] [LOCAL ] RNST: Starting deletion of primary data. [2025-09-29T20:54:17.470409] [DEBUG] [LOCAL ] RNST: Deleted primary data file. [2025-09-29T20:54:17.470812] [INFO ] [MAIN ] RNST: Starting full primary refresh. [2025-09-29T20:54:17.820550] [DEBUG] [LOCAL ] RNGR: Primary data saved (20343 records). [2025-09-29T20:54:17.840880] [INFO ] [MAIN ] RNGR: Full history saved. [2025-09-29T20:54:17.851776] [INFO ] [MAIN ] Update Progress: 1824/2371 symbols completed. RNGR took 32.4s. Estimated remaining: 1h 10m 15s. Rate: 7.8 symbols/min [2025-09-29T20:54:17.928702] [INFO ] [REMOTE ] RNST: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:54:17.949515] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-04. [2025-09-29T20:54:18.065020] [INFO ] [MAIN ] ROG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:54:18.087186] [DEBUG] [LOCAL ] ROG: Loaded 23367 existing records from primary storage. [2025-09-29T20:54:18.087448] [INFO ] [MAIN ] ROG: Loaded 23367 existing records. [2025-09-29T20:54:18.278437] [WARN ] [MAIN ] ROG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:54:18.278750] [INFO ] [MAIN ] ROG: Wiping existing primary data before full refresh. [2025-09-29T20:54:18.278814] [INFO ] [LOCAL ] ROG: Starting deletion of primary data. [2025-09-29T20:54:18.279063] [DEBUG] [LOCAL ] ROG: Deleted primary data file. [2025-09-29T20:54:18.279127] [INFO ] [MAIN ] ROG: Starting full primary refresh. [2025-09-29T20:54:18.668894] [INFO ] [REMOTE ] ROG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:54:18.748085] [INFO ] [REMOTE ] RNST: Fetching primary data for 2024-12. [2025-09-29T20:54:18.983403] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-29T20:54:18.997722] [INFO ] [REMOTE ] RNG: Full fetch complete (69452 records). [2025-09-29T20:54:18.997966] [DEBUG] [VALIDATOR ] RNG: Validating primary data. [2025-09-29T20:54:19.451057] [DEBUG] [VALIDATOR ] RNG: All expected trading days are present. [2025-09-29T20:54:19.451189] [DEBUG] [VALIDATOR ] RNG: Primary data validation passed. [2025-09-29T20:54:19.452500] [INFO ] [MAIN ] RNG: Fetched primary data is valid. [2025-09-29T20:54:19.452626] [DEBUG] [LOCAL ] RNG: Saving primary data. [2025-09-29T20:54:19.454182] [DEBUG] [LOCAL ] RNG: Trimmed 69452 records to 48025 (keeping 200 days of data) [2025-09-29T20:54:19.552233] [INFO ] [REMOTE ] ROG: Fetching primary data for 2024-12. [2025-09-29T20:54:19.726975] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-29T20:54:19.774912] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-29T20:54:19.834425] [DEBUG] [LOCAL ] RNG: Primary data saved (48025 records). [2025-09-29T20:54:19.834566] [INFO ] [MAIN ] RNG: Full history saved. [2025-09-29T20:54:19.834694] [INFO ] [MAIN ] Update Progress: 1825/2371 symbols completed. RNG took 35.6s. Estimated remaining: 1h 10m 6s. Rate: 7.8 symbols/min [2025-09-29T20:54:20.010253] [INFO ] [MAIN ] ROK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:54:20.054072] [DEBUG] [LOCAL ] ROK: Loaded 44522 existing records from primary storage. [2025-09-29T20:54:20.054398] [INFO ] [MAIN ] ROK: Loaded 44522 existing records. [2025-09-29T20:54:20.242816] [WARN ] [MAIN ] ROK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:54:20.243033] [INFO ] [MAIN ] ROK: Wiping existing primary data before full refresh. [2025-09-29T20:54:20.243080] [INFO ] [LOCAL ] ROK: Starting deletion of primary data. [2025-09-29T20:54:20.243504] [DEBUG] [LOCAL ] ROK: Deleted primary data file. [2025-09-29T20:54:20.243564] [INFO ] [MAIN ] ROK: Starting full primary refresh. [2025-09-29T20:54:20.353148] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-05. [2025-09-29T20:54:20.629408] [INFO ] [REMOTE ] ROK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:54:20.655026] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-29T20:54:21.148125] [INFO ] [REMOTE ] ROK: Fetching primary data for 2024-12. [2025-09-29T20:54:21.948096] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-01. [2025-09-29T20:54:21.980283] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-29T20:54:22.748100] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-06. [2025-09-29T20:54:22.912090] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-29T20:54:23.458182] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-29T20:54:23.548110] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-02. [2025-09-29T20:54:24.158707] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-29T20:54:24.348116] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-01. [2025-09-29T20:54:24.952299] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-29T20:54:25.148131] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-01. [2025-09-29T20:54:25.409543] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-29T20:54:25.948136] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-07. [2025-09-29T20:54:26.748108] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-02. [2025-09-29T20:54:26.864234] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-29T20:54:27.445713] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-29T20:54:27.548116] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-08. [2025-09-29T20:54:27.665952] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-29T20:54:28.348110] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-03. [2025-09-29T20:54:28.588709] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-29T20:54:29.148120] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-03. [2025-09-29T20:54:29.628843] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-29T20:54:29.948109] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-04. [2025-09-29T20:54:30.750537] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-09. [2025-09-29T20:54:30.755520] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-29T20:54:30.981453] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-29T20:54:31.548197] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-04. [2025-09-29T20:54:32.124067] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-29T20:54:32.130799] [INFO ] [REMOTE ] RNR: Full fetch complete (51097 records). [2025-09-29T20:54:32.130924] [DEBUG] [VALIDATOR ] RNR: Validating primary data. [2025-09-29T20:54:32.353226] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-02. [2025-09-29T20:54:32.544774] [DEBUG] [VALIDATOR ] RNR: All expected trading days are present. [2025-09-29T20:54:32.544873] [DEBUG] [VALIDATOR ] RNR: Primary data validation passed. [2025-09-29T20:54:32.545814] [INFO ] [MAIN ] RNR: Fetched primary data is valid. [2025-09-29T20:54:32.545882] [DEBUG] [LOCAL ] RNR: Saving primary data. [2025-09-29T20:54:32.547039] [DEBUG] [LOCAL ] RNR: Trimmed 51097 records to 33947 (keeping 200 days of data) [2025-09-29T20:54:32.774517] [DEBUG] [LOCAL ] RNR: Primary data saved (33947 records). [2025-09-29T20:54:32.774862] [INFO ] [MAIN ] RNR: Full history saved. [2025-09-29T20:54:32.777506] [INFO ] [MAIN ] Update Progress: 1826/2371 symbols completed. RNR took 30.1s. Estimated remaining: 1h 9m 59s. Rate: 7.8 symbols/min [2025-09-29T20:54:32.958080] [INFO ] [MAIN ] ROL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:54:33.010725] [DEBUG] [LOCAL ] ROL: Loaded 51031 existing records from primary storage. [2025-09-29T20:54:33.011097] [INFO ] [MAIN ] ROL: Loaded 51031 existing records. [2025-09-29T20:54:33.156049] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-05. [2025-09-29T20:54:33.244091] [WARN ] [MAIN ] ROL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:54:33.244955] [INFO ] [MAIN ] ROL: Wiping existing primary data before full refresh. [2025-09-29T20:54:33.245095] [INFO ] [LOCAL ] ROL: Starting deletion of primary data. [2025-09-29T20:54:33.246133] [DEBUG] [LOCAL ] ROL: Deleted primary data file. [2025-09-29T20:54:33.246347] [INFO ] [MAIN ] ROL: Starting full primary refresh. [2025-09-29T20:54:33.600955] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-29T20:54:33.710260] [INFO ] [REMOTE ] ROL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:54:33.781158] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-29T20:54:33.948161] [INFO ] [REMOTE ] ROL: Fetching primary data for 2024-12. [2025-09-29T20:54:34.472770] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-29T20:54:34.748158] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-05. [2025-09-29T20:54:35.548111] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-03. [2025-09-29T20:54:35.681427] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-29T20:54:36.316273] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-29T20:54:36.348090] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-06. [2025-09-29T20:54:37.148136] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-06. [2025-09-29T20:54:37.440381] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-29T20:54:37.772976] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-29T20:54:37.894512] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-29T20:54:37.948123] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-07. [2025-09-29T20:54:38.748156] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-04. [2025-09-29T20:54:39.236685] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-29T20:54:39.548191] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-07. [2025-09-29T20:54:40.348123] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-01. [2025-09-29T20:54:40.398015] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-29T20:54:41.148124] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-08. [2025-09-29T20:54:41.199440] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-29T20:54:41.948093] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-05. [2025-09-29T20:54:42.049203] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-29T20:54:42.075168] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-29T20:54:42.748155] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-02. [2025-09-29T20:54:43.548116] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-08. [2025-09-29T20:54:43.866874] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-29T20:54:44.348099] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-06. [2025-09-29T20:54:44.422226] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-29T20:54:45.063312] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-29T20:54:45.148141] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-09. [2025-09-29T20:54:45.914358] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-29T20:54:45.918515] [INFO ] [REMOTE ] ROG: Full fetch complete (30762 records). [2025-09-29T20:54:45.918610] [DEBUG] [VALIDATOR ] ROG: Validating primary data. [2025-09-29T20:54:45.953265] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-09. [2025-09-29T20:54:46.323562] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-29T20:54:46.346888] [DEBUG] [VALIDATOR ] ROG: All expected trading days are present. [2025-09-29T20:54:46.347355] [DEBUG] [VALIDATOR ] ROG: Primary data validation passed. [2025-09-29T20:54:46.348202] [INFO ] [MAIN ] ROG: Fetched primary data is valid. [2025-09-29T20:54:46.348273] [DEBUG] [LOCAL ] ROG: Saving primary data. [2025-09-29T20:54:46.349225] [DEBUG] [LOCAL ] ROG: Trimmed 30762 records to 23095 (keeping 200 days of data) [2025-09-29T20:54:46.499570] [DEBUG] [LOCAL ] ROG: Primary data saved (23095 records). [2025-09-29T20:54:46.499735] [INFO ] [MAIN ] ROG: Full history saved. [2025-09-29T20:54:46.499845] [INFO ] [MAIN ] Update Progress: 1827/2371 symbols completed. ROG took 28.6s. Estimated remaining: 1h 9m 53s. Rate: 7.8 symbols/min [2025-09-29T20:54:46.676773] [INFO ] [MAIN ] RPM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:54:46.724351] [DEBUG] [LOCAL ] RPM: Loaded 41763 existing records from primary storage. [2025-09-29T20:54:46.724716] [INFO ] [MAIN ] RPM: Loaded 41763 existing records. [2025-09-29T20:54:46.757752] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-07. [2025-09-29T20:54:46.924286] [WARN ] [MAIN ] RPM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:54:46.924517] [INFO ] [MAIN ] RPM: Wiping existing primary data before full refresh. [2025-09-29T20:54:46.924568] [INFO ] [LOCAL ] RPM: Starting deletion of primary data. [2025-09-29T20:54:46.924933] [DEBUG] [LOCAL ] RPM: Deleted primary data file. [2025-09-29T20:54:46.924996] [INFO ] [MAIN ] RPM: Starting full primary refresh. [2025-09-29T20:54:47.312076] [INFO ] [REMOTE ] RPM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:54:47.553196] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-03. [2025-09-29T20:54:47.565856] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-29T20:54:47.573412] [INFO ] [REMOTE ] RNST: Full fetch complete (53072 records). [2025-09-29T20:54:47.573522] [DEBUG] [VALIDATOR ] RNST: Validating primary data. [2025-09-29T20:54:47.969288] [DEBUG] [VALIDATOR ] RNST: All expected trading days are present. [2025-09-29T20:54:47.969414] [DEBUG] [VALIDATOR ] RNST: Primary data validation passed. [2025-09-29T20:54:47.970693] [INFO ] [MAIN ] RNST: Fetched primary data is valid. [2025-09-29T20:54:47.970770] [DEBUG] [LOCAL ] RNST: Saving primary data. [2025-09-29T20:54:47.972082] [DEBUG] [LOCAL ] RNST: Trimmed 53072 records to 37044 (keeping 200 days of data) [2025-09-29T20:54:48.246171] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-29T20:54:48.262364] [DEBUG] [LOCAL ] RNST: Primary data saved (37044 records). [2025-09-29T20:54:48.262536] [INFO ] [MAIN ] RNST: Full history saved. [2025-09-29T20:54:48.262699] [INFO ] [MAIN ] Update Progress: 1828/2371 symbols completed. RNST took 31.7s. Estimated remaining: 1h 9m 44s. Rate: 7.8 symbols/min [2025-09-29T20:54:48.356736] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-08. [2025-09-29T20:54:48.445029] [INFO ] [MAIN ] RPT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:54:48.465990] [DEBUG] [LOCAL ] RPT: Loaded 19767 existing records from primary storage. [2025-09-29T20:54:48.466283] [INFO ] [MAIN ] RPT: Loaded 19767 existing records. [2025-09-29T20:54:48.659254] [WARN ] [MAIN ] RPT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:54:48.659493] [INFO ] [MAIN ] RPT: Wiping existing primary data before full refresh. [2025-09-29T20:54:48.659544] [INFO ] [LOCAL ] RPT: Starting deletion of primary data. [2025-09-29T20:54:48.659860] [DEBUG] [LOCAL ] RPT: Deleted primary data file. [2025-09-29T20:54:48.659921] [INFO ] [MAIN ] RPT: Starting full primary refresh. [2025-09-29T20:54:49.113932] [INFO ] [REMOTE ] RPT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:54:49.148120] [INFO ] [REMOTE ] RPT: Fetching primary data for 2024-12. [2025-09-29T20:54:49.384888] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-29T20:54:49.948068] [INFO ] [REMOTE ] RPM: Fetching primary data for 2024-12. [2025-09-29T20:54:50.328312] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-29T20:54:50.419521] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-29T20:54:50.748172] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-01. [2025-09-29T20:54:51.548159] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-09. [2025-09-29T20:54:51.580860] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-29T20:54:51.842286] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-29T20:54:52.348100] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-02. [2025-09-29T20:54:53.148100] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-04. [2025-09-29T20:54:53.210721] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-29T20:54:53.219217] [INFO ] [REMOTE ] ROK: Full fetch complete (63285 records). [2025-09-29T20:54:53.219364] [DEBUG] [VALIDATOR ] ROK: Validating primary data. [2025-09-29T20:54:53.607703] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-29T20:54:53.660534] [DEBUG] [VALIDATOR ] ROK: All expected trading days are present. [2025-09-29T20:54:53.660638] [DEBUG] [VALIDATOR ] ROK: Primary data validation passed. [2025-09-29T20:54:53.662033] [INFO ] [MAIN ] ROK: Fetched primary data is valid. [2025-09-29T20:54:53.662106] [DEBUG] [LOCAL ] ROK: Saving primary data. [2025-09-29T20:54:53.663722] [DEBUG] [LOCAL ] ROK: Trimmed 63285 records to 43765 (keeping 200 days of data) [2025-09-29T20:54:53.950228] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-01. [2025-09-29T20:54:53.966000] [DEBUG] [LOCAL ] ROK: Primary data saved (43765 records). [2025-09-29T20:54:53.966159] [INFO ] [MAIN ] ROK: Full history saved. [2025-09-29T20:54:53.966300] [INFO ] [MAIN ] Update Progress: 1829/2371 symbols completed. ROK took 34.1s. Estimated remaining: 1h 9m 36s. Rate: 7.8 symbols/min [2025-09-29T20:54:54.144695] [INFO ] [MAIN ] RQI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:54:54.175759] [DEBUG] [LOCAL ] RQI: Loaded 29573 existing records from primary storage. [2025-09-29T20:54:54.176053] [INFO ] [MAIN ] RQI: Loaded 29573 existing records. [2025-09-29T20:54:54.363615] [WARN ] [MAIN ] RQI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:54:54.363856] [INFO ] [MAIN ] RQI: Wiping existing primary data before full refresh. [2025-09-29T20:54:54.363906] [INFO ] [LOCAL ] RQI: Starting deletion of primary data. [2025-09-29T20:54:54.364243] [DEBUG] [LOCAL ] RQI: Deleted primary data file. [2025-09-29T20:54:54.364304] [INFO ] [MAIN ] RQI: Starting full primary refresh. [2025-09-29T20:54:54.738122] [INFO ] [REMOTE ] RQI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:54:54.748066] [INFO ] [REMOTE ] RQI: Fetching primary data for 2024-12. [2025-09-29T20:54:54.958974] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-29T20:54:55.550582] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-05. [2025-09-29T20:54:55.553023] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-29T20:54:56.348146] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-03. [2025-09-29T20:54:56.395768] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-29T20:54:57.148082] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-01. [2025-09-29T20:54:57.448915] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-29T20:54:57.474582] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-29T20:54:57.948189] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-02. [2025-09-29T20:54:58.276561] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-29T20:54:58.748140] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-04. [2025-09-29T20:54:59.548083] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-02. [2025-09-29T20:54:59.627193] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-29T20:54:59.759361] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-29T20:55:00.348112] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-06. [2025-09-29T20:55:00.963620] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-29T20:55:01.148163] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-03. [2025-09-29T20:55:01.948165] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-03. [2025-09-29T20:55:02.196392] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-29T20:55:02.627934] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-29T20:55:02.748123] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-05. [2025-09-29T20:55:03.548120] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-07. [2025-09-29T20:55:03.620003] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-29T20:55:03.820741] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-29T20:55:04.348119] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-06. [2025-09-29T20:55:05.148087] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-04. [2025-09-29T20:55:05.546964] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-29T20:55:05.682403] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-29T20:55:05.948118] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-08. [2025-09-29T20:55:06.322555] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-29T20:55:06.748120] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-04. [2025-09-29T20:55:07.548128] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-05. [2025-09-29T20:55:07.754497] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-29T20:55:07.995802] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-29T20:55:08.348123] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-09. [2025-09-29T20:55:08.882317] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-29T20:55:09.148116] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-07. [2025-09-29T20:55:09.948128] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-05. [2025-09-29T20:55:10.100164] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-29T20:55:10.110989] [INFO ] [REMOTE ] ROL: Full fetch complete (72708 records). [2025-09-29T20:55:10.111140] [DEBUG] [VALIDATOR ] ROL: Validating primary data. [2025-09-29T20:55:10.250610] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-29T20:55:10.540911] [DEBUG] [VALIDATOR ] ROL: All expected trading days are present. [2025-09-29T20:55:10.540995] [DEBUG] [VALIDATOR ] ROL: Primary data validation passed. [2025-09-29T20:55:10.542238] [INFO ] [MAIN ] ROL: Fetched primary data is valid. [2025-09-29T20:55:10.542304] [DEBUG] [LOCAL ] ROL: Saving primary data. [2025-09-29T20:55:10.543819] [DEBUG] [LOCAL ] ROL: Trimmed 72708 records to 50261 (keeping 200 days of data) [2025-09-29T20:55:10.754521] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-06. [2025-09-29T20:55:10.890017] [DEBUG] [LOCAL ] ROL: Primary data saved (50261 records). [2025-09-29T20:55:10.890167] [INFO ] [MAIN ] ROL: Full history saved. [2025-09-29T20:55:10.890274] [INFO ] [MAIN ] Update Progress: 1830/2371 symbols completed. ROL took 38.1s. Estimated remaining: 1h 9m 31s. Rate: 7.8 symbols/min [2025-09-29T20:55:11.084140] [INFO ] [MAIN ] RRC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:55:11.145836] [DEBUG] [LOCAL ] RRC: Loaded 53554 existing records from primary storage. [2025-09-29T20:55:11.146204] [INFO ] [MAIN ] RRC: Loaded 53554 existing records. [2025-09-29T20:55:11.347723] [WARN ] [MAIN ] RRC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:55:11.348024] [INFO ] [MAIN ] RRC: Wiping existing primary data before full refresh. [2025-09-29T20:55:11.348073] [INFO ] [LOCAL ] RRC: Starting deletion of primary data. [2025-09-29T20:55:11.348415] [DEBUG] [LOCAL ] RRC: Deleted primary data file. [2025-09-29T20:55:11.348475] [INFO ] [MAIN ] RRC: Starting full primary refresh. [2025-09-29T20:55:11.549616] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-08. [2025-09-29T20:55:11.746921] [INFO ] [REMOTE ] RRC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:55:11.793918] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-29T20:55:11.795462] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-29T20:55:12.348131] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-06. [2025-09-29T20:55:12.727466] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-29T20:55:13.148152] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-07. [2025-09-29T20:55:13.948084] [INFO ] [REMOTE ] RRC: Fetching primary data for 2024-12. [2025-09-29T20:55:14.027824] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-29T20:55:14.544745] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-29T20:55:14.748146] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-09. [2025-09-29T20:55:15.548112] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-08. [2025-09-29T20:55:15.717720] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-29T20:55:15.752154] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-29T20:55:15.755922] [INFO ] [REMOTE ] RPT: Full fetch complete (28539 records). [2025-09-29T20:55:15.756012] [DEBUG] [VALIDATOR ] RPT: Validating primary data. [2025-09-29T20:55:16.148357] [DEBUG] [VALIDATOR ] RPT: All expected trading days are present. [2025-09-29T20:55:16.148439] [DEBUG] [VALIDATOR ] RPT: Primary data validation passed. [2025-09-29T20:55:16.149045] [INFO ] [MAIN ] RPT: Fetched primary data is valid. [2025-09-29T20:55:16.149107] [DEBUG] [LOCAL ] RPT: Saving primary data. [2025-09-29T20:55:16.149842] [DEBUG] [LOCAL ] RPT: Trimmed 28539 records to 19317 (keeping 200 days of data) [2025-09-29T20:55:16.261008] [DEBUG] [LOCAL ] RPT: Primary data saved (19317 records). [2025-09-29T20:55:16.261165] [INFO ] [MAIN ] RPT: Full history saved. [2025-09-29T20:55:16.261254] [INFO ] [MAIN ] Update Progress: 1831/2371 symbols completed. RPT took 28.0s. Estimated remaining: 1h 9m 22s. Rate: 7.8 symbols/min [2025-09-29T20:55:16.354481] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-07. [2025-09-29T20:55:16.442772] [INFO ] [MAIN ] RRX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:55:16.493376] [DEBUG] [LOCAL ] RRX: Loaded 41752 existing records from primary storage. [2025-09-29T20:55:16.493972] [INFO ] [MAIN ] RRX: Loaded 41752 existing records. [2025-09-29T20:55:16.700967] [WARN ] [MAIN ] RRX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:55:16.701427] [INFO ] [MAIN ] RRX: Wiping existing primary data before full refresh. [2025-09-29T20:55:16.701559] [INFO ] [LOCAL ] RRX: Starting deletion of primary data. [2025-09-29T20:55:16.702116] [DEBUG] [LOCAL ] RRX: Deleted primary data file. [2025-09-29T20:55:16.702180] [INFO ] [MAIN ] RRX: Starting full primary refresh. [2025-09-29T20:55:17.051820] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-29T20:55:17.114959] [INFO ] [REMOTE ] RRX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:55:17.148103] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-09. [2025-09-29T20:55:17.948113] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-01. [2025-09-29T20:55:17.984205] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-29T20:55:18.161781] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-29T20:55:18.169073] [INFO ] [REMOTE ] RQI: Full fetch complete (43398 records). [2025-09-29T20:55:18.169183] [DEBUG] [VALIDATOR ] RQI: Validating primary data. [2025-09-29T20:55:18.567247] [DEBUG] [VALIDATOR ] RQI: All expected trading days are present. [2025-09-29T20:55:18.567350] [DEBUG] [VALIDATOR ] RQI: Primary data validation passed. [2025-09-29T20:55:18.568208] [INFO ] [MAIN ] RQI: Fetched primary data is valid. [2025-09-29T20:55:18.568272] [DEBUG] [LOCAL ] RQI: Saving primary data. [2025-09-29T20:55:18.569357] [DEBUG] [LOCAL ] RQI: Trimmed 43398 records to 29133 (keeping 200 days of data) [2025-09-29T20:55:18.748885] [INFO ] [REMOTE ] RRX: Fetching primary data for 2024-12. [2025-09-29T20:55:18.753803] [DEBUG] [LOCAL ] RQI: Primary data saved (29133 records). [2025-09-29T20:55:18.754092] [INFO ] [MAIN ] RQI: Full history saved. [2025-09-29T20:55:18.755213] [INFO ] [MAIN ] Update Progress: 1832/2371 symbols completed. RQI took 24.8s. Estimated remaining: 1h 9m 13s. Rate: 7.8 symbols/min [2025-09-29T20:55:18.936678] [INFO ] [MAIN ] RS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:55:18.964689] [DEBUG] [LOCAL ] RS: Loaded 25864 existing records from primary storage. [2025-09-29T20:55:18.964976] [INFO ] [MAIN ] RS: Loaded 25864 existing records. [2025-09-29T20:55:19.163488] [WARN ] [MAIN ] RS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:55:19.163895] [INFO ] [MAIN ] RS: Wiping existing primary data before full refresh. [2025-09-29T20:55:19.163957] [INFO ] [LOCAL ] RS: Starting deletion of primary data. [2025-09-29T20:55:19.164241] [DEBUG] [LOCAL ] RS: Deleted primary data file. [2025-09-29T20:55:19.164304] [INFO ] [MAIN ] RS: Starting full primary refresh. [2025-09-29T20:55:19.541831] [INFO ] [REMOTE ] RS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:55:19.548066] [INFO ] [REMOTE ] RS: Fetching primary data for 2024-12. [2025-09-29T20:55:19.892746] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-29T20:55:20.341969] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-29T20:55:20.349078] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-02. [2025-09-29T20:55:21.054226] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-29T20:55:21.148116] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-08. [2025-09-29T20:55:21.948090] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-01. [2025-09-29T20:55:22.140751] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-29T20:55:22.748105] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-01. [2025-09-29T20:55:23.047265] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-29T20:55:23.517842] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-29T20:55:23.548172] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-03. [2025-09-29T20:55:24.215937] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-29T20:55:24.348121] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-09. [2025-09-29T20:55:25.148100] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-02. [2025-09-29T20:55:25.407439] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-29T20:55:25.948308] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-04. [2025-09-29T20:55:25.951527] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-29T20:55:25.964695] [INFO ] [REMOTE ] RPM: Full fetch complete (59004 records). [2025-09-29T20:55:25.964903] [DEBUG] [VALIDATOR ] RPM: Validating primary data. [2025-09-29T20:55:26.409034] [DEBUG] [VALIDATOR ] RPM: All expected trading days are present. [2025-09-29T20:55:26.409284] [DEBUG] [VALIDATOR ] RPM: Primary data validation passed. [2025-09-29T20:55:26.410470] [INFO ] [MAIN ] RPM: Fetched primary data is valid. [2025-09-29T20:55:26.410551] [DEBUG] [LOCAL ] RPM: Saving primary data. [2025-09-29T20:55:26.412067] [DEBUG] [LOCAL ] RPM: Trimmed 59004 records to 41277 (keeping 200 days of data) [2025-09-29T20:55:26.699105] [DEBUG] [LOCAL ] RPM: Primary data saved (41277 records). [2025-09-29T20:55:26.699263] [INFO ] [MAIN ] RPM: Full history saved. [2025-09-29T20:55:26.699362] [INFO ] [MAIN ] Update Progress: 1833/2371 symbols completed. RPM took 40.2s. Estimated remaining: 1h 9m 5s. Rate: 7.8 symbols/min [2025-09-29T20:55:26.758197] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-02. [2025-09-29T20:55:26.829661] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-29T20:55:26.917509] [INFO ] [MAIN ] RSF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:55:26.926029] [DEBUG] [LOCAL ] RSF: Loaded 4192 existing records from primary storage. [2025-09-29T20:55:26.926234] [INFO ] [MAIN ] RSF: Loaded 4192 existing records. [2025-09-29T20:55:27.119040] [WARN ] [MAIN ] RSF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:55:27.119287] [INFO ] [MAIN ] RSF: Wiping existing primary data before full refresh. [2025-09-29T20:55:27.119339] [INFO ] [LOCAL ] RSF: Starting deletion of primary data. [2025-09-29T20:55:27.119716] [DEBUG] [LOCAL ] RSF: Deleted primary data file. [2025-09-29T20:55:27.119794] [INFO ] [MAIN ] RSF: Starting full primary refresh. [2025-09-29T20:55:27.500050] [INFO ] [REMOTE ] RSF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:55:27.548101] [INFO ] [REMOTE ] RSF: Fetching primary data for 2024-12. [2025-09-29T20:55:27.880251] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-29T20:55:28.341291] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-29T20:55:28.348069] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-03. [2025-09-29T20:55:28.378467] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-29T20:55:29.148106] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-01. [2025-09-29T20:55:29.548568] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-29T20:55:29.652506] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-29T20:55:29.948117] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-03. [2025-09-29T20:55:30.748147] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-05. [2025-09-29T20:55:31.548157] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-02. [2025-09-29T20:55:31.638249] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-29T20:55:32.121341] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-29T20:55:32.348092] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-03. [2025-09-29T20:55:32.684959] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-29T20:55:32.709721] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-29T20:55:33.148127] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-04. [2025-09-29T20:55:33.948165] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-04. [2025-09-29T20:55:34.425882] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-29T20:55:34.748188] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-06. [2025-09-29T20:55:35.479729] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-29T20:55:35.548165] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-05. [2025-09-29T20:55:36.348114] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-04. [2025-09-29T20:55:36.835997] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-29T20:55:36.875092] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-29T20:55:37.001791] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-29T20:55:37.148147] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-05. [2025-09-29T20:55:37.670590] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-29T20:55:37.948120] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-06. [2025-09-29T20:55:38.748171] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-06. [2025-09-29T20:55:39.268967] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-29T20:55:39.284129] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-29T20:55:39.548172] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-07. [2025-09-29T20:55:40.348200] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-05. [2025-09-29T20:55:41.148162] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-07. [2025-09-29T20:55:41.584922] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-29T20:55:41.641928] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-29T20:55:41.948160] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-06. [2025-09-29T20:55:42.564689] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-29T20:55:42.748139] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-08. [2025-09-29T20:55:43.441211] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-29T20:55:43.548144] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-07. [2025-09-29T20:55:44.029415] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-29T20:55:44.326066] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-29T20:55:44.348072] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-08. [2025-09-29T20:55:45.030704] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-29T20:55:45.148157] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-09. [2025-09-29T20:55:45.704889] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-29T20:55:45.706305] [INFO ] [REMOTE ] RSF: Full fetch complete (5596 records). [2025-09-29T20:55:45.706392] [DEBUG] [VALIDATOR ] RSF: Validating primary data. [2025-09-29T20:55:45.950976] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-07. [2025-09-29T20:55:46.092077] [DEBUG] [VALIDATOR ] RSF: All expected trading days are present. [2025-09-29T20:55:46.092160] [DEBUG] [VALIDATOR ] RSF: Primary data validation passed. [2025-09-29T20:55:46.092345] [INFO ] [MAIN ] RSF: Fetched primary data is valid. [2025-09-29T20:55:46.092417] [DEBUG] [LOCAL ] RSF: Saving primary data. [2025-09-29T20:55:46.092906] [DEBUG] [LOCAL ] RSF: Trimmed 5596 records to 4180 (keeping 200 days of data) [2025-09-29T20:55:46.119974] [DEBUG] [LOCAL ] RSF: Primary data saved (4180 records). [2025-09-29T20:55:46.120098] [INFO ] [MAIN ] RSF: Full history saved. [2025-09-29T20:55:46.120211] [INFO ] [MAIN ] Update Progress: 1834/2371 symbols completed. RSF took 19.4s. Estimated remaining: 1h 9m 1s. Rate: 7.8 symbols/min [2025-09-29T20:55:46.307945] [INFO ] [MAIN ] RSG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:55:46.354764] [DEBUG] [LOCAL ] RSG: Loaded 48173 existing records from primary storage. [2025-09-29T20:55:46.355141] [INFO ] [MAIN ] RSG: Loaded 48173 existing records. [2025-09-29T20:55:46.539276] [WARN ] [MAIN ] RSG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:55:46.539513] [INFO ] [MAIN ] RSG: Wiping existing primary data before full refresh. [2025-09-29T20:55:46.539563] [INFO ] [LOCAL ] RSG: Starting deletion of primary data. [2025-09-29T20:55:46.540142] [DEBUG] [LOCAL ] RSG: Deleted primary data file. [2025-09-29T20:55:46.540202] [INFO ] [MAIN ] RSG: Starting full primary refresh. [2025-09-29T20:55:46.756271] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-09. [2025-09-29T20:55:46.951806] [INFO ] [REMOTE ] RSG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:55:47.548125] [INFO ] [REMOTE ] RSG: Fetching primary data for 2024-12. [2025-09-29T20:55:47.716208] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-29T20:55:48.030385] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-29T20:55:48.036390] [INFO ] [REMOTE ] RS: Full fetch complete (39522 records). [2025-09-29T20:55:48.036516] [DEBUG] [VALIDATOR ] RS: Validating primary data. [2025-09-29T20:55:48.353260] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-08. [2025-09-29T20:55:48.440807] [DEBUG] [VALIDATOR ] RS: All expected trading days are present. [2025-09-29T20:55:48.440894] [DEBUG] [VALIDATOR ] RS: Primary data validation passed. [2025-09-29T20:55:48.441800] [INFO ] [MAIN ] RS: Fetched primary data is valid. [2025-09-29T20:55:48.441868] [DEBUG] [LOCAL ] RS: Saving primary data. [2025-09-29T20:55:48.442863] [DEBUG] [LOCAL ] RS: Trimmed 39522 records to 25466 (keeping 200 days of data) [2025-09-29T20:55:48.606492] [DEBUG] [LOCAL ] RS: Primary data saved (25466 records). [2025-09-29T20:55:48.606631] [INFO ] [MAIN ] RS: Full history saved. [2025-09-29T20:55:48.606770] [INFO ] [MAIN ] Update Progress: 1835/2371 symbols completed. RS took 29.9s. Estimated remaining: 1h 8m 52s. Rate: 7.8 symbols/min [2025-09-29T20:55:48.791240] [INFO ] [MAIN ] RSI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:55:48.839413] [DEBUG] [LOCAL ] RSI: Loaded 47695 existing records from primary storage. [2025-09-29T20:55:48.839776] [INFO ] [MAIN ] RSI: Loaded 47695 existing records. [2025-09-29T20:55:49.045542] [WARN ] [MAIN ] RSI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:55:49.045820] [INFO ] [MAIN ] RSI: Wiping existing primary data before full refresh. [2025-09-29T20:55:49.045885] [INFO ] [LOCAL ] RSI: Starting deletion of primary data. [2025-09-29T20:55:49.046153] [DEBUG] [LOCAL ] RSI: Deleted primary data file. [2025-09-29T20:55:49.046217] [INFO ] [MAIN ] RSI: Starting full primary refresh. [2025-09-29T20:55:49.148598] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-08. [2025-09-29T20:55:49.431047] [INFO ] [REMOTE ] RSI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:55:49.456847] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-29T20:55:49.954872] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-01. [2025-09-29T20:55:49.961208] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-29T20:55:50.748168] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-09. [2025-09-29T20:55:50.874678] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-29T20:55:51.315786] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-29T20:55:51.548125] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-02. [2025-09-29T20:55:52.348169] [INFO ] [REMOTE ] RSI: Fetching primary data for 2024-12. [2025-09-29T20:55:52.677219] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-29T20:55:52.688721] [INFO ] [REMOTE ] RRC: Full fetch complete (76329 records). [2025-09-29T20:55:52.688875] [DEBUG] [VALIDATOR ] RRC: Validating primary data. [2025-09-29T20:55:53.112444] [DEBUG] [VALIDATOR ] RRC: All expected trading days are present. [2025-09-29T20:55:53.112545] [DEBUG] [VALIDATOR ] RRC: Primary data validation passed. [2025-09-29T20:55:53.113734] [INFO ] [MAIN ] RRC: Fetched primary data is valid. [2025-09-29T20:55:53.113849] [DEBUG] [LOCAL ] RRC: Saving primary data. [2025-09-29T20:55:53.115369] [DEBUG] [LOCAL ] RRC: Trimmed 76329 records to 52775 (keeping 200 days of data) [2025-09-29T20:55:53.169751] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-09. [2025-09-29T20:55:53.368692] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-29T20:55:53.499202] [DEBUG] [LOCAL ] RRC: Primary data saved (52775 records). [2025-09-29T20:55:53.499367] [INFO ] [MAIN ] RRC: Full history saved. [2025-09-29T20:55:53.499505] [INFO ] [MAIN ] Update Progress: 1836/2371 symbols completed. RRC took 42.6s. Estimated remaining: 1h 8m 43s. Rate: 7.8 symbols/min [2025-09-29T20:55:53.684827] [INFO ] [MAIN ] RSKD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:55:53.722293] [DEBUG] [LOCAL ] RSKD: Loaded 34254 existing records from primary storage. [2025-09-29T20:55:53.722621] [INFO ] [MAIN ] RSKD: Loaded 34254 existing records. [2025-09-29T20:55:53.932612] [WARN ] [MAIN ] RSKD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:55:53.932973] [INFO ] [MAIN ] RSKD: Wiping existing primary data before full refresh. [2025-09-29T20:55:53.933055] [INFO ] [LOCAL ] RSKD: Starting deletion of primary data. [2025-09-29T20:55:53.933354] [DEBUG] [LOCAL ] RSKD: Deleted primary data file. [2025-09-29T20:55:53.933414] [INFO ] [MAIN ] RSKD: Starting full primary refresh. [2025-09-29T20:55:53.967013] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-03. [2025-09-29T20:55:54.319760] [INFO ] [REMOTE ] RSKD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:55:54.349215] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-29T20:55:54.748156] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-01. [2025-09-29T20:55:54.813126] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-29T20:55:54.826600] [INFO ] [REMOTE ] RRX: Full fetch complete (58094 records). [2025-09-29T20:55:54.826800] [DEBUG] [VALIDATOR ] RRX: Validating primary data. [2025-09-29T20:55:55.255001] [DEBUG] [VALIDATOR ] RRX: All expected trading days are present. [2025-09-29T20:55:55.255092] [DEBUG] [VALIDATOR ] RRX: Primary data validation passed. [2025-09-29T20:55:55.256269] [INFO ] [MAIN ] RRX: Fetched primary data is valid. [2025-09-29T20:55:55.256355] [DEBUG] [LOCAL ] RRX: Saving primary data. [2025-09-29T20:55:55.257713] [DEBUG] [LOCAL ] RRX: Trimmed 58094 records to 41073 (keeping 200 days of data) [2025-09-29T20:55:55.531279] [DEBUG] [LOCAL ] RRX: Primary data saved (41073 records). [2025-09-29T20:55:55.531421] [INFO ] [MAIN ] RRX: Full history saved. [2025-09-29T20:55:55.531512] [INFO ] [MAIN ] Update Progress: 1837/2371 symbols completed. RRX took 39.3s. Estimated remaining: 1h 8m 34s. Rate: 7.8 symbols/min [2025-09-29T20:55:55.548184] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2024-12. [2025-09-29T20:55:55.845463] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-29T20:55:56.348141] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-04. [2025-09-29T20:55:56.576856] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-29T20:55:56.633274] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-29T20:55:57.148130] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-02. [2025-09-29T20:55:57.948158] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-01. [2025-09-29T20:55:58.355628] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-29T20:55:58.748083] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-05. [2025-09-29T20:55:58.871204] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-29T20:55:59.322518] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-29T20:55:59.548125] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-02. [2025-09-29T20:56:00.348176] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-03. [2025-09-29T20:56:00.589291] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-29T20:56:00.650410] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-29T20:56:01.148136] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-03. [2025-09-29T20:56:01.900710] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-29T20:56:01.948132] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-04. [2025-09-29T20:56:02.383679] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-29T20:56:02.748103] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-04. [2025-09-29T20:56:03.548171] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-06. [2025-09-29T20:56:03.697558] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-29T20:56:04.174299] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-29T20:56:04.348119] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-05. [2025-09-29T20:56:05.153221] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-05. [2025-09-29T20:56:05.173950] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-29T20:56:05.948132] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-07. [2025-09-29T20:56:06.147542] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-29T20:56:06.480010] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-29T20:56:06.748108] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-06. [2025-09-29T20:56:07.548156] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-06. [2025-09-29T20:56:08.072351] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-29T20:56:08.253395] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-29T20:56:08.348125] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-08. [2025-09-29T20:56:09.148090] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-07. [2025-09-29T20:56:09.258374] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-29T20:56:09.948169] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-07. [2025-09-29T20:56:10.088535] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-29T20:56:10.147865] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-29T20:56:10.748128] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-08. [2025-09-29T20:56:11.548133] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-09. [2025-09-29T20:56:11.772854] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-29T20:56:11.853381] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-29T20:56:12.348079] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-09. [2025-09-29T20:56:13.148125] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-08. [2025-09-29T20:56:13.329975] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-29T20:56:13.340395] [INFO ] [REMOTE ] RSG: Full fetch complete (67911 records). [2025-09-29T20:56:13.340560] [DEBUG] [VALIDATOR ] RSG: Validating primary data. [2025-09-29T20:56:13.701228] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-29T20:56:13.752788] [INFO ] [REMOTE ] RSKD: Full fetch complete (48190 records). [2025-09-29T20:56:13.763914] [DEBUG] [VALIDATOR ] RSKD: Validating primary data. [2025-09-29T20:56:13.899753] [DEBUG] [VALIDATOR ] RSG: All expected trading days are present. [2025-09-29T20:56:13.911065] [DEBUG] [VALIDATOR ] RSG: Primary data validation passed. [2025-09-29T20:56:13.912622] [INFO ] [MAIN ] RSG: Fetched primary data is valid. [2025-09-29T20:56:13.918164] [DEBUG] [LOCAL ] RSG: Saving primary data. [2025-09-29T20:56:13.991011] [DEBUG] [LOCAL ] RSG: Trimmed 67911 records to 47404 (keeping 200 days of data) [2025-09-29T20:56:14.344864] [DEBUG] [VALIDATOR ] RSKD: All expected trading days are present. [2025-09-29T20:56:14.345839] [DEBUG] [VALIDATOR ] RSKD: Primary data validation passed. [2025-09-29T20:56:14.348098] [INFO ] [MAIN ] RSKD: Fetched primary data is valid. [2025-09-29T20:56:14.349406] [DEBUG] [LOCAL ] RSKD: Saving primary data. [2025-09-29T20:56:14.356740] [DEBUG] [LOCAL ] RSKD: Trimmed 48190 records to 33624 (keeping 200 days of data) [2025-09-29T20:56:14.690610] [DEBUG] [LOCAL ] RSKD: Primary data saved (33624 records). [2025-09-29T20:56:14.691675] [INFO ] [MAIN ] RSKD: Full history saved. [2025-09-29T20:56:14.692063] [INFO ] [MAIN ] Update Progress: 1838/2371 symbols completed. RSKD took 21.2s. Estimated remaining: 1h 8m 30s. Rate: 7.8 symbols/min [2025-09-29T20:56:14.747410] [DEBUG] [LOCAL ] RSG: Primary data saved (47404 records). [2025-09-29T20:56:14.747565] [INFO ] [MAIN ] RSG: Full history saved. [2025-09-29T20:56:14.747684] [INFO ] [MAIN ] Update Progress: 1839/2371 symbols completed. RSG took 28.6s. Estimated remaining: 1h 8m 20s. Rate: 7.8 symbols/min [2025-09-29T20:56:15.012568] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-29T20:56:15.023909] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-09. [2025-09-29T20:56:16.705379] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-29T20:56:16.715271] [INFO ] [REMOTE ] RSI: Full fetch complete (69350 records). [2025-09-29T20:56:16.715415] [DEBUG] [VALIDATOR ] RSI: Validating primary data. [2025-09-29T20:56:17.144906] [DEBUG] [VALIDATOR ] RSI: All expected trading days are present. [2025-09-29T20:56:17.145022] [DEBUG] [VALIDATOR ] RSI: Primary data validation passed. [2025-09-29T20:56:17.146261] [INFO ] [MAIN ] RSI: Fetched primary data is valid. [2025-09-29T20:56:17.146330] [DEBUG] [LOCAL ] RSI: Saving primary data. [2025-09-29T20:56:17.147902] [DEBUG] [LOCAL ] RSI: Trimmed 69350 records to 46865 (keeping 200 days of data) [2025-09-29T20:56:17.439240] [DEBUG] [LOCAL ] RSI: Primary data saved (46865 records). [2025-09-29T20:56:17.439446] [INFO ] [MAIN ] RSI: Full history saved. [2025-09-29T20:56:17.439541] [INFO ] [MAIN ] Update Progress: 1840/2371 symbols completed. RSI took 28.8s. Estimated remaining: 1h 8m 11s. Rate: 7.8 symbols/min [2025-09-29T20:56:18.171574] [INFO ] [MAIN ] RTX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:56:18.167733] [INFO ] [MAIN ] RVT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:56:18.255513] [INFO ] [MAIN ] RVLV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:56:18.276608] [INFO ] [MAIN ] RTO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:56:18.319111] [DEBUG] [LOCAL ] RVT: Loaded 27362 existing records from primary storage. [2025-09-29T20:56:18.319575] [INFO ] [MAIN ] RVT: Loaded 27362 existing records. [2025-09-29T20:56:18.402494] [DEBUG] [LOCAL ] RTO: Loaded 40847 existing records from primary storage. [2025-09-29T20:56:18.439297] [INFO ] [MAIN ] RTO: Loaded 40847 existing records. [2025-09-29T20:56:18.556582] [DEBUG] [LOCAL ] RVLV: Loaded 48453 existing records from primary storage. [2025-09-29T20:56:18.619910] [INFO ] [MAIN ] RVLV: Loaded 48453 existing records. [2025-09-29T20:56:18.661873] [DEBUG] [LOCAL ] RTX: Loaded 54488 existing records from primary storage. [2025-09-29T20:56:18.670530] [INFO ] [MAIN ] RTX: Loaded 54488 existing records. [2025-09-29T20:56:18.687909] [WARN ] [MAIN ] RVT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:56:18.750737] [INFO ] [MAIN ] RVT: Wiping existing primary data before full refresh. [2025-09-29T20:56:18.771162] [INFO ] [LOCAL ] RVT: Starting deletion of primary data. [2025-09-29T20:56:18.884734] [DEBUG] [LOCAL ] RVT: Deleted primary data file. [2025-09-29T20:56:18.966219] [INFO ] [MAIN ] RVT: Starting full primary refresh. [2025-09-29T20:56:19.212723] [WARN ] [MAIN ] RTO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:56:19.255512] [INFO ] [MAIN ] RTO: Wiping existing primary data before full refresh. [2025-09-29T20:56:19.262826] [INFO ] [LOCAL ] RTO: Starting deletion of primary data. [2025-09-29T20:56:19.303949] [WARN ] [MAIN ] RTX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:56:19.335217] [DEBUG] [LOCAL ] RTO: Deleted primary data file. [2025-09-29T20:56:19.366030] [WARN ] [MAIN ] RVLV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:56:19.370254] [INFO ] [MAIN ] RTX: Wiping existing primary data before full refresh. [2025-09-29T20:56:19.370442] [INFO ] [LOCAL ] RTX: Starting deletion of primary data. [2025-09-29T20:56:19.360058] [INFO ] [MAIN ] RTO: Starting full primary refresh. [2025-09-29T20:56:19.376128] [INFO ] [MAIN ] RVLV: Wiping existing primary data before full refresh. [2025-09-29T20:56:19.376330] [INFO ] [LOCAL ] RVLV: Starting deletion of primary data. [2025-09-29T20:56:19.411883] [DEBUG] [LOCAL ] RVLV: Deleted primary data file. [2025-09-29T20:56:19.400554] [DEBUG] [LOCAL ] RTX: Deleted primary data file. [2025-09-29T20:56:19.451386] [INFO ] [MAIN ] RVLV: Starting full primary refresh. [2025-09-29T20:56:19.571610] [INFO ] [MAIN ] RTX: Starting full primary refresh. [2025-09-29T20:56:20.456957] [INFO ] [REMOTE ] RVT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:56:20.462565] [INFO ] [REMOTE ] RVT: Fetching primary data for 2024-12. [2025-09-29T20:56:20.764467] [INFO ] [REMOTE ] RVLV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:56:20.806293] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2024-12. [2025-09-29T20:56:20.847723] [INFO ] [REMOTE ] RTO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:56:20.891718] [INFO ] [REMOTE ] RTO: Fetching primary data for 2024-12. [2025-09-29T20:56:20.927506] [INFO ] [REMOTE ] RTX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:56:20.928825] [INFO ] [REMOTE ] RTX: Fetching primary data for 2024-12. [2025-09-29T20:56:21.996070] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-29T20:56:22.006168] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-01. [2025-09-29T20:56:22.576820] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-29T20:56:22.586419] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-01. [2025-09-29T20:56:22.674564] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-29T20:56:22.684805] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-01. [2025-09-29T20:56:23.092611] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-29T20:56:23.107202] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-01. [2025-09-29T20:56:23.268794] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-29T20:56:23.277673] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-02. [2025-09-29T20:56:24.112940] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-29T20:56:24.129076] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-02. [2025-09-29T20:56:24.303232] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-29T20:56:24.318036] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-02. [2025-09-29T20:56:24.468500] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-29T20:56:24.474834] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-03. [2025-09-29T20:56:25.163353] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-29T20:56:25.180860] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-02. [2025-09-29T20:56:25.779942] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-29T20:56:25.789990] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-03. [2025-09-29T20:56:25.857164] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-29T20:56:25.924004] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-29T20:56:25.948077] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-04. [2025-09-29T20:56:26.748204] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-03. [2025-09-29T20:56:26.990605] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-29T20:56:27.141621] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-29T20:56:27.511549] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-29T20:56:27.548065] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-04. [2025-09-29T20:56:28.348085] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-03. [2025-09-29T20:56:28.464691] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-29T20:56:29.148095] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-04. [2025-09-29T20:56:29.255744] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-29T20:56:29.948116] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-05. [2025-09-29T20:56:30.245432] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-29T20:56:30.748123] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-05. [2025-09-29T20:56:30.858315] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-29T20:56:31.203956] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-29T20:56:31.548175] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-05. [2025-09-29T20:56:32.348126] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-04. [2025-09-29T20:56:32.576067] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-29T20:56:33.042331] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-29T20:56:33.148103] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-06. [2025-09-29T20:56:33.948142] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-06. [2025-09-29T20:56:34.622525] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-29T20:56:34.657261] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-29T20:56:34.748196] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-07. [2025-09-29T20:56:35.548087] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-05. [2025-09-29T20:56:35.626408] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-29T20:56:36.249233] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-29T20:56:36.348115] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-07. [2025-09-29T20:56:37.148172] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-06. [2025-09-29T20:56:37.668059] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-29T20:56:37.948112] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-08. [2025-09-29T20:56:38.037589] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-29T20:56:38.063285] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-29T20:56:38.748178] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-07. [2025-09-29T20:56:39.496046] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-29T20:56:39.548141] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-08. [2025-09-29T20:56:39.858460] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-29T20:56:40.348153] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-06. [2025-09-29T20:56:41.148131] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-08. [2025-09-29T20:56:41.226267] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-29T20:56:41.948126] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-09. [2025-09-29T20:56:42.449623] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-29T20:56:42.650955] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-09-29T20:56:42.748158] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-09. [2025-09-29T20:56:43.548140] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-09. [2025-09-29T20:56:43.730623] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-29T20:56:43.741329] [INFO ] [REMOTE ] RVLV: Full fetch complete (68695 records). [2025-09-29T20:56:43.741548] [DEBUG] [VALIDATOR ] RVLV: Validating primary data. [2025-09-29T20:56:44.184894] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-29T20:56:44.208602] [DEBUG] [VALIDATOR ] RVLV: All expected trading days are present. [2025-09-29T20:56:44.208737] [DEBUG] [VALIDATOR ] RVLV: Primary data validation passed. [2025-09-29T20:56:44.209986] [INFO ] [MAIN ] RVLV: Fetched primary data is valid. [2025-09-29T20:56:44.210075] [DEBUG] [LOCAL ] RVLV: Saving primary data. [2025-09-29T20:56:44.210380] [INFO ] [REMOTE ] RVT: Full fetch complete (39890 records). [2025-09-29T20:56:44.210873] [DEBUG] [VALIDATOR ] RVT: Validating primary data. [2025-09-29T20:56:44.258238] [DEBUG] [LOCAL ] RVLV: Trimmed 68695 records to 47658 (keeping 200 days of data) [2025-09-29T20:56:44.370580] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-07. [2025-09-29T20:56:44.753274] [DEBUG] [VALIDATOR ] RVT: All expected trading days are present. [2025-09-29T20:56:44.753381] [DEBUG] [VALIDATOR ] RVT: Primary data validation passed. [2025-09-29T20:56:44.759984] [INFO ] [MAIN ] RVT: Fetched primary data is valid. [2025-09-29T20:56:44.760076] [DEBUG] [LOCAL ] RVT: Saving primary data. [2025-09-29T20:56:44.769614] [DEBUG] [LOCAL ] RVT: Trimmed 39890 records to 26812 (keeping 200 days of data) [2025-09-29T20:56:45.140056] [DEBUG] [LOCAL ] RVT: Primary data saved (26812 records). [2025-09-29T20:56:45.143894] [INFO ] [MAIN ] RVT: Full history saved. [2025-09-29T20:56:45.144196] [INFO ] [MAIN ] Update Progress: 1841/2371 symbols completed. RVT took 27.7s. Estimated remaining: 1h 8m 9s. Rate: 7.8 symbols/min [2025-09-29T20:56:45.173602] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-29T20:56:45.243191] [INFO ] [REMOTE ] RTO: Full fetch complete (58399 records). [2025-09-29T20:56:45.262016] [DEBUG] [VALIDATOR ] RTO: Validating primary data. [2025-09-29T20:56:45.279440] [DEBUG] [LOCAL ] RVLV: Primary data saved (47658 records). [2025-09-29T20:56:45.285405] [INFO ] [MAIN ] RVLV: Full history saved. [2025-09-29T20:56:45.301832] [INFO ] [MAIN ] Update Progress: 1842/2371 symbols completed. RVLV took 27.8s. Estimated remaining: 1h 7m 59s. Rate: 7.8 symbols/min [2025-09-29T20:56:45.477473] [INFO ] [MAIN ] RVTY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:56:45.801131] [INFO ] [MAIN ] RWT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:56:46.058432] [DEBUG] [VALIDATOR ] RTO: All expected trading days are present. [2025-09-29T20:56:46.058721] [DEBUG] [VALIDATOR ] RTO: Primary data validation passed. [2025-09-29T20:56:46.059879] [INFO ] [MAIN ] RTO: Fetched primary data is valid. [2025-09-29T20:56:46.061386] [DEBUG] [LOCAL ] RVTY: Loaded 48199 existing records from primary storage. [2025-09-29T20:56:46.060016] [DEBUG] [LOCAL ] RTO: Saving primary data. [2025-09-29T20:56:46.062104] [INFO ] [MAIN ] RVTY: Loaded 48199 existing records. [2025-09-29T20:56:46.176310] [DEBUG] [LOCAL ] RTO: Trimmed 58399 records to 40007 (keeping 200 days of data) [2025-09-29T20:56:46.181151] [DEBUG] [LOCAL ] RWT: Loaded 41352 existing records from primary storage. [2025-09-29T20:56:46.256103] [INFO ] [MAIN ] RWT: Loaded 41352 existing records. [2025-09-29T20:56:46.396899] [WARN ] [MAIN ] RVTY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:56:46.448686] [INFO ] [MAIN ] RVTY: Wiping existing primary data before full refresh. [2025-09-29T20:56:46.470886] [INFO ] [LOCAL ] RVTY: Starting deletion of primary data. [2025-09-29T20:56:46.523385] [DEBUG] [LOCAL ] RVTY: Deleted primary data file. [2025-09-29T20:56:46.524451] [INFO ] [MAIN ] RVTY: Starting full primary refresh. [2025-09-29T20:56:46.564825] [WARN ] [MAIN ] RWT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:56:46.565502] [INFO ] [MAIN ] RWT: Wiping existing primary data before full refresh. [2025-09-29T20:56:46.576701] [INFO ] [LOCAL ] RWT: Starting deletion of primary data. [2025-09-29T20:56:46.603677] [DEBUG] [LOCAL ] RWT: Deleted primary data file. [2025-09-29T20:56:46.611047] [INFO ] [MAIN ] RWT: Starting full primary refresh. [2025-09-29T20:56:47.415353] [INFO ] [REMOTE ] RVTY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:56:47.434187] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2024-12. [2025-09-29T20:56:47.457228] [INFO ] [REMOTE ] RWT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:56:47.488123] [INFO ] [REMOTE ] RWT: Fetching primary data for 2024-12. [2025-09-29T20:56:47.518410] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-07 (3.15 seconds). [2025-09-29T20:56:47.552862] [DEBUG] [LOCAL ] RTO: Primary data saved (40007 records). [2025-09-29T20:56:47.553026] [INFO ] [MAIN ] RTO: Full history saved. [2025-09-29T20:56:47.553206] [INFO ] [MAIN ] Update Progress: 1843/2371 symbols completed. RTO took 30.1s. Estimated remaining: 1h 7m 49s. Rate: 7.8 symbols/min [2025-09-29T20:56:47.553701] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-08. [2025-09-29T20:56:47.735638] [INFO ] [MAIN ] RWTN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:56:47.735864] [DEBUG] [LOCAL ] RWTN: No existing data file found in primary storage. [2025-09-29T20:56:47.735904] [WARN ] [MAIN ] RWTN: No existing data found, performing full refresh instead. [2025-09-29T20:56:47.736015] [INFO ] [MAIN ] RWTN: Wiping existing primary data before full refresh. [2025-09-29T20:56:47.736057] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-09-29T20:56:47.736098] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-09-29T20:56:47.736176] [INFO ] [MAIN ] RWTN: Starting full primary refresh. [2025-09-29T20:56:48.097277] [INFO ] [REMOTE ] RWTN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:56:48.097606] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2024-12. [2025-09-29T20:56:48.328486] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2024-12 (0.23 seconds). [2025-09-29T20:56:48.348055] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-01. [2025-09-29T20:56:48.716270] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-09-29T20:56:48.980906] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-29T20:56:49.082056] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-29T20:56:49.148162] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-01. [2025-09-29T20:56:49.329978] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-29T20:56:49.948121] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-01. [2025-09-29T20:56:50.748136] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-02. [2025-09-29T20:56:50.824336] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-29T20:56:51.160471] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-29T20:56:51.426872] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-29T20:56:51.548078] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-02. [2025-09-29T20:56:52.348109] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-03. [2025-09-29T20:56:52.847713] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-29T20:56:53.148086] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-04. [2025-09-29T20:56:53.354405] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-29T20:56:53.568264] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-29T20:56:53.948157] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-03. [2025-09-29T20:56:54.748161] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-09. [2025-09-29T20:56:55.548087] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-05. [2025-09-29T20:56:55.629408] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-29T20:56:56.114120] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-29T20:56:56.348103] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-02. [2025-09-29T20:56:56.899343] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-29T20:56:56.910872] [INFO ] [REMOTE ] RTX: Full fetch complete (77734 records). [2025-09-29T20:56:56.911048] [DEBUG] [VALIDATOR ] RTX: Validating primary data. [2025-09-29T20:56:57.153243] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-06. [2025-09-29T20:56:57.322287] [DEBUG] [VALIDATOR ] RTX: All expected trading days are present. [2025-09-29T20:56:57.322376] [DEBUG] [VALIDATOR ] RTX: Primary data validation passed. [2025-09-29T20:56:57.323505] [INFO ] [MAIN ] RTX: Fetched primary data is valid. [2025-09-29T20:56:57.323573] [DEBUG] [LOCAL ] RTX: Saving primary data. [2025-09-29T20:56:57.325102] [DEBUG] [LOCAL ] RTX: Trimmed 77734 records to 53708 (keeping 200 days of data) [2025-09-29T20:56:57.559299] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-29T20:56:57.688438] [DEBUG] [LOCAL ] RTX: Primary data saved (53708 records). [2025-09-29T20:56:57.688592] [INFO ] [MAIN ] RTX: Full history saved. [2025-09-29T20:56:57.688726] [INFO ] [MAIN ] Update Progress: 1844/2371 symbols completed. RTX took 40.2s. Estimated remaining: 1h 7m 42s. Rate: 7.8 symbols/min [2025-09-29T20:56:57.873531] [INFO ] [MAIN ] RWTO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:56:57.873778] [DEBUG] [LOCAL ] RWTO: No existing data file found in primary storage. [2025-09-29T20:56:57.873830] [WARN ] [MAIN ] RWTO: No existing data found, performing full refresh instead. [2025-09-29T20:56:57.873942] [INFO ] [MAIN ] RWTO: Wiping existing primary data before full refresh. [2025-09-29T20:56:57.873996] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-09-29T20:56:57.874043] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-09-29T20:56:57.874075] [INFO ] [MAIN ] RWTO: Starting full primary refresh. [2025-09-29T20:56:57.950822] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-04. [2025-09-29T20:56:58.271029] [INFO ] [REMOTE ] RWTO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:56:58.295150] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-29T20:56:58.748127] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2024-12. [2025-09-29T20:56:59.018822] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2024-12 (0.27 seconds). [2025-09-29T20:56:59.548097] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-01. [2025-09-29T20:56:59.679570] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-29T20:56:59.919030] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-09-29T20:57:00.348129] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-02. [2025-09-29T20:57:00.843273] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-29T20:57:01.148111] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-03. [2025-09-29T20:57:01.395508] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-09-29T20:57:01.948159] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-03. [2025-09-29T20:57:02.748140] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-07. [2025-09-29T20:57:03.296446] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-29T20:57:03.328054] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-29T20:57:03.548115] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-05. [2025-09-29T20:57:04.348138] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-04. [2025-09-29T20:57:05.149155] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-04. [2025-09-29T20:57:05.149038] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-29T20:57:05.590557] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-29T20:57:05.952817] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-05. [2025-09-29T20:57:05.959298] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-29T20:57:06.453253] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-29T20:57:06.748163] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-06. [2025-09-29T20:57:07.191206] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-29T20:57:07.548132] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-06. [2025-09-29T20:57:08.348123] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-08. [2025-09-29T20:57:08.907266] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-29T20:57:09.060260] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-29T20:57:09.148117] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-05. [2025-09-29T20:57:09.948132] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-07. [2025-09-29T20:57:10.452116] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-29T20:57:10.748093] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-07. [2025-09-29T20:57:10.963849] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-29T20:57:11.548101] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-06. [2025-09-29T20:57:12.036100] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-29T20:57:12.348124] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-09. [2025-09-29T20:57:12.779845] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-29T20:57:12.780955] [INFO ] [REMOTE ] RWTN: Full fetch complete (3111 records). [2025-09-29T20:57:12.781029] [DEBUG] [VALIDATOR ] RWTN: Validating primary data. [2025-09-29T20:57:12.781386] [FATAL] [VALIDATOR ] RWTN: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T20:57:12.781468] [FATAL] [MAIN ] RWTN: Fetched primary data is invalid. Refusing to save it. [2025-09-29T20:57:12.781512] [WARN ] [MAIN ] RWTN: Deleting existing primary and derivative data due to validation failure. [2025-09-29T20:57:12.781551] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-09-29T20:57:12.781637] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-09-29T20:57:12.781719] [INFO ] [LOCAL ] RWTN: Starting deletion of derivative data. [2025-09-29T20:57:12.781780] [DEBUG] [LOCAL ] RWTN: No derivative data file found to delete. [2025-09-29T20:57:12.781857] [INFO ] [MAIN ] Update Progress: 1845/2371 symbols completed. RWTN took 25.2s. Estimated remaining: 1h 7m 37s. Rate: 7.8 symbols/min [2025-09-29T20:57:12.966818] [INFO ] [MAIN ] RWTP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:57:12.966992] [DEBUG] [LOCAL ] RWTP: No existing data file found in primary storage. [2025-09-29T20:57:12.967031] [WARN ] [MAIN ] RWTP: No existing data found, performing full refresh instead. [2025-09-29T20:57:12.970799] [INFO ] [MAIN ] RWTP: Wiping existing primary data before full refresh. [2025-09-29T20:57:12.970857] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-09-29T20:57:12.970904] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-09-29T20:57:12.970939] [INFO ] [MAIN ] RWTP: Starting full primary refresh. [2025-09-29T20:57:13.161185] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-08. [2025-09-29T20:57:13.363811] [INFO ] [REMOTE ] RWTP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:57:13.389078] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-29T20:57:13.791428] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-29T20:57:13.948118] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-08. [2025-09-29T20:57:14.748117] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-09. [2025-09-29T20:57:15.250763] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-29T20:57:15.252308] [INFO ] [REMOTE ] RWTO: Full fetch complete (4793 records). [2025-09-29T20:57:15.252382] [DEBUG] [VALIDATOR ] RWTO: Validating primary data. [2025-09-29T20:57:15.252916] [FATAL] [VALIDATOR ] RWTO: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T20:57:15.253007] [FATAL] [MAIN ] RWTO: Fetched primary data is invalid. Refusing to save it. [2025-09-29T20:57:15.253052] [WARN ] [MAIN ] RWTO: Deleting existing primary and derivative data due to validation failure. [2025-09-29T20:57:15.253117] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-09-29T20:57:15.253303] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-09-29T20:57:15.253431] [INFO ] [LOCAL ] RWTO: Starting deletion of derivative data. [2025-09-29T20:57:15.253542] [DEBUG] [LOCAL ] RWTO: No derivative data file found to delete. [2025-09-29T20:57:15.253615] [INFO ] [MAIN ] Update Progress: 1846/2371 symbols completed. RWTO took 17.6s. Estimated remaining: 1h 7m 28s. Rate: 7.8 symbols/min [2025-09-29T20:57:15.437952] [INFO ] [MAIN ] RXO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:57:15.487361] [DEBUG] [LOCAL ] RXO: Loaded 48520 existing records from primary storage. [2025-09-29T20:57:15.487858] [INFO ] [MAIN ] RXO: Loaded 48520 existing records. [2025-09-29T20:57:15.553293] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2024-12. [2025-09-29T20:57:15.667906] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-29T20:57:15.708045] [WARN ] [MAIN ] RXO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:57:15.716703] [INFO ] [MAIN ] RXO: Wiping existing primary data before full refresh. [2025-09-29T20:57:15.716773] [INFO ] [LOCAL ] RXO: Starting deletion of primary data. [2025-09-29T20:57:15.717164] [DEBUG] [LOCAL ] RXO: Deleted primary data file. [2025-09-29T20:57:15.717225] [INFO ] [MAIN ] RXO: Starting full primary refresh. [2025-09-29T20:57:15.831699] [DEBUG] [REMOTE ] RWTP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T20:57:15.847491] [WARN ] [REMOTE ] RWTP: No data returned for month 2024-12 [2025-09-29T20:57:15.852734] [FATAL] [REMOTE ] RWTP: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T20:57:15.877259] [FATAL] [MAIN ] RWTP: Failed to fetch primary data. [2025-09-29T20:57:15.889326] [WARN ] [MAIN ] RWTP: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T20:57:15.890485] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-09-29T20:57:15.954376] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-09-29T20:57:15.981970] [INFO ] [LOCAL ] RWTP: Starting deletion of derivative data. [2025-09-29T20:57:15.993185] [DEBUG] [LOCAL ] RWTP: No derivative data file found to delete. [2025-09-29T20:57:16.017063] [INFO ] [MAIN ] Update Progress: 1847/2371 symbols completed. RWTP took 3.2s. Estimated remaining: 1h 7m 18s. Rate: 7.8 symbols/min [2025-09-29T20:57:16.235032] [INFO ] [REMOTE ] RXO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:57:16.293032] [INFO ] [MAIN ] RY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:57:16.343150] [DEBUG] [LOCAL ] RY: Loaded 48606 existing records from primary storage. [2025-09-29T20:57:16.343513] [INFO ] [MAIN ] RY: Loaded 48606 existing records. [2025-09-29T20:57:16.354544] [INFO ] [REMOTE ] RXO: Fetching primary data for 2024-12. [2025-09-29T20:57:16.539758] [WARN ] [MAIN ] RY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:57:16.539997] [INFO ] [MAIN ] RY: Wiping existing primary data before full refresh. [2025-09-29T20:57:16.540047] [INFO ] [LOCAL ] RY: Starting deletion of primary data. [2025-09-29T20:57:16.540570] [DEBUG] [LOCAL ] RY: Deleted primary data file. [2025-09-29T20:57:16.540630] [INFO ] [MAIN ] RY: Starting full primary refresh. [2025-09-29T20:57:16.920319] [INFO ] [REMOTE ] RY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:57:17.148111] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-09. [2025-09-29T20:57:17.948137] [INFO ] [REMOTE ] RY: Fetching primary data for 2024-12. [2025-09-29T20:57:18.045289] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-29T20:57:18.286095] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-29T20:57:18.298904] [INFO ] [REMOTE ] RWT: Full fetch complete (58808 records). [2025-09-29T20:57:18.299106] [DEBUG] [VALIDATOR ] RWT: Validating primary data. [2025-09-29T20:57:18.724629] [DEBUG] [VALIDATOR ] RWT: All expected trading days are present. [2025-09-29T20:57:18.724754] [DEBUG] [VALIDATOR ] RWT: Primary data validation passed. [2025-09-29T20:57:18.725877] [INFO ] [MAIN ] RWT: Fetched primary data is valid. [2025-09-29T20:57:18.725943] [DEBUG] [LOCAL ] RWT: Saving primary data. [2025-09-29T20:57:18.727462] [DEBUG] [LOCAL ] RWT: Trimmed 58808 records to 40791 (keeping 200 days of data) [2025-09-29T20:57:18.782411] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-01. [2025-09-29T20:57:18.985373] [DEBUG] [LOCAL ] RWT: Primary data saved (40791 records). [2025-09-29T20:57:18.985504] [INFO ] [MAIN ] RWT: Full history saved. [2025-09-29T20:57:18.985587] [INFO ] [MAIN ] Update Progress: 1848/2371 symbols completed. RWT took 33.7s. Estimated remaining: 1h 7m 9s. Rate: 7.8 symbols/min [2025-09-29T20:57:19.163682] [INFO ] [MAIN ] RYAM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:57:19.203125] [DEBUG] [LOCAL ] RYAM: Loaded 35709 existing records from primary storage. [2025-09-29T20:57:19.203410] [INFO ] [MAIN ] RYAM: Loaded 35709 existing records. [2025-09-29T20:57:19.393849] [WARN ] [MAIN ] RYAM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:57:19.394083] [INFO ] [MAIN ] RYAM: Wiping existing primary data before full refresh. [2025-09-29T20:57:19.394134] [INFO ] [LOCAL ] RYAM: Starting deletion of primary data. [2025-09-29T20:57:19.394491] [DEBUG] [LOCAL ] RYAM: Deleted primary data file. [2025-09-29T20:57:19.394554] [INFO ] [MAIN ] RYAM: Starting full primary refresh. [2025-09-29T20:57:19.551421] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-07. [2025-09-29T20:57:19.797737] [INFO ] [REMOTE ] RYAM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:57:19.809025] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-29T20:57:20.348121] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2024-12. [2025-09-29T20:57:20.485939] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-29T20:57:21.148105] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-02. [2025-09-29T20:57:21.520512] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-29T20:57:21.804153] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-29T20:57:21.948116] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-01. [2025-09-29T20:57:22.515974] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-29T20:57:22.748122] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-03. [2025-09-29T20:57:23.160403] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-29T20:57:23.548165] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-02. [2025-09-29T20:57:24.348139] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-08. [2025-09-29T20:57:24.406191] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-29T20:57:24.617052] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-29T20:57:25.148169] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-03. [2025-09-29T20:57:25.875488] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-29T20:57:25.948182] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-04. [2025-09-29T20:57:26.263315] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-29T20:57:26.748156] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-04. [2025-09-29T20:57:27.548136] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-09. [2025-09-29T20:57:28.037598] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-29T20:57:28.281730] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-29T20:57:28.348127] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-01. [2025-09-29T20:57:29.148143] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-05. [2025-09-29T20:57:29.357845] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-29T20:57:29.368012] [INFO ] [REMOTE ] RVTY: Full fetch complete (66505 records). [2025-09-29T20:57:29.368152] [DEBUG] [VALIDATOR ] RVTY: Validating primary data. [2025-09-29T20:57:29.797797] [DEBUG] [VALIDATOR ] RVTY: All expected trading days are present. [2025-09-29T20:57:29.797912] [DEBUG] [VALIDATOR ] RVTY: Primary data validation passed. [2025-09-29T20:57:29.799227] [INFO ] [MAIN ] RVTY: Fetched primary data is valid. [2025-09-29T20:57:29.799342] [DEBUG] [LOCAL ] RVTY: Saving primary data. [2025-09-29T20:57:29.801114] [DEBUG] [LOCAL ] RVTY: Trimmed 66505 records to 47459 (keeping 200 days of data) [2025-09-29T20:57:29.924927] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-29T20:57:29.948685] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-02. [2025-09-29T20:57:30.141951] [DEBUG] [LOCAL ] RVTY: Primary data saved (47459 records). [2025-09-29T20:57:30.142095] [INFO ] [MAIN ] RVTY: Full history saved. [2025-09-29T20:57:30.142183] [INFO ] [MAIN ] Update Progress: 1849/2371 symbols completed. RVTY took 45.0s. Estimated remaining: 1h 7m 2s. Rate: 7.8 symbols/min [2025-09-29T20:57:30.322952] [INFO ] [MAIN ] RYAN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:57:30.367486] [DEBUG] [LOCAL ] RYAN: Loaded 44960 existing records from primary storage. [2025-09-29T20:57:30.367835] [INFO ] [MAIN ] RYAN: Loaded 44960 existing records. [2025-09-29T20:57:30.558980] [WARN ] [MAIN ] RYAN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:57:30.559223] [INFO ] [MAIN ] RYAN: Wiping existing primary data before full refresh. [2025-09-29T20:57:30.559270] [INFO ] [LOCAL ] RYAN: Starting deletion of primary data. [2025-09-29T20:57:30.559750] [DEBUG] [LOCAL ] RYAN: Deleted primary data file. [2025-09-29T20:57:30.559811] [INFO ] [MAIN ] RYAN: Starting full primary refresh. [2025-09-29T20:57:30.749203] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-05. [2025-09-29T20:57:30.932567] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-29T20:57:30.983869] [INFO ] [REMOTE ] RYAN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:57:31.522736] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-29T20:57:31.548157] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2024-12. [2025-09-29T20:57:32.348162] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-03. [2025-09-29T20:57:32.548195] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-29T20:57:33.148124] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-06. [2025-09-29T20:57:33.200936] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-29T20:57:33.948161] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-06. [2025-09-29T20:57:34.131494] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-29T20:57:34.748085] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-04. [2025-09-29T20:57:34.813001] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-29T20:57:35.365432] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-29T20:57:35.548157] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-01. [2025-09-29T20:57:36.348118] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-07. [2025-09-29T20:57:36.678799] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-29T20:57:37.054758] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-29T20:57:37.148132] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-05. [2025-09-29T20:57:37.852818] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-29T20:57:37.948147] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-07. [2025-09-29T20:57:38.567635] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-29T20:57:38.748142] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-08. [2025-09-29T20:57:39.548094] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-06. [2025-09-29T20:57:39.705940] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-29T20:57:40.342140] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-29T20:57:40.350334] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-08. [2025-09-29T20:57:41.148470] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-09. [2025-09-29T20:57:41.148310] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-29T20:57:41.948095] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-07. [2025-09-29T20:57:42.077922] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-29T20:57:42.365470] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-29T20:57:42.373583] [INFO ] [REMOTE ] RYAM: Full fetch complete (48964 records). [2025-09-29T20:57:42.373737] [DEBUG] [VALIDATOR ] RYAM: Validating primary data. [2025-09-29T20:57:42.756389] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-09. [2025-09-29T20:57:42.791043] [DEBUG] [VALIDATOR ] RYAM: All expected trading days are present. [2025-09-29T20:57:42.791113] [DEBUG] [VALIDATOR ] RYAM: Primary data validation passed. [2025-09-29T20:57:42.792024] [INFO ] [MAIN ] RYAM: Fetched primary data is valid. [2025-09-29T20:57:42.792171] [DEBUG] [LOCAL ] RYAM: Saving primary data. [2025-09-29T20:57:42.793558] [DEBUG] [LOCAL ] RYAM: Trimmed 48964 records to 35124 (keeping 200 days of data) [2025-09-29T20:57:43.000918] [DEBUG] [LOCAL ] RYAM: Primary data saved (35124 records). [2025-09-29T20:57:43.001076] [INFO ] [MAIN ] RYAM: Full history saved. [2025-09-29T20:57:43.001180] [INFO ] [MAIN ] Update Progress: 1850/2371 symbols completed. RYAM took 24.0s. Estimated remaining: 1h 6m 56s. Rate: 7.8 symbols/min [2025-09-29T20:57:43.218224] [INFO ] [MAIN ] RYI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:57:43.242277] [DEBUG] [LOCAL ] RYI: Loaded 21835 existing records from primary storage. [2025-09-29T20:57:43.242554] [INFO ] [MAIN ] RYI: Loaded 21835 existing records. [2025-09-29T20:57:43.434496] [WARN ] [MAIN ] RYI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:57:43.434751] [INFO ] [MAIN ] RYI: Wiping existing primary data before full refresh. [2025-09-29T20:57:43.434805] [INFO ] [LOCAL ] RYI: Starting deletion of primary data. [2025-09-29T20:57:43.435126] [DEBUG] [LOCAL ] RYI: Deleted primary data file. [2025-09-29T20:57:43.435185] [INFO ] [MAIN ] RYI: Starting full primary refresh. [2025-09-29T20:57:43.550081] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-02. [2025-09-29T20:57:43.839822] [INFO ] [REMOTE ] RYI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:57:43.871512] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-29T20:57:44.348168] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-08. [2025-09-29T20:57:44.486280] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-29T20:57:44.498967] [INFO ] [REMOTE ] RXO: Full fetch complete (68233 records). [2025-09-29T20:57:44.499143] [DEBUG] [VALIDATOR ] RXO: Validating primary data. [2025-09-29T20:57:44.940850] [DEBUG] [VALIDATOR ] RXO: All expected trading days are present. [2025-09-29T20:57:44.940934] [DEBUG] [VALIDATOR ] RXO: Primary data validation passed. [2025-09-29T20:57:44.942139] [INFO ] [MAIN ] RXO: Fetched primary data is valid. [2025-09-29T20:57:44.942216] [DEBUG] [LOCAL ] RXO: Saving primary data. [2025-09-29T20:57:44.943839] [DEBUG] [LOCAL ] RXO: Trimmed 68233 records to 47788 (keeping 200 days of data) [2025-09-29T20:57:45.160799] [INFO ] [REMOTE ] RYI: Fetching primary data for 2024-12. [2025-09-29T20:57:45.212359] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-29T20:57:45.281792] [DEBUG] [LOCAL ] RXO: Primary data saved (47788 records). [2025-09-29T20:57:45.281960] [INFO ] [MAIN ] RXO: Full history saved. [2025-09-29T20:57:45.282088] [INFO ] [MAIN ] Update Progress: 1851/2371 symbols completed. RXO took 30.0s. Estimated remaining: 1h 6m 47s. Rate: 7.8 symbols/min [2025-09-29T20:57:45.458784] [INFO ] [MAIN ] RYN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:57:45.501928] [DEBUG] [LOCAL ] RYN: Loaded 46335 existing records from primary storage. [2025-09-29T20:57:45.502244] [INFO ] [MAIN ] RYN: Loaded 46335 existing records. [2025-09-29T20:57:45.683783] [WARN ] [MAIN ] RYN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:57:45.684046] [INFO ] [MAIN ] RYN: Wiping existing primary data before full refresh. [2025-09-29T20:57:45.684094] [INFO ] [LOCAL ] RYN: Starting deletion of primary data. [2025-09-29T20:57:45.685829] [DEBUG] [LOCAL ] RYN: Deleted primary data file. [2025-09-29T20:57:45.685908] [INFO ] [MAIN ] RYN: Starting full primary refresh. [2025-09-29T20:57:45.953205] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-03. [2025-09-29T20:57:46.087549] [INFO ] [REMOTE ] RYN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:57:46.102519] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-29T20:57:46.128473] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-29T20:57:46.748143] [INFO ] [REMOTE ] RYN: Fetching primary data for 2024-12. [2025-09-29T20:57:47.548121] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-01. [2025-09-29T20:57:47.610843] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-29T20:57:48.317152] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-29T20:57:48.348079] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-01. [2025-09-29T20:57:48.733298] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-29T20:57:49.148151] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-04. [2025-09-29T20:57:49.875285] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-29T20:57:49.948128] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-02. [2025-09-29T20:57:50.748079] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-02. [2025-09-29T20:57:50.885799] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-29T20:57:51.135483] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-29T20:57:51.548116] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-03. [2025-09-29T20:57:52.326290] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-29T20:57:52.348070] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-03. [2025-09-29T20:57:52.373382] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-29T20:57:53.148109] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-04. [2025-09-29T20:57:53.948139] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-09. [2025-09-29T20:57:54.067819] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-29T20:57:54.348756] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-29T20:57:54.748141] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-04. [2025-09-29T20:57:55.548071] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-05. [2025-09-29T20:57:55.659716] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-29T20:57:55.669329] [INFO ] [REMOTE ] RY: Full fetch complete (68613 records). [2025-09-29T20:57:55.669472] [DEBUG] [VALIDATOR ] RY: Validating primary data. [2025-09-29T20:57:56.092301] [DEBUG] [VALIDATOR ] RY: All expected trading days are present. [2025-09-29T20:57:56.092449] [DEBUG] [VALIDATOR ] RY: Primary data validation passed. [2025-09-29T20:57:56.093741] [INFO ] [MAIN ] RY: Fetched primary data is valid. [2025-09-29T20:57:56.093862] [DEBUG] [LOCAL ] RY: Saving primary data. [2025-09-29T20:57:56.095720] [DEBUG] [LOCAL ] RY: Trimmed 68613 records to 47856 (keeping 200 days of data) [2025-09-29T20:57:56.212700] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-29T20:57:56.349426] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-05. [2025-09-29T20:57:56.435709] [DEBUG] [LOCAL ] RY: Primary data saved (47856 records). [2025-09-29T20:57:56.435915] [INFO ] [MAIN ] RY: Full history saved. [2025-09-29T20:57:56.436047] [INFO ] [MAIN ] Update Progress: 1852/2371 symbols completed. RY took 40.4s. Estimated remaining: 1h 6m 40s. Rate: 7.8 symbols/min [2025-09-29T20:57:56.611244] [INFO ] [MAIN ] RZB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:57:56.619781] [DEBUG] [LOCAL ] RZB: Loaded 6291 existing records from primary storage. [2025-09-29T20:57:56.619982] [INFO ] [MAIN ] RZB: Loaded 6291 existing records. [2025-09-29T20:57:56.805434] [WARN ] [MAIN ] RZB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:57:56.805694] [INFO ] [MAIN ] RZB: Wiping existing primary data before full refresh. [2025-09-29T20:57:56.805755] [INFO ] [LOCAL ] RZB: Starting deletion of primary data. [2025-09-29T20:57:56.805993] [DEBUG] [LOCAL ] RZB: Deleted primary data file. [2025-09-29T20:57:56.806054] [INFO ] [MAIN ] RZB: Starting full primary refresh. [2025-09-29T20:57:57.156692] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-05. [2025-09-29T20:57:57.179838] [INFO ] [REMOTE ] RZB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:57:57.240012] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-29T20:57:57.948076] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-06. [2025-09-29T20:57:58.126928] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-29T20:57:58.176199] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-29T20:57:58.748127] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-06. [2025-09-29T20:57:59.528558] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-29T20:57:59.548070] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-07. [2025-09-29T20:57:59.630826] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-29T20:58:00.348091] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-07. [2025-09-29T20:58:01.148113] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-06. [2025-09-29T20:58:01.257087] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-29T20:58:01.626404] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-29T20:58:01.948119] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-08. [2025-09-29T20:58:02.629620] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-29T20:58:02.748121] [INFO ] [REMOTE ] RZB: Fetching primary data for 2024-12. [2025-09-29T20:58:03.548089] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-08. [2025-09-29T20:58:03.615932] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-29T20:58:03.619425] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-29T20:58:04.348084] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-01. [2025-09-29T20:58:04.735716] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-29T20:58:05.058702] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-29T20:58:05.148153] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-02. [2025-09-29T20:58:05.670160] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-29T20:58:05.948124] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-03. [2025-09-29T20:58:06.701005] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-29T20:58:06.748125] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-04. [2025-09-29T20:58:07.442154] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-29T20:58:07.548149] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-09. [2025-09-29T20:58:08.348156] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-05. [2025-09-29T20:58:08.991535] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-29T20:58:09.148095] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-09. [2025-09-29T20:58:09.232195] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-29T20:58:09.242966] [INFO ] [REMOTE ] RYAN: Full fetch complete (63837 records). [2025-09-29T20:58:09.243105] [DEBUG] [VALIDATOR ] RYAN: Validating primary data. [2025-09-29T20:58:09.647116] [DEBUG] [VALIDATOR ] RYAN: All expected trading days are present. [2025-09-29T20:58:09.647303] [DEBUG] [VALIDATOR ] RYAN: Primary data validation passed. [2025-09-29T20:58:09.648391] [INFO ] [MAIN ] RYAN: Fetched primary data is valid. [2025-09-29T20:58:09.648465] [DEBUG] [LOCAL ] RYAN: Saving primary data. [2025-09-29T20:58:09.650064] [DEBUG] [LOCAL ] RYAN: Trimmed 63837 records to 44405 (keeping 200 days of data) [2025-09-29T20:58:09.937609] [DEBUG] [LOCAL ] RYAN: Primary data saved (44405 records). [2025-09-29T20:58:09.937786] [INFO ] [MAIN ] RYAN: Full history saved. [2025-09-29T20:58:09.937903] [INFO ] [MAIN ] Update Progress: 1853/2371 symbols completed. RYAN took 39.8s. Estimated remaining: 1h 6m 34s. Rate: 7.8 symbols/min [2025-09-29T20:58:09.950521] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-07. [2025-09-29T20:58:10.126837] [INFO ] [MAIN ] RZC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:58:10.135795] [DEBUG] [LOCAL ] RZC: Loaded 6838 existing records from primary storage. [2025-09-29T20:58:10.136004] [INFO ] [MAIN ] RZC: Loaded 6838 existing records. [2025-09-29T20:58:10.322437] [WARN ] [MAIN ] RZC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:58:10.322700] [INFO ] [MAIN ] RZC: Wiping existing primary data before full refresh. [2025-09-29T20:58:10.322781] [INFO ] [LOCAL ] RZC: Starting deletion of primary data. [2025-09-29T20:58:10.322988] [DEBUG] [LOCAL ] RZC: Deleted primary data file. [2025-09-29T20:58:10.323046] [INFO ] [MAIN ] RZC: Starting full primary refresh. [2025-09-29T20:58:10.504731] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-29T20:58:10.597498] [INFO ] [REMOTE ] RYI: Full fetch complete (32312 records). [2025-09-29T20:58:10.612045] [DEBUG] [VALIDATOR ] RYI: Validating primary data. [2025-09-29T20:58:10.757473] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-06. [2025-09-29T20:58:10.860418] [INFO ] [REMOTE ] RZC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:58:11.115207] [DEBUG] [VALIDATOR ] RYI: All expected trading days are present. [2025-09-29T20:58:11.115286] [DEBUG] [VALIDATOR ] RYI: Primary data validation passed. [2025-09-29T20:58:11.115970] [INFO ] [MAIN ] RYI: Fetched primary data is valid. [2025-09-29T20:58:11.116033] [DEBUG] [LOCAL ] RYI: Saving primary data. [2025-09-29T20:58:11.116826] [DEBUG] [LOCAL ] RYI: Trimmed 32312 records to 21503 (keeping 200 days of data) [2025-09-29T20:58:11.253686] [DEBUG] [LOCAL ] RYI: Primary data saved (21503 records). [2025-09-29T20:58:11.253821] [INFO ] [MAIN ] RYI: Full history saved. [2025-09-29T20:58:11.253922] [INFO ] [MAIN ] Update Progress: 1854/2371 symbols completed. RYI took 28.3s. Estimated remaining: 1h 6m 24s. Rate: 7.8 symbols/min [2025-09-29T20:58:11.436436] [INFO ] [MAIN ] S: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:58:11.497550] [DEBUG] [LOCAL ] S: Loaded 54315 existing records from primary storage. [2025-09-29T20:58:11.497950] [INFO ] [MAIN ] S: Loaded 54315 existing records. [2025-09-29T20:58:11.554214] [INFO ] [REMOTE ] RZC: Fetching primary data for 2024-12. [2025-09-29T20:58:11.701318] [WARN ] [MAIN ] S: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:58:11.710173] [INFO ] [MAIN ] S: Wiping existing primary data before full refresh. [2025-09-29T20:58:11.712038] [INFO ] [LOCAL ] S: Starting deletion of primary data. [2025-09-29T20:58:11.713346] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-29T20:58:11.713451] [DEBUG] [LOCAL ] S: Deleted primary data file. [2025-09-29T20:58:11.717735] [INFO ] [MAIN ] S: Starting full primary refresh. [2025-09-29T20:58:12.066603] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-29T20:58:12.151517] [INFO ] [REMOTE ] S: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:58:12.348099] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-08. [2025-09-29T20:58:12.595224] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-29T20:58:13.148115] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-01. [2025-09-29T20:58:13.894397] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-29T20:58:13.948112] [INFO ] [REMOTE ] S: Fetching primary data for 2024-12. [2025-09-29T20:58:13.986258] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-29T20:58:14.748111] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-07. [2025-09-29T20:58:15.411675] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-29T20:58:15.548135] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-02. [2025-09-29T20:58:16.314898] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-29T20:58:16.348113] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-08. [2025-09-29T20:58:16.467000] [INFO ] [REMOTE ] S: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-09-29T20:58:17.023659] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-29T20:58:17.148109] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-09. [2025-09-29T20:58:17.795968] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-29T20:58:17.801057] [INFO ] [REMOTE ] RZB: Full fetch complete (8689 records). [2025-09-29T20:58:17.801153] [DEBUG] [VALIDATOR ] RZB: Validating primary data. [2025-09-29T20:58:17.953206] [INFO ] [REMOTE ] S: Fetching primary data for 2025-01. [2025-09-29T20:58:18.192200] [DEBUG] [VALIDATOR ] RZB: All expected trading days are present. [2025-09-29T20:58:18.192282] [DEBUG] [VALIDATOR ] RZB: Primary data validation passed. [2025-09-29T20:58:18.192495] [INFO ] [MAIN ] RZB: Fetched primary data is valid. [2025-09-29T20:58:18.192535] [DEBUG] [LOCAL ] RZB: Saving primary data. [2025-09-29T20:58:18.192994] [DEBUG] [LOCAL ] RZB: Trimmed 8689 records to 6216 (keeping 200 days of data) [2025-09-29T20:58:18.231786] [DEBUG] [LOCAL ] RZB: Primary data saved (6216 records). [2025-09-29T20:58:18.231924] [INFO ] [MAIN ] RZB: Full history saved. [2025-09-29T20:58:18.232015] [INFO ] [MAIN ] Update Progress: 1855/2371 symbols completed. RZB took 21.8s. Estimated remaining: 1h 6m 16s. Rate: 7.8 symbols/min [2025-09-29T20:58:18.408042] [INFO ] [MAIN ] SA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:58:18.451629] [DEBUG] [LOCAL ] SA: Loaded 43820 existing records from primary storage. [2025-09-29T20:58:18.451953] [INFO ] [MAIN ] SA: Loaded 43820 existing records. [2025-09-29T20:58:18.637269] [WARN ] [MAIN ] SA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:58:18.637520] [INFO ] [MAIN ] SA: Wiping existing primary data before full refresh. [2025-09-29T20:58:18.637569] [INFO ] [LOCAL ] SA: Starting deletion of primary data. [2025-09-29T20:58:18.637943] [DEBUG] [LOCAL ] SA: Deleted primary data file. [2025-09-29T20:58:18.638004] [INFO ] [MAIN ] SA: Starting full primary refresh. [2025-09-29T20:58:18.753180] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-09. [2025-09-29T20:58:18.995710] [INFO ] [REMOTE ] SA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:58:19.548113] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-03. [2025-09-29T20:58:20.319973] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-29T20:58:20.322161] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-09-29T20:58:20.357962] [INFO ] [REMOTE ] SA: Fetching primary data for 2024-12. [2025-09-29T20:58:20.363469] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-29T20:58:20.373708] [INFO ] [REMOTE ] RYN: Full fetch complete (64812 records). [2025-09-29T20:58:20.373844] [DEBUG] [VALIDATOR ] RYN: Validating primary data. [2025-09-29T20:58:20.787024] [DEBUG] [VALIDATOR ] RYN: All expected trading days are present. [2025-09-29T20:58:20.787161] [DEBUG] [VALIDATOR ] RYN: Primary data validation passed. [2025-09-29T20:58:20.788398] [INFO ] [MAIN ] RYN: Fetched primary data is valid. [2025-09-29T20:58:20.788494] [DEBUG] [LOCAL ] RYN: Saving primary data. [2025-09-29T20:58:20.790006] [DEBUG] [LOCAL ] RYN: Trimmed 64812 records to 45587 (keeping 200 days of data) [2025-09-29T20:58:21.104119] [DEBUG] [LOCAL ] RYN: Primary data saved (45587 records). [2025-09-29T20:58:21.104293] [INFO ] [MAIN ] RYN: Full history saved. [2025-09-29T20:58:21.104422] [INFO ] [MAIN ] Update Progress: 1856/2371 symbols completed. RYN took 35.8s. Estimated remaining: 1h 6m 7s. Rate: 7.8 symbols/min [2025-09-29T20:58:21.155707] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-04. [2025-09-29T20:58:21.298503] [INFO ] [MAIN ] SABA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:58:21.309750] [DEBUG] [LOCAL ] SABA: Loaded 9306 existing records from primary storage. [2025-09-29T20:58:21.310064] [INFO ] [MAIN ] SABA: Loaded 9306 existing records. [2025-09-29T20:58:21.505320] [WARN ] [MAIN ] SABA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:58:21.505595] [INFO ] [MAIN ] SABA: Wiping existing primary data before full refresh. [2025-09-29T20:58:21.505670] [INFO ] [LOCAL ] SABA: Starting deletion of primary data. [2025-09-29T20:58:21.505917] [DEBUG] [LOCAL ] SABA: Deleted primary data file. [2025-09-29T20:58:21.505978] [INFO ] [MAIN ] SABA: Starting full primary refresh. [2025-09-29T20:58:21.886725] [INFO ] [REMOTE ] SABA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:58:21.948086] [INFO ] [REMOTE ] SABA: Fetching primary data for 2024-12. [2025-09-29T20:58:22.030820] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-29T20:58:22.209367] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-29T20:58:22.615992] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-29T20:58:22.748116] [INFO ] [REMOTE ] S: Fetching primary data for 2025-02. [2025-09-29T20:58:23.548145] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-01. [2025-09-29T20:58:24.348140] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-01. [2025-09-29T20:58:24.795768] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-29T20:58:25.040399] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-29T20:58:25.148080] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-02. [2025-09-29T20:58:25.388898] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-29T20:58:25.948162] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-05. [2025-09-29T20:58:26.663028] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-29T20:58:26.752423] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-06. [2025-09-29T20:58:26.757852] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-29T20:58:27.503507] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-29T20:58:27.548195] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-07. [2025-09-29T20:58:28.348167] [INFO ] [REMOTE ] S: Fetching primary data for 2025-03. [2025-09-29T20:58:28.404295] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-29T20:58:29.148193] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-08. [2025-09-29T20:58:29.923237] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-29T20:58:29.948073] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-09. [2025-09-29T20:58:30.513945] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-29T20:58:30.579272] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-29T20:58:30.580982] [INFO ] [REMOTE ] RZC: Full fetch complete (9860 records). [2025-09-29T20:58:30.581057] [DEBUG] [VALIDATOR ] RZC: Validating primary data. [2025-09-29T20:58:30.765989] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-03. [2025-09-29T20:58:30.968860] [DEBUG] [VALIDATOR ] RZC: All expected trading days are present. [2025-09-29T20:58:30.968972] [DEBUG] [VALIDATOR ] RZC: Primary data validation passed. [2025-09-29T20:58:30.969274] [INFO ] [MAIN ] RZC: Fetched primary data is valid. [2025-09-29T20:58:30.969340] [DEBUG] [LOCAL ] RZC: Saving primary data. [2025-09-29T20:58:30.969943] [DEBUG] [LOCAL ] RZC: Trimmed 9860 records to 6776 (keeping 200 days of data) [2025-09-29T20:58:31.011829] [DEBUG] [LOCAL ] RZC: Primary data saved (6776 records). [2025-09-29T20:58:31.011958] [INFO ] [MAIN ] RZC: Full history saved. [2025-09-29T20:58:31.012040] [INFO ] [MAIN ] Update Progress: 1857/2371 symbols completed. RZC took 21.1s. Estimated remaining: 1h 6m 0s. Rate: 7.8 symbols/min [2025-09-29T20:58:31.191359] [INFO ] [MAIN ] SAFE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:58:31.223974] [DEBUG] [LOCAL ] SAFE: Loaded 30819 existing records from primary storage. [2025-09-29T20:58:31.224287] [INFO ] [MAIN ] SAFE: Loaded 30819 existing records. [2025-09-29T20:58:31.411680] [WARN ] [MAIN ] SAFE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:58:31.411959] [INFO ] [MAIN ] SAFE: Wiping existing primary data before full refresh. [2025-09-29T20:58:31.412018] [INFO ] [LOCAL ] SAFE: Starting deletion of primary data. [2025-09-29T20:58:31.412364] [DEBUG] [LOCAL ] SAFE: Deleted primary data file. [2025-09-29T20:58:31.412430] [INFO ] [MAIN ] SAFE: Starting full primary refresh. [2025-09-29T20:58:31.561017] [INFO ] [REMOTE ] S: Fetching primary data for 2025-04. [2025-09-29T20:58:31.800069] [INFO ] [REMOTE ] SAFE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:58:32.348102] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-02. [2025-09-29T20:58:32.593336] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-29T20:58:33.148118] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-04. [2025-09-29T20:58:33.243731] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-29T20:58:33.665496] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-29T20:58:33.948127] [INFO ] [REMOTE ] S: Fetching primary data for 2025-05. [2025-09-29T20:58:34.542494] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-29T20:58:34.748135] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-03. [2025-09-29T20:58:35.548093] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-05. [2025-09-29T20:58:35.620934] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-29T20:58:35.913478] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-29T20:58:36.348116] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2024-12. [2025-09-29T20:58:37.148745] [INFO ] [REMOTE ] S: Fetching primary data for 2025-06. [2025-09-29T20:58:37.151604] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-29T20:58:37.609167] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-29T20:58:37.948117] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-06. [2025-09-29T20:58:38.748147] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-04. [2025-09-29T20:58:39.298792] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-29T20:58:39.548083] [INFO ] [REMOTE ] S: Fetching primary data for 2025-07. [2025-09-29T20:58:39.621847] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-29T20:58:39.621571] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-29T20:58:40.348101] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-07. [2025-09-29T20:58:41.148241] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-05. [2025-09-29T20:58:41.913347] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-09-29T20:58:41.948140] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-01. [2025-09-29T20:58:42.056672] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-29T20:58:42.248489] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-29T20:58:42.748118] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-06. [2025-09-29T20:58:43.116401] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-29T20:58:43.401689] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-29T20:58:43.548132] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-02. [2025-09-29T20:58:44.348152] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-07. [2025-09-29T20:58:45.017788] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-29T20:58:45.148156] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-03. [2025-09-29T20:58:45.204190] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-29T20:58:45.948161] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-08. [2025-09-29T20:58:46.505296] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-29T20:58:46.748136] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-04. [2025-09-29T20:58:46.833501] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-29T20:58:47.548117] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-09. [2025-09-29T20:58:48.288622] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-29T20:58:48.348111] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-08. [2025-09-29T20:58:48.410572] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-29T20:58:48.413487] [INFO ] [REMOTE ] SABA: Full fetch complete (15473 records). [2025-09-29T20:58:48.413576] [DEBUG] [VALIDATOR ] SABA: Validating primary data. [2025-09-29T20:58:48.806714] [DEBUG] [VALIDATOR ] SABA: All expected trading days are present. [2025-09-29T20:58:48.806808] [DEBUG] [VALIDATOR ] SABA: Primary data validation passed. [2025-09-29T20:58:48.807211] [INFO ] [MAIN ] SABA: Fetched primary data is valid. [2025-09-29T20:58:48.807278] [DEBUG] [LOCAL ] SABA: Saving primary data. [2025-09-29T20:58:48.807830] [DEBUG] [LOCAL ] SABA: Trimmed 15473 records to 9189 (keeping 200 days of data) [2025-09-29T20:58:48.866446] [DEBUG] [LOCAL ] SABA: Primary data saved (9189 records). [2025-09-29T20:58:48.866627] [INFO ] [MAIN ] SABA: Full history saved. [2025-09-29T20:58:48.866780] [INFO ] [MAIN ] Update Progress: 1858/2371 symbols completed. SABA took 27.8s. Estimated remaining: 1h 5m 55s. Rate: 7.8 symbols/min [2025-09-29T20:58:49.069318] [INFO ] [MAIN ] SAH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:58:49.092715] [DEBUG] [LOCAL ] SAH: Loaded 22368 existing records from primary storage. [2025-09-29T20:58:49.093007] [INFO ] [MAIN ] SAH: Loaded 22368 existing records. [2025-09-29T20:58:49.157852] [INFO ] [REMOTE ] S: Fetching primary data for 2025-08. [2025-09-29T20:58:49.290266] [WARN ] [MAIN ] SAH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:58:49.290493] [INFO ] [MAIN ] SAH: Wiping existing primary data before full refresh. [2025-09-29T20:58:49.290551] [INFO ] [LOCAL ] SAH: Starting deletion of primary data. [2025-09-29T20:58:49.290843] [DEBUG] [LOCAL ] SAH: Deleted primary data file. [2025-09-29T20:58:49.290903] [INFO ] [MAIN ] SAH: Starting full primary refresh. [2025-09-29T20:58:49.679871] [INFO ] [REMOTE ] SAH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:58:49.948159] [INFO ] [REMOTE ] SAH: Fetching primary data for 2024-12. [2025-09-29T20:58:50.081677] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-29T20:58:50.748120] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-09. [2025-09-29T20:58:50.873934] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-29T20:58:51.383173] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-29T20:58:51.548129] [INFO ] [REMOTE ] S: Fetching primary data for 2025-09. [2025-09-29T20:58:52.348120] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-05. [2025-09-29T20:58:52.591268] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-29T20:58:52.602013] [INFO ] [REMOTE ] SA: Full fetch complete (62186 records). [2025-09-29T20:58:52.602158] [DEBUG] [VALIDATOR ] SA: Validating primary data. [2025-09-29T20:58:53.018311] [DEBUG] [VALIDATOR ] SA: All expected trading days are present. [2025-09-29T20:58:53.018429] [DEBUG] [VALIDATOR ] SA: Primary data validation passed. [2025-09-29T20:58:53.019460] [INFO ] [MAIN ] SA: Fetched primary data is valid. [2025-09-29T20:58:53.019524] [DEBUG] [LOCAL ] SA: Saving primary data. [2025-09-29T20:58:53.020779] [DEBUG] [LOCAL ] SA: Trimmed 62186 records to 43225 (keeping 200 days of data) [2025-09-29T20:58:53.190860] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-01. [2025-09-29T20:58:53.286271] [DEBUG] [LOCAL ] SA: Primary data saved (43225 records). [2025-09-29T20:58:53.286413] [INFO ] [MAIN ] SA: Full history saved. [2025-09-29T20:58:53.286498] [INFO ] [MAIN ] Update Progress: 1859/2371 symbols completed. SA took 35.1s. Estimated remaining: 1h 5m 47s. Rate: 7.8 symbols/min [2025-09-29T20:58:53.482178] [INFO ] [MAIN ] SAJ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:58:53.482363] [DEBUG] [LOCAL ] SAJ: No existing data file found in primary storage. [2025-09-29T20:58:53.482401] [WARN ] [MAIN ] SAJ: No existing data found, performing full refresh instead. [2025-09-29T20:58:53.482514] [INFO ] [MAIN ] SAJ: Wiping existing primary data before full refresh. [2025-09-29T20:58:53.482556] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-09-29T20:58:53.482597] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-09-29T20:58:53.482693] [INFO ] [MAIN ] SAJ: Starting full primary refresh. [2025-09-29T20:58:53.898673] [INFO ] [REMOTE ] SAJ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:58:53.948925] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2024-12. [2025-09-29T20:58:53.948673] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-09-29T20:58:53.951076] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-29T20:58:53.970437] [INFO ] [REMOTE ] S: Full fetch complete (77546 records). [2025-09-29T20:58:53.970978] [DEBUG] [VALIDATOR ] S: Validating primary data. [2025-09-29T20:58:54.422945] [DEBUG] [VALIDATOR ] S: All expected trading days are present. [2025-09-29T20:58:54.424003] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-29T20:58:54.429934] [DEBUG] [VALIDATOR ] S: Primary data validation passed. [2025-09-29T20:58:54.432291] [INFO ] [MAIN ] S: Fetched primary data is valid. [2025-09-29T20:58:54.432378] [DEBUG] [LOCAL ] S: Saving primary data. [2025-09-29T20:58:54.433902] [DEBUG] [LOCAL ] S: Trimmed 77546 records to 53535 (keeping 200 days of data) [2025-09-29T20:58:54.522746] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-29T20:58:54.751595] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-06. [2025-09-29T20:58:54.778940] [DEBUG] [LOCAL ] S: Primary data saved (53535 records). [2025-09-29T20:58:54.779078] [INFO ] [MAIN ] S: Full history saved. [2025-09-29T20:58:54.779162] [INFO ] [MAIN ] Update Progress: 1860/2371 symbols completed. S took 43.5s. Estimated remaining: 1h 5m 37s. Rate: 7.8 symbols/min [2025-09-29T20:58:54.962155] [INFO ] [MAIN ] SAM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:58:54.984564] [DEBUG] [LOCAL ] SAM: Loaded 21766 existing records from primary storage. [2025-09-29T20:58:54.984907] [INFO ] [MAIN ] SAM: Loaded 21766 existing records. [2025-09-29T20:58:55.174124] [WARN ] [MAIN ] SAM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:58:55.174433] [INFO ] [MAIN ] SAM: Wiping existing primary data before full refresh. [2025-09-29T20:58:55.174512] [INFO ] [LOCAL ] SAM: Starting deletion of primary data. [2025-09-29T20:58:55.174836] [DEBUG] [LOCAL ] SAM: Deleted primary data file. [2025-09-29T20:58:55.174897] [INFO ] [MAIN ] SAM: Starting full primary refresh. [2025-09-29T20:58:55.549719] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-01. [2025-09-29T20:58:55.577175] [INFO ] [REMOTE ] SAM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:58:55.829579] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-01 (0.28 seconds). [2025-09-29T20:58:56.076712] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-29T20:58:56.348180] [INFO ] [REMOTE ] SAM: Fetching primary data for 2024-12. [2025-09-29T20:58:57.148125] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-02. [2025-09-29T20:58:57.610175] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-29T20:58:57.948119] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-01. [2025-09-29T20:58:58.147246] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-29T20:58:58.748086] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-02. [2025-09-29T20:58:59.080401] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-29T20:58:59.119930] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-29T20:58:59.548134] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-07. [2025-09-29T20:59:00.348144] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-03. [2025-09-29T20:59:00.621218] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-09-29T20:59:01.145714] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-29T20:59:01.152542] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-02. [2025-09-29T20:59:01.948176] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-03. [2025-09-29T20:59:02.453907] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-29T20:59:02.748155] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-08. [2025-09-29T20:59:03.184563] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-29T20:59:03.548119] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-04. [2025-09-29T20:59:03.900147] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-29T20:59:04.066485] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-29T20:59:04.348131] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-05. [2025-09-29T20:59:04.626687] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-09-29T20:59:05.148159] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-04. [2025-09-29T20:59:05.948119] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-03. [2025-09-29T20:59:06.574564] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-29T20:59:06.748112] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-09. [2025-09-29T20:59:07.189789] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-29T20:59:07.548163] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-05. [2025-09-29T20:59:08.084814] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-29T20:59:08.094729] [INFO ] [REMOTE ] SAFE: Full fetch complete (45088 records). [2025-09-29T20:59:08.094978] [DEBUG] [VALIDATOR ] SAFE: Validating primary data. [2025-09-29T20:59:08.357775] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-04. [2025-09-29T20:59:08.544834] [DEBUG] [VALIDATOR ] SAFE: All expected trading days are present. [2025-09-29T20:59:08.547672] [DEBUG] [VALIDATOR ] SAFE: Primary data validation passed. [2025-09-29T20:59:08.547495] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-29T20:59:08.549040] [INFO ] [MAIN ] SAFE: Fetched primary data is valid. [2025-09-29T20:59:08.555026] [DEBUG] [LOCAL ] SAFE: Saving primary data. [2025-09-29T20:59:08.558257] [DEBUG] [LOCAL ] SAFE: Trimmed 45088 records to 30266 (keeping 200 days of data) [2025-09-29T20:59:08.771289] [DEBUG] [LOCAL ] SAFE: Primary data saved (30266 records). [2025-09-29T20:59:08.771458] [INFO ] [MAIN ] SAFE: Full history saved. [2025-09-29T20:59:08.771639] [INFO ] [MAIN ] Update Progress: 1861/2371 symbols completed. SAFE took 37.8s. Estimated remaining: 1h 5m 31s. Rate: 7.8 symbols/min [2025-09-29T20:59:08.951199] [INFO ] [MAIN ] SAN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:59:09.009120] [DEBUG] [LOCAL ] SAN: Loaded 53774 existing records from primary storage. [2025-09-29T20:59:09.009561] [INFO ] [MAIN ] SAN: Loaded 53774 existing records. [2025-09-29T20:59:09.164199] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-06. [2025-09-29T20:59:09.212379] [WARN ] [MAIN ] SAN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:59:09.212722] [INFO ] [MAIN ] SAN: Wiping existing primary data before full refresh. [2025-09-29T20:59:09.212842] [INFO ] [LOCAL ] SAN: Starting deletion of primary data. [2025-09-29T20:59:09.213315] [DEBUG] [LOCAL ] SAN: Deleted primary data file. [2025-09-29T20:59:09.213379] [INFO ] [MAIN ] SAN: Starting full primary refresh. [2025-09-29T20:59:09.597751] [INFO ] [REMOTE ] SAN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:59:09.616139] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-29T20:59:09.948163] [INFO ] [REMOTE ] SAN: Fetching primary data for 2024-12. [2025-09-29T20:59:10.344396] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-29T20:59:10.748158] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-05. [2025-09-29T20:59:11.548177] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-07. [2025-09-29T20:59:11.814124] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-29T20:59:11.942695] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-29T20:59:12.348168] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-01. [2025-09-29T20:59:12.847949] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-29T20:59:13.148181] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-06. [2025-09-29T20:59:13.948101] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-06. [2025-09-29T20:59:13.992617] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-29T20:59:14.270837] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-29T20:59:14.454826] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-29T20:59:14.748138] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-07. [2025-09-29T20:59:15.057908] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-29T20:59:15.548165] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-08. [2025-09-29T20:59:15.951730] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-29T20:59:16.348107] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-08. [2025-09-29T20:59:17.148102] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-02. [2025-09-29T20:59:17.464232] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-29T20:59:17.948130] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-09. [2025-09-29T20:59:18.305471] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-29T20:59:18.306300] [INFO ] [REMOTE ] SAJ: Full fetch complete (919 records). [2025-09-29T20:59:18.306376] [DEBUG] [VALIDATOR ] SAJ: Validating primary data. [2025-09-29T20:59:18.306831] [FATAL] [VALIDATOR ] SAJ: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T20:59:18.306924] [FATAL] [MAIN ] SAJ: Fetched primary data is invalid. Refusing to save it. [2025-09-29T20:59:18.306969] [WARN ] [MAIN ] SAJ: Deleting existing primary and derivative data due to validation failure. [2025-09-29T20:59:18.307040] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-09-29T20:59:18.307144] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-09-29T20:59:18.307193] [INFO ] [LOCAL ] SAJ: Starting deletion of derivative data. [2025-09-29T20:59:18.307252] [DEBUG] [LOCAL ] SAJ: No derivative data file found to delete. [2025-09-29T20:59:18.307342] [INFO ] [MAIN ] Update Progress: 1862/2371 symbols completed. SAJ took 25.0s. Estimated remaining: 1h 5m 24s. Rate: 7.8 symbols/min [2025-09-29T20:59:18.499318] [INFO ] [MAIN ] SAND: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:59:18.555003] [DEBUG] [LOCAL ] SAND: Loaded 52527 existing records from primary storage. [2025-09-29T20:59:18.555368] [INFO ] [MAIN ] SAND: Loaded 52527 existing records. [2025-09-29T20:59:18.751481] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-09. [2025-09-29T20:59:18.758018] [WARN ] [MAIN ] SAND: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:59:18.759767] [INFO ] [MAIN ] SAND: Wiping existing primary data before full refresh. [2025-09-29T20:59:18.759854] [INFO ] [LOCAL ] SAND: Starting deletion of primary data. [2025-09-29T20:59:18.760392] [DEBUG] [LOCAL ] SAND: Deleted primary data file. [2025-09-29T20:59:18.760519] [INFO ] [MAIN ] SAND: Starting full primary refresh. [2025-09-29T20:59:19.118124] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-29T20:59:19.213112] [INFO ] [REMOTE ] SAND: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:59:19.548104] [INFO ] [REMOTE ] SAND: Fetching primary data for 2024-12. [2025-09-29T20:59:19.828953] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-29T20:59:19.833526] [INFO ] [REMOTE ] SAH: Full fetch complete (30439 records). [2025-09-29T20:59:19.833634] [DEBUG] [VALIDATOR ] SAH: Validating primary data. [2025-09-29T20:59:20.253036] [DEBUG] [VALIDATOR ] SAH: All expected trading days are present. [2025-09-29T20:59:20.253184] [DEBUG] [VALIDATOR ] SAH: Primary data validation passed. [2025-09-29T20:59:20.254513] [INFO ] [MAIN ] SAH: Fetched primary data is valid. [2025-09-29T20:59:20.254591] [DEBUG] [LOCAL ] SAH: Saving primary data. [2025-09-29T20:59:20.256040] [DEBUG] [LOCAL ] SAH: Trimmed 30439 records to 22003 (keeping 200 days of data) [2025-09-29T20:59:20.375738] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-03. [2025-09-29T20:59:20.468679] [DEBUG] [LOCAL ] SAH: Primary data saved (22003 records). [2025-09-29T20:59:20.468960] [INFO ] [MAIN ] SAH: Full history saved. [2025-09-29T20:59:20.469128] [INFO ] [MAIN ] Update Progress: 1863/2371 symbols completed. SAH took 31.6s. Estimated remaining: 1h 5m 15s. Rate: 7.8 symbols/min [2025-09-29T20:59:20.760176] [INFO ] [MAIN ] SAP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:59:20.856700] [DEBUG] [LOCAL ] SAP: Loaded 50800 existing records from primary storage. [2025-09-29T20:59:20.857685] [INFO ] [MAIN ] SAP: Loaded 50800 existing records. [2025-09-29T20:59:21.162458] [WARN ] [MAIN ] SAP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:59:21.151079] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-07. [2025-09-29T20:59:21.163872] [INFO ] [MAIN ] SAP: Wiping existing primary data before full refresh. [2025-09-29T20:59:21.165569] [INFO ] [LOCAL ] SAP: Starting deletion of primary data. [2025-09-29T20:59:21.166922] [DEBUG] [LOCAL ] SAP: Deleted primary data file. [2025-09-29T20:59:21.167260] [INFO ] [MAIN ] SAP: Starting full primary refresh. [2025-09-29T20:59:21.625187] [INFO ] [REMOTE ] SAP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:59:21.654733] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-29T20:59:21.948121] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-01. [2025-09-29T20:59:22.575593] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-29T20:59:22.615734] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-29T20:59:22.748141] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-08. [2025-09-29T20:59:23.449267] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-29T20:59:23.548180] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-02. [2025-09-29T20:59:23.926496] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-29T20:59:24.348118] [INFO ] [REMOTE ] SAP: Fetching primary data for 2024-12. [2025-09-29T20:59:25.148115] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-04. [2025-09-29T20:59:25.228901] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-29T20:59:25.948148] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-03. [2025-09-29T20:59:26.256306] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-29T20:59:26.748086] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-01. [2025-09-29T20:59:27.264613] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-29T20:59:27.548167] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-05. [2025-09-29T20:59:27.693968] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-29T20:59:28.348146] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-04. [2025-09-29T20:59:28.739879] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-29T20:59:29.148107] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-02. [2025-09-29T20:59:29.482924] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-29T20:59:29.948114] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-06. [2025-09-29T20:59:30.255420] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-29T20:59:30.748123] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-05. [2025-09-29T20:59:30.945610] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-29T20:59:31.548104] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-03. [2025-09-29T20:59:31.809371] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-29T20:59:32.348086] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-09. [2025-09-29T20:59:32.692620] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-29T20:59:33.148152] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-07. [2025-09-29T20:59:33.580758] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-29T20:59:33.585972] [INFO ] [REMOTE ] SAM: Full fetch complete (30434 records). [2025-09-29T20:59:33.586084] [DEBUG] [VALIDATOR ] SAM: Validating primary data. [2025-09-29T20:59:33.800859] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-09-29T20:59:33.953177] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-06. [2025-09-29T20:59:34.034527] [DEBUG] [VALIDATOR ] SAM: All expected trading days are present. [2025-09-29T20:59:34.034611] [DEBUG] [VALIDATOR ] SAM: Primary data validation passed. [2025-09-29T20:59:34.035255] [INFO ] [MAIN ] SAM: Fetched primary data is valid. [2025-09-29T20:59:34.035313] [DEBUG] [LOCAL ] SAM: Saving primary data. [2025-09-29T20:59:34.036073] [DEBUG] [LOCAL ] SAM: Trimmed 30434 records to 21311 (keeping 200 days of data) [2025-09-29T20:59:34.183461] [DEBUG] [LOCAL ] SAM: Primary data saved (21311 records). [2025-09-29T20:59:34.183592] [INFO ] [MAIN ] SAM: Full history saved. [2025-09-29T20:59:34.183729] [INFO ] [MAIN ] Update Progress: 1864/2371 symbols completed. SAM took 39.4s. Estimated remaining: 1h 5m 9s. Rate: 7.8 symbols/min [2025-09-29T20:59:34.367569] [INFO ] [MAIN ] SAR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:59:34.388111] [DEBUG] [LOCAL ] SAR: Loaded 16382 existing records from primary storage. [2025-09-29T20:59:34.388365] [INFO ] [MAIN ] SAR: Loaded 16382 existing records. [2025-09-29T20:59:34.575497] [WARN ] [MAIN ] SAR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:59:34.575775] [INFO ] [MAIN ] SAR: Wiping existing primary data before full refresh. [2025-09-29T20:59:34.575832] [INFO ] [LOCAL ] SAR: Starting deletion of primary data. [2025-09-29T20:59:34.576076] [DEBUG] [LOCAL ] SAR: Deleted primary data file. [2025-09-29T20:59:34.576135] [INFO ] [MAIN ] SAR: Starting full primary refresh. [2025-09-29T20:59:34.764682] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-04. [2025-09-29T20:59:35.012497] [INFO ] [REMOTE ] SAR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:59:35.046025] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-29T20:59:35.548099] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-08. [2025-09-29T20:59:35.794876] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-29T20:59:36.348139] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-07. [2025-09-29T20:59:36.788445] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-29T20:59:37.148124] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-05. [2025-09-29T20:59:37.526497] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-29T20:59:37.948159] [INFO ] [REMOTE ] SAR: Fetching primary data for 2024-12. [2025-09-29T20:59:38.306188] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-29T20:59:38.678228] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-29T20:59:38.748107] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-01. [2025-09-29T20:59:39.263275] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-29T20:59:39.548106] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-06. [2025-09-29T20:59:39.606243] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-29T20:59:40.348113] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-09. [2025-09-29T20:59:41.148083] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-08. [2025-09-29T20:59:41.464420] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-29T20:59:41.948156] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-07. [2025-09-29T20:59:42.232036] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-29T20:59:42.249305] [INFO ] [REMOTE ] SAN: Full fetch complete (76197 records). [2025-09-29T20:59:42.249595] [DEBUG] [VALIDATOR ] SAN: Validating primary data. [2025-09-29T20:59:42.690517] [DEBUG] [VALIDATOR ] SAN: All expected trading days are present. [2025-09-29T20:59:42.690603] [DEBUG] [VALIDATOR ] SAN: Primary data validation passed. [2025-09-29T20:59:42.691732] [INFO ] [MAIN ] SAN: Fetched primary data is valid. [2025-09-29T20:59:42.691800] [DEBUG] [LOCAL ] SAN: Saving primary data. [2025-09-29T20:59:42.695720] [DEBUG] [LOCAL ] SAN: Trimmed 76197 records to 52995 (keeping 200 days of data) [2025-09-29T20:59:42.750751] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-02. [2025-09-29T20:59:43.031090] [DEBUG] [LOCAL ] SAN: Primary data saved (52995 records). [2025-09-29T20:59:43.031221] [INFO ] [MAIN ] SAN: Full history saved. [2025-09-29T20:59:43.031339] [INFO ] [MAIN ] Update Progress: 1865/2371 symbols completed. SAN took 34.3s. Estimated remaining: 1h 5m 2s. Rate: 7.8 symbols/min [2025-09-29T20:59:43.256020] [INFO ] [MAIN ] SARO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:59:43.258011] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-29T20:59:43.316508] [DEBUG] [LOCAL ] SARO: Loaded 49425 existing records from primary storage. [2025-09-29T20:59:43.316978] [INFO ] [MAIN ] SARO: Loaded 49425 existing records. [2025-09-29T20:59:43.515164] [WARN ] [MAIN ] SARO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T20:59:43.515507] [INFO ] [MAIN ] SARO: Wiping existing primary data before full refresh. [2025-09-29T20:59:43.515568] [INFO ] [LOCAL ] SARO: Starting deletion of primary data. [2025-09-29T20:59:43.515966] [DEBUG] [LOCAL ] SARO: Deleted primary data file. [2025-09-29T20:59:43.516025] [INFO ] [MAIN ] SARO: Starting full primary refresh. [2025-09-29T20:59:43.555285] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-09. [2025-09-29T20:59:43.842324] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-29T20:59:43.933044] [INFO ] [REMOTE ] SARO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:59:43.967607] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-29T20:59:44.348133] [INFO ] [REMOTE ] SARO: Fetching primary data for 2024-12. [2025-09-29T20:59:45.148123] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-08. [2025-09-29T20:59:45.607700] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-29T20:59:45.618839] [INFO ] [REMOTE ] SAND: Full fetch complete (74385 records). [2025-09-29T20:59:45.619015] [DEBUG] [VALIDATOR ] SAND: Validating primary data. [2025-09-29T20:59:45.953266] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-03. [2025-09-29T20:59:46.072987] [DEBUG] [VALIDATOR ] SAND: All expected trading days are present. [2025-09-29T20:59:46.073198] [DEBUG] [VALIDATOR ] SAND: Primary data validation passed. [2025-09-29T20:59:46.074379] [INFO ] [MAIN ] SAND: Fetched primary data is valid. [2025-09-29T20:59:46.074558] [DEBUG] [LOCAL ] SAND: Saving primary data. [2025-09-29T20:59:46.104273] [DEBUG] [LOCAL ] SAND: Trimmed 74385 records to 51791 (keeping 200 days of data) [2025-09-29T20:59:46.105949] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-29T20:59:46.451310] [DEBUG] [LOCAL ] SAND: Primary data saved (51791 records). [2025-09-29T20:59:46.451459] [INFO ] [MAIN ] SAND: Full history saved. [2025-09-29T20:59:46.451543] [INFO ] [MAIN ] Update Progress: 1866/2371 symbols completed. SAND took 28.1s. Estimated remaining: 1h 4m 53s. Rate: 7.8 symbols/min [2025-09-29T20:59:46.643071] [INFO ] [MAIN ] SAT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:59:46.643237] [DEBUG] [LOCAL ] SAT: No existing data file found in primary storage. [2025-09-29T20:59:46.643276] [WARN ] [MAIN ] SAT: No existing data found, performing full refresh instead. [2025-09-29T20:59:46.643434] [INFO ] [MAIN ] SAT: Wiping existing primary data before full refresh. [2025-09-29T20:59:46.643481] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-09-29T20:59:46.643526] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-09-29T20:59:46.643577] [INFO ] [MAIN ] SAT: Starting full primary refresh. [2025-09-29T20:59:46.761075] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-01. [2025-09-29T20:59:46.972904] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-29T20:59:47.064806] [INFO ] [REMOTE ] SAT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:59:47.101709] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-29T20:59:47.548133] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-04. [2025-09-29T20:59:48.319561] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-29T20:59:48.348085] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-02. [2025-09-29T20:59:48.361225] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-29T20:59:49.148130] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-09. [2025-09-29T20:59:49.864571] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-29T20:59:49.948117] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-03. [2025-09-29T20:59:50.748170] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-05. [2025-09-29T20:59:50.953997] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-29T20:59:50.968469] [INFO ] [REMOTE ] SAP: Full fetch complete (71778 records). [2025-09-29T20:59:50.968699] [DEBUG] [VALIDATOR ] SAP: Validating primary data. [2025-09-29T20:59:51.407696] [DEBUG] [VALIDATOR ] SAP: All expected trading days are present. [2025-09-29T20:59:51.407812] [DEBUG] [VALIDATOR ] SAP: Primary data validation passed. [2025-09-29T20:59:51.409102] [INFO ] [MAIN ] SAP: Fetched primary data is valid. [2025-09-29T20:59:51.409182] [DEBUG] [LOCAL ] SAP: Saving primary data. [2025-09-29T20:59:51.410964] [DEBUG] [LOCAL ] SAP: Trimmed 71778 records to 50034 (keeping 200 days of data) [2025-09-29T20:59:51.548110] [INFO ] [REMOTE ] SAT: Fetching primary data for 2024-12. [2025-09-29T20:59:51.744291] [DEBUG] [LOCAL ] SAP: Primary data saved (50034 records). [2025-09-29T20:59:51.744620] [INFO ] [MAIN ] SAP: Full history saved. [2025-09-29T20:59:51.746706] [INFO ] [MAIN ] Update Progress: 1867/2371 symbols completed. SAP took 31.3s. Estimated remaining: 1h 4m 44s. Rate: 7.8 symbols/min [2025-09-29T20:59:51.918313] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-29T20:59:51.975465] [INFO ] [MAIN ] SAY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T20:59:51.971550] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-29T20:59:51.979122] [DEBUG] [LOCAL ] SAY: No existing data file found in primary storage. [2025-09-29T20:59:51.989034] [WARN ] [MAIN ] SAY: No existing data found, performing full refresh instead. [2025-09-29T20:59:51.990325] [INFO ] [MAIN ] SAY: Wiping existing primary data before full refresh. [2025-09-29T20:59:51.990508] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-09-29T20:59:51.990580] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-09-29T20:59:51.990890] [INFO ] [MAIN ] SAY: Starting full primary refresh. [2025-09-29T20:59:52.222737] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-29T20:59:52.360267] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-01. [2025-09-29T20:59:52.366709] [INFO ] [REMOTE ] SAY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T20:59:52.585936] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-01 (0.23 seconds). [2025-09-29T20:59:53.148117] [INFO ] [REMOTE ] SAY: Fetching primary data for 2024-12. [2025-09-29T20:59:53.681156] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-29T20:59:53.948129] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-01. [2025-09-29T20:59:54.159460] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-01 (0.21 seconds). [2025-09-29T20:59:54.748137] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-04. [2025-09-29T20:59:55.548129] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-06. [2025-09-29T20:59:56.348119] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-02. [2025-09-29T20:59:56.554433] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-29T20:59:56.601813] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-29T20:59:56.720475] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-29T20:59:57.148137] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-05. [2025-09-29T20:59:57.948154] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-02. [2025-09-29T20:59:58.409142] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-29T20:59:58.748119] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-03. [2025-09-29T20:59:58.909961] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-29T20:59:59.220594] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-29T20:59:59.548115] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-07. [2025-09-29T21:00:00.348106] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-06. [2025-09-29T21:00:00.705162] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-29T21:00:01.148081] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-08. [2025-09-29T21:00:01.948136] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-03. [2025-09-29T21:00:02.021380] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-29T21:00:02.175974] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-09-29T21:00:02.544297] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-29T21:00:02.748310] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-04. [2025-09-29T21:00:03.365633] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-29T21:00:03.548142] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-09. [2025-09-29T21:00:04.348123] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-07. [2025-09-29T21:00:04.820002] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-29T21:00:04.824297] [INFO ] [REMOTE ] SAR: Full fetch complete (22497 records). [2025-09-29T21:00:04.824396] [DEBUG] [VALIDATOR ] SAR: Validating primary data. [2025-09-29T21:00:05.153238] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-05. [2025-09-29T21:00:05.224731] [DEBUG] [VALIDATOR ] SAR: All expected trading days are present. [2025-09-29T21:00:05.224828] [DEBUG] [VALIDATOR ] SAR: Primary data validation passed. [2025-09-29T21:00:05.225376] [INFO ] [MAIN ] SAR: Fetched primary data is valid. [2025-09-29T21:00:05.225422] [DEBUG] [LOCAL ] SAR: Saving primary data. [2025-09-29T21:00:05.226553] [DEBUG] [LOCAL ] SAR: Trimmed 22497 records to 16143 (keeping 200 days of data) [2025-09-29T21:00:05.335067] [DEBUG] [LOCAL ] SAR: Primary data saved (16143 records). [2025-09-29T21:00:05.335217] [INFO ] [MAIN ] SAR: Full history saved. [2025-09-29T21:00:05.335318] [INFO ] [MAIN ] Update Progress: 1868/2371 symbols completed. SAR took 31.2s. Estimated remaining: 1h 4m 38s. Rate: 7.8 symbols/min [2025-09-29T21:00:05.519878] [INFO ] [MAIN ] SAZ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:00:05.523975] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-29T21:00:05.524202] [DEBUG] [LOCAL ] SAZ: No existing data file found in primary storage. [2025-09-29T21:00:05.525531] [WARN ] [MAIN ] SAZ: No existing data found, performing full refresh instead. [2025-09-29T21:00:05.525698] [INFO ] [MAIN ] SAZ: Wiping existing primary data before full refresh. [2025-09-29T21:00:05.525753] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-09-29T21:00:05.525798] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-09-29T21:00:05.525830] [INFO ] [MAIN ] SAZ: Starting full primary refresh. [2025-09-29T21:00:05.910559] [INFO ] [REMOTE ] SAZ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:00:05.948109] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-06. [2025-09-29T21:00:06.015790] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-29T21:00:06.632459] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-29T21:00:06.748163] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-07. [2025-09-29T21:00:06.960348] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-07 (0.21 seconds). [2025-09-29T21:00:07.548158] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-08. [2025-09-29T21:00:07.723446] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-08 (0.18 seconds). [2025-09-29T21:00:08.348096] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-04. [2025-09-29T21:00:08.825956] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-29T21:00:09.148141] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-09. [2025-09-29T21:00:09.737545] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-29T21:00:09.738364] [INFO ] [REMOTE ] SAY: Full fetch complete (1398 records). [2025-09-29T21:00:09.738464] [DEBUG] [VALIDATOR ] SAY: Validating primary data. [2025-09-29T21:00:09.738904] [FATAL] [VALIDATOR ] SAY: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T21:00:09.738994] [FATAL] [MAIN ] SAY: Fetched primary data is invalid. Refusing to save it. [2025-09-29T21:00:09.739041] [WARN ] [MAIN ] SAY: Deleting existing primary and derivative data due to validation failure. [2025-09-29T21:00:09.739088] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-09-29T21:00:09.739145] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-09-29T21:00:09.739200] [INFO ] [LOCAL ] SAY: Starting deletion of derivative data. [2025-09-29T21:00:09.739287] [DEBUG] [LOCAL ] SAY: No derivative data file found to delete. [2025-09-29T21:00:09.739385] [INFO ] [MAIN ] Update Progress: 1869/2371 symbols completed. SAY took 18.0s. Estimated remaining: 1h 4m 30s. Rate: 7.8 symbols/min [2025-09-29T21:00:09.916424] [INFO ] [MAIN ] SB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:00:09.952344] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-05. [2025-09-29T21:00:09.953212] [DEBUG] [LOCAL ] SB: Loaded 33735 existing records from primary storage. [2025-09-29T21:00:09.954450] [INFO ] [MAIN ] SB: Loaded 33735 existing records. [2025-09-29T21:00:10.143167] [WARN ] [MAIN ] SB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:00:10.143420] [INFO ] [MAIN ] SB: Wiping existing primary data before full refresh. [2025-09-29T21:00:10.143482] [INFO ] [LOCAL ] SB: Starting deletion of primary data. [2025-09-29T21:00:10.143943] [DEBUG] [LOCAL ] SB: Deleted primary data file. [2025-09-29T21:00:10.144013] [INFO ] [MAIN ] SB: Starting full primary refresh. [2025-09-29T21:00:10.457228] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-29T21:00:10.531393] [INFO ] [REMOTE ] SB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:00:10.748118] [INFO ] [REMOTE ] SB: Fetching primary data for 2024-12. [2025-09-29T21:00:11.548141] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-08. [2025-09-29T21:00:12.348161] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2024-12. [2025-09-29T21:00:12.421711] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-29T21:00:12.763319] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-29T21:00:13.148091] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-01. [2025-09-29T21:00:13.190211] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-29T21:00:13.499427] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-29T21:00:13.948127] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-06. [2025-09-29T21:00:14.375145] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-29T21:00:14.748146] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-01. [2025-09-29T21:00:15.548128] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-07. [2025-09-29T21:00:15.900404] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-29T21:00:16.239050] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-29T21:00:16.348096] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-09. [2025-09-29T21:00:17.148107] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-02. [2025-09-29T21:00:17.401886] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-02 (0.25 seconds). [2025-09-29T21:00:17.948113] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-03. [2025-09-29T21:00:18.466701] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-29T21:00:18.518597] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-29T21:00:18.528300] [INFO ] [REMOTE ] SARO: Full fetch complete (69025 records). [2025-09-29T21:00:18.528467] [DEBUG] [VALIDATOR ] SARO: Validating primary data. [2025-09-29T21:00:18.753201] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-02. [2025-09-29T21:00:18.968022] [DEBUG] [VALIDATOR ] SARO: All expected trading days are present. [2025-09-29T21:00:18.968105] [DEBUG] [VALIDATOR ] SARO: Primary data validation passed. [2025-09-29T21:00:18.969296] [INFO ] [MAIN ] SARO: Fetched primary data is valid. [2025-09-29T21:00:18.969387] [DEBUG] [LOCAL ] SARO: Saving primary data. [2025-09-29T21:00:18.970835] [DEBUG] [LOCAL ] SARO: Trimmed 69025 records to 48625 (keeping 200 days of data) [2025-09-29T21:00:19.266328] [DEBUG] [LOCAL ] SARO: Primary data saved (48625 records). [2025-09-29T21:00:19.266480] [INFO ] [MAIN ] SARO: Full history saved. [2025-09-29T21:00:19.266572] [INFO ] [MAIN ] Update Progress: 1870/2371 symbols completed. SARO took 36.2s. Estimated remaining: 1h 4m 22s. Rate: 7.8 symbols/min [2025-09-29T21:00:19.449781] [INFO ] [MAIN ] SBDS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:00:19.450021] [DEBUG] [LOCAL ] SBDS: No existing data file found in primary storage. [2025-09-29T21:00:19.450079] [WARN ] [MAIN ] SBDS: No existing data found, performing full refresh instead. [2025-09-29T21:00:19.450219] [INFO ] [MAIN ] SBDS: Wiping existing primary data before full refresh. [2025-09-29T21:00:19.450264] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-09-29T21:00:19.450309] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-09-29T21:00:19.450343] [INFO ] [MAIN ] SBDS: Starting full primary refresh. [2025-09-29T21:00:19.554170] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-04. [2025-09-29T21:00:19.826604] [INFO ] [REMOTE ] SBDS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:00:20.046381] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-29T21:00:20.345930] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-29T21:00:20.353895] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2024-12. [2025-09-29T21:00:20.489256] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T21:00:20.489632] [WARN ] [REMOTE ] SBDS: No data returned for month 2024-12 [2025-09-29T21:00:20.489756] [FATAL] [REMOTE ] SBDS: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T21:00:20.489804] [FATAL] [MAIN ] SBDS: Failed to fetch primary data. [2025-09-29T21:00:20.489863] [WARN ] [MAIN ] SBDS: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T21:00:20.489974] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-09-29T21:00:20.490066] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-09-29T21:00:20.490123] [INFO ] [LOCAL ] SBDS: Starting deletion of derivative data. [2025-09-29T21:00:20.490170] [DEBUG] [LOCAL ] SBDS: No derivative data file found to delete. [2025-09-29T21:00:20.490221] [INFO ] [MAIN ] Update Progress: 1871/2371 symbols completed. SBDS took 1.2s. Estimated remaining: 1h 4m 13s. Rate: 7.8 symbols/min [2025-09-29T21:00:20.676402] [INFO ] [MAIN ] SBH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:00:20.728996] [DEBUG] [LOCAL ] SBH: Loaded 50565 existing records from primary storage. [2025-09-29T21:00:20.729372] [INFO ] [MAIN ] SBH: Loaded 50565 existing records. [2025-09-29T21:00:20.919515] [WARN ] [MAIN ] SBH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:00:20.919770] [INFO ] [MAIN ] SBH: Wiping existing primary data before full refresh. [2025-09-29T21:00:20.919829] [INFO ] [LOCAL ] SBH: Starting deletion of primary data. [2025-09-29T21:00:20.920487] [DEBUG] [LOCAL ] SBH: Deleted primary data file. [2025-09-29T21:00:20.920550] [INFO ] [MAIN ] SBH: Starting full primary refresh. [2025-09-29T21:00:21.153303] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-05. [2025-09-29T21:00:21.300487] [INFO ] [REMOTE ] SBH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:00:21.691894] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-29T21:00:21.948126] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-08. [2025-09-29T21:00:22.162084] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-08 (0.21 seconds). [2025-09-29T21:00:22.748187] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-09. [2025-09-29T21:00:23.128973] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-29T21:00:23.129743] [INFO ] [REMOTE ] SAT: Full fetch complete (1587 records). [2025-09-29T21:00:23.129815] [DEBUG] [VALIDATOR ] SAT: Validating primary data. [2025-09-29T21:00:23.130183] [FATAL] [VALIDATOR ] SAT: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T21:00:23.130336] [FATAL] [MAIN ] SAT: Fetched primary data is invalid. Refusing to save it. [2025-09-29T21:00:23.130428] [WARN ] [MAIN ] SAT: Deleting existing primary and derivative data due to validation failure. [2025-09-29T21:00:23.130503] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-09-29T21:00:23.130568] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-09-29T21:00:23.130604] [INFO ] [LOCAL ] SAT: Starting deletion of derivative data. [2025-09-29T21:00:23.130670] [DEBUG] [LOCAL ] SAT: No derivative data file found to delete. [2025-09-29T21:00:23.130747] [INFO ] [MAIN ] Update Progress: 1872/2371 symbols completed. SAT took 36.7s. Estimated remaining: 1h 4m 4s. Rate: 7.8 symbols/min [2025-09-29T21:00:23.316833] [INFO ] [MAIN ] SBI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:00:23.327025] [DEBUG] [LOCAL ] SBI: Loaded 7848 existing records from primary storage. [2025-09-29T21:00:23.327301] [INFO ] [MAIN ] SBI: Loaded 7848 existing records. [2025-09-29T21:00:23.518948] [WARN ] [MAIN ] SBI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:00:23.519199] [INFO ] [MAIN ] SBI: Wiping existing primary data before full refresh. [2025-09-29T21:00:23.519247] [INFO ] [LOCAL ] SBI: Starting deletion of primary data. [2025-09-29T21:00:23.519503] [DEBUG] [LOCAL ] SBI: Deleted primary data file. [2025-09-29T21:00:23.519565] [INFO ] [MAIN ] SBI: Starting full primary refresh. [2025-09-29T21:00:23.553242] [INFO ] [REMOTE ] SBH: Fetching primary data for 2024-12. [2025-09-29T21:00:23.924822] [INFO ] [REMOTE ] SBI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:00:24.348140] [INFO ] [REMOTE ] SBI: Fetching primary data for 2024-12. [2025-09-29T21:00:25.148153] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-03. [2025-09-29T21:00:25.267615] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-29T21:00:25.506024] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-29T21:00:25.948126] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-01. [2025-09-29T21:00:26.753813] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-06. [2025-09-29T21:00:26.759611] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-29T21:00:26.900837] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-06 (0.15 seconds). [2025-09-29T21:00:27.548093] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-07. [2025-09-29T21:00:27.612963] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-29T21:00:28.078249] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-29T21:00:28.348089] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-02. [2025-09-29T21:00:29.148130] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-01. [2025-09-29T21:00:29.948168] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-04. [2025-09-29T21:00:29.964727] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-29T21:00:30.168798] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-29T21:00:30.748156] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-03. [2025-09-29T21:00:31.500026] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-29T21:00:31.548076] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-05. [2025-09-29T21:00:32.348092] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-02. [2025-09-29T21:00:32.608545] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-29T21:00:32.728738] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-29T21:00:33.019280] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-29T21:00:33.148162] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-03. [2025-09-29T21:00:33.879281] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-29T21:00:33.948144] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-06. [2025-09-29T21:00:34.748123] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-04. [2025-09-29T21:00:35.322222] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-29T21:00:35.548154] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-04. [2025-09-29T21:00:36.348128] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-08. [2025-09-29T21:00:36.423393] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-29T21:00:36.536075] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-29T21:00:36.646220] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-09-29T21:00:37.148136] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-05. [2025-09-29T21:00:37.866931] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-29T21:00:37.948155] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-05. [2025-09-29T21:00:38.748172] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-07. [2025-09-29T21:00:39.548129] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-06. [2025-09-29T21:00:39.682082] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-29T21:00:40.283382] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-29T21:00:40.348118] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-08. [2025-09-29T21:00:40.436191] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-29T21:00:41.148125] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-06. [2025-09-29T21:00:41.731274] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-29T21:00:41.948125] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-09. [2025-09-29T21:00:42.748132] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-09. [2025-09-29T21:00:42.858967] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-29T21:00:43.072900] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-29T21:00:43.073766] [INFO ] [REMOTE ] SAZ: Full fetch complete (1805 records). [2025-09-29T21:00:43.073841] [DEBUG] [VALIDATOR ] SAZ: Validating primary data. [2025-09-29T21:00:43.074298] [FATAL] [VALIDATOR ] SAZ: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T21:00:43.074393] [FATAL] [MAIN ] SAZ: Fetched primary data is invalid. Refusing to save it. [2025-09-29T21:00:43.074439] [WARN ] [MAIN ] SAZ: Deleting existing primary and derivative data due to validation failure. [2025-09-29T21:00:43.074506] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-09-29T21:00:43.074595] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-09-29T21:00:43.074682] [INFO ] [LOCAL ] SAZ: Starting deletion of derivative data. [2025-09-29T21:00:43.074761] [DEBUG] [LOCAL ] SAZ: No derivative data file found to delete. [2025-09-29T21:00:43.074863] [INFO ] [MAIN ] Update Progress: 1873/2371 symbols completed. SAZ took 37.7s. Estimated remaining: 1h 3m 59s. Rate: 7.8 symbols/min [2025-09-29T21:00:43.260971] [INFO ] [MAIN ] SBR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:00:43.279582] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-29T21:00:43.287922] [INFO ] [REMOTE ] SB: Full fetch complete (50374 records). [2025-09-29T21:00:43.291635] [DEBUG] [VALIDATOR ] SB: Validating primary data. [2025-09-29T21:00:43.291552] [DEBUG] [LOCAL ] SBR: Loaded 7350 existing records from primary storage. [2025-09-29T21:00:43.291912] [INFO ] [MAIN ] SBR: Loaded 7350 existing records. [2025-09-29T21:00:43.556157] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-07. [2025-09-29T21:00:43.733323] [WARN ] [MAIN ] SBR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:00:43.824363] [INFO ] [MAIN ] SBR: Wiping existing primary data before full refresh. [2025-09-29T21:00:43.839181] [INFO ] [LOCAL ] SBR: Starting deletion of primary data. [2025-09-29T21:00:43.856852] [DEBUG] [LOCAL ] SBR: Deleted primary data file. [2025-09-29T21:00:43.860173] [INFO ] [MAIN ] SBR: Starting full primary refresh. [2025-09-29T21:00:44.144625] [DEBUG] [VALIDATOR ] SB: All expected trading days are present. [2025-09-29T21:00:44.146532] [DEBUG] [VALIDATOR ] SB: Primary data validation passed. [2025-09-29T21:00:44.149132] [INFO ] [MAIN ] SB: Fetched primary data is valid. [2025-09-29T21:00:44.165247] [DEBUG] [LOCAL ] SB: Saving primary data. [2025-09-29T21:00:44.323449] [DEBUG] [LOCAL ] SB: Trimmed 50374 records to 33129 (keeping 200 days of data) [2025-09-29T21:00:44.391484] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-07. [2025-09-29T21:00:44.532217] [INFO ] [REMOTE ] SBR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:00:44.642358] [DEBUG] [LOCAL ] SB: Primary data saved (33129 records). [2025-09-29T21:00:44.642517] [INFO ] [MAIN ] SB: Full history saved. [2025-09-29T21:00:44.642620] [INFO ] [MAIN ] Update Progress: 1874/2371 symbols completed. SB took 34.9s. Estimated remaining: 1h 3m 50s. Rate: 7.8 symbols/min [2025-09-29T21:00:44.823106] [INFO ] [MAIN ] SBS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:00:44.872141] [DEBUG] [LOCAL ] SBS: Loaded 50166 existing records from primary storage. [2025-09-29T21:00:44.872565] [INFO ] [MAIN ] SBS: Loaded 50166 existing records. [2025-09-29T21:00:45.066075] [WARN ] [MAIN ] SBS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:00:45.066319] [INFO ] [MAIN ] SBS: Wiping existing primary data before full refresh. [2025-09-29T21:00:45.066371] [INFO ] [LOCAL ] SBS: Starting deletion of primary data. [2025-09-29T21:00:45.067152] [DEBUG] [LOCAL ] SBS: Deleted primary data file. [2025-09-29T21:00:45.067216] [INFO ] [MAIN ] SBS: Starting full primary refresh. [2025-09-29T21:00:45.151055] [INFO ] [REMOTE ] SBR: Fetching primary data for 2024-12. [2025-09-29T21:00:45.339387] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-29T21:00:45.472293] [INFO ] [REMOTE ] SBS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:00:45.575225] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-29T21:00:45.948096] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-08. [2025-09-29T21:00:45.995935] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-29T21:00:46.748153] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-08. [2025-09-29T21:00:47.548079] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-01. [2025-09-29T21:00:47.640752] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-29T21:00:47.646489] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-29T21:00:48.128903] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-29T21:00:48.348157] [INFO ] [REMOTE ] SBS: Fetching primary data for 2024-12. [2025-09-29T21:00:49.148107] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-09. [2025-09-29T21:00:49.824696] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-29T21:00:49.827385] [INFO ] [REMOTE ] SBI: Full fetch complete (10650 records). [2025-09-29T21:00:49.827497] [DEBUG] [VALIDATOR ] SBI: Validating primary data. [2025-09-29T21:00:49.951228] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-09. [2025-09-29T21:00:50.252722] [DEBUG] [VALIDATOR ] SBI: All expected trading days are present. [2025-09-29T21:00:50.252918] [DEBUG] [VALIDATOR ] SBI: Primary data validation passed. [2025-09-29T21:00:50.253298] [INFO ] [MAIN ] SBI: Fetched primary data is valid. [2025-09-29T21:00:50.253382] [DEBUG] [LOCAL ] SBI: Saving primary data. [2025-09-29T21:00:50.254243] [DEBUG] [LOCAL ] SBI: Trimmed 10650 records to 7679 (keeping 200 days of data) [2025-09-29T21:00:50.319844] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-29T21:00:50.341579] [DEBUG] [LOCAL ] SBI: Primary data saved (7679 records). [2025-09-29T21:00:50.341736] [INFO ] [MAIN ] SBI: Full history saved. [2025-09-29T21:00:50.341831] [INFO ] [MAIN ] Update Progress: 1875/2371 symbols completed. SBI took 27.2s. Estimated remaining: 1h 3m 42s. Rate: 7.8 symbols/min [2025-09-29T21:00:50.532178] [INFO ] [MAIN ] SBSI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:00:50.548809] [DEBUG] [LOCAL ] SBSI: Loaded 14974 existing records from primary storage. [2025-09-29T21:00:50.549060] [INFO ] [MAIN ] SBSI: Loaded 14974 existing records. [2025-09-29T21:00:50.748670] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-01. [2025-09-29T21:00:50.774330] [WARN ] [MAIN ] SBSI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:00:50.774696] [INFO ] [MAIN ] SBSI: Wiping existing primary data before full refresh. [2025-09-29T21:00:50.774764] [INFO ] [LOCAL ] SBSI: Starting deletion of primary data. [2025-09-29T21:00:50.775158] [DEBUG] [LOCAL ] SBSI: Deleted primary data file. [2025-09-29T21:00:50.775220] [INFO ] [MAIN ] SBSI: Starting full primary refresh. [2025-09-29T21:00:51.183746] [INFO ] [REMOTE ] SBSI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:00:51.548145] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-02. [2025-09-29T21:00:51.733513] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-29T21:00:51.744329] [INFO ] [REMOTE ] SBH: Full fetch complete (72799 records). [2025-09-29T21:00:51.744468] [DEBUG] [VALIDATOR ] SBH: Validating primary data. [2025-09-29T21:00:52.156092] [DEBUG] [VALIDATOR ] SBH: All expected trading days are present. [2025-09-29T21:00:52.156194] [DEBUG] [VALIDATOR ] SBH: Primary data validation passed. [2025-09-29T21:00:52.157441] [INFO ] [MAIN ] SBH: Fetched primary data is valid. [2025-09-29T21:00:52.157512] [DEBUG] [LOCAL ] SBH: Saving primary data. [2025-09-29T21:00:52.159283] [DEBUG] [LOCAL ] SBH: Trimmed 72799 records to 49790 (keeping 200 days of data) [2025-09-29T21:00:52.354601] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2024-12. [2025-09-29T21:00:52.391036] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-29T21:00:52.495458] [DEBUG] [LOCAL ] SBH: Primary data saved (49790 records). [2025-09-29T21:00:52.495619] [INFO ] [MAIN ] SBH: Full history saved. [2025-09-29T21:00:52.495760] [INFO ] [MAIN ] Update Progress: 1876/2371 symbols completed. SBH took 32.0s. Estimated remaining: 1h 3m 33s. Rate: 7.8 symbols/min [2025-09-29T21:00:52.700718] [INFO ] [MAIN ] SBSW: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:00:52.753440] [DEBUG] [LOCAL ] SBSW: Loaded 53745 existing records from primary storage. [2025-09-29T21:00:52.753825] [INFO ] [MAIN ] SBSW: Loaded 53745 existing records. [2025-09-29T21:00:52.946827] [WARN ] [MAIN ] SBSW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:00:52.947116] [INFO ] [MAIN ] SBSW: Wiping existing primary data before full refresh. [2025-09-29T21:00:52.947289] [INFO ] [LOCAL ] SBSW: Starting deletion of primary data. [2025-09-29T21:00:52.957250] [DEBUG] [LOCAL ] SBSW: Deleted primary data file. [2025-09-29T21:00:52.962977] [INFO ] [MAIN ] SBSW: Starting full primary refresh. [2025-09-29T21:00:53.068384] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-09-29T21:00:53.150572] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-02. [2025-09-29T21:00:53.378511] [INFO ] [REMOTE ] SBSW: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:00:53.455996] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-29T21:00:53.948148] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-03. [2025-09-29T21:00:54.753234] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2024-12. [2025-09-29T21:00:54.771368] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-29T21:00:54.832492] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-29T21:00:55.548117] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-04. [2025-09-29T21:00:56.348125] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-03. [2025-09-29T21:00:56.535820] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-29T21:00:56.558709] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-29T21:00:57.148139] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-05. [2025-09-29T21:00:57.948143] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-01. [2025-09-29T21:00:57.970993] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-29T21:00:58.073724] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-29T21:00:58.748155] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-01. [2025-09-29T21:00:59.002039] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-29T21:00:59.548114] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-06. [2025-09-29T21:01:00.348143] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-04. [2025-09-29T21:01:00.790304] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-29T21:01:01.148125] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-07. [2025-09-29T21:01:01.758958] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-01 (3.01 seconds). [2025-09-29T21:01:01.944102] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-29T21:01:01.948052] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-08. [2025-09-29T21:01:02.318593] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-29T21:01:02.748145] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-02. [2025-09-29T21:01:02.858809] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-29T21:01:03.548140] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-09. [2025-09-29T21:01:04.348159] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-05. [2025-09-29T21:01:04.406160] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-29T21:01:04.410343] [INFO ] [REMOTE ] SBR: Full fetch complete (11095 records). [2025-09-29T21:01:04.410563] [DEBUG] [VALIDATOR ] SBR: Validating primary data. [2025-09-29T21:01:04.862006] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-29T21:01:04.872211] [DEBUG] [VALIDATOR ] SBR: All expected trading days are present. [2025-09-29T21:01:04.873039] [DEBUG] [VALIDATOR ] SBR: Primary data validation passed. [2025-09-29T21:01:04.873391] [INFO ] [MAIN ] SBR: Fetched primary data is valid. [2025-09-29T21:01:04.873438] [DEBUG] [LOCAL ] SBR: Saving primary data. [2025-09-29T21:01:04.874085] [DEBUG] [LOCAL ] SBR: Trimmed 11095 records to 7282 (keeping 200 days of data) [2025-09-29T21:01:04.923079] [DEBUG] [LOCAL ] SBR: Primary data saved (7282 records). [2025-09-29T21:01:04.923231] [INFO ] [MAIN ] SBR: Full history saved. [2025-09-29T21:01:04.923331] [INFO ] [MAIN ] Update Progress: 1877/2371 symbols completed. SBR took 21.8s. Estimated remaining: 1h 3m 26s. Rate: 7.8 symbols/min [2025-09-29T21:01:05.148152] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-02. [2025-09-29T21:01:05.910864] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-29T21:01:05.948148] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-06. [2025-09-29T21:01:06.178964] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-29T21:01:06.748176] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-03. [2025-09-29T21:01:07.548199] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-03. [2025-09-29T21:01:07.777409] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-29T21:01:08.348113] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-07. [2025-09-29T21:01:08.395864] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-29T21:01:08.654758] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-29T21:01:09.148106] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-04. [2025-09-29T21:01:09.948135] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-04. [2025-09-29T21:01:10.194109] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-29T21:01:10.220852] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-29T21:01:10.748104] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-05. [2025-09-29T21:01:11.548120] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-08. [2025-09-29T21:01:11.659326] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-29T21:01:11.967179] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-29T21:01:12.348113] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-06. [2025-09-29T21:01:13.148135] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-05. [2025-09-29T21:01:13.271440] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-29T21:01:13.376595] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-29T21:01:13.948140] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-09. [2025-09-29T21:01:14.748130] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-07. [2025-09-29T21:01:15.053051] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-29T21:01:15.548111] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-06. [2025-09-29T21:01:15.715748] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-29T21:01:15.736872] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-29T21:01:15.737129] [INFO ] [REMOTE ] SBS: Full fetch complete (70134 records). [2025-09-29T21:01:15.737280] [DEBUG] [VALIDATOR ] SBS: Validating primary data. [2025-09-29T21:01:16.169179] [DEBUG] [VALIDATOR ] SBS: All expected trading days are present. [2025-09-29T21:01:16.169269] [DEBUG] [VALIDATOR ] SBS: Primary data validation passed. [2025-09-29T21:01:16.170473] [INFO ] [MAIN ] SBS: Fetched primary data is valid. [2025-09-29T21:01:16.170584] [DEBUG] [LOCAL ] SBS: Saving primary data. [2025-09-29T21:01:16.172071] [DEBUG] [LOCAL ] SBS: Trimmed 70134 records to 49491 (keeping 200 days of data) [2025-09-29T21:01:16.359692] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-08. [2025-09-29T21:01:16.493614] [DEBUG] [LOCAL ] SBS: Primary data saved (49491 records). [2025-09-29T21:01:16.493807] [INFO ] [MAIN ] SBS: Full history saved. [2025-09-29T21:01:16.493939] [INFO ] [MAIN ] Update Progress: 1878/2371 symbols completed. SBS took 31.9s. Estimated remaining: 1h 3m 20s. Rate: 7.8 symbols/min [2025-09-29T21:01:17.377998] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-29T21:01:17.384288] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-09. [2025-09-29T21:01:17.586879] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-29T21:01:17.948163] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-07. [2025-09-29T21:01:18.064745] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-29T21:01:18.068505] [INFO ] [REMOTE ] SBSI: Full fetch complete (21219 records). [2025-09-29T21:01:18.068595] [DEBUG] [VALIDATOR ] SBSI: Validating primary data. [2025-09-29T21:01:18.455284] [DEBUG] [VALIDATOR ] SBSI: All expected trading days are present. [2025-09-29T21:01:18.455369] [DEBUG] [VALIDATOR ] SBSI: Primary data validation passed. [2025-09-29T21:01:18.455935] [INFO ] [MAIN ] SBSI: Fetched primary data is valid. [2025-09-29T21:01:18.456001] [DEBUG] [LOCAL ] SBSI: Saving primary data. [2025-09-29T21:01:18.456784] [DEBUG] [LOCAL ] SBSI: Trimmed 21219 records to 14718 (keeping 200 days of data) [2025-09-29T21:01:18.552176] [DEBUG] [LOCAL ] SBSI: Primary data saved (14718 records). [2025-09-29T21:01:18.552323] [INFO ] [MAIN ] SBSI: Full history saved. [2025-09-29T21:01:18.552449] [INFO ] [MAIN ] Update Progress: 1879/2371 symbols completed. SBSI took 28.2s. Estimated remaining: 1h 3m 10s. Rate: 7.8 symbols/min [2025-09-29T21:01:20.164939] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-29T21:01:20.177809] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-08. [2025-09-29T21:01:22.221676] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-29T21:01:22.233477] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-09. [2025-09-29T21:01:24.387096] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-29T21:01:24.398721] [INFO ] [REMOTE ] SBSW: Full fetch complete (76507 records). [2025-09-29T21:01:24.398879] [DEBUG] [VALIDATOR ] SBSW: Validating primary data. [2025-09-29T21:01:24.852418] [DEBUG] [VALIDATOR ] SBSW: All expected trading days are present. [2025-09-29T21:01:24.852514] [DEBUG] [VALIDATOR ] SBSW: Primary data validation passed. [2025-09-29T21:01:24.853821] [INFO ] [MAIN ] SBSW: Fetched primary data is valid. [2025-09-29T21:01:24.853892] [DEBUG] [LOCAL ] SBSW: Saving primary data. [2025-09-29T21:01:24.855533] [DEBUG] [LOCAL ] SBSW: Trimmed 76507 records to 52993 (keeping 200 days of data) [2025-09-29T21:01:25.180866] [DEBUG] [LOCAL ] SBSW: Primary data saved (52993 records). [2025-09-29T21:01:25.181017] [INFO ] [MAIN ] SBSW: Full history saved. [2025-09-29T21:01:25.181148] [INFO ] [MAIN ] Update Progress: 1880/2371 symbols completed. SBSW took 32.7s. Estimated remaining: 1h 3m 2s. Rate: 7.8 symbols/min [2025-09-29T21:01:25.861292] [INFO ] [MAIN ] SCHW: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:01:25.973314] [INFO ] [MAIN ] SCD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:01:25.968198] [INFO ] [MAIN ] SBXD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:01:25.975296] [INFO ] [MAIN ] SCCO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:01:25.976364] [DEBUG] [LOCAL ] SBXD: No existing data file found in primary storage. [2025-09-29T21:01:25.976576] [WARN ] [MAIN ] SBXD: No existing data found, performing full refresh instead. [2025-09-29T21:01:25.977403] [INFO ] [MAIN ] SBXD: Wiping existing primary data before full refresh. [2025-09-29T21:01:25.977625] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-09-29T21:01:25.978097] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-09-29T21:01:25.978241] [INFO ] [MAIN ] SBXD: Starting full primary refresh. [2025-09-29T21:01:26.107686] [DEBUG] [LOCAL ] SCD: Loaded 12749 existing records from primary storage. [2025-09-29T21:01:26.113035] [INFO ] [MAIN ] SCD: Loaded 12749 existing records. [2025-09-29T21:01:26.494665] [DEBUG] [LOCAL ] SCHW: Loaded 54465 existing records from primary storage. [2025-09-29T21:01:26.531308] [INFO ] [MAIN ] SCHW: Loaded 54465 existing records. [2025-09-29T21:01:26.588819] [WARN ] [MAIN ] SCD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:01:26.541016] [DEBUG] [LOCAL ] SCCO: Loaded 50148 existing records from primary storage. [2025-09-29T21:01:26.626919] [INFO ] [MAIN ] SCCO: Loaded 50148 existing records. [2025-09-29T21:01:26.627026] [INFO ] [MAIN ] SCD: Wiping existing primary data before full refresh. [2025-09-29T21:01:26.676387] [INFO ] [LOCAL ] SCD: Starting deletion of primary data. [2025-09-29T21:01:26.798463] [DEBUG] [LOCAL ] SCD: Deleted primary data file. [2025-09-29T21:01:26.939999] [INFO ] [MAIN ] SCD: Starting full primary refresh. [2025-09-29T21:01:26.881614] [INFO ] [REMOTE ] SBXD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:01:26.968852] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2024-12. [2025-09-29T21:01:27.101734] [WARN ] [MAIN ] SCHW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:01:27.141179] [INFO ] [MAIN ] SCHW: Wiping existing primary data before full refresh. [2025-09-29T21:01:27.183364] [INFO ] [LOCAL ] SCHW: Starting deletion of primary data. [2025-09-29T21:01:27.207806] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2024-12 (0.24 seconds). [2025-09-29T21:01:27.223499] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-01. [2025-09-29T21:01:27.223604] [DEBUG] [LOCAL ] SCHW: Deleted primary data file. [2025-09-29T21:01:27.231520] [INFO ] [MAIN ] SCHW: Starting full primary refresh. [2025-09-29T21:01:27.270447] [WARN ] [MAIN ] SCCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:01:27.402291] [INFO ] [MAIN ] SCCO: Wiping existing primary data before full refresh. [2025-09-29T21:01:27.488091] [INFO ] [LOCAL ] SCCO: Starting deletion of primary data. [2025-09-29T21:01:27.499374] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-01 (0.28 seconds). [2025-09-29T21:01:27.563412] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-02. [2025-09-29T21:01:27.563471] [DEBUG] [LOCAL ] SCCO: Deleted primary data file. [2025-09-29T21:01:27.602087] [INFO ] [MAIN ] SCCO: Starting full primary refresh. [2025-09-29T21:01:27.918975] [INFO ] [REMOTE ] SCD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:01:27.948311] [INFO ] [REMOTE ] SCD: Fetching primary data for 2024-12. [2025-09-29T21:01:28.185764] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-29T21:01:28.218966] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-03. [2025-09-29T21:01:28.321276] [INFO ] [REMOTE ] SCHW: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:01:28.396192] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2024-12. [2025-09-29T21:01:28.395917] [INFO ] [REMOTE ] SCCO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:01:28.396485] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2024-12. [2025-09-29T21:01:28.493592] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-09-29T21:01:28.494436] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-04. [2025-09-29T21:01:28.708228] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-04 (0.21 seconds). [2025-09-29T21:01:28.709111] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-05. [2025-09-29T21:01:29.074311] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-29T21:01:29.075289] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-06. [2025-09-29T21:01:29.243147] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-29T21:01:29.245310] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-01. [2025-09-29T21:01:29.915820] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-29T21:01:29.919189] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-07. [2025-09-29T21:01:30.064353] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-29T21:01:30.067017] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-02. [2025-09-29T21:01:30.158909] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-29T21:01:30.409390] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-29T21:01:30.428083] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-29T21:01:30.748086] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-01. [2025-09-29T21:01:30.901203] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-29T21:01:31.548177] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-08. [2025-09-29T21:01:32.016463] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-29T21:01:32.355301] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-01. [2025-09-29T21:01:32.381894] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-29T21:01:33.148127] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-09. [2025-09-29T21:01:33.509735] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-29T21:01:33.510610] [INFO ] [REMOTE ] SBXD: Full fetch complete (3078 records). [2025-09-29T21:01:33.510711] [DEBUG] [VALIDATOR ] SBXD: Validating primary data. [2025-09-29T21:01:33.511097] [FATAL] [VALIDATOR ] SBXD: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T21:01:33.511188] [FATAL] [MAIN ] SBXD: Fetched primary data is invalid. Refusing to save it. [2025-09-29T21:01:33.511234] [WARN ] [MAIN ] SBXD: Deleting existing primary and derivative data due to validation failure. [2025-09-29T21:01:33.511317] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-09-29T21:01:33.511432] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-09-29T21:01:33.511479] [INFO ] [LOCAL ] SBXD: Starting deletion of derivative data. [2025-09-29T21:01:33.511556] [DEBUG] [LOCAL ] SBXD: No derivative data file found to delete. [2025-09-29T21:01:33.511637] [INFO ] [MAIN ] Update Progress: 1881/2371 symbols completed. SBXD took 8.3s. Estimated remaining: 1h 2m 55s. Rate: 7.8 symbols/min [2025-09-29T21:01:33.709243] [INFO ] [MAIN ] SCI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:01:33.784488] [DEBUG] [LOCAL ] SCI: Loaded 47257 existing records from primary storage. [2025-09-29T21:01:33.784889] [INFO ] [MAIN ] SCI: Loaded 47257 existing records. [2025-09-29T21:01:33.953248] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-02. [2025-09-29T21:01:33.998290] [WARN ] [MAIN ] SCI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:01:33.999418] [INFO ] [MAIN ] SCI: Wiping existing primary data before full refresh. [2025-09-29T21:01:33.999487] [INFO ] [LOCAL ] SCI: Starting deletion of primary data. [2025-09-29T21:01:33.999968] [DEBUG] [LOCAL ] SCI: Deleted primary data file. [2025-09-29T21:01:34.000029] [INFO ] [MAIN ] SCI: Starting full primary refresh. [2025-09-29T21:01:34.411037] [INFO ] [REMOTE ] SCI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:01:34.445546] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-29T21:01:34.748156] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-02. [2025-09-29T21:01:35.548131] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-03. [2025-09-29T21:01:35.850223] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-29T21:01:36.118724] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-29T21:01:36.310041] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-29T21:01:36.348082] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-03. [2025-09-29T21:01:37.148137] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-03. [2025-09-29T21:01:37.948076] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-04. [2025-09-29T21:01:38.272971] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-29T21:01:38.748090] [INFO ] [REMOTE ] SCI: Fetching primary data for 2024-12. [2025-09-29T21:01:38.834594] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-29T21:01:39.092140] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-29T21:01:39.548135] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-05. [2025-09-29T21:01:40.353298] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-04. [2025-09-29T21:01:40.380093] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-29T21:01:40.379819] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-29T21:01:41.148232] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-01. [2025-09-29T21:01:41.948149] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-04. [2025-09-29T21:01:42.372158] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-29T21:01:42.733789] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-29T21:01:42.748075] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-05. [2025-09-29T21:01:43.548146] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-06. [2025-09-29T21:01:44.097757] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-29T21:01:44.348105] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-05. [2025-09-29T21:01:44.615152] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-29T21:01:44.638108] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-29T21:01:45.148156] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-06. [2025-09-29T21:01:45.948132] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-07. [2025-09-29T21:01:46.367511] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-29T21:01:46.748126] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-02. [2025-09-29T21:01:46.968904] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-29T21:01:47.126424] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-29T21:01:47.548155] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-06. [2025-09-29T21:01:48.348088] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-07. [2025-09-29T21:01:48.497699] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-29T21:01:49.148097] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-03. [2025-09-29T21:01:49.475466] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-29T21:01:49.948154] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-08. [2025-09-29T21:01:50.330775] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-29T21:01:50.748178] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-07. [2025-09-29T21:01:50.975396] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-29T21:01:51.015314] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-29T21:01:51.548137] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-08. [2025-09-29T21:01:52.348106] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-04. [2025-09-29T21:01:52.967103] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-29T21:01:53.148154] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-08. [2025-09-29T21:01:53.382099] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-29T21:01:53.948101] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-09. [2025-09-29T21:01:54.353304] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-29T21:01:54.748089] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-09. [2025-09-29T21:01:54.872608] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-29T21:01:55.413848] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-29T21:01:55.425164] [INFO ] [REMOTE ] SCCO: Full fetch complete (70847 records). [2025-09-29T21:01:55.425330] [DEBUG] [VALIDATOR ] SCCO: Validating primary data. [2025-09-29T21:01:55.553207] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-09. [2025-09-29T21:01:55.794450] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-29T21:01:55.839712] [INFO ] [REMOTE ] SCD: Full fetch complete (16355 records). [2025-09-29T21:01:55.859032] [DEBUG] [VALIDATOR ] SCCO: All expected trading days are present. [2025-09-29T21:01:55.859134] [DEBUG] [VALIDATOR ] SCCO: Primary data validation passed. [2025-09-29T21:01:55.859227] [DEBUG] [VALIDATOR ] SCD: Validating primary data. [2025-09-29T21:01:55.860595] [INFO ] [MAIN ] SCCO: Fetched primary data is valid. [2025-09-29T21:01:55.860979] [DEBUG] [LOCAL ] SCCO: Saving primary data. [2025-09-29T21:01:55.978474] [DEBUG] [LOCAL ] SCCO: Trimmed 70847 records to 49404 (keeping 200 days of data) [2025-09-29T21:01:56.360960] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-05. [2025-09-29T21:01:56.408526] [DEBUG] [VALIDATOR ] SCD: All expected trading days are present. [2025-09-29T21:01:56.408956] [DEBUG] [VALIDATOR ] SCD: Primary data validation passed. [2025-09-29T21:01:56.409670] [INFO ] [MAIN ] SCD: Fetched primary data is valid. [2025-09-29T21:01:56.410066] [DEBUG] [LOCAL ] SCD: Saving primary data. [2025-09-29T21:01:56.412758] [DEBUG] [LOCAL ] SCD: Trimmed 16355 records to 12679 (keeping 200 days of data) [2025-09-29T21:01:56.639101] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-29T21:01:56.657716] [INFO ] [REMOTE ] SCHW: Full fetch complete (77703 records). [2025-09-29T21:01:56.658837] [DEBUG] [VALIDATOR ] SCHW: Validating primary data. [2025-09-29T21:01:56.777864] [DEBUG] [LOCAL ] SCD: Primary data saved (12679 records). [2025-09-29T21:01:56.804326] [INFO ] [MAIN ] SCD: Full history saved. [2025-09-29T21:01:56.824888] [INFO ] [MAIN ] Update Progress: 1882/2371 symbols completed. SCD took 31.6s. Estimated remaining: 1h 2m 51s. Rate: 7.8 symbols/min [2025-09-29T21:01:57.256303] [INFO ] [MAIN ] SCL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:01:57.332343] [DEBUG] [VALIDATOR ] SCHW: All expected trading days are present. [2025-09-29T21:01:57.332615] [DEBUG] [VALIDATOR ] SCHW: Primary data validation passed. [2025-09-29T21:01:57.334108] [INFO ] [MAIN ] SCHW: Fetched primary data is valid. [2025-09-29T21:01:57.334760] [DEBUG] [LOCAL ] SCHW: Saving primary data. [2025-09-29T21:01:57.387438] [DEBUG] [LOCAL ] SCHW: Trimmed 77703 records to 53685 (keeping 200 days of data) [2025-09-29T21:01:57.394679] [DEBUG] [LOCAL ] SCL: Loaded 15113 existing records from primary storage. [2025-09-29T21:01:57.395604] [INFO ] [MAIN ] SCL: Loaded 15113 existing records. [2025-09-29T21:01:57.704706] [WARN ] [MAIN ] SCL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:01:57.705715] [INFO ] [MAIN ] SCL: Wiping existing primary data before full refresh. [2025-09-29T21:01:57.706060] [INFO ] [LOCAL ] SCL: Starting deletion of primary data. [2025-09-29T21:01:57.708445] [DEBUG] [LOCAL ] SCL: Deleted primary data file. [2025-09-29T21:01:57.709111] [INFO ] [MAIN ] SCL: Starting full primary refresh. [2025-09-29T21:01:57.790924] [DEBUG] [LOCAL ] SCCO: Primary data saved (49404 records). [2025-09-29T21:01:57.809131] [INFO ] [MAIN ] SCCO: Full history saved. [2025-09-29T21:01:57.820634] [INFO ] [MAIN ] Update Progress: 1883/2371 symbols completed. SCCO took 32.6s. Estimated remaining: 1h 2m 42s. Rate: 7.8 symbols/min [2025-09-29T21:01:58.188182] [INFO ] [MAIN ] SCM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:01:58.330154] [INFO ] [REMOTE ] SCL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:01:58.331614] [INFO ] [REMOTE ] SCL: Fetching primary data for 2024-12. [2025-09-29T21:01:58.371626] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-29T21:01:58.392839] [DEBUG] [LOCAL ] SCM: Loaded 20163 existing records from primary storage. [2025-09-29T21:01:58.394540] [INFO ] [MAIN ] SCM: Loaded 20163 existing records. [2025-09-29T21:01:58.394392] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-06. [2025-09-29T21:01:58.691459] [WARN ] [MAIN ] SCM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:01:58.692220] [INFO ] [MAIN ] SCM: Wiping existing primary data before full refresh. [2025-09-29T21:01:58.692580] [INFO ] [LOCAL ] SCM: Starting deletion of primary data. [2025-09-29T21:01:58.693143] [DEBUG] [LOCAL ] SCM: Deleted primary data file. [2025-09-29T21:01:58.693203] [INFO ] [MAIN ] SCM: Starting full primary refresh. [2025-09-29T21:01:59.096773] [INFO ] [REMOTE ] SCM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:01:59.097964] [INFO ] [REMOTE ] SCM: Fetching primary data for 2024-12. [2025-09-29T21:01:59.220042] [DEBUG] [LOCAL ] SCHW: Primary data saved (53685 records). [2025-09-29T21:01:59.220189] [INFO ] [MAIN ] SCHW: Full history saved. [2025-09-29T21:01:59.222816] [INFO ] [MAIN ] Update Progress: 1884/2371 symbols completed. SCHW took 34.0s. Estimated remaining: 1h 2m 32s. Rate: 7.8 symbols/min [2025-09-29T21:01:59.364198] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-29T21:01:59.424620] [INFO ] [MAIN ] SCS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:01:59.468784] [DEBUG] [LOCAL ] SCS: Loaded 43834 existing records from primary storage. [2025-09-29T21:01:59.469161] [INFO ] [MAIN ] SCS: Loaded 43834 existing records. [2025-09-29T21:01:59.559969] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-01. [2025-09-29T21:01:59.659546] [WARN ] [MAIN ] SCS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:01:59.659840] [INFO ] [MAIN ] SCS: Wiping existing primary data before full refresh. [2025-09-29T21:01:59.659893] [INFO ] [LOCAL ] SCS: Starting deletion of primary data. [2025-09-29T21:01:59.660231] [DEBUG] [LOCAL ] SCS: Deleted primary data file. [2025-09-29T21:01:59.660301] [INFO ] [MAIN ] SCS: Starting full primary refresh. [2025-09-29T21:02:00.048064] [INFO ] [REMOTE ] SCS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:02:00.265404] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-29T21:02:00.338237] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-29T21:02:00.348057] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-01. [2025-09-29T21:02:00.796759] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-29T21:02:01.148118] [INFO ] [REMOTE ] SCS: Fetching primary data for 2024-12. [2025-09-29T21:02:01.332490] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-29T21:02:01.948120] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-02. [2025-09-29T21:02:02.733972] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-29T21:02:02.749924] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-07. [2025-09-29T21:02:02.754163] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-29T21:02:03.548120] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-01. [2025-09-29T21:02:04.348125] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-02. [2025-09-29T21:02:04.732600] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-29T21:02:05.025149] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-29T21:02:05.104993] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-29T21:02:05.148081] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-02. [2025-09-29T21:02:05.948130] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-03. [2025-09-29T21:02:06.640744] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-29T21:02:06.748108] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-03. [2025-09-29T21:02:07.217724] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-29T21:02:07.548117] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-03. [2025-09-29T21:02:08.348113] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-08. [2025-09-29T21:02:08.460875] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-29T21:02:08.482537] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-29T21:02:09.148124] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-04. [2025-09-29T21:02:09.948121] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-04. [2025-09-29T21:02:10.185874] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-29T21:02:10.396159] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-29T21:02:10.748122] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-05. [2025-09-29T21:02:11.349994] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-29T21:02:11.548129] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-09. [2025-09-29T21:02:11.866468] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-29T21:02:12.348099] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-04. [2025-09-29T21:02:13.148093] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-06. [2025-09-29T21:02:13.228434] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-29T21:02:13.238400] [INFO ] [REMOTE ] SCI: Full fetch complete (67191 records). [2025-09-29T21:02:13.238598] [DEBUG] [VALIDATOR ] SCI: Validating primary data. [2025-09-29T21:02:13.697232] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-29T21:02:13.714790] [DEBUG] [VALIDATOR ] SCI: All expected trading days are present. [2025-09-29T21:02:13.714932] [DEBUG] [VALIDATOR ] SCI: Primary data validation passed. [2025-09-29T21:02:13.720787] [INFO ] [MAIN ] SCI: Fetched primary data is valid. [2025-09-29T21:02:13.721342] [DEBUG] [LOCAL ] SCI: Saving primary data. [2025-09-29T21:02:13.723549] [DEBUG] [LOCAL ] SCI: Trimmed 67191 records to 46497 (keeping 200 days of data) [2025-09-29T21:02:13.964825] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-05. [2025-09-29T21:02:14.051113] [DEBUG] [LOCAL ] SCI: Primary data saved (46497 records). [2025-09-29T21:02:14.051265] [INFO ] [MAIN ] SCI: Full history saved. [2025-09-29T21:02:14.051369] [INFO ] [MAIN ] Update Progress: 1885/2371 symbols completed. SCI took 40.5s. Estimated remaining: 1h 2m 26s. Rate: 7.8 symbols/min [2025-09-29T21:02:14.237681] [INFO ] [MAIN ] SD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:02:14.249350] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-29T21:02:14.283598] [DEBUG] [LOCAL ] SD: Loaded 29368 existing records from primary storage. [2025-09-29T21:02:14.283968] [INFO ] [MAIN ] SD: Loaded 29368 existing records. [2025-09-29T21:02:14.473515] [WARN ] [MAIN ] SD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:02:14.473777] [INFO ] [MAIN ] SD: Wiping existing primary data before full refresh. [2025-09-29T21:02:14.473834] [INFO ] [LOCAL ] SD: Starting deletion of primary data. [2025-09-29T21:02:14.474087] [DEBUG] [LOCAL ] SD: Deleted primary data file. [2025-09-29T21:02:14.474149] [INFO ] [MAIN ] SD: Starting full primary refresh. [2025-09-29T21:02:14.753472] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-05. [2025-09-29T21:02:14.859988] [INFO ] [REMOTE ] SD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:02:15.548102] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-07. [2025-09-29T21:02:15.574388] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-29T21:02:15.909002] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-29T21:02:16.348099] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-06. [2025-09-29T21:02:16.591049] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-29T21:02:17.148167] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-08. [2025-09-29T21:02:17.206482] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-29T21:02:17.948078] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-07. [2025-09-29T21:02:18.324890] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-29T21:02:18.748124] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-09. [2025-09-29T21:02:19.059004] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-29T21:02:19.548154] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-06. [2025-09-29T21:02:19.952750] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-29T21:02:19.958357] [INFO ] [REMOTE ] SCM: Full fetch complete (28516 records). [2025-09-29T21:02:19.958506] [DEBUG] [VALIDATOR ] SCM: Validating primary data. [2025-09-29T21:02:20.343359] [DEBUG] [VALIDATOR ] SCM: All expected trading days are present. [2025-09-29T21:02:20.343442] [DEBUG] [VALIDATOR ] SCM: Primary data validation passed. [2025-09-29T21:02:20.344054] [INFO ] [MAIN ] SCM: Fetched primary data is valid. [2025-09-29T21:02:20.344121] [DEBUG] [LOCAL ] SCM: Saving primary data. [2025-09-29T21:02:20.344982] [DEBUG] [LOCAL ] SCM: Trimmed 28516 records to 19770 (keeping 200 days of data) [2025-09-29T21:02:20.397177] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-08. [2025-09-29T21:02:20.484929] [DEBUG] [LOCAL ] SCM: Primary data saved (19770 records). [2025-09-29T21:02:20.485194] [INFO ] [MAIN ] SCM: Full history saved. [2025-09-29T21:02:20.485345] [INFO ] [MAIN ] Update Progress: 1886/2371 symbols completed. SCM took 22.7s. Estimated remaining: 1h 2m 18s. Rate: 7.8 symbols/min [2025-09-29T21:02:20.672963] [INFO ] [MAIN ] SDHC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:02:20.687719] [DEBUG] [LOCAL ] SDHC: Loaded 10686 existing records from primary storage. [2025-09-29T21:02:20.687970] [INFO ] [MAIN ] SDHC: Loaded 10686 existing records. [2025-09-29T21:02:20.883145] [WARN ] [MAIN ] SDHC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:02:20.883356] [INFO ] [MAIN ] SDHC: Wiping existing primary data before full refresh. [2025-09-29T21:02:20.883404] [INFO ] [LOCAL ] SDHC: Starting deletion of primary data. [2025-09-29T21:02:20.883599] [DEBUG] [LOCAL ] SDHC: Deleted primary data file. [2025-09-29T21:02:20.883700] [INFO ] [MAIN ] SDHC: Starting full primary refresh. [2025-09-29T21:02:21.149363] [INFO ] [REMOTE ] SD: Fetching primary data for 2024-12. [2025-09-29T21:02:21.285469] [INFO ] [REMOTE ] SDHC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:02:21.310588] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-29T21:02:21.596021] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-29T21:02:21.948157] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2024-12. [2025-09-29T21:02:22.597576] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-29T21:02:22.748171] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-01. [2025-09-29T21:02:22.994698] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-29T21:02:23.548180] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-07. [2025-09-29T21:02:23.977112] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-29T21:02:24.348106] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-02. [2025-09-29T21:02:24.953515] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-29T21:02:25.148148] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-08. [2025-09-29T21:02:25.175112] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-29T21:02:25.948128] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-09. [2025-09-29T21:02:26.748214] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-03. [2025-09-29T21:02:26.926216] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-29T21:02:27.038530] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-29T21:02:27.043097] [INFO ] [REMOTE ] SCL: Full fetch complete (21187 records). [2025-09-29T21:02:27.043217] [DEBUG] [VALIDATOR ] SCL: Validating primary data. [2025-09-29T21:02:27.466064] [DEBUG] [VALIDATOR ] SCL: All expected trading days are present. [2025-09-29T21:02:27.466156] [DEBUG] [VALIDATOR ] SCL: Primary data validation passed. [2025-09-29T21:02:27.466701] [INFO ] [MAIN ] SCL: Fetched primary data is valid. [2025-09-29T21:02:27.466811] [DEBUG] [LOCAL ] SCL: Saving primary data. [2025-09-29T21:02:27.467531] [DEBUG] [LOCAL ] SCL: Trimmed 21187 records to 14886 (keeping 200 days of data) [2025-09-29T21:02:27.548390] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-09. [2025-09-29T21:02:27.580540] [DEBUG] [LOCAL ] SCL: Primary data saved (14886 records). [2025-09-29T21:02:27.580755] [INFO ] [MAIN ] SCL: Full history saved. [2025-09-29T21:02:27.580873] [INFO ] [MAIN ] Update Progress: 1887/2371 symbols completed. SCL took 30.7s. Estimated remaining: 1h 2m 11s. Rate: 7.8 symbols/min [2025-09-29T21:02:27.759802] [INFO ] [MAIN ] SDHY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:02:27.773126] [DEBUG] [LOCAL ] SDHY: Loaded 10710 existing records from primary storage. [2025-09-29T21:02:27.773409] [INFO ] [MAIN ] SDHY: Loaded 10710 existing records. [2025-09-29T21:02:27.964766] [WARN ] [MAIN ] SDHY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:02:27.965017] [INFO ] [MAIN ] SDHY: Wiping existing primary data before full refresh. [2025-09-29T21:02:27.965078] [INFO ] [LOCAL ] SDHY: Starting deletion of primary data. [2025-09-29T21:02:27.965300] [DEBUG] [LOCAL ] SDHY: Deleted primary data file. [2025-09-29T21:02:27.965363] [INFO ] [MAIN ] SDHY: Starting full primary refresh. [2025-09-29T21:02:28.365924] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-01. [2025-09-29T21:02:28.372013] [INFO ] [REMOTE ] SDHY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:02:28.394332] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-29T21:02:29.061744] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-29T21:02:29.148130] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2024-12. [2025-09-29T21:02:29.438628] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-29T21:02:29.453201] [INFO ] [REMOTE ] SCS: Full fetch complete (60418 records). [2025-09-29T21:02:29.453410] [DEBUG] [VALIDATOR ] SCS: Validating primary data. [2025-09-29T21:02:29.882737] [DEBUG] [VALIDATOR ] SCS: All expected trading days are present. [2025-09-29T21:02:29.882842] [DEBUG] [VALIDATOR ] SCS: Primary data validation passed. [2025-09-29T21:02:29.884023] [INFO ] [MAIN ] SCS: Fetched primary data is valid. [2025-09-29T21:02:29.884092] [DEBUG] [LOCAL ] SCS: Saving primary data. [2025-09-29T21:02:29.885488] [DEBUG] [LOCAL ] SCS: Trimmed 60418 records to 43337 (keeping 200 days of data) [2025-09-29T21:02:29.948811] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-02. [2025-09-29T21:02:30.201576] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-29T21:02:30.211951] [DEBUG] [LOCAL ] SCS: Primary data saved (43337 records). [2025-09-29T21:02:30.212110] [INFO ] [MAIN ] SCS: Full history saved. [2025-09-29T21:02:30.212204] [INFO ] [MAIN ] Update Progress: 1888/2371 symbols completed. SCS took 31.0s. Estimated remaining: 1h 2m 2s. Rate: 7.8 symbols/min [2025-09-29T21:02:30.403006] [INFO ] [MAIN ] SDRL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:02:30.449267] [DEBUG] [LOCAL ] SDRL: Loaded 42459 existing records from primary storage. [2025-09-29T21:02:30.449686] [INFO ] [MAIN ] SDRL: Loaded 42459 existing records. [2025-09-29T21:02:30.647901] [WARN ] [MAIN ] SDRL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:02:30.648142] [INFO ] [MAIN ] SDRL: Wiping existing primary data before full refresh. [2025-09-29T21:02:30.648196] [INFO ] [LOCAL ] SDRL: Starting deletion of primary data. [2025-09-29T21:02:30.648472] [DEBUG] [LOCAL ] SDRL: Deleted primary data file. [2025-09-29T21:02:30.648559] [INFO ] [MAIN ] SDRL: Starting full primary refresh. [2025-09-29T21:02:30.749017] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-01. [2025-09-29T21:02:30.880133] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-29T21:02:31.103280] [INFO ] [REMOTE ] SDRL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:02:31.548168] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-03. [2025-09-29T21:02:31.716264] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-29T21:02:32.348091] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-04. [2025-09-29T21:02:32.513100] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-29T21:02:33.148126] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-02. [2025-09-29T21:02:33.735223] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-29T21:02:33.948119] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-05. [2025-09-29T21:02:34.018807] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-29T21:02:34.748151] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-03. [2025-09-29T21:02:35.339920] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-29T21:02:35.548148] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2024-12. [2025-09-29T21:02:35.599156] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-29T21:02:36.348130] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-04. [2025-09-29T21:02:37.148124] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-04. [2025-09-29T21:02:37.166456] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-29T21:02:37.205163] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-29T21:02:37.948118] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-05. [2025-09-29T21:02:38.163106] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-29T21:02:38.608184] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-29T21:02:38.748112] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-01. [2025-09-29T21:02:39.548121] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-05. [2025-09-29T21:02:40.348161] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-06. [2025-09-29T21:02:40.375438] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-29T21:02:40.411866] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-29T21:02:41.148256] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-06. [2025-09-29T21:02:41.229482] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-29T21:02:41.948145] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-02. [2025-09-29T21:02:42.074835] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-29T21:02:42.748163] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-07. [2025-09-29T21:02:43.548162] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-06. [2025-09-29T21:02:43.598570] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-29T21:02:43.714059] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-29T21:02:44.348161] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-03. [2025-09-29T21:02:44.918393] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-29T21:02:45.148145] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-08. [2025-09-29T21:02:45.948275] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-07. [2025-09-29T21:02:46.006769] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-29T21:02:46.075166] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-29T21:02:46.748126] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-04. [2025-09-29T21:02:46.966036] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-29T21:02:47.548167] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-08. [2025-09-29T21:02:48.348129] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-07. [2025-09-29T21:02:48.378062] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-29T21:02:49.148141] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-09. [2025-09-29T21:02:49.302035] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-09-29T21:02:49.661263] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-29T21:02:49.948140] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-05. [2025-09-29T21:02:49.989622] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-29T21:02:49.992749] [INFO ] [REMOTE ] SDHY: Full fetch complete (15900 records). [2025-09-29T21:02:49.992830] [DEBUG] [VALIDATOR ] SDHY: Validating primary data. [2025-09-29T21:02:50.379712] [DEBUG] [VALIDATOR ] SDHY: All expected trading days are present. [2025-09-29T21:02:50.379803] [DEBUG] [VALIDATOR ] SDHY: Primary data validation passed. [2025-09-29T21:02:50.380158] [INFO ] [MAIN ] SDHY: Fetched primary data is valid. [2025-09-29T21:02:50.380233] [DEBUG] [LOCAL ] SDHY: Saving primary data. [2025-09-29T21:02:50.380844] [DEBUG] [LOCAL ] SDHY: Trimmed 15900 records to 10460 (keeping 200 days of data) [2025-09-29T21:02:50.449712] [DEBUG] [LOCAL ] SDHY: Primary data saved (10460 records). [2025-09-29T21:02:50.449857] [INFO ] [MAIN ] SDHY: Full history saved. [2025-09-29T21:02:50.449962] [INFO ] [MAIN ] Update Progress: 1889/2371 symbols completed. SDHY took 22.9s. Estimated remaining: 1h 1m 57s. Rate: 7.8 symbols/min [2025-09-29T21:02:50.655146] [INFO ] [MAIN ] SE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:02:50.719039] [DEBUG] [LOCAL ] SE: Loaded 54140 existing records from primary storage. [2025-09-29T21:02:50.719406] [INFO ] [MAIN ] SE: Loaded 54140 existing records. [2025-09-29T21:02:50.753226] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-08. [2025-09-29T21:02:50.936892] [WARN ] [MAIN ] SE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:02:50.937200] [INFO ] [MAIN ] SE: Wiping existing primary data before full refresh. [2025-09-29T21:02:50.937254] [INFO ] [LOCAL ] SE: Starting deletion of primary data. [2025-09-29T21:02:50.937567] [DEBUG] [LOCAL ] SE: Deleted primary data file. [2025-09-29T21:02:50.937627] [INFO ] [MAIN ] SE: Starting full primary refresh. [2025-09-29T21:02:51.351824] [INFO ] [REMOTE ] SE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:02:51.375842] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-29T21:02:51.548148] [INFO ] [REMOTE ] SE: Fetching primary data for 2024-12. [2025-09-29T21:02:52.163635] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-29T21:02:52.348158] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-09. [2025-09-29T21:02:53.000788] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-29T21:02:53.003845] [INFO ] [REMOTE ] SDHC: Full fetch complete (17177 records). [2025-09-29T21:02:53.003922] [DEBUG] [VALIDATOR ] SDHC: Validating primary data. [2025-09-29T21:02:53.152502] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-06. [2025-09-29T21:02:53.407789] [DEBUG] [VALIDATOR ] SDHC: All expected trading days are present. [2025-09-29T21:02:53.407896] [DEBUG] [VALIDATOR ] SDHC: Primary data validation passed. [2025-09-29T21:02:53.408391] [INFO ] [MAIN ] SDHC: Fetched primary data is valid. [2025-09-29T21:02:53.408472] [DEBUG] [LOCAL ] SDHC: Saving primary data. [2025-09-29T21:02:53.409353] [DEBUG] [LOCAL ] SDHC: Trimmed 17177 records to 10477 (keeping 200 days of data) [2025-09-29T21:02:53.500096] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-29T21:02:53.530922] [DEBUG] [LOCAL ] SDHC: Primary data saved (10477 records). [2025-09-29T21:02:53.531083] [INFO ] [MAIN ] SDHC: Full history saved. [2025-09-29T21:02:53.531175] [INFO ] [MAIN ] Update Progress: 1890/2371 symbols completed. SDHC took 33.0s. Estimated remaining: 1h 1m 48s. Rate: 7.8 symbols/min [2025-09-29T21:02:53.771523] [INFO ] [MAIN ] SEE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:02:53.825892] [DEBUG] [LOCAL ] SEE: Loaded 49069 existing records from primary storage. [2025-09-29T21:02:53.826266] [INFO ] [MAIN ] SEE: Loaded 49069 existing records. [2025-09-29T21:02:53.953280] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-01. [2025-09-29T21:02:54.021006] [WARN ] [MAIN ] SEE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:02:54.021405] [INFO ] [MAIN ] SEE: Wiping existing primary data before full refresh. [2025-09-29T21:02:54.021456] [INFO ] [LOCAL ] SEE: Starting deletion of primary data. [2025-09-29T21:02:54.021944] [DEBUG] [LOCAL ] SEE: Deleted primary data file. [2025-09-29T21:02:54.022005] [INFO ] [MAIN ] SEE: Starting full primary refresh. [2025-09-29T21:02:54.396780] [INFO ] [REMOTE ] SEE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:02:54.748154] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-09. [2025-09-29T21:02:54.900896] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-29T21:02:55.548161] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-07. [2025-09-29T21:02:56.021868] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-29T21:02:56.030447] [INFO ] [REMOTE ] SD: Full fetch complete (40987 records). [2025-09-29T21:02:56.046310] [DEBUG] [VALIDATOR ] SD: Validating primary data. [2025-09-29T21:02:56.061883] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-29T21:02:56.355006] [INFO ] [REMOTE ] SEE: Fetching primary data for 2024-12. [2025-09-29T21:02:56.479966] [DEBUG] [VALIDATOR ] SD: All expected trading days are present. [2025-09-29T21:02:56.480051] [DEBUG] [VALIDATOR ] SD: Primary data validation passed. [2025-09-29T21:02:56.480909] [INFO ] [MAIN ] SD: Fetched primary data is valid. [2025-09-29T21:02:56.480974] [DEBUG] [LOCAL ] SD: Saving primary data. [2025-09-29T21:02:56.481927] [DEBUG] [LOCAL ] SD: Trimmed 40987 records to 28722 (keeping 200 days of data) [2025-09-29T21:02:56.661632] [DEBUG] [LOCAL ] SD: Primary data saved (28722 records). [2025-09-29T21:02:56.661797] [INFO ] [MAIN ] SD: Full history saved. [2025-09-29T21:02:56.661891] [INFO ] [MAIN ] Update Progress: 1891/2371 symbols completed. SD took 42.6s. Estimated remaining: 1h 1m 39s. Rate: 7.8 symbols/min [2025-09-29T21:02:56.833897] [INFO ] [MAIN ] SEG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:02:56.849521] [DEBUG] [LOCAL ] SEG: Loaded 13887 existing records from primary storage. [2025-09-29T21:02:56.849806] [INFO ] [MAIN ] SEG: Loaded 13887 existing records. [2025-09-29T21:02:57.035292] [WARN ] [MAIN ] SEG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:02:57.035765] [INFO ] [MAIN ] SEG: Wiping existing primary data before full refresh. [2025-09-29T21:02:57.035833] [INFO ] [LOCAL ] SEG: Starting deletion of primary data. [2025-09-29T21:02:57.036026] [DEBUG] [LOCAL ] SEG: Deleted primary data file. [2025-09-29T21:02:57.036085] [INFO ] [MAIN ] SEG: Starting full primary refresh. [2025-09-29T21:02:57.149058] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-02. [2025-09-29T21:02:57.420561] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-29T21:02:57.441081] [INFO ] [REMOTE ] SEG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:02:57.682468] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-29T21:02:57.948114] [INFO ] [REMOTE ] SEG: Fetching primary data for 2024-12. [2025-09-29T21:02:58.748163] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-08. [2025-09-29T21:02:58.759293] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-29T21:02:59.548108] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-01. [2025-09-29T21:02:59.582635] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-09-29T21:03:00.348145] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-03. [2025-09-29T21:03:00.523181] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-29T21:03:01.148139] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-01. [2025-09-29T21:03:01.362985] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-29T21:03:01.948139] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-09. [2025-09-29T21:03:02.130453] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-29T21:03:02.341544] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-29T21:03:02.748125] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-02. [2025-09-29T21:03:03.407615] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-29T21:03:03.416595] [INFO ] [REMOTE ] SDRL: Full fetch complete (61727 records). [2025-09-29T21:03:03.416843] [DEBUG] [VALIDATOR ] SDRL: Validating primary data. [2025-09-29T21:03:03.553193] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-04. [2025-09-29T21:03:03.847791] [DEBUG] [VALIDATOR ] SDRL: All expected trading days are present. [2025-09-29T21:03:03.847899] [DEBUG] [VALIDATOR ] SDRL: Primary data validation passed. [2025-09-29T21:03:03.857952] [INFO ] [MAIN ] SDRL: Fetched primary data is valid. [2025-09-29T21:03:03.858608] [DEBUG] [LOCAL ] SDRL: Saving primary data. [2025-09-29T21:03:03.859202] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-29T21:03:03.864237] [DEBUG] [LOCAL ] SDRL: Trimmed 61727 records to 41692 (keeping 200 days of data) [2025-09-29T21:03:04.127884] [DEBUG] [LOCAL ] SDRL: Primary data saved (41692 records). [2025-09-29T21:03:04.128043] [INFO ] [MAIN ] SDRL: Full history saved. [2025-09-29T21:03:04.128166] [INFO ] [MAIN ] Update Progress: 1892/2371 symbols completed. SDRL took 33.9s. Estimated remaining: 1h 1m 32s. Rate: 7.8 symbols/min [2025-09-29T21:03:04.305632] [INFO ] [MAIN ] SEI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:03:04.353457] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-03. [2025-09-29T21:03:04.356361] [DEBUG] [LOCAL ] SEI: Loaded 50411 existing records from primary storage. [2025-09-29T21:03:04.356682] [INFO ] [MAIN ] SEI: Loaded 50411 existing records. [2025-09-29T21:03:04.550432] [WARN ] [MAIN ] SEI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:03:04.550881] [INFO ] [MAIN ] SEI: Wiping existing primary data before full refresh. [2025-09-29T21:03:04.550974] [INFO ] [LOCAL ] SEI: Starting deletion of primary data. [2025-09-29T21:03:04.551358] [DEBUG] [LOCAL ] SEI: Deleted primary data file. [2025-09-29T21:03:04.551473] [INFO ] [MAIN ] SEI: Starting full primary refresh. [2025-09-29T21:03:04.966141] [INFO ] [REMOTE ] SEI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:03:05.148131] [INFO ] [REMOTE ] SEI: Fetching primary data for 2024-12. [2025-09-29T21:03:05.589756] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-29T21:03:05.886922] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-29T21:03:05.948082] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-05. [2025-09-29T21:03:06.748103] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-04. [2025-09-29T21:03:06.797518] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-29T21:03:07.548132] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-01. [2025-09-29T21:03:07.759562] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-29T21:03:08.337086] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-09-29T21:03:08.348453] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-05. [2025-09-29T21:03:08.925545] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-29T21:03:09.148089] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-02. [2025-09-29T21:03:09.276336] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-29T21:03:09.948111] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-06. [2025-09-29T21:03:10.748129] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-06. [2025-09-29T21:03:10.810134] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-29T21:03:10.886584] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-29T21:03:11.548160] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-07. [2025-09-29T21:03:12.348137] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-03. [2025-09-29T21:03:12.447891] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-29T21:03:12.881017] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-29T21:03:13.148153] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-07. [2025-09-29T21:03:13.948098] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-08. [2025-09-29T21:03:14.256293] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-29T21:03:14.634933] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-29T21:03:14.748105] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-02. [2025-09-29T21:03:15.186613] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-29T21:03:15.548124] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-08. [2025-09-29T21:03:16.348096] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-04. [2025-09-29T21:03:16.461354] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-29T21:03:17.148149] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-09. [2025-09-29T21:03:17.819337] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-29T21:03:17.948121] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-03. [2025-09-29T21:03:18.005427] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-29T21:03:18.008424] [INFO ] [REMOTE ] SEG: Full fetch complete (19801 records). [2025-09-29T21:03:18.008574] [DEBUG] [VALIDATOR ] SEG: Validating primary data. [2025-09-29T21:03:18.438323] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-29T21:03:18.525100] [DEBUG] [VALIDATOR ] SEG: All expected trading days are present. [2025-09-29T21:03:18.525217] [DEBUG] [VALIDATOR ] SEG: Primary data validation passed. [2025-09-29T21:03:18.525931] [INFO ] [MAIN ] SEG: Fetched primary data is valid. [2025-09-29T21:03:18.526021] [DEBUG] [LOCAL ] SEG: Saving primary data. [2025-09-29T21:03:18.526924] [DEBUG] [LOCAL ] SEG: Trimmed 19801 records to 13602 (keeping 200 days of data) [2025-09-29T21:03:18.629771] [DEBUG] [LOCAL ] SEG: Primary data saved (13602 records). [2025-09-29T21:03:18.629960] [INFO ] [MAIN ] SEG: Full history saved. [2025-09-29T21:03:18.630118] [INFO ] [MAIN ] Update Progress: 1893/2371 symbols completed. SEG took 22.0s. Estimated remaining: 1h 1m 26s. Rate: 7.8 symbols/min [2025-09-29T21:03:18.753333] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-09. [2025-09-29T21:03:18.849396] [INFO ] [MAIN ] SEM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:03:18.904518] [DEBUG] [LOCAL ] SEM: Loaded 43533 existing records from primary storage. [2025-09-29T21:03:18.904963] [INFO ] [MAIN ] SEM: Loaded 43533 existing records. [2025-09-29T21:03:19.160841] [WARN ] [MAIN ] SEM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:03:19.161193] [INFO ] [MAIN ] SEM: Wiping existing primary data before full refresh. [2025-09-29T21:03:19.161270] [INFO ] [LOCAL ] SEM: Starting deletion of primary data. [2025-09-29T21:03:19.161769] [DEBUG] [LOCAL ] SEM: Deleted primary data file. [2025-09-29T21:03:19.161849] [INFO ] [MAIN ] SEM: Starting full primary refresh. [2025-09-29T21:03:19.553473] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-05. [2025-09-29T21:03:19.778948] [INFO ] [REMOTE ] SEM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:03:19.854323] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-29T21:03:19.867943] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-29T21:03:19.868226] [INFO ] [REMOTE ] SE: Full fetch complete (76682 records). [2025-09-29T21:03:19.879748] [DEBUG] [VALIDATOR ] SE: Validating primary data. [2025-09-29T21:03:19.881421] [FATAL] [VALIDATOR ] SE: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T21:03:19.881577] [FATAL] [MAIN ] SE: Fetched primary data is invalid. Refusing to save it. [2025-09-29T21:03:19.881624] [WARN ] [MAIN ] SE: Deleting existing primary and derivative data due to validation failure. [2025-09-29T21:03:19.881709] [INFO ] [LOCAL ] SE: Starting deletion of primary data. [2025-09-29T21:03:19.881796] [DEBUG] [LOCAL ] SE: No primary data file found to delete. [2025-09-29T21:03:19.881848] [INFO ] [LOCAL ] SE: Starting deletion of derivative data. [2025-09-29T21:03:19.882581] [DEBUG] [LOCAL ] SE: Deleted derivative data file. [2025-09-29T21:03:19.882759] [INFO ] [MAIN ] Update Progress: 1894/2371 symbols completed. SE took 29.4s. Estimated remaining: 1h 1m 16s. Rate: 7.8 symbols/min [2025-09-29T21:03:20.071828] [INFO ] [MAIN ] SEMR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:03:20.110526] [DEBUG] [LOCAL ] SEMR: Loaded 42184 existing records from primary storage. [2025-09-29T21:03:20.110878] [INFO ] [MAIN ] SEMR: Loaded 42184 existing records. [2025-09-29T21:03:20.307196] [WARN ] [MAIN ] SEMR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:03:20.307441] [INFO ] [MAIN ] SEMR: Wiping existing primary data before full refresh. [2025-09-29T21:03:20.307518] [INFO ] [LOCAL ] SEMR: Starting deletion of primary data. [2025-09-29T21:03:20.307803] [DEBUG] [LOCAL ] SEMR: Deleted primary data file. [2025-09-29T21:03:20.307879] [INFO ] [MAIN ] SEMR: Starting full primary refresh. [2025-09-29T21:03:20.353274] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-04. [2025-09-29T21:03:20.693053] [INFO ] [REMOTE ] SEMR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:03:21.021851] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-29T21:03:21.148165] [INFO ] [REMOTE ] SEM: Fetching primary data for 2024-12. [2025-09-29T21:03:21.948147] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2024-12. [2025-09-29T21:03:22.278560] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-29T21:03:22.690475] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-29T21:03:22.748177] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-01. [2025-09-29T21:03:23.362352] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-29T21:03:23.548156] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-06. [2025-09-29T21:03:23.962355] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-29T21:03:24.348118] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-01. [2025-09-29T21:03:25.148137] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-05. [2025-09-29T21:03:25.251557] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-29T21:03:25.953274] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-07. [2025-09-29T21:03:25.970764] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-29T21:03:26.748142] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-02. [2025-09-29T21:03:26.951829] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-29T21:03:27.548111] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-06. [2025-09-29T21:03:27.976787] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-29T21:03:28.139309] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-29T21:03:28.348126] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-08. [2025-09-29T21:03:28.951815] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-29T21:03:29.148119] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-07. [2025-09-29T21:03:29.948113] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-02. [2025-09-29T21:03:30.045121] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-29T21:03:30.748127] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-03. [2025-09-29T21:03:30.950831] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-29T21:03:31.520140] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-29T21:03:31.548085] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-08. [2025-09-29T21:03:32.089212] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-29T21:03:32.348151] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-03. [2025-09-29T21:03:32.971336] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-29T21:03:33.148149] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-09. [2025-09-29T21:03:33.948189] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-04. [2025-09-29T21:03:34.005366] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-29T21:03:34.542913] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-29T21:03:34.553327] [INFO ] [REMOTE ] SEE: Full fetch complete (69572 records). [2025-09-29T21:03:34.553479] [DEBUG] [VALIDATOR ] SEE: Validating primary data. [2025-09-29T21:03:34.751440] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-09. [2025-09-29T21:03:34.994076] [DEBUG] [VALIDATOR ] SEE: All expected trading days are present. [2025-09-29T21:03:34.994183] [DEBUG] [VALIDATOR ] SEE: Primary data validation passed. [2025-09-29T21:03:34.995474] [INFO ] [MAIN ] SEE: Fetched primary data is valid. [2025-09-29T21:03:34.995568] [DEBUG] [LOCAL ] SEE: Saving primary data. [2025-09-29T21:03:34.997236] [DEBUG] [LOCAL ] SEE: Trimmed 69572 records to 48292 (keeping 200 days of data) [2025-09-29T21:03:35.326578] [DEBUG] [LOCAL ] SEE: Primary data saved (48292 records). [2025-09-29T21:03:35.326752] [INFO ] [MAIN ] SEE: Full history saved. [2025-09-29T21:03:35.326871] [INFO ] [MAIN ] Update Progress: 1895/2371 symbols completed. SEE took 41.8s. Estimated remaining: 1h 1m 10s. Rate: 7.8 symbols/min [2025-09-29T21:03:35.527262] [INFO ] [MAIN ] SES: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:03:35.551259] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-04. [2025-09-29T21:03:35.552944] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-29T21:03:35.618575] [DEBUG] [LOCAL ] SES: Loaded 52331 existing records from primary storage. [2025-09-29T21:03:35.618997] [INFO ] [MAIN ] SES: Loaded 52331 existing records. [2025-09-29T21:03:35.823599] [WARN ] [MAIN ] SES: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:03:35.823852] [INFO ] [MAIN ] SES: Wiping existing primary data before full refresh. [2025-09-29T21:03:35.823946] [INFO ] [LOCAL ] SES: Starting deletion of primary data. [2025-09-29T21:03:35.824545] [DEBUG] [LOCAL ] SES: Deleted primary data file. [2025-09-29T21:03:35.824604] [INFO ] [MAIN ] SES: Starting full primary refresh. [2025-09-29T21:03:36.209132] [INFO ] [REMOTE ] SES: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:03:36.348099] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-05. [2025-09-29T21:03:36.896404] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-29T21:03:36.909476] [INFO ] [REMOTE ] SEI: Full fetch complete (69884 records). [2025-09-29T21:03:36.909631] [DEBUG] [VALIDATOR ] SEI: Validating primary data. [2025-09-29T21:03:37.153235] [INFO ] [REMOTE ] SES: Fetching primary data for 2024-12. [2025-09-29T21:03:37.258446] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-29T21:03:37.378751] [DEBUG] [VALIDATOR ] SEI: All expected trading days are present. [2025-09-29T21:03:37.378848] [DEBUG] [VALIDATOR ] SEI: Primary data validation passed. [2025-09-29T21:03:37.379952] [INFO ] [MAIN ] SEI: Fetched primary data is valid. [2025-09-29T21:03:37.380018] [DEBUG] [LOCAL ] SEI: Saving primary data. [2025-09-29T21:03:37.381506] [DEBUG] [LOCAL ] SEI: Trimmed 69884 records to 49639 (keeping 200 days of data) [2025-09-29T21:03:37.706937] [DEBUG] [LOCAL ] SEI: Primary data saved (49639 records). [2025-09-29T21:03:37.707112] [INFO ] [MAIN ] SEI: Full history saved. [2025-09-29T21:03:37.707216] [INFO ] [MAIN ] Update Progress: 1896/2371 symbols completed. SEI took 33.6s. Estimated remaining: 1h 1m 1s. Rate: 7.8 symbols/min [2025-09-29T21:03:37.928404] [INFO ] [MAIN ] SF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:03:37.930569] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-29T21:03:37.948064] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-06. [2025-09-29T21:03:37.995132] [DEBUG] [LOCAL ] SF: Loaded 42360 existing records from primary storage. [2025-09-29T21:03:37.995485] [INFO ] [MAIN ] SF: Loaded 42360 existing records. [2025-09-29T21:03:38.186999] [WARN ] [MAIN ] SF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:03:38.187342] [INFO ] [MAIN ] SF: Wiping existing primary data before full refresh. [2025-09-29T21:03:38.187397] [INFO ] [LOCAL ] SF: Starting deletion of primary data. [2025-09-29T21:03:38.187836] [DEBUG] [LOCAL ] SF: Deleted primary data file. [2025-09-29T21:03:38.187896] [INFO ] [MAIN ] SF: Starting full primary refresh. [2025-09-29T21:03:38.555926] [INFO ] [REMOTE ] SF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:03:38.748132] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-05. [2025-09-29T21:03:39.428736] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-09-29T21:03:39.526958] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-29T21:03:39.548073] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-07. [2025-09-29T21:03:40.348108] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-01. [2025-09-29T21:03:40.563241] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-29T21:03:40.900998] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-29T21:03:41.148127] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-06. [2025-09-29T21:03:41.948119] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-08. [2025-09-29T21:03:42.748089] [INFO ] [REMOTE ] SF: Fetching primary data for 2024-12. [2025-09-29T21:03:43.010745] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-29T21:03:43.054127] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-01 (2.71 seconds). [2025-09-29T21:03:43.548095] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-02. [2025-09-29T21:03:43.629113] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-29T21:03:44.099805] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-29T21:03:44.348144] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-07. [2025-09-29T21:03:45.148120] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-01. [2025-09-29T21:03:45.948111] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-09. [2025-09-29T21:03:46.020316] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-09-29T21:03:46.059670] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-29T21:03:46.344702] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-29T21:03:46.748118] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-08. [2025-09-29T21:03:47.306410] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-29T21:03:47.315740] [INFO ] [REMOTE ] SEMR: Full fetch complete (59051 records). [2025-09-29T21:03:47.315875] [DEBUG] [VALIDATOR ] SEMR: Validating primary data. [2025-09-29T21:03:47.554531] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-03. [2025-09-29T21:03:47.728461] [DEBUG] [VALIDATOR ] SEMR: All expected trading days are present. [2025-09-29T21:03:47.728546] [DEBUG] [VALIDATOR ] SEMR: Primary data validation passed. [2025-09-29T21:03:47.729630] [INFO ] [MAIN ] SEMR: Fetched primary data is valid. [2025-09-29T21:03:47.729717] [DEBUG] [LOCAL ] SEMR: Saving primary data. [2025-09-29T21:03:47.730944] [DEBUG] [LOCAL ] SEMR: Trimmed 59051 records to 41505 (keeping 200 days of data) [2025-09-29T21:03:47.985335] [DEBUG] [LOCAL ] SEMR: Primary data saved (41505 records). [2025-09-29T21:03:47.985466] [INFO ] [MAIN ] SEMR: Full history saved. [2025-09-29T21:03:47.985583] [INFO ] [MAIN ] Update Progress: 1897/2371 symbols completed. SEMR took 28.1s. Estimated remaining: 1h 0m 54s. Rate: 7.8 symbols/min [2025-09-29T21:03:48.163879] [INFO ] [MAIN ] SFB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:03:48.171721] [DEBUG] [LOCAL ] SFB: Loaded 4046 existing records from primary storage. [2025-09-29T21:03:48.171990] [INFO ] [MAIN ] SFB: Loaded 4046 existing records. [2025-09-29T21:03:48.349701] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-02. [2025-09-29T21:03:48.349502] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-29T21:03:48.404411] [WARN ] [MAIN ] SFB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:03:48.405727] [INFO ] [MAIN ] SFB: Wiping existing primary data before full refresh. [2025-09-29T21:03:48.405793] [INFO ] [LOCAL ] SFB: Starting deletion of primary data. [2025-09-29T21:03:48.406150] [DEBUG] [LOCAL ] SFB: Deleted primary data file. [2025-09-29T21:03:48.406214] [INFO ] [MAIN ] SFB: Starting full primary refresh. [2025-09-29T21:03:48.777940] [INFO ] [REMOTE ] SFB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:03:49.148121] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-09. [2025-09-29T21:03:49.926796] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-29T21:03:49.948087] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-03. [2025-09-29T21:03:50.323739] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-03 (2.77 seconds). [2025-09-29T21:03:50.656214] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-29T21:03:50.665479] [INFO ] [REMOTE ] SEM: Full fetch complete (61522 records). [2025-09-29T21:03:50.665664] [DEBUG] [VALIDATOR ] SEM: Validating primary data. [2025-09-29T21:03:50.753332] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-04. [2025-09-29T21:03:51.088079] [DEBUG] [VALIDATOR ] SEM: All expected trading days are present. [2025-09-29T21:03:51.088181] [DEBUG] [VALIDATOR ] SEM: Primary data validation passed. [2025-09-29T21:03:51.089544] [INFO ] [MAIN ] SEM: Fetched primary data is valid. [2025-09-29T21:03:51.089617] [DEBUG] [LOCAL ] SEM: Saving primary data. [2025-09-29T21:03:51.090996] [DEBUG] [LOCAL ] SEM: Trimmed 61522 records to 42796 (keeping 200 days of data) [2025-09-29T21:03:51.250231] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-29T21:03:51.420688] [DEBUG] [LOCAL ] SEM: Primary data saved (42796 records). [2025-09-29T21:03:51.420826] [INFO ] [MAIN ] SEM: Full history saved. [2025-09-29T21:03:51.420947] [INFO ] [MAIN ] Update Progress: 1898/2371 symbols completed. SEM took 32.8s. Estimated remaining: 1h 0m 46s. Rate: 7.8 symbols/min [2025-09-29T21:03:51.553241] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-04. [2025-09-29T21:03:51.604113] [INFO ] [MAIN ] SFBS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:03:51.629927] [DEBUG] [LOCAL ] SFBS: Loaded 21483 existing records from primary storage. [2025-09-29T21:03:51.630200] [INFO ] [MAIN ] SFBS: Loaded 21483 existing records. [2025-09-29T21:03:51.822191] [WARN ] [MAIN ] SFBS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:03:51.822429] [INFO ] [MAIN ] SFBS: Wiping existing primary data before full refresh. [2025-09-29T21:03:51.822485] [INFO ] [LOCAL ] SFBS: Starting deletion of primary data. [2025-09-29T21:03:51.822873] [DEBUG] [LOCAL ] SFBS: Deleted primary data file. [2025-09-29T21:03:51.822954] [INFO ] [MAIN ] SFBS: Starting full primary refresh. [2025-09-29T21:03:52.191928] [INFO ] [REMOTE ] SFBS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:03:52.348138] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2024-12. [2025-09-29T21:03:52.986405] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-29T21:03:53.138488] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-29T21:03:53.148063] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-01. [2025-09-29T21:03:53.572596] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-29T21:03:53.948122] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-05. [2025-09-29T21:03:54.667763] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-29T21:03:54.748125] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-05. [2025-09-29T21:03:55.327818] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-29T21:03:55.548182] [INFO ] [REMOTE ] SFB: Fetching primary data for 2024-12. [2025-09-29T21:03:56.255821] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-29T21:03:56.348123] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-02. [2025-09-29T21:03:57.148133] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-01. [2025-09-29T21:03:57.237996] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-09-29T21:03:57.536035] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-29T21:03:57.856518] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-29T21:03:57.948103] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-06. [2025-09-29T21:03:58.748116] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-06. [2025-09-29T21:03:59.548138] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-02. [2025-09-29T21:04:00.134075] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-29T21:04:00.197155] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-29T21:04:00.281951] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-29T21:04:00.348122] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-03. [2025-09-29T21:04:01.120357] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-29T21:04:01.148081] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-04. [2025-09-29T21:04:01.646401] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-29T21:04:01.948113] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-03. [2025-09-29T21:04:02.748139] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-05. [2025-09-29T21:04:03.166249] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-29T21:04:03.400908] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-29T21:04:03.548104] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-07. [2025-09-29T21:04:04.348117] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-06. [2025-09-29T21:04:04.991984] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-29T21:04:05.148121] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-07. [2025-09-29T21:04:05.227822] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-29T21:04:05.816991] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-29T21:04:05.948118] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-08. [2025-09-29T21:04:06.748112] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-04. [2025-09-29T21:04:07.534317] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-29T21:04:07.548057] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-09. [2025-09-29T21:04:07.827547] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-29T21:04:08.348112] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-05. [2025-09-29T21:04:09.024253] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-29T21:04:09.032758] [INFO ] [REMOTE ] SF: Full fetch complete (59697 records). [2025-09-29T21:04:09.032960] [DEBUG] [VALIDATOR ] SF: Validating primary data. [2025-09-29T21:04:09.153191] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-07. [2025-09-29T21:04:09.457876] [DEBUG] [VALIDATOR ] SF: All expected trading days are present. [2025-09-29T21:04:09.458033] [DEBUG] [VALIDATOR ] SF: Primary data validation passed. [2025-09-29T21:04:09.459064] [INFO ] [MAIN ] SF: Fetched primary data is valid. [2025-09-29T21:04:09.459130] [DEBUG] [LOCAL ] SF: Saving primary data. [2025-09-29T21:04:09.460419] [DEBUG] [LOCAL ] SF: Trimmed 59697 records to 41603 (keeping 200 days of data) [2025-09-29T21:04:09.565293] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-29T21:04:09.752594] [DEBUG] [LOCAL ] SF: Primary data saved (41603 records). [2025-09-29T21:04:09.752762] [INFO ] [MAIN ] SF: Full history saved. [2025-09-29T21:04:09.752855] [INFO ] [MAIN ] Update Progress: 1899/2371 symbols completed. SF took 32.0s. Estimated remaining: 1h 0m 40s. Rate: 7.8 symbols/min [2025-09-29T21:04:09.939374] [INFO ] [MAIN ] SFL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:04:09.948129] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-06. [2025-09-29T21:04:10.005426] [DEBUG] [LOCAL ] SFL: Loaded 46026 existing records from primary storage. [2025-09-29T21:04:10.005890] [INFO ] [MAIN ] SFL: Loaded 46026 existing records. [2025-09-29T21:04:10.194865] [WARN ] [MAIN ] SFL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:04:10.195130] [INFO ] [MAIN ] SFL: Wiping existing primary data before full refresh. [2025-09-29T21:04:10.195182] [INFO ] [LOCAL ] SFL: Starting deletion of primary data. [2025-09-29T21:04:10.195831] [DEBUG] [LOCAL ] SFL: Deleted primary data file. [2025-09-29T21:04:10.195894] [INFO ] [MAIN ] SFL: Starting full primary refresh. [2025-09-29T21:04:10.566168] [INFO ] [REMOTE ] SFL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:04:10.748162] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-08. [2025-09-29T21:04:10.873630] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-29T21:04:11.245388] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-29T21:04:11.372993] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-29T21:04:11.548156] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-07. [2025-09-29T21:04:12.348120] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-08. [2025-09-29T21:04:12.786830] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-29T21:04:13.148180] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-09. [2025-09-29T21:04:13.715881] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-29T21:04:13.718220] [INFO ] [REMOTE ] SFB: Full fetch complete (5762 records). [2025-09-29T21:04:13.718354] [DEBUG] [VALIDATOR ] SFB: Validating primary data. [2025-09-29T21:04:13.957696] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-08. [2025-09-29T21:04:14.262393] [DEBUG] [VALIDATOR ] SFB: All expected trading days are present. [2025-09-29T21:04:14.262487] [DEBUG] [VALIDATOR ] SFB: Primary data validation passed. [2025-09-29T21:04:14.262699] [INFO ] [MAIN ] SFB: Fetched primary data is valid. [2025-09-29T21:04:14.262811] [DEBUG] [LOCAL ] SFB: Saving primary data. [2025-09-29T21:04:14.263341] [DEBUG] [LOCAL ] SFB: Trimmed 5762 records to 4000 (keeping 200 days of data) [2025-09-29T21:04:14.289073] [DEBUG] [LOCAL ] SFB: Primary data saved (4000 records). [2025-09-29T21:04:14.289187] [INFO ] [MAIN ] SFB: Full history saved. [2025-09-29T21:04:14.289293] [INFO ] [MAIN ] Update Progress: 1900/2371 symbols completed. SFB took 26.3s. Estimated remaining: 1h 0m 32s. Rate: 7.8 symbols/min [2025-09-29T21:04:14.486989] [INFO ] [MAIN ] SG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:04:14.558050] [DEBUG] [LOCAL ] SG: Loaded 54227 existing records from primary storage. [2025-09-29T21:04:14.558490] [INFO ] [MAIN ] SG: Loaded 54227 existing records. [2025-09-29T21:04:14.761466] [INFO ] [REMOTE ] SFL: Fetching primary data for 2024-12. [2025-09-29T21:04:14.811324] [WARN ] [MAIN ] SG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:04:14.824852] [INFO ] [MAIN ] SG: Wiping existing primary data before full refresh. [2025-09-29T21:04:14.825185] [INFO ] [LOCAL ] SG: Starting deletion of primary data. [2025-09-29T21:04:14.827005] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-08 (2.48 seconds). [2025-09-29T21:04:14.827181] [DEBUG] [LOCAL ] SG: Deleted primary data file. [2025-09-29T21:04:14.838388] [INFO ] [MAIN ] SG: Starting full primary refresh. [2025-09-29T21:04:15.216309] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-29T21:04:15.267030] [INFO ] [REMOTE ] SG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:04:15.548150] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-09. [2025-09-29T21:04:16.321662] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-29T21:04:16.348114] [INFO ] [REMOTE ] SG: Fetching primary data for 2024-12. [2025-09-29T21:04:16.470946] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-29T21:04:16.483361] [INFO ] [REMOTE ] SES: Full fetch complete (74910 records). [2025-09-29T21:04:16.483541] [DEBUG] [VALIDATOR ] SES: Validating primary data. [2025-09-29T21:04:16.912566] [DEBUG] [VALIDATOR ] SES: All expected trading days are present. [2025-09-29T21:04:16.912719] [DEBUG] [VALIDATOR ] SES: Primary data validation passed. [2025-09-29T21:04:16.914118] [INFO ] [MAIN ] SES: Fetched primary data is valid. [2025-09-29T21:04:16.914201] [DEBUG] [LOCAL ] SES: Saving primary data. [2025-09-29T21:04:16.918596] [DEBUG] [LOCAL ] SES: Trimmed 74910 records to 51559 (keeping 200 days of data) [2025-09-29T21:04:17.148466] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-09. [2025-09-29T21:04:17.250856] [DEBUG] [LOCAL ] SES: Primary data saved (51559 records). [2025-09-29T21:04:17.251005] [INFO ] [MAIN ] SES: Full history saved. [2025-09-29T21:04:17.251123] [INFO ] [MAIN ] Update Progress: 1901/2371 symbols completed. SES took 41.9s. Estimated remaining: 1h 0m 23s. Rate: 7.8 symbols/min [2025-09-29T21:04:17.430370] [INFO ] [MAIN ] SGHC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:04:17.477573] [DEBUG] [LOCAL ] SGHC: Loaded 46435 existing records from primary storage. [2025-09-29T21:04:17.477929] [INFO ] [MAIN ] SGHC: Loaded 46435 existing records. [2025-09-29T21:04:17.672404] [WARN ] [MAIN ] SGHC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:04:17.672713] [INFO ] [MAIN ] SGHC: Wiping existing primary data before full refresh. [2025-09-29T21:04:17.672780] [INFO ] [LOCAL ] SGHC: Starting deletion of primary data. [2025-09-29T21:04:17.673407] [DEBUG] [LOCAL ] SGHC: Deleted primary data file. [2025-09-29T21:04:17.673478] [INFO ] [MAIN ] SGHC: Starting full primary refresh. [2025-09-29T21:04:17.954769] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-01. [2025-09-29T21:04:18.093400] [INFO ] [REMOTE ] SGHC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:04:18.328877] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-29T21:04:18.374142] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-29T21:04:18.378941] [INFO ] [REMOTE ] SFBS: Full fetch complete (30199 records). [2025-09-29T21:04:18.379046] [DEBUG] [VALIDATOR ] SFBS: Validating primary data. [2025-09-29T21:04:18.749709] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2024-12. [2025-09-29T21:04:18.784037] [DEBUG] [VALIDATOR ] SFBS: All expected trading days are present. [2025-09-29T21:04:18.784146] [DEBUG] [VALIDATOR ] SFBS: Primary data validation passed. [2025-09-29T21:04:18.784951] [INFO ] [MAIN ] SFBS: Fetched primary data is valid. [2025-09-29T21:04:18.785055] [DEBUG] [LOCAL ] SFBS: Saving primary data. [2025-09-29T21:04:18.786126] [DEBUG] [LOCAL ] SFBS: Trimmed 30199 records to 21030 (keeping 200 days of data) [2025-09-29T21:04:18.922331] [DEBUG] [LOCAL ] SFBS: Primary data saved (21030 records). [2025-09-29T21:04:18.922464] [INFO ] [MAIN ] SFBS: Full history saved. [2025-09-29T21:04:18.922602] [INFO ] [MAIN ] Update Progress: 1902/2371 symbols completed. SFBS took 27.5s. Estimated remaining: 1h 0m 14s. Rate: 7.8 symbols/min [2025-09-29T21:04:19.104811] [INFO ] [MAIN ] SGI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:04:19.105006] [DEBUG] [LOCAL ] SGI: No existing data file found in primary storage. [2025-09-29T21:04:19.105049] [WARN ] [MAIN ] SGI: No existing data found, performing full refresh instead. [2025-09-29T21:04:19.105182] [INFO ] [MAIN ] SGI: Wiping existing primary data before full refresh. [2025-09-29T21:04:19.105252] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-09-29T21:04:19.105344] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-09-29T21:04:19.105410] [INFO ] [MAIN ] SGI: Starting full primary refresh. [2025-09-29T21:04:19.498075] [INFO ] [REMOTE ] SGI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:04:19.548113] [INFO ] [REMOTE ] SGI: Fetching primary data for 2024-12. [2025-09-29T21:04:19.756202] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-29T21:04:19.845792] [DEBUG] [REMOTE ] SGI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T21:04:19.846152] [WARN ] [REMOTE ] SGI: No data returned for month 2024-12 [2025-09-29T21:04:19.846251] [FATAL] [REMOTE ] SGI: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T21:04:19.846306] [FATAL] [MAIN ] SGI: Failed to fetch primary data. [2025-09-29T21:04:19.846344] [WARN ] [MAIN ] SGI: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T21:04:19.846387] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-09-29T21:04:19.846446] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-09-29T21:04:19.846499] [INFO ] [LOCAL ] SGI: Starting deletion of derivative data. [2025-09-29T21:04:19.846570] [DEBUG] [LOCAL ] SGI: No derivative data file found to delete. [2025-09-29T21:04:19.846624] [INFO ] [MAIN ] Update Progress: 1903/2371 symbols completed. SGI took 0.9s. Estimated remaining: 1h 0m 5s. Rate: 7.8 symbols/min [2025-09-29T21:04:20.070961] [INFO ] [MAIN ] SGU: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:04:20.082664] [DEBUG] [LOCAL ] SGU: Loaded 6765 existing records from primary storage. [2025-09-29T21:04:20.082913] [INFO ] [MAIN ] SGU: Loaded 6765 existing records. [2025-09-29T21:04:20.285152] [WARN ] [MAIN ] SGU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:04:20.285568] [INFO ] [MAIN ] SGU: Wiping existing primary data before full refresh. [2025-09-29T21:04:20.285798] [INFO ] [LOCAL ] SGU: Starting deletion of primary data. [2025-09-29T21:04:20.293373] [DEBUG] [LOCAL ] SGU: Deleted primary data file. [2025-09-29T21:04:20.306321] [INFO ] [MAIN ] SGU: Starting full primary refresh. [2025-09-29T21:04:20.313150] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-29T21:04:20.372239] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-02. [2025-09-29T21:04:20.714133] [INFO ] [REMOTE ] SGU: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:04:21.148167] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-01. [2025-09-29T21:04:21.948123] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-01. [2025-09-29T21:04:22.160727] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-29T21:04:22.748122] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-03. [2025-09-29T21:04:23.055884] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-29T21:04:23.504302] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-29T21:04:23.548130] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-02. [2025-09-29T21:04:24.348104] [INFO ] [REMOTE ] SGU: Fetching primary data for 2024-12. [2025-09-29T21:04:24.611062] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-29T21:04:25.052118] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-29T21:04:25.148082] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-04. [2025-09-29T21:04:25.181462] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-29T21:04:25.948139] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-01. [2025-09-29T21:04:26.635627] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-29T21:04:26.748135] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-02. [2025-09-29T21:04:26.969115] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-29T21:04:27.548164] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-02. [2025-09-29T21:04:28.067310] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-29T21:04:28.348113] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-03. [2025-09-29T21:04:28.802969] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-29T21:04:29.046566] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-29T21:04:29.148142] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-04. [2025-09-29T21:04:29.864483] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-29T21:04:29.948124] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-03. [2025-09-29T21:04:30.748096] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-05. [2025-09-29T21:04:31.444039] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-29T21:04:31.548141] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-06. [2025-09-29T21:04:31.610308] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-29T21:04:32.292932] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-29T21:04:32.348143] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-04. [2025-09-29T21:04:33.148130] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-07. [2025-09-29T21:04:33.946004] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-29T21:04:33.955079] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-03. [2025-09-29T21:04:34.221221] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-29T21:04:34.748107] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-05. [2025-09-29T21:04:35.548125] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-05. [2025-09-29T21:04:35.884972] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-29T21:04:36.348101] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-04. [2025-09-29T21:04:36.480330] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-29T21:04:37.148120] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-06. [2025-09-29T21:04:37.284001] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-29T21:04:37.948096] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-08. [2025-09-29T21:04:38.331746] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-29T21:04:38.735255] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-29T21:04:38.748061] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-07. [2025-09-29T21:04:38.785586] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-29T21:04:39.548132] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-05. [2025-09-29T21:04:40.348176] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-06. [2025-09-29T21:04:40.569941] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-29T21:04:41.148127] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-08. [2025-09-29T21:04:41.731344] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-29T21:04:41.948469] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-06. [2025-09-29T21:04:41.948397] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-29T21:04:42.748174] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-07. [2025-09-29T21:04:42.885914] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-29T21:04:43.548136] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-09. [2025-09-29T21:04:43.994995] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-29T21:04:44.302905] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-29T21:04:44.319030] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-29T21:04:44.321048] [INFO ] [REMOTE ] SGU: Full fetch complete (8965 records). [2025-09-29T21:04:44.321147] [DEBUG] [VALIDATOR ] SGU: Validating primary data. [2025-09-29T21:04:44.353239] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-09. [2025-09-29T21:04:44.758927] [DEBUG] [VALIDATOR ] SGU: All expected trading days are present. [2025-09-29T21:04:44.759012] [DEBUG] [VALIDATOR ] SGU: Primary data validation passed. [2025-09-29T21:04:44.759283] [INFO ] [MAIN ] SGU: Fetched primary data is valid. [2025-09-29T21:04:44.759346] [DEBUG] [LOCAL ] SGU: Saving primary data. [2025-09-29T21:04:44.759997] [DEBUG] [LOCAL ] SGU: Trimmed 8965 records to 6691 (keeping 200 days of data) [2025-09-29T21:04:44.801463] [DEBUG] [LOCAL ] SGU: Primary data saved (6691 records). [2025-09-29T21:04:44.801605] [INFO ] [MAIN ] SGU: Full history saved. [2025-09-29T21:04:44.801712] [INFO ] [MAIN ] Update Progress: 1904/2371 symbols completed. SGU took 25.0s. Estimated remaining: 1h 0m 1s. Rate: 7.8 symbols/min [2025-09-29T21:04:44.984892] [INFO ] [MAIN ] SHAK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:04:45.039989] [DEBUG] [LOCAL ] SHAK: Loaded 49831 existing records from primary storage. [2025-09-29T21:04:45.040357] [INFO ] [MAIN ] SHAK: Loaded 49831 existing records. [2025-09-29T21:04:45.148984] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-08. [2025-09-29T21:04:45.235142] [WARN ] [MAIN ] SHAK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:04:45.235417] [INFO ] [MAIN ] SHAK: Wiping existing primary data before full refresh. [2025-09-29T21:04:45.235541] [INFO ] [LOCAL ] SHAK: Starting deletion of primary data. [2025-09-29T21:04:45.235903] [DEBUG] [LOCAL ] SHAK: Deleted primary data file. [2025-09-29T21:04:45.235963] [INFO ] [MAIN ] SHAK: Starting full primary refresh. [2025-09-29T21:04:45.621313] [INFO ] [REMOTE ] SHAK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:04:45.948121] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-07. [2025-09-29T21:04:46.490633] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-29T21:04:46.501851] [INFO ] [REMOTE ] SGHC: Full fetch complete (63536 records). [2025-09-29T21:04:46.502027] [DEBUG] [VALIDATOR ] SGHC: Validating primary data. [2025-09-29T21:04:46.753726] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2024-12. [2025-09-29T21:04:46.935848] [DEBUG] [VALIDATOR ] SGHC: All expected trading days are present. [2025-09-29T21:04:46.935972] [DEBUG] [VALIDATOR ] SGHC: Primary data validation passed. [2025-09-29T21:04:46.937161] [INFO ] [MAIN ] SGHC: Fetched primary data is valid. [2025-09-29T21:04:46.937262] [DEBUG] [LOCAL ] SGHC: Saving primary data. [2025-09-29T21:04:46.948163] [DEBUG] [LOCAL ] SGHC: Trimmed 63536 records to 45832 (keeping 200 days of data) [2025-09-29T21:04:46.967035] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-29T21:04:47.266174] [DEBUG] [LOCAL ] SGHC: Primary data saved (45832 records). [2025-09-29T21:04:47.266320] [INFO ] [MAIN ] SGHC: Full history saved. [2025-09-29T21:04:47.266408] [INFO ] [MAIN ] Update Progress: 1905/2371 symbols completed. SGHC took 30.0s. Estimated remaining: 59m 52s. Rate: 7.8 symbols/min [2025-09-29T21:04:47.437167] [INFO ] [MAIN ] SHCO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:04:47.464386] [DEBUG] [LOCAL ] SHCO: Loaded 26427 existing records from primary storage. [2025-09-29T21:04:47.464705] [INFO ] [MAIN ] SHCO: Loaded 26427 existing records. [2025-09-29T21:04:47.561701] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-09. [2025-09-29T21:04:47.660427] [WARN ] [MAIN ] SHCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:04:47.660713] [INFO ] [MAIN ] SHCO: Wiping existing primary data before full refresh. [2025-09-29T21:04:47.660775] [INFO ] [LOCAL ] SHCO: Starting deletion of primary data. [2025-09-29T21:04:47.661137] [DEBUG] [LOCAL ] SHCO: Deleted primary data file. [2025-09-29T21:04:47.661201] [INFO ] [MAIN ] SHCO: Starting full primary refresh. [2025-09-29T21:04:48.047453] [INFO ] [REMOTE ] SHCO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:04:48.159293] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-29T21:04:48.348125] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2024-12. [2025-09-29T21:04:48.473926] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-29T21:04:49.148101] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-01. [2025-09-29T21:04:49.289590] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-29T21:04:49.300176] [INFO ] [REMOTE ] SFL: Full fetch complete (65581 records). [2025-09-29T21:04:49.300320] [DEBUG] [VALIDATOR ] SFL: Validating primary data. [2025-09-29T21:04:49.649939] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-29T21:04:49.740422] [DEBUG] [VALIDATOR ] SFL: All expected trading days are present. [2025-09-29T21:04:49.740514] [DEBUG] [VALIDATOR ] SFL: Primary data validation passed. [2025-09-29T21:04:49.741569] [INFO ] [MAIN ] SFL: Fetched primary data is valid. [2025-09-29T21:04:49.741635] [DEBUG] [LOCAL ] SFL: Saving primary data. [2025-09-29T21:04:49.743091] [DEBUG] [LOCAL ] SFL: Trimmed 65581 records to 45250 (keeping 200 days of data) [2025-09-29T21:04:49.969171] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-01. [2025-09-29T21:04:50.044617] [DEBUG] [LOCAL ] SFL: Primary data saved (45250 records). [2025-09-29T21:04:50.044804] [INFO ] [MAIN ] SFL: Full history saved. [2025-09-29T21:04:50.044913] [INFO ] [MAIN ] Update Progress: 1906/2371 symbols completed. SFL took 40.3s. Estimated remaining: 59m 43s. Rate: 7.8 symbols/min [2025-09-29T21:04:50.236054] [INFO ] [MAIN ] SHEL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:04:50.301343] [DEBUG] [LOCAL ] SHEL: Loaded 54451 existing records from primary storage. [2025-09-29T21:04:50.301758] [INFO ] [MAIN ] SHEL: Loaded 54451 existing records. [2025-09-29T21:04:50.494265] [WARN ] [MAIN ] SHEL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:04:50.495416] [INFO ] [MAIN ] SHEL: Wiping existing primary data before full refresh. [2025-09-29T21:04:50.495582] [INFO ] [LOCAL ] SHEL: Starting deletion of primary data. [2025-09-29T21:04:50.496182] [DEBUG] [LOCAL ] SHEL: Deleted primary data file. [2025-09-29T21:04:50.496248] [INFO ] [MAIN ] SHEL: Starting full primary refresh. [2025-09-29T21:04:50.753472] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-08. [2025-09-29T21:04:50.898308] [INFO ] [REMOTE ] SHEL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:04:50.940296] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-29T21:04:51.169881] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-29T21:04:51.548109] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-02. [2025-09-29T21:04:52.348146] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2024-12. [2025-09-29T21:04:52.713270] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-29T21:04:52.827719] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-29T21:04:53.148139] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-09. [2025-09-29T21:04:53.948139] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-03. [2025-09-29T21:04:54.450037] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-29T21:04:54.748130] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-02. [2025-09-29T21:04:55.251541] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-29T21:04:55.262766] [INFO ] [REMOTE ] SG: Full fetch complete (77263 records). [2025-09-29T21:04:55.262915] [DEBUG] [VALIDATOR ] SG: Validating primary data. [2025-09-29T21:04:55.548759] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-01. [2025-09-29T21:04:55.596486] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-29T21:04:55.702865] [DEBUG] [VALIDATOR ] SG: All expected trading days are present. [2025-09-29T21:04:55.702959] [DEBUG] [VALIDATOR ] SG: Primary data validation passed. [2025-09-29T21:04:55.704215] [INFO ] [MAIN ] SG: Fetched primary data is valid. [2025-09-29T21:04:55.704287] [DEBUG] [LOCAL ] SG: Saving primary data. [2025-09-29T21:04:55.706333] [DEBUG] [LOCAL ] SG: Trimmed 77263 records to 53451 (keeping 200 days of data) [2025-09-29T21:04:56.036381] [DEBUG] [LOCAL ] SG: Primary data saved (53451 records). [2025-09-29T21:04:56.036581] [INFO ] [MAIN ] SG: Full history saved. [2025-09-29T21:04:56.036708] [INFO ] [MAIN ] Update Progress: 1907/2371 symbols completed. SG took 41.7s. Estimated remaining: 59m 35s. Rate: 7.8 symbols/min [2025-09-29T21:04:56.211906] [INFO ] [MAIN ] SHG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:04:56.240836] [DEBUG] [LOCAL ] SHG: Loaded 27307 existing records from primary storage. [2025-09-29T21:04:56.241106] [INFO ] [MAIN ] SHG: Loaded 27307 existing records. [2025-09-29T21:04:56.353239] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-04. [2025-09-29T21:04:56.427475] [WARN ] [MAIN ] SHG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:04:56.427987] [INFO ] [MAIN ] SHG: Wiping existing primary data before full refresh. [2025-09-29T21:04:56.428091] [INFO ] [LOCAL ] SHG: Starting deletion of primary data. [2025-09-29T21:04:56.428385] [DEBUG] [LOCAL ] SHG: Deleted primary data file. [2025-09-29T21:04:56.428461] [INFO ] [MAIN ] SHG: Starting full primary refresh. [2025-09-29T21:04:56.817370] [INFO ] [REMOTE ] SHG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:04:56.846960] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-29T21:04:57.148112] [INFO ] [REMOTE ] SHG: Fetching primary data for 2024-12. [2025-09-29T21:04:57.713772] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-09-29T21:04:57.761145] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-29T21:04:57.948080] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-05. [2025-09-29T21:04:58.568000] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-29T21:04:58.748108] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-03. [2025-09-29T21:04:58.844058] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-29T21:04:59.548137] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-01. [2025-09-29T21:05:00.348109] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-02. [2025-09-29T21:05:00.634887] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-29T21:05:01.026457] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-29T21:05:01.148153] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-04. [2025-09-29T21:05:01.948134] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-06. [2025-09-29T21:05:02.442015] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-29T21:05:02.748100] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-03. [2025-09-29T21:05:03.046718] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-29T21:05:03.161366] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-29T21:05:03.548139] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-05. [2025-09-29T21:05:04.348138] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-02. [2025-09-29T21:05:05.148132] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-07. [2025-09-29T21:05:05.488039] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-03 (2.74 seconds). [2025-09-29T21:05:05.781426] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-29T21:05:05.903666] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-29T21:05:05.948149] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-03. [2025-09-29T21:05:06.574950] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-29T21:05:06.748158] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-06. [2025-09-29T21:05:07.211991] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-29T21:05:07.548113] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-08. [2025-09-29T21:05:08.348128] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-04. [2025-09-29T21:05:08.552097] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-29T21:05:09.011884] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-29T21:05:09.148109] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-04. [2025-09-29T21:05:09.948126] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-09. [2025-09-29T21:05:10.565039] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-29T21:05:10.630558] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-29T21:05:10.748113] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-07. [2025-09-29T21:05:11.286547] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-29T21:05:11.294055] [INFO ] [REMOTE ] SHCO: Full fetch complete (37556 records). [2025-09-29T21:05:11.294221] [DEBUG] [VALIDATOR ] SHCO: Validating primary data. [2025-09-29T21:05:11.554412] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-05. [2025-09-29T21:05:11.697920] [DEBUG] [VALIDATOR ] SHCO: All expected trading days are present. [2025-09-29T21:05:11.698009] [DEBUG] [VALIDATOR ] SHCO: Primary data validation passed. [2025-09-29T21:05:11.698874] [INFO ] [MAIN ] SHCO: Fetched primary data is valid. [2025-09-29T21:05:11.698938] [DEBUG] [LOCAL ] SHCO: Saving primary data. [2025-09-29T21:05:11.699860] [DEBUG] [LOCAL ] SHCO: Trimmed 37556 records to 25899 (keeping 200 days of data) [2025-09-29T21:05:11.867195] [DEBUG] [LOCAL ] SHCO: Primary data saved (25899 records). [2025-09-29T21:05:11.867334] [INFO ] [MAIN ] SHCO: Full history saved. [2025-09-29T21:05:11.867431] [INFO ] [MAIN ] Update Progress: 1908/2371 symbols completed. SHCO took 24.6s. Estimated remaining: 59m 29s. Rate: 7.8 symbols/min [2025-09-29T21:05:12.115560] [INFO ] [MAIN ] SHO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:05:12.164370] [DEBUG] [LOCAL ] SHO: Loaded 50552 existing records from primary storage. [2025-09-29T21:05:12.164725] [INFO ] [MAIN ] SHO: Loaded 50552 existing records. [2025-09-29T21:05:12.348416] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-05. [2025-09-29T21:05:12.354515] [WARN ] [MAIN ] SHO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:05:12.356062] [INFO ] [MAIN ] SHO: Wiping existing primary data before full refresh. [2025-09-29T21:05:12.356124] [INFO ] [LOCAL ] SHO: Starting deletion of primary data. [2025-09-29T21:05:12.356402] [DEBUG] [LOCAL ] SHO: Deleted primary data file. [2025-09-29T21:05:12.356463] [INFO ] [MAIN ] SHO: Starting full primary refresh. [2025-09-29T21:05:12.748882] [INFO ] [REMOTE ] SHO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:05:12.785214] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-29T21:05:13.148089] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-08. [2025-09-29T21:05:13.177712] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-29T21:05:13.948151] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-06. [2025-09-29T21:05:14.747333] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-09-29T21:05:14.758254] [INFO ] [REMOTE ] SHO: Fetching primary data for 2024-12. [2025-09-29T21:05:14.869443] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-29T21:05:14.959984] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-29T21:05:15.548114] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-09. [2025-09-29T21:05:16.348176] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-07. [2025-09-29T21:05:16.793789] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-29T21:05:17.149174] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-01. [2025-09-29T21:05:17.154636] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-29T21:05:17.165205] [INFO ] [REMOTE ] SHAK: Full fetch complete (70203 records). [2025-09-29T21:05:17.165356] [DEBUG] [VALIDATOR ] SHAK: Validating primary data. [2025-09-29T21:05:17.579193] [DEBUG] [VALIDATOR ] SHAK: All expected trading days are present. [2025-09-29T21:05:17.579347] [DEBUG] [VALIDATOR ] SHAK: Primary data validation passed. [2025-09-29T21:05:17.580707] [INFO ] [MAIN ] SHAK: Fetched primary data is valid. [2025-09-29T21:05:17.580776] [DEBUG] [LOCAL ] SHAK: Saving primary data. [2025-09-29T21:05:17.582236] [DEBUG] [LOCAL ] SHAK: Trimmed 70203 records to 49035 (keeping 200 days of data) [2025-09-29T21:05:17.820832] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-29T21:05:17.928998] [DEBUG] [LOCAL ] SHAK: Primary data saved (49035 records). [2025-09-29T21:05:17.929164] [INFO ] [MAIN ] SHAK: Full history saved. [2025-09-29T21:05:17.929266] [INFO ] [MAIN ] Update Progress: 1909/2371 symbols completed. SHAK took 33.1s. Estimated remaining: 59m 21s. Rate: 7.8 symbols/min [2025-09-29T21:05:17.953186] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-06. [2025-09-29T21:05:18.107975] [INFO ] [MAIN ] SHOC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:05:18.115314] [DEBUG] [LOCAL ] SHOC: Loaded 3747 existing records from primary storage. [2025-09-29T21:05:18.115553] [INFO ] [MAIN ] SHOC: Loaded 3747 existing records. [2025-09-29T21:05:18.303785] [WARN ] [MAIN ] SHOC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:05:18.304053] [INFO ] [MAIN ] SHOC: Wiping existing primary data before full refresh. [2025-09-29T21:05:18.304103] [INFO ] [LOCAL ] SHOC: Starting deletion of primary data. [2025-09-29T21:05:18.304300] [DEBUG] [LOCAL ] SHOC: Deleted primary data file. [2025-09-29T21:05:18.304359] [INFO ] [MAIN ] SHOC: Starting full primary refresh. [2025-09-29T21:05:18.718556] [INFO ] [REMOTE ] SHOC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:05:18.747370] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-29T21:05:18.756588] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-08. [2025-09-29T21:05:19.548147] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-02. [2025-09-29T21:05:19.983277] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-29T21:05:20.009004] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-29T21:05:20.348144] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-09. [2025-09-29T21:05:21.148141] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2024-12. [2025-09-29T21:05:21.207177] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-29T21:05:21.345513] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-29T21:05:21.351467] [INFO ] [REMOTE ] SHG: Full fetch complete (41356 records). [2025-09-29T21:05:21.351612] [DEBUG] [VALIDATOR ] SHG: Validating primary data. [2025-09-29T21:05:21.778425] [DEBUG] [VALIDATOR ] SHG: All expected trading days are present. [2025-09-29T21:05:21.778529] [DEBUG] [VALIDATOR ] SHG: Primary data validation passed. [2025-09-29T21:05:21.779517] [INFO ] [MAIN ] SHG: Fetched primary data is valid. [2025-09-29T21:05:21.779585] [DEBUG] [LOCAL ] SHG: Saving primary data. [2025-09-29T21:05:21.780708] [DEBUG] [LOCAL ] SHG: Trimmed 41356 records to 26594 (keeping 200 days of data) [2025-09-29T21:05:21.949217] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-07. [2025-09-29T21:05:21.957711] [DEBUG] [LOCAL ] SHG: Primary data saved (26594 records). [2025-09-29T21:05:21.957900] [INFO ] [MAIN ] SHG: Full history saved. [2025-09-29T21:05:21.958008] [INFO ] [MAIN ] Update Progress: 1910/2371 symbols completed. SHG took 25.9s. Estimated remaining: 59m 13s. Rate: 7.8 symbols/min [2025-09-29T21:05:22.144440] [INFO ] [MAIN ] SHW: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:05:22.198094] [DEBUG] [LOCAL ] SHW: Loaded 51174 existing records from primary storage. [2025-09-29T21:05:22.198468] [INFO ] [MAIN ] SHW: Loaded 51174 existing records. [2025-09-29T21:05:22.322531] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-29T21:05:22.398039] [WARN ] [MAIN ] SHW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:05:22.398258] [INFO ] [MAIN ] SHW: Wiping existing primary data before full refresh. [2025-09-29T21:05:22.398310] [INFO ] [LOCAL ] SHW: Starting deletion of primary data. [2025-09-29T21:05:22.398824] [DEBUG] [LOCAL ] SHW: Deleted primary data file. [2025-09-29T21:05:22.398886] [INFO ] [MAIN ] SHW: Starting full primary refresh. [2025-09-29T21:05:22.758534] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-01. [2025-09-29T21:05:22.794466] [INFO ] [REMOTE ] SHW: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:05:23.470198] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-29T21:05:23.548117] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-02. [2025-09-29T21:05:24.155885] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-29T21:05:24.252233] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-29T21:05:24.348141] [INFO ] [REMOTE ] SHW: Fetching primary data for 2024-12. [2025-09-29T21:05:25.148095] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-03. [2025-09-29T21:05:25.948147] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-03. [2025-09-29T21:05:26.254555] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-29T21:05:26.525235] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-29T21:05:26.748155] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-04. [2025-09-29T21:05:26.919380] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-29T21:05:27.548156] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-01. [2025-09-29T21:05:27.700879] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-29T21:05:28.348135] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-04. [2025-09-29T21:05:29.122867] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-29T21:05:29.148072] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-02. [2025-09-29T21:05:29.751780] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-29T21:05:29.948142] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-05. [2025-09-29T21:05:30.539186] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-29T21:05:30.748140] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-08. [2025-09-29T21:05:31.051795] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-29T21:05:31.548163] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-05. [2025-09-29T21:05:32.348121] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-06. [2025-09-29T21:05:32.887309] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-29T21:05:33.066932] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-29T21:05:33.148108] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-07. [2025-09-29T21:05:33.242336] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-29T21:05:33.764676] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-29T21:05:33.948114] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-06. [2025-09-29T21:05:34.748162] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-09. [2025-09-29T21:05:35.512735] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-29T21:05:35.548106] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-08. [2025-09-29T21:05:35.967378] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-29T21:05:36.348129] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-09. [2025-09-29T21:05:36.819428] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-29T21:05:36.832298] [INFO ] [REMOTE ] SHEL: Full fetch complete (77690 records). [2025-09-29T21:05:36.832497] [DEBUG] [VALIDATOR ] SHEL: Validating primary data. [2025-09-29T21:05:36.922293] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-29T21:05:36.952774] [INFO ] [REMOTE ] SHOC: Full fetch complete (7384 records). [2025-09-29T21:05:36.958580] [DEBUG] [VALIDATOR ] SHOC: Validating primary data. [2025-09-29T21:05:37.156105] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-03. [2025-09-29T21:05:37.624264] [DEBUG] [VALIDATOR ] SHEL: All expected trading days are present. [2025-09-29T21:05:37.635251] [DEBUG] [VALIDATOR ] SHEL: Primary data validation passed. [2025-09-29T21:05:37.647132] [INFO ] [MAIN ] SHEL: Fetched primary data is valid. [2025-09-29T21:05:37.665990] [DEBUG] [LOCAL ] SHEL: Saving primary data. [2025-09-29T21:05:37.711442] [DEBUG] [VALIDATOR ] SHOC: All expected trading days are present. [2025-09-29T21:05:37.711614] [DEBUG] [VALIDATOR ] SHOC: Primary data validation passed. [2025-09-29T21:05:37.711796] [INFO ] [MAIN ] SHOC: Fetched primary data is valid. [2025-09-29T21:05:37.711876] [DEBUG] [LOCAL ] SHOC: Saving primary data. [2025-09-29T21:05:37.712671] [DEBUG] [LOCAL ] SHOC: Trimmed 7384 records to 3522 (keeping 200 days of data) [2025-09-29T21:05:37.713247] [DEBUG] [LOCAL ] SHEL: Trimmed 77690 records to 53671 (keeping 200 days of data) [2025-09-29T21:05:37.841144] [DEBUG] [LOCAL ] SHOC: Primary data saved (3522 records). [2025-09-29T21:05:37.844441] [INFO ] [MAIN ] SHOC: Full history saved. [2025-09-29T21:05:37.846824] [INFO ] [MAIN ] Update Progress: 1911/2371 symbols completed. SHOC took 19.9s. Estimated remaining: 59m 7s. Rate: 7.8 symbols/min [2025-09-29T21:05:37.952982] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-07. [2025-09-29T21:05:38.048597] [INFO ] [MAIN ] SI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:05:38.050262] [DEBUG] [LOCAL ] SI: No existing data file found in primary storage. [2025-09-29T21:05:38.050865] [WARN ] [MAIN ] SI: No existing data found, performing full refresh instead. [2025-09-29T21:05:38.051908] [INFO ] [MAIN ] SI: Wiping existing primary data before full refresh. [2025-09-29T21:05:38.052491] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-09-29T21:05:38.052920] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-09-29T21:05:38.053294] [INFO ] [MAIN ] SI: Starting full primary refresh. [2025-09-29T21:05:38.555914] [INFO ] [REMOTE ] SI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:05:38.685985] [DEBUG] [LOCAL ] SHEL: Primary data saved (53671 records). [2025-09-29T21:05:38.686156] [INFO ] [MAIN ] SHEL: Full history saved. [2025-09-29T21:05:38.686307] [INFO ] [MAIN ] Update Progress: 1912/2371 symbols completed. SHEL took 48.6s. Estimated remaining: 58m 58s. Rate: 7.8 symbols/min [2025-09-29T21:05:38.756599] [INFO ] [REMOTE ] SI: Fetching primary data for 2024-12. [2025-09-29T21:05:38.873288] [INFO ] [MAIN ] SID: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:05:38.918197] [DEBUG] [LOCAL ] SID: Loaded 42834 existing records from primary storage. [2025-09-29T21:05:38.918515] [INFO ] [MAIN ] SID: Loaded 42834 existing records. [2025-09-29T21:05:39.106923] [WARN ] [MAIN ] SID: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:05:39.107189] [INFO ] [MAIN ] SID: Wiping existing primary data before full refresh. [2025-09-29T21:05:39.107242] [INFO ] [LOCAL ] SID: Starting deletion of primary data. [2025-09-29T21:05:39.107592] [DEBUG] [LOCAL ] SID: Deleted primary data file. [2025-09-29T21:05:39.107676] [INFO ] [MAIN ] SID: Starting full primary refresh. [2025-09-29T21:05:39.201325] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T21:05:39.215210] [WARN ] [REMOTE ] SI: No data returned for month 2024-12 [2025-09-29T21:05:39.224120] [FATAL] [REMOTE ] SI: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T21:05:39.229024] [FATAL] [MAIN ] SI: Failed to fetch primary data. [2025-09-29T21:05:39.229441] [WARN ] [MAIN ] SI: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T21:05:39.245745] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-09-29T21:05:39.290926] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-09-29T21:05:39.302468] [INFO ] [LOCAL ] SI: Starting deletion of derivative data. [2025-09-29T21:05:39.320281] [DEBUG] [LOCAL ] SI: No derivative data file found to delete. [2025-09-29T21:05:39.348333] [INFO ] [MAIN ] Update Progress: 1913/2371 symbols completed. SI took 1.5s. Estimated remaining: 58m 48s. Rate: 7.8 symbols/min [2025-09-29T21:05:39.666334] [INFO ] [MAIN ] SIG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:05:39.716563] [INFO ] [REMOTE ] SID: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:05:39.717414] [INFO ] [REMOTE ] SID: Fetching primary data for 2024-12. [2025-09-29T21:05:39.754044] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-03 (2.60 seconds). [2025-09-29T21:05:39.800424] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-29T21:05:39.844318] [DEBUG] [LOCAL ] SIG: Loaded 47111 existing records from primary storage. [2025-09-29T21:05:39.844636] [INFO ] [MAIN ] SIG: Loaded 47111 existing records. [2025-09-29T21:05:40.028878] [WARN ] [MAIN ] SIG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:05:40.029124] [INFO ] [MAIN ] SIG: Wiping existing primary data before full refresh. [2025-09-29T21:05:40.029182] [INFO ] [LOCAL ] SIG: Starting deletion of primary data. [2025-09-29T21:05:40.029965] [DEBUG] [LOCAL ] SIG: Deleted primary data file. [2025-09-29T21:05:40.030056] [INFO ] [MAIN ] SIG: Starting full primary refresh. [2025-09-29T21:05:40.353260] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-04. [2025-09-29T21:05:40.409167] [INFO ] [REMOTE ] SIG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:05:41.148096] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-08. [2025-09-29T21:05:41.451087] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-29T21:05:41.948088] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-01. [2025-09-29T21:05:42.301256] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-29T21:05:42.748104] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-05. [2025-09-29T21:05:42.886266] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-29T21:05:43.553508] [INFO ] [REMOTE ] SIG: Fetching primary data for 2024-12. [2025-09-29T21:05:43.576329] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-29T21:05:44.348168] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-09. [2025-09-29T21:05:44.785225] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-29T21:05:45.148140] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-02. [2025-09-29T21:05:45.433537] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-29T21:05:45.625022] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-29T21:05:45.636957] [INFO ] [REMOTE ] SHO: Full fetch complete (71109 records). [2025-09-29T21:05:45.637156] [DEBUG] [VALIDATOR ] SHO: Validating primary data. [2025-09-29T21:05:45.956719] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-06. [2025-09-29T21:05:46.063809] [DEBUG] [VALIDATOR ] SHO: All expected trading days are present. [2025-09-29T21:05:46.063929] [DEBUG] [VALIDATOR ] SHO: Primary data validation passed. [2025-09-29T21:05:46.065218] [INFO ] [MAIN ] SHO: Fetched primary data is valid. [2025-09-29T21:05:46.065339] [DEBUG] [LOCAL ] SHO: Saving primary data. [2025-09-29T21:05:46.069624] [DEBUG] [LOCAL ] SHO: Trimmed 71109 records to 49778 (keeping 200 days of data) [2025-09-29T21:05:46.396405] [DEBUG] [LOCAL ] SHO: Primary data saved (49778 records). [2025-09-29T21:05:46.396562] [INFO ] [MAIN ] SHO: Full history saved. [2025-09-29T21:05:46.396675] [INFO ] [MAIN ] Update Progress: 1914/2371 symbols completed. SHO took 34.5s. Estimated remaining: 58m 40s. Rate: 7.8 symbols/min [2025-09-29T21:05:46.591955] [INFO ] [MAIN ] SII: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:05:46.617199] [DEBUG] [LOCAL ] SII: Loaded 23644 existing records from primary storage. [2025-09-29T21:05:46.637041] [INFO ] [MAIN ] SII: Loaded 23644 existing records. [2025-09-29T21:05:46.698520] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-29T21:05:46.753580] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-01. [2025-09-29T21:05:46.838135] [WARN ] [MAIN ] SII: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:05:46.838350] [INFO ] [MAIN ] SII: Wiping existing primary data before full refresh. [2025-09-29T21:05:46.838399] [INFO ] [LOCAL ] SII: Starting deletion of primary data. [2025-09-29T21:05:46.838789] [DEBUG] [LOCAL ] SII: Deleted primary data file. [2025-09-29T21:05:46.838850] [INFO ] [MAIN ] SII: Starting full primary refresh. [2025-09-29T21:05:47.235917] [INFO ] [REMOTE ] SII: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:05:47.548129] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-03. [2025-09-29T21:05:47.847365] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-29T21:05:48.348119] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-07. [2025-09-29T21:05:48.609855] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-29T21:05:49.148115] [INFO ] [REMOTE ] SII: Fetching primary data for 2024-12. [2025-09-29T21:05:49.240195] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-29T21:05:49.948181] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-04. [2025-09-29T21:05:50.230586] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-29T21:05:50.237053] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-29T21:05:50.748160] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-01. [2025-09-29T21:05:51.406576] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-29T21:05:51.548127] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-02. [2025-09-29T21:05:51.778712] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-29T21:05:52.348119] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-02. [2025-09-29T21:05:53.148081] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-05. [2025-09-29T21:05:53.313734] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-29T21:05:53.371627] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-29T21:05:53.948118] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-03. [2025-09-29T21:05:54.550383] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-29T21:05:54.748165] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-06. [2025-09-29T21:05:55.548102] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-03. [2025-09-29T21:05:55.730974] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-29T21:05:56.221320] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-29T21:05:56.339856] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-29T21:05:56.348269] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-08. [2025-09-29T21:05:57.148121] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-04. [2025-09-29T21:05:57.948102] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-07. [2025-09-29T21:05:58.168242] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-29T21:05:58.545025] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-29T21:05:58.748117] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-05. [2025-09-29T21:05:59.441077] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-29T21:05:59.548159] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-09. [2025-09-29T21:05:59.658425] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-29T21:06:00.348142] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-06. [2025-09-29T21:06:01.148081] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-08. [2025-09-29T21:06:01.331355] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-29T21:06:01.342850] [INFO ] [REMOTE ] SHW: Full fetch complete (73006 records). [2025-09-29T21:06:01.343020] [DEBUG] [VALIDATOR ] SHW: Validating primary data. [2025-09-29T21:06:01.701495] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-29T21:06:01.819055] [DEBUG] [VALIDATOR ] SHW: All expected trading days are present. [2025-09-29T21:06:01.819154] [DEBUG] [VALIDATOR ] SHW: Primary data validation passed. [2025-09-29T21:06:01.820331] [INFO ] [MAIN ] SHW: Fetched primary data is valid. [2025-09-29T21:06:01.820415] [DEBUG] [LOCAL ] SHW: Saving primary data. [2025-09-29T21:06:01.823299] [DEBUG] [LOCAL ] SHW: Trimmed 73006 records to 50382 (keeping 200 days of data) [2025-09-29T21:06:01.948195] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-07. [2025-09-29T21:06:02.161037] [DEBUG] [LOCAL ] SHW: Primary data saved (50382 records). [2025-09-29T21:06:02.161195] [INFO ] [MAIN ] SHW: Full history saved. [2025-09-29T21:06:02.161302] [INFO ] [MAIN ] Update Progress: 1915/2371 symbols completed. SHW took 40.2s. Estimated remaining: 58m 34s. Rate: 7.8 symbols/min [2025-09-29T21:06:02.342320] [INFO ] [MAIN ] SILA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:06:02.377152] [DEBUG] [LOCAL ] SILA: Loaded 31635 existing records from primary storage. [2025-09-29T21:06:02.377480] [INFO ] [MAIN ] SILA: Loaded 31635 existing records. [2025-09-29T21:06:02.574245] [WARN ] [MAIN ] SILA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:06:02.574509] [INFO ] [MAIN ] SILA: Wiping existing primary data before full refresh. [2025-09-29T21:06:02.574584] [INFO ] [LOCAL ] SILA: Starting deletion of primary data. [2025-09-29T21:06:02.574944] [DEBUG] [LOCAL ] SILA: Deleted primary data file. [2025-09-29T21:06:02.575010] [INFO ] [MAIN ] SILA: Starting full primary refresh. [2025-09-29T21:06:02.760306] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-04. [2025-09-29T21:06:02.972880] [INFO ] [REMOTE ] SILA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:06:03.002194] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-29T21:06:03.344349] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-29T21:06:03.548117] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-08. [2025-09-29T21:06:04.348085] [INFO ] [REMOTE ] SILA: Fetching primary data for 2024-12. [2025-09-29T21:06:04.388379] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-29T21:06:04.615532] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-29T21:06:05.148129] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-09. [2025-09-29T21:06:05.426037] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-29T21:06:05.948100] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-09. [2025-09-29T21:06:06.691853] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-29T21:06:06.700973] [INFO ] [REMOTE ] SID: Full fetch complete (60841 records). [2025-09-29T21:06:06.701112] [DEBUG] [VALIDATOR ] SID: Validating primary data. [2025-09-29T21:06:06.756222] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-05. [2025-09-29T21:06:06.833124] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-29T21:06:06.886076] [INFO ] [REMOTE ] SII: Full fetch complete (29983 records). [2025-09-29T21:06:06.893794] [DEBUG] [VALIDATOR ] SII: Validating primary data. [2025-09-29T21:06:07.439094] [DEBUG] [VALIDATOR ] SID: All expected trading days are present. [2025-09-29T21:06:07.442184] [DEBUG] [VALIDATOR ] SID: Primary data validation passed. [2025-09-29T21:06:07.443333] [INFO ] [MAIN ] SID: Fetched primary data is valid. [2025-09-29T21:06:07.443419] [DEBUG] [LOCAL ] SID: Saving primary data. [2025-09-29T21:06:07.471324] [DEBUG] [LOCAL ] SID: Trimmed 60841 records to 42361 (keeping 200 days of data) [2025-09-29T21:06:07.575272] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-01. [2025-09-29T21:06:07.599147] [DEBUG] [VALIDATOR ] SII: All expected trading days are present. [2025-09-29T21:06:07.599509] [DEBUG] [VALIDATOR ] SII: Primary data validation passed. [2025-09-29T21:06:07.599900] [INFO ] [MAIN ] SII: Fetched primary data is valid. [2025-09-29T21:06:07.600987] [DEBUG] [LOCAL ] SII: Saving primary data. [2025-09-29T21:06:07.636745] [DEBUG] [LOCAL ] SII: Trimmed 29983 records to 23405 (keeping 200 days of data) [2025-09-29T21:06:07.930172] [DEBUG] [LOCAL ] SII: Primary data saved (23405 records). [2025-09-29T21:06:07.930894] [INFO ] [MAIN ] SII: Full history saved. [2025-09-29T21:06:07.931564] [INFO ] [MAIN ] Update Progress: 1916/2371 symbols completed. SII took 21.5s. Estimated remaining: 58m 26s. Rate: 7.8 symbols/min [2025-09-29T21:06:08.113151] [DEBUG] [LOCAL ] SID: Primary data saved (42361 records). [2025-09-29T21:06:08.142809] [INFO ] [MAIN ] SID: Full history saved. [2025-09-29T21:06:08.142736] [INFO ] [MAIN ] SITC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:06:08.143039] [INFO ] [MAIN ] Update Progress: 1917/2371 symbols completed. SID took 29.5s. Estimated remaining: 58m 17s. Rate: 7.8 symbols/min [2025-09-29T21:06:08.188624] [DEBUG] [LOCAL ] SITC: Loaded 42233 existing records from primary storage. [2025-09-29T21:06:08.188955] [INFO ] [MAIN ] SITC: Loaded 42233 existing records. [2025-09-29T21:06:08.390476] [WARN ] [MAIN ] SITC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:06:08.390800] [INFO ] [MAIN ] SITC: Wiping existing primary data before full refresh. [2025-09-29T21:06:08.390888] [INFO ] [LOCAL ] SITC: Starting deletion of primary data. [2025-09-29T21:06:08.391414] [DEBUG] [LOCAL ] SITC: Deleted primary data file. [2025-09-29T21:06:08.391475] [INFO ] [MAIN ] SITC: Starting full primary refresh. [2025-09-29T21:06:08.783737] [INFO ] [REMOTE ] SITC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:06:08.784580] [INFO ] [REMOTE ] SITC: Fetching primary data for 2024-12. [2025-09-29T21:06:08.812294] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-29T21:06:09.091135] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-29T21:06:09.148071] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-02. [2025-09-29T21:06:09.948153] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-06. [2025-09-29T21:06:10.551955] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-29T21:06:10.598891] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-29T21:06:10.748166] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-03. [2025-09-29T21:06:11.548143] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-01. [2025-09-29T21:06:11.708988] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-29T21:06:12.230241] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-29T21:06:12.348104] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-07. [2025-09-29T21:06:13.148096] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-04. [2025-09-29T21:06:13.198413] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-29T21:06:13.948126] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-02. [2025-09-29T21:06:14.118780] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-29T21:06:14.189325] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-29T21:06:14.748127] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-05. [2025-09-29T21:06:15.408356] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-29T21:06:15.548157] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-03. [2025-09-29T21:06:16.254709] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-29T21:06:16.348134] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-06. [2025-09-29T21:06:17.150023] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-08. [2025-09-29T21:06:17.152775] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-29T21:06:17.542418] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-29T21:06:17.948106] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-04. [2025-09-29T21:06:18.623359] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-29T21:06:18.748173] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-07. [2025-09-29T21:06:19.565913] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-09. [2025-09-29T21:06:19.571599] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-29T21:06:20.181678] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-29T21:06:20.348148] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-05. [2025-09-29T21:06:21.148094] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-08. [2025-09-29T21:06:21.302597] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-29T21:06:21.312544] [INFO ] [REMOTE ] SIG: Full fetch complete (68033 records). [2025-09-29T21:06:21.312710] [DEBUG] [VALIDATOR ] SIG: Validating primary data. [2025-09-29T21:06:21.722798] [DEBUG] [VALIDATOR ] SIG: All expected trading days are present. [2025-09-29T21:06:21.722986] [DEBUG] [VALIDATOR ] SIG: Primary data validation passed. [2025-09-29T21:06:21.724117] [INFO ] [MAIN ] SIG: Fetched primary data is valid. [2025-09-29T21:06:21.724200] [DEBUG] [LOCAL ] SIG: Saving primary data. [2025-09-29T21:06:21.749958] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-29T21:06:21.747580] [DEBUG] [LOCAL ] SIG: Trimmed 68033 records to 46323 (keeping 200 days of data) [2025-09-29T21:06:21.971785] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-06. [2025-09-29T21:06:22.092765] [DEBUG] [LOCAL ] SIG: Primary data saved (46323 records). [2025-09-29T21:06:22.092917] [INFO ] [MAIN ] SIG: Full history saved. [2025-09-29T21:06:22.093142] [INFO ] [MAIN ] Update Progress: 1918/2371 symbols completed. SIG took 42.7s. Estimated remaining: 58m 11s. Rate: 7.8 symbols/min [2025-09-29T21:06:22.426553] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-29T21:06:22.748117] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-09. [2025-09-29T21:06:23.510067] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-29T21:06:23.548092] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-07. [2025-09-29T21:06:23.985758] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-29T21:06:23.992517] [INFO ] [REMOTE ] SILA: Full fetch complete (45082 records). [2025-09-29T21:06:23.992709] [DEBUG] [VALIDATOR ] SILA: Validating primary data. [2025-09-29T21:06:24.397624] [DEBUG] [VALIDATOR ] SILA: All expected trading days are present. [2025-09-29T21:06:24.397746] [DEBUG] [VALIDATOR ] SILA: Primary data validation passed. [2025-09-29T21:06:24.398608] [INFO ] [MAIN ] SILA: Fetched primary data is valid. [2025-09-29T21:06:24.398682] [DEBUG] [LOCAL ] SILA: Saving primary data. [2025-09-29T21:06:24.399789] [DEBUG] [LOCAL ] SILA: Trimmed 45082 records to 31020 (keeping 200 days of data) [2025-09-29T21:06:24.608252] [DEBUG] [LOCAL ] SILA: Primary data saved (31020 records). [2025-09-29T21:06:24.608410] [INFO ] [MAIN ] SILA: Full history saved. [2025-09-29T21:06:24.608498] [INFO ] [MAIN ] Update Progress: 1919/2371 symbols completed. SILA took 22.4s. Estimated remaining: 58m 2s. Rate: 7.8 symbols/min [2025-09-29T21:06:24.911467] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-29T21:06:24.921401] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-08. [2025-09-29T21:06:26.573960] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-29T21:06:26.583492] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-09. [2025-09-29T21:06:28.133855] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-29T21:06:28.143807] [INFO ] [REMOTE ] SITC: Full fetch complete (61077 records). [2025-09-29T21:06:28.143956] [DEBUG] [VALIDATOR ] SITC: Validating primary data. [2025-09-29T21:06:28.558363] [DEBUG] [VALIDATOR ] SITC: All expected trading days are present. [2025-09-29T21:06:28.558463] [DEBUG] [VALIDATOR ] SITC: Primary data validation passed. [2025-09-29T21:06:28.559715] [INFO ] [MAIN ] SITC: Fetched primary data is valid. [2025-09-29T21:06:28.559793] [DEBUG] [LOCAL ] SITC: Saving primary data. [2025-09-29T21:06:28.561235] [DEBUG] [LOCAL ] SITC: Trimmed 61077 records to 41628 (keeping 200 days of data) [2025-09-29T21:06:28.825014] [DEBUG] [LOCAL ] SITC: Primary data saved (41628 records). [2025-09-29T21:06:28.825261] [INFO ] [MAIN ] SITC: Full history saved. [2025-09-29T21:06:28.825455] [INFO ] [MAIN ] Update Progress: 1920/2371 symbols completed. SITC took 20.9s. Estimated remaining: 57m 53s. Rate: 7.8 symbols/min [2025-09-29T21:06:29.437791] [INFO ] [MAIN ] SITE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:06:29.483307] [INFO ] [MAIN ] SKE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:06:29.568233] [INFO ] [MAIN ] SJT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:06:29.597478] [INFO ] [MAIN ] SJM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:06:29.637258] [DEBUG] [LOCAL ] SJT: Loaded 22419 existing records from primary storage. [2025-09-29T21:06:29.645305] [INFO ] [MAIN ] SJT: Loaded 22419 existing records. [2025-09-29T21:06:29.791399] [DEBUG] [LOCAL ] SITE: Loaded 35513 existing records from primary storage. [2025-09-29T21:06:29.808785] [DEBUG] [LOCAL ] SKE: Loaded 36252 existing records from primary storage. [2025-09-29T21:06:29.819469] [INFO ] [MAIN ] SITE: Loaded 35513 existing records. [2025-09-29T21:06:29.892936] [INFO ] [MAIN ] SKE: Loaded 36252 existing records. [2025-09-29T21:06:29.935189] [WARN ] [MAIN ] SJT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:06:29.994726] [INFO ] [MAIN ] SJT: Wiping existing primary data before full refresh. [2025-09-29T21:06:30.041855] [INFO ] [LOCAL ] SJT: Starting deletion of primary data. [2025-09-29T21:06:30.058056] [DEBUG] [LOCAL ] SJM: Loaded 50877 existing records from primary storage. [2025-09-29T21:06:30.083516] [INFO ] [MAIN ] SJM: Loaded 50877 existing records. [2025-09-29T21:06:30.083751] [DEBUG] [LOCAL ] SJT: Deleted primary data file. [2025-09-29T21:06:30.147626] [INFO ] [MAIN ] SJT: Starting full primary refresh. [2025-09-29T21:06:30.372475] [WARN ] [MAIN ] SITE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:06:30.493240] [INFO ] [MAIN ] SITE: Wiping existing primary data before full refresh. [2025-09-29T21:06:30.529557] [INFO ] [LOCAL ] SITE: Starting deletion of primary data. [2025-09-29T21:06:30.606847] [WARN ] [MAIN ] SKE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:06:30.671439] [DEBUG] [LOCAL ] SITE: Deleted primary data file. [2025-09-29T21:06:30.671363] [INFO ] [MAIN ] SKE: Wiping existing primary data before full refresh. [2025-09-29T21:06:30.682849] [INFO ] [LOCAL ] SKE: Starting deletion of primary data. [2025-09-29T21:06:30.671159] [WARN ] [MAIN ] SJM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:06:30.686935] [INFO ] [MAIN ] SITE: Starting full primary refresh. [2025-09-29T21:06:30.689511] [INFO ] [MAIN ] SJM: Wiping existing primary data before full refresh. [2025-09-29T21:06:30.697200] [DEBUG] [LOCAL ] SKE: Deleted primary data file. [2025-09-29T21:06:30.717844] [INFO ] [MAIN ] SKE: Starting full primary refresh. [2025-09-29T21:06:30.717759] [INFO ] [LOCAL ] SJM: Starting deletion of primary data. [2025-09-29T21:06:30.774166] [DEBUG] [LOCAL ] SJM: Deleted primary data file. [2025-09-29T21:06:30.824131] [INFO ] [MAIN ] SJM: Starting full primary refresh. [2025-09-29T21:06:31.339803] [INFO ] [REMOTE ] SJT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:06:31.351863] [INFO ] [REMOTE ] SJT: Fetching primary data for 2024-12. [2025-09-29T21:06:32.179804] [INFO ] [REMOTE ] SITE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:06:32.213613] [INFO ] [REMOTE ] SJM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:06:32.205348] [INFO ] [REMOTE ] SKE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:06:32.214163] [INFO ] [REMOTE ] SITE: Fetching primary data for 2024-12. [2025-09-29T21:06:32.214483] [INFO ] [REMOTE ] SJM: Fetching primary data for 2024-12. [2025-09-29T21:06:32.216699] [INFO ] [REMOTE ] SKE: Fetching primary data for 2024-12. [2025-09-29T21:06:32.689777] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-29T21:06:32.695594] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-01. [2025-09-29T21:06:33.619585] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-29T21:06:33.626969] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-01. [2025-09-29T21:06:33.645262] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-29T21:06:33.655744] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-01. [2025-09-29T21:06:33.849156] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-29T21:06:33.853864] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-02. [2025-09-29T21:06:33.946065] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-29T21:06:33.957049] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-01. [2025-09-29T21:06:34.712899] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-29T21:06:34.719761] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-02. [2025-09-29T21:06:34.797678] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-29T21:06:34.804108] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-02. [2025-09-29T21:06:34.845811] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-29T21:06:34.851343] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-03. [2025-09-29T21:06:35.523489] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-29T21:06:35.548075] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-02. [2025-09-29T21:06:36.032544] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-29T21:06:36.150158] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-29T21:06:36.170714] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-29T21:06:36.348130] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-04. [2025-09-29T21:06:37.081395] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-29T21:06:37.148623] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-03. [2025-09-29T21:06:37.482308] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-29T21:06:37.948146] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-03. [2025-09-29T21:06:38.674060] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-29T21:06:38.748162] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-05. [2025-09-29T21:06:39.548129] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-03. [2025-09-29T21:06:39.701691] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-29T21:06:40.131398] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-29T21:06:40.348130] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-06. [2025-09-29T21:06:41.082711] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-29T21:06:41.148120] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-04. [2025-09-29T21:06:41.434277] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-29T21:06:41.948131] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-04. [2025-09-29T21:06:42.748117] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-04. [2025-09-29T21:06:43.002250] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-29T21:06:43.548117] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-07. [2025-09-29T21:06:43.659054] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-29T21:06:43.945848] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-29T21:06:44.348122] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-05. [2025-09-29T21:06:44.657959] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-29T21:06:45.148156] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-05. [2025-09-29T21:06:45.893362] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-29T21:06:45.948087] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-06. [2025-09-29T21:06:46.748150] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-08. [2025-09-29T21:06:46.807313] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-29T21:06:47.024921] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-29T21:06:47.548175] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-07. [2025-09-29T21:06:47.696908] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-29T21:06:48.348138] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-09. [2025-09-29T21:06:48.687768] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-29T21:06:49.148145] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-08. [2025-09-29T21:06:49.476478] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-29T21:06:49.481203] [INFO ] [REMOTE ] SJT: Full fetch complete (32105 records). [2025-09-29T21:06:49.481318] [DEBUG] [VALIDATOR ] SJT: Validating primary data. [2025-09-29T21:06:49.878637] [DEBUG] [VALIDATOR ] SJT: All expected trading days are present. [2025-09-29T21:06:49.878769] [DEBUG] [VALIDATOR ] SJT: Primary data validation passed. [2025-09-29T21:06:49.879589] [INFO ] [MAIN ] SJT: Fetched primary data is valid. [2025-09-29T21:06:49.879683] [DEBUG] [LOCAL ] SJT: Saving primary data. [2025-09-29T21:06:49.880592] [DEBUG] [LOCAL ] SJT: Trimmed 32105 records to 22132 (keeping 200 days of data) [2025-09-29T21:06:49.963441] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-06. [2025-09-29T21:06:50.017870] [DEBUG] [LOCAL ] SJT: Primary data saved (22132 records). [2025-09-29T21:06:50.018008] [INFO ] [MAIN ] SJT: Full history saved. [2025-09-29T21:06:50.018097] [INFO ] [MAIN ] Update Progress: 1921/2371 symbols completed. SJT took 21.2s. Estimated remaining: 57m 49s. Rate: 7.8 symbols/min [2025-09-29T21:06:50.199058] [INFO ] [MAIN ] SKIL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:06:50.208844] [DEBUG] [LOCAL ] SKIL: Loaded 6395 existing records from primary storage. [2025-09-29T21:06:50.209092] [INFO ] [MAIN ] SKIL: Loaded 6395 existing records. [2025-09-29T21:06:50.403246] [WARN ] [MAIN ] SKIL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:06:50.403537] [INFO ] [MAIN ] SKIL: Wiping existing primary data before full refresh. [2025-09-29T21:06:50.403590] [INFO ] [LOCAL ] SKIL: Starting deletion of primary data. [2025-09-29T21:06:50.403806] [DEBUG] [LOCAL ] SKIL: Deleted primary data file. [2025-09-29T21:06:50.403866] [INFO ] [MAIN ] SKIL: Starting full primary refresh. [2025-09-29T21:06:50.749436] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-05. [2025-09-29T21:06:50.810346] [INFO ] [REMOTE ] SKIL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:06:50.834241] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-29T21:06:51.431192] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-29T21:06:51.548115] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-09. [2025-09-29T21:06:52.348123] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2024-12. [2025-09-29T21:06:52.613824] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-29T21:06:53.080100] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-29T21:06:53.088101] [INFO ] [REMOTE ] SITE: Full fetch complete (49370 records). [2025-09-29T21:06:53.088220] [DEBUG] [VALIDATOR ] SITE: Validating primary data. [2025-09-29T21:06:53.153191] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-07. [2025-09-29T21:06:53.245556] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-29T21:06:53.498887] [DEBUG] [VALIDATOR ] SITE: All expected trading days are present. [2025-09-29T21:06:53.499009] [DEBUG] [VALIDATOR ] SITE: Primary data validation passed. [2025-09-29T21:06:53.500029] [INFO ] [MAIN ] SITE: Fetched primary data is valid. [2025-09-29T21:06:53.500096] [DEBUG] [LOCAL ] SITE: Saving primary data. [2025-09-29T21:06:53.501260] [DEBUG] [LOCAL ] SITE: Trimmed 49370 records to 35027 (keeping 200 days of data) [2025-09-29T21:06:53.721143] [DEBUG] [LOCAL ] SITE: Primary data saved (35027 records). [2025-09-29T21:06:53.721300] [INFO ] [MAIN ] SITE: Full history saved. [2025-09-29T21:06:53.721479] [INFO ] [MAIN ] Update Progress: 1922/2371 symbols completed. SITE took 24.9s. Estimated remaining: 57m 40s. Rate: 7.8 symbols/min [2025-09-29T21:06:53.898871] [INFO ] [MAIN ] SKLZ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:06:53.912872] [DEBUG] [LOCAL ] SKLZ: Loaded 12122 existing records from primary storage. [2025-09-29T21:06:53.913116] [INFO ] [MAIN ] SKLZ: Loaded 12122 existing records. [2025-09-29T21:06:53.955451] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-06. [2025-09-29T21:06:54.114310] [WARN ] [MAIN ] SKLZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:06:54.114555] [INFO ] [MAIN ] SKLZ: Wiping existing primary data before full refresh. [2025-09-29T21:06:54.114604] [INFO ] [LOCAL ] SKLZ: Starting deletion of primary data. [2025-09-29T21:06:54.114884] [DEBUG] [LOCAL ] SKLZ: Deleted primary data file. [2025-09-29T21:06:54.114943] [INFO ] [MAIN ] SKLZ: Starting full primary refresh. [2025-09-29T21:06:54.502687] [INFO ] [REMOTE ] SKLZ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:06:54.722291] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-29T21:06:54.748097] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-08. [2025-09-29T21:06:55.548133] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-01. [2025-09-29T21:06:56.004936] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-29T21:06:56.232397] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-29T21:06:56.348079] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-07. [2025-09-29T21:06:56.443171] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-29T21:06:57.148113] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2024-12. [2025-09-29T21:06:57.948118] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-09. [2025-09-29T21:06:58.221258] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-29T21:06:58.247180] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-29T21:06:58.748116] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-08. [2025-09-29T21:06:59.545044] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-29T21:06:59.553296] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-02. [2025-09-29T21:06:59.555116] [INFO ] [REMOTE ] SKE: Full fetch complete (50382 records). [2025-09-29T21:06:59.555224] [DEBUG] [VALIDATOR ] SKE: Validating primary data. [2025-09-29T21:06:59.953530] [DEBUG] [VALIDATOR ] SKE: All expected trading days are present. [2025-09-29T21:06:59.953610] [DEBUG] [VALIDATOR ] SKE: Primary data validation passed. [2025-09-29T21:06:59.954633] [INFO ] [MAIN ] SKE: Fetched primary data is valid. [2025-09-29T21:06:59.954719] [DEBUG] [LOCAL ] SKE: Saving primary data. [2025-09-29T21:06:59.955842] [DEBUG] [LOCAL ] SKE: Trimmed 50382 records to 35818 (keeping 200 days of data) [2025-09-29T21:07:00.177540] [DEBUG] [LOCAL ] SKE: Primary data saved (35818 records). [2025-09-29T21:07:00.177722] [INFO ] [MAIN ] SKE: Full history saved. [2025-09-29T21:07:00.177824] [INFO ] [MAIN ] Update Progress: 1923/2371 symbols completed. SKE took 31.4s. Estimated remaining: 57m 32s. Rate: 7.8 symbols/min [2025-09-29T21:07:00.361921] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-01. [2025-09-29T21:07:00.365799] [INFO ] [MAIN ] SKM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:07:00.378407] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-29T21:07:00.412398] [DEBUG] [LOCAL ] SKM: Loaded 35557 existing records from primary storage. [2025-09-29T21:07:00.412719] [INFO ] [MAIN ] SKM: Loaded 35557 existing records. [2025-09-29T21:07:00.604701] [WARN ] [MAIN ] SKM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:07:00.605189] [INFO ] [MAIN ] SKM: Wiping existing primary data before full refresh. [2025-09-29T21:07:00.605325] [INFO ] [LOCAL ] SKM: Starting deletion of primary data. [2025-09-29T21:07:00.605890] [DEBUG] [LOCAL ] SKM: Deleted primary data file. [2025-09-29T21:07:00.605958] [INFO ] [MAIN ] SKM: Starting full primary refresh. [2025-09-29T21:07:01.017597] [INFO ] [REMOTE ] SKM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:07:01.020808] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-29T21:07:01.148105] [INFO ] [REMOTE ] SKM: Fetching primary data for 2024-12. [2025-09-29T21:07:01.489199] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-29T21:07:01.948128] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-02. [2025-09-29T21:07:02.398536] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-29T21:07:02.748110] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-01. [2025-09-29T21:07:02.836046] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-29T21:07:03.548172] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-03. [2025-09-29T21:07:04.003034] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-29T21:07:04.348088] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-02. [2025-09-29T21:07:04.519735] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-29T21:07:05.148112] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-09. [2025-09-29T21:07:05.670064] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-29T21:07:05.948132] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-03. [2025-09-29T21:07:06.748095] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-04. [2025-09-29T21:07:07.104053] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-29T21:07:07.115301] [INFO ] [REMOTE ] SJM: Full fetch complete (72053 records). [2025-09-29T21:07:07.115414] [DEBUG] [VALIDATOR ] SJM: Validating primary data. [2025-09-29T21:07:07.508073] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-29T21:07:07.554824] [DEBUG] [VALIDATOR ] SJM: All expected trading days are present. [2025-09-29T21:07:07.555014] [DEBUG] [VALIDATOR ] SJM: Primary data validation passed. [2025-09-29T21:07:07.554119] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-03. [2025-09-29T21:07:07.556384] [INFO ] [MAIN ] SJM: Fetched primary data is valid. [2025-09-29T21:07:07.556538] [DEBUG] [LOCAL ] SJM: Saving primary data. [2025-09-29T21:07:07.560323] [DEBUG] [LOCAL ] SJM: Trimmed 72053 records to 50123 (keeping 200 days of data) [2025-09-29T21:07:07.790803] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-29T21:07:07.899716] [DEBUG] [LOCAL ] SJM: Primary data saved (50123 records). [2025-09-29T21:07:07.899874] [INFO ] [MAIN ] SJM: Full history saved. [2025-09-29T21:07:07.899960] [INFO ] [MAIN ] Update Progress: 1924/2371 symbols completed. SJM took 39.1s. Estimated remaining: 57m 24s. Rate: 7.8 symbols/min [2025-09-29T21:07:08.074528] [INFO ] [MAIN ] SKT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:07:08.118913] [DEBUG] [LOCAL ] SKT: Loaded 43227 existing records from primary storage. [2025-09-29T21:07:08.119267] [INFO ] [MAIN ] SKT: Loaded 43227 existing records. [2025-09-29T21:07:08.329305] [WARN ] [MAIN ] SKT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:07:08.335728] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-29T21:07:08.335947] [INFO ] [MAIN ] SKT: Wiping existing primary data before full refresh. [2025-09-29T21:07:08.338795] [INFO ] [LOCAL ] SKT: Starting deletion of primary data. [2025-09-29T21:07:08.339473] [DEBUG] [LOCAL ] SKT: Deleted primary data file. [2025-09-29T21:07:08.339551] [INFO ] [MAIN ] SKT: Starting full primary refresh. [2025-09-29T21:07:08.354980] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-04. [2025-09-29T21:07:08.858554] [INFO ] [REMOTE ] SKT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:07:09.148158] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-05. [2025-09-29T21:07:09.948105] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-04. [2025-09-29T21:07:10.025819] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-29T21:07:10.047390] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-29T21:07:10.748088] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-05. [2025-09-29T21:07:10.826392] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-29T21:07:11.548126] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-06. [2025-09-29T21:07:12.348094] [INFO ] [REMOTE ] SKT: Fetching primary data for 2024-12. [2025-09-29T21:07:12.376208] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-29T21:07:12.482459] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-29T21:07:13.148143] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-06. [2025-09-29T21:07:13.845494] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-29T21:07:13.948140] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-07. [2025-09-29T21:07:14.532482] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-29T21:07:14.734521] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-29T21:07:14.748068] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-01. [2025-09-29T21:07:15.548155] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-08. [2025-09-29T21:07:16.243355] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-29T21:07:16.348160] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-05. [2025-09-29T21:07:16.644183] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-29T21:07:16.963251] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-29T21:07:17.148131] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-09. [2025-09-29T21:07:17.948130] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-06. [2025-09-29T21:07:18.141285] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-29T21:07:18.145322] [INFO ] [REMOTE ] SKLZ: Full fetch complete (18948 records). [2025-09-29T21:07:18.145433] [DEBUG] [VALIDATOR ] SKLZ: Validating primary data. [2025-09-29T21:07:18.536359] [DEBUG] [VALIDATOR ] SKLZ: All expected trading days are present. [2025-09-29T21:07:18.536453] [DEBUG] [VALIDATOR ] SKLZ: Primary data validation passed. [2025-09-29T21:07:18.537096] [INFO ] [MAIN ] SKLZ: Fetched primary data is valid. [2025-09-29T21:07:18.537164] [DEBUG] [LOCAL ] SKLZ: Saving primary data. [2025-09-29T21:07:18.537855] [DEBUG] [LOCAL ] SKLZ: Trimmed 18948 records to 11939 (keeping 200 days of data) [2025-09-29T21:07:18.610756] [DEBUG] [LOCAL ] SKLZ: Primary data saved (11939 records). [2025-09-29T21:07:18.610937] [INFO ] [MAIN ] SKLZ: Full history saved. [2025-09-29T21:07:18.611036] [INFO ] [MAIN ] Update Progress: 1925/2371 symbols completed. SKLZ took 24.9s. Estimated remaining: 57m 17s. Rate: 7.8 symbols/min [2025-09-29T21:07:18.764448] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-02. [2025-09-29T21:07:18.802618] [INFO ] [MAIN ] SKY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:07:18.811857] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-29T21:07:18.857661] [DEBUG] [LOCAL ] SKY: Loaded 38305 existing records from primary storage. [2025-09-29T21:07:18.858096] [INFO ] [MAIN ] SKY: Loaded 38305 existing records. [2025-09-29T21:07:19.053596] [WARN ] [MAIN ] SKY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:07:19.053904] [INFO ] [MAIN ] SKY: Wiping existing primary data before full refresh. [2025-09-29T21:07:19.053955] [INFO ] [LOCAL ] SKY: Starting deletion of primary data. [2025-09-29T21:07:19.054300] [DEBUG] [LOCAL ] SKY: Deleted primary data file. [2025-09-29T21:07:19.054362] [INFO ] [MAIN ] SKY: Starting full primary refresh. [2025-09-29T21:07:19.427953] [INFO ] [REMOTE ] SKY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:07:19.548123] [INFO ] [REMOTE ] SKY: Fetching primary data for 2024-12. [2025-09-29T21:07:20.287695] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-29T21:07:20.348119] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-03. [2025-09-29T21:07:21.006465] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-29T21:07:21.148117] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-07. [2025-09-29T21:07:21.949030] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-07. [2025-09-29T21:07:21.955401] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-29T21:07:21.971959] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-29T21:07:22.748151] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-08. [2025-09-29T21:07:23.408997] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-29T21:07:23.474932] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-29T21:07:23.548166] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-01. [2025-09-29T21:07:24.348150] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-04. [2025-09-29T21:07:25.119234] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-29T21:07:25.148080] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-02. [2025-09-29T21:07:25.948112] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-09. [2025-09-29T21:07:26.078796] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-29T21:07:26.697982] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-29T21:07:26.700431] [INFO ] [REMOTE ] SKIL: Full fetch complete (10165 records). [2025-09-29T21:07:26.700611] [DEBUG] [VALIDATOR ] SKIL: Validating primary data. [2025-09-29T21:07:26.761705] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-05. [2025-09-29T21:07:26.830814] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-29T21:07:27.102945] [DEBUG] [VALIDATOR ] SKIL: All expected trading days are present. [2025-09-29T21:07:27.103027] [DEBUG] [VALIDATOR ] SKIL: Primary data validation passed. [2025-09-29T21:07:27.103317] [INFO ] [MAIN ] SKIL: Fetched primary data is valid. [2025-09-29T21:07:27.103384] [DEBUG] [LOCAL ] SKIL: Saving primary data. [2025-09-29T21:07:27.103866] [DEBUG] [LOCAL ] SKIL: Trimmed 10165 records to 6287 (keeping 200 days of data) [2025-09-29T21:07:27.142769] [DEBUG] [LOCAL ] SKIL: Primary data saved (6287 records). [2025-09-29T21:07:27.142924] [INFO ] [MAIN ] SKIL: Full history saved. [2025-09-29T21:07:27.143106] [INFO ] [MAIN ] Update Progress: 1926/2371 symbols completed. SKIL took 37.1s. Estimated remaining: 57m 10s. Rate: 7.8 symbols/min [2025-09-29T21:07:27.321094] [INFO ] [MAIN ] SKYH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:07:27.340690] [DEBUG] [LOCAL ] SKYH: Loaded 16851 existing records from primary storage. [2025-09-29T21:07:27.340992] [INFO ] [MAIN ] SKYH: Loaded 16851 existing records. [2025-09-29T21:07:27.527564] [WARN ] [MAIN ] SKYH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:07:27.527854] [INFO ] [MAIN ] SKYH: Wiping existing primary data before full refresh. [2025-09-29T21:07:27.527915] [INFO ] [LOCAL ] SKYH: Starting deletion of primary data. [2025-09-29T21:07:27.528226] [DEBUG] [LOCAL ] SKYH: Deleted primary data file. [2025-09-29T21:07:27.528286] [INFO ] [MAIN ] SKYH: Starting full primary refresh. [2025-09-29T21:07:27.559155] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-08. [2025-09-29T21:07:27.911412] [INFO ] [REMOTE ] SKYH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:07:28.348110] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2024-12. [2025-09-29T21:07:28.515120] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-29T21:07:29.016297] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-29T21:07:29.148103] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-09. [2025-09-29T21:07:29.462261] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-29T21:07:29.948117] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-03. [2025-09-29T21:07:30.552222] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-29T21:07:30.559384] [INFO ] [REMOTE ] SKM: Full fetch complete (47987 records). [2025-09-29T21:07:30.559531] [DEBUG] [VALIDATOR ] SKM: Validating primary data. [2025-09-29T21:07:30.753211] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-01. [2025-09-29T21:07:30.953348] [DEBUG] [VALIDATOR ] SKM: All expected trading days are present. [2025-09-29T21:07:30.953435] [DEBUG] [VALIDATOR ] SKM: Primary data validation passed. [2025-09-29T21:07:30.954338] [INFO ] [MAIN ] SKM: Fetched primary data is valid. [2025-09-29T21:07:30.954403] [DEBUG] [LOCAL ] SKM: Saving primary data. [2025-09-29T21:07:30.955577] [DEBUG] [LOCAL ] SKM: Trimmed 47987 records to 34959 (keeping 200 days of data) [2025-09-29T21:07:31.202523] [DEBUG] [LOCAL ] SKM: Primary data saved (34959 records). [2025-09-29T21:07:31.202858] [INFO ] [MAIN ] SKM: Full history saved. [2025-09-29T21:07:31.203072] [INFO ] [MAIN ] Update Progress: 1927/2371 symbols completed. SKM took 31.0s. Estimated remaining: 57m 1s. Rate: 7.8 symbols/min [2025-09-29T21:07:31.210097] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-29T21:07:31.391196] [INFO ] [MAIN ] SLB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:07:31.450348] [DEBUG] [LOCAL ] SLB: Loaded 54477 existing records from primary storage. [2025-09-29T21:07:31.450744] [INFO ] [MAIN ] SLB: Loaded 54477 existing records. [2025-09-29T21:07:31.553958] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-04. [2025-09-29T21:07:31.647298] [WARN ] [MAIN ] SLB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:07:31.647739] [INFO ] [MAIN ] SLB: Wiping existing primary data before full refresh. [2025-09-29T21:07:31.647825] [INFO ] [LOCAL ] SLB: Starting deletion of primary data. [2025-09-29T21:07:31.648409] [DEBUG] [LOCAL ] SLB: Deleted primary data file. [2025-09-29T21:07:31.648469] [INFO ] [MAIN ] SLB: Starting full primary refresh. [2025-09-29T21:07:31.787344] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-29T21:07:32.065328] [INFO ] [REMOTE ] SLB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:07:32.348171] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-02. [2025-09-29T21:07:32.938580] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-29T21:07:33.148164] [INFO ] [REMOTE ] SLB: Fetching primary data for 2024-12. [2025-09-29T21:07:33.187696] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-29T21:07:33.948128] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-03. [2025-09-29T21:07:34.748153] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-05. [2025-09-29T21:07:35.070409] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-29T21:07:35.325967] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-29T21:07:35.548150] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-01. [2025-09-29T21:07:36.330057] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-29T21:07:36.348072] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-06. [2025-09-29T21:07:37.148121] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-04. [2025-09-29T21:07:37.663522] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-29T21:07:37.948129] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-02. [2025-09-29T21:07:38.027936] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-29T21:07:38.436144] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-29T21:07:38.748190] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-05. [2025-09-29T21:07:39.548091] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-07. [2025-09-29T21:07:39.799414] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-29T21:07:39.945596] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-29T21:07:40.348115] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-06. [2025-09-29T21:07:41.126307] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-29T21:07:41.148081] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-08. [2025-09-29T21:07:41.810690] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-29T21:07:41.948146] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-07. [2025-09-29T21:07:42.647712] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-29T21:07:42.748149] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-06. [2025-09-29T21:07:43.316685] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-29T21:07:43.548112] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-09. [2025-09-29T21:07:43.967523] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-29T21:07:44.348135] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-07. [2025-09-29T21:07:45.127344] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-29T21:07:45.135869] [INFO ] [REMOTE ] SKY: Full fetch complete (54862 records). [2025-09-29T21:07:45.135996] [DEBUG] [VALIDATOR ] SKY: Validating primary data. [2025-09-29T21:07:45.153343] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-08. [2025-09-29T21:07:45.476779] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-29T21:07:45.562307] [DEBUG] [VALIDATOR ] SKY: All expected trading days are present. [2025-09-29T21:07:45.562406] [DEBUG] [VALIDATOR ] SKY: Primary data validation passed. [2025-09-29T21:07:45.563424] [INFO ] [MAIN ] SKY: Fetched primary data is valid. [2025-09-29T21:07:45.563494] [DEBUG] [LOCAL ] SKY: Saving primary data. [2025-09-29T21:07:45.564702] [DEBUG] [LOCAL ] SKY: Trimmed 54862 records to 37686 (keeping 200 days of data) [2025-09-29T21:07:45.794155] [DEBUG] [LOCAL ] SKY: Primary data saved (37686 records). [2025-09-29T21:07:45.794327] [INFO ] [MAIN ] SKY: Full history saved. [2025-09-29T21:07:45.794438] [INFO ] [MAIN ] Update Progress: 1928/2371 symbols completed. SKY took 27.2s. Estimated remaining: 56m 55s. Rate: 7.8 symbols/min [2025-09-29T21:07:45.956508] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-08. [2025-09-29T21:07:45.978810] [INFO ] [MAIN ] SLF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:07:46.018907] [DEBUG] [LOCAL ] SLF: Loaded 39426 existing records from primary storage. [2025-09-29T21:07:46.019240] [INFO ] [MAIN ] SLF: Loaded 39426 existing records. [2025-09-29T21:07:46.203769] [WARN ] [MAIN ] SLF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:07:46.204055] [INFO ] [MAIN ] SLF: Wiping existing primary data before full refresh. [2025-09-29T21:07:46.204105] [INFO ] [LOCAL ] SLF: Starting deletion of primary data. [2025-09-29T21:07:46.204476] [DEBUG] [LOCAL ] SLF: Deleted primary data file. [2025-09-29T21:07:46.204536] [INFO ] [MAIN ] SLF: Starting full primary refresh. [2025-09-29T21:07:46.593603] [INFO ] [REMOTE ] SLF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:07:46.748113] [INFO ] [REMOTE ] SLF: Fetching primary data for 2024-12. [2025-09-29T21:07:46.855967] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-29T21:07:46.888725] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-29T21:07:47.548162] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-03. [2025-09-29T21:07:48.183559] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-29T21:07:48.348118] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-09. [2025-09-29T21:07:48.918150] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-29T21:07:48.921996] [INFO ] [REMOTE ] SKYH: Full fetch complete (22612 records). [2025-09-29T21:07:48.922094] [DEBUG] [VALIDATOR ] SKYH: Validating primary data. [2025-09-29T21:07:49.159050] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-01. [2025-09-29T21:07:49.327974] [DEBUG] [VALIDATOR ] SKYH: All expected trading days are present. [2025-09-29T21:07:49.328215] [DEBUG] [VALIDATOR ] SKYH: Primary data validation passed. [2025-09-29T21:07:49.328871] [INFO ] [MAIN ] SKYH: Fetched primary data is valid. [2025-09-29T21:07:49.328938] [DEBUG] [LOCAL ] SKYH: Saving primary data. [2025-09-29T21:07:49.329747] [DEBUG] [LOCAL ] SKYH: Trimmed 22612 records to 16530 (keeping 200 days of data) [2025-09-29T21:07:49.433761] [DEBUG] [LOCAL ] SKYH: Primary data saved (16530 records). [2025-09-29T21:07:49.433980] [INFO ] [MAIN ] SKYH: Full history saved. [2025-09-29T21:07:49.434077] [INFO ] [MAIN ] Update Progress: 1929/2371 symbols completed. SKYH took 22.3s. Estimated remaining: 56m 46s. Rate: 7.8 symbols/min [2025-09-29T21:07:49.625278] [INFO ] [MAIN ] SLG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:07:49.677563] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-29T21:07:49.726632] [DEBUG] [LOCAL ] SLG: Loaded 46130 existing records from primary storage. [2025-09-29T21:07:49.726971] [INFO ] [MAIN ] SLG: Loaded 46130 existing records. [2025-09-29T21:07:49.909150] [WARN ] [MAIN ] SLG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:07:49.909418] [INFO ] [MAIN ] SLG: Wiping existing primary data before full refresh. [2025-09-29T21:07:49.909468] [INFO ] [LOCAL ] SLG: Starting deletion of primary data. [2025-09-29T21:07:49.910129] [DEBUG] [LOCAL ] SLG: Deleted primary data file. [2025-09-29T21:07:49.910190] [INFO ] [MAIN ] SLG: Starting full primary refresh. [2025-09-29T21:07:49.953260] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-09. [2025-09-29T21:07:50.293709] [INFO ] [REMOTE ] SLG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:07:50.406148] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-29T21:07:50.748151] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-02. [2025-09-29T21:07:51.548106] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-04. [2025-09-29T21:07:51.699756] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-29T21:07:51.708762] [INFO ] [REMOTE ] SKT: Full fetch complete (60175 records). [2025-09-29T21:07:51.708897] [DEBUG] [VALIDATOR ] SKT: Validating primary data. [2025-09-29T21:07:52.165248] [DEBUG] [VALIDATOR ] SKT: All expected trading days are present. [2025-09-29T21:07:52.165500] [DEBUG] [VALIDATOR ] SKT: Primary data validation passed. [2025-09-29T21:07:52.166934] [INFO ] [MAIN ] SKT: Fetched primary data is valid. [2025-09-29T21:07:52.167108] [DEBUG] [LOCAL ] SKT: Saving primary data. [2025-09-29T21:07:52.176989] [DEBUG] [LOCAL ] SKT: Trimmed 60175 records to 42517 (keeping 200 days of data) [2025-09-29T21:07:52.197844] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-29T21:07:52.381741] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-03. [2025-09-29T21:07:52.474848] [DEBUG] [LOCAL ] SKT: Primary data saved (42517 records). [2025-09-29T21:07:52.474987] [INFO ] [MAIN ] SKT: Full history saved. [2025-09-29T21:07:52.475072] [INFO ] [MAIN ] Update Progress: 1930/2371 symbols completed. SKT took 44.6s. Estimated remaining: 56m 38s. Rate: 7.8 symbols/min [2025-09-29T21:07:52.651040] [INFO ] [MAIN ] SLGN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:07:52.696893] [DEBUG] [LOCAL ] SLGN: Loaded 41039 existing records from primary storage. [2025-09-29T21:07:52.697241] [INFO ] [MAIN ] SLGN: Loaded 41039 existing records. [2025-09-29T21:07:52.883570] [WARN ] [MAIN ] SLGN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:07:52.883896] [INFO ] [MAIN ] SLGN: Wiping existing primary data before full refresh. [2025-09-29T21:07:52.883957] [INFO ] [LOCAL ] SLGN: Starting deletion of primary data. [2025-09-29T21:07:52.884567] [DEBUG] [LOCAL ] SLGN: Deleted primary data file. [2025-09-29T21:07:52.884627] [INFO ] [MAIN ] SLGN: Starting full primary refresh. [2025-09-29T21:07:53.153190] [INFO ] [REMOTE ] SLG: Fetching primary data for 2024-12. [2025-09-29T21:07:53.260400] [INFO ] [REMOTE ] SLGN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:07:53.776454] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-29T21:07:53.905873] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-29T21:07:53.948076] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-05. [2025-09-29T21:07:54.748108] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-04. [2025-09-29T21:07:54.998304] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-29T21:07:55.548113] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-01. [2025-09-29T21:07:56.102564] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-29T21:07:56.348112] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2024-12. [2025-09-29T21:07:56.410705] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-29T21:07:57.148098] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-05. [2025-09-29T21:07:57.252491] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-29T21:07:57.883408] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-29T21:07:57.948120] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-02. [2025-09-29T21:07:58.691362] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-29T21:07:58.748125] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-01. [2025-09-29T21:07:59.548104] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-06. [2025-09-29T21:07:59.620473] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-29T21:08:00.274517] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-29T21:08:00.348127] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-06. [2025-09-29T21:08:01.148203] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-02. [2025-09-29T21:08:01.229487] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-29T21:08:01.948127] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-03. [2025-09-29T21:08:02.556858] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-09-29T21:08:02.721086] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-29T21:08:02.748077] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-07. [2025-09-29T21:08:03.548115] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-03. [2025-09-29T21:08:03.777569] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-29T21:08:04.348105] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-04. [2025-09-29T21:08:04.495055] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-29T21:08:05.148103] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-08. [2025-09-29T21:08:05.250192] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-29T21:08:05.820518] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-29T21:08:05.948155] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-04. [2025-09-29T21:08:06.748150] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-07. [2025-09-29T21:08:06.935364] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-29T21:08:07.557890] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-05. [2025-09-29T21:08:07.564836] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-29T21:08:08.348105] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-09. [2025-09-29T21:08:09.051149] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-09-29T21:08:09.148138] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-08. [2025-09-29T21:08:09.689514] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-29T21:08:09.773582] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-29T21:08:09.781620] [INFO ] [REMOTE ] SLF: Full fetch complete (56397 records). [2025-09-29T21:08:09.781845] [DEBUG] [VALIDATOR ] SLF: Validating primary data. [2025-09-29T21:08:09.950341] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-06. [2025-09-29T21:08:10.195621] [DEBUG] [VALIDATOR ] SLF: All expected trading days are present. [2025-09-29T21:08:10.195736] [DEBUG] [VALIDATOR ] SLF: Primary data validation passed. [2025-09-29T21:08:10.196813] [INFO ] [MAIN ] SLF: Fetched primary data is valid. [2025-09-29T21:08:10.196879] [DEBUG] [LOCAL ] SLF: Saving primary data. [2025-09-29T21:08:10.198176] [DEBUG] [LOCAL ] SLF: Trimmed 56397 records to 38739 (keeping 200 days of data) [2025-09-29T21:08:10.442573] [DEBUG] [LOCAL ] SLF: Primary data saved (38739 records). [2025-09-29T21:08:10.442759] [INFO ] [MAIN ] SLF: Full history saved. [2025-09-29T21:08:10.442911] [INFO ] [MAIN ] Update Progress: 1931/2371 symbols completed. SLF took 24.6s. Estimated remaining: 56m 32s. Rate: 7.8 symbols/min [2025-09-29T21:08:10.614181] [INFO ] [MAIN ] SLNZ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:08:10.614400] [DEBUG] [LOCAL ] SLNZ: No existing data file found in primary storage. [2025-09-29T21:08:10.614456] [WARN ] [MAIN ] SLNZ: No existing data found, performing full refresh instead. [2025-09-29T21:08:10.614588] [INFO ] [MAIN ] SLNZ: Wiping existing primary data before full refresh. [2025-09-29T21:08:10.614661] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-09-29T21:08:10.614733] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-09-29T21:08:10.614771] [INFO ] [MAIN ] SLNZ: Starting full primary refresh. [2025-09-29T21:08:10.764011] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-05. [2025-09-29T21:08:11.058815] [INFO ] [REMOTE ] SLNZ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:08:11.359499] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-29T21:08:11.548091] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-09. [2025-09-29T21:08:11.813267] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-29T21:08:11.900738] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-29T21:08:12.348130] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-07. [2025-09-29T21:08:13.148147] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-06. [2025-09-29T21:08:13.693762] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-29T21:08:13.706549] [INFO ] [REMOTE ] SLB: Full fetch complete (77740 records). [2025-09-29T21:08:13.706864] [DEBUG] [VALIDATOR ] SLB: Validating primary data. [2025-09-29T21:08:13.953425] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2024-12. [2025-09-29T21:08:14.164915] [DEBUG] [VALIDATOR ] SLB: All expected trading days are present. [2025-09-29T21:08:14.165098] [DEBUG] [VALIDATOR ] SLB: Primary data validation passed. [2025-09-29T21:08:14.166589] [INFO ] [MAIN ] SLB: Fetched primary data is valid. [2025-09-29T21:08:14.166704] [DEBUG] [LOCAL ] SLB: Saving primary data. [2025-09-29T21:08:14.199697] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-29T21:08:14.210555] [DEBUG] [LOCAL ] SLB: Trimmed 77740 records to 53697 (keeping 200 days of data) [2025-09-29T21:08:14.320707] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-09-29T21:08:14.583275] [DEBUG] [LOCAL ] SLB: Primary data saved (53697 records). [2025-09-29T21:08:14.583439] [INFO ] [MAIN ] SLB: Full history saved. [2025-09-29T21:08:14.583562] [INFO ] [MAIN ] Update Progress: 1932/2371 symbols completed. SLB took 43.4s. Estimated remaining: 56m 24s. Rate: 7.8 symbols/min [2025-09-29T21:08:14.782368] [INFO ] [MAIN ] SLQT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:08:14.777778] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-08. [2025-09-29T21:08:14.808453] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-29T21:08:14.856186] [DEBUG] [LOCAL ] SLQT: Loaded 44370 existing records from primary storage. [2025-09-29T21:08:14.856510] [INFO ] [MAIN ] SLQT: Loaded 44370 existing records. [2025-09-29T21:08:15.042864] [WARN ] [MAIN ] SLQT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:08:15.043076] [INFO ] [MAIN ] SLQT: Wiping existing primary data before full refresh. [2025-09-29T21:08:15.043125] [INFO ] [LOCAL ] SLQT: Starting deletion of primary data. [2025-09-29T21:08:15.043510] [DEBUG] [LOCAL ] SLQT: Deleted primary data file. [2025-09-29T21:08:15.043570] [INFO ] [MAIN ] SLQT: Starting full primary refresh. [2025-09-29T21:08:15.414355] [INFO ] [REMOTE ] SLQT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:08:15.548166] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-07. [2025-09-29T21:08:16.348105] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-01. [2025-09-29T21:08:16.539478] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-29T21:08:16.687541] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-29T21:08:17.148127] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-02. [2025-09-29T21:08:17.187330] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-29T21:08:17.360459] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-02 (0.21 seconds). [2025-09-29T21:08:17.948117] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-03. [2025-09-29T21:08:18.228511] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-09-29T21:08:18.748172] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-09. [2025-09-29T21:08:19.548114] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2024-12. [2025-09-29T21:08:20.348091] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-04. [2025-09-29T21:08:20.443935] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-29T21:08:20.453996] [INFO ] [REMOTE ] SLG: Full fetch complete (65226 records). [2025-09-29T21:08:20.454159] [DEBUG] [VALIDATOR ] SLG: Validating primary data. [2025-09-29T21:08:20.867682] [DEBUG] [VALIDATOR ] SLG: All expected trading days are present. [2025-09-29T21:08:20.867845] [DEBUG] [VALIDATOR ] SLG: Primary data validation passed. [2025-09-29T21:08:20.869048] [INFO ] [MAIN ] SLG: Fetched primary data is valid. [2025-09-29T21:08:20.869158] [DEBUG] [LOCAL ] SLG: Saving primary data. [2025-09-29T21:08:20.870535] [DEBUG] [LOCAL ] SLG: Trimmed 65226 records to 45400 (keeping 200 days of data) [2025-09-29T21:08:20.996498] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-29T21:08:21.150956] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-08. [2025-09-29T21:08:21.188720] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-29T21:08:21.205688] [DEBUG] [LOCAL ] SLG: Primary data saved (45400 records). [2025-09-29T21:08:21.205791] [INFO ] [MAIN ] SLG: Full history saved. [2025-09-29T21:08:21.205890] [INFO ] [MAIN ] Update Progress: 1933/2371 symbols completed. SLG took 31.8s. Estimated remaining: 56m 16s. Rate: 7.8 symbols/min [2025-09-29T21:08:21.384049] [INFO ] [MAIN ] SLVM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:08:21.411626] [DEBUG] [LOCAL ] SLVM: Loaded 28332 existing records from primary storage. [2025-09-29T21:08:21.411939] [INFO ] [MAIN ] SLVM: Loaded 28332 existing records. [2025-09-29T21:08:21.606721] [WARN ] [MAIN ] SLVM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:08:21.606943] [INFO ] [MAIN ] SLVM: Wiping existing primary data before full refresh. [2025-09-29T21:08:21.606993] [INFO ] [LOCAL ] SLVM: Starting deletion of primary data. [2025-09-29T21:08:21.607607] [DEBUG] [LOCAL ] SLVM: Deleted primary data file. [2025-09-29T21:08:21.607701] [INFO ] [MAIN ] SLVM: Starting full primary refresh. [2025-09-29T21:08:21.951924] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-05. [2025-09-29T21:08:21.982716] [INFO ] [REMOTE ] SLVM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:08:22.390120] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-29T21:08:22.583277] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-29T21:08:22.748158] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2024-12. [2025-09-29T21:08:23.548085] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-09. [2025-09-29T21:08:24.017987] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-29T21:08:24.348139] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-06. [2025-09-29T21:08:24.788788] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-29T21:08:25.143265] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-29T21:08:25.152542] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-01. [2025-09-29T21:08:25.154364] [INFO ] [REMOTE ] SLGN: Full fetch complete (58315 records). [2025-09-29T21:08:25.154467] [DEBUG] [VALIDATOR ] SLGN: Validating primary data. [2025-09-29T21:08:25.613008] [DEBUG] [VALIDATOR ] SLGN: All expected trading days are present. [2025-09-29T21:08:25.613163] [DEBUG] [VALIDATOR ] SLGN: Primary data validation passed. [2025-09-29T21:08:25.614299] [INFO ] [MAIN ] SLGN: Fetched primary data is valid. [2025-09-29T21:08:25.614365] [DEBUG] [LOCAL ] SLGN: Saving primary data. [2025-09-29T21:08:25.615712] [DEBUG] [LOCAL ] SLGN: Trimmed 58315 records to 40384 (keeping 200 days of data) [2025-09-29T21:08:25.893979] [DEBUG] [LOCAL ] SLGN: Primary data saved (40384 records). [2025-09-29T21:08:25.894151] [INFO ] [MAIN ] SLGN: Full history saved. [2025-09-29T21:08:25.894275] [INFO ] [MAIN ] Update Progress: 1934/2371 symbols completed. SLGN took 33.4s. Estimated remaining: 56m 7s. Rate: 7.8 symbols/min [2025-09-29T21:08:25.959838] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-01. [2025-09-29T21:08:26.077468] [INFO ] [MAIN ] SM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:08:26.141000] [DEBUG] [LOCAL ] SM: Loaded 53080 existing records from primary storage. [2025-09-29T21:08:26.141356] [INFO ] [MAIN ] SM: Loaded 53080 existing records. [2025-09-29T21:08:26.324945] [WARN ] [MAIN ] SM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:08:26.325225] [INFO ] [MAIN ] SM: Wiping existing primary data before full refresh. [2025-09-29T21:08:26.325275] [INFO ] [LOCAL ] SM: Starting deletion of primary data. [2025-09-29T21:08:26.325881] [DEBUG] [LOCAL ] SM: Deleted primary data file. [2025-09-29T21:08:26.325943] [INFO ] [MAIN ] SM: Starting full primary refresh. [2025-09-29T21:08:26.715715] [INFO ] [REMOTE ] SM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:08:26.748080] [INFO ] [REMOTE ] SM: Fetching primary data for 2024-12. [2025-09-29T21:08:26.832874] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-29T21:08:27.178610] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-29T21:08:27.548123] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-02. [2025-09-29T21:08:28.348095] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-07. [2025-09-29T21:08:28.408810] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-29T21:08:28.570212] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-07 (0.22 seconds). [2025-09-29T21:08:29.148100] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-08. [2025-09-29T21:08:29.298847] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-29T21:08:29.361201] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-08 (0.21 seconds). [2025-09-29T21:08:29.948114] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-03. [2025-09-29T21:08:30.748140] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-01. [2025-09-29T21:08:31.548117] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-02. [2025-09-29T21:08:31.593776] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-29T21:08:32.348117] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-09. [2025-09-29T21:08:32.696539] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-29T21:08:32.854888] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-29T21:08:32.899843] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-29T21:08:32.900753] [INFO ] [REMOTE ] SLNZ: Full fetch complete (1057 records). [2025-09-29T21:08:32.900845] [DEBUG] [VALIDATOR ] SLNZ: Validating primary data. [2025-09-29T21:08:32.901287] [FATAL] [VALIDATOR ] SLNZ: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T21:08:32.901379] [FATAL] [MAIN ] SLNZ: Fetched primary data is invalid. Refusing to save it. [2025-09-29T21:08:32.901425] [WARN ] [MAIN ] SLNZ: Deleting existing primary and derivative data due to validation failure. [2025-09-29T21:08:32.901495] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-09-29T21:08:32.901562] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-09-29T21:08:32.901601] [INFO ] [LOCAL ] SLNZ: Starting deletion of derivative data. [2025-09-29T21:08:32.901708] [DEBUG] [LOCAL ] SLNZ: No derivative data file found to delete. [2025-09-29T21:08:32.901809] [INFO ] [MAIN ] Update Progress: 1935/2371 symbols completed. SLNZ took 22.5s. Estimated remaining: 55m 60s. Rate: 7.8 symbols/min [2025-09-29T21:08:33.082582] [INFO ] [MAIN ] SMA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:08:33.082803] [DEBUG] [LOCAL ] SMA: No existing data file found in primary storage. [2025-09-29T21:08:33.082903] [WARN ] [MAIN ] SMA: No existing data found, performing full refresh instead. [2025-09-29T21:08:33.083035] [INFO ] [MAIN ] SMA: Wiping existing primary data before full refresh. [2025-09-29T21:08:33.083080] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-09-29T21:08:33.083124] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-09-29T21:08:33.083157] [INFO ] [MAIN ] SMA: Starting full primary refresh. [2025-09-29T21:08:33.153273] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-02. [2025-09-29T21:08:33.472023] [INFO ] [REMOTE ] SMA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:08:33.948163] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-03. [2025-09-29T21:08:34.748141] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-04. [2025-09-29T21:08:34.893928] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-29T21:08:35.370058] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-29T21:08:35.548156] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-03. [2025-09-29T21:08:36.348083] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-04. [2025-09-29T21:08:36.468169] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-29T21:08:36.958667] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-29T21:08:37.148127] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-04. [2025-09-29T21:08:37.716110] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-29T21:08:37.948124] [INFO ] [REMOTE ] SMA: Fetching primary data for 2024-12. [2025-09-29T21:08:38.291501] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T21:08:38.291902] [WARN ] [REMOTE ] SMA: No data returned for month 2024-12 [2025-09-29T21:08:38.291982] [FATAL] [REMOTE ] SMA: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T21:08:38.292065] [FATAL] [MAIN ] SMA: Failed to fetch primary data. [2025-09-29T21:08:38.292134] [WARN ] [MAIN ] SMA: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T21:08:38.292207] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-09-29T21:08:38.292274] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-09-29T21:08:38.292313] [INFO ] [LOCAL ] SMA: Starting deletion of derivative data. [2025-09-29T21:08:38.292353] [DEBUG] [LOCAL ] SMA: No derivative data file found to delete. [2025-09-29T21:08:38.292402] [INFO ] [MAIN ] Update Progress: 1936/2371 symbols completed. SMA took 5.4s. Estimated remaining: 55m 51s. Rate: 7.8 symbols/min [2025-09-29T21:08:38.473519] [INFO ] [MAIN ] SMBK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:08:38.486631] [DEBUG] [LOCAL ] SMBK: Loaded 8332 existing records from primary storage. [2025-09-29T21:08:38.486937] [INFO ] [MAIN ] SMBK: Loaded 8332 existing records. [2025-09-29T21:08:38.706967] [WARN ] [MAIN ] SMBK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:08:38.707465] [INFO ] [MAIN ] SMBK: Wiping existing primary data before full refresh. [2025-09-29T21:08:38.707571] [INFO ] [LOCAL ] SMBK: Starting deletion of primary data. [2025-09-29T21:08:38.707819] [DEBUG] [LOCAL ] SMBK: Deleted primary data file. [2025-09-29T21:08:38.707899] [INFO ] [MAIN ] SMBK: Starting full primary refresh. [2025-09-29T21:08:38.753890] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-05. [2025-09-29T21:08:39.108849] [INFO ] [REMOTE ] SMBK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:08:39.139585] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-29T21:08:39.548107] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2024-12. [2025-09-29T21:08:40.128082] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-29T21:08:40.348073] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-06. [2025-09-29T21:08:40.422496] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-29T21:08:41.148153] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-01. [2025-09-29T21:08:41.674495] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-29T21:08:41.948107] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-05. [2025-09-29T21:08:41.987526] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-29T21:08:42.748124] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-02. [2025-09-29T21:08:43.539582] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-29T21:08:43.548105] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-03. [2025-09-29T21:08:43.872798] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-29T21:08:44.221439] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-29T21:08:44.348112] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-04. [2025-09-29T21:08:45.151416] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-05. [2025-09-29T21:08:45.153742] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-29T21:08:45.948153] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-05. [2025-09-29T21:08:46.751586] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-07. [2025-09-29T21:08:46.753915] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-29T21:08:46.840685] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-29T21:08:47.548136] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-06. [2025-09-29T21:08:47.997765] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-29T21:08:48.100415] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-29T21:08:48.348135] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-08. [2025-09-29T21:08:49.148136] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-07. [2025-09-29T21:08:49.713019] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-29T21:08:49.948107] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-09. [2025-09-29T21:08:50.082887] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-29T21:08:50.748086] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-08. [2025-09-29T21:08:51.112364] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-29T21:08:51.118711] [INFO ] [REMOTE ] SLVM: Full fetch complete (39628 records). [2025-09-29T21:08:51.118852] [DEBUG] [VALIDATOR ] SLVM: Validating primary data. [2025-09-29T21:08:51.531078] [DEBUG] [VALIDATOR ] SLVM: All expected trading days are present. [2025-09-29T21:08:51.531396] [DEBUG] [VALIDATOR ] SLVM: Primary data validation passed. [2025-09-29T21:08:51.532352] [INFO ] [MAIN ] SLVM: Fetched primary data is valid. [2025-09-29T21:08:51.532435] [DEBUG] [LOCAL ] SLVM: Saving primary data. [2025-09-29T21:08:51.533541] [DEBUG] [LOCAL ] SLVM: Trimmed 39628 records to 27843 (keeping 200 days of data) [2025-09-29T21:08:51.592679] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-06. [2025-09-29T21:08:51.640571] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-29T21:08:51.732155] [DEBUG] [LOCAL ] SLVM: Primary data saved (27843 records). [2025-09-29T21:08:51.732364] [INFO ] [MAIN ] SLVM: Full history saved. [2025-09-29T21:08:51.732473] [INFO ] [MAIN ] Update Progress: 1937/2371 symbols completed. SLVM took 30.5s. Estimated remaining: 55m 45s. Rate: 7.8 symbols/min [2025-09-29T21:08:51.961680] [INFO ] [MAIN ] SMC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:08:51.975368] [DEBUG] [LOCAL ] SMC: Loaded 11630 existing records from primary storage. [2025-09-29T21:08:51.975586] [INFO ] [MAIN ] SMC: Loaded 11630 existing records. [2025-09-29T21:08:52.163262] [WARN ] [MAIN ] SMC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:08:52.163555] [INFO ] [MAIN ] SMC: Wiping existing primary data before full refresh. [2025-09-29T21:08:52.163606] [INFO ] [LOCAL ] SMC: Starting deletion of primary data. [2025-09-29T21:08:52.164379] [DEBUG] [LOCAL ] SMC: Deleted primary data file. [2025-09-29T21:08:52.164470] [INFO ] [MAIN ] SMC: Starting full primary refresh. [2025-09-29T21:08:52.357681] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-09. [2025-09-29T21:08:52.557536] [INFO ] [REMOTE ] SMC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:08:53.108621] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-29T21:08:53.110827] [INFO ] [REMOTE ] SMBK: Full fetch complete (11744 records). [2025-09-29T21:08:53.110960] [DEBUG] [VALIDATOR ] SMBK: Validating primary data. [2025-09-29T21:08:53.153370] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-06. [2025-09-29T21:08:53.603006] [DEBUG] [VALIDATOR ] SMBK: All expected trading days are present. [2025-09-29T21:08:53.603140] [DEBUG] [VALIDATOR ] SMBK: Primary data validation passed. [2025-09-29T21:08:53.603628] [INFO ] [MAIN ] SMBK: Fetched primary data is valid. [2025-09-29T21:08:53.603755] [DEBUG] [LOCAL ] SMBK: Saving primary data. [2025-09-29T21:08:53.604664] [DEBUG] [LOCAL ] SMBK: Trimmed 11744 records to 8162 (keeping 200 days of data) [2025-09-29T21:08:53.719271] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-29T21:08:53.763796] [DEBUG] [LOCAL ] SMBK: Primary data saved (8162 records). [2025-09-29T21:08:53.763987] [INFO ] [MAIN ] SMBK: Full history saved. [2025-09-29T21:08:53.764119] [INFO ] [MAIN ] Update Progress: 1938/2371 symbols completed. SMBK took 15.5s. Estimated remaining: 55m 36s. Rate: 7.8 symbols/min [2025-09-29T21:08:53.953278] [INFO ] [REMOTE ] SMC: Fetching primary data for 2024-12. [2025-09-29T21:08:54.046636] [INFO ] [MAIN ] SMFG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:08:54.104984] [DEBUG] [LOCAL ] SMFG: Loaded 48771 existing records from primary storage. [2025-09-29T21:08:54.105367] [INFO ] [MAIN ] SMFG: Loaded 48771 existing records. [2025-09-29T21:08:54.390888] [WARN ] [MAIN ] SMFG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:08:54.391214] [INFO ] [MAIN ] SMFG: Wiping existing primary data before full refresh. [2025-09-29T21:08:54.391315] [INFO ] [LOCAL ] SMFG: Starting deletion of primary data. [2025-09-29T21:08:54.391911] [DEBUG] [LOCAL ] SMFG: Deleted primary data file. [2025-09-29T21:08:54.391978] [INFO ] [MAIN ] SMFG: Starting full primary refresh. [2025-09-29T21:08:54.750266] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-07. [2025-09-29T21:08:54.782246] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-29T21:08:54.812715] [INFO ] [REMOTE ] SMFG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:08:55.069760] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-29T21:08:55.548151] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-01. [2025-09-29T21:08:56.348142] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2024-12. [2025-09-29T21:08:56.386168] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-29T21:08:56.660921] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-29T21:08:57.148129] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-02. [2025-09-29T21:08:57.948093] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-07. [2025-09-29T21:08:58.081595] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-29T21:08:58.102689] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-29T21:08:58.748114] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-03. [2025-09-29T21:08:59.560955] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-01. [2025-09-29T21:08:59.566949] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-29T21:08:59.705200] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-29T21:09:00.348111] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-08. [2025-09-29T21:09:01.132009] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-29T21:09:01.148061] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-02. [2025-09-29T21:09:01.948136] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-08. [2025-09-29T21:09:02.146717] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-29T21:09:02.748105] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-09. [2025-09-29T21:09:02.837022] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-29T21:09:03.548222] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-03. [2025-09-29T21:09:03.756056] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-29T21:09:03.924717] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-29T21:09:03.933236] [INFO ] [REMOTE ] SLQT: Full fetch complete (63555 records). [2025-09-29T21:09:03.933412] [DEBUG] [VALIDATOR ] SLQT: Validating primary data. [2025-09-29T21:09:04.338893] [DEBUG] [VALIDATOR ] SLQT: All expected trading days are present. [2025-09-29T21:09:04.338980] [DEBUG] [VALIDATOR ] SLQT: Primary data validation passed. [2025-09-29T21:09:04.340107] [INFO ] [MAIN ] SLQT: Fetched primary data is valid. [2025-09-29T21:09:04.340176] [DEBUG] [LOCAL ] SLQT: Saving primary data. [2025-09-29T21:09:04.341496] [DEBUG] [LOCAL ] SLQT: Trimmed 63555 records to 43566 (keeping 200 days of data) [2025-09-29T21:09:04.388065] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-09. [2025-09-29T21:09:04.600349] [DEBUG] [LOCAL ] SLQT: Primary data saved (43566 records). [2025-09-29T21:09:04.600497] [INFO ] [MAIN ] SLQT: Full history saved. [2025-09-29T21:09:04.600586] [INFO ] [MAIN ] Update Progress: 1939/2371 symbols completed. SLQT took 50.0s. Estimated remaining: 55m 29s. Rate: 7.8 symbols/min [2025-09-29T21:09:04.790389] [INFO ] [MAIN ] SMG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:09:04.833333] [DEBUG] [LOCAL ] SMG: Loaded 44546 existing records from primary storage. [2025-09-29T21:09:04.833638] [INFO ] [MAIN ] SMG: Loaded 44546 existing records. [2025-09-29T21:09:05.019522] [WARN ] [MAIN ] SMG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:09:05.019809] [INFO ] [MAIN ] SMG: Wiping existing primary data before full refresh. [2025-09-29T21:09:05.019871] [INFO ] [LOCAL ] SMG: Starting deletion of primary data. [2025-09-29T21:09:05.020397] [DEBUG] [LOCAL ] SMG: Deleted primary data file. [2025-09-29T21:09:05.020457] [INFO ] [MAIN ] SMG: Starting full primary refresh. [2025-09-29T21:09:05.153218] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-04. [2025-09-29T21:09:05.431382] [INFO ] [REMOTE ] SMG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:09:05.516901] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-29T21:09:05.791467] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-29T21:09:05.802757] [INFO ] [REMOTE ] SM: Full fetch complete (75242 records). [2025-09-29T21:09:05.802935] [DEBUG] [VALIDATOR ] SM: Validating primary data. [2025-09-29T21:09:05.960300] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-04. [2025-09-29T21:09:06.215474] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-29T21:09:06.299805] [DEBUG] [VALIDATOR ] SM: All expected trading days are present. [2025-09-29T21:09:06.299896] [DEBUG] [VALIDATOR ] SM: Primary data validation passed. [2025-09-29T21:09:06.301133] [INFO ] [MAIN ] SM: Fetched primary data is valid. [2025-09-29T21:09:06.301206] [DEBUG] [LOCAL ] SM: Saving primary data. [2025-09-29T21:09:06.302833] [DEBUG] [LOCAL ] SM: Trimmed 75242 records to 52302 (keeping 200 days of data) [2025-09-29T21:09:06.643261] [DEBUG] [LOCAL ] SM: Primary data saved (52302 records). [2025-09-29T21:09:06.643415] [INFO ] [MAIN ] SM: Full history saved. [2025-09-29T21:09:06.643528] [INFO ] [MAIN ] Update Progress: 1940/2371 symbols completed. SM took 40.7s. Estimated remaining: 55m 20s. Rate: 7.8 symbols/min [2025-09-29T21:09:06.753282] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-05. [2025-09-29T21:09:06.833246] [INFO ] [MAIN ] SMHI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:09:06.850410] [DEBUG] [LOCAL ] SMHI: Loaded 13885 existing records from primary storage. [2025-09-29T21:09:06.850676] [INFO ] [MAIN ] SMHI: Loaded 13885 existing records. [2025-09-29T21:09:07.047291] [WARN ] [MAIN ] SMHI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:09:07.047559] [INFO ] [MAIN ] SMHI: Wiping existing primary data before full refresh. [2025-09-29T21:09:07.047612] [INFO ] [LOCAL ] SMHI: Starting deletion of primary data. [2025-09-29T21:09:07.047983] [DEBUG] [LOCAL ] SMHI: Deleted primary data file. [2025-09-29T21:09:07.048044] [INFO ] [MAIN ] SMHI: Starting full primary refresh. [2025-09-29T21:09:07.414422] [INFO ] [REMOTE ] SMHI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:09:07.421812] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-29T21:09:07.548115] [INFO ] [REMOTE ] SMG: Fetching primary data for 2024-12. [2025-09-29T21:09:07.928404] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-29T21:09:08.348141] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-05. [2025-09-29T21:09:09.113115] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-29T21:09:09.148075] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-01. [2025-09-29T21:09:09.751208] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-29T21:09:09.948164] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-06. [2025-09-29T21:09:10.748082] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-06. [2025-09-29T21:09:10.860782] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-29T21:09:10.905556] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-29T21:09:11.548118] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-07. [2025-09-29T21:09:12.348078] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-02. [2025-09-29T21:09:12.383514] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-29T21:09:12.402875] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-29T21:09:13.148160] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-08. [2025-09-29T21:09:13.948090] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2024-12. [2025-09-29T21:09:14.025109] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-29T21:09:14.025915] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-29T21:09:14.748119] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-03. [2025-09-29T21:09:15.207538] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-29T21:09:15.548161] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-01. [2025-09-29T21:09:16.348092] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-09. [2025-09-29T21:09:16.460071] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-29T21:09:16.582282] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-29T21:09:17.148159] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-07. [2025-09-29T21:09:17.168587] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-29T21:09:17.171473] [INFO ] [REMOTE ] SMC: Full fetch complete (16595 records). [2025-09-29T21:09:17.171566] [DEBUG] [VALIDATOR ] SMC: Validating primary data. [2025-09-29T21:09:17.578243] [DEBUG] [VALIDATOR ] SMC: All expected trading days are present. [2025-09-29T21:09:17.578342] [DEBUG] [VALIDATOR ] SMC: Primary data validation passed. [2025-09-29T21:09:17.578789] [INFO ] [MAIN ] SMC: Fetched primary data is valid. [2025-09-29T21:09:17.578866] [DEBUG] [LOCAL ] SMC: Saving primary data. [2025-09-29T21:09:17.579442] [DEBUG] [LOCAL ] SMC: Trimmed 16595 records to 11332 (keeping 200 days of data) [2025-09-29T21:09:17.650343] [DEBUG] [LOCAL ] SMC: Primary data saved (11332 records). [2025-09-29T21:09:17.650498] [INFO ] [MAIN ] SMC: Full history saved. [2025-09-29T21:09:17.650612] [INFO ] [MAIN ] Update Progress: 1941/2371 symbols completed. SMC took 25.9s. Estimated remaining: 55m 13s. Rate: 7.8 symbols/min [2025-09-29T21:09:17.862192] [INFO ] [MAIN ] SMP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:09:17.884668] [DEBUG] [LOCAL ] SMP: Loaded 19999 existing records from primary storage. [2025-09-29T21:09:17.884959] [INFO ] [MAIN ] SMP: Loaded 19999 existing records. [2025-09-29T21:09:17.953313] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-02. [2025-09-29T21:09:18.073254] [WARN ] [MAIN ] SMP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:09:18.073451] [INFO ] [MAIN ] SMP: Wiping existing primary data before full refresh. [2025-09-29T21:09:18.073501] [INFO ] [LOCAL ] SMP: Starting deletion of primary data. [2025-09-29T21:09:18.073896] [DEBUG] [LOCAL ] SMP: Deleted primary data file. [2025-09-29T21:09:18.073957] [INFO ] [MAIN ] SMP: Starting full primary refresh. [2025-09-29T21:09:18.457976] [INFO ] [REMOTE ] SMP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:09:18.748129] [INFO ] [REMOTE ] SMP: Fetching primary data for 2024-12. [2025-09-29T21:09:18.846947] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-29T21:09:19.027994] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-29T21:09:19.548088] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-08. [2025-09-29T21:09:19.713710] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-29T21:09:20.348138] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-04. [2025-09-29T21:09:21.093364] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-29T21:09:21.148114] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-01. [2025-09-29T21:09:21.948086] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-03. [2025-09-29T21:09:22.056288] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-29T21:09:22.129330] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-29T21:09:22.748178] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-05. [2025-09-29T21:09:23.038805] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-29T21:09:23.548164] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-02. [2025-09-29T21:09:24.348152] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-04. [2025-09-29T21:09:24.429272] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-29T21:09:24.596743] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-29T21:09:25.148160] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-06. [2025-09-29T21:09:25.339130] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-29T21:09:25.948139] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-09. [2025-09-29T21:09:26.748142] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-03. [2025-09-29T21:09:26.909963] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-29T21:09:27.548127] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-05. [2025-09-29T21:09:27.763555] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-29T21:09:27.774351] [INFO ] [REMOTE ] SMFG: Full fetch complete (68909 records). [2025-09-29T21:09:27.774538] [DEBUG] [VALIDATOR ] SMFG: Validating primary data. [2025-09-29T21:09:28.143465] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-29T21:09:28.208091] [DEBUG] [VALIDATOR ] SMFG: All expected trading days are present. [2025-09-29T21:09:28.208178] [DEBUG] [VALIDATOR ] SMFG: Primary data validation passed. [2025-09-29T21:09:28.209319] [INFO ] [MAIN ] SMFG: Fetched primary data is valid. [2025-09-29T21:09:28.209390] [DEBUG] [LOCAL ] SMFG: Saving primary data. [2025-09-29T21:09:28.211499] [DEBUG] [LOCAL ] SMFG: Trimmed 68909 records to 48091 (keeping 200 days of data) [2025-09-29T21:09:28.396367] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-07. [2025-09-29T21:09:28.518450] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-29T21:09:28.536906] [DEBUG] [LOCAL ] SMFG: Primary data saved (48091 records). [2025-09-29T21:09:28.537046] [INFO ] [MAIN ] SMFG: Full history saved. [2025-09-29T21:09:28.537174] [INFO ] [MAIN ] Update Progress: 1942/2371 symbols completed. SMFG took 34.8s. Estimated remaining: 55m 6s. Rate: 7.8 symbols/min [2025-09-29T21:09:28.746425] [INFO ] [MAIN ] SMR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:09:28.805282] [DEBUG] [LOCAL ] SMR: Loaded 54577 existing records from primary storage. [2025-09-29T21:09:28.805669] [INFO ] [MAIN ] SMR: Loaded 54577 existing records. [2025-09-29T21:09:28.983412] [WARN ] [MAIN ] SMR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:09:28.983702] [INFO ] [MAIN ] SMR: Wiping existing primary data before full refresh. [2025-09-29T21:09:28.983761] [INFO ] [LOCAL ] SMR: Starting deletion of primary data. [2025-09-29T21:09:28.985194] [DEBUG] [LOCAL ] SMR: Deleted primary data file. [2025-09-29T21:09:28.985256] [INFO ] [MAIN ] SMR: Starting full primary refresh. [2025-09-29T21:09:29.157308] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-04. [2025-09-29T21:09:29.343319] [INFO ] [REMOTE ] SMR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:09:29.948170] [INFO ] [REMOTE ] SMR: Fetching primary data for 2024-12. [2025-09-29T21:09:30.173698] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-29T21:09:30.748173] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-08. [2025-09-29T21:09:30.941928] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-29T21:09:31.548159] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-05. [2025-09-29T21:09:32.134072] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-29T21:09:32.348114] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-09. [2025-09-29T21:09:32.591807] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2024-12 (2.64 seconds). [2025-09-29T21:09:32.635857] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-29T21:09:33.148095] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-06. [2025-09-29T21:09:33.902588] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-29T21:09:33.910967] [INFO ] [REMOTE ] SMG: Full fetch complete (62698 records). [2025-09-29T21:09:33.911097] [DEBUG] [VALIDATOR ] SMG: Validating primary data. [2025-09-29T21:09:33.956595] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-06. [2025-09-29T21:09:34.333476] [DEBUG] [VALIDATOR ] SMG: All expected trading days are present. [2025-09-29T21:09:34.333636] [DEBUG] [VALIDATOR ] SMG: Primary data validation passed. [2025-09-29T21:09:34.334821] [INFO ] [MAIN ] SMG: Fetched primary data is valid. [2025-09-29T21:09:34.334889] [DEBUG] [LOCAL ] SMG: Saving primary data. [2025-09-29T21:09:34.336234] [DEBUG] [LOCAL ] SMG: Trimmed 62698 records to 43774 (keeping 200 days of data) [2025-09-29T21:09:34.574287] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-29T21:09:34.637977] [DEBUG] [LOCAL ] SMG: Primary data saved (43774 records). [2025-09-29T21:09:34.638134] [INFO ] [MAIN ] SMG: Full history saved. [2025-09-29T21:09:34.638261] [INFO ] [MAIN ] Update Progress: 1943/2371 symbols completed. SMG took 30.0s. Estimated remaining: 54m 58s. Rate: 7.8 symbols/min [2025-09-29T21:09:34.748245] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-07. [2025-09-29T21:09:34.828249] [INFO ] [MAIN ] SMRT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:09:34.880041] [DEBUG] [LOCAL ] SMRT: Loaded 44707 existing records from primary storage. [2025-09-29T21:09:34.880387] [INFO ] [MAIN ] SMRT: Loaded 44707 existing records. [2025-09-29T21:09:35.004568] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-29T21:09:35.098567] [WARN ] [MAIN ] SMRT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:09:35.098905] [INFO ] [MAIN ] SMRT: Wiping existing primary data before full refresh. [2025-09-29T21:09:35.098970] [INFO ] [LOCAL ] SMRT: Starting deletion of primary data. [2025-09-29T21:09:35.099470] [DEBUG] [LOCAL ] SMRT: Deleted primary data file. [2025-09-29T21:09:35.099533] [INFO ] [MAIN ] SMRT: Starting full primary refresh. [2025-09-29T21:09:35.505219] [INFO ] [REMOTE ] SMRT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:09:35.548127] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2024-12. [2025-09-29T21:09:35.919203] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-29T21:09:36.348127] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-01. [2025-09-29T21:09:37.153421] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-08. [2025-09-29T21:09:37.164981] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-29T21:09:37.948137] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-07. [2025-09-29T21:09:38.359869] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-29T21:09:38.748103] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-09. [2025-09-29T21:09:38.846343] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-01 (2.50 seconds). [2025-09-29T21:09:38.860553] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-29T21:09:39.548134] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-02. [2025-09-29T21:09:39.785941] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-29T21:09:39.789805] [INFO ] [REMOTE ] SMP: Full fetch complete (26167 records). [2025-09-29T21:09:39.789885] [DEBUG] [VALIDATOR ] SMP: Validating primary data. [2025-09-29T21:09:40.191088] [DEBUG] [VALIDATOR ] SMP: All expected trading days are present. [2025-09-29T21:09:40.191224] [DEBUG] [VALIDATOR ] SMP: Primary data validation passed. [2025-09-29T21:09:40.191913] [INFO ] [MAIN ] SMP: Fetched primary data is valid. [2025-09-29T21:09:40.192004] [DEBUG] [LOCAL ] SMP: Saving primary data. [2025-09-29T21:09:40.192812] [DEBUG] [LOCAL ] SMP: Trimmed 26167 records to 19461 (keeping 200 days of data) [2025-09-29T21:09:40.316816] [DEBUG] [LOCAL ] SMP: Primary data saved (19461 records). [2025-09-29T21:09:40.316966] [INFO ] [MAIN ] SMP: Full history saved. [2025-09-29T21:09:40.317053] [INFO ] [MAIN ] Update Progress: 1944/2371 symbols completed. SMP took 22.7s. Estimated remaining: 54m 50s. Rate: 7.8 symbols/min [2025-09-29T21:09:40.353287] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-01. [2025-09-29T21:09:40.498165] [INFO ] [MAIN ] SMWB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:09:40.532850] [DEBUG] [LOCAL ] SMWB: Loaded 33137 existing records from primary storage. [2025-09-29T21:09:40.533146] [INFO ] [MAIN ] SMWB: Loaded 33137 existing records. [2025-09-29T21:09:40.728459] [WARN ] [MAIN ] SMWB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:09:40.728726] [INFO ] [MAIN ] SMWB: Wiping existing primary data before full refresh. [2025-09-29T21:09:40.728784] [INFO ] [LOCAL ] SMWB: Starting deletion of primary data. [2025-09-29T21:09:40.729010] [DEBUG] [LOCAL ] SMWB: Deleted primary data file. [2025-09-29T21:09:40.729107] [INFO ] [MAIN ] SMWB: Starting full primary refresh. [2025-09-29T21:09:41.133486] [INFO ] [REMOTE ] SMWB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:09:41.148113] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2024-12. [2025-09-29T21:09:41.862100] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-09-29T21:09:41.902575] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-29T21:09:41.948092] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-02. [2025-09-29T21:09:42.299472] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-29T21:09:42.748121] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-03. [2025-09-29T21:09:43.442879] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-29T21:09:43.548143] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-03. [2025-09-29T21:09:44.348148] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-08. [2025-09-29T21:09:45.148136] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-01. [2025-09-29T21:09:45.199742] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-29T21:09:45.231676] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-29T21:09:45.415259] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-03 (2.67 seconds). [2025-09-29T21:09:45.948116] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-04. [2025-09-29T21:09:46.706172] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-29T21:09:46.748147] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-04. [2025-09-29T21:09:47.548152] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-09. [2025-09-29T21:09:48.216841] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-29T21:09:48.219858] [INFO ] [REMOTE ] SMHI: Full fetch complete (23660 records). [2025-09-29T21:09:48.219944] [DEBUG] [VALIDATOR ] SMHI: Validating primary data. [2025-09-29T21:09:48.352049] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-02. [2025-09-29T21:09:48.543305] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-29T21:09:48.662877] [DEBUG] [VALIDATOR ] SMHI: All expected trading days are present. [2025-09-29T21:09:48.663132] [DEBUG] [VALIDATOR ] SMHI: Primary data validation passed. [2025-09-29T21:09:48.663895] [INFO ] [MAIN ] SMHI: Fetched primary data is valid. [2025-09-29T21:09:48.664027] [DEBUG] [LOCAL ] SMHI: Saving primary data. [2025-09-29T21:09:48.665316] [DEBUG] [LOCAL ] SMHI: Trimmed 23660 records to 13369 (keeping 200 days of data) [2025-09-29T21:09:48.757892] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-04 (2.81 seconds). [2025-09-29T21:09:48.786259] [DEBUG] [LOCAL ] SMHI: Primary data saved (13369 records). [2025-09-29T21:09:48.786401] [INFO ] [MAIN ] SMHI: Full history saved. [2025-09-29T21:09:48.786501] [INFO ] [MAIN ] Update Progress: 1945/2371 symbols completed. SMHI took 42.1s. Estimated remaining: 54m 42s. Rate: 7.8 symbols/min [2025-09-29T21:09:48.960791] [INFO ] [MAIN ] SN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:09:49.011344] [DEBUG] [LOCAL ] SN: Loaded 50487 existing records from primary storage. [2025-09-29T21:09:49.011791] [INFO ] [MAIN ] SN: Loaded 50487 existing records. [2025-09-29T21:09:49.154830] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-05. [2025-09-29T21:09:49.199235] [WARN ] [MAIN ] SN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:09:49.199435] [INFO ] [MAIN ] SN: Wiping existing primary data before full refresh. [2025-09-29T21:09:49.199484] [INFO ] [LOCAL ] SN: Starting deletion of primary data. [2025-09-29T21:09:49.199928] [DEBUG] [LOCAL ] SN: Deleted primary data file. [2025-09-29T21:09:49.199989] [INFO ] [MAIN ] SN: Starting full primary refresh. [2025-09-29T21:09:49.613037] [INFO ] [REMOTE ] SN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:09:49.948092] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-05. [2025-09-29T21:09:50.035615] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-29T21:09:50.748089] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-03. [2025-09-29T21:09:51.148687] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-29T21:09:51.548131] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-06. [2025-09-29T21:09:52.185116] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-29T21:09:52.348090] [INFO ] [REMOTE ] SN: Fetching primary data for 2024-12. [2025-09-29T21:09:52.816903] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-05 (2.87 seconds). [2025-09-29T21:09:53.148130] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-04. [2025-09-29T21:09:53.358618] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-29T21:09:53.948144] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-07. [2025-09-29T21:09:54.101398] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-29T21:09:54.650968] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-29T21:09:54.748144] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-01. [2025-09-29T21:09:55.548083] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-06. [2025-09-29T21:09:55.592601] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-29T21:09:56.348117] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-08. [2025-09-29T21:09:56.495617] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-29T21:09:57.148149] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-02. [2025-09-29T21:09:57.948805] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-05. [2025-09-29T21:09:57.953962] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-29T21:09:58.334950] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-06 (2.79 seconds). [2025-09-29T21:09:58.748115] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-09. [2025-09-29T21:09:58.904169] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-29T21:09:59.098527] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-29T21:09:59.548137] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-03. [2025-09-29T21:10:00.330221] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-29T21:10:00.338515] [INFO ] [REMOTE ] SMRT: Full fetch complete (62007 records). [2025-09-29T21:10:00.338674] [DEBUG] [VALIDATOR ] SMRT: Validating primary data. [2025-09-29T21:10:00.353253] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-06. [2025-09-29T21:10:00.747042] [DEBUG] [VALIDATOR ] SMRT: All expected trading days are present. [2025-09-29T21:10:00.747182] [DEBUG] [VALIDATOR ] SMRT: Primary data validation passed. [2025-09-29T21:10:00.748230] [INFO ] [MAIN ] SMRT: Fetched primary data is valid. [2025-09-29T21:10:00.748297] [DEBUG] [LOCAL ] SMRT: Saving primary data. [2025-09-29T21:10:00.749710] [DEBUG] [LOCAL ] SMRT: Trimmed 62007 records to 43880 (keeping 200 days of data) [2025-09-29T21:10:01.005342] [DEBUG] [LOCAL ] SMRT: Primary data saved (43880 records). [2025-09-29T21:10:01.005492] [INFO ] [MAIN ] SMRT: Full history saved. [2025-09-29T21:10:01.005584] [INFO ] [MAIN ] Update Progress: 1946/2371 symbols completed. SMRT took 26.4s. Estimated remaining: 54m 36s. Rate: 7.8 symbols/min [2025-09-29T21:10:01.157091] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-07. [2025-09-29T21:10:01.186035] [INFO ] [MAIN ] SNA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:10:01.216540] [DEBUG] [LOCAL ] SNA: Loaded 26608 existing records from primary storage. [2025-09-29T21:10:01.216896] [INFO ] [MAIN ] SNA: Loaded 26608 existing records. [2025-09-29T21:10:01.414237] [WARN ] [MAIN ] SNA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:10:01.414562] [INFO ] [MAIN ] SNA: Wiping existing primary data before full refresh. [2025-09-29T21:10:01.414769] [INFO ] [LOCAL ] SNA: Starting deletion of primary data. [2025-09-29T21:10:01.415192] [DEBUG] [LOCAL ] SNA: Deleted primary data file. [2025-09-29T21:10:01.415258] [INFO ] [MAIN ] SNA: Starting full primary refresh. [2025-09-29T21:10:01.735720] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-29T21:10:01.869580] [INFO ] [REMOTE ] SNA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:10:01.923413] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-29T21:10:01.948082] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-07. [2025-09-29T21:10:02.748115] [INFO ] [REMOTE ] SNA: Fetching primary data for 2024-12. [2025-09-29T21:10:03.465537] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-29T21:10:03.548209] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-08. [2025-09-29T21:10:04.171132] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-07 (3.01 seconds). [2025-09-29T21:10:04.225237] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-29T21:10:04.348158] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-01. [2025-09-29T21:10:04.974787] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-29T21:10:05.148111] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-09. [2025-09-29T21:10:05.852784] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-29T21:10:05.948128] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-04. [2025-09-29T21:10:06.451942] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-29T21:10:06.458453] [INFO ] [REMOTE ] SMWB: Full fetch complete (49882 records). [2025-09-29T21:10:06.458619] [DEBUG] [VALIDATOR ] SMWB: Validating primary data. [2025-09-29T21:10:06.755370] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-08. [2025-09-29T21:10:06.875701] [DEBUG] [VALIDATOR ] SMWB: All expected trading days are present. [2025-09-29T21:10:06.875866] [DEBUG] [VALIDATOR ] SMWB: Primary data validation passed. [2025-09-29T21:10:06.877017] [INFO ] [MAIN ] SMWB: Fetched primary data is valid. [2025-09-29T21:10:06.877114] [DEBUG] [LOCAL ] SMWB: Saving primary data. [2025-09-29T21:10:06.878879] [DEBUG] [LOCAL ] SMWB: Trimmed 49882 records to 32507 (keeping 200 days of data) [2025-09-29T21:10:07.075353] [DEBUG] [LOCAL ] SMWB: Primary data saved (32507 records). [2025-09-29T21:10:07.075495] [INFO ] [MAIN ] SMWB: Full history saved. [2025-09-29T21:10:07.075636] [INFO ] [MAIN ] Update Progress: 1947/2371 symbols completed. SMWB took 26.8s. Estimated remaining: 54m 27s. Rate: 7.8 symbols/min [2025-09-29T21:10:07.251828] [INFO ] [MAIN ] SNAP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:10:07.306084] [DEBUG] [LOCAL ] SNAP: Loaded 54576 existing records from primary storage. [2025-09-29T21:10:07.306453] [INFO ] [MAIN ] SNAP: Loaded 54576 existing records. [2025-09-29T21:10:07.493010] [WARN ] [MAIN ] SNAP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:10:07.493232] [INFO ] [MAIN ] SNAP: Wiping existing primary data before full refresh. [2025-09-29T21:10:07.493359] [INFO ] [LOCAL ] SNAP: Starting deletion of primary data. [2025-09-29T21:10:07.493808] [DEBUG] [LOCAL ] SNAP: Deleted primary data file. [2025-09-29T21:10:07.493871] [INFO ] [MAIN ] SNAP: Starting full primary refresh. [2025-09-29T21:10:07.552495] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-02. [2025-09-29T21:10:07.880469] [INFO ] [REMOTE ] SNAP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:10:07.965056] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-29T21:10:08.348105] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-05. [2025-09-29T21:10:08.982547] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-29T21:10:09.148149] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-03. [2025-09-29T21:10:09.744057] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-08 (2.99 seconds). [2025-09-29T21:10:09.948084] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2024-12. [2025-09-29T21:10:10.074851] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-29T21:10:10.652619] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-29T21:10:10.748138] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-04. [2025-09-29T21:10:11.548144] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-09. [2025-09-29T21:10:12.283007] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-29T21:10:12.348088] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-05. [2025-09-29T21:10:12.397307] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-29T21:10:12.408634] [INFO ] [REMOTE ] SMR: Full fetch complete (77584 records). [2025-09-29T21:10:12.408854] [DEBUG] [VALIDATOR ] SMR: Validating primary data. [2025-09-29T21:10:12.410137] [FATAL] [VALIDATOR ] SMR: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T21:10:12.410235] [FATAL] [MAIN ] SMR: Fetched primary data is invalid. Refusing to save it. [2025-09-29T21:10:12.410280] [WARN ] [MAIN ] SMR: Deleting existing primary and derivative data due to validation failure. [2025-09-29T21:10:12.410348] [INFO ] [LOCAL ] SMR: Starting deletion of primary data. [2025-09-29T21:10:12.410416] [DEBUG] [LOCAL ] SMR: No primary data file found to delete. [2025-09-29T21:10:12.410456] [INFO ] [LOCAL ] SMR: Starting deletion of derivative data. [2025-09-29T21:10:12.411133] [DEBUG] [LOCAL ] SMR: Deleted derivative data file. [2025-09-29T21:10:12.411264] [INFO ] [MAIN ] Update Progress: 1948/2371 symbols completed. SMR took 43.9s. Estimated remaining: 54m 19s. Rate: 7.8 symbols/min [2025-09-29T21:10:12.587334] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2024-12 (2.64 seconds). [2025-09-29T21:10:12.656205] [INFO ] [MAIN ] SNDA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:10:12.664271] [DEBUG] [LOCAL ] SNDA: Loaded 4732 existing records from primary storage. [2025-09-29T21:10:12.664495] [INFO ] [MAIN ] SNDA: Loaded 4732 existing records. [2025-09-29T21:10:12.849612] [WARN ] [MAIN ] SNDA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:10:12.849852] [INFO ] [MAIN ] SNDA: Wiping existing primary data before full refresh. [2025-09-29T21:10:12.849901] [INFO ] [LOCAL ] SNDA: Starting deletion of primary data. [2025-09-29T21:10:12.850095] [DEBUG] [LOCAL ] SNDA: Deleted primary data file. [2025-09-29T21:10:12.850155] [INFO ] [MAIN ] SNDA: Starting full primary refresh. [2025-09-29T21:10:13.153271] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-06. [2025-09-29T21:10:13.222728] [INFO ] [REMOTE ] SNDA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:10:13.766707] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-29T21:10:13.948116] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-01. [2025-09-29T21:10:14.748096] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-06. [2025-09-29T21:10:14.864588] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-29T21:10:15.548129] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2024-12. [2025-09-29T21:10:16.083771] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-29T21:10:16.348116] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-07. [2025-09-29T21:10:16.635058] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-01 (2.69 seconds). [2025-09-29T21:10:17.148128] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-02. [2025-09-29T21:10:17.504531] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-29T21:10:17.948138] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-07. [2025-09-29T21:10:18.167553] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-29T21:10:18.748138] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-01. [2025-09-29T21:10:19.427484] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-09-29T21:10:19.446092] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-29T21:10:19.548091] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-02. [2025-09-29T21:10:19.624903] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-29T21:10:20.348160] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-03. [2025-09-29T21:10:20.357317] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-29T21:10:21.148126] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-08. [2025-09-29T21:10:21.948134] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-03. [2025-09-29T21:10:22.369485] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-29T21:10:22.748125] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-09. [2025-09-29T21:10:22.777381] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-29T21:10:22.813448] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-09-29T21:10:23.548093] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-04. [2025-09-29T21:10:23.980110] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-29T21:10:23.985595] [INFO ] [REMOTE ] SNA: Full fetch complete (38936 records). [2025-09-29T21:10:23.985792] [DEBUG] [VALIDATOR ] SNA: Validating primary data. [2025-09-29T21:10:24.353560] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-04. [2025-09-29T21:10:24.409150] [DEBUG] [VALIDATOR ] SNA: All expected trading days are present. [2025-09-29T21:10:24.409252] [DEBUG] [VALIDATOR ] SNA: Primary data validation passed. [2025-09-29T21:10:24.410194] [INFO ] [MAIN ] SNA: Fetched primary data is valid. [2025-09-29T21:10:24.410262] [DEBUG] [LOCAL ] SNA: Saving primary data. [2025-09-29T21:10:24.411619] [DEBUG] [LOCAL ] SNA: Trimmed 38936 records to 26015 (keeping 200 days of data) [2025-09-29T21:10:24.591172] [DEBUG] [LOCAL ] SNA: Primary data saved (26015 records). [2025-09-29T21:10:24.591338] [INFO ] [MAIN ] SNA: Full history saved. [2025-09-29T21:10:24.591442] [INFO ] [MAIN ] Update Progress: 1949/2371 symbols completed. SNA took 23.6s. Estimated remaining: 54m 13s. Rate: 7.8 symbols/min [2025-09-29T21:10:24.767052] [INFO ] [MAIN ] SNDR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:10:24.811666] [DEBUG] [LOCAL ] SNDR: Loaded 41368 existing records from primary storage. [2025-09-29T21:10:24.811978] [INFO ] [MAIN ] SNDR: Loaded 41368 existing records. [2025-09-29T21:10:24.993551] [WARN ] [MAIN ] SNDR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:10:24.993941] [INFO ] [MAIN ] SNDR: Wiping existing primary data before full refresh. [2025-09-29T21:10:24.993992] [INFO ] [LOCAL ] SNDR: Starting deletion of primary data. [2025-09-29T21:10:24.994377] [DEBUG] [LOCAL ] SNDR: Deleted primary data file. [2025-09-29T21:10:24.994437] [INFO ] [MAIN ] SNDR: Starting full primary refresh. [2025-09-29T21:10:25.158196] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-08. [2025-09-29T21:10:25.277631] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-29T21:10:25.389229] [INFO ] [REMOTE ] SNDR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:10:25.948146] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-05. [2025-09-29T21:10:26.062579] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-09-29T21:10:26.699807] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-29T21:10:26.748145] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-05. [2025-09-29T21:10:27.197756] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-29T21:10:27.548120] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2024-12. [2025-09-29T21:10:28.348111] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-09. [2025-09-29T21:10:29.148092] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-06. [2025-09-29T21:10:29.261062] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-09-29T21:10:29.296627] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-29T21:10:29.821844] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-29T21:10:29.959727] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-01. [2025-09-29T21:10:29.965548] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-29T21:10:29.977577] [INFO ] [REMOTE ] SN: Full fetch complete (70818 records). [2025-09-29T21:10:29.977769] [DEBUG] [VALIDATOR ] SN: Validating primary data. [2025-09-29T21:10:30.397673] [DEBUG] [VALIDATOR ] SN: All expected trading days are present. [2025-09-29T21:10:30.397777] [DEBUG] [VALIDATOR ] SN: Primary data validation passed. [2025-09-29T21:10:30.398871] [INFO ] [MAIN ] SN: Fetched primary data is valid. [2025-09-29T21:10:30.398944] [DEBUG] [LOCAL ] SN: Saving primary data. [2025-09-29T21:10:30.400777] [DEBUG] [LOCAL ] SN: Trimmed 70818 records to 49744 (keeping 200 days of data) [2025-09-29T21:10:30.722963] [DEBUG] [LOCAL ] SN: Primary data saved (49744 records). [2025-09-29T21:10:30.723106] [INFO ] [MAIN ] SN: Full history saved. [2025-09-29T21:10:30.723194] [INFO ] [MAIN ] Update Progress: 1950/2371 symbols completed. SN took 41.9s. Estimated remaining: 54m 4s. Rate: 7.8 symbols/min [2025-09-29T21:10:30.757290] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-06. [2025-09-29T21:10:30.902962] [INFO ] [MAIN ] SNN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:10:30.953188] [DEBUG] [LOCAL ] SNN: Loaded 45037 existing records from primary storage. [2025-09-29T21:10:30.953493] [INFO ] [MAIN ] SNN: Loaded 45037 existing records. [2025-09-29T21:10:31.151946] [WARN ] [MAIN ] SNN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:10:31.152172] [INFO ] [MAIN ] SNN: Wiping existing primary data before full refresh. [2025-09-29T21:10:31.152220] [INFO ] [LOCAL ] SNN: Starting deletion of primary data. [2025-09-29T21:10:31.152820] [DEBUG] [LOCAL ] SNN: Deleted primary data file. [2025-09-29T21:10:31.152882] [INFO ] [MAIN ] SNN: Starting full primary refresh. [2025-09-29T21:10:31.549210] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-07. [2025-09-29T21:10:31.549084] [INFO ] [REMOTE ] SNN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:10:31.577761] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-29T21:10:32.312941] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-29T21:10:32.348114] [INFO ] [REMOTE ] SNN: Fetching primary data for 2024-12. [2025-09-29T21:10:33.148136] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-08. [2025-09-29T21:10:33.332700] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-06 (2.58 seconds). [2025-09-29T21:10:33.695369] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-29T21:10:33.901743] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-29T21:10:33.948164] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-09. [2025-09-29T21:10:34.687470] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-29T21:10:34.689145] [INFO ] [REMOTE ] SNDA: Full fetch complete (8261 records). [2025-09-29T21:10:34.689284] [DEBUG] [VALIDATOR ] SNDA: Validating primary data. [2025-09-29T21:10:34.753290] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-01. [2025-09-29T21:10:35.098962] [DEBUG] [VALIDATOR ] SNDA: All expected trading days are present. [2025-09-29T21:10:35.099054] [DEBUG] [VALIDATOR ] SNDA: Primary data validation passed. [2025-09-29T21:10:35.099280] [INFO ] [MAIN ] SNDA: Fetched primary data is valid. [2025-09-29T21:10:35.099323] [DEBUG] [LOCAL ] SNDA: Saving primary data. [2025-09-29T21:10:35.099970] [DEBUG] [LOCAL ] SNDA: Trimmed 8261 records to 4575 (keeping 200 days of data) [2025-09-29T21:10:35.128442] [DEBUG] [LOCAL ] SNDA: Primary data saved (4575 records). [2025-09-29T21:10:35.128592] [INFO ] [MAIN ] SNDA: Full history saved. [2025-09-29T21:10:35.128720] [INFO ] [MAIN ] Update Progress: 1951/2371 symbols completed. SNDA took 22.7s. Estimated remaining: 53m 56s. Rate: 7.8 symbols/min [2025-09-29T21:10:35.316056] [INFO ] [MAIN ] SNOW: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:10:35.379442] [DEBUG] [LOCAL ] SNOW: Loaded 54371 existing records from primary storage. [2025-09-29T21:10:35.379839] [INFO ] [MAIN ] SNOW: Loaded 54371 existing records. [2025-09-29T21:10:35.559787] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-02. [2025-09-29T21:10:35.565815] [WARN ] [MAIN ] SNOW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:10:35.566065] [INFO ] [MAIN ] SNOW: Wiping existing primary data before full refresh. [2025-09-29T21:10:35.566866] [INFO ] [LOCAL ] SNOW: Starting deletion of primary data. [2025-09-29T21:10:35.567486] [DEBUG] [LOCAL ] SNOW: Deleted primary data file. [2025-09-29T21:10:35.567548] [INFO ] [MAIN ] SNOW: Starting full primary refresh. [2025-09-29T21:10:35.952913] [INFO ] [REMOTE ] SNOW: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:10:36.348153] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2024-12. [2025-09-29T21:10:36.404544] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-29T21:10:37.148124] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-02. [2025-09-29T21:10:37.207585] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-29T21:10:37.948134] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-03. [2025-09-29T21:10:38.505905] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-29T21:10:38.751064] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-07. [2025-09-29T21:10:38.765520] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-09-29T21:10:39.187370] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-29T21:10:39.548126] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-04. [2025-09-29T21:10:40.348148] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-01. [2025-09-29T21:10:41.084805] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-29T21:10:41.148067] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-05. [2025-09-29T21:10:41.186303] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-09-29T21:10:41.948150] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-08. [2025-09-29T21:10:42.475727] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-29T21:10:42.689756] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-29T21:10:42.748149] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-02. [2025-09-29T21:10:43.548162] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-03. [2025-09-29T21:10:44.348174] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-06. [2025-09-29T21:10:44.548313] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-08 (2.60 seconds). [2025-09-29T21:10:45.148089] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-09. [2025-09-29T21:10:45.201499] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-29T21:10:45.239128] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-02 (2.49 seconds). [2025-09-29T21:10:45.634939] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-29T21:10:45.948130] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-07. [2025-09-29T21:10:46.748149] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-04. [2025-09-29T21:10:47.548499] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-03. [2025-09-29T21:10:47.548414] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-09-29T21:10:47.561272] [INFO ] [REMOTE ] SNAP: Full fetch complete (77934 records). [2025-09-29T21:10:47.561443] [DEBUG] [VALIDATOR ] SNAP: Validating primary data. [2025-09-29T21:10:47.761376] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-29T21:10:48.022364] [DEBUG] [VALIDATOR ] SNAP: All expected trading days are present. [2025-09-29T21:10:48.022452] [DEBUG] [VALIDATOR ] SNAP: Primary data validation passed. [2025-09-29T21:10:48.023612] [INFO ] [MAIN ] SNAP: Fetched primary data is valid. [2025-09-29T21:10:48.023704] [DEBUG] [LOCAL ] SNAP: Saving primary data. [2025-09-29T21:10:48.025227] [DEBUG] [LOCAL ] SNAP: Trimmed 77934 records to 53796 (keeping 200 days of data) [2025-09-29T21:10:48.348283] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-08. [2025-09-29T21:10:48.357629] [DEBUG] [LOCAL ] SNAP: Primary data saved (53796 records). [2025-09-29T21:10:48.357894] [INFO ] [MAIN ] SNAP: Full history saved. [2025-09-29T21:10:48.357998] [INFO ] [MAIN ] Update Progress: 1952/2371 symbols completed. SNAP took 41.3s. Estimated remaining: 53m 50s. Rate: 7.8 symbols/min [2025-09-29T21:10:48.538757] [INFO ] [MAIN ] SNV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:10:48.568961] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-29T21:10:48.623515] [DEBUG] [LOCAL ] SNV: Loaded 49633 existing records from primary storage. [2025-09-29T21:10:48.623908] [INFO ] [MAIN ] SNV: Loaded 49633 existing records. [2025-09-29T21:10:48.812228] [WARN ] [MAIN ] SNV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:10:48.812466] [INFO ] [MAIN ] SNV: Wiping existing primary data before full refresh. [2025-09-29T21:10:48.812516] [INFO ] [LOCAL ] SNV: Starting deletion of primary data. [2025-09-29T21:10:48.813073] [DEBUG] [LOCAL ] SNV: Deleted primary data file. [2025-09-29T21:10:48.813136] [INFO ] [MAIN ] SNV: Starting full primary refresh. [2025-09-29T21:10:49.152943] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-05. [2025-09-29T21:10:49.193773] [INFO ] [REMOTE ] SNV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:10:49.546273] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-29T21:10:49.927022] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-29T21:10:49.948071] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-09. [2025-09-29T21:10:50.748173] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-04. [2025-09-29T21:10:50.983902] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-29T21:10:51.548098] [INFO ] [REMOTE ] SNV: Fetching primary data for 2024-12. [2025-09-29T21:10:51.631110] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-29T21:10:51.640262] [INFO ] [REMOTE ] SNDR: Full fetch complete (59070 records). [2025-09-29T21:10:51.640414] [DEBUG] [VALIDATOR ] SNDR: Validating primary data. [2025-09-29T21:10:52.049069] [DEBUG] [VALIDATOR ] SNDR: All expected trading days are present. [2025-09-29T21:10:52.049268] [DEBUG] [VALIDATOR ] SNDR: Primary data validation passed. [2025-09-29T21:10:52.050318] [INFO ] [MAIN ] SNDR: Fetched primary data is valid. [2025-09-29T21:10:52.050385] [DEBUG] [LOCAL ] SNDR: Saving primary data. [2025-09-29T21:10:52.054419] [DEBUG] [LOCAL ] SNDR: Trimmed 59070 records to 40706 (keeping 200 days of data) [2025-09-29T21:10:52.322429] [DEBUG] [LOCAL ] SNDR: Primary data saved (40706 records). [2025-09-29T21:10:52.322560] [INFO ] [MAIN ] SNDR: Full history saved. [2025-09-29T21:10:52.322663] [INFO ] [MAIN ] Update Progress: 1953/2371 symbols completed. SNDR took 27.7s. Estimated remaining: 53m 41s. Rate: 7.8 symbols/min [2025-09-29T21:10:52.356767] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-06. [2025-09-29T21:10:52.509706] [INFO ] [MAIN ] SNX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:10:52.554937] [DEBUG] [LOCAL ] SNX: Loaded 40540 existing records from primary storage. [2025-09-29T21:10:52.555309] [INFO ] [MAIN ] SNX: Loaded 40540 existing records. [2025-09-29T21:10:52.742208] [WARN ] [MAIN ] SNX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:10:52.742531] [INFO ] [MAIN ] SNX: Wiping existing primary data before full refresh. [2025-09-29T21:10:52.742584] [INFO ] [LOCAL ] SNX: Starting deletion of primary data. [2025-09-29T21:10:52.742990] [DEBUG] [LOCAL ] SNX: Deleted primary data file. [2025-09-29T21:10:52.743051] [INFO ] [MAIN ] SNX: Starting full primary refresh. [2025-09-29T21:10:53.125266] [INFO ] [REMOTE ] SNX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:10:53.158541] [INFO ] [REMOTE ] SNX: Fetching primary data for 2024-12. [2025-09-29T21:10:53.162096] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-09-29T21:10:53.304759] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-29T21:10:53.948086] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-01. [2025-09-29T21:10:54.044039] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-29T21:10:54.748104] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-07. [2025-09-29T21:10:55.240505] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-29T21:10:55.548133] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-05. [2025-09-29T21:10:55.739926] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-29T21:10:56.348144] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-01. [2025-09-29T21:10:56.496056] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-29T21:10:57.148206] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-08. [2025-09-29T21:10:57.948127] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-02. [2025-09-29T21:10:58.085081] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-29T21:10:58.128049] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-05 (2.58 seconds). [2025-09-29T21:10:58.748116] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-02. [2025-09-29T21:10:58.915793] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-29T21:10:59.548106] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-09. [2025-09-29T21:10:59.694452] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-29T21:10:59.800925] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-29T21:11:00.348118] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-06. [2025-09-29T21:11:01.148151] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-03. [2025-09-29T21:11:01.308281] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-29T21:11:01.318667] [INFO ] [REMOTE ] SNN: Full fetch complete (63154 records). [2025-09-29T21:11:01.318856] [DEBUG] [VALIDATOR ] SNN: Validating primary data. [2025-09-29T21:11:01.803687] [DEBUG] [VALIDATOR ] SNN: All expected trading days are present. [2025-09-29T21:11:01.803829] [DEBUG] [VALIDATOR ] SNN: Primary data validation passed. [2025-09-29T21:11:01.805512] [INFO ] [MAIN ] SNN: Fetched primary data is valid. [2025-09-29T21:11:01.805610] [DEBUG] [LOCAL ] SNN: Saving primary data. [2025-09-29T21:11:01.807464] [DEBUG] [LOCAL ] SNN: Trimmed 63154 records to 44340 (keeping 200 days of data) [2025-09-29T21:11:01.950568] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-03. [2025-09-29T21:11:02.139100] [DEBUG] [LOCAL ] SNN: Primary data saved (44340 records). [2025-09-29T21:11:02.139233] [INFO ] [MAIN ] SNN: Full history saved. [2025-09-29T21:11:02.139324] [INFO ] [MAIN ] Update Progress: 1954/2371 symbols completed. SNN took 31.4s. Estimated remaining: 53m 34s. Rate: 7.8 symbols/min [2025-09-29T21:11:02.326281] [INFO ] [MAIN ] SO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:11:02.382277] [DEBUG] [LOCAL ] SO: Loaded 54383 existing records from primary storage. [2025-09-29T21:11:02.382677] [INFO ] [MAIN ] SO: Loaded 54383 existing records. [2025-09-29T21:11:02.571703] [WARN ] [MAIN ] SO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:11:02.572171] [INFO ] [MAIN ] SO: Wiping existing primary data before full refresh. [2025-09-29T21:11:02.572236] [INFO ] [LOCAL ] SO: Starting deletion of primary data. [2025-09-29T21:11:02.572831] [DEBUG] [LOCAL ] SO: Deleted primary data file. [2025-09-29T21:11:02.572907] [INFO ] [MAIN ] SO: Starting full primary refresh. [2025-09-29T21:11:02.976205] [INFO ] [REMOTE ] SO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:11:02.976763] [INFO ] [REMOTE ] SO: Fetching primary data for 2024-12. [2025-09-29T21:11:03.009086] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-06 (2.66 seconds). [2025-09-29T21:11:03.372609] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-29T21:11:03.548111] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-04. [2025-09-29T21:11:04.349143] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-07. [2025-09-29T21:11:04.357442] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-09-29T21:11:05.150290] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-04. [2025-09-29T21:11:05.156225] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-29T21:11:05.736395] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-29T21:11:05.948132] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-05. [2025-09-29T21:11:06.748089] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-01. [2025-09-29T21:11:06.848263] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-09-29T21:11:07.034595] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-29T21:11:07.234069] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-29T21:11:07.548172] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-08. [2025-09-29T21:11:08.348113] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-06. [2025-09-29T21:11:08.484877] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-29T21:11:09.148123] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-05. [2025-09-29T21:11:09.948082] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-02. [2025-09-29T21:11:10.051841] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-29T21:11:10.166663] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-09-29T21:11:10.451683] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-29T21:11:10.748165] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-09. [2025-09-29T21:11:11.556458] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-06. [2025-09-29T21:11:11.577055] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-29T21:11:11.775168] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-29T21:11:11.786032] [INFO ] [REMOTE ] SNOW: Full fetch complete (77260 records). [2025-09-29T21:11:11.786237] [DEBUG] [VALIDATOR ] SNOW: Validating primary data. [2025-09-29T21:11:11.788429] [FATAL] [VALIDATOR ] SNOW: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T21:11:11.788524] [FATAL] [MAIN ] SNOW: Fetched primary data is invalid. Refusing to save it. [2025-09-29T21:11:11.788570] [WARN ] [MAIN ] SNOW: Deleting existing primary and derivative data due to validation failure. [2025-09-29T21:11:11.788662] [INFO ] [LOCAL ] SNOW: Starting deletion of primary data. [2025-09-29T21:11:11.788761] [DEBUG] [LOCAL ] SNOW: No primary data file found to delete. [2025-09-29T21:11:11.788829] [INFO ] [LOCAL ] SNOW: Starting deletion of derivative data. [2025-09-29T21:11:11.789270] [DEBUG] [LOCAL ] SNOW: Deleted derivative data file. [2025-09-29T21:11:11.789385] [INFO ] [MAIN ] Update Progress: 1955/2371 symbols completed. SNOW took 36.7s. Estimated remaining: 53m 26s. Rate: 7.8 symbols/min [2025-09-29T21:11:11.969766] [INFO ] [MAIN ] SOBO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:11:12.013045] [DEBUG] [LOCAL ] SOBO: Loaded 40211 existing records from primary storage. [2025-09-29T21:11:12.013420] [INFO ] [MAIN ] SOBO: Loaded 40211 existing records. [2025-09-29T21:11:12.203497] [WARN ] [MAIN ] SOBO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:11:12.203758] [INFO ] [MAIN ] SOBO: Wiping existing primary data before full refresh. [2025-09-29T21:11:12.203812] [INFO ] [LOCAL ] SOBO: Starting deletion of primary data. [2025-09-29T21:11:12.204340] [DEBUG] [LOCAL ] SOBO: Deleted primary data file. [2025-09-29T21:11:12.204400] [INFO ] [MAIN ] SOBO: Starting full primary refresh. [2025-09-29T21:11:12.353261] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-07. [2025-09-29T21:11:12.602098] [INFO ] [REMOTE ] SOBO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:11:12.964140] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-29T21:11:13.148223] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2024-12. [2025-09-29T21:11:13.948108] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-03. [2025-09-29T21:11:14.089758] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-29T21:11:14.489701] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-29T21:11:14.748167] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-01. [2025-09-29T21:11:15.548133] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-08. [2025-09-29T21:11:16.000140] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-29T21:11:16.212449] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-29T21:11:16.348151] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-02. [2025-09-29T21:11:17.086846] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-29T21:11:17.148137] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-07. [2025-09-29T21:11:17.594783] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-29T21:11:17.948153] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-09. [2025-09-29T21:11:18.748143] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-03. [2025-09-29T21:11:19.058077] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-29T21:11:19.427226] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-29T21:11:19.435999] [INFO ] [REMOTE ] SNX: Full fetch complete (56998 records). [2025-09-29T21:11:19.436150] [DEBUG] [VALIDATOR ] SNX: Validating primary data. [2025-09-29T21:11:19.553277] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-04. [2025-09-29T21:11:19.854937] [DEBUG] [VALIDATOR ] SNX: All expected trading days are present. [2025-09-29T21:11:19.855033] [DEBUG] [VALIDATOR ] SNX: Primary data validation passed. [2025-09-29T21:11:19.856158] [INFO ] [MAIN ] SNX: Fetched primary data is valid. [2025-09-29T21:11:19.856245] [DEBUG] [LOCAL ] SNX: Saving primary data. [2025-09-29T21:11:19.857620] [DEBUG] [LOCAL ] SNX: Trimmed 56998 records to 39916 (keeping 200 days of data) [2025-09-29T21:11:20.125887] [DEBUG] [LOCAL ] SNX: Primary data saved (39916 records). [2025-09-29T21:11:20.126086] [INFO ] [MAIN ] SNX: Full history saved. [2025-09-29T21:11:20.127889] [INFO ] [MAIN ] Update Progress: 1956/2371 symbols completed. SNX took 27.8s. Estimated remaining: 53m 19s. Rate: 7.8 symbols/min [2025-09-29T21:11:20.341436] [INFO ] [MAIN ] SOC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:11:20.343275] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-29T21:11:20.353054] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-08. [2025-09-29T21:11:20.409563] [DEBUG] [LOCAL ] SOC: Loaded 51041 existing records from primary storage. [2025-09-29T21:11:20.410037] [INFO ] [MAIN ] SOC: Loaded 51041 existing records. [2025-09-29T21:11:20.596504] [WARN ] [MAIN ] SOC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:11:20.596744] [INFO ] [MAIN ] SOC: Wiping existing primary data before full refresh. [2025-09-29T21:11:20.596798] [INFO ] [LOCAL ] SOC: Starting deletion of primary data. [2025-09-29T21:11:20.597263] [DEBUG] [LOCAL ] SOC: Deleted primary data file. [2025-09-29T21:11:20.597324] [INFO ] [MAIN ] SOC: Starting full primary refresh. [2025-09-29T21:11:21.007808] [INFO ] [REMOTE ] SOC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:11:21.148119] [INFO ] [REMOTE ] SOC: Fetching primary data for 2024-12. [2025-09-29T21:11:21.405672] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-29T21:11:21.948091] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-05. [2025-09-29T21:11:22.274834] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-29T21:11:22.748136] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-09. [2025-09-29T21:11:22.876566] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-29T21:11:23.548117] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-01. [2025-09-29T21:11:23.916822] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-29T21:11:24.348128] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-04. [2025-09-29T21:11:24.420184] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-29T21:11:24.430774] [INFO ] [REMOTE ] SNV: Full fetch complete (71137 records). [2025-09-29T21:11:24.430987] [DEBUG] [VALIDATOR ] SNV: Validating primary data. [2025-09-29T21:11:24.857737] [DEBUG] [VALIDATOR ] SNV: All expected trading days are present. [2025-09-29T21:11:24.857844] [DEBUG] [VALIDATOR ] SNV: Primary data validation passed. [2025-09-29T21:11:24.859085] [INFO ] [MAIN ] SNV: Fetched primary data is valid. [2025-09-29T21:11:24.859152] [DEBUG] [LOCAL ] SNV: Saving primary data. [2025-09-29T21:11:24.860611] [DEBUG] [LOCAL ] SNV: Trimmed 71137 records to 48851 (keeping 200 days of data) [2025-09-29T21:11:25.150726] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-06. [2025-09-29T21:11:25.181717] [DEBUG] [LOCAL ] SNV: Primary data saved (48851 records). [2025-09-29T21:11:25.181872] [INFO ] [MAIN ] SNV: Full history saved. [2025-09-29T21:11:25.181960] [INFO ] [MAIN ] Update Progress: 1957/2371 symbols completed. SNV took 36.8s. Estimated remaining: 53m 11s. Rate: 7.8 symbols/min [2025-09-29T21:11:25.337532] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-29T21:11:25.722844] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-29T21:11:25.948159] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-02. [2025-09-29T21:11:26.748137] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-05. [2025-09-29T21:11:27.038163] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-29T21:11:27.548173] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-07. [2025-09-29T21:11:27.601990] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-29T21:11:28.334602] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-29T21:11:28.348062] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-06. [2025-09-29T21:11:29.148107] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-03. [2025-09-29T21:11:29.621383] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-29T21:11:29.895561] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-29T21:11:29.948126] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-07. [2025-09-29T21:11:30.748171] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-08. [2025-09-29T21:11:30.904885] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-29T21:11:30.977190] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-29T21:11:31.494942] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-29T21:11:31.548084] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-09. [2025-09-29T21:11:32.348144] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-04. [2025-09-29T21:11:32.501503] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-29T21:11:32.512324] [INFO ] [REMOTE ] SO: Full fetch complete (77198 records). [2025-09-29T21:11:32.512561] [DEBUG] [VALIDATOR ] SO: Validating primary data. [2025-09-29T21:11:32.513565] [FATAL] [VALIDATOR ] SO: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T21:11:32.513699] [FATAL] [MAIN ] SO: Fetched primary data is invalid. Refusing to save it. [2025-09-29T21:11:32.513791] [WARN ] [MAIN ] SO: Deleting existing primary and derivative data due to validation failure. [2025-09-29T21:11:32.513890] [INFO ] [LOCAL ] SO: Starting deletion of primary data. [2025-09-29T21:11:32.513997] [DEBUG] [LOCAL ] SO: No primary data file found to delete. [2025-09-29T21:11:32.514071] [INFO ] [LOCAL ] SO: Starting deletion of derivative data. [2025-09-29T21:11:32.514853] [DEBUG] [LOCAL ] SO: Deleted derivative data file. [2025-09-29T21:11:32.514983] [INFO ] [MAIN ] Update Progress: 1958/2371 symbols completed. SO took 30.4s. Estimated remaining: 53m 3s. Rate: 7.8 symbols/min [2025-09-29T21:11:33.148178] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-08. [2025-09-29T21:11:34.206005] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-29T21:11:34.217628] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-05. [2025-09-29T21:11:34.242908] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-29T21:11:34.748156] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-09. [2025-09-29T21:11:35.824317] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-29T21:11:35.836469] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-06. [2025-09-29T21:11:36.253306] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-29T21:11:36.261880] [INFO ] [REMOTE ] SOBO: Full fetch complete (58509 records). [2025-09-29T21:11:36.262031] [DEBUG] [VALIDATOR ] SOBO: Validating primary data. [2025-09-29T21:11:36.663842] [DEBUG] [VALIDATOR ] SOBO: All expected trading days are present. [2025-09-29T21:11:36.663934] [DEBUG] [VALIDATOR ] SOBO: Primary data validation passed. [2025-09-29T21:11:36.664933] [INFO ] [MAIN ] SOBO: Fetched primary data is valid. [2025-09-29T21:11:36.665003] [DEBUG] [LOCAL ] SOBO: Saving primary data. [2025-09-29T21:11:36.666240] [DEBUG] [LOCAL ] SOBO: Trimmed 58509 records to 39451 (keeping 200 days of data) [2025-09-29T21:11:36.922260] [DEBUG] [LOCAL ] SOBO: Primary data saved (39451 records). [2025-09-29T21:11:36.922460] [INFO ] [MAIN ] SOBO: Full history saved. [2025-09-29T21:11:36.922587] [INFO ] [MAIN ] Update Progress: 1959/2371 symbols completed. SOBO took 25.1s. Estimated remaining: 52m 54s. Rate: 7.8 symbols/min [2025-09-29T21:11:37.633872] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-29T21:11:37.644882] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-07. [2025-09-29T21:11:39.482105] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-29T21:11:39.494162] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-08. [2025-09-29T21:11:41.017467] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-29T21:11:41.028869] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-09. [2025-09-29T21:11:42.678238] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-29T21:11:42.690034] [INFO ] [REMOTE ] SOC: Full fetch complete (71399 records). [2025-09-29T21:11:42.690224] [DEBUG] [VALIDATOR ] SOC: Validating primary data. [2025-09-29T21:11:43.100565] [DEBUG] [VALIDATOR ] SOC: All expected trading days are present. [2025-09-29T21:11:43.100691] [DEBUG] [VALIDATOR ] SOC: Primary data validation passed. [2025-09-29T21:11:43.101840] [INFO ] [MAIN ] SOC: Fetched primary data is valid. [2025-09-29T21:11:43.101907] [DEBUG] [LOCAL ] SOC: Saving primary data. [2025-09-29T21:11:43.103429] [DEBUG] [LOCAL ] SOC: Trimmed 71399 records to 50346 (keeping 200 days of data) [2025-09-29T21:11:43.410733] [DEBUG] [LOCAL ] SOC: Primary data saved (50346 records). [2025-09-29T21:11:43.410872] [INFO ] [MAIN ] SOC: Full history saved. [2025-09-29T21:11:43.410956] [INFO ] [MAIN ] Update Progress: 1960/2371 symbols completed. SOC took 23.3s. Estimated remaining: 52m 46s. Rate: 7.8 symbols/min [2025-09-29T21:11:44.007992] [INFO ] [MAIN ] SOJC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:11:44.154836] [INFO ] [MAIN ] SOJF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:11:44.158681] [INFO ] [MAIN ] SOJD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:11:44.188635] [INFO ] [MAIN ] SOJE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:11:44.188858] [DEBUG] [LOCAL ] SOJF: No existing data file found in primary storage. [2025-09-29T21:11:44.191543] [WARN ] [MAIN ] SOJF: No existing data found, performing full refresh instead. [2025-09-29T21:11:44.191842] [INFO ] [MAIN ] SOJF: Wiping existing primary data before full refresh. [2025-09-29T21:11:44.191978] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-09-29T21:11:44.192090] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-09-29T21:11:44.192182] [INFO ] [MAIN ] SOJF: Starting full primary refresh. [2025-09-29T21:11:44.195810] [DEBUG] [LOCAL ] SOJC: Loaded 5120 existing records from primary storage. [2025-09-29T21:11:44.251608] [INFO ] [MAIN ] SOJC: Loaded 5120 existing records. [2025-09-29T21:11:44.376885] [DEBUG] [LOCAL ] SOJE: Loaded 9408 existing records from primary storage. [2025-09-29T21:11:44.393054] [DEBUG] [LOCAL ] SOJD: Loaded 13180 existing records from primary storage. [2025-09-29T21:11:44.425021] [INFO ] [MAIN ] SOJD: Loaded 13180 existing records. [2025-09-29T21:11:44.416095] [INFO ] [MAIN ] SOJE: Loaded 9408 existing records. [2025-09-29T21:11:45.047404] [WARN ] [MAIN ] SOJC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:11:45.146129] [WARN ] [MAIN ] SOJD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:11:45.110127] [INFO ] [MAIN ] SOJC: Wiping existing primary data before full refresh. [2025-09-29T21:11:45.209301] [INFO ] [MAIN ] SOJD: Wiping existing primary data before full refresh. [2025-09-29T21:11:45.193221] [INFO ] [LOCAL ] SOJC: Starting deletion of primary data. [2025-09-29T21:11:45.256240] [WARN ] [MAIN ] SOJE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:11:45.259498] [INFO ] [LOCAL ] SOJD: Starting deletion of primary data. [2025-09-29T21:11:45.259316] [INFO ] [REMOTE ] SOJF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:11:45.259896] [INFO ] [MAIN ] SOJE: Wiping existing primary data before full refresh. [2025-09-29T21:11:45.260677] [DEBUG] [LOCAL ] SOJD: Deleted primary data file. [2025-09-29T21:11:45.260545] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2024-12. [2025-09-29T21:11:45.260842] [DEBUG] [LOCAL ] SOJC: Deleted primary data file. [2025-09-29T21:11:45.260601] [INFO ] [LOCAL ] SOJE: Starting deletion of primary data. [2025-09-29T21:11:45.261001] [INFO ] [MAIN ] SOJD: Starting full primary refresh. [2025-09-29T21:11:45.262132] [INFO ] [MAIN ] SOJC: Starting full primary refresh. [2025-09-29T21:11:45.279997] [DEBUG] [LOCAL ] SOJE: Deleted primary data file. [2025-09-29T21:11:45.388431] [INFO ] [MAIN ] SOJE: Starting full primary refresh. [2025-09-29T21:11:45.628299] [DEBUG] [REMOTE ] SOJF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T21:11:45.727917] [WARN ] [REMOTE ] SOJF: No data returned for month 2024-12 [2025-09-29T21:11:45.817951] [FATAL] [REMOTE ] SOJF: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T21:11:45.847171] [FATAL] [MAIN ] SOJF: Failed to fetch primary data. [2025-09-29T21:11:45.864835] [WARN ] [MAIN ] SOJF: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T21:11:45.927604] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-09-29T21:11:45.983575] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-09-29T21:11:46.102046] [INFO ] [LOCAL ] SOJF: Starting deletion of derivative data. [2025-09-29T21:11:46.156841] [DEBUG] [LOCAL ] SOJF: No derivative data file found to delete. [2025-09-29T21:11:46.187025] [INFO ] [MAIN ] Update Progress: 1961/2371 symbols completed. SOJF took 2.8s. Estimated remaining: 52m 38s. Rate: 7.8 symbols/min [2025-09-29T21:11:46.441208] [INFO ] [REMOTE ] SOJC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:11:46.462764] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2024-12. [2025-09-29T21:11:46.566025] [INFO ] [REMOTE ] SOJD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:11:46.615315] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2024-12. [2025-09-29T21:11:46.631518] [INFO ] [REMOTE ] SOJE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:11:46.659109] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2024-12. [2025-09-29T21:11:46.686117] [INFO ] [MAIN ] SOL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:11:46.704819] [DEBUG] [LOCAL ] SOL: Loaded 13694 existing records from primary storage. [2025-09-29T21:11:46.705077] [INFO ] [MAIN ] SOL: Loaded 13694 existing records. [2025-09-29T21:11:46.896190] [WARN ] [MAIN ] SOL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:11:46.896434] [INFO ] [MAIN ] SOL: Wiping existing primary data before full refresh. [2025-09-29T21:11:46.896492] [INFO ] [LOCAL ] SOL: Starting deletion of primary data. [2025-09-29T21:11:46.896787] [DEBUG] [LOCAL ] SOL: Deleted primary data file. [2025-09-29T21:11:46.896848] [INFO ] [MAIN ] SOL: Starting full primary refresh. [2025-09-29T21:11:47.271513] [INFO ] [REMOTE ] SOL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:11:47.271968] [INFO ] [REMOTE ] SOL: Fetching primary data for 2024-12. [2025-09-29T21:11:47.413456] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-29T21:11:47.416715] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-01. [2025-09-29T21:11:47.527836] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-29T21:11:47.532010] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-01. [2025-09-29T21:11:47.834817] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-29T21:11:47.839794] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-01. [2025-09-29T21:11:47.867175] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-29T21:11:47.869407] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-02. [2025-09-29T21:11:48.312115] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-29T21:11:48.313825] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-03. [2025-09-29T21:11:48.355459] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-29T21:11:48.358732] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-02. [2025-09-29T21:11:48.553626] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-29T21:11:48.558835] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-01. [2025-09-29T21:11:48.874965] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-29T21:11:48.881141] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-02. [2025-09-29T21:11:49.004101] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-29T21:11:49.148163] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-04. [2025-09-29T21:11:49.165072] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-29T21:11:49.709766] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-29T21:11:49.822831] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-29T21:11:49.948174] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-03. [2025-09-29T21:11:49.997192] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-29T21:11:50.748131] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-03. [2025-09-29T21:11:51.038884] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-29T21:11:51.548098] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-05. [2025-09-29T21:11:51.703849] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-29T21:11:52.045033] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-29T21:11:52.348124] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-04. [2025-09-29T21:11:53.148096] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-04. [2025-09-29T21:11:53.366226] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-29T21:11:53.948079] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-02. [2025-09-29T21:11:54.018422] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-29T21:11:54.748085] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-06. [2025-09-29T21:11:54.905791] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-29T21:11:55.168138] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-29T21:11:55.548111] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-05. [2025-09-29T21:11:56.348117] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-05. [2025-09-29T21:11:56.410744] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-29T21:11:57.148156] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-07. [2025-09-29T21:11:57.323533] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-29T21:11:57.810860] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-29T21:11:57.948110] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-06. [2025-09-29T21:11:58.748109] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-03. [2025-09-29T21:11:58.844949] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-29T21:11:59.548120] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-08. [2025-09-29T21:11:59.631050] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-29T21:12:00.205395] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-29T21:12:00.348126] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-06. [2025-09-29T21:12:01.148123] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-04. [2025-09-29T21:12:01.252131] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-29T21:12:01.948094] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-07. [2025-09-29T21:12:02.098882] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-29T21:12:02.748130] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-09. [2025-09-29T21:12:02.798570] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-29T21:12:03.409107] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-29T21:12:03.410865] [INFO ] [REMOTE ] SOJC: Full fetch complete (7840 records). [2025-09-29T21:12:03.410956] [DEBUG] [VALIDATOR ] SOJC: Validating primary data. [2025-09-29T21:12:03.553276] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-08. [2025-09-29T21:12:03.863019] [DEBUG] [VALIDATOR ] SOJC: All expected trading days are present. [2025-09-29T21:12:03.863108] [DEBUG] [VALIDATOR ] SOJC: Primary data validation passed. [2025-09-29T21:12:03.863341] [INFO ] [MAIN ] SOJC: Fetched primary data is valid. [2025-09-29T21:12:03.863435] [DEBUG] [LOCAL ] SOJC: Saving primary data. [2025-09-29T21:12:03.863916] [DEBUG] [LOCAL ] SOJC: Trimmed 7840 records to 5050 (keeping 200 days of data) [2025-09-29T21:12:03.897844] [DEBUG] [LOCAL ] SOJC: Primary data saved (5050 records). [2025-09-29T21:12:03.897986] [INFO ] [MAIN ] SOJC: Full history saved. [2025-09-29T21:12:03.898082] [INFO ] [MAIN ] Update Progress: 1962/2371 symbols completed. SOJC took 20.5s. Estimated remaining: 52m 32s. Rate: 7.8 symbols/min [2025-09-29T21:12:04.083530] [INFO ] [MAIN ] SOLV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:12:04.135147] [DEBUG] [LOCAL ] SOLV: Loaded 44791 existing records from primary storage. [2025-09-29T21:12:04.135493] [INFO ] [MAIN ] SOLV: Loaded 44791 existing records. [2025-09-29T21:12:04.330308] [WARN ] [MAIN ] SOLV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:12:04.330750] [INFO ] [MAIN ] SOLV: Wiping existing primary data before full refresh. [2025-09-29T21:12:04.330837] [INFO ] [LOCAL ] SOLV: Starting deletion of primary data. [2025-09-29T21:12:04.337841] [DEBUG] [LOCAL ] SOLV: Deleted primary data file. [2025-09-29T21:12:04.338175] [INFO ] [MAIN ] SOLV: Starting full primary refresh. [2025-09-29T21:12:04.353221] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-07. [2025-09-29T21:12:04.362182] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-29T21:12:04.745452] [INFO ] [REMOTE ] SOLV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:12:05.148089] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-05. [2025-09-29T21:12:05.456961] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-29T21:12:05.948108] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-08. [2025-09-29T21:12:06.067703] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-29T21:12:06.748122] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-06. [2025-09-29T21:12:06.850931] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-29T21:12:07.548132] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-09. [2025-09-29T21:12:07.636714] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-29T21:12:08.348118] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-07. [2025-09-29T21:12:08.402502] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-29T21:12:08.404635] [INFO ] [REMOTE ] SOJE: Full fetch complete (14477 records). [2025-09-29T21:12:08.404737] [DEBUG] [VALIDATOR ] SOJE: Validating primary data. [2025-09-29T21:12:08.787630] [DEBUG] [VALIDATOR ] SOJE: All expected trading days are present. [2025-09-29T21:12:08.787790] [DEBUG] [VALIDATOR ] SOJE: Primary data validation passed. [2025-09-29T21:12:08.788270] [INFO ] [MAIN ] SOJE: Fetched primary data is valid. [2025-09-29T21:12:08.788337] [DEBUG] [LOCAL ] SOJE: Saving primary data. [2025-09-29T21:12:08.789146] [DEBUG] [LOCAL ] SOJE: Trimmed 14477 records to 9332 (keeping 200 days of data) [2025-09-29T21:12:08.847745] [DEBUG] [LOCAL ] SOJE: Primary data saved (9332 records). [2025-09-29T21:12:08.847916] [INFO ] [MAIN ] SOJE: Full history saved. [2025-09-29T21:12:08.848012] [INFO ] [MAIN ] Update Progress: 1963/2371 symbols completed. SOJE took 25.4s. Estimated remaining: 52m 24s. Rate: 7.8 symbols/min [2025-09-29T21:12:09.027412] [INFO ] [MAIN ] SON: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:12:09.076069] [DEBUG] [LOCAL ] SON: Loaded 43596 existing records from primary storage. [2025-09-29T21:12:09.076496] [INFO ] [MAIN ] SON: Loaded 43596 existing records. [2025-09-29T21:12:09.150399] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2024-12. [2025-09-29T21:12:09.269252] [WARN ] [MAIN ] SON: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:12:09.269466] [INFO ] [MAIN ] SON: Wiping existing primary data before full refresh. [2025-09-29T21:12:09.269514] [INFO ] [LOCAL ] SON: Starting deletion of primary data. [2025-09-29T21:12:09.270077] [DEBUG] [LOCAL ] SON: Deleted primary data file. [2025-09-29T21:12:09.270137] [INFO ] [MAIN ] SON: Starting full primary refresh. [2025-09-29T21:12:09.564813] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-29T21:12:09.680695] [INFO ] [REMOTE ] SON: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:12:09.948144] [INFO ] [REMOTE ] SON: Fetching primary data for 2024-12. [2025-09-29T21:12:10.748135] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-09. [2025-09-29T21:12:10.912968] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-29T21:12:11.548155] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-01. [2025-09-29T21:12:11.610617] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-29T21:12:11.613609] [INFO ] [REMOTE ] SOJD: Full fetch complete (20082 records). [2025-09-29T21:12:11.613716] [DEBUG] [VALIDATOR ] SOJD: Validating primary data. [2025-09-29T21:12:11.816050] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-29T21:12:12.045957] [DEBUG] [VALIDATOR ] SOJD: All expected trading days are present. [2025-09-29T21:12:12.046050] [DEBUG] [VALIDATOR ] SOJD: Primary data validation passed. [2025-09-29T21:12:12.046485] [INFO ] [MAIN ] SOJD: Fetched primary data is valid. [2025-09-29T21:12:12.046528] [DEBUG] [LOCAL ] SOJD: Saving primary data. [2025-09-29T21:12:12.047286] [DEBUG] [LOCAL ] SOJD: Trimmed 20082 records to 13039 (keeping 200 days of data) [2025-09-29T21:12:12.130619] [DEBUG] [LOCAL ] SOJD: Primary data saved (13039 records). [2025-09-29T21:12:12.130800] [INFO ] [MAIN ] SOJD: Full history saved. [2025-09-29T21:12:12.130896] [INFO ] [MAIN ] Update Progress: 1964/2371 symbols completed. SOJD took 28.7s. Estimated remaining: 52m 15s. Rate: 7.8 symbols/min [2025-09-29T21:12:12.308178] [INFO ] [MAIN ] SONY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:12:12.348147] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-01. [2025-09-29T21:12:12.366452] [DEBUG] [LOCAL ] SONY: Loaded 54136 existing records from primary storage. [2025-09-29T21:12:12.366850] [INFO ] [MAIN ] SONY: Loaded 54136 existing records. [2025-09-29T21:12:12.556495] [WARN ] [MAIN ] SONY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:12:12.556769] [INFO ] [MAIN ] SONY: Wiping existing primary data before full refresh. [2025-09-29T21:12:12.556827] [INFO ] [LOCAL ] SONY: Starting deletion of primary data. [2025-09-29T21:12:12.557357] [DEBUG] [LOCAL ] SONY: Deleted primary data file. [2025-09-29T21:12:12.557417] [INFO ] [MAIN ] SONY: Starting full primary refresh. [2025-09-29T21:12:12.925459] [INFO ] [REMOTE ] SONY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:12:13.148157] [INFO ] [REMOTE ] SONY: Fetching primary data for 2024-12. [2025-09-29T21:12:13.527922] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-29T21:12:13.948209] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-08. [2025-09-29T21:12:14.528018] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-29T21:12:14.571609] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-29T21:12:14.748163] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-09. [2025-09-29T21:12:15.310389] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-29T21:12:15.413118] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-29T21:12:15.416119] [INFO ] [REMOTE ] SOL: Full fetch complete (21644 records). [2025-09-29T21:12:15.416199] [DEBUG] [VALIDATOR ] SOL: Validating primary data. [2025-09-29T21:12:15.561587] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-02. [2025-09-29T21:12:15.811403] [DEBUG] [VALIDATOR ] SOL: All expected trading days are present. [2025-09-29T21:12:15.811519] [DEBUG] [VALIDATOR ] SOL: Primary data validation passed. [2025-09-29T21:12:15.812018] [INFO ] [MAIN ] SOL: Fetched primary data is valid. [2025-09-29T21:12:15.812083] [DEBUG] [LOCAL ] SOL: Saving primary data. [2025-09-29T21:12:15.812694] [DEBUG] [LOCAL ] SOL: Trimmed 21644 records to 13458 (keeping 200 days of data) [2025-09-29T21:12:15.894387] [DEBUG] [LOCAL ] SOL: Primary data saved (13458 records). [2025-09-29T21:12:15.894535] [INFO ] [MAIN ] SOL: Full history saved. [2025-09-29T21:12:15.894619] [INFO ] [MAIN ] Update Progress: 1965/2371 symbols completed. SOL took 29.7s. Estimated remaining: 52m 7s. Rate: 7.8 symbols/min [2025-09-29T21:12:16.104774] [INFO ] [MAIN ] SOR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:12:16.110529] [DEBUG] [LOCAL ] SOR: Loaded 2947 existing records from primary storage. [2025-09-29T21:12:16.110748] [INFO ] [MAIN ] SOR: Loaded 2947 existing records. [2025-09-29T21:12:16.295839] [WARN ] [MAIN ] SOR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:12:16.296070] [INFO ] [MAIN ] SOR: Wiping existing primary data before full refresh. [2025-09-29T21:12:16.296119] [INFO ] [LOCAL ] SOR: Starting deletion of primary data. [2025-09-29T21:12:16.296326] [DEBUG] [LOCAL ] SOR: Deleted primary data file. [2025-09-29T21:12:16.296385] [INFO ] [MAIN ] SOR: Starting full primary refresh. [2025-09-29T21:12:16.361104] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-02. [2025-09-29T21:12:16.693469] [INFO ] [REMOTE ] SOR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:12:17.148097] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-01. [2025-09-29T21:12:17.336045] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-29T21:12:17.948091] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-03. [2025-09-29T21:12:18.550758] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-29T21:12:18.748119] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-03. [2025-09-29T21:12:19.141243] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-29T21:12:19.277257] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-29T21:12:19.548139] [INFO ] [REMOTE ] SOR: Fetching primary data for 2024-12. [2025-09-29T21:12:20.299337] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-29T21:12:20.339926] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-29T21:12:20.349861] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-02. [2025-09-29T21:12:21.148127] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-04. [2025-09-29T21:12:21.948150] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-01. [2025-09-29T21:12:22.315716] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-29T21:12:22.639309] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-29T21:12:22.744061] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-29T21:12:22.753252] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-04. [2025-09-29T21:12:23.548112] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-03. [2025-09-29T21:12:24.348110] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-02. [2025-09-29T21:12:24.673768] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-29T21:12:24.762696] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-29T21:12:25.148121] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-05. [2025-09-29T21:12:25.716837] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-29T21:12:25.948128] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-03. [2025-09-29T21:12:26.443080] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-29T21:12:26.758001] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-04. [2025-09-29T21:12:26.763871] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-29T21:12:27.548137] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-06. [2025-09-29T21:12:28.348096] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-05. [2025-09-29T21:12:28.848489] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-29T21:12:29.148133] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-05. [2025-09-29T21:12:29.187728] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-29T21:12:29.941501] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-29T21:12:29.949851] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-07. [2025-09-29T21:12:30.748171] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-06. [2025-09-29T21:12:31.312766] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-29T21:12:31.522752] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-29T21:12:31.548062] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-08. [2025-09-29T21:12:31.983012] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-29T21:12:32.348141] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-07. [2025-09-29T21:12:33.126374] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-29T21:12:33.148074] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-09. [2025-09-29T21:12:33.948086] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-04. [2025-09-29T21:12:34.048839] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-29T21:12:34.397662] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-29T21:12:34.501300] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-29T21:12:34.511329] [INFO ] [REMOTE ] SOLV: Full fetch complete (63224 records). [2025-09-29T21:12:34.511542] [DEBUG] [VALIDATOR ] SOLV: Validating primary data. [2025-09-29T21:12:34.761365] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-08. [2025-09-29T21:12:34.968215] [DEBUG] [VALIDATOR ] SOLV: All expected trading days are present. [2025-09-29T21:12:34.968322] [DEBUG] [VALIDATOR ] SOLV: Primary data validation passed. [2025-09-29T21:12:34.969496] [INFO ] [MAIN ] SOLV: Fetched primary data is valid. [2025-09-29T21:12:34.969569] [DEBUG] [LOCAL ] SOLV: Saving primary data. [2025-09-29T21:12:34.971022] [DEBUG] [LOCAL ] SOLV: Trimmed 63224 records to 44046 (keeping 200 days of data) [2025-09-29T21:12:35.242761] [DEBUG] [LOCAL ] SOLV: Primary data saved (44046 records). [2025-09-29T21:12:35.242912] [INFO ] [MAIN ] SOLV: Full history saved. [2025-09-29T21:12:35.243015] [INFO ] [MAIN ] Update Progress: 1966/2371 symbols completed. SOLV took 31.3s. Estimated remaining: 52m 1s. Rate: 7.8 symbols/min [2025-09-29T21:12:35.418318] [INFO ] [MAIN ] SOS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:12:35.428982] [DEBUG] [LOCAL ] SOS: Loaded 8266 existing records from primary storage. [2025-09-29T21:12:35.429196] [INFO ] [MAIN ] SOS: Loaded 8266 existing records. [2025-09-29T21:12:35.553213] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-05. [2025-09-29T21:12:35.616725] [WARN ] [MAIN ] SOS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:12:35.616930] [INFO ] [MAIN ] SOS: Wiping existing primary data before full refresh. [2025-09-29T21:12:35.616979] [INFO ] [LOCAL ] SOS: Starting deletion of primary data. [2025-09-29T21:12:35.617252] [DEBUG] [LOCAL ] SOS: Deleted primary data file. [2025-09-29T21:12:35.617313] [INFO ] [MAIN ] SOS: Starting full primary refresh. [2025-09-29T21:12:36.007498] [INFO ] [REMOTE ] SOS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:12:36.271282] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-29T21:12:36.273064] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-29T21:12:36.348131] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-09. [2025-09-29T21:12:37.148127] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-06. [2025-09-29T21:12:37.858974] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-29T21:12:37.868712] [INFO ] [REMOTE ] SON: Full fetch complete (62330 records). [2025-09-29T21:12:37.868871] [DEBUG] [VALIDATOR ] SON: Validating primary data. [2025-09-29T21:12:37.953224] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-06. [2025-09-29T21:12:38.277376] [DEBUG] [VALIDATOR ] SON: All expected trading days are present. [2025-09-29T21:12:38.277528] [DEBUG] [VALIDATOR ] SON: Primary data validation passed. [2025-09-29T21:12:38.278565] [INFO ] [MAIN ] SON: Fetched primary data is valid. [2025-09-29T21:12:38.278631] [DEBUG] [LOCAL ] SON: Saving primary data. [2025-09-29T21:12:38.279910] [DEBUG] [LOCAL ] SON: Trimmed 62330 records to 42977 (keeping 200 days of data) [2025-09-29T21:12:38.560526] [DEBUG] [LOCAL ] SON: Primary data saved (42977 records). [2025-09-29T21:12:38.560699] [INFO ] [MAIN ] SON: Full history saved. [2025-09-29T21:12:38.560804] [INFO ] [MAIN ] Update Progress: 1967/2371 symbols completed. SON took 29.7s. Estimated remaining: 51m 53s. Rate: 7.8 symbols/min [2025-09-29T21:12:38.673945] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-29T21:12:38.750403] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-07. [2025-09-29T21:12:38.756177] [INFO ] [MAIN ] SPB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:12:38.807451] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-29T21:12:38.831894] [DEBUG] [LOCAL ] SPB: Loaded 34677 existing records from primary storage. [2025-09-29T21:12:38.832247] [INFO ] [MAIN ] SPB: Loaded 34677 existing records. [2025-09-29T21:12:39.028897] [WARN ] [MAIN ] SPB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:12:39.029123] [INFO ] [MAIN ] SPB: Wiping existing primary data before full refresh. [2025-09-29T21:12:39.029180] [INFO ] [LOCAL ] SPB: Starting deletion of primary data. [2025-09-29T21:12:39.029699] [DEBUG] [LOCAL ] SPB: Deleted primary data file. [2025-09-29T21:12:39.029761] [INFO ] [MAIN ] SPB: Starting full primary refresh. [2025-09-29T21:12:39.422326] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-29T21:12:39.430495] [INFO ] [REMOTE ] SPB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:12:39.548149] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-07. [2025-09-29T21:12:40.348125] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-08. [2025-09-29T21:12:40.911709] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-29T21:12:41.148186] [INFO ] [REMOTE ] SOS: Fetching primary data for 2024-12. [2025-09-29T21:12:41.767672] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-29T21:12:41.948144] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-08. [2025-09-29T21:12:42.301310] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-29T21:12:42.748105] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-09. [2025-09-29T21:12:43.223282] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-29T21:12:43.224483] [INFO ] [REMOTE ] SOR: Full fetch complete (4365 records). [2025-09-29T21:12:43.224559] [DEBUG] [VALIDATOR ] SOR: Validating primary data. [2025-09-29T21:12:43.553269] [INFO ] [REMOTE ] SPB: Fetching primary data for 2024-12. [2025-09-29T21:12:43.688324] [DEBUG] [VALIDATOR ] SOR: All expected trading days are present. [2025-09-29T21:12:43.688449] [DEBUG] [VALIDATOR ] SOR: Primary data validation passed. [2025-09-29T21:12:43.688771] [INFO ] [MAIN ] SOR: Fetched primary data is valid. [2025-09-29T21:12:43.688841] [DEBUG] [LOCAL ] SOR: Saving primary data. [2025-09-29T21:12:43.689322] [DEBUG] [LOCAL ] SOR: Trimmed 4365 records to 2891 (keeping 200 days of data) [2025-09-29T21:12:43.711308] [DEBUG] [LOCAL ] SOR: Primary data saved (2891 records). [2025-09-29T21:12:43.711472] [INFO ] [MAIN ] SOR: Full history saved. [2025-09-29T21:12:43.711616] [INFO ] [MAIN ] Update Progress: 1968/2371 symbols completed. SOR took 27.8s. Estimated remaining: 51m 45s. Rate: 7.8 symbols/min [2025-09-29T21:12:43.934203] [INFO ] [MAIN ] SPCE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:12:43.994488] [DEBUG] [LOCAL ] SPCE: Loaded 50615 existing records from primary storage. [2025-09-29T21:12:43.995048] [INFO ] [MAIN ] SPCE: Loaded 50615 existing records. [2025-09-29T21:12:44.190899] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-29T21:12:44.237012] [WARN ] [MAIN ] SPCE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:12:44.238294] [INFO ] [MAIN ] SPCE: Wiping existing primary data before full refresh. [2025-09-29T21:12:44.238358] [INFO ] [LOCAL ] SPCE: Starting deletion of primary data. [2025-09-29T21:12:44.239279] [DEBUG] [LOCAL ] SPCE: Deleted primary data file. [2025-09-29T21:12:44.239359] [INFO ] [MAIN ] SPCE: Starting full primary refresh. [2025-09-29T21:12:44.353249] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-01. [2025-09-29T21:12:44.645024] [INFO ] [REMOTE ] SPCE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:12:45.059724] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-29T21:12:45.148161] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2024-12. [2025-09-29T21:12:45.199504] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-29T21:12:45.948137] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-09. [2025-09-29T21:12:46.748148] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-02. [2025-09-29T21:12:47.254708] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-29T21:12:47.309886] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-29T21:12:47.548123] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-01. [2025-09-29T21:12:47.982516] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-29T21:12:47.994901] [INFO ] [REMOTE ] SONY: Full fetch complete (77228 records). [2025-09-29T21:12:47.995087] [DEBUG] [VALIDATOR ] SONY: Validating primary data. [2025-09-29T21:12:48.353264] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-01. [2025-09-29T21:12:48.415558] [DEBUG] [VALIDATOR ] SONY: All expected trading days are present. [2025-09-29T21:12:48.415690] [DEBUG] [VALIDATOR ] SONY: Primary data validation passed. [2025-09-29T21:12:48.417025] [INFO ] [MAIN ] SONY: Fetched primary data is valid. [2025-09-29T21:12:48.417130] [DEBUG] [LOCAL ] SONY: Saving primary data. [2025-09-29T21:12:48.422012] [DEBUG] [LOCAL ] SONY: Trimmed 77228 records to 53357 (keeping 200 days of data) [2025-09-29T21:12:48.774147] [DEBUG] [LOCAL ] SONY: Primary data saved (53357 records). [2025-09-29T21:12:48.774311] [INFO ] [MAIN ] SONY: Full history saved. [2025-09-29T21:12:48.774465] [INFO ] [MAIN ] Update Progress: 1969/2371 symbols completed. SONY took 36.6s. Estimated remaining: 51m 36s. Rate: 7.8 symbols/min [2025-09-29T21:12:48.954834] [INFO ] [MAIN ] SPE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:12:48.968043] [DEBUG] [LOCAL ] SPE: Loaded 6441 existing records from primary storage. [2025-09-29T21:12:48.968280] [INFO ] [MAIN ] SPE: Loaded 6441 existing records. [2025-09-29T21:12:49.162828] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-03. [2025-09-29T21:12:49.162550] [WARN ] [MAIN ] SPE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:12:49.164264] [INFO ] [MAIN ] SPE: Wiping existing primary data before full refresh. [2025-09-29T21:12:49.164446] [INFO ] [LOCAL ] SPE: Starting deletion of primary data. [2025-09-29T21:12:49.164782] [DEBUG] [LOCAL ] SPE: Deleted primary data file. [2025-09-29T21:12:49.164936] [INFO ] [MAIN ] SPE: Starting full primary refresh. [2025-09-29T21:12:49.500565] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-29T21:12:49.624712] [INFO ] [REMOTE ] SPE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:12:49.730445] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-29T21:12:49.778189] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-29T21:12:49.948108] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-04. [2025-09-29T21:12:50.489767] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-29T21:12:50.748299] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-02. [2025-09-29T21:12:51.548115] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-05. [2025-09-29T21:12:52.184893] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-29T21:12:52.217747] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-29T21:12:52.348114] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-03. [2025-09-29T21:12:53.148127] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-06. [2025-09-29T21:12:53.622080] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-29T21:12:53.687777] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-29T21:12:53.948111] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-07. [2025-09-29T21:12:54.748127] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-02. [2025-09-29T21:12:55.149232] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-29T21:12:55.548121] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-04. [2025-09-29T21:12:56.348099] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-08. [2025-09-29T21:12:56.722965] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-29T21:12:56.798030] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-29T21:12:57.148119] [INFO ] [REMOTE ] SPE: Fetching primary data for 2024-12. [2025-09-29T21:12:57.438706] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-29T21:12:57.948109] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-09. [2025-09-29T21:12:57.963315] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-29T21:12:58.748112] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-01. [2025-09-29T21:12:58.956907] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-29T21:12:58.961405] [INFO ] [REMOTE ] SOS: Full fetch complete (10981 records). [2025-09-29T21:12:58.961573] [DEBUG] [VALIDATOR ] SOS: Validating primary data. [2025-09-29T21:12:59.450335] [DEBUG] [VALIDATOR ] SOS: All expected trading days are present. [2025-09-29T21:12:59.450420] [DEBUG] [VALIDATOR ] SOS: Primary data validation passed. [2025-09-29T21:12:59.450804] [INFO ] [MAIN ] SOS: Fetched primary data is valid. [2025-09-29T21:12:59.450896] [DEBUG] [LOCAL ] SOS: Saving primary data. [2025-09-29T21:12:59.451416] [DEBUG] [LOCAL ] SOS: Trimmed 10981 records to 8457 (keeping 200 days of data) [2025-09-29T21:12:59.505110] [DEBUG] [LOCAL ] SOS: Primary data saved (8457 records). [2025-09-29T21:12:59.505266] [INFO ] [MAIN ] SOS: Full history saved. [2025-09-29T21:12:59.505383] [INFO ] [MAIN ] Update Progress: 1970/2371 symbols completed. SOS took 24.3s. Estimated remaining: 51m 29s. Rate: 7.8 symbols/min [2025-09-29T21:12:59.552257] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-05. [2025-09-29T21:12:59.593030] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-29T21:12:59.713500] [INFO ] [MAIN ] SPG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:12:59.772456] [DEBUG] [LOCAL ] SPG: Loaded 51134 existing records from primary storage. [2025-09-29T21:12:59.772857] [INFO ] [MAIN ] SPG: Loaded 51134 existing records. [2025-09-29T21:12:59.961724] [WARN ] [MAIN ] SPG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:12:59.961974] [INFO ] [MAIN ] SPG: Wiping existing primary data before full refresh. [2025-09-29T21:12:59.962022] [INFO ] [LOCAL ] SPG: Starting deletion of primary data. [2025-09-29T21:12:59.962504] [DEBUG] [LOCAL ] SPG: Deleted primary data file. [2025-09-29T21:12:59.962567] [INFO ] [MAIN ] SPG: Starting full primary refresh. [2025-09-29T21:13:00.357549] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-02. [2025-09-29T21:13:00.382355] [INFO ] [REMOTE ] SPG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:13:01.148179] [INFO ] [REMOTE ] SPG: Fetching primary data for 2024-12. [2025-09-29T21:13:01.205905] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-29T21:13:01.206289] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-29T21:13:01.948081] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-06. [2025-09-29T21:13:02.748118] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-03. [2025-09-29T21:13:03.072718] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-29T21:13:03.521837] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-29T21:13:03.548096] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-07. [2025-09-29T21:13:03.710539] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-29T21:13:04.348126] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-04. [2025-09-29T21:13:04.945479] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-29T21:13:04.960349] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-29T21:13:05.148129] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-03. [2025-09-29T21:13:05.948145] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-08. [2025-09-29T21:13:06.748139] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-05. [2025-09-29T21:13:07.276929] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-29T21:13:07.345120] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-29T21:13:07.521339] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-29T21:13:07.548076] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-09. [2025-09-29T21:13:08.348128] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-04. [2025-09-29T21:13:09.082195] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-29T21:13:09.089203] [INFO ] [REMOTE ] SPB: Full fetch complete (47493 records). [2025-09-29T21:13:09.089324] [DEBUG] [VALIDATOR ] SPB: Validating primary data. [2025-09-29T21:13:09.156237] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-01. [2025-09-29T21:13:09.505350] [DEBUG] [VALIDATOR ] SPB: All expected trading days are present. [2025-09-29T21:13:09.505444] [DEBUG] [VALIDATOR ] SPB: Primary data validation passed. [2025-09-29T21:13:09.506352] [INFO ] [MAIN ] SPB: Fetched primary data is valid. [2025-09-29T21:13:09.506419] [DEBUG] [LOCAL ] SPB: Saving primary data. [2025-09-29T21:13:09.507673] [DEBUG] [LOCAL ] SPB: Trimmed 47493 records to 34134 (keeping 200 days of data) [2025-09-29T21:13:09.721002] [DEBUG] [LOCAL ] SPB: Primary data saved (34134 records). [2025-09-29T21:13:09.721148] [INFO ] [MAIN ] SPB: Full history saved. [2025-09-29T21:13:09.721253] [INFO ] [MAIN ] Update Progress: 1971/2371 symbols completed. SPB took 31.2s. Estimated remaining: 51m 22s. Rate: 7.8 symbols/min [2025-09-29T21:13:09.901862] [INFO ] [MAIN ] SPGI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:13:09.954781] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-06. [2025-09-29T21:13:09.958190] [DEBUG] [LOCAL ] SPGI: Loaded 46562 existing records from primary storage. [2025-09-29T21:13:09.958687] [INFO ] [MAIN ] SPGI: Loaded 46562 existing records. [2025-09-29T21:13:10.165895] [WARN ] [MAIN ] SPGI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:13:10.166207] [INFO ] [MAIN ] SPGI: Wiping existing primary data before full refresh. [2025-09-29T21:13:10.166287] [INFO ] [LOCAL ] SPGI: Starting deletion of primary data. [2025-09-29T21:13:10.166636] [DEBUG] [LOCAL ] SPGI: Deleted primary data file. [2025-09-29T21:13:10.166782] [INFO ] [MAIN ] SPGI: Starting full primary refresh. [2025-09-29T21:13:10.477338] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-29T21:13:10.601036] [INFO ] [REMOTE ] SPGI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:13:10.729795] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-29T21:13:10.748051] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-07. [2025-09-29T21:13:11.101542] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-29T21:13:11.462620] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-29T21:13:11.548165] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2024-12. [2025-09-29T21:13:12.348166] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-02. [2025-09-29T21:13:13.148155] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-08. [2025-09-29T21:13:13.360523] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-29T21:13:13.948093] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-01. [2025-09-29T21:13:13.963665] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-29T21:13:14.119556] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-29T21:13:14.748137] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-03. [2025-09-29T21:13:15.548105] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-05. [2025-09-29T21:13:15.837475] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-29T21:13:16.348116] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-02. [2025-09-29T21:13:16.653315] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-29T21:13:17.148102] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-04. [2025-09-29T21:13:17.649168] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-29T21:13:17.948101] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-06. [2025-09-29T21:13:18.162240] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-29T21:13:18.748090] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-09. [2025-09-29T21:13:19.188954] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-29T21:13:19.551329] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-05. [2025-09-29T21:13:19.553730] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-29T21:13:19.556699] [INFO ] [REMOTE ] SPE: Full fetch complete (10194 records). [2025-09-29T21:13:19.556780] [DEBUG] [VALIDATOR ] SPE: Validating primary data. [2025-09-29T21:13:19.949311] [DEBUG] [VALIDATOR ] SPE: All expected trading days are present. [2025-09-29T21:13:19.949520] [DEBUG] [VALIDATOR ] SPE: Primary data validation passed. [2025-09-29T21:13:19.949884] [INFO ] [MAIN ] SPE: Fetched primary data is valid. [2025-09-29T21:13:19.950078] [DEBUG] [LOCAL ] SPE: Saving primary data. [2025-09-29T21:13:19.951008] [DEBUG] [LOCAL ] SPE: Trimmed 10194 records to 6363 (keeping 200 days of data) [2025-09-29T21:13:20.011510] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-29T21:13:20.033121] [DEBUG] [LOCAL ] SPE: Primary data saved (6363 records). [2025-09-29T21:13:20.033264] [INFO ] [MAIN ] SPE: Full history saved. [2025-09-29T21:13:20.033357] [INFO ] [MAIN ] Update Progress: 1972/2371 symbols completed. SPE took 31.3s. Estimated remaining: 51m 15s. Rate: 7.8 symbols/min [2025-09-29T21:13:20.200781] [INFO ] [MAIN ] SPH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:13:20.225877] [DEBUG] [LOCAL ] SPH: Loaded 18213 existing records from primary storage. [2025-09-29T21:13:20.226158] [INFO ] [MAIN ] SPH: Loaded 18213 existing records. [2025-09-29T21:13:20.353277] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-07. [2025-09-29T21:13:20.435304] [WARN ] [MAIN ] SPH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:13:20.436188] [INFO ] [MAIN ] SPH: Wiping existing primary data before full refresh. [2025-09-29T21:13:20.436269] [INFO ] [LOCAL ] SPH: Starting deletion of primary data. [2025-09-29T21:13:20.436579] [DEBUG] [LOCAL ] SPH: Deleted primary data file. [2025-09-29T21:13:20.436674] [INFO ] [MAIN ] SPH: Starting full primary refresh. [2025-09-29T21:13:20.844418] [INFO ] [REMOTE ] SPH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:13:21.148072] [INFO ] [REMOTE ] SPH: Fetching primary data for 2024-12. [2025-09-29T21:13:21.238301] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-29T21:13:21.948146] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-06. [2025-09-29T21:13:22.280600] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-29T21:13:22.652319] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-09-29T21:13:22.748137] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-01. [2025-09-29T21:13:23.540352] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-29T21:13:23.550132] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-03. [2025-09-29T21:13:23.907144] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-29T21:13:24.348120] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-02. [2025-09-29T21:13:25.148119] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-08. [2025-09-29T21:13:25.523900] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-29T21:13:25.578279] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-29T21:13:25.948164] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-03. [2025-09-29T21:13:26.748148] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-04. [2025-09-29T21:13:27.277365] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-29T21:13:27.303218] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-29T21:13:27.548116] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-09. [2025-09-29T21:13:28.348102] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-07. [2025-09-29T21:13:28.427787] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-29T21:13:28.438935] [INFO ] [REMOTE ] SPCE: Full fetch complete (72293 records). [2025-09-29T21:13:28.439134] [DEBUG] [VALIDATOR ] SPCE: Validating primary data. [2025-09-29T21:13:28.663690] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-29T21:13:28.910154] [DEBUG] [VALIDATOR ] SPCE: All expected trading days are present. [2025-09-29T21:13:28.910282] [DEBUG] [VALIDATOR ] SPCE: Primary data validation passed. [2025-09-29T21:13:28.911430] [INFO ] [MAIN ] SPCE: Fetched primary data is valid. [2025-09-29T21:13:28.911509] [DEBUG] [LOCAL ] SPCE: Saving primary data. [2025-09-29T21:13:28.916042] [DEBUG] [LOCAL ] SPCE: Trimmed 72293 records to 49882 (keeping 200 days of data) [2025-09-29T21:13:29.148134] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-05. [2025-09-29T21:13:29.233054] [DEBUG] [LOCAL ] SPCE: Primary data saved (49882 records). [2025-09-29T21:13:29.233210] [INFO ] [MAIN ] SPCE: Full history saved. [2025-09-29T21:13:29.233311] [INFO ] [MAIN ] Update Progress: 1973/2371 symbols completed. SPCE took 45.5s. Estimated remaining: 51m 7s. Rate: 7.8 symbols/min [2025-09-29T21:13:29.407008] [INFO ] [MAIN ] SPHR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:13:29.451714] [DEBUG] [LOCAL ] SPHR: Loaded 40745 existing records from primary storage. [2025-09-29T21:13:29.452011] [INFO ] [MAIN ] SPHR: Loaded 40745 existing records. [2025-09-29T21:13:29.634732] [WARN ] [MAIN ] SPHR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:13:29.635018] [INFO ] [MAIN ] SPHR: Wiping existing primary data before full refresh. [2025-09-29T21:13:29.635075] [INFO ] [LOCAL ] SPHR: Starting deletion of primary data. [2025-09-29T21:13:29.635749] [DEBUG] [LOCAL ] SPHR: Deleted primary data file. [2025-09-29T21:13:29.635827] [INFO ] [MAIN ] SPHR: Starting full primary refresh. [2025-09-29T21:13:29.952921] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-04. [2025-09-29T21:13:30.031445] [INFO ] [REMOTE ] SPHR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:13:30.063074] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-29T21:13:30.748079] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-08. [2025-09-29T21:13:30.901947] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-29T21:13:31.013032] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-29T21:13:31.243340] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-29T21:13:31.548172] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2024-12. [2025-09-29T21:13:32.348151] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-06. [2025-09-29T21:13:32.955501] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-29T21:13:33.148146] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-05. [2025-09-29T21:13:33.776765] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-29T21:13:33.948118] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-01. [2025-09-29T21:13:34.217842] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-29T21:13:34.748118] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-07. [2025-09-29T21:13:35.548153] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-09. [2025-09-29T21:13:35.841927] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-29T21:13:36.348090] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-06. [2025-09-29T21:13:36.681556] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-29T21:13:37.148319] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-08. [2025-09-29T21:13:37.148241] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-29T21:13:37.160223] [INFO ] [REMOTE ] SPG: Full fetch complete (72021 records). [2025-09-29T21:13:37.160356] [DEBUG] [VALIDATOR ] SPG: Validating primary data. [2025-09-29T21:13:37.632854] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-29T21:13:37.637161] [DEBUG] [VALIDATOR ] SPG: All expected trading days are present. [2025-09-29T21:13:37.641947] [DEBUG] [VALIDATOR ] SPG: Primary data validation passed. [2025-09-29T21:13:37.643540] [INFO ] [MAIN ] SPG: Fetched primary data is valid. [2025-09-29T21:13:37.643995] [DEBUG] [LOCAL ] SPG: Saving primary data. [2025-09-29T21:13:37.645933] [DEBUG] [LOCAL ] SPG: Trimmed 72021 records to 50320 (keeping 200 days of data) [2025-09-29T21:13:37.950456] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-02. [2025-09-29T21:13:37.995152] [DEBUG] [LOCAL ] SPG: Primary data saved (50320 records). [2025-09-29T21:13:37.995302] [INFO ] [MAIN ] SPG: Full history saved. [2025-09-29T21:13:37.995452] [INFO ] [MAIN ] Update Progress: 1974/2371 symbols completed. SPG took 38.5s. Estimated remaining: 50m 60s. Rate: 7.8 symbols/min [2025-09-29T21:13:38.181274] [INFO ] [MAIN ] SPIR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:13:38.215472] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-29T21:13:38.260148] [DEBUG] [LOCAL ] SPIR: Loaded 37871 existing records from primary storage. [2025-09-29T21:13:38.260462] [INFO ] [MAIN ] SPIR: Loaded 37871 existing records. [2025-09-29T21:13:38.446048] [WARN ] [MAIN ] SPIR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:13:38.446280] [INFO ] [MAIN ] SPIR: Wiping existing primary data before full refresh. [2025-09-29T21:13:38.446330] [INFO ] [LOCAL ] SPIR: Starting deletion of primary data. [2025-09-29T21:13:38.446735] [DEBUG] [LOCAL ] SPIR: Deleted primary data file. [2025-09-29T21:13:38.446796] [INFO ] [MAIN ] SPIR: Starting full primary refresh. [2025-09-29T21:13:38.753365] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-07. [2025-09-29T21:13:38.850831] [INFO ] [REMOTE ] SPIR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:13:39.458017] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-29T21:13:39.476853] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-29T21:13:39.548114] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-08. [2025-09-29T21:13:40.348122] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-09. [2025-09-29T21:13:40.690337] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-29T21:13:41.148131] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-09. [2025-09-29T21:13:41.948124] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2024-12. [2025-09-29T21:13:42.001209] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-29T21:13:42.011088] [INFO ] [REMOTE ] SPGI: Full fetch complete (66704 records). [2025-09-29T21:13:42.011275] [DEBUG] [VALIDATOR ] SPGI: Validating primary data. [2025-09-29T21:13:42.322670] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-29T21:13:42.352745] [INFO ] [REMOTE ] SPH: Full fetch complete (28409 records). [2025-09-29T21:13:42.358672] [DEBUG] [VALIDATOR ] SPH: Validating primary data. [2025-09-29T21:13:42.577436] [DEBUG] [VALIDATOR ] SPGI: All expected trading days are present. [2025-09-29T21:13:42.587944] [DEBUG] [VALIDATOR ] SPGI: Primary data validation passed. [2025-09-29T21:13:42.615017] [INFO ] [MAIN ] SPGI: Fetched primary data is valid. [2025-09-29T21:13:42.646461] [DEBUG] [LOCAL ] SPGI: Saving primary data. [2025-09-29T21:13:42.748701] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-03. [2025-09-29T21:13:42.771512] [DEBUG] [LOCAL ] SPGI: Trimmed 66704 records to 45801 (keeping 200 days of data) [2025-09-29T21:13:42.968125] [DEBUG] [VALIDATOR ] SPH: All expected trading days are present. [2025-09-29T21:13:42.968889] [DEBUG] [VALIDATOR ] SPH: Primary data validation passed. [2025-09-29T21:13:42.969626] [INFO ] [MAIN ] SPH: Fetched primary data is valid. [2025-09-29T21:13:42.969996] [DEBUG] [LOCAL ] SPH: Saving primary data. [2025-09-29T21:13:42.972924] [DEBUG] [LOCAL ] SPH: Trimmed 28409 records to 17676 (keeping 200 days of data) [2025-09-29T21:13:43.221735] [DEBUG] [LOCAL ] SPH: Primary data saved (17676 records). [2025-09-29T21:13:43.222936] [INFO ] [MAIN ] SPH: Full history saved. [2025-09-29T21:13:43.223748] [INFO ] [MAIN ] Update Progress: 1975/2371 symbols completed. SPH took 23.2s. Estimated remaining: 50m 52s. Rate: 7.8 symbols/min [2025-09-29T21:13:43.363732] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-29T21:13:43.434327] [INFO ] [MAIN ] SPMC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:13:43.449259] [DEBUG] [LOCAL ] SPMC: Loaded 5613 existing records from primary storage. [2025-09-29T21:13:43.450390] [INFO ] [MAIN ] SPMC: Loaded 5613 existing records. [2025-09-29T21:13:43.556542] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-01. [2025-09-29T21:13:43.651577] [WARN ] [MAIN ] SPMC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:13:43.652327] [INFO ] [MAIN ] SPMC: Wiping existing primary data before full refresh. [2025-09-29T21:13:43.652880] [INFO ] [LOCAL ] SPMC: Starting deletion of primary data. [2025-09-29T21:13:43.654054] [DEBUG] [LOCAL ] SPMC: Deleted primary data file. [2025-09-29T21:13:43.654328] [INFO ] [MAIN ] SPMC: Starting full primary refresh. [2025-09-29T21:13:44.023066] [DEBUG] [LOCAL ] SPGI: Primary data saved (45801 records). [2025-09-29T21:13:44.043047] [INFO ] [MAIN ] SPGI: Full history saved. [2025-09-29T21:13:44.057524] [INFO ] [MAIN ] Update Progress: 1976/2371 symbols completed. SPGI took 34.3s. Estimated remaining: 50m 43s. Rate: 7.8 symbols/min [2025-09-29T21:13:44.125518] [INFO ] [REMOTE ] SPMC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:13:44.263944] [INFO ] [MAIN ] SPME: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:13:44.264109] [DEBUG] [LOCAL ] SPME: No existing data file found in primary storage. [2025-09-29T21:13:44.264149] [WARN ] [MAIN ] SPME: No existing data found, performing full refresh instead. [2025-09-29T21:13:44.264246] [INFO ] [MAIN ] SPME: Wiping existing primary data before full refresh. [2025-09-29T21:13:44.264291] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-09-29T21:13:44.264333] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-09-29T21:13:44.264384] [INFO ] [MAIN ] SPME: Starting full primary refresh. [2025-09-29T21:13:44.349718] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2024-12. [2025-09-29T21:13:44.685773] [INFO ] [REMOTE ] SPME: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:13:44.688206] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-29T21:13:45.148120] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-04. [2025-09-29T21:13:45.190824] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-29T21:13:45.244616] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-29T21:13:45.948123] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-02. [2025-09-29T21:13:46.748104] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-01. [2025-09-29T21:13:46.832057] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-29T21:13:47.548095] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-05. [2025-09-29T21:13:47.620631] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-29T21:13:48.348128] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-03. [2025-09-29T21:13:48.775895] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-29T21:13:49.153262] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-02. [2025-09-29T21:13:49.171640] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-29T21:13:49.907903] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-29T21:13:49.948112] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-06. [2025-09-29T21:13:50.123373] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-29T21:13:50.748128] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-04. [2025-09-29T21:13:51.430130] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-29T21:13:51.548178] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-03. [2025-09-29T21:13:52.096359] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-29T21:13:52.348377] [INFO ] [REMOTE ] SPME: Fetching primary data for 2024-12. [2025-09-29T21:13:52.348248] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-29T21:13:52.544752] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T21:13:52.545084] [WARN ] [REMOTE ] SPME: No data returned for month 2024-12 [2025-09-29T21:13:52.545180] [FATAL] [REMOTE ] SPME: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T21:13:52.545228] [FATAL] [MAIN ] SPME: Failed to fetch primary data. [2025-09-29T21:13:52.545265] [WARN ] [MAIN ] SPME: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T21:13:52.545304] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-09-29T21:13:52.545406] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-09-29T21:13:52.545469] [INFO ] [LOCAL ] SPME: Starting deletion of derivative data. [2025-09-29T21:13:52.545550] [DEBUG] [LOCAL ] SPME: No derivative data file found to delete. [2025-09-29T21:13:52.545621] [INFO ] [MAIN ] Update Progress: 1977/2371 symbols completed. SPME took 8.5s. Estimated remaining: 50m 35s. Rate: 7.8 symbols/min [2025-09-29T21:13:52.723070] [INFO ] [MAIN ] SPNT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:13:52.760918] [DEBUG] [LOCAL ] SPNT: Loaded 35342 existing records from primary storage. [2025-09-29T21:13:52.761240] [INFO ] [MAIN ] SPNT: Loaded 35342 existing records. [2025-09-29T21:13:52.961093] [WARN ] [MAIN ] SPNT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:13:52.961390] [INFO ] [MAIN ] SPNT: Wiping existing primary data before full refresh. [2025-09-29T21:13:52.961447] [INFO ] [LOCAL ] SPNT: Starting deletion of primary data. [2025-09-29T21:13:52.961749] [DEBUG] [LOCAL ] SPNT: Deleted primary data file. [2025-09-29T21:13:52.961809] [INFO ] [MAIN ] SPNT: Starting full primary refresh. [2025-09-29T21:13:53.153384] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-05. [2025-09-29T21:13:53.371796] [INFO ] [REMOTE ] SPNT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:13:53.948124] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-07. [2025-09-29T21:13:54.717589] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-29T21:13:54.748091] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-04. [2025-09-29T21:13:55.275148] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-29T21:13:55.548125] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-08. [2025-09-29T21:13:55.555077] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-29T21:13:56.348103] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-05. [2025-09-29T21:13:57.036282] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-29T21:13:57.111854] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-29T21:13:57.148108] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-06. [2025-09-29T21:13:57.948115] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-09. [2025-09-29T21:13:58.719957] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-29T21:13:58.748071] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-07. [2025-09-29T21:13:59.548085] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-06. [2025-09-29T21:13:59.673057] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-29T21:13:59.683306] [INFO ] [REMOTE ] SPHR: Full fetch complete (57658 records). [2025-09-29T21:13:59.683486] [DEBUG] [VALIDATOR ] SPHR: Validating primary data. [2025-09-29T21:14:00.116787] [DEBUG] [VALIDATOR ] SPHR: All expected trading days are present. [2025-09-29T21:14:00.116920] [DEBUG] [VALIDATOR ] SPHR: Primary data validation passed. [2025-09-29T21:14:00.118230] [INFO ] [MAIN ] SPHR: Fetched primary data is valid. [2025-09-29T21:14:00.118327] [DEBUG] [LOCAL ] SPHR: Saving primary data. [2025-09-29T21:14:00.119837] [DEBUG] [LOCAL ] SPHR: Trimmed 57658 records to 40022 (keeping 200 days of data) [2025-09-29T21:14:00.233101] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-29T21:14:00.364076] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2024-12. [2025-09-29T21:14:00.373946] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-29T21:14:00.418349] [DEBUG] [LOCAL ] SPHR: Primary data saved (40022 records). [2025-09-29T21:14:00.418481] [INFO ] [MAIN ] SPHR: Full history saved. [2025-09-29T21:14:00.418580] [INFO ] [MAIN ] Update Progress: 1978/2371 symbols completed. SPHR took 31.2s. Estimated remaining: 50m 27s. Rate: 7.8 symbols/min [2025-09-29T21:14:00.612979] [INFO ] [MAIN ] SPOT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:14:00.670924] [DEBUG] [LOCAL ] SPOT: Loaded 51481 existing records from primary storage. [2025-09-29T21:14:00.671257] [INFO ] [MAIN ] SPOT: Loaded 51481 existing records. [2025-09-29T21:14:00.859765] [WARN ] [MAIN ] SPOT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:14:00.860127] [INFO ] [MAIN ] SPOT: Wiping existing primary data before full refresh. [2025-09-29T21:14:00.860185] [INFO ] [LOCAL ] SPOT: Starting deletion of primary data. [2025-09-29T21:14:00.860561] [DEBUG] [LOCAL ] SPOT: Deleted primary data file. [2025-09-29T21:14:00.860701] [INFO ] [MAIN ] SPOT: Starting full primary refresh. [2025-09-29T21:14:01.148976] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-07. [2025-09-29T21:14:01.233096] [INFO ] [REMOTE ] SPOT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:14:01.696265] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-29T21:14:01.789468] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-29T21:14:01.948112] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-08. [2025-09-29T21:14:02.552976] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-29T21:14:02.748110] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-08. [2025-09-29T21:14:03.548111] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-01. [2025-09-29T21:14:04.348084] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-09. [2025-09-29T21:14:04.447918] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-29T21:14:04.732799] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-29T21:14:04.790865] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-29T21:14:04.792429] [INFO ] [REMOTE ] SPMC: Full fetch complete (8159 records). [2025-09-29T21:14:04.792503] [DEBUG] [VALIDATOR ] SPMC: Validating primary data. [2025-09-29T21:14:05.155043] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-09. [2025-09-29T21:14:05.182104] [DEBUG] [VALIDATOR ] SPMC: All expected trading days are present. [2025-09-29T21:14:05.182169] [DEBUG] [VALIDATOR ] SPMC: Primary data validation passed. [2025-09-29T21:14:05.182402] [INFO ] [MAIN ] SPMC: Fetched primary data is valid. [2025-09-29T21:14:05.182455] [DEBUG] [LOCAL ] SPMC: Saving primary data. [2025-09-29T21:14:05.183154] [DEBUG] [LOCAL ] SPMC: Trimmed 8159 records to 5454 (keeping 200 days of data) [2025-09-29T21:14:05.219133] [DEBUG] [LOCAL ] SPMC: Primary data saved (5454 records). [2025-09-29T21:14:05.219258] [INFO ] [MAIN ] SPMC: Full history saved. [2025-09-29T21:14:05.219347] [INFO ] [MAIN ] Update Progress: 1979/2371 symbols completed. SPMC took 22.0s. Estimated remaining: 50m 19s. Rate: 7.8 symbols/min [2025-09-29T21:14:05.413232] [INFO ] [MAIN ] SPR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:14:05.460132] [DEBUG] [LOCAL ] SPR: Loaded 41867 existing records from primary storage. [2025-09-29T21:14:05.460461] [INFO ] [MAIN ] SPR: Loaded 41867 existing records. [2025-09-29T21:14:05.653242] [WARN ] [MAIN ] SPR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:14:05.653474] [INFO ] [MAIN ] SPR: Wiping existing primary data before full refresh. [2025-09-29T21:14:05.653543] [INFO ] [LOCAL ] SPR: Starting deletion of primary data. [2025-09-29T21:14:05.653821] [DEBUG] [LOCAL ] SPR: Deleted primary data file. [2025-09-29T21:14:05.653884] [INFO ] [MAIN ] SPR: Starting full primary refresh. [2025-09-29T21:14:05.953296] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2024-12. [2025-09-29T21:14:06.033028] [INFO ] [REMOTE ] SPR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:14:06.748098] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-02. [2025-09-29T21:14:06.805687] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-29T21:14:06.813399] [INFO ] [REMOTE ] SPIR: Full fetch complete (52478 records). [2025-09-29T21:14:06.813588] [DEBUG] [VALIDATOR ] SPIR: Validating primary data. [2025-09-29T21:14:07.224735] [DEBUG] [VALIDATOR ] SPIR: All expected trading days are present. [2025-09-29T21:14:07.224859] [DEBUG] [VALIDATOR ] SPIR: Primary data validation passed. [2025-09-29T21:14:07.225896] [INFO ] [MAIN ] SPIR: Fetched primary data is valid. [2025-09-29T21:14:07.225963] [DEBUG] [LOCAL ] SPIR: Saving primary data. [2025-09-29T21:14:07.227249] [DEBUG] [LOCAL ] SPIR: Trimmed 52478 records to 37260 (keeping 200 days of data) [2025-09-29T21:14:07.446284] [DEBUG] [LOCAL ] SPIR: Primary data saved (37260 records). [2025-09-29T21:14:07.446436] [INFO ] [MAIN ] SPIR: Full history saved. [2025-09-29T21:14:07.446523] [INFO ] [MAIN ] Update Progress: 1980/2371 symbols completed. SPIR took 29.5s. Estimated remaining: 50m 10s. Rate: 7.8 symbols/min [2025-09-29T21:14:07.553238] [INFO ] [REMOTE ] SPR: Fetching primary data for 2024-12. [2025-09-29T21:14:07.631235] [INFO ] [MAIN ] SPRU: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:14:07.641687] [DEBUG] [LOCAL ] SPRU: Loaded 8714 existing records from primary storage. [2025-09-29T21:14:07.641927] [INFO ] [MAIN ] SPRU: Loaded 8714 existing records. [2025-09-29T21:14:07.832684] [WARN ] [MAIN ] SPRU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:14:07.832966] [INFO ] [MAIN ] SPRU: Wiping existing primary data before full refresh. [2025-09-29T21:14:07.833051] [INFO ] [LOCAL ] SPRU: Starting deletion of primary data. [2025-09-29T21:14:07.833266] [DEBUG] [LOCAL ] SPRU: Deleted primary data file. [2025-09-29T21:14:07.833324] [INFO ] [MAIN ] SPRU: Starting full primary refresh. [2025-09-29T21:14:08.251411] [INFO ] [REMOTE ] SPRU: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:14:08.271509] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-29T21:14:08.326749] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-09-29T21:14:08.348063] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-01. [2025-09-29T21:14:09.148095] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2024-12. [2025-09-29T21:14:09.248747] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-29T21:14:09.764067] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-29T21:14:09.948097] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-01. [2025-09-29T21:14:10.378290] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-29T21:14:10.455771] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-29T21:14:10.748143] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-02. [2025-09-29T21:14:11.439896] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-29T21:14:11.548147] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-02. [2025-09-29T21:14:12.348180] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-03. [2025-09-29T21:14:13.148120] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-01. [2025-09-29T21:14:13.473983] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-29T21:14:13.795302] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-29T21:14:13.948158] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-04. [2025-09-29T21:14:14.755511] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-03. [2025-09-29T21:14:14.772848] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-29T21:14:15.345828] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-29T21:14:15.548116] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-02. [2025-09-29T21:14:16.348124] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-05. [2025-09-29T21:14:16.889412] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-29T21:14:17.148091] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-03. [2025-09-29T21:14:17.182837] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-09-29T21:14:17.862526] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-29T21:14:17.948125] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-03. [2025-09-29T21:14:18.678737] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-29T21:14:18.748190] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-04. [2025-09-29T21:14:18.834042] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-29T21:14:19.548158] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-04. [2025-09-29T21:14:20.348116] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-04. [2025-09-29T21:14:21.148150] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-06. [2025-09-29T21:14:21.207448] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-29T21:14:21.295192] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-29T21:14:21.337881] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-09-29T21:14:21.948163] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-05. [2025-09-29T21:14:22.523336] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-29T21:14:22.748133] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-07. [2025-09-29T21:14:23.548161] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-05. [2025-09-29T21:14:24.349312] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-05. [2025-09-29T21:14:24.357685] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-09-29T21:14:24.402822] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-29T21:14:24.421549] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-29T21:14:25.148170] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-08. [2025-09-29T21:14:25.948187] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-06. [2025-09-29T21:14:26.036297] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-29T21:14:26.369783] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-29T21:14:26.625629] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-29T21:14:26.748105] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-09. [2025-09-29T21:14:27.548131] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-06. [2025-09-29T21:14:28.189382] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-29T21:14:28.197482] [INFO ] [REMOTE ] SPNT: Full fetch complete (48955 records). [2025-09-29T21:14:28.197702] [DEBUG] [VALIDATOR ] SPNT: Validating primary data. [2025-09-29T21:14:28.353272] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-06. [2025-09-29T21:14:28.614456] [DEBUG] [VALIDATOR ] SPNT: All expected trading days are present. [2025-09-29T21:14:28.614571] [DEBUG] [VALIDATOR ] SPNT: Primary data validation passed. [2025-09-29T21:14:28.615610] [INFO ] [MAIN ] SPNT: Fetched primary data is valid. [2025-09-29T21:14:28.615703] [DEBUG] [LOCAL ] SPNT: Saving primary data. [2025-09-29T21:14:28.616865] [DEBUG] [LOCAL ] SPNT: Trimmed 48955 records to 34745 (keeping 200 days of data) [2025-09-29T21:14:28.828608] [DEBUG] [LOCAL ] SPNT: Primary data saved (34745 records). [2025-09-29T21:14:28.828775] [INFO ] [MAIN ] SPNT: Full history saved. [2025-09-29T21:14:28.828881] [INFO ] [MAIN ] Update Progress: 1981/2371 symbols completed. SPNT took 36.3s. Estimated remaining: 50m 5s. Rate: 7.8 symbols/min [2025-09-29T21:14:29.024780] [INFO ] [MAIN ] SPXC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:14:29.053532] [DEBUG] [LOCAL ] SPXC: Loaded 23666 existing records from primary storage. [2025-09-29T21:14:29.053893] [INFO ] [MAIN ] SPXC: Loaded 23666 existing records. [2025-09-29T21:14:29.157744] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-07. [2025-09-29T21:14:29.260937] [WARN ] [MAIN ] SPXC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:14:29.283172] [INFO ] [MAIN ] SPXC: Wiping existing primary data before full refresh. [2025-09-29T21:14:29.283358] [INFO ] [LOCAL ] SPXC: Starting deletion of primary data. [2025-09-29T21:14:29.284072] [DEBUG] [LOCAL ] SPXC: Deleted primary data file. [2025-09-29T21:14:29.284146] [INFO ] [MAIN ] SPXC: Starting full primary refresh. [2025-09-29T21:14:29.290411] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-29T21:14:29.680914] [INFO ] [REMOTE ] SPXC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:14:29.948092] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-07. [2025-09-29T21:14:30.016840] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-29T21:14:30.595362] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-29T21:14:30.748100] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-07. [2025-09-29T21:14:31.376411] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-29T21:14:31.548148] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-08. [2025-09-29T21:14:32.348128] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2024-12. [2025-09-29T21:14:33.147496] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-29T21:14:33.155236] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-08. [2025-09-29T21:14:33.344072] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-09-29T21:14:33.570216] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-29T21:14:33.948089] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-08. [2025-09-29T21:14:34.299411] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-29T21:14:34.748173] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-09. [2025-09-29T21:14:35.548100] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-01. [2025-09-29T21:14:35.627883] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-29T21:14:35.630613] [INFO ] [REMOTE ] SPRU: Full fetch complete (11403 records). [2025-09-29T21:14:35.630743] [DEBUG] [VALIDATOR ] SPRU: Validating primary data. [2025-09-29T21:14:36.034011] [DEBUG] [VALIDATOR ] SPRU: All expected trading days are present. [2025-09-29T21:14:36.034141] [DEBUG] [VALIDATOR ] SPRU: Primary data validation passed. [2025-09-29T21:14:36.034462] [INFO ] [MAIN ] SPRU: Fetched primary data is valid. [2025-09-29T21:14:36.034510] [DEBUG] [LOCAL ] SPRU: Saving primary data. [2025-09-29T21:14:36.035053] [DEBUG] [LOCAL ] SPRU: Trimmed 11403 records to 8757 (keeping 200 days of data) [2025-09-29T21:14:36.085490] [DEBUG] [LOCAL ] SPRU: Primary data saved (8757 records). [2025-09-29T21:14:36.085638] [INFO ] [MAIN ] SPRU: Full history saved. [2025-09-29T21:14:36.085770] [INFO ] [MAIN ] Update Progress: 1982/2371 symbols completed. SPRU took 28.6s. Estimated remaining: 49m 58s. Rate: 7.8 symbols/min [2025-09-29T21:14:36.279638] [INFO ] [MAIN ] SPXX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:14:36.295081] [DEBUG] [LOCAL ] SPXX: Loaded 9166 existing records from primary storage. [2025-09-29T21:14:36.295385] [INFO ] [MAIN ] SPXX: Loaded 9166 existing records. [2025-09-29T21:14:36.353969] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-09. [2025-09-29T21:14:36.493262] [WARN ] [MAIN ] SPXX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:14:36.505613] [INFO ] [MAIN ] SPXX: Wiping existing primary data before full refresh. [2025-09-29T21:14:36.523616] [INFO ] [LOCAL ] SPXX: Starting deletion of primary data. [2025-09-29T21:14:36.525809] [DEBUG] [LOCAL ] SPXX: Deleted primary data file. [2025-09-29T21:14:36.525730] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-08 (2.58 seconds). [2025-09-29T21:14:36.526059] [INFO ] [MAIN ] SPXX: Starting full primary refresh. [2025-09-29T21:14:36.952045] [INFO ] [REMOTE ] SPXX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:14:36.954161] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-29T21:14:37.148117] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2024-12. [2025-09-29T21:14:37.896036] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-29T21:14:37.927188] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-29T21:14:37.937981] [INFO ] [REMOTE ] SPR: Full fetch complete (60044 records). [2025-09-29T21:14:37.938183] [DEBUG] [VALIDATOR ] SPR: Validating primary data. [2025-09-29T21:14:37.953278] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-09. [2025-09-29T21:14:38.348116] [DEBUG] [VALIDATOR ] SPR: All expected trading days are present. [2025-09-29T21:14:38.348199] [DEBUG] [VALIDATOR ] SPR: Primary data validation passed. [2025-09-29T21:14:38.349206] [INFO ] [MAIN ] SPR: Fetched primary data is valid. [2025-09-29T21:14:38.349271] [DEBUG] [LOCAL ] SPR: Saving primary data. [2025-09-29T21:14:38.350845] [DEBUG] [LOCAL ] SPR: Trimmed 60044 records to 41141 (keeping 200 days of data) [2025-09-29T21:14:38.614450] [DEBUG] [LOCAL ] SPR: Primary data saved (41141 records). [2025-09-29T21:14:38.614727] [INFO ] [MAIN ] SPR: Full history saved. [2025-09-29T21:14:38.614886] [INFO ] [MAIN ] Update Progress: 1983/2371 symbols completed. SPR took 33.4s. Estimated remaining: 49m 49s. Rate: 7.8 symbols/min [2025-09-29T21:14:38.749233] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-01. [2025-09-29T21:14:38.797159] [INFO ] [MAIN ] SQM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:14:38.855894] [DEBUG] [LOCAL ] SQM: Loaded 49278 existing records from primary storage. [2025-09-29T21:14:38.856468] [INFO ] [MAIN ] SQM: Loaded 49278 existing records. [2025-09-29T21:14:38.996979] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-29T21:14:39.065139] [INFO ] [REMOTE ] SPOT: Full fetch complete (73492 records). [2025-09-29T21:14:39.082387] [DEBUG] [VALIDATOR ] SPOT: Validating primary data. [2025-09-29T21:14:39.088978] [WARN ] [MAIN ] SQM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:14:39.089258] [INFO ] [MAIN ] SQM: Wiping existing primary data before full refresh. [2025-09-29T21:14:39.089452] [INFO ] [LOCAL ] SQM: Starting deletion of primary data. [2025-09-29T21:14:39.090140] [DEBUG] [LOCAL ] SQM: Deleted primary data file. [2025-09-29T21:14:39.090496] [INFO ] [MAIN ] SQM: Starting full primary refresh. [2025-09-29T21:14:39.090421] [FATAL] [VALIDATOR ] SPOT: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T21:14:39.134838] [FATAL] [MAIN ] SPOT: Fetched primary data is invalid. Refusing to save it. [2025-09-29T21:14:39.157003] [WARN ] [MAIN ] SPOT: Deleting existing primary and derivative data due to validation failure. [2025-09-29T21:14:39.169730] [INFO ] [LOCAL ] SPOT: Starting deletion of primary data. [2025-09-29T21:14:39.186365] [DEBUG] [LOCAL ] SPOT: No primary data file found to delete. [2025-09-29T21:14:39.196837] [INFO ] [LOCAL ] SPOT: Starting deletion of derivative data. [2025-09-29T21:14:39.203059] [DEBUG] [LOCAL ] SPOT: Deleted derivative data file. [2025-09-29T21:14:39.223623] [INFO ] [MAIN ] Update Progress: 1984/2371 symbols completed. SPOT took 38.8s. Estimated remaining: 49m 40s. Rate: 7.8 symbols/min [2025-09-29T21:14:39.570202] [INFO ] [MAIN ] SQNS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:14:39.563394] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-02. [2025-09-29T21:14:39.631180] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-29T21:14:39.663710] [INFO ] [REMOTE ] SQM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:14:39.686885] [DEBUG] [LOCAL ] SQNS: Loaded 26307 existing records from primary storage. [2025-09-29T21:14:39.687284] [INFO ] [MAIN ] SQNS: Loaded 26307 existing records. [2025-09-29T21:14:39.872831] [WARN ] [MAIN ] SQNS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:14:39.873054] [INFO ] [MAIN ] SQNS: Wiping existing primary data before full refresh. [2025-09-29T21:14:39.873105] [INFO ] [LOCAL ] SQNS: Starting deletion of primary data. [2025-09-29T21:14:39.873366] [DEBUG] [LOCAL ] SQNS: Deleted primary data file. [2025-09-29T21:14:39.873426] [INFO ] [MAIN ] SQNS: Starting full primary refresh. [2025-09-29T21:14:40.240781] [INFO ] [REMOTE ] SQNS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:14:40.348124] [INFO ] [REMOTE ] SQM: Fetching primary data for 2024-12. [2025-09-29T21:14:40.835068] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-29T21:14:41.148153] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-02. [2025-09-29T21:14:41.948093] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2024-12. [2025-09-29T21:14:42.104962] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-29T21:14:42.141469] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-29T21:14:42.748093] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-01. [2025-09-29T21:14:42.997626] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-29T21:14:43.548191] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-03. [2025-09-29T21:14:44.070691] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-29T21:14:44.348164] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-03. [2025-09-29T21:14:44.471099] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-29T21:14:45.148172] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-01. [2025-09-29T21:14:45.635956] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-29T21:14:45.948117] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-02. [2025-09-29T21:14:46.215677] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-29T21:14:46.748113] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-04. [2025-09-29T21:14:47.548093] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-04. [2025-09-29T21:14:47.716284] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-29T21:14:48.142234] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-29T21:14:48.301169] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-29T21:14:48.348097] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-05. [2025-09-29T21:14:49.142964] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-29T21:14:49.148052] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-06. [2025-09-29T21:14:49.944532] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-29T21:14:49.948063] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-07. [2025-09-29T21:14:50.748092] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-03. [2025-09-29T21:14:50.875035] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-29T21:14:51.548144] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-08. [2025-09-29T21:14:52.326761] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-29T21:14:52.348084] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-09. [2025-09-29T21:14:52.484608] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-29T21:14:53.148088] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-05. [2025-09-29T21:14:53.193366] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-29T21:14:53.196307] [INFO ] [REMOTE ] SPXX: Full fetch complete (12663 records). [2025-09-29T21:14:53.196383] [DEBUG] [VALIDATOR ] SPXX: Validating primary data. [2025-09-29T21:14:53.573035] [DEBUG] [VALIDATOR ] SPXX: All expected trading days are present. [2025-09-29T21:14:53.573122] [DEBUG] [VALIDATOR ] SPXX: Primary data validation passed. [2025-09-29T21:14:53.573460] [INFO ] [MAIN ] SPXX: Fetched primary data is valid. [2025-09-29T21:14:53.573500] [DEBUG] [LOCAL ] SPXX: Saving primary data. [2025-09-29T21:14:53.574021] [DEBUG] [LOCAL ] SPXX: Trimmed 12663 records to 9028 (keeping 200 days of data) [2025-09-29T21:14:53.633253] [DEBUG] [LOCAL ] SPXX: Primary data saved (9028 records). [2025-09-29T21:14:53.633379] [INFO ] [MAIN ] SPXX: Full history saved. [2025-09-29T21:14:53.633516] [INFO ] [MAIN ] Update Progress: 1985/2371 symbols completed. SPXX took 17.5s. Estimated remaining: 49m 33s. Rate: 7.8 symbols/min [2025-09-29T21:14:53.810942] [INFO ] [MAIN ] SR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:14:53.846039] [DEBUG] [LOCAL ] SR: Loaded 33411 existing records from primary storage. [2025-09-29T21:14:53.846346] [INFO ] [MAIN ] SR: Loaded 33411 existing records. [2025-09-29T21:14:53.952271] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-04. [2025-09-29T21:14:54.046618] [WARN ] [MAIN ] SR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:14:54.046876] [INFO ] [MAIN ] SR: Wiping existing primary data before full refresh. [2025-09-29T21:14:54.046927] [INFO ] [LOCAL ] SR: Starting deletion of primary data. [2025-09-29T21:14:54.047327] [DEBUG] [LOCAL ] SR: Deleted primary data file. [2025-09-29T21:14:54.047427] [INFO ] [MAIN ] SR: Starting full primary refresh. [2025-09-29T21:14:54.438425] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-29T21:14:54.444288] [INFO ] [REMOTE ] SR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:14:54.748114] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-06. [2025-09-29T21:14:55.548109] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-02. [2025-09-29T21:14:55.768111] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-29T21:14:56.140160] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-29T21:14:56.348115] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-05. [2025-09-29T21:14:56.363707] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-29T21:14:57.148121] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-07. [2025-09-29T21:14:57.948131] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-03. [2025-09-29T21:14:58.094172] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-29T21:14:58.244799] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-29T21:14:58.570335] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-29T21:14:58.748116] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-06. [2025-09-29T21:14:59.548129] [INFO ] [REMOTE ] SR: Fetching primary data for 2024-12. [2025-09-29T21:15:00.348131] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-08. [2025-09-29T21:15:00.469349] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-29T21:15:00.790828] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-29T21:15:01.148147] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-04. [2025-09-29T21:15:01.508361] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-29T21:15:01.948137] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-01. [2025-09-29T21:15:01.996432] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-29T21:15:02.748110] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-05. [2025-09-29T21:15:03.255915] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-29T21:15:03.548136] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-09. [2025-09-29T21:15:03.635627] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-29T21:15:04.348110] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-06. [2025-09-29T21:15:04.857213] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-29T21:15:04.864697] [INFO ] [REMOTE ] SPXC: Full fetch complete (33925 records). [2025-09-29T21:15:04.864903] [DEBUG] [VALIDATOR ] SPXC: Validating primary data. [2025-09-29T21:15:05.154863] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-02. [2025-09-29T21:15:05.292605] [DEBUG] [VALIDATOR ] SPXC: All expected trading days are present. [2025-09-29T21:15:05.292837] [DEBUG] [VALIDATOR ] SPXC: Primary data validation passed. [2025-09-29T21:15:05.293790] [INFO ] [MAIN ] SPXC: Fetched primary data is valid. [2025-09-29T21:15:05.293941] [DEBUG] [LOCAL ] SPXC: Saving primary data. [2025-09-29T21:15:05.295021] [DEBUG] [LOCAL ] SPXC: Trimmed 33925 records to 23250 (keeping 200 days of data) [2025-09-29T21:15:05.393475] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-29T21:15:05.457789] [DEBUG] [LOCAL ] SPXC: Primary data saved (23250 records). [2025-09-29T21:15:05.457947] [INFO ] [MAIN ] SPXC: Full history saved. [2025-09-29T21:15:05.458038] [INFO ] [MAIN ] Update Progress: 1986/2371 symbols completed. SPXC took 36.6s. Estimated remaining: 49m 27s. Rate: 7.8 symbols/min [2025-09-29T21:15:05.637204] [INFO ] [MAIN ] SRE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:15:05.700042] [DEBUG] [LOCAL ] SRE: Loaded 54202 existing records from primary storage. [2025-09-29T21:15:05.700384] [INFO ] [MAIN ] SRE: Loaded 54202 existing records. [2025-09-29T21:15:05.883362] [WARN ] [MAIN ] SRE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:15:05.883609] [INFO ] [MAIN ] SRE: Wiping existing primary data before full refresh. [2025-09-29T21:15:05.883691] [INFO ] [LOCAL ] SRE: Starting deletion of primary data. [2025-09-29T21:15:05.884158] [DEBUG] [LOCAL ] SRE: Deleted primary data file. [2025-09-29T21:15:05.884220] [INFO ] [MAIN ] SRE: Starting full primary refresh. [2025-09-29T21:15:05.953317] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-07. [2025-09-29T21:15:06.264637] [INFO ] [REMOTE ] SRE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:15:06.725069] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-29T21:15:06.748093] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-03. [2025-09-29T21:15:07.548214] [INFO ] [REMOTE ] SRE: Fetching primary data for 2024-12. [2025-09-29T21:15:07.935719] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-29T21:15:08.221601] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-29T21:15:08.348154] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-04. [2025-09-29T21:15:09.148154] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-08. [2025-09-29T21:15:09.242789] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-29T21:15:09.871222] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-29T21:15:09.948175] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-01. [2025-09-29T21:15:10.748149] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-05. [2025-09-29T21:15:11.152668] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-29T21:15:11.548162] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-09. [2025-09-29T21:15:11.847205] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-29T21:15:11.942869] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-29T21:15:12.348161] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-06. [2025-09-29T21:15:12.881954] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-29T21:15:12.890370] [INFO ] [REMOTE ] SQNS: Full fetch complete (31920 records). [2025-09-29T21:15:12.890530] [DEBUG] [VALIDATOR ] SQNS: Validating primary data. [2025-09-29T21:15:13.158297] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-07. [2025-09-29T21:15:13.309435] [DEBUG] [VALIDATOR ] SQNS: All expected trading days are present. [2025-09-29T21:15:13.309539] [DEBUG] [VALIDATOR ] SQNS: Primary data validation passed. [2025-09-29T21:15:13.310269] [INFO ] [MAIN ] SQNS: Fetched primary data is valid. [2025-09-29T21:15:13.310336] [DEBUG] [LOCAL ] SQNS: Saving primary data. [2025-09-29T21:15:13.311364] [DEBUG] [LOCAL ] SQNS: Trimmed 31920 records to 26214 (keeping 200 days of data) [2025-09-29T21:15:13.444776] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-29T21:15:13.501310] [DEBUG] [LOCAL ] SQNS: Primary data saved (26214 records). [2025-09-29T21:15:13.501479] [INFO ] [MAIN ] SQNS: Full history saved. [2025-09-29T21:15:13.501603] [INFO ] [MAIN ] Update Progress: 1987/2371 symbols completed. SQNS took 34.3s. Estimated remaining: 49m 19s. Rate: 7.8 symbols/min [2025-09-29T21:15:13.674086] [INFO ] [MAIN ] SREA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:15:13.688451] [DEBUG] [LOCAL ] SREA: Loaded 10561 existing records from primary storage. [2025-09-29T21:15:13.688763] [INFO ] [MAIN ] SREA: Loaded 10561 existing records. [2025-09-29T21:15:13.872700] [WARN ] [MAIN ] SREA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:15:13.872943] [INFO ] [MAIN ] SREA: Wiping existing primary data before full refresh. [2025-09-29T21:15:13.872989] [INFO ] [LOCAL ] SREA: Starting deletion of primary data. [2025-09-29T21:15:13.873251] [DEBUG] [LOCAL ] SREA: Deleted primary data file. [2025-09-29T21:15:13.873309] [INFO ] [MAIN ] SREA: Starting full primary refresh. [2025-09-29T21:15:13.953491] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-02. [2025-09-29T21:15:14.239578] [INFO ] [REMOTE ] SREA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:15:14.748173] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-07. [2025-09-29T21:15:15.147154] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-29T21:15:15.548121] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-08. [2025-09-29T21:15:15.590985] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-29T21:15:16.026018] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-29T21:15:16.348157] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-08. [2025-09-29T21:15:17.148173] [INFO ] [REMOTE ] SREA: Fetching primary data for 2024-12. [2025-09-29T21:15:17.478878] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-29T21:15:17.905604] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-29T21:15:17.948126] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-09. [2025-09-29T21:15:18.068300] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-29T21:15:18.748229] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-03. [2025-09-29T21:15:19.289021] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-29T21:15:19.298340] [INFO ] [REMOTE ] SR: Full fetch complete (46121 records). [2025-09-29T21:15:19.298700] [DEBUG] [VALIDATOR ] SR: Validating primary data. [2025-09-29T21:15:19.554272] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-09. [2025-09-29T21:15:19.703699] [DEBUG] [VALIDATOR ] SR: All expected trading days are present. [2025-09-29T21:15:19.703931] [DEBUG] [VALIDATOR ] SR: Primary data validation passed. [2025-09-29T21:15:19.705271] [INFO ] [MAIN ] SR: Fetched primary data is valid. [2025-09-29T21:15:19.705355] [DEBUG] [LOCAL ] SR: Saving primary data. [2025-09-29T21:15:19.707214] [DEBUG] [LOCAL ] SR: Trimmed 46121 records to 32873 (keeping 200 days of data) [2025-09-29T21:15:19.932434] [DEBUG] [LOCAL ] SR: Primary data saved (32873 records). [2025-09-29T21:15:19.932617] [INFO ] [MAIN ] SR: Full history saved. [2025-09-29T21:15:19.932751] [INFO ] [MAIN ] Update Progress: 1988/2371 symbols completed. SR took 26.3s. Estimated remaining: 49m 11s. Rate: 7.8 symbols/min [2025-09-29T21:15:20.117268] [INFO ] [MAIN ] SRFM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:15:20.154988] [DEBUG] [LOCAL ] SRFM: Loaded 36431 existing records from primary storage. [2025-09-29T21:15:20.155344] [INFO ] [MAIN ] SRFM: Loaded 36431 existing records. [2025-09-29T21:15:20.350629] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-01. [2025-09-29T21:15:20.378832] [WARN ] [MAIN ] SRFM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:15:20.380425] [INFO ] [MAIN ] SRFM: Wiping existing primary data before full refresh. [2025-09-29T21:15:20.380528] [INFO ] [LOCAL ] SRFM: Starting deletion of primary data. [2025-09-29T21:15:20.381094] [DEBUG] [LOCAL ] SRFM: Deleted primary data file. [2025-09-29T21:15:20.381159] [INFO ] [MAIN ] SRFM: Starting full primary refresh. [2025-09-29T21:15:20.790107] [INFO ] [REMOTE ] SRFM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:15:20.826401] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-29T21:15:21.148104] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-04. [2025-09-29T21:15:21.380710] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-29T21:15:21.413844] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-29T21:15:21.424878] [INFO ] [REMOTE ] SQM: Full fetch complete (68915 records). [2025-09-29T21:15:21.425085] [DEBUG] [VALIDATOR ] SQM: Validating primary data. [2025-09-29T21:15:21.861554] [DEBUG] [VALIDATOR ] SQM: All expected trading days are present. [2025-09-29T21:15:21.861695] [DEBUG] [VALIDATOR ] SQM: Primary data validation passed. [2025-09-29T21:15:21.862957] [INFO ] [MAIN ] SQM: Fetched primary data is valid. [2025-09-29T21:15:21.863024] [DEBUG] [LOCAL ] SQM: Saving primary data. [2025-09-29T21:15:21.865361] [DEBUG] [LOCAL ] SQM: Trimmed 68915 records to 48530 (keeping 200 days of data) [2025-09-29T21:15:21.958562] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-02. [2025-09-29T21:15:22.180142] [DEBUG] [LOCAL ] SQM: Primary data saved (48530 records). [2025-09-29T21:15:22.180334] [INFO ] [MAIN ] SQM: Full history saved. [2025-09-29T21:15:22.180537] [INFO ] [MAIN ] Update Progress: 1989/2371 symbols completed. SQM took 43.6s. Estimated remaining: 49m 2s. Rate: 7.8 symbols/min [2025-09-29T21:15:22.375186] [INFO ] [MAIN ] SRG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:15:22.398183] [DEBUG] [LOCAL ] SRG: Loaded 15859 existing records from primary storage. [2025-09-29T21:15:22.398478] [INFO ] [MAIN ] SRG: Loaded 15859 existing records. [2025-09-29T21:15:22.595503] [WARN ] [MAIN ] SRG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:15:22.595781] [INFO ] [MAIN ] SRG: Wiping existing primary data before full refresh. [2025-09-29T21:15:22.595842] [INFO ] [LOCAL ] SRG: Starting deletion of primary data. [2025-09-29T21:15:22.596196] [DEBUG] [LOCAL ] SRG: Deleted primary data file. [2025-09-29T21:15:22.596273] [INFO ] [MAIN ] SRG: Starting full primary refresh. [2025-09-29T21:15:22.760054] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2024-12. [2025-09-29T21:15:22.824508] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-29T21:15:23.039177] [INFO ] [REMOTE ] SRG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:15:23.102214] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-29T21:15:23.548160] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-05. [2025-09-29T21:15:24.348204] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-03. [2025-09-29T21:15:24.542862] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-29T21:15:25.148154] [INFO ] [REMOTE ] SRG: Fetching primary data for 2024-12. [2025-09-29T21:15:25.224358] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-29T21:15:25.272593] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-29T21:15:25.948087] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-06. [2025-09-29T21:15:26.324467] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-29T21:15:26.748113] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-01. [2025-09-29T21:15:27.553311] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-04. [2025-09-29T21:15:27.574100] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-29T21:15:28.077631] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-29T21:15:28.348118] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-01. [2025-09-29T21:15:28.551080] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-29T21:15:29.148112] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-07. [2025-09-29T21:15:29.456500] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-29T21:15:29.948172] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-02. [2025-09-29T21:15:30.754917] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-05. [2025-09-29T21:15:30.784345] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-29T21:15:30.989295] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-29T21:15:31.548151] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-02. [2025-09-29T21:15:31.740398] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-29T21:15:32.348162] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-08. [2025-09-29T21:15:32.860975] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-29T21:15:33.148135] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-03. [2025-09-29T21:15:33.258435] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-29T21:15:33.919788] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-29T21:15:33.948157] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-04. [2025-09-29T21:15:34.748180] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-03. [2025-09-29T21:15:34.799626] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-29T21:15:35.548175] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-09. [2025-09-29T21:15:35.698539] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-29T21:15:36.070620] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-29T21:15:36.081336] [INFO ] [REMOTE ] SRE: Full fetch complete (76902 records). [2025-09-29T21:15:36.081529] [DEBUG] [VALIDATOR ] SRE: Validating primary data. [2025-09-29T21:15:36.084081] [FATAL] [VALIDATOR ] SRE: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T21:15:36.084194] [FATAL] [MAIN ] SRE: Fetched primary data is invalid. Refusing to save it. [2025-09-29T21:15:36.084240] [WARN ] [MAIN ] SRE: Deleting existing primary and derivative data due to validation failure. [2025-09-29T21:15:36.084310] [INFO ] [LOCAL ] SRE: Starting deletion of primary data. [2025-09-29T21:15:36.084414] [DEBUG] [LOCAL ] SRE: No primary data file found to delete. [2025-09-29T21:15:36.084494] [INFO ] [LOCAL ] SRE: Starting deletion of derivative data. [2025-09-29T21:15:36.085046] [DEBUG] [LOCAL ] SRE: Deleted derivative data file. [2025-09-29T21:15:36.085156] [INFO ] [MAIN ] Update Progress: 1990/2371 symbols completed. SRE took 30.6s. Estimated remaining: 48m 56s. Rate: 7.8 symbols/min [2025-09-29T21:15:36.265017] [INFO ] [MAIN ] SRI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:15:36.298004] [DEBUG] [LOCAL ] SRI: Loaded 27810 existing records from primary storage. [2025-09-29T21:15:36.298296] [INFO ] [MAIN ] SRI: Loaded 27810 existing records. [2025-09-29T21:15:36.353310] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-06. [2025-09-29T21:15:36.507940] [WARN ] [MAIN ] SRI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:15:36.508306] [INFO ] [MAIN ] SRI: Wiping existing primary data before full refresh. [2025-09-29T21:15:36.508380] [INFO ] [LOCAL ] SRI: Starting deletion of primary data. [2025-09-29T21:15:36.508867] [DEBUG] [LOCAL ] SRI: Deleted primary data file. [2025-09-29T21:15:36.508939] [INFO ] [MAIN ] SRI: Starting full primary refresh. [2025-09-29T21:15:37.024537] [INFO ] [REMOTE ] SRI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:15:37.148207] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-05. [2025-09-29T21:15:37.348343] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-29T21:15:37.948141] [INFO ] [REMOTE ] SRI: Fetching primary data for 2024-12. [2025-09-29T21:15:38.166335] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-29T21:15:38.748124] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-04. [2025-09-29T21:15:39.355072] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-29T21:15:39.548139] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-07. [2025-09-29T21:15:39.874212] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-29T21:15:40.348167] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-05. [2025-09-29T21:15:40.459223] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-29T21:15:41.148129] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-01. [2025-09-29T21:15:41.261519] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-29T21:15:41.948124] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-08. [2025-09-29T21:15:42.736607] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-29T21:15:42.748077] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-02. [2025-09-29T21:15:42.853877] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-29T21:15:43.548115] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-06. [2025-09-29T21:15:43.898772] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-29T21:15:44.348161] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-09. [2025-09-29T21:15:45.133020] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-29T21:15:45.136093] [INFO ] [REMOTE ] SREA: Full fetch complete (15902 records). [2025-09-29T21:15:45.136213] [DEBUG] [VALIDATOR ] SREA: Validating primary data. [2025-09-29T21:15:45.158750] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-06. [2025-09-29T21:15:45.470219] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-29T21:15:45.590317] [DEBUG] [VALIDATOR ] SREA: All expected trading days are present. [2025-09-29T21:15:45.590447] [DEBUG] [VALIDATOR ] SREA: Primary data validation passed. [2025-09-29T21:15:45.590907] [INFO ] [MAIN ] SREA: Fetched primary data is valid. [2025-09-29T21:15:45.590990] [DEBUG] [LOCAL ] SREA: Saving primary data. [2025-09-29T21:15:45.591819] [DEBUG] [LOCAL ] SREA: Trimmed 15902 records to 10419 (keeping 200 days of data) [2025-09-29T21:15:45.664825] [DEBUG] [LOCAL ] SREA: Primary data saved (10419 records). [2025-09-29T21:15:45.664982] [INFO ] [MAIN ] SREA: Full history saved. [2025-09-29T21:15:45.665107] [INFO ] [MAIN ] Update Progress: 1991/2371 symbols completed. SREA took 32.2s. Estimated remaining: 48m 48s. Rate: 7.8 symbols/min [2025-09-29T21:15:45.858608] [INFO ] [MAIN ] SRL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:15:45.858828] [DEBUG] [LOCAL ] SRL: No existing data file found in primary storage. [2025-09-29T21:15:45.858874] [WARN ] [MAIN ] SRL: No existing data found, performing full refresh instead. [2025-09-29T21:15:45.859012] [INFO ] [MAIN ] SRL: Wiping existing primary data before full refresh. [2025-09-29T21:15:45.859056] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-09-29T21:15:45.859098] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-09-29T21:15:45.859174] [INFO ] [MAIN ] SRL: Starting full primary refresh. [2025-09-29T21:15:45.953257] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-03. [2025-09-29T21:15:46.184747] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-29T21:15:46.262561] [INFO ] [REMOTE ] SRL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:15:46.748129] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-07. [2025-09-29T21:15:47.451201] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-29T21:15:47.548144] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-07. [2025-09-29T21:15:47.667811] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-29T21:15:48.348113] [INFO ] [REMOTE ] SRL: Fetching primary data for 2024-12. [2025-09-29T21:15:48.869267] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-29T21:15:49.148114] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-08. [2025-09-29T21:15:49.948113] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-01. [2025-09-29T21:15:49.999624] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-09-29T21:15:50.263827] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-29T21:15:50.401668] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-29T21:15:50.748097] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-09. [2025-09-29T21:15:51.548129] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-04. [2025-09-29T21:15:51.762709] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-29T21:15:51.767412] [INFO ] [REMOTE ] SRG: Full fetch complete (24999 records). [2025-09-29T21:15:51.767520] [DEBUG] [VALIDATOR ] SRG: Validating primary data. [2025-09-29T21:15:52.159551] [DEBUG] [VALIDATOR ] SRG: All expected trading days are present. [2025-09-29T21:15:52.159668] [DEBUG] [VALIDATOR ] SRG: Primary data validation passed. [2025-09-29T21:15:52.160204] [INFO ] [MAIN ] SRG: Fetched primary data is valid. [2025-09-29T21:15:52.160247] [DEBUG] [LOCAL ] SRG: Saving primary data. [2025-09-29T21:15:52.161126] [DEBUG] [LOCAL ] SRG: Trimmed 24999 records to 15524 (keeping 200 days of data) [2025-09-29T21:15:52.251782] [DEBUG] [LOCAL ] SRG: Primary data saved (15524 records). [2025-09-29T21:15:52.251996] [INFO ] [MAIN ] SRG: Full history saved. [2025-09-29T21:15:52.252105] [INFO ] [MAIN ] Update Progress: 1992/2371 symbols completed. SRG took 30.1s. Estimated remaining: 48m 40s. Rate: 7.8 symbols/min [2025-09-29T21:15:52.354560] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-02. [2025-09-29T21:15:52.435560] [INFO ] [MAIN ] SRV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:15:52.445459] [DEBUG] [LOCAL ] SRV: Loaded 7631 existing records from primary storage. [2025-09-29T21:15:52.445737] [INFO ] [MAIN ] SRV: Loaded 7631 existing records. [2025-09-29T21:15:52.638848] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-09-29T21:15:52.642248] [WARN ] [MAIN ] SRV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:15:52.643793] [INFO ] [MAIN ] SRV: Wiping existing primary data before full refresh. [2025-09-29T21:15:52.643858] [INFO ] [LOCAL ] SRV: Starting deletion of primary data. [2025-09-29T21:15:52.644133] [DEBUG] [LOCAL ] SRV: Deleted primary data file. [2025-09-29T21:15:52.644207] [INFO ] [MAIN ] SRV: Starting full primary refresh. [2025-09-29T21:15:53.033122] [INFO ] [REMOTE ] SRV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:15:53.050266] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-29T21:15:53.148127] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-05. [2025-09-29T21:15:53.948129] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-03. [2025-09-29T21:15:54.527619] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-29T21:15:54.552268] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-29T21:15:54.748147] [INFO ] [REMOTE ] SRV: Fetching primary data for 2024-12. [2025-09-29T21:15:55.435843] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-29T21:15:55.548114] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-08. [2025-09-29T21:15:56.348115] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-01. [2025-09-29T21:15:57.148148] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-06. [2025-09-29T21:15:57.221459] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-29T21:15:57.864944] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-29T21:15:57.948146] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-02. [2025-09-29T21:15:58.076448] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-29T21:15:58.681563] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-29T21:15:58.748112] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-03. [2025-09-29T21:15:59.548087] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-09. [2025-09-29T21:15:59.604636] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-29T21:16:00.348150] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-07. [2025-09-29T21:16:01.148121] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-04. [2025-09-29T21:16:01.590404] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-29T21:16:01.602300] [INFO ] [REMOTE ] SRFM: Full fetch complete (49290 records). [2025-09-29T21:16:01.602544] [DEBUG] [VALIDATOR ] SRFM: Validating primary data. [2025-09-29T21:16:01.954186] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-29T21:16:01.951872] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-04. [2025-09-29T21:16:02.096876] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-29T21:16:02.117564] [DEBUG] [VALIDATOR ] SRFM: All expected trading days are present. [2025-09-29T21:16:02.117704] [DEBUG] [VALIDATOR ] SRFM: Primary data validation passed. [2025-09-29T21:16:02.118867] [INFO ] [MAIN ] SRFM: Fetched primary data is valid. [2025-09-29T21:16:02.118935] [DEBUG] [LOCAL ] SRFM: Saving primary data. [2025-09-29T21:16:02.120235] [DEBUG] [LOCAL ] SRFM: Trimmed 49290 records to 36247 (keeping 200 days of data) [2025-09-29T21:16:02.347329] [DEBUG] [LOCAL ] SRFM: Primary data saved (36247 records). [2025-09-29T21:16:02.347480] [INFO ] [MAIN ] SRFM: Full history saved. [2025-09-29T21:16:02.347593] [INFO ] [MAIN ] Update Progress: 1993/2371 symbols completed. SRFM took 42.4s. Estimated remaining: 48m 33s. Rate: 7.8 symbols/min [2025-09-29T21:16:02.556457] [INFO ] [MAIN ] SSB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:16:02.560162] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-29T21:16:02.601586] [DEBUG] [LOCAL ] SSB: Loaded 43377 existing records from primary storage. [2025-09-29T21:16:02.601950] [INFO ] [MAIN ] SSB: Loaded 43377 existing records. [2025-09-29T21:16:02.753321] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-08. [2025-09-29T21:16:02.804115] [WARN ] [MAIN ] SSB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:16:02.804851] [INFO ] [MAIN ] SSB: Wiping existing primary data before full refresh. [2025-09-29T21:16:02.804940] [INFO ] [LOCAL ] SSB: Starting deletion of primary data. [2025-09-29T21:16:02.805328] [DEBUG] [LOCAL ] SSB: Deleted primary data file. [2025-09-29T21:16:02.805393] [INFO ] [MAIN ] SSB: Starting full primary refresh. [2025-09-29T21:16:03.180187] [INFO ] [REMOTE ] SSB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:16:03.548141] [INFO ] [REMOTE ] SSB: Fetching primary data for 2024-12. [2025-09-29T21:16:03.991913] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-29T21:16:04.348151] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-09. [2025-09-29T21:16:04.882100] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-29T21:16:05.148116] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-05. [2025-09-29T21:16:05.514354] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-29T21:16:05.522226] [INFO ] [REMOTE ] SRI: Full fetch complete (41548 records). [2025-09-29T21:16:05.522419] [DEBUG] [VALIDATOR ] SRI: Validating primary data. [2025-09-29T21:16:05.644921] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-29T21:16:05.937132] [DEBUG] [VALIDATOR ] SRI: All expected trading days are present. [2025-09-29T21:16:05.937224] [DEBUG] [VALIDATOR ] SRI: Primary data validation passed. [2025-09-29T21:16:05.938062] [INFO ] [MAIN ] SRI: Fetched primary data is valid. [2025-09-29T21:16:05.938125] [DEBUG] [LOCAL ] SRI: Saving primary data. [2025-09-29T21:16:05.939151] [DEBUG] [LOCAL ] SRI: Trimmed 41548 records to 27306 (keeping 200 days of data) [2025-09-29T21:16:05.986972] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-05. [2025-09-29T21:16:06.103368] [DEBUG] [LOCAL ] SRI: Primary data saved (27306 records). [2025-09-29T21:16:06.103520] [INFO ] [MAIN ] SRI: Full history saved. [2025-09-29T21:16:06.103611] [INFO ] [MAIN ] Update Progress: 1994/2371 symbols completed. SRI took 30.0s. Estimated remaining: 48m 25s. Rate: 7.8 symbols/min [2025-09-29T21:16:06.287215] [INFO ] [MAIN ] SSD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:16:06.321506] [DEBUG] [LOCAL ] SSD: Loaded 22631 existing records from primary storage. [2025-09-29T21:16:06.321934] [INFO ] [MAIN ] SSD: Loaded 22631 existing records. [2025-09-29T21:16:06.510803] [WARN ] [MAIN ] SSD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:16:06.511070] [INFO ] [MAIN ] SSD: Wiping existing primary data before full refresh. [2025-09-29T21:16:06.511128] [INFO ] [LOCAL ] SSD: Starting deletion of primary data. [2025-09-29T21:16:06.511441] [DEBUG] [LOCAL ] SSD: Deleted primary data file. [2025-09-29T21:16:06.511499] [INFO ] [MAIN ] SSD: Starting full primary refresh. [2025-09-29T21:16:06.753180] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-01. [2025-09-29T21:16:06.886663] [INFO ] [REMOTE ] SSD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:16:06.892550] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-29T21:16:07.548150] [INFO ] [REMOTE ] SSD: Fetching primary data for 2024-12. [2025-09-29T21:16:08.351473] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-06. [2025-09-29T21:16:08.357835] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-29T21:16:08.422851] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-29T21:16:08.750894] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-29T21:16:09.148147] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-02. [2025-09-29T21:16:09.948150] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-06. [2025-09-29T21:16:10.494314] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-29T21:16:10.748147] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-07. [2025-09-29T21:16:10.768431] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-29T21:16:11.088994] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-29T21:16:11.548151] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-01. [2025-09-29T21:16:12.348121] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-08. [2025-09-29T21:16:12.704085] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-29T21:16:12.889984] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-29T21:16:13.148159] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-07. [2025-09-29T21:16:13.948145] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-02. [2025-09-29T21:16:13.970897] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-29T21:16:14.748146] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-03. [2025-09-29T21:16:15.220365] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-29T21:16:15.548093] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-09. [2025-09-29T21:16:15.893822] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-29T21:16:15.894679] [INFO ] [REMOTE ] SRL: Full fetch complete (1957 records). [2025-09-29T21:16:15.894756] [DEBUG] [VALIDATOR ] SRL: Validating primary data. [2025-09-29T21:16:15.895136] [FATAL] [VALIDATOR ] SRL: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T21:16:15.895219] [FATAL] [MAIN ] SRL: Fetched primary data is invalid. Refusing to save it. [2025-09-29T21:16:15.895265] [WARN ] [MAIN ] SRL: Deleting existing primary and derivative data due to validation failure. [2025-09-29T21:16:15.895306] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-09-29T21:16:15.895363] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-09-29T21:16:15.895400] [INFO ] [LOCAL ] SRL: Starting deletion of derivative data. [2025-09-29T21:16:15.895461] [DEBUG] [LOCAL ] SRL: No derivative data file found to delete. [2025-09-29T21:16:15.895539] [INFO ] [MAIN ] Update Progress: 1995/2371 symbols completed. SRL took 30.2s. Estimated remaining: 48m 17s. Rate: 7.8 symbols/min [2025-09-29T21:16:16.091744] [INFO ] [MAIN ] SSL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:16:16.140665] [DEBUG] [LOCAL ] SSL: Loaded 41830 existing records from primary storage. [2025-09-29T21:16:16.140980] [INFO ] [MAIN ] SSL: Loaded 41830 existing records. [2025-09-29T21:16:16.326526] [WARN ] [MAIN ] SSL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:16:16.326785] [INFO ] [MAIN ] SSL: Wiping existing primary data before full refresh. [2025-09-29T21:16:16.326839] [INFO ] [LOCAL ] SSL: Starting deletion of primary data. [2025-09-29T21:16:16.327386] [DEBUG] [LOCAL ] SSL: Deleted primary data file. [2025-09-29T21:16:16.327448] [INFO ] [MAIN ] SSL: Starting full primary refresh. [2025-09-29T21:16:16.357688] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-03. [2025-09-29T21:16:16.743007] [INFO ] [REMOTE ] SSL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:16:16.769201] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-29T21:16:17.148133] [INFO ] [REMOTE ] SSL: Fetching primary data for 2024-12. [2025-09-29T21:16:17.408980] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-29T21:16:17.948164] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-08. [2025-09-29T21:16:18.757624] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-04. [2025-09-29T21:16:18.768624] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-29T21:16:18.781358] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-29T21:16:19.548166] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-09. [2025-09-29T21:16:19.998084] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-29T21:16:20.207062] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-29T21:16:20.209096] [INFO ] [REMOTE ] SRV: Full fetch complete (11558 records). [2025-09-29T21:16:20.209176] [DEBUG] [VALIDATOR ] SRV: Validating primary data. [2025-09-29T21:16:20.355973] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-05. [2025-09-29T21:16:20.623822] [DEBUG] [VALIDATOR ] SRV: All expected trading days are present. [2025-09-29T21:16:20.623906] [DEBUG] [VALIDATOR ] SRV: Primary data validation passed. [2025-09-29T21:16:20.624202] [INFO ] [MAIN ] SRV: Fetched primary data is valid. [2025-09-29T21:16:20.624242] [DEBUG] [LOCAL ] SRV: Saving primary data. [2025-09-29T21:16:20.624767] [DEBUG] [LOCAL ] SRV: Trimmed 11558 records to 7429 (keeping 200 days of data) [2025-09-29T21:16:20.677988] [DEBUG] [LOCAL ] SRV: Primary data saved (7429 records). [2025-09-29T21:16:20.678143] [INFO ] [MAIN ] SRV: Full history saved. [2025-09-29T21:16:20.678247] [INFO ] [MAIN ] Update Progress: 1996/2371 symbols completed. SRV took 28.4s. Estimated remaining: 48m 9s. Rate: 7.8 symbols/min [2025-09-29T21:16:20.892893] [INFO ] [MAIN ] SST: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:16:20.906572] [DEBUG] [LOCAL ] SST: Loaded 12166 existing records from primary storage. [2025-09-29T21:16:20.906880] [INFO ] [MAIN ] SST: Loaded 12166 existing records. [2025-09-29T21:16:21.101863] [WARN ] [MAIN ] SST: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:16:21.102103] [INFO ] [MAIN ] SST: Wiping existing primary data before full refresh. [2025-09-29T21:16:21.102182] [INFO ] [LOCAL ] SST: Starting deletion of primary data. [2025-09-29T21:16:21.102485] [DEBUG] [LOCAL ] SST: Deleted primary data file. [2025-09-29T21:16:21.102556] [INFO ] [MAIN ] SST: Starting full primary refresh. [2025-09-29T21:16:21.159102] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-01. [2025-09-29T21:16:21.488080] [INFO ] [REMOTE ] SST: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:16:21.509178] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-29T21:16:21.948136] [INFO ] [REMOTE ] SST: Fetching primary data for 2024-12. [2025-09-29T21:16:22.748151] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-06. [2025-09-29T21:16:22.922011] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-29T21:16:23.109586] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-29T21:16:23.548162] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-02. [2025-09-29T21:16:23.729583] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-29T21:16:24.348142] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-04. [2025-09-29T21:16:24.973538] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-29T21:16:25.148123] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-01. [2025-09-29T21:16:25.948154] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-03. [2025-09-29T21:16:26.015270] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-29T21:16:26.405414] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-29T21:16:26.748164] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-05. [2025-09-29T21:16:27.548115] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-07. [2025-09-29T21:16:27.577421] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-29T21:16:28.181468] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-29T21:16:28.348143] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-04. [2025-09-29T21:16:28.871094] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-29T21:16:29.148167] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-08. [2025-09-29T21:16:29.948088] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-02. [2025-09-29T21:16:30.050897] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-29T21:16:30.430689] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-29T21:16:30.748188] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-05. [2025-09-29T21:16:30.849379] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-29T21:16:31.548177] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-03. [2025-09-29T21:16:32.348112] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-09. [2025-09-29T21:16:32.470068] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-29T21:16:32.470403] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-29T21:16:33.148123] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-04. [2025-09-29T21:16:33.182611] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-29T21:16:33.187734] [INFO ] [REMOTE ] SSD: Full fetch complete (32315 records). [2025-09-29T21:16:33.187837] [DEBUG] [VALIDATOR ] SSD: Validating primary data. [2025-09-29T21:16:33.581021] [DEBUG] [VALIDATOR ] SSD: All expected trading days are present. [2025-09-29T21:16:33.581107] [DEBUG] [VALIDATOR ] SSD: Primary data validation passed. [2025-09-29T21:16:33.581829] [INFO ] [MAIN ] SSD: Fetched primary data is valid. [2025-09-29T21:16:33.581896] [DEBUG] [LOCAL ] SSD: Saving primary data. [2025-09-29T21:16:33.582732] [DEBUG] [LOCAL ] SSD: Trimmed 32315 records to 22375 (keeping 200 days of data) [2025-09-29T21:16:33.749987] [DEBUG] [LOCAL ] SSD: Primary data saved (22375 records). [2025-09-29T21:16:33.750168] [INFO ] [MAIN ] SSD: Full history saved. [2025-09-29T21:16:33.750299] [INFO ] [MAIN ] Update Progress: 1997/2371 symbols completed. SSD took 27.6s. Estimated remaining: 48m 2s. Rate: 7.8 symbols/min [2025-09-29T21:16:33.948133] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-06. [2025-09-29T21:16:33.982430] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-29T21:16:34.748194] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-06. [2025-09-29T21:16:35.548116] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-05. [2025-09-29T21:16:35.623011] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-29T21:16:36.330442] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-29T21:16:36.346532] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-29T21:16:36.348336] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-07. [2025-09-29T21:16:37.148153] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-06. [2025-09-29T21:16:37.948139] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-07. [2025-09-29T21:16:38.135665] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-29T21:16:38.322730] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-29T21:16:38.748177] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-08. [2025-09-29T21:16:39.548088] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-07. [2025-09-29T21:16:39.818994] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-29T21:16:39.974875] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-29T21:16:40.293843] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-29T21:16:40.348092] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-08. [2025-09-29T21:16:40.945931] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-29T21:16:41.148145] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-09. [2025-09-29T21:16:41.861508] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-29T21:16:41.863592] [INFO ] [REMOTE ] SST: Full fetch complete (18968 records). [2025-09-29T21:16:41.863714] [DEBUG] [VALIDATOR ] SST: Validating primary data. [2025-09-29T21:16:41.953264] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-08. [2025-09-29T21:16:42.280056] [DEBUG] [VALIDATOR ] SST: All expected trading days are present. [2025-09-29T21:16:42.280168] [DEBUG] [VALIDATOR ] SST: Primary data validation passed. [2025-09-29T21:16:42.280593] [INFO ] [MAIN ] SST: Fetched primary data is valid. [2025-09-29T21:16:42.280634] [DEBUG] [LOCAL ] SST: Saving primary data. [2025-09-29T21:16:42.281280] [DEBUG] [LOCAL ] SST: Trimmed 18968 records to 11966 (keeping 200 days of data) [2025-09-29T21:16:42.351759] [DEBUG] [LOCAL ] SST: Primary data saved (11966 records). [2025-09-29T21:16:42.351907] [INFO ] [MAIN ] SST: Full history saved. [2025-09-29T21:16:42.352010] [INFO ] [MAIN ] Update Progress: 1998/2371 symbols completed. SST took 21.7s. Estimated remaining: 47m 55s. Rate: 7.8 symbols/min [2025-09-29T21:16:42.748094] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-09. [2025-09-29T21:16:43.628066] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-29T21:16:43.637728] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-09. [2025-09-29T21:16:44.527296] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-29T21:16:44.536426] [INFO ] [REMOTE ] SSL: Full fetch complete (60176 records). [2025-09-29T21:16:44.536565] [DEBUG] [VALIDATOR ] SSL: Validating primary data. [2025-09-29T21:16:44.967109] [DEBUG] [VALIDATOR ] SSL: All expected trading days are present. [2025-09-29T21:16:44.967215] [DEBUG] [VALIDATOR ] SSL: Primary data validation passed. [2025-09-29T21:16:44.968325] [INFO ] [MAIN ] SSL: Fetched primary data is valid. [2025-09-29T21:16:44.968400] [DEBUG] [LOCAL ] SSL: Saving primary data. [2025-09-29T21:16:44.969750] [DEBUG] [LOCAL ] SSL: Trimmed 60176 records to 41163 (keeping 200 days of data) [2025-09-29T21:16:45.218899] [DEBUG] [LOCAL ] SSL: Primary data saved (41163 records). [2025-09-29T21:16:45.219030] [INFO ] [MAIN ] SSL: Full history saved. [2025-09-29T21:16:45.219111] [INFO ] [MAIN ] Update Progress: 1999/2371 symbols completed. SSL took 29.3s. Estimated remaining: 47m 46s. Rate: 7.8 symbols/min [2025-09-29T21:16:45.344101] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-29T21:16:45.353024] [INFO ] [REMOTE ] SSB: Full fetch complete (61113 records). [2025-09-29T21:16:45.353161] [DEBUG] [VALIDATOR ] SSB: Validating primary data. [2025-09-29T21:16:45.796427] [DEBUG] [VALIDATOR ] SSB: All expected trading days are present. [2025-09-29T21:16:45.796518] [DEBUG] [VALIDATOR ] SSB: Primary data validation passed. [2025-09-29T21:16:45.797806] [INFO ] [MAIN ] SSB: Fetched primary data is valid. [2025-09-29T21:16:45.797876] [DEBUG] [LOCAL ] SSB: Saving primary data. [2025-09-29T21:16:45.799194] [DEBUG] [LOCAL ] SSB: Trimmed 61113 records to 42740 (keeping 200 days of data) [2025-09-29T21:16:46.079224] [DEBUG] [LOCAL ] SSB: Primary data saved (42740 records). [2025-09-29T21:16:46.079620] [INFO ] [MAIN ] SSB: Full history saved. [2025-09-29T21:16:46.079935] [INFO ] [MAIN ] Update Progress: 2000/2371 symbols completed. SSB took 43.7s. Estimated remaining: 47m 37s. Rate: 7.8 symbols/min [2025-09-29T21:16:46.775696] [INFO ] [MAIN ] STC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:16:46.851612] [INFO ] [MAIN ] SSTK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:16:46.871819] [INFO ] [MAIN ] ST: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:16:46.876542] [INFO ] [MAIN ] STAG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:16:46.897524] [DEBUG] [LOCAL ] STC: Loaded 17878 existing records from primary storage. [2025-09-29T21:16:46.897954] [INFO ] [MAIN ] STC: Loaded 17878 existing records. [2025-09-29T21:16:47.052590] [DEBUG] [LOCAL ] SSTK: Loaded 26762 existing records from primary storage. [2025-09-29T21:16:47.064994] [INFO ] [MAIN ] SSTK: Loaded 26762 existing records. [2025-09-29T21:16:47.210216] [WARN ] [MAIN ] STC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:16:47.234035] [DEBUG] [LOCAL ] STAG: Loaded 50799 existing records from primary storage. [2025-09-29T21:16:47.255109] [INFO ] [MAIN ] STC: Wiping existing primary data before full refresh. [2025-09-29T21:16:47.279719] [INFO ] [MAIN ] STAG: Loaded 50799 existing records. [2025-09-29T21:16:47.305825] [DEBUG] [LOCAL ] ST: Loaded 50505 existing records from primary storage. [2025-09-29T21:16:47.305956] [INFO ] [LOCAL ] STC: Starting deletion of primary data. [2025-09-29T21:16:47.371815] [INFO ] [MAIN ] ST: Loaded 50505 existing records. [2025-09-29T21:16:47.413321] [DEBUG] [LOCAL ] STC: Deleted primary data file. [2025-09-29T21:16:47.498019] [INFO ] [MAIN ] STC: Starting full primary refresh. [2025-09-29T21:16:47.754131] [WARN ] [MAIN ] SSTK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:16:47.897625] [INFO ] [MAIN ] SSTK: Wiping existing primary data before full refresh. [2025-09-29T21:16:47.939195] [INFO ] [LOCAL ] SSTK: Starting deletion of primary data. [2025-09-29T21:16:48.011131] [WARN ] [MAIN ] STAG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:16:48.032265] [INFO ] [MAIN ] STAG: Wiping existing primary data before full refresh. [2025-09-29T21:16:48.032329] [DEBUG] [LOCAL ] SSTK: Deleted primary data file. [2025-09-29T21:16:48.007820] [WARN ] [MAIN ] ST: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:16:48.037965] [INFO ] [LOCAL ] STAG: Starting deletion of primary data. [2025-09-29T21:16:48.037895] [INFO ] [MAIN ] SSTK: Starting full primary refresh. [2025-09-29T21:16:48.088112] [INFO ] [MAIN ] ST: Wiping existing primary data before full refresh. [2025-09-29T21:16:48.107180] [INFO ] [LOCAL ] ST: Starting deletion of primary data. [2025-09-29T21:16:48.183678] [DEBUG] [LOCAL ] ST: Deleted primary data file. [2025-09-29T21:16:48.158992] [DEBUG] [LOCAL ] STAG: Deleted primary data file. [2025-09-29T21:16:48.231639] [INFO ] [MAIN ] ST: Starting full primary refresh. [2025-09-29T21:16:48.268364] [INFO ] [MAIN ] STAG: Starting full primary refresh. [2025-09-29T21:16:48.753895] [INFO ] [REMOTE ] STC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:16:48.784789] [INFO ] [REMOTE ] STC: Fetching primary data for 2024-12. [2025-09-29T21:16:49.316191] [INFO ] [REMOTE ] SSTK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:16:49.357618] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2024-12. [2025-09-29T21:16:49.434836] [INFO ] [REMOTE ] ST: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:16:49.438347] [INFO ] [REMOTE ] ST: Fetching primary data for 2024-12. [2025-09-29T21:16:49.461388] [INFO ] [REMOTE ] STAG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:16:49.461786] [INFO ] [REMOTE ] STAG: Fetching primary data for 2024-12. [2025-09-29T21:16:49.617450] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-29T21:16:49.622054] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-01. [2025-09-29T21:16:50.740132] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-29T21:16:50.745413] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-02. [2025-09-29T21:16:50.905628] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-29T21:16:50.912406] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-01. [2025-09-29T21:16:51.067127] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-29T21:16:51.077907] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-01. [2025-09-29T21:16:51.386785] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-29T21:16:51.397247] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-01. [2025-09-29T21:16:51.885197] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-29T21:16:51.889755] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-03. [2025-09-29T21:16:52.279450] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-29T21:16:52.348108] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-02. [2025-09-29T21:16:52.586130] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-29T21:16:52.736472] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-29T21:16:52.853165] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-29T21:16:53.148118] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-02. [2025-09-29T21:16:53.379438] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-29T21:16:53.948122] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-04. [2025-09-29T21:16:54.748122] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-03. [2025-09-29T21:16:54.945932] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-29T21:16:55.011160] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-29T21:16:55.548102] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-03. [2025-09-29T21:16:56.240358] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-29T21:16:56.348114] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-04. [2025-09-29T21:16:57.001027] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-29T21:16:57.148130] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-04. [2025-09-29T21:16:57.427330] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-29T21:16:57.948167] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-05. [2025-09-29T21:16:58.633930] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-29T21:16:58.748148] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-06. [2025-09-29T21:16:59.121795] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-29T21:16:59.468245] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-29T21:16:59.548152] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-05. [2025-09-29T21:17:00.348141] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-07. [2025-09-29T21:17:00.907603] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-29T21:17:01.148195] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-06. [2025-09-29T21:17:01.556876] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-29T21:17:01.948150] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-08. [2025-09-29T21:17:02.422347] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-29T21:17:02.660035] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-29T21:17:02.748143] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-09. [2025-09-29T21:17:03.548103] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-02. [2025-09-29T21:17:03.779092] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-29T21:17:03.783260] [INFO ] [REMOTE ] STC: Full fetch complete (26060 records). [2025-09-29T21:17:03.783390] [DEBUG] [VALIDATOR ] STC: Validating primary data. [2025-09-29T21:17:04.178838] [DEBUG] [VALIDATOR ] STC: All expected trading days are present. [2025-09-29T21:17:04.178928] [DEBUG] [VALIDATOR ] STC: Primary data validation passed. [2025-09-29T21:17:04.179498] [INFO ] [MAIN ] STC: Fetched primary data is valid. [2025-09-29T21:17:04.179541] [DEBUG] [LOCAL ] STC: Saving primary data. [2025-09-29T21:17:04.180363] [DEBUG] [LOCAL ] STC: Trimmed 26060 records to 17536 (keeping 200 days of data) [2025-09-29T21:17:04.295383] [DEBUG] [LOCAL ] STC: Primary data saved (17536 records). [2025-09-29T21:17:04.295541] [INFO ] [MAIN ] STC: Full history saved. [2025-09-29T21:17:04.295626] [INFO ] [MAIN ] Update Progress: 2001/2371 symbols completed. STC took 18.2s. Estimated remaining: 47m 32s. Rate: 7.8 symbols/min [2025-09-29T21:17:04.360330] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-05. [2025-09-29T21:17:04.478590] [INFO ] [MAIN ] STE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:17:04.516285] [DEBUG] [LOCAL ] STE: Loaded 35822 existing records from primary storage. [2025-09-29T21:17:04.516603] [INFO ] [MAIN ] STE: Loaded 35822 existing records. [2025-09-29T21:17:04.699342] [WARN ] [MAIN ] STE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:17:04.699588] [INFO ] [MAIN ] STE: Wiping existing primary data before full refresh. [2025-09-29T21:17:04.699664] [INFO ] [LOCAL ] STE: Starting deletion of primary data. [2025-09-29T21:17:04.700008] [DEBUG] [LOCAL ] STE: Deleted primary data file. [2025-09-29T21:17:04.700068] [INFO ] [MAIN ] STE: Starting full primary refresh. [2025-09-29T21:17:05.087152] [INFO ] [REMOTE ] STE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:17:05.148130] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-07. [2025-09-29T21:17:05.278988] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-29T21:17:05.912461] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-29T21:17:05.948075] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-06. [2025-09-29T21:17:06.012942] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-29T21:17:06.748157] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-08. [2025-09-29T21:17:07.548117] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-03. [2025-09-29T21:17:07.881847] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-29T21:17:07.895183] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-29T21:17:08.348144] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-07. [2025-09-29T21:17:08.984940] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-29T21:17:09.148108] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-04. [2025-09-29T21:17:09.948086] [INFO ] [REMOTE ] STE: Fetching primary data for 2024-12. [2025-09-29T21:17:10.151597] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-29T21:17:10.748107] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-08. [2025-09-29T21:17:10.979521] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-29T21:17:11.552777] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-05. [2025-09-29T21:17:11.554903] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-29T21:17:12.348121] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-01. [2025-09-29T21:17:12.482528] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-29T21:17:13.148105] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-09. [2025-09-29T21:17:13.545601] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-29T21:17:13.578326] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-29T21:17:13.948081] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-02. [2025-09-29T21:17:14.293367] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-29T21:17:14.298585] [INFO ] [REMOTE ] SSTK: Full fetch complete (41935 records). [2025-09-29T21:17:14.298770] [DEBUG] [VALIDATOR ] SSTK: Validating primary data. [2025-09-29T21:17:14.697943] [DEBUG] [VALIDATOR ] SSTK: All expected trading days are present. [2025-09-29T21:17:14.698023] [DEBUG] [VALIDATOR ] SSTK: Primary data validation passed. [2025-09-29T21:17:14.698899] [INFO ] [MAIN ] SSTK: Fetched primary data is valid. [2025-09-29T21:17:14.698963] [DEBUG] [LOCAL ] SSTK: Saving primary data. [2025-09-29T21:17:14.699940] [DEBUG] [LOCAL ] SSTK: Trimmed 41935 records to 26016 (keeping 200 days of data) [2025-09-29T21:17:14.752551] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-06. [2025-09-29T21:17:14.862701] [DEBUG] [LOCAL ] SSTK: Primary data saved (26016 records). [2025-09-29T21:17:14.862891] [INFO ] [MAIN ] SSTK: Full history saved. [2025-09-29T21:17:14.863012] [INFO ] [MAIN ] Update Progress: 2002/2371 symbols completed. SSTK took 28.8s. Estimated remaining: 47m 24s. Rate: 7.8 symbols/min [2025-09-29T21:17:15.043773] [INFO ] [MAIN ] STEL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:17:15.068674] [DEBUG] [LOCAL ] STEL: Loaded 23823 existing records from primary storage. [2025-09-29T21:17:15.069004] [INFO ] [MAIN ] STEL: Loaded 23823 existing records. [2025-09-29T21:17:15.263190] [WARN ] [MAIN ] STEL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:17:15.263523] [INFO ] [MAIN ] STEL: Wiping existing primary data before full refresh. [2025-09-29T21:17:15.263738] [INFO ] [LOCAL ] STEL: Starting deletion of primary data. [2025-09-29T21:17:15.264028] [DEBUG] [LOCAL ] STEL: Deleted primary data file. [2025-09-29T21:17:15.264087] [INFO ] [MAIN ] STEL: Starting full primary refresh. [2025-09-29T21:17:15.548341] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-09. [2025-09-29T21:17:15.680107] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-29T21:17:15.685771] [INFO ] [REMOTE ] STEL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:17:16.348127] [INFO ] [REMOTE ] STEL: Fetching primary data for 2024-12. [2025-09-29T21:17:16.672909] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-29T21:17:17.148104] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-07. [2025-09-29T21:17:17.212437] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-29T21:17:17.223609] [INFO ] [REMOTE ] STAG: Full fetch complete (71944 records). [2025-09-29T21:17:17.223791] [DEBUG] [VALIDATOR ] STAG: Validating primary data. [2025-09-29T21:17:17.628170] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-29T21:17:17.670672] [DEBUG] [VALIDATOR ] STAG: All expected trading days are present. [2025-09-29T21:17:17.670776] [DEBUG] [VALIDATOR ] STAG: Primary data validation passed. [2025-09-29T21:17:17.672042] [INFO ] [MAIN ] STAG: Fetched primary data is valid. [2025-09-29T21:17:17.672110] [DEBUG] [LOCAL ] STAG: Saving primary data. [2025-09-29T21:17:17.673598] [DEBUG] [LOCAL ] STAG: Trimmed 71944 records to 50034 (keeping 200 days of data) [2025-09-29T21:17:17.954682] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-01. [2025-09-29T21:17:17.992970] [DEBUG] [LOCAL ] STAG: Primary data saved (50034 records). [2025-09-29T21:17:17.993202] [INFO ] [MAIN ] STAG: Full history saved. [2025-09-29T21:17:17.993300] [INFO ] [MAIN ] Update Progress: 2003/2371 symbols completed. STAG took 31.9s. Estimated remaining: 47m 16s. Rate: 7.8 symbols/min [2025-09-29T21:17:18.173764] [INFO ] [MAIN ] STEM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:17:18.213634] [DEBUG] [LOCAL ] STEM: Loaded 40374 existing records from primary storage. [2025-09-29T21:17:18.213990] [INFO ] [MAIN ] STEM: Loaded 40374 existing records. [2025-09-29T21:17:18.402227] [WARN ] [MAIN ] STEM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:17:18.402926] [INFO ] [MAIN ] STEM: Wiping existing primary data before full refresh. [2025-09-29T21:17:18.402989] [INFO ] [LOCAL ] STEM: Starting deletion of primary data. [2025-09-29T21:17:18.403430] [DEBUG] [LOCAL ] STEM: Deleted primary data file. [2025-09-29T21:17:18.403488] [INFO ] [MAIN ] STEM: Starting full primary refresh. [2025-09-29T21:17:18.748195] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-03. [2025-09-29T21:17:18.781101] [INFO ] [REMOTE ] STEM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:17:18.860357] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-29T21:17:18.979489] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-29T21:17:19.548113] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-08. [2025-09-29T21:17:20.348091] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-02. [2025-09-29T21:17:20.446476] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-29T21:17:21.148088] [INFO ] [REMOTE ] STEM: Fetching primary data for 2024-12. [2025-09-29T21:17:21.185315] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-29T21:17:21.434023] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-29T21:17:21.948145] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-03. [2025-09-29T21:17:22.748122] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-04. [2025-09-29T21:17:22.859157] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-29T21:17:23.279572] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-29T21:17:23.548120] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-04. [2025-09-29T21:17:24.348123] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-09. [2025-09-29T21:17:24.406593] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-29T21:17:24.950217] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-29T21:17:25.148154] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-05. [2025-09-29T21:17:25.948110] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-05. [2025-09-29T21:17:26.185847] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-29T21:17:26.196779] [INFO ] [REMOTE ] ST: Full fetch complete (71925 records). [2025-09-29T21:17:26.196915] [DEBUG] [VALIDATOR ] ST: Validating primary data. [2025-09-29T21:17:26.610080] [DEBUG] [VALIDATOR ] ST: All expected trading days are present. [2025-09-29T21:17:26.610170] [DEBUG] [VALIDATOR ] ST: Primary data validation passed. [2025-09-29T21:17:26.611380] [INFO ] [MAIN ] ST: Fetched primary data is valid. [2025-09-29T21:17:26.611446] [DEBUG] [LOCAL ] ST: Saving primary data. [2025-09-29T21:17:26.612909] [DEBUG] [LOCAL ] ST: Trimmed 71925 records to 49729 (keeping 200 days of data) [2025-09-29T21:17:26.748167] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-01. [2025-09-29T21:17:26.911824] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-29T21:17:27.008742] [DEBUG] [LOCAL ] ST: Primary data saved (49729 records). [2025-09-29T21:17:27.008914] [INFO ] [MAIN ] ST: Full history saved. [2025-09-29T21:17:27.009018] [INFO ] [MAIN ] Update Progress: 2004/2371 symbols completed. ST took 40.9s. Estimated remaining: 47m 8s. Rate: 7.8 symbols/min [2025-09-29T21:17:27.172916] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-29T21:17:27.213120] [INFO ] [MAIN ] STEW: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:17:27.233971] [DEBUG] [LOCAL ] STEW: Loaded 16354 existing records from primary storage. [2025-09-29T21:17:27.234270] [INFO ] [MAIN ] STEW: Loaded 16354 existing records. [2025-09-29T21:17:27.424952] [WARN ] [MAIN ] STEW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:17:27.425202] [INFO ] [MAIN ] STEW: Wiping existing primary data before full refresh. [2025-09-29T21:17:27.425251] [INFO ] [LOCAL ] STEW: Starting deletion of primary data. [2025-09-29T21:17:27.425522] [DEBUG] [LOCAL ] STEW: Deleted primary data file. [2025-09-29T21:17:27.425583] [INFO ] [MAIN ] STEW: Starting full primary refresh. [2025-09-29T21:17:27.553279] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-06. [2025-09-29T21:17:27.822325] [INFO ] [REMOTE ] STEW: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:17:28.348114] [INFO ] [REMOTE ] STEW: Fetching primary data for 2024-12. [2025-09-29T21:17:28.838569] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-29T21:17:28.945448] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-09-29T21:17:29.148128] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-02. [2025-09-29T21:17:29.351904] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-29T21:17:29.948171] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-01. [2025-09-29T21:17:30.748103] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-06. [2025-09-29T21:17:30.816170] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-29T21:17:31.250380] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-29T21:17:31.548168] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-02. [2025-09-29T21:17:31.635883] [DEBUG] [REMOTE ] STEW: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-09-29T21:17:31.636294] [WARN ] [REMOTE ] STEW: No data returned for month 2025-02 [2025-09-29T21:17:31.636396] [FATAL] [REMOTE ] STEW: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T21:17:31.636509] [FATAL] [MAIN ] STEW: Failed to fetch primary data. [2025-09-29T21:17:31.636581] [WARN ] [MAIN ] STEW: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T21:17:31.636691] [INFO ] [LOCAL ] STEW: Starting deletion of primary data. [2025-09-29T21:17:31.636788] [DEBUG] [LOCAL ] STEW: No primary data file found to delete. [2025-09-29T21:17:31.636847] [INFO ] [LOCAL ] STEW: Starting deletion of derivative data. [2025-09-29T21:17:31.637422] [DEBUG] [LOCAL ] STEW: Deleted derivative data file. [2025-09-29T21:17:31.637556] [INFO ] [MAIN ] Update Progress: 2005/2371 symbols completed. STEW took 4.6s. Estimated remaining: 47m 0s. Rate: 7.8 symbols/min [2025-09-29T21:17:31.824101] [INFO ] [MAIN ] STG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:17:31.824411] [DEBUG] [LOCAL ] STG: No existing data file found in primary storage. [2025-09-29T21:17:31.824469] [WARN ] [MAIN ] STG: No existing data found, performing full refresh instead. [2025-09-29T21:17:31.824590] [INFO ] [MAIN ] STG: Wiping existing primary data before full refresh. [2025-09-29T21:17:31.824634] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-09-29T21:17:31.824915] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-09-29T21:17:31.824955] [INFO ] [MAIN ] STG: Starting full primary refresh. [2025-09-29T21:17:32.136174] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-29T21:17:32.224751] [INFO ] [REMOTE ] STG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:17:32.348118] [INFO ] [REMOTE ] STG: Fetching primary data for 2024-12. [2025-09-29T21:17:33.038316] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-29T21:17:33.148140] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-07. [2025-09-29T21:17:33.948115] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-07. [2025-09-29T21:17:34.754880] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-01. [2025-09-29T21:17:34.759457] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-29T21:17:35.138612] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-29T21:17:35.285919] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-29T21:17:35.548123] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-02. [2025-09-29T21:17:35.902319] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-29T21:17:36.348129] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-08. [2025-09-29T21:17:37.148103] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-08. [2025-09-29T21:17:37.881091] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-29T21:17:37.948079] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-03. [2025-09-29T21:17:38.207487] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-09-29T21:17:38.304159] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-29T21:17:38.748123] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-03. [2025-09-29T21:17:39.548156] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-09. [2025-09-29T21:17:40.348186] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-09. [2025-09-29T21:17:40.679353] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-29T21:17:40.685470] [INFO ] [REMOTE ] STEL: Full fetch complete (32211 records). [2025-09-29T21:17:40.685762] [DEBUG] [VALIDATOR ] STEL: Validating primary data. [2025-09-29T21:17:41.148725] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-04. [2025-09-29T21:17:41.244015] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-03 (2.50 seconds). [2025-09-29T21:17:41.323520] [DEBUG] [VALIDATOR ] STEL: All expected trading days are present. [2025-09-29T21:17:41.323639] [DEBUG] [VALIDATOR ] STEL: Primary data validation passed. [2025-09-29T21:17:41.325143] [INFO ] [MAIN ] STEL: Fetched primary data is valid. [2025-09-29T21:17:41.325223] [DEBUG] [LOCAL ] STEL: Saving primary data. [2025-09-29T21:17:41.326329] [DEBUG] [LOCAL ] STEL: Trimmed 32211 records to 23292 (keeping 200 days of data) [2025-09-29T21:17:41.491858] [DEBUG] [LOCAL ] STEL: Primary data saved (23292 records). [2025-09-29T21:17:41.492016] [INFO ] [MAIN ] STEL: Full history saved. [2025-09-29T21:17:41.492136] [INFO ] [MAIN ] Update Progress: 2006/2371 symbols completed. STEL took 26.6s. Estimated remaining: 46m 53s. Rate: 7.8 symbols/min [2025-09-29T21:17:41.563068] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-29T21:17:41.716065] [INFO ] [MAIN ] STK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:17:41.728157] [DEBUG] [LOCAL ] STK: Loaded 9550 existing records from primary storage. [2025-09-29T21:17:41.728431] [INFO ] [MAIN ] STK: Loaded 9550 existing records. [2025-09-29T21:17:41.943550] [WARN ] [MAIN ] STK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:17:41.945556] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-29T21:17:41.945782] [INFO ] [MAIN ] STK: Wiping existing primary data before full refresh. [2025-09-29T21:17:41.945891] [INFO ] [LOCAL ] STK: Starting deletion of primary data. [2025-09-29T21:17:41.953161] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-05. [2025-09-29T21:17:41.954945] [INFO ] [REMOTE ] STE: Full fetch complete (50606 records). [2025-09-29T21:17:41.955041] [DEBUG] [VALIDATOR ] STE: Validating primary data. [2025-09-29T21:17:41.955226] [DEBUG] [LOCAL ] STK: Deleted primary data file. [2025-09-29T21:17:41.955396] [INFO ] [MAIN ] STK: Starting full primary refresh. [2025-09-29T21:17:42.473037] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-29T21:17:42.752886] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-06. [2025-09-29T21:17:42.808358] [DEBUG] [VALIDATOR ] STE: All expected trading days are present. [2025-09-29T21:17:42.816301] [INFO ] [REMOTE ] STK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:17:42.816544] [DEBUG] [VALIDATOR ] STE: Primary data validation passed. [2025-09-29T21:17:42.818236] [INFO ] [MAIN ] STE: Fetched primary data is valid. [2025-09-29T21:17:42.818318] [DEBUG] [LOCAL ] STE: Saving primary data. [2025-09-29T21:17:42.819419] [DEBUG] [LOCAL ] STE: Trimmed 50606 records to 35218 (keeping 200 days of data) [2025-09-29T21:17:43.034119] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-09-29T21:17:43.063723] [DEBUG] [LOCAL ] STE: Primary data saved (35218 records). [2025-09-29T21:17:43.063871] [INFO ] [MAIN ] STE: Full history saved. [2025-09-29T21:17:43.063970] [INFO ] [MAIN ] Update Progress: 2007/2371 symbols completed. STE took 38.8s. Estimated remaining: 46m 44s. Rate: 7.8 symbols/min [2025-09-29T21:17:43.245876] [INFO ] [MAIN ] STLA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:17:43.296508] [DEBUG] [LOCAL ] STLA: Loaded 54322 existing records from primary storage. [2025-09-29T21:17:43.297032] [INFO ] [MAIN ] STLA: Loaded 54322 existing records. [2025-09-29T21:17:43.479601] [WARN ] [MAIN ] STLA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:17:43.479913] [INFO ] [MAIN ] STLA: Wiping existing primary data before full refresh. [2025-09-29T21:17:43.479969] [INFO ] [LOCAL ] STLA: Starting deletion of primary data. [2025-09-29T21:17:43.480577] [DEBUG] [LOCAL ] STLA: Deleted primary data file. [2025-09-29T21:17:43.480675] [INFO ] [MAIN ] STLA: Starting full primary refresh. [2025-09-29T21:17:43.553213] [INFO ] [REMOTE ] STK: Fetching primary data for 2024-12. [2025-09-29T21:17:43.870975] [INFO ] [REMOTE ] STLA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:17:44.348109] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-04. [2025-09-29T21:17:44.513592] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-29T21:17:45.148116] [INFO ] [REMOTE ] STLA: Fetching primary data for 2024-12. [2025-09-29T21:17:45.948121] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-07. [2025-09-29T21:17:46.543785] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-29T21:17:46.561740] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-29T21:17:46.748129] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-01. [2025-09-29T21:17:47.475390] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-09-29T21:17:47.548121] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-08. [2025-09-29T21:17:47.654463] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-29T21:17:47.981872] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-29T21:17:48.348119] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-02. [2025-09-29T21:17:49.148127] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-05. [2025-09-29T21:17:49.264484] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-29T21:17:49.948110] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-01. [2025-09-29T21:17:50.748095] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-09. [2025-09-29T21:17:51.033692] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-09-29T21:17:51.034617] [INFO ] [REMOTE ] STG: Full fetch complete (2484 records). [2025-09-29T21:17:51.034727] [DEBUG] [VALIDATOR ] STG: Validating primary data. [2025-09-29T21:17:51.035126] [FATAL] [VALIDATOR ] STG: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T21:17:51.035213] [FATAL] [MAIN ] STG: Fetched primary data is invalid. Refusing to save it. [2025-09-29T21:17:51.035257] [WARN ] [MAIN ] STG: Deleting existing primary and derivative data due to validation failure. [2025-09-29T21:17:51.035296] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-09-29T21:17:51.035352] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-09-29T21:17:51.035400] [INFO ] [LOCAL ] STG: Starting deletion of derivative data. [2025-09-29T21:17:51.035469] [DEBUG] [LOCAL ] STG: No derivative data file found to delete. [2025-09-29T21:17:51.035526] [INFO ] [MAIN ] Update Progress: 2008/2371 symbols completed. STG took 19.4s. Estimated remaining: 46m 36s. Rate: 7.8 symbols/min [2025-09-29T21:17:51.232492] [INFO ] [MAIN ] STM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:17:51.261420] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-29T21:17:51.326969] [DEBUG] [LOCAL ] STM: Loaded 54362 existing records from primary storage. [2025-09-29T21:17:51.327353] [INFO ] [MAIN ] STM: Loaded 54362 existing records. [2025-09-29T21:17:51.512848] [WARN ] [MAIN ] STM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:17:51.513183] [INFO ] [MAIN ] STM: Wiping existing primary data before full refresh. [2025-09-29T21:17:51.513243] [INFO ] [LOCAL ] STM: Starting deletion of primary data. [2025-09-29T21:17:51.513747] [DEBUG] [LOCAL ] STM: Deleted primary data file. [2025-09-29T21:17:51.513816] [INFO ] [MAIN ] STM: Starting full primary refresh. [2025-09-29T21:17:51.553352] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-06. [2025-09-29T21:17:51.909522] [INFO ] [REMOTE ] STM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:17:52.173806] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-09-29T21:17:52.348118] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-02. [2025-09-29T21:17:53.148168] [INFO ] [REMOTE ] STM: Fetching primary data for 2024-12. [2025-09-29T21:17:53.537741] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-29T21:17:53.948384] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-03. [2025-09-29T21:17:54.657968] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-09-29T21:17:54.748098] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-03. [2025-09-29T21:17:54.890113] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-29T21:17:55.193737] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-29T21:17:55.548099] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-04. [2025-09-29T21:17:56.348116] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-07. [2025-09-29T21:17:56.458361] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-29T21:17:57.094027] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-09-29T21:17:57.148084] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-05. [2025-09-29T21:17:57.702953] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-29T21:17:57.948115] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-01. [2025-09-29T21:17:58.110508] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-29T21:17:58.748119] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-08. [2025-09-29T21:17:59.548101] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-04. [2025-09-29T21:18:00.127307] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-29T21:18:00.215345] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-29T21:18:00.348123] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-02. [2025-09-29T21:18:01.148123] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-06. [2025-09-29T21:18:01.938614] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-29T21:18:01.948061] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-07. [2025-09-29T21:18:02.014305] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-09-29T21:18:02.099591] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-29T21:18:02.748103] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-03. [2025-09-29T21:18:02.866516] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-29T21:18:03.548135] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-05. [2025-09-29T21:18:04.348318] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-09. [2025-09-29T21:18:05.136896] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-09-29T21:18:05.148229] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-08. [2025-09-29T21:18:05.581766] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-29T21:18:05.589062] [INFO ] [REMOTE ] STEM: Full fetch complete (62429 records). [2025-09-29T21:18:05.589318] [DEBUG] [VALIDATOR ] STEM: Validating primary data. [2025-09-29T21:18:05.956316] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-04. [2025-09-29T21:18:06.025663] [DEBUG] [VALIDATOR ] STEM: All expected trading days are present. [2025-09-29T21:18:06.025824] [DEBUG] [VALIDATOR ] STEM: Primary data validation passed. [2025-09-29T21:18:06.027104] [INFO ] [MAIN ] STEM: Fetched primary data is valid. [2025-09-29T21:18:06.028064] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-29T21:18:06.031309] [DEBUG] [LOCAL ] STEM: Saving primary data. [2025-09-29T21:18:06.049459] [DEBUG] [LOCAL ] STEM: Trimmed 62429 records to 39510 (keeping 200 days of data) [2025-09-29T21:18:06.067150] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-09-29T21:18:06.315581] [DEBUG] [LOCAL ] STEM: Primary data saved (39510 records). [2025-09-29T21:18:06.315764] [INFO ] [MAIN ] STEM: Full history saved. [2025-09-29T21:18:06.315879] [INFO ] [MAIN ] Update Progress: 2009/2371 symbols completed. STEM took 48.3s. Estimated remaining: 46m 30s. Rate: 7.8 symbols/min [2025-09-29T21:18:06.490255] [INFO ] [MAIN ] STN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:18:06.513849] [DEBUG] [LOCAL ] STN: Loaded 23436 existing records from primary storage. [2025-09-29T21:18:06.514150] [INFO ] [MAIN ] STN: Loaded 23436 existing records. [2025-09-29T21:18:06.714371] [WARN ] [MAIN ] STN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:18:06.714608] [INFO ] [MAIN ] STN: Wiping existing primary data before full refresh. [2025-09-29T21:18:06.714685] [INFO ] [LOCAL ] STN: Starting deletion of primary data. [2025-09-29T21:18:06.714977] [DEBUG] [LOCAL ] STN: Deleted primary data file. [2025-09-29T21:18:06.715037] [INFO ] [MAIN ] STN: Starting full primary refresh. [2025-09-29T21:18:06.756745] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-09. [2025-09-29T21:18:07.078600] [INFO ] [REMOTE ] STN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:18:07.470485] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-29T21:18:07.473274] [INFO ] [REMOTE ] STK: Full fetch complete (14067 records). [2025-09-29T21:18:07.473355] [DEBUG] [VALIDATOR ] STK: Validating primary data. [2025-09-29T21:18:07.553295] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-06. [2025-09-29T21:18:07.858025] [DEBUG] [VALIDATOR ] STK: All expected trading days are present. [2025-09-29T21:18:07.858130] [DEBUG] [VALIDATOR ] STK: Primary data validation passed. [2025-09-29T21:18:07.858565] [INFO ] [MAIN ] STK: Fetched primary data is valid. [2025-09-29T21:18:07.858683] [DEBUG] [LOCAL ] STK: Saving primary data. [2025-09-29T21:18:07.859502] [DEBUG] [LOCAL ] STK: Trimmed 14067 records to 9304 (keeping 200 days of data) [2025-09-29T21:18:07.953631] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-29T21:18:07.970204] [DEBUG] [LOCAL ] STK: Primary data saved (9304 records). [2025-09-29T21:18:07.970361] [INFO ] [MAIN ] STK: Full history saved. [2025-09-29T21:18:07.970464] [INFO ] [MAIN ] Update Progress: 2010/2371 symbols completed. STK took 26.5s. Estimated remaining: 46m 21s. Rate: 7.8 symbols/min [2025-09-29T21:18:08.144176] [INFO ] [MAIN ] STNG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:18:08.189630] [DEBUG] [LOCAL ] STNG: Loaded 44620 existing records from primary storage. [2025-09-29T21:18:08.189992] [INFO ] [MAIN ] STNG: Loaded 44620 existing records. [2025-09-29T21:18:08.352377] [INFO ] [REMOTE ] STN: Fetching primary data for 2024-12. [2025-09-29T21:18:08.385750] [WARN ] [MAIN ] STNG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:18:08.386358] [INFO ] [MAIN ] STNG: Wiping existing primary data before full refresh. [2025-09-29T21:18:08.386442] [INFO ] [LOCAL ] STNG: Starting deletion of primary data. [2025-09-29T21:18:08.387101] [DEBUG] [LOCAL ] STNG: Deleted primary data file. [2025-09-29T21:18:08.387169] [INFO ] [MAIN ] STNG: Starting full primary refresh. [2025-09-29T21:18:08.790359] [INFO ] [REMOTE ] STNG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:18:09.148113] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-05. [2025-09-29T21:18:09.413668] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-29T21:18:09.596693] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-29T21:18:09.948153] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-01. [2025-09-29T21:18:10.748159] [INFO ] [REMOTE ] STNG: Fetching primary data for 2024-12. [2025-09-29T21:18:11.204587] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-29T21:18:11.369700] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-29T21:18:11.548112] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-06. [2025-09-29T21:18:12.231166] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-29T21:18:12.348154] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-02. [2025-09-29T21:18:13.148098] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-01. [2025-09-29T21:18:13.521362] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-29T21:18:13.547559] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-29T21:18:13.948128] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-07. [2025-09-29T21:18:14.748086] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-07. [2025-09-29T21:18:14.821757] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-29T21:18:15.548114] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-02. [2025-09-29T21:18:16.041109] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-29T21:18:16.348119] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-08. [2025-09-29T21:18:16.922727] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-29T21:18:17.148102] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-03. [2025-09-29T21:18:17.288702] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-09-29T21:18:17.948133] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-03. [2025-09-29T21:18:18.529242] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-29T21:18:18.748096] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-08. [2025-09-29T21:18:18.844593] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-29T21:18:19.132460] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-29T21:18:19.548160] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-04. [2025-09-29T21:18:20.348155] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-09. [2025-09-29T21:18:20.458784] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-29T21:18:20.870727] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-29T21:18:21.148132] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-04. [2025-09-29T21:18:21.948138] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-09. [2025-09-29T21:18:22.397401] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-29T21:18:22.412454] [INFO ] [REMOTE ] STM: Full fetch complete (77526 records). [2025-09-29T21:18:22.412635] [DEBUG] [VALIDATOR ] STM: Validating primary data. [2025-09-29T21:18:22.753619] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-05. [2025-09-29T21:18:22.878839] [DEBUG] [VALIDATOR ] STM: All expected trading days are present. [2025-09-29T21:18:22.878956] [DEBUG] [VALIDATOR ] STM: Primary data validation passed. [2025-09-29T21:18:22.880613] [INFO ] [MAIN ] STM: Fetched primary data is valid. [2025-09-29T21:18:22.880792] [DEBUG] [LOCAL ] STM: Saving primary data. [2025-09-29T21:18:22.882728] [DEBUG] [LOCAL ] STM: Trimmed 77526 records to 53582 (keeping 200 days of data) [2025-09-29T21:18:23.003372] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-29T21:18:23.266421] [DEBUG] [LOCAL ] STM: Primary data saved (53582 records). [2025-09-29T21:18:23.266574] [INFO ] [MAIN ] STM: Full history saved. [2025-09-29T21:18:23.266680] [INFO ] [MAIN ] Update Progress: 2011/2371 symbols completed. STM took 32.2s. Estimated remaining: 46m 15s. Rate: 7.8 symbols/min [2025-09-29T21:18:23.446040] [INFO ] [MAIN ] STRV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:18:23.459742] [DEBUG] [LOCAL ] STRV: Loaded 11754 existing records from primary storage. [2025-09-29T21:18:23.460044] [INFO ] [MAIN ] STRV: Loaded 11754 existing records. [2025-09-29T21:18:23.556095] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-05. [2025-09-29T21:18:23.657963] [WARN ] [MAIN ] STRV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:18:23.658292] [INFO ] [MAIN ] STRV: Wiping existing primary data before full refresh. [2025-09-29T21:18:23.658369] [INFO ] [LOCAL ] STRV: Starting deletion of primary data. [2025-09-29T21:18:23.658743] [DEBUG] [LOCAL ] STRV: Deleted primary data file. [2025-09-29T21:18:23.658809] [INFO ] [MAIN ] STRV: Starting full primary refresh. [2025-09-29T21:18:24.059027] [INFO ] [REMOTE ] STRV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:18:24.071984] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-29T21:18:24.113871] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-29T21:18:24.126544] [INFO ] [REMOTE ] STLA: Full fetch complete (77530 records). [2025-09-29T21:18:24.126797] [DEBUG] [VALIDATOR ] STLA: Validating primary data. [2025-09-29T21:18:24.354306] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-06. [2025-09-29T21:18:24.579524] [DEBUG] [VALIDATOR ] STLA: All expected trading days are present. [2025-09-29T21:18:24.579707] [DEBUG] [VALIDATOR ] STLA: Primary data validation passed. [2025-09-29T21:18:24.580941] [INFO ] [MAIN ] STLA: Fetched primary data is valid. [2025-09-29T21:18:24.581023] [DEBUG] [LOCAL ] STLA: Saving primary data. [2025-09-29T21:18:24.582865] [DEBUG] [LOCAL ] STLA: Trimmed 77530 records to 53542 (keeping 200 days of data) [2025-09-29T21:18:24.919564] [DEBUG] [LOCAL ] STLA: Primary data saved (53542 records). [2025-09-29T21:18:24.919759] [INFO ] [MAIN ] STLA: Full history saved. [2025-09-29T21:18:24.919855] [INFO ] [MAIN ] Update Progress: 2012/2371 symbols completed. STLA took 41.9s. Estimated remaining: 46m 6s. Rate: 7.8 symbols/min [2025-09-29T21:18:25.117830] [INFO ] [MAIN ] STT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:18:25.153601] [INFO ] [REMOTE ] STRV: Fetching primary data for 2024-12. [2025-09-29T21:18:25.178170] [DEBUG] [LOCAL ] STT: Loaded 51793 existing records from primary storage. [2025-09-29T21:18:25.178848] [INFO ] [MAIN ] STT: Loaded 51793 existing records. [2025-09-29T21:18:25.382907] [WARN ] [MAIN ] STT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:18:25.404515] [INFO ] [MAIN ] STT: Wiping existing primary data before full refresh. [2025-09-29T21:18:25.407681] [INFO ] [LOCAL ] STT: Starting deletion of primary data. [2025-09-29T21:18:25.409205] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-29T21:18:25.417750] [DEBUG] [LOCAL ] STT: Deleted primary data file. [2025-09-29T21:18:25.423984] [INFO ] [MAIN ] STT: Starting full primary refresh. [2025-09-29T21:18:25.437998] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-29T21:18:25.823789] [INFO ] [REMOTE ] STT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:18:25.948114] [INFO ] [REMOTE ] STT: Fetching primary data for 2024-12. [2025-09-29T21:18:26.297990] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-29T21:18:26.748151] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-01. [2025-09-29T21:18:27.548092] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-06. [2025-09-29T21:18:27.827035] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-29T21:18:27.900338] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-29T21:18:28.348147] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-02. [2025-09-29T21:18:29.153009] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-01. [2025-09-29T21:18:29.158795] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-29T21:18:29.303493] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-29T21:18:29.948125] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-07. [2025-09-29T21:18:30.748077] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-07. [2025-09-29T21:18:30.939205] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-29T21:18:31.548097] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-02. [2025-09-29T21:18:31.797796] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-29T21:18:32.020764] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-29T21:18:32.348119] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-08. [2025-09-29T21:18:33.036596] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-29T21:18:33.148381] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-08. [2025-09-29T21:18:33.644378] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-29T21:18:33.948183] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-03. [2025-09-29T21:18:34.748088] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-03. [2025-09-29T21:18:34.798202] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-29T21:18:35.553232] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-09. [2025-09-29T21:18:35.568733] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-29T21:18:35.849665] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-29T21:18:36.348139] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-04. [2025-09-29T21:18:36.448254] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-29T21:18:36.454146] [INFO ] [REMOTE ] STN: Full fetch complete (32404 records). [2025-09-29T21:18:36.454258] [DEBUG] [VALIDATOR ] STN: Validating primary data. [2025-09-29T21:18:36.851833] [DEBUG] [VALIDATOR ] STN: All expected trading days are present. [2025-09-29T21:18:36.851918] [DEBUG] [VALIDATOR ] STN: Primary data validation passed. [2025-09-29T21:18:36.852631] [INFO ] [MAIN ] STN: Fetched primary data is valid. [2025-09-29T21:18:36.852740] [DEBUG] [LOCAL ] STN: Saving primary data. [2025-09-29T21:18:36.853611] [DEBUG] [LOCAL ] STN: Trimmed 32404 records to 22940 (keeping 200 days of data) [2025-09-29T21:18:36.996689] [DEBUG] [LOCAL ] STN: Primary data saved (22940 records). [2025-09-29T21:18:36.996830] [INFO ] [MAIN ] STN: Full history saved. [2025-09-29T21:18:36.996914] [INFO ] [MAIN ] Update Progress: 2013/2371 symbols completed. STN took 30.7s. Estimated remaining: 45m 59s. Rate: 7.8 symbols/min [2025-09-29T21:18:37.163691] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-04. [2025-09-29T21:18:37.186928] [INFO ] [MAIN ] STUB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:18:37.187192] [DEBUG] [LOCAL ] STUB: No existing data file found in primary storage. [2025-09-29T21:18:37.187248] [WARN ] [MAIN ] STUB: No existing data found, performing full refresh instead. [2025-09-29T21:18:37.187360] [INFO ] [MAIN ] STUB: Wiping existing primary data before full refresh. [2025-09-29T21:18:37.187401] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-09-29T21:18:37.187442] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-09-29T21:18:37.187485] [INFO ] [MAIN ] STUB: Starting full primary refresh. [2025-09-29T21:18:37.568726] [INFO ] [REMOTE ] STUB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:18:37.585142] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-29T21:18:37.948119] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-05. [2025-09-29T21:18:38.748082] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-09. [2025-09-29T21:18:38.841106] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-29T21:18:39.248361] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-29T21:18:39.548103] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-05. [2025-09-29T21:18:40.348092] [INFO ] [REMOTE ] STUB: Fetching primary data for 2024-12. [2025-09-29T21:18:40.440622] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-29T21:18:40.449825] [INFO ] [REMOTE ] STNG: Full fetch complete (64394 records). [2025-09-29T21:18:40.449988] [DEBUG] [VALIDATOR ] STNG: Validating primary data. [2025-09-29T21:18:40.859982] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T21:18:40.863704] [DEBUG] [VALIDATOR ] STNG: All expected trading days are present. [2025-09-29T21:18:40.863879] [WARN ] [REMOTE ] STUB: No data returned for month 2024-12 [2025-09-29T21:18:40.864041] [DEBUG] [VALIDATOR ] STNG: Primary data validation passed. [2025-09-29T21:18:40.864138] [FATAL] [REMOTE ] STUB: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T21:18:40.865369] [INFO ] [MAIN ] STNG: Fetched primary data is valid. [2025-09-29T21:18:40.865471] [DEBUG] [LOCAL ] STNG: Saving primary data. [2025-09-29T21:18:40.865569] [FATAL] [MAIN ] STUB: Failed to fetch primary data. [2025-09-29T21:18:40.865896] [WARN ] [MAIN ] STUB: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T21:18:40.865990] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-09-29T21:18:40.866064] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-09-29T21:18:40.866114] [INFO ] [LOCAL ] STUB: Starting deletion of derivative data. [2025-09-29T21:18:40.866525] [DEBUG] [LOCAL ] STUB: No derivative data file found to delete. [2025-09-29T21:18:40.866741] [INFO ] [MAIN ] Update Progress: 2014/2371 symbols completed. STUB took 3.9s. Estimated remaining: 45m 51s. Rate: 7.8 symbols/min [2025-09-29T21:18:40.955543] [DEBUG] [LOCAL ] STNG: Trimmed 64394 records to 43903 (keeping 200 days of data) [2025-09-29T21:18:41.157318] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-06. [2025-09-29T21:18:41.164458] [INFO ] [MAIN ] STVN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:18:41.219972] [DEBUG] [LOCAL ] STVN: Loaded 26677 existing records from primary storage. [2025-09-29T21:18:41.226679] [INFO ] [MAIN ] STVN: Loaded 26677 existing records. [2025-09-29T21:18:41.549339] [WARN ] [MAIN ] STVN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:18:41.551402] [INFO ] [MAIN ] STVN: Wiping existing primary data before full refresh. [2025-09-29T21:18:41.551841] [INFO ] [LOCAL ] STVN: Starting deletion of primary data. [2025-09-29T21:18:41.553070] [DEBUG] [LOCAL ] STVN: Deleted primary data file. [2025-09-29T21:18:41.553438] [INFO ] [MAIN ] STVN: Starting full primary refresh. [2025-09-29T21:18:41.763005] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-29T21:18:41.948477] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-06. [2025-09-29T21:18:41.967892] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-29T21:18:41.977061] [DEBUG] [LOCAL ] STNG: Primary data saved (43903 records). [2025-09-29T21:18:41.980885] [INFO ] [MAIN ] STNG: Full history saved. [2025-09-29T21:18:41.981365] [INFO ] [MAIN ] Update Progress: 2015/2371 symbols completed. STNG took 34.0s. Estimated remaining: 45m 42s. Rate: 7.8 symbols/min [2025-09-29T21:18:42.176934] [INFO ] [REMOTE ] STVN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:18:42.255597] [INFO ] [MAIN ] STWD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:18:42.312234] [DEBUG] [LOCAL ] STWD: Loaded 52643 existing records from primary storage. [2025-09-29T21:18:42.312597] [INFO ] [MAIN ] STWD: Loaded 52643 existing records. [2025-09-29T21:18:42.506251] [WARN ] [MAIN ] STWD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:18:42.506494] [INFO ] [MAIN ] STWD: Wiping existing primary data before full refresh. [2025-09-29T21:18:42.506543] [INFO ] [LOCAL ] STWD: Starting deletion of primary data. [2025-09-29T21:18:42.507063] [DEBUG] [LOCAL ] STWD: Deleted primary data file. [2025-09-29T21:18:42.512804] [INFO ] [MAIN ] STWD: Starting full primary refresh. [2025-09-29T21:18:42.753422] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-07. [2025-09-29T21:18:42.914041] [INFO ] [REMOTE ] STWD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:18:43.439006] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-29T21:18:43.439820] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-29T21:18:43.548103] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-07. [2025-09-29T21:18:44.348122] [INFO ] [REMOTE ] STWD: Fetching primary data for 2024-12. [2025-09-29T21:18:45.148094] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-08. [2025-09-29T21:18:45.575767] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-29T21:18:45.948128] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-08. [2025-09-29T21:18:45.978753] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-29T21:18:46.193106] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-29T21:18:46.748104] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-01. [2025-09-29T21:18:46.848079] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-29T21:18:47.548108] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-09. [2025-09-29T21:18:48.348122] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-09. [2025-09-29T21:18:49.148170] [INFO ] [REMOTE ] STVN: Fetching primary data for 2024-12. [2025-09-29T21:18:49.861006] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-29T21:18:49.863542] [INFO ] [REMOTE ] STRV: Full fetch complete (18306 records). [2025-09-29T21:18:49.863625] [DEBUG] [VALIDATOR ] STRV: Validating primary data. [2025-09-29T21:18:50.260595] [DEBUG] [VALIDATOR ] STRV: All expected trading days are present. [2025-09-29T21:18:50.260871] [DEBUG] [VALIDATOR ] STRV: Primary data validation passed. [2025-09-29T21:18:50.261597] [INFO ] [MAIN ] STRV: Fetched primary data is valid. [2025-09-29T21:18:50.261717] [DEBUG] [LOCAL ] STRV: Saving primary data. [2025-09-29T21:18:50.286225] [DEBUG] [LOCAL ] STRV: Trimmed 18306 records to 11439 (keeping 200 days of data) [2025-09-29T21:18:50.292218] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-29T21:18:50.391545] [INFO ] [REMOTE ] STT: Full fetch complete (74111 records). [2025-09-29T21:18:50.394352] [DEBUG] [VALIDATOR ] STT: Validating primary data. [2025-09-29T21:18:50.393878] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-01 (3.65 seconds). [2025-09-29T21:18:50.408286] [FATAL] [VALIDATOR ] STT: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T21:18:50.409472] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-02. [2025-09-29T21:18:50.410841] [FATAL] [MAIN ] STT: Fetched primary data is invalid. Refusing to save it. [2025-09-29T21:18:50.412904] [WARN ] [MAIN ] STT: Deleting existing primary and derivative data due to validation failure. [2025-09-29T21:18:50.414262] [INFO ] [LOCAL ] STT: Starting deletion of primary data. [2025-09-29T21:18:50.414983] [DEBUG] [LOCAL ] STT: No primary data file found to delete. [2025-09-29T21:18:50.415712] [INFO ] [LOCAL ] STT: Starting deletion of derivative data. [2025-09-29T21:18:50.417126] [DEBUG] [LOCAL ] STT: Deleted derivative data file. [2025-09-29T21:18:50.417597] [INFO ] [MAIN ] Update Progress: 2016/2371 symbols completed. STT took 25.5s. Estimated remaining: 45m 34s. Rate: 7.8 symbols/min [2025-09-29T21:18:50.537994] [DEBUG] [LOCAL ] STRV: Primary data saved (11439 records). [2025-09-29T21:18:50.552026] [INFO ] [MAIN ] STRV: Full history saved. [2025-09-29T21:18:50.552196] [INFO ] [MAIN ] Update Progress: 2017/2371 symbols completed. STRV took 27.3s. Estimated remaining: 45m 25s. Rate: 7.8 symbols/min [2025-09-29T21:18:50.739705] [INFO ] [MAIN ] STXD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:18:50.800281] [DEBUG] [LOCAL ] STXD: Loaded 1341 existing records from primary storage. [2025-09-29T21:18:50.832146] [INFO ] [MAIN ] STXD: Loaded 1341 existing records. [2025-09-29T21:18:50.859187] [INFO ] [MAIN ] STXE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:18:50.978544] [DEBUG] [LOCAL ] STXE: Loaded 2234 existing records from primary storage. [2025-09-29T21:18:50.989275] [INFO ] [MAIN ] STXE: Loaded 2234 existing records. [2025-09-29T21:18:51.121420] [WARN ] [MAIN ] STXD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:18:51.153385] [INFO ] [MAIN ] STXD: Wiping existing primary data before full refresh. [2025-09-29T21:18:51.160300] [INFO ] [LOCAL ] STXD: Starting deletion of primary data. [2025-09-29T21:18:51.172625] [DEBUG] [LOCAL ] STXD: Deleted primary data file. [2025-09-29T21:18:51.172881] [INFO ] [MAIN ] STXD: Starting full primary refresh. [2025-09-29T21:18:51.349418] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-09-29T21:18:51.376378] [WARN ] [MAIN ] STXE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:18:51.406762] [INFO ] [MAIN ] STXE: Wiping existing primary data before full refresh. [2025-09-29T21:18:51.406666] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-01. [2025-09-29T21:18:51.418955] [INFO ] [LOCAL ] STXE: Starting deletion of primary data. [2025-09-29T21:18:51.424445] [DEBUG] [LOCAL ] STXE: Deleted primary data file. [2025-09-29T21:18:51.429838] [INFO ] [MAIN ] STXE: Starting full primary refresh. [2025-09-29T21:18:51.977633] [INFO ] [REMOTE ] STXD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:18:52.019287] [INFO ] [REMOTE ] STXD: Fetching primary data for 2024-12. [2025-09-29T21:18:52.117883] [INFO ] [REMOTE ] STXE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:18:52.294194] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-29T21:18:52.348138] [INFO ] [REMOTE ] STXE: Fetching primary data for 2024-12. [2025-09-29T21:18:52.387664] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-29T21:18:52.774916] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-29T21:18:53.107967] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-29T21:18:53.148102] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-01. [2025-09-29T21:18:53.631200] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-29T21:18:53.948107] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-02. [2025-09-29T21:18:54.399015] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-29T21:18:54.748117] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-03. [2025-09-29T21:18:55.548097] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-02. [2025-09-29T21:18:56.348181] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-03. [2025-09-29T21:18:56.428327] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-29T21:18:56.600595] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-29T21:18:56.985285] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-29T21:18:57.148113] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-03. [2025-09-29T21:18:57.948128] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-04. [2025-09-29T21:18:58.748117] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-01. [2025-09-29T21:18:58.959302] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-29T21:18:59.548132] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-04. [2025-09-29T21:19:00.347851] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-29T21:19:00.349593] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-05. [2025-09-29T21:19:00.514101] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-29T21:19:00.817436] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-29T21:19:00.886052] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-04 (2.94 seconds). [2025-09-29T21:19:01.148177] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-04. [2025-09-29T21:19:01.948117] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-02. [2025-09-29T21:19:02.119907] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-29T21:19:02.748160] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-05. [2025-09-29T21:19:02.917544] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-29T21:19:03.548113] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-03. [2025-09-29T21:19:03.790683] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-29T21:19:04.067994] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-29T21:19:04.348155] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-06. [2025-09-29T21:19:05.148181] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-05. [2025-09-29T21:19:05.579095] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-29T21:19:05.948138] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-07. [2025-09-29T21:19:06.748113] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-06. [2025-09-29T21:19:06.915631] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-29T21:19:06.948469] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-29T21:19:07.269315] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-29T21:19:07.548107] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-07. [2025-09-29T21:19:07.928715] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-29T21:19:08.348148] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-04. [2025-09-29T21:19:08.890303] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-29T21:19:09.148163] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-05. [2025-09-29T21:19:09.784203] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-29T21:19:09.948168] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-06. [2025-09-29T21:19:10.748154] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-08. [2025-09-29T21:19:11.548148] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-06. [2025-09-29T21:19:11.938841] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-29T21:19:12.002552] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-29T21:19:12.046147] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-29T21:19:12.348114] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-07. [2025-09-29T21:19:13.148124] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-07. [2025-09-29T21:19:13.610934] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-29T21:19:13.948102] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-08. [2025-09-29T21:19:14.206697] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-29T21:19:14.502673] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-29T21:19:14.748147] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-08. [2025-09-29T21:19:15.548103] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-09. [2025-09-29T21:19:15.948466] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-29T21:19:15.949692] [INFO ] [REMOTE ] STXE: Full fetch complete (3703 records). [2025-09-29T21:19:15.949785] [DEBUG] [VALIDATOR ] STXE: Validating primary data. [2025-09-29T21:19:16.342637] [DEBUG] [VALIDATOR ] STXE: All expected trading days are present. [2025-09-29T21:19:16.342755] [DEBUG] [VALIDATOR ] STXE: Primary data validation passed. [2025-09-29T21:19:16.342933] [INFO ] [MAIN ] STXE: Fetched primary data is valid. [2025-09-29T21:19:16.342975] [DEBUG] [LOCAL ] STXE: Saving primary data. [2025-09-29T21:19:16.343325] [DEBUG] [LOCAL ] STXE: Trimmed 3703 records to 2172 (keeping 200 days of data) [2025-09-29T21:19:16.352056] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-08. [2025-09-29T21:19:16.362041] [DEBUG] [LOCAL ] STXE: Primary data saved (2172 records). [2025-09-29T21:19:16.362121] [INFO ] [MAIN ] STXE: Full history saved. [2025-09-29T21:19:16.362277] [INFO ] [MAIN ] Update Progress: 2018/2371 symbols completed. STXE took 25.8s. Estimated remaining: 45m 21s. Rate: 7.8 symbols/min [2025-09-29T21:19:16.536187] [INFO ] [MAIN ] STXG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:19:16.573987] [DEBUG] [LOCAL ] STXG: Loaded 2612 existing records from primary storage. [2025-09-29T21:19:16.574698] [INFO ] [MAIN ] STXG: Loaded 2612 existing records. [2025-09-29T21:19:16.609998] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-29T21:19:16.777992] [WARN ] [MAIN ] STXG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:19:16.778284] [INFO ] [MAIN ] STXG: Wiping existing primary data before full refresh. [2025-09-29T21:19:16.778346] [INFO ] [LOCAL ] STXG: Starting deletion of primary data. [2025-09-29T21:19:16.778572] [DEBUG] [LOCAL ] STXG: Deleted primary data file. [2025-09-29T21:19:16.778630] [INFO ] [MAIN ] STXG: Starting full primary refresh. [2025-09-29T21:19:16.864723] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-29T21:19:17.161522] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-09. [2025-09-29T21:19:17.168266] [INFO ] [REMOTE ] STXG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:19:17.948125] [INFO ] [REMOTE ] STXG: Fetching primary data for 2024-12. [2025-09-29T21:19:18.555910] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-29T21:19:18.554763] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-29T21:19:18.564405] [INFO ] [REMOTE ] STVN: Full fetch complete (39397 records). [2025-09-29T21:19:18.564505] [DEBUG] [VALIDATOR ] STVN: Validating primary data. [2025-09-29T21:19:18.780133] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-09. [2025-09-29T21:19:18.990806] [DEBUG] [VALIDATOR ] STVN: All expected trading days are present. [2025-09-29T21:19:18.990971] [DEBUG] [VALIDATOR ] STVN: Primary data validation passed. [2025-09-29T21:19:18.991835] [INFO ] [MAIN ] STVN: Fetched primary data is valid. [2025-09-29T21:19:18.991901] [DEBUG] [LOCAL ] STVN: Saving primary data. [2025-09-29T21:19:18.992991] [DEBUG] [LOCAL ] STVN: Trimmed 39397 records to 26204 (keeping 200 days of data) [2025-09-29T21:19:19.153749] [DEBUG] [LOCAL ] STVN: Primary data saved (26204 records). [2025-09-29T21:19:19.153898] [INFO ] [MAIN ] STVN: Full history saved. [2025-09-29T21:19:19.153988] [INFO ] [MAIN ] Update Progress: 2019/2371 symbols completed. STVN took 38.3s. Estimated remaining: 45m 12s. Rate: 7.8 symbols/min [2025-09-29T21:19:19.333628] [INFO ] [MAIN ] STXK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:19:19.336826] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-29T21:19:19.338423] [INFO ] [REMOTE ] STXD: Full fetch complete (2060 records). [2025-09-29T21:19:19.338584] [DEBUG] [VALIDATOR ] STXD: Validating primary data. [2025-09-29T21:19:19.414165] [DEBUG] [LOCAL ] STXK: Loaded 1535 existing records from primary storage. [2025-09-29T21:19:19.426151] [INFO ] [MAIN ] STXK: Loaded 1535 existing records. [2025-09-29T21:19:19.549387] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-09. [2025-09-29T21:19:19.867059] [WARN ] [MAIN ] STXK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:19:19.887491] [INFO ] [MAIN ] STXK: Wiping existing primary data before full refresh. [2025-09-29T21:19:19.908467] [INFO ] [LOCAL ] STXK: Starting deletion of primary data. [2025-09-29T21:19:19.936348] [DEBUG] [VALIDATOR ] STXD: All expected trading days are present. [2025-09-29T21:19:19.936457] [DEBUG] [VALIDATOR ] STXD: Primary data validation passed. [2025-09-29T21:19:19.936590] [INFO ] [MAIN ] STXD: Fetched primary data is valid. [2025-09-29T21:19:19.936672] [DEBUG] [LOCAL ] STXD: Saving primary data. [2025-09-29T21:19:19.937406] [DEBUG] [LOCAL ] STXD: Trimmed 2060 records to 1289 (keeping 200 days of data) [2025-09-29T21:19:19.947104] [DEBUG] [LOCAL ] STXK: Deleted primary data file. [2025-09-29T21:19:19.948773] [INFO ] [MAIN ] STXK: Starting full primary refresh. [2025-09-29T21:19:20.019897] [DEBUG] [LOCAL ] STXD: Primary data saved (1289 records). [2025-09-29T21:19:20.031832] [INFO ] [MAIN ] STXD: Full history saved. [2025-09-29T21:19:20.048299] [INFO ] [MAIN ] Update Progress: 2020/2371 symbols completed. STXD took 29.6s. Estimated remaining: 45m 3s. Rate: 7.8 symbols/min [2025-09-29T21:19:20.359159] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-01. [2025-09-29T21:19:20.408818] [INFO ] [MAIN ] STXM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:19:20.438343] [DEBUG] [LOCAL ] STXM: No existing data file found in primary storage. [2025-09-29T21:19:20.438630] [WARN ] [MAIN ] STXM: No existing data found, performing full refresh instead. [2025-09-29T21:19:20.439186] [INFO ] [MAIN ] STXM: Wiping existing primary data before full refresh. [2025-09-29T21:19:20.450019] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-09-29T21:19:20.480421] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-09-29T21:19:20.502066] [INFO ] [MAIN ] STXM: Starting full primary refresh. [2025-09-29T21:19:20.525231] [INFO ] [REMOTE ] STXK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:19:20.944771] [INFO ] [REMOTE ] STXM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:19:21.100246] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-29T21:19:21.111274] [INFO ] [REMOTE ] STWD: Full fetch complete (75037 records). [2025-09-29T21:19:21.111425] [DEBUG] [VALIDATOR ] STWD: Validating primary data. [2025-09-29T21:19:21.155853] [INFO ] [REMOTE ] STXK: Fetching primary data for 2024-12. [2025-09-29T21:19:21.174437] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-29T21:19:21.527141] [DEBUG] [VALIDATOR ] STWD: All expected trading days are present. [2025-09-29T21:19:21.527231] [DEBUG] [VALIDATOR ] STWD: Primary data validation passed. [2025-09-29T21:19:21.528481] [INFO ] [MAIN ] STWD: Fetched primary data is valid. [2025-09-29T21:19:21.528549] [DEBUG] [LOCAL ] STWD: Saving primary data. [2025-09-29T21:19:21.530110] [DEBUG] [LOCAL ] STWD: Trimmed 75037 records to 51877 (keeping 200 days of data) [2025-09-29T21:19:21.860109] [DEBUG] [LOCAL ] STWD: Primary data saved (51877 records). [2025-09-29T21:19:21.860253] [INFO ] [MAIN ] STWD: Full history saved. [2025-09-29T21:19:21.860339] [INFO ] [MAIN ] Update Progress: 2021/2371 symbols completed. STWD took 39.9s. Estimated remaining: 44m 55s. Rate: 7.8 symbols/min [2025-09-29T21:19:21.947237] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-29T21:19:21.953417] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-02. [2025-09-29T21:19:22.047784] [INFO ] [MAIN ] STXT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:19:22.052481] [DEBUG] [LOCAL ] STXT: Loaded 2592 existing records from primary storage. [2025-09-29T21:19:22.052683] [INFO ] [MAIN ] STXT: Loaded 2592 existing records. [2025-09-29T21:19:22.236055] [WARN ] [MAIN ] STXT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:19:22.236242] [INFO ] [MAIN ] STXT: Wiping existing primary data before full refresh. [2025-09-29T21:19:22.236345] [INFO ] [LOCAL ] STXT: Starting deletion of primary data. [2025-09-29T21:19:22.236689] [DEBUG] [LOCAL ] STXT: Deleted primary data file. [2025-09-29T21:19:22.236748] [INFO ] [MAIN ] STXT: Starting full primary refresh. [2025-09-29T21:19:22.540845] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-29T21:19:22.625801] [INFO ] [REMOTE ] STXT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:19:22.748135] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-03. [2025-09-29T21:19:23.354486] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-29T21:19:23.548096] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-04. [2025-09-29T21:19:24.230334] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-29T21:19:24.348100] [INFO ] [REMOTE ] STXT: Fetching primary data for 2024-12. [2025-09-29T21:19:25.064115] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-29T21:19:25.148199] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-01. [2025-09-29T21:19:25.752978] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-29T21:19:25.948197] [INFO ] [REMOTE ] STXM: Fetching primary data for 2024-12. [2025-09-29T21:19:26.314619] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-09-29T21:19:26.748113] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-02. [2025-09-29T21:19:27.334235] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-29T21:19:27.548104] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-05. [2025-09-29T21:19:28.092922] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-29T21:19:28.348133] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-06. [2025-09-29T21:19:28.868566] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-29T21:19:29.148120] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-01. [2025-09-29T21:19:29.513267] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-09-29T21:19:29.948110] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-02. [2025-09-29T21:19:30.291358] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-29T21:19:30.748158] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-01. [2025-09-29T21:19:31.123245] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-29T21:19:31.548118] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-03. [2025-09-29T21:19:31.870891] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-29T21:19:32.348102] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-04. [2025-09-29T21:19:32.761133] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-29T21:19:33.148145] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-07. [2025-09-29T21:19:33.662799] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-29T21:19:33.948140] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-02. [2025-09-29T21:19:34.349420] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-29T21:19:34.748144] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-05. [2025-09-29T21:19:35.115006] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-29T21:19:35.548110] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-03. [2025-09-29T21:19:36.059703] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-29T21:19:36.348139] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-03. [2025-09-29T21:19:36.990737] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-29T21:19:37.148192] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-04. [2025-09-29T21:19:37.677319] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-29T21:19:37.948124] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-08. [2025-09-29T21:19:38.493474] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-29T21:19:38.748122] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-04. [2025-09-29T21:19:39.314074] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-29T21:19:39.548108] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-05. [2025-09-29T21:19:40.019771] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-29T21:19:40.348114] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-06. [2025-09-29T21:19:40.834635] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-29T21:19:41.148104] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-05. [2025-09-29T21:19:41.536693] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-29T21:19:41.948115] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-07. [2025-09-29T21:19:42.286138] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-29T21:19:42.748131] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-09. [2025-09-29T21:19:43.232469] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-29T21:19:43.233941] [INFO ] [REMOTE ] STXG: Full fetch complete (4168 records). [2025-09-29T21:19:43.234041] [DEBUG] [VALIDATOR ] STXG: Validating primary data. [2025-09-29T21:19:43.553173] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-06. [2025-09-29T21:19:43.616545] [DEBUG] [VALIDATOR ] STXG: All expected trading days are present. [2025-09-29T21:19:43.616627] [DEBUG] [VALIDATOR ] STXG: Primary data validation passed. [2025-09-29T21:19:43.616817] [INFO ] [MAIN ] STXG: Fetched primary data is valid. [2025-09-29T21:19:43.616867] [DEBUG] [LOCAL ] STXG: Saving primary data. [2025-09-29T21:19:43.617282] [DEBUG] [LOCAL ] STXG: Trimmed 4168 records to 2515 (keeping 200 days of data) [2025-09-29T21:19:43.636040] [DEBUG] [LOCAL ] STXG: Primary data saved (2515 records). [2025-09-29T21:19:43.636172] [INFO ] [MAIN ] STXG: Full history saved. [2025-09-29T21:19:43.636298] [INFO ] [MAIN ] Update Progress: 2022/2371 symbols completed. STXG took 27.3s. Estimated remaining: 44m 49s. Rate: 7.8 symbols/min [2025-09-29T21:19:43.797373] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-09-29T21:19:43.815560] [INFO ] [MAIN ] STXV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:19:43.820761] [DEBUG] [LOCAL ] STXV: Loaded 1648 existing records from primary storage. [2025-09-29T21:19:43.820950] [INFO ] [MAIN ] STXV: Loaded 1648 existing records. [2025-09-29T21:19:44.009167] [WARN ] [MAIN ] STXV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:19:44.009407] [INFO ] [MAIN ] STXV: Wiping existing primary data before full refresh. [2025-09-29T21:19:44.009457] [INFO ] [LOCAL ] STXV: Starting deletion of primary data. [2025-09-29T21:19:44.009685] [DEBUG] [LOCAL ] STXV: Deleted primary data file. [2025-09-29T21:19:44.009745] [INFO ] [MAIN ] STXV: Starting full primary refresh. [2025-09-29T21:19:44.353361] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-07. [2025-09-29T21:19:44.397725] [INFO ] [REMOTE ] STXV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:19:44.729947] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-29T21:19:45.148123] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-06. [2025-09-29T21:19:45.566913] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-29T21:19:45.948141] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-08. [2025-09-29T21:19:46.640495] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-29T21:19:46.748112] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-09. [2025-09-29T21:19:47.200768] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-29T21:19:47.201872] [INFO ] [REMOTE ] STXK: Full fetch complete (2413 records). [2025-09-29T21:19:47.201955] [DEBUG] [VALIDATOR ] STXK: Validating primary data. [2025-09-29T21:19:47.556547] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-07. [2025-09-29T21:19:47.608516] [DEBUG] [VALIDATOR ] STXK: All expected trading days are present. [2025-09-29T21:19:47.608634] [DEBUG] [VALIDATOR ] STXK: Primary data validation passed. [2025-09-29T21:19:47.608840] [INFO ] [MAIN ] STXK: Fetched primary data is valid. [2025-09-29T21:19:47.608916] [DEBUG] [LOCAL ] STXK: Saving primary data. [2025-09-29T21:19:47.609531] [DEBUG] [LOCAL ] STXK: Trimmed 2413 records to 1495 (keeping 200 days of data) [2025-09-29T21:19:47.626044] [DEBUG] [LOCAL ] STXK: Primary data saved (1495 records). [2025-09-29T21:19:47.626205] [INFO ] [MAIN ] STXK: Full history saved. [2025-09-29T21:19:47.626379] [INFO ] [MAIN ] Update Progress: 2023/2371 symbols completed. STXK took 28.5s. Estimated remaining: 44m 41s. Rate: 7.8 symbols/min [2025-09-29T21:19:47.820216] [INFO ] [MAIN ] STZ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:19:47.893715] [DEBUG] [LOCAL ] STZ: Loaded 53035 existing records from primary storage. [2025-09-29T21:19:47.894093] [INFO ] [MAIN ] STZ: Loaded 53035 existing records. [2025-09-29T21:19:48.091242] [WARN ] [MAIN ] STZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:19:48.091994] [INFO ] [MAIN ] STZ: Wiping existing primary data before full refresh. [2025-09-29T21:19:48.092055] [INFO ] [LOCAL ] STZ: Starting deletion of primary data. [2025-09-29T21:19:48.092572] [DEBUG] [LOCAL ] STZ: Deleted primary data file. [2025-09-29T21:19:48.092633] [INFO ] [MAIN ] STZ: Starting full primary refresh. [2025-09-29T21:19:48.358605] [INFO ] [REMOTE ] STXV: Fetching primary data for 2024-12. [2025-09-29T21:19:48.402554] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-29T21:19:48.509732] [INFO ] [REMOTE ] STZ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:19:49.130114] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-29T21:19:49.148066] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-01. [2025-09-29T21:19:49.784098] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-29T21:19:49.948213] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-08. [2025-09-29T21:19:50.337514] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-29T21:19:50.748113] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-08. [2025-09-29T21:19:50.950983] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-08 (0.20 seconds). [2025-09-29T21:19:51.548146] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-09. [2025-09-29T21:19:52.080930] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-29T21:19:52.082019] [INFO ] [REMOTE ] STXT: Full fetch complete (3991 records). [2025-09-29T21:19:52.082112] [DEBUG] [VALIDATOR ] STXT: Validating primary data. [2025-09-29T21:19:52.353239] [INFO ] [REMOTE ] STZ: Fetching primary data for 2024-12. [2025-09-29T21:19:52.457603] [DEBUG] [VALIDATOR ] STXT: All expected trading days are present. [2025-09-29T21:19:52.457714] [DEBUG] [VALIDATOR ] STXT: Primary data validation passed. [2025-09-29T21:19:52.457855] [INFO ] [MAIN ] STXT: Fetched primary data is valid. [2025-09-29T21:19:52.457912] [DEBUG] [LOCAL ] STXT: Saving primary data. [2025-09-29T21:19:52.458312] [DEBUG] [LOCAL ] STXT: Trimmed 3991 records to 2526 (keeping 200 days of data) [2025-09-29T21:19:52.475980] [DEBUG] [LOCAL ] STXT: Primary data saved (2526 records). [2025-09-29T21:19:52.476099] [INFO ] [MAIN ] STXT: Full history saved. [2025-09-29T21:19:52.476237] [INFO ] [MAIN ] Update Progress: 2024/2371 symbols completed. STXT took 30.6s. Estimated remaining: 44m 33s. Rate: 7.8 symbols/min [2025-09-29T21:19:52.661934] [INFO ] [MAIN ] SU: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:19:52.723621] [DEBUG] [LOCAL ] SU: Loaded 54234 existing records from primary storage. [2025-09-29T21:19:52.724019] [INFO ] [MAIN ] SU: Loaded 54234 existing records. [2025-09-29T21:19:52.910430] [WARN ] [MAIN ] SU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:19:52.910665] [INFO ] [MAIN ] SU: Wiping existing primary data before full refresh. [2025-09-29T21:19:52.910727] [INFO ] [LOCAL ] SU: Starting deletion of primary data. [2025-09-29T21:19:52.911350] [DEBUG] [LOCAL ] SU: Deleted primary data file. [2025-09-29T21:19:52.911426] [INFO ] [MAIN ] SU: Starting full primary refresh. [2025-09-29T21:19:53.153310] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-02. [2025-09-29T21:19:53.295259] [INFO ] [REMOTE ] SU: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:19:53.735695] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-29T21:19:53.948090] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-09. [2025-09-29T21:19:54.168725] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-29T21:19:54.300236] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-29T21:19:54.301147] [INFO ] [REMOTE ] STXM: Full fetch complete (1424 records). [2025-09-29T21:19:54.301259] [DEBUG] [VALIDATOR ] STXM: Validating primary data. [2025-09-29T21:19:54.301633] [FATAL] [VALIDATOR ] STXM: Data is stale - most recent date (2025-09-26) is before last completed trading day (2025-09-29). Symbol may be delisted or halted. [2025-09-29T21:19:54.301764] [FATAL] [MAIN ] STXM: Fetched primary data is invalid. Refusing to save it. [2025-09-29T21:19:54.301847] [WARN ] [MAIN ] STXM: Deleting existing primary and derivative data due to validation failure. [2025-09-29T21:19:54.301936] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-09-29T21:19:54.302014] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-09-29T21:19:54.302065] [INFO ] [LOCAL ] STXM: Starting deletion of derivative data. [2025-09-29T21:19:54.302134] [DEBUG] [LOCAL ] STXM: No derivative data file found to delete. [2025-09-29T21:19:54.302218] [INFO ] [MAIN ] Update Progress: 2025/2371 symbols completed. STXM took 34.2s. Estimated remaining: 44m 24s. Rate: 7.8 symbols/min [2025-09-29T21:19:54.482237] [INFO ] [MAIN ] SUI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:19:54.542980] [DEBUG] [LOCAL ] SUI: Loaded 42505 existing records from primary storage. [2025-09-29T21:19:54.543307] [INFO ] [MAIN ] SUI: Loaded 42505 existing records. [2025-09-29T21:19:54.735178] [WARN ] [MAIN ] SUI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:19:54.735440] [INFO ] [MAIN ] SUI: Wiping existing primary data before full refresh. [2025-09-29T21:19:54.735508] [INFO ] [LOCAL ] SUI: Starting deletion of primary data. [2025-09-29T21:19:54.736307] [DEBUG] [LOCAL ] SUI: Deleted primary data file. [2025-09-29T21:19:54.736368] [INFO ] [MAIN ] SUI: Starting full primary refresh. [2025-09-29T21:19:54.752713] [INFO ] [REMOTE ] SU: Fetching primary data for 2024-12. [2025-09-29T21:19:55.111825] [INFO ] [REMOTE ] SUI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:19:55.548092] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-01. [2025-09-29T21:19:56.348096] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-03. [2025-09-29T21:19:56.542345] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-29T21:19:56.871382] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-29T21:19:57.073850] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-29T21:19:57.148079] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-02. [2025-09-29T21:19:57.948293] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-04. [2025-09-29T21:19:58.487405] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-29T21:19:58.748135] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-01. [2025-09-29T21:19:59.296282] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-29T21:19:59.548102] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-03. [2025-09-29T21:20:00.348086] [INFO ] [REMOTE ] SUI: Fetching primary data for 2024-12. [2025-09-29T21:20:00.697867] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-29T21:20:01.148104] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-02. [2025-09-29T21:20:01.587857] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-29T21:20:01.948171] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-04. [2025-09-29T21:20:02.151348] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-29T21:20:02.719417] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-29T21:20:02.748126] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-05. [2025-09-29T21:20:03.254725] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-29T21:20:03.548143] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-03. [2025-09-29T21:20:04.019989] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-29T21:20:04.348151] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-05. [2025-09-29T21:20:05.145979] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-29T21:20:05.157190] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-01. [2025-09-29T21:20:05.948112] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-04. [2025-09-29T21:20:06.521700] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-29T21:20:06.748837] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-06. [2025-09-29T21:20:06.751829] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-29T21:20:07.548150] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-02. [2025-09-29T21:20:08.038070] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-29T21:20:08.348102] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-06. [2025-09-29T21:20:08.773221] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-29T21:20:08.813601] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-29T21:20:08.948499] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-29T21:20:09.148126] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-03. [2025-09-29T21:20:09.948141] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-05. [2025-09-29T21:20:10.717309] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-29T21:20:10.748077] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-04. [2025-09-29T21:20:11.548167] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-07. [2025-09-29T21:20:12.172190] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-29T21:20:12.348112] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-06. [2025-09-29T21:20:12.705001] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-29T21:20:13.148144] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-07. [2025-09-29T21:20:13.721689] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-29T21:20:13.948155] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-08. [2025-09-29T21:20:14.394823] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-07 (2.85 seconds). [2025-09-29T21:20:14.506795] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-29T21:20:14.748100] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-08. [2025-09-29T21:20:15.002981] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-06 (2.65 seconds). [2025-09-29T21:20:15.548188] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-05. [2025-09-29T21:20:16.348364] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-07. [2025-09-29T21:20:16.690988] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-29T21:20:17.148963] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-09. [2025-09-29T21:20:17.154228] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-29T21:20:17.948698] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-06. [2025-09-29T21:20:18.550675] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-29T21:20:18.748137] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-08. [2025-09-29T21:20:19.285770] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-29T21:20:19.298553] [INFO ] [REMOTE ] STZ: Full fetch complete (75796 records). [2025-09-29T21:20:19.298905] [DEBUG] [VALIDATOR ] STZ: Validating primary data. [2025-09-29T21:20:19.549330] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-09. [2025-09-29T21:20:19.733680] [DEBUG] [VALIDATOR ] STZ: All expected trading days are present. [2025-09-29T21:20:19.733874] [DEBUG] [VALIDATOR ] STZ: Primary data validation passed. [2025-09-29T21:20:19.735251] [INFO ] [MAIN ] STZ: Fetched primary data is valid. [2025-09-29T21:20:19.735342] [DEBUG] [LOCAL ] STZ: Saving primary data. [2025-09-29T21:20:19.737141] [DEBUG] [LOCAL ] STZ: Trimmed 75796 records to 52277 (keeping 200 days of data) [2025-09-29T21:20:19.830249] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-29T21:20:20.004826] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-29T21:20:20.007254] [INFO ] [REMOTE ] STXV: Full fetch complete (2618 records). [2025-09-29T21:20:20.007619] [DEBUG] [VALIDATOR ] STXV: Validating primary data. [2025-09-29T21:20:20.352006] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-07. [2025-09-29T21:20:20.431675] [DEBUG] [VALIDATOR ] STXV: All expected trading days are present. [2025-09-29T21:20:20.432447] [DEBUG] [VALIDATOR ] STXV: Primary data validation passed. [2025-09-29T21:20:20.432609] [INFO ] [MAIN ] STXV: Fetched primary data is valid. [2025-09-29T21:20:20.434087] [DEBUG] [LOCAL ] STXV: Saving primary data. [2025-09-29T21:20:20.434930] [DEBUG] [LOCAL ] STXV: Trimmed 2618 records to 1590 (keeping 200 days of data) [2025-09-29T21:20:20.454769] [DEBUG] [LOCAL ] STXV: Primary data saved (1590 records). [2025-09-29T21:20:20.455387] [INFO ] [MAIN ] STXV: Full history saved. [2025-09-29T21:20:20.456341] [INFO ] [MAIN ] Update Progress: 2026/2371 symbols completed. STXV took 36.8s. Estimated remaining: 44m 19s. Rate: 7.8 symbols/min [2025-09-29T21:20:20.763415] [INFO ] [MAIN ] SUN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:20:20.767051] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-29T21:20:20.801201] [DEBUG] [LOCAL ] STZ: Primary data saved (52277 records). [2025-09-29T21:20:20.801352] [INFO ] [MAIN ] STZ: Full history saved. [2025-09-29T21:20:20.801461] [INFO ] [MAIN ] Update Progress: 2027/2371 symbols completed. STZ took 33.2s. Estimated remaining: 44m 10s. Rate: 7.8 symbols/min [2025-09-29T21:20:21.017639] [DEBUG] [LOCAL ] SUN: Loaded 37928 existing records from primary storage. [2025-09-29T21:20:21.016758] [INFO ] [MAIN ] SUPV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:20:21.018413] [INFO ] [MAIN ] SUN: Loaded 37928 existing records. [2025-09-29T21:20:21.151937] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-09. [2025-09-29T21:20:21.212927] [WARN ] [MAIN ] SUN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:20:21.213333] [INFO ] [MAIN ] SUN: Wiping existing primary data before full refresh. [2025-09-29T21:20:21.213413] [INFO ] [LOCAL ] SUN: Starting deletion of primary data. [2025-09-29T21:20:21.214028] [DEBUG] [LOCAL ] SUN: Deleted primary data file. [2025-09-29T21:20:21.214124] [INFO ] [MAIN ] SUN: Starting full primary refresh. [2025-09-29T21:20:21.412779] [DEBUG] [LOCAL ] SUPV: Loaded 47961 existing records from primary storage. [2025-09-29T21:20:21.431225] [INFO ] [MAIN ] SUPV: Loaded 47961 existing records. [2025-09-29T21:20:21.788718] [INFO ] [REMOTE ] SUN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:20:21.854127] [WARN ] [MAIN ] SUPV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:20:21.854590] [INFO ] [MAIN ] SUPV: Wiping existing primary data before full refresh. [2025-09-29T21:20:21.854879] [INFO ] [LOCAL ] SUPV: Starting deletion of primary data. [2025-09-29T21:20:21.855326] [DEBUG] [LOCAL ] SUPV: Deleted primary data file. [2025-09-29T21:20:21.855442] [INFO ] [MAIN ] SUPV: Starting full primary refresh. [2025-09-29T21:20:21.960791] [INFO ] [REMOTE ] SUN: Fetching primary data for 2024-12. [2025-09-29T21:20:22.130725] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-29T21:20:22.284581] [INFO ] [REMOTE ] SUPV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:20:22.748103] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-08. [2025-09-29T21:20:23.013232] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-29T21:20:23.024975] [INFO ] [REMOTE ] SU: Full fetch complete (77396 records). [2025-09-29T21:20:23.025149] [DEBUG] [VALIDATOR ] SU: Validating primary data. [2025-09-29T21:20:23.515118] [DEBUG] [VALIDATOR ] SU: All expected trading days are present. [2025-09-29T21:20:23.515965] [DEBUG] [VALIDATOR ] SU: Primary data validation passed. [2025-09-29T21:20:23.517392] [INFO ] [MAIN ] SU: Fetched primary data is valid. [2025-09-29T21:20:23.518781] [DEBUG] [LOCAL ] SU: Saving primary data. [2025-09-29T21:20:23.518678] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-29T21:20:23.528627] [DEBUG] [LOCAL ] SU: Trimmed 77396 records to 53451 (keeping 200 days of data) [2025-09-29T21:20:23.588959] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-01. [2025-09-29T21:20:23.887843] [DEBUG] [LOCAL ] SU: Primary data saved (53451 records). [2025-09-29T21:20:23.888091] [INFO ] [MAIN ] SU: Full history saved. [2025-09-29T21:20:23.888199] [INFO ] [MAIN ] Update Progress: 2028/2371 symbols completed. SU took 31.4s. Estimated remaining: 44m 2s. Rate: 7.8 symbols/min [2025-09-29T21:20:24.074009] [INFO ] [MAIN ] SUZ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:20:24.114480] [DEBUG] [LOCAL ] SUZ: Loaded 46428 existing records from primary storage. [2025-09-29T21:20:24.114817] [INFO ] [MAIN ] SUZ: Loaded 46428 existing records. [2025-09-29T21:20:24.302092] [WARN ] [MAIN ] SUZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:20:24.302489] [INFO ] [MAIN ] SUZ: Wiping existing primary data before full refresh. [2025-09-29T21:20:24.302553] [INFO ] [LOCAL ] SUZ: Starting deletion of primary data. [2025-09-29T21:20:24.303080] [DEBUG] [LOCAL ] SUZ: Deleted primary data file. [2025-09-29T21:20:24.303144] [INFO ] [MAIN ] SUZ: Starting full primary refresh. [2025-09-29T21:20:24.351191] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2024-12. [2025-09-29T21:20:24.723841] [INFO ] [REMOTE ] SUZ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:20:24.726968] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-29T21:20:25.148091] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-09. [2025-09-29T21:20:25.224942] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-29T21:20:25.948087] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2024-12. [2025-09-29T21:20:26.119502] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-29T21:20:26.420619] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-29T21:20:26.430045] [INFO ] [REMOTE ] SUI: Full fetch complete (60988 records). [2025-09-29T21:20:26.430183] [DEBUG] [VALIDATOR ] SUI: Validating primary data. [2025-09-29T21:20:26.751716] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-02. [2025-09-29T21:20:26.853601] [DEBUG] [VALIDATOR ] SUI: All expected trading days are present. [2025-09-29T21:20:26.853735] [DEBUG] [VALIDATOR ] SUI: Primary data validation passed. [2025-09-29T21:20:26.854950] [INFO ] [MAIN ] SUI: Fetched primary data is valid. [2025-09-29T21:20:26.855018] [DEBUG] [LOCAL ] SUI: Saving primary data. [2025-09-29T21:20:26.856396] [DEBUG] [LOCAL ] SUI: Trimmed 60988 records to 41785 (keeping 200 days of data) [2025-09-29T21:20:27.140495] [DEBUG] [LOCAL ] SUI: Primary data saved (41785 records). [2025-09-29T21:20:27.140676] [INFO ] [MAIN ] SUI: Full history saved. [2025-09-29T21:20:27.140790] [INFO ] [MAIN ] Update Progress: 2029/2371 symbols completed. SUI took 32.8s. Estimated remaining: 43m 54s. Rate: 7.8 symbols/min [2025-09-29T21:20:27.339392] [INFO ] [MAIN ] SVV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:20:27.405539] [DEBUG] [LOCAL ] SVV: Loaded 40221 existing records from primary storage. [2025-09-29T21:20:27.406033] [INFO ] [MAIN ] SVV: Loaded 40221 existing records. [2025-09-29T21:20:27.551116] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-01. [2025-09-29T21:20:27.620516] [WARN ] [MAIN ] SVV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:20:27.621175] [INFO ] [MAIN ] SVV: Wiping existing primary data before full refresh. [2025-09-29T21:20:27.621394] [INFO ] [LOCAL ] SVV: Starting deletion of primary data. [2025-09-29T21:20:27.631200] [DEBUG] [LOCAL ] SVV: Deleted primary data file. [2025-09-29T21:20:27.631291] [INFO ] [MAIN ] SVV: Starting full primary refresh. [2025-09-29T21:20:27.759624] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-29T21:20:28.050419] [INFO ] [REMOTE ] SVV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:20:28.130677] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-29T21:20:28.348163] [INFO ] [REMOTE ] SVV: Fetching primary data for 2024-12. [2025-09-29T21:20:29.148097] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-03. [2025-09-29T21:20:29.330588] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-29T21:20:29.794319] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-29T21:20:29.948112] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-01. [2025-09-29T21:20:30.325940] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-29T21:20:30.748116] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-04. [2025-09-29T21:20:31.461746] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-29T21:20:31.548102] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-01. [2025-09-29T21:20:32.203448] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-29T21:20:32.348133] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-02. [2025-09-29T21:20:32.868001] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-29T21:20:33.148119] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-02. [2025-09-29T21:20:33.306459] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-29T21:20:33.948121] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-02. [2025-09-29T21:20:34.748150] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-05. [2025-09-29T21:20:34.798406] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-29T21:20:35.531756] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-29T21:20:35.548072] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-03. [2025-09-29T21:20:36.003283] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-29T21:20:36.348134] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-03. [2025-09-29T21:20:37.082670] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-29T21:20:37.148124] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-03. [2025-09-29T21:20:37.948161] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-06. [2025-09-29T21:20:38.151039] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-29T21:20:38.453753] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-29T21:20:38.748115] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-04. [2025-09-29T21:20:39.177210] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-29T21:20:39.548160] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-04. [2025-09-29T21:20:40.348131] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-07. [2025-09-29T21:20:40.459574] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-29T21:20:40.917304] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-29T21:20:41.148123] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-04. [2025-09-29T21:20:41.585433] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-29T21:20:41.948111] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-08. [2025-09-29T21:20:42.416979] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-29T21:20:42.748110] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-05. [2025-09-29T21:20:43.502438] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-29T21:20:43.548108] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-05. [2025-09-29T21:20:44.348089] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-09. [2025-09-29T21:20:44.441701] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-29T21:20:44.732114] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-29T21:20:45.148114] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-06. [2025-09-29T21:20:45.832006] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-29T21:20:45.840606] [INFO ] [REMOTE ] SUN: Full fetch complete (54697 records). [2025-09-29T21:20:45.840859] [DEBUG] [VALIDATOR ] SUN: Validating primary data. [2025-09-29T21:20:45.953102] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-05. [2025-09-29T21:20:46.264435] [DEBUG] [VALIDATOR ] SUN: All expected trading days are present. [2025-09-29T21:20:46.264556] [DEBUG] [VALIDATOR ] SUN: Primary data validation passed. [2025-09-29T21:20:46.265720] [INFO ] [MAIN ] SUN: Fetched primary data is valid. [2025-09-29T21:20:46.265788] [DEBUG] [LOCAL ] SUN: Saving primary data. [2025-09-29T21:20:46.267965] [DEBUG] [LOCAL ] SUN: Trimmed 54697 records to 37437 (keeping 200 days of data) [2025-09-29T21:20:46.515314] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-29T21:20:46.556678] [DEBUG] [LOCAL ] SUN: Primary data saved (37437 records). [2025-09-29T21:20:46.556860] [INFO ] [MAIN ] SUN: Full history saved. [2025-09-29T21:20:46.556989] [INFO ] [MAIN ] Update Progress: 2030/2371 symbols completed. SUN took 26.1s. Estimated remaining: 43m 48s. Rate: 7.8 symbols/min [2025-09-29T21:20:46.739557] [INFO ] [MAIN ] SW: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:20:46.748137] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-06. [2025-09-29T21:20:46.800383] [DEBUG] [LOCAL ] SW: Loaded 53939 existing records from primary storage. [2025-09-29T21:20:46.800753] [INFO ] [MAIN ] SW: Loaded 53939 existing records. [2025-09-29T21:20:46.996478] [WARN ] [MAIN ] SW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:20:46.996741] [INFO ] [MAIN ] SW: Wiping existing primary data before full refresh. [2025-09-29T21:20:46.996798] [INFO ] [LOCAL ] SW: Starting deletion of primary data. [2025-09-29T21:20:46.997322] [DEBUG] [LOCAL ] SW: Deleted primary data file. [2025-09-29T21:20:46.997382] [INFO ] [MAIN ] SW: Starting full primary refresh. [2025-09-29T21:20:47.375682] [INFO ] [REMOTE ] SW: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:20:47.548091] [INFO ] [REMOTE ] SW: Fetching primary data for 2024-12. [2025-09-29T21:20:47.640311] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-29T21:20:48.271479] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-29T21:20:48.348167] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-07. [2025-09-29T21:20:49.150372] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-06. [2025-09-29T21:20:49.156624] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-29T21:20:49.682122] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-29T21:20:49.948110] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-01. [2025-09-29T21:20:50.748133] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-07. [2025-09-29T21:20:50.790691] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-29T21:20:51.548105] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-08. [2025-09-29T21:20:51.732172] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-29T21:20:51.889676] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-29T21:20:52.348113] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-07. [2025-09-29T21:20:53.035859] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-29T21:20:53.148089] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-09. [2025-09-29T21:20:53.948108] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-02. [2025-09-29T21:20:54.057182] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-29T21:20:54.748156] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-08. [2025-09-29T21:20:54.828409] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-29T21:20:54.838242] [INFO ] [REMOTE ] SVV: Full fetch complete (56135 records). [2025-09-29T21:20:54.838403] [DEBUG] [VALIDATOR ] SVV: Validating primary data. [2025-09-29T21:20:55.273928] [DEBUG] [VALIDATOR ] SVV: All expected trading days are present. [2025-09-29T21:20:55.274089] [DEBUG] [VALIDATOR ] SVV: Primary data validation passed. [2025-09-29T21:20:55.275307] [INFO ] [MAIN ] SVV: Fetched primary data is valid. [2025-09-29T21:20:55.275398] [DEBUG] [LOCAL ] SVV: Saving primary data. [2025-09-29T21:20:55.277046] [DEBUG] [LOCAL ] SVV: Trimmed 56135 records to 39617 (keeping 200 days of data) [2025-09-29T21:20:55.412733] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-29T21:20:55.548967] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-03. [2025-09-29T21:20:55.559867] [DEBUG] [LOCAL ] SVV: Primary data saved (39617 records). [2025-09-29T21:20:55.560088] [INFO ] [MAIN ] SVV: Full history saved. [2025-09-29T21:20:55.560220] [INFO ] [MAIN ] Update Progress: 2031/2371 symbols completed. SVV took 28.4s. Estimated remaining: 43m 40s. Rate: 7.8 symbols/min [2025-09-29T21:20:55.741512] [INFO ] [MAIN ] SWK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:20:55.790170] [DEBUG] [LOCAL ] SWK: Loaded 53178 existing records from primary storage. [2025-09-29T21:20:55.790492] [INFO ] [MAIN ] SWK: Loaded 53178 existing records. [2025-09-29T21:20:55.973934] [WARN ] [MAIN ] SWK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:20:55.974154] [INFO ] [MAIN ] SWK: Wiping existing primary data before full refresh. [2025-09-29T21:20:55.974202] [INFO ] [LOCAL ] SWK: Starting deletion of primary data. [2025-09-29T21:20:55.974811] [DEBUG] [LOCAL ] SWK: Deleted primary data file. [2025-09-29T21:20:55.974899] [INFO ] [MAIN ] SWK: Starting full primary refresh. [2025-09-29T21:20:56.360523] [INFO ] [REMOTE ] SWK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:20:56.360685] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-08. [2025-09-29T21:20:56.416787] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-29T21:20:57.148136] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-09. [2025-09-29T21:20:57.476617] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-29T21:20:57.948119] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-04. [2025-09-29T21:20:58.002596] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-29T21:20:58.478761] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-29T21:20:58.490529] [INFO ] [REMOTE ] SUPV: Full fetch complete (68300 records). [2025-09-29T21:20:58.490794] [DEBUG] [VALIDATOR ] SUPV: Validating primary data. [2025-09-29T21:20:58.753223] [INFO ] [REMOTE ] SWK: Fetching primary data for 2024-12. [2025-09-29T21:20:58.917486] [DEBUG] [VALIDATOR ] SUPV: All expected trading days are present. [2025-09-29T21:20:58.917572] [DEBUG] [VALIDATOR ] SUPV: Primary data validation passed. [2025-09-29T21:20:58.919053] [INFO ] [MAIN ] SUPV: Fetched primary data is valid. [2025-09-29T21:20:58.919121] [DEBUG] [LOCAL ] SUPV: Saving primary data. [2025-09-29T21:20:58.920563] [DEBUG] [LOCAL ] SUPV: Trimmed 68300 records to 47228 (keeping 200 days of data) [2025-09-29T21:20:59.233574] [DEBUG] [LOCAL ] SUPV: Primary data saved (47228 records). [2025-09-29T21:20:59.233794] [INFO ] [MAIN ] SUPV: Full history saved. [2025-09-29T21:20:59.233922] [INFO ] [MAIN ] Update Progress: 2032/2371 symbols completed. SUPV took 38.4s. Estimated remaining: 43m 32s. Rate: 7.8 symbols/min [2025-09-29T21:20:59.436142] [INFO ] [MAIN ] SWX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:20:59.471426] [DEBUG] [LOCAL ] SWX: Loaded 31735 existing records from primary storage. [2025-09-29T21:20:59.471825] [INFO ] [MAIN ] SWX: Loaded 31735 existing records. [2025-09-29T21:20:59.553810] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-09. [2025-09-29T21:20:59.676548] [WARN ] [MAIN ] SWX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:20:59.676975] [INFO ] [MAIN ] SWX: Wiping existing primary data before full refresh. [2025-09-29T21:20:59.677052] [INFO ] [LOCAL ] SWX: Starting deletion of primary data. [2025-09-29T21:20:59.677781] [DEBUG] [LOCAL ] SWX: Deleted primary data file. [2025-09-29T21:20:59.677848] [INFO ] [MAIN ] SWX: Starting full primary refresh. [2025-09-29T21:20:59.906367] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-29T21:21:00.122898] [INFO ] [REMOTE ] SWX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:21:00.348091] [INFO ] [REMOTE ] SWX: Fetching primary data for 2024-12. [2025-09-29T21:21:00.599107] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-29T21:21:01.132751] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-29T21:21:01.141836] [INFO ] [REMOTE ] SUZ: Full fetch complete (66891 records). [2025-09-29T21:21:01.142021] [DEBUG] [VALIDATOR ] SUZ: Validating primary data. [2025-09-29T21:21:01.154797] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-05. [2025-09-29T21:21:01.601672] [DEBUG] [VALIDATOR ] SUZ: All expected trading days are present. [2025-09-29T21:21:01.601880] [DEBUG] [VALIDATOR ] SUZ: Primary data validation passed. [2025-09-29T21:21:01.603169] [INFO ] [MAIN ] SUZ: Fetched primary data is valid. [2025-09-29T21:21:01.603400] [DEBUG] [LOCAL ] SUZ: Saving primary data. [2025-09-29T21:21:01.605078] [DEBUG] [LOCAL ] SUZ: Trimmed 66891 records to 45751 (keeping 200 days of data) [2025-09-29T21:21:01.731400] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-29T21:21:01.940405] [DEBUG] [LOCAL ] SUZ: Primary data saved (45751 records). [2025-09-29T21:21:01.940563] [INFO ] [MAIN ] SUZ: Full history saved. [2025-09-29T21:21:01.940693] [INFO ] [MAIN ] Update Progress: 2033/2371 symbols completed. SUZ took 38.1s. Estimated remaining: 43m 23s. Rate: 7.8 symbols/min [2025-09-29T21:21:01.954196] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-01. [2025-09-29T21:21:02.124346] [INFO ] [MAIN ] SWZ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:21:02.133030] [DEBUG] [LOCAL ] SWZ: Loaded 6074 existing records from primary storage. [2025-09-29T21:21:02.133314] [INFO ] [MAIN ] SWZ: Loaded 6074 existing records. [2025-09-29T21:21:02.326305] [WARN ] [MAIN ] SWZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:21:02.326682] [INFO ] [MAIN ] SWZ: Wiping existing primary data before full refresh. [2025-09-29T21:21:02.326754] [INFO ] [LOCAL ] SWZ: Starting deletion of primary data. [2025-09-29T21:21:02.327190] [DEBUG] [LOCAL ] SWZ: Deleted primary data file. [2025-09-29T21:21:02.327264] [INFO ] [MAIN ] SWZ: Starting full primary refresh. [2025-09-29T21:21:02.726142] [INFO ] [REMOTE ] SWZ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:21:02.748148] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2024-12. [2025-09-29T21:21:03.048284] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-29T21:21:03.247813] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-29T21:21:03.419774] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-29T21:21:03.548133] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-01. [2025-09-29T21:21:04.348169] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-01. [2025-09-29T21:21:04.941823] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-29T21:21:05.148096] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-02. [2025-09-29T21:21:05.413361] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-29T21:21:05.560872] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-29T21:21:05.948147] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-02. [2025-09-29T21:21:06.748170] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-03. [2025-09-29T21:21:07.283759] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-29T21:21:07.381408] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-29T21:21:07.548119] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-02. [2025-09-29T21:21:08.348150] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-06. [2025-09-29T21:21:09.038490] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-29T21:21:09.148172] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-03. [2025-09-29T21:21:09.749082] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-29T21:21:09.948119] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-03. [2025-09-29T21:21:10.515765] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-29T21:21:10.748156] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-07. [2025-09-29T21:21:11.548094] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-04. [2025-09-29T21:21:11.752277] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-29T21:21:12.348107] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-04. [2025-09-29T21:21:12.404993] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-29T21:21:12.729947] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-29T21:21:13.148156] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-08. [2025-09-29T21:21:13.948129] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-04. [2025-09-29T21:21:14.176860] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-29T21:21:14.748125] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-05. [2025-09-29T21:21:15.091475] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-29T21:21:15.256538] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-29T21:21:15.548167] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-05. [2025-09-29T21:21:16.157732] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-29T21:21:16.348161] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-05. [2025-09-29T21:21:16.352268] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-29T21:21:17.148137] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-06. [2025-09-29T21:21:17.637017] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-29T21:21:17.766779] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-29T21:21:17.948138] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-06. [2025-09-29T21:21:18.748109] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-09. [2025-09-29T21:21:19.548160] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-06. [2025-09-29T21:21:19.777894] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-29T21:21:20.348094] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-07. [2025-09-29T21:21:20.512943] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-29T21:21:20.525234] [INFO ] [REMOTE ] SW: Full fetch complete (76767 records). [2025-09-29T21:21:20.525416] [DEBUG] [VALIDATOR ] SW: Validating primary data. [2025-09-29T21:21:21.028214] [DEBUG] [VALIDATOR ] SW: All expected trading days are present. [2025-09-29T21:21:21.028344] [DEBUG] [VALIDATOR ] SW: Primary data validation passed. [2025-09-29T21:21:21.030379] [INFO ] [MAIN ] SW: Fetched primary data is valid. [2025-09-29T21:21:21.031681] [DEBUG] [LOCAL ] SW: Saving primary data. [2025-09-29T21:21:21.031560] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-29T21:21:21.042881] [DEBUG] [LOCAL ] SW: Trimmed 76767 records to 53160 (keeping 200 days of data) [2025-09-29T21:21:21.149076] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-07. [2025-09-29T21:21:21.397856] [DEBUG] [LOCAL ] SW: Primary data saved (53160 records). [2025-09-29T21:21:21.398012] [INFO ] [MAIN ] SW: Full history saved. [2025-09-29T21:21:21.398139] [INFO ] [MAIN ] Update Progress: 2034/2371 symbols completed. SW took 34.8s. Estimated remaining: 43m 18s. Rate: 7.8 symbols/min [2025-09-29T21:21:21.568743] [INFO ] [MAIN ] SXC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:21:21.612538] [DEBUG] [LOCAL ] SXC: Loaded 42142 existing records from primary storage. [2025-09-29T21:21:21.613308] [INFO ] [MAIN ] SXC: Loaded 42142 existing records. [2025-09-29T21:21:21.731457] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-29T21:21:21.810748] [WARN ] [MAIN ] SXC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:21:21.810972] [INFO ] [MAIN ] SXC: Wiping existing primary data before full refresh. [2025-09-29T21:21:21.811020] [INFO ] [LOCAL ] SXC: Starting deletion of primary data. [2025-09-29T21:21:21.811455] [DEBUG] [LOCAL ] SXC: Deleted primary data file. [2025-09-29T21:21:21.811552] [INFO ] [MAIN ] SXC: Starting full primary refresh. [2025-09-29T21:21:21.952895] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-08. [2025-09-29T21:21:22.201345] [INFO ] [REMOTE ] SXC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:21:22.237299] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-29T21:21:22.748121] [INFO ] [REMOTE ] SXC: Fetching primary data for 2024-12. [2025-09-29T21:21:22.925985] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-29T21:21:23.548117] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-09. [2025-09-29T21:21:24.141582] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-29T21:21:24.142922] [INFO ] [REMOTE ] SWZ: Full fetch complete (8093 records). [2025-09-29T21:21:24.143000] [DEBUG] [VALIDATOR ] SWZ: Validating primary data. [2025-09-29T21:21:24.349810] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-07. [2025-09-29T21:21:24.540801] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-29T21:21:24.638195] [DEBUG] [VALIDATOR ] SWZ: All expected trading days are present. [2025-09-29T21:21:24.638273] [DEBUG] [VALIDATOR ] SWZ: Primary data validation passed. [2025-09-29T21:21:24.638520] [INFO ] [MAIN ] SWZ: Fetched primary data is valid. [2025-09-29T21:21:24.638582] [DEBUG] [LOCAL ] SWZ: Saving primary data. [2025-09-29T21:21:24.639054] [DEBUG] [LOCAL ] SWZ: Trimmed 8093 records to 6005 (keeping 200 days of data) [2025-09-29T21:21:24.674560] [DEBUG] [LOCAL ] SWZ: Primary data saved (6005 records). [2025-09-29T21:21:24.674727] [INFO ] [MAIN ] SWZ: Full history saved. [2025-09-29T21:21:24.674844] [INFO ] [MAIN ] Update Progress: 2035/2371 symbols completed. SWZ took 22.7s. Estimated remaining: 43m 9s. Rate: 7.8 symbols/min [2025-09-29T21:21:24.853688] [INFO ] [MAIN ] SXI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:21:24.870854] [DEBUG] [LOCAL ] SXI: Loaded 11685 existing records from primary storage. [2025-09-29T21:21:24.871145] [INFO ] [MAIN ] SXI: Loaded 11685 existing records. [2025-09-29T21:21:25.063128] [WARN ] [MAIN ] SXI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:21:25.063339] [INFO ] [MAIN ] SXI: Wiping existing primary data before full refresh. [2025-09-29T21:21:25.063394] [INFO ] [LOCAL ] SXI: Starting deletion of primary data. [2025-09-29T21:21:25.063676] [DEBUG] [LOCAL ] SXI: Deleted primary data file. [2025-09-29T21:21:25.063736] [INFO ] [MAIN ] SXI: Starting full primary refresh. [2025-09-29T21:21:25.153261] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-01. [2025-09-29T21:21:25.447590] [INFO ] [REMOTE ] SXI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:21:25.887351] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-29T21:21:25.948121] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-08. [2025-09-29T21:21:26.327224] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-29T21:21:26.748100] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-02. [2025-09-29T21:21:27.262430] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-29T21:21:27.548154] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-09. [2025-09-29T21:21:28.288378] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-29T21:21:28.348130] [INFO ] [REMOTE ] SXI: Fetching primary data for 2024-12. [2025-09-29T21:21:28.839369] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-29T21:21:28.850856] [INFO ] [REMOTE ] SWX: Full fetch complete (43920 records). [2025-09-29T21:21:28.851691] [DEBUG] [VALIDATOR ] SWX: Validating primary data. [2025-09-29T21:21:28.851918] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-29T21:21:29.154539] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-08. [2025-09-29T21:21:29.349774] [DEBUG] [VALIDATOR ] SWX: All expected trading days are present. [2025-09-29T21:21:29.349880] [DEBUG] [VALIDATOR ] SWX: Primary data validation passed. [2025-09-29T21:21:29.351273] [INFO ] [MAIN ] SWX: Fetched primary data is valid. [2025-09-29T21:21:29.351358] [DEBUG] [LOCAL ] SWX: Saving primary data. [2025-09-29T21:21:29.353124] [DEBUG] [LOCAL ] SWX: Trimmed 43920 records to 31090 (keeping 200 days of data) [2025-09-29T21:21:29.648542] [DEBUG] [LOCAL ] SWX: Primary data saved (31090 records). [2025-09-29T21:21:29.648781] [INFO ] [MAIN ] SWX: Full history saved. [2025-09-29T21:21:29.648927] [INFO ] [MAIN ] Update Progress: 2036/2371 symbols completed. SWX took 30.4s. Estimated remaining: 43m 1s. Rate: 7.8 symbols/min [2025-09-29T21:21:29.906346] [INFO ] [MAIN ] SXT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:21:29.950733] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-03. [2025-09-29T21:21:29.951506] [DEBUG] [LOCAL ] SXT: Loaded 29557 existing records from primary storage. [2025-09-29T21:21:29.952918] [INFO ] [MAIN ] SXT: Loaded 29557 existing records. [2025-09-29T21:21:30.194061] [WARN ] [MAIN ] SXT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:21:30.194317] [INFO ] [MAIN ] SXT: Wiping existing primary data before full refresh. [2025-09-29T21:21:30.194366] [INFO ] [LOCAL ] SXT: Starting deletion of primary data. [2025-09-29T21:21:30.194683] [DEBUG] [LOCAL ] SXT: Deleted primary data file. [2025-09-29T21:21:30.194754] [INFO ] [MAIN ] SXT: Starting full primary refresh. [2025-09-29T21:21:30.575639] [INFO ] [REMOTE ] SXT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:21:30.748155] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-01. [2025-09-29T21:21:31.117337] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-29T21:21:31.449241] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-29T21:21:31.548131] [INFO ] [REMOTE ] SXT: Fetching primary data for 2024-12. [2025-09-29T21:21:31.616175] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-29T21:21:32.348145] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-04. [2025-09-29T21:21:32.402273] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-29T21:21:33.148118] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-09. [2025-09-29T21:21:33.953195] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-02. [2025-09-29T21:21:33.970303] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-29T21:21:34.472979] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-29T21:21:34.484548] [INFO ] [REMOTE ] SWK: Full fetch complete (75344 records). [2025-09-29T21:21:34.484765] [DEBUG] [VALIDATOR ] SWK: Validating primary data. [2025-09-29T21:21:34.754117] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-05. [2025-09-29T21:21:34.911512] [DEBUG] [VALIDATOR ] SWK: All expected trading days are present. [2025-09-29T21:21:34.920506] [DEBUG] [VALIDATOR ] SWK: Primary data validation passed. [2025-09-29T21:21:34.921734] [INFO ] [MAIN ] SWK: Fetched primary data is valid. [2025-09-29T21:21:34.922160] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-29T21:21:34.922264] [DEBUG] [LOCAL ] SWK: Saving primary data. [2025-09-29T21:21:34.927597] [DEBUG] [LOCAL ] SWK: Trimmed 75344 records to 52392 (keeping 200 days of data) [2025-09-29T21:21:35.277322] [DEBUG] [LOCAL ] SWK: Primary data saved (52392 records). [2025-09-29T21:21:35.277468] [INFO ] [MAIN ] SWK: Full history saved. [2025-09-29T21:21:35.277551] [INFO ] [MAIN ] Update Progress: 2037/2371 symbols completed. SWK took 39.7s. Estimated remaining: 42m 53s. Rate: 7.8 symbols/min [2025-09-29T21:21:35.548149] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-01. [2025-09-29T21:21:36.292934] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-29T21:21:36.317001] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-29T21:21:36.348152] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-02. [2025-09-29T21:21:37.148109] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-03. [2025-09-29T21:21:37.471691] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-29T21:21:37.948161] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-06. [2025-09-29T21:21:37.968012] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-29T21:21:38.748151] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-03. [2025-09-29T21:21:39.031602] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-29T21:21:39.548093] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-07. [2025-09-29T21:21:40.015030] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-29T21:21:40.348113] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-04. [2025-09-29T21:21:41.148113] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-04. [2025-09-29T21:21:41.179027] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-29T21:21:41.824311] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-29T21:21:41.948107] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-05. [2025-09-29T21:21:42.010512] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-29T21:21:42.748093] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-08. [2025-09-29T21:21:43.077423] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-29T21:21:43.548125] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-06. [2025-09-29T21:21:44.258699] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-29T21:21:44.348112] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-09. [2025-09-29T21:21:44.778719] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-29T21:21:45.148133] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-07. [2025-09-29T21:21:45.777018] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-29T21:21:45.785439] [INFO ] [REMOTE ] SXC: Full fetch complete (61205 records). [2025-09-29T21:21:45.785575] [DEBUG] [VALIDATOR ] SXC: Validating primary data. [2025-09-29T21:21:45.949195] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-05. [2025-09-29T21:21:46.200049] [DEBUG] [VALIDATOR ] SXC: All expected trading days are present. [2025-09-29T21:21:46.200149] [DEBUG] [VALIDATOR ] SXC: Primary data validation passed. [2025-09-29T21:21:46.201329] [INFO ] [MAIN ] SXC: Fetched primary data is valid. [2025-09-29T21:21:46.201428] [DEBUG] [LOCAL ] SXC: Saving primary data. [2025-09-29T21:21:46.202980] [DEBUG] [LOCAL ] SXC: Trimmed 61205 records to 41438 (keeping 200 days of data) [2025-09-29T21:21:46.339632] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-29T21:21:46.503844] [DEBUG] [LOCAL ] SXC: Primary data saved (41438 records). [2025-09-29T21:21:46.503986] [INFO ] [MAIN ] SXC: Full history saved. [2025-09-29T21:21:46.504071] [INFO ] [MAIN ] Update Progress: 2038/2371 symbols completed. SXC took 25.1s. Estimated remaining: 42m 46s. Rate: 7.8 symbols/min [2025-09-29T21:21:46.748119] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-08. [2025-09-29T21:21:46.859295] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-29T21:21:47.548143] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-06. [2025-09-29T21:21:47.941692] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-29T21:21:48.348147] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-09. [2025-09-29T21:21:48.374777] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-29T21:21:49.148107] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-07. [2025-09-29T21:21:49.347386] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-29T21:21:49.354479] [INFO ] [REMOTE ] SXT: Full fetch complete (38180 records). [2025-09-29T21:21:49.354606] [DEBUG] [VALIDATOR ] SXT: Validating primary data. [2025-09-29T21:21:49.769345] [DEBUG] [VALIDATOR ] SXT: All expected trading days are present. [2025-09-29T21:21:49.769700] [DEBUG] [VALIDATOR ] SXT: Primary data validation passed. [2025-09-29T21:21:49.770591] [INFO ] [MAIN ] SXT: Fetched primary data is valid. [2025-09-29T21:21:49.770846] [DEBUG] [LOCAL ] SXT: Saving primary data. [2025-09-29T21:21:49.772004] [DEBUG] [LOCAL ] SXT: Trimmed 38180 records to 29225 (keeping 200 days of data) [2025-09-29T21:21:49.970965] [DEBUG] [LOCAL ] SXT: Primary data saved (29225 records). [2025-09-29T21:21:49.971121] [INFO ] [MAIN ] SXT: Full history saved. [2025-09-29T21:21:49.971222] [INFO ] [MAIN ] Update Progress: 2039/2371 symbols completed. SXT took 20.3s. Estimated remaining: 42m 37s. Rate: 7.8 symbols/min [2025-09-29T21:21:50.020560] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-29T21:21:50.024214] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-08. [2025-09-29T21:21:50.741452] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-29T21:21:50.748061] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-09. [2025-09-29T21:21:51.604248] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-29T21:21:51.609140] [INFO ] [REMOTE ] SXI: Full fetch complete (14710 records). [2025-09-29T21:21:51.609283] [DEBUG] [VALIDATOR ] SXI: Validating primary data. [2025-09-29T21:21:52.015753] [DEBUG] [VALIDATOR ] SXI: All expected trading days are present. [2025-09-29T21:21:52.015852] [DEBUG] [VALIDATOR ] SXI: Primary data validation passed. [2025-09-29T21:21:52.016235] [INFO ] [MAIN ] SXI: Fetched primary data is valid. [2025-09-29T21:21:52.016289] [DEBUG] [LOCAL ] SXI: Saving primary data. [2025-09-29T21:21:52.016954] [DEBUG] [LOCAL ] SXI: Trimmed 14710 records to 11510 (keeping 200 days of data) [2025-09-29T21:21:52.096546] [DEBUG] [LOCAL ] SXI: Primary data saved (11510 records). [2025-09-29T21:21:52.096732] [INFO ] [MAIN ] SXI: Full history saved. [2025-09-29T21:21:52.096880] [INFO ] [MAIN ] Update Progress: 2040/2371 symbols completed. SXI took 27.4s. Estimated remaining: 42m 29s. Rate: 7.8 symbols/min [2025-09-29T21:21:52.747164] [INFO ] [MAIN ] SYF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:21:52.799360] [INFO ] [MAIN ] T: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:21:52.831444] [INFO ] [MAIN ] SYY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:21:52.899183] [INFO ] [MAIN ] SYK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:21:53.019388] [DEBUG] [LOCAL ] SYF: Loaded 54222 existing records from primary storage. [2025-09-29T21:21:53.035629] [INFO ] [MAIN ] SYF: Loaded 54222 existing records. [2025-09-29T21:21:53.035252] [DEBUG] [LOCAL ] SYK: Loaded 47699 existing records from primary storage. [2025-09-29T21:21:53.066782] [INFO ] [MAIN ] SYK: Loaded 47699 existing records. [2025-09-29T21:21:53.260725] [DEBUG] [LOCAL ] SYY: Loaded 54009 existing records from primary storage. [2025-09-29T21:21:53.297227] [DEBUG] [LOCAL ] T: Loaded 54578 existing records from primary storage. [2025-09-29T21:21:53.296941] [INFO ] [MAIN ] SYY: Loaded 54009 existing records. [2025-09-29T21:21:53.334142] [INFO ] [MAIN ] T: Loaded 54578 existing records. [2025-09-29T21:21:53.573529] [WARN ] [MAIN ] SYK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:21:53.653183] [INFO ] [MAIN ] SYK: Wiping existing primary data before full refresh. [2025-09-29T21:21:53.588743] [WARN ] [MAIN ] SYF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:21:53.704543] [INFO ] [MAIN ] SYF: Wiping existing primary data before full refresh. [2025-09-29T21:21:53.686794] [INFO ] [LOCAL ] SYK: Starting deletion of primary data. [2025-09-29T21:21:53.719521] [INFO ] [LOCAL ] SYF: Starting deletion of primary data. [2025-09-29T21:21:53.783441] [DEBUG] [LOCAL ] SYF: Deleted primary data file. [2025-09-29T21:21:53.778226] [DEBUG] [LOCAL ] SYK: Deleted primary data file. [2025-09-29T21:21:53.799957] [INFO ] [MAIN ] SYF: Starting full primary refresh. [2025-09-29T21:21:53.861693] [INFO ] [MAIN ] SYK: Starting full primary refresh. [2025-09-29T21:21:53.867586] [WARN ] [MAIN ] SYY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:21:53.996697] [INFO ] [MAIN ] SYY: Wiping existing primary data before full refresh. [2025-09-29T21:21:54.020821] [WARN ] [MAIN ] T: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:21:54.091760] [INFO ] [LOCAL ] SYY: Starting deletion of primary data. [2025-09-29T21:21:54.062868] [INFO ] [MAIN ] T: Wiping existing primary data before full refresh. [2025-09-29T21:21:54.116336] [INFO ] [LOCAL ] T: Starting deletion of primary data. [2025-09-29T21:21:54.127398] [DEBUG] [LOCAL ] SYY: Deleted primary data file. [2025-09-29T21:21:54.132049] [DEBUG] [LOCAL ] T: Deleted primary data file. [2025-09-29T21:21:54.132196] [INFO ] [MAIN ] SYY: Starting full primary refresh. [2025-09-29T21:21:54.143165] [INFO ] [MAIN ] T: Starting full primary refresh. [2025-09-29T21:21:55.107340] [INFO ] [REMOTE ] SYK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:21:55.177236] [INFO ] [REMOTE ] SYF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:21:55.182691] [INFO ] [REMOTE ] SYK: Fetching primary data for 2024-12. [2025-09-29T21:21:55.237713] [INFO ] [REMOTE ] SYF: Fetching primary data for 2024-12. [2025-09-29T21:21:55.455095] [INFO ] [REMOTE ] T: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:21:55.467408] [INFO ] [REMOTE ] T: Fetching primary data for 2024-12. [2025-09-29T21:21:55.491286] [INFO ] [REMOTE ] SYY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:21:55.491563] [INFO ] [REMOTE ] SYY: Fetching primary data for 2024-12. [2025-09-29T21:21:56.900335] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-29T21:21:56.912290] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-01. [2025-09-29T21:21:57.062388] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-29T21:21:57.073010] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-01. [2025-09-29T21:21:57.262842] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-29T21:21:57.274704] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-01. [2025-09-29T21:21:57.513405] [INFO ] [REMOTE ] T: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-29T21:21:57.524613] [INFO ] [REMOTE ] T: Fetching primary data for 2025-01. [2025-09-29T21:21:58.653027] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-29T21:21:58.664134] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-02. [2025-09-29T21:21:58.956978] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-29T21:21:58.968454] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-02. [2025-09-29T21:21:59.063048] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-29T21:21:59.492632] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-29T21:21:59.548139] [INFO ] [REMOTE ] T: Fetching primary data for 2025-02. [2025-09-29T21:21:59.987460] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-29T21:22:00.348085] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-03. [2025-09-29T21:22:00.744465] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-29T21:22:01.148411] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-02. [2025-09-29T21:22:01.913394] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-09-29T21:22:01.948179] [INFO ] [REMOTE ] T: Fetching primary data for 2025-03. [2025-09-29T21:22:02.168565] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-29T21:22:02.515337] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-29T21:22:02.748168] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-04. [2025-09-29T21:22:03.548168] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-03. [2025-09-29T21:22:04.348103] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-03. [2025-09-29T21:22:04.479742] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-09-29T21:22:04.661134] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-29T21:22:05.148114] [INFO ] [REMOTE ] T: Fetching primary data for 2025-04. [2025-09-29T21:22:05.509299] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-29T21:22:05.948143] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-05. [2025-09-29T21:22:06.142529] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-29T21:22:06.748123] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-04. [2025-09-29T21:22:07.451297] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-29T21:22:07.548144] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-04. [2025-09-29T21:22:07.840069] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-29T21:22:08.221939] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-29T21:22:08.348129] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-06. [2025-09-29T21:22:09.095556] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-29T21:22:09.148133] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-05. [2025-09-29T21:22:09.948183] [INFO ] [REMOTE ] T: Fetching primary data for 2025-05. [2025-09-29T21:22:10.187616] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-29T21:22:10.748139] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-07. [2025-09-29T21:22:11.139895] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-29T21:22:11.548125] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-06. [2025-09-29T21:22:12.304358] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-29T21:22:12.348097] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-08. [2025-09-29T21:22:12.429877] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-09-29T21:22:12.984031] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-29T21:22:13.148140] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-07. [2025-09-29T21:22:13.761410] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-29T21:22:13.948163] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-05. [2025-09-29T21:22:14.748122] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-09. [2025-09-29T21:22:14.981576] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-29T21:22:15.373452] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-29T21:22:15.548141] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-08. [2025-09-29T21:22:16.321571] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-29T21:22:16.333104] [INFO ] [REMOTE ] SYF: Full fetch complete (77326 records). [2025-09-29T21:22:16.333281] [DEBUG] [VALIDATOR ] SYF: Validating primary data. [2025-09-29T21:22:16.355967] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-06. [2025-09-29T21:22:16.782544] [DEBUG] [VALIDATOR ] SYF: All expected trading days are present. [2025-09-29T21:22:16.782632] [DEBUG] [VALIDATOR ] SYF: Primary data validation passed. [2025-09-29T21:22:16.783813] [INFO ] [MAIN ] SYF: Fetched primary data is valid. [2025-09-29T21:22:16.783878] [DEBUG] [LOCAL ] SYF: Saving primary data. [2025-09-29T21:22:16.785579] [DEBUG] [LOCAL ] SYF: Trimmed 77326 records to 53442 (keeping 200 days of data) [2025-09-29T21:22:17.148151] [INFO ] [REMOTE ] T: Fetching primary data for 2025-06. [2025-09-29T21:22:17.150669] [DEBUG] [LOCAL ] SYF: Primary data saved (53442 records). [2025-09-29T21:22:17.151736] [INFO ] [MAIN ] SYF: Full history saved. [2025-09-29T21:22:17.151858] [INFO ] [MAIN ] Update Progress: 2041/2371 symbols completed. SYF took 25.1s. Estimated remaining: 42m 24s. Rate: 7.8 symbols/min [2025-09-29T21:22:17.348488] [INFO ] [MAIN ] TAC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:22:17.431519] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-29T21:22:17.429816] [DEBUG] [LOCAL ] TAC: Loaded 43441 existing records from primary storage. [2025-09-29T21:22:17.443170] [INFO ] [MAIN ] TAC: Loaded 43441 existing records. [2025-09-29T21:22:17.636088] [WARN ] [MAIN ] TAC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:22:17.636412] [INFO ] [MAIN ] TAC: Wiping existing primary data before full refresh. [2025-09-29T21:22:17.636471] [INFO ] [LOCAL ] TAC: Starting deletion of primary data. [2025-09-29T21:22:17.636863] [DEBUG] [LOCAL ] TAC: Deleted primary data file. [2025-09-29T21:22:17.636925] [INFO ] [MAIN ] TAC: Starting full primary refresh. [2025-09-29T21:22:17.954824] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-09. [2025-09-29T21:22:18.029246] [INFO ] [REMOTE ] TAC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:22:18.062381] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-29T21:22:18.748150] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-07. [2025-09-29T21:22:19.279366] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-29T21:22:19.548102] [INFO ] [REMOTE ] T: Fetching primary data for 2025-07. [2025-09-29T21:22:19.776461] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-29T21:22:19.787714] [INFO ] [REMOTE ] SYY: Full fetch complete (76969 records). [2025-09-29T21:22:19.787887] [DEBUG] [VALIDATOR ] SYY: Validating primary data. [2025-09-29T21:22:20.216973] [DEBUG] [VALIDATOR ] SYY: All expected trading days are present. [2025-09-29T21:22:20.217121] [DEBUG] [VALIDATOR ] SYY: Primary data validation passed. [2025-09-29T21:22:20.218500] [INFO ] [MAIN ] SYY: Fetched primary data is valid. [2025-09-29T21:22:20.218568] [DEBUG] [LOCAL ] SYY: Saving primary data. [2025-09-29T21:22:20.225237] [DEBUG] [LOCAL ] SYY: Trimmed 76969 records to 53228 (keeping 200 days of data) [2025-09-29T21:22:20.348245] [INFO ] [REMOTE ] TAC: Fetching primary data for 2024-12. [2025-09-29T21:22:20.607551] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-29T21:22:20.649343] [DEBUG] [LOCAL ] SYY: Primary data saved (53228 records). [2025-09-29T21:22:20.649510] [INFO ] [MAIN ] SYY: Full history saved. [2025-09-29T21:22:20.649625] [INFO ] [MAIN ] Update Progress: 2042/2371 symbols completed. SYY took 28.6s. Estimated remaining: 42m 16s. Rate: 7.8 symbols/min [2025-09-29T21:22:20.832495] [INFO ] [MAIN ] TAK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:22:20.889100] [DEBUG] [LOCAL ] TAK: Loaded 50538 existing records from primary storage. [2025-09-29T21:22:20.889451] [INFO ] [MAIN ] TAK: Loaded 50538 existing records. [2025-09-29T21:22:21.072831] [WARN ] [MAIN ] TAK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:22:21.073064] [INFO ] [MAIN ] TAK: Wiping existing primary data before full refresh. [2025-09-29T21:22:21.073113] [INFO ] [LOCAL ] TAK: Starting deletion of primary data. [2025-09-29T21:22:21.073467] [DEBUG] [LOCAL ] TAK: Deleted primary data file. [2025-09-29T21:22:21.073527] [INFO ] [MAIN ] TAK: Starting full primary refresh. [2025-09-29T21:22:21.153236] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-08. [2025-09-29T21:22:21.451914] [INFO ] [REMOTE ] TAK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:22:21.680047] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-29T21:22:21.948276] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-01. [2025-09-29T21:22:22.160132] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-09-29T21:22:22.748123] [INFO ] [REMOTE ] TAK: Fetching primary data for 2024-12. [2025-09-29T21:22:23.016030] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-29T21:22:23.548151] [INFO ] [REMOTE ] T: Fetching primary data for 2025-08. [2025-09-29T21:22:23.621435] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-29T21:22:24.348137] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-02. [2025-09-29T21:22:24.403722] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-29T21:22:25.148186] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-01. [2025-09-29T21:22:25.666331] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-29T21:22:25.728627] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-29T21:22:25.948122] [INFO ] [REMOTE ] T: Fetching primary data for 2025-09. [2025-09-29T21:22:26.514182] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-29T21:22:26.748177] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-03. [2025-09-29T21:22:27.548146] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-02. [2025-09-29T21:22:28.141545] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-29T21:22:28.153004] [INFO ] [REMOTE ] T: Full fetch complete (77935 records). [2025-09-29T21:22:28.153151] [DEBUG] [VALIDATOR ] T: Validating primary data. [2025-09-29T21:22:28.369155] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-09. [2025-09-29T21:22:28.627754] [DEBUG] [VALIDATOR ] T: All expected trading days are present. [2025-09-29T21:22:28.627948] [DEBUG] [VALIDATOR ] T: Primary data validation passed. [2025-09-29T21:22:28.629863] [INFO ] [MAIN ] T: Fetched primary data is valid. [2025-09-29T21:22:28.631303] [DEBUG] [LOCAL ] T: Saving primary data. [2025-09-29T21:22:28.631208] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-29T21:22:28.643526] [DEBUG] [LOCAL ] T: Trimmed 77935 records to 53798 (keeping 200 days of data) [2025-09-29T21:22:29.016297] [DEBUG] [LOCAL ] T: Primary data saved (53798 records). [2025-09-29T21:22:29.016440] [INFO ] [MAIN ] T: Full history saved. [2025-09-29T21:22:29.016528] [INFO ] [MAIN ] Update Progress: 2043/2371 symbols completed. T took 36.9s. Estimated remaining: 42m 8s. Rate: 7.8 symbols/min [2025-09-29T21:22:29.153367] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-04. [2025-09-29T21:22:29.211830] [INFO ] [MAIN ] TAL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:22:29.239808] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-29T21:22:29.297230] [DEBUG] [LOCAL ] TAL: Loaded 52783 existing records from primary storage. [2025-09-29T21:22:29.297582] [INFO ] [MAIN ] TAL: Loaded 52783 existing records. [2025-09-29T21:22:29.486031] [WARN ] [MAIN ] TAL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:22:29.486313] [INFO ] [MAIN ] TAL: Wiping existing primary data before full refresh. [2025-09-29T21:22:29.486361] [INFO ] [LOCAL ] TAL: Starting deletion of primary data. [2025-09-29T21:22:29.486671] [DEBUG] [LOCAL ] TAL: Deleted primary data file. [2025-09-29T21:22:29.486730] [INFO ] [MAIN ] TAL: Starting full primary refresh. [2025-09-29T21:22:29.883466] [INFO ] [REMOTE ] TAL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:22:29.948123] [INFO ] [REMOTE ] TAL: Fetching primary data for 2024-12. [2025-09-29T21:22:30.023892] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-29T21:22:30.034622] [INFO ] [REMOTE ] SYK: Full fetch complete (68765 records). [2025-09-29T21:22:30.034812] [DEBUG] [VALIDATOR ] SYK: Validating primary data. [2025-09-29T21:22:30.464775] [DEBUG] [VALIDATOR ] SYK: All expected trading days are present. [2025-09-29T21:22:30.464945] [DEBUG] [VALIDATOR ] SYK: Primary data validation passed. [2025-09-29T21:22:30.466173] [INFO ] [MAIN ] SYK: Fetched primary data is valid. [2025-09-29T21:22:30.466296] [DEBUG] [LOCAL ] SYK: Saving primary data. [2025-09-29T21:22:30.468194] [DEBUG] [LOCAL ] SYK: Trimmed 68765 records to 46905 (keeping 200 days of data) [2025-09-29T21:22:30.611752] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-29T21:22:30.749160] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-03. [2025-09-29T21:22:30.820735] [DEBUG] [LOCAL ] SYK: Primary data saved (46905 records). [2025-09-29T21:22:30.820875] [INFO ] [MAIN ] SYK: Full history saved. [2025-09-29T21:22:30.820961] [INFO ] [MAIN ] Update Progress: 2044/2371 symbols completed. SYK took 38.7s. Estimated remaining: 41m 59s. Rate: 7.8 symbols/min [2025-09-29T21:22:31.016256] [INFO ] [MAIN ] TALO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:22:31.065353] [DEBUG] [LOCAL ] TALO: Loaded 51575 existing records from primary storage. [2025-09-29T21:22:31.065717] [INFO ] [MAIN ] TALO: Loaded 51575 existing records. [2025-09-29T21:22:31.265952] [WARN ] [MAIN ] TALO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:22:31.266361] [INFO ] [MAIN ] TALO: Wiping existing primary data before full refresh. [2025-09-29T21:22:31.266600] [INFO ] [LOCAL ] TALO: Starting deletion of primary data. [2025-09-29T21:22:31.266949] [DEBUG] [LOCAL ] TALO: Deleted primary data file. [2025-09-29T21:22:31.267065] [INFO ] [MAIN ] TALO: Starting full primary refresh. [2025-09-29T21:22:31.556357] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-05. [2025-09-29T21:22:31.743674] [INFO ] [REMOTE ] TALO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:22:31.746900] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-29T21:22:32.348127] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-01. [2025-09-29T21:22:32.489815] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-29T21:22:33.081971] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-29T21:22:33.148115] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-06. [2025-09-29T21:22:33.759778] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-29T21:22:33.948193] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-02. [2025-09-29T21:22:34.748544] [INFO ] [REMOTE ] TALO: Fetching primary data for 2024-12. [2025-09-29T21:22:34.755814] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-29T21:22:35.404970] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-29T21:22:35.548179] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-07. [2025-09-29T21:22:36.348104] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-04. [2025-09-29T21:22:36.445149] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-29T21:22:36.810363] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-29T21:22:37.148132] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-03. [2025-09-29T21:22:37.948096] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-01. [2025-09-29T21:22:38.123792] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-29T21:22:38.748130] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-08. [2025-09-29T21:22:38.892499] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-29T21:22:39.548106] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-05. [2025-09-29T21:22:39.699550] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-29T21:22:39.940993] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-29T21:22:40.348120] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-02. [2025-09-29T21:22:40.886398] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-29T21:22:41.148115] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-06. [2025-09-29T21:22:41.923840] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-29T21:22:41.948078] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-04. [2025-09-29T21:22:42.748096] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-03. [2025-09-29T21:22:42.915124] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-29T21:22:43.548119] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-07. [2025-09-29T21:22:43.804030] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-29T21:22:44.353277] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-05. [2025-09-29T21:22:44.372828] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-29T21:22:44.949125] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-29T21:22:45.148118] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-04. [2025-09-29T21:22:45.948110] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-08. [2025-09-29T21:22:46.158072] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-29T21:22:46.748106] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-09. [2025-09-29T21:22:46.877674] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-29T21:22:47.548134] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-05. [2025-09-29T21:22:47.709078] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-29T21:22:48.165294] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-29T21:22:48.174161] [INFO ] [REMOTE ] TAC: Full fetch complete (63965 records). [2025-09-29T21:22:48.174291] [DEBUG] [VALIDATOR ] TAC: Validating primary data. [2025-09-29T21:22:48.354431] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-09. [2025-09-29T21:22:48.616504] [DEBUG] [VALIDATOR ] TAC: All expected trading days are present. [2025-09-29T21:22:48.616639] [DEBUG] [VALIDATOR ] TAC: Primary data validation passed. [2025-09-29T21:22:48.617877] [INFO ] [MAIN ] TAC: Fetched primary data is valid. [2025-09-29T21:22:48.618011] [DEBUG] [LOCAL ] TAC: Saving primary data. [2025-09-29T21:22:48.619363] [DEBUG] [LOCAL ] TAC: Trimmed 63965 records to 42590 (keeping 200 days of data) [2025-09-29T21:22:48.892093] [DEBUG] [LOCAL ] TAC: Primary data saved (42590 records). [2025-09-29T21:22:48.892231] [INFO ] [MAIN ] TAC: Full history saved. [2025-09-29T21:22:48.892333] [INFO ] [MAIN ] Update Progress: 2045/2371 symbols completed. TAC took 31.7s. Estimated remaining: 41m 53s. Rate: 7.8 symbols/min [2025-09-29T21:22:49.080575] [INFO ] [MAIN ] TAP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:22:49.139447] [DEBUG] [LOCAL ] TAP: Loaded 53648 existing records from primary storage. [2025-09-29T21:22:49.140004] [INFO ] [MAIN ] TAP: Loaded 53648 existing records. [2025-09-29T21:22:49.172297] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-06. [2025-09-29T21:22:49.360403] [WARN ] [MAIN ] TAP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:22:49.363590] [INFO ] [MAIN ] TAP: Wiping existing primary data before full refresh. [2025-09-29T21:22:49.364127] [INFO ] [LOCAL ] TAP: Starting deletion of primary data. [2025-09-29T21:22:49.365284] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-29T21:22:49.369432] [DEBUG] [LOCAL ] TAP: Deleted primary data file. [2025-09-29T21:22:49.376189] [INFO ] [MAIN ] TAP: Starting full primary refresh. [2025-09-29T21:22:49.740110] [INFO ] [REMOTE ] TAP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:22:49.948087] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-06. [2025-09-29T21:22:50.023498] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-29T21:22:50.033695] [INFO ] [REMOTE ] TAK: Full fetch complete (71531 records). [2025-09-29T21:22:50.033836] [DEBUG] [VALIDATOR ] TAK: Validating primary data. [2025-09-29T21:22:50.450467] [DEBUG] [VALIDATOR ] TAK: All expected trading days are present. [2025-09-29T21:22:50.450582] [DEBUG] [VALIDATOR ] TAK: Primary data validation passed. [2025-09-29T21:22:50.451832] [INFO ] [MAIN ] TAK: Fetched primary data is valid. [2025-09-29T21:22:50.451901] [DEBUG] [LOCAL ] TAK: Saving primary data. [2025-09-29T21:22:50.453909] [DEBUG] [LOCAL ] TAK: Trimmed 71531 records to 49800 (keeping 200 days of data) [2025-09-29T21:22:50.748263] [INFO ] [REMOTE ] TAP: Fetching primary data for 2024-12. [2025-09-29T21:22:50.789408] [DEBUG] [LOCAL ] TAK: Primary data saved (49800 records). [2025-09-29T21:22:50.789558] [INFO ] [MAIN ] TAK: Full history saved. [2025-09-29T21:22:50.789673] [INFO ] [MAIN ] Update Progress: 2046/2371 symbols completed. TAK took 30.1s. Estimated remaining: 41m 45s. Rate: 7.8 symbols/min [2025-09-29T21:22:51.001728] [INFO ] [MAIN ] TBB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:22:51.004594] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-29T21:22:51.036620] [DEBUG] [LOCAL ] TBB: Loaded 11828 existing records from primary storage. [2025-09-29T21:22:51.037566] [INFO ] [MAIN ] TBB: Loaded 11828 existing records. [2025-09-29T21:22:51.249412] [WARN ] [MAIN ] TBB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:22:51.249719] [INFO ] [MAIN ] TBB: Wiping existing primary data before full refresh. [2025-09-29T21:22:51.249793] [INFO ] [LOCAL ] TBB: Starting deletion of primary data. [2025-09-29T21:22:51.250133] [DEBUG] [LOCAL ] TBB: Deleted primary data file. [2025-09-29T21:22:51.250193] [INFO ] [MAIN ] TBB: Starting full primary refresh. [2025-09-29T21:22:51.550500] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-07. [2025-09-29T21:22:51.644908] [INFO ] [REMOTE ] TBB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:22:51.677140] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-29T21:22:52.348145] [INFO ] [REMOTE ] TBB: Fetching primary data for 2024-12. [2025-09-29T21:22:52.481480] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-29T21:22:53.148149] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-01. [2025-09-29T21:22:53.948395] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-07. [2025-09-29T21:23:05.012198] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2024-12 (12.66 seconds). [2025-09-29T21:23:05.017230] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-01. [2025-09-29T21:23:06.099539] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-07 (14.55 seconds). [2025-09-29T21:23:06.111091] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-08. [2025-09-29T21:23:06.226802] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-01 (13.08 seconds). [2025-09-29T21:23:06.237599] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-02. [2025-09-29T21:23:06.383971] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-29T21:23:06.388250] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-02. [2025-09-29T21:23:06.649353] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-07 (12.70 seconds). [2025-09-29T21:23:06.661306] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-08. [2025-09-29T21:23:07.106824] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-29T21:23:07.109317] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-03. [2025-09-29T21:23:07.756700] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-29T21:23:07.759943] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-04. [2025-09-29T21:23:07.897183] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-29T21:23:07.909469] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-09. [2025-09-29T21:23:08.037928] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-29T21:23:08.049247] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-09. [2025-09-29T21:23:08.328631] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-29T21:23:08.332007] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-05. [2025-09-29T21:23:08.410063] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-29T21:23:08.420858] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-03. [2025-09-29T21:23:09.203745] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-29T21:23:09.207393] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-06. [2025-09-29T21:23:09.251042] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-29T21:23:09.261423] [INFO ] [REMOTE ] TALO: Full fetch complete (73301 records). [2025-09-29T21:23:09.261571] [DEBUG] [VALIDATOR ] TALO: Validating primary data. [2025-09-29T21:23:09.704427] [DEBUG] [VALIDATOR ] TALO: All expected trading days are present. [2025-09-29T21:23:09.704612] [DEBUG] [VALIDATOR ] TALO: Primary data validation passed. [2025-09-29T21:23:09.705892] [INFO ] [MAIN ] TALO: Fetched primary data is valid. [2025-09-29T21:23:09.705978] [DEBUG] [LOCAL ] TALO: Saving primary data. [2025-09-29T21:23:09.740630] [DEBUG] [LOCAL ] TALO: Trimmed 73301 records to 50798 (keeping 200 days of data) [2025-09-29T21:23:09.743437] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-29T21:23:09.837581] [INFO ] [REMOTE ] TAL: Full fetch complete (75595 records). [2025-09-29T21:23:09.838812] [DEBUG] [VALIDATOR ] TAL: Validating primary data. [2025-09-29T21:23:09.980212] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-29T21:23:10.028556] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-07. [2025-09-29T21:23:10.371487] [DEBUG] [VALIDATOR ] TAL: All expected trading days are present. [2025-09-29T21:23:10.372035] [DEBUG] [VALIDATOR ] TAL: Primary data validation passed. [2025-09-29T21:23:10.373775] [INFO ] [MAIN ] TAL: Fetched primary data is valid. [2025-09-29T21:23:10.375676] [DEBUG] [LOCAL ] TAL: Saving primary data. [2025-09-29T21:23:10.392320] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-29T21:23:10.460476] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-04. [2025-09-29T21:23:10.492578] [DEBUG] [LOCAL ] TAL: Trimmed 75595 records to 51990 (keeping 200 days of data) [2025-09-29T21:23:10.704788] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-29T21:23:10.711060] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-08. [2025-09-29T21:23:10.826045] [DEBUG] [LOCAL ] TALO: Primary data saved (50798 records). [2025-09-29T21:23:10.827407] [INFO ] [MAIN ] TALO: Full history saved. [2025-09-29T21:23:10.827989] [INFO ] [MAIN ] Update Progress: 2047/2371 symbols completed. TALO took 40.0s. Estimated remaining: 41m 39s. Rate: 7.8 symbols/min [2025-09-29T21:23:11.025591] [INFO ] [MAIN ] TBBB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:23:11.126760] [DEBUG] [LOCAL ] TBBB: Loaded 36262 existing records from primary storage. [2025-09-29T21:23:11.127411] [INFO ] [MAIN ] TBBB: Loaded 36262 existing records. [2025-09-29T21:23:11.324903] [WARN ] [MAIN ] TBBB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:23:11.326127] [INFO ] [MAIN ] TBBB: Wiping existing primary data before full refresh. [2025-09-29T21:23:11.326216] [INFO ] [LOCAL ] TBBB: Starting deletion of primary data. [2025-09-29T21:23:11.327576] [DEBUG] [LOCAL ] TBBB: Deleted primary data file. [2025-09-29T21:23:11.328050] [INFO ] [MAIN ] TBBB: Starting full primary refresh. [2025-09-29T21:23:11.631021] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-29T21:23:11.630198] [DEBUG] [LOCAL ] TAL: Primary data saved (51990 records). [2025-09-29T21:23:11.662147] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-09. [2025-09-29T21:23:11.661593] [INFO ] [MAIN ] TAL: Full history saved. [2025-09-29T21:23:11.663692] [INFO ] [MAIN ] Update Progress: 2048/2371 symbols completed. TAL took 42.6s. Estimated remaining: 41m 30s. Rate: 7.8 symbols/min [2025-09-29T21:23:11.894598] [INFO ] [REMOTE ] TBBB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:23:11.905396] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2024-12. [2025-09-29T21:23:11.961535] [INFO ] [MAIN ] TBI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:23:11.988100] [DEBUG] [LOCAL ] TBI: Loaded 22937 existing records from primary storage. [2025-09-29T21:23:11.988370] [INFO ] [MAIN ] TBI: Loaded 22937 existing records. [2025-09-29T21:23:12.187606] [WARN ] [MAIN ] TBI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:23:12.187844] [INFO ] [MAIN ] TBI: Wiping existing primary data before full refresh. [2025-09-29T21:23:12.187903] [INFO ] [LOCAL ] TBI: Starting deletion of primary data. [2025-09-29T21:23:12.188282] [DEBUG] [LOCAL ] TBI: Deleted primary data file. [2025-09-29T21:23:12.188347] [INFO ] [MAIN ] TBI: Starting full primary refresh. [2025-09-29T21:23:12.605344] [INFO ] [REMOTE ] TBI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:23:12.606998] [INFO ] [REMOTE ] TBI: Fetching primary data for 2024-12. [2025-09-29T21:23:12.608541] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-29T21:23:12.614243] [INFO ] [REMOTE ] TBB: Full fetch complete (17908 records). [2025-09-29T21:23:12.614419] [DEBUG] [VALIDATOR ] TBB: Validating primary data. [2025-09-29T21:23:12.857165] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-09-29T21:23:12.979026] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-05. [2025-09-29T21:23:13.074589] [DEBUG] [VALIDATOR ] TBB: All expected trading days are present. [2025-09-29T21:23:13.074724] [DEBUG] [VALIDATOR ] TBB: Primary data validation passed. [2025-09-29T21:23:13.075193] [INFO ] [MAIN ] TBB: Fetched primary data is valid. [2025-09-29T21:23:13.081960] [DEBUG] [LOCAL ] TBB: Saving primary data. [2025-09-29T21:23:13.096083] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-29T21:23:13.096306] [DEBUG] [LOCAL ] TBB: Trimmed 17908 records to 11736 (keeping 200 days of data) [2025-09-29T21:23:13.103805] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-01. [2025-09-29T21:23:13.183035] [DEBUG] [LOCAL ] TBB: Primary data saved (11736 records). [2025-09-29T21:23:13.183193] [INFO ] [MAIN ] TBB: Full history saved. [2025-09-29T21:23:13.183283] [INFO ] [MAIN ] Update Progress: 2049/2371 symbols completed. TBB took 22.4s. Estimated remaining: 41m 21s. Rate: 7.8 symbols/min [2025-09-29T21:23:13.361807] [INFO ] [MAIN ] TBLU: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:23:13.362001] [DEBUG] [LOCAL ] TBLU: No existing data file found in primary storage. [2025-09-29T21:23:13.362040] [WARN ] [MAIN ] TBLU: No existing data found, performing full refresh instead. [2025-09-29T21:23:13.362158] [INFO ] [MAIN ] TBLU: Wiping existing primary data before full refresh. [2025-09-29T21:23:13.362208] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-09-29T21:23:13.362250] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-09-29T21:23:13.362283] [INFO ] [MAIN ] TBLU: Starting full primary refresh. [2025-09-29T21:23:13.768738] [INFO ] [REMOTE ] TBLU: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:23:13.769287] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2024-12. [2025-09-29T21:23:13.787872] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-29T21:23:13.793807] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-01. [2025-09-29T21:23:14.115256] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-29T21:23:14.116838] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-01. [2025-09-29T21:23:14.386942] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-29T21:23:14.399936] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-02. [2025-09-29T21:23:14.423484] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-09-29T21:23:14.424955] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-02. [2025-09-29T21:23:14.577312] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-29T21:23:14.748126] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-02. [2025-09-29T21:23:14.777018] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-29T21:23:14.847754] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-29T21:23:15.548105] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-06. [2025-09-29T21:23:15.841766] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-29T21:23:15.943412] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-29T21:23:16.348139] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-03. [2025-09-29T21:23:16.677379] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-29T21:23:17.148089] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-03. [2025-09-29T21:23:17.263216] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-29T21:23:17.948136] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-07. [2025-09-29T21:23:18.561504] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-29T21:23:18.748131] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-04. [2025-09-29T21:23:19.548102] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-04. [2025-09-29T21:23:19.757736] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-29T21:23:19.885239] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-29T21:23:20.262911] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-29T21:23:20.348132] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-05. [2025-09-29T21:23:20.703703] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-29T21:23:21.148167] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-03. [2025-09-29T21:23:21.948096] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-05. [2025-09-29T21:23:22.257733] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-29T21:23:22.748113] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-06. [2025-09-29T21:23:23.085603] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-29T21:23:23.143818] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-29T21:23:23.548116] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-04. [2025-09-29T21:23:24.348157] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-07. [2025-09-29T21:23:24.676454] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-29T21:23:24.713017] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-29T21:23:25.148156] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-08. [2025-09-29T21:23:25.948115] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-05. [2025-09-29T21:23:26.748138] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-08. [2025-09-29T21:23:26.936372] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-29T21:23:27.101706] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-29T21:23:27.186545] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-29T21:23:27.548327] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-09. [2025-09-29T21:23:27.823412] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-09-29T21:23:27.824213] [INFO ] [REMOTE ] TBLU: Full fetch complete (1176 records). [2025-09-29T21:23:27.824290] [DEBUG] [VALIDATOR ] TBLU: Validating primary data. [2025-09-29T21:23:28.009354] [WARN ] [VALIDATOR ] TBLU: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-29T21:23:28.009545] [FATAL] [MAIN ] TBLU: Fetched primary data is invalid. Refusing to save it. [2025-09-29T21:23:28.009617] [WARN ] [MAIN ] TBLU: Deleting existing primary and derivative data due to validation failure. [2025-09-29T21:23:28.009713] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-09-29T21:23:28.009815] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-09-29T21:23:28.009873] [INFO ] [LOCAL ] TBLU: Starting deletion of derivative data. [2025-09-29T21:23:28.009920] [DEBUG] [LOCAL ] TBLU: No derivative data file found to delete. [2025-09-29T21:23:28.009981] [INFO ] [MAIN ] Update Progress: 2050/2371 symbols completed. TBLU took 14.8s. Estimated remaining: 41m 15s. Rate: 7.8 symbols/min [2025-09-29T21:23:28.184149] [INFO ] [MAIN ] TBN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:23:28.189520] [DEBUG] [LOCAL ] TBN: Loaded 3044 existing records from primary storage. [2025-09-29T21:23:28.189752] [INFO ] [MAIN ] TBN: Loaded 3044 existing records. [2025-09-29T21:23:28.364883] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-06. [2025-09-29T21:23:28.373747] [WARN ] [MAIN ] TBN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:23:28.373951] [INFO ] [MAIN ] TBN: Wiping existing primary data before full refresh. [2025-09-29T21:23:28.374009] [INFO ] [LOCAL ] TBN: Starting deletion of primary data. [2025-09-29T21:23:28.374265] [DEBUG] [LOCAL ] TBN: Deleted primary data file. [2025-09-29T21:23:28.374405] [INFO ] [MAIN ] TBN: Starting full primary refresh. [2025-09-29T21:23:28.755183] [INFO ] [REMOTE ] TBN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:23:29.148088] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-06. [2025-09-29T21:23:29.377234] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-29T21:23:29.948127] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-07. [2025-09-29T21:23:30.507610] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-29T21:23:30.748121] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-07. [2025-09-29T21:23:31.032077] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-29T21:23:31.548125] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-08. [2025-09-29T21:23:32.348090] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-09. [2025-09-29T21:23:32.565471] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-29T21:23:33.148118] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-09. [2025-09-29T21:23:33.834524] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-29T21:23:33.845720] [INFO ] [REMOTE ] TAP: Full fetch complete (76157 records). [2025-09-29T21:23:33.845920] [DEBUG] [VALIDATOR ] TAP: Validating primary data. [2025-09-29T21:23:33.951835] [INFO ] [REMOTE ] TBN: Fetching primary data for 2024-12. [2025-09-29T21:23:34.182145] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-29T21:23:34.213954] [INFO ] [REMOTE ] TBI: Full fetch complete (31735 records). [2025-09-29T21:23:34.242895] [DEBUG] [VALIDATOR ] TBI: Validating primary data. [2025-09-29T21:23:34.360899] [DEBUG] [VALIDATOR ] TAP: All expected trading days are present. [2025-09-29T21:23:34.376157] [DEBUG] [VALIDATOR ] TAP: Primary data validation passed. [2025-09-29T21:23:34.400090] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-29T21:23:34.412752] [INFO ] [MAIN ] TAP: Fetched primary data is valid. [2025-09-29T21:23:34.417835] [DEBUG] [LOCAL ] TAP: Saving primary data. [2025-09-29T21:23:34.489822] [DEBUG] [LOCAL ] TAP: Trimmed 76157 records to 52873 (keeping 200 days of data) [2025-09-29T21:23:34.761975] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-01. [2025-09-29T21:23:34.819475] [DEBUG] [VALIDATOR ] TBI: All expected trading days are present. [2025-09-29T21:23:34.819862] [DEBUG] [VALIDATOR ] TBI: Primary data validation passed. [2025-09-29T21:23:34.820909] [INFO ] [MAIN ] TBI: Fetched primary data is valid. [2025-09-29T21:23:34.821337] [DEBUG] [LOCAL ] TBI: Saving primary data. [2025-09-29T21:23:34.824763] [DEBUG] [LOCAL ] TBI: Trimmed 31735 records to 22581 (keeping 200 days of data) [2025-09-29T21:23:34.972058] [DEBUG] [LOCAL ] TBI: Primary data saved (22581 records). [2025-09-29T21:23:34.973277] [INFO ] [MAIN ] TBI: Full history saved. [2025-09-29T21:23:34.974169] [INFO ] [MAIN ] Update Progress: 2051/2371 symbols completed. TBI took 23.3s. Estimated remaining: 41m 7s. Rate: 7.8 symbols/min [2025-09-29T21:23:35.276504] [INFO ] [MAIN ] TCAI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:23:35.277780] [DEBUG] [LOCAL ] TCAI: No existing data file found in primary storage. [2025-09-29T21:23:35.278105] [WARN ] [MAIN ] TCAI: No existing data found, performing full refresh instead. [2025-09-29T21:23:35.279097] [INFO ] [MAIN ] TCAI: Wiping existing primary data before full refresh. [2025-09-29T21:23:35.279707] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-09-29T21:23:35.280114] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-09-29T21:23:35.280161] [INFO ] [MAIN ] TCAI: Starting full primary refresh. [2025-09-29T21:23:35.423157] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-07 (4.68 seconds). [2025-09-29T21:23:35.429918] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-29T21:23:35.554227] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-08. [2025-09-29T21:23:35.782285] [INFO ] [REMOTE ] TCAI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:23:35.872046] [DEBUG] [LOCAL ] TAP: Primary data saved (52873 records). [2025-09-29T21:23:35.872198] [INFO ] [MAIN ] TAP: Full history saved. [2025-09-29T21:23:35.872285] [INFO ] [MAIN ] Update Progress: 2052/2371 symbols completed. TAP took 47.0s. Estimated remaining: 40m 58s. Rate: 7.8 symbols/min [2025-09-29T21:23:36.045417] [INFO ] [MAIN ] TD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:23:36.099137] [DEBUG] [LOCAL ] TD: Loaded 53036 existing records from primary storage. [2025-09-29T21:23:36.099474] [INFO ] [MAIN ] TD: Loaded 53036 existing records. [2025-09-29T21:23:36.281624] [WARN ] [MAIN ] TD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:23:36.281853] [INFO ] [MAIN ] TD: Wiping existing primary data before full refresh. [2025-09-29T21:23:36.281900] [INFO ] [LOCAL ] TD: Starting deletion of primary data. [2025-09-29T21:23:36.282288] [DEBUG] [LOCAL ] TD: Deleted primary data file. [2025-09-29T21:23:36.282347] [INFO ] [MAIN ] TD: Starting full primary refresh. [2025-09-29T21:23:36.353226] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-02. [2025-09-29T21:23:36.671302] [INFO ] [REMOTE ] TD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:23:36.692000] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-29T21:23:37.077681] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-29T21:23:37.148095] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-03. [2025-09-29T21:23:37.722786] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-29T21:23:37.948108] [INFO ] [REMOTE ] TD: Fetching primary data for 2024-12. [2025-09-29T21:23:38.748132] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2024-12. [2025-09-29T21:23:38.945252] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T21:23:38.945634] [WARN ] [REMOTE ] TCAI: No data returned for month 2024-12 [2025-09-29T21:23:38.945752] [FATAL] [REMOTE ] TCAI: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T21:23:38.945829] [FATAL] [MAIN ] TCAI: Failed to fetch primary data. [2025-09-29T21:23:38.945900] [WARN ] [MAIN ] TCAI: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T21:23:38.945972] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-09-29T21:23:38.946089] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-09-29T21:23:38.946141] [INFO ] [LOCAL ] TCAI: Starting deletion of derivative data. [2025-09-29T21:23:38.946184] [DEBUG] [LOCAL ] TCAI: No derivative data file found to delete. [2025-09-29T21:23:38.946233] [INFO ] [MAIN ] Update Progress: 2053/2371 symbols completed. TCAI took 4.0s. Estimated remaining: 40m 50s. Rate: 7.8 symbols/min [2025-09-29T21:23:39.130129] [INFO ] [MAIN ] TDC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:23:39.176775] [DEBUG] [LOCAL ] TDC: Loaded 47501 existing records from primary storage. [2025-09-29T21:23:39.177147] [INFO ] [MAIN ] TDC: Loaded 47501 existing records. [2025-09-29T21:23:39.358310] [WARN ] [MAIN ] TDC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:23:39.359257] [INFO ] [MAIN ] TDC: Wiping existing primary data before full refresh. [2025-09-29T21:23:39.359405] [INFO ] [LOCAL ] TDC: Starting deletion of primary data. [2025-09-29T21:23:39.359843] [DEBUG] [LOCAL ] TDC: Deleted primary data file. [2025-09-29T21:23:39.359907] [INFO ] [MAIN ] TDC: Starting full primary refresh. [2025-09-29T21:23:39.554837] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-04. [2025-09-29T21:23:39.774564] [INFO ] [REMOTE ] TDC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:23:39.809467] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-29T21:23:39.939914] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-29T21:23:40.348111] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-05. [2025-09-29T21:23:40.781760] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-29T21:23:41.148108] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-06. [2025-09-29T21:23:41.600164] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-29T21:23:41.948104] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-07. [2025-09-29T21:23:42.481086] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-29T21:23:42.748114] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-08. [2025-09-29T21:23:43.078969] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-29T21:23:43.548105] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-09. [2025-09-29T21:23:44.110205] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-29T21:23:44.111968] [INFO ] [REMOTE ] TBN: Full fetch complete (4851 records). [2025-09-29T21:23:44.112042] [DEBUG] [VALIDATOR ] TBN: Validating primary data. [2025-09-29T21:23:44.353195] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-01. [2025-09-29T21:23:44.498062] [DEBUG] [VALIDATOR ] TBN: All expected trading days are present. [2025-09-29T21:23:44.498149] [DEBUG] [VALIDATOR ] TBN: Primary data validation passed. [2025-09-29T21:23:44.498295] [INFO ] [MAIN ] TBN: Fetched primary data is valid. [2025-09-29T21:23:44.498336] [DEBUG] [LOCAL ] TBN: Saving primary data. [2025-09-29T21:23:44.498851] [DEBUG] [LOCAL ] TBN: Trimmed 4851 records to 2993 (keeping 200 days of data) [2025-09-29T21:23:44.519380] [DEBUG] [LOCAL ] TBN: Primary data saved (2993 records). [2025-09-29T21:23:44.519486] [INFO ] [MAIN ] TBN: Full history saved. [2025-09-29T21:23:44.519571] [INFO ] [MAIN ] Update Progress: 2054/2371 symbols completed. TBN took 16.5s. Estimated remaining: 40m 42s. Rate: 7.8 symbols/min [2025-09-29T21:23:44.695424] [INFO ] [MAIN ] TDF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:23:44.706244] [DEBUG] [LOCAL ] TDF: Loaded 6595 existing records from primary storage. [2025-09-29T21:23:44.706559] [INFO ] [MAIN ] TDF: Loaded 6595 existing records. [2025-09-29T21:23:44.890225] [WARN ] [MAIN ] TDF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:23:44.890459] [INFO ] [MAIN ] TDF: Wiping existing primary data before full refresh. [2025-09-29T21:23:44.890510] [INFO ] [LOCAL ] TDF: Starting deletion of primary data. [2025-09-29T21:23:44.890741] [DEBUG] [LOCAL ] TDF: Deleted primary data file. [2025-09-29T21:23:44.890801] [INFO ] [MAIN ] TDF: Starting full primary refresh. [2025-09-29T21:23:45.153263] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-09. [2025-09-29T21:23:45.275608] [INFO ] [REMOTE ] TDF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:23:45.948085] [INFO ] [REMOTE ] TDF: Fetching primary data for 2024-12. [2025-09-29T21:23:46.153972] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-29T21:23:46.200363] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-29T21:23:46.207756] [INFO ] [REMOTE ] TBBB: Full fetch complete (51245 records). [2025-09-29T21:23:46.207872] [DEBUG] [VALIDATOR ] TBBB: Validating primary data. [2025-09-29T21:23:46.612443] [DEBUG] [VALIDATOR ] TBBB: All expected trading days are present. [2025-09-29T21:23:46.612548] [DEBUG] [VALIDATOR ] TBBB: Primary data validation passed. [2025-09-29T21:23:46.613728] [INFO ] [MAIN ] TBBB: Fetched primary data is valid. [2025-09-29T21:23:46.613802] [DEBUG] [LOCAL ] TBBB: Saving primary data. [2025-09-29T21:23:46.616083] [DEBUG] [LOCAL ] TBBB: Trimmed 51245 records to 35550 (keeping 200 days of data) [2025-09-29T21:23:46.718683] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-29T21:23:46.748088] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-01. [2025-09-29T21:23:46.858158] [DEBUG] [LOCAL ] TBBB: Primary data saved (35550 records). [2025-09-29T21:23:46.858317] [INFO ] [MAIN ] TBBB: Full history saved. [2025-09-29T21:23:46.858454] [INFO ] [MAIN ] Update Progress: 2055/2371 symbols completed. TBBB took 36.0s. Estimated remaining: 40m 33s. Rate: 7.8 symbols/min [2025-09-29T21:23:47.041753] [INFO ] [MAIN ] TDG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:23:47.068516] [DEBUG] [LOCAL ] TDG: Loaded 22314 existing records from primary storage. [2025-09-29T21:23:47.068829] [INFO ] [MAIN ] TDG: Loaded 22314 existing records. [2025-09-29T21:23:47.255418] [WARN ] [MAIN ] TDG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:23:47.255702] [INFO ] [MAIN ] TDG: Wiping existing primary data before full refresh. [2025-09-29T21:23:47.255762] [INFO ] [LOCAL ] TDG: Starting deletion of primary data. [2025-09-29T21:23:47.255987] [DEBUG] [LOCAL ] TDG: Deleted primary data file. [2025-09-29T21:23:47.256045] [INFO ] [MAIN ] TDG: Starting full primary refresh. [2025-09-29T21:23:47.553255] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-02. [2025-09-29T21:23:47.641124] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-29T21:23:47.654531] [INFO ] [REMOTE ] TDG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:23:48.348120] [INFO ] [REMOTE ] TDC: Fetching primary data for 2024-12. [2025-09-29T21:23:49.148103] [INFO ] [REMOTE ] TDG: Fetching primary data for 2024-12. [2025-09-29T21:23:49.238813] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-29T21:23:49.860954] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-29T21:23:49.948154] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-03. [2025-09-29T21:23:50.039919] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-29T21:23:50.748154] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-02. [2025-09-29T21:23:51.513343] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-29T21:23:51.548134] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-03. [2025-09-29T21:23:51.698399] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-29T21:23:52.348114] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-04. [2025-09-29T21:23:52.358610] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-29T21:23:53.148194] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-01. [2025-09-29T21:23:53.948109] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-01. [2025-09-29T21:23:54.146144] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-29T21:23:54.323863] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-29T21:23:54.748116] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-04. [2025-09-29T21:23:55.442443] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-29T21:23:55.452069] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-29T21:23:55.548154] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-02. [2025-09-29T21:23:56.348134] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-05. [2025-09-29T21:23:56.741945] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-29T21:23:57.148132] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-02. [2025-09-29T21:23:57.948132] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-05. [2025-09-29T21:23:58.189017] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-29T21:23:58.307419] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-29T21:23:58.639491] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-29T21:23:58.748123] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-03. [2025-09-29T21:23:59.548103] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-03. [2025-09-29T21:23:59.706191] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-29T21:24:00.348134] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-04. [2025-09-29T21:24:01.148091] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-06. [2025-09-29T21:24:01.638299] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-29T21:24:01.948149] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-06. [2025-09-29T21:24:02.748160] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-05. [2025-09-29T21:24:03.210832] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-03 (3.66 seconds). [2025-09-29T21:24:03.548163] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-04. [2025-09-29T21:24:04.922445] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-06 (3.77 seconds). [2025-09-29T21:24:04.934511] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-07. [2025-09-29T21:24:05.008890] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-06 (3.06 seconds). [2025-09-29T21:24:05.148117] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-07. [2025-09-29T21:24:05.593837] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-05 (2.85 seconds). [2025-09-29T21:24:05.739749] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-29T21:24:05.948165] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-08. [2025-09-29T21:24:06.474086] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-04 (2.93 seconds). [2025-09-29T21:24:06.555247] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-29T21:24:06.748206] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-05. [2025-09-29T21:24:07.345608] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-09-29T21:24:07.548156] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-09. [2025-09-29T21:24:08.061071] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-29T21:24:08.063680] [INFO ] [REMOTE ] TDF: Full fetch complete (10566 records). [2025-09-29T21:24:08.063759] [DEBUG] [VALIDATOR ] TDF: Validating primary data. [2025-09-29T21:24:08.349777] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-06. [2025-09-29T21:24:08.450959] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-29T21:24:08.551303] [DEBUG] [VALIDATOR ] TDF: All expected trading days are present. [2025-09-29T21:24:08.551390] [DEBUG] [VALIDATOR ] TDF: Primary data validation passed. [2025-09-29T21:24:08.551688] [INFO ] [MAIN ] TDF: Fetched primary data is valid. [2025-09-29T21:24:08.551751] [DEBUG] [LOCAL ] TDF: Saving primary data. [2025-09-29T21:24:08.552295] [DEBUG] [LOCAL ] TDF: Trimmed 10566 records to 6433 (keeping 200 days of data) [2025-09-29T21:24:08.595739] [DEBUG] [LOCAL ] TDF: Primary data saved (6433 records). [2025-09-29T21:24:08.595876] [INFO ] [MAIN ] TDF: Full history saved. [2025-09-29T21:24:08.595965] [INFO ] [MAIN ] Update Progress: 2056/2371 symbols completed. TDF took 24.1s. Estimated remaining: 40m 28s. Rate: 7.8 symbols/min [2025-09-29T21:24:08.778396] [INFO ] [MAIN ] TDOC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:24:08.846025] [DEBUG] [LOCAL ] TDOC: Loaded 54125 existing records from primary storage. [2025-09-29T21:24:08.846370] [INFO ] [MAIN ] TDOC: Loaded 54125 existing records. [2025-09-29T21:24:09.032120] [WARN ] [MAIN ] TDOC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:24:09.032343] [INFO ] [MAIN ] TDOC: Wiping existing primary data before full refresh. [2025-09-29T21:24:09.032392] [INFO ] [LOCAL ] TDOC: Starting deletion of primary data. [2025-09-29T21:24:09.032894] [DEBUG] [LOCAL ] TDOC: Deleted primary data file. [2025-09-29T21:24:09.032960] [INFO ] [MAIN ] TDOC: Starting full primary refresh. [2025-09-29T21:24:09.153293] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-06. [2025-09-29T21:24:09.459795] [INFO ] [REMOTE ] TDOC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:24:09.575493] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-29T21:24:09.948131] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-07. [2025-09-29T21:24:10.753252] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2024-12. [2025-09-29T21:24:10.765789] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-29T21:24:10.825882] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-29T21:24:11.548159] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-08. [2025-09-29T21:24:12.348148] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-08. [2025-09-29T21:24:12.767869] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-29T21:24:12.997778] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-29T21:24:13.148121] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-01. [2025-09-29T21:24:13.310300] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-29T21:24:13.948122] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-09. [2025-09-29T21:24:14.748123] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-07. [2025-09-29T21:24:15.197744] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-29T21:24:15.548110] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-02. [2025-09-29T21:24:15.759331] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-29T21:24:15.770411] [INFO ] [REMOTE ] TD: Full fetch complete (75789 records). [2025-09-29T21:24:15.770561] [DEBUG] [VALIDATOR ] TD: Validating primary data. [2025-09-29T21:24:16.218930] [DEBUG] [VALIDATOR ] TD: All expected trading days are present. [2025-09-29T21:24:16.219170] [DEBUG] [VALIDATOR ] TD: Primary data validation passed. [2025-09-29T21:24:16.220500] [INFO ] [MAIN ] TD: Fetched primary data is valid. [2025-09-29T21:24:16.220585] [DEBUG] [LOCAL ] TD: Saving primary data. [2025-09-29T21:24:16.237031] [DEBUG] [LOCAL ] TD: Trimmed 75789 records to 52270 (keeping 200 days of data) [2025-09-29T21:24:16.252583] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-29T21:24:16.360418] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-09. [2025-09-29T21:24:16.616178] [DEBUG] [LOCAL ] TD: Primary data saved (52270 records). [2025-09-29T21:24:16.616331] [INFO ] [MAIN ] TD: Full history saved. [2025-09-29T21:24:16.616420] [INFO ] [MAIN ] Update Progress: 2057/2371 symbols completed. TD took 40.7s. Estimated remaining: 40m 20s. Rate: 7.8 symbols/min [2025-09-29T21:24:16.800960] [INFO ] [MAIN ] TDS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:24:16.857251] [DEBUG] [LOCAL ] TDS: Loaded 43435 existing records from primary storage. [2025-09-29T21:24:16.858361] [INFO ] [MAIN ] TDS: Loaded 43435 existing records. [2025-09-29T21:24:17.059851] [WARN ] [MAIN ] TDS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:24:17.060221] [INFO ] [MAIN ] TDS: Wiping existing primary data before full refresh. [2025-09-29T21:24:17.060284] [INFO ] [LOCAL ] TDS: Starting deletion of primary data. [2025-09-29T21:24:17.061063] [DEBUG] [LOCAL ] TDS: Deleted primary data file. [2025-09-29T21:24:17.061137] [INFO ] [MAIN ] TDS: Starting full primary refresh. [2025-09-29T21:24:17.158081] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-08. [2025-09-29T21:24:17.456450] [INFO ] [REMOTE ] TDS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:24:17.555886] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-29T21:24:17.592877] [INFO ] [REMOTE ] TDG: Full fetch complete (32020 records). [2025-09-29T21:24:17.593133] [DEBUG] [VALIDATOR ] TDG: Validating primary data. [2025-09-29T21:24:17.596603] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-29T21:24:17.957909] [INFO ] [REMOTE ] TDS: Fetching primary data for 2024-12. [2025-09-29T21:24:18.001328] [DEBUG] [VALIDATOR ] TDG: All expected trading days are present. [2025-09-29T21:24:18.001471] [DEBUG] [VALIDATOR ] TDG: Primary data validation passed. [2025-09-29T21:24:18.002329] [INFO ] [MAIN ] TDG: Fetched primary data is valid. [2025-09-29T21:24:18.002429] [DEBUG] [LOCAL ] TDG: Saving primary data. [2025-09-29T21:24:18.003909] [DEBUG] [LOCAL ] TDG: Trimmed 32020 records to 21894 (keeping 200 days of data) [2025-09-29T21:24:18.170515] [DEBUG] [LOCAL ] TDG: Primary data saved (21894 records). [2025-09-29T21:24:18.170735] [INFO ] [MAIN ] TDG: Full history saved. [2025-09-29T21:24:18.170880] [INFO ] [MAIN ] Update Progress: 2058/2371 symbols completed. TDG took 31.3s. Estimated remaining: 40m 11s. Rate: 7.8 symbols/min [2025-09-29T21:24:18.347211] [INFO ] [MAIN ] TDW: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:24:18.391717] [DEBUG] [LOCAL ] TDW: Loaded 46091 existing records from primary storage. [2025-09-29T21:24:18.392021] [INFO ] [MAIN ] TDW: Loaded 46091 existing records. [2025-09-29T21:24:18.576486] [WARN ] [MAIN ] TDW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:24:18.576767] [INFO ] [MAIN ] TDW: Wiping existing primary data before full refresh. [2025-09-29T21:24:18.576853] [INFO ] [LOCAL ] TDW: Starting deletion of primary data. [2025-09-29T21:24:18.577172] [DEBUG] [LOCAL ] TDW: Deleted primary data file. [2025-09-29T21:24:18.577230] [INFO ] [MAIN ] TDW: Starting full primary refresh. [2025-09-29T21:24:18.757580] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-03. [2025-09-29T21:24:18.968039] [INFO ] [REMOTE ] TDW: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:24:19.000627] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-29T21:24:19.457400] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-29T21:24:19.548121] [INFO ] [REMOTE ] TDW: Fetching primary data for 2024-12. [2025-09-29T21:24:20.348128] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-01. [2025-09-29T21:24:20.901252] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-29T21:24:21.005552] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-29T21:24:21.148115] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-04. [2025-09-29T21:24:21.856450] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-29T21:24:21.948110] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-02. [2025-09-29T21:24:22.748212] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-01. [2025-09-29T21:24:23.000840] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-29T21:24:23.389237] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-29T21:24:23.548129] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-09. [2025-09-29T21:24:24.348171] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-05. [2025-09-29T21:24:24.484943] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-29T21:24:25.153207] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-03. [2025-09-29T21:24:25.168928] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-29T21:24:25.179103] [INFO ] [REMOTE ] TDC: Full fetch complete (66835 records). [2025-09-29T21:24:25.179264] [DEBUG] [VALIDATOR ] TDC: Validating primary data. [2025-09-29T21:24:25.585459] [DEBUG] [VALIDATOR ] TDC: All expected trading days are present. [2025-09-29T21:24:25.585554] [DEBUG] [VALIDATOR ] TDC: Primary data validation passed. [2025-09-29T21:24:25.586603] [INFO ] [MAIN ] TDC: Fetched primary data is valid. [2025-09-29T21:24:25.586691] [DEBUG] [LOCAL ] TDC: Saving primary data. [2025-09-29T21:24:25.588043] [DEBUG] [LOCAL ] TDC: Trimmed 66835 records to 46688 (keeping 200 days of data) [2025-09-29T21:24:25.887917] [DEBUG] [LOCAL ] TDC: Primary data saved (46688 records). [2025-09-29T21:24:25.888087] [INFO ] [MAIN ] TDC: Full history saved. [2025-09-29T21:24:25.888207] [INFO ] [MAIN ] Update Progress: 2059/2371 symbols completed. TDC took 46.9s. Estimated remaining: 40m 4s. Rate: 7.8 symbols/min [2025-09-29T21:24:25.956498] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-02. [2025-09-29T21:24:26.074144] [INFO ] [MAIN ] TDY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:24:26.108830] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-29T21:24:26.137906] [DEBUG] [LOCAL ] TDY: Loaded 22979 existing records from primary storage. [2025-09-29T21:24:26.138188] [INFO ] [MAIN ] TDY: Loaded 22979 existing records. [2025-09-29T21:24:26.323317] [WARN ] [MAIN ] TDY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:24:26.323595] [INFO ] [MAIN ] TDY: Wiping existing primary data before full refresh. [2025-09-29T21:24:26.323678] [INFO ] [LOCAL ] TDY: Starting deletion of primary data. [2025-09-29T21:24:26.323900] [DEBUG] [LOCAL ] TDY: Deleted primary data file. [2025-09-29T21:24:26.323958] [INFO ] [MAIN ] TDY: Starting full primary refresh. [2025-09-29T21:24:26.738913] [INFO ] [REMOTE ] TDY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:24:26.748065] [INFO ] [REMOTE ] TDY: Fetching primary data for 2024-12. [2025-09-29T21:24:26.829145] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-29T21:24:27.548118] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-06. [2025-09-29T21:24:27.737583] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-29T21:24:27.878099] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-29T21:24:28.348132] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-01. [2025-09-29T21:24:29.148122] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-03. [2025-09-29T21:24:29.483806] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-29T21:24:29.536198] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-29T21:24:29.948207] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-07. [2025-09-29T21:24:30.748200] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-02. [2025-09-29T21:24:30.876422] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-29T21:24:31.548153] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-04. [2025-09-29T21:24:31.882852] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-29T21:24:32.153963] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-29T21:24:32.348141] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-03. [2025-09-29T21:24:33.148154] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-04. [2025-09-29T21:24:33.283978] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-29T21:24:33.525707] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-29T21:24:33.948150] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-04. [2025-09-29T21:24:34.748076] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-08. [2025-09-29T21:24:34.914505] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-29T21:24:35.203523] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-29T21:24:35.548134] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-05. [2025-09-29T21:24:36.348121] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-05. [2025-09-29T21:24:36.654980] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-29T21:24:37.148102] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-09. [2025-09-29T21:24:37.197155] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-29T21:24:37.343134] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-29T21:24:37.948085] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-06. [2025-09-29T21:24:38.748080] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-06. [2025-09-29T21:24:39.086176] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-29T21:24:39.110927] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-29T21:24:39.110208] [INFO ] [REMOTE ] TDOC: Full fetch complete (77276 records). [2025-09-29T21:24:39.116507] [DEBUG] [VALIDATOR ] TDOC: Validating primary data. [2025-09-29T21:24:39.523113] [DEBUG] [VALIDATOR ] TDOC: All expected trading days are present. [2025-09-29T21:24:39.523282] [DEBUG] [VALIDATOR ] TDOC: Primary data validation passed. [2025-09-29T21:24:39.524623] [INFO ] [MAIN ] TDOC: Fetched primary data is valid. [2025-09-29T21:24:39.524717] [DEBUG] [LOCAL ] TDOC: Saving primary data. [2025-09-29T21:24:39.528092] [DEBUG] [LOCAL ] TDOC: Trimmed 77276 records to 53344 (keeping 200 days of data) [2025-09-29T21:24:39.576972] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-05. [2025-09-29T21:24:39.856075] [DEBUG] [LOCAL ] TDOC: Primary data saved (53344 records). [2025-09-29T21:24:39.856280] [INFO ] [MAIN ] TDOC: Full history saved. [2025-09-29T21:24:39.856484] [INFO ] [MAIN ] Update Progress: 2060/2371 symbols completed. TDOC took 31.3s. Estimated remaining: 39m 57s. Rate: 7.8 symbols/min [2025-09-29T21:24:40.035020] [INFO ] [MAIN ] TE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:24:40.035342] [DEBUG] [LOCAL ] TE: No existing data file found in primary storage. [2025-09-29T21:24:40.035450] [WARN ] [MAIN ] TE: No existing data found, performing full refresh instead. [2025-09-29T21:24:40.035607] [INFO ] [MAIN ] TE: Wiping existing primary data before full refresh. [2025-09-29T21:24:40.035715] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-09-29T21:24:40.035800] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-09-29T21:24:40.035850] [INFO ] [MAIN ] TE: Starting full primary refresh. [2025-09-29T21:24:40.214457] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-29T21:24:40.353219] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-07. [2025-09-29T21:24:40.462577] [INFO ] [REMOTE ] TE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:24:41.143261] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-29T21:24:41.152326] [INFO ] [REMOTE ] TE: Fetching primary data for 2024-12. [2025-09-29T21:24:41.349366] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T21:24:41.349703] [WARN ] [REMOTE ] TE: No data returned for month 2024-12 [2025-09-29T21:24:41.349812] [FATAL] [REMOTE ] TE: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T21:24:41.349893] [FATAL] [MAIN ] TE: Failed to fetch primary data. [2025-09-29T21:24:41.349977] [WARN ] [MAIN ] TE: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T21:24:41.350073] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-09-29T21:24:41.350155] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-09-29T21:24:41.350207] [INFO ] [LOCAL ] TE: Starting deletion of derivative data. [2025-09-29T21:24:41.350288] [DEBUG] [LOCAL ] TE: No derivative data file found to delete. [2025-09-29T21:24:41.350375] [INFO ] [MAIN ] Update Progress: 2061/2371 symbols completed. TE took 1.5s. Estimated remaining: 39m 48s. Rate: 7.8 symbols/min [2025-09-29T21:24:41.549466] [INFO ] [MAIN ] TEAF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:24:41.564495] [DEBUG] [LOCAL ] TEAF: Loaded 7529 existing records from primary storage. [2025-09-29T21:24:41.564848] [INFO ] [MAIN ] TEAF: Loaded 7529 existing records. [2025-09-29T21:24:41.762430] [WARN ] [MAIN ] TEAF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:24:41.762837] [INFO ] [MAIN ] TEAF: Wiping existing primary data before full refresh. [2025-09-29T21:24:41.762955] [INFO ] [LOCAL ] TEAF: Starting deletion of primary data. [2025-09-29T21:24:41.763257] [DEBUG] [LOCAL ] TEAF: Deleted primary data file. [2025-09-29T21:24:41.763441] [INFO ] [MAIN ] TEAF: Starting full primary refresh. [2025-09-29T21:24:41.896256] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-29T21:24:41.953186] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-08. [2025-09-29T21:24:42.183141] [INFO ] [REMOTE ] TEAF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:24:42.748095] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-07. [2025-09-29T21:24:43.069632] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-29T21:24:43.548112] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-06. [2025-09-29T21:24:44.348106] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-09. [2025-09-29T21:24:44.482620] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-29T21:24:44.612935] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-29T21:24:45.148096] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2024-12. [2025-09-29T21:24:45.495212] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-29T21:24:45.499720] [INFO ] [REMOTE ] TDY: Full fetch complete (32363 records). [2025-09-29T21:24:45.499828] [DEBUG] [VALIDATOR ] TDY: Validating primary data. [2025-09-29T21:24:45.930316] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-29T21:24:45.957499] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-01. [2025-09-29T21:24:45.976263] [DEBUG] [VALIDATOR ] TDY: All expected trading days are present. [2025-09-29T21:24:45.976352] [DEBUG] [VALIDATOR ] TDY: Primary data validation passed. [2025-09-29T21:24:45.977173] [INFO ] [MAIN ] TDY: Fetched primary data is valid. [2025-09-29T21:24:45.977255] [DEBUG] [LOCAL ] TDY: Saving primary data. [2025-09-29T21:24:45.978453] [DEBUG] [LOCAL ] TDY: Trimmed 32363 records to 22545 (keeping 200 days of data) [2025-09-29T21:24:46.144886] [DEBUG] [LOCAL ] TDY: Primary data saved (22545 records). [2025-09-29T21:24:46.145021] [INFO ] [MAIN ] TDY: Full history saved. [2025-09-29T21:24:46.145106] [INFO ] [MAIN ] Update Progress: 2062/2371 symbols completed. TDY took 20.3s. Estimated remaining: 39m 40s. Rate: 7.8 symbols/min [2025-09-29T21:24:46.371392] [INFO ] [MAIN ] TECK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:24:46.433827] [DEBUG] [LOCAL ] TECK: Loaded 54216 existing records from primary storage. [2025-09-29T21:24:46.434247] [INFO ] [MAIN ] TECK: Loaded 54216 existing records. [2025-09-29T21:24:46.666378] [WARN ] [MAIN ] TECK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:24:46.667569] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-29T21:24:46.670176] [INFO ] [MAIN ] TECK: Wiping existing primary data before full refresh. [2025-09-29T21:24:46.670252] [INFO ] [LOCAL ] TECK: Starting deletion of primary data. [2025-09-29T21:24:46.670606] [DEBUG] [LOCAL ] TECK: Deleted primary data file. [2025-09-29T21:24:46.670696] [INFO ] [MAIN ] TECK: Starting full primary refresh. [2025-09-29T21:24:46.753291] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-02. [2025-09-29T21:24:47.130425] [INFO ] [REMOTE ] TECK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:24:47.370483] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-29T21:24:47.548119] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-07. [2025-09-29T21:24:48.348117] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-08. [2025-09-29T21:24:48.863493] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-29T21:24:49.148106] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-08. [2025-09-29T21:24:49.948114] [INFO ] [REMOTE ] TECK: Fetching primary data for 2024-12. [2025-09-29T21:24:50.083783] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-29T21:24:50.748125] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-03. [2025-09-29T21:24:50.796078] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-29T21:24:51.333099] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-29T21:24:51.334074] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-29T21:24:51.548113] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-01. [2025-09-29T21:24:52.348119] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-04. [2025-09-29T21:24:53.143073] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-29T21:24:53.148052] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-05. [2025-09-29T21:24:53.402619] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-29T21:24:53.833665] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-29T21:24:53.948137] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-06. [2025-09-29T21:24:54.450230] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-29T21:24:54.748160] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-09. [2025-09-29T21:24:55.548122] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-02. [2025-09-29T21:24:56.285732] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-29T21:24:56.295112] [INFO ] [REMOTE ] TDW: Full fetch complete (67169 records). [2025-09-29T21:24:56.295278] [DEBUG] [VALIDATOR ] TDW: Validating primary data. [2025-09-29T21:24:56.353293] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-09. [2025-09-29T21:24:56.703767] [DEBUG] [VALIDATOR ] TDW: All expected trading days are present. [2025-09-29T21:24:56.703876] [DEBUG] [VALIDATOR ] TDW: Primary data validation passed. [2025-09-29T21:24:56.705043] [INFO ] [MAIN ] TDW: Fetched primary data is valid. [2025-09-29T21:24:56.705113] [DEBUG] [LOCAL ] TDW: Saving primary data. [2025-09-29T21:24:56.706693] [DEBUG] [LOCAL ] TDW: Trimmed 67169 records to 45406 (keeping 200 days of data) [2025-09-29T21:24:56.995746] [DEBUG] [LOCAL ] TDW: Primary data saved (45406 records). [2025-09-29T21:24:56.995890] [INFO ] [MAIN ] TDW: Full history saved. [2025-09-29T21:24:56.995980] [INFO ] [MAIN ] Update Progress: 2063/2371 symbols completed. TDW took 38.8s. Estimated remaining: 39m 33s. Rate: 7.8 symbols/min [2025-09-29T21:24:57.173357] [INFO ] [MAIN ] TEF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:24:57.169590] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-07. [2025-09-29T21:24:57.211446] [DEBUG] [LOCAL ] TEF: Loaded 37944 existing records from primary storage. [2025-09-29T21:24:57.211844] [INFO ] [MAIN ] TEF: Loaded 37944 existing records. [2025-09-29T21:24:57.437836] [WARN ] [MAIN ] TEF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:24:57.441009] [INFO ] [MAIN ] TEF: Wiping existing primary data before full refresh. [2025-09-29T21:24:57.440914] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-29T21:24:57.441324] [INFO ] [LOCAL ] TEF: Starting deletion of primary data. [2025-09-29T21:24:57.452260] [DEBUG] [LOCAL ] TEF: Deleted primary data file. [2025-09-29T21:24:57.452332] [INFO ] [MAIN ] TEF: Starting full primary refresh. [2025-09-29T21:24:57.909163] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-29T21:24:57.949259] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-03. [2025-09-29T21:24:57.980701] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-29T21:24:58.032486] [INFO ] [REMOTE ] TEF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:24:58.033858] [INFO ] [REMOTE ] TDS: Full fetch complete (61577 records). [2025-09-29T21:24:58.034064] [DEBUG] [VALIDATOR ] TDS: Validating primary data. [2025-09-29T21:24:58.458304] [DEBUG] [VALIDATOR ] TDS: All expected trading days are present. [2025-09-29T21:24:58.458403] [DEBUG] [VALIDATOR ] TDS: Primary data validation passed. [2025-09-29T21:24:58.459746] [INFO ] [MAIN ] TDS: Fetched primary data is valid. [2025-09-29T21:24:58.459815] [DEBUG] [LOCAL ] TDS: Saving primary data. [2025-09-29T21:24:58.461074] [DEBUG] [LOCAL ] TDS: Trimmed 61577 records to 42693 (keeping 200 days of data) [2025-09-29T21:24:58.739389] [DEBUG] [LOCAL ] TDS: Primary data saved (42693 records). [2025-09-29T21:24:58.739564] [INFO ] [MAIN ] TDS: Full history saved. [2025-09-29T21:24:58.739719] [INFO ] [MAIN ] Update Progress: 2064/2371 symbols completed. TDS took 42.1s. Estimated remaining: 39m 24s. Rate: 7.8 symbols/min [2025-09-29T21:24:58.754026] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-08. [2025-09-29T21:24:58.917275] [INFO ] [MAIN ] TEI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:24:58.938840] [DEBUG] [LOCAL ] TEI: Loaded 20910 existing records from primary storage. [2025-09-29T21:24:58.939121] [INFO ] [MAIN ] TEI: Loaded 20910 existing records. [2025-09-29T21:24:59.153157] [WARN ] [MAIN ] TEI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:24:59.153394] [INFO ] [MAIN ] TEI: Wiping existing primary data before full refresh. [2025-09-29T21:24:59.153443] [INFO ] [LOCAL ] TEI: Starting deletion of primary data. [2025-09-29T21:24:59.153788] [DEBUG] [LOCAL ] TEI: Deleted primary data file. [2025-09-29T21:24:59.153848] [INFO ] [MAIN ] TEI: Starting full primary refresh. [2025-09-29T21:24:59.534105] [INFO ] [REMOTE ] TEI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:24:59.545387] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-29T21:24:59.548055] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-09. [2025-09-29T21:24:59.598273] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-29T21:25:00.311682] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-29T21:25:00.313779] [INFO ] [REMOTE ] TEAF: Full fetch complete (9927 records). [2025-09-29T21:25:00.313853] [DEBUG] [VALIDATOR ] TEAF: Validating primary data. [2025-09-29T21:25:00.353292] [INFO ] [REMOTE ] TEF: Fetching primary data for 2024-12. [2025-09-29T21:25:00.686280] [DEBUG] [VALIDATOR ] TEAF: All expected trading days are present. [2025-09-29T21:25:00.686366] [DEBUG] [VALIDATOR ] TEAF: Primary data validation passed. [2025-09-29T21:25:00.686637] [INFO ] [MAIN ] TEAF: Fetched primary data is valid. [2025-09-29T21:25:00.686723] [DEBUG] [LOCAL ] TEAF: Saving primary data. [2025-09-29T21:25:00.687370] [DEBUG] [LOCAL ] TEAF: Trimmed 9927 records to 7473 (keeping 200 days of data) [2025-09-29T21:25:00.736259] [DEBUG] [LOCAL ] TEAF: Primary data saved (7473 records). [2025-09-29T21:25:00.736409] [INFO ] [MAIN ] TEAF: Full history saved. [2025-09-29T21:25:00.736537] [INFO ] [MAIN ] Update Progress: 2065/2371 symbols completed. TEAF took 19.4s. Estimated remaining: 39m 16s. Rate: 7.8 symbols/min [2025-09-29T21:25:00.918930] [INFO ] [MAIN ] TEL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:25:00.990050] [DEBUG] [LOCAL ] TEL: Loaded 51898 existing records from primary storage. [2025-09-29T21:25:00.990394] [INFO ] [MAIN ] TEL: Loaded 51898 existing records. [2025-09-29T21:25:01.165985] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-04. [2025-09-29T21:25:01.172364] [WARN ] [MAIN ] TEL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:25:01.173722] [INFO ] [MAIN ] TEL: Wiping existing primary data before full refresh. [2025-09-29T21:25:01.173807] [INFO ] [LOCAL ] TEL: Starting deletion of primary data. [2025-09-29T21:25:01.174258] [DEBUG] [LOCAL ] TEL: Deleted primary data file. [2025-09-29T21:25:01.174318] [INFO ] [MAIN ] TEL: Starting full primary refresh. [2025-09-29T21:25:01.591055] [INFO ] [REMOTE ] TEL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:25:01.948136] [INFO ] [REMOTE ] TEL: Fetching primary data for 2024-12. [2025-09-29T21:25:02.017006] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-29T21:25:02.747034] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-29T21:25:02.757707] [INFO ] [REMOTE ] TEI: Fetching primary data for 2024-12. [2025-09-29T21:25:03.548078] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-01. [2025-09-29T21:25:03.652051] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-29T21:25:03.835596] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-29T21:25:04.348132] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-05. [2025-09-29T21:25:05.105251] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-29T21:25:05.148128] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-02. [2025-09-29T21:25:05.854253] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-29T21:25:05.948159] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-01. [2025-09-29T21:25:06.505874] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-29T21:25:06.748140] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-01. [2025-09-29T21:25:07.078442] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-29T21:25:07.548115] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-03. [2025-09-29T21:25:08.348088] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-02. [2025-09-29T21:25:08.609476] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-29T21:25:09.126634] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-29T21:25:09.148057] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-02. [2025-09-29T21:25:09.461411] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-29T21:25:09.948161] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-04. [2025-09-29T21:25:10.781439] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-06. [2025-09-29T21:25:10.800723] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-29T21:25:11.508958] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-29T21:25:11.548068] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-05. [2025-09-29T21:25:12.278299] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-29T21:25:12.348098] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-07. [2025-09-29T21:25:13.021782] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-29T21:25:13.148127] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-03. [2025-09-29T21:25:13.948166] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-06. [2025-09-29T21:25:14.313883] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-29T21:25:14.419801] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-29T21:25:14.748119] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-03. [2025-09-29T21:25:15.349460] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-29T21:25:15.548122] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-08. [2025-09-29T21:25:16.348159] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-04. [2025-09-29T21:25:16.585180] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-29T21:25:17.037337] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-29T21:25:17.148190] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-09. [2025-09-29T21:25:17.443299] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-29T21:25:17.948124] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-04. [2025-09-29T21:25:18.748158] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-07. [2025-09-29T21:25:18.962423] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-29T21:25:18.974557] [INFO ] [REMOTE ] TECK: Full fetch complete (77306 records). [2025-09-29T21:25:18.974742] [DEBUG] [VALIDATOR ] TECK: Validating primary data. [2025-09-29T21:25:19.400435] [DEBUG] [VALIDATOR ] TECK: All expected trading days are present. [2025-09-29T21:25:19.400529] [DEBUG] [VALIDATOR ] TECK: Primary data validation passed. [2025-09-29T21:25:19.401841] [INFO ] [MAIN ] TECK: Fetched primary data is valid. [2025-09-29T21:25:19.401936] [DEBUG] [LOCAL ] TECK: Saving primary data. [2025-09-29T21:25:19.403488] [DEBUG] [LOCAL ] TECK: Trimmed 77306 records to 53436 (keeping 200 days of data) [2025-09-29T21:25:19.591119] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-05. [2025-09-29T21:25:19.799518] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-29T21:25:19.802382] [DEBUG] [LOCAL ] TECK: Primary data saved (53436 records). [2025-09-29T21:25:19.814285] [INFO ] [MAIN ] TECK: Full history saved. [2025-09-29T21:25:19.815163] [INFO ] [MAIN ] Update Progress: 2066/2371 symbols completed. TECK took 33.7s. Estimated remaining: 39m 10s. Rate: 7.8 symbols/min [2025-09-29T21:25:20.007137] [INFO ] [MAIN ] TEN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:25:20.030319] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-29T21:25:20.072303] [DEBUG] [LOCAL ] TEN: Loaded 31383 existing records from primary storage. [2025-09-29T21:25:20.072708] [INFO ] [MAIN ] TEN: Loaded 31383 existing records. [2025-09-29T21:25:20.265616] [WARN ] [MAIN ] TEN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:25:20.265938] [INFO ] [MAIN ] TEN: Wiping existing primary data before full refresh. [2025-09-29T21:25:20.266003] [INFO ] [LOCAL ] TEN: Starting deletion of primary data. [2025-09-29T21:25:20.266464] [DEBUG] [LOCAL ] TEN: Deleted primary data file. [2025-09-29T21:25:20.266522] [INFO ] [MAIN ] TEN: Starting full primary refresh. [2025-09-29T21:25:20.353180] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-08. [2025-09-29T21:25:20.664035] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-29T21:25:20.701966] [INFO ] [REMOTE ] TEN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:25:21.148123] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-06. [2025-09-29T21:25:21.636753] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-29T21:25:21.948113] [INFO ] [REMOTE ] TEN: Fetching primary data for 2024-12. [2025-09-29T21:25:22.215882] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-29T21:25:22.748139] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-07. [2025-09-29T21:25:23.309773] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-29T21:25:23.548077] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-05. [2025-09-29T21:25:23.718973] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-29T21:25:24.348151] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-09. [2025-09-29T21:25:24.884334] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-29T21:25:25.148123] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-08. [2025-09-29T21:25:25.702450] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-29T21:25:25.711687] [INFO ] [REMOTE ] TEF: Full fetch complete (54659 records). [2025-09-29T21:25:25.711875] [DEBUG] [VALIDATOR ] TEF: Validating primary data. [2025-09-29T21:25:25.954142] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-06. [2025-09-29T21:25:26.168730] [DEBUG] [VALIDATOR ] TEF: All expected trading days are present. [2025-09-29T21:25:26.168578] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-29T21:25:26.168963] [DEBUG] [VALIDATOR ] TEF: Primary data validation passed. [2025-09-29T21:25:26.176242] [INFO ] [MAIN ] TEF: Fetched primary data is valid. [2025-09-29T21:25:26.176756] [DEBUG] [LOCAL ] TEF: Saving primary data. [2025-09-29T21:25:26.178237] [DEBUG] [LOCAL ] TEF: Trimmed 54659 records to 37364 (keeping 200 days of data) [2025-09-29T21:25:26.420136] [DEBUG] [LOCAL ] TEF: Primary data saved (37364 records). [2025-09-29T21:25:26.420285] [INFO ] [MAIN ] TEF: Full history saved. [2025-09-29T21:25:26.420433] [INFO ] [MAIN ] Update Progress: 2067/2371 symbols completed. TEF took 29.4s. Estimated remaining: 39m 2s. Rate: 7.8 symbols/min [2025-09-29T21:25:26.605070] [INFO ] [MAIN ] TEO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:25:26.628985] [DEBUG] [LOCAL ] TEO: Loaded 22345 existing records from primary storage. [2025-09-29T21:25:26.629269] [INFO ] [MAIN ] TEO: Loaded 22345 existing records. [2025-09-29T21:25:26.753298] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-01. [2025-09-29T21:25:26.815309] [WARN ] [MAIN ] TEO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:25:26.815580] [INFO ] [MAIN ] TEO: Wiping existing primary data before full refresh. [2025-09-29T21:25:26.815633] [INFO ] [LOCAL ] TEO: Starting deletion of primary data. [2025-09-29T21:25:26.815979] [DEBUG] [LOCAL ] TEO: Deleted primary data file. [2025-09-29T21:25:26.816039] [INFO ] [MAIN ] TEO: Starting full primary refresh. [2025-09-29T21:25:27.196431] [INFO ] [REMOTE ] TEO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:25:27.548129] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-09. [2025-09-29T21:25:27.843572] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-29T21:25:28.064597] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-29T21:25:28.348104] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-02. [2025-09-29T21:25:28.633572] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-29T21:25:28.638472] [INFO ] [REMOTE ] TEI: Full fetch complete (30214 records). [2025-09-29T21:25:28.638557] [DEBUG] [VALIDATOR ] TEI: Validating primary data. [2025-09-29T21:25:29.030268] [DEBUG] [VALIDATOR ] TEI: All expected trading days are present. [2025-09-29T21:25:29.030378] [DEBUG] [VALIDATOR ] TEI: Primary data validation passed. [2025-09-29T21:25:29.031089] [INFO ] [MAIN ] TEI: Fetched primary data is valid. [2025-09-29T21:25:29.031179] [DEBUG] [LOCAL ] TEI: Saving primary data. [2025-09-29T21:25:29.032225] [DEBUG] [LOCAL ] TEI: Trimmed 30214 records to 20866 (keeping 200 days of data) [2025-09-29T21:25:29.148165] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-07. [2025-09-29T21:25:29.167944] [DEBUG] [LOCAL ] TEI: Primary data saved (20866 records). [2025-09-29T21:25:29.168085] [INFO ] [MAIN ] TEI: Full history saved. [2025-09-29T21:25:29.168168] [INFO ] [MAIN ] Update Progress: 2068/2371 symbols completed. TEI took 30.4s. Estimated remaining: 38m 53s. Rate: 7.8 symbols/min [2025-09-29T21:25:29.353352] [INFO ] [MAIN ] TEVA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:25:29.412499] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-29T21:25:29.440434] [DEBUG] [LOCAL ] TEVA: Loaded 54413 existing records from primary storage. [2025-09-29T21:25:29.440813] [INFO ] [MAIN ] TEVA: Loaded 54413 existing records. [2025-09-29T21:25:29.637184] [WARN ] [MAIN ] TEVA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:25:29.637405] [INFO ] [MAIN ] TEVA: Wiping existing primary data before full refresh. [2025-09-29T21:25:29.637457] [INFO ] [LOCAL ] TEVA: Starting deletion of primary data. [2025-09-29T21:25:29.637820] [DEBUG] [LOCAL ] TEVA: Deleted primary data file. [2025-09-29T21:25:29.637880] [INFO ] [MAIN ] TEVA: Starting full primary refresh. [2025-09-29T21:25:29.953256] [INFO ] [REMOTE ] TEO: Fetching primary data for 2024-12. [2025-09-29T21:25:30.031944] [INFO ] [REMOTE ] TEVA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:25:30.748109] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2024-12. [2025-09-29T21:25:31.051873] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-29T21:25:31.153762] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-29T21:25:31.548156] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-01. [2025-09-29T21:25:32.348208] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-03. [2025-09-29T21:25:32.769789] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-29T21:25:32.807509] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-29T21:25:33.148117] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-01. [2025-09-29T21:25:33.450691] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-29T21:25:33.948137] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-08. [2025-09-29T21:25:34.748129] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-04. [2025-09-29T21:25:34.852572] [DEBUG] [REMOTE ] TEN: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-09-29T21:25:34.852950] [WARN ] [REMOTE ] TEN: No data returned for month 2025-04 [2025-09-29T21:25:34.853041] [FATAL] [REMOTE ] TEN: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T21:25:34.853130] [FATAL] [MAIN ] TEN: Failed to fetch primary data. [2025-09-29T21:25:34.853196] [WARN ] [MAIN ] TEN: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T21:25:34.853272] [INFO ] [LOCAL ] TEN: Starting deletion of primary data. [2025-09-29T21:25:34.853338] [DEBUG] [LOCAL ] TEN: No primary data file found to delete. [2025-09-29T21:25:34.853376] [INFO ] [LOCAL ] TEN: Starting deletion of derivative data. [2025-09-29T21:25:34.854032] [DEBUG] [LOCAL ] TEN: Deleted derivative data file. [2025-09-29T21:25:34.854127] [INFO ] [MAIN ] Update Progress: 2069/2371 symbols completed. TEN took 15.0s. Estimated remaining: 38m 45s. Rate: 7.8 symbols/min [2025-09-29T21:25:35.043603] [INFO ] [MAIN ] TEX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:25:35.094471] [DEBUG] [LOCAL ] TEX: Loaded 45170 existing records from primary storage. [2025-09-29T21:25:35.094922] [INFO ] [MAIN ] TEX: Loaded 45170 existing records. [2025-09-29T21:25:35.305709] [WARN ] [MAIN ] TEX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:25:35.325241] [INFO ] [MAIN ] TEX: Wiping existing primary data before full refresh. [2025-09-29T21:25:35.327174] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-29T21:25:35.326043] [INFO ] [LOCAL ] TEX: Starting deletion of primary data. [2025-09-29T21:25:35.338301] [DEBUG] [LOCAL ] TEX: Deleted primary data file. [2025-09-29T21:25:35.338413] [INFO ] [MAIN ] TEX: Starting full primary refresh. [2025-09-29T21:25:35.553254] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-02. [2025-09-29T21:25:35.711470] [INFO ] [REMOTE ] TEX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:25:35.744747] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-29T21:25:36.348075] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-02. [2025-09-29T21:25:36.670676] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-29T21:25:37.148134] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-09. [2025-09-29T21:25:37.948135] [INFO ] [REMOTE ] TEX: Fetching primary data for 2024-12. [2025-09-29T21:25:38.088031] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-29T21:25:38.748146] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-03. [2025-09-29T21:25:38.807013] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-29T21:25:38.817867] [INFO ] [REMOTE ] TEL: Full fetch complete (73382 records). [2025-09-29T21:25:38.818059] [DEBUG] [VALIDATOR ] TEL: Validating primary data. [2025-09-29T21:25:39.255363] [DEBUG] [VALIDATOR ] TEL: All expected trading days are present. [2025-09-29T21:25:39.255460] [DEBUG] [VALIDATOR ] TEL: Primary data validation passed. [2025-09-29T21:25:39.256777] [INFO ] [MAIN ] TEL: Fetched primary data is valid. [2025-09-29T21:25:39.256852] [DEBUG] [LOCAL ] TEL: Saving primary data. [2025-09-29T21:25:39.258969] [DEBUG] [LOCAL ] TEL: Trimmed 73382 records to 51130 (keeping 200 days of data) [2025-09-29T21:25:39.551308] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-03. [2025-09-29T21:25:39.557605] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-29T21:25:39.652490] [DEBUG] [LOCAL ] TEL: Primary data saved (51130 records). [2025-09-29T21:25:39.652703] [INFO ] [MAIN ] TEL: Full history saved. [2025-09-29T21:25:39.652834] [INFO ] [MAIN ] Update Progress: 2070/2371 symbols completed. TEL took 38.9s. Estimated remaining: 38m 37s. Rate: 7.8 symbols/min [2025-09-29T21:25:39.865549] [INFO ] [MAIN ] TFC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:25:39.938587] [DEBUG] [LOCAL ] TFC: Loaded 54447 existing records from primary storage. [2025-09-29T21:25:39.939020] [INFO ] [MAIN ] TFC: Loaded 54447 existing records. [2025-09-29T21:25:40.140136] [WARN ] [MAIN ] TFC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:25:40.140468] [INFO ] [MAIN ] TFC: Wiping existing primary data before full refresh. [2025-09-29T21:25:40.140532] [INFO ] [LOCAL ] TFC: Starting deletion of primary data. [2025-09-29T21:25:40.141122] [DEBUG] [LOCAL ] TFC: Deleted primary data file. [2025-09-29T21:25:40.141185] [INFO ] [MAIN ] TFC: Starting full primary refresh. [2025-09-29T21:25:40.349919] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-01. [2025-09-29T21:25:40.465121] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-29T21:25:40.543882] [INFO ] [REMOTE ] TFC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:25:40.807489] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-29T21:25:41.148119] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-04. [2025-09-29T21:25:41.948095] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-04. [2025-09-29T21:25:41.994822] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-29T21:25:42.748143] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-02. [2025-09-29T21:25:42.816681] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-29T21:25:42.935090] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-29T21:25:43.548123] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-05. [2025-09-29T21:25:44.348099] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-05. [2025-09-29T21:25:44.379433] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-29T21:25:45.148122] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-03. [2025-09-29T21:25:45.425184] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-29T21:25:45.831907] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-29T21:25:45.948107] [INFO ] [REMOTE ] TFC: Fetching primary data for 2024-12. [2025-09-29T21:25:46.477936] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-29T21:25:46.748107] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-04. [2025-09-29T21:25:47.548110] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-06. [2025-09-29T21:25:47.784594] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-29T21:25:48.348100] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-01. [2025-09-29T21:25:48.424871] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-29T21:25:48.685905] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-29T21:25:49.148108] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-06. [2025-09-29T21:25:49.948092] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-05. [2025-09-29T21:25:49.979357] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-29T21:25:50.748175] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-02. [2025-09-29T21:25:51.076671] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-29T21:25:51.548166] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-07. [2025-09-29T21:25:51.835453] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-29T21:25:52.348137] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-06. [2025-09-29T21:25:52.414335] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-29T21:25:52.468219] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-29T21:25:53.148130] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-03. [2025-09-29T21:25:53.793930] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-29T21:25:53.948132] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-07. [2025-09-29T21:25:54.748136] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-08. [2025-09-29T21:25:55.115054] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-29T21:25:55.538726] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-29T21:25:55.548065] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-09. [2025-09-29T21:25:55.684794] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-29T21:25:56.348154] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-04. [2025-09-29T21:25:56.793207] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-29T21:25:56.799575] [INFO ] [REMOTE ] TEO: Full fetch complete (32816 records). [2025-09-29T21:25:56.799732] [DEBUG] [VALIDATOR ] TEO: Validating primary data. [2025-09-29T21:25:57.158583] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-08. [2025-09-29T21:25:57.189963] [DEBUG] [VALIDATOR ] TEO: All expected trading days are present. [2025-09-29T21:25:57.190853] [DEBUG] [VALIDATOR ] TEO: Primary data validation passed. [2025-09-29T21:25:57.191691] [INFO ] [MAIN ] TEO: Fetched primary data is valid. [2025-09-29T21:25:57.191865] [DEBUG] [LOCAL ] TEO: Saving primary data. [2025-09-29T21:25:57.192831] [DEBUG] [LOCAL ] TEO: Trimmed 32816 records to 22040 (keeping 200 days of data) [2025-09-29T21:25:57.342387] [DEBUG] [LOCAL ] TEO: Primary data saved (22040 records). [2025-09-29T21:25:57.342849] [INFO ] [MAIN ] TEO: Full history saved. [2025-09-29T21:25:57.343034] [INFO ] [MAIN ] Update Progress: 2071/2371 symbols completed. TEO took 30.9s. Estimated remaining: 38m 31s. Rate: 7.8 symbols/min [2025-09-29T21:25:57.531981] [INFO ] [MAIN ] TFII: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:25:57.575100] [DEBUG] [LOCAL ] TFII: Loaded 34733 existing records from primary storage. [2025-09-29T21:25:57.575489] [INFO ] [MAIN ] TFII: Loaded 34733 existing records. [2025-09-29T21:25:57.763063] [WARN ] [MAIN ] TFII: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:25:57.763323] [INFO ] [MAIN ] TFII: Wiping existing primary data before full refresh. [2025-09-29T21:25:57.763379] [INFO ] [LOCAL ] TFII: Starting deletion of primary data. [2025-09-29T21:25:57.764060] [DEBUG] [LOCAL ] TFII: Deleted primary data file. [2025-09-29T21:25:57.764138] [INFO ] [MAIN ] TFII: Starting full primary refresh. [2025-09-29T21:25:57.953977] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-07. [2025-09-29T21:25:58.159532] [INFO ] [REMOTE ] TFII: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:25:58.358590] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-29T21:25:58.752853] [INFO ] [REMOTE ] TFII: Fetching primary data for 2024-12. [2025-09-29T21:25:58.767463] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-29T21:25:59.548128] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-05. [2025-09-29T21:25:59.961218] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-29T21:25:59.989097] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-29T21:26:00.348138] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-01. [2025-09-29T21:26:01.153485] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-09. [2025-09-29T21:26:01.188935] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-29T21:26:01.538695] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-29T21:26:01.948145] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-02. [2025-09-29T21:26:02.748157] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-08. [2025-09-29T21:26:02.938469] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-29T21:26:02.947685] [INFO ] [REMOTE ] TEX: Full fetch complete (64710 records). [2025-09-29T21:26:02.947887] [DEBUG] [VALIDATOR ] TEX: Validating primary data. [2025-09-29T21:26:03.417982] [DEBUG] [VALIDATOR ] TEX: All expected trading days are present. [2025-09-29T21:26:03.418194] [DEBUG] [VALIDATOR ] TEX: Primary data validation passed. [2025-09-29T21:26:03.419277] [INFO ] [MAIN ] TEX: Fetched primary data is valid. [2025-09-29T21:26:03.419494] [DEBUG] [LOCAL ] TEX: Saving primary data. [2025-09-29T21:26:03.427690] [DEBUG] [LOCAL ] TEX: Trimmed 64710 records to 44379 (keeping 200 days of data) [2025-09-29T21:26:03.440279] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-29T21:26:03.548107] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-03. [2025-09-29T21:26:03.739975] [DEBUG] [LOCAL ] TEX: Primary data saved (44379 records). [2025-09-29T21:26:03.740129] [INFO ] [MAIN ] TEX: Full history saved. [2025-09-29T21:26:03.740237] [INFO ] [MAIN ] Update Progress: 2072/2371 symbols completed. TEX took 28.9s. Estimated remaining: 38m 23s. Rate: 7.8 symbols/min [2025-09-29T21:26:03.926731] [INFO ] [MAIN ] TFIN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:26:03.950577] [DEBUG] [LOCAL ] TFIN: Loaded 23896 existing records from primary storage. [2025-09-29T21:26:03.950951] [INFO ] [MAIN ] TFIN: Loaded 23896 existing records. [2025-09-29T21:26:04.147855] [WARN ] [MAIN ] TFIN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:26:04.148109] [INFO ] [MAIN ] TFIN: Wiping existing primary data before full refresh. [2025-09-29T21:26:04.148166] [INFO ] [LOCAL ] TFIN: Starting deletion of primary data. [2025-09-29T21:26:04.148443] [DEBUG] [LOCAL ] TFIN: Deleted primary data file. [2025-09-29T21:26:04.148502] [INFO ] [MAIN ] TFIN: Starting full primary refresh. [2025-09-29T21:26:04.375363] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-06. [2025-09-29T21:26:04.538438] [INFO ] [REMOTE ] TFIN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:26:04.820249] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-29T21:26:04.866070] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-29T21:26:05.148126] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-09. [2025-09-29T21:26:05.948075] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-04. [2025-09-29T21:26:06.039800] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-29T21:26:06.748147] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2024-12. [2025-09-29T21:26:07.282321] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-29T21:26:07.293990] [INFO ] [REMOTE ] TEVA: Full fetch complete (77683 records). [2025-09-29T21:26:07.294188] [DEBUG] [VALIDATOR ] TEVA: Validating primary data. [2025-09-29T21:26:07.549548] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-07. [2025-09-29T21:26:07.703817] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-29T21:26:07.758876] [DEBUG] [VALIDATOR ] TEVA: All expected trading days are present. [2025-09-29T21:26:07.758970] [DEBUG] [VALIDATOR ] TEVA: Primary data validation passed. [2025-09-29T21:26:07.760170] [INFO ] [MAIN ] TEVA: Fetched primary data is valid. [2025-09-29T21:26:07.760249] [DEBUG] [LOCAL ] TEVA: Saving primary data. [2025-09-29T21:26:07.785855] [DEBUG] [LOCAL ] TEVA: Trimmed 77683 records to 53632 (keeping 200 days of data) [2025-09-29T21:26:07.788291] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-29T21:26:08.185788] [DEBUG] [LOCAL ] TEVA: Primary data saved (53632 records). [2025-09-29T21:26:08.185948] [INFO ] [MAIN ] TEVA: Full history saved. [2025-09-29T21:26:08.186067] [INFO ] [MAIN ] Update Progress: 2073/2371 symbols completed. TEVA took 39.0s. Estimated remaining: 38m 15s. Rate: 7.8 symbols/min [2025-09-29T21:26:08.362087] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-05. [2025-09-29T21:26:08.366964] [INFO ] [MAIN ] TFPM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:26:08.407453] [DEBUG] [LOCAL ] TFPM: Loaded 37997 existing records from primary storage. [2025-09-29T21:26:08.407792] [INFO ] [MAIN ] TFPM: Loaded 37997 existing records. [2025-09-29T21:26:08.606958] [WARN ] [MAIN ] TFPM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:26:08.607259] [INFO ] [MAIN ] TFPM: Wiping existing primary data before full refresh. [2025-09-29T21:26:08.607326] [INFO ] [LOCAL ] TFPM: Starting deletion of primary data. [2025-09-29T21:26:08.607829] [DEBUG] [LOCAL ] TFPM: Deleted primary data file. [2025-09-29T21:26:08.607890] [INFO ] [MAIN ] TFPM: Starting full primary refresh. [2025-09-29T21:26:09.012467] [INFO ] [REMOTE ] TFPM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:26:09.148113] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-01. [2025-09-29T21:26:09.592972] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-29T21:26:09.693204] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-29T21:26:09.948145] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-06. [2025-09-29T21:26:10.142438] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-29T21:26:10.748207] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2024-12. [2025-09-29T21:26:11.262972] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-29T21:26:11.548078] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-08. [2025-09-29T21:26:12.003047] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-29T21:26:12.348140] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-07. [2025-09-29T21:26:13.148103] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-02. [2025-09-29T21:26:13.186989] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-29T21:26:13.748815] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-29T21:26:13.867552] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-29T21:26:13.948117] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-03. [2025-09-29T21:26:14.748212] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-09. [2025-09-29T21:26:15.107062] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-29T21:26:15.548133] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-01. [2025-09-29T21:26:16.348088] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-08. [2025-09-29T21:26:16.466953] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-29T21:26:16.478578] [INFO ] [REMOTE ] TFC: Full fetch complete (77670 records). [2025-09-29T21:26:16.478789] [DEBUG] [VALIDATOR ] TFC: Validating primary data. [2025-09-29T21:26:16.877320] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-29T21:26:16.925912] [DEBUG] [VALIDATOR ] TFC: All expected trading days are present. [2025-09-29T21:26:16.926009] [DEBUG] [VALIDATOR ] TFC: Primary data validation passed. [2025-09-29T21:26:16.927355] [INFO ] [MAIN ] TFC: Fetched primary data is valid. [2025-09-29T21:26:16.927459] [DEBUG] [LOCAL ] TFC: Saving primary data. [2025-09-29T21:26:16.930799] [DEBUG] [LOCAL ] TFC: Trimmed 77670 records to 53667 (keeping 200 days of data) [2025-09-29T21:26:17.160793] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-02. [2025-09-29T21:26:17.297769] [DEBUG] [LOCAL ] TFC: Primary data saved (53667 records). [2025-09-29T21:26:17.297938] [INFO ] [MAIN ] TFC: Full history saved. [2025-09-29T21:26:17.298057] [INFO ] [MAIN ] Update Progress: 2074/2371 symbols completed. TFC took 37.6s. Estimated remaining: 38m 8s. Rate: 7.8 symbols/min [2025-09-29T21:26:17.503362] [INFO ] [MAIN ] TFX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:26:17.513397] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-29T21:26:17.570347] [DEBUG] [LOCAL ] TFX: Loaded 37936 existing records from primary storage. [2025-09-29T21:26:17.570711] [INFO ] [MAIN ] TFX: Loaded 37936 existing records. [2025-09-29T21:26:17.761824] [WARN ] [MAIN ] TFX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:26:17.762045] [INFO ] [MAIN ] TFX: Wiping existing primary data before full refresh. [2025-09-29T21:26:17.762094] [INFO ] [LOCAL ] TFX: Starting deletion of primary data. [2025-09-29T21:26:17.762418] [DEBUG] [LOCAL ] TFX: Deleted primary data file. [2025-09-29T21:26:17.762481] [INFO ] [MAIN ] TFX: Starting full primary refresh. [2025-09-29T21:26:17.953288] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-09. [2025-09-29T21:26:18.158603] [INFO ] [REMOTE ] TFX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:26:18.706527] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-29T21:26:18.748133] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-03. [2025-09-29T21:26:19.335935] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-29T21:26:19.342335] [INFO ] [REMOTE ] TFII: Full fetch complete (47753 records). [2025-09-29T21:26:19.342436] [DEBUG] [VALIDATOR ] TFII: Validating primary data. [2025-09-29T21:26:19.555335] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-04. [2025-09-29T21:26:19.754780] [DEBUG] [VALIDATOR ] TFII: All expected trading days are present. [2025-09-29T21:26:19.754867] [DEBUG] [VALIDATOR ] TFII: Primary data validation passed. [2025-09-29T21:26:19.755903] [INFO ] [MAIN ] TFII: Fetched primary data is valid. [2025-09-29T21:26:19.755971] [DEBUG] [LOCAL ] TFII: Saving primary data. [2025-09-29T21:26:19.758161] [DEBUG] [LOCAL ] TFII: Trimmed 47753 records to 33910 (keeping 200 days of data) [2025-09-29T21:26:19.986015] [DEBUG] [LOCAL ] TFII: Primary data saved (33910 records). [2025-09-29T21:26:19.986208] [INFO ] [MAIN ] TFII: Full history saved. [2025-09-29T21:26:19.986363] [INFO ] [MAIN ] Update Progress: 2075/2371 symbols completed. TFII took 22.6s. Estimated remaining: 37m 59s. Rate: 7.8 symbols/min [2025-09-29T21:26:20.202712] [INFO ] [MAIN ] TG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:26:20.203896] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-29T21:26:20.223964] [DEBUG] [LOCAL ] TG: Loaded 10581 existing records from primary storage. [2025-09-29T21:26:20.224230] [INFO ] [MAIN ] TG: Loaded 10581 existing records. [2025-09-29T21:26:20.353310] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-04. [2025-09-29T21:26:20.427851] [WARN ] [MAIN ] TG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:26:20.428223] [INFO ] [MAIN ] TG: Wiping existing primary data before full refresh. [2025-09-29T21:26:20.428317] [INFO ] [LOCAL ] TG: Starting deletion of primary data. [2025-09-29T21:26:20.428688] [DEBUG] [LOCAL ] TG: Deleted primary data file. [2025-09-29T21:26:20.428750] [INFO ] [MAIN ] TG: Starting full primary refresh. [2025-09-29T21:26:20.805862] [INFO ] [REMOTE ] TG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:26:20.982428] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-29T21:26:21.148187] [INFO ] [REMOTE ] TFX: Fetching primary data for 2024-12. [2025-09-29T21:26:21.948113] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-05. [2025-09-29T21:26:22.032370] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-29T21:26:22.631119] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-29T21:26:22.748114] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-01. [2025-09-29T21:26:23.080073] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-29T21:26:23.548136] [INFO ] [REMOTE ] TG: Fetching primary data for 2024-12. [2025-09-29T21:26:24.309614] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-29T21:26:24.348088] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-05. [2025-09-29T21:26:24.464802] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-29T21:26:25.148122] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-01. [2025-09-29T21:26:25.854386] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-29T21:26:25.948086] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-06. [2025-09-29T21:26:26.023040] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-29T21:26:26.748146] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-02. [2025-09-29T21:26:27.482289] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-29T21:26:27.548168] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-02. [2025-09-29T21:26:28.252256] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-29T21:26:28.321743] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-29T21:26:28.348112] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-03. [2025-09-29T21:26:29.148112] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-06. [2025-09-29T21:26:29.897955] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-29T21:26:29.948128] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-03. [2025-09-29T21:26:30.324725] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-29T21:26:30.748196] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-29T21:26:30.748272] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-07. [2025-09-29T21:26:31.548124] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-04. [2025-09-29T21:26:32.348084] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-07. [2025-09-29T21:26:32.402277] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-29T21:26:32.466446] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-29T21:26:33.148106] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-05. [2025-09-29T21:26:33.595556] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-29T21:26:33.736763] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-29T21:26:33.948131] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-08. [2025-09-29T21:26:34.748109] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-04. [2025-09-29T21:26:35.324014] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-29T21:26:35.548099] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-08. [2025-09-29T21:26:36.348081] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-09. [2025-09-29T21:26:36.374692] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-29T21:26:36.451327] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-29T21:26:37.148127] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-09. [2025-09-29T21:26:37.861276] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-29T21:26:37.870527] [INFO ] [REMOTE ] TFPM: Full fetch complete (50850 records). [2025-09-29T21:26:37.870726] [DEBUG] [VALIDATOR ] TFPM: Validating primary data. [2025-09-29T21:26:37.961335] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-06. [2025-09-29T21:26:38.198536] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-29T21:26:38.230475] [INFO ] [REMOTE ] TFIN: Full fetch complete (31087 records). [2025-09-29T21:26:38.254579] [DEBUG] [VALIDATOR ] TFIN: Validating primary data. [2025-09-29T21:26:38.404069] [DEBUG] [VALIDATOR ] TFPM: All expected trading days are present. [2025-09-29T21:26:38.407176] [DEBUG] [VALIDATOR ] TFPM: Primary data validation passed. [2025-09-29T21:26:38.408355] [INFO ] [MAIN ] TFPM: Fetched primary data is valid. [2025-09-29T21:26:38.408442] [DEBUG] [LOCAL ] TFPM: Saving primary data. [2025-09-29T21:26:38.462972] [DEBUG] [LOCAL ] TFPM: Trimmed 50850 records to 37691 (keeping 200 days of data) [2025-09-29T21:26:38.736896] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-29T21:26:38.751078] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-05. [2025-09-29T21:26:38.841076] [DEBUG] [VALIDATOR ] TFIN: All expected trading days are present. [2025-09-29T21:26:38.841416] [DEBUG] [VALIDATOR ] TFIN: Primary data validation passed. [2025-09-29T21:26:38.842769] [INFO ] [MAIN ] TFIN: Fetched primary data is valid. [2025-09-29T21:26:38.843086] [DEBUG] [LOCAL ] TFIN: Saving primary data. [2025-09-29T21:26:38.846177] [DEBUG] [LOCAL ] TFIN: Trimmed 31087 records to 23487 (keeping 200 days of data) [2025-09-29T21:26:39.117629] [DEBUG] [LOCAL ] TFIN: Primary data saved (23487 records). [2025-09-29T21:26:39.118621] [INFO ] [MAIN ] TFIN: Full history saved. [2025-09-29T21:26:39.119084] [INFO ] [MAIN ] Update Progress: 2076/2371 symbols completed. TFIN took 35.4s. Estimated remaining: 37m 53s. Rate: 7.8 symbols/min [2025-09-29T21:26:39.289878] [DEBUG] [LOCAL ] TFPM: Primary data saved (37691 records). [2025-09-29T21:26:39.292068] [INFO ] [MAIN ] TFPM: Full history saved. [2025-09-29T21:26:39.308741] [INFO ] [MAIN ] Update Progress: 2077/2371 symbols completed. TFPM took 31.1s. Estimated remaining: 37m 44s. Rate: 7.8 symbols/min [2025-09-29T21:26:39.312364] [INFO ] [MAIN ] TGE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:26:39.312554] [DEBUG] [LOCAL ] TGE: No existing data file found in primary storage. [2025-09-29T21:26:39.312770] [WARN ] [MAIN ] TGE: No existing data found, performing full refresh instead. [2025-09-29T21:26:39.312969] [INFO ] [MAIN ] TGE: Wiping existing primary data before full refresh. [2025-09-29T21:26:39.313025] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-09-29T21:26:39.313071] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-09-29T21:26:39.313154] [INFO ] [MAIN ] TGE: Starting full primary refresh. [2025-09-29T21:26:39.556474] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-07. [2025-09-29T21:26:39.705424] [INFO ] [REMOTE ] TGE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:26:40.202979] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-29T21:26:40.224784] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-29T21:26:40.348107] [INFO ] [REMOTE ] TGE: Fetching primary data for 2024-12. [2025-09-29T21:26:40.550181] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T21:26:40.550504] [WARN ] [REMOTE ] TGE: No data returned for month 2024-12 [2025-09-29T21:26:40.550596] [FATAL] [REMOTE ] TGE: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T21:26:40.550680] [FATAL] [MAIN ] TGE: Failed to fetch primary data. [2025-09-29T21:26:40.550737] [WARN ] [MAIN ] TGE: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T21:26:40.550847] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-09-29T21:26:40.550929] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-09-29T21:26:40.550966] [INFO ] [LOCAL ] TGE: Starting deletion of derivative data. [2025-09-29T21:26:40.551019] [DEBUG] [LOCAL ] TGE: No derivative data file found to delete. [2025-09-29T21:26:40.551093] [INFO ] [MAIN ] Update Progress: 2078/2371 symbols completed. TGE took 1.4s. Estimated remaining: 37m 36s. Rate: 7.8 symbols/min [2025-09-29T21:26:41.148112] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-08. [2025-09-29T21:26:41.948112] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-06. [2025-09-29T21:26:41.969278] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-29T21:26:42.748111] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-09. [2025-09-29T21:26:43.267677] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-29T21:26:43.548281] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-07. [2025-09-29T21:26:43.633482] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-29T21:26:43.636851] [INFO ] [REMOTE ] TG: Full fetch complete (15122 records). [2025-09-29T21:26:43.636938] [DEBUG] [VALIDATOR ] TG: Validating primary data. [2025-09-29T21:26:44.026980] [DEBUG] [VALIDATOR ] TG: All expected trading days are present. [2025-09-29T21:26:44.027092] [DEBUG] [VALIDATOR ] TG: Primary data validation passed. [2025-09-29T21:26:44.027500] [INFO ] [MAIN ] TG: Fetched primary data is valid. [2025-09-29T21:26:44.027543] [DEBUG] [LOCAL ] TG: Saving primary data. [2025-09-29T21:26:44.028117] [DEBUG] [LOCAL ] TG: Trimmed 15122 records to 10383 (keeping 200 days of data) [2025-09-29T21:26:44.088316] [DEBUG] [LOCAL ] TG: Primary data saved (10383 records). [2025-09-29T21:26:44.088453] [INFO ] [MAIN ] TG: Full history saved. [2025-09-29T21:26:44.088539] [INFO ] [MAIN ] Update Progress: 2079/2371 symbols completed. TG took 24.1s. Estimated remaining: 37m 27s. Rate: 7.8 symbols/min [2025-09-29T21:26:44.712202] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-29T21:26:44.720472] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-08. [2025-09-29T21:26:46.138134] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-29T21:26:46.146222] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-09. [2025-09-29T21:26:47.609388] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-29T21:26:47.617929] [INFO ] [REMOTE ] TFX: Full fetch complete (54408 records). [2025-09-29T21:26:47.618045] [DEBUG] [VALIDATOR ] TFX: Validating primary data. [2025-09-29T21:26:48.023227] [DEBUG] [VALIDATOR ] TFX: All expected trading days are present. [2025-09-29T21:26:48.023353] [DEBUG] [VALIDATOR ] TFX: Primary data validation passed. [2025-09-29T21:26:48.024425] [INFO ] [MAIN ] TFX: Fetched primary data is valid. [2025-09-29T21:26:48.024491] [DEBUG] [LOCAL ] TFX: Saving primary data. [2025-09-29T21:26:48.025962] [DEBUG] [LOCAL ] TFX: Trimmed 54408 records to 37180 (keeping 200 days of data) [2025-09-29T21:26:48.266808] [DEBUG] [LOCAL ] TFX: Primary data saved (37180 records). [2025-09-29T21:26:48.266962] [INFO ] [MAIN ] TFX: Full history saved. [2025-09-29T21:26:48.267097] [INFO ] [MAIN ] Update Progress: 2080/2371 symbols completed. TFX took 31.0s. Estimated remaining: 37m 19s. Rate: 7.8 symbols/min [2025-09-29T21:26:48.910953] [INFO ] [MAIN ] TGLS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:26:48.998134] [INFO ] [MAIN ] TGS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:26:49.009816] [INFO ] [MAIN ] TGNA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:26:49.040532] [INFO ] [MAIN ] TGT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:26:49.092084] [DEBUG] [LOCAL ] TGLS: Loaded 28709 existing records from primary storage. [2025-09-29T21:26:49.092448] [INFO ] [MAIN ] TGLS: Loaded 28709 existing records. [2025-09-29T21:26:49.182131] [DEBUG] [LOCAL ] TGS: Loaded 33072 existing records from primary storage. [2025-09-29T21:26:49.194297] [INFO ] [MAIN ] TGS: Loaded 33072 existing records. [2025-09-29T21:26:49.356560] [DEBUG] [LOCAL ] TGNA: Loaded 49444 existing records from primary storage. [2025-09-29T21:26:49.439758] [INFO ] [MAIN ] TGNA: Loaded 49444 existing records. [2025-09-29T21:26:49.544880] [DEBUG] [LOCAL ] TGT: Loaded 54558 existing records from primary storage. [2025-09-29T21:26:49.598143] [WARN ] [MAIN ] TGS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:26:49.604963] [INFO ] [MAIN ] TGT: Loaded 54558 existing records. [2025-09-29T21:26:49.629574] [WARN ] [MAIN ] TGLS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:26:49.651663] [INFO ] [MAIN ] TGS: Wiping existing primary data before full refresh. [2025-09-29T21:26:49.681994] [INFO ] [MAIN ] TGLS: Wiping existing primary data before full refresh. [2025-09-29T21:26:49.681761] [INFO ] [LOCAL ] TGS: Starting deletion of primary data. [2025-09-29T21:26:49.742507] [INFO ] [LOCAL ] TGLS: Starting deletion of primary data. [2025-09-29T21:26:49.758728] [DEBUG] [LOCAL ] TGS: Deleted primary data file. [2025-09-29T21:26:49.763989] [DEBUG] [LOCAL ] TGLS: Deleted primary data file. [2025-09-29T21:26:49.780531] [INFO ] [MAIN ] TGLS: Starting full primary refresh. [2025-09-29T21:26:49.793903] [INFO ] [MAIN ] TGS: Starting full primary refresh. [2025-09-29T21:26:50.141338] [WARN ] [MAIN ] TGNA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:26:50.211839] [INFO ] [MAIN ] TGNA: Wiping existing primary data before full refresh. [2025-09-29T21:26:50.286888] [INFO ] [LOCAL ] TGNA: Starting deletion of primary data. [2025-09-29T21:26:50.328314] [WARN ] [MAIN ] TGT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:26:50.374229] [INFO ] [MAIN ] TGT: Wiping existing primary data before full refresh. [2025-09-29T21:26:50.437935] [INFO ] [LOCAL ] TGT: Starting deletion of primary data. [2025-09-29T21:26:50.443381] [DEBUG] [LOCAL ] TGNA: Deleted primary data file. [2025-09-29T21:26:50.461931] [DEBUG] [LOCAL ] TGT: Deleted primary data file. [2025-09-29T21:26:50.483797] [INFO ] [MAIN ] TGT: Starting full primary refresh. [2025-09-29T21:26:50.483724] [INFO ] [MAIN ] TGNA: Starting full primary refresh. [2025-09-29T21:26:51.162979] [INFO ] [REMOTE ] TGLS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:26:51.187696] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2024-12. [2025-09-29T21:26:51.215480] [INFO ] [REMOTE ] TGS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:26:51.259318] [INFO ] [REMOTE ] TGS: Fetching primary data for 2024-12. [2025-09-29T21:26:51.621230] [INFO ] [REMOTE ] TGT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:26:51.637414] [INFO ] [REMOTE ] TGT: Fetching primary data for 2024-12. [2025-09-29T21:26:51.643560] [INFO ] [REMOTE ] TGNA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:26:51.643962] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2024-12. [2025-09-29T21:26:52.496452] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-29T21:26:52.502148] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-01. [2025-09-29T21:26:52.732189] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-29T21:26:52.738882] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-01. [2025-09-29T21:26:53.342703] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-29T21:26:53.352787] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-01. [2025-09-29T21:26:53.508708] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-29T21:26:53.515444] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-02. [2025-09-29T21:26:53.925332] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-09-29T21:26:53.936495] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-01. [2025-09-29T21:26:54.251874] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-29T21:26:54.259426] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-02. [2025-09-29T21:26:54.346693] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-29T21:26:54.352537] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-03. [2025-09-29T21:26:54.661234] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-29T21:26:54.748095] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-02. [2025-09-29T21:26:55.344633] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-29T21:26:55.548148] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-04. [2025-09-29T21:26:55.606213] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-29T21:26:55.626781] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-29T21:26:56.114517] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-29T21:26:56.348114] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-02. [2025-09-29T21:26:56.924232] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-29T21:26:57.148144] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-03. [2025-09-29T21:26:57.948104] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-03. [2025-09-29T21:26:58.372211] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-29T21:26:58.488952] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-29T21:26:58.748155] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-05. [2025-09-29T21:26:59.548123] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-04. [2025-09-29T21:26:59.745945] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-29T21:27:00.096622] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-29T21:27:00.348113] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-06. [2025-09-29T21:27:01.022835] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-29T21:27:01.148126] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-04. [2025-09-29T21:27:01.468344] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-29T21:27:01.948133] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-03. [2025-09-29T21:27:02.748189] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-05. [2025-09-29T21:27:03.035490] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-29T21:27:03.548154] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-07. [2025-09-29T21:27:04.063363] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-29T21:27:04.348106] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-06. [2025-09-29T21:27:04.411474] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-09-29T21:27:04.693391] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-29T21:27:05.148108] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-04. [2025-09-29T21:27:05.251451] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-29T21:27:05.948149] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-05. [2025-09-29T21:27:06.748143] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-07. [2025-09-29T21:27:07.556796] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-08. [2025-09-29T21:27:07.563918] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-29T21:27:07.664192] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-09-29T21:27:08.126480] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-29T21:27:08.348104] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-05. [2025-09-29T21:27:08.684192] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-29T21:27:09.148133] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-09. [2025-09-29T21:27:09.948138] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-08. [2025-09-29T21:27:10.158772] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-29T21:27:10.164880] [INFO ] [REMOTE ] TGLS: Full fetch complete (40502 records). [2025-09-29T21:27:10.164992] [DEBUG] [VALIDATOR ] TGLS: Validating primary data. [2025-09-29T21:27:10.570393] [DEBUG] [VALIDATOR ] TGLS: All expected trading days are present. [2025-09-29T21:27:10.570512] [DEBUG] [VALIDATOR ] TGLS: Primary data validation passed. [2025-09-29T21:27:10.571459] [INFO ] [MAIN ] TGLS: Fetched primary data is valid. [2025-09-29T21:27:10.571546] [DEBUG] [LOCAL ] TGLS: Saving primary data. [2025-09-29T21:27:10.572909] [DEBUG] [LOCAL ] TGLS: Trimmed 40502 records to 28129 (keeping 200 days of data) [2025-09-29T21:27:10.734481] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-09-29T21:27:10.748695] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-06. [2025-09-29T21:27:10.811974] [DEBUG] [LOCAL ] TGLS: Primary data saved (28129 records). [2025-09-29T21:27:10.812114] [INFO ] [MAIN ] TGLS: Full history saved. [2025-09-29T21:27:10.812210] [INFO ] [MAIN ] Update Progress: 2081/2371 symbols completed. TGLS took 22.5s. Estimated remaining: 37m 14s. Rate: 7.8 symbols/min [2025-09-29T21:27:11.006245] [INFO ] [MAIN ] THC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:27:11.060008] [DEBUG] [LOCAL ] THC: Loaded 48617 existing records from primary storage. [2025-09-29T21:27:11.060397] [INFO ] [MAIN ] THC: Loaded 48617 existing records. [2025-09-29T21:27:11.252826] [WARN ] [MAIN ] THC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:27:11.253581] [INFO ] [MAIN ] THC: Wiping existing primary data before full refresh. [2025-09-29T21:27:11.253741] [INFO ] [LOCAL ] THC: Starting deletion of primary data. [2025-09-29T21:27:11.254349] [DEBUG] [LOCAL ] THC: Deleted primary data file. [2025-09-29T21:27:11.254464] [INFO ] [MAIN ] THC: Starting full primary refresh. [2025-09-29T21:27:11.404665] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-29T21:27:11.553288] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-09. [2025-09-29T21:27:11.667157] [INFO ] [REMOTE ] THC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:27:12.153678] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-29T21:27:12.348105] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-07. [2025-09-29T21:27:13.108270] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-29T21:27:13.117086] [INFO ] [REMOTE ] TGS: Full fetch complete (47729 records). [2025-09-29T21:27:13.117235] [DEBUG] [VALIDATOR ] TGS: Validating primary data. [2025-09-29T21:27:13.153229] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-06. [2025-09-29T21:27:13.507098] [DEBUG] [VALIDATOR ] TGS: All expected trading days are present. [2025-09-29T21:27:13.507188] [DEBUG] [VALIDATOR ] TGS: Primary data validation passed. [2025-09-29T21:27:13.508087] [INFO ] [MAIN ] TGS: Fetched primary data is valid. [2025-09-29T21:27:13.508150] [DEBUG] [LOCAL ] TGS: Saving primary data. [2025-09-29T21:27:13.509201] [DEBUG] [LOCAL ] TGS: Trimmed 47729 records to 32648 (keeping 200 days of data) [2025-09-29T21:27:13.712081] [DEBUG] [LOCAL ] TGS: Primary data saved (32648 records). [2025-09-29T21:27:13.712243] [INFO ] [MAIN ] TGS: Full history saved. [2025-09-29T21:27:13.712369] [INFO ] [MAIN ] Update Progress: 2082/2371 symbols completed. TGS took 25.4s. Estimated remaining: 37m 5s. Rate: 7.8 symbols/min [2025-09-29T21:27:13.891994] [INFO ] [MAIN ] THG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:27:13.921667] [DEBUG] [LOCAL ] THG: Loaded 22081 existing records from primary storage. [2025-09-29T21:27:13.921951] [INFO ] [MAIN ] THG: Loaded 22081 existing records. [2025-09-29T21:27:13.953262] [INFO ] [REMOTE ] THC: Fetching primary data for 2024-12. [2025-09-29T21:27:14.112036] [WARN ] [MAIN ] THG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:27:14.112361] [INFO ] [MAIN ] THG: Wiping existing primary data before full refresh. [2025-09-29T21:27:14.112491] [INFO ] [LOCAL ] THG: Starting deletion of primary data. [2025-09-29T21:27:14.112889] [DEBUG] [LOCAL ] THG: Deleted primary data file. [2025-09-29T21:27:14.112950] [INFO ] [MAIN ] THG: Starting full primary refresh. [2025-09-29T21:27:14.249509] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-29T21:27:14.558098] [INFO ] [REMOTE ] THG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:27:14.748127] [INFO ] [REMOTE ] THG: Fetching primary data for 2024-12. [2025-09-29T21:27:15.468689] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-09-29T21:27:15.548079] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-07. [2025-09-29T21:27:15.769127] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-29T21:27:15.908900] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-29T21:27:16.348108] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-01. [2025-09-29T21:27:17.148148] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-08. [2025-09-29T21:27:17.825573] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-29T21:27:17.956140] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-08. [2025-09-29T21:27:17.961852] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-29T21:27:18.627006] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-29T21:27:18.748117] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-02. [2025-09-29T21:27:19.548131] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-01. [2025-09-29T21:27:19.952994] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-29T21:27:20.348076] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-09. [2025-09-29T21:27:20.458563] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-29T21:27:20.589632] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-29T21:27:21.148118] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-03. [2025-09-29T21:27:21.948162] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-02. [2025-09-29T21:27:22.086628] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-29T21:27:22.098110] [INFO ] [REMOTE ] TGNA: Full fetch complete (69953 records). [2025-09-29T21:27:22.098303] [DEBUG] [VALIDATOR ] TGNA: Validating primary data. [2025-09-29T21:27:22.525378] [DEBUG] [VALIDATOR ] TGNA: All expected trading days are present. [2025-09-29T21:27:22.525601] [DEBUG] [VALIDATOR ] TGNA: Primary data validation passed. [2025-09-29T21:27:22.526852] [INFO ] [MAIN ] TGNA: Fetched primary data is valid. [2025-09-29T21:27:22.526949] [DEBUG] [LOCAL ] TGNA: Saving primary data. [2025-09-29T21:27:22.528633] [DEBUG] [LOCAL ] TGNA: Trimmed 69953 records to 48677 (keeping 200 days of data) [2025-09-29T21:27:22.752822] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-09. [2025-09-29T21:27:22.886721] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-29T21:27:22.900002] [DEBUG] [LOCAL ] TGNA: Primary data saved (48677 records). [2025-09-29T21:27:22.900538] [INFO ] [MAIN ] TGNA: Full history saved. [2025-09-29T21:27:22.900842] [INFO ] [MAIN ] Update Progress: 2083/2371 symbols completed. TGNA took 34.6s. Estimated remaining: 36m 58s. Rate: 7.8 symbols/min [2025-09-29T21:27:23.096878] [INFO ] [MAIN ] THIR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:27:23.102272] [DEBUG] [LOCAL ] THIR: Loaded 2238 existing records from primary storage. [2025-09-29T21:27:23.102428] [INFO ] [MAIN ] THIR: Loaded 2238 existing records. [2025-09-29T21:27:23.227954] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-29T21:27:23.309101] [WARN ] [MAIN ] THIR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:27:23.309337] [INFO ] [MAIN ] THIR: Wiping existing primary data before full refresh. [2025-09-29T21:27:23.309388] [INFO ] [LOCAL ] THIR: Starting deletion of primary data. [2025-09-29T21:27:23.309602] [DEBUG] [LOCAL ] THIR: Deleted primary data file. [2025-09-29T21:27:23.309697] [INFO ] [MAIN ] THIR: Starting full primary refresh. [2025-09-29T21:27:23.554719] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-03. [2025-09-29T21:27:23.688334] [INFO ] [REMOTE ] THIR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:27:24.348131] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-04. [2025-09-29T21:27:24.765287] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-29T21:27:25.137711] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-09-29T21:27:25.148352] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-04. [2025-09-29T21:27:25.150851] [INFO ] [REMOTE ] TGT: Full fetch complete (77860 records). [2025-09-29T21:27:25.151057] [DEBUG] [VALIDATOR ] TGT: Validating primary data. [2025-09-29T21:27:25.567782] [DEBUG] [VALIDATOR ] TGT: All expected trading days are present. [2025-09-29T21:27:25.567919] [DEBUG] [VALIDATOR ] TGT: Primary data validation passed. [2025-09-29T21:27:25.569349] [INFO ] [MAIN ] TGT: Fetched primary data is valid. [2025-09-29T21:27:25.569429] [DEBUG] [LOCAL ] TGT: Saving primary data. [2025-09-29T21:27:25.571243] [DEBUG] [LOCAL ] TGT: Trimmed 77860 records to 53778 (keeping 200 days of data) [2025-09-29T21:27:25.829310] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-29T21:27:25.948735] [INFO ] [REMOTE ] THIR: Fetching primary data for 2024-12. [2025-09-29T21:27:25.970766] [DEBUG] [LOCAL ] TGT: Primary data saved (53778 records). [2025-09-29T21:27:25.970999] [INFO ] [MAIN ] TGT: Full history saved. [2025-09-29T21:27:25.971153] [INFO ] [MAIN ] Update Progress: 2084/2371 symbols completed. TGT took 37.7s. Estimated remaining: 36m 49s. Rate: 7.8 symbols/min [2025-09-29T21:27:26.157286] [INFO ] [MAIN ] THLV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:27:26.162141] [DEBUG] [LOCAL ] THLV: Loaded 1614 existing records from primary storage. [2025-09-29T21:27:26.162330] [INFO ] [MAIN ] THLV: Loaded 1614 existing records. [2025-09-29T21:27:26.349916] [WARN ] [MAIN ] THLV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:27:26.350171] [INFO ] [MAIN ] THLV: Wiping existing primary data before full refresh. [2025-09-29T21:27:26.350225] [INFO ] [LOCAL ] THLV: Starting deletion of primary data. [2025-09-29T21:27:26.350467] [DEBUG] [LOCAL ] THLV: Deleted primary data file. [2025-09-29T21:27:26.350565] [INFO ] [MAIN ] THLV: Starting full primary refresh. [2025-09-29T21:27:26.569826] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-29T21:27:26.749708] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-05. [2025-09-29T21:27:26.777941] [INFO ] [REMOTE ] THLV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:27:26.781634] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-29T21:27:27.548123] [INFO ] [REMOTE ] THLV: Fetching primary data for 2024-12. [2025-09-29T21:27:27.916351] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-09-29T21:27:28.348229] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-01. [2025-09-29T21:27:28.519423] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-29T21:27:28.796994] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-29T21:27:29.148186] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-02. [2025-09-29T21:27:29.602892] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-29T21:27:29.948142] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-03. [2025-09-29T21:27:30.462819] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-29T21:27:30.748148] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-04. [2025-09-29T21:27:31.181253] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-29T21:27:31.548154] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-01. [2025-09-29T21:27:31.822423] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-09-29T21:27:32.348155] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-06. [2025-09-29T21:27:33.148135] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-05. [2025-09-29T21:27:33.948084] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-05. [2025-09-29T21:27:34.041833] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-29T21:27:34.069302] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-29T21:27:34.365349] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-29T21:27:34.748126] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-06. [2025-09-29T21:27:35.094508] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-29T21:27:35.548110] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-07. [2025-09-29T21:27:35.830059] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-09-29T21:27:36.348149] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-08. [2025-09-29T21:27:36.662188] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-29T21:27:37.148132] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-09. [2025-09-29T21:27:37.548721] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-29T21:27:37.550175] [INFO ] [REMOTE ] THLV: Full fetch complete (2652 records). [2025-09-29T21:27:37.550263] [DEBUG] [VALIDATOR ] THLV: Validating primary data. [2025-09-29T21:27:37.942070] [DEBUG] [VALIDATOR ] THLV: All expected trading days are present. [2025-09-29T21:27:37.942155] [DEBUG] [VALIDATOR ] THLV: Primary data validation passed. [2025-09-29T21:27:37.942274] [INFO ] [MAIN ] THLV: Fetched primary data is valid. [2025-09-29T21:27:37.942318] [DEBUG] [LOCAL ] THLV: Saving primary data. [2025-09-29T21:27:37.942783] [DEBUG] [LOCAL ] THLV: Trimmed 2652 records to 1564 (keeping 200 days of data) [2025-09-29T21:27:37.948797] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-06. [2025-09-29T21:27:37.954874] [DEBUG] [LOCAL ] THLV: Primary data saved (1564 records). [2025-09-29T21:27:37.954999] [INFO ] [MAIN ] THLV: Full history saved. [2025-09-29T21:27:37.955083] [INFO ] [MAIN ] Update Progress: 2085/2371 symbols completed. THLV took 12.0s. Estimated remaining: 36m 42s. Rate: 7.8 symbols/min [2025-09-29T21:27:38.145339] [INFO ] [MAIN ] THO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:27:38.191207] [DEBUG] [LOCAL ] THO: Loaded 42957 existing records from primary storage. [2025-09-29T21:27:38.191541] [INFO ] [MAIN ] THO: Loaded 42957 existing records. [2025-09-29T21:27:38.379157] [WARN ] [MAIN ] THO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:27:38.379421] [INFO ] [MAIN ] THO: Wiping existing primary data before full refresh. [2025-09-29T21:27:38.379480] [INFO ] [LOCAL ] THO: Starting deletion of primary data. [2025-09-29T21:27:38.379978] [DEBUG] [LOCAL ] THO: Deleted primary data file. [2025-09-29T21:27:38.380038] [INFO ] [MAIN ] THO: Starting full primary refresh. [2025-09-29T21:27:38.759291] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-07. [2025-09-29T21:27:38.766305] [INFO ] [REMOTE ] THO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:27:39.087955] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-29T21:27:39.548168] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-07. [2025-09-29T21:27:40.348115] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-02. [2025-09-29T21:27:40.561543] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-29T21:27:40.602523] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-29T21:27:40.622360] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-09-29T21:27:41.148115] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-03. [2025-09-29T21:27:41.464735] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-29T21:27:41.948160] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-04. [2025-09-29T21:27:42.393554] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-29T21:27:42.748109] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-05. [2025-09-29T21:27:43.189237] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-29T21:27:43.548109] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-08. [2025-09-29T21:27:44.348119] [INFO ] [REMOTE ] THO: Fetching primary data for 2024-12. [2025-09-29T21:27:45.153953] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-06. [2025-09-29T21:27:45.160591] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-29T21:27:45.616145] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-29T21:27:45.796571] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-29T21:27:45.948089] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-07. [2025-09-29T21:27:46.264705] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-29T21:27:46.748107] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-01. [2025-09-29T21:27:47.548142] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-08. [2025-09-29T21:27:48.281107] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-29T21:27:48.348092] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-02. [2025-09-29T21:27:48.611530] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-29T21:27:49.148114] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-08. [2025-09-29T21:27:49.690356] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-29T21:27:49.825267] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-29T21:27:49.948165] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-09. [2025-09-29T21:27:50.416985] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-29T21:27:50.418153] [INFO ] [REMOTE ] THIR: Full fetch complete (2707 records). [2025-09-29T21:27:50.418226] [DEBUG] [VALIDATOR ] THIR: Validating primary data. [2025-09-29T21:27:50.754932] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-09. [2025-09-29T21:27:50.798472] [DEBUG] [VALIDATOR ] THIR: All expected trading days are present. [2025-09-29T21:27:50.798550] [DEBUG] [VALIDATOR ] THIR: Primary data validation passed. [2025-09-29T21:27:50.798694] [INFO ] [MAIN ] THIR: Fetched primary data is valid. [2025-09-29T21:27:50.798757] [DEBUG] [LOCAL ] THIR: Saving primary data. [2025-09-29T21:27:50.799124] [DEBUG] [LOCAL ] THIR: Trimmed 2707 records to 2188 (keeping 200 days of data) [2025-09-29T21:27:50.813888] [DEBUG] [LOCAL ] THIR: Primary data saved (2188 records). [2025-09-29T21:27:50.813993] [INFO ] [MAIN ] THIR: Full history saved. [2025-09-29T21:27:50.814082] [INFO ] [MAIN ] Update Progress: 2086/2371 symbols completed. THIR took 27.9s. Estimated remaining: 36m 35s. Rate: 7.8 symbols/min [2025-09-29T21:27:50.989115] [INFO ] [MAIN ] THQ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:27:51.016698] [DEBUG] [LOCAL ] THQ: Loaded 24879 existing records from primary storage. [2025-09-29T21:27:51.016986] [INFO ] [MAIN ] THQ: Loaded 24879 existing records. [2025-09-29T21:27:51.211184] [WARN ] [MAIN ] THQ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:27:51.211880] [INFO ] [MAIN ] THQ: Wiping existing primary data before full refresh. [2025-09-29T21:27:51.211967] [INFO ] [LOCAL ] THQ: Starting deletion of primary data. [2025-09-29T21:27:51.212414] [DEBUG] [LOCAL ] THQ: Deleted primary data file. [2025-09-29T21:27:51.212504] [INFO ] [MAIN ] THQ: Starting full primary refresh. [2025-09-29T21:27:51.553258] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-09. [2025-09-29T21:27:51.621924] [INFO ] [REMOTE ] THQ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:27:51.815692] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-29T21:27:51.820490] [INFO ] [REMOTE ] THG: Full fetch complete (31143 records). [2025-09-29T21:27:51.820607] [DEBUG] [VALIDATOR ] THG: Validating primary data. [2025-09-29T21:27:52.243514] [DEBUG] [VALIDATOR ] THG: All expected trading days are present. [2025-09-29T21:27:52.243614] [DEBUG] [VALIDATOR ] THG: Primary data validation passed. [2025-09-29T21:27:52.244439] [INFO ] [MAIN ] THG: Fetched primary data is valid. [2025-09-29T21:27:52.244517] [DEBUG] [LOCAL ] THG: Saving primary data. [2025-09-29T21:27:52.245554] [DEBUG] [LOCAL ] THG: Trimmed 31143 records to 21717 (keeping 200 days of data) [2025-09-29T21:27:52.350723] [INFO ] [REMOTE ] THQ: Fetching primary data for 2024-12. [2025-09-29T21:27:52.395523] [DEBUG] [LOCAL ] THG: Primary data saved (21717 records). [2025-09-29T21:27:52.395712] [INFO ] [MAIN ] THG: Full history saved. [2025-09-29T21:27:52.395840] [INFO ] [MAIN ] Update Progress: 2087/2371 symbols completed. THG took 38.7s. Estimated remaining: 36m 27s. Rate: 7.8 symbols/min [2025-09-29T21:27:52.585053] [INFO ] [MAIN ] THR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:27:52.607181] [DEBUG] [LOCAL ] THR: Loaded 20218 existing records from primary storage. [2025-09-29T21:27:52.607501] [INFO ] [MAIN ] THR: Loaded 20218 existing records. [2025-09-29T21:27:52.804579] [WARN ] [MAIN ] THR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:27:52.804846] [INFO ] [MAIN ] THR: Wiping existing primary data before full refresh. [2025-09-29T21:27:52.804896] [INFO ] [LOCAL ] THR: Starting deletion of primary data. [2025-09-29T21:27:52.805234] [DEBUG] [LOCAL ] THR: Deleted primary data file. [2025-09-29T21:27:52.805294] [INFO ] [MAIN ] THR: Starting full primary refresh. [2025-09-29T21:27:53.165073] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-03. [2025-09-29T21:27:53.241252] [INFO ] [REMOTE ] THR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:27:53.268255] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-29T21:27:53.278033] [INFO ] [REMOTE ] THC: Full fetch complete (69371 records). [2025-09-29T21:27:53.278167] [DEBUG] [VALIDATOR ] THC: Validating primary data. [2025-09-29T21:27:53.717830] [DEBUG] [VALIDATOR ] THC: All expected trading days are present. [2025-09-29T21:27:53.714148] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-29T21:27:53.725171] [DEBUG] [VALIDATOR ] THC: Primary data validation passed. [2025-09-29T21:27:53.727530] [INFO ] [MAIN ] THC: Fetched primary data is valid. [2025-09-29T21:27:53.727629] [DEBUG] [LOCAL ] THC: Saving primary data. [2025-09-29T21:27:53.729513] [DEBUG] [LOCAL ] THC: Trimmed 69371 records to 47803 (keeping 200 days of data) [2025-09-29T21:27:53.952791] [INFO ] [REMOTE ] THR: Fetching primary data for 2024-12. [2025-09-29T21:27:54.041288] [DEBUG] [LOCAL ] THC: Primary data saved (47803 records). [2025-09-29T21:27:54.041434] [INFO ] [MAIN ] THC: Full history saved. [2025-09-29T21:27:54.041531] [INFO ] [MAIN ] Update Progress: 2088/2371 symbols completed. THC took 43.2s. Estimated remaining: 36m 18s. Rate: 7.8 symbols/min [2025-09-29T21:27:54.255238] [INFO ] [MAIN ] THS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:27:54.296997] [DEBUG] [LOCAL ] THS: Loaded 38565 existing records from primary storage. [2025-09-29T21:27:54.297373] [INFO ] [MAIN ] THS: Loaded 38565 existing records. [2025-09-29T21:27:54.504183] [WARN ] [MAIN ] THS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:27:54.504453] [INFO ] [MAIN ] THS: Wiping existing primary data before full refresh. [2025-09-29T21:27:54.504513] [INFO ] [LOCAL ] THS: Starting deletion of primary data. [2025-09-29T21:27:54.504825] [DEBUG] [LOCAL ] THS: Deleted primary data file. [2025-09-29T21:27:54.504885] [INFO ] [MAIN ] THS: Starting full primary refresh. [2025-09-29T21:27:54.768765] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-01. [2025-09-29T21:27:55.195229] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-29T21:27:55.191216] [INFO ] [REMOTE ] THS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:27:55.239314] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-29T21:27:55.548191] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-01. [2025-09-29T21:27:55.795101] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-29T21:27:56.348132] [INFO ] [REMOTE ] THS: Fetching primary data for 2024-12. [2025-09-29T21:27:56.537921] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-29T21:27:57.148153] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-02. [2025-09-29T21:27:57.922279] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-29T21:27:57.954025] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-01. [2025-09-29T21:27:57.957849] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-29T21:27:58.748115] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-03. [2025-09-29T21:27:59.044487] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-29T21:27:59.548099] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-04. [2025-09-29T21:27:59.770840] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-29T21:28:00.348127] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-02. [2025-09-29T21:28:01.148189] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-02. [2025-09-29T21:28:01.325606] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-29T21:28:01.388971] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-29T21:28:01.875412] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-29T21:28:01.948140] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-04. [2025-09-29T21:28:02.748088] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-05. [2025-09-29T21:28:03.102738] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-29T21:28:03.548122] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-05. [2025-09-29T21:28:04.242010] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-29T21:28:04.348095] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-06. [2025-09-29T21:28:04.370417] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-29T21:28:05.148164] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-06. [2025-09-29T21:28:05.948094] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-03. [2025-09-29T21:28:06.103837] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-29T21:28:06.203702] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-29T21:28:06.748111] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-07. [2025-09-29T21:28:06.792831] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-29T21:28:07.548150] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-04. [2025-09-29T21:28:08.150357] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-29T21:28:08.348116] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-08. [2025-09-29T21:28:08.601989] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-29T21:28:09.148118] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-05. [2025-09-29T21:28:09.484296] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-29T21:28:09.948136] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-09. [2025-09-29T21:28:10.320515] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-29T21:28:10.748078] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-03. [2025-09-29T21:28:11.125279] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-29T21:28:11.130893] [INFO ] [REMOTE ] THQ: Full fetch complete (35054 records). [2025-09-29T21:28:11.131066] [DEBUG] [VALIDATOR ] THQ: Validating primary data. [2025-09-29T21:28:11.548715] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-06. [2025-09-29T21:28:11.550286] [DEBUG] [VALIDATOR ] THQ: All expected trading days are present. [2025-09-29T21:28:11.550383] [DEBUG] [VALIDATOR ] THQ: Primary data validation passed. [2025-09-29T21:28:11.551268] [INFO ] [MAIN ] THQ: Fetched primary data is valid. [2025-09-29T21:28:11.551466] [DEBUG] [LOCAL ] THQ: Saving primary data. [2025-09-29T21:28:11.552464] [DEBUG] [LOCAL ] THQ: Trimmed 35054 records to 24768 (keeping 200 days of data) [2025-09-29T21:28:11.725930] [DEBUG] [LOCAL ] THQ: Primary data saved (24768 records). [2025-09-29T21:28:11.726090] [INFO ] [MAIN ] THQ: Full history saved. [2025-09-29T21:28:11.726201] [INFO ] [MAIN ] Update Progress: 2089/2371 symbols completed. THQ took 20.9s. Estimated remaining: 36m 12s. Rate: 7.8 symbols/min [2025-09-29T21:28:11.914953] [INFO ] [MAIN ] THW: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:28:11.936455] [DEBUG] [LOCAL ] THW: Loaded 19392 existing records from primary storage. [2025-09-29T21:28:11.936784] [INFO ] [MAIN ] THW: Loaded 19392 existing records. [2025-09-29T21:28:12.181794] [WARN ] [MAIN ] THW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:28:12.182202] [INFO ] [MAIN ] THW: Wiping existing primary data before full refresh. [2025-09-29T21:28:12.182290] [INFO ] [LOCAL ] THW: Starting deletion of primary data. [2025-09-29T21:28:12.190233] [DEBUG] [LOCAL ] THW: Deleted primary data file. [2025-09-29T21:28:12.203247] [INFO ] [MAIN ] THW: Starting full primary refresh. [2025-09-29T21:28:12.204868] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-29T21:28:12.363713] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-07. [2025-09-29T21:28:12.547912] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-29T21:28:12.620722] [INFO ] [REMOTE ] THW: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:28:13.148120] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-07. [2025-09-29T21:28:13.948104] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-04. [2025-09-29T21:28:13.980565] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-29T21:28:14.138979] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-29T21:28:14.748120] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-08. [2025-09-29T21:28:15.481088] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-29T21:28:15.548127] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-08. [2025-09-29T21:28:16.292689] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-29T21:28:16.348131] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-09. [2025-09-29T21:28:16.711521] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-29T21:28:17.148122] [INFO ] [REMOTE ] THW: Fetching primary data for 2024-12. [2025-09-29T21:28:17.955170] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-05. [2025-09-29T21:28:17.973929] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-29T21:28:17.983554] [INFO ] [REMOTE ] THO: Full fetch complete (60219 records). [2025-09-29T21:28:17.983782] [DEBUG] [VALIDATOR ] THO: Validating primary data. [2025-09-29T21:28:18.446793] [DEBUG] [VALIDATOR ] THO: All expected trading days are present. [2025-09-29T21:28:18.446974] [DEBUG] [VALIDATOR ] THO: Primary data validation passed. [2025-09-29T21:28:18.448562] [INFO ] [MAIN ] THO: Fetched primary data is valid. [2025-09-29T21:28:18.449395] [DEBUG] [LOCAL ] THO: Saving primary data. [2025-09-29T21:28:18.450535] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-29T21:28:18.460245] [DEBUG] [LOCAL ] THO: Trimmed 60219 records to 42119 (keeping 200 days of data) [2025-09-29T21:28:18.733384] [DEBUG] [LOCAL ] THO: Primary data saved (42119 records). [2025-09-29T21:28:18.733520] [INFO ] [MAIN ] THO: Full history saved. [2025-09-29T21:28:18.733619] [INFO ] [MAIN ] Update Progress: 2090/2371 symbols completed. THO took 40.8s. Estimated remaining: 36m 4s. Rate: 7.8 symbols/min [2025-09-29T21:28:18.755950] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-09. [2025-09-29T21:28:18.917525] [INFO ] [MAIN ] TIC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:28:18.917762] [DEBUG] [LOCAL ] TIC: No existing data file found in primary storage. [2025-09-29T21:28:18.917822] [WARN ] [MAIN ] TIC: No existing data found, performing full refresh instead. [2025-09-29T21:28:18.917971] [INFO ] [MAIN ] TIC: Wiping existing primary data before full refresh. [2025-09-29T21:28:18.918038] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-09-29T21:28:18.918094] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-09-29T21:28:18.918138] [INFO ] [MAIN ] TIC: Starting full primary refresh. [2025-09-29T21:28:19.304089] [INFO ] [REMOTE ] TIC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:28:19.325364] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-29T21:28:19.548130] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-01. [2025-09-29T21:28:19.782869] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-29T21:28:19.788140] [INFO ] [REMOTE ] THR: Full fetch complete (28856 records). [2025-09-29T21:28:19.788274] [DEBUG] [VALIDATOR ] THR: Validating primary data. [2025-09-29T21:28:20.198758] [DEBUG] [VALIDATOR ] THR: All expected trading days are present. [2025-09-29T21:28:20.198852] [DEBUG] [VALIDATOR ] THR: Primary data validation passed. [2025-09-29T21:28:20.199524] [INFO ] [MAIN ] THR: Fetched primary data is valid. [2025-09-29T21:28:20.199571] [DEBUG] [LOCAL ] THR: Saving primary data. [2025-09-29T21:28:20.200527] [DEBUG] [LOCAL ] THR: Trimmed 28856 records to 19815 (keeping 200 days of data) [2025-09-29T21:28:20.323304] [DEBUG] [LOCAL ] THR: Primary data saved (19815 records). [2025-09-29T21:28:20.323464] [INFO ] [MAIN ] THR: Full history saved. [2025-09-29T21:28:20.323556] [INFO ] [MAIN ] Update Progress: 2091/2371 symbols completed. THR took 27.9s. Estimated remaining: 35m 56s. Rate: 7.8 symbols/min [2025-09-29T21:28:20.353292] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-06. [2025-09-29T21:28:20.517525] [INFO ] [MAIN ] TIMB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:28:20.563939] [DEBUG] [LOCAL ] TIMB: Loaded 36983 existing records from primary storage. [2025-09-29T21:28:20.564255] [INFO ] [MAIN ] TIMB: Loaded 36983 existing records. [2025-09-29T21:28:20.763482] [WARN ] [MAIN ] TIMB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:28:20.764026] [INFO ] [MAIN ] TIMB: Wiping existing primary data before full refresh. [2025-09-29T21:28:20.764145] [INFO ] [LOCAL ] TIMB: Starting deletion of primary data. [2025-09-29T21:28:20.781038] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-29T21:28:20.780375] [DEBUG] [LOCAL ] TIMB: Deleted primary data file. [2025-09-29T21:28:20.786878] [INFO ] [MAIN ] TIMB: Starting full primary refresh. [2025-09-29T21:28:21.149681] [INFO ] [REMOTE ] TIC: Fetching primary data for 2024-12. [2025-09-29T21:28:21.170735] [INFO ] [REMOTE ] TIMB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:28:21.379133] [DEBUG] [REMOTE ] TIC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T21:28:21.379544] [WARN ] [REMOTE ] TIC: No data returned for month 2024-12 [2025-09-29T21:28:21.379688] [FATAL] [REMOTE ] TIC: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T21:28:21.379777] [FATAL] [MAIN ] TIC: Failed to fetch primary data. [2025-09-29T21:28:21.379859] [WARN ] [MAIN ] TIC: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T21:28:21.379954] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-09-29T21:28:21.380046] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-09-29T21:28:21.380115] [INFO ] [LOCAL ] TIC: Starting deletion of derivative data. [2025-09-29T21:28:21.380201] [DEBUG] [LOCAL ] TIC: No derivative data file found to delete. [2025-09-29T21:28:21.380298] [INFO ] [MAIN ] Update Progress: 2092/2371 symbols completed. TIC took 2.6s. Estimated remaining: 35m 47s. Rate: 7.8 symbols/min [2025-09-29T21:28:21.568143] [INFO ] [MAIN ] TISI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:28:21.576334] [DEBUG] [LOCAL ] TISI: Loaded 3805 existing records from primary storage. [2025-09-29T21:28:21.576545] [INFO ] [MAIN ] TISI: Loaded 3805 existing records. [2025-09-29T21:28:21.771458] [WARN ] [MAIN ] TISI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:28:21.771784] [INFO ] [MAIN ] TISI: Wiping existing primary data before full refresh. [2025-09-29T21:28:21.771961] [INFO ] [LOCAL ] TISI: Starting deletion of primary data. [2025-09-29T21:28:21.772198] [DEBUG] [LOCAL ] TISI: Deleted primary data file. [2025-09-29T21:28:21.772372] [INFO ] [MAIN ] TISI: Starting full primary refresh. [2025-09-29T21:28:21.867987] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-29T21:28:21.953393] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2024-12. [2025-09-29T21:28:22.186550] [INFO ] [REMOTE ] TISI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:28:22.748121] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-02. [2025-09-29T21:28:23.548136] [INFO ] [REMOTE ] TISI: Fetching primary data for 2024-12. [2025-09-29T21:28:23.617567] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-29T21:28:23.733207] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-29T21:28:24.210340] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-29T21:28:24.348136] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-07. [2025-09-29T21:28:25.148140] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-01. [2025-09-29T21:28:25.497388] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-29T21:28:25.838864] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-29T21:28:25.948107] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-02. [2025-09-29T21:28:26.583679] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-29T21:28:26.748152] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-03. [2025-09-29T21:28:27.430604] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-29T21:28:27.548110] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-03. [2025-09-29T21:28:28.348099] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-04. [2025-09-29T21:28:28.560101] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-29T21:28:29.099598] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-29T21:28:29.148148] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-04. [2025-09-29T21:28:29.948153] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-01. [2025-09-29T21:28:30.227383] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-29T21:28:30.748113] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-05. [2025-09-29T21:28:31.165849] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-29T21:28:31.488062] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-29T21:28:31.548149] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-08. [2025-09-29T21:28:32.348113] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-02. [2025-09-29T21:28:33.113628] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-29T21:28:33.148084] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-09. [2025-09-29T21:28:33.381571] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-29T21:28:33.948133] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-06. [2025-09-29T21:28:34.649813] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-29T21:28:34.659685] [INFO ] [REMOTE ] THS: Full fetch complete (53829 records). [2025-09-29T21:28:34.659871] [DEBUG] [VALIDATOR ] THS: Validating primary data. [2025-09-29T21:28:34.753467] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-03. [2025-09-29T21:28:34.834821] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-29T21:28:35.090952] [DEBUG] [VALIDATOR ] THS: All expected trading days are present. [2025-09-29T21:28:35.091072] [DEBUG] [VALIDATOR ] THS: Primary data validation passed. [2025-09-29T21:28:35.092161] [INFO ] [MAIN ] THS: Fetched primary data is valid. [2025-09-29T21:28:35.092229] [DEBUG] [LOCAL ] THS: Saving primary data. [2025-09-29T21:28:35.093445] [DEBUG] [LOCAL ] THS: Trimmed 53829 records to 38036 (keeping 200 days of data) [2025-09-29T21:28:35.328310] [DEBUG] [LOCAL ] THS: Primary data saved (38036 records). [2025-09-29T21:28:35.328450] [INFO ] [MAIN ] THS: Full history saved. [2025-09-29T21:28:35.328536] [INFO ] [MAIN ] Update Progress: 2093/2371 symbols completed. THS took 41.3s. Estimated remaining: 35m 40s. Rate: 7.8 symbols/min [2025-09-29T21:28:35.504316] [INFO ] [MAIN ] TIXT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:28:35.540099] [DEBUG] [LOCAL ] TIXT: Loaded 31824 existing records from primary storage. [2025-09-29T21:28:35.540381] [INFO ] [MAIN ] TIXT: Loaded 31824 existing records. [2025-09-29T21:28:35.553194] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-07. [2025-09-29T21:28:35.738689] [WARN ] [MAIN ] TIXT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:28:35.738951] [INFO ] [MAIN ] TIXT: Wiping existing primary data before full refresh. [2025-09-29T21:28:35.739007] [INFO ] [LOCAL ] TIXT: Starting deletion of primary data. [2025-09-29T21:28:35.739339] [DEBUG] [LOCAL ] TIXT: Deleted primary data file. [2025-09-29T21:28:35.739399] [INFO ] [MAIN ] TIXT: Starting full primary refresh. [2025-09-29T21:28:36.101811] [INFO ] [REMOTE ] TIXT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:28:36.348093] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-05. [2025-09-29T21:28:36.476316] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-29T21:28:36.850208] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-29T21:28:36.953319] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-29T21:28:37.148121] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-08. [2025-09-29T21:28:37.948141] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2024-12. [2025-09-29T21:28:38.245601] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-29T21:28:38.748114] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-09. [2025-09-29T21:28:39.229488] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-29T21:28:39.548118] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-04. [2025-09-29T21:28:39.712498] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-29T21:28:39.716591] [INFO ] [REMOTE ] THW: Full fetch complete (29400 records). [2025-09-29T21:28:39.716722] [DEBUG] [VALIDATOR ] THW: Validating primary data. [2025-09-29T21:28:40.114945] [DEBUG] [VALIDATOR ] THW: All expected trading days are present. [2025-09-29T21:28:40.115050] [DEBUG] [VALIDATOR ] THW: Primary data validation passed. [2025-09-29T21:28:40.115682] [INFO ] [MAIN ] THW: Fetched primary data is valid. [2025-09-29T21:28:40.115747] [DEBUG] [LOCAL ] THW: Saving primary data. [2025-09-29T21:28:40.116427] [DEBUG] [LOCAL ] THW: Trimmed 29400 records to 19211 (keeping 200 days of data) [2025-09-29T21:28:40.233059] [DEBUG] [LOCAL ] THW: Primary data saved (19211 records). [2025-09-29T21:28:40.233241] [INFO ] [MAIN ] THW: Full history saved. [2025-09-29T21:28:40.233330] [INFO ] [MAIN ] Update Progress: 2094/2371 symbols completed. THW took 28.5s. Estimated remaining: 35m 32s. Rate: 7.8 symbols/min [2025-09-29T21:28:40.353296] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-06. [2025-09-29T21:28:40.415072] [INFO ] [MAIN ] TJX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:28:40.482607] [DEBUG] [LOCAL ] TJX: Loaded 54449 existing records from primary storage. [2025-09-29T21:28:40.483057] [INFO ] [MAIN ] TJX: Loaded 54449 existing records. [2025-09-29T21:28:40.675799] [WARN ] [MAIN ] TJX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:28:40.676021] [INFO ] [MAIN ] TJX: Wiping existing primary data before full refresh. [2025-09-29T21:28:40.676068] [INFO ] [LOCAL ] TJX: Starting deletion of primary data. [2025-09-29T21:28:40.676513] [DEBUG] [LOCAL ] TJX: Deleted primary data file. [2025-09-29T21:28:40.676571] [INFO ] [MAIN ] TJX: Starting full primary refresh. [2025-09-29T21:28:41.049617] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-29T21:28:41.072308] [INFO ] [REMOTE ] TJX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:28:41.101351] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-29T21:28:41.148116] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-07. [2025-09-29T21:28:41.450058] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-09-29T21:28:41.948117] [INFO ] [REMOTE ] TJX: Fetching primary data for 2024-12. [2025-09-29T21:28:42.748112] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-08. [2025-09-29T21:28:43.222733] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-29T21:28:43.548110] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-09. [2025-09-29T21:28:44.008944] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-29T21:28:44.044148] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-29T21:28:44.045169] [INFO ] [REMOTE ] TISI: Full fetch complete (4924 records). [2025-09-29T21:28:44.045285] [DEBUG] [VALIDATOR ] TISI: Validating primary data. [2025-09-29T21:28:44.353819] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-05. [2025-09-29T21:28:44.436977] [DEBUG] [VALIDATOR ] TISI: All expected trading days are present. [2025-09-29T21:28:44.437088] [DEBUG] [VALIDATOR ] TISI: Primary data validation passed. [2025-09-29T21:28:44.437267] [INFO ] [MAIN ] TISI: Fetched primary data is valid. [2025-09-29T21:28:44.437310] [DEBUG] [LOCAL ] TISI: Saving primary data. [2025-09-29T21:28:44.437722] [DEBUG] [LOCAL ] TISI: Trimmed 4924 records to 3729 (keeping 200 days of data) [2025-09-29T21:28:44.460196] [DEBUG] [LOCAL ] TISI: Primary data saved (3729 records). [2025-09-29T21:28:44.460279] [INFO ] [MAIN ] TISI: Full history saved. [2025-09-29T21:28:44.460357] [INFO ] [MAIN ] Update Progress: 2095/2371 symbols completed. TISI took 23.1s. Estimated remaining: 35m 24s. Rate: 7.8 symbols/min [2025-09-29T21:28:44.637167] [INFO ] [MAIN ] TK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:28:44.677170] [DEBUG] [LOCAL ] TK: Loaded 40151 existing records from primary storage. [2025-09-29T21:28:44.677468] [INFO ] [MAIN ] TK: Loaded 40151 existing records. [2025-09-29T21:28:44.870688] [WARN ] [MAIN ] TK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:28:44.870957] [INFO ] [MAIN ] TK: Wiping existing primary data before full refresh. [2025-09-29T21:28:44.871013] [INFO ] [LOCAL ] TK: Starting deletion of primary data. [2025-09-29T21:28:44.871397] [DEBUG] [LOCAL ] TK: Deleted primary data file. [2025-09-29T21:28:44.871456] [INFO ] [MAIN ] TK: Starting full primary refresh. [2025-09-29T21:28:45.153266] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-01. [2025-09-29T21:28:45.236226] [INFO ] [REMOTE ] TK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:28:45.827024] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-29T21:28:45.948255] [INFO ] [REMOTE ] TK: Fetching primary data for 2024-12. [2025-09-29T21:28:46.748137] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-06. [2025-09-29T21:28:46.984573] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-29T21:28:47.556813] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-01. [2025-09-29T21:28:47.559528] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-29T21:28:48.228367] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-29T21:28:48.348089] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-02. [2025-09-29T21:28:48.789876] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-29T21:28:49.148151] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-01. [2025-09-29T21:28:49.948139] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-02. [2025-09-29T21:28:50.235416] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-29T21:28:50.439788] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-29T21:28:50.748151] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-07. [2025-09-29T21:28:51.140784] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-29T21:28:51.548172] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-03. [2025-09-29T21:28:52.050258] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-29T21:28:52.348144] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-03. [2025-09-29T21:28:53.148071] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-02. [2025-09-29T21:28:53.288842] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-29T21:28:53.533305] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-29T21:28:53.948192] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-04. [2025-09-29T21:28:54.177977] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-29T21:28:54.748137] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-03. [2025-09-29T21:28:54.873160] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-29T21:28:55.548177] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-04. [2025-09-29T21:28:56.339032] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-29T21:28:56.348140] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-04. [2025-09-29T21:28:57.148149] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-08. [2025-09-29T21:28:57.635311] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-29T21:28:57.837976] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-29T21:28:57.948093] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-05. [2025-09-29T21:28:58.578026] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-29T21:28:58.748133] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-05. [2025-09-29T21:28:59.501527] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-29T21:28:59.548123] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-06. [2025-09-29T21:29:00.348122] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-05. [2025-09-29T21:29:00.705131] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-29T21:29:01.104986] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-29T21:29:01.148074] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-06. [2025-09-29T21:29:01.458394] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-29T21:29:01.948117] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-07. [2025-09-29T21:29:02.748137] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-09. [2025-09-29T21:29:03.123258] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-29T21:29:03.462252] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-29T21:29:03.553203] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-06. [2025-09-29T21:29:03.563736] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-29T21:29:03.570873] [INFO ] [REMOTE ] TIMB: Full fetch complete (54421 records). [2025-09-29T21:29:03.571060] [DEBUG] [VALIDATOR ] TIMB: Validating primary data. [2025-09-29T21:29:03.981190] [DEBUG] [VALIDATOR ] TIMB: All expected trading days are present. [2025-09-29T21:29:03.981282] [DEBUG] [VALIDATOR ] TIMB: Primary data validation passed. [2025-09-29T21:29:03.982363] [INFO ] [MAIN ] TIMB: Fetched primary data is valid. [2025-09-29T21:29:03.982432] [DEBUG] [LOCAL ] TIMB: Saving primary data. [2025-09-29T21:29:03.983813] [DEBUG] [LOCAL ] TIMB: Trimmed 54421 records to 36222 (keeping 200 days of data) [2025-09-29T21:29:04.226438] [DEBUG] [LOCAL ] TIMB: Primary data saved (36222 records). [2025-09-29T21:29:04.226600] [INFO ] [MAIN ] TIMB: Full history saved. [2025-09-29T21:29:04.226712] [INFO ] [MAIN ] Update Progress: 2096/2371 symbols completed. TIMB took 43.9s. Estimated remaining: 35m 18s. Rate: 7.8 symbols/min [2025-09-29T21:29:04.353258] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-07. [2025-09-29T21:29:04.436751] [INFO ] [MAIN ] TKC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:29:04.480559] [DEBUG] [LOCAL ] TKC: Loaded 39062 existing records from primary storage. [2025-09-29T21:29:04.481120] [INFO ] [MAIN ] TKC: Loaded 39062 existing records. [2025-09-29T21:29:04.759612] [WARN ] [MAIN ] TKC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:29:04.760767] [INFO ] [MAIN ] TKC: Wiping existing primary data before full refresh. [2025-09-29T21:29:04.760848] [INFO ] [LOCAL ] TKC: Starting deletion of primary data. [2025-09-29T21:29:04.761403] [DEBUG] [LOCAL ] TKC: Deleted primary data file. [2025-09-29T21:29:04.761476] [INFO ] [MAIN ] TKC: Starting full primary refresh. [2025-09-29T21:29:05.104412] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-29T21:29:05.160716] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-07. [2025-09-29T21:29:05.367722] [INFO ] [REMOTE ] TKC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:29:05.948088] [INFO ] [REMOTE ] TKC: Fetching primary data for 2024-12. [2025-09-29T21:29:06.462969] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-29T21:29:06.640919] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-29T21:29:06.748070] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-08. [2025-09-29T21:29:06.783029] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-29T21:29:07.548158] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-01. [2025-09-29T21:29:08.020256] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-29T21:29:08.348160] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-08. [2025-09-29T21:29:08.511272] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-29T21:29:09.148114] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-09. [2025-09-29T21:29:09.948135] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-02. [2025-09-29T21:29:10.361458] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-29T21:29:10.553617] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-29T21:29:10.561083] [INFO ] [REMOTE ] TK: Full fetch complete (56669 records). [2025-09-29T21:29:10.561244] [DEBUG] [VALIDATOR ] TK: Validating primary data. [2025-09-29T21:29:10.749843] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-09. [2025-09-29T21:29:10.983551] [DEBUG] [VALIDATOR ] TK: All expected trading days are present. [2025-09-29T21:29:10.983885] [DEBUG] [VALIDATOR ] TK: Primary data validation passed. [2025-09-29T21:29:10.985108] [INFO ] [MAIN ] TK: Fetched primary data is valid. [2025-09-29T21:29:10.985193] [DEBUG] [LOCAL ] TK: Saving primary data. [2025-09-29T21:29:11.003122] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-29T21:29:11.009806] [DEBUG] [LOCAL ] TK: Trimmed 56669 records to 39550 (keeping 200 days of data) [2025-09-29T21:29:11.244662] [DEBUG] [LOCAL ] TK: Primary data saved (39550 records). [2025-09-29T21:29:11.244819] [INFO ] [MAIN ] TK: Full history saved. [2025-09-29T21:29:11.244907] [INFO ] [MAIN ] Update Progress: 2097/2371 symbols completed. TK took 26.8s. Estimated remaining: 35m 10s. Rate: 7.8 symbols/min [2025-09-29T21:29:11.459501] [INFO ] [MAIN ] TKO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:29:11.508406] [DEBUG] [LOCAL ] TKO: Loaded 44814 existing records from primary storage. [2025-09-29T21:29:11.508747] [INFO ] [MAIN ] TKO: Loaded 44814 existing records. [2025-09-29T21:29:11.553339] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-08. [2025-09-29T21:29:11.693012] [WARN ] [MAIN ] TKO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:29:11.693275] [INFO ] [MAIN ] TKO: Wiping existing primary data before full refresh. [2025-09-29T21:29:11.693330] [INFO ] [LOCAL ] TKO: Starting deletion of primary data. [2025-09-29T21:29:11.693879] [DEBUG] [LOCAL ] TKO: Deleted primary data file. [2025-09-29T21:29:11.693953] [INFO ] [MAIN ] TKO: Starting full primary refresh. [2025-09-29T21:29:12.089103] [INFO ] [REMOTE ] TKO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:29:12.348138] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-03. [2025-09-29T21:29:12.500296] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-29T21:29:12.512612] [INFO ] [REMOTE ] TJX: Full fetch complete (77678 records). [2025-09-29T21:29:12.512883] [DEBUG] [VALIDATOR ] TJX: Validating primary data. [2025-09-29T21:29:12.992625] [DEBUG] [VALIDATOR ] TJX: All expected trading days are present. [2025-09-29T21:29:13.004088] [DEBUG] [VALIDATOR ] TJX: Primary data validation passed. [2025-09-29T21:29:13.012190] [INFO ] [MAIN ] TJX: Fetched primary data is valid. [2025-09-29T21:29:13.012867] [DEBUG] [LOCAL ] TJX: Saving primary data. [2025-09-29T21:29:13.014150] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-29T21:29:13.022937] [DEBUG] [LOCAL ] TJX: Trimmed 77678 records to 53669 (keeping 200 days of data) [2025-09-29T21:29:13.148110] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-09. [2025-09-29T21:29:13.386105] [DEBUG] [LOCAL ] TJX: Primary data saved (53669 records). [2025-09-29T21:29:13.386233] [INFO ] [MAIN ] TJX: Full history saved. [2025-09-29T21:29:13.386326] [INFO ] [MAIN ] Update Progress: 2098/2371 symbols completed. TJX took 33.2s. Estimated remaining: 35m 2s. Rate: 7.8 symbols/min [2025-09-29T21:29:13.564585] [INFO ] [MAIN ] TKR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:29:13.607447] [DEBUG] [LOCAL ] TKR: Loaded 40832 existing records from primary storage. [2025-09-29T21:29:13.607780] [INFO ] [MAIN ] TKR: Loaded 40832 existing records. [2025-09-29T21:29:13.799911] [WARN ] [MAIN ] TKR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:29:13.800214] [INFO ] [MAIN ] TKR: Wiping existing primary data before full refresh. [2025-09-29T21:29:13.800367] [INFO ] [LOCAL ] TKR: Starting deletion of primary data. [2025-09-29T21:29:13.801152] [DEBUG] [LOCAL ] TKR: Deleted primary data file. [2025-09-29T21:29:13.801215] [INFO ] [MAIN ] TKR: Starting full primary refresh. [2025-09-29T21:29:13.952698] [INFO ] [REMOTE ] TKO: Fetching primary data for 2024-12. [2025-09-29T21:29:13.987221] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-29T21:29:14.219208] [INFO ] [REMOTE ] TKR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:29:14.664386] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-29T21:29:14.673685] [INFO ] [REMOTE ] TIXT: Full fetch complete (45689 records). [2025-09-29T21:29:14.673817] [DEBUG] [VALIDATOR ] TIXT: Validating primary data. [2025-09-29T21:29:14.754466] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-04. [2025-09-29T21:29:15.094981] [DEBUG] [VALIDATOR ] TIXT: All expected trading days are present. [2025-09-29T21:29:15.095103] [DEBUG] [VALIDATOR ] TIXT: Primary data validation passed. [2025-09-29T21:29:15.096070] [INFO ] [MAIN ] TIXT: Fetched primary data is valid. [2025-09-29T21:29:15.096159] [DEBUG] [LOCAL ] TIXT: Saving primary data. [2025-09-29T21:29:15.100534] [DEBUG] [LOCAL ] TIXT: Trimmed 45689 records to 31355 (keeping 200 days of data) [2025-09-29T21:29:15.282256] [DEBUG] [LOCAL ] TIXT: Primary data saved (31355 records). [2025-09-29T21:29:15.282394] [INFO ] [MAIN ] TIXT: Full history saved. [2025-09-29T21:29:15.282532] [INFO ] [MAIN ] Update Progress: 2099/2371 symbols completed. TIXT took 40.0s. Estimated remaining: 34m 53s. Rate: 7.8 symbols/min [2025-09-29T21:29:15.456188] [INFO ] [MAIN ] TLK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:29:15.502269] [DEBUG] [LOCAL ] TLK: Loaded 39925 existing records from primary storage. [2025-09-29T21:29:15.502633] [INFO ] [MAIN ] TLK: Loaded 39925 existing records. [2025-09-29T21:29:15.556982] [INFO ] [REMOTE ] TKR: Fetching primary data for 2024-12. [2025-09-29T21:29:15.692025] [WARN ] [MAIN ] TLK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:29:15.692532] [INFO ] [MAIN ] TLK: Wiping existing primary data before full refresh. [2025-09-29T21:29:15.692738] [INFO ] [LOCAL ] TLK: Starting deletion of primary data. [2025-09-29T21:29:15.693437] [DEBUG] [LOCAL ] TLK: Deleted primary data file. [2025-09-29T21:29:15.693500] [INFO ] [MAIN ] TLK: Starting full primary refresh. [2025-09-29T21:29:15.975297] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-29T21:29:16.129979] [INFO ] [REMOTE ] TLK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:29:16.157507] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-29T21:29:16.348141] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-05. [2025-09-29T21:29:16.730184] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-29T21:29:17.148119] [INFO ] [REMOTE ] TLK: Fetching primary data for 2024-12. [2025-09-29T21:29:17.444373] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-29T21:29:17.948144] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-06. [2025-09-29T21:29:18.490461] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-29T21:29:18.748122] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-01. [2025-09-29T21:29:19.548974] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-01. [2025-09-29T21:29:19.552334] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-29T21:29:20.257146] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-29T21:29:20.348113] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-02. [2025-09-29T21:29:21.148080] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-01. [2025-09-29T21:29:21.203399] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-29T21:29:21.419506] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-29T21:29:21.948116] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-03. [2025-09-29T21:29:22.748142] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-07. [2025-09-29T21:29:22.821998] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-29T21:29:23.169802] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-29T21:29:23.548147] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-02. [2025-09-29T21:29:24.176952] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-29T21:29:24.348113] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-02. [2025-09-29T21:29:25.148187] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-04. [2025-09-29T21:29:25.221863] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-29T21:29:25.863296] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-29T21:29:25.948126] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-08. [2025-09-29T21:29:26.644762] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-29T21:29:26.748114] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-03. [2025-09-29T21:29:27.339415] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-29T21:29:27.548101] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-09. [2025-09-29T21:29:28.348094] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-03. [2025-09-29T21:29:28.568841] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-29T21:29:29.148128] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-04. [2025-09-29T21:29:29.236698] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-29T21:29:29.246808] [INFO ] [REMOTE ] TKC: Full fetch complete (51763 records). [2025-09-29T21:29:29.246976] [DEBUG] [VALIDATOR ] TKC: Validating primary data. [2025-09-29T21:29:29.669449] [DEBUG] [VALIDATOR ] TKC: All expected trading days are present. [2025-09-29T21:29:29.669552] [DEBUG] [VALIDATOR ] TKC: Primary data validation passed. [2025-09-29T21:29:29.670733] [INFO ] [MAIN ] TKC: Fetched primary data is valid. [2025-09-29T21:29:29.670912] [DEBUG] [LOCAL ] TKC: Saving primary data. [2025-09-29T21:29:29.672451] [DEBUG] [LOCAL ] TKC: Trimmed 51763 records to 38704 (keeping 200 days of data) [2025-09-29T21:29:29.780155] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-29T21:29:29.930444] [DEBUG] [LOCAL ] TKC: Primary data saved (38704 records). [2025-09-29T21:29:29.930582] [INFO ] [MAIN ] TKC: Full history saved. [2025-09-29T21:29:29.930693] [INFO ] [MAIN ] Update Progress: 2100/2371 symbols completed. TKC took 25.7s. Estimated remaining: 34m 46s. Rate: 7.8 symbols/min [2025-09-29T21:29:29.953162] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-05. [2025-09-29T21:29:30.108917] [INFO ] [MAIN ] TLYS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:29:30.128939] [DEBUG] [LOCAL ] TLYS: Loaded 17064 existing records from primary storage. [2025-09-29T21:29:30.129185] [INFO ] [MAIN ] TLYS: Loaded 17064 existing records. [2025-09-29T21:29:30.317183] [WARN ] [MAIN ] TLYS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:29:30.317393] [INFO ] [MAIN ] TLYS: Wiping existing primary data before full refresh. [2025-09-29T21:29:30.317440] [INFO ] [LOCAL ] TLYS: Starting deletion of primary data. [2025-09-29T21:29:30.317750] [DEBUG] [LOCAL ] TLYS: Deleted primary data file. [2025-09-29T21:29:30.317809] [INFO ] [MAIN ] TLYS: Starting full primary refresh. [2025-09-29T21:29:30.710133] [INFO ] [REMOTE ] TLYS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:29:30.748078] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-04. [2025-09-29T21:29:30.968561] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-29T21:29:31.489156] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-29T21:29:31.548125] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-05. [2025-09-29T21:29:32.178677] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-29T21:29:32.348122] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2024-12. [2025-09-29T21:29:33.148125] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-06. [2025-09-29T21:29:33.312214] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-29T21:29:33.350888] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-29T21:29:33.948109] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-01. [2025-09-29T21:29:34.732777] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-29T21:29:34.748077] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-02. [2025-09-29T21:29:34.882051] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-29T21:29:35.548139] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-05. [2025-09-29T21:29:35.569207] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-29T21:29:36.348113] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-03. [2025-09-29T21:29:37.130312] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-29T21:29:37.147886] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-29T21:29:37.150560] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-06. [2025-09-29T21:29:37.948129] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-06. [2025-09-29T21:29:38.532561] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-29T21:29:38.748112] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-07. [2025-09-29T21:29:39.549405] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-04. [2025-09-29T21:29:39.552566] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-29T21:29:39.942358] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-29T21:29:40.348116] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-08. [2025-09-29T21:29:40.403131] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-29T21:29:41.148113] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-07. [2025-09-29T21:29:41.822233] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-29T21:29:41.948127] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-07. [2025-09-29T21:29:42.667121] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-29T21:29:42.748075] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-08. [2025-09-29T21:29:43.539619] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-29T21:29:43.548387] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-05. [2025-09-29T21:29:44.349511] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-09. [2025-09-29T21:29:44.354868] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-29T21:29:44.411069] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-29T21:29:45.148115] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-08. [2025-09-29T21:29:45.865668] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-29T21:29:45.921477] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-29T21:29:45.930960] [INFO ] [REMOTE ] TKR: Full fetch complete (57729 records). [2025-09-29T21:29:45.931099] [DEBUG] [VALIDATOR ] TKR: Validating primary data. [2025-09-29T21:29:45.953230] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-09. [2025-09-29T21:29:46.345016] [DEBUG] [VALIDATOR ] TKR: All expected trading days are present. [2025-09-29T21:29:46.345102] [DEBUG] [VALIDATOR ] TKR: Primary data validation passed. [2025-09-29T21:29:46.346098] [INFO ] [MAIN ] TKR: Fetched primary data is valid. [2025-09-29T21:29:46.346166] [DEBUG] [LOCAL ] TKR: Saving primary data. [2025-09-29T21:29:46.347444] [DEBUG] [LOCAL ] TKR: Trimmed 57729 records to 40096 (keeping 200 days of data) [2025-09-29T21:29:46.605564] [DEBUG] [LOCAL ] TKR: Primary data saved (40096 records). [2025-09-29T21:29:46.605728] [INFO ] [MAIN ] TKR: Full history saved. [2025-09-29T21:29:46.605842] [INFO ] [MAIN ] Update Progress: 2101/2371 symbols completed. TKR took 33.2s. Estimated remaining: 34m 40s. Rate: 7.8 symbols/min [2025-09-29T21:29:46.753296] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-06. [2025-09-29T21:29:46.787519] [INFO ] [MAIN ] TM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:29:46.831525] [DEBUG] [LOCAL ] TM: Loaded 36992 existing records from primary storage. [2025-09-29T21:29:46.831891] [INFO ] [MAIN ] TM: Loaded 36992 existing records. [2025-09-29T21:29:47.024997] [WARN ] [MAIN ] TM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:29:47.025255] [INFO ] [MAIN ] TM: Wiping existing primary data before full refresh. [2025-09-29T21:29:47.025309] [INFO ] [LOCAL ] TM: Starting deletion of primary data. [2025-09-29T21:29:47.025839] [DEBUG] [LOCAL ] TM: Deleted primary data file. [2025-09-29T21:29:47.025897] [INFO ] [MAIN ] TM: Starting full primary refresh. [2025-09-29T21:29:47.399953] [INFO ] [REMOTE ] TM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:29:47.548116] [INFO ] [REMOTE ] TM: Fetching primary data for 2024-12. [2025-09-29T21:29:47.611542] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-29T21:29:47.621087] [INFO ] [REMOTE ] TKO: Full fetch complete (64672 records). [2025-09-29T21:29:47.621288] [DEBUG] [VALIDATOR ] TKO: Validating primary data. [2025-09-29T21:29:48.056204] [DEBUG] [VALIDATOR ] TKO: All expected trading days are present. [2025-09-29T21:29:48.056393] [DEBUG] [VALIDATOR ] TKO: Primary data validation passed. [2025-09-29T21:29:48.057751] [INFO ] [MAIN ] TKO: Fetched primary data is valid. [2025-09-29T21:29:48.067037] [DEBUG] [LOCAL ] TKO: Saving primary data. [2025-09-29T21:29:48.084204] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-29T21:29:48.094857] [DEBUG] [LOCAL ] TKO: Trimmed 64672 records to 44049 (keeping 200 days of data) [2025-09-29T21:29:48.348268] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-07. [2025-09-29T21:29:48.387334] [DEBUG] [LOCAL ] TKO: Primary data saved (44049 records). [2025-09-29T21:29:48.387478] [INFO ] [MAIN ] TKO: Full history saved. [2025-09-29T21:29:48.387571] [INFO ] [MAIN ] Update Progress: 2102/2371 symbols completed. TKO took 37.1s. Estimated remaining: 34m 31s. Rate: 7.8 symbols/min [2025-09-29T21:29:48.580236] [INFO ] [MAIN ] TME: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:29:48.642473] [DEBUG] [LOCAL ] TME: Loaded 53979 existing records from primary storage. [2025-09-29T21:29:48.642862] [INFO ] [MAIN ] TME: Loaded 53979 existing records. [2025-09-29T21:29:48.837450] [WARN ] [MAIN ] TME: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:29:48.837696] [INFO ] [MAIN ] TME: Wiping existing primary data before full refresh. [2025-09-29T21:29:48.837756] [INFO ] [LOCAL ] TME: Starting deletion of primary data. [2025-09-29T21:29:48.838339] [DEBUG] [LOCAL ] TME: Deleted primary data file. [2025-09-29T21:29:48.838415] [INFO ] [MAIN ] TME: Starting full primary refresh. [2025-09-29T21:29:49.149007] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-09. [2025-09-29T21:29:49.228443] [INFO ] [REMOTE ] TME: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:29:49.259947] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-29T21:29:49.402277] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-29T21:29:49.948127] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-08. [2025-09-29T21:29:50.127145] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-29T21:29:50.135169] [INFO ] [REMOTE ] TLK: Full fetch complete (57251 records). [2025-09-29T21:29:50.135338] [DEBUG] [VALIDATOR ] TLK: Validating primary data. [2025-09-29T21:29:50.539485] [DEBUG] [VALIDATOR ] TLK: All expected trading days are present. [2025-09-29T21:29:50.539569] [DEBUG] [VALIDATOR ] TLK: Primary data validation passed. [2025-09-29T21:29:50.540700] [INFO ] [MAIN ] TLK: Fetched primary data is valid. [2025-09-29T21:29:50.540801] [DEBUG] [LOCAL ] TLK: Saving primary data. [2025-09-29T21:29:50.542033] [DEBUG] [LOCAL ] TLK: Trimmed 57251 records to 39177 (keeping 200 days of data) [2025-09-29T21:29:50.753524] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-01. [2025-09-29T21:29:50.798375] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-29T21:29:50.812237] [DEBUG] [LOCAL ] TLK: Primary data saved (39177 records). [2025-09-29T21:29:50.812403] [INFO ] [MAIN ] TLK: Full history saved. [2025-09-29T21:29:50.812523] [INFO ] [MAIN ] Update Progress: 2103/2371 symbols completed. TLK took 35.5s. Estimated remaining: 34m 23s. Rate: 7.8 symbols/min [2025-09-29T21:29:50.998152] [INFO ] [MAIN ] TMHC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:29:51.045195] [DEBUG] [LOCAL ] TMHC: Loaded 46274 existing records from primary storage. [2025-09-29T21:29:51.045525] [INFO ] [MAIN ] TMHC: Loaded 46274 existing records. [2025-09-29T21:29:51.230496] [WARN ] [MAIN ] TMHC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:29:51.230867] [INFO ] [MAIN ] TMHC: Wiping existing primary data before full refresh. [2025-09-29T21:29:51.230927] [INFO ] [LOCAL ] TMHC: Starting deletion of primary data. [2025-09-29T21:29:51.231403] [DEBUG] [LOCAL ] TMHC: Deleted primary data file. [2025-09-29T21:29:51.231463] [INFO ] [MAIN ] TMHC: Starting full primary refresh. [2025-09-29T21:29:51.563284] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-09. [2025-09-29T21:29:51.606948] [INFO ] [REMOTE ] TMHC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:29:52.348136] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2024-12. [2025-09-29T21:29:52.389006] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-29T21:29:52.521255] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-29T21:29:52.524902] [INFO ] [REMOTE ] TLYS: Full fetch complete (21910 records). [2025-09-29T21:29:52.524989] [DEBUG] [VALIDATOR ] TLYS: Validating primary data. [2025-09-29T21:29:52.915266] [DEBUG] [VALIDATOR ] TLYS: All expected trading days are present. [2025-09-29T21:29:52.915362] [DEBUG] [VALIDATOR ] TLYS: Primary data validation passed. [2025-09-29T21:29:52.915956] [INFO ] [MAIN ] TLYS: Fetched primary data is valid. [2025-09-29T21:29:52.916023] [DEBUG] [LOCAL ] TLYS: Saving primary data. [2025-09-29T21:29:52.916920] [DEBUG] [LOCAL ] TLYS: Trimmed 21910 records to 16915 (keeping 200 days of data) [2025-09-29T21:29:53.015761] [DEBUG] [LOCAL ] TLYS: Primary data saved (16915 records). [2025-09-29T21:29:53.015914] [INFO ] [MAIN ] TLYS: Full history saved. [2025-09-29T21:29:53.016006] [INFO ] [MAIN ] Update Progress: 2104/2371 symbols completed. TLYS took 23.1s. Estimated remaining: 34m 15s. Rate: 7.8 symbols/min [2025-09-29T21:29:53.153225] [INFO ] [REMOTE ] TME: Fetching primary data for 2024-12. [2025-09-29T21:29:53.201012] [INFO ] [MAIN ] TMO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:29:53.265037] [DEBUG] [LOCAL ] TMO: Loaded 53089 existing records from primary storage. [2025-09-29T21:29:53.265398] [INFO ] [MAIN ] TMO: Loaded 53089 existing records. [2025-09-29T21:29:53.449329] [WARN ] [MAIN ] TMO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:29:53.449584] [INFO ] [MAIN ] TMO: Wiping existing primary data before full refresh. [2025-09-29T21:29:53.449634] [INFO ] [LOCAL ] TMO: Starting deletion of primary data. [2025-09-29T21:29:53.450377] [DEBUG] [LOCAL ] TMO: Deleted primary data file. [2025-09-29T21:29:53.450441] [INFO ] [MAIN ] TMO: Starting full primary refresh. [2025-09-29T21:29:53.833429] [INFO ] [REMOTE ] TMO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:29:53.920041] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-29T21:29:53.948084] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-01. [2025-09-29T21:29:54.748103] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-02. [2025-09-29T21:29:55.038780] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-29T21:29:55.548088] [INFO ] [REMOTE ] TMO: Fetching primary data for 2024-12. [2025-09-29T21:29:55.673691] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-29T21:29:56.306469] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-29T21:29:56.348167] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-02. [2025-09-29T21:29:57.148191] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-03. [2025-09-29T21:29:57.350449] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-29T21:29:57.948198] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-01. [2025-09-29T21:29:58.015046] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-29T21:29:58.391529] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-29T21:29:58.748123] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-04. [2025-09-29T21:29:59.548125] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-01. [2025-09-29T21:29:59.702821] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-29T21:30:00.348099] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-02. [2025-09-29T21:30:00.538317] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-29T21:30:01.148113] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-05. [2025-09-29T21:30:01.542424] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-29T21:30:01.948177] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-02. [2025-09-29T21:30:02.210322] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-29T21:30:02.465628] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-29T21:30:02.748148] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-03. [2025-09-29T21:30:03.548086] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-06. [2025-09-29T21:30:03.811465] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-29T21:30:04.348141] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-03. [2025-09-29T21:30:04.551519] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-29T21:30:05.148096] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-04. [2025-09-29T21:30:05.233682] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-29T21:30:05.948130] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-03. [2025-09-29T21:30:06.263672] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-29T21:30:06.748199] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-07. [2025-09-29T21:30:07.050489] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-29T21:30:07.126499] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-29T21:30:07.548139] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-05. [2025-09-29T21:30:08.348088] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-04. [2025-09-29T21:30:08.611689] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-29T21:30:09.148103] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-08. [2025-09-29T21:30:09.428838] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-29T21:30:09.948139] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-04. [2025-09-29T21:30:10.203906] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-29T21:30:10.374948] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-29T21:30:10.748142] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-09. [2025-09-29T21:30:11.548154] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-05. [2025-09-29T21:30:11.726995] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-29T21:30:11.824202] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-29T21:30:11.831567] [INFO ] [REMOTE ] TM: Full fetch complete (52833 records). [2025-09-29T21:30:11.831759] [DEBUG] [VALIDATOR ] TM: Validating primary data. [2025-09-29T21:30:12.251331] [DEBUG] [VALIDATOR ] TM: All expected trading days are present. [2025-09-29T21:30:12.251460] [DEBUG] [VALIDATOR ] TM: Primary data validation passed. [2025-09-29T21:30:12.252603] [INFO ] [MAIN ] TM: Fetched primary data is valid. [2025-09-29T21:30:12.252693] [DEBUG] [LOCAL ] TM: Saving primary data. [2025-09-29T21:30:12.254043] [DEBUG] [LOCAL ] TM: Trimmed 52833 records to 36388 (keeping 200 days of data) [2025-09-29T21:30:12.350550] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-05. [2025-09-29T21:30:12.491979] [DEBUG] [LOCAL ] TM: Primary data saved (36388 records). [2025-09-29T21:30:12.492125] [INFO ] [MAIN ] TM: Full history saved. [2025-09-29T21:30:12.492221] [INFO ] [MAIN ] Update Progress: 2105/2371 symbols completed. TM took 25.9s. Estimated remaining: 34m 8s. Rate: 7.8 symbols/min [2025-09-29T21:30:12.667022] [INFO ] [MAIN ] TNC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:30:12.684872] [DEBUG] [LOCAL ] TNC: Loaded 15334 existing records from primary storage. [2025-09-29T21:30:12.685190] [INFO ] [MAIN ] TNC: Loaded 15334 existing records. [2025-09-29T21:30:12.918934] [WARN ] [MAIN ] TNC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:30:12.920475] [INFO ] [MAIN ] TNC: Wiping existing primary data before full refresh. [2025-09-29T21:30:12.920536] [INFO ] [LOCAL ] TNC: Starting deletion of primary data. [2025-09-29T21:30:12.921313] [DEBUG] [LOCAL ] TNC: Deleted primary data file. [2025-09-29T21:30:12.921373] [INFO ] [MAIN ] TNC: Starting full primary refresh. [2025-09-29T21:30:13.154195] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-06. [2025-09-29T21:30:13.323492] [INFO ] [REMOTE ] TNC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:30:13.549692] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-29T21:30:13.948145] [INFO ] [REMOTE ] TNC: Fetching primary data for 2024-12. [2025-09-29T21:30:13.993511] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-29T21:30:14.748097] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-06. [2025-09-29T21:30:14.983114] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-29T21:30:15.130532] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-29T21:30:15.548142] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-06. [2025-09-29T21:30:16.157574] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-29T21:30:16.348155] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-07. [2025-09-29T21:30:17.084863] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-29T21:30:17.148128] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-07. [2025-09-29T21:30:17.948159] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-01. [2025-09-29T21:30:18.119633] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-29T21:30:18.748092] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-07. [2025-09-29T21:30:19.018870] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-29T21:30:19.162550] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-29T21:30:19.548124] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-08. [2025-09-29T21:30:20.348096] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-08. [2025-09-29T21:30:20.905922] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-29T21:30:20.923659] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-29T21:30:21.148141] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-08. [2025-09-29T21:30:21.948101] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-02. [2025-09-29T21:30:22.376016] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-29T21:30:22.748083] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-09. [2025-09-29T21:30:22.989085] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-29T21:30:23.063075] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-29T21:30:23.548127] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-09. [2025-09-29T21:30:24.348093] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-09. [2025-09-29T21:30:24.633679] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-29T21:30:24.645918] [INFO ] [REMOTE ] TME: Full fetch complete (76928 records). [2025-09-29T21:30:24.646077] [DEBUG] [VALIDATOR ] TME: Validating primary data. [2025-09-29T21:30:24.962776] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-29T21:30:25.002054] [INFO ] [REMOTE ] TMHC: Full fetch complete (65966 records). [2025-09-29T21:30:25.012508] [DEBUG] [VALIDATOR ] TMHC: Validating primary data. [2025-09-29T21:30:25.162223] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-03. [2025-09-29T21:30:25.219140] [DEBUG] [VALIDATOR ] TME: All expected trading days are present. [2025-09-29T21:30:25.224882] [DEBUG] [VALIDATOR ] TME: Primary data validation passed. [2025-09-29T21:30:25.231423] [INFO ] [MAIN ] TME: Fetched primary data is valid. [2025-09-29T21:30:25.242032] [DEBUG] [LOCAL ] TME: Saving primary data. [2025-09-29T21:30:25.330103] [DEBUG] [LOCAL ] TME: Trimmed 76928 records to 53194 (keeping 200 days of data) [2025-09-29T21:30:25.667477] [DEBUG] [VALIDATOR ] TMHC: All expected trading days are present. [2025-09-29T21:30:25.668926] [DEBUG] [VALIDATOR ] TMHC: Primary data validation passed. [2025-09-29T21:30:25.671099] [INFO ] [MAIN ] TMHC: Fetched primary data is valid. [2025-09-29T21:30:25.671822] [DEBUG] [LOCAL ] TMHC: Saving primary data. [2025-09-29T21:30:25.679560] [DEBUG] [LOCAL ] TMHC: Trimmed 65966 records to 45505 (keeping 200 days of data) [2025-09-29T21:30:25.843765] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-29T21:30:25.864234] [INFO ] [REMOTE ] TMO: Full fetch complete (75470 records). [2025-09-29T21:30:25.864683] [DEBUG] [VALIDATOR ] TMO: Validating primary data. [2025-09-29T21:30:26.490288] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-29T21:30:26.558853] [DEBUG] [VALIDATOR ] TMO: All expected trading days are present. [2025-09-29T21:30:26.560332] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-04. [2025-09-29T21:30:26.559964] [DEBUG] [VALIDATOR ] TMO: Primary data validation passed. [2025-09-29T21:30:26.563209] [INFO ] [MAIN ] TMO: Fetched primary data is valid. [2025-09-29T21:30:26.565074] [DEBUG] [LOCAL ] TMO: Saving primary data. [2025-09-29T21:30:26.584554] [DEBUG] [LOCAL ] TMO: Trimmed 75470 records to 52328 (keeping 200 days of data) [2025-09-29T21:30:26.816113] [DEBUG] [LOCAL ] TMHC: Primary data saved (45505 records). [2025-09-29T21:30:26.817523] [INFO ] [MAIN ] TMHC: Full history saved. [2025-09-29T21:30:26.818372] [INFO ] [MAIN ] Update Progress: 2106/2371 symbols completed. TMHC took 36.0s. Estimated remaining: 34m 1s. Rate: 7.8 symbols/min [2025-09-29T21:30:27.029516] [INFO ] [MAIN ] TNET: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:30:27.049725] [DEBUG] [LOCAL ] TME: Primary data saved (53194 records). [2025-09-29T21:30:27.052932] [INFO ] [MAIN ] TME: Full history saved. [2025-09-29T21:30:27.053964] [INFO ] [MAIN ] Update Progress: 2107/2371 symbols completed. TME took 38.7s. Estimated remaining: 33m 53s. Rate: 7.8 symbols/min [2025-09-29T21:30:27.184114] [DEBUG] [LOCAL ] TNET: Loaded 29247 existing records from primary storage. [2025-09-29T21:30:27.204625] [INFO ] [MAIN ] TNET: Loaded 29247 existing records. [2025-09-29T21:30:27.386998] [INFO ] [MAIN ] TNGY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:30:27.471777] [DEBUG] [LOCAL ] TNGY: No existing data file found in primary storage. [2025-09-29T21:30:27.472469] [WARN ] [MAIN ] TNGY: No existing data found, performing full refresh instead. [2025-09-29T21:30:27.492688] [INFO ] [MAIN ] TNGY: Wiping existing primary data before full refresh. [2025-09-29T21:30:27.493903] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-09-29T21:30:27.494587] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-09-29T21:30:27.495575] [INFO ] [MAIN ] TNGY: Starting full primary refresh. [2025-09-29T21:30:27.680101] [WARN ] [MAIN ] TNET: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:30:27.686455] [INFO ] [MAIN ] TNET: Wiping existing primary data before full refresh. [2025-09-29T21:30:27.692037] [INFO ] [LOCAL ] TNET: Starting deletion of primary data. [2025-09-29T21:30:27.709468] [DEBUG] [LOCAL ] TNET: Deleted primary data file. [2025-09-29T21:30:27.733303] [INFO ] [MAIN ] TNET: Starting full primary refresh. [2025-09-29T21:30:27.922385] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-29T21:30:28.048821] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-05. [2025-09-29T21:30:28.383795] [INFO ] [REMOTE ] TNGY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:30:28.401314] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2024-12. [2025-09-29T21:30:28.507678] [INFO ] [REMOTE ] TNET: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:30:28.508726] [INFO ] [REMOTE ] TNET: Fetching primary data for 2024-12. [2025-09-29T21:30:28.600725] [DEBUG] [LOCAL ] TMO: Primary data saved (52328 records). [2025-09-29T21:30:28.600878] [INFO ] [MAIN ] TMO: Full history saved. [2025-09-29T21:30:28.600982] [INFO ] [MAIN ] Update Progress: 2108/2371 symbols completed. TMO took 35.6s. Estimated remaining: 33m 44s. Rate: 7.8 symbols/min [2025-09-29T21:30:28.645770] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T21:30:28.684477] [WARN ] [REMOTE ] TNGY: No data returned for month 2024-12 [2025-09-29T21:30:28.696628] [FATAL] [REMOTE ] TNGY: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T21:30:28.708408] [FATAL] [MAIN ] TNGY: Failed to fetch primary data. [2025-09-29T21:30:28.708501] [WARN ] [MAIN ] TNGY: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T21:30:28.708668] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-09-29T21:30:28.714528] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-09-29T21:30:28.724889] [INFO ] [LOCAL ] TNGY: Starting deletion of derivative data. [2025-09-29T21:30:28.764668] [DEBUG] [LOCAL ] TNGY: No derivative data file found to delete. [2025-09-29T21:30:28.785331] [INFO ] [MAIN ] TNK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:30:28.783684] [INFO ] [MAIN ] Update Progress: 2109/2371 symbols completed. TNGY took 1.7s. Estimated remaining: 33m 36s. Rate: 7.8 symbols/min [2025-09-29T21:30:28.980559] [INFO ] [MAIN ] TNL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:30:28.999613] [DEBUG] [LOCAL ] TNK: Loaded 35701 existing records from primary storage. [2025-09-29T21:30:29.000187] [INFO ] [MAIN ] TNK: Loaded 35701 existing records. [2025-09-29T21:30:29.217868] [WARN ] [MAIN ] TNK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:30:29.218262] [INFO ] [MAIN ] TNK: Wiping existing primary data before full refresh. [2025-09-29T21:30:29.218369] [INFO ] [LOCAL ] TNK: Starting deletion of primary data. [2025-09-29T21:30:29.218877] [DEBUG] [LOCAL ] TNK: Deleted primary data file. [2025-09-29T21:30:29.218954] [INFO ] [MAIN ] TNK: Starting full primary refresh. [2025-09-29T21:30:29.323000] [DEBUG] [LOCAL ] TNL: Loaded 42474 existing records from primary storage. [2025-09-29T21:30:29.357205] [INFO ] [MAIN ] TNL: Loaded 42474 existing records. [2025-09-29T21:30:29.365499] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-29T21:30:29.411092] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-06. [2025-09-29T21:30:29.784209] [WARN ] [MAIN ] TNL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:30:29.805849] [INFO ] [MAIN ] TNL: Wiping existing primary data before full refresh. [2025-09-29T21:30:29.825378] [INFO ] [LOCAL ] TNL: Starting deletion of primary data. [2025-09-29T21:30:29.868879] [INFO ] [REMOTE ] TNK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:30:29.862960] [DEBUG] [LOCAL ] TNL: Deleted primary data file. [2025-09-29T21:30:29.869158] [INFO ] [MAIN ] TNL: Starting full primary refresh. [2025-09-29T21:30:29.952738] [INFO ] [REMOTE ] TNK: Fetching primary data for 2024-12. [2025-09-29T21:30:30.078543] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-29T21:30:30.289354] [INFO ] [REMOTE ] TNL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:30:30.482061] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-29T21:30:30.748115] [INFO ] [REMOTE ] TNL: Fetching primary data for 2024-12. [2025-09-29T21:30:31.366113] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-29T21:30:31.548113] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-01. [2025-09-29T21:30:32.195890] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-29T21:30:32.348118] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-01. [2025-09-29T21:30:32.747150] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-29T21:30:33.148117] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-02. [2025-09-29T21:30:33.796150] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-29T21:30:33.948122] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-07. [2025-09-29T21:30:34.519757] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-29T21:30:34.748098] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-02. [2025-09-29T21:30:34.928971] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-29T21:30:35.548320] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-08. [2025-09-29T21:30:36.152046] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-29T21:30:36.190403] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-29T21:30:36.348123] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-03. [2025-09-29T21:30:37.148118] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-01. [2025-09-29T21:30:37.705931] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-29T21:30:37.948113] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-03. [2025-09-29T21:30:38.602079] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-29T21:30:38.748113] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-02. [2025-09-29T21:30:39.412716] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-29T21:30:39.548154] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-09. [2025-09-29T21:30:40.226558] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-29T21:30:40.269707] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-29T21:30:40.273290] [INFO ] [REMOTE ] TNC: Full fetch complete (23117 records). [2025-09-29T21:30:40.273506] [DEBUG] [VALIDATOR ] TNC: Validating primary data. [2025-09-29T21:30:40.353314] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-04. [2025-09-29T21:30:40.672502] [DEBUG] [VALIDATOR ] TNC: All expected trading days are present. [2025-09-29T21:30:40.672595] [DEBUG] [VALIDATOR ] TNC: Primary data validation passed. [2025-09-29T21:30:40.673131] [INFO ] [MAIN ] TNC: Fetched primary data is valid. [2025-09-29T21:30:40.673197] [DEBUG] [LOCAL ] TNC: Saving primary data. [2025-09-29T21:30:40.674048] [DEBUG] [LOCAL ] TNC: Trimmed 23117 records to 14964 (keeping 200 days of data) [2025-09-29T21:30:40.775875] [DEBUG] [LOCAL ] TNC: Primary data saved (14964 records). [2025-09-29T21:30:40.776042] [INFO ] [MAIN ] TNC: Full history saved. [2025-09-29T21:30:40.776144] [INFO ] [MAIN ] Update Progress: 2110/2371 symbols completed. TNC took 28.3s. Estimated remaining: 33m 29s. Rate: 7.8 symbols/min [2025-09-29T21:30:40.956584] [INFO ] [MAIN ] TOL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:30:41.015958] [DEBUG] [LOCAL ] TOL: Loaded 51738 existing records from primary storage. [2025-09-29T21:30:41.016282] [INFO ] [MAIN ] TOL: Loaded 51738 existing records. [2025-09-29T21:30:41.153363] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-03. [2025-09-29T21:30:41.214977] [WARN ] [MAIN ] TOL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:30:41.215414] [INFO ] [MAIN ] TOL: Wiping existing primary data before full refresh. [2025-09-29T21:30:41.215475] [INFO ] [LOCAL ] TOL: Starting deletion of primary data. [2025-09-29T21:30:41.215911] [DEBUG] [LOCAL ] TOL: Deleted primary data file. [2025-09-29T21:30:41.215974] [INFO ] [MAIN ] TOL: Starting full primary refresh. [2025-09-29T21:30:41.611541] [INFO ] [REMOTE ] TOL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:30:41.712226] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-29T21:30:41.948123] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-05. [2025-09-29T21:30:42.531201] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-29T21:30:42.748123] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-04. [2025-09-29T21:30:43.196274] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-29T21:30:43.548115] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-06. [2025-09-29T21:30:44.348141] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-04. [2025-09-29T21:30:44.496470] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-29T21:30:44.651710] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-29T21:30:45.148113] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-05. [2025-09-29T21:30:45.948187] [INFO ] [REMOTE ] TOL: Fetching primary data for 2024-12. [2025-09-29T21:30:45.985713] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-29T21:30:46.754867] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-05. [2025-09-29T21:30:46.777281] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-29T21:30:47.548106] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-06. [2025-09-29T21:30:47.984204] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-29T21:30:48.316093] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-29T21:30:48.348122] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-06. [2025-09-29T21:30:48.611173] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-29T21:30:49.148164] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-01. [2025-09-29T21:30:49.774322] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-29T21:30:49.948128] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-07. [2025-09-29T21:30:50.481362] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-29T21:30:50.748161] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-07. [2025-09-29T21:30:51.548118] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-07. [2025-09-29T21:30:51.620506] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-29T21:30:52.042869] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-29T21:30:52.348151] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-08. [2025-09-29T21:30:52.520072] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-29T21:30:53.148165] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-08. [2025-09-29T21:30:53.944125] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-29T21:30:53.952804] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-02. [2025-09-29T21:30:54.596699] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-29T21:30:54.748134] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-08. [2025-09-29T21:30:55.548098] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-09. [2025-09-29T21:30:55.643445] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-29T21:30:55.715779] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-29T21:30:56.348146] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-09. [2025-09-29T21:30:56.931008] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-29T21:30:56.938802] [INFO ] [REMOTE ] TNK: Full fetch complete (51831 records). [2025-09-29T21:30:56.938954] [DEBUG] [VALIDATOR ] TNK: Validating primary data. [2025-09-29T21:30:57.152446] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-09. [2025-09-29T21:30:57.379010] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-29T21:30:57.379263] [DEBUG] [VALIDATOR ] TNK: All expected trading days are present. [2025-09-29T21:30:57.385180] [DEBUG] [VALIDATOR ] TNK: Primary data validation passed. [2025-09-29T21:30:57.386732] [INFO ] [MAIN ] TNK: Fetched primary data is valid. [2025-09-29T21:30:57.386901] [INFO ] [REMOTE ] TNET: Full fetch complete (41698 records). [2025-09-29T21:30:57.387111] [DEBUG] [VALIDATOR ] TNET: Validating primary data. [2025-09-29T21:30:57.386976] [DEBUG] [LOCAL ] TNK: Saving primary data. [2025-09-29T21:30:57.499019] [DEBUG] [LOCAL ] TNK: Trimmed 51831 records to 35166 (keeping 200 days of data) [2025-09-29T21:30:57.909507] [DEBUG] [VALIDATOR ] TNET: All expected trading days are present. [2025-09-29T21:30:57.910204] [DEBUG] [VALIDATOR ] TNET: Primary data validation passed. [2025-09-29T21:30:57.911402] [INFO ] [MAIN ] TNET: Fetched primary data is valid. [2025-09-29T21:30:57.911757] [DEBUG] [LOCAL ] TNET: Saving primary data. [2025-09-29T21:30:57.915580] [DEBUG] [LOCAL ] TNET: Trimmed 41698 records to 28664 (keeping 200 days of data) [2025-09-29T21:30:57.972555] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-03. [2025-09-29T21:30:58.192893] [DEBUG] [LOCAL ] TNET: Primary data saved (28664 records). [2025-09-29T21:30:58.193369] [INFO ] [MAIN ] TNET: Full history saved. [2025-09-29T21:30:58.193819] [INFO ] [MAIN ] Update Progress: 2111/2371 symbols completed. TNET took 31.4s. Estimated remaining: 33m 22s. Rate: 7.8 symbols/min [2025-09-29T21:30:58.394899] [INFO ] [MAIN ] TOST: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:30:58.418934] [DEBUG] [LOCAL ] TNK: Primary data saved (35166 records). [2025-09-29T21:30:58.419099] [INFO ] [MAIN ] TNK: Full history saved. [2025-09-29T21:30:58.419195] [INFO ] [MAIN ] Update Progress: 2112/2371 symbols completed. TNK took 29.8s. Estimated remaining: 33m 13s. Rate: 7.8 symbols/min [2025-09-29T21:30:58.608272] [DEBUG] [LOCAL ] TOST: Loaded 54461 existing records from primary storage. [2025-09-29T21:30:58.645989] [INFO ] [MAIN ] TPB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:30:58.641410] [INFO ] [MAIN ] TOST: Loaded 54461 existing records. [2025-09-29T21:30:58.876941] [DEBUG] [LOCAL ] TPB: Loaded 25409 existing records from primary storage. [2025-09-29T21:30:58.878855] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-29T21:30:58.879694] [INFO ] [MAIN ] TPB: Loaded 25409 existing records. [2025-09-29T21:30:58.917542] [WARN ] [MAIN ] TOST: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:30:58.934014] [INFO ] [REMOTE ] TNL: Full fetch complete (58874 records). [2025-09-29T21:30:58.934226] [DEBUG] [VALIDATOR ] TNL: Validating primary data. [2025-09-29T21:30:58.962536] [INFO ] [MAIN ] TOST: Wiping existing primary data before full refresh. [2025-09-29T21:30:58.982197] [INFO ] [LOCAL ] TOST: Starting deletion of primary data. [2025-09-29T21:30:59.037678] [DEBUG] [LOCAL ] TOST: Deleted primary data file. [2025-09-29T21:30:59.093990] [INFO ] [MAIN ] TOST: Starting full primary refresh. [2025-09-29T21:30:59.324490] [WARN ] [MAIN ] TPB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:30:59.346696] [INFO ] [MAIN ] TPB: Wiping existing primary data before full refresh. [2025-09-29T21:30:59.369801] [INFO ] [LOCAL ] TPB: Starting deletion of primary data. [2025-09-29T21:30:59.441277] [DEBUG] [LOCAL ] TPB: Deleted primary data file. [2025-09-29T21:30:59.468543] [INFO ] [MAIN ] TPB: Starting full primary refresh. [2025-09-29T21:30:59.960230] [DEBUG] [VALIDATOR ] TNL: All expected trading days are present. [2025-09-29T21:30:59.979824] [DEBUG] [VALIDATOR ] TNL: Primary data validation passed. [2025-09-29T21:31:00.051702] [INFO ] [MAIN ] TNL: Fetched primary data is valid. [2025-09-29T21:31:00.103596] [DEBUG] [LOCAL ] TNL: Saving primary data. [2025-09-29T21:31:00.210781] [INFO ] [REMOTE ] TOST: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:31:00.234769] [INFO ] [REMOTE ] TOST: Fetching primary data for 2024-12. [2025-09-29T21:31:00.235860] [DEBUG] [LOCAL ] TNL: Trimmed 58874 records to 41762 (keeping 200 days of data) [2025-09-29T21:31:00.419968] [INFO ] [REMOTE ] TPB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:31:00.423849] [INFO ] [REMOTE ] TPB: Fetching primary data for 2024-12. [2025-09-29T21:31:00.474069] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-03 (2.50 seconds). [2025-09-29T21:31:00.490541] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-04. [2025-09-29T21:31:00.646334] [DEBUG] [LOCAL ] TNL: Primary data saved (41762 records). [2025-09-29T21:31:00.646470] [INFO ] [MAIN ] TNL: Full history saved. [2025-09-29T21:31:00.646552] [INFO ] [MAIN ] Update Progress: 2113/2371 symbols completed. TNL took 31.9s. Estimated remaining: 33m 5s. Rate: 7.8 symbols/min [2025-09-29T21:31:00.823234] [INFO ] [MAIN ] TPC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:31:00.866508] [DEBUG] [LOCAL ] TPC: Loaded 39311 existing records from primary storage. [2025-09-29T21:31:00.866864] [INFO ] [MAIN ] TPC: Loaded 39311 existing records. [2025-09-29T21:31:01.052718] [WARN ] [MAIN ] TPC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:31:01.053032] [INFO ] [MAIN ] TPC: Wiping existing primary data before full refresh. [2025-09-29T21:31:01.053095] [INFO ] [LOCAL ] TPC: Starting deletion of primary data. [2025-09-29T21:31:01.053851] [DEBUG] [LOCAL ] TPC: Deleted primary data file. [2025-09-29T21:31:01.053913] [INFO ] [MAIN ] TPC: Starting full primary refresh. [2025-09-29T21:31:01.496350] [INFO ] [REMOTE ] TPC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:31:01.496703] [INFO ] [REMOTE ] TPC: Fetching primary data for 2024-12. [2025-09-29T21:31:01.618281] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-29T21:31:01.948135] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-01. [2025-09-29T21:31:02.407815] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-29T21:31:02.504240] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-09-29T21:31:02.715843] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-29T21:31:02.748083] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-05. [2025-09-29T21:31:02.824886] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-29T21:31:03.548162] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-02. [2025-09-29T21:31:04.348086] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-01. [2025-09-29T21:31:04.442325] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-29T21:31:04.645265] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-29T21:31:05.148119] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-01. [2025-09-29T21:31:05.845074] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-29T21:31:05.948158] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-03. [2025-09-29T21:31:06.748122] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-06. [2025-09-29T21:31:06.990298] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-29T21:31:07.164422] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-29T21:31:07.548163] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-02. [2025-09-29T21:31:08.348104] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-02. [2025-09-29T21:31:08.547736] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-29T21:31:08.597284] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-29T21:31:09.148136] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-07. [2025-09-29T21:31:09.948150] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-03. [2025-09-29T21:31:10.325462] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-29T21:31:10.748101] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-03. [2025-09-29T21:31:11.012035] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-29T21:31:11.448268] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-29T21:31:11.548167] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-08. [2025-09-29T21:31:12.348120] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-04. [2025-09-29T21:31:12.497119] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-29T21:31:13.150498] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-04. [2025-09-29T21:31:13.154333] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-29T21:31:13.465984] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-29T21:31:13.948126] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-05. [2025-09-29T21:31:14.748156] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-09. [2025-09-29T21:31:15.171695] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-29T21:31:15.198210] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-29T21:31:15.548158] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-05. [2025-09-29T21:31:16.348093] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-04. [2025-09-29T21:31:16.540258] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-29T21:31:16.551625] [INFO ] [REMOTE ] TOL: Full fetch complete (73889 records). [2025-09-29T21:31:16.551920] [DEBUG] [VALIDATOR ] TOL: Validating primary data. [2025-09-29T21:31:16.994345] [DEBUG] [VALIDATOR ] TOL: All expected trading days are present. [2025-09-29T21:31:16.994433] [DEBUG] [VALIDATOR ] TOL: Primary data validation passed. [2025-09-29T21:31:16.995563] [INFO ] [MAIN ] TOL: Fetched primary data is valid. [2025-09-29T21:31:16.995630] [DEBUG] [LOCAL ] TOL: Saving primary data. [2025-09-29T21:31:16.997338] [DEBUG] [LOCAL ] TOL: Trimmed 73889 records to 50929 (keeping 200 days of data) [2025-09-29T21:31:17.194549] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-06. [2025-09-29T21:31:17.353764] [DEBUG] [LOCAL ] TOL: Primary data saved (50929 records). [2025-09-29T21:31:17.353949] [INFO ] [MAIN ] TOL: Full history saved. [2025-09-29T21:31:17.354059] [INFO ] [MAIN ] Update Progress: 2114/2371 symbols completed. TOL took 36.6s. Estimated remaining: 32m 58s. Rate: 7.8 symbols/min [2025-09-29T21:31:17.620488] [INFO ] [MAIN ] TPH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:31:17.658216] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-29T21:31:17.709149] [DEBUG] [LOCAL ] TPH: Loaded 45821 existing records from primary storage. [2025-09-29T21:31:17.709683] [INFO ] [MAIN ] TPH: Loaded 45821 existing records. [2025-09-29T21:31:17.855958] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-29T21:31:17.950931] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-06. [2025-09-29T21:31:17.955599] [WARN ] [MAIN ] TPH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:31:17.956970] [INFO ] [MAIN ] TPH: Wiping existing primary data before full refresh. [2025-09-29T21:31:17.957133] [INFO ] [LOCAL ] TPH: Starting deletion of primary data. [2025-09-29T21:31:17.957491] [DEBUG] [LOCAL ] TPH: Deleted primary data file. [2025-09-29T21:31:17.957572] [INFO ] [MAIN ] TPH: Starting full primary refresh. [2025-09-29T21:31:18.366774] [INFO ] [REMOTE ] TPH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:31:18.453630] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-29T21:31:18.748165] [INFO ] [REMOTE ] TPH: Fetching primary data for 2024-12. [2025-09-29T21:31:19.548135] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-07. [2025-09-29T21:31:19.861497] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-29T21:31:20.308699] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-29T21:31:20.348128] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-01. [2025-09-29T21:31:20.865757] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-29T21:31:21.148212] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-05. [2025-09-29T21:31:21.919319] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-29T21:31:21.948144] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-02. [2025-09-29T21:31:22.513574] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-29T21:31:22.748104] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-06. [2025-09-29T21:31:23.355947] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-29T21:31:23.548171] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-08. [2025-09-29T21:31:24.289909] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-29T21:31:24.348131] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-07. [2025-09-29T21:31:24.825001] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-29T21:31:25.148126] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-09. [2025-09-29T21:31:25.948121] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-03. [2025-09-29T21:31:26.290765] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-29T21:31:26.300153] [INFO ] [REMOTE ] TPB: Full fetch complete (34942 records). [2025-09-29T21:31:26.300323] [DEBUG] [VALIDATOR ] TPB: Validating primary data. [2025-09-29T21:31:26.761768] [DEBUG] [VALIDATOR ] TPB: All expected trading days are present. [2025-09-29T21:31:26.761445] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-07. [2025-09-29T21:31:26.762117] [DEBUG] [VALIDATOR ] TPB: Primary data validation passed. [2025-09-29T21:31:26.764268] [INFO ] [MAIN ] TPB: Fetched primary data is valid. [2025-09-29T21:31:26.764392] [DEBUG] [LOCAL ] TPB: Saving primary data. [2025-09-29T21:31:26.767613] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-09-29T21:31:26.780302] [DEBUG] [LOCAL ] TPB: Trimmed 34942 records to 25081 (keeping 200 days of data) [2025-09-29T21:31:26.941399] [DEBUG] [LOCAL ] TPB: Primary data saved (25081 records). [2025-09-29T21:31:26.941553] [INFO ] [MAIN ] TPB: Full history saved. [2025-09-29T21:31:26.941664] [INFO ] [MAIN ] Update Progress: 2115/2371 symbols completed. TPB took 28.5s. Estimated remaining: 32m 51s. Rate: 7.8 symbols/min [2025-09-29T21:31:27.113465] [INFO ] [MAIN ] TPL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:31:27.130339] [DEBUG] [LOCAL ] TPL: Loaded 12533 existing records from primary storage. [2025-09-29T21:31:27.130606] [INFO ] [MAIN ] TPL: Loaded 12533 existing records. [2025-09-29T21:31:27.324604] [WARN ] [MAIN ] TPL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:31:27.325391] [INFO ] [MAIN ] TPL: Wiping existing primary data before full refresh. [2025-09-29T21:31:27.325524] [INFO ] [LOCAL ] TPL: Starting deletion of primary data. [2025-09-29T21:31:27.326115] [DEBUG] [LOCAL ] TPL: Deleted primary data file. [2025-09-29T21:31:27.326181] [INFO ] [MAIN ] TPL: Starting full primary refresh. [2025-09-29T21:31:27.457676] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-29T21:31:27.553325] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-08. [2025-09-29T21:31:27.751483] [INFO ] [REMOTE ] TPL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:31:28.354087] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-04. [2025-09-29T21:31:28.366718] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-29T21:31:29.148157] [INFO ] [REMOTE ] TPL: Fetching primary data for 2024-12. [2025-09-29T21:31:29.513706] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-29T21:31:29.576963] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-29T21:31:29.948106] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-05. [2025-09-29T21:31:30.328411] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-29T21:31:30.748166] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-01. [2025-09-29T21:31:31.428472] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-29T21:31:31.548153] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-09. [2025-09-29T21:31:31.585056] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-29T21:31:32.348158] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-02. [2025-09-29T21:31:33.148098] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-08. [2025-09-29T21:31:33.296071] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-29T21:31:33.517833] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-29T21:31:33.531120] [INFO ] [REMOTE ] TOST: Full fetch complete (77698 records). [2025-09-29T21:31:33.531304] [DEBUG] [VALIDATOR ] TOST: Validating primary data. [2025-09-29T21:31:33.952935] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-06. [2025-09-29T21:31:33.954195] [DEBUG] [VALIDATOR ] TOST: All expected trading days are present. [2025-09-29T21:31:33.954260] [DEBUG] [VALIDATOR ] TOST: Primary data validation passed. [2025-09-29T21:31:33.955569] [INFO ] [MAIN ] TOST: Fetched primary data is valid. [2025-09-29T21:31:33.955754] [DEBUG] [LOCAL ] TOST: Saving primary data. [2025-09-29T21:31:33.957561] [DEBUG] [LOCAL ] TOST: Trimmed 77698 records to 53681 (keeping 200 days of data) [2025-09-29T21:31:34.311418] [DEBUG] [LOCAL ] TOST: Primary data saved (53681 records). [2025-09-29T21:31:34.311561] [INFO ] [MAIN ] TOST: Full history saved. [2025-09-29T21:31:34.311677] [INFO ] [MAIN ] Update Progress: 2116/2371 symbols completed. TOST took 36.1s. Estimated remaining: 32m 43s. Rate: 7.8 symbols/min [2025-09-29T21:31:34.492130] [INFO ] [MAIN ] TPR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:31:34.547056] [DEBUG] [LOCAL ] TPR: Loaded 54252 existing records from primary storage. [2025-09-29T21:31:34.547558] [INFO ] [MAIN ] TPR: Loaded 54252 existing records. [2025-09-29T21:31:34.754610] [WARN ] [MAIN ] TPR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:31:34.754679] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-03. [2025-09-29T21:31:34.766135] [INFO ] [MAIN ] TPR: Wiping existing primary data before full refresh. [2025-09-29T21:31:34.766244] [INFO ] [LOCAL ] TPR: Starting deletion of primary data. [2025-09-29T21:31:34.767277] [DEBUG] [LOCAL ] TPR: Deleted primary data file. [2025-09-29T21:31:34.768542] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-29T21:31:34.768994] [INFO ] [MAIN ] TPR: Starting full primary refresh. [2025-09-29T21:31:35.194385] [INFO ] [REMOTE ] TPR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:31:35.548128] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-09. [2025-09-29T21:31:35.617669] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-29T21:31:35.793717] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-29T21:31:36.348130] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-07. [2025-09-29T21:31:36.956486] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-29T21:31:36.967478] [INFO ] [REMOTE ] TPC: Full fetch complete (55025 records). [2025-09-29T21:31:36.967719] [DEBUG] [VALIDATOR ] TPC: Validating primary data. [2025-09-29T21:31:37.153196] [INFO ] [REMOTE ] TPR: Fetching primary data for 2024-12. [2025-09-29T21:31:37.479398] [DEBUG] [VALIDATOR ] TPC: All expected trading days are present. [2025-09-29T21:31:37.479484] [DEBUG] [VALIDATOR ] TPC: Primary data validation passed. [2025-09-29T21:31:37.480612] [INFO ] [MAIN ] TPC: Fetched primary data is valid. [2025-09-29T21:31:37.480708] [DEBUG] [LOCAL ] TPC: Saving primary data. [2025-09-29T21:31:37.482048] [DEBUG] [LOCAL ] TPC: Trimmed 55025 records to 38713 (keeping 200 days of data) [2025-09-29T21:31:37.720213] [DEBUG] [LOCAL ] TPC: Primary data saved (38713 records). [2025-09-29T21:31:37.720368] [INFO ] [MAIN ] TPC: Full history saved. [2025-09-29T21:31:37.720490] [INFO ] [MAIN ] Update Progress: 2117/2371 symbols completed. TPC took 37.1s. Estimated remaining: 32m 35s. Rate: 7.8 symbols/min [2025-09-29T21:31:37.948101] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-04. [2025-09-29T21:31:37.994573] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-29T21:31:38.748133] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-08. [2025-09-29T21:31:38.859259] [DEBUG] [REMOTE ] TPH: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-09-29T21:31:38.859702] [WARN ] [REMOTE ] TPH: No data returned for month 2025-08 [2025-09-29T21:31:38.859822] [FATAL] [REMOTE ] TPH: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T21:31:38.859954] [FATAL] [MAIN ] TPH: Failed to fetch primary data. [2025-09-29T21:31:38.860029] [WARN ] [MAIN ] TPH: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T21:31:38.860114] [INFO ] [LOCAL ] TPH: Starting deletion of primary data. [2025-09-29T21:31:38.860211] [DEBUG] [LOCAL ] TPH: No primary data file found to delete. [2025-09-29T21:31:38.860283] [INFO ] [LOCAL ] TPH: Starting deletion of derivative data. [2025-09-29T21:31:38.861119] [DEBUG] [LOCAL ] TPH: Deleted derivative data file. [2025-09-29T21:31:38.861274] [INFO ] [MAIN ] Update Progress: 2118/2371 symbols completed. TPH took 21.5s. Estimated remaining: 32m 27s. Rate: 7.8 symbols/min [2025-09-29T21:31:39.076714] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-29T21:31:39.121167] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-29T21:31:39.548119] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-05. [2025-09-29T21:31:40.348135] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-01. [2025-09-29T21:31:40.553311] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-29T21:31:41.148177] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-06. [2025-09-29T21:31:42.123405] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-29T21:31:42.127246] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-07. [2025-09-29T21:31:42.274974] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-29T21:31:42.748153] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-02. [2025-09-29T21:31:42.807088] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-29T21:31:43.548113] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-08. [2025-09-29T21:31:44.008751] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-29T21:31:44.348129] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-09. [2025-09-29T21:31:44.577130] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-29T21:31:45.148100] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-03. [2025-09-29T21:31:45.162712] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-29T21:31:45.167871] [INFO ] [REMOTE ] TPL: Full fetch complete (18039 records). [2025-09-29T21:31:45.168111] [DEBUG] [VALIDATOR ] TPL: Validating primary data. [2025-09-29T21:31:45.789926] [DEBUG] [VALIDATOR ] TPL: All expected trading days are present. [2025-09-29T21:31:45.790046] [DEBUG] [VALIDATOR ] TPL: Primary data validation passed. [2025-09-29T21:31:45.790873] [INFO ] [MAIN ] TPL: Fetched primary data is valid. [2025-09-29T21:31:45.790961] [DEBUG] [LOCAL ] TPL: Saving primary data. [2025-09-29T21:31:45.792290] [DEBUG] [LOCAL ] TPL: Trimmed 18039 records to 12304 (keeping 200 days of data) [2025-09-29T21:31:45.899758] [DEBUG] [LOCAL ] TPL: Primary data saved (12304 records). [2025-09-29T21:31:45.899923] [INFO ] [MAIN ] TPL: Full history saved. [2025-09-29T21:31:45.900042] [INFO ] [MAIN ] Update Progress: 2119/2371 symbols completed. TPL took 19.0s. Estimated remaining: 32m 19s. Rate: 7.8 symbols/min [2025-09-29T21:31:47.104320] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-29T21:31:47.116350] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-04. [2025-09-29T21:31:49.035733] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-29T21:31:49.047300] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-05. [2025-09-29T21:31:50.741722] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-29T21:31:50.754186] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-06. [2025-09-29T21:31:52.556265] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-29T21:31:52.568166] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-07. [2025-09-29T21:31:54.121773] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-29T21:31:54.137261] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-08. [2025-09-29T21:31:56.005222] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-29T21:31:56.017420] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-09. [2025-09-29T21:31:57.794278] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-29T21:31:57.805081] [INFO ] [REMOTE ] TPR: Full fetch complete (77428 records). [2025-09-29T21:31:57.805222] [DEBUG] [VALIDATOR ] TPR: Validating primary data. [2025-09-29T21:31:58.241327] [DEBUG] [VALIDATOR ] TPR: All expected trading days are present. [2025-09-29T21:31:58.241420] [DEBUG] [VALIDATOR ] TPR: Primary data validation passed. [2025-09-29T21:31:58.242797] [INFO ] [MAIN ] TPR: Fetched primary data is valid. [2025-09-29T21:31:58.242865] [DEBUG] [LOCAL ] TPR: Saving primary data. [2025-09-29T21:31:58.244460] [DEBUG] [LOCAL ] TPR: Trimmed 77428 records to 53470 (keeping 200 days of data) [2025-09-29T21:31:58.593061] [DEBUG] [LOCAL ] TPR: Primary data saved (53470 records). [2025-09-29T21:31:58.593209] [INFO ] [MAIN ] TPR: Full history saved. [2025-09-29T21:31:58.593305] [INFO ] [MAIN ] Update Progress: 2120/2371 symbols completed. TPR took 24.3s. Estimated remaining: 32m 12s. Rate: 7.8 symbols/min [2025-09-29T21:31:59.290519] [INFO ] [MAIN ] TR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:31:59.348621] [INFO ] [MAIN ] TPVG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:31:59.365464] [INFO ] [MAIN ] TPZ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:31:59.408341] [INFO ] [MAIN ] TPYP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:31:59.428972] [DEBUG] [LOCAL ] TR: Loaded 18494 existing records from primary storage. [2025-09-29T21:31:59.432435] [DEBUG] [LOCAL ] TPZ: Loaded 5095 existing records from primary storage. [2025-09-29T21:31:59.433403] [INFO ] [MAIN ] TPZ: Loaded 5095 existing records. [2025-09-29T21:31:59.458094] [DEBUG] [LOCAL ] TPYP: Loaded 8039 existing records from primary storage. [2025-09-29T21:31:59.433168] [INFO ] [MAIN ] TR: Loaded 18494 existing records. [2025-09-29T21:31:59.474730] [INFO ] [MAIN ] TPYP: Loaded 8039 existing records. [2025-09-29T21:31:59.661885] [DEBUG] [LOCAL ] TPVG: Loaded 27400 existing records from primary storage. [2025-09-29T21:31:59.745259] [INFO ] [MAIN ] TPVG: Loaded 27400 existing records. [2025-09-29T21:32:00.084842] [WARN ] [MAIN ] TPZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:32:00.127003] [INFO ] [MAIN ] TPZ: Wiping existing primary data before full refresh. [2025-09-29T21:32:00.191316] [INFO ] [LOCAL ] TPZ: Starting deletion of primary data. [2025-09-29T21:32:00.203357] [WARN ] [MAIN ] TPYP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:32:00.225115] [WARN ] [MAIN ] TR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:32:00.225362] [DEBUG] [LOCAL ] TPZ: Deleted primary data file. [2025-09-29T21:32:00.225461] [INFO ] [MAIN ] TPYP: Wiping existing primary data before full refresh. [2025-09-29T21:32:00.241376] [INFO ] [MAIN ] TPZ: Starting full primary refresh. [2025-09-29T21:32:00.246717] [INFO ] [MAIN ] TR: Wiping existing primary data before full refresh. [2025-09-29T21:32:00.251961] [INFO ] [LOCAL ] TPYP: Starting deletion of primary data. [2025-09-29T21:32:00.265840] [INFO ] [LOCAL ] TR: Starting deletion of primary data. [2025-09-29T21:32:00.294475] [DEBUG] [LOCAL ] TR: Deleted primary data file. [2025-09-29T21:32:00.300608] [INFO ] [MAIN ] TR: Starting full primary refresh. [2025-09-29T21:32:00.320746] [DEBUG] [LOCAL ] TPYP: Deleted primary data file. [2025-09-29T21:32:00.348719] [INFO ] [MAIN ] TPYP: Starting full primary refresh. [2025-09-29T21:32:00.504167] [WARN ] [MAIN ] TPVG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:32:00.599131] [INFO ] [MAIN ] TPVG: Wiping existing primary data before full refresh. [2025-09-29T21:32:00.599295] [INFO ] [LOCAL ] TPVG: Starting deletion of primary data. [2025-09-29T21:32:00.604610] [DEBUG] [LOCAL ] TPVG: Deleted primary data file. [2025-09-29T21:32:00.634220] [INFO ] [MAIN ] TPVG: Starting full primary refresh. [2025-09-29T21:32:01.676155] [INFO ] [REMOTE ] TPZ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:32:01.734387] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2024-12. [2025-09-29T21:32:02.000316] [INFO ] [REMOTE ] TPYP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:32:02.045426] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2024-12. [2025-09-29T21:32:02.050265] [INFO ] [REMOTE ] TR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:32:02.062240] [INFO ] [REMOTE ] TR: Fetching primary data for 2024-12. [2025-09-29T21:32:02.128485] [INFO ] [REMOTE ] TPVG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:32:02.128976] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2024-12. [2025-09-29T21:32:02.837386] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-29T21:32:02.840025] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-01. [2025-09-29T21:32:02.846994] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-29T21:32:02.849631] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-01. [2025-09-29T21:32:02.986876] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-29T21:32:02.990380] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-01. [2025-09-29T21:32:03.393235] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-29T21:32:03.409306] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-29T21:32:03.410142] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-01. [2025-09-29T21:32:03.413779] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-02. [2025-09-29T21:32:03.425218] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-29T21:32:03.429400] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-02. [2025-09-29T21:32:03.999935] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-29T21:32:04.005288] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-02. [2025-09-29T21:32:04.012107] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-29T21:32:04.014669] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-03. [2025-09-29T21:32:04.207398] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-29T21:32:04.210247] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-03. [2025-09-29T21:32:04.461388] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-29T21:32:04.464157] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-04. [2025-09-29T21:32:04.581468] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-29T21:32:04.585247] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-03. [2025-09-29T21:32:04.666490] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-29T21:32:04.673442] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-02. [2025-09-29T21:32:04.960953] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-29T21:32:04.963382] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-05. [2025-09-29T21:32:04.995281] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-29T21:32:04.997952] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-04. [2025-09-29T21:32:05.442434] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-29T21:32:05.446596] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-04. [2025-09-29T21:32:05.523858] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-29T21:32:05.604384] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-29T21:32:05.614627] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-29T21:32:05.948128] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-03. [2025-09-29T21:32:06.416115] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-29T21:32:06.748151] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-05. [2025-09-29T21:32:06.935509] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-29T21:32:07.543818] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-29T21:32:07.548053] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-06. [2025-09-29T21:32:08.274670] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-29T21:32:08.348117] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-05. [2025-09-29T21:32:09.148141] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-06. [2025-09-29T21:32:09.410945] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-29T21:32:09.580810] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-29T21:32:09.948128] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-07. [2025-09-29T21:32:10.690449] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-29T21:32:10.748132] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-08. [2025-09-29T21:32:11.493349] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-29T21:32:11.548160] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-06. [2025-09-29T21:32:12.348106] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-07. [2025-09-29T21:32:12.636597] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-29T21:32:13.112507] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-29T21:32:13.148108] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-08. [2025-09-29T21:32:13.801822] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-29T21:32:13.948129] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-09. [2025-09-29T21:32:14.568429] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-29T21:32:14.569912] [INFO ] [REMOTE ] TPZ: Full fetch complete (9192 records). [2025-09-29T21:32:14.569989] [DEBUG] [VALIDATOR ] TPZ: Validating primary data. [2025-09-29T21:32:14.759338] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-07. [2025-09-29T21:32:14.969613] [DEBUG] [VALIDATOR ] TPZ: All expected trading days are present. [2025-09-29T21:32:14.969743] [DEBUG] [VALIDATOR ] TPZ: Primary data validation passed. [2025-09-29T21:32:14.970033] [INFO ] [MAIN ] TPZ: Fetched primary data is valid. [2025-09-29T21:32:14.970097] [DEBUG] [LOCAL ] TPZ: Saving primary data. [2025-09-29T21:32:14.970535] [DEBUG] [LOCAL ] TPZ: Trimmed 9192 records to 5014 (keeping 200 days of data) [2025-09-29T21:32:15.003241] [DEBUG] [LOCAL ] TPZ: Primary data saved (5014 records). [2025-09-29T21:32:15.003371] [INFO ] [MAIN ] TPZ: Full history saved. [2025-09-29T21:32:15.003458] [INFO ] [MAIN ] Update Progress: 2121/2371 symbols completed. TPZ took 16.4s. Estimated remaining: 32m 5s. Rate: 7.8 symbols/min [2025-09-29T21:32:15.194166] [INFO ] [MAIN ] TRAK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:32:15.206429] [DEBUG] [LOCAL ] TRAK: Loaded 9383 existing records from primary storage. [2025-09-29T21:32:15.206692] [INFO ] [MAIN ] TRAK: Loaded 9383 existing records. [2025-09-29T21:32:15.407319] [WARN ] [MAIN ] TRAK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:32:15.407554] [INFO ] [MAIN ] TRAK: Wiping existing primary data before full refresh. [2025-09-29T21:32:15.407605] [INFO ] [LOCAL ] TRAK: Starting deletion of primary data. [2025-09-29T21:32:15.407887] [DEBUG] [LOCAL ] TRAK: Deleted primary data file. [2025-09-29T21:32:15.407949] [INFO ] [MAIN ] TRAK: Starting full primary refresh. [2025-09-29T21:32:15.553254] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-04. [2025-09-29T21:32:15.812053] [INFO ] [REMOTE ] TRAK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:32:16.205067] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-29T21:32:16.348134] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-09. [2025-09-29T21:32:17.070170] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-29T21:32:17.072385] [INFO ] [REMOTE ] TPYP: Full fetch complete (12614 records). [2025-09-29T21:32:17.072481] [DEBUG] [VALIDATOR ] TPYP: Validating primary data. [2025-09-29T21:32:17.148932] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-08. [2025-09-29T21:32:17.211920] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-29T21:32:17.516319] [DEBUG] [VALIDATOR ] TPYP: All expected trading days are present. [2025-09-29T21:32:17.516421] [DEBUG] [VALIDATOR ] TPYP: Primary data validation passed. [2025-09-29T21:32:17.516785] [INFO ] [MAIN ] TPYP: Fetched primary data is valid. [2025-09-29T21:32:17.516852] [DEBUG] [LOCAL ] TPYP: Saving primary data. [2025-09-29T21:32:17.517382] [DEBUG] [LOCAL ] TPYP: Trimmed 12614 records to 7911 (keeping 200 days of data) [2025-09-29T21:32:17.569855] [DEBUG] [LOCAL ] TPYP: Primary data saved (7911 records). [2025-09-29T21:32:17.570010] [INFO ] [MAIN ] TPYP: Full history saved. [2025-09-29T21:32:17.570100] [INFO ] [MAIN ] Update Progress: 2122/2371 symbols completed. TPYP took 19.0s. Estimated remaining: 31m 57s. Rate: 7.8 symbols/min [2025-09-29T21:32:17.746436] [INFO ] [MAIN ] TRC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:32:17.766479] [DEBUG] [LOCAL ] TRC: Loaded 16189 existing records from primary storage. [2025-09-29T21:32:17.766776] [INFO ] [MAIN ] TRC: Loaded 16189 existing records. [2025-09-29T21:32:17.949128] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-05. [2025-09-29T21:32:17.953197] [WARN ] [MAIN ] TRC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:32:17.953753] [INFO ] [MAIN ] TRC: Wiping existing primary data before full refresh. [2025-09-29T21:32:17.954905] [INFO ] [LOCAL ] TRC: Starting deletion of primary data. [2025-09-29T21:32:17.955155] [DEBUG] [LOCAL ] TRC: Deleted primary data file. [2025-09-29T21:32:17.955216] [INFO ] [MAIN ] TRC: Starting full primary refresh. [2025-09-29T21:32:18.347621] [INFO ] [REMOTE ] TRC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:32:18.360817] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-29T21:32:18.748138] [INFO ] [REMOTE ] TRC: Fetching primary data for 2024-12. [2025-09-29T21:32:19.211017] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-29T21:32:19.548139] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-09. [2025-09-29T21:32:19.800140] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-29T21:32:20.348121] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-01. [2025-09-29T21:32:21.148104] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2024-12. [2025-09-29T21:32:21.392905] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-29T21:32:21.770022] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-29T21:32:21.774956] [INFO ] [REMOTE ] TR: Full fetch complete (24963 records). [2025-09-29T21:32:21.775092] [DEBUG] [VALIDATOR ] TR: Validating primary data. [2025-09-29T21:32:21.949939] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-06. [2025-09-29T21:32:22.050821] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-29T21:32:22.195560] [DEBUG] [VALIDATOR ] TR: All expected trading days are present. [2025-09-29T21:32:22.195683] [DEBUG] [VALIDATOR ] TR: Primary data validation passed. [2025-09-29T21:32:22.196344] [INFO ] [MAIN ] TR: Fetched primary data is valid. [2025-09-29T21:32:22.196406] [DEBUG] [LOCAL ] TR: Saving primary data. [2025-09-29T21:32:22.197226] [DEBUG] [LOCAL ] TR: Trimmed 24963 records to 18290 (keeping 200 days of data) [2025-09-29T21:32:22.310507] [DEBUG] [LOCAL ] TR: Primary data saved (18290 records). [2025-09-29T21:32:22.310690] [INFO ] [MAIN ] TR: Full history saved. [2025-09-29T21:32:22.310798] [INFO ] [MAIN ] Update Progress: 2123/2371 symbols completed. TR took 23.7s. Estimated remaining: 31m 49s. Rate: 7.8 symbols/min [2025-09-29T21:32:22.490093] [INFO ] [MAIN ] TREX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:32:22.553028] [DEBUG] [LOCAL ] TREX: Loaded 50733 existing records from primary storage. [2025-09-29T21:32:22.553607] [INFO ] [MAIN ] TREX: Loaded 50733 existing records. [2025-09-29T21:32:22.744263] [WARN ] [MAIN ] TREX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:32:22.744572] [INFO ] [MAIN ] TREX: Wiping existing primary data before full refresh. [2025-09-29T21:32:22.744633] [INFO ] [LOCAL ] TREX: Starting deletion of primary data. [2025-09-29T21:32:22.745323] [DEBUG] [LOCAL ] TREX: Deleted primary data file. [2025-09-29T21:32:22.745385] [INFO ] [MAIN ] TREX: Starting full primary refresh. [2025-09-29T21:32:22.756927] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-01. [2025-09-29T21:32:23.126759] [INFO ] [REMOTE ] TREX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:32:23.277120] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-29T21:32:23.548131] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-07. [2025-09-29T21:32:23.637173] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-29T21:32:24.320402] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-29T21:32:24.348147] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-08. [2025-09-29T21:32:25.148131] [INFO ] [REMOTE ] TREX: Fetching primary data for 2024-12. [2025-09-29T21:32:25.654520] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-29T21:32:25.948149] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-02. [2025-09-29T21:32:26.618139] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-29T21:32:26.748119] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-09. [2025-09-29T21:32:26.839591] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-29T21:32:27.548144] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-01. [2025-09-29T21:32:27.714305] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-29T21:32:27.721762] [INFO ] [REMOTE ] TPVG: Full fetch complete (40422 records). [2025-09-29T21:32:27.722045] [DEBUG] [VALIDATOR ] TPVG: Validating primary data. [2025-09-29T21:32:28.127767] [DEBUG] [VALIDATOR ] TPVG: All expected trading days are present. [2025-09-29T21:32:28.127893] [DEBUG] [VALIDATOR ] TPVG: Primary data validation passed. [2025-09-29T21:32:28.128943] [INFO ] [MAIN ] TPVG: Fetched primary data is valid. [2025-09-29T21:32:28.129010] [DEBUG] [LOCAL ] TPVG: Saving primary data. [2025-09-29T21:32:28.130140] [DEBUG] [LOCAL ] TPVG: Trimmed 40422 records to 26999 (keeping 200 days of data) [2025-09-29T21:32:28.294837] [DEBUG] [LOCAL ] TPVG: Primary data saved (26999 records). [2025-09-29T21:32:28.294992] [INFO ] [MAIN ] TPVG: Full history saved. [2025-09-29T21:32:28.295084] [INFO ] [MAIN ] Update Progress: 2124/2371 symbols completed. TPVG took 29.7s. Estimated remaining: 31m 41s. Rate: 7.8 symbols/min [2025-09-29T21:32:28.359762] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-03. [2025-09-29T21:32:28.477048] [INFO ] [MAIN ] TRGP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:32:28.540347] [DEBUG] [LOCAL ] TRGP: Loaded 51504 existing records from primary storage. [2025-09-29T21:32:28.540714] [INFO ] [MAIN ] TRGP: Loaded 51504 existing records. [2025-09-29T21:32:28.730383] [WARN ] [MAIN ] TRGP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:32:28.730933] [INFO ] [MAIN ] TRGP: Wiping existing primary data before full refresh. [2025-09-29T21:32:28.731131] [INFO ] [LOCAL ] TRGP: Starting deletion of primary data. [2025-09-29T21:32:28.731607] [DEBUG] [LOCAL ] TRGP: Deleted primary data file. [2025-09-29T21:32:28.731701] [INFO ] [MAIN ] TRGP: Starting full primary refresh. [2025-09-29T21:32:29.129390] [INFO ] [REMOTE ] TRGP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:32:29.154679] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-02. [2025-09-29T21:32:29.160713] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-29T21:32:29.299047] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-29T21:32:29.948133] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2024-12. [2025-09-29T21:32:30.039131] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-29T21:32:30.748133] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-03. [2025-09-29T21:32:31.548122] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-02. [2025-09-29T21:32:31.678053] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-29T21:32:31.731935] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-29T21:32:32.348122] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-01. [2025-09-29T21:32:33.101990] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-29T21:32:33.148115] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-03. [2025-09-29T21:32:33.948084] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-04. [2025-09-29T21:32:34.156286] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-29T21:32:34.748092] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-02. [2025-09-29T21:32:34.973274] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-29T21:32:35.061868] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-29T21:32:35.548127] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-04. [2025-09-29T21:32:36.348110] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-05. [2025-09-29T21:32:36.432865] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-29T21:32:36.863422] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-29T21:32:37.148108] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-04. [2025-09-29T21:32:37.362876] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-29T21:32:37.933482] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-29T21:32:37.948077] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-05. [2025-09-29T21:32:38.695516] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-29T21:32:38.748123] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-06. [2025-09-29T21:32:39.363439] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-29T21:32:39.548114] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-07. [2025-09-29T21:32:39.657947] [DEBUG] [REMOTE ] TRC: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-09-29T21:32:39.658283] [WARN ] [REMOTE ] TRC: No data returned for month 2025-07 [2025-09-29T21:32:39.658393] [FATAL] [REMOTE ] TRC: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T21:32:39.658505] [FATAL] [MAIN ] TRC: Failed to fetch primary data. [2025-09-29T21:32:39.658605] [WARN ] [MAIN ] TRC: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T21:32:39.658763] [INFO ] [LOCAL ] TRC: Starting deletion of primary data. [2025-09-29T21:32:39.658901] [DEBUG] [LOCAL ] TRC: No primary data file found to delete. [2025-09-29T21:32:39.659012] [INFO ] [LOCAL ] TRC: Starting deletion of derivative data. [2025-09-29T21:32:39.660126] [DEBUG] [LOCAL ] TRC: Deleted derivative data file. [2025-09-29T21:32:39.660241] [INFO ] [MAIN ] Update Progress: 2125/2371 symbols completed. TRC took 22.1s. Estimated remaining: 31m 34s. Rate: 7.8 symbols/min [2025-09-29T21:32:39.845667] [INFO ] [MAIN ] TRN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:32:39.896309] [DEBUG] [LOCAL ] TRN: Loaded 37786 existing records from primary storage. [2025-09-29T21:32:39.896732] [INFO ] [MAIN ] TRN: Loaded 37786 existing records. [2025-09-29T21:32:40.081486] [WARN ] [MAIN ] TRN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:32:40.081777] [INFO ] [MAIN ] TRN: Wiping existing primary data before full refresh. [2025-09-29T21:32:40.081844] [INFO ] [LOCAL ] TRN: Starting deletion of primary data. [2025-09-29T21:32:40.082250] [DEBUG] [LOCAL ] TRN: Deleted primary data file. [2025-09-29T21:32:40.082309] [INFO ] [MAIN ] TRN: Starting full primary refresh. [2025-09-29T21:32:40.353173] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-06. [2025-09-29T21:32:40.463807] [INFO ] [REMOTE ] TRN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:32:41.148089] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-03. [2025-09-29T21:32:41.300474] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-29T21:32:41.948126] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-05. [2025-09-29T21:32:42.748102] [INFO ] [REMOTE ] TRN: Fetching primary data for 2024-12. [2025-09-29T21:32:42.936488] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-29T21:32:43.548133] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-07. [2025-09-29T21:32:43.659110] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-29T21:32:44.136914] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-29T21:32:44.348128] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-01. [2025-09-29T21:32:44.408829] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-29T21:32:45.148287] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-08. [2025-09-29T21:32:45.760259] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-29T21:32:45.774683] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-29T21:32:45.948154] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-09. [2025-09-29T21:32:46.748117] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-06. [2025-09-29T21:32:46.784787] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-29T21:32:46.787540] [INFO ] [REMOTE ] TRAK: Full fetch complete (13389 records). [2025-09-29T21:32:46.787673] [DEBUG] [VALIDATOR ] TRAK: Validating primary data. [2025-09-29T21:32:47.171595] [DEBUG] [VALIDATOR ] TRAK: All expected trading days are present. [2025-09-29T21:32:47.171720] [DEBUG] [VALIDATOR ] TRAK: Primary data validation passed. [2025-09-29T21:32:47.172198] [INFO ] [MAIN ] TRAK: Fetched primary data is valid. [2025-09-29T21:32:47.172273] [DEBUG] [LOCAL ] TRAK: Saving primary data. [2025-09-29T21:32:47.172878] [DEBUG] [LOCAL ] TRAK: Trimmed 13389 records to 9222 (keeping 200 days of data) [2025-09-29T21:32:47.234010] [DEBUG] [LOCAL ] TRAK: Primary data saved (9222 records). [2025-09-29T21:32:47.234159] [INFO ] [MAIN ] TRAK: Full history saved. [2025-09-29T21:32:47.234308] [INFO ] [MAIN ] Update Progress: 2126/2371 symbols completed. TRAK took 32.2s. Estimated remaining: 31m 26s. Rate: 7.8 symbols/min [2025-09-29T21:32:47.427379] [INFO ] [MAIN ] TRNO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:32:47.492503] [DEBUG] [LOCAL ] TRNO: Loaded 44598 existing records from primary storage. [2025-09-29T21:32:47.492869] [INFO ] [MAIN ] TRNO: Loaded 44598 existing records. [2025-09-29T21:32:47.560317] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-02. [2025-09-29T21:32:47.690041] [WARN ] [MAIN ] TRNO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:32:47.690271] [INFO ] [MAIN ] TRNO: Wiping existing primary data before full refresh. [2025-09-29T21:32:47.690325] [INFO ] [LOCAL ] TRNO: Starting deletion of primary data. [2025-09-29T21:32:47.690727] [DEBUG] [LOCAL ] TRNO: Deleted primary data file. [2025-09-29T21:32:47.690788] [INFO ] [MAIN ] TRNO: Starting full primary refresh. [2025-09-29T21:32:48.073425] [INFO ] [REMOTE ] TRNO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:32:48.348145] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-04. [2025-09-29T21:32:48.400077] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-29T21:32:49.014004] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-29T21:32:49.148131] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-07. [2025-09-29T21:32:49.948151] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2024-12. [2025-09-29T21:32:50.218393] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-29T21:32:50.748091] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-05. [2025-09-29T21:32:50.900935] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-29T21:32:51.556226] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-08. [2025-09-29T21:32:51.561681] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-29T21:32:52.348101] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-01. [2025-09-29T21:32:52.423314] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-29T21:32:52.959234] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-29T21:32:53.148134] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-06. [2025-09-29T21:32:53.842502] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-29T21:32:53.948160] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-02. [2025-09-29T21:32:54.748152] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-09. [2025-09-29T21:32:54.892303] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-29T21:32:55.074378] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-29T21:32:55.548210] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-03. [2025-09-29T21:32:56.348104] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-03. [2025-09-29T21:32:56.446812] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-29T21:32:56.457991] [INFO ] [REMOTE ] TREX: Full fetch complete (71064 records). [2025-09-29T21:32:56.458247] [DEBUG] [VALIDATOR ] TREX: Validating primary data. [2025-09-29T21:32:56.906169] [DEBUG] [VALIDATOR ] TREX: All expected trading days are present. [2025-09-29T21:32:56.906355] [DEBUG] [VALIDATOR ] TREX: Primary data validation passed. [2025-09-29T21:32:56.907851] [INFO ] [MAIN ] TREX: Fetched primary data is valid. [2025-09-29T21:32:56.907939] [DEBUG] [LOCAL ] TREX: Saving primary data. [2025-09-29T21:32:56.909848] [DEBUG] [LOCAL ] TREX: Trimmed 71064 records to 49972 (keeping 200 days of data) [2025-09-29T21:32:57.039866] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-29T21:32:57.149378] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-04. [2025-09-29T21:32:57.279032] [DEBUG] [LOCAL ] TREX: Primary data saved (49972 records). [2025-09-29T21:32:57.279187] [INFO ] [MAIN ] TREX: Full history saved. [2025-09-29T21:32:57.279295] [INFO ] [MAIN ] Update Progress: 2127/2371 symbols completed. TREX took 35.0s. Estimated remaining: 31m 18s. Rate: 7.8 symbols/min [2025-09-29T21:32:57.472283] [INFO ] [MAIN ] TROX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:32:57.504437] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-29T21:32:57.570533] [DEBUG] [LOCAL ] TROX: Loaded 52550 existing records from primary storage. [2025-09-29T21:32:57.571133] [INFO ] [MAIN ] TROX: Loaded 52550 existing records. [2025-09-29T21:32:57.784629] [WARN ] [MAIN ] TROX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:32:57.784890] [INFO ] [MAIN ] TROX: Wiping existing primary data before full refresh. [2025-09-29T21:32:57.784940] [INFO ] [LOCAL ] TROX: Starting deletion of primary data. [2025-09-29T21:32:57.785375] [DEBUG] [LOCAL ] TROX: Deleted primary data file. [2025-09-29T21:32:57.785437] [INFO ] [MAIN ] TROX: Starting full primary refresh. [2025-09-29T21:32:57.955687] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-07. [2025-09-29T21:32:58.183006] [INFO ] [REMOTE ] TROX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:32:58.562962] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-29T21:32:58.748131] [INFO ] [REMOTE ] TROX: Fetching primary data for 2024-12. [2025-09-29T21:32:59.548095] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-04. [2025-09-29T21:32:59.741186] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-29T21:32:59.944296] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-29T21:33:00.348140] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-08. [2025-09-29T21:33:00.764425] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-29T21:33:01.148353] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-05. [2025-09-29T21:33:01.948119] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-01. [2025-09-29T21:33:02.118374] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-29T21:33:02.188676] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-29T21:33:02.748138] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-09. [2025-09-29T21:33:03.554275] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-05. [2025-09-29T21:33:03.561879] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-29T21:33:04.348164] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-06. [2025-09-29T21:33:04.477741] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-29T21:33:04.491834] [INFO ] [REMOTE ] TRGP: Full fetch complete (73454 records). [2025-09-29T21:33:04.492076] [DEBUG] [VALIDATOR ] TRGP: Validating primary data. [2025-09-29T21:33:04.961790] [DEBUG] [VALIDATOR ] TRGP: All expected trading days are present. [2025-09-29T21:33:04.961942] [DEBUG] [VALIDATOR ] TRGP: Primary data validation passed. [2025-09-29T21:33:04.963165] [INFO ] [MAIN ] TRGP: Fetched primary data is valid. [2025-09-29T21:33:04.963241] [DEBUG] [LOCAL ] TRGP: Saving primary data. [2025-09-29T21:33:04.964796] [DEBUG] [LOCAL ] TRGP: Trimmed 73454 records to 50707 (keeping 200 days of data) [2025-09-29T21:33:05.155558] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-02. [2025-09-29T21:33:05.236660] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-29T21:33:05.341366] [DEBUG] [LOCAL ] TRGP: Primary data saved (50707 records). [2025-09-29T21:33:05.341545] [INFO ] [MAIN ] TRGP: Full history saved. [2025-09-29T21:33:05.341689] [INFO ] [MAIN ] Update Progress: 2128/2371 symbols completed. TRGP took 37.0s. Estimated remaining: 31m 11s. Rate: 7.8 symbols/min [2025-09-29T21:33:05.534006] [INFO ] [MAIN ] TRP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:33:05.557824] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-29T21:33:05.621147] [DEBUG] [LOCAL ] TRP: Loaded 52891 existing records from primary storage. [2025-09-29T21:33:05.621611] [INFO ] [MAIN ] TRP: Loaded 52891 existing records. [2025-09-29T21:33:05.818773] [WARN ] [MAIN ] TRP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:33:05.818983] [INFO ] [MAIN ] TRP: Wiping existing primary data before full refresh. [2025-09-29T21:33:05.819033] [INFO ] [LOCAL ] TRP: Starting deletion of primary data. [2025-09-29T21:33:05.819575] [DEBUG] [LOCAL ] TRP: Deleted primary data file. [2025-09-29T21:33:05.819636] [INFO ] [MAIN ] TRP: Starting full primary refresh. [2025-09-29T21:33:05.962199] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-07. [2025-09-29T21:33:06.234262] [INFO ] [REMOTE ] TRP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:33:06.748122] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-06. [2025-09-29T21:33:06.797525] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-29T21:33:07.543585] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-29T21:33:07.552816] [INFO ] [REMOTE ] TRP: Fetching primary data for 2024-12. [2025-09-29T21:33:08.353249] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-08. [2025-09-29T21:33:08.365181] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-29T21:33:09.148117] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-07. [2025-09-29T21:33:09.382029] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-29T21:33:09.857576] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-29T21:33:09.948101] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-01. [2025-09-29T21:33:10.748085] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-09. [2025-09-29T21:33:10.835232] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-29T21:33:11.548102] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-08. [2025-09-29T21:33:11.648619] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-29T21:33:12.180831] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-29T21:33:12.188371] [INFO ] [REMOTE ] TRN: Full fetch complete (52874 records). [2025-09-29T21:33:12.188504] [DEBUG] [VALIDATOR ] TRN: Validating primary data. [2025-09-29T21:33:12.359361] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-02. [2025-09-29T21:33:12.604895] [DEBUG] [VALIDATOR ] TRN: All expected trading days are present. [2025-09-29T21:33:12.604995] [DEBUG] [VALIDATOR ] TRN: Primary data validation passed. [2025-09-29T21:33:12.606182] [INFO ] [MAIN ] TRN: Fetched primary data is valid. [2025-09-29T21:33:12.606265] [DEBUG] [LOCAL ] TRN: Saving primary data. [2025-09-29T21:33:12.607483] [DEBUG] [LOCAL ] TRN: Trimmed 52874 records to 37138 (keeping 200 days of data) [2025-09-29T21:33:12.841593] [DEBUG] [LOCAL ] TRN: Primary data saved (37138 records). [2025-09-29T21:33:12.841762] [INFO ] [MAIN ] TRN: Full history saved. [2025-09-29T21:33:12.841867] [INFO ] [MAIN ] Update Progress: 2129/2371 symbols completed. TRN took 33.2s. Estimated remaining: 31m 3s. Rate: 7.8 symbols/min [2025-09-29T21:33:13.028826] [INFO ] [MAIN ] TRTX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:33:13.068205] [DEBUG] [LOCAL ] TRTX: Loaded 38058 existing records from primary storage. [2025-09-29T21:33:13.068547] [INFO ] [MAIN ] TRTX: Loaded 38058 existing records. [2025-09-29T21:33:13.150287] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-03. [2025-09-29T21:33:13.308341] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-29T21:33:13.312819] [WARN ] [MAIN ] TRTX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:33:13.323099] [INFO ] [MAIN ] TRTX: Wiping existing primary data before full refresh. [2025-09-29T21:33:13.323160] [INFO ] [LOCAL ] TRTX: Starting deletion of primary data. [2025-09-29T21:33:13.323570] [DEBUG] [LOCAL ] TRTX: Deleted primary data file. [2025-09-29T21:33:13.323637] [INFO ] [MAIN ] TRTX: Starting full primary refresh. [2025-09-29T21:33:13.699294] [INFO ] [REMOTE ] TRTX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:33:13.948181] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-09. [2025-09-29T21:33:14.213830] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-29T21:33:14.748120] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-03. [2025-09-29T21:33:15.008481] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-29T21:33:15.460222] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-29T21:33:15.469448] [INFO ] [REMOTE ] TRNO: Full fetch complete (63903 records). [2025-09-29T21:33:15.469576] [DEBUG] [VALIDATOR ] TRNO: Validating primary data. [2025-09-29T21:33:15.553257] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2024-12. [2025-09-29T21:33:15.892180] [DEBUG] [VALIDATOR ] TRNO: All expected trading days are present. [2025-09-29T21:33:15.892274] [DEBUG] [VALIDATOR ] TRNO: Primary data validation passed. [2025-09-29T21:33:15.893461] [INFO ] [MAIN ] TRNO: Fetched primary data is valid. [2025-09-29T21:33:15.893530] [DEBUG] [LOCAL ] TRNO: Saving primary data. [2025-09-29T21:33:15.895719] [DEBUG] [LOCAL ] TRNO: Trimmed 63903 records to 43949 (keeping 200 days of data) [2025-09-29T21:33:16.175825] [DEBUG] [LOCAL ] TRNO: Primary data saved (43949 records). [2025-09-29T21:33:16.175960] [INFO ] [MAIN ] TRNO: Full history saved. [2025-09-29T21:33:16.176043] [INFO ] [MAIN ] Update Progress: 2130/2371 symbols completed. TRNO took 28.9s. Estimated remaining: 30m 55s. Rate: 7.8 symbols/min [2025-09-29T21:33:16.355372] [INFO ] [MAIN ] TRU: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:33:16.352872] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-04. [2025-09-29T21:33:16.412274] [DEBUG] [LOCAL ] TRU: Loaded 51965 existing records from primary storage. [2025-09-29T21:33:16.412630] [INFO ] [MAIN ] TRU: Loaded 51965 existing records. [2025-09-29T21:33:16.605999] [WARN ] [MAIN ] TRU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:33:16.606359] [INFO ] [MAIN ] TRU: Wiping existing primary data before full refresh. [2025-09-29T21:33:16.606464] [INFO ] [LOCAL ] TRU: Starting deletion of primary data. [2025-09-29T21:33:16.607291] [DEBUG] [LOCAL ] TRU: Deleted primary data file. [2025-09-29T21:33:16.607465] [INFO ] [MAIN ] TRU: Starting full primary refresh. [2025-09-29T21:33:16.771109] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-29T21:33:17.033096] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-29T21:33:17.064218] [INFO ] [REMOTE ] TRU: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:33:17.148072] [INFO ] [REMOTE ] TRU: Fetching primary data for 2024-12. [2025-09-29T21:33:17.948138] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-04. [2025-09-29T21:33:18.264453] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-29T21:33:18.383908] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-29T21:33:18.748100] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-05. [2025-09-29T21:33:19.548142] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-01. [2025-09-29T21:33:19.798141] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-29T21:33:20.348133] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-05. [2025-09-29T21:33:20.633275] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-29T21:33:20.946784] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-29T21:33:21.148128] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-02. [2025-09-29T21:33:21.721955] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-29T21:33:21.948128] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-06. [2025-09-29T21:33:22.748118] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-01. [2025-09-29T21:33:22.807918] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-29T21:33:23.517701] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-29T21:33:23.548084] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-07. [2025-09-29T21:33:23.828350] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-29T21:33:24.348129] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-02. [2025-09-29T21:33:25.148163] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-06. [2025-09-29T21:33:25.415972] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-29T21:33:25.756363] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-29T21:33:25.948102] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-03. [2025-09-29T21:33:26.748113] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-03. [2025-09-29T21:33:26.952882] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-29T21:33:27.491737] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-29T21:33:27.548082] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-04. [2025-09-29T21:33:28.348116] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-07. [2025-09-29T21:33:28.513317] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-29T21:33:29.147464] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-29T21:33:29.156418] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-08. [2025-09-29T21:33:29.948082] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-05. [2025-09-29T21:33:30.148859] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-29T21:33:30.748087] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-04. [2025-09-29T21:33:30.855480] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-29T21:33:31.342790] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-29T21:33:31.548157] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-09. [2025-09-29T21:33:32.348101] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-08. [2025-09-29T21:33:32.530920] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-29T21:33:33.071637] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-29T21:33:33.083351] [INFO ] [REMOTE ] TRP: Full fetch complete (75559 records). [2025-09-29T21:33:33.083545] [DEBUG] [VALIDATOR ] TRP: Validating primary data. [2025-09-29T21:33:33.161413] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-05. [2025-09-29T21:33:33.519197] [DEBUG] [VALIDATOR ] TRP: All expected trading days are present. [2025-09-29T21:33:33.519277] [DEBUG] [VALIDATOR ] TRP: Primary data validation passed. [2025-09-29T21:33:33.520396] [INFO ] [MAIN ] TRP: Fetched primary data is valid. [2025-09-29T21:33:33.520459] [DEBUG] [LOCAL ] TRP: Saving primary data. [2025-09-29T21:33:33.521860] [DEBUG] [LOCAL ] TRP: Trimmed 75559 records to 52103 (keeping 200 days of data) [2025-09-29T21:33:33.797695] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-29T21:33:33.911763] [DEBUG] [LOCAL ] TRP: Primary data saved (52103 records). [2025-09-29T21:33:33.911908] [INFO ] [MAIN ] TRP: Full history saved. [2025-09-29T21:33:33.912009] [INFO ] [MAIN ] Update Progress: 2131/2371 symbols completed. TRP took 28.6s. Estimated remaining: 30m 48s. Rate: 7.8 symbols/min [2025-09-29T21:33:33.955965] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-06. [2025-09-29T21:33:34.093998] [INFO ] [MAIN ] TRV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:33:34.149683] [DEBUG] [LOCAL ] TRV: Loaded 48744 existing records from primary storage. [2025-09-29T21:33:34.150097] [INFO ] [MAIN ] TRV: Loaded 48744 existing records. [2025-09-29T21:33:34.353187] [WARN ] [MAIN ] TRV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:33:34.353472] [INFO ] [MAIN ] TRV: Wiping existing primary data before full refresh. [2025-09-29T21:33:34.353536] [INFO ] [LOCAL ] TRV: Starting deletion of primary data. [2025-09-29T21:33:34.354086] [DEBUG] [LOCAL ] TRV: Deleted primary data file. [2025-09-29T21:33:34.354148] [INFO ] [MAIN ] TRV: Starting full primary refresh. [2025-09-29T21:33:34.770978] [INFO ] [REMOTE ] TRV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:33:34.764391] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-09. [2025-09-29T21:33:34.953358] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-29T21:33:35.419066] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-29T21:33:35.548120] [INFO ] [REMOTE ] TRV: Fetching primary data for 2024-12. [2025-09-29T21:33:36.348098] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-07. [2025-09-29T21:33:36.516343] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-29T21:33:36.527543] [INFO ] [REMOTE ] TROX: Full fetch complete (72961 records). [2025-09-29T21:33:36.527734] [DEBUG] [VALIDATOR ] TROX: Validating primary data. [2025-09-29T21:33:36.946140] [DEBUG] [VALIDATOR ] TROX: All expected trading days are present. [2025-09-29T21:33:36.946250] [DEBUG] [VALIDATOR ] TROX: Primary data validation passed. [2025-09-29T21:33:36.947531] [INFO ] [MAIN ] TROX: Fetched primary data is valid. [2025-09-29T21:33:36.947600] [DEBUG] [LOCAL ] TROX: Saving primary data. [2025-09-29T21:33:36.950050] [DEBUG] [LOCAL ] TROX: Trimmed 72961 records to 51813 (keeping 200 days of data) [2025-09-29T21:33:37.158767] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-06. [2025-09-29T21:33:37.267215] [DEBUG] [LOCAL ] TROX: Primary data saved (51813 records). [2025-09-29T21:33:37.267365] [INFO ] [MAIN ] TROX: Full history saved. [2025-09-29T21:33:37.267451] [INFO ] [MAIN ] Update Progress: 2132/2371 symbols completed. TROX took 40.0s. Estimated remaining: 30m 40s. Rate: 7.8 symbols/min [2025-09-29T21:33:37.448803] [INFO ] [MAIN ] TS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:33:37.479222] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-29T21:33:37.543021] [DEBUG] [LOCAL ] TS: Loaded 52425 existing records from primary storage. [2025-09-29T21:33:37.543602] [INFO ] [MAIN ] TS: Loaded 52425 existing records. [2025-09-29T21:33:37.740843] [WARN ] [MAIN ] TS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:33:37.741440] [INFO ] [MAIN ] TS: Wiping existing primary data before full refresh. [2025-09-29T21:33:37.741510] [INFO ] [LOCAL ] TS: Starting deletion of primary data. [2025-09-29T21:33:37.742126] [DEBUG] [LOCAL ] TS: Deleted primary data file. [2025-09-29T21:33:37.742190] [INFO ] [MAIN ] TS: Starting full primary refresh. [2025-09-29T21:33:37.956723] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-01. [2025-09-29T21:33:38.073552] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-29T21:33:38.164842] [INFO ] [REMOTE ] TS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:33:38.757446] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-08. [2025-09-29T21:33:38.764147] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-29T21:33:39.548108] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-07. [2025-09-29T21:33:39.914202] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-29T21:33:40.079008] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-29T21:33:40.348107] [INFO ] [REMOTE ] TS: Fetching primary data for 2024-12. [2025-09-29T21:33:41.040962] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-29T21:33:41.148122] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-09. [2025-09-29T21:33:41.948112] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-02. [2025-09-29T21:33:42.371464] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-29T21:33:42.622324] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-29T21:33:42.630843] [INFO ] [REMOTE ] TRTX: Full fetch complete (53139 records). [2025-09-29T21:33:42.631018] [DEBUG] [VALIDATOR ] TRTX: Validating primary data. [2025-09-29T21:33:42.753341] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-01. [2025-09-29T21:33:43.065068] [DEBUG] [VALIDATOR ] TRTX: All expected trading days are present. [2025-09-29T21:33:43.065187] [DEBUG] [VALIDATOR ] TRTX: Primary data validation passed. [2025-09-29T21:33:43.066208] [INFO ] [MAIN ] TRTX: Fetched primary data is valid. [2025-09-29T21:33:43.066292] [DEBUG] [LOCAL ] TRTX: Saving primary data. [2025-09-29T21:33:43.067594] [DEBUG] [LOCAL ] TRTX: Trimmed 53139 records to 37400 (keeping 200 days of data) [2025-09-29T21:33:43.293909] [DEBUG] [LOCAL ] TRTX: Primary data saved (37400 records). [2025-09-29T21:33:43.294056] [INFO ] [MAIN ] TRTX: Full history saved. [2025-09-29T21:33:43.294156] [INFO ] [MAIN ] Update Progress: 2133/2371 symbols completed. TRTX took 30.5s. Estimated remaining: 30m 32s. Rate: 7.8 symbols/min [2025-09-29T21:33:43.476586] [INFO ] [MAIN ] TSE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:33:43.506491] [DEBUG] [LOCAL ] TSE: Loaded 29074 existing records from primary storage. [2025-09-29T21:33:43.506873] [INFO ] [MAIN ] TSE: Loaded 29074 existing records. [2025-09-29T21:33:43.552373] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-08. [2025-09-29T21:33:43.706497] [WARN ] [MAIN ] TSE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:33:43.706973] [INFO ] [MAIN ] TSE: Wiping existing primary data before full refresh. [2025-09-29T21:33:43.707076] [INFO ] [LOCAL ] TSE: Starting deletion of primary data. [2025-09-29T21:33:43.707571] [DEBUG] [LOCAL ] TSE: Deleted primary data file. [2025-09-29T21:33:43.707752] [INFO ] [MAIN ] TSE: Starting full primary refresh. [2025-09-29T21:33:43.845336] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-29T21:33:44.130278] [INFO ] [REMOTE ] TSE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:33:44.188973] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-29T21:33:44.348077] [INFO ] [REMOTE ] TSE: Fetching primary data for 2024-12. [2025-09-29T21:33:45.148137] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-03. [2025-09-29T21:33:45.283387] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-29T21:33:45.603465] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-29T21:33:45.948146] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-01. [2025-09-29T21:33:46.748125] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-09. [2025-09-29T21:33:47.074639] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-29T21:33:47.118204] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-29T21:33:47.548196] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-02. [2025-09-29T21:33:48.348180] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-02. [2025-09-29T21:33:48.727413] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-29T21:33:48.741900] [INFO ] [REMOTE ] TRU: Full fetch complete (73222 records). [2025-09-29T21:33:48.742071] [DEBUG] [VALIDATOR ] TRU: Validating primary data. [2025-09-29T21:33:49.165518] [DEBUG] [VALIDATOR ] TRU: All expected trading days are present. [2025-09-29T21:33:49.165607] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-04. [2025-09-29T21:33:49.166594] [DEBUG] [VALIDATOR ] TRU: Primary data validation passed. [2025-09-29T21:33:49.168467] [INFO ] [MAIN ] TRU: Fetched primary data is valid. [2025-09-29T21:33:49.168749] [DEBUG] [LOCAL ] TRU: Saving primary data. [2025-09-29T21:33:49.171262] [DEBUG] [LOCAL ] TRU: Trimmed 73222 records to 51194 (keeping 200 days of data) [2025-09-29T21:33:49.294557] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-29T21:33:49.562340] [DEBUG] [LOCAL ] TRU: Primary data saved (51194 records). [2025-09-29T21:33:49.563119] [INFO ] [MAIN ] TRU: Full history saved. [2025-09-29T21:33:49.563935] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-29T21:33:49.564204] [INFO ] [MAIN ] Update Progress: 2134/2371 symbols completed. TRU took 33.4s. Estimated remaining: 30m 24s. Rate: 7.8 symbols/min [2025-09-29T21:33:49.750604] [INFO ] [MAIN ] TSI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:33:49.760791] [DEBUG] [LOCAL ] TSI: Loaded 8090 existing records from primary storage. [2025-09-29T21:33:49.761051] [INFO ] [MAIN ] TSI: Loaded 8090 existing records. [2025-09-29T21:33:49.952496] [WARN ] [MAIN ] TSI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:33:49.952634] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-03. [2025-09-29T21:33:49.953207] [INFO ] [MAIN ] TSI: Wiping existing primary data before full refresh. [2025-09-29T21:33:49.954242] [INFO ] [LOCAL ] TSI: Starting deletion of primary data. [2025-09-29T21:33:49.954515] [DEBUG] [LOCAL ] TSI: Deleted primary data file. [2025-09-29T21:33:49.954578] [INFO ] [MAIN ] TSI: Starting full primary refresh. [2025-09-29T21:33:50.348528] [INFO ] [REMOTE ] TSI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:33:50.748137] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-03. [2025-09-29T21:33:51.202537] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-29T21:33:51.307495] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-29T21:33:51.548150] [INFO ] [REMOTE ] TSI: Fetching primary data for 2024-12. [2025-09-29T21:33:52.287867] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-29T21:33:52.348092] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-04. [2025-09-29T21:33:52.529313] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-29T21:33:53.148169] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-04. [2025-09-29T21:33:53.595383] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-29T21:33:53.948134] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-05. [2025-09-29T21:33:54.748124] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-01. [2025-09-29T21:33:54.945837] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-29T21:33:55.206790] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-29T21:33:55.223476] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-29T21:33:55.548157] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-05. [2025-09-29T21:33:56.348117] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-05. [2025-09-29T21:33:57.148090] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-06. [2025-09-29T21:33:57.234914] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-29T21:33:57.814733] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-29T21:33:57.948151] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-02. [2025-09-29T21:33:58.748114] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-06. [2025-09-29T21:33:58.888386] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-29T21:33:58.927748] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-29T21:33:59.548130] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-07. [2025-09-29T21:34:00.096895] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-29T21:34:00.348140] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-03. [2025-09-29T21:34:01.157771] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-06. [2025-09-29T21:34:01.182600] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-29T21:34:01.357962] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-29T21:34:01.948147] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-04. [2025-09-29T21:34:02.160998] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-29T21:34:02.748114] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-07. [2025-09-29T21:34:02.777200] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-29T21:34:03.548139] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-07. [2025-09-29T21:34:04.121115] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-29T21:34:04.348145] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-08. [2025-09-29T21:34:05.148105] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-05. [2025-09-29T21:34:05.263059] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-29T21:34:05.683734] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-29T21:34:05.706963] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-29T21:34:05.948120] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-06. [2025-09-29T21:34:06.709398] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-29T21:34:06.748145] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-08. [2025-09-29T21:34:07.548113] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-08. [2025-09-29T21:34:08.348135] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-07. [2025-09-29T21:34:08.565974] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-29T21:34:08.812362] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-29T21:34:09.148115] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-09. [2025-09-29T21:34:09.322357] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-29T21:34:09.948157] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-08. [2025-09-29T21:34:10.748148] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-09. [2025-09-29T21:34:10.834823] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-29T21:34:10.844708] [INFO ] [REMOTE ] TRV: Full fetch complete (69924 records). [2025-09-29T21:34:10.844886] [DEBUG] [VALIDATOR ] TRV: Validating primary data. [2025-09-29T21:34:10.967690] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-29T21:34:11.399875] [DEBUG] [VALIDATOR ] TRV: All expected trading days are present. [2025-09-29T21:34:11.399997] [DEBUG] [VALIDATOR ] TRV: Primary data validation passed. [2025-09-29T21:34:11.401841] [INFO ] [MAIN ] TRV: Fetched primary data is valid. [2025-09-29T21:34:11.401931] [DEBUG] [LOCAL ] TRV: Saving primary data. [2025-09-29T21:34:11.403895] [DEBUG] [LOCAL ] TRV: Trimmed 69924 records to 47907 (keeping 200 days of data) [2025-09-29T21:34:11.550938] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-09. [2025-09-29T21:34:11.789086] [DEBUG] [LOCAL ] TRV: Primary data saved (47907 records). [2025-09-29T21:34:11.789252] [INFO ] [MAIN ] TRV: Full history saved. [2025-09-29T21:34:11.789431] [INFO ] [MAIN ] Update Progress: 2135/2371 symbols completed. TRV took 37.9s. Estimated remaining: 30m 18s. Rate: 7.8 symbols/min [2025-09-29T21:34:11.990434] [INFO ] [MAIN ] TSLX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:34:11.986790] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-29T21:34:11.996459] [INFO ] [REMOTE ] TSE: Full fetch complete (41713 records). [2025-09-29T21:34:11.996564] [DEBUG] [VALIDATOR ] TSE: Validating primary data. [2025-09-29T21:34:12.348191] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-29T21:34:12.354546] [DEBUG] [LOCAL ] TSLX: Loaded 35752 existing records from primary storage. [2025-09-29T21:34:12.353429] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-09. [2025-09-29T21:34:12.381054] [INFO ] [MAIN ] TSLX: Loaded 35752 existing records. [2025-09-29T21:34:12.379844] [INFO ] [REMOTE ] TSI: Full fetch complete (13277 records). [2025-09-29T21:34:12.386848] [DEBUG] [VALIDATOR ] TSI: Validating primary data. [2025-09-29T21:34:12.703283] [DEBUG] [VALIDATOR ] TSE: All expected trading days are present. [2025-09-29T21:34:12.708602] [DEBUG] [VALIDATOR ] TSE: Primary data validation passed. [2025-09-29T21:34:12.715096] [INFO ] [MAIN ] TSE: Fetched primary data is valid. [2025-09-29T21:34:12.760200] [DEBUG] [LOCAL ] TSE: Saving primary data. [2025-09-29T21:34:12.937751] [DEBUG] [LOCAL ] TSE: Trimmed 41713 records to 28538 (keeping 200 days of data) [2025-09-29T21:34:12.954738] [WARN ] [MAIN ] TSLX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:34:12.981068] [INFO ] [MAIN ] TSLX: Wiping existing primary data before full refresh. [2025-09-29T21:34:12.995597] [INFO ] [LOCAL ] TSLX: Starting deletion of primary data. [2025-09-29T21:34:13.116794] [DEBUG] [LOCAL ] TSLX: Deleted primary data file. [2025-09-29T21:34:13.122417] [INFO ] [MAIN ] TSLX: Starting full primary refresh. [2025-09-29T21:34:13.303988] [DEBUG] [VALIDATOR ] TSI: All expected trading days are present. [2025-09-29T21:34:13.309577] [DEBUG] [VALIDATOR ] TSI: Primary data validation passed. [2025-09-29T21:34:13.323844] [INFO ] [MAIN ] TSI: Fetched primary data is valid. [2025-09-29T21:34:13.352028] [DEBUG] [LOCAL ] TSI: Saving primary data. [2025-09-29T21:34:13.424175] [DEBUG] [LOCAL ] TSI: Trimmed 13277 records to 7626 (keeping 200 days of data) [2025-09-29T21:34:13.508056] [DEBUG] [LOCAL ] TSE: Primary data saved (28538 records). [2025-09-29T21:34:13.533084] [INFO ] [MAIN ] TSE: Full history saved. [2025-09-29T21:34:13.538465] [INFO ] [MAIN ] Update Progress: 2136/2371 symbols completed. TSE took 30.2s. Estimated remaining: 30m 10s. Rate: 7.8 symbols/min [2025-09-29T21:34:13.875946] [DEBUG] [LOCAL ] TSI: Primary data saved (7626 records). [2025-09-29T21:34:13.921363] [INFO ] [MAIN ] TSI: Full history saved. [2025-09-29T21:34:13.940026] [INFO ] [MAIN ] Update Progress: 2137/2371 symbols completed. TSI took 24.4s. Estimated remaining: 30m 1s. Rate: 7.8 symbols/min [2025-09-29T21:34:13.946024] [INFO ] [REMOTE ] TSLX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:34:14.001117] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2024-12. [2025-09-29T21:34:14.064152] [INFO ] [MAIN ] TSM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:34:14.184296] [INFO ] [MAIN ] TSN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:34:14.243038] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-29T21:34:14.271585] [INFO ] [REMOTE ] TS: Full fetch complete (74484 records). [2025-09-29T21:34:14.271959] [DEBUG] [VALIDATOR ] TS: Validating primary data. [2025-09-29T21:34:14.273145] [DEBUG] [LOCAL ] TSM: Loaded 54599 existing records from primary storage. [2025-09-29T21:34:14.288158] [INFO ] [MAIN ] TSM: Loaded 54599 existing records. [2025-09-29T21:34:14.566592] [DEBUG] [LOCAL ] TSN: Loaded 53638 existing records from primary storage. [2025-09-29T21:34:14.577506] [INFO ] [MAIN ] TSN: Loaded 53638 existing records. [2025-09-29T21:34:14.745265] [WARN ] [MAIN ] TSM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:34:14.839245] [INFO ] [MAIN ] TSM: Wiping existing primary data before full refresh. [2025-09-29T21:34:14.848266] [INFO ] [LOCAL ] TSM: Starting deletion of primary data. [2025-09-29T21:34:14.907592] [DEBUG] [LOCAL ] TSM: Deleted primary data file. [2025-09-29T21:34:14.967580] [INFO ] [MAIN ] TSM: Starting full primary refresh. [2025-09-29T21:34:15.193525] [WARN ] [MAIN ] TSN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:34:15.254023] [INFO ] [MAIN ] TSN: Wiping existing primary data before full refresh. [2025-09-29T21:34:15.306088] [DEBUG] [VALIDATOR ] TS: All expected trading days are present. [2025-09-29T21:34:15.306343] [DEBUG] [VALIDATOR ] TS: Primary data validation passed. [2025-09-29T21:34:15.313379] [INFO ] [MAIN ] TS: Fetched primary data is valid. [2025-09-29T21:34:15.306267] [INFO ] [LOCAL ] TSN: Starting deletion of primary data. [2025-09-29T21:34:15.323901] [DEBUG] [LOCAL ] TS: Saving primary data. [2025-09-29T21:34:15.364364] [DEBUG] [LOCAL ] TSN: Deleted primary data file. [2025-09-29T21:34:15.368371] [INFO ] [MAIN ] TSN: Starting full primary refresh. [2025-09-29T21:34:15.478999] [DEBUG] [LOCAL ] TS: Trimmed 74484 records to 51664 (keeping 200 days of data) [2025-09-29T21:34:15.611692] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-29T21:34:15.672713] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-01. [2025-09-29T21:34:16.002944] [INFO ] [REMOTE ] TSM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:34:16.034833] [INFO ] [REMOTE ] TSM: Fetching primary data for 2024-12. [2025-09-29T21:34:16.309246] [INFO ] [REMOTE ] TSN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:34:16.310341] [INFO ] [REMOTE ] TSN: Fetching primary data for 2024-12. [2025-09-29T21:34:16.402264] [DEBUG] [LOCAL ] TS: Primary data saved (51664 records). [2025-09-29T21:34:16.402426] [INFO ] [MAIN ] TS: Full history saved. [2025-09-29T21:34:16.402530] [INFO ] [MAIN ] Update Progress: 2138/2371 symbols completed. TS took 39.1s. Estimated remaining: 29m 53s. Rate: 7.8 symbols/min [2025-09-29T21:34:16.576680] [INFO ] [MAIN ] TSQ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:34:16.591151] [DEBUG] [LOCAL ] TSQ: Loaded 12195 existing records from primary storage. [2025-09-29T21:34:16.591396] [INFO ] [MAIN ] TSQ: Loaded 12195 existing records. [2025-09-29T21:34:16.780910] [WARN ] [MAIN ] TSQ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:34:16.781151] [INFO ] [MAIN ] TSQ: Wiping existing primary data before full refresh. [2025-09-29T21:34:16.781198] [INFO ] [LOCAL ] TSQ: Starting deletion of primary data. [2025-09-29T21:34:16.781432] [DEBUG] [LOCAL ] TSQ: Deleted primary data file. [2025-09-29T21:34:16.781491] [INFO ] [MAIN ] TSQ: Starting full primary refresh. [2025-09-29T21:34:17.159741] [INFO ] [REMOTE ] TSQ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:34:17.160140] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2024-12. [2025-09-29T21:34:17.217617] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-29T21:34:17.223471] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-02. [2025-09-29T21:34:17.972401] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-29T21:34:17.975589] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-01. [2025-09-29T21:34:18.148196] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-29T21:34:18.494198] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-29T21:34:18.636841] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-29T21:34:18.748153] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-01. [2025-09-29T21:34:19.109975] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2024-12 (3.08 seconds). [2025-09-29T21:34:19.548142] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-03. [2025-09-29T21:34:20.348092] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-02. [2025-09-29T21:34:20.519456] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-29T21:34:20.971436] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-29T21:34:20.994852] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-29T21:34:21.148109] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-04. [2025-09-29T21:34:21.948128] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-02. [2025-09-29T21:34:22.624995] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-29T21:34:22.748128] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-01. [2025-09-29T21:34:23.460294] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-29T21:34:23.548115] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-03. [2025-09-29T21:34:24.348132] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-03. [2025-09-29T21:34:25.136990] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-29T21:34:25.148051] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-04. [2025-09-29T21:34:25.406670] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-01 (2.66 seconds). [2025-09-29T21:34:25.474386] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-29T21:34:25.667128] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-29T21:34:25.948121] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-05. [2025-09-29T21:34:26.748100] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-02. [2025-09-29T21:34:26.934195] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-29T21:34:27.548170] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-05. [2025-09-29T21:34:28.348095] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-04. [2025-09-29T21:34:29.062278] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-29T21:34:29.148113] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-06. [2025-09-29T21:34:29.311129] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-02 (2.56 seconds). [2025-09-29T21:34:29.739698] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-29T21:34:29.948124] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-06. [2025-09-29T21:34:30.641254] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-29T21:34:30.748126] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-07. [2025-09-29T21:34:30.925163] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-29T21:34:31.548131] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-07. [2025-09-29T21:34:32.296280] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-29T21:34:32.348109] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-05. [2025-09-29T21:34:32.375888] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-29T21:34:33.148132] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-08. [2025-09-29T21:34:33.948095] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-03. [2025-09-29T21:34:33.960826] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-29T21:34:34.369815] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-29T21:34:34.748133] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-09. [2025-09-29T21:34:35.399177] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-29T21:34:35.401560] [INFO ] [REMOTE ] TSQ: Full fetch complete (16593 records). [2025-09-29T21:34:35.401662] [DEBUG] [VALIDATOR ] TSQ: Validating primary data. [2025-09-29T21:34:35.556749] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-08. [2025-09-29T21:34:35.782854] [DEBUG] [VALIDATOR ] TSQ: All expected trading days are present. [2025-09-29T21:34:35.782938] [DEBUG] [VALIDATOR ] TSQ: Primary data validation passed. [2025-09-29T21:34:35.783371] [INFO ] [MAIN ] TSQ: Fetched primary data is valid. [2025-09-29T21:34:35.783428] [DEBUG] [LOCAL ] TSQ: Saving primary data. [2025-09-29T21:34:35.784098] [DEBUG] [LOCAL ] TSQ: Trimmed 16593 records to 12000 (keeping 200 days of data) [2025-09-29T21:34:35.854583] [DEBUG] [LOCAL ] TSQ: Primary data saved (12000 records). [2025-09-29T21:34:35.854741] [INFO ] [MAIN ] TSQ: Full history saved. [2025-09-29T21:34:35.854832] [INFO ] [MAIN ] Update Progress: 2139/2371 symbols completed. TSQ took 19.5s. Estimated remaining: 29m 47s. Rate: 7.8 symbols/min [2025-09-29T21:34:36.026353] [INFO ] [MAIN ] TT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:34:36.079855] [DEBUG] [LOCAL ] TT: Loaded 48538 existing records from primary storage. [2025-09-29T21:34:36.080199] [INFO ] [MAIN ] TT: Loaded 48538 existing records. [2025-09-29T21:34:36.288130] [WARN ] [MAIN ] TT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:34:36.288686] [INFO ] [MAIN ] TT: Wiping existing primary data before full refresh. [2025-09-29T21:34:36.288748] [INFO ] [LOCAL ] TT: Starting deletion of primary data. [2025-09-29T21:34:36.289490] [DEBUG] [LOCAL ] TT: Deleted primary data file. [2025-09-29T21:34:36.289552] [INFO ] [MAIN ] TT: Starting full primary refresh. [2025-09-29T21:34:36.356401] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-06. [2025-09-29T21:34:36.686268] [INFO ] [REMOTE ] TT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:34:36.753237] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-03 (2.81 seconds). [2025-09-29T21:34:37.121421] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-29T21:34:37.148068] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-09. [2025-09-29T21:34:37.948123] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-04. [2025-09-29T21:34:38.319782] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-29T21:34:38.383512] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-29T21:34:38.393485] [INFO ] [REMOTE ] TSLX: Full fetch complete (49121 records). [2025-09-29T21:34:38.393618] [DEBUG] [VALIDATOR ] TSLX: Validating primary data. [2025-09-29T21:34:38.750329] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-07. [2025-09-29T21:34:38.802707] [DEBUG] [VALIDATOR ] TSLX: All expected trading days are present. [2025-09-29T21:34:38.802813] [DEBUG] [VALIDATOR ] TSLX: Primary data validation passed. [2025-09-29T21:34:38.803946] [INFO ] [MAIN ] TSLX: Fetched primary data is valid. [2025-09-29T21:34:38.804016] [DEBUG] [LOCAL ] TSLX: Saving primary data. [2025-09-29T21:34:38.805381] [DEBUG] [LOCAL ] TSLX: Trimmed 49121 records to 35148 (keeping 200 days of data) [2025-09-29T21:34:39.037898] [DEBUG] [LOCAL ] TSLX: Primary data saved (35148 records). [2025-09-29T21:34:39.038193] [INFO ] [MAIN ] TSLX: Full history saved. [2025-09-29T21:34:39.038410] [INFO ] [MAIN ] Update Progress: 2140/2371 symbols completed. TSLX took 27.2s. Estimated remaining: 29m 38s. Rate: 7.8 symbols/min [2025-09-29T21:34:39.222534] [INFO ] [MAIN ] TTAM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:34:39.222730] [DEBUG] [LOCAL ] TTAM: No existing data file found in primary storage. [2025-09-29T21:34:39.222802] [WARN ] [MAIN ] TTAM: No existing data found, performing full refresh instead. [2025-09-29T21:34:39.222937] [INFO ] [MAIN ] TTAM: Wiping existing primary data before full refresh. [2025-09-29T21:34:39.222980] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-09-29T21:34:39.223022] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-09-29T21:34:39.223056] [INFO ] [MAIN ] TTAM: Starting full primary refresh. [2025-09-29T21:34:39.563014] [INFO ] [REMOTE ] TT: Fetching primary data for 2024-12. [2025-09-29T21:34:39.612935] [INFO ] [REMOTE ] TTAM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:34:40.348847] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2024-12. [2025-09-29T21:34:40.559008] [DEBUG] [REMOTE ] TTAM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T21:34:40.559359] [WARN ] [REMOTE ] TTAM: No data returned for month 2024-12 [2025-09-29T21:34:40.559469] [FATAL] [REMOTE ] TTAM: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T21:34:40.559526] [FATAL] [MAIN ] TTAM: Failed to fetch primary data. [2025-09-29T21:34:40.559590] [WARN ] [MAIN ] TTAM: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T21:34:40.559689] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-09-29T21:34:40.559766] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-09-29T21:34:40.559866] [INFO ] [LOCAL ] TTAM: Starting deletion of derivative data. [2025-09-29T21:34:40.559947] [DEBUG] [LOCAL ] TTAM: No derivative data file found to delete. [2025-09-29T21:34:40.560019] [INFO ] [MAIN ] Update Progress: 2141/2371 symbols completed. TTAM took 1.5s. Estimated remaining: 29m 30s. Rate: 7.8 symbols/min [2025-09-29T21:34:40.809922] [INFO ] [MAIN ] TTC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:34:40.831370] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-04 (2.88 seconds). [2025-09-29T21:34:40.880014] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-29T21:34:40.952737] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-29T21:34:40.951491] [DEBUG] [LOCAL ] TTC: Loaded 43005 existing records from primary storage. [2025-09-29T21:34:40.964493] [INFO ] [MAIN ] TTC: Loaded 43005 existing records. [2025-09-29T21:34:41.146168] [WARN ] [MAIN ] TTC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:34:41.146403] [INFO ] [MAIN ] TTC: Wiping existing primary data before full refresh. [2025-09-29T21:34:41.146450] [INFO ] [LOCAL ] TTC: Starting deletion of primary data. [2025-09-29T21:34:41.146895] [DEBUG] [LOCAL ] TTC: Deleted primary data file. [2025-09-29T21:34:41.146954] [INFO ] [MAIN ] TTC: Starting full primary refresh. [2025-09-29T21:34:41.157871] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-01. [2025-09-29T21:34:41.536976] [INFO ] [REMOTE ] TTC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:34:41.948115] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-05. [2025-09-29T21:34:42.748125] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-08. [2025-09-29T21:34:43.126536] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-29T21:34:43.238345] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-29T21:34:43.548117] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-09. [2025-09-29T21:34:44.348112] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-02. [2025-09-29T21:34:44.840527] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-05 (2.89 seconds). [2025-09-29T21:34:45.148098] [INFO ] [REMOTE ] TTC: Fetching primary data for 2024-12. [2025-09-29T21:34:45.357219] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-29T21:34:45.368968] [INFO ] [REMOTE ] TSN: Full fetch complete (76295 records). [2025-09-29T21:34:45.369153] [DEBUG] [VALIDATOR ] TSN: Validating primary data. [2025-09-29T21:34:45.809195] [DEBUG] [VALIDATOR ] TSN: All expected trading days are present. [2025-09-29T21:34:45.809616] [DEBUG] [VALIDATOR ] TSN: Primary data validation passed. [2025-09-29T21:34:45.811913] [INFO ] [MAIN ] TSN: Fetched primary data is valid. [2025-09-29T21:34:45.812186] [DEBUG] [LOCAL ] TSN: Saving primary data. [2025-09-29T21:34:45.814088] [DEBUG] [LOCAL ] TSN: Trimmed 76295 records to 52896 (keeping 200 days of data) [2025-09-29T21:34:45.936020] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-29T21:34:45.948217] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-03. [2025-09-29T21:34:46.192876] [DEBUG] [LOCAL ] TSN: Primary data saved (52896 records). [2025-09-29T21:34:46.193020] [INFO ] [MAIN ] TSN: Full history saved. [2025-09-29T21:34:46.193118] [INFO ] [MAIN ] Update Progress: 2142/2371 symbols completed. TSN took 32.2s. Estimated remaining: 29m 22s. Rate: 7.8 symbols/min [2025-09-29T21:34:46.378347] [INFO ] [MAIN ] TTE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:34:46.435109] [DEBUG] [LOCAL ] TTE: Loaded 52395 existing records from primary storage. [2025-09-29T21:34:46.435473] [INFO ] [MAIN ] TTE: Loaded 52395 existing records. [2025-09-29T21:34:46.638330] [WARN ] [MAIN ] TTE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:34:46.638783] [INFO ] [MAIN ] TTE: Wiping existing primary data before full refresh. [2025-09-29T21:34:46.638944] [INFO ] [LOCAL ] TTE: Starting deletion of primary data. [2025-09-29T21:34:46.639830] [DEBUG] [LOCAL ] TTE: Deleted primary data file. [2025-09-29T21:34:46.639910] [INFO ] [MAIN ] TTE: Starting full primary refresh. [2025-09-29T21:34:46.749369] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-06. [2025-09-29T21:34:46.968199] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-29T21:34:47.060220] [INFO ] [REMOTE ] TTE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:34:47.548140] [INFO ] [REMOTE ] TTE: Fetching primary data for 2024-12. [2025-09-29T21:34:47.847999] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-29T21:34:48.348168] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-04. [2025-09-29T21:34:49.148074] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-01. [2025-09-29T21:34:49.485027] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-29T21:34:49.539520] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-06 (2.79 seconds). [2025-09-29T21:34:49.948086] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-01. [2025-09-29T21:34:50.234445] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-29T21:34:50.345246] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-29T21:34:50.748110] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-02. [2025-09-29T21:34:51.548106] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-05. [2025-09-29T21:34:51.631123] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-29T21:34:52.324151] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-29T21:34:52.348067] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-03. [2025-09-29T21:34:53.045016] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-29T21:34:53.148096] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-07. [2025-09-29T21:34:53.623272] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-29T21:34:53.948100] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-02. [2025-09-29T21:34:54.748129] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-06. [2025-09-29T21:34:55.548135] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-04. [2025-09-29T21:34:55.605455] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-29T21:34:55.910626] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-07 (2.76 seconds). [2025-09-29T21:34:56.348106] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-08. [2025-09-29T21:34:56.428482] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-29T21:34:57.152112] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-03. [2025-09-29T21:34:57.159965] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-29T21:34:57.948195] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-07. [2025-09-29T21:34:58.748123] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-05. [2025-09-29T21:34:59.044549] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-08 (2.70 seconds). [2025-09-29T21:34:59.088671] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-29T21:34:59.428730] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-29T21:34:59.548129] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-09. [2025-09-29T21:35:00.171843] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-29T21:35:00.348161] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-04. [2025-09-29T21:35:01.148174] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-06. [2025-09-29T21:35:01.948129] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-08. [2025-09-29T21:35:02.296057] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-29T21:35:02.459136] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-09 (2.91 seconds). [2025-09-29T21:35:02.470950] [INFO ] [REMOTE ] TSM: Full fetch complete (77990 records). [2025-09-29T21:35:02.471190] [DEBUG] [VALIDATOR ] TSM: Validating primary data. [2025-09-29T21:35:02.750523] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-05. [2025-09-29T21:35:02.765896] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-29T21:35:02.946373] [DEBUG] [VALIDATOR ] TSM: All expected trading days are present. [2025-09-29T21:35:02.946468] [DEBUG] [VALIDATOR ] TSM: Primary data validation passed. [2025-09-29T21:35:02.947712] [INFO ] [MAIN ] TSM: Fetched primary data is valid. [2025-09-29T21:35:02.947792] [DEBUG] [LOCAL ] TSM: Saving primary data. [2025-09-29T21:35:02.949308] [DEBUG] [LOCAL ] TSM: Trimmed 77990 records to 53819 (keeping 200 days of data) [2025-09-29T21:35:03.322591] [DEBUG] [LOCAL ] TSM: Primary data saved (53819 records). [2025-09-29T21:35:03.322961] [INFO ] [MAIN ] TSM: Full history saved. [2025-09-29T21:35:03.323109] [INFO ] [MAIN ] Update Progress: 2143/2371 symbols completed. TSM took 49.8s. Estimated remaining: 29m 16s. Rate: 7.8 symbols/min [2025-09-29T21:35:03.512668] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-29T21:35:03.545475] [INFO ] [MAIN ] TTI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:35:03.548069] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-09. [2025-09-29T21:35:03.594702] [DEBUG] [LOCAL ] TTI: Loaded 46112 existing records from primary storage. [2025-09-29T21:35:03.595075] [INFO ] [MAIN ] TTI: Loaded 46112 existing records. [2025-09-29T21:35:03.780839] [WARN ] [MAIN ] TTI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:35:03.781050] [INFO ] [MAIN ] TTI: Wiping existing primary data before full refresh. [2025-09-29T21:35:03.781098] [INFO ] [LOCAL ] TTI: Starting deletion of primary data. [2025-09-29T21:35:03.781451] [DEBUG] [LOCAL ] TTI: Deleted primary data file. [2025-09-29T21:35:03.781509] [INFO ] [MAIN ] TTI: Starting full primary refresh. [2025-09-29T21:35:04.154526] [INFO ] [REMOTE ] TTI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:35:04.348137] [INFO ] [REMOTE ] TTI: Fetching primary data for 2024-12. [2025-09-29T21:35:04.696705] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-29T21:35:05.148091] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-06. [2025-09-29T21:35:05.332918] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-29T21:35:05.343267] [INFO ] [REMOTE ] TT: Full fetch complete (69839 records). [2025-09-29T21:35:05.343450] [DEBUG] [VALIDATOR ] TT: Validating primary data. [2025-09-29T21:35:05.761933] [DEBUG] [VALIDATOR ] TT: All expected trading days are present. [2025-09-29T21:35:05.762187] [DEBUG] [VALIDATOR ] TT: Primary data validation passed. [2025-09-29T21:35:05.763412] [INFO ] [MAIN ] TT: Fetched primary data is valid. [2025-09-29T21:35:05.763661] [DEBUG] [LOCAL ] TT: Saving primary data. [2025-09-29T21:35:05.765175] [DEBUG] [LOCAL ] TT: Trimmed 69839 records to 47762 (keeping 200 days of data) [2025-09-29T21:35:05.901576] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-29T21:35:05.996321] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-07. [2025-09-29T21:35:06.120994] [DEBUG] [LOCAL ] TT: Primary data saved (47762 records). [2025-09-29T21:35:06.121142] [INFO ] [MAIN ] TT: Full history saved. [2025-09-29T21:35:06.121246] [INFO ] [MAIN ] Update Progress: 2144/2371 symbols completed. TT took 30.3s. Estimated remaining: 29m 7s. Rate: 7.8 symbols/min [2025-09-29T21:35:06.295882] [INFO ] [MAIN ] TU: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:35:06.357270] [DEBUG] [LOCAL ] TU: Loaded 50606 existing records from primary storage. [2025-09-29T21:35:06.357607] [INFO ] [MAIN ] TU: Loaded 50606 existing records. [2025-09-29T21:35:06.549953] [WARN ] [MAIN ] TU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:35:06.550387] [INFO ] [MAIN ] TU: Wiping existing primary data before full refresh. [2025-09-29T21:35:06.550458] [INFO ] [LOCAL ] TU: Starting deletion of primary data. [2025-09-29T21:35:06.551160] [DEBUG] [LOCAL ] TU: Deleted primary data file. [2025-09-29T21:35:06.551226] [INFO ] [MAIN ] TU: Starting full primary refresh. [2025-09-29T21:35:06.767959] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-01. [2025-09-29T21:35:06.962511] [INFO ] [REMOTE ] TU: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:35:06.995506] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-29T21:35:07.240414] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-29T21:35:07.548157] [INFO ] [REMOTE ] TU: Fetching primary data for 2024-12. [2025-09-29T21:35:08.348103] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-08. [2025-09-29T21:35:08.515280] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-29T21:35:09.148169] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-07. [2025-09-29T21:35:09.414158] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-29T21:35:09.833354] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-29T21:35:09.948161] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-01. [2025-09-29T21:35:10.748076] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-02. [2025-09-29T21:35:10.956577] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-29T21:35:11.548111] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-09. [2025-09-29T21:35:11.712361] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-29T21:35:12.349976] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-08. [2025-09-29T21:35:12.352992] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-29T21:35:12.653514] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-29T21:35:12.662729] [INFO ] [REMOTE ] TTC: Full fetch complete (62183 records). [2025-09-29T21:35:12.662869] [DEBUG] [VALIDATOR ] TTC: Validating primary data. [2025-09-29T21:35:13.093638] [DEBUG] [VALIDATOR ] TTC: All expected trading days are present. [2025-09-29T21:35:13.093758] [DEBUG] [VALIDATOR ] TTC: Primary data validation passed. [2025-09-29T21:35:13.094829] [INFO ] [MAIN ] TTC: Fetched primary data is valid. [2025-09-29T21:35:13.094896] [DEBUG] [LOCAL ] TTC: Saving primary data. [2025-09-29T21:35:13.096222] [DEBUG] [LOCAL ] TTC: Trimmed 62183 records to 42206 (keeping 200 days of data) [2025-09-29T21:35:13.154278] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-03. [2025-09-29T21:35:13.377829] [DEBUG] [LOCAL ] TTC: Primary data saved (42206 records). [2025-09-29T21:35:13.377980] [INFO ] [MAIN ] TTC: Full history saved. [2025-09-29T21:35:13.378118] [INFO ] [MAIN ] Update Progress: 2145/2371 symbols completed. TTC took 32.8s. Estimated remaining: 28m 60s. Rate: 7.8 symbols/min [2025-09-29T21:35:13.551770] [INFO ] [MAIN ] TUYA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:35:13.596744] [DEBUG] [LOCAL ] TUYA: Loaded 47185 existing records from primary storage. [2025-09-29T21:35:13.597102] [INFO ] [MAIN ] TUYA: Loaded 47185 existing records. [2025-09-29T21:35:13.787270] [WARN ] [MAIN ] TUYA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:35:13.787617] [INFO ] [MAIN ] TUYA: Wiping existing primary data before full refresh. [2025-09-29T21:35:13.787717] [INFO ] [LOCAL ] TUYA: Starting deletion of primary data. [2025-09-29T21:35:13.789199] [DEBUG] [LOCAL ] TUYA: Deleted primary data file. [2025-09-29T21:35:13.789264] [INFO ] [MAIN ] TUYA: Starting full primary refresh. [2025-09-29T21:35:13.954324] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-02. [2025-09-29T21:35:14.142634] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-29T21:35:14.238825] [INFO ] [REMOTE ] TUYA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:35:14.748138] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2024-12. [2025-09-29T21:35:14.797862] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-29T21:35:15.548131] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-04. [2025-09-29T21:35:15.649424] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-29T21:35:16.254739] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-29T21:35:16.348153] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-03. [2025-09-29T21:35:16.817828] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-29T21:35:17.148157] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-05. [2025-09-29T21:35:17.948100] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-09. [2025-09-29T21:35:18.116941] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-29T21:35:18.753224] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-04. [2025-09-29T21:35:18.767492] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-29T21:35:19.548128] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-01. [2025-09-29T21:35:19.866683] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-29T21:35:19.877426] [INFO ] [REMOTE ] TTE: Full fetch complete (75048 records). [2025-09-29T21:35:19.877589] [DEBUG] [VALIDATOR ] TTE: Validating primary data. [2025-09-29T21:35:20.332236] [DEBUG] [VALIDATOR ] TTE: All expected trading days are present. [2025-09-29T21:35:20.332465] [DEBUG] [VALIDATOR ] TTE: Primary data validation passed. [2025-09-29T21:35:20.333667] [INFO ] [MAIN ] TTE: Fetched primary data is valid. [2025-09-29T21:35:20.333732] [DEBUG] [LOCAL ] TTE: Saving primary data. [2025-09-29T21:35:20.335401] [DEBUG] [LOCAL ] TTE: Trimmed 75048 records to 51619 (keeping 200 days of data) [2025-09-29T21:35:20.389395] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-06. [2025-09-29T21:35:20.586131] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-29T21:35:20.711392] [DEBUG] [LOCAL ] TTE: Primary data saved (51619 records). [2025-09-29T21:35:20.711552] [INFO ] [MAIN ] TTE: Full history saved. [2025-09-29T21:35:20.711669] [INFO ] [MAIN ] Update Progress: 2146/2371 symbols completed. TTE took 34.5s. Estimated remaining: 28m 52s. Rate: 7.8 symbols/min [2025-09-29T21:35:20.897345] [INFO ] [MAIN ] TV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:35:20.942486] [DEBUG] [LOCAL ] TV: Loaded 43514 existing records from primary storage. [2025-09-29T21:35:20.942815] [INFO ] [MAIN ] TV: Loaded 43514 existing records. [2025-09-29T21:35:21.152840] [WARN ] [MAIN ] TV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:35:21.158017] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-05. [2025-09-29T21:35:21.158263] [INFO ] [MAIN ] TV: Wiping existing primary data before full refresh. [2025-09-29T21:35:21.162705] [INFO ] [LOCAL ] TV: Starting deletion of primary data. [2025-09-29T21:35:21.164147] [DEBUG] [LOCAL ] TV: Deleted primary data file. [2025-09-29T21:35:21.164050] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-29T21:35:21.164254] [INFO ] [MAIN ] TV: Starting full primary refresh. [2025-09-29T21:35:21.574437] [INFO ] [REMOTE ] TV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:35:21.948116] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-02. [2025-09-29T21:35:21.990788] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-29T21:35:22.461779] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-29T21:35:22.748144] [INFO ] [REMOTE ] TV: Fetching primary data for 2024-12. [2025-09-29T21:35:23.548127] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-07. [2025-09-29T21:35:23.902550] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-29T21:35:24.071206] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-29T21:35:24.348121] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-03. [2025-09-29T21:35:25.148101] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-06. [2025-09-29T21:35:25.226789] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-29T21:35:25.948129] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-08. [2025-09-29T21:35:26.152071] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-29T21:35:26.698393] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-29T21:35:26.748106] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-07. [2025-09-29T21:35:27.548087] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-01. [2025-09-29T21:35:27.622319] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-29T21:35:28.348099] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-04. [2025-09-29T21:35:28.519782] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-29T21:35:29.119876] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-29T21:35:29.148101] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-02. [2025-09-29T21:35:29.775842] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-29T21:35:29.948127] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-09. [2025-09-29T21:35:30.708097] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-29T21:35:30.748089] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-03. [2025-09-29T21:35:31.538709] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-29T21:35:31.548207] [INFO ] [REMOTE ] TTI: Full fetch complete (65075 records). [2025-09-29T21:35:31.548089] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-08. [2025-09-29T21:35:31.548370] [DEBUG] [VALIDATOR ] TTI: Validating primary data. [2025-09-29T21:35:32.004557] [DEBUG] [VALIDATOR ] TTI: All expected trading days are present. [2025-09-29T21:35:32.004757] [DEBUG] [VALIDATOR ] TTI: Primary data validation passed. [2025-09-29T21:35:32.006313] [INFO ] [MAIN ] TTI: Fetched primary data is valid. [2025-09-29T21:35:32.006451] [DEBUG] [LOCAL ] TTI: Saving primary data. [2025-09-29T21:35:32.024747] [DEBUG] [LOCAL ] TTI: Trimmed 65075 records to 45490 (keeping 200 days of data) [2025-09-29T21:35:32.042962] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-29T21:35:32.348236] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-04. [2025-09-29T21:35:32.404742] [DEBUG] [LOCAL ] TTI: Primary data saved (45490 records). [2025-09-29T21:35:32.404957] [INFO ] [MAIN ] TTI: Full history saved. [2025-09-29T21:35:32.405093] [INFO ] [MAIN ] Update Progress: 2147/2371 symbols completed. TTI took 29.1s. Estimated remaining: 28m 45s. Rate: 7.8 symbols/min [2025-09-29T21:35:32.711076] [INFO ] [MAIN ] TVC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:35:32.719862] [DEBUG] [LOCAL ] TVC: Loaded 3466 existing records from primary storage. [2025-09-29T21:35:32.720179] [INFO ] [MAIN ] TVC: Loaded 3466 existing records. [2025-09-29T21:35:33.019956] [WARN ] [MAIN ] TVC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:35:33.020270] [INFO ] [MAIN ] TVC: Wiping existing primary data before full refresh. [2025-09-29T21:35:33.020345] [INFO ] [LOCAL ] TVC: Starting deletion of primary data. [2025-09-29T21:35:33.020745] [DEBUG] [LOCAL ] TVC: Deleted primary data file. [2025-09-29T21:35:33.020809] [INFO ] [MAIN ] TVC: Starting full primary refresh. [2025-09-29T21:35:33.156280] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-05. [2025-09-29T21:35:33.472931] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-29T21:35:33.506275] [INFO ] [REMOTE ] TVC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:35:33.948089] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-09. [2025-09-29T21:35:34.049143] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-29T21:35:34.748092] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-05. [2025-09-29T21:35:34.915783] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-29T21:35:35.507724] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-29T21:35:35.518834] [INFO ] [REMOTE ] TU: Full fetch complete (72886 records). [2025-09-29T21:35:35.518975] [DEBUG] [VALIDATOR ] TU: Validating primary data. [2025-09-29T21:35:35.554907] [INFO ] [REMOTE ] TVC: Fetching primary data for 2024-12. [2025-09-29T21:35:35.961877] [DEBUG] [VALIDATOR ] TU: All expected trading days are present. [2025-09-29T21:35:35.961978] [DEBUG] [VALIDATOR ] TU: Primary data validation passed. [2025-09-29T21:35:35.963253] [INFO ] [MAIN ] TU: Fetched primary data is valid. [2025-09-29T21:35:35.963321] [DEBUG] [LOCAL ] TU: Saving primary data. [2025-09-29T21:35:35.965057] [DEBUG] [LOCAL ] TU: Trimmed 72886 records to 49845 (keeping 200 days of data) [2025-09-29T21:35:36.299924] [DEBUG] [LOCAL ] TU: Primary data saved (49845 records). [2025-09-29T21:35:36.300104] [INFO ] [MAIN ] TU: Full history saved. [2025-09-29T21:35:36.300220] [INFO ] [MAIN ] Update Progress: 2148/2371 symbols completed. TU took 30.2s. Estimated remaining: 28m 36s. Rate: 7.8 symbols/min [2025-09-29T21:35:36.359477] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-06. [2025-09-29T21:35:36.500045] [INFO ] [MAIN ] TVE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:35:36.500551] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-29T21:35:36.538483] [DEBUG] [LOCAL ] TVE: Loaded 2795 existing records from primary storage. [2025-09-29T21:35:36.540399] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-29T21:35:36.551208] [INFO ] [MAIN ] TVE: Loaded 2795 existing records. [2025-09-29T21:35:36.743273] [WARN ] [MAIN ] TVE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:35:36.743474] [INFO ] [MAIN ] TVE: Wiping existing primary data before full refresh. [2025-09-29T21:35:36.743520] [INFO ] [LOCAL ] TVE: Starting deletion of primary data. [2025-09-29T21:35:36.743723] [DEBUG] [LOCAL ] TVE: Deleted primary data file. [2025-09-29T21:35:36.743782] [INFO ] [MAIN ] TVE: Starting full primary refresh. [2025-09-29T21:35:37.129431] [INFO ] [REMOTE ] TVE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:35:37.148085] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-01. [2025-09-29T21:35:37.761511] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-29T21:35:37.948104] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-06. [2025-09-29T21:35:38.080178] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-29T21:35:38.748107] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-07. [2025-09-29T21:35:39.487621] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-29T21:35:39.548103] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-07. [2025-09-29T21:35:40.348132] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-02. [2025-09-29T21:35:40.415750] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-29T21:35:40.929461] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-29T21:35:41.148160] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-03. [2025-09-29T21:35:41.211723] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-29T21:35:41.525301] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-29T21:35:41.948151] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-04. [2025-09-29T21:35:42.586834] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-29T21:35:42.748126] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-08. [2025-09-29T21:35:43.548162] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-08. [2025-09-29T21:35:44.299381] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-29T21:35:44.348113] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-05. [2025-09-29T21:35:45.107984] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-29T21:35:45.140258] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-29T21:35:45.148861] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-06. [2025-09-29T21:35:45.784758] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-29T21:35:45.948127] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-09. [2025-09-29T21:35:46.748108] [INFO ] [REMOTE ] TVE: Fetching primary data for 2024-12. [2025-09-29T21:35:47.320265] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-29T21:35:47.510192] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-29T21:35:47.519677] [INFO ] [REMOTE ] TUYA: Full fetch complete (65758 records). [2025-09-29T21:35:47.519803] [DEBUG] [VALIDATOR ] TUYA: Validating primary data. [2025-09-29T21:35:47.553287] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-07. [2025-09-29T21:35:47.932901] [DEBUG] [VALIDATOR ] TUYA: All expected trading days are present. [2025-09-29T21:35:47.933050] [DEBUG] [VALIDATOR ] TUYA: Primary data validation passed. [2025-09-29T21:35:47.934362] [INFO ] [MAIN ] TUYA: Fetched primary data is valid. [2025-09-29T21:35:47.934438] [DEBUG] [LOCAL ] TUYA: Saving primary data. [2025-09-29T21:35:47.935926] [DEBUG] [LOCAL ] TUYA: Trimmed 65758 records to 46346 (keeping 200 days of data) [2025-09-29T21:35:48.023782] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-29T21:35:48.220970] [DEBUG] [LOCAL ] TUYA: Primary data saved (46346 records). [2025-09-29T21:35:48.221117] [INFO ] [MAIN ] TUYA: Full history saved. [2025-09-29T21:35:48.221220] [INFO ] [MAIN ] Update Progress: 2149/2371 symbols completed. TUYA took 34.8s. Estimated remaining: 28m 29s. Rate: 7.8 symbols/min [2025-09-29T21:35:48.353318] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-09. [2025-09-29T21:35:48.410206] [INFO ] [MAIN ] TWI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:35:48.457102] [DEBUG] [LOCAL ] TWI: Loaded 34981 existing records from primary storage. [2025-09-29T21:35:48.457428] [INFO ] [MAIN ] TWI: Loaded 34981 existing records. [2025-09-29T21:35:48.701296] [WARN ] [MAIN ] TWI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:35:48.701552] [INFO ] [MAIN ] TWI: Wiping existing primary data before full refresh. [2025-09-29T21:35:48.701636] [INFO ] [LOCAL ] TWI: Starting deletion of primary data. [2025-09-29T21:35:48.702136] [DEBUG] [LOCAL ] TWI: Deleted primary data file. [2025-09-29T21:35:48.702215] [INFO ] [MAIN ] TWI: Starting full primary refresh. [2025-09-29T21:35:49.155071] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-01. [2025-09-29T21:35:49.162064] [INFO ] [REMOTE ] TWI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:35:49.813039] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-29T21:35:49.816886] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-29T21:35:49.825695] [INFO ] [REMOTE ] TV: Full fetch complete (62091 records). [2025-09-29T21:35:49.825851] [DEBUG] [VALIDATOR ] TV: Validating primary data. [2025-09-29T21:35:49.953219] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-08. [2025-09-29T21:35:50.238339] [DEBUG] [VALIDATOR ] TV: All expected trading days are present. [2025-09-29T21:35:50.238428] [DEBUG] [VALIDATOR ] TV: Primary data validation passed. [2025-09-29T21:35:50.239480] [INFO ] [MAIN ] TV: Fetched primary data is valid. [2025-09-29T21:35:50.239556] [DEBUG] [LOCAL ] TV: Saving primary data. [2025-09-29T21:35:50.240894] [DEBUG] [LOCAL ] TV: Trimmed 62091 records to 42765 (keeping 200 days of data) [2025-09-29T21:35:50.504434] [DEBUG] [LOCAL ] TV: Primary data saved (42765 records). [2025-09-29T21:35:50.504622] [INFO ] [MAIN ] TV: Full history saved. [2025-09-29T21:35:50.504763] [INFO ] [MAIN ] Update Progress: 2150/2371 symbols completed. TV took 29.8s. Estimated remaining: 28m 21s. Rate: 7.8 symbols/min [2025-09-29T21:35:50.601242] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-29T21:35:50.709116] [INFO ] [MAIN ] TWLO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:35:50.748123] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-09. [2025-09-29T21:35:50.772678] [DEBUG] [LOCAL ] TWLO: Loaded 53501 existing records from primary storage. [2025-09-29T21:35:50.773033] [INFO ] [MAIN ] TWLO: Loaded 53501 existing records. [2025-09-29T21:35:50.958075] [WARN ] [MAIN ] TWLO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:35:50.958347] [INFO ] [MAIN ] TWLO: Wiping existing primary data before full refresh. [2025-09-29T21:35:50.958419] [INFO ] [LOCAL ] TWLO: Starting deletion of primary data. [2025-09-29T21:35:50.958832] [DEBUG] [LOCAL ] TWLO: Deleted primary data file. [2025-09-29T21:35:50.958896] [INFO ] [MAIN ] TWLO: Starting full primary refresh. [2025-09-29T21:35:51.257750] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-29T21:35:51.280139] [INFO ] [REMOTE ] TVC: Full fetch complete (5624 records). [2025-09-29T21:35:51.304718] [DEBUG] [VALIDATOR ] TVC: Validating primary data. [2025-09-29T21:35:51.409579] [INFO ] [REMOTE ] TWLO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:35:51.553327] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2024-12. [2025-09-29T21:35:51.755050] [DEBUG] [VALIDATOR ] TVC: All expected trading days are present. [2025-09-29T21:35:51.755135] [DEBUG] [VALIDATOR ] TVC: Primary data validation passed. [2025-09-29T21:35:51.755323] [INFO ] [MAIN ] TVC: Fetched primary data is valid. [2025-09-29T21:35:51.755363] [DEBUG] [LOCAL ] TVC: Saving primary data. [2025-09-29T21:35:51.755824] [DEBUG] [LOCAL ] TVC: Trimmed 5624 records to 3412 (keeping 200 days of data) [2025-09-29T21:35:51.777060] [DEBUG] [LOCAL ] TVC: Primary data saved (3412 records). [2025-09-29T21:35:51.777188] [INFO ] [MAIN ] TVC: Full history saved. [2025-09-29T21:35:51.777295] [INFO ] [MAIN ] Update Progress: 2151/2371 symbols completed. TVC took 19.4s. Estimated remaining: 28m 13s. Rate: 7.8 symbols/min [2025-09-29T21:35:51.950538] [INFO ] [MAIN ] TWN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:35:51.956096] [DEBUG] [LOCAL ] TWN: Loaded 3250 existing records from primary storage. [2025-09-29T21:35:51.956284] [INFO ] [MAIN ] TWN: Loaded 3250 existing records. [2025-09-29T21:35:52.140283] [WARN ] [MAIN ] TWN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:35:52.140572] [INFO ] [MAIN ] TWN: Wiping existing primary data before full refresh. [2025-09-29T21:35:52.140624] [INFO ] [LOCAL ] TWN: Starting deletion of primary data. [2025-09-29T21:35:52.140870] [DEBUG] [LOCAL ] TWN: Deleted primary data file. [2025-09-29T21:35:52.140930] [INFO ] [MAIN ] TWN: Starting full primary refresh. [2025-09-29T21:35:52.358510] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-02. [2025-09-29T21:35:52.533829] [INFO ] [REMOTE ] TWN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:35:53.027569] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-29T21:35:53.148152] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-03. [2025-09-29T21:35:53.716217] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-29T21:35:53.858471] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-29T21:35:53.948170] [INFO ] [REMOTE ] TWI: Fetching primary data for 2024-12. [2025-09-29T21:35:54.748108] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-01. [2025-09-29T21:35:55.480026] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-29T21:35:55.548144] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-01. [2025-09-29T21:35:56.348118] [INFO ] [REMOTE ] TWN: Fetching primary data for 2024-12. [2025-09-29T21:35:56.878669] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-29T21:35:57.076452] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-29T21:35:57.148119] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-04. [2025-09-29T21:35:57.243032] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-29T21:35:57.785238] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-29T21:35:57.948163] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-05. [2025-09-29T21:35:58.489733] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-29T21:35:58.748093] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-06. [2025-09-29T21:35:59.319588] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-29T21:35:59.548114] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-01. [2025-09-29T21:36:00.143298] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-29T21:36:00.348127] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-02. [2025-09-29T21:36:01.148188] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-07. [2025-09-29T21:36:01.663493] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-29T21:36:01.948154] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-08. [2025-09-29T21:36:02.487622] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-29T21:36:02.497102] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-29T21:36:02.748109] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-09. [2025-09-29T21:36:03.242931] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-29T21:36:03.244259] [INFO ] [REMOTE ] TVE: Full fetch complete (4350 records). [2025-09-29T21:36:03.244353] [DEBUG] [VALIDATOR ] TVE: Validating primary data. [2025-09-29T21:36:03.550370] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-02. [2025-09-29T21:36:03.639522] [DEBUG] [VALIDATOR ] TVE: All expected trading days are present. [2025-09-29T21:36:03.639611] [DEBUG] [VALIDATOR ] TVE: Primary data validation passed. [2025-09-29T21:36:03.639795] [INFO ] [MAIN ] TVE: Fetched primary data is valid. [2025-09-29T21:36:03.639854] [DEBUG] [LOCAL ] TVE: Saving primary data. [2025-09-29T21:36:03.640355] [DEBUG] [LOCAL ] TVE: Trimmed 4350 records to 2753 (keeping 200 days of data) [2025-09-29T21:36:03.658085] [DEBUG] [LOCAL ] TVE: Primary data saved (2753 records). [2025-09-29T21:36:03.658196] [INFO ] [MAIN ] TVE: Full history saved. [2025-09-29T21:36:03.658311] [INFO ] [MAIN ] Update Progress: 2152/2371 symbols completed. TVE took 27.4s. Estimated remaining: 28m 5s. Rate: 7.8 symbols/min [2025-09-29T21:36:03.835522] [INFO ] [MAIN ] TWO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:36:03.892638] [DEBUG] [LOCAL ] TWO: Loaded 49002 existing records from primary storage. [2025-09-29T21:36:03.893004] [INFO ] [MAIN ] TWO: Loaded 49002 existing records. [2025-09-29T21:36:04.082334] [WARN ] [MAIN ] TWO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:36:04.082676] [INFO ] [MAIN ] TWO: Wiping existing primary data before full refresh. [2025-09-29T21:36:04.082762] [INFO ] [LOCAL ] TWO: Starting deletion of primary data. [2025-09-29T21:36:04.083365] [DEBUG] [LOCAL ] TWO: Deleted primary data file. [2025-09-29T21:36:04.083431] [INFO ] [MAIN ] TWO: Starting full primary refresh. [2025-09-29T21:36:04.355263] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-02. [2025-09-29T21:36:04.466748] [INFO ] [REMOTE ] TWO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:36:05.041025] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-29T21:36:05.043788] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-29T21:36:05.148135] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-03. [2025-09-29T21:36:05.948145] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-03. [2025-09-29T21:36:06.692510] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-29T21:36:06.748159] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-04. [2025-09-29T21:36:07.548112] [INFO ] [REMOTE ] TWO: Fetching primary data for 2024-12. [2025-09-29T21:36:07.888501] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-29T21:36:07.944134] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-29T21:36:08.348130] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-05. [2025-09-29T21:36:09.148128] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-03. [2025-09-29T21:36:09.231160] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-29T21:36:09.737722] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-29T21:36:09.793546] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-29T21:36:09.948163] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-01. [2025-09-29T21:36:10.748108] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-04. [2025-09-29T21:36:11.557394] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-06. [2025-09-29T21:36:11.564097] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-29T21:36:12.348095] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-04. [2025-09-29T21:36:12.698072] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-29T21:36:12.948616] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-29T21:36:13.001279] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-29T21:36:13.148132] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-05. [2025-09-29T21:36:13.543616] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-29T21:36:13.948160] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-06. [2025-09-29T21:36:14.570764] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-29T21:36:14.748102] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-05. [2025-09-29T21:36:15.548124] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-07. [2025-09-29T21:36:16.047956] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-29T21:36:16.348103] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-02. [2025-09-29T21:36:16.838187] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-29T21:36:17.148143] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-06. [2025-09-29T21:36:17.603444] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-29T21:36:17.948136] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-08. [2025-09-29T21:36:18.418115] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-29T21:36:18.748160] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-09. [2025-09-29T21:36:18.898136] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-29T21:36:19.359068] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-29T21:36:19.360408] [INFO ] [REMOTE ] TWN: Full fetch complete (5360 records). [2025-09-29T21:36:19.360484] [DEBUG] [VALIDATOR ] TWN: Validating primary data. [2025-09-29T21:36:19.550217] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-07. [2025-09-29T21:36:19.750030] [DEBUG] [VALIDATOR ] TWN: All expected trading days are present. [2025-09-29T21:36:19.750110] [DEBUG] [VALIDATOR ] TWN: Primary data validation passed. [2025-09-29T21:36:19.750353] [INFO ] [MAIN ] TWN: Fetched primary data is valid. [2025-09-29T21:36:19.750417] [DEBUG] [LOCAL ] TWN: Saving primary data. [2025-09-29T21:36:19.750865] [DEBUG] [LOCAL ] TWN: Trimmed 5360 records to 3153 (keeping 200 days of data) [2025-09-29T21:36:19.770457] [DEBUG] [LOCAL ] TWN: Primary data saved (3153 records). [2025-09-29T21:36:19.770570] [INFO ] [MAIN ] TWN: Full history saved. [2025-09-29T21:36:19.770697] [INFO ] [MAIN ] Update Progress: 2153/2371 symbols completed. TWN took 28.0s. Estimated remaining: 27m 58s. Rate: 7.8 symbols/min [2025-09-29T21:36:19.950974] [INFO ] [MAIN ] TWOD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:36:19.951145] [DEBUG] [LOCAL ] TWOD: No existing data file found in primary storage. [2025-09-29T21:36:19.951186] [WARN ] [MAIN ] TWOD: No existing data found, performing full refresh instead. [2025-09-29T21:36:19.951300] [INFO ] [MAIN ] TWOD: Wiping existing primary data before full refresh. [2025-09-29T21:36:19.951342] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-09-29T21:36:19.951386] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-09-29T21:36:19.951419] [INFO ] [MAIN ] TWOD: Starting full primary refresh. [2025-09-29T21:36:20.354284] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-07. [2025-09-29T21:36:20.360363] [INFO ] [REMOTE ] TWOD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:36:21.108683] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-29T21:36:21.148096] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-08. [2025-09-29T21:36:21.948109] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-03. [2025-09-29T21:36:22.419439] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-29T21:36:22.461020] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-29T21:36:22.748104] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-08. [2025-09-29T21:36:23.548186] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-09. [2025-09-29T21:36:23.611174] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-29T21:36:24.348088] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2024-12. [2025-09-29T21:36:24.481961] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-29T21:36:24.561058] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T21:36:24.561391] [WARN ] [REMOTE ] TWOD: No data returned for month 2024-12 [2025-09-29T21:36:24.561488] [FATAL] [REMOTE ] TWOD: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T21:36:24.561558] [FATAL] [MAIN ] TWOD: Failed to fetch primary data. [2025-09-29T21:36:24.561629] [WARN ] [MAIN ] TWOD: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T21:36:24.561721] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-09-29T21:36:24.561792] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-09-29T21:36:24.561832] [INFO ] [LOCAL ] TWOD: Starting deletion of derivative data. [2025-09-29T21:36:24.561907] [DEBUG] [LOCAL ] TWOD: No derivative data file found to delete. [2025-09-29T21:36:24.562003] [INFO ] [MAIN ] Update Progress: 2154/2371 symbols completed. TWOD took 4.8s. Estimated remaining: 27m 50s. Rate: 7.8 symbols/min [2025-09-29T21:36:24.751663] [INFO ] [MAIN ] TX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:36:24.786724] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-29T21:36:24.801410] [INFO ] [REMOTE ] TWI: Full fetch complete (53013 records). [2025-09-29T21:36:24.801721] [DEBUG] [VALIDATOR ] TWI: Validating primary data. [2025-09-29T21:36:24.802302] [DEBUG] [LOCAL ] TX: Loaded 23932 existing records from primary storage. [2025-09-29T21:36:24.802708] [INFO ] [MAIN ] TX: Loaded 23932 existing records. [2025-09-29T21:36:25.154502] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-09. [2025-09-29T21:36:25.233676] [WARN ] [MAIN ] TX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:36:25.261131] [INFO ] [MAIN ] TX: Wiping existing primary data before full refresh. [2025-09-29T21:36:25.312464] [INFO ] [LOCAL ] TX: Starting deletion of primary data. [2025-09-29T21:36:25.349073] [DEBUG] [LOCAL ] TX: Deleted primary data file. [2025-09-29T21:36:25.354609] [INFO ] [MAIN ] TX: Starting full primary refresh. [2025-09-29T21:36:25.580196] [DEBUG] [VALIDATOR ] TWI: All expected trading days are present. [2025-09-29T21:36:25.585469] [DEBUG] [VALIDATOR ] TWI: Primary data validation passed. [2025-09-29T21:36:25.591755] [INFO ] [MAIN ] TWI: Fetched primary data is valid. [2025-09-29T21:36:25.591854] [DEBUG] [LOCAL ] TWI: Saving primary data. [2025-09-29T21:36:25.650037] [DEBUG] [LOCAL ] TWI: Trimmed 53013 records to 34294 (keeping 200 days of data) [2025-09-29T21:36:25.949102] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-04. [2025-09-29T21:36:26.057922] [INFO ] [REMOTE ] TX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:36:26.170353] [DEBUG] [LOCAL ] TWI: Primary data saved (34294 records). [2025-09-29T21:36:26.170524] [INFO ] [MAIN ] TWI: Full history saved. [2025-09-29T21:36:26.170680] [INFO ] [MAIN ] Update Progress: 2155/2371 symbols completed. TWI took 37.9s. Estimated remaining: 27m 42s. Rate: 7.8 symbols/min [2025-09-29T21:36:26.370629] [INFO ] [MAIN ] TXNM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:36:26.422228] [DEBUG] [LOCAL ] TXNM: Loaded 44463 existing records from primary storage. [2025-09-29T21:36:26.422576] [INFO ] [MAIN ] TXNM: Loaded 44463 existing records. [2025-09-29T21:36:26.614786] [WARN ] [MAIN ] TXNM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:36:26.615032] [INFO ] [MAIN ] TXNM: Wiping existing primary data before full refresh. [2025-09-29T21:36:26.615081] [INFO ] [LOCAL ] TXNM: Starting deletion of primary data. [2025-09-29T21:36:26.615473] [DEBUG] [LOCAL ] TXNM: Deleted primary data file. [2025-09-29T21:36:26.615532] [INFO ] [MAIN ] TXNM: Starting full primary refresh. [2025-09-29T21:36:26.762621] [INFO ] [REMOTE ] TX: Fetching primary data for 2024-12. [2025-09-29T21:36:26.988828] [INFO ] [REMOTE ] TXNM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:36:27.156006] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-29T21:36:27.168055] [INFO ] [REMOTE ] TWLO: Full fetch complete (76444 records). [2025-09-29T21:36:27.168218] [DEBUG] [VALIDATOR ] TWLO: Validating primary data. [2025-09-29T21:36:27.554513] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2024-12. [2025-09-29T21:36:27.607344] [DEBUG] [VALIDATOR ] TWLO: All expected trading days are present. [2025-09-29T21:36:27.607452] [DEBUG] [VALIDATOR ] TWLO: Primary data validation passed. [2025-09-29T21:36:27.608977] [INFO ] [MAIN ] TWLO: Fetched primary data is valid. [2025-09-29T21:36:27.609295] [DEBUG] [LOCAL ] TWLO: Saving primary data. [2025-09-29T21:36:27.612826] [DEBUG] [LOCAL ] TWLO: Trimmed 76444 records to 52709 (keeping 200 days of data) [2025-09-29T21:36:27.874950] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-29T21:36:28.012802] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-29T21:36:28.020333] [DEBUG] [LOCAL ] TWLO: Primary data saved (52709 records). [2025-09-29T21:36:28.021105] [INFO ] [MAIN ] TWLO: Full history saved. [2025-09-29T21:36:28.021238] [INFO ] [MAIN ] Update Progress: 2156/2371 symbols completed. TWLO took 37.5s. Estimated remaining: 27m 34s. Rate: 7.8 symbols/min [2025-09-29T21:36:28.201100] [INFO ] [MAIN ] TXO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:36:28.224940] [DEBUG] [LOCAL ] TXO: Loaded 19060 existing records from primary storage. [2025-09-29T21:36:28.225189] [INFO ] [MAIN ] TXO: Loaded 19060 existing records. [2025-09-29T21:36:28.353181] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-01. [2025-09-29T21:36:28.416778] [WARN ] [MAIN ] TXO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:36:28.417053] [INFO ] [MAIN ] TXO: Wiping existing primary data before full refresh. [2025-09-29T21:36:28.417115] [INFO ] [LOCAL ] TXO: Starting deletion of primary data. [2025-09-29T21:36:28.417397] [DEBUG] [LOCAL ] TXO: Deleted primary data file. [2025-09-29T21:36:28.417456] [INFO ] [MAIN ] TXO: Starting full primary refresh. [2025-09-29T21:36:28.784154] [INFO ] [REMOTE ] TXO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:36:29.148088] [INFO ] [REMOTE ] TXO: Fetching primary data for 2024-12. [2025-09-29T21:36:29.194718] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-29T21:36:29.605626] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-29T21:36:29.948131] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-01. [2025-09-29T21:36:29.973991] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-29T21:36:30.748106] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-05. [2025-09-29T21:36:31.533325] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-29T21:36:31.548121] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-02. [2025-09-29T21:36:32.101984] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-29T21:36:32.348115] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-06. [2025-09-29T21:36:32.822390] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-29T21:36:33.148106] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-01. [2025-09-29T21:36:33.948126] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-02. [2025-09-29T21:36:33.961874] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-29T21:36:34.038470] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-29T21:36:34.748117] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-03. [2025-09-29T21:36:35.396672] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-29T21:36:35.548073] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-02. [2025-09-29T21:36:36.010936] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-29T21:36:36.348122] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-04. [2025-09-29T21:36:36.542815] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-29T21:36:37.148114] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-03. [2025-09-29T21:36:37.606807] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-29T21:36:37.948087] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-07. [2025-09-29T21:36:38.075221] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-29T21:36:38.748111] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-03. [2025-09-29T21:36:39.548097] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-04. [2025-09-29T21:36:39.809388] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-29T21:36:40.348094] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-08. [2025-09-29T21:36:40.387297] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-29T21:36:40.446335] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-29T21:36:41.148130] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-05. [2025-09-29T21:36:41.887467] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-29T21:36:41.948093] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-04. [2025-09-29T21:36:42.279162] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-29T21:36:42.748178] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-09. [2025-09-29T21:36:43.548108] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-05. [2025-09-29T21:36:43.650235] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-29T21:36:44.348095] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-05. [2025-09-29T21:36:44.400932] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-29T21:36:44.412572] [INFO ] [REMOTE ] TWO: Full fetch complete (68965 records). [2025-09-29T21:36:44.412801] [DEBUG] [VALIDATOR ] TWO: Validating primary data. [2025-09-29T21:36:44.861382] [DEBUG] [VALIDATOR ] TWO: All expected trading days are present. [2025-09-29T21:36:44.861517] [DEBUG] [VALIDATOR ] TWO: Primary data validation passed. [2025-09-29T21:36:44.862810] [INFO ] [MAIN ] TWO: Fetched primary data is valid. [2025-09-29T21:36:44.862921] [DEBUG] [LOCAL ] TWO: Saving primary data. [2025-09-29T21:36:44.877603] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-29T21:36:44.883746] [DEBUG] [LOCAL ] TWO: Trimmed 68965 records to 48311 (keeping 200 days of data) [2025-09-29T21:36:45.148182] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-06. [2025-09-29T21:36:45.203253] [DEBUG] [LOCAL ] TWO: Primary data saved (48311 records). [2025-09-29T21:36:45.203441] [INFO ] [MAIN ] TWO: Full history saved. [2025-09-29T21:36:45.203574] [INFO ] [MAIN ] Update Progress: 2157/2371 symbols completed. TWO took 41.5s. Estimated remaining: 27m 27s. Rate: 7.8 symbols/min [2025-09-29T21:36:45.845913] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-29T21:36:45.948145] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-06. [2025-09-29T21:36:46.347730] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-29T21:36:46.748124] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-07. [2025-09-29T21:36:47.513397] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-29T21:36:47.548142] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-07. [2025-09-29T21:36:47.924099] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-29T21:36:48.348118] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-08. [2025-09-29T21:36:49.148144] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-06. [2025-09-29T21:36:49.177844] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-29T21:36:49.518717] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-29T21:36:49.948117] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-08. [2025-09-29T21:36:50.326701] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-29T21:36:50.748122] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-07. [2025-09-29T21:36:51.559236] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-09. [2025-09-29T21:36:51.564624] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-29T21:36:51.734673] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-29T21:36:52.343782] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-29T21:36:52.348132] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-08. [2025-09-29T21:36:52.348601] [INFO ] [REMOTE ] TX: Full fetch complete (35750 records). [2025-09-29T21:36:52.349717] [DEBUG] [VALIDATOR ] TX: Validating primary data. [2025-09-29T21:36:52.749807] [DEBUG] [VALIDATOR ] TX: All expected trading days are present. [2025-09-29T21:36:52.749899] [DEBUG] [VALIDATOR ] TX: Primary data validation passed. [2025-09-29T21:36:52.750757] [INFO ] [MAIN ] TX: Fetched primary data is valid. [2025-09-29T21:36:52.750822] [DEBUG] [LOCAL ] TX: Saving primary data. [2025-09-29T21:36:52.751607] [DEBUG] [LOCAL ] TX: Trimmed 35750 records to 23300 (keeping 200 days of data) [2025-09-29T21:36:52.899716] [DEBUG] [LOCAL ] TX: Primary data saved (23300 records). [2025-09-29T21:36:52.899852] [INFO ] [MAIN ] TX: Full history saved. [2025-09-29T21:36:52.900005] [INFO ] [MAIN ] Update Progress: 2158/2371 symbols completed. TX took 28.3s. Estimated remaining: 27m 19s. Rate: 7.8 symbols/min [2025-09-29T21:36:53.113188] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-29T21:36:53.148076] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-09. [2025-09-29T21:36:53.948138] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-09. [2025-09-29T21:36:54.156109] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-29T21:36:54.160451] [INFO ] [REMOTE ] TXO: Full fetch complete (26078 records). [2025-09-29T21:36:54.160545] [DEBUG] [VALIDATOR ] TXO: Validating primary data. [2025-09-29T21:36:54.553341] [DEBUG] [VALIDATOR ] TXO: All expected trading days are present. [2025-09-29T21:36:54.553425] [DEBUG] [VALIDATOR ] TXO: Primary data validation passed. [2025-09-29T21:36:54.554061] [INFO ] [MAIN ] TXO: Fetched primary data is valid. [2025-09-29T21:36:54.554125] [DEBUG] [LOCAL ] TXO: Saving primary data. [2025-09-29T21:36:54.554867] [DEBUG] [LOCAL ] TXO: Trimmed 26078 records to 18852 (keeping 200 days of data) [2025-09-29T21:36:54.683690] [DEBUG] [LOCAL ] TXO: Primary data saved (18852 records). [2025-09-29T21:36:54.683864] [INFO ] [MAIN ] TXO: Full history saved. [2025-09-29T21:36:54.684010] [INFO ] [MAIN ] Update Progress: 2159/2371 symbols completed. TXO took 26.7s. Estimated remaining: 27m 11s. Rate: 7.8 symbols/min [2025-09-29T21:36:55.362236] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-29T21:36:55.371585] [INFO ] [REMOTE ] TXNM: Full fetch complete (62660 records). [2025-09-29T21:36:55.371801] [DEBUG] [VALIDATOR ] TXNM: Validating primary data. [2025-09-29T21:36:55.796700] [DEBUG] [VALIDATOR ] TXNM: All expected trading days are present. [2025-09-29T21:36:55.797069] [DEBUG] [VALIDATOR ] TXNM: Primary data validation passed. [2025-09-29T21:36:55.798330] [INFO ] [MAIN ] TXNM: Fetched primary data is valid. [2025-09-29T21:36:55.798433] [DEBUG] [LOCAL ] TXNM: Saving primary data. [2025-09-29T21:36:55.799894] [DEBUG] [LOCAL ] TXNM: Trimmed 62660 records to 43630 (keeping 200 days of data) [2025-09-29T21:36:56.127961] [DEBUG] [LOCAL ] TXNM: Primary data saved (43630 records). [2025-09-29T21:36:56.128098] [INFO ] [MAIN ] TXNM: Full history saved. [2025-09-29T21:36:56.128214] [INFO ] [MAIN ] Update Progress: 2160/2371 symbols completed. TXNM took 30.0s. Estimated remaining: 27m 3s. Rate: 7.8 symbols/min [2025-09-29T21:36:56.757748] [INFO ] [MAIN ] TXT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:36:56.764967] [INFO ] [MAIN ] TY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:36:56.868092] [INFO ] [MAIN ] TYG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:36:56.909965] [INFO ] [MAIN ] TYL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:36:56.890615] [DEBUG] [LOCAL ] TY: Loaded 7756 existing records from primary storage. [2025-09-29T21:36:56.910982] [INFO ] [MAIN ] TY: Loaded 7756 existing records. [2025-09-29T21:36:57.041625] [DEBUG] [LOCAL ] TYG: Loaded 14410 existing records from primary storage. [2025-09-29T21:36:57.042062] [INFO ] [MAIN ] TYG: Loaded 14410 existing records. [2025-09-29T21:36:57.186964] [DEBUG] [LOCAL ] TYL: Loaded 22582 existing records from primary storage. [2025-09-29T21:36:57.255232] [INFO ] [MAIN ] TYL: Loaded 22582 existing records. [2025-09-29T21:36:57.333071] [DEBUG] [LOCAL ] TXT: Loaded 50470 existing records from primary storage. [2025-09-29T21:36:57.362678] [WARN ] [MAIN ] TY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:36:57.359344] [INFO ] [MAIN ] TXT: Loaded 50470 existing records. [2025-09-29T21:36:57.404718] [INFO ] [MAIN ] TY: Wiping existing primary data before full refresh. [2025-09-29T21:36:57.433236] [INFO ] [LOCAL ] TY: Starting deletion of primary data. [2025-09-29T21:36:57.514212] [DEBUG] [LOCAL ] TY: Deleted primary data file. [2025-09-29T21:36:57.481285] [WARN ] [MAIN ] TYG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:36:57.529804] [INFO ] [MAIN ] TY: Starting full primary refresh. [2025-09-29T21:36:57.594796] [INFO ] [MAIN ] TYG: Wiping existing primary data before full refresh. [2025-09-29T21:36:57.643002] [INFO ] [LOCAL ] TYG: Starting deletion of primary data. [2025-09-29T21:36:57.754808] [DEBUG] [LOCAL ] TYG: Deleted primary data file. [2025-09-29T21:36:57.830668] [WARN ] [MAIN ] TYL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:36:57.802707] [INFO ] [MAIN ] TYG: Starting full primary refresh. [2025-09-29T21:36:57.864824] [INFO ] [MAIN ] TYL: Wiping existing primary data before full refresh. [2025-09-29T21:36:57.952866] [WARN ] [MAIN ] TXT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:36:57.963598] [INFO ] [MAIN ] TXT: Wiping existing primary data before full refresh. [2025-09-29T21:36:57.963387] [INFO ] [LOCAL ] TYL: Starting deletion of primary data. [2025-09-29T21:36:58.031391] [DEBUG] [LOCAL ] TYL: Deleted primary data file. [2025-09-29T21:36:58.063568] [INFO ] [MAIN ] TYL: Starting full primary refresh. [2025-09-29T21:36:58.026147] [INFO ] [LOCAL ] TXT: Starting deletion of primary data. [2025-09-29T21:36:58.116820] [DEBUG] [LOCAL ] TXT: Deleted primary data file. [2025-09-29T21:36:58.157366] [INFO ] [MAIN ] TXT: Starting full primary refresh. [2025-09-29T21:36:58.845474] [INFO ] [REMOTE ] TY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:36:58.946329] [INFO ] [REMOTE ] TY: Fetching primary data for 2024-12. [2025-09-29T21:36:59.113320] [INFO ] [REMOTE ] TYG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:36:59.173078] [INFO ] [REMOTE ] TYG: Fetching primary data for 2024-12. [2025-09-29T21:36:59.328808] [INFO ] [REMOTE ] TYL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:36:59.329565] [INFO ] [REMOTE ] TYL: Fetching primary data for 2024-12. [2025-09-29T21:36:59.351256] [INFO ] [REMOTE ] TXT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:36:59.351724] [INFO ] [REMOTE ] TXT: Fetching primary data for 2024-12. [2025-09-29T21:36:59.942224] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-29T21:36:59.945057] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-01. [2025-09-29T21:37:00.139593] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-29T21:37:00.143209] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-01. [2025-09-29T21:37:00.223630] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-29T21:37:00.228847] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-01. [2025-09-29T21:37:00.840991] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-29T21:37:00.843800] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-02. [2025-09-29T21:37:01.068301] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-29T21:37:01.148114] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-02. [2025-09-29T21:37:01.444601] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-29T21:37:01.470441] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-29T21:37:01.624845] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-29T21:37:01.948103] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-03. [2025-09-29T21:37:02.119101] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-29T21:37:02.379515] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-29T21:37:02.748107] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-01. [2025-09-29T21:37:03.548148] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-02. [2025-09-29T21:37:04.348135] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-04. [2025-09-29T21:37:04.497101] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-29T21:37:04.722737] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-29T21:37:05.148121] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-03. [2025-09-29T21:37:05.161953] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-29T21:37:05.948123] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-03. [2025-09-29T21:37:06.087578] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-29T21:37:06.748124] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-02. [2025-09-29T21:37:07.266709] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-29T21:37:07.548118] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-04. [2025-09-29T21:37:08.348085] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-05. [2025-09-29T21:37:08.566370] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-29T21:37:08.613406] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-29T21:37:08.799987] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-29T21:37:09.148136] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-04. [2025-09-29T21:37:09.948108] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-06. [2025-09-29T21:37:10.434526] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-29T21:37:10.713262] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-29T21:37:10.748101] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-05. [2025-09-29T21:37:11.548166] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-05. [2025-09-29T21:37:11.950754] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-29T21:37:12.348093] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-06. [2025-09-29T21:37:12.396913] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-29T21:37:13.148130] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-03. [2025-09-29T21:37:13.462283] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-29T21:37:13.948123] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-07. [2025-09-29T21:37:14.482234] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-29T21:37:14.748109] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-06. [2025-09-29T21:37:15.039991] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-29T21:37:15.315944] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-29T21:37:15.548133] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-07. [2025-09-29T21:37:16.348107] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-08. [2025-09-29T21:37:16.554479] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-29T21:37:16.667793] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-29T21:37:17.148117] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-09. [2025-09-29T21:37:17.948110] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-07. [2025-09-29T21:37:18.293700] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-29T21:37:18.298630] [INFO ] [REMOTE ] TYL: Full fetch complete (31342 records). [2025-09-29T21:37:18.298806] [DEBUG] [VALIDATOR ] TYL: Validating primary data. [2025-09-29T21:37:18.716389] [DEBUG] [VALIDATOR ] TYL: All expected trading days are present. [2025-09-29T21:37:18.716529] [DEBUG] [VALIDATOR ] TYL: Primary data validation passed. [2025-09-29T21:37:18.717422] [INFO ] [MAIN ] TYL: Fetched primary data is valid. [2025-09-29T21:37:18.717492] [DEBUG] [LOCAL ] TYL: Saving primary data. [2025-09-29T21:37:18.718687] [DEBUG] [LOCAL ] TYL: Trimmed 31342 records to 22172 (keeping 200 days of data) [2025-09-29T21:37:18.775787] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-04. [2025-09-29T21:37:18.826075] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-29T21:37:18.880744] [DEBUG] [LOCAL ] TYL: Primary data saved (22172 records). [2025-09-29T21:37:18.880916] [INFO ] [MAIN ] TYL: Full history saved. [2025-09-29T21:37:18.881008] [INFO ] [MAIN ] Update Progress: 2161/2371 symbols completed. TYL took 22.8s. Estimated remaining: 26m 57s. Rate: 7.8 symbols/min [2025-09-29T21:37:19.057542] [INFO ] [MAIN ] U: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:37:19.115697] [DEBUG] [LOCAL ] U: Loaded 54579 existing records from primary storage. [2025-09-29T21:37:19.116099] [INFO ] [MAIN ] U: Loaded 54579 existing records. [2025-09-29T21:37:19.307681] [WARN ] [MAIN ] U: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:37:19.307950] [INFO ] [MAIN ] U: Wiping existing primary data before full refresh. [2025-09-29T21:37:19.308012] [INFO ] [LOCAL ] U: Starting deletion of primary data. [2025-09-29T21:37:19.308533] [DEBUG] [LOCAL ] U: Deleted primary data file. [2025-09-29T21:37:19.308598] [INFO ] [MAIN ] U: Starting full primary refresh. [2025-09-29T21:37:19.553218] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-08. [2025-09-29T21:37:19.707018] [INFO ] [REMOTE ] U: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:37:20.348144] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-08. [2025-09-29T21:37:20.374336] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-29T21:37:20.572222] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-29T21:37:21.107586] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-29T21:37:21.148113] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-05. [2025-09-29T21:37:21.948112] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-09. [2025-09-29T21:37:22.513076] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-29T21:37:22.748103] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-06. [2025-09-29T21:37:22.858856] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-29T21:37:22.862529] [INFO ] [REMOTE ] TYG: Full fetch complete (22579 records). [2025-09-29T21:37:22.862730] [DEBUG] [VALIDATOR ] TYG: Validating primary data. [2025-09-29T21:37:23.267510] [DEBUG] [VALIDATOR ] TYG: All expected trading days are present. [2025-09-29T21:37:23.267594] [DEBUG] [VALIDATOR ] TYG: Primary data validation passed. [2025-09-29T21:37:23.268166] [INFO ] [MAIN ] TYG: Fetched primary data is valid. [2025-09-29T21:37:23.268231] [DEBUG] [LOCAL ] TYG: Saving primary data. [2025-09-29T21:37:23.268959] [DEBUG] [LOCAL ] TYG: Trimmed 22579 records to 14195 (keeping 200 days of data) [2025-09-29T21:37:23.365447] [DEBUG] [LOCAL ] TYG: Primary data saved (14195 records). [2025-09-29T21:37:23.365601] [INFO ] [MAIN ] TYG: Full history saved. [2025-09-29T21:37:23.365728] [INFO ] [MAIN ] Update Progress: 2162/2371 symbols completed. TYG took 27.2s. Estimated remaining: 26m 49s. Rate: 7.8 symbols/min [2025-09-29T21:37:23.546744] [INFO ] [MAIN ] UA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:37:23.548091] [INFO ] [REMOTE ] U: Fetching primary data for 2024-12. [2025-09-29T21:37:23.603673] [DEBUG] [LOCAL ] UA: Loaded 51189 existing records from primary storage. [2025-09-29T21:37:23.604068] [INFO ] [MAIN ] UA: Loaded 51189 existing records. [2025-09-29T21:37:23.808279] [WARN ] [MAIN ] UA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:37:23.808525] [INFO ] [MAIN ] UA: Wiping existing primary data before full refresh. [2025-09-29T21:37:23.808582] [INFO ] [LOCAL ] UA: Starting deletion of primary data. [2025-09-29T21:37:23.809130] [DEBUG] [LOCAL ] UA: Deleted primary data file. [2025-09-29T21:37:23.809190] [INFO ] [MAIN ] UA: Starting full primary refresh. [2025-09-29T21:37:24.204606] [INFO ] [REMOTE ] UA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:37:24.348149] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-09. [2025-09-29T21:37:24.463953] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-29T21:37:25.047202] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-29T21:37:25.049570] [INFO ] [REMOTE ] TY: Full fetch complete (11703 records). [2025-09-29T21:37:25.049673] [DEBUG] [VALIDATOR ] TY: Validating primary data. [2025-09-29T21:37:25.153237] [INFO ] [REMOTE ] UA: Fetching primary data for 2024-12. [2025-09-29T21:37:25.460081] [DEBUG] [VALIDATOR ] TY: All expected trading days are present. [2025-09-29T21:37:25.460183] [DEBUG] [VALIDATOR ] TY: Primary data validation passed. [2025-09-29T21:37:25.460602] [INFO ] [MAIN ] TY: Fetched primary data is valid. [2025-09-29T21:37:25.460705] [DEBUG] [LOCAL ] TY: Saving primary data. [2025-09-29T21:37:25.461276] [DEBUG] [LOCAL ] TY: Trimmed 11703 records to 7581 (keeping 200 days of data) [2025-09-29T21:37:25.508965] [DEBUG] [LOCAL ] TY: Primary data saved (7581 records). [2025-09-29T21:37:25.509137] [INFO ] [MAIN ] TY: Full history saved. [2025-09-29T21:37:25.509234] [INFO ] [MAIN ] Update Progress: 2163/2371 symbols completed. TY took 29.4s. Estimated remaining: 26m 40s. Rate: 7.8 symbols/min [2025-09-29T21:37:25.690873] [INFO ] [MAIN ] UAA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:37:25.750845] [DEBUG] [LOCAL ] UAA: Loaded 54287 existing records from primary storage. [2025-09-29T21:37:25.751320] [INFO ] [MAIN ] UAA: Loaded 54287 existing records. [2025-09-29T21:37:25.947368] [WARN ] [MAIN ] UAA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:37:25.947947] [INFO ] [MAIN ] UAA: Wiping existing primary data before full refresh. [2025-09-29T21:37:25.948107] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-07. [2025-09-29T21:37:25.948516] [INFO ] [LOCAL ] UAA: Starting deletion of primary data. [2025-09-29T21:37:25.950367] [DEBUG] [LOCAL ] UAA: Deleted primary data file. [2025-09-29T21:37:25.950476] [INFO ] [MAIN ] UAA: Starting full primary refresh. [2025-09-29T21:37:26.149185] [INFO ] [REMOTE ] U: Incremental fetch complete for 2024-12 (2.60 seconds). [2025-09-29T21:37:26.413810] [INFO ] [REMOTE ] UAA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:37:26.748085] [INFO ] [REMOTE ] U: Fetching primary data for 2025-01. [2025-09-29T21:37:26.928438] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-29T21:37:27.548088] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-01. [2025-09-29T21:37:27.815039] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-29T21:37:28.348111] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-08. [2025-09-29T21:37:28.996791] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-29T21:37:29.040788] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-29T21:37:29.148104] [INFO ] [REMOTE ] UAA: Fetching primary data for 2024-12. [2025-09-29T21:37:29.313307] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-29T21:37:29.948099] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-09. [2025-09-29T21:37:30.748083] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-02. [2025-09-29T21:37:31.081888] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-29T21:37:31.170008] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-29T21:37:31.179972] [INFO ] [REMOTE ] TXT: Full fetch complete (72266 records). [2025-09-29T21:37:31.180105] [DEBUG] [VALIDATOR ] TXT: Validating primary data. [2025-09-29T21:37:31.553289] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-01. [2025-09-29T21:37:31.604068] [DEBUG] [VALIDATOR ] TXT: All expected trading days are present. [2025-09-29T21:37:31.604165] [DEBUG] [VALIDATOR ] TXT: Primary data validation passed. [2025-09-29T21:37:31.605473] [INFO ] [MAIN ] TXT: Fetched primary data is valid. [2025-09-29T21:37:31.605559] [DEBUG] [LOCAL ] TXT: Saving primary data. [2025-09-29T21:37:31.607193] [DEBUG] [LOCAL ] TXT: Trimmed 72266 records to 49733 (keeping 200 days of data) [2025-09-29T21:37:31.931887] [DEBUG] [LOCAL ] TXT: Primary data saved (49733 records). [2025-09-29T21:37:31.932068] [INFO ] [MAIN ] TXT: Full history saved. [2025-09-29T21:37:31.932179] [INFO ] [MAIN ] Update Progress: 2164/2371 symbols completed. TXT took 35.8s. Estimated remaining: 26m 33s. Rate: 7.8 symbols/min [2025-09-29T21:37:32.118385] [INFO ] [MAIN ] UAN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:37:32.128125] [DEBUG] [LOCAL ] UAN: Loaded 5507 existing records from primary storage. [2025-09-29T21:37:32.128445] [INFO ] [MAIN ] UAN: Loaded 5507 existing records. [2025-09-29T21:37:32.319598] [WARN ] [MAIN ] UAN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:37:32.319882] [INFO ] [MAIN ] UAN: Wiping existing primary data before full refresh. [2025-09-29T21:37:32.319961] [INFO ] [LOCAL ] UAN: Starting deletion of primary data. [2025-09-29T21:37:32.320249] [DEBUG] [LOCAL ] UAN: Deleted primary data file. [2025-09-29T21:37:32.320310] [INFO ] [MAIN ] UAN: Starting full primary refresh. [2025-09-29T21:37:32.353125] [INFO ] [REMOTE ] U: Fetching primary data for 2025-02. [2025-09-29T21:37:32.704904] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-29T21:37:32.761185] [INFO ] [REMOTE ] UAN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:37:33.148073] [INFO ] [REMOTE ] UAN: Fetching primary data for 2024-12. [2025-09-29T21:37:33.418065] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-29T21:37:33.670148] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-29T21:37:33.948119] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-03. [2025-09-29T21:37:34.329754] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-29T21:37:34.748169] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-01. [2025-09-29T21:37:35.388003] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-29T21:37:35.548138] [INFO ] [REMOTE ] U: Fetching primary data for 2025-03. [2025-09-29T21:37:35.820992] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-29T21:37:36.348119] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-04. [2025-09-29T21:37:37.148131] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-02. [2025-09-29T21:37:37.812527] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-29T21:37:37.830015] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-29T21:37:37.948116] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-03. [2025-09-29T21:37:38.058718] [DEBUG] [REMOTE ] UA: Error fetching primary data for 2025-04: Server request status code is 503. [2025-09-29T21:37:38.059055] [WARN ] [REMOTE ] UA: No data returned for month 2025-04 [2025-09-29T21:37:38.059151] [FATAL] [REMOTE ] UA: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T21:37:38.059233] [FATAL] [MAIN ] UA: Failed to fetch primary data. [2025-09-29T21:37:38.059273] [WARN ] [MAIN ] UA: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T21:37:38.059347] [INFO ] [LOCAL ] UA: Starting deletion of primary data. [2025-09-29T21:37:38.059429] [DEBUG] [LOCAL ] UA: No primary data file found to delete. [2025-09-29T21:37:38.059467] [INFO ] [LOCAL ] UA: Starting deletion of derivative data. [2025-09-29T21:37:38.060158] [DEBUG] [LOCAL ] UA: Deleted derivative data file. [2025-09-29T21:37:38.060251] [INFO ] [MAIN ] Update Progress: 2165/2371 symbols completed. UA took 14.7s. Estimated remaining: 26m 25s. Rate: 7.8 symbols/min [2025-09-29T21:37:38.246541] [INFO ] [MAIN ] UBER: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:37:38.310546] [DEBUG] [LOCAL ] UBER: Loaded 54586 existing records from primary storage. [2025-09-29T21:37:38.310956] [INFO ] [MAIN ] UBER: Loaded 54586 existing records. [2025-09-29T21:37:38.521091] [WARN ] [MAIN ] UBER: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:37:38.521313] [INFO ] [MAIN ] UBER: Wiping existing primary data before full refresh. [2025-09-29T21:37:38.521363] [INFO ] [LOCAL ] UBER: Starting deletion of primary data. [2025-09-29T21:37:38.522072] [DEBUG] [LOCAL ] UBER: Deleted primary data file. [2025-09-29T21:37:38.522135] [INFO ] [MAIN ] UBER: Starting full primary refresh. [2025-09-29T21:37:38.642379] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-29T21:37:38.753234] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-02. [2025-09-29T21:37:38.918385] [INFO ] [REMOTE ] UBER: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:37:39.548114] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-04. [2025-09-29T21:37:40.348130] [INFO ] [REMOTE ] U: Fetching primary data for 2025-04. [2025-09-29T21:37:40.375079] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-29T21:37:40.571445] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-29T21:37:41.148150] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-05. [2025-09-29T21:37:41.872869] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-29T21:37:41.948114] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-06. [2025-09-29T21:37:42.573430] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-29T21:37:42.591089] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-29T21:37:42.748123] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-07. [2025-09-29T21:37:43.317607] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-29T21:37:43.548143] [INFO ] [REMOTE ] U: Fetching primary data for 2025-05. [2025-09-29T21:37:44.348152] [INFO ] [REMOTE ] UBER: Fetching primary data for 2024-12. [2025-09-29T21:37:45.148111] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-03. [2025-09-29T21:37:45.899337] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-09-29T21:37:45.948095] [INFO ] [REMOTE ] U: Fetching primary data for 2025-06. [2025-09-29T21:37:46.456164] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-29T21:37:46.748103] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-01. [2025-09-29T21:37:46.946629] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-29T21:37:47.548166] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-04. [2025-09-29T21:37:48.067511] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-29T21:37:48.348141] [INFO ] [REMOTE ] U: Fetching primary data for 2025-07. [2025-09-29T21:37:48.830040] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-29T21:37:49.085011] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-29T21:37:49.148071] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-05. [2025-09-29T21:37:49.948152] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-08. [2025-09-29T21:37:50.713371] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-29T21:37:50.753275] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-09. [2025-09-29T21:37:50.780365] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-09-29T21:37:50.983684] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-29T21:37:51.371669] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-29T21:37:51.373250] [INFO ] [REMOTE ] UAN: Full fetch complete (8149 records). [2025-09-29T21:37:51.373363] [DEBUG] [VALIDATOR ] UAN: Validating primary data. [2025-09-29T21:37:51.549153] [INFO ] [REMOTE ] U: Fetching primary data for 2025-08. [2025-09-29T21:37:51.779972] [DEBUG] [VALIDATOR ] UAN: All expected trading days are present. [2025-09-29T21:37:51.780074] [DEBUG] [VALIDATOR ] UAN: Primary data validation passed. [2025-09-29T21:37:51.780363] [INFO ] [MAIN ] UAN: Fetched primary data is valid. [2025-09-29T21:37:51.780447] [DEBUG] [LOCAL ] UAN: Saving primary data. [2025-09-29T21:37:51.781041] [DEBUG] [LOCAL ] UAN: Trimmed 8149 records to 5404 (keeping 200 days of data) [2025-09-29T21:37:51.816783] [DEBUG] [LOCAL ] UAN: Primary data saved (5404 records). [2025-09-29T21:37:51.816926] [INFO ] [MAIN ] UAN: Full history saved. [2025-09-29T21:37:51.817043] [INFO ] [MAIN ] Update Progress: 2166/2371 symbols completed. UAN took 19.9s. Estimated remaining: 26m 18s. Rate: 7.8 symbols/min [2025-09-29T21:37:51.999271] [INFO ] [MAIN ] UBS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:37:52.053658] [DEBUG] [LOCAL ] UBS: Loaded 53187 existing records from primary storage. [2025-09-29T21:37:52.053996] [INFO ] [MAIN ] UBS: Loaded 53187 existing records. [2025-09-29T21:37:52.239752] [WARN ] [MAIN ] UBS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:37:52.239969] [INFO ] [MAIN ] UBS: Wiping existing primary data before full refresh. [2025-09-29T21:37:52.240020] [INFO ] [LOCAL ] UBS: Starting deletion of primary data. [2025-09-29T21:37:52.240778] [DEBUG] [LOCAL ] UBS: Deleted primary data file. [2025-09-29T21:37:52.240839] [INFO ] [MAIN ] UBS: Starting full primary refresh. [2025-09-29T21:37:52.354150] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-06. [2025-09-29T21:37:52.654828] [INFO ] [REMOTE ] UBS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:37:52.932282] [DEBUG] [REMOTE ] UAA: Error fetching primary data for 2025-06: Server request status code is 503. [2025-09-29T21:37:52.932695] [WARN ] [REMOTE ] UAA: No data returned for month 2025-06 [2025-09-29T21:37:52.932787] [FATAL] [REMOTE ] UAA: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T21:37:52.932910] [FATAL] [MAIN ] UAA: Failed to fetch primary data. [2025-09-29T21:37:52.932981] [WARN ] [MAIN ] UAA: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T21:37:52.933055] [INFO ] [LOCAL ] UAA: Starting deletion of primary data. [2025-09-29T21:37:52.933139] [DEBUG] [LOCAL ] UAA: No primary data file found to delete. [2025-09-29T21:37:52.933195] [INFO ] [LOCAL ] UAA: Starting deletion of derivative data. [2025-09-29T21:37:52.933583] [DEBUG] [LOCAL ] UAA: Deleted derivative data file. [2025-09-29T21:37:52.933696] [INFO ] [MAIN ] Update Progress: 2167/2371 symbols completed. UAA took 27.4s. Estimated remaining: 26m 9s. Rate: 7.8 symbols/min [2025-09-29T21:37:53.121738] [INFO ] [MAIN ] UCB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:37:53.148919] [INFO ] [REMOTE ] UBS: Fetching primary data for 2024-12. [2025-09-29T21:37:53.166911] [DEBUG] [LOCAL ] UCB: Loaded 38555 existing records from primary storage. [2025-09-29T21:37:53.167261] [INFO ] [MAIN ] UCB: Loaded 38555 existing records. [2025-09-29T21:37:53.350575] [WARN ] [MAIN ] UCB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:37:53.350836] [INFO ] [MAIN ] UCB: Wiping existing primary data before full refresh. [2025-09-29T21:37:53.350885] [INFO ] [LOCAL ] UCB: Starting deletion of primary data. [2025-09-29T21:37:53.351349] [DEBUG] [LOCAL ] UCB: Deleted primary data file. [2025-09-29T21:37:53.351411] [INFO ] [MAIN ] UCB: Starting full primary refresh. [2025-09-29T21:37:53.776885] [INFO ] [REMOTE ] UCB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:37:53.948133] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-02. [2025-09-29T21:37:54.013989] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-09-29T21:37:54.748139] [INFO ] [REMOTE ] U: Fetching primary data for 2025-09. [2025-09-29T21:37:54.884983] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-29T21:37:55.548118] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-01. [2025-09-29T21:37:56.015252] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-29T21:37:56.348148] [INFO ] [REMOTE ] UCB: Fetching primary data for 2024-12. [2025-09-29T21:37:56.998067] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-29T21:37:57.010030] [INFO ] [REMOTE ] U: Full fetch complete (77925 records). [2025-09-29T21:37:57.010188] [DEBUG] [VALIDATOR ] U: Validating primary data. [2025-09-29T21:37:57.164479] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-03. [2025-09-29T21:37:57.458377] [DEBUG] [VALIDATOR ] U: All expected trading days are present. [2025-09-29T21:37:57.458575] [DEBUG] [VALIDATOR ] U: Primary data validation passed. [2025-09-29T21:37:57.460044] [INFO ] [MAIN ] U: Fetched primary data is valid. [2025-09-29T21:37:57.460260] [DEBUG] [LOCAL ] U: Saving primary data. [2025-09-29T21:37:57.492065] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-29T21:37:57.492246] [DEBUG] [LOCAL ] U: Trimmed 77925 records to 53799 (keeping 200 days of data) [2025-09-29T21:37:57.842997] [DEBUG] [LOCAL ] U: Primary data saved (53799 records). [2025-09-29T21:37:57.843145] [INFO ] [MAIN ] U: Full history saved. [2025-09-29T21:37:57.843233] [INFO ] [MAIN ] Update Progress: 2168/2371 symbols completed. U took 39.0s. Estimated remaining: 26m 1s. Rate: 7.8 symbols/min [2025-09-29T21:37:57.949898] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-02. [2025-09-29T21:37:58.028022] [INFO ] [MAIN ] UDR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:37:58.055509] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-29T21:37:58.116107] [DEBUG] [LOCAL ] UDR: Loaded 52555 existing records from primary storage. [2025-09-29T21:37:58.116620] [INFO ] [MAIN ] UDR: Loaded 52555 existing records. [2025-09-29T21:37:58.297944] [WARN ] [MAIN ] UDR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:37:58.298183] [INFO ] [MAIN ] UDR: Wiping existing primary data before full refresh. [2025-09-29T21:37:58.298231] [INFO ] [LOCAL ] UDR: Starting deletion of primary data. [2025-09-29T21:37:58.298810] [DEBUG] [LOCAL ] UDR: Deleted primary data file. [2025-09-29T21:37:58.298870] [INFO ] [MAIN ] UDR: Starting full primary refresh. [2025-09-29T21:37:58.721746] [INFO ] [REMOTE ] UDR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:37:58.748090] [INFO ] [REMOTE ] UDR: Fetching primary data for 2024-12. [2025-09-29T21:37:59.548086] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-01. [2025-09-29T21:37:59.602511] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-09-29T21:37:59.706825] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-29T21:38:00.348117] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-04. [2025-09-29T21:38:00.468978] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-29T21:38:01.132082] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-29T21:38:01.148057] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-02. [2025-09-29T21:38:01.948120] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-01. [2025-09-29T21:38:02.539315] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-29T21:38:02.748174] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-03. [2025-09-29T21:38:02.837410] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-09-29T21:38:03.548141] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-05. [2025-09-29T21:38:03.602845] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-29T21:38:04.028234] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-29T21:38:04.348115] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-04. [2025-09-29T21:38:05.148123] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-03. [2025-09-29T21:38:05.919905] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-29T21:38:05.948094] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-05. [2025-09-29T21:38:06.068204] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-09-29T21:38:06.675939] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-29T21:38:06.748122] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-04. [2025-09-29T21:38:06.972016] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-29T21:38:07.548128] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-06. [2025-09-29T21:38:08.348172] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-06. [2025-09-29T21:38:08.600189] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-29T21:38:09.052045] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-29T21:38:09.148120] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-07. [2025-09-29T21:38:09.948127] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-05. [2025-09-29T21:38:10.704696] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-29T21:38:10.748095] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-08. [2025-09-29T21:38:10.948575] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-09-29T21:38:11.548126] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-07. [2025-09-29T21:38:11.706912] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-29T21:38:12.199475] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-29T21:38:12.348150] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-09. [2025-09-29T21:38:13.148167] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-02. [2025-09-29T21:38:13.769251] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-29T21:38:13.778609] [INFO ] [REMOTE ] UCB: Full fetch complete (54699 records). [2025-09-29T21:38:13.778841] [DEBUG] [VALIDATOR ] UCB: Validating primary data. [2025-09-29T21:38:13.948119] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-06. [2025-09-29T21:38:14.202502] [DEBUG] [VALIDATOR ] UCB: All expected trading days are present. [2025-09-29T21:38:14.202677] [DEBUG] [VALIDATOR ] UCB: Primary data validation passed. [2025-09-29T21:38:14.205496] [INFO ] [MAIN ] UCB: Fetched primary data is valid. [2025-09-29T21:38:14.205748] [DEBUG] [LOCAL ] UCB: Saving primary data. [2025-09-29T21:38:14.207763] [DEBUG] [LOCAL ] UCB: Trimmed 54699 records to 37898 (keeping 200 days of data) [2025-09-29T21:38:14.320394] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-07 (2.77 seconds). [2025-09-29T21:38:14.541883] [DEBUG] [LOCAL ] UCB: Primary data saved (37898 records). [2025-09-29T21:38:14.542147] [INFO ] [MAIN ] UCB: Full history saved. [2025-09-29T21:38:14.542296] [INFO ] [MAIN ] Update Progress: 2169/2371 symbols completed. UCB took 21.6s. Estimated remaining: 25m 54s. Rate: 7.8 symbols/min [2025-09-29T21:38:14.783198] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-08. [2025-09-29T21:38:14.791980] [INFO ] [MAIN ] UE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:38:14.825794] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-29T21:38:14.878149] [DEBUG] [LOCAL ] UE: Loaded 43513 existing records from primary storage. [2025-09-29T21:38:14.878553] [INFO ] [MAIN ] UE: Loaded 43513 existing records. [2025-09-29T21:38:15.054718] [WARN ] [MAIN ] UE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:38:15.055032] [INFO ] [MAIN ] UE: Wiping existing primary data before full refresh. [2025-09-29T21:38:15.055084] [INFO ] [LOCAL ] UE: Starting deletion of primary data. [2025-09-29T21:38:15.055629] [DEBUG] [LOCAL ] UE: Deleted primary data file. [2025-09-29T21:38:15.055726] [INFO ] [MAIN ] UE: Starting full primary refresh. [2025-09-29T21:38:15.422840] [INFO ] [REMOTE ] UE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:38:15.548112] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-03. [2025-09-29T21:38:15.628250] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-29T21:38:16.348217] [INFO ] [REMOTE ] UE: Fetching primary data for 2024-12. [2025-09-29T21:38:16.880404] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-29T21:38:17.148124] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-07. [2025-09-29T21:38:17.228157] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-09-29T21:38:17.820795] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-29T21:38:17.948156] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-01. [2025-09-29T21:38:18.748100] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-09. [2025-09-29T21:38:18.933769] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-29T21:38:19.073424] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-29T21:38:19.553241] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-08. [2025-09-29T21:38:19.581306] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-29T21:38:19.595070] [INFO ] [REMOTE ] UBER: Full fetch complete (77978 records). [2025-09-29T21:38:19.595313] [DEBUG] [VALIDATOR ] UBER: Validating primary data. [2025-09-29T21:38:20.031356] [DEBUG] [VALIDATOR ] UBER: All expected trading days are present. [2025-09-29T21:38:20.031503] [DEBUG] [VALIDATOR ] UBER: Primary data validation passed. [2025-09-29T21:38:20.033374] [INFO ] [MAIN ] UBER: Fetched primary data is valid. [2025-09-29T21:38:20.033497] [DEBUG] [LOCAL ] UBER: Saving primary data. [2025-09-29T21:38:20.039578] [DEBUG] [LOCAL ] UBER: Trimmed 77978 records to 53806 (keeping 200 days of data) [2025-09-29T21:38:20.349289] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-04. [2025-09-29T21:38:20.397905] [DEBUG] [LOCAL ] UBER: Primary data saved (53806 records). [2025-09-29T21:38:20.398103] [INFO ] [MAIN ] UBER: Full history saved. [2025-09-29T21:38:20.398264] [INFO ] [MAIN ] Update Progress: 2170/2371 symbols completed. UBER took 42.3s. Estimated remaining: 25m 47s. Rate: 7.8 symbols/min [2025-09-29T21:38:20.576933] [INFO ] [MAIN ] UFI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:38:20.589717] [DEBUG] [LOCAL ] UFI: Loaded 8229 existing records from primary storage. [2025-09-29T21:38:20.590009] [INFO ] [MAIN ] UFI: Loaded 8229 existing records. [2025-09-29T21:38:20.782894] [WARN ] [MAIN ] UFI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:38:20.783299] [INFO ] [MAIN ] UFI: Wiping existing primary data before full refresh. [2025-09-29T21:38:20.783374] [INFO ] [LOCAL ] UFI: Starting deletion of primary data. [2025-09-29T21:38:20.783717] [DEBUG] [LOCAL ] UFI: Deleted primary data file. [2025-09-29T21:38:20.783777] [INFO ] [MAIN ] UFI: Starting full primary refresh. [2025-09-29T21:38:21.151739] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-02. [2025-09-29T21:38:21.181147] [INFO ] [REMOTE ] UFI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:38:21.220891] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-29T21:38:21.948134] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-09. [2025-09-29T21:38:22.184444] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-29T21:38:22.704001] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-29T21:38:22.748123] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-03. [2025-09-29T21:38:23.548122] [INFO ] [REMOTE ] UFI: Fetching primary data for 2024-12. [2025-09-29T21:38:23.664786] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-29T21:38:23.675719] [INFO ] [REMOTE ] UBS: Full fetch complete (75632 records). [2025-09-29T21:38:23.675907] [DEBUG] [VALIDATOR ] UBS: Validating primary data. [2025-09-29T21:38:24.109048] [DEBUG] [VALIDATOR ] UBS: All expected trading days are present. [2025-09-29T21:38:24.109726] [DEBUG] [VALIDATOR ] UBS: Primary data validation passed. [2025-09-29T21:38:24.111262] [INFO ] [MAIN ] UBS: Fetched primary data is valid. [2025-09-29T21:38:24.111366] [DEBUG] [LOCAL ] UBS: Saving primary data. [2025-09-29T21:38:24.109990] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-29T21:38:24.116265] [DEBUG] [LOCAL ] UBS: Trimmed 75632 records to 52406 (keeping 200 days of data) [2025-09-29T21:38:24.351148] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-05. [2025-09-29T21:38:24.374148] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-29T21:38:24.495587] [DEBUG] [LOCAL ] UBS: Primary data saved (52406 records). [2025-09-29T21:38:24.495813] [INFO ] [MAIN ] UBS: Full history saved. [2025-09-29T21:38:24.495949] [INFO ] [MAIN ] Update Progress: 2171/2371 symbols completed. UBS took 32.7s. Estimated remaining: 25m 39s. Rate: 7.8 symbols/min [2025-09-29T21:38:24.683488] [INFO ] [MAIN ] UGI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:38:24.742262] [DEBUG] [LOCAL ] UGI: Loaded 51290 existing records from primary storage. [2025-09-29T21:38:24.742611] [INFO ] [MAIN ] UGI: Loaded 51290 existing records. [2025-09-29T21:38:24.923008] [WARN ] [MAIN ] UGI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:38:24.923223] [INFO ] [MAIN ] UGI: Wiping existing primary data before full refresh. [2025-09-29T21:38:24.923270] [INFO ] [LOCAL ] UGI: Starting deletion of primary data. [2025-09-29T21:38:24.923805] [DEBUG] [LOCAL ] UGI: Deleted primary data file. [2025-09-29T21:38:24.923864] [INFO ] [MAIN ] UGI: Starting full primary refresh. [2025-09-29T21:38:25.153287] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-04. [2025-09-29T21:38:25.296716] [INFO ] [REMOTE ] UGI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:38:25.948134] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-01. [2025-09-29T21:38:26.215023] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-29T21:38:26.379423] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-29T21:38:26.748127] [INFO ] [REMOTE ] UGI: Fetching primary data for 2024-12. [2025-09-29T21:38:26.810553] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-29T21:38:27.548816] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-06. [2025-09-29T21:38:28.179880] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-29T21:38:28.348164] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-01. [2025-09-29T21:38:29.148103] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-02. [2025-09-29T21:38:29.240069] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-29T21:38:29.924159] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-29T21:38:29.948081] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-03. [2025-09-29T21:38:30.071685] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-29T21:38:30.750205] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-02. [2025-09-29T21:38:30.753766] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-29T21:38:31.548107] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-07. [2025-09-29T21:38:32.294738] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-29T21:38:32.348083] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-03. [2025-09-29T21:38:33.148118] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-04. [2025-09-29T21:38:33.319014] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-29T21:38:33.621004] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-29T21:38:33.760737] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-29T21:38:33.948107] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-08. [2025-09-29T21:38:34.704922] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-29T21:38:34.748137] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-04. [2025-09-29T21:38:35.548113] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-09. [2025-09-29T21:38:36.176688] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-29T21:38:36.348122] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-05. [2025-09-29T21:38:37.152251] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-05. [2025-09-29T21:38:37.158962] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-29T21:38:37.174365] [INFO ] [REMOTE ] UDR: Full fetch complete (74506 records). [2025-09-29T21:38:37.174547] [DEBUG] [VALIDATOR ] UDR: Validating primary data. [2025-09-29T21:38:37.618410] [DEBUG] [VALIDATOR ] UDR: All expected trading days are present. [2025-09-29T21:38:37.618615] [DEBUG] [VALIDATOR ] UDR: Primary data validation passed. [2025-09-29T21:38:37.620773] [INFO ] [MAIN ] UDR: Fetched primary data is valid. [2025-09-29T21:38:37.620862] [DEBUG] [LOCAL ] UDR: Saving primary data. [2025-09-29T21:38:37.651280] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-29T21:38:37.649799] [DEBUG] [LOCAL ] UDR: Trimmed 74506 records to 51792 (keeping 200 days of data) [2025-09-29T21:38:37.972515] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-05. [2025-09-29T21:38:38.027259] [DEBUG] [LOCAL ] UDR: Primary data saved (51792 records). [2025-09-29T21:38:38.027503] [INFO ] [MAIN ] UDR: Full history saved. [2025-09-29T21:38:38.027751] [INFO ] [MAIN ] Update Progress: 2172/2371 symbols completed. UDR took 40.2s. Estimated remaining: 25m 31s. Rate: 7.8 symbols/min [2025-09-29T21:38:38.204560] [INFO ] [MAIN ] UGP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:38:38.260557] [DEBUG] [LOCAL ] UGP: Loaded 43319 existing records from primary storage. [2025-09-29T21:38:38.261073] [INFO ] [MAIN ] UGP: Loaded 43319 existing records. [2025-09-29T21:38:38.450973] [WARN ] [MAIN ] UGP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:38:38.451231] [INFO ] [MAIN ] UGP: Wiping existing primary data before full refresh. [2025-09-29T21:38:38.451612] [INFO ] [LOCAL ] UGP: Starting deletion of primary data. [2025-09-29T21:38:38.452404] [DEBUG] [LOCAL ] UGP: Deleted primary data file. [2025-09-29T21:38:38.452471] [INFO ] [MAIN ] UGP: Starting full primary refresh. [2025-09-29T21:38:38.749731] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-06. [2025-09-29T21:38:38.835115] [INFO ] [REMOTE ] UGP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:38:38.837054] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-29T21:38:38.880828] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-29T21:38:39.548181] [INFO ] [REMOTE ] UGP: Fetching primary data for 2024-12. [2025-09-29T21:38:40.259860] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-29T21:38:40.348123] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-06. [2025-09-29T21:38:40.977296] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-29T21:38:41.156031] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-07. [2025-09-29T21:38:41.188005] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-29T21:38:41.685702] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-29T21:38:41.948139] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-06. [2025-09-29T21:38:42.748145] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-08. [2025-09-29T21:38:43.437524] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-29T21:38:43.548092] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-09. [2025-09-29T21:38:43.643836] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-29T21:38:44.249683] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-29T21:38:44.251785] [INFO ] [REMOTE ] UFI: Full fetch complete (12367 records). [2025-09-29T21:38:44.251860] [DEBUG] [VALIDATOR ] UFI: Validating primary data. [2025-09-29T21:38:44.353266] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-07. [2025-09-29T21:38:44.622435] [DEBUG] [VALIDATOR ] UFI: All expected trading days are present. [2025-09-29T21:38:44.622513] [DEBUG] [VALIDATOR ] UFI: Primary data validation passed. [2025-09-29T21:38:44.622826] [INFO ] [MAIN ] UFI: Fetched primary data is valid. [2025-09-29T21:38:44.622887] [DEBUG] [LOCAL ] UFI: Saving primary data. [2025-09-29T21:38:44.623398] [DEBUG] [LOCAL ] UFI: Trimmed 12367 records to 8088 (keeping 200 days of data) [2025-09-29T21:38:44.669448] [DEBUG] [LOCAL ] UFI: Primary data saved (8088 records). [2025-09-29T21:38:44.669593] [INFO ] [MAIN ] UFI: Full history saved. [2025-09-29T21:38:44.669703] [INFO ] [MAIN ] Update Progress: 2173/2371 symbols completed. UFI took 24.3s. Estimated remaining: 25m 24s. Rate: 7.8 symbols/min [2025-09-29T21:38:44.852533] [INFO ] [MAIN ] UHAL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:38:44.873322] [DEBUG] [LOCAL ] UHAL: Loaded 16817 existing records from primary storage. [2025-09-29T21:38:44.873681] [INFO ] [MAIN ] UHAL: Loaded 16817 existing records. [2025-09-29T21:38:45.103819] [WARN ] [MAIN ] UHAL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:38:45.104127] [INFO ] [MAIN ] UHAL: Wiping existing primary data before full refresh. [2025-09-29T21:38:45.104193] [INFO ] [LOCAL ] UHAL: Starting deletion of primary data. [2025-09-29T21:38:45.104526] [DEBUG] [LOCAL ] UHAL: Deleted primary data file. [2025-09-29T21:38:45.104589] [INFO ] [MAIN ] UHAL: Starting full primary refresh. [2025-09-29T21:38:45.154961] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-07. [2025-09-29T21:38:45.511036] [INFO ] [REMOTE ] UHAL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:38:45.948100] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-01. [2025-09-29T21:38:46.174818] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-29T21:38:46.748137] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-08. [2025-09-29T21:38:46.872597] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-29T21:38:47.516195] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-29T21:38:47.548098] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-02. [2025-09-29T21:38:48.028502] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-29T21:38:48.348128] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-09. [2025-09-29T21:38:48.989029] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-29T21:38:49.148147] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-08. [2025-09-29T21:38:49.626556] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-29T21:38:49.637440] [INFO ] [REMOTE ] UGI: Full fetch complete (73391 records). [2025-09-29T21:38:49.637602] [DEBUG] [VALIDATOR ] UGI: Validating primary data. [2025-09-29T21:38:49.953292] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2024-12. [2025-09-29T21:38:50.076198] [DEBUG] [VALIDATOR ] UGI: All expected trading days are present. [2025-09-29T21:38:50.076586] [DEBUG] [VALIDATOR ] UGI: Primary data validation passed. [2025-09-29T21:38:50.079022] [INFO ] [MAIN ] UGI: Fetched primary data is valid. [2025-09-29T21:38:50.079129] [DEBUG] [LOCAL ] UGI: Saving primary data. [2025-09-29T21:38:50.080755] [DEBUG] [LOCAL ] UGI: Trimmed 73391 records to 50508 (keeping 200 days of data) [2025-09-29T21:38:50.418820] [DEBUG] [LOCAL ] UGI: Primary data saved (50508 records). [2025-09-29T21:38:50.419006] [INFO ] [MAIN ] UGI: Full history saved. [2025-09-29T21:38:50.419222] [INFO ] [MAIN ] Update Progress: 2174/2371 symbols completed. UGI took 25.9s. Estimated remaining: 25m 16s. Rate: 7.8 symbols/min [2025-09-29T21:38:50.604182] [INFO ] [MAIN ] UHS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:38:50.676443] [DEBUG] [LOCAL ] UHS: Loaded 41674 existing records from primary storage. [2025-09-29T21:38:50.677810] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-29T21:38:50.687242] [INFO ] [MAIN ] UHS: Loaded 41674 existing records. [2025-09-29T21:38:50.759291] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-09. [2025-09-29T21:38:50.882856] [WARN ] [MAIN ] UHS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:38:50.883171] [INFO ] [MAIN ] UHS: Wiping existing primary data before full refresh. [2025-09-29T21:38:50.883240] [INFO ] [LOCAL ] UHS: Starting deletion of primary data. [2025-09-29T21:38:50.883779] [DEBUG] [LOCAL ] UHS: Deleted primary data file. [2025-09-29T21:38:50.883896] [INFO ] [MAIN ] UHS: Starting full primary refresh. [2025-09-29T21:38:51.127476] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-29T21:38:51.294606] [INFO ] [REMOTE ] UHS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:38:51.548120] [INFO ] [REMOTE ] UHS: Fetching primary data for 2024-12. [2025-09-29T21:38:52.332102] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-29T21:38:52.341027] [INFO ] [REMOTE ] UE: Full fetch complete (61454 records). [2025-09-29T21:38:52.341203] [DEBUG] [VALIDATOR ] UE: Validating primary data. [2025-09-29T21:38:52.353459] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-03. [2025-09-29T21:38:52.752029] [DEBUG] [VALIDATOR ] UE: All expected trading days are present. [2025-09-29T21:38:52.752123] [DEBUG] [VALIDATOR ] UE: Primary data validation passed. [2025-09-29T21:38:52.753202] [INFO ] [MAIN ] UE: Fetched primary data is valid. [2025-09-29T21:38:52.753271] [DEBUG] [LOCAL ] UE: Saving primary data. [2025-09-29T21:38:52.754569] [DEBUG] [LOCAL ] UE: Trimmed 61454 records to 42769 (keeping 200 days of data) [2025-09-29T21:38:53.036073] [DEBUG] [LOCAL ] UE: Primary data saved (42769 records). [2025-09-29T21:38:53.036266] [INFO ] [MAIN ] UE: Full history saved. [2025-09-29T21:38:53.036452] [INFO ] [MAIN ] Update Progress: 2175/2371 symbols completed. UE took 38.5s. Estimated remaining: 25m 8s. Rate: 7.8 symbols/min [2025-09-29T21:38:53.150730] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-01. [2025-09-29T21:38:53.245288] [INFO ] [MAIN ] UHT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:38:53.247287] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-29T21:38:53.265769] [DEBUG] [LOCAL ] UHT: Loaded 10131 existing records from primary storage. [2025-09-29T21:38:53.265995] [INFO ] [MAIN ] UHT: Loaded 10131 existing records. [2025-09-29T21:38:53.450280] [WARN ] [MAIN ] UHT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:38:53.450529] [INFO ] [MAIN ] UHT: Wiping existing primary data before full refresh. [2025-09-29T21:38:53.450594] [INFO ] [LOCAL ] UHT: Starting deletion of primary data. [2025-09-29T21:38:53.450834] [DEBUG] [LOCAL ] UHT: Deleted primary data file. [2025-09-29T21:38:53.450914] [INFO ] [MAIN ] UHT: Starting full primary refresh. [2025-09-29T21:38:53.843636] [INFO ] [REMOTE ] UHT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:38:53.948112] [INFO ] [REMOTE ] UHT: Fetching primary data for 2024-12. [2025-09-29T21:38:54.079740] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-29T21:38:54.239741] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-29T21:38:54.669282] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-29T21:38:54.748158] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-01. [2025-09-29T21:38:55.548145] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-01. [2025-09-29T21:38:55.667264] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-29T21:38:56.348167] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-04. [2025-09-29T21:38:57.011462] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-29T21:38:57.148156] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-02. [2025-09-29T21:38:57.613769] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-29T21:38:57.948119] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-02. [2025-09-29T21:38:58.042363] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-29T21:38:58.748130] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-03. [2025-09-29T21:38:58.840136] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-29T21:38:59.337738] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-29T21:38:59.548157] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-05. [2025-09-29T21:39:00.348124] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-02. [2025-09-29T21:39:01.148093] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-04. [2025-09-29T21:39:01.365926] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-29T21:39:01.517265] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-29T21:39:01.953794] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-03. [2025-09-29T21:39:01.955535] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-29T21:39:02.585706] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-29T21:39:02.748153] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-06. [2025-09-29T21:39:03.548134] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-03. [2025-09-29T21:39:04.341908] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-29T21:39:04.350194] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-04. [2025-09-29T21:39:05.148151] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-07. [2025-09-29T21:39:05.218320] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-29T21:39:05.417562] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-29T21:39:05.948174] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-04. [2025-09-29T21:39:06.739168] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-29T21:39:06.749001] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-05. [2025-09-29T21:39:07.293464] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-29T21:39:07.548148] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-05. [2025-09-29T21:39:07.802877] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-29T21:39:08.348139] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-06. [2025-09-29T21:39:08.714403] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-29T21:39:09.148105] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-08. [2025-09-29T21:39:09.321590] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-29T21:39:09.948122] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-05. [2025-09-29T21:39:10.421335] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-29T21:39:10.748122] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-06. [2025-09-29T21:39:10.765461] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-29T21:39:11.548128] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-06. [2025-09-29T21:39:12.348121] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-09. [2025-09-29T21:39:12.441267] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-29T21:39:12.560908] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-29T21:39:13.148105] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-07. [2025-09-29T21:39:13.904318] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-29T21:39:13.913940] [INFO ] [REMOTE ] UGP: Full fetch complete (62152 records). [2025-09-29T21:39:13.914108] [DEBUG] [VALIDATOR ] UGP: Validating primary data. [2025-09-29T21:39:13.953215] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-07. [2025-09-29T21:39:14.036158] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-29T21:39:14.348480] [DEBUG] [VALIDATOR ] UGP: All expected trading days are present. [2025-09-29T21:39:14.348623] [DEBUG] [VALIDATOR ] UGP: Primary data validation passed. [2025-09-29T21:39:14.350253] [INFO ] [MAIN ] UGP: Fetched primary data is valid. [2025-09-29T21:39:14.350351] [DEBUG] [LOCAL ] UGP: Saving primary data. [2025-09-29T21:39:14.351771] [DEBUG] [LOCAL ] UGP: Trimmed 62152 records to 42809 (keeping 200 days of data) [2025-09-29T21:39:14.612908] [DEBUG] [LOCAL ] UGP: Primary data saved (42809 records). [2025-09-29T21:39:14.613040] [INFO ] [MAIN ] UGP: Full history saved. [2025-09-29T21:39:14.613174] [INFO ] [MAIN ] Update Progress: 2176/2371 symbols completed. UGP took 36.6s. Estimated remaining: 25m 1s. Rate: 7.8 symbols/min [2025-09-29T21:39:14.756711] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-08. [2025-09-29T21:39:14.792033] [INFO ] [MAIN ] UI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:39:14.808813] [DEBUG] [LOCAL ] UI: Loaded 13008 existing records from primary storage. [2025-09-29T21:39:14.809098] [INFO ] [MAIN ] UI: Loaded 13008 existing records. [2025-09-29T21:39:14.990477] [WARN ] [MAIN ] UI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:39:14.990712] [INFO ] [MAIN ] UI: Wiping existing primary data before full refresh. [2025-09-29T21:39:14.990770] [INFO ] [LOCAL ] UI: Starting deletion of primary data. [2025-09-29T21:39:14.991000] [DEBUG] [LOCAL ] UI: Deleted primary data file. [2025-09-29T21:39:14.991059] [INFO ] [MAIN ] UI: Starting full primary refresh. [2025-09-29T21:39:15.392105] [INFO ] [REMOTE ] UI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:39:15.548083] [INFO ] [REMOTE ] UI: Fetching primary data for 2024-12. [2025-09-29T21:39:15.596555] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-29T21:39:15.616125] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-29T21:39:16.348095] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-08. [2025-09-29T21:39:16.405806] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-29T21:39:17.044573] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-29T21:39:17.148126] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-07. [2025-09-29T21:39:17.948142] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-09. [2025-09-29T21:39:18.157585] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-29T21:39:18.511703] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-29T21:39:18.514528] [INFO ] [REMOTE ] UHT: Full fetch complete (15168 records). [2025-09-29T21:39:18.514614] [DEBUG] [VALIDATOR ] UHT: Validating primary data. [2025-09-29T21:39:18.753336] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-08. [2025-09-29T21:39:18.968234] [DEBUG] [VALIDATOR ] UHT: All expected trading days are present. [2025-09-29T21:39:18.968301] [DEBUG] [VALIDATOR ] UHT: Primary data validation passed. [2025-09-29T21:39:18.968702] [INFO ] [MAIN ] UHT: Fetched primary data is valid. [2025-09-29T21:39:18.968765] [DEBUG] [LOCAL ] UHT: Saving primary data. [2025-09-29T21:39:18.969327] [DEBUG] [LOCAL ] UHT: Trimmed 15168 records to 9973 (keeping 200 days of data) [2025-09-29T21:39:19.033687] [DEBUG] [LOCAL ] UHT: Primary data saved (9973 records). [2025-09-29T21:39:19.033835] [INFO ] [MAIN ] UHT: Full history saved. [2025-09-29T21:39:19.033922] [INFO ] [MAIN ] Update Progress: 2177/2371 symbols completed. UHT took 26.0s. Estimated remaining: 24m 53s. Rate: 7.8 symbols/min [2025-09-29T21:39:19.207429] [INFO ] [MAIN ] UIS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:39:19.252179] [DEBUG] [LOCAL ] UIS: Loaded 37552 existing records from primary storage. [2025-09-29T21:39:19.252548] [INFO ] [MAIN ] UIS: Loaded 37552 existing records. [2025-09-29T21:39:19.436667] [WARN ] [MAIN ] UIS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:39:19.436893] [INFO ] [MAIN ] UIS: Wiping existing primary data before full refresh. [2025-09-29T21:39:19.436942] [INFO ] [LOCAL ] UIS: Starting deletion of primary data. [2025-09-29T21:39:19.437285] [DEBUG] [LOCAL ] UIS: Deleted primary data file. [2025-09-29T21:39:19.437368] [INFO ] [MAIN ] UIS: Starting full primary refresh. [2025-09-29T21:39:19.553157] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-09. [2025-09-29T21:39:19.826750] [INFO ] [REMOTE ] UIS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:39:19.852975] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-29T21:39:20.348181] [INFO ] [REMOTE ] UIS: Fetching primary data for 2024-12. [2025-09-29T21:39:21.005234] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-29T21:39:21.014357] [INFO ] [REMOTE ] UHS: Full fetch complete (58264 records). [2025-09-29T21:39:21.014518] [DEBUG] [VALIDATOR ] UHS: Validating primary data. [2025-09-29T21:39:21.153335] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-01. [2025-09-29T21:39:21.435702] [DEBUG] [VALIDATOR ] UHS: All expected trading days are present. [2025-09-29T21:39:21.435903] [DEBUG] [VALIDATOR ] UHS: Primary data validation passed. [2025-09-29T21:39:21.437225] [INFO ] [MAIN ] UHS: Fetched primary data is valid. [2025-09-29T21:39:21.437337] [DEBUG] [LOCAL ] UHS: Saving primary data. [2025-09-29T21:39:21.460733] [DEBUG] [LOCAL ] UHS: Trimmed 58264 records to 40961 (keeping 200 days of data) [2025-09-29T21:39:21.461562] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-29T21:39:21.749705] [DEBUG] [LOCAL ] UHS: Primary data saved (40961 records). [2025-09-29T21:39:21.749842] [INFO ] [MAIN ] UHS: Full history saved. [2025-09-29T21:39:21.749929] [INFO ] [MAIN ] Update Progress: 2178/2371 symbols completed. UHS took 31.3s. Estimated remaining: 24m 45s. Rate: 7.8 symbols/min [2025-09-29T21:39:21.940636] [INFO ] [MAIN ] UL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:39:21.948162] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-09. [2025-09-29T21:39:22.002964] [DEBUG] [LOCAL ] UL: Loaded 53843 existing records from primary storage. [2025-09-29T21:39:22.003294] [INFO ] [MAIN ] UL: Loaded 53843 existing records. [2025-09-29T21:39:22.200426] [WARN ] [MAIN ] UL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:39:22.200757] [INFO ] [MAIN ] UL: Wiping existing primary data before full refresh. [2025-09-29T21:39:22.208947] [INFO ] [LOCAL ] UL: Starting deletion of primary data. [2025-09-29T21:39:22.209992] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-29T21:39:22.212766] [DEBUG] [LOCAL ] UL: Deleted primary data file. [2025-09-29T21:39:22.213588] [INFO ] [MAIN ] UL: Starting full primary refresh. [2025-09-29T21:39:22.580376] [INFO ] [REMOTE ] UL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:39:22.748090] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-02. [2025-09-29T21:39:23.076814] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-29T21:39:23.081743] [INFO ] [REMOTE ] UHAL: Full fetch complete (23179 records). [2025-09-29T21:39:23.081836] [DEBUG] [VALIDATOR ] UHAL: Validating primary data. [2025-09-29T21:39:23.500683] [DEBUG] [VALIDATOR ] UHAL: All expected trading days are present. [2025-09-29T21:39:23.500785] [DEBUG] [VALIDATOR ] UHAL: Primary data validation passed. [2025-09-29T21:39:23.501367] [INFO ] [MAIN ] UHAL: Fetched primary data is valid. [2025-09-29T21:39:23.501410] [DEBUG] [LOCAL ] UHAL: Saving primary data. [2025-09-29T21:39:23.502186] [DEBUG] [LOCAL ] UHAL: Trimmed 23179 records to 16542 (keeping 200 days of data) [2025-09-29T21:39:23.553525] [INFO ] [REMOTE ] UL: Fetching primary data for 2024-12. [2025-09-29T21:39:23.621822] [DEBUG] [LOCAL ] UHAL: Primary data saved (16542 records). [2025-09-29T21:39:23.621974] [INFO ] [MAIN ] UHAL: Full history saved. [2025-09-29T21:39:23.622121] [INFO ] [MAIN ] Update Progress: 2179/2371 symbols completed. UHAL took 39.0s. Estimated remaining: 24m 37s. Rate: 7.8 symbols/min [2025-09-29T21:39:23.818788] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-29T21:39:23.839824] [INFO ] [MAIN ] ULS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:39:23.892024] [DEBUG] [LOCAL ] ULS: Loaded 39769 existing records from primary storage. [2025-09-29T21:39:23.892341] [INFO ] [MAIN ] ULS: Loaded 39769 existing records. [2025-09-29T21:39:24.078123] [WARN ] [MAIN ] ULS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:39:24.078385] [INFO ] [MAIN ] ULS: Wiping existing primary data before full refresh. [2025-09-29T21:39:24.078436] [INFO ] [LOCAL ] ULS: Starting deletion of primary data. [2025-09-29T21:39:24.078697] [DEBUG] [LOCAL ] ULS: Deleted primary data file. [2025-09-29T21:39:24.078757] [INFO ] [MAIN ] ULS: Starting full primary refresh. [2025-09-29T21:39:24.353250] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-01. [2025-09-29T21:39:24.457735] [INFO ] [REMOTE ] ULS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:39:25.148100] [INFO ] [REMOTE ] ULS: Fetching primary data for 2024-12. [2025-09-29T21:39:25.376258] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-29T21:39:25.693596] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-29T21:39:25.948119] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-03. [2025-09-29T21:39:26.649002] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-29T21:39:26.665505] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-29T21:39:26.748117] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-01. [2025-09-29T21:39:27.548121] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-04. [2025-09-29T21:39:28.348089] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-02. [2025-09-29T21:39:28.507574] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-29T21:39:28.564248] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-29T21:39:29.148122] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-05. [2025-09-29T21:39:29.643711] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-29T21:39:29.948099] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-03. [2025-09-29T21:39:30.146741] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-29T21:39:30.748093] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-01. [2025-09-29T21:39:31.394706] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-29T21:39:31.548119] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-04. [2025-09-29T21:39:32.069461] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-29T21:39:32.348113] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-02. [2025-09-29T21:39:33.154336] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-02. [2025-09-29T21:39:33.159387] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-29T21:39:33.767103] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-29T21:39:33.948112] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-06. [2025-09-29T21:39:34.748081] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-03. [2025-09-29T21:39:34.834030] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-29T21:39:34.920302] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-29T21:39:35.548120] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-03. [2025-09-29T21:39:36.292310] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-29T21:39:36.348126] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-07. [2025-09-29T21:39:37.148114] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-05. [2025-09-29T21:39:37.210437] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-29T21:39:37.463939] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-29T21:39:37.948117] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-04. [2025-09-29T21:39:38.342023] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-29T21:39:38.748161] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-04. [2025-09-29T21:39:39.548180] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-06. [2025-09-29T21:39:39.968023] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-29T21:39:40.348131] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-05. [2025-09-29T21:39:40.379853] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-29T21:39:40.610565] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-29T21:39:41.148142] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-05. [2025-09-29T21:39:41.948166] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-08. [2025-09-29T21:39:42.375376] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-29T21:39:42.757344] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-06. [2025-09-29T21:39:42.762769] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-29T21:39:43.161959] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-29T21:39:43.548166] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-06. [2025-09-29T21:39:44.348165] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-07. [2025-09-29T21:39:44.616149] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-29T21:39:44.925627] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-29T21:39:45.148144] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-09. [2025-09-29T21:39:45.349374] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-29T21:39:45.948112] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-07. [2025-09-29T21:39:46.354101] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-29T21:39:46.358036] [INFO ] [REMOTE ] UI: Full fetch complete (18279 records). [2025-09-29T21:39:46.358129] [DEBUG] [VALIDATOR ] UI: Validating primary data. [2025-09-29T21:39:46.748460] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-07. [2025-09-29T21:39:46.748966] [DEBUG] [VALIDATOR ] UI: All expected trading days are present. [2025-09-29T21:39:46.749302] [DEBUG] [VALIDATOR ] UI: Primary data validation passed. [2025-09-29T21:39:46.750594] [INFO ] [MAIN ] UI: Fetched primary data is valid. [2025-09-29T21:39:46.750690] [DEBUG] [LOCAL ] UI: Saving primary data. [2025-09-29T21:39:46.751430] [DEBUG] [LOCAL ] UI: Trimmed 18279 records to 12807 (keeping 200 days of data) [2025-09-29T21:39:46.839142] [DEBUG] [LOCAL ] UI: Primary data saved (12807 records). [2025-09-29T21:39:46.839327] [INFO ] [MAIN ] UI: Full history saved. [2025-09-29T21:39:46.839427] [INFO ] [MAIN ] Update Progress: 2180/2371 symbols completed. UI took 32.2s. Estimated remaining: 24m 31s. Rate: 7.8 symbols/min [2025-09-29T21:39:47.016354] [INFO ] [MAIN ] UMC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:39:47.073439] [DEBUG] [LOCAL ] UMC: Loaded 53490 existing records from primary storage. [2025-09-29T21:39:47.073993] [INFO ] [MAIN ] UMC: Loaded 53490 existing records. [2025-09-29T21:39:47.283845] [WARN ] [MAIN ] UMC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:39:47.284091] [INFO ] [MAIN ] UMC: Wiping existing primary data before full refresh. [2025-09-29T21:39:47.284144] [INFO ] [LOCAL ] UMC: Starting deletion of primary data. [2025-09-29T21:39:47.284756] [DEBUG] [LOCAL ] UMC: Deleted primary data file. [2025-09-29T21:39:47.284821] [INFO ] [MAIN ] UMC: Starting full primary refresh. [2025-09-29T21:39:47.548200] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-08. [2025-09-29T21:39:47.674321] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-29T21:39:47.695825] [INFO ] [REMOTE ] UMC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:39:48.348098] [INFO ] [REMOTE ] UMC: Fetching primary data for 2024-12. [2025-09-29T21:39:48.742771] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-29T21:39:49.122980] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-29T21:39:49.148071] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-09. [2025-09-29T21:39:49.948112] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-08. [2025-09-29T21:39:49.997218] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-29T21:39:50.490602] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-29T21:39:50.498368] [INFO ] [REMOTE ] UIS: Full fetch complete (51757 records). [2025-09-29T21:39:50.498580] [DEBUG] [VALIDATOR ] UIS: Validating primary data. [2025-09-29T21:39:50.760393] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-01. [2025-09-29T21:39:50.907183] [DEBUG] [VALIDATOR ] UIS: All expected trading days are present. [2025-09-29T21:39:50.907315] [DEBUG] [VALIDATOR ] UIS: Primary data validation passed. [2025-09-29T21:39:50.908447] [INFO ] [MAIN ] UIS: Fetched primary data is valid. [2025-09-29T21:39:50.908514] [DEBUG] [LOCAL ] UIS: Saving primary data. [2025-09-29T21:39:50.909773] [DEBUG] [LOCAL ] UIS: Trimmed 51757 records to 36931 (keeping 200 days of data) [2025-09-29T21:39:51.135304] [DEBUG] [LOCAL ] UIS: Primary data saved (36931 records). [2025-09-29T21:39:51.135448] [INFO ] [MAIN ] UIS: Full history saved. [2025-09-29T21:39:51.135563] [INFO ] [MAIN ] Update Progress: 2181/2371 symbols completed. UIS took 32.1s. Estimated remaining: 24m 23s. Rate: 7.8 symbols/min [2025-09-29T21:39:51.351101] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-29T21:39:51.352850] [INFO ] [MAIN ] UMH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:39:51.401741] [DEBUG] [LOCAL ] UMH: Loaded 34078 existing records from primary storage. [2025-09-29T21:39:51.402053] [INFO ] [MAIN ] UMH: Loaded 34078 existing records. [2025-09-29T21:39:51.558167] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-09. [2025-09-29T21:39:51.589058] [WARN ] [MAIN ] UMH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:39:51.589974] [INFO ] [MAIN ] UMH: Wiping existing primary data before full refresh. [2025-09-29T21:39:51.590024] [INFO ] [LOCAL ] UMH: Starting deletion of primary data. [2025-09-29T21:39:51.590447] [DEBUG] [LOCAL ] UMH: Deleted primary data file. [2025-09-29T21:39:51.590506] [INFO ] [MAIN ] UMH: Starting full primary refresh. [2025-09-29T21:39:51.974414] [INFO ] [REMOTE ] UMH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:39:52.348089] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-08. [2025-09-29T21:39:52.697019] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-29T21:39:53.136013] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-29T21:39:53.143781] [INFO ] [REMOTE ] ULS: Full fetch complete (54353 records). [2025-09-29T21:39:53.143917] [DEBUG] [VALIDATOR ] ULS: Validating primary data. [2025-09-29T21:39:53.156022] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-02. [2025-09-29T21:39:53.554921] [DEBUG] [VALIDATOR ] ULS: All expected trading days are present. [2025-09-29T21:39:53.555015] [DEBUG] [VALIDATOR ] ULS: Primary data validation passed. [2025-09-29T21:39:53.556087] [INFO ] [MAIN ] ULS: Fetched primary data is valid. [2025-09-29T21:39:53.556151] [DEBUG] [LOCAL ] ULS: Saving primary data. [2025-09-29T21:39:53.557524] [DEBUG] [LOCAL ] ULS: Trimmed 54353 records to 39257 (keeping 200 days of data) [2025-09-29T21:39:53.813008] [DEBUG] [LOCAL ] ULS: Primary data saved (39257 records). [2025-09-29T21:39:53.813186] [INFO ] [MAIN ] ULS: Full history saved. [2025-09-29T21:39:53.813308] [INFO ] [MAIN ] Update Progress: 2182/2371 symbols completed. ULS took 30.2s. Estimated remaining: 24m 14s. Rate: 7.8 symbols/min [2025-09-29T21:39:53.958166] [INFO ] [REMOTE ] UMH: Fetching primary data for 2024-12. [2025-09-29T21:39:53.992552] [INFO ] [MAIN ] UNF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:39:54.009132] [DEBUG] [LOCAL ] UNF: Loaded 12048 existing records from primary storage. [2025-09-29T21:39:54.009423] [INFO ] [MAIN ] UNF: Loaded 12048 existing records. [2025-09-29T21:39:54.197242] [WARN ] [MAIN ] UNF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:39:54.197477] [INFO ] [MAIN ] UNF: Wiping existing primary data before full refresh. [2025-09-29T21:39:54.197543] [INFO ] [LOCAL ] UNF: Starting deletion of primary data. [2025-09-29T21:39:54.197923] [DEBUG] [LOCAL ] UNF: Deleted primary data file. [2025-09-29T21:39:54.197994] [INFO ] [MAIN ] UNF: Starting full primary refresh. [2025-09-29T21:39:54.532048] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-29T21:39:54.651110] [INFO ] [REMOTE ] UNF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:39:54.748166] [INFO ] [REMOTE ] UNF: Fetching primary data for 2024-12. [2025-09-29T21:39:55.094561] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-29T21:39:55.408759] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-29T21:39:55.548111] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-03. [2025-09-29T21:39:55.609915] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-29T21:39:56.348102] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-09. [2025-09-29T21:39:57.148099] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-01. [2025-09-29T21:39:57.658387] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-29T21:39:57.948097] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-04. [2025-09-29T21:39:58.197285] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-29T21:39:58.208501] [INFO ] [REMOTE ] UL: Full fetch complete (76874 records). [2025-09-29T21:39:58.208705] [DEBUG] [VALIDATOR ] UL: Validating primary data. [2025-09-29T21:39:58.565326] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-29T21:39:58.658386] [DEBUG] [VALIDATOR ] UL: All expected trading days are present. [2025-09-29T21:39:58.658501] [DEBUG] [VALIDATOR ] UL: Primary data validation passed. [2025-09-29T21:39:58.659916] [INFO ] [MAIN ] UL: Fetched primary data is valid. [2025-09-29T21:39:58.659988] [DEBUG] [LOCAL ] UL: Saving primary data. [2025-09-29T21:39:58.661606] [DEBUG] [LOCAL ] UL: Trimmed 76874 records to 53060 (keeping 200 days of data) [2025-09-29T21:39:58.754349] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-02. [2025-09-29T21:39:59.019897] [DEBUG] [LOCAL ] UL: Primary data saved (53060 records). [2025-09-29T21:39:59.020209] [INFO ] [MAIN ] UL: Full history saved. [2025-09-29T21:39:59.020467] [INFO ] [MAIN ] Update Progress: 2183/2371 symbols completed. UL took 37.3s. Estimated remaining: 24m 6s. Rate: 7.8 symbols/min [2025-09-29T21:39:59.207501] [INFO ] [MAIN ] UNFI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:39:59.255958] [DEBUG] [LOCAL ] UNFI: Loaded 42528 existing records from primary storage. [2025-09-29T21:39:59.256327] [INFO ] [MAIN ] UNFI: Loaded 42528 existing records. [2025-09-29T21:39:59.449743] [WARN ] [MAIN ] UNFI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:39:59.450229] [INFO ] [MAIN ] UNFI: Wiping existing primary data before full refresh. [2025-09-29T21:39:59.450300] [INFO ] [LOCAL ] UNFI: Starting deletion of primary data. [2025-09-29T21:39:59.450799] [DEBUG] [LOCAL ] UNFI: Deleted primary data file. [2025-09-29T21:39:59.450870] [INFO ] [MAIN ] UNFI: Starting full primary refresh. [2025-09-29T21:39:59.553720] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-01. [2025-09-29T21:39:59.864090] [INFO ] [REMOTE ] UNFI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:39:59.896076] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-29T21:39:59.941867] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-29T21:40:00.348233] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-03. [2025-09-29T21:40:00.738578] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-29T21:40:01.148109] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-02. [2025-09-29T21:40:01.745202] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-29T21:40:01.948169] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2024-12. [2025-09-29T21:40:01.983466] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-29T21:40:02.748135] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-03. [2025-09-29T21:40:03.539056] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-29T21:40:03.547995] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-01. [2025-09-29T21:40:03.742583] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-29T21:40:04.348147] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-04. [2025-09-29T21:40:05.057836] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-29T21:40:05.148135] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-04. [2025-09-29T21:40:05.427872] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-29T21:40:05.948130] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-05. [2025-09-29T21:40:06.311947] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-29T21:40:06.748129] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-05. [2025-09-29T21:40:06.757817] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-29T21:40:07.548146] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-05. [2025-09-29T21:40:08.015024] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-29T21:40:08.348117] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-06. [2025-09-29T21:40:09.148106] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-06. [2025-09-29T21:40:09.390147] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-29T21:40:09.826743] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-29T21:40:09.948087] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-07. [2025-09-29T21:40:10.026792] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-29T21:40:10.748141] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-02. [2025-09-29T21:40:11.316706] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-29T21:40:11.548107] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-08. [2025-09-29T21:40:12.245271] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-29T21:40:12.348120] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-03. [2025-09-29T21:40:13.062813] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-29T21:40:13.148102] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-09. [2025-09-29T21:40:13.954174] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-06. [2025-09-29T21:40:13.957359] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-29T21:40:14.639055] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-29T21:40:14.647166] [INFO ] [REMOTE ] UMH: Full fetch complete (46628 records). [2025-09-29T21:40:14.647278] [DEBUG] [VALIDATOR ] UMH: Validating primary data. [2025-09-29T21:40:14.751683] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-04. [2025-09-29T21:40:15.045081] [DEBUG] [VALIDATOR ] UMH: All expected trading days are present. [2025-09-29T21:40:15.045220] [DEBUG] [VALIDATOR ] UMH: Primary data validation passed. [2025-09-29T21:40:15.046416] [INFO ] [MAIN ] UMH: Fetched primary data is valid. [2025-09-29T21:40:15.046502] [DEBUG] [LOCAL ] UMH: Saving primary data. [2025-09-29T21:40:15.048125] [DEBUG] [LOCAL ] UMH: Trimmed 46628 records to 33623 (keeping 200 days of data) [2025-09-29T21:40:15.269842] [DEBUG] [LOCAL ] UMH: Primary data saved (33623 records). [2025-09-29T21:40:15.269985] [INFO ] [MAIN ] UMH: Full history saved. [2025-09-29T21:40:15.270106] [INFO ] [MAIN ] Update Progress: 2184/2371 symbols completed. UMH took 24.1s. Estimated remaining: 23m 60s. Rate: 7.8 symbols/min [2025-09-29T21:40:15.531853] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-29T21:40:15.533595] [INFO ] [MAIN ] UNH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:40:15.548078] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-07. [2025-09-29T21:40:15.605158] [DEBUG] [LOCAL ] UNH: Loaded 54574 existing records from primary storage. [2025-09-29T21:40:15.605518] [INFO ] [MAIN ] UNH: Loaded 54574 existing records. [2025-09-29T21:40:15.788119] [WARN ] [MAIN ] UNH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:40:15.788347] [INFO ] [MAIN ] UNH: Wiping existing primary data before full refresh. [2025-09-29T21:40:15.788417] [INFO ] [LOCAL ] UNH: Starting deletion of primary data. [2025-09-29T21:40:15.789225] [DEBUG] [LOCAL ] UNH: Deleted primary data file. [2025-09-29T21:40:15.789290] [INFO ] [MAIN ] UNH: Starting full primary refresh. [2025-09-29T21:40:16.181083] [INFO ] [REMOTE ] UNH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:40:16.228150] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-29T21:40:16.348073] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-05. [2025-09-29T21:40:16.563888] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-29T21:40:17.148129] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-08. [2025-09-29T21:40:17.665871] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-29T21:40:17.744244] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-29T21:40:17.948144] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-07. [2025-09-29T21:40:18.748132] [INFO ] [REMOTE ] UNH: Fetching primary data for 2024-12. [2025-09-29T21:40:19.548122] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-09. [2025-09-29T21:40:19.710952] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-29T21:40:20.346914] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-29T21:40:20.349592] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-06. [2025-09-29T21:40:20.351281] [INFO ] [REMOTE ] UNF: Full fetch complete (17244 records). [2025-09-29T21:40:20.351407] [DEBUG] [VALIDATOR ] UNF: Validating primary data. [2025-09-29T21:40:20.742404] [DEBUG] [VALIDATOR ] UNF: All expected trading days are present. [2025-09-29T21:40:20.742525] [DEBUG] [VALIDATOR ] UNF: Primary data validation passed. [2025-09-29T21:40:20.743064] [INFO ] [MAIN ] UNF: Fetched primary data is valid. [2025-09-29T21:40:20.743134] [DEBUG] [LOCAL ] UNF: Saving primary data. [2025-09-29T21:40:20.743823] [DEBUG] [LOCAL ] UNF: Trimmed 17244 records to 11964 (keeping 200 days of data) [2025-09-29T21:40:20.824280] [DEBUG] [LOCAL ] UNF: Primary data saved (11964 records). [2025-09-29T21:40:20.824472] [INFO ] [MAIN ] UNF: Full history saved. [2025-09-29T21:40:20.824587] [INFO ] [MAIN ] Update Progress: 2185/2371 symbols completed. UNF took 27.0s. Estimated remaining: 23m 52s. Rate: 7.8 symbols/min [2025-09-29T21:40:21.005966] [INFO ] [MAIN ] UNM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:40:21.067250] [DEBUG] [LOCAL ] UNM: Loaded 49368 existing records from primary storage. [2025-09-29T21:40:21.067577] [INFO ] [MAIN ] UNM: Loaded 49368 existing records. [2025-09-29T21:40:21.149540] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-08. [2025-09-29T21:40:21.262160] [WARN ] [MAIN ] UNM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:40:21.262474] [INFO ] [MAIN ] UNM: Wiping existing primary data before full refresh. [2025-09-29T21:40:21.262614] [INFO ] [LOCAL ] UNM: Starting deletion of primary data. [2025-09-29T21:40:21.263163] [DEBUG] [LOCAL ] UNM: Deleted primary data file. [2025-09-29T21:40:21.278557] [INFO ] [MAIN ] UNM: Starting full primary refresh. [2025-09-29T21:40:21.380512] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2024-12 (2.63 seconds). [2025-09-29T21:40:21.689010] [INFO ] [REMOTE ] UNM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:40:21.951245] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-01. [2025-09-29T21:40:21.956449] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-29T21:40:22.748087] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-07. [2025-09-29T21:40:22.965557] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-29T21:40:23.548159] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-09. [2025-09-29T21:40:24.212021] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-09-29T21:40:24.348093] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-02. [2025-09-29T21:40:24.447876] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-29T21:40:25.148083] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-08. [2025-09-29T21:40:25.429743] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-29T21:40:25.441016] [INFO ] [REMOTE ] UMC: Full fetch complete (76586 records). [2025-09-29T21:40:25.441174] [DEBUG] [VALIDATOR ] UMC: Validating primary data. [2025-09-29T21:40:25.851085] [DEBUG] [VALIDATOR ] UMC: All expected trading days are present. [2025-09-29T21:40:25.851179] [DEBUG] [VALIDATOR ] UMC: Primary data validation passed. [2025-09-29T21:40:25.852449] [INFO ] [MAIN ] UMC: Fetched primary data is valid. [2025-09-29T21:40:25.852526] [DEBUG] [LOCAL ] UMC: Saving primary data. [2025-09-29T21:40:25.854183] [DEBUG] [LOCAL ] UMC: Trimmed 76586 records to 52708 (keeping 200 days of data) [2025-09-29T21:40:25.954509] [INFO ] [REMOTE ] UNM: Fetching primary data for 2024-12. [2025-09-29T21:40:26.182379] [DEBUG] [LOCAL ] UMC: Primary data saved (52708 records). [2025-09-29T21:40:26.182536] [INFO ] [MAIN ] UMC: Full history saved. [2025-09-29T21:40:26.182668] [INFO ] [MAIN ] Update Progress: 2186/2371 symbols completed. UMC took 39.3s. Estimated remaining: 23m 44s. Rate: 7.8 symbols/min [2025-09-29T21:40:26.379859] [INFO ] [MAIN ] UNMA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:40:26.408021] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-29T21:40:26.419726] [DEBUG] [LOCAL ] UNMA: Loaded 3627 existing records from primary storage. [2025-09-29T21:40:26.420968] [INFO ] [MAIN ] UNMA: Loaded 3627 existing records. [2025-09-29T21:40:26.618878] [WARN ] [MAIN ] UNMA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:40:26.619278] [INFO ] [MAIN ] UNMA: Wiping existing primary data before full refresh. [2025-09-29T21:40:26.619394] [INFO ] [LOCAL ] UNMA: Starting deletion of primary data. [2025-09-29T21:40:26.619873] [DEBUG] [LOCAL ] UNMA: Deleted primary data file. [2025-09-29T21:40:26.629608] [INFO ] [MAIN ] UNMA: Starting full primary refresh. [2025-09-29T21:40:26.736602] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-09-29T21:40:26.755844] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-09. [2025-09-29T21:40:27.083907] [INFO ] [REMOTE ] UNMA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:40:27.555885] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-03. [2025-09-29T21:40:27.562009] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-29T21:40:27.929148] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-29T21:40:27.938329] [INFO ] [REMOTE ] UNFI: Full fetch complete (59110 records). [2025-09-29T21:40:27.938480] [DEBUG] [VALIDATOR ] UNFI: Validating primary data. [2025-09-29T21:40:28.352929] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2024-12. [2025-09-29T21:40:28.354287] [DEBUG] [VALIDATOR ] UNFI: All expected trading days are present. [2025-09-29T21:40:28.354399] [DEBUG] [VALIDATOR ] UNFI: Primary data validation passed. [2025-09-29T21:40:28.355732] [INFO ] [MAIN ] UNFI: Fetched primary data is valid. [2025-09-29T21:40:28.355899] [DEBUG] [LOCAL ] UNFI: Saving primary data. [2025-09-29T21:40:28.357219] [DEBUG] [LOCAL ] UNFI: Trimmed 59110 records to 41830 (keeping 200 days of data) [2025-09-29T21:40:28.616832] [DEBUG] [LOCAL ] UNFI: Primary data saved (41830 records). [2025-09-29T21:40:28.616988] [INFO ] [MAIN ] UNFI: Full history saved. [2025-09-29T21:40:28.617091] [INFO ] [MAIN ] Update Progress: 2187/2371 symbols completed. UNFI took 29.6s. Estimated remaining: 23m 36s. Rate: 7.8 symbols/min [2025-09-29T21:40:28.810215] [INFO ] [MAIN ] UNP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:40:28.868617] [DEBUG] [LOCAL ] UNP: Loaded 54030 existing records from primary storage. [2025-09-29T21:40:28.868976] [INFO ] [MAIN ] UNP: Loaded 54030 existing records. [2025-09-29T21:40:29.075439] [WARN ] [MAIN ] UNP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:40:29.076453] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-29T21:40:29.076738] [INFO ] [MAIN ] UNP: Wiping existing primary data before full refresh. [2025-09-29T21:40:29.079033] [INFO ] [LOCAL ] UNP: Starting deletion of primary data. [2025-09-29T21:40:29.079492] [DEBUG] [LOCAL ] UNP: Deleted primary data file. [2025-09-29T21:40:29.079553] [INFO ] [MAIN ] UNP: Starting full primary refresh. [2025-09-29T21:40:29.153263] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-01. [2025-09-29T21:40:29.478437] [INFO ] [REMOTE ] UNP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:40:29.759485] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-29T21:40:29.948113] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-04. [2025-09-29T21:40:30.748091] [INFO ] [REMOTE ] UNP: Fetching primary data for 2024-12. [2025-09-29T21:40:30.843185] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-29T21:40:31.548133] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-01. [2025-09-29T21:40:32.147339] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-29T21:40:32.266258] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-29T21:40:32.348136] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-02. [2025-09-29T21:40:32.490460] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-04 (2.54 seconds). [2025-09-29T21:40:33.148125] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-01. [2025-09-29T21:40:33.601454] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-29T21:40:33.948111] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-02. [2025-09-29T21:40:34.551432] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-29T21:40:34.631687] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-29T21:40:34.748098] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-03. [2025-09-29T21:40:35.548205] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-05. [2025-09-29T21:40:36.087764] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-29T21:40:36.348128] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-04. [2025-09-29T21:40:37.148122] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-02. [2025-09-29T21:40:37.948135] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-03. [2025-09-29T21:40:38.235141] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-29T21:40:38.350279] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-05 (2.80 seconds). [2025-09-29T21:40:38.560232] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-29T21:40:38.748089] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-04. [2025-09-29T21:40:38.894096] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-29T21:40:39.087369] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-29T21:40:39.548153] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-05. [2025-09-29T21:40:40.053456] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-29T21:40:40.348132] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-05. [2025-09-29T21:40:41.148153] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-06. [2025-09-29T21:40:41.948101] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-06. [2025-09-29T21:40:42.084615] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-29T21:40:42.513971] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-29T21:40:42.748130] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-07. [2025-09-29T21:40:43.358569] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-29T21:40:43.548116] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-03. [2025-09-29T21:40:43.698454] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-06 (2.55 seconds). [2025-09-29T21:40:44.348155] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-06. [2025-09-29T21:40:45.148115] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-07. [2025-09-29T21:40:45.526723] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-29T21:40:45.948140] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-08. [2025-09-29T21:40:46.099845] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-29T21:40:46.424541] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-29T21:40:46.748112] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-07. [2025-09-29T21:40:47.548145] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-04. [2025-09-29T21:40:47.672987] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-09-29T21:40:48.114005] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-29T21:40:48.348148] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-08. [2025-09-29T21:40:49.148151] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-09. [2025-09-29T21:40:49.494548] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-29T21:40:49.495929] [INFO ] [REMOTE ] UNMA: Full fetch complete (5787 records). [2025-09-29T21:40:49.496017] [DEBUG] [VALIDATOR ] UNMA: Validating primary data. [2025-09-29T21:40:49.889437] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-29T21:40:49.935085] [DEBUG] [VALIDATOR ] UNMA: All expected trading days are present. [2025-09-29T21:40:49.935236] [DEBUG] [VALIDATOR ] UNMA: Primary data validation passed. [2025-09-29T21:40:49.935783] [INFO ] [MAIN ] UNMA: Fetched primary data is valid. [2025-09-29T21:40:49.935850] [DEBUG] [LOCAL ] UNMA: Saving primary data. [2025-09-29T21:40:49.936310] [DEBUG] [LOCAL ] UNMA: Trimmed 5787 records to 3529 (keeping 200 days of data) [2025-09-29T21:40:49.949099] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-05. [2025-09-29T21:40:49.961960] [DEBUG] [LOCAL ] UNMA: Primary data saved (3529 records). [2025-09-29T21:40:49.962108] [INFO ] [MAIN ] UNMA: Full history saved. [2025-09-29T21:40:49.962222] [INFO ] [MAIN ] Update Progress: 2188/2371 symbols completed. UNMA took 23.8s. Estimated remaining: 23m 29s. Rate: 7.8 symbols/min [2025-09-29T21:40:50.143344] [INFO ] [MAIN ] UP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:40:50.195352] [DEBUG] [LOCAL ] UP: Loaded 43857 existing records from primary storage. [2025-09-29T21:40:50.195714] [INFO ] [MAIN ] UP: Loaded 43857 existing records. [2025-09-29T21:40:50.390406] [WARN ] [MAIN ] UP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:40:50.390639] [INFO ] [MAIN ] UP: Wiping existing primary data before full refresh. [2025-09-29T21:40:50.390724] [INFO ] [LOCAL ] UP: Starting deletion of primary data. [2025-09-29T21:40:50.391025] [DEBUG] [LOCAL ] UP: Deleted primary data file. [2025-09-29T21:40:50.391083] [INFO ] [MAIN ] UP: Starting full primary refresh. [2025-09-29T21:40:50.753269] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-08. [2025-09-29T21:40:50.792894] [INFO ] [REMOTE ] UP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:40:51.222372] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-08 (2.87 seconds). [2025-09-29T21:40:51.548145] [INFO ] [REMOTE ] UP: Fetching primary data for 2024-12. [2025-09-29T21:40:51.758856] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-29T21:40:52.050269] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-29T21:40:52.348159] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-09. [2025-09-29T21:40:52.825171] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-29T21:40:53.157061] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-06. [2025-09-29T21:40:53.163110] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-29T21:40:53.174632] [INFO ] [REMOTE ] UNH: Full fetch complete (77866 records). [2025-09-29T21:40:53.174834] [DEBUG] [VALIDATOR ] UNH: Validating primary data. [2025-09-29T21:40:53.609524] [DEBUG] [VALIDATOR ] UNH: All expected trading days are present. [2025-09-29T21:40:53.609678] [DEBUG] [VALIDATOR ] UNH: Primary data validation passed. [2025-09-29T21:40:53.611099] [INFO ] [MAIN ] UNH: Fetched primary data is valid. [2025-09-29T21:40:53.611173] [DEBUG] [LOCAL ] UNH: Saving primary data. [2025-09-29T21:40:53.612868] [DEBUG] [LOCAL ] UNH: Trimmed 77866 records to 53794 (keeping 200 days of data) [2025-09-29T21:40:53.954337] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-09. [2025-09-29T21:40:53.991262] [DEBUG] [LOCAL ] UNH: Primary data saved (53794 records). [2025-09-29T21:40:53.991451] [INFO ] [MAIN ] UNH: Full history saved. [2025-09-29T21:40:53.991616] [INFO ] [MAIN ] Update Progress: 2189/2371 symbols completed. UNH took 38.7s. Estimated remaining: 23m 21s. Rate: 7.8 symbols/min [2025-09-29T21:40:54.168775] [INFO ] [MAIN ] UPS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:40:54.228093] [DEBUG] [LOCAL ] UPS: Loaded 54490 existing records from primary storage. [2025-09-29T21:40:54.228474] [INFO ] [MAIN ] UPS: Loaded 54490 existing records. [2025-09-29T21:40:54.416081] [WARN ] [MAIN ] UPS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:40:54.416332] [INFO ] [MAIN ] UPS: Wiping existing primary data before full refresh. [2025-09-29T21:40:54.416388] [INFO ] [LOCAL ] UPS: Starting deletion of primary data. [2025-09-29T21:40:54.416992] [DEBUG] [LOCAL ] UPS: Deleted primary data file. [2025-09-29T21:40:54.417055] [INFO ] [MAIN ] UPS: Starting full primary refresh. [2025-09-29T21:40:54.767464] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-01. [2025-09-29T21:40:54.815682] [INFO ] [REMOTE ] UPS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:40:54.891262] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-29T21:40:55.549076] [INFO ] [REMOTE ] UPS: Fetching primary data for 2024-12. [2025-09-29T21:40:55.552186] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-29T21:40:55.563987] [INFO ] [REMOTE ] UNM: Full fetch complete (70075 records). [2025-09-29T21:40:55.564178] [DEBUG] [VALIDATOR ] UNM: Validating primary data. [2025-09-29T21:40:55.987634] [DEBUG] [VALIDATOR ] UNM: All expected trading days are present. [2025-09-29T21:40:55.987748] [DEBUG] [VALIDATOR ] UNM: Primary data validation passed. [2025-09-29T21:40:55.988922] [INFO ] [MAIN ] UNM: Fetched primary data is valid. [2025-09-29T21:40:55.988988] [DEBUG] [LOCAL ] UNM: Saving primary data. [2025-09-29T21:40:55.990545] [DEBUG] [LOCAL ] UNM: Trimmed 70075 records to 48581 (keeping 200 days of data) [2025-09-29T21:40:56.316423] [DEBUG] [LOCAL ] UNM: Primary data saved (48581 records). [2025-09-29T21:40:56.316606] [INFO ] [MAIN ] UNM: Full history saved. [2025-09-29T21:40:56.316803] [INFO ] [MAIN ] Update Progress: 2190/2371 symbols completed. UNM took 35.5s. Estimated remaining: 23m 13s. Rate: 7.8 symbols/min [2025-09-29T21:40:56.362610] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-07. [2025-09-29T21:40:56.530696] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-29T21:40:56.534596] [INFO ] [MAIN ] URI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:40:56.588151] [DEBUG] [LOCAL ] URI: Loaded 36669 existing records from primary storage. [2025-09-29T21:40:56.588457] [INFO ] [MAIN ] URI: Loaded 36669 existing records. [2025-09-29T21:40:56.773960] [WARN ] [MAIN ] URI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:40:56.774199] [INFO ] [MAIN ] URI: Wiping existing primary data before full refresh. [2025-09-29T21:40:56.774248] [INFO ] [LOCAL ] URI: Starting deletion of primary data. [2025-09-29T21:40:56.774922] [DEBUG] [LOCAL ] URI: Deleted primary data file. [2025-09-29T21:40:56.775001] [INFO ] [MAIN ] URI: Starting full primary refresh. [2025-09-29T21:40:57.153247] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-02. [2025-09-29T21:40:57.217968] [INFO ] [REMOTE ] URI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:40:57.743129] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-29T21:40:57.948072] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-01. [2025-09-29T21:40:58.453902] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-29T21:40:58.603323] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-29T21:40:58.748108] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-03. [2025-09-29T21:40:59.548121] [INFO ] [REMOTE ] URI: Fetching primary data for 2024-12. [2025-09-29T21:40:59.848757] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-29T21:41:00.064248] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-29T21:41:00.348191] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-04. [2025-09-29T21:41:01.148117] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-02. [2025-09-29T21:41:01.457198] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-29T21:41:01.796123] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-29T21:41:01.948114] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-05. [2025-09-29T21:41:02.748163] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-08. [2025-09-29T21:41:03.138865] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-29T21:41:03.371199] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-29T21:41:03.548110] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-06. [2025-09-29T21:41:04.348100] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-03. [2025-09-29T21:41:04.731422] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-29T21:41:04.981356] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-29T21:41:05.148162] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-07. [2025-09-29T21:41:05.948079] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-09. [2025-09-29T21:41:06.381951] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-29T21:41:06.421350] [INFO ] [REMOTE ] UNP: Full fetch complete (76921 records). [2025-09-29T21:41:06.421201] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-29T21:41:06.421732] [DEBUG] [VALIDATOR ] UNP: Validating primary data. [2025-09-29T21:41:06.714383] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-09-29T21:41:06.755716] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-08. [2025-09-29T21:41:06.918112] [DEBUG] [VALIDATOR ] UNP: All expected trading days are present. [2025-09-29T21:41:06.918246] [DEBUG] [VALIDATOR ] UNP: Primary data validation passed. [2025-09-29T21:41:06.919700] [INFO ] [MAIN ] UNP: Fetched primary data is valid. [2025-09-29T21:41:06.919777] [DEBUG] [LOCAL ] UNP: Saving primary data. [2025-09-29T21:41:06.921557] [DEBUG] [LOCAL ] UNP: Trimmed 76921 records to 53265 (keeping 200 days of data) [2025-09-29T21:41:07.291425] [DEBUG] [LOCAL ] UNP: Primary data saved (53265 records). [2025-09-29T21:41:07.291574] [INFO ] [MAIN ] UNP: Full history saved. [2025-09-29T21:41:07.291694] [INFO ] [MAIN ] Update Progress: 2191/2371 symbols completed. UNP took 38.7s. Estimated remaining: 23m 5s. Rate: 7.8 symbols/min [2025-09-29T21:41:07.481030] [INFO ] [MAIN ] USA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:41:07.528361] [DEBUG] [LOCAL ] USA: Loaded 36524 existing records from primary storage. [2025-09-29T21:41:07.528743] [INFO ] [MAIN ] USA: Loaded 36524 existing records. [2025-09-29T21:41:07.553299] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-04. [2025-09-29T21:41:07.724594] [WARN ] [MAIN ] USA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:41:07.724853] [INFO ] [MAIN ] USA: Wiping existing primary data before full refresh. [2025-09-29T21:41:07.724912] [INFO ] [LOCAL ] USA: Starting deletion of primary data. [2025-09-29T21:41:07.725448] [DEBUG] [LOCAL ] USA: Deleted primary data file. [2025-09-29T21:41:07.725509] [INFO ] [MAIN ] USA: Starting full primary refresh. [2025-09-29T21:41:08.098337] [INFO ] [REMOTE ] USA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:41:08.157281] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-29T21:41:08.348122] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-09. [2025-09-29T21:41:09.148138] [INFO ] [REMOTE ] USA: Fetching primary data for 2024-12. [2025-09-29T21:41:09.957164] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-01. [2025-09-29T21:41:09.980499] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-09-29T21:41:10.328436] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-29T21:41:10.339973] [INFO ] [REMOTE ] UP: Full fetch complete (62237 records). [2025-09-29T21:41:10.340123] [DEBUG] [VALIDATOR ] UP: Validating primary data. [2025-09-29T21:41:10.724197] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-29T21:41:10.761863] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-01. [2025-09-29T21:41:10.823491] [DEBUG] [VALIDATOR ] UP: All expected trading days are present. [2025-09-29T21:41:10.823622] [DEBUG] [VALIDATOR ] UP: Primary data validation passed. [2025-09-29T21:41:10.825209] [INFO ] [MAIN ] UP: Fetched primary data is valid. [2025-09-29T21:41:10.825285] [DEBUG] [LOCAL ] UP: Saving primary data. [2025-09-29T21:41:10.827545] [DEBUG] [LOCAL ] UP: Trimmed 62237 records to 43110 (keeping 200 days of data) [2025-09-29T21:41:11.092554] [DEBUG] [LOCAL ] UP: Primary data saved (43110 records). [2025-09-29T21:41:11.092773] [INFO ] [MAIN ] UP: Full history saved. [2025-09-29T21:41:11.092902] [INFO ] [MAIN ] Update Progress: 2192/2371 symbols completed. UP took 21.1s. Estimated remaining: 22m 57s. Rate: 7.8 symbols/min [2025-09-29T21:41:11.266847] [INFO ] [MAIN ] USAC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:41:11.292390] [DEBUG] [LOCAL ] USAC: Loaded 23060 existing records from primary storage. [2025-09-29T21:41:11.292759] [INFO ] [MAIN ] USAC: Loaded 23060 existing records. [2025-09-29T21:41:11.485883] [WARN ] [MAIN ] USAC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:41:11.486434] [INFO ] [MAIN ] USAC: Wiping existing primary data before full refresh. [2025-09-29T21:41:11.486518] [INFO ] [LOCAL ] USAC: Starting deletion of primary data. [2025-09-29T21:41:11.486980] [DEBUG] [LOCAL ] USAC: Deleted primary data file. [2025-09-29T21:41:11.487071] [INFO ] [MAIN ] USAC: Starting full primary refresh. [2025-09-29T21:41:11.549145] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-05. [2025-09-29T21:41:11.602126] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-29T21:41:11.910352] [INFO ] [REMOTE ] USAC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:41:11.936119] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-29T21:41:12.348172] [INFO ] [REMOTE ] USAC: Fetching primary data for 2024-12. [2025-09-29T21:41:13.083015] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-29T21:41:13.148077] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-01. [2025-09-29T21:41:13.829412] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-29T21:41:13.948130] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-02. [2025-09-29T21:41:13.983218] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-29T21:41:14.748151] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-02. [2025-09-29T21:41:15.213532] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-29T21:41:15.548128] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-03. [2025-09-29T21:41:16.177921] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-29T21:41:16.348113] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-06. [2025-09-29T21:41:16.630582] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-29T21:41:17.148126] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-03. [2025-09-29T21:41:17.948130] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-02. [2025-09-29T21:41:18.293682] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-29T21:41:18.375200] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-29T21:41:18.748122] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-07. [2025-09-29T21:41:19.176292] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-29T21:41:19.548121] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-04. [2025-09-29T21:41:20.348084] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-03. [2025-09-29T21:41:20.749051] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-29T21:41:20.897602] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-29T21:41:21.148120] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-08. [2025-09-29T21:41:21.948105] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-05. [2025-09-29T21:41:22.025693] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-29T21:41:22.748121] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-04. [2025-09-29T21:41:23.275394] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-29T21:41:23.309858] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-29T21:41:23.548184] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-09. [2025-09-29T21:41:23.986193] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-29T21:41:24.348147] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-06. [2025-09-29T21:41:24.553353] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-29T21:41:24.571372] [INFO ] [REMOTE ] UPS: Full fetch complete (77755 records). [2025-09-29T21:41:24.571592] [DEBUG] [VALIDATOR ] UPS: Validating primary data. [2025-09-29T21:41:25.005568] [DEBUG] [VALIDATOR ] UPS: All expected trading days are present. [2025-09-29T21:41:25.005692] [DEBUG] [VALIDATOR ] UPS: Primary data validation passed. [2025-09-29T21:41:25.007091] [INFO ] [MAIN ] UPS: Fetched primary data is valid. [2025-09-29T21:41:25.007160] [DEBUG] [LOCAL ] UPS: Saving primary data. [2025-09-29T21:41:25.008746] [DEBUG] [LOCAL ] UPS: Trimmed 77755 records to 53711 (keeping 200 days of data) [2025-09-29T21:41:25.149722] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-04. [2025-09-29T21:41:25.379146] [DEBUG] [LOCAL ] UPS: Primary data saved (53711 records). [2025-09-29T21:41:25.379295] [INFO ] [MAIN ] UPS: Full history saved. [2025-09-29T21:41:25.379380] [INFO ] [MAIN ] Update Progress: 2193/2371 symbols completed. UPS took 31.4s. Estimated remaining: 22m 50s. Rate: 7.8 symbols/min [2025-09-29T21:41:25.557413] [INFO ] [MAIN ] USB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:41:25.615005] [DEBUG] [LOCAL ] USB: Loaded 54468 existing records from primary storage. [2025-09-29T21:41:25.615414] [INFO ] [MAIN ] USB: Loaded 54468 existing records. [2025-09-29T21:41:25.859462] [WARN ] [MAIN ] USB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:41:25.873104] [INFO ] [MAIN ] USB: Wiping existing primary data before full refresh. [2025-09-29T21:41:25.874423] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-29T21:41:25.873600] [INFO ] [LOCAL ] USB: Starting deletion of primary data. [2025-09-29T21:41:25.881922] [DEBUG] [LOCAL ] USB: Deleted primary data file. [2025-09-29T21:41:25.881997] [INFO ] [MAIN ] USB: Starting full primary refresh. [2025-09-29T21:41:25.954101] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-07. [2025-09-29T21:41:26.274357] [INFO ] [REMOTE ] USB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:41:26.748085] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-05. [2025-09-29T21:41:26.931780] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-29T21:41:27.553911] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-05. [2025-09-29T21:41:27.559914] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-29T21:41:28.128203] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-29T21:41:28.348127] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-06. [2025-09-29T21:41:29.152042] [INFO ] [REMOTE ] USB: Fetching primary data for 2024-12. [2025-09-29T21:41:29.156788] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-29T21:41:29.424633] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-29T21:41:29.948117] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-06. [2025-09-29T21:41:30.748121] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-08. [2025-09-29T21:41:30.955035] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-29T21:41:31.028756] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-29T21:41:31.548123] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-01. [2025-09-29T21:41:32.157936] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-29T21:41:32.348114] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-07. [2025-09-29T21:41:33.148089] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-07. [2025-09-29T21:41:33.668758] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-29T21:41:33.948225] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-29T21:41:33.948347] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-09. [2025-09-29T21:41:34.149689] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-29T21:41:34.748146] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-08. [2025-09-29T21:41:35.505762] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-29T21:41:35.514372] [INFO ] [REMOTE ] USA: Full fetch complete (51810 records). [2025-09-29T21:41:35.514508] [DEBUG] [VALIDATOR ] USA: Validating primary data. [2025-09-29T21:41:35.553272] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-08. [2025-09-29T21:41:35.936508] [DEBUG] [VALIDATOR ] USA: All expected trading days are present. [2025-09-29T21:41:35.936703] [DEBUG] [VALIDATOR ] USA: Primary data validation passed. [2025-09-29T21:41:35.937900] [INFO ] [MAIN ] USA: Fetched primary data is valid. [2025-09-29T21:41:35.937970] [DEBUG] [LOCAL ] USA: Saving primary data. [2025-09-29T21:41:35.939351] [DEBUG] [LOCAL ] USA: Trimmed 51810 records to 35934 (keeping 200 days of data) [2025-09-29T21:41:36.179227] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-29T21:41:36.195206] [DEBUG] [LOCAL ] USA: Primary data saved (35934 records). [2025-09-29T21:41:36.195368] [INFO ] [MAIN ] USA: Full history saved. [2025-09-29T21:41:36.195458] [INFO ] [MAIN ] Update Progress: 2194/2371 symbols completed. USA took 28.9s. Estimated remaining: 22m 43s. Rate: 7.8 symbols/min [2025-09-29T21:41:36.374442] [INFO ] [MAIN ] USFD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:41:36.353206] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-02. [2025-09-29T21:41:36.436747] [DEBUG] [LOCAL ] USFD: Loaded 51959 existing records from primary storage. [2025-09-29T21:41:36.437259] [INFO ] [MAIN ] USFD: Loaded 51959 existing records. [2025-09-29T21:41:36.657595] [WARN ] [MAIN ] USFD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:41:36.669256] [INFO ] [MAIN ] USFD: Wiping existing primary data before full refresh. [2025-09-29T21:41:36.669907] [INFO ] [LOCAL ] USFD: Starting deletion of primary data. [2025-09-29T21:41:36.670297] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-29T21:41:36.674659] [DEBUG] [LOCAL ] USFD: Deleted primary data file. [2025-09-29T21:41:36.675285] [INFO ] [MAIN ] USFD: Starting full primary refresh. [2025-09-29T21:41:37.065560] [INFO ] [REMOTE ] USFD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:41:37.148134] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-09. [2025-09-29T21:41:37.850286] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-29T21:41:37.868276] [INFO ] [REMOTE ] URI: Full fetch complete (53677 records). [2025-09-29T21:41:37.873594] [DEBUG] [VALIDATOR ] URI: Validating primary data. [2025-09-29T21:41:37.952489] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-09. [2025-09-29T21:41:37.978870] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-29T21:41:38.332557] [DEBUG] [VALIDATOR ] URI: All expected trading days are present. [2025-09-29T21:41:38.332673] [DEBUG] [VALIDATOR ] URI: Primary data validation passed. [2025-09-29T21:41:38.333818] [INFO ] [MAIN ] URI: Fetched primary data is valid. [2025-09-29T21:41:38.333897] [DEBUG] [LOCAL ] URI: Saving primary data. [2025-09-29T21:41:38.335251] [DEBUG] [LOCAL ] URI: Trimmed 53677 records to 35898 (keeping 200 days of data) [2025-09-29T21:41:38.582736] [DEBUG] [LOCAL ] URI: Primary data saved (35898 records). [2025-09-29T21:41:38.582918] [INFO ] [MAIN ] URI: Full history saved. [2025-09-29T21:41:38.583029] [INFO ] [MAIN ] Update Progress: 2195/2371 symbols completed. URI took 42.3s. Estimated remaining: 22m 35s. Rate: 7.8 symbols/min [2025-09-29T21:41:38.758434] [INFO ] [MAIN ] USNA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:41:38.754751] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-03. [2025-09-29T21:41:38.781028] [DEBUG] [LOCAL ] USNA: Loaded 18368 existing records from primary storage. [2025-09-29T21:41:38.781299] [INFO ] [MAIN ] USNA: Loaded 18368 existing records. [2025-09-29T21:41:38.987605] [WARN ] [MAIN ] USNA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:41:38.987980] [INFO ] [MAIN ] USNA: Wiping existing primary data before full refresh. [2025-09-29T21:41:38.988107] [INFO ] [LOCAL ] USNA: Starting deletion of primary data. [2025-09-29T21:41:38.988485] [DEBUG] [LOCAL ] USNA: Deleted primary data file. [2025-09-29T21:41:38.988593] [INFO ] [MAIN ] USNA: Starting full primary refresh. [2025-09-29T21:41:39.065758] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-29T21:41:39.123546] [INFO ] [REMOTE ] USAC: Full fetch complete (35676 records). [2025-09-29T21:41:39.124099] [DEBUG] [VALIDATOR ] USAC: Validating primary data. [2025-09-29T21:41:39.548576] [INFO ] [REMOTE ] USFD: Fetching primary data for 2024-12. [2025-09-29T21:41:39.709448] [INFO ] [REMOTE ] USNA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:41:39.834064] [DEBUG] [VALIDATOR ] USAC: All expected trading days are present. [2025-09-29T21:41:39.834147] [DEBUG] [VALIDATOR ] USAC: Primary data validation passed. [2025-09-29T21:41:39.834989] [INFO ] [MAIN ] USAC: Fetched primary data is valid. [2025-09-29T21:41:39.835097] [DEBUG] [LOCAL ] USAC: Saving primary data. [2025-09-29T21:41:39.836054] [DEBUG] [LOCAL ] USAC: Trimmed 35676 records to 22553 (keeping 200 days of data) [2025-09-29T21:41:39.980094] [DEBUG] [LOCAL ] USAC: Primary data saved (22553 records). [2025-09-29T21:41:39.980241] [INFO ] [MAIN ] USAC: Full history saved. [2025-09-29T21:41:39.980343] [INFO ] [MAIN ] Update Progress: 2196/2371 symbols completed. USAC took 28.9s. Estimated remaining: 22m 27s. Rate: 7.8 symbols/min [2025-09-29T21:41:40.162276] [INFO ] [MAIN ] USPH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:41:40.182439] [DEBUG] [LOCAL ] USPH: Loaded 16827 existing records from primary storage. [2025-09-29T21:41:40.182703] [INFO ] [MAIN ] USPH: Loaded 16827 existing records. [2025-09-29T21:41:40.363604] [INFO ] [REMOTE ] USNA: Fetching primary data for 2024-12. [2025-09-29T21:41:40.369822] [WARN ] [MAIN ] USPH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:41:40.370065] [INFO ] [MAIN ] USPH: Wiping existing primary data before full refresh. [2025-09-29T21:41:40.370158] [INFO ] [LOCAL ] USPH: Starting deletion of primary data. [2025-09-29T21:41:40.371314] [DEBUG] [LOCAL ] USPH: Deleted primary data file. [2025-09-29T21:41:40.371410] [INFO ] [MAIN ] USPH: Starting full primary refresh. [2025-09-29T21:41:40.756187] [INFO ] [REMOTE ] USPH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:41:40.790765] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-29T21:41:41.045614] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-29T21:41:41.148086] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-04. [2025-09-29T21:41:41.379072] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-29T21:41:41.948112] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-01. [2025-09-29T21:41:42.725622] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-29T21:41:42.748081] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-02. [2025-09-29T21:41:42.932966] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-29T21:41:43.548170] [INFO ] [REMOTE ] USPH: Fetching primary data for 2024-12. [2025-09-29T21:41:43.792732] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-29T21:41:44.178725] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-29T21:41:44.348117] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-05. [2025-09-29T21:41:45.148141] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-01. [2025-09-29T21:41:45.787842] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-29T21:41:45.948112] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-02. [2025-09-29T21:41:46.344474] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-29T21:41:46.521453] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-29T21:41:46.748180] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-03. [2025-09-29T21:41:47.548109] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-06. [2025-09-29T21:41:47.826869] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-29T21:41:48.348134] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-01. [2025-09-29T21:41:49.148153] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-04. [2025-09-29T21:41:49.385814] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-29T21:41:49.948144] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-07. [2025-09-29T21:41:50.050070] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-29T21:41:50.302457] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-29T21:41:50.748120] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-05. [2025-09-29T21:41:51.548159] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-03. [2025-09-29T21:41:51.941371] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-29T21:41:51.973151] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-29T21:41:52.348167] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-08. [2025-09-29T21:41:52.557702] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-29T21:41:53.148122] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-06. [2025-09-29T21:41:53.948149] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-04. [2025-09-29T21:41:54.253254] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-29T21:41:54.279214] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-29T21:41:54.748495] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-09. [2025-09-29T21:41:54.751798] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-29T21:41:55.327582] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-29T21:41:55.339171] [INFO ] [REMOTE ] USB: Full fetch complete (77710 records). [2025-09-29T21:41:55.339339] [DEBUG] [VALIDATOR ] USB: Validating primary data. [2025-09-29T21:41:55.562810] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-02. [2025-09-29T21:41:55.777120] [DEBUG] [VALIDATOR ] USB: All expected trading days are present. [2025-09-29T21:41:55.777235] [DEBUG] [VALIDATOR ] USB: Primary data validation passed. [2025-09-29T21:41:55.778506] [INFO ] [MAIN ] USB: Fetched primary data is valid. [2025-09-29T21:41:55.778574] [DEBUG] [LOCAL ] USB: Saving primary data. [2025-09-29T21:41:55.780263] [DEBUG] [LOCAL ] USB: Trimmed 77710 records to 53688 (keeping 200 days of data) [2025-09-29T21:41:56.128079] [DEBUG] [LOCAL ] USB: Primary data saved (53688 records). [2025-09-29T21:41:56.128220] [INFO ] [MAIN ] USB: Full history saved. [2025-09-29T21:41:56.128304] [INFO ] [MAIN ] Update Progress: 2197/2371 symbols completed. USB took 30.7s. Estimated remaining: 22m 20s. Rate: 7.8 symbols/min [2025-09-29T21:41:56.348159] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-07. [2025-09-29T21:41:57.148142] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-05. [2025-09-29T21:41:57.344023] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-29T21:41:57.365869] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-29T21:41:57.948095] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-08. [2025-09-29T21:41:58.176580] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-29T21:41:58.575719] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-29T21:41:58.748215] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-09. [2025-09-29T21:41:59.548113] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-06. [2025-09-29T21:41:59.690923] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-29T21:41:59.694691] [INFO ] [REMOTE ] USNA: Full fetch complete (26523 records). [2025-09-29T21:41:59.694822] [DEBUG] [VALIDATOR ] USNA: Validating primary data. [2025-09-29T21:42:00.079572] [DEBUG] [VALIDATOR ] USNA: All expected trading days are present. [2025-09-29T21:42:00.079685] [DEBUG] [VALIDATOR ] USNA: Primary data validation passed. [2025-09-29T21:42:00.080268] [INFO ] [MAIN ] USNA: Fetched primary data is valid. [2025-09-29T21:42:00.080314] [DEBUG] [LOCAL ] USNA: Saving primary data. [2025-09-29T21:42:00.081093] [DEBUG] [LOCAL ] USNA: Trimmed 26523 records to 17984 (keeping 200 days of data) [2025-09-29T21:42:00.190587] [DEBUG] [LOCAL ] USNA: Primary data saved (17984 records). [2025-09-29T21:42:00.190763] [INFO ] [MAIN ] USNA: Full history saved. [2025-09-29T21:42:00.190854] [INFO ] [MAIN ] Update Progress: 2198/2371 symbols completed. USNA took 21.6s. Estimated remaining: 22m 12s. Rate: 7.8 symbols/min [2025-09-29T21:42:00.348166] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-03. [2025-09-29T21:42:00.539943] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-29T21:42:01.148158] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-07. [2025-09-29T21:42:01.970148] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-29T21:42:01.982666] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-04. [2025-09-29T21:42:02.225286] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-29T21:42:02.748172] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-08. [2025-09-29T21:42:03.430139] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-29T21:42:03.548145] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-05. [2025-09-29T21:42:03.749478] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-29T21:42:04.348136] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-09. [2025-09-29T21:42:05.278469] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-29T21:42:05.290358] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-06. [2025-09-29T21:42:05.317793] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-29T21:42:05.321855] [INFO ] [REMOTE ] USPH: Full fetch complete (22612 records). [2025-09-29T21:42:05.321964] [DEBUG] [VALIDATOR ] USPH: Validating primary data. [2025-09-29T21:42:05.734884] [DEBUG] [VALIDATOR ] USPH: All expected trading days are present. [2025-09-29T21:42:05.735035] [DEBUG] [VALIDATOR ] USPH: Primary data validation passed. [2025-09-29T21:42:05.735612] [INFO ] [MAIN ] USPH: Fetched primary data is valid. [2025-09-29T21:42:05.735685] [DEBUG] [LOCAL ] USPH: Saving primary data. [2025-09-29T21:42:05.736353] [DEBUG] [LOCAL ] USPH: Trimmed 22612 records to 16571 (keeping 200 days of data) [2025-09-29T21:42:05.849210] [DEBUG] [LOCAL ] USPH: Primary data saved (16571 records). [2025-09-29T21:42:05.849352] [INFO ] [MAIN ] USPH: Full history saved. [2025-09-29T21:42:05.849475] [INFO ] [MAIN ] Update Progress: 2199/2371 symbols completed. USPH took 25.9s. Estimated remaining: 22m 4s. Rate: 7.8 symbols/min [2025-09-29T21:42:06.976771] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-29T21:42:06.987967] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-07. [2025-09-29T21:42:08.868970] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-29T21:42:08.880484] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-08. [2025-09-29T21:42:10.642486] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-29T21:42:10.653818] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-09. [2025-09-29T21:42:12.316878] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-29T21:42:12.328050] [INFO ] [REMOTE ] USFD: Full fetch complete (73922 records). [2025-09-29T21:42:12.328247] [DEBUG] [VALIDATOR ] USFD: Validating primary data. [2025-09-29T21:42:12.746546] [DEBUG] [VALIDATOR ] USFD: All expected trading days are present. [2025-09-29T21:42:12.746686] [DEBUG] [VALIDATOR ] USFD: Primary data validation passed. [2025-09-29T21:42:12.747894] [INFO ] [MAIN ] USFD: Fetched primary data is valid. [2025-09-29T21:42:12.747960] [DEBUG] [LOCAL ] USFD: Saving primary data. [2025-09-29T21:42:12.749410] [DEBUG] [LOCAL ] USFD: Trimmed 73922 records to 51182 (keeping 200 days of data) [2025-09-29T21:42:13.078277] [DEBUG] [LOCAL ] USFD: Primary data saved (51182 records). [2025-09-29T21:42:13.078429] [INFO ] [MAIN ] USFD: Full history saved. [2025-09-29T21:42:13.078523] [INFO ] [MAIN ] Update Progress: 2200/2371 symbols completed. USFD took 36.9s. Estimated remaining: 21m 56s. Rate: 7.8 symbols/min [2025-09-29T21:42:13.728885] [INFO ] [MAIN ] UTL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:42:13.805471] [INFO ] [MAIN ] UTZ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:42:13.830163] [INFO ] [MAIN ] UTI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:42:13.852972] [INFO ] [MAIN ] UTF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:42:13.864966] [DEBUG] [LOCAL ] UTL: Loaded 11273 existing records from primary storage. [2025-09-29T21:42:13.865250] [INFO ] [MAIN ] UTL: Loaded 11273 existing records. [2025-09-29T21:42:14.096388] [DEBUG] [LOCAL ] UTF: Loaded 29200 existing records from primary storage. [2025-09-29T21:42:14.112789] [INFO ] [MAIN ] UTF: Loaded 29200 existing records. [2025-09-29T21:42:14.138798] [DEBUG] [LOCAL ] UTI: Loaded 41146 existing records from primary storage. [2025-09-29T21:42:14.143326] [WARN ] [MAIN ] UTL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:42:14.169734] [INFO ] [MAIN ] UTI: Loaded 41146 existing records. [2025-09-29T21:42:14.192399] [INFO ] [MAIN ] UTL: Wiping existing primary data before full refresh. [2025-09-29T21:42:14.192604] [DEBUG] [LOCAL ] UTZ: Loaded 45341 existing records from primary storage. [2025-09-29T21:42:14.192759] [INFO ] [LOCAL ] UTL: Starting deletion of primary data. [2025-09-29T21:42:14.307713] [DEBUG] [LOCAL ] UTL: Deleted primary data file. [2025-09-29T21:42:14.328685] [INFO ] [MAIN ] UTL: Starting full primary refresh. [2025-09-29T21:42:14.334069] [INFO ] [MAIN ] UTZ: Loaded 45341 existing records. [2025-09-29T21:42:14.712066] [WARN ] [MAIN ] UTF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:42:14.754413] [INFO ] [MAIN ] UTF: Wiping existing primary data before full refresh. [2025-09-29T21:42:14.754493] [INFO ] [LOCAL ] UTF: Starting deletion of primary data. [2025-09-29T21:42:14.766764] [DEBUG] [LOCAL ] UTF: Deleted primary data file. [2025-09-29T21:42:14.766885] [INFO ] [MAIN ] UTF: Starting full primary refresh. [2025-09-29T21:42:14.818106] [WARN ] [MAIN ] UTI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:42:14.921845] [INFO ] [MAIN ] UTI: Wiping existing primary data before full refresh. [2025-09-29T21:42:14.958228] [INFO ] [LOCAL ] UTI: Starting deletion of primary data. [2025-09-29T21:42:15.079546] [DEBUG] [LOCAL ] UTI: Deleted primary data file. [2025-09-29T21:42:15.176857] [WARN ] [MAIN ] UTZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:42:15.173464] [INFO ] [MAIN ] UTI: Starting full primary refresh. [2025-09-29T21:42:15.255834] [INFO ] [MAIN ] UTZ: Wiping existing primary data before full refresh. [2025-09-29T21:42:15.346907] [INFO ] [LOCAL ] UTZ: Starting deletion of primary data. [2025-09-29T21:42:15.548056] [INFO ] [REMOTE ] UTL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:42:15.539724] [DEBUG] [LOCAL ] UTZ: Deleted primary data file. [2025-09-29T21:42:15.573943] [INFO ] [REMOTE ] UTL: Fetching primary data for 2024-12. [2025-09-29T21:42:15.583222] [INFO ] [MAIN ] UTZ: Starting full primary refresh. [2025-09-29T21:42:15.881223] [INFO ] [REMOTE ] UTF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:42:15.887082] [INFO ] [REMOTE ] UTF: Fetching primary data for 2024-12. [2025-09-29T21:42:16.394979] [INFO ] [REMOTE ] UTI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:42:16.406311] [INFO ] [REMOTE ] UTI: Fetching primary data for 2024-12. [2025-09-29T21:42:16.453861] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-29T21:42:16.459051] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-01. [2025-09-29T21:42:16.589160] [INFO ] [REMOTE ] UTZ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:42:16.589822] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2024-12. [2025-09-29T21:42:17.252826] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-29T21:42:17.259207] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-01. [2025-09-29T21:42:17.388001] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-29T21:42:17.390677] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-02. [2025-09-29T21:42:17.918597] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-29T21:42:17.926703] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-01. [2025-09-29T21:42:17.991324] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-29T21:42:17.999981] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-01. [2025-09-29T21:42:18.007367] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-29T21:42:18.010507] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-03. [2025-09-29T21:42:18.158277] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-29T21:42:18.164841] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-02. [2025-09-29T21:42:18.944765] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-29T21:42:18.947925] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-04. [2025-09-29T21:42:19.004495] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-29T21:42:19.014039] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-02. [2025-09-29T21:42:19.318243] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-29T21:42:19.328297] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-02. [2025-09-29T21:42:19.405956] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-29T21:42:19.548157] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-03. [2025-09-29T21:42:19.733007] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-29T21:42:20.140717] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-29T21:42:20.348081] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-05. [2025-09-29T21:42:20.865888] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-29T21:42:20.894125] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-29T21:42:21.148120] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-04. [2025-09-29T21:42:21.166883] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-29T21:42:21.948117] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-03. [2025-09-29T21:42:22.656137] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-29T21:42:22.748128] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-05. [2025-09-29T21:42:23.548123] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-03. [2025-09-29T21:42:23.594990] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-29T21:42:23.690899] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-29T21:42:24.348119] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-06. [2025-09-29T21:42:25.148077] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-04. [2025-09-29T21:42:25.231039] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-29T21:42:25.367543] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-29T21:42:25.948131] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-07. [2025-09-29T21:42:26.748142] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-04. [2025-09-29T21:42:26.839163] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-29T21:42:27.112474] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-29T21:42:27.548119] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-06. [2025-09-29T21:42:28.243440] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-29T21:42:28.346672] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-29T21:42:28.349726] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-05. [2025-09-29T21:42:29.148130] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-05. [2025-09-29T21:42:29.916704] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-29T21:42:29.948138] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-06. [2025-09-29T21:42:30.406364] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-29T21:42:30.748125] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-08. [2025-09-29T21:42:31.098557] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-29T21:42:31.548117] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-07. [2025-09-29T21:42:31.963761] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-29T21:42:32.327450] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-29T21:42:32.348080] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-08. [2025-09-29T21:42:33.148089] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-07. [2025-09-29T21:42:33.301090] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-29T21:42:33.948152] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-09. [2025-09-29T21:42:34.677703] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-29T21:42:34.748113] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-08. [2025-09-29T21:42:34.878232] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-29T21:42:34.881989] [INFO ] [REMOTE ] UTL: Full fetch complete (15318 records). [2025-09-29T21:42:34.882149] [DEBUG] [VALIDATOR ] UTL: Validating primary data. [2025-09-29T21:42:35.267024] [DEBUG] [VALIDATOR ] UTL: All expected trading days are present. [2025-09-29T21:42:35.267113] [DEBUG] [VALIDATOR ] UTL: Primary data validation passed. [2025-09-29T21:42:35.267476] [INFO ] [MAIN ] UTL: Fetched primary data is valid. [2025-09-29T21:42:35.267516] [DEBUG] [LOCAL ] UTL: Saving primary data. [2025-09-29T21:42:35.268124] [DEBUG] [LOCAL ] UTL: Trimmed 15318 records to 11195 (keeping 200 days of data) [2025-09-29T21:42:35.345718] [DEBUG] [LOCAL ] UTL: Primary data saved (11195 records). [2025-09-29T21:42:35.345871] [INFO ] [MAIN ] UTL: Full history saved. [2025-09-29T21:42:35.345998] [INFO ] [MAIN ] Update Progress: 2201/2371 symbols completed. UTL took 22.2s. Estimated remaining: 21m 49s. Rate: 7.8 symbols/min [2025-09-29T21:42:35.550486] [INFO ] [MAIN ] UVE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:42:35.550624] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-06. [2025-09-29T21:42:35.580078] [DEBUG] [LOCAL ] UVE: Loaded 22124 existing records from primary storage. [2025-09-29T21:42:35.580431] [INFO ] [MAIN ] UVE: Loaded 22124 existing records. [2025-09-29T21:42:35.791262] [WARN ] [MAIN ] UVE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:42:35.791520] [INFO ] [MAIN ] UVE: Wiping existing primary data before full refresh. [2025-09-29T21:42:35.791581] [INFO ] [LOCAL ] UVE: Starting deletion of primary data. [2025-09-29T21:42:35.791956] [DEBUG] [LOCAL ] UVE: Deleted primary data file. [2025-09-29T21:42:35.792017] [INFO ] [MAIN ] UVE: Starting full primary refresh. [2025-09-29T21:42:36.175759] [INFO ] [REMOTE ] UVE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:42:36.341496] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-29T21:42:36.353463] [INFO ] [REMOTE ] UVE: Fetching primary data for 2024-12. [2025-09-29T21:42:36.838149] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-29T21:42:37.148122] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-09. [2025-09-29T21:42:37.404689] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-29T21:42:37.948152] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-01. [2025-09-29T21:42:38.611822] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-29T21:42:38.621059] [INFO ] [REMOTE ] UTI: Full fetch complete (58158 records). [2025-09-29T21:42:38.621175] [DEBUG] [VALIDATOR ] UTI: Validating primary data. [2025-09-29T21:42:38.753314] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-07. [2025-09-29T21:42:38.992372] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-29T21:42:39.082445] [DEBUG] [VALIDATOR ] UTI: All expected trading days are present. [2025-09-29T21:42:39.082537] [DEBUG] [VALIDATOR ] UTI: Primary data validation passed. [2025-09-29T21:42:39.083778] [INFO ] [MAIN ] UTI: Fetched primary data is valid. [2025-09-29T21:42:39.083850] [DEBUG] [LOCAL ] UTI: Saving primary data. [2025-09-29T21:42:39.086184] [DEBUG] [LOCAL ] UTI: Trimmed 58158 records to 40490 (keeping 200 days of data) [2025-09-29T21:42:39.344412] [DEBUG] [LOCAL ] UTI: Primary data saved (40490 records). [2025-09-29T21:42:39.344560] [INFO ] [MAIN ] UTI: Full history saved. [2025-09-29T21:42:39.344708] [INFO ] [MAIN ] Update Progress: 2202/2371 symbols completed. UTI took 26.3s. Estimated remaining: 21m 41s. Rate: 7.8 symbols/min [2025-09-29T21:42:39.526968] [INFO ] [MAIN ] UVV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:42:39.552885] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-09. [2025-09-29T21:42:39.554051] [DEBUG] [LOCAL ] UVV: Loaded 22660 existing records from primary storage. [2025-09-29T21:42:39.555105] [INFO ] [MAIN ] UVV: Loaded 22660 existing records. [2025-09-29T21:42:39.747684] [WARN ] [MAIN ] UVV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:42:39.747952] [INFO ] [MAIN ] UVV: Wiping existing primary data before full refresh. [2025-09-29T21:42:39.748007] [INFO ] [LOCAL ] UVV: Starting deletion of primary data. [2025-09-29T21:42:39.748315] [DEBUG] [LOCAL ] UVV: Deleted primary data file. [2025-09-29T21:42:39.748373] [INFO ] [MAIN ] UVV: Starting full primary refresh. [2025-09-29T21:42:40.115740] [INFO ] [REMOTE ] UVV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:42:40.146184] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-29T21:42:40.348109] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-08. [2025-09-29T21:42:41.148102] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-02. [2025-09-29T21:42:41.173515] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-29T21:42:41.182573] [INFO ] [REMOTE ] UTF: Full fetch complete (41666 records). [2025-09-29T21:42:41.182777] [DEBUG] [VALIDATOR ] UTF: Validating primary data. [2025-09-29T21:42:41.632128] [DEBUG] [VALIDATOR ] UTF: All expected trading days are present. [2025-09-29T21:42:41.632313] [DEBUG] [VALIDATOR ] UTF: Primary data validation passed. [2025-09-29T21:42:41.633666] [INFO ] [MAIN ] UTF: Fetched primary data is valid. [2025-09-29T21:42:41.633777] [DEBUG] [LOCAL ] UTF: Saving primary data. [2025-09-29T21:42:41.650111] [DEBUG] [LOCAL ] UTF: Trimmed 41666 records to 28893 (keeping 200 days of data) [2025-09-29T21:42:41.662280] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-29T21:42:41.878967] [DEBUG] [LOCAL ] UTF: Primary data saved (28893 records). [2025-09-29T21:42:41.879123] [INFO ] [MAIN ] UTF: Full history saved. [2025-09-29T21:42:41.879234] [INFO ] [MAIN ] Update Progress: 2203/2371 symbols completed. UTF took 28.8s. Estimated remaining: 21m 33s. Rate: 7.8 symbols/min [2025-09-29T21:42:41.950453] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-09. [2025-09-29T21:42:42.080933] [INFO ] [MAIN ] UWMC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:42:42.143501] [DEBUG] [LOCAL ] UWMC: Loaded 53516 existing records from primary storage. [2025-09-29T21:42:42.143953] [INFO ] [MAIN ] UWMC: Loaded 53516 existing records. [2025-09-29T21:42:42.399387] [WARN ] [MAIN ] UWMC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:42:42.401729] [INFO ] [MAIN ] UWMC: Wiping existing primary data before full refresh. [2025-09-29T21:42:42.401518] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-29T21:42:42.401870] [INFO ] [LOCAL ] UWMC: Starting deletion of primary data. [2025-09-29T21:42:42.407984] [DEBUG] [LOCAL ] UWMC: Deleted primary data file. [2025-09-29T21:42:42.408056] [INFO ] [MAIN ] UWMC: Starting full primary refresh. [2025-09-29T21:42:42.758329] [INFO ] [REMOTE ] UVV: Fetching primary data for 2024-12. [2025-09-29T21:42:42.782907] [INFO ] [REMOTE ] UWMC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:42:43.016362] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-29T21:42:43.025603] [INFO ] [REMOTE ] UTZ: Full fetch complete (64017 records). [2025-09-29T21:42:43.025820] [DEBUG] [VALIDATOR ] UTZ: Validating primary data. [2025-09-29T21:42:43.444154] [DEBUG] [VALIDATOR ] UTZ: All expected trading days are present. [2025-09-29T21:42:43.444239] [DEBUG] [VALIDATOR ] UTZ: Primary data validation passed. [2025-09-29T21:42:43.445345] [INFO ] [MAIN ] UTZ: Fetched primary data is valid. [2025-09-29T21:42:43.445412] [DEBUG] [LOCAL ] UTZ: Saving primary data. [2025-09-29T21:42:43.446731] [DEBUG] [LOCAL ] UTZ: Trimmed 64017 records to 44683 (keeping 200 days of data) [2025-09-29T21:42:43.553008] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-03. [2025-09-29T21:42:43.558160] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-29T21:42:43.809141] [DEBUG] [LOCAL ] UTZ: Primary data saved (44683 records). [2025-09-29T21:42:43.809295] [INFO ] [MAIN ] UTZ: Full history saved. [2025-09-29T21:42:43.809424] [INFO ] [MAIN ] Update Progress: 2204/2371 symbols completed. UTZ took 30.7s. Estimated remaining: 21m 25s. Rate: 7.8 symbols/min [2025-09-29T21:42:44.004259] [INFO ] [MAIN ] UZD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:42:44.013831] [DEBUG] [LOCAL ] UZD: Loaded 6455 existing records from primary storage. [2025-09-29T21:42:44.014129] [INFO ] [MAIN ] UZD: Loaded 6455 existing records. [2025-09-29T21:42:44.217810] [WARN ] [MAIN ] UZD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:42:44.218053] [INFO ] [MAIN ] UZD: Wiping existing primary data before full refresh. [2025-09-29T21:42:44.218107] [INFO ] [LOCAL ] UZD: Starting deletion of primary data. [2025-09-29T21:42:44.218326] [DEBUG] [LOCAL ] UZD: Deleted primary data file. [2025-09-29T21:42:44.218386] [INFO ] [MAIN ] UZD: Starting full primary refresh. [2025-09-29T21:42:44.353254] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2024-12. [2025-09-29T21:42:44.634615] [INFO ] [REMOTE ] UZD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:42:44.649132] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-29T21:42:45.148117] [INFO ] [REMOTE ] UZD: Fetching primary data for 2024-12. [2025-09-29T21:42:45.846862] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-29T21:42:45.948094] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-01. [2025-09-29T21:42:46.251665] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-29T21:42:46.409066] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-29T21:42:46.748159] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-04. [2025-09-29T21:42:47.548128] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-01. [2025-09-29T21:42:47.963478] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-29T21:42:48.348087] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-01. [2025-09-29T21:42:48.586236] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-29T21:42:49.148149] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-05. [2025-09-29T21:42:49.677884] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-29T21:42:49.948091] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-02. [2025-09-29T21:42:50.287023] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-29T21:42:50.358227] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-29T21:42:50.748143] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-06. [2025-09-29T21:42:51.548126] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-03. [2025-09-29T21:42:51.846689] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-29T21:42:52.230808] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-29T21:42:52.348108] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-04. [2025-09-29T21:42:52.863534] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-29T21:42:53.148173] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-02. [2025-09-29T21:42:53.948135] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-07. [2025-09-29T21:42:54.156495] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-29T21:42:54.748163] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-03. [2025-09-29T21:42:55.263248] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-29T21:42:55.515931] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-29T21:42:55.548131] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-04. [2025-09-29T21:42:56.348091] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-02. [2025-09-29T21:42:56.744378] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-29T21:42:57.148139] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-08. [2025-09-29T21:42:57.628527] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-29T21:42:57.948131] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-05. [2025-09-29T21:42:58.166994] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-29T21:42:58.748116] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-09. [2025-09-29T21:42:59.111921] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-29T21:42:59.548162] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-05. [2025-09-29T21:42:59.727883] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-29T21:42:59.734307] [INFO ] [REMOTE ] UVE: Full fetch complete (29683 records). [2025-09-29T21:42:59.734513] [DEBUG] [VALIDATOR ] UVE: Validating primary data. [2025-09-29T21:43:00.067619] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-29T21:43:00.154550] [DEBUG] [VALIDATOR ] UVE: All expected trading days are present. [2025-09-29T21:43:00.154708] [DEBUG] [VALIDATOR ] UVE: Primary data validation passed. [2025-09-29T21:43:00.155977] [INFO ] [MAIN ] UVE: Fetched primary data is valid. [2025-09-29T21:43:00.156046] [DEBUG] [LOCAL ] UVE: Saving primary data. [2025-09-29T21:43:00.157866] [DEBUG] [LOCAL ] UVE: Trimmed 29683 records to 21806 (keeping 200 days of data) [2025-09-29T21:43:00.301015] [DEBUG] [LOCAL ] UVE: Primary data saved (21806 records). [2025-09-29T21:43:00.301164] [INFO ] [MAIN ] UVE: Full history saved. [2025-09-29T21:43:00.301342] [INFO ] [MAIN ] Update Progress: 2205/2371 symbols completed. UVE took 25.0s. Estimated remaining: 21m 18s. Rate: 7.8 symbols/min [2025-09-29T21:43:00.353222] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-06. [2025-09-29T21:43:00.494533] [INFO ] [MAIN ] UZE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:43:00.507196] [DEBUG] [LOCAL ] UZE: Loaded 7528 existing records from primary storage. [2025-09-29T21:43:00.507425] [INFO ] [MAIN ] UZE: Loaded 7528 existing records. [2025-09-29T21:43:00.692576] [WARN ] [MAIN ] UZE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:43:00.692847] [INFO ] [MAIN ] UZE: Wiping existing primary data before full refresh. [2025-09-29T21:43:00.692896] [INFO ] [LOCAL ] UZE: Starting deletion of primary data. [2025-09-29T21:43:00.693154] [DEBUG] [LOCAL ] UZE: Deleted primary data file. [2025-09-29T21:43:00.693213] [INFO ] [MAIN ] UZE: Starting full primary refresh. [2025-09-29T21:43:01.073206] [INFO ] [REMOTE ] UZE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:43:01.148125] [INFO ] [REMOTE ] UZE: Fetching primary data for 2024-12. [2025-09-29T21:43:01.666758] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-29T21:43:01.921135] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-29T21:43:01.948076] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-01. [2025-09-29T21:43:02.674859] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-29T21:43:02.748142] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-03. [2025-09-29T21:43:03.548231] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-06. [2025-09-29T21:43:04.249116] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-29T21:43:04.348142] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-07. [2025-09-29T21:43:04.590934] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-29T21:43:04.914045] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-29T21:43:05.148135] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-08. [2025-09-29T21:43:05.688616] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-29T21:43:05.948115] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-02. [2025-09-29T21:43:06.497561] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-29T21:43:06.748142] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-04. [2025-09-29T21:43:07.548150] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-03. [2025-09-29T21:43:08.341579] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-29T21:43:08.348070] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-04. [2025-09-29T21:43:08.649498] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-29T21:43:09.090213] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-29T21:43:09.148193] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-09. [2025-09-29T21:43:09.572799] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-29T21:43:09.574466] [INFO ] [REMOTE ] UZD: Full fetch complete (9459 records). [2025-09-29T21:43:09.574585] [DEBUG] [VALIDATOR ] UZD: Validating primary data. [2025-09-29T21:43:09.955691] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-05. [2025-09-29T21:43:09.981143] [DEBUG] [VALIDATOR ] UZD: All expected trading days are present. [2025-09-29T21:43:09.981232] [DEBUG] [VALIDATOR ] UZD: Primary data validation passed. [2025-09-29T21:43:09.981505] [INFO ] [MAIN ] UZD: Fetched primary data is valid. [2025-09-29T21:43:09.981565] [DEBUG] [LOCAL ] UZD: Saving primary data. [2025-09-29T21:43:09.982421] [DEBUG] [LOCAL ] UZD: Trimmed 9459 records to 6366 (keeping 200 days of data) [2025-09-29T21:43:10.026315] [DEBUG] [LOCAL ] UZD: Primary data saved (6366 records). [2025-09-29T21:43:10.026459] [INFO ] [MAIN ] UZD: Full history saved. [2025-09-29T21:43:10.026552] [INFO ] [MAIN ] Update Progress: 2206/2371 symbols completed. UZD took 26.2s. Estimated remaining: 21m 11s. Rate: 7.8 symbols/min [2025-09-29T21:43:10.210468] [INFO ] [MAIN ] UZF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:43:10.220015] [DEBUG] [LOCAL ] UZF: Loaded 6574 existing records from primary storage. [2025-09-29T21:43:10.220301] [INFO ] [MAIN ] UZF: Loaded 6574 existing records. [2025-09-29T21:43:10.408119] [WARN ] [MAIN ] UZF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:43:10.408390] [INFO ] [MAIN ] UZF: Wiping existing primary data before full refresh. [2025-09-29T21:43:10.408458] [INFO ] [LOCAL ] UZF: Starting deletion of primary data. [2025-09-29T21:43:10.408856] [DEBUG] [LOCAL ] UZF: Deleted primary data file. [2025-09-29T21:43:10.408955] [INFO ] [MAIN ] UZF: Starting full primary refresh. [2025-09-29T21:43:10.753327] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-07. [2025-09-29T21:43:10.795883] [INFO ] [REMOTE ] UZF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:43:11.548105] [INFO ] [REMOTE ] UZF: Fetching primary data for 2024-12. [2025-09-29T21:43:11.647159] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-29T21:43:11.798473] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-29T21:43:12.255786] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-29T21:43:12.348106] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-01. [2025-09-29T21:43:12.744273] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-29T21:43:13.148122] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-06. [2025-09-29T21:43:13.948127] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-08. [2025-09-29T21:43:14.748114] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-05. [2025-09-29T21:43:14.940502] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-29T21:43:15.145114] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-29T21:43:15.381677] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-29T21:43:15.548076] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-07. [2025-09-29T21:43:16.348114] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-06. [2025-09-29T21:43:16.975916] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-29T21:43:17.148112] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-07. [2025-09-29T21:43:17.355880] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-29T21:43:17.784786] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-29T21:43:17.948149] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-08. [2025-09-29T21:43:18.748116] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-02. [2025-09-29T21:43:19.292238] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-29T21:43:19.548104] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-08. [2025-09-29T21:43:19.812727] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-29T21:43:20.348100] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-09. [2025-09-29T21:43:20.486311] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-29T21:43:21.148112] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-09. [2025-09-29T21:43:21.816897] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-29T21:43:21.818778] [INFO ] [REMOTE ] UZE: Full fetch complete (10086 records). [2025-09-29T21:43:21.818893] [DEBUG] [VALIDATOR ] UZE: Validating primary data. [2025-09-29T21:43:21.953278] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-03. [2025-09-29T21:43:22.217967] [DEBUG] [VALIDATOR ] UZE: All expected trading days are present. [2025-09-29T21:43:22.218117] [DEBUG] [VALIDATOR ] UZE: Primary data validation passed. [2025-09-29T21:43:22.218406] [INFO ] [MAIN ] UZE: Fetched primary data is valid. [2025-09-29T21:43:22.218485] [DEBUG] [LOCAL ] UZE: Saving primary data. [2025-09-29T21:43:22.219314] [DEBUG] [LOCAL ] UZE: Trimmed 10086 records to 7414 (keeping 200 days of data) [2025-09-29T21:43:22.300008] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-29T21:43:22.319412] [DEBUG] [LOCAL ] UZE: Primary data saved (7414 records). [2025-09-29T21:43:22.319756] [INFO ] [MAIN ] UZE: Full history saved. [2025-09-29T21:43:22.319950] [INFO ] [MAIN ] Update Progress: 2207/2371 symbols completed. UZE took 22.0s. Estimated remaining: 21m 3s. Rate: 7.8 symbols/min [2025-09-29T21:43:22.319633] [INFO ] [REMOTE ] UWMC: Full fetch complete (75524 records). [2025-09-29T21:43:22.353509] [DEBUG] [VALIDATOR ] UWMC: Validating primary data. [2025-09-29T21:43:22.623348] [INFO ] [MAIN ] V: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:43:22.753211] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-09. [2025-09-29T21:43:22.836067] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-29T21:43:23.005809] [DEBUG] [VALIDATOR ] UWMC: All expected trading days are present. [2025-09-29T21:43:23.005940] [DEBUG] [VALIDATOR ] UWMC: Primary data validation passed. [2025-09-29T21:43:23.007216] [INFO ] [MAIN ] UWMC: Fetched primary data is valid. [2025-09-29T21:43:23.007321] [DEBUG] [LOCAL ] UWMC: Saving primary data. [2025-09-29T21:43:23.009110] [DEBUG] [LOCAL ] V: Loaded 54535 existing records from primary storage. [2025-09-29T21:43:23.010087] [INFO ] [MAIN ] V: Loaded 54535 existing records. [2025-09-29T21:43:23.083787] [DEBUG] [LOCAL ] UWMC: Trimmed 75524 records to 52754 (keeping 200 days of data) [2025-09-29T21:43:23.293021] [WARN ] [MAIN ] V: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:43:23.294221] [INFO ] [MAIN ] V: Wiping existing primary data before full refresh. [2025-09-29T21:43:23.294281] [INFO ] [LOCAL ] V: Starting deletion of primary data. [2025-09-29T21:43:23.295325] [DEBUG] [LOCAL ] V: Deleted primary data file. [2025-09-29T21:43:23.295814] [INFO ] [MAIN ] V: Starting full primary refresh. [2025-09-29T21:43:23.555105] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-04. [2025-09-29T21:43:23.763151] [INFO ] [REMOTE ] V: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:43:23.894981] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-29T21:43:23.902241] [INFO ] [REMOTE ] UVV: Full fetch complete (29865 records). [2025-09-29T21:43:23.902630] [DEBUG] [VALIDATOR ] UVV: Validating primary data. [2025-09-29T21:43:24.331910] [DEBUG] [LOCAL ] UWMC: Primary data saved (52754 records). [2025-09-29T21:43:24.338031] [INFO ] [MAIN ] UWMC: Full history saved. [2025-09-29T21:43:24.348391] [INFO ] [REMOTE ] V: Fetching primary data for 2024-12. [2025-09-29T21:43:24.348611] [INFO ] [MAIN ] Update Progress: 2208/2371 symbols completed. UWMC took 42.5s. Estimated remaining: 20m 55s. Rate: 7.8 symbols/min [2025-09-29T21:43:24.503263] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-29T21:43:24.503512] [DEBUG] [VALIDATOR ] UVV: All expected trading days are present. [2025-09-29T21:43:24.553572] [DEBUG] [VALIDATOR ] UVV: Primary data validation passed. [2025-09-29T21:43:24.558093] [INFO ] [MAIN ] UVV: Fetched primary data is valid. [2025-09-29T21:43:24.558242] [DEBUG] [LOCAL ] UVV: Saving primary data. [2025-09-29T21:43:24.604028] [DEBUG] [LOCAL ] UVV: Trimmed 29865 records to 22450 (keeping 200 days of data) [2025-09-29T21:43:24.640266] [INFO ] [MAIN ] VAC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:43:24.780177] [DEBUG] [LOCAL ] VAC: Loaded 35026 existing records from primary storage. [2025-09-29T21:43:24.782199] [INFO ] [MAIN ] VAC: Loaded 35026 existing records. [2025-09-29T21:43:24.948484] [DEBUG] [LOCAL ] UVV: Primary data saved (22450 records). [2025-09-29T21:43:24.967284] [INFO ] [MAIN ] UVV: Full history saved. [2025-09-29T21:43:24.972580] [INFO ] [MAIN ] Update Progress: 2209/2371 symbols completed. UVV took 45.6s. Estimated remaining: 20m 47s. Rate: 7.8 symbols/min [2025-09-29T21:43:25.056250] [WARN ] [MAIN ] VAC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:43:25.105506] [INFO ] [MAIN ] VAC: Wiping existing primary data before full refresh. [2025-09-29T21:43:25.116571] [INFO ] [LOCAL ] VAC: Starting deletion of primary data. [2025-09-29T21:43:25.122465] [DEBUG] [LOCAL ] VAC: Deleted primary data file. [2025-09-29T21:43:25.132895] [INFO ] [MAIN ] VAC: Starting full primary refresh. [2025-09-29T21:43:25.184260] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-05. [2025-09-29T21:43:25.234301] [INFO ] [MAIN ] VAL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:43:25.586306] [DEBUG] [LOCAL ] VAL: Loaded 51142 existing records from primary storage. [2025-09-29T21:43:25.602093] [INFO ] [MAIN ] VAL: Loaded 51142 existing records. [2025-09-29T21:43:25.786042] [INFO ] [REMOTE ] VAC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:43:25.922801] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-29T21:43:25.927425] [WARN ] [MAIN ] VAL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:43:25.929880] [INFO ] [MAIN ] VAL: Wiping existing primary data before full refresh. [2025-09-29T21:43:25.929942] [INFO ] [LOCAL ] VAL: Starting deletion of primary data. [2025-09-29T21:43:25.930248] [DEBUG] [LOCAL ] VAL: Deleted primary data file. [2025-09-29T21:43:25.930307] [INFO ] [MAIN ] VAL: Starting full primary refresh. [2025-09-29T21:43:25.954119] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-06. [2025-09-29T21:43:26.331915] [INFO ] [REMOTE ] VAL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:43:26.369454] [INFO ] [REMOTE ] V: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-29T21:43:26.654324] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-29T21:43:26.748106] [INFO ] [REMOTE ] VAC: Fetching primary data for 2024-12. [2025-09-29T21:43:27.548127] [INFO ] [REMOTE ] VAL: Fetching primary data for 2024-12. [2025-09-29T21:43:27.798192] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-29T21:43:28.348125] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-07. [2025-09-29T21:43:28.679814] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-29T21:43:29.148099] [INFO ] [REMOTE ] V: Fetching primary data for 2025-01. [2025-09-29T21:43:29.285079] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-29T21:43:29.948112] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-01. [2025-09-29T21:43:30.748118] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-08. [2025-09-29T21:43:31.224730] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-29T21:43:31.310776] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-09-29T21:43:31.548162] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-02. [2025-09-29T21:43:31.716637] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-29T21:43:32.348148] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-01. [2025-09-29T21:43:32.645326] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-29T21:43:33.148117] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-03. [2025-09-29T21:43:33.948099] [INFO ] [REMOTE ] V: Fetching primary data for 2025-02. [2025-09-29T21:43:34.138142] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-29T21:43:34.399065] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-29T21:43:34.748124] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-04. [2025-09-29T21:43:35.548173] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-02. [2025-09-29T21:43:35.696603] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-29T21:43:36.219309] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-29T21:43:36.348114] [INFO ] [REMOTE ] V: Fetching primary data for 2025-03. [2025-09-29T21:43:37.148126] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-09. [2025-09-29T21:43:37.277100] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-29T21:43:37.543118] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-29T21:43:37.544812] [INFO ] [REMOTE ] UZF: Full fetch complete (8822 records). [2025-09-29T21:43:37.544916] [DEBUG] [VALIDATOR ] UZF: Validating primary data. [2025-09-29T21:43:37.936280] [DEBUG] [VALIDATOR ] UZF: All expected trading days are present. [2025-09-29T21:43:37.936363] [DEBUG] [VALIDATOR ] UZF: Primary data validation passed. [2025-09-29T21:43:37.936638] [INFO ] [MAIN ] UZF: Fetched primary data is valid. [2025-09-29T21:43:37.936724] [DEBUG] [LOCAL ] UZF: Saving primary data. [2025-09-29T21:43:37.937215] [DEBUG] [LOCAL ] UZF: Trimmed 8822 records to 6423 (keeping 200 days of data) [2025-09-29T21:43:37.954874] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-03. [2025-09-29T21:43:37.981615] [DEBUG] [LOCAL ] UZF: Primary data saved (6423 records). [2025-09-29T21:43:37.981859] [INFO ] [MAIN ] UZF: Full history saved. [2025-09-29T21:43:37.981967] [INFO ] [MAIN ] Update Progress: 2210/2371 symbols completed. UZF took 28.0s. Estimated remaining: 20m 40s. Rate: 7.8 symbols/min [2025-09-29T21:43:38.177089] [INFO ] [MAIN ] VALE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:43:38.225492] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-29T21:43:38.282199] [DEBUG] [LOCAL ] VALE: Loaded 54474 existing records from primary storage. [2025-09-29T21:43:38.282543] [INFO ] [MAIN ] VALE: Loaded 54474 existing records. [2025-09-29T21:43:38.469207] [WARN ] [MAIN ] VALE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:43:38.469449] [INFO ] [MAIN ] VALE: Wiping existing primary data before full refresh. [2025-09-29T21:43:38.469498] [INFO ] [LOCAL ] VALE: Starting deletion of primary data. [2025-09-29T21:43:38.470042] [DEBUG] [LOCAL ] VALE: Deleted primary data file. [2025-09-29T21:43:38.470104] [INFO ] [MAIN ] VALE: Starting full primary refresh. [2025-09-29T21:43:38.754758] [INFO ] [REMOTE ] V: Fetching primary data for 2025-04. [2025-09-29T21:43:38.848761] [INFO ] [REMOTE ] VALE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:43:39.446026] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-29T21:43:39.548130] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-05. [2025-09-29T21:43:40.348173] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-04. [2025-09-29T21:43:40.799528] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-29T21:43:41.148130] [INFO ] [REMOTE ] VALE: Fetching primary data for 2024-12. [2025-09-29T21:43:41.151007] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-29T21:43:41.948152] [INFO ] [REMOTE ] V: Fetching primary data for 2025-05. [2025-09-29T21:43:42.378982] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-29T21:43:42.748119] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-05. [2025-09-29T21:43:43.087853] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-29T21:43:43.548166] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-06. [2025-09-29T21:43:44.156234] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-29T21:43:44.199458] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-29T21:43:44.348126] [INFO ] [REMOTE ] V: Fetching primary data for 2025-06. [2025-09-29T21:43:44.970430] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-29T21:43:45.148235] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-06. [2025-09-29T21:43:45.948174] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-07. [2025-09-29T21:43:46.665623] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-09-29T21:43:46.748186] [INFO ] [REMOTE ] V: Fetching primary data for 2025-07. [2025-09-29T21:43:46.923745] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-29T21:43:47.014492] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-29T21:43:47.548116] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-07. [2025-09-29T21:43:48.348126] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-08. [2025-09-29T21:43:49.148169] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-01. [2025-09-29T21:43:49.214462] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-09-29T21:43:49.418160] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-29T21:43:49.598313] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-29T21:43:49.948134] [INFO ] [REMOTE ] V: Fetching primary data for 2025-08. [2025-09-29T21:43:50.748173] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-09. [2025-09-29T21:43:51.253221] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-29T21:43:51.548159] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-08. [2025-09-29T21:43:51.839325] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-29T21:43:52.125962] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-29T21:43:52.133063] [INFO ] [REMOTE ] VAC: Full fetch complete (47949 records). [2025-09-29T21:43:52.133181] [DEBUG] [VALIDATOR ] VAC: Validating primary data. [2025-09-29T21:43:52.353240] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-02. [2025-09-29T21:43:52.579112] [DEBUG] [VALIDATOR ] VAC: All expected trading days are present. [2025-09-29T21:43:52.579207] [DEBUG] [VALIDATOR ] VAC: Primary data validation passed. [2025-09-29T21:43:52.580187] [INFO ] [MAIN ] VAC: Fetched primary data is valid. [2025-09-29T21:43:52.580255] [DEBUG] [LOCAL ] VAC: Saving primary data. [2025-09-29T21:43:52.581543] [DEBUG] [LOCAL ] VAC: Trimmed 47949 records to 34360 (keeping 200 days of data) [2025-09-29T21:43:52.816032] [DEBUG] [LOCAL ] VAC: Primary data saved (34360 records). [2025-09-29T21:43:52.816235] [INFO ] [MAIN ] VAC: Full history saved. [2025-09-29T21:43:52.816331] [INFO ] [MAIN ] Update Progress: 2211/2371 symbols completed. VAC took 28.5s. Estimated remaining: 20m 32s. Rate: 7.8 symbols/min [2025-09-29T21:43:52.993793] [INFO ] [MAIN ] VATE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:43:53.001527] [DEBUG] [LOCAL ] VATE: Loaded 5658 existing records from primary storage. [2025-09-29T21:43:53.001745] [INFO ] [MAIN ] VATE: Loaded 5658 existing records. [2025-09-29T21:43:53.160710] [INFO ] [REMOTE ] V: Fetching primary data for 2025-09. [2025-09-29T21:43:53.227879] [WARN ] [MAIN ] VATE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:43:53.229350] [INFO ] [MAIN ] VATE: Wiping existing primary data before full refresh. [2025-09-29T21:43:53.229463] [INFO ] [LOCAL ] VATE: Starting deletion of primary data. [2025-09-29T21:43:53.229743] [DEBUG] [LOCAL ] VATE: Deleted primary data file. [2025-09-29T21:43:53.229807] [INFO ] [MAIN ] VATE: Starting full primary refresh. [2025-09-29T21:43:53.340464] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-29T21:43:53.792855] [INFO ] [REMOTE ] VATE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:43:53.948098] [INFO ] [REMOTE ] VATE: Fetching primary data for 2024-12. [2025-09-29T21:43:54.228205] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-29T21:43:54.239483] [INFO ] [REMOTE ] V: Full fetch complete (77822 records). [2025-09-29T21:43:54.239634] [DEBUG] [VALIDATOR ] V: Validating primary data. [2025-09-29T21:43:54.585212] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-29T21:43:54.676816] [DEBUG] [VALIDATOR ] V: All expected trading days are present. [2025-09-29T21:43:54.700870] [DEBUG] [VALIDATOR ] V: Primary data validation passed. [2025-09-29T21:43:54.705038] [INFO ] [MAIN ] V: Fetched primary data is valid. [2025-09-29T21:43:54.705208] [DEBUG] [LOCAL ] V: Saving primary data. [2025-09-29T21:43:54.708083] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-09-29T21:43:54.719574] [DEBUG] [LOCAL ] V: Trimmed 77822 records to 53755 (keeping 200 days of data) [2025-09-29T21:43:54.781523] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-01. [2025-09-29T21:43:55.093003] [DEBUG] [LOCAL ] V: Primary data saved (53755 records). [2025-09-29T21:43:55.093158] [INFO ] [MAIN ] V: Full history saved. [2025-09-29T21:43:55.093270] [INFO ] [MAIN ] Update Progress: 2212/2371 symbols completed. V took 32.8s. Estimated remaining: 20m 24s. Rate: 7.8 symbols/min [2025-09-29T21:43:55.270381] [INFO ] [MAIN ] VBF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:43:55.283282] [DEBUG] [LOCAL ] VBF: Loaded 7206 existing records from primary storage. [2025-09-29T21:43:55.283510] [INFO ] [MAIN ] VBF: Loaded 7206 existing records. [2025-09-29T21:43:55.481328] [WARN ] [MAIN ] VBF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:43:55.481677] [INFO ] [MAIN ] VBF: Wiping existing primary data before full refresh. [2025-09-29T21:43:55.481741] [INFO ] [LOCAL ] VBF: Starting deletion of primary data. [2025-09-29T21:43:55.481997] [DEBUG] [LOCAL ] VBF: Deleted primary data file. [2025-09-29T21:43:55.482057] [INFO ] [MAIN ] VBF: Starting full primary refresh. [2025-09-29T21:43:55.553302] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-03. [2025-09-29T21:43:55.879701] [INFO ] [REMOTE ] VBF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:43:55.985070] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-29T21:43:56.348137] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-02. [2025-09-29T21:43:57.148113] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-09. [2025-09-29T21:43:57.210331] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-29T21:43:57.753175] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-29T21:43:57.948107] [INFO ] [REMOTE ] VBF: Fetching primary data for 2024-12. [2025-09-29T21:43:58.406568] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-29T21:43:58.509792] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-29T21:43:58.520574] [INFO ] [REMOTE ] VAL: Full fetch complete (73285 records). [2025-09-29T21:43:58.520781] [DEBUG] [VALIDATOR ] VAL: Validating primary data. [2025-09-29T21:43:58.751735] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-03. [2025-09-29T21:43:58.946811] [DEBUG] [VALIDATOR ] VAL: All expected trading days are present. [2025-09-29T21:43:58.946911] [DEBUG] [VALIDATOR ] VAL: Primary data validation passed. [2025-09-29T21:43:58.948252] [INFO ] [MAIN ] VAL: Fetched primary data is valid. [2025-09-29T21:43:58.948330] [DEBUG] [LOCAL ] VAL: Saving primary data. [2025-09-29T21:43:58.950011] [DEBUG] [LOCAL ] VAL: Trimmed 73285 records to 50344 (keeping 200 days of data) [2025-09-29T21:43:59.273712] [DEBUG] [LOCAL ] VAL: Primary data saved (50344 records). [2025-09-29T21:43:59.273860] [INFO ] [MAIN ] VAL: Full history saved. [2025-09-29T21:43:59.273948] [INFO ] [MAIN ] Update Progress: 2213/2371 symbols completed. VAL took 34.3s. Estimated remaining: 20m 16s. Rate: 7.8 symbols/min [2025-09-29T21:43:59.465088] [INFO ] [MAIN ] VCV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:43:59.483353] [DEBUG] [LOCAL ] VCV: Loaded 13766 existing records from primary storage. [2025-09-29T21:43:59.483680] [INFO ] [MAIN ] VCV: Loaded 13766 existing records. [2025-09-29T21:43:59.552629] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-04. [2025-09-29T21:43:59.685801] [WARN ] [MAIN ] VCV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:43:59.687758] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-29T21:43:59.691075] [INFO ] [MAIN ] VCV: Wiping existing primary data before full refresh. [2025-09-29T21:43:59.691160] [INFO ] [LOCAL ] VCV: Starting deletion of primary data. [2025-09-29T21:43:59.691443] [DEBUG] [LOCAL ] VCV: Deleted primary data file. [2025-09-29T21:43:59.691504] [INFO ] [MAIN ] VCV: Starting full primary refresh. [2025-09-29T21:44:00.089272] [INFO ] [REMOTE ] VCV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:44:00.348146] [INFO ] [REMOTE ] VCV: Fetching primary data for 2024-12. [2025-09-29T21:44:01.148151] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-01. [2025-09-29T21:44:01.504224] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-29T21:44:01.601288] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-29T21:44:01.601666] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-29T21:44:01.948150] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-01. [2025-09-29T21:44:02.579095] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-29T21:44:02.748132] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-05. [2025-09-29T21:44:03.548211] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-02. [2025-09-29T21:44:04.348100] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-04. [2025-09-29T21:44:04.387203] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-29T21:44:04.432496] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-29T21:44:05.067191] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-29T21:44:05.148150] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-02. [2025-09-29T21:44:05.948127] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-06. [2025-09-29T21:44:05.994286] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-29T21:44:06.748118] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-03. [2025-09-29T21:44:07.249477] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-29T21:44:07.548137] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-05. [2025-09-29T21:44:07.756545] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-29T21:44:08.347226] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-29T21:44:08.349140] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-04. [2025-09-29T21:44:09.066228] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-29T21:44:09.148152] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-05. [2025-09-29T21:44:09.514026] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-29T21:44:09.948145] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-07. [2025-09-29T21:44:10.748175] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-06. [2025-09-29T21:44:11.467634] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-29T21:44:11.548135] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-06. [2025-09-29T21:44:11.968394] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-29T21:44:12.267889] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-29T21:44:12.348130] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-07. [2025-09-29T21:44:12.695675] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-29T21:44:13.148125] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-07. [2025-09-29T21:44:13.701067] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-29T21:44:13.948141] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-08. [2025-09-29T21:44:14.731675] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-29T21:44:14.748115] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-09. [2025-09-29T21:44:15.428961] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-29T21:44:15.431043] [INFO ] [REMOTE ] VBF: Full fetch complete (10429 records). [2025-09-29T21:44:15.431118] [DEBUG] [VALIDATOR ] VBF: Validating primary data. [2025-09-29T21:44:15.553182] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-03. [2025-09-29T21:44:15.830569] [DEBUG] [VALIDATOR ] VBF: All expected trading days are present. [2025-09-29T21:44:15.830676] [DEBUG] [VALIDATOR ] VBF: Primary data validation passed. [2025-09-29T21:44:15.830989] [INFO ] [MAIN ] VBF: Fetched primary data is valid. [2025-09-29T21:44:15.831035] [DEBUG] [LOCAL ] VBF: Saving primary data. [2025-09-29T21:44:15.831546] [DEBUG] [LOCAL ] VBF: Trimmed 10429 records to 6989 (keeping 200 days of data) [2025-09-29T21:44:15.876032] [DEBUG] [LOCAL ] VBF: Primary data saved (6989 records). [2025-09-29T21:44:15.876171] [INFO ] [MAIN ] VBF: Full history saved. [2025-09-29T21:44:15.876257] [INFO ] [MAIN ] Update Progress: 2214/2371 symbols completed. VBF took 20.8s. Estimated remaining: 20m 9s. Rate: 7.8 symbols/min [2025-09-29T21:44:16.054187] [INFO ] [MAIN ] VEEV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:44:16.109732] [DEBUG] [LOCAL ] VEEV: Loaded 47821 existing records from primary storage. [2025-09-29T21:44:16.110151] [INFO ] [MAIN ] VEEV: Loaded 47821 existing records. [2025-09-29T21:44:16.301634] [WARN ] [MAIN ] VEEV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:44:16.301875] [INFO ] [MAIN ] VEEV: Wiping existing primary data before full refresh. [2025-09-29T21:44:16.301925] [INFO ] [LOCAL ] VEEV: Starting deletion of primary data. [2025-09-29T21:44:16.302625] [DEBUG] [LOCAL ] VEEV: Deleted primary data file. [2025-09-29T21:44:16.302724] [INFO ] [MAIN ] VEEV: Starting full primary refresh. [2025-09-29T21:44:16.351026] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-08. [2025-09-29T21:44:16.556013] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-29T21:44:16.703455] [INFO ] [REMOTE ] VEEV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:44:17.148137] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-04. [2025-09-29T21:44:17.948105] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-08. [2025-09-29T21:44:18.147318] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-29T21:44:18.285798] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-29T21:44:18.624573] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-29T21:44:18.748159] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-05. [2025-09-29T21:44:19.548159] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-09. [2025-09-29T21:44:19.606371] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-29T21:44:20.348117] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-06. [2025-09-29T21:44:21.148119] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-09. [2025-09-29T21:44:21.288290] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-29T21:44:21.299395] [INFO ] [REMOTE ] VALE: Full fetch complete (77764 records). [2025-09-29T21:44:21.299548] [DEBUG] [VALIDATOR ] VALE: Validating primary data. [2025-09-29T21:44:21.631934] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-29T21:44:21.747237] [DEBUG] [VALIDATOR ] VALE: All expected trading days are present. [2025-09-29T21:44:21.747325] [DEBUG] [VALIDATOR ] VALE: Primary data validation passed. [2025-09-29T21:44:21.748632] [INFO ] [MAIN ] VALE: Fetched primary data is valid. [2025-09-29T21:44:21.748721] [DEBUG] [LOCAL ] VALE: Saving primary data. [2025-09-29T21:44:21.750340] [DEBUG] [LOCAL ] VALE: Trimmed 77764 records to 53694 (keeping 200 days of data) [2025-09-29T21:44:21.849761] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-29T21:44:21.853532] [INFO ] [REMOTE ] VATE: Full fetch complete (10506 records). [2025-09-29T21:44:21.854216] [DEBUG] [VALIDATOR ] VATE: Validating primary data. [2025-09-29T21:44:21.953196] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2024-12. [2025-09-29T21:44:22.267846] [DEBUG] [VALIDATOR ] VATE: All expected trading days are present. [2025-09-29T21:44:22.267949] [DEBUG] [VALIDATOR ] VATE: Primary data validation passed. [2025-09-29T21:44:22.269128] [INFO ] [MAIN ] VATE: Fetched primary data is valid. [2025-09-29T21:44:22.269209] [DEBUG] [LOCAL ] VATE: Saving primary data. [2025-09-29T21:44:22.273711] [DEBUG] [LOCAL ] VATE: Trimmed 10506 records to 5353 (keeping 200 days of data) [2025-09-29T21:44:22.407060] [DEBUG] [LOCAL ] VATE: Primary data saved (5353 records). [2025-09-29T21:44:22.408266] [INFO ] [MAIN ] VATE: Full history saved. [2025-09-29T21:44:22.408925] [INFO ] [MAIN ] Update Progress: 2215/2371 symbols completed. VATE took 29.6s. Estimated remaining: 20m 1s. Rate: 7.8 symbols/min [2025-09-29T21:44:22.609166] [INFO ] [MAIN ] VEL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:44:22.631612] [DEBUG] [LOCAL ] VEL: Loaded 13299 existing records from primary storage. [2025-09-29T21:44:22.633049] [INFO ] [MAIN ] VEL: Loaded 13299 existing records. [2025-09-29T21:44:22.750232] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-07. [2025-09-29T21:44:22.844137] [WARN ] [MAIN ] VEL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:44:22.846401] [INFO ] [MAIN ] VEL: Wiping existing primary data before full refresh. [2025-09-29T21:44:22.847711] [INFO ] [LOCAL ] VEL: Starting deletion of primary data. [2025-09-29T21:44:22.849187] [DEBUG] [LOCAL ] VEL: Deleted primary data file. [2025-09-29T21:44:22.849500] [INFO ] [MAIN ] VEL: Starting full primary refresh. [2025-09-29T21:44:23.330364] [INFO ] [REMOTE ] VEL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:44:23.340466] [DEBUG] [LOCAL ] VALE: Primary data saved (53694 records). [2025-09-29T21:44:23.340750] [INFO ] [MAIN ] VALE: Full history saved. [2025-09-29T21:44:23.340949] [INFO ] [MAIN ] Update Progress: 2216/2371 symbols completed. VALE took 45.4s. Estimated remaining: 19m 53s. Rate: 7.8 symbols/min [2025-09-29T21:44:23.534239] [INFO ] [MAIN ] VET: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:44:23.548159] [INFO ] [REMOTE ] VEL: Fetching primary data for 2024-12. [2025-09-29T21:44:23.576369] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-29T21:44:23.620332] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-29T21:44:23.632829] [DEBUG] [LOCAL ] VET: Loaded 44749 existing records from primary storage. [2025-09-29T21:44:23.633133] [INFO ] [MAIN ] VET: Loaded 44749 existing records. [2025-09-29T21:44:23.815755] [WARN ] [MAIN ] VET: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:44:23.816136] [INFO ] [MAIN ] VET: Wiping existing primary data before full refresh. [2025-09-29T21:44:23.816198] [INFO ] [LOCAL ] VET: Starting deletion of primary data. [2025-09-29T21:44:23.816931] [DEBUG] [LOCAL ] VET: Deleted primary data file. [2025-09-29T21:44:23.817017] [INFO ] [MAIN ] VET: Starting full primary refresh. [2025-09-29T21:44:24.197016] [INFO ] [REMOTE ] VET: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:44:24.283689] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-29T21:44:24.348115] [INFO ] [REMOTE ] VET: Fetching primary data for 2024-12. [2025-09-29T21:44:25.148116] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-08. [2025-09-29T21:44:25.730762] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-29T21:44:25.903581] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-29T21:44:25.948068] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-01. [2025-09-29T21:44:26.748109] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-01. [2025-09-29T21:44:27.364913] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-29T21:44:27.385211] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-29T21:44:27.548127] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-09. [2025-09-29T21:44:28.214211] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-29T21:44:28.218050] [INFO ] [REMOTE ] VCV: Full fetch complete (19621 records). [2025-09-29T21:44:28.218151] [DEBUG] [VALIDATOR ] VCV: Validating primary data. [2025-09-29T21:44:28.353229] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-02. [2025-09-29T21:44:28.625703] [DEBUG] [VALIDATOR ] VCV: All expected trading days are present. [2025-09-29T21:44:28.625820] [DEBUG] [VALIDATOR ] VCV: Primary data validation passed. [2025-09-29T21:44:28.626318] [INFO ] [MAIN ] VCV: Fetched primary data is valid. [2025-09-29T21:44:28.626359] [DEBUG] [LOCAL ] VCV: Saving primary data. [2025-09-29T21:44:28.627224] [DEBUG] [LOCAL ] VCV: Trimmed 19621 records to 13647 (keeping 200 days of data) [2025-09-29T21:44:28.721426] [DEBUG] [LOCAL ] VCV: Primary data saved (13647 records). [2025-09-29T21:44:28.721581] [INFO ] [MAIN ] VCV: Full history saved. [2025-09-29T21:44:28.721709] [INFO ] [MAIN ] Update Progress: 2217/2371 symbols completed. VCV took 29.4s. Estimated remaining: 19m 45s. Rate: 7.8 symbols/min [2025-09-29T21:44:28.902804] [INFO ] [MAIN ] VFC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:44:28.909838] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-29T21:44:28.978020] [DEBUG] [LOCAL ] VFC: Loaded 54390 existing records from primary storage. [2025-09-29T21:44:28.978373] [INFO ] [MAIN ] VFC: Loaded 54390 existing records. [2025-09-29T21:44:29.151363] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-01. [2025-09-29T21:44:29.178011] [WARN ] [MAIN ] VFC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:44:29.179124] [INFO ] [MAIN ] VFC: Wiping existing primary data before full refresh. [2025-09-29T21:44:29.179212] [INFO ] [LOCAL ] VFC: Starting deletion of primary data. [2025-09-29T21:44:29.180379] [DEBUG] [LOCAL ] VFC: Deleted primary data file. [2025-09-29T21:44:29.180445] [INFO ] [MAIN ] VFC: Starting full primary refresh. [2025-09-29T21:44:29.548312] [INFO ] [REMOTE ] VFC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:44:29.948104] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-02. [2025-09-29T21:44:30.748093] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-03. [2025-09-29T21:44:30.833792] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-29T21:44:31.419295] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-29T21:44:31.469491] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-29T21:44:31.548103] [INFO ] [REMOTE ] VFC: Fetching primary data for 2024-12. [2025-09-29T21:44:32.348161] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-04. [2025-09-29T21:44:33.074242] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-29T21:44:33.148116] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-03. [2025-09-29T21:44:33.261104] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-29T21:44:33.948125] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-01. [2025-09-29T21:44:34.748136] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-02. [2025-09-29T21:44:34.807432] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-29T21:44:35.548093] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-05. [2025-09-29T21:44:35.988467] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-29T21:44:36.062786] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-29T21:44:36.146213] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-29T21:44:36.348112] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-06. [2025-09-29T21:44:37.148147] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-04. [2025-09-29T21:44:37.304738] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-29T21:44:37.948126] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-07. [2025-09-29T21:44:38.568740] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-29T21:44:38.752791] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-02. [2025-09-29T21:44:38.757423] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-29T21:44:39.548120] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-03. [2025-09-29T21:44:40.148428] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-29T21:44:40.348134] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-03. [2025-09-29T21:44:41.148125] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-05. [2025-09-29T21:44:41.374416] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-29T21:44:41.842107] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-29T21:44:41.948119] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-08. [2025-09-29T21:44:42.739917] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-29T21:44:42.748077] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-09. [2025-09-29T21:44:42.829732] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-29T21:44:43.318806] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-29T21:44:43.321765] [INFO ] [REMOTE ] VEL: Full fetch complete (16958 records). [2025-09-29T21:44:43.321880] [DEBUG] [VALIDATOR ] VEL: Validating primary data. [2025-09-29T21:44:43.548791] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-04. [2025-09-29T21:44:43.776052] [DEBUG] [VALIDATOR ] VEL: All expected trading days are present. [2025-09-29T21:44:43.776139] [DEBUG] [VALIDATOR ] VEL: Primary data validation passed. [2025-09-29T21:44:43.776548] [INFO ] [MAIN ] VEL: Fetched primary data is valid. [2025-09-29T21:44:43.776610] [DEBUG] [LOCAL ] VEL: Saving primary data. [2025-09-29T21:44:43.778528] [DEBUG] [LOCAL ] VEL: Trimmed 16958 records to 12859 (keeping 200 days of data) [2025-09-29T21:44:43.865968] [DEBUG] [LOCAL ] VEL: Primary data saved (12859 records). [2025-09-29T21:44:43.866199] [INFO ] [MAIN ] VEL: Full history saved. [2025-09-29T21:44:43.866443] [INFO ] [MAIN ] Update Progress: 2218/2371 symbols completed. VEL took 21.5s. Estimated remaining: 19m 38s. Rate: 7.8 symbols/min [2025-09-29T21:44:44.039706] [INFO ] [MAIN ] VG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:44:44.039931] [DEBUG] [LOCAL ] VG: No existing data file found in primary storage. [2025-09-29T21:44:44.039989] [WARN ] [MAIN ] VG: No existing data found, performing full refresh instead. [2025-09-29T21:44:44.040131] [INFO ] [MAIN ] VG: Wiping existing primary data before full refresh. [2025-09-29T21:44:44.040186] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-09-29T21:44:44.040256] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-09-29T21:44:44.040295] [INFO ] [MAIN ] VG: Starting full primary refresh. [2025-09-29T21:44:44.358857] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-06. [2025-09-29T21:44:44.402346] [INFO ] [REMOTE ] VG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:44:45.148106] [INFO ] [REMOTE ] VG: Fetching primary data for 2024-12. [2025-09-29T21:44:45.345209] [DEBUG] [REMOTE ] VG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T21:44:45.345570] [WARN ] [REMOTE ] VG: No data returned for month 2024-12 [2025-09-29T21:44:45.345690] [FATAL] [REMOTE ] VG: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T21:44:45.345746] [FATAL] [MAIN ] VG: Failed to fetch primary data. [2025-09-29T21:44:45.345813] [WARN ] [MAIN ] VG: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T21:44:45.345929] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-09-29T21:44:45.346012] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-09-29T21:44:45.346059] [INFO ] [LOCAL ] VG: Starting deletion of derivative data. [2025-09-29T21:44:45.346123] [DEBUG] [LOCAL ] VG: No derivative data file found to delete. [2025-09-29T21:44:45.346211] [INFO ] [MAIN ] Update Progress: 2219/2371 symbols completed. VG took 1.5s. Estimated remaining: 19m 30s. Rate: 7.8 symbols/min [2025-09-29T21:44:45.533160] [INFO ] [MAIN ] VGI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:44:45.564397] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-29T21:44:45.581884] [DEBUG] [LOCAL ] VGI: Loaded 5237 existing records from primary storage. [2025-09-29T21:44:45.582175] [INFO ] [MAIN ] VGI: Loaded 5237 existing records. [2025-09-29T21:44:45.779963] [WARN ] [MAIN ] VGI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:44:45.780294] [INFO ] [MAIN ] VGI: Wiping existing primary data before full refresh. [2025-09-29T21:44:45.780708] [INFO ] [LOCAL ] VGI: Starting deletion of primary data. [2025-09-29T21:44:45.780957] [DEBUG] [LOCAL ] VGI: Deleted primary data file. [2025-09-29T21:44:45.781017] [INFO ] [MAIN ] VGI: Starting full primary refresh. [2025-09-29T21:44:45.956742] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-05. [2025-09-29T21:44:46.140151] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-29T21:44:46.216061] [INFO ] [REMOTE ] VGI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:44:46.748110] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-04. [2025-09-29T21:44:47.548175] [INFO ] [REMOTE ] VGI: Fetching primary data for 2024-12. [2025-09-29T21:44:47.862678] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-29T21:44:48.226421] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-29T21:44:48.348124] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-06. [2025-09-29T21:44:48.882535] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-29T21:44:49.148141] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-01. [2025-09-29T21:44:49.654523] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-29T21:44:49.948126] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-05. [2025-09-29T21:44:50.077499] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-29T21:44:50.748164] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-02. [2025-09-29T21:44:51.117748] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-29T21:44:51.548156] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-07. [2025-09-29T21:44:51.841174] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-29T21:44:52.348130] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-07. [2025-09-29T21:44:52.744834] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-29T21:44:53.148107] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-08. [2025-09-29T21:44:53.948096] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-03. [2025-09-29T21:44:54.239217] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-29T21:44:54.416761] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-29T21:44:54.532805] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-29T21:44:54.748131] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-04. [2025-09-29T21:44:55.358236] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-29T21:44:55.548088] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-06. [2025-09-29T21:44:56.348135] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-09. [2025-09-29T21:44:57.148110] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-08. [2025-09-29T21:44:57.530070] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-29T21:44:57.797395] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-29T21:44:57.806285] [INFO ] [REMOTE ] VET: Full fetch complete (64472 records). [2025-09-29T21:44:57.806427] [DEBUG] [VALIDATOR ] VET: Validating primary data. [2025-09-29T21:44:57.958389] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-05. [2025-09-29T21:44:58.225609] [DEBUG] [VALIDATOR ] VET: All expected trading days are present. [2025-09-29T21:44:58.225730] [DEBUG] [VALIDATOR ] VET: Primary data validation passed. [2025-09-29T21:44:58.227088] [INFO ] [MAIN ] VET: Fetched primary data is valid. [2025-09-29T21:44:58.227158] [DEBUG] [LOCAL ] VET: Saving primary data. [2025-09-29T21:44:58.228488] [DEBUG] [LOCAL ] VET: Trimmed 64472 records to 43955 (keeping 200 days of data) [2025-09-29T21:44:58.453551] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-29T21:44:58.523763] [DEBUG] [LOCAL ] VET: Primary data saved (43955 records). [2025-09-29T21:44:58.523934] [INFO ] [MAIN ] VET: Full history saved. [2025-09-29T21:44:58.524042] [INFO ] [MAIN ] Update Progress: 2220/2371 symbols completed. VET took 35.2s. Estimated remaining: 19m 23s. Rate: 7.8 symbols/min [2025-09-29T21:44:58.708030] [INFO ] [MAIN ] VGM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:44:58.730778] [DEBUG] [LOCAL ] VGM: Loaded 18384 existing records from primary storage. [2025-09-29T21:44:58.731039] [INFO ] [MAIN ] VGM: Loaded 18384 existing records. [2025-09-29T21:44:58.753264] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-06. [2025-09-29T21:44:58.925377] [WARN ] [MAIN ] VGM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:44:58.925778] [INFO ] [MAIN ] VGM: Wiping existing primary data before full refresh. [2025-09-29T21:44:58.925912] [INFO ] [LOCAL ] VGM: Starting deletion of primary data. [2025-09-29T21:44:58.936116] [DEBUG] [LOCAL ] VGM: Deleted primary data file. [2025-09-29T21:44:58.949221] [INFO ] [MAIN ] VGM: Starting full primary refresh. [2025-09-29T21:44:59.014225] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-29T21:44:59.288374] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-29T21:44:59.350185] [INFO ] [REMOTE ] VGM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:44:59.548118] [INFO ] [REMOTE ] VGM: Fetching primary data for 2024-12. [2025-09-29T21:45:00.348117] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-07. [2025-09-29T21:45:00.588694] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-29T21:45:01.053851] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-29T21:45:01.148155] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-09. [2025-09-29T21:45:01.948108] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-07. [2025-09-29T21:45:02.655463] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-29T21:45:02.665620] [INFO ] [REMOTE ] VEEV: Full fetch complete (68274 records). [2025-09-29T21:45:02.665787] [DEBUG] [VALIDATOR ] VEEV: Validating primary data. [2025-09-29T21:45:02.753238] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-08. [2025-09-29T21:45:03.098157] [DEBUG] [VALIDATOR ] VEEV: All expected trading days are present. [2025-09-29T21:45:03.098265] [DEBUG] [VALIDATOR ] VEEV: Primary data validation passed. [2025-09-29T21:45:03.099427] [INFO ] [MAIN ] VEEV: Fetched primary data is valid. [2025-09-29T21:45:03.099495] [DEBUG] [LOCAL ] VEEV: Saving primary data. [2025-09-29T21:45:03.101008] [DEBUG] [LOCAL ] VEEV: Trimmed 68274 records to 47036 (keeping 200 days of data) [2025-09-29T21:45:03.411136] [DEBUG] [LOCAL ] VEEV: Primary data saved (47036 records). [2025-09-29T21:45:03.411275] [INFO ] [MAIN ] VEEV: Full history saved. [2025-09-29T21:45:03.411362] [INFO ] [MAIN ] Update Progress: 2221/2371 symbols completed. VEEV took 47.5s. Estimated remaining: 19m 15s. Rate: 7.8 symbols/min [2025-09-29T21:45:03.528106] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-29T21:45:03.553200] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-09. [2025-09-29T21:45:03.612501] [INFO ] [MAIN ] VHI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:45:03.620764] [DEBUG] [LOCAL ] VHI: Loaded 2905 existing records from primary storage. [2025-09-29T21:45:03.621280] [INFO ] [MAIN ] VHI: Loaded 2905 existing records. [2025-09-29T21:45:03.821016] [WARN ] [MAIN ] VHI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:45:03.821377] [INFO ] [MAIN ] VHI: Wiping existing primary data before full refresh. [2025-09-29T21:45:03.821433] [INFO ] [LOCAL ] VHI: Starting deletion of primary data. [2025-09-29T21:45:03.821756] [DEBUG] [LOCAL ] VHI: Deleted primary data file. [2025-09-29T21:45:03.821817] [INFO ] [MAIN ] VHI: Starting full primary refresh. [2025-09-29T21:45:04.156051] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-29T21:45:04.234459] [INFO ] [REMOTE ] VGI: Full fetch complete (7772 records). [2025-09-29T21:45:04.241763] [INFO ] [REMOTE ] VHI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:45:04.242495] [DEBUG] [VALIDATOR ] VGI: Validating primary data. [2025-09-29T21:45:04.354604] [INFO ] [REMOTE ] VHI: Fetching primary data for 2024-12. [2025-09-29T21:45:04.533787] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-09-29T21:45:04.762603] [DEBUG] [VALIDATOR ] VGI: All expected trading days are present. [2025-09-29T21:45:04.762722] [DEBUG] [VALIDATOR ] VGI: Primary data validation passed. [2025-09-29T21:45:04.762961] [INFO ] [MAIN ] VGI: Fetched primary data is valid. [2025-09-29T21:45:04.763003] [DEBUG] [LOCAL ] VGI: Saving primary data. [2025-09-29T21:45:04.763512] [DEBUG] [LOCAL ] VGI: Trimmed 7772 records to 5132 (keeping 200 days of data) [2025-09-29T21:45:04.796861] [DEBUG] [LOCAL ] VGI: Primary data saved (5132 records). [2025-09-29T21:45:04.797068] [INFO ] [MAIN ] VGI: Full history saved. [2025-09-29T21:45:04.797190] [INFO ] [MAIN ] Update Progress: 2222/2371 symbols completed. VGI took 19.5s. Estimated remaining: 19m 7s. Rate: 7.8 symbols/min [2025-09-29T21:45:04.983103] [INFO ] [MAIN ] VIA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:45:04.983303] [DEBUG] [LOCAL ] VIA: No existing data file found in primary storage. [2025-09-29T21:45:04.983342] [WARN ] [MAIN ] VIA: No existing data found, performing full refresh instead. [2025-09-29T21:45:04.983457] [INFO ] [MAIN ] VIA: Wiping existing primary data before full refresh. [2025-09-29T21:45:04.983501] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-09-29T21:45:04.983544] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-09-29T21:45:04.983578] [INFO ] [MAIN ] VIA: Starting full primary refresh. [2025-09-29T21:45:05.148104] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-01. [2025-09-29T21:45:05.293571] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-29T21:45:05.379852] [INFO ] [REMOTE ] VIA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:45:05.948087] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-01. [2025-09-29T21:45:06.047498] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-29T21:45:06.401567] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-29T21:45:06.748146] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-02. [2025-09-29T21:45:07.266700] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-29T21:45:07.548121] [INFO ] [REMOTE ] VIA: Fetching primary data for 2024-12. [2025-09-29T21:45:07.916854] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T21:45:07.917232] [WARN ] [REMOTE ] VIA: No data returned for month 2024-12 [2025-09-29T21:45:07.917385] [FATAL] [REMOTE ] VIA: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T21:45:07.917481] [FATAL] [MAIN ] VIA: Failed to fetch primary data. [2025-09-29T21:45:07.917562] [WARN ] [MAIN ] VIA: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T21:45:07.917676] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-09-29T21:45:07.917773] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-09-29T21:45:07.917815] [INFO ] [LOCAL ] VIA: Starting deletion of derivative data. [2025-09-29T21:45:07.917859] [DEBUG] [LOCAL ] VIA: No derivative data file found to delete. [2025-09-29T21:45:07.917968] [INFO ] [MAIN ] Update Progress: 2223/2371 symbols completed. VIA took 3.1s. Estimated remaining: 18m 59s. Rate: 7.8 symbols/min [2025-09-29T21:45:08.104931] [INFO ] [MAIN ] VICI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:45:08.173209] [DEBUG] [LOCAL ] VICI: Loaded 54427 existing records from primary storage. [2025-09-29T21:45:08.173546] [INFO ] [MAIN ] VICI: Loaded 54427 existing records. [2025-09-29T21:45:08.357212] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-08. [2025-09-29T21:45:08.364179] [WARN ] [MAIN ] VICI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:45:08.364512] [INFO ] [MAIN ] VICI: Wiping existing primary data before full refresh. [2025-09-29T21:45:08.365533] [INFO ] [LOCAL ] VICI: Starting deletion of primary data. [2025-09-29T21:45:08.366182] [DEBUG] [LOCAL ] VICI: Deleted primary data file. [2025-09-29T21:45:08.366328] [INFO ] [MAIN ] VICI: Starting full primary refresh. [2025-09-29T21:45:08.739343] [INFO ] [REMOTE ] VICI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:45:09.148135] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-03. [2025-09-29T21:45:09.617275] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-29T21:45:09.948091] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-04. [2025-09-29T21:45:09.985043] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-29T21:45:10.325437] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-29T21:45:10.748151] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-09. [2025-09-29T21:45:11.548190] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-02. [2025-09-29T21:45:12.348125] [INFO ] [REMOTE ] VICI: Fetching primary data for 2024-12. [2025-09-29T21:45:12.714954] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-29T21:45:12.727513] [INFO ] [REMOTE ] VFC: Full fetch complete (77586 records). [2025-09-29T21:45:12.727803] [DEBUG] [VALIDATOR ] VFC: Validating primary data. [2025-09-29T21:45:12.872128] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-29T21:45:13.157030] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-05. [2025-09-29T21:45:13.161108] [DEBUG] [VALIDATOR ] VFC: All expected trading days are present. [2025-09-29T21:45:13.161587] [DEBUG] [VALIDATOR ] VFC: Primary data validation passed. [2025-09-29T21:45:13.163087] [INFO ] [MAIN ] VFC: Fetched primary data is valid. [2025-09-29T21:45:13.163908] [DEBUG] [LOCAL ] VFC: Saving primary data. [2025-09-29T21:45:13.165999] [DEBUG] [LOCAL ] VFC: Trimmed 77586 records to 53610 (keeping 200 days of data) [2025-09-29T21:45:13.531399] [DEBUG] [LOCAL ] VFC: Primary data saved (53610 records). [2025-09-29T21:45:13.531558] [INFO ] [MAIN ] VFC: Full history saved. [2025-09-29T21:45:13.531680] [INFO ] [MAIN ] Update Progress: 2224/2371 symbols completed. VFC took 44.8s. Estimated remaining: 18m 51s. Rate: 7.8 symbols/min [2025-09-29T21:45:13.719500] [INFO ] [MAIN ] VIK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:45:13.724074] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-29T21:45:13.787659] [DEBUG] [LOCAL ] VIK: Loaded 53250 existing records from primary storage. [2025-09-29T21:45:13.788019] [INFO ] [MAIN ] VIK: Loaded 53250 existing records. [2025-09-29T21:45:13.954774] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-03. [2025-09-29T21:45:13.981059] [WARN ] [MAIN ] VIK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:45:13.981299] [INFO ] [MAIN ] VIK: Wiping existing primary data before full refresh. [2025-09-29T21:45:13.981358] [INFO ] [LOCAL ] VIK: Starting deletion of primary data. [2025-09-29T21:45:13.982311] [DEBUG] [LOCAL ] VIK: Deleted primary data file. [2025-09-29T21:45:13.982425] [INFO ] [MAIN ] VIK: Starting full primary refresh. [2025-09-29T21:45:14.381546] [INFO ] [REMOTE ] VIK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:45:14.447440] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-29T21:45:14.748129] [INFO ] [REMOTE ] VIK: Fetching primary data for 2024-12. [2025-09-29T21:45:14.999303] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-29T21:45:15.548122] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-04. [2025-09-29T21:45:16.348110] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-01. [2025-09-29T21:45:16.693193] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-29T21:45:16.736033] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-29T21:45:17.148158] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-05. [2025-09-29T21:45:17.948434] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-29T21:45:17.948661] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-01. [2025-09-29T21:45:18.171966] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-29T21:45:18.748130] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-06. [2025-09-29T21:45:19.548090] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-02. [2025-09-29T21:45:19.773039] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-29T21:45:20.018297] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-29T21:45:20.348110] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-02. [2025-09-29T21:45:21.148080] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-06. [2025-09-29T21:45:21.223364] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-29T21:45:21.502138] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-29T21:45:21.948102] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-03. [2025-09-29T21:45:22.025206] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-29T21:45:22.748121] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-07. [2025-09-29T21:45:23.548141] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-07. [2025-09-29T21:45:23.655987] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-29T21:45:23.768017] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-29T21:45:23.974807] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-29T21:45:24.348135] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-08. [2025-09-29T21:45:25.148112] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-08. [2025-09-29T21:45:25.327177] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-29T21:45:25.707219] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-29T21:45:25.948120] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-09. [2025-09-29T21:45:26.748095] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-03. [2025-09-29T21:45:26.980080] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-29T21:45:26.984576] [INFO ] [REMOTE ] VGM: Full fetch complete (26225 records). [2025-09-29T21:45:26.984766] [DEBUG] [VALIDATOR ] VGM: Validating primary data. [2025-09-29T21:45:27.421803] [DEBUG] [VALIDATOR ] VGM: All expected trading days are present. [2025-09-29T21:45:27.421911] [DEBUG] [VALIDATOR ] VGM: Primary data validation passed. [2025-09-29T21:45:27.422811] [INFO ] [MAIN ] VGM: Fetched primary data is valid. [2025-09-29T21:45:27.422878] [DEBUG] [LOCAL ] VGM: Saving primary data. [2025-09-29T21:45:27.425100] [DEBUG] [LOCAL ] VGM: Trimmed 26225 records to 18241 (keeping 200 days of data) [2025-09-29T21:45:27.548089] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-09. [2025-09-29T21:45:27.553628] [DEBUG] [LOCAL ] VGM: Primary data saved (18241 records). [2025-09-29T21:45:27.553774] [INFO ] [MAIN ] VGM: Full history saved. [2025-09-29T21:45:27.553895] [INFO ] [MAIN ] Update Progress: 2225/2371 symbols completed. VGM took 29.0s. Estimated remaining: 18m 44s. Rate: 7.8 symbols/min [2025-09-29T21:45:27.736336] [INFO ] [MAIN ] VIPS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:45:27.795085] [DEBUG] [LOCAL ] VIPS: Loaded 52093 existing records from primary storage. [2025-09-29T21:45:27.795414] [INFO ] [MAIN ] VIPS: Loaded 52093 existing records. [2025-09-29T21:45:27.982814] [WARN ] [MAIN ] VIPS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:45:27.983045] [INFO ] [MAIN ] VIPS: Wiping existing primary data before full refresh. [2025-09-29T21:45:27.983099] [INFO ] [LOCAL ] VIPS: Starting deletion of primary data. [2025-09-29T21:45:27.983786] [DEBUG] [LOCAL ] VIPS: Deleted primary data file. [2025-09-29T21:45:27.983849] [INFO ] [MAIN ] VIPS: Starting full primary refresh. [2025-09-29T21:45:28.110539] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-29T21:45:28.127170] [INFO ] [REMOTE ] VHI: Full fetch complete (4533 records). [2025-09-29T21:45:28.160312] [DEBUG] [VALIDATOR ] VHI: Validating primary data. [2025-09-29T21:45:28.351458] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-04. [2025-09-29T21:45:28.657840] [INFO ] [REMOTE ] VIPS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:45:28.812254] [DEBUG] [VALIDATOR ] VHI: All expected trading days are present. [2025-09-29T21:45:28.812394] [DEBUG] [VALIDATOR ] VHI: Primary data validation passed. [2025-09-29T21:45:28.812584] [INFO ] [MAIN ] VHI: Fetched primary data is valid. [2025-09-29T21:45:28.812762] [DEBUG] [LOCAL ] VHI: Saving primary data. [2025-09-29T21:45:28.813626] [DEBUG] [LOCAL ] VHI: Trimmed 4533 records to 2784 (keeping 200 days of data) [2025-09-29T21:45:28.864800] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-29T21:45:28.867524] [DEBUG] [LOCAL ] VHI: Primary data saved (2784 records). [2025-09-29T21:45:28.878934] [INFO ] [MAIN ] VHI: Full history saved. [2025-09-29T21:45:28.879333] [INFO ] [MAIN ] Update Progress: 2226/2371 symbols completed. VHI took 25.5s. Estimated remaining: 18m 36s. Rate: 7.8 symbols/min [2025-09-29T21:45:29.079522] [INFO ] [MAIN ] VIRT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:45:29.138960] [DEBUG] [LOCAL ] VIRT: Loaded 47448 existing records from primary storage. [2025-09-29T21:45:29.139287] [INFO ] [MAIN ] VIRT: Loaded 47448 existing records. [2025-09-29T21:45:29.153343] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-04. [2025-09-29T21:45:29.332292] [WARN ] [MAIN ] VIRT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:45:29.332684] [INFO ] [MAIN ] VIRT: Wiping existing primary data before full refresh. [2025-09-29T21:45:29.332745] [INFO ] [LOCAL ] VIRT: Starting deletion of primary data. [2025-09-29T21:45:29.333587] [DEBUG] [LOCAL ] VIRT: Deleted primary data file. [2025-09-29T21:45:29.333696] [INFO ] [MAIN ] VIRT: Starting full primary refresh. [2025-09-29T21:45:29.723225] [INFO ] [REMOTE ] VIRT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:45:29.948079] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2024-12. [2025-09-29T21:45:30.442902] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-29T21:45:30.748127] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-05. [2025-09-29T21:45:31.028196] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-29T21:45:31.548127] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2024-12. [2025-09-29T21:45:31.794711] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-29T21:45:32.351422] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-01. [2025-09-29T21:45:32.357771] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-29T21:45:32.877539] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-29T21:45:33.148143] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-06. [2025-09-29T21:45:33.948115] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-01. [2025-09-29T21:45:34.182538] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-29T21:45:34.707458] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-29T21:45:34.748155] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-05. [2025-09-29T21:45:35.247385] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-29T21:45:35.548162] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-02. [2025-09-29T21:45:36.229789] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-29T21:45:36.348125] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-02. [2025-09-29T21:45:37.121163] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-29T21:45:37.148093] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-03. [2025-09-29T21:45:37.948125] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-07. [2025-09-29T21:45:38.079356] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-29T21:45:38.500752] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-29T21:45:38.748137] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-04. [2025-09-29T21:45:39.548103] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-06. [2025-09-29T21:45:39.678822] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-29T21:45:40.077686] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-29T21:45:40.348136] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-05. [2025-09-29T21:45:40.867570] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-29T21:45:41.148143] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-03. [2025-09-29T21:45:41.883054] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-29T21:45:41.948114] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-06. [2025-09-29T21:45:42.748134] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-07. [2025-09-29T21:45:42.909044] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-29T21:45:43.193909] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-29T21:45:43.548145] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-04. [2025-09-29T21:45:44.215014] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-29T21:45:44.348157] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-08. [2025-09-29T21:45:45.148167] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-07. [2025-09-29T21:45:45.371420] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-29T21:45:45.948079] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-05. [2025-09-29T21:45:46.189093] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-29T21:45:46.551875] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-29T21:45:46.748131] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-08. [2025-09-29T21:45:47.265054] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-29T21:45:47.548165] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-08. [2025-09-29T21:45:48.348149] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-06. [2025-09-29T21:45:48.873500] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-29T21:45:48.923001] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-29T21:45:49.148162] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-09. [2025-09-29T21:45:49.948113] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-09. [2025-09-29T21:45:50.178731] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-29T21:45:50.458321] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-29T21:45:50.470386] [INFO ] [REMOTE ] VICI: Full fetch complete (77656 records). [2025-09-29T21:45:50.470602] [DEBUG] [VALIDATOR ] VICI: Validating primary data. [2025-09-29T21:45:50.753194] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-07. [2025-09-29T21:45:50.950456] [DEBUG] [VALIDATOR ] VICI: All expected trading days are present. [2025-09-29T21:45:50.950575] [DEBUG] [VALIDATOR ] VICI: Primary data validation passed. [2025-09-29T21:45:50.951902] [INFO ] [MAIN ] VICI: Fetched primary data is valid. [2025-09-29T21:45:50.952005] [DEBUG] [LOCAL ] VICI: Saving primary data. [2025-09-29T21:45:50.980921] [DEBUG] [LOCAL ] VICI: Trimmed 77656 records to 53647 (keeping 200 days of data) [2025-09-29T21:45:50.982005] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-29T21:45:50.998450] [INFO ] [REMOTE ] VIK: Full fetch complete (75858 records). [2025-09-29T21:45:50.998744] [DEBUG] [VALIDATOR ] VIK: Validating primary data. [2025-09-29T21:45:51.543807] [DEBUG] [VALIDATOR ] VIK: All expected trading days are present. [2025-09-29T21:45:51.543904] [DEBUG] [VALIDATOR ] VIK: Primary data validation passed. [2025-09-29T21:45:51.545291] [INFO ] [MAIN ] VIK: Fetched primary data is valid. [2025-09-29T21:45:51.545926] [DEBUG] [LOCAL ] VIK: Saving primary data. [2025-09-29T21:45:51.548294] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-09. [2025-09-29T21:45:51.552739] [DEBUG] [LOCAL ] VIK: Trimmed 75858 records to 52469 (keeping 200 days of data) [2025-09-29T21:45:52.088445] [DEBUG] [LOCAL ] VICI: Primary data saved (53647 records). [2025-09-29T21:45:52.096511] [INFO ] [MAIN ] VICI: Full history saved. [2025-09-29T21:45:52.113936] [INFO ] [MAIN ] Update Progress: 2227/2371 symbols completed. VICI took 44.2s. Estimated remaining: 18m 29s. Rate: 7.8 symbols/min [2025-09-29T21:45:52.339955] [INFO ] [MAIN ] VIST: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:45:52.359298] [DEBUG] [LOCAL ] VIK: Primary data saved (52469 records). [2025-09-29T21:45:52.359477] [INFO ] [MAIN ] VIK: Full history saved. [2025-09-29T21:45:52.359599] [INFO ] [MAIN ] Update Progress: 2228/2371 symbols completed. VIK took 38.8s. Estimated remaining: 18m 21s. Rate: 7.8 symbols/min [2025-09-29T21:45:52.607563] [DEBUG] [LOCAL ] VIST: Loaded 46722 existing records from primary storage. [2025-09-29T21:45:52.606090] [INFO ] [MAIN ] VIV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:45:52.608160] [INFO ] [MAIN ] VIST: Loaded 46722 existing records. [2025-09-29T21:45:52.802957] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-29T21:45:52.865891] [WARN ] [MAIN ] VIST: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:45:52.878757] [INFO ] [MAIN ] VIST: Wiping existing primary data before full refresh. [2025-09-29T21:45:52.879598] [INFO ] [LOCAL ] VIST: Starting deletion of primary data. [2025-09-29T21:45:52.880122] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-08. [2025-09-29T21:45:52.882044] [DEBUG] [LOCAL ] VIST: Deleted primary data file. [2025-09-29T21:45:52.882221] [INFO ] [MAIN ] VIST: Starting full primary refresh. [2025-09-29T21:45:52.982503] [DEBUG] [LOCAL ] VIV: Loaded 45667 existing records from primary storage. [2025-09-29T21:45:53.003808] [INFO ] [MAIN ] VIV: Loaded 45667 existing records. [2025-09-29T21:45:53.427769] [WARN ] [MAIN ] VIV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:45:53.440381] [INFO ] [MAIN ] VIV: Wiping existing primary data before full refresh. [2025-09-29T21:45:53.440577] [INFO ] [LOCAL ] VIV: Starting deletion of primary data. [2025-09-29T21:45:53.456821] [DEBUG] [LOCAL ] VIV: Deleted primary data file. [2025-09-29T21:45:53.494680] [INFO ] [MAIN ] VIV: Starting full primary refresh. [2025-09-29T21:45:53.575937] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-29T21:45:53.579479] [INFO ] [REMOTE ] VIST: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:45:53.611905] [INFO ] [REMOTE ] VIST: Fetching primary data for 2024-12. [2025-09-29T21:45:53.649771] [INFO ] [REMOTE ] VIRT: Full fetch complete (66945 records). [2025-09-29T21:45:53.690847] [DEBUG] [VALIDATOR ] VIRT: Validating primary data. [2025-09-29T21:45:54.434266] [INFO ] [REMOTE ] VIV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:45:54.439853] [INFO ] [REMOTE ] VIV: Fetching primary data for 2024-12. [2025-09-29T21:45:54.553337] [DEBUG] [VALIDATOR ] VIRT: All expected trading days are present. [2025-09-29T21:45:54.553546] [DEBUG] [VALIDATOR ] VIRT: Primary data validation passed. [2025-09-29T21:45:54.555028] [INFO ] [MAIN ] VIRT: Fetched primary data is valid. [2025-09-29T21:45:54.555138] [DEBUG] [LOCAL ] VIRT: Saving primary data. [2025-09-29T21:45:54.556736] [DEBUG] [LOCAL ] VIRT: Trimmed 66945 records to 46674 (keeping 200 days of data) [2025-09-29T21:45:54.693175] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-29T21:45:54.798984] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-09. [2025-09-29T21:45:54.883454] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-29T21:45:54.967081] [DEBUG] [LOCAL ] VIRT: Primary data saved (46674 records). [2025-09-29T21:45:54.967231] [INFO ] [MAIN ] VIRT: Full history saved. [2025-09-29T21:45:54.967327] [INFO ] [MAIN ] Update Progress: 2229/2371 symbols completed. VIRT took 26.1s. Estimated remaining: 18m 13s. Rate: 7.8 symbols/min [2025-09-29T21:45:55.198771] [INFO ] [MAIN ] VKQ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:45:55.218710] [DEBUG] [LOCAL ] VKQ: Loaded 17552 existing records from primary storage. [2025-09-29T21:45:55.218950] [INFO ] [MAIN ] VKQ: Loaded 17552 existing records. [2025-09-29T21:45:55.416512] [WARN ] [MAIN ] VKQ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:45:55.416758] [INFO ] [MAIN ] VKQ: Wiping existing primary data before full refresh. [2025-09-29T21:45:55.416811] [INFO ] [LOCAL ] VKQ: Starting deletion of primary data. [2025-09-29T21:45:55.417190] [DEBUG] [LOCAL ] VKQ: Deleted primary data file. [2025-09-29T21:45:55.417248] [INFO ] [MAIN ] VKQ: Starting full primary refresh. [2025-09-29T21:45:55.553210] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-01. [2025-09-29T21:45:55.821637] [INFO ] [REMOTE ] VKQ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:45:56.147427] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-29T21:45:56.348123] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-01. [2025-09-29T21:45:56.408107] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-29T21:45:56.419137] [INFO ] [REMOTE ] VIPS: Full fetch complete (74589 records). [2025-09-29T21:45:56.419296] [DEBUG] [VALIDATOR ] VIPS: Validating primary data. [2025-09-29T21:45:56.832534] [DEBUG] [VALIDATOR ] VIPS: All expected trading days are present. [2025-09-29T21:45:56.832793] [DEBUG] [VALIDATOR ] VIPS: Primary data validation passed. [2025-09-29T21:45:56.834105] [INFO ] [MAIN ] VIPS: Fetched primary data is valid. [2025-09-29T21:45:56.834172] [DEBUG] [LOCAL ] VIPS: Saving primary data. [2025-09-29T21:45:56.835631] [DEBUG] [LOCAL ] VIPS: Trimmed 74589 records to 51313 (keeping 200 days of data) [2025-09-29T21:45:57.097798] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-29T21:45:57.165710] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-02. [2025-09-29T21:45:57.213542] [DEBUG] [LOCAL ] VIPS: Primary data saved (51313 records). [2025-09-29T21:45:57.213724] [INFO ] [MAIN ] VIPS: Full history saved. [2025-09-29T21:45:57.213827] [INFO ] [MAIN ] Update Progress: 2230/2371 symbols completed. VIPS took 29.7s. Estimated remaining: 18m 5s. Rate: 7.8 symbols/min [2025-09-29T21:45:57.414370] [INFO ] [MAIN ] VLN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:45:57.445719] [DEBUG] [LOCAL ] VLN: Loaded 29056 existing records from primary storage. [2025-09-29T21:45:57.446035] [INFO ] [MAIN ] VLN: Loaded 29056 existing records. [2025-09-29T21:45:57.646255] [WARN ] [MAIN ] VLN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:45:57.646855] [INFO ] [MAIN ] VLN: Wiping existing primary data before full refresh. [2025-09-29T21:45:57.646920] [INFO ] [LOCAL ] VLN: Starting deletion of primary data. [2025-09-29T21:45:57.647361] [DEBUG] [LOCAL ] VLN: Deleted primary data file. [2025-09-29T21:45:57.647419] [INFO ] [MAIN ] VLN: Starting full primary refresh. [2025-09-29T21:45:57.955865] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2024-12. [2025-09-29T21:45:58.068986] [INFO ] [REMOTE ] VLN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:45:58.071445] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-29T21:45:58.483113] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-29T21:45:58.748079] [INFO ] [REMOTE ] VLN: Fetching primary data for 2024-12. [2025-09-29T21:45:59.063110] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-29T21:45:59.548128] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-01. [2025-09-29T21:46:00.285930] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-29T21:46:00.305238] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-29T21:46:00.348098] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-02. [2025-09-29T21:46:01.148137] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-03. [2025-09-29T21:46:01.352995] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-29T21:46:01.948153] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-02. [2025-09-29T21:46:02.729293] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-29T21:46:02.748118] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-04. [2025-09-29T21:46:03.184991] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-29T21:46:03.548154] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-03. [2025-09-29T21:46:04.223564] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-29T21:46:04.253770] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-29T21:46:04.348182] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-03. [2025-09-29T21:46:05.148123] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-05. [2025-09-29T21:46:05.939033] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-29T21:46:05.948386] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-04. [2025-09-29T21:46:06.485159] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-29T21:46:06.748119] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-01. [2025-09-29T21:46:06.980229] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-29T21:46:07.548128] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-04. [2025-09-29T21:46:08.179342] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-29T21:46:08.348125] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-05. [2025-09-29T21:46:08.886535] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-29T21:46:08.946415] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-29T21:46:09.148134] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-06. [2025-09-29T21:46:09.948127] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-05. [2025-09-29T21:46:10.139622] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-29T21:46:10.748131] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-06. [2025-09-29T21:46:11.480598] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-29T21:46:11.548160] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-02. [2025-09-29T21:46:12.356919] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-06. [2025-09-29T21:46:12.382379] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-29T21:46:12.761922] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-29T21:46:13.148158] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-07. [2025-09-29T21:46:13.948168] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-07. [2025-09-29T21:46:14.024550] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-29T21:46:14.748145] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-03. [2025-09-29T21:46:14.801770] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-29T21:46:15.078521] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-29T21:46:15.509302] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-29T21:46:15.548074] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-08. [2025-09-29T21:46:16.348109] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-08. [2025-09-29T21:46:17.119191] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-29T21:46:17.148137] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-09. [2025-09-29T21:46:17.335430] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-29T21:46:17.948145] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-09. [2025-09-29T21:46:18.759362] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-04. [2025-09-29T21:46:18.765474] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-29T21:46:18.776584] [INFO ] [REMOTE ] VIST: Full fetch complete (66857 records). [2025-09-29T21:46:18.776768] [DEBUG] [VALIDATOR ] VIST: Validating primary data. [2025-09-29T21:46:19.155512] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-29T21:46:19.187849] [INFO ] [REMOTE ] VKQ: Full fetch complete (24626 records). [2025-09-29T21:46:19.209665] [DEBUG] [VALIDATOR ] VKQ: Validating primary data. [2025-09-29T21:46:19.329836] [DEBUG] [VALIDATOR ] VIST: All expected trading days are present. [2025-09-29T21:46:19.346898] [DEBUG] [VALIDATOR ] VIST: Primary data validation passed. [2025-09-29T21:46:19.356627] [INFO ] [MAIN ] VIST: Fetched primary data is valid. [2025-09-29T21:46:19.359531] [DEBUG] [LOCAL ] VIST: Saving primary data. [2025-09-29T21:46:19.443943] [DEBUG] [LOCAL ] VIST: Trimmed 66857 records to 45967 (keeping 200 days of data) [2025-09-29T21:46:19.560056] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-07. [2025-09-29T21:46:19.801068] [DEBUG] [VALIDATOR ] VKQ: All expected trading days are present. [2025-09-29T21:46:19.802039] [DEBUG] [VALIDATOR ] VKQ: Primary data validation passed. [2025-09-29T21:46:19.803465] [INFO ] [MAIN ] VKQ: Fetched primary data is valid. [2025-09-29T21:46:19.804208] [DEBUG] [LOCAL ] VKQ: Saving primary data. [2025-09-29T21:46:19.806309] [DEBUG] [LOCAL ] VKQ: Trimmed 24626 records to 17477 (keeping 200 days of data) [2025-09-29T21:46:20.040041] [DEBUG] [LOCAL ] VKQ: Primary data saved (17477 records). [2025-09-29T21:46:20.041855] [INFO ] [MAIN ] VKQ: Full history saved. [2025-09-29T21:46:20.042481] [INFO ] [MAIN ] Update Progress: 2231/2371 symbols completed. VKQ took 25.1s. Estimated remaining: 17m 58s. Rate: 7.8 symbols/min [2025-09-29T21:46:20.160251] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-29T21:46:20.319088] [INFO ] [MAIN ] VLO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:46:20.348606] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-05. [2025-09-29T21:46:20.426226] [DEBUG] [LOCAL ] VIST: Primary data saved (45967 records). [2025-09-29T21:46:20.427270] [INFO ] [MAIN ] VIST: Full history saved. [2025-09-29T21:46:20.427465] [INFO ] [MAIN ] Update Progress: 2232/2371 symbols completed. VIST took 28.3s. Estimated remaining: 17m 50s. Rate: 7.8 symbols/min [2025-09-29T21:46:20.557287] [DEBUG] [LOCAL ] VLO: Loaded 53865 existing records from primary storage. [2025-09-29T21:46:20.558189] [INFO ] [MAIN ] VLO: Loaded 53865 existing records. [2025-09-29T21:46:20.726930] [INFO ] [MAIN ] VLRS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:46:20.866618] [WARN ] [MAIN ] VLO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:46:20.866928] [INFO ] [MAIN ] VLO: Wiping existing primary data before full refresh. [2025-09-29T21:46:20.867017] [INFO ] [LOCAL ] VLO: Starting deletion of primary data. [2025-09-29T21:46:20.867718] [DEBUG] [LOCAL ] VLO: Deleted primary data file. [2025-09-29T21:46:20.867777] [INFO ] [MAIN ] VLO: Starting full primary refresh. [2025-09-29T21:46:21.057514] [DEBUG] [LOCAL ] VLRS: Loaded 41188 existing records from primary storage. [2025-09-29T21:46:21.083801] [INFO ] [MAIN ] VLRS: Loaded 41188 existing records. [2025-09-29T21:46:21.492661] [WARN ] [MAIN ] VLRS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:46:21.516193] [INFO ] [REMOTE ] VLO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:46:21.516753] [INFO ] [MAIN ] VLRS: Wiping existing primary data before full refresh. [2025-09-29T21:46:21.517569] [INFO ] [REMOTE ] VLO: Fetching primary data for 2024-12. [2025-09-29T21:46:21.527051] [INFO ] [LOCAL ] VLRS: Starting deletion of primary data. [2025-09-29T21:46:21.535362] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-29T21:46:21.535543] [DEBUG] [LOCAL ] VLRS: Deleted primary data file. [2025-09-29T21:46:21.552895] [INFO ] [MAIN ] VLRS: Starting full primary refresh. [2025-09-29T21:46:21.642769] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-29T21:46:21.956781] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-06. [2025-09-29T21:46:22.000247] [INFO ] [REMOTE ] VLRS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:46:22.748091] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-08. [2025-09-29T21:46:22.900602] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-29T21:46:23.282626] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-29T21:46:23.548126] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-01. [2025-09-29T21:46:24.348119] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2024-12. [2025-09-29T21:46:24.392303] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-29T21:46:25.148385] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-09. [2025-09-29T21:46:25.149819] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-29T21:46:25.932269] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-29T21:46:25.948074] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-01. [2025-09-29T21:46:26.749325] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-02. [2025-09-29T21:46:26.753095] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-29T21:46:26.772897] [INFO ] [REMOTE ] VIV: Full fetch complete (64603 records). [2025-09-29T21:46:26.773187] [DEBUG] [VALIDATOR ] VIV: Validating primary data. [2025-09-29T21:46:27.252441] [DEBUG] [VALIDATOR ] VIV: All expected trading days are present. [2025-09-29T21:46:27.265595] [DEBUG] [VALIDATOR ] VIV: Primary data validation passed. [2025-09-29T21:46:27.267636] [INFO ] [MAIN ] VIV: Fetched primary data is valid. [2025-09-29T21:46:27.268537] [DEBUG] [LOCAL ] VIV: Saving primary data. [2025-09-29T21:46:27.268431] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-29T21:46:27.278552] [DEBUG] [LOCAL ] VIV: Trimmed 64603 records to 44940 (keeping 200 days of data) [2025-09-29T21:46:27.560307] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-07. [2025-09-29T21:46:27.580083] [DEBUG] [LOCAL ] VIV: Primary data saved (44940 records). [2025-09-29T21:46:27.580331] [INFO ] [MAIN ] VIV: Full history saved. [2025-09-29T21:46:27.580470] [INFO ] [MAIN ] Update Progress: 2233/2371 symbols completed. VIV took 35.2s. Estimated remaining: 17m 42s. Rate: 7.8 symbols/min [2025-09-29T21:46:27.764128] [INFO ] [MAIN ] VLT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:46:27.773512] [DEBUG] [LOCAL ] VLT: Loaded 4615 existing records from primary storage. [2025-09-29T21:46:27.773746] [INFO ] [MAIN ] VLT: Loaded 4615 existing records. [2025-09-29T21:46:27.965473] [WARN ] [MAIN ] VLT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:46:27.965743] [INFO ] [MAIN ] VLT: Wiping existing primary data before full refresh. [2025-09-29T21:46:27.965798] [INFO ] [LOCAL ] VLT: Starting deletion of primary data. [2025-09-29T21:46:27.966090] [DEBUG] [LOCAL ] VLT: Deleted primary data file. [2025-09-29T21:46:27.966149] [INFO ] [MAIN ] VLT: Starting full primary refresh. [2025-09-29T21:46:28.352474] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-02. [2025-09-29T21:46:28.361887] [INFO ] [REMOTE ] VLT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:46:28.395804] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-29T21:46:28.669933] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-29T21:46:29.148139] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-08. [2025-09-29T21:46:29.772914] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-29T21:46:29.948160] [INFO ] [REMOTE ] VLT: Fetching primary data for 2024-12. [2025-09-29T21:46:30.474819] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-29T21:46:30.573406] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-29T21:46:30.748131] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-03. [2025-09-29T21:46:31.548177] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-01. [2025-09-29T21:46:32.002499] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-29T21:46:32.154226] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-29T21:46:32.348150] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-03. [2025-09-29T21:46:33.148118] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-04. [2025-09-29T21:46:33.948079] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-02. [2025-09-29T21:46:34.251992] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-29T21:46:34.674249] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-29T21:46:34.678887] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-29T21:46:34.748147] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-04. [2025-09-29T21:46:35.548149] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-05. [2025-09-29T21:46:36.357161] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-03. [2025-09-29T21:46:36.379059] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-29T21:46:37.005954] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-29T21:46:37.056745] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-29T21:46:37.148157] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-05. [2025-09-29T21:46:37.948126] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-06. [2025-09-29T21:46:38.710917] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-29T21:46:38.748121] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-06. [2025-09-29T21:46:39.361613] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-29T21:46:39.548130] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-04. [2025-09-29T21:46:40.358870] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-09. [2025-09-29T21:46:40.365235] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-29T21:46:40.369713] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-29T21:46:41.148115] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-07. [2025-09-29T21:46:41.444919] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-29T21:46:41.452074] [INFO ] [REMOTE ] VLN: Full fetch complete (43127 records). [2025-09-29T21:46:41.452195] [DEBUG] [VALIDATOR ] VLN: Validating primary data. [2025-09-29T21:46:41.848476] [DEBUG] [VALIDATOR ] VLN: All expected trading days are present. [2025-09-29T21:46:41.848570] [DEBUG] [VALIDATOR ] VLN: Primary data validation passed. [2025-09-29T21:46:41.849491] [INFO ] [MAIN ] VLN: Fetched primary data is valid. [2025-09-29T21:46:41.849582] [DEBUG] [LOCAL ] VLN: Saving primary data. [2025-09-29T21:46:41.850594] [DEBUG] [LOCAL ] VLN: Trimmed 43127 records to 28862 (keeping 200 days of data) [2025-09-29T21:46:41.948285] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-05. [2025-09-29T21:46:42.022690] [DEBUG] [LOCAL ] VLN: Primary data saved (28862 records). [2025-09-29T21:46:42.022867] [INFO ] [MAIN ] VLN: Full history saved. [2025-09-29T21:46:42.022967] [INFO ] [MAIN ] Update Progress: 2234/2371 symbols completed. VLN took 44.8s. Estimated remaining: 17m 35s. Rate: 7.8 symbols/min [2025-09-29T21:46:42.196602] [INFO ] [MAIN ] VLTO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:46:42.244829] [DEBUG] [LOCAL ] VLTO: Loaded 46710 existing records from primary storage. [2025-09-29T21:46:42.245139] [INFO ] [MAIN ] VLTO: Loaded 46710 existing records. [2025-09-29T21:46:42.432387] [WARN ] [MAIN ] VLTO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:46:42.432684] [INFO ] [MAIN ] VLTO: Wiping existing primary data before full refresh. [2025-09-29T21:46:42.432745] [INFO ] [LOCAL ] VLTO: Starting deletion of primary data. [2025-09-29T21:46:42.434687] [DEBUG] [LOCAL ] VLTO: Deleted primary data file. [2025-09-29T21:46:42.434752] [INFO ] [MAIN ] VLTO: Starting full primary refresh. [2025-09-29T21:46:42.730899] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-29T21:46:42.753225] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-07. [2025-09-29T21:46:42.839011] [INFO ] [REMOTE ] VLTO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:46:42.852816] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-29T21:46:43.548160] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2024-12. [2025-09-29T21:46:44.329362] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-29T21:46:44.348087] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-06. [2025-09-29T21:46:44.838250] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-29T21:46:45.148156] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-07. [2025-09-29T21:46:45.234844] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-29T21:46:45.656738] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-29T21:46:45.948124] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-01. [2025-09-29T21:46:46.748130] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-08. [2025-09-29T21:46:47.363408] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-29T21:46:47.364169] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-29T21:46:47.548158] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-08. [2025-09-29T21:46:48.348134] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-08. [2025-09-29T21:46:48.660444] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-29T21:46:49.148101] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-02. [2025-09-29T21:46:49.790328] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-29T21:46:49.948168] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-09. [2025-09-29T21:46:50.367078] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-29T21:46:50.748176] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-09. [2025-09-29T21:46:51.503798] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-29T21:46:51.505601] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-29T21:46:51.529571] [INFO ] [REMOTE ] VLO: Full fetch complete (76932 records). [2025-09-29T21:46:51.530300] [DEBUG] [VALIDATOR ] VLO: Validating primary data. [2025-09-29T21:46:51.554467] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-03. [2025-09-29T21:46:51.563668] [INFO ] [REMOTE ] VLRS: Full fetch complete (58523 records). [2025-09-29T21:46:51.563967] [DEBUG] [VALIDATOR ] VLRS: Validating primary data. [2025-09-29T21:46:52.363057] [DEBUG] [VALIDATOR ] VLO: All expected trading days are present. [2025-09-29T21:46:52.370041] [DEBUG] [VALIDATOR ] VLO: Primary data validation passed. [2025-09-29T21:46:52.362851] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-09. [2025-09-29T21:46:52.372727] [INFO ] [MAIN ] VLO: Fetched primary data is valid. [2025-09-29T21:46:52.384320] [DEBUG] [LOCAL ] VLO: Saving primary data. [2025-09-29T21:46:52.387514] [DEBUG] [VALIDATOR ] VLRS: All expected trading days are present. [2025-09-29T21:46:52.387990] [DEBUG] [VALIDATOR ] VLRS: Primary data validation passed. [2025-09-29T21:46:52.388616] [INFO ] [MAIN ] VLRS: Fetched primary data is valid. [2025-09-29T21:46:52.389041] [DEBUG] [LOCAL ] VLRS: Saving primary data. [2025-09-29T21:46:52.390141] [DEBUG] [LOCAL ] VLO: Trimmed 76932 records to 53086 (keeping 200 days of data) [2025-09-29T21:46:52.391434] [DEBUG] [LOCAL ] VLRS: Trimmed 58523 records to 40414 (keeping 200 days of data) [2025-09-29T21:46:52.880629] [DEBUG] [LOCAL ] VLRS: Primary data saved (40414 records). [2025-09-29T21:46:52.882251] [INFO ] [MAIN ] VLRS: Full history saved. [2025-09-29T21:46:52.882392] [INFO ] [MAIN ] Update Progress: 2235/2371 symbols completed. VLRS took 32.5s. Estimated remaining: 17m 27s. Rate: 7.8 symbols/min [2025-09-29T21:46:53.091942] [INFO ] [MAIN ] VMC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:46:53.100051] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-29T21:46:53.105175] [INFO ] [REMOTE ] VLT: Full fetch complete (7507 records). [2025-09-29T21:46:53.105832] [DEBUG] [VALIDATOR ] VLT: Validating primary data. [2025-09-29T21:46:53.560949] [DEBUG] [LOCAL ] VMC: Loaded 44263 existing records from primary storage. [2025-09-29T21:46:53.559813] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-29T21:46:53.573708] [INFO ] [MAIN ] VMC: Loaded 44263 existing records. [2025-09-29T21:46:53.613296] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-04. [2025-09-29T21:46:53.800048] [DEBUG] [VALIDATOR ] VLT: All expected trading days are present. [2025-09-29T21:46:53.806322] [DEBUG] [VALIDATOR ] VLT: Primary data validation passed. [2025-09-29T21:46:53.806976] [INFO ] [MAIN ] VLT: Fetched primary data is valid. [2025-09-29T21:46:53.812886] [DEBUG] [LOCAL ] VLT: Saving primary data. [2025-09-29T21:46:53.846802] [DEBUG] [LOCAL ] VLT: Trimmed 7507 records to 4558 (keeping 200 days of data) [2025-09-29T21:46:53.890055] [WARN ] [MAIN ] VMC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:46:53.891514] [INFO ] [MAIN ] VMC: Wiping existing primary data before full refresh. [2025-09-29T21:46:53.896891] [DEBUG] [LOCAL ] VLO: Primary data saved (53086 records). [2025-09-29T21:46:53.893355] [INFO ] [LOCAL ] VMC: Starting deletion of primary data. [2025-09-29T21:46:53.909108] [INFO ] [MAIN ] VLO: Full history saved. [2025-09-29T21:46:53.918545] [INFO ] [MAIN ] Update Progress: 2236/2371 symbols completed. VLO took 33.9s. Estimated remaining: 17m 19s. Rate: 7.8 symbols/min [2025-09-29T21:46:53.924377] [DEBUG] [LOCAL ] VMC: Deleted primary data file. [2025-09-29T21:46:53.924631] [INFO ] [MAIN ] VMC: Starting full primary refresh. [2025-09-29T21:46:54.252433] [DEBUG] [LOCAL ] VLT: Primary data saved (4558 records). [2025-09-29T21:46:54.269291] [INFO ] [MAIN ] VLT: Full history saved. [2025-09-29T21:46:54.354854] [INFO ] [MAIN ] Update Progress: 2237/2371 symbols completed. VLT took 26.8s. Estimated remaining: 17m 11s. Rate: 7.8 symbols/min [2025-09-29T21:46:54.345171] [INFO ] [MAIN ] VMI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:46:54.542682] [INFO ] [REMOTE ] VMC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:46:54.549407] [INFO ] [REMOTE ] VMC: Fetching primary data for 2024-12. [2025-09-29T21:46:54.550814] [DEBUG] [LOCAL ] VMI: Loaded 15711 existing records from primary storage. [2025-09-29T21:46:54.551128] [INFO ] [MAIN ] VMI: Loaded 15711 existing records. [2025-09-29T21:46:54.742225] [WARN ] [MAIN ] VMI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:46:54.742457] [INFO ] [MAIN ] VMI: Wiping existing primary data before full refresh. [2025-09-29T21:46:54.742510] [INFO ] [LOCAL ] VMI: Starting deletion of primary data. [2025-09-29T21:46:54.742810] [DEBUG] [LOCAL ] VMI: Deleted primary data file. [2025-09-29T21:46:54.742871] [INFO ] [MAIN ] VMI: Starting full primary refresh. [2025-09-29T21:46:55.123546] [INFO ] [REMOTE ] VMI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:46:55.123956] [INFO ] [REMOTE ] VMI: Fetching primary data for 2024-12. [2025-09-29T21:46:55.162753] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-29T21:46:55.548179] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-05. [2025-09-29T21:46:55.883899] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-29T21:46:56.240901] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-29T21:46:56.348134] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-01. [2025-09-29T21:46:56.843232] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-29T21:46:57.148156] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-01. [2025-09-29T21:46:57.805844] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-29T21:46:57.824198] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-29T21:46:57.948116] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-02. [2025-09-29T21:46:58.748103] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-06. [2025-09-29T21:46:58.879197] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-29T21:46:59.548194] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-03. [2025-09-29T21:47:00.348139] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-02. [2025-09-29T21:47:00.401936] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-29T21:47:00.452240] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-29T21:47:01.148122] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-04. [2025-09-29T21:47:01.887786] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-29T21:47:01.948105] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-03. [2025-09-29T21:47:02.298246] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-29T21:47:02.748167] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-07. [2025-09-29T21:47:03.548094] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-05. [2025-09-29T21:47:03.721439] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-29T21:47:04.121057] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-29T21:47:04.348124] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-08. [2025-09-29T21:47:04.521136] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-29T21:47:05.148174] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-06. [2025-09-29T21:47:05.598150] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-29T21:47:05.815283] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-29T21:47:05.948197] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-09. [2025-09-29T21:47:06.748153] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-04. [2025-09-29T21:47:07.548125] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-07. [2025-09-29T21:47:07.609745] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-29T21:47:07.620155] [INFO ] [REMOTE ] VLTO: Full fetch complete (66818 records). [2025-09-29T21:47:07.620330] [DEBUG] [VALIDATOR ] VLTO: Validating primary data. [2025-09-29T21:47:08.043788] [DEBUG] [VALIDATOR ] VLTO: All expected trading days are present. [2025-09-29T21:47:08.043912] [DEBUG] [VALIDATOR ] VLTO: Primary data validation passed. [2025-09-29T21:47:08.045184] [INFO ] [MAIN ] VLTO: Fetched primary data is valid. [2025-09-29T21:47:08.045254] [DEBUG] [LOCAL ] VLTO: Saving primary data. [2025-09-29T21:47:08.046765] [DEBUG] [LOCAL ] VLTO: Trimmed 66818 records to 45975 (keeping 200 days of data) [2025-09-29T21:47:08.299136] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-29T21:47:08.331725] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-29T21:47:08.348280] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-05. [2025-09-29T21:47:08.413583] [DEBUG] [LOCAL ] VLTO: Primary data saved (45975 records). [2025-09-29T21:47:08.413847] [INFO ] [MAIN ] VLTO: Full history saved. [2025-09-29T21:47:08.413998] [INFO ] [MAIN ] Update Progress: 2238/2371 symbols completed. VLTO took 26.4s. Estimated remaining: 17m 4s. Rate: 7.8 symbols/min [2025-09-29T21:47:09.148097] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-08. [2025-09-29T21:47:09.975631] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-29T21:47:09.979881] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-09. [2025-09-29T21:47:10.048836] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-29T21:47:10.723184] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-29T21:47:10.726906] [INFO ] [REMOTE ] VMI: Full fetch complete (21237 records). [2025-09-29T21:47:10.727048] [DEBUG] [VALIDATOR ] VMI: Validating primary data. [2025-09-29T21:47:10.761594] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-06. [2025-09-29T21:47:11.123253] [DEBUG] [VALIDATOR ] VMI: All expected trading days are present. [2025-09-29T21:47:11.123333] [DEBUG] [VALIDATOR ] VMI: Primary data validation passed. [2025-09-29T21:47:11.123845] [INFO ] [MAIN ] VMI: Fetched primary data is valid. [2025-09-29T21:47:11.123909] [DEBUG] [LOCAL ] VMI: Saving primary data. [2025-09-29T21:47:11.124521] [DEBUG] [LOCAL ] VMI: Trimmed 21237 records to 15416 (keeping 200 days of data) [2025-09-29T21:47:11.223667] [DEBUG] [LOCAL ] VMI: Primary data saved (15416 records). [2025-09-29T21:47:11.223816] [INFO ] [MAIN ] VMI: Full history saved. [2025-09-29T21:47:11.223904] [INFO ] [MAIN ] Update Progress: 2239/2371 symbols completed. VMI took 17.3s. Estimated remaining: 16m 56s. Rate: 7.8 symbols/min [2025-09-29T21:47:12.370326] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-29T21:47:12.379585] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-07. [2025-09-29T21:47:14.134859] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-29T21:47:14.145337] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-08. [2025-09-29T21:47:15.573495] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-29T21:47:15.583041] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-09. [2025-09-29T21:47:16.083913] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-29T21:47:16.092193] [INFO ] [REMOTE ] VMC: Full fetch complete (62565 records). [2025-09-29T21:47:16.092314] [DEBUG] [VALIDATOR ] VMC: Validating primary data. [2025-09-29T21:47:16.499164] [DEBUG] [VALIDATOR ] VMC: All expected trading days are present. [2025-09-29T21:47:16.499255] [DEBUG] [VALIDATOR ] VMC: Primary data validation passed. [2025-09-29T21:47:16.500495] [INFO ] [MAIN ] VMC: Fetched primary data is valid. [2025-09-29T21:47:16.500564] [DEBUG] [LOCAL ] VMC: Saving primary data. [2025-09-29T21:47:16.501936] [DEBUG] [LOCAL ] VMC: Trimmed 62565 records to 43401 (keeping 200 days of data) [2025-09-29T21:47:16.788027] [DEBUG] [LOCAL ] VMC: Primary data saved (43401 records). [2025-09-29T21:47:16.788161] [INFO ] [MAIN ] VMC: Full history saved. [2025-09-29T21:47:16.788244] [INFO ] [MAIN ] Update Progress: 2240/2371 symbols completed. VMC took 23.9s. Estimated remaining: 16m 48s. Rate: 7.8 symbols/min [2025-09-29T21:47:17.473833] [INFO ] [MAIN ] VMO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:47:17.483659] [INFO ] [MAIN ] VNCE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:47:17.527238] [INFO ] [MAIN ] VNT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:47:17.564847] [INFO ] [MAIN ] VNO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:47:17.576550] [DEBUG] [LOCAL ] VNCE: Loaded 7593 existing records from primary storage. [2025-09-29T21:47:17.576902] [INFO ] [MAIN ] VNCE: Loaded 7593 existing records. [2025-09-29T21:47:17.731472] [DEBUG] [LOCAL ] VMO: Loaded 21297 existing records from primary storage. [2025-09-29T21:47:17.731979] [INFO ] [MAIN ] VMO: Loaded 21297 existing records. [2025-09-29T21:47:17.869549] [WARN ] [MAIN ] VNCE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:47:17.920429] [INFO ] [MAIN ] VNCE: Wiping existing primary data before full refresh. [2025-09-29T21:47:17.948911] [INFO ] [LOCAL ] VNCE: Starting deletion of primary data. [2025-09-29T21:47:17.970214] [DEBUG] [LOCAL ] VNT: Loaded 44451 existing records from primary storage. [2025-09-29T21:47:17.975891] [DEBUG] [LOCAL ] VNO: Loaded 49668 existing records from primary storage. [2025-09-29T21:47:17.976690] [INFO ] [MAIN ] VNT: Loaded 44451 existing records. [2025-09-29T21:47:17.982094] [DEBUG] [LOCAL ] VNCE: Deleted primary data file. [2025-09-29T21:47:18.003636] [INFO ] [MAIN ] VNO: Loaded 49668 existing records. [2025-09-29T21:47:18.003471] [INFO ] [MAIN ] VNCE: Starting full primary refresh. [2025-09-29T21:47:18.208639] [WARN ] [MAIN ] VMO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:47:18.408753] [INFO ] [MAIN ] VMO: Wiping existing primary data before full refresh. [2025-09-29T21:47:18.465399] [INFO ] [LOCAL ] VMO: Starting deletion of primary data. [2025-09-29T21:47:18.639200] [DEBUG] [LOCAL ] VMO: Deleted primary data file. [2025-09-29T21:47:18.635578] [WARN ] [MAIN ] VNO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:47:18.650267] [INFO ] [MAIN ] VNO: Wiping existing primary data before full refresh. [2025-09-29T21:47:18.642745] [WARN ] [MAIN ] VNT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:47:18.642872] [INFO ] [MAIN ] VMO: Starting full primary refresh. [2025-09-29T21:47:18.672752] [INFO ] [LOCAL ] VNO: Starting deletion of primary data. [2025-09-29T21:47:18.672666] [INFO ] [MAIN ] VNT: Wiping existing primary data before full refresh. [2025-09-29T21:47:18.815898] [DEBUG] [LOCAL ] VNO: Deleted primary data file. [2025-09-29T21:47:18.816100] [INFO ] [MAIN ] VNO: Starting full primary refresh. [2025-09-29T21:47:18.782119] [INFO ] [LOCAL ] VNT: Starting deletion of primary data. [2025-09-29T21:47:18.954230] [DEBUG] [LOCAL ] VNT: Deleted primary data file. [2025-09-29T21:47:19.044112] [INFO ] [MAIN ] VNT: Starting full primary refresh. [2025-09-29T21:47:19.257615] [INFO ] [REMOTE ] VNCE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:47:19.326531] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2024-12. [2025-09-29T21:47:19.621000] [INFO ] [REMOTE ] VMO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:47:19.659506] [INFO ] [REMOTE ] VMO: Fetching primary data for 2024-12. [2025-09-29T21:47:20.041361] [INFO ] [REMOTE ] VNO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:47:20.044134] [INFO ] [REMOTE ] VNO: Fetching primary data for 2024-12. [2025-09-29T21:47:20.065554] [INFO ] [REMOTE ] VNT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:47:20.065889] [INFO ] [REMOTE ] VNT: Fetching primary data for 2024-12. [2025-09-29T21:47:20.314862] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-29T21:47:20.319148] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-01. [2025-09-29T21:47:20.886808] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-29T21:47:20.892190] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-01. [2025-09-29T21:47:21.244497] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-29T21:47:21.252930] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-01. [2025-09-29T21:47:21.510215] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-29T21:47:21.516066] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-02. [2025-09-29T21:47:21.755285] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-29T21:47:21.765173] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-01. [2025-09-29T21:47:21.915083] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-29T21:47:21.919722] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-02. [2025-09-29T21:47:22.331750] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-29T21:47:22.334769] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-03. [2025-09-29T21:47:22.453356] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-29T21:47:22.738891] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-29T21:47:22.748066] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-04. [2025-09-29T21:47:23.058057] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-29T21:47:23.122617] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-29T21:47:23.227722] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-29T21:47:23.548112] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-05. [2025-09-29T21:47:24.074514] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-29T21:47:24.348133] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-02. [2025-09-29T21:47:25.148128] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-02. [2025-09-29T21:47:25.773150] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-29T21:47:25.948120] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-03. [2025-09-29T21:47:26.749676] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-03. [2025-09-29T21:47:26.752134] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-29T21:47:27.548107] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-06. [2025-09-29T21:47:27.605135] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-29T21:47:27.812980] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-29T21:47:28.227374] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-29T21:47:28.348120] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-04. [2025-09-29T21:47:29.148118] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-03. [2025-09-29T21:47:29.948186] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-04. [2025-09-29T21:47:29.990253] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-29T21:47:30.574815] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-29T21:47:30.748117] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-05. [2025-09-29T21:47:31.043509] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-29T21:47:31.548179] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-04. [2025-09-29T21:47:32.348143] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-05. [2025-09-29T21:47:32.411164] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-29T21:47:33.157788] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-06. [2025-09-29T21:47:33.161026] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-29T21:47:33.418837] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-29T21:47:33.948119] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-05. [2025-09-29T21:47:34.420736] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-29T21:47:34.748122] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-06. [2025-09-29T21:47:35.300461] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-29T21:47:35.553628] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-07. [2025-09-29T21:47:35.561423] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-29T21:47:36.348122] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-07. [2025-09-29T21:47:37.158541] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-07. [2025-09-29T21:47:37.164308] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-29T21:47:37.392547] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-29T21:47:37.575851] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-29T21:47:37.948127] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-08. [2025-09-29T21:47:38.748123] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-06. [2025-09-29T21:47:39.548239] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-08. [2025-09-29T21:47:39.578014] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-29T21:47:40.055965] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-29T21:47:40.355378] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-09. [2025-09-29T21:47:40.381331] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-29T21:47:41.148149] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-08. [2025-09-29T21:47:41.401348] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-29T21:47:41.406513] [INFO ] [REMOTE ] VNCE: Full fetch complete (15658 records). [2025-09-29T21:47:41.406631] [DEBUG] [VALIDATOR ] VNCE: Validating primary data. [2025-09-29T21:47:41.820455] [DEBUG] [VALIDATOR ] VNCE: All expected trading days are present. [2025-09-29T21:47:41.825890] [DEBUG] [VALIDATOR ] VNCE: Primary data validation passed. [2025-09-29T21:47:41.826539] [INFO ] [MAIN ] VNCE: Fetched primary data is valid. [2025-09-29T21:47:41.832873] [DEBUG] [LOCAL ] VNCE: Saving primary data. [2025-09-29T21:47:41.834436] [DEBUG] [LOCAL ] VNCE: Trimmed 15658 records to 7694 (keeping 200 days of data) [2025-09-29T21:47:41.834896] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-29T21:47:41.884687] [DEBUG] [LOCAL ] VNCE: Primary data saved (7694 records). [2025-09-29T21:47:41.884817] [INFO ] [MAIN ] VNCE: Full history saved. [2025-09-29T21:47:41.884973] [INFO ] [MAIN ] Update Progress: 2241/2371 symbols completed. VNCE took 25.1s. Estimated remaining: 16m 41s. Rate: 7.8 symbols/min [2025-09-29T21:47:41.953288] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-09. [2025-09-29T21:47:42.065449] [INFO ] [MAIN ] VOC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:47:42.078554] [DEBUG] [LOCAL ] VOC: Loaded 9021 existing records from primary storage. [2025-09-29T21:47:42.078837] [INFO ] [MAIN ] VOC: Loaded 9021 existing records. [2025-09-29T21:47:42.265947] [WARN ] [MAIN ] VOC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:47:42.266214] [INFO ] [MAIN ] VOC: Wiping existing primary data before full refresh. [2025-09-29T21:47:42.266261] [INFO ] [LOCAL ] VOC: Starting deletion of primary data. [2025-09-29T21:47:42.266573] [DEBUG] [LOCAL ] VOC: Deleted primary data file. [2025-09-29T21:47:42.266688] [INFO ] [MAIN ] VOC: Starting full primary refresh. [2025-09-29T21:47:42.639638] [INFO ] [REMOTE ] VOC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:47:42.748151] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-07. [2025-09-29T21:47:43.185847] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-29T21:47:43.195055] [INFO ] [REMOTE ] VNT: Full fetch complete (63473 records). [2025-09-29T21:47:43.195274] [DEBUG] [VALIDATOR ] VNT: Validating primary data. [2025-09-29T21:47:43.560989] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-09. [2025-09-29T21:47:43.615515] [DEBUG] [VALIDATOR ] VNT: All expected trading days are present. [2025-09-29T21:47:43.615630] [DEBUG] [VALIDATOR ] VNT: Primary data validation passed. [2025-09-29T21:47:43.617208] [INFO ] [MAIN ] VNT: Fetched primary data is valid. [2025-09-29T21:47:43.617291] [DEBUG] [LOCAL ] VNT: Saving primary data. [2025-09-29T21:47:43.619315] [DEBUG] [LOCAL ] VNT: Trimmed 63473 records to 43608 (keeping 200 days of data) [2025-09-29T21:47:43.913638] [DEBUG] [LOCAL ] VNT: Primary data saved (43608 records). [2025-09-29T21:47:43.913849] [INFO ] [MAIN ] VNT: Full history saved. [2025-09-29T21:47:43.919234] [INFO ] [MAIN ] Update Progress: 2242/2371 symbols completed. VNT took 27.1s. Estimated remaining: 16m 33s. Rate: 7.8 symbols/min [2025-09-29T21:47:44.111966] [INFO ] [MAIN ] VOYA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:47:44.159609] [DEBUG] [LOCAL ] VOYA: Loaded 43377 existing records from primary storage. [2025-09-29T21:47:44.160007] [INFO ] [MAIN ] VOYA: Loaded 43377 existing records. [2025-09-29T21:47:44.349911] [WARN ] [MAIN ] VOYA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:47:44.350007] [INFO ] [REMOTE ] VOC: Fetching primary data for 2024-12. [2025-09-29T21:47:44.350502] [INFO ] [MAIN ] VOYA: Wiping existing primary data before full refresh. [2025-09-29T21:47:44.351410] [INFO ] [LOCAL ] VOYA: Starting deletion of primary data. [2025-09-29T21:47:44.351963] [DEBUG] [LOCAL ] VOYA: Deleted primary data file. [2025-09-29T21:47:44.352037] [INFO ] [MAIN ] VOYA: Starting full primary refresh. [2025-09-29T21:47:44.736798] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-29T21:47:44.762550] [INFO ] [REMOTE ] VOYA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:47:44.824680] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-29T21:47:44.831383] [INFO ] [REMOTE ] VMO: Full fetch complete (31442 records). [2025-09-29T21:47:44.831504] [DEBUG] [VALIDATOR ] VMO: Validating primary data. [2025-09-29T21:47:45.188861] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-08. [2025-09-29T21:47:45.286447] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-29T21:47:45.302984] [DEBUG] [VALIDATOR ] VMO: All expected trading days are present. [2025-09-29T21:47:45.303068] [DEBUG] [VALIDATOR ] VMO: Primary data validation passed. [2025-09-29T21:47:45.303863] [INFO ] [MAIN ] VMO: Fetched primary data is valid. [2025-09-29T21:47:45.303931] [DEBUG] [LOCAL ] VMO: Saving primary data. [2025-09-29T21:47:45.304872] [DEBUG] [LOCAL ] VMO: Trimmed 31442 records to 20979 (keeping 200 days of data) [2025-09-29T21:47:45.441087] [DEBUG] [LOCAL ] VMO: Primary data saved (20979 records). [2025-09-29T21:47:45.441220] [INFO ] [MAIN ] VMO: Full history saved. [2025-09-29T21:47:45.441313] [INFO ] [MAIN ] Update Progress: 2243/2371 symbols completed. VMO took 28.7s. Estimated remaining: 16m 25s. Rate: 7.8 symbols/min [2025-09-29T21:47:45.625964] [INFO ] [MAIN ] VOYG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:47:45.626142] [DEBUG] [LOCAL ] VOYG: No existing data file found in primary storage. [2025-09-29T21:47:45.626183] [WARN ] [MAIN ] VOYG: No existing data found, performing full refresh instead. [2025-09-29T21:47:45.626298] [INFO ] [MAIN ] VOYG: Wiping existing primary data before full refresh. [2025-09-29T21:47:45.626343] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-09-29T21:47:45.626387] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-09-29T21:47:45.626441] [INFO ] [MAIN ] VOYG: Starting full primary refresh. [2025-09-29T21:47:45.953366] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2024-12. [2025-09-29T21:47:46.019264] [INFO ] [REMOTE ] VOYG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:47:46.748076] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2024-12. [2025-09-29T21:47:46.862876] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-29T21:47:46.953747] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T21:47:46.954136] [WARN ] [REMOTE ] VOYG: No data returned for month 2024-12 [2025-09-29T21:47:46.954229] [FATAL] [REMOTE ] VOYG: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T21:47:46.954299] [FATAL] [MAIN ] VOYG: Failed to fetch primary data. [2025-09-29T21:47:46.954370] [WARN ] [MAIN ] VOYG: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T21:47:46.954451] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-09-29T21:47:46.954518] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-09-29T21:47:46.954556] [INFO ] [LOCAL ] VOYG: Starting deletion of derivative data. [2025-09-29T21:47:46.954622] [DEBUG] [LOCAL ] VOYG: No derivative data file found to delete. [2025-09-29T21:47:46.954723] [INFO ] [MAIN ] Update Progress: 2244/2371 symbols completed. VOYG took 1.5s. Estimated remaining: 16m 17s. Rate: 7.8 symbols/min [2025-09-29T21:47:47.132950] [INFO ] [MAIN ] VPG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:47:47.151748] [DEBUG] [LOCAL ] VPG: Loaded 17373 existing records from primary storage. [2025-09-29T21:47:47.152039] [INFO ] [MAIN ] VPG: Loaded 17373 existing records. [2025-09-29T21:47:47.347164] [WARN ] [MAIN ] VPG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:47:47.347450] [INFO ] [MAIN ] VPG: Wiping existing primary data before full refresh. [2025-09-29T21:47:47.347509] [INFO ] [LOCAL ] VPG: Starting deletion of primary data. [2025-09-29T21:47:47.347783] [DEBUG] [LOCAL ] VPG: Deleted primary data file. [2025-09-29T21:47:47.347856] [INFO ] [MAIN ] VPG: Starting full primary refresh. [2025-09-29T21:47:47.553213] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-09. [2025-09-29T21:47:47.736570] [INFO ] [REMOTE ] VPG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:47:47.762506] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-29T21:47:48.348169] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-01. [2025-09-29T21:47:48.915220] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-29T21:47:48.927422] [INFO ] [REMOTE ] VNO: Full fetch complete (70497 records). [2025-09-29T21:47:48.927601] [DEBUG] [VALIDATOR ] VNO: Validating primary data. [2025-09-29T21:47:49.154514] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-01. [2025-09-29T21:47:49.226914] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-29T21:47:49.369676] [DEBUG] [VALIDATOR ] VNO: All expected trading days are present. [2025-09-29T21:47:49.369788] [DEBUG] [VALIDATOR ] VNO: Primary data validation passed. [2025-09-29T21:47:49.370998] [INFO ] [MAIN ] VNO: Fetched primary data is valid. [2025-09-29T21:47:49.371070] [DEBUG] [LOCAL ] VNO: Saving primary data. [2025-09-29T21:47:49.372587] [DEBUG] [LOCAL ] VNO: Trimmed 70497 records to 48911 (keeping 200 days of data) [2025-09-29T21:47:49.678364] [DEBUG] [LOCAL ] VNO: Primary data saved (48911 records). [2025-09-29T21:47:49.678562] [INFO ] [MAIN ] VNO: Full history saved. [2025-09-29T21:47:49.678708] [INFO ] [MAIN ] Update Progress: 2245/2371 symbols completed. VNO took 32.9s. Estimated remaining: 16m 9s. Rate: 7.8 symbols/min [2025-09-29T21:47:49.873279] [INFO ] [MAIN ] VPV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:47:49.881934] [DEBUG] [LOCAL ] VPV: Loaded 5429 existing records from primary storage. [2025-09-29T21:47:49.882158] [INFO ] [MAIN ] VPV: Loaded 5429 existing records. [2025-09-29T21:47:49.953288] [INFO ] [REMOTE ] VPG: Fetching primary data for 2024-12. [2025-09-29T21:47:50.070810] [WARN ] [MAIN ] VPV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:47:50.071039] [INFO ] [MAIN ] VPV: Wiping existing primary data before full refresh. [2025-09-29T21:47:50.071091] [INFO ] [LOCAL ] VPV: Starting deletion of primary data. [2025-09-29T21:47:50.071313] [DEBUG] [LOCAL ] VPV: Deleted primary data file. [2025-09-29T21:47:50.071374] [INFO ] [MAIN ] VPV: Starting full primary refresh. [2025-09-29T21:47:50.439061] [INFO ] [REMOTE ] VPV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:47:50.695554] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-29T21:47:50.748114] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-01. [2025-09-29T21:47:50.976832] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-29T21:47:51.548122] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-02. [2025-09-29T21:47:51.574223] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-29T21:47:52.348167] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-02. [2025-09-29T21:47:53.116722] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-29T21:47:53.151512] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-02. [2025-09-29T21:47:53.155407] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-29T21:47:53.702553] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-29T21:47:53.948118] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-03. [2025-09-29T21:47:54.729628] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-29T21:47:54.748104] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-04. [2025-09-29T21:47:55.548158] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-03. [2025-09-29T21:47:55.590484] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-29T21:47:56.348093] [INFO ] [REMOTE ] VPV: Fetching primary data for 2024-12. [2025-09-29T21:47:56.468198] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-29T21:47:57.148091] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-04. [2025-09-29T21:47:57.217139] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-29T21:47:57.948122] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-01. [2025-09-29T21:47:58.419290] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-29T21:47:58.485172] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-29T21:47:58.748141] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-03. [2025-09-29T21:47:59.548120] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-05. [2025-09-29T21:48:00.348090] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-05. [2025-09-29T21:48:00.471328] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-29T21:48:00.528302] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-29T21:48:00.850226] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-29T21:48:01.148136] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-06. [2025-09-29T21:48:01.948136] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-02. [2025-09-29T21:48:02.214268] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-29T21:48:02.524268] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-29T21:48:02.748133] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-04. [2025-09-29T21:48:03.548119] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-07. [2025-09-29T21:48:04.348103] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-03. [2025-09-29T21:48:04.399320] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-29T21:48:04.578455] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-29T21:48:04.880917] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-29T21:48:05.148121] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-05. [2025-09-29T21:48:05.948109] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-04. [2025-09-29T21:48:06.489740] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-29T21:48:06.612489] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-29T21:48:06.748174] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-08. [2025-09-29T21:48:07.335081] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-29T21:48:07.548174] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-05. [2025-09-29T21:48:08.166604] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-29T21:48:08.348207] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-06. [2025-09-29T21:48:08.793463] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-29T21:48:09.148141] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-09. [2025-09-29T21:48:09.948102] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-06. [2025-09-29T21:48:09.958889] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-29T21:48:09.962215] [INFO ] [REMOTE ] VPG: Full fetch complete (22942 records). [2025-09-29T21:48:09.962298] [DEBUG] [VALIDATOR ] VPG: Validating primary data. [2025-09-29T21:48:10.366781] [DEBUG] [VALIDATOR ] VPG: All expected trading days are present. [2025-09-29T21:48:10.366869] [DEBUG] [VALIDATOR ] VPG: Primary data validation passed. [2025-09-29T21:48:10.367475] [INFO ] [MAIN ] VPG: Fetched primary data is valid. [2025-09-29T21:48:10.367550] [DEBUG] [LOCAL ] VPG: Saving primary data. [2025-09-29T21:48:10.368343] [DEBUG] [LOCAL ] VPG: Trimmed 22942 records to 17049 (keeping 200 days of data) [2025-09-29T21:48:10.474830] [DEBUG] [LOCAL ] VPG: Primary data saved (17049 records). [2025-09-29T21:48:10.474986] [INFO ] [MAIN ] VPG: Full history saved. [2025-09-29T21:48:10.475092] [INFO ] [MAIN ] Update Progress: 2246/2371 symbols completed. VPG took 23.5s. Estimated remaining: 16m 2s. Rate: 7.8 symbols/min [2025-09-29T21:48:10.654821] [INFO ] [MAIN ] VRE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:48:10.698796] [DEBUG] [LOCAL ] VRE: Loaded 35345 existing records from primary storage. [2025-09-29T21:48:10.699096] [INFO ] [MAIN ] VRE: Loaded 35345 existing records. [2025-09-29T21:48:10.753231] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-06. [2025-09-29T21:48:10.810248] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-29T21:48:10.899014] [WARN ] [MAIN ] VRE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:48:10.899321] [INFO ] [MAIN ] VRE: Wiping existing primary data before full refresh. [2025-09-29T21:48:10.899379] [INFO ] [LOCAL ] VRE: Starting deletion of primary data. [2025-09-29T21:48:10.899752] [DEBUG] [LOCAL ] VRE: Deleted primary data file. [2025-09-29T21:48:10.899812] [INFO ] [MAIN ] VRE: Starting full primary refresh. [2025-09-29T21:48:11.267566] [INFO ] [REMOTE ] VRE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:48:11.548123] [INFO ] [REMOTE ] VRE: Fetching primary data for 2024-12. [2025-09-29T21:48:11.953868] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-29T21:48:12.348141] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-07. [2025-09-29T21:48:12.916604] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-29T21:48:13.148150] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-07. [2025-09-29T21:48:13.869849] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-29T21:48:13.948137] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-07. [2025-09-29T21:48:14.032995] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-29T21:48:14.737908] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-29T21:48:14.748060] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-08. [2025-09-29T21:48:15.548180] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-01. [2025-09-29T21:48:15.570780] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-29T21:48:16.348114] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-09. [2025-09-29T21:48:16.576416] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-29T21:48:17.148106] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-08. [2025-09-29T21:48:17.174188] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-29T21:48:17.176347] [INFO ] [REMOTE ] VOC: Full fetch complete (13118 records). [2025-09-29T21:48:17.176423] [DEBUG] [VALIDATOR ] VOC: Validating primary data. [2025-09-29T21:48:17.563589] [DEBUG] [VALIDATOR ] VOC: All expected trading days are present. [2025-09-29T21:48:17.563723] [DEBUG] [VALIDATOR ] VOC: Primary data validation passed. [2025-09-29T21:48:17.564081] [INFO ] [MAIN ] VOC: Fetched primary data is valid. [2025-09-29T21:48:17.564129] [DEBUG] [LOCAL ] VOC: Saving primary data. [2025-09-29T21:48:17.564672] [DEBUG] [LOCAL ] VOC: Trimmed 13118 records to 8895 (keeping 200 days of data) [2025-09-29T21:48:17.618960] [DEBUG] [LOCAL ] VOC: Primary data saved (8895 records). [2025-09-29T21:48:17.619111] [INFO ] [MAIN ] VOC: Full history saved. [2025-09-29T21:48:17.619198] [INFO ] [MAIN ] Update Progress: 2247/2371 symbols completed. VOC took 35.7s. Estimated remaining: 15m 54s. Rate: 7.8 symbols/min [2025-09-29T21:48:17.794551] [INFO ] [MAIN ] VRT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:48:17.859071] [DEBUG] [LOCAL ] VRT: Loaded 54533 existing records from primary storage. [2025-09-29T21:48:17.859494] [INFO ] [MAIN ] VRT: Loaded 54533 existing records. [2025-09-29T21:48:17.956225] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-02. [2025-09-29T21:48:18.051224] [WARN ] [MAIN ] VRT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:48:18.051402] [INFO ] [MAIN ] VRT: Wiping existing primary data before full refresh. [2025-09-29T21:48:18.051450] [INFO ] [LOCAL ] VRT: Starting deletion of primary data. [2025-09-29T21:48:18.051869] [DEBUG] [LOCAL ] VRT: Deleted primary data file. [2025-09-29T21:48:18.051929] [INFO ] [MAIN ] VRT: Starting full primary refresh. [2025-09-29T21:48:18.438294] [INFO ] [REMOTE ] VRT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:48:18.607928] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-29T21:48:18.748124] [INFO ] [REMOTE ] VRT: Fetching primary data for 2024-12. [2025-09-29T21:48:18.947335] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-29T21:48:19.548132] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-03. [2025-09-29T21:48:20.348116] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-09. [2025-09-29T21:48:20.573353] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-29T21:48:20.740382] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-29T21:48:21.148117] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-01. [2025-09-29T21:48:21.881203] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-29T21:48:21.890127] [INFO ] [REMOTE ] VOYA: Full fetch complete (62039 records). [2025-09-29T21:48:21.890263] [DEBUG] [VALIDATOR ] VOYA: Validating primary data. [2025-09-29T21:48:21.960220] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-08. [2025-09-29T21:48:22.313853] [DEBUG] [VALIDATOR ] VOYA: All expected trading days are present. [2025-09-29T21:48:22.313965] [DEBUG] [VALIDATOR ] VOYA: Primary data validation passed. [2025-09-29T21:48:22.315051] [INFO ] [MAIN ] VOYA: Fetched primary data is valid. [2025-09-29T21:48:22.315114] [DEBUG] [LOCAL ] VOYA: Saving primary data. [2025-09-29T21:48:22.316439] [DEBUG] [LOCAL ] VOYA: Trimmed 62039 records to 42548 (keeping 200 days of data) [2025-09-29T21:48:22.591123] [DEBUG] [LOCAL ] VOYA: Primary data saved (42548 records). [2025-09-29T21:48:22.591254] [INFO ] [MAIN ] VOYA: Full history saved. [2025-09-29T21:48:22.591336] [INFO ] [MAIN ] Update Progress: 2248/2371 symbols completed. VOYA took 38.7s. Estimated remaining: 15m 47s. Rate: 7.8 symbols/min [2025-09-29T21:48:22.710342] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-29T21:48:22.773561] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-09. [2025-09-29T21:48:22.777744] [INFO ] [MAIN ] VRTS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:48:22.792480] [DEBUG] [LOCAL ] VRTS: Loaded 9287 existing records from primary storage. [2025-09-29T21:48:22.792864] [INFO ] [MAIN ] VRTS: Loaded 9287 existing records. [2025-09-29T21:48:22.983141] [WARN ] [MAIN ] VRTS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:48:22.983524] [INFO ] [MAIN ] VRTS: Wiping existing primary data before full refresh. [2025-09-29T21:48:22.983576] [INFO ] [LOCAL ] VRTS: Starting deletion of primary data. [2025-09-29T21:48:22.983780] [DEBUG] [LOCAL ] VRTS: Deleted primary data file. [2025-09-29T21:48:22.983838] [INFO ] [MAIN ] VRTS: Starting full primary refresh. [2025-09-29T21:48:23.364857] [INFO ] [REMOTE ] VRTS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:48:23.412377] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-29T21:48:23.414757] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-09-29T21:48:23.428335] [INFO ] [REMOTE ] VPV: Full fetch complete (9334 records). [2025-09-29T21:48:23.429280] [DEBUG] [VALIDATOR ] VPV: Validating primary data. [2025-09-29T21:48:23.553332] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-02. [2025-09-29T21:48:23.829570] [DEBUG] [VALIDATOR ] VPV: All expected trading days are present. [2025-09-29T21:48:23.829678] [DEBUG] [VALIDATOR ] VPV: Primary data validation passed. [2025-09-29T21:48:23.829978] [INFO ] [MAIN ] VPV: Fetched primary data is valid. [2025-09-29T21:48:23.830021] [DEBUG] [LOCAL ] VPV: Saving primary data. [2025-09-29T21:48:23.830559] [DEBUG] [LOCAL ] VPV: Trimmed 9334 records to 5403 (keeping 200 days of data) [2025-09-29T21:48:23.867523] [DEBUG] [LOCAL ] VPV: Primary data saved (5403 records). [2025-09-29T21:48:23.867703] [INFO ] [MAIN ] VPV: Full history saved. [2025-09-29T21:48:23.867810] [INFO ] [MAIN ] Update Progress: 2249/2371 symbols completed. VPV took 34.2s. Estimated remaining: 15m 39s. Rate: 7.8 symbols/min [2025-09-29T21:48:24.053342] [INFO ] [MAIN ] VSCO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:48:24.111384] [DEBUG] [LOCAL ] VSCO: Loaded 53556 existing records from primary storage. [2025-09-29T21:48:24.111772] [INFO ] [MAIN ] VSCO: Loaded 53556 existing records. [2025-09-29T21:48:24.301276] [WARN ] [MAIN ] VSCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:48:24.301523] [INFO ] [MAIN ] VSCO: Wiping existing primary data before full refresh. [2025-09-29T21:48:24.301573] [INFO ] [LOCAL ] VSCO: Starting deletion of primary data. [2025-09-29T21:48:24.302079] [DEBUG] [LOCAL ] VSCO: Deleted primary data file. [2025-09-29T21:48:24.302138] [INFO ] [MAIN ] VSCO: Starting full primary refresh. [2025-09-29T21:48:24.356699] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-04. [2025-09-29T21:48:24.700385] [INFO ] [REMOTE ] VSCO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:48:25.148121] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2024-12. [2025-09-29T21:48:25.838600] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-29T21:48:25.864143] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-29T21:48:25.948107] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-01. [2025-09-29T21:48:25.984071] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-09-29T21:48:26.608257] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-29T21:48:26.748117] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-02. [2025-09-29T21:48:27.459893] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-29T21:48:27.548147] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-03. [2025-09-29T21:48:28.348118] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-03. [2025-09-29T21:48:29.060372] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-29T21:48:29.148168] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2024-12. [2025-09-29T21:48:29.948079] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-04. [2025-09-29T21:48:30.011097] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-09-29T21:48:30.717496] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-29T21:48:30.720105] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-29T21:48:30.748080] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-05. [2025-09-29T21:48:31.251325] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-29T21:48:31.548137] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-04. [2025-09-29T21:48:32.348131] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-06. [2025-09-29T21:48:33.033690] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-29T21:48:33.148146] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-01. [2025-09-29T21:48:33.948176] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-05. [2025-09-29T21:48:34.078287] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-04 (2.53 seconds). [2025-09-29T21:48:34.532733] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-29T21:48:34.748156] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-02. [2025-09-29T21:48:35.034313] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-29T21:48:35.548119] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-06. [2025-09-29T21:48:36.343467] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-29T21:48:36.353305] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-07. [2025-09-29T21:48:36.954710] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-29T21:48:36.984611] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-29T21:48:37.148124] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-07. [2025-09-29T21:48:37.948135] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-08. [2025-09-29T21:48:38.219084] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-29T21:48:38.748119] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-08. [2025-09-29T21:48:38.828736] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-29T21:48:39.548131] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-09. [2025-09-29T21:48:39.744876] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-29T21:48:40.265694] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-29T21:48:40.268004] [INFO ] [REMOTE ] VRTS: Full fetch complete (11352 records). [2025-09-29T21:48:40.268092] [DEBUG] [VALIDATOR ] VRTS: Validating primary data. [2025-09-29T21:48:40.353200] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-05. [2025-09-29T21:48:40.650907] [DEBUG] [VALIDATOR ] VRTS: All expected trading days are present. [2025-09-29T21:48:40.651001] [DEBUG] [VALIDATOR ] VRTS: Primary data validation passed. [2025-09-29T21:48:40.651326] [INFO ] [MAIN ] VRTS: Fetched primary data is valid. [2025-09-29T21:48:40.651371] [DEBUG] [LOCAL ] VRTS: Saving primary data. [2025-09-29T21:48:40.651941] [DEBUG] [LOCAL ] VRTS: Trimmed 11352 records to 9211 (keeping 200 days of data) [2025-09-29T21:48:40.716847] [DEBUG] [LOCAL ] VRTS: Primary data saved (9211 records). [2025-09-29T21:48:40.717723] [INFO ] [MAIN ] VRTS: Full history saved. [2025-09-29T21:48:40.717987] [INFO ] [MAIN ] Update Progress: 2250/2371 symbols completed. VRTS took 18.1s. Estimated remaining: 15m 31s. Rate: 7.8 symbols/min [2025-09-29T21:48:40.931304] [INFO ] [MAIN ] VSH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:48:40.983753] [DEBUG] [LOCAL ] VSH: Loaded 49188 existing records from primary storage. [2025-09-29T21:48:40.984087] [INFO ] [MAIN ] VSH: Loaded 49188 existing records. [2025-09-29T21:48:41.155575] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-03. [2025-09-29T21:48:41.183972] [WARN ] [MAIN ] VSH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:48:41.184375] [INFO ] [MAIN ] VSH: Wiping existing primary data before full refresh. [2025-09-29T21:48:41.184432] [INFO ] [LOCAL ] VSH: Starting deletion of primary data. [2025-09-29T21:48:41.184936] [DEBUG] [LOCAL ] VSH: Deleted primary data file. [2025-09-29T21:48:41.184998] [INFO ] [MAIN ] VSH: Starting full primary refresh. [2025-09-29T21:48:41.592068] [INFO ] [REMOTE ] VSH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:48:41.948134] [INFO ] [REMOTE ] VSH: Fetching primary data for 2024-12. [2025-09-29T21:48:42.499759] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-29T21:48:42.748120] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-06. [2025-09-29T21:48:43.196019] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-29T21:48:43.548107] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-04. [2025-09-29T21:48:43.799190] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-29T21:48:44.348161] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-01. [2025-09-29T21:48:45.036504] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-09-29T21:48:45.148133] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-07. [2025-09-29T21:48:45.453675] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-29T21:48:45.598732] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-29T21:48:45.948170] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-09. [2025-09-29T21:48:46.748130] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-02. [2025-09-29T21:48:47.219886] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-29T21:48:47.229288] [INFO ] [REMOTE ] VRE: Full fetch complete (48010 records). [2025-09-29T21:48:47.229469] [DEBUG] [VALIDATOR ] VRE: Validating primary data. [2025-09-29T21:48:47.563531] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-05. [2025-09-29T21:48:47.644573] [DEBUG] [VALIDATOR ] VRE: All expected trading days are present. [2025-09-29T21:48:47.644852] [DEBUG] [VALIDATOR ] VRE: Primary data validation passed. [2025-09-29T21:48:47.645962] [INFO ] [MAIN ] VRE: Fetched primary data is valid. [2025-09-29T21:48:47.646044] [DEBUG] [LOCAL ] VRE: Saving primary data. [2025-09-29T21:48:47.680103] [DEBUG] [LOCAL ] VRE: Trimmed 48010 records to 34845 (keeping 200 days of data) [2025-09-29T21:48:47.682179] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-09-29T21:48:47.918345] [DEBUG] [LOCAL ] VRE: Primary data saved (34845 records). [2025-09-29T21:48:47.918503] [INFO ] [MAIN ] VRE: Full history saved. [2025-09-29T21:48:47.918595] [INFO ] [MAIN ] Update Progress: 2251/2371 symbols completed. VRE took 37.4s. Estimated remaining: 15m 24s. Rate: 7.8 symbols/min [2025-09-29T21:48:48.103572] [INFO ] [MAIN ] VST: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:48:48.157932] [DEBUG] [LOCAL ] VST: Loaded 54498 existing records from primary storage. [2025-09-29T21:48:48.158432] [INFO ] [MAIN ] VST: Loaded 54498 existing records. [2025-09-29T21:48:48.362473] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-08. [2025-09-29T21:48:48.365102] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-29T21:48:48.395790] [WARN ] [MAIN ] VST: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:48:48.405767] [INFO ] [MAIN ] VST: Wiping existing primary data before full refresh. [2025-09-29T21:48:48.406196] [INFO ] [LOCAL ] VST: Starting deletion of primary data. [2025-09-29T21:48:48.407327] [DEBUG] [LOCAL ] VST: Deleted primary data file. [2025-09-29T21:48:48.407405] [INFO ] [MAIN ] VST: Starting full primary refresh. [2025-09-29T21:48:48.816674] [INFO ] [REMOTE ] VST: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:48:49.148137] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-03. [2025-09-29T21:48:49.581793] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-29T21:48:49.948151] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-06. [2025-09-29T21:48:50.737801] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-29T21:48:50.749114] [INFO ] [REMOTE ] VST: Fetching primary data for 2024-12. [2025-09-29T21:48:50.975758] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-08 (2.61 seconds). [2025-09-29T21:48:51.548088] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-04. [2025-09-29T21:48:51.787635] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-29T21:48:52.348117] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-09. [2025-09-29T21:48:53.148105] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-07. [2025-09-29T21:48:53.255814] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2024-12 (2.51 seconds). [2025-09-29T21:48:53.299283] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-29T21:48:53.948145] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-01. [2025-09-29T21:48:54.522333] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-29T21:48:54.533582] [INFO ] [REMOTE ] VRT: Full fetch complete (77831 records). [2025-09-29T21:48:54.533775] [DEBUG] [VALIDATOR ] VRT: Validating primary data. [2025-09-29T21:48:54.756752] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-05. [2025-09-29T21:48:54.993351] [DEBUG] [VALIDATOR ] VRT: All expected trading days are present. [2025-09-29T21:48:54.993593] [DEBUG] [VALIDATOR ] VRT: Primary data validation passed. [2025-09-29T21:48:54.994881] [INFO ] [MAIN ] VRT: Fetched primary data is valid. [2025-09-29T21:48:54.994967] [DEBUG] [LOCAL ] VRT: Saving primary data. [2025-09-29T21:48:55.027213] [DEBUG] [LOCAL ] VRT: Trimmed 77831 records to 53753 (keeping 200 days of data) [2025-09-29T21:48:55.028935] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-29T21:48:55.394292] [DEBUG] [LOCAL ] VRT: Primary data saved (53753 records). [2025-09-29T21:48:55.394440] [INFO ] [MAIN ] VRT: Full history saved. [2025-09-29T21:48:55.394536] [INFO ] [MAIN ] Update Progress: 2252/2371 symbols completed. VRT took 37.8s. Estimated remaining: 15m 16s. Rate: 7.8 symbols/min [2025-09-29T21:48:55.555747] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-08. [2025-09-29T21:48:55.577717] [INFO ] [MAIN ] VSTS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:48:55.624550] [DEBUG] [LOCAL ] VSTS: Loaded 49773 existing records from primary storage. [2025-09-29T21:48:55.624912] [INFO ] [MAIN ] VSTS: Loaded 49773 existing records. [2025-09-29T21:48:55.817378] [WARN ] [MAIN ] VSTS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:48:55.817624] [INFO ] [MAIN ] VSTS: Wiping existing primary data before full refresh. [2025-09-29T21:48:55.817704] [INFO ] [LOCAL ] VSTS: Starting deletion of primary data. [2025-09-29T21:48:55.818193] [DEBUG] [LOCAL ] VSTS: Deleted primary data file. [2025-09-29T21:48:55.818254] [INFO ] [MAIN ] VSTS: Starting full primary refresh. [2025-09-29T21:48:56.186627] [INFO ] [REMOTE ] VSTS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:48:56.348123] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2024-12. [2025-09-29T21:48:56.578407] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-01 (2.63 seconds). [2025-09-29T21:48:56.633708] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-29T21:48:56.931081] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-29T21:48:57.148149] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-02. [2025-09-29T21:48:57.816196] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-29T21:48:57.948125] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-09. [2025-09-29T21:48:58.748137] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-06. [2025-09-29T21:48:59.517972] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-29T21:48:59.534781] [INFO ] [REMOTE ] VSCO: Full fetch complete (76174 records). [2025-09-29T21:48:59.535010] [DEBUG] [VALIDATOR ] VSCO: Validating primary data. [2025-09-29T21:48:59.555520] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-01. [2025-09-29T21:49:00.223376] [DEBUG] [VALIDATOR ] VSCO: All expected trading days are present. [2025-09-29T21:49:00.223544] [DEBUG] [VALIDATOR ] VSCO: Primary data validation passed. [2025-09-29T21:49:00.225758] [INFO ] [MAIN ] VSCO: Fetched primary data is valid. [2025-09-29T21:49:00.225966] [DEBUG] [LOCAL ] VSCO: Saving primary data. [2025-09-29T21:49:00.229880] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-02 (3.08 seconds). [2025-09-29T21:49:00.245165] [DEBUG] [LOCAL ] VSCO: Trimmed 76174 records to 52776 (keeping 200 days of data) [2025-09-29T21:49:00.353340] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-03. [2025-09-29T21:49:00.405564] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-29T21:49:00.705776] [DEBUG] [LOCAL ] VSCO: Primary data saved (52776 records). [2025-09-29T21:49:00.705942] [INFO ] [MAIN ] VSCO: Full history saved. [2025-09-29T21:49:00.706070] [INFO ] [MAIN ] Update Progress: 2253/2371 symbols completed. VSCO took 36.8s. Estimated remaining: 15m 8s. Rate: 7.8 symbols/min [2025-09-29T21:49:00.893765] [INFO ] [MAIN ] VTEX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:49:00.940209] [DEBUG] [LOCAL ] VTEX: Loaded 43948 existing records from primary storage. [2025-09-29T21:49:00.940567] [INFO ] [MAIN ] VTEX: Loaded 43948 existing records. [2025-09-29T21:49:01.132551] [WARN ] [MAIN ] VTEX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:49:01.132941] [INFO ] [MAIN ] VTEX: Wiping existing primary data before full refresh. [2025-09-29T21:49:01.133216] [INFO ] [LOCAL ] VTEX: Starting deletion of primary data. [2025-09-29T21:49:01.134107] [DEBUG] [LOCAL ] VTEX: Deleted primary data file. [2025-09-29T21:49:01.134168] [INFO ] [MAIN ] VTEX: Starting full primary refresh. [2025-09-29T21:49:01.167709] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-07. [2025-09-29T21:49:01.452592] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-29T21:49:01.572607] [INFO ] [REMOTE ] VTEX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:49:01.948132] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-02. [2025-09-29T21:49:02.578305] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-29T21:49:02.748166] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-04. [2025-09-29T21:49:03.044030] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-29T21:49:03.434120] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-29T21:49:03.548127] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-03. [2025-09-29T21:49:04.348112] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-08. [2025-09-29T21:49:05.105391] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-29T21:49:05.148100] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2024-12. [2025-09-29T21:49:05.301135] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-29T21:49:05.948133] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-05. [2025-09-29T21:49:06.162502] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-29T21:49:06.217565] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-29T21:49:06.748184] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-01. [2025-09-29T21:49:07.548180] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-04. [2025-09-29T21:49:08.175262] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-29T21:49:08.227769] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-29T21:49:08.348125] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-02. [2025-09-29T21:49:08.820475] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-29T21:49:09.148140] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-06. [2025-09-29T21:49:09.817608] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-29T21:49:09.948096] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-05. [2025-09-29T21:49:10.748124] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-09. [2025-09-29T21:49:11.154002] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-29T21:49:11.446339] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-29T21:49:11.548156] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-07. [2025-09-29T21:49:12.352691] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-06. [2025-09-29T21:49:12.363679] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-29T21:49:12.375512] [INFO ] [REMOTE ] VSH: Full fetch complete (71030 records). [2025-09-29T21:49:12.375706] [DEBUG] [VALIDATOR ] VSH: Validating primary data. [2025-09-29T21:49:12.786794] [DEBUG] [VALIDATOR ] VSH: All expected trading days are present. [2025-09-29T21:49:12.786883] [DEBUG] [VALIDATOR ] VSH: Primary data validation passed. [2025-09-29T21:49:12.788121] [INFO ] [MAIN ] VSH: Fetched primary data is valid. [2025-09-29T21:49:12.788199] [DEBUG] [LOCAL ] VSH: Saving primary data. [2025-09-29T21:49:12.789762] [DEBUG] [LOCAL ] VSH: Trimmed 71030 records to 48383 (keeping 200 days of data) [2025-09-29T21:49:13.104283] [DEBUG] [LOCAL ] VSH: Primary data saved (48383 records). [2025-09-29T21:49:13.104418] [INFO ] [MAIN ] VSH: Full history saved. [2025-09-29T21:49:13.104550] [INFO ] [MAIN ] Update Progress: 2254/2371 symbols completed. VSH took 32.4s. Estimated remaining: 15m 1s. Rate: 7.8 symbols/min [2025-09-29T21:49:13.161667] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-03. [2025-09-29T21:49:13.293748] [INFO ] [MAIN ] VTLE: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:49:13.345775] [DEBUG] [LOCAL ] VTLE: Loaded 49337 existing records from primary storage. [2025-09-29T21:49:13.346159] [INFO ] [MAIN ] VTLE: Loaded 49337 existing records. [2025-09-29T21:49:13.538965] [WARN ] [MAIN ] VTLE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:49:13.539167] [INFO ] [MAIN ] VTLE: Wiping existing primary data before full refresh. [2025-09-29T21:49:13.539214] [INFO ] [LOCAL ] VTLE: Starting deletion of primary data. [2025-09-29T21:49:13.539891] [DEBUG] [LOCAL ] VTLE: Deleted primary data file. [2025-09-29T21:49:13.539952] [INFO ] [MAIN ] VTLE: Starting full primary refresh. [2025-09-29T21:49:13.967234] [INFO ] [REMOTE ] VTLE: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:49:13.968900] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2024-12. [2025-09-29T21:49:13.971115] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-29T21:49:14.059708] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-09-29T21:49:14.746113] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-29T21:49:14.755098] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-07. [2025-09-29T21:49:15.548099] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-04. [2025-09-29T21:49:15.585003] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-29T21:49:16.348115] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-01. [2025-09-29T21:49:16.405862] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-29T21:49:16.984831] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-29T21:49:17.148107] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-05. [2025-09-29T21:49:17.696169] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-29T21:49:17.948135] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-08. [2025-09-29T21:49:18.748125] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-08. [2025-09-29T21:49:18.916296] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-29T21:49:19.548096] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-02. [2025-09-29T21:49:19.690730] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-29T21:49:20.348104] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-09. [2025-09-29T21:49:20.965510] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-29T21:49:21.039862] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-29T21:49:21.148114] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-09. [2025-09-29T21:49:21.867282] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-29T21:49:21.878998] [INFO ] [REMOTE ] VST: Full fetch complete (77807 records). [2025-09-29T21:49:21.879157] [DEBUG] [VALIDATOR ] VST: Validating primary data. [2025-09-29T21:49:21.952708] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-06. [2025-09-29T21:49:22.238956] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-29T21:49:22.268530] [INFO ] [REMOTE ] VSTS: Full fetch complete (69814 records). [2025-09-29T21:49:22.279071] [DEBUG] [VALIDATOR ] VSTS: Validating primary data. [2025-09-29T21:49:22.435962] [DEBUG] [VALIDATOR ] VST: All expected trading days are present. [2025-09-29T21:49:22.454799] [DEBUG] [VALIDATOR ] VST: Primary data validation passed. [2025-09-29T21:49:22.474812] [INFO ] [MAIN ] VST: Fetched primary data is valid. [2025-09-29T21:49:22.483691] [DEBUG] [LOCAL ] VST: Saving primary data. [2025-09-29T21:49:22.548402] [DEBUG] [LOCAL ] VST: Trimmed 77807 records to 53718 (keeping 200 days of data) [2025-09-29T21:49:22.761200] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-03. [2025-09-29T21:49:22.910619] [DEBUG] [VALIDATOR ] VSTS: All expected trading days are present. [2025-09-29T21:49:22.911069] [DEBUG] [VALIDATOR ] VSTS: Primary data validation passed. [2025-09-29T21:49:22.912538] [INFO ] [MAIN ] VSTS: Fetched primary data is valid. [2025-09-29T21:49:22.912628] [DEBUG] [LOCAL ] VSTS: Saving primary data. [2025-09-29T21:49:22.920738] [DEBUG] [LOCAL ] VSTS: Trimmed 69814 records to 49016 (keeping 200 days of data) [2025-09-29T21:49:23.290460] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-29T21:49:23.402712] [DEBUG] [LOCAL ] VSTS: Primary data saved (49016 records). [2025-09-29T21:49:23.405734] [INFO ] [MAIN ] VSTS: Full history saved. [2025-09-29T21:49:23.405934] [INFO ] [MAIN ] Update Progress: 2255/2371 symbols completed. VSTS took 28.0s. Estimated remaining: 14m 53s. Rate: 7.8 symbols/min [2025-09-29T21:49:23.551474] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-07. [2025-09-29T21:49:23.679203] [INFO ] [MAIN ] VTMX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:49:23.704510] [DEBUG] [LOCAL ] VTMX: Loaded 17811 existing records from primary storage. [2025-09-29T21:49:23.705364] [INFO ] [MAIN ] VTMX: Loaded 17811 existing records. [2025-09-29T21:49:23.836796] [DEBUG] [LOCAL ] VST: Primary data saved (53718 records). [2025-09-29T21:49:23.856347] [INFO ] [MAIN ] VST: Full history saved. [2025-09-29T21:49:23.870759] [INFO ] [MAIN ] Update Progress: 2256/2371 symbols completed. VST took 36.0s. Estimated remaining: 14m 45s. Rate: 7.8 symbols/min [2025-09-29T21:49:23.946798] [WARN ] [MAIN ] VTMX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:49:23.969757] [INFO ] [MAIN ] VTMX: Wiping existing primary data before full refresh. [2025-09-29T21:49:23.975151] [INFO ] [LOCAL ] VTMX: Starting deletion of primary data. [2025-09-29T21:49:23.987704] [DEBUG] [LOCAL ] VTMX: Deleted primary data file. [2025-09-29T21:49:23.987879] [INFO ] [MAIN ] VTMX: Starting full primary refresh. [2025-09-29T21:49:24.195295] [INFO ] [MAIN ] VTN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:49:24.335375] [DEBUG] [LOCAL ] VTN: Loaded 7293 existing records from primary storage. [2025-09-29T21:49:24.365903] [INFO ] [MAIN ] VTN: Loaded 7293 existing records. [2025-09-29T21:49:24.657070] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-29T21:49:24.665734] [INFO ] [REMOTE ] VTMX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:49:24.725616] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2024-12. [2025-09-29T21:49:24.745710] [WARN ] [MAIN ] VTN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:49:24.746988] [INFO ] [MAIN ] VTN: Wiping existing primary data before full refresh. [2025-09-29T21:49:24.747046] [INFO ] [LOCAL ] VTN: Starting deletion of primary data. [2025-09-29T21:49:24.747258] [DEBUG] [LOCAL ] VTN: Deleted primary data file. [2025-09-29T21:49:24.747314] [INFO ] [MAIN ] VTN: Starting full primary refresh. [2025-09-29T21:49:25.126154] [INFO ] [REMOTE ] VTN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:49:25.153190] [INFO ] [REMOTE ] VTN: Fetching primary data for 2024-12. [2025-09-29T21:49:25.173070] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-29T21:49:25.840846] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-29T21:49:25.948087] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-04. [2025-09-29T21:49:26.267527] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-29T21:49:26.748145] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-01. [2025-09-29T21:49:27.543665] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-29T21:49:27.548055] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-02. [2025-09-29T21:49:27.772182] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-29T21:49:28.348091] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-01. [2025-09-29T21:49:28.424729] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-29T21:49:29.148127] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-08. [2025-09-29T21:49:29.312381] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-29T21:49:29.948143] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-05. [2025-09-29T21:49:30.542757] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-29T21:49:30.748149] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-09. [2025-09-29T21:49:31.548138] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-03. [2025-09-29T21:49:31.706092] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-29T21:49:32.068163] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-29T21:49:32.077707] [INFO ] [REMOTE ] VTEX: Full fetch complete (60703 records). [2025-09-29T21:49:32.077892] [DEBUG] [VALIDATOR ] VTEX: Validating primary data. [2025-09-29T21:49:32.217054] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-29T21:49:32.354391] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-04. [2025-09-29T21:49:32.503902] [DEBUG] [VALIDATOR ] VTEX: All expected trading days are present. [2025-09-29T21:49:32.504018] [DEBUG] [VALIDATOR ] VTEX: Primary data validation passed. [2025-09-29T21:49:32.505286] [INFO ] [MAIN ] VTEX: Fetched primary data is valid. [2025-09-29T21:49:32.505389] [DEBUG] [LOCAL ] VTEX: Saving primary data. [2025-09-29T21:49:32.509981] [DEBUG] [LOCAL ] VTEX: Trimmed 60703 records to 43304 (keeping 200 days of data) [2025-09-29T21:49:32.769139] [DEBUG] [LOCAL ] VTEX: Primary data saved (43304 records). [2025-09-29T21:49:32.769279] [INFO ] [MAIN ] VTEX: Full history saved. [2025-09-29T21:49:32.769367] [INFO ] [MAIN ] Update Progress: 2257/2371 symbols completed. VTEX took 32.1s. Estimated remaining: 14m 37s. Rate: 7.8 symbols/min [2025-09-29T21:49:32.958371] [INFO ] [MAIN ] VTOL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:49:32.965723] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-29T21:49:32.992190] [DEBUG] [LOCAL ] VTOL: Loaded 19915 existing records from primary storage. [2025-09-29T21:49:32.992484] [INFO ] [MAIN ] VTOL: Loaded 19915 existing records. [2025-09-29T21:49:33.153244] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-05. [2025-09-29T21:49:33.194813] [WARN ] [MAIN ] VTOL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:49:33.195125] [INFO ] [MAIN ] VTOL: Wiping existing primary data before full refresh. [2025-09-29T21:49:33.195185] [INFO ] [LOCAL ] VTOL: Starting deletion of primary data. [2025-09-29T21:49:33.195615] [DEBUG] [LOCAL ] VTOL: Deleted primary data file. [2025-09-29T21:49:33.195714] [INFO ] [MAIN ] VTOL: Starting full primary refresh. [2025-09-29T21:49:33.563242] [INFO ] [REMOTE ] VTOL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:49:33.650427] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-29T21:49:33.948162] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-02. [2025-09-29T21:49:34.748102] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2024-12. [2025-09-29T21:49:35.060693] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-29T21:49:35.548089] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-06. [2025-09-29T21:49:35.760849] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-29T21:49:36.060969] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-29T21:49:36.348107] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-07. [2025-09-29T21:49:36.866559] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-29T21:49:37.148131] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-01. [2025-09-29T21:49:37.948095] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-06. [2025-09-29T21:49:37.987729] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-29T21:49:38.748140] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-02. [2025-09-29T21:49:39.548086] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-03. [2025-09-29T21:49:39.627261] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-29T21:49:39.671137] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-29T21:49:40.241425] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-29T21:49:40.348089] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-03. [2025-09-29T21:49:41.148176] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-08. [2025-09-29T21:49:41.418081] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-29T21:49:41.905417] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-29T21:49:41.948106] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-09. [2025-09-29T21:49:42.609509] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-29T21:49:42.611871] [INFO ] [REMOTE ] VTN: Full fetch complete (11504 records). [2025-09-29T21:49:42.611948] [DEBUG] [VALIDATOR ] VTN: Validating primary data. [2025-09-29T21:49:42.753191] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-04. [2025-09-29T21:49:43.004151] [DEBUG] [VALIDATOR ] VTN: All expected trading days are present. [2025-09-29T21:49:43.004495] [DEBUG] [VALIDATOR ] VTN: Primary data validation passed. [2025-09-29T21:49:43.004977] [INFO ] [MAIN ] VTN: Fetched primary data is valid. [2025-09-29T21:49:43.005072] [DEBUG] [LOCAL ] VTN: Saving primary data. [2025-09-29T21:49:43.005611] [DEBUG] [LOCAL ] VTN: Trimmed 11504 records to 7072 (keeping 200 days of data) [2025-09-29T21:49:43.052065] [DEBUG] [LOCAL ] VTN: Primary data saved (7072 records). [2025-09-29T21:49:43.052196] [INFO ] [MAIN ] VTN: Full history saved. [2025-09-29T21:49:43.052294] [INFO ] [MAIN ] Update Progress: 2258/2371 symbols completed. VTN took 19.2s. Estimated remaining: 14m 30s. Rate: 7.8 symbols/min [2025-09-29T21:49:43.273449] [INFO ] [MAIN ] VTR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:49:43.340633] [DEBUG] [LOCAL ] VTR: Loaded 53620 existing records from primary storage. [2025-09-29T21:49:43.341106] [INFO ] [MAIN ] VTR: Loaded 53620 existing records. [2025-09-29T21:49:43.533271] [WARN ] [MAIN ] VTR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:49:43.533534] [INFO ] [MAIN ] VTR: Wiping existing primary data before full refresh. [2025-09-29T21:49:43.533582] [INFO ] [LOCAL ] VTR: Starting deletion of primary data. [2025-09-29T21:49:43.534184] [DEBUG] [LOCAL ] VTR: Deleted primary data file. [2025-09-29T21:49:43.534260] [INFO ] [MAIN ] VTR: Starting full primary refresh. [2025-09-29T21:49:43.556048] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-07. [2025-09-29T21:49:43.942319] [INFO ] [REMOTE ] VTR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:49:43.958921] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-29T21:49:44.348132] [INFO ] [REMOTE ] VTR: Fetching primary data for 2024-12. [2025-09-29T21:49:45.148176] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-05. [2025-09-29T21:49:45.354982] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-29T21:49:45.949002] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-04. [2025-09-29T21:49:45.952981] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-29T21:49:46.165612] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-29T21:49:46.748094] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-01. [2025-09-29T21:49:46.807830] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-29T21:49:47.548123] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-06. [2025-09-29T21:49:48.315706] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-29T21:49:48.348118] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-08. [2025-09-29T21:49:48.666445] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-29T21:49:49.148111] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-07. [2025-09-29T21:49:49.664733] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-29T21:49:49.948125] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-02. [2025-09-29T21:49:50.175005] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-29T21:49:50.748157] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-05. [2025-09-29T21:49:51.334711] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-29T21:49:51.548089] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-03. [2025-09-29T21:49:51.711244] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-29T21:49:52.348242] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-09. [2025-09-29T21:49:53.148157] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-06. [2025-09-29T21:49:53.354074] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-29T21:49:53.948110] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-04. [2025-09-29T21:49:54.064922] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-29T21:49:54.075342] [INFO ] [REMOTE ] VTLE: Full fetch complete (68780 records). [2025-09-29T21:49:54.075556] [DEBUG] [VALIDATOR ] VTLE: Validating primary data. [2025-09-29T21:49:54.393224] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-29T21:49:54.525789] [DEBUG] [VALIDATOR ] VTLE: All expected trading days are present. [2025-09-29T21:49:54.525945] [DEBUG] [VALIDATOR ] VTLE: Primary data validation passed. [2025-09-29T21:49:54.527543] [INFO ] [MAIN ] VTLE: Fetched primary data is valid. [2025-09-29T21:49:54.527660] [DEBUG] [LOCAL ] VTLE: Saving primary data. [2025-09-29T21:49:54.532171] [DEBUG] [LOCAL ] VTLE: Trimmed 68780 records to 48538 (keeping 200 days of data) [2025-09-29T21:49:54.748230] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-07. [2025-09-29T21:49:54.834331] [DEBUG] [LOCAL ] VTLE: Primary data saved (48538 records). [2025-09-29T21:49:54.834447] [INFO ] [MAIN ] VTLE: Full history saved. [2025-09-29T21:49:54.834559] [INFO ] [MAIN ] Update Progress: 2259/2371 symbols completed. VTLE took 41.7s. Estimated remaining: 14m 22s. Rate: 7.8 symbols/min [2025-09-29T21:49:55.026064] [INFO ] [MAIN ] VTS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:49:55.060022] [DEBUG] [LOCAL ] VTS: Loaded 30992 existing records from primary storage. [2025-09-29T21:49:55.060303] [INFO ] [MAIN ] VTS: Loaded 30992 existing records. [2025-09-29T21:49:55.254491] [WARN ] [MAIN ] VTS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:49:55.254717] [INFO ] [MAIN ] VTS: Wiping existing primary data before full refresh. [2025-09-29T21:49:55.254775] [INFO ] [LOCAL ] VTS: Starting deletion of primary data. [2025-09-29T21:49:55.255107] [DEBUG] [LOCAL ] VTS: Deleted primary data file. [2025-09-29T21:49:55.255166] [INFO ] [MAIN ] VTS: Starting full primary refresh. [2025-09-29T21:49:55.551754] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-08. [2025-09-29T21:49:55.716568] [INFO ] [REMOTE ] VTS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:49:55.751933] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-29T21:49:55.828022] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-29T21:49:56.195306] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-29T21:49:56.348102] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-05. [2025-09-29T21:49:57.148171] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-09. [2025-09-29T21:49:57.948142] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-08. [2025-09-29T21:49:58.073401] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-29T21:49:58.077304] [INFO ] [REMOTE ] VTMX: Full fetch complete (25992 records). [2025-09-29T21:49:58.077403] [DEBUG] [VALIDATOR ] VTMX: Validating primary data. [2025-09-29T21:49:58.451850] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-29T21:49:58.539075] [DEBUG] [VALIDATOR ] VTMX: All expected trading days are present. [2025-09-29T21:49:58.539435] [DEBUG] [VALIDATOR ] VTMX: Primary data validation passed. [2025-09-29T21:49:58.540503] [INFO ] [MAIN ] VTMX: Fetched primary data is valid. [2025-09-29T21:49:58.540782] [DEBUG] [LOCAL ] VTMX: Saving primary data. [2025-09-29T21:49:58.542112] [DEBUG] [LOCAL ] VTMX: Trimmed 25992 records to 17534 (keeping 200 days of data) [2025-09-29T21:49:58.655231] [DEBUG] [LOCAL ] VTMX: Primary data saved (17534 records). [2025-09-29T21:49:58.655381] [INFO ] [MAIN ] VTMX: Full history saved. [2025-09-29T21:49:58.655481] [INFO ] [MAIN ] Update Progress: 2260/2371 symbols completed. VTMX took 35.2s. Estimated remaining: 14m 14s. Rate: 7.8 symbols/min [2025-09-29T21:49:58.751534] [INFO ] [REMOTE ] VTS: Fetching primary data for 2024-12. [2025-09-29T21:49:58.845974] [INFO ] [MAIN ] VVR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:49:58.863053] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-29T21:49:58.901303] [DEBUG] [LOCAL ] VVR: Loaded 31251 existing records from primary storage. [2025-09-29T21:49:58.901603] [INFO ] [MAIN ] VVR: Loaded 31251 existing records. [2025-09-29T21:49:59.093810] [WARN ] [MAIN ] VVR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:49:59.094020] [INFO ] [MAIN ] VVR: Wiping existing primary data before full refresh. [2025-09-29T21:49:59.094068] [INFO ] [LOCAL ] VVR: Starting deletion of primary data. [2025-09-29T21:49:59.094334] [DEBUG] [LOCAL ] VVR: Deleted primary data file. [2025-09-29T21:49:59.094392] [INFO ] [MAIN ] VVR: Starting full primary refresh. [2025-09-29T21:49:59.482477] [INFO ] [REMOTE ] VVR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:49:59.548118] [INFO ] [REMOTE ] VVR: Fetching primary data for 2024-12. [2025-09-29T21:49:59.879032] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-29T21:50:00.348119] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-06. [2025-09-29T21:50:00.692352] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-29T21:50:01.148161] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-01. [2025-09-29T21:50:01.948116] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-01. [2025-09-29T21:50:02.164150] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-29T21:50:02.215618] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-29T21:50:02.748143] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-07. [2025-09-29T21:50:03.163912] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-29T21:50:03.548109] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-02. [2025-09-29T21:50:04.138951] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-29T21:50:04.348159] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-09. [2025-09-29T21:50:04.705399] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-29T21:50:05.148158] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-03. [2025-09-29T21:50:05.437500] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-29T21:50:05.442937] [INFO ] [REMOTE ] VTOL: Full fetch complete (25982 records). [2025-09-29T21:50:05.443141] [DEBUG] [VALIDATOR ] VTOL: Validating primary data. [2025-09-29T21:50:05.871825] [DEBUG] [VALIDATOR ] VTOL: All expected trading days are present. [2025-09-29T21:50:05.871924] [DEBUG] [VALIDATOR ] VTOL: Primary data validation passed. [2025-09-29T21:50:05.872488] [INFO ] [MAIN ] VTOL: Fetched primary data is valid. [2025-09-29T21:50:05.872533] [DEBUG] [LOCAL ] VTOL: Saving primary data. [2025-09-29T21:50:05.873251] [DEBUG] [LOCAL ] VTOL: Trimmed 25982 records to 19534 (keeping 200 days of data) [2025-09-29T21:50:05.958932] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-02. [2025-09-29T21:50:05.998705] [DEBUG] [LOCAL ] VTOL: Primary data saved (19534 records). [2025-09-29T21:50:05.998877] [INFO ] [MAIN ] VTOL: Full history saved. [2025-09-29T21:50:05.998972] [INFO ] [MAIN ] Update Progress: 2261/2371 symbols completed. VTOL took 33.2s. Estimated remaining: 14m 7s. Rate: 7.8 symbols/min [2025-09-29T21:50:06.206510] [INFO ] [MAIN ] VVV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:50:06.262258] [DEBUG] [LOCAL ] VVV: Loaded 50933 existing records from primary storage. [2025-09-29T21:50:06.262600] [INFO ] [MAIN ] VVV: Loaded 50933 existing records. [2025-09-29T21:50:06.455045] [WARN ] [MAIN ] VVV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:50:06.455395] [INFO ] [MAIN ] VVV: Wiping existing primary data before full refresh. [2025-09-29T21:50:06.455474] [INFO ] [LOCAL ] VVV: Starting deletion of primary data. [2025-09-29T21:50:06.455970] [DEBUG] [LOCAL ] VVV: Deleted primary data file. [2025-09-29T21:50:06.456035] [INFO ] [MAIN ] VVV: Starting full primary refresh. [2025-09-29T21:50:06.666374] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-29T21:50:06.757017] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-08. [2025-09-29T21:50:06.884291] [INFO ] [REMOTE ] VVV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:50:07.014511] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-29T21:50:07.548148] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-03. [2025-09-29T21:50:08.189865] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-29T21:50:08.348140] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-09. [2025-09-29T21:50:08.897697] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-29T21:50:08.909379] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-29T21:50:08.916509] [INFO ] [REMOTE ] VTR: Full fetch complete (76355 records). [2025-09-29T21:50:08.917045] [DEBUG] [VALIDATOR ] VTR: Validating primary data. [2025-09-29T21:50:09.153198] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-04. [2025-09-29T21:50:09.331712] [DEBUG] [VALIDATOR ] VTR: All expected trading days are present. [2025-09-29T21:50:09.331801] [DEBUG] [VALIDATOR ] VTR: Primary data validation passed. [2025-09-29T21:50:09.332981] [INFO ] [MAIN ] VTR: Fetched primary data is valid. [2025-09-29T21:50:09.333046] [DEBUG] [LOCAL ] VTR: Saving primary data. [2025-09-29T21:50:09.334541] [DEBUG] [LOCAL ] VTR: Trimmed 76355 records to 52839 (keeping 200 days of data) [2025-09-29T21:50:09.673385] [DEBUG] [LOCAL ] VTR: Primary data saved (52839 records). [2025-09-29T21:50:09.673530] [INFO ] [MAIN ] VTR: Full history saved. [2025-09-29T21:50:09.673615] [INFO ] [MAIN ] Update Progress: 2262/2371 symbols completed. VTR took 26.6s. Estimated remaining: 13m 59s. Rate: 7.8 symbols/min [2025-09-29T21:50:09.852394] [INFO ] [MAIN ] VVX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:50:09.874984] [DEBUG] [LOCAL ] VVX: Loaded 23664 existing records from primary storage. [2025-09-29T21:50:09.875254] [INFO ] [MAIN ] VVX: Loaded 23664 existing records. [2025-09-29T21:50:09.953223] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-04. [2025-09-29T21:50:10.066275] [WARN ] [MAIN ] VVX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:50:10.066502] [INFO ] [MAIN ] VVX: Wiping existing primary data before full refresh. [2025-09-29T21:50:10.066563] [INFO ] [LOCAL ] VVX: Starting deletion of primary data. [2025-09-29T21:50:10.066776] [DEBUG] [LOCAL ] VVX: Deleted primary data file. [2025-09-29T21:50:10.066837] [INFO ] [MAIN ] VVX: Starting full primary refresh. [2025-09-29T21:50:10.449787] [INFO ] [REMOTE ] VVX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:50:10.671909] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-29T21:50:10.748160] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-05. [2025-09-29T21:50:11.043996] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-29T21:50:11.548143] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-05. [2025-09-29T21:50:11.766989] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-29T21:50:12.348122] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-06. [2025-09-29T21:50:12.513500] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-29T21:50:13.148158] [INFO ] [REMOTE ] VVV: Fetching primary data for 2024-12. [2025-09-29T21:50:13.627063] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-29T21:50:13.948112] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-06. [2025-09-29T21:50:14.748100] [INFO ] [REMOTE ] VVX: Fetching primary data for 2024-12. [2025-09-29T21:50:14.898338] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-29T21:50:15.361424] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-29T21:50:15.539183] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-29T21:50:15.548058] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-01. [2025-09-29T21:50:16.348084] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-07. [2025-09-29T21:50:16.502426] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-29T21:50:17.148126] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-01. [2025-09-29T21:50:17.708316] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-29T21:50:17.948116] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-02. [2025-09-29T21:50:18.376760] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-29T21:50:18.748119] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-08. [2025-09-29T21:50:19.050385] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-29T21:50:19.548105] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-03. [2025-09-29T21:50:19.930231] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-29T21:50:20.348092] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-09. [2025-09-29T21:50:20.491941] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-29T21:50:21.148133] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-07. [2025-09-29T21:50:21.685709] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-29T21:50:21.692918] [INFO ] [REMOTE ] VTS: Full fetch complete (41118 records). [2025-09-29T21:50:21.693053] [DEBUG] [VALIDATOR ] VTS: Validating primary data. [2025-09-29T21:50:21.953180] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-02. [2025-09-29T21:50:22.118837] [DEBUG] [VALIDATOR ] VTS: All expected trading days are present. [2025-09-29T21:50:22.119027] [DEBUG] [VALIDATOR ] VTS: Primary data validation passed. [2025-09-29T21:50:22.119981] [INFO ] [MAIN ] VTS: Fetched primary data is valid. [2025-09-29T21:50:22.120098] [DEBUG] [LOCAL ] VTS: Saving primary data. [2025-09-29T21:50:22.121363] [DEBUG] [LOCAL ] VTS: Trimmed 41118 records to 30560 (keeping 200 days of data) [2025-09-29T21:50:22.246174] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-29T21:50:22.354427] [DEBUG] [LOCAL ] VTS: Primary data saved (30560 records). [2025-09-29T21:50:22.354584] [INFO ] [MAIN ] VTS: Full history saved. [2025-09-29T21:50:22.354696] [INFO ] [MAIN ] Update Progress: 2263/2371 symbols completed. VTS took 27.5s. Estimated remaining: 13m 51s. Rate: 7.8 symbols/min [2025-09-29T21:50:22.525952] [INFO ] [MAIN ] VYX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:50:22.573357] [DEBUG] [LOCAL ] VYX: Loaded 49624 existing records from primary storage. [2025-09-29T21:50:22.573764] [INFO ] [MAIN ] VYX: Loaded 49624 existing records. [2025-09-29T21:50:22.756382] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-04. [2025-09-29T21:50:22.762803] [WARN ] [MAIN ] VYX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:50:22.763062] [INFO ] [MAIN ] VYX: Wiping existing primary data before full refresh. [2025-09-29T21:50:22.763237] [INFO ] [LOCAL ] VYX: Starting deletion of primary data. [2025-09-29T21:50:22.763746] [DEBUG] [LOCAL ] VYX: Deleted primary data file. [2025-09-29T21:50:22.764925] [INFO ] [MAIN ] VYX: Starting full primary refresh. [2025-09-29T21:50:23.140944] [INFO ] [REMOTE ] VYX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:50:23.548146] [INFO ] [REMOTE ] VYX: Fetching primary data for 2024-12. [2025-09-29T21:50:23.883018] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-29T21:50:23.974701] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-29T21:50:24.348153] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-03. [2025-09-29T21:50:25.102769] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-29T21:50:25.148131] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-08. [2025-09-29T21:50:25.770581] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-29T21:50:25.948118] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-04. [2025-09-29T21:50:26.444204] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-29T21:50:26.748109] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-09. [2025-09-29T21:50:27.336253] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-29T21:50:27.548143] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-05. [2025-09-29T21:50:27.939853] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-29T21:50:27.948134] [INFO ] [REMOTE ] VVR: Full fetch complete (46087 records). [2025-09-29T21:50:27.948259] [DEBUG] [VALIDATOR ] VVR: Validating primary data. [2025-09-29T21:50:28.348161] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-05. [2025-09-29T21:50:28.348874] [DEBUG] [VALIDATOR ] VVR: All expected trading days are present. [2025-09-29T21:50:28.349919] [DEBUG] [VALIDATOR ] VVR: Primary data validation passed. [2025-09-29T21:50:28.351043] [INFO ] [MAIN ] VVR: Fetched primary data is valid. [2025-09-29T21:50:28.351199] [DEBUG] [LOCAL ] VVR: Saving primary data. [2025-09-29T21:50:28.352498] [DEBUG] [LOCAL ] VVR: Trimmed 46087 records to 31013 (keeping 200 days of data) [2025-09-29T21:50:28.464055] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-29T21:50:28.570051] [DEBUG] [LOCAL ] VVR: Primary data saved (31013 records). [2025-09-29T21:50:28.570207] [INFO ] [MAIN ] VVR: Full history saved. [2025-09-29T21:50:28.570294] [INFO ] [MAIN ] Update Progress: 2264/2371 symbols completed. VVR took 29.9s. Estimated remaining: 13m 44s. Rate: 7.8 symbols/min [2025-09-29T21:50:28.756284] [INFO ] [MAIN ] VZ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:50:28.812427] [DEBUG] [LOCAL ] VZ: Loaded 54571 existing records from primary storage. [2025-09-29T21:50:28.812804] [INFO ] [MAIN ] VZ: Loaded 54571 existing records. [2025-09-29T21:50:28.995588] [WARN ] [MAIN ] VZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:50:28.995852] [INFO ] [MAIN ] VZ: Wiping existing primary data before full refresh. [2025-09-29T21:50:28.995902] [INFO ] [LOCAL ] VZ: Starting deletion of primary data. [2025-09-29T21:50:28.996554] [DEBUG] [LOCAL ] VZ: Deleted primary data file. [2025-09-29T21:50:28.996616] [INFO ] [MAIN ] VZ: Starting full primary refresh. [2025-09-29T21:50:29.157514] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-01. [2025-09-29T21:50:29.372421] [INFO ] [REMOTE ] VZ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:50:29.742514] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-29T21:50:29.948098] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-06. [2025-09-29T21:50:30.511621] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-29T21:50:30.748121] [INFO ] [REMOTE ] VZ: Fetching primary data for 2024-12. [2025-09-29T21:50:31.003777] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-29T21:50:31.548123] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-02. [2025-09-29T21:50:32.348121] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-07. [2025-09-29T21:50:32.830418] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-29T21:50:33.148102] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-01. [2025-09-29T21:50:33.192470] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-29T21:50:33.203263] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-29T21:50:33.948107] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-06. [2025-09-29T21:50:34.748113] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-03. [2025-09-29T21:50:35.548112] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-08. [2025-09-29T21:50:35.592947] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-09-29T21:50:35.852259] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-29T21:50:36.348101] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-07. [2025-09-29T21:50:36.628726] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-29T21:50:36.912220] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-29T21:50:37.148147] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-04. [2025-09-29T21:50:37.948107] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-02. [2025-09-29T21:50:38.119428] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-29T21:50:38.508732] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-29T21:50:38.748148] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-05. [2025-09-29T21:50:39.548177] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-09. [2025-09-29T21:50:40.249034] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-09-29T21:50:40.348371] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-03. [2025-09-29T21:50:40.349740] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-29T21:50:40.790923] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-29T21:50:40.797206] [INFO ] [REMOTE ] VVX: Full fetch complete (33538 records). [2025-09-29T21:50:40.797303] [DEBUG] [VALIDATOR ] VVX: Validating primary data. [2025-09-29T21:50:41.163061] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-08. [2025-09-29T21:50:41.179861] [DEBUG] [VALIDATOR ] VVX: All expected trading days are present. [2025-09-29T21:50:41.179948] [DEBUG] [VALIDATOR ] VVX: Primary data validation passed. [2025-09-29T21:50:41.180843] [INFO ] [MAIN ] VVX: Fetched primary data is valid. [2025-09-29T21:50:41.181016] [DEBUG] [LOCAL ] VVX: Saving primary data. [2025-09-29T21:50:41.182081] [DEBUG] [LOCAL ] VVX: Trimmed 33538 records to 23189 (keeping 200 days of data) [2025-09-29T21:50:41.322996] [DEBUG] [LOCAL ] VVX: Primary data saved (23189 records). [2025-09-29T21:50:41.323167] [INFO ] [MAIN ] VVX: Full history saved. [2025-09-29T21:50:41.323265] [INFO ] [MAIN ] Update Progress: 2265/2371 symbols completed. VVX took 31.6s. Estimated remaining: 13m 36s. Rate: 7.8 symbols/min [2025-09-29T21:50:41.506076] [INFO ] [MAIN ] W: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:50:41.562498] [DEBUG] [LOCAL ] W: Loaded 54266 existing records from primary storage. [2025-09-29T21:50:41.562907] [INFO ] [MAIN ] W: Loaded 54266 existing records. [2025-09-29T21:50:41.751438] [WARN ] [MAIN ] W: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:50:41.751695] [INFO ] [MAIN ] W: Wiping existing primary data before full refresh. [2025-09-29T21:50:41.751755] [INFO ] [LOCAL ] W: Starting deletion of primary data. [2025-09-29T21:50:41.752237] [DEBUG] [LOCAL ] W: Deleted primary data file. [2025-09-29T21:50:41.752297] [INFO ] [MAIN ] W: Starting full primary refresh. [2025-09-29T21:50:41.977169] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-06. [2025-09-29T21:50:42.131007] [INFO ] [REMOTE ] W: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:50:42.638599] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-29T21:50:42.684739] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-09-29T21:50:42.748129] [INFO ] [REMOTE ] W: Fetching primary data for 2024-12. [2025-09-29T21:50:43.548134] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-09. [2025-09-29T21:50:43.718806] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-29T21:50:44.353531] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-07. [2025-09-29T21:50:44.378672] [INFO ] [REMOTE ] W: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-29T21:50:45.130599] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-29T21:50:45.145916] [INFO ] [REMOTE ] VVV: Full fetch complete (72383 records). [2025-09-29T21:50:45.146118] [DEBUG] [VALIDATOR ] VVV: Validating primary data. [2025-09-29T21:50:45.153296] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-04. [2025-09-29T21:50:45.711769] [DEBUG] [VALIDATOR ] VVV: All expected trading days are present. [2025-09-29T21:50:45.711910] [DEBUG] [VALIDATOR ] VVV: Primary data validation passed. [2025-09-29T21:50:45.713362] [INFO ] [MAIN ] VVV: Fetched primary data is valid. [2025-09-29T21:50:45.713510] [DEBUG] [LOCAL ] VVV: Saving primary data. [2025-09-29T21:50:45.715583] [DEBUG] [LOCAL ] VVV: Trimmed 72383 records to 50186 (keeping 200 days of data) [2025-09-29T21:50:45.854563] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-29T21:50:45.958247] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-08. [2025-09-29T21:50:46.109212] [DEBUG] [LOCAL ] VVV: Primary data saved (50186 records). [2025-09-29T21:50:46.109392] [INFO ] [MAIN ] VVV: Full history saved. [2025-09-29T21:50:46.109528] [INFO ] [MAIN ] Update Progress: 2266/2371 symbols completed. VVV took 40.1s. Estimated remaining: 13m 28s. Rate: 7.8 symbols/min [2025-09-29T21:50:46.301107] [INFO ] [MAIN ] WAB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:50:46.358110] [DEBUG] [LOCAL ] WAB: Loaded 44872 existing records from primary storage. [2025-09-29T21:50:46.358528] [INFO ] [MAIN ] WAB: Loaded 44872 existing records. [2025-09-29T21:50:46.542119] [WARN ] [MAIN ] WAB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:50:46.542391] [INFO ] [MAIN ] WAB: Wiping existing primary data before full refresh. [2025-09-29T21:50:46.542464] [INFO ] [LOCAL ] WAB: Starting deletion of primary data. [2025-09-29T21:50:46.543079] [DEBUG] [LOCAL ] WAB: Deleted primary data file. [2025-09-29T21:50:46.543142] [INFO ] [MAIN ] WAB: Starting full primary refresh. [2025-09-29T21:50:46.765244] [INFO ] [REMOTE ] W: Fetching primary data for 2025-01. [2025-09-29T21:50:46.923591] [INFO ] [REMOTE ] WAB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:50:47.338214] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-29T21:50:47.548112] [INFO ] [REMOTE ] WAB: Fetching primary data for 2024-12. [2025-09-29T21:50:47.597535] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-29T21:50:48.348117] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-09. [2025-09-29T21:50:48.813562] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-29T21:50:49.148119] [INFO ] [REMOTE ] W: Fetching primary data for 2025-02. [2025-09-29T21:50:49.315952] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-29T21:50:49.700832] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-29T21:50:49.711047] [INFO ] [REMOTE ] VYX: Full fetch complete (70285 records). [2025-09-29T21:50:49.711194] [DEBUG] [VALIDATOR ] VYX: Validating primary data. [2025-09-29T21:50:49.955591] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-05. [2025-09-29T21:50:50.141421] [DEBUG] [VALIDATOR ] VYX: All expected trading days are present. [2025-09-29T21:50:50.141537] [DEBUG] [VALIDATOR ] VYX: Primary data validation passed. [2025-09-29T21:50:50.142902] [INFO ] [MAIN ] VYX: Fetched primary data is valid. [2025-09-29T21:50:50.143004] [DEBUG] [LOCAL ] VYX: Saving primary data. [2025-09-29T21:50:50.145388] [DEBUG] [LOCAL ] VYX: Trimmed 70285 records to 48802 (keeping 200 days of data) [2025-09-29T21:50:50.468038] [DEBUG] [LOCAL ] VYX: Primary data saved (48802 records). [2025-09-29T21:50:50.468322] [INFO ] [MAIN ] VYX: Full history saved. [2025-09-29T21:50:50.468537] [INFO ] [MAIN ] Update Progress: 2267/2371 symbols completed. VYX took 28.1s. Estimated remaining: 13m 20s. Rate: 7.8 symbols/min [2025-09-29T21:50:50.662702] [INFO ] [MAIN ] WAL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:50:50.703982] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-29T21:50:50.748946] [INFO ] [REMOTE ] W: Fetching primary data for 2025-03. [2025-09-29T21:50:50.751614] [DEBUG] [LOCAL ] WAL: Loaded 46040 existing records from primary storage. [2025-09-29T21:50:50.752146] [INFO ] [MAIN ] WAL: Loaded 46040 existing records. [2025-09-29T21:50:50.965142] [WARN ] [MAIN ] WAL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:50:50.965789] [INFO ] [MAIN ] WAL: Wiping existing primary data before full refresh. [2025-09-29T21:50:50.965923] [INFO ] [LOCAL ] WAL: Starting deletion of primary data. [2025-09-29T21:50:50.966876] [DEBUG] [LOCAL ] WAL: Deleted primary data file. [2025-09-29T21:50:50.966967] [INFO ] [MAIN ] WAL: Starting full primary refresh. [2025-09-29T21:50:51.342879] [INFO ] [REMOTE ] WAL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:50:51.548168] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-01. [2025-09-29T21:50:52.339177] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-29T21:50:52.349997] [INFO ] [REMOTE ] WAL: Fetching primary data for 2024-12. [2025-09-29T21:50:52.630231] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-05 (2.67 seconds). [2025-09-29T21:50:53.148116] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-06. [2025-09-29T21:50:53.258398] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-29T21:50:53.866843] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-29T21:50:53.948172] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-02. [2025-09-29T21:50:54.748083] [INFO ] [REMOTE ] W: Fetching primary data for 2025-04. [2025-09-29T21:50:54.956033] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-29T21:50:55.425898] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-29T21:50:55.548122] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-01. [2025-09-29T21:50:56.348102] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-07. [2025-09-29T21:50:56.772749] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-29T21:50:56.986888] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-29T21:50:57.148152] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-03. [2025-09-29T21:50:57.948161] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-02. [2025-09-29T21:50:58.580802] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-29T21:50:58.745471] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-09-29T21:50:58.756855] [INFO ] [REMOTE ] W: Fetching primary data for 2025-05. [2025-09-29T21:50:59.330464] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-29T21:50:59.548159] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-04. [2025-09-29T21:51:00.353211] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-03. [2025-09-29T21:51:00.370989] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-29T21:51:01.010681] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-29T21:51:01.148145] [INFO ] [REMOTE ] W: Fetching primary data for 2025-06. [2025-09-29T21:51:01.798692] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-29T21:51:01.948120] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-08. [2025-09-29T21:51:02.748123] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-04. [2025-09-29T21:51:03.219125] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-29T21:51:03.548110] [INFO ] [REMOTE ] W: Fetching primary data for 2025-07. [2025-09-29T21:51:04.348141] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-05. [2025-09-29T21:51:04.388854] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-09-29T21:51:04.603796] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-29T21:51:05.148123] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-05. [2025-09-29T21:51:05.295537] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-29T21:51:05.839197] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-29T21:51:05.948151] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-09. [2025-09-29T21:51:06.237945] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-29T21:51:06.618553] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-29T21:51:06.630074] [INFO ] [REMOTE ] VZ: Full fetch complete (77958 records). [2025-09-29T21:51:06.630244] [DEBUG] [VALIDATOR ] VZ: Validating primary data. [2025-09-29T21:51:06.753309] [INFO ] [REMOTE ] W: Fetching primary data for 2025-08. [2025-09-29T21:51:07.071333] [DEBUG] [VALIDATOR ] VZ: All expected trading days are present. [2025-09-29T21:51:07.071443] [DEBUG] [VALIDATOR ] VZ: Primary data validation passed. [2025-09-29T21:51:07.072834] [INFO ] [MAIN ] VZ: Fetched primary data is valid. [2025-09-29T21:51:07.072904] [DEBUG] [LOCAL ] VZ: Saving primary data. [2025-09-29T21:51:07.074442] [DEBUG] [LOCAL ] VZ: Trimmed 77958 records to 53791 (keeping 200 days of data) [2025-09-29T21:51:07.426124] [DEBUG] [LOCAL ] VZ: Primary data saved (53791 records). [2025-09-29T21:51:07.426280] [INFO ] [MAIN ] VZ: Full history saved. [2025-09-29T21:51:07.426382] [INFO ] [MAIN ] Update Progress: 2268/2371 symbols completed. VZ took 38.9s. Estimated remaining: 13m 13s. Rate: 7.8 symbols/min [2025-09-29T21:51:07.553434] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-06. [2025-09-29T21:51:07.619874] [INFO ] [MAIN ] WAT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:51:07.659563] [DEBUG] [LOCAL ] WAT: Loaded 35620 existing records from primary storage. [2025-09-29T21:51:07.659946] [INFO ] [MAIN ] WAT: Loaded 35620 existing records. [2025-09-29T21:51:07.848206] [WARN ] [MAIN ] WAT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:51:07.848442] [INFO ] [MAIN ] WAT: Wiping existing primary data before full refresh. [2025-09-29T21:51:07.848490] [INFO ] [LOCAL ] WAT: Starting deletion of primary data. [2025-09-29T21:51:07.848938] [DEBUG] [LOCAL ] WAT: Deleted primary data file. [2025-09-29T21:51:07.848997] [INFO ] [MAIN ] WAT: Starting full primary refresh. [2025-09-29T21:51:08.224420] [INFO ] [REMOTE ] WAT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:51:08.348074] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-06. [2025-09-29T21:51:08.549575] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-29T21:51:08.915908] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-29T21:51:09.148109] [INFO ] [REMOTE ] W: Fetching primary data for 2025-09. [2025-09-29T21:51:09.516169] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-29T21:51:09.948115] [INFO ] [REMOTE ] WAT: Fetching primary data for 2024-12. [2025-09-29T21:51:10.734867] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-29T21:51:10.746397] [INFO ] [REMOTE ] W: Full fetch complete (77430 records). [2025-09-29T21:51:10.746553] [DEBUG] [VALIDATOR ] W: Validating primary data. [2025-09-29T21:51:10.753222] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-07. [2025-09-29T21:51:11.196526] [DEBUG] [VALIDATOR ] W: All expected trading days are present. [2025-09-29T21:51:11.196760] [DEBUG] [VALIDATOR ] W: Primary data validation passed. [2025-09-29T21:51:11.198215] [INFO ] [MAIN ] W: Fetched primary data is valid. [2025-09-29T21:51:11.198285] [DEBUG] [LOCAL ] W: Saving primary data. [2025-09-29T21:51:11.199931] [DEBUG] [LOCAL ] W: Trimmed 77430 records to 53489 (keeping 200 days of data) [2025-09-29T21:51:11.437673] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-29T21:51:11.548153] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-01. [2025-09-29T21:51:11.565074] [DEBUG] [LOCAL ] W: Primary data saved (53489 records). [2025-09-29T21:51:11.565834] [INFO ] [MAIN ] W: Full history saved. [2025-09-29T21:51:11.565955] [INFO ] [MAIN ] Update Progress: 2269/2371 symbols completed. W took 30.2s. Estimated remaining: 13m 5s. Rate: 7.8 symbols/min [2025-09-29T21:51:11.743274] [INFO ] [MAIN ] WBI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:51:11.743507] [DEBUG] [LOCAL ] WBI: No existing data file found in primary storage. [2025-09-29T21:51:11.743565] [WARN ] [MAIN ] WBI: No existing data found, performing full refresh instead. [2025-09-29T21:51:11.743669] [INFO ] [MAIN ] WBI: Wiping existing primary data before full refresh. [2025-09-29T21:51:11.743727] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-09-29T21:51:11.743775] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-09-29T21:51:11.743810] [INFO ] [MAIN ] WBI: Starting full primary refresh. [2025-09-29T21:51:12.131293] [INFO ] [REMOTE ] WBI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:51:12.348101] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-07. [2025-09-29T21:51:12.646444] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-29T21:51:13.010294] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-29T21:51:13.148191] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-08. [2025-09-29T21:51:13.832518] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-29T21:51:13.948116] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-08. [2025-09-29T21:51:14.416535] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-29T21:51:14.748117] [INFO ] [REMOTE ] WBI: Fetching primary data for 2024-12. [2025-09-29T21:51:14.978211] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T21:51:14.978526] [WARN ] [REMOTE ] WBI: No data returned for month 2024-12 [2025-09-29T21:51:14.978698] [FATAL] [REMOTE ] WBI: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T21:51:14.978781] [FATAL] [MAIN ] WBI: Failed to fetch primary data. [2025-09-29T21:51:14.978851] [WARN ] [MAIN ] WBI: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T21:51:14.978931] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-09-29T21:51:14.979030] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-09-29T21:51:14.979087] [INFO ] [LOCAL ] WBI: Starting deletion of derivative data. [2025-09-29T21:51:14.979160] [DEBUG] [LOCAL ] WBI: No derivative data file found to delete. [2025-09-29T21:51:14.979263] [INFO ] [MAIN ] Update Progress: 2270/2371 symbols completed. WBI took 3.4s. Estimated remaining: 12m 57s. Rate: 7.8 symbols/min [2025-09-29T21:51:15.159754] [INFO ] [MAIN ] WBS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:51:15.222552] [DEBUG] [LOCAL ] WBS: Loaded 49471 existing records from primary storage. [2025-09-29T21:51:15.222922] [INFO ] [MAIN ] WBS: Loaded 49471 existing records. [2025-09-29T21:51:15.417289] [WARN ] [MAIN ] WBS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:51:15.417684] [INFO ] [MAIN ] WBS: Wiping existing primary data before full refresh. [2025-09-29T21:51:15.417824] [INFO ] [LOCAL ] WBS: Starting deletion of primary data. [2025-09-29T21:51:15.418402] [DEBUG] [LOCAL ] WBS: Deleted primary data file. [2025-09-29T21:51:15.418466] [INFO ] [MAIN ] WBS: Starting full primary refresh. [2025-09-29T21:51:15.553726] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-02. [2025-09-29T21:51:15.847985] [INFO ] [REMOTE ] WBS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:51:15.852622] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-29T21:51:16.348132] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-09. [2025-09-29T21:51:17.123589] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-29T21:51:17.148121] [INFO ] [REMOTE ] WBS: Fetching primary data for 2024-12. [2025-09-29T21:51:17.941800] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-29T21:51:17.951186] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-03. [2025-09-29T21:51:17.953519] [INFO ] [REMOTE ] WAL: Full fetch complete (66582 records). [2025-09-29T21:51:17.953700] [DEBUG] [VALIDATOR ] WAL: Validating primary data. [2025-09-29T21:51:18.378278] [DEBUG] [VALIDATOR ] WAL: All expected trading days are present. [2025-09-29T21:51:18.378376] [DEBUG] [VALIDATOR ] WAL: Primary data validation passed. [2025-09-29T21:51:18.379721] [INFO ] [MAIN ] WAL: Fetched primary data is valid. [2025-09-29T21:51:18.379793] [DEBUG] [LOCAL ] WAL: Saving primary data. [2025-09-29T21:51:18.381261] [DEBUG] [LOCAL ] WAL: Trimmed 66582 records to 45253 (keeping 200 days of data) [2025-09-29T21:51:18.676266] [DEBUG] [LOCAL ] WAL: Primary data saved (45253 records). [2025-09-29T21:51:18.676420] [INFO ] [MAIN ] WAL: Full history saved. [2025-09-29T21:51:18.676538] [INFO ] [MAIN ] Update Progress: 2271/2371 symbols completed. WAL took 28.2s. Estimated remaining: 12m 50s. Rate: 7.8 symbols/min [2025-09-29T21:51:18.751356] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-09. [2025-09-29T21:51:18.892953] [INFO ] [MAIN ] WBX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:51:18.905713] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-29T21:51:18.926546] [DEBUG] [LOCAL ] WBX: Loaded 12558 existing records from primary storage. [2025-09-29T21:51:18.926847] [INFO ] [MAIN ] WBX: Loaded 12558 existing records. [2025-09-29T21:51:19.113709] [WARN ] [MAIN ] WBX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:51:19.113939] [INFO ] [MAIN ] WBX: Wiping existing primary data before full refresh. [2025-09-29T21:51:19.113990] [INFO ] [LOCAL ] WBX: Starting deletion of primary data. [2025-09-29T21:51:19.114189] [DEBUG] [LOCAL ] WBX: Deleted primary data file. [2025-09-29T21:51:19.114250] [INFO ] [MAIN ] WBX: Starting full primary refresh. [2025-09-29T21:51:19.519378] [INFO ] [REMOTE ] WBX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:51:19.566471] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-29T21:51:19.552463] [INFO ] [REMOTE ] WBX: Fetching primary data for 2024-12. [2025-09-29T21:51:19.579229] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-29T21:51:19.579421] [INFO ] [REMOTE ] WAB: Full fetch complete (64447 records). [2025-09-29T21:51:19.587203] [DEBUG] [VALIDATOR ] WAB: Validating primary data. [2025-09-29T21:51:19.999921] [DEBUG] [VALIDATOR ] WAB: All expected trading days are present. [2025-09-29T21:51:20.000006] [DEBUG] [VALIDATOR ] WAB: Primary data validation passed. [2025-09-29T21:51:20.001265] [INFO ] [MAIN ] WAB: Fetched primary data is valid. [2025-09-29T21:51:20.001336] [DEBUG] [LOCAL ] WAB: Saving primary data. [2025-09-29T21:51:20.002726] [DEBUG] [LOCAL ] WAB: Trimmed 64447 records to 44166 (keeping 200 days of data) [2025-09-29T21:51:20.295356] [DEBUG] [LOCAL ] WAB: Primary data saved (44166 records). [2025-09-29T21:51:20.295507] [INFO ] [MAIN ] WAB: Full history saved. [2025-09-29T21:51:20.295675] [INFO ] [MAIN ] Update Progress: 2272/2371 symbols completed. WAB took 34.2s. Estimated remaining: 12m 42s. Rate: 7.8 symbols/min [2025-09-29T21:51:20.356796] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-04. [2025-09-29T21:51:20.481002] [INFO ] [MAIN ] WCC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:51:20.528220] [DEBUG] [LOCAL ] WCC: Loaded 40567 existing records from primary storage. [2025-09-29T21:51:20.528527] [INFO ] [MAIN ] WCC: Loaded 40567 existing records. [2025-09-29T21:51:20.722079] [WARN ] [MAIN ] WCC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:51:20.722334] [INFO ] [MAIN ] WCC: Wiping existing primary data before full refresh. [2025-09-29T21:51:20.722389] [INFO ] [LOCAL ] WCC: Starting deletion of primary data. [2025-09-29T21:51:20.722838] [DEBUG] [LOCAL ] WCC: Deleted primary data file. [2025-09-29T21:51:20.722898] [INFO ] [MAIN ] WCC: Starting full primary refresh. [2025-09-29T21:51:21.132283] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-29T21:51:21.158485] [INFO ] [REMOTE ] WCC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:51:21.152364] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-01. [2025-09-29T21:51:21.677890] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-29T21:51:21.948110] [INFO ] [REMOTE ] WCC: Fetching primary data for 2024-12. [2025-09-29T21:51:22.753233] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-01. [2025-09-29T21:51:22.772517] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-29T21:51:23.120368] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-29T21:51:23.548118] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-02. [2025-09-29T21:51:24.055025] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-29T21:51:24.348125] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-01. [2025-09-29T21:51:25.148110] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-05. [2025-09-29T21:51:25.235214] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-29T21:51:25.767336] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-29T21:51:25.948097] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-02. [2025-09-29T21:51:26.732371] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-29T21:51:26.748073] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-06. [2025-09-29T21:51:26.766296] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-29T21:51:27.548096] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-03. [2025-09-29T21:51:27.738429] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-29T21:51:28.348148] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-02. [2025-09-29T21:51:29.148122] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-07. [2025-09-29T21:51:29.376234] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-29T21:51:29.675663] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-29T21:51:29.948123] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-03. [2025-09-29T21:51:30.748124] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-04. [2025-09-29T21:51:30.814332] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-29T21:51:30.980167] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-29T21:51:31.548116] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-08. [2025-09-29T21:51:32.298795] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-29T21:51:32.340697] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-29T21:51:32.351274] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-09. [2025-09-29T21:51:32.691971] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-29T21:51:32.699801] [INFO ] [REMOTE ] WAT: Full fetch complete (49968 records). [2025-09-29T21:51:32.699950] [DEBUG] [VALIDATOR ] WAT: Validating primary data. [2025-09-29T21:51:33.122424] [DEBUG] [VALIDATOR ] WAT: All expected trading days are present. [2025-09-29T21:51:33.122519] [DEBUG] [VALIDATOR ] WAT: Primary data validation passed. [2025-09-29T21:51:33.123662] [INFO ] [MAIN ] WAT: Fetched primary data is valid. [2025-09-29T21:51:33.123731] [DEBUG] [LOCAL ] WAT: Saving primary data. [2025-09-29T21:51:33.124898] [DEBUG] [LOCAL ] WAT: Trimmed 49968 records to 35125 (keeping 200 days of data) [2025-09-29T21:51:33.175903] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-03. [2025-09-29T21:51:33.350739] [DEBUG] [LOCAL ] WAT: Primary data saved (35125 records). [2025-09-29T21:51:33.350896] [INFO ] [MAIN ] WAT: Full history saved. [2025-09-29T21:51:33.350993] [INFO ] [MAIN ] Update Progress: 2273/2371 symbols completed. WAT took 25.9s. Estimated remaining: 12m 34s. Rate: 7.8 symbols/min [2025-09-29T21:51:33.532571] [INFO ] [MAIN ] WCN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:51:33.580682] [DEBUG] [LOCAL ] WCN: Loaded 48708 existing records from primary storage. [2025-09-29T21:51:33.581012] [INFO ] [MAIN ] WCN: Loaded 48708 existing records. [2025-09-29T21:51:33.756234] [WARN ] [MAIN ] WCN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:51:33.756470] [INFO ] [MAIN ] WCN: Wiping existing primary data before full refresh. [2025-09-29T21:51:33.756518] [INFO ] [LOCAL ] WCN: Starting deletion of primary data. [2025-09-29T21:51:33.756977] [DEBUG] [LOCAL ] WCN: Deleted primary data file. [2025-09-29T21:51:33.757035] [INFO ] [MAIN ] WCN: Starting full primary refresh. [2025-09-29T21:51:33.954742] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-05. [2025-09-29T21:51:34.128199] [INFO ] [REMOTE ] WCN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:51:34.748078] [INFO ] [REMOTE ] WCN: Fetching primary data for 2024-12. [2025-09-29T21:51:34.878219] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-29T21:51:35.548172] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-04. [2025-09-29T21:51:35.813163] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-29T21:51:36.138342] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-29T21:51:36.348129] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-01. [2025-09-29T21:51:36.969309] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-29T21:51:37.148111] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-05. [2025-09-29T21:51:37.948091] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-04. [2025-09-29T21:51:38.124420] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-29T21:51:38.477605] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-29T21:51:38.690252] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-29T21:51:38.748108] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-05. [2025-09-29T21:51:39.548121] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-06. [2025-09-29T21:51:39.810828] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-29T21:51:40.348125] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-02. [2025-09-29T21:51:41.148103] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-06. [2025-09-29T21:51:41.191199] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-29T21:51:41.941987] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-29T21:51:41.948110] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-06. [2025-09-29T21:51:42.030057] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-29T21:51:42.748124] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-03. [2025-09-29T21:51:43.412868] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-29T21:51:43.548125] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-07. [2025-09-29T21:51:44.348084] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-07. [2025-09-29T21:51:44.450690] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-29T21:51:45.148103] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-07. [2025-09-29T21:51:45.394888] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-29T21:51:45.649309] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-29T21:51:45.861338] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-29T21:51:45.948102] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-08. [2025-09-29T21:51:46.748141] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-08. [2025-09-29T21:51:47.311951] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-29T21:51:47.463721] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-29T21:51:47.548173] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-09. [2025-09-29T21:51:48.348119] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-08. [2025-09-29T21:51:49.138813] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-29T21:51:49.147637] [INFO ] [REMOTE ] WCC: Full fetch complete (58032 records). [2025-09-29T21:51:49.147780] [DEBUG] [VALIDATOR ] WCC: Validating primary data. [2025-09-29T21:51:49.148166] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-04. [2025-09-29T21:51:49.561624] [DEBUG] [VALIDATOR ] WCC: All expected trading days are present. [2025-09-29T21:51:49.561744] [DEBUG] [VALIDATOR ] WCC: Primary data validation passed. [2025-09-29T21:51:49.562854] [INFO ] [MAIN ] WCC: Fetched primary data is valid. [2025-09-29T21:51:49.562920] [DEBUG] [LOCAL ] WCC: Saving primary data. [2025-09-29T21:51:49.564178] [DEBUG] [LOCAL ] WCC: Trimmed 58032 records to 39763 (keeping 200 days of data) [2025-09-29T21:51:49.825200] [DEBUG] [LOCAL ] WCC: Primary data saved (39763 records). [2025-09-29T21:51:49.825354] [INFO ] [MAIN ] WCC: Full history saved. [2025-09-29T21:51:49.825461] [INFO ] [MAIN ] Update Progress: 2274/2371 symbols completed. WCC took 29.5s. Estimated remaining: 12m 27s. Rate: 7.8 symbols/min [2025-09-29T21:51:49.948404] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-09. [2025-09-29T21:51:50.025679] [INFO ] [MAIN ] WD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:51:50.054307] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-29T21:51:50.088417] [DEBUG] [LOCAL ] WD: Loaded 23747 existing records from primary storage. [2025-09-29T21:51:50.088719] [INFO ] [MAIN ] WD: Loaded 23747 existing records. [2025-09-29T21:51:50.282749] [WARN ] [MAIN ] WD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:51:50.283306] [INFO ] [MAIN ] WD: Wiping existing primary data before full refresh. [2025-09-29T21:51:50.283420] [INFO ] [LOCAL ] WD: Starting deletion of primary data. [2025-09-29T21:51:50.283967] [DEBUG] [LOCAL ] WD: Deleted primary data file. [2025-09-29T21:51:50.284028] [INFO ] [MAIN ] WD: Starting full primary refresh. [2025-09-29T21:51:50.590975] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-29T21:51:50.615817] [INFO ] [REMOTE ] WBX: Full fetch complete (25275 records). [2025-09-29T21:51:50.621303] [DEBUG] [VALIDATOR ] WBX: Validating primary data. [2025-09-29T21:51:50.694424] [INFO ] [REMOTE ] WD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:51:50.753200] [INFO ] [REMOTE ] WD: Fetching primary data for 2024-12. [2025-09-29T21:51:51.079082] [DEBUG] [VALIDATOR ] WBX: All expected trading days are present. [2025-09-29T21:51:51.079252] [DEBUG] [VALIDATOR ] WBX: Primary data validation passed. [2025-09-29T21:51:51.079868] [INFO ] [MAIN ] WBX: Fetched primary data is valid. [2025-09-29T21:51:51.079931] [DEBUG] [LOCAL ] WBX: Saving primary data. [2025-09-29T21:51:51.080577] [DEBUG] [LOCAL ] WBX: Trimmed 25275 records to 11843 (keeping 200 days of data) [2025-09-29T21:51:51.162746] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-29T21:51:51.191236] [DEBUG] [LOCAL ] WBX: Primary data saved (11843 records). [2025-09-29T21:51:51.191397] [INFO ] [MAIN ] WBX: Full history saved. [2025-09-29T21:51:51.191489] [INFO ] [MAIN ] Update Progress: 2275/2371 symbols completed. WBX took 32.5s. Estimated remaining: 12m 19s. Rate: 7.8 symbols/min [2025-09-29T21:51:51.376572] [INFO ] [MAIN ] WDH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:51:51.400298] [DEBUG] [LOCAL ] WDH: Loaded 17597 existing records from primary storage. [2025-09-29T21:51:51.400593] [INFO ] [MAIN ] WDH: Loaded 17597 existing records. [2025-09-29T21:51:51.551748] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-09. [2025-09-29T21:51:51.598556] [WARN ] [MAIN ] WDH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:51:51.598995] [INFO ] [MAIN ] WDH: Wiping existing primary data before full refresh. [2025-09-29T21:51:51.599186] [INFO ] [LOCAL ] WDH: Starting deletion of primary data. [2025-09-29T21:51:51.604811] [DEBUG] [LOCAL ] WDH: Deleted primary data file. [2025-09-29T21:51:51.609125] [INFO ] [MAIN ] WDH: Starting full primary refresh. [2025-09-29T21:51:51.615413] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-29T21:51:51.981482] [INFO ] [REMOTE ] WDH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:51:52.348123] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-01. [2025-09-29T21:51:53.148083] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-05. [2025-09-29T21:51:53.188030] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-29T21:51:53.278404] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-29T21:51:53.288969] [INFO ] [REMOTE ] WBS: Full fetch complete (69523 records). [2025-09-29T21:51:53.289137] [DEBUG] [VALIDATOR ] WBS: Validating primary data. [2025-09-29T21:51:53.716202] [DEBUG] [VALIDATOR ] WBS: All expected trading days are present. [2025-09-29T21:51:53.716297] [DEBUG] [VALIDATOR ] WBS: Primary data validation passed. [2025-09-29T21:51:53.717527] [INFO ] [MAIN ] WBS: Fetched primary data is valid. [2025-09-29T21:51:53.717593] [DEBUG] [LOCAL ] WBS: Saving primary data. [2025-09-29T21:51:53.719082] [DEBUG] [LOCAL ] WBS: Trimmed 69523 records to 48686 (keeping 200 days of data) [2025-09-29T21:51:53.948816] [INFO ] [REMOTE ] WDH: Fetching primary data for 2024-12. [2025-09-29T21:51:54.038895] [DEBUG] [LOCAL ] WBS: Primary data saved (48686 records). [2025-09-29T21:51:54.039074] [INFO ] [MAIN ] WBS: Full history saved. [2025-09-29T21:51:54.039211] [INFO ] [MAIN ] Update Progress: 2276/2371 symbols completed. WBS took 39.1s. Estimated remaining: 12m 11s. Rate: 7.8 symbols/min [2025-09-29T21:51:54.216252] [INFO ] [MAIN ] WDI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:51:54.242583] [DEBUG] [LOCAL ] WDI: Loaded 21314 existing records from primary storage. [2025-09-29T21:51:54.242884] [INFO ] [MAIN ] WDI: Loaded 21314 existing records. [2025-09-29T21:51:54.434281] [WARN ] [MAIN ] WDI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:51:54.434725] [INFO ] [MAIN ] WDI: Wiping existing primary data before full refresh. [2025-09-29T21:51:54.434800] [INFO ] [LOCAL ] WDI: Starting deletion of primary data. [2025-09-29T21:51:54.435088] [DEBUG] [LOCAL ] WDI: Deleted primary data file. [2025-09-29T21:51:54.435147] [INFO ] [MAIN ] WDI: Starting full primary refresh. [2025-09-29T21:51:54.753181] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-02. [2025-09-29T21:51:54.876103] [INFO ] [REMOTE ] WDI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:51:54.894622] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-29T21:51:54.952118] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-29T21:51:55.548184] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-01. [2025-09-29T21:51:55.825955] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-29T21:51:56.350127] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-03. [2025-09-29T21:51:56.354432] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-29T21:51:57.148127] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-02. [2025-09-29T21:51:57.478452] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-29T21:51:57.948042] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-29T21:51:57.948123] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-04. [2025-09-29T21:51:58.748101] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-03. [2025-09-29T21:51:59.135938] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-29T21:51:59.346033] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-29T21:51:59.548134] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-04. [2025-09-29T21:52:00.194377] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-29T21:52:00.348132] [INFO ] [REMOTE ] WDI: Fetching primary data for 2024-12. [2025-09-29T21:52:01.148103] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-06. [2025-09-29T21:52:01.287378] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-29T21:52:01.948222] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-05. [2025-09-29T21:52:02.433496] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-29T21:52:02.748131] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-05. [2025-09-29T21:52:03.143908] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-29T21:52:03.328864] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-29T21:52:03.548111] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-06. [2025-09-29T21:52:04.141961] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-29T21:52:04.348151] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-07. [2025-09-29T21:52:05.148162] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-01. [2025-09-29T21:52:05.504389] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-29T21:52:05.948087] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-08. [2025-09-29T21:52:06.194587] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-29T21:52:06.608436] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-29T21:52:06.748120] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-07. [2025-09-29T21:52:07.548165] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-06. [2025-09-29T21:52:08.348101] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-09. [2025-09-29T21:52:08.572819] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-29T21:52:08.630192] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-29T21:52:09.148177] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-02. [2025-09-29T21:52:09.524780] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-29T21:52:09.532588] [INFO ] [REMOTE ] WDH: Full fetch complete (23152 records). [2025-09-29T21:52:09.532821] [DEBUG] [VALIDATOR ] WDH: Validating primary data. [2025-09-29T21:52:09.949782] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-08. [2025-09-29T21:52:09.964068] [DEBUG] [VALIDATOR ] WDH: All expected trading days are present. [2025-09-29T21:52:09.965117] [DEBUG] [VALIDATOR ] WDH: Primary data validation passed. [2025-09-29T21:52:09.975371] [INFO ] [MAIN ] WDH: Fetched primary data is valid. [2025-09-29T21:52:09.977452] [DEBUG] [LOCAL ] WDH: Saving primary data. [2025-09-29T21:52:09.979113] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-29T21:52:09.983559] [DEBUG] [LOCAL ] WDH: Trimmed 23152 records to 17598 (keeping 200 days of data) [2025-09-29T21:52:10.099087] [DEBUG] [LOCAL ] WDH: Primary data saved (17598 records). [2025-09-29T21:52:10.099250] [INFO ] [MAIN ] WDH: Full history saved. [2025-09-29T21:52:10.099375] [INFO ] [MAIN ] Update Progress: 2277/2371 symbols completed. WDH took 18.9s. Estimated remaining: 12m 4s. Rate: 7.8 symbols/min [2025-09-29T21:52:10.748120] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-03. [2025-09-29T21:52:11.548131] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-07. [2025-09-29T21:52:11.743473] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-29T21:52:11.809728] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-29T21:52:12.348154] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-09. [2025-09-29T21:52:12.752047] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-29T21:52:13.148113] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-08. [2025-09-29T21:52:13.707179] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-29T21:52:13.717235] [INFO ] [REMOTE ] WCN: Full fetch complete (69441 records). [2025-09-29T21:52:13.717404] [DEBUG] [VALIDATOR ] WCN: Validating primary data. [2025-09-29T21:52:13.967689] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-04. [2025-09-29T21:52:14.156822] [DEBUG] [VALIDATOR ] WCN: All expected trading days are present. [2025-09-29T21:52:14.156986] [DEBUG] [VALIDATOR ] WCN: Primary data validation passed. [2025-09-29T21:52:14.158345] [INFO ] [MAIN ] WCN: Fetched primary data is valid. [2025-09-29T21:52:14.158415] [DEBUG] [LOCAL ] WCN: Saving primary data. [2025-09-29T21:52:14.159855] [DEBUG] [LOCAL ] WCN: Trimmed 69441 records to 47959 (keeping 200 days of data) [2025-09-29T21:52:14.293346] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-29T21:52:14.495295] [DEBUG] [LOCAL ] WCN: Primary data saved (47959 records). [2025-09-29T21:52:14.495432] [INFO ] [MAIN ] WCN: Full history saved. [2025-09-29T21:52:14.495530] [INFO ] [MAIN ] Update Progress: 2278/2371 symbols completed. WCN took 41.1s. Estimated remaining: 11m 56s. Rate: 7.8 symbols/min [2025-09-29T21:52:14.748165] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-09. [2025-09-29T21:52:14.880598] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-29T21:52:15.548158] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-05. [2025-09-29T21:52:15.809510] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-29T21:52:15.815250] [INFO ] [REMOTE ] WD: Full fetch complete (33052 records). [2025-09-29T21:52:15.815346] [DEBUG] [VALIDATOR ] WD: Validating primary data. [2025-09-29T21:52:16.208945] [DEBUG] [VALIDATOR ] WD: All expected trading days are present. [2025-09-29T21:52:16.209074] [DEBUG] [VALIDATOR ] WD: Primary data validation passed. [2025-09-29T21:52:16.209811] [INFO ] [MAIN ] WD: Fetched primary data is valid. [2025-09-29T21:52:16.209884] [DEBUG] [LOCAL ] WD: Saving primary data. [2025-09-29T21:52:16.210713] [DEBUG] [LOCAL ] WD: Trimmed 33052 records to 23224 (keeping 200 days of data) [2025-09-29T21:52:16.358536] [DEBUG] [LOCAL ] WD: Primary data saved (23224 records). [2025-09-29T21:52:16.358703] [INFO ] [MAIN ] WD: Full history saved. [2025-09-29T21:52:16.358803] [INFO ] [MAIN ] Update Progress: 2279/2371 symbols completed. WD took 26.5s. Estimated remaining: 11m 48s. Rate: 7.8 symbols/min [2025-09-29T21:52:16.695552] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-29T21:52:16.701345] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-06. [2025-09-29T21:52:17.754715] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-29T21:52:17.759874] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-07. [2025-09-29T21:52:18.805870] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-29T21:52:18.811317] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-08. [2025-09-29T21:52:19.916795] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-29T21:52:19.922048] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-09. [2025-09-29T21:52:20.725969] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-29T21:52:20.730185] [INFO ] [REMOTE ] WDI: Full fetch complete (30743 records). [2025-09-29T21:52:20.730291] [DEBUG] [VALIDATOR ] WDI: Validating primary data. [2025-09-29T21:52:21.136531] [DEBUG] [VALIDATOR ] WDI: All expected trading days are present. [2025-09-29T21:52:21.136632] [DEBUG] [VALIDATOR ] WDI: Primary data validation passed. [2025-09-29T21:52:21.137347] [INFO ] [MAIN ] WDI: Fetched primary data is valid. [2025-09-29T21:52:21.137409] [DEBUG] [LOCAL ] WDI: Saving primary data. [2025-09-29T21:52:21.138222] [DEBUG] [LOCAL ] WDI: Trimmed 30743 records to 21038 (keeping 200 days of data) [2025-09-29T21:52:21.268100] [DEBUG] [LOCAL ] WDI: Primary data saved (21038 records). [2025-09-29T21:52:21.268228] [INFO ] [MAIN ] WDI: Full history saved. [2025-09-29T21:52:21.268307] [INFO ] [MAIN ] Update Progress: 2280/2371 symbols completed. WDI took 27.2s. Estimated remaining: 11m 40s. Rate: 7.8 symbols/min [2025-09-29T21:52:21.818760] [INFO ] [MAIN ] WEAV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:52:21.883093] [INFO ] [MAIN ] WDS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:52:22.012863] [INFO ] [MAIN ] WEC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:52:22.011215] [INFO ] [MAIN ] WEA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:52:22.025525] [DEBUG] [LOCAL ] WEA: Loaded 7379 existing records from primary storage. [2025-09-29T21:52:22.025992] [INFO ] [MAIN ] WEA: Loaded 7379 existing records. [2025-09-29T21:52:22.220126] [DEBUG] [LOCAL ] WEAV: Loaded 42562 existing records from primary storage. [2025-09-29T21:52:22.264016] [INFO ] [MAIN ] WEAV: Loaded 42562 existing records. [2025-09-29T21:52:22.288327] [DEBUG] [LOCAL ] WDS: Loaded 44259 existing records from primary storage. [2025-09-29T21:52:22.332760] [WARN ] [MAIN ] WEA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:52:22.338332] [INFO ] [MAIN ] WEA: Wiping existing primary data before full refresh. [2025-09-29T21:52:22.321570] [INFO ] [MAIN ] WDS: Loaded 44259 existing records. [2025-09-29T21:52:22.365877] [INFO ] [LOCAL ] WEA: Starting deletion of primary data. [2025-09-29T21:52:22.448755] [DEBUG] [LOCAL ] WEC: Loaded 52958 existing records from primary storage. [2025-09-29T21:52:22.487431] [INFO ] [MAIN ] WEC: Loaded 52958 existing records. [2025-09-29T21:52:22.501365] [DEBUG] [LOCAL ] WEA: Deleted primary data file. [2025-09-29T21:52:22.537616] [INFO ] [MAIN ] WEA: Starting full primary refresh. [2025-09-29T21:52:22.886093] [WARN ] [MAIN ] WEAV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:52:22.980881] [WARN ] [MAIN ] WDS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:52:22.991667] [INFO ] [MAIN ] WDS: Wiping existing primary data before full refresh. [2025-09-29T21:52:23.022739] [INFO ] [LOCAL ] WDS: Starting deletion of primary data. [2025-09-29T21:52:22.991380] [INFO ] [MAIN ] WEAV: Wiping existing primary data before full refresh. [2025-09-29T21:52:23.043189] [INFO ] [LOCAL ] WEAV: Starting deletion of primary data. [2025-09-29T21:52:23.049719] [DEBUG] [LOCAL ] WDS: Deleted primary data file. [2025-09-29T21:52:23.100883] [INFO ] [MAIN ] WDS: Starting full primary refresh. [2025-09-29T21:52:23.104548] [WARN ] [MAIN ] WEC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:52:23.141796] [DEBUG] [LOCAL ] WEAV: Deleted primary data file. [2025-09-29T21:52:23.176543] [INFO ] [MAIN ] WEC: Wiping existing primary data before full refresh. [2025-09-29T21:52:23.176630] [INFO ] [MAIN ] WEAV: Starting full primary refresh. [2025-09-29T21:52:23.220185] [INFO ] [LOCAL ] WEC: Starting deletion of primary data. [2025-09-29T21:52:23.302984] [DEBUG] [LOCAL ] WEC: Deleted primary data file. [2025-09-29T21:52:23.323433] [INFO ] [MAIN ] WEC: Starting full primary refresh. [2025-09-29T21:52:23.906128] [INFO ] [REMOTE ] WEA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:52:24.010404] [INFO ] [REMOTE ] WEA: Fetching primary data for 2024-12. [2025-09-29T21:52:24.424584] [INFO ] [REMOTE ] WDS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:52:24.445785] [INFO ] [REMOTE ] WDS: Fetching primary data for 2024-12. [2025-09-29T21:52:24.548710] [INFO ] [REMOTE ] WEAV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:52:24.569456] [INFO ] [REMOTE ] WEC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:52:24.569765] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2024-12. [2025-09-29T21:52:24.570841] [INFO ] [REMOTE ] WEC: Fetching primary data for 2024-12. [2025-09-29T21:52:24.679391] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-29T21:52:24.681456] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-01. [2025-09-29T21:52:25.302836] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-29T21:52:25.305973] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-02. [2025-09-29T21:52:25.783029] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-29T21:52:25.784903] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-03. [2025-09-29T21:52:26.021292] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-29T21:52:26.032727] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-01. [2025-09-29T21:52:26.061880] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-29T21:52:26.072249] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-01. [2025-09-29T21:52:26.103268] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-29T21:52:26.216518] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-29T21:52:26.748170] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-04. [2025-09-29T21:52:27.421071] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-29T21:52:27.548128] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-01. [2025-09-29T21:52:27.707712] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-29T21:52:27.876757] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-29T21:52:28.348145] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-02. [2025-09-29T21:52:28.935187] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-29T21:52:29.148154] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-05. [2025-09-29T21:52:29.590180] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-29T21:52:29.948155] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-02. [2025-09-29T21:52:29.956626] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-29T21:52:30.748170] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-06. [2025-09-29T21:52:31.401461] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-29T21:52:31.472227] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-29T21:52:31.548152] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-07. [2025-09-29T21:52:32.087190] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-29T21:52:32.348164] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-03. [2025-09-29T21:52:33.148144] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-08. [2025-09-29T21:52:33.925677] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-29T21:52:33.948103] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-09. [2025-09-29T21:52:34.131290] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-29T21:52:34.585104] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-29T21:52:34.587117] [INFO ] [REMOTE ] WEA: Full fetch complete (9777 records). [2025-09-29T21:52:34.587209] [DEBUG] [VALIDATOR ] WEA: Validating primary data. [2025-09-29T21:52:34.772565] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-04. [2025-09-29T21:52:34.990242] [DEBUG] [VALIDATOR ] WEA: All expected trading days are present. [2025-09-29T21:52:34.990325] [DEBUG] [VALIDATOR ] WEA: Primary data validation passed. [2025-09-29T21:52:34.990595] [INFO ] [MAIN ] WEA: Fetched primary data is valid. [2025-09-29T21:52:34.990635] [DEBUG] [LOCAL ] WEA: Saving primary data. [2025-09-29T21:52:34.991127] [DEBUG] [LOCAL ] WEA: Trimmed 9777 records to 7302 (keeping 200 days of data) [2025-09-29T21:52:35.039512] [DEBUG] [LOCAL ] WEA: Primary data saved (7302 records). [2025-09-29T21:52:35.039686] [INFO ] [MAIN ] WEA: Full history saved. [2025-09-29T21:52:35.039831] [INFO ] [MAIN ] Update Progress: 2281/2371 symbols completed. WEA took 13.8s. Estimated remaining: 11m 33s. Rate: 7.8 symbols/min [2025-09-29T21:52:35.221499] [INFO ] [MAIN ] WELL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:52:35.287227] [DEBUG] [LOCAL ] WELL: Loaded 53132 existing records from primary storage. [2025-09-29T21:52:35.287622] [INFO ] [MAIN ] WELL: Loaded 53132 existing records. [2025-09-29T21:52:35.474385] [WARN ] [MAIN ] WELL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:52:35.474621] [INFO ] [MAIN ] WELL: Wiping existing primary data before full refresh. [2025-09-29T21:52:35.474704] [INFO ] [LOCAL ] WELL: Starting deletion of primary data. [2025-09-29T21:52:35.475182] [DEBUG] [LOCAL ] WELL: Deleted primary data file. [2025-09-29T21:52:35.475242] [INFO ] [MAIN ] WELL: Starting full primary refresh. [2025-09-29T21:52:35.553378] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-02. [2025-09-29T21:52:35.873195] [INFO ] [REMOTE ] WELL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:52:36.348162] [INFO ] [REMOTE ] WELL: Fetching primary data for 2024-12. [2025-09-29T21:52:36.458731] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-29T21:52:37.030258] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-29T21:52:37.148107] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-03. [2025-09-29T21:52:37.948085] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-03. [2025-09-29T21:52:38.157474] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-29T21:52:38.748139] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-01. [2025-09-29T21:52:38.903811] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-29T21:52:39.230077] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-29T21:52:39.548144] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-05. [2025-09-29T21:52:40.348144] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-04. [2025-09-29T21:52:40.430941] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-29T21:52:41.005719] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-29T21:52:41.148124] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-06. [2025-09-29T21:52:41.865865] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-29T21:52:41.948099] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-02. [2025-09-29T21:52:42.662942] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-29T21:52:42.748125] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-07. [2025-09-29T21:52:43.548162] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-05. [2025-09-29T21:52:43.700011] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-29T21:52:44.348099] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-04. [2025-09-29T21:52:44.686187] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-29T21:52:45.153254] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-08. [2025-09-29T21:52:45.167387] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-29T21:52:45.948099] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-03. [2025-09-29T21:52:45.985570] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-29T21:52:46.748093] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-05. [2025-09-29T21:52:47.062689] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-29T21:52:47.548207] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-09. [2025-09-29T21:52:47.897686] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-29T21:52:48.298824] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-29T21:52:48.344670] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-29T21:52:48.354577] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-06. [2025-09-29T21:52:48.358047] [INFO ] [REMOTE ] WEC: Full fetch complete (75504 records). [2025-09-29T21:52:48.358346] [DEBUG] [VALIDATOR ] WEC: Validating primary data. [2025-09-29T21:52:48.813119] [DEBUG] [VALIDATOR ] WEC: All expected trading days are present. [2025-09-29T21:52:48.813213] [DEBUG] [VALIDATOR ] WEC: Primary data validation passed. [2025-09-29T21:52:48.814393] [INFO ] [MAIN ] WEC: Fetched primary data is valid. [2025-09-29T21:52:48.814473] [DEBUG] [LOCAL ] WEC: Saving primary data. [2025-09-29T21:52:48.815983] [DEBUG] [LOCAL ] WEC: Trimmed 75504 records to 52172 (keeping 200 days of data) [2025-09-29T21:52:49.148362] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-06. [2025-09-29T21:52:49.175888] [DEBUG] [LOCAL ] WEC: Primary data saved (52172 records). [2025-09-29T21:52:49.176031] [INFO ] [MAIN ] WEC: Full history saved. [2025-09-29T21:52:49.176148] [INFO ] [MAIN ] Update Progress: 2282/2371 symbols completed. WEC took 27.9s. Estimated remaining: 11m 25s. Rate: 7.8 symbols/min [2025-09-29T21:52:49.359673] [INFO ] [MAIN ] WES: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:52:49.414193] [DEBUG] [LOCAL ] WES: Loaded 48689 existing records from primary storage. [2025-09-29T21:52:49.414698] [INFO ] [MAIN ] WES: Loaded 48689 existing records. [2025-09-29T21:52:49.605380] [WARN ] [MAIN ] WES: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:52:49.605771] [INFO ] [MAIN ] WES: Wiping existing primary data before full refresh. [2025-09-29T21:52:49.605940] [INFO ] [LOCAL ] WES: Starting deletion of primary data. [2025-09-29T21:52:49.615103] [DEBUG] [LOCAL ] WES: Deleted primary data file. [2025-09-29T21:52:49.630035] [INFO ] [MAIN ] WES: Starting full primary refresh. [2025-09-29T21:52:49.709213] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-29T21:52:49.953212] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-04. [2025-09-29T21:52:50.031557] [INFO ] [REMOTE ] WES: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:52:50.540945] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-29T21:52:50.748154] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-07. [2025-09-29T21:52:51.548167] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-07. [2025-09-29T21:52:51.998757] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-29T21:52:52.164248] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-29T21:52:52.348118] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-08. [2025-09-29T21:52:53.059233] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-29T21:52:53.148114] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-05. [2025-09-29T21:52:53.600104] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-29T21:52:53.948156] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-08. [2025-09-29T21:52:54.748158] [INFO ] [REMOTE ] WES: Fetching primary data for 2024-12. [2025-09-29T21:52:55.035255] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-29T21:52:55.428066] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-29T21:52:55.548118] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-06. [2025-09-29T21:52:56.054021] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-29T21:52:56.348126] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-01. [2025-09-29T21:52:57.148120] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-09. [2025-09-29T21:52:57.420532] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-29T21:52:57.948107] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-07. [2025-09-29T21:52:58.105164] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-29T21:52:58.304097] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-29T21:52:58.313426] [INFO ] [REMOTE ] WEAV: Full fetch complete (61527 records). [2025-09-29T21:52:58.313578] [DEBUG] [VALIDATOR ] WEAV: Validating primary data. [2025-09-29T21:52:58.721860] [DEBUG] [VALIDATOR ] WEAV: All expected trading days are present. [2025-09-29T21:52:58.721983] [DEBUG] [VALIDATOR ] WEAV: Primary data validation passed. [2025-09-29T21:52:58.723122] [INFO ] [MAIN ] WEAV: Fetched primary data is valid. [2025-09-29T21:52:58.723188] [DEBUG] [LOCAL ] WEAV: Saving primary data. [2025-09-29T21:52:58.724574] [DEBUG] [LOCAL ] WEAV: Trimmed 61527 records to 41848 (keeping 200 days of data) [2025-09-29T21:52:58.772388] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-02. [2025-09-29T21:52:58.969595] [DEBUG] [LOCAL ] WEAV: Primary data saved (41848 records). [2025-09-29T21:52:58.969754] [INFO ] [MAIN ] WEAV: Full history saved. [2025-09-29T21:52:58.969876] [INFO ] [MAIN ] Update Progress: 2283/2371 symbols completed. WEAV took 37.7s. Estimated remaining: 11m 17s. Rate: 7.8 symbols/min [2025-09-29T21:52:59.150894] [INFO ] [MAIN ] WEX: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:52:59.196443] [DEBUG] [LOCAL ] WEX: Loaded 35697 existing records from primary storage. [2025-09-29T21:52:59.196781] [INFO ] [MAIN ] WEX: Loaded 35697 existing records. [2025-09-29T21:52:59.395248] [WARN ] [MAIN ] WEX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:52:59.395481] [INFO ] [MAIN ] WEX: Wiping existing primary data before full refresh. [2025-09-29T21:52:59.395537] [INFO ] [LOCAL ] WEX: Starting deletion of primary data. [2025-09-29T21:52:59.395988] [DEBUG] [LOCAL ] WEX: Deleted primary data file. [2025-09-29T21:52:59.396048] [INFO ] [MAIN ] WEX: Starting full primary refresh. [2025-09-29T21:52:59.557507] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-09. [2025-09-29T21:52:59.785456] [INFO ] [REMOTE ] WEX: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:52:59.819443] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-29T21:53:00.348090] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-08. [2025-09-29T21:53:00.440117] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-29T21:53:00.896720] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-29T21:53:00.906317] [INFO ] [REMOTE ] WDS: Full fetch complete (64686 records). [2025-09-29T21:53:00.906454] [DEBUG] [VALIDATOR ] WDS: Validating primary data. [2025-09-29T21:53:01.153296] [INFO ] [REMOTE ] WEX: Fetching primary data for 2024-12. [2025-09-29T21:53:01.332733] [DEBUG] [VALIDATOR ] WDS: All expected trading days are present. [2025-09-29T21:53:01.332854] [DEBUG] [VALIDATOR ] WDS: Primary data validation passed. [2025-09-29T21:53:01.334159] [INFO ] [MAIN ] WDS: Fetched primary data is valid. [2025-09-29T21:53:01.334233] [DEBUG] [LOCAL ] WDS: Saving primary data. [2025-09-29T21:53:01.335912] [DEBUG] [LOCAL ] WDS: Trimmed 64686 records to 43456 (keeping 200 days of data) [2025-09-29T21:53:01.636536] [DEBUG] [LOCAL ] WDS: Primary data saved (43456 records). [2025-09-29T21:53:01.636752] [INFO ] [MAIN ] WDS: Full history saved. [2025-09-29T21:53:01.636861] [INFO ] [MAIN ] Update Progress: 2284/2371 symbols completed. WDS took 40.4s. Estimated remaining: 11m 10s. Rate: 7.8 symbols/min [2025-09-29T21:53:01.830190] [INFO ] [MAIN ] WF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:53:01.846832] [DEBUG] [LOCAL ] WF: Loaded 10903 existing records from primary storage. [2025-09-29T21:53:01.847236] [INFO ] [MAIN ] WF: Loaded 10903 existing records. [2025-09-29T21:53:01.960360] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-03. [2025-09-29T21:53:02.058490] [WARN ] [MAIN ] WF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:53:02.058865] [INFO ] [MAIN ] WF: Wiping existing primary data before full refresh. [2025-09-29T21:53:02.058942] [INFO ] [LOCAL ] WF: Starting deletion of primary data. [2025-09-29T21:53:02.059190] [DEBUG] [LOCAL ] WF: Deleted primary data file. [2025-09-29T21:53:02.059241] [INFO ] [MAIN ] WF: Starting full primary refresh. [2025-09-29T21:53:02.237203] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-29T21:53:02.549030] [INFO ] [REMOTE ] WF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:53:02.567817] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-29T21:53:02.748108] [INFO ] [REMOTE ] WF: Fetching primary data for 2024-12. [2025-09-29T21:53:03.552007] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-09. [2025-09-29T21:53:03.576916] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-29T21:53:03.601788] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-29T21:53:04.087396] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-29T21:53:04.102379] [INFO ] [REMOTE ] WELL: Full fetch complete (75739 records). [2025-09-29T21:53:04.102559] [DEBUG] [VALIDATOR ] WELL: Validating primary data. [2025-09-29T21:53:04.353321] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-01. [2025-09-29T21:53:04.546021] [DEBUG] [VALIDATOR ] WELL: All expected trading days are present. [2025-09-29T21:53:04.546129] [DEBUG] [VALIDATOR ] WELL: Primary data validation passed. [2025-09-29T21:53:04.547729] [INFO ] [MAIN ] WELL: Fetched primary data is valid. [2025-09-29T21:53:04.547897] [DEBUG] [LOCAL ] WELL: Saving primary data. [2025-09-29T21:53:04.549552] [DEBUG] [LOCAL ] WELL: Trimmed 75739 records to 52365 (keeping 200 days of data) [2025-09-29T21:53:04.895626] [DEBUG] [LOCAL ] WELL: Primary data saved (52365 records). [2025-09-29T21:53:04.895799] [INFO ] [MAIN ] WELL: Full history saved. [2025-09-29T21:53:04.895894] [INFO ] [MAIN ] Update Progress: 2285/2371 symbols completed. WELL took 29.9s. Estimated remaining: 11m 2s. Rate: 7.8 symbols/min [2025-09-29T21:53:05.079182] [INFO ] [MAIN ] WFC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:53:05.126791] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-29T21:53:05.150395] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-02. [2025-09-29T21:53:05.152807] [DEBUG] [LOCAL ] WFC: Loaded 54528 existing records from primary storage. [2025-09-29T21:53:05.153202] [INFO ] [MAIN ] WFC: Loaded 54528 existing records. [2025-09-29T21:53:05.342065] [WARN ] [MAIN ] WFC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:53:05.342282] [INFO ] [MAIN ] WFC: Wiping existing primary data before full refresh. [2025-09-29T21:53:05.342331] [INFO ] [LOCAL ] WFC: Starting deletion of primary data. [2025-09-29T21:53:05.342889] [DEBUG] [LOCAL ] WFC: Deleted primary data file. [2025-09-29T21:53:05.342966] [INFO ] [MAIN ] WFC: Starting full primary refresh. [2025-09-29T21:53:05.727407] [INFO ] [REMOTE ] WFC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:53:05.948087] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-01. [2025-09-29T21:53:06.028005] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-29T21:53:06.748137] [INFO ] [REMOTE ] WFC: Fetching primary data for 2024-12. [2025-09-29T21:53:06.877493] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-29T21:53:07.548145] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-03. [2025-09-29T21:53:08.186297] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-29T21:53:08.348140] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-04. [2025-09-29T21:53:08.730510] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-29T21:53:09.148130] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-01. [2025-09-29T21:53:09.948097] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-02. [2025-09-29T21:53:10.187230] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-29T21:53:10.748117] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-05. [2025-09-29T21:53:11.033842] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-29T21:53:11.408780] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-29T21:53:11.548116] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-04. [2025-09-29T21:53:12.229394] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-29T21:53:12.302941] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-29T21:53:12.348091] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-05. [2025-09-29T21:53:13.004501] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-29T21:53:13.148114] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-06. [2025-09-29T21:53:13.948118] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-03. [2025-09-29T21:53:14.034792] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-29T21:53:14.748125] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-06. [2025-09-29T21:53:15.373365] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-29T21:53:15.548108] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-04. [2025-09-29T21:53:16.080021] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-29T21:53:16.348114] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-07. [2025-09-29T21:53:17.148082] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-02. [2025-09-29T21:53:17.240769] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-29T21:53:17.948109] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-05. [2025-09-29T21:53:18.015932] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-29T21:53:18.748104] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-07. [2025-09-29T21:53:18.891936] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-29T21:53:19.502357] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-29T21:53:19.522827] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-29T21:53:19.548066] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-08. [2025-09-29T21:53:20.039414] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-29T21:53:20.348171] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-06. [2025-09-29T21:53:21.148155] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-09. [2025-09-29T21:53:21.767265] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-29T21:53:21.948095] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-07. [2025-09-29T21:53:22.088718] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-29T21:53:22.091107] [INFO ] [REMOTE ] WF: Full fetch complete (16340 records). [2025-09-29T21:53:22.091188] [DEBUG] [VALIDATOR ] WF: Validating primary data. [2025-09-29T21:53:22.476217] [DEBUG] [VALIDATOR ] WF: All expected trading days are present. [2025-09-29T21:53:22.476306] [DEBUG] [VALIDATOR ] WF: Primary data validation passed. [2025-09-29T21:53:22.476717] [INFO ] [MAIN ] WF: Fetched primary data is valid. [2025-09-29T21:53:22.476779] [DEBUG] [LOCAL ] WF: Saving primary data. [2025-09-29T21:53:22.477318] [DEBUG] [LOCAL ] WF: Trimmed 16340 records to 10719 (keeping 200 days of data) [2025-09-29T21:53:22.544380] [DEBUG] [LOCAL ] WF: Primary data saved (10719 records). [2025-09-29T21:53:22.544523] [INFO ] [MAIN ] WF: Full history saved. [2025-09-29T21:53:22.544621] [INFO ] [MAIN ] Update Progress: 2286/2371 symbols completed. WF took 20.9s. Estimated remaining: 10m 54s. Rate: 7.8 symbols/min [2025-09-29T21:53:22.721905] [INFO ] [MAIN ] WFG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:53:22.753308] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-03. [2025-09-29T21:53:22.754579] [DEBUG] [LOCAL ] WFG: Loaded 25211 existing records from primary storage. [2025-09-29T21:53:22.755833] [INFO ] [MAIN ] WFG: Loaded 25211 existing records. [2025-09-29T21:53:22.967044] [WARN ] [MAIN ] WFG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:53:22.967258] [INFO ] [MAIN ] WFG: Wiping existing primary data before full refresh. [2025-09-29T21:53:22.967306] [INFO ] [LOCAL ] WFG: Starting deletion of primary data. [2025-09-29T21:53:22.967711] [DEBUG] [LOCAL ] WFG: Deleted primary data file. [2025-09-29T21:53:22.967770] [INFO ] [MAIN ] WFG: Starting full primary refresh. [2025-09-29T21:53:23.346694] [INFO ] [REMOTE ] WFG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:53:23.413107] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-29T21:53:23.548116] [INFO ] [REMOTE ] WFG: Fetching primary data for 2024-12. [2025-09-29T21:53:24.348108] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-08. [2025-09-29T21:53:24.495863] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-29T21:53:24.903034] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-29T21:53:25.148131] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-04. [2025-09-29T21:53:25.347101] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-29T21:53:25.948102] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-01. [2025-09-29T21:53:26.748122] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-08. [2025-09-29T21:53:27.055957] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-29T21:53:27.469403] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-29T21:53:27.548096] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-05. [2025-09-29T21:53:28.348128] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-02. [2025-09-29T21:53:28.490992] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-29T21:53:29.148097] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-09. [2025-09-29T21:53:29.447268] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-29T21:53:29.478254] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-29T21:53:29.948086] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-09. [2025-09-29T21:53:30.748099] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-03. [2025-09-29T21:53:30.846990] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-29T21:53:30.857394] [INFO ] [REMOTE ] WES: Full fetch complete (69864 records). [2025-09-29T21:53:30.857540] [DEBUG] [VALIDATOR ] WES: Validating primary data. [2025-09-29T21:53:31.264748] [DEBUG] [VALIDATOR ] WES: All expected trading days are present. [2025-09-29T21:53:31.264853] [DEBUG] [VALIDATOR ] WES: Primary data validation passed. [2025-09-29T21:53:31.266055] [INFO ] [MAIN ] WES: Fetched primary data is valid. [2025-09-29T21:53:31.266207] [DEBUG] [LOCAL ] WES: Saving primary data. [2025-09-29T21:53:31.283928] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-29T21:53:31.290214] [DEBUG] [LOCAL ] WES: Trimmed 69864 records to 47949 (keeping 200 days of data) [2025-09-29T21:53:31.290814] [INFO ] [REMOTE ] WEX: Full fetch complete (50705 records). [2025-09-29T21:53:31.291115] [DEBUG] [VALIDATOR ] WEX: Validating primary data. [2025-09-29T21:53:31.553058] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-06. [2025-09-29T21:53:31.833125] [DEBUG] [VALIDATOR ] WEX: All expected trading days are present. [2025-09-29T21:53:31.833519] [DEBUG] [VALIDATOR ] WEX: Primary data validation passed. [2025-09-29T21:53:31.835576] [INFO ] [MAIN ] WEX: Fetched primary data is valid. [2025-09-29T21:53:31.836857] [DEBUG] [LOCAL ] WEX: Saving primary data. [2025-09-29T21:53:31.842228] [DEBUG] [LOCAL ] WEX: Trimmed 50705 records to 34822 (keeping 200 days of data) [2025-09-29T21:53:31.953690] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-29T21:53:32.272224] [DEBUG] [LOCAL ] WES: Primary data saved (47949 records). [2025-09-29T21:53:32.273068] [INFO ] [MAIN ] WES: Full history saved. [2025-09-29T21:53:32.273815] [INFO ] [MAIN ] Update Progress: 2287/2371 symbols completed. WES took 43.1s. Estimated remaining: 10m 47s. Rate: 7.8 symbols/min [2025-09-29T21:53:32.353722] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-04. [2025-09-29T21:53:32.381210] [DEBUG] [LOCAL ] WEX: Primary data saved (34822 records). [2025-09-29T21:53:32.397202] [INFO ] [MAIN ] WEX: Full history saved. [2025-09-29T21:53:32.400634] [INFO ] [MAIN ] Update Progress: 2288/2371 symbols completed. WEX took 33.4s. Estimated remaining: 10m 39s. Rate: 7.8 symbols/min [2025-09-29T21:53:32.602323] [INFO ] [MAIN ] WGO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:53:32.667014] [INFO ] [MAIN ] WH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:53:32.717128] [DEBUG] [LOCAL ] WGO: Loaded 39823 existing records from primary storage. [2025-09-29T21:53:32.717420] [INFO ] [MAIN ] WGO: Loaded 39823 existing records. [2025-09-29T21:53:32.834500] [DEBUG] [LOCAL ] WH: Loaded 46339 existing records from primary storage. [2025-09-29T21:53:32.850711] [INFO ] [MAIN ] WH: Loaded 46339 existing records. [2025-09-29T21:53:33.006311] [WARN ] [MAIN ] WGO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:53:33.024136] [INFO ] [MAIN ] WGO: Wiping existing primary data before full refresh. [2025-09-29T21:53:33.035018] [INFO ] [LOCAL ] WGO: Starting deletion of primary data. [2025-09-29T21:53:33.040786] [DEBUG] [LOCAL ] WGO: Deleted primary data file. [2025-09-29T21:53:33.051130] [INFO ] [MAIN ] WGO: Starting full primary refresh. [2025-09-29T21:53:33.204680] [WARN ] [MAIN ] WH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:53:33.229714] [INFO ] [MAIN ] WH: Wiping existing primary data before full refresh. [2025-09-29T21:53:33.240499] [INFO ] [LOCAL ] WH: Starting deletion of primary data. [2025-09-29T21:53:33.256517] [DEBUG] [LOCAL ] WH: Deleted primary data file. [2025-09-29T21:53:33.275695] [INFO ] [MAIN ] WH: Starting full primary refresh. [2025-09-29T21:53:33.771916] [INFO ] [REMOTE ] WGO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:53:33.782283] [INFO ] [REMOTE ] WGO: Fetching primary data for 2024-12. [2025-09-29T21:53:33.937524] [INFO ] [REMOTE ] WH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:53:33.939903] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-29T21:53:33.958096] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-05. [2025-09-29T21:53:33.978781] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-09-29T21:53:34.748086] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-07. [2025-09-29T21:53:34.807365] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-29T21:53:35.349329] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-29T21:53:35.548169] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-01. [2025-09-29T21:53:36.348131] [INFO ] [REMOTE ] WH: Fetching primary data for 2024-12. [2025-09-29T21:53:36.982749] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-29T21:53:37.140896] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-29T21:53:37.149482] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-08. [2025-09-29T21:53:37.875335] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-29T21:53:37.948109] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-02. [2025-09-29T21:53:38.748118] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-06. [2025-09-29T21:53:39.075579] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-29T21:53:39.488829] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-09-29T21:53:39.548095] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-09. [2025-09-29T21:53:39.958185] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-29T21:53:40.355790] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-01. [2025-09-29T21:53:40.396096] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-29T21:53:40.414836] [INFO ] [REMOTE ] WFC: Full fetch complete (77791 records). [2025-09-29T21:53:40.415104] [DEBUG] [VALIDATOR ] WFC: Validating primary data. [2025-09-29T21:53:41.031769] [DEBUG] [VALIDATOR ] WFC: All expected trading days are present. [2025-09-29T21:53:41.031911] [DEBUG] [VALIDATOR ] WFC: Primary data validation passed. [2025-09-29T21:53:41.034568] [INFO ] [MAIN ] WFC: Fetched primary data is valid. [2025-09-29T21:53:41.034815] [DEBUG] [LOCAL ] WFC: Saving primary data. [2025-09-29T21:53:41.036753] [DEBUG] [LOCAL ] WFC: Trimmed 77791 records to 53748 (keeping 200 days of data) [2025-09-29T21:53:41.179014] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-03. [2025-09-29T21:53:41.495418] [DEBUG] [LOCAL ] WFC: Primary data saved (53748 records). [2025-09-29T21:53:41.495575] [INFO ] [MAIN ] WFC: Full history saved. [2025-09-29T21:53:41.495737] [INFO ] [MAIN ] Update Progress: 2289/2371 symbols completed. WFC took 36.6s. Estimated remaining: 10m 31s. Rate: 7.8 symbols/min [2025-09-29T21:53:41.692127] [INFO ] [MAIN ] WHD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:53:41.762945] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-29T21:53:41.761252] [DEBUG] [LOCAL ] WHD: Loaded 41130 existing records from primary storage. [2025-09-29T21:53:41.771720] [INFO ] [MAIN ] WHD: Loaded 41130 existing records. [2025-09-29T21:53:41.958824] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-07. [2025-09-29T21:53:41.965894] [WARN ] [MAIN ] WHD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:53:41.967078] [INFO ] [MAIN ] WHD: Wiping existing primary data before full refresh. [2025-09-29T21:53:41.967147] [INFO ] [LOCAL ] WHD: Starting deletion of primary data. [2025-09-29T21:53:41.967735] [DEBUG] [LOCAL ] WHD: Deleted primary data file. [2025-09-29T21:53:41.967799] [INFO ] [MAIN ] WHD: Starting full primary refresh. [2025-09-29T21:53:42.349625] [INFO ] [REMOTE ] WHD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:53:42.657385] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-29T21:53:42.748165] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-02. [2025-09-29T21:53:43.260583] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-29T21:53:43.548179] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-04. [2025-09-29T21:53:44.319169] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-29T21:53:44.348076] [INFO ] [REMOTE ] WHD: Fetching primary data for 2024-12. [2025-09-29T21:53:45.153305] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-08. [2025-09-29T21:53:45.167507] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-29T21:53:45.820818] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-29T21:53:45.948116] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-01. [2025-09-29T21:53:46.151425] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-29T21:53:46.748157] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-05. [2025-09-29T21:53:47.421959] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-29T21:53:47.548145] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-02. [2025-09-29T21:53:47.983455] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-29T21:53:48.348185] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-06. [2025-09-29T21:53:48.903030] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-29T21:53:49.148110] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-03. [2025-09-29T21:53:49.932155] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-29T21:53:49.948064] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-07. [2025-09-29T21:53:50.598442] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-29T21:53:50.748116] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-09. [2025-09-29T21:53:51.421898] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-29T21:53:51.548134] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-04. [2025-09-29T21:53:51.669584] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-29T21:53:51.675526] [INFO ] [REMOTE ] WFG: Full fetch complete (35813 records). [2025-09-29T21:53:51.675674] [DEBUG] [VALIDATOR ] WFG: Validating primary data. [2025-09-29T21:53:52.083007] [DEBUG] [VALIDATOR ] WFG: All expected trading days are present. [2025-09-29T21:53:52.083149] [DEBUG] [VALIDATOR ] WFG: Primary data validation passed. [2025-09-29T21:53:52.084005] [INFO ] [MAIN ] WFG: Fetched primary data is valid. [2025-09-29T21:53:52.084072] [DEBUG] [LOCAL ] WFG: Saving primary data. [2025-09-29T21:53:52.085278] [DEBUG] [LOCAL ] WFG: Trimmed 35813 records to 24760 (keeping 200 days of data) [2025-09-29T21:53:52.252529] [DEBUG] [LOCAL ] WFG: Primary data saved (24760 records). [2025-09-29T21:53:52.252736] [INFO ] [MAIN ] WFG: Full history saved. [2025-09-29T21:53:52.252856] [INFO ] [MAIN ] Update Progress: 2290/2371 symbols completed. WFG took 29.7s. Estimated remaining: 10m 24s. Rate: 7.8 symbols/min [2025-09-29T21:53:52.356378] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-03. [2025-09-29T21:53:52.435920] [INFO ] [MAIN ] WHG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:53:52.442555] [DEBUG] [LOCAL ] WHG: Loaded 3416 existing records from primary storage. [2025-09-29T21:53:52.442741] [INFO ] [MAIN ] WHG: Loaded 3416 existing records. [2025-09-29T21:53:52.630526] [WARN ] [MAIN ] WHG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:53:52.630755] [INFO ] [MAIN ] WHG: Wiping existing primary data before full refresh. [2025-09-29T21:53:52.630808] [INFO ] [LOCAL ] WHG: Starting deletion of primary data. [2025-09-29T21:53:52.631009] [DEBUG] [LOCAL ] WHG: Deleted primary data file. [2025-09-29T21:53:52.631067] [INFO ] [MAIN ] WHG: Starting full primary refresh. [2025-09-29T21:53:53.033626] [INFO ] [REMOTE ] WHG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:53:53.148103] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-08. [2025-09-29T21:53:53.178831] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-29T21:53:53.948141] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-05. [2025-09-29T21:53:54.193260] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-29T21:53:54.267696] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-29T21:53:54.748128] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-09. [2025-09-29T21:53:55.496388] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-29T21:53:55.548155] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-06. [2025-09-29T21:53:55.995076] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-29T21:53:56.004596] [INFO ] [REMOTE ] WGO: Full fetch complete (57502 records). [2025-09-29T21:53:56.004782] [DEBUG] [VALIDATOR ] WGO: Validating primary data. [2025-09-29T21:53:56.353435] [INFO ] [REMOTE ] WHG: Fetching primary data for 2024-12. [2025-09-29T21:53:56.410902] [DEBUG] [VALIDATOR ] WGO: All expected trading days are present. [2025-09-29T21:53:56.410996] [DEBUG] [VALIDATOR ] WGO: Primary data validation passed. [2025-09-29T21:53:56.412044] [INFO ] [MAIN ] WGO: Fetched primary data is valid. [2025-09-29T21:53:56.412109] [DEBUG] [LOCAL ] WGO: Saving primary data. [2025-09-29T21:53:56.413380] [DEBUG] [LOCAL ] WGO: Trimmed 57502 records to 39119 (keeping 200 days of data) [2025-09-29T21:53:56.686483] [DEBUG] [LOCAL ] WGO: Primary data saved (39119 records). [2025-09-29T21:53:56.686665] [INFO ] [MAIN ] WGO: Full history saved. [2025-09-29T21:53:56.686810] [INFO ] [MAIN ] Update Progress: 2291/2371 symbols completed. WGO took 24.4s. Estimated remaining: 10m 16s. Rate: 7.8 symbols/min [2025-09-29T21:53:56.865106] [INFO ] [MAIN ] WHR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:53:56.922190] [DEBUG] [LOCAL ] WHR: Loaded 48846 existing records from primary storage. [2025-09-29T21:53:56.922537] [INFO ] [MAIN ] WHR: Loaded 48846 existing records. [2025-09-29T21:53:57.041722] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-29T21:53:57.150394] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-01. [2025-09-29T21:53:57.141279] [WARN ] [MAIN ] WHR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:53:57.156841] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-29T21:53:57.155305] [INFO ] [MAIN ] WHR: Wiping existing primary data before full refresh. [2025-09-29T21:53:57.165053] [INFO ] [LOCAL ] WHR: Starting deletion of primary data. [2025-09-29T21:53:57.166215] [DEBUG] [LOCAL ] WHR: Deleted primary data file. [2025-09-29T21:53:57.166305] [INFO ] [MAIN ] WHR: Starting full primary refresh. [2025-09-29T21:53:57.537325] [INFO ] [REMOTE ] WHR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:53:57.581592] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-29T21:53:57.948109] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-04. [2025-09-29T21:53:58.748142] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-07. [2025-09-29T21:53:59.548140] [INFO ] [REMOTE ] WHR: Fetching primary data for 2024-12. [2025-09-29T21:53:59.672213] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-29T21:54:00.190473] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-29T21:54:00.348133] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-08. [2025-09-29T21:54:01.094475] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-29T21:54:01.148145] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-05. [2025-09-29T21:54:01.959591] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-29T21:54:01.957634] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-02. [2025-09-29T21:54:02.349192] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-29T21:54:02.587616] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-29T21:54:02.748153] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-06. [2025-09-29T21:54:03.548121] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-01. [2025-09-29T21:54:04.348162] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-09. [2025-09-29T21:54:04.542243] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-29T21:54:05.148089] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-03. [2025-09-29T21:54:05.284846] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-29T21:54:05.792198] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-29T21:54:05.795458] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-29T21:54:05.804432] [INFO ] [REMOTE ] WHD: Full fetch complete (57268 records). [2025-09-29T21:54:05.804585] [DEBUG] [VALIDATOR ] WHD: Validating primary data. [2025-09-29T21:54:05.959595] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-07. [2025-09-29T21:54:06.230315] [DEBUG] [VALIDATOR ] WHD: All expected trading days are present. [2025-09-29T21:54:06.230435] [DEBUG] [VALIDATOR ] WHD: Primary data validation passed. [2025-09-29T21:54:06.231507] [INFO ] [MAIN ] WHD: Fetched primary data is valid. [2025-09-29T21:54:06.231574] [DEBUG] [LOCAL ] WHD: Saving primary data. [2025-09-29T21:54:06.232918] [DEBUG] [LOCAL ] WHD: Trimmed 57268 records to 40413 (keeping 200 days of data) [2025-09-29T21:54:06.490242] [DEBUG] [LOCAL ] WHD: Primary data saved (40413 records). [2025-09-29T21:54:06.490401] [INFO ] [MAIN ] WHD: Full history saved. [2025-09-29T21:54:06.490536] [INFO ] [MAIN ] Update Progress: 2292/2371 symbols completed. WHD took 25.0s. Estimated remaining: 10m 8s. Rate: 7.8 symbols/min [2025-09-29T21:54:06.676914] [INFO ] [MAIN ] WIA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:54:06.685361] [DEBUG] [LOCAL ] WIA: Loaded 4937 existing records from primary storage. [2025-09-29T21:54:06.685565] [INFO ] [MAIN ] WIA: Loaded 4937 existing records. [2025-09-29T21:54:06.753357] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-04. [2025-09-29T21:54:06.875981] [WARN ] [MAIN ] WIA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:54:06.876215] [INFO ] [MAIN ] WIA: Wiping existing primary data before full refresh. [2025-09-29T21:54:06.876264] [INFO ] [LOCAL ] WIA: Starting deletion of primary data. [2025-09-29T21:54:06.876498] [DEBUG] [LOCAL ] WIA: Deleted primary data file. [2025-09-29T21:54:06.876556] [INFO ] [MAIN ] WIA: Starting full primary refresh. [2025-09-29T21:54:07.253432] [INFO ] [REMOTE ] WIA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:54:07.277448] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-29T21:54:07.548160] [INFO ] [REMOTE ] WIA: Fetching primary data for 2024-12. [2025-09-29T21:54:07.856189] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-29T21:54:08.243988] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-29T21:54:08.348109] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-01. [2025-09-29T21:54:08.842573] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-29T21:54:09.148112] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-02. [2025-09-29T21:54:09.948113] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-08. [2025-09-29T21:54:10.748146] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-02. [2025-09-29T21:54:10.855801] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-29T21:54:11.186724] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-29T21:54:11.548137] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-03. [2025-09-29T21:54:11.606450] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-29T21:54:11.898087] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-29T21:54:12.348100] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-05. [2025-09-29T21:54:13.010873] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-29T21:54:13.148109] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-06. [2025-09-29T21:54:13.732000] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-29T21:54:13.948151] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-09. [2025-09-29T21:54:14.748117] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-07. [2025-09-29T21:54:15.246824] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-29T21:54:15.260272] [INFO ] [REMOTE ] WH: Full fetch complete (64958 records). [2025-09-29T21:54:15.260463] [DEBUG] [VALIDATOR ] WH: Validating primary data. [2025-09-29T21:54:15.271734] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-29T21:54:15.553243] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-03. [2025-09-29T21:54:15.686386] [DEBUG] [VALIDATOR ] WH: All expected trading days are present. [2025-09-29T21:54:15.686481] [DEBUG] [VALIDATOR ] WH: Primary data validation passed. [2025-09-29T21:54:15.687733] [INFO ] [MAIN ] WH: Fetched primary data is valid. [2025-09-29T21:54:15.687802] [DEBUG] [LOCAL ] WH: Saving primary data. [2025-09-29T21:54:15.689179] [DEBUG] [LOCAL ] WH: Trimmed 64958 records to 45535 (keeping 200 days of data) [2025-09-29T21:54:16.008923] [DEBUG] [LOCAL ] WH: Primary data saved (45535 records). [2025-09-29T21:54:16.009101] [INFO ] [MAIN ] WH: Full history saved. [2025-09-29T21:54:16.009246] [INFO ] [MAIN ] Update Progress: 2293/2371 symbols completed. WH took 43.6s. Estimated remaining: 10m 0s. Rate: 7.8 symbols/min [2025-09-29T21:54:16.196731] [INFO ] [MAIN ] WINN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:54:16.215068] [DEBUG] [LOCAL ] WINN: Loaded 11944 existing records from primary storage. [2025-09-29T21:54:16.215331] [INFO ] [MAIN ] WINN: Loaded 11944 existing records. [2025-09-29T21:54:16.361410] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-04. [2025-09-29T21:54:16.406288] [WARN ] [MAIN ] WINN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:54:16.406792] [INFO ] [MAIN ] WINN: Wiping existing primary data before full refresh. [2025-09-29T21:54:16.406846] [INFO ] [LOCAL ] WINN: Starting deletion of primary data. [2025-09-29T21:54:16.407455] [DEBUG] [LOCAL ] WINN: Deleted primary data file. [2025-09-29T21:54:16.407518] [INFO ] [MAIN ] WINN: Starting full primary refresh. [2025-09-29T21:54:16.821953] [INFO ] [REMOTE ] WINN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:54:17.041397] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-29T21:54:17.148103] [INFO ] [REMOTE ] WINN: Fetching primary data for 2024-12. [2025-09-29T21:54:17.483781] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-29T21:54:17.810523] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-29T21:54:17.948112] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-08. [2025-09-29T21:54:18.429988] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-29T21:54:18.748159] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-04. [2025-09-29T21:54:19.548121] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-09. [2025-09-29T21:54:19.934834] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-29T21:54:19.935958] [INFO ] [REMOTE ] WHG: Full fetch complete (4643 records). [2025-09-29T21:54:19.936069] [DEBUG] [VALIDATOR ] WHG: Validating primary data. [2025-09-29T21:54:20.320107] [DEBUG] [VALIDATOR ] WHG: All expected trading days are present. [2025-09-29T21:54:20.320319] [DEBUG] [VALIDATOR ] WHG: Primary data validation passed. [2025-09-29T21:54:20.320671] [INFO ] [MAIN ] WHG: Fetched primary data is valid. [2025-09-29T21:54:20.320765] [DEBUG] [LOCAL ] WHG: Saving primary data. [2025-09-29T21:54:20.321544] [DEBUG] [LOCAL ] WHG: Trimmed 4643 records to 3311 (keeping 200 days of data) [2025-09-29T21:54:20.344330] [DEBUG] [LOCAL ] WHG: Primary data saved (3311 records). [2025-09-29T21:54:20.344472] [INFO ] [MAIN ] WHG: Full history saved. [2025-09-29T21:54:20.344599] [INFO ] [MAIN ] Update Progress: 2294/2371 symbols completed. WHG took 28.1s. Estimated remaining: 9m 53s. Rate: 7.8 symbols/min [2025-09-29T21:54:20.350027] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-05. [2025-09-29T21:54:20.534782] [INFO ] [MAIN ] WIT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:54:20.603835] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-29T21:54:20.634433] [DEBUG] [LOCAL ] WIT: Loaded 53070 existing records from primary storage. [2025-09-29T21:54:20.634797] [INFO ] [MAIN ] WIT: Loaded 53070 existing records. [2025-09-29T21:54:20.822460] [WARN ] [MAIN ] WIT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:54:20.822723] [INFO ] [MAIN ] WIT: Wiping existing primary data before full refresh. [2025-09-29T21:54:20.822791] [INFO ] [LOCAL ] WIT: Starting deletion of primary data. [2025-09-29T21:54:20.823572] [DEBUG] [LOCAL ] WIT: Deleted primary data file. [2025-09-29T21:54:20.823680] [INFO ] [MAIN ] WIT: Starting full primary refresh. [2025-09-29T21:54:21.049526] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-29T21:54:21.163485] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-05. [2025-09-29T21:54:21.205397] [INFO ] [REMOTE ] WIT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:54:21.948104] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-06. [2025-09-29T21:54:22.387903] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-29T21:54:22.753209] [INFO ] [REMOTE ] WIT: Fetching primary data for 2024-12. [2025-09-29T21:54:22.772380] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-29T21:54:23.548119] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-07. [2025-09-29T21:54:24.150831] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-29T21:54:24.348105] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-06. [2025-09-29T21:54:24.614607] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-29T21:54:25.148102] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-01. [2025-09-29T21:54:25.866975] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-29T21:54:25.948097] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-02. [2025-09-29T21:54:26.041888] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-29T21:54:26.442242] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-29T21:54:26.748116] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-03. [2025-09-29T21:54:27.548103] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-08. [2025-09-29T21:54:27.592742] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-29T21:54:28.187761] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-29T21:54:28.348102] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-09. [2025-09-29T21:54:29.019116] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-29T21:54:29.021466] [INFO ] [REMOTE ] WIA: Full fetch complete (7272 records). [2025-09-29T21:54:29.021545] [DEBUG] [VALIDATOR ] WIA: Validating primary data. [2025-09-29T21:54:29.153264] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-04. [2025-09-29T21:54:29.445891] [DEBUG] [VALIDATOR ] WIA: All expected trading days are present. [2025-09-29T21:54:29.445969] [DEBUG] [VALIDATOR ] WIA: Primary data validation passed. [2025-09-29T21:54:29.446151] [INFO ] [MAIN ] WIA: Fetched primary data is valid. [2025-09-29T21:54:29.446190] [DEBUG] [LOCAL ] WIA: Saving primary data. [2025-09-29T21:54:29.446671] [DEBUG] [LOCAL ] WIA: Trimmed 7272 records to 4851 (keeping 200 days of data) [2025-09-29T21:54:29.476905] [DEBUG] [LOCAL ] WIA: Primary data saved (4851 records). [2025-09-29T21:54:29.480566] [INFO ] [MAIN ] WIA: Full history saved. [2025-09-29T21:54:29.480707] [INFO ] [MAIN ] Update Progress: 2295/2371 symbols completed. WIA took 23.0s. Estimated remaining: 9m 45s. Rate: 7.8 symbols/min [2025-09-29T21:54:29.659823] [INFO ] [MAIN ] WIW: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:54:29.681871] [DEBUG] [LOCAL ] WIW: Loaded 20756 existing records from primary storage. [2025-09-29T21:54:29.682142] [INFO ] [MAIN ] WIW: Loaded 20756 existing records. [2025-09-29T21:54:29.877275] [WARN ] [MAIN ] WIW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:54:29.877506] [INFO ] [MAIN ] WIW: Wiping existing primary data before full refresh. [2025-09-29T21:54:29.877557] [INFO ] [LOCAL ] WIW: Starting deletion of primary data. [2025-09-29T21:54:29.877829] [DEBUG] [LOCAL ] WIW: Deleted primary data file. [2025-09-29T21:54:29.877888] [INFO ] [MAIN ] WIW: Starting full primary refresh. [2025-09-29T21:54:29.959111] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-01. [2025-09-29T21:54:30.285379] [INFO ] [REMOTE ] WIW: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:54:30.286766] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-29T21:54:30.748115] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-05. [2025-09-29T21:54:31.404357] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-29T21:54:31.548095] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-06. [2025-09-29T21:54:31.781805] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-29T21:54:32.263353] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-29T21:54:32.348121] [INFO ] [REMOTE ] WIW: Fetching primary data for 2024-12. [2025-09-29T21:54:33.148140] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-02. [2025-09-29T21:54:33.232381] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-29T21:54:33.948103] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-07. [2025-09-29T21:54:34.505584] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-29T21:54:34.715477] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-29T21:54:34.748141] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-03. [2025-09-29T21:54:35.548134] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-01. [2025-09-29T21:54:36.348085] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-08. [2025-09-29T21:54:36.397459] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-29T21:54:36.445890] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-29T21:54:36.989594] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-29T21:54:37.148124] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-02. [2025-09-29T21:54:37.948106] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-09. [2025-09-29T21:54:38.141741] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-29T21:54:38.748165] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-03. [2025-09-29T21:54:38.791614] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-29T21:54:38.794222] [INFO ] [REMOTE ] WINN: Full fetch complete (17621 records). [2025-09-29T21:54:38.794316] [DEBUG] [VALIDATOR ] WINN: Validating primary data. [2025-09-29T21:54:39.180731] [DEBUG] [VALIDATOR ] WINN: All expected trading days are present. [2025-09-29T21:54:39.180856] [DEBUG] [VALIDATOR ] WINN: Primary data validation passed. [2025-09-29T21:54:39.181282] [INFO ] [MAIN ] WINN: Fetched primary data is valid. [2025-09-29T21:54:39.181345] [DEBUG] [LOCAL ] WINN: Saving primary data. [2025-09-29T21:54:39.182001] [DEBUG] [LOCAL ] WINN: Trimmed 17621 records to 11668 (keeping 200 days of data) [2025-09-29T21:54:39.257371] [DEBUG] [LOCAL ] WINN: Primary data saved (11668 records). [2025-09-29T21:54:39.257527] [INFO ] [MAIN ] WINN: Full history saved. [2025-09-29T21:54:39.257614] [INFO ] [MAIN ] Update Progress: 2296/2371 symbols completed. WINN took 23.2s. Estimated remaining: 9m 37s. Rate: 7.8 symbols/min [2025-09-29T21:54:39.437586] [INFO ] [MAIN ] WK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:54:39.481274] [DEBUG] [LOCAL ] WK: Loaded 37342 existing records from primary storage. [2025-09-29T21:54:39.481567] [INFO ] [MAIN ] WK: Loaded 37342 existing records. [2025-09-29T21:54:39.551051] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-04. [2025-09-29T21:54:39.670022] [WARN ] [MAIN ] WK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:54:39.670308] [INFO ] [MAIN ] WK: Wiping existing primary data before full refresh. [2025-09-29T21:54:39.670364] [INFO ] [LOCAL ] WK: Starting deletion of primary data. [2025-09-29T21:54:39.670734] [DEBUG] [LOCAL ] WK: Deleted primary data file. [2025-09-29T21:54:39.670795] [INFO ] [MAIN ] WK: Starting full primary refresh. [2025-09-29T21:54:39.936583] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-29T21:54:40.060059] [INFO ] [REMOTE ] WK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:54:40.348139] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-07. [2025-09-29T21:54:41.148145] [INFO ] [REMOTE ] WK: Fetching primary data for 2024-12. [2025-09-29T21:54:41.286807] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-29T21:54:41.948115] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-04. [2025-09-29T21:54:42.282589] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-29T21:54:42.322703] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-29T21:54:42.748138] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-05. [2025-09-29T21:54:42.840696] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-29T21:54:43.548131] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-08. [2025-09-29T21:54:44.348111] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-05. [2025-09-29T21:54:44.515738] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-29T21:54:45.129094] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-29T21:54:45.148067] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-06. [2025-09-29T21:54:45.350821] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-29T21:54:45.948090] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-06. [2025-09-29T21:54:46.224334] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-29T21:54:46.748127] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-09. [2025-09-29T21:54:47.553716] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-01. [2025-09-29T21:54:47.584145] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-29T21:54:48.036068] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-29T21:54:48.050239] [INFO ] [REMOTE ] WHR: Full fetch complete (68488 records). [2025-09-29T21:54:48.050469] [DEBUG] [VALIDATOR ] WHR: Validating primary data. [2025-09-29T21:54:48.353242] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-07. [2025-09-29T21:54:48.470439] [DEBUG] [VALIDATOR ] WHR: All expected trading days are present. [2025-09-29T21:54:48.470532] [DEBUG] [VALIDATOR ] WHR: Primary data validation passed. [2025-09-29T21:54:48.471692] [INFO ] [MAIN ] WHR: Fetched primary data is valid. [2025-09-29T21:54:48.471761] [DEBUG] [LOCAL ] WHR: Saving primary data. [2025-09-29T21:54:48.473359] [DEBUG] [LOCAL ] WHR: Trimmed 68488 records to 48178 (keeping 200 days of data) [2025-09-29T21:54:48.755534] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-29T21:54:48.834510] [DEBUG] [LOCAL ] WHR: Primary data saved (48178 records). [2025-09-29T21:54:48.834693] [INFO ] [MAIN ] WHR: Full history saved. [2025-09-29T21:54:48.834845] [INFO ] [MAIN ] Update Progress: 2297/2371 symbols completed. WHR took 52.1s. Estimated remaining: 9m 30s. Rate: 7.8 symbols/min [2025-09-29T21:54:49.019184] [INFO ] [MAIN ] WKC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:54:49.062406] [DEBUG] [LOCAL ] WKC: Loaded 35538 existing records from primary storage. [2025-09-29T21:54:49.062762] [INFO ] [MAIN ] WKC: Loaded 35538 existing records. [2025-09-29T21:54:49.153313] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-02. [2025-09-29T21:54:49.260482] [WARN ] [MAIN ] WKC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:54:49.260901] [INFO ] [MAIN ] WKC: Wiping existing primary data before full refresh. [2025-09-29T21:54:49.260960] [INFO ] [LOCAL ] WKC: Starting deletion of primary data. [2025-09-29T21:54:49.261471] [DEBUG] [LOCAL ] WKC: Deleted primary data file. [2025-09-29T21:54:49.261534] [INFO ] [MAIN ] WKC: Starting full primary refresh. [2025-09-29T21:54:49.647496] [INFO ] [REMOTE ] WKC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:54:49.948113] [INFO ] [REMOTE ] WKC: Fetching primary data for 2024-12. [2025-09-29T21:54:50.286124] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-29T21:54:50.478941] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-29T21:54:50.748186] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-08. [2025-09-29T21:54:51.351759] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-29T21:54:51.550870] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-07. [2025-09-29T21:54:52.083524] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-29T21:54:52.348096] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-01. [2025-09-29T21:54:52.680163] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-29T21:54:53.148124] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-03. [2025-09-29T21:54:53.637230] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-29T21:54:53.948113] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-02. [2025-09-29T21:54:54.614746] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-29T21:54:54.748131] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-08. [2025-09-29T21:54:55.003521] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-29T21:54:55.548163] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-04. [2025-09-29T21:54:55.837896] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-29T21:54:56.348132] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-09. [2025-09-29T21:54:56.705611] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-29T21:54:57.148143] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-09. [2025-09-29T21:54:57.405923] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-29T21:54:57.410946] [INFO ] [REMOTE ] WIW: Full fetch complete (29948 records). [2025-09-29T21:54:57.411104] [DEBUG] [VALIDATOR ] WIW: Validating primary data. [2025-09-29T21:54:57.836672] [DEBUG] [VALIDATOR ] WIW: All expected trading days are present. [2025-09-29T21:54:57.836767] [DEBUG] [VALIDATOR ] WIW: Primary data validation passed. [2025-09-29T21:54:57.841424] [INFO ] [MAIN ] WIW: Fetched primary data is valid. [2025-09-29T21:54:57.841535] [DEBUG] [LOCAL ] WIW: Saving primary data. [2025-09-29T21:54:57.842574] [DEBUG] [LOCAL ] WIW: Trimmed 29948 records to 20346 (keeping 200 days of data) [2025-09-29T21:54:57.948412] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-05. [2025-09-29T21:54:57.978383] [DEBUG] [LOCAL ] WIW: Primary data saved (20346 records). [2025-09-29T21:54:57.978520] [INFO ] [MAIN ] WIW: Full history saved. [2025-09-29T21:54:57.978676] [INFO ] [MAIN ] Update Progress: 2298/2371 symbols completed. WIW took 28.5s. Estimated remaining: 9m 22s. Rate: 7.8 symbols/min [2025-09-29T21:54:58.182063] [INFO ] [MAIN ] WLK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:54:58.239373] [DEBUG] [LOCAL ] WLK: Loaded 46113 existing records from primary storage. [2025-09-29T21:54:58.239896] [INFO ] [MAIN ] WLK: Loaded 46113 existing records. [2025-09-29T21:54:58.436105] [WARN ] [MAIN ] WLK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:54:58.436455] [INFO ] [MAIN ] WLK: Wiping existing primary data before full refresh. [2025-09-29T21:54:58.436505] [INFO ] [LOCAL ] WLK: Starting deletion of primary data. [2025-09-29T21:54:58.437097] [DEBUG] [LOCAL ] WLK: Deleted primary data file. [2025-09-29T21:54:58.437158] [INFO ] [MAIN ] WLK: Starting full primary refresh. [2025-09-29T21:54:58.750898] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-03. [2025-09-29T21:54:58.817613] [INFO ] [REMOTE ] WLK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:54:58.851963] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-29T21:54:58.863781] [INFO ] [REMOTE ] WIT: Full fetch complete (75606 records). [2025-09-29T21:54:58.863967] [DEBUG] [VALIDATOR ] WIT: Validating primary data. [2025-09-29T21:54:59.300270] [DEBUG] [VALIDATOR ] WIT: All expected trading days are present. [2025-09-29T21:54:59.300387] [DEBUG] [VALIDATOR ] WIT: Primary data validation passed. [2025-09-29T21:54:59.301699] [INFO ] [MAIN ] WIT: Fetched primary data is valid. [2025-09-29T21:54:59.301833] [DEBUG] [LOCAL ] WIT: Saving primary data. [2025-09-29T21:54:59.323941] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-29T21:54:59.332700] [DEBUG] [LOCAL ] WIT: Trimmed 75606 records to 52326 (keeping 200 days of data) [2025-09-29T21:54:59.550719] [INFO ] [REMOTE ] WLK: Fetching primary data for 2024-12. [2025-09-29T21:54:59.663234] [DEBUG] [LOCAL ] WIT: Primary data saved (52326 records). [2025-09-29T21:54:59.663404] [INFO ] [MAIN ] WIT: Full history saved. [2025-09-29T21:54:59.663511] [INFO ] [MAIN ] Update Progress: 2299/2371 symbols completed. WIT took 39.3s. Estimated remaining: 9m 14s. Rate: 7.8 symbols/min [2025-09-29T21:54:59.840987] [INFO ] [MAIN ] WLKP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:54:59.852319] [DEBUG] [LOCAL ] WLKP: Loaded 6800 existing records from primary storage. [2025-09-29T21:54:59.852578] [INFO ] [MAIN ] WLKP: Loaded 6800 existing records. [2025-09-29T21:55:00.045297] [WARN ] [MAIN ] WLKP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:55:00.045560] [INFO ] [MAIN ] WLKP: Wiping existing primary data before full refresh. [2025-09-29T21:55:00.045617] [INFO ] [LOCAL ] WLKP: Starting deletion of primary data. [2025-09-29T21:55:00.045920] [DEBUG] [LOCAL ] WLKP: Deleted primary data file. [2025-09-29T21:55:00.045988] [INFO ] [MAIN ] WLKP: Starting full primary refresh. [2025-09-29T21:55:00.358359] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-06. [2025-09-29T21:55:00.435317] [INFO ] [REMOTE ] WLKP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:55:00.457486] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-29T21:55:01.138691] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-29T21:55:01.148056] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-01. [2025-09-29T21:55:01.734022] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-29T21:55:01.948098] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-07. [2025-09-29T21:55:02.748097] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2024-12. [2025-09-29T21:55:02.972260] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-29T21:55:03.318454] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-29T21:55:03.343211] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-29T21:55:03.548110] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-02. [2025-09-29T21:55:04.348132] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-08. [2025-09-29T21:55:05.103844] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-29T21:55:05.148100] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-04. [2025-09-29T21:55:05.724481] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-29T21:55:05.948095] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-09. [2025-09-29T21:55:06.407292] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-29T21:55:06.748110] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-01. [2025-09-29T21:55:07.132736] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-29T21:55:07.175909] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-29T21:55:07.184435] [INFO ] [REMOTE ] WK: Full fetch complete (52423 records). [2025-09-29T21:55:07.184561] [DEBUG] [VALIDATOR ] WK: Validating primary data. [2025-09-29T21:55:07.553256] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-02. [2025-09-29T21:55:07.630911] [DEBUG] [VALIDATOR ] WK: All expected trading days are present. [2025-09-29T21:55:07.631048] [DEBUG] [VALIDATOR ] WK: Primary data validation passed. [2025-09-29T21:55:07.632192] [INFO ] [MAIN ] WK: Fetched primary data is valid. [2025-09-29T21:55:07.632279] [DEBUG] [LOCAL ] WK: Saving primary data. [2025-09-29T21:55:07.634139] [DEBUG] [LOCAL ] WK: Trimmed 52423 records to 36964 (keeping 200 days of data) [2025-09-29T21:55:07.880459] [DEBUG] [LOCAL ] WK: Primary data saved (36964 records). [2025-09-29T21:55:07.880606] [INFO ] [MAIN ] WK: Full history saved. [2025-09-29T21:55:07.880727] [INFO ] [MAIN ] Update Progress: 2300/2371 symbols completed. WK took 28.6s. Estimated remaining: 9m 7s. Rate: 7.8 symbols/min [2025-09-29T21:55:08.055878] [INFO ] [MAIN ] WLTG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:55:08.056045] [DEBUG] [LOCAL ] WLTG: No existing data file found in primary storage. [2025-09-29T21:55:08.056083] [WARN ] [MAIN ] WLTG: No existing data found, performing full refresh instead. [2025-09-29T21:55:08.056192] [INFO ] [MAIN ] WLTG: Wiping existing primary data before full refresh. [2025-09-29T21:55:08.056235] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-09-29T21:55:08.056277] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-09-29T21:55:08.056309] [INFO ] [MAIN ] WLTG: Starting full primary refresh. [2025-09-29T21:55:08.248058] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-29T21:55:08.353288] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-03. [2025-09-29T21:55:08.458345] [INFO ] [REMOTE ] WLTG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:55:08.996301] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-29T21:55:09.148149] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-03. [2025-09-29T21:55:09.948140] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-05. [2025-09-29T21:55:10.754175] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2024-12. [2025-09-29T21:55:10.784116] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-29T21:55:11.139235] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-09-29T21:55:11.462502] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-29T21:55:11.548152] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-04. [2025-09-29T21:55:12.348174] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-04. [2025-09-29T21:55:12.899825] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-29T21:55:12.948359] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-29T21:55:13.148136] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-06. [2025-09-29T21:55:13.948105] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-05. [2025-09-29T21:55:14.542093] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-29T21:55:14.748125] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-07. [2025-09-29T21:55:15.548095] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-05. [2025-09-29T21:55:15.717887] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-29T21:55:16.095029] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-29T21:55:16.348105] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-06. [2025-09-29T21:55:16.379080] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-29T21:55:17.148125] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-08. [2025-09-29T21:55:17.950996] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-01. [2025-09-29T21:55:17.956774] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-29T21:55:18.377640] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-29T21:55:18.599357] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-29T21:55:18.748128] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-09. [2025-09-29T21:55:19.548175] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-07. [2025-09-29T21:55:20.136705] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-29T21:55:20.144976] [INFO ] [REMOTE ] WKC: Full fetch complete (51116 records). [2025-09-29T21:55:20.145169] [DEBUG] [VALIDATOR ] WKC: Validating primary data. [2025-09-29T21:55:20.353866] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-02. [2025-09-29T21:55:20.562239] [DEBUG] [VALIDATOR ] WKC: All expected trading days are present. [2025-09-29T21:55:20.562381] [DEBUG] [VALIDATOR ] WKC: Primary data validation passed. [2025-09-29T21:55:20.564018] [INFO ] [MAIN ] WKC: Fetched primary data is valid. [2025-09-29T21:55:20.564098] [DEBUG] [LOCAL ] WKC: Saving primary data. [2025-09-29T21:55:20.565742] [DEBUG] [LOCAL ] WKC: Trimmed 51116 records to 34919 (keeping 200 days of data) [2025-09-29T21:55:20.813994] [DEBUG] [LOCAL ] WKC: Primary data saved (34919 records). [2025-09-29T21:55:20.814262] [INFO ] [MAIN ] WKC: Full history saved. [2025-09-29T21:55:20.814411] [INFO ] [MAIN ] Update Progress: 2301/2371 symbols completed. WKC took 32.0s. Estimated remaining: 8m 59s. Rate: 7.8 symbols/min [2025-09-29T21:55:21.016609] [INFO ] [MAIN ] WLY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:55:21.058896] [DEBUG] [LOCAL ] WLY: Loaded 30414 existing records from primary storage. [2025-09-29T21:55:21.059351] [INFO ] [MAIN ] WLY: Loaded 30414 existing records. [2025-09-29T21:55:21.156012] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-06. [2025-09-29T21:55:21.274039] [WARN ] [MAIN ] WLY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:55:21.267708] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-29T21:55:21.276881] [INFO ] [MAIN ] WLY: Wiping existing primary data before full refresh. [2025-09-29T21:55:21.277269] [INFO ] [LOCAL ] WLY: Starting deletion of primary data. [2025-09-29T21:55:21.278031] [DEBUG] [LOCAL ] WLY: Deleted primary data file. [2025-09-29T21:55:21.278137] [INFO ] [MAIN ] WLY: Starting full primary refresh. [2025-09-29T21:55:21.501961] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-29T21:55:21.696752] [INFO ] [REMOTE ] WLY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:55:21.719341] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-29T21:55:21.948142] [INFO ] [REMOTE ] WLY: Fetching primary data for 2024-12. [2025-09-29T21:55:22.748138] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-03. [2025-09-29T21:55:22.980156] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-29T21:55:23.094040] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-29T21:55:23.548145] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-04. [2025-09-29T21:55:24.041414] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-29T21:55:24.348153] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-08. [2025-09-29T21:55:25.148166] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-05. [2025-09-29T21:55:25.507537] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-29T21:55:25.948097] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-06. [2025-09-29T21:55:25.990053] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-29T21:55:26.315194] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-29T21:55:26.748178] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-07. [2025-09-29T21:55:27.168175] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-29T21:55:27.548125] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-08. [2025-09-29T21:55:27.856196] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-29T21:55:28.348144] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-09. [2025-09-29T21:55:29.148122] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-01. [2025-09-29T21:55:29.769266] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-29T21:55:29.778506] [INFO ] [REMOTE ] WLK: Full fetch complete (62888 records). [2025-09-29T21:55:29.778686] [DEBUG] [VALIDATOR ] WLK: Validating primary data. [2025-09-29T21:55:29.956690] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-09. [2025-09-29T21:55:30.248108] [DEBUG] [VALIDATOR ] WLK: All expected trading days are present. [2025-09-29T21:55:30.248271] [DEBUG] [VALIDATOR ] WLK: Primary data validation passed. [2025-09-29T21:55:30.249805] [INFO ] [MAIN ] WLK: Fetched primary data is valid. [2025-09-29T21:55:30.250437] [DEBUG] [LOCAL ] WLK: Saving primary data. [2025-09-29T21:55:30.252969] [DEBUG] [LOCAL ] WLK: Trimmed 62888 records to 45427 (keeping 200 days of data) [2025-09-29T21:55:30.385073] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-29T21:55:30.387036] [INFO ] [REMOTE ] WLTG: Full fetch complete (1673 records). [2025-09-29T21:55:30.387396] [DEBUG] [VALIDATOR ] WLTG: Validating primary data. [2025-09-29T21:55:30.513181] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-29T21:55:30.715264] [WARN ] [VALIDATOR ] WLTG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-29T21:55:30.716335] [FATAL] [MAIN ] WLTG: Fetched primary data is invalid. Refusing to save it. [2025-09-29T21:55:30.716710] [WARN ] [MAIN ] WLTG: Deleting existing primary and derivative data due to validation failure. [2025-09-29T21:55:30.717150] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-09-29T21:55:30.717548] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-09-29T21:55:30.717637] [INFO ] [LOCAL ] WLTG: Starting deletion of derivative data. [2025-09-29T21:55:30.718087] [DEBUG] [LOCAL ] WLTG: No derivative data file found to delete. [2025-09-29T21:55:30.718279] [INFO ] [MAIN ] Update Progress: 2302/2371 symbols completed. WLTG took 22.8s. Estimated remaining: 8m 51s. Rate: 7.8 symbols/min [2025-09-29T21:55:30.752357] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-02. [2025-09-29T21:55:30.917606] [INFO ] [MAIN ] WM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:55:30.997335] [DEBUG] [LOCAL ] WLK: Primary data saved (45427 records). [2025-09-29T21:55:30.997723] [INFO ] [MAIN ] WLK: Full history saved. [2025-09-29T21:55:30.997864] [INFO ] [MAIN ] Update Progress: 2303/2371 symbols completed. WLK took 33.0s. Estimated remaining: 8m 43s. Rate: 7.8 symbols/min [2025-09-29T21:55:31.098536] [DEBUG] [LOCAL ] WM: Loaded 51697 existing records from primary storage. [2025-09-29T21:55:31.121224] [INFO ] [MAIN ] WM: Loaded 51697 existing records. [2025-09-29T21:55:31.308593] [INFO ] [MAIN ] WMB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:55:31.397722] [WARN ] [MAIN ] WM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:55:31.398077] [INFO ] [MAIN ] WM: Wiping existing primary data before full refresh. [2025-09-29T21:55:31.398144] [INFO ] [LOCAL ] WM: Starting deletion of primary data. [2025-09-29T21:55:31.398866] [DEBUG] [LOCAL ] WM: Deleted primary data file. [2025-09-29T21:55:31.402831] [INFO ] [MAIN ] WM: Starting full primary refresh. [2025-09-29T21:55:31.556723] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-07. [2025-09-29T21:55:31.714962] [DEBUG] [LOCAL ] WMB: Loaded 54451 existing records from primary storage. [2025-09-29T21:55:31.744712] [INFO ] [MAIN ] WMB: Loaded 54451 existing records. [2025-09-29T21:55:32.005023] [INFO ] [REMOTE ] WM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:55:32.027877] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-29T21:55:32.093785] [WARN ] [MAIN ] WMB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:55:32.094035] [INFO ] [MAIN ] WMB: Wiping existing primary data before full refresh. [2025-09-29T21:55:32.094110] [INFO ] [LOCAL ] WMB: Starting deletion of primary data. [2025-09-29T21:55:32.094784] [DEBUG] [LOCAL ] WMB: Deleted primary data file. [2025-09-29T21:55:32.094845] [INFO ] [MAIN ] WMB: Starting full primary refresh. [2025-09-29T21:55:32.353333] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-03. [2025-09-29T21:55:32.408519] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-29T21:55:32.489085] [INFO ] [REMOTE ] WMB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:55:33.148129] [INFO ] [REMOTE ] WMB: Fetching primary data for 2024-12. [2025-09-29T21:55:33.828632] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-29T21:55:33.948150] [INFO ] [REMOTE ] WM: Fetching primary data for 2024-12. [2025-09-29T21:55:34.748090] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-08. [2025-09-29T21:55:35.492882] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-09-29T21:55:35.494610] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-29T21:55:35.548083] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-09. [2025-09-29T21:55:35.613670] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-29T21:55:36.247839] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-29T21:55:36.250891] [INFO ] [REMOTE ] WLKP: Full fetch complete (10317 records). [2025-09-29T21:55:36.250969] [DEBUG] [VALIDATOR ] WLKP: Validating primary data. [2025-09-29T21:55:36.355863] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-01. [2025-09-29T21:55:36.678724] [DEBUG] [VALIDATOR ] WLKP: All expected trading days are present. [2025-09-29T21:55:36.678837] [DEBUG] [VALIDATOR ] WLKP: Primary data validation passed. [2025-09-29T21:55:36.679237] [INFO ] [MAIN ] WLKP: Fetched primary data is valid. [2025-09-29T21:55:36.679322] [DEBUG] [LOCAL ] WLKP: Saving primary data. [2025-09-29T21:55:36.679988] [DEBUG] [LOCAL ] WLKP: Trimmed 10317 records to 6768 (keeping 200 days of data) [2025-09-29T21:55:36.730918] [DEBUG] [LOCAL ] WLKP: Primary data saved (6768 records). [2025-09-29T21:55:36.731058] [INFO ] [MAIN ] WLKP: Full history saved. [2025-09-29T21:55:36.731164] [INFO ] [MAIN ] Update Progress: 2304/2371 symbols completed. WLKP took 37.1s. Estimated remaining: 8m 36s. Rate: 7.8 symbols/min [2025-09-29T21:55:36.928475] [INFO ] [MAIN ] WMK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:55:36.951597] [DEBUG] [LOCAL ] WMK: Loaded 14753 existing records from primary storage. [2025-09-29T21:55:36.951891] [INFO ] [MAIN ] WMK: Loaded 14753 existing records. [2025-09-29T21:55:37.147110] [WARN ] [MAIN ] WMK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:55:37.147351] [INFO ] [MAIN ] WMK: Wiping existing primary data before full refresh. [2025-09-29T21:55:37.147399] [INFO ] [LOCAL ] WMK: Starting deletion of primary data. [2025-09-29T21:55:37.147748] [DEBUG] [LOCAL ] WMK: Deleted primary data file. [2025-09-29T21:55:37.147807] [INFO ] [MAIN ] WMK: Starting full primary refresh. [2025-09-29T21:55:37.159478] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-01. [2025-09-29T21:55:37.531106] [INFO ] [REMOTE ] WMK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:55:37.948139] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-04. [2025-09-29T21:55:38.035075] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-29T21:55:38.748135] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-02. [2025-09-29T21:55:38.950886] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-29T21:55:38.975688] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-29T21:55:39.548112] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-02. [2025-09-29T21:55:40.348139] [INFO ] [REMOTE ] WMK: Fetching primary data for 2024-12. [2025-09-29T21:55:40.861584] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-29T21:55:41.148137] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-05. [2025-09-29T21:55:41.183247] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-29T21:55:41.285164] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-29T21:55:41.948150] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-03. [2025-09-29T21:55:42.297711] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-29T21:55:42.748099] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-06. [2025-09-29T21:55:43.554939] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-03. [2025-09-29T21:55:43.567780] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-29T21:55:43.741155] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-29T21:55:44.348176] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-07. [2025-09-29T21:55:45.148175] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-04. [2025-09-29T21:55:45.448382] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-29T21:55:45.743535] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-29T21:55:45.948143] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-01. [2025-09-29T21:55:46.748126] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-04. [2025-09-29T21:55:46.839055] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-29T21:55:47.209297] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-29T21:55:47.548170] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-05. [2025-09-29T21:55:48.348086] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-08. [2025-09-29T21:55:48.698257] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-29T21:55:49.134233] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-29T21:55:49.148085] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-05. [2025-09-29T21:55:49.595331] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-29T21:55:49.948156] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-02. [2025-09-29T21:55:50.748105] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-06. [2025-09-29T21:55:50.823882] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-29T21:55:50.969886] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-29T21:55:51.548171] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-06. [2025-09-29T21:55:52.279006] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-29T21:55:52.348103] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-09. [2025-09-29T21:55:53.148130] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-07. [2025-09-29T21:55:53.150677] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-29T21:55:53.725371] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-29T21:55:53.732568] [INFO ] [REMOTE ] WLY: Full fetch complete (42983 records). [2025-09-29T21:55:53.732712] [DEBUG] [VALIDATOR ] WLY: Validating primary data. [2025-09-29T21:55:53.957520] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-03. [2025-09-29T21:55:54.157070] [DEBUG] [VALIDATOR ] WLY: All expected trading days are present. [2025-09-29T21:55:54.157258] [DEBUG] [VALIDATOR ] WLY: Primary data validation passed. [2025-09-29T21:55:54.158424] [INFO ] [MAIN ] WLY: Fetched primary data is valid. [2025-09-29T21:55:54.158497] [DEBUG] [LOCAL ] WLY: Saving primary data. [2025-09-29T21:55:54.159826] [DEBUG] [LOCAL ] WLY: Trimmed 42983 records to 29803 (keeping 200 days of data) [2025-09-29T21:55:54.389072] [DEBUG] [LOCAL ] WLY: Primary data saved (29803 records). [2025-09-29T21:55:54.389225] [INFO ] [MAIN ] WLY: Full history saved. [2025-09-29T21:55:54.389354] [INFO ] [MAIN ] Update Progress: 2305/2371 symbols completed. WLY took 33.6s. Estimated remaining: 8m 28s. Rate: 7.8 symbols/min [2025-09-29T21:55:54.601501] [INFO ] [MAIN ] WMS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:55:54.651504] [DEBUG] [LOCAL ] WMS: Loaded 40249 existing records from primary storage. [2025-09-29T21:55:54.651875] [INFO ] [MAIN ] WMS: Loaded 40249 existing records. [2025-09-29T21:55:54.753245] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-07. [2025-09-29T21:55:54.841665] [WARN ] [MAIN ] WMS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:55:54.842138] [INFO ] [MAIN ] WMS: Wiping existing primary data before full refresh. [2025-09-29T21:55:54.842251] [INFO ] [LOCAL ] WMS: Starting deletion of primary data. [2025-09-29T21:55:54.843012] [DEBUG] [LOCAL ] WMS: Deleted primary data file. [2025-09-29T21:55:54.843198] [INFO ] [MAIN ] WMS: Starting full primary refresh. [2025-09-29T21:55:55.183138] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-29T21:55:55.253720] [INFO ] [REMOTE ] WMS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:55:55.288877] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-29T21:55:55.548121] [INFO ] [REMOTE ] WMS: Fetching primary data for 2024-12. [2025-09-29T21:55:56.348073] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-04. [2025-09-29T21:55:56.565273] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-29T21:55:57.090363] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-29T21:55:57.148150] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-01. [2025-09-29T21:55:57.440449] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-29T21:55:57.948144] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-08. [2025-09-29T21:55:58.748154] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-05. [2025-09-29T21:55:58.797089] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-29T21:55:59.548095] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-02. [2025-09-29T21:55:59.777442] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-29T21:55:59.868162] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-29T21:56:00.348120] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-09. [2025-09-29T21:56:01.154815] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-08. [2025-09-29T21:56:01.161988] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-29T21:56:01.174584] [INFO ] [REMOTE ] WMB: Full fetch complete (77690 records). [2025-09-29T21:56:01.174830] [DEBUG] [VALIDATOR ] WMB: Validating primary data. [2025-09-29T21:56:01.574880] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-29T21:56:01.730733] [DEBUG] [VALIDATOR ] WMB: All expected trading days are present. [2025-09-29T21:56:01.730838] [DEBUG] [VALIDATOR ] WMB: Primary data validation passed. [2025-09-29T21:56:01.732096] [INFO ] [MAIN ] WMB: Fetched primary data is valid. [2025-09-29T21:56:01.732171] [DEBUG] [LOCAL ] WMB: Saving primary data. [2025-09-29T21:56:01.733857] [DEBUG] [LOCAL ] WMB: Trimmed 77690 records to 53671 (keeping 200 days of data) [2025-09-29T21:56:01.968676] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-03. [2025-09-29T21:56:02.106866] [DEBUG] [LOCAL ] WMB: Primary data saved (53671 records). [2025-09-29T21:56:02.107062] [INFO ] [MAIN ] WMB: Full history saved. [2025-09-29T21:56:02.107159] [INFO ] [MAIN ] Update Progress: 2306/2371 symbols completed. WMB took 31.1s. Estimated remaining: 8m 21s. Rate: 7.8 symbols/min [2025-09-29T21:56:02.294557] [INFO ] [MAIN ] WMT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:56:02.359599] [DEBUG] [LOCAL ] WMT: Loaded 54580 existing records from primary storage. [2025-09-29T21:56:02.360024] [INFO ] [MAIN ] WMT: Loaded 54580 existing records. [2025-09-29T21:56:02.549461] [WARN ] [MAIN ] WMT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:56:02.549872] [INFO ] [MAIN ] WMT: Wiping existing primary data before full refresh. [2025-09-29T21:56:02.549933] [INFO ] [LOCAL ] WMT: Starting deletion of primary data. [2025-09-29T21:56:02.551015] [DEBUG] [LOCAL ] WMT: Deleted primary data file. [2025-09-29T21:56:02.551096] [INFO ] [MAIN ] WMT: Starting full primary refresh. [2025-09-29T21:56:02.770575] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-06. [2025-09-29T21:56:02.933869] [INFO ] [REMOTE ] WMT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:56:03.299809] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-29T21:56:03.502092] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-29T21:56:03.548081] [INFO ] [REMOTE ] WMT: Fetching primary data for 2024-12. [2025-09-29T21:56:03.597613] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-29T21:56:04.348120] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-07. [2025-09-29T21:56:05.148130] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-04. [2025-09-29T21:56:05.239331] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-29T21:56:05.948084] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-08. [2025-09-29T21:56:06.163825] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2024-12 (2.62 seconds). [2025-09-29T21:56:06.487595] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-29T21:56:06.748097] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-05. [2025-09-29T21:56:06.896032] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-29T21:56:07.548154] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-09. [2025-09-29T21:56:08.345876] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-29T21:56:08.354376] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-01. [2025-09-29T21:56:08.480971] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-29T21:56:08.484824] [INFO ] [REMOTE ] WMK: Full fetch complete (19564 records). [2025-09-29T21:56:08.484934] [DEBUG] [VALIDATOR ] WMK: Validating primary data. [2025-09-29T21:56:08.882286] [DEBUG] [VALIDATOR ] WMK: All expected trading days are present. [2025-09-29T21:56:08.882401] [DEBUG] [VALIDATOR ] WMK: Primary data validation passed. [2025-09-29T21:56:08.882978] [INFO ] [MAIN ] WMK: Fetched primary data is valid. [2025-09-29T21:56:08.883062] [DEBUG] [LOCAL ] WMK: Saving primary data. [2025-09-29T21:56:08.884088] [DEBUG] [LOCAL ] WMK: Trimmed 19564 records to 14479 (keeping 200 days of data) [2025-09-29T21:56:08.988715] [DEBUG] [LOCAL ] WMK: Primary data saved (14479 records). [2025-09-29T21:56:08.988966] [INFO ] [MAIN ] WMK: Full history saved. [2025-09-29T21:56:08.989122] [INFO ] [MAIN ] Update Progress: 2307/2371 symbols completed. WMK took 32.3s. Estimated remaining: 8m 13s. Rate: 7.8 symbols/min [2025-09-29T21:56:09.148152] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-06. [2025-09-29T21:56:09.167939] [INFO ] [MAIN ] WNC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:56:09.214866] [DEBUG] [LOCAL ] WNC: Loaded 40452 existing records from primary storage. [2025-09-29T21:56:09.215202] [INFO ] [MAIN ] WNC: Loaded 40452 existing records. [2025-09-29T21:56:09.404327] [WARN ] [MAIN ] WNC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:56:09.404563] [INFO ] [MAIN ] WNC: Wiping existing primary data before full refresh. [2025-09-29T21:56:09.404614] [INFO ] [LOCAL ] WNC: Starting deletion of primary data. [2025-09-29T21:56:09.405024] [DEBUG] [LOCAL ] WNC: Deleted primary data file. [2025-09-29T21:56:09.405084] [INFO ] [MAIN ] WNC: Starting full primary refresh. [2025-09-29T21:56:09.791488] [INFO ] [REMOTE ] WNC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:56:09.948131] [INFO ] [REMOTE ] WNC: Fetching primary data for 2024-12. [2025-09-29T21:56:10.727196] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-29T21:56:10.748035] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-07. [2025-09-29T21:56:10.832320] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-01 (2.48 seconds). [2025-09-29T21:56:11.110505] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-29T21:56:11.548138] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-02. [2025-09-29T21:56:12.217632] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-29T21:56:12.348111] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-09. [2025-09-29T21:56:12.989425] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-29T21:56:13.001361] [INFO ] [REMOTE ] WM: Full fetch complete (73738 records). [2025-09-29T21:56:13.001564] [DEBUG] [VALIDATOR ] WM: Validating primary data. [2025-09-29T21:56:13.153661] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-08. [2025-09-29T21:56:13.434411] [DEBUG] [VALIDATOR ] WM: All expected trading days are present. [2025-09-29T21:56:13.434506] [DEBUG] [VALIDATOR ] WM: Primary data validation passed. [2025-09-29T21:56:13.435833] [INFO ] [MAIN ] WM: Fetched primary data is valid. [2025-09-29T21:56:13.435909] [DEBUG] [LOCAL ] WM: Saving primary data. [2025-09-29T21:56:13.437419] [DEBUG] [LOCAL ] WM: Trimmed 73738 records to 50916 (keeping 200 days of data) [2025-09-29T21:56:13.783914] [DEBUG] [LOCAL ] WM: Primary data saved (50916 records). [2025-09-29T21:56:13.784071] [INFO ] [MAIN ] WM: Full history saved. [2025-09-29T21:56:13.784187] [INFO ] [MAIN ] Update Progress: 2308/2371 symbols completed. WM took 43.1s. Estimated remaining: 8m 5s. Rate: 7.8 symbols/min [2025-09-29T21:56:13.951157] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-01. [2025-09-29T21:56:13.972497] [INFO ] [MAIN ] WNS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:56:14.021804] [DEBUG] [LOCAL ] WNS: Loaded 40539 existing records from primary storage. [2025-09-29T21:56:14.022118] [INFO ] [MAIN ] WNS: Loaded 40539 existing records. [2025-09-29T21:56:14.165163] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-02 (2.62 seconds). [2025-09-29T21:56:14.254567] [WARN ] [MAIN ] WNS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:56:14.254839] [INFO ] [MAIN ] WNS: Wiping existing primary data before full refresh. [2025-09-29T21:56:14.254901] [INFO ] [LOCAL ] WNS: Starting deletion of primary data. [2025-09-29T21:56:14.255206] [DEBUG] [LOCAL ] WNS: Deleted primary data file. [2025-09-29T21:56:14.255270] [INFO ] [MAIN ] WNS: Starting full primary refresh. [2025-09-29T21:56:14.651209] [INFO ] [REMOTE ] WNS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:56:14.678336] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-29T21:56:14.748103] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-09. [2025-09-29T21:56:15.548091] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-03. [2025-09-29T21:56:15.574904] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-29T21:56:16.356803] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-02. [2025-09-29T21:56:16.373976] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-29T21:56:16.384217] [INFO ] [REMOTE ] WMS: Full fetch complete (57260 records). [2025-09-29T21:56:16.384389] [DEBUG] [VALIDATOR ] WMS: Validating primary data. [2025-09-29T21:56:16.835394] [DEBUG] [VALIDATOR ] WMS: All expected trading days are present. [2025-09-29T21:56:16.835498] [DEBUG] [VALIDATOR ] WMS: Primary data validation passed. [2025-09-29T21:56:16.836715] [INFO ] [MAIN ] WMS: Fetched primary data is valid. [2025-09-29T21:56:16.836782] [DEBUG] [LOCAL ] WMS: Saving primary data. [2025-09-29T21:56:16.838176] [DEBUG] [LOCAL ] WMS: Trimmed 57260 records to 39540 (keeping 200 days of data) [2025-09-29T21:56:17.110917] [DEBUG] [LOCAL ] WMS: Primary data saved (39540 records). [2025-09-29T21:56:17.111069] [INFO ] [MAIN ] WMS: Full history saved. [2025-09-29T21:56:17.111162] [INFO ] [MAIN ] Update Progress: 2309/2371 symbols completed. WMS took 22.7s. Estimated remaining: 7m 57s. Rate: 7.8 symbols/min [2025-09-29T21:56:17.155395] [INFO ] [REMOTE ] WNS: Fetching primary data for 2024-12. [2025-09-29T21:56:17.290520] [INFO ] [MAIN ] WOLF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:56:17.354002] [DEBUG] [LOCAL ] WOLF: Loaded 54312 existing records from primary storage. [2025-09-29T21:56:17.354370] [INFO ] [MAIN ] WOLF: Loaded 54312 existing records. [2025-09-29T21:56:17.546224] [WARN ] [MAIN ] WOLF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:56:17.546695] [INFO ] [MAIN ] WOLF: Wiping existing primary data before full refresh. [2025-09-29T21:56:17.546850] [INFO ] [LOCAL ] WOLF: Starting deletion of primary data. [2025-09-29T21:56:17.547441] [DEBUG] [LOCAL ] WOLF: Deleted primary data file. [2025-09-29T21:56:17.547501] [INFO ] [MAIN ] WOLF: Starting full primary refresh. [2025-09-29T21:56:17.961574] [INFO ] [REMOTE ] WOLF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:56:17.962148] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2024-12. [2025-09-29T21:56:17.994287] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-29T21:56:18.067859] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-09-29T21:56:18.286778] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-29T21:56:18.748133] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-03. [2025-09-29T21:56:19.548113] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-01. [2025-09-29T21:56:20.275724] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-09-29T21:56:20.348132] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-04. [2025-09-29T21:56:20.503438] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-29T21:56:20.699082] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-29T21:56:21.148154] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-01. [2025-09-29T21:56:21.948176] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-04. [2025-09-29T21:56:22.748174] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-02. [2025-09-29T21:56:23.282370] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-04 (2.93 seconds). [2025-09-29T21:56:23.548161] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-05. [2025-09-29T21:56:23.673217] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-29T21:56:23.757500] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-29T21:56:23.961539] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-01 (2.81 seconds). [2025-09-29T21:56:24.348135] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-03. [2025-09-29T21:56:25.148153] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-02. [2025-09-29T21:56:25.636516] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-29T21:56:25.948135] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-04. [2025-09-29T21:56:26.748170] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-05. [2025-09-29T21:56:27.245972] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-29T21:56:27.548199] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-03. [2025-09-29T21:56:27.746833] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-29T21:56:28.039440] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-29T21:56:28.135704] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-05 (4.59 seconds). [2025-09-29T21:56:28.348145] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-06. [2025-09-29T21:56:29.148159] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-05. [2025-09-29T21:56:29.747794] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-29T21:56:29.890964] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-09-29T21:56:29.948106] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-04. [2025-09-29T21:56:30.530100] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-29T21:56:30.748160] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-07. [2025-09-29T21:56:31.548162] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-06. [2025-09-29T21:56:32.091875] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-29T21:56:32.348138] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-06. [2025-09-29T21:56:32.744941] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-04 (2.80 seconds). [2025-09-29T21:56:33.148153] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-08. [2025-09-29T21:56:33.725630] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-29T21:56:33.830970] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-29T21:56:33.948119] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-07. [2025-09-29T21:56:34.608439] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-29T21:56:34.748132] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-07. [2025-09-29T21:56:35.440141] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-29T21:56:35.548134] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-05. [2025-09-29T21:56:36.348173] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-09. [2025-09-29T21:56:37.148227] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-08. [2025-09-29T21:56:37.392998] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-07 (2.64 seconds). [2025-09-29T21:56:37.661236] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-29T21:56:37.668271] [INFO ] [REMOTE ] WNC: Full fetch complete (57482 records). [2025-09-29T21:56:37.668436] [DEBUG] [VALIDATOR ] WNC: Validating primary data. [2025-09-29T21:56:37.950081] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-08. [2025-09-29T21:56:38.131860] [DEBUG] [VALIDATOR ] WNC: All expected trading days are present. [2025-09-29T21:56:38.150993] [DEBUG] [VALIDATOR ] WNC: Primary data validation passed. [2025-09-29T21:56:38.162746] [INFO ] [MAIN ] WNC: Fetched primary data is valid. [2025-09-29T21:56:38.163486] [DEBUG] [LOCAL ] WNC: Saving primary data. [2025-09-29T21:56:38.165429] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-05 (2.62 seconds). [2025-09-29T21:56:38.178244] [DEBUG] [LOCAL ] WNC: Trimmed 57482 records to 39559 (keeping 200 days of data) [2025-09-29T21:56:38.430996] [DEBUG] [LOCAL ] WNC: Primary data saved (39559 records). [2025-09-29T21:56:38.431161] [INFO ] [MAIN ] WNC: Full history saved. [2025-09-29T21:56:38.431249] [INFO ] [MAIN ] Update Progress: 2310/2371 symbols completed. WNC took 29.4s. Estimated remaining: 7m 50s. Rate: 7.8 symbols/min [2025-09-29T21:56:38.617224] [INFO ] [MAIN ] WOR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:56:38.648036] [DEBUG] [LOCAL ] WOR: Loaded 25288 existing records from primary storage. [2025-09-29T21:56:38.648343] [INFO ] [MAIN ] WOR: Loaded 25288 existing records. [2025-09-29T21:56:38.750742] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-06. [2025-09-29T21:56:38.876680] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-29T21:56:38.883366] [WARN ] [MAIN ] WOR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:56:38.892879] [INFO ] [MAIN ] WOR: Wiping existing primary data before full refresh. [2025-09-29T21:56:38.892944] [INFO ] [LOCAL ] WOR: Starting deletion of primary data. [2025-09-29T21:56:38.893747] [DEBUG] [LOCAL ] WOR: Deleted primary data file. [2025-09-29T21:56:38.893812] [INFO ] [MAIN ] WOR: Starting full primary refresh. [2025-09-29T21:56:39.289559] [INFO ] [REMOTE ] WOR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:56:39.548165] [INFO ] [REMOTE ] WOR: Fetching primary data for 2024-12. [2025-09-29T21:56:40.348122] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-09. [2025-09-29T21:56:40.640203] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-29T21:56:40.737444] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-08 (2.79 seconds). [2025-09-29T21:56:41.118088] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-09-29T21:56:41.148069] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-07. [2025-09-29T21:56:41.736455] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-29T21:56:41.745735] [INFO ] [REMOTE ] WNS: Full fetch complete (54928 records). [2025-09-29T21:56:41.745919] [DEBUG] [VALIDATOR ] WNS: Validating primary data. [2025-09-29T21:56:41.951431] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-01. [2025-09-29T21:56:42.199679] [DEBUG] [VALIDATOR ] WNS: All expected trading days are present. [2025-09-29T21:56:42.199799] [DEBUG] [VALIDATOR ] WNS: Primary data validation passed. [2025-09-29T21:56:42.201039] [INFO ] [MAIN ] WNS: Fetched primary data is valid. [2025-09-29T21:56:42.201107] [DEBUG] [LOCAL ] WNS: Saving primary data. [2025-09-29T21:56:42.202343] [DEBUG] [LOCAL ] WNS: Trimmed 54928 records to 40019 (keeping 200 days of data) [2025-09-29T21:56:42.455443] [DEBUG] [LOCAL ] WNS: Primary data saved (40019 records). [2025-09-29T21:56:42.455578] [INFO ] [MAIN ] WNS: Full history saved. [2025-09-29T21:56:42.455695] [INFO ] [MAIN ] Update Progress: 2311/2371 symbols completed. WNS took 28.7s. Estimated remaining: 7m 42s. Rate: 7.8 symbols/min [2025-09-29T21:56:42.636524] [INFO ] [MAIN ] WOW: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:56:42.675009] [DEBUG] [LOCAL ] WOW: Loaded 30769 existing records from primary storage. [2025-09-29T21:56:42.675349] [INFO ] [MAIN ] WOW: Loaded 30769 existing records. [2025-09-29T21:56:42.753970] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-09. [2025-09-29T21:56:42.880810] [WARN ] [MAIN ] WOW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:56:42.881125] [INFO ] [MAIN ] WOW: Wiping existing primary data before full refresh. [2025-09-29T21:56:42.881175] [INFO ] [LOCAL ] WOW: Starting deletion of primary data. [2025-09-29T21:56:42.881520] [DEBUG] [LOCAL ] WOW: Deleted primary data file. [2025-09-29T21:56:42.881579] [INFO ] [MAIN ] WOW: Starting full primary refresh. [2025-09-29T21:56:43.284575] [INFO ] [REMOTE ] WOW: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:56:43.286456] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-29T21:56:43.409916] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-29T21:56:43.423909] [INFO ] [REMOTE ] WMT: Full fetch complete (77968 records). [2025-09-29T21:56:43.424084] [DEBUG] [VALIDATOR ] WMT: Validating primary data. [2025-09-29T21:56:43.552365] [INFO ] [REMOTE ] WOW: Fetching primary data for 2024-12. [2025-09-29T21:56:43.864268] [DEBUG] [VALIDATOR ] WMT: All expected trading days are present. [2025-09-29T21:56:43.864431] [DEBUG] [VALIDATOR ] WMT: Primary data validation passed. [2025-09-29T21:56:43.865870] [INFO ] [MAIN ] WMT: Fetched primary data is valid. [2025-09-29T21:56:43.865958] [DEBUG] [LOCAL ] WMT: Saving primary data. [2025-09-29T21:56:43.867662] [DEBUG] [LOCAL ] WMT: Trimmed 77968 records to 53800 (keeping 200 days of data) [2025-09-29T21:56:43.994597] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-07 (2.85 seconds). [2025-09-29T21:56:44.273430] [DEBUG] [LOCAL ] WMT: Primary data saved (53800 records). [2025-09-29T21:56:44.273581] [INFO ] [MAIN ] WMT: Full history saved. [2025-09-29T21:56:44.273692] [INFO ] [MAIN ] Update Progress: 2312/2371 symbols completed. WMT took 42.2s. Estimated remaining: 7m 34s. Rate: 7.8 symbols/min [2025-09-29T21:56:44.353934] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-02. [2025-09-29T21:56:44.460192] [INFO ] [MAIN ] WPC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:56:44.527167] [DEBUG] [LOCAL ] WPC: Loaded 49217 existing records from primary storage. [2025-09-29T21:56:44.527557] [INFO ] [MAIN ] WPC: Loaded 49217 existing records. [2025-09-29T21:56:44.733607] [WARN ] [MAIN ] WPC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:56:44.733897] [INFO ] [MAIN ] WPC: Wiping existing primary data before full refresh. [2025-09-29T21:56:44.733954] [INFO ] [LOCAL ] WPC: Starting deletion of primary data. [2025-09-29T21:56:44.734587] [DEBUG] [LOCAL ] WPC: Deleted primary data file. [2025-09-29T21:56:44.734718] [INFO ] [MAIN ] WPC: Starting full primary refresh. [2025-09-29T21:56:45.067122] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-29T21:56:45.159617] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-08. [2025-09-29T21:56:45.166485] [INFO ] [REMOTE ] WPC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:56:45.314422] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-29T21:56:45.948145] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-01. [2025-09-29T21:56:46.748089] [INFO ] [REMOTE ] WPC: Fetching primary data for 2024-12. [2025-09-29T21:56:46.798001] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-29T21:56:47.412874] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-29T21:56:47.548116] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-09. [2025-09-29T21:56:48.258208] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-29T21:56:48.348134] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-03. [2025-09-29T21:56:49.148119] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-01. [2025-09-29T21:56:49.827127] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-29T21:56:49.828564] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-29T21:56:49.847282] [INFO ] [REMOTE ] WOLF: Full fetch complete (77252 records). [2025-09-29T21:56:49.847949] [DEBUG] [VALIDATOR ] WOLF: Validating primary data. [2025-09-29T21:56:49.955424] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-04. [2025-09-29T21:56:50.263839] [DEBUG] [VALIDATOR ] WOLF: All expected trading days are present. [2025-09-29T21:56:50.264037] [DEBUG] [VALIDATOR ] WOLF: Primary data validation passed. [2025-09-29T21:56:50.265424] [INFO ] [MAIN ] WOLF: Fetched primary data is valid. [2025-09-29T21:56:50.265493] [DEBUG] [LOCAL ] WOLF: Saving primary data. [2025-09-29T21:56:50.267083] [DEBUG] [LOCAL ] WOLF: Trimmed 77252 records to 53184 (keeping 200 days of data) [2025-09-29T21:56:50.607857] [DEBUG] [LOCAL ] WOLF: Primary data saved (53184 records). [2025-09-29T21:56:50.608492] [INFO ] [MAIN ] WOLF: Full history saved. [2025-09-29T21:56:50.608754] [INFO ] [MAIN ] Update Progress: 2313/2371 symbols completed. WOLF took 33.5s. Estimated remaining: 7m 27s. Rate: 7.8 symbols/min [2025-09-29T21:56:50.756752] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-02. [2025-09-29T21:56:50.794528] [INFO ] [MAIN ] WPM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:56:50.828813] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-29T21:56:50.892609] [DEBUG] [LOCAL ] WPM: Loaded 53504 existing records from primary storage. [2025-09-29T21:56:50.892987] [INFO ] [MAIN ] WPM: Loaded 53504 existing records. [2025-09-29T21:56:51.092969] [WARN ] [MAIN ] WPM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:56:51.093203] [INFO ] [MAIN ] WPM: Wiping existing primary data before full refresh. [2025-09-29T21:56:51.093272] [INFO ] [LOCAL ] WPM: Starting deletion of primary data. [2025-09-29T21:56:51.093722] [DEBUG] [LOCAL ] WPM: Deleted primary data file. [2025-09-29T21:56:51.093805] [INFO ] [MAIN ] WPM: Starting full primary refresh. [2025-09-29T21:56:51.498152] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-29T21:56:51.544605] [INFO ] [REMOTE ] WPM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:56:51.548062] [INFO ] [REMOTE ] WPM: Fetching primary data for 2024-12. [2025-09-29T21:56:51.981481] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-29T21:56:52.348172] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-03. [2025-09-29T21:56:53.127926] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-29T21:56:53.148110] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-02. [2025-09-29T21:56:53.615285] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-29T21:56:53.948124] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-04. [2025-09-29T21:56:54.487778] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-29T21:56:54.748111] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-03. [2025-09-29T21:56:54.938582] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-29T21:56:55.548102] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-05. [2025-09-29T21:56:56.271734] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-29T21:56:56.348119] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-05. [2025-09-29T21:56:56.635001] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-29T21:56:57.148105] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-01. [2025-09-29T21:56:57.488565] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-29T21:56:57.948120] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-06. [2025-09-29T21:56:58.616566] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-29T21:56:58.748132] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-04. [2025-09-29T21:56:59.105574] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-29T21:56:59.548117] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-07. [2025-09-29T21:57:00.348094] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-02. [2025-09-29T21:57:00.501608] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-29T21:57:00.570448] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-29T21:57:01.148127] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-05. [2025-09-29T21:57:01.948119] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-06. [2025-09-29T21:57:02.149859] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-29T21:57:02.550425] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-29T21:57:02.748128] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-08. [2025-09-29T21:57:03.116375] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-29T21:57:03.548117] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-07. [2025-09-29T21:57:04.292355] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-29T21:57:04.348085] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-09. [2025-09-29T21:57:04.622920] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-29T21:57:05.148141] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-06. [2025-09-29T21:57:05.776305] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-29T21:57:05.784452] [INFO ] [REMOTE ] WOW: Full fetch complete (42027 records). [2025-09-29T21:57:05.784561] [DEBUG] [VALIDATOR ] WOW: Validating primary data. [2025-09-29T21:57:05.974102] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-08. [2025-09-29T21:57:06.191505] [DEBUG] [VALIDATOR ] WOW: All expected trading days are present. [2025-09-29T21:57:06.191613] [DEBUG] [VALIDATOR ] WOW: Primary data validation passed. [2025-09-29T21:57:06.192521] [INFO ] [MAIN ] WOW: Fetched primary data is valid. [2025-09-29T21:57:06.192594] [DEBUG] [LOCAL ] WOW: Saving primary data. [2025-09-29T21:57:06.193563] [DEBUG] [LOCAL ] WOW: Trimmed 42027 records to 30401 (keeping 200 days of data) [2025-09-29T21:57:06.377504] [DEBUG] [LOCAL ] WOW: Primary data saved (30401 records). [2025-09-29T21:57:06.377793] [INFO ] [MAIN ] WOW: Full history saved. [2025-09-29T21:57:06.377950] [INFO ] [MAIN ] Update Progress: 2314/2371 symbols completed. WOW took 23.9s. Estimated remaining: 7m 19s. Rate: 7.8 symbols/min [2025-09-29T21:57:06.556330] [INFO ] [MAIN ] WPP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:57:06.593500] [DEBUG] [LOCAL ] WPP: Loaded 34282 existing records from primary storage. [2025-09-29T21:57:06.593824] [INFO ] [MAIN ] WPP: Loaded 34282 existing records. [2025-09-29T21:57:06.752055] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-03. [2025-09-29T21:57:06.784943] [WARN ] [MAIN ] WPP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:57:06.786623] [INFO ] [MAIN ] WPP: Wiping existing primary data before full refresh. [2025-09-29T21:57:06.786728] [INFO ] [LOCAL ] WPP: Starting deletion of primary data. [2025-09-29T21:57:06.787418] [DEBUG] [LOCAL ] WPP: Deleted primary data file. [2025-09-29T21:57:06.787589] [INFO ] [MAIN ] WPP: Starting full primary refresh. [2025-09-29T21:57:07.040011] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-29T21:57:07.206587] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-29T21:57:07.249740] [INFO ] [REMOTE ] WPP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:57:07.548123] [INFO ] [REMOTE ] WPP: Fetching primary data for 2024-12. [2025-09-29T21:57:08.348112] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-09. [2025-09-29T21:57:08.557697] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-29T21:57:08.886033] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-29T21:57:09.148117] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-01. [2025-09-29T21:57:09.637135] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-29T21:57:09.642819] [INFO ] [REMOTE ] WOR: Full fetch complete (36444 records). [2025-09-29T21:57:09.642930] [DEBUG] [VALIDATOR ] WOR: Validating primary data. [2025-09-29T21:57:09.948084] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-07. [2025-09-29T21:57:10.041885] [DEBUG] [VALIDATOR ] WOR: All expected trading days are present. [2025-09-29T21:57:10.041980] [DEBUG] [VALIDATOR ] WOR: Primary data validation passed. [2025-09-29T21:57:10.042940] [INFO ] [MAIN ] WOR: Fetched primary data is valid. [2025-09-29T21:57:10.043338] [DEBUG] [LOCAL ] WOR: Saving primary data. [2025-09-29T21:57:10.044595] [DEBUG] [LOCAL ] WOR: Trimmed 36444 records to 24903 (keeping 200 days of data) [2025-09-29T21:57:10.208235] [DEBUG] [LOCAL ] WOR: Primary data saved (24903 records). [2025-09-29T21:57:10.208372] [INFO ] [MAIN ] WOR: Full history saved. [2025-09-29T21:57:10.208473] [INFO ] [MAIN ] Update Progress: 2315/2371 symbols completed. WOR took 31.8s. Estimated remaining: 7m 11s. Rate: 7.8 symbols/min [2025-09-29T21:57:10.393235] [INFO ] [MAIN ] WRB: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:57:10.413216] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-29T21:57:10.474175] [DEBUG] [LOCAL ] WRB: Loaded 51313 existing records from primary storage. [2025-09-29T21:57:10.474547] [INFO ] [MAIN ] WRB: Loaded 51313 existing records. [2025-09-29T21:57:10.658779] [WARN ] [MAIN ] WRB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:57:10.659054] [INFO ] [MAIN ] WRB: Wiping existing primary data before full refresh. [2025-09-29T21:57:10.659108] [INFO ] [LOCAL ] WRB: Starting deletion of primary data. [2025-09-29T21:57:10.659694] [DEBUG] [LOCAL ] WRB: Deleted primary data file. [2025-09-29T21:57:10.659754] [INFO ] [MAIN ] WRB: Starting full primary refresh. [2025-09-29T21:57:10.755502] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-04. [2025-09-29T21:57:11.031118] [INFO ] [REMOTE ] WRB: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:57:11.419689] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-29T21:57:11.548113] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-08. [2025-09-29T21:57:12.348091] [INFO ] [REMOTE ] WRB: Fetching primary data for 2024-12. [2025-09-29T21:57:12.619703] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-29T21:57:13.143934] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-29T21:57:13.153721] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-05. [2025-09-29T21:57:13.948092] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-02. [2025-09-29T21:57:13.996683] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-29T21:57:14.748082] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-01. [2025-09-29T21:57:15.037904] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-29T21:57:15.074749] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-29T21:57:15.548126] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-03. [2025-09-29T21:57:16.348086] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-06. [2025-09-29T21:57:16.518014] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-29T21:57:16.802108] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-29T21:57:17.148122] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-09. [2025-09-29T21:57:17.868260] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-29T21:57:17.948109] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-02. [2025-09-29T21:57:18.748153] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-07. [2025-09-29T21:57:18.928960] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-29T21:57:18.939331] [INFO ] [REMOTE ] WPC: Full fetch complete (70787 records). [2025-09-29T21:57:18.939503] [DEBUG] [VALIDATOR ] WPC: Validating primary data. [2025-09-29T21:57:19.367379] [DEBUG] [VALIDATOR ] WPC: All expected trading days are present. [2025-09-29T21:57:19.367553] [DEBUG] [VALIDATOR ] WPC: Primary data validation passed. [2025-09-29T21:57:19.369028] [INFO ] [MAIN ] WPC: Fetched primary data is valid. [2025-09-29T21:57:19.369157] [DEBUG] [LOCAL ] WPC: Saving primary data. [2025-09-29T21:57:19.370665] [DEBUG] [LOCAL ] WPC: Trimmed 70787 records to 48399 (keeping 200 days of data) [2025-09-29T21:57:19.561353] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-04. [2025-09-29T21:57:19.644187] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-29T21:57:19.749324] [DEBUG] [LOCAL ] WPC: Primary data saved (48399 records). [2025-09-29T21:57:19.749500] [INFO ] [MAIN ] WPC: Full history saved. [2025-09-29T21:57:19.749673] [INFO ] [MAIN ] Update Progress: 2316/2371 symbols completed. WPC took 35.5s. Estimated remaining: 7m 4s. Rate: 7.8 symbols/min [2025-09-29T21:57:19.932008] [INFO ] [MAIN ] WRBY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:57:19.985054] [DEBUG] [LOCAL ] WRBY: Loaded 51609 existing records from primary storage. [2025-09-29T21:57:19.985363] [INFO ] [MAIN ] WRBY: Loaded 51609 existing records. [2025-09-29T21:57:20.170745] [WARN ] [MAIN ] WRBY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:57:20.171005] [INFO ] [MAIN ] WRBY: Wiping existing primary data before full refresh. [2025-09-29T21:57:20.171066] [INFO ] [LOCAL ] WRBY: Starting deletion of primary data. [2025-09-29T21:57:20.171574] [DEBUG] [LOCAL ] WRBY: Deleted primary data file. [2025-09-29T21:57:20.171637] [INFO ] [MAIN ] WRBY: Starting full primary refresh. [2025-09-29T21:57:20.353177] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-03. [2025-09-29T21:57:20.556288] [INFO ] [REMOTE ] WRBY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:57:20.801094] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-29T21:57:21.058858] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-29T21:57:21.148149] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-05. [2025-09-29T21:57:21.894591] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-29T21:57:21.948121] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-04. [2025-09-29T21:57:22.120406] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-29T21:57:22.748123] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-06. [2025-09-29T21:57:23.548183] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2024-12. [2025-09-29T21:57:23.881444] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-29T21:57:23.916566] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-29T21:57:24.348133] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-08. [2025-09-29T21:57:24.896596] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-29T21:57:25.148126] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-05. [2025-09-29T21:57:25.948132] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-07. [2025-09-29T21:57:26.096550] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-29T21:57:26.748158] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-01. [2025-09-29T21:57:26.830809] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-29T21:57:27.548089] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-06. [2025-09-29T21:57:27.642277] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-29T21:57:28.348100] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-08. [2025-09-29T21:57:28.613899] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-29T21:57:29.114706] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-29T21:57:29.148174] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-02. [2025-09-29T21:57:29.847969] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-29T21:57:29.948171] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-09. [2025-09-29T21:57:30.699722] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-29T21:57:30.748084] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-03. [2025-09-29T21:57:31.548118] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-07. [2025-09-29T21:57:31.720353] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-29T21:57:31.732785] [INFO ] [REMOTE ] WPM: Full fetch complete (75865 records). [2025-09-29T21:57:31.732955] [DEBUG] [VALIDATOR ] WPM: Validating primary data. [2025-09-29T21:57:32.166488] [DEBUG] [VALIDATOR ] WPM: All expected trading days are present. [2025-09-29T21:57:32.166588] [DEBUG] [VALIDATOR ] WPM: Primary data validation passed. [2025-09-29T21:57:32.168018] [INFO ] [MAIN ] WPM: Fetched primary data is valid. [2025-09-29T21:57:32.168093] [DEBUG] [LOCAL ] WPM: Saving primary data. [2025-09-29T21:57:32.170488] [DEBUG] [LOCAL ] WPM: Trimmed 75865 records to 52729 (keeping 200 days of data) [2025-09-29T21:57:32.367403] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-09. [2025-09-29T21:57:32.540538] [DEBUG] [LOCAL ] WPM: Primary data saved (52729 records). [2025-09-29T21:57:32.540908] [INFO ] [MAIN ] WPM: Full history saved. [2025-09-29T21:57:32.541136] [INFO ] [MAIN ] Update Progress: 2317/2371 symbols completed. WPM took 41.9s. Estimated remaining: 6m 56s. Rate: 7.8 symbols/min [2025-09-29T21:57:32.593882] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-29T21:57:33.148078] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-04. [2025-09-29T21:57:33.282194] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-29T21:57:33.477591] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-29T21:57:33.485443] [INFO ] [REMOTE ] WPP: Full fetch complete (45365 records). [2025-09-29T21:57:33.485553] [DEBUG] [VALIDATOR ] WPP: Validating primary data. [2025-09-29T21:57:33.897425] [DEBUG] [VALIDATOR ] WPP: All expected trading days are present. [2025-09-29T21:57:33.897541] [DEBUG] [VALIDATOR ] WPP: Primary data validation passed. [2025-09-29T21:57:33.898512] [INFO ] [MAIN ] WPP: Fetched primary data is valid. [2025-09-29T21:57:33.898579] [DEBUG] [LOCAL ] WPP: Saving primary data. [2025-09-29T21:57:33.899756] [DEBUG] [LOCAL ] WPP: Trimmed 45365 records to 33859 (keeping 200 days of data) [2025-09-29T21:57:33.951872] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-08. [2025-09-29T21:57:34.110476] [DEBUG] [LOCAL ] WPP: Primary data saved (33859 records). [2025-09-29T21:57:34.110623] [INFO ] [MAIN ] WPP: Full history saved. [2025-09-29T21:57:34.110756] [INFO ] [MAIN ] Update Progress: 2318/2371 symbols completed. WPP took 27.7s. Estimated remaining: 6m 48s. Rate: 7.8 symbols/min [2025-09-29T21:57:34.681261] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-29T21:57:34.748159] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-05. [2025-09-29T21:57:35.710344] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-29T21:57:35.721622] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-09. [2025-09-29T21:57:36.187630] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-29T21:57:36.198149] [INFO ] [REMOTE ] WRB: Full fetch complete (73323 records). [2025-09-29T21:57:36.198287] [DEBUG] [VALIDATOR ] WRB: Validating primary data. [2025-09-29T21:57:36.637600] [DEBUG] [VALIDATOR ] WRB: All expected trading days are present. [2025-09-29T21:57:36.637779] [DEBUG] [VALIDATOR ] WRB: Primary data validation passed. [2025-09-29T21:57:36.639231] [INFO ] [MAIN ] WRB: Fetched primary data is valid. [2025-09-29T21:57:36.639321] [DEBUG] [LOCAL ] WRB: Saving primary data. [2025-09-29T21:57:36.671004] [DEBUG] [LOCAL ] WRB: Trimmed 73323 records to 50549 (keeping 200 days of data) [2025-09-29T21:57:36.674691] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-29T21:57:36.776474] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-06. [2025-09-29T21:57:37.028263] [DEBUG] [LOCAL ] WRB: Primary data saved (50549 records). [2025-09-29T21:57:37.028550] [INFO ] [MAIN ] WRB: Full history saved. [2025-09-29T21:57:37.028696] [INFO ] [MAIN ] Update Progress: 2319/2371 symbols completed. WRB took 26.8s. Estimated remaining: 6m 40s. Rate: 7.8 symbols/min [2025-09-29T21:57:38.433395] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-29T21:57:38.444489] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-07. [2025-09-29T21:57:40.226001] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-29T21:57:40.237608] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-08. [2025-09-29T21:57:41.889230] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-29T21:57:41.900961] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-09. [2025-09-29T21:57:43.270209] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-29T21:57:43.280479] [INFO ] [REMOTE ] WRBY: Full fetch complete (73399 records). [2025-09-29T21:57:43.280624] [DEBUG] [VALIDATOR ] WRBY: Validating primary data. [2025-09-29T21:57:43.706399] [DEBUG] [VALIDATOR ] WRBY: All expected trading days are present. [2025-09-29T21:57:43.706533] [DEBUG] [VALIDATOR ] WRBY: Primary data validation passed. [2025-09-29T21:57:43.708600] [INFO ] [MAIN ] WRBY: Fetched primary data is valid. [2025-09-29T21:57:43.708690] [DEBUG] [LOCAL ] WRBY: Saving primary data. [2025-09-29T21:57:43.711242] [DEBUG] [LOCAL ] WRBY: Trimmed 73399 records to 50810 (keeping 200 days of data) [2025-09-29T21:57:44.036283] [DEBUG] [LOCAL ] WRBY: Primary data saved (50810 records). [2025-09-29T21:57:44.036447] [INFO ] [MAIN ] WRBY: Full history saved. [2025-09-29T21:57:44.036560] [INFO ] [MAIN ] Update Progress: 2320/2371 symbols completed. WRBY took 24.3s. Estimated remaining: 6m 33s. Rate: 7.8 symbols/min [2025-09-29T21:57:44.768920] [INFO ] [MAIN ] WSO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:57:44.772027] [INFO ] [MAIN ] WSR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:57:44.801348] [INFO ] [MAIN ] WS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:57:44.821102] [INFO ] [MAIN ] WSM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:57:44.856217] [DEBUG] [LOCAL ] WSR: Loaded 23550 existing records from primary storage. [2025-09-29T21:57:44.856752] [INFO ] [MAIN ] WSR: Loaded 23550 existing records. [2025-09-29T21:57:44.966786] [DEBUG] [LOCAL ] WSO: Loaded 25059 existing records from primary storage. [2025-09-29T21:57:45.022283] [DEBUG] [LOCAL ] WS: Loaded 24434 existing records from primary storage. [2025-09-29T21:57:45.033414] [INFO ] [MAIN ] WSO: Loaded 25059 existing records. [2025-09-29T21:57:45.049445] [INFO ] [MAIN ] WS: Loaded 24434 existing records. [2025-09-29T21:57:45.152615] [WARN ] [MAIN ] WSR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:57:45.231717] [INFO ] [MAIN ] WSR: Wiping existing primary data before full refresh. [2025-09-29T21:57:45.231492] [DEBUG] [LOCAL ] WSM: Loaded 50533 existing records from primary storage. [2025-09-29T21:57:45.257224] [INFO ] [LOCAL ] WSR: Starting deletion of primary data. [2025-09-29T21:57:45.290189] [INFO ] [MAIN ] WSM: Loaded 50533 existing records. [2025-09-29T21:57:45.290248] [DEBUG] [LOCAL ] WSR: Deleted primary data file. [2025-09-29T21:57:45.321327] [INFO ] [MAIN ] WSR: Starting full primary refresh. [2025-09-29T21:57:45.480058] [WARN ] [MAIN ] WSO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:57:45.629811] [INFO ] [MAIN ] WSO: Wiping existing primary data before full refresh. [2025-09-29T21:57:45.661554] [INFO ] [LOCAL ] WSO: Starting deletion of primary data. [2025-09-29T21:57:45.821746] [DEBUG] [LOCAL ] WSO: Deleted primary data file. [2025-09-29T21:57:45.814766] [WARN ] [MAIN ] WSM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:57:45.856231] [INFO ] [MAIN ] WSO: Starting full primary refresh. [2025-09-29T21:57:45.861686] [INFO ] [MAIN ] WSM: Wiping existing primary data before full refresh. [2025-09-29T21:57:45.868935] [INFO ] [LOCAL ] WSM: Starting deletion of primary data. [2025-09-29T21:57:45.855776] [WARN ] [MAIN ] WS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:57:45.910885] [DEBUG] [LOCAL ] WSM: Deleted primary data file. [2025-09-29T21:57:45.962624] [INFO ] [MAIN ] WS: Wiping existing primary data before full refresh. [2025-09-29T21:57:46.011856] [INFO ] [LOCAL ] WS: Starting deletion of primary data. [2025-09-29T21:57:46.010781] [INFO ] [MAIN ] WSM: Starting full primary refresh. [2025-09-29T21:57:46.093446] [DEBUG] [LOCAL ] WS: Deleted primary data file. [2025-09-29T21:57:46.149244] [INFO ] [MAIN ] WS: Starting full primary refresh. [2025-09-29T21:57:46.782269] [INFO ] [REMOTE ] WSR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:57:46.852583] [INFO ] [REMOTE ] WSR: Fetching primary data for 2024-12. [2025-09-29T21:57:47.040918] [INFO ] [REMOTE ] WSO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:57:47.077701] [INFO ] [REMOTE ] WSO: Fetching primary data for 2024-12. [2025-09-29T21:57:47.256803] [INFO ] [REMOTE ] WSM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:57:47.288779] [INFO ] [REMOTE ] WSM: Fetching primary data for 2024-12. [2025-09-29T21:57:47.330831] [INFO ] [REMOTE ] WS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:57:47.331151] [INFO ] [REMOTE ] WS: Fetching primary data for 2024-12. [2025-09-29T21:57:48.170019] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-29T21:57:48.178086] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-01. [2025-09-29T21:57:48.234913] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-29T21:57:48.239207] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-01. [2025-09-29T21:57:48.603871] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-29T21:57:48.613955] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-01. [2025-09-29T21:57:48.843935] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-29T21:57:48.848740] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-02. [2025-09-29T21:57:49.017511] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-29T21:57:49.028558] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-01. [2025-09-29T21:57:49.049287] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-29T21:57:49.053898] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-02. [2025-09-29T21:57:49.584219] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-29T21:57:49.589041] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-03. [2025-09-29T21:57:49.883523] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-29T21:57:49.889407] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-02. [2025-09-29T21:57:50.224954] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-29T21:57:50.230430] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-03. [2025-09-29T21:57:50.530386] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-29T21:57:50.536246] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-04. [2025-09-29T21:57:50.846722] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-29T21:57:50.857591] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-02. [2025-09-29T21:57:51.042669] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-29T21:57:51.157061] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-29T21:57:51.548120] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-04. [2025-09-29T21:57:51.723013] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-29T21:57:52.256341] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-29T21:57:52.348137] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-03. [2025-09-29T21:57:52.955077] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-29T21:57:53.148117] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-05. [2025-09-29T21:57:53.948075] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-03. [2025-09-29T21:57:54.029589] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-29T21:57:54.372682] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-29T21:57:54.748123] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-05. [2025-09-29T21:57:54.940856] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-29T21:57:55.548129] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-04. [2025-09-29T21:57:55.831265] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-29T21:57:56.348106] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-06. [2025-09-29T21:57:56.386852] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-29T21:57:57.148154] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-04. [2025-09-29T21:57:57.443526] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-29T21:57:57.948102] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-07. [2025-09-29T21:57:58.748083] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-06. [2025-09-29T21:57:58.900431] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-29T21:57:59.213300] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-29T21:57:59.548087] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-08. [2025-09-29T21:57:59.927722] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-29T21:58:00.348127] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-07. [2025-09-29T21:58:00.533533] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-29T21:58:01.148140] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-05. [2025-09-29T21:58:01.330635] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-29T21:58:01.948122] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-09. [2025-09-29T21:58:02.748184] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-08. [2025-09-29T21:58:02.764170] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-29T21:58:02.984672] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-29T21:58:02.989509] [INFO ] [REMOTE ] WSR: Full fetch complete (32811 records). [2025-09-29T21:58:02.989634] [DEBUG] [VALIDATOR ] WSR: Validating primary data. [2025-09-29T21:58:03.386965] [DEBUG] [VALIDATOR ] WSR: All expected trading days are present. [2025-09-29T21:58:03.387057] [DEBUG] [VALIDATOR ] WSR: Primary data validation passed. [2025-09-29T21:58:03.387743] [INFO ] [MAIN ] WSR: Fetched primary data is valid. [2025-09-29T21:58:03.387817] [DEBUG] [LOCAL ] WSR: Saving primary data. [2025-09-29T21:58:03.388674] [DEBUG] [LOCAL ] WSR: Trimmed 32811 records to 23065 (keeping 200 days of data) [2025-09-29T21:58:03.537841] [DEBUG] [LOCAL ] WSR: Primary data saved (23065 records). [2025-09-29T21:58:03.537982] [INFO ] [MAIN ] WSR: Full history saved. [2025-09-29T21:58:03.538121] [INFO ] [MAIN ] Update Progress: 2321/2371 symbols completed. WSR took 19.5s. Estimated remaining: 6m 25s. Rate: 7.8 symbols/min [2025-09-29T21:58:03.553241] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-06. [2025-09-29T21:58:03.728594] [INFO ] [MAIN ] WST: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:58:03.771784] [DEBUG] [LOCAL ] WST: Loaded 38092 existing records from primary storage. [2025-09-29T21:58:03.772081] [INFO ] [MAIN ] WST: Loaded 38092 existing records. [2025-09-29T21:58:03.969429] [WARN ] [MAIN ] WST: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:58:03.969802] [INFO ] [MAIN ] WST: Wiping existing primary data before full refresh. [2025-09-29T21:58:03.969956] [INFO ] [LOCAL ] WST: Starting deletion of primary data. [2025-09-29T21:58:03.970337] [DEBUG] [LOCAL ] WST: Deleted primary data file. [2025-09-29T21:58:03.970456] [INFO ] [MAIN ] WST: Starting full primary refresh. [2025-09-29T21:58:04.249686] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-29T21:58:04.357793] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-05. [2025-09-29T21:58:04.382690] [INFO ] [REMOTE ] WST: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:58:05.148078] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-09. [2025-09-29T21:58:05.248180] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-29T21:58:05.777692] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-09-29T21:58:05.948144] [INFO ] [REMOTE ] WST: Fetching primary data for 2024-12. [2025-09-29T21:58:06.175560] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-29T21:58:06.182065] [INFO ] [REMOTE ] WSO: Full fetch complete (34255 records). [2025-09-29T21:58:06.182183] [DEBUG] [VALIDATOR ] WSO: Validating primary data. [2025-09-29T21:58:06.570422] [DEBUG] [VALIDATOR ] WSO: All expected trading days are present. [2025-09-29T21:58:06.570551] [DEBUG] [VALIDATOR ] WSO: Primary data validation passed. [2025-09-29T21:58:06.571389] [INFO ] [MAIN ] WSO: Fetched primary data is valid. [2025-09-29T21:58:06.571491] [DEBUG] [LOCAL ] WSO: Saving primary data. [2025-09-29T21:58:06.572428] [DEBUG] [LOCAL ] WSO: Trimmed 34255 records to 24534 (keeping 200 days of data) [2025-09-29T21:58:06.748718] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-06. [2025-09-29T21:58:06.752460] [DEBUG] [LOCAL ] WSO: Primary data saved (24534 records). [2025-09-29T21:58:06.752708] [INFO ] [MAIN ] WSO: Full history saved. [2025-09-29T21:58:06.752870] [INFO ] [MAIN ] Update Progress: 2322/2371 symbols completed. WSO took 22.7s. Estimated remaining: 6m 17s. Rate: 7.8 symbols/min [2025-09-29T21:58:06.934664] [INFO ] [MAIN ] WT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:58:06.981574] [DEBUG] [LOCAL ] WT: Loaded 48354 existing records from primary storage. [2025-09-29T21:58:06.981940] [INFO ] [MAIN ] WT: Loaded 48354 existing records. [2025-09-29T21:58:07.181861] [WARN ] [MAIN ] WT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:58:07.182244] [INFO ] [MAIN ] WT: Wiping existing primary data before full refresh. [2025-09-29T21:58:07.182307] [INFO ] [LOCAL ] WT: Starting deletion of primary data. [2025-09-29T21:58:07.182677] [DEBUG] [LOCAL ] WT: Deleted primary data file. [2025-09-29T21:58:07.182737] [INFO ] [MAIN ] WT: Starting full primary refresh. [2025-09-29T21:58:07.557076] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-07. [2025-09-29T21:58:07.562594] [INFO ] [REMOTE ] WT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:58:07.582559] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-29T21:58:08.114409] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-29T21:58:08.348114] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-07. [2025-09-29T21:58:09.149533] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-29T21:58:09.148195] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-01. [2025-09-29T21:58:09.572258] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-29T21:58:09.948124] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-08. [2025-09-29T21:58:10.315163] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-29T21:58:10.748120] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-02. [2025-09-29T21:58:11.548131] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-08. [2025-09-29T21:58:11.804105] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-29T21:58:12.348104] [INFO ] [REMOTE ] WT: Fetching primary data for 2024-12. [2025-09-29T21:58:12.377546] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-29T21:58:12.762549] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-29T21:58:13.148124] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-03. [2025-09-29T21:58:13.928029] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-29T21:58:13.948073] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-01. [2025-09-29T21:58:14.677313] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-29T21:58:14.748114] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-09. [2025-09-29T21:58:15.488049] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-29T21:58:15.497967] [INFO ] [REMOTE ] WSM: Full fetch complete (72088 records). [2025-09-29T21:58:15.498102] [DEBUG] [VALIDATOR ] WSM: Validating primary data. [2025-09-29T21:58:15.559181] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-09. [2025-09-29T21:58:15.887046] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-29T21:58:16.028830] [DEBUG] [VALIDATOR ] WSM: All expected trading days are present. [2025-09-29T21:58:16.028916] [DEBUG] [VALIDATOR ] WSM: Primary data validation passed. [2025-09-29T21:58:16.030091] [INFO ] [MAIN ] WSM: Fetched primary data is valid. [2025-09-29T21:58:16.030157] [DEBUG] [LOCAL ] WSM: Saving primary data. [2025-09-29T21:58:16.031500] [DEBUG] [LOCAL ] WSM: Trimmed 72088 records to 49743 (keeping 200 days of data) [2025-09-29T21:58:16.348242] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-02. [2025-09-29T21:58:16.366857] [DEBUG] [LOCAL ] WSM: Primary data saved (49743 records). [2025-09-29T21:58:16.367116] [INFO ] [MAIN ] WSM: Full history saved. [2025-09-29T21:58:16.367214] [INFO ] [MAIN ] Update Progress: 2323/2371 symbols completed. WSM took 32.3s. Estimated remaining: 6m 10s. Rate: 7.8 symbols/min [2025-09-29T21:58:16.550274] [INFO ] [MAIN ] WTI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:58:16.598734] [DEBUG] [LOCAL ] WTI: Loaded 44472 existing records from primary storage. [2025-09-29T21:58:16.599060] [INFO ] [MAIN ] WTI: Loaded 44472 existing records. [2025-09-29T21:58:16.798790] [WARN ] [MAIN ] WTI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:58:16.799265] [INFO ] [MAIN ] WTI: Wiping existing primary data before full refresh. [2025-09-29T21:58:16.799431] [INFO ] [LOCAL ] WTI: Starting deletion of primary data. [2025-09-29T21:58:16.805090] [DEBUG] [LOCAL ] WTI: Deleted primary data file. [2025-09-29T21:58:16.814237] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-29T21:58:16.813794] [INFO ] [MAIN ] WTI: Starting full primary refresh. [2025-09-29T21:58:16.856165] [INFO ] [REMOTE ] WS: Full fetch complete (36599 records). [2025-09-29T21:58:16.884625] [DEBUG] [VALIDATOR ] WS: Validating primary data. [2025-09-29T21:58:17.160560] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-04. [2025-09-29T21:58:17.707032] [DEBUG] [VALIDATOR ] WS: All expected trading days are present. [2025-09-29T21:58:17.714505] [INFO ] [REMOTE ] WTI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:58:17.714873] [DEBUG] [VALIDATOR ] WS: Primary data validation passed. [2025-09-29T21:58:17.716025] [INFO ] [MAIN ] WS: Fetched primary data is valid. [2025-09-29T21:58:17.716402] [DEBUG] [LOCAL ] WS: Saving primary data. [2025-09-29T21:58:17.717571] [DEBUG] [LOCAL ] WS: Trimmed 36599 records to 24030 (keeping 200 days of data) [2025-09-29T21:58:17.879854] [DEBUG] [LOCAL ] WS: Primary data saved (24030 records). [2025-09-29T21:58:17.879993] [INFO ] [MAIN ] WS: Full history saved. [2025-09-29T21:58:17.880081] [INFO ] [MAIN ] Update Progress: 2324/2371 symbols completed. WS took 33.8s. Estimated remaining: 6m 2s. Rate: 7.8 symbols/min [2025-09-29T21:58:17.948835] [INFO ] [REMOTE ] WTI: Fetching primary data for 2024-12. [2025-09-29T21:58:18.104597] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-29T21:58:18.110214] [INFO ] [MAIN ] WTM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:58:18.110530] [DEBUG] [LOCAL ] WTM: No existing data file found in primary storage. [2025-09-29T21:58:18.119696] [WARN ] [MAIN ] WTM: No existing data found, performing full refresh instead. [2025-09-29T21:58:18.120936] [INFO ] [MAIN ] WTM: Wiping existing primary data before full refresh. [2025-09-29T21:58:18.121000] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-09-29T21:58:18.121052] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-09-29T21:58:18.121086] [INFO ] [MAIN ] WTM: Starting full primary refresh. [2025-09-29T21:58:18.541967] [INFO ] [REMOTE ] WTM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:58:18.748101] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-03. [2025-09-29T21:58:19.012581] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-29T21:58:19.463916] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-29T21:58:19.548171] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-05. [2025-09-29T21:58:20.352067] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-01. [2025-09-29T21:58:20.358488] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-29T21:58:21.148106] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-04. [2025-09-29T21:58:21.225502] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-29T21:58:21.837800] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-29T21:58:21.948193] [INFO ] [REMOTE ] WTM: Fetching primary data for 2024-12. [2025-09-29T21:58:22.377420] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-29T21:58:22.748100] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-06. [2025-09-29T21:58:22.790877] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-29T21:58:23.548165] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-05. [2025-09-29T21:58:24.273195] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-29T21:58:24.348133] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-07. [2025-09-29T21:58:25.148797] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-02. [2025-09-29T21:58:25.148701] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-29T21:58:25.950133] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-01. [2025-09-29T21:58:25.958370] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-29T21:58:26.315119] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-29T21:58:26.588570] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-29T21:58:26.748131] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-06. [2025-09-29T21:58:27.548160] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-02. [2025-09-29T21:58:27.972950] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-29T21:58:28.348112] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-03. [2025-09-29T21:58:28.396520] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-29T21:58:29.148147] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-07. [2025-09-29T21:58:29.663869] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-29T21:58:29.948146] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-04. [2025-09-29T21:58:30.748133] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-03. [2025-09-29T21:58:30.959469] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-29T21:58:31.225535] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-29T21:58:31.315765] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-29T21:58:31.548192] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-08. [2025-09-29T21:58:32.234430] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-29T21:58:32.348153] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-05. [2025-09-29T21:58:33.148111] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-08. [2025-09-29T21:58:33.948085] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-09. [2025-09-29T21:58:34.038341] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-29T21:58:34.628115] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-29T21:58:34.635370] [INFO ] [REMOTE ] WST: Full fetch complete (53739 records). [2025-09-29T21:58:34.635513] [DEBUG] [VALIDATOR ] WST: Validating primary data. [2025-09-29T21:58:34.752495] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-06. [2025-09-29T21:58:35.066787] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-29T21:58:35.097837] [DEBUG] [VALIDATOR ] WST: All expected trading days are present. [2025-09-29T21:58:35.098081] [DEBUG] [VALIDATOR ] WST: Primary data validation passed. [2025-09-29T21:58:35.099355] [INFO ] [MAIN ] WST: Fetched primary data is valid. [2025-09-29T21:58:35.099877] [DEBUG] [LOCAL ] WST: Saving primary data. [2025-09-29T21:58:35.101201] [DEBUG] [LOCAL ] WST: Trimmed 53739 records to 37372 (keeping 200 days of data) [2025-09-29T21:58:35.355351] [DEBUG] [LOCAL ] WST: Primary data saved (37372 records). [2025-09-29T21:58:35.355505] [INFO ] [MAIN ] WST: Full history saved. [2025-09-29T21:58:35.355611] [INFO ] [MAIN ] Update Progress: 2325/2371 symbols completed. WST took 31.8s. Estimated remaining: 5m 54s. Rate: 7.8 symbols/min [2025-09-29T21:58:35.546373] [INFO ] [MAIN ] WTRG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:58:35.548116] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-09. [2025-09-29T21:58:35.599856] [DEBUG] [LOCAL ] WTRG: Loaded 51656 existing records from primary storage. [2025-09-29T21:58:35.600208] [INFO ] [MAIN ] WTRG: Loaded 51656 existing records. [2025-09-29T21:58:35.795159] [WARN ] [MAIN ] WTRG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:58:35.795444] [INFO ] [MAIN ] WTRG: Wiping existing primary data before full refresh. [2025-09-29T21:58:35.795495] [INFO ] [LOCAL ] WTRG: Starting deletion of primary data. [2025-09-29T21:58:35.796586] [DEBUG] [LOCAL ] WTRG: Deleted primary data file. [2025-09-29T21:58:35.796678] [INFO ] [MAIN ] WTRG: Starting full primary refresh. [2025-09-29T21:58:36.186014] [INFO ] [REMOTE ] WTRG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:58:36.348142] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2024-12. [2025-09-29T21:58:36.776884] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-29T21:58:37.148118] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-07. [2025-09-29T21:58:37.386342] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-29T21:58:37.397320] [INFO ] [REMOTE ] WT: Full fetch complete (69095 records). [2025-09-29T21:58:37.397485] [DEBUG] [VALIDATOR ] WT: Validating primary data. [2025-09-29T21:58:37.814813] [DEBUG] [VALIDATOR ] WT: All expected trading days are present. [2025-09-29T21:58:37.814927] [DEBUG] [VALIDATOR ] WT: Primary data validation passed. [2025-09-29T21:58:37.816086] [INFO ] [MAIN ] WT: Fetched primary data is valid. [2025-09-29T21:58:37.816152] [DEBUG] [LOCAL ] WT: Saving primary data. [2025-09-29T21:58:37.817684] [DEBUG] [LOCAL ] WT: Trimmed 69095 records to 47632 (keeping 200 days of data) [2025-09-29T21:58:37.997262] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-04. [2025-09-29T21:58:38.127039] [DEBUG] [LOCAL ] WT: Primary data saved (47632 records). [2025-09-29T21:58:38.127196] [INFO ] [MAIN ] WT: Full history saved. [2025-09-29T21:58:38.127289] [INFO ] [MAIN ] Update Progress: 2326/2371 symbols completed. WT took 31.4s. Estimated remaining: 5m 47s. Rate: 7.8 symbols/min [2025-09-29T21:58:38.340835] [INFO ] [MAIN ] WTS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:58:38.342939] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-29T21:58:38.373700] [DEBUG] [LOCAL ] WTS: Loaded 18597 existing records from primary storage. [2025-09-29T21:58:38.374015] [INFO ] [MAIN ] WTS: Loaded 18597 existing records. [2025-09-29T21:58:38.458506] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-29T21:58:38.573136] [WARN ] [MAIN ] WTS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:58:38.573382] [INFO ] [MAIN ] WTS: Wiping existing primary data before full refresh. [2025-09-29T21:58:38.573436] [INFO ] [LOCAL ] WTS: Starting deletion of primary data. [2025-09-29T21:58:38.573790] [DEBUG] [LOCAL ] WTS: Deleted primary data file. [2025-09-29T21:58:38.573851] [INFO ] [MAIN ] WTS: Starting full primary refresh. [2025-09-29T21:58:38.749200] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-01. [2025-09-29T21:58:38.990940] [INFO ] [REMOTE ] WTS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:58:39.031105] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-29T21:58:39.548133] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-08. [2025-09-29T21:58:40.356424] [INFO ] [REMOTE ] WTS: Fetching primary data for 2024-12. [2025-09-29T21:58:40.362105] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-29T21:58:40.801084] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-29T21:58:41.148082] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-02. [2025-09-29T21:58:41.234309] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-29T21:58:41.948119] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-01. [2025-09-29T21:58:42.748088] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-09. [2025-09-29T21:58:42.784043] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-29T21:58:42.972376] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-29T21:58:43.548149] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-05. [2025-09-29T21:58:43.954285] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-29T21:58:44.050226] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-29T21:58:44.059877] [INFO ] [REMOTE ] WTI: Full fetch complete (64200 records). [2025-09-29T21:58:44.060040] [DEBUG] [VALIDATOR ] WTI: Validating primary data. [2025-09-29T21:58:44.353236] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-03. [2025-09-29T21:58:44.472554] [DEBUG] [VALIDATOR ] WTI: All expected trading days are present. [2025-09-29T21:58:44.472680] [DEBUG] [VALIDATOR ] WTI: Primary data validation passed. [2025-09-29T21:58:44.473852] [INFO ] [MAIN ] WTI: Fetched primary data is valid. [2025-09-29T21:58:44.473918] [DEBUG] [LOCAL ] WTI: Saving primary data. [2025-09-29T21:58:44.475243] [DEBUG] [LOCAL ] WTI: Trimmed 64200 records to 43885 (keeping 200 days of data) [2025-09-29T21:58:44.753937] [DEBUG] [LOCAL ] WTI: Primary data saved (43885 records). [2025-09-29T21:58:44.754151] [INFO ] [MAIN ] WTI: Full history saved. [2025-09-29T21:58:44.754321] [INFO ] [MAIN ] Update Progress: 2327/2371 symbols completed. WTI took 28.4s. Estimated remaining: 5m 39s. Rate: 7.8 symbols/min [2025-09-29T21:58:44.936749] [INFO ] [MAIN ] WTTR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:58:44.984360] [DEBUG] [LOCAL ] WTTR: Loaded 45735 existing records from primary storage. [2025-09-29T21:58:44.984695] [INFO ] [MAIN ] WTTR: Loaded 45735 existing records. [2025-09-29T21:58:45.163784] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-02. [2025-09-29T21:58:45.171512] [WARN ] [MAIN ] WTTR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:58:45.172528] [INFO ] [MAIN ] WTTR: Wiping existing primary data before full refresh. [2025-09-29T21:58:45.172599] [INFO ] [LOCAL ] WTTR: Starting deletion of primary data. [2025-09-29T21:58:45.173075] [DEBUG] [LOCAL ] WTTR: Deleted primary data file. [2025-09-29T21:58:45.173137] [INFO ] [MAIN ] WTTR: Starting full primary refresh. [2025-09-29T21:58:45.555742] [INFO ] [REMOTE ] WTTR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:58:45.948106] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2024-12. [2025-09-29T21:58:46.210801] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-29T21:58:46.315553] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-29T21:58:46.748185] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-06. [2025-09-29T21:58:47.230604] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-29T21:58:47.366214] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-29T21:58:47.548187] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-01. [2025-09-29T21:58:48.348129] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-07. [2025-09-29T21:58:48.819865] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-29T21:58:49.137412] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-29T21:58:49.148053] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-02. [2025-09-29T21:58:49.948119] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-04. [2025-09-29T21:58:50.369444] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-29T21:58:50.748154] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-08. [2025-09-29T21:58:51.242866] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-29T21:58:51.548090] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-03. [2025-09-29T21:58:51.702007] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-29T21:58:52.348113] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-03. [2025-09-29T21:58:53.148094] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-05. [2025-09-29T21:58:53.217772] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-29T21:58:53.590709] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-29T21:58:53.948117] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-04. [2025-09-29T21:58:54.748081] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-09. [2025-09-29T21:58:54.887499] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-29T21:58:54.954432] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-29T21:58:55.287036] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-29T21:58:55.288518] [INFO ] [REMOTE ] WTM: Full fetch complete (2324 records). [2025-09-29T21:58:55.288594] [DEBUG] [VALIDATOR ] WTM: Validating primary data. [2025-09-29T21:58:55.515825] [WARN ] [VALIDATOR ] WTM: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-29T21:58:55.516407] [FATAL] [MAIN ] WTM: Fetched primary data is invalid. Refusing to save it. [2025-09-29T21:58:55.516512] [WARN ] [MAIN ] WTM: Deleting existing primary and derivative data due to validation failure. [2025-09-29T21:58:55.516627] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-09-29T21:58:55.516812] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-09-29T21:58:55.516901] [INFO ] [LOCAL ] WTM: Starting deletion of derivative data. [2025-09-29T21:58:55.517036] [DEBUG] [LOCAL ] WTM: No derivative data file found to delete. [2025-09-29T21:58:55.517261] [INFO ] [MAIN ] Update Progress: 2328/2371 symbols completed. WTM took 37.6s. Estimated remaining: 5m 31s. Rate: 7.8 symbols/min [2025-09-29T21:58:55.553372] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-06. [2025-09-29T21:58:55.704146] [INFO ] [MAIN ] WU: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:58:55.761093] [DEBUG] [LOCAL ] WU: Loaded 54232 existing records from primary storage. [2025-09-29T21:58:55.761422] [INFO ] [MAIN ] WU: Loaded 54232 existing records. [2025-09-29T21:58:55.950279] [WARN ] [MAIN ] WU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:58:55.950566] [INFO ] [MAIN ] WU: Wiping existing primary data before full refresh. [2025-09-29T21:58:55.950631] [INFO ] [LOCAL ] WU: Starting deletion of primary data. [2025-09-29T21:58:55.951070] [DEBUG] [LOCAL ] WU: Deleted primary data file. [2025-09-29T21:58:55.951129] [INFO ] [MAIN ] WU: Starting full primary refresh. [2025-09-29T21:58:56.322113] [INFO ] [REMOTE ] WU: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:58:56.348086] [INFO ] [REMOTE ] WU: Fetching primary data for 2024-12. [2025-09-29T21:58:57.033265] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-29T21:58:57.148129] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-05. [2025-09-29T21:58:57.948096] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-04. [2025-09-29T21:58:58.150396] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-29T21:58:58.274349] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-29T21:58:58.748126] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-07. [2025-09-29T21:58:59.541421] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-29T21:58:59.551200] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-01. [2025-09-29T21:59:00.348114] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-05. [2025-09-29T21:59:00.600979] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-29T21:59:01.148076] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-08. [2025-09-29T21:59:01.426154] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-29T21:59:01.939147] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-29T21:59:01.948377] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-02. [2025-09-29T21:59:02.686240] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-29T21:59:02.748103] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-09. [2025-09-29T21:59:03.438561] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-29T21:59:03.548124] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-03. [2025-09-29T21:59:04.348124] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-06. [2025-09-29T21:59:04.445817] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-29T21:59:04.456785] [INFO ] [REMOTE ] WTRG: Full fetch complete (73315 records). [2025-09-29T21:59:04.457006] [DEBUG] [VALIDATOR ] WTRG: Validating primary data. [2025-09-29T21:59:04.868760] [DEBUG] [VALIDATOR ] WTRG: All expected trading days are present. [2025-09-29T21:59:04.868864] [DEBUG] [VALIDATOR ] WTRG: Primary data validation passed. [2025-09-29T21:59:04.870178] [INFO ] [MAIN ] WTRG: Fetched primary data is valid. [2025-09-29T21:59:04.870247] [DEBUG] [LOCAL ] WTRG: Saving primary data. [2025-09-29T21:59:04.871797] [DEBUG] [LOCAL ] WTRG: Trimmed 73315 records to 50896 (keeping 200 days of data) [2025-09-29T21:59:05.168596] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-06. [2025-09-29T21:59:05.219014] [DEBUG] [LOCAL ] WTRG: Primary data saved (50896 records). [2025-09-29T21:59:05.219165] [INFO ] [MAIN ] WTRG: Full history saved. [2025-09-29T21:59:05.219259] [INFO ] [MAIN ] Update Progress: 2329/2371 symbols completed. WTRG took 29.9s. Estimated remaining: 5m 24s. Rate: 7.8 symbols/min [2025-09-29T21:59:05.463762] [INFO ] [MAIN ] WWW: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:59:05.543569] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-29T21:59:05.573411] [DEBUG] [LOCAL ] WWW: Loaded 49906 existing records from primary storage. [2025-09-29T21:59:05.594956] [INFO ] [MAIN ] WWW: Loaded 49906 existing records. [2025-09-29T21:59:05.656485] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-29T21:59:05.799200] [WARN ] [MAIN ] WWW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:59:05.799485] [INFO ] [MAIN ] WWW: Wiping existing primary data before full refresh. [2025-09-29T21:59:05.799559] [INFO ] [LOCAL ] WWW: Starting deletion of primary data. [2025-09-29T21:59:05.800225] [DEBUG] [LOCAL ] WWW: Deleted primary data file. [2025-09-29T21:59:05.800288] [INFO ] [MAIN ] WWW: Starting full primary refresh. [2025-09-29T21:59:05.948083] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-07. [2025-09-29T21:59:06.191464] [INFO ] [REMOTE ] WWW: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:59:06.203841] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-29T21:59:06.748155] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-07. [2025-09-29T21:59:07.359824] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-29T21:59:07.548089] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-04. [2025-09-29T21:59:07.854266] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-29T21:59:08.348108] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-08. [2025-09-29T21:59:08.927320] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-29T21:59:09.148083] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-05. [2025-09-29T21:59:09.255571] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-29T21:59:09.948116] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-09. [2025-09-29T21:59:10.748074] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-08. [2025-09-29T21:59:10.953539] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-29T21:59:10.991725] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-29T21:59:10.995078] [INFO ] [REMOTE ] WTS: Full fetch complete (26221 records). [2025-09-29T21:59:10.995181] [DEBUG] [VALIDATOR ] WTS: Validating primary data. [2025-09-29T21:59:11.383069] [DEBUG] [VALIDATOR ] WTS: All expected trading days are present. [2025-09-29T21:59:11.383159] [DEBUG] [VALIDATOR ] WTS: Primary data validation passed. [2025-09-29T21:59:11.383740] [INFO ] [MAIN ] WTS: Fetched primary data is valid. [2025-09-29T21:59:11.383805] [DEBUG] [LOCAL ] WTS: Saving primary data. [2025-09-29T21:59:11.384545] [DEBUG] [LOCAL ] WTS: Trimmed 26221 records to 18250 (keeping 200 days of data) [2025-09-29T21:59:11.528935] [DEBUG] [LOCAL ] WTS: Primary data saved (18250 records). [2025-09-29T21:59:11.529082] [INFO ] [MAIN ] WTS: Full history saved. [2025-09-29T21:59:11.529210] [INFO ] [MAIN ] Update Progress: 2330/2371 symbols completed. WTS took 33.4s. Estimated remaining: 5m 16s. Rate: 7.8 symbols/min [2025-09-29T21:59:11.556478] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-06. [2025-09-29T21:59:11.728863] [INFO ] [MAIN ] WY: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:59:11.793696] [DEBUG] [LOCAL ] WY: Loaded 53899 existing records from primary storage. [2025-09-29T21:59:11.794239] [INFO ] [MAIN ] WY: Loaded 53899 existing records. [2025-09-29T21:59:11.986868] [WARN ] [MAIN ] WY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:59:11.987137] [INFO ] [MAIN ] WY: Wiping existing primary data before full refresh. [2025-09-29T21:59:11.987192] [INFO ] [LOCAL ] WY: Starting deletion of primary data. [2025-09-29T21:59:11.987615] [DEBUG] [LOCAL ] WY: Deleted primary data file. [2025-09-29T21:59:11.987714] [INFO ] [MAIN ] WY: Starting full primary refresh. [2025-09-29T21:59:12.348271] [INFO ] [REMOTE ] WWW: Fetching primary data for 2024-12. [2025-09-29T21:59:12.458106] [INFO ] [REMOTE ] WY: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:59:12.487198] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-29T21:59:13.148118] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-09. [2025-09-29T21:59:13.474181] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-29T21:59:13.948095] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-07. [2025-09-29T21:59:14.015678] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-29T21:59:14.372155] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-29T21:59:14.382209] [INFO ] [REMOTE ] WTTR: Full fetch complete (65606 records). [2025-09-29T21:59:14.382385] [DEBUG] [VALIDATOR ] WTTR: Validating primary data. [2025-09-29T21:59:14.758488] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-01. [2025-09-29T21:59:14.808749] [DEBUG] [VALIDATOR ] WTTR: All expected trading days are present. [2025-09-29T21:59:14.808870] [DEBUG] [VALIDATOR ] WTTR: Primary data validation passed. [2025-09-29T21:59:14.810566] [INFO ] [MAIN ] WTTR: Fetched primary data is valid. [2025-09-29T21:59:14.810639] [DEBUG] [LOCAL ] WTTR: Saving primary data. [2025-09-29T21:59:14.812563] [DEBUG] [LOCAL ] WTTR: Trimmed 65606 records to 44970 (keeping 200 days of data) [2025-09-29T21:59:15.116330] [DEBUG] [LOCAL ] WTTR: Primary data saved (44970 records). [2025-09-29T21:59:15.116530] [INFO ] [MAIN ] WTTR: Full history saved. [2025-09-29T21:59:15.116693] [INFO ] [MAIN ] Update Progress: 2331/2371 symbols completed. WTTR took 30.4s. Estimated remaining: 5m 8s. Rate: 7.8 symbols/min [2025-09-29T21:59:15.285445] [INFO ] [MAIN ] XFLT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:59:15.329954] [DEBUG] [LOCAL ] XFLT: Loaded 30306 existing records from primary storage. [2025-09-29T21:59:15.330320] [INFO ] [MAIN ] XFLT: Loaded 30306 existing records. [2025-09-29T21:59:15.511613] [WARN ] [MAIN ] XFLT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:59:15.511973] [INFO ] [MAIN ] XFLT: Wiping existing primary data before full refresh. [2025-09-29T21:59:15.512028] [INFO ] [LOCAL ] XFLT: Starting deletion of primary data. [2025-09-29T21:59:15.512885] [DEBUG] [LOCAL ] XFLT: Deleted primary data file. [2025-09-29T21:59:15.512974] [INFO ] [MAIN ] XFLT: Starting full primary refresh. [2025-09-29T21:59:15.555486] [INFO ] [REMOTE ] WY: Fetching primary data for 2024-12. [2025-09-29T21:59:15.888488] [INFO ] [REMOTE ] XFLT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:59:15.928353] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-29T21:59:16.166045] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-29T21:59:16.348139] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-08. [2025-09-29T21:59:17.148179] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2024-12. [2025-09-29T21:59:17.802373] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-09-29T21:59:17.948139] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-01. [2025-09-29T21:59:18.289613] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-29T21:59:18.365916] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-29T21:59:18.748133] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-09. [2025-09-29T21:59:19.548120] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-01. [2025-09-29T21:59:19.808234] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-29T21:59:20.348156] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-02. [2025-09-29T21:59:20.571175] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-29T21:59:20.582917] [INFO ] [REMOTE ] WU: Full fetch complete (77332 records). [2025-09-29T21:59:20.583107] [DEBUG] [VALIDATOR ] WU: Validating primary data. [2025-09-29T21:59:20.995885] [DEBUG] [VALIDATOR ] WU: All expected trading days are present. [2025-09-29T21:59:20.996057] [DEBUG] [VALIDATOR ] WU: Primary data validation passed. [2025-09-29T21:59:20.997880] [INFO ] [MAIN ] WU: Fetched primary data is valid. [2025-09-29T21:59:20.997976] [DEBUG] [LOCAL ] WU: Saving primary data. [2025-09-29T21:59:21.029608] [DEBUG] [LOCAL ] WU: Trimmed 77332 records to 53452 (keeping 200 days of data) [2025-09-29T21:59:21.029443] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-29T21:59:21.148145] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-02. [2025-09-29T21:59:21.387961] [DEBUG] [LOCAL ] WU: Primary data saved (53452 records). [2025-09-29T21:59:21.388162] [INFO ] [MAIN ] WU: Full history saved. [2025-09-29T21:59:21.388324] [INFO ] [MAIN ] Update Progress: 2332/2371 symbols completed. WU took 25.9s. Estimated remaining: 5m 0s. Rate: 7.8 symbols/min [2025-09-29T21:59:21.556999] [INFO ] [MAIN ] XHR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:59:21.611355] [DEBUG] [LOCAL ] XHR: Loaded 44680 existing records from primary storage. [2025-09-29T21:59:21.611929] [INFO ] [MAIN ] XHR: Loaded 44680 existing records. [2025-09-29T21:59:21.801839] [WARN ] [MAIN ] XHR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:59:21.802398] [INFO ] [MAIN ] XHR: Wiping existing primary data before full refresh. [2025-09-29T21:59:21.802603] [INFO ] [LOCAL ] XHR: Starting deletion of primary data. [2025-09-29T21:59:21.803165] [DEBUG] [LOCAL ] XHR: Deleted primary data file. [2025-09-29T21:59:21.803236] [INFO ] [MAIN ] XHR: Starting full primary refresh. [2025-09-29T21:59:21.964467] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-02. [2025-09-29T21:59:22.091779] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-29T21:59:22.259932] [INFO ] [REMOTE ] XHR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:59:22.262101] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-29T21:59:22.748134] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-03. [2025-09-29T21:59:23.346694] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-29T21:59:23.548143] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-03. [2025-09-29T21:59:24.348101] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-03. [2025-09-29T21:59:24.574224] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-29T21:59:24.866505] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-29T21:59:25.148118] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-04. [2025-09-29T21:59:25.867268] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-29T21:59:25.948122] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-04. [2025-09-29T21:59:26.755133] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-04. [2025-09-29T21:59:26.762076] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-29T21:59:27.548083] [INFO ] [REMOTE ] XHR: Fetching primary data for 2024-12. [2025-09-29T21:59:27.827350] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-29T21:59:27.858058] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-29T21:59:28.348283] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-05. [2025-09-29T21:59:29.062498] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-29T21:59:29.148099] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-01. [2025-09-29T21:59:29.597243] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-29T21:59:29.948119] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-05. [2025-09-29T21:59:30.479495] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-29T21:59:30.748120] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-05. [2025-09-29T21:59:31.548105] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-02. [2025-09-29T21:59:31.795604] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-29T21:59:31.942394] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-29T21:59:32.348121] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-06. [2025-09-29T21:59:32.608610] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-29T21:59:33.148121] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-06. [2025-09-29T21:59:33.818826] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-29T21:59:33.948108] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-06. [2025-09-29T21:59:34.540973] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-29T21:59:34.748191] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-03. [2025-09-29T21:59:35.202609] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-29T21:59:35.548121] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-07. [2025-09-29T21:59:36.036778] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-29T21:59:36.348147] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-07. [2025-09-29T21:59:37.148136] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-04. [2025-09-29T21:59:37.512680] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-29T21:59:37.948092] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-08. [2025-09-29T21:59:38.142815] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-29T21:59:38.712437] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-29T21:59:38.748097] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-09. [2025-09-29T21:59:38.784091] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-29T21:59:39.419866] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-29T21:59:39.431574] [INFO ] [REMOTE ] WY: Full fetch complete (76849 records). [2025-09-29T21:59:39.431787] [DEBUG] [VALIDATOR ] WY: Validating primary data. [2025-09-29T21:59:39.548912] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-05. [2025-09-29T21:59:39.859837] [DEBUG] [VALIDATOR ] WY: All expected trading days are present. [2025-09-29T21:59:39.860005] [DEBUG] [VALIDATOR ] WY: Primary data validation passed. [2025-09-29T21:59:39.862251] [INFO ] [MAIN ] WY: Fetched primary data is valid. [2025-09-29T21:59:39.862353] [DEBUG] [LOCAL ] WY: Saving primary data. [2025-09-29T21:59:39.868110] [DEBUG] [LOCAL ] WY: Trimmed 76849 records to 53120 (keeping 200 days of data) [2025-09-29T21:59:40.215312] [DEBUG] [LOCAL ] WY: Primary data saved (53120 records). [2025-09-29T21:59:40.215459] [INFO ] [MAIN ] WY: Full history saved. [2025-09-29T21:59:40.215547] [INFO ] [MAIN ] Update Progress: 2333/2371 symbols completed. WY took 28.7s. Estimated remaining: 4m 53s. Rate: 7.8 symbols/min [2025-09-29T21:59:40.353301] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-07. [2025-09-29T21:59:40.412081] [INFO ] [MAIN ] XIFR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:59:40.412322] [DEBUG] [LOCAL ] XIFR: No existing data file found in primary storage. [2025-09-29T21:59:40.412369] [WARN ] [MAIN ] XIFR: No existing data found, performing full refresh instead. [2025-09-29T21:59:40.412513] [INFO ] [MAIN ] XIFR: Wiping existing primary data before full refresh. [2025-09-29T21:59:40.412556] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-09-29T21:59:40.412600] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-09-29T21:59:40.412636] [INFO ] [MAIN ] XIFR: Starting full primary refresh. [2025-09-29T21:59:40.806978] [INFO ] [REMOTE ] XIFR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:59:41.000710] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-29T21:59:41.148122] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-06. [2025-09-29T21:59:41.852439] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-29T21:59:41.948118] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-08. [2025-09-29T21:59:42.368884] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-29T21:59:42.748115] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-07. [2025-09-29T21:59:43.313671] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-29T21:59:43.548121] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-09. [2025-09-29T21:59:44.108375] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-29T21:59:44.348125] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2024-12. [2025-09-29T21:59:44.555072] [DEBUG] [REMOTE ] XIFR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T21:59:44.555390] [WARN ] [REMOTE ] XIFR: No data returned for month 2024-12 [2025-09-29T21:59:44.555484] [FATAL] [REMOTE ] XIFR: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T21:59:44.555532] [FATAL] [MAIN ] XIFR: Failed to fetch primary data. [2025-09-29T21:59:44.555567] [WARN ] [MAIN ] XIFR: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T21:59:44.555635] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-09-29T21:59:44.555770] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-09-29T21:59:44.555829] [INFO ] [LOCAL ] XIFR: Starting deletion of derivative data. [2025-09-29T21:59:44.555890] [DEBUG] [LOCAL ] XIFR: No derivative data file found to delete. [2025-09-29T21:59:44.555960] [INFO ] [MAIN ] Update Progress: 2334/2371 symbols completed. XIFR took 4.3s. Estimated remaining: 4m 45s. Rate: 7.8 symbols/min [2025-09-29T21:59:44.747268] [INFO ] [MAIN ] XOM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:59:44.810795] [DEBUG] [LOCAL ] XOM: Loaded 54573 existing records from primary storage. [2025-09-29T21:59:44.811405] [INFO ] [MAIN ] XOM: Loaded 54573 existing records. [2025-09-29T21:59:44.935486] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-29T21:59:44.953159] [INFO ] [REMOTE ] XFLT: Full fetch complete (44244 records). [2025-09-29T21:59:44.963554] [DEBUG] [VALIDATOR ] XFLT: Validating primary data. [2025-09-29T21:59:45.110193] [WARN ] [MAIN ] XOM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:59:45.135052] [INFO ] [MAIN ] XOM: Wiping existing primary data before full refresh. [2025-09-29T21:59:45.138014] [INFO ] [LOCAL ] XOM: Starting deletion of primary data. [2025-09-29T21:59:45.149026] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-08. [2025-09-29T21:59:45.143865] [DEBUG] [LOCAL ] XOM: Deleted primary data file. [2025-09-29T21:59:45.185745] [INFO ] [MAIN ] XOM: Starting full primary refresh. [2025-09-29T21:59:45.696508] [DEBUG] [VALIDATOR ] XFLT: All expected trading days are present. [2025-09-29T21:59:45.712832] [DEBUG] [VALIDATOR ] XFLT: Primary data validation passed. [2025-09-29T21:59:45.734423] [INFO ] [MAIN ] XFLT: Fetched primary data is valid. [2025-09-29T21:59:45.734864] [DEBUG] [LOCAL ] XFLT: Saving primary data. [2025-09-29T21:59:45.791769] [DEBUG] [LOCAL ] XFLT: Trimmed 44244 records to 29722 (keeping 200 days of data) [2025-09-29T21:59:45.816045] [INFO ] [REMOTE ] XOM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:59:45.966453] [INFO ] [REMOTE ] XOM: Fetching primary data for 2024-12. [2025-09-29T21:59:46.008619] [DEBUG] [LOCAL ] XFLT: Primary data saved (29722 records). [2025-09-29T21:59:46.008826] [INFO ] [MAIN ] XFLT: Full history saved. [2025-09-29T21:59:46.009000] [INFO ] [MAIN ] Update Progress: 2335/2371 symbols completed. XFLT took 30.9s. Estimated remaining: 4m 37s. Rate: 7.8 symbols/min [2025-09-29T21:59:46.192757] [INFO ] [MAIN ] XPER: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:59:46.228877] [DEBUG] [LOCAL ] XPER: Loaded 30181 existing records from primary storage. [2025-09-29T21:59:46.229209] [INFO ] [MAIN ] XPER: Loaded 30181 existing records. [2025-09-29T21:59:46.415933] [WARN ] [MAIN ] XPER: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:59:46.416202] [INFO ] [MAIN ] XPER: Wiping existing primary data before full refresh. [2025-09-29T21:59:46.416251] [INFO ] [LOCAL ] XPER: Starting deletion of primary data. [2025-09-29T21:59:46.416902] [DEBUG] [LOCAL ] XPER: Deleted primary data file. [2025-09-29T21:59:46.417005] [INFO ] [MAIN ] XPER: Starting full primary refresh. [2025-09-29T21:59:46.753296] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-08. [2025-09-29T21:59:46.800459] [INFO ] [REMOTE ] XPER: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:59:47.048998] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-29T21:59:47.548154] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-09. [2025-09-29T21:59:48.257823] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-09-29T21:59:48.306125] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-29T21:59:48.348098] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-09. [2025-09-29T21:59:48.924367] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-29T21:59:48.935127] [INFO ] [REMOTE ] WWW: Full fetch complete (70140 records). [2025-09-29T21:59:48.935350] [DEBUG] [VALIDATOR ] WWW: Validating primary data. [2025-09-29T21:59:49.153280] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-01. [2025-09-29T21:59:49.357945] [DEBUG] [VALIDATOR ] WWW: All expected trading days are present. [2025-09-29T21:59:49.358145] [DEBUG] [VALIDATOR ] WWW: Primary data validation passed. [2025-09-29T21:59:49.359569] [INFO ] [MAIN ] WWW: Fetched primary data is valid. [2025-09-29T21:59:49.359824] [DEBUG] [LOCAL ] WWW: Saving primary data. [2025-09-29T21:59:49.361779] [DEBUG] [LOCAL ] WWW: Trimmed 70140 records to 49142 (keeping 200 days of data) [2025-09-29T21:59:49.492848] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-29T21:59:49.506308] [INFO ] [REMOTE ] XHR: Full fetch complete (61504 records). [2025-09-29T21:59:49.506826] [DEBUG] [VALIDATOR ] XHR: Validating primary data. [2025-09-29T21:59:49.937898] [DEBUG] [VALIDATOR ] XHR: All expected trading days are present. [2025-09-29T21:59:49.938263] [DEBUG] [VALIDATOR ] XHR: Primary data validation passed. [2025-09-29T21:59:49.940160] [INFO ] [MAIN ] XHR: Fetched primary data is valid. [2025-09-29T21:59:49.940524] [DEBUG] [LOCAL ] XHR: Saving primary data. [2025-09-29T21:59:49.946334] [DEBUG] [LOCAL ] XHR: Trimmed 61504 records to 43843 (keeping 200 days of data) [2025-09-29T21:59:49.948941] [INFO ] [REMOTE ] XPER: Fetching primary data for 2024-12. [2025-09-29T21:59:50.403124] [DEBUG] [LOCAL ] WWW: Primary data saved (49142 records). [2025-09-29T21:59:50.404039] [INFO ] [MAIN ] WWW: Full history saved. [2025-09-29T21:59:50.405327] [INFO ] [MAIN ] Update Progress: 2336/2371 symbols completed. WWW took 45.2s. Estimated remaining: 4m 30s. Rate: 7.8 symbols/min [2025-09-29T21:59:50.629866] [INFO ] [MAIN ] XPEV: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:59:50.631994] [DEBUG] [LOCAL ] XHR: Primary data saved (43843 records). [2025-09-29T21:59:50.632170] [INFO ] [MAIN ] XHR: Full history saved. [2025-09-29T21:59:50.632280] [INFO ] [MAIN ] Update Progress: 2337/2371 symbols completed. XHR took 29.2s. Estimated remaining: 4m 22s. Rate: 7.8 symbols/min [2025-09-29T21:59:50.852416] [INFO ] [MAIN ] XPO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T21:59:50.876672] [DEBUG] [LOCAL ] XPEV: Loaded 54419 existing records from primary storage. [2025-09-29T21:59:50.877216] [INFO ] [MAIN ] XPEV: Loaded 54419 existing records. [2025-09-29T21:59:51.089229] [WARN ] [MAIN ] XPEV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:59:51.091373] [DEBUG] [LOCAL ] XPO: Loaded 48656 existing records from primary storage. [2025-09-29T21:59:51.092280] [INFO ] [MAIN ] XPO: Loaded 48656 existing records. [2025-09-29T21:59:51.092088] [INFO ] [MAIN ] XPEV: Wiping existing primary data before full refresh. [2025-09-29T21:59:51.125426] [INFO ] [LOCAL ] XPEV: Starting deletion of primary data. [2025-09-29T21:59:51.174093] [DEBUG] [LOCAL ] XPEV: Deleted primary data file. [2025-09-29T21:59:51.200553] [INFO ] [MAIN ] XPEV: Starting full primary refresh. [2025-09-29T21:59:51.420873] [WARN ] [MAIN ] XPO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T21:59:51.464820] [INFO ] [MAIN ] XPO: Wiping existing primary data before full refresh. [2025-09-29T21:59:51.555547] [INFO ] [LOCAL ] XPO: Starting deletion of primary data. [2025-09-29T21:59:51.584914] [DEBUG] [LOCAL ] XPO: Deleted primary data file. [2025-09-29T21:59:51.590267] [INFO ] [MAIN ] XPO: Starting full primary refresh. [2025-09-29T21:59:51.726482] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-29T21:59:51.824951] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-01. [2025-09-29T21:59:51.861824] [INFO ] [REMOTE ] XPEV: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:59:51.868973] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2024-12. [2025-09-29T21:59:52.162768] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-01 (3.01 seconds). [2025-09-29T21:59:52.241272] [INFO ] [REMOTE ] XPO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T21:59:52.348146] [INFO ] [REMOTE ] XPO: Fetching primary data for 2024-12. [2025-09-29T21:59:53.039947] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-29T21:59:53.148097] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-02. [2025-09-29T21:59:53.778029] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-29T21:59:53.900614] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-29T21:59:53.948098] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-01. [2025-09-29T21:59:54.331856] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-29T21:59:54.748154] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-02. [2025-09-29T21:59:55.548127] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-03. [2025-09-29T21:59:55.922236] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-29T21:59:56.348128] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-02. [2025-09-29T21:59:56.863431] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-29T21:59:56.939829] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-29T21:59:57.148107] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-03. [2025-09-29T21:59:57.948127] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-01. [2025-09-29T21:59:58.639771] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-29T21:59:58.748164] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-03. [2025-09-29T21:59:59.231334] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-29T21:59:59.548085] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-04. [2025-09-29T21:59:59.662059] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-29T22:00:00.348154] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-04. [2025-09-29T22:00:00.830942] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-29T22:00:00.991077] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-29T22:00:01.148150] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-05. [2025-09-29T22:00:01.948161] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-04. [2025-09-29T22:00:02.056201] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-29T22:00:02.678631] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-29T22:00:02.748104] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-05. [2025-09-29T22:00:03.548118] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-02. [2025-09-29T22:00:04.276710] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-29T22:00:04.348106] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-05. [2025-09-29T22:00:05.148165] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-06. [2025-09-29T22:00:05.441755] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-05 (2.69 seconds). [2025-09-29T22:00:05.880235] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-09-29T22:00:05.948097] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-03. [2025-09-29T22:00:06.384286] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-29T22:00:06.565245] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-29T22:00:06.748158] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-07. [2025-09-29T22:00:07.548117] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-06. [2025-09-29T22:00:07.780550] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-29T22:00:08.348107] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-08. [2025-09-29T22:00:08.708502] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-03 (2.76 seconds). [2025-09-29T22:00:09.148112] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-04. [2025-09-29T22:00:09.487941] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-29T22:00:09.923988] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-09-29T22:00:09.948101] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-06. [2025-09-29T22:00:10.748083] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-07. [2025-09-29T22:00:10.996215] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-29T22:00:11.548116] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-05. [2025-09-29T22:00:12.348132] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-09. [2025-09-29T22:00:12.854901] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-29T22:00:13.148072] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-08. [2025-09-29T22:00:13.278451] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-06 (3.33 seconds). [2025-09-29T22:00:13.336304] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-29T22:00:13.625273] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-29T22:00:13.632406] [INFO ] [REMOTE ] XPER: Full fetch complete (43237 records). [2025-09-29T22:00:13.632504] [DEBUG] [VALIDATOR ] XPER: Validating primary data. [2025-09-29T22:00:13.951768] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-06. [2025-09-29T22:00:14.048396] [DEBUG] [VALIDATOR ] XPER: All expected trading days are present. [2025-09-29T22:00:14.048484] [DEBUG] [VALIDATOR ] XPER: Primary data validation passed. [2025-09-29T22:00:14.049511] [INFO ] [MAIN ] XPER: Fetched primary data is valid. [2025-09-29T22:00:14.049619] [DEBUG] [LOCAL ] XPER: Saving primary data. [2025-09-29T22:00:14.050874] [DEBUG] [LOCAL ] XPER: Trimmed 43237 records to 29702 (keeping 200 days of data) [2025-09-29T22:00:14.223085] [DEBUG] [LOCAL ] XPER: Primary data saved (29702 records). [2025-09-29T22:00:14.223229] [INFO ] [MAIN ] XPER: Full history saved. [2025-09-29T22:00:14.223318] [INFO ] [MAIN ] Update Progress: 2338/2371 symbols completed. XPER took 28.2s. Estimated remaining: 4m 14s. Rate: 7.8 symbols/min [2025-09-29T22:00:14.432436] [INFO ] [MAIN ] XPOF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T22:00:14.473195] [DEBUG] [LOCAL ] XPOF: Loaded 39243 existing records from primary storage. [2025-09-29T22:00:14.473496] [INFO ] [MAIN ] XPOF: Loaded 39243 existing records. [2025-09-29T22:00:14.661002] [WARN ] [MAIN ] XPOF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T22:00:14.661271] [INFO ] [MAIN ] XPOF: Wiping existing primary data before full refresh. [2025-09-29T22:00:14.661342] [INFO ] [LOCAL ] XPOF: Starting deletion of primary data. [2025-09-29T22:00:14.661833] [DEBUG] [LOCAL ] XPOF: Deleted primary data file. [2025-09-29T22:00:14.661898] [INFO ] [MAIN ] XPOF: Starting full primary refresh. [2025-09-29T22:00:14.758350] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-07. [2025-09-29T22:00:15.050075] [INFO ] [REMOTE ] XPOF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T22:00:15.312520] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-29T22:00:15.494535] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-29T22:00:15.548147] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-09. [2025-09-29T22:00:16.348156] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-07. [2025-09-29T22:00:17.148145] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2024-12. [2025-09-29T22:00:17.273564] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-09-29T22:00:17.793558] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-29T22:00:17.805455] [INFO ] [REMOTE ] XPEV: Full fetch complete (77678 records). [2025-09-29T22:00:17.805736] [DEBUG] [VALIDATOR ] XPEV: Validating primary data. [2025-09-29T22:00:17.951732] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-08. [2025-09-29T22:00:18.079821] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-29T22:00:18.366714] [DEBUG] [VALIDATOR ] XPEV: All expected trading days are present. [2025-09-29T22:00:18.366848] [DEBUG] [VALIDATOR ] XPEV: Primary data validation passed. [2025-09-29T22:00:18.368421] [INFO ] [MAIN ] XPEV: Fetched primary data is valid. [2025-09-29T22:00:18.368553] [DEBUG] [LOCAL ] XPEV: Saving primary data. [2025-09-29T22:00:18.370450] [DEBUG] [LOCAL ] XPEV: Trimmed 77678 records to 53637 (keeping 200 days of data) [2025-09-29T22:00:18.480240] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-29T22:00:18.732435] [DEBUG] [LOCAL ] XPEV: Primary data saved (53637 records). [2025-09-29T22:00:18.732593] [INFO ] [MAIN ] XPEV: Full history saved. [2025-09-29T22:00:18.732706] [INFO ] [MAIN ] Update Progress: 2339/2371 symbols completed. XPEV took 28.3s. Estimated remaining: 4m 6s. Rate: 7.8 symbols/min [2025-09-29T22:00:18.754768] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-08. [2025-09-29T22:00:18.944498] [INFO ] [MAIN ] XPRO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T22:00:18.991066] [DEBUG] [LOCAL ] XPRO: Loaded 46617 existing records from primary storage. [2025-09-29T22:00:18.991394] [INFO ] [MAIN ] XPRO: Loaded 46617 existing records. [2025-09-29T22:00:19.182829] [WARN ] [MAIN ] XPRO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T22:00:19.183097] [INFO ] [MAIN ] XPRO: Wiping existing primary data before full refresh. [2025-09-29T22:00:19.183146] [INFO ] [LOCAL ] XPRO: Starting deletion of primary data. [2025-09-29T22:00:19.183716] [DEBUG] [LOCAL ] XPRO: Deleted primary data file. [2025-09-29T22:00:19.183776] [INFO ] [MAIN ] XPRO: Starting full primary refresh. [2025-09-29T22:00:19.553021] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-01. [2025-09-29T22:00:19.564815] [INFO ] [REMOTE ] XPRO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T22:00:20.164307] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-29T22:00:20.226721] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-29T22:00:20.348080] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2024-12. [2025-09-29T22:00:20.783091] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-29T22:00:21.148150] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-09. [2025-09-29T22:00:21.649121] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-29T22:00:21.948121] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-02. [2025-09-29T22:00:22.670267] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-29T22:00:22.683468] [INFO ] [REMOTE ] XPO: Full fetch complete (69939 records). [2025-09-29T22:00:22.683685] [DEBUG] [VALIDATOR ] XPO: Validating primary data. [2025-09-29T22:00:22.753300] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-09. [2025-09-29T22:00:22.990894] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-29T22:00:23.132246] [DEBUG] [VALIDATOR ] XPO: All expected trading days are present. [2025-09-29T22:00:23.132343] [DEBUG] [VALIDATOR ] XPO: Primary data validation passed. [2025-09-29T22:00:23.133661] [INFO ] [MAIN ] XPO: Fetched primary data is valid. [2025-09-29T22:00:23.133731] [DEBUG] [LOCAL ] XPO: Saving primary data. [2025-09-29T22:00:23.136050] [DEBUG] [LOCAL ] XPO: Trimmed 69939 records to 47863 (keeping 200 days of data) [2025-09-29T22:00:23.394840] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-29T22:00:23.409529] [INFO ] [REMOTE ] XOM: Full fetch complete (77922 records). [2025-09-29T22:00:23.410970] [DEBUG] [VALIDATOR ] XOM: Validating primary data. [2025-09-29T22:00:23.553443] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-03. [2025-09-29T22:00:23.899239] [DEBUG] [VALIDATOR ] XOM: All expected trading days are present. [2025-09-29T22:00:23.899983] [DEBUG] [VALIDATOR ] XOM: Primary data validation passed. [2025-09-29T22:00:23.902007] [INFO ] [MAIN ] XOM: Fetched primary data is valid. [2025-09-29T22:00:23.902427] [DEBUG] [LOCAL ] XOM: Saving primary data. [2025-09-29T22:00:23.907240] [DEBUG] [LOCAL ] XOM: Trimmed 77922 records to 53793 (keeping 200 days of data) [2025-09-29T22:00:24.077151] [DEBUG] [LOCAL ] XPO: Primary data saved (47863 records). [2025-09-29T22:00:24.079499] [INFO ] [MAIN ] XPO: Full history saved. [2025-09-29T22:00:24.079962] [INFO ] [MAIN ] Update Progress: 2340/2371 symbols completed. XPO took 33.4s. Estimated remaining: 3m 59s. Rate: 7.8 symbols/min [2025-09-29T22:00:24.283240] [INFO ] [MAIN ] XYF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T22:00:24.356471] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-01. [2025-09-29T22:00:24.416746] [DEBUG] [LOCAL ] XYF: Loaded 28464 existing records from primary storage. [2025-09-29T22:00:24.418040] [INFO ] [MAIN ] XYF: Loaded 28464 existing records. [2025-09-29T22:00:24.627221] [WARN ] [MAIN ] XYF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T22:00:24.630199] [INFO ] [MAIN ] XYF: Wiping existing primary data before full refresh. [2025-09-29T22:00:24.630732] [INFO ] [LOCAL ] XYF: Starting deletion of primary data. [2025-09-29T22:00:24.632251] [DEBUG] [LOCAL ] XYF: Deleted primary data file. [2025-09-29T22:00:24.632583] [INFO ] [MAIN ] XYF: Starting full primary refresh. [2025-09-29T22:00:25.116235] [INFO ] [REMOTE ] XYF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T22:00:25.151337] [INFO ] [REMOTE ] XYF: Fetching primary data for 2024-12. [2025-09-29T22:00:25.160485] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-29T22:00:25.178741] [DEBUG] [LOCAL ] XOM: Primary data saved (53793 records). [2025-09-29T22:00:25.178934] [INFO ] [MAIN ] XOM: Full history saved. [2025-09-29T22:00:25.179042] [INFO ] [MAIN ] Update Progress: 2341/2371 symbols completed. XOM took 40.6s. Estimated remaining: 3m 51s. Rate: 7.8 symbols/min [2025-09-29T22:00:25.362737] [INFO ] [MAIN ] XYL: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T22:00:25.419118] [DEBUG] [LOCAL ] XYL: Loaded 48777 existing records from primary storage. [2025-09-29T22:00:25.419433] [INFO ] [MAIN ] XYL: Loaded 48777 existing records. [2025-09-29T22:00:25.630101] [WARN ] [MAIN ] XYL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T22:00:25.631153] [INFO ] [MAIN ] XYL: Wiping existing primary data before full refresh. [2025-09-29T22:00:25.631378] [INFO ] [LOCAL ] XYL: Starting deletion of primary data. [2025-09-29T22:00:25.636422] [DEBUG] [LOCAL ] XYL: Deleted primary data file. [2025-09-29T22:00:25.637103] [INFO ] [MAIN ] XYL: Starting full primary refresh. [2025-09-29T22:00:25.669832] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-29T22:00:25.951607] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-01. [2025-09-29T22:00:26.026354] [INFO ] [REMOTE ] XYL: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T22:00:26.053880] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-29T22:00:26.637370] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-29T22:00:26.748149] [INFO ] [REMOTE ] XYL: Fetching primary data for 2024-12. [2025-09-29T22:00:27.548257] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-04. [2025-09-29T22:00:28.348183] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-02. [2025-09-29T22:00:28.496012] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-29T22:00:28.688694] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-29T22:00:29.148098] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-05. [2025-09-29T22:00:29.622830] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-29T22:00:29.948125] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-03. [2025-09-29T22:00:30.614791] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-29T22:00:30.748146] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-01. [2025-09-29T22:00:31.548091] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-06. [2025-09-29T22:00:31.644372] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-29T22:00:32.211688] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-29T22:00:32.348127] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-02. [2025-09-29T22:00:32.873925] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-29T22:00:33.148125] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-02. [2025-09-29T22:00:33.830004] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-29T22:00:33.948125] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-03. [2025-09-29T22:00:34.038999] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-29T22:00:34.748153] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-07. [2025-09-29T22:00:35.011555] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-29T22:00:35.548114] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-04. [2025-09-29T22:00:36.250890] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-29T22:00:36.348134] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-03. [2025-09-29T22:00:36.807810] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-29T22:00:37.148146] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-08. [2025-09-29T22:00:37.948095] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-05. [2025-09-29T22:00:38.056044] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-29T22:00:38.264457] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-29T22:00:38.748161] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-04. [2025-09-29T22:00:39.237877] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-29T22:00:39.548120] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-09. [2025-09-29T22:00:40.348078] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-06. [2025-09-29T22:00:40.583266] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-29T22:00:40.590914] [INFO ] [REMOTE ] XPOF: Full fetch complete (52193 records). [2025-09-29T22:00:40.591066] [DEBUG] [VALIDATOR ] XPOF: Validating primary data. [2025-09-29T22:00:40.937707] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-29T22:00:41.043510] [DEBUG] [VALIDATOR ] XPOF: All expected trading days are present. [2025-09-29T22:00:41.043614] [DEBUG] [VALIDATOR ] XPOF: Primary data validation passed. [2025-09-29T22:00:41.044782] [INFO ] [MAIN ] XPOF: Fetched primary data is valid. [2025-09-29T22:00:41.044849] [DEBUG] [LOCAL ] XPOF: Saving primary data. [2025-09-29T22:00:41.046099] [DEBUG] [LOCAL ] XPOF: Trimmed 52193 records to 38417 (keeping 200 days of data) [2025-09-29T22:00:41.149252] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-05. [2025-09-29T22:00:41.286012] [DEBUG] [LOCAL ] XPOF: Primary data saved (38417 records). [2025-09-29T22:00:41.286225] [INFO ] [MAIN ] XPOF: Full history saved. [2025-09-29T22:00:41.286350] [INFO ] [MAIN ] Update Progress: 2342/2371 symbols completed. XPOF took 27.1s. Estimated remaining: 3m 43s. Rate: 7.8 symbols/min [2025-09-29T22:00:41.470988] [INFO ] [MAIN ] XYZ: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T22:00:41.471274] [DEBUG] [LOCAL ] XYZ: No existing data file found in primary storage. [2025-09-29T22:00:41.471523] [WARN ] [MAIN ] XYZ: No existing data found, performing full refresh instead. [2025-09-29T22:00:41.471703] [INFO ] [MAIN ] XYZ: Wiping existing primary data before full refresh. [2025-09-29T22:00:41.471867] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-09-29T22:00:41.472069] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-09-29T22:00:41.472208] [INFO ] [MAIN ] XYZ: Starting full primary refresh. [2025-09-29T22:00:41.761087] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-29T22:00:41.895707] [INFO ] [REMOTE ] XYZ: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T22:00:41.948090] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2024-12. [2025-09-29T22:00:42.141880] [DEBUG] [REMOTE ] XYZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-29T22:00:42.142271] [WARN ] [REMOTE ] XYZ: No data returned for month 2024-12 [2025-09-29T22:00:42.142363] [FATAL] [REMOTE ] XYZ: API call failed - aborting fetch to avoid wasting further API calls [2025-09-29T22:00:42.142410] [FATAL] [MAIN ] XYZ: Failed to fetch primary data. [2025-09-29T22:00:42.142471] [WARN ] [MAIN ] XYZ: Deleting existing primary and derivative data due to fetch failure. [2025-09-29T22:00:42.142544] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-09-29T22:00:42.142610] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-09-29T22:00:42.142671] [INFO ] [LOCAL ] XYZ: Starting deletion of derivative data. [2025-09-29T22:00:42.142803] [DEBUG] [LOCAL ] XYZ: No derivative data file found to delete. [2025-09-29T22:00:42.142875] [INFO ] [MAIN ] Update Progress: 2343/2371 symbols completed. XYZ took 0.9s. Estimated remaining: 3m 36s. Rate: 7.8 symbols/min [2025-09-29T22:00:42.336215] [INFO ] [MAIN ] YALA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T22:00:42.379977] [DEBUG] [LOCAL ] YALA: Loaded 37892 existing records from primary storage. [2025-09-29T22:00:42.380371] [INFO ] [MAIN ] YALA: Loaded 37892 existing records. [2025-09-29T22:00:42.599938] [WARN ] [MAIN ] YALA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T22:00:42.600313] [INFO ] [MAIN ] YALA: Wiping existing primary data before full refresh. [2025-09-29T22:00:42.600584] [INFO ] [LOCAL ] YALA: Starting deletion of primary data. [2025-09-29T22:00:42.601218] [DEBUG] [LOCAL ] YALA: Deleted primary data file. [2025-09-29T22:00:42.601281] [INFO ] [MAIN ] YALA: Starting full primary refresh. [2025-09-29T22:00:42.756613] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-04. [2025-09-29T22:00:43.027933] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-29T22:00:43.033933] [INFO ] [REMOTE ] YALA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T22:00:43.548141] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-06. [2025-09-29T22:00:44.288619] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-29T22:00:44.348158] [INFO ] [REMOTE ] YALA: Fetching primary data for 2024-12. [2025-09-29T22:00:45.148100] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-07. [2025-09-29T22:00:45.256322] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-29T22:00:45.312081] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-29T22:00:45.948124] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-05. [2025-09-29T22:00:46.675140] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-29T22:00:46.748166] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-07. [2025-09-29T22:00:47.479018] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-29T22:00:47.548146] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-08. [2025-09-29T22:00:48.348126] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-06. [2025-09-29T22:00:48.410548] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-29T22:00:48.771558] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-29T22:00:49.148099] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-09. [2025-09-29T22:00:49.864431] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-29T22:00:49.948144] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-01. [2025-09-29T22:00:50.202560] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-29T22:00:50.208700] [INFO ] [REMOTE ] XYF: Full fetch complete (31784 records). [2025-09-29T22:00:50.208913] [DEBUG] [VALIDATOR ] XYF: Validating primary data. [2025-09-29T22:00:50.633396] [DEBUG] [VALIDATOR ] XYF: All expected trading days are present. [2025-09-29T22:00:50.633562] [DEBUG] [VALIDATOR ] XYF: Primary data validation passed. [2025-09-29T22:00:50.634256] [INFO ] [MAIN ] XYF: Fetched primary data is valid. [2025-09-29T22:00:50.634320] [DEBUG] [LOCAL ] XYF: Saving primary data. [2025-09-29T22:00:50.635188] [DEBUG] [LOCAL ] XYF: Trimmed 31784 records to 28397 (keeping 200 days of data) [2025-09-29T22:00:50.749380] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-08. [2025-09-29T22:00:50.760747] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-29T22:00:50.841185] [DEBUG] [LOCAL ] XYF: Primary data saved (28397 records). [2025-09-29T22:00:50.841339] [INFO ] [MAIN ] XYF: Full history saved. [2025-09-29T22:00:50.841445] [INFO ] [MAIN ] Update Progress: 2344/2371 symbols completed. XYF took 26.8s. Estimated remaining: 3m 28s. Rate: 7.8 symbols/min [2025-09-29T22:00:51.028867] [INFO ] [MAIN ] YELP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T22:00:51.092716] [DEBUG] [LOCAL ] YELP: Loaded 45909 existing records from primary storage. [2025-09-29T22:00:51.093366] [INFO ] [MAIN ] YELP: Loaded 45909 existing records. [2025-09-29T22:00:51.289232] [WARN ] [MAIN ] YELP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T22:00:51.289564] [INFO ] [MAIN ] YELP: Wiping existing primary data before full refresh. [2025-09-29T22:00:51.289639] [INFO ] [LOCAL ] YELP: Starting deletion of primary data. [2025-09-29T22:00:51.290297] [DEBUG] [LOCAL ] YELP: Deleted primary data file. [2025-09-29T22:00:51.290357] [INFO ] [MAIN ] YELP: Starting full primary refresh. [2025-09-29T22:00:51.553211] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-02. [2025-09-29T22:00:51.662229] [INFO ] [REMOTE ] YELP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T22:00:52.348087] [INFO ] [REMOTE ] YELP: Fetching primary data for 2024-12. [2025-09-29T22:00:52.444883] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-29T22:00:52.719290] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-29T22:00:53.148120] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-03. [2025-09-29T22:00:53.949624] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-07. [2025-09-29T22:00:53.955668] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-29T22:00:54.582895] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-29T22:00:54.748137] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-09. [2025-09-29T22:00:55.481844] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-29T22:00:55.492610] [INFO ] [REMOTE ] XYL: Full fetch complete (69805 records). [2025-09-29T22:00:55.493050] [DEBUG] [VALIDATOR ] XYL: Validating primary data. [2025-09-29T22:00:55.553239] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-01. [2025-09-29T22:00:55.701999] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-29T22:00:55.954195] [DEBUG] [VALIDATOR ] XYL: All expected trading days are present. [2025-09-29T22:00:55.954283] [DEBUG] [VALIDATOR ] XYL: Primary data validation passed. [2025-09-29T22:00:55.955459] [INFO ] [MAIN ] XYL: Fetched primary data is valid. [2025-09-29T22:00:55.955528] [DEBUG] [LOCAL ] XYL: Saving primary data. [2025-09-29T22:00:55.957068] [DEBUG] [LOCAL ] XYL: Trimmed 69805 records to 47998 (keeping 200 days of data) [2025-09-29T22:00:56.275810] [DEBUG] [LOCAL ] XYL: Primary data saved (47998 records). [2025-09-29T22:00:56.275949] [INFO ] [MAIN ] XYL: Full history saved. [2025-09-29T22:00:56.276100] [INFO ] [MAIN ] Update Progress: 2345/2371 symbols completed. XYL took 31.1s. Estimated remaining: 3m 20s. Rate: 7.8 symbols/min [2025-09-29T22:00:56.357050] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-08. [2025-09-29T22:00:56.466004] [INFO ] [MAIN ] YETI: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T22:00:56.532147] [DEBUG] [LOCAL ] YETI: Loaded 53216 existing records from primary storage. [2025-09-29T22:00:56.532479] [INFO ] [MAIN ] YETI: Loaded 53216 existing records. [2025-09-29T22:00:56.737372] [WARN ] [MAIN ] YETI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T22:00:56.737752] [INFO ] [MAIN ] YETI: Wiping existing primary data before full refresh. [2025-09-29T22:00:56.738023] [INFO ] [LOCAL ] YETI: Starting deletion of primary data. [2025-09-29T22:00:56.738869] [DEBUG] [LOCAL ] YETI: Deleted primary data file. [2025-09-29T22:00:56.738944] [INFO ] [MAIN ] YETI: Starting full primary refresh. [2025-09-29T22:00:56.990523] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-29T22:00:57.157749] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-04. [2025-09-29T22:00:57.192163] [INFO ] [REMOTE ] YETI: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T22:00:57.948104] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-02. [2025-09-29T22:00:58.134239] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-29T22:00:58.489876] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-29T22:00:58.748122] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-05. [2025-09-29T22:00:59.412107] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-29T22:00:59.548123] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-03. [2025-09-29T22:01:00.348150] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-09. [2025-09-29T22:01:00.482608] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-29T22:01:01.148152] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-06. [2025-09-29T22:01:01.325568] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-29T22:01:01.636416] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-29T22:01:01.647362] [INFO ] [REMOTE ] XPRO: Full fetch complete (66538 records). [2025-09-29T22:01:01.647549] [DEBUG] [VALIDATOR ] XPRO: Validating primary data. [2025-09-29T22:01:01.953234] [INFO ] [REMOTE ] YETI: Fetching primary data for 2024-12. [2025-09-29T22:01:02.084677] [DEBUG] [VALIDATOR ] XPRO: All expected trading days are present. [2025-09-29T22:01:02.084788] [DEBUG] [VALIDATOR ] XPRO: Primary data validation passed. [2025-09-29T22:01:02.086138] [INFO ] [MAIN ] XPRO: Fetched primary data is valid. [2025-09-29T22:01:02.086206] [DEBUG] [LOCAL ] XPRO: Saving primary data. [2025-09-29T22:01:02.087736] [DEBUG] [LOCAL ] XPRO: Trimmed 66538 records to 45851 (keeping 200 days of data) [2025-09-29T22:01:02.402857] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-29T22:01:02.416180] [DEBUG] [LOCAL ] XPRO: Primary data saved (45851 records). [2025-09-29T22:01:02.416397] [INFO ] [MAIN ] XPRO: Full history saved. [2025-09-29T22:01:02.416689] [INFO ] [MAIN ] Update Progress: 2346/2371 symbols completed. XPRO took 43.7s. Estimated remaining: 3m 12s. Rate: 7.8 symbols/min [2025-09-29T22:01:02.654553] [INFO ] [MAIN ] YEXT: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T22:01:02.711845] [DEBUG] [LOCAL ] YEXT: Loaded 43863 existing records from primary storage. [2025-09-29T22:01:02.712195] [INFO ] [MAIN ] YEXT: Loaded 43863 existing records. [2025-09-29T22:01:02.753309] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-04. [2025-09-29T22:01:02.903176] [WARN ] [MAIN ] YEXT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T22:01:02.903411] [INFO ] [MAIN ] YEXT: Wiping existing primary data before full refresh. [2025-09-29T22:01:02.903458] [INFO ] [LOCAL ] YEXT: Starting deletion of primary data. [2025-09-29T22:01:02.903873] [DEBUG] [LOCAL ] YEXT: Deleted primary data file. [2025-09-29T22:01:02.903932] [INFO ] [MAIN ] YEXT: Starting full primary refresh. [2025-09-29T22:01:03.282796] [INFO ] [REMOTE ] YEXT: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T22:01:03.548178] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-07. [2025-09-29T22:01:03.747746] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-29T22:01:04.348151] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-01. [2025-09-29T22:01:04.456401] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-29T22:01:04.709682] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-29T22:01:05.148161] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2024-12. [2025-09-29T22:01:05.955872] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-08. [2025-09-29T22:01:05.978541] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-29T22:01:06.579406] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-29T22:01:06.748112] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-02. [2025-09-29T22:01:07.453238] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-29T22:01:07.548119] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-01. [2025-09-29T22:01:08.348110] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-09. [2025-09-29T22:01:08.378439] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-29T22:01:09.127885] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-29T22:01:09.148067] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-02. [2025-09-29T22:01:09.501043] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-29T22:01:09.508807] [INFO ] [REMOTE ] YALA: Full fetch complete (46488 records). [2025-09-29T22:01:09.509124] [DEBUG] [VALIDATOR ] YALA: Validating primary data. [2025-09-29T22:01:09.915633] [DEBUG] [VALIDATOR ] YALA: All expected trading days are present. [2025-09-29T22:01:09.915748] [DEBUG] [VALIDATOR ] YALA: Primary data validation passed. [2025-09-29T22:01:09.916698] [INFO ] [MAIN ] YALA: Fetched primary data is valid. [2025-09-29T22:01:09.916767] [DEBUG] [LOCAL ] YALA: Saving primary data. [2025-09-29T22:01:09.917964] [DEBUG] [LOCAL ] YALA: Trimmed 46488 records to 37355 (keeping 200 days of data) [2025-09-29T22:01:09.969070] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-03. [2025-09-29T22:01:10.152291] [DEBUG] [LOCAL ] YALA: Primary data saved (37355 records). [2025-09-29T22:01:10.152454] [INFO ] [MAIN ] YALA: Full history saved. [2025-09-29T22:01:10.152544] [INFO ] [MAIN ] Update Progress: 2347/2371 symbols completed. YALA took 28.0s. Estimated remaining: 3m 5s. Rate: 7.8 symbols/min [2025-09-29T22:01:10.390736] [INFO ] [MAIN ] YMM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T22:01:10.461526] [DEBUG] [LOCAL ] YMM: Loaded 53425 existing records from primary storage. [2025-09-29T22:01:10.461887] [INFO ] [MAIN ] YMM: Loaded 53425 existing records. [2025-09-29T22:01:10.652799] [WARN ] [MAIN ] YMM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T22:01:10.653234] [INFO ] [MAIN ] YMM: Wiping existing primary data before full refresh. [2025-09-29T22:01:10.662307] [INFO ] [LOCAL ] YMM: Starting deletion of primary data. [2025-09-29T22:01:10.677417] [DEBUG] [LOCAL ] YMM: Deleted primary data file. [2025-09-29T22:01:10.678341] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-29T22:01:10.678416] [INFO ] [MAIN ] YMM: Starting full primary refresh. [2025-09-29T22:01:10.753477] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-05. [2025-09-29T22:01:11.080513] [INFO ] [REMOTE ] YMM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T22:01:11.436305] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-29T22:01:11.548121] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-03. [2025-09-29T22:01:12.294463] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-29T22:01:12.348106] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-06. [2025-09-29T22:01:13.148106] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-04. [2025-09-29T22:01:13.224560] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-29T22:01:13.735679] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-29T22:01:13.948178] [INFO ] [REMOTE ] YMM: Fetching primary data for 2024-12. [2025-09-29T22:01:14.748202] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-07. [2025-09-29T22:01:14.970050] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-29T22:01:15.548198] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-04. [2025-09-29T22:01:16.031871] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-29T22:01:16.086049] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-29T22:01:16.348177] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-05. [2025-09-29T22:01:16.729523] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-29T22:01:17.148160] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-08. [2025-09-29T22:01:17.948203] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-05. [2025-09-29T22:01:18.194142] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-29T22:01:18.748114] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-01. [2025-09-29T22:01:18.822995] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-29T22:01:19.425078] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-29T22:01:19.548135] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-06. [2025-09-29T22:01:20.207761] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-29T22:01:20.348195] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-06. [2025-09-29T22:01:20.913253] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-29T22:01:21.148171] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-07. [2025-09-29T22:01:21.790542] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-29T22:01:21.948156] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-02. [2025-09-29T22:01:22.753318] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-07. [2025-09-29T22:01:22.777399] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-29T22:01:23.380956] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-29T22:01:23.548162] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-03. [2025-09-29T22:01:23.914760] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-29T22:01:24.348126] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-08. [2025-09-29T22:01:25.148098] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-08. [2025-09-29T22:01:25.442130] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-29T22:01:25.623369] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-29T22:01:25.948134] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-09. [2025-09-29T22:01:26.748125] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-04. [2025-09-29T22:01:27.060882] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-29T22:01:27.541505] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-29T22:01:27.557001] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-09. [2025-09-29T22:01:27.559047] [INFO ] [REMOTE ] YEXT: Full fetch complete (63401 records). [2025-09-29T22:01:27.559195] [DEBUG] [VALIDATOR ] YEXT: Validating primary data. [2025-09-29T22:01:27.987064] [DEBUG] [VALIDATOR ] YEXT: All expected trading days are present. [2025-09-29T22:01:27.987161] [DEBUG] [VALIDATOR ] YEXT: Primary data validation passed. [2025-09-29T22:01:27.988326] [INFO ] [MAIN ] YEXT: Fetched primary data is valid. [2025-09-29T22:01:27.988398] [DEBUG] [LOCAL ] YEXT: Saving primary data. [2025-09-29T22:01:27.989756] [DEBUG] [LOCAL ] YEXT: Trimmed 63401 records to 43143 (keeping 200 days of data) [2025-09-29T22:01:28.272380] [DEBUG] [LOCAL ] YEXT: Primary data saved (43143 records). [2025-09-29T22:01:28.272604] [INFO ] [MAIN ] YEXT: Full history saved. [2025-09-29T22:01:28.272773] [INFO ] [MAIN ] Update Progress: 2348/2371 symbols completed. YEXT took 25.9s. Estimated remaining: 2m 57s. Rate: 7.8 symbols/min [2025-09-29T22:01:28.351459] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-09. [2025-09-29T22:01:28.474003] [INFO ] [MAIN ] YOU: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T22:01:28.550359] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-29T22:01:28.578954] [DEBUG] [LOCAL ] YOU: Loaded 50504 existing records from primary storage. [2025-09-29T22:01:28.579306] [INFO ] [MAIN ] YOU: Loaded 50504 existing records. [2025-09-29T22:01:28.763696] [WARN ] [MAIN ] YOU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T22:01:28.763948] [INFO ] [MAIN ] YOU: Wiping existing primary data before full refresh. [2025-09-29T22:01:28.764006] [INFO ] [LOCAL ] YOU: Starting deletion of primary data. [2025-09-29T22:01:28.764464] [DEBUG] [LOCAL ] YOU: Deleted primary data file. [2025-09-29T22:01:28.764572] [INFO ] [MAIN ] YOU: Starting full primary refresh. [2025-09-29T22:01:29.139470] [INFO ] [REMOTE ] YOU: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T22:01:29.148083] [INFO ] [REMOTE ] YOU: Fetching primary data for 2024-12. [2025-09-29T22:01:29.304865] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-29T22:01:29.316309] [INFO ] [REMOTE ] YETI: Full fetch complete (75449 records). [2025-09-29T22:01:29.316516] [DEBUG] [VALIDATOR ] YETI: Validating primary data. [2025-09-29T22:01:29.764778] [DEBUG] [VALIDATOR ] YETI: All expected trading days are present. [2025-09-29T22:01:29.764899] [DEBUG] [VALIDATOR ] YETI: Primary data validation passed. [2025-09-29T22:01:29.766242] [INFO ] [MAIN ] YETI: Fetched primary data is valid. [2025-09-29T22:01:29.766362] [DEBUG] [LOCAL ] YETI: Saving primary data. [2025-09-29T22:01:29.771026] [DEBUG] [LOCAL ] YETI: Trimmed 75449 records to 52480 (keeping 200 days of data) [2025-09-29T22:01:29.919717] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-29T22:01:29.934220] [INFO ] [REMOTE ] YELP: Full fetch complete (64273 records). [2025-09-29T22:01:29.985386] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-05. [2025-09-29T22:01:29.985537] [DEBUG] [VALIDATOR ] YELP: Validating primary data. [2025-09-29T22:01:30.500963] [DEBUG] [VALIDATOR ] YELP: All expected trading days are present. [2025-09-29T22:01:30.502545] [DEBUG] [VALIDATOR ] YELP: Primary data validation passed. [2025-09-29T22:01:30.507885] [INFO ] [MAIN ] YELP: Fetched primary data is valid. [2025-09-29T22:01:30.512995] [DEBUG] [LOCAL ] YELP: Saving primary data. [2025-09-29T22:01:30.559855] [DEBUG] [LOCAL ] YELP: Trimmed 64273 records to 45246 (keeping 200 days of data) [2025-09-29T22:01:30.695713] [DEBUG] [LOCAL ] YETI: Primary data saved (52480 records). [2025-09-29T22:01:30.698762] [INFO ] [MAIN ] YETI: Full history saved. [2025-09-29T22:01:30.699684] [INFO ] [MAIN ] Update Progress: 2349/2371 symbols completed. YETI took 34.4s. Estimated remaining: 2m 49s. Rate: 7.8 symbols/min [2025-09-29T22:01:30.928868] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-29T22:01:31.000125] [INFO ] [MAIN ] YPF: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T22:01:31.049375] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-01. [2025-09-29T22:01:31.131668] [DEBUG] [LOCAL ] YPF: Loaded 51252 existing records from primary storage. [2025-09-29T22:01:31.148997] [INFO ] [MAIN ] YPF: Loaded 51252 existing records. [2025-09-29T22:01:31.373863] [WARN ] [MAIN ] YPF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T22:01:31.376158] [INFO ] [MAIN ] YPF: Wiping existing primary data before full refresh. [2025-09-29T22:01:31.377012] [INFO ] [LOCAL ] YPF: Starting deletion of primary data. [2025-09-29T22:01:31.378380] [DEBUG] [LOCAL ] YPF: Deleted primary data file. [2025-09-29T22:01:31.378707] [INFO ] [MAIN ] YPF: Starting full primary refresh. [2025-09-29T22:01:31.378568] [DEBUG] [LOCAL ] YELP: Primary data saved (45246 records). [2025-09-29T22:01:31.448504] [INFO ] [MAIN ] YELP: Full history saved. [2025-09-29T22:01:31.458168] [INFO ] [MAIN ] Update Progress: 2350/2371 symbols completed. YELP took 40.6s. Estimated remaining: 2m 42s. Rate: 7.8 symbols/min [2025-09-29T22:01:31.871607] [INFO ] [MAIN ] YRD: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T22:01:32.018152] [DEBUG] [LOCAL ] YRD: Loaded 12726 existing records from primary storage. [2025-09-29T22:01:32.025287] [INFO ] [REMOTE ] YPF: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T22:01:32.025992] [INFO ] [REMOTE ] YPF: Fetching primary data for 2024-12. [2025-09-29T22:01:32.025594] [INFO ] [MAIN ] YRD: Loaded 12726 existing records. [2025-09-29T22:01:32.195429] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-29T22:01:32.270581] [WARN ] [MAIN ] YRD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T22:01:32.270848] [INFO ] [MAIN ] YRD: Wiping existing primary data before full refresh. [2025-09-29T22:01:32.270901] [INFO ] [LOCAL ] YRD: Starting deletion of primary data. [2025-09-29T22:01:32.271148] [DEBUG] [LOCAL ] YRD: Deleted primary data file. [2025-09-29T22:01:32.271207] [INFO ] [MAIN ] YRD: Starting full primary refresh. [2025-09-29T22:01:32.357457] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-06. [2025-09-29T22:01:32.669800] [INFO ] [REMOTE ] YRD: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T22:01:32.702458] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-29T22:01:33.148164] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-02. [2025-09-29T22:01:33.845816] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-29T22:01:33.948091] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-01. [2025-09-29T22:01:34.251542] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-29T22:01:34.748159] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-07. [2025-09-29T22:01:34.870674] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-29T22:01:35.548294] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-03. [2025-09-29T22:01:35.624523] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-29T22:01:36.348139] [INFO ] [REMOTE ] YRD: Fetching primary data for 2024-12. [2025-09-29T22:01:36.619400] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-29T22:01:37.149498] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-29T22:01:37.148168] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-08. [2025-09-29T22:01:37.260768] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-29T22:01:37.948129] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-01. [2025-09-29T22:01:38.561906] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-29T22:01:38.748148] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-02. [2025-09-29T22:01:38.866802] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-29T22:01:39.548116] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-04. [2025-09-29T22:01:39.947963] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-29T22:01:40.348117] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-09. [2025-09-29T22:01:41.148092] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-03. [2025-09-29T22:01:41.336424] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-29T22:01:41.725759] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-29T22:01:41.738080] [INFO ] [REMOTE ] YMM: Full fetch complete (76398 records). [2025-09-29T22:01:41.738279] [DEBUG] [VALIDATOR ] YMM: Validating primary data. [2025-09-29T22:01:41.968179] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-02. [2025-09-29T22:01:42.227579] [DEBUG] [VALIDATOR ] YMM: All expected trading days are present. [2025-09-29T22:01:42.227755] [DEBUG] [VALIDATOR ] YMM: Primary data validation passed. [2025-09-29T22:01:42.229187] [INFO ] [MAIN ] YMM: Fetched primary data is valid. [2025-09-29T22:01:42.229274] [DEBUG] [LOCAL ] YMM: Saving primary data. [2025-09-29T22:01:42.231015] [DEBUG] [LOCAL ] YMM: Trimmed 76398 records to 52637 (keeping 200 days of data) [2025-09-29T22:01:42.623628] [DEBUG] [LOCAL ] YMM: Primary data saved (52637 records). [2025-09-29T22:01:42.625385] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-29T22:01:42.636612] [INFO ] [MAIN ] YMM: Full history saved. [2025-09-29T22:01:42.637769] [INFO ] [MAIN ] Update Progress: 2351/2371 symbols completed. YMM took 32.5s. Estimated remaining: 2m 34s. Rate: 7.8 symbols/min [2025-09-29T22:01:42.753244] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-05. [2025-09-29T22:01:42.834994] [INFO ] [MAIN ] YSG: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T22:01:42.867388] [DEBUG] [LOCAL ] YSG: Loaded 25485 existing records from primary storage. [2025-09-29T22:01:42.867701] [INFO ] [MAIN ] YSG: Loaded 25485 existing records. [2025-09-29T22:01:43.064789] [WARN ] [MAIN ] YSG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T22:01:43.065086] [INFO ] [MAIN ] YSG: Wiping existing primary data before full refresh. [2025-09-29T22:01:43.065156] [INFO ] [LOCAL ] YSG: Starting deletion of primary data. [2025-09-29T22:01:43.065547] [DEBUG] [LOCAL ] YSG: Deleted primary data file. [2025-09-29T22:01:43.065607] [INFO ] [MAIN ] YSG: Starting full primary refresh. [2025-09-29T22:01:43.199707] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-29T22:01:43.468346] [INFO ] [REMOTE ] YSG: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T22:01:43.548135] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-03. [2025-09-29T22:01:44.334132] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-29T22:01:44.348066] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-06. [2025-09-29T22:01:44.527211] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-29T22:01:45.148153] [INFO ] [REMOTE ] YSG: Fetching primary data for 2024-12. [2025-09-29T22:01:45.948163] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-04. [2025-09-29T22:01:46.057004] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-29T22:01:46.136609] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-29T22:01:46.748155] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-01. [2025-09-29T22:01:47.497442] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-29T22:01:47.548111] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-05. [2025-09-29T22:01:47.639134] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-29T22:01:48.348121] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-07. [2025-09-29T22:01:49.154396] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-04. [2025-09-29T22:01:49.161085] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-29T22:01:49.697733] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-29T22:01:49.948122] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-02. [2025-09-29T22:01:50.098721] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-29T22:01:50.711286] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-29T22:01:50.748102] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-06. [2025-09-29T22:01:51.548131] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-08. [2025-09-29T22:01:52.207845] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-29T22:01:52.348111] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-03. [2025-09-29T22:01:53.148124] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-07. [2025-09-29T22:01:53.266256] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-29T22:01:53.377221] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-29T22:01:53.948124] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-05. [2025-09-29T22:01:54.748149] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-04. [2025-09-29T22:01:54.943864] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-29T22:01:54.964363] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-29T22:01:55.548128] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-06. [2025-09-29T22:01:55.728127] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-29T22:01:56.183414] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-29T22:01:56.348136] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-09. [2025-09-29T22:01:57.148110] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-08. [2025-09-29T22:01:57.955771] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-05. [2025-09-29T22:01:57.983794] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-29T22:01:57.995573] [INFO ] [REMOTE ] YOU: Full fetch complete (72055 records). [2025-09-29T22:01:57.995813] [DEBUG] [VALIDATOR ] YOU: Validating primary data. [2025-09-29T22:01:58.418525] [DEBUG] [VALIDATOR ] YOU: All expected trading days are present. [2025-09-29T22:01:58.418610] [DEBUG] [VALIDATOR ] YOU: Primary data validation passed. [2025-09-29T22:01:58.419849] [INFO ] [MAIN ] YOU: Fetched primary data is valid. [2025-09-29T22:01:58.419917] [DEBUG] [LOCAL ] YOU: Saving primary data. [2025-09-29T22:01:58.421263] [DEBUG] [LOCAL ] YOU: Trimmed 72055 records to 49695 (keeping 200 days of data) [2025-09-29T22:01:58.566399] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-29T22:01:58.764615] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-07. [2025-09-29T22:01:58.803636] [DEBUG] [LOCAL ] YOU: Primary data saved (49695 records). [2025-09-29T22:01:58.803810] [INFO ] [MAIN ] YOU: Full history saved. [2025-09-29T22:01:58.803918] [INFO ] [MAIN ] Update Progress: 2352/2371 symbols completed. YOU took 30.5s. Estimated remaining: 2m 26s. Rate: 7.8 symbols/min [2025-09-29T22:01:58.970632] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-29T22:01:59.011572] [INFO ] [MAIN ] YUM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T22:01:59.080931] [DEBUG] [LOCAL ] YUM: Loaded 51931 existing records from primary storage. [2025-09-29T22:01:59.081350] [INFO ] [MAIN ] YUM: Loaded 51931 existing records. [2025-09-29T22:01:59.276506] [WARN ] [MAIN ] YUM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T22:01:59.276758] [INFO ] [MAIN ] YUM: Wiping existing primary data before full refresh. [2025-09-29T22:01:59.276812] [INFO ] [LOCAL ] YUM: Starting deletion of primary data. [2025-09-29T22:01:59.277582] [DEBUG] [LOCAL ] YUM: Deleted primary data file. [2025-09-29T22:01:59.277672] [INFO ] [MAIN ] YUM: Starting full primary refresh. [2025-09-29T22:01:59.549532] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-09. [2025-09-29T22:01:59.605533] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-29T22:01:59.687335] [INFO ] [REMOTE ] YUM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T22:02:00.348112] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-08. [2025-09-29T22:02:01.140833] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-29T22:02:01.151055] [INFO ] [REMOTE ] YUM: Fetching primary data for 2024-12. [2025-09-29T22:02:01.152706] [INFO ] [REMOTE ] YPF: Full fetch complete (73488 records). [2025-09-29T22:02:01.152809] [DEBUG] [VALIDATOR ] YPF: Validating primary data. [2025-09-29T22:02:01.329210] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-29T22:02:01.640047] [DEBUG] [VALIDATOR ] YPF: All expected trading days are present. [2025-09-29T22:02:01.640130] [DEBUG] [VALIDATOR ] YPF: Primary data validation passed. [2025-09-29T22:02:01.641325] [INFO ] [MAIN ] YPF: Fetched primary data is valid. [2025-09-29T22:02:01.641392] [DEBUG] [LOCAL ] YPF: Saving primary data. [2025-09-29T22:02:01.643154] [DEBUG] [LOCAL ] YPF: Trimmed 73488 records to 50484 (keeping 200 days of data) [2025-09-29T22:02:01.954325] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-09. [2025-09-29T22:02:01.997552] [DEBUG] [LOCAL ] YPF: Primary data saved (50484 records). [2025-09-29T22:02:01.997740] [INFO ] [MAIN ] YPF: Full history saved. [2025-09-29T22:02:01.997845] [INFO ] [MAIN ] Update Progress: 2353/2371 symbols completed. YPF took 31.3s. Estimated remaining: 2m 19s. Rate: 7.8 symbols/min [2025-09-29T22:02:02.197689] [INFO ] [MAIN ] YUMC: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T22:02:02.258222] [DEBUG] [LOCAL ] YUMC: Loaded 53455 existing records from primary storage. [2025-09-29T22:02:02.258577] [INFO ] [MAIN ] YUMC: Loaded 53455 existing records. [2025-09-29T22:02:02.499714] [WARN ] [MAIN ] YUMC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T22:02:02.500005] [INFO ] [MAIN ] YUMC: Wiping existing primary data before full refresh. [2025-09-29T22:02:02.500174] [INFO ] [LOCAL ] YUMC: Starting deletion of primary data. [2025-09-29T22:02:02.500871] [DEBUG] [LOCAL ] YUMC: Deleted primary data file. [2025-09-29T22:02:02.500930] [INFO ] [MAIN ] YUMC: Starting full primary refresh. [2025-09-29T22:02:02.759850] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-06. [2025-09-29T22:02:02.738183] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-29T22:02:02.830406] [INFO ] [REMOTE ] YRD: Full fetch complete (19035 records). [2025-09-29T22:02:02.836401] [DEBUG] [VALIDATOR ] YRD: Validating primary data. [2025-09-29T22:02:02.962035] [INFO ] [REMOTE ] YUMC: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T22:02:03.124016] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-29T22:02:03.374099] [DEBUG] [VALIDATOR ] YRD: All expected trading days are present. [2025-09-29T22:02:03.374256] [DEBUG] [VALIDATOR ] YRD: Primary data validation passed. [2025-09-29T22:02:03.374718] [INFO ] [MAIN ] YRD: Fetched primary data is valid. [2025-09-29T22:02:03.374779] [DEBUG] [LOCAL ] YRD: Saving primary data. [2025-09-29T22:02:03.375359] [DEBUG] [LOCAL ] YRD: Trimmed 19035 records to 12556 (keeping 200 days of data) [2025-09-29T22:02:03.449260] [DEBUG] [LOCAL ] YRD: Primary data saved (12556 records). [2025-09-29T22:02:03.449405] [INFO ] [MAIN ] YRD: Full history saved. [2025-09-29T22:02:03.449494] [INFO ] [MAIN ] Update Progress: 2354/2371 symbols completed. YRD took 32.0s. Estimated remaining: 2m 11s. Rate: 7.8 symbols/min [2025-09-29T22:02:03.554284] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-01. [2025-09-29T22:02:03.637970] [INFO ] [MAIN ] ZBH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T22:02:03.708127] [DEBUG] [LOCAL ] ZBH: Loaded 51948 existing records from primary storage. [2025-09-29T22:02:03.708476] [INFO ] [MAIN ] ZBH: Loaded 51948 existing records. [2025-09-29T22:02:03.906625] [WARN ] [MAIN ] ZBH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T22:02:03.906852] [INFO ] [MAIN ] ZBH: Wiping existing primary data before full refresh. [2025-09-29T22:02:03.906902] [INFO ] [LOCAL ] ZBH: Starting deletion of primary data. [2025-09-29T22:02:03.907294] [DEBUG] [LOCAL ] ZBH: Deleted primary data file. [2025-09-29T22:02:03.907355] [INFO ] [MAIN ] ZBH: Starting full primary refresh. [2025-09-29T22:02:04.303675] [INFO ] [REMOTE ] ZBH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T22:02:04.344730] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-29T22:02:04.355206] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2024-12. [2025-09-29T22:02:05.148105] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-07. [2025-09-29T22:02:05.401920] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-29T22:02:05.948081] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2024-12. [2025-09-29T22:02:06.144133] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-29T22:02:06.618796] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-29T22:02:06.748119] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-08. [2025-09-29T22:02:07.548118] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-01. [2025-09-29T22:02:07.661016] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-29T22:02:07.955229] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-29T22:02:08.348134] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-09. [2025-09-29T22:02:09.048698] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-29T22:02:09.148109] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-01. [2025-09-29T22:02:09.398603] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-29T22:02:09.404514] [INFO ] [REMOTE ] YSG: Full fetch complete (32544 records). [2025-09-29T22:02:09.404635] [DEBUG] [VALIDATOR ] YSG: Validating primary data. [2025-09-29T22:02:09.858202] [DEBUG] [VALIDATOR ] YSG: All expected trading days are present. [2025-09-29T22:02:09.858340] [DEBUG] [VALIDATOR ] YSG: Primary data validation passed. [2025-09-29T22:02:09.859227] [INFO ] [MAIN ] YSG: Fetched primary data is valid. [2025-09-29T22:02:09.859310] [DEBUG] [LOCAL ] YSG: Saving primary data. [2025-09-29T22:02:09.861163] [DEBUG] [LOCAL ] YSG: Trimmed 32544 records to 25406 (keeping 200 days of data) [2025-09-29T22:02:09.959417] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-02. [2025-09-29T22:02:10.037001] [DEBUG] [LOCAL ] YSG: Primary data saved (25406 records). [2025-09-29T22:02:10.037197] [INFO ] [MAIN ] YSG: Full history saved. [2025-09-29T22:02:10.037359] [INFO ] [MAIN ] Update Progress: 2355/2371 symbols completed. YSG took 27.4s. Estimated remaining: 2m 3s. Rate: 7.8 symbols/min [2025-09-29T22:02:10.251876] [INFO ] [MAIN ] ZEPP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T22:02:10.272917] [DEBUG] [LOCAL ] ZEPP: Loaded 17335 existing records from primary storage. [2025-09-29T22:02:10.273413] [INFO ] [MAIN ] ZEPP: Loaded 17335 existing records. [2025-09-29T22:02:10.519118] [WARN ] [MAIN ] ZEPP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T22:02:10.519576] [INFO ] [MAIN ] ZEPP: Wiping existing primary data before full refresh. [2025-09-29T22:02:10.519779] [INFO ] [LOCAL ] ZEPP: Starting deletion of primary data. [2025-09-29T22:02:10.520109] [DEBUG] [LOCAL ] ZEPP: Deleted primary data file. [2025-09-29T22:02:10.520176] [INFO ] [MAIN ] ZEPP: Starting full primary refresh. [2025-09-29T22:02:10.765764] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-02. [2025-09-29T22:02:11.013307] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-29T22:02:11.030195] [INFO ] [REMOTE ] ZEPP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T22:02:11.548169] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2024-12. [2025-09-29T22:02:11.786582] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-29T22:02:11.922045] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-09-29T22:02:12.349537] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-03. [2025-09-29T22:02:12.349416] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-29T22:02:13.148200] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-02. [2025-09-29T22:02:13.948141] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-01. [2025-09-29T22:02:14.265794] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-29T22:02:14.436197] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-29T22:02:14.748121] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-04. [2025-09-29T22:02:14.949923] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-29T22:02:15.548175] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-02. [2025-09-29T22:02:15.961853] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-29T22:02:16.348106] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-03. [2025-09-29T22:02:16.783610] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-29T22:02:16.956702] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-29T22:02:17.148133] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-03. [2025-09-29T22:02:17.948163] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-04. [2025-09-29T22:02:18.373173] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-29T22:02:18.748163] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-05. [2025-09-29T22:02:19.044891] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-29T22:02:19.392072] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-29T22:02:19.548125] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-04. [2025-09-29T22:02:20.348160] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-03. [2025-09-29T22:02:21.148105] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-06. [2025-09-29T22:02:21.193365] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-29T22:02:21.769985] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-29T22:02:21.948375] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-05. [2025-09-29T22:02:22.190324] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-29T22:02:22.748184] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-04. [2025-09-29T22:02:23.487007] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-29T22:02:23.548131] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-05. [2025-09-29T22:02:24.348130] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-07. [2025-09-29T22:02:24.699933] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-29T22:02:24.934170] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-29T22:02:25.148166] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-05. [2025-09-29T22:02:25.583810] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-29T22:02:25.948124] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-08. [2025-09-29T22:02:26.748128] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-06. [2025-09-29T22:02:26.856618] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-29T22:02:27.548154] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-06. [2025-09-29T22:02:27.631922] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-29T22:02:28.348173] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-09. [2025-09-29T22:02:28.484121] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-29T22:02:28.988929] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-29T22:02:29.148143] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-07. [2025-09-29T22:02:29.852551] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-29T22:02:29.859770] [INFO ] [REMOTE ] ZEPP: Full fetch complete (18790 records). [2025-09-29T22:02:29.859873] [DEBUG] [VALIDATOR ] ZEPP: Validating primary data. [2025-09-29T22:02:29.953303] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-06. [2025-09-29T22:02:30.267187] [DEBUG] [VALIDATOR ] ZEPP: All expected trading days are present. [2025-09-29T22:02:30.267270] [DEBUG] [VALIDATOR ] ZEPP: Primary data validation passed. [2025-09-29T22:02:30.267754] [INFO ] [MAIN ] ZEPP: Fetched primary data is valid. [2025-09-29T22:02:30.267820] [DEBUG] [LOCAL ] ZEPP: Saving primary data. [2025-09-29T22:02:30.268590] [DEBUG] [LOCAL ] ZEPP: Trimmed 18790 records to 17429 (keeping 200 days of data) [2025-09-29T22:02:30.376923] [DEBUG] [LOCAL ] ZEPP: Primary data saved (17429 records). [2025-09-29T22:02:30.377118] [INFO ] [MAIN ] ZEPP: Full history saved. [2025-09-29T22:02:30.377207] [INFO ] [MAIN ] Update Progress: 2356/2371 symbols completed. ZEPP took 20.3s. Estimated remaining: 1m 56s. Rate: 7.8 symbols/min [2025-09-29T22:02:30.570008] [INFO ] [MAIN ] ZETA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T22:02:30.628755] [DEBUG] [LOCAL ] ZETA: Loaded 54375 existing records from primary storage. [2025-09-29T22:02:30.629121] [INFO ] [MAIN ] ZETA: Loaded 54375 existing records. [2025-09-29T22:02:30.752199] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-07. [2025-09-29T22:02:30.821009] [WARN ] [MAIN ] ZETA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T22:02:30.821282] [INFO ] [MAIN ] ZETA: Wiping existing primary data before full refresh. [2025-09-29T22:02:30.821430] [INFO ] [LOCAL ] ZETA: Starting deletion of primary data. [2025-09-29T22:02:30.821820] [DEBUG] [LOCAL ] ZETA: Deleted primary data file. [2025-09-29T22:02:30.821906] [INFO ] [MAIN ] ZETA: Starting full primary refresh. [2025-09-29T22:02:31.137763] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-29T22:02:31.253822] [INFO ] [REMOTE ] ZETA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T22:02:31.548125] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-08. [2025-09-29T22:02:31.720429] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-29T22:02:32.277329] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-29T22:02:32.348117] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-08. [2025-09-29T22:02:33.104807] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-29T22:02:33.148135] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-09. [2025-09-29T22:02:33.640444] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-29T22:02:33.651076] [INFO ] [REMOTE ] YUM: Full fetch complete (74396 records). [2025-09-29T22:02:33.651296] [DEBUG] [VALIDATOR ] YUM: Validating primary data. [2025-09-29T22:02:33.961382] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-07. [2025-09-29T22:02:34.070632] [DEBUG] [VALIDATOR ] YUM: All expected trading days are present. [2025-09-29T22:02:34.070802] [DEBUG] [VALIDATOR ] YUM: Primary data validation passed. [2025-09-29T22:02:34.072216] [INFO ] [MAIN ] YUM: Fetched primary data is valid. [2025-09-29T22:02:34.072371] [DEBUG] [LOCAL ] YUM: Saving primary data. [2025-09-29T22:02:34.074167] [DEBUG] [LOCAL ] YUM: Trimmed 74396 records to 51166 (keeping 200 days of data) [2025-09-29T22:02:34.208413] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-29T22:02:34.473199] [DEBUG] [LOCAL ] YUM: Primary data saved (51166 records). [2025-09-29T22:02:34.473364] [INFO ] [MAIN ] YUM: Full history saved. [2025-09-29T22:02:34.473461] [INFO ] [MAIN ] Update Progress: 2357/2371 symbols completed. YUM took 35.7s. Estimated remaining: 1m 48s. Rate: 7.8 symbols/min [2025-09-29T22:02:34.748135] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2024-12. [2025-09-29T22:02:35.549101] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-09. [2025-09-29T22:02:35.557981] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-29T22:02:36.348146] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-08. [2025-09-29T22:02:36.898873] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-29T22:02:37.148090] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-09. [2025-09-29T22:02:37.268343] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-09-29T22:02:37.311789] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-29T22:02:37.323254] [INFO ] [REMOTE ] YUMC: Full fetch complete (76164 records). [2025-09-29T22:02:37.323421] [DEBUG] [VALIDATOR ] YUMC: Validating primary data. [2025-09-29T22:02:37.802911] [DEBUG] [VALIDATOR ] YUMC: All expected trading days are present. [2025-09-29T22:02:37.803089] [DEBUG] [VALIDATOR ] YUMC: Primary data validation passed. [2025-09-29T22:02:37.804709] [INFO ] [MAIN ] YUMC: Fetched primary data is valid. [2025-09-29T22:02:37.804806] [DEBUG] [LOCAL ] YUMC: Saving primary data. [2025-09-29T22:02:37.806792] [DEBUG] [LOCAL ] YUMC: Trimmed 76164 records to 52675 (keeping 200 days of data) [2025-09-29T22:02:37.948802] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-01. [2025-09-29T22:02:37.948325] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-29T22:02:37.966481] [INFO ] [REMOTE ] ZBH: Full fetch complete (73869 records). [2025-09-29T22:02:37.973127] [DEBUG] [VALIDATOR ] ZBH: Validating primary data. [2025-09-29T22:02:38.551359] [DEBUG] [VALIDATOR ] ZBH: All expected trading days are present. [2025-09-29T22:02:38.552110] [DEBUG] [VALIDATOR ] ZBH: Primary data validation passed. [2025-09-29T22:02:38.553660] [INFO ] [MAIN ] ZBH: Fetched primary data is valid. [2025-09-29T22:02:38.554077] [DEBUG] [LOCAL ] ZBH: Saving primary data. [2025-09-29T22:02:38.559373] [DEBUG] [LOCAL ] ZBH: Trimmed 73869 records to 51156 (keeping 200 days of data) [2025-09-29T22:02:38.982189] [DEBUG] [LOCAL ] YUMC: Primary data saved (52675 records). [2025-09-29T22:02:38.983267] [INFO ] [MAIN ] YUMC: Full history saved. [2025-09-29T22:02:38.983680] [INFO ] [MAIN ] Update Progress: 2358/2371 symbols completed. YUMC took 37.0s. Estimated remaining: 1m 40s. Rate: 7.8 symbols/min [2025-09-29T22:02:38.996390] [DEBUG] [LOCAL ] ZBH: Primary data saved (51156 records). [2025-09-29T22:02:38.996539] [INFO ] [MAIN ] ZBH: Full history saved. [2025-09-29T22:02:38.996627] [INFO ] [MAIN ] Update Progress: 2359/2371 symbols completed. ZBH took 35.5s. Estimated remaining: 1m 32s. Rate: 7.8 symbols/min [2025-09-29T22:02:40.088026] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-09-29T22:02:40.099512] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-02. [2025-09-29T22:02:42.522143] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-09-29T22:02:42.533626] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-03. [2025-09-29T22:02:44.752683] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-29T22:02:44.764556] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-04. [2025-09-29T22:02:46.872537] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-29T22:02:46.884180] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-05. [2025-09-29T22:02:48.887194] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-29T22:02:48.900384] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-06. [2025-09-29T22:02:51.215569] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-09-29T22:02:51.227516] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-07. [2025-09-29T22:02:53.818785] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-09-29T22:02:53.831014] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-08. [2025-09-29T22:02:56.258887] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-09-29T22:02:56.271468] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-09. [2025-09-29T22:02:58.552963] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-29T22:02:58.564171] [INFO ] [REMOTE ] ZETA: Full fetch complete (77678 records). [2025-09-29T22:02:58.564319] [DEBUG] [VALIDATOR ] ZETA: Validating primary data. [2025-09-29T22:02:59.001888] [DEBUG] [VALIDATOR ] ZETA: All expected trading days are present. [2025-09-29T22:02:59.002081] [DEBUG] [VALIDATOR ] ZETA: Primary data validation passed. [2025-09-29T22:02:59.003921] [INFO ] [MAIN ] ZETA: Fetched primary data is valid. [2025-09-29T22:02:59.004040] [DEBUG] [LOCAL ] ZETA: Saving primary data. [2025-09-29T22:02:59.005890] [DEBUG] [LOCAL ] ZETA: Trimmed 77678 records to 53595 (keeping 200 days of data) [2025-09-29T22:02:59.362193] [DEBUG] [LOCAL ] ZETA: Primary data saved (53595 records). [2025-09-29T22:02:59.362341] [INFO ] [MAIN ] ZETA: Full history saved. [2025-09-29T22:02:59.362480] [INFO ] [MAIN ] Update Progress: 2360/2371 symbols completed. ZETA took 29.0s. Estimated remaining: 1m 25s. Rate: 7.8 symbols/min [2025-09-29T22:03:00.011746] [INFO ] [MAIN ] ZGN: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T22:03:00.100061] [INFO ] [MAIN ] ZIM: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T22:03:00.162793] [INFO ] [MAIN ] ZH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T22:03:00.186222] [INFO ] [MAIN ] ZIP: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T22:03:00.258575] [DEBUG] [LOCAL ] ZH: Loaded 27298 existing records from primary storage. [2025-09-29T22:03:00.259879] [DEBUG] [LOCAL ] ZGN: Loaded 41333 existing records from primary storage. [2025-09-29T22:03:00.259208] [INFO ] [MAIN ] ZH: Loaded 27298 existing records. [2025-09-29T22:03:00.300973] [INFO ] [MAIN ] ZGN: Loaded 41333 existing records. [2025-09-29T22:03:00.519225] [DEBUG] [LOCAL ] ZIP: Loaded 44952 existing records from primary storage. [2025-09-29T22:03:00.567436] [INFO ] [MAIN ] ZIP: Loaded 44952 existing records. [2025-09-29T22:03:00.551196] [DEBUG] [LOCAL ] ZIM: Loaded 54298 existing records from primary storage. [2025-09-29T22:03:00.656760] [INFO ] [MAIN ] ZIM: Loaded 54298 existing records. [2025-09-29T22:03:00.752661] [WARN ] [MAIN ] ZH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T22:03:00.847163] [WARN ] [MAIN ] ZGN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T22:03:00.863207] [INFO ] [MAIN ] ZGN: Wiping existing primary data before full refresh. [2025-09-29T22:03:00.863344] [INFO ] [LOCAL ] ZGN: Starting deletion of primary data. [2025-09-29T22:03:00.863461] [INFO ] [MAIN ] ZH: Wiping existing primary data before full refresh. [2025-09-29T22:03:00.884786] [DEBUG] [LOCAL ] ZGN: Deleted primary data file. [2025-09-29T22:03:00.884923] [INFO ] [MAIN ] ZGN: Starting full primary refresh. [2025-09-29T22:03:00.890187] [INFO ] [LOCAL ] ZH: Starting deletion of primary data. [2025-09-29T22:03:00.981930] [DEBUG] [LOCAL ] ZH: Deleted primary data file. [2025-09-29T22:03:01.007838] [INFO ] [MAIN ] ZH: Starting full primary refresh. [2025-09-29T22:03:01.153276] [WARN ] [MAIN ] ZIP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T22:03:01.250456] [INFO ] [MAIN ] ZIP: Wiping existing primary data before full refresh. [2025-09-29T22:03:01.279467] [INFO ] [LOCAL ] ZIP: Starting deletion of primary data. [2025-09-29T22:03:01.355779] [DEBUG] [LOCAL ] ZIP: Deleted primary data file. [2025-09-29T22:03:01.356807] [INFO ] [MAIN ] ZIP: Starting full primary refresh. [2025-09-29T22:03:01.392849] [WARN ] [MAIN ] ZIM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T22:03:01.463454] [INFO ] [MAIN ] ZIM: Wiping existing primary data before full refresh. [2025-09-29T22:03:01.620408] [INFO ] [LOCAL ] ZIM: Starting deletion of primary data. [2025-09-29T22:03:01.669812] [DEBUG] [LOCAL ] ZIM: Deleted primary data file. [2025-09-29T22:03:01.669948] [INFO ] [MAIN ] ZIM: Starting full primary refresh. [2025-09-29T22:03:02.372809] [INFO ] [REMOTE ] ZH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T22:03:02.446066] [INFO ] [REMOTE ] ZH: Fetching primary data for 2024-12. [2025-09-29T22:03:02.609358] [INFO ] [REMOTE ] ZGN: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T22:03:02.614997] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2024-12. [2025-09-29T22:03:02.823079] [INFO ] [REMOTE ] ZIP: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T22:03:02.841026] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2024-12. [2025-09-29T22:03:02.883801] [INFO ] [REMOTE ] ZIM: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T22:03:02.884149] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2024-12. [2025-09-29T22:03:03.625808] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-29T22:03:03.631187] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-01. [2025-09-29T22:03:03.728404] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-29T22:03:03.737277] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-01. [2025-09-29T22:03:04.175562] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-29T22:03:04.182464] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-01. [2025-09-29T22:03:04.388698] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-29T22:03:04.400478] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-01. [2025-09-29T22:03:04.649782] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-29T22:03:04.654385] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-02. [2025-09-29T22:03:04.792789] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-29T22:03:04.801439] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-02. [2025-09-29T22:03:05.521143] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-29T22:03:05.527474] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-02. [2025-09-29T22:03:05.806086] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-29T22:03:05.814027] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-03. [2025-09-29T22:03:05.894984] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-29T22:03:05.904053] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-03. [2025-09-29T22:03:06.672896] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-09-29T22:03:06.685094] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-29T22:03:06.693520] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-03. [2025-09-29T22:03:06.693174] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-02. [2025-09-29T22:03:07.168611] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-29T22:03:07.178771] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-04. [2025-09-29T22:03:07.246857] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-29T22:03:07.255674] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-04. [2025-09-29T22:03:08.179683] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-29T22:03:08.190632] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-04. [2025-09-29T22:03:08.350345] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-29T22:03:08.357913] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-05. [2025-09-29T22:03:08.506490] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-29T22:03:08.546796] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-05. [2025-09-29T22:03:08.550065] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-29T22:03:08.561433] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-03. [2025-09-29T22:03:09.413464] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-29T22:03:09.418309] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-06. [2025-09-29T22:03:09.524412] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-29T22:03:09.534928] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-05. [2025-09-29T22:03:09.948926] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-29T22:03:09.958143] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-06. [2025-09-29T22:03:10.504377] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-29T22:03:10.510562] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-07. [2025-09-29T22:03:10.562000] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-29T22:03:10.573885] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-04. [2025-09-29T22:03:11.013744] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-29T22:03:11.023965] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-06. [2025-09-29T22:03:11.392940] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-29T22:03:11.402216] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-07. [2025-09-29T22:03:11.557323] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-29T22:03:11.564123] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-08. [2025-09-29T22:03:12.388688] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-29T22:03:12.398441] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-07. [2025-09-29T22:03:12.470908] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-29T22:03:12.476577] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-09. [2025-09-29T22:03:12.833292] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-29T22:03:12.843335] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-08. [2025-09-29T22:03:12.913380] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-29T22:03:12.924823] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-05. [2025-09-29T22:03:13.664015] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-29T22:03:13.670904] [INFO ] [REMOTE ] ZH: Full fetch complete (40199 records). [2025-09-29T22:03:13.671065] [DEBUG] [VALIDATOR ] ZH: Validating primary data. [2025-09-29T22:03:14.114220] [DEBUG] [VALIDATOR ] ZH: All expected trading days are present. [2025-09-29T22:03:14.114480] [DEBUG] [VALIDATOR ] ZH: Primary data validation passed. [2025-09-29T22:03:14.115521] [INFO ] [MAIN ] ZH: Fetched primary data is valid. [2025-09-29T22:03:14.118347] [DEBUG] [LOCAL ] ZH: Saving primary data. [2025-09-29T22:03:14.120892] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-29T22:03:14.130488] [DEBUG] [LOCAL ] ZH: Trimmed 40199 records to 26791 (keeping 200 days of data) [2025-09-29T22:03:14.131014] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-08. [2025-09-29T22:03:14.260765] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-29T22:03:14.273038] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-09. [2025-09-29T22:03:14.320885] [DEBUG] [LOCAL ] ZH: Primary data saved (26791 records). [2025-09-29T22:03:14.321005] [INFO ] [MAIN ] ZH: Full history saved. [2025-09-29T22:03:14.321133] [INFO ] [MAIN ] Update Progress: 2361/2371 symbols completed. ZH took 15.0s. Estimated remaining: 1m 17s. Rate: 7.8 symbols/min [2025-09-29T22:03:14.493753] [INFO ] [MAIN ] ZK: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T22:03:14.541453] [DEBUG] [LOCAL ] ZK: Loaded 40504 existing records from primary storage. [2025-09-29T22:03:14.541833] [INFO ] [MAIN ] ZK: Loaded 40504 existing records. [2025-09-29T22:03:14.730214] [WARN ] [MAIN ] ZK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T22:03:14.730453] [INFO ] [MAIN ] ZK: Wiping existing primary data before full refresh. [2025-09-29T22:03:14.730508] [INFO ] [LOCAL ] ZK: Starting deletion of primary data. [2025-09-29T22:03:14.731012] [DEBUG] [LOCAL ] ZK: Deleted primary data file. [2025-09-29T22:03:14.731072] [INFO ] [MAIN ] ZK: Starting full primary refresh. [2025-09-29T22:03:15.107767] [INFO ] [REMOTE ] ZK: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T22:03:15.108334] [INFO ] [REMOTE ] ZK: Fetching primary data for 2024-12. [2025-09-29T22:03:15.183090] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-29T22:03:15.194922] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-06. [2025-09-29T22:03:15.529022] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-29T22:03:15.538039] [INFO ] [REMOTE ] ZGN: Full fetch complete (58144 records). [2025-09-29T22:03:15.538173] [DEBUG] [VALIDATOR ] ZGN: Validating primary data. [2025-09-29T22:03:15.876509] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-29T22:03:15.900199] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-09. [2025-09-29T22:03:15.985320] [DEBUG] [VALIDATOR ] ZGN: All expected trading days are present. [2025-09-29T22:03:15.985407] [DEBUG] [VALIDATOR ] ZGN: Primary data validation passed. [2025-09-29T22:03:15.986483] [INFO ] [MAIN ] ZGN: Fetched primary data is valid. [2025-09-29T22:03:15.986547] [DEBUG] [LOCAL ] ZGN: Saving primary data. [2025-09-29T22:03:15.987791] [DEBUG] [LOCAL ] ZGN: Trimmed 58144 records to 40692 (keeping 200 days of data) [2025-09-29T22:03:16.233218] [DEBUG] [LOCAL ] ZGN: Primary data saved (40692 records). [2025-09-29T22:03:16.233351] [INFO ] [MAIN ] ZGN: Full history saved. [2025-09-29T22:03:16.233435] [INFO ] [MAIN ] Update Progress: 2362/2371 symbols completed. ZGN took 16.9s. Estimated remaining: 1m 9s. Rate: 7.8 symbols/min [2025-09-29T22:03:16.414789] [INFO ] [MAIN ] ZKH: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T22:03:16.426096] [DEBUG] [LOCAL ] ZKH: Loaded 8119 existing records from primary storage. [2025-09-29T22:03:16.426315] [INFO ] [MAIN ] ZKH: Loaded 8119 existing records. [2025-09-29T22:03:16.622986] [WARN ] [MAIN ] ZKH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T22:03:16.623419] [INFO ] [MAIN ] ZKH: Wiping existing primary data before full refresh. [2025-09-29T22:03:16.623519] [INFO ] [LOCAL ] ZKH: Starting deletion of primary data. [2025-09-29T22:03:16.623948] [DEBUG] [LOCAL ] ZKH: Deleted primary data file. [2025-09-29T22:03:16.624016] [INFO ] [MAIN ] ZKH: Starting full primary refresh. [2025-09-29T22:03:16.949187] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-29T22:03:16.974534] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-01. [2025-09-29T22:03:17.044317] [INFO ] [REMOTE ] ZKH: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T22:03:17.044784] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2024-12. [2025-09-29T22:03:17.177716] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-29T22:03:17.190141] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-07. [2025-09-29T22:03:17.278909] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-29T22:03:17.291011] [INFO ] [REMOTE ] ZIP: Full fetch complete (59431 records). [2025-09-29T22:03:17.291190] [DEBUG] [VALIDATOR ] ZIP: Validating primary data. [2025-09-29T22:03:17.651080] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-29T22:03:17.752214] [DEBUG] [VALIDATOR ] ZIP: All expected trading days are present. [2025-09-29T22:03:17.752318] [DEBUG] [VALIDATOR ] ZIP: Primary data validation passed. [2025-09-29T22:03:17.753620] [INFO ] [MAIN ] ZIP: Fetched primary data is valid. [2025-09-29T22:03:17.753718] [DEBUG] [LOCAL ] ZIP: Saving primary data. [2025-09-29T22:03:17.755094] [DEBUG] [LOCAL ] ZIP: Trimmed 59431 records to 44171 (keeping 200 days of data) [2025-09-29T22:03:17.948634] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-01. [2025-09-29T22:03:18.009349] [DEBUG] [LOCAL ] ZIP: Primary data saved (44171 records). [2025-09-29T22:03:18.009551] [INFO ] [MAIN ] ZIP: Full history saved. [2025-09-29T22:03:18.009749] [INFO ] [MAIN ] Update Progress: 2363/2371 symbols completed. ZIP took 18.6s. Estimated remaining: 1m 2s. Rate: 7.8 symbols/min [2025-09-29T22:03:18.212355] [INFO ] [MAIN ] ZTO: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T22:03:18.270959] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-29T22:03:18.295993] [DEBUG] [LOCAL ] ZTO: Loaded 50751 existing records from primary storage. [2025-09-29T22:03:18.296349] [INFO ] [MAIN ] ZTO: Loaded 50751 existing records. [2025-09-29T22:03:18.479190] [WARN ] [MAIN ] ZTO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T22:03:18.479416] [INFO ] [MAIN ] ZTO: Wiping existing primary data before full refresh. [2025-09-29T22:03:18.479465] [INFO ] [LOCAL ] ZTO: Starting deletion of primary data. [2025-09-29T22:03:18.480007] [DEBUG] [LOCAL ] ZTO: Deleted primary data file. [2025-09-29T22:03:18.480071] [INFO ] [MAIN ] ZTO: Starting full primary refresh. [2025-09-29T22:03:18.589199] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-29T22:03:18.753204] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-02. [2025-09-29T22:03:18.853933] [INFO ] [REMOTE ] ZTO: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T22:03:19.355625] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-29T22:03:19.548115] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-08. [2025-09-29T22:03:20.354721] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-02. [2025-09-29T22:03:20.359730] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-29T22:03:21.151067] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-03. [2025-09-29T22:03:21.151933] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-29T22:03:21.511631] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-29T22:03:21.948118] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2024-12. [2025-09-29T22:03:22.753216] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-03. [2025-09-29T22:03:22.760660] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-29T22:03:23.556485] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-29T22:03:23.555146] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-09. [2025-09-29T22:03:23.808030] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-29T22:03:24.348111] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-04. [2025-09-29T22:03:24.869263] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-29T22:03:25.148109] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-05. [2025-09-29T22:03:25.361299] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-29T22:03:25.372558] [INFO ] [REMOTE ] ZIM: Full fetch complete (77497 records). [2025-09-29T22:03:25.372741] [DEBUG] [VALIDATOR ] ZIM: Validating primary data. [2025-09-29T22:03:25.768247] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-29T22:03:25.793802] [DEBUG] [VALIDATOR ] ZIM: All expected trading days are present. [2025-09-29T22:03:25.794199] [DEBUG] [VALIDATOR ] ZIM: Primary data validation passed. [2025-09-29T22:03:25.795457] [INFO ] [MAIN ] ZIM: Fetched primary data is valid. [2025-09-29T22:03:25.795523] [DEBUG] [LOCAL ] ZIM: Saving primary data. [2025-09-29T22:03:25.796932] [DEBUG] [LOCAL ] ZIM: Trimmed 77497 records to 53516 (keeping 200 days of data) [2025-09-29T22:03:26.000399] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-01. [2025-09-29T22:03:26.168746] [DEBUG] [LOCAL ] ZIM: Primary data saved (53516 records). [2025-09-29T22:03:26.168896] [INFO ] [MAIN ] ZIM: Full history saved. [2025-09-29T22:03:26.168987] [INFO ] [MAIN ] Update Progress: 2364/2371 symbols completed. ZIM took 26.8s. Estimated remaining: 53.9s. Rate: 7.8 symbols/min [2025-09-29T22:03:26.351727] [INFO ] [MAIN ] ZTR: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T22:03:26.371454] [DEBUG] [LOCAL ] ZTR: Loaded 16911 existing records from primary storage. [2025-09-29T22:03:26.371845] [INFO ] [MAIN ] ZTR: Loaded 16911 existing records. [2025-09-29T22:03:26.554696] [WARN ] [MAIN ] ZTR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T22:03:26.554964] [INFO ] [MAIN ] ZTR: Wiping existing primary data before full refresh. [2025-09-29T22:03:26.555012] [INFO ] [LOCAL ] ZTR: Starting deletion of primary data. [2025-09-29T22:03:26.555287] [DEBUG] [LOCAL ] ZTR: Deleted primary data file. [2025-09-29T22:03:26.555368] [INFO ] [MAIN ] ZTR: Starting full primary refresh. [2025-09-29T22:03:26.757857] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-04. [2025-09-29T22:03:26.935703] [INFO ] [REMOTE ] ZTR: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T22:03:27.544620] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-29T22:03:27.554209] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-06. [2025-09-29T22:03:28.130948] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-29T22:03:28.317163] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-29T22:03:28.348074] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-05. [2025-09-29T22:03:29.148119] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-02. [2025-09-29T22:03:29.739711] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-29T22:03:29.948114] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2024-12. [2025-09-29T22:03:30.753578] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-06. [2025-09-29T22:03:30.759537] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-29T22:03:30.790105] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-29T22:03:31.548137] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-03. [2025-09-29T22:03:32.162524] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-29T22:03:32.348120] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-07. [2025-09-29T22:03:33.148138] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-07. [2025-09-29T22:03:33.411178] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-29T22:03:33.447409] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-29T22:03:33.948170] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-01. [2025-09-29T22:03:34.205296] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-29T22:03:34.748120] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-08. [2025-09-29T22:03:34.953790] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-29T22:03:35.548156] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-08. [2025-09-29T22:03:36.086582] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-29T22:03:36.102721] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-29T22:03:36.348107] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-09. [2025-09-29T22:03:36.707839] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-29T22:03:36.710267] [INFO ] [REMOTE ] ZKH: Full fetch complete (11850 records). [2025-09-29T22:03:36.710381] [DEBUG] [VALIDATOR ] ZKH: Validating primary data. [2025-09-29T22:03:37.100201] [DEBUG] [VALIDATOR ] ZKH: All expected trading days are present. [2025-09-29T22:03:37.100304] [DEBUG] [VALIDATOR ] ZKH: Primary data validation passed. [2025-09-29T22:03:37.100638] [INFO ] [MAIN ] ZKH: Fetched primary data is valid. [2025-09-29T22:03:37.100740] [DEBUG] [LOCAL ] ZKH: Saving primary data. [2025-09-29T22:03:37.101230] [DEBUG] [LOCAL ] ZKH: Trimmed 11850 records to 7929 (keeping 200 days of data) [2025-09-29T22:03:37.147565] [DEBUG] [LOCAL ] ZKH: Primary data saved (7929 records). [2025-09-29T22:03:37.147739] [INFO ] [MAIN ] ZKH: Full history saved. [2025-09-29T22:03:37.147913] [INFO ] [MAIN ] Update Progress: 2365/2371 symbols completed. ZKH took 20.9s. Estimated remaining: 46.2s. Rate: 7.8 symbols/min [2025-09-29T22:03:37.153342] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-02. [2025-09-29T22:03:37.331662] [INFO ] [MAIN ] ZTS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T22:03:37.395717] [DEBUG] [LOCAL ] ZTS: Loaded 53775 existing records from primary storage. [2025-09-29T22:03:37.396069] [INFO ] [MAIN ] ZTS: Loaded 53775 existing records. [2025-09-29T22:03:37.587266] [WARN ] [MAIN ] ZTS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T22:03:37.587515] [INFO ] [MAIN ] ZTS: Wiping existing primary data before full refresh. [2025-09-29T22:03:37.587584] [INFO ] [LOCAL ] ZTS: Starting deletion of primary data. [2025-09-29T22:03:37.588281] [DEBUG] [LOCAL ] ZTS: Deleted primary data file. [2025-09-29T22:03:37.588360] [INFO ] [MAIN ] ZTS: Starting full primary refresh. [2025-09-29T22:03:37.962435] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-09. [2025-09-29T22:03:37.969813] [INFO ] [REMOTE ] ZTS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T22:03:38.358497] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-29T22:03:38.748136] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2024-12. [2025-09-29T22:03:39.262825] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-29T22:03:39.271630] [INFO ] [REMOTE ] ZK: Full fetch complete (57140 records). [2025-09-29T22:03:39.271795] [DEBUG] [VALIDATOR ] ZK: Validating primary data. [2025-09-29T22:03:39.553257] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-04. [2025-09-29T22:03:39.672542] [DEBUG] [VALIDATOR ] ZK: All expected trading days are present. [2025-09-29T22:03:39.672631] [DEBUG] [VALIDATOR ] ZK: Primary data validation passed. [2025-09-29T22:03:39.674056] [INFO ] [MAIN ] ZK: Fetched primary data is valid. [2025-09-29T22:03:39.674126] [DEBUG] [LOCAL ] ZK: Saving primary data. [2025-09-29T22:03:39.675468] [DEBUG] [LOCAL ] ZK: Trimmed 57140 records to 39661 (keeping 200 days of data) [2025-09-29T22:03:39.929313] [DEBUG] [LOCAL ] ZK: Primary data saved (39661 records). [2025-09-29T22:03:39.929460] [INFO ] [MAIN ] ZK: Full history saved. [2025-09-29T22:03:39.929548] [INFO ] [MAIN ] Update Progress: 2366/2371 symbols completed. ZK took 25.6s. Estimated remaining: 38.5s. Rate: 7.8 symbols/min [2025-09-29T22:03:40.106125] [INFO ] [MAIN ] ZVIA: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T22:03:40.145836] [DEBUG] [LOCAL ] ZVIA: Loaded 35966 existing records from primary storage. [2025-09-29T22:03:40.146150] [INFO ] [MAIN ] ZVIA: Loaded 35966 existing records. [2025-09-29T22:03:40.355055] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-03. [2025-09-29T22:03:40.362233] [WARN ] [MAIN ] ZVIA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T22:03:40.364271] [INFO ] [MAIN ] ZVIA: Wiping existing primary data before full refresh. [2025-09-29T22:03:40.364451] [INFO ] [LOCAL ] ZVIA: Starting deletion of primary data. [2025-09-29T22:03:40.365010] [DEBUG] [LOCAL ] ZVIA: Deleted primary data file. [2025-09-29T22:03:40.365075] [INFO ] [MAIN ] ZVIA: Starting full primary refresh. [2025-09-29T22:03:40.762313] [INFO ] [REMOTE ] ZVIA: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T22:03:40.796737] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-29T22:03:41.148104] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2024-12. [2025-09-29T22:03:41.332232] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-29T22:03:41.467892] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-29T22:03:41.948147] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-04. [2025-09-29T22:03:42.487487] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-29T22:03:42.748089] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-01. [2025-09-29T22:03:42.780915] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-29T22:03:43.548156] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-05. [2025-09-29T22:03:44.354284] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-01. [2025-09-29T22:03:44.368062] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-29T22:03:45.148113] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-02. [2025-09-29T22:03:45.222888] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-29T22:03:45.533140] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-29T22:03:45.948117] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-06. [2025-09-29T22:03:46.748155] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-05. [2025-09-29T22:03:47.040581] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-29T22:03:47.387254] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-29T22:03:47.548166] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-02. [2025-09-29T22:03:47.650958] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-29T22:03:48.348160] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-03. [2025-09-29T22:03:48.786149] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-29T22:03:49.148116] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-07. [2025-09-29T22:03:49.948105] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-03. [2025-09-29T22:03:50.300142] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-29T22:03:50.748129] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-04. [2025-09-29T22:03:50.932682] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-29T22:03:51.479412] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-29T22:03:51.548139] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-08. [2025-09-29T22:03:52.348129] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-04. [2025-09-29T22:03:52.686975] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-29T22:03:53.116200] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-29T22:03:53.148074] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-09. [2025-09-29T22:03:53.643930] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-29T22:03:53.948120] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-05. [2025-09-29T22:03:54.533245] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-29T22:03:54.543963] [INFO ] [REMOTE ] ZTO: Full fetch complete (73120 records). [2025-09-29T22:03:54.544139] [DEBUG] [VALIDATOR ] ZTO: Validating primary data. [2025-09-29T22:03:54.753286] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-05. [2025-09-29T22:03:54.958691] [DEBUG] [VALIDATOR ] ZTO: All expected trading days are present. [2025-09-29T22:03:54.958820] [DEBUG] [VALIDATOR ] ZTO: Primary data validation passed. [2025-09-29T22:03:54.960073] [INFO ] [MAIN ] ZTO: Fetched primary data is valid. [2025-09-29T22:03:54.960152] [DEBUG] [LOCAL ] ZTO: Saving primary data. [2025-09-29T22:03:54.961566] [DEBUG] [LOCAL ] ZTO: Trimmed 73120 records to 49966 (keeping 200 days of data) [2025-09-29T22:03:55.309457] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-29T22:03:55.309593] [DEBUG] [LOCAL ] ZTO: Primary data saved (49966 records). [2025-09-29T22:03:55.317678] [INFO ] [MAIN ] ZTO: Full history saved. [2025-09-29T22:03:55.318152] [INFO ] [MAIN ] Update Progress: 2367/2371 symbols completed. ZTO took 37.3s. Estimated remaining: 30.8s. Rate: 7.8 symbols/min [2025-09-29T22:03:55.533306] [INFO ] [MAIN ] ZWS: Starting incremental primary update from 2025-09-19 to 2025-09-29. [2025-09-29T22:03:55.548140] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-06. [2025-09-29T22:03:55.580783] [DEBUG] [LOCAL ] ZWS: Loaded 43134 existing records from primary storage. [2025-09-29T22:03:55.581149] [INFO ] [MAIN ] ZWS: Loaded 43134 existing records. [2025-09-29T22:03:55.773861] [WARN ] [MAIN ] ZWS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-10 for 200 day retention. Performing full refresh. [2025-09-29T22:03:55.774113] [INFO ] [MAIN ] ZWS: Wiping existing primary data before full refresh. [2025-09-29T22:03:55.774171] [INFO ] [LOCAL ] ZWS: Starting deletion of primary data. [2025-09-29T22:03:55.774539] [DEBUG] [LOCAL ] ZWS: Deleted primary data file. [2025-09-29T22:03:55.774597] [INFO ] [MAIN ] ZWS: Starting full primary refresh. [2025-09-29T22:03:56.189820] [INFO ] [REMOTE ] ZWS: Fetching primary data covering 200 trading days from 2024-12-10 to 2025-09-29 (requires 10 months of data pull). [2025-09-29T22:03:56.348088] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-06. [2025-09-29T22:03:56.746233] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-29T22:03:56.953723] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-29T22:03:57.148077] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-06. [2025-09-29T22:03:57.300771] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-29T22:03:57.948110] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-07. [2025-09-29T22:03:58.748106] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2024-12. [2025-09-29T22:03:58.854131] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-29T22:03:58.971603] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-29T22:03:59.548136] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-07. [2025-09-29T22:04:00.313920] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-29T22:04:00.348134] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-08. [2025-09-29T22:04:00.523835] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-29T22:04:01.148098] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-01. [2025-09-29T22:04:01.243145] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-29T22:04:01.948112] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-07. [2025-09-29T22:04:02.730259] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-29T22:04:02.748082] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-02. [2025-09-29T22:04:03.548120] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-08. [2025-09-29T22:04:03.890026] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-29T22:04:04.348122] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-08. [2025-09-29T22:04:04.350602] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-29T22:04:05.106881] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-29T22:04:05.148101] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-09. [2025-09-29T22:04:05.948120] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-03. [2025-09-29T22:04:06.254792] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-29T22:04:06.309039] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-29T22:04:06.317084] [INFO ] [REMOTE ] ZVIA: Full fetch complete (52596 records). [2025-09-29T22:04:06.317199] [DEBUG] [VALIDATOR ] ZVIA: Validating primary data. [2025-09-29T22:04:06.726013] [DEBUG] [VALIDATOR ] ZVIA: All expected trading days are present. [2025-09-29T22:04:06.726137] [DEBUG] [VALIDATOR ] ZVIA: Primary data validation passed. [2025-09-29T22:04:06.727369] [INFO ] [MAIN ] ZVIA: Fetched primary data is valid. [2025-09-29T22:04:06.727449] [DEBUG] [LOCAL ] ZVIA: Saving primary data. [2025-09-29T22:04:06.728747] [DEBUG] [LOCAL ] ZVIA: Trimmed 52596 records to 35419 (keeping 200 days of data) [2025-09-29T22:04:06.775338] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-09. [2025-09-29T22:04:06.949592] [DEBUG] [LOCAL ] ZVIA: Primary data saved (35419 records). [2025-09-29T22:04:06.949782] [INFO ] [MAIN ] ZVIA: Full history saved. [2025-09-29T22:04:06.949882] [INFO ] [MAIN ] Update Progress: 2368/2371 symbols completed. ZVIA took 27.0s. Estimated remaining: 23.1s. Rate: 7.8 symbols/min [2025-09-29T22:04:07.261499] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-29T22:04:07.417759] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-29T22:04:07.421633] [INFO ] [REMOTE ] ZTR: Full fetch complete (26803 records). [2025-09-29T22:04:07.421808] [DEBUG] [VALIDATOR ] ZTR: Validating primary data. [2025-09-29T22:04:07.553238] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-09. [2025-09-29T22:04:07.836492] [DEBUG] [VALIDATOR ] ZTR: All expected trading days are present. [2025-09-29T22:04:07.836575] [DEBUG] [VALIDATOR ] ZTR: Primary data validation passed. [2025-09-29T22:04:07.837302] [INFO ] [MAIN ] ZTR: Fetched primary data is valid. [2025-09-29T22:04:07.837367] [DEBUG] [LOCAL ] ZTR: Saving primary data. [2025-09-29T22:04:07.838152] [DEBUG] [LOCAL ] ZTR: Trimmed 26803 records to 16651 (keeping 200 days of data) [2025-09-29T22:04:07.941293] [DEBUG] [LOCAL ] ZTR: Primary data saved (16651 records). [2025-09-29T22:04:07.941449] [INFO ] [MAIN ] ZTR: Full history saved. [2025-09-29T22:04:07.941548] [INFO ] [MAIN ] Update Progress: 2369/2371 symbols completed. ZTR took 41.8s. Estimated remaining: 15.4s. Rate: 7.8 symbols/min [2025-09-29T22:04:08.217055] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-29T22:04:08.228245] [INFO ] [REMOTE ] ZTS: Full fetch complete (76690 records). [2025-09-29T22:04:08.228444] [DEBUG] [VALIDATOR ] ZTS: Validating primary data. [2025-09-29T22:04:08.355710] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-04. [2025-09-29T22:04:08.648293] [DEBUG] [VALIDATOR ] ZTS: All expected trading days are present. [2025-09-29T22:04:08.648397] [DEBUG] [VALIDATOR ] ZTS: Primary data validation passed. [2025-09-29T22:04:08.649772] [INFO ] [MAIN ] ZTS: Fetched primary data is valid. [2025-09-29T22:04:08.649843] [DEBUG] [LOCAL ] ZTS: Saving primary data. [2025-09-29T22:04:08.651442] [DEBUG] [LOCAL ] ZTS: Trimmed 76690 records to 52993 (keeping 200 days of data) [2025-09-29T22:04:09.007737] [DEBUG] [LOCAL ] ZTS: Primary data saved (52993 records). [2025-09-29T22:04:09.007887] [INFO ] [MAIN ] ZTS: Full history saved. [2025-09-29T22:04:09.007972] [INFO ] [MAIN ] Update Progress: 2370/2371 symbols completed. ZTS took 31.9s. Estimated remaining: 7.7s. Rate: 7.8 symbols/min [2025-09-29T22:04:10.124373] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-29T22:04:10.135275] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-05. [2025-09-29T22:04:11.701748] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-29T22:04:11.712055] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-06. [2025-09-29T22:04:13.147200] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-29T22:04:13.155034] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-07. [2025-09-29T22:04:14.634348] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-29T22:04:14.645194] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-08. [2025-09-29T22:04:16.268457] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-29T22:04:16.278725] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-09. [2025-09-29T22:04:17.624580] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-29T22:04:17.633638] [INFO ] [REMOTE ] ZWS: Full fetch complete (62043 records). [2025-09-29T22:04:17.633810] [DEBUG] [VALIDATOR ] ZWS: Validating primary data. [2025-09-29T22:04:18.041575] [DEBUG] [VALIDATOR ] ZWS: All expected trading days are present. [2025-09-29T22:04:18.041728] [DEBUG] [VALIDATOR ] ZWS: Primary data validation passed. [2025-09-29T22:04:18.042845] [INFO ] [MAIN ] ZWS: Fetched primary data is valid. [2025-09-29T22:04:18.042909] [DEBUG] [LOCAL ] ZWS: Saving primary data. [2025-09-29T22:04:18.044158] [DEBUG] [LOCAL ] ZWS: Trimmed 62043 records to 42344 (keeping 200 days of data) [2025-09-29T22:04:18.320795] [DEBUG] [LOCAL ] ZWS: Primary data saved (42344 records). [2025-09-29T22:04:18.320933] [INFO ] [MAIN ] ZWS: Full history saved. [2025-09-29T22:04:18.321032] [INFO ] [MAIN ] Update Progress: 2371/2371 symbols completed. ZWS took 23.0s. Estimated remaining: 0.0s. Rate: 7.8 symbols/min [2025-09-29T22:04:18.322335] [INFO ] [MAIN ] Parallel update completed in 5h 4m 15s [2025-09-29T22:04:18.322461] [WARN ] [MAIN ] Failed symbols (314): AAMI, AAM, A, AAP, AAUC, AA, ABG, ACEL, ACP, AD... [2025-09-29T22:04:18.322559] [INFO ] [MAIN ] Update success rate: 86.8% (2057/2371 symbols) [2025-09-29T22:04:19.056580] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Primary Update Completed (2057/2371 @ 86.76%)' [2025-09-29T22:04:19.057218] [INFO ] [MAIN ] Primary update successful. Now generating derivatives... [2025-09-29T22:04:19.057313] [INFO ] [MAIN ] Refreshing symbols list before derivative generation... [2025-09-29T22:04:19.057381] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-09-29T22:04:19.057517] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-09-29T22:04:19.057578] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-09-29T22:04:19.896557] [DEBUG] [SYMBOL ] Found 2423 valid NYSE symbols. [2025-09-29T22:04:19.896747] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-09-29T22:04:19.897010] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-09-29T22:04:19.897618] [INFO ] [LOCAL ] Symbols cache updated with 2371 symbols. [2025-09-29T22:04:19.897730] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-09-29T22:04:19.897773] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-09-29T22:04:19.897835] [INFO ] [MAIN ] Pruning stale symbols... [2025-09-29T22:04:19.897871] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-09-29T22:04:19.897990] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-29T22:04:19.898390] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-09-29T22:04:19.898444] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-29T22:04:19.898629] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-09-29T22:04:19.898702] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2371 valid symbols. [2025-09-29T22:04:19.898746] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-09-29T22:04:19.898780] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-09-29T22:04:19.927407] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-09-29T22:04:19.955384] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-09-29T22:04:19.955476] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-09-29T22:04:19.955513] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-09-29T22:04:19.955544] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-09-29T22:04:19.955603] [INFO ] [MAIN ] Running derivative generation in parallel mode [2025-09-29T22:04:19.955636] [INFO ] [MAIN ] Wiping all existing derivative data before regeneration. [2025-09-29T22:04:19.955718] [INFO ] [LOCAL ] Starting deletion of all local derivative data. [2025-09-29T22:04:19.957135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CINT.csv [2025-09-29T22:04:19.957438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMC.csv [2025-09-29T22:04:19.957694] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FF.csv [2025-09-29T22:04:19.958070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLOW.csv [2025-09-29T22:04:19.958509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTN.csv [2025-09-29T22:04:19.958877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBR.csv [2025-09-29T22:04:19.959127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTI.csv [2025-09-29T22:04:19.959520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TX.csv [2025-09-29T22:04:19.959769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTZ.csv [2025-09-29T22:04:19.960209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSF.csv [2025-09-29T22:04:19.960681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTZ.csv [2025-09-29T22:04:19.960958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERO.csv [2025-09-29T22:04:19.961215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPP.csv [2025-09-29T22:04:19.961434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OBDC.csv [2025-09-29T22:04:19.961675] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLL.csv [2025-09-29T22:04:19.961900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HII.csv [2025-09-29T22:04:19.962187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MX.csv [2025-09-29T22:04:19.962469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSI.csv [2025-09-29T22:04:19.962722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGD.csv [2025-09-29T22:04:19.962941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMWL.csv [2025-09-29T22:04:19.963555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDST.csv [2025-09-29T22:04:19.963790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEN.csv [2025-09-29T22:04:19.964012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGO.csv [2025-09-29T22:04:19.964241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRK.csv [2025-09-29T22:04:19.964502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRL.csv [2025-09-29T22:04:19.964711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXYZ.csv [2025-09-29T22:04:19.964908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPFD.csv [2025-09-29T22:04:19.965094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMX.csv [2025-09-29T22:04:19.965517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYN.csv [2025-09-29T22:04:19.965766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHE.csv [2025-09-29T22:04:19.966023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/D.csv [2025-09-29T22:04:19.966257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACV.csv [2025-09-29T22:04:19.966820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZC.csv [2025-09-29T22:04:19.967018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NABL.csv [2025-09-29T22:04:19.967358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SII.csv [2025-09-29T22:04:19.967509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCV.csv [2025-09-29T22:04:19.967706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNK.csv [2025-09-29T22:04:19.967859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIN.csv [2025-09-29T22:04:19.967973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNX.csv [2025-09-29T22:04:19.968343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TREX.csv [2025-09-29T22:04:19.968531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTST.csv [2025-09-29T22:04:19.968810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKM.csv [2025-09-29T22:04:19.969037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCF.csv [2025-09-29T22:04:19.969345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITC.csv [2025-09-29T22:04:19.969572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLGN.csv [2025-09-29T22:04:19.969745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MRK.csv [2025-09-29T22:04:19.969914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVN.csv [2025-09-29T22:04:19.970309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGI.csv [2025-09-29T22:04:19.970455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEPU.csv [2025-09-29T22:04:19.970600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPX.csv [2025-09-29T22:04:19.970802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTB.csv [2025-09-29T22:04:19.971026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AAT.csv [2025-09-29T22:04:19.971245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEN.csv [2025-09-29T22:04:19.971934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMS.csv [2025-09-29T22:04:19.972222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VKQ.csv [2025-09-29T22:04:19.972356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNNE.csv [2025-09-29T22:04:19.972521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVX.csv [2025-09-29T22:04:19.972760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLNK.csv [2025-09-29T22:04:19.972930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINV.csv [2025-09-29T22:04:19.973340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/S.csv [2025-09-29T22:04:19.973522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSS.csv [2025-09-29T22:04:19.973720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JELD.csv [2025-09-29T22:04:19.973854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JKS.csv [2025-09-29T22:04:19.974016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOS.csv [2025-09-29T22:04:19.974181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCA.csv [2025-09-29T22:04:19.974493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAT.csv [2025-09-29T22:04:19.974817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QUAD.csv [2025-09-29T22:04:19.974975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUR.csv [2025-09-29T22:04:19.975138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNB.csv [2025-09-29T22:04:19.975408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRMB.csv [2025-09-29T22:04:19.975530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTE.csv [2025-09-29T22:04:19.975718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPI.csv [2025-09-29T22:04:19.975887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAZ.csv [2025-09-29T22:04:19.976111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDS.csv [2025-09-29T22:04:19.976472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YPF.csv [2025-09-29T22:04:19.976812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTL.csv [2025-09-29T22:04:19.977420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UFI.csv [2025-09-29T22:04:19.977603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFC.csv [2025-09-29T22:04:19.977865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEO.csv [2025-09-29T22:04:19.978062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTHY.csv [2025-09-29T22:04:19.978426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPHR.csv [2025-09-29T22:04:19.978611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCV.csv [2025-09-29T22:04:19.979139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNW.csv [2025-09-29T22:04:19.979343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BP.csv [2025-09-29T22:04:19.979498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRC.csv [2025-09-29T22:04:19.979907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BB.csv [2025-09-29T22:04:19.980087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDOT.csv [2025-09-29T22:04:19.980312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVS.csv [2025-09-29T22:04:19.980585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVR.csv [2025-09-29T22:04:19.980857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNST.csv [2025-09-29T22:04:19.981035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OSCR.csv [2025-09-29T22:04:19.981241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVGS.csv [2025-09-29T22:04:19.981400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMF.csv [2025-09-29T22:04:19.981629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVB.csv [2025-09-29T22:04:19.981889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OR.csv [2025-09-29T22:04:19.982384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIPR.csv [2025-09-29T22:04:19.982545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMR.csv [2025-09-29T22:04:19.982759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVH.csv [2025-09-29T22:04:19.982952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLCO.csv [2025-09-29T22:04:19.983196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVI.csv [2025-09-29T22:04:19.983705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WY.csv [2025-09-29T22:04:19.983902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BR.csv [2025-09-29T22:04:19.984244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGLS.csv [2025-09-29T22:04:19.984578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TD.csv [2025-09-29T22:04:19.984845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAG.csv [2025-09-29T22:04:19.985031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMU.csv [2025-09-29T22:04:19.985290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYL.csv [2025-09-29T22:04:19.985466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUMN.csv [2025-09-29T22:04:19.985666] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMA.csv [2025-09-29T22:04:19.986011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPFI.csv [2025-09-29T22:04:19.986191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGR.csv [2025-09-29T22:04:19.986360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGD.csv [2025-09-29T22:04:19.986542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHF.csv [2025-09-29T22:04:19.986803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBX.csv [2025-09-29T22:04:19.987017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENO.csv [2025-09-29T22:04:19.991000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPB.csv [2025-09-29T22:04:19.991200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DECK.csv [2025-09-29T22:04:19.991374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBC.csv [2025-09-29T22:04:19.991554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTY.csv [2025-09-29T22:04:19.991904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPG.csv [2025-09-29T22:04:19.992112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUZ.csv [2025-09-29T22:04:19.992444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRX.csv [2025-09-29T22:04:19.992630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIPO.csv [2025-09-29T22:04:19.993048] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPI.csv [2025-09-29T22:04:19.993240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/H.csv [2025-09-29T22:04:19.993460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAY.csv [2025-09-29T22:04:19.993695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEQ.csv [2025-09-29T22:04:19.994182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIT.csv [2025-09-29T22:04:19.994613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTRG.csv [2025-09-29T22:04:19.994937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGP.csv [2025-09-29T22:04:19.995112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPOR.csv [2025-09-29T22:04:19.995317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRH.csv [2025-09-29T22:04:19.995516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCPT.csv [2025-09-29T22:04:19.995983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFN.csv [2025-09-29T22:04:19.996102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAE.csv [2025-09-29T22:04:19.996401] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOL.csv [2025-09-29T22:04:19.996552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYB.csv [2025-09-29T22:04:19.996901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNF.csv [2025-09-29T22:04:19.997217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOR.csv [2025-09-29T22:04:19.997404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IMAX.csv [2025-09-29T22:04:19.997560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZN.csv [2025-09-29T22:04:19.997883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WS.csv [2025-09-29T22:04:19.998019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAL.csv [2025-09-29T22:04:19.998154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLR.csv [2025-09-29T22:04:19.998359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BK.csv [2025-09-29T22:04:19.998501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIM.csv [2025-09-29T22:04:19.998807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCN.csv [2025-09-29T22:04:19.998951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNY.csv [2025-09-29T22:04:19.999278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLO.csv [2025-09-29T22:04:19.999553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGVT.csv [2025-09-29T22:04:19.999795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOV.csv [2025-09-29T22:04:19.999949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPR.csv [2025-09-29T22:04:20.000116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTL.csv [2025-09-29T22:04:20.000297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KWR.csv [2025-09-29T22:04:20.000505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AORT.csv [2025-09-29T22:04:20.001013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAN.csv [2025-09-29T22:04:20.001439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGN.csv [2025-09-29T22:04:20.001750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USB.csv [2025-09-29T22:04:20.002242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGT.csv [2025-09-29T22:04:20.002452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMY.csv [2025-09-29T22:04:20.002629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLO.csv [2025-09-29T22:04:20.002863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCS.csv [2025-09-29T22:04:20.003255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YSG.csv [2025-09-29T22:04:20.003445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATO.csv [2025-09-29T22:04:20.003630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSL.csv [2025-09-29T22:04:20.003817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NREF.csv [2025-09-29T22:04:20.004000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFG.csv [2025-09-29T22:04:20.004160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIVI.csv [2025-09-29T22:04:20.004365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNT.csv [2025-09-29T22:04:20.004511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIM.csv [2025-09-29T22:04:20.004716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRT.csv [2025-09-29T22:04:20.004888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAI.csv [2025-09-29T22:04:20.005160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMO.csv [2025-09-29T22:04:20.005299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRB.csv [2025-09-29T22:04:20.005432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTH.csv [2025-09-29T22:04:20.005568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRO.csv [2025-09-29T22:04:20.005772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCN.csv [2025-09-29T22:04:20.006188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFSI.csv [2025-09-29T22:04:20.006356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNG.csv [2025-09-29T22:04:20.006469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXU.csv [2025-09-29T22:04:20.006724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRGP.csv [2025-09-29T22:04:20.006872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMEZ.csv [2025-09-29T22:04:20.007086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHAL.csv [2025-09-29T22:04:20.007206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOB.csv [2025-09-29T22:04:20.007458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPER.csv [2025-09-29T22:04:20.007581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPH.csv [2025-09-29T22:04:20.008047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WST.csv [2025-09-29T22:04:20.008209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPK.csv [2025-09-29T22:04:20.008386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GL.csv [2025-09-29T22:04:20.008512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRS.csv [2025-09-29T22:04:20.008751] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FR.csv [2025-09-29T22:04:20.008900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIM.csv [2025-09-29T22:04:20.009395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTR.csv [2025-09-29T22:04:20.009512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MD.csv [2025-09-29T22:04:20.009695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NFJ.csv [2025-09-29T22:04:20.009993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRG.csv [2025-09-29T22:04:20.010283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHW.csv [2025-09-29T22:04:20.010446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACM.csv [2025-09-29T22:04:20.010722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKE.csv [2025-09-29T22:04:20.010906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWAN.csv [2025-09-29T22:04:20.011080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPA.csv [2025-09-29T22:04:20.011213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEE.csv [2025-09-29T22:04:20.011492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTR.csv [2025-09-29T22:04:20.011627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNV.csv [2025-09-29T22:04:20.011819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNOW.csv [2025-09-29T22:04:20.011961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBZ.csv [2025-09-29T22:04:20.012266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPMC.csv [2025-09-29T22:04:20.012437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIO.csv [2025-09-29T22:04:20.012576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWA.csv [2025-09-29T22:04:20.012788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYE.csv [2025-09-29T22:04:20.012943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRI.csv [2025-09-29T22:04:20.013088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNY.csv [2025-09-29T22:04:20.013217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGG.csv [2025-09-29T22:04:20.013439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARR.csv [2025-09-29T22:04:20.013586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYT.csv [2025-09-29T22:04:20.013759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPC.csv [2025-09-29T22:04:20.013916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUT.csv [2025-09-29T22:04:20.014139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSD.csv [2025-09-29T22:04:20.014271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHC.csv [2025-09-29T22:04:20.014450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLB.csv [2025-09-29T22:04:20.014617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNED.csv [2025-09-29T22:04:20.014774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXC.csv [2025-09-29T22:04:20.014991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWLP.csv [2025-09-29T22:04:20.015171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNA.csv [2025-09-29T22:04:20.015331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFG.csv [2025-09-29T22:04:20.015491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NU.csv [2025-09-29T22:04:20.015806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXNM.csv [2025-09-29T22:04:20.015975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGI.csv [2025-09-29T22:04:20.016231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ULS.csv [2025-09-29T22:04:20.016525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNI.csv [2025-09-29T22:04:20.016835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFS.csv [2025-09-29T22:04:20.017043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BC.csv [2025-09-29T22:04:20.017243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSD.csv [2025-09-29T22:04:20.017428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSG.csv [2025-09-29T22:04:20.017762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYL.csv [2025-09-29T22:04:20.018082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIMB.csv [2025-09-29T22:04:20.018263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EE.csv [2025-09-29T22:04:20.018410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRK.csv [2025-09-29T22:04:20.018562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZ.csv [2025-09-29T22:04:20.018787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAC.csv [2025-09-29T22:04:20.018958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVEO.csv [2025-09-29T22:04:20.019123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HI.csv [2025-09-29T22:04:20.019309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSCI.csv [2025-09-29T22:04:20.019596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNG.csv [2025-09-29T22:04:20.019807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLNG.csv [2025-09-29T22:04:20.019960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRD.csv [2025-09-29T22:04:20.020178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNN.csv [2025-09-29T22:04:20.020344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABEV.csv [2025-09-29T22:04:20.020493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAC.csv [2025-09-29T22:04:20.020616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRBR.csv [2025-09-29T22:04:20.020821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONTO.csv [2025-09-29T22:04:20.021055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SF.csv [2025-09-29T22:04:20.021256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMI.csv [2025-09-29T22:04:20.021393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHN.csv [2025-09-29T22:04:20.021703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGZ.csv [2025-09-29T22:04:20.021982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAN.csv [2025-09-29T22:04:20.022123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMBT.csv [2025-09-29T22:04:20.022356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QD.csv [2025-09-29T22:04:20.022623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VICI.csv [2025-09-29T22:04:20.022776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACI.csv [2025-09-29T22:04:20.022923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHG.csv [2025-09-29T22:04:20.023064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRDY.csv [2025-09-29T22:04:20.023191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDN.csv [2025-09-29T22:04:20.023324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AX.csv [2025-09-29T22:04:20.023458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHK.csv [2025-09-29T22:04:20.023603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPC.csv [2025-09-29T22:04:20.023752] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRX.csv [2025-09-29T22:04:20.023971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAM.csv [2025-09-29T22:04:20.024290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBER.csv [2025-09-29T22:04:20.024609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEO.csv [2025-09-29T22:04:20.024827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEI.csv [2025-09-29T22:04:20.025043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RXO.csv [2025-09-29T22:04:20.025169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AJG.csv [2025-09-29T22:04:20.025285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTN.csv [2025-09-29T22:04:20.025397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFB.csv [2025-09-29T22:04:20.025536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFLY.csv [2025-09-29T22:04:20.025745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBU.csv [2025-09-29T22:04:20.025923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHY.csv [2025-09-29T22:04:20.026042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITGR.csv [2025-09-29T22:04:20.026263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRV.csv [2025-09-29T22:04:20.026406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MRC.csv [2025-09-29T22:04:20.026606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOR.csv [2025-09-29T22:04:20.026825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGL.csv [2025-09-29T22:04:20.026974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWT.csv [2025-09-29T22:04:20.027134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUS.csv [2025-09-29T22:04:20.027460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLK.csv [2025-09-29T22:04:20.027830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WD.csv [2025-09-29T22:04:20.027959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BVN.csv [2025-09-29T22:04:20.028288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEAV.csv [2025-09-29T22:04:20.028409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHN.csv [2025-09-29T22:04:20.028692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WK.csv [2025-09-29T22:04:20.028838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHWY.csv [2025-09-29T22:04:20.029050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSL.csv [2025-09-29T22:04:20.029198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMR.csv [2025-09-29T22:04:20.029551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLY.csv [2025-09-29T22:04:20.029891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGF.csv [2025-09-29T22:04:20.030322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEL.csv [2025-09-29T22:04:20.030458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRBK.csv [2025-09-29T22:04:20.030816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOLV.csv [2025-09-29T22:04:20.031110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIXT.csv [2025-09-29T22:04:20.031407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBRK.csv [2025-09-29T22:04:20.031566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOG.csv [2025-09-29T22:04:20.031788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LRN.csv [2025-09-29T22:04:20.031938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGA.csv [2025-09-29T22:04:20.032281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXC.csv [2025-09-29T22:04:20.032459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUN.csv [2025-09-29T22:04:20.032614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHI.csv [2025-09-29T22:04:20.032780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEG.csv [2025-09-29T22:04:20.032933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMT.csv [2025-09-29T22:04:20.033158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LC.csv [2025-09-29T22:04:20.033332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ES.csv [2025-09-29T22:04:20.033513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BARK.csv [2025-09-29T22:04:20.033807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYTR.csv [2025-09-29T22:04:20.034068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHG.csv [2025-09-29T22:04:20.034221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OKE.csv [2025-09-29T22:04:20.034367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HESM.csv [2025-09-29T22:04:20.034617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XHR.csv [2025-09-29T22:04:20.034872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TROX.csv [2025-09-29T22:04:20.034994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNW.csv [2025-09-29T22:04:20.035124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDV.csv [2025-09-29T22:04:20.035270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BILL.csv [2025-09-29T22:04:20.035403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFD.csv [2025-09-29T22:04:20.035569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHX.csv [2025-09-29T22:04:20.035940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRBY.csv [2025-09-29T22:04:20.036161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REZI.csv [2025-09-29T22:04:20.036384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STC.csv [2025-09-29T22:04:20.036510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQI.csv [2025-09-29T22:04:20.036682] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCI.csv [2025-09-29T22:04:20.036808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCX.csv [2025-09-29T22:04:20.037263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOC.csv [2025-09-29T22:04:20.037401] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIC.csv [2025-09-29T22:04:20.037527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATGE.csv [2025-09-29T22:04:20.037946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRI.csv [2025-09-29T22:04:20.038067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEE.csv [2025-09-29T22:04:20.038242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHK.csv [2025-09-29T22:04:20.038383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIMN.csv [2025-09-29T22:04:20.038799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLD.csv [2025-09-29T22:04:20.039052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKE.csv [2025-09-29T22:04:20.039162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLXR.csv [2025-09-29T22:04:20.039286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPM.csv [2025-09-29T22:04:20.039425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTS.csv [2025-09-29T22:04:20.039573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDI.csv [2025-09-29T22:04:20.039776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APTV.csv [2025-09-29T22:04:20.039915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLI.csv [2025-09-29T22:04:20.040118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QSR.csv [2025-09-29T22:04:20.040228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSV.csv [2025-09-29T22:04:20.040343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAA.csv [2025-09-29T22:04:20.040538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THS.csv [2025-09-29T22:04:20.040784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDIV.csv [2025-09-29T22:04:20.040916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BALL.csv [2025-09-29T22:04:20.041029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IR.csv [2025-09-29T22:04:20.041160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODV.csv [2025-09-29T22:04:20.041273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDL.csv [2025-09-29T22:04:20.041431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVLG.csv [2025-09-29T22:04:20.041555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMI.csv [2025-09-29T22:04:20.041737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNF.csv [2025-09-29T22:04:20.041884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CW.csv [2025-09-29T22:04:20.042155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBCI.csv [2025-09-29T22:04:20.042308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRDN.csv [2025-09-29T22:04:20.042472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYI.csv [2025-09-29T22:04:20.042623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PACK.csv [2025-09-29T22:04:20.042760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COP.csv [2025-09-29T22:04:20.043247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMT.csv [2025-09-29T22:04:20.043493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLYM.csv [2025-09-29T22:04:20.043707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DINO.csv [2025-09-29T22:04:20.044003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAC.csv [2025-09-29T22:04:20.044153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMG.csv [2025-09-29T22:04:20.044330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AU.csv [2025-09-29T22:04:20.044491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AKR.csv [2025-09-29T22:04:20.044812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPG.csv [2025-09-29T22:04:20.044966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMM.csv [2025-09-29T22:04:20.045127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHF.csv [2025-09-29T22:04:20.045330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPH.csv [2025-09-29T22:04:20.045482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADT.csv [2025-09-29T22:04:20.045702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLDR.csv [2025-09-29T22:04:20.045895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTS.csv [2025-09-29T22:04:20.046075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBF.csv [2025-09-29T22:04:20.046276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARCO.csv [2025-09-29T22:04:20.046453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBHC.csv [2025-09-29T22:04:20.046622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHC.csv [2025-09-29T22:04:20.047163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SG.csv [2025-09-29T22:04:20.047404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPT.csv [2025-09-29T22:04:20.047713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THLV.csv [2025-09-29T22:04:20.047876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXTA.csv [2025-09-29T22:04:20.048129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDDT.csv [2025-09-29T22:04:20.048241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MA.csv [2025-09-29T22:04:20.048364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADC.csv [2025-09-29T22:04:20.048565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIRT.csv [2025-09-29T22:04:20.048980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAR.csv [2025-09-29T22:04:20.049101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIG.csv [2025-09-29T22:04:20.049408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTG.csv [2025-09-29T22:04:20.049550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BW.csv [2025-09-29T22:04:20.049689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRA.csv [2025-09-29T22:04:20.049814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATUS.csv [2025-09-29T22:04:20.049956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MODG.csv [2025-09-29T22:04:20.050073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AQNB.csv [2025-09-29T22:04:20.050334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STK.csv [2025-09-29T22:04:20.050565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWZ.csv [2025-09-29T22:04:20.050728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABR.csv [2025-09-29T22:04:20.050840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATR.csv [2025-09-29T22:04:20.050965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFXT.csv [2025-09-29T22:04:20.051105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CF.csv [2025-09-29T22:04:20.051231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTBB.csv [2025-09-29T22:04:20.051351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GROV.csv [2025-09-29T22:04:20.051456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLX.csv [2025-09-29T22:04:20.051573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRGY.csv [2025-09-29T22:04:20.051748] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLVT.csv [2025-09-29T22:04:20.051864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HHH.csv [2025-09-29T22:04:20.052077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTO.csv [2025-09-29T22:04:20.052192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEA.csv [2025-09-29T22:04:20.052322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OXM.csv [2025-09-29T22:04:20.052453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUD.csv [2025-09-29T22:04:20.052699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRAK.csv [2025-09-29T22:04:20.052823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPG.csv [2025-09-29T22:04:20.053048] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIG.csv [2025-09-29T22:04:20.053170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDC.csv [2025-09-29T22:04:20.053558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVV.csv [2025-09-29T22:04:20.053686] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPC.csv [2025-09-29T22:04:20.053786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IH.csv [2025-09-29T22:04:20.054211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VZ.csv [2025-09-29T22:04:20.054345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECL.csv [2025-09-29T22:04:20.054472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTH.csv [2025-09-29T22:04:20.054592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUM.csv [2025-09-29T22:04:20.054767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTVA.csv [2025-09-29T22:04:20.055069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXT.csv [2025-09-29T22:04:20.055457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSTS.csv [2025-09-29T22:04:20.055600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESS.csv [2025-09-29T22:04:20.055752] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FICO.csv [2025-09-29T22:04:20.056023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USA.csv [2025-09-29T22:04:20.056163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNC.csv [2025-09-29T22:04:20.056259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSB.csv [2025-09-29T22:04:20.056367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSCO.csv [2025-09-29T22:04:20.056480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KF.csv [2025-09-29T22:04:20.056673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DVA.csv [2025-09-29T22:04:20.056939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPRU.csv [2025-09-29T22:04:20.057118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFN.csv [2025-09-29T22:04:20.057421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPB.csv [2025-09-29T22:04:20.057596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXK.csv [2025-09-29T22:04:20.057874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKKT.csv [2025-09-29T22:04:20.058040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHGG.csv [2025-09-29T22:04:20.058193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIS.csv [2025-09-29T22:04:20.058435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHOC.csv [2025-09-29T22:04:20.058636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBGS.csv [2025-09-29T22:04:20.058804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKV.csv [2025-09-29T22:04:20.058960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVD.csv [2025-09-29T22:04:20.059135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KLC.csv [2025-09-29T22:04:20.059404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLQT.csv [2025-09-29T22:04:20.059563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVRR.csv [2025-09-29T22:04:20.059742] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMB.csv [2025-09-29T22:04:20.059898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASBA.csv [2025-09-29T22:04:20.060054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVNA.csv [2025-09-29T22:04:20.060218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGR.csv [2025-09-29T22:04:20.060394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBXG.csv [2025-09-29T22:04:20.060575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BZH.csv [2025-09-29T22:04:20.060744] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACA.csv [2025-09-29T22:04:20.060904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRA.csv [2025-09-29T22:04:20.061179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPP.csv [2025-09-29T22:04:20.061480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGR.csv [2025-09-29T22:04:20.061770] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEI.csv [2025-09-29T22:04:20.061912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KB.csv [2025-09-29T22:04:20.062042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGL.csv [2025-09-29T22:04:20.062160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEFC.csv [2025-09-29T22:04:20.062385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUI.csv [2025-09-29T22:04:20.062534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAI.csv [2025-09-29T22:04:20.062671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CULP.csv [2025-09-29T22:04:20.062957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHEL.csv [2025-09-29T22:04:20.063258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNT.csv [2025-09-29T22:04:20.063374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETV.csv [2025-09-29T22:04:20.063623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WM.csv [2025-09-29T22:04:20.063791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CURV.csv [2025-09-29T22:04:20.063999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDW.csv [2025-09-29T22:04:20.064128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COLD.csv [2025-09-29T22:04:20.064253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYH.csv [2025-09-29T22:04:20.064436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THW.csv [2025-09-29T22:04:20.064533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAGS.csv [2025-09-29T22:04:20.064712] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNO.csv [2025-09-29T22:04:20.064820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXG.csv [2025-09-29T22:04:20.064935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CP.csv [2025-09-29T22:04:20.065057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCK.csv [2025-09-29T22:04:20.065164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVT.csv [2025-09-29T22:04:20.065283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHR.csv [2025-09-29T22:04:20.065495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDN.csv [2025-09-29T22:04:20.065876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPRO.csv [2025-09-29T22:04:20.066061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSA.csv [2025-09-29T22:04:20.066277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHC.csv [2025-09-29T22:04:20.066404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTU.csv [2025-09-29T22:04:20.066608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLTO.csv [2025-09-29T22:04:20.066862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEI.csv [2025-09-29T22:04:20.067001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBM.csv [2025-09-29T22:04:20.067112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXR.csv [2025-09-29T22:04:20.067243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAT.csv [2025-09-29T22:04:20.067359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LION.csv [2025-09-29T22:04:20.067486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXC.csv [2025-09-29T22:04:20.067593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVX.csv [2025-09-29T22:04:20.067757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGR.csv [2025-09-29T22:04:20.067983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEM.csv [2025-09-29T22:04:20.068104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWP.csv [2025-09-29T22:04:20.068377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLTY.csv [2025-09-29T22:04:20.068608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RHI.csv [2025-09-29T22:04:20.068858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HXL.csv [2025-09-29T22:04:20.068979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHT.csv [2025-09-29T22:04:20.069156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROG.csv [2025-09-29T22:04:20.069411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VALE.csv [2025-09-29T22:04:20.069537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRM.csv [2025-09-29T22:04:20.069707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CION.csv [2025-09-29T22:04:20.069901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMS.csv [2025-09-29T22:04:20.070029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWR.csv [2025-09-29T22:04:20.070166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFR.csv [2025-09-29T22:04:20.070330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFC.csv [2025-09-29T22:04:20.070624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRT.csv [2025-09-29T22:04:20.070803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GENI.csv [2025-09-29T22:04:20.071043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VFC.csv [2025-09-29T22:04:20.071338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMFG.csv [2025-09-29T22:04:20.071475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGTY.csv [2025-09-29T22:04:20.071721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NJR.csv [2025-09-29T22:04:20.071884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENFY.csv [2025-09-29T22:04:20.072053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFI.csv [2025-09-29T22:04:20.072299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SM.csv [2025-09-29T22:04:20.072530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHD.csv [2025-09-29T22:04:20.072730] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CB.csv [2025-09-29T22:04:20.072916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGG.csv [2025-09-29T22:04:20.073083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APO.csv [2025-09-29T22:04:20.073225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDT.csv [2025-09-29T22:04:20.073399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTM.csv [2025-09-29T22:04:20.073705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TJX.csv [2025-09-29T22:04:20.073870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMN.csv [2025-09-29T22:04:20.074009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHH.csv [2025-09-29T22:04:20.074160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYI.csv [2025-09-29T22:04:20.074348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBDC.csv [2025-09-29T22:04:20.074485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOAH.csv [2025-09-29T22:04:20.074881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPR.csv [2025-09-29T22:04:20.074997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTG.csv [2025-09-29T22:04:20.075124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARI.csv [2025-09-29T22:04:20.075274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOS.csv [2025-09-29T22:04:20.075390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GETY.csv [2025-09-29T22:04:20.075506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKH.csv [2025-09-29T22:04:20.075753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRH.csv [2025-09-29T22:04:20.075853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HKD.csv [2025-09-29T22:04:20.076089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAB.csv [2025-09-29T22:04:20.076414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REVG.csv [2025-09-29T22:04:20.076632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SIG.csv [2025-09-29T22:04:20.076762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZZ.csv [2025-09-29T22:04:20.076930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRT.csv [2025-09-29T22:04:20.077080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITUB.csv [2025-09-29T22:04:20.077176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXP.csv [2025-09-29T22:04:20.077256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HASI.csv [2025-09-29T22:04:20.077370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNS.csv [2025-09-29T22:04:20.077564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SILA.csv [2025-09-29T22:04:20.077799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIW.csv [2025-09-29T22:04:20.077946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NX.csv [2025-09-29T22:04:20.078156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGRE.csv [2025-09-29T22:04:20.078357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNC.csv [2025-09-29T22:04:20.078536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCDL.csv [2025-09-29T22:04:20.078719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HR.csv [2025-09-29T22:04:20.078841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBE.csv [2025-09-29T22:04:20.078955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRND.csv [2025-09-29T22:04:20.079080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCTS.csv [2025-09-29T22:04:20.079196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNX.csv [2025-09-29T22:04:20.079317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBX.csv [2025-09-29T22:04:20.079471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACCO.csv [2025-09-29T22:04:20.079917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTEX.csv [2025-09-29T22:04:20.080025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AL.csv [2025-09-29T22:04:20.080513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEX.csv [2025-09-29T22:04:20.080842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NC.csv [2025-09-29T22:04:20.081093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNL.csv [2025-09-29T22:04:20.081310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VATE.csv [2025-09-29T22:04:20.081487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFS.csv [2025-09-29T22:04:20.081619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDS.csv [2025-09-29T22:04:20.081854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWK.csv [2025-09-29T22:04:20.081981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNP.csv [2025-09-29T22:04:20.082094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRI.csv [2025-09-29T22:04:20.082221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOI.csv [2025-09-29T22:04:20.082386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSB.csv [2025-09-29T22:04:20.082580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKT.csv [2025-09-29T22:04:20.082805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVE.csv [2025-09-29T22:04:20.083103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNR.csv [2025-09-29T22:04:20.083285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUV.csv [2025-09-29T22:04:20.083757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RL.csv [2025-09-29T22:04:20.083973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXT.csv [2025-09-29T22:04:20.084108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLE.csv [2025-09-29T22:04:20.084272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHMI.csv [2025-09-29T22:04:20.084435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LW.csv [2025-09-29T22:04:20.084573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTWO.csv [2025-09-29T22:04:20.084739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/J.csv [2025-09-29T22:04:20.084944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAE.csv [2025-09-29T22:04:20.085098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXS.csv [2025-09-29T22:04:20.085261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONON.csv [2025-09-29T22:04:20.085412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFY.csv [2025-09-29T22:04:20.085846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSN.csv [2025-09-29T22:04:20.086256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLYS.csv [2025-09-29T22:04:20.086409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBRE.csv [2025-09-29T22:04:20.086628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWO.csv [2025-09-29T22:04:20.086865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFB.csv [2025-09-29T22:04:20.087180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSA.csv [2025-09-29T22:04:20.087481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDY.csv [2025-09-29T22:04:20.087667] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLG.csv [2025-09-29T22:04:20.087827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIA.csv [2025-09-29T22:04:20.088174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNGR.csv [2025-09-29T22:04:20.088375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNET.csv [2025-09-29T22:04:20.088500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEM.csv [2025-09-29T22:04:20.088691] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNL.csv [2025-09-29T22:04:20.088848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBND.csv [2025-09-29T22:04:20.088957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTB.csv [2025-09-29T22:04:20.089088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBI.csv [2025-09-29T22:04:20.089197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESAB.csv [2025-09-29T22:04:20.089319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDJ.csv [2025-09-29T22:04:20.089734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SONY.csv [2025-09-29T22:04:20.089950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOC.csv [2025-09-29T22:04:20.090059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAC.csv [2025-09-29T22:04:20.090248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PD.csv [2025-09-29T22:04:20.090390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JXN.csv [2025-09-29T22:04:20.090503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOT.csv [2025-09-29T22:04:20.090627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDI.csv [2025-09-29T22:04:20.090754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABM.csv [2025-09-29T22:04:20.090930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCUS.csv [2025-09-29T22:04:20.091043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNRC.csv [2025-09-29T22:04:20.091165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIY.csv [2025-09-29T22:04:20.091593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIA.csv [2025-09-29T22:04:20.091738] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITP.csv [2025-09-29T22:04:20.091854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DG.csv [2025-09-29T22:04:20.091964] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MANU.csv [2025-09-29T22:04:20.092071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHD.csv [2025-09-29T22:04:20.092187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXE.csv [2025-09-29T22:04:20.092337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELME.csv [2025-09-29T22:04:20.092575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XOM.csv [2025-09-29T22:04:20.092801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIPS.csv [2025-09-29T22:04:20.093051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOL.csv [2025-09-29T22:04:20.093177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPO.csv [2025-09-29T22:04:20.093315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GD.csv [2025-09-29T22:04:20.093610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPYP.csv [2025-09-29T22:04:20.093812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRGV.csv [2025-09-29T22:04:20.093949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTF.csv [2025-09-29T22:04:20.094054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVRI.csv [2025-09-29T22:04:20.094170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDP.csv [2025-09-29T22:04:20.094357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RERE.csv [2025-09-29T22:04:20.094519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBU.csv [2025-09-29T22:04:20.094921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMO.csv [2025-09-29T22:04:20.095145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STNG.csv [2025-09-29T22:04:20.095331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHT.csv [2025-09-29T22:04:20.095529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VYX.csv [2025-09-29T22:04:20.095690] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNI.csv [2025-09-29T22:04:20.095798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETO.csv [2025-09-29T22:04:20.095941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCO.csv [2025-09-29T22:04:20.096060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUK.csv [2025-09-29T22:04:20.096178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVS.csv [2025-09-29T22:04:20.096303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JFR.csv [2025-09-29T22:04:20.096566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RELX.csv [2025-09-29T22:04:20.096776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IEX.csv [2025-09-29T22:04:20.096907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MET.csv [2025-09-29T22:04:20.097122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OLN.csv [2025-09-29T22:04:20.097407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBS.csv [2025-09-29T22:04:20.097581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAI.csv [2025-09-29T22:04:20.097836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQNS.csv [2025-09-29T22:04:20.097980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETN.csv [2025-09-29T22:04:20.098151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVYO.csv [2025-09-29T22:04:20.098335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVR.csv [2025-09-29T22:04:20.098725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMI.csv [2025-09-29T22:04:20.098906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECVT.csv [2025-09-29T22:04:20.099256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VET.csv [2025-09-29T22:04:20.099414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENIC.csv [2025-09-29T22:04:20.099724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBS.csv [2025-09-29T22:04:20.099858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTV.csv [2025-09-29T22:04:20.100280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STM.csv [2025-09-29T22:04:20.100426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CII.csv [2025-09-29T22:04:20.100715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDI.csv [2025-09-29T22:04:20.100849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALTG.csv [2025-09-29T22:04:20.100993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOCL.csv [2025-09-29T22:04:20.101211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBC.csv [2025-09-29T22:04:20.101459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSE.csv [2025-09-29T22:04:20.101582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIT.csv [2025-09-29T22:04:20.101754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHH.csv [2025-09-29T22:04:20.101862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXC.csv [2025-09-29T22:04:20.101975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DUKB.csv [2025-09-29T22:04:20.102093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ED.csv [2025-09-29T22:04:20.102206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JGH.csv [2025-09-29T22:04:20.102303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMT.csv [2025-09-29T22:04:20.102536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RWT.csv [2025-09-29T22:04:20.102961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QGEN.csv [2025-09-29T22:04:20.103090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MC.csv [2025-09-29T22:04:20.103214] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBTA.csv [2025-09-29T22:04:20.103344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APH.csv [2025-09-29T22:04:20.103471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NI.csv [2025-09-29T22:04:20.103659] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWI.csv [2025-09-29T22:04:20.103759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAO.csv [2025-09-29T22:04:20.104114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UWMC.csv [2025-09-29T22:04:20.104249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFY.csv [2025-09-29T22:04:20.104524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEEV.csv [2025-09-29T22:04:20.104620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOC.csv [2025-09-29T22:04:20.104910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WES.csv [2025-09-29T22:04:20.105014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRS.csv [2025-09-29T22:04:20.105119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIPR.csv [2025-09-29T22:04:20.105320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMHI.csv [2025-09-29T22:04:20.105434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDD.csv [2025-09-29T22:04:20.105565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEM.csv [2025-09-29T22:04:20.105799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YETI.csv [2025-09-29T22:04:20.106000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/U.csv [2025-09-29T22:04:20.106220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAC.csv [2025-09-29T22:04:20.106328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KR.csv [2025-09-29T22:04:20.106423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCE.csv [2025-09-29T22:04:20.106523] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBRT.csv [2025-09-29T22:04:20.106627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALEX.csv [2025-09-29T22:04:20.106831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNP.csv [2025-09-29T22:04:20.107011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEN.csv [2025-09-29T22:04:20.107126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXRT.csv [2025-09-29T22:04:20.107233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKD.csv [2025-09-29T22:04:20.107360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUA.csv [2025-09-29T22:04:20.107458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JNJ.csv [2025-09-29T22:04:20.107562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGY.csv [2025-09-29T22:04:20.107708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LH.csv [2025-09-29T22:04:20.107806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGS.csv [2025-09-29T22:04:20.107892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOOT.csv [2025-09-29T22:04:20.107990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AESI.csv [2025-09-29T22:04:20.108102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHS.csv [2025-09-29T22:04:20.108440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNA.csv [2025-09-29T22:04:20.108561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSTM.csv [2025-09-29T22:04:20.108802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PUMP.csv [2025-09-29T22:04:20.109006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLX.csv [2025-09-29T22:04:20.109146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGE.csv [2025-09-29T22:04:20.109302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAC.csv [2025-09-29T22:04:20.109438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVO.csv [2025-09-29T22:04:20.109620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTZ.csv [2025-09-29T22:04:20.109899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAG.csv [2025-09-29T22:04:20.110021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWF.csv [2025-09-29T22:04:20.110275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYY.csv [2025-09-29T22:04:20.110412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AP.csv [2025-09-29T22:04:20.110548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVR.csv [2025-09-29T22:04:20.110721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDP.csv [2025-09-29T22:04:20.110850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAN.csv [2025-09-29T22:04:20.110985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMN.csv [2025-09-29T22:04:20.111261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZH.csv [2025-09-29T22:04:20.111395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMAI.csv [2025-09-29T22:04:20.111525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLF.csv [2025-09-29T22:04:20.111931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SD.csv [2025-09-29T22:04:20.112164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKLZ.csv [2025-09-29T22:04:20.112316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINS.csv [2025-09-29T22:04:20.112452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LANV.csv [2025-09-29T22:04:20.112594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALX.csv [2025-09-29T22:04:20.112857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBN.csv [2025-09-29T22:04:20.113016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFA.csv [2025-09-29T22:04:20.113175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDO.csv [2025-09-29T22:04:20.113449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYN.csv [2025-09-29T22:04:20.113578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKR.csv [2025-09-29T22:04:20.113749] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HP.csv [2025-09-29T22:04:20.113950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCQ.csv [2025-09-29T22:04:20.114178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPR.csv [2025-09-29T22:04:20.114371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVT.csv [2025-09-29T22:04:20.114473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPJ.csv [2025-09-29T22:04:20.114689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRIM.csv [2025-09-29T22:04:20.114790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIC.csv [2025-09-29T22:04:20.114985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBH.csv [2025-09-29T22:04:20.115171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWK.csv [2025-09-29T22:04:20.115327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGP.csv [2025-09-29T22:04:20.115598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAM.csv [2025-09-29T22:04:20.115784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTI.csv [2025-09-29T22:04:20.115951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOLE.csv [2025-09-29T22:04:20.116187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHD.csv [2025-09-29T22:04:20.116314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMCM.csv [2025-09-29T22:04:20.116544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WWW.csv [2025-09-29T22:04:20.116692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AI.csv [2025-09-29T22:04:20.116806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIO.csv [2025-09-29T22:04:20.117039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USFD.csv [2025-09-29T22:04:20.117166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOV.csv [2025-09-29T22:04:20.117289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVO.csv [2025-09-29T22:04:20.117399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDP.csv [2025-09-29T22:04:20.117504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSDL.csv [2025-09-29T22:04:20.117610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIGS.csv [2025-09-29T22:04:20.117803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTW.csv [2025-09-29T22:04:20.117953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MG.csv [2025-09-29T22:04:20.118088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODC.csv [2025-09-29T22:04:20.118177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOBY.csv [2025-09-29T22:04:20.118308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKR.csv [2025-09-29T22:04:20.118421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONL.csv [2025-09-29T22:04:20.118601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRI.csv [2025-09-29T22:04:20.118725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSL.csv [2025-09-29T22:04:20.118871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNK.csv [2025-09-29T22:04:20.118984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/M.csv [2025-09-29T22:04:20.119089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCS.csv [2025-09-29T22:04:20.119184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGX.csv [2025-09-29T22:04:20.119366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIST.csv [2025-09-29T22:04:20.119549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMAX.csv [2025-09-29T22:04:20.119788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDC.csv [2025-09-29T22:04:20.120095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STE.csv [2025-09-29T22:04:20.120285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUPV.csv [2025-09-29T22:04:20.120395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAP.csv [2025-09-29T22:04:20.120505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPR.csv [2025-09-29T22:04:20.120610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AYI.csv [2025-09-29T22:04:20.120759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LU.csv [2025-09-29T22:04:20.120867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPQ.csv [2025-09-29T22:04:20.121053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALV.csv [2025-09-29T22:04:20.121217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAXS.csv [2025-09-29T22:04:20.121376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMT.csv [2025-09-29T22:04:20.121617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEF.csv [2025-09-29T22:04:20.121869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PVL.csv [2025-09-29T22:04:20.121998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBP.csv [2025-09-29T22:04:20.122129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHT.csv [2025-09-29T22:04:20.122265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGD.csv [2025-09-29T22:04:20.122485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUN.csv [2025-09-29T22:04:20.123022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSKD.csv [2025-09-29T22:04:20.123259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UL.csv [2025-09-29T22:04:20.123483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXG.csv [2025-09-29T22:04:20.123704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATV.csv [2025-09-29T22:04:20.123869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOUR.csv [2025-09-29T22:04:20.124010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAZ.csv [2025-09-29T22:04:20.124187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AB.csv [2025-09-29T22:04:20.124470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBI.csv [2025-09-29T22:04:20.124634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUL.csv [2025-09-29T22:04:20.124839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLS.csv [2025-09-29T22:04:20.125153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELP.csv [2025-09-29T22:04:20.125311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMG.csv [2025-09-29T22:04:20.125559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHG.csv [2025-09-29T22:04:20.125817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPNG.csv [2025-09-29T22:04:20.125943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NDMO.csv [2025-09-29T22:04:20.126051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZO.csv [2025-09-29T22:04:20.126154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COOK.csv [2025-09-29T22:04:20.126365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUMC.csv [2025-09-29T22:04:20.126756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSBD.csv [2025-09-29T22:04:20.126877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOC.csv [2025-09-29T22:04:20.127115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKO.csv [2025-09-29T22:04:20.127226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSC.csv [2025-09-29T22:04:20.127388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGHC.csv [2025-09-29T22:04:20.127503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DX.csv [2025-09-29T22:04:20.127705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTW.csv [2025-09-29T22:04:20.127893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMK.csv [2025-09-29T22:04:20.128057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SID.csv [2025-09-29T22:04:20.128245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFPM.csv [2025-09-29T22:04:20.128347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDF.csv [2025-09-29T22:04:20.128520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPIR.csv [2025-09-29T22:04:20.128870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOF.csv [2025-09-29T22:04:20.128961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GYLD.csv [2025-09-29T22:04:20.129031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NYT.csv [2025-09-29T22:04:20.129097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMM.csv [2025-09-29T22:04:20.129176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMP.csv [2025-09-29T22:04:20.129276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DPG.csv [2025-09-29T22:04:20.129453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMO.csv [2025-09-29T22:04:20.129590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HE.csv [2025-09-29T22:04:20.129778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOD.csv [2025-09-29T22:04:20.129869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBW.csv [2025-09-29T22:04:20.129954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTRN.csv [2025-09-29T22:04:20.130225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WKC.csv [2025-09-29T22:04:20.130331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOS.csv [2025-09-29T22:04:20.130436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOF.csv [2025-09-29T22:04:20.130561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETR.csv [2025-09-29T22:04:20.130694] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMT.csv [2025-09-29T22:04:20.130910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAL.csv [2025-09-29T22:04:20.131103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZVIA.csv [2025-09-29T22:04:20.131289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEVA.csv [2025-09-29T22:04:20.131415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOMD.csv [2025-09-29T22:04:20.131525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVS.csv [2025-09-29T22:04:20.131632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CL.csv [2025-09-29T22:04:20.131776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNF.csv [2025-09-29T22:04:20.131890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRW.csv [2025-09-29T22:04:20.132074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SST.csv [2025-09-29T22:04:20.132231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNCE.csv [2025-09-29T22:04:20.132432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNS.csv [2025-09-29T22:04:20.132599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUZ.csv [2025-09-29T22:04:20.132862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WT.csv [2025-09-29T22:04:20.132958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELAN.csv [2025-09-29T22:04:20.133067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMS.csv [2025-09-29T22:04:20.133196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOP.csv [2025-09-29T22:04:20.133336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CX.csv [2025-09-29T22:04:20.133951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRB.csv [2025-09-29T22:04:20.134103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTB.csv [2025-09-29T22:04:20.134303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RH.csv [2025-09-29T22:04:20.134456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BROS.csv [2025-09-29T22:04:20.134699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNNT.csv [2025-09-29T22:04:20.135272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSN.csv [2025-09-29T22:04:20.135539] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXT.csv [2025-09-29T22:04:20.135697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTES.csv [2025-09-29T22:04:20.135928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPRK.csv [2025-09-29T22:04:20.136094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVF.csv [2025-09-29T22:04:20.136244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMN.csv [2025-09-29T22:04:20.136372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCO.csv [2025-09-29T22:04:20.136824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTS.csv [2025-09-29T22:04:20.136982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRD.csv [2025-09-29T22:04:20.137159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRC.csv [2025-09-29T22:04:20.137560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRN.csv [2025-09-29T22:04:20.137718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DK.csv [2025-09-29T22:04:20.137869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPN.csv [2025-09-29T22:04:20.138049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BURL.csv [2025-09-29T22:04:20.138195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTD.csv [2025-09-29T22:04:20.138334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHG.csv [2025-09-29T22:04:20.138453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LLY.csv [2025-09-29T22:04:20.138601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMA.csv [2025-09-29T22:04:20.138754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIW.csv [2025-09-29T22:04:20.138898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCO.csv [2025-09-29T22:04:20.139086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SREA.csv [2025-09-29T22:04:20.139258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDG.csv [2025-09-29T22:04:20.139420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBR.csv [2025-09-29T22:04:20.139554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEA.csv [2025-09-29T22:04:20.139686] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSR.csv [2025-09-29T22:04:20.139847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATEN.csv [2025-09-29T22:04:20.140017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STLA.csv [2025-09-29T22:04:20.140186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMC.csv [2025-09-29T22:04:20.140372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXV.csv [2025-09-29T22:04:20.140484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLOB.csv [2025-09-29T22:04:20.140689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMG.csv [2025-09-29T22:04:20.140797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVA.csv [2025-09-29T22:04:20.141125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YMM.csv [2025-09-29T22:04:20.141330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YALA.csv [2025-09-29T22:04:20.141480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IP.csv [2025-09-29T22:04:20.141583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVY.csv [2025-09-29T22:04:20.141729] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNO.csv [2025-09-29T22:04:20.141846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEXA.csv [2025-09-29T22:04:20.142033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMHC.csv [2025-09-29T22:04:20.142156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPC.csv [2025-09-29T22:04:20.142280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/K.csv [2025-09-29T22:04:20.142393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HDB.csv [2025-09-29T22:04:20.143318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAFE.csv [2025-09-29T22:04:20.143439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHM.csv [2025-09-29T22:04:20.143664] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QTWO.csv [2025-09-29T22:04:20.143808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOK.csv [2025-09-29T22:04:20.144033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPCE.csv [2025-09-29T22:04:20.144152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOAR.csv [2025-09-29T22:04:20.144295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPF.csv [2025-09-29T22:04:20.144401] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFX.csv [2025-09-29T22:04:20.144538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLIO.csv [2025-09-29T22:04:20.144750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDR.csv [2025-09-29T22:04:20.144892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMX.csv [2025-09-29T22:04:20.145125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RTO.csv [2025-09-29T22:04:20.145284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTO.csv [2025-09-29T22:04:20.145383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOA.csv [2025-09-29T22:04:20.145487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLS.csv [2025-09-29T22:04:20.145700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TM.csv [2025-09-29T22:04:20.145864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERJ.csv [2025-09-29T22:04:20.146110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNC.csv [2025-09-29T22:04:20.146235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPLX.csv [2025-09-29T22:04:20.146421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PX.csv [2025-09-29T22:04:20.146521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MED.csv [2025-09-29T22:04:20.146742] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPE.csv [2025-09-29T22:04:20.147009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIK.csv [2025-09-29T22:04:20.147221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGR.csv [2025-09-29T22:04:20.147400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFWM.csv [2025-09-29T22:04:20.147740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPF.csv [2025-09-29T22:04:20.147984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSI.csv [2025-09-29T22:04:20.148125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDU.csv [2025-09-29T22:04:20.148389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTMX.csv [2025-09-29T22:04:20.148544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBM.csv [2025-09-29T22:04:20.148711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECG.csv [2025-09-29T22:04:20.148911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFT.csv [2025-09-29T22:04:20.149057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CANG.csv [2025-09-29T22:04:20.149322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTI.csv [2025-09-29T22:04:20.149579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UIS.csv [2025-09-29T22:04:20.149826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RC.csv [2025-09-29T22:04:20.149973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/C.csv [2025-09-29T22:04:20.150121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LII.csv [2025-09-29T22:04:20.150260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVH.csv [2025-09-29T22:04:20.150397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPRT.csv [2025-09-29T22:04:20.150549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCI.csv [2025-09-29T22:04:20.150719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIO.csv [2025-09-29T22:04:20.150849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOTE.csv [2025-09-29T22:04:20.151205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SABA.csv [2025-09-29T22:04:20.151505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSH.csv [2025-09-29T22:04:20.151778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVK.csv [2025-09-29T22:04:20.151933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHLD.csv [2025-09-29T22:04:20.152032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDD.csv [2025-09-29T22:04:20.152102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESE.csv [2025-09-29T22:04:20.152243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GF.csv [2025-09-29T22:04:20.152366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GE.csv [2025-09-29T22:04:20.152551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSI.csv [2025-09-29T22:04:20.152710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEN.csv [2025-09-29T22:04:20.152839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGV.csv [2025-09-29T22:04:20.152957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGC.csv [2025-09-29T22:04:20.153060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FT.csv [2025-09-29T22:04:20.153200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQY.csv [2025-09-29T22:04:20.153332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOOS.csv [2025-09-29T22:04:20.153567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNMA.csv [2025-09-29T22:04:20.153746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSAC.csv [2025-09-29T22:04:20.153876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAR.csv [2025-09-29T22:04:20.153982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIP.csv [2025-09-29T22:04:20.154078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EB.csv [2025-09-29T22:04:20.154234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKIL.csv [2025-09-29T22:04:20.154353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSM.csv [2025-09-29T22:04:20.154459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFH.csv [2025-09-29T22:04:20.154628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIV.csv [2025-09-29T22:04:20.154868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTOL.csv [2025-09-29T22:04:20.154962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATMU.csv [2025-09-29T22:04:20.155041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXL.csv [2025-09-29T22:04:20.155136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLI.csv [2025-09-29T22:04:20.155231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUC.csv [2025-09-29T22:04:20.155415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEE.csv [2025-09-29T22:04:20.155540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWRE.csv [2025-09-29T22:04:20.155768] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFL.csv [2025-09-29T22:04:20.156009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WINN.csv [2025-09-29T22:04:20.156193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UE.csv [2025-09-29T22:04:20.156337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBAB.csv [2025-09-29T22:04:20.156443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEB.csv [2025-09-29T22:04:20.156549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIV.csv [2025-09-29T22:04:20.156672] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEL.csv [2025-09-29T22:04:20.156813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QS.csv [2025-09-29T22:04:20.156904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHI.csv [2025-09-29T22:04:20.157081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGM.csv [2025-09-29T22:04:20.157213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTD.csv [2025-09-29T22:04:20.157305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASX.csv [2025-09-29T22:04:20.157531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOLF.csv [2025-09-29T22:04:20.157672] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELC.csv [2025-09-29T22:04:20.157800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWH.csv [2025-09-29T22:04:20.157992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNN.csv [2025-09-29T22:04:20.158093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVST.csv [2025-09-29T22:04:20.158172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LCII.csv [2025-09-29T22:04:20.158436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOS.csv [2025-09-29T22:04:20.158574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNOP.csv [2025-09-29T22:04:20.159019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIM.csv [2025-09-29T22:04:20.159151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBC.csv [2025-09-29T22:04:20.159301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLF.csv [2025-09-29T22:04:20.159464] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMI.csv [2025-09-29T22:04:20.159676] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAIN.csv [2025-09-29T22:04:20.159961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAK.csv [2025-09-29T22:04:20.160220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLG.csv [2025-09-29T22:04:20.160426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEAF.csv [2025-09-29T22:04:20.160569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSM.csv [2025-09-29T22:04:20.160774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVR.csv [2025-09-29T22:04:20.160950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELS.csv [2025-09-29T22:04:20.161203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WH.csv [2025-09-29T22:04:20.161362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPV.csv [2025-09-29T22:04:20.161600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGNA.csv [2025-09-29T22:04:20.161775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CC.csv [2025-09-29T22:04:20.162021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAM.csv [2025-09-29T22:04:20.162163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COTY.csv [2025-09-29T22:04:20.162338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFH.csv [2025-09-29T22:04:20.162474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAY.csv [2025-09-29T22:04:20.162694] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMWB.csv [2025-09-29T22:04:20.162823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBF.csv [2025-09-29T22:04:20.163179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOUS.csv [2025-09-29T22:04:20.163337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRO.csv [2025-09-29T22:04:20.163485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOG.csv [2025-09-29T22:04:20.163773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHIN.csv [2025-09-29T22:04:20.163872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPL.csv [2025-09-29T22:04:20.163943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDN.csv [2025-09-29T22:04:20.164033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOTU.csv [2025-09-29T22:04:20.164170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAD.csv [2025-09-29T22:04:20.164288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYD.csv [2025-09-29T22:04:20.164431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSTZ.csv [2025-09-29T22:04:20.164524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOX.csv [2025-09-29T22:04:20.164621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIN.csv [2025-09-29T22:04:20.164769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOF.csv [2025-09-29T22:04:20.164928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMC.csv [2025-09-29T22:04:20.165096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THR.csv [2025-09-29T22:04:20.165206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NE.csv [2025-09-29T22:04:20.165438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHR.csv [2025-09-29T22:04:20.165780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSTG.csv [2025-09-29T22:04:20.165961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCM.csv [2025-09-29T22:04:20.166127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AM.csv [2025-09-29T22:04:20.166228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEG.csv [2025-09-29T22:04:20.166308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASA.csv [2025-09-29T22:04:20.166445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNSO.csv [2025-09-29T22:04:20.166607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLI.csv [2025-09-29T22:04:20.166778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARW.csv [2025-09-29T22:04:20.166877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHM.csv [2025-09-29T22:04:20.167004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EW.csv [2025-09-29T22:04:20.167118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPWR.csv [2025-09-29T22:04:20.167212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FGN.csv [2025-09-29T22:04:20.167305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTO.csv [2025-09-29T22:04:20.167507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PH.csv [2025-09-29T22:04:20.167616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APOS.csv [2025-09-29T22:04:20.167775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DD.csv [2025-09-29T22:04:20.167893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWEN.csv [2025-09-29T22:04:20.168102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWLO.csv [2025-09-29T22:04:20.168274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRNO.csv [2025-09-29T22:04:20.168452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSO.csv [2025-09-29T22:04:20.168618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBT.csv [2025-09-29T22:04:20.168799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UDR.csv [2025-09-29T22:04:20.168908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETG.csv [2025-09-29T22:04:20.169010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTGC.csv [2025-09-29T22:04:20.169118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAAP.csv [2025-09-29T22:04:20.169243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSL.csv [2025-09-29T22:04:20.169347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ISD.csv [2025-09-29T22:04:20.169530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THG.csv [2025-09-29T22:04:20.169624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETB.csv [2025-09-29T22:04:20.169759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNK.csv [2025-09-29T22:04:20.169867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOV.csv [2025-09-29T22:04:20.170068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYI.csv [2025-09-29T22:04:20.170162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FE.csv [2025-09-29T22:04:20.170450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXK.csv [2025-09-29T22:04:20.170665] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDY.csv [2025-09-29T22:04:20.170818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFF.csv [2025-09-29T22:04:20.170944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGM.csv [2025-09-29T22:04:20.171549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTI.csv [2025-09-29T22:04:20.171841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMP.csv [2025-09-29T22:04:20.172050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRG.csv [2025-09-29T22:04:20.172287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCS.csv [2025-09-29T22:04:20.172825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCS.csv [2025-09-29T22:04:20.172975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAM.csv [2025-09-29T22:04:20.173178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCC.csv [2025-09-29T22:04:20.173321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNT.csv [2025-09-29T22:04:20.173451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSI.csv [2025-09-29T22:04:20.173570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COF.csv [2025-09-29T22:04:20.173794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIV.csv [2025-09-29T22:04:20.174011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNH.csv [2025-09-29T22:04:20.174150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXM.csv [2025-09-29T22:04:20.174277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRL.csv [2025-09-29T22:04:20.174591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGT.csv [2025-09-29T22:04:20.174848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJM.csv [2025-09-29T22:04:20.175073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SN.csv [2025-09-29T22:04:20.175263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PERF.csv [2025-09-29T22:04:20.175435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DV.csv [2025-09-29T22:04:20.175546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BG.csv [2025-09-29T22:04:20.175681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGC.csv [2025-09-29T22:04:20.175776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPCT.csv [2025-09-29T22:04:20.175918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHAK.csv [2025-09-29T22:04:20.176027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALSN.csv [2025-09-29T22:04:20.176230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UPS.csv [2025-09-29T22:04:20.176372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNC.csv [2025-09-29T22:04:20.176494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQV.csv [2025-09-29T22:04:20.176623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESI.csv [2025-09-29T22:04:20.176760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCJ.csv [2025-09-29T22:04:20.176908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TG.csv [2025-09-29T22:04:20.177062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSM.csv [2025-09-29T22:04:20.177254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDH.csv [2025-09-29T22:04:20.177388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBNA.csv [2025-09-29T22:04:20.177832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REXR.csv [2025-09-29T22:04:20.178034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RKT.csv [2025-09-29T22:04:20.178163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/G.csv [2025-09-29T22:04:20.178291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRT.csv [2025-09-29T22:04:20.178475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VCV.csv [2025-09-29T22:04:20.178588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESNT.csv [2025-09-29T22:04:20.178745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNH.csv [2025-09-29T22:04:20.178866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOE.csv [2025-09-29T22:04:20.178998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSU.csv [2025-09-29T22:04:20.179129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRNT.csv [2025-09-29T22:04:20.179255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETW.csv [2025-09-29T22:04:20.179354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSW.csv [2025-09-29T22:04:20.179423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATS.csv [2025-09-29T22:04:20.179526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGY.csv [2025-09-29T22:04:20.179807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEL.csv [2025-09-29T22:04:20.179919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KT.csv [2025-09-29T22:04:20.180101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GS.csv [2025-09-29T22:04:20.180221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARS.csv [2025-09-29T22:04:20.180339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEO.csv [2025-09-29T22:04:20.180459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPG.csv [2025-09-29T22:04:20.180569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPC.csv [2025-09-29T22:04:20.180694] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LFT.csv [2025-09-29T22:04:20.180800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPI.csv [2025-09-29T22:04:20.180949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPJA.csv [2025-09-29T22:04:20.181256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKU.csv [2025-09-29T22:04:20.181366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIIN.csv [2025-09-29T22:04:20.181537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAC.csv [2025-09-29T22:04:20.181723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTE.csv [2025-09-29T22:04:20.181897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TK.csv [2025-09-29T22:04:20.182263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RHP.csv [2025-09-29T22:04:20.182411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLD.csv [2025-09-29T22:04:20.182546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLP.csv [2025-09-29T22:04:20.182710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBH.csv [2025-09-29T22:04:20.183043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USAC.csv [2025-09-29T22:04:20.183217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYM.csv [2025-09-29T22:04:20.183371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLT.csv [2025-09-29T22:04:20.183550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDT.csv [2025-09-29T22:04:20.183812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSM.csv [2025-09-29T22:04:20.183958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDO.csv [2025-09-29T22:04:20.184104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLY.csv [2025-09-29T22:04:20.184280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAVA.csv [2025-09-29T22:04:20.184410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOG.csv [2025-09-29T22:04:20.184674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZKH.csv [2025-09-29T22:04:20.185195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RQI.csv [2025-09-29T22:04:20.185444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/T.csv [2025-09-29T22:04:20.185837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSG.csv [2025-09-29T22:04:20.185989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OBK.csv [2025-09-29T22:04:20.186122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HZO.csv [2025-09-29T22:04:20.186444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STRV.csv [2025-09-29T22:04:20.186618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLX.csv [2025-09-29T22:04:20.186783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FXED.csv [2025-09-29T22:04:20.186994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THQ.csv [2025-09-29T22:04:20.187177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCU.csv [2025-09-29T22:04:20.187338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWH.csv [2025-09-29T22:04:20.187461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMD.csv [2025-09-29T22:04:20.187595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOUG.csv [2025-09-29T22:04:20.187762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEGI.csv [2025-09-29T22:04:20.187907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CE.csv [2025-09-29T22:04:20.188027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMND.csv [2025-09-29T22:04:20.188131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNN.csv [2025-09-29T22:04:20.188254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHI.csv [2025-09-29T22:04:20.188382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMG.csv [2025-09-29T22:04:20.188819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PML.csv [2025-09-29T22:04:20.188930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIG.csv [2025-09-29T22:04:20.189079] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OUT.csv [2025-09-29T22:04:20.189217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUE.csv [2025-09-29T22:04:20.189420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCCO.csv [2025-09-29T22:04:20.189527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFC.csv [2025-09-29T22:04:20.189625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPK.csv [2025-09-29T22:04:20.189828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEX.csv [2025-09-29T22:04:20.189925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASB.csv [2025-09-29T22:04:20.190053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PTA.csv [2025-09-29T22:04:20.190187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMC.csv [2025-09-29T22:04:20.190609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGA.csv [2025-09-29T22:04:20.190861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SES.csv [2025-09-29T22:04:20.190972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVAL.csv [2025-09-29T22:04:20.191100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGS.csv [2025-09-29T22:04:20.191280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWX.csv [2025-09-29T22:04:20.191578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSBD.csv [2025-09-29T22:04:20.191708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEE.csv [2025-09-29T22:04:20.192122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXE.csv [2025-09-29T22:04:20.192241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEP.csv [2025-09-29T22:04:20.192336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDOS.csv [2025-09-29T22:04:20.192713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFMZ.csv [2025-09-29T22:04:20.192813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EC.csv [2025-09-29T22:04:20.192884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPX.csv [2025-09-29T22:04:20.193018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOBO.csv [2025-09-29T22:04:20.193184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/POR.csv [2025-09-29T22:04:20.193288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEC.csv [2025-09-29T22:04:20.193407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CI.csv [2025-09-29T22:04:20.193576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOYA.csv [2025-09-29T22:04:20.193695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEU.csv [2025-09-29T22:04:20.193796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXP.csv [2025-09-29T22:04:20.193907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NFG.csv [2025-09-29T22:04:20.194004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMX.csv [2025-09-29T22:04:20.194183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VST.csv [2025-09-29T22:04:20.194359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRO.csv [2025-09-29T22:04:20.194541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZK.csv [2025-09-29T22:04:20.194837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNFI.csv [2025-09-29T22:04:20.194939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/E.csv [2025-09-29T22:04:20.195054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NET.csv [2025-09-29T22:04:20.195150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRC.csv [2025-09-29T22:04:20.195222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBWI.csv [2025-09-29T22:04:20.195448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TR.csv [2025-09-29T22:04:20.195608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RM.csv [2025-09-29T22:04:20.195874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGER.csv [2025-09-29T22:04:20.196108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEL.csv [2025-09-29T22:04:20.196233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEX.csv [2025-09-29T22:04:20.196361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKT.csv [2025-09-29T22:04:20.196489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ING.csv [2025-09-29T22:04:20.196713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPE.csv [2025-09-29T22:04:20.196926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGU.csv [2025-09-29T22:04:20.197209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTUS.csv [2025-09-29T22:04:20.197402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OWLT.csv [2025-09-29T22:04:20.197546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARE.csv [2025-09-29T22:04:20.197696] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGB.csv [2025-09-29T22:04:20.197818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMX.csv [2025-09-29T22:04:20.198042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTTR.csv [2025-09-29T22:04:20.198306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRTS.csv [2025-09-29T22:04:20.198434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAN.csv [2025-09-29T22:04:20.198624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOW.csv [2025-09-29T22:04:20.198831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFRC.csv [2025-09-29T22:04:20.199070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSF.csv [2025-09-29T22:04:20.199206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GME.csv [2025-09-29T22:04:20.199366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCC.csv [2025-09-29T22:04:20.199605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLNT.csv [2025-09-29T22:04:20.199762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGB.csv [2025-09-29T22:04:20.199940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGI.csv [2025-09-29T22:04:20.200119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UCB.csv [2025-09-29T22:04:20.200305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLT.csv [2025-09-29T22:04:20.200423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRE.csv [2025-09-29T22:04:20.200512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMI.csv [2025-09-29T22:04:20.200858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USPH.csv [2025-09-29T22:04:20.200970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTC.csv [2025-09-29T22:04:20.201082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCL.csv [2025-09-29T22:04:20.201200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DKS.csv [2025-09-29T22:04:20.201317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUI.csv [2025-09-29T22:04:20.201444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFH.csv [2025-09-29T22:04:20.201568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETX.csv [2025-09-29T22:04:20.201693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRT.csv [2025-09-29T22:04:20.201844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACN.csv [2025-09-29T22:04:20.202082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVTY.csv [2025-09-29T22:04:20.202255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMPO.csv [2025-09-29T22:04:20.202374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPJ.csv [2025-09-29T22:04:20.202470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHD.csv [2025-09-29T22:04:20.202542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KD.csv [2025-09-29T22:04:20.202636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNJ.csv [2025-09-29T22:04:20.202792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOLF.csv [2025-09-29T22:04:20.202994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPGI.csv [2025-09-29T22:04:20.203112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIR.csv [2025-09-29T22:04:20.203505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NATL.csv [2025-09-29T22:04:20.203788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSW.csv [2025-09-29T22:04:20.203931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOW.csv [2025-09-29T22:04:20.204123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITE.csv [2025-09-29T22:04:20.204539] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAH.csv [2025-09-29T22:04:20.204852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIF.csv [2025-09-29T22:04:20.204984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRG.csv [2025-09-29T22:04:20.205101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEO.csv [2025-09-29T22:04:20.205199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIO.csv [2025-09-29T22:04:20.205273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KN.csv [2025-09-29T22:04:20.205364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COHR.csv [2025-09-29T22:04:20.205460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCT.csv [2025-09-29T22:04:20.205703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RRC.csv [2025-09-29T22:04:20.205863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GATX.csv [2025-09-29T22:04:20.206269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJC.csv [2025-09-29T22:04:20.206533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEC.csv [2025-09-29T22:04:20.206775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PARR.csv [2025-09-29T22:04:20.206912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HD.csv [2025-09-29T22:04:20.207259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAN.csv [2025-09-29T22:04:20.208036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WGO.csv [2025-09-29T22:04:20.208169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARR.csv [2025-09-29T22:04:20.208289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHX.csv [2025-09-29T22:04:20.208398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GKOS.csv [2025-09-29T22:04:20.208557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCD.csv [2025-09-29T22:04:20.208727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKE.csv [2025-09-29T22:04:20.208907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSD.csv [2025-09-29T22:04:20.209090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMD.csv [2025-09-29T22:04:20.209258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICL.csv [2025-09-29T22:04:20.209505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSR.csv [2025-09-29T22:04:20.209672] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DB.csv [2025-09-29T22:04:20.209827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQT.csv [2025-09-29T22:04:20.209976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTR.csv [2025-09-29T22:04:20.210097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGM.csv [2025-09-29T22:04:20.210245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCO.csv [2025-09-29T22:04:20.210378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLW.csv [2025-09-29T22:04:20.210503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITT.csv [2025-09-29T22:04:20.210610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQT.csv [2025-09-29T22:04:20.210831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALE.csv [2025-09-29T22:04:20.210970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOD.csv [2025-09-29T22:04:20.211132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBI.csv [2025-09-29T22:04:20.211280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIE.csv [2025-09-29T22:04:20.211414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPS.csv [2025-09-29T22:04:20.211547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LB.csv [2025-09-29T22:04:20.211902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPL.csv [2025-09-29T22:04:20.212025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNSL.csv [2025-09-29T22:04:20.212183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STVN.csv [2025-09-29T22:04:20.212294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CON.csv [2025-09-29T22:04:20.212526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAL.csv [2025-09-29T22:04:20.212891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROK.csv [2025-09-29T22:04:20.213058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTA.csv [2025-09-29T22:04:20.213200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LND.csv [2025-09-29T22:04:20.213383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFF.csv [2025-09-29T22:04:20.213546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMTG.csv [2025-09-29T22:04:20.213754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JILL.csv [2025-09-29T22:04:20.213984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRU.csv [2025-09-29T22:04:20.214327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SB.csv [2025-09-29T22:04:20.214919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RF.csv [2025-09-29T22:04:20.215060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JMIA.csv [2025-09-29T22:04:20.215243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIC.csv [2025-09-29T22:04:20.215499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMC.csv [2025-09-29T22:04:20.215619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONIT.csv [2025-09-29T22:04:20.215861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGS.csv [2025-09-29T22:04:20.216119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TU.csv [2025-09-29T22:04:20.216327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIO.csv [2025-09-29T22:04:20.216477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBD.csv [2025-09-29T22:04:20.216748] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGI.csv [2025-09-29T22:04:20.216985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASPN.csv [2025-09-29T22:04:20.217088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NWG.csv [2025-09-29T22:04:20.217276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RJF.csv [2025-09-29T22:04:20.217377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRI.csv [2025-09-29T22:04:20.217491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMY.csv [2025-09-29T22:04:20.217731] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TV.csv [2025-09-29T22:04:20.217942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBB.csv [2025-09-29T22:04:20.218074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCH.csv [2025-09-29T22:04:20.218289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDA.csv [2025-09-29T22:04:20.218512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCK.csv [2025-09-29T22:04:20.218726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAH.csv [2025-09-29T22:04:20.218871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HL.csv [2025-09-29T22:04:20.219007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FND.csv [2025-09-29T22:04:20.219141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRT.csv [2025-09-29T22:04:20.219480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TISI.csv [2025-09-29T22:04:20.219730] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRFM.csv [2025-09-29T22:04:20.219869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMO.csv [2025-09-29T22:04:20.220004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCN.csv [2025-09-29T22:04:20.220260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKST.csv [2025-09-29T22:04:20.220402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMH.csv [2025-09-29T22:04:20.220529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNTK.csv [2025-09-29T22:04:20.220694] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATI.csv [2025-09-29T22:04:20.220956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPC.csv [2025-09-29T22:04:20.221126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNM.csv [2025-09-29T22:04:20.221261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDA.csv [2025-09-29T22:04:20.221375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNI.csv [2025-09-29T22:04:20.221498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETD.csv [2025-09-29T22:04:20.221626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHK.csv [2025-09-29T22:04:20.221895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEI.csv [2025-09-29T22:04:20.222096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TALO.csv [2025-09-29T22:04:20.222252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMT.csv [2025-09-29T22:04:20.222475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDLR.csv [2025-09-29T22:04:20.222711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADCT.csv [2025-09-29T22:04:20.222908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKC.csv [2025-09-29T22:04:20.223035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRSP.csv [2025-09-29T22:04:20.223228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKYH.csv [2025-09-29T22:04:20.223330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MXF.csv [2025-09-29T22:04:20.223427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIHL.csv [2025-09-29T22:04:20.223538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DKL.csv [2025-09-29T22:04:20.223679] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVT.csv [2025-09-29T22:04:20.223826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHR.csv [2025-09-29T22:04:20.224000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDF.csv [2025-09-29T22:04:20.224245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIP.csv [2025-09-29T22:04:20.224437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAAS.csv [2025-09-29T22:04:20.224635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHCO.csv [2025-09-29T22:04:20.224805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HY.csv [2025-09-29T22:04:20.224943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSGS.csv [2025-09-29T22:04:20.225187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOST.csv [2025-09-29T22:04:20.225316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOND.csv [2025-09-29T22:04:20.225674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPG.csv [2025-09-29T22:04:20.225790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AON.csv [2025-09-29T22:04:20.225903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXW.csv [2025-09-29T22:04:20.226020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NLOP.csv [2025-09-29T22:04:20.226231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDW.csv [2025-09-29T22:04:20.226457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RPT.csv [2025-09-29T22:04:20.226585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KSS.csv [2025-09-29T22:04:20.226730] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEF.csv [2025-09-29T22:04:20.226846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEC.csv [2025-09-29T22:04:20.227026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NQP.csv [2025-09-29T22:04:20.227266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNV.csv [2025-09-29T22:04:20.227391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBY.csv [2025-09-29T22:04:20.227875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRE.csv [2025-09-29T22:04:20.228005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTM.csv [2025-09-29T22:04:20.228169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBA.csv [2025-09-29T22:04:20.228318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LBRT.csv [2025-09-29T22:04:20.228457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAK.csv [2025-09-29T22:04:20.228633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMI.csv [2025-09-29T22:04:20.228799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDX.csv [2025-09-29T22:04:20.228949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VHI.csv [2025-09-29T22:04:20.229081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FI.csv [2025-09-29T22:04:20.229238] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAO.csv [2025-09-29T22:04:20.229443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YOU.csv [2025-09-29T22:04:20.229556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONTF.csv [2025-09-29T22:04:20.229727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAR.csv [2025-09-29T22:04:20.229871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNTY.csv [2025-09-29T22:04:20.230013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENOV.csv [2025-09-29T22:04:20.230139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KORE.csv [2025-09-29T22:04:20.230330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBS.csv [2025-09-29T22:04:20.230543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVV.csv [2025-09-29T22:04:20.230782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSFE.csv [2025-09-29T22:04:20.231155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YEXT.csv [2025-09-29T22:04:20.231272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HNI.csv [2025-09-29T22:04:20.231396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMI.csv [2025-09-29T22:04:20.231576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHCT.csv [2025-09-29T22:04:20.231741] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTB.csv [2025-09-29T22:04:20.231874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIF.csv [2025-09-29T22:04:20.232018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUB.csv [2025-09-29T22:04:20.232160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACVA.csv [2025-09-29T22:04:20.232328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PACS.csv [2025-09-29T22:04:20.232457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAN.csv [2025-09-29T22:04:20.232712] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMMZ.csv [2025-09-29T22:04:20.232930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PINE.csv [2025-09-29T22:04:20.233047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GXO.csv [2025-09-29T22:04:20.233169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMF.csv [2025-09-29T22:04:20.233373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXD.csv [2025-09-29T22:04:20.233475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BA.csv [2025-09-29T22:04:20.233620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUM.csv [2025-09-29T22:04:20.234027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLN.csv [2025-09-29T22:04:20.234235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQM.csv [2025-09-29T22:04:20.234333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIX.csv [2025-09-29T22:04:20.234498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PINS.csv [2025-09-29T22:04:20.234614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLNG.csv [2025-09-29T22:04:20.234787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLY.csv [2025-09-29T22:04:20.235145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PII.csv [2025-09-29T22:04:20.235277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFL.csv [2025-09-29T22:04:20.235377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOS.csv [2025-09-29T22:04:20.235502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNX.csv [2025-09-29T22:04:20.235614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSLY.csv [2025-09-29T22:04:20.235778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWW.csv [2025-09-29T22:04:20.235863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVG.csv [2025-09-29T22:04:20.235996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNA.csv [2025-09-29T22:04:20.236258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XFLT.csv [2025-09-29T22:04:20.236368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DUK.csv [2025-09-29T22:04:20.236504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIB.csv [2025-09-29T22:04:20.236604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTH.csv [2025-09-29T22:04:20.236723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAL.csv [2025-09-29T22:04:20.236884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USNA.csv [2025-09-29T22:04:20.237083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRV.csv [2025-09-29T22:04:20.237266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYK.csv [2025-09-29T22:04:20.237379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FET.csv [2025-09-29T22:04:20.237484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMN.csv [2025-09-29T22:04:20.237581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMCR.csv [2025-09-29T22:04:20.237684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADX.csv [2025-09-29T22:04:20.237780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFG.csv [2025-09-29T22:04:20.237894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THIR.csv [2025-09-29T22:04:20.238018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPAD.csv [2025-09-29T22:04:20.238112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCE.csv [2025-09-29T22:04:20.238206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSHP.csv [2025-09-29T22:04:20.238339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRP.csv [2025-09-29T22:04:20.238439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYG.csv [2025-09-29T22:04:20.238546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOH.csv [2025-09-29T22:04:20.238697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKL.csv [2025-09-29T22:04:20.238819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDT.csv [2025-09-29T22:04:20.238989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/W.csv [2025-09-29T22:04:20.239179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WU.csv [2025-09-29T22:04:20.239276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NSP.csv [2025-09-29T22:04:20.239375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXT.csv [2025-09-29T22:04:20.239468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLH.csv [2025-09-29T22:04:20.239616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMP.csv [2025-09-29T22:04:20.239824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLJ.csv [2025-09-29T22:04:20.239948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTCM.csv [2025-09-29T22:04:20.240286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTS.csv [2025-09-29T22:04:20.240384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCC.csv [2025-09-29T22:04:20.240465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBB.csv [2025-09-29T22:04:20.240614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TUYA.csv [2025-09-29T22:04:20.240969] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PUK.csv [2025-09-29T22:04:20.241102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSBR.csv [2025-09-29T22:04:20.241227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSGE.csv [2025-09-29T22:04:20.241538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCI.csv [2025-09-29T22:04:20.241634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FAF.csv [2025-09-29T22:04:20.241781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAR.csv [2025-09-29T22:04:20.241901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGLB.csv [2025-09-29T22:04:20.241997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMC.csv [2025-09-29T22:04:20.242103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAP.csv [2025-09-29T22:04:20.242199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFAM.csv [2025-09-29T22:04:20.242266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/F.csv [2025-09-29T22:04:20.242386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSQH.csv [2025-09-29T22:04:20.242669] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVE.csv [2025-09-29T22:04:20.242782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EEX.csv [2025-09-29T22:04:20.242875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRTG.csv [2025-09-29T22:04:20.242958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEYS.csv [2025-09-29T22:04:20.243053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRI.csv [2025-09-29T22:04:20.243179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXI.csv [2025-09-29T22:04:20.243291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOH.csv [2025-09-29T22:04:20.243382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBT.csv [2025-09-29T22:04:20.243469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSK.csv [2025-09-29T22:04:20.243590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HWM.csv [2025-09-29T22:04:20.243717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSY.csv [2025-09-29T22:04:20.243873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHI.csv [2025-09-29T22:04:20.244302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PTY.csv [2025-09-29T22:04:20.244422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSA.csv [2025-09-29T22:04:20.244611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSI.csv [2025-09-29T22:04:20.244809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ST.csv [2025-09-29T22:04:20.244955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALG.csv [2025-09-29T22:04:20.245052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWG.csv [2025-09-29T22:04:20.245122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPI.csv [2025-09-29T22:04:20.245190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRT.csv [2025-09-29T22:04:20.245268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOW.csv [2025-09-29T22:04:20.245446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/V.csv [2025-09-29T22:04:20.245834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTDR.csv [2025-09-29T22:04:20.245930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLPR.csv [2025-09-29T22:04:20.246088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHY.csv [2025-09-29T22:04:20.246186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBI.csv [2025-09-29T22:04:20.246334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TY.csv [2025-09-29T22:04:20.246469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOMB.csv [2025-09-29T22:04:20.246632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEA.csv [2025-09-29T22:04:20.246804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLW.csv [2025-09-29T22:04:20.246902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KYN.csv [2025-09-29T22:04:20.247018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCS.csv [2025-09-29T22:04:20.247147] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPI.csv [2025-09-29T22:04:20.247266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYV.csv [2025-09-29T22:04:20.247471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXX.csv [2025-09-29T22:04:20.247578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMCO.csv [2025-09-29T22:04:20.247731] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRGE.csv [2025-09-29T22:04:20.247930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPEV.csv [2025-09-29T22:04:20.248080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YRD.csv [2025-09-29T22:04:20.248173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESRT.csv [2025-09-29T22:04:20.248267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KW.csv [2025-09-29T22:04:20.248441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMM.csv [2025-09-29T22:04:20.248595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENB.csv [2025-09-29T22:04:20.248734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITW.csv [2025-09-29T22:04:20.248887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SVV.csv [2025-09-29T22:04:20.249082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLF.csv [2025-09-29T22:04:20.249200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPV.csv [2025-09-29T22:04:20.249305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTX.csv [2025-09-29T22:04:20.249425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLB.csv [2025-09-29T22:04:20.249589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSM.csv [2025-09-29T22:04:20.249730] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANF.csv [2025-09-29T22:04:20.250195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCHW.csv [2025-09-29T22:04:20.250300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGM.csv [2025-09-29T22:04:20.250381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANET.csv [2025-09-29T22:04:20.250487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQV.csv [2025-09-29T22:04:20.250669] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THC.csv [2025-09-29T22:04:20.250780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUXX.csv [2025-09-29T22:04:20.250915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLN.csv [2025-09-29T22:04:20.251113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBS.csv [2025-09-29T22:04:20.251273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZEPP.csv [2025-09-29T22:04:20.251399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIA.csv [2025-09-29T22:04:20.251557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNM.csv [2025-09-29T22:04:20.251940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PK.csv [2025-09-29T22:04:20.252088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLRS.csv [2025-09-29T22:04:20.252202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OEC.csv [2025-09-29T22:04:20.252294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IT.csv [2025-09-29T22:04:20.252364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTC.csv [2025-09-29T22:04:20.252448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVE.csv [2025-09-29T22:04:20.252574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFIN.csv [2025-09-29T22:04:20.252710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCI.csv [2025-09-29T22:04:20.252815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CATO.csv [2025-09-29T22:04:20.252944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGX.csv [2025-09-29T22:04:20.253066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IX.csv [2025-09-29T22:04:20.253357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/L.csv [2025-09-29T22:04:20.253455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGY.csv [2025-09-29T22:04:20.253621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSX.csv [2025-09-29T22:04:20.253780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYD.csv [2025-09-29T22:04:20.253955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDS.csv [2025-09-29T22:04:20.254050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AR.csv [2025-09-29T22:04:20.254195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCL.csv [2025-09-29T22:04:20.254353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBR.csv [2025-09-29T22:04:20.254457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPAY.csv [2025-09-29T22:04:20.254628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEG.csv [2025-09-29T22:04:20.254830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIEN.csv [2025-09-29T22:04:20.254945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBD.csv [2025-09-29T22:04:20.255076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWMX.csv [2025-09-29T22:04:20.255310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RTX.csv [2025-09-29T22:04:20.255478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AER.csv [2025-09-29T22:04:20.255613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRCC.csv [2025-09-29T22:04:20.255812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SU.csv [2025-09-29T22:04:20.255924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMC.csv [2025-09-29T22:04:20.256049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMU.csv [2025-09-29T22:04:20.256189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGH.csv [2025-09-29T22:04:20.256288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEF.csv [2025-09-29T22:04:20.256362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNS.csv [2025-09-29T22:04:20.256468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAYC.csv [2025-09-29T22:04:20.256587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNR.csv [2025-09-29T22:04:20.256713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMRE.csv [2025-09-29T22:04:20.256824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLR.csv [2025-09-29T22:04:20.256968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GM.csv [2025-09-29T22:04:20.257108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCI.csv [2025-09-29T22:04:20.257347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFL.csv [2025-09-29T22:04:20.257516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKY.csv [2025-09-29T22:04:20.257671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXG.csv [2025-09-29T22:04:20.257778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIO.csv [2025-09-29T22:04:20.257852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAYW.csv [2025-09-29T22:04:20.257921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MP.csv [2025-09-29T22:04:20.257998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGP.csv [2025-09-29T22:04:20.258187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORA.csv [2025-09-29T22:04:20.258352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLUT.csv [2025-09-29T22:04:20.258471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUFG.csv [2025-09-29T22:04:20.258598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEO.csv [2025-09-29T22:04:20.258877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLVM.csv [2025-09-29T22:04:20.258992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPT.csv [2025-09-29T22:04:20.259204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZE.csv [2025-09-29T22:04:20.259298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXH.csv [2025-09-29T22:04:20.259380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIS.csv [2025-09-29T22:04:20.259499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRP.csv [2025-09-29T22:04:20.259660] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEA.csv [2025-09-29T22:04:20.259761] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAS.csv [2025-09-29T22:04:20.259832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVWR.csv [2025-09-29T22:04:20.259933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSP.csv [2025-09-29T22:04:20.260066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEP.csv [2025-09-29T22:04:20.260208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUVB.csv [2025-09-29T22:04:20.260438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTS.csv [2025-09-29T22:04:20.260599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCI.csv [2025-09-29T22:04:20.260766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PWR.csv [2025-09-29T22:04:20.260860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBTG.csv [2025-09-29T22:04:20.260982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWN.csv [2025-09-29T22:04:20.261079] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGAU.csv [2025-09-29T22:04:20.261311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SR.csv [2025-09-29T22:04:20.261406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNH.csv [2025-09-29T22:04:20.261478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHS.csv [2025-09-29T22:04:20.261615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLK.csv [2025-09-29T22:04:20.261812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPOF.csv [2025-09-29T22:04:20.261918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BME.csv [2025-09-29T22:04:20.262048] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDT.csv [2025-09-29T22:04:20.262141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTLS.csv [2025-09-29T22:04:20.262239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYD.csv [2025-09-29T22:04:20.262865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PL.csv [2025-09-29T22:04:20.263037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDS.csv [2025-09-29T22:04:20.263241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSCO.csv [2025-09-29T22:04:20.263380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NZF.csv [2025-09-29T22:04:20.263477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLX.csv [2025-09-29T22:04:20.263582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OWL.csv [2025-09-29T22:04:20.263735] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKSY.csv [2025-09-29T22:04:20.263834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GES.csv [2025-09-29T22:04:20.263945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAX.csv [2025-09-29T22:04:20.264043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OLP.csv [2025-09-29T22:04:20.264136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLP.csv [2025-09-29T22:04:20.264266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTB.csv [2025-09-29T22:04:20.264363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INN.csv [2025-09-29T22:04:20.264489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHR.csv [2025-09-29T22:04:20.264596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCZ.csv [2025-09-29T22:04:20.264725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCA.csv [2025-09-29T22:04:20.264919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXC.csv [2025-09-29T22:04:20.265013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSK.csv [2025-09-29T22:04:20.265085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CQP.csv [2025-09-29T22:04:20.265286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STWD.csv [2025-09-29T22:04:20.265381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGRO.csv [2025-09-29T22:04:20.265462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACR.csv [2025-09-29T22:04:20.265570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDRE.csv [2025-09-29T22:04:20.265706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LSPD.csv [2025-09-29T22:04:20.265817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LGI.csv [2025-09-29T22:04:20.265967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIM.csv [2025-09-29T22:04:20.266060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHN.csv [2025-09-29T22:04:20.266212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEMR.csv [2025-09-29T22:04:20.266310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOE.csv [2025-09-29T22:04:20.266811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSTL.csv [2025-09-29T22:04:20.266977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFR.csv [2025-09-29T22:04:20.267104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NSA.csv [2025-09-29T22:04:20.267273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/URI.csv [2025-09-29T22:04:20.267368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHP.csv [2025-09-29T22:04:20.267491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGI.csv [2025-09-29T22:04:20.267607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBN.csv [2025-09-29T22:04:20.267837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZWS.csv [2025-09-29T22:04:20.267949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAD.csv [2025-09-29T22:04:20.268200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RS.csv [2025-09-29T22:04:20.268324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DGX.csv [2025-09-29T22:04:20.268419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBIN.csv [2025-09-29T22:04:20.268489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLLY.csv [2025-09-29T22:04:20.268566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFL.csv [2025-09-29T22:04:20.268777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBA.csv [2025-09-29T22:04:20.268941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YELP.csv [2025-09-29T22:04:20.269131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UI.csv [2025-09-29T22:04:20.269277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTR.csv [2025-09-29T22:04:20.269553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITT.csv [2025-09-29T22:04:20.269710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EG.csv [2025-09-29T22:04:20.269824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PATH.csv [2025-09-29T22:04:20.269915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLK.csv [2025-09-29T22:04:20.269995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQL.csv [2025-09-29T22:04:20.270154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJE.csv [2025-09-29T22:04:20.270248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGCO.csv [2025-09-29T22:04:20.270330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXP.csv [2025-09-29T22:04:20.270518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFIN.csv [2025-09-29T22:04:20.270670] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUYA.csv [2025-09-29T22:04:20.270777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATX.csv [2025-09-29T22:04:20.270882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PB.csv [2025-09-29T22:04:20.271048] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRTX.csv [2025-09-29T22:04:20.271168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBR.csv [2025-09-29T22:04:20.271269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPK.csv [2025-09-29T22:04:20.271339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSMC.csv [2025-09-29T22:04:20.271416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMY.csv [2025-09-29T22:04:20.271511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AN.csv [2025-09-29T22:04:20.271582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COR.csv [2025-09-29T22:04:20.271710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEG.csv [2025-09-29T22:04:20.271914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZD.csv [2025-09-29T22:04:20.272025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LADR.csv [2025-09-29T22:04:20.272146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBS.csv [2025-09-29T22:04:20.272311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMRT.csv [2025-09-29T22:04:20.272406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESTC.csv [2025-09-29T22:04:20.272517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OVV.csv [2025-09-29T22:04:20.272831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNAP.csv [2025-09-29T22:04:20.272942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHS.csv [2025-09-29T22:04:20.273041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCR.csv [2025-09-29T22:04:20.273128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSAN.csv [2025-09-29T22:04:20.273224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXE.csv [2025-09-29T22:04:20.273315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCRD.csv [2025-09-29T22:04:20.273481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RAMP.csv [2025-09-29T22:04:20.273590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHT.csv [2025-09-29T22:04:20.273877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIG.csv [2025-09-29T22:04:20.273989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OOMA.csv [2025-09-29T22:04:20.274121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGO.csv [2025-09-29T22:04:20.274270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RA.csv [2025-09-29T22:04:20.274364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DT.csv [2025-09-29T22:04:20.274444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSBC.csv [2025-09-29T22:04:20.274543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAW.csv [2025-09-29T22:04:20.274742] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SW.csv [2025-09-29T22:04:20.274836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELF.csv [2025-09-29T22:04:20.274975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRS.csv [2025-09-29T22:04:20.275175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TME.csv [2025-09-29T22:04:20.275361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYG.csv [2025-09-29T22:04:20.275473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AES.csv [2025-09-29T22:04:20.275588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAI.csv [2025-09-29T22:04:20.275737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXPD.csv [2025-09-29T22:04:20.275854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBI.csv [2025-09-29T22:04:20.275976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTOS.csv [2025-09-29T22:04:20.276109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDE.csv [2025-09-29T22:04:20.276210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NKX.csv [2025-09-29T22:04:20.276350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOW.csv [2025-09-29T22:04:20.276498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUW.csv [2025-09-29T22:04:20.276604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPX.csv [2025-09-29T22:04:20.276792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFBS.csv [2025-09-29T22:04:20.277037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSL.csv [2025-09-29T22:04:20.277158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFK.csv [2025-09-29T22:04:20.277265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HVT.csv [2025-09-29T22:04:20.277378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRE.csv [2025-09-29T22:04:20.277476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DELL.csv [2025-09-29T22:04:20.277607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THO.csv [2025-09-29T22:04:20.277812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAP.csv [2025-09-29T22:04:20.277947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGVC.csv [2025-09-29T22:04:20.278107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFLT.csv [2025-09-29T22:04:20.278227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEUE.csv [2025-09-29T22:04:20.278319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQBK.csv [2025-09-29T22:04:20.278387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLB.csv [2025-09-29T22:04:20.278453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLE.csv [2025-09-29T22:04:20.278537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLCO.csv [2025-09-29T22:04:20.278707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMH.csv [2025-09-29T22:04:20.278922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROL.csv [2025-09-29T22:04:20.279080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBL.csv [2025-09-29T22:04:20.279202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUN.csv [2025-09-29T22:04:20.279317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BN.csv [2025-09-29T22:04:20.279421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQNR.csv [2025-09-29T22:04:20.279517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAE.csv [2025-09-29T22:04:20.279631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHO.csv [2025-09-29T22:04:20.279778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPW.csv [2025-09-29T22:04:20.279884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOMR.csv [2025-09-29T22:04:20.280052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMBK.csv [2025-09-29T22:04:20.280145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAGN.csv [2025-09-29T22:04:20.280281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPH.csv [2025-09-29T22:04:20.280373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOA.csv [2025-09-29T22:04:20.280495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVC.csv [2025-09-29T22:04:20.280628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFGC.csv [2025-09-29T22:04:20.280747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMN.csv [2025-09-29T22:04:20.281171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSO.csv [2025-09-29T22:04:20.281334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STZ.csv [2025-09-29T22:04:20.281456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIO.csv [2025-09-29T22:04:20.281698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVX.csv [2025-09-29T22:04:20.281802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDE.csv [2025-09-29T22:04:20.282019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDS.csv [2025-09-29T22:04:20.282187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FERG.csv [2025-09-29T22:04:20.282295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOR.csv [2025-09-29T22:04:20.282388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOD.csv [2025-09-29T22:04:20.282815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPC.csv [2025-09-29T22:04:20.282973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYF.csv [2025-09-29T22:04:20.283085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBI.csv [2025-09-29T22:04:20.283252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TECK.csv [2025-09-29T22:04:20.283358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCB.csv [2025-09-29T22:04:20.283617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFM.csv [2025-09-29T22:04:20.283756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKC.csv [2025-09-29T22:04:20.283873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLX.csv [2025-09-29T22:04:20.283966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVZ.csv [2025-09-29T22:04:20.284117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/R.csv [2025-09-29T22:04:20.284217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMC.csv [2025-09-29T22:04:20.284315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCN.csv [2025-09-29T22:04:20.284409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LHX.csv [2025-09-29T22:04:20.284498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDC.csv [2025-09-29T22:04:20.284905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WF.csv [2025-09-29T22:04:20.285001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMRE.csv [2025-09-29T22:04:20.285099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUV.csv [2025-09-29T22:04:20.285294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTN.csv [2025-09-29T22:04:20.285390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWXT.csv [2025-09-29T22:04:20.285495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RPM.csv [2025-09-29T22:04:20.285565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANRO.csv [2025-09-29T22:04:20.285732] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPVG.csv [2025-09-29T22:04:20.285874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFC.csv [2025-09-29T22:04:20.285990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNE.csv [2025-09-29T22:04:20.286111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPV.csv [2025-09-29T22:04:20.286238] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SARO.csv [2025-09-29T22:04:20.286332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NWN.csv [2025-09-29T22:04:20.286404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIG.csv [2025-09-29T22:04:20.286492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVF.csv [2025-09-29T22:04:20.286628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLND.csv [2025-09-29T22:04:20.286804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNF.csv [2025-09-29T22:04:20.286979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLR.csv [2025-09-29T22:04:20.287073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NHI.csv [2025-09-29T22:04:20.287180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPAM.csv [2025-09-29T22:04:20.287304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPZ.csv [2025-09-29T22:04:20.287439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEM.csv [2025-09-29T22:04:20.287532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBN.csv [2025-09-29T22:04:20.287616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCF.csv [2025-09-29T22:04:20.287838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHD.csv [2025-09-29T22:04:20.287935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETY.csv [2025-09-29T22:04:20.288099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZETA.csv [2025-09-29T22:04:20.288265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBLX.csv [2025-09-29T22:04:20.288598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFC.csv [2025-09-29T22:04:20.288899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UP.csv [2025-09-29T22:04:20.289003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLS.csv [2025-09-29T22:04:20.289073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACHR.csv [2025-09-29T22:04:20.289191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STAG.csv [2025-09-29T22:04:20.289326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCIF.csv [2025-09-29T22:04:20.289426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KODK.csv [2025-09-29T22:04:20.289505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALB.csv [2025-09-29T22:04:20.289624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLDT.csv [2025-09-29T22:04:20.289762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARES.csv [2025-09-29T22:04:20.289901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PJT.csv [2025-09-29T22:04:20.290024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCI.csv [2025-09-29T22:04:20.290151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NLY.csv [2025-09-29T22:04:20.290339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VBF.csv [2025-09-29T22:04:20.290485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RY.csv [2025-09-29T22:04:20.290612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDRL.csv [2025-09-29T22:04:20.290757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATKR.csv [2025-09-29T22:04:20.290860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BX.csv [2025-09-29T22:04:20.290976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MWA.csv [2025-09-29T22:04:20.291089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GVA.csv [2025-09-29T22:04:20.291189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBP.csv [2025-09-29T22:04:20.291300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OFG.csv [2025-09-29T22:04:20.291431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIRK.csv [2025-09-29T22:04:20.291614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MS.csv [2025-09-29T22:04:20.291802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMM.csv [2025-09-29T22:04:20.291904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOMA.csv [2025-09-29T22:04:20.291999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BST.csv [2025-09-29T22:04:20.292142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNP.csv [2025-09-29T22:04:20.292260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNS.csv [2025-09-29T22:04:20.292363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQR.csv [2025-09-29T22:04:20.292488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECO.csv [2025-09-29T22:04:20.292674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBI.csv [2025-09-29T22:04:20.292780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRB.csv [2025-09-29T22:04:20.292925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBOT.csv [2025-09-29T22:04:20.293043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEV.csv [2025-09-29T22:04:20.293167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAB.csv [2025-09-29T22:04:20.293264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALC.csv [2025-09-29T22:04:20.293334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMRC.csv [2025-09-29T22:04:20.293421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQH.csv [2025-09-29T22:04:20.293757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QXO.csv [2025-09-29T22:04:20.293889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DY.csv [2025-09-29T22:04:20.293989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMA.csv [2025-09-29T22:04:20.294146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HFRO.csv [2025-09-29T22:04:20.294245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBB.csv [2025-09-29T22:04:20.294315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALIT.csv [2025-09-29T22:04:20.294527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAN.csv [2025-09-29T22:04:20.294932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRM.csv [2025-09-29T22:04:20.295033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AME.csv [2025-09-29T22:04:20.295110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZB.csv [2025-09-29T22:04:20.295183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKRS.csv [2025-09-29T22:04:20.295252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXN.csv [2025-09-29T22:04:20.295488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJD.csv [2025-09-29T22:04:20.295592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBB.csv [2025-09-29T22:04:20.295805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDM.csv [2025-09-29T22:04:20.295902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRC.csv [2025-09-29T22:04:20.295985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGA.csv [2025-09-29T22:04:20.296097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BE.csv [2025-09-29T22:04:20.296308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRA.csv [2025-09-29T22:04:20.296403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OII.csv [2025-09-29T22:04:20.296473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OCFT.csv [2025-09-29T22:04:20.296582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGB.csv [2025-09-29T22:04:20.296728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTM.csv [2025-09-29T22:04:20.296824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BANC.csv [2025-09-29T22:04:20.297019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSTK.csv [2025-09-29T22:04:20.297123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FC.csv [2025-09-29T22:04:20.297275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMED.csv [2025-09-29T22:04:20.297379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EL.csv [2025-09-29T22:04:20.297474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBVA.csv [2025-09-29T22:04:20.297608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJT.csv [2025-09-29T22:04:20.297732] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEI.csv [2025-09-29T22:04:20.297863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXDT.csv [2025-09-29T22:04:20.297955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEKE.csv [2025-09-29T22:04:20.298034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGS.csv [2025-09-29T22:04:20.298156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUSA.csv [2025-09-29T22:04:20.298257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGN.csv [2025-09-29T22:04:20.298370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OHI.csv [2025-09-29T22:04:20.298463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTI.csv [2025-09-29T22:04:20.298583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTLE.csv [2025-09-29T22:04:20.298750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAH.csv [2025-09-29T22:04:20.298891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSQ.csv [2025-09-29T22:04:20.298997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDC.csv [2025-09-29T22:04:20.299097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRUC.csv [2025-09-29T22:04:20.299168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIL.csv [2025-09-29T22:04:20.299278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHVN.csv [2025-09-29T22:04:20.299451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHS.csv [2025-09-29T22:04:20.299562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSX.csv [2025-09-29T22:04:20.299686] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTE.csv [2025-09-29T22:04:20.299781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAG.csv [2025-09-29T22:04:20.299930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHG.csv [2025-09-29T22:04:20.300119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PVH.csv [2025-09-29T22:04:20.300210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABCB.csv [2025-09-29T22:04:20.300309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFS.csv [2025-09-29T22:04:20.300402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOV.csv [2025-09-29T22:04:20.300503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BORR.csv [2025-09-29T22:04:20.300595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BY.csv [2025-09-29T22:04:20.300705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IONQ.csv [2025-09-29T22:04:20.300846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBBB.csv [2025-09-29T22:04:20.300953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEQ.csv [2025-09-29T22:04:20.301112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZF.csv [2025-09-29T22:04:20.301274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REX.csv [2025-09-29T22:04:20.301435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFII.csv [2025-09-29T22:04:20.301702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHO.csv [2025-09-29T22:04:20.301814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIM.csv [2025-09-29T22:04:20.301963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPO.csv [2025-09-29T22:04:20.302166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZB.csv [2025-09-29T22:04:20.302259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXFR.csv [2025-09-29T22:04:20.302327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBL.csv [2025-09-29T22:04:20.302401] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCSF.csv [2025-09-29T22:04:20.302494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKN.csv [2025-09-29T22:04:20.302725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFG.csv [2025-09-29T22:04:20.302841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOC.csv [2025-09-29T22:04:20.303025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSLX.csv [2025-09-29T22:04:20.303116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUNA.csv [2025-09-29T22:04:20.303210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHG.csv [2025-09-29T22:04:20.303544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFO.csv [2025-09-29T22:04:20.304045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVR.csv [2025-09-29T22:04:20.304166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPD.csv [2025-09-29T22:04:20.304319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANVS.csv [2025-09-29T22:04:20.304423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUBO.csv [2025-09-29T22:04:20.304508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IOT.csv [2025-09-29T22:04:20.304623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXJ.csv [2025-09-29T22:04:20.304755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLW.csv [2025-09-29T22:04:20.304838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAC.csv [2025-09-29T22:04:20.304935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBH.csv [2025-09-29T22:04:20.305072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHPT.csv [2025-09-29T22:04:20.305204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORN.csv [2025-09-29T22:04:20.305305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGS.csv [2025-09-29T22:04:20.305376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOF.csv [2025-09-29T22:04:20.305514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORC.csv [2025-09-29T22:04:20.305702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAL.csv [2025-09-29T22:04:20.305825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMR.csv [2025-09-29T22:04:20.305920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHI.csv [2025-09-29T22:04:20.306004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIS.csv [2025-09-29T22:04:20.306113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUX.csv [2025-09-29T22:04:20.306259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TS.csv [2025-09-29T22:04:20.306372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVT.csv [2025-09-29T22:04:20.306485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICE.csv [2025-09-29T22:04:20.306686] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPNT.csv [2025-09-29T22:04:20.306823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CODI.csv [2025-09-29T22:04:20.307047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRLB.csv [2025-09-29T22:04:20.307199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKG.csv [2025-09-29T22:04:20.307295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZM.csv [2025-09-29T22:04:20.307364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAT.csv [2025-09-29T22:04:20.307501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAFN.csv [2025-09-29T22:04:20.307618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMZ.csv [2025-09-29T22:04:20.308272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAND.csv [2025-09-29T22:04:20.308408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRH.csv [2025-09-29T22:04:20.308500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABT.csv [2025-09-29T22:04:20.308568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBG.csv [2025-09-29T22:04:20.308687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRMN.csv [2025-09-29T22:04:20.308802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIB.csv [2025-09-29T22:04:20.308924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCLH.csv [2025-09-29T22:04:20.309067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPB.csv [2025-09-29T22:04:20.309161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JQC.csv [2025-09-29T22:04:20.309241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDDY.csv [2025-09-29T22:04:20.309338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCY.csv [2025-09-29T22:04:20.309658] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMT.csv [2025-09-29T22:04:20.309808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DE.csv [2025-09-29T22:04:20.309910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FN.csv [2025-09-29T22:04:20.310006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFM.csv [2025-09-29T22:04:20.310076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFA.csv [2025-09-29T22:04:20.310201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RACE.csv [2025-09-29T22:04:20.310302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAM.csv [2025-09-29T22:04:20.310398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIN.csv [2025-09-29T22:04:20.310467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIX.csv [2025-09-29T22:04:20.310531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABBV.csv [2025-09-29T22:04:20.310710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFX.csv [2025-09-29T22:04:20.310810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMS.csv [2025-09-29T22:04:20.311074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFI.csv [2025-09-29T22:04:20.311193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDO.csv [2025-09-29T22:04:20.311293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCM.csv [2025-09-29T22:04:20.311446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDOC.csv [2025-09-29T22:04:20.311590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMT.csv [2025-09-29T22:04:20.311851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKX.csv [2025-09-29T22:04:20.311950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDU.csv [2025-09-29T22:04:20.312029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXSL.csv [2025-09-29T22:04:20.312185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPM.csv [2025-09-29T22:04:20.312341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZGN.csv [2025-09-29T22:04:20.312499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/POST.csv [2025-09-29T22:04:20.312590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIR.csv [2025-09-29T22:04:20.312717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAVA.csv [2025-09-29T22:04:20.312830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETJ.csv [2025-09-29T22:04:20.312931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLC.csv [2025-09-29T22:04:20.313170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NINE.csv [2025-09-29T22:04:20.313291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEVI.csv [2025-09-29T22:04:20.313404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAT.csv [2025-09-29T22:04:20.313591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMB.csv [2025-09-29T22:04:20.313718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTK.csv [2025-09-29T22:04:20.313868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BABA.csv [2025-09-29T22:04:20.313972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGZ.csv [2025-09-29T22:04:20.314069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ET.csv [2025-09-29T22:04:20.314437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTF.csv [2025-09-29T22:04:20.314547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMT.csv [2025-09-29T22:04:20.314762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZBH.csv [2025-09-29T22:04:20.314915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STN.csv [2025-09-29T22:04:20.315009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUG.csv [2025-09-29T22:04:20.315115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGT.csv [2025-09-29T22:04:20.315207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPP.csv [2025-09-29T22:04:20.315305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTD.csv [2025-09-29T22:04:20.315402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OI.csv [2025-09-29T22:04:20.315472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTAL.csv [2025-09-29T22:04:20.315549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDV.csv [2025-09-29T22:04:20.315689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPI.csv [2025-09-29T22:04:20.315867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WELL.csv [2025-09-29T22:04:20.315989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMC.csv [2025-09-29T22:04:20.316073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASH.csv [2025-09-29T22:04:20.316433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVLV.csv [2025-09-29T22:04:20.316564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVT.csv [2025-09-29T22:04:20.316744] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACRE.csv [2025-09-29T22:04:20.316893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TT.csv [2025-09-29T22:04:20.317074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYF.csv [2025-09-29T22:04:20.317229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PR.csv [2025-09-29T22:04:20.317347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAR.csv [2025-09-29T22:04:20.317485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBL.csv [2025-09-29T22:04:20.317578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MT.csv [2025-09-29T22:04:20.317809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCC.csv [2025-09-29T22:04:20.317971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIS.csv [2025-09-29T22:04:20.318134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RES.csv [2025-09-29T22:04:20.318232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDX.csv [2025-09-29T22:04:20.318302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KREF.csv [2025-09-29T22:04:20.318413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUJ.csv [2025-09-29T22:04:20.318562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRGO.csv [2025-09-29T22:04:20.318691] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRO.csv [2025-09-29T22:04:20.318815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCX.csv [2025-09-29T22:04:20.318938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMI.csv [2025-09-29T22:04:20.319163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPMT.csv [2025-09-29T22:04:20.319363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SON.csv [2025-09-29T22:04:20.319491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXP.csv [2025-09-29T22:04:20.319635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPF.csv [2025-09-29T22:04:20.319926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAP.csv [2025-09-29T22:04:20.320064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLKP.csv [2025-09-29T22:04:20.320323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCD.csv [2025-09-29T22:04:20.320443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DCO.csv [2025-09-29T22:04:20.320612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRP.csv [2025-09-29T22:04:20.320784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTC.csv [2025-09-29T22:04:20.320931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RITM.csv [2025-09-29T22:04:20.321171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMD.csv [2025-09-29T22:04:20.321268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APLE.csv [2025-09-29T22:04:20.321369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVUE.csv [2025-09-29T22:04:20.321507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWK.csv [2025-09-29T22:04:20.321601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXR.csv [2025-09-29T22:04:20.321745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRKS.csv [2025-09-29T22:04:20.321878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTDD.csv [2025-09-29T22:04:20.322019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SA.csv [2025-09-29T22:04:20.322177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNL.csv [2025-09-29T22:04:20.322316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXO.csv [2025-09-29T22:04:20.322461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RRX.csv [2025-09-29T22:04:20.322583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRU.csv [2025-09-29T22:04:20.322704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIMS.csv [2025-09-29T22:04:20.322818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CM.csv [2025-09-29T22:04:20.322929] [INFO ] [LOCAL ] Deleted 2057 derivative data files. [2025-09-29T22:04:20.322965] [INFO ] [LOCAL ] Scanning primary storage for available symbols. [2025-09-29T22:04:20.325123] [INFO ] [LOCAL ] Found 2057 symbols with primary data. [2025-09-29T22:04:20.325403] [INFO ] [MAIN ] Starting parallel derivative generation with 3 worker threads for 2057 symbols [2025-09-29T22:04:20.326478] [INFO ] [MAIN ] AB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:20.326011] [INFO ] [MAIN ] AAT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:20.327105] [INFO ] [MAIN ] ABBV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:20.367189] [DEBUG] [LOCAL ] AB: Loaded 27747 existing records from primary storage. [2025-09-29T22:04:20.376308] [INFO ] [MAIN ] AB: Loaded 27747 primary data records. [2025-09-29T22:04:20.382883] [DEBUG] [LOCAL ] AAT: Loaded 30539 existing records from primary storage. [2025-09-29T22:04:20.412107] [INFO ] [MAIN ] AAT: Loaded 30539 primary data records. [2025-09-29T22:04:20.674051] [DEBUG] [LOCAL ] ABBV: Loaded 53684 existing records from primary storage. [2025-09-29T22:04:20.721395] [INFO ] [MAIN ] ABBV: Loaded 53684 primary data records. [2025-09-29T22:04:21.510360] [DEBUG] [MAIN ] AAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:21.512730] [INFO ] [MAIN ] AAT: Generated 1794 derivative records from 30539 primary records. [2025-09-29T22:04:21.512845] [DEBUG] [LOCAL ] AAT: Saving derivative data. [2025-09-29T22:04:21.553167] [DEBUG] [MAIN ] AB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:21.558465] [INFO ] [MAIN ] AB: Generated 1794 derivative records from 27747 primary records. [2025-09-29T22:04:21.558940] [DEBUG] [LOCAL ] AB: Saving derivative data. [2025-09-29T22:04:21.586700] [DEBUG] [LOCAL ] AAT: Derivative data saved (1794 records). [2025-09-29T22:04:21.593889] [DEBUG] [MAIN ] ABBV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:21.594020] [INFO ] [MAIN ] AAT: Successfully saved derivative data. [2025-09-29T22:04:21.596076] [INFO ] [MAIN ] Derivative Progress: 1/2057 symbols completed. AAT took 1.3s. Estimated remaining: 43m 33s. Rate: 47.2 symbols/min [2025-09-29T22:04:21.597448] [INFO ] [MAIN ] ABBV: Generated 1794 derivative records from 53684 primary records. [2025-09-29T22:04:21.598040] [INFO ] [MAIN ] ABCB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:21.598134] [DEBUG] [LOCAL ] ABBV: Saving derivative data. [2025-09-29T22:04:21.621616] [DEBUG] [LOCAL ] AB: Derivative data saved (1794 records). [2025-09-29T22:04:21.622454] [INFO ] [MAIN ] AB: Successfully saved derivative data. [2025-09-29T22:04:21.624980] [INFO ] [MAIN ] Derivative Progress: 2/2057 symbols completed. AB took 1.3s. Estimated remaining: 22m 15s. Rate: 92.3 symbols/min [2025-09-29T22:04:21.625851] [INFO ] [MAIN ] ABEV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:21.628288] [DEBUG] [LOCAL ] ABBV: Derivative data saved (1794 records). [2025-09-29T22:04:21.628455] [INFO ] [MAIN ] ABBV: Successfully saved derivative data. [2025-09-29T22:04:21.631301] [INFO ] [MAIN ] Derivative Progress: 3/2057 symbols completed. ABBV took 1.3s. Estimated remaining: 14m 54s. Rate: 137.8 symbols/min [2025-09-29T22:04:21.631764] [INFO ] [MAIN ] ABM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:21.653892] [DEBUG] [LOCAL ] ABCB: Loaded 30510 existing records from primary storage. [2025-09-29T22:04:21.654030] [INFO ] [MAIN ] ABCB: Loaded 30510 primary data records. [2025-09-29T22:04:22.026695] [DEBUG] [LOCAL ] ABM: Loaded 32159 existing records from primary storage. [2025-09-29T22:04:22.066312] [INFO ] [MAIN ] ABM: Loaded 32159 primary data records. [2025-09-29T22:04:22.128023] [DEBUG] [LOCAL ] ABEV: Loaded 53278 existing records from primary storage. [2025-09-29T22:04:22.142417] [INFO ] [MAIN ] ABEV: Loaded 53278 primary data records. [2025-09-29T22:04:22.787857] [DEBUG] [MAIN ] ABCB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:22.790013] [INFO ] [MAIN ] ABCB: Generated 1794 derivative records from 30510 primary records. [2025-09-29T22:04:22.790986] [DEBUG] [LOCAL ] ABCB: Saving derivative data. [2025-09-29T22:04:22.811305] [DEBUG] [LOCAL ] ABCB: Derivative data saved (1794 records). [2025-09-29T22:04:22.811453] [INFO ] [MAIN ] ABCB: Successfully saved derivative data. [2025-09-29T22:04:22.813562] [INFO ] [MAIN ] Derivative Progress: 4/2057 symbols completed. ABCB took 1.2s. Estimated remaining: 21m 17s. Rate: 96.4 symbols/min [2025-09-29T22:04:22.814020] [INFO ] [MAIN ] ABR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:22.845847] [DEBUG] [MAIN ] ABM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:22.853157] [DEBUG] [MAIN ] ABEV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:22.854928] [INFO ] [MAIN ] ABEV: Generated 1794 derivative records from 53278 primary records. [2025-09-29T22:04:22.854061] [INFO ] [MAIN ] ABM: Generated 1794 derivative records from 32159 primary records. [2025-09-29T22:04:22.855169] [DEBUG] [LOCAL ] ABEV: Saving derivative data. [2025-09-29T22:04:22.855247] [DEBUG] [LOCAL ] ABM: Saving derivative data. [2025-09-29T22:04:22.885810] [DEBUG] [LOCAL ] ABEV: Derivative data saved (1794 records). [2025-09-29T22:04:22.886326] [INFO ] [MAIN ] ABEV: Successfully saved derivative data. [2025-09-29T22:04:22.889749] [INFO ] [MAIN ] Derivative Progress: 5/2057 symbols completed. ABEV took 1.3s. Estimated remaining: 17m 32s. Rate: 117.0 symbols/min [2025-09-29T22:04:22.890977] [INFO ] [MAIN ] ABT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:22.907318] [DEBUG] [LOCAL ] ABM: Derivative data saved (1794 records). [2025-09-29T22:04:22.907394] [INFO ] [MAIN ] ABM: Successfully saved derivative data. [2025-09-29T22:04:22.909461] [INFO ] [MAIN ] Derivative Progress: 6/2057 symbols completed. ABM took 1.3s. Estimated remaining: 14m 43s. Rate: 139.3 symbols/min [2025-09-29T22:04:22.909830] [INFO ] [MAIN ] ACA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:22.931206] [DEBUG] [LOCAL ] ABR: Loaded 52026 existing records from primary storage. [2025-09-29T22:04:22.931566] [INFO ] [MAIN ] ABR: Loaded 52026 primary data records. [2025-09-29T22:04:23.055206] [DEBUG] [LOCAL ] ACA: Loaded 23441 existing records from primary storage. [2025-09-29T22:04:23.070711] [INFO ] [MAIN ] ACA: Loaded 23441 primary data records. [2025-09-29T22:04:23.409261] [DEBUG] [LOCAL ] ABT: Loaded 53620 existing records from primary storage. [2025-09-29T22:04:23.421263] [INFO ] [MAIN ] ABT: Loaded 53620 primary data records. [2025-09-29T22:04:24.039345] [DEBUG] [MAIN ] ABR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:24.040792] [INFO ] [MAIN ] ABR: Generated 1794 derivative records from 52026 primary records. [2025-09-29T22:04:24.040934] [DEBUG] [LOCAL ] ABR: Saving derivative data. [2025-09-29T22:04:24.062290] [DEBUG] [LOCAL ] ABR: Derivative data saved (1794 records). [2025-09-29T22:04:24.062489] [INFO ] [MAIN ] ABR: Successfully saved derivative data. [2025-09-29T22:04:24.064555] [INFO ] [MAIN ] Derivative Progress: 7/2057 symbols completed. ABR took 1.3s. Estimated remaining: 18m 15s. Rate: 112.3 symbols/min [2025-09-29T22:04:24.064760] [INFO ] [MAIN ] ACCO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:24.079634] [DEBUG] [MAIN ] ACA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:24.080614] [INFO ] [MAIN ] ACA: Generated 1794 derivative records from 23441 primary records. [2025-09-29T22:04:24.080930] [DEBUG] [LOCAL ] ACA: Saving derivative data. [2025-09-29T22:04:24.114082] [DEBUG] [MAIN ] ABT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:24.114476] [DEBUG] [LOCAL ] ACA: Derivative data saved (1794 records). [2025-09-29T22:04:24.114802] [INFO ] [MAIN ] ACA: Successfully saved derivative data. [2025-09-29T22:04:24.116832] [INFO ] [MAIN ] Derivative Progress: 8/2057 symbols completed. ACA took 1.2s. Estimated remaining: 16m 11s. Rate: 126.6 symbols/min [2025-09-29T22:04:24.127562] [INFO ] [MAIN ] ACHR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:24.118097] [INFO ] [MAIN ] ABT: Generated 1794 derivative records from 53620 primary records. [2025-09-29T22:04:24.127846] [DEBUG] [LOCAL ] ABT: Saving derivative data. [2025-09-29T22:04:24.157713] [DEBUG] [LOCAL ] ABT: Derivative data saved (1794 records). [2025-09-29T22:04:24.157879] [INFO ] [MAIN ] ABT: Successfully saved derivative data. [2025-09-29T22:04:24.161401] [INFO ] [MAIN ] Derivative Progress: 9/2057 symbols completed. ABT took 1.3s. Estimated remaining: 14m 33s. Rate: 140.8 symbols/min [2025-09-29T22:04:24.158628] [DEBUG] [LOCAL ] ACCO: Loaded 37516 existing records from primary storage. [2025-09-29T22:04:24.161639] [INFO ] [MAIN ] ACI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:24.161999] [INFO ] [MAIN ] ACCO: Loaded 37516 primary data records. [2025-09-29T22:04:24.522983] [DEBUG] [LOCAL ] ACHR: Loaded 53818 existing records from primary storage. [2025-09-29T22:04:24.523922] [INFO ] [MAIN ] ACHR: Loaded 53818 primary data records. [2025-09-29T22:04:24.633822] [DEBUG] [LOCAL ] ACI: Loaded 53256 existing records from primary storage. [2025-09-29T22:04:24.656574] [INFO ] [MAIN ] ACI: Loaded 53256 primary data records. [2025-09-29T22:04:25.191145] [DEBUG] [MAIN ] ACCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:25.225170] [INFO ] [MAIN ] ACCO: Generated 1794 derivative records from 37516 primary records. [2025-09-29T22:04:25.226060] [DEBUG] [LOCAL ] ACCO: Saving derivative data. [2025-09-29T22:04:25.247506] [DEBUG] [LOCAL ] ACCO: Derivative data saved (1794 records). [2025-09-29T22:04:25.248263] [INFO ] [MAIN ] ACCO: Successfully saved derivative data. [2025-09-29T22:04:25.250976] [INFO ] [MAIN ] Derivative Progress: 10/2057 symbols completed. ACCO took 1.2s. Estimated remaining: 16m 48s. Rate: 121.8 symbols/min [2025-09-29T22:04:25.251535] [INFO ] [MAIN ] ACM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:25.281310] [DEBUG] [MAIN ] ACHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:25.282674] [INFO ] [MAIN ] ACHR: Generated 1794 derivative records from 53818 primary records. [2025-09-29T22:04:25.283089] [DEBUG] [LOCAL ] ACHR: Saving derivative data. [2025-09-29T22:04:25.337169] [DEBUG] [LOCAL ] ACHR: Derivative data saved (1794 records). [2025-09-29T22:04:25.336353] [DEBUG] [MAIN ] ACI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:25.337437] [INFO ] [MAIN ] ACHR: Successfully saved derivative data. [2025-09-29T22:04:25.338265] [INFO ] [MAIN ] ACI: Generated 1794 derivative records from 53256 primary records. [2025-09-29T22:04:25.340467] [DEBUG] [LOCAL ] ACI: Saving derivative data. [2025-09-29T22:04:25.340243] [INFO ] [MAIN ] Derivative Progress: 11/2057 symbols completed. ACHR took 1.2s. Estimated remaining: 15m 33s. Rate: 131.6 symbols/min [2025-09-29T22:04:25.341058] [INFO ] [MAIN ] ACN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:25.374569] [DEBUG] [LOCAL ] ACM: Loaded 43033 existing records from primary storage. [2025-09-29T22:04:25.374826] [INFO ] [MAIN ] ACM: Loaded 43033 primary data records. [2025-09-29T22:04:25.373578] [DEBUG] [LOCAL ] ACI: Derivative data saved (1794 records). [2025-09-29T22:04:25.375041] [INFO ] [MAIN ] ACI: Successfully saved derivative data. [2025-09-29T22:04:25.389362] [INFO ] [MAIN ] Derivative Progress: 12/2057 symbols completed. ACI took 1.2s. Estimated remaining: 14m 23s. Rate: 142.2 symbols/min [2025-09-29T22:04:25.415124] [INFO ] [MAIN ] ACR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:25.513180] [DEBUG] [LOCAL ] ACR: Loaded 6054 existing records from primary storage. [2025-09-29T22:04:25.691637] [INFO ] [MAIN ] ACR: Loaded 6054 primary data records. [2025-09-29T22:04:25.864513] [DEBUG] [LOCAL ] ACN: Loaded 53425 existing records from primary storage. [2025-09-29T22:04:25.877972] [INFO ] [MAIN ] ACN: Loaded 53425 primary data records. [2025-09-29T22:04:26.253228] [DEBUG] [MAIN ] ACM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:26.258681] [INFO ] [MAIN ] ACM: Generated 1794 derivative records from 43033 primary records. [2025-09-29T22:04:26.258819] [DEBUG] [LOCAL ] ACM: Saving derivative data. [2025-09-29T22:04:26.477760] [DEBUG] [LOCAL ] ACM: Derivative data saved (1794 records). [2025-09-29T22:04:26.481305] [INFO ] [MAIN ] ACM: Successfully saved derivative data. [2025-09-29T22:04:26.484171] [INFO ] [MAIN ] Derivative Progress: 13/2057 symbols completed. ACM took 1.2s. Estimated remaining: 16m 8s. Rate: 126.6 symbols/min [2025-09-29T22:04:26.498222] [DEBUG] [MAIN ] ACR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:26.499445] [INFO ] [MAIN ] ACR: Generated 1794 derivative records from 6054 primary records. [2025-09-29T22:04:26.499690] [DEBUG] [LOCAL ] ACR: Saving derivative data. [2025-09-29T22:04:26.518704] [DEBUG] [LOCAL ] ACR: Derivative data saved (1794 records). [2025-09-29T22:04:26.518928] [INFO ] [MAIN ] ACR: Successfully saved derivative data. [2025-09-29T22:04:26.520751] [INFO ] [MAIN ] Derivative Progress: 14/2057 symbols completed. ACR took 1.1s. Estimated remaining: 15m 4s. Rate: 135.6 symbols/min [2025-09-29T22:04:26.538102] [DEBUG] [MAIN ] ACN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:26.538896] [INFO ] [MAIN ] ACN: Generated 1794 derivative records from 53425 primary records. [2025-09-29T22:04:26.538994] [DEBUG] [LOCAL ] ACN: Saving derivative data. [2025-09-29T22:04:26.555025] [DEBUG] [LOCAL ] ACN: Derivative data saved (1794 records). [2025-09-29T22:04:26.555143] [INFO ] [MAIN ] ACN: Successfully saved derivative data. [2025-09-29T22:04:26.557579] [INFO ] [MAIN ] Derivative Progress: 15/2057 symbols completed. ACN took 1.2s. Estimated remaining: 14m 8s. Rate: 144.4 symbols/min [2025-09-29T22:04:26.558042] [INFO ] [MAIN ] ACRE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:26.558177] [INFO ] [MAIN ] ACVA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:26.558407] [INFO ] [MAIN ] ACV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:26.571085] [DEBUG] [LOCAL ] ACV: Loaded 7105 existing records from primary storage. [2025-09-29T22:04:26.571298] [INFO ] [MAIN ] ACV: Loaded 7105 primary data records. [2025-09-29T22:04:26.935108] [DEBUG] [LOCAL ] ACRE: Loaded 33528 existing records from primary storage. [2025-09-29T22:04:26.935415] [INFO ] [MAIN ] ACRE: Loaded 33528 primary data records. [2025-09-29T22:04:26.959715] [DEBUG] [LOCAL ] ACVA: Loaded 49259 existing records from primary storage. [2025-09-29T22:04:26.979376] [INFO ] [MAIN ] ACVA: Loaded 49259 primary data records. [2025-09-29T22:04:27.631542] [DEBUG] [MAIN ] ACV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:27.635299] [INFO ] [MAIN ] ACV: Generated 1794 derivative records from 7105 primary records. [2025-09-29T22:04:27.635421] [DEBUG] [LOCAL ] ACV: Saving derivative data. [2025-09-29T22:04:27.654556] [DEBUG] [LOCAL ] ACV: Derivative data saved (1794 records). [2025-09-29T22:04:27.654883] [INFO ] [MAIN ] ACV: Successfully saved derivative data. [2025-09-29T22:04:27.658064] [INFO ] [MAIN ] Derivative Progress: 16/2057 symbols completed. ACV took 1.1s. Estimated remaining: 15m 35s. Rate: 130.9 symbols/min [2025-09-29T22:04:27.658593] [INFO ] [MAIN ] ADC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:27.698091] [DEBUG] [MAIN ] ACVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:27.697796] [DEBUG] [MAIN ] ACRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:27.699198] [INFO ] [MAIN ] ACRE: Generated 1794 derivative records from 33528 primary records. [2025-09-29T22:04:27.700148] [INFO ] [MAIN ] ACVA: Generated 1794 derivative records from 49259 primary records. [2025-09-29T22:04:27.700276] [DEBUG] [LOCAL ] ACRE: Saving derivative data. [2025-09-29T22:04:27.700357] [DEBUG] [LOCAL ] ACVA: Saving derivative data. [2025-09-29T22:04:27.739529] [DEBUG] [LOCAL ] ACRE: Derivative data saved (1794 records). [2025-09-29T22:04:27.738321] [DEBUG] [LOCAL ] ACVA: Derivative data saved (1794 records). [2025-09-29T22:04:27.750723] [INFO ] [MAIN ] ACVA: Successfully saved derivative data. [2025-09-29T22:04:27.750533] [INFO ] [MAIN ] ACRE: Successfully saved derivative data. [2025-09-29T22:04:27.752768] [INFO ] [MAIN ] Derivative Progress: 17/2057 symbols completed. ACRE took 1.2s. Estimated remaining: 14m 51s. Rate: 137.3 symbols/min [2025-09-29T22:04:27.755974] [INFO ] [MAIN ] ADCT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:27.756685] [INFO ] [MAIN ] Derivative Progress: 18/2057 symbols completed. ACVA took 1.2s. Estimated remaining: 14m 2s. Rate: 145.3 symbols/min [2025-09-29T22:04:27.756853] [INFO ] [MAIN ] ADT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:27.776477] [DEBUG] [LOCAL ] ADC: Loaded 46182 existing records from primary storage. [2025-09-29T22:04:27.776755] [INFO ] [MAIN ] ADC: Loaded 46182 primary data records. [2025-09-29T22:04:28.006556] [DEBUG] [LOCAL ] ADCT: Loaded 34320 existing records from primary storage. [2025-09-29T22:04:28.128135] [INFO ] [MAIN ] ADCT: Loaded 34320 primary data records. [2025-09-29T22:04:28.246795] [DEBUG] [LOCAL ] ADT: Loaded 53469 existing records from primary storage. [2025-09-29T22:04:28.259062] [INFO ] [MAIN ] ADT: Loaded 53469 primary data records. [2025-09-29T22:04:28.877403] [DEBUG] [MAIN ] ADC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:28.878623] [INFO ] [MAIN ] ADC: Generated 1794 derivative records from 46182 primary records. [2025-09-29T22:04:28.879626] [DEBUG] [LOCAL ] ADC: Saving derivative data. [2025-09-29T22:04:28.903101] [DEBUG] [LOCAL ] ADC: Derivative data saved (1794 records). [2025-09-29T22:04:28.904172] [INFO ] [MAIN ] ADC: Successfully saved derivative data. [2025-09-29T22:04:28.907552] [INFO ] [MAIN ] Derivative Progress: 19/2057 symbols completed. ADC took 1.2s. Estimated remaining: 15m 21s. Rate: 132.8 symbols/min [2025-09-29T22:04:28.908098] [INFO ] [MAIN ] ADX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:28.923169] [DEBUG] [MAIN ] ADCT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:28.924269] [INFO ] [MAIN ] ADCT: Generated 1794 derivative records from 34320 primary records. [2025-09-29T22:04:28.924491] [DEBUG] [LOCAL ] ADCT: Saving derivative data. [2025-09-29T22:04:28.944296] [DEBUG] [LOCAL ] ADCT: Derivative data saved (1794 records). [2025-09-29T22:04:28.944599] [INFO ] [MAIN ] ADCT: Successfully saved derivative data. [2025-09-29T22:04:28.946537] [INFO ] [MAIN ] Derivative Progress: 20/2057 symbols completed. ADCT took 1.2s. Estimated remaining: 14m 38s. Rate: 139.2 symbols/min [2025-09-29T22:04:28.946858] [INFO ] [MAIN ] AEE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:28.969738] [DEBUG] [MAIN ] ADT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:28.970877] [INFO ] [MAIN ] ADT: Generated 1794 derivative records from 53469 primary records. [2025-09-29T22:04:28.971004] [DEBUG] [LOCAL ] ADT: Saving derivative data. [2025-09-29T22:04:28.997978] [DEBUG] [LOCAL ] ADX: Loaded 27588 existing records from primary storage. [2025-09-29T22:04:28.998383] [INFO ] [MAIN ] ADX: Loaded 27588 primary data records. [2025-09-29T22:04:29.020970] [DEBUG] [LOCAL ] ADT: Derivative data saved (1794 records). [2025-09-29T22:04:29.057056] [INFO ] [MAIN ] ADT: Successfully saved derivative data. [2025-09-29T22:04:29.080768] [INFO ] [MAIN ] Derivative Progress: 21/2057 symbols completed. ADT took 1.3s. Estimated remaining: 14m 9s. Rate: 143.9 symbols/min [2025-09-29T22:04:29.098916] [INFO ] [MAIN ] AEFC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:29.341876] [DEBUG] [LOCAL ] AEFC: Loaded 8491 existing records from primary storage. [2025-09-29T22:04:29.342096] [INFO ] [MAIN ] AEFC: Loaded 8491 primary data records. [2025-09-29T22:04:29.470247] [DEBUG] [LOCAL ] AEE: Loaded 50084 existing records from primary storage. [2025-09-29T22:04:29.481170] [INFO ] [MAIN ] AEE: Loaded 50084 primary data records. [2025-09-29T22:04:30.009889] [DEBUG] [MAIN ] ADX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:30.011375] [INFO ] [MAIN ] ADX: Generated 1794 derivative records from 27588 primary records. [2025-09-29T22:04:30.011672] [DEBUG] [LOCAL ] ADX: Saving derivative data. [2025-09-29T22:04:30.047636] [DEBUG] [MAIN ] AEFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:30.049005] [INFO ] [MAIN ] AEFC: Generated 1794 derivative records from 8491 primary records. [2025-09-29T22:04:30.049670] [DEBUG] [LOCAL ] ADX: Derivative data saved (1794 records). [2025-09-29T22:04:30.049905] [INFO ] [MAIN ] ADX: Successfully saved derivative data. [2025-09-29T22:04:30.049320] [DEBUG] [LOCAL ] AEFC: Saving derivative data. [2025-09-29T22:04:30.051962] [INFO ] [MAIN ] Derivative Progress: 22/2057 symbols completed. ADX took 1.1s. Estimated remaining: 14m 60s. Rate: 135.7 symbols/min [2025-09-29T22:04:30.052116] [INFO ] [MAIN ] AEG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:30.082407] [DEBUG] [MAIN ] AEE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:30.086283] [DEBUG] [LOCAL ] AEFC: Derivative data saved (1794 records). [2025-09-29T22:04:30.085635] [INFO ] [MAIN ] AEE: Generated 1794 derivative records from 50084 primary records. [2025-09-29T22:04:30.086561] [INFO ] [MAIN ] AEFC: Successfully saved derivative data. [2025-09-29T22:04:30.088628] [INFO ] [MAIN ] Derivative Progress: 23/2057 symbols completed. AEFC took 1.0s. Estimated remaining: 14m 23s. Rate: 141.3 symbols/min [2025-09-29T22:04:30.088982] [DEBUG] [LOCAL ] AEE: Saving derivative data. [2025-09-29T22:04:30.088838] [INFO ] [MAIN ] AEM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:30.123930] [DEBUG] [LOCAL ] AEE: Derivative data saved (1794 records). [2025-09-29T22:04:30.124063] [INFO ] [MAIN ] AEE: Successfully saved derivative data. [2025-09-29T22:04:30.128107] [INFO ] [MAIN ] Derivative Progress: 24/2057 symbols completed. AEE took 1.2s. Estimated remaining: 13m 50s. Rate: 146.9 symbols/min [2025-09-29T22:04:30.128494] [INFO ] [MAIN ] AEO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:30.147764] [DEBUG] [LOCAL ] AEG: Loaded 49547 existing records from primary storage. [2025-09-29T22:04:30.154459] [INFO ] [MAIN ] AEG: Loaded 49547 primary data records. [2025-09-29T22:04:30.575183] [DEBUG] [LOCAL ] AEM: Loaded 53465 existing records from primary storage. [2025-09-29T22:04:30.576021] [INFO ] [MAIN ] AEM: Loaded 53465 primary data records. [2025-09-29T22:04:30.577046] [DEBUG] [LOCAL ] AEO: Loaded 53558 existing records from primary storage. [2025-09-29T22:04:30.577939] [INFO ] [MAIN ] AEO: Loaded 53558 primary data records. [2025-09-29T22:04:31.253935] [DEBUG] [MAIN ] AEG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:31.256255] [INFO ] [MAIN ] AEG: Generated 1794 derivative records from 49547 primary records. [2025-09-29T22:04:31.256443] [DEBUG] [LOCAL ] AEG: Saving derivative data. [2025-09-29T22:04:31.281053] [DEBUG] [LOCAL ] AEG: Derivative data saved (1794 records). [2025-09-29T22:04:31.281761] [INFO ] [MAIN ] AEG: Successfully saved derivative data. [2025-09-29T22:04:31.284287] [INFO ] [MAIN ] Derivative Progress: 25/2057 symbols completed. AEG took 1.2s. Estimated remaining: 14m 51s. Rate: 136.9 symbols/min [2025-09-29T22:04:31.284997] [INFO ] [MAIN ] AER: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:31.318342] [DEBUG] [MAIN ] AEM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:31.318096] [DEBUG] [MAIN ] AEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:31.319861] [INFO ] [MAIN ] AEM: Generated 1794 derivative records from 53465 primary records. [2025-09-29T22:04:31.319173] [INFO ] [MAIN ] AEO: Generated 1794 derivative records from 53558 primary records. [2025-09-29T22:04:31.320009] [DEBUG] [LOCAL ] AEM: Saving derivative data. [2025-09-29T22:04:31.320887] [DEBUG] [LOCAL ] AEO: Saving derivative data. [2025-09-29T22:04:31.350780] [DEBUG] [LOCAL ] AEM: Derivative data saved (1794 records). [2025-09-29T22:04:31.352326] [INFO ] [MAIN ] AEM: Successfully saved derivative data. [2025-09-29T22:04:31.356426] [INFO ] [MAIN ] Derivative Progress: 26/2057 symbols completed. AEM took 1.3s. Estimated remaining: 14m 22s. Rate: 141.4 symbols/min [2025-09-29T22:04:31.357522] [INFO ] [MAIN ] AES: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:31.373426] [DEBUG] [LOCAL ] AEO: Derivative data saved (1794 records). [2025-09-29T22:04:31.373741] [INFO ] [MAIN ] AEO: Successfully saved derivative data. [2025-09-29T22:04:31.377286] [INFO ] [MAIN ] Derivative Progress: 27/2057 symbols completed. AEO took 1.2s. Estimated remaining: 13m 51s. Rate: 146.6 symbols/min [2025-09-29T22:04:31.377724] [INFO ] [MAIN ] AESI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:31.399737] [DEBUG] [LOCAL ] AER: Loaded 48447 existing records from primary storage. [2025-09-29T22:04:31.399981] [INFO ] [MAIN ] AER: Loaded 48447 primary data records. [2025-09-29T22:04:31.781549] [DEBUG] [LOCAL ] AES: Loaded 53670 existing records from primary storage. [2025-09-29T22:04:31.790271] [INFO ] [MAIN ] AES: Loaded 53670 primary data records. [2025-09-29T22:04:31.792096] [DEBUG] [LOCAL ] AESI: Loaded 49449 existing records from primary storage. [2025-09-29T22:04:31.792539] [INFO ] [MAIN ] AESI: Loaded 49449 primary data records. [2025-09-29T22:04:32.466528] [DEBUG] [MAIN ] AER: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:32.467952] [INFO ] [MAIN ] AER: Generated 1794 derivative records from 48447 primary records. [2025-09-29T22:04:32.468215] [DEBUG] [LOCAL ] AER: Saving derivative data. [2025-09-29T22:04:32.491300] [DEBUG] [LOCAL ] AER: Derivative data saved (1794 records). [2025-09-29T22:04:32.491563] [INFO ] [MAIN ] AER: Successfully saved derivative data. [2025-09-29T22:04:32.493820] [INFO ] [MAIN ] Derivative Progress: 28/2057 symbols completed. AER took 1.2s. Estimated remaining: 14m 42s. Rate: 138.1 symbols/min [2025-09-29T22:04:32.525537] [DEBUG] [MAIN ] AESI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:32.525825] [DEBUG] [MAIN ] AES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:32.526628] [INFO ] [MAIN ] AES: Generated 1794 derivative records from 53670 primary records. [2025-09-29T22:04:32.527316] [INFO ] [MAIN ] AESI: Generated 1794 derivative records from 49449 primary records. [2025-09-29T22:04:32.527404] [DEBUG] [LOCAL ] AESI: Saving derivative data. [2025-09-29T22:04:32.527485] [DEBUG] [LOCAL ] AES: Saving derivative data. [2025-09-29T22:04:32.558874] [DEBUG] [LOCAL ] AESI: Derivative data saved (1794 records). [2025-09-29T22:04:32.559423] [INFO ] [MAIN ] AESI: Successfully saved derivative data. [2025-09-29T22:04:32.562418] [INFO ] [MAIN ] Derivative Progress: 29/2057 symbols completed. AESI took 1.2s. Estimated remaining: 14m 16s. Rate: 142.2 symbols/min [2025-09-29T22:04:32.563607] [DEBUG] [LOCAL ] AES: Derivative data saved (1794 records). [2025-09-29T22:04:32.563712] [INFO ] [MAIN ] AES: Successfully saved derivative data. [2025-09-29T22:04:32.566620] [INFO ] [MAIN ] Derivative Progress: 30/2057 symbols completed. AES took 1.2s. Estimated remaining: 13m 47s. Rate: 147.0 symbols/min [2025-09-29T22:04:32.567908] [INFO ] [MAIN ] AFB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:32.568055] [INFO ] [MAIN ] AFG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:32.568218] [INFO ] [MAIN ] AFGB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:32.574744] [DEBUG] [LOCAL ] AFGB: Loaded 2333 existing records from primary storage. [2025-09-29T22:04:32.574887] [INFO ] [MAIN ] AFGB: Loaded 2333 primary data records. [2025-09-29T22:04:32.696622] [DEBUG] [LOCAL ] AFB: Loaded 11281 existing records from primary storage. [2025-09-29T22:04:32.732238] [INFO ] [MAIN ] AFB: Loaded 11281 primary data records. [2025-09-29T22:04:33.003557] [DEBUG] [LOCAL ] AFG: Loaded 32404 existing records from primary storage. [2025-09-29T22:04:33.024064] [INFO ] [MAIN ] AFG: Loaded 32404 primary data records. [2025-09-29T22:04:33.597888] [DEBUG] [MAIN ] AFGB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:33.600956] [INFO ] [MAIN ] AFGB: Generated 1794 derivative records from 2333 primary records. [2025-09-29T22:04:33.601376] [DEBUG] [LOCAL ] AFGB: Saving derivative data. [2025-09-29T22:04:33.616126] [DEBUG] [MAIN ] AFB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:33.628262] [INFO ] [MAIN ] AFB: Generated 1794 derivative records from 11281 primary records. [2025-09-29T22:04:33.630753] [DEBUG] [LOCAL ] AFB: Saving derivative data. [2025-09-29T22:04:33.637340] [DEBUG] [LOCAL ] AFGB: Derivative data saved (1794 records). [2025-09-29T22:04:33.638583] [INFO ] [MAIN ] AFGB: Successfully saved derivative data. [2025-09-29T22:04:33.641267] [INFO ] [MAIN ] Derivative Progress: 31/2057 symbols completed. AFGB took 1.1s. Estimated remaining: 14m 30s. Rate: 139.7 symbols/min [2025-09-29T22:04:33.649555] [INFO ] [MAIN ] AFGC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:33.670269] [DEBUG] [LOCAL ] AFB: Derivative data saved (1794 records). [2025-09-29T22:04:33.663461] [DEBUG] [MAIN ] AFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:33.670571] [INFO ] [MAIN ] AFB: Successfully saved derivative data. [2025-09-29T22:04:33.672929] [INFO ] [MAIN ] Derivative Progress: 32/2057 symbols completed. AFB took 1.1s. Estimated remaining: 14m 5s. Rate: 143.8 symbols/min [2025-09-29T22:04:33.673478] [INFO ] [MAIN ] AFGD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:33.674535] [INFO ] [MAIN ] AFG: Generated 1794 derivative records from 32404 primary records. [2025-09-29T22:04:33.674729] [DEBUG] [LOCAL ] AFG: Saving derivative data. [2025-09-29T22:04:33.693166] [DEBUG] [LOCAL ] AFGC: Loaded 2542 existing records from primary storage. [2025-09-29T22:04:33.694246] [INFO ] [MAIN ] AFGC: Loaded 2542 primary data records. [2025-09-29T22:04:33.714797] [DEBUG] [LOCAL ] AFGD: Loaded 1812 existing records from primary storage. [2025-09-29T22:04:33.739595] [INFO ] [MAIN ] AFGD: Loaded 1812 primary data records. [2025-09-29T22:04:33.830794] [DEBUG] [LOCAL ] AFG: Derivative data saved (1794 records). [2025-09-29T22:04:33.848585] [INFO ] [MAIN ] AFG: Successfully saved derivative data. [2025-09-29T22:04:33.858461] [INFO ] [MAIN ] Derivative Progress: 33/2057 symbols completed. AFG took 1.3s. Estimated remaining: 13m 50s. Rate: 146.3 symbols/min [2025-09-29T22:04:33.891993] [INFO ] [MAIN ] AFGE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:34.066483] [DEBUG] [LOCAL ] AFGE: Loaded 2470 existing records from primary storage. [2025-09-29T22:04:34.243683] [INFO ] [MAIN ] AFGE: Loaded 2470 primary data records. [2025-09-29T22:04:34.789507] [DEBUG] [MAIN ] AFGC: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-09-29T22:04:34.791249] [INFO ] [MAIN ] AFGC: Generated 1792 derivative records from 2542 primary records. [2025-09-29T22:04:34.791437] [DEBUG] [LOCAL ] AFGC: Saving derivative data. [2025-09-29T22:04:34.817197] [DEBUG] [MAIN ] AFGD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:34.821238] [DEBUG] [LOCAL ] AFGC: Derivative data saved (1792 records). [2025-09-29T22:04:34.822471] [INFO ] [MAIN ] AFGC: Successfully saved derivative data. [2025-09-29T22:04:34.822205] [INFO ] [MAIN ] AFGD: Generated 1794 derivative records from 1812 primary records. [2025-09-29T22:04:34.824698] [INFO ] [MAIN ] Derivative Progress: 34/2057 symbols completed. AFGC took 1.2s. Estimated remaining: 14m 23s. Rate: 140.7 symbols/min [2025-09-29T22:04:34.825069] [INFO ] [MAIN ] AGCO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:34.824917] [DEBUG] [LOCAL ] AFGD: Saving derivative data. [2025-09-29T22:04:34.842325] [DEBUG] [LOCAL ] AFGD: Derivative data saved (1794 records). [2025-09-29T22:04:34.842571] [INFO ] [MAIN ] AFGD: Successfully saved derivative data. [2025-09-29T22:04:34.845920] [INFO ] [MAIN ] Derivative Progress: 35/2057 symbols completed. AFGD took 1.2s. Estimated remaining: 13m 59s. Rate: 144.6 symbols/min [2025-09-29T22:04:34.847167] [INFO ] [MAIN ] AGD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:34.862726] [DEBUG] [MAIN ] AFGE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:34.863591] [INFO ] [MAIN ] AFGE: Generated 1794 derivative records from 2470 primary records. [2025-09-29T22:04:34.863705] [DEBUG] [LOCAL ] AFGE: Saving derivative data. [2025-09-29T22:04:34.886106] [DEBUG] [LOCAL ] AFGE: Derivative data saved (1794 records). [2025-09-29T22:04:34.886213] [INFO ] [MAIN ] AFGE: Successfully saved derivative data. [2025-09-29T22:04:34.888308] [INFO ] [MAIN ] Derivative Progress: 36/2057 symbols completed. AFGE took 1.0s. Estimated remaining: 13m 38s. Rate: 148.3 symbols/min [2025-09-29T22:04:34.888536] [INFO ] [MAIN ] AGI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:34.907431] [DEBUG] [LOCAL ] AGD: Loaded 17846 existing records from primary storage. [2025-09-29T22:04:34.907756] [INFO ] [MAIN ] AGD: Loaded 17846 primary data records. [2025-09-29T22:04:35.039465] [DEBUG] [LOCAL ] AGCO: Loaded 42413 existing records from primary storage. [2025-09-29T22:04:35.055877] [INFO ] [MAIN ] AGCO: Loaded 42413 primary data records. [2025-09-29T22:04:35.387931] [DEBUG] [LOCAL ] AGI: Loaded 53415 existing records from primary storage. [2025-09-29T22:04:35.388534] [INFO ] [MAIN ] AGI: Loaded 53415 primary data records. [2025-09-29T22:04:35.955387] [DEBUG] [MAIN ] AGD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:35.957380] [INFO ] [MAIN ] AGD: Generated 1794 derivative records from 17846 primary records. [2025-09-29T22:04:35.957589] [DEBUG] [LOCAL ] AGD: Saving derivative data. [2025-09-29T22:04:35.979785] [DEBUG] [LOCAL ] AGD: Derivative data saved (1794 records). [2025-09-29T22:04:35.980680] [INFO ] [MAIN ] AGD: Successfully saved derivative data. [2025-09-29T22:04:35.983145] [INFO ] [MAIN ] Derivative Progress: 37/2057 symbols completed. AGD took 1.1s. Estimated remaining: 14m 15s. Rate: 141.8 symbols/min [2025-09-29T22:04:35.983787] [INFO ] [MAIN ] AGL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:36.001346] [DEBUG] [MAIN ] AGCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:36.002265] [INFO ] [MAIN ] AGCO: Generated 1794 derivative records from 42413 primary records. [2025-09-29T22:04:36.002424] [DEBUG] [LOCAL ] AGCO: Saving derivative data. [2025-09-29T22:04:36.025627] [DEBUG] [MAIN ] AGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:36.032955] [INFO ] [MAIN ] AGI: Generated 1794 derivative records from 53415 primary records. [2025-09-29T22:04:36.034024] [DEBUG] [LOCAL ] AGI: Saving derivative data. [2025-09-29T22:04:36.033801] [DEBUG] [LOCAL ] AGCO: Derivative data saved (1794 records). [2025-09-29T22:04:36.034842] [INFO ] [MAIN ] AGCO: Successfully saved derivative data. [2025-09-29T22:04:36.037388] [INFO ] [MAIN ] Derivative Progress: 38/2057 symbols completed. AGCO took 1.2s. Estimated remaining: 13m 55s. Rate: 145.1 symbols/min [2025-09-29T22:04:36.037734] [INFO ] [MAIN ] AGM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:36.055809] [DEBUG] [LOCAL ] AGI: Derivative data saved (1794 records). [2025-09-29T22:04:36.070529] [INFO ] [MAIN ] AGI: Successfully saved derivative data. [2025-09-29T22:04:36.073520] [INFO ] [MAIN ] Derivative Progress: 39/2057 symbols completed. AGI took 1.2s. Estimated remaining: 13m 35s. Rate: 148.6 symbols/min [2025-09-29T22:04:36.077109] [INFO ] [MAIN ] AGO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:36.084072] [DEBUG] [LOCAL ] AGM: Loaded 10075 existing records from primary storage. [2025-09-29T22:04:36.084345] [INFO ] [MAIN ] AGM: Loaded 10075 primary data records. [2025-09-29T22:04:36.222773] [DEBUG] [LOCAL ] AGL: Loaded 52425 existing records from primary storage. [2025-09-29T22:04:36.231304] [INFO ] [MAIN ] AGL: Loaded 52425 primary data records. [2025-09-29T22:04:36.397265] [DEBUG] [LOCAL ] AGO: Loaded 27898 existing records from primary storage. [2025-09-29T22:04:36.427307] [INFO ] [MAIN ] AGO: Loaded 27898 primary data records. [2025-09-29T22:04:37.172068] [DEBUG] [MAIN ] AGM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:37.173117] [INFO ] [MAIN ] AGM: Generated 1794 derivative records from 10075 primary records. [2025-09-29T22:04:37.173576] [DEBUG] [LOCAL ] AGM: Saving derivative data. [2025-09-29T22:04:37.192279] [DEBUG] [LOCAL ] AGM: Derivative data saved (1794 records). [2025-09-29T22:04:37.194019] [INFO ] [MAIN ] AGM: Successfully saved derivative data. [2025-09-29T22:04:37.196370] [INFO ] [MAIN ] Derivative Progress: 40/2057 symbols completed. AGM took 1.2s. Estimated remaining: 14m 11s. Rate: 142.3 symbols/min [2025-09-29T22:04:37.196740] [INFO ] [MAIN ] AGRO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:37.214287] [DEBUG] [MAIN ] AGL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:37.215290] [INFO ] [MAIN ] AGL: Generated 1794 derivative records from 52425 primary records. [2025-09-29T22:04:37.215560] [DEBUG] [LOCAL ] AGL: Saving derivative data. [2025-09-29T22:04:37.233507] [DEBUG] [LOCAL ] AGL: Derivative data saved (1794 records). [2025-09-29T22:04:37.233827] [INFO ] [MAIN ] AGL: Successfully saved derivative data. [2025-09-29T22:04:37.236000] [INFO ] [MAIN ] Derivative Progress: 41/2057 symbols completed. AGL took 1.3s. Estimated remaining: 13m 52s. Rate: 145.5 symbols/min [2025-09-29T22:04:37.236369] [INFO ] [MAIN ] AGX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:37.272953] [DEBUG] [MAIN ] AGO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:37.274253] [INFO ] [MAIN ] AGO: Generated 1794 derivative records from 27898 primary records. [2025-09-29T22:04:37.285665] [DEBUG] [LOCAL ] AGO: Saving derivative data. [2025-09-29T22:04:37.307531] [DEBUG] [LOCAL ] AGRO: Loaded 33601 existing records from primary storage. [2025-09-29T22:04:37.309756] [INFO ] [MAIN ] AGRO: Loaded 33601 primary data records. [2025-09-29T22:04:37.370787] [DEBUG] [LOCAL ] AGO: Derivative data saved (1794 records). [2025-09-29T22:04:37.393300] [INFO ] [MAIN ] AGO: Successfully saved derivative data. [2025-09-29T22:04:37.418789] [INFO ] [MAIN ] Derivative Progress: 42/2057 symbols completed. AGO took 1.3s. Estimated remaining: 13m 40s. Rate: 147.4 symbols/min [2025-09-29T22:04:37.458629] [INFO ] [MAIN ] AHH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:37.475709] [DEBUG] [LOCAL ] AGX: Loaded 33224 existing records from primary storage. [2025-09-29T22:04:37.509328] [INFO ] [MAIN ] AGX: Loaded 33224 primary data records. [2025-09-29T22:04:37.995622] [DEBUG] [LOCAL ] AHH: Loaded 41228 existing records from primary storage. [2025-09-29T22:04:37.996292] [INFO ] [MAIN ] AHH: Loaded 41228 primary data records. [2025-09-29T22:04:38.348042] [DEBUG] [MAIN ] AGRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:38.348978] [INFO ] [MAIN ] AGRO: Generated 1794 derivative records from 33601 primary records. [2025-09-29T22:04:38.352037] [DEBUG] [LOCAL ] AGRO: Saving derivative data. [2025-09-29T22:04:38.385523] [DEBUG] [MAIN ] AGX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:38.387255] [INFO ] [MAIN ] AGX: Generated 1794 derivative records from 33224 primary records. [2025-09-29T22:04:38.388190] [DEBUG] [LOCAL ] AGX: Saving derivative data. [2025-09-29T22:04:38.409509] [DEBUG] [LOCAL ] AGX: Derivative data saved (1794 records). [2025-09-29T22:04:38.409412] [DEBUG] [LOCAL ] AGRO: Derivative data saved (1794 records). [2025-09-29T22:04:38.410289] [INFO ] [MAIN ] AGRO: Successfully saved derivative data. [2025-09-29T22:04:38.409984] [INFO ] [MAIN ] AGX: Successfully saved derivative data. [2025-09-29T22:04:38.412690] [INFO ] [MAIN ] Derivative Progress: 43/2057 symbols completed. AGX took 1.2s. Estimated remaining: 14m 7s. Rate: 142.6 symbols/min [2025-09-29T22:04:38.415441] [INFO ] [MAIN ] Derivative Progress: 44/2057 symbols completed. AGRO took 1.2s. Estimated remaining: 13m 48s. Rate: 145.9 symbols/min [2025-09-29T22:04:38.432514] [DEBUG] [MAIN ] AHH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:38.433115] [INFO ] [MAIN ] AHH: Generated 1794 derivative records from 41228 primary records. [2025-09-29T22:04:38.433181] [DEBUG] [LOCAL ] AHH: Saving derivative data. [2025-09-29T22:04:38.447976] [DEBUG] [LOCAL ] AHH: Derivative data saved (1794 records). [2025-09-29T22:04:38.448084] [INFO ] [MAIN ] AHH: Successfully saved derivative data. [2025-09-29T22:04:38.450594] [INFO ] [MAIN ] Derivative Progress: 45/2057 symbols completed. AHH took 1.0s. Estimated remaining: 13m 30s. Rate: 149.0 symbols/min [2025-09-29T22:04:38.451258] [INFO ] [MAIN ] AHR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:38.451413] [INFO ] [MAIN ] AI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:38.452380] [INFO ] [MAIN ] AHT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:38.462151] [DEBUG] [LOCAL ] AHT: Loaded 6127 existing records from primary storage. [2025-09-29T22:04:38.462369] [INFO ] [MAIN ] AHT: Loaded 6127 primary data records. [2025-09-29T22:04:38.859400] [DEBUG] [LOCAL ] AHR: Loaded 49171 existing records from primary storage. [2025-09-29T22:04:38.860341] [INFO ] [MAIN ] AHR: Loaded 49171 primary data records. [2025-09-29T22:04:38.945371] [DEBUG] [LOCAL ] AI: Loaded 53750 existing records from primary storage. [2025-09-29T22:04:38.969121] [INFO ] [MAIN ] AI: Loaded 53750 primary data records. [2025-09-29T22:04:39.548851] [DEBUG] [MAIN ] AHT: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:04:39.549967] [INFO ] [MAIN ] AHT: Generated 1793 derivative records from 6127 primary records. [2025-09-29T22:04:39.550170] [DEBUG] [LOCAL ] AHT: Saving derivative data. [2025-09-29T22:04:39.565927] [DEBUG] [LOCAL ] AHT: Derivative data saved (1793 records). [2025-09-29T22:04:39.566207] [INFO ] [MAIN ] AHT: Successfully saved derivative data. [2025-09-29T22:04:39.568687] [INFO ] [MAIN ] Derivative Progress: 46/2057 symbols completed. AHT took 1.1s. Estimated remaining: 14m 1s. Rate: 143.4 symbols/min [2025-09-29T22:04:39.569686] [INFO ] [MAIN ] AIG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:39.588893] [DEBUG] [MAIN ] AHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:39.589725] [INFO ] [MAIN ] AHR: Generated 1794 derivative records from 49171 primary records. [2025-09-29T22:04:39.589999] [DEBUG] [LOCAL ] AHR: Saving derivative data. [2025-09-29T22:04:39.621154] [DEBUG] [MAIN ] AI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:39.622276] [INFO ] [MAIN ] AI: Generated 1794 derivative records from 53750 primary records. [2025-09-29T22:04:39.622401] [DEBUG] [LOCAL ] AI: Saving derivative data. [2025-09-29T22:04:39.640888] [DEBUG] [LOCAL ] AI: Derivative data saved (1794 records). [2025-09-29T22:04:39.641287] [DEBUG] [LOCAL ] AHR: Derivative data saved (1794 records). [2025-09-29T22:04:39.641466] [INFO ] [MAIN ] AHR: Successfully saved derivative data. [2025-09-29T22:04:39.641514] [INFO ] [MAIN ] AI: Successfully saved derivative data. [2025-09-29T22:04:39.643584] [INFO ] [MAIN ] Derivative Progress: 47/2057 symbols completed. AI took 1.2s. Estimated remaining: 13m 46s. Rate: 146.0 symbols/min [2025-09-29T22:04:39.645943] [INFO ] [MAIN ] AIN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:39.646069] [INFO ] [MAIN ] Derivative Progress: 48/2057 symbols completed. AHR took 1.2s. Estimated remaining: 13m 29s. Rate: 149.1 symbols/min [2025-09-29T22:04:39.646434] [INFO ] [MAIN ] AIO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:39.675958] [DEBUG] [LOCAL ] AIO: Loaded 13223 existing records from primary storage. [2025-09-29T22:04:39.680878] [INFO ] [MAIN ] AIO: Loaded 13223 primary data records. [2025-09-29T22:04:39.736540] [DEBUG] [LOCAL ] AIG: Loaded 53471 existing records from primary storage. [2025-09-29T22:04:39.764117] [INFO ] [MAIN ] AIG: Loaded 53471 primary data records. [2025-09-29T22:04:39.813786] [DEBUG] [LOCAL ] AIN: Loaded 24535 existing records from primary storage. [2025-09-29T22:04:39.854782] [INFO ] [MAIN ] AIN: Loaded 24535 primary data records. [2025-09-29T22:04:40.705972] [DEBUG] [MAIN ] AIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:40.707183] [INFO ] [MAIN ] AIO: Generated 1794 derivative records from 13223 primary records. [2025-09-29T22:04:40.708421] [DEBUG] [LOCAL ] AIO: Saving derivative data. [2025-09-29T22:04:40.741311] [DEBUG] [LOCAL ] AIO: Derivative data saved (1794 records). [2025-09-29T22:04:40.740215] [DEBUG] [MAIN ] AIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:40.742514] [INFO ] [MAIN ] AIG: Generated 1794 derivative records from 53471 primary records. [2025-09-29T22:04:40.742731] [INFO ] [MAIN ] AIO: Successfully saved derivative data. [2025-09-29T22:04:40.743851] [DEBUG] [LOCAL ] AIG: Saving derivative data. [2025-09-29T22:04:40.746208] [INFO ] [MAIN ] Derivative Progress: 49/2057 symbols completed. AIO took 1.1s. Estimated remaining: 13m 57s. Rate: 144.0 symbols/min [2025-09-29T22:04:40.749204] [INFO ] [MAIN ] AIR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:40.774804] [DEBUG] [MAIN ] AIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:40.779824] [DEBUG] [LOCAL ] AIG: Derivative data saved (1794 records). [2025-09-29T22:04:40.780924] [INFO ] [MAIN ] AIG: Successfully saved derivative data. [2025-09-29T22:04:40.780680] [INFO ] [MAIN ] AIN: Generated 1794 derivative records from 24535 primary records. [2025-09-29T22:04:40.783368] [INFO ] [MAIN ] Derivative Progress: 50/2057 symbols completed. AIG took 1.2s. Estimated remaining: 13m 41s. Rate: 146.6 symbols/min [2025-09-29T22:04:40.783843] [DEBUG] [LOCAL ] AIN: Saving derivative data. [2025-09-29T22:04:40.783591] [INFO ] [MAIN ] AIV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:40.801236] [DEBUG] [LOCAL ] AIN: Derivative data saved (1794 records). [2025-09-29T22:04:40.808881] [INFO ] [MAIN ] AIN: Successfully saved derivative data. [2025-09-29T22:04:40.811384] [INFO ] [MAIN ] Derivative Progress: 51/2057 symbols completed. AIN took 1.2s. Estimated remaining: 13m 26s. Rate: 149.4 symbols/min [2025-09-29T22:04:40.811779] [INFO ] [MAIN ] AIZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:40.824709] [DEBUG] [LOCAL ] AIR: Loaded 27816 existing records from primary storage. [2025-09-29T22:04:40.835257] [INFO ] [MAIN ] AIR: Loaded 27816 primary data records. [2025-09-29T22:04:40.969956] [DEBUG] [LOCAL ] AIV: Loaded 40298 existing records from primary storage. [2025-09-29T22:04:41.005200] [INFO ] [MAIN ] AIV: Loaded 40298 primary data records. [2025-09-29T22:04:41.109595] [DEBUG] [LOCAL ] AIZ: Loaded 29952 existing records from primary storage. [2025-09-29T22:04:41.283309] [INFO ] [MAIN ] AIZ: Loaded 29952 primary data records. [2025-09-29T22:04:41.897290] [DEBUG] [MAIN ] AIR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:41.898699] [INFO ] [MAIN ] AIR: Generated 1794 derivative records from 27816 primary records. [2025-09-29T22:04:41.899110] [DEBUG] [LOCAL ] AIR: Saving derivative data. [2025-09-29T22:04:41.916912] [DEBUG] [LOCAL ] AIR: Derivative data saved (1794 records). [2025-09-29T22:04:41.917139] [INFO ] [MAIN ] AIR: Successfully saved derivative data. [2025-09-29T22:04:41.919670] [INFO ] [MAIN ] Derivative Progress: 52/2057 symbols completed. AIR took 1.2s. Estimated remaining: 13m 53s. Rate: 144.5 symbols/min [2025-09-29T22:04:41.921389] [INFO ] [MAIN ] AIZN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:41.940798] [DEBUG] [MAIN ] AIV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:41.944188] [DEBUG] [LOCAL ] AIZN: Loaded 3911 existing records from primary storage. [2025-09-29T22:04:41.945039] [INFO ] [MAIN ] AIV: Generated 1794 derivative records from 40298 primary records. [2025-09-29T22:04:41.945343] [INFO ] [MAIN ] AIZN: Loaded 3911 primary data records. [2025-09-29T22:04:41.945454] [DEBUG] [LOCAL ] AIV: Saving derivative data. [2025-09-29T22:04:42.117019] [DEBUG] [LOCAL ] AIV: Derivative data saved (1794 records). [2025-09-29T22:04:42.136697] [INFO ] [MAIN ] AIV: Successfully saved derivative data. [2025-09-29T22:04:42.106080] [DEBUG] [MAIN ] AIZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:42.149540] [INFO ] [MAIN ] AIZ: Generated 1794 derivative records from 29952 primary records. [2025-09-29T22:04:42.148411] [INFO ] [MAIN ] Derivative Progress: 53/2057 symbols completed. AIV took 1.4s. Estimated remaining: 13m 45s. Rate: 145.7 symbols/min [2025-09-29T22:04:42.158607] [DEBUG] [LOCAL ] AIZ: Saving derivative data. [2025-09-29T22:04:42.159610] [INFO ] [MAIN ] AJG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:42.328617] [DEBUG] [LOCAL ] AIZ: Derivative data saved (1794 records). [2025-09-29T22:04:42.328896] [INFO ] [MAIN ] AIZ: Successfully saved derivative data. [2025-09-29T22:04:42.331199] [INFO ] [MAIN ] Derivative Progress: 54/2057 symbols completed. AIZ took 1.5s. Estimated remaining: 13m 36s. Rate: 147.2 symbols/min [2025-09-29T22:04:42.331453] [INFO ] [MAIN ] AKR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:42.371514] [DEBUG] [MAIN ] AIZN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:42.372521] [INFO ] [MAIN ] AIZN: Generated 1794 derivative records from 3911 primary records. [2025-09-29T22:04:42.372782] [DEBUG] [LOCAL ] AIZN: Saving derivative data. [2025-09-29T22:04:42.422450] [DEBUG] [LOCAL ] AJG: Loaded 46911 existing records from primary storage. [2025-09-29T22:04:42.422957] [DEBUG] [LOCAL ] AIZN: Derivative data saved (1794 records). [2025-09-29T22:04:42.423791] [INFO ] [MAIN ] AIZN: Successfully saved derivative data. [2025-09-29T22:04:42.423684] [INFO ] [MAIN ] AJG: Loaded 46911 primary data records. [2025-09-29T22:04:42.426778] [INFO ] [MAIN ] Derivative Progress: 55/2057 symbols completed. AIZN took 0.5s. Estimated remaining: 13m 24s. Rate: 149.3 symbols/min [2025-09-29T22:04:42.427084] [INFO ] [MAIN ] AL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:42.482941] [DEBUG] [LOCAL ] AKR: Loaded 45716 existing records from primary storage. [2025-09-29T22:04:42.488256] [INFO ] [MAIN ] AKR: Loaded 45716 primary data records. [2025-09-29T22:04:43.178792] [DEBUG] [LOCAL ] AL: Loaded 44176 existing records from primary storage. [2025-09-29T22:04:43.180313] [INFO ] [MAIN ] AL: Loaded 44176 primary data records. [2025-09-29T22:04:43.535087] [DEBUG] [MAIN ] AKR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:43.549230] [INFO ] [MAIN ] AKR: Generated 1794 derivative records from 45716 primary records. [2025-09-29T22:04:43.549393] [DEBUG] [LOCAL ] AKR: Saving derivative data. [2025-09-29T22:04:43.550717] [DEBUG] [MAIN ] AJG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:43.552367] [INFO ] [MAIN ] AJG: Generated 1794 derivative records from 46911 primary records. [2025-09-29T22:04:43.552462] [DEBUG] [LOCAL ] AJG: Saving derivative data. [2025-09-29T22:04:43.582006] [DEBUG] [LOCAL ] AJG: Derivative data saved (1794 records). [2025-09-29T22:04:43.582993] [INFO ] [MAIN ] AJG: Successfully saved derivative data. [2025-09-29T22:04:43.585591] [INFO ] [MAIN ] Derivative Progress: 56/2057 symbols completed. AJG took 1.4s. Estimated remaining: 13m 51s. Rate: 144.5 symbols/min [2025-09-29T22:04:43.586532] [INFO ] [MAIN ] ALB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:43.589786] [DEBUG] [LOCAL ] AKR: Derivative data saved (1794 records). [2025-09-29T22:04:43.590616] [INFO ] [MAIN ] AKR: Successfully saved derivative data. [2025-09-29T22:04:43.592926] [INFO ] [MAIN ] Derivative Progress: 57/2057 symbols completed. AKR took 1.3s. Estimated remaining: 13m 36s. Rate: 147.0 symbols/min [2025-09-29T22:04:43.593305] [INFO ] [MAIN ] ALC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:43.610883] [DEBUG] [MAIN ] AL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:43.611716] [INFO ] [MAIN ] AL: Generated 1794 derivative records from 44176 primary records. [2025-09-29T22:04:43.611905] [DEBUG] [LOCAL ] AL: Saving derivative data. [2025-09-29T22:04:43.630160] [DEBUG] [LOCAL ] AL: Derivative data saved (1794 records). [2025-09-29T22:04:43.630322] [INFO ] [MAIN ] AL: Successfully saved derivative data. [2025-09-29T22:04:43.632808] [INFO ] [MAIN ] Derivative Progress: 58/2057 symbols completed. AL took 1.2s. Estimated remaining: 13m 23s. Rate: 149.3 symbols/min [2025-09-29T22:04:43.685896] [DEBUG] [LOCAL ] ALB: Loaded 53226 existing records from primary storage. [2025-09-29T22:04:43.700021] [INFO ] [MAIN ] ALB: Loaded 53226 primary data records. [2025-09-29T22:04:43.700918] [DEBUG] [LOCAL ] ALC: Loaded 50776 existing records from primary storage. [2025-09-29T22:04:43.749929] [INFO ] [MAIN ] ALC: Loaded 50776 primary data records. [2025-09-29T22:04:44.420028] [DEBUG] [MAIN ] ALB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:44.421138] [INFO ] [MAIN ] ALB: Generated 1794 derivative records from 53226 primary records. [2025-09-29T22:04:44.421236] [DEBUG] [LOCAL ] ALB: Saving derivative data. [2025-09-29T22:04:44.439539] [DEBUG] [LOCAL ] ALB: Derivative data saved (1794 records). [2025-09-29T22:04:44.439826] [INFO ] [MAIN ] ALB: Successfully saved derivative data. [2025-09-29T22:04:44.442194] [INFO ] [MAIN ] Derivative Progress: 59/2057 symbols completed. ALB took 0.9s. Estimated remaining: 13m 37s. Rate: 146.8 symbols/min [2025-09-29T22:04:44.461331] [DEBUG] [MAIN ] ALC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:44.462021] [INFO ] [MAIN ] ALC: Generated 1794 derivative records from 50776 primary records. [2025-09-29T22:04:44.462182] [DEBUG] [LOCAL ] ALC: Saving derivative data. [2025-09-29T22:04:44.477735] [DEBUG] [LOCAL ] ALC: Derivative data saved (1794 records). [2025-09-29T22:04:44.477800] [INFO ] [MAIN ] ALC: Successfully saved derivative data. [2025-09-29T22:04:44.480330] [INFO ] [MAIN ] Derivative Progress: 60/2057 symbols completed. ALC took 0.9s. Estimated remaining: 13m 24s. Rate: 149.0 symbols/min [2025-09-29T22:04:44.481057] [INFO ] [MAIN ] ALE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:44.481119] [INFO ] [MAIN ] ALEX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:44.481343] [INFO ] [MAIN ] ALG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:44.497243] [DEBUG] [LOCAL ] ALG: Loaded 10273 existing records from primary storage. [2025-09-29T22:04:44.497375] [INFO ] [MAIN ] ALG: Loaded 10273 primary data records. [2025-09-29T22:04:44.713004] [DEBUG] [LOCAL ] ALEX: Loaded 31165 existing records from primary storage. [2025-09-29T22:04:44.737047] [INFO ] [MAIN ] ALEX: Loaded 31165 primary data records. [2025-09-29T22:04:44.736908] [DEBUG] [LOCAL ] ALE: Loaded 30436 existing records from primary storage. [2025-09-29T22:04:44.742710] [INFO ] [MAIN ] ALE: Loaded 30436 primary data records. [2025-09-29T22:04:45.604469] [DEBUG] [MAIN ] ALG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:45.605782] [INFO ] [MAIN ] ALG: Generated 1794 derivative records from 10273 primary records. [2025-09-29T22:04:45.606050] [DEBUG] [LOCAL ] ALG: Saving derivative data. [2025-09-29T22:04:45.625081] [DEBUG] [LOCAL ] ALG: Derivative data saved (1794 records). [2025-09-29T22:04:45.626517] [INFO ] [MAIN ] ALG: Successfully saved derivative data. [2025-09-29T22:04:45.630364] [INFO ] [MAIN ] Derivative Progress: 61/2057 symbols completed. ALG took 1.1s. Estimated remaining: 13m 48s. Rate: 144.6 symbols/min [2025-09-29T22:04:45.630672] [INFO ] [MAIN ] ALIT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:45.645983] [DEBUG] [MAIN ] ALE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:45.647002] [INFO ] [MAIN ] ALE: Generated 1794 derivative records from 30436 primary records. [2025-09-29T22:04:45.647173] [DEBUG] [LOCAL ] ALE: Saving derivative data. [2025-09-29T22:04:45.681945] [DEBUG] [MAIN ] ALEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:45.681575] [DEBUG] [LOCAL ] ALE: Derivative data saved (1794 records). [2025-09-29T22:04:45.683150] [INFO ] [MAIN ] ALE: Successfully saved derivative data. [2025-09-29T22:04:45.682974] [INFO ] [MAIN ] ALEX: Generated 1794 derivative records from 31165 primary records. [2025-09-29T22:04:45.685607] [INFO ] [MAIN ] Derivative Progress: 62/2057 symbols completed. ALE took 1.2s. Estimated remaining: 13m 36s. Rate: 146.7 symbols/min [2025-09-29T22:04:45.686170] [INFO ] [MAIN ] ALLE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:45.685804] [DEBUG] [LOCAL ] ALEX: Saving derivative data. [2025-09-29T22:04:45.719507] [DEBUG] [LOCAL ] ALEX: Derivative data saved (1794 records). [2025-09-29T22:04:45.719669] [INFO ] [MAIN ] ALEX: Successfully saved derivative data. [2025-09-29T22:04:45.722176] [INFO ] [MAIN ] Derivative Progress: 63/2057 symbols completed. ALEX took 1.2s. Estimated remaining: 13m 24s. Rate: 148.8 symbols/min [2025-09-29T22:04:45.722386] [INFO ] [MAIN ] ALLY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:45.742060] [DEBUG] [LOCAL ] ALIT: Loaded 52760 existing records from primary storage. [2025-09-29T22:04:45.742258] [INFO ] [MAIN ] ALIT: Loaded 52760 primary data records. [2025-09-29T22:04:46.088566] [DEBUG] [LOCAL ] ALLE: Loaded 44821 existing records from primary storage. [2025-09-29T22:04:46.103928] [INFO ] [MAIN ] ALLE: Loaded 44821 primary data records. [2025-09-29T22:04:46.189941] [DEBUG] [LOCAL ] ALLY: Loaded 53217 existing records from primary storage. [2025-09-29T22:04:46.243762] [INFO ] [MAIN ] ALLY: Loaded 53217 primary data records. [2025-09-29T22:04:46.867827] [DEBUG] [MAIN ] ALIT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:46.869470] [INFO ] [MAIN ] ALIT: Generated 1794 derivative records from 52760 primary records. [2025-09-29T22:04:46.869744] [DEBUG] [LOCAL ] ALIT: Saving derivative data. [2025-09-29T22:04:46.896631] [DEBUG] [LOCAL ] ALIT: Derivative data saved (1794 records). [2025-09-29T22:04:46.897199] [INFO ] [MAIN ] ALIT: Successfully saved derivative data. [2025-09-29T22:04:46.901539] [INFO ] [MAIN ] Derivative Progress: 64/2057 symbols completed. ALIT took 1.3s. Estimated remaining: 13m 48s. Rate: 144.5 symbols/min [2025-09-29T22:04:46.903247] [INFO ] [MAIN ] ALSN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:46.919210] [DEBUG] [MAIN ] ALLE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:46.921329] [INFO ] [MAIN ] ALLE: Generated 1794 derivative records from 44821 primary records. [2025-09-29T22:04:46.922425] [DEBUG] [LOCAL ] ALLE: Saving derivative data. [2025-09-29T22:04:46.951262] [DEBUG] [MAIN ] ALLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:46.953361] [INFO ] [MAIN ] ALLY: Generated 1794 derivative records from 53217 primary records. [2025-09-29T22:04:46.953451] [DEBUG] [LOCAL ] ALLY: Saving derivative data. [2025-09-29T22:04:46.969596] [DEBUG] [LOCAL ] ALLE: Derivative data saved (1794 records). [2025-09-29T22:04:46.970260] [INFO ] [MAIN ] ALLE: Successfully saved derivative data. [2025-09-29T22:04:46.972857] [INFO ] [MAIN ] Derivative Progress: 65/2057 symbols completed. ALLE took 1.3s. Estimated remaining: 13m 37s. Rate: 146.4 symbols/min [2025-09-29T22:04:46.973349] [INFO ] [MAIN ] ALTG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:46.987969] [DEBUG] [LOCAL ] ALLY: Derivative data saved (1794 records). [2025-09-29T22:04:46.988159] [INFO ] [MAIN ] ALLY: Successfully saved derivative data. [2025-09-29T22:04:46.990470] [INFO ] [MAIN ] Derivative Progress: 66/2057 symbols completed. ALLY took 1.3s. Estimated remaining: 13m 24s. Rate: 148.5 symbols/min [2025-09-29T22:04:46.990783] [INFO ] [MAIN ] ALV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:47.011982] [DEBUG] [LOCAL ] ALSN: Loaded 43263 existing records from primary storage. [2025-09-29T22:04:47.012200] [INFO ] [MAIN ] ALSN: Loaded 43263 primary data records. [2025-09-29T22:04:47.093818] [DEBUG] [LOCAL ] ALTG: Loaded 23671 existing records from primary storage. [2025-09-29T22:04:47.111734] [INFO ] [MAIN ] ALTG: Loaded 23671 primary data records. [2025-09-29T22:04:47.577879] [DEBUG] [LOCAL ] ALV: Loaded 42485 existing records from primary storage. [2025-09-29T22:04:47.578920] [INFO ] [MAIN ] ALV: Loaded 42485 primary data records. [2025-09-29T22:04:48.084919] [DEBUG] [MAIN ] ALSN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:48.086314] [INFO ] [MAIN ] ALSN: Generated 1794 derivative records from 43263 primary records. [2025-09-29T22:04:48.087607] [DEBUG] [LOCAL ] ALSN: Saving derivative data. [2025-09-29T22:04:48.105544] [DEBUG] [LOCAL ] ALSN: Derivative data saved (1794 records). [2025-09-29T22:04:48.106974] [INFO ] [MAIN ] ALSN: Successfully saved derivative data. [2025-09-29T22:04:48.111498] [INFO ] [MAIN ] Derivative Progress: 67/2057 symbols completed. ALSN took 1.2s. Estimated remaining: 13m 45s. Rate: 144.7 symbols/min [2025-09-29T22:04:48.112893] [INFO ] [MAIN ] ALX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:48.128077] [DEBUG] [MAIN ] ALTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:48.129177] [INFO ] [MAIN ] ALTG: Generated 1794 derivative records from 23671 primary records. [2025-09-29T22:04:48.131272] [DEBUG] [LOCAL ] ALTG: Saving derivative data. [2025-09-29T22:04:48.135904] [DEBUG] [LOCAL ] ALX: Loaded 6134 existing records from primary storage. [2025-09-29T22:04:48.148244] [INFO ] [MAIN ] ALX: Loaded 6134 primary data records. [2025-09-29T22:04:48.272262] [DEBUG] [MAIN ] ALV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:48.288227] [DEBUG] [LOCAL ] ALTG: Derivative data saved (1794 records). [2025-09-29T22:04:48.293803] [INFO ] [MAIN ] ALTG: Successfully saved derivative data. [2025-09-29T22:04:48.287192] [INFO ] [MAIN ] ALV: Generated 1794 derivative records from 42485 primary records. [2025-09-29T22:04:48.296477] [DEBUG] [LOCAL ] ALV: Saving derivative data. [2025-09-29T22:04:48.296369] [INFO ] [MAIN ] Derivative Progress: 68/2057 symbols completed. ALTG took 1.3s. Estimated remaining: 13m 38s. Rate: 145.9 symbols/min [2025-09-29T22:04:48.313259] [INFO ] [MAIN ] AM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:48.523545] [DEBUG] [LOCAL ] ALV: Derivative data saved (1794 records). [2025-09-29T22:04:48.524571] [INFO ] [MAIN ] ALV: Successfully saved derivative data. [2025-09-29T22:04:48.527372] [INFO ] [MAIN ] Derivative Progress: 69/2057 symbols completed. ALV took 1.5s. Estimated remaining: 13m 33s. Rate: 146.8 symbols/min [2025-09-29T22:04:48.527818] [INFO ] [MAIN ] AMBC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:48.583553] [DEBUG] [MAIN ] ALX: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-09-29T22:04:48.598264] [INFO ] [MAIN ] ALX: Generated 1792 derivative records from 6134 primary records. [2025-09-29T22:04:48.599839] [DEBUG] [LOCAL ] ALX: Saving derivative data. [2025-09-29T22:04:48.601018] [DEBUG] [LOCAL ] AM: Loaded 52096 existing records from primary storage. [2025-09-29T22:04:48.602032] [INFO ] [MAIN ] AM: Loaded 52096 primary data records. [2025-09-29T22:04:48.710624] [DEBUG] [LOCAL ] AMBC: Loaded 36595 existing records from primary storage. [2025-09-29T22:04:48.723445] [INFO ] [MAIN ] AMBC: Loaded 36595 primary data records. [2025-09-29T22:04:48.779466] [DEBUG] [LOCAL ] ALX: Derivative data saved (1792 records). [2025-09-29T22:04:48.794237] [INFO ] [MAIN ] ALX: Successfully saved derivative data. [2025-09-29T22:04:48.851185] [INFO ] [MAIN ] Derivative Progress: 70/2057 symbols completed. ALX took 0.7s. Estimated remaining: 13m 30s. Rate: 147.2 symbols/min [2025-09-29T22:04:48.949533] [INFO ] [MAIN ] AMBP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:49.316300] [DEBUG] [MAIN ] AM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:49.330496] [INFO ] [MAIN ] AM: Generated 1794 derivative records from 52096 primary records. [2025-09-29T22:04:49.330742] [DEBUG] [LOCAL ] AM: Saving derivative data. [2025-09-29T22:04:49.331942] [DEBUG] [LOCAL ] AMBP: Loaded 45121 existing records from primary storage. [2025-09-29T22:04:49.332258] [INFO ] [MAIN ] AMBP: Loaded 45121 primary data records. [2025-09-29T22:04:49.436997] [DEBUG] [LOCAL ] AM: Derivative data saved (1794 records). [2025-09-29T22:04:49.463592] [INFO ] [MAIN ] AM: Successfully saved derivative data. [2025-09-29T22:04:49.467323] [INFO ] [MAIN ] Derivative Progress: 71/2057 symbols completed. AM took 1.2s. Estimated remaining: 13m 35s. Rate: 146.2 symbols/min [2025-09-29T22:04:49.473086] [INFO ] [MAIN ] AMC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:49.568691] [DEBUG] [MAIN ] AMBC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:49.569434] [INFO ] [MAIN ] AMBC: Generated 1794 derivative records from 36595 primary records. [2025-09-29T22:04:49.675723] [DEBUG] [LOCAL ] AMBC: Saving derivative data. [2025-09-29T22:04:49.747528] [DEBUG] [LOCAL ] AMBC: Derivative data saved (1794 records). [2025-09-29T22:04:49.748315] [INFO ] [MAIN ] AMBC: Successfully saved derivative data. [2025-09-29T22:04:49.755482] [INFO ] [MAIN ] Derivative Progress: 72/2057 symbols completed. AMBC took 1.2s. Estimated remaining: 13m 31s. Rate: 146.8 symbols/min [2025-09-29T22:04:49.756131] [INFO ] [MAIN ] AMCR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:49.793746] [DEBUG] [MAIN ] AMBP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:49.794555] [INFO ] [MAIN ] AMBP: Generated 1794 derivative records from 45121 primary records. [2025-09-29T22:04:49.794849] [DEBUG] [LOCAL ] AMBP: Saving derivative data. [2025-09-29T22:04:49.829871] [DEBUG] [LOCAL ] AMC: Loaded 53760 existing records from primary storage. [2025-09-29T22:04:49.828471] [DEBUG] [LOCAL ] AMBP: Derivative data saved (1794 records). [2025-09-29T22:04:49.830179] [INFO ] [MAIN ] AMC: Loaded 53760 primary data records. [2025-09-29T22:04:49.830239] [INFO ] [MAIN ] AMBP: Successfully saved derivative data. [2025-09-29T22:04:49.832599] [INFO ] [MAIN ] Derivative Progress: 73/2057 symbols completed. AMBP took 0.9s. Estimated remaining: 13m 22s. Rate: 148.4 symbols/min [2025-09-29T22:04:49.989950] [DEBUG] [LOCAL ] AMCR: Loaded 53669 existing records from primary storage. [2025-09-29T22:04:50.000355] [INFO ] [MAIN ] AMCR: Loaded 53669 primary data records. [2025-09-29T22:04:50.569820] [DEBUG] [MAIN ] AMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:50.570976] [INFO ] [MAIN ] AMC: Generated 1794 derivative records from 53760 primary records. [2025-09-29T22:04:50.571063] [DEBUG] [LOCAL ] AMC: Saving derivative data. [2025-09-29T22:04:50.588008] [DEBUG] [LOCAL ] AMC: Derivative data saved (1794 records). [2025-09-29T22:04:50.588111] [INFO ] [MAIN ] AMC: Successfully saved derivative data. [2025-09-29T22:04:50.590172] [INFO ] [MAIN ] Derivative Progress: 74/2057 symbols completed. AMC took 1.1s. Estimated remaining: 13m 31s. Rate: 146.7 symbols/min [2025-09-29T22:04:50.607682] [DEBUG] [MAIN ] AMCR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:50.608467] [INFO ] [MAIN ] AMCR: Generated 1794 derivative records from 53669 primary records. [2025-09-29T22:04:50.608535] [DEBUG] [LOCAL ] AMCR: Saving derivative data. [2025-09-29T22:04:50.625019] [DEBUG] [LOCAL ] AMCR: Derivative data saved (1794 records). [2025-09-29T22:04:50.625102] [INFO ] [MAIN ] AMCR: Successfully saved derivative data. [2025-09-29T22:04:50.627275] [INFO ] [MAIN ] Derivative Progress: 75/2057 symbols completed. AMCR took 0.9s. Estimated remaining: 13m 21s. Rate: 148.5 symbols/min [2025-09-29T22:04:50.627844] [INFO ] [MAIN ] AMG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:50.627787] [INFO ] [MAIN ] AME: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:50.628037] [INFO ] [MAIN ] AMH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:50.661366] [DEBUG] [LOCAL ] AMG: Loaded 20495 existing records from primary storage. [2025-09-29T22:04:50.661526] [INFO ] [MAIN ] AMG: Loaded 20495 primary data records. [2025-09-29T22:04:50.850287] [DEBUG] [LOCAL ] AMH: Loaded 51699 existing records from primary storage. [2025-09-29T22:04:50.920247] [INFO ] [MAIN ] AMH: Loaded 51699 primary data records. [2025-09-29T22:04:50.985799] [DEBUG] [LOCAL ] AME: Loaded 48537 existing records from primary storage. [2025-09-29T22:04:51.063923] [INFO ] [MAIN ] AME: Loaded 48537 primary data records. [2025-09-29T22:04:51.751567] [DEBUG] [MAIN ] AMG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:51.754705] [INFO ] [MAIN ] AMG: Generated 1794 derivative records from 20495 primary records. [2025-09-29T22:04:51.755765] [DEBUG] [LOCAL ] AMG: Saving derivative data. [2025-09-29T22:04:51.774637] [DEBUG] [LOCAL ] AMG: Derivative data saved (1794 records). [2025-09-29T22:04:51.775227] [INFO ] [MAIN ] AMG: Successfully saved derivative data. [2025-09-29T22:04:51.777277] [INFO ] [MAIN ] Derivative Progress: 76/2057 symbols completed. AMG took 1.1s. Estimated remaining: 13m 40s. Rate: 145.0 symbols/min [2025-09-29T22:04:51.777444] [INFO ] [MAIN ] AMN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:51.800618] [DEBUG] [MAIN ] AMH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:51.802847] [INFO ] [MAIN ] AMH: Generated 1794 derivative records from 51699 primary records. [2025-09-29T22:04:51.803855] [DEBUG] [LOCAL ] AMH: Saving derivative data. [2025-09-29T22:04:51.830841] [DEBUG] [MAIN ] AME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:51.834285] [INFO ] [MAIN ] AME: Generated 1794 derivative records from 48537 primary records. [2025-09-29T22:04:51.834378] [DEBUG] [LOCAL ] AME: Saving derivative data. [2025-09-29T22:04:51.858904] [DEBUG] [LOCAL ] AMH: Derivative data saved (1794 records). [2025-09-29T22:04:51.860621] [INFO ] [MAIN ] AMH: Successfully saved derivative data. [2025-09-29T22:04:51.863036] [INFO ] [MAIN ] Derivative Progress: 77/2057 symbols completed. AMH took 1.2s. Estimated remaining: 13m 31s. Rate: 146.5 symbols/min [2025-09-29T22:04:51.863790] [INFO ] [MAIN ] AMP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:51.867001] [DEBUG] [LOCAL ] AME: Derivative data saved (1794 records). [2025-09-29T22:04:51.867199] [INFO ] [MAIN ] AME: Successfully saved derivative data. [2025-09-29T22:04:51.869880] [INFO ] [MAIN ] Derivative Progress: 78/2057 symbols completed. AME took 1.2s. Estimated remaining: 13m 20s. Rate: 148.4 symbols/min [2025-09-29T22:04:51.870331] [INFO ] [MAIN ] AMPX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:51.885740] [DEBUG] [LOCAL ] AMN: Loaded 41796 existing records from primary storage. [2025-09-29T22:04:51.885973] [INFO ] [MAIN ] AMN: Loaded 41796 primary data records. [2025-09-29T22:04:52.113929] [DEBUG] [LOCAL ] AMP: Loaded 32281 existing records from primary storage. [2025-09-29T22:04:52.130715] [INFO ] [MAIN ] AMP: Loaded 32281 primary data records. [2025-09-29T22:04:52.373460] [DEBUG] [LOCAL ] AMPX: Loaded 52224 existing records from primary storage. [2025-09-29T22:04:52.379445] [INFO ] [MAIN ] AMPX: Loaded 52224 primary data records. [2025-09-29T22:04:52.934269] [DEBUG] [MAIN ] AMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:52.936216] [INFO ] [MAIN ] AMN: Generated 1794 derivative records from 41796 primary records. [2025-09-29T22:04:52.936548] [DEBUG] [LOCAL ] AMN: Saving derivative data. [2025-09-29T22:04:52.979003] [DEBUG] [LOCAL ] AMN: Derivative data saved (1794 records). [2025-09-29T22:04:52.979834] [INFO ] [MAIN ] AMN: Successfully saved derivative data. [2025-09-29T22:04:52.979444] [DEBUG] [MAIN ] AMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:52.981279] [INFO ] [MAIN ] AMP: Generated 1794 derivative records from 32281 primary records. [2025-09-29T22:04:52.983760] [DEBUG] [LOCAL ] AMP: Saving derivative data. [2025-09-29T22:04:52.983574] [INFO ] [MAIN ] Derivative Progress: 79/2057 symbols completed. AMN took 1.2s. Estimated remaining: 13m 38s. Rate: 145.1 symbols/min [2025-09-29T22:04:52.984998] [INFO ] [MAIN ] AMR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:53.003031] [DEBUG] [LOCAL ] AMP: Derivative data saved (1794 records). [2025-09-29T22:04:53.003346] [INFO ] [MAIN ] AMP: Successfully saved derivative data. [2025-09-29T22:04:53.005821] [INFO ] [MAIN ] Derivative Progress: 80/2057 symbols completed. AMP took 1.1s. Estimated remaining: 13m 28s. Rate: 146.9 symbols/min [2025-09-29T22:04:53.006041] [INFO ] [MAIN ] AMRC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:53.023192] [DEBUG] [MAIN ] AMPX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:53.024182] [INFO ] [MAIN ] AMPX: Generated 1794 derivative records from 52224 primary records. [2025-09-29T22:04:53.024278] [DEBUG] [LOCAL ] AMPX: Saving derivative data. [2025-09-29T22:04:53.064048] [DEBUG] [LOCAL ] AMPX: Derivative data saved (1794 records). [2025-09-29T22:04:53.064481] [INFO ] [MAIN ] AMPX: Successfully saved derivative data. [2025-09-29T22:04:53.077721] [INFO ] [MAIN ] Derivative Progress: 81/2057 symbols completed. AMPX took 1.2s. Estimated remaining: 13m 19s. Rate: 148.4 symbols/min [2025-09-29T22:04:53.078035] [INFO ] [MAIN ] AMT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:53.079622] [DEBUG] [LOCAL ] AMR: Loaded 28957 existing records from primary storage. [2025-09-29T22:04:53.079863] [INFO ] [MAIN ] AMR: Loaded 28957 primary data records. [2025-09-29T22:04:53.204239] [DEBUG] [LOCAL ] AMRC: Loaded 38202 existing records from primary storage. [2025-09-29T22:04:53.215275] [INFO ] [MAIN ] AMRC: Loaded 38202 primary data records. [2025-09-29T22:04:53.650633] [DEBUG] [LOCAL ] AMT: Loaded 52433 existing records from primary storage. [2025-09-29T22:04:53.776085] [INFO ] [MAIN ] AMT: Loaded 52433 primary data records. [2025-09-29T22:04:54.188840] [DEBUG] [MAIN ] AMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:54.190797] [INFO ] [MAIN ] AMR: Generated 1794 derivative records from 28957 primary records. [2025-09-29T22:04:54.191291] [DEBUG] [LOCAL ] AMR: Saving derivative data. [2025-09-29T22:04:54.210583] [DEBUG] [LOCAL ] AMR: Derivative data saved (1794 records). [2025-09-29T22:04:54.213450] [INFO ] [MAIN ] AMR: Successfully saved derivative data. [2025-09-29T22:04:54.216210] [INFO ] [MAIN ] Derivative Progress: 82/2057 symbols completed. AMR took 1.2s. Estimated remaining: 13m 36s. Rate: 145.2 symbols/min [2025-09-29T22:04:54.216780] [INFO ] [MAIN ] AMTB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:54.232382] [DEBUG] [MAIN ] AMRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:54.233700] [INFO ] [MAIN ] AMRC: Generated 1794 derivative records from 38202 primary records. [2025-09-29T22:04:54.234068] [DEBUG] [LOCAL ] AMRC: Saving derivative data. [2025-09-29T22:04:54.257171] [DEBUG] [LOCAL ] AMRC: Derivative data saved (1794 records). [2025-09-29T22:04:54.257591] [INFO ] [MAIN ] AMRC: Successfully saved derivative data. [2025-09-29T22:04:54.259872] [INFO ] [MAIN ] Derivative Progress: 83/2057 symbols completed. AMRC took 1.3s. Estimated remaining: 13m 27s. Rate: 146.8 symbols/min [2025-09-29T22:04:54.261328] [INFO ] [MAIN ] AMTD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:54.285809] [DEBUG] [LOCAL ] AMTB: Loaded 20251 existing records from primary storage. [2025-09-29T22:04:54.287228] [DEBUG] [MAIN ] AMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:54.288595] [INFO ] [MAIN ] AMT: Generated 1794 derivative records from 52433 primary records. [2025-09-29T22:04:54.288787] [DEBUG] [LOCAL ] AMT: Saving derivative data. [2025-09-29T22:04:54.287772] [INFO ] [MAIN ] AMTB: Loaded 20251 primary data records. [2025-09-29T22:04:54.292729] [DEBUG] [LOCAL ] AMTD: Loaded 3600 existing records from primary storage. [2025-09-29T22:04:54.334052] [INFO ] [MAIN ] AMTD: Loaded 3600 primary data records. [2025-09-29T22:04:54.610258] [DEBUG] [LOCAL ] AMT: Derivative data saved (1794 records). [2025-09-29T22:04:54.636134] [INFO ] [MAIN ] AMT: Successfully saved derivative data. [2025-09-29T22:04:54.768446] [INFO ] [MAIN ] Derivative Progress: 84/2057 symbols completed. AMT took 1.7s. Estimated remaining: 13m 29s. Rate: 146.3 symbols/min [2025-09-29T22:04:54.773795] [INFO ] [MAIN ] AMTM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:55.011379] [DEBUG] [MAIN ] AMTB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:55.012260] [INFO ] [MAIN ] AMTB: Generated 1794 derivative records from 20251 primary records. [2025-09-29T22:04:55.012422] [DEBUG] [LOCAL ] AMTB: Saving derivative data. [2025-09-29T22:04:55.031421] [DEBUG] [LOCAL ] AMTB: Derivative data saved (1794 records). [2025-09-29T22:04:55.032700] [INFO ] [MAIN ] AMTB: Successfully saved derivative data. [2025-09-29T22:04:55.050608] [INFO ] [MAIN ] Derivative Progress: 85/2057 symbols completed. AMTB took 0.8s. Estimated remaining: 13m 26s. Rate: 146.9 symbols/min [2025-09-29T22:04:55.052487] [DEBUG] [LOCAL ] AMTM: Loaded 50658 existing records from primary storage. [2025-09-29T22:04:55.065885] [INFO ] [MAIN ] AMTM: Loaded 50658 primary data records. [2025-09-29T22:04:55.065780] [DEBUG] [MAIN ] AMTD: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-09-29T22:04:55.051208] [INFO ] [MAIN ] AMWL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:55.066801] [INFO ] [MAIN ] AMTD: Generated 1792 derivative records from 3600 primary records. [2025-09-29T22:04:55.079363] [DEBUG] [LOCAL ] AMTD: Saving derivative data. [2025-09-29T22:04:55.180639] [DEBUG] [LOCAL ] AMTD: Derivative data saved (1792 records). [2025-09-29T22:04:55.195120] [INFO ] [MAIN ] AMTD: Successfully saved derivative data. [2025-09-29T22:04:55.201279] [INFO ] [MAIN ] Derivative Progress: 86/2057 symbols completed. AMTD took 0.9s. Estimated remaining: 13m 19s. Rate: 148.0 symbols/min [2025-09-29T22:04:55.211741] [DEBUG] [LOCAL ] AMWL: Loaded 8685 existing records from primary storage. [2025-09-29T22:04:55.205524] [INFO ] [MAIN ] AMX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:55.222271] [INFO ] [MAIN ] AMWL: Loaded 8685 primary data records. [2025-09-29T22:04:55.768620] [DEBUG] [LOCAL ] AMX: Loaded 49128 existing records from primary storage. [2025-09-29T22:04:55.769146] [INFO ] [MAIN ] AMX: Loaded 49128 primary data records. [2025-09-29T22:04:55.990679] [DEBUG] [MAIN ] AMTM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:56.145229] [INFO ] [MAIN ] AMTM: Generated 1794 derivative records from 50658 primary records. [2025-09-29T22:04:56.158957] [DEBUG] [LOCAL ] AMTM: Saving derivative data. [2025-09-29T22:04:56.179450] [DEBUG] [LOCAL ] AMTM: Derivative data saved (1794 records). [2025-09-29T22:04:56.181135] [INFO ] [MAIN ] AMTM: Successfully saved derivative data. [2025-09-29T22:04:56.183813] [INFO ] [MAIN ] Derivative Progress: 87/2057 symbols completed. AMTM took 1.4s. Estimated remaining: 13m 32s. Rate: 145.6 symbols/min [2025-09-29T22:04:56.184201] [INFO ] [MAIN ] AN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:56.212174] [DEBUG] [MAIN ] AMWL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:56.213547] [INFO ] [MAIN ] AMWL: Generated 1794 derivative records from 8685 primary records. [2025-09-29T22:04:56.213952] [DEBUG] [LOCAL ] AMWL: Saving derivative data. [2025-09-29T22:04:56.273080] [DEBUG] [MAIN ] AMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:56.274233] [INFO ] [MAIN ] AMX: Generated 1794 derivative records from 49128 primary records. [2025-09-29T22:04:56.274579] [DEBUG] [LOCAL ] AMX: Saving derivative data. [2025-09-29T22:04:56.276856] [DEBUG] [LOCAL ] AMWL: Derivative data saved (1794 records). [2025-09-29T22:04:56.276154] [DEBUG] [LOCAL ] AN: Loaded 32121 existing records from primary storage. [2025-09-29T22:04:56.277043] [INFO ] [MAIN ] AN: Loaded 32121 primary data records. [2025-09-29T22:04:56.283030] [INFO ] [MAIN ] AMWL: Successfully saved derivative data. [2025-09-29T22:04:56.305981] [INFO ] [MAIN ] Derivative Progress: 88/2057 symbols completed. AMWL took 1.3s. Estimated remaining: 13m 25s. Rate: 146.7 symbols/min [2025-09-29T22:04:56.476843] [DEBUG] [LOCAL ] AMX: Derivative data saved (1794 records). [2025-09-29T22:04:56.570490] [INFO ] [MAIN ] AMX: Successfully saved derivative data. [2025-09-29T22:04:56.621870] [INFO ] [MAIN ] Derivative Progress: 89/2057 symbols completed. AMX took 1.4s. Estimated remaining: 13m 23s. Rate: 147.1 symbols/min [2025-09-29T22:04:56.648158] [DEBUG] [MAIN ] AN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:56.648863] [INFO ] [MAIN ] AN: Generated 1794 derivative records from 32121 primary records. [2025-09-29T22:04:56.648934] [DEBUG] [LOCAL ] AN: Saving derivative data. [2025-09-29T22:04:56.665524] [DEBUG] [LOCAL ] AN: Derivative data saved (1794 records). [2025-09-29T22:04:56.665693] [INFO ] [MAIN ] AN: Successfully saved derivative data. [2025-09-29T22:04:56.667834] [INFO ] [MAIN ] Derivative Progress: 90/2057 symbols completed. AN took 0.5s. Estimated remaining: 13m 14s. Rate: 148.6 symbols/min [2025-09-29T22:04:56.668450] [INFO ] [MAIN ] ANET: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:56.668725] [INFO ] [MAIN ] ANF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:56.668579] [INFO ] [MAIN ] ANRO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:56.696308] [DEBUG] [LOCAL ] ANRO: Loaded 18969 existing records from primary storage. [2025-09-29T22:04:56.696462] [INFO ] [MAIN ] ANRO: Loaded 18969 primary data records. [2025-09-29T22:04:56.914508] [DEBUG] [LOCAL ] ANF: Loaded 52173 existing records from primary storage. [2025-09-29T22:04:56.948837] [INFO ] [MAIN ] ANF: Loaded 52173 primary data records. [2025-09-29T22:04:57.175041] [DEBUG] [LOCAL ] ANET: Loaded 53766 existing records from primary storage. [2025-09-29T22:04:57.181215] [INFO ] [MAIN ] ANET: Loaded 53766 primary data records. [2025-09-29T22:04:57.767496] [DEBUG] [MAIN ] ANRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:57.769605] [INFO ] [MAIN ] ANRO: Generated 1794 derivative records from 18969 primary records. [2025-09-29T22:04:57.769946] [DEBUG] [LOCAL ] ANRO: Saving derivative data. [2025-09-29T22:04:57.791617] [DEBUG] [LOCAL ] ANRO: Derivative data saved (1794 records). [2025-09-29T22:04:57.792216] [INFO ] [MAIN ] ANRO: Successfully saved derivative data. [2025-09-29T22:04:57.794830] [INFO ] [MAIN ] Derivative Progress: 91/2057 symbols completed. ANRO took 1.1s. Estimated remaining: 13m 30s. Rate: 145.7 symbols/min [2025-09-29T22:04:57.795250] [INFO ] [MAIN ] ANVS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:57.810343] [DEBUG] [MAIN ] ANF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:57.811608] [INFO ] [MAIN ] ANF: Generated 1794 derivative records from 52173 primary records. [2025-09-29T22:04:57.812113] [DEBUG] [LOCAL ] ANF: Saving derivative data. [2025-09-29T22:04:57.830520] [DEBUG] [LOCAL ] ANF: Derivative data saved (1794 records). [2025-09-29T22:04:57.836204] [INFO ] [MAIN ] ANF: Successfully saved derivative data. [2025-09-29T22:04:57.838415] [INFO ] [MAIN ] Derivative Progress: 92/2057 symbols completed. ANF took 1.2s. Estimated remaining: 13m 21s. Rate: 147.1 symbols/min [2025-09-29T22:04:57.840001] [INFO ] [MAIN ] AOD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:57.864490] [DEBUG] [LOCAL ] ANVS: Loaded 23113 existing records from primary storage. [2025-09-29T22:04:57.865212] [INFO ] [MAIN ] ANVS: Loaded 23113 primary data records. [2025-09-29T22:04:57.865125] [DEBUG] [MAIN ] ANET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:57.887516] [INFO ] [MAIN ] ANET: Generated 1794 derivative records from 53766 primary records. [2025-09-29T22:04:57.922162] [DEBUG] [LOCAL ] ANET: Saving derivative data. [2025-09-29T22:04:58.000207] [DEBUG] [LOCAL ] ANET: Derivative data saved (1794 records). [2025-09-29T22:04:58.011202] [INFO ] [MAIN ] ANET: Successfully saved derivative data. [2025-09-29T22:04:58.030368] [INFO ] [MAIN ] Derivative Progress: 93/2057 symbols completed. ANET took 1.4s. Estimated remaining: 13m 16s. Rate: 148.0 symbols/min [2025-09-29T22:04:58.102256] [INFO ] [MAIN ] AOMR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:58.261158] [DEBUG] [LOCAL ] AOD: Loaded 30055 existing records from primary storage. [2025-09-29T22:04:58.261452] [INFO ] [MAIN ] AOD: Loaded 30055 primary data records. [2025-09-29T22:04:58.405859] [DEBUG] [LOCAL ] AOMR: Loaded 16553 existing records from primary storage. [2025-09-29T22:04:58.411393] [INFO ] [MAIN ] AOMR: Loaded 16553 primary data records. [2025-09-29T22:04:58.987775] [DEBUG] [MAIN ] ANVS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:58.989720] [INFO ] [MAIN ] ANVS: Generated 1794 derivative records from 23113 primary records. [2025-09-29T22:04:58.991831] [DEBUG] [LOCAL ] ANVS: Saving derivative data. [2025-09-29T22:04:59.037803] [DEBUG] [MAIN ] AOD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:59.040869] [INFO ] [MAIN ] AOD: Generated 1794 derivative records from 30055 primary records. [2025-09-29T22:04:59.041379] [DEBUG] [LOCAL ] AOD: Saving derivative data. [2025-09-29T22:04:59.043817] [DEBUG] [LOCAL ] ANVS: Derivative data saved (1794 records). [2025-09-29T22:04:59.064858] [INFO ] [MAIN ] ANVS: Successfully saved derivative data. [2025-09-29T22:04:59.066669] [DEBUG] [MAIN ] AOMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:04:59.067778] [INFO ] [MAIN ] AOMR: Generated 1794 derivative records from 16553 primary records. [2025-09-29T22:04:59.070804] [DEBUG] [LOCAL ] AOMR: Saving derivative data. [2025-09-29T22:04:59.082260] [DEBUG] [LOCAL ] AOD: Derivative data saved (1794 records). [2025-09-29T22:04:59.082412] [INFO ] [MAIN ] AOD: Successfully saved derivative data. [2025-09-29T22:04:59.081165] [INFO ] [MAIN ] Derivative Progress: 94/2057 symbols completed. ANVS took 1.3s. Estimated remaining: 13m 29s. Rate: 145.5 symbols/min [2025-09-29T22:04:59.085319] [INFO ] [MAIN ] AON: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:59.092999] [INFO ] [MAIN ] Derivative Progress: 95/2057 symbols completed. AOD took 1.2s. Estimated remaining: 13m 21s. Rate: 147.0 symbols/min [2025-09-29T22:04:59.093226] [INFO ] [MAIN ] AORT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:59.104224] [DEBUG] [LOCAL ] AOMR: Derivative data saved (1794 records). [2025-09-29T22:04:59.104327] [INFO ] [MAIN ] AOMR: Successfully saved derivative data. [2025-09-29T22:04:59.106877] [INFO ] [MAIN ] Derivative Progress: 96/2057 symbols completed. AOMR took 1.0s. Estimated remaining: 13m 12s. Rate: 148.5 symbols/min [2025-09-29T22:04:59.107073] [INFO ] [MAIN ] AOS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:04:59.139814] [DEBUG] [LOCAL ] AORT: Loaded 29482 existing records from primary storage. [2025-09-29T22:04:59.140158] [INFO ] [MAIN ] AORT: Loaded 29482 primary data records. [2025-09-29T22:04:59.341081] [DEBUG] [LOCAL ] AON: Loaded 45463 existing records from primary storage. [2025-09-29T22:04:59.376252] [INFO ] [MAIN ] AON: Loaded 45463 primary data records. [2025-09-29T22:04:59.533806] [DEBUG] [LOCAL ] AOS: Loaded 48890 existing records from primary storage. [2025-09-29T22:04:59.533934] [INFO ] [MAIN ] AOS: Loaded 48890 primary data records. [2025-09-29T22:05:00.246100] [DEBUG] [MAIN ] AORT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:00.248441] [INFO ] [MAIN ] AORT: Generated 1794 derivative records from 29482 primary records. [2025-09-29T22:05:00.248805] [DEBUG] [LOCAL ] AORT: Saving derivative data. [2025-09-29T22:05:00.268403] [DEBUG] [LOCAL ] AORT: Derivative data saved (1794 records). [2025-09-29T22:05:00.269875] [INFO ] [MAIN ] AORT: Successfully saved derivative data. [2025-09-29T22:05:00.272260] [INFO ] [MAIN ] Derivative Progress: 97/2057 symbols completed. AORT took 1.2s. Estimated remaining: 13m 27s. Rate: 145.7 symbols/min [2025-09-29T22:05:00.272680] [INFO ] [MAIN ] AP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:00.295780] [DEBUG] [MAIN ] AON: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:00.296687] [INFO ] [MAIN ] AON: Generated 1794 derivative records from 45463 primary records. [2025-09-29T22:05:00.296910] [DEBUG] [LOCAL ] AON: Saving derivative data. [2025-09-29T22:05:00.315431] [DEBUG] [MAIN ] AOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:00.313781] [DEBUG] [LOCAL ] AP: Loaded 7191 existing records from primary storage. [2025-09-29T22:05:00.316625] [INFO ] [MAIN ] AOS: Generated 1794 derivative records from 48890 primary records. [2025-09-29T22:05:00.324154] [DEBUG] [LOCAL ] AOS: Saving derivative data. [2025-09-29T22:05:00.324063] [INFO ] [MAIN ] AP: Loaded 7191 primary data records. [2025-09-29T22:05:00.364193] [DEBUG] [LOCAL ] AON: Derivative data saved (1794 records). [2025-09-29T22:05:00.391718] [INFO ] [MAIN ] AON: Successfully saved derivative data. [2025-09-29T22:05:00.423378] [INFO ] [MAIN ] Derivative Progress: 98/2057 symbols completed. AON took 1.3s. Estimated remaining: 13m 22s. Rate: 146.6 symbols/min [2025-09-29T22:05:00.432146] [INFO ] [MAIN ] APH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:00.466891] [DEBUG] [LOCAL ] AOS: Derivative data saved (1794 records). [2025-09-29T22:05:00.472708] [INFO ] [MAIN ] AOS: Successfully saved derivative data. [2025-09-29T22:05:00.490301] [INFO ] [MAIN ] Derivative Progress: 99/2057 symbols completed. AOS took 1.4s. Estimated remaining: 13m 14s. Rate: 147.9 symbols/min [2025-09-29T22:05:00.511120] [INFO ] [MAIN ] APLE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:00.750043] [DEBUG] [MAIN ] AP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:00.750951] [INFO ] [MAIN ] AP: Generated 1794 derivative records from 7191 primary records. [2025-09-29T22:05:00.751076] [DEBUG] [LOCAL ] AP: Saving derivative data. [2025-09-29T22:05:00.753452] [DEBUG] [LOCAL ] APH: Loaded 53691 existing records from primary storage. [2025-09-29T22:05:00.753681] [INFO ] [MAIN ] APH: Loaded 53691 primary data records. [2025-09-29T22:05:00.875385] [DEBUG] [LOCAL ] APLE: Loaded 51976 existing records from primary storage. [2025-09-29T22:05:00.893171] [DEBUG] [LOCAL ] AP: Derivative data saved (1794 records). [2025-09-29T22:05:00.896990] [INFO ] [MAIN ] APLE: Loaded 51976 primary data records. [2025-09-29T22:05:00.897084] [INFO ] [MAIN ] AP: Successfully saved derivative data. [2025-09-29T22:05:00.899465] [INFO ] [MAIN ] Derivative Progress: 100/2057 symbols completed. AP took 0.6s. Estimated remaining: 13m 14s. Rate: 147.9 symbols/min [2025-09-29T22:05:00.940762] [INFO ] [MAIN ] APO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:01.497558] [DEBUG] [MAIN ] APH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:01.519512] [INFO ] [MAIN ] APH: Generated 1794 derivative records from 53691 primary records. [2025-09-29T22:05:01.518684] [DEBUG] [LOCAL ] APO: Loaded 53382 existing records from primary storage. [2025-09-29T22:05:01.519819] [INFO ] [MAIN ] APO: Loaded 53382 primary data records. [2025-09-29T22:05:01.519749] [DEBUG] [LOCAL ] APH: Saving derivative data. [2025-09-29T22:05:01.657049] [DEBUG] [MAIN ] APLE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:01.677975] [DEBUG] [LOCAL ] APH: Derivative data saved (1794 records). [2025-09-29T22:05:01.678127] [INFO ] [MAIN ] APH: Successfully saved derivative data. [2025-09-29T22:05:01.681940] [INFO ] [MAIN ] Derivative Progress: 101/2057 symbols completed. APH took 1.2s. Estimated remaining: 13m 21s. Rate: 146.5 symbols/min [2025-09-29T22:05:01.673211] [INFO ] [MAIN ] APLE: Generated 1794 derivative records from 51976 primary records. [2025-09-29T22:05:01.693352] [DEBUG] [LOCAL ] APLE: Saving derivative data. [2025-09-29T22:05:01.699621] [INFO ] [MAIN ] APOS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:01.928387] [DEBUG] [LOCAL ] APLE: Derivative data saved (1794 records). [2025-09-29T22:05:01.933508] [DEBUG] [LOCAL ] APOS: Loaded 7514 existing records from primary storage. [2025-09-29T22:05:01.933943] [INFO ] [MAIN ] APLE: Successfully saved derivative data. [2025-09-29T22:05:01.937021] [INFO ] [MAIN ] Derivative Progress: 102/2057 symbols completed. APLE took 1.4s. Estimated remaining: 13m 18s. Rate: 147.1 symbols/min [2025-09-29T22:05:01.937861] [INFO ] [MAIN ] APTV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:01.937458] [INFO ] [MAIN ] APOS: Loaded 7514 primary data records. [2025-09-29T22:05:02.322836] [DEBUG] [MAIN ] APO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:02.324318] [INFO ] [MAIN ] APO: Generated 1794 derivative records from 53382 primary records. [2025-09-29T22:05:02.325100] [DEBUG] [LOCAL ] APO: Saving derivative data. [2025-09-29T22:05:02.363026] [DEBUG] [LOCAL ] APO: Derivative data saved (1794 records). [2025-09-29T22:05:02.362910] [DEBUG] [LOCAL ] APTV: Loaded 52148 existing records from primary storage. [2025-09-29T22:05:02.363219] [INFO ] [MAIN ] APTV: Loaded 52148 primary data records. [2025-09-29T22:05:02.363317] [INFO ] [MAIN ] APO: Successfully saved derivative data. [2025-09-29T22:05:02.365631] [INFO ] [MAIN ] Derivative Progress: 103/2057 symbols completed. APO took 1.4s. Estimated remaining: 13m 18s. Rate: 147.0 symbols/min [2025-09-29T22:05:02.764037] [DEBUG] [MAIN ] APOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:02.765372] [INFO ] [MAIN ] APOS: Generated 1794 derivative records from 7514 primary records. [2025-09-29T22:05:02.766091] [DEBUG] [LOCAL ] APOS: Saving derivative data. [2025-09-29T22:05:02.785872] [DEBUG] [LOCAL ] APOS: Derivative data saved (1794 records). [2025-09-29T22:05:02.786046] [INFO ] [MAIN ] APOS: Successfully saved derivative data. [2025-09-29T22:05:02.789206] [INFO ] [MAIN ] Derivative Progress: 104/2057 symbols completed. APOS took 1.1s. Estimated remaining: 13m 17s. Rate: 146.9 symbols/min [2025-09-29T22:05:02.810842] [DEBUG] [MAIN ] APTV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:02.811541] [INFO ] [MAIN ] APTV: Generated 1794 derivative records from 52148 primary records. [2025-09-29T22:05:02.811609] [DEBUG] [LOCAL ] APTV: Saving derivative data. [2025-09-29T22:05:02.827521] [DEBUG] [LOCAL ] APTV: Derivative data saved (1794 records). [2025-09-29T22:05:02.827685] [INFO ] [MAIN ] APTV: Successfully saved derivative data. [2025-09-29T22:05:02.830147] [INFO ] [MAIN ] Derivative Progress: 105/2057 symbols completed. APTV took 0.9s. Estimated remaining: 13m 10s. Rate: 148.2 symbols/min [2025-09-29T22:05:02.830601] [INFO ] [MAIN ] AQNB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:02.830736] [INFO ] [MAIN ] ARCO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:02.830829] [INFO ] [MAIN ] AR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:02.840828] [DEBUG] [LOCAL ] AQNB: Loaded 4142 existing records from primary storage. [2025-09-29T22:05:02.841275] [INFO ] [MAIN ] AQNB: Loaded 4142 primary data records. [2025-09-29T22:05:03.201231] [DEBUG] [LOCAL ] ARCO: Loaded 44534 existing records from primary storage. [2025-09-29T22:05:03.216009] [INFO ] [MAIN ] ARCO: Loaded 44534 primary data records. [2025-09-29T22:05:03.269062] [DEBUG] [LOCAL ] AR: Loaded 53584 existing records from primary storage. [2025-09-29T22:05:03.282586] [INFO ] [MAIN ] AR: Loaded 53584 primary data records. [2025-09-29T22:05:03.922015] [DEBUG] [MAIN ] AQNB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:03.924746] [INFO ] [MAIN ] AQNB: Generated 1794 derivative records from 4142 primary records. [2025-09-29T22:05:03.925230] [DEBUG] [LOCAL ] AQNB: Saving derivative data. [2025-09-29T22:05:03.967802] [DEBUG] [LOCAL ] AQNB: Derivative data saved (1794 records). [2025-09-29T22:05:03.971381] [DEBUG] [MAIN ] ARCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:03.972377] [INFO ] [MAIN ] ARCO: Generated 1794 derivative records from 44534 primary records. [2025-09-29T22:05:03.972562] [DEBUG] [LOCAL ] ARCO: Saving derivative data. [2025-09-29T22:05:03.970788] [INFO ] [MAIN ] AQNB: Successfully saved derivative data. [2025-09-29T22:05:03.989532] [INFO ] [MAIN ] Derivative Progress: 106/2057 symbols completed. AQNB took 1.2s. Estimated remaining: 13m 24s. Rate: 145.7 symbols/min [2025-09-29T22:05:03.990280] [INFO ] [MAIN ] ARDC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:04.001760] [DEBUG] [MAIN ] AR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:04.007137] [INFO ] [MAIN ] AR: Generated 1794 derivative records from 53584 primary records. [2025-09-29T22:05:04.007752] [DEBUG] [LOCAL ] AR: Saving derivative data. [2025-09-29T22:05:04.040852] [DEBUG] [LOCAL ] ARDC: Loaded 14689 existing records from primary storage. [2025-09-29T22:05:04.038705] [DEBUG] [LOCAL ] ARCO: Derivative data saved (1794 records). [2025-09-29T22:05:04.041843] [INFO ] [MAIN ] ARCO: Successfully saved derivative data. [2025-09-29T22:05:04.041774] [INFO ] [MAIN ] ARDC: Loaded 14689 primary data records. [2025-09-29T22:05:04.042416] [DEBUG] [LOCAL ] AR: Derivative data saved (1794 records). [2025-09-29T22:05:04.047934] [INFO ] [MAIN ] AR: Successfully saved derivative data. [2025-09-29T22:05:04.050580] [INFO ] [MAIN ] Derivative Progress: 107/2057 symbols completed. ARCO took 1.2s. Estimated remaining: 13m 17s. Rate: 146.8 symbols/min [2025-09-29T22:05:04.070522] [INFO ] [MAIN ] ARE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:04.084600] [INFO ] [MAIN ] Derivative Progress: 108/2057 symbols completed. AR took 1.2s. Estimated remaining: 13m 10s. Rate: 148.1 symbols/min [2025-09-29T22:05:04.125511] [INFO ] [MAIN ] ARES: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:04.475063] [DEBUG] [LOCAL ] ARE: Loaded 50593 existing records from primary storage. [2025-09-29T22:05:04.476368] [INFO ] [MAIN ] ARE: Loaded 50593 primary data records. [2025-09-29T22:05:04.609267] [DEBUG] [LOCAL ] ARES: Loaded 49525 existing records from primary storage. [2025-09-29T22:05:04.614367] [INFO ] [MAIN ] ARES: Loaded 49525 primary data records. [2025-09-29T22:05:05.224886] [DEBUG] [MAIN ] ARDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:05.227035] [INFO ] [MAIN ] ARDC: Generated 1794 derivative records from 14689 primary records. [2025-09-29T22:05:05.228959] [DEBUG] [LOCAL ] ARDC: Saving derivative data. [2025-09-29T22:05:05.253828] [DEBUG] [LOCAL ] ARDC: Derivative data saved (1794 records). [2025-09-29T22:05:05.255153] [INFO ] [MAIN ] ARDC: Successfully saved derivative data. [2025-09-29T22:05:05.258149] [INFO ] [MAIN ] Derivative Progress: 109/2057 symbols completed. ARDC took 1.3s. Estimated remaining: 13m 23s. Rate: 145.6 symbols/min [2025-09-29T22:05:05.258926] [INFO ] [MAIN ] ARI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:05.275104] [DEBUG] [MAIN ] ARE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:05.276196] [INFO ] [MAIN ] ARE: Generated 1794 derivative records from 50593 primary records. [2025-09-29T22:05:05.276334] [DEBUG] [LOCAL ] ARE: Saving derivative data. [2025-09-29T22:05:05.289583] [DEBUG] [MAIN ] ARES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:05.290965] [INFO ] [MAIN ] ARES: Generated 1794 derivative records from 49525 primary records. [2025-09-29T22:05:05.299479] [DEBUG] [LOCAL ] ARES: Saving derivative data. [2025-09-29T22:05:05.320694] [DEBUG] [LOCAL ] ARE: Derivative data saved (1794 records). [2025-09-29T22:05:05.321909] [INFO ] [MAIN ] ARE: Successfully saved derivative data. [2025-09-29T22:05:05.323431] [DEBUG] [LOCAL ] ARES: Derivative data saved (1794 records). [2025-09-29T22:05:05.325861] [INFO ] [MAIN ] ARES: Successfully saved derivative data. [2025-09-29T22:05:05.325634] [INFO ] [MAIN ] Derivative Progress: 110/2057 symbols completed. ARE took 1.3s. Estimated remaining: 13m 17s. Rate: 146.7 symbols/min [2025-09-29T22:05:05.328848] [INFO ] [MAIN ] ARR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:05.329033] [INFO ] [MAIN ] Derivative Progress: 111/2057 symbols completed. ARES took 1.2s. Estimated remaining: 13m 9s. Rate: 148.0 symbols/min [2025-09-29T22:05:05.329831] [INFO ] [MAIN ] ARW: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:05.365575] [DEBUG] [LOCAL ] ARI: Loaded 43363 existing records from primary storage. [2025-09-29T22:05:05.366020] [INFO ] [MAIN ] ARI: Loaded 43363 primary data records. [2025-09-29T22:05:05.519796] [DEBUG] [LOCAL ] ARW: Loaded 33065 existing records from primary storage. [2025-09-29T22:05:05.531085] [INFO ] [MAIN ] ARW: Loaded 33065 primary data records. [2025-09-29T22:05:05.820127] [DEBUG] [LOCAL ] ARR: Loaded 52025 existing records from primary storage. [2025-09-29T22:05:05.827052] [INFO ] [MAIN ] ARR: Loaded 52025 primary data records. [2025-09-29T22:05:06.438842] [DEBUG] [MAIN ] ARI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:06.441156] [INFO ] [MAIN ] ARI: Generated 1794 derivative records from 43363 primary records. [2025-09-29T22:05:06.442494] [DEBUG] [LOCAL ] ARI: Saving derivative data. [2025-09-29T22:05:06.474323] [DEBUG] [MAIN ] ARW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:06.475966] [INFO ] [MAIN ] ARW: Generated 1794 derivative records from 33065 primary records. [2025-09-29T22:05:06.476260] [DEBUG] [LOCAL ] ARW: Saving derivative data. [2025-09-29T22:05:06.487307] [DEBUG] [LOCAL ] ARI: Derivative data saved (1794 records). [2025-09-29T22:05:06.487544] [INFO ] [MAIN ] ARI: Successfully saved derivative data. [2025-09-29T22:05:06.490907] [INFO ] [MAIN ] Derivative Progress: 112/2057 symbols completed. ARI took 1.2s. Estimated remaining: 13m 22s. Rate: 145.6 symbols/min [2025-09-29T22:05:06.496288] [INFO ] [MAIN ] ASA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:06.513243] [DEBUG] [MAIN ] ARR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:06.515323] [INFO ] [MAIN ] ARR: Generated 1794 derivative records from 52025 primary records. [2025-09-29T22:05:06.516235] [DEBUG] [LOCAL ] ARR: Saving derivative data. [2025-09-29T22:05:06.521508] [DEBUG] [LOCAL ] ARW: Derivative data saved (1794 records). [2025-09-29T22:05:06.522292] [INFO ] [MAIN ] ARW: Successfully saved derivative data. [2025-09-29T22:05:06.536000] [INFO ] [MAIN ] Derivative Progress: 113/2057 symbols completed. ARW took 1.2s. Estimated remaining: 13m 15s. Rate: 146.7 symbols/min [2025-09-29T22:05:06.541742] [INFO ] [MAIN ] ASB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:06.544371] [DEBUG] [LOCAL ] ASA: Loaded 14041 existing records from primary storage. [2025-09-29T22:05:06.544786] [INFO ] [MAIN ] ASA: Loaded 14041 primary data records. [2025-09-29T22:05:06.604820] [DEBUG] [LOCAL ] ARR: Derivative data saved (1794 records). [2025-09-29T22:05:06.638817] [INFO ] [MAIN ] ARR: Successfully saved derivative data. [2025-09-29T22:05:06.658570] [INFO ] [MAIN ] Derivative Progress: 114/2057 symbols completed. ARR took 1.3s. Estimated remaining: 13m 10s. Rate: 147.6 symbols/min [2025-09-29T22:05:06.658978] [INFO ] [MAIN ] ASBA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:06.746261] [DEBUG] [LOCAL ] ASBA: Loaded 3427 existing records from primary storage. [2025-09-29T22:05:06.886347] [INFO ] [MAIN ] ASBA: Loaded 3427 primary data records. [2025-09-29T22:05:07.044712] [DEBUG] [LOCAL ] ASB: Loaded 49512 existing records from primary storage. [2025-09-29T22:05:07.055743] [INFO ] [MAIN ] ASB: Loaded 49512 primary data records. [2025-09-29T22:05:07.614385] [DEBUG] [MAIN ] ASA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:07.615374] [INFO ] [MAIN ] ASA: Generated 1794 derivative records from 14041 primary records. [2025-09-29T22:05:07.615743] [DEBUG] [LOCAL ] ASA: Saving derivative data. [2025-09-29T22:05:07.639966] [DEBUG] [LOCAL ] ASA: Derivative data saved (1794 records). [2025-09-29T22:05:07.640346] [INFO ] [MAIN ] ASA: Successfully saved derivative data. [2025-09-29T22:05:07.643883] [INFO ] [MAIN ] Derivative Progress: 115/2057 symbols completed. ASA took 1.1s. Estimated remaining: 13m 19s. Rate: 145.8 symbols/min [2025-09-29T22:05:07.644112] [INFO ] [MAIN ] ASGI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:07.661308] [DEBUG] [MAIN ] ASBA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:07.662333] [INFO ] [MAIN ] ASBA: Generated 1794 derivative records from 3427 primary records. [2025-09-29T22:05:07.662679] [DEBUG] [LOCAL ] ASBA: Saving derivative data. [2025-09-29T22:05:07.680275] [DEBUG] [LOCAL ] ASBA: Derivative data saved (1794 records). [2025-09-29T22:05:07.680483] [INFO ] [MAIN ] ASBA: Successfully saved derivative data. [2025-09-29T22:05:07.683149] [INFO ] [MAIN ] Derivative Progress: 116/2057 symbols completed. ASBA took 1.0s. Estimated remaining: 13m 12s. Rate: 147.0 symbols/min [2025-09-29T22:05:07.683487] [INFO ] [MAIN ] ASGN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:07.720013] [DEBUG] [MAIN ] ASB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:07.721134] [INFO ] [MAIN ] ASB: Generated 1794 derivative records from 49512 primary records. [2025-09-29T22:05:07.721824] [DEBUG] [LOCAL ] ASGI: Loaded 22549 existing records from primary storage. [2025-09-29T22:05:07.722043] [DEBUG] [LOCAL ] ASB: Saving derivative data. [2025-09-29T22:05:07.723164] [INFO ] [MAIN ] ASGI: Loaded 22549 primary data records. [2025-09-29T22:05:07.841982] [DEBUG] [LOCAL ] ASB: Derivative data saved (1794 records). [2025-09-29T22:05:07.863186] [INFO ] [MAIN ] ASB: Successfully saved derivative data. [2025-09-29T22:05:07.903738] [INFO ] [MAIN ] Derivative Progress: 117/2057 symbols completed. ASB took 1.4s. Estimated remaining: 13m 9s. Rate: 147.5 symbols/min [2025-09-29T22:05:07.940970] [INFO ] [MAIN ] ASH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:07.951921] [DEBUG] [LOCAL ] ASGN: Loaded 35955 existing records from primary storage. [2025-09-29T22:05:07.952337] [INFO ] [MAIN ] ASGN: Loaded 35955 primary data records. [2025-09-29T22:05:08.518386] [DEBUG] [LOCAL ] ASH: Loaded 37715 existing records from primary storage. [2025-09-29T22:05:08.518640] [INFO ] [MAIN ] ASH: Loaded 37715 primary data records. [2025-09-29T22:05:08.741033] [DEBUG] [MAIN ] ASGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:08.753875] [INFO ] [MAIN ] ASGI: Generated 1794 derivative records from 22549 primary records. [2025-09-29T22:05:08.795520] [DEBUG] [LOCAL ] ASGI: Saving derivative data. [2025-09-29T22:05:08.902099] [DEBUG] [LOCAL ] ASGI: Derivative data saved (1794 records). [2025-09-29T22:05:08.955297] [INFO ] [MAIN ] ASGI: Successfully saved derivative data. [2025-09-29T22:05:08.967227] [INFO ] [MAIN ] Derivative Progress: 118/2057 symbols completed. ASGI took 1.3s. Estimated remaining: 13m 19s. Rate: 145.6 symbols/min [2025-09-29T22:05:09.127847] [DEBUG] [MAIN ] ASGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:09.129270] [INFO ] [MAIN ] ASGN: Generated 1794 derivative records from 35955 primary records. [2025-09-29T22:05:09.129400] [DEBUG] [LOCAL ] ASGN: Saving derivative data. [2025-09-29T22:05:09.151900] [DEBUG] [LOCAL ] ASGN: Derivative data saved (1794 records). [2025-09-29T22:05:09.152283] [INFO ] [MAIN ] ASGN: Successfully saved derivative data. [2025-09-29T22:05:09.154698] [INFO ] [MAIN ] Derivative Progress: 119/2057 symbols completed. ASGN took 1.5s. Estimated remaining: 13m 15s. Rate: 146.2 symbols/min [2025-09-29T22:05:09.171569] [DEBUG] [MAIN ] ASH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:09.172291] [INFO ] [MAIN ] ASH: Generated 1794 derivative records from 37715 primary records. [2025-09-29T22:05:09.172355] [DEBUG] [LOCAL ] ASH: Saving derivative data. [2025-09-29T22:05:09.188954] [DEBUG] [LOCAL ] ASH: Derivative data saved (1794 records). [2025-09-29T22:05:09.189105] [INFO ] [MAIN ] ASH: Successfully saved derivative data. [2025-09-29T22:05:09.191530] [INFO ] [MAIN ] Derivative Progress: 120/2057 symbols completed. ASH took 1.3s. Estimated remaining: 13m 9s. Rate: 147.3 symbols/min [2025-09-29T22:05:09.192201] [INFO ] [MAIN ] ASX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:09.192312] [INFO ] [MAIN ] ASPN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:09.192132] [INFO ] [MAIN ] ATEN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:09.264769] [DEBUG] [LOCAL ] ATEN: Loaded 39679 existing records from primary storage. [2025-09-29T22:05:09.265070] [INFO ] [MAIN ] ATEN: Loaded 39679 primary data records. [2025-09-29T22:05:09.411912] [DEBUG] [LOCAL ] ASX: Loaded 52837 existing records from primary storage. [2025-09-29T22:05:09.416939] [DEBUG] [LOCAL ] ASPN: Loaded 49585 existing records from primary storage. [2025-09-29T22:05:09.417404] [INFO ] [MAIN ] ASX: Loaded 52837 primary data records. [2025-09-29T22:05:09.417619] [INFO ] [MAIN ] ASPN: Loaded 49585 primary data records. [2025-09-29T22:05:10.354486] [DEBUG] [MAIN ] ATEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:10.355352] [INFO ] [MAIN ] ATEN: Generated 1794 derivative records from 39679 primary records. [2025-09-29T22:05:10.355562] [DEBUG] [LOCAL ] ATEN: Saving derivative data. [2025-09-29T22:05:10.390327] [DEBUG] [MAIN ] ASX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:10.391754] [INFO ] [MAIN ] ASX: Generated 1794 derivative records from 52837 primary records. [2025-09-29T22:05:10.405727] [DEBUG] [LOCAL ] ATEN: Derivative data saved (1794 records). [2025-09-29T22:05:10.399623] [DEBUG] [LOCAL ] ASX: Saving derivative data. [2025-09-29T22:05:10.405946] [INFO ] [MAIN ] ATEN: Successfully saved derivative data. [2025-09-29T22:05:10.406737] [DEBUG] [MAIN ] ASPN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:10.408900] [INFO ] [MAIN ] Derivative Progress: 121/2057 symbols completed. ATEN took 1.2s. Estimated remaining: 13m 21s. Rate: 145.0 symbols/min [2025-09-29T22:05:10.409807] [INFO ] [MAIN ] ASPN: Generated 1794 derivative records from 49585 primary records. [2025-09-29T22:05:10.410145] [INFO ] [MAIN ] ATGE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:10.421448] [DEBUG] [LOCAL ] ASPN: Saving derivative data. [2025-09-29T22:05:10.438534] [DEBUG] [LOCAL ] ASX: Derivative data saved (1794 records). [2025-09-29T22:05:10.439961] [INFO ] [MAIN ] ASX: Successfully saved derivative data. [2025-09-29T22:05:10.442797] [INFO ] [MAIN ] Derivative Progress: 122/2057 symbols completed. ASX took 1.3s. Estimated remaining: 13m 15s. Rate: 146.1 symbols/min [2025-09-29T22:05:10.443733] [INFO ] [MAIN ] ATHM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:10.445673] [DEBUG] [LOCAL ] ASPN: Derivative data saved (1794 records). [2025-09-29T22:05:10.445999] [INFO ] [MAIN ] ASPN: Successfully saved derivative data. [2025-09-29T22:05:10.448239] [INFO ] [MAIN ] Derivative Progress: 123/2057 symbols completed. ASPN took 1.3s. Estimated remaining: 13m 8s. Rate: 147.2 symbols/min [2025-09-29T22:05:10.449030] [INFO ] [MAIN ] ATHS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:10.467722] [DEBUG] [LOCAL ] ATHS: Loaded 6984 existing records from primary storage. [2025-09-29T22:05:10.468822] [INFO ] [MAIN ] ATHS: Loaded 6984 primary data records. [2025-09-29T22:05:10.570809] [DEBUG] [LOCAL ] ATGE: Loaded 31631 existing records from primary storage. [2025-09-29T22:05:10.601995] [INFO ] [MAIN ] ATGE: Loaded 31631 primary data records. [2025-09-29T22:05:10.698861] [DEBUG] [LOCAL ] ATHM: Loaded 32365 existing records from primary storage. [2025-09-29T22:05:10.727742] [INFO ] [MAIN ] ATHM: Loaded 32365 primary data records. [2025-09-29T22:05:11.535275] [DEBUG] [MAIN ] ATHS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:11.536706] [INFO ] [MAIN ] ATHS: Generated 1794 derivative records from 6984 primary records. [2025-09-29T22:05:11.537080] [DEBUG] [LOCAL ] ATHS: Saving derivative data. [2025-09-29T22:05:11.558550] [DEBUG] [LOCAL ] ATHS: Derivative data saved (1794 records). [2025-09-29T22:05:11.572881] [INFO ] [MAIN ] ATHS: Successfully saved derivative data. [2025-09-29T22:05:11.574968] [INFO ] [MAIN ] Derivative Progress: 124/2057 symbols completed. ATHS took 1.1s. Estimated remaining: 13m 19s. Rate: 145.2 symbols/min [2025-09-29T22:05:11.572733] [DEBUG] [MAIN ] ATGE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:11.576420] [INFO ] [MAIN ] ATI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:11.576138] [INFO ] [MAIN ] ATGE: Generated 1794 derivative records from 31631 primary records. [2025-09-29T22:05:11.580400] [DEBUG] [LOCAL ] ATGE: Saving derivative data. [2025-09-29T22:05:11.613493] [DEBUG] [LOCAL ] ATGE: Derivative data saved (1794 records). [2025-09-29T22:05:11.611894] [DEBUG] [MAIN ] ATHM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:11.613725] [INFO ] [MAIN ] ATGE: Successfully saved derivative data. [2025-09-29T22:05:11.617142] [INFO ] [MAIN ] ATHM: Generated 1794 derivative records from 32365 primary records. [2025-09-29T22:05:11.615873] [INFO ] [MAIN ] Derivative Progress: 125/2057 symbols completed. ATGE took 1.2s. Estimated remaining: 13m 13s. Rate: 146.2 symbols/min [2025-09-29T22:05:11.617409] [DEBUG] [LOCAL ] ATHM: Saving derivative data. [2025-09-29T22:05:11.618539] [INFO ] [MAIN ] ATKR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:11.636146] [DEBUG] [LOCAL ] ATHM: Derivative data saved (1794 records). [2025-09-29T22:05:11.636254] [INFO ] [MAIN ] ATHM: Successfully saved derivative data. [2025-09-29T22:05:11.638750] [INFO ] [MAIN ] Derivative Progress: 126/2057 symbols completed. ATHM took 1.2s. Estimated remaining: 13m 6s. Rate: 147.3 symbols/min [2025-09-29T22:05:11.638938] [INFO ] [MAIN ] ATMU: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:11.693559] [DEBUG] [LOCAL ] ATI: Loaded 51503 existing records from primary storage. [2025-09-29T22:05:11.693820] [INFO ] [MAIN ] ATI: Loaded 51503 primary data records. [2025-09-29T22:05:11.810347] [DEBUG] [LOCAL ] ATKR: Loaded 35560 existing records from primary storage. [2025-09-29T22:05:11.823053] [INFO ] [MAIN ] ATKR: Loaded 35560 primary data records. [2025-09-29T22:05:12.061048] [DEBUG] [LOCAL ] ATMU: Loaded 39533 existing records from primary storage. [2025-09-29T22:05:12.146791] [INFO ] [MAIN ] ATMU: Loaded 39533 primary data records. [2025-09-29T22:05:12.729184] [DEBUG] [MAIN ] ATI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:12.730417] [INFO ] [MAIN ] ATI: Generated 1794 derivative records from 51503 primary records. [2025-09-29T22:05:12.730914] [DEBUG] [LOCAL ] ATI: Saving derivative data. [2025-09-29T22:05:12.767942] [DEBUG] [MAIN ] ATKR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:12.767344] [DEBUG] [LOCAL ] ATI: Derivative data saved (1794 records). [2025-09-29T22:05:12.768081] [INFO ] [MAIN ] ATI: Successfully saved derivative data. [2025-09-29T22:05:12.770502] [INFO ] [MAIN ] Derivative Progress: 127/2057 symbols completed. ATI took 1.2s. Estimated remaining: 13m 17s. Rate: 145.3 symbols/min [2025-09-29T22:05:12.771531] [INFO ] [MAIN ] ATKR: Generated 1794 derivative records from 35560 primary records. [2025-09-29T22:05:12.770730] [INFO ] [MAIN ] ATO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:12.771770] [DEBUG] [LOCAL ] ATKR: Saving derivative data. [2025-09-29T22:05:12.789438] [DEBUG] [LOCAL ] ATKR: Derivative data saved (1794 records). [2025-09-29T22:05:12.789812] [INFO ] [MAIN ] ATKR: Successfully saved derivative data. [2025-09-29T22:05:12.792062] [INFO ] [MAIN ] Derivative Progress: 128/2057 symbols completed. ATKR took 1.2s. Estimated remaining: 13m 11s. Rate: 146.4 symbols/min [2025-09-29T22:05:12.794146] [INFO ] [MAIN ] ATR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:12.808759] [DEBUG] [MAIN ] ATMU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:12.809577] [INFO ] [MAIN ] ATMU: Generated 1794 derivative records from 39533 primary records. [2025-09-29T22:05:12.809800] [DEBUG] [LOCAL ] ATMU: Saving derivative data. [2025-09-29T22:05:12.829125] [DEBUG] [LOCAL ] ATMU: Derivative data saved (1794 records). [2025-09-29T22:05:12.829392] [INFO ] [MAIN ] ATMU: Successfully saved derivative data. [2025-09-29T22:05:12.831807] [INFO ] [MAIN ] Derivative Progress: 129/2057 symbols completed. ATMU took 1.2s. Estimated remaining: 13m 5s. Rate: 147.4 symbols/min [2025-09-29T22:05:12.832296] [INFO ] [MAIN ] ATS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:12.882098] [DEBUG] [LOCAL ] ATR: Loaded 30406 existing records from primary storage. [2025-09-29T22:05:12.883343] [DEBUG] [LOCAL ] ATO: Loaded 41864 existing records from primary storage. [2025-09-29T22:05:12.883561] [INFO ] [MAIN ] ATO: Loaded 41864 primary data records. [2025-09-29T22:05:12.883672] [INFO ] [MAIN ] ATR: Loaded 30406 primary data records. [2025-09-29T22:05:12.964931] [DEBUG] [LOCAL ] ATS: Loaded 17851 existing records from primary storage. [2025-09-29T22:05:12.993072] [INFO ] [MAIN ] ATS: Loaded 17851 primary data records. [2025-09-29T22:05:13.979535] [DEBUG] [MAIN ] ATO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:13.981446] [INFO ] [MAIN ] ATO: Generated 1794 derivative records from 41864 primary records. [2025-09-29T22:05:13.981815] [DEBUG] [LOCAL ] ATO: Saving derivative data. [2025-09-29T22:05:14.008274] [DEBUG] [MAIN ] ATR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:14.013878] [DEBUG] [LOCAL ] ATO: Derivative data saved (1794 records). [2025-09-29T22:05:14.016549] [INFO ] [MAIN ] ATO: Successfully saved derivative data. [2025-09-29T22:05:14.015749] [INFO ] [MAIN ] ATR: Generated 1794 derivative records from 30406 primary records. [2025-09-29T22:05:14.018750] [INFO ] [MAIN ] Derivative Progress: 130/2057 symbols completed. ATO took 1.2s. Estimated remaining: 13m 16s. Rate: 145.3 symbols/min [2025-09-29T22:05:14.019249] [DEBUG] [LOCAL ] ATR: Saving derivative data. [2025-09-29T22:05:14.019096] [INFO ] [MAIN ] ATUS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:14.042496] [DEBUG] [MAIN ] ATS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:14.046320] [INFO ] [MAIN ] ATS: Generated 1794 derivative records from 17851 primary records. [2025-09-29T22:05:14.047039] [DEBUG] [LOCAL ] ATS: Saving derivative data. [2025-09-29T22:05:14.064742] [DEBUG] [LOCAL ] ATR: Derivative data saved (1794 records). [2025-09-29T22:05:14.065416] [INFO ] [MAIN ] ATR: Successfully saved derivative data. [2025-09-29T22:05:14.068223] [INFO ] [MAIN ] Derivative Progress: 131/2057 symbols completed. ATR took 1.3s. Estimated remaining: 13m 10s. Rate: 146.3 symbols/min [2025-09-29T22:05:14.068732] [INFO ] [MAIN ] AU: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:14.073047] [DEBUG] [LOCAL ] ATS: Derivative data saved (1794 records). [2025-09-29T22:05:14.073288] [INFO ] [MAIN ] ATS: Successfully saved derivative data. [2025-09-29T22:05:14.075440] [INFO ] [MAIN ] Derivative Progress: 132/2057 symbols completed. ATS took 1.2s. Estimated remaining: 13m 4s. Rate: 147.3 symbols/min [2025-09-29T22:05:14.075737] [INFO ] [MAIN ] AUB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:14.108604] [DEBUG] [LOCAL ] ATUS: Loaded 49225 existing records from primary storage. [2025-09-29T22:05:14.108962] [INFO ] [MAIN ] ATUS: Loaded 49225 primary data records. [2025-09-29T22:05:14.364833] [DEBUG] [LOCAL ] AU: Loaded 52987 existing records from primary storage. [2025-09-29T22:05:14.477897] [DEBUG] [LOCAL ] AUB: Loaded 46313 existing records from primary storage. [2025-09-29T22:05:14.483335] [INFO ] [MAIN ] AUB: Loaded 46313 primary data records. [2025-09-29T22:05:14.492897] [INFO ] [MAIN ] AU: Loaded 52987 primary data records. [2025-09-29T22:05:15.196636] [DEBUG] [MAIN ] ATUS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:15.197632] [INFO ] [MAIN ] ATUS: Generated 1794 derivative records from 49225 primary records. [2025-09-29T22:05:15.197763] [DEBUG] [LOCAL ] ATUS: Saving derivative data. [2025-09-29T22:05:15.218615] [DEBUG] [LOCAL ] ATUS: Derivative data saved (1794 records). [2025-09-29T22:05:15.218879] [INFO ] [MAIN ] ATUS: Successfully saved derivative data. [2025-09-29T22:05:15.221480] [INFO ] [MAIN ] Derivative Progress: 133/2057 symbols completed. ATUS took 1.2s. Estimated remaining: 13m 14s. Rate: 145.4 symbols/min [2025-09-29T22:05:15.239867] [DEBUG] [MAIN ] AU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:15.240612] [INFO ] [MAIN ] AU: Generated 1794 derivative records from 52987 primary records. [2025-09-29T22:05:15.240799] [DEBUG] [LOCAL ] AU: Saving derivative data. [2025-09-29T22:05:15.254636] [DEBUG] [MAIN ] AUB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:15.263619] [INFO ] [MAIN ] AUB: Generated 1794 derivative records from 46313 primary records. [2025-09-29T22:05:15.266790] [DEBUG] [LOCAL ] AUB: Saving derivative data. [2025-09-29T22:05:15.284337] [DEBUG] [LOCAL ] AU: Derivative data saved (1794 records). [2025-09-29T22:05:15.287169] [DEBUG] [LOCAL ] AUB: Derivative data saved (1794 records). [2025-09-29T22:05:15.284949] [INFO ] [MAIN ] AU: Successfully saved derivative data. [2025-09-29T22:05:15.289574] [INFO ] [MAIN ] Derivative Progress: 134/2057 symbols completed. AU took 1.2s. Estimated remaining: 13m 9s. Rate: 146.3 symbols/min [2025-09-29T22:05:15.289694] [INFO ] [MAIN ] AUB: Successfully saved derivative data. [2025-09-29T22:05:15.292305] [INFO ] [MAIN ] Derivative Progress: 135/2057 symbols completed. AUB took 1.2s. Estimated remaining: 13m 3s. Rate: 147.4 symbols/min [2025-09-29T22:05:15.292799] [INFO ] [MAIN ] AVA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:15.292752] [INFO ] [MAIN ] AUNA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:15.292917] [INFO ] [MAIN ] AVAL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:15.303718] [DEBUG] [LOCAL ] AUNA: Loaded 4872 existing records from primary storage. [2025-09-29T22:05:15.303925] [INFO ] [MAIN ] AUNA: Loaded 4872 primary data records. [2025-09-29T22:05:15.366802] [DEBUG] [LOCAL ] AVAL: Loaded 8780 existing records from primary storage. [2025-09-29T22:05:15.394048] [INFO ] [MAIN ] AVAL: Loaded 8780 primary data records. [2025-09-29T22:05:15.645194] [DEBUG] [LOCAL ] AVA: Loaded 39461 existing records from primary storage. [2025-09-29T22:05:15.768850] [INFO ] [MAIN ] AVA: Loaded 39461 primary data records. [2025-09-29T22:05:16.353530] [DEBUG] [MAIN ] AUNA: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:05:16.355932] [INFO ] [MAIN ] AUNA: Generated 1793 derivative records from 4872 primary records. [2025-09-29T22:05:16.356763] [DEBUG] [LOCAL ] AUNA: Saving derivative data. [2025-09-29T22:05:16.386198] [DEBUG] [MAIN ] AVAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:16.388327] [INFO ] [MAIN ] AVAL: Generated 1794 derivative records from 8780 primary records. [2025-09-29T22:05:16.389175] [DEBUG] [LOCAL ] AVAL: Saving derivative data. [2025-09-29T22:05:16.390973] [DEBUG] [LOCAL ] AUNA: Derivative data saved (1793 records). [2025-09-29T22:05:16.391561] [INFO ] [MAIN ] AUNA: Successfully saved derivative data. [2025-09-29T22:05:16.393635] [INFO ] [MAIN ] Derivative Progress: 136/2057 symbols completed. AUNA took 1.1s. Estimated remaining: 13m 12s. Rate: 145.5 symbols/min [2025-09-29T22:05:16.401066] [INFO ] [MAIN ] AVB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:16.412224] [DEBUG] [LOCAL ] AVAL: Derivative data saved (1794 records). [2025-09-29T22:05:16.412453] [INFO ] [MAIN ] AVAL: Successfully saved derivative data. [2025-09-29T22:05:16.415188] [INFO ] [MAIN ] Derivative Progress: 137/2057 symbols completed. AVAL took 1.1s. Estimated remaining: 13m 6s. Rate: 146.6 symbols/min [2025-09-29T22:05:16.415456] [INFO ] [MAIN ] AVD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:16.429527] [DEBUG] [MAIN ] AVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:16.430248] [INFO ] [MAIN ] AVA: Generated 1794 derivative records from 39461 primary records. [2025-09-29T22:05:16.430391] [DEBUG] [LOCAL ] AVA: Saving derivative data. [2025-09-29T22:05:16.447737] [DEBUG] [LOCAL ] AVA: Derivative data saved (1794 records). [2025-09-29T22:05:16.448003] [INFO ] [MAIN ] AVA: Successfully saved derivative data. [2025-09-29T22:05:16.455951] [INFO ] [MAIN ] Derivative Progress: 138/2057 symbols completed. AVA took 1.2s. Estimated remaining: 13m 1s. Rate: 147.5 symbols/min [2025-09-29T22:05:16.456270] [INFO ] [MAIN ] AVK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:16.476347] [DEBUG] [LOCAL ] AVD: Loaded 22711 existing records from primary storage. [2025-09-29T22:05:16.476509] [INFO ] [MAIN ] AVD: Loaded 22711 primary data records. [2025-09-29T22:05:16.607925] [DEBUG] [LOCAL ] AVB: Loaded 41892 existing records from primary storage. [2025-09-29T22:05:16.613729] [INFO ] [MAIN ] AVB: Loaded 41892 primary data records. [2025-09-29T22:05:16.678274] [DEBUG] [LOCAL ] AVK: Loaded 17863 existing records from primary storage. [2025-09-29T22:05:16.725225] [INFO ] [MAIN ] AVK: Loaded 17863 primary data records. [2025-09-29T22:05:17.550682] [DEBUG] [MAIN ] AVD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:17.551900] [INFO ] [MAIN ] AVD: Generated 1794 derivative records from 22711 primary records. [2025-09-29T22:05:17.552998] [DEBUG] [LOCAL ] AVD: Saving derivative data. [2025-09-29T22:05:17.576178] [DEBUG] [LOCAL ] AVD: Derivative data saved (1794 records). [2025-09-29T22:05:17.576500] [INFO ] [MAIN ] AVD: Successfully saved derivative data. [2025-09-29T22:05:17.578805] [INFO ] [MAIN ] Derivative Progress: 139/2057 symbols completed. AVD took 1.2s. Estimated remaining: 13m 10s. Rate: 145.7 symbols/min [2025-09-29T22:05:17.593289] [INFO ] [MAIN ] AVNS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:17.595318] [DEBUG] [MAIN ] AVK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:17.596230] [INFO ] [MAIN ] AVK: Generated 1794 derivative records from 17863 primary records. [2025-09-29T22:05:17.596434] [DEBUG] [LOCAL ] AVK: Saving derivative data. [2025-09-29T22:05:17.618290] [DEBUG] [MAIN ] AVB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:17.624193] [INFO ] [MAIN ] AVB: Generated 1794 derivative records from 41892 primary records. [2025-09-29T22:05:17.624563] [DEBUG] [LOCAL ] AVB: Saving derivative data. [2025-09-29T22:05:17.629853] [DEBUG] [LOCAL ] AVK: Derivative data saved (1794 records). [2025-09-29T22:05:17.631242] [INFO ] [MAIN ] AVK: Successfully saved derivative data. [2025-09-29T22:05:17.633843] [INFO ] [MAIN ] Derivative Progress: 140/2057 symbols completed. AVK took 1.2s. Estimated remaining: 13m 5s. Rate: 146.6 symbols/min [2025-09-29T22:05:17.641685] [INFO ] [MAIN ] AVY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:17.662226] [DEBUG] [LOCAL ] AVB: Derivative data saved (1794 records). [2025-09-29T22:05:17.673466] [INFO ] [MAIN ] AVB: Successfully saved derivative data. [2025-09-29T22:05:17.676143] [INFO ] [MAIN ] Derivative Progress: 141/2057 symbols completed. AVB took 1.3s. Estimated remaining: 12m 59s. Rate: 147.5 symbols/min [2025-09-29T22:05:17.677420] [INFO ] [MAIN ] AWF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:17.677112] [DEBUG] [LOCAL ] AVNS: Loaded 33542 existing records from primary storage. [2025-09-29T22:05:17.678177] [INFO ] [MAIN ] AVNS: Loaded 33542 primary data records. [2025-09-29T22:05:17.902143] [DEBUG] [LOCAL ] AVY: Loaded 37420 existing records from primary storage. [2025-09-29T22:05:17.929038] [DEBUG] [LOCAL ] AWF: Loaded 24244 existing records from primary storage. [2025-09-29T22:05:17.929242] [INFO ] [MAIN ] AWF: Loaded 24244 primary data records. [2025-09-29T22:05:17.929390] [INFO ] [MAIN ] AVY: Loaded 37420 primary data records. [2025-09-29T22:05:18.880956] [DEBUG] [MAIN ] AVNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:18.883133] [INFO ] [MAIN ] AVNS: Generated 1794 derivative records from 33542 primary records. [2025-09-29T22:05:18.883273] [DEBUG] [LOCAL ] AVNS: Saving derivative data. [2025-09-29T22:05:18.907970] [DEBUG] [LOCAL ] AVNS: Derivative data saved (1794 records). [2025-09-29T22:05:18.910685] [INFO ] [MAIN ] AVNS: Successfully saved derivative data. [2025-09-29T22:05:18.913614] [INFO ] [MAIN ] Derivative Progress: 142/2057 symbols completed. AVNS took 1.3s. Estimated remaining: 13m 10s. Rate: 145.4 symbols/min [2025-09-29T22:05:18.914307] [INFO ] [MAIN ] AWK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:18.932633] [DEBUG] [MAIN ] AWF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:18.933861] [INFO ] [MAIN ] AWF: Generated 1794 derivative records from 24244 primary records. [2025-09-29T22:05:18.934015] [DEBUG] [LOCAL ] AWF: Saving derivative data. [2025-09-29T22:05:18.968190] [DEBUG] [MAIN ] AVY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:18.970282] [INFO ] [MAIN ] AVY: Generated 1794 derivative records from 37420 primary records. [2025-09-29T22:05:18.970944] [DEBUG] [LOCAL ] AVY: Saving derivative data. [2025-09-29T22:05:18.991276] [DEBUG] [LOCAL ] AWF: Derivative data saved (1794 records). [2025-09-29T22:05:18.991555] [INFO ] [MAIN ] AWF: Successfully saved derivative data. [2025-09-29T22:05:18.994807] [INFO ] [MAIN ] Derivative Progress: 143/2057 symbols completed. AWF took 1.3s. Estimated remaining: 13m 5s. Rate: 146.2 symbols/min [2025-09-29T22:05:18.995121] [INFO ] [MAIN ] AWP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:18.992292] [DEBUG] [LOCAL ] AVY: Derivative data saved (1794 records). [2025-09-29T22:05:18.996043] [INFO ] [MAIN ] AVY: Successfully saved derivative data. [2025-09-29T22:05:18.998821] [INFO ] [MAIN ] Derivative Progress: 144/2057 symbols completed. AVY took 1.4s. Estimated remaining: 12m 59s. Rate: 147.3 symbols/min [2025-09-29T22:05:18.999617] [INFO ] [MAIN ] AWR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:19.051794] [DEBUG] [LOCAL ] AWP: Loaded 21606 existing records from primary storage. [2025-09-29T22:05:19.053321] [DEBUG] [LOCAL ] AWK: Loaded 48718 existing records from primary storage. [2025-09-29T22:05:19.053754] [INFO ] [MAIN ] AWK: Loaded 48718 primary data records. [2025-09-29T22:05:19.053522] [INFO ] [MAIN ] AWP: Loaded 21606 primary data records. [2025-09-29T22:05:19.100711] [DEBUG] [LOCAL ] AWR: Loaded 22508 existing records from primary storage. [2025-09-29T22:05:19.146786] [INFO ] [MAIN ] AWR: Loaded 22508 primary data records. [2025-09-29T22:05:20.149172] [DEBUG] [MAIN ] AWK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:20.158426] [INFO ] [MAIN ] AWK: Generated 1794 derivative records from 48718 primary records. [2025-09-29T22:05:20.162973] [DEBUG] [LOCAL ] AWK: Saving derivative data. [2025-09-29T22:05:20.166145] [DEBUG] [MAIN ] AWP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:20.174388] [INFO ] [MAIN ] AWP: Generated 1794 derivative records from 21606 primary records. [2025-09-29T22:05:20.181798] [DEBUG] [LOCAL ] AWP: Saving derivative data. [2025-09-29T22:05:20.198961] [DEBUG] [MAIN ] AWR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:20.199511] [DEBUG] [LOCAL ] AWK: Derivative data saved (1794 records). [2025-09-29T22:05:20.200427] [INFO ] [MAIN ] AWR: Generated 1794 derivative records from 22508 primary records. [2025-09-29T22:05:20.199671] [INFO ] [MAIN ] AWK: Successfully saved derivative data. [2025-09-29T22:05:20.200865] [DEBUG] [LOCAL ] AWR: Saving derivative data. [2025-09-29T22:05:20.203023] [INFO ] [MAIN ] Derivative Progress: 145/2057 symbols completed. AWK took 1.3s. Estimated remaining: 13m 10s. Rate: 145.3 symbols/min [2025-09-29T22:05:20.224570] [INFO ] [MAIN ] AX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:20.238717] [DEBUG] [LOCAL ] AWP: Derivative data saved (1794 records). [2025-09-29T22:05:20.239549] [DEBUG] [LOCAL ] AWR: Derivative data saved (1794 records). [2025-09-29T22:05:20.239488] [INFO ] [MAIN ] AWP: Successfully saved derivative data. [2025-09-29T22:05:20.242099] [INFO ] [MAIN ] AWR: Successfully saved derivative data. [2025-09-29T22:05:20.242023] [INFO ] [MAIN ] Derivative Progress: 146/2057 symbols completed. AWP took 1.2s. Estimated remaining: 13m 4s. Rate: 146.2 symbols/min [2025-09-29T22:05:20.242379] [INFO ] [MAIN ] AXL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:20.244770] [INFO ] [MAIN ] Derivative Progress: 147/2057 symbols completed. AWR took 1.2s. Estimated remaining: 12m 59s. Rate: 147.2 symbols/min [2025-09-29T22:05:20.245282] [INFO ] [MAIN ] AXP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:20.270895] [DEBUG] [LOCAL ] AX: Loaded 28381 existing records from primary storage. [2025-09-29T22:05:20.271184] [INFO ] [MAIN ] AX: Loaded 28381 primary data records. [2025-09-29T22:05:20.682783] [DEBUG] [LOCAL ] AXP: Loaded 53201 existing records from primary storage. [2025-09-29T22:05:20.683013] [INFO ] [MAIN ] AXP: Loaded 53201 primary data records. [2025-09-29T22:05:20.683949] [DEBUG] [LOCAL ] AXL: Loaded 50519 existing records from primary storage. [2025-09-29T22:05:20.689688] [INFO ] [MAIN ] AXL: Loaded 50519 primary data records. [2025-09-29T22:05:21.397068] [DEBUG] [MAIN ] AX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:21.398152] [INFO ] [MAIN ] AX: Generated 1794 derivative records from 28381 primary records. [2025-09-29T22:05:21.398816] [DEBUG] [LOCAL ] AX: Saving derivative data. [2025-09-29T22:05:21.422071] [DEBUG] [LOCAL ] AX: Derivative data saved (1794 records). [2025-09-29T22:05:21.425158] [INFO ] [MAIN ] AX: Successfully saved derivative data. [2025-09-29T22:05:21.428109] [INFO ] [MAIN ] Derivative Progress: 148/2057 symbols completed. AX took 1.2s. Estimated remaining: 13m 8s. Rate: 145.3 symbols/min [2025-09-29T22:05:21.444247] [DEBUG] [MAIN ] AXL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:21.445226] [INFO ] [MAIN ] AXL: Generated 1794 derivative records from 50519 primary records. [2025-09-29T22:05:21.445425] [DEBUG] [LOCAL ] AXL: Saving derivative data. [2025-09-29T22:05:21.466160] [DEBUG] [MAIN ] AXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:21.471132] [INFO ] [MAIN ] AXP: Generated 1794 derivative records from 53201 primary records. [2025-09-29T22:05:21.471490] [DEBUG] [LOCAL ] AXP: Saving derivative data. [2025-09-29T22:05:21.490850] [DEBUG] [LOCAL ] AXP: Derivative data saved (1794 records). [2025-09-29T22:05:21.491459] [INFO ] [MAIN ] AXP: Successfully saved derivative data. [2025-09-29T22:05:21.494265] [INFO ] [MAIN ] Derivative Progress: 149/2057 symbols completed. AXP took 1.2s. Estimated remaining: 13m 3s. Rate: 146.2 symbols/min [2025-09-29T22:05:21.494419] [DEBUG] [LOCAL ] AXL: Derivative data saved (1794 records). [2025-09-29T22:05:21.494779] [INFO ] [MAIN ] AXL: Successfully saved derivative data. [2025-09-29T22:05:21.497365] [INFO ] [MAIN ] Derivative Progress: 150/2057 symbols completed. AXL took 1.3s. Estimated remaining: 12m 58s. Rate: 147.1 symbols/min [2025-09-29T22:05:21.497934] [INFO ] [MAIN ] AXTA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:21.497809] [INFO ] [MAIN ] AXR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:21.497870] [INFO ] [MAIN ] AXS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:21.505422] [DEBUG] [LOCAL ] AXR: Loaded 3112 existing records from primary storage. [2025-09-29T22:05:21.505559] [INFO ] [MAIN ] AXR: Loaded 3112 primary data records. [2025-09-29T22:05:21.886036] [DEBUG] [LOCAL ] AXS: Loaded 38385 existing records from primary storage. [2025-09-29T22:05:21.887886] [INFO ] [MAIN ] AXS: Loaded 38385 primary data records. [2025-09-29T22:05:21.904549] [DEBUG] [LOCAL ] AXTA: Loaded 52065 existing records from primary storage. [2025-09-29T22:05:21.910510] [INFO ] [MAIN ] AXTA: Loaded 52065 primary data records. [2025-09-29T22:05:22.606525] [DEBUG] [MAIN ] AXR: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-09-29T22:05:22.608227] [INFO ] [MAIN ] AXR: Generated 1792 derivative records from 3112 primary records. [2025-09-29T22:05:22.609073] [DEBUG] [LOCAL ] AXR: Saving derivative data. [2025-09-29T22:05:22.628462] [DEBUG] [LOCAL ] AXR: Derivative data saved (1792 records). [2025-09-29T22:05:22.628593] [INFO ] [MAIN ] AXR: Successfully saved derivative data. [2025-09-29T22:05:22.631193] [INFO ] [MAIN ] Derivative Progress: 151/2057 symbols completed. AXR took 1.1s. Estimated remaining: 13m 6s. Rate: 145.4 symbols/min [2025-09-29T22:05:22.631711] [INFO ] [MAIN ] AYI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:22.650119] [DEBUG] [MAIN ] AXS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:22.651052] [INFO ] [MAIN ] AXS: Generated 1794 derivative records from 38385 primary records. [2025-09-29T22:05:22.651142] [DEBUG] [LOCAL ] AXS: Saving derivative data. [2025-09-29T22:05:22.690905] [DEBUG] [LOCAL ] AXS: Derivative data saved (1794 records). [2025-09-29T22:05:22.691617] [INFO ] [MAIN ] AXS: Successfully saved derivative data. [2025-09-29T22:05:22.691450] [DEBUG] [MAIN ] AXTA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:22.694994] [INFO ] [MAIN ] AXTA: Generated 1794 derivative records from 52065 primary records. [2025-09-29T22:05:22.693997] [INFO ] [MAIN ] Derivative Progress: 152/2057 symbols completed. AXS took 1.2s. Estimated remaining: 13m 2s. Rate: 146.2 symbols/min [2025-09-29T22:05:22.702536] [DEBUG] [LOCAL ] AXTA: Saving derivative data. [2025-09-29T22:05:22.695234] [INFO ] [MAIN ] AZO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:22.715023] [DEBUG] [LOCAL ] AYI: Loaded 25060 existing records from primary storage. [2025-09-29T22:05:22.718542] [INFO ] [MAIN ] AYI: Loaded 25060 primary data records. [2025-09-29T22:05:22.819673] [DEBUG] [LOCAL ] AZO: Loaded 11372 existing records from primary storage. [2025-09-29T22:05:22.832143] [INFO ] [MAIN ] AZO: Loaded 11372 primary data records. [2025-09-29T22:05:22.857059] [DEBUG] [LOCAL ] AXTA: Derivative data saved (1794 records). [2025-09-29T22:05:22.933513] [INFO ] [MAIN ] AXTA: Successfully saved derivative data. [2025-09-29T22:05:22.994633] [INFO ] [MAIN ] Derivative Progress: 153/2057 symbols completed. AXTA took 1.5s. Estimated remaining: 12m 60s. Rate: 146.5 symbols/min [2025-09-29T22:05:23.034888] [INFO ] [MAIN ] AZZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:23.413671] [DEBUG] [LOCAL ] AZZ: Loaded 21975 existing records from primary storage. [2025-09-29T22:05:23.415379] [INFO ] [MAIN ] AZZ: Loaded 21975 primary data records. [2025-09-29T22:05:23.496205] [DEBUG] [MAIN ] AYI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:23.513862] [INFO ] [MAIN ] AYI: Generated 1794 derivative records from 25060 primary records. [2025-09-29T22:05:23.554450] [DEBUG] [LOCAL ] AYI: Saving derivative data. [2025-09-29T22:05:23.614771] [DEBUG] [MAIN ] AZO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:23.642830] [INFO ] [MAIN ] AZO: Generated 1794 derivative records from 11372 primary records. [2025-09-29T22:05:23.655786] [DEBUG] [LOCAL ] AZO: Saving derivative data. [2025-09-29T22:05:23.659034] [DEBUG] [LOCAL ] AYI: Derivative data saved (1794 records). [2025-09-29T22:05:23.659826] [INFO ] [MAIN ] AYI: Successfully saved derivative data. [2025-09-29T22:05:23.684102] [INFO ] [MAIN ] Derivative Progress: 154/2057 symbols completed. AYI took 1.1s. Estimated remaining: 13m 3s. Rate: 145.8 symbols/min [2025-09-29T22:05:23.774396] [INFO ] [MAIN ] BA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:23.841339] [DEBUG] [LOCAL ] AZO: Derivative data saved (1794 records). [2025-09-29T22:05:23.841469] [INFO ] [MAIN ] AZO: Successfully saved derivative data. [2025-09-29T22:05:23.843945] [INFO ] [MAIN ] Derivative Progress: 155/2057 symbols completed. AZO took 1.1s. Estimated remaining: 12m 59s. Rate: 146.4 symbols/min [2025-09-29T22:05:23.844146] [INFO ] [MAIN ] BABA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:23.871919] [DEBUG] [MAIN ] AZZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:23.872627] [INFO ] [MAIN ] AZZ: Generated 1794 derivative records from 21975 primary records. [2025-09-29T22:05:23.872814] [DEBUG] [LOCAL ] AZZ: Saving derivative data. [2025-09-29T22:05:23.890178] [DEBUG] [LOCAL ] AZZ: Derivative data saved (1794 records). [2025-09-29T22:05:23.905954] [INFO ] [MAIN ] AZZ: Successfully saved derivative data. [2025-09-29T22:05:23.925865] [INFO ] [MAIN ] Derivative Progress: 156/2057 symbols completed. AZZ took 0.9s. Estimated remaining: 12m 55s. Rate: 147.2 symbols/min [2025-09-29T22:05:23.926278] [INFO ] [MAIN ] BAC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:23.948264] [DEBUG] [LOCAL ] BA: Loaded 53791 existing records from primary storage. [2025-09-29T22:05:23.948504] [INFO ] [MAIN ] BA: Loaded 53791 primary data records. [2025-09-29T22:05:24.060973] [DEBUG] [LOCAL ] BABA: Loaded 53820 existing records from primary storage. [2025-09-29T22:05:24.072561] [INFO ] [MAIN ] BABA: Loaded 53820 primary data records. [2025-09-29T22:05:24.485411] [DEBUG] [LOCAL ] BAC: Loaded 53808 existing records from primary storage. [2025-09-29T22:05:24.500758] [INFO ] [MAIN ] BAC: Loaded 53808 primary data records. [2025-09-29T22:05:25.020948] [DEBUG] [MAIN ] BA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:25.022558] [INFO ] [MAIN ] BA: Generated 1794 derivative records from 53791 primary records. [2025-09-29T22:05:25.022680] [DEBUG] [LOCAL ] BA: Saving derivative data. [2025-09-29T22:05:25.056934] [DEBUG] [MAIN ] BABA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:25.059178] [INFO ] [MAIN ] BABA: Generated 1794 derivative records from 53820 primary records. [2025-09-29T22:05:25.058186] [DEBUG] [LOCAL ] BA: Derivative data saved (1794 records). [2025-09-29T22:05:25.059450] [INFO ] [MAIN ] BA: Successfully saved derivative data. [2025-09-29T22:05:25.059685] [DEBUG] [LOCAL ] BABA: Saving derivative data. [2025-09-29T22:05:25.064149] [INFO ] [MAIN ] Derivative Progress: 157/2057 symbols completed. BA took 1.3s. Estimated remaining: 13m 3s. Rate: 145.5 symbols/min [2025-09-29T22:05:25.076999] [INFO ] [MAIN ] BAH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:25.094442] [DEBUG] [LOCAL ] BABA: Derivative data saved (1794 records). [2025-09-29T22:05:25.099918] [INFO ] [MAIN ] BABA: Successfully saved derivative data. [2025-09-29T22:05:25.102567] [INFO ] [MAIN ] Derivative Progress: 158/2057 symbols completed. BABA took 1.3s. Estimated remaining: 12m 59s. Rate: 146.3 symbols/min [2025-09-29T22:05:25.103059] [INFO ] [MAIN ] BAK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:25.099839] [DEBUG] [MAIN ] BAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:25.104211] [INFO ] [MAIN ] BAC: Generated 1794 derivative records from 53808 primary records. [2025-09-29T22:05:25.104343] [DEBUG] [LOCAL ] BAC: Saving derivative data. [2025-09-29T22:05:25.121812] [DEBUG] [LOCAL ] BAC: Derivative data saved (1794 records). [2025-09-29T22:05:25.121951] [INFO ] [MAIN ] BAC: Successfully saved derivative data. [2025-09-29T22:05:25.124342] [INFO ] [MAIN ] Derivative Progress: 159/2057 symbols completed. BAC took 1.2s. Estimated remaining: 12m 54s. Rate: 147.2 symbols/min [2025-09-29T22:05:25.124593] [INFO ] [MAIN ] BALL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:25.167956] [DEBUG] [LOCAL ] BAK: Loaded 39012 existing records from primary storage. [2025-09-29T22:05:25.168112] [INFO ] [MAIN ] BAK: Loaded 39012 primary data records. [2025-09-29T22:05:25.316439] [DEBUG] [LOCAL ] BAH: Loaded 51698 existing records from primary storage. [2025-09-29T22:05:25.316762] [INFO ] [MAIN ] BAH: Loaded 51698 primary data records. [2025-09-29T22:05:25.650742] [DEBUG] [LOCAL ] BALL: Loaded 51786 existing records from primary storage. [2025-09-29T22:05:25.650998] [INFO ] [MAIN ] BALL: Loaded 51786 primary data records. [2025-09-29T22:05:26.213028] [DEBUG] [MAIN ] BAK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:26.214991] [INFO ] [MAIN ] BAK: Generated 1794 derivative records from 39012 primary records. [2025-09-29T22:05:26.215107] [DEBUG] [LOCAL ] BAK: Saving derivative data. [2025-09-29T22:05:26.235414] [DEBUG] [LOCAL ] BAK: Derivative data saved (1794 records). [2025-09-29T22:05:26.235846] [INFO ] [MAIN ] BAK: Successfully saved derivative data. [2025-09-29T22:05:26.238174] [INFO ] [MAIN ] Derivative Progress: 160/2057 symbols completed. BAK took 1.1s. Estimated remaining: 13m 1s. Rate: 145.6 symbols/min [2025-09-29T22:05:26.238449] [INFO ] [MAIN ] BAM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:26.252548] [DEBUG] [MAIN ] BAH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:26.253692] [INFO ] [MAIN ] BAH: Generated 1794 derivative records from 51698 primary records. [2025-09-29T22:05:26.253846] [DEBUG] [LOCAL ] BAH: Saving derivative data. [2025-09-29T22:05:26.296978] [DEBUG] [MAIN ] BALL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:26.298426] [DEBUG] [LOCAL ] BAH: Derivative data saved (1794 records). [2025-09-29T22:05:26.300028] [INFO ] [MAIN ] BALL: Generated 1794 derivative records from 51786 primary records. [2025-09-29T22:05:26.300132] [INFO ] [MAIN ] BAH: Successfully saved derivative data. [2025-09-29T22:05:26.302724] [INFO ] [MAIN ] Derivative Progress: 161/2057 symbols completed. BAH took 1.2s. Estimated remaining: 12m 57s. Rate: 146.4 symbols/min [2025-09-29T22:05:26.302898] [DEBUG] [LOCAL ] BALL: Saving derivative data. [2025-09-29T22:05:26.303288] [INFO ] [MAIN ] BANC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:26.336510] [DEBUG] [LOCAL ] BALL: Derivative data saved (1794 records). [2025-09-29T22:05:26.336782] [INFO ] [MAIN ] BALL: Successfully saved derivative data. [2025-09-29T22:05:26.339168] [INFO ] [MAIN ] Derivative Progress: 162/2057 symbols completed. BALL took 1.2s. Estimated remaining: 12m 52s. Rate: 147.2 symbols/min [2025-09-29T22:05:26.339487] [INFO ] [MAIN ] BAP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:26.358410] [DEBUG] [LOCAL ] BAM: Loaded 51993 existing records from primary storage. [2025-09-29T22:05:26.358749] [INFO ] [MAIN ] BAM: Loaded 51993 primary data records. [2025-09-29T22:05:26.515222] [DEBUG] [LOCAL ] BAP: Loaded 26168 existing records from primary storage. [2025-09-29T22:05:26.530941] [INFO ] [MAIN ] BAP: Loaded 26168 primary data records. [2025-09-29T22:05:26.811064] [DEBUG] [LOCAL ] BANC: Loaded 51232 existing records from primary storage. [2025-09-29T22:05:26.875737] [INFO ] [MAIN ] BANC: Loaded 51232 primary data records. [2025-09-29T22:05:27.444546] [DEBUG] [MAIN ] BAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:27.445897] [INFO ] [MAIN ] BAM: Generated 1794 derivative records from 51993 primary records. [2025-09-29T22:05:27.446106] [DEBUG] [LOCAL ] BAM: Saving derivative data. [2025-09-29T22:05:27.485368] [DEBUG] [MAIN ] BAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:27.484947] [DEBUG] [LOCAL ] BAM: Derivative data saved (1794 records). [2025-09-29T22:05:27.494727] [INFO ] [MAIN ] BAM: Successfully saved derivative data. [2025-09-29T22:05:27.486594] [INFO ] [MAIN ] BAP: Generated 1794 derivative records from 26168 primary records. [2025-09-29T22:05:27.500368] [DEBUG] [LOCAL ] BAP: Saving derivative data. [2025-09-29T22:05:27.502806] [INFO ] [MAIN ] Derivative Progress: 163/2057 symbols completed. BAM took 1.3s. Estimated remaining: 13m 1s. Rate: 145.6 symbols/min [2025-09-29T22:05:27.503951] [DEBUG] [MAIN ] BANC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:27.512770] [INFO ] [MAIN ] BANC: Generated 1794 derivative records from 51232 primary records. [2025-09-29T22:05:27.516867] [DEBUG] [LOCAL ] BANC: Saving derivative data. [2025-09-29T22:05:27.521001] [DEBUG] [LOCAL ] BAP: Derivative data saved (1794 records). [2025-09-29T22:05:27.521988] [INFO ] [MAIN ] BAP: Successfully saved derivative data. [2025-09-29T22:05:27.523989] [INFO ] [MAIN ] Derivative Progress: 164/2057 symbols completed. BAP took 1.2s. Estimated remaining: 12m 56s. Rate: 146.4 symbols/min [2025-09-29T22:05:27.539862] [DEBUG] [LOCAL ] BANC: Derivative data saved (1794 records). [2025-09-29T22:05:27.539952] [INFO ] [MAIN ] BANC: Successfully saved derivative data. [2025-09-29T22:05:27.542249] [INFO ] [MAIN ] Derivative Progress: 165/2057 symbols completed. BANC took 1.2s. Estimated remaining: 12m 51s. Rate: 147.3 symbols/min [2025-09-29T22:05:27.542915] [INFO ] [MAIN ] BB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:27.542838] [INFO ] [MAIN ] BARK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:27.543099] [INFO ] [MAIN ] BBAI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:27.609300] [DEBUG] [LOCAL ] BARK: Loaded 38149 existing records from primary storage. [2025-09-29T22:05:27.609505] [INFO ] [MAIN ] BARK: Loaded 38149 primary data records. [2025-09-29T22:05:27.751973] [DEBUG] [LOCAL ] BBAI: Loaded 53820 existing records from primary storage. [2025-09-29T22:05:27.752290] [INFO ] [MAIN ] BBAI: Loaded 53820 primary data records. [2025-09-29T22:05:27.753350] [DEBUG] [LOCAL ] BB: Loaded 52924 existing records from primary storage. [2025-09-29T22:05:27.776863] [INFO ] [MAIN ] BB: Loaded 52924 primary data records. [2025-09-29T22:05:28.678166] [DEBUG] [MAIN ] BARK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:28.679363] [INFO ] [MAIN ] BARK: Generated 1794 derivative records from 38149 primary records. [2025-09-29T22:05:28.680675] [DEBUG] [LOCAL ] BARK: Saving derivative data. [2025-09-29T22:05:28.702730] [DEBUG] [LOCAL ] BARK: Derivative data saved (1794 records). [2025-09-29T22:05:28.703076] [INFO ] [MAIN ] BARK: Successfully saved derivative data. [2025-09-29T22:05:28.705045] [INFO ] [MAIN ] Derivative Progress: 166/2057 symbols completed. BARK took 1.2s. Estimated remaining: 12m 59s. Rate: 145.7 symbols/min [2025-09-29T22:05:28.705773] [INFO ] [MAIN ] BBAR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:28.724195] [DEBUG] [MAIN ] BBAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:28.725352] [INFO ] [MAIN ] BBAI: Generated 1794 derivative records from 53820 primary records. [2025-09-29T22:05:28.725687] [DEBUG] [LOCAL ] BBAI: Saving derivative data. [2025-09-29T22:05:28.752158] [DEBUG] [MAIN ] BB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:28.753516] [INFO ] [MAIN ] BB: Generated 1794 derivative records from 52924 primary records. [2025-09-29T22:05:28.754266] [DEBUG] [LOCAL ] BB: Saving derivative data. [2025-09-29T22:05:28.776557] [DEBUG] [LOCAL ] BBAI: Derivative data saved (1794 records). [2025-09-29T22:05:28.786025] [INFO ] [MAIN ] BBAI: Successfully saved derivative data. [2025-09-29T22:05:28.788569] [INFO ] [MAIN ] Derivative Progress: 167/2057 symbols completed. BBAI took 1.2s. Estimated remaining: 12m 55s. Rate: 146.4 symbols/min [2025-09-29T22:05:28.789459] [DEBUG] [LOCAL ] BB: Derivative data saved (1794 records). [2025-09-29T22:05:28.789545] [INFO ] [MAIN ] BB: Successfully saved derivative data. [2025-09-29T22:05:28.791834] [INFO ] [MAIN ] BBD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:28.792081] [INFO ] [MAIN ] Derivative Progress: 168/2057 symbols completed. BB took 1.2s. Estimated remaining: 12m 50s. Rate: 147.2 symbols/min [2025-09-29T22:05:28.792684] [INFO ] [MAIN ] BBDC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:28.810812] [DEBUG] [LOCAL ] BBAR: Loaded 41378 existing records from primary storage. [2025-09-29T22:05:28.811242] [INFO ] [MAIN ] BBAR: Loaded 41378 primary data records. [2025-09-29T22:05:29.071591] [DEBUG] [LOCAL ] BBDC: Loaded 33080 existing records from primary storage. [2025-09-29T22:05:29.195047] [INFO ] [MAIN ] BBDC: Loaded 33080 primary data records. [2025-09-29T22:05:29.330540] [DEBUG] [LOCAL ] BBD: Loaded 53196 existing records from primary storage. [2025-09-29T22:05:29.341608] [INFO ] [MAIN ] BBD: Loaded 53196 primary data records. [2025-09-29T22:05:29.895794] [DEBUG] [MAIN ] BBAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:29.897120] [INFO ] [MAIN ] BBAR: Generated 1794 derivative records from 41378 primary records. [2025-09-29T22:05:29.897353] [DEBUG] [LOCAL ] BBAR: Saving derivative data. [2025-09-29T22:05:29.918412] [DEBUG] [LOCAL ] BBAR: Derivative data saved (1794 records). [2025-09-29T22:05:29.918781] [INFO ] [MAIN ] BBAR: Successfully saved derivative data. [2025-09-29T22:05:29.921091] [INFO ] [MAIN ] Derivative Progress: 169/2057 symbols completed. BBAR took 1.2s. Estimated remaining: 12m 57s. Rate: 145.7 symbols/min [2025-09-29T22:05:29.921454] [INFO ] [MAIN ] BBDO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:29.947871] [DEBUG] [MAIN ] BBDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:29.949243] [INFO ] [MAIN ] BBDC: Generated 1794 derivative records from 33080 primary records. [2025-09-29T22:05:29.948116] [DEBUG] [LOCAL ] BBDO: Loaded 4954 existing records from primary storage. [2025-09-29T22:05:29.949797] [INFO ] [MAIN ] BBDO: Loaded 4954 primary data records. [2025-09-29T22:05:29.955321] [DEBUG] [LOCAL ] BBDC: Saving derivative data. [2025-09-29T22:05:30.071156] [DEBUG] [LOCAL ] BBDC: Derivative data saved (1794 records). [2025-09-29T22:05:30.098332] [INFO ] [MAIN ] BBDC: Successfully saved derivative data. [2025-09-29T22:05:30.133875] [INFO ] [MAIN ] Derivative Progress: 170/2057 symbols completed. BBDC took 1.3s. Estimated remaining: 12m 55s. Rate: 146.1 symbols/min [2025-09-29T22:05:30.134058] [INFO ] [MAIN ] BBN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:30.165181] [DEBUG] [MAIN ] BBD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:30.173553] [INFO ] [MAIN ] BBD: Generated 1794 derivative records from 53196 primary records. [2025-09-29T22:05:30.197349] [DEBUG] [LOCAL ] BBD: Saving derivative data. [2025-09-29T22:05:30.352694] [DEBUG] [LOCAL ] BBN: Loaded 18016 existing records from primary storage. [2025-09-29T22:05:30.353864] [INFO ] [MAIN ] BBN: Loaded 18016 primary data records. [2025-09-29T22:05:30.353960] [DEBUG] [LOCAL ] BBD: Derivative data saved (1794 records). [2025-09-29T22:05:30.354674] [INFO ] [MAIN ] BBD: Successfully saved derivative data. [2025-09-29T22:05:30.388958] [INFO ] [MAIN ] Derivative Progress: 171/2057 symbols completed. BBD took 1.6s. Estimated remaining: 12m 53s. Rate: 146.4 symbols/min [2025-09-29T22:05:30.436430] [INFO ] [MAIN ] BBU: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:30.498117] [DEBUG] [LOCAL ] BBU: Loaded 4536 existing records from primary storage. [2025-09-29T22:05:30.552760] [INFO ] [MAIN ] BBU: Loaded 4536 primary data records. [2025-09-29T22:05:30.800424] [DEBUG] [MAIN ] BBDO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:30.816943] [INFO ] [MAIN ] BBDO: Generated 1794 derivative records from 4954 primary records. [2025-09-29T22:05:30.860991] [DEBUG] [LOCAL ] BBDO: Saving derivative data. [2025-09-29T22:05:31.105494] [DEBUG] [LOCAL ] BBDO: Derivative data saved (1794 records). [2025-09-29T22:05:31.107030] [INFO ] [MAIN ] BBDO: Successfully saved derivative data. [2025-09-29T22:05:31.109581] [INFO ] [MAIN ] Derivative Progress: 172/2057 symbols completed. BBDO took 1.2s. Estimated remaining: 12m 56s. Rate: 145.8 symbols/min [2025-09-29T22:05:31.110244] [INFO ] [MAIN ] BBVA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:31.130878] [DEBUG] [MAIN ] BBN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:31.131753] [INFO ] [MAIN ] BBN: Generated 1794 derivative records from 18016 primary records. [2025-09-29T22:05:31.132097] [DEBUG] [LOCAL ] BBN: Saving derivative data. [2025-09-29T22:05:31.150101] [DEBUG] [LOCAL ] BBN: Derivative data saved (1794 records). [2025-09-29T22:05:31.152724] [INFO ] [MAIN ] BBN: Successfully saved derivative data. [2025-09-29T22:05:31.155192] [INFO ] [MAIN ] Derivative Progress: 173/2057 symbols completed. BBN took 1.0s. Estimated remaining: 12m 51s. Rate: 146.5 symbols/min [2025-09-29T22:05:31.155597] [INFO ] [MAIN ] BBW: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:31.169153] [DEBUG] [MAIN ] BBU: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:05:31.169748] [INFO ] [MAIN ] BBU: Generated 1793 derivative records from 4536 primary records. [2025-09-29T22:05:31.169869] [DEBUG] [LOCAL ] BBU: Saving derivative data. [2025-09-29T22:05:31.198502] [DEBUG] [LOCAL ] BBU: Derivative data saved (1793 records). [2025-09-29T22:05:31.198773] [INFO ] [MAIN ] BBU: Successfully saved derivative data. [2025-09-29T22:05:31.200858] [INFO ] [MAIN ] Derivative Progress: 174/2057 symbols completed. BBU took 0.8s. Estimated remaining: 12m 47s. Rate: 147.3 symbols/min [2025-09-29T22:05:31.208573] [INFO ] [MAIN ] BBWI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:31.227080] [DEBUG] [LOCAL ] BBVA: Loaded 49353 existing records from primary storage. [2025-09-29T22:05:31.227364] [INFO ] [MAIN ] BBVA: Loaded 49353 primary data records. [2025-09-29T22:05:31.328904] [DEBUG] [LOCAL ] BBW: Loaded 26648 existing records from primary storage. [2025-09-29T22:05:31.349757] [INFO ] [MAIN ] BBW: Loaded 26648 primary data records. [2025-09-29T22:05:31.924921] [DEBUG] [LOCAL ] BBWI: Loaded 53580 existing records from primary storage. [2025-09-29T22:05:31.925407] [INFO ] [MAIN ] BBWI: Loaded 53580 primary data records. [2025-09-29T22:05:32.294241] [DEBUG] [MAIN ] BBVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:32.296432] [INFO ] [MAIN ] BBVA: Generated 1794 derivative records from 49353 primary records. [2025-09-29T22:05:32.296617] [DEBUG] [LOCAL ] BBVA: Saving derivative data. [2025-09-29T22:05:32.319552] [DEBUG] [LOCAL ] BBVA: Derivative data saved (1794 records). [2025-09-29T22:05:32.319801] [INFO ] [MAIN ] BBVA: Successfully saved derivative data. [2025-09-29T22:05:32.336512] [INFO ] [MAIN ] Derivative Progress: 175/2057 symbols completed. BBVA took 1.2s. Estimated remaining: 12m 54s. Rate: 145.8 symbols/min [2025-09-29T22:05:32.336753] [INFO ] [MAIN ] BBY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:32.334453] [DEBUG] [MAIN ] BBW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:32.337964] [INFO ] [MAIN ] BBW: Generated 1794 derivative records from 26648 primary records. [2025-09-29T22:05:32.338204] [DEBUG] [LOCAL ] BBW: Saving derivative data. [2025-09-29T22:05:32.361577] [DEBUG] [LOCAL ] BBW: Derivative data saved (1794 records). [2025-09-29T22:05:32.362918] [INFO ] [MAIN ] BBW: Successfully saved derivative data. [2025-09-29T22:05:32.366869] [INFO ] [MAIN ] Derivative Progress: 176/2057 symbols completed. BBW took 1.2s. Estimated remaining: 12m 50s. Rate: 146.6 symbols/min [2025-09-29T22:05:32.367355] [INFO ] [MAIN ] BC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:32.382272] [DEBUG] [MAIN ] BBWI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:32.383087] [INFO ] [MAIN ] BBWI: Generated 1794 derivative records from 53580 primary records. [2025-09-29T22:05:32.383201] [DEBUG] [LOCAL ] BBWI: Saving derivative data. [2025-09-29T22:05:32.414953] [DEBUG] [LOCAL ] BBWI: Derivative data saved (1794 records). [2025-09-29T22:05:32.415284] [INFO ] [MAIN ] BBWI: Successfully saved derivative data. [2025-09-29T22:05:32.417568] [INFO ] [MAIN ] Derivative Progress: 177/2057 symbols completed. BBWI took 1.2s. Estimated remaining: 12m 46s. Rate: 147.3 symbols/min [2025-09-29T22:05:32.417905] [INFO ] [MAIN ] BCC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:32.455883] [DEBUG] [LOCAL ] BBY: Loaded 53470 existing records from primary storage. [2025-09-29T22:05:32.456767] [INFO ] [MAIN ] BBY: Loaded 53470 primary data records. [2025-09-29T22:05:32.539614] [DEBUG] [LOCAL ] BC: Loaded 44259 existing records from primary storage. [2025-09-29T22:05:32.557286] [INFO ] [MAIN ] BC: Loaded 44259 primary data records. [2025-09-29T22:05:32.627592] [DEBUG] [LOCAL ] BCC: Loaded 28242 existing records from primary storage. [2025-09-29T22:05:32.687164] [INFO ] [MAIN ] BCC: Loaded 28242 primary data records. [2025-09-29T22:05:33.571319] [DEBUG] [MAIN ] BBY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:33.572490] [INFO ] [MAIN ] BBY: Generated 1794 derivative records from 53470 primary records. [2025-09-29T22:05:33.572900] [DEBUG] [LOCAL ] BBY: Saving derivative data. [2025-09-29T22:05:33.591796] [DEBUG] [LOCAL ] BBY: Derivative data saved (1794 records). [2025-09-29T22:05:33.592002] [INFO ] [MAIN ] BBY: Successfully saved derivative data. [2025-09-29T22:05:33.594501] [INFO ] [MAIN ] Derivative Progress: 178/2057 symbols completed. BBY took 1.3s. Estimated remaining: 12m 53s. Rate: 145.8 symbols/min [2025-09-29T22:05:33.627990] [DEBUG] [MAIN ] BC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:33.628334] [DEBUG] [MAIN ] BCC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:33.629229] [INFO ] [MAIN ] BCC: Generated 1794 derivative records from 28242 primary records. [2025-09-29T22:05:33.630059] [INFO ] [MAIN ] BC: Generated 1794 derivative records from 44259 primary records. [2025-09-29T22:05:33.630158] [DEBUG] [LOCAL ] BCC: Saving derivative data. [2025-09-29T22:05:33.630293] [DEBUG] [LOCAL ] BC: Saving derivative data. [2025-09-29T22:05:33.663084] [DEBUG] [LOCAL ] BC: Derivative data saved (1794 records). [2025-09-29T22:05:33.663762] [INFO ] [MAIN ] BC: Successfully saved derivative data. [2025-09-29T22:05:33.666782] [DEBUG] [LOCAL ] BCC: Derivative data saved (1794 records). [2025-09-29T22:05:33.666272] [INFO ] [MAIN ] Derivative Progress: 179/2057 symbols completed. BC took 1.3s. Estimated remaining: 12m 49s. Rate: 146.4 symbols/min [2025-09-29T22:05:33.667154] [INFO ] [MAIN ] BCC: Successfully saved derivative data. [2025-09-29T22:05:33.672050] [INFO ] [MAIN ] Derivative Progress: 180/2057 symbols completed. BCC took 1.3s. Estimated remaining: 12m 45s. Rate: 147.2 symbols/min [2025-09-29T22:05:33.672749] [INFO ] [MAIN ] BCO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:33.672544] [INFO ] [MAIN ] BCE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:33.672940] [INFO ] [MAIN ] BCH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:33.712299] [DEBUG] [LOCAL ] BCO: Loaded 26212 existing records from primary storage. [2025-09-29T22:05:33.722657] [INFO ] [MAIN ] BCO: Loaded 26212 primary data records. [2025-09-29T22:05:33.755893] [DEBUG] [LOCAL ] BCH: Loaded 29497 existing records from primary storage. [2025-09-29T22:05:33.783873] [INFO ] [MAIN ] BCH: Loaded 29497 primary data records. [2025-09-29T22:05:34.033837] [DEBUG] [LOCAL ] BCE: Loaded 52283 existing records from primary storage. [2025-09-29T22:05:34.072465] [INFO ] [MAIN ] BCE: Loaded 52283 primary data records. [2025-09-29T22:05:34.764402] [DEBUG] [MAIN ] BCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:34.778911] [INFO ] [MAIN ] BCO: Generated 1794 derivative records from 26212 primary records. [2025-09-29T22:05:34.780267] [DEBUG] [LOCAL ] BCO: Saving derivative data. [2025-09-29T22:05:34.780051] [DEBUG] [MAIN ] BCH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:34.782688] [INFO ] [MAIN ] BCH: Generated 1794 derivative records from 29497 primary records. [2025-09-29T22:05:34.783243] [DEBUG] [LOCAL ] BCH: Saving derivative data. [2025-09-29T22:05:34.818175] [DEBUG] [LOCAL ] BCH: Derivative data saved (1794 records). [2025-09-29T22:05:34.819735] [INFO ] [MAIN ] BCH: Successfully saved derivative data. [2025-09-29T22:05:34.825887] [INFO ] [MAIN ] Derivative Progress: 181/2057 symbols completed. BCH took 1.2s. Estimated remaining: 12m 52s. Rate: 145.8 symbols/min [2025-09-29T22:05:34.823496] [DEBUG] [LOCAL ] BCO: Derivative data saved (1794 records). [2025-09-29T22:05:34.826330] [INFO ] [MAIN ] BCS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:34.826187] [INFO ] [MAIN ] BCO: Successfully saved derivative data. [2025-09-29T22:05:34.829307] [INFO ] [MAIN ] Derivative Progress: 182/2057 symbols completed. BCO took 1.2s. Estimated remaining: 12m 48s. Rate: 146.6 symbols/min [2025-09-29T22:05:34.843518] [DEBUG] [MAIN ] BCE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:34.843158] [INFO ] [MAIN ] BCSF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:34.844546] [INFO ] [MAIN ] BCE: Generated 1794 derivative records from 52283 primary records. [2025-09-29T22:05:34.844711] [DEBUG] [LOCAL ] BCE: Saving derivative data. [2025-09-29T22:05:34.863505] [DEBUG] [LOCAL ] BCE: Derivative data saved (1794 records). [2025-09-29T22:05:34.863696] [INFO ] [MAIN ] BCE: Successfully saved derivative data. [2025-09-29T22:05:34.866375] [INFO ] [MAIN ] Derivative Progress: 183/2057 symbols completed. BCE took 1.2s. Estimated remaining: 12m 43s. Rate: 147.3 symbols/min [2025-09-29T22:05:34.866665] [INFO ] [MAIN ] BCX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:34.913910] [DEBUG] [LOCAL ] BCSF: Loaded 27789 existing records from primary storage. [2025-09-29T22:05:34.914973] [INFO ] [MAIN ] BCSF: Loaded 27789 primary data records. [2025-09-29T22:05:35.015317] [DEBUG] [LOCAL ] BCS: Loaded 53457 existing records from primary storage. [2025-09-29T22:05:35.021154] [DEBUG] [LOCAL ] BCX: Loaded 21626 existing records from primary storage. [2025-09-29T22:05:35.028727] [INFO ] [MAIN ] BCS: Loaded 53457 primary data records. [2025-09-29T22:05:35.039157] [INFO ] [MAIN ] BCX: Loaded 21626 primary data records. [2025-09-29T22:05:35.989189] [DEBUG] [MAIN ] BCSF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:35.992201] [INFO ] [MAIN ] BCSF: Generated 1794 derivative records from 27789 primary records. [2025-09-29T22:05:35.992477] [DEBUG] [LOCAL ] BCSF: Saving derivative data. [2025-09-29T22:05:36.024473] [DEBUG] [LOCAL ] BCSF: Derivative data saved (1794 records). [2025-09-29T22:05:36.021716] [DEBUG] [MAIN ] BCX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:36.024680] [INFO ] [MAIN ] BCSF: Successfully saved derivative data. [2025-09-29T22:05:36.027528] [INFO ] [MAIN ] Derivative Progress: 184/2057 symbols completed. BCSF took 1.2s. Estimated remaining: 12m 51s. Rate: 145.8 symbols/min [2025-09-29T22:05:36.025422] [INFO ] [MAIN ] BCX: Generated 1794 derivative records from 21626 primary records. [2025-09-29T22:05:36.027697] [DEBUG] [LOCAL ] BCX: Saving derivative data. [2025-09-29T22:05:36.036390] [INFO ] [MAIN ] BDC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:36.049501] [DEBUG] [MAIN ] BCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:36.050578] [INFO ] [MAIN ] BCS: Generated 1794 derivative records from 53457 primary records. [2025-09-29T22:05:36.050812] [DEBUG] [LOCAL ] BCS: Saving derivative data. [2025-09-29T22:05:36.068176] [DEBUG] [LOCAL ] BCX: Derivative data saved (1794 records). [2025-09-29T22:05:36.071145] [INFO ] [MAIN ] BCX: Successfully saved derivative data. [2025-09-29T22:05:36.074200] [INFO ] [MAIN ] Derivative Progress: 185/2057 symbols completed. BCX took 1.2s. Estimated remaining: 12m 46s. Rate: 146.5 symbols/min [2025-09-29T22:05:36.074619] [INFO ] [MAIN ] BDJ: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:36.079588] [DEBUG] [LOCAL ] BCS: Derivative data saved (1794 records). [2025-09-29T22:05:36.079869] [INFO ] [MAIN ] BCS: Successfully saved derivative data. [2025-09-29T22:05:36.081992] [INFO ] [MAIN ] Derivative Progress: 186/2057 symbols completed. BCS took 1.3s. Estimated remaining: 12m 42s. Rate: 147.3 symbols/min [2025-09-29T22:05:36.088472] [INFO ] [MAIN ] BDN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:36.110835] [DEBUG] [LOCAL ] BDC: Loaded 24595 existing records from primary storage. [2025-09-29T22:05:36.111165] [INFO ] [MAIN ] BDC: Loaded 24595 primary data records. [2025-09-29T22:05:36.256732] [DEBUG] [LOCAL ] BDJ: Loaded 28915 existing records from primary storage. [2025-09-29T22:05:36.273829] [INFO ] [MAIN ] BDJ: Loaded 28915 primary data records. [2025-09-29T22:05:36.546935] [DEBUG] [LOCAL ] BDN: Loaded 47512 existing records from primary storage. [2025-09-29T22:05:36.564726] [INFO ] [MAIN ] BDN: Loaded 47512 primary data records. [2025-09-29T22:05:37.203099] [DEBUG] [MAIN ] BDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:37.204585] [INFO ] [MAIN ] BDC: Generated 1794 derivative records from 24595 primary records. [2025-09-29T22:05:37.205212] [DEBUG] [LOCAL ] BDC: Saving derivative data. [2025-09-29T22:05:37.227171] [DEBUG] [LOCAL ] BDC: Derivative data saved (1794 records). [2025-09-29T22:05:37.241207] [DEBUG] [MAIN ] BDJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:37.242200] [INFO ] [MAIN ] BDC: Successfully saved derivative data. [2025-09-29T22:05:37.242006] [INFO ] [MAIN ] BDJ: Generated 1794 derivative records from 28915 primary records. [2025-09-29T22:05:37.244681] [DEBUG] [LOCAL ] BDJ: Saving derivative data. [2025-09-29T22:05:37.244410] [INFO ] [MAIN ] Derivative Progress: 187/2057 symbols completed. BDC took 1.2s. Estimated remaining: 12m 49s. Rate: 145.9 symbols/min [2025-09-29T22:05:37.245354] [INFO ] [MAIN ] BDX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:37.263309] [DEBUG] [LOCAL ] BDJ: Derivative data saved (1794 records). [2025-09-29T22:05:37.263615] [INFO ] [MAIN ] BDJ: Successfully saved derivative data. [2025-09-29T22:05:37.267081] [INFO ] [MAIN ] Derivative Progress: 188/2057 symbols completed. BDJ took 1.2s. Estimated remaining: 12m 45s. Rate: 146.6 symbols/min [2025-09-29T22:05:37.267306] [INFO ] [MAIN ] BE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:37.283124] [DEBUG] [MAIN ] BDN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:37.284025] [INFO ] [MAIN ] BDN: Generated 1794 derivative records from 47512 primary records. [2025-09-29T22:05:37.284150] [DEBUG] [LOCAL ] BDN: Saving derivative data. [2025-09-29T22:05:37.300736] [DEBUG] [LOCAL ] BDN: Derivative data saved (1794 records). [2025-09-29T22:05:37.300994] [INFO ] [MAIN ] BDN: Successfully saved derivative data. [2025-09-29T22:05:37.303147] [INFO ] [MAIN ] Derivative Progress: 189/2057 symbols completed. BDN took 1.2s. Estimated remaining: 12m 41s. Rate: 147.3 symbols/min [2025-09-29T22:05:37.303382] [INFO ] [MAIN ] BEKE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:37.357177] [DEBUG] [LOCAL ] BDX: Loaded 52378 existing records from primary storage. [2025-09-29T22:05:37.357887] [INFO ] [MAIN ] BDX: Loaded 52378 primary data records. [2025-09-29T22:05:37.471203] [DEBUG] [LOCAL ] BE: Loaded 53653 existing records from primary storage. [2025-09-29T22:05:37.501177] [INFO ] [MAIN ] BE: Loaded 53653 primary data records. [2025-09-29T22:05:37.859103] [DEBUG] [LOCAL ] BEKE: Loaded 53241 existing records from primary storage. [2025-09-29T22:05:37.884806] [INFO ] [MAIN ] BEKE: Loaded 53241 primary data records. [2025-09-29T22:05:38.440068] [DEBUG] [MAIN ] BDX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:38.441275] [INFO ] [MAIN ] BDX: Generated 1794 derivative records from 52378 primary records. [2025-09-29T22:05:38.441543] [DEBUG] [LOCAL ] BDX: Saving derivative data. [2025-09-29T22:05:38.466423] [DEBUG] [LOCAL ] BDX: Derivative data saved (1794 records). [2025-09-29T22:05:38.472679] [INFO ] [MAIN ] BDX: Successfully saved derivative data. [2025-09-29T22:05:38.480135] [INFO ] [MAIN ] Derivative Progress: 190/2057 symbols completed. BDX took 1.2s. Estimated remaining: 12m 48s. Rate: 145.9 symbols/min [2025-09-29T22:05:38.487987] [DEBUG] [MAIN ] BE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:38.488158] [INFO ] [MAIN ] BEN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:38.489818] [INFO ] [MAIN ] BE: Generated 1794 derivative records from 53653 primary records. [2025-09-29T22:05:38.490690] [DEBUG] [LOCAL ] BE: Saving derivative data. [2025-09-29T22:05:38.524251] [DEBUG] [MAIN ] BEKE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:38.529151] [DEBUG] [LOCAL ] BE: Derivative data saved (1794 records). [2025-09-29T22:05:38.530277] [INFO ] [MAIN ] BEKE: Generated 1794 derivative records from 53241 primary records. [2025-09-29T22:05:38.530730] [INFO ] [MAIN ] BE: Successfully saved derivative data. [2025-09-29T22:05:38.533303] [DEBUG] [LOCAL ] BEKE: Saving derivative data. [2025-09-29T22:05:38.533181] [INFO ] [MAIN ] Derivative Progress: 191/2057 symbols completed. BE took 1.3s. Estimated remaining: 12m 44s. Rate: 146.5 symbols/min [2025-09-29T22:05:38.534511] [INFO ] [MAIN ] BEP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:38.558055] [DEBUG] [LOCAL ] BEKE: Derivative data saved (1794 records). [2025-09-29T22:05:38.558343] [INFO ] [MAIN ] BEKE: Successfully saved derivative data. [2025-09-29T22:05:38.561224] [INFO ] [MAIN ] Derivative Progress: 192/2057 symbols completed. BEKE took 1.3s. Estimated remaining: 12m 40s. Rate: 147.2 symbols/min [2025-09-29T22:05:38.561534] [INFO ] [MAIN ] BEPC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:38.625234] [DEBUG] [LOCAL ] BEN: Loaded 53054 existing records from primary storage. [2025-09-29T22:05:38.625954] [DEBUG] [LOCAL ] BEP: Loaded 38575 existing records from primary storage. [2025-09-29T22:05:38.626160] [INFO ] [MAIN ] BEN: Loaded 53054 primary data records. [2025-09-29T22:05:38.626344] [INFO ] [MAIN ] BEP: Loaded 38575 primary data records. [2025-09-29T22:05:38.901897] [DEBUG] [LOCAL ] BEPC: Loaded 46440 existing records from primary storage. [2025-09-29T22:05:38.933220] [INFO ] [MAIN ] BEPC: Loaded 46440 primary data records. [2025-09-29T22:05:39.741924] [DEBUG] [MAIN ] BEP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:39.742966] [INFO ] [MAIN ] BEP: Generated 1794 derivative records from 38575 primary records. [2025-09-29T22:05:39.743102] [DEBUG] [LOCAL ] BEP: Saving derivative data. [2025-09-29T22:05:39.765859] [DEBUG] [MAIN ] BEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:39.770999] [INFO ] [MAIN ] BEN: Generated 1794 derivative records from 53054 primary records. [2025-09-29T22:05:39.771360] [DEBUG] [LOCAL ] BEN: Saving derivative data. [2025-09-29T22:05:39.791590] [DEBUG] [LOCAL ] BEN: Derivative data saved (1794 records). [2025-09-29T22:05:39.792894] [INFO ] [MAIN ] BEN: Successfully saved derivative data. [2025-09-29T22:05:39.795678] [INFO ] [MAIN ] Derivative Progress: 193/2057 symbols completed. BEN took 1.3s. Estimated remaining: 12m 48s. Rate: 145.7 symbols/min [2025-09-29T22:05:39.800058] [DEBUG] [LOCAL ] BEP: Derivative data saved (1794 records). [2025-09-29T22:05:39.800200] [INFO ] [MAIN ] BEP: Successfully saved derivative data. [2025-09-29T22:05:39.803788] [INFO ] [MAIN ] Derivative Progress: 194/2057 symbols completed. BEP took 1.3s. Estimated remaining: 12m 43s. Rate: 146.5 symbols/min [2025-09-29T22:05:39.818406] [DEBUG] [MAIN ] BEPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:39.819172] [INFO ] [MAIN ] BEPC: Generated 1794 derivative records from 46440 primary records. [2025-09-29T22:05:39.819237] [DEBUG] [LOCAL ] BEPC: Saving derivative data. [2025-09-29T22:05:39.835148] [DEBUG] [LOCAL ] BEPC: Derivative data saved (1794 records). [2025-09-29T22:05:39.835334] [INFO ] [MAIN ] BEPC: Successfully saved derivative data. [2025-09-29T22:05:39.837394] [INFO ] [MAIN ] Derivative Progress: 195/2057 symbols completed. BEPC took 1.3s. Estimated remaining: 12m 39s. Rate: 147.1 symbols/min [2025-09-29T22:05:39.838002] [INFO ] [MAIN ] BEPI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:39.838104] [INFO ] [MAIN ] BFAM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:39.838301] [INFO ] [MAIN ] BEPJ: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:39.845854] [DEBUG] [LOCAL ] BEPI: Loaded 3481 existing records from primary storage. [2025-09-29T22:05:39.847295] [INFO ] [MAIN ] BEPI: Loaded 3481 primary data records. [2025-09-29T22:05:39.919764] [DEBUG] [LOCAL ] BEPJ: Loaded 3138 existing records from primary storage. [2025-09-29T22:05:39.937672] [INFO ] [MAIN ] BEPJ: Loaded 3138 primary data records. [2025-09-29T22:05:40.315374] [DEBUG] [LOCAL ] BFAM: Loaded 33077 existing records from primary storage. [2025-09-29T22:05:40.321526] [INFO ] [MAIN ] BFAM: Loaded 33077 primary data records. [2025-09-29T22:05:40.862179] [DEBUG] [MAIN ] BEPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:40.863704] [INFO ] [MAIN ] BEPI: Generated 1794 derivative records from 3481 primary records. [2025-09-29T22:05:40.863809] [DEBUG] [LOCAL ] BEPI: Saving derivative data. [2025-09-29T22:05:40.884280] [DEBUG] [LOCAL ] BEPI: Derivative data saved (1794 records). [2025-09-29T22:05:40.892507] [INFO ] [MAIN ] BEPI: Successfully saved derivative data. [2025-09-29T22:05:40.900171] [DEBUG] [MAIN ] BEPJ: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-09-29T22:05:40.901048] [INFO ] [MAIN ] BEPJ: Generated 1792 derivative records from 3138 primary records. [2025-09-29T22:05:40.899790] [INFO ] [MAIN ] Derivative Progress: 196/2057 symbols completed. BEPI took 1.1s. Estimated remaining: 12m 45s. Rate: 146.0 symbols/min [2025-09-29T22:05:40.901577] [DEBUG] [LOCAL ] BEPJ: Saving derivative data. [2025-09-29T22:05:40.901758] [INFO ] [MAIN ] BFH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:40.922141] [DEBUG] [LOCAL ] BEPJ: Derivative data saved (1792 records). [2025-09-29T22:05:40.922510] [INFO ] [MAIN ] BEPJ: Successfully saved derivative data. [2025-09-29T22:05:40.924933] [INFO ] [MAIN ] Derivative Progress: 197/2057 symbols completed. BEPJ took 1.1s. Estimated remaining: 12m 41s. Rate: 146.7 symbols/min [2025-09-29T22:05:40.925278] [INFO ] [MAIN ] BFK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:40.939216] [DEBUG] [MAIN ] BFAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:40.940012] [INFO ] [MAIN ] BFAM: Generated 1794 derivative records from 33077 primary records. [2025-09-29T22:05:40.940079] [DEBUG] [LOCAL ] BFAM: Saving derivative data. [2025-09-29T22:05:40.964629] [DEBUG] [LOCAL ] BFK: Loaded 13908 existing records from primary storage. [2025-09-29T22:05:40.965351] [INFO ] [MAIN ] BFK: Loaded 13908 primary data records. [2025-09-29T22:05:41.039737] [DEBUG] [LOCAL ] BFAM: Derivative data saved (1794 records). [2025-09-29T22:05:41.076455] [INFO ] [MAIN ] BFAM: Successfully saved derivative data. [2025-09-29T22:05:41.080767] [INFO ] [MAIN ] Derivative Progress: 198/2057 symbols completed. BFAM took 1.2s. Estimated remaining: 12m 38s. Rate: 147.1 symbols/min [2025-09-29T22:05:41.090609] [INFO ] [MAIN ] BFLY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:41.103463] [DEBUG] [LOCAL ] BFH: Loaded 41647 existing records from primary storage. [2025-09-29T22:05:41.104548] [INFO ] [MAIN ] BFH: Loaded 41647 primary data records. [2025-09-29T22:05:41.713541] [DEBUG] [LOCAL ] BFLY: Loaded 51799 existing records from primary storage. [2025-09-29T22:05:41.714472] [INFO ] [MAIN ] BFLY: Loaded 51799 primary data records. [2025-09-29T22:05:41.911073] [DEBUG] [MAIN ] BFK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:41.911857] [INFO ] [MAIN ] BFK: Generated 1794 derivative records from 13908 primary records. [2025-09-29T22:05:41.911965] [DEBUG] [LOCAL ] BFK: Saving derivative data. [2025-09-29T22:05:42.083758] [DEBUG] [LOCAL ] BFK: Derivative data saved (1794 records). [2025-09-29T22:05:42.096423] [INFO ] [MAIN ] BFK: Successfully saved derivative data. [2025-09-29T22:05:42.098855] [INFO ] [MAIN ] Derivative Progress: 199/2057 symbols completed. BFK took 1.2s. Estimated remaining: 12m 43s. Rate: 146.0 symbols/min [2025-09-29T22:05:42.099234] [INFO ] [MAIN ] BG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:42.100714] [DEBUG] [MAIN ] BFH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:42.101741] [INFO ] [MAIN ] BFH: Generated 1794 derivative records from 41647 primary records. [2025-09-29T22:05:42.101867] [DEBUG] [LOCAL ] BFH: Saving derivative data. [2025-09-29T22:05:42.126367] [DEBUG] [LOCAL ] BFH: Derivative data saved (1794 records). [2025-09-29T22:05:42.126683] [INFO ] [MAIN ] BFH: Successfully saved derivative data. [2025-09-29T22:05:42.129216] [INFO ] [MAIN ] Derivative Progress: 200/2057 symbols completed. BFH took 1.2s. Estimated remaining: 12m 40s. Rate: 146.7 symbols/min [2025-09-29T22:05:42.130424] [INFO ] [MAIN ] BGB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:42.147985] [DEBUG] [MAIN ] BFLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:42.148893] [INFO ] [MAIN ] BFLY: Generated 1794 derivative records from 51799 primary records. [2025-09-29T22:05:42.149038] [DEBUG] [LOCAL ] BFLY: Saving derivative data. [2025-09-29T22:05:42.188432] [DEBUG] [LOCAL ] BGB: Loaded 17484 existing records from primary storage. [2025-09-29T22:05:42.189463] [INFO ] [MAIN ] BGB: Loaded 17484 primary data records. [2025-09-29T22:05:42.189348] [DEBUG] [LOCAL ] BFLY: Derivative data saved (1794 records). [2025-09-29T22:05:42.190533] [INFO ] [MAIN ] BFLY: Successfully saved derivative data. [2025-09-29T22:05:42.214312] [INFO ] [MAIN ] Derivative Progress: 201/2057 symbols completed. BFLY took 1.1s. Estimated remaining: 12m 36s. Rate: 147.3 symbols/min [2025-09-29T22:05:42.229016] [INFO ] [MAIN ] BGH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:42.278224] [DEBUG] [LOCAL ] BG: Loaded 50382 existing records from primary storage. [2025-09-29T22:05:42.308927] [INFO ] [MAIN ] BG: Loaded 50382 primary data records. [2025-09-29T22:05:42.433845] [DEBUG] [LOCAL ] BGH: Loaded 16600 existing records from primary storage. [2025-09-29T22:05:42.466181] [INFO ] [MAIN ] BGH: Loaded 16600 primary data records. [2025-09-29T22:05:43.212625] [DEBUG] [MAIN ] BGB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:43.213671] [INFO ] [MAIN ] BGB: Generated 1794 derivative records from 17484 primary records. [2025-09-29T22:05:43.214096] [DEBUG] [LOCAL ] BGB: Saving derivative data. [2025-09-29T22:05:43.251772] [DEBUG] [MAIN ] BG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:43.252159] [DEBUG] [LOCAL ] BGB: Derivative data saved (1794 records). [2025-09-29T22:05:43.252481] [INFO ] [MAIN ] BGB: Successfully saved derivative data. [2025-09-29T22:05:43.253287] [INFO ] [MAIN ] BG: Generated 1794 derivative records from 50382 primary records. [2025-09-29T22:05:43.256015] [INFO ] [MAIN ] Derivative Progress: 202/2057 symbols completed. BGB took 1.1s. Estimated remaining: 12m 42s. Rate: 146.1 symbols/min [2025-09-29T22:05:43.253669] [DEBUG] [LOCAL ] BG: Saving derivative data. [2025-09-29T22:05:43.256265] [INFO ] [MAIN ] BGR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:43.295808] [DEBUG] [LOCAL ] BG: Derivative data saved (1794 records). [2025-09-29T22:05:43.296428] [INFO ] [MAIN ] BG: Successfully saved derivative data. [2025-09-29T22:05:43.296196] [DEBUG] [MAIN ] BGH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:43.298749] [INFO ] [MAIN ] Derivative Progress: 203/2057 symbols completed. BG took 1.2s. Estimated remaining: 12m 38s. Rate: 146.8 symbols/min [2025-09-29T22:05:43.299164] [INFO ] [MAIN ] BGS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:43.300163] [INFO ] [MAIN ] BGH: Generated 1794 derivative records from 16600 primary records. [2025-09-29T22:05:43.301092] [DEBUG] [LOCAL ] BGH: Saving derivative data. [2025-09-29T22:05:43.307455] [DEBUG] [LOCAL ] BGR: Loaded 13477 existing records from primary storage. [2025-09-29T22:05:43.307906] [INFO ] [MAIN ] BGR: Loaded 13477 primary data records. [2025-09-29T22:05:43.403418] [DEBUG] [LOCAL ] BGH: Derivative data saved (1794 records). [2025-09-29T22:05:43.418028] [INFO ] [MAIN ] BGH: Successfully saved derivative data. [2025-09-29T22:05:43.442095] [INFO ] [MAIN ] Derivative Progress: 204/2057 symbols completed. BGH took 1.2s. Estimated remaining: 12m 35s. Rate: 147.3 symbols/min [2025-09-29T22:05:43.446090] [INFO ] [MAIN ] BGT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:43.686101] [DEBUG] [LOCAL ] BGS: Loaded 50439 existing records from primary storage. [2025-09-29T22:05:43.686485] [INFO ] [MAIN ] BGS: Loaded 50439 primary data records. [2025-09-29T22:05:43.729857] [DEBUG] [LOCAL ] BGT: Loaded 16594 existing records from primary storage. [2025-09-29T22:05:43.736151] [INFO ] [MAIN ] BGT: Loaded 16594 primary data records. [2025-09-29T22:05:44.416803] [DEBUG] [MAIN ] BGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:44.418407] [INFO ] [MAIN ] BGR: Generated 1794 derivative records from 13477 primary records. [2025-09-29T22:05:44.419131] [DEBUG] [LOCAL ] BGR: Saving derivative data. [2025-09-29T22:05:44.438912] [DEBUG] [LOCAL ] BGR: Derivative data saved (1794 records). [2025-09-29T22:05:44.439132] [INFO ] [MAIN ] BGR: Successfully saved derivative data. [2025-09-29T22:05:44.441360] [INFO ] [MAIN ] Derivative Progress: 205/2057 symbols completed. BGR took 1.2s. Estimated remaining: 12m 40s. Rate: 146.2 symbols/min [2025-09-29T22:05:44.441837] [INFO ] [MAIN ] BGX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:44.472595] [DEBUG] [MAIN ] BGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:44.472231] [DEBUG] [LOCAL ] BGX: Loaded 10834 existing records from primary storage. [2025-09-29T22:05:44.475104] [INFO ] [MAIN ] BGX: Loaded 10834 primary data records. [2025-09-29T22:05:44.474987] [INFO ] [MAIN ] BGS: Generated 1794 derivative records from 50439 primary records. [2025-09-29T22:05:44.487092] [DEBUG] [LOCAL ] BGS: Saving derivative data. [2025-09-29T22:05:44.561835] [DEBUG] [MAIN ] BGT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:44.593571] [INFO ] [MAIN ] BGT: Generated 1794 derivative records from 16594 primary records. [2025-09-29T22:05:44.599730] [DEBUG] [LOCAL ] BGT: Saving derivative data. [2025-09-29T22:05:44.619543] [DEBUG] [LOCAL ] BGS: Derivative data saved (1794 records). [2025-09-29T22:05:44.619731] [INFO ] [MAIN ] BGS: Successfully saved derivative data. [2025-09-29T22:05:44.641546] [INFO ] [MAIN ] Derivative Progress: 206/2057 symbols completed. BGS took 1.3s. Estimated remaining: 12m 38s. Rate: 146.6 symbols/min [2025-09-29T22:05:44.653208] [INFO ] [MAIN ] BGY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:44.668364] [DEBUG] [LOCAL ] BGT: Derivative data saved (1794 records). [2025-09-29T22:05:44.679070] [INFO ] [MAIN ] BGT: Successfully saved derivative data. [2025-09-29T22:05:44.698223] [INFO ] [MAIN ] Derivative Progress: 207/2057 symbols completed. BGT took 1.3s. Estimated remaining: 12m 34s. Rate: 147.2 symbols/min [2025-09-29T22:05:44.734994] [INFO ] [MAIN ] BHK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:44.889299] [DEBUG] [LOCAL ] BGY: Loaded 22400 existing records from primary storage. [2025-09-29T22:05:44.890248] [INFO ] [MAIN ] BGY: Loaded 22400 primary data records. [2025-09-29T22:05:45.014550] [DEBUG] [LOCAL ] BHK: Loaded 22906 existing records from primary storage. [2025-09-29T22:05:45.015428] [INFO ] [MAIN ] BHK: Loaded 22906 primary data records. [2025-09-29T22:05:45.549045] [DEBUG] [MAIN ] BGX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:45.549939] [INFO ] [MAIN ] BGX: Generated 1794 derivative records from 10834 primary records. [2025-09-29T22:05:45.550113] [DEBUG] [LOCAL ] BGX: Saving derivative data. [2025-09-29T22:05:45.572171] [DEBUG] [LOCAL ] BGX: Derivative data saved (1794 records). [2025-09-29T22:05:45.572691] [INFO ] [MAIN ] BGX: Successfully saved derivative data. [2025-09-29T22:05:45.575237] [INFO ] [MAIN ] Derivative Progress: 208/2057 symbols completed. BGX took 1.1s. Estimated remaining: 12m 38s. Rate: 146.4 symbols/min [2025-09-29T22:05:45.596155] [DEBUG] [MAIN ] BGY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:45.597071] [INFO ] [MAIN ] BGY: Generated 1794 derivative records from 22400 primary records. [2025-09-29T22:05:45.597228] [DEBUG] [LOCAL ] BGY: Saving derivative data. [2025-09-29T22:05:45.628377] [DEBUG] [LOCAL ] BGY: Derivative data saved (1794 records). [2025-09-29T22:05:45.628307] [DEBUG] [MAIN ] BHK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:45.629229] [INFO ] [MAIN ] BGY: Successfully saved derivative data. [2025-09-29T22:05:45.629168] [INFO ] [MAIN ] BHK: Generated 1794 derivative records from 22906 primary records. [2025-09-29T22:05:45.631344] [INFO ] [MAIN ] Derivative Progress: 209/2057 symbols completed. BGY took 1.0s. Estimated remaining: 12m 34s. Rate: 147.0 symbols/min [2025-09-29T22:05:45.631416] [DEBUG] [LOCAL ] BHK: Saving derivative data. [2025-09-29T22:05:45.646806] [DEBUG] [LOCAL ] BHK: Derivative data saved (1794 records). [2025-09-29T22:05:45.646871] [INFO ] [MAIN ] BHK: Successfully saved derivative data. [2025-09-29T22:05:45.648966] [INFO ] [MAIN ] Derivative Progress: 210/2057 symbols completed. BHK took 0.9s. Estimated remaining: 12m 30s. Rate: 147.7 symbols/min [2025-09-29T22:05:45.649372] [INFO ] [MAIN ] BHVN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:45.649325] [INFO ] [MAIN ] BHP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:45.649490] [INFO ] [MAIN ] BHR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:45.679890] [DEBUG] [LOCAL ] BHR: Loaded 21364 existing records from primary storage. [2025-09-29T22:05:45.680184] [INFO ] [MAIN ] BHR: Loaded 21364 primary data records. [2025-09-29T22:05:45.934963] [DEBUG] [LOCAL ] BHVN: Loaded 49696 existing records from primary storage. [2025-09-29T22:05:46.112066] [INFO ] [MAIN ] BHVN: Loaded 49696 primary data records. [2025-09-29T22:05:46.128665] [DEBUG] [LOCAL ] BHP: Loaded 53373 existing records from primary storage. [2025-09-29T22:05:46.151706] [INFO ] [MAIN ] BHP: Loaded 53373 primary data records. [2025-09-29T22:05:46.825314] [DEBUG] [MAIN ] BHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:46.826835] [INFO ] [MAIN ] BHR: Generated 1794 derivative records from 21364 primary records. [2025-09-29T22:05:46.827581] [DEBUG] [LOCAL ] BHR: Saving derivative data. [2025-09-29T22:05:46.866418] [DEBUG] [MAIN ] BHVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:46.868639] [INFO ] [MAIN ] BHVN: Generated 1794 derivative records from 49696 primary records. [2025-09-29T22:05:46.869580] [DEBUG] [LOCAL ] BHVN: Saving derivative data. [2025-09-29T22:05:46.869229] [DEBUG] [LOCAL ] BHR: Derivative data saved (1794 records). [2025-09-29T22:05:46.884119] [INFO ] [MAIN ] BHR: Successfully saved derivative data. [2025-09-29T22:05:46.885305] [DEBUG] [MAIN ] BHP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:46.896337] [INFO ] [MAIN ] Derivative Progress: 211/2057 symbols completed. BHR took 1.2s. Estimated remaining: 12m 37s. Rate: 146.2 symbols/min [2025-09-29T22:05:46.900758] [INFO ] [MAIN ] BILL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:46.904830] [INFO ] [MAIN ] BHP: Generated 1794 derivative records from 53373 primary records. [2025-09-29T22:05:46.904993] [DEBUG] [LOCAL ] BHP: Saving derivative data. [2025-09-29T22:05:46.905428] [DEBUG] [LOCAL ] BHVN: Derivative data saved (1794 records). [2025-09-29T22:05:46.906896] [INFO ] [MAIN ] BHVN: Successfully saved derivative data. [2025-09-29T22:05:46.909777] [INFO ] [MAIN ] Derivative Progress: 212/2057 symbols completed. BHVN took 1.3s. Estimated remaining: 12m 34s. Rate: 146.9 symbols/min [2025-09-29T22:05:46.917545] [INFO ] [MAIN ] BIO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:46.928343] [DEBUG] [LOCAL ] BHP: Derivative data saved (1794 records). [2025-09-29T22:05:46.928611] [INFO ] [MAIN ] BHP: Successfully saved derivative data. [2025-09-29T22:05:46.931128] [INFO ] [MAIN ] Derivative Progress: 213/2057 symbols completed. BHP took 1.3s. Estimated remaining: 12m 30s. Rate: 147.6 symbols/min [2025-09-29T22:05:46.931387] [INFO ] [MAIN ] BIP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:46.954506] [DEBUG] [LOCAL ] BIO: Loaded 25004 existing records from primary storage. [2025-09-29T22:05:46.954739] [INFO ] [MAIN ] BIO: Loaded 25004 primary data records. [2025-09-29T22:05:47.123924] [DEBUG] [LOCAL ] BILL: Loaded 52329 existing records from primary storage. [2025-09-29T22:05:47.149271] [INFO ] [MAIN ] BILL: Loaded 52329 primary data records. [2025-09-29T22:05:47.397474] [DEBUG] [LOCAL ] BIP: Loaded 39545 existing records from primary storage. [2025-09-29T22:05:47.403537] [INFO ] [MAIN ] BIP: Loaded 39545 primary data records. [2025-09-29T22:05:48.073986] [DEBUG] [MAIN ] BIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:48.075309] [INFO ] [MAIN ] BIO: Generated 1794 derivative records from 25004 primary records. [2025-09-29T22:05:48.075597] [DEBUG] [LOCAL ] BIO: Saving derivative data. [2025-09-29T22:05:48.111316] [DEBUG] [MAIN ] BILL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:48.113205] [INFO ] [MAIN ] BILL: Generated 1794 derivative records from 52329 primary records. [2025-09-29T22:05:48.113933] [DEBUG] [LOCAL ] BILL: Saving derivative data. [2025-09-29T22:05:48.130846] [DEBUG] [LOCAL ] BIO: Derivative data saved (1794 records). [2025-09-29T22:05:48.133635] [DEBUG] [LOCAL ] BILL: Derivative data saved (1794 records). [2025-09-29T22:05:48.133871] [INFO ] [MAIN ] BILL: Successfully saved derivative data. [2025-09-29T22:05:48.133803] [INFO ] [MAIN ] BIO: Successfully saved derivative data. [2025-09-29T22:05:48.136015] [INFO ] [MAIN ] Derivative Progress: 214/2057 symbols completed. BILL took 1.2s. Estimated remaining: 12m 36s. Rate: 146.2 symbols/min [2025-09-29T22:05:48.151406] [INFO ] [MAIN ] Derivative Progress: 215/2057 symbols completed. BIO took 1.2s. Estimated remaining: 12m 32s. Rate: 146.9 symbols/min [2025-09-29T22:05:48.151227] [INFO ] [MAIN ] BIPH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:48.151842] [INFO ] [MAIN ] BIPI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:48.151728] [DEBUG] [MAIN ] BIP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:48.153341] [INFO ] [MAIN ] BIP: Generated 1794 derivative records from 39545 primary records. [2025-09-29T22:05:48.153413] [DEBUG] [LOCAL ] BIP: Saving derivative data. [2025-09-29T22:05:48.172178] [DEBUG] [LOCAL ] BIP: Derivative data saved (1794 records). [2025-09-29T22:05:48.175219] [DEBUG] [LOCAL ] BIPH: Loaded 2572 existing records from primary storage. [2025-09-29T22:05:48.177360] [DEBUG] [LOCAL ] BIPI: Loaded 3221 existing records from primary storage. [2025-09-29T22:05:48.177574] [INFO ] [MAIN ] BIP: Successfully saved derivative data. [2025-09-29T22:05:48.177726] [INFO ] [MAIN ] BIPH: Loaded 2572 primary data records. [2025-09-29T22:05:48.177834] [INFO ] [MAIN ] BIPI: Loaded 3221 primary data records. [2025-09-29T22:05:48.185058] [INFO ] [MAIN ] Derivative Progress: 216/2057 symbols completed. BIP took 1.3s. Estimated remaining: 12m 29s. Rate: 147.5 symbols/min [2025-09-29T22:05:48.191753] [INFO ] [MAIN ] BIPJ: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:48.406601] [DEBUG] [LOCAL ] BIPJ: Loaded 3022 existing records from primary storage. [2025-09-29T22:05:48.428278] [INFO ] [MAIN ] BIPJ: Loaded 3022 primary data records. [2025-09-29T22:05:49.205303] [DEBUG] [MAIN ] BIPH: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:05:49.206686] [INFO ] [MAIN ] BIPH: Generated 1793 derivative records from 2572 primary records. [2025-09-29T22:05:49.207491] [DEBUG] [LOCAL ] BIPH: Saving derivative data. [2025-09-29T22:05:49.207383] [DEBUG] [MAIN ] BIPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:49.220431] [INFO ] [MAIN ] BIPI: Generated 1794 derivative records from 3221 primary records. [2025-09-29T22:05:49.224747] [DEBUG] [LOCAL ] BIPH: Derivative data saved (1793 records). [2025-09-29T22:05:49.226545] [DEBUG] [LOCAL ] BIPI: Saving derivative data. [2025-09-29T22:05:49.225897] [INFO ] [MAIN ] BIPH: Successfully saved derivative data. [2025-09-29T22:05:49.228866] [INFO ] [MAIN ] Derivative Progress: 217/2057 symbols completed. BIPH took 1.1s. Estimated remaining: 12m 34s. Rate: 146.5 symbols/min [2025-09-29T22:05:49.230847] [INFO ] [MAIN ] BIRK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:49.259899] [DEBUG] [LOCAL ] BIPI: Derivative data saved (1794 records). [2025-09-29T22:05:49.259406] [DEBUG] [MAIN ] BIPJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:49.260156] [INFO ] [MAIN ] BIPI: Successfully saved derivative data. [2025-09-29T22:05:49.262393] [INFO ] [MAIN ] Derivative Progress: 218/2057 symbols completed. BIPI took 1.1s. Estimated remaining: 12m 30s. Rate: 147.1 symbols/min [2025-09-29T22:05:49.263430] [INFO ] [MAIN ] BIPJ: Generated 1794 derivative records from 3022 primary records. [2025-09-29T22:05:49.263695] [DEBUG] [LOCAL ] BIPJ: Saving derivative data. [2025-09-29T22:05:49.263808] [INFO ] [MAIN ] BIT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:49.279743] [DEBUG] [LOCAL ] BIPJ: Derivative data saved (1794 records). [2025-09-29T22:05:49.280053] [INFO ] [MAIN ] BIPJ: Successfully saved derivative data. [2025-09-29T22:05:49.282410] [INFO ] [MAIN ] Derivative Progress: 219/2057 symbols completed. BIPJ took 1.1s. Estimated remaining: 12m 27s. Rate: 147.7 symbols/min [2025-09-29T22:05:49.282710] [INFO ] [MAIN ] BK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:49.318048] [DEBUG] [LOCAL ] BIT: Loaded 22570 existing records from primary storage. [2025-09-29T22:05:49.318448] [INFO ] [MAIN ] BIT: Loaded 22570 primary data records. [2025-09-29T22:05:49.466525] [DEBUG] [LOCAL ] BIRK: Loaded 50899 existing records from primary storage. [2025-09-29T22:05:49.481759] [INFO ] [MAIN ] BIRK: Loaded 50899 primary data records. [2025-09-29T22:05:49.697858] [DEBUG] [LOCAL ] BK: Loaded 53539 existing records from primary storage. [2025-09-29T22:05:49.823916] [INFO ] [MAIN ] BK: Loaded 53539 primary data records. [2025-09-29T22:05:50.432952] [DEBUG] [MAIN ] BIT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:50.435343] [INFO ] [MAIN ] BIT: Generated 1794 derivative records from 22570 primary records. [2025-09-29T22:05:50.435591] [DEBUG] [LOCAL ] BIT: Saving derivative data. [2025-09-29T22:05:50.465970] [DEBUG] [MAIN ] BIRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:50.466727] [INFO ] [MAIN ] BIRK: Generated 1794 derivative records from 50899 primary records. [2025-09-29T22:05:50.466903] [DEBUG] [LOCAL ] BIRK: Saving derivative data. [2025-09-29T22:05:50.465667] [DEBUG] [LOCAL ] BIT: Derivative data saved (1794 records). [2025-09-29T22:05:50.467519] [INFO ] [MAIN ] BIT: Successfully saved derivative data. [2025-09-29T22:05:50.470190] [INFO ] [MAIN ] Derivative Progress: 220/2057 symbols completed. BIT took 1.2s. Estimated remaining: 12m 33s. Rate: 146.4 symbols/min [2025-09-29T22:05:50.481502] [INFO ] [MAIN ] BKD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:50.488501] [DEBUG] [LOCAL ] BIRK: Derivative data saved (1794 records). [2025-09-29T22:05:50.489603] [INFO ] [MAIN ] BIRK: Successfully saved derivative data. [2025-09-29T22:05:50.492626] [INFO ] [MAIN ] Derivative Progress: 221/2057 symbols completed. BIRK took 1.3s. Estimated remaining: 12m 29s. Rate: 147.1 symbols/min [2025-09-29T22:05:50.493128] [INFO ] [MAIN ] BKE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:50.508065] [DEBUG] [MAIN ] BK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:50.508987] [INFO ] [MAIN ] BK: Generated 1794 derivative records from 53539 primary records. [2025-09-29T22:05:50.509159] [DEBUG] [LOCAL ] BK: Saving derivative data. [2025-09-29T22:05:50.529056] [DEBUG] [LOCAL ] BK: Derivative data saved (1794 records). [2025-09-29T22:05:50.529235] [INFO ] [MAIN ] BK: Successfully saved derivative data. [2025-09-29T22:05:50.531506] [INFO ] [MAIN ] Derivative Progress: 222/2057 symbols completed. BK took 1.2s. Estimated remaining: 12m 26s. Rate: 147.7 symbols/min [2025-09-29T22:05:50.531928] [INFO ] [MAIN ] BKH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:50.570243] [DEBUG] [LOCAL ] BKE: Loaded 34611 existing records from primary storage. [2025-09-29T22:05:50.570609] [INFO ] [MAIN ] BKE: Loaded 34611 primary data records. [2025-09-29T22:05:50.612709] [DEBUG] [LOCAL ] BKD: Loaded 50182 existing records from primary storage. [2025-09-29T22:05:50.625535] [INFO ] [MAIN ] BKD: Loaded 50182 primary data records. [2025-09-29T22:05:50.825963] [DEBUG] [LOCAL ] BKH: Loaded 36557 existing records from primary storage. [2025-09-29T22:05:50.846761] [INFO ] [MAIN ] BKH: Loaded 36557 primary data records. [2025-09-29T22:05:51.631358] [DEBUG] [MAIN ] BKD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:51.633262] [INFO ] [MAIN ] BKD: Generated 1794 derivative records from 50182 primary records. [2025-09-29T22:05:51.635432] [DEBUG] [LOCAL ] BKD: Saving derivative data. [2025-09-29T22:05:51.668212] [DEBUG] [LOCAL ] BKD: Derivative data saved (1794 records). [2025-09-29T22:05:51.663523] [DEBUG] [MAIN ] BKE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:51.669334] [INFO ] [MAIN ] BKD: Successfully saved derivative data. [2025-09-29T22:05:51.669249] [INFO ] [MAIN ] BKE: Generated 1794 derivative records from 34611 primary records. [2025-09-29T22:05:51.672013] [INFO ] [MAIN ] Derivative Progress: 223/2057 symbols completed. BKD took 1.2s. Estimated remaining: 12m 31s. Rate: 146.5 symbols/min [2025-09-29T22:05:51.672579] [DEBUG] [LOCAL ] BKE: Saving derivative data. [2025-09-29T22:05:51.692151] [DEBUG] [LOCAL ] BKE: Derivative data saved (1794 records). [2025-09-29T22:05:51.692352] [INFO ] [MAIN ] BKE: Successfully saved derivative data. [2025-09-29T22:05:51.694617] [INFO ] [MAIN ] Derivative Progress: 224/2057 symbols completed. BKE took 1.2s. Estimated remaining: 12m 28s. Rate: 147.1 symbols/min [2025-09-29T22:05:51.713574] [DEBUG] [MAIN ] BKH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:51.714421] [INFO ] [MAIN ] BKH: Generated 1794 derivative records from 36557 primary records. [2025-09-29T22:05:51.714494] [DEBUG] [LOCAL ] BKH: Saving derivative data. [2025-09-29T22:05:51.730265] [DEBUG] [LOCAL ] BKH: Derivative data saved (1794 records). [2025-09-29T22:05:51.730360] [INFO ] [MAIN ] BKH: Successfully saved derivative data. [2025-09-29T22:05:51.733774] [INFO ] [MAIN ] Derivative Progress: 225/2057 symbols completed. BKH took 1.2s. Estimated remaining: 12m 24s. Rate: 147.7 symbols/min [2025-09-29T22:05:51.734577] [INFO ] [MAIN ] BKN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:51.734854] [INFO ] [MAIN ] BKSY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:51.734469] [INFO ] [MAIN ] BKKT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:51.749293] [DEBUG] [LOCAL ] BKN: Loaded 7759 existing records from primary storage. [2025-09-29T22:05:51.749590] [INFO ] [MAIN ] BKN: Loaded 7759 primary data records. [2025-09-29T22:05:52.004044] [DEBUG] [LOCAL ] BKKT: Loaded 34818 existing records from primary storage. [2025-09-29T22:05:52.123531] [INFO ] [MAIN ] BKKT: Loaded 34818 primary data records. [2025-09-29T22:05:52.161016] [DEBUG] [LOCAL ] BKSY: Loaded 48195 existing records from primary storage. [2025-09-29T22:05:52.186120] [INFO ] [MAIN ] BKSY: Loaded 48195 primary data records. [2025-09-29T22:05:52.858885] [DEBUG] [MAIN ] BKN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:52.861039] [INFO ] [MAIN ] BKN: Generated 1794 derivative records from 7759 primary records. [2025-09-29T22:05:52.861374] [DEBUG] [LOCAL ] BKN: Saving derivative data. [2025-09-29T22:05:52.880631] [DEBUG] [LOCAL ] BKN: Derivative data saved (1794 records). [2025-09-29T22:05:52.881256] [INFO ] [MAIN ] BKN: Successfully saved derivative data. [2025-09-29T22:05:52.884080] [INFO ] [MAIN ] Derivative Progress: 226/2057 symbols completed. BKN took 1.1s. Estimated remaining: 12m 30s. Rate: 146.5 symbols/min [2025-09-29T22:05:52.885022] [INFO ] [MAIN ] BKT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:52.918688] [DEBUG] [LOCAL ] BKT: Loaded 11191 existing records from primary storage. [2025-09-29T22:05:52.919136] [DEBUG] [MAIN ] BKKT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:52.920313] [INFO ] [MAIN ] BKKT: Generated 1794 derivative records from 34818 primary records. [2025-09-29T22:05:52.920421] [INFO ] [MAIN ] BKT: Loaded 11191 primary data records. [2025-09-29T22:05:52.928574] [DEBUG] [LOCAL ] BKKT: Saving derivative data. [2025-09-29T22:05:52.947201] [DEBUG] [MAIN ] BKSY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:52.999126] [INFO ] [MAIN ] BKSY: Generated 1794 derivative records from 48195 primary records. [2025-09-29T22:05:53.012857] [DEBUG] [LOCAL ] BKSY: Saving derivative data. [2025-09-29T22:05:53.117420] [DEBUG] [LOCAL ] BKKT: Derivative data saved (1794 records). [2025-09-29T22:05:53.135496] [INFO ] [MAIN ] BKKT: Successfully saved derivative data. [2025-09-29T22:05:53.146806] [DEBUG] [LOCAL ] BKSY: Derivative data saved (1794 records). [2025-09-29T22:05:53.149257] [INFO ] [MAIN ] Derivative Progress: 227/2057 symbols completed. BKKT took 1.4s. Estimated remaining: 12m 28s. Rate: 146.7 symbols/min [2025-09-29T22:05:53.176504] [INFO ] [MAIN ] BKSY: Successfully saved derivative data. [2025-09-29T22:05:53.299197] [INFO ] [MAIN ] BKU: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:53.316908] [INFO ] [MAIN ] Derivative Progress: 228/2057 symbols completed. BKSY took 1.6s. Estimated remaining: 12m 26s. Rate: 147.1 symbols/min [2025-09-29T22:05:53.318001] [INFO ] [MAIN ] BKV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:53.381410] [DEBUG] [LOCAL ] BKV: Loaded 29665 existing records from primary storage. [2025-09-29T22:05:53.380741] [DEBUG] [MAIN ] BKT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:53.381873] [INFO ] [MAIN ] BKV: Loaded 29665 primary data records. [2025-09-29T22:05:53.382794] [INFO ] [MAIN ] BKT: Generated 1794 derivative records from 11191 primary records. [2025-09-29T22:05:53.383127] [DEBUG] [LOCAL ] BKT: Saving derivative data. [2025-09-29T22:05:53.513523] [DEBUG] [LOCAL ] BKT: Derivative data saved (1794 records). [2025-09-29T22:05:53.527118] [INFO ] [MAIN ] BKT: Successfully saved derivative data. [2025-09-29T22:05:53.528095] [DEBUG] [LOCAL ] BKU: Loaded 41557 existing records from primary storage. [2025-09-29T22:05:53.530863] [INFO ] [MAIN ] Derivative Progress: 229/2057 symbols completed. BKT took 0.6s. Estimated remaining: 12m 24s. Rate: 147.4 symbols/min [2025-09-29T22:05:53.531070] [INFO ] [MAIN ] BLCO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:53.528253] [INFO ] [MAIN ] BKU: Loaded 41557 primary data records. [2025-09-29T22:05:54.034598] [DEBUG] [LOCAL ] BLCO: Loaded 35418 existing records from primary storage. [2025-09-29T22:05:54.035373] [INFO ] [MAIN ] BLCO: Loaded 35418 primary data records. [2025-09-29T22:05:54.562381] [DEBUG] [MAIN ] BKV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:54.563437] [INFO ] [MAIN ] BKV: Generated 1794 derivative records from 29665 primary records. [2025-09-29T22:05:54.563762] [DEBUG] [LOCAL ] BKV: Saving derivative data. [2025-09-29T22:05:54.587755] [DEBUG] [LOCAL ] BKV: Derivative data saved (1794 records). [2025-09-29T22:05:54.587973] [INFO ] [MAIN ] BKV: Successfully saved derivative data. [2025-09-29T22:05:54.603047] [INFO ] [MAIN ] Derivative Progress: 230/2057 symbols completed. BKV took 1.3s. Estimated remaining: 12m 29s. Rate: 146.4 symbols/min [2025-09-29T22:05:54.605371] [DEBUG] [MAIN ] BKU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:54.605077] [INFO ] [MAIN ] BLD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:54.606789] [INFO ] [MAIN ] BKU: Generated 1794 derivative records from 41557 primary records. [2025-09-29T22:05:54.606929] [DEBUG] [LOCAL ] BKU: Saving derivative data. [2025-09-29T22:05:54.627485] [DEBUG] [LOCAL ] BKU: Derivative data saved (1794 records). [2025-09-29T22:05:54.627833] [INFO ] [MAIN ] BKU: Successfully saved derivative data. [2025-09-29T22:05:54.631001] [INFO ] [MAIN ] Derivative Progress: 231/2057 symbols completed. BKU took 1.3s. Estimated remaining: 12m 25s. Rate: 147.0 symbols/min [2025-09-29T22:05:54.631739] [INFO ] [MAIN ] BLDR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:54.658067] [DEBUG] [MAIN ] BLCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:54.658910] [INFO ] [MAIN ] BLCO: Generated 1794 derivative records from 35418 primary records. [2025-09-29T22:05:54.659131] [DEBUG] [LOCAL ] BLCO: Saving derivative data. [2025-09-29T22:05:54.681470] [DEBUG] [LOCAL ] BLD: Loaded 27802 existing records from primary storage. [2025-09-29T22:05:54.683513] [INFO ] [MAIN ] BLD: Loaded 27802 primary data records. [2025-09-29T22:05:54.691702] [DEBUG] [LOCAL ] BLCO: Derivative data saved (1794 records). [2025-09-29T22:05:54.704233] [INFO ] [MAIN ] BLCO: Successfully saved derivative data. [2025-09-29T22:05:54.707303] [INFO ] [MAIN ] Derivative Progress: 232/2057 symbols completed. BLCO took 1.2s. Estimated remaining: 12m 22s. Rate: 147.5 symbols/min [2025-09-29T22:05:54.718434] [INFO ] [MAIN ] BLE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:54.909461] [DEBUG] [LOCAL ] BLE: Loaded 14424 existing records from primary storage. [2025-09-29T22:05:54.915395] [INFO ] [MAIN ] BLE: Loaded 14424 primary data records. [2025-09-29T22:05:55.104364] [DEBUG] [LOCAL ] BLDR: Loaded 51635 existing records from primary storage. [2025-09-29T22:05:55.154978] [INFO ] [MAIN ] BLDR: Loaded 51635 primary data records. [2025-09-29T22:05:55.735233] [DEBUG] [MAIN ] BLD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:55.739149] [INFO ] [MAIN ] BLD: Generated 1794 derivative records from 27802 primary records. [2025-09-29T22:05:55.739364] [DEBUG] [LOCAL ] BLD: Saving derivative data. [2025-09-29T22:05:55.771986] [DEBUG] [MAIN ] BLE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:55.776475] [DEBUG] [LOCAL ] BLD: Derivative data saved (1794 records). [2025-09-29T22:05:55.777960] [INFO ] [MAIN ] BLE: Generated 1794 derivative records from 14424 primary records. [2025-09-29T22:05:55.778231] [INFO ] [MAIN ] BLD: Successfully saved derivative data. [2025-09-29T22:05:55.781300] [INFO ] [MAIN ] Derivative Progress: 233/2057 symbols completed. BLD took 1.2s. Estimated remaining: 12m 27s. Rate: 146.5 symbols/min [2025-09-29T22:05:55.781712] [DEBUG] [LOCAL ] BLE: Saving derivative data. [2025-09-29T22:05:55.781904] [INFO ] [MAIN ] BLK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:55.801867] [DEBUG] [LOCAL ] BLE: Derivative data saved (1794 records). [2025-09-29T22:05:55.802232] [INFO ] [MAIN ] BLE: Successfully saved derivative data. [2025-09-29T22:05:55.804592] [INFO ] [MAIN ] Derivative Progress: 234/2057 symbols completed. BLE took 1.1s. Estimated remaining: 12m 24s. Rate: 147.0 symbols/min [2025-09-29T22:05:55.807016] [INFO ] [MAIN ] BLND: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:55.823772] [DEBUG] [MAIN ] BLDR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:55.824942] [INFO ] [MAIN ] BLDR: Generated 1794 derivative records from 51635 primary records. [2025-09-29T22:05:55.825211] [DEBUG] [LOCAL ] BLDR: Saving derivative data. [2025-09-29T22:05:55.844233] [DEBUG] [LOCAL ] BLDR: Derivative data saved (1794 records). [2025-09-29T22:05:55.844335] [INFO ] [MAIN ] BLDR: Successfully saved derivative data. [2025-09-29T22:05:55.847804] [INFO ] [MAIN ] Derivative Progress: 235/2057 symbols completed. BLDR took 1.2s. Estimated remaining: 12m 21s. Rate: 147.6 symbols/min [2025-09-29T22:05:55.848203] [INFO ] [MAIN ] BLW: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:55.885005] [DEBUG] [LOCAL ] BLK: Loaded 34520 existing records from primary storage. [2025-09-29T22:05:55.898452] [INFO ] [MAIN ] BLK: Loaded 34520 primary data records. [2025-09-29T22:05:55.958535] [DEBUG] [LOCAL ] BLW: Loaded 12943 existing records from primary storage. [2025-09-29T22:05:55.994815] [INFO ] [MAIN ] BLW: Loaded 12943 primary data records. [2025-09-29T22:05:56.067720] [DEBUG] [LOCAL ] BLND: Loaded 49330 existing records from primary storage. [2025-09-29T22:05:56.085747] [INFO ] [MAIN ] BLND: Loaded 49330 primary data records. [2025-09-29T22:05:57.022636] [DEBUG] [MAIN ] BLK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:57.023769] [INFO ] [MAIN ] BLK: Generated 1794 derivative records from 34520 primary records. [2025-09-29T22:05:57.023996] [DEBUG] [LOCAL ] BLK: Saving derivative data. [2025-09-29T22:05:57.061278] [DEBUG] [MAIN ] BLND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:57.066138] [DEBUG] [LOCAL ] BLK: Derivative data saved (1794 records). [2025-09-29T22:05:57.067716] [INFO ] [MAIN ] BLND: Generated 1794 derivative records from 49330 primary records. [2025-09-29T22:05:57.067987] [DEBUG] [LOCAL ] BLND: Saving derivative data. [2025-09-29T22:05:57.068195] [INFO ] [MAIN ] BLK: Successfully saved derivative data. [2025-09-29T22:05:57.079538] [INFO ] [MAIN ] Derivative Progress: 236/2057 symbols completed. BLK took 1.3s. Estimated remaining: 12m 27s. Rate: 146.4 symbols/min [2025-09-29T22:05:57.080097] [INFO ] [MAIN ] BLX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:57.098933] [DEBUG] [MAIN ] BLW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:57.103383] [DEBUG] [LOCAL ] BLND: Derivative data saved (1794 records). [2025-09-29T22:05:57.103774] [INFO ] [MAIN ] BLND: Successfully saved derivative data. [2025-09-29T22:05:57.108268] [INFO ] [MAIN ] BLW: Generated 1794 derivative records from 12943 primary records. [2025-09-29T22:05:57.106946] [INFO ] [MAIN ] Derivative Progress: 237/2057 symbols completed. BLND took 1.3s. Estimated remaining: 12m 23s. Rate: 146.9 symbols/min [2025-09-29T22:05:57.108787] [DEBUG] [LOCAL ] BLW: Saving derivative data. [2025-09-29T22:05:57.108616] [INFO ] [MAIN ] BMA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:57.141090] [DEBUG] [LOCAL ] BLX: Loaded 15569 existing records from primary storage. [2025-09-29T22:05:57.143821] [DEBUG] [LOCAL ] BLW: Derivative data saved (1794 records). [2025-09-29T22:05:57.144309] [INFO ] [MAIN ] BLW: Successfully saved derivative data. [2025-09-29T22:05:57.148280] [INFO ] [MAIN ] Derivative Progress: 238/2057 symbols completed. BLW took 1.3s. Estimated remaining: 12m 20s. Rate: 147.5 symbols/min [2025-09-29T22:05:57.148710] [INFO ] [MAIN ] BLX: Loaded 15569 primary data records. [2025-09-29T22:05:57.492171] [DEBUG] [LOCAL ] BMA: Loaded 35091 existing records from primary storage. [2025-09-29T22:05:57.493250] [INFO ] [MAIN ] BMA: Loaded 35091 primary data records. [2025-09-29T22:05:57.883138] [DEBUG] [MAIN ] BLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:57.884830] [INFO ] [MAIN ] BLX: Generated 1794 derivative records from 15569 primary records. [2025-09-29T22:05:57.884908] [DEBUG] [LOCAL ] BLX: Saving derivative data. [2025-09-29T22:05:57.906306] [DEBUG] [LOCAL ] BLX: Derivative data saved (1794 records). [2025-09-29T22:05:57.906689] [INFO ] [MAIN ] BLX: Successfully saved derivative data. [2025-09-29T22:05:57.909478] [INFO ] [MAIN ] Derivative Progress: 239/2057 symbols completed. BLX took 0.8s. Estimated remaining: 12m 22s. Rate: 146.9 symbols/min [2025-09-29T22:05:57.927964] [DEBUG] [MAIN ] BMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:57.928907] [INFO ] [MAIN ] BMA: Generated 1794 derivative records from 35091 primary records. [2025-09-29T22:05:57.928981] [DEBUG] [LOCAL ] BMA: Saving derivative data. [2025-09-29T22:05:57.945087] [DEBUG] [LOCAL ] BMA: Derivative data saved (1794 records). [2025-09-29T22:05:57.945149] [INFO ] [MAIN ] BMA: Successfully saved derivative data. [2025-09-29T22:05:57.948249] [INFO ] [MAIN ] Derivative Progress: 240/2057 symbols completed. BMA took 0.8s. Estimated remaining: 12m 19s. Rate: 147.5 symbols/min [2025-09-29T22:05:57.948985] [INFO ] [MAIN ] BME: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:57.948886] [INFO ] [MAIN ] BMEZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:57.949679] [INFO ] [MAIN ] BMI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:57.962845] [DEBUG] [LOCAL ] BME: Loaded 10831 existing records from primary storage. [2025-09-29T22:05:57.963084] [INFO ] [MAIN ] BME: Loaded 10831 primary data records. [2025-09-29T22:05:58.152772] [DEBUG] [LOCAL ] BMEZ: Loaded 26001 existing records from primary storage. [2025-09-29T22:05:58.188439] [INFO ] [MAIN ] BMEZ: Loaded 26001 primary data records. [2025-09-29T22:05:58.321785] [DEBUG] [LOCAL ] BMI: Loaded 24272 existing records from primary storage. [2025-09-29T22:05:58.350156] [INFO ] [MAIN ] BMI: Loaded 24272 primary data records. [2025-09-29T22:05:59.066566] [DEBUG] [MAIN ] BME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:59.068052] [INFO ] [MAIN ] BME: Generated 1794 derivative records from 10831 primary records. [2025-09-29T22:05:59.068831] [DEBUG] [LOCAL ] BME: Saving derivative data. [2025-09-29T22:05:59.101349] [DEBUG] [MAIN ] BMEZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:59.102890] [INFO ] [MAIN ] BMEZ: Generated 1794 derivative records from 26001 primary records. [2025-09-29T22:05:59.103365] [DEBUG] [LOCAL ] BMEZ: Saving derivative data. [2025-09-29T22:05:59.118354] [DEBUG] [LOCAL ] BME: Derivative data saved (1794 records). [2025-09-29T22:05:59.120444] [INFO ] [MAIN ] BME: Successfully saved derivative data. [2025-09-29T22:05:59.122832] [INFO ] [MAIN ] Derivative Progress: 241/2057 symbols completed. BME took 1.2s. Estimated remaining: 12m 24s. Rate: 146.4 symbols/min [2025-09-29T22:05:59.124610] [INFO ] [MAIN ] BMN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:59.126983] [DEBUG] [LOCAL ] BMEZ: Derivative data saved (1794 records). [2025-09-29T22:05:59.128928] [INFO ] [MAIN ] BMEZ: Successfully saved derivative data. [2025-09-29T22:05:59.131748] [INFO ] [MAIN ] Derivative Progress: 242/2057 symbols completed. BMEZ took 1.2s. Estimated remaining: 12m 21s. Rate: 147.0 symbols/min [2025-09-29T22:05:59.132610] [INFO ] [MAIN ] BMO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:59.147694] [DEBUG] [MAIN ] BMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:05:59.151308] [INFO ] [MAIN ] BMI: Generated 1794 derivative records from 24272 primary records. [2025-09-29T22:05:59.151504] [DEBUG] [LOCAL ] BMI: Saving derivative data. [2025-09-29T22:05:59.150341] [DEBUG] [LOCAL ] BMN: Loaded 2561 existing records from primary storage. [2025-09-29T22:05:59.152363] [INFO ] [MAIN ] BMN: Loaded 2561 primary data records. [2025-09-29T22:05:59.295799] [DEBUG] [LOCAL ] BMI: Derivative data saved (1794 records). [2025-09-29T22:05:59.316764] [INFO ] [MAIN ] BMI: Successfully saved derivative data. [2025-09-29T22:05:59.334373] [INFO ] [MAIN ] Derivative Progress: 243/2057 symbols completed. BMI took 1.4s. Estimated remaining: 12m 19s. Rate: 147.3 symbols/min [2025-09-29T22:05:59.344248] [INFO ] [MAIN ] BMY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:05:59.515443] [DEBUG] [LOCAL ] BMO: Loaded 41236 existing records from primary storage. [2025-09-29T22:05:59.515832] [INFO ] [MAIN ] BMO: Loaded 41236 primary data records. [2025-09-29T22:05:59.918230] [DEBUG] [LOCAL ] BMY: Loaded 53757 existing records from primary storage. [2025-09-29T22:05:59.919557] [INFO ] [MAIN ] BMY: Loaded 53757 primary data records. [2025-09-29T22:06:00.003688] [DEBUG] [MAIN ] BMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:00.017992] [INFO ] [MAIN ] BMN: Generated 1794 derivative records from 2561 primary records. [2025-09-29T22:06:00.036695] [DEBUG] [LOCAL ] BMN: Saving derivative data. [2025-09-29T22:06:00.282370] [DEBUG] [LOCAL ] BMN: Derivative data saved (1794 records). [2025-09-29T22:06:00.283058] [INFO ] [MAIN ] BMN: Successfully saved derivative data. [2025-09-29T22:06:00.287925] [INFO ] [MAIN ] Derivative Progress: 244/2057 symbols completed. BMN took 1.2s. Estimated remaining: 12m 23s. Rate: 146.5 symbols/min [2025-09-29T22:06:00.289383] [INFO ] [MAIN ] BN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:00.305704] [DEBUG] [MAIN ] BMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:00.307895] [INFO ] [MAIN ] BMO: Generated 1794 derivative records from 41236 primary records. [2025-09-29T22:06:00.308179] [DEBUG] [LOCAL ] BMO: Saving derivative data. [2025-09-29T22:06:00.329636] [DEBUG] [LOCAL ] BMO: Derivative data saved (1794 records). [2025-09-29T22:06:00.329908] [INFO ] [MAIN ] BMO: Successfully saved derivative data. [2025-09-29T22:06:00.332319] [INFO ] [MAIN ] Derivative Progress: 245/2057 symbols completed. BMO took 1.2s. Estimated remaining: 12m 20s. Rate: 147.0 symbols/min [2025-09-29T22:06:00.333077] [INFO ] [MAIN ] BNED: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:00.365493] [DEBUG] [MAIN ] BMY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:00.369800] [INFO ] [MAIN ] BMY: Generated 1794 derivative records from 53757 primary records. [2025-09-29T22:06:00.370233] [DEBUG] [LOCAL ] BMY: Saving derivative data. [2025-09-29T22:06:00.396830] [DEBUG] [LOCAL ] BMY: Derivative data saved (1794 records). [2025-09-29T22:06:00.397128] [INFO ] [MAIN ] BMY: Successfully saved derivative data. [2025-09-29T22:06:00.399467] [INFO ] [MAIN ] Derivative Progress: 246/2057 symbols completed. BMY took 1.1s. Estimated remaining: 12m 17s. Rate: 147.5 symbols/min [2025-09-29T22:06:00.414501] [INFO ] [MAIN ] BNH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:00.417681] [DEBUG] [LOCAL ] BN: Loaded 52993 existing records from primary storage. [2025-09-29T22:06:00.417854] [INFO ] [MAIN ] BN: Loaded 52993 primary data records. [2025-09-29T22:06:00.533151] [DEBUG] [LOCAL ] BNED: Loaded 29579 existing records from primary storage. [2025-09-29T22:06:00.548229] [INFO ] [MAIN ] BNED: Loaded 29579 primary data records. [2025-09-29T22:06:00.548468] [DEBUG] [LOCAL ] BNH: Loaded 4916 existing records from primary storage. [2025-09-29T22:06:00.593564] [INFO ] [MAIN ] BNH: Loaded 4916 primary data records. [2025-09-29T22:06:01.617922] [DEBUG] [MAIN ] BN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:01.620541] [INFO ] [MAIN ] BN: Generated 1794 derivative records from 52993 primary records. [2025-09-29T22:06:01.621186] [DEBUG] [LOCAL ] BN: Saving derivative data. [2025-09-29T22:06:01.695779] [DEBUG] [MAIN ] BNH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:01.698522] [DEBUG] [LOCAL ] BN: Derivative data saved (1794 records). [2025-09-29T22:06:01.699008] [INFO ] [MAIN ] BN: Successfully saved derivative data. [2025-09-29T22:06:01.717587] [INFO ] [MAIN ] Derivative Progress: 247/2057 symbols completed. BN took 1.4s. Estimated remaining: 12m 23s. Rate: 146.2 symbols/min [2025-09-29T22:06:01.700426] [INFO ] [MAIN ] BNH: Generated 1794 derivative records from 4916 primary records. [2025-09-29T22:06:01.718515] [DEBUG] [LOCAL ] BNH: Saving derivative data. [2025-09-29T22:06:01.718219] [INFO ] [MAIN ] BNJ: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:01.734802] [DEBUG] [MAIN ] BNED: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:01.740970] [INFO ] [MAIN ] BNED: Generated 1794 derivative records from 29579 primary records. [2025-09-29T22:06:01.746308] [DEBUG] [LOCAL ] BNED: Saving derivative data. [2025-09-29T22:06:01.768624] [DEBUG] [LOCAL ] BNH: Derivative data saved (1794 records). [2025-09-29T22:06:01.769237] [INFO ] [MAIN ] BNH: Successfully saved derivative data. [2025-09-29T22:06:01.773217] [INFO ] [MAIN ] Derivative Progress: 248/2057 symbols completed. BNH took 1.4s. Estimated remaining: 12m 20s. Rate: 146.7 symbols/min [2025-09-29T22:06:01.778800] [INFO ] [MAIN ] BNL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:01.778273] [DEBUG] [LOCAL ] BNJ: Loaded 2582 existing records from primary storage. [2025-09-29T22:06:01.787369] [INFO ] [MAIN ] BNJ: Loaded 2582 primary data records. [2025-09-29T22:06:01.796772] [DEBUG] [LOCAL ] BNED: Derivative data saved (1794 records). [2025-09-29T22:06:01.797187] [INFO ] [MAIN ] BNED: Successfully saved derivative data. [2025-09-29T22:06:01.801910] [INFO ] [MAIN ] Derivative Progress: 249/2057 symbols completed. BNED took 1.5s. Estimated remaining: 12m 17s. Rate: 147.2 symbols/min [2025-09-29T22:06:01.822483] [INFO ] [MAIN ] BNS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:02.005953] [DEBUG] [LOCAL ] BNS: Loaded 51439 existing records from primary storage. [2025-09-29T22:06:02.006386] [INFO ] [MAIN ] BNS: Loaded 51439 primary data records. [2025-09-29T22:06:02.186526] [DEBUG] [LOCAL ] BNL: Loaded 46846 existing records from primary storage. [2025-09-29T22:06:02.244099] [INFO ] [MAIN ] BNL: Loaded 46846 primary data records. [2025-09-29T22:06:03.042191] [DEBUG] [MAIN ] BNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:03.043075] [INFO ] [MAIN ] BNS: Generated 1794 derivative records from 51439 primary records. [2025-09-29T22:06:03.043296] [DEBUG] [LOCAL ] BNS: Saving derivative data. [2025-09-29T22:06:03.041899] [DEBUG] [MAIN ] BNJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:03.046210] [INFO ] [MAIN ] BNJ: Generated 1794 derivative records from 2582 primary records. [2025-09-29T22:06:03.054587] [DEBUG] [LOCAL ] BNJ: Saving derivative data. [2025-09-29T22:06:03.092538] [DEBUG] [LOCAL ] BNS: Derivative data saved (1794 records). [2025-09-29T22:06:03.094943] [INFO ] [MAIN ] BNS: Successfully saved derivative data. [2025-09-29T22:06:03.095345] [DEBUG] [MAIN ] BNL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:03.097995] [INFO ] [MAIN ] Derivative Progress: 250/2057 symbols completed. BNS took 1.3s. Estimated remaining: 12m 23s. Rate: 146.0 symbols/min [2025-09-29T22:06:03.098129] [DEBUG] [LOCAL ] BNJ: Derivative data saved (1794 records). [2025-09-29T22:06:03.098580] [INFO ] [MAIN ] BNT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:03.098781] [INFO ] [MAIN ] BNJ: Successfully saved derivative data. [2025-09-29T22:06:03.101855] [INFO ] [MAIN ] Derivative Progress: 251/2057 symbols completed. BNJ took 1.4s. Estimated remaining: 12m 20s. Rate: 146.5 symbols/min [2025-09-29T22:06:03.099773] [INFO ] [MAIN ] BNL: Generated 1794 derivative records from 46846 primary records. [2025-09-29T22:06:03.102394] [INFO ] [MAIN ] BNY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:03.102566] [DEBUG] [LOCAL ] BNL: Saving derivative data. [2025-09-29T22:06:03.120947] [DEBUG] [LOCAL ] BNT: Loaded 3382 existing records from primary storage. [2025-09-29T22:06:03.123522] [INFO ] [MAIN ] BNT: Loaded 3382 primary data records. [2025-09-29T22:06:03.171744] [DEBUG] [LOCAL ] BNL: Derivative data saved (1794 records). [2025-09-29T22:06:03.172334] [INFO ] [MAIN ] BNL: Successfully saved derivative data. [2025-09-29T22:06:03.172125] [DEBUG] [LOCAL ] BNY: Loaded 7148 existing records from primary storage. [2025-09-29T22:06:03.182837] [INFO ] [MAIN ] Derivative Progress: 252/2057 symbols completed. BNL took 1.4s. Estimated remaining: 12m 17s. Rate: 147.0 symbols/min [2025-09-29T22:06:03.203294] [INFO ] [MAIN ] BNY: Loaded 7148 primary data records. [2025-09-29T22:06:03.195935] [INFO ] [MAIN ] BOC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:03.496729] [DEBUG] [LOCAL ] BOC: Loaded 18267 existing records from primary storage. [2025-09-29T22:06:03.687981] [INFO ] [MAIN ] BOC: Loaded 18267 primary data records. [2025-09-29T22:06:04.200575] [DEBUG] [MAIN ] BNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:04.201111] [DEBUG] [MAIN ] BNY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:04.204538] [INFO ] [MAIN ] BNY: Generated 1794 derivative records from 7148 primary records. [2025-09-29T22:06:04.204790] [DEBUG] [LOCAL ] BNY: Saving derivative data. [2025-09-29T22:06:04.203592] [INFO ] [MAIN ] BNT: Generated 1794 derivative records from 3382 primary records. [2025-09-29T22:06:04.206281] [DEBUG] [LOCAL ] BNT: Saving derivative data. [2025-09-29T22:06:04.237546] [DEBUG] [LOCAL ] BNY: Derivative data saved (1794 records). [2025-09-29T22:06:04.239670] [INFO ] [MAIN ] BNY: Successfully saved derivative data. [2025-09-29T22:06:04.241581] [DEBUG] [LOCAL ] BNT: Derivative data saved (1794 records). [2025-09-29T22:06:04.244907] [INFO ] [MAIN ] Derivative Progress: 253/2057 symbols completed. BNY took 1.1s. Estimated remaining: 12m 21s. Rate: 146.1 symbols/min [2025-09-29T22:06:04.245276] [INFO ] [MAIN ] BNT: Successfully saved derivative data. [2025-09-29T22:06:04.248083] [INFO ] [MAIN ] Derivative Progress: 254/2057 symbols completed. BNT took 1.1s. Estimated remaining: 12m 18s. Rate: 146.6 symbols/min [2025-09-29T22:06:04.264059] [DEBUG] [MAIN ] BOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:04.264740] [INFO ] [MAIN ] BOC: Generated 1794 derivative records from 18267 primary records. [2025-09-29T22:06:04.264810] [DEBUG] [LOCAL ] BOC: Saving derivative data. [2025-09-29T22:06:04.281419] [DEBUG] [LOCAL ] BOC: Derivative data saved (1794 records). [2025-09-29T22:06:04.281511] [INFO ] [MAIN ] BOC: Successfully saved derivative data. [2025-09-29T22:06:04.284170] [INFO ] [MAIN ] Derivative Progress: 255/2057 symbols completed. BOC took 1.1s. Estimated remaining: 12m 15s. Rate: 147.2 symbols/min [2025-09-29T22:06:04.284820] [INFO ] [MAIN ] BOND: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:04.284993] [INFO ] [MAIN ] BOE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:04.285136] [INFO ] [MAIN ] BOH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:04.327950] [DEBUG] [LOCAL ] BOE: Loaded 17601 existing records from primary storage. [2025-09-29T22:06:04.328232] [INFO ] [MAIN ] BOE: Loaded 17601 primary data records. [2025-09-29T22:06:04.444172] [DEBUG] [LOCAL ] BOH: Loaded 30949 existing records from primary storage. [2025-09-29T22:06:04.477580] [INFO ] [MAIN ] BOH: Loaded 30949 primary data records. [2025-09-29T22:06:04.477476] [DEBUG] [LOCAL ] BOND: Loaded 32075 existing records from primary storage. [2025-09-29T22:06:04.477798] [INFO ] [MAIN ] BOND: Loaded 32075 primary data records. [2025-09-29T22:06:05.392509] [DEBUG] [MAIN ] BOE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:05.393889] [INFO ] [MAIN ] BOE: Generated 1794 derivative records from 17601 primary records. [2025-09-29T22:06:05.394302] [DEBUG] [LOCAL ] BOE: Saving derivative data. [2025-09-29T22:06:05.415773] [DEBUG] [LOCAL ] BOE: Derivative data saved (1794 records). [2025-09-29T22:06:05.417880] [INFO ] [MAIN ] BOE: Successfully saved derivative data. [2025-09-29T22:06:05.433283] [INFO ] [MAIN ] Derivative Progress: 256/2057 symbols completed. BOE took 1.1s. Estimated remaining: 12m 19s. Rate: 146.1 symbols/min [2025-09-29T22:06:05.433988] [INFO ] [MAIN ] BOOT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:05.434388] [DEBUG] [MAIN ] BOND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:05.449117] [INFO ] [MAIN ] BOND: Generated 1794 derivative records from 32075 primary records. [2025-09-29T22:06:05.449488] [DEBUG] [MAIN ] BOH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:05.450041] [DEBUG] [LOCAL ] BOND: Saving derivative data. [2025-09-29T22:06:05.450877] [INFO ] [MAIN ] BOH: Generated 1794 derivative records from 30949 primary records. [2025-09-29T22:06:05.450972] [DEBUG] [LOCAL ] BOH: Saving derivative data. [2025-09-29T22:06:05.484124] [DEBUG] [LOCAL ] BOND: Derivative data saved (1794 records). [2025-09-29T22:06:05.485813] [INFO ] [MAIN ] BOND: Successfully saved derivative data. [2025-09-29T22:06:05.488260] [INFO ] [MAIN ] Derivative Progress: 257/2057 symbols completed. BOND took 1.2s. Estimated remaining: 12m 17s. Rate: 146.6 symbols/min [2025-09-29T22:06:05.488659] [INFO ] [MAIN ] BORR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:05.488434] [DEBUG] [LOCAL ] BOH: Derivative data saved (1794 records). [2025-09-29T22:06:05.489401] [INFO ] [MAIN ] BOH: Successfully saved derivative data. [2025-09-29T22:06:05.491799] [INFO ] [MAIN ] Derivative Progress: 258/2057 symbols completed. BOH took 1.2s. Estimated remaining: 12m 13s. Rate: 147.2 symbols/min [2025-09-29T22:06:05.492226] [INFO ] [MAIN ] BOW: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:05.530530] [DEBUG] [LOCAL ] BOOT: Loaded 40631 existing records from primary storage. [2025-09-29T22:06:05.530786] [INFO ] [MAIN ] BOOT: Loaded 40631 primary data records. [2025-09-29T22:06:05.627934] [DEBUG] [LOCAL ] BOW: Loaded 23476 existing records from primary storage. [2025-09-29T22:06:05.633874] [INFO ] [MAIN ] BOW: Loaded 23476 primary data records. [2025-09-29T22:06:05.823523] [DEBUG] [LOCAL ] BORR: Loaded 51131 existing records from primary storage. [2025-09-29T22:06:05.895139] [INFO ] [MAIN ] BORR: Loaded 51131 primary data records. [2025-09-29T22:06:06.679624] [DEBUG] [MAIN ] BOOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:06.682418] [INFO ] [MAIN ] BOOT: Generated 1794 derivative records from 40631 primary records. [2025-09-29T22:06:06.682620] [DEBUG] [LOCAL ] BOOT: Saving derivative data. [2025-09-29T22:06:06.708468] [DEBUG] [MAIN ] BOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:06.712736] [INFO ] [MAIN ] BOW: Generated 1794 derivative records from 23476 primary records. [2025-09-29T22:06:06.712882] [DEBUG] [LOCAL ] BOW: Saving derivative data. [2025-09-29T22:06:06.714085] [DEBUG] [LOCAL ] BOOT: Derivative data saved (1794 records). [2025-09-29T22:06:06.714359] [INFO ] [MAIN ] BOOT: Successfully saved derivative data. [2025-09-29T22:06:06.727143] [INFO ] [MAIN ] Derivative Progress: 259/2057 symbols completed. BOOT took 1.3s. Estimated remaining: 12m 19s. Rate: 146.0 symbols/min [2025-09-29T22:06:06.731369] [INFO ] [MAIN ] BOX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:06.736464] [DEBUG] [LOCAL ] BOW: Derivative data saved (1794 records). [2025-09-29T22:06:06.749338] [INFO ] [MAIN ] BOW: Successfully saved derivative data. [2025-09-29T22:06:06.749883] [DEBUG] [MAIN ] BORR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:06.750709] [INFO ] [MAIN ] BORR: Generated 1794 derivative records from 51131 primary records. [2025-09-29T22:06:06.752964] [DEBUG] [LOCAL ] BORR: Saving derivative data. [2025-09-29T22:06:06.752887] [INFO ] [MAIN ] Derivative Progress: 260/2057 symbols completed. BOW took 1.3s. Estimated remaining: 12m 16s. Rate: 146.6 symbols/min [2025-09-29T22:06:06.753180] [INFO ] [MAIN ] BP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:06.774156] [DEBUG] [LOCAL ] BORR: Derivative data saved (1794 records). [2025-09-29T22:06:06.774427] [INFO ] [MAIN ] BORR: Successfully saved derivative data. [2025-09-29T22:06:06.777687] [INFO ] [MAIN ] Derivative Progress: 261/2057 symbols completed. BORR took 1.3s. Estimated remaining: 12m 13s. Rate: 147.1 symbols/min [2025-09-29T22:06:06.778002] [INFO ] [MAIN ] BR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:06.828399] [DEBUG] [LOCAL ] BOX: Loaded 50244 existing records from primary storage. [2025-09-29T22:06:06.828673] [INFO ] [MAIN ] BOX: Loaded 50244 primary data records. [2025-09-29T22:06:06.949230] [DEBUG] [LOCAL ] BP: Loaded 53711 existing records from primary storage. [2025-09-29T22:06:06.982833] [INFO ] [MAIN ] BP: Loaded 53711 primary data records. [2025-09-29T22:06:06.991261] [DEBUG] [LOCAL ] BR: Loaded 34585 existing records from primary storage. [2025-09-29T22:06:07.034688] [INFO ] [MAIN ] BR: Loaded 34585 primary data records. [2025-09-29T22:06:07.970777] [DEBUG] [MAIN ] BOX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:07.971865] [INFO ] [MAIN ] BOX: Generated 1794 derivative records from 50244 primary records. [2025-09-29T22:06:07.972170] [DEBUG] [LOCAL ] BOX: Saving derivative data. [2025-09-29T22:06:08.010310] [DEBUG] [LOCAL ] BOX: Derivative data saved (1794 records). [2025-09-29T22:06:08.010974] [DEBUG] [MAIN ] BP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:08.011161] [INFO ] [MAIN ] BOX: Successfully saved derivative data. [2025-09-29T22:06:08.014177] [INFO ] [MAIN ] BP: Generated 1794 derivative records from 53711 primary records. [2025-09-29T22:06:08.013216] [INFO ] [MAIN ] Derivative Progress: 262/2057 symbols completed. BOX took 1.3s. Estimated remaining: 12m 18s. Rate: 146.0 symbols/min [2025-09-29T22:06:08.014383] [DEBUG] [LOCAL ] BP: Saving derivative data. [2025-09-29T22:06:08.015695] [INFO ] [MAIN ] BRBR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:08.048881] [DEBUG] [MAIN ] BR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:08.049810] [INFO ] [MAIN ] BR: Generated 1794 derivative records from 34585 primary records. [2025-09-29T22:06:08.048632] [DEBUG] [LOCAL ] BP: Derivative data saved (1794 records). [2025-09-29T22:06:08.050045] [INFO ] [MAIN ] BP: Successfully saved derivative data. [2025-09-29T22:06:08.049981] [DEBUG] [LOCAL ] BR: Saving derivative data. [2025-09-29T22:06:08.052285] [INFO ] [MAIN ] Derivative Progress: 263/2057 symbols completed. BP took 1.3s. Estimated remaining: 12m 15s. Rate: 146.5 symbols/min [2025-09-29T22:06:08.053429] [INFO ] [MAIN ] BRC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:08.072671] [DEBUG] [LOCAL ] BR: Derivative data saved (1794 records). [2025-09-29T22:06:08.072838] [INFO ] [MAIN ] BR: Successfully saved derivative data. [2025-09-29T22:06:08.075319] [INFO ] [MAIN ] Derivative Progress: 264/2057 symbols completed. BR took 1.3s. Estimated remaining: 12m 12s. Rate: 147.0 symbols/min [2025-09-29T22:06:08.075539] [INFO ] [MAIN ] BRCC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:08.102208] [DEBUG] [LOCAL ] BRC: Loaded 19180 existing records from primary storage. [2025-09-29T22:06:08.102339] [INFO ] [MAIN ] BRC: Loaded 19180 primary data records. [2025-09-29T22:06:08.231055] [DEBUG] [LOCAL ] BRBR: Loaded 51250 existing records from primary storage. [2025-09-29T22:06:08.257329] [INFO ] [MAIN ] BRBR: Loaded 51250 primary data records. [2025-09-29T22:06:08.519440] [DEBUG] [LOCAL ] BRCC: Loaded 40218 existing records from primary storage. [2025-09-29T22:06:08.547215] [INFO ] [MAIN ] BRCC: Loaded 40218 primary data records. [2025-09-29T22:06:09.183483] [DEBUG] [MAIN ] BRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:09.184764] [INFO ] [MAIN ] BRC: Generated 1794 derivative records from 19180 primary records. [2025-09-29T22:06:09.185285] [DEBUG] [LOCAL ] BRC: Saving derivative data. [2025-09-29T22:06:09.209398] [DEBUG] [LOCAL ] BRC: Derivative data saved (1794 records). [2025-09-29T22:06:09.223372] [INFO ] [MAIN ] BRC: Successfully saved derivative data. [2025-09-29T22:06:09.223823] [DEBUG] [MAIN ] BRBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:09.224627] [INFO ] [MAIN ] BRBR: Generated 1794 derivative records from 51250 primary records. [2025-09-29T22:06:09.226722] [INFO ] [MAIN ] Derivative Progress: 265/2057 symbols completed. BRC took 1.2s. Estimated remaining: 12m 16s. Rate: 146.0 symbols/min [2025-09-29T22:06:09.226858] [DEBUG] [LOCAL ] BRBR: Saving derivative data. [2025-09-29T22:06:09.227582] [INFO ] [MAIN ] BRO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:09.248500] [DEBUG] [LOCAL ] BRBR: Derivative data saved (1794 records). [2025-09-29T22:06:09.248722] [INFO ] [MAIN ] BRBR: Successfully saved derivative data. [2025-09-29T22:06:09.251342] [INFO ] [MAIN ] Derivative Progress: 266/2057 symbols completed. BRBR took 1.2s. Estimated remaining: 12m 13s. Rate: 146.5 symbols/min [2025-09-29T22:06:09.251678] [INFO ] [MAIN ] BROS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:09.266627] [DEBUG] [MAIN ] BRCC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:09.267730] [INFO ] [MAIN ] BRCC: Generated 1794 derivative records from 40218 primary records. [2025-09-29T22:06:09.267875] [DEBUG] [LOCAL ] BRCC: Saving derivative data. [2025-09-29T22:06:09.286759] [DEBUG] [LOCAL ] BRCC: Derivative data saved (1794 records). [2025-09-29T22:06:09.287107] [INFO ] [MAIN ] BRCC: Successfully saved derivative data. [2025-09-29T22:06:09.289418] [INFO ] [MAIN ] Derivative Progress: 267/2057 symbols completed. BRCC took 1.2s. Estimated remaining: 12m 11s. Rate: 147.0 symbols/min [2025-09-29T22:06:09.289888] [INFO ] [MAIN ] BRSP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:09.356377] [DEBUG] [LOCAL ] BRO: Loaded 51890 existing records from primary storage. [2025-09-29T22:06:09.377864] [INFO ] [MAIN ] BRO: Loaded 51890 primary data records. [2025-09-29T22:06:09.380268] [DEBUG] [LOCAL ] BROS: Loaded 53289 existing records from primary storage. [2025-09-29T22:06:09.385743] [INFO ] [MAIN ] BROS: Loaded 53289 primary data records. [2025-09-29T22:06:09.564447] [DEBUG] [LOCAL ] BRSP: Loaded 36849 existing records from primary storage. [2025-09-29T22:06:09.612750] [INFO ] [MAIN ] BRSP: Loaded 36849 primary data records. [2025-09-29T22:06:10.501154] [DEBUG] [MAIN ] BRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:10.500836] [DEBUG] [MAIN ] BROS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:10.502774] [INFO ] [MAIN ] BROS: Generated 1794 derivative records from 53289 primary records. [2025-09-29T22:06:10.502138] [INFO ] [MAIN ] BRO: Generated 1794 derivative records from 51890 primary records. [2025-09-29T22:06:10.502913] [DEBUG] [LOCAL ] BROS: Saving derivative data. [2025-09-29T22:06:10.503096] [DEBUG] [LOCAL ] BRO: Saving derivative data. [2025-09-29T22:06:10.544339] [DEBUG] [LOCAL ] BROS: Derivative data saved (1794 records). [2025-09-29T22:06:10.550835] [INFO ] [MAIN ] BROS: Successfully saved derivative data. [2025-09-29T22:06:10.553631] [INFO ] [MAIN ] Derivative Progress: 268/2057 symbols completed. BROS took 1.3s. Estimated remaining: 12m 16s. Rate: 145.9 symbols/min [2025-09-29T22:06:10.551174] [DEBUG] [MAIN ] BRSP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:10.555689] [INFO ] [MAIN ] BRSP: Generated 1794 derivative records from 36849 primary records. [2025-09-29T22:06:10.556015] [DEBUG] [LOCAL ] BRSP: Saving derivative data. [2025-09-29T22:06:10.572265] [DEBUG] [LOCAL ] BRO: Derivative data saved (1794 records). [2025-09-29T22:06:10.572777] [INFO ] [MAIN ] BRO: Successfully saved derivative data. [2025-09-29T22:06:10.575076] [INFO ] [MAIN ] Derivative Progress: 269/2057 symbols completed. BRO took 1.3s. Estimated remaining: 12m 13s. Rate: 146.4 symbols/min [2025-09-29T22:06:10.577107] [DEBUG] [LOCAL ] BRSP: Derivative data saved (1794 records). [2025-09-29T22:06:10.577179] [INFO ] [MAIN ] BRSP: Successfully saved derivative data. [2025-09-29T22:06:10.579560] [INFO ] [MAIN ] Derivative Progress: 270/2057 symbols completed. BRSP took 1.3s. Estimated remaining: 12m 10s. Rate: 146.9 symbols/min [2025-09-29T22:06:10.580085] [INFO ] [MAIN ] BRT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:10.580147] [INFO ] [MAIN ] BRW: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:10.580256] [INFO ] [MAIN ] BRX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:10.589766] [DEBUG] [LOCAL ] BRT: Loaded 4966 existing records from primary storage. [2025-09-29T22:06:10.589972] [INFO ] [MAIN ] BRT: Loaded 4966 primary data records. [2025-09-29T22:06:10.710829] [DEBUG] [LOCAL ] BRW: Loaded 19790 existing records from primary storage. [2025-09-29T22:06:10.711082] [INFO ] [MAIN ] BRW: Loaded 19790 primary data records. [2025-09-29T22:06:11.134471] [DEBUG] [LOCAL ] BRX: Loaded 51703 existing records from primary storage. [2025-09-29T22:06:11.164684] [INFO ] [MAIN ] BRX: Loaded 51703 primary data records. [2025-09-29T22:06:11.663460] [DEBUG] [MAIN ] BRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:11.665594] [INFO ] [MAIN ] BRT: Generated 1794 derivative records from 4966 primary records. [2025-09-29T22:06:11.666429] [DEBUG] [LOCAL ] BRT: Saving derivative data. [2025-09-29T22:06:11.681833] [DEBUG] [MAIN ] BRW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:11.683241] [INFO ] [MAIN ] BRW: Generated 1794 derivative records from 19790 primary records. [2025-09-29T22:06:11.691382] [DEBUG] [LOCAL ] BRW: Saving derivative data. [2025-09-29T22:06:11.713111] [DEBUG] [LOCAL ] BRT: Derivative data saved (1794 records). [2025-09-29T22:06:11.714817] [INFO ] [MAIN ] BRT: Successfully saved derivative data. [2025-09-29T22:06:11.719161] [INFO ] [MAIN ] Derivative Progress: 271/2057 symbols completed. BRT took 1.1s. Estimated remaining: 12m 14s. Rate: 146.0 symbols/min [2025-09-29T22:06:11.720502] [INFO ] [MAIN ] BSAC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:11.721525] [DEBUG] [LOCAL ] BRW: Derivative data saved (1794 records). [2025-09-29T22:06:11.721965] [INFO ] [MAIN ] BRW: Successfully saved derivative data. [2025-09-29T22:06:11.725062] [INFO ] [MAIN ] Derivative Progress: 272/2057 symbols completed. BRW took 1.1s. Estimated remaining: 12m 11s. Rate: 146.5 symbols/min [2025-09-29T22:06:11.725591] [INFO ] [MAIN ] BSBR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:11.747131] [DEBUG] [MAIN ] BRX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:11.748090] [INFO ] [MAIN ] BRX: Generated 1794 derivative records from 51703 primary records. [2025-09-29T22:06:11.748319] [DEBUG] [LOCAL ] BRX: Saving derivative data. [2025-09-29T22:06:11.786988] [DEBUG] [LOCAL ] BRX: Derivative data saved (1794 records). [2025-09-29T22:06:11.787156] [INFO ] [MAIN ] BRX: Successfully saved derivative data. [2025-09-29T22:06:11.789601] [INFO ] [MAIN ] Derivative Progress: 273/2057 symbols completed. BRX took 1.2s. Estimated remaining: 12m 8s. Rate: 147.0 symbols/min [2025-09-29T22:06:11.790009] [INFO ] [MAIN ] BSL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:11.804236] [DEBUG] [LOCAL ] BSAC: Loaded 32849 existing records from primary storage. [2025-09-29T22:06:11.815054] [INFO ] [MAIN ] BSAC: Loaded 32849 primary data records. [2025-09-29T22:06:11.852611] [DEBUG] [LOCAL ] BSBR: Loaded 35252 existing records from primary storage. [2025-09-29T22:06:11.865638] [INFO ] [MAIN ] BSBR: Loaded 35252 primary data records. [2025-09-29T22:06:11.916020] [DEBUG] [LOCAL ] BSL: Loaded 8156 existing records from primary storage. [2025-09-29T22:06:11.961284] [INFO ] [MAIN ] BSL: Loaded 8156 primary data records. [2025-09-29T22:06:12.949723] [DEBUG] [MAIN ] BSBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:12.950080] [DEBUG] [MAIN ] BSAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:12.951073] [INFO ] [MAIN ] BSBR: Generated 1794 derivative records from 35252 primary records. [2025-09-29T22:06:12.952075] [INFO ] [MAIN ] BSAC: Generated 1794 derivative records from 32849 primary records. [2025-09-29T22:06:12.951345] [DEBUG] [LOCAL ] BSBR: Saving derivative data. [2025-09-29T22:06:12.955501] [DEBUG] [LOCAL ] BSAC: Saving derivative data. [2025-09-29T22:06:12.996282] [DEBUG] [MAIN ] BSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:12.997606] [DEBUG] [LOCAL ] BSBR: Derivative data saved (1794 records). [2025-09-29T22:06:13.000951] [INFO ] [MAIN ] BSBR: Successfully saved derivative data. [2025-09-29T22:06:12.998382] [INFO ] [MAIN ] BSL: Generated 1794 derivative records from 8156 primary records. [2025-09-29T22:06:13.002221] [DEBUG] [LOCAL ] BSL: Saving derivative data. [2025-09-29T22:06:13.003571] [DEBUG] [LOCAL ] BSAC: Derivative data saved (1794 records). [2025-09-29T22:06:13.006759] [INFO ] [MAIN ] BSAC: Successfully saved derivative data. [2025-09-29T22:06:13.006492] [INFO ] [MAIN ] Derivative Progress: 274/2057 symbols completed. BSBR took 1.3s. Estimated remaining: 12m 13s. Rate: 145.9 symbols/min [2025-09-29T22:06:13.009909] [INFO ] [MAIN ] BSM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:13.009990] [INFO ] [MAIN ] Derivative Progress: 275/2057 symbols completed. BSAC took 1.3s. Estimated remaining: 12m 10s. Rate: 146.4 symbols/min [2025-09-29T22:06:13.021513] [INFO ] [MAIN ] BST: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:13.026403] [DEBUG] [LOCAL ] BSL: Derivative data saved (1794 records). [2025-09-29T22:06:13.026471] [INFO ] [MAIN ] BSL: Successfully saved derivative data. [2025-09-29T22:06:13.029298] [INFO ] [MAIN ] Derivative Progress: 276/2057 symbols completed. BSL took 1.2s. Estimated remaining: 12m 7s. Rate: 146.9 symbols/min [2025-09-29T22:06:13.029733] [INFO ] [MAIN ] BSTZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:13.062371] [DEBUG] [LOCAL ] BST: Loaded 18957 existing records from primary storage. [2025-09-29T22:06:13.062923] [INFO ] [MAIN ] BST: Loaded 18957 primary data records. [2025-09-29T22:06:13.179627] [DEBUG] [LOCAL ] BSTZ: Loaded 24704 existing records from primary storage. [2025-09-29T22:06:13.179844] [INFO ] [MAIN ] BSTZ: Loaded 24704 primary data records. [2025-09-29T22:06:13.227133] [DEBUG] [LOCAL ] BSM: Loaded 32184 existing records from primary storage. [2025-09-29T22:06:13.245691] [INFO ] [MAIN ] BSM: Loaded 32184 primary data records. [2025-09-29T22:06:14.100448] [DEBUG] [MAIN ] BST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:14.101341] [INFO ] [MAIN ] BST: Generated 1794 derivative records from 18957 primary records. [2025-09-29T22:06:14.101540] [DEBUG] [LOCAL ] BST: Saving derivative data. [2025-09-29T22:06:14.122137] [DEBUG] [LOCAL ] BST: Derivative data saved (1794 records). [2025-09-29T22:06:14.123363] [INFO ] [MAIN ] BST: Successfully saved derivative data. [2025-09-29T22:06:14.126329] [INFO ] [MAIN ] Derivative Progress: 277/2057 symbols completed. BST took 1.1s. Estimated remaining: 12m 11s. Rate: 146.0 symbols/min [2025-09-29T22:06:14.127064] [INFO ] [MAIN ] BSX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:14.143375] [DEBUG] [MAIN ] BSTZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:14.157817] [INFO ] [MAIN ] BSTZ: Generated 1794 derivative records from 24704 primary records. [2025-09-29T22:06:14.158214] [DEBUG] [LOCAL ] BSTZ: Saving derivative data. [2025-09-29T22:06:14.159339] [DEBUG] [MAIN ] BSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:14.171936] [INFO ] [MAIN ] BSM: Generated 1794 derivative records from 32184 primary records. [2025-09-29T22:06:14.172132] [DEBUG] [LOCAL ] BSM: Saving derivative data. [2025-09-29T22:06:14.185185] [DEBUG] [LOCAL ] BSTZ: Derivative data saved (1794 records). [2025-09-29T22:06:14.190197] [INFO ] [MAIN ] BSTZ: Successfully saved derivative data. [2025-09-29T22:06:14.193333] [INFO ] [MAIN ] Derivative Progress: 278/2057 symbols completed. BSTZ took 1.2s. Estimated remaining: 12m 9s. Rate: 146.5 symbols/min [2025-09-29T22:06:14.193826] [INFO ] [MAIN ] BTA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:14.198761] [DEBUG] [LOCAL ] BSM: Derivative data saved (1794 records). [2025-09-29T22:06:14.199075] [INFO ] [MAIN ] BSM: Successfully saved derivative data. [2025-09-29T22:06:14.203466] [INFO ] [MAIN ] Derivative Progress: 279/2057 symbols completed. BSM took 1.2s. Estimated remaining: 12m 6s. Rate: 147.0 symbols/min [2025-09-29T22:06:14.203760] [INFO ] [MAIN ] BTCM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:14.208155] [DEBUG] [LOCAL ] BTA: Loaded 5413 existing records from primary storage. [2025-09-29T22:06:14.208330] [INFO ] [MAIN ] BTA: Loaded 5413 primary data records. [2025-09-29T22:06:14.390911] [DEBUG] [LOCAL ] BTCM: Loaded 15156 existing records from primary storage. [2025-09-29T22:06:14.448702] [INFO ] [MAIN ] BTCM: Loaded 15156 primary data records. [2025-09-29T22:06:14.449795] [DEBUG] [LOCAL ] BSX: Loaded 53688 existing records from primary storage. [2025-09-29T22:06:14.490819] [INFO ] [MAIN ] BSX: Loaded 53688 primary data records. [2025-09-29T22:06:15.317346] [DEBUG] [MAIN ] BTA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:15.318353] [INFO ] [MAIN ] BTA: Generated 1794 derivative records from 5413 primary records. [2025-09-29T22:06:15.321507] [DEBUG] [LOCAL ] BTA: Saving derivative data. [2025-09-29T22:06:15.352018] [DEBUG] [MAIN ] BTCM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:15.359568] [INFO ] [MAIN ] BTCM: Generated 1794 derivative records from 15156 primary records. [2025-09-29T22:06:15.359821] [DEBUG] [LOCAL ] BTCM: Saving derivative data. [2025-09-29T22:06:15.359716] [DEBUG] [LOCAL ] BTA: Derivative data saved (1794 records). [2025-09-29T22:06:15.360786] [INFO ] [MAIN ] BTA: Successfully saved derivative data. [2025-09-29T22:06:15.363966] [INFO ] [MAIN ] Derivative Progress: 280/2057 symbols completed. BTA took 1.2s. Estimated remaining: 12m 10s. Rate: 146.0 symbols/min [2025-09-29T22:06:15.373045] [INFO ] [MAIN ] BTE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:15.394431] [DEBUG] [MAIN ] BSX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:15.396632] [INFO ] [MAIN ] BSX: Generated 1794 derivative records from 53688 primary records. [2025-09-29T22:06:15.397433] [DEBUG] [LOCAL ] BTCM: Derivative data saved (1794 records). [2025-09-29T22:06:15.397536] [INFO ] [MAIN ] BTCM: Successfully saved derivative data. [2025-09-29T22:06:15.397601] [DEBUG] [LOCAL ] BSX: Saving derivative data. [2025-09-29T22:06:15.400068] [INFO ] [MAIN ] Derivative Progress: 281/2057 symbols completed. BTCM took 1.2s. Estimated remaining: 12m 7s. Rate: 146.5 symbols/min [2025-09-29T22:06:15.401198] [INFO ] [MAIN ] BTI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:15.418606] [DEBUG] [LOCAL ] BSX: Derivative data saved (1794 records). [2025-09-29T22:06:15.418799] [INFO ] [MAIN ] BSX: Successfully saved derivative data. [2025-09-29T22:06:15.421618] [INFO ] [MAIN ] Derivative Progress: 282/2057 symbols completed. BSX took 1.3s. Estimated remaining: 12m 4s. Rate: 147.0 symbols/min [2025-09-29T22:06:15.421944] [INFO ] [MAIN ] BTO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:15.434823] [DEBUG] [LOCAL ] BTO: Loaded 8806 existing records from primary storage. [2025-09-29T22:06:15.435000] [INFO ] [MAIN ] BTO: Loaded 8806 primary data records. [2025-09-29T22:06:15.635559] [DEBUG] [LOCAL ] BTE: Loaded 52726 existing records from primary storage. [2025-09-29T22:06:15.676746] [INFO ] [MAIN ] BTE: Loaded 52726 primary data records. [2025-09-29T22:06:15.863987] [DEBUG] [LOCAL ] BTI: Loaded 53554 existing records from primary storage. [2025-09-29T22:06:15.884355] [INFO ] [MAIN ] BTI: Loaded 53554 primary data records. [2025-09-29T22:06:16.606722] [DEBUG] [MAIN ] BTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:16.608290] [INFO ] [MAIN ] BTO: Generated 1794 derivative records from 8806 primary records. [2025-09-29T22:06:16.608733] [DEBUG] [LOCAL ] BTO: Saving derivative data. [2025-09-29T22:06:16.639104] [DEBUG] [LOCAL ] BTO: Derivative data saved (1794 records). [2025-09-29T22:06:16.639385] [INFO ] [MAIN ] BTO: Successfully saved derivative data. [2025-09-29T22:06:16.642451] [INFO ] [MAIN ] Derivative Progress: 283/2057 symbols completed. BTO took 1.2s. Estimated remaining: 12m 9s. Rate: 146.0 symbols/min [2025-09-29T22:06:16.661966] [DEBUG] [MAIN ] BTE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:16.663912] [INFO ] [MAIN ] BTE: Generated 1794 derivative records from 52726 primary records. [2025-09-29T22:06:16.664865] [DEBUG] [LOCAL ] BTE: Saving derivative data. [2025-09-29T22:06:16.692940] [DEBUG] [MAIN ] BTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:16.697458] [INFO ] [MAIN ] BTI: Generated 1794 derivative records from 53554 primary records. [2025-09-29T22:06:16.697547] [DEBUG] [LOCAL ] BTI: Saving derivative data. [2025-09-29T22:06:16.696702] [DEBUG] [LOCAL ] BTE: Derivative data saved (1794 records). [2025-09-29T22:06:16.698140] [INFO ] [MAIN ] BTE: Successfully saved derivative data. [2025-09-29T22:06:16.700450] [INFO ] [MAIN ] Derivative Progress: 284/2057 symbols completed. BTE took 1.3s. Estimated remaining: 12m 7s. Rate: 146.4 symbols/min [2025-09-29T22:06:16.716949] [DEBUG] [LOCAL ] BTI: Derivative data saved (1794 records). [2025-09-29T22:06:16.717053] [INFO ] [MAIN ] BTI: Successfully saved derivative data. [2025-09-29T22:06:16.719364] [INFO ] [MAIN ] Derivative Progress: 285/2057 symbols completed. BTI took 1.3s. Estimated remaining: 12m 4s. Rate: 146.9 symbols/min [2025-09-29T22:06:16.720130] [INFO ] [MAIN ] BTZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:16.720344] [INFO ] [MAIN ] BUD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:16.720035] [INFO ] [MAIN ] BTU: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:16.748529] [DEBUG] [LOCAL ] BTZ: Loaded 22647 existing records from primary storage. [2025-09-29T22:06:16.748898] [INFO ] [MAIN ] BTZ: Loaded 22647 primary data records. [2025-09-29T22:06:16.986252] [DEBUG] [LOCAL ] BUD: Loaded 52720 existing records from primary storage. [2025-09-29T22:06:17.013274] [INFO ] [MAIN ] BUD: Loaded 52720 primary data records. [2025-09-29T22:06:17.135135] [DEBUG] [LOCAL ] BTU: Loaded 53306 existing records from primary storage. [2025-09-29T22:06:17.147746] [INFO ] [MAIN ] BTU: Loaded 53306 primary data records. [2025-09-29T22:06:17.842763] [DEBUG] [MAIN ] BTZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:17.844418] [INFO ] [MAIN ] BTZ: Generated 1794 derivative records from 22647 primary records. [2025-09-29T22:06:17.845282] [DEBUG] [LOCAL ] BTZ: Saving derivative data. [2025-09-29T22:06:17.875639] [DEBUG] [LOCAL ] BTZ: Derivative data saved (1794 records). [2025-09-29T22:06:17.881627] [DEBUG] [MAIN ] BUD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:17.882624] [INFO ] [MAIN ] BUD: Generated 1794 derivative records from 52720 primary records. [2025-09-29T22:06:17.881128] [INFO ] [MAIN ] BTZ: Successfully saved derivative data. [2025-09-29T22:06:17.885451] [INFO ] [MAIN ] Derivative Progress: 286/2057 symbols completed. BTZ took 1.2s. Estimated remaining: 12m 8s. Rate: 146.0 symbols/min [2025-09-29T22:06:17.885570] [DEBUG] [LOCAL ] BUD: Saving derivative data. [2025-09-29T22:06:17.887139] [INFO ] [MAIN ] BUI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:17.911512] [DEBUG] [LOCAL ] BUD: Derivative data saved (1794 records). [2025-09-29T22:06:17.912150] [INFO ] [MAIN ] BUD: Successfully saved derivative data. [2025-09-29T22:06:17.933697] [DEBUG] [MAIN ] BTU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:17.937406] [INFO ] [MAIN ] BTU: Generated 1794 derivative records from 53306 primary records. [2025-09-29T22:06:17.937975] [DEBUG] [LOCAL ] BUI: Loaded 11526 existing records from primary storage. [2025-09-29T22:06:17.936217] [INFO ] [MAIN ] Derivative Progress: 287/2057 symbols completed. BUD took 1.2s. Estimated remaining: 12m 5s. Rate: 146.4 symbols/min [2025-09-29T22:06:17.938153] [INFO ] [MAIN ] BUI: Loaded 11526 primary data records. [2025-09-29T22:06:17.943558] [DEBUG] [LOCAL ] BTU: Saving derivative data. [2025-09-29T22:06:17.943486] [INFO ] [MAIN ] BURL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:18.086314] [DEBUG] [LOCAL ] BTU: Derivative data saved (1794 records). [2025-09-29T22:06:18.103627] [INFO ] [MAIN ] BTU: Successfully saved derivative data. [2025-09-29T22:06:18.129175] [INFO ] [MAIN ] Derivative Progress: 288/2057 symbols completed. BTU took 1.4s. Estimated remaining: 12m 4s. Rate: 146.7 symbols/min [2025-09-29T22:06:18.186878] [INFO ] [MAIN ] BUXX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:18.332571] [DEBUG] [LOCAL ] BURL: Loaded 46116 existing records from primary storage. [2025-09-29T22:06:18.333609] [INFO ] [MAIN ] BURL: Loaded 46116 primary data records. [2025-09-29T22:06:18.456570] [DEBUG] [LOCAL ] BUXX: Loaded 15148 existing records from primary storage. [2025-09-29T22:06:18.460748] [INFO ] [MAIN ] BUXX: Loaded 15148 primary data records. [2025-09-29T22:06:18.938798] [DEBUG] [MAIN ] BUI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:19.127899] [INFO ] [MAIN ] BUI: Generated 1794 derivative records from 11526 primary records. [2025-09-29T22:06:19.128194] [DEBUG] [LOCAL ] BUI: Saving derivative data. [2025-09-29T22:06:19.150159] [DEBUG] [LOCAL ] BUI: Derivative data saved (1794 records). [2025-09-29T22:06:19.150498] [INFO ] [MAIN ] BUI: Successfully saved derivative data. [2025-09-29T22:06:19.153863] [INFO ] [MAIN ] Derivative Progress: 289/2057 symbols completed. BUI took 1.3s. Estimated remaining: 12m 7s. Rate: 145.9 symbols/min [2025-09-29T22:06:19.154324] [INFO ] [MAIN ] BVN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:19.171903] [DEBUG] [MAIN ] BURL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:19.172730] [INFO ] [MAIN ] BURL: Generated 1794 derivative records from 46116 primary records. [2025-09-29T22:06:19.172852] [DEBUG] [LOCAL ] BURL: Saving derivative data. [2025-09-29T22:06:19.191550] [DEBUG] [LOCAL ] BURL: Derivative data saved (1794 records). [2025-09-29T22:06:19.193511] [INFO ] [MAIN ] BURL: Successfully saved derivative data. [2025-09-29T22:06:19.196335] [INFO ] [MAIN ] Derivative Progress: 290/2057 symbols completed. BURL took 1.3s. Estimated remaining: 12m 4s. Rate: 146.4 symbols/min [2025-09-29T22:06:19.196841] [INFO ] [MAIN ] BW: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:19.211932] [DEBUG] [MAIN ] BUXX: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:06:19.212933] [INFO ] [MAIN ] BUXX: Generated 1793 derivative records from 15148 primary records. [2025-09-29T22:06:19.213171] [DEBUG] [LOCAL ] BUXX: Saving derivative data. [2025-09-29T22:06:19.242134] [DEBUG] [LOCAL ] BUXX: Derivative data saved (1793 records). [2025-09-29T22:06:19.255182] [INFO ] [MAIN ] BUXX: Successfully saved derivative data. [2025-09-29T22:06:19.258113] [INFO ] [MAIN ] Derivative Progress: 291/2057 symbols completed. BUXX took 1.1s. Estimated remaining: 12m 2s. Rate: 146.8 symbols/min [2025-09-29T22:06:19.259446] [DEBUG] [LOCAL ] BVN: Loaded 43956 existing records from primary storage. [2025-09-29T22:06:19.268231] [INFO ] [MAIN ] BVN: Loaded 43956 primary data records. [2025-09-29T22:06:19.268352] [INFO ] [MAIN ] BWA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:19.392256] [DEBUG] [LOCAL ] BW: Loaded 39676 existing records from primary storage. [2025-09-29T22:06:19.433186] [INFO ] [MAIN ] BW: Loaded 39676 primary data records. [2025-09-29T22:06:19.805747] [DEBUG] [LOCAL ] BWA: Loaded 52193 existing records from primary storage. [2025-09-29T22:06:19.842674] [INFO ] [MAIN ] BWA: Loaded 52193 primary data records. [2025-09-29T22:06:20.317484] [DEBUG] [MAIN ] BVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:20.318997] [INFO ] [MAIN ] BVN: Generated 1794 derivative records from 43956 primary records. [2025-09-29T22:06:20.319589] [DEBUG] [LOCAL ] BVN: Saving derivative data. [2025-09-29T22:06:20.340874] [DEBUG] [LOCAL ] BVN: Derivative data saved (1794 records). [2025-09-29T22:06:20.341143] [INFO ] [MAIN ] BVN: Successfully saved derivative data. [2025-09-29T22:06:20.343420] [INFO ] [MAIN ] Derivative Progress: 292/2057 symbols completed. BVN took 1.2s. Estimated remaining: 12m 5s. Rate: 146.0 symbols/min [2025-09-29T22:06:20.343879] [INFO ] [MAIN ] BWG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:20.358111] [DEBUG] [MAIN ] BW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:20.359687] [INFO ] [MAIN ] BW: Generated 1794 derivative records from 39676 primary records. [2025-09-29T22:06:20.359978] [DEBUG] [LOCAL ] BW: Saving derivative data. [2025-09-29T22:06:20.387840] [DEBUG] [LOCAL ] BWG: Loaded 12382 existing records from primary storage. [2025-09-29T22:06:20.389639] [DEBUG] [LOCAL ] BW: Derivative data saved (1794 records). [2025-09-29T22:06:20.388683] [INFO ] [MAIN ] BWG: Loaded 12382 primary data records. [2025-09-29T22:06:20.395051] [INFO ] [MAIN ] BW: Successfully saved derivative data. [2025-09-29T22:06:20.399857] [INFO ] [MAIN ] Derivative Progress: 293/2057 symbols completed. BW took 1.2s. Estimated remaining: 12m 3s. Rate: 146.4 symbols/min [2025-09-29T22:06:20.413153] [INFO ] [MAIN ] BWLP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:20.463901] [DEBUG] [MAIN ] BWA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:20.478890] [INFO ] [MAIN ] BWA: Generated 1794 derivative records from 52193 primary records. [2025-09-29T22:06:20.504627] [DEBUG] [LOCAL ] BWA: Saving derivative data. [2025-09-29T22:06:20.757583] [DEBUG] [LOCAL ] BWA: Derivative data saved (1794 records). [2025-09-29T22:06:20.772227] [INFO ] [MAIN ] BWA: Successfully saved derivative data. [2025-09-29T22:06:20.774980] [INFO ] [MAIN ] Derivative Progress: 294/2057 symbols completed. BWA took 1.5s. Estimated remaining: 12m 2s. Rate: 146.5 symbols/min [2025-09-29T22:06:20.775336] [INFO ] [MAIN ] BWMX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:20.777195] [DEBUG] [LOCAL ] BWLP: Loaded 32466 existing records from primary storage. [2025-09-29T22:06:20.777547] [INFO ] [MAIN ] BWLP: Loaded 32466 primary data records. [2025-09-29T22:06:20.898944] [DEBUG] [LOCAL ] BWMX: Loaded 7635 existing records from primary storage. [2025-09-29T22:06:20.903761] [INFO ] [MAIN ] BWMX: Loaded 7635 primary data records. [2025-09-29T22:06:21.508332] [DEBUG] [MAIN ] BWG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:21.510180] [INFO ] [MAIN ] BWG: Generated 1794 derivative records from 12382 primary records. [2025-09-29T22:06:21.512444] [DEBUG] [LOCAL ] BWG: Saving derivative data. [2025-09-29T22:06:21.532378] [DEBUG] [LOCAL ] BWG: Derivative data saved (1794 records). [2025-09-29T22:06:21.532828] [INFO ] [MAIN ] BWG: Successfully saved derivative data. [2025-09-29T22:06:21.535531] [INFO ] [MAIN ] Derivative Progress: 295/2057 symbols completed. BWG took 1.2s. Estimated remaining: 12m 4s. Rate: 146.0 symbols/min [2025-09-29T22:06:21.536981] [INFO ] [MAIN ] BWXT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:21.593538] [DEBUG] [MAIN ] BWMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:21.593268] [DEBUG] [MAIN ] BWLP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:21.595092] [INFO ] [MAIN ] BWLP: Generated 1794 derivative records from 32466 primary records. [2025-09-29T22:06:21.595866] [DEBUG] [LOCAL ] BWLP: Saving derivative data. [2025-09-29T22:06:21.594358] [INFO ] [MAIN ] BWMX: Generated 1794 derivative records from 7635 primary records. [2025-09-29T22:06:21.596836] [DEBUG] [LOCAL ] BWMX: Saving derivative data. [2025-09-29T22:06:21.624674] [DEBUG] [LOCAL ] BWMX: Derivative data saved (1794 records). [2025-09-29T22:06:21.627706] [INFO ] [MAIN ] BWMX: Successfully saved derivative data. [2025-09-29T22:06:21.631178] [INFO ] [MAIN ] Derivative Progress: 296/2057 symbols completed. BWMX took 0.9s. Estimated remaining: 12m 2s. Rate: 146.4 symbols/min [2025-09-29T22:06:21.641605] [INFO ] [MAIN ] BX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:21.642928] [DEBUG] [LOCAL ] BWLP: Derivative data saved (1794 records). [2025-09-29T22:06:21.643520] [INFO ] [MAIN ] BWLP: Successfully saved derivative data. [2025-09-29T22:06:21.646703] [INFO ] [MAIN ] Derivative Progress: 297/2057 symbols completed. BWLP took 1.2s. Estimated remaining: 11m 59s. Rate: 146.9 symbols/min [2025-09-29T22:06:21.647185] [INFO ] [MAIN ] BXC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:21.666080] [DEBUG] [LOCAL ] BWXT: Loaded 46789 existing records from primary storage. [2025-09-29T22:06:21.669565] [INFO ] [MAIN ] BWXT: Loaded 46789 primary data records. [2025-09-29T22:06:21.771871] [DEBUG] [LOCAL ] BXC: Loaded 13669 existing records from primary storage. [2025-09-29T22:06:21.783909] [INFO ] [MAIN ] BXC: Loaded 13669 primary data records. [2025-09-29T22:06:22.158398] [DEBUG] [LOCAL ] BX: Loaded 53489 existing records from primary storage. [2025-09-29T22:06:22.163975] [INFO ] [MAIN ] BX: Loaded 53489 primary data records. [2025-09-29T22:06:22.712094] [DEBUG] [MAIN ] BWXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:22.713711] [INFO ] [MAIN ] BWXT: Generated 1794 derivative records from 46789 primary records. [2025-09-29T22:06:22.726238] [DEBUG] [LOCAL ] BWXT: Saving derivative data. [2025-09-29T22:06:22.727200] [DEBUG] [MAIN ] BXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:22.728153] [INFO ] [MAIN ] BXC: Generated 1794 derivative records from 13669 primary records. [2025-09-29T22:06:22.729351] [DEBUG] [LOCAL ] BXC: Saving derivative data. [2025-09-29T22:06:22.762072] [DEBUG] [LOCAL ] BWXT: Derivative data saved (1794 records). [2025-09-29T22:06:22.761993] [DEBUG] [LOCAL ] BXC: Derivative data saved (1794 records). [2025-09-29T22:06:22.762204] [INFO ] [MAIN ] BWXT: Successfully saved derivative data. [2025-09-29T22:06:22.762333] [INFO ] [MAIN ] BXC: Successfully saved derivative data. [2025-09-29T22:06:22.764746] [INFO ] [MAIN ] Derivative Progress: 298/2057 symbols completed. BWXT took 1.2s. Estimated remaining: 12m 3s. Rate: 146.0 symbols/min [2025-09-29T22:06:22.769476] [INFO ] [MAIN ] Derivative Progress: 299/2057 symbols completed. BXC took 1.1s. Estimated remaining: 11m 60s. Rate: 146.5 symbols/min [2025-09-29T22:06:22.783131] [DEBUG] [MAIN ] BX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:22.783850] [INFO ] [MAIN ] BX: Generated 1794 derivative records from 53489 primary records. [2025-09-29T22:06:22.783916] [DEBUG] [LOCAL ] BX: Saving derivative data. [2025-09-29T22:06:22.800609] [DEBUG] [LOCAL ] BX: Derivative data saved (1794 records). [2025-09-29T22:06:22.800809] [INFO ] [MAIN ] BX: Successfully saved derivative data. [2025-09-29T22:06:22.803350] [INFO ] [MAIN ] Derivative Progress: 300/2057 symbols completed. BX took 1.2s. Estimated remaining: 11m 57s. Rate: 147.0 symbols/min [2025-09-29T22:06:22.803795] [INFO ] [MAIN ] BXMT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:22.804012] [INFO ] [MAIN ] BXSL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:22.803926] [INFO ] [MAIN ] BXMX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:22.827806] [DEBUG] [LOCAL ] BXMX: Loaded 19482 existing records from primary storage. [2025-09-29T22:06:22.827985] [INFO ] [MAIN ] BXMX: Loaded 19482 primary data records. [2025-09-29T22:06:23.078994] [DEBUG] [LOCAL ] BXMT: Loaded 47211 existing records from primary storage. [2025-09-29T22:06:23.232832] [INFO ] [MAIN ] BXMT: Loaded 47211 primary data records. [2025-09-29T22:06:23.244065] [DEBUG] [LOCAL ] BXSL: Loaded 47578 existing records from primary storage. [2025-09-29T22:06:23.249620] [INFO ] [MAIN ] BXSL: Loaded 47578 primary data records. [2025-09-29T22:06:24.001080] [DEBUG] [MAIN ] BXMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:24.002347] [INFO ] [MAIN ] BXMX: Generated 1794 derivative records from 19482 primary records. [2025-09-29T22:06:24.002479] [DEBUG] [LOCAL ] BXMX: Saving derivative data. [2025-09-29T22:06:24.025192] [DEBUG] [LOCAL ] BXMX: Derivative data saved (1794 records). [2025-09-29T22:06:24.025366] [INFO ] [MAIN ] BXMX: Successfully saved derivative data. [2025-09-29T22:06:24.027940] [INFO ] [MAIN ] Derivative Progress: 301/2057 symbols completed. BXMX took 1.2s. Estimated remaining: 12m 2s. Rate: 146.0 symbols/min [2025-09-29T22:06:24.028470] [INFO ] [MAIN ] BY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:24.049927] [DEBUG] [MAIN ] BXMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:24.050982] [INFO ] [MAIN ] BXMT: Generated 1794 derivative records from 47211 primary records. [2025-09-29T22:06:24.051233] [DEBUG] [LOCAL ] BXMT: Saving derivative data. [2025-09-29T22:06:24.071215] [DEBUG] [MAIN ] BXSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:24.080810] [INFO ] [MAIN ] BXSL: Generated 1794 derivative records from 47578 primary records. [2025-09-29T22:06:24.083515] [DEBUG] [LOCAL ] BXSL: Saving derivative data. [2025-09-29T22:06:24.108462] [DEBUG] [LOCAL ] BY: Loaded 21703 existing records from primary storage. [2025-09-29T22:06:24.114178] [DEBUG] [LOCAL ] BXMT: Derivative data saved (1794 records). [2025-09-29T22:06:24.113813] [INFO ] [MAIN ] BY: Loaded 21703 primary data records. [2025-09-29T22:06:24.114902] [INFO ] [MAIN ] BXMT: Successfully saved derivative data. [2025-09-29T22:06:24.122376] [DEBUG] [LOCAL ] BXSL: Derivative data saved (1794 records). [2025-09-29T22:06:24.117128] [INFO ] [MAIN ] Derivative Progress: 302/2057 symbols completed. BXMT took 1.3s. Estimated remaining: 11m 59s. Rate: 146.4 symbols/min [2025-09-29T22:06:24.151424] [INFO ] [MAIN ] BXSL: Successfully saved derivative data. [2025-09-29T22:06:24.156742] [INFO ] [MAIN ] BYD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:24.169948] [INFO ] [MAIN ] Derivative Progress: 303/2057 symbols completed. BXSL took 1.4s. Estimated remaining: 11m 57s. Rate: 146.8 symbols/min [2025-09-29T22:06:24.181128] [INFO ] [MAIN ] BYM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:24.329102] [DEBUG] [LOCAL ] BYM: Loaded 12098 existing records from primary storage. [2025-09-29T22:06:24.329397] [INFO ] [MAIN ] BYM: Loaded 12098 primary data records. [2025-09-29T22:06:24.589530] [DEBUG] [LOCAL ] BYD: Loaded 45040 existing records from primary storage. [2025-09-29T22:06:24.591787] [INFO ] [MAIN ] BYD: Loaded 45040 primary data records. [2025-09-29T22:06:25.000040] [DEBUG] [MAIN ] BY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:25.037741] [INFO ] [MAIN ] BY: Generated 1794 derivative records from 21703 primary records. [2025-09-29T22:06:25.162382] [DEBUG] [LOCAL ] BY: Saving derivative data. [2025-09-29T22:06:25.185040] [DEBUG] [LOCAL ] BY: Derivative data saved (1794 records). [2025-09-29T22:06:25.186071] [INFO ] [MAIN ] BY: Successfully saved derivative data. [2025-09-29T22:06:25.188532] [INFO ] [MAIN ] Derivative Progress: 304/2057 symbols completed. BY took 1.2s. Estimated remaining: 12m 0s. Rate: 146.1 symbols/min [2025-09-29T22:06:25.189104] [INFO ] [MAIN ] BZH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:25.214193] [DEBUG] [MAIN ] BYM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:25.218257] [INFO ] [MAIN ] BYM: Generated 1794 derivative records from 12098 primary records. [2025-09-29T22:06:25.228092] [DEBUG] [LOCAL ] BYM: Saving derivative data. [2025-09-29T22:06:25.250033] [DEBUG] [MAIN ] BYD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:25.256620] [INFO ] [MAIN ] BYD: Generated 1794 derivative records from 45040 primary records. [2025-09-29T22:06:25.269861] [DEBUG] [LOCAL ] BYD: Saving derivative data. [2025-09-29T22:06:25.272461] [DEBUG] [LOCAL ] BYM: Derivative data saved (1794 records). [2025-09-29T22:06:25.272582] [INFO ] [MAIN ] BYM: Successfully saved derivative data. [2025-09-29T22:06:25.271918] [DEBUG] [LOCAL ] BZH: Loaded 32490 existing records from primary storage. [2025-09-29T22:06:25.275014] [INFO ] [MAIN ] Derivative Progress: 305/2057 symbols completed. BYM took 1.1s. Estimated remaining: 11m 58s. Rate: 146.5 symbols/min [2025-09-29T22:06:25.275095] [INFO ] [MAIN ] BZH: Loaded 32490 primary data records. [2025-09-29T22:06:25.275572] [INFO ] [MAIN ] C: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:25.355673] [DEBUG] [LOCAL ] BYD: Derivative data saved (1794 records). [2025-09-29T22:06:25.373045] [INFO ] [MAIN ] BYD: Successfully saved derivative data. [2025-09-29T22:06:25.399047] [INFO ] [MAIN ] Derivative Progress: 306/2057 symbols completed. BYD took 1.2s. Estimated remaining: 11m 56s. Rate: 146.8 symbols/min [2025-09-29T22:06:25.411465] [INFO ] [MAIN ] CAAP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:25.680203] [DEBUG] [LOCAL ] CAAP: Loaded 19823 existing records from primary storage. [2025-09-29T22:06:25.697093] [INFO ] [MAIN ] CAAP: Loaded 19823 primary data records. [2025-09-29T22:06:25.712394] [DEBUG] [LOCAL ] C: Loaded 53741 existing records from primary storage. [2025-09-29T22:06:25.733960] [INFO ] [MAIN ] C: Loaded 53741 primary data records. [2025-09-29T22:06:26.386400] [DEBUG] [MAIN ] BZH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:26.387958] [INFO ] [MAIN ] BZH: Generated 1794 derivative records from 32490 primary records. [2025-09-29T22:06:26.388061] [DEBUG] [LOCAL ] BZH: Saving derivative data. [2025-09-29T22:06:26.406928] [DEBUG] [LOCAL ] BZH: Derivative data saved (1794 records). [2025-09-29T22:06:26.408834] [INFO ] [MAIN ] BZH: Successfully saved derivative data. [2025-09-29T22:06:26.410989] [INFO ] [MAIN ] Derivative Progress: 307/2057 symbols completed. BZH took 1.2s. Estimated remaining: 11m 59s. Rate: 146.1 symbols/min [2025-09-29T22:06:26.411327] [INFO ] [MAIN ] CAE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:26.436878] [DEBUG] [MAIN ] C: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:26.451913] [DEBUG] [MAIN ] CAAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:26.451235] [INFO ] [MAIN ] C: Generated 1794 derivative records from 53741 primary records. [2025-09-29T22:06:26.453123] [INFO ] [MAIN ] CAAP: Generated 1794 derivative records from 19823 primary records. [2025-09-29T22:06:26.453252] [DEBUG] [LOCAL ] CAAP: Saving derivative data. [2025-09-29T22:06:26.453314] [DEBUG] [LOCAL ] C: Saving derivative data. [2025-09-29T22:06:26.498030] [DEBUG] [LOCAL ] C: Derivative data saved (1794 records). [2025-09-29T22:06:26.498590] [DEBUG] [LOCAL ] CAAP: Derivative data saved (1794 records). [2025-09-29T22:06:26.499078] [INFO ] [MAIN ] C: Successfully saved derivative data. [2025-09-29T22:06:26.512991] [INFO ] [MAIN ] Derivative Progress: 308/2057 symbols completed. C took 1.2s. Estimated remaining: 11m 57s. Rate: 146.4 symbols/min [2025-09-29T22:06:26.499011] [INFO ] [MAIN ] CAAP: Successfully saved derivative data. [2025-09-29T22:06:26.513320] [INFO ] [MAIN ] CAG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:26.515437] [INFO ] [MAIN ] Derivative Progress: 309/2057 symbols completed. CAAP took 1.1s. Estimated remaining: 11m 54s. Rate: 146.9 symbols/min [2025-09-29T22:06:26.516219] [INFO ] [MAIN ] CAH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:26.518012] [DEBUG] [LOCAL ] CAE: Loaded 38991 existing records from primary storage. [2025-09-29T22:06:26.518346] [INFO ] [MAIN ] CAE: Loaded 38991 primary data records. [2025-09-29T22:06:26.909932] [DEBUG] [LOCAL ] CAH: Loaded 51421 existing records from primary storage. [2025-09-29T22:06:26.910389] [INFO ] [MAIN ] CAH: Loaded 51421 primary data records. [2025-09-29T22:06:26.909834] [DEBUG] [LOCAL ] CAG: Loaded 53660 existing records from primary storage. [2025-09-29T22:06:26.910633] [INFO ] [MAIN ] CAG: Loaded 53660 primary data records. [2025-09-29T22:06:27.308162] [DEBUG] [MAIN ] CAE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:27.634705] [INFO ] [MAIN ] CAE: Generated 1794 derivative records from 38991 primary records. [2025-09-29T22:06:27.644301] [DEBUG] [LOCAL ] CAE: Saving derivative data. [2025-09-29T22:06:27.678038] [DEBUG] [LOCAL ] CAE: Derivative data saved (1794 records). [2025-09-29T22:06:27.678552] [INFO ] [MAIN ] CAE: Successfully saved derivative data. [2025-09-29T22:06:27.681496] [INFO ] [MAIN ] Derivative Progress: 310/2057 symbols completed. CAE took 1.3s. Estimated remaining: 11m 58s. Rate: 146.0 symbols/min [2025-09-29T22:06:27.682057] [INFO ] [MAIN ] CANG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:27.702240] [DEBUG] [MAIN ] CAG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:27.704269] [INFO ] [MAIN ] CAG: Generated 1794 derivative records from 53660 primary records. [2025-09-29T22:06:27.706103] [DEBUG] [LOCAL ] CAG: Saving derivative data. [2025-09-29T22:06:27.743132] [DEBUG] [MAIN ] CAH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:27.745168] [INFO ] [MAIN ] CAH: Generated 1794 derivative records from 51421 primary records. [2025-09-29T22:06:27.755044] [DEBUG] [LOCAL ] CAH: Saving derivative data. [2025-09-29T22:06:27.759014] [DEBUG] [LOCAL ] CANG: Loaded 26896 existing records from primary storage. [2025-09-29T22:06:27.761441] [INFO ] [MAIN ] CANG: Loaded 26896 primary data records. [2025-09-29T22:06:27.761937] [DEBUG] [LOCAL ] CAG: Derivative data saved (1794 records). [2025-09-29T22:06:27.794348] [INFO ] [MAIN ] CAG: Successfully saved derivative data. [2025-09-29T22:06:27.808177] [INFO ] [MAIN ] Derivative Progress: 311/2057 symbols completed. CAG took 1.3s. Estimated remaining: 11m 56s. Rate: 146.4 symbols/min [2025-09-29T22:06:27.830028] [INFO ] [MAIN ] CARR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:27.973058] [DEBUG] [LOCAL ] CAH: Derivative data saved (1794 records). [2025-09-29T22:06:28.092190] [INFO ] [MAIN ] CAH: Successfully saved derivative data. [2025-09-29T22:06:28.103232] [INFO ] [MAIN ] Derivative Progress: 312/2057 symbols completed. CAH took 1.6s. Estimated remaining: 11m 55s. Rate: 146.5 symbols/min [2025-09-29T22:06:28.103585] [INFO ] [MAIN ] CARS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:28.151531] [DEBUG] [LOCAL ] CARR: Loaded 53594 existing records from primary storage. [2025-09-29T22:06:28.152082] [INFO ] [MAIN ] CARR: Loaded 53594 primary data records. [2025-09-29T22:06:28.200146] [DEBUG] [MAIN ] CANG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:28.239890] [INFO ] [MAIN ] CANG: Generated 1794 derivative records from 26896 primary records. [2025-09-29T22:06:28.291516] [DEBUG] [LOCAL ] CANG: Saving derivative data. [2025-09-29T22:06:28.320627] [DEBUG] [LOCAL ] CARS: Loaded 39894 existing records from primary storage. [2025-09-29T22:06:28.380101] [INFO ] [MAIN ] CARS: Loaded 39894 primary data records. [2025-09-29T22:06:28.638631] [DEBUG] [LOCAL ] CANG: Derivative data saved (1794 records). [2025-09-29T22:06:28.639809] [INFO ] [MAIN ] CANG: Successfully saved derivative data. [2025-09-29T22:06:28.642543] [INFO ] [MAIN ] Derivative Progress: 313/2057 symbols completed. CANG took 1.0s. Estimated remaining: 11m 55s. Rate: 146.4 symbols/min [2025-09-29T22:06:28.872697] [DEBUG] [MAIN ] CARR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:28.873999] [INFO ] [MAIN ] CARR: Generated 1794 derivative records from 53594 primary records. [2025-09-29T22:06:28.874526] [DEBUG] [LOCAL ] CARR: Saving derivative data. [2025-09-29T22:06:28.893454] [DEBUG] [LOCAL ] CARR: Derivative data saved (1794 records). [2025-09-29T22:06:28.893688] [INFO ] [MAIN ] CARR: Successfully saved derivative data. [2025-09-29T22:06:28.895795] [INFO ] [MAIN ] Derivative Progress: 314/2057 symbols completed. CARR took 1.1s. Estimated remaining: 11m 54s. Rate: 146.5 symbols/min [2025-09-29T22:06:28.913092] [DEBUG] [MAIN ] CARS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:28.913873] [INFO ] [MAIN ] CARS: Generated 1794 derivative records from 39894 primary records. [2025-09-29T22:06:28.913941] [DEBUG] [LOCAL ] CARS: Saving derivative data. [2025-09-29T22:06:28.932122] [DEBUG] [LOCAL ] CARS: Derivative data saved (1794 records). [2025-09-29T22:06:28.932224] [INFO ] [MAIN ] CARS: Successfully saved derivative data. [2025-09-29T22:06:28.934591] [INFO ] [MAIN ] Derivative Progress: 315/2057 symbols completed. CARS took 0.8s. Estimated remaining: 11m 51s. Rate: 147.0 symbols/min [2025-09-29T22:06:28.935291] [INFO ] [MAIN ] CATO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:28.935214] [INFO ] [MAIN ] CAT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:28.936046] [INFO ] [MAIN ] CAVA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:28.947821] [DEBUG] [LOCAL ] CATO: Loaded 7098 existing records from primary storage. [2025-09-29T22:06:28.947928] [INFO ] [MAIN ] CATO: Loaded 7098 primary data records. [2025-09-29T22:06:29.310099] [DEBUG] [LOCAL ] CAVA: Loaded 53552 existing records from primary storage. [2025-09-29T22:06:29.310448] [INFO ] [MAIN ] CAVA: Loaded 53552 primary data records. [2025-09-29T22:06:29.424566] [DEBUG] [LOCAL ] CAT: Loaded 52915 existing records from primary storage. [2025-09-29T22:06:29.444261] [INFO ] [MAIN ] CAT: Loaded 52915 primary data records. [2025-09-29T22:06:30.036135] [DEBUG] [MAIN ] CATO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:30.037791] [INFO ] [MAIN ] CATO: Generated 1794 derivative records from 7098 primary records. [2025-09-29T22:06:30.038161] [DEBUG] [LOCAL ] CATO: Saving derivative data. [2025-09-29T22:06:30.056499] [DEBUG] [LOCAL ] CATO: Derivative data saved (1794 records). [2025-09-29T22:06:30.058191] [INFO ] [MAIN ] CATO: Successfully saved derivative data. [2025-09-29T22:06:30.062367] [INFO ] [MAIN ] Derivative Progress: 316/2057 symbols completed. CATO took 1.1s. Estimated remaining: 11m 55s. Rate: 146.1 symbols/min [2025-09-29T22:06:30.063581] [INFO ] [MAIN ] CB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:30.079209] [DEBUG] [MAIN ] CAVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:30.080540] [INFO ] [MAIN ] CAVA: Generated 1794 derivative records from 53552 primary records. [2025-09-29T22:06:30.080899] [DEBUG] [LOCAL ] CAVA: Saving derivative data. [2025-09-29T22:06:30.103347] [DEBUG] [LOCAL ] CAVA: Derivative data saved (1794 records). [2025-09-29T22:06:30.103980] [INFO ] [MAIN ] CAVA: Successfully saved derivative data. [2025-09-29T22:06:30.108038] [INFO ] [MAIN ] Derivative Progress: 317/2057 symbols completed. CAVA took 1.2s. Estimated remaining: 11m 52s. Rate: 146.6 symbols/min [2025-09-29T22:06:30.108265] [INFO ] [MAIN ] CBL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:30.124010] [DEBUG] [MAIN ] CAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:30.125306] [INFO ] [MAIN ] CAT: Generated 1794 derivative records from 52915 primary records. [2025-09-29T22:06:30.125458] [DEBUG] [LOCAL ] CAT: Saving derivative data. [2025-09-29T22:06:30.148608] [DEBUG] [LOCAL ] CAT: Derivative data saved (1794 records). [2025-09-29T22:06:30.159926] [INFO ] [MAIN ] CAT: Successfully saved derivative data. [2025-09-29T22:06:30.163885] [INFO ] [MAIN ] Derivative Progress: 318/2057 symbols completed. CAT took 1.2s. Estimated remaining: 11m 50s. Rate: 147.0 symbols/min [2025-09-29T22:06:30.164240] [INFO ] [MAIN ] CBNA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:30.174796] [DEBUG] [LOCAL ] CBL: Loaded 16397 existing records from primary storage. [2025-09-29T22:06:30.176000] [INFO ] [MAIN ] CBL: Loaded 16397 primary data records. [2025-09-29T22:06:30.179572] [DEBUG] [LOCAL ] CBNA: Loaded 2901 existing records from primary storage. [2025-09-29T22:06:30.230843] [INFO ] [MAIN ] CBNA: Loaded 2901 primary data records. [2025-09-29T22:06:30.338419] [DEBUG] [LOCAL ] CB: Loaded 49973 existing records from primary storage. [2025-09-29T22:06:30.378816] [INFO ] [MAIN ] CB: Loaded 49973 primary data records. [2025-09-29T22:06:31.217197] [DEBUG] [MAIN ] CBL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:31.232025] [INFO ] [MAIN ] CBL: Generated 1794 derivative records from 16397 primary records. [2025-09-29T22:06:31.233086] [DEBUG] [LOCAL ] CBL: Saving derivative data. [2025-09-29T22:06:31.230843] [DEBUG] [MAIN ] CBNA: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:06:31.235050] [INFO ] [MAIN ] CBNA: Generated 1793 derivative records from 2901 primary records. [2025-09-29T22:06:31.235222] [DEBUG] [LOCAL ] CBNA: Saving derivative data. [2025-09-29T22:06:31.280097] [DEBUG] [LOCAL ] CBNA: Derivative data saved (1793 records). [2025-09-29T22:06:31.278731] [DEBUG] [MAIN ] CB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:31.282467] [INFO ] [MAIN ] CB: Generated 1794 derivative records from 49973 primary records. [2025-09-29T22:06:31.282833] [DEBUG] [LOCAL ] CBL: Derivative data saved (1794 records). [2025-09-29T22:06:31.282985] [INFO ] [MAIN ] CBL: Successfully saved derivative data. [2025-09-29T22:06:31.283051] [DEBUG] [LOCAL ] CB: Saving derivative data. [2025-09-29T22:06:31.283684] [INFO ] [MAIN ] CBNA: Successfully saved derivative data. [2025-09-29T22:06:31.285945] [INFO ] [MAIN ] Derivative Progress: 319/2057 symbols completed. CBL took 1.2s. Estimated remaining: 11m 54s. Rate: 146.2 symbols/min [2025-09-29T22:06:31.288735] [INFO ] [MAIN ] CBRE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:31.288827] [INFO ] [MAIN ] Derivative Progress: 320/2057 symbols completed. CBNA took 1.1s. Estimated remaining: 11m 51s. Rate: 146.6 symbols/min [2025-09-29T22:06:31.297148] [INFO ] [MAIN ] CBT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:31.308601] [DEBUG] [LOCAL ] CB: Derivative data saved (1794 records). [2025-09-29T22:06:31.308836] [INFO ] [MAIN ] CB: Successfully saved derivative data. [2025-09-29T22:06:31.310963] [INFO ] [MAIN ] Derivative Progress: 321/2057 symbols completed. CB took 1.2s. Estimated remaining: 11m 48s. Rate: 147.0 symbols/min [2025-09-29T22:06:31.311287] [INFO ] [MAIN ] CBU: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:31.345348] [DEBUG] [LOCAL ] CBT: Loaded 30857 existing records from primary storage. [2025-09-29T22:06:31.353109] [INFO ] [MAIN ] CBT: Loaded 30857 primary data records. [2025-09-29T22:06:31.367518] [DEBUG] [LOCAL ] CBU: Loaded 22640 existing records from primary storage. [2025-09-29T22:06:31.367916] [INFO ] [MAIN ] CBU: Loaded 22640 primary data records. [2025-09-29T22:06:31.571985] [DEBUG] [LOCAL ] CBRE: Loaded 50596 existing records from primary storage. [2025-09-29T22:06:31.622637] [INFO ] [MAIN ] CBRE: Loaded 50596 primary data records. [2025-09-29T22:06:32.415319] [DEBUG] [MAIN ] CBT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:32.417348] [INFO ] [MAIN ] CBT: Generated 1794 derivative records from 30857 primary records. [2025-09-29T22:06:32.419486] [DEBUG] [LOCAL ] CBT: Saving derivative data. [2025-09-29T22:06:32.451592] [DEBUG] [LOCAL ] CBT: Derivative data saved (1794 records). [2025-09-29T22:06:32.452544] [INFO ] [MAIN ] CBT: Successfully saved derivative data. [2025-09-29T22:06:32.454945] [INFO ] [MAIN ] Derivative Progress: 322/2057 symbols completed. CBT took 1.2s. Estimated remaining: 11m 52s. Rate: 146.2 symbols/min [2025-09-29T22:06:32.455211] [INFO ] [MAIN ] CBZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:32.455748] [DEBUG] [MAIN ] CBU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:32.457095] [INFO ] [MAIN ] CBU: Generated 1794 derivative records from 22640 primary records. [2025-09-29T22:06:32.457374] [DEBUG] [LOCAL ] CBU: Saving derivative data. [2025-09-29T22:06:32.476890] [DEBUG] [LOCAL ] CBU: Derivative data saved (1794 records). [2025-09-29T22:06:32.489556] [INFO ] [MAIN ] CBU: Successfully saved derivative data. [2025-09-29T22:06:32.490113] [DEBUG] [MAIN ] CBRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:32.490883] [INFO ] [MAIN ] CBRE: Generated 1794 derivative records from 50596 primary records. [2025-09-29T22:06:32.493114] [DEBUG] [LOCAL ] CBRE: Saving derivative data. [2025-09-29T22:06:32.493033] [INFO ] [MAIN ] Derivative Progress: 323/2057 symbols completed. CBU took 1.2s. Estimated remaining: 11m 50s. Rate: 146.6 symbols/min [2025-09-29T22:06:32.494159] [INFO ] [MAIN ] CC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:32.521580] [DEBUG] [LOCAL ] CBRE: Derivative data saved (1794 records). [2025-09-29T22:06:32.533169] [INFO ] [MAIN ] CBRE: Successfully saved derivative data. [2025-09-29T22:06:32.537762] [INFO ] [MAIN ] Derivative Progress: 324/2057 symbols completed. CBRE took 1.2s. Estimated remaining: 11m 47s. Rate: 147.0 symbols/min [2025-09-29T22:06:32.539426] [DEBUG] [LOCAL ] CBZ: Loaded 33640 existing records from primary storage. [2025-09-29T22:06:32.539721] [INFO ] [MAIN ] CCI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:32.540071] [INFO ] [MAIN ] CBZ: Loaded 33640 primary data records. [2025-09-29T22:06:32.901558] [DEBUG] [LOCAL ] CC: Loaded 53007 existing records from primary storage. [2025-09-29T22:06:32.901896] [INFO ] [MAIN ] CC: Loaded 53007 primary data records. [2025-09-29T22:06:33.071332] [DEBUG] [LOCAL ] CCI: Loaded 53143 existing records from primary storage. [2025-09-29T22:06:33.103154] [INFO ] [MAIN ] CCI: Loaded 53143 primary data records. [2025-09-29T22:06:33.609524] [DEBUG] [MAIN ] CBZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:33.611774] [INFO ] [MAIN ] CBZ: Generated 1794 derivative records from 33640 primary records. [2025-09-29T22:06:33.612899] [DEBUG] [LOCAL ] CBZ: Saving derivative data. [2025-09-29T22:06:33.633429] [DEBUG] [LOCAL ] CBZ: Derivative data saved (1794 records). [2025-09-29T22:06:33.635638] [INFO ] [MAIN ] CBZ: Successfully saved derivative data. [2025-09-29T22:06:33.639179] [INFO ] [MAIN ] Derivative Progress: 325/2057 symbols completed. CBZ took 1.2s. Estimated remaining: 11m 50s. Rate: 146.3 symbols/min [2025-09-29T22:06:33.639829] [INFO ] [MAIN ] CCIF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:33.654873] [DEBUG] [MAIN ] CC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:33.657441] [INFO ] [MAIN ] CC: Generated 1794 derivative records from 53007 primary records. [2025-09-29T22:06:33.658493] [DEBUG] [LOCAL ] CC: Saving derivative data. [2025-09-29T22:06:33.685731] [DEBUG] [LOCAL ] CC: Derivative data saved (1794 records). [2025-09-29T22:06:33.685908] [INFO ] [MAIN ] CC: Successfully saved derivative data. [2025-09-29T22:06:33.689574] [INFO ] [MAIN ] Derivative Progress: 326/2057 symbols completed. CC took 1.2s. Estimated remaining: 11m 48s. Rate: 146.7 symbols/min [2025-09-29T22:06:33.690769] [INFO ] [MAIN ] CCJ: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:33.713314] [DEBUG] [LOCAL ] CCIF: Loaded 15655 existing records from primary storage. [2025-09-29T22:06:33.713783] [DEBUG] [MAIN ] CCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:33.714008] [INFO ] [MAIN ] CCIF: Loaded 15655 primary data records. [2025-09-29T22:06:33.715159] [INFO ] [MAIN ] CCI: Generated 1794 derivative records from 53143 primary records. [2025-09-29T22:06:33.720705] [DEBUG] [LOCAL ] CCI: Saving derivative data. [2025-09-29T22:06:33.840260] [DEBUG] [LOCAL ] CCI: Derivative data saved (1794 records). [2025-09-29T22:06:33.844285] [INFO ] [MAIN ] CCI: Successfully saved derivative data. [2025-09-29T22:06:33.846523] [INFO ] [MAIN ] Derivative Progress: 327/2057 symbols completed. CCI took 1.3s. Estimated remaining: 11m 46s. Rate: 146.9 symbols/min [2025-09-29T22:06:33.847254] [INFO ] [MAIN ] CCK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:34.113453] [DEBUG] [LOCAL ] CCJ: Loaded 53673 existing records from primary storage. [2025-09-29T22:06:34.113730] [INFO ] [MAIN ] CCJ: Loaded 53673 primary data records. [2025-09-29T22:06:34.292824] [DEBUG] [LOCAL ] CCK: Loaded 46287 existing records from primary storage. [2025-09-29T22:06:34.315377] [INFO ] [MAIN ] CCK: Loaded 46287 primary data records. [2025-09-29T22:06:34.744489] [DEBUG] [MAIN ] CCIF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:34.865368] [INFO ] [MAIN ] CCIF: Generated 1794 derivative records from 15655 primary records. [2025-09-29T22:06:34.866358] [DEBUG] [LOCAL ] CCIF: Saving derivative data. [2025-09-29T22:06:34.889321] [DEBUG] [LOCAL ] CCIF: Derivative data saved (1794 records). [2025-09-29T22:06:34.889691] [INFO ] [MAIN ] CCIF: Successfully saved derivative data. [2025-09-29T22:06:34.892299] [INFO ] [MAIN ] Derivative Progress: 328/2057 symbols completed. CCIF took 1.3s. Estimated remaining: 11m 49s. Rate: 146.2 symbols/min [2025-09-29T22:06:34.910764] [DEBUG] [MAIN ] CCJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:34.911534] [INFO ] [MAIN ] CCJ: Generated 1794 derivative records from 53673 primary records. [2025-09-29T22:06:34.911747] [DEBUG] [LOCAL ] CCJ: Saving derivative data. [2025-09-29T22:06:34.929136] [DEBUG] [LOCAL ] CCJ: Derivative data saved (1794 records). [2025-09-29T22:06:34.929798] [INFO ] [MAIN ] CCJ: Successfully saved derivative data. [2025-09-29T22:06:34.932772] [INFO ] [MAIN ] Derivative Progress: 329/2057 symbols completed. CCJ took 1.2s. Estimated remaining: 11m 47s. Rate: 146.6 symbols/min [2025-09-29T22:06:34.947370] [DEBUG] [MAIN ] CCK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:34.948050] [INFO ] [MAIN ] CCK: Generated 1794 derivative records from 46287 primary records. [2025-09-29T22:06:34.948116] [DEBUG] [LOCAL ] CCK: Saving derivative data. [2025-09-29T22:06:34.964232] [DEBUG] [LOCAL ] CCK: Derivative data saved (1794 records). [2025-09-29T22:06:34.964301] [INFO ] [MAIN ] CCK: Successfully saved derivative data. [2025-09-29T22:06:34.966746] [INFO ] [MAIN ] Derivative Progress: 330/2057 symbols completed. CCK took 1.1s. Estimated remaining: 11m 45s. Rate: 147.1 symbols/min [2025-09-29T22:06:34.967226] [INFO ] [MAIN ] CCL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:34.967523] [INFO ] [MAIN ] CCO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:34.967389] [INFO ] [MAIN ] CCRD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:34.979812] [DEBUG] [LOCAL ] CCRD: Loaded 9032 existing records from primary storage. [2025-09-29T22:06:34.979967] [INFO ] [MAIN ] CCRD: Loaded 9032 primary data records. [2025-09-29T22:06:35.332611] [DEBUG] [LOCAL ] CCO: Loaded 47797 existing records from primary storage. [2025-09-29T22:06:35.332966] [INFO ] [MAIN ] CCO: Loaded 47797 primary data records. [2025-09-29T22:06:35.459429] [DEBUG] [LOCAL ] CCL: Loaded 53800 existing records from primary storage. [2025-09-29T22:06:35.499347] [INFO ] [MAIN ] CCL: Loaded 53800 primary data records. [2025-09-29T22:06:35.848038] [DEBUG] [MAIN ] CCRD: Filtered 7001 bins outside market hours, 7823 incomplete bins [2025-09-29T22:06:36.043684] [INFO ] [MAIN ] CCRD: Generated 1791 derivative records from 9032 primary records. [2025-09-29T22:06:36.052016] [DEBUG] [LOCAL ] CCRD: Saving derivative data. [2025-09-29T22:06:36.072338] [DEBUG] [LOCAL ] CCRD: Derivative data saved (1791 records). [2025-09-29T22:06:36.073798] [INFO ] [MAIN ] CCRD: Successfully saved derivative data. [2025-09-29T22:06:36.077172] [INFO ] [MAIN ] Derivative Progress: 331/2057 symbols completed. CCRD took 1.1s. Estimated remaining: 11m 48s. Rate: 146.3 symbols/min [2025-09-29T22:06:36.077540] [INFO ] [MAIN ] CCS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:36.093225] [DEBUG] [MAIN ] CCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:36.095192] [INFO ] [MAIN ] CCO: Generated 1794 derivative records from 47797 primary records. [2025-09-29T22:06:36.095381] [DEBUG] [LOCAL ] CCO: Saving derivative data. [2025-09-29T22:06:36.113208] [DEBUG] [LOCAL ] CCO: Derivative data saved (1794 records). [2025-09-29T22:06:36.113483] [INFO ] [MAIN ] CCO: Successfully saved derivative data. [2025-09-29T22:06:36.124201] [INFO ] [MAIN ] Derivative Progress: 332/2057 symbols completed. CCO took 1.2s. Estimated remaining: 11m 46s. Rate: 146.7 symbols/min [2025-09-29T22:06:36.124664] [INFO ] [MAIN ] CCU: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:36.153261] [DEBUG] [MAIN ] CCL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:36.154890] [INFO ] [MAIN ] CCL: Generated 1794 derivative records from 53800 primary records. [2025-09-29T22:06:36.153897] [DEBUG] [LOCAL ] CCS: Loaded 30622 existing records from primary storage. [2025-09-29T22:06:36.155150] [DEBUG] [LOCAL ] CCL: Saving derivative data. [2025-09-29T22:06:36.155903] [INFO ] [MAIN ] CCS: Loaded 30622 primary data records. [2025-09-29T22:06:36.284330] [DEBUG] [LOCAL ] CCU: Loaded 23240 existing records from primary storage. [2025-09-29T22:06:36.298429] [INFO ] [MAIN ] CCU: Loaded 23240 primary data records. [2025-09-29T22:06:36.299352] [DEBUG] [LOCAL ] CCL: Derivative data saved (1794 records). [2025-09-29T22:06:36.310216] [INFO ] [MAIN ] CCL: Successfully saved derivative data. [2025-09-29T22:06:36.341914] [INFO ] [MAIN ] Derivative Progress: 333/2057 symbols completed. CCL took 1.4s. Estimated remaining: 11m 44s. Rate: 146.9 symbols/min [2025-09-29T22:06:36.369000] [INFO ] [MAIN ] CDE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:36.900464] [DEBUG] [LOCAL ] CDE: Loaded 53641 existing records from primary storage. [2025-09-29T22:06:36.906498] [INFO ] [MAIN ] CDE: Loaded 53641 primary data records. [2025-09-29T22:06:36.906402] [DEBUG] [MAIN ] CCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:36.913432] [INFO ] [MAIN ] CCS: Generated 1794 derivative records from 30622 primary records. [2025-09-29T22:06:36.930055] [DEBUG] [LOCAL ] CCS: Saving derivative data. [2025-09-29T22:06:37.078537] [DEBUG] [MAIN ] CCU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:37.129143] [INFO ] [MAIN ] CCU: Generated 1794 derivative records from 23240 primary records. [2025-09-29T22:06:37.242316] [DEBUG] [LOCAL ] CCU: Saving derivative data. [2025-09-29T22:06:37.247679] [DEBUG] [LOCAL ] CCS: Derivative data saved (1794 records). [2025-09-29T22:06:37.256611] [INFO ] [MAIN ] CCS: Successfully saved derivative data. [2025-09-29T22:06:37.260070] [INFO ] [MAIN ] Derivative Progress: 334/2057 symbols completed. CCS took 1.2s. Estimated remaining: 11m 46s. Rate: 146.3 symbols/min [2025-09-29T22:06:37.260528] [INFO ] [MAIN ] CDLR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:37.278024] [DEBUG] [LOCAL ] CCU: Derivative data saved (1794 records). [2025-09-29T22:06:37.279001] [INFO ] [MAIN ] CCU: Successfully saved derivative data. [2025-09-29T22:06:37.281341] [INFO ] [MAIN ] Derivative Progress: 335/2057 symbols completed. CCU took 1.2s. Estimated remaining: 11m 44s. Rate: 146.8 symbols/min [2025-09-29T22:06:37.281787] [INFO ] [MAIN ] CDP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:37.291303] [DEBUG] [LOCAL ] CDLR: Loaded 9783 existing records from primary storage. [2025-09-29T22:06:37.291479] [INFO ] [MAIN ] CDLR: Loaded 9783 primary data records. [2025-09-29T22:06:37.644586] [DEBUG] [LOCAL ] CDP: Loaded 42547 existing records from primary storage. [2025-09-29T22:06:37.645675] [INFO ] [MAIN ] CDP: Loaded 42547 primary data records. [2025-09-29T22:06:37.644949] [DEBUG] [MAIN ] CDE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:37.646797] [INFO ] [MAIN ] CDE: Generated 1794 derivative records from 53641 primary records. [2025-09-29T22:06:37.652687] [DEBUG] [LOCAL ] CDE: Saving derivative data. [2025-09-29T22:06:38.043118] [DEBUG] [LOCAL ] CDE: Derivative data saved (1794 records). [2025-09-29T22:06:38.056534] [INFO ] [MAIN ] CDE: Successfully saved derivative data. [2025-09-29T22:06:38.058912] [INFO ] [MAIN ] Derivative Progress: 336/2057 symbols completed. CDE took 1.7s. Estimated remaining: 11m 45s. Rate: 146.4 symbols/min [2025-09-29T22:06:38.059671] [INFO ] [MAIN ] CDRE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:38.059418] [DEBUG] [MAIN ] CDLR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:38.062238] [INFO ] [MAIN ] CDLR: Generated 1794 derivative records from 9783 primary records. [2025-09-29T22:06:38.062763] [DEBUG] [LOCAL ] CDLR: Saving derivative data. [2025-09-29T22:06:38.088904] [DEBUG] [LOCAL ] CDLR: Derivative data saved (1794 records). [2025-09-29T22:06:38.089111] [INFO ] [MAIN ] CDLR: Successfully saved derivative data. [2025-09-29T22:06:38.091482] [INFO ] [MAIN ] Derivative Progress: 337/2057 symbols completed. CDLR took 0.8s. Estimated remaining: 11m 43s. Rate: 146.8 symbols/min [2025-09-29T22:06:38.091679] [INFO ] [MAIN ] CE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:38.114627] [DEBUG] [LOCAL ] CDRE: Loaded 25219 existing records from primary storage. [2025-09-29T22:06:38.120316] [DEBUG] [MAIN ] CDP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:38.120503] [INFO ] [MAIN ] CDRE: Loaded 25219 primary data records. [2025-09-29T22:06:38.121306] [INFO ] [MAIN ] CDP: Generated 1794 derivative records from 42547 primary records. [2025-09-29T22:06:38.121443] [DEBUG] [LOCAL ] CDP: Saving derivative data. [2025-09-29T22:06:38.284784] [DEBUG] [LOCAL ] CDP: Derivative data saved (1794 records). [2025-09-29T22:06:38.344716] [INFO ] [MAIN ] CDP: Successfully saved derivative data. [2025-09-29T22:06:38.455363] [INFO ] [MAIN ] Derivative Progress: 338/2057 symbols completed. CDP took 1.2s. Estimated remaining: 11m 43s. Rate: 146.8 symbols/min [2025-09-29T22:06:38.469708] [INFO ] [MAIN ] CEE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:38.493184] [DEBUG] [LOCAL ] CE: Loaded 51527 existing records from primary storage. [2025-09-29T22:06:38.494833] [INFO ] [MAIN ] CE: Loaded 51527 primary data records. [2025-09-29T22:06:38.565912] [DEBUG] [LOCAL ] CEE: Loaded 6213 existing records from primary storage. [2025-09-29T22:06:38.591284] [INFO ] [MAIN ] CEE: Loaded 6213 primary data records. [2025-09-29T22:06:39.218985] [DEBUG] [MAIN ] CDRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:39.220028] [INFO ] [MAIN ] CDRE: Generated 1794 derivative records from 25219 primary records. [2025-09-29T22:06:39.220943] [DEBUG] [LOCAL ] CDRE: Saving derivative data. [2025-09-29T22:06:39.249469] [DEBUG] [LOCAL ] CDRE: Derivative data saved (1794 records). [2025-09-29T22:06:39.250598] [INFO ] [MAIN ] CDRE: Successfully saved derivative data. [2025-09-29T22:06:39.253339] [INFO ] [MAIN ] Derivative Progress: 339/2057 symbols completed. CDRE took 1.2s. Estimated remaining: 11m 44s. Rate: 146.4 symbols/min [2025-09-29T22:06:39.253813] [INFO ] [MAIN ] CEPU: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:39.268691] [DEBUG] [MAIN ] CE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:39.269786] [INFO ] [MAIN ] CE: Generated 1794 derivative records from 51527 primary records. [2025-09-29T22:06:39.269970] [DEBUG] [LOCAL ] CE: Saving derivative data. [2025-09-29T22:06:39.298352] [DEBUG] [LOCAL ] CE: Derivative data saved (1794 records). [2025-09-29T22:06:39.300200] [INFO ] [MAIN ] CE: Successfully saved derivative data. [2025-09-29T22:06:39.303180] [INFO ] [MAIN ] Derivative Progress: 340/2057 symbols completed. CE took 1.2s. Estimated remaining: 11m 42s. Rate: 146.8 symbols/min [2025-09-29T22:06:39.303578] [INFO ] [MAIN ] CF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:39.326471] [DEBUG] [MAIN ] CEE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:39.327357] [DEBUG] [LOCAL ] CEPU: Loaded 25890 existing records from primary storage. [2025-09-29T22:06:39.328534] [INFO ] [MAIN ] CEE: Generated 1794 derivative records from 6213 primary records. [2025-09-29T22:06:39.328720] [DEBUG] [LOCAL ] CEE: Saving derivative data. [2025-09-29T22:06:39.328825] [INFO ] [MAIN ] CEPU: Loaded 25890 primary data records. [2025-09-29T22:06:39.491817] [DEBUG] [LOCAL ] CEE: Derivative data saved (1794 records). [2025-09-29T22:06:39.531285] [INFO ] [MAIN ] CEE: Successfully saved derivative data. [2025-09-29T22:06:39.674796] [INFO ] [MAIN ] Derivative Progress: 341/2057 symbols completed. CEE took 1.2s. Estimated remaining: 11m 41s. Rate: 146.8 symbols/min [2025-09-29T22:06:39.690503] [INFO ] [MAIN ] CFG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:39.711898] [DEBUG] [LOCAL ] CF: Loaded 52195 existing records from primary storage. [2025-09-29T22:06:39.713435] [INFO ] [MAIN ] CF: Loaded 52195 primary data records. [2025-09-29T22:06:40.085944] [DEBUG] [MAIN ] CEPU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:40.087909] [INFO ] [MAIN ] CEPU: Generated 1794 derivative records from 25890 primary records. [2025-09-29T22:06:40.088129] [DEBUG] [LOCAL ] CEPU: Saving derivative data. [2025-09-29T22:06:40.091182] [DEBUG] [LOCAL ] CFG: Loaded 53624 existing records from primary storage. [2025-09-29T22:06:40.091458] [INFO ] [MAIN ] CFG: Loaded 53624 primary data records. [2025-09-29T22:06:40.183535] [DEBUG] [LOCAL ] CEPU: Derivative data saved (1794 records). [2025-09-29T22:06:40.206894] [INFO ] [MAIN ] CEPU: Successfully saved derivative data. [2025-09-29T22:06:40.217238] [INFO ] [MAIN ] Derivative Progress: 342/2057 symbols completed. CEPU took 1.0s. Estimated remaining: 11m 42s. Rate: 146.7 symbols/min [2025-09-29T22:06:40.221238] [INFO ] [MAIN ] CFR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:40.491309] [DEBUG] [MAIN ] CF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:40.492519] [INFO ] [MAIN ] CF: Generated 1794 derivative records from 52195 primary records. [2025-09-29T22:06:40.492858] [DEBUG] [LOCAL ] CF: Saving derivative data. [2025-09-29T22:06:40.523228] [DEBUG] [LOCAL ] CFR: Loaded 33412 existing records from primary storage. [2025-09-29T22:06:40.522499] [DEBUG] [LOCAL ] CF: Derivative data saved (1794 records). [2025-09-29T22:06:40.523870] [INFO ] [MAIN ] CFR: Loaded 33412 primary data records. [2025-09-29T22:06:40.524021] [INFO ] [MAIN ] CF: Successfully saved derivative data. [2025-09-29T22:06:40.531542] [INFO ] [MAIN ] Derivative Progress: 343/2057 symbols completed. CF took 1.2s. Estimated remaining: 11m 41s. Rate: 146.8 symbols/min [2025-09-29T22:06:40.743102] [DEBUG] [MAIN ] CFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:40.871351] [INFO ] [MAIN ] CFG: Generated 1794 derivative records from 53624 primary records. [2025-09-29T22:06:40.871679] [DEBUG] [LOCAL ] CFG: Saving derivative data. [2025-09-29T22:06:40.893552] [DEBUG] [LOCAL ] CFG: Derivative data saved (1794 records). [2025-09-29T22:06:40.894808] [INFO ] [MAIN ] CFG: Successfully saved derivative data. [2025-09-29T22:06:40.899413] [INFO ] [MAIN ] Derivative Progress: 344/2057 symbols completed. CFG took 1.2s. Estimated remaining: 11m 40s. Rate: 146.8 symbols/min [2025-09-29T22:06:40.918209] [DEBUG] [MAIN ] CFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:40.918908] [INFO ] [MAIN ] CFR: Generated 1794 derivative records from 33412 primary records. [2025-09-29T22:06:40.918974] [DEBUG] [LOCAL ] CFR: Saving derivative data. [2025-09-29T22:06:40.934552] [DEBUG] [LOCAL ] CFR: Derivative data saved (1794 records). [2025-09-29T22:06:40.934634] [INFO ] [MAIN ] CFR: Successfully saved derivative data. [2025-09-29T22:06:40.937024] [INFO ] [MAIN ] Derivative Progress: 345/2057 symbols completed. CFR took 0.7s. Estimated remaining: 11m 38s. Rate: 147.2 symbols/min [2025-09-29T22:06:40.937886] [INFO ] [MAIN ] CGAU: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:40.938366] [INFO ] [MAIN ] CHCT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:40.938312] [INFO ] [MAIN ] CHD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:40.975873] [DEBUG] [LOCAL ] CHCT: Loaded 23872 existing records from primary storage. [2025-09-29T22:06:40.976066] [INFO ] [MAIN ] CHCT: Loaded 23872 primary data records. [2025-09-29T22:06:41.226298] [DEBUG] [LOCAL ] CHD: Loaded 52043 existing records from primary storage. [2025-09-29T22:06:41.340242] [DEBUG] [LOCAL ] CGAU: Loaded 42672 existing records from primary storage. [2025-09-29T22:06:41.354223] [INFO ] [MAIN ] CHD: Loaded 52043 primary data records. [2025-09-29T22:06:41.354478] [INFO ] [MAIN ] CGAU: Loaded 42672 primary data records. [2025-09-29T22:06:42.076158] [DEBUG] [MAIN ] CHCT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:42.077361] [INFO ] [MAIN ] CHCT: Generated 1794 derivative records from 23872 primary records. [2025-09-29T22:06:42.077920] [DEBUG] [LOCAL ] CHCT: Saving derivative data. [2025-09-29T22:06:42.098168] [DEBUG] [LOCAL ] CHCT: Derivative data saved (1794 records). [2025-09-29T22:06:42.098665] [INFO ] [MAIN ] CHCT: Successfully saved derivative data. [2025-09-29T22:06:42.101008] [INFO ] [MAIN ] Derivative Progress: 346/2057 symbols completed. CHCT took 1.2s. Estimated remaining: 11m 41s. Rate: 146.4 symbols/min [2025-09-29T22:06:42.101440] [INFO ] [MAIN ] CHE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:42.137846] [DEBUG] [MAIN ] CGAU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:42.143502] [INFO ] [MAIN ] CGAU: Generated 1794 derivative records from 42672 primary records. [2025-09-29T22:06:42.142602] [DEBUG] [MAIN ] CHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:42.143780] [DEBUG] [LOCAL ] CGAU: Saving derivative data. [2025-09-29T22:06:42.144704] [INFO ] [MAIN ] CHD: Generated 1794 derivative records from 52043 primary records. [2025-09-29T22:06:42.145525] [DEBUG] [LOCAL ] CHD: Saving derivative data. [2025-09-29T22:06:42.163232] [DEBUG] [LOCAL ] CHE: Loaded 14789 existing records from primary storage. [2025-09-29T22:06:42.163381] [INFO ] [MAIN ] CHE: Loaded 14789 primary data records. [2025-09-29T22:06:42.230280] [DEBUG] [LOCAL ] CHD: Derivative data saved (1794 records). [2025-09-29T22:06:42.238754] [INFO ] [MAIN ] CHD: Successfully saved derivative data. [2025-09-29T22:06:42.241705] [INFO ] [MAIN ] Derivative Progress: 347/2057 symbols completed. CHD took 1.3s. Estimated remaining: 11m 39s. Rate: 146.7 symbols/min [2025-09-29T22:06:42.241988] [INFO ] [MAIN ] CHGG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:42.284416] [DEBUG] [LOCAL ] CGAU: Derivative data saved (1794 records). [2025-09-29T22:06:42.296415] [INFO ] [MAIN ] CGAU: Successfully saved derivative data. [2025-09-29T22:06:42.299415] [INFO ] [MAIN ] Derivative Progress: 348/2057 symbols completed. CGAU took 1.4s. Estimated remaining: 11m 37s. Rate: 147.1 symbols/min [2025-09-29T22:06:42.310232] [INFO ] [MAIN ] CHH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:42.599243] [DEBUG] [LOCAL ] CHGG: Loaded 47693 existing records from primary storage. [2025-09-29T22:06:42.609580] [INFO ] [MAIN ] CHGG: Loaded 47693 primary data records. [2025-09-29T22:06:42.610449] [DEBUG] [LOCAL ] CHH: Loaded 32071 existing records from primary storage. [2025-09-29T22:06:42.660991] [INFO ] [MAIN ] CHH: Loaded 32071 primary data records. [2025-09-29T22:06:42.774182] [DEBUG] [MAIN ] CHE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:42.775063] [INFO ] [MAIN ] CHE: Generated 1794 derivative records from 14789 primary records. [2025-09-29T22:06:42.775151] [DEBUG] [LOCAL ] CHE: Saving derivative data. [2025-09-29T22:06:42.923056] [DEBUG] [LOCAL ] CHE: Derivative data saved (1794 records). [2025-09-29T22:06:42.947335] [INFO ] [MAIN ] CHE: Successfully saved derivative data. [2025-09-29T22:06:42.971252] [INFO ] [MAIN ] Derivative Progress: 349/2057 symbols completed. CHE took 0.9s. Estimated remaining: 11m 38s. Rate: 146.8 symbols/min [2025-09-29T22:06:42.973280] [INFO ] [MAIN ] CHMI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:43.359687] [DEBUG] [LOCAL ] CHMI: Loaded 21938 existing records from primary storage. [2025-09-29T22:06:43.360729] [INFO ] [MAIN ] CHMI: Loaded 21938 primary data records. [2025-09-29T22:06:43.571245] [DEBUG] [MAIN ] CHH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:43.571567] [DEBUG] [MAIN ] CHGG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:43.597087] [INFO ] [MAIN ] CHH: Generated 1794 derivative records from 32071 primary records. [2025-09-29T22:06:43.601701] [DEBUG] [LOCAL ] CHH: Saving derivative data. [2025-09-29T22:06:43.732504] [INFO ] [MAIN ] CHGG: Generated 1794 derivative records from 47693 primary records. [2025-09-29T22:06:43.734042] [DEBUG] [LOCAL ] CHGG: Saving derivative data. [2025-09-29T22:06:43.762919] [DEBUG] [LOCAL ] CHH: Derivative data saved (1794 records). [2025-09-29T22:06:43.771559] [DEBUG] [LOCAL ] CHGG: Derivative data saved (1794 records). [2025-09-29T22:06:43.772004] [INFO ] [MAIN ] CHH: Successfully saved derivative data. [2025-09-29T22:06:43.774230] [INFO ] [MAIN ] Derivative Progress: 350/2057 symbols completed. CHH took 1.5s. Estimated remaining: 11m 40s. Rate: 146.4 symbols/min [2025-09-29T22:06:43.774435] [INFO ] [MAIN ] CHGG: Successfully saved derivative data. [2025-09-29T22:06:43.777746] [INFO ] [MAIN ] CHN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:43.777936] [INFO ] [MAIN ] Derivative Progress: 351/2057 symbols completed. CHGG took 1.5s. Estimated remaining: 11m 37s. Rate: 146.8 symbols/min [2025-09-29T22:06:43.778680] [INFO ] [MAIN ] CHPT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:43.787709] [DEBUG] [LOCAL ] CHN: Loaded 4812 existing records from primary storage. [2025-09-29T22:06:43.788118] [INFO ] [MAIN ] CHN: Loaded 4812 primary data records. [2025-09-29T22:06:44.017665] [DEBUG] [MAIN ] CHMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:44.143371] [INFO ] [MAIN ] CHMI: Generated 1794 derivative records from 21938 primary records. [2025-09-29T22:06:44.144365] [DEBUG] [LOCAL ] CHMI: Saving derivative data. [2025-09-29T22:06:44.171600] [DEBUG] [LOCAL ] CHPT: Loaded 48897 existing records from primary storage. [2025-09-29T22:06:44.175319] [INFO ] [MAIN ] CHPT: Loaded 48897 primary data records. [2025-09-29T22:06:44.217417] [DEBUG] [LOCAL ] CHMI: Derivative data saved (1794 records). [2025-09-29T22:06:44.217563] [INFO ] [MAIN ] CHMI: Successfully saved derivative data. [2025-09-29T22:06:44.227681] [INFO ] [MAIN ] Derivative Progress: 352/2057 symbols completed. CHMI took 1.3s. Estimated remaining: 11m 37s. Rate: 146.8 symbols/min [2025-09-29T22:06:44.250473] [INFO ] [MAIN ] CHT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:44.574815] [DEBUG] [LOCAL ] CHT: Loaded 19553 existing records from primary storage. [2025-09-29T22:06:44.575137] [DEBUG] [MAIN ] CHN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:44.575998] [INFO ] [MAIN ] CHN: Generated 1794 derivative records from 4812 primary records. [2025-09-29T22:06:44.576212] [DEBUG] [LOCAL ] CHN: Saving derivative data. [2025-09-29T22:06:44.576276] [INFO ] [MAIN ] CHT: Loaded 19553 primary data records. [2025-09-29T22:06:44.667446] [DEBUG] [LOCAL ] CHN: Derivative data saved (1794 records). [2025-09-29T22:06:44.680282] [INFO ] [MAIN ] CHN: Successfully saved derivative data. [2025-09-29T22:06:44.695093] [INFO ] [MAIN ] Derivative Progress: 353/2057 symbols completed. CHN took 0.9s. Estimated remaining: 11m 37s. Rate: 146.7 symbols/min [2025-09-29T22:06:44.703567] [INFO ] [MAIN ] CHWY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:44.937819] [DEBUG] [MAIN ] CHPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:44.938636] [INFO ] [MAIN ] CHPT: Generated 1794 derivative records from 48897 primary records. [2025-09-29T22:06:44.939153] [DEBUG] [LOCAL ] CHPT: Saving derivative data. [2025-09-29T22:06:44.956897] [DEBUG] [LOCAL ] CHPT: Derivative data saved (1794 records). [2025-09-29T22:06:44.971423] [INFO ] [MAIN ] CHPT: Successfully saved derivative data. [2025-09-29T22:06:44.973595] [INFO ] [MAIN ] Derivative Progress: 354/2057 symbols completed. CHPT took 1.2s. Estimated remaining: 11m 36s. Rate: 146.8 symbols/min [2025-09-29T22:06:44.974020] [INFO ] [MAIN ] CI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:45.007014] [DEBUG] [MAIN ] CHT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:45.009756] [INFO ] [MAIN ] CHT: Generated 1794 derivative records from 19553 primary records. [2025-09-29T22:06:45.009896] [DEBUG] [LOCAL ] CHT: Saving derivative data. [2025-09-29T22:06:45.011047] [DEBUG] [LOCAL ] CHWY: Loaded 53654 existing records from primary storage. [2025-09-29T22:06:45.012061] [INFO ] [MAIN ] CHWY: Loaded 53654 primary data records. [2025-09-29T22:06:45.229072] [DEBUG] [LOCAL ] CHT: Derivative data saved (1794 records). [2025-09-29T22:06:45.368445] [INFO ] [MAIN ] CHT: Successfully saved derivative data. [2025-09-29T22:06:45.372402] [INFO ] [MAIN ] Derivative Progress: 355/2057 symbols completed. CHT took 1.1s. Estimated remaining: 11m 35s. Rate: 146.8 symbols/min [2025-09-29T22:06:45.372598] [INFO ] [MAIN ] CIA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:45.369818] [DEBUG] [LOCAL ] CI: Loaded 49743 existing records from primary storage. [2025-09-29T22:06:45.373013] [INFO ] [MAIN ] CI: Loaded 49743 primary data records. [2025-09-29T22:06:45.494288] [DEBUG] [LOCAL ] CIA: Loaded 16973 existing records from primary storage. [2025-09-29T22:06:45.510304] [INFO ] [MAIN ] CIA: Loaded 16973 primary data records. [2025-09-29T22:06:45.899260] [DEBUG] [MAIN ] CHWY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:45.941812] [INFO ] [MAIN ] CHWY: Generated 1794 derivative records from 53654 primary records. [2025-09-29T22:06:46.064891] [DEBUG] [LOCAL ] CHWY: Saving derivative data. [2025-09-29T22:06:46.087353] [DEBUG] [LOCAL ] CHWY: Derivative data saved (1794 records). [2025-09-29T22:06:46.088038] [INFO ] [MAIN ] CHWY: Successfully saved derivative data. [2025-09-29T22:06:46.090584] [INFO ] [MAIN ] Derivative Progress: 356/2057 symbols completed. CHWY took 1.4s. Estimated remaining: 11m 36s. Rate: 146.5 symbols/min [2025-09-29T22:06:46.090826] [INFO ] [MAIN ] CIB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:46.112559] [DEBUG] [MAIN ] CI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:46.113460] [INFO ] [MAIN ] CI: Generated 1794 derivative records from 49743 primary records. [2025-09-29T22:06:46.113767] [DEBUG] [LOCAL ] CI: Saving derivative data. [2025-09-29T22:06:46.141758] [DEBUG] [LOCAL ] CI: Derivative data saved (1794 records). [2025-09-29T22:06:46.142544] [INFO ] [MAIN ] CI: Successfully saved derivative data. [2025-09-29T22:06:46.144990] [INFO ] [MAIN ] Derivative Progress: 357/2057 symbols completed. CI took 1.2s. Estimated remaining: 11m 34s. Rate: 146.9 symbols/min [2025-09-29T22:06:46.145385] [INFO ] [MAIN ] CIEN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:46.159484] [DEBUG] [MAIN ] CIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:46.170545] [INFO ] [MAIN ] CIA: Generated 1794 derivative records from 16973 primary records. [2025-09-29T22:06:46.170719] [DEBUG] [LOCAL ] CIA: Saving derivative data. [2025-09-29T22:06:46.172163] [DEBUG] [LOCAL ] CIB: Loaded 30906 existing records from primary storage. [2025-09-29T22:06:46.183553] [INFO ] [MAIN ] CIB: Loaded 30906 primary data records. [2025-09-29T22:06:46.187933] [DEBUG] [LOCAL ] CIA: Derivative data saved (1794 records). [2025-09-29T22:06:46.210853] [INFO ] [MAIN ] CIA: Successfully saved derivative data. [2025-09-29T22:06:46.224025] [INFO ] [MAIN ] Derivative Progress: 358/2057 symbols completed. CIA took 0.9s. Estimated remaining: 11m 32s. Rate: 147.2 symbols/min [2025-09-29T22:06:46.532969] [DEBUG] [LOCAL ] CIEN: Loaded 52074 existing records from primary storage. [2025-09-29T22:06:46.534123] [INFO ] [MAIN ] CIEN: Loaded 52074 primary data records. [2025-09-29T22:06:46.907366] [DEBUG] [MAIN ] CIB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:46.908418] [INFO ] [MAIN ] CIB: Generated 1794 derivative records from 30906 primary records. [2025-09-29T22:06:46.908751] [DEBUG] [LOCAL ] CIB: Saving derivative data. [2025-09-29T22:06:46.926629] [DEBUG] [LOCAL ] CIB: Derivative data saved (1794 records). [2025-09-29T22:06:46.926882] [INFO ] [MAIN ] CIB: Successfully saved derivative data. [2025-09-29T22:06:46.929263] [INFO ] [MAIN ] Derivative Progress: 359/2057 symbols completed. CIB took 0.8s. Estimated remaining: 11m 33s. Rate: 146.9 symbols/min [2025-09-29T22:06:46.949285] [DEBUG] [MAIN ] CIEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:46.949994] [INFO ] [MAIN ] CIEN: Generated 1794 derivative records from 52074 primary records. [2025-09-29T22:06:46.950061] [DEBUG] [LOCAL ] CIEN: Saving derivative data. [2025-09-29T22:06:46.966208] [DEBUG] [LOCAL ] CIEN: Derivative data saved (1794 records). [2025-09-29T22:06:46.966353] [INFO ] [MAIN ] CIEN: Successfully saved derivative data. [2025-09-29T22:06:46.968733] [INFO ] [MAIN ] Derivative Progress: 360/2057 symbols completed. CIEN took 0.8s. Estimated remaining: 11m 31s. Rate: 147.3 symbols/min [2025-09-29T22:06:46.969214] [INFO ] [MAIN ] CII: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:46.969165] [INFO ] [MAIN ] CIF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:46.969267] [INFO ] [MAIN ] CIG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:46.977750] [DEBUG] [LOCAL ] CIF: Loaded 4271 existing records from primary storage. [2025-09-29T22:06:46.977895] [INFO ] [MAIN ] CIF: Loaded 4271 primary data records. [2025-09-29T22:06:47.086855] [DEBUG] [LOCAL ] CII: Loaded 15286 existing records from primary storage. [2025-09-29T22:06:47.100111] [INFO ] [MAIN ] CII: Loaded 15286 primary data records. [2025-09-29T22:06:47.478928] [DEBUG] [LOCAL ] CIG: Loaded 43863 existing records from primary storage. [2025-09-29T22:06:47.500572] [INFO ] [MAIN ] CIG: Loaded 43863 primary data records. [2025-09-29T22:06:48.016207] [DEBUG] [MAIN ] CIF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:48.018390] [INFO ] [MAIN ] CIF: Generated 1794 derivative records from 4271 primary records. [2025-09-29T22:06:48.018674] [DEBUG] [LOCAL ] CIF: Saving derivative data. [2025-09-29T22:06:48.034435] [DEBUG] [LOCAL ] CIF: Derivative data saved (1794 records). [2025-09-29T22:06:48.034732] [INFO ] [MAIN ] CIF: Successfully saved derivative data. [2025-09-29T22:06:48.037200] [INFO ] [MAIN ] Derivative Progress: 361/2057 symbols completed. CIF took 1.1s. Estimated remaining: 11m 34s. Rate: 146.6 symbols/min [2025-09-29T22:06:48.038610] [INFO ] [MAIN ] CIM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:48.056203] [DEBUG] [MAIN ] CII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:48.057158] [INFO ] [MAIN ] CII: Generated 1794 derivative records from 15286 primary records. [2025-09-29T22:06:48.057499] [DEBUG] [LOCAL ] CII: Saving derivative data. [2025-09-29T22:06:48.077790] [DEBUG] [LOCAL ] CII: Derivative data saved (1794 records). [2025-09-29T22:06:48.078094] [INFO ] [MAIN ] CII: Successfully saved derivative data. [2025-09-29T22:06:48.091952] [INFO ] [MAIN ] Derivative Progress: 362/2057 symbols completed. CII took 1.1s. Estimated remaining: 11m 32s. Rate: 147.0 symbols/min [2025-09-29T22:06:48.097418] [INFO ] [MAIN ] CIMN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:48.108189] [DEBUG] [MAIN ] CIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:48.108943] [INFO ] [MAIN ] CIG: Generated 1794 derivative records from 43863 primary records. [2025-09-29T22:06:48.109161] [DEBUG] [LOCAL ] CIG: Saving derivative data. [2025-09-29T22:06:48.125446] [DEBUG] [LOCAL ] CIMN: Loaded 2664 existing records from primary storage. [2025-09-29T22:06:48.126409] [INFO ] [MAIN ] CIMN: Loaded 2664 primary data records. [2025-09-29T22:06:48.210588] [DEBUG] [LOCAL ] CIM: Loaded 37273 existing records from primary storage. [2025-09-29T22:06:48.223327] [INFO ] [MAIN ] CIM: Loaded 37273 primary data records. [2025-09-29T22:06:48.234900] [DEBUG] [LOCAL ] CIG: Derivative data saved (1794 records). [2025-09-29T22:06:48.264671] [INFO ] [MAIN ] CIG: Successfully saved derivative data. [2025-09-29T22:06:48.293504] [INFO ] [MAIN ] Derivative Progress: 363/2057 symbols completed. CIG took 1.3s. Estimated remaining: 11m 31s. Rate: 147.2 symbols/min [2025-09-29T22:06:48.307098] [INFO ] [MAIN ] CINT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:48.859178] [DEBUG] [LOCAL ] CINT: Loaded 18619 existing records from primary storage. [2025-09-29T22:06:48.876613] [INFO ] [MAIN ] CINT: Loaded 18619 primary data records. [2025-09-29T22:06:49.231618] [DEBUG] [MAIN ] CIMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:49.232861] [INFO ] [MAIN ] CIMN: Generated 1794 derivative records from 2664 primary records. [2025-09-29T22:06:49.233073] [DEBUG] [LOCAL ] CIMN: Saving derivative data. [2025-09-29T22:06:49.253154] [DEBUG] [LOCAL ] CIMN: Derivative data saved (1794 records). [2025-09-29T22:06:49.266279] [INFO ] [MAIN ] CIMN: Successfully saved derivative data. [2025-09-29T22:06:49.268849] [INFO ] [MAIN ] Derivative Progress: 364/2057 symbols completed. CIMN took 1.2s. Estimated remaining: 11m 33s. Rate: 146.6 symbols/min [2025-09-29T22:06:49.269081] [INFO ] [MAIN ] CIO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:49.270796] [DEBUG] [MAIN ] CIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:49.271532] [INFO ] [MAIN ] CIM: Generated 1794 derivative records from 37273 primary records. [2025-09-29T22:06:49.271750] [DEBUG] [LOCAL ] CIM: Saving derivative data. [2025-09-29T22:06:49.289283] [DEBUG] [LOCAL ] CIM: Derivative data saved (1794 records). [2025-09-29T22:06:49.292005] [INFO ] [MAIN ] CIM: Successfully saved derivative data. [2025-09-29T22:06:49.295819] [INFO ] [MAIN ] Derivative Progress: 365/2057 symbols completed. CIM took 1.3s. Estimated remaining: 11m 31s. Rate: 147.0 symbols/min [2025-09-29T22:06:49.296426] [INFO ] [MAIN ] CION: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:49.316780] [DEBUG] [MAIN ] CINT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:49.317759] [INFO ] [MAIN ] CINT: Generated 1794 derivative records from 18619 primary records. [2025-09-29T22:06:49.318002] [DEBUG] [LOCAL ] CINT: Saving derivative data. [2025-09-29T22:06:49.340725] [DEBUG] [LOCAL ] CIO: Loaded 20139 existing records from primary storage. [2025-09-29T22:06:49.341371] [INFO ] [MAIN ] CIO: Loaded 20139 primary data records. [2025-09-29T22:06:49.431554] [DEBUG] [LOCAL ] CINT: Derivative data saved (1794 records). [2025-09-29T22:06:49.468579] [INFO ] [MAIN ] CINT: Successfully saved derivative data. [2025-09-29T22:06:49.479951] [DEBUG] [LOCAL ] CION: Loaded 29154 existing records from primary storage. [2025-09-29T22:06:49.492932] [INFO ] [MAIN ] Derivative Progress: 366/2057 symbols completed. CINT took 1.2s. Estimated remaining: 11m 29s. Rate: 147.2 symbols/min [2025-09-29T22:06:49.498298] [INFO ] [MAIN ] CIVI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:49.498209] [INFO ] [MAIN ] CION: Loaded 29154 primary data records. [2025-09-29T22:06:50.061307] [DEBUG] [LOCAL ] CIVI: Loaded 52585 existing records from primary storage. [2025-09-29T22:06:50.060044] [DEBUG] [MAIN ] CIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:50.061617] [INFO ] [MAIN ] CIVI: Loaded 52585 primary data records. [2025-09-29T22:06:50.062492] [INFO ] [MAIN ] CIO: Generated 1794 derivative records from 20139 primary records. [2025-09-29T22:06:50.062887] [DEBUG] [LOCAL ] CIO: Saving derivative data. [2025-09-29T22:06:50.198237] [DEBUG] [LOCAL ] CIO: Derivative data saved (1794 records). [2025-09-29T22:06:50.238487] [INFO ] [MAIN ] CIO: Successfully saved derivative data. [2025-09-29T22:06:50.248583] [INFO ] [MAIN ] Derivative Progress: 367/2057 symbols completed. CIO took 1.0s. Estimated remaining: 11m 30s. Rate: 146.9 symbols/min [2025-09-29T22:06:50.268856] [INFO ] [MAIN ] CL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:50.404370] [DEBUG] [MAIN ] CION: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:50.420525] [INFO ] [MAIN ] CION: Generated 1794 derivative records from 29154 primary records. [2025-09-29T22:06:50.420619] [DEBUG] [LOCAL ] CION: Saving derivative data. [2025-09-29T22:06:50.444298] [DEBUG] [LOCAL ] CION: Derivative data saved (1794 records). [2025-09-29T22:06:50.444817] [INFO ] [MAIN ] CION: Successfully saved derivative data. [2025-09-29T22:06:50.447683] [INFO ] [MAIN ] Derivative Progress: 368/2057 symbols completed. CION took 1.2s. Estimated remaining: 11m 29s. Rate: 147.1 symbols/min [2025-09-29T22:06:50.448238] [INFO ] [MAIN ] CLB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:50.486308] [DEBUG] [MAIN ] CIVI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:50.487270] [INFO ] [MAIN ] CIVI: Generated 1794 derivative records from 52585 primary records. [2025-09-29T22:06:50.487617] [DEBUG] [LOCAL ] CIVI: Saving derivative data. [2025-09-29T22:06:50.507087] [DEBUG] [LOCAL ] CIVI: Derivative data saved (1794 records). [2025-09-29T22:06:50.514494] [INFO ] [MAIN ] CIVI: Successfully saved derivative data. [2025-09-29T22:06:50.532493] [INFO ] [MAIN ] Derivative Progress: 369/2057 symbols completed. CIVI took 1.0s. Estimated remaining: 11m 27s. Rate: 147.4 symbols/min [2025-09-29T22:06:50.534808] [INFO ] [MAIN ] CLCO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:50.537277] [DEBUG] [LOCAL ] CL: Loaded 53644 existing records from primary storage. [2025-09-29T22:06:50.537772] [INFO ] [MAIN ] CL: Loaded 53644 primary data records. [2025-09-29T22:06:50.677697] [DEBUG] [LOCAL ] CLB: Loaded 32878 existing records from primary storage. [2025-09-29T22:06:50.686849] [DEBUG] [LOCAL ] CLCO: Loaded 12684 existing records from primary storage. [2025-09-29T22:06:50.687403] [INFO ] [MAIN ] CLB: Loaded 32878 primary data records. [2025-09-29T22:06:50.703193] [INFO ] [MAIN ] CLCO: Loaded 12684 primary data records. [2025-09-29T22:06:51.600246] [DEBUG] [MAIN ] CL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:51.601333] [INFO ] [MAIN ] CL: Generated 1794 derivative records from 53644 primary records. [2025-09-29T22:06:51.601446] [DEBUG] [LOCAL ] CL: Saving derivative data. [2025-09-29T22:06:51.623681] [DEBUG] [LOCAL ] CL: Derivative data saved (1794 records). [2025-09-29T22:06:51.624111] [INFO ] [MAIN ] CL: Successfully saved derivative data. [2025-09-29T22:06:51.639597] [INFO ] [MAIN ] Derivative Progress: 370/2057 symbols completed. CL took 1.4s. Estimated remaining: 11m 30s. Rate: 146.7 symbols/min [2025-09-29T22:06:51.640307] [DEBUG] [MAIN ] CLB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:51.640500] [INFO ] [MAIN ] CLDT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:51.641317] [INFO ] [MAIN ] CLB: Generated 1794 derivative records from 32878 primary records. [2025-09-29T22:06:51.641822] [DEBUG] [LOCAL ] CLB: Saving derivative data. [2025-09-29T22:06:51.664633] [DEBUG] [MAIN ] CLCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:51.669508] [INFO ] [MAIN ] CLCO: Generated 1794 derivative records from 12684 primary records. [2025-09-29T22:06:51.669911] [DEBUG] [LOCAL ] CLCO: Saving derivative data. [2025-09-29T22:06:51.688827] [DEBUG] [LOCAL ] CLCO: Derivative data saved (1794 records). [2025-09-29T22:06:51.696757] [INFO ] [MAIN ] CLCO: Successfully saved derivative data. [2025-09-29T22:06:51.699633] [INFO ] [MAIN ] Derivative Progress: 371/2057 symbols completed. CLCO took 1.2s. Estimated remaining: 11m 28s. Rate: 147.1 symbols/min [2025-09-29T22:06:51.700151] [INFO ] [MAIN ] CLF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:51.701889] [DEBUG] [LOCAL ] CLB: Derivative data saved (1794 records). [2025-09-29T22:06:51.701961] [INFO ] [MAIN ] CLB: Successfully saved derivative data. [2025-09-29T22:06:51.704335] [INFO ] [MAIN ] Derivative Progress: 372/2057 symbols completed. CLB took 1.3s. Estimated remaining: 11m 26s. Rate: 147.4 symbols/min [2025-09-29T22:06:51.704728] [INFO ] [MAIN ] CLH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:51.714886] [DEBUG] [LOCAL ] CLDT: Loaded 25475 existing records from primary storage. [2025-09-29T22:06:51.715217] [INFO ] [MAIN ] CLDT: Loaded 25475 primary data records. [2025-09-29T22:06:51.923707] [DEBUG] [LOCAL ] CLH: Loaded 27795 existing records from primary storage. [2025-09-29T22:06:52.055929] [INFO ] [MAIN ] CLH: Loaded 27795 primary data records. [2025-09-29T22:06:52.157920] [DEBUG] [LOCAL ] CLF: Loaded 53741 existing records from primary storage. [2025-09-29T22:06:52.163666] [INFO ] [MAIN ] CLF: Loaded 53741 primary data records. [2025-09-29T22:06:52.755198] [DEBUG] [MAIN ] CLDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:52.757412] [INFO ] [MAIN ] CLDT: Generated 1794 derivative records from 25475 primary records. [2025-09-29T22:06:52.758244] [DEBUG] [LOCAL ] CLDT: Saving derivative data. [2025-09-29T22:06:52.779231] [DEBUG] [LOCAL ] CLDT: Derivative data saved (1794 records). [2025-09-29T22:06:52.779503] [INFO ] [MAIN ] CLDT: Successfully saved derivative data. [2025-09-29T22:06:52.782154] [INFO ] [MAIN ] Derivative Progress: 373/2057 symbols completed. CLDT took 1.1s. Estimated remaining: 11m 28s. Rate: 146.8 symbols/min [2025-09-29T22:06:52.801525] [DEBUG] [MAIN ] CLH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:52.802675] [INFO ] [MAIN ] CLH: Generated 1794 derivative records from 27795 primary records. [2025-09-29T22:06:52.802815] [DEBUG] [LOCAL ] CLH: Saving derivative data. [2025-09-29T22:06:52.835484] [DEBUG] [MAIN ] CLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:52.836835] [INFO ] [MAIN ] CLF: Generated 1794 derivative records from 53741 primary records. [2025-09-29T22:06:52.837347] [DEBUG] [LOCAL ] CLF: Saving derivative data. [2025-09-29T22:06:52.837291] [DEBUG] [LOCAL ] CLH: Derivative data saved (1794 records). [2025-09-29T22:06:52.837889] [INFO ] [MAIN ] CLH: Successfully saved derivative data. [2025-09-29T22:06:52.840922] [INFO ] [MAIN ] Derivative Progress: 374/2057 symbols completed. CLH took 1.1s. Estimated remaining: 11m 26s. Rate: 147.1 symbols/min [2025-09-29T22:06:52.856801] [DEBUG] [LOCAL ] CLF: Derivative data saved (1794 records). [2025-09-29T22:06:52.856884] [INFO ] [MAIN ] CLF: Successfully saved derivative data. [2025-09-29T22:06:52.859959] [INFO ] [MAIN ] Derivative Progress: 375/2057 symbols completed. CLF took 1.2s. Estimated remaining: 11m 24s. Rate: 147.5 symbols/min [2025-09-29T22:06:52.860616] [INFO ] [MAIN ] CLS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:52.860523] [INFO ] [MAIN ] CLPR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:52.860820] [INFO ] [MAIN ] CLVT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:52.879550] [DEBUG] [LOCAL ] CLPR: Loaded 11464 existing records from primary storage. [2025-09-29T22:06:52.884610] [INFO ] [MAIN ] CLPR: Loaded 11464 primary data records. [2025-09-29T22:06:53.180925] [DEBUG] [LOCAL ] CLVT: Loaded 51942 existing records from primary storage. [2025-09-29T22:06:53.291605] [INFO ] [MAIN ] CLVT: Loaded 51942 primary data records. [2025-09-29T22:06:53.364863] [DEBUG] [LOCAL ] CLS: Loaded 53629 existing records from primary storage. [2025-09-29T22:06:53.387555] [INFO ] [MAIN ] CLS: Loaded 53629 primary data records. [2025-09-29T22:06:53.994613] [DEBUG] [MAIN ] CLPR: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:06:53.995578] [INFO ] [MAIN ] CLPR: Generated 1793 derivative records from 11464 primary records. [2025-09-29T22:06:53.995718] [DEBUG] [LOCAL ] CLPR: Saving derivative data. [2025-09-29T22:06:54.013904] [DEBUG] [LOCAL ] CLPR: Derivative data saved (1793 records). [2025-09-29T22:06:54.014164] [INFO ] [MAIN ] CLPR: Successfully saved derivative data. [2025-09-29T22:06:54.017128] [INFO ] [MAIN ] Derivative Progress: 376/2057 symbols completed. CLPR took 1.2s. Estimated remaining: 11m 27s. Rate: 146.8 symbols/min [2025-09-29T22:06:54.018272] [INFO ] [MAIN ] CLW: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:54.036771] [DEBUG] [MAIN ] CLVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:54.037781] [INFO ] [MAIN ] CLVT: Generated 1794 derivative records from 51942 primary records. [2025-09-29T22:06:54.038052] [DEBUG] [LOCAL ] CLVT: Saving derivative data. [2025-09-29T22:06:54.072183] [DEBUG] [MAIN ] CLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:54.074199] [INFO ] [MAIN ] CLS: Generated 1794 derivative records from 53629 primary records. [2025-09-29T22:06:54.074584] [DEBUG] [LOCAL ] CLS: Saving derivative data. [2025-09-29T22:06:54.096219] [DEBUG] [LOCAL ] CLW: Loaded 21833 existing records from primary storage. [2025-09-29T22:06:54.096319] [DEBUG] [LOCAL ] CLVT: Derivative data saved (1794 records). [2025-09-29T22:06:54.096585] [INFO ] [MAIN ] CLW: Loaded 21833 primary data records. [2025-09-29T22:06:54.096508] [INFO ] [MAIN ] CLVT: Successfully saved derivative data. [2025-09-29T22:06:54.107994] [INFO ] [MAIN ] Derivative Progress: 377/2057 symbols completed. CLVT took 1.2s. Estimated remaining: 11m 25s. Rate: 147.1 symbols/min [2025-09-29T22:06:54.118785] [DEBUG] [LOCAL ] CLS: Derivative data saved (1794 records). [2025-09-29T22:06:54.128977] [INFO ] [MAIN ] CLS: Successfully saved derivative data. [2025-09-29T22:06:54.128806] [INFO ] [MAIN ] CLX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:54.147134] [INFO ] [MAIN ] Derivative Progress: 378/2057 symbols completed. CLS took 1.3s. Estimated remaining: 11m 23s. Rate: 147.4 symbols/min [2025-09-29T22:06:54.154663] [INFO ] [MAIN ] CM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:54.495767] [DEBUG] [LOCAL ] CM: Loaded 48571 existing records from primary storage. [2025-09-29T22:06:54.496391] [INFO ] [MAIN ] CM: Loaded 48571 primary data records. [2025-09-29T22:06:54.502613] [DEBUG] [LOCAL ] CLX: Loaded 51455 existing records from primary storage. [2025-09-29T22:06:54.520301] [INFO ] [MAIN ] CLX: Loaded 51455 primary data records. [2025-09-29T22:06:54.744424] [DEBUG] [MAIN ] CLW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:54.765089] [INFO ] [MAIN ] CLW: Generated 1794 derivative records from 21833 primary records. [2025-09-29T22:06:54.801805] [DEBUG] [LOCAL ] CLW: Saving derivative data. [2025-09-29T22:06:54.952906] [DEBUG] [LOCAL ] CLW: Derivative data saved (1794 records). [2025-09-29T22:06:55.237794] [INFO ] [MAIN ] CLW: Successfully saved derivative data. [2025-09-29T22:06:55.240144] [INFO ] [MAIN ] Derivative Progress: 379/2057 symbols completed. CLW took 1.2s. Estimated remaining: 11m 26s. Rate: 146.8 symbols/min [2025-09-29T22:06:55.240519] [INFO ] [MAIN ] CMA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:55.292227] [DEBUG] [MAIN ] CLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:55.293546] [INFO ] [MAIN ] CLX: Generated 1794 derivative records from 51455 primary records. [2025-09-29T22:06:55.307670] [DEBUG] [LOCAL ] CLX: Saving derivative data. [2025-09-29T22:06:55.308137] [DEBUG] [MAIN ] CM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:55.310508] [INFO ] [MAIN ] CM: Generated 1794 derivative records from 48571 primary records. [2025-09-29T22:06:55.310713] [DEBUG] [LOCAL ] CM: Saving derivative data. [2025-09-29T22:06:55.335867] [DEBUG] [LOCAL ] CLX: Derivative data saved (1794 records). [2025-09-29T22:06:55.358501] [INFO ] [MAIN ] CLX: Successfully saved derivative data. [2025-09-29T22:06:55.363939] [INFO ] [MAIN ] Derivative Progress: 380/2057 symbols completed. CLX took 1.2s. Estimated remaining: 11m 24s. Rate: 147.1 symbols/min [2025-09-29T22:06:55.364152] [INFO ] [MAIN ] CMBT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:55.359486] [DEBUG] [LOCAL ] CM: Derivative data saved (1794 records). [2025-09-29T22:06:55.364682] [INFO ] [MAIN ] CM: Successfully saved derivative data. [2025-09-29T22:06:55.367330] [INFO ] [MAIN ] Derivative Progress: 381/2057 symbols completed. CM took 1.2s. Estimated remaining: 11m 22s. Rate: 147.4 symbols/min [2025-09-29T22:06:55.367789] [INFO ] [MAIN ] CMC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:55.369697] [DEBUG] [LOCAL ] CMA: Loaded 49918 existing records from primary storage. [2025-09-29T22:06:55.371947] [INFO ] [MAIN ] CMA: Loaded 49918 primary data records. [2025-09-29T22:06:55.594363] [DEBUG] [LOCAL ] CMBT: Loaded 22930 existing records from primary storage. [2025-09-29T22:06:55.732045] [DEBUG] [LOCAL ] CMC: Loaded 45570 existing records from primary storage. [2025-09-29T22:06:55.725458] [INFO ] [MAIN ] CMBT: Loaded 22930 primary data records. [2025-09-29T22:06:55.741337] [INFO ] [MAIN ] CMC: Loaded 45570 primary data records. [2025-09-29T22:06:56.423376] [DEBUG] [MAIN ] CMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:56.425514] [INFO ] [MAIN ] CMA: Generated 1794 derivative records from 49918 primary records. [2025-09-29T22:06:56.426244] [DEBUG] [LOCAL ] CMA: Saving derivative data. [2025-09-29T22:06:56.448867] [DEBUG] [LOCAL ] CMA: Derivative data saved (1794 records). [2025-09-29T22:06:56.449632] [INFO ] [MAIN ] CMA: Successfully saved derivative data. [2025-09-29T22:06:56.452159] [INFO ] [MAIN ] Derivative Progress: 382/2057 symbols completed. CMA took 1.2s. Estimated remaining: 11m 25s. Rate: 146.8 symbols/min [2025-09-29T22:06:56.453001] [INFO ] [MAIN ] CMCM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:56.476510] [DEBUG] [LOCAL ] CMCM: Loaded 4758 existing records from primary storage. [2025-09-29T22:06:56.483136] [DEBUG] [MAIN ] CMBT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:56.483362] [INFO ] [MAIN ] CMCM: Loaded 4758 primary data records. [2025-09-29T22:06:56.521557] [INFO ] [MAIN ] CMBT: Generated 1794 derivative records from 22930 primary records. [2025-09-29T22:06:56.573744] [DEBUG] [LOCAL ] CMBT: Saving derivative data. [2025-09-29T22:06:56.584161] [DEBUG] [MAIN ] CMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:56.603978] [INFO ] [MAIN ] CMC: Generated 1794 derivative records from 45570 primary records. [2025-09-29T22:06:56.636202] [DEBUG] [LOCAL ] CMC: Saving derivative data. [2025-09-29T22:06:56.709443] [DEBUG] [LOCAL ] CMBT: Derivative data saved (1794 records). [2025-09-29T22:06:56.752314] [INFO ] [MAIN ] CMBT: Successfully saved derivative data. [2025-09-29T22:06:56.877777] [INFO ] [MAIN ] Derivative Progress: 383/2057 symbols completed. CMBT took 1.5s. Estimated remaining: 11m 24s. Rate: 146.8 symbols/min [2025-09-29T22:06:56.880145] [INFO ] [MAIN ] CMG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:56.883888] [DEBUG] [LOCAL ] CMC: Derivative data saved (1794 records). [2025-09-29T22:06:56.884433] [INFO ] [MAIN ] CMC: Successfully saved derivative data. [2025-09-29T22:06:56.886770] [INFO ] [MAIN ] Derivative Progress: 384/2057 symbols completed. CMC took 1.5s. Estimated remaining: 11m 22s. Rate: 147.2 symbols/min [2025-09-29T22:06:56.887569] [INFO ] [MAIN ] CMI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:56.926457] [DEBUG] [MAIN ] CMCM: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:06:56.927466] [INFO ] [MAIN ] CMCM: Generated 1793 derivative records from 4758 primary records. [2025-09-29T22:06:56.927704] [DEBUG] [LOCAL ] CMCM: Saving derivative data. [2025-09-29T22:06:56.968424] [DEBUG] [LOCAL ] CMCM: Derivative data saved (1793 records). [2025-09-29T22:06:56.968534] [INFO ] [MAIN ] CMCM: Successfully saved derivative data. [2025-09-29T22:06:56.970998] [INFO ] [MAIN ] Derivative Progress: 385/2057 symbols completed. CMCM took 0.5s. Estimated remaining: 11m 20s. Rate: 147.5 symbols/min [2025-09-29T22:06:56.972214] [INFO ] [MAIN ] CMP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:56.987903] [DEBUG] [LOCAL ] CMI: Loaded 41746 existing records from primary storage. [2025-09-29T22:06:57.005439] [INFO ] [MAIN ] CMI: Loaded 41746 primary data records. [2025-09-29T22:06:57.028622] [DEBUG] [LOCAL ] CMG: Loaded 53721 existing records from primary storage. [2025-09-29T22:06:57.053138] [INFO ] [MAIN ] CMG: Loaded 53721 primary data records. [2025-09-29T22:06:57.338351] [DEBUG] [LOCAL ] CMP: Loaded 36313 existing records from primary storage. [2025-09-29T22:06:57.497169] [INFO ] [MAIN ] CMP: Loaded 36313 primary data records. [2025-09-29T22:06:58.088744] [DEBUG] [MAIN ] CMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:58.092830] [INFO ] [MAIN ] CMI: Generated 1794 derivative records from 41746 primary records. [2025-09-29T22:06:58.093151] [DEBUG] [LOCAL ] CMI: Saving derivative data. [2025-09-29T22:06:58.116158] [DEBUG] [MAIN ] CMG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:58.121292] [INFO ] [MAIN ] CMG: Generated 1794 derivative records from 53721 primary records. [2025-09-29T22:06:58.121738] [DEBUG] [LOCAL ] CMG: Saving derivative data. [2025-09-29T22:06:58.127194] [DEBUG] [LOCAL ] CMI: Derivative data saved (1794 records). [2025-09-29T22:06:58.127539] [INFO ] [MAIN ] CMI: Successfully saved derivative data. [2025-09-29T22:06:58.129906] [INFO ] [MAIN ] Derivative Progress: 386/2057 symbols completed. CMI took 1.2s. Estimated remaining: 11m 23s. Rate: 146.8 symbols/min [2025-09-29T22:06:58.131451] [INFO ] [MAIN ] CMPO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:58.167463] [DEBUG] [LOCAL ] CMG: Derivative data saved (1794 records). [2025-09-29T22:06:58.168342] [INFO ] [MAIN ] CMG: Successfully saved derivative data. [2025-09-29T22:06:58.168081] [DEBUG] [MAIN ] CMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:58.171334] [INFO ] [MAIN ] Derivative Progress: 387/2057 symbols completed. CMG took 1.3s. Estimated remaining: 11m 21s. Rate: 147.1 symbols/min [2025-09-29T22:06:58.171718] [INFO ] [MAIN ] CMRE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:58.172986] [INFO ] [MAIN ] CMP: Generated 1794 derivative records from 36313 primary records. [2025-09-29T22:06:58.173608] [DEBUG] [LOCAL ] CMP: Saving derivative data. [2025-09-29T22:06:58.192166] [DEBUG] [LOCAL ] CMP: Derivative data saved (1794 records). [2025-09-29T22:06:58.192436] [INFO ] [MAIN ] CMP: Successfully saved derivative data. [2025-09-29T22:06:58.195003] [INFO ] [MAIN ] Derivative Progress: 388/2057 symbols completed. CMP took 1.2s. Estimated remaining: 11m 19s. Rate: 147.5 symbols/min [2025-09-29T22:06:58.226207] [DEBUG] [LOCAL ] CMPO: Loaded 39383 existing records from primary storage. [2025-09-29T22:06:58.226363] [INFO ] [MAIN ] CMPO: Loaded 39383 primary data records. [2025-09-29T22:06:58.426518] [DEBUG] [LOCAL ] CMRE: Loaded 35457 existing records from primary storage. [2025-09-29T22:06:58.457996] [INFO ] [MAIN ] CMRE: Loaded 35457 primary data records. [2025-09-29T22:06:58.924860] [DEBUG] [MAIN ] CMPO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:58.925780] [INFO ] [MAIN ] CMPO: Generated 1794 derivative records from 39383 primary records. [2025-09-29T22:06:58.925899] [DEBUG] [LOCAL ] CMPO: Saving derivative data. [2025-09-29T22:06:58.943615] [DEBUG] [LOCAL ] CMPO: Derivative data saved (1794 records). [2025-09-29T22:06:58.943867] [INFO ] [MAIN ] CMPO: Successfully saved derivative data. [2025-09-29T22:06:58.946091] [INFO ] [MAIN ] Derivative Progress: 389/2057 symbols completed. CMPO took 0.8s. Estimated remaining: 11m 20s. Rate: 147.1 symbols/min [2025-09-29T22:06:58.962950] [DEBUG] [MAIN ] CMRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:06:58.963520] [INFO ] [MAIN ] CMRE: Generated 1794 derivative records from 35457 primary records. [2025-09-29T22:06:58.963582] [DEBUG] [LOCAL ] CMRE: Saving derivative data. [2025-09-29T22:06:58.978974] [DEBUG] [LOCAL ] CMRE: Derivative data saved (1794 records). [2025-09-29T22:06:58.979040] [INFO ] [MAIN ] CMRE: Successfully saved derivative data. [2025-09-29T22:06:58.980938] [INFO ] [MAIN ] Derivative Progress: 390/2057 symbols completed. CMRE took 0.8s. Estimated remaining: 11m 18s. Rate: 147.5 symbols/min [2025-09-29T22:06:58.981458] [INFO ] [MAIN ] CMSA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:58.981385] [INFO ] [MAIN ] CMSC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:58.981671] [INFO ] [MAIN ] CMSD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:06:58.989444] [DEBUG] [LOCAL ] CMSA: Loaded 3414 existing records from primary storage. [2025-09-29T22:06:58.991053] [INFO ] [MAIN ] CMSA: Loaded 3414 primary data records. [2025-09-29T22:06:59.029291] [DEBUG] [LOCAL ] CMSC: Loaded 5080 existing records from primary storage. [2025-09-29T22:06:59.068841] [INFO ] [MAIN ] CMSC: Loaded 5080 primary data records. [2025-09-29T22:06:59.147001] [DEBUG] [LOCAL ] CMSD: Loaded 8088 existing records from primary storage. [2025-09-29T22:06:59.167800] [INFO ] [MAIN ] CMSD: Loaded 8088 primary data records. [2025-09-29T22:07:00.004306] [DEBUG] [MAIN ] CMSA: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:07:00.005236] [INFO ] [MAIN ] CMSA: Generated 1793 derivative records from 3414 primary records. [2025-09-29T22:07:00.005412] [DEBUG] [LOCAL ] CMSA: Saving derivative data. [2025-09-29T22:07:00.041953] [DEBUG] [MAIN ] CMSC: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:07:00.041604] [DEBUG] [LOCAL ] CMSA: Derivative data saved (1793 records). [2025-09-29T22:07:00.043184] [INFO ] [MAIN ] CMSC: Generated 1793 derivative records from 5080 primary records. [2025-09-29T22:07:00.042310] [INFO ] [MAIN ] CMSA: Successfully saved derivative data. [2025-09-29T22:07:00.045524] [INFO ] [MAIN ] Derivative Progress: 391/2057 symbols completed. CMSA took 1.1s. Estimated remaining: 11m 21s. Rate: 146.9 symbols/min [2025-09-29T22:07:00.045716] [DEBUG] [LOCAL ] CMSC: Saving derivative data. [2025-09-29T22:07:00.046316] [INFO ] [MAIN ] CMTG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:00.060938] [DEBUG] [MAIN ] CMSD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:07:00.062029] [INFO ] [MAIN ] CMSD: Generated 1793 derivative records from 8088 primary records. [2025-09-29T22:07:00.062119] [DEBUG] [LOCAL ] CMSD: Saving derivative data. [2025-09-29T22:07:00.078102] [DEBUG] [LOCAL ] CMSC: Derivative data saved (1793 records). [2025-09-29T22:07:00.078885] [INFO ] [MAIN ] CMSC: Successfully saved derivative data. [2025-09-29T22:07:00.089678] [INFO ] [MAIN ] Derivative Progress: 392/2057 symbols completed. CMSC took 1.1s. Estimated remaining: 11m 19s. Rate: 147.2 symbols/min [2025-09-29T22:07:00.093270] [INFO ] [MAIN ] CMU: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:00.110291] [DEBUG] [LOCAL ] CMSD: Derivative data saved (1793 records). [2025-09-29T22:07:00.110477] [INFO ] [MAIN ] CMSD: Successfully saved derivative data. [2025-09-29T22:07:00.112639] [INFO ] [MAIN ] Derivative Progress: 393/2057 symbols completed. CMSD took 1.1s. Estimated remaining: 11m 17s. Rate: 147.6 symbols/min [2025-09-29T22:07:00.112940] [INFO ] [MAIN ] CNA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:00.117238] [DEBUG] [LOCAL ] CMU: Loaded 7024 existing records from primary storage. [2025-09-29T22:07:00.117377] [INFO ] [MAIN ] CMU: Loaded 7024 primary data records. [2025-09-29T22:07:00.224982] [DEBUG] [LOCAL ] CMTG: Loaded 37127 existing records from primary storage. [2025-09-29T22:07:00.246992] [INFO ] [MAIN ] CMTG: Loaded 37127 primary data records. [2025-09-29T22:07:00.607530] [DEBUG] [LOCAL ] CNA: Loaded 32662 existing records from primary storage. [2025-09-29T22:07:00.629602] [INFO ] [MAIN ] CNA: Loaded 32662 primary data records. [2025-09-29T22:07:01.179360] [DEBUG] [MAIN ] CMU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:01.180290] [INFO ] [MAIN ] CMU: Generated 1794 derivative records from 7024 primary records. [2025-09-29T22:07:01.180563] [DEBUG] [LOCAL ] CMU: Saving derivative data. [2025-09-29T22:07:01.200993] [DEBUG] [LOCAL ] CMU: Derivative data saved (1794 records). [2025-09-29T22:07:01.201780] [INFO ] [MAIN ] CMU: Successfully saved derivative data. [2025-09-29T22:07:01.204346] [INFO ] [MAIN ] Derivative Progress: 394/2057 symbols completed. CMU took 1.1s. Estimated remaining: 11m 19s. Rate: 146.9 symbols/min [2025-09-29T22:07:01.212781] [INFO ] [MAIN ] CNC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:01.218959] [DEBUG] [MAIN ] CMTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:01.220356] [INFO ] [MAIN ] CMTG: Generated 1794 derivative records from 37127 primary records. [2025-09-29T22:07:01.220606] [DEBUG] [LOCAL ] CMTG: Saving derivative data. [2025-09-29T22:07:01.240907] [DEBUG] [LOCAL ] CMTG: Derivative data saved (1794 records). [2025-09-29T22:07:01.241039] [INFO ] [MAIN ] CMTG: Successfully saved derivative data. [2025-09-29T22:07:01.243474] [INFO ] [MAIN ] Derivative Progress: 395/2057 symbols completed. CMTG took 1.2s. Estimated remaining: 11m 17s. Rate: 147.3 symbols/min [2025-09-29T22:07:01.244073] [INFO ] [MAIN ] CNF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:01.267178] [DEBUG] [MAIN ] CNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:01.268097] [INFO ] [MAIN ] CNA: Generated 1794 derivative records from 32662 primary records. [2025-09-29T22:07:01.268329] [DEBUG] [LOCAL ] CNA: Saving derivative data. [2025-09-29T22:07:01.274312] [DEBUG] [LOCAL ] CNF: Loaded 11068 existing records from primary storage. [2025-09-29T22:07:01.285628] [INFO ] [MAIN ] CNF: Loaded 11068 primary data records. [2025-09-29T22:07:01.396570] [DEBUG] [LOCAL ] CNA: Derivative data saved (1794 records). [2025-09-29T22:07:01.433920] [INFO ] [MAIN ] CNA: Successfully saved derivative data. [2025-09-29T22:07:01.447204] [INFO ] [MAIN ] Derivative Progress: 396/2057 symbols completed. CNA took 1.3s. Estimated remaining: 11m 16s. Rate: 147.5 symbols/min [2025-09-29T22:07:01.444828] [DEBUG] [LOCAL ] CNC: Loaded 53739 existing records from primary storage. [2025-09-29T22:07:01.484076] [INFO ] [MAIN ] CNH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:01.462727] [INFO ] [MAIN ] CNC: Loaded 53739 primary data records. [2025-09-29T22:07:02.064865] [DEBUG] [MAIN ] CNF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:02.066011] [INFO ] [MAIN ] CNF: Generated 1794 derivative records from 11068 primary records. [2025-09-29T22:07:02.066255] [DEBUG] [LOCAL ] CNF: Saving derivative data. [2025-09-29T22:07:02.091208] [DEBUG] [LOCAL ] CNH: Loaded 53557 existing records from primary storage. [2025-09-29T22:07:02.098899] [INFO ] [MAIN ] CNH: Loaded 53557 primary data records. [2025-09-29T22:07:02.111718] [DEBUG] [LOCAL ] CNF: Derivative data saved (1794 records). [2025-09-29T22:07:02.133552] [INFO ] [MAIN ] CNF: Successfully saved derivative data. [2025-09-29T22:07:02.141322] [INFO ] [MAIN ] Derivative Progress: 397/2057 symbols completed. CNF took 0.9s. Estimated remaining: 11m 17s. Rate: 147.2 symbols/min [2025-09-29T22:07:02.149883] [INFO ] [MAIN ] CNI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:02.256846] [DEBUG] [MAIN ] CNC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:02.278931] [INFO ] [MAIN ] CNC: Generated 1794 derivative records from 53739 primary records. [2025-09-29T22:07:02.322574] [DEBUG] [LOCAL ] CNC: Saving derivative data. [2025-09-29T22:07:02.483345] [DEBUG] [LOCAL ] CNC: Derivative data saved (1794 records). [2025-09-29T22:07:02.483511] [INFO ] [MAIN ] CNC: Successfully saved derivative data. [2025-09-29T22:07:02.486034] [INFO ] [MAIN ] Derivative Progress: 398/2057 symbols completed. CNC took 1.3s. Estimated remaining: 11m 16s. Rate: 147.3 symbols/min [2025-09-29T22:07:02.487877] [INFO ] [MAIN ] CNK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:02.508269] [DEBUG] [LOCAL ] CNI: Loaded 51653 existing records from primary storage. [2025-09-29T22:07:02.508852] [INFO ] [MAIN ] CNI: Loaded 51653 primary data records. [2025-09-29T22:07:02.745423] [DEBUG] [MAIN ] CNH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:02.860221] [INFO ] [MAIN ] CNH: Generated 1794 derivative records from 53557 primary records. [2025-09-29T22:07:02.874858] [DEBUG] [LOCAL ] CNH: Saving derivative data. [2025-09-29T22:07:02.914035] [DEBUG] [LOCAL ] CNK: Loaded 52880 existing records from primary storage. [2025-09-29T22:07:02.911747] [DEBUG] [LOCAL ] CNH: Derivative data saved (1794 records). [2025-09-29T22:07:02.914964] [INFO ] [MAIN ] CNK: Loaded 52880 primary data records. [2025-09-29T22:07:02.914850] [INFO ] [MAIN ] CNH: Successfully saved derivative data. [2025-09-29T22:07:02.923056] [INFO ] [MAIN ] Derivative Progress: 399/2057 symbols completed. CNH took 1.4s. Estimated remaining: 11m 16s. Rate: 147.2 symbols/min [2025-09-29T22:07:03.008134] [INFO ] [MAIN ] CNM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:03.266456] [DEBUG] [MAIN ] CNI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:03.283493] [INFO ] [MAIN ] CNI: Generated 1794 derivative records from 51653 primary records. [2025-09-29T22:07:03.283685] [DEBUG] [LOCAL ] CNI: Saving derivative data. [2025-09-29T22:07:03.327765] [DEBUG] [LOCAL ] CNM: Loaded 50973 existing records from primary storage. [2025-09-29T22:07:03.328104] [INFO ] [MAIN ] CNM: Loaded 50973 primary data records. [2025-09-29T22:07:03.325785] [DEBUG] [LOCAL ] CNI: Derivative data saved (1794 records). [2025-09-29T22:07:03.328495] [INFO ] [MAIN ] CNI: Successfully saved derivative data. [2025-09-29T22:07:03.336303] [INFO ] [MAIN ] Derivative Progress: 400/2057 symbols completed. CNI took 1.2s. Estimated remaining: 11m 15s. Rate: 147.2 symbols/min [2025-09-29T22:07:03.377171] [INFO ] [MAIN ] CNNE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:03.453023] [DEBUG] [MAIN ] CNK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:03.459611] [INFO ] [MAIN ] CNK: Generated 1794 derivative records from 52880 primary records. [2025-09-29T22:07:03.459853] [DEBUG] [LOCAL ] CNK: Saving derivative data. [2025-09-29T22:07:03.536917] [DEBUG] [LOCAL ] CNK: Derivative data saved (1794 records). [2025-09-29T22:07:03.730554] [INFO ] [MAIN ] CNK: Successfully saved derivative data. [2025-09-29T22:07:03.758779] [INFO ] [MAIN ] Derivative Progress: 401/2057 symbols completed. CNK took 1.3s. Estimated remaining: 11m 15s. Rate: 147.2 symbols/min [2025-09-29T22:07:03.759296] [INFO ] [MAIN ] CNO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:03.776784] [DEBUG] [LOCAL ] CNNE: Loaded 36466 existing records from primary storage. [2025-09-29T22:07:03.777384] [INFO ] [MAIN ] CNNE: Loaded 36466 primary data records. [2025-09-29T22:07:04.002989] [DEBUG] [LOCAL ] CNO: Loaded 41180 existing records from primary storage. [2025-09-29T22:07:04.111338] [INFO ] [MAIN ] CNO: Loaded 41180 primary data records. [2025-09-29T22:07:04.255490] [DEBUG] [MAIN ] CNM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:04.266874] [INFO ] [MAIN ] CNM: Generated 1794 derivative records from 50973 primary records. [2025-09-29T22:07:04.289277] [DEBUG] [LOCAL ] CNM: Saving derivative data. [2025-09-29T22:07:04.497131] [DEBUG] [LOCAL ] CNM: Derivative data saved (1794 records). [2025-09-29T22:07:04.497824] [INFO ] [MAIN ] CNM: Successfully saved derivative data. [2025-09-29T22:07:04.500230] [INFO ] [MAIN ] Derivative Progress: 402/2057 symbols completed. CNM took 1.5s. Estimated remaining: 11m 16s. Rate: 146.9 symbols/min [2025-09-29T22:07:04.500787] [INFO ] [MAIN ] CNP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:04.523425] [DEBUG] [MAIN ] CNNE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:04.525025] [INFO ] [MAIN ] CNNE: Generated 1794 derivative records from 36466 primary records. [2025-09-29T22:07:04.526031] [DEBUG] [LOCAL ] CNNE: Saving derivative data. [2025-09-29T22:07:04.546077] [DEBUG] [LOCAL ] CNNE: Derivative data saved (1794 records). [2025-09-29T22:07:04.546481] [INFO ] [MAIN ] CNNE: Successfully saved derivative data. [2025-09-29T22:07:04.549271] [INFO ] [MAIN ] Derivative Progress: 403/2057 symbols completed. CNNE took 1.2s. Estimated remaining: 11m 14s. Rate: 147.2 symbols/min [2025-09-29T22:07:04.568317] [DEBUG] [MAIN ] CNO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:04.569116] [INFO ] [MAIN ] CNO: Generated 1794 derivative records from 41180 primary records. [2025-09-29T22:07:04.584702] [DEBUG] [LOCAL ] CNO: Saving derivative data. [2025-09-29T22:07:04.603144] [DEBUG] [LOCAL ] CNO: Derivative data saved (1794 records). [2025-09-29T22:07:04.618391] [INFO ] [MAIN ] CNO: Successfully saved derivative data. [2025-09-29T22:07:04.622528] [INFO ] [MAIN ] Derivative Progress: 404/2057 symbols completed. CNO took 0.9s. Estimated remaining: 11m 12s. Rate: 147.5 symbols/min [2025-09-29T22:07:04.624528] [DEBUG] [LOCAL ] CNP: Loaded 53469 existing records from primary storage. [2025-09-29T22:07:04.624734] [INFO ] [MAIN ] CNP: Loaded 53469 primary data records. [2025-09-29T22:07:04.951986] [DEBUG] [MAIN ] CNP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:04.952732] [INFO ] [MAIN ] CNP: Generated 1794 derivative records from 53469 primary records. [2025-09-29T22:07:04.952802] [DEBUG] [LOCAL ] CNP: Saving derivative data. [2025-09-29T22:07:04.968415] [DEBUG] [LOCAL ] CNP: Derivative data saved (1794 records). [2025-09-29T22:07:04.968489] [INFO ] [MAIN ] CNP: Successfully saved derivative data. [2025-09-29T22:07:04.970765] [INFO ] [MAIN ] Derivative Progress: 405/2057 symbols completed. CNP took 0.5s. Estimated remaining: 11m 12s. Rate: 147.6 symbols/min [2025-09-29T22:07:04.971545] [INFO ] [MAIN ] CNX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:04.971767] [INFO ] [MAIN ] CODI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:04.971437] [INFO ] [MAIN ] CNS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:04.999267] [DEBUG] [LOCAL ] CNS: Loaded 20650 existing records from primary storage. [2025-09-29T22:07:05.008372] [INFO ] [MAIN ] CNS: Loaded 20650 primary data records. [2025-09-29T22:07:05.129327] [DEBUG] [LOCAL ] CODI: Loaded 39820 existing records from primary storage. [2025-09-29T22:07:05.142789] [INFO ] [MAIN ] CODI: Loaded 39820 primary data records. [2025-09-29T22:07:05.293244] [DEBUG] [LOCAL ] CNX: Loaded 51375 existing records from primary storage. [2025-09-29T22:07:05.458808] [INFO ] [MAIN ] CNX: Loaded 51375 primary data records. [2025-09-29T22:07:06.100087] [DEBUG] [MAIN ] CNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:06.101460] [INFO ] [MAIN ] CNS: Generated 1794 derivative records from 20650 primary records. [2025-09-29T22:07:06.101611] [DEBUG] [LOCAL ] CNS: Saving derivative data. [2025-09-29T22:07:06.123981] [DEBUG] [LOCAL ] CNS: Derivative data saved (1794 records). [2025-09-29T22:07:06.124131] [INFO ] [MAIN ] CNS: Successfully saved derivative data. [2025-09-29T22:07:06.126383] [INFO ] [MAIN ] Derivative Progress: 406/2057 symbols completed. CNS took 1.2s. Estimated remaining: 11m 14s. Rate: 146.9 symbols/min [2025-09-29T22:07:06.134939] [INFO ] [MAIN ] COF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:06.141361] [DEBUG] [MAIN ] CODI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:06.142587] [INFO ] [MAIN ] CODI: Generated 1794 derivative records from 39820 primary records. [2025-09-29T22:07:06.142779] [DEBUG] [LOCAL ] CODI: Saving derivative data. [2025-09-29T22:07:06.177511] [DEBUG] [LOCAL ] CODI: Derivative data saved (1794 records). [2025-09-29T22:07:06.176050] [DEBUG] [MAIN ] CNX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:06.178681] [INFO ] [MAIN ] CNX: Generated 1794 derivative records from 51375 primary records. [2025-09-29T22:07:06.178787] [INFO ] [MAIN ] CODI: Successfully saved derivative data. [2025-09-29T22:07:06.178837] [DEBUG] [LOCAL ] CNX: Saving derivative data. [2025-09-29T22:07:06.181118] [INFO ] [MAIN ] Derivative Progress: 407/2057 symbols completed. CODI took 1.2s. Estimated remaining: 11m 12s. Rate: 147.2 symbols/min [2025-09-29T22:07:06.182193] [INFO ] [MAIN ] COHR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:06.199677] [DEBUG] [LOCAL ] CNX: Derivative data saved (1794 records). [2025-09-29T22:07:06.199925] [INFO ] [MAIN ] CNX: Successfully saved derivative data. [2025-09-29T22:07:06.202227] [INFO ] [MAIN ] Derivative Progress: 408/2057 symbols completed. CNX took 1.2s. Estimated remaining: 11m 10s. Rate: 147.6 symbols/min [2025-09-29T22:07:06.202447] [INFO ] [MAIN ] COLD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:06.277502] [DEBUG] [LOCAL ] COF: Loaded 53608 existing records from primary storage. [2025-09-29T22:07:06.277873] [INFO ] [MAIN ] COF: Loaded 53608 primary data records. [2025-09-29T22:07:06.413393] [DEBUG] [LOCAL ] COLD: Loaded 52032 existing records from primary storage. [2025-09-29T22:07:06.417867] [INFO ] [MAIN ] COLD: Loaded 52032 primary data records. [2025-09-29T22:07:06.419045] [DEBUG] [LOCAL ] COHR: Loaded 53363 existing records from primary storage. [2025-09-29T22:07:06.429575] [INFO ] [MAIN ] COHR: Loaded 53363 primary data records. [2025-09-29T22:07:07.300552] [DEBUG] [MAIN ] COF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:07.302107] [INFO ] [MAIN ] COF: Generated 1794 derivative records from 53608 primary records. [2025-09-29T22:07:07.303486] [DEBUG] [LOCAL ] COF: Saving derivative data. [2025-09-29T22:07:07.336103] [DEBUG] [MAIN ] COLD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:07.338887] [INFO ] [MAIN ] COLD: Generated 1794 derivative records from 52032 primary records. [2025-09-29T22:07:07.339810] [DEBUG] [LOCAL ] COLD: Saving derivative data. [2025-09-29T22:07:07.340966] [DEBUG] [LOCAL ] COF: Derivative data saved (1794 records). [2025-09-29T22:07:07.341178] [INFO ] [MAIN ] COF: Successfully saved derivative data. [2025-09-29T22:07:07.357880] [INFO ] [MAIN ] Derivative Progress: 409/2057 symbols completed. COF took 1.2s. Estimated remaining: 11m 13s. Rate: 146.9 symbols/min [2025-09-29T22:07:07.358692] [INFO ] [MAIN ] CON: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:07.358487] [DEBUG] [MAIN ] COHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:07.359631] [INFO ] [MAIN ] COHR: Generated 1794 derivative records from 53363 primary records. [2025-09-29T22:07:07.359923] [DEBUG] [LOCAL ] COHR: Saving derivative data. [2025-09-29T22:07:07.390358] [DEBUG] [LOCAL ] COLD: Derivative data saved (1794 records). [2025-09-29T22:07:07.391229] [INFO ] [MAIN ] COLD: Successfully saved derivative data. [2025-09-29T22:07:07.393728] [INFO ] [MAIN ] Derivative Progress: 410/2057 symbols completed. COLD took 1.2s. Estimated remaining: 11m 11s. Rate: 147.2 symbols/min [2025-09-29T22:07:07.394195] [INFO ] [MAIN ] COOK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:07.399940] [DEBUG] [LOCAL ] COHR: Derivative data saved (1794 records). [2025-09-29T22:07:07.400089] [INFO ] [MAIN ] COHR: Successfully saved derivative data. [2025-09-29T22:07:07.402487] [INFO ] [MAIN ] Derivative Progress: 411/2057 symbols completed. COHR took 1.2s. Estimated remaining: 11m 9s. Rate: 147.6 symbols/min [2025-09-29T22:07:07.402830] [INFO ] [MAIN ] COP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:07.436231] [DEBUG] [LOCAL ] COOK: Loaded 24365 existing records from primary storage. [2025-09-29T22:07:07.436409] [INFO ] [MAIN ] COOK: Loaded 24365 primary data records. [2025-09-29T22:07:07.504595] [DEBUG] [LOCAL ] CON: Loaded 38727 existing records from primary storage. [2025-09-29T22:07:07.520623] [INFO ] [MAIN ] CON: Loaded 38727 primary data records. [2025-09-29T22:07:07.961620] [DEBUG] [LOCAL ] COP: Loaded 53727 existing records from primary storage. [2025-09-29T22:07:08.003045] [INFO ] [MAIN ] COP: Loaded 53727 primary data records. [2025-09-29T22:07:08.523703] [DEBUG] [MAIN ] COOK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:08.525317] [INFO ] [MAIN ] COOK: Generated 1794 derivative records from 24365 primary records. [2025-09-29T22:07:08.526136] [DEBUG] [LOCAL ] COOK: Saving derivative data. [2025-09-29T22:07:08.562621] [DEBUG] [MAIN ] CON: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:08.564119] [INFO ] [MAIN ] CON: Generated 1794 derivative records from 38727 primary records. [2025-09-29T22:07:08.564992] [DEBUG] [LOCAL ] CON: Saving derivative data. [2025-09-29T22:07:08.567855] [DEBUG] [LOCAL ] COOK: Derivative data saved (1794 records). [2025-09-29T22:07:08.568176] [INFO ] [MAIN ] COOK: Successfully saved derivative data. [2025-09-29T22:07:08.570346] [INFO ] [MAIN ] Derivative Progress: 412/2057 symbols completed. COOK took 1.2s. Estimated remaining: 11m 12s. Rate: 146.9 symbols/min [2025-09-29T22:07:08.578192] [INFO ] [MAIN ] COR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:08.588081] [DEBUG] [LOCAL ] CON: Derivative data saved (1794 records). [2025-09-29T22:07:08.588166] [INFO ] [MAIN ] CON: Successfully saved derivative data. [2025-09-29T22:07:08.590496] [INFO ] [MAIN ] Derivative Progress: 413/2057 symbols completed. CON took 1.2s. Estimated remaining: 11m 10s. Rate: 147.3 symbols/min [2025-09-29T22:07:08.590849] [INFO ] [MAIN ] COTY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:08.610289] [DEBUG] [MAIN ] COP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:08.611299] [INFO ] [MAIN ] COP: Generated 1794 derivative records from 53727 primary records. [2025-09-29T22:07:08.611533] [DEBUG] [LOCAL ] COP: Saving derivative data. [2025-09-29T22:07:08.635633] [DEBUG] [LOCAL ] COP: Derivative data saved (1794 records). [2025-09-29T22:07:08.647043] [INFO ] [MAIN ] COP: Successfully saved derivative data. [2025-09-29T22:07:08.649335] [INFO ] [MAIN ] Derivative Progress: 414/2057 symbols completed. COP took 1.2s. Estimated remaining: 11m 8s. Rate: 147.6 symbols/min [2025-09-29T22:07:08.649611] [INFO ] [MAIN ] CP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:08.682564] [DEBUG] [LOCAL ] COR: Loaded 47081 existing records from primary storage. [2025-09-29T22:07:08.682809] [INFO ] [MAIN ] COR: Loaded 47081 primary data records. [2025-09-29T22:07:08.811414] [DEBUG] [LOCAL ] COTY: Loaded 53223 existing records from primary storage. [2025-09-29T22:07:08.816718] [INFO ] [MAIN ] COTY: Loaded 53223 primary data records. [2025-09-29T22:07:09.184793] [DEBUG] [LOCAL ] CP: Loaded 53268 existing records from primary storage. [2025-09-29T22:07:09.191719] [INFO ] [MAIN ] CP: Loaded 53268 primary data records. [2025-09-29T22:07:09.755752] [DEBUG] [MAIN ] COR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:09.757429] [INFO ] [MAIN ] COR: Generated 1794 derivative records from 47081 primary records. [2025-09-29T22:07:09.758217] [DEBUG] [LOCAL ] COR: Saving derivative data. [2025-09-29T22:07:09.797855] [DEBUG] [LOCAL ] COR: Derivative data saved (1794 records). [2025-09-29T22:07:09.797376] [DEBUG] [MAIN ] COTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:09.798317] [INFO ] [MAIN ] COR: Successfully saved derivative data. [2025-09-29T22:07:09.800472] [INFO ] [MAIN ] Derivative Progress: 415/2057 symbols completed. COR took 1.2s. Estimated remaining: 11m 11s. Rate: 146.9 symbols/min [2025-09-29T22:07:09.802406] [INFO ] [MAIN ] COTY: Generated 1794 derivative records from 53223 primary records. [2025-09-29T22:07:09.801698] [INFO ] [MAIN ] CPAY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:09.804476] [DEBUG] [LOCAL ] COTY: Saving derivative data. [2025-09-29T22:07:09.827231] [DEBUG] [MAIN ] CP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:09.831196] [INFO ] [MAIN ] CP: Generated 1794 derivative records from 53268 primary records. [2025-09-29T22:07:09.831551] [DEBUG] [LOCAL ] CP: Saving derivative data. [2025-09-29T22:07:09.851026] [DEBUG] [LOCAL ] COTY: Derivative data saved (1794 records). [2025-09-29T22:07:09.851747] [INFO ] [MAIN ] COTY: Successfully saved derivative data. [2025-09-29T22:07:09.853951] [INFO ] [MAIN ] Derivative Progress: 416/2057 symbols completed. COTY took 1.3s. Estimated remaining: 11m 9s. Rate: 147.2 symbols/min [2025-09-29T22:07:09.855902] [DEBUG] [LOCAL ] CP: Derivative data saved (1794 records). [2025-09-29T22:07:09.856264] [INFO ] [MAIN ] CP: Successfully saved derivative data. [2025-09-29T22:07:09.856006] [INFO ] [MAIN ] CPF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:09.863928] [INFO ] [MAIN ] Derivative Progress: 417/2057 symbols completed. CP took 1.2s. Estimated remaining: 11m 7s. Rate: 147.6 symbols/min [2025-09-29T22:07:09.864599] [INFO ] [MAIN ] CPK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:09.897630] [DEBUG] [LOCAL ] CPAY: Loaded 30608 existing records from primary storage. [2025-09-29T22:07:09.897949] [INFO ] [MAIN ] CPAY: Loaded 30608 primary data records. [2025-09-29T22:07:09.966773] [DEBUG] [LOCAL ] CPK: Loaded 13437 existing records from primary storage. [2025-09-29T22:07:09.998205] [DEBUG] [LOCAL ] CPF: Loaded 15248 existing records from primary storage. [2025-09-29T22:07:10.011918] [INFO ] [MAIN ] CPK: Loaded 13437 primary data records. [2025-09-29T22:07:10.011841] [INFO ] [MAIN ] CPF: Loaded 15248 primary data records. [2025-09-29T22:07:10.976953] [DEBUG] [MAIN ] CPAY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:10.978267] [INFO ] [MAIN ] CPAY: Generated 1794 derivative records from 30608 primary records. [2025-09-29T22:07:10.978634] [DEBUG] [LOCAL ] CPAY: Saving derivative data. [2025-09-29T22:07:11.028164] [DEBUG] [MAIN ] CPF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:11.029852] [DEBUG] [MAIN ] CPK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:11.031363] [INFO ] [MAIN ] CPK: Generated 1794 derivative records from 13437 primary records. [2025-09-29T22:07:11.032095] [INFO ] [MAIN ] CPF: Generated 1794 derivative records from 15248 primary records. [2025-09-29T22:07:11.032495] [DEBUG] [LOCAL ] CPAY: Derivative data saved (1794 records). [2025-09-29T22:07:11.032752] [DEBUG] [LOCAL ] CPF: Saving derivative data. [2025-09-29T22:07:11.032823] [DEBUG] [LOCAL ] CPK: Saving derivative data. [2025-09-29T22:07:11.032968] [INFO ] [MAIN ] CPAY: Successfully saved derivative data. [2025-09-29T22:07:11.035710] [INFO ] [MAIN ] Derivative Progress: 418/2057 symbols completed. CPAY took 1.2s. Estimated remaining: 11m 9s. Rate: 146.9 symbols/min [2025-09-29T22:07:11.066009] [DEBUG] [LOCAL ] CPK: Derivative data saved (1794 records). [2025-09-29T22:07:11.066682] [INFO ] [MAIN ] CPK: Successfully saved derivative data. [2025-09-29T22:07:11.068849] [INFO ] [MAIN ] Derivative Progress: 419/2057 symbols completed. CPK took 1.2s. Estimated remaining: 11m 7s. Rate: 147.2 symbols/min [2025-09-29T22:07:11.071898] [DEBUG] [LOCAL ] CPF: Derivative data saved (1794 records). [2025-09-29T22:07:11.072024] [INFO ] [MAIN ] CPF: Successfully saved derivative data. [2025-09-29T22:07:11.074461] [INFO ] [MAIN ] Derivative Progress: 420/2057 symbols completed. CPF took 1.2s. Estimated remaining: 11m 6s. Rate: 147.6 symbols/min [2025-09-29T22:07:11.074931] [INFO ] [MAIN ] CPNG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:11.075276] [INFO ] [MAIN ] CPT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:11.075096] [INFO ] [MAIN ] CQP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:11.103075] [DEBUG] [LOCAL ] CQP: Loaded 19676 existing records from primary storage. [2025-09-29T22:07:11.103223] [INFO ] [MAIN ] CQP: Loaded 19676 primary data records. [2025-09-29T22:07:11.309736] [DEBUG] [LOCAL ] CPT: Loaded 44317 existing records from primary storage. [2025-09-29T22:07:11.459869] [INFO ] [MAIN ] CPT: Loaded 44317 primary data records. [2025-09-29T22:07:11.480358] [DEBUG] [LOCAL ] CPNG: Loaded 53670 existing records from primary storage. [2025-09-29T22:07:11.513522] [INFO ] [MAIN ] CPNG: Loaded 53670 primary data records. [2025-09-29T22:07:12.355284] [DEBUG] [MAIN ] CQP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:12.364190] [INFO ] [MAIN ] CQP: Generated 1794 derivative records from 19676 primary records. [2025-09-29T22:07:12.364503] [DEBUG] [LOCAL ] CQP: Saving derivative data. [2025-09-29T22:07:12.362701] [DEBUG] [MAIN ] CPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:12.377702] [INFO ] [MAIN ] CPT: Generated 1794 derivative records from 44317 primary records. [2025-09-29T22:07:12.396219] [DEBUG] [LOCAL ] CQP: Derivative data saved (1794 records). [2025-09-29T22:07:12.396413] [INFO ] [MAIN ] CQP: Successfully saved derivative data. [2025-09-29T22:07:12.388703] [DEBUG] [LOCAL ] CPT: Saving derivative data. [2025-09-29T22:07:12.399334] [INFO ] [MAIN ] Derivative Progress: 421/2057 symbols completed. CQP took 1.3s. Estimated remaining: 11m 9s. Rate: 146.8 symbols/min [2025-09-29T22:07:12.400336] [INFO ] [MAIN ] CRBD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:12.460294] [DEBUG] [MAIN ] CPNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:12.459766] [DEBUG] [LOCAL ] CPT: Derivative data saved (1794 records). [2025-09-29T22:07:12.460685] [INFO ] [MAIN ] CPT: Successfully saved derivative data. [2025-09-29T22:07:12.462104] [INFO ] [MAIN ] CPNG: Generated 1794 derivative records from 53670 primary records. [2025-09-29T22:07:12.465094] [DEBUG] [LOCAL ] CPNG: Saving derivative data. [2025-09-29T22:07:12.464756] [INFO ] [MAIN ] Derivative Progress: 422/2057 symbols completed. CPT took 1.4s. Estimated remaining: 11m 7s. Rate: 147.1 symbols/min [2025-09-29T22:07:12.466612] [INFO ] [MAIN ] CRBG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:12.494273] [DEBUG] [LOCAL ] CRBD: Loaded 9005 existing records from primary storage. [2025-09-29T22:07:12.496143] [INFO ] [MAIN ] CRBD: Loaded 9005 primary data records. [2025-09-29T22:07:12.652830] [DEBUG] [LOCAL ] CPNG: Derivative data saved (1794 records). [2025-09-29T22:07:12.658382] [INFO ] [MAIN ] CPNG: Successfully saved derivative data. [2025-09-29T22:07:12.665595] [INFO ] [MAIN ] Derivative Progress: 423/2057 symbols completed. CPNG took 1.6s. Estimated remaining: 11m 6s. Rate: 147.3 symbols/min [2025-09-29T22:07:12.665920] [INFO ] [MAIN ] CRC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:12.959365] [DEBUG] [LOCAL ] CRBG: Loaded 52335 existing records from primary storage. [2025-09-29T22:07:12.959906] [INFO ] [MAIN ] CRBG: Loaded 52335 primary data records. [2025-09-29T22:07:13.126222] [DEBUG] [LOCAL ] CRC: Loaded 44146 existing records from primary storage. [2025-09-29T22:07:13.127023] [INFO ] [MAIN ] CRC: Loaded 44146 primary data records. [2025-09-29T22:07:13.684402] [DEBUG] [MAIN ] CRBD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:13.685806] [INFO ] [MAIN ] CRBD: Generated 1794 derivative records from 9005 primary records. [2025-09-29T22:07:13.686526] [DEBUG] [LOCAL ] CRBD: Saving derivative data. [2025-09-29T22:07:13.711940] [DEBUG] [LOCAL ] CRBD: Derivative data saved (1794 records). [2025-09-29T22:07:13.712208] [INFO ] [MAIN ] CRBD: Successfully saved derivative data. [2025-09-29T22:07:13.714298] [INFO ] [MAIN ] Derivative Progress: 424/2057 symbols completed. CRBD took 1.3s. Estimated remaining: 11m 8s. Rate: 146.7 symbols/min [2025-09-29T22:07:13.714803] [INFO ] [MAIN ] CRGY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:13.735177] [DEBUG] [MAIN ] CRBG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:13.736134] [INFO ] [MAIN ] CRBG: Generated 1794 derivative records from 52335 primary records. [2025-09-29T22:07:13.736326] [DEBUG] [LOCAL ] CRBG: Saving derivative data. [2025-09-29T22:07:13.779420] [DEBUG] [MAIN ] CRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:13.778818] [DEBUG] [LOCAL ] CRBG: Derivative data saved (1794 records). [2025-09-29T22:07:13.779663] [INFO ] [MAIN ] CRBG: Successfully saved derivative data. [2025-09-29T22:07:13.780543] [INFO ] [MAIN ] CRC: Generated 1794 derivative records from 44146 primary records. [2025-09-29T22:07:13.782699] [DEBUG] [LOCAL ] CRC: Saving derivative data. [2025-09-29T22:07:13.782598] [INFO ] [MAIN ] Derivative Progress: 425/2057 symbols completed. CRBG took 1.3s. Estimated remaining: 11m 6s. Rate: 147.0 symbols/min [2025-09-29T22:07:13.783698] [INFO ] [MAIN ] CRH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:13.818315] [DEBUG] [LOCAL ] CRC: Derivative data saved (1794 records). [2025-09-29T22:07:13.818476] [INFO ] [MAIN ] CRC: Successfully saved derivative data. [2025-09-29T22:07:13.820726] [INFO ] [MAIN ] Derivative Progress: 426/2057 symbols completed. CRC took 1.2s. Estimated remaining: 11m 4s. Rate: 147.3 symbols/min [2025-09-29T22:07:13.821760] [INFO ] [MAIN ] CRI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:13.838134] [DEBUG] [LOCAL ] CRGY: Loaded 52509 existing records from primary storage. [2025-09-29T22:07:13.838585] [INFO ] [MAIN ] CRGY: Loaded 52509 primary data records. [2025-09-29T22:07:14.194034] [DEBUG] [LOCAL ] CRH: Loaded 53463 existing records from primary storage. [2025-09-29T22:07:14.194911] [INFO ] [MAIN ] CRH: Loaded 53463 primary data records. [2025-09-29T22:07:14.255470] [DEBUG] [LOCAL ] CRI: Loaded 49926 existing records from primary storage. [2025-09-29T22:07:14.261681] [INFO ] [MAIN ] CRI: Loaded 49926 primary data records. [2025-09-29T22:07:14.925446] [DEBUG] [MAIN ] CRGY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:14.926594] [INFO ] [MAIN ] CRGY: Generated 1794 derivative records from 52509 primary records. [2025-09-29T22:07:14.927232] [DEBUG] [LOCAL ] CRGY: Saving derivative data. [2025-09-29T22:07:14.946175] [DEBUG] [LOCAL ] CRGY: Derivative data saved (1794 records). [2025-09-29T22:07:14.946462] [INFO ] [MAIN ] CRGY: Successfully saved derivative data. [2025-09-29T22:07:14.948783] [INFO ] [MAIN ] Derivative Progress: 427/2057 symbols completed. CRGY took 1.2s. Estimated remaining: 11m 7s. Rate: 146.7 symbols/min [2025-09-29T22:07:14.949242] [INFO ] [MAIN ] CRK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:14.970599] [DEBUG] [MAIN ] CRH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:14.971570] [INFO ] [MAIN ] CRH: Generated 1794 derivative records from 53463 primary records. [2025-09-29T22:07:14.971827] [DEBUG] [LOCAL ] CRH: Saving derivative data. [2025-09-29T22:07:14.986661] [DEBUG] [MAIN ] CRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:14.987748] [INFO ] [MAIN ] CRI: Generated 1794 derivative records from 49926 primary records. [2025-09-29T22:07:14.988098] [DEBUG] [LOCAL ] CRI: Saving derivative data. [2025-09-29T22:07:15.021021] [DEBUG] [LOCAL ] CRH: Derivative data saved (1794 records). [2025-09-29T22:07:15.021539] [INFO ] [MAIN ] CRH: Successfully saved derivative data. [2025-09-29T22:07:15.024544] [INFO ] [MAIN ] Derivative Progress: 428/2057 symbols completed. CRH took 1.2s. Estimated remaining: 11m 5s. Rate: 147.0 symbols/min [2025-09-29T22:07:15.026626] [INFO ] [MAIN ] CRL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:15.044724] [DEBUG] [LOCAL ] CRI: Derivative data saved (1794 records). [2025-09-29T22:07:15.045078] [INFO ] [MAIN ] CRI: Successfully saved derivative data. [2025-09-29T22:07:15.049589] [INFO ] [MAIN ] Derivative Progress: 429/2057 symbols completed. CRI took 1.2s. Estimated remaining: 11m 3s. Rate: 147.3 symbols/min [2025-09-29T22:07:15.050192] [INFO ] [MAIN ] CRS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:15.071541] [DEBUG] [LOCAL ] CRK: Loaded 52121 existing records from primary storage. [2025-09-29T22:07:15.071869] [INFO ] [MAIN ] CRK: Loaded 52121 primary data records. [2025-09-29T22:07:15.440845] [DEBUG] [LOCAL ] CRL: Loaded 43015 existing records from primary storage. [2025-09-29T22:07:15.452852] [INFO ] [MAIN ] CRL: Loaded 43015 primary data records. [2025-09-29T22:07:15.479523] [DEBUG] [LOCAL ] CRS: Loaded 43170 existing records from primary storage. [2025-09-29T22:07:15.510700] [INFO ] [MAIN ] CRS: Loaded 43170 primary data records. [2025-09-29T22:07:16.138552] [DEBUG] [MAIN ] CRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:16.139578] [INFO ] [MAIN ] CRK: Generated 1794 derivative records from 52121 primary records. [2025-09-29T22:07:16.139806] [DEBUG] [LOCAL ] CRK: Saving derivative data. [2025-09-29T22:07:16.161118] [DEBUG] [LOCAL ] CRK: Derivative data saved (1794 records). [2025-09-29T22:07:16.161311] [INFO ] [MAIN ] CRK: Successfully saved derivative data. [2025-09-29T22:07:16.163571] [INFO ] [MAIN ] Derivative Progress: 430/2057 symbols completed. CRK took 1.2s. Estimated remaining: 11m 5s. Rate: 146.7 symbols/min [2025-09-29T22:07:16.164395] [INFO ] [MAIN ] CRT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:16.188444] [DEBUG] [LOCAL ] CRT: Loaded 4976 existing records from primary storage. [2025-09-29T22:07:16.189381] [DEBUG] [MAIN ] CRL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:16.190373] [INFO ] [MAIN ] CRL: Generated 1794 derivative records from 43015 primary records. [2025-09-29T22:07:16.189625] [INFO ] [MAIN ] CRT: Loaded 4976 primary data records. [2025-09-29T22:07:16.190664] [DEBUG] [LOCAL ] CRL: Saving derivative data. [2025-09-29T22:07:16.328307] [DEBUG] [MAIN ] CRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:16.330388] [INFO ] [MAIN ] CRS: Generated 1794 derivative records from 43170 primary records. [2025-09-29T22:07:16.331581] [DEBUG] [LOCAL ] CRS: Saving derivative data. [2025-09-29T22:07:16.404044] [DEBUG] [LOCAL ] CRL: Derivative data saved (1794 records). [2025-09-29T22:07:16.423242] [INFO ] [MAIN ] CRL: Successfully saved derivative data. [2025-09-29T22:07:16.425547] [INFO ] [MAIN ] Derivative Progress: 431/2057 symbols completed. CRL took 1.4s. Estimated remaining: 11m 4s. Rate: 146.8 symbols/min [2025-09-29T22:07:16.425992] [INFO ] [MAIN ] CSAN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:16.561279] [DEBUG] [LOCAL ] CRS: Derivative data saved (1794 records). [2025-09-29T22:07:16.561569] [INFO ] [MAIN ] CRS: Successfully saved derivative data. [2025-09-29T22:07:16.564873] [INFO ] [MAIN ] Derivative Progress: 432/2057 symbols completed. CRS took 1.5s. Estimated remaining: 11m 3s. Rate: 147.1 symbols/min [2025-09-29T22:07:16.565752] [INFO ] [MAIN ] CSL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:16.600233] [DEBUG] [MAIN ] CRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:16.601009] [INFO ] [MAIN ] CRT: Generated 1794 derivative records from 4976 primary records. [2025-09-29T22:07:16.601293] [DEBUG] [LOCAL ] CRT: Saving derivative data. [2025-09-29T22:07:16.632240] [DEBUG] [LOCAL ] CSAN: Loaded 42412 existing records from primary storage. [2025-09-29T22:07:16.635693] [INFO ] [MAIN ] CSAN: Loaded 42412 primary data records. [2025-09-29T22:07:16.696146] [DEBUG] [LOCAL ] CRT: Derivative data saved (1794 records). [2025-09-29T22:07:16.724382] [INFO ] [MAIN ] CRT: Successfully saved derivative data. [2025-09-29T22:07:16.733902] [INFO ] [MAIN ] Derivative Progress: 433/2057 symbols completed. CRT took 0.6s. Estimated remaining: 11m 2s. Rate: 147.3 symbols/min [2025-09-29T22:07:16.719012] [DEBUG] [LOCAL ] CSL: Loaded 31556 existing records from primary storage. [2025-09-29T22:07:16.739450] [INFO ] [MAIN ] CSL: Loaded 31556 primary data records. [2025-09-29T22:07:17.398086] [DEBUG] [MAIN ] CSAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:17.399123] [INFO ] [MAIN ] CSAN: Generated 1794 derivative records from 42412 primary records. [2025-09-29T22:07:17.399341] [DEBUG] [LOCAL ] CSAN: Saving derivative data. [2025-09-29T22:07:17.418338] [DEBUG] [LOCAL ] CSAN: Derivative data saved (1794 records). [2025-09-29T22:07:17.418660] [INFO ] [MAIN ] CSAN: Successfully saved derivative data. [2025-09-29T22:07:17.433305] [INFO ] [MAIN ] Derivative Progress: 434/2057 symbols completed. CSAN took 1.0s. Estimated remaining: 11m 2s. Rate: 147.0 symbols/min [2025-09-29T22:07:17.433837] [DEBUG] [MAIN ] CSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:17.434755] [INFO ] [MAIN ] CSL: Generated 1794 derivative records from 31556 primary records. [2025-09-29T22:07:17.434894] [DEBUG] [LOCAL ] CSL: Saving derivative data. [2025-09-29T22:07:17.450966] [DEBUG] [LOCAL ] CSL: Derivative data saved (1794 records). [2025-09-29T22:07:17.451033] [INFO ] [MAIN ] CSL: Successfully saved derivative data. [2025-09-29T22:07:17.452993] [INFO ] [MAIN ] Derivative Progress: 435/2057 symbols completed. CSL took 0.9s. Estimated remaining: 11m 0s. Rate: 147.4 symbols/min [2025-09-29T22:07:17.453686] [INFO ] [MAIN ] CSTM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:17.453571] [INFO ] [MAIN ] CSR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:17.454059] [INFO ] [MAIN ] CTBB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:17.472347] [DEBUG] [LOCAL ] CTBB: Loaded 7077 existing records from primary storage. [2025-09-29T22:07:17.472498] [INFO ] [MAIN ] CTBB: Loaded 7077 primary data records. [2025-09-29T22:07:17.529872] [DEBUG] [LOCAL ] CSR: Loaded 12759 existing records from primary storage. [2025-09-29T22:07:17.582188] [INFO ] [MAIN ] CSR: Loaded 12759 primary data records. [2025-09-29T22:07:17.923946] [DEBUG] [LOCAL ] CSTM: Loaded 47545 existing records from primary storage. [2025-09-29T22:07:17.943823] [INFO ] [MAIN ] CSTM: Loaded 47545 primary data records. [2025-09-29T22:07:18.517335] [DEBUG] [MAIN ] CTBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:18.518853] [INFO ] [MAIN ] CTBB: Generated 1794 derivative records from 7077 primary records. [2025-09-29T22:07:18.519006] [DEBUG] [LOCAL ] CTBB: Saving derivative data. [2025-09-29T22:07:18.539116] [DEBUG] [LOCAL ] CTBB: Derivative data saved (1794 records). [2025-09-29T22:07:18.539424] [INFO ] [MAIN ] CTBB: Successfully saved derivative data. [2025-09-29T22:07:18.542359] [INFO ] [MAIN ] Derivative Progress: 436/2057 symbols completed. CTBB took 1.1s. Estimated remaining: 11m 3s. Rate: 146.8 symbols/min [2025-09-29T22:07:18.543108] [INFO ] [MAIN ] CTDD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:18.573746] [DEBUG] [MAIN ] CSR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:18.574083] [DEBUG] [LOCAL ] CTDD: Loaded 5923 existing records from primary storage. [2025-09-29T22:07:18.587034] [INFO ] [MAIN ] CTDD: Loaded 5923 primary data records. [2025-09-29T22:07:18.588223] [INFO ] [MAIN ] CSR: Generated 1794 derivative records from 12759 primary records. [2025-09-29T22:07:18.588962] [DEBUG] [MAIN ] CSTM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:18.588604] [DEBUG] [LOCAL ] CSR: Saving derivative data. [2025-09-29T22:07:18.594983] [INFO ] [MAIN ] CSTM: Generated 1794 derivative records from 47545 primary records. [2025-09-29T22:07:18.628203] [DEBUG] [LOCAL ] CSTM: Saving derivative data. [2025-09-29T22:07:18.840694] [DEBUG] [LOCAL ] CSR: Derivative data saved (1794 records). [2025-09-29T22:07:18.943781] [INFO ] [MAIN ] CSR: Successfully saved derivative data. [2025-09-29T22:07:18.946748] [INFO ] [MAIN ] Derivative Progress: 437/2057 symbols completed. CSR took 1.5s. Estimated remaining: 11m 2s. Rate: 146.8 symbols/min [2025-09-29T22:07:18.944339] [DEBUG] [LOCAL ] CSTM: Derivative data saved (1794 records). [2025-09-29T22:07:18.946940] [INFO ] [MAIN ] CSTM: Successfully saved derivative data. [2025-09-29T22:07:18.947197] [INFO ] [MAIN ] CTO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:18.949659] [INFO ] [MAIN ] Derivative Progress: 438/2057 symbols completed. CSTM took 1.5s. Estimated remaining: 11m 0s. Rate: 147.1 symbols/min [2025-09-29T22:07:18.950971] [INFO ] [MAIN ] CTOS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:18.993921] [DEBUG] [MAIN ] CTDD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:07:18.994747] [INFO ] [MAIN ] CTDD: Generated 1793 derivative records from 5923 primary records. [2025-09-29T22:07:18.994927] [DEBUG] [LOCAL ] CTDD: Saving derivative data. [2025-09-29T22:07:19.004916] [DEBUG] [LOCAL ] CTO: Loaded 27978 existing records from primary storage. [2025-09-29T22:07:19.005425] [INFO ] [MAIN ] CTO: Loaded 27978 primary data records. [2025-09-29T22:07:19.091205] [DEBUG] [LOCAL ] CTOS: Loaded 36520 existing records from primary storage. [2025-09-29T22:07:19.105877] [INFO ] [MAIN ] CTOS: Loaded 36520 primary data records. [2025-09-29T22:07:19.217781] [DEBUG] [LOCAL ] CTDD: Derivative data saved (1793 records). [2025-09-29T22:07:19.225720] [INFO ] [MAIN ] CTDD: Successfully saved derivative data. [2025-09-29T22:07:19.238088] [INFO ] [MAIN ] Derivative Progress: 439/2057 symbols completed. CTDD took 0.7s. Estimated remaining: 10m 59s. Rate: 147.2 symbols/min [2025-09-29T22:07:19.267784] [INFO ] [MAIN ] CTRA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:19.760608] [DEBUG] [MAIN ] CTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:19.776279] [INFO ] [MAIN ] CTO: Generated 1794 derivative records from 27978 primary records. [2025-09-29T22:07:19.776676] [DEBUG] [LOCAL ] CTO: Saving derivative data. [2025-09-29T22:07:19.778587] [DEBUG] [LOCAL ] CTRA: Loaded 53648 existing records from primary storage. [2025-09-29T22:07:19.778960] [INFO ] [MAIN ] CTRA: Loaded 53648 primary data records. [2025-09-29T22:07:19.818103] [DEBUG] [LOCAL ] CTO: Derivative data saved (1794 records). [2025-09-29T22:07:19.837264] [INFO ] [MAIN ] CTO: Successfully saved derivative data. [2025-09-29T22:07:19.874447] [INFO ] [MAIN ] Derivative Progress: 440/2057 symbols completed. CTO took 0.9s. Estimated remaining: 10m 60s. Rate: 147.0 symbols/min [2025-09-29T22:07:19.890466] [DEBUG] [MAIN ] CTOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:19.909676] [INFO ] [MAIN ] CTRE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:19.928845] [INFO ] [MAIN ] CTOS: Generated 1794 derivative records from 36520 primary records. [2025-09-29T22:07:19.933851] [DEBUG] [LOCAL ] CTOS: Saving derivative data. [2025-09-29T22:07:20.037328] [DEBUG] [LOCAL ] CTOS: Derivative data saved (1794 records). [2025-09-29T22:07:20.077536] [INFO ] [MAIN ] CTOS: Successfully saved derivative data. [2025-09-29T22:07:20.166059] [INFO ] [MAIN ] Derivative Progress: 441/2057 symbols completed. CTOS took 1.2s. Estimated remaining: 10m 59s. Rate: 147.1 symbols/min [2025-09-29T22:07:20.166683] [INFO ] [MAIN ] CTRI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:20.207767] [DEBUG] [LOCAL ] CTRE: Loaded 49220 existing records from primary storage. [2025-09-29T22:07:20.208142] [INFO ] [MAIN ] CTRE: Loaded 49220 primary data records. [2025-09-29T22:07:20.362852] [DEBUG] [LOCAL ] CTRI: Loaded 38199 existing records from primary storage. [2025-09-29T22:07:20.368715] [INFO ] [MAIN ] CTRI: Loaded 38199 primary data records. [2025-09-29T22:07:20.379557] [DEBUG] [MAIN ] CTRA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:20.385792] [INFO ] [MAIN ] CTRA: Generated 1794 derivative records from 53648 primary records. [2025-09-29T22:07:20.392370] [DEBUG] [LOCAL ] CTRA: Saving derivative data. [2025-09-29T22:07:20.945891] [DEBUG] [LOCAL ] CTRA: Derivative data saved (1794 records). [2025-09-29T22:07:20.946247] [INFO ] [MAIN ] CTRA: Successfully saved derivative data. [2025-09-29T22:07:20.949218] [INFO ] [MAIN ] Derivative Progress: 442/2057 symbols completed. CTRA took 1.7s. Estimated remaining: 10m 60s. Rate: 146.8 symbols/min [2025-09-29T22:07:20.950560] [INFO ] [MAIN ] CTS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:20.982480] [DEBUG] [MAIN ] CTRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:20.983484] [INFO ] [MAIN ] CTRE: Generated 1794 derivative records from 49220 primary records. [2025-09-29T22:07:20.983780] [DEBUG] [LOCAL ] CTRE: Saving derivative data. [2025-09-29T22:07:21.004681] [DEBUG] [LOCAL ] CTS: Loaded 19346 existing records from primary storage. [2025-09-29T22:07:21.005564] [INFO ] [MAIN ] CTS: Loaded 19346 primary data records. [2025-09-29T22:07:21.084091] [DEBUG] [LOCAL ] CTRE: Derivative data saved (1794 records). [2025-09-29T22:07:21.093912] [DEBUG] [MAIN ] CTRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:21.117558] [INFO ] [MAIN ] CTRE: Successfully saved derivative data. [2025-09-29T22:07:21.126256] [INFO ] [MAIN ] Derivative Progress: 443/2057 symbols completed. CTRE took 1.2s. Estimated remaining: 10m 59s. Rate: 147.0 symbols/min [2025-09-29T22:07:21.112215] [INFO ] [MAIN ] CTRI: Generated 1794 derivative records from 38199 primary records. [2025-09-29T22:07:21.137619] [DEBUG] [LOCAL ] CTRI: Saving derivative data. [2025-09-29T22:07:21.137833] [INFO ] [MAIN ] CTVA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:21.197434] [DEBUG] [LOCAL ] CTRI: Derivative data saved (1794 records). [2025-09-29T22:07:21.216710] [INFO ] [MAIN ] CTRI: Successfully saved derivative data. [2025-09-29T22:07:21.241580] [INFO ] [MAIN ] Derivative Progress: 444/2057 symbols completed. CTRI took 1.1s. Estimated remaining: 10m 57s. Rate: 147.3 symbols/min [2025-09-29T22:07:21.305017] [INFO ] [MAIN ] CUBE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:21.445233] [DEBUG] [LOCAL ] CTVA: Loaded 53232 existing records from primary storage. [2025-09-29T22:07:21.446031] [INFO ] [MAIN ] CTVA: Loaded 53232 primary data records. [2025-09-29T22:07:21.703796] [DEBUG] [LOCAL ] CUBE: Loaded 50626 existing records from primary storage. [2025-09-29T22:07:21.702382] [DEBUG] [MAIN ] CTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:21.822131] [INFO ] [MAIN ] CUBE: Loaded 50626 primary data records. [2025-09-29T22:07:21.822050] [INFO ] [MAIN ] CTS: Generated 1794 derivative records from 19346 primary records. [2025-09-29T22:07:21.827493] [DEBUG] [LOCAL ] CTS: Saving derivative data. [2025-09-29T22:07:22.014410] [DEBUG] [LOCAL ] CTS: Derivative data saved (1794 records). [2025-09-29T22:07:22.024178] [INFO ] [MAIN ] CTS: Successfully saved derivative data. [2025-09-29T22:07:22.026573] [INFO ] [MAIN ] Derivative Progress: 445/2057 symbols completed. CTS took 1.1s. Estimated remaining: 10m 58s. Rate: 146.9 symbols/min [2025-09-29T22:07:22.165123] [INFO ] [MAIN ] CUBI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:22.204634] [DEBUG] [MAIN ] CTVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:22.205421] [INFO ] [MAIN ] CTVA: Generated 1794 derivative records from 53232 primary records. [2025-09-29T22:07:22.205748] [DEBUG] [LOCAL ] CTVA: Saving derivative data. [2025-09-29T22:07:22.243572] [DEBUG] [LOCAL ] CTVA: Derivative data saved (1794 records). [2025-09-29T22:07:22.242890] [DEBUG] [LOCAL ] CUBI: Loaded 27225 existing records from primary storage. [2025-09-29T22:07:22.244142] [INFO ] [MAIN ] CTVA: Successfully saved derivative data. [2025-09-29T22:07:22.244072] [INFO ] [MAIN ] CUBI: Loaded 27225 primary data records. [2025-09-29T22:07:22.246361] [INFO ] [MAIN ] Derivative Progress: 446/2057 symbols completed. CTVA took 1.1s. Estimated remaining: 10m 57s. Rate: 147.1 symbols/min [2025-09-29T22:07:22.282847] [DEBUG] [MAIN ] CUBE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:22.298714] [INFO ] [MAIN ] CUK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:22.330445] [INFO ] [MAIN ] CUBE: Generated 1794 derivative records from 50626 primary records. [2025-09-29T22:07:22.337529] [DEBUG] [LOCAL ] CUBE: Saving derivative data. [2025-09-29T22:07:22.418772] [DEBUG] [LOCAL ] CUBE: Derivative data saved (1794 records). [2025-09-29T22:07:22.442190] [INFO ] [MAIN ] CUBE: Successfully saved derivative data. [2025-09-29T22:07:22.456983] [INFO ] [MAIN ] Derivative Progress: 447/2057 symbols completed. CUBE took 1.2s. Estimated remaining: 10m 56s. Rate: 147.3 symbols/min [2025-09-29T22:07:22.458446] [INFO ] [MAIN ] CULP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:22.622677] [DEBUG] [LOCAL ] CULP: Loaded 2994 existing records from primary storage. [2025-09-29T22:07:22.623594] [INFO ] [MAIN ] CULP: Loaded 2994 primary data records. [2025-09-29T22:07:22.760082] [DEBUG] [LOCAL ] CUK: Loaded 50998 existing records from primary storage. [2025-09-29T22:07:22.760585] [INFO ] [MAIN ] CUK: Loaded 50998 primary data records. [2025-09-29T22:07:23.377610] [DEBUG] [MAIN ] CUBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:23.378479] [INFO ] [MAIN ] CUBI: Generated 1794 derivative records from 27225 primary records. [2025-09-29T22:07:23.379473] [DEBUG] [LOCAL ] CUBI: Saving derivative data. [2025-09-29T22:07:23.404355] [DEBUG] [LOCAL ] CUBI: Derivative data saved (1794 records). [2025-09-29T22:07:23.404992] [INFO ] [MAIN ] CUBI: Successfully saved derivative data. [2025-09-29T22:07:23.408121] [INFO ] [MAIN ] Derivative Progress: 448/2057 symbols completed. CUBI took 1.2s. Estimated remaining: 10m 58s. Rate: 146.8 symbols/min [2025-09-29T22:07:23.421670] [DEBUG] [MAIN ] CULP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:23.422689] [INFO ] [MAIN ] CULP: Generated 1794 derivative records from 2994 primary records. [2025-09-29T22:07:23.422876] [DEBUG] [LOCAL ] CULP: Saving derivative data. [2025-09-29T22:07:23.440004] [DEBUG] [LOCAL ] CULP: Derivative data saved (1794 records). [2025-09-29T22:07:23.440245] [INFO ] [MAIN ] CULP: Successfully saved derivative data. [2025-09-29T22:07:23.455113] [INFO ] [MAIN ] Derivative Progress: 449/2057 symbols completed. CULP took 1.0s. Estimated remaining: 10m 56s. Rate: 147.1 symbols/min [2025-09-29T22:07:23.455446] [DEBUG] [MAIN ] CUK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:23.456272] [INFO ] [MAIN ] CUK: Generated 1794 derivative records from 50998 primary records. [2025-09-29T22:07:23.456452] [DEBUG] [LOCAL ] CUK: Saving derivative data. [2025-09-29T22:07:23.472579] [DEBUG] [LOCAL ] CUK: Derivative data saved (1794 records). [2025-09-29T22:07:23.472685] [INFO ] [MAIN ] CUK: Successfully saved derivative data. [2025-09-29T22:07:23.474692] [INFO ] [MAIN ] Derivative Progress: 450/2057 symbols completed. CUK took 1.2s. Estimated remaining: 10m 54s. Rate: 147.4 symbols/min [2025-09-29T22:07:23.475317] [INFO ] [MAIN ] CUZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:23.475258] [INFO ] [MAIN ] CURV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:23.475455] [INFO ] [MAIN ] CVE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:23.520808] [DEBUG] [LOCAL ] CURV: Loaded 26507 existing records from primary storage. [2025-09-29T22:07:23.520977] [INFO ] [MAIN ] CURV: Loaded 26507 primary data records. [2025-09-29T22:07:23.660347] [DEBUG] [LOCAL ] CUZ: Loaded 49357 existing records from primary storage. [2025-09-29T22:07:23.671355] [INFO ] [MAIN ] CUZ: Loaded 49357 primary data records. [2025-09-29T22:07:23.955142] [DEBUG] [LOCAL ] CVE: Loaded 53557 existing records from primary storage. [2025-09-29T22:07:24.009872] [INFO ] [MAIN ] CVE: Loaded 53557 primary data records. [2025-09-29T22:07:24.579600] [DEBUG] [MAIN ] CURV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:24.581221] [INFO ] [MAIN ] CURV: Generated 1794 derivative records from 26507 primary records. [2025-09-29T22:07:24.581624] [DEBUG] [LOCAL ] CURV: Saving derivative data. [2025-09-29T22:07:24.604568] [DEBUG] [LOCAL ] CURV: Derivative data saved (1794 records). [2025-09-29T22:07:24.604998] [INFO ] [MAIN ] CURV: Successfully saved derivative data. [2025-09-29T22:07:24.608464] [INFO ] [MAIN ] Derivative Progress: 451/2057 symbols completed. CURV took 1.1s. Estimated remaining: 10m 56s. Rate: 146.8 symbols/min [2025-09-29T22:07:24.609718] [INFO ] [MAIN ] CVEO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:24.624991] [DEBUG] [MAIN ] CUZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:24.626044] [INFO ] [MAIN ] CUZ: Generated 1794 derivative records from 49357 primary records. [2025-09-29T22:07:24.626199] [DEBUG] [LOCAL ] CUZ: Saving derivative data. [2025-09-29T22:07:24.649821] [DEBUG] [MAIN ] CVE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:24.653821] [INFO ] [MAIN ] CVE: Generated 1794 derivative records from 53557 primary records. [2025-09-29T22:07:24.654156] [DEBUG] [LOCAL ] CVE: Saving derivative data. [2025-09-29T22:07:24.677950] [DEBUG] [LOCAL ] CUZ: Derivative data saved (1794 records). [2025-09-29T22:07:24.678388] [INFO ] [MAIN ] CUZ: Successfully saved derivative data. [2025-09-29T22:07:24.680636] [INFO ] [MAIN ] Derivative Progress: 452/2057 symbols completed. CUZ took 1.2s. Estimated remaining: 10m 55s. Rate: 147.1 symbols/min [2025-09-29T22:07:24.690497] [INFO ] [MAIN ] CVI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:24.692358] [DEBUG] [LOCAL ] CVEO: Loaded 15098 existing records from primary storage. [2025-09-29T22:07:24.693815] [INFO ] [MAIN ] CVEO: Loaded 15098 primary data records. [2025-09-29T22:07:24.699687] [DEBUG] [LOCAL ] CVE: Derivative data saved (1794 records). [2025-09-29T22:07:24.723024] [INFO ] [MAIN ] CVE: Successfully saved derivative data. [2025-09-29T22:07:24.758035] [INFO ] [MAIN ] Derivative Progress: 453/2057 symbols completed. CVE took 1.3s. Estimated remaining: 10m 53s. Rate: 147.4 symbols/min [2025-09-29T22:07:24.786925] [INFO ] [MAIN ] CVLG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:25.053036] [DEBUG] [LOCAL ] CVLG: Loaded 15540 existing records from primary storage. [2025-09-29T22:07:25.054057] [INFO ] [MAIN ] CVLG: Loaded 15540 primary data records. [2025-09-29T22:07:25.120389] [DEBUG] [LOCAL ] CVI: Loaded 46430 existing records from primary storage. [2025-09-29T22:07:25.120556] [INFO ] [MAIN ] CVI: Loaded 46430 primary data records. [2025-09-29T22:07:25.792039] [DEBUG] [MAIN ] CVEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:25.792894] [INFO ] [MAIN ] CVEO: Generated 1794 derivative records from 15098 primary records. [2025-09-29T22:07:25.793172] [DEBUG] [LOCAL ] CVEO: Saving derivative data. [2025-09-29T22:07:25.818317] [DEBUG] [LOCAL ] CVEO: Derivative data saved (1794 records). [2025-09-29T22:07:25.818614] [INFO ] [MAIN ] CVEO: Successfully saved derivative data. [2025-09-29T22:07:25.822347] [INFO ] [MAIN ] Derivative Progress: 454/2057 symbols completed. CVEO took 1.2s. Estimated remaining: 10m 55s. Rate: 146.8 symbols/min [2025-09-29T22:07:25.823935] [INFO ] [MAIN ] CVNA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:25.850631] [DEBUG] [MAIN ] CVI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:25.865628] [INFO ] [MAIN ] CVI: Generated 1794 derivative records from 46430 primary records. [2025-09-29T22:07:25.864746] [DEBUG] [MAIN ] CVLG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:25.866561] [INFO ] [MAIN ] CVLG: Generated 1794 derivative records from 15540 primary records. [2025-09-29T22:07:25.866873] [DEBUG] [LOCAL ] CVI: Saving derivative data. [2025-09-29T22:07:25.866810] [DEBUG] [LOCAL ] CVLG: Saving derivative data. [2025-09-29T22:07:25.896814] [DEBUG] [LOCAL ] CVI: Derivative data saved (1794 records). [2025-09-29T22:07:25.897585] [INFO ] [MAIN ] CVI: Successfully saved derivative data. [2025-09-29T22:07:25.899830] [INFO ] [MAIN ] Derivative Progress: 455/2057 symbols completed. CVI took 1.2s. Estimated remaining: 10m 53s. Rate: 147.1 symbols/min [2025-09-29T22:07:25.900018] [INFO ] [MAIN ] CVS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:25.918970] [DEBUG] [LOCAL ] CVLG: Derivative data saved (1794 records). [2025-09-29T22:07:25.919115] [INFO ] [MAIN ] CVLG: Successfully saved derivative data. [2025-09-29T22:07:25.921303] [INFO ] [MAIN ] Derivative Progress: 456/2057 symbols completed. CVLG took 1.1s. Estimated remaining: 10m 52s. Rate: 147.4 symbols/min [2025-09-29T22:07:25.921719] [INFO ] [MAIN ] CVX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:25.944320] [DEBUG] [LOCAL ] CVNA: Loaded 52985 existing records from primary storage. [2025-09-29T22:07:25.944714] [INFO ] [MAIN ] CVNA: Loaded 52985 primary data records. [2025-09-29T22:07:26.325332] [DEBUG] [LOCAL ] CVS: Loaded 53696 existing records from primary storage. [2025-09-29T22:07:26.325588] [INFO ] [MAIN ] CVS: Loaded 53696 primary data records. [2025-09-29T22:07:26.461043] [DEBUG] [LOCAL ] CVX: Loaded 53760 existing records from primary storage. [2025-09-29T22:07:26.461825] [INFO ] [MAIN ] CVX: Loaded 53760 primary data records. [2025-09-29T22:07:27.018271] [DEBUG] [MAIN ] CVNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:27.029735] [INFO ] [MAIN ] CVNA: Generated 1794 derivative records from 52985 primary records. [2025-09-29T22:07:27.029983] [DEBUG] [LOCAL ] CVNA: Saving derivative data. [2025-09-29T22:07:27.053152] [DEBUG] [LOCAL ] CVNA: Derivative data saved (1794 records). [2025-09-29T22:07:27.053295] [INFO ] [MAIN ] CVNA: Successfully saved derivative data. [2025-09-29T22:07:27.055567] [INFO ] [MAIN ] Derivative Progress: 457/2057 symbols completed. CVNA took 1.2s. Estimated remaining: 10m 54s. Rate: 146.8 symbols/min [2025-09-29T22:07:27.056130] [INFO ] [MAIN ] CW: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:27.074055] [DEBUG] [MAIN ] CVS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:27.074863] [INFO ] [MAIN ] CVS: Generated 1794 derivative records from 53696 primary records. [2025-09-29T22:07:27.075399] [DEBUG] [LOCAL ] CVS: Saving derivative data. [2025-09-29T22:07:27.100240] [DEBUG] [LOCAL ] CVS: Derivative data saved (1794 records). [2025-09-29T22:07:27.100437] [INFO ] [MAIN ] CVS: Successfully saved derivative data. [2025-09-29T22:07:27.102802] [INFO ] [MAIN ] Derivative Progress: 458/2057 symbols completed. CVS took 1.2s. Estimated remaining: 10m 52s. Rate: 147.1 symbols/min [2025-09-29T22:07:27.103005] [INFO ] [MAIN ] CWAN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:27.124924] [DEBUG] [MAIN ] CVX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:27.125966] [INFO ] [MAIN ] CVX: Generated 1794 derivative records from 53760 primary records. [2025-09-29T22:07:27.126497] [DEBUG] [LOCAL ] CW: Loaded 22246 existing records from primary storage. [2025-09-29T22:07:27.126725] [INFO ] [MAIN ] CW: Loaded 22246 primary data records. [2025-09-29T22:07:27.126792] [DEBUG] [LOCAL ] CVX: Saving derivative data. [2025-09-29T22:07:27.487100] [DEBUG] [LOCAL ] CVX: Derivative data saved (1794 records). [2025-09-29T22:07:27.501544] [INFO ] [MAIN ] CVX: Successfully saved derivative data. [2025-09-29T22:07:27.504433] [INFO ] [MAIN ] Derivative Progress: 459/2057 symbols completed. CVX took 1.6s. Estimated remaining: 10m 52s. Rate: 147.1 symbols/min [2025-09-29T22:07:27.505844] [DEBUG] [LOCAL ] CWAN: Loaded 52393 existing records from primary storage. [2025-09-29T22:07:27.505964] [INFO ] [MAIN ] CWAN: Loaded 52393 primary data records. [2025-09-29T22:07:27.506104] [INFO ] [MAIN ] CWEN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:27.905868] [DEBUG] [LOCAL ] CWEN: Loaded 44991 existing records from primary storage. [2025-09-29T22:07:27.906585] [INFO ] [MAIN ] CWEN: Loaded 44991 primary data records. [2025-09-29T22:07:27.990139] [DEBUG] [MAIN ] CW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:28.026017] [INFO ] [MAIN ] CW: Generated 1794 derivative records from 22246 primary records. [2025-09-29T22:07:28.032042] [DEBUG] [LOCAL ] CW: Saving derivative data. [2025-09-29T22:07:28.249589] [DEBUG] [LOCAL ] CW: Derivative data saved (1794 records). [2025-09-29T22:07:28.249810] [INFO ] [MAIN ] CW: Successfully saved derivative data. [2025-09-29T22:07:28.252044] [INFO ] [MAIN ] Derivative Progress: 460/2057 symbols completed. CW took 1.2s. Estimated remaining: 10m 52s. Rate: 146.9 symbols/min [2025-09-29T22:07:28.252390] [INFO ] [MAIN ] CWH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:28.273899] [DEBUG] [MAIN ] CWAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:28.276251] [INFO ] [MAIN ] CWAN: Generated 1794 derivative records from 52393 primary records. [2025-09-29T22:07:28.276424] [DEBUG] [LOCAL ] CWAN: Saving derivative data. [2025-09-29T22:07:28.299806] [DEBUG] [LOCAL ] CWAN: Derivative data saved (1794 records). [2025-09-29T22:07:28.300951] [INFO ] [MAIN ] CWAN: Successfully saved derivative data. [2025-09-29T22:07:28.303422] [INFO ] [MAIN ] Derivative Progress: 461/2057 symbols completed. CWAN took 1.2s. Estimated remaining: 10m 51s. Rate: 147.1 symbols/min [2025-09-29T22:07:28.312191] [INFO ] [MAIN ] CWK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:28.318256] [DEBUG] [MAIN ] CWEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:28.333805] [INFO ] [MAIN ] CWEN: Generated 1794 derivative records from 44991 primary records. [2025-09-29T22:07:28.334175] [DEBUG] [LOCAL ] CWEN: Saving derivative data. [2025-09-29T22:07:28.353091] [DEBUG] [LOCAL ] CWEN: Derivative data saved (1794 records). [2025-09-29T22:07:28.353223] [INFO ] [MAIN ] CWEN: Successfully saved derivative data. [2025-09-29T22:07:28.355736] [INFO ] [MAIN ] Derivative Progress: 462/2057 symbols completed. CWEN took 0.8s. Estimated remaining: 10m 49s. Rate: 147.4 symbols/min [2025-09-29T22:07:28.355896] [INFO ] [MAIN ] CWT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:28.375184] [DEBUG] [LOCAL ] CWH: Loaded 51377 existing records from primary storage. [2025-09-29T22:07:28.375389] [INFO ] [MAIN ] CWH: Loaded 51377 primary data records. [2025-09-29T22:07:28.734023] [DEBUG] [LOCAL ] CWT: Loaded 27821 existing records from primary storage. [2025-09-29T22:07:28.748253] [INFO ] [MAIN ] CWT: Loaded 27821 primary data records. [2025-09-29T22:07:28.756220] [DEBUG] [LOCAL ] CWK: Loaded 49419 existing records from primary storage. [2025-09-29T22:07:28.786672] [INFO ] [MAIN ] CWK: Loaded 49419 primary data records. [2025-09-29T22:07:29.430629] [DEBUG] [MAIN ] CWH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:29.433628] [INFO ] [MAIN ] CWH: Generated 1794 derivative records from 51377 primary records. [2025-09-29T22:07:29.433897] [DEBUG] [LOCAL ] CWH: Saving derivative data. [2025-09-29T22:07:29.454734] [DEBUG] [LOCAL ] CWH: Derivative data saved (1794 records). [2025-09-29T22:07:29.455072] [INFO ] [MAIN ] CWH: Successfully saved derivative data. [2025-09-29T22:07:29.457474] [INFO ] [MAIN ] Derivative Progress: 463/2057 symbols completed. CWH took 1.2s. Estimated remaining: 10m 51s. Rate: 146.9 symbols/min [2025-09-29T22:07:29.479714] [DEBUG] [MAIN ] CWT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:29.480742] [INFO ] [MAIN ] CWT: Generated 1794 derivative records from 27821 primary records. [2025-09-29T22:07:29.480963] [DEBUG] [LOCAL ] CWT: Saving derivative data. [2025-09-29T22:07:29.514450] [DEBUG] [MAIN ] CWK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:29.516420] [INFO ] [MAIN ] CWK: Generated 1794 derivative records from 49419 primary records. [2025-09-29T22:07:29.516515] [DEBUG] [LOCAL ] CWK: Saving derivative data. [2025-09-29T22:07:29.517121] [DEBUG] [LOCAL ] CWT: Derivative data saved (1794 records). [2025-09-29T22:07:29.517814] [INFO ] [MAIN ] CWT: Successfully saved derivative data. [2025-09-29T22:07:29.520491] [INFO ] [MAIN ] Derivative Progress: 464/2057 symbols completed. CWT took 1.2s. Estimated remaining: 10m 50s. Rate: 147.1 symbols/min [2025-09-29T22:07:29.537092] [DEBUG] [LOCAL ] CWK: Derivative data saved (1794 records). [2025-09-29T22:07:29.537197] [INFO ] [MAIN ] CWK: Successfully saved derivative data. [2025-09-29T22:07:29.540458] [INFO ] [MAIN ] Derivative Progress: 465/2057 symbols completed. CWK took 1.2s. Estimated remaining: 10m 48s. Rate: 147.5 symbols/min [2025-09-29T22:07:29.541224] [INFO ] [MAIN ] CX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:29.541528] [INFO ] [MAIN ] CXH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:29.541387] [INFO ] [MAIN ] CXE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:29.552774] [DEBUG] [LOCAL ] CXH: Loaded 4413 existing records from primary storage. [2025-09-29T22:07:29.552984] [INFO ] [MAIN ] CXH: Loaded 4413 primary data records. [2025-09-29T22:07:29.621421] [DEBUG] [LOCAL ] CXE: Loaded 6813 existing records from primary storage. [2025-09-29T22:07:29.637586] [INFO ] [MAIN ] CXE: Loaded 6813 primary data records. [2025-09-29T22:07:29.929496] [DEBUG] [LOCAL ] CX: Loaded 52822 existing records from primary storage. [2025-09-29T22:07:30.063794] [INFO ] [MAIN ] CX: Loaded 52822 primary data records. [2025-09-29T22:07:30.649332] [DEBUG] [MAIN ] CXE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:30.650476] [INFO ] [MAIN ] CXE: Generated 1794 derivative records from 6813 primary records. [2025-09-29T22:07:30.664932] [DEBUG] [LOCAL ] CXE: Saving derivative data. [2025-09-29T22:07:30.666115] [DEBUG] [MAIN ] CXH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:30.678836] [INFO ] [MAIN ] CXH: Generated 1794 derivative records from 4413 primary records. [2025-09-29T22:07:30.679188] [DEBUG] [LOCAL ] CXH: Saving derivative data. [2025-09-29T22:07:30.697373] [DEBUG] [LOCAL ] CXH: Derivative data saved (1794 records). [2025-09-29T22:07:30.698116] [INFO ] [MAIN ] CXH: Successfully saved derivative data. [2025-09-29T22:07:30.701534] [INFO ] [MAIN ] Derivative Progress: 466/2057 symbols completed. CXH took 1.2s. Estimated remaining: 10m 50s. Rate: 146.9 symbols/min [2025-09-29T22:07:30.703557] [INFO ] [MAIN ] CXM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:30.708130] [DEBUG] [LOCAL ] CXE: Derivative data saved (1794 records). [2025-09-29T22:07:30.721757] [INFO ] [MAIN ] CXE: Successfully saved derivative data. [2025-09-29T22:07:30.724716] [INFO ] [MAIN ] Derivative Progress: 467/2057 symbols completed. CXE took 1.2s. Estimated remaining: 10m 48s. Rate: 147.2 symbols/min [2025-09-29T22:07:30.725462] [INFO ] [MAIN ] CXT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:30.725127] [DEBUG] [MAIN ] CX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:30.727212] [INFO ] [MAIN ] CX: Generated 1794 derivative records from 52822 primary records. [2025-09-29T22:07:30.727444] [DEBUG] [LOCAL ] CX: Saving derivative data. [2025-09-29T22:07:30.745485] [DEBUG] [LOCAL ] CX: Derivative data saved (1794 records). [2025-09-29T22:07:30.745775] [INFO ] [MAIN ] CX: Successfully saved derivative data. [2025-09-29T22:07:30.749057] [INFO ] [MAIN ] Derivative Progress: 468/2057 symbols completed. CX took 1.2s. Estimated remaining: 10m 47s. Rate: 147.5 symbols/min [2025-09-29T22:07:30.749430] [INFO ] [MAIN ] CXW: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:30.791100] [DEBUG] [LOCAL ] CXT: Loaded 31002 existing records from primary storage. [2025-09-29T22:07:30.791354] [INFO ] [MAIN ] CXT: Loaded 31002 primary data records. [2025-09-29T22:07:30.857261] [DEBUG] [LOCAL ] CXM: Loaded 47791 existing records from primary storage. [2025-09-29T22:07:30.900461] [INFO ] [MAIN ] CXM: Loaded 47791 primary data records. [2025-09-29T22:07:31.085531] [DEBUG] [LOCAL ] CXW: Loaded 44141 existing records from primary storage. [2025-09-29T22:07:31.142084] [INFO ] [MAIN ] CXW: Loaded 44141 primary data records. [2025-09-29T22:07:31.916339] [DEBUG] [MAIN ] CXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:31.917540] [INFO ] [MAIN ] CXT: Generated 1794 derivative records from 31002 primary records. [2025-09-29T22:07:31.917789] [DEBUG] [LOCAL ] CXT: Saving derivative data. [2025-09-29T22:07:31.937832] [DEBUG] [LOCAL ] CXT: Derivative data saved (1794 records). [2025-09-29T22:07:31.938922] [INFO ] [MAIN ] CXT: Successfully saved derivative data. [2025-09-29T22:07:31.941234] [INFO ] [MAIN ] Derivative Progress: 469/2057 symbols completed. CXT took 1.2s. Estimated remaining: 10m 49s. Rate: 146.9 symbols/min [2025-09-29T22:07:31.941705] [INFO ] [MAIN ] CYD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:31.956273] [DEBUG] [MAIN ] CXM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:31.957381] [INFO ] [MAIN ] CXM: Generated 1794 derivative records from 47791 primary records. [2025-09-29T22:07:31.957530] [DEBUG] [LOCAL ] CXM: Saving derivative data. [2025-09-29T22:07:31.995359] [DEBUG] [MAIN ] CXW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:31.996453] [INFO ] [MAIN ] CXW: Generated 1794 derivative records from 44141 primary records. [2025-09-29T22:07:31.996799] [DEBUG] [LOCAL ] CXW: Saving derivative data. [2025-09-29T22:07:32.013141] [DEBUG] [LOCAL ] CXM: Derivative data saved (1794 records). [2025-09-29T22:07:32.022140] [INFO ] [MAIN ] CXM: Successfully saved derivative data. [2025-09-29T22:07:32.025002] [INFO ] [MAIN ] Derivative Progress: 470/2057 symbols completed. CXM took 1.3s. Estimated remaining: 10m 47s. Rate: 147.1 symbols/min [2025-09-29T22:07:32.025421] [INFO ] [MAIN ] CYH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:32.026425] [DEBUG] [LOCAL ] CYD: Loaded 26601 existing records from primary storage. [2025-09-29T22:07:32.026889] [INFO ] [MAIN ] CYD: Loaded 26601 primary data records. [2025-09-29T22:07:32.028044] [DEBUG] [LOCAL ] CXW: Derivative data saved (1794 records). [2025-09-29T22:07:32.028384] [INFO ] [MAIN ] CXW: Successfully saved derivative data. [2025-09-29T22:07:32.042816] [INFO ] [MAIN ] Derivative Progress: 471/2057 symbols completed. CXW took 1.3s. Estimated remaining: 10m 46s. Rate: 147.4 symbols/min [2025-09-29T22:07:32.063827] [INFO ] [MAIN ] D: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:32.398270] [DEBUG] [LOCAL ] CYH: Loaded 47561 existing records from primary storage. [2025-09-29T22:07:32.398557] [INFO ] [MAIN ] CYH: Loaded 47561 primary data records. [2025-09-29T22:07:32.580285] [DEBUG] [LOCAL ] D: Loaded 53646 existing records from primary storage. [2025-09-29T22:07:32.617330] [INFO ] [MAIN ] D: Loaded 53646 primary data records. [2025-09-29T22:07:33.110016] [DEBUG] [MAIN ] CYD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:33.112977] [INFO ] [MAIN ] CYD: Generated 1794 derivative records from 26601 primary records. [2025-09-29T22:07:33.113329] [DEBUG] [LOCAL ] CYD: Saving derivative data. [2025-09-29T22:07:33.138742] [DEBUG] [LOCAL ] CYD: Derivative data saved (1794 records). [2025-09-29T22:07:33.140141] [INFO ] [MAIN ] CYD: Successfully saved derivative data. [2025-09-29T22:07:33.143062] [INFO ] [MAIN ] Derivative Progress: 472/2057 symbols completed. CYD took 1.2s. Estimated remaining: 10m 47s. Rate: 146.9 symbols/min [2025-09-29T22:07:33.143244] [INFO ] [MAIN ] DAC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:33.157904] [DEBUG] [MAIN ] CYH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:33.158837] [INFO ] [MAIN ] CYH: Generated 1794 derivative records from 47561 primary records. [2025-09-29T22:07:33.159041] [DEBUG] [LOCAL ] CYH: Saving derivative data. [2025-09-29T22:07:33.182676] [DEBUG] [LOCAL ] DAC: Loaded 12571 existing records from primary storage. [2025-09-29T22:07:33.183127] [INFO ] [MAIN ] DAC: Loaded 12571 primary data records. [2025-09-29T22:07:33.273231] [DEBUG] [LOCAL ] CYH: Derivative data saved (1794 records). [2025-09-29T22:07:33.296268] [INFO ] [MAIN ] CYH: Successfully saved derivative data. [2025-09-29T22:07:33.322024] [INFO ] [MAIN ] Derivative Progress: 473/2057 symbols completed. CYH took 1.3s. Estimated remaining: 10m 46s. Rate: 147.0 symbols/min [2025-09-29T22:07:33.322965] [INFO ] [MAIN ] DAL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:33.322812] [DEBUG] [MAIN ] D: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:33.340915] [INFO ] [MAIN ] D: Generated 1794 derivative records from 53646 primary records. [2025-09-29T22:07:33.375569] [DEBUG] [LOCAL ] D: Saving derivative data. [2025-09-29T22:07:33.553209] [DEBUG] [LOCAL ] D: Derivative data saved (1794 records). [2025-09-29T22:07:33.553632] [INFO ] [MAIN ] D: Successfully saved derivative data. [2025-09-29T22:07:33.557667] [INFO ] [MAIN ] Derivative Progress: 474/2057 symbols completed. D took 1.5s. Estimated remaining: 10m 45s. Rate: 147.2 symbols/min [2025-09-29T22:07:33.557945] [INFO ] [MAIN ] DAN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:33.596555] [DEBUG] [MAIN ] DAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:33.612681] [INFO ] [MAIN ] DAC: Generated 1794 derivative records from 12571 primary records. [2025-09-29T22:07:33.614077] [DEBUG] [LOCAL ] DAL: Loaded 53753 existing records from primary storage. [2025-09-29T22:07:33.614304] [DEBUG] [LOCAL ] DAC: Saving derivative data. [2025-09-29T22:07:33.614506] [INFO ] [MAIN ] DAL: Loaded 53753 primary data records. [2025-09-29T22:07:33.799034] [DEBUG] [LOCAL ] DAC: Derivative data saved (1794 records). [2025-09-29T22:07:33.830213] [INFO ] [MAIN ] DAC: Successfully saved derivative data. [2025-09-29T22:07:33.861534] [DEBUG] [LOCAL ] DAN: Loaded 48995 existing records from primary storage. [2025-09-29T22:07:33.859816] [INFO ] [MAIN ] Derivative Progress: 475/2057 symbols completed. DAC took 0.7s. Estimated remaining: 10m 45s. Rate: 147.3 symbols/min [2025-09-29T22:07:33.867949] [INFO ] [MAIN ] DAN: Loaded 48995 primary data records. [2025-09-29T22:07:33.868096] [INFO ] [MAIN ] DAO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:34.165432] [DEBUG] [LOCAL ] DAO: Loaded 21017 existing records from primary storage. [2025-09-29T22:07:34.195573] [INFO ] [MAIN ] DAO: Loaded 21017 primary data records. [2025-09-29T22:07:34.747411] [DEBUG] [MAIN ] DAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:34.749370] [INFO ] [MAIN ] DAL: Generated 1794 derivative records from 53753 primary records. [2025-09-29T22:07:34.749745] [DEBUG] [LOCAL ] DAL: Saving derivative data. [2025-09-29T22:07:34.787100] [DEBUG] [MAIN ] DAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:34.788884] [DEBUG] [LOCAL ] DAL: Derivative data saved (1794 records). [2025-09-29T22:07:34.789718] [INFO ] [MAIN ] DAN: Generated 1794 derivative records from 48995 primary records. [2025-09-29T22:07:34.790094] [INFO ] [MAIN ] DAL: Successfully saved derivative data. [2025-09-29T22:07:34.792809] [DEBUG] [LOCAL ] DAN: Saving derivative data. [2025-09-29T22:07:34.792557] [INFO ] [MAIN ] Derivative Progress: 476/2057 symbols completed. DAL took 1.5s. Estimated remaining: 10m 46s. Rate: 146.9 symbols/min [2025-09-29T22:07:34.793794] [INFO ] [MAIN ] DAR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:34.812569] [DEBUG] [LOCAL ] DAN: Derivative data saved (1794 records). [2025-09-29T22:07:34.812936] [INFO ] [MAIN ] DAN: Successfully saved derivative data. [2025-09-29T22:07:34.815107] [INFO ] [MAIN ] Derivative Progress: 477/2057 symbols completed. DAN took 1.3s. Estimated remaining: 10m 44s. Rate: 147.2 symbols/min [2025-09-29T22:07:34.815531] [INFO ] [MAIN ] DAVA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:34.833887] [DEBUG] [MAIN ] DAO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:34.834669] [INFO ] [MAIN ] DAO: Generated 1794 derivative records from 21017 primary records. [2025-09-29T22:07:34.834736] [DEBUG] [LOCAL ] DAO: Saving derivative data. [2025-09-29T22:07:34.866847] [DEBUG] [LOCAL ] DAO: Derivative data saved (1794 records). [2025-09-29T22:07:34.867099] [INFO ] [MAIN ] DAO: Successfully saved derivative data. [2025-09-29T22:07:34.869249] [INFO ] [MAIN ] Derivative Progress: 478/2057 symbols completed. DAO took 1.0s. Estimated remaining: 10m 43s. Rate: 147.4 symbols/min [2025-09-29T22:07:34.898289] [DEBUG] [LOCAL ] DAR: Loaded 51851 existing records from primary storage. [2025-09-29T22:07:34.898972] [INFO ] [MAIN ] DAR: Loaded 51851 primary data records. [2025-09-29T22:07:34.992435] [DEBUG] [LOCAL ] DAVA: Loaded 40816 existing records from primary storage. [2025-09-29T22:07:35.010408] [INFO ] [MAIN ] DAVA: Loaded 40816 primary data records. [2025-09-29T22:07:35.595953] [DEBUG] [MAIN ] DAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:35.596953] [INFO ] [MAIN ] DAR: Generated 1794 derivative records from 51851 primary records. [2025-09-29T22:07:35.597178] [DEBUG] [LOCAL ] DAR: Saving derivative data. [2025-09-29T22:07:35.614431] [DEBUG] [LOCAL ] DAR: Derivative data saved (1794 records). [2025-09-29T22:07:35.614857] [INFO ] [MAIN ] DAR: Successfully saved derivative data. [2025-09-29T22:07:35.617146] [INFO ] [MAIN ] Derivative Progress: 479/2057 symbols completed. DAR took 0.8s. Estimated remaining: 10m 43s. Rate: 147.2 symbols/min [2025-09-29T22:07:35.633363] [DEBUG] [MAIN ] DAVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:35.634061] [INFO ] [MAIN ] DAVA: Generated 1794 derivative records from 40816 primary records. [2025-09-29T22:07:35.634128] [DEBUG] [LOCAL ] DAVA: Saving derivative data. [2025-09-29T22:07:35.650971] [DEBUG] [LOCAL ] DAVA: Derivative data saved (1794 records). [2025-09-29T22:07:35.651058] [INFO ] [MAIN ] DAVA: Successfully saved derivative data. [2025-09-29T22:07:35.653207] [INFO ] [MAIN ] Derivative Progress: 480/2057 symbols completed. DAVA took 0.8s. Estimated remaining: 10m 42s. Rate: 147.4 symbols/min [2025-09-29T22:07:35.653790] [INFO ] [MAIN ] DAY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:35.653930] [INFO ] [MAIN ] DBL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:35.654457] [INFO ] [MAIN ] DB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:35.669772] [DEBUG] [LOCAL ] DBL: Loaded 9252 existing records from primary storage. [2025-09-29T22:07:35.670027] [INFO ] [MAIN ] DBL: Loaded 9252 primary data records. [2025-09-29T22:07:36.030608] [DEBUG] [LOCAL ] DB: Loaded 52583 existing records from primary storage. [2025-09-29T22:07:36.045065] [INFO ] [MAIN ] DB: Loaded 52583 primary data records. [2025-09-29T22:07:36.045872] [DEBUG] [LOCAL ] DAY: Loaded 49690 existing records from primary storage. [2025-09-29T22:07:36.046169] [INFO ] [MAIN ] DAY: Loaded 49690 primary data records. [2025-09-29T22:07:36.754050] [DEBUG] [MAIN ] DBL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:36.755603] [INFO ] [MAIN ] DBL: Generated 1794 derivative records from 9252 primary records. [2025-09-29T22:07:36.755738] [DEBUG] [LOCAL ] DBL: Saving derivative data. [2025-09-29T22:07:36.773974] [DEBUG] [LOCAL ] DBL: Derivative data saved (1794 records). [2025-09-29T22:07:36.774590] [INFO ] [MAIN ] DBL: Successfully saved derivative data. [2025-09-29T22:07:36.777019] [INFO ] [MAIN ] Derivative Progress: 481/2057 symbols completed. DBL took 1.1s. Estimated remaining: 10m 44s. Rate: 146.9 symbols/min [2025-09-29T22:07:36.777328] [INFO ] [MAIN ] DCO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:36.795903] [DEBUG] [MAIN ] DAY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:36.796921] [INFO ] [MAIN ] DAY: Generated 1794 derivative records from 49690 primary records. [2025-09-29T22:07:36.797173] [DEBUG] [LOCAL ] DAY: Saving derivative data. [2025-09-29T22:07:36.835079] [DEBUG] [LOCAL ] DCO: Loaded 13831 existing records from primary storage. [2025-09-29T22:07:36.834703] [DEBUG] [MAIN ] DB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:36.836773] [INFO ] [MAIN ] DB: Generated 1794 derivative records from 52583 primary records. [2025-09-29T22:07:36.837169] [DEBUG] [LOCAL ] DB: Saving derivative data. [2025-09-29T22:07:36.838021] [INFO ] [MAIN ] DCO: Loaded 13831 primary data records. [2025-09-29T22:07:36.841748] [DEBUG] [LOCAL ] DAY: Derivative data saved (1794 records). [2025-09-29T22:07:36.901764] [INFO ] [MAIN ] DAY: Successfully saved derivative data. [2025-09-29T22:07:36.909067] [INFO ] [MAIN ] Derivative Progress: 482/2057 symbols completed. DAY took 1.3s. Estimated remaining: 10m 42s. Rate: 147.1 symbols/min [2025-09-29T22:07:36.909241] [INFO ] [MAIN ] DD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:37.035515] [DEBUG] [LOCAL ] DB: Derivative data saved (1794 records). [2025-09-29T22:07:37.058367] [INFO ] [MAIN ] DB: Successfully saved derivative data. [2025-09-29T22:07:37.060959] [INFO ] [MAIN ] Derivative Progress: 483/2057 symbols completed. DB took 1.4s. Estimated remaining: 10m 41s. Rate: 147.3 symbols/min [2025-09-29T22:07:37.061324] [INFO ] [MAIN ] DDD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:37.227922] [DEBUG] [LOCAL ] DD: Loaded 52829 existing records from primary storage. [2025-09-29T22:07:37.228335] [INFO ] [MAIN ] DD: Loaded 52829 primary data records. [2025-09-29T22:07:37.357737] [DEBUG] [MAIN ] DCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:37.381461] [INFO ] [MAIN ] DCO: Generated 1794 derivative records from 13831 primary records. [2025-09-29T22:07:37.386844] [DEBUG] [LOCAL ] DCO: Saving derivative data. [2025-09-29T22:07:37.440176] [DEBUG] [LOCAL ] DDD: Loaded 50893 existing records from primary storage. [2025-09-29T22:07:37.495695] [INFO ] [MAIN ] DDD: Loaded 50893 primary data records. [2025-09-29T22:07:37.685117] [DEBUG] [LOCAL ] DCO: Derivative data saved (1794 records). [2025-09-29T22:07:37.726838] [INFO ] [MAIN ] DCO: Successfully saved derivative data. [2025-09-29T22:07:37.742510] [INFO ] [MAIN ] Derivative Progress: 484/2057 symbols completed. DCO took 1.0s. Estimated remaining: 10m 42s. Rate: 147.1 symbols/min [2025-09-29T22:07:37.748693] [INFO ] [MAIN ] DDL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:38.074743] [DEBUG] [LOCAL ] DDL: Loaded 36597 existing records from primary storage. [2025-09-29T22:07:38.075307] [INFO ] [MAIN ] DDL: Loaded 36597 primary data records. [2025-09-29T22:07:38.203747] [DEBUG] [MAIN ] DD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:38.253621] [INFO ] [MAIN ] DD: Generated 1794 derivative records from 52829 primary records. [2025-09-29T22:07:38.281058] [DEBUG] [LOCAL ] DD: Saving derivative data. [2025-09-29T22:07:38.489294] [DEBUG] [LOCAL ] DD: Derivative data saved (1794 records). [2025-09-29T22:07:38.489582] [INFO ] [MAIN ] DD: Successfully saved derivative data. [2025-09-29T22:07:38.491755] [INFO ] [MAIN ] Derivative Progress: 485/2057 symbols completed. DD took 1.6s. Estimated remaining: 10m 42s. Rate: 146.8 symbols/min [2025-09-29T22:07:38.492049] [INFO ] [MAIN ] DDS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:38.520920] [DEBUG] [MAIN ] DDD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:38.521959] [INFO ] [MAIN ] DDD: Generated 1794 derivative records from 50893 primary records. [2025-09-29T22:07:38.522256] [DEBUG] [LOCAL ] DDD: Saving derivative data. [2025-09-29T22:07:38.528286] [DEBUG] [LOCAL ] DDS: Loaded 13100 existing records from primary storage. [2025-09-29T22:07:38.529023] [INFO ] [MAIN ] DDS: Loaded 13100 primary data records. [2025-09-29T22:07:38.670164] [DEBUG] [LOCAL ] DDD: Derivative data saved (1794 records). [2025-09-29T22:07:38.710306] [INFO ] [MAIN ] DDD: Successfully saved derivative data. [2025-09-29T22:07:38.864414] [DEBUG] [MAIN ] DDL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:38.871980] [INFO ] [MAIN ] Derivative Progress: 486/2057 symbols completed. DDD took 1.8s. Estimated remaining: 10m 42s. Rate: 146.9 symbols/min [2025-09-29T22:07:38.882615] [INFO ] [MAIN ] DDL: Generated 1794 derivative records from 36597 primary records. [2025-09-29T22:07:38.882956] [DEBUG] [LOCAL ] DDL: Saving derivative data. [2025-09-29T22:07:38.883110] [INFO ] [MAIN ] DDT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:38.905348] [DEBUG] [LOCAL ] DDT: Loaded 2094 existing records from primary storage. [2025-09-29T22:07:38.906208] [INFO ] [MAIN ] DDT: Loaded 2094 primary data records. [2025-09-29T22:07:38.961928] [DEBUG] [LOCAL ] DDL: Derivative data saved (1794 records). [2025-09-29T22:07:38.971233] [INFO ] [MAIN ] DDL: Successfully saved derivative data. [2025-09-29T22:07:38.989363] [INFO ] [MAIN ] Derivative Progress: 487/2057 symbols completed. DDL took 1.2s. Estimated remaining: 10m 40s. Rate: 147.1 symbols/min [2025-09-29T22:07:39.026567] [INFO ] [MAIN ] DE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:39.285380] [DEBUG] [MAIN ] DDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:39.287275] [INFO ] [MAIN ] DDS: Generated 1794 derivative records from 13100 primary records. [2025-09-29T22:07:39.287454] [DEBUG] [LOCAL ] DDS: Saving derivative data. [2025-09-29T22:07:39.307383] [DEBUG] [LOCAL ] DDS: Derivative data saved (1794 records). [2025-09-29T22:07:39.322951] [INFO ] [MAIN ] DDS: Successfully saved derivative data. [2025-09-29T22:07:39.325559] [INFO ] [MAIN ] Derivative Progress: 488/2057 symbols completed. DDS took 0.8s. Estimated remaining: 10m 40s. Rate: 147.1 symbols/min [2025-09-29T22:07:39.327254] [DEBUG] [LOCAL ] DE: Loaded 47576 existing records from primary storage. [2025-09-29T22:07:39.327422] [INFO ] [MAIN ] DEA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:39.327782] [INFO ] [MAIN ] DE: Loaded 47576 primary data records. [2025-09-29T22:07:39.558247] [DEBUG] [MAIN ] DDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:39.683635] [INFO ] [MAIN ] DDT: Generated 1794 derivative records from 2094 primary records. [2025-09-29T22:07:39.695722] [DEBUG] [LOCAL ] DDT: Saving derivative data. [2025-09-29T22:07:39.700285] [DEBUG] [LOCAL ] DEA: Loaded 40957 existing records from primary storage. [2025-09-29T22:07:39.708547] [INFO ] [MAIN ] DEA: Loaded 40957 primary data records. [2025-09-29T22:07:39.815857] [DEBUG] [LOCAL ] DDT: Derivative data saved (1794 records). [2025-09-29T22:07:39.828390] [INFO ] [MAIN ] DDT: Successfully saved derivative data. [2025-09-29T22:07:39.830768] [INFO ] [MAIN ] Derivative Progress: 489/2057 symbols completed. DDT took 0.9s. Estimated remaining: 10m 40s. Rate: 147.1 symbols/min [2025-09-29T22:07:39.831158] [INFO ] [MAIN ] DEC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:40.061326] [DEBUG] [MAIN ] DE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:40.062675] [INFO ] [MAIN ] DE: Generated 1794 derivative records from 47576 primary records. [2025-09-29T22:07:40.062838] [DEBUG] [LOCAL ] DE: Saving derivative data. [2025-09-29T22:07:40.092399] [DEBUG] [LOCAL ] DEC: Loaded 30417 existing records from primary storage. [2025-09-29T22:07:40.093777] [INFO ] [MAIN ] DEC: Loaded 30417 primary data records. [2025-09-29T22:07:40.118165] [DEBUG] [LOCAL ] DE: Derivative data saved (1794 records). [2025-09-29T22:07:40.130193] [INFO ] [MAIN ] DE: Successfully saved derivative data. [2025-09-29T22:07:40.156270] [INFO ] [MAIN ] Derivative Progress: 490/2057 symbols completed. DE took 1.1s. Estimated remaining: 10m 39s. Rate: 147.1 symbols/min [2025-09-29T22:07:40.180277] [INFO ] [MAIN ] DECK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:40.284543] [DEBUG] [MAIN ] DEA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:40.308433] [INFO ] [MAIN ] DEA: Generated 1794 derivative records from 40957 primary records. [2025-09-29T22:07:40.421957] [DEBUG] [LOCAL ] DEA: Saving derivative data. [2025-09-29T22:07:40.465622] [DEBUG] [LOCAL ] DEA: Derivative data saved (1794 records). [2025-09-29T22:07:40.481798] [INFO ] [MAIN ] DEA: Successfully saved derivative data. [2025-09-29T22:07:40.484280] [INFO ] [MAIN ] Derivative Progress: 491/2057 symbols completed. DEA took 1.2s. Estimated remaining: 10m 38s. Rate: 147.2 symbols/min [2025-09-29T22:07:40.484971] [INFO ] [MAIN ] DEI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:40.505517] [DEBUG] [MAIN ] DEC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:40.506458] [INFO ] [MAIN ] DEC: Generated 1794 derivative records from 30417 primary records. [2025-09-29T22:07:40.506765] [DEBUG] [LOCAL ] DEC: Saving derivative data. [2025-09-29T22:07:40.532442] [DEBUG] [LOCAL ] DECK: Loaded 53297 existing records from primary storage. [2025-09-29T22:07:40.535206] [INFO ] [MAIN ] DECK: Loaded 53297 primary data records. [2025-09-29T22:07:40.539718] [DEBUG] [LOCAL ] DEC: Derivative data saved (1794 records). [2025-09-29T22:07:40.539841] [INFO ] [MAIN ] DEC: Successfully saved derivative data. [2025-09-29T22:07:40.542208] [INFO ] [MAIN ] Derivative Progress: 492/2057 symbols completed. DEC took 0.7s. Estimated remaining: 10m 37s. Rate: 147.4 symbols/min [2025-09-29T22:07:40.547603] [INFO ] [MAIN ] DELL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:40.919814] [DEBUG] [LOCAL ] DEI: Loaded 48386 existing records from primary storage. [2025-09-29T22:07:40.920773] [INFO ] [MAIN ] DEI: Loaded 48386 primary data records. [2025-09-29T22:07:41.086400] [DEBUG] [LOCAL ] DELL: Loaded 53735 existing records from primary storage. [2025-09-29T22:07:41.097410] [INFO ] [MAIN ] DELL: Loaded 53735 primary data records. [2025-09-29T22:07:41.652600] [DEBUG] [MAIN ] DECK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:41.655041] [INFO ] [MAIN ] DECK: Generated 1794 derivative records from 53297 primary records. [2025-09-29T22:07:41.655290] [DEBUG] [LOCAL ] DECK: Saving derivative data. [2025-09-29T22:07:41.681253] [DEBUG] [LOCAL ] DECK: Derivative data saved (1794 records). [2025-09-29T22:07:41.681469] [INFO ] [MAIN ] DECK: Successfully saved derivative data. [2025-09-29T22:07:41.683802] [INFO ] [MAIN ] Derivative Progress: 493/2057 symbols completed. DECK took 1.5s. Estimated remaining: 10m 39s. Rate: 146.9 symbols/min [2025-09-29T22:07:41.697751] [DEBUG] [MAIN ] DEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:41.698609] [INFO ] [MAIN ] DEI: Generated 1794 derivative records from 48386 primary records. [2025-09-29T22:07:41.698948] [DEBUG] [LOCAL ] DEI: Saving derivative data. [2025-09-29T22:07:41.730902] [DEBUG] [MAIN ] DELL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:41.732273] [INFO ] [MAIN ] DELL: Generated 1794 derivative records from 53735 primary records. [2025-09-29T22:07:41.732806] [DEBUG] [LOCAL ] DELL: Saving derivative data. [2025-09-29T22:07:41.742105] [DEBUG] [LOCAL ] DEI: Derivative data saved (1794 records). [2025-09-29T22:07:41.745680] [INFO ] [MAIN ] DEI: Successfully saved derivative data. [2025-09-29T22:07:41.747968] [INFO ] [MAIN ] Derivative Progress: 494/2057 symbols completed. DEI took 1.3s. Estimated remaining: 10m 37s. Rate: 147.2 symbols/min [2025-09-29T22:07:41.752349] [DEBUG] [LOCAL ] DELL: Derivative data saved (1794 records). [2025-09-29T22:07:41.752415] [INFO ] [MAIN ] DELL: Successfully saved derivative data. [2025-09-29T22:07:41.755578] [INFO ] [MAIN ] Derivative Progress: 495/2057 symbols completed. DELL took 1.2s. Estimated remaining: 10m 36s. Rate: 147.4 symbols/min [2025-09-29T22:07:41.756200] [INFO ] [MAIN ] DFIN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:41.756122] [INFO ] [MAIN ] DFH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:41.756414] [INFO ] [MAIN ] DG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:41.791209] [DEBUG] [LOCAL ] DFIN: Loaded 23167 existing records from primary storage. [2025-09-29T22:07:41.791352] [INFO ] [MAIN ] DFIN: Loaded 23167 primary data records. [2025-09-29T22:07:41.922146] [DEBUG] [LOCAL ] DFH: Loaded 32389 existing records from primary storage. [2025-09-29T22:07:41.934890] [INFO ] [MAIN ] DFH: Loaded 32389 primary data records. [2025-09-29T22:07:42.225094] [DEBUG] [LOCAL ] DG: Loaded 53284 existing records from primary storage. [2025-09-29T22:07:42.249012] [INFO ] [MAIN ] DG: Loaded 53284 primary data records. [2025-09-29T22:07:42.887158] [DEBUG] [MAIN ] DFIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:42.888511] [INFO ] [MAIN ] DFIN: Generated 1794 derivative records from 23167 primary records. [2025-09-29T22:07:42.888961] [DEBUG] [LOCAL ] DFIN: Saving derivative data. [2025-09-29T22:07:42.925089] [DEBUG] [MAIN ] DG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:42.939409] [INFO ] [MAIN ] DG: Generated 1794 derivative records from 53284 primary records. [2025-09-29T22:07:42.938639] [DEBUG] [MAIN ] DFH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:42.940161] [INFO ] [MAIN ] DFH: Generated 1794 derivative records from 32389 primary records. [2025-09-29T22:07:42.938124] [DEBUG] [LOCAL ] DFIN: Derivative data saved (1794 records). [2025-09-29T22:07:42.939575] [DEBUG] [LOCAL ] DG: Saving derivative data. [2025-09-29T22:07:42.940460] [INFO ] [MAIN ] DFIN: Successfully saved derivative data. [2025-09-29T22:07:42.942910] [INFO ] [MAIN ] Derivative Progress: 496/2057 symbols completed. DFIN took 1.2s. Estimated remaining: 10m 38s. Rate: 146.9 symbols/min [2025-09-29T22:07:42.940551] [DEBUG] [LOCAL ] DFH: Saving derivative data. [2025-09-29T22:07:42.943835] [INFO ] [MAIN ] DGX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:42.974552] [DEBUG] [LOCAL ] DG: Derivative data saved (1794 records). [2025-09-29T22:07:42.975085] [INFO ] [MAIN ] DG: Successfully saved derivative data. [2025-09-29T22:07:42.977709] [INFO ] [MAIN ] Derivative Progress: 497/2057 symbols completed. DG took 1.2s. Estimated remaining: 10m 36s. Rate: 147.1 symbols/min [2025-09-29T22:07:42.978113] [INFO ] [MAIN ] DHF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:42.981422] [DEBUG] [LOCAL ] DFH: Derivative data saved (1794 records). [2025-09-29T22:07:42.981499] [INFO ] [MAIN ] DFH: Successfully saved derivative data. [2025-09-29T22:07:42.984166] [INFO ] [MAIN ] Derivative Progress: 498/2057 symbols completed. DFH took 1.2s. Estimated remaining: 10m 34s. Rate: 147.4 symbols/min [2025-09-29T22:07:42.984723] [INFO ] [MAIN ] DHI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:43.018113] [DEBUG] [LOCAL ] DHF: Loaded 20678 existing records from primary storage. [2025-09-29T22:07:43.018563] [INFO ] [MAIN ] DHF: Loaded 20678 primary data records. [2025-09-29T22:07:43.164524] [DEBUG] [LOCAL ] DGX: Loaded 44954 existing records from primary storage. [2025-09-29T22:07:43.188728] [INFO ] [MAIN ] DGX: Loaded 44954 primary data records. [2025-09-29T22:07:43.358397] [DEBUG] [LOCAL ] DHI: Loaded 53361 existing records from primary storage. [2025-09-29T22:07:43.506395] [INFO ] [MAIN ] DHI: Loaded 53361 primary data records. [2025-09-29T22:07:44.084005] [DEBUG] [MAIN ] DHF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:44.086494] [INFO ] [MAIN ] DHF: Generated 1794 derivative records from 20678 primary records. [2025-09-29T22:07:44.086803] [DEBUG] [LOCAL ] DHF: Saving derivative data. [2025-09-29T22:07:44.107634] [DEBUG] [LOCAL ] DHF: Derivative data saved (1794 records). [2025-09-29T22:07:44.107958] [INFO ] [MAIN ] DHF: Successfully saved derivative data. [2025-09-29T22:07:44.118410] [INFO ] [MAIN ] Derivative Progress: 499/2057 symbols completed. DHF took 1.1s. Estimated remaining: 10m 36s. Rate: 146.9 symbols/min [2025-09-29T22:07:44.123798] [INFO ] [MAIN ] DHT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:44.124128] [DEBUG] [MAIN ] DGX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:44.125788] [INFO ] [MAIN ] DGX: Generated 1794 derivative records from 44954 primary records. [2025-09-29T22:07:44.126010] [DEBUG] [LOCAL ] DGX: Saving derivative data. [2025-09-29T22:07:44.146727] [DEBUG] [LOCAL ] DGX: Derivative data saved (1794 records). [2025-09-29T22:07:44.146906] [INFO ] [MAIN ] DGX: Successfully saved derivative data. [2025-09-29T22:07:44.149207] [INFO ] [MAIN ] Derivative Progress: 500/2057 symbols completed. DGX took 1.2s. Estimated remaining: 10m 35s. Rate: 147.2 symbols/min [2025-09-29T22:07:44.157476] [INFO ] [MAIN ] DHX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:44.163399] [DEBUG] [MAIN ] DHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:44.164303] [INFO ] [MAIN ] DHI: Generated 1794 derivative records from 53361 primary records. [2025-09-29T22:07:44.164459] [DEBUG] [LOCAL ] DHI: Saving derivative data. [2025-09-29T22:07:44.187258] [DEBUG] [LOCAL ] DHI: Derivative data saved (1794 records). [2025-09-29T22:07:44.202868] [INFO ] [MAIN ] DHI: Successfully saved derivative data. [2025-09-29T22:07:44.202761] [DEBUG] [LOCAL ] DHX: Loaded 13104 existing records from primary storage. [2025-09-29T22:07:44.205434] [INFO ] [MAIN ] DHX: Loaded 13104 primary data records. [2025-09-29T22:07:44.205300] [INFO ] [MAIN ] Derivative Progress: 501/2057 symbols completed. DHI took 1.2s. Estimated remaining: 10m 33s. Rate: 147.4 symbols/min [2025-09-29T22:07:44.239740] [INFO ] [MAIN ] DIN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:44.327077] [DEBUG] [LOCAL ] DHT: Loaded 47882 existing records from primary storage. [2025-09-29T22:07:44.330918] [INFO ] [MAIN ] DHT: Loaded 47882 primary data records. [2025-09-29T22:07:44.778502] [DEBUG] [LOCAL ] DIN: Loaded 37181 existing records from primary storage. [2025-09-29T22:07:44.925443] [INFO ] [MAIN ] DIN: Loaded 37181 primary data records. [2025-09-29T22:07:45.289755] [DEBUG] [MAIN ] DHX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:45.290752] [INFO ] [MAIN ] DHX: Generated 1794 derivative records from 13104 primary records. [2025-09-29T22:07:45.291763] [DEBUG] [LOCAL ] DHX: Saving derivative data. [2025-09-29T22:07:45.328454] [DEBUG] [MAIN ] DHT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:45.329519] [INFO ] [MAIN ] DHT: Generated 1794 derivative records from 47882 primary records. [2025-09-29T22:07:45.329874] [DEBUG] [LOCAL ] DHT: Saving derivative data. [2025-09-29T22:07:45.331373] [DEBUG] [LOCAL ] DHX: Derivative data saved (1794 records). [2025-09-29T22:07:45.331922] [INFO ] [MAIN ] DHX: Successfully saved derivative data. [2025-09-29T22:07:45.346329] [INFO ] [MAIN ] Derivative Progress: 502/2057 symbols completed. DHX took 1.2s. Estimated remaining: 10m 35s. Rate: 146.9 symbols/min [2025-09-29T22:07:45.351254] [INFO ] [MAIN ] DINO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:45.351128] [DEBUG] [LOCAL ] DHT: Derivative data saved (1794 records). [2025-09-29T22:07:45.352024] [INFO ] [MAIN ] DHT: Successfully saved derivative data. [2025-09-29T22:07:45.354504] [INFO ] [MAIN ] Derivative Progress: 503/2057 symbols completed. DHT took 1.2s. Estimated remaining: 10m 33s. Rate: 147.2 symbols/min [2025-09-29T22:07:45.355327] [INFO ] [MAIN ] DIS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:45.374488] [DEBUG] [MAIN ] DIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:45.375333] [INFO ] [MAIN ] DIN: Generated 1794 derivative records from 37181 primary records. [2025-09-29T22:07:45.375483] [DEBUG] [LOCAL ] DIN: Saving derivative data. [2025-09-29T22:07:45.393512] [DEBUG] [LOCAL ] DIN: Derivative data saved (1794 records). [2025-09-29T22:07:45.393697] [INFO ] [MAIN ] DIN: Successfully saved derivative data. [2025-09-29T22:07:45.396391] [INFO ] [MAIN ] Derivative Progress: 504/2057 symbols completed. DIN took 1.2s. Estimated remaining: 10m 32s. Rate: 147.5 symbols/min [2025-09-29T22:07:45.396565] [INFO ] [MAIN ] DK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:45.482188] [DEBUG] [LOCAL ] DINO: Loaded 52952 existing records from primary storage. [2025-09-29T22:07:45.483979] [INFO ] [MAIN ] DINO: Loaded 52952 primary data records. [2025-09-29T22:07:45.507517] [DEBUG] [LOCAL ] DIS: Loaded 53788 existing records from primary storage. [2025-09-29T22:07:45.543950] [INFO ] [MAIN ] DIS: Loaded 53788 primary data records. [2025-09-29T22:07:45.601602] [DEBUG] [LOCAL ] DK: Loaded 49324 existing records from primary storage. [2025-09-29T22:07:45.657025] [INFO ] [MAIN ] DK: Loaded 49324 primary data records. [2025-09-29T22:07:46.529636] [DEBUG] [MAIN ] DIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:46.531762] [DEBUG] [MAIN ] DINO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:46.532968] [INFO ] [MAIN ] DIS: Generated 1794 derivative records from 53788 primary records. [2025-09-29T22:07:46.534141] [INFO ] [MAIN ] DINO: Generated 1794 derivative records from 52952 primary records. [2025-09-29T22:07:46.534428] [DEBUG] [LOCAL ] DIS: Saving derivative data. [2025-09-29T22:07:46.534299] [DEBUG] [LOCAL ] DINO: Saving derivative data. [2025-09-29T22:07:46.579959] [DEBUG] [LOCAL ] DIS: Derivative data saved (1794 records). [2025-09-29T22:07:46.580194] [DEBUG] [MAIN ] DK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:46.584363] [INFO ] [MAIN ] DK: Generated 1794 derivative records from 49324 primary records. [2025-09-29T22:07:46.583110] [DEBUG] [LOCAL ] DINO: Derivative data saved (1794 records). [2025-09-29T22:07:46.584516] [INFO ] [MAIN ] DINO: Successfully saved derivative data. [2025-09-29T22:07:46.584633] [DEBUG] [LOCAL ] DK: Saving derivative data. [2025-09-29T22:07:46.583255] [INFO ] [MAIN ] DIS: Successfully saved derivative data. [2025-09-29T22:07:46.587331] [INFO ] [MAIN ] Derivative Progress: 505/2057 symbols completed. DINO took 1.2s. Estimated remaining: 10m 34s. Rate: 146.9 symbols/min [2025-09-29T22:07:46.590036] [INFO ] [MAIN ] DKL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:46.590547] [INFO ] [MAIN ] Derivative Progress: 506/2057 symbols completed. DIS took 1.2s. Estimated remaining: 10m 32s. Rate: 147.2 symbols/min [2025-09-29T22:07:46.604699] [INFO ] [MAIN ] DKS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:46.608496] [DEBUG] [LOCAL ] DK: Derivative data saved (1794 records). [2025-09-29T22:07:46.608675] [INFO ] [MAIN ] DK: Successfully saved derivative data. [2025-09-29T22:07:46.610850] [INFO ] [MAIN ] Derivative Progress: 507/2057 symbols completed. DK took 1.2s. Estimated remaining: 10m 31s. Rate: 147.5 symbols/min [2025-09-29T22:07:46.611135] [INFO ] [MAIN ] DLB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:46.627390] [DEBUG] [LOCAL ] DKL: Loaded 18836 existing records from primary storage. [2025-09-29T22:07:46.627613] [INFO ] [MAIN ] DKL: Loaded 18836 primary data records. [2025-09-29T22:07:46.821196] [DEBUG] [LOCAL ] DLB: Loaded 31993 existing records from primary storage. [2025-09-29T22:07:46.847744] [INFO ] [MAIN ] DLB: Loaded 31993 primary data records. [2025-09-29T22:07:47.090146] [DEBUG] [LOCAL ] DKS: Loaded 49803 existing records from primary storage. [2025-09-29T22:07:47.103819] [INFO ] [MAIN ] DKS: Loaded 49803 primary data records. [2025-09-29T22:07:47.691862] [DEBUG] [MAIN ] DKL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:47.692987] [INFO ] [MAIN ] DKL: Generated 1794 derivative records from 18836 primary records. [2025-09-29T22:07:47.693098] [DEBUG] [LOCAL ] DKL: Saving derivative data. [2025-09-29T22:07:47.712520] [DEBUG] [LOCAL ] DKL: Derivative data saved (1794 records). [2025-09-29T22:07:47.712907] [INFO ] [MAIN ] DKL: Successfully saved derivative data. [2025-09-29T22:07:47.714972] [INFO ] [MAIN ] Derivative Progress: 508/2057 symbols completed. DKL took 1.1s. Estimated remaining: 10m 32s. Rate: 147.0 symbols/min [2025-09-29T22:07:47.733914] [DEBUG] [MAIN ] DLB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:47.735894] [INFO ] [MAIN ] DLB: Generated 1794 derivative records from 31993 primary records. [2025-09-29T22:07:47.736086] [DEBUG] [LOCAL ] DLB: Saving derivative data. [2025-09-29T22:07:47.749475] [DEBUG] [MAIN ] DKS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:47.750340] [INFO ] [MAIN ] DKS: Generated 1794 derivative records from 49803 primary records. [2025-09-29T22:07:47.757520] [DEBUG] [LOCAL ] DKS: Saving derivative data. [2025-09-29T22:07:47.779541] [DEBUG] [LOCAL ] DLB: Derivative data saved (1794 records). [2025-09-29T22:07:47.781127] [INFO ] [MAIN ] DLB: Successfully saved derivative data. [2025-09-29T22:07:47.784014] [INFO ] [MAIN ] Derivative Progress: 509/2057 symbols completed. DLB took 1.2s. Estimated remaining: 10m 31s. Rate: 147.2 symbols/min [2025-09-29T22:07:47.784422] [DEBUG] [LOCAL ] DKS: Derivative data saved (1794 records). [2025-09-29T22:07:47.784632] [INFO ] [MAIN ] DKS: Successfully saved derivative data. [2025-09-29T22:07:47.786848] [INFO ] [MAIN ] Derivative Progress: 510/2057 symbols completed. DKS took 1.2s. Estimated remaining: 10m 29s. Rate: 147.5 symbols/min [2025-09-29T22:07:47.787241] [INFO ] [MAIN ] DLR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:47.787354] [INFO ] [MAIN ] DLX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:47.787826] [INFO ] [MAIN ] DLNG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:47.797820] [DEBUG] [LOCAL ] DLNG: Loaded 6117 existing records from primary storage. [2025-09-29T22:07:47.797954] [INFO ] [MAIN ] DLNG: Loaded 6117 primary data records. [2025-09-29T22:07:48.149334] [DEBUG] [LOCAL ] DLX: Loaded 28625 existing records from primary storage. [2025-09-29T22:07:48.166019] [DEBUG] [LOCAL ] DLR: Loaded 51011 existing records from primary storage. [2025-09-29T22:07:48.165170] [INFO ] [MAIN ] DLX: Loaded 28625 primary data records. [2025-09-29T22:07:48.166449] [INFO ] [MAIN ] DLR: Loaded 51011 primary data records. [2025-09-29T22:07:48.837427] [DEBUG] [MAIN ] DLNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:48.841200] [INFO ] [MAIN ] DLNG: Generated 1794 derivative records from 6117 primary records. [2025-09-29T22:07:48.841914] [DEBUG] [LOCAL ] DLNG: Saving derivative data. [2025-09-29T22:07:48.863763] [DEBUG] [LOCAL ] DLNG: Derivative data saved (1794 records). [2025-09-29T22:07:48.864062] [INFO ] [MAIN ] DLNG: Successfully saved derivative data. [2025-09-29T22:07:48.866467] [INFO ] [MAIN ] Derivative Progress: 511/2057 symbols completed. DLNG took 1.1s. Estimated remaining: 10m 31s. Rate: 147.0 symbols/min [2025-09-29T22:07:48.867337] [INFO ] [MAIN ] DLY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:48.912473] [DEBUG] [MAIN ] DLR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:48.913940] [INFO ] [MAIN ] DLR: Generated 1794 derivative records from 51011 primary records. [2025-09-29T22:07:48.912940] [DEBUG] [MAIN ] DLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:48.914084] [DEBUG] [LOCAL ] DLR: Saving derivative data. [2025-09-29T22:07:48.915111] [INFO ] [MAIN ] DLX: Generated 1794 derivative records from 28625 primary records. [2025-09-29T22:07:48.915219] [DEBUG] [LOCAL ] DLX: Saving derivative data. [2025-09-29T22:07:48.940357] [DEBUG] [LOCAL ] DLY: Loaded 19652 existing records from primary storage. [2025-09-29T22:07:48.945461] [INFO ] [MAIN ] DLY: Loaded 19652 primary data records. [2025-09-29T22:07:48.978061] [DEBUG] [LOCAL ] DLR: Derivative data saved (1794 records). [2025-09-29T22:07:48.996122] [INFO ] [MAIN ] DLR: Successfully saved derivative data. [2025-09-29T22:07:48.996228] [DEBUG] [LOCAL ] DLX: Derivative data saved (1794 records). [2025-09-29T22:07:49.006282] [INFO ] [MAIN ] Derivative Progress: 512/2057 symbols completed. DLR took 1.2s. Estimated remaining: 10m 30s. Rate: 147.2 symbols/min [2025-09-29T22:07:49.011707] [INFO ] [MAIN ] DMA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:49.041930] [INFO ] [MAIN ] DLX: Successfully saved derivative data. [2025-09-29T22:07:49.054959] [INFO ] [MAIN ] Derivative Progress: 513/2057 symbols completed. DLX took 1.3s. Estimated remaining: 10m 28s. Rate: 147.5 symbols/min [2025-09-29T22:07:49.073196] [INFO ] [MAIN ] DMB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:49.156372] [DEBUG] [LOCAL ] DMA: Loaded 4526 existing records from primary storage. [2025-09-29T22:07:49.165037] [INFO ] [MAIN ] DMA: Loaded 4526 primary data records. [2025-09-29T22:07:49.328521] [DEBUG] [LOCAL ] DMB: Loaded 10202 existing records from primary storage. [2025-09-29T22:07:49.347597] [INFO ] [MAIN ] DMB: Loaded 10202 primary data records. [2025-09-29T22:07:50.020894] [DEBUG] [MAIN ] DLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:50.022045] [INFO ] [MAIN ] DLY: Generated 1794 derivative records from 19652 primary records. [2025-09-29T22:07:50.022995] [DEBUG] [LOCAL ] DLY: Saving derivative data. [2025-09-29T22:07:50.042908] [DEBUG] [LOCAL ] DLY: Derivative data saved (1794 records). [2025-09-29T22:07:50.043414] [INFO ] [MAIN ] DLY: Successfully saved derivative data. [2025-09-29T22:07:50.045580] [INFO ] [MAIN ] Derivative Progress: 514/2057 symbols completed. DLY took 1.2s. Estimated remaining: 10m 30s. Rate: 147.1 symbols/min [2025-09-29T22:07:50.046174] [INFO ] [MAIN ] DNA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:50.082439] [DEBUG] [MAIN ] DMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:50.082257] [DEBUG] [MAIN ] DMA: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:07:50.083478] [INFO ] [MAIN ] DMA: Generated 1793 derivative records from 4526 primary records. [2025-09-29T22:07:50.084198] [INFO ] [MAIN ] DMB: Generated 1794 derivative records from 10202 primary records. [2025-09-29T22:07:50.084415] [DEBUG] [LOCAL ] DMA: Saving derivative data. [2025-09-29T22:07:50.084806] [DEBUG] [LOCAL ] DMB: Saving derivative data. [2025-09-29T22:07:50.115445] [DEBUG] [LOCAL ] DMB: Derivative data saved (1794 records). [2025-09-29T22:07:50.127797] [INFO ] [MAIN ] DMB: Successfully saved derivative data. [2025-09-29T22:07:50.114668] [DEBUG] [LOCAL ] DMA: Derivative data saved (1793 records). [2025-09-29T22:07:50.128010] [INFO ] [MAIN ] DMA: Successfully saved derivative data. [2025-09-29T22:07:50.130284] [INFO ] [MAIN ] Derivative Progress: 515/2057 symbols completed. DMA took 1.1s. Estimated remaining: 10m 28s. Rate: 147.3 symbols/min [2025-09-29T22:07:50.132707] [INFO ] [MAIN ] Derivative Progress: 516/2057 symbols completed. DMB took 1.1s. Estimated remaining: 10m 27s. Rate: 147.6 symbols/min [2025-09-29T22:07:50.132921] [INFO ] [MAIN ] DNP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:50.132628] [INFO ] [MAIN ] DNOW: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:50.153879] [DEBUG] [LOCAL ] DNA: Loaded 48248 existing records from primary storage. [2025-09-29T22:07:50.154212] [INFO ] [MAIN ] DNA: Loaded 48248 primary data records. [2025-09-29T22:07:50.394975] [DEBUG] [LOCAL ] DNP: Loaded 33167 existing records from primary storage. [2025-09-29T22:07:50.396112] [INFO ] [MAIN ] DNP: Loaded 33167 primary data records. [2025-09-29T22:07:50.396016] [DEBUG] [LOCAL ] DNOW: Loaded 43639 existing records from primary storage. [2025-09-29T22:07:50.398081] [INFO ] [MAIN ] DNOW: Loaded 43639 primary data records. [2025-09-29T22:07:51.295017] [DEBUG] [MAIN ] DNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:51.295849] [INFO ] [MAIN ] DNA: Generated 1794 derivative records from 48248 primary records. [2025-09-29T22:07:51.296285] [DEBUG] [LOCAL ] DNA: Saving derivative data. [2025-09-29T22:07:51.314487] [DEBUG] [LOCAL ] DNA: Derivative data saved (1794 records). [2025-09-29T22:07:51.315242] [INFO ] [MAIN ] DNA: Successfully saved derivative data. [2025-09-29T22:07:51.317380] [INFO ] [MAIN ] Derivative Progress: 517/2057 symbols completed. DNA took 1.3s. Estimated remaining: 10m 28s. Rate: 147.0 symbols/min [2025-09-29T22:07:51.317696] [INFO ] [MAIN ] DOC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:51.337939] [DEBUG] [MAIN ] DNP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:51.352076] [INFO ] [MAIN ] DNP: Generated 1794 derivative records from 33167 primary records. [2025-09-29T22:07:51.352415] [DEBUG] [MAIN ] DNOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:51.352746] [DEBUG] [LOCAL ] DNP: Saving derivative data. [2025-09-29T22:07:51.353957] [INFO ] [MAIN ] DNOW: Generated 1794 derivative records from 43639 primary records. [2025-09-29T22:07:51.354346] [DEBUG] [LOCAL ] DNOW: Saving derivative data. [2025-09-29T22:07:51.384068] [DEBUG] [LOCAL ] DNP: Derivative data saved (1794 records). [2025-09-29T22:07:51.387596] [DEBUG] [LOCAL ] DNOW: Derivative data saved (1794 records). [2025-09-29T22:07:51.387695] [INFO ] [MAIN ] DNP: Successfully saved derivative data. [2025-09-29T22:07:51.387924] [INFO ] [MAIN ] DNOW: Successfully saved derivative data. [2025-09-29T22:07:51.390200] [INFO ] [MAIN ] Derivative Progress: 518/2057 symbols completed. DNP took 1.3s. Estimated remaining: 10m 27s. Rate: 147.3 symbols/min [2025-09-29T22:07:51.392558] [INFO ] [MAIN ] DOCN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:51.392885] [INFO ] [MAIN ] Derivative Progress: 519/2057 symbols completed. DNOW took 1.3s. Estimated remaining: 10m 25s. Rate: 147.5 symbols/min [2025-09-29T22:07:51.393475] [INFO ] [MAIN ] DOLE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:51.437474] [DEBUG] [LOCAL ] DOC: Loaded 53542 existing records from primary storage. [2025-09-29T22:07:51.437800] [INFO ] [MAIN ] DOC: Loaded 53542 primary data records. [2025-09-29T22:07:51.584795] [DEBUG] [LOCAL ] DOLE: Loaded 38140 existing records from primary storage. [2025-09-29T22:07:51.590953] [INFO ] [MAIN ] DOLE: Loaded 38140 primary data records. [2025-09-29T22:07:51.726334] [DEBUG] [LOCAL ] DOCN: Loaded 50511 existing records from primary storage. [2025-09-29T22:07:51.758724] [INFO ] [MAIN ] DOCN: Loaded 50511 primary data records. [2025-09-29T22:07:52.495210] [DEBUG] [MAIN ] DOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:52.498055] [INFO ] [MAIN ] DOC: Generated 1794 derivative records from 53542 primary records. [2025-09-29T22:07:52.498330] [DEBUG] [LOCAL ] DOC: Saving derivative data. [2025-09-29T22:07:52.534012] [DEBUG] [LOCAL ] DOC: Derivative data saved (1794 records). [2025-09-29T22:07:52.535087] [INFO ] [MAIN ] DOC: Successfully saved derivative data. [2025-09-29T22:07:52.534887] [DEBUG] [MAIN ] DOLE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:52.535990] [INFO ] [MAIN ] DOLE: Generated 1794 derivative records from 38140 primary records. [2025-09-29T22:07:52.538864] [INFO ] [MAIN ] Derivative Progress: 520/2057 symbols completed. DOC took 1.2s. Estimated remaining: 10m 27s. Rate: 147.0 symbols/min [2025-09-29T22:07:52.542132] [INFO ] [MAIN ] DOUG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:52.541174] [DEBUG] [LOCAL ] DOLE: Saving derivative data. [2025-09-29T22:07:52.574835] [DEBUG] [MAIN ] DOCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:52.579883] [INFO ] [MAIN ] DOCN: Generated 1794 derivative records from 50511 primary records. [2025-09-29T22:07:52.580784] [DEBUG] [LOCAL ] DOLE: Derivative data saved (1794 records). [2025-09-29T22:07:52.580902] [DEBUG] [LOCAL ] DOCN: Saving derivative data. [2025-09-29T22:07:52.589776] [INFO ] [MAIN ] DOLE: Successfully saved derivative data. [2025-09-29T22:07:52.599035] [INFO ] [MAIN ] Derivative Progress: 521/2057 symbols completed. DOLE took 1.2s. Estimated remaining: 10m 26s. Rate: 147.3 symbols/min [2025-09-29T22:07:52.602688] [DEBUG] [LOCAL ] DOCN: Derivative data saved (1794 records). [2025-09-29T22:07:52.603369] [INFO ] [MAIN ] DOCN: Successfully saved derivative data. [2025-09-29T22:07:52.602990] [INFO ] [MAIN ] DOV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:52.605749] [INFO ] [MAIN ] Derivative Progress: 522/2057 symbols completed. DOCN took 1.2s. Estimated remaining: 10m 24s. Rate: 147.5 symbols/min [2025-09-29T22:07:52.616576] [INFO ] [MAIN ] DPG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:52.636501] [DEBUG] [LOCAL ] DOUG: Loaded 34627 existing records from primary storage. [2025-09-29T22:07:52.636855] [INFO ] [MAIN ] DOUG: Loaded 34627 primary data records. [2025-09-29T22:07:52.711159] [DEBUG] [LOCAL ] DPG: Loaded 13524 existing records from primary storage. [2025-09-29T22:07:52.723786] [INFO ] [MAIN ] DPG: Loaded 13524 primary data records. [2025-09-29T22:07:53.127761] [DEBUG] [LOCAL ] DOV: Loaded 45536 existing records from primary storage. [2025-09-29T22:07:53.156445] [INFO ] [MAIN ] DOV: Loaded 45536 primary data records. [2025-09-29T22:07:53.780605] [DEBUG] [MAIN ] DOUG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:53.791140] [INFO ] [MAIN ] DOUG: Generated 1794 derivative records from 34627 primary records. [2025-09-29T22:07:53.792362] [DEBUG] [LOCAL ] DOUG: Saving derivative data. [2025-09-29T22:07:53.828361] [DEBUG] [MAIN ] DPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:53.831868] [INFO ] [MAIN ] DPG: Generated 1794 derivative records from 13524 primary records. [2025-09-29T22:07:53.832263] [DEBUG] [LOCAL ] DPG: Saving derivative data. [2025-09-29T22:07:53.834829] [DEBUG] [LOCAL ] DOUG: Derivative data saved (1794 records). [2025-09-29T22:07:53.835263] [INFO ] [MAIN ] DOUG: Successfully saved derivative data. [2025-09-29T22:07:53.837480] [INFO ] [MAIN ] Derivative Progress: 523/2057 symbols completed. DOUG took 1.3s. Estimated remaining: 10m 26s. Rate: 147.0 symbols/min [2025-09-29T22:07:53.855590] [DEBUG] [LOCAL ] DPG: Derivative data saved (1794 records). [2025-09-29T22:07:53.856093] [INFO ] [MAIN ] DPG: Successfully saved derivative data. [2025-09-29T22:07:53.859180] [INFO ] [MAIN ] Derivative Progress: 524/2057 symbols completed. DPG took 1.2s. Estimated remaining: 10m 25s. Rate: 147.2 symbols/min [2025-09-29T22:07:53.878176] [DEBUG] [MAIN ] DOV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:53.879095] [INFO ] [MAIN ] DOV: Generated 1794 derivative records from 45536 primary records. [2025-09-29T22:07:53.879168] [DEBUG] [LOCAL ] DOV: Saving derivative data. [2025-09-29T22:07:53.895825] [DEBUG] [LOCAL ] DOV: Derivative data saved (1794 records). [2025-09-29T22:07:53.895895] [INFO ] [MAIN ] DOV: Successfully saved derivative data. [2025-09-29T22:07:53.898264] [INFO ] [MAIN ] Derivative Progress: 525/2057 symbols completed. DOV took 1.3s. Estimated remaining: 10m 23s. Rate: 147.5 symbols/min [2025-09-29T22:07:53.898811] [INFO ] [MAIN ] DRH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:53.898906] [INFO ] [MAIN ] DRD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:53.899276] [INFO ] [MAIN ] DSL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:53.949446] [DEBUG] [LOCAL ] DSL: Loaded 28288 existing records from primary storage. [2025-09-29T22:07:53.949594] [INFO ] [MAIN ] DSL: Loaded 28288 primary data records. [2025-09-29T22:07:54.083538] [DEBUG] [LOCAL ] DRH: Loaded 50452 existing records from primary storage. [2025-09-29T22:07:54.094682] [INFO ] [MAIN ] DRH: Loaded 50452 primary data records. [2025-09-29T22:07:54.105812] [DEBUG] [LOCAL ] DRD: Loaded 36927 existing records from primary storage. [2025-09-29T22:07:54.111322] [INFO ] [MAIN ] DRD: Loaded 36927 primary data records. [2025-09-29T22:07:55.026623] [DEBUG] [MAIN ] DSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:55.028061] [INFO ] [MAIN ] DSL: Generated 1794 derivative records from 28288 primary records. [2025-09-29T22:07:55.028280] [DEBUG] [LOCAL ] DSL: Saving derivative data. [2025-09-29T22:07:55.048486] [DEBUG] [LOCAL ] DSL: Derivative data saved (1794 records). [2025-09-29T22:07:55.048766] [INFO ] [MAIN ] DSL: Successfully saved derivative data. [2025-09-29T22:07:55.050811] [INFO ] [MAIN ] Derivative Progress: 526/2057 symbols completed. DSL took 1.2s. Estimated remaining: 10m 25s. Rate: 147.0 symbols/min [2025-09-29T22:07:55.051239] [INFO ] [MAIN ] DSMC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:55.086903] [DEBUG] [LOCAL ] DSMC: Loaded 1912 existing records from primary storage. [2025-09-29T22:07:55.087669] [DEBUG] [MAIN ] DRH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:55.088328] [INFO ] [MAIN ] DSMC: Loaded 1912 primary data records. [2025-09-29T22:07:55.088237] [DEBUG] [MAIN ] DRD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:55.089197] [INFO ] [MAIN ] DRH: Generated 1794 derivative records from 50452 primary records. [2025-09-29T22:07:55.102107] [DEBUG] [LOCAL ] DRH: Saving derivative data. [2025-09-29T22:07:55.095320] [INFO ] [MAIN ] DRD: Generated 1794 derivative records from 36927 primary records. [2025-09-29T22:07:55.123602] [DEBUG] [LOCAL ] DRD: Saving derivative data. [2025-09-29T22:07:55.239609] [DEBUG] [LOCAL ] DRD: Derivative data saved (1794 records). [2025-09-29T22:07:55.246462] [INFO ] [MAIN ] DRD: Successfully saved derivative data. [2025-09-29T22:07:55.246357] [DEBUG] [LOCAL ] DRH: Derivative data saved (1794 records). [2025-09-29T22:07:55.256953] [INFO ] [MAIN ] DRH: Successfully saved derivative data. [2025-09-29T22:07:55.269718] [INFO ] [MAIN ] Derivative Progress: 527/2057 symbols completed. DRH took 1.4s. Estimated remaining: 10m 24s. Rate: 147.1 symbols/min [2025-09-29T22:07:55.292112] [INFO ] [MAIN ] DSU: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:55.292221] [INFO ] [MAIN ] Derivative Progress: 528/2057 symbols completed. DRD took 1.4s. Estimated remaining: 10m 23s. Rate: 147.4 symbols/min [2025-09-29T22:07:55.436211] [INFO ] [MAIN ] DT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:55.475072] [DEBUG] [LOCAL ] DSU: Loaded 22497 existing records from primary storage. [2025-09-29T22:07:55.477095] [INFO ] [MAIN ] DSU: Loaded 22497 primary data records. [2025-09-29T22:07:55.611462] [DEBUG] [MAIN ] DSMC: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:07:55.616268] [INFO ] [MAIN ] DSMC: Generated 1793 derivative records from 1912 primary records. [2025-09-29T22:07:55.617168] [DEBUG] [LOCAL ] DSMC: Saving derivative data. [2025-09-29T22:07:55.702267] [DEBUG] [LOCAL ] DT: Loaded 52927 existing records from primary storage. [2025-09-29T22:07:55.817519] [DEBUG] [LOCAL ] DSMC: Derivative data saved (1793 records). [2025-09-29T22:07:55.869104] [INFO ] [MAIN ] DSMC: Successfully saved derivative data. [2025-09-29T22:07:55.876595] [INFO ] [MAIN ] Derivative Progress: 529/2057 symbols completed. DSMC took 0.8s. Estimated remaining: 10m 23s. Rate: 147.3 symbols/min [2025-09-29T22:07:55.799828] [INFO ] [MAIN ] DT: Loaded 52927 primary data records. [2025-09-29T22:07:55.885425] [INFO ] [MAIN ] DTB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:55.993825] [DEBUG] [LOCAL ] DTB: Loaded 4788 existing records from primary storage. [2025-09-29T22:07:56.007515] [INFO ] [MAIN ] DTB: Loaded 4788 primary data records. [2025-09-29T22:07:56.557075] [DEBUG] [MAIN ] DSU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:56.558859] [INFO ] [MAIN ] DSU: Generated 1794 derivative records from 22497 primary records. [2025-09-29T22:07:56.559869] [DEBUG] [LOCAL ] DSU: Saving derivative data. [2025-09-29T22:07:56.579692] [DEBUG] [LOCAL ] DSU: Derivative data saved (1794 records). [2025-09-29T22:07:56.580072] [INFO ] [MAIN ] DSU: Successfully saved derivative data. [2025-09-29T22:07:56.584538] [INFO ] [MAIN ] Derivative Progress: 530/2057 symbols completed. DSU took 1.3s. Estimated remaining: 10m 23s. Rate: 147.0 symbols/min [2025-09-29T22:07:56.585348] [INFO ] [MAIN ] DTE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:56.601662] [DEBUG] [MAIN ] DT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:56.602984] [INFO ] [MAIN ] DT: Generated 1794 derivative records from 52927 primary records. [2025-09-29T22:07:56.603257] [DEBUG] [LOCAL ] DT: Saving derivative data. [2025-09-29T22:07:56.621293] [DEBUG] [LOCAL ] DT: Derivative data saved (1794 records). [2025-09-29T22:07:56.621608] [INFO ] [MAIN ] DT: Successfully saved derivative data. [2025-09-29T22:07:56.623918] [INFO ] [MAIN ] Derivative Progress: 531/2057 symbols completed. DT took 1.2s. Estimated remaining: 10m 22s. Rate: 147.3 symbols/min [2025-09-29T22:07:56.624243] [INFO ] [MAIN ] DTG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:56.643816] [DEBUG] [MAIN ] DTB: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:07:56.644769] [INFO ] [MAIN ] DTB: Generated 1793 derivative records from 4788 primary records. [2025-09-29T22:07:56.644922] [DEBUG] [LOCAL ] DTB: Saving derivative data. [2025-09-29T22:07:56.649563] [DEBUG] [LOCAL ] DTG: Loaded 5880 existing records from primary storage. [2025-09-29T22:07:56.668833] [INFO ] [MAIN ] DTG: Loaded 5880 primary data records. [2025-09-29T22:07:56.783538] [DEBUG] [LOCAL ] DTB: Derivative data saved (1793 records). [2025-09-29T22:07:56.788957] [INFO ] [MAIN ] DTB: Successfully saved derivative data. [2025-09-29T22:07:56.811304] [DEBUG] [LOCAL ] DTE: Loaded 47796 existing records from primary storage. [2025-09-29T22:07:56.809915] [INFO ] [MAIN ] Derivative Progress: 532/2057 symbols completed. DTB took 0.9s. Estimated remaining: 10m 21s. Rate: 147.4 symbols/min [2025-09-29T22:07:56.811563] [INFO ] [MAIN ] DTE: Loaded 47796 primary data records. [2025-09-29T22:07:56.811695] [INFO ] [MAIN ] DTM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:57.379204] [DEBUG] [LOCAL ] DTM: Loaded 44232 existing records from primary storage. [2025-09-29T22:07:57.379939] [INFO ] [MAIN ] DTM: Loaded 44232 primary data records. [2025-09-29T22:07:57.513396] [DEBUG] [MAIN ] DTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:57.539036] [INFO ] [MAIN ] DTG: Generated 1794 derivative records from 5880 primary records. [2025-09-29T22:07:57.613981] [DEBUG] [LOCAL ] DTG: Saving derivative data. [2025-09-29T22:07:57.614745] [DEBUG] [MAIN ] DTE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:57.616449] [INFO ] [MAIN ] DTE: Generated 1794 derivative records from 47796 primary records. [2025-09-29T22:07:57.743044] [DEBUG] [LOCAL ] DTE: Saving derivative data. [2025-09-29T22:07:57.797966] [DEBUG] [LOCAL ] DTG: Derivative data saved (1794 records). [2025-09-29T22:07:57.798263] [INFO ] [MAIN ] DTG: Successfully saved derivative data. [2025-09-29T22:07:57.807453] [INFO ] [MAIN ] Derivative Progress: 533/2057 symbols completed. DTG took 1.2s. Estimated remaining: 10m 22s. Rate: 147.0 symbols/min [2025-09-29T22:07:57.812102] [INFO ] [MAIN ] DTW: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:57.819750] [DEBUG] [LOCAL ] DTE: Derivative data saved (1794 records). [2025-09-29T22:07:57.820180] [INFO ] [MAIN ] DTE: Successfully saved derivative data. [2025-09-29T22:07:57.823006] [INFO ] [MAIN ] Derivative Progress: 534/2057 symbols completed. DTE took 1.2s. Estimated remaining: 10m 20s. Rate: 147.3 symbols/min [2025-09-29T22:07:57.823413] [INFO ] [MAIN ] DUK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:57.830291] [DEBUG] [LOCAL ] DTW: Loaded 4881 existing records from primary storage. [2025-09-29T22:07:57.830730] [INFO ] [MAIN ] DTW: Loaded 4881 primary data records. [2025-09-29T22:07:58.161094] [DEBUG] [MAIN ] DTM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:58.176399] [INFO ] [MAIN ] DTM: Generated 1794 derivative records from 44232 primary records. [2025-09-29T22:07:58.177376] [DEBUG] [LOCAL ] DTM: Saving derivative data. [2025-09-29T22:07:58.213389] [DEBUG] [LOCAL ] DTM: Derivative data saved (1794 records). [2025-09-29T22:07:58.213576] [INFO ] [MAIN ] DTM: Successfully saved derivative data. [2025-09-29T22:07:58.216000] [INFO ] [MAIN ] Derivative Progress: 535/2057 symbols completed. DTM took 1.4s. Estimated remaining: 10m 20s. Rate: 147.3 symbols/min [2025-09-29T22:07:58.217716] [INFO ] [MAIN ] DUKB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:58.217396] [DEBUG] [LOCAL ] DUK: Loaded 53458 existing records from primary storage. [2025-09-29T22:07:58.218752] [INFO ] [MAIN ] DUK: Loaded 53458 primary data records. [2025-09-29T22:07:58.337368] [DEBUG] [LOCAL ] DUKB: Loaded 6344 existing records from primary storage. [2025-09-29T22:07:58.338948] [INFO ] [MAIN ] DUKB: Loaded 6344 primary data records. [2025-09-29T22:07:58.452501] [DEBUG] [MAIN ] DTW: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:07:58.509796] [INFO ] [MAIN ] DTW: Generated 1793 derivative records from 4881 primary records. [2025-09-29T22:07:58.596251] [DEBUG] [LOCAL ] DTW: Saving derivative data. [2025-09-29T22:07:58.714216] [DEBUG] [LOCAL ] DTW: Derivative data saved (1793 records). [2025-09-29T22:07:58.736613] [INFO ] [MAIN ] DTW: Successfully saved derivative data. [2025-09-29T22:07:58.776369] [INFO ] [MAIN ] Derivative Progress: 536/2057 symbols completed. DTW took 1.0s. Estimated remaining: 10m 20s. Rate: 147.2 symbols/min [2025-09-29T22:07:58.783209] [INFO ] [MAIN ] DV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:58.939957] [DEBUG] [MAIN ] DUK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:58.941219] [INFO ] [MAIN ] DUK: Generated 1794 derivative records from 53458 primary records. [2025-09-29T22:07:58.941609] [DEBUG] [LOCAL ] DUK: Saving derivative data. [2025-09-29T22:07:58.991466] [DEBUG] [LOCAL ] DUK: Derivative data saved (1794 records). [2025-09-29T22:07:58.997020] [INFO ] [MAIN ] DUK: Successfully saved derivative data. [2025-09-29T22:07:58.997382] [DEBUG] [MAIN ] DUKB: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-09-29T22:07:58.999681] [INFO ] [MAIN ] Derivative Progress: 537/2057 symbols completed. DUK took 1.2s. Estimated remaining: 10m 19s. Rate: 147.3 symbols/min [2025-09-29T22:07:59.000940] [INFO ] [MAIN ] DVA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:59.000802] [INFO ] [MAIN ] DUKB: Generated 1792 derivative records from 6344 primary records. [2025-09-29T22:07:59.002309] [DEBUG] [LOCAL ] DUKB: Saving derivative data. [2025-09-29T22:07:59.030557] [DEBUG] [LOCAL ] DV: Loaded 51263 existing records from primary storage. [2025-09-29T22:07:59.033891] [DEBUG] [LOCAL ] DUKB: Derivative data saved (1792 records). [2025-09-29T22:07:59.034116] [INFO ] [MAIN ] DV: Loaded 51263 primary data records. [2025-09-29T22:07:59.034188] [INFO ] [MAIN ] DUKB: Successfully saved derivative data. [2025-09-29T22:07:59.036924] [INFO ] [MAIN ] Derivative Progress: 538/2057 symbols completed. DUKB took 0.8s. Estimated remaining: 10m 18s. Rate: 147.6 symbols/min [2025-09-29T22:07:59.379929] [DEBUG] [LOCAL ] DVA: Loaded 41068 existing records from primary storage. [2025-09-29T22:07:59.380164] [INFO ] [MAIN ] DVA: Loaded 41068 primary data records. [2025-09-29T22:07:59.717858] [DEBUG] [MAIN ] DV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:59.718918] [INFO ] [MAIN ] DV: Generated 1794 derivative records from 51263 primary records. [2025-09-29T22:07:59.719122] [DEBUG] [LOCAL ] DV: Saving derivative data. [2025-09-29T22:07:59.746067] [DEBUG] [LOCAL ] DV: Derivative data saved (1794 records). [2025-09-29T22:07:59.746327] [INFO ] [MAIN ] DV: Successfully saved derivative data. [2025-09-29T22:07:59.748582] [INFO ] [MAIN ] Derivative Progress: 539/2057 symbols completed. DV took 1.0s. Estimated remaining: 10m 18s. Rate: 147.4 symbols/min [2025-09-29T22:07:59.762392] [DEBUG] [MAIN ] DVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:07:59.763177] [INFO ] [MAIN ] DVA: Generated 1794 derivative records from 41068 primary records. [2025-09-29T22:07:59.763245] [DEBUG] [LOCAL ] DVA: Saving derivative data. [2025-09-29T22:07:59.779939] [DEBUG] [LOCAL ] DVA: Derivative data saved (1794 records). [2025-09-29T22:07:59.780013] [INFO ] [MAIN ] DVA: Successfully saved derivative data. [2025-09-29T22:07:59.782194] [INFO ] [MAIN ] Derivative Progress: 540/2057 symbols completed. DVA took 0.8s. Estimated remaining: 10m 17s. Rate: 147.6 symbols/min [2025-09-29T22:07:59.782952] [INFO ] [MAIN ] DX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:59.783070] [INFO ] [MAIN ] DXC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:59.783771] [INFO ] [MAIN ] DXYZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:07:59.850398] [DEBUG] [LOCAL ] DXYZ: Loaded 36627 existing records from primary storage. [2025-09-29T22:07:59.850573] [INFO ] [MAIN ] DXYZ: Loaded 36627 primary data records. [2025-09-29T22:07:59.988614] [DEBUG] [LOCAL ] DX: Loaded 52453 existing records from primary storage. [2025-09-29T22:08:00.005696] [DEBUG] [LOCAL ] DXC: Loaded 49756 existing records from primary storage. [2025-09-29T22:08:00.030218] [INFO ] [MAIN ] DX: Loaded 52453 primary data records. [2025-09-29T22:08:00.039473] [INFO ] [MAIN ] DXC: Loaded 49756 primary data records. [2025-09-29T22:08:00.915538] [DEBUG] [MAIN ] DXYZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:00.916507] [INFO ] [MAIN ] DXYZ: Generated 1794 derivative records from 36627 primary records. [2025-09-29T22:08:00.917499] [DEBUG] [LOCAL ] DXYZ: Saving derivative data. [2025-09-29T22:08:00.965783] [DEBUG] [LOCAL ] DXYZ: Derivative data saved (1794 records). [2025-09-29T22:08:00.971757] [DEBUG] [MAIN ] DX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:00.971208] [DEBUG] [MAIN ] DXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:00.972781] [INFO ] [MAIN ] DXYZ: Successfully saved derivative data. [2025-09-29T22:08:00.973450] [INFO ] [MAIN ] DX: Generated 1794 derivative records from 52453 primary records. [2025-09-29T22:08:00.972679] [INFO ] [MAIN ] DXC: Generated 1794 derivative records from 49756 primary records. [2025-09-29T22:08:00.973628] [DEBUG] [LOCAL ] DX: Saving derivative data. [2025-09-29T22:08:00.973765] [DEBUG] [LOCAL ] DXC: Saving derivative data. [2025-09-29T22:08:00.975634] [INFO ] [MAIN ] Derivative Progress: 541/2057 symbols completed. DXYZ took 1.2s. Estimated remaining: 10m 18s. Rate: 147.1 symbols/min [2025-09-29T22:08:00.977265] [INFO ] [MAIN ] DY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:01.008212] [DEBUG] [LOCAL ] DX: Derivative data saved (1794 records). [2025-09-29T22:08:01.010253] [INFO ] [MAIN ] DX: Successfully saved derivative data. [2025-09-29T22:08:01.010316] [DEBUG] [LOCAL ] DXC: Derivative data saved (1794 records). [2025-09-29T22:08:01.012619] [INFO ] [MAIN ] Derivative Progress: 542/2057 symbols completed. DX took 1.2s. Estimated remaining: 10m 17s. Rate: 147.4 symbols/min [2025-09-29T22:08:01.012833] [INFO ] [MAIN ] DXC: Successfully saved derivative data. [2025-09-29T22:08:01.012930] [INFO ] [MAIN ] E: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:01.015465] [INFO ] [MAIN ] Derivative Progress: 543/2057 symbols completed. DXC took 1.2s. Estimated remaining: 10m 15s. Rate: 147.6 symbols/min [2025-09-29T22:08:01.015706] [INFO ] [MAIN ] EAI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:01.034071] [DEBUG] [LOCAL ] EAI: Loaded 3960 existing records from primary storage. [2025-09-29T22:08:01.034314] [INFO ] [MAIN ] EAI: Loaded 3960 primary data records. [2025-09-29T22:08:01.115906] [DEBUG] [LOCAL ] DY: Loaded 29395 existing records from primary storage. [2025-09-29T22:08:01.129350] [INFO ] [MAIN ] DY: Loaded 29395 primary data records. [2025-09-29T22:08:01.386365] [DEBUG] [LOCAL ] E: Loaded 33269 existing records from primary storage. [2025-09-29T22:08:01.397670] [INFO ] [MAIN ] E: Loaded 33269 primary data records. [2025-09-29T22:08:02.164436] [DEBUG] [MAIN ] EAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:02.168833] [INFO ] [MAIN ] EAI: Generated 1794 derivative records from 3960 primary records. [2025-09-29T22:08:02.183231] [DEBUG] [LOCAL ] EAI: Saving derivative data. [2025-09-29T22:08:02.184204] [DEBUG] [MAIN ] DY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:02.186526] [INFO ] [MAIN ] DY: Generated 1794 derivative records from 29395 primary records. [2025-09-29T22:08:02.186911] [DEBUG] [LOCAL ] DY: Saving derivative data. [2025-09-29T22:08:02.219849] [DEBUG] [LOCAL ] EAI: Derivative data saved (1794 records). [2025-09-29T22:08:02.222605] [INFO ] [MAIN ] EAI: Successfully saved derivative data. [2025-09-29T22:08:02.226007] [INFO ] [MAIN ] Derivative Progress: 544/2057 symbols completed. EAI took 1.2s. Estimated remaining: 10m 17s. Rate: 147.1 symbols/min [2025-09-29T22:08:02.227882] [INFO ] [MAIN ] EAT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:02.230279] [DEBUG] [LOCAL ] DY: Derivative data saved (1794 records). [2025-09-29T22:08:02.230526] [INFO ] [MAIN ] DY: Successfully saved derivative data. [2025-09-29T22:08:02.233258] [INFO ] [MAIN ] Derivative Progress: 545/2057 symbols completed. DY took 1.3s. Estimated remaining: 10m 16s. Rate: 147.4 symbols/min [2025-09-29T22:08:02.233766] [INFO ] [MAIN ] EB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:02.247875] [DEBUG] [MAIN ] E: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:02.248597] [INFO ] [MAIN ] E: Generated 1794 derivative records from 33269 primary records. [2025-09-29T22:08:02.248849] [DEBUG] [LOCAL ] E: Saving derivative data. [2025-09-29T22:08:02.265322] [DEBUG] [LOCAL ] E: Derivative data saved (1794 records). [2025-09-29T22:08:02.265541] [INFO ] [MAIN ] E: Successfully saved derivative data. [2025-09-29T22:08:02.267836] [INFO ] [MAIN ] Derivative Progress: 546/2057 symbols completed. E took 1.3s. Estimated remaining: 10m 14s. Rate: 147.6 symbols/min [2025-09-29T22:08:02.268106] [INFO ] [MAIN ] EBF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:02.321811] [DEBUG] [LOCAL ] EB: Loaded 37261 existing records from primary storage. [2025-09-29T22:08:02.322269] [DEBUG] [LOCAL ] EBF: Loaded 19222 existing records from primary storage. [2025-09-29T22:08:02.322578] [INFO ] [MAIN ] EB: Loaded 37261 primary data records. [2025-09-29T22:08:02.322442] [INFO ] [MAIN ] EBF: Loaded 19222 primary data records. [2025-09-29T22:08:02.509524] [DEBUG] [LOCAL ] EAT: Loaded 49769 existing records from primary storage. [2025-09-29T22:08:02.533862] [INFO ] [MAIN ] EAT: Loaded 49769 primary data records. [2025-09-29T22:08:03.347926] [DEBUG] [MAIN ] EBF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:03.351569] [INFO ] [MAIN ] EBF: Generated 1794 derivative records from 19222 primary records. [2025-09-29T22:08:03.352149] [DEBUG] [LOCAL ] EBF: Saving derivative data. [2025-09-29T22:08:03.375306] [DEBUG] [MAIN ] EB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:03.379828] [INFO ] [MAIN ] EB: Generated 1794 derivative records from 37261 primary records. [2025-09-29T22:08:03.380549] [DEBUG] [LOCAL ] EB: Saving derivative data. [2025-09-29T22:08:03.384473] [DEBUG] [LOCAL ] EBF: Derivative data saved (1794 records). [2025-09-29T22:08:03.385558] [INFO ] [MAIN ] EBF: Successfully saved derivative data. [2025-09-29T22:08:03.389106] [INFO ] [MAIN ] Derivative Progress: 547/2057 symbols completed. EBF took 1.1s. Estimated remaining: 10m 16s. Rate: 147.1 symbols/min [2025-09-29T22:08:03.396718] [INFO ] [MAIN ] EBR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:03.416155] [DEBUG] [MAIN ] EAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:03.417818] [INFO ] [MAIN ] EAT: Generated 1794 derivative records from 49769 primary records. [2025-09-29T22:08:03.418256] [DEBUG] [LOCAL ] EAT: Saving derivative data. [2025-09-29T22:08:03.438682] [DEBUG] [LOCAL ] EAT: Derivative data saved (1794 records). [2025-09-29T22:08:03.439202] [INFO ] [MAIN ] EAT: Successfully saved derivative data. [2025-09-29T22:08:03.441880] [INFO ] [MAIN ] Derivative Progress: 548/2057 symbols completed. EAT took 1.2s. Estimated remaining: 10m 14s. Rate: 147.4 symbols/min [2025-09-29T22:08:03.442146] [INFO ] [MAIN ] EBS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:03.442358] [DEBUG] [LOCAL ] EB: Derivative data saved (1794 records). [2025-09-29T22:08:03.442934] [INFO ] [MAIN ] EB: Successfully saved derivative data. [2025-09-29T22:08:03.445241] [INFO ] [MAIN ] Derivative Progress: 549/2057 symbols completed. EB took 1.2s. Estimated remaining: 10m 13s. Rate: 147.6 symbols/min [2025-09-29T22:08:03.445705] [INFO ] [MAIN ] EC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:03.484307] [DEBUG] [LOCAL ] EBR: Loaded 43035 existing records from primary storage. [2025-09-29T22:08:03.484722] [INFO ] [MAIN ] EBR: Loaded 43035 primary data records. [2025-09-29T22:08:03.659841] [DEBUG] [LOCAL ] EC: Loaded 49282 existing records from primary storage. [2025-09-29T22:08:03.704686] [INFO ] [MAIN ] EC: Loaded 49282 primary data records. [2025-09-29T22:08:03.738260] [DEBUG] [LOCAL ] EBS: Loaded 46678 existing records from primary storage. [2025-09-29T22:08:03.876923] [INFO ] [MAIN ] EBS: Loaded 46678 primary data records. [2025-09-29T22:08:04.581099] [DEBUG] [MAIN ] EBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:04.582630] [INFO ] [MAIN ] EBR: Generated 1794 derivative records from 43035 primary records. [2025-09-29T22:08:04.583445] [DEBUG] [LOCAL ] EBR: Saving derivative data. [2025-09-29T22:08:04.606169] [DEBUG] [LOCAL ] EBR: Derivative data saved (1794 records). [2025-09-29T22:08:04.606299] [INFO ] [MAIN ] EBR: Successfully saved derivative data. [2025-09-29T22:08:04.608696] [INFO ] [MAIN ] Derivative Progress: 550/2057 symbols completed. EBR took 1.2s. Estimated remaining: 10m 15s. Rate: 147.1 symbols/min [2025-09-29T22:08:04.608945] [INFO ] [MAIN ] ECG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:04.643741] [DEBUG] [MAIN ] EBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:04.644548] [INFO ] [MAIN ] EBS: Generated 1794 derivative records from 46678 primary records. [2025-09-29T22:08:04.644616] [DEBUG] [LOCAL ] EBS: Saving derivative data. [2025-09-29T22:08:04.630055] [DEBUG] [MAIN ] EC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:04.653341] [INFO ] [MAIN ] EC: Generated 1794 derivative records from 49282 primary records. [2025-09-29T22:08:04.653450] [DEBUG] [LOCAL ] EC: Saving derivative data. [2025-09-29T22:08:04.685352] [DEBUG] [LOCAL ] EC: Derivative data saved (1794 records). [2025-09-29T22:08:04.685601] [INFO ] [MAIN ] EC: Successfully saved derivative data. [2025-09-29T22:08:04.688311] [INFO ] [MAIN ] Derivative Progress: 551/2057 symbols completed. EC took 1.2s. Estimated remaining: 10m 13s. Rate: 147.4 symbols/min [2025-09-29T22:08:04.689622] [INFO ] [MAIN ] ECL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:04.701759] [DEBUG] [LOCAL ] ECG: Loaded 33936 existing records from primary storage. [2025-09-29T22:08:04.702789] [INFO ] [MAIN ] ECG: Loaded 33936 primary data records. [2025-09-29T22:08:04.709423] [DEBUG] [LOCAL ] EBS: Derivative data saved (1794 records). [2025-09-29T22:08:04.739080] [INFO ] [MAIN ] EBS: Successfully saved derivative data. [2025-09-29T22:08:04.754777] [INFO ] [MAIN ] Derivative Progress: 552/2057 symbols completed. EBS took 1.3s. Estimated remaining: 10m 12s. Rate: 147.6 symbols/min [2025-09-29T22:08:04.765662] [INFO ] [MAIN ] ECO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:05.140532] [DEBUG] [LOCAL ] ECO: Loaded 18367 existing records from primary storage. [2025-09-29T22:08:05.161718] [INFO ] [MAIN ] ECO: Loaded 18367 primary data records. [2025-09-29T22:08:05.184334] [DEBUG] [LOCAL ] ECL: Loaded 46782 existing records from primary storage. [2025-09-29T22:08:05.185167] [INFO ] [MAIN ] ECL: Loaded 46782 primary data records. [2025-09-29T22:08:05.860863] [DEBUG] [MAIN ] ECG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:05.906156] [INFO ] [MAIN ] ECG: Generated 1794 derivative records from 33936 primary records. [2025-09-29T22:08:06.039735] [DEBUG] [LOCAL ] ECG: Saving derivative data. [2025-09-29T22:08:06.064316] [DEBUG] [LOCAL ] ECG: Derivative data saved (1794 records). [2025-09-29T22:08:06.064521] [INFO ] [MAIN ] ECG: Successfully saved derivative data. [2025-09-29T22:08:06.067235] [INFO ] [MAIN ] Derivative Progress: 553/2057 symbols completed. ECG took 1.5s. Estimated remaining: 10m 14s. Rate: 147.0 symbols/min [2025-09-29T22:08:06.106096] [DEBUG] [MAIN ] ECO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:06.107428] [INFO ] [MAIN ] ECO: Generated 1794 derivative records from 18367 primary records. [2025-09-29T22:08:06.106442] [DEBUG] [MAIN ] ECL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:06.107606] [DEBUG] [LOCAL ] ECO: Saving derivative data. [2025-09-29T22:08:06.108474] [INFO ] [MAIN ] ECL: Generated 1794 derivative records from 46782 primary records. [2025-09-29T22:08:06.109086] [DEBUG] [LOCAL ] ECL: Saving derivative data. [2025-09-29T22:08:06.139447] [DEBUG] [LOCAL ] ECO: Derivative data saved (1794 records). [2025-09-29T22:08:06.142700] [INFO ] [MAIN ] ECO: Successfully saved derivative data. [2025-09-29T22:08:06.142799] [DEBUG] [LOCAL ] ECL: Derivative data saved (1794 records). [2025-09-29T22:08:06.144865] [INFO ] [MAIN ] Derivative Progress: 554/2057 symbols completed. ECO took 1.4s. Estimated remaining: 10m 13s. Rate: 147.2 symbols/min [2025-09-29T22:08:06.145072] [INFO ] [MAIN ] ECL: Successfully saved derivative data. [2025-09-29T22:08:06.148158] [INFO ] [MAIN ] Derivative Progress: 555/2057 symbols completed. ECL took 1.5s. Estimated remaining: 10m 11s. Rate: 147.5 symbols/min [2025-09-29T22:08:06.148773] [INFO ] [MAIN ] ECVT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:06.149135] [INFO ] [MAIN ] EDD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:06.149422] [INFO ] [MAIN ] ED: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:06.186434] [DEBUG] [LOCAL ] EDD: Loaded 27095 existing records from primary storage. [2025-09-29T22:08:06.186766] [INFO ] [MAIN ] EDD: Loaded 27095 primary data records. [2025-09-29T22:08:06.330298] [DEBUG] [LOCAL ] ECVT: Loaded 42947 existing records from primary storage. [2025-09-29T22:08:06.341154] [INFO ] [MAIN ] ECVT: Loaded 42947 primary data records. [2025-09-29T22:08:06.476341] [DEBUG] [LOCAL ] ED: Loaded 52759 existing records from primary storage. [2025-09-29T22:08:06.646411] [INFO ] [MAIN ] ED: Loaded 52759 primary data records. [2025-09-29T22:08:07.298159] [DEBUG] [MAIN ] EDD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:07.299085] [INFO ] [MAIN ] EDD: Generated 1794 derivative records from 27095 primary records. [2025-09-29T22:08:07.299324] [DEBUG] [LOCAL ] EDD: Saving derivative data. [2025-09-29T22:08:07.322523] [DEBUG] [LOCAL ] EDD: Derivative data saved (1794 records). [2025-09-29T22:08:07.323371] [INFO ] [MAIN ] EDD: Successfully saved derivative data. [2025-09-29T22:08:07.337102] [DEBUG] [MAIN ] ECVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:07.339166] [INFO ] [MAIN ] Derivative Progress: 556/2057 symbols completed. EDD took 1.2s. Estimated remaining: 10m 13s. Rate: 147.0 symbols/min [2025-09-29T22:08:07.340353] [INFO ] [MAIN ] EDF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:07.340067] [INFO ] [MAIN ] ECVT: Generated 1794 derivative records from 42947 primary records. [2025-09-29T22:08:07.340794] [DEBUG] [LOCAL ] ECVT: Saving derivative data. [2025-09-29T22:08:07.360818] [DEBUG] [LOCAL ] ECVT: Derivative data saved (1794 records). [2025-09-29T22:08:07.360978] [INFO ] [MAIN ] ECVT: Successfully saved derivative data. [2025-09-29T22:08:07.363344] [INFO ] [MAIN ] Derivative Progress: 557/2057 symbols completed. ECVT took 1.2s. Estimated remaining: 10m 11s. Rate: 147.2 symbols/min [2025-09-29T22:08:07.363714] [INFO ] [MAIN ] EDN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:07.377723] [DEBUG] [MAIN ] ED: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:07.382668] [INFO ] [MAIN ] ED: Generated 1794 derivative records from 52759 primary records. [2025-09-29T22:08:07.382811] [DEBUG] [LOCAL ] ED: Saving derivative data. [2025-09-29T22:08:07.410360] [DEBUG] [LOCAL ] ED: Derivative data saved (1794 records). [2025-09-29T22:08:07.410477] [INFO ] [MAIN ] ED: Successfully saved derivative data. [2025-09-29T22:08:07.410187] [DEBUG] [LOCAL ] EDF: Loaded 13397 existing records from primary storage. [2025-09-29T22:08:07.412940] [INFO ] [MAIN ] Derivative Progress: 558/2057 symbols completed. ED took 1.3s. Estimated remaining: 10m 10s. Rate: 147.4 symbols/min [2025-09-29T22:08:07.413166] [INFO ] [MAIN ] EDF: Loaded 13397 primary data records. [2025-09-29T22:08:07.413306] [INFO ] [MAIN ] EDU: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:07.458508] [DEBUG] [LOCAL ] EDN: Loaded 18073 existing records from primary storage. [2025-09-29T22:08:07.481042] [INFO ] [MAIN ] EDN: Loaded 18073 primary data records. [2025-09-29T22:08:08.119586] [DEBUG] [LOCAL ] EDU: Loaded 44931 existing records from primary storage. [2025-09-29T22:08:08.120383] [INFO ] [MAIN ] EDU: Loaded 44931 primary data records. [2025-09-29T22:08:08.465531] [DEBUG] [MAIN ] EDF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:08.468538] [INFO ] [MAIN ] EDF: Generated 1794 derivative records from 13397 primary records. [2025-09-29T22:08:08.469925] [DEBUG] [LOCAL ] EDF: Saving derivative data. [2025-09-29T22:08:08.498192] [DEBUG] [MAIN ] EDN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:08.501688] [INFO ] [MAIN ] EDN: Generated 1794 derivative records from 18073 primary records. [2025-09-29T22:08:08.504322] [DEBUG] [LOCAL ] EDF: Derivative data saved (1794 records). [2025-09-29T22:08:08.504497] [DEBUG] [LOCAL ] EDN: Saving derivative data. [2025-09-29T22:08:08.504615] [INFO ] [MAIN ] EDF: Successfully saved derivative data. [2025-09-29T22:08:08.507951] [INFO ] [MAIN ] Derivative Progress: 559/2057 symbols completed. EDF took 1.2s. Estimated remaining: 10m 11s. Rate: 147.0 symbols/min [2025-09-29T22:08:08.509911] [INFO ] [MAIN ] EE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:08.531056] [DEBUG] [LOCAL ] EDN: Derivative data saved (1794 records). [2025-09-29T22:08:08.531709] [INFO ] [MAIN ] EDN: Successfully saved derivative data. [2025-09-29T22:08:08.534231] [INFO ] [MAIN ] Derivative Progress: 560/2057 symbols completed. EDN took 1.2s. Estimated remaining: 10m 10s. Rate: 147.2 symbols/min [2025-09-29T22:08:08.534809] [INFO ] [MAIN ] EEX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:08.560256] [DEBUG] [MAIN ] EDU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:08.566616] [INFO ] [MAIN ] EDU: Generated 1794 derivative records from 44931 primary records. [2025-09-29T22:08:08.565478] [DEBUG] [LOCAL ] EEX: Loaded 11665 existing records from primary storage. [2025-09-29T22:08:08.566774] [DEBUG] [LOCAL ] EDU: Saving derivative data. [2025-09-29T22:08:08.567968] [INFO ] [MAIN ] EEX: Loaded 11665 primary data records. [2025-09-29T22:08:08.693525] [DEBUG] [LOCAL ] EDU: Derivative data saved (1794 records). [2025-09-29T22:08:08.705737] [INFO ] [MAIN ] EDU: Successfully saved derivative data. [2025-09-29T22:08:08.708271] [INFO ] [MAIN ] Derivative Progress: 561/2057 symbols completed. EDU took 1.3s. Estimated remaining: 10m 9s. Rate: 147.4 symbols/min [2025-09-29T22:08:08.716590] [INFO ] [MAIN ] EFC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:08.722327] [DEBUG] [LOCAL ] EE: Loaded 32516 existing records from primary storage. [2025-09-29T22:08:08.722531] [INFO ] [MAIN ] EE: Loaded 32516 primary data records. [2025-09-29T22:08:09.336298] [DEBUG] [LOCAL ] EFC: Loaded 46199 existing records from primary storage. [2025-09-29T22:08:09.338556] [INFO ] [MAIN ] EFC: Loaded 46199 primary data records. [2025-09-29T22:08:09.702604] [DEBUG] [MAIN ] EEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:09.705484] [INFO ] [MAIN ] EEX: Generated 1794 derivative records from 11665 primary records. [2025-09-29T22:08:09.707585] [DEBUG] [LOCAL ] EEX: Saving derivative data. [2025-09-29T22:08:09.740023] [DEBUG] [MAIN ] EE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:09.741068] [DEBUG] [LOCAL ] EEX: Derivative data saved (1794 records). [2025-09-29T22:08:09.742479] [INFO ] [MAIN ] EE: Generated 1794 derivative records from 32516 primary records. [2025-09-29T22:08:09.741668] [INFO ] [MAIN ] EEX: Successfully saved derivative data. [2025-09-29T22:08:09.742755] [DEBUG] [LOCAL ] EE: Saving derivative data. [2025-09-29T22:08:09.745154] [INFO ] [MAIN ] Derivative Progress: 562/2057 symbols completed. EEX took 1.2s. Estimated remaining: 10m 10s. Rate: 147.0 symbols/min [2025-09-29T22:08:09.747803] [INFO ] [MAIN ] EFT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:09.764859] [DEBUG] [LOCAL ] EE: Derivative data saved (1794 records). [2025-09-29T22:08:09.765164] [INFO ] [MAIN ] EE: Successfully saved derivative data. [2025-09-29T22:08:09.767530] [INFO ] [MAIN ] Derivative Progress: 563/2057 symbols completed. EE took 1.3s. Estimated remaining: 10m 9s. Rate: 147.2 symbols/min [2025-09-29T22:08:09.767712] [INFO ] [MAIN ] EFX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:09.793162] [DEBUG] [MAIN ] EFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:09.799025] [DEBUG] [LOCAL ] EFT: Loaded 12787 existing records from primary storage. [2025-09-29T22:08:09.798720] [INFO ] [MAIN ] EFC: Generated 1794 derivative records from 46199 primary records. [2025-09-29T22:08:09.799190] [INFO ] [MAIN ] EFT: Loaded 12787 primary data records. [2025-09-29T22:08:09.799450] [DEBUG] [LOCAL ] EFC: Saving derivative data. [2025-09-29T22:08:09.942947] [DEBUG] [LOCAL ] EFC: Derivative data saved (1794 records). [2025-09-29T22:08:09.953624] [INFO ] [MAIN ] EFC: Successfully saved derivative data. [2025-09-29T22:08:10.019833] [INFO ] [MAIN ] Derivative Progress: 564/2057 symbols completed. EFC took 1.3s. Estimated remaining: 10m 8s. Rate: 147.3 symbols/min [2025-09-29T22:08:10.048863] [DEBUG] [LOCAL ] EFX: Loaded 44588 existing records from primary storage. [2025-09-29T22:08:10.160256] [INFO ] [MAIN ] EFXT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:10.165947] [INFO ] [MAIN ] EFX: Loaded 44588 primary data records. [2025-09-29T22:08:10.525563] [DEBUG] [LOCAL ] EFXT: Loaded 29190 existing records from primary storage. [2025-09-29T22:08:10.537634] [INFO ] [MAIN ] EFXT: Loaded 29190 primary data records. [2025-09-29T22:08:10.627111] [DEBUG] [MAIN ] EFT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:10.659923] [INFO ] [MAIN ] EFT: Generated 1794 derivative records from 12787 primary records. [2025-09-29T22:08:10.683237] [DEBUG] [LOCAL ] EFT: Saving derivative data. [2025-09-29T22:08:10.999408] [DEBUG] [LOCAL ] EFT: Derivative data saved (1794 records). [2025-09-29T22:08:11.000261] [INFO ] [MAIN ] EFT: Successfully saved derivative data. [2025-09-29T22:08:11.003432] [INFO ] [MAIN ] Derivative Progress: 565/2057 symbols completed. EFT took 1.3s. Estimated remaining: 10m 9s. Rate: 147.0 symbols/min [2025-09-29T22:08:11.004933] [INFO ] [MAIN ] EG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:11.026190] [DEBUG] [MAIN ] EFX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:11.027835] [INFO ] [MAIN ] EFX: Generated 1794 derivative records from 44588 primary records. [2025-09-29T22:08:11.028066] [DEBUG] [LOCAL ] EFX: Saving derivative data. [2025-09-29T22:08:11.056767] [DEBUG] [LOCAL ] EFX: Derivative data saved (1794 records). [2025-09-29T22:08:11.057002] [INFO ] [MAIN ] EFX: Successfully saved derivative data. [2025-09-29T22:08:11.059196] [INFO ] [MAIN ] Derivative Progress: 566/2057 symbols completed. EFX took 1.3s. Estimated remaining: 10m 8s. Rate: 147.2 symbols/min [2025-09-29T22:08:11.059519] [INFO ] [MAIN ] EGO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:11.072826] [DEBUG] [LOCAL ] EG: Loaded 28398 existing records from primary storage. [2025-09-29T22:08:11.073053] [INFO ] [MAIN ] EG: Loaded 28398 primary data records. [2025-09-29T22:08:11.130597] [DEBUG] [MAIN ] EFXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:11.164948] [INFO ] [MAIN ] EFXT: Generated 1794 derivative records from 29190 primary records. [2025-09-29T22:08:11.181768] [DEBUG] [LOCAL ] EFXT: Saving derivative data. [2025-09-29T22:08:11.430628] [DEBUG] [LOCAL ] EFXT: Derivative data saved (1794 records). [2025-09-29T22:08:11.431104] [INFO ] [MAIN ] EFXT: Successfully saved derivative data. [2025-09-29T22:08:11.433210] [INFO ] [MAIN ] Derivative Progress: 567/2057 symbols completed. EFXT took 1.3s. Estimated remaining: 10m 7s. Rate: 147.2 symbols/min [2025-09-29T22:08:11.433437] [INFO ] [MAIN ] EGP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:11.456105] [DEBUG] [LOCAL ] EGO: Loaded 51568 existing records from primary storage. [2025-09-29T22:08:11.456674] [INFO ] [MAIN ] EGO: Loaded 51568 primary data records. [2025-09-29T22:08:11.766042] [DEBUG] [LOCAL ] EGP: Loaded 30961 existing records from primary storage. [2025-09-29T22:08:11.786779] [INFO ] [MAIN ] EGP: Loaded 30961 primary data records. [2025-09-29T22:08:11.931952] [DEBUG] [MAIN ] EG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:11.938174] [INFO ] [MAIN ] EG: Generated 1794 derivative records from 28398 primary records. [2025-09-29T22:08:11.954021] [DEBUG] [LOCAL ] EG: Saving derivative data. [2025-09-29T22:08:12.159602] [DEBUG] [LOCAL ] EG: Derivative data saved (1794 records). [2025-09-29T22:08:12.161154] [INFO ] [MAIN ] EG: Successfully saved derivative data. [2025-09-29T22:08:12.163292] [INFO ] [MAIN ] Derivative Progress: 568/2057 symbols completed. EG took 1.2s. Estimated remaining: 10m 8s. Rate: 147.0 symbols/min [2025-09-29T22:08:12.191624] [DEBUG] [MAIN ] EGO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:12.192963] [INFO ] [MAIN ] EGO: Generated 1794 derivative records from 51568 primary records. [2025-09-29T22:08:12.193191] [DEBUG] [LOCAL ] EGO: Saving derivative data. [2025-09-29T22:08:12.215827] [DEBUG] [LOCAL ] EGO: Derivative data saved (1794 records). [2025-09-29T22:08:12.217037] [INFO ] [MAIN ] EGO: Successfully saved derivative data. [2025-09-29T22:08:12.220039] [INFO ] [MAIN ] Derivative Progress: 569/2057 symbols completed. EGO took 1.2s. Estimated remaining: 10m 6s. Rate: 147.2 symbols/min [2025-09-29T22:08:12.234915] [DEBUG] [MAIN ] EGP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:12.235631] [INFO ] [MAIN ] EGP: Generated 1794 derivative records from 30961 primary records. [2025-09-29T22:08:12.235722] [DEBUG] [LOCAL ] EGP: Saving derivative data. [2025-09-29T22:08:12.251617] [DEBUG] [LOCAL ] EGP: Derivative data saved (1794 records). [2025-09-29T22:08:12.251713] [INFO ] [MAIN ] EGP: Successfully saved derivative data. [2025-09-29T22:08:12.254117] [INFO ] [MAIN ] Derivative Progress: 570/2057 symbols completed. EGP took 0.8s. Estimated remaining: 10m 5s. Rate: 147.5 symbols/min [2025-09-29T22:08:12.254956] [INFO ] [MAIN ] EHC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:12.254846] [INFO ] [MAIN ] EGY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:12.255018] [INFO ] [MAIN ] EHI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:12.269639] [DEBUG] [LOCAL ] EHI: Loaded 10420 existing records from primary storage. [2025-09-29T22:08:12.269958] [INFO ] [MAIN ] EHI: Loaded 10420 primary data records. [2025-09-29T22:08:12.518316] [DEBUG] [LOCAL ] EGY: Loaded 42167 existing records from primary storage. [2025-09-29T22:08:12.518452] [DEBUG] [LOCAL ] EHC: Loaded 41153 existing records from primary storage. [2025-09-29T22:08:12.641095] [INFO ] [MAIN ] EHC: Loaded 41153 primary data records. [2025-09-29T22:08:12.641889] [INFO ] [MAIN ] EGY: Loaded 42167 primary data records. [2025-09-29T22:08:13.376485] [DEBUG] [MAIN ] EHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:13.378253] [INFO ] [MAIN ] EHI: Generated 1794 derivative records from 10420 primary records. [2025-09-29T22:08:13.378516] [DEBUG] [LOCAL ] EHI: Saving derivative data. [2025-09-29T22:08:13.399359] [DEBUG] [LOCAL ] EHI: Derivative data saved (1794 records). [2025-09-29T22:08:13.399797] [INFO ] [MAIN ] EHI: Successfully saved derivative data. [2025-09-29T22:08:13.403989] [INFO ] [MAIN ] Derivative Progress: 571/2057 symbols completed. EHI took 1.1s. Estimated remaining: 10m 7s. Rate: 147.0 symbols/min [2025-09-29T22:08:13.404608] [INFO ] [MAIN ] EIC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:13.422043] [DEBUG] [MAIN ] EHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:13.423231] [INFO ] [MAIN ] EHC: Generated 1794 derivative records from 41153 primary records. [2025-09-29T22:08:13.424510] [DEBUG] [LOCAL ] EHC: Saving derivative data. [2025-09-29T22:08:13.456365] [DEBUG] [MAIN ] EGY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:13.457844] [INFO ] [MAIN ] EGY: Generated 1794 derivative records from 42167 primary records. [2025-09-29T22:08:13.465939] [DEBUG] [LOCAL ] EGY: Saving derivative data. [2025-09-29T22:08:13.469129] [DEBUG] [LOCAL ] EHC: Derivative data saved (1794 records). [2025-09-29T22:08:13.470022] [INFO ] [MAIN ] EHC: Successfully saved derivative data. [2025-09-29T22:08:13.493252] [DEBUG] [LOCAL ] EIC: Loaded 23686 existing records from primary storage. [2025-09-29T22:08:13.492112] [INFO ] [MAIN ] Derivative Progress: 572/2057 symbols completed. EHC took 1.2s. Estimated remaining: 10m 5s. Rate: 147.2 symbols/min [2025-09-29T22:08:13.493893] [INFO ] [MAIN ] EIC: Loaded 23686 primary data records. [2025-09-29T22:08:13.494477] [INFO ] [MAIN ] EIG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:13.499304] [DEBUG] [LOCAL ] EGY: Derivative data saved (1794 records). [2025-09-29T22:08:13.532307] [INFO ] [MAIN ] EGY: Successfully saved derivative data. [2025-09-29T22:08:13.540267] [INFO ] [MAIN ] Derivative Progress: 573/2057 symbols completed. EGY took 1.3s. Estimated remaining: 10m 4s. Rate: 147.4 symbols/min [2025-09-29T22:08:13.577527] [INFO ] [MAIN ] EL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:13.633300] [DEBUG] [LOCAL ] EIG: Loaded 20285 existing records from primary storage. [2025-09-29T22:08:13.634065] [INFO ] [MAIN ] EIG: Loaded 20285 primary data records. [2025-09-29T22:08:14.230240] [DEBUG] [LOCAL ] EL: Loaded 53397 existing records from primary storage. [2025-09-29T22:08:14.231710] [INFO ] [MAIN ] EL: Loaded 53397 primary data records. [2025-09-29T22:08:14.588088] [DEBUG] [MAIN ] EIC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:14.589154] [INFO ] [MAIN ] EIC: Generated 1794 derivative records from 23686 primary records. [2025-09-29T22:08:14.589363] [DEBUG] [LOCAL ] EIC: Saving derivative data. [2025-09-29T22:08:14.613291] [DEBUG] [LOCAL ] EIC: Derivative data saved (1794 records). [2025-09-29T22:08:14.626664] [INFO ] [MAIN ] EIC: Successfully saved derivative data. [2025-09-29T22:08:14.629155] [INFO ] [MAIN ] Derivative Progress: 574/2057 symbols completed. EIC took 1.2s. Estimated remaining: 10m 5s. Rate: 147.0 symbols/min [2025-09-29T22:08:14.629398] [INFO ] [MAIN ] ELAN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:14.627024] [DEBUG] [MAIN ] EIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:14.630517] [INFO ] [MAIN ] EIG: Generated 1794 derivative records from 20285 primary records. [2025-09-29T22:08:14.631158] [DEBUG] [LOCAL ] EIG: Saving derivative data. [2025-09-29T22:08:14.649921] [DEBUG] [LOCAL ] EIG: Derivative data saved (1794 records). [2025-09-29T22:08:14.650091] [INFO ] [MAIN ] EIG: Successfully saved derivative data. [2025-09-29T22:08:14.652470] [INFO ] [MAIN ] Derivative Progress: 575/2057 symbols completed. EIG took 1.2s. Estimated remaining: 10m 4s. Rate: 147.2 symbols/min [2025-09-29T22:08:14.652973] [INFO ] [MAIN ] ELC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:14.672544] [DEBUG] [MAIN ] EL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:14.675588] [DEBUG] [LOCAL ] ELC: Loaded 3481 existing records from primary storage. [2025-09-29T22:08:14.676616] [INFO ] [MAIN ] ELC: Loaded 3481 primary data records. [2025-09-29T22:08:14.676523] [INFO ] [MAIN ] EL: Generated 1794 derivative records from 53397 primary records. [2025-09-29T22:08:14.682143] [DEBUG] [LOCAL ] EL: Saving derivative data. [2025-09-29T22:08:14.808362] [DEBUG] [LOCAL ] EL: Derivative data saved (1794 records). [2025-09-29T22:08:14.827146] [INFO ] [MAIN ] EL: Successfully saved derivative data. [2025-09-29T22:08:14.829272] [INFO ] [MAIN ] Derivative Progress: 576/2057 symbols completed. EL took 1.3s. Estimated remaining: 10m 3s. Rate: 147.4 symbols/min [2025-09-29T22:08:14.829565] [INFO ] [MAIN ] ELF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:15.061138] [DEBUG] [LOCAL ] ELAN: Loaded 53226 existing records from primary storage. [2025-09-29T22:08:15.061691] [INFO ] [MAIN ] ELAN: Loaded 53226 primary data records. [2025-09-29T22:08:15.477955] [DEBUG] [LOCAL ] ELF: Loaded 52235 existing records from primary storage. [2025-09-29T22:08:15.487696] [INFO ] [MAIN ] ELF: Loaded 52235 primary data records. [2025-09-29T22:08:15.670726] [DEBUG] [MAIN ] ELC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:15.698601] [INFO ] [MAIN ] ELC: Generated 1794 derivative records from 3481 primary records. [2025-09-29T22:08:15.702721] [DEBUG] [LOCAL ] ELC: Saving derivative data. [2025-09-29T22:08:15.843926] [DEBUG] [LOCAL ] ELC: Derivative data saved (1794 records). [2025-09-29T22:08:15.844570] [INFO ] [MAIN ] ELC: Successfully saved derivative data. [2025-09-29T22:08:15.846712] [INFO ] [MAIN ] Derivative Progress: 577/2057 symbols completed. ELC took 1.2s. Estimated remaining: 10m 4s. Rate: 147.0 symbols/min [2025-09-29T22:08:15.846921] [INFO ] [MAIN ] ELME: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:15.868359] [DEBUG] [MAIN ] ELAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:15.869476] [INFO ] [MAIN ] ELAN: Generated 1794 derivative records from 53226 primary records. [2025-09-29T22:08:15.869886] [DEBUG] [LOCAL ] ELAN: Saving derivative data. [2025-09-29T22:08:15.889325] [DEBUG] [LOCAL ] ELAN: Derivative data saved (1794 records). [2025-09-29T22:08:15.901535] [INFO ] [MAIN ] ELAN: Successfully saved derivative data. [2025-09-29T22:08:15.904219] [INFO ] [MAIN ] Derivative Progress: 578/2057 symbols completed. ELAN took 1.3s. Estimated remaining: 10m 3s. Rate: 147.2 symbols/min [2025-09-29T22:08:15.904719] [INFO ] [MAIN ] ELP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:15.920207] [DEBUG] [MAIN ] ELF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:15.921080] [INFO ] [MAIN ] ELF: Generated 1794 derivative records from 52235 primary records. [2025-09-29T22:08:15.921216] [DEBUG] [LOCAL ] ELF: Saving derivative data. [2025-09-29T22:08:15.951204] [DEBUG] [LOCAL ] ELME: Loaded 39202 existing records from primary storage. [2025-09-29T22:08:15.961090] [INFO ] [MAIN ] ELME: Loaded 39202 primary data records. [2025-09-29T22:08:15.962720] [DEBUG] [LOCAL ] ELF: Derivative data saved (1794 records). [2025-09-29T22:08:15.975781] [INFO ] [MAIN ] ELF: Successfully saved derivative data. [2025-09-29T22:08:16.007861] [INFO ] [MAIN ] Derivative Progress: 579/2057 symbols completed. ELF took 1.2s. Estimated remaining: 10m 2s. Rate: 147.4 symbols/min [2025-09-29T22:08:16.036131] [INFO ] [MAIN ] ELS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:16.036004] [DEBUG] [LOCAL ] ELP: Loaded 25746 existing records from primary storage. [2025-09-29T22:08:16.054720] [INFO ] [MAIN ] ELP: Loaded 25746 primary data records. [2025-09-29T22:08:16.654971] [DEBUG] [LOCAL ] ELS: Loaded 49379 existing records from primary storage. [2025-09-29T22:08:16.656122] [INFO ] [MAIN ] ELS: Loaded 49379 primary data records. [2025-09-29T22:08:17.037378] [DEBUG] [MAIN ] ELME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:17.039092] [INFO ] [MAIN ] ELME: Generated 1794 derivative records from 39202 primary records. [2025-09-29T22:08:17.039837] [DEBUG] [MAIN ] ELP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:17.040705] [DEBUG] [LOCAL ] ELME: Saving derivative data. [2025-09-29T22:08:17.042096] [INFO ] [MAIN ] ELP: Generated 1794 derivative records from 25746 primary records. [2025-09-29T22:08:17.042636] [DEBUG] [LOCAL ] ELP: Saving derivative data. [2025-09-29T22:08:17.075282] [DEBUG] [LOCAL ] ELP: Derivative data saved (1794 records). [2025-09-29T22:08:17.078153] [DEBUG] [LOCAL ] ELME: Derivative data saved (1794 records). [2025-09-29T22:08:17.078310] [INFO ] [MAIN ] ELME: Successfully saved derivative data. [2025-09-29T22:08:17.081874] [INFO ] [MAIN ] Derivative Progress: 580/2057 symbols completed. ELME took 1.2s. Estimated remaining: 10m 3s. Rate: 147.0 symbols/min [2025-09-29T22:08:17.082259] [INFO ] [MAIN ] EMD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:17.076786] [INFO ] [MAIN ] ELP: Successfully saved derivative data. [2025-09-29T22:08:17.084979] [INFO ] [MAIN ] Derivative Progress: 581/2057 symbols completed. ELP took 1.2s. Estimated remaining: 10m 1s. Rate: 147.2 symbols/min [2025-09-29T22:08:17.085519] [INFO ] [MAIN ] EMF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:17.107263] [DEBUG] [MAIN ] ELS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:17.107486] [DEBUG] [LOCAL ] EMF: Loaded 3445 existing records from primary storage. [2025-09-29T22:08:17.108397] [INFO ] [MAIN ] ELS: Generated 1794 derivative records from 49379 primary records. [2025-09-29T22:08:17.108791] [INFO ] [MAIN ] EMF: Loaded 3445 primary data records. [2025-09-29T22:08:17.108622] [DEBUG] [LOCAL ] ELS: Saving derivative data. [2025-09-29T22:08:17.240085] [DEBUG] [LOCAL ] EMD: Loaded 21085 existing records from primary storage. [2025-09-29T22:08:17.243218] [INFO ] [MAIN ] EMD: Loaded 21085 primary data records. [2025-09-29T22:08:17.244324] [DEBUG] [LOCAL ] ELS: Derivative data saved (1794 records). [2025-09-29T22:08:17.260196] [INFO ] [MAIN ] ELS: Successfully saved derivative data. [2025-09-29T22:08:17.268977] [INFO ] [MAIN ] Derivative Progress: 582/2057 symbols completed. ELS took 1.2s. Estimated remaining: 10m 1s. Rate: 147.4 symbols/min [2025-09-29T22:08:17.295724] [INFO ] [MAIN ] EMN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:17.848879] [DEBUG] [LOCAL ] EMN: Loaded 50422 existing records from primary storage. [2025-09-29T22:08:17.849455] [INFO ] [MAIN ] EMN: Loaded 50422 primary data records. [2025-09-29T22:08:17.949130] [DEBUG] [MAIN ] EMF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:17.955933] [INFO ] [MAIN ] EMF: Generated 1794 derivative records from 3445 primary records. [2025-09-29T22:08:17.979315] [DEBUG] [LOCAL ] EMF: Saving derivative data. [2025-09-29T22:08:18.087261] [DEBUG] [MAIN ] EMD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:18.111551] [INFO ] [MAIN ] EMD: Generated 1794 derivative records from 21085 primary records. [2025-09-29T22:08:18.246005] [DEBUG] [LOCAL ] EMD: Saving derivative data. [2025-09-29T22:08:18.247580] [DEBUG] [LOCAL ] EMF: Derivative data saved (1794 records). [2025-09-29T22:08:18.247972] [INFO ] [MAIN ] EMF: Successfully saved derivative data. [2025-09-29T22:08:18.250118] [INFO ] [MAIN ] Derivative Progress: 583/2057 symbols completed. EMF took 1.2s. Estimated remaining: 10m 2s. Rate: 147.0 symbols/min [2025-09-29T22:08:18.269446] [DEBUG] [LOCAL ] EMD: Derivative data saved (1794 records). [2025-09-29T22:08:18.269573] [INFO ] [MAIN ] EMD: Successfully saved derivative data. [2025-09-29T22:08:18.271970] [INFO ] [MAIN ] Derivative Progress: 584/2057 symbols completed. EMD took 1.2s. Estimated remaining: 10m 0s. Rate: 147.3 symbols/min [2025-09-29T22:08:18.291820] [DEBUG] [MAIN ] EMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:18.292482] [INFO ] [MAIN ] EMN: Generated 1794 derivative records from 50422 primary records. [2025-09-29T22:08:18.292548] [DEBUG] [LOCAL ] EMN: Saving derivative data. [2025-09-29T22:08:18.308417] [DEBUG] [LOCAL ] EMN: Derivative data saved (1794 records). [2025-09-29T22:08:18.308492] [INFO ] [MAIN ] EMN: Successfully saved derivative data. [2025-09-29T22:08:18.310892] [INFO ] [MAIN ] Derivative Progress: 585/2057 symbols completed. EMN took 1.0s. Estimated remaining: 9m 59s. Rate: 147.5 symbols/min [2025-09-29T22:08:18.311372] [INFO ] [MAIN ] EMR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:18.311531] [INFO ] [MAIN ] ENFY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:18.311638] [INFO ] [MAIN ] ENB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:18.318887] [DEBUG] [LOCAL ] ENFY: Loaded 3090 existing records from primary storage. [2025-09-29T22:08:18.319093] [INFO ] [MAIN ] ENFY: Loaded 3090 primary data records. [2025-09-29T22:08:18.705975] [DEBUG] [LOCAL ] ENB: Loaded 53513 existing records from primary storage. [2025-09-29T22:08:18.709203] [INFO ] [MAIN ] ENB: Loaded 53513 primary data records. [2025-09-29T22:08:18.710312] [DEBUG] [LOCAL ] EMR: Loaded 53249 existing records from primary storage. [2025-09-29T22:08:18.722114] [INFO ] [MAIN ] EMR: Loaded 53249 primary data records. [2025-09-29T22:08:19.428465] [DEBUG] [MAIN ] ENFY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:19.430502] [INFO ] [MAIN ] ENFY: Generated 1794 derivative records from 3090 primary records. [2025-09-29T22:08:19.430970] [DEBUG] [LOCAL ] ENFY: Saving derivative data. [2025-09-29T22:08:19.452905] [DEBUG] [LOCAL ] ENFY: Derivative data saved (1794 records). [2025-09-29T22:08:19.453277] [INFO ] [MAIN ] ENFY: Successfully saved derivative data. [2025-09-29T22:08:19.457676] [INFO ] [MAIN ] Derivative Progress: 586/2057 symbols completed. ENFY took 1.1s. Estimated remaining: 10m 0s. Rate: 147.0 symbols/min [2025-09-29T22:08:19.458449] [INFO ] [MAIN ] ENIC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:19.477559] [DEBUG] [MAIN ] ENB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:19.478465] [INFO ] [MAIN ] ENB: Generated 1794 derivative records from 53513 primary records. [2025-09-29T22:08:19.478547] [DEBUG] [LOCAL ] ENB: Saving derivative data. [2025-09-29T22:08:19.499539] [DEBUG] [LOCAL ] ENB: Derivative data saved (1794 records). [2025-09-29T22:08:19.499891] [INFO ] [MAIN ] ENB: Successfully saved derivative data. [2025-09-29T22:08:19.502113] [INFO ] [MAIN ] Derivative Progress: 587/2057 symbols completed. ENB took 1.2s. Estimated remaining: 9m 59s. Rate: 147.3 symbols/min [2025-09-29T22:08:19.502438] [INFO ] [MAIN ] ENO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:19.526825] [DEBUG] [MAIN ] EMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:19.528695] [INFO ] [MAIN ] EMR: Generated 1794 derivative records from 53249 primary records. [2025-09-29T22:08:19.528922] [DEBUG] [LOCAL ] EMR: Saving derivative data. [2025-09-29T22:08:19.532248] [DEBUG] [LOCAL ] ENO: Loaded 1914 existing records from primary storage. [2025-09-29T22:08:19.532665] [INFO ] [MAIN ] ENO: Loaded 1914 primary data records. [2025-09-29T22:08:19.652335] [DEBUG] [LOCAL ] ENIC: Loaded 36314 existing records from primary storage. [2025-09-29T22:08:19.659410] [INFO ] [MAIN ] ENIC: Loaded 36314 primary data records. [2025-09-29T22:08:19.684739] [DEBUG] [LOCAL ] EMR: Derivative data saved (1794 records). [2025-09-29T22:08:19.696052] [INFO ] [MAIN ] EMR: Successfully saved derivative data. [2025-09-29T22:08:19.699431] [INFO ] [MAIN ] Derivative Progress: 588/2057 symbols completed. EMR took 1.4s. Estimated remaining: 9m 58s. Rate: 147.4 symbols/min [2025-09-29T22:08:19.717363] [INFO ] [MAIN ] ENOV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:20.253110] [DEBUG] [LOCAL ] ENOV: Loaded 45017 existing records from primary storage. [2025-09-29T22:08:20.254070] [INFO ] [MAIN ] ENOV: Loaded 45017 primary data records. [2025-09-29T22:08:20.468258] [DEBUG] [MAIN ] ENO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:20.590332] [INFO ] [MAIN ] ENO: Generated 1794 derivative records from 1914 primary records. [2025-09-29T22:08:20.591371] [DEBUG] [LOCAL ] ENO: Saving derivative data. [2025-09-29T22:08:20.623540] [DEBUG] [MAIN ] ENIC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:20.625474] [INFO ] [MAIN ] ENIC: Generated 1794 derivative records from 36314 primary records. [2025-09-29T22:08:20.626772] [DEBUG] [LOCAL ] ENIC: Saving derivative data. [2025-09-29T22:08:20.628362] [DEBUG] [LOCAL ] ENO: Derivative data saved (1794 records). [2025-09-29T22:08:20.640060] [INFO ] [MAIN ] ENO: Successfully saved derivative data. [2025-09-29T22:08:20.647700] [INFO ] [MAIN ] Derivative Progress: 589/2057 symbols completed. ENO took 1.1s. Estimated remaining: 9m 59s. Rate: 147.1 symbols/min [2025-09-29T22:08:20.649633] [INFO ] [MAIN ] EOD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:20.654735] [DEBUG] [LOCAL ] ENIC: Derivative data saved (1794 records). [2025-09-29T22:08:20.654969] [INFO ] [MAIN ] ENIC: Successfully saved derivative data. [2025-09-29T22:08:20.657821] [INFO ] [MAIN ] Derivative Progress: 590/2057 symbols completed. ENIC took 1.2s. Estimated remaining: 9m 58s. Rate: 147.3 symbols/min [2025-09-29T22:08:20.658275] [INFO ] [MAIN ] EOG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:20.671193] [DEBUG] [LOCAL ] EOD: Loaded 14134 existing records from primary storage. [2025-09-29T22:08:20.671526] [INFO ] [MAIN ] EOD: Loaded 14134 primary data records. [2025-09-29T22:08:20.723026] [DEBUG] [MAIN ] ENOV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:20.742827] [INFO ] [MAIN ] ENOV: Generated 1794 derivative records from 45017 primary records. [2025-09-29T22:08:20.769124] [DEBUG] [LOCAL ] ENOV: Saving derivative data. [2025-09-29T22:08:21.019628] [DEBUG] [LOCAL ] ENOV: Derivative data saved (1794 records). [2025-09-29T22:08:21.028369] [INFO ] [MAIN ] ENOV: Successfully saved derivative data. [2025-09-29T22:08:21.031447] [INFO ] [MAIN ] Derivative Progress: 591/2057 symbols completed. ENOV took 1.3s. Estimated remaining: 9m 57s. Rate: 147.3 symbols/min [2025-09-29T22:08:21.031874] [INFO ] [MAIN ] EOI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:21.054143] [DEBUG] [LOCAL ] EOG: Loaded 53342 existing records from primary storage. [2025-09-29T22:08:21.054530] [INFO ] [MAIN ] EOG: Loaded 53342 primary data records. [2025-09-29T22:08:21.151397] [DEBUG] [LOCAL ] EOI: Loaded 10661 existing records from primary storage. [2025-09-29T22:08:21.172790] [INFO ] [MAIN ] EOI: Loaded 10661 primary data records. [2025-09-29T22:08:21.595942] [DEBUG] [MAIN ] EOD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:21.763074] [INFO ] [MAIN ] EOD: Generated 1794 derivative records from 14134 primary records. [2025-09-29T22:08:21.764168] [DEBUG] [LOCAL ] EOD: Saving derivative data. [2025-09-29T22:08:21.784204] [DEBUG] [LOCAL ] EOD: Derivative data saved (1794 records). [2025-09-29T22:08:21.785288] [INFO ] [MAIN ] EOD: Successfully saved derivative data. [2025-09-29T22:08:21.787601] [INFO ] [MAIN ] Derivative Progress: 592/2057 symbols completed. EOD took 1.1s. Estimated remaining: 9m 58s. Rate: 147.1 symbols/min [2025-09-29T22:08:21.788679] [INFO ] [MAIN ] EOS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:21.831236] [DEBUG] [MAIN ] EOG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:21.832061] [INFO ] [MAIN ] EOG: Generated 1794 derivative records from 53342 primary records. [2025-09-29T22:08:21.830750] [DEBUG] [LOCAL ] EOS: Loaded 15244 existing records from primary storage. [2025-09-29T22:08:21.832248] [INFO ] [MAIN ] EOS: Loaded 15244 primary data records. [2025-09-29T22:08:21.832386] [DEBUG] [LOCAL ] EOG: Saving derivative data. [2025-09-29T22:08:21.970472] [DEBUG] [MAIN ] EOI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:21.972543] [INFO ] [MAIN ] EOI: Generated 1794 derivative records from 10661 primary records. [2025-09-29T22:08:21.983294] [DEBUG] [LOCAL ] EOI: Saving derivative data. [2025-09-29T22:08:22.000921] [DEBUG] [LOCAL ] EOG: Derivative data saved (1794 records). [2025-09-29T22:08:22.014594] [INFO ] [MAIN ] EOG: Successfully saved derivative data. [2025-09-29T22:08:22.035534] [INFO ] [MAIN ] Derivative Progress: 593/2057 symbols completed. EOG took 1.4s. Estimated remaining: 9m 57s. Rate: 147.2 symbols/min [2025-09-29T22:08:22.174275] [INFO ] [MAIN ] EOT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:22.196856] [DEBUG] [LOCAL ] EOI: Derivative data saved (1794 records). [2025-09-29T22:08:22.197022] [INFO ] [MAIN ] EOI: Successfully saved derivative data. [2025-09-29T22:08:22.202186] [INFO ] [MAIN ] Derivative Progress: 594/2057 symbols completed. EOI took 1.2s. Estimated remaining: 9m 56s. Rate: 147.3 symbols/min [2025-09-29T22:08:22.202502] [INFO ] [MAIN ] EPAM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:22.208924] [DEBUG] [LOCAL ] EOT: Loaded 6885 existing records from primary storage. [2025-09-29T22:08:22.209431] [INFO ] [MAIN ] EOT: Loaded 6885 primary data records. [2025-09-29T22:08:22.556566] [DEBUG] [LOCAL ] EPAM: Loaded 39831 existing records from primary storage. [2025-09-29T22:08:22.557012] [INFO ] [MAIN ] EPAM: Loaded 39831 primary data records. [2025-09-29T22:08:22.627424] [DEBUG] [MAIN ] EOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:22.670009] [INFO ] [MAIN ] EOS: Generated 1794 derivative records from 15244 primary records. [2025-09-29T22:08:22.696843] [DEBUG] [LOCAL ] EOS: Saving derivative data. [2025-09-29T22:08:22.928104] [DEBUG] [LOCAL ] EOS: Derivative data saved (1794 records). [2025-09-29T22:08:22.929258] [INFO ] [MAIN ] EOS: Successfully saved derivative data. [2025-09-29T22:08:22.931272] [INFO ] [MAIN ] Derivative Progress: 595/2057 symbols completed. EOS took 1.1s. Estimated remaining: 9m 56s. Rate: 147.2 symbols/min [2025-09-29T22:08:22.931457] [INFO ] [MAIN ] EPC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:22.952500] [DEBUG] [MAIN ] EOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:22.955719] [INFO ] [MAIN ] EOT: Generated 1794 derivative records from 6885 primary records. [2025-09-29T22:08:22.955979] [DEBUG] [LOCAL ] EOT: Saving derivative data. [2025-09-29T22:08:22.977002] [DEBUG] [LOCAL ] EOT: Derivative data saved (1794 records). [2025-09-29T22:08:22.986805] [INFO ] [MAIN ] EOT: Successfully saved derivative data. [2025-09-29T22:08:22.989324] [INFO ] [MAIN ] Derivative Progress: 596/2057 symbols completed. EOT took 0.8s. Estimated remaining: 9m 55s. Rate: 147.4 symbols/min [2025-09-29T22:08:22.989619] [INFO ] [MAIN ] EPD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:23.019436] [DEBUG] [MAIN ] EPAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:23.020040] [DEBUG] [LOCAL ] EPC: Loaded 39719 existing records from primary storage. [2025-09-29T22:08:23.021111] [INFO ] [MAIN ] EPAM: Generated 1794 derivative records from 39831 primary records. [2025-09-29T22:08:23.021234] [DEBUG] [LOCAL ] EPAM: Saving derivative data. [2025-09-29T22:08:23.021318] [INFO ] [MAIN ] EPC: Loaded 39719 primary data records. [2025-09-29T22:08:23.144075] [DEBUG] [LOCAL ] EPAM: Derivative data saved (1794 records). [2025-09-29T22:08:23.157554] [INFO ] [MAIN ] EPAM: Successfully saved derivative data. [2025-09-29T22:08:23.167302] [INFO ] [MAIN ] Derivative Progress: 597/2057 symbols completed. EPAM took 1.0s. Estimated remaining: 9m 54s. Rate: 147.5 symbols/min [2025-09-29T22:08:23.183083] [INFO ] [MAIN ] EPR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:23.408693] [DEBUG] [LOCAL ] EPD: Loaded 53610 existing records from primary storage. [2025-09-29T22:08:23.409072] [INFO ] [MAIN ] EPD: Loaded 53610 primary data records. [2025-09-29T22:08:23.605942] [DEBUG] [LOCAL ] EPR: Loaded 43933 existing records from primary storage. [2025-09-29T22:08:23.617282] [INFO ] [MAIN ] EPR: Loaded 43933 primary data records. [2025-09-29T22:08:23.960084] [DEBUG] [MAIN ] EPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:23.976807] [INFO ] [MAIN ] EPC: Generated 1794 derivative records from 39719 primary records. [2025-09-29T22:08:23.976940] [DEBUG] [LOCAL ] EPC: Saving derivative data. [2025-09-29T22:08:24.177139] [DEBUG] [LOCAL ] EPC: Derivative data saved (1794 records). [2025-09-29T22:08:24.178286] [INFO ] [MAIN ] EPC: Successfully saved derivative data. [2025-09-29T22:08:24.180494] [INFO ] [MAIN ] Derivative Progress: 598/2057 symbols completed. EPC took 1.2s. Estimated remaining: 9m 55s. Rate: 147.1 symbols/min [2025-09-29T22:08:24.200950] [DEBUG] [MAIN ] EPD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:24.202036] [INFO ] [MAIN ] EPD: Generated 1794 derivative records from 53610 primary records. [2025-09-29T22:08:24.202388] [DEBUG] [LOCAL ] EPD: Saving derivative data. [2025-09-29T22:08:24.222935] [DEBUG] [LOCAL ] EPD: Derivative data saved (1794 records). [2025-09-29T22:08:24.223280] [INFO ] [MAIN ] EPD: Successfully saved derivative data. [2025-09-29T22:08:24.238666] [INFO ] [MAIN ] Derivative Progress: 599/2057 symbols completed. EPD took 1.2s. Estimated remaining: 9m 54s. Rate: 147.3 symbols/min [2025-09-29T22:08:24.239259] [DEBUG] [MAIN ] EPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:24.240177] [INFO ] [MAIN ] EPR: Generated 1794 derivative records from 43933 primary records. [2025-09-29T22:08:24.240291] [DEBUG] [LOCAL ] EPR: Saving derivative data. [2025-09-29T22:08:24.257020] [DEBUG] [LOCAL ] EPR: Derivative data saved (1794 records). [2025-09-29T22:08:24.257133] [INFO ] [MAIN ] EPR: Successfully saved derivative data. [2025-09-29T22:08:24.259467] [INFO ] [MAIN ] Derivative Progress: 600/2057 symbols completed. EPR took 1.1s. Estimated remaining: 9m 52s. Rate: 147.6 symbols/min [2025-09-29T22:08:24.260098] [INFO ] [MAIN ] EQNR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:24.259994] [INFO ] [MAIN ] EPRT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:24.260229] [INFO ] [MAIN ] EQBK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:24.278352] [DEBUG] [LOCAL ] EQBK: Loaded 10915 existing records from primary storage. [2025-09-29T22:08:24.278506] [INFO ] [MAIN ] EQBK: Loaded 10915 primary data records. [2025-09-29T22:08:24.642024] [DEBUG] [LOCAL ] EPRT: Loaded 48483 existing records from primary storage. [2025-09-29T22:08:24.651675] [INFO ] [MAIN ] EPRT: Loaded 48483 primary data records. [2025-09-29T22:08:24.739359] [DEBUG] [LOCAL ] EQNR: Loaded 53027 existing records from primary storage. [2025-09-29T22:08:24.757733] [INFO ] [MAIN ] EQNR: Loaded 53027 primary data records. [2025-09-29T22:08:25.337351] [DEBUG] [MAIN ] EQBK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:25.339044] [INFO ] [MAIN ] EQBK: Generated 1794 derivative records from 10915 primary records. [2025-09-29T22:08:25.339788] [DEBUG] [LOCAL ] EQBK: Saving derivative data. [2025-09-29T22:08:25.377624] [DEBUG] [LOCAL ] EQBK: Derivative data saved (1794 records). [2025-09-29T22:08:25.378316] [INFO ] [MAIN ] EQBK: Successfully saved derivative data. [2025-09-29T22:08:25.380778] [INFO ] [MAIN ] Derivative Progress: 601/2057 symbols completed. EQBK took 1.1s. Estimated remaining: 9m 54s. Rate: 147.2 symbols/min [2025-09-29T22:08:25.378064] [DEBUG] [MAIN ] EPRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:25.382018] [INFO ] [MAIN ] EPRT: Generated 1794 derivative records from 48483 primary records. [2025-09-29T22:08:25.382443] [INFO ] [MAIN ] EQR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:25.382937] [DEBUG] [LOCAL ] EPRT: Saving derivative data. [2025-09-29T22:08:25.417889] [DEBUG] [MAIN ] EQNR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:25.419467] [INFO ] [MAIN ] EQNR: Generated 1794 derivative records from 53027 primary records. [2025-09-29T22:08:25.419573] [DEBUG] [LOCAL ] EQNR: Saving derivative data. [2025-09-29T22:08:25.420243] [DEBUG] [LOCAL ] EPRT: Derivative data saved (1794 records). [2025-09-29T22:08:25.420524] [INFO ] [MAIN ] EPRT: Successfully saved derivative data. [2025-09-29T22:08:25.422518] [INFO ] [MAIN ] Derivative Progress: 602/2057 symbols completed. EPRT took 1.2s. Estimated remaining: 9m 52s. Rate: 147.4 symbols/min [2025-09-29T22:08:25.423376] [INFO ] [MAIN ] EQT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:25.442067] [DEBUG] [LOCAL ] EQNR: Derivative data saved (1794 records). [2025-09-29T22:08:25.442307] [INFO ] [MAIN ] EQNR: Successfully saved derivative data. [2025-09-29T22:08:25.445102] [INFO ] [MAIN ] Derivative Progress: 603/2057 symbols completed. EQNR took 1.2s. Estimated remaining: 9m 51s. Rate: 147.6 symbols/min [2025-09-29T22:08:25.445394] [INFO ] [MAIN ] EQV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:25.465782] [DEBUG] [LOCAL ] EQV: Loaded 2742 existing records from primary storage. [2025-09-29T22:08:25.466126] [INFO ] [MAIN ] EQV: Loaded 2742 primary data records. [2025-09-29T22:08:25.588272] [DEBUG] [LOCAL ] EQR: Loaded 51469 existing records from primary storage. [2025-09-29T22:08:25.592772] [INFO ] [MAIN ] EQR: Loaded 51469 primary data records. [2025-09-29T22:08:26.004387] [DEBUG] [LOCAL ] EQT: Loaded 53682 existing records from primary storage. [2025-09-29T22:08:26.061456] [INFO ] [MAIN ] EQT: Loaded 53682 primary data records. [2025-09-29T22:08:26.543215] [DEBUG] [MAIN ] EQV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:26.544729] [INFO ] [MAIN ] EQV: Generated 1794 derivative records from 2742 primary records. [2025-09-29T22:08:26.544820] [DEBUG] [LOCAL ] EQV: Saving derivative data. [2025-09-29T22:08:26.581278] [DEBUG] [LOCAL ] EQV: Derivative data saved (1794 records). [2025-09-29T22:08:26.582145] [INFO ] [MAIN ] EQV: Successfully saved derivative data. [2025-09-29T22:08:26.582046] [DEBUG] [MAIN ] EQR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:26.584677] [INFO ] [MAIN ] Derivative Progress: 604/2057 symbols completed. EQV took 1.1s. Estimated remaining: 9m 52s. Rate: 147.2 symbols/min [2025-09-29T22:08:26.586142] [INFO ] [MAIN ] ERJ: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:26.585858] [INFO ] [MAIN ] EQR: Generated 1794 derivative records from 51469 primary records. [2025-09-29T22:08:26.586704] [DEBUG] [LOCAL ] EQR: Saving derivative data. [2025-09-29T22:08:26.609718] [DEBUG] [LOCAL ] EQR: Derivative data saved (1794 records). [2025-09-29T22:08:26.610026] [INFO ] [MAIN ] EQR: Successfully saved derivative data. [2025-09-29T22:08:26.626143] [INFO ] [MAIN ] Derivative Progress: 605/2057 symbols completed. EQR took 1.2s. Estimated remaining: 9m 51s. Rate: 147.4 symbols/min [2025-09-29T22:08:26.633590] [INFO ] [MAIN ] ERO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:26.635200] [DEBUG] [MAIN ] EQT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:26.636595] [INFO ] [MAIN ] EQT: Generated 1794 derivative records from 53682 primary records. [2025-09-29T22:08:26.636838] [DEBUG] [LOCAL ] EQT: Saving derivative data. [2025-09-29T22:08:26.672189] [DEBUG] [LOCAL ] EQT: Derivative data saved (1794 records). [2025-09-29T22:08:26.672424] [INFO ] [MAIN ] EQT: Successfully saved derivative data. [2025-09-29T22:08:26.676484] [INFO ] [MAIN ] Derivative Progress: 606/2057 symbols completed. EQT took 1.3s. Estimated remaining: 9m 50s. Rate: 147.6 symbols/min [2025-09-29T22:08:26.678046] [INFO ] [MAIN ] ES: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:26.707558] [DEBUG] [LOCAL ] ERJ: Loaded 50678 existing records from primary storage. [2025-09-29T22:08:26.707889] [INFO ] [MAIN ] ERJ: Loaded 50678 primary data records. [2025-09-29T22:08:26.828133] [DEBUG] [LOCAL ] ERO: Loaded 41225 existing records from primary storage. [2025-09-29T22:08:26.840578] [INFO ] [MAIN ] ERO: Loaded 41225 primary data records. [2025-09-29T22:08:27.422182] [DEBUG] [LOCAL ] ES: Loaded 52538 existing records from primary storage. [2025-09-29T22:08:27.422431] [INFO ] [MAIN ] ES: Loaded 52538 primary data records. [2025-09-29T22:08:27.776931] [DEBUG] [MAIN ] ERJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:27.779383] [INFO ] [MAIN ] ERJ: Generated 1794 derivative records from 50678 primary records. [2025-09-29T22:08:27.779544] [DEBUG] [LOCAL ] ERJ: Saving derivative data. [2025-09-29T22:08:27.817876] [DEBUG] [MAIN ] ERO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:27.820260] [INFO ] [MAIN ] ERO: Generated 1794 derivative records from 41225 primary records. [2025-09-29T22:08:27.821761] [DEBUG] [LOCAL ] ERO: Saving derivative data. [2025-09-29T22:08:27.820735] [DEBUG] [LOCAL ] ERJ: Derivative data saved (1794 records). [2025-09-29T22:08:27.823490] [INFO ] [MAIN ] ERJ: Successfully saved derivative data. [2025-09-29T22:08:27.833175] [INFO ] [MAIN ] Derivative Progress: 607/2057 symbols completed. ERJ took 1.2s. Estimated remaining: 9m 51s. Rate: 147.1 symbols/min [2025-09-29T22:08:27.835265] [INFO ] [MAIN ] ESAB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:27.849972] [DEBUG] [LOCAL ] ERO: Derivative data saved (1794 records). [2025-09-29T22:08:27.851443] [INFO ] [MAIN ] ERO: Successfully saved derivative data. [2025-09-29T22:08:27.854237] [INFO ] [MAIN ] Derivative Progress: 608/2057 symbols completed. ERO took 1.2s. Estimated remaining: 9m 50s. Rate: 147.4 symbols/min [2025-09-29T22:08:27.855307] [INFO ] [MAIN ] ESE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:27.887085] [DEBUG] [MAIN ] ES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:27.888383] [INFO ] [MAIN ] ES: Generated 1794 derivative records from 52538 primary records. [2025-09-29T22:08:27.888584] [DEBUG] [LOCAL ] ES: Saving derivative data. [2025-09-29T22:08:27.916589] [DEBUG] [LOCAL ] ES: Derivative data saved (1794 records). [2025-09-29T22:08:27.920900] [INFO ] [MAIN ] ES: Successfully saved derivative data. [2025-09-29T22:08:27.923544] [INFO ] [MAIN ] Derivative Progress: 609/2057 symbols completed. ES took 1.2s. Estimated remaining: 9m 49s. Rate: 147.6 symbols/min [2025-09-29T22:08:27.923841] [INFO ] [MAIN ] ESI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:27.925030] [DEBUG] [LOCAL ] ESAB: Loaded 26158 existing records from primary storage. [2025-09-29T22:08:27.925832] [INFO ] [MAIN ] ESAB: Loaded 26158 primary data records. [2025-09-29T22:08:27.991145] [DEBUG] [LOCAL ] ESE: Loaded 16687 existing records from primary storage. [2025-09-29T22:08:28.018418] [INFO ] [MAIN ] ESE: Loaded 16687 primary data records. [2025-09-29T22:08:28.508159] [DEBUG] [LOCAL ] ESI: Loaded 50777 existing records from primary storage. [2025-09-29T22:08:28.625778] [INFO ] [MAIN ] ESI: Loaded 50777 primary data records. [2025-09-29T22:08:28.995278] [DEBUG] [MAIN ] ESAB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:28.997112] [INFO ] [MAIN ] ESAB: Generated 1794 derivative records from 26158 primary records. [2025-09-29T22:08:28.998365] [DEBUG] [LOCAL ] ESAB: Saving derivative data. [2025-09-29T22:08:29.031790] [DEBUG] [MAIN ] ESE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:29.035554] [INFO ] [MAIN ] ESE: Generated 1794 derivative records from 16687 primary records. [2025-09-29T22:08:29.035949] [DEBUG] [LOCAL ] ESE: Saving derivative data. [2025-09-29T22:08:29.039005] [DEBUG] [LOCAL ] ESAB: Derivative data saved (1794 records). [2025-09-29T22:08:29.039286] [INFO ] [MAIN ] ESAB: Successfully saved derivative data. [2025-09-29T22:08:29.041923] [INFO ] [MAIN ] Derivative Progress: 610/2057 symbols completed. ESAB took 1.2s. Estimated remaining: 9m 50s. Rate: 147.2 symbols/min [2025-09-29T22:08:29.043801] [INFO ] [MAIN ] ESNT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:29.076090] [DEBUG] [LOCAL ] ESE: Derivative data saved (1794 records). [2025-09-29T22:08:29.076367] [INFO ] [MAIN ] ESE: Successfully saved derivative data. [2025-09-29T22:08:29.079611] [INFO ] [MAIN ] Derivative Progress: 611/2057 symbols completed. ESE took 1.2s. Estimated remaining: 9m 49s. Rate: 147.4 symbols/min [2025-09-29T22:08:29.076745] [DEBUG] [MAIN ] ESI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:29.080071] [INFO ] [MAIN ] ESRT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:29.081328] [INFO ] [MAIN ] ESI: Generated 1794 derivative records from 50777 primary records. [2025-09-29T22:08:29.081543] [DEBUG] [LOCAL ] ESI: Saving derivative data. [2025-09-29T22:08:29.099201] [DEBUG] [LOCAL ] ESI: Derivative data saved (1794 records). [2025-09-29T22:08:29.099349] [INFO ] [MAIN ] ESI: Successfully saved derivative data. [2025-09-29T22:08:29.107154] [INFO ] [MAIN ] Derivative Progress: 612/2057 symbols completed. ESI took 1.2s. Estimated remaining: 9m 47s. Rate: 147.6 symbols/min [2025-09-29T22:08:29.107405] [INFO ] [MAIN ] ESS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:29.148104] [DEBUG] [LOCAL ] ESNT: Loaded 38376 existing records from primary storage. [2025-09-29T22:08:29.148499] [INFO ] [MAIN ] ESNT: Loaded 38376 primary data records. [2025-09-29T22:08:29.283979] [DEBUG] [LOCAL ] ESRT: Loaded 46398 existing records from primary storage. [2025-09-29T22:08:29.295107] [INFO ] [MAIN ] ESRT: Loaded 46398 primary data records. [2025-09-29T22:08:29.397579] [DEBUG] [LOCAL ] ESS: Loaded 30019 existing records from primary storage. [2025-09-29T22:08:29.558722] [INFO ] [MAIN ] ESS: Loaded 30019 primary data records. [2025-09-29T22:08:30.254968] [DEBUG] [MAIN ] ESNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:30.256722] [INFO ] [MAIN ] ESNT: Generated 1794 derivative records from 38376 primary records. [2025-09-29T22:08:30.257158] [DEBUG] [LOCAL ] ESNT: Saving derivative data. [2025-09-29T22:08:30.279467] [DEBUG] [LOCAL ] ESNT: Derivative data saved (1794 records). [2025-09-29T22:08:30.287807] [INFO ] [MAIN ] ESNT: Successfully saved derivative data. [2025-09-29T22:08:30.295186] [INFO ] [MAIN ] Derivative Progress: 613/2057 symbols completed. ESNT took 1.3s. Estimated remaining: 9m 49s. Rate: 147.1 symbols/min [2025-09-29T22:08:30.295581] [DEBUG] [MAIN ] ESRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:30.297279] [INFO ] [MAIN ] ESRT: Generated 1794 derivative records from 46398 primary records. [2025-09-29T22:08:30.297539] [DEBUG] [LOCAL ] ESRT: Saving derivative data. [2025-09-29T22:08:30.316854] [DEBUG] [LOCAL ] ESRT: Derivative data saved (1794 records). [2025-09-29T22:08:30.317188] [INFO ] [MAIN ] ESRT: Successfully saved derivative data. [2025-09-29T22:08:30.319950] [INFO ] [MAIN ] Derivative Progress: 614/2057 symbols completed. ESRT took 1.2s. Estimated remaining: 9m 48s. Rate: 147.4 symbols/min [2025-09-29T22:08:30.332872] [DEBUG] [MAIN ] ESS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:30.333570] [INFO ] [MAIN ] ESS: Generated 1794 derivative records from 30019 primary records. [2025-09-29T22:08:30.333635] [DEBUG] [LOCAL ] ESS: Saving derivative data. [2025-09-29T22:08:30.349132] [DEBUG] [LOCAL ] ESS: Derivative data saved (1794 records). [2025-09-29T22:08:30.349192] [INFO ] [MAIN ] ESS: Successfully saved derivative data. [2025-09-29T22:08:30.351572] [INFO ] [MAIN ] Derivative Progress: 615/2057 symbols completed. ESS took 1.2s. Estimated remaining: 9m 46s. Rate: 147.6 symbols/min [2025-09-29T22:08:30.352196] [INFO ] [MAIN ] ESTC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:30.352049] [INFO ] [MAIN ] ET: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:30.353883] [INFO ] [MAIN ] ETB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:30.369332] [DEBUG] [LOCAL ] ETB: Loaded 12084 existing records from primary storage. [2025-09-29T22:08:30.369561] [INFO ] [MAIN ] ETB: Loaded 12084 primary data records. [2025-09-29T22:08:30.752709] [DEBUG] [LOCAL ] ESTC: Loaded 49961 existing records from primary storage. [2025-09-29T22:08:30.753569] [INFO ] [MAIN ] ESTC: Loaded 49961 primary data records. [2025-09-29T22:08:30.754551] [DEBUG] [LOCAL ] ET: Loaded 53789 existing records from primary storage. [2025-09-29T22:08:30.754753] [INFO ] [MAIN ] ET: Loaded 53789 primary data records. [2025-09-29T22:08:31.462154] [DEBUG] [MAIN ] ETB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:31.463884] [INFO ] [MAIN ] ETB: Generated 1794 derivative records from 12084 primary records. [2025-09-29T22:08:31.465491] [DEBUG] [LOCAL ] ETB: Saving derivative data. [2025-09-29T22:08:31.489271] [DEBUG] [LOCAL ] ETB: Derivative data saved (1794 records). [2025-09-29T22:08:31.492225] [INFO ] [MAIN ] ETB: Successfully saved derivative data. [2025-09-29T22:08:31.496700] [INFO ] [MAIN ] Derivative Progress: 616/2057 symbols completed. ETB took 1.1s. Estimated remaining: 9m 48s. Rate: 147.2 symbols/min [2025-09-29T22:08:31.526255] [DEBUG] [MAIN ] ESTC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:31.524868] [INFO ] [MAIN ] ETD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:31.527415] [INFO ] [MAIN ] ESTC: Generated 1794 derivative records from 49961 primary records. [2025-09-29T22:08:31.527738] [DEBUG] [MAIN ] ET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:31.527953] [DEBUG] [LOCAL ] ESTC: Saving derivative data. [2025-09-29T22:08:31.528890] [INFO ] [MAIN ] ET: Generated 1794 derivative records from 53789 primary records. [2025-09-29T22:08:31.529968] [DEBUG] [LOCAL ] ET: Saving derivative data. [2025-09-29T22:08:31.564757] [DEBUG] [LOCAL ] ESTC: Derivative data saved (1794 records). [2025-09-29T22:08:31.565288] [INFO ] [MAIN ] ESTC: Successfully saved derivative data. [2025-09-29T22:08:31.574983] [INFO ] [MAIN ] Derivative Progress: 617/2057 symbols completed. ESTC took 1.2s. Estimated remaining: 9m 46s. Rate: 147.3 symbols/min [2025-09-29T22:08:31.576464] [INFO ] [MAIN ] ETG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:31.578475] [DEBUG] [LOCAL ] ET: Derivative data saved (1794 records). [2025-09-29T22:08:31.578668] [INFO ] [MAIN ] ET: Successfully saved derivative data. [2025-09-29T22:08:31.581373] [INFO ] [MAIN ] Derivative Progress: 618/2057 symbols completed. ET took 1.2s. Estimated remaining: 9m 45s. Rate: 147.6 symbols/min [2025-09-29T22:08:31.582733] [INFO ] [MAIN ] ETJ: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:31.592604] [DEBUG] [LOCAL ] ETD: Loaded 27396 existing records from primary storage. [2025-09-29T22:08:31.592814] [INFO ] [MAIN ] ETD: Loaded 27396 primary data records. [2025-09-29T22:08:31.726786] [DEBUG] [LOCAL ] ETG: Loaded 16477 existing records from primary storage. [2025-09-29T22:08:31.727048] [INFO ] [MAIN ] ETG: Loaded 16477 primary data records. [2025-09-29T22:08:31.883063] [DEBUG] [LOCAL ] ETJ: Loaded 16684 existing records from primary storage. [2025-09-29T22:08:31.897573] [INFO ] [MAIN ] ETJ: Loaded 16684 primary data records. [2025-09-29T22:08:32.682931] [DEBUG] [MAIN ] ETD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:32.684288] [INFO ] [MAIN ] ETD: Generated 1794 derivative records from 27396 primary records. [2025-09-29T22:08:32.684875] [DEBUG] [LOCAL ] ETD: Saving derivative data. [2025-09-29T22:08:32.703491] [DEBUG] [LOCAL ] ETD: Derivative data saved (1794 records). [2025-09-29T22:08:32.704090] [INFO ] [MAIN ] ETD: Successfully saved derivative data. [2025-09-29T22:08:32.707602] [INFO ] [MAIN ] Derivative Progress: 619/2057 symbols completed. ETD took 1.2s. Estimated remaining: 9m 46s. Rate: 147.2 symbols/min [2025-09-29T22:08:32.709920] [INFO ] [MAIN ] ETN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:32.726096] [DEBUG] [MAIN ] ETJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:32.727689] [INFO ] [MAIN ] ETJ: Generated 1794 derivative records from 16684 primary records. [2025-09-29T22:08:32.727894] [DEBUG] [LOCAL ] ETJ: Saving derivative data. [2025-09-29T22:08:32.757910] [DEBUG] [MAIN ] ETG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:32.758771] [INFO ] [MAIN ] ETG: Generated 1794 derivative records from 16477 primary records. [2025-09-29T22:08:32.757553] [DEBUG] [LOCAL ] ETJ: Derivative data saved (1794 records). [2025-09-29T22:08:32.758919] [DEBUG] [LOCAL ] ETG: Saving derivative data. [2025-09-29T22:08:32.758998] [INFO ] [MAIN ] ETJ: Successfully saved derivative data. [2025-09-29T22:08:32.762053] [INFO ] [MAIN ] Derivative Progress: 620/2057 symbols completed. ETJ took 1.2s. Estimated remaining: 9m 45s. Rate: 147.4 symbols/min [2025-09-29T22:08:32.762343] [INFO ] [MAIN ] ETO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:32.782109] [DEBUG] [LOCAL ] ETG: Derivative data saved (1794 records). [2025-09-29T22:08:32.785774] [INFO ] [MAIN ] ETG: Successfully saved derivative data. [2025-09-29T22:08:32.785979] [DEBUG] [LOCAL ] ETO: Loaded 6496 existing records from primary storage. [2025-09-29T22:08:32.786114] [INFO ] [MAIN ] ETO: Loaded 6496 primary data records. [2025-09-29T22:08:32.789024] [INFO ] [MAIN ] Derivative Progress: 621/2057 symbols completed. ETG took 1.2s. Estimated remaining: 9m 44s. Rate: 147.6 symbols/min [2025-09-29T22:08:32.801263] [INFO ] [MAIN ] ETR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:33.018239] [DEBUG] [LOCAL ] ETN: Loaded 52799 existing records from primary storage. [2025-09-29T22:08:33.096310] [INFO ] [MAIN ] ETN: Loaded 52799 primary data records. [2025-09-29T22:08:33.342619] [DEBUG] [LOCAL ] ETR: Loaded 53220 existing records from primary storage. [2025-09-29T22:08:33.403814] [INFO ] [MAIN ] ETR: Loaded 53220 primary data records. [2025-09-29T22:08:33.953566] [DEBUG] [MAIN ] ETO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:33.954696] [INFO ] [MAIN ] ETO: Generated 1794 derivative records from 6496 primary records. [2025-09-29T22:08:33.954806] [DEBUG] [LOCAL ] ETO: Saving derivative data. [2025-09-29T22:08:33.976054] [DEBUG] [LOCAL ] ETO: Derivative data saved (1794 records). [2025-09-29T22:08:33.976793] [INFO ] [MAIN ] ETO: Successfully saved derivative data. [2025-09-29T22:08:33.992166] [INFO ] [MAIN ] Derivative Progress: 622/2057 symbols completed. ETO took 1.2s. Estimated remaining: 9m 45s. Rate: 147.1 symbols/min [2025-09-29T22:08:33.993235] [DEBUG] [MAIN ] ETN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:33.994484] [INFO ] [MAIN ] ETN: Generated 1794 derivative records from 52799 primary records. [2025-09-29T22:08:33.994732] [DEBUG] [LOCAL ] ETN: Saving derivative data. [2025-09-29T22:08:34.004009] [INFO ] [MAIN ] ETV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:34.015046] [DEBUG] [LOCAL ] ETN: Derivative data saved (1794 records). [2025-09-29T22:08:34.015457] [INFO ] [MAIN ] ETN: Successfully saved derivative data. [2025-09-29T22:08:34.018056] [INFO ] [MAIN ] Derivative Progress: 623/2057 symbols completed. ETN took 1.3s. Estimated remaining: 9m 44s. Rate: 147.3 symbols/min [2025-09-29T22:08:34.018477] [INFO ] [MAIN ] ETW: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:34.045362] [DEBUG] [MAIN ] ETR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:34.046378] [INFO ] [MAIN ] ETR: Generated 1794 derivative records from 53220 primary records. [2025-09-29T22:08:34.046577] [DEBUG] [LOCAL ] ETR: Saving derivative data. [2025-09-29T22:08:34.072222] [DEBUG] [LOCAL ] ETV: Loaded 21450 existing records from primary storage. [2025-09-29T22:08:34.073884] [INFO ] [MAIN ] ETV: Loaded 21450 primary data records. [2025-09-29T22:08:34.117624] [DEBUG] [LOCAL ] ETW: Loaded 25073 existing records from primary storage. [2025-09-29T22:08:34.123189] [INFO ] [MAIN ] ETW: Loaded 25073 primary data records. [2025-09-29T22:08:34.123743] [DEBUG] [LOCAL ] ETR: Derivative data saved (1794 records). [2025-09-29T22:08:34.141188] [INFO ] [MAIN ] ETR: Successfully saved derivative data. [2025-09-29T22:08:34.193475] [INFO ] [MAIN ] Derivative Progress: 624/2057 symbols completed. ETR took 1.4s. Estimated remaining: 9m 43s. Rate: 147.5 symbols/min [2025-09-29T22:08:34.224327] [INFO ] [MAIN ] ETX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:34.781856] [DEBUG] [LOCAL ] ETX: Loaded 5023 existing records from primary storage. [2025-09-29T22:08:34.783833] [INFO ] [MAIN ] ETX: Loaded 5023 primary data records. [2025-09-29T22:08:35.139525] [DEBUG] [MAIN ] ETV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:35.141685] [INFO ] [MAIN ] ETV: Generated 1794 derivative records from 21450 primary records. [2025-09-29T22:08:35.142323] [DEBUG] [LOCAL ] ETV: Saving derivative data. [2025-09-29T22:08:35.164730] [DEBUG] [LOCAL ] ETV: Derivative data saved (1794 records). [2025-09-29T22:08:35.165920] [INFO ] [MAIN ] ETV: Successfully saved derivative data. [2025-09-29T22:08:35.182802] [INFO ] [MAIN ] Derivative Progress: 625/2057 symbols completed. ETV took 1.2s. Estimated remaining: 9m 44s. Rate: 147.1 symbols/min [2025-09-29T22:08:35.183714] [DEBUG] [MAIN ] ETW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:35.184267] [INFO ] [MAIN ] ETY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:35.185586] [INFO ] [MAIN ] ETW: Generated 1794 derivative records from 25073 primary records. [2025-09-29T22:08:35.185896] [DEBUG] [LOCAL ] ETW: Saving derivative data. [2025-09-29T22:08:35.205282] [DEBUG] [LOCAL ] ETW: Derivative data saved (1794 records). [2025-09-29T22:08:35.205734] [INFO ] [MAIN ] ETW: Successfully saved derivative data. [2025-09-29T22:08:35.208734] [INFO ] [MAIN ] Derivative Progress: 626/2057 symbols completed. ETW took 1.2s. Estimated remaining: 9m 43s. Rate: 147.4 symbols/min [2025-09-29T22:08:35.209036] [INFO ] [MAIN ] EVF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:35.236094] [DEBUG] [MAIN ] ETX: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:08:35.237038] [INFO ] [MAIN ] ETX: Generated 1793 derivative records from 5023 primary records. [2025-09-29T22:08:35.244459] [DEBUG] [LOCAL ] ETX: Saving derivative data. [2025-09-29T22:08:35.245043] [DEBUG] [LOCAL ] ETY: Loaded 22661 existing records from primary storage. [2025-09-29T22:08:35.250531] [INFO ] [MAIN ] ETY: Loaded 22661 primary data records. [2025-09-29T22:08:35.251263] [DEBUG] [LOCAL ] EVF: Loaded 9377 existing records from primary storage. [2025-09-29T22:08:35.263311] [INFO ] [MAIN ] EVF: Loaded 9377 primary data records. [2025-09-29T22:08:35.387927] [DEBUG] [LOCAL ] ETX: Derivative data saved (1793 records). [2025-09-29T22:08:35.448624] [INFO ] [MAIN ] ETX: Successfully saved derivative data. [2025-09-29T22:08:35.480050] [INFO ] [MAIN ] Derivative Progress: 627/2057 symbols completed. ETX took 1.3s. Estimated remaining: 9m 42s. Rate: 147.4 symbols/min [2025-09-29T22:08:35.492457] [INFO ] [MAIN ] EVH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:35.958173] [DEBUG] [LOCAL ] EVH: Loaded 49370 existing records from primary storage. [2025-09-29T22:08:35.958945] [INFO ] [MAIN ] EVH: Loaded 49370 primary data records. [2025-09-29T22:08:36.118059] [DEBUG] [MAIN ] EVF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:36.137622] [INFO ] [MAIN ] EVF: Generated 1794 derivative records from 9377 primary records. [2025-09-29T22:08:36.160716] [DEBUG] [LOCAL ] EVF: Saving derivative data. [2025-09-29T22:08:36.206954] [DEBUG] [MAIN ] ETY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:36.362418] [INFO ] [MAIN ] ETY: Generated 1794 derivative records from 22661 primary records. [2025-09-29T22:08:36.365597] [DEBUG] [LOCAL ] ETY: Saving derivative data. [2025-09-29T22:08:36.372108] [DEBUG] [LOCAL ] EVF: Derivative data saved (1794 records). [2025-09-29T22:08:36.385930] [INFO ] [MAIN ] EVF: Successfully saved derivative data. [2025-09-29T22:08:36.389030] [INFO ] [MAIN ] Derivative Progress: 628/2057 symbols completed. EVF took 1.2s. Estimated remaining: 9m 43s. Rate: 147.2 symbols/min [2025-09-29T22:08:36.396311] [DEBUG] [LOCAL ] ETY: Derivative data saved (1794 records). [2025-09-29T22:08:36.396551] [INFO ] [MAIN ] ETY: Successfully saved derivative data. [2025-09-29T22:08:36.399716] [INFO ] [MAIN ] Derivative Progress: 629/2057 symbols completed. ETY took 1.2s. Estimated remaining: 9m 41s. Rate: 147.4 symbols/min [2025-09-29T22:08:36.421605] [DEBUG] [MAIN ] EVH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:36.422349] [INFO ] [MAIN ] EVH: Generated 1794 derivative records from 49370 primary records. [2025-09-29T22:08:36.422417] [DEBUG] [LOCAL ] EVH: Saving derivative data. [2025-09-29T22:08:36.437992] [DEBUG] [LOCAL ] EVH: Derivative data saved (1794 records). [2025-09-29T22:08:36.438066] [INFO ] [MAIN ] EVH: Successfully saved derivative data. [2025-09-29T22:08:36.440388] [INFO ] [MAIN ] Derivative Progress: 630/2057 symbols completed. EVH took 0.9s. Estimated remaining: 9m 40s. Rate: 147.6 symbols/min [2025-09-29T22:08:36.440921] [INFO ] [MAIN ] EVN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:36.441026] [INFO ] [MAIN ] EVT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:36.440975] [INFO ] [MAIN ] EVR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:36.460291] [DEBUG] [LOCAL ] EVN: Loaded 11135 existing records from primary storage. [2025-09-29T22:08:36.460485] [INFO ] [MAIN ] EVN: Loaded 11135 primary data records. [2025-09-29T22:08:36.534697] [DEBUG] [LOCAL ] EVT: Loaded 16958 existing records from primary storage. [2025-09-29T22:08:36.568260] [INFO ] [MAIN ] EVT: Loaded 16958 primary data records. [2025-09-29T22:08:36.800307] [DEBUG] [LOCAL ] EVR: Loaded 35058 existing records from primary storage. [2025-09-29T22:08:36.867242] [INFO ] [MAIN ] EVR: Loaded 35058 primary data records. [2025-09-29T22:08:37.517124] [DEBUG] [MAIN ] EVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:37.516413] [DEBUG] [MAIN ] EVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:37.519226] [INFO ] [MAIN ] EVN: Generated 1794 derivative records from 11135 primary records. [2025-09-29T22:08:37.519321] [DEBUG] [LOCAL ] EVN: Saving derivative data. [2025-09-29T22:08:37.518563] [INFO ] [MAIN ] EVT: Generated 1794 derivative records from 16958 primary records. [2025-09-29T22:08:37.520420] [DEBUG] [LOCAL ] EVT: Saving derivative data. [2025-09-29T22:08:37.548158] [DEBUG] [LOCAL ] EVN: Derivative data saved (1794 records). [2025-09-29T22:08:37.552604] [DEBUG] [LOCAL ] EVT: Derivative data saved (1794 records). [2025-09-29T22:08:37.552944] [INFO ] [MAIN ] EVN: Successfully saved derivative data. [2025-09-29T22:08:37.553003] [INFO ] [MAIN ] EVT: Successfully saved derivative data. [2025-09-29T22:08:37.555431] [INFO ] [MAIN ] Derivative Progress: 631/2057 symbols completed. EVN took 1.1s. Estimated remaining: 9m 41s. Rate: 147.2 symbols/min [2025-09-29T22:08:37.558709] [INFO ] [MAIN ] EVTC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:37.558918] [INFO ] [MAIN ] Derivative Progress: 632/2057 symbols completed. EVT took 1.1s. Estimated remaining: 9m 40s. Rate: 147.4 symbols/min [2025-09-29T22:08:37.559563] [INFO ] [MAIN ] EVTL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:37.581171] [DEBUG] [MAIN ] EVR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:37.582002] [INFO ] [MAIN ] EVR: Generated 1794 derivative records from 35058 primary records. [2025-09-29T22:08:37.582158] [DEBUG] [LOCAL ] EVR: Saving derivative data. [2025-09-29T22:08:37.627873] [DEBUG] [LOCAL ] EVR: Derivative data saved (1794 records). [2025-09-29T22:08:37.629161] [INFO ] [MAIN ] EVR: Successfully saved derivative data. [2025-09-29T22:08:37.629781] [DEBUG] [LOCAL ] EVTC: Loaded 26254 existing records from primary storage. [2025-09-29T22:08:37.632672] [INFO ] [MAIN ] Derivative Progress: 633/2057 symbols completed. EVR took 1.2s. Estimated remaining: 9m 39s. Rate: 147.6 symbols/min [2025-09-29T22:08:37.633123] [INFO ] [MAIN ] EVTR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:37.633009] [INFO ] [MAIN ] EVTC: Loaded 26254 primary data records. [2025-09-29T22:08:37.758111] [DEBUG] [LOCAL ] EVTL: Loaded 37802 existing records from primary storage. [2025-09-29T22:08:37.764071] [INFO ] [MAIN ] EVTL: Loaded 37802 primary data records. [2025-09-29T22:08:37.918905] [DEBUG] [LOCAL ] EVTR: Loaded 23510 existing records from primary storage. [2025-09-29T22:08:37.944361] [INFO ] [MAIN ] EVTR: Loaded 23510 primary data records. [2025-09-29T22:08:38.718984] [DEBUG] [MAIN ] EVTC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:38.719992] [INFO ] [MAIN ] EVTC: Generated 1794 derivative records from 26254 primary records. [2025-09-29T22:08:38.720370] [DEBUG] [LOCAL ] EVTC: Saving derivative data. [2025-09-29T22:08:38.739401] [DEBUG] [LOCAL ] EVTC: Derivative data saved (1794 records). [2025-09-29T22:08:38.741395] [INFO ] [MAIN ] EVTC: Successfully saved derivative data. [2025-09-29T22:08:38.743426] [INFO ] [MAIN ] Derivative Progress: 634/2057 symbols completed. EVTC took 1.2s. Estimated remaining: 9m 40s. Rate: 147.2 symbols/min [2025-09-29T22:08:38.743681] [INFO ] [MAIN ] EW: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:38.763969] [DEBUG] [MAIN ] EVTL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:38.765264] [INFO ] [MAIN ] EVTL: Generated 1794 derivative records from 37802 primary records. [2025-09-29T22:08:38.765404] [DEBUG] [LOCAL ] EVTL: Saving derivative data. [2025-09-29T22:08:38.804807] [DEBUG] [MAIN ] EVTR: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:08:38.806567] [INFO ] [MAIN ] EVTR: Generated 1793 derivative records from 23510 primary records. [2025-09-29T22:08:38.806754] [DEBUG] [LOCAL ] EVTL: Derivative data saved (1794 records). [2025-09-29T22:08:38.806812] [DEBUG] [LOCAL ] EVTR: Saving derivative data. [2025-09-29T22:08:38.807697] [INFO ] [MAIN ] EVTL: Successfully saved derivative data. [2025-09-29T22:08:38.810674] [INFO ] [MAIN ] Derivative Progress: 635/2057 symbols completed. EVTL took 1.3s. Estimated remaining: 9m 39s. Rate: 147.4 symbols/min [2025-09-29T22:08:38.811231] [INFO ] [MAIN ] EXG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:38.829362] [DEBUG] [LOCAL ] EVTR: Derivative data saved (1793 records). [2025-09-29T22:08:38.829748] [INFO ] [MAIN ] EVTR: Successfully saved derivative data. [2025-09-29T22:08:38.832181] [INFO ] [MAIN ] Derivative Progress: 636/2057 symbols completed. EVTR took 1.2s. Estimated remaining: 9m 38s. Rate: 147.6 symbols/min [2025-09-29T22:08:38.832511] [INFO ] [MAIN ] EXK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:38.871677] [DEBUG] [LOCAL ] EW: Loaded 53397 existing records from primary storage. [2025-09-29T22:08:38.871896] [INFO ] [MAIN ] EW: Loaded 53397 primary data records. [2025-09-29T22:08:39.037922] [DEBUG] [LOCAL ] EXG: Loaded 34119 existing records from primary storage. [2025-09-29T22:08:39.078027] [INFO ] [MAIN ] EXG: Loaded 34119 primary data records. [2025-09-29T22:08:39.317831] [DEBUG] [LOCAL ] EXK: Loaded 53126 existing records from primary storage. [2025-09-29T22:08:39.336045] [INFO ] [MAIN ] EXK: Loaded 53126 primary data records. [2025-09-29T22:08:39.963848] [DEBUG] [MAIN ] EW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:39.965211] [INFO ] [MAIN ] EW: Generated 1794 derivative records from 53397 primary records. [2025-09-29T22:08:39.965573] [DEBUG] [LOCAL ] EW: Saving derivative data. [2025-09-29T22:08:39.991108] [DEBUG] [LOCAL ] EW: Derivative data saved (1794 records). [2025-09-29T22:08:39.999518] [INFO ] [MAIN ] EW: Successfully saved derivative data. [2025-09-29T22:08:40.007257] [INFO ] [MAIN ] Derivative Progress: 637/2057 symbols completed. EW took 1.3s. Estimated remaining: 9m 39s. Rate: 147.2 symbols/min [2025-09-29T22:08:40.007942] [INFO ] [MAIN ] EXP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:40.007774] [DEBUG] [MAIN ] EXG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:40.009683] [INFO ] [MAIN ] EXG: Generated 1794 derivative records from 34119 primary records. [2025-09-29T22:08:40.010462] [DEBUG] [LOCAL ] EXG: Saving derivative data. [2025-09-29T22:08:40.031556] [DEBUG] [LOCAL ] EXG: Derivative data saved (1794 records). [2025-09-29T22:08:40.032245] [INFO ] [MAIN ] EXG: Successfully saved derivative data. [2025-09-29T22:08:40.047618] [INFO ] [MAIN ] Derivative Progress: 638/2057 symbols completed. EXG took 1.2s. Estimated remaining: 9m 38s. Rate: 147.4 symbols/min [2025-09-29T22:08:40.048501] [INFO ] [MAIN ] EXPD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:40.048348] [DEBUG] [MAIN ] EXK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:40.050074] [INFO ] [MAIN ] EXK: Generated 1794 derivative records from 53126 primary records. [2025-09-29T22:08:40.050327] [DEBUG] [LOCAL ] EXK: Saving derivative data. [2025-09-29T22:08:40.075903] [DEBUG] [LOCAL ] EXK: Derivative data saved (1794 records). [2025-09-29T22:08:40.076096] [INFO ] [MAIN ] EXK: Successfully saved derivative data. [2025-09-29T22:08:40.079437] [INFO ] [MAIN ] Derivative Progress: 639/2057 symbols completed. EXK took 1.2s. Estimated remaining: 9m 36s. Rate: 147.6 symbols/min [2025-09-29T22:08:40.079835] [INFO ] [MAIN ] EXR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:40.091471] [DEBUG] [LOCAL ] EXP: Loaded 29703 existing records from primary storage. [2025-09-29T22:08:40.091676] [INFO ] [MAIN ] EXP: Loaded 29703 primary data records. [2025-09-29T22:08:40.430709] [DEBUG] [LOCAL ] EXPD: Loaded 48037 existing records from primary storage. [2025-09-29T22:08:40.445704] [INFO ] [MAIN ] EXPD: Loaded 48037 primary data records. [2025-09-29T22:08:40.530071] [DEBUG] [LOCAL ] EXR: Loaded 45310 existing records from primary storage. [2025-09-29T22:08:40.546039] [INFO ] [MAIN ] EXR: Loaded 45310 primary data records. [2025-09-29T22:08:41.220484] [DEBUG] [MAIN ] EXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:41.222281] [INFO ] [MAIN ] EXP: Generated 1794 derivative records from 29703 primary records. [2025-09-29T22:08:41.222462] [DEBUG] [LOCAL ] EXP: Saving derivative data. [2025-09-29T22:08:41.244578] [DEBUG] [LOCAL ] EXP: Derivative data saved (1794 records). [2025-09-29T22:08:41.244879] [INFO ] [MAIN ] EXP: Successfully saved derivative data. [2025-09-29T22:08:41.247906] [INFO ] [MAIN ] Derivative Progress: 640/2057 symbols completed. EXP took 1.2s. Estimated remaining: 9m 38s. Rate: 147.2 symbols/min [2025-09-29T22:08:41.248540] [INFO ] [MAIN ] F: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:41.272502] [DEBUG] [MAIN ] EXPD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:41.273434] [INFO ] [MAIN ] EXPD: Generated 1794 derivative records from 48037 primary records. [2025-09-29T22:08:41.274114] [DEBUG] [LOCAL ] EXPD: Saving derivative data. [2025-09-29T22:08:41.295772] [DEBUG] [LOCAL ] EXPD: Derivative data saved (1794 records). [2025-09-29T22:08:41.296141] [INFO ] [MAIN ] EXPD: Successfully saved derivative data. [2025-09-29T22:08:41.311286] [INFO ] [MAIN ] Derivative Progress: 641/2057 symbols completed. EXPD took 1.3s. Estimated remaining: 9m 37s. Rate: 147.4 symbols/min [2025-09-29T22:08:41.311746] [INFO ] [MAIN ] FAF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:41.312511] [DEBUG] [MAIN ] EXR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:41.313957] [INFO ] [MAIN ] EXR: Generated 1794 derivative records from 45310 primary records. [2025-09-29T22:08:41.314092] [DEBUG] [LOCAL ] EXR: Saving derivative data. [2025-09-29T22:08:41.345977] [DEBUG] [LOCAL ] EXR: Derivative data saved (1794 records). [2025-09-29T22:08:41.346201] [INFO ] [MAIN ] EXR: Successfully saved derivative data. [2025-09-29T22:08:41.349838] [INFO ] [MAIN ] Derivative Progress: 642/2057 symbols completed. EXR took 1.3s. Estimated remaining: 9m 35s. Rate: 147.6 symbols/min [2025-09-29T22:08:41.350099] [INFO ] [MAIN ] FBIN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:41.369498] [DEBUG] [LOCAL ] F: Loaded 53820 existing records from primary storage. [2025-09-29T22:08:41.370063] [INFO ] [MAIN ] F: Loaded 53820 primary data records. [2025-09-29T22:08:41.529722] [DEBUG] [LOCAL ] FAF: Loaded 41799 existing records from primary storage. [2025-09-29T22:08:41.544308] [INFO ] [MAIN ] FAF: Loaded 41799 primary data records. [2025-09-29T22:08:41.869708] [DEBUG] [LOCAL ] FBIN: Loaded 50319 existing records from primary storage. [2025-09-29T22:08:41.892071] [INFO ] [MAIN ] FBIN: Loaded 50319 primary data records. [2025-09-29T22:08:42.439115] [DEBUG] [MAIN ] F: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:42.441545] [INFO ] [MAIN ] F: Generated 1794 derivative records from 53820 primary records. [2025-09-29T22:08:42.441787] [DEBUG] [LOCAL ] F: Saving derivative data. [2025-09-29T22:08:42.461665] [DEBUG] [LOCAL ] F: Derivative data saved (1794 records). [2025-09-29T22:08:42.463596] [INFO ] [MAIN ] F: Successfully saved derivative data. [2025-09-29T22:08:42.467001] [INFO ] [MAIN ] Derivative Progress: 643/2057 symbols completed. F took 1.2s. Estimated remaining: 9m 36s. Rate: 147.2 symbols/min [2025-09-29T22:08:42.489365] [DEBUG] [MAIN ] FAF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:42.490917] [INFO ] [MAIN ] FAF: Generated 1794 derivative records from 41799 primary records. [2025-09-29T22:08:42.491059] [DEBUG] [LOCAL ] FAF: Saving derivative data. [2025-09-29T22:08:42.512021] [DEBUG] [LOCAL ] FAF: Derivative data saved (1794 records). [2025-09-29T22:08:42.512136] [INFO ] [MAIN ] FAF: Successfully saved derivative data. [2025-09-29T22:08:42.515768] [INFO ] [MAIN ] Derivative Progress: 644/2057 symbols completed. FAF took 1.2s. Estimated remaining: 9m 35s. Rate: 147.4 symbols/min [2025-09-29T22:08:42.529681] [DEBUG] [MAIN ] FBIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:42.530450] [INFO ] [MAIN ] FBIN: Generated 1794 derivative records from 50319 primary records. [2025-09-29T22:08:42.530518] [DEBUG] [LOCAL ] FBIN: Saving derivative data. [2025-09-29T22:08:42.546579] [DEBUG] [LOCAL ] FBIN: Derivative data saved (1794 records). [2025-09-29T22:08:42.546690] [INFO ] [MAIN ] FBIN: Successfully saved derivative data. [2025-09-29T22:08:42.549481] [INFO ] [MAIN ] Derivative Progress: 645/2057 symbols completed. FBIN took 1.2s. Estimated remaining: 9m 34s. Rate: 147.6 symbols/min [2025-09-29T22:08:42.550365] [INFO ] [MAIN ] FCF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:42.550105] [INFO ] [MAIN ] FBRT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:42.550268] [INFO ] [MAIN ] FC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:42.571632] [DEBUG] [LOCAL ] FC: Loaded 15423 existing records from primary storage. [2025-09-29T22:08:42.571963] [INFO ] [MAIN ] FC: Loaded 15423 primary data records. [2025-09-29T22:08:42.769046] [DEBUG] [LOCAL ] FCF: Loaded 39462 existing records from primary storage. [2025-09-29T22:08:42.772917] [DEBUG] [LOCAL ] FBRT: Loaded 34454 existing records from primary storage. [2025-09-29T22:08:42.790820] [INFO ] [MAIN ] FCF: Loaded 39462 primary data records. [2025-09-29T22:08:42.820219] [INFO ] [MAIN ] FBRT: Loaded 34454 primary data records. [2025-09-29T22:08:43.682457] [DEBUG] [MAIN ] FC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:43.684192] [INFO ] [MAIN ] FC: Generated 1794 derivative records from 15423 primary records. [2025-09-29T22:08:43.684569] [DEBUG] [LOCAL ] FC: Saving derivative data. [2025-09-29T22:08:43.704324] [DEBUG] [LOCAL ] FC: Derivative data saved (1794 records). [2025-09-29T22:08:43.705736] [INFO ] [MAIN ] FC: Successfully saved derivative data. [2025-09-29T22:08:43.708103] [INFO ] [MAIN ] Derivative Progress: 646/2057 symbols completed. FC took 1.2s. Estimated remaining: 9m 35s. Rate: 147.2 symbols/min [2025-09-29T22:08:43.708703] [INFO ] [MAIN ] FCPT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:43.727535] [DEBUG] [MAIN ] FCF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:43.728464] [INFO ] [MAIN ] FCF: Generated 1794 derivative records from 39462 primary records. [2025-09-29T22:08:43.728749] [DEBUG] [LOCAL ] FCF: Saving derivative data. [2025-09-29T22:08:43.774639] [DEBUG] [LOCAL ] FCF: Derivative data saved (1794 records). [2025-09-29T22:08:43.765030] [DEBUG] [MAIN ] FBRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:43.776199] [INFO ] [MAIN ] FCF: Successfully saved derivative data. [2025-09-29T22:08:43.776055] [INFO ] [MAIN ] FBRT: Generated 1794 derivative records from 34454 primary records. [2025-09-29T22:08:43.779154] [INFO ] [MAIN ] Derivative Progress: 647/2057 symbols completed. FCF took 1.2s. Estimated remaining: 9m 34s. Rate: 147.4 symbols/min [2025-09-29T22:08:43.779348] [DEBUG] [LOCAL ] FBRT: Saving derivative data. [2025-09-29T22:08:43.779537] [INFO ] [MAIN ] FCT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:43.812219] [DEBUG] [LOCAL ] FCPT: Loaded 37247 existing records from primary storage. [2025-09-29T22:08:43.816912] [INFO ] [MAIN ] FCPT: Loaded 37247 primary data records. [2025-09-29T22:08:43.859708] [DEBUG] [LOCAL ] FCT: Loaded 14519 existing records from primary storage. [2025-09-29T22:08:43.859506] [DEBUG] [LOCAL ] FBRT: Derivative data saved (1794 records). [2025-09-29T22:08:43.889930] [INFO ] [MAIN ] FBRT: Successfully saved derivative data. [2025-09-29T22:08:43.890103] [INFO ] [MAIN ] FCT: Loaded 14519 primary data records. [2025-09-29T22:08:43.923893] [INFO ] [MAIN ] Derivative Progress: 648/2057 symbols completed. FBRT took 1.4s. Estimated remaining: 9m 33s. Rate: 147.5 symbols/min [2025-09-29T22:08:43.964152] [INFO ] [MAIN ] FCX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:44.580876] [DEBUG] [LOCAL ] FCX: Loaded 53700 existing records from primary storage. [2025-09-29T22:08:44.587441] [INFO ] [MAIN ] FCX: Loaded 53700 primary data records. [2025-09-29T22:08:44.587179] [DEBUG] [MAIN ] FCPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:44.600850] [INFO ] [MAIN ] FCPT: Generated 1794 derivative records from 37247 primary records. [2025-09-29T22:08:44.621993] [DEBUG] [LOCAL ] FCPT: Saving derivative data. [2025-09-29T22:08:44.788339] [DEBUG] [MAIN ] FCT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:44.828113] [DEBUG] [LOCAL ] FCPT: Derivative data saved (1794 records). [2025-09-29T22:08:44.950847] [INFO ] [MAIN ] FCPT: Successfully saved derivative data. [2025-09-29T22:08:44.968161] [INFO ] [MAIN ] Derivative Progress: 649/2057 symbols completed. FCPT took 1.3s. Estimated remaining: 9m 34s. Rate: 147.1 symbols/min [2025-09-29T22:08:44.879776] [INFO ] [MAIN ] FCT: Generated 1794 derivative records from 14519 primary records. [2025-09-29T22:08:44.968476] [INFO ] [MAIN ] FDP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:44.968979] [DEBUG] [LOCAL ] FCT: Saving derivative data. [2025-09-29T22:08:44.988592] [DEBUG] [LOCAL ] FCT: Derivative data saved (1794 records). [2025-09-29T22:08:44.989451] [INFO ] [MAIN ] FCT: Successfully saved derivative data. [2025-09-29T22:08:44.992448] [INFO ] [MAIN ] Derivative Progress: 650/2057 symbols completed. FCT took 1.2s. Estimated remaining: 9m 33s. Rate: 147.4 symbols/min [2025-09-29T22:08:44.992801] [INFO ] [MAIN ] FDS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:45.036696] [DEBUG] [MAIN ] FCX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:45.053384] [INFO ] [MAIN ] FCX: Generated 1794 derivative records from 53700 primary records. [2025-09-29T22:08:45.055679] [DEBUG] [LOCAL ] FCX: Saving derivative data. [2025-09-29T22:08:45.056115] [DEBUG] [LOCAL ] FDS: Loaded 26449 existing records from primary storage. [2025-09-29T22:08:45.057053] [DEBUG] [LOCAL ] FDP: Loaded 30255 existing records from primary storage. [2025-09-29T22:08:45.057971] [INFO ] [MAIN ] FDS: Loaded 26449 primary data records. [2025-09-29T22:08:45.058354] [INFO ] [MAIN ] FDP: Loaded 30255 primary data records. [2025-09-29T22:08:45.329461] [DEBUG] [LOCAL ] FCX: Derivative data saved (1794 records). [2025-09-29T22:08:45.374183] [INFO ] [MAIN ] FCX: Successfully saved derivative data. [2025-09-29T22:08:45.569703] [INFO ] [MAIN ] Derivative Progress: 651/2057 symbols completed. FCX took 1.6s. Estimated remaining: 9m 33s. Rate: 147.3 symbols/min [2025-09-29T22:08:45.772482] [INFO ] [MAIN ] FE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:45.823524] [DEBUG] [MAIN ] FDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:45.823171] [DEBUG] [MAIN ] FDP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:45.824781] [INFO ] [MAIN ] FDS: Generated 1794 derivative records from 26449 primary records. [2025-09-29T22:08:45.825522] [INFO ] [MAIN ] FDP: Generated 1794 derivative records from 30255 primary records. [2025-09-29T22:08:45.825772] [DEBUG] [LOCAL ] FDS: Saving derivative data. [2025-09-29T22:08:45.825913] [DEBUG] [LOCAL ] FDP: Saving derivative data. [2025-09-29T22:08:45.890514] [DEBUG] [LOCAL ] FDS: Derivative data saved (1794 records). [2025-09-29T22:08:45.890195] [DEBUG] [LOCAL ] FDP: Derivative data saved (1794 records). [2025-09-29T22:08:45.890739] [INFO ] [MAIN ] FDP: Successfully saved derivative data. [2025-09-29T22:08:45.890859] [INFO ] [MAIN ] FDS: Successfully saved derivative data. [2025-09-29T22:08:45.893452] [INFO ] [MAIN ] Derivative Progress: 652/2057 symbols completed. FDP took 0.9s. Estimated remaining: 9m 32s. Rate: 147.3 symbols/min [2025-09-29T22:08:45.896001] [INFO ] [MAIN ] FERG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:45.896087] [INFO ] [MAIN ] Derivative Progress: 653/2057 symbols completed. FDS took 0.9s. Estimated remaining: 9m 31s. Rate: 147.5 symbols/min [2025-09-29T22:08:45.896742] [INFO ] [MAIN ] FET: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:45.900125] [DEBUG] [LOCAL ] FE: Loaded 53427 existing records from primary storage. [2025-09-29T22:08:45.900458] [INFO ] [MAIN ] FE: Loaded 53427 primary data records. [2025-09-29T22:08:46.021229] [DEBUG] [LOCAL ] FET: Loaded 12877 existing records from primary storage. [2025-09-29T22:08:46.021609] [INFO ] [MAIN ] FET: Loaded 12877 primary data records. [2025-09-29T22:08:46.585787] [DEBUG] [LOCAL ] FERG: Loaded 48889 existing records from primary storage. [2025-09-29T22:08:46.602044] [INFO ] [MAIN ] FERG: Loaded 48889 primary data records. [2025-09-29T22:08:46.968831] [DEBUG] [MAIN ] FE: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:08:46.971892] [INFO ] [MAIN ] FE: Generated 1793 derivative records from 53427 primary records. [2025-09-29T22:08:46.972248] [DEBUG] [LOCAL ] FE: Saving derivative data. [2025-09-29T22:08:46.999925] [DEBUG] [LOCAL ] FE: Derivative data saved (1793 records). [2025-09-29T22:08:47.003430] [INFO ] [MAIN ] FE: Successfully saved derivative data. [2025-09-29T22:08:47.008685] [INFO ] [MAIN ] Derivative Progress: 654/2057 symbols completed. FE took 1.2s. Estimated remaining: 9m 32s. Rate: 147.1 symbols/min [2025-09-29T22:08:47.010024] [INFO ] [MAIN ] FF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:47.027097] [DEBUG] [MAIN ] FET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:47.028021] [INFO ] [MAIN ] FET: Generated 1794 derivative records from 12877 primary records. [2025-09-29T22:08:47.028463] [DEBUG] [LOCAL ] FET: Saving derivative data. [2025-09-29T22:08:47.055170] [DEBUG] [LOCAL ] FET: Derivative data saved (1794 records). [2025-09-29T22:08:47.055369] [INFO ] [MAIN ] FET: Successfully saved derivative data. [2025-09-29T22:08:47.058939] [INFO ] [MAIN ] Derivative Progress: 655/2057 symbols completed. FET took 1.2s. Estimated remaining: 9m 31s. Rate: 147.3 symbols/min [2025-09-29T22:08:47.059511] [INFO ] [MAIN ] FFC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:47.086204] [DEBUG] [MAIN ] FERG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:47.087306] [INFO ] [MAIN ] FERG: Generated 1794 derivative records from 48889 primary records. [2025-09-29T22:08:47.087530] [DEBUG] [LOCAL ] FERG: Saving derivative data. [2025-09-29T22:08:47.114577] [DEBUG] [LOCAL ] FERG: Derivative data saved (1794 records). [2025-09-29T22:08:47.114876] [INFO ] [MAIN ] FERG: Successfully saved derivative data. [2025-09-29T22:08:47.115452] [DEBUG] [LOCAL ] FF: Loaded 25233 existing records from primary storage. [2025-09-29T22:08:47.117879] [INFO ] [MAIN ] Derivative Progress: 656/2057 symbols completed. FERG took 1.2s. Estimated remaining: 9m 30s. Rate: 147.5 symbols/min [2025-09-29T22:08:47.118256] [INFO ] [MAIN ] FF: Loaded 25233 primary data records. [2025-09-29T22:08:47.131492] [INFO ] [MAIN ] FFWM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:47.235796] [DEBUG] [LOCAL ] FFC: Loaded 16759 existing records from primary storage. [2025-09-29T22:08:47.239928] [INFO ] [MAIN ] FFC: Loaded 16759 primary data records. [2025-09-29T22:08:47.666263] [DEBUG] [LOCAL ] FFWM: Loaded 35823 existing records from primary storage. [2025-09-29T22:08:47.666769] [INFO ] [MAIN ] FFWM: Loaded 35823 primary data records. [2025-09-29T22:08:48.237438] [DEBUG] [MAIN ] FF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:48.238468] [INFO ] [MAIN ] FF: Generated 1794 derivative records from 25233 primary records. [2025-09-29T22:08:48.239214] [DEBUG] [LOCAL ] FF: Saving derivative data. [2025-09-29T22:08:48.271970] [DEBUG] [LOCAL ] FF: Derivative data saved (1794 records). [2025-09-29T22:08:48.272677] [INFO ] [MAIN ] FF: Successfully saved derivative data. [2025-09-29T22:08:48.272983] [DEBUG] [MAIN ] FFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:48.276290] [INFO ] [MAIN ] Derivative Progress: 657/2057 symbols completed. FF took 1.3s. Estimated remaining: 9m 31s. Rate: 147.1 symbols/min [2025-09-29T22:08:48.276498] [INFO ] [MAIN ] FGN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:48.274148] [INFO ] [MAIN ] FFC: Generated 1794 derivative records from 16759 primary records. [2025-09-29T22:08:48.277017] [DEBUG] [LOCAL ] FFC: Saving derivative data. [2025-09-29T22:08:48.295921] [DEBUG] [LOCAL ] FFC: Derivative data saved (1794 records). [2025-09-29T22:08:48.298684] [DEBUG] [LOCAL ] FGN: Loaded 3865 existing records from primary storage. [2025-09-29T22:08:48.298997] [INFO ] [MAIN ] FFC: Successfully saved derivative data. [2025-09-29T22:08:48.300177] [INFO ] [MAIN ] FGN: Loaded 3865 primary data records. [2025-09-29T22:08:48.303370] [INFO ] [MAIN ] Derivative Progress: 658/2057 symbols completed. FFC took 1.2s. Estimated remaining: 9m 30s. Rate: 147.3 symbols/min [2025-09-29T22:08:48.412798] [DEBUG] [MAIN ] FFWM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:48.424388] [INFO ] [MAIN ] FFWM: Generated 1794 derivative records from 35823 primary records. [2025-09-29T22:08:48.424863] [DEBUG] [LOCAL ] FFWM: Saving derivative data. [2025-09-29T22:08:48.500001] [DEBUG] [LOCAL ] FFWM: Derivative data saved (1794 records). [2025-09-29T22:08:48.522436] [INFO ] [MAIN ] FFWM: Successfully saved derivative data. [2025-09-29T22:08:48.554479] [INFO ] [MAIN ] Derivative Progress: 659/2057 symbols completed. FFWM took 1.4s. Estimated remaining: 9m 29s. Rate: 147.4 symbols/min [2025-09-29T22:08:48.675170] [DEBUG] [MAIN ] FGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:48.675940] [INFO ] [MAIN ] FGN: Generated 1794 derivative records from 3865 primary records. [2025-09-29T22:08:48.676007] [DEBUG] [LOCAL ] FGN: Saving derivative data. [2025-09-29T22:08:48.691413] [DEBUG] [LOCAL ] FGN: Derivative data saved (1794 records). [2025-09-29T22:08:48.691517] [INFO ] [MAIN ] FGN: Successfully saved derivative data. [2025-09-29T22:08:48.693589] [INFO ] [MAIN ] Derivative Progress: 660/2057 symbols completed. FGN took 0.4s. Estimated remaining: 9m 28s. Rate: 147.6 symbols/min [2025-09-29T22:08:48.694852] [INFO ] [MAIN ] FICO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:48.694712] [INFO ] [MAIN ] FHN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:48.695102] [INFO ] [MAIN ] FI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:48.722695] [DEBUG] [LOCAL ] FICO: Loaded 20330 existing records from primary storage. [2025-09-29T22:08:48.722947] [INFO ] [MAIN ] FICO: Loaded 20330 primary data records. [2025-09-29T22:08:49.063004] [DEBUG] [LOCAL ] FI: Loaded 53497 existing records from primary storage. [2025-09-29T22:08:49.115037] [INFO ] [MAIN ] FI: Loaded 53497 primary data records. [2025-09-29T22:08:49.109750] [DEBUG] [LOCAL ] FHN: Loaded 53366 existing records from primary storage. [2025-09-29T22:08:49.123949] [INFO ] [MAIN ] FHN: Loaded 53366 primary data records. [2025-09-29T22:08:49.859562] [DEBUG] [MAIN ] FICO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:49.862748] [INFO ] [MAIN ] FICO: Generated 1794 derivative records from 20330 primary records. [2025-09-29T22:08:49.863042] [DEBUG] [LOCAL ] FICO: Saving derivative data. [2025-09-29T22:08:49.883718] [DEBUG] [LOCAL ] FICO: Derivative data saved (1794 records). [2025-09-29T22:08:49.884681] [INFO ] [MAIN ] FICO: Successfully saved derivative data. [2025-09-29T22:08:49.886954] [INFO ] [MAIN ] Derivative Progress: 661/2057 symbols completed. FICO took 1.2s. Estimated remaining: 9m 29s. Rate: 147.1 symbols/min [2025-09-29T22:08:49.887534] [INFO ] [MAIN ] FIGS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:49.926912] [DEBUG] [MAIN ] FI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:49.929310] [INFO ] [MAIN ] FI: Generated 1794 derivative records from 53497 primary records. [2025-09-29T22:08:49.929456] [DEBUG] [LOCAL ] FI: Saving derivative data. [2025-09-29T22:08:49.927958] [DEBUG] [MAIN ] FHN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:49.930723] [INFO ] [MAIN ] FHN: Generated 1794 derivative records from 53366 primary records. [2025-09-29T22:08:49.931620] [DEBUG] [LOCAL ] FHN: Saving derivative data. [2025-09-29T22:08:49.981108] [DEBUG] [LOCAL ] FI: Derivative data saved (1794 records). [2025-09-29T22:08:49.981573] [INFO ] [MAIN ] FI: Successfully saved derivative data. [2025-09-29T22:08:49.981260] [DEBUG] [LOCAL ] FHN: Derivative data saved (1794 records). [2025-09-29T22:08:49.984137] [INFO ] [MAIN ] FHN: Successfully saved derivative data. [2025-09-29T22:08:49.984031] [INFO ] [MAIN ] Derivative Progress: 662/2057 symbols completed. FI took 1.3s. Estimated remaining: 9m 28s. Rate: 147.3 symbols/min [2025-09-29T22:08:49.984394] [INFO ] [MAIN ] FIHL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:49.987609] [INFO ] [MAIN ] Derivative Progress: 663/2057 symbols completed. FHN took 1.3s. Estimated remaining: 9m 27s. Rate: 147.5 symbols/min [2025-09-29T22:08:49.988562] [INFO ] [MAIN ] FINS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:50.007421] [DEBUG] [LOCAL ] FIGS: Loaded 48861 existing records from primary storage. [2025-09-29T22:08:50.009687] [INFO ] [MAIN ] FIGS: Loaded 48861 primary data records. [2025-09-29T22:08:50.096602] [DEBUG] [LOCAL ] FINS: Loaded 8262 existing records from primary storage. [2025-09-29T22:08:50.113476] [INFO ] [MAIN ] FINS: Loaded 8262 primary data records. [2025-09-29T22:08:50.382967] [DEBUG] [LOCAL ] FIHL: Loaded 39998 existing records from primary storage. [2025-09-29T22:08:50.539684] [INFO ] [MAIN ] FIHL: Loaded 39998 primary data records. [2025-09-29T22:08:51.044376] [DEBUG] [MAIN ] FIGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:51.045424] [INFO ] [MAIN ] FIGS: Generated 1794 derivative records from 48861 primary records. [2025-09-29T22:08:51.045636] [DEBUG] [LOCAL ] FIGS: Saving derivative data. [2025-09-29T22:08:51.077453] [DEBUG] [MAIN ] FINS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:51.078782] [INFO ] [MAIN ] FINS: Generated 1794 derivative records from 8262 primary records. [2025-09-29T22:08:51.079120] [DEBUG] [LOCAL ] FINS: Saving derivative data. [2025-09-29T22:08:51.082158] [DEBUG] [LOCAL ] FIGS: Derivative data saved (1794 records). [2025-09-29T22:08:51.082404] [INFO ] [MAIN ] FIGS: Successfully saved derivative data. [2025-09-29T22:08:51.085368] [INFO ] [MAIN ] Derivative Progress: 664/2057 symbols completed. FIGS took 1.2s. Estimated remaining: 9m 28s. Rate: 147.1 symbols/min [2025-09-29T22:08:51.092823] [INFO ] [MAIN ] FINV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:51.105847] [DEBUG] [LOCAL ] FINS: Derivative data saved (1794 records). [2025-09-29T22:08:51.106116] [INFO ] [MAIN ] FINS: Successfully saved derivative data. [2025-09-29T22:08:51.108466] [INFO ] [MAIN ] Derivative Progress: 665/2057 symbols completed. FINS took 1.1s. Estimated remaining: 9m 27s. Rate: 147.4 symbols/min [2025-09-29T22:08:51.108805] [INFO ] [MAIN ] FIS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:51.127126] [DEBUG] [MAIN ] FIHL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:51.127987] [INFO ] [MAIN ] FIHL: Generated 1794 derivative records from 39998 primary records. [2025-09-29T22:08:51.128143] [DEBUG] [LOCAL ] FIHL: Saving derivative data. [2025-09-29T22:08:51.146888] [DEBUG] [LOCAL ] FIHL: Derivative data saved (1794 records). [2025-09-29T22:08:51.160321] [INFO ] [MAIN ] FIHL: Successfully saved derivative data. [2025-09-29T22:08:51.163299] [INFO ] [MAIN ] Derivative Progress: 666/2057 symbols completed. FIHL took 1.2s. Estimated remaining: 9m 26s. Rate: 147.5 symbols/min [2025-09-29T22:08:51.163785] [INFO ] [MAIN ] FIX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:51.197321] [DEBUG] [LOCAL ] FINV: Loaded 45191 existing records from primary storage. [2025-09-29T22:08:51.197731] [INFO ] [MAIN ] FINV: Loaded 45191 primary data records. [2025-09-29T22:08:51.326801] [DEBUG] [LOCAL ] FIS: Loaded 53364 existing records from primary storage. [2025-09-29T22:08:51.331468] [INFO ] [MAIN ] FIS: Loaded 53364 primary data records. [2025-09-29T22:08:51.441098] [DEBUG] [LOCAL ] FIX: Loaded 30013 existing records from primary storage. [2025-09-29T22:08:51.503636] [INFO ] [MAIN ] FIX: Loaded 30013 primary data records. [2025-09-29T22:08:52.379533] [DEBUG] [MAIN ] FINV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:52.380815] [INFO ] [MAIN ] FINV: Generated 1794 derivative records from 45191 primary records. [2025-09-29T22:08:52.381544] [DEBUG] [LOCAL ] FINV: Saving derivative data. [2025-09-29T22:08:52.414581] [DEBUG] [MAIN ] FIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:52.416684] [INFO ] [MAIN ] FIS: Generated 1794 derivative records from 53364 primary records. [2025-09-29T22:08:52.417304] [DEBUG] [LOCAL ] FIS: Saving derivative data. [2025-09-29T22:08:52.431276] [DEBUG] [LOCAL ] FINV: Derivative data saved (1794 records). [2025-09-29T22:08:52.434371] [INFO ] [MAIN ] FINV: Successfully saved derivative data. [2025-09-29T22:08:52.440019] [INFO ] [MAIN ] Derivative Progress: 667/2057 symbols completed. FINV took 1.3s. Estimated remaining: 9m 27s. Rate: 147.1 symbols/min [2025-09-29T22:08:52.440768] [INFO ] [MAIN ] FLC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:52.461946] [DEBUG] [MAIN ] FIX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:52.465060] [INFO ] [MAIN ] FIX: Generated 1794 derivative records from 30013 primary records. [2025-09-29T22:08:52.466118] [DEBUG] [LOCAL ] FIX: Saving derivative data. [2025-09-29T22:08:52.467727] [DEBUG] [LOCAL ] FIS: Derivative data saved (1794 records). [2025-09-29T22:08:52.472845] [DEBUG] [LOCAL ] FLC: Loaded 5476 existing records from primary storage. [2025-09-29T22:08:52.472730] [INFO ] [MAIN ] FIS: Successfully saved derivative data. [2025-09-29T22:08:52.484530] [INFO ] [MAIN ] FLC: Loaded 5476 primary data records. [2025-09-29T22:08:52.484302] [INFO ] [MAIN ] Derivative Progress: 668/2057 symbols completed. FIS took 1.4s. Estimated remaining: 9m 26s. Rate: 147.3 symbols/min [2025-09-29T22:08:52.498418] [INFO ] [MAIN ] FLG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:52.534019] [DEBUG] [LOCAL ] FIX: Derivative data saved (1794 records). [2025-09-29T22:08:52.569896] [INFO ] [MAIN ] FIX: Successfully saved derivative data. [2025-09-29T22:08:52.591269] [INFO ] [MAIN ] Derivative Progress: 669/2057 symbols completed. FIX took 1.4s. Estimated remaining: 9m 25s. Rate: 147.4 symbols/min [2025-09-29T22:08:52.617829] [INFO ] [MAIN ] FLNG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:52.871861] [DEBUG] [LOCAL ] FLNG: Loaded 33774 existing records from primary storage. [2025-09-29T22:08:52.888230] [INFO ] [MAIN ] FLNG: Loaded 33774 primary data records. [2025-09-29T22:08:52.895164] [DEBUG] [LOCAL ] FLG: Loaded 53325 existing records from primary storage. [2025-09-29T22:08:52.927140] [INFO ] [MAIN ] FLG: Loaded 53325 primary data records. [2025-09-29T22:08:53.151761] [DEBUG] [MAIN ] FLC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:53.210989] [INFO ] [MAIN ] FLC: Generated 1794 derivative records from 5476 primary records. [2025-09-29T22:08:53.351085] [DEBUG] [LOCAL ] FLC: Saving derivative data. [2025-09-29T22:08:53.558846] [DEBUG] [LOCAL ] FLC: Derivative data saved (1794 records). [2025-09-29T22:08:53.559327] [INFO ] [MAIN ] FLC: Successfully saved derivative data. [2025-09-29T22:08:53.562995] [INFO ] [MAIN ] Derivative Progress: 670/2057 symbols completed. FLC took 1.1s. Estimated remaining: 9m 26s. Rate: 147.1 symbols/min [2025-09-29T22:08:53.563934] [INFO ] [MAIN ] FLO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:53.588924] [DEBUG] [MAIN ] FLNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:53.589774] [INFO ] [MAIN ] FLNG: Generated 1794 derivative records from 33774 primary records. [2025-09-29T22:08:53.590040] [DEBUG] [LOCAL ] FLNG: Saving derivative data. [2025-09-29T22:08:53.621833] [DEBUG] [MAIN ] FLG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:53.623678] [INFO ] [MAIN ] FLG: Generated 1794 derivative records from 53325 primary records. [2025-09-29T22:08:53.624073] [DEBUG] [LOCAL ] FLG: Saving derivative data. [2025-09-29T22:08:53.634830] [DEBUG] [LOCAL ] FLNG: Derivative data saved (1794 records). [2025-09-29T22:08:53.657701] [INFO ] [MAIN ] FLNG: Successfully saved derivative data. [2025-09-29T22:08:53.659844] [INFO ] [MAIN ] Derivative Progress: 671/2057 symbols completed. FLNG took 1.0s. Estimated remaining: 9m 25s. Rate: 147.3 symbols/min [2025-09-29T22:08:53.660733] [INFO ] [MAIN ] FLR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:53.666458] [DEBUG] [LOCAL ] FLG: Derivative data saved (1794 records). [2025-09-29T22:08:53.668072] [INFO ] [MAIN ] FLG: Successfully saved derivative data. [2025-09-29T22:08:53.670300] [INFO ] [MAIN ] Derivative Progress: 672/2057 symbols completed. FLG took 1.2s. Estimated remaining: 9m 23s. Rate: 147.5 symbols/min [2025-09-29T22:08:53.688514] [INFO ] [MAIN ] FLS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:53.690546] [DEBUG] [LOCAL ] FLO: Loaded 51900 existing records from primary storage. [2025-09-29T22:08:53.690853] [INFO ] [MAIN ] FLO: Loaded 51900 primary data records. [2025-09-29T22:08:54.118363] [DEBUG] [LOCAL ] FLR: Loaded 53111 existing records from primary storage. [2025-09-29T22:08:54.118615] [INFO ] [MAIN ] FLR: Loaded 53111 primary data records. [2025-09-29T22:08:54.246335] [DEBUG] [LOCAL ] FLS: Loaded 50154 existing records from primary storage. [2025-09-29T22:08:54.252712] [INFO ] [MAIN ] FLS: Loaded 50154 primary data records. [2025-09-29T22:08:54.825056] [DEBUG] [MAIN ] FLO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:54.827230] [INFO ] [MAIN ] FLO: Generated 1794 derivative records from 51900 primary records. [2025-09-29T22:08:54.828192] [DEBUG] [LOCAL ] FLO: Saving derivative data. [2025-09-29T22:08:54.864477] [DEBUG] [LOCAL ] FLO: Derivative data saved (1794 records). [2025-09-29T22:08:54.864873] [DEBUG] [MAIN ] FLR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:54.865427] [INFO ] [MAIN ] FLO: Successfully saved derivative data. [2025-09-29T22:08:54.866537] [INFO ] [MAIN ] FLR: Generated 1794 derivative records from 53111 primary records. [2025-09-29T22:08:54.868749] [INFO ] [MAIN ] Derivative Progress: 673/2057 symbols completed. FLO took 1.3s. Estimated remaining: 9m 25s. Rate: 147.1 symbols/min [2025-09-29T22:08:54.869468] [DEBUG] [LOCAL ] FLR: Saving derivative data. [2025-09-29T22:08:54.887369] [DEBUG] [LOCAL ] FLR: Derivative data saved (1794 records). [2025-09-29T22:08:54.889268] [INFO ] [MAIN ] FLR: Successfully saved derivative data. [2025-09-29T22:08:54.892533] [INFO ] [MAIN ] Derivative Progress: 674/2057 symbols completed. FLR took 1.2s. Estimated remaining: 9m 23s. Rate: 147.3 symbols/min [2025-09-29T22:08:54.906735] [DEBUG] [MAIN ] FLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:54.907543] [INFO ] [MAIN ] FLS: Generated 1794 derivative records from 50154 primary records. [2025-09-29T22:08:54.907611] [DEBUG] [LOCAL ] FLS: Saving derivative data. [2025-09-29T22:08:54.923580] [DEBUG] [LOCAL ] FLS: Derivative data saved (1794 records). [2025-09-29T22:08:54.923698] [INFO ] [MAIN ] FLS: Successfully saved derivative data. [2025-09-29T22:08:54.926078] [INFO ] [MAIN ] Derivative Progress: 675/2057 symbols completed. FLS took 1.2s. Estimated remaining: 9m 22s. Rate: 147.5 symbols/min [2025-09-29T22:08:54.927010] [INFO ] [MAIN ] FLXR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:54.926857] [INFO ] [MAIN ] FLUT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:54.927397] [INFO ] [MAIN ] FMC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:54.953285] [DEBUG] [LOCAL ] FLXR: Loaded 20158 existing records from primary storage. [2025-09-29T22:08:54.953464] [INFO ] [MAIN ] FLXR: Loaded 20158 primary data records. [2025-09-29T22:08:55.327685] [DEBUG] [LOCAL ] FMC: Loaded 51780 existing records from primary storage. [2025-09-29T22:08:55.342520] [INFO ] [MAIN ] FMC: Loaded 51780 primary data records. [2025-09-29T22:08:55.343437] [DEBUG] [LOCAL ] FLUT: Loaded 50763 existing records from primary storage. [2025-09-29T22:08:55.379046] [INFO ] [MAIN ] FLUT: Loaded 50763 primary data records. [2025-09-29T22:08:56.052718] [DEBUG] [MAIN ] FLXR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:56.054381] [INFO ] [MAIN ] FLXR: Generated 1794 derivative records from 20158 primary records. [2025-09-29T22:08:56.055826] [DEBUG] [LOCAL ] FLXR: Saving derivative data. [2025-09-29T22:08:56.075386] [DEBUG] [LOCAL ] FLXR: Derivative data saved (1794 records). [2025-09-29T22:08:56.075819] [INFO ] [MAIN ] FLXR: Successfully saved derivative data. [2025-09-29T22:08:56.077994] [INFO ] [MAIN ] Derivative Progress: 676/2057 symbols completed. FLXR took 1.2s. Estimated remaining: 9m 23s. Rate: 147.1 symbols/min [2025-09-29T22:08:56.078532] [INFO ] [MAIN ] FMN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:56.106593] [DEBUG] [LOCAL ] FMN: Loaded 5776 existing records from primary storage. [2025-09-29T22:08:56.120920] [INFO ] [MAIN ] FMN: Loaded 5776 primary data records. [2025-09-29T22:08:56.127787] [DEBUG] [MAIN ] FLUT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:56.128556] [INFO ] [MAIN ] FLUT: Generated 1794 derivative records from 50763 primary records. [2025-09-29T22:08:56.128668] [DEBUG] [LOCAL ] FLUT: Saving derivative data. [2025-09-29T22:08:56.120729] [DEBUG] [MAIN ] FMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:56.130027] [INFO ] [MAIN ] FMC: Generated 1794 derivative records from 51780 primary records. [2025-09-29T22:08:56.144848] [DEBUG] [LOCAL ] FMC: Saving derivative data. [2025-09-29T22:08:56.291217] [DEBUG] [LOCAL ] FLUT: Derivative data saved (1794 records). [2025-09-29T22:08:56.318678] [INFO ] [MAIN ] FLUT: Successfully saved derivative data. [2025-09-29T22:08:56.337561] [DEBUG] [LOCAL ] FMC: Derivative data saved (1794 records). [2025-09-29T22:08:56.364472] [INFO ] [MAIN ] FMC: Successfully saved derivative data. [2025-09-29T22:08:56.358385] [INFO ] [MAIN ] Derivative Progress: 677/2057 symbols completed. FLUT took 1.4s. Estimated remaining: 9m 23s. Rate: 147.2 symbols/min [2025-09-29T22:08:56.516104] [INFO ] [MAIN ] Derivative Progress: 678/2057 symbols completed. FMC took 1.4s. Estimated remaining: 9m 22s. Rate: 147.3 symbols/min [2025-09-29T22:08:56.507857] [INFO ] [MAIN ] FMS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:56.517232] [INFO ] [MAIN ] FMX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:56.567826] [DEBUG] [MAIN ] FMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:56.577905] [INFO ] [MAIN ] FMN: Generated 1794 derivative records from 5776 primary records. [2025-09-29T22:08:56.578060] [DEBUG] [LOCAL ] FMN: Saving derivative data. [2025-09-29T22:08:56.589318] [DEBUG] [LOCAL ] FMS: Loaded 30196 existing records from primary storage. [2025-09-29T22:08:56.606018] [INFO ] [MAIN ] FMS: Loaded 30196 primary data records. [2025-09-29T22:08:56.675779] [DEBUG] [LOCAL ] FMN: Derivative data saved (1794 records). [2025-09-29T22:08:56.698711] [INFO ] [MAIN ] FMN: Successfully saved derivative data. [2025-09-29T22:08:56.705602] [DEBUG] [LOCAL ] FMX: Loaded 40666 existing records from primary storage. [2025-09-29T22:08:56.727630] [INFO ] [MAIN ] Derivative Progress: 679/2057 symbols completed. FMN took 0.6s. Estimated remaining: 9m 21s. Rate: 147.4 symbols/min [2025-09-29T22:08:56.744280] [INFO ] [MAIN ] FMY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:56.744450] [INFO ] [MAIN ] FMX: Loaded 40666 primary data records. [2025-09-29T22:08:56.798279] [DEBUG] [LOCAL ] FMY: Loaded 1400 existing records from primary storage. [2025-09-29T22:08:56.803599] [INFO ] [MAIN ] FMY: Loaded 1400 primary data records. [2025-09-29T22:08:57.665984] [DEBUG] [MAIN ] FMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:57.667903] [INFO ] [MAIN ] FMS: Generated 1794 derivative records from 30196 primary records. [2025-09-29T22:08:57.668109] [DEBUG] [LOCAL ] FMS: Saving derivative data. [2025-09-29T22:08:57.684085] [DEBUG] [MAIN ] FMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:57.694982] [INFO ] [MAIN ] FMX: Generated 1794 derivative records from 40666 primary records. [2025-09-29T22:08:57.700464] [DEBUG] [LOCAL ] FMX: Saving derivative data. [2025-09-29T22:08:57.726881] [DEBUG] [MAIN ] FMY: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:08:57.731364] [INFO ] [MAIN ] FMY: Generated 1793 derivative records from 1400 primary records. [2025-09-29T22:08:57.733241] [DEBUG] [LOCAL ] FMY: Saving derivative data. [2025-09-29T22:08:57.737683] [DEBUG] [LOCAL ] FMX: Derivative data saved (1794 records). [2025-09-29T22:08:57.739160] [INFO ] [MAIN ] FMX: Successfully saved derivative data. [2025-09-29T22:08:57.741483] [INFO ] [MAIN ] Derivative Progress: 680/2057 symbols completed. FMX took 1.2s. Estimated remaining: 9m 22s. Rate: 147.1 symbols/min [2025-09-29T22:08:57.747846] [INFO ] [MAIN ] FN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:57.749846] [DEBUG] [LOCAL ] FMS: Derivative data saved (1794 records). [2025-09-29T22:08:57.752875] [INFO ] [MAIN ] FMS: Successfully saved derivative data. [2025-09-29T22:08:57.756799] [DEBUG] [LOCAL ] FMY: Derivative data saved (1793 records). [2025-09-29T22:08:57.757070] [INFO ] [MAIN ] FMY: Successfully saved derivative data. [2025-09-29T22:08:57.759945] [INFO ] [MAIN ] Derivative Progress: 681/2057 symbols completed. FMY took 1.0s. Estimated remaining: 9m 21s. Rate: 147.3 symbols/min [2025-09-29T22:08:57.762975] [INFO ] [MAIN ] FNB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:57.763254] [INFO ] [MAIN ] Derivative Progress: 682/2057 symbols completed. FMS took 1.3s. Estimated remaining: 9m 19s. Rate: 147.5 symbols/min [2025-09-29T22:08:57.763726] [INFO ] [MAIN ] FND: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:57.820322] [DEBUG] [LOCAL ] FN: Loaded 38886 existing records from primary storage. [2025-09-29T22:08:57.820479] [INFO ] [MAIN ] FN: Loaded 38886 primary data records. [2025-09-29T22:08:57.979276] [DEBUG] [LOCAL ] FND: Loaded 52098 existing records from primary storage. [2025-09-29T22:08:57.978006] [DEBUG] [LOCAL ] FNB: Loaded 52447 existing records from primary storage. [2025-09-29T22:08:57.990677] [INFO ] [MAIN ] FNB: Loaded 52447 primary data records. [2025-09-29T22:08:57.985400] [INFO ] [MAIN ] FND: Loaded 52098 primary data records. [2025-09-29T22:08:59.149010] [DEBUG] [MAIN ] FN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:59.152319] [INFO ] [MAIN ] FN: Generated 1794 derivative records from 38886 primary records. [2025-09-29T22:08:59.152800] [DEBUG] [LOCAL ] FN: Saving derivative data. [2025-09-29T22:08:59.173464] [DEBUG] [LOCAL ] FN: Derivative data saved (1794 records). [2025-09-29T22:08:59.174268] [INFO ] [MAIN ] FN: Successfully saved derivative data. [2025-09-29T22:08:59.176932] [INFO ] [MAIN ] Derivative Progress: 683/2057 symbols completed. FN took 1.4s. Estimated remaining: 9m 21s. Rate: 147.0 symbols/min [2025-09-29T22:08:59.177897] [INFO ] [MAIN ] FNF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:59.202754] [DEBUG] [MAIN ] FNB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:59.203877] [INFO ] [MAIN ] FNB: Generated 1794 derivative records from 52447 primary records. [2025-09-29T22:08:59.217305] [DEBUG] [LOCAL ] FNB: Saving derivative data. [2025-09-29T22:08:59.226602] [DEBUG] [MAIN ] FND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:08:59.235315] [INFO ] [MAIN ] FND: Generated 1794 derivative records from 52098 primary records. [2025-09-29T22:08:59.239282] [DEBUG] [LOCAL ] FND: Saving derivative data. [2025-09-29T22:08:59.274120] [DEBUG] [LOCAL ] FND: Derivative data saved (1794 records). [2025-09-29T22:08:59.276346] [DEBUG] [LOCAL ] FNB: Derivative data saved (1794 records). [2025-09-29T22:08:59.275744] [INFO ] [MAIN ] FND: Successfully saved derivative data. [2025-09-29T22:08:59.278898] [INFO ] [MAIN ] Derivative Progress: 684/2057 symbols completed. FND took 1.5s. Estimated remaining: 9m 20s. Rate: 147.1 symbols/min [2025-09-29T22:08:59.279169] [INFO ] [MAIN ] FNV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:59.279364] [INFO ] [MAIN ] FNB: Successfully saved derivative data. [2025-09-29T22:08:59.283448] [INFO ] [MAIN ] Derivative Progress: 685/2057 symbols completed. FNB took 1.5s. Estimated remaining: 9m 19s. Rate: 147.3 symbols/min [2025-09-29T22:08:59.284630] [INFO ] [MAIN ] FOA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:08:59.302117] [DEBUG] [LOCAL ] FNF: Loaded 49115 existing records from primary storage. [2025-09-29T22:08:59.302416] [INFO ] [MAIN ] FNF: Loaded 49115 primary data records. [2025-09-29T22:08:59.413280] [DEBUG] [LOCAL ] FOA: Loaded 13128 existing records from primary storage. [2025-09-29T22:08:59.428154] [INFO ] [MAIN ] FOA: Loaded 13128 primary data records. [2025-09-29T22:08:59.648072] [DEBUG] [LOCAL ] FNV: Loaded 46253 existing records from primary storage. [2025-09-29T22:08:59.786146] [INFO ] [MAIN ] FNV: Loaded 46253 primary data records. [2025-09-29T22:09:00.352115] [DEBUG] [MAIN ] FNF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:00.355495] [INFO ] [MAIN ] FNF: Generated 1794 derivative records from 49115 primary records. [2025-09-29T22:09:00.356822] [DEBUG] [LOCAL ] FNF: Saving derivative data. [2025-09-29T22:09:00.379864] [DEBUG] [MAIN ] FOA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:00.388135] [INFO ] [MAIN ] FOA: Generated 1794 derivative records from 13128 primary records. [2025-09-29T22:09:00.388270] [DEBUG] [LOCAL ] FOA: Saving derivative data. [2025-09-29T22:09:00.390029] [DEBUG] [LOCAL ] FNF: Derivative data saved (1794 records). [2025-09-29T22:09:00.391288] [INFO ] [MAIN ] FNF: Successfully saved derivative data. [2025-09-29T22:09:00.393794] [INFO ] [MAIN ] Derivative Progress: 686/2057 symbols completed. FNF took 1.2s. Estimated remaining: 9m 20s. Rate: 147.0 symbols/min [2025-09-29T22:09:00.401075] [INFO ] [MAIN ] FOF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:00.413596] [DEBUG] [LOCAL ] FOA: Derivative data saved (1794 records). [2025-09-29T22:09:00.414077] [INFO ] [MAIN ] FOA: Successfully saved derivative data. [2025-09-29T22:09:00.416244] [INFO ] [MAIN ] Derivative Progress: 687/2057 symbols completed. FOA took 1.1s. Estimated remaining: 9m 19s. Rate: 147.2 symbols/min [2025-09-29T22:09:00.416743] [INFO ] [MAIN ] FOR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:00.433408] [DEBUG] [MAIN ] FNV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:00.434417] [INFO ] [MAIN ] FNV: Generated 1794 derivative records from 46253 primary records. [2025-09-29T22:09:00.434675] [DEBUG] [LOCAL ] FNV: Saving derivative data. [2025-09-29T22:09:00.439741] [DEBUG] [LOCAL ] FOF: Loaded 8434 existing records from primary storage. [2025-09-29T22:09:00.450988] [INFO ] [MAIN ] FOF: Loaded 8434 primary data records. [2025-09-29T22:09:00.562834] [DEBUG] [LOCAL ] FOR: Loaded 19910 existing records from primary storage. [2025-09-29T22:09:00.576933] [INFO ] [MAIN ] FOR: Loaded 19910 primary data records. [2025-09-29T22:09:00.606525] [DEBUG] [LOCAL ] FNV: Derivative data saved (1794 records). [2025-09-29T22:09:00.628623] [INFO ] [MAIN ] FNV: Successfully saved derivative data. [2025-09-29T22:09:00.697070] [INFO ] [MAIN ] Derivative Progress: 688/2057 symbols completed. FNV took 1.4s. Estimated remaining: 9m 18s. Rate: 147.2 symbols/min [2025-09-29T22:09:01.187989] [DEBUG] [MAIN ] FOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:01.189061] [INFO ] [MAIN ] FOF: Generated 1794 derivative records from 8434 primary records. [2025-09-29T22:09:01.189169] [DEBUG] [LOCAL ] FOF: Saving derivative data. [2025-09-29T22:09:01.205773] [DEBUG] [LOCAL ] FOF: Derivative data saved (1794 records). [2025-09-29T22:09:01.205991] [INFO ] [MAIN ] FOF: Successfully saved derivative data. [2025-09-29T22:09:01.208102] [INFO ] [MAIN ] Derivative Progress: 689/2057 symbols completed. FOF took 0.8s. Estimated remaining: 9m 18s. Rate: 147.2 symbols/min [2025-09-29T22:09:01.224195] [DEBUG] [MAIN ] FOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:01.224799] [INFO ] [MAIN ] FOR: Generated 1794 derivative records from 19910 primary records. [2025-09-29T22:09:01.224865] [DEBUG] [LOCAL ] FOR: Saving derivative data. [2025-09-29T22:09:01.240152] [DEBUG] [LOCAL ] FOR: Derivative data saved (1794 records). [2025-09-29T22:09:01.240222] [INFO ] [MAIN ] FOR: Successfully saved derivative data. [2025-09-29T22:09:01.242352] [INFO ] [MAIN ] Derivative Progress: 690/2057 symbols completed. FOR took 0.8s. Estimated remaining: 9m 17s. Rate: 147.4 symbols/min [2025-09-29T22:09:01.243060] [INFO ] [MAIN ] FPF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:01.242954] [INFO ] [MAIN ] FOUR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:01.243352] [INFO ] [MAIN ] FPH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:01.276500] [DEBUG] [LOCAL ] FPF: Loaded 17885 existing records from primary storage. [2025-09-29T22:09:01.276115] [DEBUG] [LOCAL ] FPH: Loaded 19569 existing records from primary storage. [2025-09-29T22:09:01.276712] [INFO ] [MAIN ] FPH: Loaded 19569 primary data records. [2025-09-29T22:09:01.276811] [INFO ] [MAIN ] FPF: Loaded 17885 primary data records. [2025-09-29T22:09:01.956528] [DEBUG] [LOCAL ] FOUR: Loaded 49547 existing records from primary storage. [2025-09-29T22:09:01.971534] [INFO ] [MAIN ] FOUR: Loaded 49547 primary data records. [2025-09-29T22:09:02.371800] [DEBUG] [MAIN ] FPF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:02.371453] [DEBUG] [MAIN ] FPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:02.372632] [INFO ] [MAIN ] FPF: Generated 1794 derivative records from 17885 primary records. [2025-09-29T22:09:02.373860] [DEBUG] [LOCAL ] FPF: Saving derivative data. [2025-09-29T22:09:02.374019] [INFO ] [MAIN ] FPH: Generated 1794 derivative records from 19569 primary records. [2025-09-29T22:09:02.375664] [DEBUG] [LOCAL ] FPH: Saving derivative data. [2025-09-29T22:09:02.407731] [DEBUG] [LOCAL ] FPF: Derivative data saved (1794 records). [2025-09-29T22:09:02.408052] [INFO ] [MAIN ] FPF: Successfully saved derivative data. [2025-09-29T22:09:02.410244] [INFO ] [MAIN ] Derivative Progress: 691/2057 symbols completed. FPF took 1.2s. Estimated remaining: 9m 18s. Rate: 147.0 symbols/min [2025-09-29T22:09:02.407421] [DEBUG] [LOCAL ] FPH: Derivative data saved (1794 records). [2025-09-29T22:09:02.410532] [INFO ] [MAIN ] FPI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:02.411056] [INFO ] [MAIN ] FPH: Successfully saved derivative data. [2025-09-29T22:09:02.413779] [INFO ] [MAIN ] Derivative Progress: 692/2057 symbols completed. FPH took 1.2s. Estimated remaining: 9m 16s. Rate: 147.2 symbols/min [2025-09-29T22:09:02.414631] [INFO ] [MAIN ] FR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:02.434878] [DEBUG] [MAIN ] FOUR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:02.435639] [INFO ] [MAIN ] FOUR: Generated 1794 derivative records from 49547 primary records. [2025-09-29T22:09:02.435787] [DEBUG] [LOCAL ] FOUR: Saving derivative data. [2025-09-29T22:09:02.452937] [DEBUG] [LOCAL ] FOUR: Derivative data saved (1794 records). [2025-09-29T22:09:02.453164] [INFO ] [MAIN ] FOUR: Successfully saved derivative data. [2025-09-29T22:09:02.455553] [INFO ] [MAIN ] Derivative Progress: 693/2057 symbols completed. FOUR took 1.2s. Estimated remaining: 9m 15s. Rate: 147.4 symbols/min [2025-09-29T22:09:02.455902] [INFO ] [MAIN ] FRA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:02.583404] [DEBUG] [LOCAL ] FPI: Loaded 31022 existing records from primary storage. [2025-09-29T22:09:02.589134] [INFO ] [MAIN ] FPI: Loaded 31022 primary data records. [2025-09-29T22:09:02.601166] [DEBUG] [LOCAL ] FRA: Loaded 14517 existing records from primary storage. [2025-09-29T22:09:02.607973] [INFO ] [MAIN ] FRA: Loaded 14517 primary data records. [2025-09-29T22:09:02.649354] [DEBUG] [LOCAL ] FR: Loaded 46393 existing records from primary storage. [2025-09-29T22:09:02.683993] [INFO ] [MAIN ] FR: Loaded 46393 primary data records. [2025-09-29T22:09:03.657936] [DEBUG] [MAIN ] FPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:03.659571] [INFO ] [MAIN ] FPI: Generated 1794 derivative records from 31022 primary records. [2025-09-29T22:09:03.660046] [DEBUG] [LOCAL ] FPI: Saving derivative data. [2025-09-29T22:09:03.695191] [DEBUG] [MAIN ] FR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:03.709759] [INFO ] [MAIN ] FR: Generated 1794 derivative records from 46393 primary records. [2025-09-29T22:09:03.710097] [DEBUG] [MAIN ] FRA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:03.710245] [DEBUG] [LOCAL ] FR: Saving derivative data. [2025-09-29T22:09:03.712165] [INFO ] [MAIN ] FRA: Generated 1794 derivative records from 14517 primary records. [2025-09-29T22:09:03.712549] [DEBUG] [LOCAL ] FRA: Saving derivative data. [2025-09-29T22:09:03.713029] [DEBUG] [LOCAL ] FPI: Derivative data saved (1794 records). [2025-09-29T22:09:03.714404] [INFO ] [MAIN ] FPI: Successfully saved derivative data. [2025-09-29T22:09:03.723500] [INFO ] [MAIN ] Derivative Progress: 694/2057 symbols completed. FPI took 1.3s. Estimated remaining: 9m 17s. Rate: 146.9 symbols/min [2025-09-29T22:09:03.732195] [INFO ] [MAIN ] FRGE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:03.746922] [DEBUG] [LOCAL ] FRA: Derivative data saved (1794 records). [2025-09-29T22:09:03.749390] [DEBUG] [LOCAL ] FR: Derivative data saved (1794 records). [2025-09-29T22:09:03.749674] [INFO ] [MAIN ] FR: Successfully saved derivative data. [2025-09-29T22:09:03.749612] [INFO ] [MAIN ] FRA: Successfully saved derivative data. [2025-09-29T22:09:03.752047] [INFO ] [MAIN ] Derivative Progress: 695/2057 symbols completed. FR took 1.3s. Estimated remaining: 9m 15s. Rate: 147.1 symbols/min [2025-09-29T22:09:03.754577] [INFO ] [MAIN ] FRO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:03.754796] [INFO ] [MAIN ] Derivative Progress: 696/2057 symbols completed. FRA took 1.3s. Estimated remaining: 9m 14s. Rate: 147.3 symbols/min [2025-09-29T22:09:03.755067] [INFO ] [MAIN ] FRT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:03.773742] [DEBUG] [LOCAL ] FRGE: Loaded 17953 existing records from primary storage. [2025-09-29T22:09:03.773883] [INFO ] [MAIN ] FRGE: Loaded 17953 primary data records. [2025-09-29T22:09:04.133516] [DEBUG] [LOCAL ] FRT: Loaded 42096 existing records from primary storage. [2025-09-29T22:09:04.143433] [INFO ] [MAIN ] FRT: Loaded 42096 primary data records. [2025-09-29T22:09:04.231392] [DEBUG] [LOCAL ] FRO: Loaded 51814 existing records from primary storage. [2025-09-29T22:09:04.250712] [INFO ] [MAIN ] FRO: Loaded 51814 primary data records. [2025-09-29T22:09:04.819666] [DEBUG] [MAIN ] FRGE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:04.821326] [INFO ] [MAIN ] FRGE: Generated 1794 derivative records from 17953 primary records. [2025-09-29T22:09:04.821699] [DEBUG] [LOCAL ] FRGE: Saving derivative data. [2025-09-29T22:09:04.841535] [DEBUG] [LOCAL ] FRGE: Derivative data saved (1794 records). [2025-09-29T22:09:04.842428] [INFO ] [MAIN ] FRGE: Successfully saved derivative data. [2025-09-29T22:09:04.845302] [INFO ] [MAIN ] Derivative Progress: 697/2057 symbols completed. FRGE took 1.1s. Estimated remaining: 9m 15s. Rate: 147.0 symbols/min [2025-09-29T22:09:04.845614] [INFO ] [MAIN ] FSCO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:04.880581] [DEBUG] [MAIN ] FRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:04.887361] [INFO ] [MAIN ] FRT: Generated 1794 derivative records from 42096 primary records. [2025-09-29T22:09:04.887635] [DEBUG] [LOCAL ] FRT: Saving derivative data. [2025-09-29T22:09:04.888380] [DEBUG] [MAIN ] FRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:04.890216] [INFO ] [MAIN ] FRO: Generated 1794 derivative records from 51814 primary records. [2025-09-29T22:09:04.899982] [DEBUG] [LOCAL ] FRO: Saving derivative data. [2025-09-29T22:09:04.916382] [DEBUG] [LOCAL ] FRT: Derivative data saved (1794 records). [2025-09-29T22:09:04.916504] [INFO ] [MAIN ] FRT: Successfully saved derivative data. [2025-09-29T22:09:04.918679] [INFO ] [MAIN ] Derivative Progress: 698/2057 symbols completed. FRT took 1.2s. Estimated remaining: 9m 14s. Rate: 147.2 symbols/min [2025-09-29T22:09:04.927234] [INFO ] [MAIN ] FSK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:04.945920] [DEBUG] [LOCAL ] FRO: Derivative data saved (1794 records). [2025-09-29T22:09:04.947377] [INFO ] [MAIN ] FRO: Successfully saved derivative data. [2025-09-29T22:09:04.949825] [INFO ] [MAIN ] Derivative Progress: 699/2057 symbols completed. FRO took 1.2s. Estimated remaining: 9m 13s. Rate: 147.4 symbols/min [2025-09-29T22:09:04.950893] [INFO ] [MAIN ] FSLY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:04.950772] [DEBUG] [LOCAL ] FSCO: Loaded 37264 existing records from primary storage. [2025-09-29T22:09:04.951480] [INFO ] [MAIN ] FSCO: Loaded 37264 primary data records. [2025-09-29T22:09:05.366814] [DEBUG] [LOCAL ] FSK: Loaded 49406 existing records from primary storage. [2025-09-29T22:09:05.367848] [INFO ] [MAIN ] FSK: Loaded 49406 primary data records. [2025-09-29T22:09:05.368553] [DEBUG] [LOCAL ] FSLY: Loaded 51193 existing records from primary storage. [2025-09-29T22:09:05.369707] [INFO ] [MAIN ] FSLY: Loaded 51193 primary data records. [2025-09-29T22:09:06.052125] [DEBUG] [MAIN ] FSCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:06.052937] [INFO ] [MAIN ] FSCO: Generated 1794 derivative records from 37264 primary records. [2025-09-29T22:09:06.053237] [DEBUG] [LOCAL ] FSCO: Saving derivative data. [2025-09-29T22:09:06.083103] [DEBUG] [LOCAL ] FSCO: Derivative data saved (1794 records). [2025-09-29T22:09:06.083865] [INFO ] [MAIN ] FSCO: Successfully saved derivative data. [2025-09-29T22:09:06.086308] [INFO ] [MAIN ] Derivative Progress: 700/2057 symbols completed. FSCO took 1.2s. Estimated remaining: 9m 14s. Rate: 147.0 symbols/min [2025-09-29T22:09:06.087129] [INFO ] [MAIN ] FSM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:06.109177] [DEBUG] [MAIN ] FSK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:06.112593] [INFO ] [MAIN ] FSK: Generated 1794 derivative records from 49406 primary records. [2025-09-29T22:09:06.113832] [DEBUG] [LOCAL ] FSK: Saving derivative data. [2025-09-29T22:09:06.150299] [DEBUG] [MAIN ] FSLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:06.152062] [INFO ] [MAIN ] FSLY: Generated 1794 derivative records from 51193 primary records. [2025-09-29T22:09:06.152253] [DEBUG] [LOCAL ] FSLY: Saving derivative data. [2025-09-29T22:09:06.188225] [DEBUG] [LOCAL ] FSK: Derivative data saved (1794 records). [2025-09-29T22:09:06.188925] [INFO ] [MAIN ] FSK: Successfully saved derivative data. [2025-09-29T22:09:06.192280] [INFO ] [MAIN ] Derivative Progress: 701/2057 symbols completed. FSK took 1.3s. Estimated remaining: 9m 13s. Rate: 147.1 symbols/min [2025-09-29T22:09:06.193584] [INFO ] [MAIN ] FSS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:06.194994] [DEBUG] [LOCAL ] FSLY: Derivative data saved (1794 records). [2025-09-29T22:09:06.195216] [INFO ] [MAIN ] FSLY: Successfully saved derivative data. [2025-09-29T22:09:06.197095] [INFO ] [MAIN ] Derivative Progress: 702/2057 symbols completed. FSLY took 1.2s. Estimated remaining: 9m 12s. Rate: 147.3 symbols/min [2025-09-29T22:09:06.198731] [INFO ] [MAIN ] FT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:06.215022] [DEBUG] [LOCAL ] FSM: Loaded 53287 existing records from primary storage. [2025-09-29T22:09:06.215329] [INFO ] [MAIN ] FSM: Loaded 53287 primary data records. [2025-09-29T22:09:06.315627] [DEBUG] [LOCAL ] FT: Loaded 6436 existing records from primary storage. [2025-09-29T22:09:06.330427] [INFO ] [MAIN ] FT: Loaded 6436 primary data records. [2025-09-29T22:09:06.651998] [DEBUG] [LOCAL ] FSS: Loaded 34208 existing records from primary storage. [2025-09-29T22:09:06.665916] [INFO ] [MAIN ] FSS: Loaded 34208 primary data records. [2025-09-29T22:09:07.331050] [DEBUG] [MAIN ] FSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:07.332509] [INFO ] [MAIN ] FSM: Generated 1794 derivative records from 53287 primary records. [2025-09-29T22:09:07.332727] [DEBUG] [LOCAL ] FSM: Saving derivative data. [2025-09-29T22:09:07.355262] [DEBUG] [LOCAL ] FSM: Derivative data saved (1794 records). [2025-09-29T22:09:07.355483] [INFO ] [MAIN ] FSM: Successfully saved derivative data. [2025-09-29T22:09:07.370309] [INFO ] [MAIN ] Derivative Progress: 703/2057 symbols completed. FSM took 1.3s. Estimated remaining: 9m 13s. Rate: 146.9 symbols/min [2025-09-29T22:09:07.371489] [DEBUG] [MAIN ] FT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:07.372318] [INFO ] [MAIN ] FT: Generated 1794 derivative records from 6436 primary records. [2025-09-29T22:09:07.372476] [DEBUG] [LOCAL ] FT: Saving derivative data. [2025-09-29T22:09:07.402558] [DEBUG] [MAIN ] FSS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:07.403785] [INFO ] [MAIN ] FSS: Generated 1794 derivative records from 34208 primary records. [2025-09-29T22:09:07.404330] [DEBUG] [LOCAL ] FSS: Saving derivative data. [2025-09-29T22:09:07.405233] [DEBUG] [LOCAL ] FT: Derivative data saved (1794 records). [2025-09-29T22:09:07.405682] [INFO ] [MAIN ] FT: Successfully saved derivative data. [2025-09-29T22:09:07.408211] [INFO ] [MAIN ] Derivative Progress: 704/2057 symbols completed. FT took 1.2s. Estimated remaining: 9m 12s. Rate: 147.1 symbols/min [2025-09-29T22:09:07.423407] [DEBUG] [LOCAL ] FSS: Derivative data saved (1794 records). [2025-09-29T22:09:07.423482] [INFO ] [MAIN ] FSS: Successfully saved derivative data. [2025-09-29T22:09:07.425526] [INFO ] [MAIN ] Derivative Progress: 705/2057 symbols completed. FSS took 1.2s. Estimated remaining: 9m 11s. Rate: 147.3 symbols/min [2025-09-29T22:09:07.426052] [INFO ] [MAIN ] FTHY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:07.426161] [INFO ] [MAIN ] FTK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:07.426252] [INFO ] [MAIN ] FTI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:07.443083] [DEBUG] [LOCAL ] FTHY: Loaded 11823 existing records from primary storage. [2025-09-29T22:09:07.443313] [INFO ] [MAIN ] FTHY: Loaded 11823 primary data records. [2025-09-29T22:09:07.626150] [DEBUG] [LOCAL ] FTK: Loaded 32226 existing records from primary storage. [2025-09-29T22:09:07.661962] [INFO ] [MAIN ] FTK: Loaded 32226 primary data records. [2025-09-29T22:09:07.955854] [DEBUG] [LOCAL ] FTI: Loaded 53297 existing records from primary storage. [2025-09-29T22:09:07.966423] [INFO ] [MAIN ] FTI: Loaded 53297 primary data records. [2025-09-29T22:09:08.487188] [DEBUG] [MAIN ] FTHY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:08.488470] [INFO ] [MAIN ] FTHY: Generated 1794 derivative records from 11823 primary records. [2025-09-29T22:09:08.488631] [DEBUG] [LOCAL ] FTHY: Saving derivative data. [2025-09-29T22:09:08.507946] [DEBUG] [LOCAL ] FTHY: Derivative data saved (1794 records). [2025-09-29T22:09:08.509959] [INFO ] [MAIN ] FTHY: Successfully saved derivative data. [2025-09-29T22:09:08.512097] [INFO ] [MAIN ] Derivative Progress: 706/2057 symbols completed. FTHY took 1.1s. Estimated remaining: 9m 11s. Rate: 147.0 symbols/min [2025-09-29T22:09:08.522370] [INFO ] [MAIN ] FTS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:08.535229] [DEBUG] [MAIN ] FTK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:08.536271] [INFO ] [MAIN ] FTK: Generated 1794 derivative records from 32226 primary records. [2025-09-29T22:09:08.549627] [DEBUG] [LOCAL ] FTK: Saving derivative data. [2025-09-29T22:09:08.550303] [DEBUG] [MAIN ] FTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:08.551411] [INFO ] [MAIN ] FTI: Generated 1794 derivative records from 53297 primary records. [2025-09-29T22:09:08.551873] [DEBUG] [LOCAL ] FTI: Saving derivative data. [2025-09-29T22:09:08.581080] [DEBUG] [LOCAL ] FTK: Derivative data saved (1794 records). [2025-09-29T22:09:08.584337] [INFO ] [MAIN ] FTK: Successfully saved derivative data. [2025-09-29T22:09:08.588877] [INFO ] [MAIN ] Derivative Progress: 707/2057 symbols completed. FTK took 1.2s. Estimated remaining: 9m 10s. Rate: 147.2 symbols/min [2025-09-29T22:09:08.589831] [DEBUG] [LOCAL ] FTI: Derivative data saved (1794 records). [2025-09-29T22:09:08.590050] [INFO ] [MAIN ] FTI: Successfully saved derivative data. [2025-09-29T22:09:08.592379] [INFO ] [MAIN ] Derivative Progress: 708/2057 symbols completed. FTI took 1.2s. Estimated remaining: 9m 9s. Rate: 147.4 symbols/min [2025-09-29T22:09:08.589964] [INFO ] [MAIN ] FTV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:08.592663] [INFO ] [MAIN ] FTWO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:08.607871] [DEBUG] [LOCAL ] FTWO: Loaded 1795 existing records from primary storage. [2025-09-29T22:09:08.608058] [INFO ] [MAIN ] FTWO: Loaded 1795 primary data records. [2025-09-29T22:09:08.746855] [DEBUG] [LOCAL ] FTS: Loaded 42097 existing records from primary storage. [2025-09-29T22:09:08.753046] [INFO ] [MAIN ] FTS: Loaded 42097 primary data records. [2025-09-29T22:09:09.186610] [DEBUG] [LOCAL ] FTV: Loaded 52922 existing records from primary storage. [2025-09-29T22:09:09.195202] [INFO ] [MAIN ] FTV: Loaded 52922 primary data records. [2025-09-29T22:09:09.714384] [DEBUG] [MAIN ] FTWO: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:09:09.715298] [INFO ] [MAIN ] FTWO: Generated 1793 derivative records from 1795 primary records. [2025-09-29T22:09:09.715392] [DEBUG] [LOCAL ] FTWO: Saving derivative data. [2025-09-29T22:09:09.748842] [DEBUG] [LOCAL ] FTWO: Derivative data saved (1793 records). [2025-09-29T22:09:09.749214] [DEBUG] [MAIN ] FTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:09.749615] [INFO ] [MAIN ] FTWO: Successfully saved derivative data. [2025-09-29T22:09:09.751809] [INFO ] [MAIN ] Derivative Progress: 709/2057 symbols completed. FTWO took 1.2s. Estimated remaining: 9m 10s. Rate: 147.0 symbols/min [2025-09-29T22:09:09.752720] [INFO ] [MAIN ] FTS: Generated 1794 derivative records from 42097 primary records. [2025-09-29T22:09:09.753056] [DEBUG] [LOCAL ] FTS: Saving derivative data. [2025-09-29T22:09:09.752932] [INFO ] [MAIN ] FUBO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:09.773305] [DEBUG] [LOCAL ] FTS: Derivative data saved (1794 records). [2025-09-29T22:09:09.773504] [INFO ] [MAIN ] FTS: Successfully saved derivative data. [2025-09-29T22:09:09.775726] [INFO ] [MAIN ] Derivative Progress: 710/2057 symbols completed. FTS took 1.3s. Estimated remaining: 9m 9s. Rate: 147.2 symbols/min [2025-09-29T22:09:09.776910] [INFO ] [MAIN ] FUL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:09.793424] [DEBUG] [MAIN ] FTV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:09.794233] [INFO ] [MAIN ] FTV: Generated 1794 derivative records from 52922 primary records. [2025-09-29T22:09:09.794318] [DEBUG] [LOCAL ] FTV: Saving derivative data. [2025-09-29T22:09:09.825301] [DEBUG] [LOCAL ] FTV: Derivative data saved (1794 records). [2025-09-29T22:09:09.825515] [INFO ] [MAIN ] FTV: Successfully saved derivative data. [2025-09-29T22:09:09.827456] [INFO ] [MAIN ] Derivative Progress: 711/2057 symbols completed. FTV took 1.2s. Estimated remaining: 9m 8s. Rate: 147.4 symbols/min [2025-09-29T22:09:09.827593] [INFO ] [MAIN ] FUN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:09.856484] [DEBUG] [LOCAL ] FUBO: Loaded 53695 existing records from primary storage. [2025-09-29T22:09:09.856876] [INFO ] [MAIN ] FUBO: Loaded 53695 primary data records. [2025-09-29T22:09:09.967877] [DEBUG] [LOCAL ] FUL: Loaded 33014 existing records from primary storage. [2025-09-29T22:09:09.980493] [INFO ] [MAIN ] FUL: Loaded 33014 primary data records. [2025-09-29T22:09:10.536786] [DEBUG] [LOCAL ] FUN: Loaded 51585 existing records from primary storage. [2025-09-29T22:09:10.537102] [INFO ] [MAIN ] FUN: Loaded 51585 primary data records. [2025-09-29T22:09:10.882748] [DEBUG] [MAIN ] FUBO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:10.885357] [INFO ] [MAIN ] FUBO: Generated 1794 derivative records from 53695 primary records. [2025-09-29T22:09:10.886157] [DEBUG] [LOCAL ] FUBO: Saving derivative data. [2025-09-29T22:09:10.924443] [DEBUG] [MAIN ] FUL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:10.925100] [DEBUG] [LOCAL ] FUBO: Derivative data saved (1794 records). [2025-09-29T22:09:10.925335] [INFO ] [MAIN ] FUBO: Successfully saved derivative data. [2025-09-29T22:09:10.926206] [INFO ] [MAIN ] FUL: Generated 1794 derivative records from 33014 primary records. [2025-09-29T22:09:10.926480] [DEBUG] [LOCAL ] FUL: Saving derivative data. [2025-09-29T22:09:10.930056] [INFO ] [MAIN ] Derivative Progress: 712/2057 symbols completed. FUBO took 1.2s. Estimated remaining: 9m 9s. Rate: 147.0 symbols/min [2025-09-29T22:09:10.930624] [INFO ] [MAIN ] FVR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:10.948807] [DEBUG] [LOCAL ] FUL: Derivative data saved (1794 records). [2025-09-29T22:09:10.949277] [INFO ] [MAIN ] FUL: Successfully saved derivative data. [2025-09-29T22:09:10.952434] [INFO ] [MAIN ] Derivative Progress: 713/2057 symbols completed. FUL took 1.2s. Estimated remaining: 9m 8s. Rate: 147.2 symbols/min [2025-09-29T22:09:10.954470] [INFO ] [MAIN ] FVRR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:10.969310] [DEBUG] [MAIN ] FUN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:10.970182] [INFO ] [MAIN ] FUN: Generated 1794 derivative records from 51585 primary records. [2025-09-29T22:09:10.975806] [DEBUG] [LOCAL ] FUN: Saving derivative data. [2025-09-29T22:09:11.006130] [DEBUG] [LOCAL ] FVR: Loaded 21881 existing records from primary storage. [2025-09-29T22:09:11.007060] [INFO ] [MAIN ] FVR: Loaded 21881 primary data records. [2025-09-29T22:09:11.111545] [DEBUG] [LOCAL ] FUN: Derivative data saved (1794 records). [2025-09-29T22:09:11.132870] [INFO ] [MAIN ] FUN: Successfully saved derivative data. [2025-09-29T22:09:11.168421] [INFO ] [MAIN ] Derivative Progress: 714/2057 symbols completed. FUN took 1.3s. Estimated remaining: 9m 7s. Rate: 147.3 symbols/min [2025-09-29T22:09:11.189665] [INFO ] [MAIN ] FXED: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:11.213561] [DEBUG] [LOCAL ] FVRR: Loaded 40008 existing records from primary storage. [2025-09-29T22:09:11.239566] [INFO ] [MAIN ] FVRR: Loaded 40008 primary data records. [2025-09-29T22:09:11.433186] [DEBUG] [LOCAL ] FXED: Loaded 1240 existing records from primary storage. [2025-09-29T22:09:11.446608] [INFO ] [MAIN ] FXED: Loaded 1240 primary data records. [2025-09-29T22:09:12.076470] [DEBUG] [MAIN ] FVR: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:09:12.077343] [INFO ] [MAIN ] FVR: Generated 1793 derivative records from 21881 primary records. [2025-09-29T22:09:12.077596] [DEBUG] [LOCAL ] FVR: Saving derivative data. [2025-09-29T22:09:12.124982] [DEBUG] [MAIN ] FVRR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:12.133258] [DEBUG] [LOCAL ] FVR: Derivative data saved (1793 records). [2025-09-29T22:09:12.135282] [INFO ] [MAIN ] FVRR: Generated 1794 derivative records from 40008 primary records. [2025-09-29T22:09:12.135469] [INFO ] [MAIN ] FVR: Successfully saved derivative data. [2025-09-29T22:09:12.138046] [INFO ] [MAIN ] Derivative Progress: 715/2057 symbols completed. FVR took 1.2s. Estimated remaining: 9m 8s. Rate: 147.0 symbols/min [2025-09-29T22:09:12.135848] [DEBUG] [LOCAL ] FVRR: Saving derivative data. [2025-09-29T22:09:12.138558] [DEBUG] [MAIN ] FXED: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:12.140206] [INFO ] [MAIN ] FXED: Generated 1794 derivative records from 1240 primary records. [2025-09-29T22:09:12.140903] [DEBUG] [LOCAL ] FXED: Saving derivative data. [2025-09-29T22:09:12.139100] [INFO ] [MAIN ] G: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:12.172562] [DEBUG] [LOCAL ] FXED: Derivative data saved (1794 records). [2025-09-29T22:09:12.173722] [INFO ] [MAIN ] FXED: Successfully saved derivative data. [2025-09-29T22:09:12.176009] [INFO ] [MAIN ] Derivative Progress: 716/2057 symbols completed. FXED took 1.0s. Estimated remaining: 9m 7s. Rate: 147.2 symbols/min [2025-09-29T22:09:12.176338] [INFO ] [MAIN ] GAB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:12.173593] [DEBUG] [LOCAL ] FVRR: Derivative data saved (1794 records). [2025-09-29T22:09:12.177028] [INFO ] [MAIN ] FVRR: Successfully saved derivative data. [2025-09-29T22:09:12.179739] [INFO ] [MAIN ] Derivative Progress: 717/2057 symbols completed. FVRR took 1.2s. Estimated remaining: 9m 5s. Rate: 147.4 symbols/min [2025-09-29T22:09:12.180124] [INFO ] [MAIN ] GAM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:12.188617] [DEBUG] [LOCAL ] GAM: Loaded 4065 existing records from primary storage. [2025-09-29T22:09:12.189022] [INFO ] [MAIN ] GAM: Loaded 4065 primary data records. [2025-09-29T22:09:12.417149] [DEBUG] [LOCAL ] GAB: Loaded 28038 existing records from primary storage. [2025-09-29T22:09:12.543699] [INFO ] [MAIN ] GAB: Loaded 28038 primary data records. [2025-09-29T22:09:12.586817] [DEBUG] [LOCAL ] G: Loaded 49797 existing records from primary storage. [2025-09-29T22:09:12.611843] [INFO ] [MAIN ] G: Loaded 49797 primary data records. [2025-09-29T22:09:13.216957] [DEBUG] [MAIN ] GAM: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:09:13.219055] [INFO ] [MAIN ] GAM: Generated 1793 derivative records from 4065 primary records. [2025-09-29T22:09:13.219485] [DEBUG] [LOCAL ] GAM: Saving derivative data. [2025-09-29T22:09:13.236850] [DEBUG] [LOCAL ] GAM: Derivative data saved (1793 records). [2025-09-29T22:09:13.237195] [INFO ] [MAIN ] GAM: Successfully saved derivative data. [2025-09-29T22:09:13.239543] [INFO ] [MAIN ] Derivative Progress: 718/2057 symbols completed. GAM took 1.1s. Estimated remaining: 9m 6s. Rate: 147.1 symbols/min [2025-09-29T22:09:13.261383] [DEBUG] [MAIN ] GAB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:13.262481] [INFO ] [MAIN ] GAB: Generated 1794 derivative records from 28038 primary records. [2025-09-29T22:09:13.262678] [DEBUG] [LOCAL ] GAB: Saving derivative data. [2025-09-29T22:09:13.275555] [DEBUG] [MAIN ] G: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:13.277283] [INFO ] [MAIN ] G: Generated 1794 derivative records from 49797 primary records. [2025-09-29T22:09:13.277608] [DEBUG] [LOCAL ] G: Saving derivative data. [2025-09-29T22:09:13.301126] [DEBUG] [LOCAL ] GAB: Derivative data saved (1794 records). [2025-09-29T22:09:13.303890] [INFO ] [MAIN ] GAB: Successfully saved derivative data. [2025-09-29T22:09:13.306784] [INFO ] [MAIN ] Derivative Progress: 719/2057 symbols completed. GAB took 1.1s. Estimated remaining: 9m 5s. Rate: 147.2 symbols/min [2025-09-29T22:09:13.311222] [DEBUG] [LOCAL ] G: Derivative data saved (1794 records). [2025-09-29T22:09:13.311295] [INFO ] [MAIN ] G: Successfully saved derivative data. [2025-09-29T22:09:13.313477] [INFO ] [MAIN ] Derivative Progress: 720/2057 symbols completed. G took 1.2s. Estimated remaining: 9m 4s. Rate: 147.4 symbols/min [2025-09-29T22:09:13.313912] [INFO ] [MAIN ] GAP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:13.314053] [INFO ] [MAIN ] GATX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:13.314540] [INFO ] [MAIN ] GBAB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:13.336760] [DEBUG] [LOCAL ] GBAB: Loaded 13065 existing records from primary storage. [2025-09-29T22:09:13.337050] [INFO ] [MAIN ] GBAB: Loaded 13065 primary data records. [2025-09-29T22:09:13.442785] [DEBUG] [LOCAL ] GATX: Loaded 18170 existing records from primary storage. [2025-09-29T22:09:13.467938] [INFO ] [MAIN ] GATX: Loaded 18170 primary data records. [2025-09-29T22:09:13.837591] [DEBUG] [LOCAL ] GAP: Loaded 53655 existing records from primary storage. [2025-09-29T22:09:13.857285] [INFO ] [MAIN ] GAP: Loaded 53655 primary data records. [2025-09-29T22:09:14.423976] [DEBUG] [MAIN ] GBAB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:14.425822] [INFO ] [MAIN ] GBAB: Generated 1794 derivative records from 13065 primary records. [2025-09-29T22:09:14.434247] [DEBUG] [LOCAL ] GBAB: Saving derivative data. [2025-09-29T22:09:14.444125] [DEBUG] [MAIN ] GATX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:14.461384] [DEBUG] [LOCAL ] GBAB: Derivative data saved (1794 records). [2025-09-29T22:09:14.461535] [INFO ] [MAIN ] GBAB: Successfully saved derivative data. [2025-09-29T22:09:14.459979] [INFO ] [MAIN ] GATX: Generated 1794 derivative records from 18170 primary records. [2025-09-29T22:09:14.464152] [INFO ] [MAIN ] Derivative Progress: 721/2057 symbols completed. GBAB took 1.1s. Estimated remaining: 9m 5s. Rate: 147.1 symbols/min [2025-09-29T22:09:14.464474] [DEBUG] [LOCAL ] GATX: Saving derivative data. [2025-09-29T22:09:14.464682] [INFO ] [MAIN ] GBCI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:14.486430] [DEBUG] [LOCAL ] GATX: Derivative data saved (1794 records). [2025-09-29T22:09:14.487451] [INFO ] [MAIN ] GATX: Successfully saved derivative data. [2025-09-29T22:09:14.489909] [INFO ] [MAIN ] Derivative Progress: 722/2057 symbols completed. GATX took 1.2s. Estimated remaining: 9m 4s. Rate: 147.3 symbols/min [2025-09-29T22:09:14.490218] [INFO ] [MAIN ] GBTG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:14.504767] [DEBUG] [MAIN ] GAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:14.505673] [INFO ] [MAIN ] GAP: Generated 1794 derivative records from 53655 primary records. [2025-09-29T22:09:14.505816] [DEBUG] [LOCAL ] GAP: Saving derivative data. [2025-09-29T22:09:14.532602] [DEBUG] [LOCAL ] GAP: Derivative data saved (1794 records). [2025-09-29T22:09:14.532787] [INFO ] [MAIN ] GAP: Successfully saved derivative data. [2025-09-29T22:09:14.535093] [INFO ] [MAIN ] Derivative Progress: 723/2057 symbols completed. GAP took 1.2s. Estimated remaining: 9m 3s. Rate: 147.4 symbols/min [2025-09-29T22:09:14.535382] [INFO ] [MAIN ] GBX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:14.551204] [DEBUG] [LOCAL ] GBCI: Loaded 40061 existing records from primary storage. [2025-09-29T22:09:14.551435] [INFO ] [MAIN ] GBCI: Loaded 40061 primary data records. [2025-09-29T22:09:14.729150] [DEBUG] [LOCAL ] GBTG: Loaded 40026 existing records from primary storage. [2025-09-29T22:09:14.722850] [DEBUG] [LOCAL ] GBX: Loaded 29132 existing records from primary storage. [2025-09-29T22:09:14.745922] [INFO ] [MAIN ] GBTG: Loaded 40026 primary data records. [2025-09-29T22:09:14.745837] [INFO ] [MAIN ] GBX: Loaded 29132 primary data records. [2025-09-29T22:09:15.656890] [DEBUG] [MAIN ] GBCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:15.657862] [INFO ] [MAIN ] GBCI: Generated 1794 derivative records from 40061 primary records. [2025-09-29T22:09:15.658044] [DEBUG] [LOCAL ] GBCI: Saving derivative data. [2025-09-29T22:09:15.678247] [DEBUG] [LOCAL ] GBCI: Derivative data saved (1794 records). [2025-09-29T22:09:15.678504] [INFO ] [MAIN ] GBCI: Successfully saved derivative data. [2025-09-29T22:09:15.680804] [INFO ] [MAIN ] Derivative Progress: 724/2057 symbols completed. GBCI took 1.2s. Estimated remaining: 9m 4s. Rate: 147.1 symbols/min [2025-09-29T22:09:15.681984] [INFO ] [MAIN ] GCI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:15.703037] [DEBUG] [MAIN ] GBTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:15.716390] [INFO ] [MAIN ] GBTG: Generated 1794 derivative records from 40026 primary records. [2025-09-29T22:09:15.716823] [DEBUG] [LOCAL ] GBTG: Saving derivative data. [2025-09-29T22:09:15.717068] [DEBUG] [MAIN ] GBX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:15.717782] [INFO ] [MAIN ] GBX: Generated 1794 derivative records from 29132 primary records. [2025-09-29T22:09:15.718524] [DEBUG] [LOCAL ] GBX: Saving derivative data. [2025-09-29T22:09:15.748030] [DEBUG] [LOCAL ] GBTG: Derivative data saved (1794 records). [2025-09-29T22:09:15.748374] [INFO ] [MAIN ] GBTG: Successfully saved derivative data. [2025-09-29T22:09:15.750946] [INFO ] [MAIN ] Derivative Progress: 725/2057 symbols completed. GBTG took 1.3s. Estimated remaining: 9m 3s. Rate: 147.2 symbols/min [2025-09-29T22:09:15.761959] [INFO ] [MAIN ] GCO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:15.763449] [DEBUG] [LOCAL ] GBX: Derivative data saved (1794 records). [2025-09-29T22:09:15.763602] [INFO ] [MAIN ] GBX: Successfully saved derivative data. [2025-09-29T22:09:15.765965] [INFO ] [MAIN ] Derivative Progress: 726/2057 symbols completed. GBX took 1.2s. Estimated remaining: 9m 2s. Rate: 147.4 symbols/min [2025-09-29T22:09:15.766314] [INFO ] [MAIN ] GCTS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:15.782181] [DEBUG] [LOCAL ] GCI: Loaded 44152 existing records from primary storage. [2025-09-29T22:09:15.782404] [INFO ] [MAIN ] GCI: Loaded 44152 primary data records. [2025-09-29T22:09:15.964806] [DEBUG] [LOCAL ] GCTS: Loaded 19896 existing records from primary storage. [2025-09-29T22:09:15.965685] [DEBUG] [LOCAL ] GCO: Loaded 24869 existing records from primary storage. [2025-09-29T22:09:15.996210] [INFO ] [MAIN ] GCTS: Loaded 19896 primary data records. [2025-09-29T22:09:15.996089] [INFO ] [MAIN ] GCO: Loaded 24869 primary data records. [2025-09-29T22:09:16.793691] [DEBUG] [MAIN ] GCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:16.795025] [INFO ] [MAIN ] GCI: Generated 1794 derivative records from 44152 primary records. [2025-09-29T22:09:16.795441] [DEBUG] [LOCAL ] GCI: Saving derivative data. [2025-09-29T22:09:16.817395] [DEBUG] [LOCAL ] GCI: Derivative data saved (1794 records). [2025-09-29T22:09:16.818572] [INFO ] [MAIN ] GCI: Successfully saved derivative data. [2025-09-29T22:09:16.820862] [INFO ] [MAIN ] Derivative Progress: 727/2057 symbols completed. GCI took 1.1s. Estimated remaining: 9m 2s. Rate: 147.1 symbols/min [2025-09-29T22:09:16.821288] [INFO ] [MAIN ] GCV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:16.836258] [DEBUG] [MAIN ] GCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:16.837323] [INFO ] [MAIN ] GCO: Generated 1794 derivative records from 24869 primary records. [2025-09-29T22:09:16.839772] [DEBUG] [LOCAL ] GCO: Saving derivative data. [2025-09-29T22:09:16.856504] [DEBUG] [LOCAL ] GCV: Loaded 7301 existing records from primary storage. [2025-09-29T22:09:16.858263] [INFO ] [MAIN ] GCV: Loaded 7301 primary data records. [2025-09-29T22:09:16.962813] [DEBUG] [LOCAL ] GCO: Derivative data saved (1794 records). [2025-09-29T22:09:16.962952] [INFO ] [MAIN ] GCO: Successfully saved derivative data. [2025-09-29T22:09:16.954998] [DEBUG] [MAIN ] GCTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:16.968887] [INFO ] [MAIN ] GCTS: Generated 1794 derivative records from 19896 primary records. [2025-09-29T22:09:16.976264] [INFO ] [MAIN ] Derivative Progress: 728/2057 symbols completed. GCO took 1.2s. Estimated remaining: 9m 2s. Rate: 147.2 symbols/min [2025-09-29T22:09:16.982670] [DEBUG] [LOCAL ] GCTS: Saving derivative data. [2025-09-29T22:09:16.982843] [INFO ] [MAIN ] GD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:17.223845] [DEBUG] [LOCAL ] GCTS: Derivative data saved (1794 records). [2025-09-29T22:09:17.224448] [INFO ] [MAIN ] GCTS: Successfully saved derivative data. [2025-09-29T22:09:17.226809] [INFO ] [MAIN ] Derivative Progress: 729/2057 symbols completed. GCTS took 1.5s. Estimated remaining: 9m 1s. Rate: 147.3 symbols/min [2025-09-29T22:09:17.227301] [INFO ] [MAIN ] GDDY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:17.281838] [DEBUG] [LOCAL ] GD: Loaded 47179 existing records from primary storage. [2025-09-29T22:09:17.282427] [INFO ] [MAIN ] GD: Loaded 47179 primary data records. [2025-09-29T22:09:17.282312] [DEBUG] [MAIN ] GCV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:17.286374] [INFO ] [MAIN ] GCV: Generated 1794 derivative records from 7301 primary records. [2025-09-29T22:09:17.318230] [DEBUG] [LOCAL ] GCV: Saving derivative data. [2025-09-29T22:09:17.654763] [DEBUG] [LOCAL ] GCV: Derivative data saved (1794 records). [2025-09-29T22:09:17.657341] [DEBUG] [LOCAL ] GDDY: Loaded 49651 existing records from primary storage. [2025-09-29T22:09:17.657631] [INFO ] [MAIN ] GDDY: Loaded 49651 primary data records. [2025-09-29T22:09:17.657566] [INFO ] [MAIN ] GCV: Successfully saved derivative data. [2025-09-29T22:09:17.671989] [INFO ] [MAIN ] Derivative Progress: 730/2057 symbols completed. GCV took 0.9s. Estimated remaining: 9m 1s. Rate: 147.3 symbols/min [2025-09-29T22:09:17.699903] [INFO ] [MAIN ] GDIV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:17.781443] [DEBUG] [LOCAL ] GDIV: Loaded 3642 existing records from primary storage. [2025-09-29T22:09:17.807742] [INFO ] [MAIN ] GDIV: Loaded 3642 primary data records. [2025-09-29T22:09:18.383471] [DEBUG] [MAIN ] GD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:18.384702] [INFO ] [MAIN ] GD: Generated 1794 derivative records from 47179 primary records. [2025-09-29T22:09:18.385121] [DEBUG] [LOCAL ] GD: Saving derivative data. [2025-09-29T22:09:18.438861] [DEBUG] [MAIN ] GDDY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:18.439961] [INFO ] [MAIN ] GDDY: Generated 1794 derivative records from 49651 primary records. [2025-09-29T22:09:18.438439] [DEBUG] [LOCAL ] GD: Derivative data saved (1794 records). [2025-09-29T22:09:18.440328] [DEBUG] [LOCAL ] GDDY: Saving derivative data. [2025-09-29T22:09:18.440237] [INFO ] [MAIN ] GD: Successfully saved derivative data. [2025-09-29T22:09:18.443441] [INFO ] [MAIN ] Derivative Progress: 731/2057 symbols completed. GD took 1.5s. Estimated remaining: 9m 1s. Rate: 147.1 symbols/min [2025-09-29T22:09:18.443722] [INFO ] [MAIN ] GDO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:18.469969] [DEBUG] [LOCAL ] GDDY: Derivative data saved (1794 records). [2025-09-29T22:09:18.471058] [INFO ] [MAIN ] GDDY: Successfully saved derivative data. [2025-09-29T22:09:18.473803] [INFO ] [MAIN ] Derivative Progress: 732/2057 symbols completed. GDDY took 1.2s. Estimated remaining: 8m 60s. Rate: 147.3 symbols/min [2025-09-29T22:09:18.474030] [INFO ] [MAIN ] GDOT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:18.498941] [DEBUG] [LOCAL ] GDO: Loaded 5949 existing records from primary storage. [2025-09-29T22:09:18.499487] [INFO ] [MAIN ] GDO: Loaded 5949 primary data records. [2025-09-29T22:09:18.500114] [DEBUG] [MAIN ] GDIV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:09:18.525242] [INFO ] [MAIN ] GDIV: Generated 1793 derivative records from 3642 primary records. [2025-09-29T22:09:18.542894] [DEBUG] [LOCAL ] GDIV: Saving derivative data. [2025-09-29T22:09:18.705557] [DEBUG] [LOCAL ] GDIV: Derivative data saved (1793 records). [2025-09-29T22:09:18.750572] [INFO ] [MAIN ] GDIV: Successfully saved derivative data. [2025-09-29T22:09:18.879208] [INFO ] [MAIN ] Derivative Progress: 733/2057 symbols completed. GDIV took 1.2s. Estimated remaining: 8m 59s. Rate: 147.3 symbols/min [2025-09-29T22:09:18.880707] [DEBUG] [LOCAL ] GDOT: Loaded 38421 existing records from primary storage. [2025-09-29T22:09:18.880938] [INFO ] [MAIN ] GDOT: Loaded 38421 primary data records. [2025-09-29T22:09:19.220094] [DEBUG] [MAIN ] GDO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:19.221007] [INFO ] [MAIN ] GDO: Generated 1794 derivative records from 5949 primary records. [2025-09-29T22:09:19.221227] [DEBUG] [LOCAL ] GDO: Saving derivative data. [2025-09-29T22:09:19.240116] [DEBUG] [LOCAL ] GDO: Derivative data saved (1794 records). [2025-09-29T22:09:19.240340] [INFO ] [MAIN ] GDO: Successfully saved derivative data. [2025-09-29T22:09:19.242823] [INFO ] [MAIN ] Derivative Progress: 734/2057 symbols completed. GDO took 0.8s. Estimated remaining: 8m 59s. Rate: 147.3 symbols/min [2025-09-29T22:09:19.258373] [DEBUG] [MAIN ] GDOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:19.259096] [INFO ] [MAIN ] GDOT: Generated 1794 derivative records from 38421 primary records. [2025-09-29T22:09:19.259163] [DEBUG] [LOCAL ] GDOT: Saving derivative data. [2025-09-29T22:09:19.274861] [DEBUG] [LOCAL ] GDOT: Derivative data saved (1794 records). [2025-09-29T22:09:19.274953] [INFO ] [MAIN ] GDOT: Successfully saved derivative data. [2025-09-29T22:09:19.276912] [INFO ] [MAIN ] Derivative Progress: 735/2057 symbols completed. GDOT took 0.8s. Estimated remaining: 8m 58s. Rate: 147.5 symbols/min [2025-09-29T22:09:19.277451] [INFO ] [MAIN ] GEF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:19.277705] [INFO ] [MAIN ] GDV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:19.277556] [INFO ] [MAIN ] GE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:19.306771] [DEBUG] [LOCAL ] GEF: Loaded 20543 existing records from primary storage. [2025-09-29T22:09:19.307097] [INFO ] [MAIN ] GEF: Loaded 20543 primary data records. [2025-09-29T22:09:19.384908] [DEBUG] [LOCAL ] GDV: Loaded 19569 existing records from primary storage. [2025-09-29T22:09:19.413399] [INFO ] [MAIN ] GDV: Loaded 19569 primary data records. [2025-09-29T22:09:19.778368] [DEBUG] [LOCAL ] GE: Loaded 53713 existing records from primary storage. [2025-09-29T22:09:19.789668] [INFO ] [MAIN ] GE: Loaded 53713 primary data records. [2025-09-29T22:09:20.393411] [DEBUG] [MAIN ] GEF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:20.395094] [INFO ] [MAIN ] GEF: Generated 1794 derivative records from 20543 primary records. [2025-09-29T22:09:20.395506] [DEBUG] [LOCAL ] GEF: Saving derivative data. [2025-09-29T22:09:20.429974] [DEBUG] [MAIN ] GDV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:20.432208] [INFO ] [MAIN ] GDV: Generated 1794 derivative records from 19569 primary records. [2025-09-29T22:09:20.432376] [DEBUG] [LOCAL ] GDV: Saving derivative data. [2025-09-29T22:09:20.442520] [DEBUG] [LOCAL ] GEF: Derivative data saved (1794 records). [2025-09-29T22:09:20.443911] [INFO ] [MAIN ] GEF: Successfully saved derivative data. [2025-09-29T22:09:20.448950] [INFO ] [MAIN ] Derivative Progress: 736/2057 symbols completed. GEF took 1.2s. Estimated remaining: 8m 59s. Rate: 147.1 symbols/min [2025-09-29T22:09:20.449984] [INFO ] [MAIN ] GEL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:20.458395] [DEBUG] [LOCAL ] GDV: Derivative data saved (1794 records). [2025-09-29T22:09:20.458709] [INFO ] [MAIN ] GDV: Successfully saved derivative data. [2025-09-29T22:09:20.461072] [INFO ] [MAIN ] Derivative Progress: 737/2057 symbols completed. GDV took 1.2s. Estimated remaining: 8m 58s. Rate: 147.3 symbols/min [2025-09-29T22:09:20.461685] [INFO ] [MAIN ] GENI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:20.475526] [DEBUG] [MAIN ] GE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:20.476667] [INFO ] [MAIN ] GE: Generated 1794 derivative records from 53713 primary records. [2025-09-29T22:09:20.476739] [DEBUG] [LOCAL ] GE: Saving derivative data. [2025-09-29T22:09:20.494435] [DEBUG] [LOCAL ] GE: Derivative data saved (1794 records). [2025-09-29T22:09:20.494570] [INFO ] [MAIN ] GE: Successfully saved derivative data. [2025-09-29T22:09:20.497104] [INFO ] [MAIN ] Derivative Progress: 738/2057 symbols completed. GE took 1.2s. Estimated remaining: 8m 56s. Rate: 147.5 symbols/min [2025-09-29T22:09:20.497552] [INFO ] [MAIN ] GEO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:20.543775] [DEBUG] [LOCAL ] GEL: Loaded 33432 existing records from primary storage. [2025-09-29T22:09:20.544630] [INFO ] [MAIN ] GEL: Loaded 33432 primary data records. [2025-09-29T22:09:20.620314] [DEBUG] [LOCAL ] GENI: Loaded 52916 existing records from primary storage. [2025-09-29T22:09:20.620479] [INFO ] [MAIN ] GENI: Loaded 52916 primary data records. [2025-09-29T22:09:20.933516] [DEBUG] [LOCAL ] GEO: Loaded 51992 existing records from primary storage. [2025-09-29T22:09:21.118723] [INFO ] [MAIN ] GEO: Loaded 51992 primary data records. [2025-09-29T22:09:21.620404] [DEBUG] [MAIN ] GENI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:21.621838] [INFO ] [MAIN ] GENI: Generated 1794 derivative records from 52916 primary records. [2025-09-29T22:09:21.620853] [DEBUG] [MAIN ] GEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:21.622500] [INFO ] [MAIN ] GEL: Generated 1794 derivative records from 33432 primary records. [2025-09-29T22:09:21.622672] [DEBUG] [LOCAL ] GENI: Saving derivative data. [2025-09-29T22:09:21.623613] [DEBUG] [LOCAL ] GEL: Saving derivative data. [2025-09-29T22:09:21.658349] [DEBUG] [LOCAL ] GEL: Derivative data saved (1794 records). [2025-09-29T22:09:21.659072] [INFO ] [MAIN ] GEL: Successfully saved derivative data. [2025-09-29T22:09:21.661489] [INFO ] [MAIN ] Derivative Progress: 739/2057 symbols completed. GEL took 1.2s. Estimated remaining: 8m 57s. Rate: 147.1 symbols/min [2025-09-29T22:09:21.661849] [DEBUG] [LOCAL ] GENI: Derivative data saved (1794 records). [2025-09-29T22:09:21.662012] [INFO ] [MAIN ] GES: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:21.662235] [INFO ] [MAIN ] GENI: Successfully saved derivative data. [2025-09-29T22:09:21.664530] [INFO ] [MAIN ] Derivative Progress: 740/2057 symbols completed. GENI took 1.2s. Estimated remaining: 8m 56s. Rate: 147.3 symbols/min [2025-09-29T22:09:21.665422] [INFO ] [MAIN ] GETY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:21.684436] [DEBUG] [MAIN ] GEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:21.685352] [INFO ] [MAIN ] GEO: Generated 1794 derivative records from 51992 primary records. [2025-09-29T22:09:21.685511] [DEBUG] [LOCAL ] GEO: Saving derivative data. [2025-09-29T22:09:21.714978] [DEBUG] [LOCAL ] GEO: Derivative data saved (1794 records). [2025-09-29T22:09:21.715140] [INFO ] [MAIN ] GEO: Successfully saved derivative data. [2025-09-29T22:09:21.718285] [INFO ] [MAIN ] Derivative Progress: 741/2057 symbols completed. GEO took 1.2s. Estimated remaining: 8m 55s. Rate: 147.5 symbols/min [2025-09-29T22:09:21.719265] [INFO ] [MAIN ] GEV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:21.740959] [DEBUG] [LOCAL ] GETY: Loaded 35719 existing records from primary storage. [2025-09-29T22:09:21.741354] [INFO ] [MAIN ] GETY: Loaded 35719 primary data records. [2025-09-29T22:09:21.866814] [DEBUG] [LOCAL ] GES: Loaded 39554 existing records from primary storage. [2025-09-29T22:09:21.878029] [INFO ] [MAIN ] GES: Loaded 39554 primary data records. [2025-09-29T22:09:22.345769] [DEBUG] [LOCAL ] GEV: Loaded 53076 existing records from primary storage. [2025-09-29T22:09:22.466833] [INFO ] [MAIN ] GEV: Loaded 53076 primary data records. [2025-09-29T22:09:22.840808] [DEBUG] [MAIN ] GETY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:22.856250] [INFO ] [MAIN ] GETY: Generated 1794 derivative records from 35719 primary records. [2025-09-29T22:09:22.857391] [DEBUG] [LOCAL ] GETY: Saving derivative data. [2025-09-29T22:09:22.877897] [DEBUG] [LOCAL ] GETY: Derivative data saved (1794 records). [2025-09-29T22:09:22.878565] [INFO ] [MAIN ] GETY: Successfully saved derivative data. [2025-09-29T22:09:22.880818] [INFO ] [MAIN ] Derivative Progress: 742/2057 symbols completed. GETY took 1.2s. Estimated remaining: 8m 56s. Rate: 147.1 symbols/min [2025-09-29T22:09:22.882352] [INFO ] [MAIN ] GF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:22.901241] [DEBUG] [MAIN ] GES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:22.902307] [INFO ] [MAIN ] GES: Generated 1794 derivative records from 39554 primary records. [2025-09-29T22:09:22.905394] [DEBUG] [LOCAL ] GES: Saving derivative data. [2025-09-29T22:09:22.905161] [DEBUG] [LOCAL ] GF: Loaded 3023 existing records from primary storage. [2025-09-29T22:09:22.906616] [INFO ] [MAIN ] GF: Loaded 3023 primary data records. [2025-09-29T22:09:23.093021] [DEBUG] [LOCAL ] GES: Derivative data saved (1794 records). [2025-09-29T22:09:23.131559] [INFO ] [MAIN ] GES: Successfully saved derivative data. [2025-09-29T22:09:23.133723] [INFO ] [MAIN ] Derivative Progress: 743/2057 symbols completed. GES took 1.5s. Estimated remaining: 8m 56s. Rate: 147.2 symbols/min [2025-09-29T22:09:23.106798] [DEBUG] [MAIN ] GEV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:23.135146] [INFO ] [MAIN ] GFF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:23.135002] [INFO ] [MAIN ] GEV: Generated 1794 derivative records from 53076 primary records. [2025-09-29T22:09:23.141763] [DEBUG] [LOCAL ] GEV: Saving derivative data. [2025-09-29T22:09:23.281268] [DEBUG] [LOCAL ] GEV: Derivative data saved (1794 records). [2025-09-29T22:09:23.281830] [INFO ] [MAIN ] GEV: Successfully saved derivative data. [2025-09-29T22:09:23.284282] [INFO ] [MAIN ] Derivative Progress: 744/2057 symbols completed. GEV took 1.6s. Estimated remaining: 8m 55s. Rate: 147.3 symbols/min [2025-09-29T22:09:23.284600] [INFO ] [MAIN ] GFI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:23.313386] [DEBUG] [LOCAL ] GFF: Loaded 30447 existing records from primary storage. [2025-09-29T22:09:23.313849] [INFO ] [MAIN ] GFF: Loaded 30447 primary data records. [2025-09-29T22:09:23.362997] [DEBUG] [MAIN ] GF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:23.382347] [INFO ] [MAIN ] GF: Generated 1794 derivative records from 3023 primary records. [2025-09-29T22:09:23.412245] [DEBUG] [LOCAL ] GF: Saving derivative data. [2025-09-29T22:09:23.633770] [DEBUG] [LOCAL ] GF: Derivative data saved (1794 records). [2025-09-29T22:09:23.677269] [INFO ] [MAIN ] GF: Successfully saved derivative data. [2025-09-29T22:09:23.679812] [INFO ] [MAIN ] Derivative Progress: 745/2057 symbols completed. GF took 0.8s. Estimated remaining: 8m 54s. Rate: 147.4 symbols/min [2025-09-29T22:09:23.697695] [INFO ] [MAIN ] GFL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:23.699827] [DEBUG] [LOCAL ] GFI: Loaded 53108 existing records from primary storage. [2025-09-29T22:09:23.700240] [INFO ] [MAIN ] GFI: Loaded 53108 primary data records. [2025-09-29T22:09:24.091472] [DEBUG] [LOCAL ] GFL: Loaded 47965 existing records from primary storage. [2025-09-29T22:09:24.097484] [INFO ] [MAIN ] GFL: Loaded 47965 primary data records. [2025-09-29T22:09:24.097931] [DEBUG] [MAIN ] GFF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:24.120867] [INFO ] [MAIN ] GFF: Generated 1794 derivative records from 30447 primary records. [2025-09-29T22:09:24.135989] [DEBUG] [LOCAL ] GFF: Saving derivative data. [2025-09-29T22:09:24.214800] [DEBUG] [LOCAL ] GFF: Derivative data saved (1794 records). [2025-09-29T22:09:24.229855] [INFO ] [MAIN ] GFF: Successfully saved derivative data. [2025-09-29T22:09:24.236195] [INFO ] [MAIN ] Derivative Progress: 746/2057 symbols completed. GFF took 1.1s. Estimated remaining: 8m 54s. Rate: 147.3 symbols/min [2025-09-29T22:09:24.236930] [INFO ] [MAIN ] GFR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:24.497691] [DEBUG] [MAIN ] GFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:24.503218] [DEBUG] [LOCAL ] GFR: Loaded 8377 existing records from primary storage. [2025-09-29T22:09:24.502968] [INFO ] [MAIN ] GFI: Generated 1794 derivative records from 53108 primary records. [2025-09-29T22:09:24.503443] [INFO ] [MAIN ] GFR: Loaded 8377 primary data records. [2025-09-29T22:09:24.503378] [DEBUG] [LOCAL ] GFI: Saving derivative data. [2025-09-29T22:09:24.691570] [DEBUG] [LOCAL ] GFI: Derivative data saved (1794 records). [2025-09-29T22:09:24.725218] [INFO ] [MAIN ] GFI: Successfully saved derivative data. [2025-09-29T22:09:24.757638] [INFO ] [MAIN ] Derivative Progress: 747/2057 symbols completed. GFI took 1.5s. Estimated remaining: 8m 54s. Rate: 147.2 symbols/min [2025-09-29T22:09:24.845787] [INFO ] [MAIN ] GGB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:24.913424] [DEBUG] [MAIN ] GFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:24.915372] [INFO ] [MAIN ] GFL: Generated 1794 derivative records from 47965 primary records. [2025-09-29T22:09:24.915739] [DEBUG] [LOCAL ] GFL: Saving derivative data. [2025-09-29T22:09:24.934049] [DEBUG] [LOCAL ] GFL: Derivative data saved (1794 records). [2025-09-29T22:09:24.934294] [INFO ] [MAIN ] GFL: Successfully saved derivative data. [2025-09-29T22:09:24.936552] [INFO ] [MAIN ] Derivative Progress: 748/2057 symbols completed. GFL took 1.2s. Estimated remaining: 8m 53s. Rate: 147.3 symbols/min [2025-09-29T22:09:24.966830] [DEBUG] [MAIN ] GFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:24.967543] [INFO ] [MAIN ] GFR: Generated 1794 derivative records from 8377 primary records. [2025-09-29T22:09:24.967613] [DEBUG] [LOCAL ] GFR: Saving derivative data. [2025-09-29T22:09:24.995629] [DEBUG] [LOCAL ] GGB: Loaded 51072 existing records from primary storage. [2025-09-29T22:09:24.996234] [INFO ] [MAIN ] GGB: Loaded 51072 primary data records. [2025-09-29T22:09:25.102720] [DEBUG] [LOCAL ] GFR: Derivative data saved (1794 records). [2025-09-29T22:09:25.108593] [INFO ] [MAIN ] GFR: Successfully saved derivative data. [2025-09-29T22:09:25.121075] [INFO ] [MAIN ] Derivative Progress: 749/2057 symbols completed. GFR took 0.9s. Estimated remaining: 8m 52s. Rate: 147.4 symbols/min [2025-09-29T22:09:25.338757] [DEBUG] [MAIN ] GGB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:25.339408] [INFO ] [MAIN ] GGB: Generated 1794 derivative records from 51072 primary records. [2025-09-29T22:09:25.339475] [DEBUG] [LOCAL ] GGB: Saving derivative data. [2025-09-29T22:09:25.356467] [DEBUG] [LOCAL ] GGB: Derivative data saved (1794 records). [2025-09-29T22:09:25.356567] [INFO ] [MAIN ] GGB: Successfully saved derivative data. [2025-09-29T22:09:25.359173] [INFO ] [MAIN ] Derivative Progress: 750/2057 symbols completed. GGB took 0.5s. Estimated remaining: 8m 52s. Rate: 147.5 symbols/min [2025-09-29T22:09:25.359573] [INFO ] [MAIN ] GGG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:25.359879] [INFO ] [MAIN ] GGZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:25.359760] [INFO ] [MAIN ] GHC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:25.369081] [DEBUG] [LOCAL ] GHC: Loaded 2660 existing records from primary storage. [2025-09-29T22:09:25.367084] [DEBUG] [LOCAL ] GGZ: Loaded 2412 existing records from primary storage. [2025-09-29T22:09:25.369275] [INFO ] [MAIN ] GGZ: Loaded 2412 primary data records. [2025-09-29T22:09:25.381770] [INFO ] [MAIN ] GHC: Loaded 2660 primary data records. [2025-09-29T22:09:25.706292] [DEBUG] [LOCAL ] GGG: Loaded 40907 existing records from primary storage. [2025-09-29T22:09:25.914853] [INFO ] [MAIN ] GGG: Loaded 40907 primary data records. [2025-09-29T22:09:26.448025] [DEBUG] [MAIN ] GHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:26.449263] [INFO ] [MAIN ] GHC: Generated 1794 derivative records from 2660 primary records. [2025-09-29T22:09:26.449367] [DEBUG] [LOCAL ] GHC: Saving derivative data. [2025-09-29T22:09:26.481953] [DEBUG] [MAIN ] GGZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:26.483061] [DEBUG] [LOCAL ] GHC: Derivative data saved (1794 records). [2025-09-29T22:09:26.483536] [INFO ] [MAIN ] GHC: Successfully saved derivative data. [2025-09-29T22:09:26.484570] [INFO ] [MAIN ] GGZ: Generated 1794 derivative records from 2412 primary records. [2025-09-29T22:09:26.484724] [DEBUG] [LOCAL ] GGZ: Saving derivative data. [2025-09-29T22:09:26.488089] [INFO ] [MAIN ] Derivative Progress: 751/2057 symbols completed. GHC took 1.1s. Estimated remaining: 8m 52s. Rate: 147.2 symbols/min [2025-09-29T22:09:26.488664] [INFO ] [MAIN ] GHG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:26.505462] [DEBUG] [LOCAL ] GGZ: Derivative data saved (1794 records). [2025-09-29T22:09:26.505676] [INFO ] [MAIN ] GGZ: Successfully saved derivative data. [2025-09-29T22:09:26.510924] [INFO ] [MAIN ] Derivative Progress: 752/2057 symbols completed. GGZ took 1.2s. Estimated remaining: 8m 51s. Rate: 147.4 symbols/min [2025-09-29T22:09:26.511114] [INFO ] [MAIN ] GHI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:26.508474] [DEBUG] [LOCAL ] GHG: Loaded 3192 existing records from primary storage. [2025-09-29T22:09:26.513576] [INFO ] [MAIN ] GHG: Loaded 3192 primary data records. [2025-09-29T22:09:26.610910] [DEBUG] [MAIN ] GGG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:26.628774] [INFO ] [MAIN ] GGG: Generated 1794 derivative records from 40907 primary records. [2025-09-29T22:09:26.629082] [DEBUG] [LOCAL ] GHI: Loaded 6929 existing records from primary storage. [2025-09-29T22:09:26.641532] [INFO ] [MAIN ] GHI: Loaded 6929 primary data records. [2025-09-29T22:09:26.629259] [DEBUG] [LOCAL ] GGG: Saving derivative data. [2025-09-29T22:09:27.092931] [DEBUG] [LOCAL ] GGG: Derivative data saved (1794 records). [2025-09-29T22:09:27.093110] [INFO ] [MAIN ] GGG: Successfully saved derivative data. [2025-09-29T22:09:27.214353] [INFO ] [MAIN ] Derivative Progress: 753/2057 symbols completed. GGG took 1.9s. Estimated remaining: 8m 51s. Rate: 147.2 symbols/min [2025-09-29T22:09:27.216171] [INFO ] [MAIN ] GHLD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:27.226916] [DEBUG] [LOCAL ] GHLD: Loaded 4162 existing records from primary storage. [2025-09-29T22:09:27.228023] [INFO ] [MAIN ] GHLD: Loaded 4162 primary data records. [2025-09-29T22:09:27.563941] [DEBUG] [MAIN ] GHG: Filtered 7001 bins outside market hours, 7825 incomplete bins [2025-09-29T22:09:27.564918] [INFO ] [MAIN ] GHG: Generated 1789 derivative records from 3192 primary records. [2025-09-29T22:09:27.578019] [DEBUG] [LOCAL ] GHG: Saving derivative data. [2025-09-29T22:09:27.578607] [DEBUG] [MAIN ] GHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:27.580451] [INFO ] [MAIN ] GHI: Generated 1794 derivative records from 6929 primary records. [2025-09-29T22:09:27.580553] [DEBUG] [LOCAL ] GHI: Saving derivative data. [2025-09-29T22:09:27.613086] [DEBUG] [LOCAL ] GHI: Derivative data saved (1794 records). [2025-09-29T22:09:27.614859] [INFO ] [MAIN ] GHI: Successfully saved derivative data. [2025-09-29T22:09:27.617211] [INFO ] [MAIN ] Derivative Progress: 754/2057 symbols completed. GHI took 1.1s. Estimated remaining: 8m 51s. Rate: 147.2 symbols/min [2025-09-29T22:09:27.617489] [INFO ] [MAIN ] GHM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:27.614987] [DEBUG] [LOCAL ] GHG: Derivative data saved (1789 records). [2025-09-29T22:09:27.618072] [INFO ] [MAIN ] GHG: Successfully saved derivative data. [2025-09-29T22:09:27.620637] [INFO ] [MAIN ] Derivative Progress: 755/2057 symbols completed. GHG took 1.1s. Estimated remaining: 8m 50s. Rate: 147.4 symbols/min [2025-09-29T22:09:27.621067] [INFO ] [MAIN ] GHY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:27.636928] [DEBUG] [LOCAL ] GHM: Loaded 13966 existing records from primary storage. [2025-09-29T22:09:27.637183] [INFO ] [MAIN ] GHM: Loaded 13966 primary data records. [2025-09-29T22:09:27.795738] [DEBUG] [LOCAL ] GHY: Loaded 20963 existing records from primary storage. [2025-09-29T22:09:27.801479] [INFO ] [MAIN ] GHY: Loaded 20963 primary data records. [2025-09-29T22:09:27.801415] [DEBUG] [MAIN ] GHLD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:27.902161] [INFO ] [MAIN ] GHLD: Generated 1794 derivative records from 4162 primary records. [2025-09-29T22:09:28.059226] [DEBUG] [LOCAL ] GHLD: Saving derivative data. [2025-09-29T22:09:28.389542] [DEBUG] [LOCAL ] GHLD: Derivative data saved (1794 records). [2025-09-29T22:09:28.390090] [INFO ] [MAIN ] GHLD: Successfully saved derivative data. [2025-09-29T22:09:28.393297] [INFO ] [MAIN ] Derivative Progress: 756/2057 symbols completed. GHLD took 1.2s. Estimated remaining: 8m 50s. Rate: 147.2 symbols/min [2025-09-29T22:09:28.394444] [INFO ] [MAIN ] GIB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:28.419604] [DEBUG] [MAIN ] GHM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:28.420612] [INFO ] [MAIN ] GHM: Generated 1794 derivative records from 13966 primary records. [2025-09-29T22:09:28.420838] [DEBUG] [LOCAL ] GHM: Saving derivative data. [2025-09-29T22:09:28.464351] [DEBUG] [LOCAL ] GHM: Derivative data saved (1794 records). [2025-09-29T22:09:28.473200] [INFO ] [MAIN ] GHM: Successfully saved derivative data. [2025-09-29T22:09:28.475532] [INFO ] [MAIN ] Derivative Progress: 757/2057 symbols completed. GHM took 0.9s. Estimated remaining: 8m 49s. Rate: 147.4 symbols/min [2025-09-29T22:09:28.459180] [DEBUG] [MAIN ] GHY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:28.477248] [INFO ] [MAIN ] GIC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:28.478517] [INFO ] [MAIN ] GHY: Generated 1794 derivative records from 20963 primary records. [2025-09-29T22:09:28.479100] [DEBUG] [LOCAL ] GHY: Saving derivative data. [2025-09-29T22:09:28.480186] [DEBUG] [LOCAL ] GIB: Loaded 32054 existing records from primary storage. [2025-09-29T22:09:28.481599] [INFO ] [MAIN ] GIB: Loaded 32054 primary data records. [2025-09-29T22:09:28.619428] [DEBUG] [LOCAL ] GIC: Loaded 13539 existing records from primary storage. [2025-09-29T22:09:28.623293] [INFO ] [MAIN ] GIC: Loaded 13539 primary data records. [2025-09-29T22:09:28.745222] [DEBUG] [LOCAL ] GHY: Derivative data saved (1794 records). [2025-09-29T22:09:28.799993] [INFO ] [MAIN ] GHY: Successfully saved derivative data. [2025-09-29T22:09:28.807623] [INFO ] [MAIN ] Derivative Progress: 758/2057 symbols completed. GHY took 1.2s. Estimated remaining: 8m 49s. Rate: 147.4 symbols/min [2025-09-29T22:09:28.950268] [INFO ] [MAIN ] GIL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:29.236106] [DEBUG] [LOCAL ] GIL: Loaded 43252 existing records from primary storage. [2025-09-29T22:09:29.236603] [INFO ] [MAIN ] GIL: Loaded 43252 primary data records. [2025-09-29T22:09:29.282879] [DEBUG] [MAIN ] GIB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:29.302214] [INFO ] [MAIN ] GIB: Generated 1794 derivative records from 32054 primary records. [2025-09-29T22:09:29.324947] [DEBUG] [LOCAL ] GIB: Saving derivative data. [2025-09-29T22:09:29.412936] [DEBUG] [MAIN ] GIC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:29.433522] [INFO ] [MAIN ] GIC: Generated 1794 derivative records from 13539 primary records. [2025-09-29T22:09:29.434040] [DEBUG] [LOCAL ] GIC: Saving derivative data. [2025-09-29T22:09:29.610241] [DEBUG] [LOCAL ] GIB: Derivative data saved (1794 records). [2025-09-29T22:09:29.611667] [INFO ] [MAIN ] GIB: Successfully saved derivative data. [2025-09-29T22:09:29.614088] [INFO ] [MAIN ] Derivative Progress: 759/2057 symbols completed. GIB took 1.2s. Estimated remaining: 8m 49s. Rate: 147.2 symbols/min [2025-09-29T22:09:29.614501] [INFO ] [MAIN ] GIS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:29.618513] [DEBUG] [LOCAL ] GIC: Derivative data saved (1794 records). [2025-09-29T22:09:29.618879] [INFO ] [MAIN ] GIC: Successfully saved derivative data. [2025-09-29T22:09:29.621168] [INFO ] [MAIN ] Derivative Progress: 760/2057 symbols completed. GIC took 1.1s. Estimated remaining: 8m 48s. Rate: 147.4 symbols/min [2025-09-29T22:09:29.621591] [INFO ] [MAIN ] GKOS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:29.643919] [DEBUG] [MAIN ] GIL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:29.644638] [INFO ] [MAIN ] GIL: Generated 1794 derivative records from 43252 primary records. [2025-09-29T22:09:29.644729] [DEBUG] [LOCAL ] GIL: Saving derivative data. [2025-09-29T22:09:29.673031] [DEBUG] [LOCAL ] GIL: Derivative data saved (1794 records). [2025-09-29T22:09:29.673207] [INFO ] [MAIN ] GIL: Successfully saved derivative data. [2025-09-29T22:09:29.675429] [INFO ] [MAIN ] Derivative Progress: 761/2057 symbols completed. GIL took 0.7s. Estimated remaining: 8m 47s. Rate: 147.6 symbols/min [2025-09-29T22:09:29.688403] [INFO ] [MAIN ] GL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:29.706207] [DEBUG] [LOCAL ] GKOS: Loaded 42728 existing records from primary storage. [2025-09-29T22:09:29.708842] [INFO ] [MAIN ] GKOS: Loaded 42728 primary data records. [2025-09-29T22:09:29.833337] [DEBUG] [LOCAL ] GIS: Loaded 53673 existing records from primary storage. [2025-09-29T22:09:29.833553] [INFO ] [MAIN ] GIS: Loaded 53673 primary data records. [2025-09-29T22:09:30.304830] [DEBUG] [LOCAL ] GL: Loaded 37753 existing records from primary storage. [2025-09-29T22:09:30.330812] [INFO ] [MAIN ] GL: Loaded 37753 primary data records. [2025-09-29T22:09:30.814771] [DEBUG] [MAIN ] GKOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:30.816072] [INFO ] [MAIN ] GKOS: Generated 1794 derivative records from 42728 primary records. [2025-09-29T22:09:30.816152] [DEBUG] [LOCAL ] GKOS: Saving derivative data. [2025-09-29T22:09:30.841314] [DEBUG] [LOCAL ] GKOS: Derivative data saved (1794 records). [2025-09-29T22:09:30.842460] [INFO ] [MAIN ] GKOS: Successfully saved derivative data. [2025-09-29T22:09:30.845609] [INFO ] [MAIN ] Derivative Progress: 762/2057 symbols completed. GKOS took 1.2s. Estimated remaining: 8m 48s. Rate: 147.2 symbols/min [2025-09-29T22:09:30.845954] [INFO ] [MAIN ] GLOB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:30.861867] [DEBUG] [MAIN ] GIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:30.862877] [INFO ] [MAIN ] GIS: Generated 1794 derivative records from 53673 primary records. [2025-09-29T22:09:30.863328] [DEBUG] [LOCAL ] GIS: Saving derivative data. [2025-09-29T22:09:30.888475] [DEBUG] [LOCAL ] GIS: Derivative data saved (1794 records). [2025-09-29T22:09:30.888945] [INFO ] [MAIN ] GIS: Successfully saved derivative data. [2025-09-29T22:09:30.891627] [INFO ] [MAIN ] Derivative Progress: 763/2057 symbols completed. GIS took 1.3s. Estimated remaining: 8m 47s. Rate: 147.4 symbols/min [2025-09-29T22:09:30.905923] [DEBUG] [MAIN ] GL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:30.906750] [INFO ] [MAIN ] GL: Generated 1794 derivative records from 37753 primary records. [2025-09-29T22:09:30.917239] [DEBUG] [LOCAL ] GL: Saving derivative data. [2025-09-29T22:09:30.948369] [DEBUG] [LOCAL ] GL: Derivative data saved (1794 records). [2025-09-29T22:09:30.949239] [INFO ] [MAIN ] GL: Successfully saved derivative data. [2025-09-29T22:09:30.951636] [INFO ] [MAIN ] Derivative Progress: 764/2057 symbols completed. GL took 1.3s. Estimated remaining: 8m 46s. Rate: 147.6 symbols/min [2025-09-29T22:09:30.949085] [DEBUG] [LOCAL ] GLOB: Loaded 47508 existing records from primary storage. [2025-09-29T22:09:30.952061] [INFO ] [MAIN ] GLOB: Loaded 47508 primary data records. [2025-09-29T22:09:31.264072] [DEBUG] [MAIN ] GLOB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:31.264793] [INFO ] [MAIN ] GLOB: Generated 1794 derivative records from 47508 primary records. [2025-09-29T22:09:31.264861] [DEBUG] [LOCAL ] GLOB: Saving derivative data. [2025-09-29T22:09:31.280779] [DEBUG] [LOCAL ] GLOB: Derivative data saved (1794 records). [2025-09-29T22:09:31.280841] [INFO ] [MAIN ] GLOB: Successfully saved derivative data. [2025-09-29T22:09:31.283067] [INFO ] [MAIN ] Derivative Progress: 765/2057 symbols completed. GLOB took 0.4s. Estimated remaining: 8m 45s. Rate: 147.6 symbols/min [2025-09-29T22:09:31.283805] [INFO ] [MAIN ] GM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:31.283698] [INFO ] [MAIN ] GLP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:31.283962] [INFO ] [MAIN ] GLW: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:31.298194] [DEBUG] [LOCAL ] GLP: Loaded 9348 existing records from primary storage. [2025-09-29T22:09:31.298379] [INFO ] [MAIN ] GLP: Loaded 9348 primary data records. [2025-09-29T22:09:31.709066] [DEBUG] [LOCAL ] GM: Loaded 53728 existing records from primary storage. [2025-09-29T22:09:31.710388] [DEBUG] [LOCAL ] GLW: Loaded 53635 existing records from primary storage. [2025-09-29T22:09:31.711417] [INFO ] [MAIN ] GM: Loaded 53728 primary data records. [2025-09-29T22:09:31.712001] [INFO ] [MAIN ] GLW: Loaded 53635 primary data records. [2025-09-29T22:09:32.416131] [DEBUG] [MAIN ] GLP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:32.417466] [INFO ] [MAIN ] GLP: Generated 1794 derivative records from 9348 primary records. [2025-09-29T22:09:32.417886] [DEBUG] [LOCAL ] GLP: Saving derivative data. [2025-09-29T22:09:32.436217] [DEBUG] [LOCAL ] GLP: Derivative data saved (1794 records). [2025-09-29T22:09:32.437454] [INFO ] [MAIN ] GLP: Successfully saved derivative data. [2025-09-29T22:09:32.440057] [INFO ] [MAIN ] Derivative Progress: 766/2057 symbols completed. GLP took 1.2s. Estimated remaining: 8m 46s. Rate: 147.3 symbols/min [2025-09-29T22:09:32.440801] [INFO ] [MAIN ] GME: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:32.471620] [DEBUG] [MAIN ] GM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:32.485582] [INFO ] [MAIN ] GM: Generated 1794 derivative records from 53728 primary records. [2025-09-29T22:09:32.486283] [DEBUG] [LOCAL ] GM: Saving derivative data. [2025-09-29T22:09:32.486599] [DEBUG] [MAIN ] GLW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:32.488444] [INFO ] [MAIN ] GLW: Generated 1794 derivative records from 53635 primary records. [2025-09-29T22:09:32.488881] [DEBUG] [LOCAL ] GLW: Saving derivative data. [2025-09-29T22:09:32.529590] [DEBUG] [LOCAL ] GLW: Derivative data saved (1794 records). [2025-09-29T22:09:32.532617] [INFO ] [MAIN ] GLW: Successfully saved derivative data. [2025-09-29T22:09:32.535292] [INFO ] [MAIN ] Derivative Progress: 767/2057 symbols completed. GLW took 1.3s. Estimated remaining: 8m 45s. Rate: 147.4 symbols/min [2025-09-29T22:09:32.536601] [INFO ] [MAIN ] GMED: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:32.541390] [DEBUG] [LOCAL ] GM: Derivative data saved (1794 records). [2025-09-29T22:09:32.541677] [INFO ] [MAIN ] GM: Successfully saved derivative data. [2025-09-29T22:09:32.543729] [INFO ] [MAIN ] Derivative Progress: 768/2057 symbols completed. GM took 1.3s. Estimated remaining: 8m 44s. Rate: 147.6 symbols/min [2025-09-29T22:09:32.544150] [INFO ] [MAIN ] GMRE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:32.562772] [DEBUG] [LOCAL ] GME: Loaded 53762 existing records from primary storage. [2025-09-29T22:09:32.563109] [INFO ] [MAIN ] GME: Loaded 53762 primary data records. [2025-09-29T22:09:32.886597] [DEBUG] [LOCAL ] GMED: Loaded 48347 existing records from primary storage. [2025-09-29T22:09:32.951326] [INFO ] [MAIN ] GMED: Loaded 48347 primary data records. [2025-09-29T22:09:33.085075] [DEBUG] [LOCAL ] GMRE: Loaded 37551 existing records from primary storage. [2025-09-29T22:09:33.128340] [INFO ] [MAIN ] GMRE: Loaded 37551 primary data records. [2025-09-29T22:09:33.625448] [DEBUG] [MAIN ] GME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:33.641196] [INFO ] [MAIN ] GME: Generated 1794 derivative records from 53762 primary records. [2025-09-29T22:09:33.641869] [DEBUG] [LOCAL ] GME: Saving derivative data. [2025-09-29T22:09:33.667337] [DEBUG] [LOCAL ] GME: Derivative data saved (1794 records). [2025-09-29T22:09:33.680770] [INFO ] [MAIN ] GME: Successfully saved derivative data. [2025-09-29T22:09:33.683571] [INFO ] [MAIN ] Derivative Progress: 769/2057 symbols completed. GME took 1.2s. Estimated remaining: 8m 45s. Rate: 147.2 symbols/min [2025-09-29T22:09:33.685050] [INFO ] [MAIN ] GNE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:33.686208] [DEBUG] [MAIN ] GMED: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:33.687234] [INFO ] [MAIN ] GMED: Generated 1794 derivative records from 48347 primary records. [2025-09-29T22:09:33.687459] [DEBUG] [LOCAL ] GMED: Saving derivative data. [2025-09-29T22:09:33.706391] [DEBUG] [LOCAL ] GMED: Derivative data saved (1794 records). [2025-09-29T22:09:33.706877] [INFO ] [MAIN ] GMED: Successfully saved derivative data. [2025-09-29T22:09:33.709251] [INFO ] [MAIN ] Derivative Progress: 770/2057 symbols completed. GMED took 1.2s. Estimated remaining: 8m 44s. Rate: 147.4 symbols/min [2025-09-29T22:09:33.709523] [INFO ] [MAIN ] GNK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:33.738035] [DEBUG] [MAIN ] GMRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:33.739192] [DEBUG] [LOCAL ] GNE: Loaded 17740 existing records from primary storage. [2025-09-29T22:09:33.739309] [INFO ] [MAIN ] GNE: Loaded 17740 primary data records. [2025-09-29T22:09:33.740217] [INFO ] [MAIN ] GMRE: Generated 1794 derivative records from 37551 primary records. [2025-09-29T22:09:33.740333] [DEBUG] [LOCAL ] GMRE: Saving derivative data. [2025-09-29T22:09:33.861758] [DEBUG] [LOCAL ] GMRE: Derivative data saved (1794 records). [2025-09-29T22:09:33.867775] [INFO ] [MAIN ] GMRE: Successfully saved derivative data. [2025-09-29T22:09:33.882247] [INFO ] [MAIN ] Derivative Progress: 771/2057 symbols completed. GMRE took 1.3s. Estimated remaining: 8m 43s. Rate: 147.5 symbols/min [2025-09-29T22:09:33.916692] [INFO ] [MAIN ] GNL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:34.093079] [DEBUG] [LOCAL ] GNK: Loaded 40282 existing records from primary storage. [2025-09-29T22:09:34.094083] [INFO ] [MAIN ] GNK: Loaded 40282 primary data records. [2025-09-29T22:09:34.448491] [DEBUG] [LOCAL ] GNL: Loaded 46945 existing records from primary storage. [2025-09-29T22:09:34.450149] [INFO ] [MAIN ] GNL: Loaded 46945 primary data records. [2025-09-29T22:09:34.471041] [DEBUG] [MAIN ] GNE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:34.511759] [INFO ] [MAIN ] GNE: Generated 1794 derivative records from 17740 primary records. [2025-09-29T22:09:34.525731] [DEBUG] [LOCAL ] GNE: Saving derivative data. [2025-09-29T22:09:34.879453] [DEBUG] [LOCAL ] GNE: Derivative data saved (1794 records). [2025-09-29T22:09:34.879924] [INFO ] [MAIN ] GNE: Successfully saved derivative data. [2025-09-29T22:09:34.890322] [INFO ] [MAIN ] Derivative Progress: 772/2057 symbols completed. GNE took 1.2s. Estimated remaining: 8m 44s. Rate: 147.3 symbols/min [2025-09-29T22:09:34.895724] [INFO ] [MAIN ] GNRC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:34.897878] [DEBUG] [MAIN ] GNK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:34.898674] [INFO ] [MAIN ] GNK: Generated 1794 derivative records from 40282 primary records. [2025-09-29T22:09:34.898875] [DEBUG] [LOCAL ] GNK: Saving derivative data. [2025-09-29T22:09:34.922566] [DEBUG] [LOCAL ] GNK: Derivative data saved (1794 records). [2025-09-29T22:09:34.922804] [INFO ] [MAIN ] GNK: Successfully saved derivative data. [2025-09-29T22:09:34.925182] [INFO ] [MAIN ] Derivative Progress: 773/2057 symbols completed. GNK took 1.2s. Estimated remaining: 8m 43s. Rate: 147.4 symbols/min [2025-09-29T22:09:34.925838] [INFO ] [MAIN ] GNT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:34.962044] [DEBUG] [LOCAL ] GNT: Loaded 8083 existing records from primary storage. [2025-09-29T22:09:34.962567] [INFO ] [MAIN ] GNT: Loaded 8083 primary data records. [2025-09-29T22:09:34.985731] [DEBUG] [MAIN ] GNL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:35.024745] [INFO ] [MAIN ] GNL: Generated 1794 derivative records from 46945 primary records. [2025-09-29T22:09:35.086917] [DEBUG] [LOCAL ] GNL: Saving derivative data. [2025-09-29T22:09:35.106746] [DEBUG] [LOCAL ] GNRC: Loaded 45182 existing records from primary storage. [2025-09-29T22:09:35.107897] [INFO ] [MAIN ] GNRC: Loaded 45182 primary data records. [2025-09-29T22:09:35.490685] [DEBUG] [LOCAL ] GNL: Derivative data saved (1794 records). [2025-09-29T22:09:35.531368] [INFO ] [MAIN ] GNL: Successfully saved derivative data. [2025-09-29T22:09:35.533826] [INFO ] [MAIN ] Derivative Progress: 774/2057 symbols completed. GNL took 1.6s. Estimated remaining: 8m 42s. Rate: 147.3 symbols/min [2025-09-29T22:09:35.650948] [INFO ] [MAIN ] GNTY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:35.666398] [DEBUG] [LOCAL ] GNTY: Loaded 7288 existing records from primary storage. [2025-09-29T22:09:35.670054] [INFO ] [MAIN ] GNTY: Loaded 7288 primary data records. [2025-09-29T22:09:35.738421] [DEBUG] [MAIN ] GNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:35.754584] [INFO ] [MAIN ] GNT: Generated 1794 derivative records from 8083 primary records. [2025-09-29T22:09:35.761672] [DEBUG] [LOCAL ] GNT: Saving derivative data. [2025-09-29T22:09:35.890099] [DEBUG] [MAIN ] GNRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:35.923708] [INFO ] [MAIN ] GNRC: Generated 1794 derivative records from 45182 primary records. [2025-09-29T22:09:35.924337] [DEBUG] [LOCAL ] GNT: Derivative data saved (1794 records). [2025-09-29T22:09:35.924451] [DEBUG] [LOCAL ] GNRC: Saving derivative data. [2025-09-29T22:09:36.028116] [INFO ] [MAIN ] GNT: Successfully saved derivative data. [2025-09-29T22:09:36.055229] [INFO ] [MAIN ] Derivative Progress: 775/2057 symbols completed. GNT took 1.1s. Estimated remaining: 8m 42s. Rate: 147.3 symbols/min [2025-09-29T22:09:36.056433] [INFO ] [MAIN ] GNW: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:36.065883] [DEBUG] [LOCAL ] GNRC: Derivative data saved (1794 records). [2025-09-29T22:09:36.066067] [INFO ] [MAIN ] GNRC: Successfully saved derivative data. [2025-09-29T22:09:36.068263] [INFO ] [MAIN ] Derivative Progress: 776/2057 symbols completed. GNRC took 1.2s. Estimated remaining: 8m 41s. Rate: 147.5 symbols/min [2025-09-29T22:09:36.068845] [INFO ] [MAIN ] GOF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:36.109261] [DEBUG] [MAIN ] GNTY: Filtered 7001 bins outside market hours, 7824 incomplete bins [2025-09-29T22:09:36.110228] [INFO ] [MAIN ] GNTY: Generated 1790 derivative records from 7288 primary records. [2025-09-29T22:09:36.110356] [DEBUG] [LOCAL ] GNTY: Saving derivative data. [2025-09-29T22:09:36.150774] [DEBUG] [LOCAL ] GNW: Loaded 51334 existing records from primary storage. [2025-09-29T22:09:36.151585] [INFO ] [MAIN ] GNW: Loaded 51334 primary data records. [2025-09-29T22:09:36.151508] [DEBUG] [LOCAL ] GNTY: Derivative data saved (1790 records). [2025-09-29T22:09:36.151804] [INFO ] [MAIN ] GNTY: Successfully saved derivative data. [2025-09-29T22:09:36.153772] [INFO ] [MAIN ] Derivative Progress: 777/2057 symbols completed. GNTY took 0.5s. Estimated remaining: 8m 40s. Rate: 147.6 symbols/min [2025-09-29T22:09:36.159194] [INFO ] [MAIN ] GOLF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:36.277442] [DEBUG] [LOCAL ] GOF: Loaded 42678 existing records from primary storage. [2025-09-29T22:09:36.283356] [INFO ] [MAIN ] GOF: Loaded 42678 primary data records. [2025-09-29T22:09:36.600809] [DEBUG] [LOCAL ] GOLF: Loaded 31352 existing records from primary storage. [2025-09-29T22:09:36.615930] [INFO ] [MAIN ] GOLF: Loaded 31352 primary data records. [2025-09-29T22:09:37.242421] [DEBUG] [MAIN ] GNW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:37.244986] [INFO ] [MAIN ] GNW: Generated 1794 derivative records from 51334 primary records. [2025-09-29T22:09:37.245926] [DEBUG] [LOCAL ] GNW: Saving derivative data. [2025-09-29T22:09:37.263542] [DEBUG] [LOCAL ] GNW: Derivative data saved (1794 records). [2025-09-29T22:09:37.263906] [INFO ] [MAIN ] GNW: Successfully saved derivative data. [2025-09-29T22:09:37.269678] [INFO ] [MAIN ] Derivative Progress: 778/2057 symbols completed. GNW took 1.2s. Estimated remaining: 8m 41s. Rate: 147.3 symbols/min [2025-09-29T22:09:37.287619] [DEBUG] [MAIN ] GOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:37.288614] [INFO ] [MAIN ] GOF: Generated 1794 derivative records from 42678 primary records. [2025-09-29T22:09:37.288913] [DEBUG] [LOCAL ] GOF: Saving derivative data. [2025-09-29T22:09:37.305787] [DEBUG] [LOCAL ] GOF: Derivative data saved (1794 records). [2025-09-29T22:09:37.305995] [INFO ] [MAIN ] GOF: Successfully saved derivative data. [2025-09-29T22:09:37.309292] [INFO ] [MAIN ] Derivative Progress: 779/2057 symbols completed. GOF took 1.2s. Estimated remaining: 8m 40s. Rate: 147.5 symbols/min [2025-09-29T22:09:37.324079] [DEBUG] [MAIN ] GOLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:37.324754] [INFO ] [MAIN ] GOLF: Generated 1794 derivative records from 31352 primary records. [2025-09-29T22:09:37.324821] [DEBUG] [LOCAL ] GOLF: Saving derivative data. [2025-09-29T22:09:37.340698] [DEBUG] [LOCAL ] GOLF: Derivative data saved (1794 records). [2025-09-29T22:09:37.340765] [INFO ] [MAIN ] GOLF: Successfully saved derivative data. [2025-09-29T22:09:37.342759] [INFO ] [MAIN ] Derivative Progress: 780/2057 symbols completed. GOLF took 1.2s. Estimated remaining: 8m 39s. Rate: 147.6 symbols/min [2025-09-29T22:09:37.343254] [INFO ] [MAIN ] GOOS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:37.343393] [INFO ] [MAIN ] GOTU: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:37.343558] [INFO ] [MAIN ] GPC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:37.401604] [DEBUG] [LOCAL ] GOTU: Loaded 38697 existing records from primary storage. [2025-09-29T22:09:37.401850] [INFO ] [MAIN ] GOTU: Loaded 38697 primary data records. [2025-09-29T22:09:37.540246] [DEBUG] [LOCAL ] GOOS: Loaded 45160 existing records from primary storage. [2025-09-29T22:09:37.545105] [DEBUG] [LOCAL ] GPC: Loaded 46447 existing records from primary storage. [2025-09-29T22:09:37.556097] [INFO ] [MAIN ] GPC: Loaded 46447 primary data records. [2025-09-29T22:09:37.550891] [INFO ] [MAIN ] GOOS: Loaded 45160 primary data records. [2025-09-29T22:09:38.447263] [DEBUG] [MAIN ] GOTU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:38.448366] [INFO ] [MAIN ] GOTU: Generated 1794 derivative records from 38697 primary records. [2025-09-29T22:09:38.448636] [DEBUG] [LOCAL ] GOTU: Saving derivative data. [2025-09-29T22:09:38.482182] [DEBUG] [LOCAL ] GOTU: Derivative data saved (1794 records). [2025-09-29T22:09:38.482769] [DEBUG] [MAIN ] GOOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:38.482864] [INFO ] [MAIN ] GOTU: Successfully saved derivative data. [2025-09-29T22:09:38.486095] [INFO ] [MAIN ] GOOS: Generated 1794 derivative records from 45160 primary records. [2025-09-29T22:09:38.485229] [INFO ] [MAIN ] Derivative Progress: 781/2057 symbols completed. GOTU took 1.1s. Estimated remaining: 8m 40s. Rate: 147.3 symbols/min [2025-09-29T22:09:38.486584] [INFO ] [MAIN ] GPI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:38.487841] [DEBUG] [LOCAL ] GOOS: Saving derivative data. [2025-09-29T22:09:38.506576] [DEBUG] [LOCAL ] GOOS: Derivative data saved (1794 records). [2025-09-29T22:09:38.520178] [INFO ] [MAIN ] GOOS: Successfully saved derivative data. [2025-09-29T22:09:38.522742] [INFO ] [MAIN ] Derivative Progress: 782/2057 symbols completed. GOOS took 1.2s. Estimated remaining: 8m 39s. Rate: 147.5 symbols/min [2025-09-29T22:09:38.523095] [DEBUG] [MAIN ] GPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:38.523534] [INFO ] [MAIN ] GPJA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:38.524347] [INFO ] [MAIN ] GPC: Generated 1794 derivative records from 46447 primary records. [2025-09-29T22:09:38.529212] [DEBUG] [LOCAL ] GPC: Saving derivative data. [2025-09-29T22:09:38.556861] [DEBUG] [LOCAL ] GPC: Derivative data saved (1794 records). [2025-09-29T22:09:38.557268] [INFO ] [MAIN ] GPC: Successfully saved derivative data. [2025-09-29T22:09:38.552438] [DEBUG] [LOCAL ] GPI: Loaded 14808 existing records from primary storage. [2025-09-29T22:09:38.559440] [INFO ] [MAIN ] Derivative Progress: 783/2057 symbols completed. GPC took 1.2s. Estimated remaining: 8m 38s. Rate: 147.6 symbols/min [2025-09-29T22:09:38.557162] [DEBUG] [LOCAL ] GPJA: Loaded 4097 existing records from primary storage. [2025-09-29T22:09:38.559914] [INFO ] [MAIN ] GPI: Loaded 14808 primary data records. [2025-09-29T22:09:38.559802] [INFO ] [MAIN ] GPK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:38.560637] [INFO ] [MAIN ] GPJA: Loaded 4097 primary data records. [2025-09-29T22:09:39.274918] [DEBUG] [LOCAL ] GPK: Loaded 52653 existing records from primary storage. [2025-09-29T22:09:39.275379] [INFO ] [MAIN ] GPK: Loaded 52653 primary data records. [2025-09-29T22:09:39.618263] [DEBUG] [MAIN ] GPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:39.619672] [INFO ] [MAIN ] GPI: Generated 1794 derivative records from 14808 primary records. [2025-09-29T22:09:39.620083] [DEBUG] [LOCAL ] GPI: Saving derivative data. [2025-09-29T22:09:39.643710] [DEBUG] [MAIN ] GPJA: Filtered 7001 bins outside market hours, 7823 incomplete bins [2025-09-29T22:09:39.649868] [INFO ] [MAIN ] GPJA: Generated 1791 derivative records from 4097 primary records. [2025-09-29T22:09:39.650356] [DEBUG] [LOCAL ] GPJA: Saving derivative data. [2025-09-29T22:09:39.669397] [DEBUG] [LOCAL ] GPJA: Derivative data saved (1791 records). [2025-09-29T22:09:39.669663] [INFO ] [MAIN ] GPJA: Successfully saved derivative data. [2025-09-29T22:09:39.671974] [INFO ] [MAIN ] Derivative Progress: 784/2057 symbols completed. GPJA took 1.1s. Estimated remaining: 8m 39s. Rate: 147.3 symbols/min [2025-09-29T22:09:39.672296] [INFO ] [MAIN ] GPMT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:39.673563] [DEBUG] [LOCAL ] GPI: Derivative data saved (1794 records). [2025-09-29T22:09:39.674042] [INFO ] [MAIN ] GPI: Successfully saved derivative data. [2025-09-29T22:09:39.676587] [INFO ] [MAIN ] Derivative Progress: 785/2057 symbols completed. GPI took 1.2s. Estimated remaining: 8m 37s. Rate: 147.5 symbols/min [2025-09-29T22:09:39.676962] [INFO ] [MAIN ] GPN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:39.693974] [DEBUG] [MAIN ] GPK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:39.694692] [INFO ] [MAIN ] GPK: Generated 1794 derivative records from 52653 primary records. [2025-09-29T22:09:39.694852] [DEBUG] [LOCAL ] GPK: Saving derivative data. [2025-09-29T22:09:39.719725] [DEBUG] [LOCAL ] GPK: Derivative data saved (1794 records). [2025-09-29T22:09:39.719926] [INFO ] [MAIN ] GPK: Successfully saved derivative data. [2025-09-29T22:09:39.722063] [INFO ] [MAIN ] Derivative Progress: 786/2057 symbols completed. GPK took 1.2s. Estimated remaining: 8m 36s. Rate: 147.7 symbols/min [2025-09-29T22:09:39.731261] [INFO ] [MAIN ] GPOR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:39.731806] [DEBUG] [LOCAL ] GPMT: Loaded 26288 existing records from primary storage. [2025-09-29T22:09:39.732489] [INFO ] [MAIN ] GPMT: Loaded 26288 primary data records. [2025-09-29T22:09:39.945615] [DEBUG] [LOCAL ] GPN: Loaded 52049 existing records from primary storage. [2025-09-29T22:09:39.979131] [INFO ] [MAIN ] GPN: Loaded 52049 primary data records. [2025-09-29T22:09:39.957239] [DEBUG] [LOCAL ] GPOR: Loaded 22983 existing records from primary storage. [2025-09-29T22:09:40.088471] [INFO ] [MAIN ] GPOR: Loaded 22983 primary data records. [2025-09-29T22:09:40.788564] [DEBUG] [MAIN ] GPMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:40.790471] [INFO ] [MAIN ] GPMT: Generated 1794 derivative records from 26288 primary records. [2025-09-29T22:09:40.790990] [DEBUG] [LOCAL ] GPMT: Saving derivative data. [2025-09-29T22:09:40.810317] [DEBUG] [LOCAL ] GPMT: Derivative data saved (1794 records). [2025-09-29T22:09:40.810786] [INFO ] [MAIN ] GPMT: Successfully saved derivative data. [2025-09-29T22:09:40.812836] [INFO ] [MAIN ] Derivative Progress: 787/2057 symbols completed. GPMT took 1.1s. Estimated remaining: 8m 37s. Rate: 147.3 symbols/min [2025-09-29T22:09:40.813283] [INFO ] [MAIN ] GPRK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:40.832756] [DEBUG] [MAIN ] GPN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:40.835722] [INFO ] [MAIN ] GPN: Generated 1794 derivative records from 52049 primary records. [2025-09-29T22:09:40.835964] [DEBUG] [LOCAL ] GPN: Saving derivative data. [2025-09-29T22:09:40.862153] [DEBUG] [MAIN ] GPOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:40.863323] [INFO ] [MAIN ] GPOR: Generated 1794 derivative records from 22983 primary records. [2025-09-29T22:09:40.863813] [DEBUG] [LOCAL ] GPOR: Saving derivative data. [2025-09-29T22:09:40.892274] [DEBUG] [LOCAL ] GPN: Derivative data saved (1794 records). [2025-09-29T22:09:40.892632] [INFO ] [MAIN ] GPN: Successfully saved derivative data. [2025-09-29T22:09:40.895549] [INFO ] [MAIN ] Derivative Progress: 788/2057 symbols completed. GPN took 1.2s. Estimated remaining: 8m 36s. Rate: 147.5 symbols/min [2025-09-29T22:09:40.896120] [INFO ] [MAIN ] GRBK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:40.900630] [DEBUG] [LOCAL ] GPOR: Derivative data saved (1794 records). [2025-09-29T22:09:40.912728] [INFO ] [MAIN ] GPOR: Successfully saved derivative data. [2025-09-29T22:09:40.915636] [INFO ] [MAIN ] Derivative Progress: 789/2057 symbols completed. GPOR took 1.2s. Estimated remaining: 8m 35s. Rate: 147.7 symbols/min [2025-09-29T22:09:40.916067] [INFO ] [MAIN ] GRC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:40.917136] [DEBUG] [LOCAL ] GPRK: Loaded 39240 existing records from primary storage. [2025-09-29T22:09:40.917428] [INFO ] [MAIN ] GPRK: Loaded 39240 primary data records. [2025-09-29T22:09:41.034165] [DEBUG] [LOCAL ] GRC: Loaded 8910 existing records from primary storage. [2025-09-29T22:09:41.060580] [INFO ] [MAIN ] GRC: Loaded 8910 primary data records. [2025-09-29T22:09:41.071791] [DEBUG] [LOCAL ] GRBK: Loaded 26896 existing records from primary storage. [2025-09-29T22:09:41.161584] [INFO ] [MAIN ] GRBK: Loaded 26896 primary data records. [2025-09-29T22:09:41.989208] [DEBUG] [MAIN ] GPRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:41.990453] [INFO ] [MAIN ] GPRK: Generated 1794 derivative records from 39240 primary records. [2025-09-29T22:09:41.990867] [DEBUG] [LOCAL ] GPRK: Saving derivative data. [2025-09-29T22:09:42.022146] [DEBUG] [LOCAL ] GPRK: Derivative data saved (1794 records). [2025-09-29T22:09:42.027375] [INFO ] [MAIN ] GPRK: Successfully saved derivative data. [2025-09-29T22:09:42.041984] [INFO ] [MAIN ] Derivative Progress: 790/2057 symbols completed. GPRK took 1.2s. Estimated remaining: 8m 36s. Rate: 147.3 symbols/min [2025-09-29T22:09:42.042727] [DEBUG] [MAIN ] GRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:42.043008] [DEBUG] [MAIN ] GRBK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:42.043900] [INFO ] [MAIN ] GRC: Generated 1794 derivative records from 8910 primary records. [2025-09-29T22:09:42.044075] [INFO ] [MAIN ] GRDN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:42.045182] [INFO ] [MAIN ] GRBK: Generated 1794 derivative records from 26896 primary records. [2025-09-29T22:09:42.045338] [DEBUG] [LOCAL ] GRBK: Saving derivative data. [2025-09-29T22:09:42.045384] [DEBUG] [LOCAL ] GRC: Saving derivative data. [2025-09-29T22:09:42.072947] [DEBUG] [LOCAL ] GRC: Derivative data saved (1794 records). [2025-09-29T22:09:42.073372] [INFO ] [MAIN ] GRC: Successfully saved derivative data. [2025-09-29T22:09:42.076069] [INFO ] [MAIN ] Derivative Progress: 791/2057 symbols completed. GRC took 1.2s. Estimated remaining: 8m 35s. Rate: 147.5 symbols/min [2025-09-29T22:09:42.076462] [INFO ] [MAIN ] GRMN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:42.086938] [DEBUG] [LOCAL ] GRBK: Derivative data saved (1794 records). [2025-09-29T22:09:42.087093] [INFO ] [MAIN ] GRBK: Successfully saved derivative data. [2025-09-29T22:09:42.089109] [INFO ] [MAIN ] Derivative Progress: 792/2057 symbols completed. GRBK took 1.2s. Estimated remaining: 8m 34s. Rate: 147.7 symbols/min [2025-09-29T22:09:42.089310] [INFO ] [MAIN ] GRND: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:42.098627] [DEBUG] [LOCAL ] GRDN: Loaded 20177 existing records from primary storage. [2025-09-29T22:09:42.098872] [INFO ] [MAIN ] GRDN: Loaded 20177 primary data records. [2025-09-29T22:09:42.476334] [DEBUG] [LOCAL ] GRMN: Loaded 41096 existing records from primary storage. [2025-09-29T22:09:42.496063] [INFO ] [MAIN ] GRMN: Loaded 41096 primary data records. [2025-09-29T22:09:42.538495] [DEBUG] [LOCAL ] GRND: Loaded 49962 existing records from primary storage. [2025-09-29T22:09:42.569528] [INFO ] [MAIN ] GRND: Loaded 49962 primary data records. [2025-09-29T22:09:43.197346] [DEBUG] [MAIN ] GRDN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:43.199616] [INFO ] [MAIN ] GRDN: Generated 1794 derivative records from 20177 primary records. [2025-09-29T22:09:43.199786] [DEBUG] [LOCAL ] GRDN: Saving derivative data. [2025-09-29T22:09:43.222304] [DEBUG] [LOCAL ] GRDN: Derivative data saved (1794 records). [2025-09-29T22:09:43.222735] [INFO ] [MAIN ] GRDN: Successfully saved derivative data. [2025-09-29T22:09:43.225340] [INFO ] [MAIN ] Derivative Progress: 793/2057 symbols completed. GRDN took 1.2s. Estimated remaining: 8m 35s. Rate: 147.4 symbols/min [2025-09-29T22:09:43.250325] [DEBUG] [MAIN ] GRMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:43.251301] [INFO ] [MAIN ] GRMN: Generated 1794 derivative records from 41096 primary records. [2025-09-29T22:09:43.251390] [DEBUG] [LOCAL ] GRMN: Saving derivative data. [2025-09-29T22:09:43.269340] [DEBUG] [LOCAL ] GRMN: Derivative data saved (1794 records). [2025-09-29T22:09:43.269619] [INFO ] [MAIN ] GRMN: Successfully saved derivative data. [2025-09-29T22:09:43.273853] [INFO ] [MAIN ] Derivative Progress: 794/2057 symbols completed. GRMN took 1.2s. Estimated remaining: 8m 34s. Rate: 147.5 symbols/min [2025-09-29T22:09:43.290798] [DEBUG] [MAIN ] GRND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:43.291801] [INFO ] [MAIN ] GRND: Generated 1794 derivative records from 49962 primary records. [2025-09-29T22:09:43.291889] [DEBUG] [LOCAL ] GRND: Saving derivative data. [2025-09-29T22:09:43.309428] [DEBUG] [LOCAL ] GRND: Derivative data saved (1794 records). [2025-09-29T22:09:43.309523] [INFO ] [MAIN ] GRND: Successfully saved derivative data. [2025-09-29T22:09:43.313892] [INFO ] [MAIN ] Derivative Progress: 795/2057 symbols completed. GRND took 1.2s. Estimated remaining: 8m 33s. Rate: 147.7 symbols/min [2025-09-29T22:09:43.314828] [INFO ] [MAIN ] GROV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:43.314912] [INFO ] [MAIN ] GRX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:43.314723] [INFO ] [MAIN ] GRNT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:43.329914] [DEBUG] [LOCAL ] GROV: Loaded 9008 existing records from primary storage. [2025-09-29T22:09:43.333683] [INFO ] [MAIN ] GROV: Loaded 9008 primary data records. [2025-09-29T22:09:43.334052] [DEBUG] [LOCAL ] GRX: Loaded 4569 existing records from primary storage. [2025-09-29T22:09:43.347004] [INFO ] [MAIN ] GRX: Loaded 4569 primary data records. [2025-09-29T22:09:43.634613] [DEBUG] [LOCAL ] GRNT: Loaded 33708 existing records from primary storage. [2025-09-29T22:09:43.650414] [INFO ] [MAIN ] GRNT: Loaded 33708 primary data records. [2025-09-29T22:09:44.414296] [DEBUG] [MAIN ] GRX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:44.414707] [DEBUG] [MAIN ] GROV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:44.416178] [INFO ] [MAIN ] GRX: Generated 1794 derivative records from 4569 primary records. [2025-09-29T22:09:44.417267] [INFO ] [MAIN ] GROV: Generated 1794 derivative records from 9008 primary records. [2025-09-29T22:09:44.417619] [DEBUG] [LOCAL ] GROV: Saving derivative data. [2025-09-29T22:09:44.417764] [DEBUG] [LOCAL ] GRX: Saving derivative data. [2025-09-29T22:09:44.468810] [DEBUG] [MAIN ] GRNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:44.471441] [INFO ] [MAIN ] GRNT: Generated 1794 derivative records from 33708 primary records. [2025-09-29T22:09:44.472610] [DEBUG] [LOCAL ] GRNT: Saving derivative data. [2025-09-29T22:09:44.474387] [DEBUG] [LOCAL ] GROV: Derivative data saved (1794 records). [2025-09-29T22:09:44.476490] [INFO ] [MAIN ] GROV: Successfully saved derivative data. [2025-09-29T22:09:44.486124] [INFO ] [MAIN ] Derivative Progress: 796/2057 symbols completed. GROV took 1.2s. Estimated remaining: 8m 34s. Rate: 147.3 symbols/min [2025-09-29T22:09:44.476836] [DEBUG] [LOCAL ] GRX: Derivative data saved (1794 records). [2025-09-29T22:09:44.490866] [INFO ] [MAIN ] GS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:44.490702] [INFO ] [MAIN ] GRX: Successfully saved derivative data. [2025-09-29T22:09:44.497238] [INFO ] [MAIN ] Derivative Progress: 797/2057 symbols completed. GRX took 1.2s. Estimated remaining: 8m 32s. Rate: 147.5 symbols/min [2025-09-29T22:09:44.499970] [DEBUG] [LOCAL ] GRNT: Derivative data saved (1794 records). [2025-09-29T22:09:44.500390] [INFO ] [MAIN ] GRNT: Successfully saved derivative data. [2025-09-29T22:09:44.500296] [INFO ] [MAIN ] GSBD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:44.502635] [INFO ] [MAIN ] Derivative Progress: 798/2057 symbols completed. GRNT took 1.2s. Estimated remaining: 8m 31s. Rate: 147.7 symbols/min [2025-09-29T22:09:44.503178] [INFO ] [MAIN ] GSK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:44.595590] [DEBUG] [LOCAL ] GSBD: Loaded 39044 existing records from primary storage. [2025-09-29T22:09:44.612369] [INFO ] [MAIN ] GSBD: Loaded 39044 primary data records. [2025-09-29T22:09:44.614085] [DEBUG] [LOCAL ] GSK: Loaded 53491 existing records from primary storage. [2025-09-29T22:09:44.613300] [DEBUG] [LOCAL ] GS: Loaded 51915 existing records from primary storage. [2025-09-29T22:09:44.619802] [INFO ] [MAIN ] GSK: Loaded 53491 primary data records. [2025-09-29T22:09:44.620090] [INFO ] [MAIN ] GS: Loaded 51915 primary data records. [2025-09-29T22:09:45.742195] [DEBUG] [MAIN ] GSBD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:45.743372] [INFO ] [MAIN ] GSBD: Generated 1794 derivative records from 39044 primary records. [2025-09-29T22:09:45.751768] [DEBUG] [LOCAL ] GSBD: Saving derivative data. [2025-09-29T22:09:45.771963] [DEBUG] [MAIN ] GS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:45.773453] [INFO ] [MAIN ] GS: Generated 1794 derivative records from 51915 primary records. [2025-09-29T22:09:45.773691] [DEBUG] [LOCAL ] GS: Saving derivative data. [2025-09-29T22:09:45.773530] [DEBUG] [MAIN ] GSK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:45.774637] [INFO ] [MAIN ] GSK: Generated 1794 derivative records from 53491 primary records. [2025-09-29T22:09:45.782191] [DEBUG] [LOCAL ] GSK: Saving derivative data. [2025-09-29T22:09:45.816817] [DEBUG] [LOCAL ] GSBD: Derivative data saved (1794 records). [2025-09-29T22:09:45.817871] [INFO ] [MAIN ] GSBD: Successfully saved derivative data. [2025-09-29T22:09:45.820504] [INFO ] [MAIN ] Derivative Progress: 799/2057 symbols completed. GSBD took 1.3s. Estimated remaining: 8m 32s. Rate: 147.3 symbols/min [2025-09-29T22:09:45.821743] [INFO ] [MAIN ] GSL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:45.829628] [DEBUG] [LOCAL ] GS: Derivative data saved (1794 records). [2025-09-29T22:09:45.830419] [INFO ] [MAIN ] GS: Successfully saved derivative data. [2025-09-29T22:09:45.832947] [INFO ] [MAIN ] Derivative Progress: 800/2057 symbols completed. GS took 1.3s. Estimated remaining: 8m 31s. Rate: 147.5 symbols/min [2025-09-29T22:09:45.833060] [DEBUG] [LOCAL ] GSK: Derivative data saved (1794 records). [2025-09-29T22:09:45.833570] [INFO ] [MAIN ] GSK: Successfully saved derivative data. [2025-09-29T22:09:45.836259] [INFO ] [MAIN ] Derivative Progress: 801/2057 symbols completed. GSK took 1.3s. Estimated remaining: 8m 30s. Rate: 147.6 symbols/min [2025-09-29T22:09:45.833472] [INFO ] [MAIN ] GTES: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:45.836610] [INFO ] [MAIN ] GTLS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:45.883940] [DEBUG] [LOCAL ] GSL: Loaded 33319 existing records from primary storage. [2025-09-29T22:09:45.884126] [INFO ] [MAIN ] GSL: Loaded 33319 primary data records. [2025-09-29T22:09:46.240014] [DEBUG] [LOCAL ] GTES: Loaded 50587 existing records from primary storage. [2025-09-29T22:09:46.250241] [INFO ] [MAIN ] GTES: Loaded 50587 primary data records. [2025-09-29T22:09:46.241233] [DEBUG] [LOCAL ] GTLS: Loaded 42738 existing records from primary storage. [2025-09-29T22:09:46.253391] [INFO ] [MAIN ] GTLS: Loaded 42738 primary data records. [2025-09-29T22:09:46.901956] [DEBUG] [MAIN ] GSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:46.903603] [INFO ] [MAIN ] GSL: Generated 1794 derivative records from 33319 primary records. [2025-09-29T22:09:46.903941] [DEBUG] [LOCAL ] GSL: Saving derivative data. [2025-09-29T22:09:46.923597] [DEBUG] [LOCAL ] GSL: Derivative data saved (1794 records). [2025-09-29T22:09:46.924873] [INFO ] [MAIN ] GSL: Successfully saved derivative data. [2025-09-29T22:09:46.927229] [INFO ] [MAIN ] Derivative Progress: 802/2057 symbols completed. GSL took 1.1s. Estimated remaining: 8m 31s. Rate: 147.3 symbols/min [2025-09-29T22:09:46.928399] [INFO ] [MAIN ] GTN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:46.944045] [DEBUG] [MAIN ] GTES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:46.947777] [INFO ] [MAIN ] GTES: Generated 1794 derivative records from 50587 primary records. [2025-09-29T22:09:46.947958] [DEBUG] [LOCAL ] GTES: Saving derivative data. [2025-09-29T22:09:46.974270] [DEBUG] [MAIN ] GTLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:46.976768] [INFO ] [MAIN ] GTLS: Generated 1794 derivative records from 42738 primary records. [2025-09-29T22:09:46.976858] [DEBUG] [LOCAL ] GTLS: Saving derivative data. [2025-09-29T22:09:46.996409] [DEBUG] [LOCAL ] GTLS: Derivative data saved (1794 records). [2025-09-29T22:09:46.996552] [INFO ] [MAIN ] GTLS: Successfully saved derivative data. [2025-09-29T22:09:46.997462] [DEBUG] [LOCAL ] GTES: Derivative data saved (1794 records). [2025-09-29T22:09:46.999969] [INFO ] [MAIN ] Derivative Progress: 803/2057 symbols completed. GTLS took 1.2s. Estimated remaining: 8m 30s. Rate: 147.5 symbols/min [2025-09-29T22:09:47.000441] [INFO ] [MAIN ] GTY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:47.000320] [INFO ] [MAIN ] GTES: Successfully saved derivative data. [2025-09-29T22:09:47.013596] [INFO ] [MAIN ] Derivative Progress: 804/2057 symbols completed. GTES took 1.2s. Estimated remaining: 8m 29s. Rate: 147.7 symbols/min [2025-09-29T22:09:47.014008] [INFO ] [MAIN ] GUG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:47.033407] [DEBUG] [LOCAL ] GTN: Loaded 45555 existing records from primary storage. [2025-09-29T22:09:47.044213] [INFO ] [MAIN ] GTN: Loaded 45555 primary data records. [2025-09-29T22:09:47.129266] [DEBUG] [LOCAL ] GUG: Loaded 12025 existing records from primary storage. [2025-09-29T22:09:47.142415] [INFO ] [MAIN ] GUG: Loaded 12025 primary data records. [2025-09-29T22:09:47.212532] [DEBUG] [LOCAL ] GTY: Loaded 30315 existing records from primary storage. [2025-09-29T22:09:47.260189] [INFO ] [MAIN ] GTY: Loaded 30315 primary data records. [2025-09-29T22:09:48.124520] [DEBUG] [MAIN ] GTN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:48.125637] [INFO ] [MAIN ] GTN: Generated 1794 derivative records from 45555 primary records. [2025-09-29T22:09:48.126015] [DEBUG] [LOCAL ] GTN: Saving derivative data. [2025-09-29T22:09:48.147394] [DEBUG] [LOCAL ] GTN: Derivative data saved (1794 records). [2025-09-29T22:09:48.148987] [INFO ] [MAIN ] GTN: Successfully saved derivative data. [2025-09-29T22:09:48.154015] [INFO ] [MAIN ] Derivative Progress: 805/2057 symbols completed. GTN took 1.2s. Estimated remaining: 8m 30s. Rate: 147.3 symbols/min [2025-09-29T22:09:48.155376] [INFO ] [MAIN ] GUT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:48.188285] [DEBUG] [MAIN ] GTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:48.189827] [INFO ] [MAIN ] GTY: Generated 1794 derivative records from 30315 primary records. [2025-09-29T22:09:48.190277] [DEBUG] [LOCAL ] GTY: Saving derivative data. [2025-09-29T22:09:48.190096] [DEBUG] [MAIN ] GUG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:48.202245] [INFO ] [MAIN ] GUG: Generated 1794 derivative records from 12025 primary records. [2025-09-29T22:09:48.207151] [DEBUG] [LOCAL ] GUG: Saving derivative data. [2025-09-29T22:09:48.230238] [DEBUG] [LOCAL ] GTY: Derivative data saved (1794 records). [2025-09-29T22:09:48.233729] [INFO ] [MAIN ] GTY: Successfully saved derivative data. [2025-09-29T22:09:48.237886] [INFO ] [MAIN ] Derivative Progress: 806/2057 symbols completed. GTY took 1.2s. Estimated remaining: 8m 29s. Rate: 147.5 symbols/min [2025-09-29T22:09:48.235214] [DEBUG] [LOCAL ] GUG: Derivative data saved (1794 records). [2025-09-29T22:09:48.238270] [INFO ] [MAIN ] GVA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:48.244381] [INFO ] [MAIN ] GUG: Successfully saved derivative data. [2025-09-29T22:09:48.247821] [INFO ] [MAIN ] Derivative Progress: 807/2057 symbols completed. GUG took 1.2s. Estimated remaining: 8m 28s. Rate: 147.7 symbols/min [2025-09-29T22:09:48.248006] [INFO ] [MAIN ] GWH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:48.245180] [DEBUG] [LOCAL ] GUT: Loaded 15315 existing records from primary storage. [2025-09-29T22:09:48.248408] [INFO ] [MAIN ] GUT: Loaded 15315 primary data records. [2025-09-29T22:09:48.379181] [DEBUG] [LOCAL ] GWH: Loaded 15818 existing records from primary storage. [2025-09-29T22:09:48.400300] [INFO ] [MAIN ] GWH: Loaded 15818 primary data records. [2025-09-29T22:09:48.683195] [DEBUG] [LOCAL ] GVA: Loaded 33227 existing records from primary storage. [2025-09-29T22:09:48.701942] [INFO ] [MAIN ] GVA: Loaded 33227 primary data records. [2025-09-29T22:09:49.258093] [DEBUG] [MAIN ] GUT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:49.260299] [INFO ] [MAIN ] GUT: Generated 1794 derivative records from 15315 primary records. [2025-09-29T22:09:49.260414] [DEBUG] [LOCAL ] GUT: Saving derivative data. [2025-09-29T22:09:49.278520] [DEBUG] [LOCAL ] GUT: Derivative data saved (1794 records). [2025-09-29T22:09:49.278723] [INFO ] [MAIN ] GUT: Successfully saved derivative data. [2025-09-29T22:09:49.280922] [INFO ] [MAIN ] Derivative Progress: 808/2057 symbols completed. GUT took 1.1s. Estimated remaining: 8m 28s. Rate: 147.4 symbols/min [2025-09-29T22:09:49.299974] [DEBUG] [MAIN ] GWH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:49.300745] [INFO ] [MAIN ] GWH: Generated 1794 derivative records from 15818 primary records. [2025-09-29T22:09:49.300894] [DEBUG] [LOCAL ] GWH: Saving derivative data. [2025-09-29T22:09:49.329760] [DEBUG] [MAIN ] GVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:49.330975] [INFO ] [MAIN ] GVA: Generated 1794 derivative records from 33227 primary records. [2025-09-29T22:09:49.331324] [DEBUG] [LOCAL ] GVA: Saving derivative data. [2025-09-29T22:09:49.344888] [DEBUG] [LOCAL ] GWH: Derivative data saved (1794 records). [2025-09-29T22:09:49.347407] [INFO ] [MAIN ] GWH: Successfully saved derivative data. [2025-09-29T22:09:49.350241] [INFO ] [MAIN ] Derivative Progress: 809/2057 symbols completed. GWH took 1.1s. Estimated remaining: 8m 28s. Rate: 147.5 symbols/min [2025-09-29T22:09:49.352667] [DEBUG] [LOCAL ] GVA: Derivative data saved (1794 records). [2025-09-29T22:09:49.352933] [INFO ] [MAIN ] GVA: Successfully saved derivative data. [2025-09-29T22:09:49.355402] [INFO ] [MAIN ] Derivative Progress: 810/2057 symbols completed. GVA took 1.1s. Estimated remaining: 8m 27s. Rate: 147.7 symbols/min [2025-09-29T22:09:49.356018] [INFO ] [MAIN ] GWW: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:49.355937] [INFO ] [MAIN ] GWRE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:49.356172] [INFO ] [MAIN ] GXO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:49.381007] [DEBUG] [LOCAL ] GWW: Loaded 19542 existing records from primary storage. [2025-09-29T22:09:49.381527] [INFO ] [MAIN ] GWW: Loaded 19542 primary data records. [2025-09-29T22:09:49.544625] [DEBUG] [LOCAL ] GWRE: Loaded 40718 existing records from primary storage. [2025-09-29T22:09:49.595524] [INFO ] [MAIN ] GWRE: Loaded 40718 primary data records. [2025-09-29T22:09:49.765680] [DEBUG] [LOCAL ] GXO: Loaded 47499 existing records from primary storage. [2025-09-29T22:09:49.823292] [INFO ] [MAIN ] GXO: Loaded 47499 primary data records. [2025-09-29T22:09:50.474422] [DEBUG] [MAIN ] GWW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:50.475591] [INFO ] [MAIN ] GWW: Generated 1794 derivative records from 19542 primary records. [2025-09-29T22:09:50.476297] [DEBUG] [LOCAL ] GWW: Saving derivative data. [2025-09-29T22:09:50.498387] [DEBUG] [LOCAL ] GWW: Derivative data saved (1794 records). [2025-09-29T22:09:50.499155] [INFO ] [MAIN ] GWW: Successfully saved derivative data. [2025-09-29T22:09:50.503714] [INFO ] [MAIN ] Derivative Progress: 811/2057 symbols completed. GWW took 1.1s. Estimated remaining: 8m 27s. Rate: 147.4 symbols/min [2025-09-29T22:09:50.505463] [INFO ] [MAIN ] GYLD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:50.511665] [DEBUG] [LOCAL ] GYLD: Loaded 1537 existing records from primary storage. [2025-09-29T22:09:50.512335] [INFO ] [MAIN ] GYLD: Loaded 1537 primary data records. [2025-09-29T22:09:50.682582] [DEBUG] [MAIN ] GXO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:50.706864] [INFO ] [MAIN ] GXO: Generated 1794 derivative records from 47499 primary records. [2025-09-29T22:09:50.742226] [DEBUG] [MAIN ] GWRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:50.734891] [DEBUG] [LOCAL ] GXO: Saving derivative data. [2025-09-29T22:09:50.806626] [INFO ] [MAIN ] GWRE: Generated 1794 derivative records from 40718 primary records. [2025-09-29T22:09:50.815141] [DEBUG] [LOCAL ] GWRE: Saving derivative data. [2025-09-29T22:09:50.975172] [DEBUG] [LOCAL ] GXO: Derivative data saved (1794 records). [2025-09-29T22:09:51.000561] [INFO ] [MAIN ] GXO: Successfully saved derivative data. [2025-09-29T22:09:51.003889] [INFO ] [MAIN ] Derivative Progress: 812/2057 symbols completed. GXO took 1.6s. Estimated remaining: 8m 27s. Rate: 147.3 symbols/min [2025-09-29T22:09:51.013912] [INFO ] [MAIN ] H: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:51.027697] [DEBUG] [LOCAL ] GWRE: Derivative data saved (1794 records). [2025-09-29T22:09:51.028427] [INFO ] [MAIN ] GWRE: Successfully saved derivative data. [2025-09-29T22:09:51.031392] [INFO ] [MAIN ] Derivative Progress: 813/2057 symbols completed. GWRE took 1.7s. Estimated remaining: 8m 26s. Rate: 147.5 symbols/min [2025-09-29T22:09:51.031959] [INFO ] [MAIN ] HAE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:51.081238] [DEBUG] [MAIN ] GYLD: Filtered 7001 bins outside market hours, 7825 incomplete bins [2025-09-29T22:09:51.093012] [INFO ] [MAIN ] GYLD: Generated 1789 derivative records from 1537 primary records. [2025-09-29T22:09:51.093294] [DEBUG] [LOCAL ] GYLD: Saving derivative data. [2025-09-29T22:09:51.117992] [DEBUG] [LOCAL ] GYLD: Derivative data saved (1789 records). [2025-09-29T22:09:51.143449] [INFO ] [MAIN ] GYLD: Successfully saved derivative data. [2025-09-29T22:09:51.142139] [DEBUG] [LOCAL ] HAE: Loaded 39432 existing records from primary storage. [2025-09-29T22:09:51.143804] [INFO ] [MAIN ] HAE: Loaded 39432 primary data records. [2025-09-29T22:09:51.187694] [INFO ] [MAIN ] Derivative Progress: 814/2057 symbols completed. GYLD took 0.7s. Estimated remaining: 8m 25s. Rate: 147.6 symbols/min [2025-09-29T22:09:51.195806] [INFO ] [MAIN ] HAFN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:51.236301] [DEBUG] [LOCAL ] H: Loaded 44703 existing records from primary storage. [2025-09-29T22:09:51.257549] [INFO ] [MAIN ] H: Loaded 44703 primary data records. [2025-09-29T22:09:51.882308] [DEBUG] [LOCAL ] HAFN: Loaded 43393 existing records from primary storage. [2025-09-29T22:09:51.970076] [INFO ] [MAIN ] HAFN: Loaded 43393 primary data records. [2025-09-29T22:09:52.396867] [DEBUG] [MAIN ] HAE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:52.401625] [INFO ] [MAIN ] HAE: Generated 1794 derivative records from 39432 primary records. [2025-09-29T22:09:52.402113] [DEBUG] [LOCAL ] HAE: Saving derivative data. [2025-09-29T22:09:52.424380] [DEBUG] [MAIN ] H: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:52.429477] [INFO ] [MAIN ] H: Generated 1794 derivative records from 44703 primary records. [2025-09-29T22:09:52.435716] [DEBUG] [LOCAL ] H: Saving derivative data. [2025-09-29T22:09:52.435302] [DEBUG] [LOCAL ] HAE: Derivative data saved (1794 records). [2025-09-29T22:09:52.436943] [INFO ] [MAIN ] HAE: Successfully saved derivative data. [2025-09-29T22:09:52.453623] [INFO ] [MAIN ] Derivative Progress: 815/2057 symbols completed. HAE took 1.4s. Estimated remaining: 8m 26s. Rate: 147.2 symbols/min [2025-09-29T22:09:52.454379] [INFO ] [MAIN ] HAL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:52.459411] [DEBUG] [LOCAL ] H: Derivative data saved (1794 records). [2025-09-29T22:09:52.459552] [INFO ] [MAIN ] H: Successfully saved derivative data. [2025-09-29T22:09:52.463203] [INFO ] [MAIN ] Derivative Progress: 816/2057 symbols completed. H took 1.4s. Estimated remaining: 8m 25s. Rate: 147.4 symbols/min [2025-09-29T22:09:52.463529] [INFO ] [MAIN ] HASI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:52.481058] [DEBUG] [MAIN ] HAFN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:52.481934] [INFO ] [MAIN ] HAFN: Generated 1794 derivative records from 43393 primary records. [2025-09-29T22:09:52.482164] [DEBUG] [LOCAL ] HAFN: Saving derivative data. [2025-09-29T22:09:52.501710] [DEBUG] [LOCAL ] HAFN: Derivative data saved (1794 records). [2025-09-29T22:09:52.501924] [INFO ] [MAIN ] HAFN: Successfully saved derivative data. [2025-09-29T22:09:52.504101] [INFO ] [MAIN ] Derivative Progress: 817/2057 symbols completed. HAFN took 1.3s. Estimated remaining: 8m 24s. Rate: 147.6 symbols/min [2025-09-29T22:09:52.504404] [INFO ] [MAIN ] HAYW: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:52.552766] [DEBUG] [LOCAL ] HAL: Loaded 53718 existing records from primary storage. [2025-09-29T22:09:52.552989] [INFO ] [MAIN ] HAL: Loaded 53718 primary data records. [2025-09-29T22:09:52.694040] [DEBUG] [LOCAL ] HASI: Loaded 47129 existing records from primary storage. [2025-09-29T22:09:52.715521] [INFO ] [MAIN ] HASI: Loaded 47129 primary data records. [2025-09-29T22:09:53.016086] [DEBUG] [LOCAL ] HAYW: Loaded 48702 existing records from primary storage. [2025-09-29T22:09:53.031609] [INFO ] [MAIN ] HAYW: Loaded 48702 primary data records. [2025-09-29T22:09:53.591117] [DEBUG] [MAIN ] HAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:53.592723] [INFO ] [MAIN ] HAL: Generated 1794 derivative records from 53718 primary records. [2025-09-29T22:09:53.592966] [DEBUG] [LOCAL ] HAL: Saving derivative data. [2025-09-29T22:09:53.615187] [DEBUG] [LOCAL ] HAL: Derivative data saved (1794 records). [2025-09-29T22:09:53.616860] [INFO ] [MAIN ] HAL: Successfully saved derivative data. [2025-09-29T22:09:53.619042] [INFO ] [MAIN ] Derivative Progress: 818/2057 symbols completed. HAL took 1.2s. Estimated remaining: 8m 25s. Rate: 147.3 symbols/min [2025-09-29T22:09:53.619564] [INFO ] [MAIN ] HBB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:53.635181] [DEBUG] [MAIN ] HASI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:53.636174] [INFO ] [MAIN ] HASI: Generated 1794 derivative records from 47129 primary records. [2025-09-29T22:09:53.636431] [DEBUG] [LOCAL ] HASI: Saving derivative data. [2025-09-29T22:09:53.655791] [DEBUG] [LOCAL ] HBB: Loaded 6697 existing records from primary storage. [2025-09-29T22:09:53.658501] [INFO ] [MAIN ] HBB: Loaded 6697 primary data records. [2025-09-29T22:09:53.742072] [DEBUG] [MAIN ] HAYW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:53.748611] [INFO ] [MAIN ] HAYW: Generated 1794 derivative records from 48702 primary records. [2025-09-29T22:09:53.761904] [DEBUG] [LOCAL ] HAYW: Saving derivative data. [2025-09-29T22:09:53.761802] [DEBUG] [LOCAL ] HASI: Derivative data saved (1794 records). [2025-09-29T22:09:53.786475] [INFO ] [MAIN ] HASI: Successfully saved derivative data. [2025-09-29T22:09:53.789506] [INFO ] [MAIN ] Derivative Progress: 819/2057 symbols completed. HASI took 1.3s. Estimated remaining: 8m 24s. Rate: 147.4 symbols/min [2025-09-29T22:09:53.790423] [INFO ] [MAIN ] HBI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:54.020334] [DEBUG] [LOCAL ] HAYW: Derivative data saved (1794 records). [2025-09-29T22:09:54.020486] [INFO ] [MAIN ] HAYW: Successfully saved derivative data. [2025-09-29T22:09:54.022837] [INFO ] [MAIN ] Derivative Progress: 820/2057 symbols completed. HAYW took 1.5s. Estimated remaining: 8m 23s. Rate: 147.4 symbols/min [2025-09-29T22:09:54.023264] [INFO ] [MAIN ] HBM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:54.079013] [DEBUG] [LOCAL ] HBI: Loaded 52992 existing records from primary storage. [2025-09-29T22:09:54.090347] [INFO ] [MAIN ] HBI: Loaded 52992 primary data records. [2025-09-29T22:09:54.139150] [DEBUG] [MAIN ] HBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:54.166412] [INFO ] [MAIN ] HBB: Generated 1794 derivative records from 6697 primary records. [2025-09-29T22:09:54.181440] [DEBUG] [LOCAL ] HBB: Saving derivative data. [2025-09-29T22:09:54.254012] [DEBUG] [LOCAL ] HBM: Loaded 52906 existing records from primary storage. [2025-09-29T22:09:54.268267] [INFO ] [MAIN ] HBM: Loaded 52906 primary data records. [2025-09-29T22:09:54.634847] [DEBUG] [LOCAL ] HBB: Derivative data saved (1794 records). [2025-09-29T22:09:54.657572] [INFO ] [MAIN ] HBB: Successfully saved derivative data. [2025-09-29T22:09:54.665462] [INFO ] [MAIN ] Derivative Progress: 821/2057 symbols completed. HBB took 1.0s. Estimated remaining: 8m 23s. Rate: 147.3 symbols/min [2025-09-29T22:09:54.670932] [INFO ] [MAIN ] HCA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:54.875335] [DEBUG] [MAIN ] HBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:54.876786] [INFO ] [MAIN ] HBI: Generated 1794 derivative records from 52992 primary records. [2025-09-29T22:09:54.877024] [DEBUG] [LOCAL ] HBI: Saving derivative data. [2025-09-29T22:09:54.905401] [DEBUG] [LOCAL ] HBI: Derivative data saved (1794 records). [2025-09-29T22:09:54.905623] [INFO ] [MAIN ] HBI: Successfully saved derivative data. [2025-09-29T22:09:54.907917] [INFO ] [MAIN ] Derivative Progress: 822/2057 symbols completed. HBI took 1.1s. Estimated remaining: 8m 23s. Rate: 147.4 symbols/min [2025-09-29T22:09:54.908151] [INFO ] [MAIN ] HCC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:54.940455] [DEBUG] [LOCAL ] HCA: Loaded 46951 existing records from primary storage. [2025-09-29T22:09:54.940911] [INFO ] [MAIN ] HCA: Loaded 46951 primary data records. [2025-09-29T22:09:54.941391] [DEBUG] [MAIN ] HBM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:54.975671] [INFO ] [MAIN ] HBM: Generated 1794 derivative records from 52906 primary records. [2025-09-29T22:09:55.017436] [DEBUG] [LOCAL ] HBM: Saving derivative data. [2025-09-29T22:09:55.171844] [DEBUG] [LOCAL ] HBM: Derivative data saved (1794 records). [2025-09-29T22:09:55.306970] [INFO ] [MAIN ] HBM: Successfully saved derivative data. [2025-09-29T22:09:55.309631] [INFO ] [MAIN ] Derivative Progress: 823/2057 symbols completed. HBM took 1.3s. Estimated remaining: 8m 22s. Rate: 147.4 symbols/min [2025-09-29T22:09:55.310989] [DEBUG] [LOCAL ] HCC: Loaded 45384 existing records from primary storage. [2025-09-29T22:09:55.311774] [INFO ] [MAIN ] HCC: Loaded 45384 primary data records. [2025-09-29T22:09:55.669036] [DEBUG] [MAIN ] HCA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:55.670013] [INFO ] [MAIN ] HCA: Generated 1794 derivative records from 46951 primary records. [2025-09-29T22:09:55.670356] [DEBUG] [LOCAL ] HCA: Saving derivative data. [2025-09-29T22:09:55.688127] [DEBUG] [LOCAL ] HCA: Derivative data saved (1794 records). [2025-09-29T22:09:55.689741] [INFO ] [MAIN ] HCA: Successfully saved derivative data. [2025-09-29T22:09:55.692477] [INFO ] [MAIN ] Derivative Progress: 824/2057 symbols completed. HCA took 1.0s. Estimated remaining: 8m 22s. Rate: 147.4 symbols/min [2025-09-29T22:09:55.705331] [DEBUG] [MAIN ] HCC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:55.705943] [INFO ] [MAIN ] HCC: Generated 1794 derivative records from 45384 primary records. [2025-09-29T22:09:55.706010] [DEBUG] [LOCAL ] HCC: Saving derivative data. [2025-09-29T22:09:55.721055] [DEBUG] [LOCAL ] HCC: Derivative data saved (1794 records). [2025-09-29T22:09:55.721123] [INFO ] [MAIN ] HCC: Successfully saved derivative data. [2025-09-29T22:09:55.723296] [INFO ] [MAIN ] Derivative Progress: 825/2057 symbols completed. HCC took 0.8s. Estimated remaining: 8m 21s. Rate: 147.6 symbols/min [2025-09-29T22:09:55.723832] [INFO ] [MAIN ] HCI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:55.724012] [INFO ] [MAIN ] HD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:55.723933] [INFO ] [MAIN ] HDB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:55.741132] [DEBUG] [LOCAL ] HCI: Loaded 13948 existing records from primary storage. [2025-09-29T22:09:55.741398] [INFO ] [MAIN ] HCI: Loaded 13948 primary data records. [2025-09-29T22:09:56.116386] [DEBUG] [LOCAL ] HDB: Loaded 51912 existing records from primary storage. [2025-09-29T22:09:56.117352] [DEBUG] [LOCAL ] HD: Loaded 53503 existing records from primary storage. [2025-09-29T22:09:56.117756] [INFO ] [MAIN ] HDB: Loaded 51912 primary data records. [2025-09-29T22:09:56.117874] [INFO ] [MAIN ] HD: Loaded 53503 primary data records. [2025-09-29T22:09:56.834972] [DEBUG] [MAIN ] HCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:56.837089] [INFO ] [MAIN ] HCI: Generated 1794 derivative records from 13948 primary records. [2025-09-29T22:09:56.838197] [DEBUG] [LOCAL ] HCI: Saving derivative data. [2025-09-29T22:09:56.860122] [DEBUG] [LOCAL ] HCI: Derivative data saved (1794 records). [2025-09-29T22:09:56.861230] [INFO ] [MAIN ] HCI: Successfully saved derivative data. [2025-09-29T22:09:56.864510] [INFO ] [MAIN ] Derivative Progress: 826/2057 symbols completed. HCI took 1.1s. Estimated remaining: 8m 22s. Rate: 147.3 symbols/min [2025-09-29T22:09:56.865154] [INFO ] [MAIN ] HE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:56.880701] [DEBUG] [MAIN ] HDB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:56.883490] [INFO ] [MAIN ] HDB: Generated 1794 derivative records from 51912 primary records. [2025-09-29T22:09:56.883765] [DEBUG] [LOCAL ] HDB: Saving derivative data. [2025-09-29T22:09:56.898194] [DEBUG] [MAIN ] HD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:56.906611] [INFO ] [MAIN ] HD: Generated 1794 derivative records from 53503 primary records. [2025-09-29T22:09:56.908106] [DEBUG] [LOCAL ] HD: Saving derivative data. [2025-09-29T22:09:56.931060] [DEBUG] [LOCAL ] HDB: Derivative data saved (1794 records). [2025-09-29T22:09:56.932042] [INFO ] [MAIN ] HDB: Successfully saved derivative data. [2025-09-29T22:09:56.934385] [INFO ] [MAIN ] Derivative Progress: 827/2057 symbols completed. HDB took 1.2s. Estimated remaining: 8m 21s. Rate: 147.4 symbols/min [2025-09-29T22:09:56.935271] [INFO ] [MAIN ] HEI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:56.950421] [DEBUG] [LOCAL ] HD: Derivative data saved (1794 records). [2025-09-29T22:09:56.950769] [INFO ] [MAIN ] HD: Successfully saved derivative data. [2025-09-29T22:09:56.952950] [INFO ] [MAIN ] Derivative Progress: 828/2057 symbols completed. HD took 1.2s. Estimated remaining: 8m 20s. Rate: 147.6 symbols/min [2025-09-29T22:09:56.953281] [INFO ] [MAIN ] HEQ: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:56.984291] [DEBUG] [LOCAL ] HEQ: Loaded 6221 existing records from primary storage. [2025-09-29T22:09:56.985640] [DEBUG] [LOCAL ] HE: Loaded 49059 existing records from primary storage. [2025-09-29T22:09:56.985838] [INFO ] [MAIN ] HEQ: Loaded 6221 primary data records. [2025-09-29T22:09:56.985925] [INFO ] [MAIN ] HE: Loaded 49059 primary data records. [2025-09-29T22:09:57.173447] [DEBUG] [LOCAL ] HEI: Loaded 32223 existing records from primary storage. [2025-09-29T22:09:57.196161] [INFO ] [MAIN ] HEI: Loaded 32223 primary data records. [2025-09-29T22:09:57.993859] [DEBUG] [MAIN ] HE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:58.000014] [INFO ] [MAIN ] HE: Generated 1794 derivative records from 49059 primary records. [2025-09-29T22:09:58.001117] [DEBUG] [MAIN ] HEQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:58.002053] [INFO ] [MAIN ] HEQ: Generated 1794 derivative records from 6221 primary records. [2025-09-29T22:09:58.002180] [DEBUG] [LOCAL ] HEQ: Saving derivative data. [2025-09-29T22:09:58.001218] [DEBUG] [LOCAL ] HE: Saving derivative data. [2025-09-29T22:09:58.034076] [DEBUG] [LOCAL ] HEQ: Derivative data saved (1794 records). [2025-09-29T22:09:58.037686] [INFO ] [MAIN ] HEQ: Successfully saved derivative data. [2025-09-29T22:09:58.044273] [DEBUG] [LOCAL ] HE: Derivative data saved (1794 records). [2025-09-29T22:09:58.041855] [INFO ] [MAIN ] Derivative Progress: 829/2057 symbols completed. HEQ took 1.1s. Estimated remaining: 8m 20s. Rate: 147.3 symbols/min [2025-09-29T22:09:58.044565] [INFO ] [MAIN ] HESM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:58.044835] [INFO ] [MAIN ] HE: Successfully saved derivative data. [2025-09-29T22:09:58.047438] [INFO ] [MAIN ] Derivative Progress: 830/2057 symbols completed. HE took 1.2s. Estimated remaining: 8m 19s. Rate: 147.5 symbols/min [2025-09-29T22:09:58.047894] [INFO ] [MAIN ] HFRO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:58.062270] [DEBUG] [MAIN ] HEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:58.063412] [INFO ] [MAIN ] HEI: Generated 1794 derivative records from 32223 primary records. [2025-09-29T22:09:58.063672] [DEBUG] [LOCAL ] HEI: Saving derivative data. [2025-09-29T22:09:58.095537] [DEBUG] [LOCAL ] HEI: Derivative data saved (1794 records). [2025-09-29T22:09:58.095456] [DEBUG] [LOCAL ] HFRO: Loaded 17595 existing records from primary storage. [2025-09-29T22:09:58.095724] [INFO ] [MAIN ] HEI: Successfully saved derivative data. [2025-09-29T22:09:58.098242] [INFO ] [MAIN ] Derivative Progress: 831/2057 symbols completed. HEI took 1.2s. Estimated remaining: 8m 18s. Rate: 147.6 symbols/min [2025-09-29T22:09:58.098540] [INFO ] [MAIN ] HGER: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:58.098701] [INFO ] [MAIN ] HFRO: Loaded 17595 primary data records. [2025-09-29T22:09:58.227103] [DEBUG] [LOCAL ] HGER: Loaded 13386 existing records from primary storage. [2025-09-29T22:09:58.244233] [INFO ] [MAIN ] HGER: Loaded 13386 primary data records. [2025-09-29T22:09:58.297774] [DEBUG] [LOCAL ] HESM: Loaded 48194 existing records from primary storage. [2025-09-29T22:09:58.335249] [INFO ] [MAIN ] HESM: Loaded 48194 primary data records. [2025-09-29T22:09:59.207361] [DEBUG] [MAIN ] HFRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:59.208515] [INFO ] [MAIN ] HFRO: Generated 1794 derivative records from 17595 primary records. [2025-09-29T22:09:59.210144] [DEBUG] [LOCAL ] HFRO: Saving derivative data. [2025-09-29T22:09:59.228931] [DEBUG] [LOCAL ] HFRO: Derivative data saved (1794 records). [2025-09-29T22:09:59.230898] [INFO ] [MAIN ] HFRO: Successfully saved derivative data. [2025-09-29T22:09:59.233310] [INFO ] [MAIN ] Derivative Progress: 832/2057 symbols completed. HFRO took 1.2s. Estimated remaining: 8m 19s. Rate: 147.3 symbols/min [2025-09-29T22:09:59.233556] [INFO ] [MAIN ] HGLB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:59.251253] [DEBUG] [MAIN ] HGER: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:59.252238] [INFO ] [MAIN ] HGER: Generated 1794 derivative records from 13386 primary records. [2025-09-29T22:09:59.255235] [DEBUG] [LOCAL ] HGER: Saving derivative data. [2025-09-29T22:09:59.269728] [DEBUG] [MAIN ] HESM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:09:59.270877] [INFO ] [MAIN ] HESM: Generated 1794 derivative records from 48194 primary records. [2025-09-29T22:09:59.271382] [DEBUG] [LOCAL ] HESM: Saving derivative data. [2025-09-29T22:09:59.299134] [DEBUG] [LOCAL ] HESM: Derivative data saved (1794 records). [2025-09-29T22:09:59.295044] [DEBUG] [LOCAL ] HGLB: Loaded 9393 existing records from primary storage. [2025-09-29T22:09:59.303563] [INFO ] [MAIN ] HGLB: Loaded 9393 primary data records. [2025-09-29T22:09:59.303928] [INFO ] [MAIN ] HESM: Successfully saved derivative data. [2025-09-29T22:09:59.306704] [INFO ] [MAIN ] Derivative Progress: 833/2057 symbols completed. HESM took 1.3s. Estimated remaining: 8m 18s. Rate: 147.4 symbols/min [2025-09-29T22:09:59.307143] [INFO ] [MAIN ] HGTY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:09:59.437615] [DEBUG] [LOCAL ] HGER: Derivative data saved (1794 records). [2025-09-29T22:09:59.438028] [DEBUG] [LOCAL ] HGTY: Loaded 13122 existing records from primary storage. [2025-09-29T22:09:59.438356] [INFO ] [MAIN ] HGTY: Loaded 13122 primary data records. [2025-09-29T22:09:59.438440] [INFO ] [MAIN ] HGER: Successfully saved derivative data. [2025-09-29T22:09:59.473805] [INFO ] [MAIN ] Derivative Progress: 834/2057 symbols completed. HGER took 1.4s. Estimated remaining: 8m 17s. Rate: 147.5 symbols/min [2025-09-29T22:09:59.529518] [INFO ] [MAIN ] HGV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:00.042138] [DEBUG] [LOCAL ] HGV: Loaded 46645 existing records from primary storage. [2025-09-29T22:10:00.042889] [INFO ] [MAIN ] HGV: Loaded 46645 primary data records. [2025-09-29T22:10:00.070249] [DEBUG] [MAIN ] HGLB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:00.107363] [INFO ] [MAIN ] HGLB: Generated 1794 derivative records from 9393 primary records. [2025-09-29T22:10:00.149451] [DEBUG] [LOCAL ] HGLB: Saving derivative data. [2025-09-29T22:10:00.284424] [DEBUG] [LOCAL ] HGLB: Derivative data saved (1794 records). [2025-09-29T22:10:00.323062] [INFO ] [MAIN ] HGLB: Successfully saved derivative data. [2025-09-29T22:10:00.316776] [DEBUG] [MAIN ] HGTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:00.360837] [INFO ] [MAIN ] HGTY: Generated 1794 derivative records from 13122 primary records. [2025-09-29T22:10:00.408189] [INFO ] [MAIN ] Derivative Progress: 835/2057 symbols completed. HGLB took 1.2s. Estimated remaining: 8m 18s. Rate: 147.3 symbols/min [2025-09-29T22:10:00.408399] [DEBUG] [LOCAL ] HGTY: Saving derivative data. [2025-09-29T22:10:00.408533] [INFO ] [MAIN ] HHH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:00.443836] [DEBUG] [LOCAL ] HGTY: Derivative data saved (1794 records). [2025-09-29T22:10:00.444937] [INFO ] [MAIN ] HGTY: Successfully saved derivative data. [2025-09-29T22:10:00.447709] [INFO ] [MAIN ] Derivative Progress: 836/2057 symbols completed. HGTY took 1.1s. Estimated remaining: 8m 17s. Rate: 147.5 symbols/min [2025-09-29T22:10:00.448355] [INFO ] [MAIN ] HI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:00.495188] [DEBUG] [LOCAL ] HHH: Loaded 32605 existing records from primary storage. [2025-09-29T22:10:00.494485] [DEBUG] [MAIN ] HGV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:00.496183] [INFO ] [MAIN ] HGV: Generated 1794 derivative records from 46645 primary records. [2025-09-29T22:10:00.495387] [INFO ] [MAIN ] HHH: Loaded 32605 primary data records. [2025-09-29T22:10:00.496439] [DEBUG] [LOCAL ] HGV: Saving derivative data. [2025-09-29T22:10:00.641974] [DEBUG] [LOCAL ] HI: Loaded 35198 existing records from primary storage. [2025-09-29T22:10:00.650753] [INFO ] [MAIN ] HI: Loaded 35198 primary data records. [2025-09-29T22:10:00.656842] [DEBUG] [LOCAL ] HGV: Derivative data saved (1794 records). [2025-09-29T22:10:00.674399] [INFO ] [MAIN ] HGV: Successfully saved derivative data. [2025-09-29T22:10:00.688805] [INFO ] [MAIN ] Derivative Progress: 837/2057 symbols completed. HGV took 1.2s. Estimated remaining: 8m 16s. Rate: 147.5 symbols/min [2025-09-29T22:10:00.699412] [INFO ] [MAIN ] HIG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:01.286730] [DEBUG] [LOCAL ] HIG: Loaded 51212 existing records from primary storage. [2025-09-29T22:10:01.287709] [INFO ] [MAIN ] HIG: Loaded 51212 primary data records. [2025-09-29T22:10:01.332768] [DEBUG] [MAIN ] HHH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:01.356221] [INFO ] [MAIN ] HHH: Generated 1794 derivative records from 32605 primary records. [2025-09-29T22:10:01.374467] [DEBUG] [LOCAL ] HHH: Saving derivative data. [2025-09-29T22:10:01.478569] [DEBUG] [MAIN ] HI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:01.484874] [INFO ] [MAIN ] HI: Generated 1794 derivative records from 35198 primary records. [2025-09-29T22:10:01.485231] [DEBUG] [LOCAL ] HI: Saving derivative data. [2025-09-29T22:10:01.699196] [DEBUG] [LOCAL ] HHH: Derivative data saved (1794 records). [2025-09-29T22:10:01.700177] [DEBUG] [LOCAL ] HI: Derivative data saved (1794 records). [2025-09-29T22:10:01.700285] [INFO ] [MAIN ] HI: Successfully saved derivative data. [2025-09-29T22:10:01.702921] [INFO ] [MAIN ] Derivative Progress: 838/2057 symbols completed. HI took 1.3s. Estimated remaining: 8m 17s. Rate: 147.3 symbols/min [2025-09-29T22:10:01.703299] [INFO ] [MAIN ] HHH: Successfully saved derivative data. [2025-09-29T22:10:01.706282] [INFO ] [MAIN ] Derivative Progress: 839/2057 symbols completed. HHH took 1.3s. Estimated remaining: 8m 16s. Rate: 147.5 symbols/min [2025-09-29T22:10:01.729915] [DEBUG] [MAIN ] HIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:01.730563] [INFO ] [MAIN ] HIG: Generated 1794 derivative records from 51212 primary records. [2025-09-29T22:10:01.730630] [DEBUG] [LOCAL ] HIG: Saving derivative data. [2025-09-29T22:10:01.748235] [DEBUG] [LOCAL ] HIG: Derivative data saved (1794 records). [2025-09-29T22:10:01.748339] [INFO ] [MAIN ] HIG: Successfully saved derivative data. [2025-09-29T22:10:01.750728] [INFO ] [MAIN ] Derivative Progress: 840/2057 symbols completed. HIG took 1.1s. Estimated remaining: 8m 15s. Rate: 147.6 symbols/min [2025-09-29T22:10:01.751346] [INFO ] [MAIN ] HII: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:01.751454] [INFO ] [MAIN ] HIO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:01.751839] [INFO ] [MAIN ] HIMS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:01.797719] [DEBUG] [LOCAL ] HIO: Loaded 23694 existing records from primary storage. [2025-09-29T22:10:01.798441] [INFO ] [MAIN ] HIO: Loaded 23694 primary data records. [2025-09-29T22:10:01.869112] [DEBUG] [LOCAL ] HII: Loaded 34805 existing records from primary storage. [2025-09-29T22:10:01.885446] [INFO ] [MAIN ] HII: Loaded 34805 primary data records. [2025-09-29T22:10:01.971131] [DEBUG] [LOCAL ] HIMS: Loaded 53817 existing records from primary storage. [2025-09-29T22:10:02.001308] [INFO ] [MAIN ] HIMS: Loaded 53817 primary data records. [2025-09-29T22:10:02.954899] [DEBUG] [MAIN ] HIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:02.956172] [INFO ] [MAIN ] HIO: Generated 1794 derivative records from 23694 primary records. [2025-09-29T22:10:02.956765] [DEBUG] [LOCAL ] HIO: Saving derivative data. [2025-09-29T22:10:02.999925] [DEBUG] [MAIN ] HIMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:03.001416] [INFO ] [MAIN ] HIMS: Generated 1794 derivative records from 53817 primary records. [2025-09-29T22:10:03.001523] [DEBUG] [LOCAL ] HIMS: Saving derivative data. [2025-09-29T22:10:03.015960] [DEBUG] [LOCAL ] HIO: Derivative data saved (1794 records). [2025-09-29T22:10:03.029107] [DEBUG] [MAIN ] HII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:03.030451] [INFO ] [MAIN ] HII: Generated 1794 derivative records from 34805 primary records. [2025-09-29T22:10:03.029434] [INFO ] [MAIN ] HIO: Successfully saved derivative data. [2025-09-29T22:10:03.030582] [DEBUG] [LOCAL ] HII: Saving derivative data. [2025-09-29T22:10:03.033086] [INFO ] [MAIN ] Derivative Progress: 841/2057 symbols completed. HIO took 1.3s. Estimated remaining: 8m 16s. Rate: 147.2 symbols/min [2025-09-29T22:10:03.033560] [INFO ] [MAIN ] HIPO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:03.052415] [DEBUG] [LOCAL ] HIMS: Derivative data saved (1794 records). [2025-09-29T22:10:03.053193] [INFO ] [MAIN ] HIMS: Successfully saved derivative data. [2025-09-29T22:10:03.055837] [INFO ] [MAIN ] Derivative Progress: 842/2057 symbols completed. HIMS took 1.3s. Estimated remaining: 8m 15s. Rate: 147.4 symbols/min [2025-09-29T22:10:03.056268] [INFO ] [MAIN ] HIW: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:03.066360] [DEBUG] [LOCAL ] HII: Derivative data saved (1794 records). [2025-09-29T22:10:03.066580] [INFO ] [MAIN ] HII: Successfully saved derivative data. [2025-09-29T22:10:03.069351] [INFO ] [MAIN ] Derivative Progress: 843/2057 symbols completed. HII took 1.3s. Estimated remaining: 8m 14s. Rate: 147.6 symbols/min [2025-09-29T22:10:03.069810] [INFO ] [MAIN ] HIX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:03.081354] [DEBUG] [LOCAL ] HIPO: Loaded 22166 existing records from primary storage. [2025-09-29T22:10:03.081565] [INFO ] [MAIN ] HIPO: Loaded 22166 primary data records. [2025-09-29T22:10:03.305110] [DEBUG] [LOCAL ] HIX: Loaded 20488 existing records from primary storage. [2025-09-29T22:10:03.381841] [INFO ] [MAIN ] HIX: Loaded 20488 primary data records. [2025-09-29T22:10:03.481564] [DEBUG] [LOCAL ] HIW: Loaded 44565 existing records from primary storage. [2025-09-29T22:10:03.497718] [INFO ] [MAIN ] HIW: Loaded 44565 primary data records. [2025-09-29T22:10:04.176598] [DEBUG] [MAIN ] HIPO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:04.178026] [INFO ] [MAIN ] HIPO: Generated 1794 derivative records from 22166 primary records. [2025-09-29T22:10:04.178246] [DEBUG] [LOCAL ] HIPO: Saving derivative data. [2025-09-29T22:10:04.201082] [DEBUG] [LOCAL ] HIPO: Derivative data saved (1794 records). [2025-09-29T22:10:04.201496] [INFO ] [MAIN ] HIPO: Successfully saved derivative data. [2025-09-29T22:10:04.203913] [INFO ] [MAIN ] Derivative Progress: 844/2057 symbols completed. HIPO took 1.2s. Estimated remaining: 8m 14s. Rate: 147.3 symbols/min [2025-09-29T22:10:04.204320] [INFO ] [MAIN ] HKD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:04.218637] [DEBUG] [MAIN ] HIX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:04.219810] [INFO ] [MAIN ] HIX: Generated 1794 derivative records from 20488 primary records. [2025-09-29T22:10:04.220027] [DEBUG] [LOCAL ] HIX: Saving derivative data. [2025-09-29T22:10:04.242467] [DEBUG] [LOCAL ] HIX: Derivative data saved (1794 records). [2025-09-29T22:10:04.242704] [INFO ] [MAIN ] HIX: Successfully saved derivative data. [2025-09-29T22:10:04.246500] [INFO ] [MAIN ] Derivative Progress: 845/2057 symbols completed. HIX took 1.2s. Estimated remaining: 8m 13s. Rate: 147.4 symbols/min [2025-09-29T22:10:04.246861] [INFO ] [MAIN ] HL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:04.268162] [DEBUG] [LOCAL ] HKD: Loaded 18306 existing records from primary storage. [2025-09-29T22:10:04.268781] [INFO ] [MAIN ] HKD: Loaded 18306 primary data records. [2025-09-29T22:10:04.268580] [DEBUG] [MAIN ] HIW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:04.269753] [INFO ] [MAIN ] HIW: Generated 1794 derivative records from 44565 primary records. [2025-09-29T22:10:04.281676] [DEBUG] [LOCAL ] HIW: Saving derivative data. [2025-09-29T22:10:04.365907] [DEBUG] [LOCAL ] HIW: Derivative data saved (1794 records). [2025-09-29T22:10:04.376601] [INFO ] [MAIN ] HIW: Successfully saved derivative data. [2025-09-29T22:10:04.397615] [INFO ] [MAIN ] Derivative Progress: 846/2057 symbols completed. HIW took 1.3s. Estimated remaining: 8m 13s. Rate: 147.5 symbols/min [2025-09-29T22:10:04.398013] [INFO ] [MAIN ] HLF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:04.638257] [DEBUG] [LOCAL ] HL: Loaded 53671 existing records from primary storage. [2025-09-29T22:10:04.638597] [INFO ] [MAIN ] HL: Loaded 53671 primary data records. [2025-09-29T22:10:04.814844] [DEBUG] [LOCAL ] HLF: Loaded 48569 existing records from primary storage. [2025-09-29T22:10:04.850610] [INFO ] [MAIN ] HLF: Loaded 48569 primary data records. [2025-09-29T22:10:05.158013] [DEBUG] [MAIN ] HKD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:05.193249] [INFO ] [MAIN ] HKD: Generated 1794 derivative records from 18306 primary records. [2025-09-29T22:10:05.203412] [DEBUG] [LOCAL ] HKD: Saving derivative data. [2025-09-29T22:10:05.439709] [DEBUG] [LOCAL ] HKD: Derivative data saved (1794 records). [2025-09-29T22:10:05.440354] [INFO ] [MAIN ] HKD: Successfully saved derivative data. [2025-09-29T22:10:05.443150] [INFO ] [MAIN ] Derivative Progress: 847/2057 symbols completed. HKD took 1.2s. Estimated remaining: 8m 13s. Rate: 147.3 symbols/min [2025-09-29T22:10:05.446133] [INFO ] [MAIN ] HLI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:05.464451] [DEBUG] [MAIN ] HL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:05.465597] [INFO ] [MAIN ] HL: Generated 1794 derivative records from 53671 primary records. [2025-09-29T22:10:05.465976] [DEBUG] [LOCAL ] HL: Saving derivative data. [2025-09-29T22:10:05.487170] [DEBUG] [LOCAL ] HL: Derivative data saved (1794 records). [2025-09-29T22:10:05.487626] [INFO ] [MAIN ] HL: Successfully saved derivative data. [2025-09-29T22:10:05.490051] [INFO ] [MAIN ] Derivative Progress: 848/2057 symbols completed. HL took 1.2s. Estimated remaining: 8m 12s. Rate: 147.4 symbols/min [2025-09-29T22:10:05.490214] [INFO ] [MAIN ] HLIO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:05.512949] [DEBUG] [MAIN ] HLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:05.514429] [INFO ] [MAIN ] HLF: Generated 1794 derivative records from 48569 primary records. [2025-09-29T22:10:05.514625] [DEBUG] [LOCAL ] HLF: Saving derivative data. [2025-09-29T22:10:05.541094] [DEBUG] [LOCAL ] HLI: Loaded 30942 existing records from primary storage. [2025-09-29T22:10:05.542193] [INFO ] [MAIN ] HLI: Loaded 30942 primary data records. [2025-09-29T22:10:05.592458] [DEBUG] [LOCAL ] HLF: Derivative data saved (1794 records). [2025-09-29T22:10:05.614927] [INFO ] [MAIN ] HLF: Successfully saved derivative data. [2025-09-29T22:10:05.654403] [INFO ] [MAIN ] Derivative Progress: 849/2057 symbols completed. HLF took 1.3s. Estimated remaining: 8m 11s. Rate: 147.5 symbols/min [2025-09-29T22:10:05.679549] [DEBUG] [LOCAL ] HLIO: Loaded 27930 existing records from primary storage. [2025-09-29T22:10:05.679866] [INFO ] [MAIN ] HLLY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:05.707127] [INFO ] [MAIN ] HLIO: Loaded 27930 primary data records. [2025-09-29T22:10:06.040313] [DEBUG] [LOCAL ] HLLY: Loaded 33226 existing records from primary storage. [2025-09-29T22:10:06.062981] [INFO ] [MAIN ] HLLY: Loaded 33226 primary data records. [2025-09-29T22:10:06.620016] [DEBUG] [MAIN ] HLI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:06.621190] [INFO ] [MAIN ] HLI: Generated 1794 derivative records from 30942 primary records. [2025-09-29T22:10:06.621535] [DEBUG] [LOCAL ] HLI: Saving derivative data. [2025-09-29T22:10:06.643533] [DEBUG] [LOCAL ] HLI: Derivative data saved (1794 records). [2025-09-29T22:10:06.643875] [INFO ] [MAIN ] HLI: Successfully saved derivative data. [2025-09-29T22:10:06.646167] [INFO ] [MAIN ] Derivative Progress: 850/2057 symbols completed. HLI took 1.2s. Estimated remaining: 8m 12s. Rate: 147.3 symbols/min [2025-09-29T22:10:06.646366] [INFO ] [MAIN ] HLN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:06.668279] [DEBUG] [MAIN ] HLIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:06.669738] [INFO ] [MAIN ] HLIO: Generated 1794 derivative records from 27930 primary records. [2025-09-29T22:10:06.670075] [DEBUG] [LOCAL ] HLIO: Saving derivative data. [2025-09-29T22:10:06.695554] [DEBUG] [LOCAL ] HLIO: Derivative data saved (1794 records). [2025-09-29T22:10:06.695826] [INFO ] [MAIN ] HLIO: Successfully saved derivative data. [2025-09-29T22:10:06.698515] [INFO ] [MAIN ] Derivative Progress: 851/2057 symbols completed. HLIO took 1.2s. Estimated remaining: 8m 11s. Rate: 147.4 symbols/min [2025-09-29T22:10:06.711414] [INFO ] [MAIN ] HLT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:06.712102] [DEBUG] [MAIN ] HLLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:06.727224] [INFO ] [MAIN ] HLLY: Generated 1794 derivative records from 33226 primary records. [2025-09-29T22:10:06.727751] [DEBUG] [LOCAL ] HLLY: Saving derivative data. [2025-09-29T22:10:06.749499] [DEBUG] [LOCAL ] HLLY: Derivative data saved (1794 records). [2025-09-29T22:10:06.749748] [INFO ] [MAIN ] HLLY: Successfully saved derivative data. [2025-09-29T22:10:06.752204] [INFO ] [MAIN ] Derivative Progress: 852/2057 symbols completed. HLLY took 1.1s. Estimated remaining: 8m 10s. Rate: 147.6 symbols/min [2025-09-29T22:10:06.752396] [INFO ] [MAIN ] HLX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:06.774879] [DEBUG] [LOCAL ] HLN: Loaded 53085 existing records from primary storage. [2025-09-29T22:10:06.775158] [INFO ] [MAIN ] HLN: Loaded 53085 primary data records. [2025-09-29T22:10:07.047607] [DEBUG] [LOCAL ] HLT: Loaded 50632 existing records from primary storage. [2025-09-29T22:10:07.148316] [DEBUG] [LOCAL ] HLX: Loaded 47869 existing records from primary storage. [2025-09-29T22:10:07.147558] [INFO ] [MAIN ] HLT: Loaded 50632 primary data records. [2025-09-29T22:10:07.157839] [INFO ] [MAIN ] HLX: Loaded 47869 primary data records. [2025-09-29T22:10:07.893783] [DEBUG] [MAIN ] HLN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:07.896290] [INFO ] [MAIN ] HLN: Generated 1794 derivative records from 53085 primary records. [2025-09-29T22:10:07.897057] [DEBUG] [LOCAL ] HLN: Saving derivative data. [2025-09-29T22:10:07.915956] [DEBUG] [LOCAL ] HLN: Derivative data saved (1794 records). [2025-09-29T22:10:07.916247] [INFO ] [MAIN ] HLN: Successfully saved derivative data. [2025-09-29T22:10:07.918897] [INFO ] [MAIN ] Derivative Progress: 853/2057 symbols completed. HLN took 1.3s. Estimated remaining: 8m 11s. Rate: 147.2 symbols/min [2025-09-29T22:10:07.960236] [DEBUG] [MAIN ] HLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:07.961680] [INFO ] [MAIN ] HLT: Generated 1794 derivative records from 50632 primary records. [2025-09-29T22:10:07.961781] [DEBUG] [LOCAL ] HLT: Saving derivative data. [2025-09-29T22:10:07.960726] [DEBUG] [MAIN ] HLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:07.963496] [INFO ] [MAIN ] HLX: Generated 1794 derivative records from 47869 primary records. [2025-09-29T22:10:07.963627] [DEBUG] [LOCAL ] HLX: Saving derivative data. [2025-09-29T22:10:08.002563] [DEBUG] [LOCAL ] HLT: Derivative data saved (1794 records). [2025-09-29T22:10:08.003456] [INFO ] [MAIN ] HLT: Successfully saved derivative data. [2025-09-29T22:10:08.005715] [INFO ] [MAIN ] Derivative Progress: 854/2057 symbols completed. HLT took 1.3s. Estimated remaining: 8m 10s. Rate: 147.4 symbols/min [2025-09-29T22:10:08.005847] [DEBUG] [LOCAL ] HLX: Derivative data saved (1794 records). [2025-09-29T22:10:08.006193] [INFO ] [MAIN ] HLX: Successfully saved derivative data. [2025-09-29T22:10:08.008964] [INFO ] [MAIN ] Derivative Progress: 855/2057 symbols completed. HLX took 1.3s. Estimated remaining: 8m 9s. Rate: 147.5 symbols/min [2025-09-29T22:10:08.009403] [INFO ] [MAIN ] HMC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:08.009535] [INFO ] [MAIN ] HMN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:08.009694] [INFO ] [MAIN ] HMY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:08.036943] [DEBUG] [LOCAL ] HMN: Loaded 23360 existing records from primary storage. [2025-09-29T22:10:08.037272] [INFO ] [MAIN ] HMN: Loaded 23360 primary data records. [2025-09-29T22:10:08.235019] [DEBUG] [LOCAL ] HMC: Loaded 46704 existing records from primary storage. [2025-09-29T22:10:08.281157] [INFO ] [MAIN ] HMC: Loaded 46704 primary data records. [2025-09-29T22:10:08.528125] [DEBUG] [LOCAL ] HMY: Loaded 53136 existing records from primary storage. [2025-09-29T22:10:08.557353] [INFO ] [MAIN ] HMY: Loaded 53136 primary data records. [2025-09-29T22:10:09.122458] [DEBUG] [MAIN ] HMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:09.124089] [INFO ] [MAIN ] HMN: Generated 1794 derivative records from 23360 primary records. [2025-09-29T22:10:09.124319] [DEBUG] [LOCAL ] HMN: Saving derivative data. [2025-09-29T22:10:09.147576] [DEBUG] [LOCAL ] HMN: Derivative data saved (1794 records). [2025-09-29T22:10:09.147747] [INFO ] [MAIN ] HMN: Successfully saved derivative data. [2025-09-29T22:10:09.150194] [INFO ] [MAIN ] Derivative Progress: 856/2057 symbols completed. HMN took 1.1s. Estimated remaining: 8m 9s. Rate: 147.2 symbols/min [2025-09-29T22:10:09.150515] [INFO ] [MAIN ] HNI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:09.169371] [DEBUG] [MAIN ] HMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:09.170364] [INFO ] [MAIN ] HMC: Generated 1794 derivative records from 46704 primary records. [2025-09-29T22:10:09.170616] [DEBUG] [LOCAL ] HMC: Saving derivative data. [2025-09-29T22:10:09.210897] [DEBUG] [MAIN ] HMY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:09.212575] [INFO ] [MAIN ] HMY: Generated 1794 derivative records from 53136 primary records. [2025-09-29T22:10:09.213027] [DEBUG] [LOCAL ] HMY: Saving derivative data. [2025-09-29T22:10:09.215320] [DEBUG] [LOCAL ] HMC: Derivative data saved (1794 records). [2025-09-29T22:10:09.215710] [INFO ] [MAIN ] HMC: Successfully saved derivative data. [2025-09-29T22:10:09.225663] [INFO ] [MAIN ] Derivative Progress: 857/2057 symbols completed. HMC took 1.2s. Estimated remaining: 8m 9s. Rate: 147.4 symbols/min [2025-09-29T22:10:09.238219] [INFO ] [MAIN ] HOG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:09.242459] [DEBUG] [LOCAL ] HNI: Loaded 29037 existing records from primary storage. [2025-09-29T22:10:09.243396] [INFO ] [MAIN ] HNI: Loaded 29037 primary data records. [2025-09-29T22:10:09.333632] [DEBUG] [LOCAL ] HMY: Derivative data saved (1794 records). [2025-09-29T22:10:09.355802] [INFO ] [MAIN ] HMY: Successfully saved derivative data. [2025-09-29T22:10:09.363214] [INFO ] [MAIN ] Derivative Progress: 858/2057 symbols completed. HMY took 1.4s. Estimated remaining: 8m 8s. Rate: 147.5 symbols/min [2025-09-29T22:10:09.364060] [INFO ] [MAIN ] HOMB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:09.667081] [DEBUG] [LOCAL ] HOG: Loaded 51157 existing records from primary storage. [2025-09-29T22:10:09.668071] [INFO ] [MAIN ] HOG: Loaded 51157 primary data records. [2025-09-29T22:10:09.732403] [DEBUG] [LOCAL ] HOMB: Loaded 43516 existing records from primary storage. [2025-09-29T22:10:09.758902] [INFO ] [MAIN ] HOMB: Loaded 43516 primary data records. [2025-09-29T22:10:10.373667] [DEBUG] [MAIN ] HNI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:10.389264] [INFO ] [MAIN ] HNI: Generated 1794 derivative records from 29037 primary records. [2025-09-29T22:10:10.390500] [DEBUG] [LOCAL ] HNI: Saving derivative data. [2025-09-29T22:10:10.411950] [DEBUG] [LOCAL ] HNI: Derivative data saved (1794 records). [2025-09-29T22:10:10.412577] [INFO ] [MAIN ] HNI: Successfully saved derivative data. [2025-09-29T22:10:10.415142] [INFO ] [MAIN ] Derivative Progress: 859/2057 symbols completed. HNI took 1.3s. Estimated remaining: 8m 8s. Rate: 147.2 symbols/min [2025-09-29T22:10:10.416867] [INFO ] [MAIN ] HOUS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:10.443927] [DEBUG] [MAIN ] HOG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:10.447578] [INFO ] [MAIN ] HOG: Generated 1794 derivative records from 51157 primary records. [2025-09-29T22:10:10.448118] [DEBUG] [LOCAL ] HOG: Saving derivative data. [2025-09-29T22:10:10.474839] [DEBUG] [MAIN ] HOMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:10.487828] [INFO ] [MAIN ] HOMB: Generated 1794 derivative records from 43516 primary records. [2025-09-29T22:10:10.488822] [DEBUG] [LOCAL ] HOMB: Saving derivative data. [2025-09-29T22:10:10.506772] [DEBUG] [LOCAL ] HOG: Derivative data saved (1794 records). [2025-09-29T22:10:10.507831] [INFO ] [MAIN ] HOG: Successfully saved derivative data. [2025-09-29T22:10:10.523362] [DEBUG] [LOCAL ] HOMB: Derivative data saved (1794 records). [2025-09-29T22:10:10.526676] [INFO ] [MAIN ] Derivative Progress: 860/2057 symbols completed. HOG took 1.3s. Estimated remaining: 8m 7s. Rate: 147.3 symbols/min [2025-09-29T22:10:10.528172] [DEBUG] [LOCAL ] HOUS: Loaded 44315 existing records from primary storage. [2025-09-29T22:10:10.527298] [INFO ] [MAIN ] HOV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:10.528550] [INFO ] [MAIN ] HOUS: Loaded 44315 primary data records. [2025-09-29T22:10:10.527179] [INFO ] [MAIN ] HOMB: Successfully saved derivative data. [2025-09-29T22:10:10.531422] [INFO ] [MAIN ] Derivative Progress: 861/2057 symbols completed. HOMB took 1.2s. Estimated remaining: 8m 6s. Rate: 147.5 symbols/min [2025-09-29T22:10:10.549971] [INFO ] [MAIN ] HP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:10.654168] [DEBUG] [LOCAL ] HOV: Loaded 13801 existing records from primary storage. [2025-09-29T22:10:10.659614] [INFO ] [MAIN ] HOV: Loaded 13801 primary data records. [2025-09-29T22:10:11.220473] [DEBUG] [LOCAL ] HP: Loaded 51572 existing records from primary storage. [2025-09-29T22:10:11.220859] [INFO ] [MAIN ] HP: Loaded 51572 primary data records. [2025-09-29T22:10:11.590191] [DEBUG] [MAIN ] HOUS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:11.592695] [INFO ] [MAIN ] HOUS: Generated 1794 derivative records from 44315 primary records. [2025-09-29T22:10:11.593236] [DEBUG] [LOCAL ] HOUS: Saving derivative data. [2025-09-29T22:10:11.644890] [DEBUG] [LOCAL ] HOUS: Derivative data saved (1794 records). [2025-09-29T22:10:11.645756] [INFO ] [MAIN ] HOUS: Successfully saved derivative data. [2025-09-29T22:10:11.645177] [DEBUG] [MAIN ] HOV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:11.649747] [INFO ] [MAIN ] HOV: Generated 1794 derivative records from 13801 primary records. [2025-09-29T22:10:11.648763] [INFO ] [MAIN ] Derivative Progress: 862/2057 symbols completed. HOUS took 1.2s. Estimated remaining: 8m 7s. Rate: 147.2 symbols/min [2025-09-29T22:10:11.650277] [INFO ] [MAIN ] HPE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:11.650011] [DEBUG] [LOCAL ] HOV: Saving derivative data. [2025-09-29T22:10:11.672378] [DEBUG] [LOCAL ] HOV: Derivative data saved (1794 records). [2025-09-29T22:10:11.672613] [INFO ] [MAIN ] HOV: Successfully saved derivative data. [2025-09-29T22:10:11.687103] [INFO ] [MAIN ] Derivative Progress: 863/2057 symbols completed. HOV took 1.2s. Estimated remaining: 8m 6s. Rate: 147.4 symbols/min [2025-09-29T22:10:11.688684] [DEBUG] [MAIN ] HP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:11.689576] [INFO ] [MAIN ] HP: Generated 1794 derivative records from 51572 primary records. [2025-09-29T22:10:11.688285] [INFO ] [MAIN ] HPF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:11.689910] [DEBUG] [LOCAL ] HP: Saving derivative data. [2025-09-29T22:10:11.711018] [DEBUG] [LOCAL ] HP: Derivative data saved (1794 records). [2025-09-29T22:10:11.711325] [INFO ] [MAIN ] HP: Successfully saved derivative data. [2025-09-29T22:10:11.713636] [INFO ] [MAIN ] Derivative Progress: 864/2057 symbols completed. HP took 1.2s. Estimated remaining: 8m 5s. Rate: 147.5 symbols/min [2025-09-29T22:10:11.713957] [INFO ] [MAIN ] HPI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:11.719289] [DEBUG] [LOCAL ] HPF: Loaded 7335 existing records from primary storage. [2025-09-29T22:10:11.719502] [INFO ] [MAIN ] HPF: Loaded 7335 primary data records. [2025-09-29T22:10:11.853154] [DEBUG] [LOCAL ] HPI: Loaded 10210 existing records from primary storage. [2025-09-29T22:10:11.853413] [INFO ] [MAIN ] HPI: Loaded 10210 primary data records. [2025-09-29T22:10:11.892522] [DEBUG] [LOCAL ] HPE: Loaded 53697 existing records from primary storage. [2025-09-29T22:10:11.897892] [INFO ] [MAIN ] HPE: Loaded 53697 primary data records. [2025-09-29T22:10:12.796748] [DEBUG] [MAIN ] HPF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:12.797980] [INFO ] [MAIN ] HPF: Generated 1794 derivative records from 7335 primary records. [2025-09-29T22:10:12.798230] [DEBUG] [LOCAL ] HPF: Saving derivative data. [2025-09-29T22:10:12.815884] [DEBUG] [LOCAL ] HPF: Derivative data saved (1794 records). [2025-09-29T22:10:12.817087] [INFO ] [MAIN ] HPF: Successfully saved derivative data. [2025-09-29T22:10:12.820037] [INFO ] [MAIN ] Derivative Progress: 865/2057 symbols completed. HPF took 1.1s. Estimated remaining: 8m 6s. Rate: 147.2 symbols/min [2025-09-29T22:10:12.821964] [INFO ] [MAIN ] HPP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:12.837246] [DEBUG] [MAIN ] HPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:12.838111] [INFO ] [MAIN ] HPI: Generated 1794 derivative records from 10210 primary records. [2025-09-29T22:10:12.838429] [DEBUG] [LOCAL ] HPI: Saving derivative data. [2025-09-29T22:10:12.864826] [DEBUG] [MAIN ] HPE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:12.866895] [INFO ] [MAIN ] HPE: Generated 1794 derivative records from 53697 primary records. [2025-09-29T22:10:12.867759] [DEBUG] [LOCAL ] HPE: Saving derivative data. [2025-09-29T22:10:12.871810] [DEBUG] [LOCAL ] HPI: Derivative data saved (1794 records). [2025-09-29T22:10:12.882808] [INFO ] [MAIN ] HPI: Successfully saved derivative data. [2025-09-29T22:10:12.885589] [INFO ] [MAIN ] Derivative Progress: 866/2057 symbols completed. HPI took 1.2s. Estimated remaining: 8m 5s. Rate: 147.4 symbols/min [2025-09-29T22:10:12.886449] [INFO ] [MAIN ] HPQ: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:12.891041] [DEBUG] [LOCAL ] HPE: Derivative data saved (1794 records). [2025-09-29T22:10:12.891205] [INFO ] [MAIN ] HPE: Successfully saved derivative data. [2025-09-29T22:10:12.893313] [INFO ] [MAIN ] Derivative Progress: 867/2057 symbols completed. HPE took 1.2s. Estimated remaining: 8m 4s. Rate: 147.5 symbols/min [2025-09-29T22:10:12.893607] [INFO ] [MAIN ] HPS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:12.926877] [DEBUG] [LOCAL ] HPS: Loaded 10187 existing records from primary storage. [2025-09-29T22:10:12.927191] [INFO ] [MAIN ] HPS: Loaded 10187 primary data records. [2025-09-29T22:10:13.105890] [DEBUG] [LOCAL ] HPP: Loaded 50872 existing records from primary storage. [2025-09-29T22:10:13.137714] [INFO ] [MAIN ] HPP: Loaded 50872 primary data records. [2025-09-29T22:10:13.167224] [DEBUG] [LOCAL ] HPQ: Loaded 53668 existing records from primary storage. [2025-09-29T22:10:13.280403] [INFO ] [MAIN ] HPQ: Loaded 53668 primary data records. [2025-09-29T22:10:14.029598] [DEBUG] [MAIN ] HPS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:14.031633] [INFO ] [MAIN ] HPS: Generated 1794 derivative records from 10187 primary records. [2025-09-29T22:10:14.033355] [DEBUG] [LOCAL ] HPS: Saving derivative data. [2025-09-29T22:10:14.056701] [DEBUG] [LOCAL ] HPS: Derivative data saved (1794 records). [2025-09-29T22:10:14.057638] [INFO ] [MAIN ] HPS: Successfully saved derivative data. [2025-09-29T22:10:14.060584] [INFO ] [MAIN ] Derivative Progress: 868/2057 symbols completed. HPS took 1.2s. Estimated remaining: 8m 5s. Rate: 147.2 symbols/min [2025-09-29T22:10:14.087211] [DEBUG] [MAIN ] HPP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:14.087033] [DEBUG] [MAIN ] HPQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:14.088038] [INFO ] [MAIN ] HPQ: Generated 1794 derivative records from 53668 primary records. [2025-09-29T22:10:14.088118] [DEBUG] [LOCAL ] HPQ: Saving derivative data. [2025-09-29T22:10:14.088774] [INFO ] [MAIN ] HPP: Generated 1794 derivative records from 50872 primary records. [2025-09-29T22:10:14.088896] [DEBUG] [LOCAL ] HPP: Saving derivative data. [2025-09-29T22:10:14.118543] [DEBUG] [LOCAL ] HPP: Derivative data saved (1794 records). [2025-09-29T22:10:14.119254] [INFO ] [MAIN ] HPP: Successfully saved derivative data. [2025-09-29T22:10:14.121702] [INFO ] [MAIN ] Derivative Progress: 869/2057 symbols completed. HPP took 1.3s. Estimated remaining: 8m 4s. Rate: 147.4 symbols/min [2025-09-29T22:10:14.125876] [DEBUG] [LOCAL ] HPQ: Derivative data saved (1794 records). [2025-09-29T22:10:14.125946] [INFO ] [MAIN ] HPQ: Successfully saved derivative data. [2025-09-29T22:10:14.128126] [INFO ] [MAIN ] Derivative Progress: 870/2057 symbols completed. HPQ took 1.2s. Estimated remaining: 8m 3s. Rate: 147.5 symbols/min [2025-09-29T22:10:14.128512] [INFO ] [MAIN ] HQH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:14.128699] [INFO ] [MAIN ] HR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:14.128633] [INFO ] [MAIN ] HQL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:14.160999] [DEBUG] [LOCAL ] HQL: Loaded 15953 existing records from primary storage. [2025-09-29T22:10:14.161257] [INFO ] [MAIN ] HQL: Loaded 15953 primary data records. [2025-09-29T22:10:14.292059] [DEBUG] [LOCAL ] HQH: Loaded 25061 existing records from primary storage. [2025-09-29T22:10:14.297541] [INFO ] [MAIN ] HQH: Loaded 25061 primary data records. [2025-09-29T22:10:14.609806] [DEBUG] [LOCAL ] HR: Loaded 51953 existing records from primary storage. [2025-09-29T22:10:14.646122] [INFO ] [MAIN ] HR: Loaded 51953 primary data records. [2025-09-29T22:10:15.247853] [DEBUG] [MAIN ] HQL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:15.249638] [INFO ] [MAIN ] HQL: Generated 1794 derivative records from 15953 primary records. [2025-09-29T22:10:15.249937] [DEBUG] [LOCAL ] HQL: Saving derivative data. [2025-09-29T22:10:15.270865] [DEBUG] [LOCAL ] HQL: Derivative data saved (1794 records). [2025-09-29T22:10:15.272432] [INFO ] [MAIN ] HQL: Successfully saved derivative data. [2025-09-29T22:10:15.274733] [INFO ] [MAIN ] Derivative Progress: 871/2057 symbols completed. HQL took 1.1s. Estimated remaining: 8m 3s. Rate: 147.2 symbols/min [2025-09-29T22:10:15.274902] [INFO ] [MAIN ] HRB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:15.290901] [DEBUG] [MAIN ] HQH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:15.291887] [INFO ] [MAIN ] HQH: Generated 1794 derivative records from 25061 primary records. [2025-09-29T22:10:15.292145] [DEBUG] [LOCAL ] HQH: Saving derivative data. [2025-09-29T22:10:15.325707] [DEBUG] [MAIN ] HR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:15.327723] [INFO ] [MAIN ] HR: Generated 1794 derivative records from 51953 primary records. [2025-09-29T22:10:15.326686] [DEBUG] [LOCAL ] HQH: Derivative data saved (1794 records). [2025-09-29T22:10:15.327907] [DEBUG] [LOCAL ] HR: Saving derivative data. [2025-09-29T22:10:15.328003] [INFO ] [MAIN ] HQH: Successfully saved derivative data. [2025-09-29T22:10:15.330833] [INFO ] [MAIN ] Derivative Progress: 872/2057 symbols completed. HQH took 1.2s. Estimated remaining: 8m 2s. Rate: 147.4 symbols/min [2025-09-29T22:10:15.338844] [INFO ] [MAIN ] HRI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:15.360855] [DEBUG] [LOCAL ] HR: Derivative data saved (1794 records). [2025-09-29T22:10:15.360990] [INFO ] [MAIN ] HR: Successfully saved derivative data. [2025-09-29T22:10:15.363044] [INFO ] [MAIN ] Derivative Progress: 873/2057 symbols completed. HR took 1.2s. Estimated remaining: 8m 2s. Rate: 147.5 symbols/min [2025-09-29T22:10:15.363392] [INFO ] [MAIN ] HRL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:15.380301] [DEBUG] [LOCAL ] HRB: Loaded 48501 existing records from primary storage. [2025-09-29T22:10:15.380615] [INFO ] [MAIN ] HRB: Loaded 48501 primary data records. [2025-09-29T22:10:15.513319] [DEBUG] [LOCAL ] HRI: Loaded 32840 existing records from primary storage. [2025-09-29T22:10:15.513885] [INFO ] [MAIN ] HRI: Loaded 32840 primary data records. [2025-09-29T22:10:15.967835] [DEBUG] [LOCAL ] HRL: Loaded 53074 existing records from primary storage. [2025-09-29T22:10:16.126360] [INFO ] [MAIN ] HRL: Loaded 53074 primary data records. [2025-09-29T22:10:16.489774] [DEBUG] [MAIN ] HRB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:16.491593] [INFO ] [MAIN ] HRB: Generated 1794 derivative records from 48501 primary records. [2025-09-29T22:10:16.492242] [DEBUG] [LOCAL ] HRB: Saving derivative data. [2025-09-29T22:10:16.526135] [DEBUG] [MAIN ] HRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:16.528175] [INFO ] [MAIN ] HRI: Generated 1794 derivative records from 32840 primary records. [2025-09-29T22:10:16.528830] [DEBUG] [LOCAL ] HRI: Saving derivative data. [2025-09-29T22:10:16.528589] [DEBUG] [LOCAL ] HRB: Derivative data saved (1794 records). [2025-09-29T22:10:16.529080] [INFO ] [MAIN ] HRB: Successfully saved derivative data. [2025-09-29T22:10:16.532842] [INFO ] [MAIN ] Derivative Progress: 874/2057 symbols completed. HRB took 1.3s. Estimated remaining: 8m 2s. Rate: 147.2 symbols/min [2025-09-29T22:10:16.533785] [INFO ] [MAIN ] HRTG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:16.566778] [DEBUG] [MAIN ] HRL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:16.567689] [DEBUG] [LOCAL ] HRI: Derivative data saved (1794 records). [2025-09-29T22:10:16.568674] [INFO ] [MAIN ] HRL: Generated 1794 derivative records from 53074 primary records. [2025-09-29T22:10:16.567808] [INFO ] [MAIN ] HRI: Successfully saved derivative data. [2025-09-29T22:10:16.568762] [DEBUG] [LOCAL ] HRL: Saving derivative data. [2025-09-29T22:10:16.570913] [INFO ] [MAIN ] Derivative Progress: 875/2057 symbols completed. HRI took 1.2s. Estimated remaining: 8m 1s. Rate: 147.4 symbols/min [2025-09-29T22:10:16.571828] [INFO ] [MAIN ] HSBC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:16.602805] [DEBUG] [LOCAL ] HRL: Derivative data saved (1794 records). [2025-09-29T22:10:16.602965] [INFO ] [MAIN ] HRL: Successfully saved derivative data. [2025-09-29T22:10:16.605235] [INFO ] [MAIN ] Derivative Progress: 876/2057 symbols completed. HRL took 1.2s. Estimated remaining: 8m 0s. Rate: 147.5 symbols/min [2025-09-29T22:10:16.605605] [INFO ] [MAIN ] HSHP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:16.625060] [DEBUG] [LOCAL ] HRTG: Loaded 33324 existing records from primary storage. [2025-09-29T22:10:16.625416] [INFO ] [MAIN ] HRTG: Loaded 33324 primary data records. [2025-09-29T22:10:16.741462] [DEBUG] [LOCAL ] HSHP: Loaded 15287 existing records from primary storage. [2025-09-29T22:10:16.769326] [INFO ] [MAIN ] HSHP: Loaded 15287 primary data records. [2025-09-29T22:10:17.125173] [DEBUG] [LOCAL ] HSBC: Loaded 51077 existing records from primary storage. [2025-09-29T22:10:17.142511] [INFO ] [MAIN ] HSBC: Loaded 51077 primary data records. [2025-09-29T22:10:17.689311] [DEBUG] [MAIN ] HRTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:17.692172] [INFO ] [MAIN ] HRTG: Generated 1794 derivative records from 33324 primary records. [2025-09-29T22:10:17.692994] [DEBUG] [LOCAL ] HRTG: Saving derivative data. [2025-09-29T22:10:17.722222] [DEBUG] [MAIN ] HSHP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:17.725073] [DEBUG] [LOCAL ] HRTG: Derivative data saved (1794 records). [2025-09-29T22:10:17.725531] [INFO ] [MAIN ] HRTG: Successfully saved derivative data. [2025-09-29T22:10:17.728044] [INFO ] [MAIN ] Derivative Progress: 877/2057 symbols completed. HRTG took 1.2s. Estimated remaining: 8m 1s. Rate: 147.2 symbols/min [2025-09-29T22:10:17.728380] [INFO ] [MAIN ] HSY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:17.729776] [INFO ] [MAIN ] HSHP: Generated 1794 derivative records from 15287 primary records. [2025-09-29T22:10:17.730150] [DEBUG] [LOCAL ] HSHP: Saving derivative data. [2025-09-29T22:10:17.751996] [DEBUG] [LOCAL ] HSHP: Derivative data saved (1794 records). [2025-09-29T22:10:17.752553] [INFO ] [MAIN ] HSHP: Successfully saved derivative data. [2025-09-29T22:10:17.754826] [INFO ] [MAIN ] Derivative Progress: 878/2057 symbols completed. HSHP took 1.1s. Estimated remaining: 7m 60s. Rate: 147.4 symbols/min [2025-09-29T22:10:17.763242] [INFO ] [MAIN ] HTD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:17.769671] [DEBUG] [MAIN ] HSBC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:17.770582] [INFO ] [MAIN ] HSBC: Generated 1794 derivative records from 51077 primary records. [2025-09-29T22:10:17.770799] [DEBUG] [LOCAL ] HSBC: Saving derivative data. [2025-09-29T22:10:17.794573] [DEBUG] [LOCAL ] HSBC: Derivative data saved (1794 records). [2025-09-29T22:10:17.794802] [INFO ] [MAIN ] HSBC: Successfully saved derivative data. [2025-09-29T22:10:17.797017] [INFO ] [MAIN ] Derivative Progress: 879/2057 symbols completed. HSBC took 1.2s. Estimated remaining: 7m 59s. Rate: 147.5 symbols/min [2025-09-29T22:10:17.813958] [DEBUG] [LOCAL ] HTD: Loaded 13657 existing records from primary storage. [2025-09-29T22:10:17.814097] [INFO ] [MAIN ] HTGC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:17.814284] [INFO ] [MAIN ] HTD: Loaded 13657 primary data records. [2025-09-29T22:10:17.934427] [DEBUG] [LOCAL ] HSY: Loaded 50371 existing records from primary storage. [2025-09-29T22:10:17.947179] [INFO ] [MAIN ] HSY: Loaded 50371 primary data records. [2025-09-29T22:10:18.537682] [DEBUG] [LOCAL ] HTGC: Loaded 47424 existing records from primary storage. [2025-09-29T22:10:18.538395] [INFO ] [MAIN ] HTGC: Loaded 47424 primary data records. [2025-09-29T22:10:18.876955] [DEBUG] [MAIN ] HTD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:18.878350] [INFO ] [MAIN ] HTD: Generated 1794 derivative records from 13657 primary records. [2025-09-29T22:10:18.878540] [DEBUG] [LOCAL ] HTD: Saving derivative data. [2025-09-29T22:10:18.914392] [DEBUG] [LOCAL ] HTD: Derivative data saved (1794 records). [2025-09-29T22:10:18.915025] [INFO ] [MAIN ] HTD: Successfully saved derivative data. [2025-09-29T22:10:18.914896] [DEBUG] [MAIN ] HSY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:18.917307] [INFO ] [MAIN ] Derivative Progress: 880/2057 symbols completed. HTD took 1.2s. Estimated remaining: 7m 60s. Rate: 147.2 symbols/min [2025-09-29T22:10:18.917478] [INFO ] [MAIN ] HTH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:18.918387] [INFO ] [MAIN ] HSY: Generated 1794 derivative records from 50371 primary records. [2025-09-29T22:10:18.918887] [DEBUG] [LOCAL ] HSY: Saving derivative data. [2025-09-29T22:10:18.954852] [DEBUG] [MAIN ] HTGC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:18.954421] [DEBUG] [LOCAL ] HSY: Derivative data saved (1794 records). [2025-09-29T22:10:18.955144] [INFO ] [MAIN ] HSY: Successfully saved derivative data. [2025-09-29T22:10:18.955945] [INFO ] [MAIN ] HTGC: Generated 1794 derivative records from 47424 primary records. [2025-09-29T22:10:18.958268] [INFO ] [MAIN ] Derivative Progress: 881/2057 symbols completed. HSY took 1.2s. Estimated remaining: 7m 59s. Rate: 147.4 symbols/min [2025-09-29T22:10:18.956066] [DEBUG] [LOCAL ] HTGC: Saving derivative data. [2025-09-29T22:10:18.966776] [INFO ] [MAIN ] HUBB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:18.993140] [DEBUG] [LOCAL ] HTH: Loaded 32136 existing records from primary storage. [2025-09-29T22:10:18.993779] [INFO ] [MAIN ] HTH: Loaded 32136 primary data records. [2025-09-29T22:10:19.040058] [DEBUG] [LOCAL ] HTGC: Derivative data saved (1794 records). [2025-09-29T22:10:19.068899] [INFO ] [MAIN ] HTGC: Successfully saved derivative data. [2025-09-29T22:10:19.101211] [INFO ] [MAIN ] Derivative Progress: 882/2057 symbols completed. HTGC took 1.3s. Estimated remaining: 7m 58s. Rate: 147.5 symbols/min [2025-09-29T22:10:19.114410] [INFO ] [MAIN ] HUBS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:19.347189] [DEBUG] [LOCAL ] HUBB: Loaded 36843 existing records from primary storage. [2025-09-29T22:10:19.347438] [INFO ] [MAIN ] HUBB: Loaded 36843 primary data records. [2025-09-29T22:10:19.498891] [DEBUG] [LOCAL ] HUBS: Loaded 39200 existing records from primary storage. [2025-09-29T22:10:19.535051] [INFO ] [MAIN ] HUBS: Loaded 39200 primary data records. [2025-09-29T22:10:20.050240] [DEBUG] [MAIN ] HTH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:20.052019] [INFO ] [MAIN ] HTH: Generated 1794 derivative records from 32136 primary records. [2025-09-29T22:10:20.052254] [DEBUG] [LOCAL ] HTH: Saving derivative data. [2025-09-29T22:10:20.085503] [DEBUG] [LOCAL ] HTH: Derivative data saved (1794 records). [2025-09-29T22:10:20.090593] [INFO ] [MAIN ] HTH: Successfully saved derivative data. [2025-09-29T22:10:20.091412] [DEBUG] [MAIN ] HUBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:20.092340] [INFO ] [MAIN ] HUBB: Generated 1794 derivative records from 36843 primary records. [2025-09-29T22:10:20.094497] [INFO ] [MAIN ] Derivative Progress: 883/2057 symbols completed. HTH took 1.2s. Estimated remaining: 7m 58s. Rate: 147.3 symbols/min [2025-09-29T22:10:20.094948] [DEBUG] [LOCAL ] HUBB: Saving derivative data. [2025-09-29T22:10:20.115577] [DEBUG] [LOCAL ] HUBB: Derivative data saved (1794 records). [2025-09-29T22:10:20.115846] [INFO ] [MAIN ] HUBB: Successfully saved derivative data. [2025-09-29T22:10:20.118409] [INFO ] [MAIN ] Derivative Progress: 884/2057 symbols completed. HUBB took 1.2s. Estimated remaining: 7m 57s. Rate: 147.4 symbols/min [2025-09-29T22:10:20.131533] [DEBUG] [MAIN ] HUBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:20.132303] [INFO ] [MAIN ] HUBS: Generated 1794 derivative records from 39200 primary records. [2025-09-29T22:10:20.132377] [DEBUG] [LOCAL ] HUBS: Saving derivative data. [2025-09-29T22:10:20.148121] [DEBUG] [LOCAL ] HUBS: Derivative data saved (1794 records). [2025-09-29T22:10:20.148240] [INFO ] [MAIN ] HUBS: Successfully saved derivative data. [2025-09-29T22:10:20.150331] [INFO ] [MAIN ] Derivative Progress: 885/2057 symbols completed. HUBS took 1.0s. Estimated remaining: 7m 57s. Rate: 147.6 symbols/min [2025-09-29T22:10:20.150993] [INFO ] [MAIN ] HUM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:20.151191] [INFO ] [MAIN ] HUYA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:20.150889] [INFO ] [MAIN ] HUN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:20.231484] [DEBUG] [LOCAL ] HUM: Loaded 48801 existing records from primary storage. [2025-09-29T22:10:20.231833] [INFO ] [MAIN ] HUM: Loaded 48801 primary data records. [2025-09-29T22:10:20.337567] [DEBUG] [LOCAL ] HUYA: Loaded 44246 existing records from primary storage. [2025-09-29T22:10:20.348252] [INFO ] [MAIN ] HUYA: Loaded 44246 primary data records. [2025-09-29T22:10:20.367467] [DEBUG] [LOCAL ] HUN: Loaded 53195 existing records from primary storage. [2025-09-29T22:10:20.378313] [INFO ] [MAIN ] HUN: Loaded 53195 primary data records. [2025-09-29T22:10:21.372021] [DEBUG] [MAIN ] HUM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:21.386752] [INFO ] [MAIN ] HUM: Generated 1794 derivative records from 48801 primary records. [2025-09-29T22:10:21.400475] [DEBUG] [LOCAL ] HUM: Saving derivative data. [2025-09-29T22:10:21.400798] [DEBUG] [MAIN ] HUN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:21.403594] [INFO ] [MAIN ] HUN: Generated 1794 derivative records from 53195 primary records. [2025-09-29T22:10:21.403997] [DEBUG] [LOCAL ] HUN: Saving derivative data. [2025-09-29T22:10:21.402402] [DEBUG] [MAIN ] HUYA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:21.414291] [INFO ] [MAIN ] HUYA: Generated 1794 derivative records from 44246 primary records. [2025-09-29T22:10:21.419365] [DEBUG] [LOCAL ] HUYA: Saving derivative data. [2025-09-29T22:10:21.422167] [DEBUG] [LOCAL ] HUM: Derivative data saved (1794 records). [2025-09-29T22:10:21.423452] [INFO ] [MAIN ] HUM: Successfully saved derivative data. [2025-09-29T22:10:21.425548] [INFO ] [MAIN ] Derivative Progress: 886/2057 symbols completed. HUM took 1.3s. Estimated remaining: 7m 57s. Rate: 147.2 symbols/min [2025-09-29T22:10:21.426018] [INFO ] [MAIN ] HVT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:21.456886] [DEBUG] [LOCAL ] HUN: Derivative data saved (1794 records). [2025-09-29T22:10:21.457372] [INFO ] [MAIN ] HUN: Successfully saved derivative data. [2025-09-29T22:10:21.460249] [INFO ] [MAIN ] Derivative Progress: 887/2057 symbols completed. HUN took 1.3s. Estimated remaining: 7m 56s. Rate: 147.4 symbols/min [2025-09-29T22:10:21.462155] [INFO ] [MAIN ] HWM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:21.461928] [DEBUG] [LOCAL ] HUYA: Derivative data saved (1794 records). [2025-09-29T22:10:21.462764] [INFO ] [MAIN ] HUYA: Successfully saved derivative data. [2025-09-29T22:10:21.464808] [INFO ] [MAIN ] Derivative Progress: 888/2057 symbols completed. HUYA took 1.3s. Estimated remaining: 7m 55s. Rate: 147.5 symbols/min [2025-09-29T22:10:21.466850] [INFO ] [MAIN ] HXL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:21.479887] [DEBUG] [LOCAL ] HVT: Loaded 15684 existing records from primary storage. [2025-09-29T22:10:21.480029] [INFO ] [MAIN ] HVT: Loaded 15684 primary data records. [2025-09-29T22:10:21.860845] [DEBUG] [LOCAL ] HWM: Loaded 52984 existing records from primary storage. [2025-09-29T22:10:21.862732] [INFO ] [MAIN ] HWM: Loaded 52984 primary data records. [2025-09-29T22:10:21.863609] [DEBUG] [LOCAL ] HXL: Loaded 45991 existing records from primary storage. [2025-09-29T22:10:21.896858] [INFO ] [MAIN ] HXL: Loaded 45991 primary data records. [2025-09-29T22:10:22.593802] [DEBUG] [MAIN ] HVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:22.595043] [INFO ] [MAIN ] HVT: Generated 1794 derivative records from 15684 primary records. [2025-09-29T22:10:22.595216] [DEBUG] [LOCAL ] HVT: Saving derivative data. [2025-09-29T22:10:22.615399] [DEBUG] [LOCAL ] HVT: Derivative data saved (1794 records). [2025-09-29T22:10:22.616084] [INFO ] [MAIN ] HVT: Successfully saved derivative data. [2025-09-29T22:10:22.618363] [INFO ] [MAIN ] Derivative Progress: 889/2057 symbols completed. HVT took 1.2s. Estimated remaining: 7m 56s. Rate: 147.2 symbols/min [2025-09-29T22:10:22.618860] [INFO ] [MAIN ] HY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:22.641898] [DEBUG] [MAIN ] HWM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:22.643040] [INFO ] [MAIN ] HWM: Generated 1794 derivative records from 52984 primary records. [2025-09-29T22:10:22.645522] [DEBUG] [LOCAL ] HWM: Saving derivative data. [2025-09-29T22:10:22.669359] [DEBUG] [LOCAL ] HWM: Derivative data saved (1794 records). [2025-09-29T22:10:22.669888] [DEBUG] [LOCAL ] HY: Loaded 9987 existing records from primary storage. [2025-09-29T22:10:22.677808] [INFO ] [MAIN ] HWM: Successfully saved derivative data. [2025-09-29T22:10:22.677883] [INFO ] [MAIN ] HY: Loaded 9987 primary data records. [2025-09-29T22:10:22.684389] [INFO ] [MAIN ] Derivative Progress: 890/2057 symbols completed. HWM took 1.2s. Estimated remaining: 7m 55s. Rate: 147.4 symbols/min [2025-09-29T22:10:22.685028] [INFO ] [MAIN ] HYI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:22.707561] [DEBUG] [MAIN ] HXL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:22.724419] [INFO ] [MAIN ] HXL: Generated 1794 derivative records from 45991 primary records. [2025-09-29T22:10:22.766455] [DEBUG] [LOCAL ] HXL: Saving derivative data. [2025-09-29T22:10:22.843732] [DEBUG] [LOCAL ] HYI: Loaded 9292 existing records from primary storage. [2025-09-29T22:10:22.858189] [INFO ] [MAIN ] HYI: Loaded 9292 primary data records. [2025-09-29T22:10:22.924276] [DEBUG] [LOCAL ] HXL: Derivative data saved (1794 records). [2025-09-29T22:10:23.043804] [INFO ] [MAIN ] HXL: Successfully saved derivative data. [2025-09-29T22:10:23.071886] [INFO ] [MAIN ] Derivative Progress: 891/2057 symbols completed. HXL took 1.6s. Estimated remaining: 7m 55s. Rate: 147.4 symbols/min [2025-09-29T22:10:23.103356] [INFO ] [MAIN ] HYT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:23.368544] [DEBUG] [LOCAL ] HYT: Loaded 33536 existing records from primary storage. [2025-09-29T22:10:23.371583] [INFO ] [MAIN ] HYT: Loaded 33536 primary data records. [2025-09-29T22:10:23.470632] [DEBUG] [MAIN ] HY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:23.496043] [INFO ] [MAIN ] HY: Generated 1794 derivative records from 9987 primary records. [2025-09-29T22:10:23.522758] [DEBUG] [LOCAL ] HY: Saving derivative data. [2025-09-29T22:10:23.728205] [DEBUG] [LOCAL ] HY: Derivative data saved (1794 records). [2025-09-29T22:10:23.728776] [INFO ] [MAIN ] HY: Successfully saved derivative data. [2025-09-29T22:10:23.739228] [INFO ] [MAIN ] Derivative Progress: 892/2057 symbols completed. HY took 1.1s. Estimated remaining: 7m 55s. Rate: 147.3 symbols/min [2025-09-29T22:10:23.745675] [INFO ] [MAIN ] HYTR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:23.745499] [DEBUG] [MAIN ] HYI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:23.746819] [INFO ] [MAIN ] HYI: Generated 1794 derivative records from 9292 primary records. [2025-09-29T22:10:23.747021] [DEBUG] [LOCAL ] HYI: Saving derivative data. [2025-09-29T22:10:23.769182] [DEBUG] [LOCAL ] HYTR: Loaded 3140 existing records from primary storage. [2025-09-29T22:10:23.769985] [INFO ] [MAIN ] HYTR: Loaded 3140 primary data records. [2025-09-29T22:10:23.827677] [DEBUG] [LOCAL ] HYI: Derivative data saved (1794 records). [2025-09-29T22:10:23.867932] [INFO ] [MAIN ] HYI: Successfully saved derivative data. [2025-09-29T22:10:23.901336] [INFO ] [MAIN ] Derivative Progress: 893/2057 symbols completed. HYI took 1.2s. Estimated remaining: 7m 54s. Rate: 147.4 symbols/min [2025-09-29T22:10:23.906388] [INFO ] [MAIN ] HZO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:23.937145] [DEBUG] [MAIN ] HYT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:23.976055] [INFO ] [MAIN ] HYT: Generated 1794 derivative records from 33536 primary records. [2025-09-29T22:10:24.130123] [DEBUG] [LOCAL ] HYT: Saving derivative data. [2025-09-29T22:10:24.177906] [DEBUG] [LOCAL ] HYT: Derivative data saved (1794 records). [2025-09-29T22:10:24.178141] [INFO ] [MAIN ] HYT: Successfully saved derivative data. [2025-09-29T22:10:24.182185] [INFO ] [MAIN ] Derivative Progress: 894/2057 symbols completed. HYT took 1.1s. Estimated remaining: 7m 53s. Rate: 147.4 symbols/min [2025-09-29T22:10:24.183729] [INFO ] [MAIN ] IAE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:24.183581] [DEBUG] [LOCAL ] HZO: Loaded 29189 existing records from primary storage. [2025-09-29T22:10:24.185006] [INFO ] [MAIN ] HZO: Loaded 29189 primary data records. [2025-09-29T22:10:24.269611] [DEBUG] [LOCAL ] IAE: Loaded 6041 existing records from primary storage. [2025-09-29T22:10:24.275076] [INFO ] [MAIN ] IAE: Loaded 6041 primary data records. [2025-09-29T22:10:24.766911] [DEBUG] [MAIN ] HYTR: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:10:24.885306] [INFO ] [MAIN ] HYTR: Generated 1793 derivative records from 3140 primary records. [2025-09-29T22:10:24.895397] [DEBUG] [LOCAL ] HYTR: Saving derivative data. [2025-09-29T22:10:24.916211] [DEBUG] [LOCAL ] HYTR: Derivative data saved (1793 records). [2025-09-29T22:10:24.916673] [INFO ] [MAIN ] HYTR: Successfully saved derivative data. [2025-09-29T22:10:24.920042] [INFO ] [MAIN ] Derivative Progress: 895/2057 symbols completed. HYTR took 1.2s. Estimated remaining: 7m 53s. Rate: 147.3 symbols/min [2025-09-29T22:10:24.920975] [INFO ] [MAIN ] IAG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:24.939777] [DEBUG] [MAIN ] HZO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:24.940747] [INFO ] [MAIN ] HZO: Generated 1794 derivative records from 29189 primary records. [2025-09-29T22:10:24.940831] [DEBUG] [LOCAL ] HZO: Saving derivative data. [2025-09-29T22:10:24.962600] [DEBUG] [LOCAL ] HZO: Derivative data saved (1794 records). [2025-09-29T22:10:24.962913] [INFO ] [MAIN ] HZO: Successfully saved derivative data. [2025-09-29T22:10:24.965599] [INFO ] [MAIN ] Derivative Progress: 896/2057 symbols completed. HZO took 1.1s. Estimated remaining: 7m 52s. Rate: 147.4 symbols/min [2025-09-29T22:10:24.965916] [INFO ] [MAIN ] IBM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:24.979861] [DEBUG] [MAIN ] IAE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:24.980595] [INFO ] [MAIN ] IAE: Generated 1794 derivative records from 6041 primary records. [2025-09-29T22:10:24.980761] [DEBUG] [LOCAL ] IAE: Saving derivative data. [2025-09-29T22:10:25.010780] [DEBUG] [LOCAL ] IAE: Derivative data saved (1794 records). [2025-09-29T22:10:25.010941] [INFO ] [MAIN ] IAE: Successfully saved derivative data. [2025-09-29T22:10:25.013132] [INFO ] [MAIN ] Derivative Progress: 897/2057 symbols completed. IAE took 0.8s. Estimated remaining: 7m 52s. Rate: 147.6 symbols/min [2025-09-29T22:10:25.013445] [INFO ] [MAIN ] IBN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:25.033616] [DEBUG] [LOCAL ] IAG: Loaded 53448 existing records from primary storage. [2025-09-29T22:10:25.034010] [INFO ] [MAIN ] IAG: Loaded 53448 primary data records. [2025-09-29T22:10:25.245495] [DEBUG] [LOCAL ] IBM: Loaded 53636 existing records from primary storage. [2025-09-29T22:10:25.257165] [INFO ] [MAIN ] IBM: Loaded 53636 primary data records. [2025-09-29T22:10:25.514085] [DEBUG] [LOCAL ] IBN: Loaded 52868 existing records from primary storage. [2025-09-29T22:10:25.533807] [INFO ] [MAIN ] IBN: Loaded 52868 primary data records. [2025-09-29T22:10:26.090361] [DEBUG] [MAIN ] IAG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:26.091754] [INFO ] [MAIN ] IAG: Generated 1794 derivative records from 53448 primary records. [2025-09-29T22:10:26.092155] [DEBUG] [LOCAL ] IAG: Saving derivative data. [2025-09-29T22:10:26.114992] [DEBUG] [LOCAL ] IAG: Derivative data saved (1794 records). [2025-09-29T22:10:26.115434] [INFO ] [MAIN ] IAG: Successfully saved derivative data. [2025-09-29T22:10:26.126098] [INFO ] [MAIN ] Derivative Progress: 898/2057 symbols completed. IAG took 1.2s. Estimated remaining: 7m 52s. Rate: 147.3 symbols/min [2025-09-29T22:10:26.132421] [DEBUG] [MAIN ] IBM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:26.133163] [INFO ] [MAIN ] IBM: Generated 1794 derivative records from 53636 primary records. [2025-09-29T22:10:26.133246] [DEBUG] [LOCAL ] IBM: Saving derivative data. [2025-09-29T22:10:26.163897] [DEBUG] [MAIN ] IBN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:26.166567] [INFO ] [MAIN ] IBN: Generated 1794 derivative records from 52868 primary records. [2025-09-29T22:10:26.166794] [DEBUG] [LOCAL ] IBN: Saving derivative data. [2025-09-29T22:10:26.166696] [DEBUG] [LOCAL ] IBM: Derivative data saved (1794 records). [2025-09-29T22:10:26.167032] [INFO ] [MAIN ] IBM: Successfully saved derivative data. [2025-09-29T22:10:26.169598] [INFO ] [MAIN ] Derivative Progress: 899/2057 symbols completed. IBM took 1.2s. Estimated remaining: 7m 51s. Rate: 147.4 symbols/min [2025-09-29T22:10:26.186117] [DEBUG] [LOCAL ] IBN: Derivative data saved (1794 records). [2025-09-29T22:10:26.186196] [INFO ] [MAIN ] IBN: Successfully saved derivative data. [2025-09-29T22:10:26.188312] [INFO ] [MAIN ] Derivative Progress: 900/2057 symbols completed. IBN took 1.2s. Estimated remaining: 7m 50s. Rate: 147.6 symbols/min [2025-09-29T22:10:26.188979] [INFO ] [MAIN ] IBP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:26.189118] [INFO ] [MAIN ] ICE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:26.189412] [INFO ] [MAIN ] IBTA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:26.229178] [DEBUG] [LOCAL ] IBP: Loaded 29054 existing records from primary storage. [2025-09-29T22:10:26.229524] [INFO ] [MAIN ] IBP: Loaded 29054 primary data records. [2025-09-29T22:10:26.370268] [DEBUG] [LOCAL ] IBTA: Loaded 37651 existing records from primary storage. [2025-09-29T22:10:26.381480] [INFO ] [MAIN ] IBTA: Loaded 37651 primary data records. [2025-09-29T22:10:26.518532] [DEBUG] [LOCAL ] ICE: Loaded 53015 existing records from primary storage. [2025-09-29T22:10:26.645048] [INFO ] [MAIN ] ICE: Loaded 53015 primary data records. [2025-09-29T22:10:27.303278] [DEBUG] [MAIN ] IBP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:27.304382] [INFO ] [MAIN ] IBP: Generated 1794 derivative records from 29054 primary records. [2025-09-29T22:10:27.304569] [DEBUG] [LOCAL ] IBP: Saving derivative data. [2025-09-29T22:10:27.323733] [DEBUG] [LOCAL ] IBP: Derivative data saved (1794 records). [2025-09-29T22:10:27.324156] [INFO ] [MAIN ] IBP: Successfully saved derivative data. [2025-09-29T22:10:27.326729] [INFO ] [MAIN ] Derivative Progress: 901/2057 symbols completed. IBP took 1.1s. Estimated remaining: 7m 51s. Rate: 147.3 symbols/min [2025-09-29T22:10:27.326905] [INFO ] [MAIN ] ICL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:27.345786] [DEBUG] [MAIN ] IBTA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:27.346553] [INFO ] [MAIN ] IBTA: Generated 1794 derivative records from 37651 primary records. [2025-09-29T22:10:27.347030] [DEBUG] [LOCAL ] IBTA: Saving derivative data. [2025-09-29T22:10:27.369603] [DEBUG] [LOCAL ] IBTA: Derivative data saved (1794 records). [2025-09-29T22:10:27.393243] [INFO ] [MAIN ] IBTA: Successfully saved derivative data. [2025-09-29T22:10:27.393622] [DEBUG] [MAIN ] ICE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:27.396257] [INFO ] [MAIN ] Derivative Progress: 902/2057 symbols completed. IBTA took 1.2s. Estimated remaining: 7m 50s. Rate: 147.4 symbols/min [2025-09-29T22:10:27.397615] [INFO ] [MAIN ] ICE: Generated 1794 derivative records from 53015 primary records. [2025-09-29T22:10:27.396675] [INFO ] [MAIN ] IDA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:27.397829] [DEBUG] [LOCAL ] ICE: Saving derivative data. [2025-09-29T22:10:27.427378] [DEBUG] [LOCAL ] ICE: Derivative data saved (1794 records). [2025-09-29T22:10:27.429725] [INFO ] [MAIN ] ICE: Successfully saved derivative data. [2025-09-29T22:10:27.429338] [DEBUG] [LOCAL ] ICL: Loaded 38401 existing records from primary storage. [2025-09-29T22:10:27.432194] [INFO ] [MAIN ] Derivative Progress: 903/2057 symbols completed. ICE took 1.2s. Estimated remaining: 7m 49s. Rate: 147.6 symbols/min [2025-09-29T22:10:27.432390] [INFO ] [MAIN ] ICL: Loaded 38401 primary data records. [2025-09-29T22:10:27.432759] [INFO ] [MAIN ] IDE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:27.556762] [DEBUG] [LOCAL ] IDE: Loaded 8697 existing records from primary storage. [2025-09-29T22:10:27.578142] [INFO ] [MAIN ] IDE: Loaded 8697 primary data records. [2025-09-29T22:10:27.855220] [DEBUG] [LOCAL ] IDA: Loaded 31989 existing records from primary storage. [2025-09-29T22:10:27.890862] [INFO ] [MAIN ] IDA: Loaded 31989 primary data records. [2025-09-29T22:10:28.440536] [DEBUG] [MAIN ] ICL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:28.442018] [INFO ] [MAIN ] ICL: Generated 1794 derivative records from 38401 primary records. [2025-09-29T22:10:28.442133] [DEBUG] [LOCAL ] ICL: Saving derivative data. [2025-09-29T22:10:28.461590] [DEBUG] [LOCAL ] ICL: Derivative data saved (1794 records). [2025-09-29T22:10:28.461930] [INFO ] [MAIN ] ICL: Successfully saved derivative data. [2025-09-29T22:10:28.465189] [INFO ] [MAIN ] Derivative Progress: 904/2057 symbols completed. ICL took 1.1s. Estimated remaining: 7m 50s. Rate: 147.3 symbols/min [2025-09-29T22:10:28.466397] [INFO ] [MAIN ] IDT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:28.483363] [DEBUG] [MAIN ] IDE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:28.484327] [INFO ] [MAIN ] IDE: Generated 1794 derivative records from 8697 primary records. [2025-09-29T22:10:28.484519] [DEBUG] [LOCAL ] IDE: Saving derivative data. [2025-09-29T22:10:28.507569] [DEBUG] [LOCAL ] IDE: Derivative data saved (1794 records). [2025-09-29T22:10:28.508181] [INFO ] [MAIN ] IDE: Successfully saved derivative data. [2025-09-29T22:10:28.510509] [INFO ] [MAIN ] Derivative Progress: 905/2057 symbols completed. IDE took 1.1s. Estimated remaining: 7m 49s. Rate: 147.5 symbols/min [2025-09-29T22:10:28.510962] [INFO ] [MAIN ] IEX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:28.521510] [DEBUG] [LOCAL ] IDT: Loaded 17684 existing records from primary storage. [2025-09-29T22:10:28.521838] [INFO ] [MAIN ] IDT: Loaded 17684 primary data records. [2025-09-29T22:10:28.603667] [DEBUG] [MAIN ] IDA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:28.633691] [INFO ] [MAIN ] IDA: Generated 1794 derivative records from 31989 primary records. [2025-09-29T22:10:28.645075] [DEBUG] [LOCAL ] IDA: Saving derivative data. [2025-09-29T22:10:28.914985] [DEBUG] [LOCAL ] IDA: Derivative data saved (1794 records). [2025-09-29T22:10:28.923523] [INFO ] [MAIN ] IDA: Successfully saved derivative data. [2025-09-29T22:10:28.926336] [INFO ] [MAIN ] Derivative Progress: 906/2057 symbols completed. IDA took 1.5s. Estimated remaining: 7m 48s. Rate: 147.5 symbols/min [2025-09-29T22:10:28.927704] [INFO ] [MAIN ] IFF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:28.940847] [DEBUG] [LOCAL ] IEX: Loaded 38289 existing records from primary storage. [2025-09-29T22:10:28.942694] [INFO ] [MAIN ] IEX: Loaded 38289 primary data records. [2025-09-29T22:10:29.312025] [DEBUG] [LOCAL ] IFF: Loaded 50976 existing records from primary storage. [2025-09-29T22:10:29.314856] [INFO ] [MAIN ] IFF: Loaded 50976 primary data records. [2025-09-29T22:10:29.314741] [DEBUG] [MAIN ] IDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:29.315943] [INFO ] [MAIN ] IDT: Generated 1794 derivative records from 17684 primary records. [2025-09-29T22:10:29.321489] [DEBUG] [LOCAL ] IDT: Saving derivative data. [2025-09-29T22:10:29.460215] [DEBUG] [LOCAL ] IDT: Derivative data saved (1794 records). [2025-09-29T22:10:29.492627] [INFO ] [MAIN ] IDT: Successfully saved derivative data. [2025-09-29T22:10:29.517733] [INFO ] [MAIN ] Derivative Progress: 907/2057 symbols completed. IDT took 1.1s. Estimated remaining: 7m 48s. Rate: 147.4 symbols/min [2025-09-29T22:10:29.539442] [INFO ] [MAIN ] IFN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:29.676193] [DEBUG] [MAIN ] IEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:29.677860] [INFO ] [MAIN ] IEX: Generated 1794 derivative records from 38289 primary records. [2025-09-29T22:10:29.678115] [DEBUG] [LOCAL ] IEX: Saving derivative data. [2025-09-29T22:10:29.712744] [DEBUG] [LOCAL ] IFN: Loaded 18221 existing records from primary storage. [2025-09-29T22:10:29.710963] [DEBUG] [LOCAL ] IEX: Derivative data saved (1794 records). [2025-09-29T22:10:29.712961] [INFO ] [MAIN ] IEX: Successfully saved derivative data. [2025-09-29T22:10:29.713025] [INFO ] [MAIN ] IFN: Loaded 18221 primary data records. [2025-09-29T22:10:29.727080] [INFO ] [MAIN ] Derivative Progress: 908/2057 symbols completed. IEX took 1.2s. Estimated remaining: 7m 47s. Rate: 147.5 symbols/min [2025-09-29T22:10:29.754039] [INFO ] [MAIN ] IFS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:29.907049] [DEBUG] [MAIN ] IFF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:29.939033] [INFO ] [MAIN ] IFF: Generated 1794 derivative records from 50976 primary records. [2025-09-29T22:10:30.055907] [DEBUG] [LOCAL ] IFS: Loaded 22930 existing records from primary storage. [2025-09-29T22:10:30.056074] [INFO ] [MAIN ] IFS: Loaded 22930 primary data records. [2025-09-29T22:10:30.054921] [DEBUG] [LOCAL ] IFF: Saving derivative data. [2025-09-29T22:10:30.190243] [DEBUG] [LOCAL ] IFF: Derivative data saved (1794 records). [2025-09-29T22:10:30.190427] [INFO ] [MAIN ] IFF: Successfully saved derivative data. [2025-09-29T22:10:30.193300] [INFO ] [MAIN ] Derivative Progress: 909/2057 symbols completed. IFF took 1.3s. Estimated remaining: 7m 47s. Rate: 147.5 symbols/min [2025-09-29T22:10:30.214546] [INFO ] [MAIN ] IGA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:30.412900] [DEBUG] [LOCAL ] IGA: Loaded 9733 existing records from primary storage. [2025-09-29T22:10:30.413529] [INFO ] [MAIN ] IGA: Loaded 9733 primary data records. [2025-09-29T22:10:30.548396] [DEBUG] [MAIN ] IFN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:30.566185] [INFO ] [MAIN ] IFN: Generated 1794 derivative records from 18221 primary records. [2025-09-29T22:10:30.571418] [DEBUG] [LOCAL ] IFN: Saving derivative data. [2025-09-29T22:10:30.818827] [DEBUG] [LOCAL ] IFN: Derivative data saved (1794 records). [2025-09-29T22:10:30.819086] [INFO ] [MAIN ] IFN: Successfully saved derivative data. [2025-09-29T22:10:30.821419] [INFO ] [MAIN ] Derivative Progress: 910/2057 symbols completed. IFN took 1.3s. Estimated remaining: 7m 47s. Rate: 147.4 symbols/min [2025-09-29T22:10:30.821615] [INFO ] [MAIN ] IGD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:30.844569] [DEBUG] [MAIN ] IFS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:30.845741] [INFO ] [MAIN ] IFS: Generated 1794 derivative records from 22930 primary records. [2025-09-29T22:10:30.845904] [DEBUG] [LOCAL ] IFS: Saving derivative data. [2025-09-29T22:10:30.877545] [DEBUG] [LOCAL ] IFS: Derivative data saved (1794 records). [2025-09-29T22:10:30.877722] [INFO ] [MAIN ] IFS: Successfully saved derivative data. [2025-09-29T22:10:30.881265] [DEBUG] [LOCAL ] IGD: Loaded 18910 existing records from primary storage. [2025-09-29T22:10:30.880190] [INFO ] [MAIN ] Derivative Progress: 911/2057 symbols completed. IFS took 1.1s. Estimated remaining: 7m 46s. Rate: 147.5 symbols/min [2025-09-29T22:10:30.881451] [INFO ] [MAIN ] IGI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:30.881598] [INFO ] [MAIN ] IGD: Loaded 18910 primary data records. [2025-09-29T22:10:30.952082] [DEBUG] [LOCAL ] IGI: Loaded 3620 existing records from primary storage. [2025-09-29T22:10:30.979989] [INFO ] [MAIN ] IGI: Loaded 3620 primary data records. [2025-09-29T22:10:31.050528] [DEBUG] [MAIN ] IGA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:31.086518] [INFO ] [MAIN ] IGA: Generated 1794 derivative records from 9733 primary records. [2025-09-29T22:10:31.105033] [DEBUG] [LOCAL ] IGA: Saving derivative data. [2025-09-29T22:10:31.568722] [DEBUG] [LOCAL ] IGA: Derivative data saved (1794 records). [2025-09-29T22:10:31.570747] [INFO ] [MAIN ] IGA: Successfully saved derivative data. [2025-09-29T22:10:31.573199] [INFO ] [MAIN ] Derivative Progress: 912/2057 symbols completed. IGA took 1.4s. Estimated remaining: 7m 46s. Rate: 147.4 symbols/min [2025-09-29T22:10:31.574132] [INFO ] [MAIN ] IGR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:31.614689] [DEBUG] [MAIN ] IGD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:31.616318] [INFO ] [MAIN ] IGD: Generated 1794 derivative records from 18910 primary records. [2025-09-29T22:10:31.626444] [DEBUG] [LOCAL ] IGD: Saving derivative data. [2025-09-29T22:10:31.652434] [DEBUG] [MAIN ] IGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:31.641957] [DEBUG] [LOCAL ] IGR: Loaded 30457 existing records from primary storage. [2025-09-29T22:10:31.661904] [INFO ] [MAIN ] IGI: Generated 1794 derivative records from 3620 primary records. [2025-09-29T22:10:31.662041] [DEBUG] [LOCAL ] IGI: Saving derivative data. [2025-09-29T22:10:31.672450] [DEBUG] [LOCAL ] IGD: Derivative data saved (1794 records). [2025-09-29T22:10:31.661021] [INFO ] [MAIN ] IGR: Loaded 30457 primary data records. [2025-09-29T22:10:31.672820] [INFO ] [MAIN ] IGD: Successfully saved derivative data. [2025-09-29T22:10:31.675787] [INFO ] [MAIN ] Derivative Progress: 913/2057 symbols completed. IGD took 0.9s. Estimated remaining: 7m 45s. Rate: 147.5 symbols/min [2025-09-29T22:10:31.796247] [DEBUG] [LOCAL ] IGI: Derivative data saved (1794 records). [2025-09-29T22:10:31.796465] [INFO ] [MAIN ] IGI: Successfully saved derivative data. [2025-09-29T22:10:31.805709] [INFO ] [MAIN ] Derivative Progress: 914/2057 symbols completed. IGI took 0.9s. Estimated remaining: 7m 45s. Rate: 147.6 symbols/min [2025-09-29T22:10:32.022966] [DEBUG] [MAIN ] IGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:32.023709] [INFO ] [MAIN ] IGR: Generated 1794 derivative records from 30457 primary records. [2025-09-29T22:10:32.023777] [DEBUG] [LOCAL ] IGR: Saving derivative data. [2025-09-29T22:10:32.040163] [DEBUG] [LOCAL ] IGR: Derivative data saved (1794 records). [2025-09-29T22:10:32.040260] [INFO ] [MAIN ] IGR: Successfully saved derivative data. [2025-09-29T22:10:32.042896] [INFO ] [MAIN ] Derivative Progress: 915/2057 symbols completed. IGR took 0.5s. Estimated remaining: 7m 44s. Rate: 147.7 symbols/min [2025-09-29T22:10:32.043435] [INFO ] [MAIN ] IHG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:32.043539] [INFO ] [MAIN ] IHD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:32.043726] [INFO ] [MAIN ] IH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:32.058153] [DEBUG] [LOCAL ] IHD: Loaded 6922 existing records from primary storage. [2025-09-29T22:10:32.054168] [DEBUG] [LOCAL ] IH: Loaded 3313 existing records from primary storage. [2025-09-29T22:10:32.058368] [INFO ] [MAIN ] IHD: Loaded 6922 primary data records. [2025-09-29T22:10:32.070063] [INFO ] [MAIN ] IH: Loaded 3313 primary data records. [2025-09-29T22:10:32.313698] [DEBUG] [LOCAL ] IHG: Loaded 24500 existing records from primary storage. [2025-09-29T22:10:32.320371] [INFO ] [MAIN ] IHG: Loaded 24500 primary data records. [2025-09-29T22:10:33.229961] [DEBUG] [MAIN ] IHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:33.243720] [INFO ] [MAIN ] IHD: Generated 1794 derivative records from 6922 primary records. [2025-09-29T22:10:33.244216] [DEBUG] [LOCAL ] IHD: Saving derivative data. [2025-09-29T22:10:33.244164] [DEBUG] [MAIN ] IH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:33.246286] [INFO ] [MAIN ] IH: Generated 1794 derivative records from 3313 primary records. [2025-09-29T22:10:33.246560] [DEBUG] [LOCAL ] IH: Saving derivative data. [2025-09-29T22:10:33.277182] [DEBUG] [LOCAL ] IHD: Derivative data saved (1794 records). [2025-09-29T22:10:33.287980] [INFO ] [MAIN ] IHD: Successfully saved derivative data. [2025-09-29T22:10:33.290460] [INFO ] [MAIN ] Derivative Progress: 916/2057 symbols completed. IHD took 1.2s. Estimated remaining: 7m 45s. Rate: 147.4 symbols/min [2025-09-29T22:10:33.296813] [INFO ] [MAIN ] IHS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:33.297013] [DEBUG] [LOCAL ] IH: Derivative data saved (1794 records). [2025-09-29T22:10:33.297440] [INFO ] [MAIN ] IH: Successfully saved derivative data. [2025-09-29T22:10:33.300303] [INFO ] [MAIN ] Derivative Progress: 917/2057 symbols completed. IH took 1.3s. Estimated remaining: 7m 44s. Rate: 147.5 symbols/min [2025-09-29T22:10:33.300826] [INFO ] [MAIN ] IIF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:33.297933] [DEBUG] [MAIN ] IHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:33.302161] [INFO ] [MAIN ] IHG: Generated 1794 derivative records from 24500 primary records. [2025-09-29T22:10:33.302258] [DEBUG] [LOCAL ] IHG: Saving derivative data. [2025-09-29T22:10:33.329115] [DEBUG] [LOCAL ] IIF: Loaded 5715 existing records from primary storage. [2025-09-29T22:10:33.329860] [INFO ] [MAIN ] IIF: Loaded 5715 primary data records. [2025-09-29T22:10:33.456303] [DEBUG] [LOCAL ] IHG: Derivative data saved (1794 records). [2025-09-29T22:10:33.476960] [INFO ] [MAIN ] IHG: Successfully saved derivative data. [2025-09-29T22:10:33.484628] [INFO ] [MAIN ] Derivative Progress: 918/2057 symbols completed. IHG took 1.4s. Estimated remaining: 7m 43s. Rate: 147.6 symbols/min [2025-09-29T22:10:33.518272] [INFO ] [MAIN ] IIIN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:33.520096] [DEBUG] [LOCAL ] IHS: Loaded 38991 existing records from primary storage. [2025-09-29T22:10:33.533538] [INFO ] [MAIN ] IHS: Loaded 38991 primary data records. [2025-09-29T22:10:33.814465] [DEBUG] [LOCAL ] IIIN: Loaded 16511 existing records from primary storage. [2025-09-29T22:10:33.814807] [INFO ] [MAIN ] IIIN: Loaded 16511 primary data records. [2025-09-29T22:10:34.396441] [DEBUG] [MAIN ] IIF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:34.397472] [INFO ] [MAIN ] IIF: Generated 1794 derivative records from 5715 primary records. [2025-09-29T22:10:34.398628] [DEBUG] [LOCAL ] IIF: Saving derivative data. [2025-09-29T22:10:34.430244] [DEBUG] [MAIN ] IHS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:34.431339] [INFO ] [MAIN ] IHS: Generated 1794 derivative records from 38991 primary records. [2025-09-29T22:10:34.429935] [DEBUG] [LOCAL ] IIF: Derivative data saved (1794 records). [2025-09-29T22:10:34.431525] [INFO ] [MAIN ] IIF: Successfully saved derivative data. [2025-09-29T22:10:34.434015] [INFO ] [MAIN ] Derivative Progress: 919/2057 symbols completed. IIF took 1.1s. Estimated remaining: 7m 43s. Rate: 147.4 symbols/min [2025-09-29T22:10:34.434255] [INFO ] [MAIN ] IIM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:34.436217] [DEBUG] [LOCAL ] IHS: Saving derivative data. [2025-09-29T22:10:34.463439] [DEBUG] [MAIN ] IIIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:34.467700] [DEBUG] [LOCAL ] IHS: Derivative data saved (1794 records). [2025-09-29T22:10:34.468604] [INFO ] [MAIN ] IIIN: Generated 1794 derivative records from 16511 primary records. [2025-09-29T22:10:34.468952] [INFO ] [MAIN ] IHS: Successfully saved derivative data. [2025-09-29T22:10:34.471270] [INFO ] [MAIN ] Derivative Progress: 920/2057 symbols completed. IHS took 1.2s. Estimated remaining: 7m 42s. Rate: 147.5 symbols/min [2025-09-29T22:10:34.475728] [DEBUG] [LOCAL ] IIIN: Saving derivative data. [2025-09-29T22:10:34.475905] [INFO ] [MAIN ] IIPR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:34.499255] [DEBUG] [LOCAL ] IIIN: Derivative data saved (1794 records). [2025-09-29T22:10:34.499792] [DEBUG] [LOCAL ] IIM: Loaded 15934 existing records from primary storage. [2025-09-29T22:10:34.499916] [INFO ] [MAIN ] IIM: Loaded 15934 primary data records. [2025-09-29T22:10:34.500002] [INFO ] [MAIN ] IIIN: Successfully saved derivative data. [2025-09-29T22:10:34.513937] [INFO ] [MAIN ] Derivative Progress: 921/2057 symbols completed. IIIN took 1.0s. Estimated remaining: 7m 42s. Rate: 147.7 symbols/min [2025-09-29T22:10:34.547017] [INFO ] [MAIN ] IMAX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:34.843722] [DEBUG] [LOCAL ] IIPR: Loaded 29651 existing records from primary storage. [2025-09-29T22:10:34.854042] [INFO ] [MAIN ] IIPR: Loaded 29651 primary data records. [2025-09-29T22:10:34.986905] [DEBUG] [LOCAL ] IMAX: Loaded 42742 existing records from primary storage. [2025-09-29T22:10:34.998119] [INFO ] [MAIN ] IMAX: Loaded 42742 primary data records. [2025-09-29T22:10:35.581462] [DEBUG] [MAIN ] IIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:35.583156] [INFO ] [MAIN ] IIM: Generated 1794 derivative records from 15934 primary records. [2025-09-29T22:10:35.583393] [DEBUG] [LOCAL ] IIM: Saving derivative data. [2025-09-29T22:10:35.601849] [DEBUG] [LOCAL ] IIM: Derivative data saved (1794 records). [2025-09-29T22:10:35.602852] [INFO ] [MAIN ] IIM: Successfully saved derivative data. [2025-09-29T22:10:35.605436] [INFO ] [MAIN ] Derivative Progress: 922/2057 symbols completed. IIM took 1.2s. Estimated remaining: 7m 42s. Rate: 147.4 symbols/min [2025-09-29T22:10:35.605800] [INFO ] [MAIN ] INFA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:35.625477] [DEBUG] [MAIN ] IIPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:35.626368] [INFO ] [MAIN ] IIPR: Generated 1794 derivative records from 29651 primary records. [2025-09-29T22:10:35.626605] [DEBUG] [LOCAL ] IIPR: Saving derivative data. [2025-09-29T22:10:35.649097] [DEBUG] [LOCAL ] IIPR: Derivative data saved (1794 records). [2025-09-29T22:10:35.649541] [INFO ] [MAIN ] IIPR: Successfully saved derivative data. [2025-09-29T22:10:35.651873] [INFO ] [MAIN ] Derivative Progress: 923/2057 symbols completed. IIPR took 1.2s. Estimated remaining: 7m 41s. Rate: 147.6 symbols/min [2025-09-29T22:10:35.652217] [INFO ] [MAIN ] INFY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:35.684733] [DEBUG] [MAIN ] IMAX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:35.685853] [INFO ] [MAIN ] IMAX: Generated 1794 derivative records from 42742 primary records. [2025-09-29T22:10:35.686122] [DEBUG] [LOCAL ] IMAX: Saving derivative data. [2025-09-29T22:10:35.711716] [DEBUG] [LOCAL ] IMAX: Derivative data saved (1794 records). [2025-09-29T22:10:35.712000] [INFO ] [MAIN ] IMAX: Successfully saved derivative data. [2025-09-29T22:10:35.730159] [INFO ] [MAIN ] Derivative Progress: 924/2057 symbols completed. IMAX took 1.2s. Estimated remaining: 7m 40s. Rate: 147.7 symbols/min [2025-09-29T22:10:35.730914] [INFO ] [MAIN ] ING: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:35.732939] [DEBUG] [LOCAL ] INFA: Loaded 49743 existing records from primary storage. [2025-09-29T22:10:35.733572] [INFO ] [MAIN ] INFA: Loaded 49743 primary data records. [2025-09-29T22:10:36.101971] [DEBUG] [LOCAL ] INFY: Loaded 53598 existing records from primary storage. [2025-09-29T22:10:36.102379] [INFO ] [MAIN ] INFY: Loaded 53598 primary data records. [2025-09-29T22:10:36.232096] [DEBUG] [LOCAL ] ING: Loaded 50745 existing records from primary storage. [2025-09-29T22:10:36.232219] [INFO ] [MAIN ] ING: Loaded 50745 primary data records. [2025-09-29T22:10:36.778153] [DEBUG] [MAIN ] INFA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:36.779853] [INFO ] [MAIN ] INFA: Generated 1794 derivative records from 49743 primary records. [2025-09-29T22:10:36.780896] [DEBUG] [LOCAL ] INFA: Saving derivative data. [2025-09-29T22:10:36.804369] [DEBUG] [LOCAL ] INFA: Derivative data saved (1794 records). [2025-09-29T22:10:36.804638] [INFO ] [MAIN ] INFA: Successfully saved derivative data. [2025-09-29T22:10:36.807355] [INFO ] [MAIN ] Derivative Progress: 925/2057 symbols completed. INFA took 1.2s. Estimated remaining: 7m 41s. Rate: 147.4 symbols/min [2025-09-29T22:10:36.807863] [INFO ] [MAIN ] INGM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:36.823041] [DEBUG] [MAIN ] INFY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:36.824373] [INFO ] [MAIN ] INFY: Generated 1794 derivative records from 53598 primary records. [2025-09-29T22:10:36.824599] [DEBUG] [LOCAL ] INFY: Saving derivative data. [2025-09-29T22:10:36.843058] [DEBUG] [LOCAL ] INFY: Derivative data saved (1794 records). [2025-09-29T22:10:36.845100] [INFO ] [MAIN ] INFY: Successfully saved derivative data. [2025-09-29T22:10:36.847018] [INFO ] [MAIN ] Derivative Progress: 926/2057 symbols completed. INFY took 1.2s. Estimated remaining: 7m 40s. Rate: 147.6 symbols/min [2025-09-29T22:10:36.847333] [INFO ] [MAIN ] INGR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:36.861523] [DEBUG] [MAIN ] ING: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:36.862428] [INFO ] [MAIN ] ING: Generated 1794 derivative records from 50745 primary records. [2025-09-29T22:10:36.862633] [DEBUG] [LOCAL ] ING: Saving derivative data. [2025-09-29T22:10:36.886898] [DEBUG] [LOCAL ] ING: Derivative data saved (1794 records). [2025-09-29T22:10:36.887145] [INFO ] [MAIN ] ING: Successfully saved derivative data. [2025-09-29T22:10:36.889231] [INFO ] [MAIN ] Derivative Progress: 927/2057 symbols completed. ING took 1.2s. Estimated remaining: 7m 39s. Rate: 147.7 symbols/min [2025-09-29T22:10:36.889527] [INFO ] [MAIN ] INN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:36.904180] [DEBUG] [LOCAL ] INGM: Loaded 28641 existing records from primary storage. [2025-09-29T22:10:36.912338] [INFO ] [MAIN ] INGM: Loaded 28641 primary data records. [2025-09-29T22:10:37.053080] [DEBUG] [LOCAL ] INGR: Loaded 33254 existing records from primary storage. [2025-09-29T22:10:37.054331] [INFO ] [MAIN ] INGR: Loaded 33254 primary data records. [2025-09-29T22:10:37.227111] [DEBUG] [LOCAL ] INN: Loaded 41816 existing records from primary storage. [2025-09-29T22:10:37.391070] [INFO ] [MAIN ] INN: Loaded 41816 primary data records. [2025-09-29T22:10:38.052804] [DEBUG] [MAIN ] INGM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:38.055439] [INFO ] [MAIN ] INGM: Generated 1794 derivative records from 28641 primary records. [2025-09-29T22:10:38.055780] [DEBUG] [LOCAL ] INGM: Saving derivative data. [2025-09-29T22:10:38.087993] [DEBUG] [MAIN ] INGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:38.089760] [INFO ] [MAIN ] INGR: Generated 1794 derivative records from 33254 primary records. [2025-09-29T22:10:38.090403] [DEBUG] [LOCAL ] INGR: Saving derivative data. [2025-09-29T22:10:38.107510] [DEBUG] [LOCAL ] INGM: Derivative data saved (1794 records). [2025-09-29T22:10:38.108376] [INFO ] [MAIN ] INGM: Successfully saved derivative data. [2025-09-29T22:10:38.110891] [INFO ] [MAIN ] Derivative Progress: 928/2057 symbols completed. INGM took 1.3s. Estimated remaining: 7m 40s. Rate: 147.4 symbols/min [2025-09-29T22:10:38.117745] [DEBUG] [LOCAL ] INGR: Derivative data saved (1794 records). [2025-09-29T22:10:38.119419] [INFO ] [MAIN ] INGR: Successfully saved derivative data. [2025-09-29T22:10:38.122194] [INFO ] [MAIN ] Derivative Progress: 929/2057 symbols completed. INGR took 1.3s. Estimated remaining: 7m 39s. Rate: 147.5 symbols/min [2025-09-29T22:10:38.136116] [DEBUG] [MAIN ] INN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:38.136877] [INFO ] [MAIN ] INN: Generated 1794 derivative records from 41816 primary records. [2025-09-29T22:10:38.136942] [DEBUG] [LOCAL ] INN: Saving derivative data. [2025-09-29T22:10:38.152577] [DEBUG] [LOCAL ] INN: Derivative data saved (1794 records). [2025-09-29T22:10:38.152700] [INFO ] [MAIN ] INN: Successfully saved derivative data. [2025-09-29T22:10:38.154994] [INFO ] [MAIN ] Derivative Progress: 930/2057 symbols completed. INN took 1.3s. Estimated remaining: 7m 38s. Rate: 147.7 symbols/min [2025-09-29T22:10:38.155852] [INFO ] [MAIN ] INVH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:38.156007] [INFO ] [MAIN ] INSW: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:38.155757] [INFO ] [MAIN ] INSP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:38.229293] [DEBUG] [LOCAL ] INSW: Loaded 40136 existing records from primary storage. [2025-09-29T22:10:38.230865] [INFO ] [MAIN ] INSW: Loaded 40136 primary data records. [2025-09-29T22:10:38.243960] [DEBUG] [LOCAL ] INSP: Loaded 36932 existing records from primary storage. [2025-09-29T22:10:38.254574] [INFO ] [MAIN ] INSP: Loaded 36932 primary data records. [2025-09-29T22:10:38.403132] [DEBUG] [LOCAL ] INVH: Loaded 53135 existing records from primary storage. [2025-09-29T22:10:38.408541] [INFO ] [MAIN ] INVH: Loaded 53135 primary data records. [2025-09-29T22:10:39.331187] [DEBUG] [MAIN ] INSW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:39.332168] [INFO ] [MAIN ] INSW: Generated 1794 derivative records from 40136 primary records. [2025-09-29T22:10:39.332403] [DEBUG] [LOCAL ] INSW: Saving derivative data. [2025-09-29T22:10:39.367246] [DEBUG] [MAIN ] INSP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:39.368756] [INFO ] [MAIN ] INSP: Generated 1794 derivative records from 36932 primary records. [2025-09-29T22:10:39.377705] [DEBUG] [LOCAL ] INSP: Saving derivative data. [2025-09-29T22:10:39.386367] [DEBUG] [LOCAL ] INSW: Derivative data saved (1794 records). [2025-09-29T22:10:39.385914] [DEBUG] [MAIN ] INVH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:39.397251] [INFO ] [MAIN ] INSW: Successfully saved derivative data. [2025-09-29T22:10:39.402630] [INFO ] [MAIN ] Derivative Progress: 931/2057 symbols completed. INSW took 1.2s. Estimated remaining: 7m 38s. Rate: 147.4 symbols/min [2025-09-29T22:10:39.399877] [INFO ] [MAIN ] INVH: Generated 1794 derivative records from 53135 primary records. [2025-09-29T22:10:39.404749] [DEBUG] [LOCAL ] INSP: Derivative data saved (1794 records). [2025-09-29T22:10:39.405111] [INFO ] [MAIN ] INSP: Successfully saved derivative data. [2025-09-29T22:10:39.405240] [DEBUG] [LOCAL ] INVH: Saving derivative data. [2025-09-29T22:10:39.405027] [INFO ] [MAIN ] INVX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:39.408104] [INFO ] [MAIN ] Derivative Progress: 932/2057 symbols completed. INSP took 1.3s. Estimated remaining: 7m 38s. Rate: 147.5 symbols/min [2025-09-29T22:10:39.409283] [INFO ] [MAIN ] IONQ: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:39.426684] [DEBUG] [LOCAL ] INVH: Derivative data saved (1794 records). [2025-09-29T22:10:39.426902] [INFO ] [MAIN ] INVH: Successfully saved derivative data. [2025-09-29T22:10:39.436762] [INFO ] [MAIN ] Derivative Progress: 933/2057 symbols completed. INVH took 1.3s. Estimated remaining: 7m 37s. Rate: 147.7 symbols/min [2025-09-29T22:10:39.437180] [INFO ] [MAIN ] IOT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:39.450489] [DEBUG] [LOCAL ] INVX: Loaded 29009 existing records from primary storage. [2025-09-29T22:10:39.450634] [INFO ] [MAIN ] INVX: Loaded 29009 primary data records. [2025-09-29T22:10:39.636598] [DEBUG] [LOCAL ] IONQ: Loaded 53788 existing records from primary storage. [2025-09-29T22:10:39.661910] [INFO ] [MAIN ] IONQ: Loaded 53788 primary data records. [2025-09-29T22:10:39.986319] [DEBUG] [LOCAL ] IOT: Loaded 53470 existing records from primary storage. [2025-09-29T22:10:39.991792] [INFO ] [MAIN ] IOT: Loaded 53470 primary data records. [2025-09-29T22:10:40.554765] [DEBUG] [MAIN ] INVX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:40.556110] [INFO ] [MAIN ] INVX: Generated 1794 derivative records from 29009 primary records. [2025-09-29T22:10:40.556221] [DEBUG] [LOCAL ] INVX: Saving derivative data. [2025-09-29T22:10:40.580416] [DEBUG] [LOCAL ] INVX: Derivative data saved (1794 records). [2025-09-29T22:10:40.580754] [INFO ] [MAIN ] INVX: Successfully saved derivative data. [2025-09-29T22:10:40.582842] [INFO ] [MAIN ] Derivative Progress: 934/2057 symbols completed. INVX took 1.2s. Estimated remaining: 7m 37s. Rate: 147.4 symbols/min [2025-09-29T22:10:40.583281] [INFO ] [MAIN ] IP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:40.598177] [DEBUG] [MAIN ] IONQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:40.599674] [INFO ] [MAIN ] IONQ: Generated 1794 derivative records from 53788 primary records. [2025-09-29T22:10:40.599876] [DEBUG] [LOCAL ] IONQ: Saving derivative data. [2025-09-29T22:10:40.630957] [DEBUG] [LOCAL ] IONQ: Derivative data saved (1794 records). [2025-09-29T22:10:40.636113] [INFO ] [MAIN ] IONQ: Successfully saved derivative data. [2025-09-29T22:10:40.638418] [INFO ] [MAIN ] Derivative Progress: 935/2057 symbols completed. IONQ took 1.2s. Estimated remaining: 7m 36s. Rate: 147.5 symbols/min [2025-09-29T22:10:40.638780] [INFO ] [MAIN ] IPG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:40.639296] [DEBUG] [MAIN ] IOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:40.640467] [INFO ] [MAIN ] IOT: Generated 1794 derivative records from 53470 primary records. [2025-09-29T22:10:40.640540] [DEBUG] [LOCAL ] IOT: Saving derivative data. [2025-09-29T22:10:40.658070] [DEBUG] [LOCAL ] IOT: Derivative data saved (1794 records). [2025-09-29T22:10:40.658271] [INFO ] [MAIN ] IOT: Successfully saved derivative data. [2025-09-29T22:10:40.660373] [INFO ] [MAIN ] Derivative Progress: 936/2057 symbols completed. IOT took 1.2s. Estimated remaining: 7m 36s. Rate: 147.7 symbols/min [2025-09-29T22:10:40.660833] [INFO ] [MAIN ] IPI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:40.703840] [DEBUG] [LOCAL ] IP: Loaded 53313 existing records from primary storage. [2025-09-29T22:10:40.704013] [INFO ] [MAIN ] IP: Loaded 53313 primary data records. [2025-09-29T22:10:40.829607] [DEBUG] [LOCAL ] IPI: Loaded 21413 existing records from primary storage. [2025-09-29T22:10:40.842472] [INFO ] [MAIN ] IPI: Loaded 21413 primary data records. [2025-09-29T22:10:40.943549] [DEBUG] [LOCAL ] IPG: Loaded 53330 existing records from primary storage. [2025-09-29T22:10:40.979078] [INFO ] [MAIN ] IPG: Loaded 53330 primary data records. [2025-09-29T22:10:41.814990] [DEBUG] [MAIN ] IP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:41.816217] [INFO ] [MAIN ] IP: Generated 1794 derivative records from 53313 primary records. [2025-09-29T22:10:41.816439] [DEBUG] [LOCAL ] IP: Saving derivative data. [2025-09-29T22:10:41.852607] [DEBUG] [MAIN ] IPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:41.862288] [INFO ] [MAIN ] IPI: Generated 1794 derivative records from 21413 primary records. [2025-09-29T22:10:41.867324] [DEBUG] [LOCAL ] IPI: Saving derivative data. [2025-09-29T22:10:41.869842] [DEBUG] [LOCAL ] IP: Derivative data saved (1794 records). [2025-09-29T22:10:41.881089] [INFO ] [MAIN ] IP: Successfully saved derivative data. [2025-09-29T22:10:41.883083] [INFO ] [MAIN ] Derivative Progress: 937/2057 symbols completed. IP took 1.3s. Estimated remaining: 7m 36s. Rate: 147.3 symbols/min [2025-09-29T22:10:41.886818] [INFO ] [MAIN ] IQI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:41.880988] [DEBUG] [MAIN ] IPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:41.888485] [INFO ] [MAIN ] IPG: Generated 1794 derivative records from 53330 primary records. [2025-09-29T22:10:41.890912] [DEBUG] [LOCAL ] IPG: Saving derivative data. [2025-09-29T22:10:41.895127] [DEBUG] [LOCAL ] IPI: Derivative data saved (1794 records). [2025-09-29T22:10:41.904135] [INFO ] [MAIN ] IPI: Successfully saved derivative data. [2025-09-29T22:10:41.909264] [INFO ] [MAIN ] Derivative Progress: 938/2057 symbols completed. IPI took 1.2s. Estimated remaining: 7m 35s. Rate: 147.5 symbols/min [2025-09-29T22:10:41.909504] [INFO ] [MAIN ] IQV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:41.927780] [DEBUG] [LOCAL ] IQI: Loaded 18003 existing records from primary storage. [2025-09-29T22:10:41.927913] [DEBUG] [LOCAL ] IPG: Derivative data saved (1794 records). [2025-09-29T22:10:41.928206] [INFO ] [MAIN ] IQI: Loaded 18003 primary data records. [2025-09-29T22:10:41.928331] [INFO ] [MAIN ] IPG: Successfully saved derivative data. [2025-09-29T22:10:41.942949] [INFO ] [MAIN ] Derivative Progress: 939/2057 symbols completed. IPG took 1.3s. Estimated remaining: 7m 34s. Rate: 147.6 symbols/min [2025-09-29T22:10:41.943386] [INFO ] [MAIN ] IR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:42.294696] [DEBUG] [LOCAL ] IQV: Loaded 50103 existing records from primary storage. [2025-09-29T22:10:42.294936] [INFO ] [MAIN ] IQV: Loaded 50103 primary data records. [2025-09-29T22:10:42.429598] [DEBUG] [LOCAL ] IR: Loaded 52686 existing records from primary storage. [2025-09-29T22:10:42.475932] [INFO ] [MAIN ] IR: Loaded 52686 primary data records. [2025-09-29T22:10:42.839370] [DEBUG] [MAIN ] IQI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:42.844821] [INFO ] [MAIN ] IQI: Generated 1794 derivative records from 18003 primary records. [2025-09-29T22:10:42.845116] [DEBUG] [LOCAL ] IQI: Saving derivative data. [2025-09-29T22:10:42.987860] [DEBUG] [LOCAL ] IQI: Derivative data saved (1794 records). [2025-09-29T22:10:42.990159] [INFO ] [MAIN ] IQI: Successfully saved derivative data. [2025-09-29T22:10:42.992439] [INFO ] [MAIN ] Derivative Progress: 940/2057 symbols completed. IQI took 1.1s. Estimated remaining: 7m 35s. Rate: 147.4 symbols/min [2025-09-29T22:10:42.992613] [INFO ] [MAIN ] IRM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:43.009090] [DEBUG] [MAIN ] IQV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:43.011076] [INFO ] [MAIN ] IQV: Generated 1794 derivative records from 50103 primary records. [2025-09-29T22:10:43.011262] [DEBUG] [LOCAL ] IQV: Saving derivative data. [2025-09-29T22:10:43.029583] [DEBUG] [LOCAL ] IQV: Derivative data saved (1794 records). [2025-09-29T22:10:43.029958] [INFO ] [MAIN ] IQV: Successfully saved derivative data. [2025-09-29T22:10:43.032155] [INFO ] [MAIN ] Derivative Progress: 941/2057 symbols completed. IQV took 1.1s. Estimated remaining: 7m 34s. Rate: 147.5 symbols/min [2025-09-29T22:10:43.033064] [INFO ] [MAIN ] IRS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:43.052099] [DEBUG] [MAIN ] IR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:43.053033] [INFO ] [MAIN ] IR: Generated 1794 derivative records from 52686 primary records. [2025-09-29T22:10:43.053318] [DEBUG] [LOCAL ] IR: Saving derivative data. [2025-09-29T22:10:43.086843] [DEBUG] [LOCAL ] IR: Derivative data saved (1794 records). [2025-09-29T22:10:43.095584] [INFO ] [MAIN ] IR: Successfully saved derivative data. [2025-09-29T22:10:43.095409] [DEBUG] [LOCAL ] IRS: Loaded 21787 existing records from primary storage. [2025-09-29T22:10:43.097820] [INFO ] [MAIN ] Derivative Progress: 942/2057 symbols completed. IR took 1.2s. Estimated remaining: 7m 33s. Rate: 147.7 symbols/min [2025-09-29T22:10:43.115581] [INFO ] [MAIN ] IRS: Loaded 21787 primary data records. [2025-09-29T22:10:43.115999] [INFO ] [MAIN ] IRT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:43.138934] [DEBUG] [LOCAL ] IRM: Loaded 49362 existing records from primary storage. [2025-09-29T22:10:43.139334] [INFO ] [MAIN ] IRM: Loaded 49362 primary data records. [2025-09-29T22:10:43.833014] [DEBUG] [LOCAL ] IRT: Loaded 50393 existing records from primary storage. [2025-09-29T22:10:43.834189] [INFO ] [MAIN ] IRT: Loaded 50393 primary data records. [2025-09-29T22:10:44.182446] [DEBUG] [MAIN ] IRM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:44.184006] [INFO ] [MAIN ] IRM: Generated 1794 derivative records from 49362 primary records. [2025-09-29T22:10:44.184262] [DEBUG] [LOCAL ] IRM: Saving derivative data. [2025-09-29T22:10:44.214880] [DEBUG] [MAIN ] IRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:44.217061] [INFO ] [MAIN ] IRS: Generated 1794 derivative records from 21787 primary records. [2025-09-29T22:10:44.217164] [DEBUG] [LOCAL ] IRS: Saving derivative data. [2025-09-29T22:10:44.236802] [DEBUG] [LOCAL ] IRS: Derivative data saved (1794 records). [2025-09-29T22:10:44.238606] [INFO ] [MAIN ] IRS: Successfully saved derivative data. [2025-09-29T22:10:44.238525] [DEBUG] [LOCAL ] IRM: Derivative data saved (1794 records). [2025-09-29T22:10:44.241004] [INFO ] [MAIN ] Derivative Progress: 943/2057 symbols completed. IRS took 1.2s. Estimated remaining: 7m 34s. Rate: 147.4 symbols/min [2025-09-29T22:10:44.241429] [INFO ] [MAIN ] IRM: Successfully saved derivative data. [2025-09-29T22:10:44.245335] [INFO ] [MAIN ] Derivative Progress: 944/2057 symbols completed. IRM took 1.3s. Estimated remaining: 7m 33s. Rate: 147.5 symbols/min [2025-09-29T22:10:44.258778] [DEBUG] [MAIN ] IRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:44.259444] [INFO ] [MAIN ] IRT: Generated 1794 derivative records from 50393 primary records. [2025-09-29T22:10:44.259545] [DEBUG] [LOCAL ] IRT: Saving derivative data. [2025-09-29T22:10:44.275944] [DEBUG] [LOCAL ] IRT: Derivative data saved (1794 records). [2025-09-29T22:10:44.276017] [INFO ] [MAIN ] IRT: Successfully saved derivative data. [2025-09-29T22:10:44.278190] [INFO ] [MAIN ] Derivative Progress: 945/2057 symbols completed. IRT took 1.2s. Estimated remaining: 7m 32s. Rate: 147.7 symbols/min [2025-09-29T22:10:44.278723] [INFO ] [MAIN ] ITGR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:44.278636] [INFO ] [MAIN ] ISD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:44.279011] [INFO ] [MAIN ] IT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:44.306840] [DEBUG] [LOCAL ] ISD: Loaded 15526 existing records from primary storage. [2025-09-29T22:10:44.307044] [INFO ] [MAIN ] ISD: Loaded 15526 primary data records. [2025-09-29T22:10:44.419369] [DEBUG] [LOCAL ] ITGR: Loaded 31645 existing records from primary storage. [2025-09-29T22:10:44.425788] [INFO ] [MAIN ] ITGR: Loaded 31645 primary data records. [2025-09-29T22:10:44.583469] [DEBUG] [LOCAL ] IT: Loaded 41834 existing records from primary storage. [2025-09-29T22:10:44.608186] [INFO ] [MAIN ] IT: Loaded 41834 primary data records. [2025-09-29T22:10:45.370560] [DEBUG] [MAIN ] ISD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:45.371626] [INFO ] [MAIN ] ISD: Generated 1794 derivative records from 15526 primary records. [2025-09-29T22:10:45.371891] [DEBUG] [LOCAL ] ISD: Saving derivative data. [2025-09-29T22:10:45.372536] [DEBUG] [MAIN ] ITGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:45.374198] [INFO ] [MAIN ] ITGR: Generated 1794 derivative records from 31645 primary records. [2025-09-29T22:10:45.374295] [DEBUG] [LOCAL ] ITGR: Saving derivative data. [2025-09-29T22:10:45.402542] [DEBUG] [LOCAL ] ISD: Derivative data saved (1794 records). [2025-09-29T22:10:45.403825] [INFO ] [MAIN ] ISD: Successfully saved derivative data. [2025-09-29T22:10:45.406307] [INFO ] [MAIN ] Derivative Progress: 946/2057 symbols completed. ISD took 1.1s. Estimated remaining: 7m 32s. Rate: 147.4 symbols/min [2025-09-29T22:10:45.408040] [INFO ] [MAIN ] ITT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:45.414389] [DEBUG] [LOCAL ] ITGR: Derivative data saved (1794 records). [2025-09-29T22:10:45.414601] [INFO ] [MAIN ] ITGR: Successfully saved derivative data. [2025-09-29T22:10:45.416948] [INFO ] [MAIN ] Derivative Progress: 947/2057 symbols completed. ITGR took 1.1s. Estimated remaining: 7m 31s. Rate: 147.5 symbols/min [2025-09-29T22:10:45.430731] [INFO ] [MAIN ] ITUB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:45.431109] [DEBUG] [MAIN ] IT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:45.432254] [INFO ] [MAIN ] IT: Generated 1794 derivative records from 41834 primary records. [2025-09-29T22:10:45.432415] [DEBUG] [LOCAL ] IT: Saving derivative data. [2025-09-29T22:10:45.450117] [DEBUG] [LOCAL ] IT: Derivative data saved (1794 records). [2025-09-29T22:10:45.450260] [INFO ] [MAIN ] IT: Successfully saved derivative data. [2025-09-29T22:10:45.452356] [INFO ] [MAIN ] Derivative Progress: 948/2057 symbols completed. IT took 1.2s. Estimated remaining: 7m 31s. Rate: 147.7 symbols/min [2025-09-29T22:10:45.452731] [INFO ] [MAIN ] ITW: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:45.500155] [DEBUG] [LOCAL ] ITT: Loaded 32914 existing records from primary storage. [2025-09-29T22:10:45.500538] [INFO ] [MAIN ] ITT: Loaded 32914 primary data records. [2025-09-29T22:10:45.651194] [DEBUG] [LOCAL ] ITUB: Loaded 53318 existing records from primary storage. [2025-09-29T22:10:45.656367] [INFO ] [MAIN ] ITUB: Loaded 53318 primary data records. [2025-09-29T22:10:45.803195] [DEBUG] [LOCAL ] ITW: Loaded 45913 existing records from primary storage. [2025-09-29T22:10:45.971434] [INFO ] [MAIN ] ITW: Loaded 45913 primary data records. [2025-09-29T22:10:46.675824] [DEBUG] [MAIN ] ITT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:46.677792] [INFO ] [MAIN ] ITT: Generated 1794 derivative records from 32914 primary records. [2025-09-29T22:10:46.679827] [DEBUG] [LOCAL ] ITT: Saving derivative data. [2025-09-29T22:10:46.700781] [DEBUG] [LOCAL ] ITT: Derivative data saved (1794 records). [2025-09-29T22:10:46.701235] [INFO ] [MAIN ] ITT: Successfully saved derivative data. [2025-09-29T22:10:46.703423] [INFO ] [MAIN ] Derivative Progress: 949/2057 symbols completed. ITT took 1.3s. Estimated remaining: 7m 31s. Rate: 147.4 symbols/min [2025-09-29T22:10:46.703978] [INFO ] [MAIN ] IVR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:46.723534] [DEBUG] [MAIN ] ITUB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:46.727090] [INFO ] [MAIN ] ITUB: Generated 1794 derivative records from 53318 primary records. [2025-09-29T22:10:46.727391] [DEBUG] [LOCAL ] ITUB: Saving derivative data. [2025-09-29T22:10:46.741222] [DEBUG] [MAIN ] ITW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:46.753790] [INFO ] [MAIN ] ITW: Generated 1794 derivative records from 45913 primary records. [2025-09-29T22:10:46.754692] [DEBUG] [LOCAL ] ITW: Saving derivative data. [2025-09-29T22:10:46.773686] [DEBUG] [LOCAL ] ITUB: Derivative data saved (1794 records). [2025-09-29T22:10:46.773844] [INFO ] [MAIN ] ITUB: Successfully saved derivative data. [2025-09-29T22:10:46.787345] [INFO ] [MAIN ] Derivative Progress: 950/2057 symbols completed. ITUB took 1.4s. Estimated remaining: 7m 30s. Rate: 147.5 symbols/min [2025-09-29T22:10:46.787922] [INFO ] [MAIN ] IVT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:46.791856] [DEBUG] [LOCAL ] ITW: Derivative data saved (1794 records). [2025-09-29T22:10:46.791965] [INFO ] [MAIN ] ITW: Successfully saved derivative data. [2025-09-29T22:10:46.794098] [INFO ] [MAIN ] Derivative Progress: 951/2057 symbols completed. ITW took 1.3s. Estimated remaining: 7m 29s. Rate: 147.6 symbols/min [2025-09-29T22:10:46.794470] [INFO ] [MAIN ] IVZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:46.811851] [DEBUG] [LOCAL ] IVR: Loaded 47835 existing records from primary storage. [2025-09-29T22:10:46.812152] [INFO ] [MAIN ] IVR: Loaded 47835 primary data records. [2025-09-29T22:10:46.943756] [DEBUG] [LOCAL ] IVT: Loaded 30671 existing records from primary storage. [2025-09-29T22:10:46.959691] [INFO ] [MAIN ] IVT: Loaded 30671 primary data records. [2025-09-29T22:10:47.318970] [DEBUG] [LOCAL ] IVZ: Loaded 53127 existing records from primary storage. [2025-09-29T22:10:47.377837] [INFO ] [MAIN ] IVZ: Loaded 53127 primary data records. [2025-09-29T22:10:47.849079] [DEBUG] [MAIN ] IVR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:47.850553] [INFO ] [MAIN ] IVR: Generated 1794 derivative records from 47835 primary records. [2025-09-29T22:10:47.850749] [DEBUG] [LOCAL ] IVR: Saving derivative data. [2025-09-29T22:10:47.886186] [DEBUG] [MAIN ] IVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:47.887237] [INFO ] [MAIN ] IVT: Generated 1794 derivative records from 30671 primary records. [2025-09-29T22:10:47.887469] [DEBUG] [LOCAL ] IVT: Saving derivative data. [2025-09-29T22:10:47.885812] [DEBUG] [LOCAL ] IVR: Derivative data saved (1794 records). [2025-09-29T22:10:47.888574] [INFO ] [MAIN ] IVR: Successfully saved derivative data. [2025-09-29T22:10:47.890795] [INFO ] [MAIN ] Derivative Progress: 952/2057 symbols completed. IVR took 1.2s. Estimated remaining: 7m 30s. Rate: 147.4 symbols/min [2025-09-29T22:10:47.891116] [INFO ] [MAIN ] IX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:47.913461] [DEBUG] [LOCAL ] IVT: Derivative data saved (1794 records). [2025-09-29T22:10:47.921508] [INFO ] [MAIN ] IVT: Successfully saved derivative data. [2025-09-29T22:10:47.929408] [INFO ] [MAIN ] Derivative Progress: 953/2057 symbols completed. IVT took 1.1s. Estimated remaining: 7m 29s. Rate: 147.5 symbols/min [2025-09-29T22:10:47.934863] [INFO ] [MAIN ] J: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:47.934744] [DEBUG] [MAIN ] IVZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:47.935723] [INFO ] [MAIN ] IVZ: Generated 1794 derivative records from 53127 primary records. [2025-09-29T22:10:47.936030] [DEBUG] [LOCAL ] IVZ: Saving derivative data. [2025-09-29T22:10:47.959471] [DEBUG] [LOCAL ] IX: Loaded 22541 existing records from primary storage. [2025-09-29T22:10:47.961880] [INFO ] [MAIN ] IX: Loaded 22541 primary data records. [2025-09-29T22:10:47.963026] [DEBUG] [LOCAL ] IVZ: Derivative data saved (1794 records). [2025-09-29T22:10:47.963390] [INFO ] [MAIN ] IVZ: Successfully saved derivative data. [2025-09-29T22:10:47.970637] [INFO ] [MAIN ] Derivative Progress: 954/2057 symbols completed. IVZ took 1.2s. Estimated remaining: 7m 28s. Rate: 147.7 symbols/min [2025-09-29T22:10:47.998291] [INFO ] [MAIN ] JBGS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:48.356456] [DEBUG] [LOCAL ] J: Loaded 40155 existing records from primary storage. [2025-09-29T22:10:48.356623] [INFO ] [MAIN ] J: Loaded 40155 primary data records. [2025-09-29T22:10:48.479749] [DEBUG] [LOCAL ] JBGS: Loaded 42397 existing records from primary storage. [2025-09-29T22:10:48.483599] [INFO ] [MAIN ] JBGS: Loaded 42397 primary data records. [2025-09-29T22:10:49.022111] [DEBUG] [MAIN ] IX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:49.023884] [INFO ] [MAIN ] IX: Generated 1794 derivative records from 22541 primary records. [2025-09-29T22:10:49.024480] [DEBUG] [LOCAL ] IX: Saving derivative data. [2025-09-29T22:10:49.049000] [DEBUG] [LOCAL ] IX: Derivative data saved (1794 records). [2025-09-29T22:10:49.049944] [INFO ] [MAIN ] IX: Successfully saved derivative data. [2025-09-29T22:10:49.052217] [INFO ] [MAIN ] Derivative Progress: 955/2057 symbols completed. IX took 1.2s. Estimated remaining: 7m 29s. Rate: 147.4 symbols/min [2025-09-29T22:10:49.052793] [INFO ] [MAIN ] JBI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:49.066787] [DEBUG] [MAIN ] J: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:49.067954] [INFO ] [MAIN ] J: Generated 1794 derivative records from 40155 primary records. [2025-09-29T22:10:49.068159] [DEBUG] [LOCAL ] J: Saving derivative data. [2025-09-29T22:10:49.089061] [DEBUG] [LOCAL ] J: Derivative data saved (1794 records). [2025-09-29T22:10:49.089326] [INFO ] [MAIN ] J: Successfully saved derivative data. [2025-09-29T22:10:49.091607] [INFO ] [MAIN ] Derivative Progress: 956/2057 symbols completed. J took 1.2s. Estimated remaining: 7m 28s. Rate: 147.5 symbols/min [2025-09-29T22:10:49.104796] [INFO ] [MAIN ] JBL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:49.105849] [DEBUG] [MAIN ] JBGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:49.106804] [INFO ] [MAIN ] JBGS: Generated 1794 derivative records from 42397 primary records. [2025-09-29T22:10:49.106904] [DEBUG] [LOCAL ] JBGS: Saving derivative data. [2025-09-29T22:10:49.147165] [DEBUG] [LOCAL ] JBGS: Derivative data saved (1794 records). [2025-09-29T22:10:49.147462] [INFO ] [MAIN ] JBGS: Successfully saved derivative data. [2025-09-29T22:10:49.150588] [DEBUG] [LOCAL ] JBI: Loaded 43571 existing records from primary storage. [2025-09-29T22:10:49.149780] [INFO ] [MAIN ] Derivative Progress: 957/2057 symbols completed. JBGS took 1.2s. Estimated remaining: 7m 27s. Rate: 147.7 symbols/min [2025-09-29T22:10:49.151054] [INFO ] [MAIN ] JBND: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:49.150943] [INFO ] [MAIN ] JBI: Loaded 43571 primary data records. [2025-09-29T22:10:49.495362] [DEBUG] [LOCAL ] JBL: Loaded 48388 existing records from primary storage. [2025-09-29T22:10:49.504406] [DEBUG] [LOCAL ] JBND: Loaded 25760 existing records from primary storage. [2025-09-29T22:10:49.505314] [INFO ] [MAIN ] JBL: Loaded 48388 primary data records. [2025-09-29T22:10:49.505574] [INFO ] [MAIN ] JBND: Loaded 25760 primary data records. [2025-09-29T22:10:50.304104] [DEBUG] [MAIN ] JBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:50.306869] [INFO ] [MAIN ] JBI: Generated 1794 derivative records from 43571 primary records. [2025-09-29T22:10:50.307527] [DEBUG] [LOCAL ] JBI: Saving derivative data. [2025-09-29T22:10:50.331961] [DEBUG] [LOCAL ] JBI: Derivative data saved (1794 records). [2025-09-29T22:10:50.332239] [INFO ] [MAIN ] JBI: Successfully saved derivative data. [2025-09-29T22:10:50.334681] [INFO ] [MAIN ] Derivative Progress: 958/2057 symbols completed. JBI took 1.3s. Estimated remaining: 7m 27s. Rate: 147.4 symbols/min [2025-09-29T22:10:50.348298] [DEBUG] [MAIN ] JBND: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:10:50.348989] [INFO ] [MAIN ] JBND: Generated 1793 derivative records from 25760 primary records. [2025-09-29T22:10:50.349160] [DEBUG] [LOCAL ] JBND: Saving derivative data. [2025-09-29T22:10:50.379680] [DEBUG] [LOCAL ] JBND: Derivative data saved (1793 records). [2025-09-29T22:10:50.380031] [INFO ] [MAIN ] JBND: Successfully saved derivative data. [2025-09-29T22:10:50.379942] [DEBUG] [MAIN ] JBL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:50.381991] [INFO ] [MAIN ] Derivative Progress: 959/2057 symbols completed. JBND took 1.2s. Estimated remaining: 7m 27s. Rate: 147.5 symbols/min [2025-09-29T22:10:50.382761] [INFO ] [MAIN ] JBL: Generated 1794 derivative records from 48388 primary records. [2025-09-29T22:10:50.383024] [DEBUG] [LOCAL ] JBL: Saving derivative data. [2025-09-29T22:10:50.398762] [DEBUG] [LOCAL ] JBL: Derivative data saved (1794 records). [2025-09-29T22:10:50.398860] [INFO ] [MAIN ] JBL: Successfully saved derivative data. [2025-09-29T22:10:50.401071] [INFO ] [MAIN ] Derivative Progress: 960/2057 symbols completed. JBL took 1.3s. Estimated remaining: 7m 26s. Rate: 147.7 symbols/min [2025-09-29T22:10:50.401486] [INFO ] [MAIN ] JCE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:50.401612] [INFO ] [MAIN ] JCI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:50.401674] [INFO ] [MAIN ] JEF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:50.412303] [DEBUG] [LOCAL ] JCE: Loaded 6576 existing records from primary storage. [2025-09-29T22:10:50.412443] [INFO ] [MAIN ] JCE: Loaded 6576 primary data records. [2025-09-29T22:10:50.783385] [DEBUG] [LOCAL ] JEF: Loaded 49996 existing records from primary storage. [2025-09-29T22:10:50.783811] [INFO ] [MAIN ] JEF: Loaded 49996 primary data records. [2025-09-29T22:10:50.784623] [DEBUG] [LOCAL ] JCI: Loaded 53544 existing records from primary storage. [2025-09-29T22:10:50.790603] [INFO ] [MAIN ] JCI: Loaded 53544 primary data records. [2025-09-29T22:10:51.443701] [DEBUG] [MAIN ] JCE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:51.445616] [INFO ] [MAIN ] JCE: Generated 1794 derivative records from 6576 primary records. [2025-09-29T22:10:51.446562] [DEBUG] [LOCAL ] JCE: Saving derivative data. [2025-09-29T22:10:51.471223] [DEBUG] [LOCAL ] JCE: Derivative data saved (1794 records). [2025-09-29T22:10:51.471383] [INFO ] [MAIN ] JCE: Successfully saved derivative data. [2025-09-29T22:10:51.473944] [INFO ] [MAIN ] Derivative Progress: 961/2057 symbols completed. JCE took 1.1s. Estimated remaining: 7m 26s. Rate: 147.4 symbols/min [2025-09-29T22:10:51.474169] [INFO ] [MAIN ] JELD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:51.511389] [DEBUG] [MAIN ] JCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:51.512938] [INFO ] [MAIN ] JCI: Generated 1794 derivative records from 53544 primary records. [2025-09-29T22:10:51.513076] [DEBUG] [LOCAL ] JCI: Saving derivative data. [2025-09-29T22:10:51.512022] [DEBUG] [MAIN ] JEF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:51.514878] [INFO ] [MAIN ] JEF: Generated 1794 derivative records from 49996 primary records. [2025-09-29T22:10:51.514982] [DEBUG] [LOCAL ] JEF: Saving derivative data. [2025-09-29T22:10:51.544736] [DEBUG] [LOCAL ] JCI: Derivative data saved (1794 records). [2025-09-29T22:10:51.545229] [INFO ] [MAIN ] JCI: Successfully saved derivative data. [2025-09-29T22:10:51.547422] [INFO ] [MAIN ] Derivative Progress: 962/2057 symbols completed. JCI took 1.1s. Estimated remaining: 7m 25s. Rate: 147.5 symbols/min [2025-09-29T22:10:51.547911] [INFO ] [MAIN ] JEQ: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:51.567452] [DEBUG] [LOCAL ] JEF: Derivative data saved (1794 records). [2025-09-29T22:10:51.581049] [INFO ] [MAIN ] JEF: Successfully saved derivative data. [2025-09-29T22:10:51.585586] [DEBUG] [LOCAL ] JEQ: Loaded 8974 existing records from primary storage. [2025-09-29T22:10:51.588161] [INFO ] [MAIN ] Derivative Progress: 963/2057 symbols completed. JEF took 1.2s. Estimated remaining: 7m 24s. Rate: 147.7 symbols/min [2025-09-29T22:10:51.588404] [INFO ] [MAIN ] JFR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:51.588733] [INFO ] [MAIN ] JEQ: Loaded 8974 primary data records. [2025-09-29T22:10:51.589756] [DEBUG] [LOCAL ] JELD: Loaded 46097 existing records from primary storage. [2025-09-29T22:10:51.602424] [INFO ] [MAIN ] JELD: Loaded 46097 primary data records. [2025-09-29T22:10:52.266031] [DEBUG] [LOCAL ] JFR: Loaded 30591 existing records from primary storage. [2025-09-29T22:10:52.266490] [INFO ] [MAIN ] JFR: Loaded 30591 primary data records. [2025-09-29T22:10:52.717261] [DEBUG] [MAIN ] JEQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:52.718839] [INFO ] [MAIN ] JEQ: Generated 1794 derivative records from 8974 primary records. [2025-09-29T22:10:52.717578] [DEBUG] [MAIN ] JELD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:52.719157] [DEBUG] [LOCAL ] JEQ: Saving derivative data. [2025-09-29T22:10:52.721264] [INFO ] [MAIN ] JELD: Generated 1794 derivative records from 46097 primary records. [2025-09-29T22:10:52.721704] [DEBUG] [LOCAL ] JELD: Saving derivative data. [2025-09-29T22:10:52.749981] [DEBUG] [LOCAL ] JEQ: Derivative data saved (1794 records). [2025-09-29T22:10:52.750373] [INFO ] [MAIN ] JEQ: Successfully saved derivative data. [2025-09-29T22:10:52.752569] [INFO ] [MAIN ] Derivative Progress: 964/2057 symbols completed. JEQ took 1.2s. Estimated remaining: 7m 25s. Rate: 147.4 symbols/min [2025-09-29T22:10:52.753416] [INFO ] [MAIN ] JGH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:52.760911] [DEBUG] [LOCAL ] JELD: Derivative data saved (1794 records). [2025-09-29T22:10:52.761392] [INFO ] [MAIN ] JELD: Successfully saved derivative data. [2025-09-29T22:10:52.763725] [INFO ] [MAIN ] Derivative Progress: 965/2057 symbols completed. JELD took 1.3s. Estimated remaining: 7m 24s. Rate: 147.5 symbols/min [2025-09-29T22:10:52.767792] [INFO ] [MAIN ] JHG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:52.778214] [DEBUG] [LOCAL ] JGH: Loaded 10966 existing records from primary storage. [2025-09-29T22:10:52.778826] [INFO ] [MAIN ] JGH: Loaded 10966 primary data records. [2025-09-29T22:10:52.805396] [DEBUG] [MAIN ] JFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:52.834570] [INFO ] [MAIN ] JFR: Generated 1794 derivative records from 30591 primary records. [2025-09-29T22:10:52.843043] [DEBUG] [LOCAL ] JFR: Saving derivative data. [2025-09-29T22:10:52.938625] [DEBUG] [LOCAL ] JFR: Derivative data saved (1794 records). [2025-09-29T22:10:52.969097] [INFO ] [MAIN ] JFR: Successfully saved derivative data. [2025-09-29T22:10:53.025249] [INFO ] [MAIN ] Derivative Progress: 966/2057 symbols completed. JFR took 1.4s. Estimated remaining: 7m 24s. Rate: 147.6 symbols/min [2025-09-29T22:10:53.147631] [INFO ] [MAIN ] JHI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:53.169761] [DEBUG] [LOCAL ] JHG: Loaded 47709 existing records from primary storage. [2025-09-29T22:10:53.170482] [INFO ] [MAIN ] JHG: Loaded 47709 primary data records. [2025-09-29T22:10:53.223849] [DEBUG] [LOCAL ] JHI: Loaded 3586 existing records from primary storage. [2025-09-29T22:10:53.246403] [INFO ] [MAIN ] JHI: Loaded 3586 primary data records. [2025-09-29T22:10:53.844497] [DEBUG] [MAIN ] JGH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:53.845733] [INFO ] [MAIN ] JGH: Generated 1794 derivative records from 10966 primary records. [2025-09-29T22:10:53.845943] [DEBUG] [LOCAL ] JGH: Saving derivative data. [2025-09-29T22:10:53.869597] [DEBUG] [LOCAL ] JGH: Derivative data saved (1794 records). [2025-09-29T22:10:53.870207] [INFO ] [MAIN ] JGH: Successfully saved derivative data. [2025-09-29T22:10:53.872765] [INFO ] [MAIN ] Derivative Progress: 967/2057 symbols completed. JGH took 1.1s. Estimated remaining: 7m 24s. Rate: 147.4 symbols/min [2025-09-29T22:10:53.873522] [INFO ] [MAIN ] JHS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:53.882095] [DEBUG] [LOCAL ] JHS: Loaded 2826 existing records from primary storage. [2025-09-29T22:10:53.895087] [INFO ] [MAIN ] JHS: Loaded 2826 primary data records. [2025-09-29T22:10:53.895503] [DEBUG] [MAIN ] JHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:53.908144] [INFO ] [MAIN ] JHG: Generated 1794 derivative records from 47709 primary records. [2025-09-29T22:10:53.924543] [DEBUG] [LOCAL ] JHG: Saving derivative data. [2025-09-29T22:10:54.054433] [DEBUG] [MAIN ] JHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:54.066049] [INFO ] [MAIN ] JHI: Generated 1794 derivative records from 3586 primary records. [2025-09-29T22:10:54.071760] [DEBUG] [LOCAL ] JHI: Saving derivative data. [2025-09-29T22:10:54.266596] [DEBUG] [LOCAL ] JHG: Derivative data saved (1794 records). [2025-09-29T22:10:54.267696] [INFO ] [MAIN ] JHG: Successfully saved derivative data. [2025-09-29T22:10:54.270251] [INFO ] [MAIN ] Derivative Progress: 968/2057 symbols completed. JHG took 1.5s. Estimated remaining: 7m 23s. Rate: 147.4 symbols/min [2025-09-29T22:10:54.270763] [INFO ] [MAIN ] JHX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:54.273923] [DEBUG] [LOCAL ] JHI: Derivative data saved (1794 records). [2025-09-29T22:10:54.274433] [INFO ] [MAIN ] JHI: Successfully saved derivative data. [2025-09-29T22:10:54.277082] [INFO ] [MAIN ] Derivative Progress: 969/2057 symbols completed. JHI took 1.1s. Estimated remaining: 7m 22s. Rate: 147.6 symbols/min [2025-09-29T22:10:54.277613] [INFO ] [MAIN ] JILL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:54.306826] [DEBUG] [MAIN ] JHS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:54.307623] [INFO ] [MAIN ] JHS: Generated 1794 derivative records from 2826 primary records. [2025-09-29T22:10:54.307732] [DEBUG] [LOCAL ] JHS: Saving derivative data. [2025-09-29T22:10:54.327115] [DEBUG] [LOCAL ] JILL: Loaded 16701 existing records from primary storage. [2025-09-29T22:10:54.328552] [INFO ] [MAIN ] JILL: Loaded 16701 primary data records. [2025-09-29T22:10:54.365580] [DEBUG] [LOCAL ] JHS: Derivative data saved (1794 records). [2025-09-29T22:10:54.404582] [INFO ] [MAIN ] JHS: Successfully saved derivative data. [2025-09-29T22:10:54.439258] [INFO ] [MAIN ] Derivative Progress: 970/2057 symbols completed. JHS took 0.6s. Estimated remaining: 7m 22s. Rate: 147.7 symbols/min [2025-09-29T22:10:54.465223] [INFO ] [MAIN ] JKS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:54.499603] [DEBUG] [LOCAL ] JHX: Loaded 51295 existing records from primary storage. [2025-09-29T22:10:54.500815] [INFO ] [MAIN ] JHX: Loaded 51295 primary data records. [2025-09-29T22:10:55.087840] [DEBUG] [LOCAL ] JKS: Loaded 40106 existing records from primary storage. [2025-09-29T22:10:55.089287] [INFO ] [MAIN ] JKS: Loaded 40106 primary data records. [2025-09-29T22:10:55.449539] [DEBUG] [MAIN ] JILL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:55.451426] [INFO ] [MAIN ] JILL: Generated 1794 derivative records from 16701 primary records. [2025-09-29T22:10:55.451901] [DEBUG] [LOCAL ] JILL: Saving derivative data. [2025-09-29T22:10:55.482347] [DEBUG] [LOCAL ] JILL: Derivative data saved (1794 records). [2025-09-29T22:10:55.482543] [INFO ] [MAIN ] JILL: Successfully saved derivative data. [2025-09-29T22:10:55.484745] [INFO ] [MAIN ] Derivative Progress: 971/2057 symbols completed. JILL took 1.2s. Estimated remaining: 7m 22s. Rate: 147.4 symbols/min [2025-09-29T22:10:55.499464] [INFO ] [MAIN ] JLL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:55.500437] [DEBUG] [MAIN ] JHX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:55.501595] [INFO ] [MAIN ] JHX: Generated 1794 derivative records from 51295 primary records. [2025-09-29T22:10:55.501692] [DEBUG] [LOCAL ] JHX: Saving derivative data. [2025-09-29T22:10:55.522160] [DEBUG] [LOCAL ] JHX: Derivative data saved (1794 records). [2025-09-29T22:10:55.522710] [INFO ] [MAIN ] JHX: Successfully saved derivative data. [2025-09-29T22:10:55.524826] [INFO ] [MAIN ] Derivative Progress: 972/2057 symbols completed. JHX took 1.3s. Estimated remaining: 7m 21s. Rate: 147.6 symbols/min [2025-09-29T22:10:55.525342] [INFO ] [MAIN ] JLS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:55.549520] [DEBUG] [LOCAL ] JLS: Loaded 4105 existing records from primary storage. [2025-09-29T22:10:55.549826] [INFO ] [MAIN ] JLS: Loaded 4105 primary data records. [2025-09-29T22:10:55.598346] [DEBUG] [MAIN ] JKS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:55.625820] [INFO ] [MAIN ] JKS: Generated 1794 derivative records from 40106 primary records. [2025-09-29T22:10:55.686543] [DEBUG] [LOCAL ] JLL: Loaded 31761 existing records from primary storage. [2025-09-29T22:10:55.690427] [DEBUG] [LOCAL ] JKS: Saving derivative data. [2025-09-29T22:10:55.691500] [INFO ] [MAIN ] JLL: Loaded 31761 primary data records. [2025-09-29T22:10:56.047486] [DEBUG] [LOCAL ] JKS: Derivative data saved (1794 records). [2025-09-29T22:10:56.053221] [INFO ] [MAIN ] JKS: Successfully saved derivative data. [2025-09-29T22:10:56.060504] [INFO ] [MAIN ] Derivative Progress: 973/2057 symbols completed. JKS took 1.6s. Estimated remaining: 7m 21s. Rate: 147.5 symbols/min [2025-09-29T22:10:56.300810] [DEBUG] [MAIN ] JLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:56.301567] [INFO ] [MAIN ] JLS: Generated 1794 derivative records from 4105 primary records. [2025-09-29T22:10:56.301906] [DEBUG] [LOCAL ] JLS: Saving derivative data. [2025-09-29T22:10:56.333422] [DEBUG] [LOCAL ] JLS: Derivative data saved (1794 records). [2025-09-29T22:10:56.333901] [INFO ] [MAIN ] JLS: Successfully saved derivative data. [2025-09-29T22:10:56.333818] [DEBUG] [MAIN ] JLL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:56.336018] [INFO ] [MAIN ] Derivative Progress: 974/2057 symbols completed. JLS took 0.8s. Estimated remaining: 7m 20s. Rate: 147.6 symbols/min [2025-09-29T22:10:56.337052] [INFO ] [MAIN ] JLL: Generated 1794 derivative records from 31761 primary records. [2025-09-29T22:10:56.337140] [DEBUG] [LOCAL ] JLL: Saving derivative data. [2025-09-29T22:10:56.353525] [DEBUG] [LOCAL ] JLL: Derivative data saved (1794 records). [2025-09-29T22:10:56.353596] [INFO ] [MAIN ] JLL: Successfully saved derivative data. [2025-09-29T22:10:56.356156] [INFO ] [MAIN ] Derivative Progress: 975/2057 symbols completed. JLL took 0.9s. Estimated remaining: 7m 19s. Rate: 147.7 symbols/min [2025-09-29T22:10:56.356716] [INFO ] [MAIN ] JOBY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:56.356821] [INFO ] [MAIN ] JNJ: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:56.356672] [INFO ] [MAIN ] JMIA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:56.442211] [DEBUG] [LOCAL ] JOBY: Loaded 53799 existing records from primary storage. [2025-09-29T22:10:56.456663] [INFO ] [MAIN ] JOBY: Loaded 53799 primary data records. [2025-09-29T22:10:56.469557] [DEBUG] [LOCAL ] JMIA: Loaded 50591 existing records from primary storage. [2025-09-29T22:10:56.496483] [INFO ] [MAIN ] JMIA: Loaded 50591 primary data records. [2025-09-29T22:10:56.536971] [DEBUG] [LOCAL ] JNJ: Loaded 53753 existing records from primary storage. [2025-09-29T22:10:56.582200] [INFO ] [MAIN ] JNJ: Loaded 53753 primary data records. [2025-09-29T22:10:57.539200] [DEBUG] [MAIN ] JOBY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:57.555089] [DEBUG] [MAIN ] JNJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:57.556369] [INFO ] [MAIN ] JNJ: Generated 1794 derivative records from 53753 primary records. [2025-09-29T22:10:57.561748] [DEBUG] [LOCAL ] JNJ: Saving derivative data. [2025-09-29T22:10:57.554378] [INFO ] [MAIN ] JOBY: Generated 1794 derivative records from 53799 primary records. [2025-09-29T22:10:57.572687] [DEBUG] [LOCAL ] JOBY: Saving derivative data. [2025-09-29T22:10:57.573068] [DEBUG] [MAIN ] JMIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:57.586576] [INFO ] [MAIN ] JMIA: Generated 1794 derivative records from 50591 primary records. [2025-09-29T22:10:57.594359] [DEBUG] [LOCAL ] JMIA: Saving derivative data. [2025-09-29T22:10:57.628998] [DEBUG] [LOCAL ] JMIA: Derivative data saved (1794 records). [2025-09-29T22:10:57.630302] [INFO ] [MAIN ] JMIA: Successfully saved derivative data. [2025-09-29T22:10:57.632997] [INFO ] [MAIN ] Derivative Progress: 976/2057 symbols completed. JMIA took 1.3s. Estimated remaining: 7m 20s. Rate: 147.4 symbols/min [2025-09-29T22:10:57.634568] [INFO ] [MAIN ] JOE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:57.639579] [DEBUG] [LOCAL ] JOBY: Derivative data saved (1794 records). [2025-09-29T22:10:57.640201] [INFO ] [MAIN ] JOBY: Successfully saved derivative data. [2025-09-29T22:10:57.642426] [INFO ] [MAIN ] Derivative Progress: 977/2057 symbols completed. JOBY took 1.3s. Estimated remaining: 7m 19s. Rate: 147.5 symbols/min [2025-09-29T22:10:57.642615] [INFO ] [MAIN ] JOF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:57.640365] [DEBUG] [LOCAL ] JNJ: Derivative data saved (1794 records). [2025-09-29T22:10:57.642930] [INFO ] [MAIN ] JNJ: Successfully saved derivative data. [2025-09-29T22:10:57.645584] [INFO ] [MAIN ] Derivative Progress: 978/2057 symbols completed. JNJ took 1.3s. Estimated remaining: 7m 18s. Rate: 147.7 symbols/min [2025-09-29T22:10:57.645887] [INFO ] [MAIN ] JPC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:57.663565] [DEBUG] [LOCAL ] JOF: Loaded 7056 existing records from primary storage. [2025-09-29T22:10:57.663810] [INFO ] [MAIN ] JOF: Loaded 7056 primary data records. [2025-09-29T22:10:57.749405] [DEBUG] [LOCAL ] JOE: Loaded 24232 existing records from primary storage. [2025-09-29T22:10:57.763527] [INFO ] [MAIN ] JOE: Loaded 24232 primary data records. [2025-09-29T22:10:57.970433] [DEBUG] [LOCAL ] JPC: Loaded 37088 existing records from primary storage. [2025-09-29T22:10:58.117277] [INFO ] [MAIN ] JPC: Loaded 37088 primary data records. [2025-09-29T22:10:58.734283] [DEBUG] [MAIN ] JOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:58.735676] [INFO ] [MAIN ] JOF: Generated 1794 derivative records from 7056 primary records. [2025-09-29T22:10:58.735980] [DEBUG] [LOCAL ] JOF: Saving derivative data. [2025-09-29T22:10:58.765391] [DEBUG] [LOCAL ] JOF: Derivative data saved (1794 records). [2025-09-29T22:10:58.765589] [INFO ] [MAIN ] JOF: Successfully saved derivative data. [2025-09-29T22:10:58.766053] [DEBUG] [MAIN ] JOE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:58.769043] [INFO ] [MAIN ] JOE: Generated 1794 derivative records from 24232 primary records. [2025-09-29T22:10:58.769155] [DEBUG] [LOCAL ] JOE: Saving derivative data. [2025-09-29T22:10:58.768103] [INFO ] [MAIN ] Derivative Progress: 979/2057 symbols completed. JOF took 1.1s. Estimated remaining: 7m 19s. Rate: 147.4 symbols/min [2025-09-29T22:10:58.770667] [INFO ] [MAIN ] JPM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:58.789859] [DEBUG] [LOCAL ] JOE: Derivative data saved (1794 records). [2025-09-29T22:10:58.790039] [INFO ] [MAIN ] JOE: Successfully saved derivative data. [2025-09-29T22:10:58.792085] [INFO ] [MAIN ] Derivative Progress: 980/2057 symbols completed. JOE took 1.2s. Estimated remaining: 7m 18s. Rate: 147.6 symbols/min [2025-09-29T22:10:58.792336] [INFO ] [MAIN ] JQC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:58.809953] [DEBUG] [MAIN ] JPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:58.810933] [INFO ] [MAIN ] JPC: Generated 1794 derivative records from 37088 primary records. [2025-09-29T22:10:58.811097] [DEBUG] [LOCAL ] JPC: Saving derivative data. [2025-09-29T22:10:58.829126] [DEBUG] [LOCAL ] JPC: Derivative data saved (1794 records). [2025-09-29T22:10:58.829339] [INFO ] [MAIN ] JPC: Successfully saved derivative data. [2025-09-29T22:10:58.831539] [INFO ] [MAIN ] Derivative Progress: 981/2057 symbols completed. JPC took 1.2s. Estimated remaining: 7m 17s. Rate: 147.7 symbols/min [2025-09-29T22:10:58.841542] [INFO ] [MAIN ] JRI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:58.874422] [DEBUG] [LOCAL ] JQC: Loaded 33913 existing records from primary storage. [2025-09-29T22:10:58.875416] [INFO ] [MAIN ] JQC: Loaded 33913 primary data records. [2025-09-29T22:10:58.941108] [DEBUG] [LOCAL ] JPM: Loaded 53794 existing records from primary storage. [2025-09-29T22:10:58.976154] [INFO ] [MAIN ] JPM: Loaded 53794 primary data records. [2025-09-29T22:10:58.984680] [DEBUG] [LOCAL ] JRI: Loaded 14768 existing records from primary storage. [2025-09-29T22:10:59.011341] [INFO ] [MAIN ] JRI: Loaded 14768 primary data records. [2025-09-29T22:10:59.895103] [DEBUG] [MAIN ] JQC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:59.896048] [INFO ] [MAIN ] JQC: Generated 1794 derivative records from 33913 primary records. [2025-09-29T22:10:59.896362] [DEBUG] [LOCAL ] JQC: Saving derivative data. [2025-09-29T22:10:59.909937] [DEBUG] [MAIN ] JPM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:59.911001] [INFO ] [MAIN ] JPM: Generated 1794 derivative records from 53794 primary records. [2025-09-29T22:10:59.917935] [DEBUG] [LOCAL ] JPM: Saving derivative data. [2025-09-29T22:10:59.954416] [DEBUG] [MAIN ] JRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:10:59.956972] [INFO ] [MAIN ] JRI: Generated 1794 derivative records from 14768 primary records. [2025-09-29T22:10:59.957579] [DEBUG] [LOCAL ] JRI: Saving derivative data. [2025-09-29T22:10:59.960181] [DEBUG] [LOCAL ] JQC: Derivative data saved (1794 records). [2025-09-29T22:10:59.960745] [INFO ] [MAIN ] JQC: Successfully saved derivative data. [2025-09-29T22:10:59.961764] [DEBUG] [LOCAL ] JPM: Derivative data saved (1794 records). [2025-09-29T22:10:59.969672] [INFO ] [MAIN ] JPM: Successfully saved derivative data. [2025-09-29T22:10:59.971708] [INFO ] [MAIN ] Derivative Progress: 982/2057 symbols completed. JQC took 1.2s. Estimated remaining: 7m 17s. Rate: 147.4 symbols/min [2025-09-29T22:10:59.977962] [INFO ] [MAIN ] JRS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:59.978023] [INFO ] [MAIN ] Derivative Progress: 983/2057 symbols completed. JPM took 1.2s. Estimated remaining: 7m 17s. Rate: 147.6 symbols/min [2025-09-29T22:10:59.978186] [INFO ] [MAIN ] JXN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:59.984422] [DEBUG] [LOCAL ] JRI: Derivative data saved (1794 records). [2025-09-29T22:10:59.984512] [INFO ] [MAIN ] JRI: Successfully saved derivative data. [2025-09-29T22:10:59.986862] [INFO ] [MAIN ] Derivative Progress: 984/2057 symbols completed. JRI took 1.1s. Estimated remaining: 7m 16s. Rate: 147.7 symbols/min [2025-09-29T22:10:59.987111] [INFO ] [MAIN ] K: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:10:59.997269] [DEBUG] [LOCAL ] JRS: Loaded 11178 existing records from primary storage. [2025-09-29T22:10:59.997478] [INFO ] [MAIN ] JRS: Loaded 11178 primary data records. [2025-09-29T22:11:00.354981] [DEBUG] [LOCAL ] JXN: Loaded 45731 existing records from primary storage. [2025-09-29T22:11:00.355187] [INFO ] [MAIN ] JXN: Loaded 45731 primary data records. [2025-09-29T22:11:00.485567] [DEBUG] [LOCAL ] K: Loaded 49924 existing records from primary storage. [2025-09-29T22:11:00.527665] [INFO ] [MAIN ] K: Loaded 49924 primary data records. [2025-09-29T22:11:01.085926] [DEBUG] [MAIN ] JRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:01.087244] [INFO ] [MAIN ] JRS: Generated 1794 derivative records from 11178 primary records. [2025-09-29T22:11:01.087852] [DEBUG] [LOCAL ] JRS: Saving derivative data. [2025-09-29T22:11:01.137475] [DEBUG] [MAIN ] JXN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:01.140944] [DEBUG] [LOCAL ] JRS: Derivative data saved (1794 records). [2025-09-29T22:11:01.140835] [INFO ] [MAIN ] JXN: Generated 1794 derivative records from 45731 primary records. [2025-09-29T22:11:01.141213] [INFO ] [MAIN ] JRS: Successfully saved derivative data. [2025-09-29T22:11:01.141831] [DEBUG] [LOCAL ] JXN: Saving derivative data. [2025-09-29T22:11:01.145708] [INFO ] [MAIN ] Derivative Progress: 985/2057 symbols completed. JRS took 1.2s. Estimated remaining: 7m 16s. Rate: 147.4 symbols/min [2025-09-29T22:11:01.146295] [INFO ] [MAIN ] KAI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:01.176624] [DEBUG] [LOCAL ] JXN: Derivative data saved (1794 records). [2025-09-29T22:11:01.190401] [DEBUG] [MAIN ] K: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:01.190564] [INFO ] [MAIN ] JXN: Successfully saved derivative data. [2025-09-29T22:11:01.197738] [INFO ] [MAIN ] K: Generated 1794 derivative records from 49924 primary records. [2025-09-29T22:11:01.201736] [INFO ] [MAIN ] Derivative Progress: 986/2057 symbols completed. JXN took 1.2s. Estimated remaining: 7m 15s. Rate: 147.6 symbols/min [2025-09-29T22:11:01.203175] [DEBUG] [LOCAL ] K: Saving derivative data. [2025-09-29T22:11:01.203047] [INFO ] [MAIN ] KAR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:01.202839] [DEBUG] [LOCAL ] KAI: Loaded 13338 existing records from primary storage. [2025-09-29T22:11:01.204208] [INFO ] [MAIN ] KAI: Loaded 13338 primary data records. [2025-09-29T22:11:01.399784] [DEBUG] [LOCAL ] K: Derivative data saved (1794 records). [2025-09-29T22:11:01.432315] [INFO ] [MAIN ] K: Successfully saved derivative data. [2025-09-29T22:11:01.442716] [INFO ] [MAIN ] Derivative Progress: 987/2057 symbols completed. K took 1.5s. Estimated remaining: 7m 15s. Rate: 147.6 symbols/min [2025-09-29T22:11:01.443121] [INFO ] [MAIN ] KB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:01.486093] [DEBUG] [LOCAL ] KAR: Loaded 39817 existing records from primary storage. [2025-09-29T22:11:01.510462] [INFO ] [MAIN ] KAR: Loaded 39817 primary data records. [2025-09-29T22:11:01.776806] [DEBUG] [LOCAL ] KB: Loaded 24026 existing records from primary storage. [2025-09-29T22:11:01.777187] [INFO ] [MAIN ] KB: Loaded 24026 primary data records. [2025-09-29T22:11:02.651613] [DEBUG] [MAIN ] KAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:02.653864] [INFO ] [MAIN ] KAI: Generated 1794 derivative records from 13338 primary records. [2025-09-29T22:11:02.654613] [DEBUG] [LOCAL ] KAI: Saving derivative data. [2025-09-29T22:11:02.680993] [DEBUG] [LOCAL ] KAI: Derivative data saved (1794 records). [2025-09-29T22:11:02.691201] [INFO ] [MAIN ] KAI: Successfully saved derivative data. [2025-09-29T22:11:02.700297] [INFO ] [MAIN ] Derivative Progress: 988/2057 symbols completed. KAI took 1.6s. Estimated remaining: 7m 15s. Rate: 147.3 symbols/min [2025-09-29T22:11:02.700948] [DEBUG] [MAIN ] KAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:02.702604] [INFO ] [MAIN ] KAR: Generated 1794 derivative records from 39817 primary records. [2025-09-29T22:11:02.703343] [DEBUG] [LOCAL ] KAR: Saving derivative data. [2025-09-29T22:11:02.739309] [DEBUG] [MAIN ] KB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:02.740628] [INFO ] [MAIN ] KB: Generated 1794 derivative records from 24026 primary records. [2025-09-29T22:11:02.741223] [DEBUG] [LOCAL ] KB: Saving derivative data. [2025-09-29T22:11:02.751033] [DEBUG] [LOCAL ] KAR: Derivative data saved (1794 records). [2025-09-29T22:11:02.755511] [INFO ] [MAIN ] KAR: Successfully saved derivative data. [2025-09-29T22:11:02.757773] [INFO ] [MAIN ] Derivative Progress: 989/2057 symbols completed. KAR took 1.6s. Estimated remaining: 7m 15s. Rate: 147.5 symbols/min [2025-09-29T22:11:02.763225] [DEBUG] [LOCAL ] KB: Derivative data saved (1794 records). [2025-09-29T22:11:02.763386] [INFO ] [MAIN ] KB: Successfully saved derivative data. [2025-09-29T22:11:02.766322] [INFO ] [MAIN ] Derivative Progress: 990/2057 symbols completed. KB took 1.3s. Estimated remaining: 7m 14s. Rate: 147.6 symbols/min [2025-09-29T22:11:02.767071] [INFO ] [MAIN ] KBH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:02.766940] [INFO ] [MAIN ] KBDC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:02.767369] [INFO ] [MAIN ] KD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:02.793701] [DEBUG] [LOCAL ] KBDC: Loaded 20926 existing records from primary storage. [2025-09-29T22:11:02.793847] [INFO ] [MAIN ] KBDC: Loaded 20926 primary data records. [2025-09-29T22:11:02.974065] [DEBUG] [LOCAL ] KBH: Loaded 48938 existing records from primary storage. [2025-09-29T22:11:03.007973] [INFO ] [MAIN ] KBH: Loaded 48938 primary data records. [2025-09-29T22:11:03.267636] [DEBUG] [LOCAL ] KD: Loaded 52300 existing records from primary storage. [2025-09-29T22:11:03.286144] [INFO ] [MAIN ] KD: Loaded 52300 primary data records. [2025-09-29T22:11:03.876617] [DEBUG] [MAIN ] KBDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:03.878358] [INFO ] [MAIN ] KBDC: Generated 1794 derivative records from 20926 primary records. [2025-09-29T22:11:03.878731] [DEBUG] [LOCAL ] KBDC: Saving derivative data. [2025-09-29T22:11:03.898273] [DEBUG] [LOCAL ] KBDC: Derivative data saved (1794 records). [2025-09-29T22:11:03.899124] [INFO ] [MAIN ] KBDC: Successfully saved derivative data. [2025-09-29T22:11:03.901542] [INFO ] [MAIN ] Derivative Progress: 991/2057 symbols completed. KBDC took 1.1s. Estimated remaining: 7m 14s. Rate: 147.3 symbols/min [2025-09-29T22:11:03.902729] [INFO ] [MAIN ] KEN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:03.920432] [DEBUG] [LOCAL ] KEN: Loaded 4731 existing records from primary storage. [2025-09-29T22:11:03.926967] [DEBUG] [MAIN ] KBH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:03.927119] [INFO ] [MAIN ] KEN: Loaded 4731 primary data records. [2025-09-29T22:11:03.933813] [INFO ] [MAIN ] KBH: Generated 1794 derivative records from 48938 primary records. [2025-09-29T22:11:03.953217] [DEBUG] [LOCAL ] KBH: Saving derivative data. [2025-09-29T22:11:04.088423] [DEBUG] [LOCAL ] KBH: Derivative data saved (1794 records). [2025-09-29T22:11:04.109367] [INFO ] [MAIN ] KBH: Successfully saved derivative data. [2025-09-29T22:11:04.116548] [INFO ] [MAIN ] Derivative Progress: 992/2057 symbols completed. KBH took 1.3s. Estimated remaining: 7m 14s. Rate: 147.4 symbols/min [2025-09-29T22:11:04.116759] [INFO ] [MAIN ] KEP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:04.109283] [DEBUG] [MAIN ] KD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:04.123325] [INFO ] [MAIN ] KD: Generated 1794 derivative records from 52300 primary records. [2025-09-29T22:11:04.123581] [DEBUG] [LOCAL ] KD: Saving derivative data. [2025-09-29T22:11:04.327994] [DEBUG] [LOCAL ] KD: Derivative data saved (1794 records). [2025-09-29T22:11:04.328168] [INFO ] [MAIN ] KD: Successfully saved derivative data. [2025-09-29T22:11:04.330562] [INFO ] [MAIN ] Derivative Progress: 993/2057 symbols completed. KD took 1.6s. Estimated remaining: 7m 13s. Rate: 147.5 symbols/min [2025-09-29T22:11:04.331410] [INFO ] [MAIN ] KEX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:04.344420] [DEBUG] [LOCAL ] KEP: Loaded 30817 existing records from primary storage. [2025-09-29T22:11:04.345034] [INFO ] [MAIN ] KEP: Loaded 30817 primary data records. [2025-09-29T22:11:04.544671] [DEBUG] [MAIN ] KEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:04.690202] [INFO ] [MAIN ] KEN: Generated 1794 derivative records from 4731 primary records. [2025-09-29T22:11:04.699567] [DEBUG] [LOCAL ] KEN: Saving derivative data. [2025-09-29T22:11:04.713930] [DEBUG] [LOCAL ] KEX: Loaded 38072 existing records from primary storage. [2025-09-29T22:11:04.714470] [INFO ] [MAIN ] KEX: Loaded 38072 primary data records. [2025-09-29T22:11:04.807852] [DEBUG] [LOCAL ] KEN: Derivative data saved (1794 records). [2025-09-29T22:11:04.821053] [INFO ] [MAIN ] KEN: Successfully saved derivative data. [2025-09-29T22:11:04.835462] [INFO ] [MAIN ] Derivative Progress: 994/2057 symbols completed. KEN took 0.9s. Estimated remaining: 7m 13s. Rate: 147.4 symbols/min [2025-09-29T22:11:04.843767] [INFO ] [MAIN ] KEYS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:05.100093] [DEBUG] [MAIN ] KEP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:05.101402] [INFO ] [MAIN ] KEP: Generated 1794 derivative records from 30817 primary records. [2025-09-29T22:11:05.101785] [DEBUG] [LOCAL ] KEP: Saving derivative data. [2025-09-29T22:11:05.133691] [DEBUG] [LOCAL ] KEYS: Loaded 43195 existing records from primary storage. [2025-09-29T22:11:05.135288] [INFO ] [MAIN ] KEYS: Loaded 43195 primary data records. [2025-09-29T22:11:05.149458] [DEBUG] [LOCAL ] KEP: Derivative data saved (1794 records). [2025-09-29T22:11:05.207203] [INFO ] [MAIN ] KEP: Successfully saved derivative data. [2025-09-29T22:11:05.227851] [INFO ] [MAIN ] Derivative Progress: 995/2057 symbols completed. KEP took 1.1s. Estimated remaining: 7m 12s. Rate: 147.4 symbols/min [2025-09-29T22:11:05.239726] [INFO ] [MAIN ] KF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:05.306767] [DEBUG] [MAIN ] KEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:05.324935] [INFO ] [MAIN ] KEX: Generated 1794 derivative records from 38072 primary records. [2025-09-29T22:11:05.347713] [DEBUG] [LOCAL ] KEX: Saving derivative data. [2025-09-29T22:11:05.531249] [DEBUG] [LOCAL ] KF: Loaded 2467 existing records from primary storage. [2025-09-29T22:11:05.533290] [INFO ] [MAIN ] KF: Loaded 2467 primary data records. [2025-09-29T22:11:05.638055] [DEBUG] [LOCAL ] KEX: Derivative data saved (1794 records). [2025-09-29T22:11:05.657496] [INFO ] [MAIN ] KEX: Successfully saved derivative data. [2025-09-29T22:11:05.664365] [INFO ] [MAIN ] Derivative Progress: 996/2057 symbols completed. KEX took 1.3s. Estimated remaining: 7m 12s. Rate: 147.4 symbols/min [2025-09-29T22:11:05.665304] [INFO ] [MAIN ] KFRC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:05.897463] [DEBUG] [LOCAL ] KFRC: Loaded 19512 existing records from primary storage. [2025-09-29T22:11:05.899269] [INFO ] [MAIN ] KFRC: Loaded 19512 primary data records. [2025-09-29T22:11:05.984881] [DEBUG] [MAIN ] KEYS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:06.009190] [INFO ] [MAIN ] KEYS: Generated 1794 derivative records from 43195 primary records. [2025-09-29T22:11:06.021040] [DEBUG] [LOCAL ] KEYS: Saving derivative data. [2025-09-29T22:11:06.242974] [DEBUG] [LOCAL ] KEYS: Derivative data saved (1794 records). [2025-09-29T22:11:06.243400] [INFO ] [MAIN ] KEYS: Successfully saved derivative data. [2025-09-29T22:11:06.245629] [INFO ] [MAIN ] Derivative Progress: 997/2057 symbols completed. KEYS took 1.4s. Estimated remaining: 7m 12s. Rate: 147.4 symbols/min [2025-09-29T22:11:06.247511] [INFO ] [MAIN ] KFS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:06.270131] [DEBUG] [MAIN ] KF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:06.271089] [INFO ] [MAIN ] KF: Generated 1794 derivative records from 2467 primary records. [2025-09-29T22:11:06.271195] [DEBUG] [LOCAL ] KF: Saving derivative data. [2025-09-29T22:11:06.287565] [DEBUG] [LOCAL ] KFS: Loaded 8440 existing records from primary storage. [2025-09-29T22:11:06.289831] [INFO ] [MAIN ] KFS: Loaded 8440 primary data records. [2025-09-29T22:11:06.373842] [DEBUG] [LOCAL ] KF: Derivative data saved (1794 records). [2025-09-29T22:11:06.391038] [INFO ] [MAIN ] KF: Successfully saved derivative data. [2025-09-29T22:11:06.401441] [INFO ] [MAIN ] Derivative Progress: 998/2057 symbols completed. KF took 1.2s. Estimated remaining: 7m 11s. Rate: 147.5 symbols/min [2025-09-29T22:11:06.401721] [INFO ] [MAIN ] KFY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:06.616350] [DEBUG] [MAIN ] KFRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:06.644226] [INFO ] [MAIN ] KFRC: Generated 1794 derivative records from 19512 primary records. [2025-09-29T22:11:06.644676] [DEBUG] [LOCAL ] KFRC: Saving derivative data. [2025-09-29T22:11:06.675927] [DEBUG] [LOCAL ] KFY: Loaded 30178 existing records from primary storage. [2025-09-29T22:11:06.676245] [INFO ] [MAIN ] KFY: Loaded 30178 primary data records. [2025-09-29T22:11:06.699416] [DEBUG] [LOCAL ] KFRC: Derivative data saved (1794 records). [2025-09-29T22:11:06.741212] [INFO ] [MAIN ] KFRC: Successfully saved derivative data. [2025-09-29T22:11:06.806760] [DEBUG] [MAIN ] KFS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:06.770438] [INFO ] [MAIN ] Derivative Progress: 999/2057 symbols completed. KFRC took 1.1s. Estimated remaining: 7m 10s. Rate: 147.5 symbols/min [2025-09-29T22:11:06.823078] [INFO ] [MAIN ] KGC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:06.824004] [INFO ] [MAIN ] KFS: Generated 1794 derivative records from 8440 primary records. [2025-09-29T22:11:06.851531] [DEBUG] [LOCAL ] KFS: Saving derivative data. [2025-09-29T22:11:07.060960] [DEBUG] [LOCAL ] KFS: Derivative data saved (1794 records). [2025-09-29T22:11:07.061161] [INFO ] [MAIN ] KFS: Successfully saved derivative data. [2025-09-29T22:11:07.063670] [INFO ] [MAIN ] Derivative Progress: 1000/2057 symbols completed. KFS took 0.8s. Estimated remaining: 7m 10s. Rate: 147.5 symbols/min [2025-09-29T22:11:07.064330] [INFO ] [MAIN ] KGS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:07.099553] [DEBUG] [MAIN ] KFY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:07.100416] [INFO ] [MAIN ] KFY: Generated 1794 derivative records from 30178 primary records. [2025-09-29T22:11:07.100678] [DEBUG] [LOCAL ] KFY: Saving derivative data. [2025-09-29T22:11:07.131507] [DEBUG] [LOCAL ] KGC: Loaded 53699 existing records from primary storage. [2025-09-29T22:11:07.132175] [INFO ] [MAIN ] KGC: Loaded 53699 primary data records. [2025-09-29T22:11:07.235980] [DEBUG] [LOCAL ] KFY: Derivative data saved (1794 records). [2025-09-29T22:11:07.261552] [INFO ] [MAIN ] KFY: Successfully saved derivative data. [2025-09-29T22:11:07.264081] [INFO ] [MAIN ] Derivative Progress: 1001/2057 symbols completed. KFY took 0.9s. Estimated remaining: 7m 9s. Rate: 147.6 symbols/min [2025-09-29T22:11:07.264969] [INFO ] [MAIN ] KIM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:07.363996] [DEBUG] [LOCAL ] KGS: Loaded 45714 existing records from primary storage. [2025-09-29T22:11:07.371774] [INFO ] [MAIN ] KGS: Loaded 45714 primary data records. [2025-09-29T22:11:07.911062] [DEBUG] [LOCAL ] KIM: Loaded 53047 existing records from primary storage. [2025-09-29T22:11:07.912101] [INFO ] [MAIN ] KIM: Loaded 53047 primary data records. [2025-09-29T22:11:08.021414] [DEBUG] [MAIN ] KGC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:08.042061] [INFO ] [MAIN ] KGC: Generated 1794 derivative records from 53699 primary records. [2025-09-29T22:11:08.048325] [DEBUG] [LOCAL ] KGC: Saving derivative data. [2025-09-29T22:11:08.277708] [DEBUG] [LOCAL ] KGC: Derivative data saved (1794 records). [2025-09-29T22:11:08.278578] [INFO ] [MAIN ] KGC: Successfully saved derivative data. [2025-09-29T22:11:08.280865] [INFO ] [MAIN ] Derivative Progress: 1002/2057 symbols completed. KGC took 1.5s. Estimated remaining: 7m 10s. Rate: 147.4 symbols/min [2025-09-29T22:11:08.281170] [INFO ] [MAIN ] KIO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:08.296840] [DEBUG] [MAIN ] KGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:08.298528] [INFO ] [MAIN ] KGS: Generated 1794 derivative records from 45714 primary records. [2025-09-29T22:11:08.298777] [DEBUG] [LOCAL ] KGS: Saving derivative data. [2025-09-29T22:11:08.323814] [DEBUG] [LOCAL ] KGS: Derivative data saved (1794 records). [2025-09-29T22:11:08.324423] [INFO ] [MAIN ] KGS: Successfully saved derivative data. [2025-09-29T22:11:08.326881] [INFO ] [MAIN ] Derivative Progress: 1003/2057 symbols completed. KGS took 1.3s. Estimated remaining: 7m 9s. Rate: 147.5 symbols/min [2025-09-29T22:11:08.335774] [DEBUG] [LOCAL ] KIO: Loaded 21347 existing records from primary storage. [2025-09-29T22:11:08.335914] [INFO ] [MAIN ] KIO: Loaded 21347 primary data records. [2025-09-29T22:11:08.505822] [DEBUG] [MAIN ] KIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:08.520461] [INFO ] [MAIN ] KIM: Generated 1794 derivative records from 53047 primary records. [2025-09-29T22:11:08.539193] [DEBUG] [LOCAL ] KIM: Saving derivative data. [2025-09-29T22:11:08.688849] [DEBUG] [LOCAL ] KIM: Derivative data saved (1794 records). [2025-09-29T22:11:08.688996] [INFO ] [MAIN ] KIM: Successfully saved derivative data. [2025-09-29T22:11:08.691186] [INFO ] [MAIN ] Derivative Progress: 1004/2057 symbols completed. KIM took 1.4s. Estimated remaining: 7m 8s. Rate: 147.5 symbols/min [2025-09-29T22:11:08.713423] [DEBUG] [MAIN ] KIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:08.714258] [INFO ] [MAIN ] KIO: Generated 1794 derivative records from 21347 primary records. [2025-09-29T22:11:08.714344] [DEBUG] [LOCAL ] KIO: Saving derivative data. [2025-09-29T22:11:08.732550] [DEBUG] [LOCAL ] KIO: Derivative data saved (1794 records). [2025-09-29T22:11:08.732695] [INFO ] [MAIN ] KIO: Successfully saved derivative data. [2025-09-29T22:11:08.734902] [INFO ] [MAIN ] Derivative Progress: 1005/2057 symbols completed. KIO took 0.5s. Estimated remaining: 7m 8s. Rate: 147.6 symbols/min [2025-09-29T22:11:08.735682] [INFO ] [MAIN ] KKRS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:08.735592] [INFO ] [MAIN ] KKR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:08.735808] [INFO ] [MAIN ] KLC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:08.746611] [DEBUG] [LOCAL ] KKRS: Loaded 5769 existing records from primary storage. [2025-09-29T22:11:08.746781] [INFO ] [MAIN ] KKRS: Loaded 5769 primary data records. [2025-09-29T22:11:09.120403] [DEBUG] [LOCAL ] KLC: Loaded 36594 existing records from primary storage. [2025-09-29T22:11:09.120705] [INFO ] [MAIN ] KLC: Loaded 36594 primary data records. [2025-09-29T22:11:09.177594] [DEBUG] [LOCAL ] KKR: Loaded 53500 existing records from primary storage. [2025-09-29T22:11:09.192013] [INFO ] [MAIN ] KKR: Loaded 53500 primary data records. [2025-09-29T22:11:09.880052] [DEBUG] [MAIN ] KKRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:09.882482] [INFO ] [MAIN ] KKRS: Generated 1794 derivative records from 5769 primary records. [2025-09-29T22:11:09.884381] [DEBUG] [LOCAL ] KKRS: Saving derivative data. [2025-09-29T22:11:09.912083] [DEBUG] [MAIN ] KLC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:09.914171] [INFO ] [MAIN ] KLC: Generated 1794 derivative records from 36594 primary records. [2025-09-29T22:11:09.914803] [DEBUG] [LOCAL ] KLC: Saving derivative data. [2025-09-29T22:11:09.933338] [DEBUG] [LOCAL ] KKRS: Derivative data saved (1794 records). [2025-09-29T22:11:09.934466] [INFO ] [MAIN ] KKRS: Successfully saved derivative data. [2025-09-29T22:11:09.937603] [INFO ] [MAIN ] Derivative Progress: 1006/2057 symbols completed. KKRS took 1.2s. Estimated remaining: 7m 8s. Rate: 147.4 symbols/min [2025-09-29T22:11:09.938233] [INFO ] [MAIN ] KMI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:09.940043] [DEBUG] [LOCAL ] KLC: Derivative data saved (1794 records). [2025-09-29T22:11:09.940259] [INFO ] [MAIN ] KLC: Successfully saved derivative data. [2025-09-29T22:11:09.942770] [INFO ] [MAIN ] Derivative Progress: 1007/2057 symbols completed. KLC took 1.2s. Estimated remaining: 7m 7s. Rate: 147.5 symbols/min [2025-09-29T22:11:09.943149] [INFO ] [MAIN ] KMPB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:09.959309] [DEBUG] [LOCAL ] KMPB: Loaded 3626 existing records from primary storage. [2025-09-29T22:11:09.964969] [INFO ] [MAIN ] KMPB: Loaded 3626 primary data records. [2025-09-29T22:11:09.964827] [DEBUG] [MAIN ] KKR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:09.989096] [INFO ] [MAIN ] KKR: Generated 1794 derivative records from 53500 primary records. [2025-09-29T22:11:10.012917] [DEBUG] [LOCAL ] KKR: Saving derivative data. [2025-09-29T22:11:10.318668] [DEBUG] [LOCAL ] KKR: Derivative data saved (1794 records). [2025-09-29T22:11:10.334135] [INFO ] [MAIN ] KKR: Successfully saved derivative data. [2025-09-29T22:11:10.336528] [INFO ] [MAIN ] Derivative Progress: 1008/2057 symbols completed. KKR took 1.6s. Estimated remaining: 7m 7s. Rate: 147.5 symbols/min [2025-09-29T22:11:10.336891] [INFO ] [MAIN ] KMPR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:10.338936] [DEBUG] [LOCAL ] KMI: Loaded 53693 existing records from primary storage. [2025-09-29T22:11:10.339104] [INFO ] [MAIN ] KMI: Loaded 53693 primary data records. [2025-09-29T22:11:10.697193] [DEBUG] [LOCAL ] KMPR: Loaded 38685 existing records from primary storage. [2025-09-29T22:11:10.697420] [INFO ] [MAIN ] KMPR: Loaded 38685 primary data records. [2025-09-29T22:11:10.857717] [DEBUG] [MAIN ] KMPB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:10.896767] [INFO ] [MAIN ] KMPB: Generated 1794 derivative records from 3626 primary records. [2025-09-29T22:11:10.906626] [DEBUG] [LOCAL ] KMPB: Saving derivative data. [2025-09-29T22:11:11.081204] [DEBUG] [LOCAL ] KMPB: Derivative data saved (1794 records). [2025-09-29T22:11:11.084444] [INFO ] [MAIN ] KMPB: Successfully saved derivative data. [2025-09-29T22:11:11.089332] [INFO ] [MAIN ] Derivative Progress: 1009/2057 symbols completed. KMPB took 1.1s. Estimated remaining: 7m 7s. Rate: 147.4 symbols/min [2025-09-29T22:11:11.089679] [INFO ] [MAIN ] KMT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:11.106760] [DEBUG] [MAIN ] KMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:11.108957] [INFO ] [MAIN ] KMI: Generated 1794 derivative records from 53693 primary records. [2025-09-29T22:11:11.109458] [DEBUG] [LOCAL ] KMI: Saving derivative data. [2025-09-29T22:11:11.134636] [DEBUG] [LOCAL ] KMI: Derivative data saved (1794 records). [2025-09-29T22:11:11.149586] [INFO ] [MAIN ] KMI: Successfully saved derivative data. [2025-09-29T22:11:11.151952] [INFO ] [MAIN ] Derivative Progress: 1010/2057 symbols completed. KMI took 1.2s. Estimated remaining: 7m 6s. Rate: 147.5 symbols/min [2025-09-29T22:11:11.152596] [INFO ] [MAIN ] KMX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:11.152475] [DEBUG] [MAIN ] KMPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:11.165412] [INFO ] [MAIN ] KMPR: Generated 1794 derivative records from 38685 primary records. [2025-09-29T22:11:11.165786] [DEBUG] [LOCAL ] KMPR: Saving derivative data. [2025-09-29T22:11:11.198939] [DEBUG] [LOCAL ] KMT: Loaded 42985 existing records from primary storage. [2025-09-29T22:11:11.198151] [DEBUG] [LOCAL ] KMPR: Derivative data saved (1794 records). [2025-09-29T22:11:11.199166] [INFO ] [MAIN ] KMT: Loaded 42985 primary data records. [2025-09-29T22:11:11.199323] [INFO ] [MAIN ] KMPR: Successfully saved derivative data. [2025-09-29T22:11:11.201776] [INFO ] [MAIN ] Derivative Progress: 1011/2057 symbols completed. KMPR took 0.9s. Estimated remaining: 7m 5s. Rate: 147.6 symbols/min [2025-09-29T22:11:11.223397] [INFO ] [MAIN ] KN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:11.554465] [DEBUG] [LOCAL ] KMX: Loaded 53147 existing records from primary storage. [2025-09-29T22:11:11.564676] [INFO ] [MAIN ] KMX: Loaded 53147 primary data records. [2025-09-29T22:11:11.700007] [DEBUG] [LOCAL ] KN: Loaded 38615 existing records from primary storage. [2025-09-29T22:11:11.717059] [INFO ] [MAIN ] KN: Loaded 38615 primary data records. [2025-09-29T22:11:12.238539] [DEBUG] [MAIN ] KMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:12.363279] [INFO ] [MAIN ] KMT: Generated 1794 derivative records from 42985 primary records. [2025-09-29T22:11:12.363773] [DEBUG] [LOCAL ] KMT: Saving derivative data. [2025-09-29T22:11:12.385696] [DEBUG] [LOCAL ] KMT: Derivative data saved (1794 records). [2025-09-29T22:11:12.385834] [INFO ] [MAIN ] KMT: Successfully saved derivative data. [2025-09-29T22:11:12.388144] [INFO ] [MAIN ] Derivative Progress: 1012/2057 symbols completed. KMT took 1.3s. Estimated remaining: 7m 5s. Rate: 147.4 symbols/min [2025-09-29T22:11:12.388508] [INFO ] [MAIN ] KNF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:12.407226] [DEBUG] [MAIN ] KMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:12.408387] [INFO ] [MAIN ] KMX: Generated 1794 derivative records from 53147 primary records. [2025-09-29T22:11:12.408524] [DEBUG] [LOCAL ] KMX: Saving derivative data. [2025-09-29T22:11:12.444904] [DEBUG] [LOCAL ] KMX: Derivative data saved (1794 records). [2025-09-29T22:11:12.457156] [INFO ] [MAIN ] KMX: Successfully saved derivative data. [2025-09-29T22:11:12.461748] [DEBUG] [MAIN ] KN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:12.461092] [INFO ] [MAIN ] Derivative Progress: 1013/2057 symbols completed. KMX took 1.3s. Estimated remaining: 7m 5s. Rate: 147.5 symbols/min [2025-09-29T22:11:12.462811] [INFO ] [MAIN ] KN: Generated 1794 derivative records from 38615 primary records. [2025-09-29T22:11:12.462941] [DEBUG] [LOCAL ] KN: Saving derivative data. [2025-09-29T22:11:12.463169] [INFO ] [MAIN ] KNOP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:12.496275] [DEBUG] [LOCAL ] KNF: Loaded 35771 existing records from primary storage. [2025-09-29T22:11:12.497079] [INFO ] [MAIN ] KNF: Loaded 35771 primary data records. [2025-09-29T22:11:12.506879] [DEBUG] [LOCAL ] KN: Derivative data saved (1794 records). [2025-09-29T22:11:12.524286] [DEBUG] [LOCAL ] KNOP: Loaded 10275 existing records from primary storage. [2025-09-29T22:11:12.513704] [INFO ] [MAIN ] KN: Successfully saved derivative data. [2025-09-29T22:11:12.535476] [INFO ] [MAIN ] KNOP: Loaded 10275 primary data records. [2025-09-29T22:11:12.538445] [INFO ] [MAIN ] Derivative Progress: 1014/2057 symbols completed. KN took 1.3s. Estimated remaining: 7m 4s. Rate: 147.6 symbols/min [2025-09-29T22:11:12.538808] [INFO ] [MAIN ] KNSL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:12.824775] [DEBUG] [LOCAL ] KNSL: Loaded 18116 existing records from primary storage. [2025-09-29T22:11:12.906305] [INFO ] [MAIN ] KNSL: Loaded 18116 primary data records. [2025-09-29T22:11:13.550756] [DEBUG] [MAIN ] KNF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:13.551670] [INFO ] [MAIN ] KNF: Generated 1794 derivative records from 35771 primary records. [2025-09-29T22:11:13.550434] [DEBUG] [MAIN ] KNOP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:13.552548] [INFO ] [MAIN ] KNOP: Generated 1794 derivative records from 10275 primary records. [2025-09-29T22:11:13.552806] [DEBUG] [LOCAL ] KNOP: Saving derivative data. [2025-09-29T22:11:13.552675] [DEBUG] [LOCAL ] KNF: Saving derivative data. [2025-09-29T22:11:13.601819] [DEBUG] [MAIN ] KNSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:13.603508] [INFO ] [MAIN ] KNSL: Generated 1794 derivative records from 18116 primary records. [2025-09-29T22:11:13.603877] [DEBUG] [LOCAL ] KNSL: Saving derivative data. [2025-09-29T22:11:13.614389] [DEBUG] [LOCAL ] KNF: Derivative data saved (1794 records). [2025-09-29T22:11:13.614490] [INFO ] [MAIN ] KNF: Successfully saved derivative data. [2025-09-29T22:11:13.620294] [INFO ] [MAIN ] Derivative Progress: 1015/2057 symbols completed. KNF took 1.2s. Estimated remaining: 7m 4s. Rate: 147.4 symbols/min [2025-09-29T22:11:13.623296] [DEBUG] [LOCAL ] KNOP: Derivative data saved (1794 records). [2025-09-29T22:11:13.623410] [INFO ] [MAIN ] KNOP: Successfully saved derivative data. [2025-09-29T22:11:13.627312] [INFO ] [MAIN ] Derivative Progress: 1016/2057 symbols completed. KNOP took 1.2s. Estimated remaining: 7m 3s. Rate: 147.5 symbols/min [2025-09-29T22:11:13.624723] [INFO ] [MAIN ] KNTK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:13.628404] [DEBUG] [LOCAL ] KNSL: Derivative data saved (1794 records). [2025-09-29T22:11:13.628664] [INFO ] [MAIN ] KNSL: Successfully saved derivative data. [2025-09-29T22:11:13.627817] [INFO ] [MAIN ] KNX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:13.630919] [INFO ] [MAIN ] Derivative Progress: 1017/2057 symbols completed. KNSL took 1.1s. Estimated remaining: 7m 3s. Rate: 147.6 symbols/min [2025-09-29T22:11:13.631438] [INFO ] [MAIN ] KODK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:13.737893] [DEBUG] [LOCAL ] KNTK: Loaded 46082 existing records from primary storage. [2025-09-29T22:11:13.738138] [INFO ] [MAIN ] KNTK: Loaded 46082 primary data records. [2025-09-29T22:11:13.739539] [DEBUG] [LOCAL ] KNX: Loaded 52588 existing records from primary storage. [2025-09-29T22:11:13.764772] [INFO ] [MAIN ] KNX: Loaded 52588 primary data records. [2025-09-29T22:11:13.772996] [DEBUG] [LOCAL ] KODK: Loaded 43409 existing records from primary storage. [2025-09-29T22:11:13.828139] [INFO ] [MAIN ] KODK: Loaded 43409 primary data records. [2025-09-29T22:11:14.736006] [DEBUG] [MAIN ] KNTK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:14.737011] [INFO ] [MAIN ] KNTK: Generated 1794 derivative records from 46082 primary records. [2025-09-29T22:11:14.738189] [DEBUG] [LOCAL ] KNTK: Saving derivative data. [2025-09-29T22:11:14.767951] [DEBUG] [MAIN ] KODK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:14.769165] [INFO ] [MAIN ] KODK: Generated 1794 derivative records from 43409 primary records. [2025-09-29T22:11:14.777524] [DEBUG] [LOCAL ] KODK: Saving derivative data. [2025-09-29T22:11:14.783361] [DEBUG] [MAIN ] KNX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:14.785081] [INFO ] [MAIN ] KNX: Generated 1794 derivative records from 52588 primary records. [2025-09-29T22:11:14.785792] [DEBUG] [LOCAL ] KNX: Saving derivative data. [2025-09-29T22:11:14.814679] [DEBUG] [LOCAL ] KNTK: Derivative data saved (1794 records). [2025-09-29T22:11:14.816502] [INFO ] [MAIN ] KNTK: Successfully saved derivative data. [2025-09-29T22:11:14.818962] [INFO ] [MAIN ] Derivative Progress: 1018/2057 symbols completed. KNTK took 1.2s. Estimated remaining: 7m 3s. Rate: 147.4 symbols/min [2025-09-29T22:11:14.816963] [DEBUG] [LOCAL ] KODK: Derivative data saved (1794 records). [2025-09-29T22:11:14.819797] [INFO ] [MAIN ] KODK: Successfully saved derivative data. [2025-09-29T22:11:14.822067] [INFO ] [MAIN ] Derivative Progress: 1019/2057 symbols completed. KODK took 1.2s. Estimated remaining: 7m 2s. Rate: 147.5 symbols/min [2025-09-29T22:11:14.824305] [DEBUG] [LOCAL ] KNX: Derivative data saved (1794 records). [2025-09-29T22:11:14.824369] [INFO ] [MAIN ] KNX: Successfully saved derivative data. [2025-09-29T22:11:14.826472] [INFO ] [MAIN ] Derivative Progress: 1020/2057 symbols completed. KNX took 1.2s. Estimated remaining: 7m 1s. Rate: 147.6 symbols/min [2025-09-29T22:11:14.826870] [INFO ] [MAIN ] KOF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:14.827099] [INFO ] [MAIN ] KOP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:14.826979] [INFO ] [MAIN ] KORE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:14.832935] [DEBUG] [LOCAL ] KORE: Loaded 1992 existing records from primary storage. [2025-09-29T22:11:14.833097] [INFO ] [MAIN ] KORE: Loaded 1992 primary data records. [2025-09-29T22:11:14.966366] [DEBUG] [LOCAL ] KOP: Loaded 17654 existing records from primary storage. [2025-09-29T22:11:14.977404] [INFO ] [MAIN ] KOP: Loaded 17654 primary data records. [2025-09-29T22:11:15.250446] [DEBUG] [LOCAL ] KOF: Loaded 25940 existing records from primary storage. [2025-09-29T22:11:15.288766] [INFO ] [MAIN ] KOF: Loaded 25940 primary data records. [2025-09-29T22:11:15.866523] [DEBUG] [MAIN ] KORE: Filtered 7001 bins outside market hours, 7827 incomplete bins [2025-09-29T22:11:15.867987] [INFO ] [MAIN ] KORE: Generated 1787 derivative records from 1992 primary records. [2025-09-29T22:11:15.868221] [DEBUG] [LOCAL ] KORE: Saving derivative data. [2025-09-29T22:11:15.888356] [DEBUG] [LOCAL ] KORE: Derivative data saved (1787 records). [2025-09-29T22:11:15.889253] [INFO ] [MAIN ] KORE: Successfully saved derivative data. [2025-09-29T22:11:15.891492] [INFO ] [MAIN ] Derivative Progress: 1021/2057 symbols completed. KORE took 1.1s. Estimated remaining: 7m 2s. Rate: 147.4 symbols/min [2025-09-29T22:11:15.892072] [INFO ] [MAIN ] KOS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:15.912587] [DEBUG] [MAIN ] KOP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:15.913615] [INFO ] [MAIN ] KOP: Generated 1794 derivative records from 17654 primary records. [2025-09-29T22:11:15.914553] [DEBUG] [LOCAL ] KOP: Saving derivative data. [2025-09-29T22:11:15.939233] [DEBUG] [MAIN ] KOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:15.943620] [INFO ] [MAIN ] KOF: Generated 1794 derivative records from 25940 primary records. [2025-09-29T22:11:15.943846] [DEBUG] [LOCAL ] KOF: Saving derivative data. [2025-09-29T22:11:15.979431] [DEBUG] [LOCAL ] KOF: Derivative data saved (1794 records). [2025-09-29T22:11:15.980102] [INFO ] [MAIN ] KOF: Successfully saved derivative data. [2025-09-29T22:11:15.980248] [DEBUG] [LOCAL ] KOP: Derivative data saved (1794 records). [2025-09-29T22:11:15.982324] [INFO ] [MAIN ] Derivative Progress: 1022/2057 symbols completed. KOF took 1.2s. Estimated remaining: 7m 1s. Rate: 147.5 symbols/min [2025-09-29T22:11:15.982529] [INFO ] [MAIN ] KOP: Successfully saved derivative data. [2025-09-29T22:11:15.984755] [INFO ] [MAIN ] KR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:15.985051] [INFO ] [MAIN ] Derivative Progress: 1023/2057 symbols completed. KOP took 1.2s. Estimated remaining: 7m 0s. Rate: 147.7 symbols/min [2025-09-29T22:11:15.985484] [INFO ] [MAIN ] KRC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:16.004063] [DEBUG] [LOCAL ] KOS: Loaded 53047 existing records from primary storage. [2025-09-29T22:11:16.004309] [INFO ] [MAIN ] KOS: Loaded 53047 primary data records. [2025-09-29T22:11:16.427205] [DEBUG] [LOCAL ] KR: Loaded 53681 existing records from primary storage. [2025-09-29T22:11:16.427836] [INFO ] [MAIN ] KR: Loaded 53681 primary data records. [2025-09-29T22:11:16.425800] [DEBUG] [LOCAL ] KRC: Loaded 48355 existing records from primary storage. [2025-09-29T22:11:16.428351] [INFO ] [MAIN ] KRC: Loaded 48355 primary data records. [2025-09-29T22:11:17.093929] [DEBUG] [MAIN ] KOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:17.095988] [INFO ] [MAIN ] KOS: Generated 1794 derivative records from 53047 primary records. [2025-09-29T22:11:17.096238] [DEBUG] [LOCAL ] KOS: Saving derivative data. [2025-09-29T22:11:17.120459] [DEBUG] [LOCAL ] KOS: Derivative data saved (1794 records). [2025-09-29T22:11:17.121051] [INFO ] [MAIN ] KOS: Successfully saved derivative data. [2025-09-29T22:11:17.123873] [INFO ] [MAIN ] Derivative Progress: 1024/2057 symbols completed. KOS took 1.2s. Estimated remaining: 7m 0s. Rate: 147.4 symbols/min [2025-09-29T22:11:17.124059] [INFO ] [MAIN ] KREF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:17.157278] [DEBUG] [MAIN ] KR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:17.158337] [INFO ] [MAIN ] KR: Generated 1794 derivative records from 53681 primary records. [2025-09-29T22:11:17.158530] [DEBUG] [LOCAL ] KR: Saving derivative data. [2025-09-29T22:11:17.158907] [DEBUG] [MAIN ] KRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:17.160743] [INFO ] [MAIN ] KRC: Generated 1794 derivative records from 48355 primary records. [2025-09-29T22:11:17.161214] [DEBUG] [LOCAL ] KRC: Saving derivative data. [2025-09-29T22:11:17.193117] [DEBUG] [LOCAL ] KR: Derivative data saved (1794 records). [2025-09-29T22:11:17.193860] [INFO ] [MAIN ] KR: Successfully saved derivative data. [2025-09-29T22:11:17.196081] [INFO ] [MAIN ] Derivative Progress: 1025/2057 symbols completed. KR took 1.2s. Estimated remaining: 6m 60s. Rate: 147.5 symbols/min [2025-09-29T22:11:17.196968] [INFO ] [MAIN ] KRG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:17.207199] [DEBUG] [LOCAL ] KRC: Derivative data saved (1794 records). [2025-09-29T22:11:17.207493] [INFO ] [MAIN ] KRC: Successfully saved derivative data. [2025-09-29T22:11:17.209663] [INFO ] [MAIN ] Derivative Progress: 1026/2057 symbols completed. KRC took 1.2s. Estimated remaining: 6m 59s. Rate: 147.7 symbols/min [2025-09-29T22:11:17.210052] [INFO ] [MAIN ] KRO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:17.225463] [DEBUG] [LOCAL ] KREF: Loaded 37243 existing records from primary storage. [2025-09-29T22:11:17.225738] [INFO ] [MAIN ] KREF: Loaded 37243 primary data records. [2025-09-29T22:11:17.373558] [DEBUG] [LOCAL ] KRO: Loaded 26010 existing records from primary storage. [2025-09-29T22:11:17.378980] [INFO ] [MAIN ] KRO: Loaded 26010 primary data records. [2025-09-29T22:11:17.693124] [DEBUG] [LOCAL ] KRG: Loaded 49153 existing records from primary storage. [2025-09-29T22:11:17.693787] [INFO ] [MAIN ] KRG: Loaded 49153 primary data records. [2025-09-29T22:11:18.299508] [DEBUG] [MAIN ] KREF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:18.309492] [INFO ] [MAIN ] KREF: Generated 1794 derivative records from 37243 primary records. [2025-09-29T22:11:18.314957] [DEBUG] [LOCAL ] KREF: Saving derivative data. [2025-09-29T22:11:18.315338] [DEBUG] [MAIN ] KRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:18.317283] [INFO ] [MAIN ] KRO: Generated 1794 derivative records from 26010 primary records. [2025-09-29T22:11:18.317471] [DEBUG] [LOCAL ] KRO: Saving derivative data. [2025-09-29T22:11:18.348976] [DEBUG] [LOCAL ] KREF: Derivative data saved (1794 records). [2025-09-29T22:11:18.350329] [INFO ] [MAIN ] KREF: Successfully saved derivative data. [2025-09-29T22:11:18.353631] [INFO ] [MAIN ] Derivative Progress: 1027/2057 symbols completed. KREF took 1.2s. Estimated remaining: 6m 59s. Rate: 147.4 symbols/min [2025-09-29T22:11:18.354671] [INFO ] [MAIN ] KRP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:18.358415] [DEBUG] [LOCAL ] KRO: Derivative data saved (1794 records). [2025-09-29T22:11:18.358523] [INFO ] [MAIN ] KRO: Successfully saved derivative data. [2025-09-29T22:11:18.360521] [INFO ] [MAIN ] Derivative Progress: 1028/2057 symbols completed. KRO took 1.2s. Estimated remaining: 6m 58s. Rate: 147.5 symbols/min [2025-09-29T22:11:18.361126] [INFO ] [MAIN ] KSS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:18.380227] [DEBUG] [MAIN ] KRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:18.381148] [INFO ] [MAIN ] KRG: Generated 1794 derivative records from 49153 primary records. [2025-09-29T22:11:18.381274] [DEBUG] [LOCAL ] KRG: Saving derivative data. [2025-09-29T22:11:18.402161] [DEBUG] [LOCAL ] KRG: Derivative data saved (1794 records). [2025-09-29T22:11:18.411462] [INFO ] [MAIN ] KRG: Successfully saved derivative data. [2025-09-29T22:11:18.414117] [INFO ] [MAIN ] Derivative Progress: 1029/2057 symbols completed. KRG took 1.2s. Estimated remaining: 6m 58s. Rate: 147.7 symbols/min [2025-09-29T22:11:18.414446] [INFO ] [MAIN ] KT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:18.445452] [DEBUG] [LOCAL ] KRP: Loaded 37163 existing records from primary storage. [2025-09-29T22:11:18.445761] [INFO ] [MAIN ] KRP: Loaded 37163 primary data records. [2025-09-29T22:11:18.579766] [DEBUG] [LOCAL ] KSS: Loaded 53605 existing records from primary storage. [2025-09-29T22:11:18.585673] [INFO ] [MAIN ] KSS: Loaded 53605 primary data records. [2025-09-29T22:11:18.933345] [DEBUG] [LOCAL ] KT: Loaded 45650 existing records from primary storage. [2025-09-29T22:11:18.939842] [INFO ] [MAIN ] KT: Loaded 45650 primary data records. [2025-09-29T22:11:19.498337] [DEBUG] [MAIN ] KRP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:19.499868] [INFO ] [MAIN ] KRP: Generated 1794 derivative records from 37163 primary records. [2025-09-29T22:11:19.499971] [DEBUG] [LOCAL ] KRP: Saving derivative data. [2025-09-29T22:11:19.533898] [DEBUG] [MAIN ] KSS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:19.535667] [INFO ] [MAIN ] KSS: Generated 1794 derivative records from 53605 primary records. [2025-09-29T22:11:19.535835] [DEBUG] [LOCAL ] KRP: Derivative data saved (1794 records). [2025-09-29T22:11:19.536245] [DEBUG] [LOCAL ] KSS: Saving derivative data. [2025-09-29T22:11:19.536200] [INFO ] [MAIN ] KRP: Successfully saved derivative data. [2025-09-29T22:11:19.538350] [INFO ] [MAIN ] Derivative Progress: 1030/2057 symbols completed. KRP took 1.2s. Estimated remaining: 6m 58s. Rate: 147.4 symbols/min [2025-09-29T22:11:19.539529] [INFO ] [MAIN ] KTB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:19.559275] [DEBUG] [LOCAL ] KSS: Derivative data saved (1794 records). [2025-09-29T22:11:19.559570] [INFO ] [MAIN ] KSS: Successfully saved derivative data. [2025-09-29T22:11:19.561793] [INFO ] [MAIN ] Derivative Progress: 1031/2057 symbols completed. KSS took 1.2s. Estimated remaining: 6m 57s. Rate: 147.6 symbols/min [2025-09-29T22:11:19.561999] [INFO ] [MAIN ] KTF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:19.580071] [DEBUG] [MAIN ] KT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:19.581088] [INFO ] [MAIN ] KT: Generated 1794 derivative records from 45650 primary records. [2025-09-29T22:11:19.581325] [DEBUG] [LOCAL ] KT: Saving derivative data. [2025-09-29T22:11:19.606532] [DEBUG] [LOCAL ] KTF: Loaded 12803 existing records from primary storage. [2025-09-29T22:11:19.607357] [INFO ] [MAIN ] KTF: Loaded 12803 primary data records. [2025-09-29T22:11:19.744005] [DEBUG] [LOCAL ] KT: Derivative data saved (1794 records). [2025-09-29T22:11:19.751507] [INFO ] [MAIN ] KT: Successfully saved derivative data. [2025-09-29T22:11:19.762976] [DEBUG] [LOCAL ] KTB: Loaded 41099 existing records from primary storage. [2025-09-29T22:11:19.804912] [INFO ] [MAIN ] Derivative Progress: 1032/2057 symbols completed. KT took 1.4s. Estimated remaining: 6m 57s. Rate: 147.6 symbols/min [2025-09-29T22:11:19.796846] [INFO ] [MAIN ] KTB: Loaded 41099 primary data records. [2025-09-29T22:11:19.809836] [INFO ] [MAIN ] KVUE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:20.339495] [DEBUG] [LOCAL ] KVUE: Loaded 53667 existing records from primary storage. [2025-09-29T22:11:20.344914] [INFO ] [MAIN ] KVUE: Loaded 53667 primary data records. [2025-09-29T22:11:20.345230] [DEBUG] [MAIN ] KTF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:20.347056] [INFO ] [MAIN ] KTF: Generated 1794 derivative records from 12803 primary records. [2025-09-29T22:11:20.347258] [DEBUG] [LOCAL ] KTF: Saving derivative data. [2025-09-29T22:11:20.563742] [DEBUG] [LOCAL ] KTF: Derivative data saved (1794 records). [2025-09-29T22:11:20.722060] [INFO ] [MAIN ] KTF: Successfully saved derivative data. [2025-09-29T22:11:20.729717] [INFO ] [MAIN ] Derivative Progress: 1033/2057 symbols completed. KTF took 1.2s. Estimated remaining: 6m 57s. Rate: 147.4 symbols/min [2025-09-29T22:11:20.756934] [DEBUG] [MAIN ] KTB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:20.757684] [INFO ] [MAIN ] KTB: Generated 1794 derivative records from 41099 primary records. [2025-09-29T22:11:20.757754] [DEBUG] [LOCAL ] KTB: Saving derivative data. [2025-09-29T22:11:20.778304] [DEBUG] [LOCAL ] KTB: Derivative data saved (1794 records). [2025-09-29T22:11:20.778536] [INFO ] [MAIN ] KTB: Successfully saved derivative data. [2025-09-29T22:11:20.780923] [INFO ] [MAIN ] Derivative Progress: 1034/2057 symbols completed. KTB took 1.2s. Estimated remaining: 6m 56s. Rate: 147.6 symbols/min [2025-09-29T22:11:20.802442] [DEBUG] [MAIN ] KVUE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:20.803187] [INFO ] [MAIN ] KVUE: Generated 1794 derivative records from 53667 primary records. [2025-09-29T22:11:20.803255] [DEBUG] [LOCAL ] KVUE: Saving derivative data. [2025-09-29T22:11:20.821870] [DEBUG] [LOCAL ] KVUE: Derivative data saved (1794 records). [2025-09-29T22:11:20.822004] [INFO ] [MAIN ] KVUE: Successfully saved derivative data. [2025-09-29T22:11:20.823986] [INFO ] [MAIN ] Derivative Progress: 1035/2057 symbols completed. KVUE took 1.0s. Estimated remaining: 6m 55s. Rate: 147.7 symbols/min [2025-09-29T22:11:20.824615] [INFO ] [MAIN ] KW: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:20.824542] [INFO ] [MAIN ] KVYO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:20.825273] [INFO ] [MAIN ] KWR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:20.852142] [DEBUG] [LOCAL ] KWR: Loaded 16635 existing records from primary storage. [2025-09-29T22:11:20.852299] [INFO ] [MAIN ] KWR: Loaded 16635 primary data records. [2025-09-29T22:11:21.059384] [DEBUG] [LOCAL ] KW: Loaded 40567 existing records from primary storage. [2025-09-29T22:11:21.059941] [INFO ] [MAIN ] KW: Loaded 40567 primary data records. [2025-09-29T22:11:21.241164] [DEBUG] [LOCAL ] KVYO: Loaded 49993 existing records from primary storage. [2025-09-29T22:11:21.275071] [INFO ] [MAIN ] KVYO: Loaded 49993 primary data records. [2025-09-29T22:11:21.916230] [DEBUG] [MAIN ] KWR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:21.917704] [INFO ] [MAIN ] KWR: Generated 1794 derivative records from 16635 primary records. [2025-09-29T22:11:21.918402] [DEBUG] [LOCAL ] KWR: Saving derivative data. [2025-09-29T22:11:21.941274] [DEBUG] [LOCAL ] KWR: Derivative data saved (1794 records). [2025-09-29T22:11:21.941684] [INFO ] [MAIN ] KWR: Successfully saved derivative data. [2025-09-29T22:11:21.944080] [INFO ] [MAIN ] Derivative Progress: 1036/2057 symbols completed. KWR took 1.1s. Estimated remaining: 6m 56s. Rate: 147.4 symbols/min [2025-09-29T22:11:21.945472] [INFO ] [MAIN ] KYN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:21.964551] [DEBUG] [MAIN ] KW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:21.978365] [INFO ] [MAIN ] KW: Generated 1794 derivative records from 40567 primary records. [2025-09-29T22:11:21.979076] [DEBUG] [MAIN ] KVYO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:21.979904] [INFO ] [MAIN ] KVYO: Generated 1794 derivative records from 49993 primary records. [2025-09-29T22:11:21.979159] [DEBUG] [LOCAL ] KW: Saving derivative data. [2025-09-29T22:11:21.980103] [DEBUG] [LOCAL ] KVYO: Saving derivative data. [2025-09-29T22:11:22.021865] [DEBUG] [LOCAL ] KW: Derivative data saved (1794 records). [2025-09-29T22:11:22.022806] [INFO ] [MAIN ] KW: Successfully saved derivative data. [2025-09-29T22:11:22.025497] [INFO ] [MAIN ] Derivative Progress: 1037/2057 symbols completed. KW took 1.2s. Estimated remaining: 6m 55s. Rate: 147.5 symbols/min [2025-09-29T22:11:22.025943] [INFO ] [MAIN ] L: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:22.036418] [DEBUG] [LOCAL ] KVYO: Derivative data saved (1794 records). [2025-09-29T22:11:22.037538] [INFO ] [MAIN ] KVYO: Successfully saved derivative data. [2025-09-29T22:11:22.039815] [INFO ] [MAIN ] Derivative Progress: 1038/2057 symbols completed. KVYO took 1.2s. Estimated remaining: 6m 54s. Rate: 147.7 symbols/min [2025-09-29T22:11:22.039964] [INFO ] [MAIN ] LAC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:22.041134] [DEBUG] [LOCAL ] KYN: Loaded 30077 existing records from primary storage. [2025-09-29T22:11:22.041419] [INFO ] [MAIN ] KYN: Loaded 30077 primary data records. [2025-09-29T22:11:22.420582] [DEBUG] [LOCAL ] L: Loaded 40928 existing records from primary storage. [2025-09-29T22:11:22.420792] [INFO ] [MAIN ] L: Loaded 40928 primary data records. [2025-09-29T22:11:22.561964] [DEBUG] [LOCAL ] LAC: Loaded 52321 existing records from primary storage. [2025-09-29T22:11:22.568142] [INFO ] [MAIN ] LAC: Loaded 52321 primary data records. [2025-09-29T22:11:23.150009] [DEBUG] [MAIN ] KYN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:23.152050] [INFO ] [MAIN ] KYN: Generated 1794 derivative records from 30077 primary records. [2025-09-29T22:11:23.152559] [DEBUG] [LOCAL ] KYN: Saving derivative data. [2025-09-29T22:11:23.178701] [DEBUG] [LOCAL ] KYN: Derivative data saved (1794 records). [2025-09-29T22:11:23.179347] [INFO ] [MAIN ] KYN: Successfully saved derivative data. [2025-09-29T22:11:23.181474] [INFO ] [MAIN ] Derivative Progress: 1039/2057 symbols completed. KYN took 1.2s. Estimated remaining: 6m 54s. Rate: 147.4 symbols/min [2025-09-29T22:11:23.190231] [INFO ] [MAIN ] LAD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:23.197394] [DEBUG] [MAIN ] L: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:23.198393] [INFO ] [MAIN ] L: Generated 1794 derivative records from 40928 primary records. [2025-09-29T22:11:23.198741] [DEBUG] [LOCAL ] L: Saving derivative data. [2025-09-29T22:11:23.220247] [DEBUG] [LOCAL ] L: Derivative data saved (1794 records). [2025-09-29T22:11:23.233736] [INFO ] [MAIN ] L: Successfully saved derivative data. [2025-09-29T22:11:23.236248] [INFO ] [MAIN ] Derivative Progress: 1040/2057 symbols completed. L took 1.2s. Estimated remaining: 6m 54s. Rate: 147.5 symbols/min [2025-09-29T22:11:23.234103] [DEBUG] [MAIN ] LAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:23.236482] [INFO ] [MAIN ] LADR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:23.237761] [INFO ] [MAIN ] LAC: Generated 1794 derivative records from 52321 primary records. [2025-09-29T22:11:23.244270] [DEBUG] [LOCAL ] LAC: Saving derivative data. [2025-09-29T22:11:23.267891] [DEBUG] [LOCAL ] LAD: Loaded 23520 existing records from primary storage. [2025-09-29T22:11:23.269185] [INFO ] [MAIN ] LAD: Loaded 23520 primary data records. [2025-09-29T22:11:23.354587] [DEBUG] [LOCAL ] LAC: Derivative data saved (1794 records). [2025-09-29T22:11:23.360067] [INFO ] [MAIN ] LAC: Successfully saved derivative data. [2025-09-29T22:11:23.387711] [INFO ] [MAIN ] Derivative Progress: 1041/2057 symbols completed. LAC took 1.3s. Estimated remaining: 6m 53s. Rate: 147.6 symbols/min [2025-09-29T22:11:23.401307] [INFO ] [MAIN ] LANV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:23.478706] [DEBUG] [LOCAL ] LANV: Loaded 2823 existing records from primary storage. [2025-09-29T22:11:23.518618] [INFO ] [MAIN ] LANV: Loaded 2823 primary data records. [2025-09-29T22:11:23.520114] [DEBUG] [LOCAL ] LADR: Loaded 38625 existing records from primary storage. [2025-09-29T22:11:23.692514] [INFO ] [MAIN ] LADR: Loaded 38625 primary data records. [2025-09-29T22:11:24.367694] [DEBUG] [MAIN ] LAD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:24.369581] [INFO ] [MAIN ] LAD: Generated 1794 derivative records from 23520 primary records. [2025-09-29T22:11:24.370021] [DEBUG] [LOCAL ] LAD: Saving derivative data. [2025-09-29T22:11:24.405967] [DEBUG] [LOCAL ] LAD: Derivative data saved (1794 records). [2025-09-29T22:11:24.411341] [INFO ] [MAIN ] LAD: Successfully saved derivative data. [2025-09-29T22:11:24.414793] [INFO ] [MAIN ] Derivative Progress: 1042/2057 symbols completed. LAD took 1.2s. Estimated remaining: 6m 53s. Rate: 147.4 symbols/min [2025-09-29T22:11:24.415319] [DEBUG] [MAIN ] LANV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:11:24.415870] [INFO ] [MAIN ] LAW: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:24.417330] [INFO ] [MAIN ] LANV: Generated 1793 derivative records from 2823 primary records. [2025-09-29T22:11:24.417975] [DEBUG] [LOCAL ] LANV: Saving derivative data. [2025-09-29T22:11:24.435329] [DEBUG] [LOCAL ] LANV: Derivative data saved (1793 records). [2025-09-29T22:11:24.436097] [INFO ] [MAIN ] LANV: Successfully saved derivative data. [2025-09-29T22:11:24.438390] [INFO ] [MAIN ] Derivative Progress: 1043/2057 symbols completed. LANV took 1.0s. Estimated remaining: 6m 52s. Rate: 147.6 symbols/min [2025-09-29T22:11:24.452221] [INFO ] [MAIN ] LAZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:24.453117] [DEBUG] [MAIN ] LADR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:24.458909] [INFO ] [MAIN ] LADR: Generated 1794 derivative records from 38625 primary records. [2025-09-29T22:11:24.459058] [DEBUG] [LOCAL ] LADR: Saving derivative data. [2025-09-29T22:11:24.478581] [DEBUG] [LOCAL ] LAW: Loaded 13949 existing records from primary storage. [2025-09-29T22:11:24.479357] [INFO ] [MAIN ] LAW: Loaded 13949 primary data records. [2025-09-29T22:11:24.596786] [DEBUG] [LOCAL ] LADR: Derivative data saved (1794 records). [2025-09-29T22:11:24.611747] [INFO ] [MAIN ] LADR: Successfully saved derivative data. [2025-09-29T22:11:24.615528] [INFO ] [MAIN ] Derivative Progress: 1044/2057 symbols completed. LADR took 1.4s. Estimated remaining: 6m 52s. Rate: 147.6 symbols/min [2025-09-29T22:11:24.621171] [INFO ] [MAIN ] LB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:24.878707] [DEBUG] [LOCAL ] LAZ: Loaded 44983 existing records from primary storage. [2025-09-29T22:11:24.879105] [INFO ] [MAIN ] LAZ: Loaded 44983 primary data records. [2025-09-29T22:11:25.222853] [DEBUG] [LOCAL ] LB: Loaded 37552 existing records from primary storage. [2025-09-29T22:11:25.223715] [INFO ] [MAIN ] LB: Loaded 37552 primary data records. [2025-09-29T22:11:25.435986] [DEBUG] [MAIN ] LAW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:25.559572] [INFO ] [MAIN ] LAW: Generated 1794 derivative records from 13949 primary records. [2025-09-29T22:11:25.560248] [DEBUG] [LOCAL ] LAW: Saving derivative data. [2025-09-29T22:11:25.583828] [DEBUG] [LOCAL ] LAW: Derivative data saved (1794 records). [2025-09-29T22:11:25.584023] [INFO ] [MAIN ] LAW: Successfully saved derivative data. [2025-09-29T22:11:25.600988] [DEBUG] [MAIN ] LAZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:25.586572] [INFO ] [MAIN ] Derivative Progress: 1045/2057 symbols completed. LAW took 1.2s. Estimated remaining: 6m 52s. Rate: 147.4 symbols/min [2025-09-29T22:11:25.601190] [INFO ] [MAIN ] LBRT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:25.602233] [INFO ] [MAIN ] LAZ: Generated 1794 derivative records from 44983 primary records. [2025-09-29T22:11:25.602349] [DEBUG] [LOCAL ] LAZ: Saving derivative data. [2025-09-29T22:11:25.623339] [DEBUG] [LOCAL ] LAZ: Derivative data saved (1794 records). [2025-09-29T22:11:25.623566] [INFO ] [MAIN ] LAZ: Successfully saved derivative data. [2025-09-29T22:11:25.625823] [INFO ] [MAIN ] Derivative Progress: 1046/2057 symbols completed. LAZ took 1.2s. Estimated remaining: 6m 51s. Rate: 147.6 symbols/min [2025-09-29T22:11:25.626062] [INFO ] [MAIN ] LC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:25.640173] [DEBUG] [MAIN ] LB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:25.641155] [INFO ] [MAIN ] LB: Generated 1794 derivative records from 37552 primary records. [2025-09-29T22:11:25.641289] [DEBUG] [LOCAL ] LB: Saving derivative data. [2025-09-29T22:11:25.659587] [DEBUG] [LOCAL ] LB: Derivative data saved (1794 records). [2025-09-29T22:11:25.659790] [INFO ] [MAIN ] LB: Successfully saved derivative data. [2025-09-29T22:11:25.661951] [INFO ] [MAIN ] Derivative Progress: 1047/2057 symbols completed. LB took 1.0s. Estimated remaining: 6m 50s. Rate: 147.7 symbols/min [2025-09-29T22:11:25.662223] [INFO ] [MAIN ] LCII: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:25.721329] [DEBUG] [LOCAL ] LBRT: Loaded 52915 existing records from primary storage. [2025-09-29T22:11:25.721577] [INFO ] [MAIN ] LBRT: Loaded 52915 primary data records. [2025-09-29T22:11:25.844866] [DEBUG] [LOCAL ] LC: Loaded 47828 existing records from primary storage. [2025-09-29T22:11:25.844141] [DEBUG] [LOCAL ] LCII: Loaded 28223 existing records from primary storage. [2025-09-29T22:11:25.856333] [INFO ] [MAIN ] LC: Loaded 47828 primary data records. [2025-09-29T22:11:25.856875] [INFO ] [MAIN ] LCII: Loaded 28223 primary data records. [2025-09-29T22:11:26.747434] [DEBUG] [MAIN ] LBRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:26.748728] [INFO ] [MAIN ] LBRT: Generated 1794 derivative records from 52915 primary records. [2025-09-29T22:11:26.748855] [DEBUG] [LOCAL ] LBRT: Saving derivative data. [2025-09-29T22:11:26.781627] [DEBUG] [MAIN ] LC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:26.783032] [INFO ] [MAIN ] LC: Generated 1794 derivative records from 47828 primary records. [2025-09-29T22:11:26.791797] [DEBUG] [LOCAL ] LC: Saving derivative data. [2025-09-29T22:11:26.797491] [DEBUG] [MAIN ] LCII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:26.798753] [INFO ] [MAIN ] LCII: Generated 1794 derivative records from 28223 primary records. [2025-09-29T22:11:26.799323] [DEBUG] [LOCAL ] LCII: Saving derivative data. [2025-09-29T22:11:26.800436] [DEBUG] [LOCAL ] LBRT: Derivative data saved (1794 records). [2025-09-29T22:11:26.800846] [INFO ] [MAIN ] LBRT: Successfully saved derivative data. [2025-09-29T22:11:26.803405] [INFO ] [MAIN ] Derivative Progress: 1048/2057 symbols completed. LBRT took 1.2s. Estimated remaining: 6m 51s. Rate: 147.4 symbols/min [2025-09-29T22:11:26.836723] [DEBUG] [LOCAL ] LCII: Derivative data saved (1794 records). [2025-09-29T22:11:26.836865] [INFO ] [MAIN ] LCII: Successfully saved derivative data. [2025-09-29T22:11:26.836571] [DEBUG] [LOCAL ] LC: Derivative data saved (1794 records). [2025-09-29T22:11:26.838945] [INFO ] [MAIN ] Derivative Progress: 1049/2057 symbols completed. LCII took 1.2s. Estimated remaining: 6m 50s. Rate: 147.6 symbols/min [2025-09-29T22:11:26.839276] [INFO ] [MAIN ] LC: Successfully saved derivative data. [2025-09-29T22:11:26.841501] [INFO ] [MAIN ] Derivative Progress: 1050/2057 symbols completed. LC took 1.2s. Estimated remaining: 6m 49s. Rate: 147.7 symbols/min [2025-09-29T22:11:26.841936] [INFO ] [MAIN ] LDOS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:26.842010] [INFO ] [MAIN ] LDP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:26.841876] [INFO ] [MAIN ] LDI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:26.862900] [DEBUG] [LOCAL ] LDP: Loaded 12962 existing records from primary storage. [2025-09-29T22:11:26.863142] [INFO ] [MAIN ] LDP: Loaded 12962 primary data records. [2025-09-29T22:11:27.078274] [DEBUG] [LOCAL ] LDI: Loaded 44119 existing records from primary storage. [2025-09-29T22:11:27.101485] [INFO ] [MAIN ] LDI: Loaded 44119 primary data records. [2025-09-29T22:11:27.368123] [DEBUG] [LOCAL ] LDOS: Loaded 45633 existing records from primary storage. [2025-09-29T22:11:27.377427] [INFO ] [MAIN ] LDOS: Loaded 45633 primary data records. [2025-09-29T22:11:27.975809] [DEBUG] [MAIN ] LDP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:27.977761] [INFO ] [MAIN ] LDP: Generated 1794 derivative records from 12962 primary records. [2025-09-29T22:11:27.978054] [DEBUG] [LOCAL ] LDP: Saving derivative data. [2025-09-29T22:11:28.001207] [DEBUG] [LOCAL ] LDP: Derivative data saved (1794 records). [2025-09-29T22:11:28.001788] [INFO ] [MAIN ] LDP: Successfully saved derivative data. [2025-09-29T22:11:28.004425] [INFO ] [MAIN ] Derivative Progress: 1051/2057 symbols completed. LDP took 1.2s. Estimated remaining: 6m 49s. Rate: 147.4 symbols/min [2025-09-29T22:11:28.004773] [INFO ] [MAIN ] LEA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:28.025877] [DEBUG] [MAIN ] LDI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:28.026856] [INFO ] [MAIN ] LDI: Generated 1794 derivative records from 44119 primary records. [2025-09-29T22:11:28.040119] [DEBUG] [LOCAL ] LDI: Saving derivative data. [2025-09-29T22:11:28.041034] [DEBUG] [MAIN ] LDOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:28.042852] [INFO ] [MAIN ] LDOS: Generated 1794 derivative records from 45633 primary records. [2025-09-29T22:11:28.043263] [DEBUG] [LOCAL ] LDOS: Saving derivative data. [2025-09-29T22:11:28.085802] [DEBUG] [LOCAL ] LDI: Derivative data saved (1794 records). [2025-09-29T22:11:28.086515] [INFO ] [MAIN ] LDI: Successfully saved derivative data. [2025-09-29T22:11:28.088835] [INFO ] [MAIN ] Derivative Progress: 1052/2057 symbols completed. LDI took 1.2s. Estimated remaining: 6m 49s. Rate: 147.6 symbols/min [2025-09-29T22:11:28.089753] [INFO ] [MAIN ] LEG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:28.090349] [DEBUG] [LOCAL ] LDOS: Derivative data saved (1794 records). [2025-09-29T22:11:28.090937] [INFO ] [MAIN ] LDOS: Successfully saved derivative data. [2025-09-29T22:11:28.093106] [INFO ] [MAIN ] Derivative Progress: 1053/2057 symbols completed. LDOS took 1.3s. Estimated remaining: 6m 48s. Rate: 147.7 symbols/min [2025-09-29T22:11:28.093308] [INFO ] [MAIN ] LEN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:28.108488] [DEBUG] [LOCAL ] LEA: Loaded 41756 existing records from primary storage. [2025-09-29T22:11:28.108632] [INFO ] [MAIN ] LEA: Loaded 41756 primary data records. [2025-09-29T22:11:28.467938] [DEBUG] [LOCAL ] LEG: Loaded 50337 existing records from primary storage. [2025-09-29T22:11:28.469039] [INFO ] [MAIN ] LEG: Loaded 50337 primary data records. [2025-09-29T22:11:28.545070] [DEBUG] [LOCAL ] LEN: Loaded 53195 existing records from primary storage. [2025-09-29T22:11:28.554974] [INFO ] [MAIN ] LEN: Loaded 53195 primary data records. [2025-09-29T22:11:29.200967] [DEBUG] [MAIN ] LEA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:29.203160] [INFO ] [MAIN ] LEA: Generated 1794 derivative records from 41756 primary records. [2025-09-29T22:11:29.203489] [DEBUG] [LOCAL ] LEA: Saving derivative data. [2025-09-29T22:11:29.230182] [DEBUG] [LOCAL ] LEA: Derivative data saved (1794 records). [2025-09-29T22:11:29.230479] [INFO ] [MAIN ] LEA: Successfully saved derivative data. [2025-09-29T22:11:29.232635] [INFO ] [MAIN ] Derivative Progress: 1054/2057 symbols completed. LEA took 1.2s. Estimated remaining: 6m 48s. Rate: 147.4 symbols/min [2025-09-29T22:11:29.234172] [INFO ] [MAIN ] LEO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:29.251319] [DEBUG] [MAIN ] LEG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:29.252112] [INFO ] [MAIN ] LEG: Generated 1794 derivative records from 50337 primary records. [2025-09-29T22:11:29.252474] [DEBUG] [LOCAL ] LEG: Saving derivative data. [2025-09-29T22:11:29.296234] [DEBUG] [LOCAL ] LEG: Derivative data saved (1794 records). [2025-09-29T22:11:29.296945] [DEBUG] [LOCAL ] LEO: Loaded 17498 existing records from primary storage. [2025-09-29T22:11:29.297407] [INFO ] [MAIN ] LEO: Loaded 17498 primary data records. [2025-09-29T22:11:29.297475] [INFO ] [MAIN ] LEG: Successfully saved derivative data. [2025-09-29T22:11:29.297254] [DEBUG] [MAIN ] LEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:29.299506] [INFO ] [MAIN ] Derivative Progress: 1055/2057 symbols completed. LEG took 1.2s. Estimated remaining: 6m 47s. Rate: 147.6 symbols/min [2025-09-29T22:11:29.311808] [INFO ] [MAIN ] LEN: Generated 1794 derivative records from 53195 primary records. [2025-09-29T22:11:29.316232] [INFO ] [MAIN ] LEVI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:29.321506] [DEBUG] [LOCAL ] LEN: Saving derivative data. [2025-09-29T22:11:29.645585] [DEBUG] [LOCAL ] LEN: Derivative data saved (1794 records). [2025-09-29T22:11:29.645990] [INFO ] [MAIN ] LEN: Successfully saved derivative data. [2025-09-29T22:11:29.648531] [INFO ] [MAIN ] Derivative Progress: 1056/2057 symbols completed. LEN took 1.6s. Estimated remaining: 6m 47s. Rate: 147.6 symbols/min [2025-09-29T22:11:29.663245] [INFO ] [MAIN ] LFT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:29.687569] [DEBUG] [LOCAL ] LEVI: Loaded 51512 existing records from primary storage. [2025-09-29T22:11:29.693317] [INFO ] [MAIN ] LEVI: Loaded 51512 primary data records. [2025-09-29T22:11:29.770030] [DEBUG] [LOCAL ] LFT: Loaded 18238 existing records from primary storage. [2025-09-29T22:11:29.782759] [INFO ] [MAIN ] LFT: Loaded 18238 primary data records. [2025-09-29T22:11:29.951189] [DEBUG] [MAIN ] LEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:30.015874] [INFO ] [MAIN ] LEO: Generated 1794 derivative records from 17498 primary records. [2025-09-29T22:11:30.046965] [DEBUG] [LOCAL ] LEO: Saving derivative data. [2025-09-29T22:11:30.392975] [DEBUG] [LOCAL ] LEO: Derivative data saved (1794 records). [2025-09-29T22:11:30.393889] [INFO ] [MAIN ] LEO: Successfully saved derivative data. [2025-09-29T22:11:30.396005] [INFO ] [MAIN ] Derivative Progress: 1057/2057 symbols completed. LEO took 1.2s. Estimated remaining: 6m 47s. Rate: 147.5 symbols/min [2025-09-29T22:11:30.396803] [INFO ] [MAIN ] LGI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:30.427717] [DEBUG] [LOCAL ] LGI: Loaded 9870 existing records from primary storage. [2025-09-29T22:11:30.433632] [INFO ] [MAIN ] LGI: Loaded 9870 primary data records. [2025-09-29T22:11:30.442118] [DEBUG] [MAIN ] LEVI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:30.461193] [INFO ] [MAIN ] LEVI: Generated 1794 derivative records from 51512 primary records. [2025-09-29T22:11:30.500731] [DEBUG] [LOCAL ] LEVI: Saving derivative data. [2025-09-29T22:11:30.500558] [DEBUG] [MAIN ] LFT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:30.526619] [INFO ] [MAIN ] LFT: Generated 1794 derivative records from 18238 primary records. [2025-09-29T22:11:30.545185] [DEBUG] [LOCAL ] LFT: Saving derivative data. [2025-09-29T22:11:30.611745] [DEBUG] [LOCAL ] LEVI: Derivative data saved (1794 records). [2025-09-29T22:11:30.633509] [INFO ] [MAIN ] LEVI: Successfully saved derivative data. [2025-09-29T22:11:30.648481] [INFO ] [MAIN ] Derivative Progress: 1058/2057 symbols completed. LEVI took 1.3s. Estimated remaining: 6m 46s. Rate: 147.5 symbols/min [2025-09-29T22:11:30.649294] [INFO ] [MAIN ] LH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:30.744312] [DEBUG] [LOCAL ] LFT: Derivative data saved (1794 records). [2025-09-29T22:11:30.863374] [INFO ] [MAIN ] LFT: Successfully saved derivative data. [2025-09-29T22:11:30.867512] [INFO ] [MAIN ] Derivative Progress: 1059/2057 symbols completed. LFT took 1.2s. Estimated remaining: 6m 46s. Rate: 147.6 symbols/min [2025-09-29T22:11:30.893208] [INFO ] [MAIN ] LHX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:30.914120] [DEBUG] [LOCAL ] LH: Loaded 37834 existing records from primary storage. [2025-09-29T22:11:30.914780] [INFO ] [MAIN ] LH: Loaded 37834 primary data records. [2025-09-29T22:11:31.095349] [DEBUG] [MAIN ] LGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:31.145234] [INFO ] [MAIN ] LGI: Generated 1794 derivative records from 9870 primary records. [2025-09-29T22:11:31.148752] [DEBUG] [LOCAL ] LGI: Saving derivative data. [2025-09-29T22:11:31.376130] [DEBUG] [LOCAL ] LHX: Loaded 48649 existing records from primary storage. [2025-09-29T22:11:31.376811] [INFO ] [MAIN ] LHX: Loaded 48649 primary data records. [2025-09-29T22:11:31.471972] [DEBUG] [LOCAL ] LGI: Derivative data saved (1794 records). [2025-09-29T22:11:31.478033] [INFO ] [MAIN ] LGI: Successfully saved derivative data. [2025-09-29T22:11:31.492798] [INFO ] [MAIN ] Derivative Progress: 1060/2057 symbols completed. LGI took 1.1s. Estimated remaining: 6m 46s. Rate: 147.5 symbols/min [2025-09-29T22:11:31.506035] [INFO ] [MAIN ] LII: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:31.740251] [DEBUG] [MAIN ] LH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:31.741880] [INFO ] [MAIN ] LH: Generated 1794 derivative records from 37834 primary records. [2025-09-29T22:11:31.750217] [DEBUG] [LOCAL ] LH: Saving derivative data. [2025-09-29T22:11:31.783100] [DEBUG] [LOCAL ] LII: Loaded 27955 existing records from primary storage. [2025-09-29T22:11:31.783700] [INFO ] [MAIN ] LII: Loaded 27955 primary data records. [2025-09-29T22:11:31.798472] [DEBUG] [LOCAL ] LH: Derivative data saved (1794 records). [2025-09-29T22:11:31.804785] [INFO ] [MAIN ] LH: Successfully saved derivative data. [2025-09-29T22:11:31.820347] [INFO ] [MAIN ] Derivative Progress: 1061/2057 symbols completed. LH took 1.2s. Estimated remaining: 6m 45s. Rate: 147.5 symbols/min [2025-09-29T22:11:31.826682] [INFO ] [MAIN ] LION: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:31.944477] [DEBUG] [MAIN ] LHX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:31.948832] [INFO ] [MAIN ] LHX: Generated 1794 derivative records from 48649 primary records. [2025-09-29T22:11:31.949030] [DEBUG] [LOCAL ] LHX: Saving derivative data. [2025-09-29T22:11:32.039755] [DEBUG] [LOCAL ] LHX: Derivative data saved (1794 records). [2025-09-29T22:11:32.058253] [INFO ] [MAIN ] LHX: Successfully saved derivative data. [2025-09-29T22:11:32.202719] [INFO ] [MAIN ] Derivative Progress: 1062/2057 symbols completed. LHX took 1.3s. Estimated remaining: 6m 45s. Rate: 147.5 symbols/min [2025-09-29T22:11:32.202978] [INFO ] [MAIN ] LLY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:32.204479] [DEBUG] [LOCAL ] LION: Loaded 43772 existing records from primary storage. [2025-09-29T22:11:32.204962] [INFO ] [MAIN ] LION: Loaded 43772 primary data records. [2025-09-29T22:11:32.596157] [DEBUG] [MAIN ] LII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:32.597335] [INFO ] [MAIN ] LII: Generated 1794 derivative records from 27955 primary records. [2025-09-29T22:11:32.597924] [DEBUG] [LOCAL ] LII: Saving derivative data. [2025-09-29T22:11:32.599744] [DEBUG] [LOCAL ] LLY: Loaded 53280 existing records from primary storage. [2025-09-29T22:11:32.600363] [INFO ] [MAIN ] LLY: Loaded 53280 primary data records. [2025-09-29T22:11:32.742487] [DEBUG] [LOCAL ] LII: Derivative data saved (1794 records). [2025-09-29T22:11:32.763595] [INFO ] [MAIN ] LII: Successfully saved derivative data. [2025-09-29T22:11:32.826758] [INFO ] [MAIN ] Derivative Progress: 1063/2057 symbols completed. LII took 1.3s. Estimated remaining: 6m 44s. Rate: 147.5 symbols/min [2025-09-29T22:11:32.967638] [DEBUG] [MAIN ] LION: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:32.968367] [INFO ] [MAIN ] LION: Generated 1794 derivative records from 43772 primary records. [2025-09-29T22:11:32.968528] [DEBUG] [LOCAL ] LION: Saving derivative data. [2025-09-29T22:11:32.989581] [DEBUG] [LOCAL ] LION: Derivative data saved (1794 records). [2025-09-29T22:11:32.989965] [INFO ] [MAIN ] LION: Successfully saved derivative data. [2025-09-29T22:11:32.992093] [INFO ] [MAIN ] Derivative Progress: 1064/2057 symbols completed. LION took 1.2s. Estimated remaining: 6m 44s. Rate: 147.6 symbols/min [2025-09-29T22:11:33.012399] [DEBUG] [MAIN ] LLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:33.013130] [INFO ] [MAIN ] LLY: Generated 1794 derivative records from 53280 primary records. [2025-09-29T22:11:33.013198] [DEBUG] [LOCAL ] LLY: Saving derivative data. [2025-09-29T22:11:33.029433] [DEBUG] [LOCAL ] LLY: Derivative data saved (1794 records). [2025-09-29T22:11:33.029556] [INFO ] [MAIN ] LLY: Successfully saved derivative data. [2025-09-29T22:11:33.031630] [INFO ] [MAIN ] Derivative Progress: 1065/2057 symbols completed. LLY took 0.8s. Estimated remaining: 6m 43s. Rate: 147.7 symbols/min [2025-09-29T22:11:33.032203] [INFO ] [MAIN ] LNC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:33.032293] [INFO ] [MAIN ] LMT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:33.032130] [INFO ] [MAIN ] LMND: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:33.105252] [DEBUG] [LOCAL ] LMT: Loaded 49839 existing records from primary storage. [2025-09-29T22:11:33.106032] [INFO ] [MAIN ] LMT: Loaded 49839 primary data records. [2025-09-29T22:11:33.162355] [DEBUG] [LOCAL ] LNC: Loaded 51612 existing records from primary storage. [2025-09-29T22:11:33.195777] [INFO ] [MAIN ] LNC: Loaded 51612 primary data records. [2025-09-29T22:11:33.228778] [DEBUG] [LOCAL ] LMND: Loaded 51875 existing records from primary storage. [2025-09-29T22:11:33.246816] [INFO ] [MAIN ] LMND: Loaded 51875 primary data records. [2025-09-29T22:11:34.150259] [DEBUG] [MAIN ] LMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:34.151114] [INFO ] [MAIN ] LMT: Generated 1794 derivative records from 49839 primary records. [2025-09-29T22:11:34.151298] [DEBUG] [LOCAL ] LMT: Saving derivative data. [2025-09-29T22:11:34.187859] [DEBUG] [MAIN ] LNC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:34.202338] [DEBUG] [LOCAL ] LMT: Derivative data saved (1794 records). [2025-09-29T22:11:34.202951] [DEBUG] [MAIN ] LMND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:34.196922] [INFO ] [MAIN ] LNC: Generated 1794 derivative records from 51612 primary records. [2025-09-29T22:11:34.203743] [INFO ] [MAIN ] LMND: Generated 1794 derivative records from 51875 primary records. [2025-09-29T22:11:34.203065] [INFO ] [MAIN ] LMT: Successfully saved derivative data. [2025-09-29T22:11:34.204006] [DEBUG] [LOCAL ] LMND: Saving derivative data. [2025-09-29T22:11:34.203903] [DEBUG] [LOCAL ] LNC: Saving derivative data. [2025-09-29T22:11:34.206799] [INFO ] [MAIN ] Derivative Progress: 1066/2057 symbols completed. LMT took 1.2s. Estimated remaining: 6m 43s. Rate: 147.4 symbols/min [2025-09-29T22:11:34.208203] [INFO ] [MAIN ] LND: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:34.241853] [DEBUG] [LOCAL ] LND: Loaded 4918 existing records from primary storage. [2025-09-29T22:11:34.243300] [INFO ] [MAIN ] LND: Loaded 4918 primary data records. [2025-09-29T22:11:34.283160] [DEBUG] [LOCAL ] LNC: Derivative data saved (1794 records). [2025-09-29T22:11:34.297149] [DEBUG] [LOCAL ] LMND: Derivative data saved (1794 records). [2025-09-29T22:11:34.291910] [INFO ] [MAIN ] LNC: Successfully saved derivative data. [2025-09-29T22:11:34.297245] [INFO ] [MAIN ] LMND: Successfully saved derivative data. [2025-09-29T22:11:34.322096] [INFO ] [MAIN ] Derivative Progress: 1067/2057 symbols completed. LMND took 1.3s. Estimated remaining: 6m 43s. Rate: 147.5 symbols/min [2025-09-29T22:11:34.331748] [INFO ] [MAIN ] LNG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:34.336951] [INFO ] [MAIN ] Derivative Progress: 1068/2057 symbols completed. LNC took 1.3s. Estimated remaining: 6m 42s. Rate: 147.6 symbols/min [2025-09-29T22:11:34.342392] [INFO ] [MAIN ] LNN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:34.588036] [DEBUG] [LOCAL ] LNN: Loaded 11213 existing records from primary storage. [2025-09-29T22:11:34.589199] [INFO ] [MAIN ] LNN: Loaded 11213 primary data records. [2025-09-29T22:11:34.817893] [DEBUG] [LOCAL ] LNG: Loaded 51428 existing records from primary storage. [2025-09-29T22:11:34.829291] [INFO ] [MAIN ] LNG: Loaded 51428 primary data records. [2025-09-29T22:11:35.238876] [DEBUG] [MAIN ] LND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:35.349158] [INFO ] [MAIN ] LND: Generated 1794 derivative records from 4918 primary records. [2025-09-29T22:11:35.363593] [DEBUG] [LOCAL ] LND: Saving derivative data. [2025-09-29T22:11:35.383031] [DEBUG] [LOCAL ] LND: Derivative data saved (1794 records). [2025-09-29T22:11:35.384440] [INFO ] [MAIN ] LND: Successfully saved derivative data. [2025-09-29T22:11:35.387148] [INFO ] [MAIN ] Derivative Progress: 1069/2057 symbols completed. LND took 1.2s. Estimated remaining: 6m 42s. Rate: 147.4 symbols/min [2025-09-29T22:11:35.387747] [INFO ] [MAIN ] LOAR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:35.412858] [DEBUG] [MAIN ] LNN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:35.413723] [INFO ] [MAIN ] LNN: Generated 1794 derivative records from 11213 primary records. [2025-09-29T22:11:35.413932] [DEBUG] [LOCAL ] LNN: Saving derivative data. [2025-09-29T22:11:35.463235] [DEBUG] [MAIN ] LNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:35.466088] [INFO ] [MAIN ] LNG: Generated 1794 derivative records from 51428 primary records. [2025-09-29T22:11:35.467167] [DEBUG] [LOCAL ] LNG: Saving derivative data. [2025-09-29T22:11:35.469856] [DEBUG] [LOCAL ] LNN: Derivative data saved (1794 records). [2025-09-29T22:11:35.470387] [INFO ] [MAIN ] LNN: Successfully saved derivative data. [2025-09-29T22:11:35.472306] [INFO ] [MAIN ] Derivative Progress: 1070/2057 symbols completed. LNN took 1.1s. Estimated remaining: 6m 41s. Rate: 147.5 symbols/min [2025-09-29T22:11:35.484139] [INFO ] [MAIN ] LOB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:35.507798] [DEBUG] [LOCAL ] LOAR: Loaded 41633 existing records from primary storage. [2025-09-29T22:11:35.509294] [INFO ] [MAIN ] LOAR: Loaded 41633 primary data records. [2025-09-29T22:11:35.573238] [DEBUG] [LOCAL ] LNG: Derivative data saved (1794 records). [2025-09-29T22:11:35.589112] [INFO ] [MAIN ] LNG: Successfully saved derivative data. [2025-09-29T22:11:35.591608] [INFO ] [MAIN ] Derivative Progress: 1071/2057 symbols completed. LNG took 1.3s. Estimated remaining: 6m 41s. Rate: 147.6 symbols/min [2025-09-29T22:11:35.625675] [INFO ] [MAIN ] LOCL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:35.715581] [DEBUG] [LOCAL ] LOB: Loaded 27432 existing records from primary storage. [2025-09-29T22:11:35.708632] [DEBUG] [LOCAL ] LOCL: Loaded 3631 existing records from primary storage. [2025-09-29T22:11:35.739549] [INFO ] [MAIN ] LOCL: Loaded 3631 primary data records. [2025-09-29T22:11:35.735104] [INFO ] [MAIN ] LOB: Loaded 27432 primary data records. [2025-09-29T22:11:36.585738] [DEBUG] [MAIN ] LOAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:36.587593] [INFO ] [MAIN ] LOAR: Generated 1794 derivative records from 41633 primary records. [2025-09-29T22:11:36.587855] [DEBUG] [LOCAL ] LOAR: Saving derivative data. [2025-09-29T22:11:36.609946] [DEBUG] [LOCAL ] LOAR: Derivative data saved (1794 records). [2025-09-29T22:11:36.612678] [INFO ] [MAIN ] LOAR: Successfully saved derivative data. [2025-09-29T22:11:36.617225] [INFO ] [MAIN ] Derivative Progress: 1072/2057 symbols completed. LOAR took 1.2s. Estimated remaining: 6m 41s. Rate: 147.4 symbols/min [2025-09-29T22:11:36.617485] [INFO ] [MAIN ] LOMA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:36.631170] [DEBUG] [MAIN ] LOCL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:36.645042] [INFO ] [MAIN ] LOCL: Generated 1794 derivative records from 3631 primary records. [2025-09-29T22:11:36.645688] [DEBUG] [MAIN ] LOB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:36.646421] [INFO ] [MAIN ] LOB: Generated 1794 derivative records from 27432 primary records. [2025-09-29T22:11:36.646528] [DEBUG] [LOCAL ] LOCL: Saving derivative data. [2025-09-29T22:11:36.647447] [DEBUG] [LOCAL ] LOB: Saving derivative data. [2025-09-29T22:11:36.686773] [DEBUG] [LOCAL ] LOB: Derivative data saved (1794 records). [2025-09-29T22:11:36.686280] [DEBUG] [LOCAL ] LOCL: Derivative data saved (1794 records). [2025-09-29T22:11:36.686926] [INFO ] [MAIN ] LOCL: Successfully saved derivative data. [2025-09-29T22:11:36.688993] [INFO ] [MAIN ] Derivative Progress: 1073/2057 symbols completed. LOCL took 1.1s. Estimated remaining: 6m 40s. Rate: 147.5 symbols/min [2025-09-29T22:11:36.689163] [INFO ] [MAIN ] LOB: Successfully saved derivative data. [2025-09-29T22:11:36.689357] [INFO ] [MAIN ] LOW: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:36.691625] [INFO ] [MAIN ] Derivative Progress: 1074/2057 symbols completed. LOB took 1.2s. Estimated remaining: 6m 39s. Rate: 147.7 symbols/min [2025-09-29T22:11:36.691909] [INFO ] [MAIN ] LPG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:36.706630] [DEBUG] [LOCAL ] LOMA: Loaded 32012 existing records from primary storage. [2025-09-29T22:11:36.706869] [INFO ] [MAIN ] LOMA: Loaded 32012 primary data records. [2025-09-29T22:11:37.068316] [DEBUG] [LOCAL ] LPG: Loaded 39930 existing records from primary storage. [2025-09-29T22:11:37.069175] [INFO ] [MAIN ] LPG: Loaded 39930 primary data records. [2025-09-29T22:11:37.203185] [DEBUG] [LOCAL ] LOW: Loaded 52947 existing records from primary storage. [2025-09-29T22:11:37.225626] [INFO ] [MAIN ] LOW: Loaded 52947 primary data records. [2025-09-29T22:11:37.891401] [DEBUG] [MAIN ] LOMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:37.904612] [INFO ] [MAIN ] LOMA: Generated 1794 derivative records from 32012 primary records. [2025-09-29T22:11:37.905064] [DEBUG] [LOCAL ] LOMA: Saving derivative data. [2025-09-29T22:11:37.927264] [DEBUG] [LOCAL ] LOMA: Derivative data saved (1794 records). [2025-09-29T22:11:37.927957] [INFO ] [MAIN ] LOMA: Successfully saved derivative data. [2025-09-29T22:11:37.931105] [INFO ] [MAIN ] Derivative Progress: 1075/2057 symbols completed. LOMA took 1.3s. Estimated remaining: 6m 40s. Rate: 147.4 symbols/min [2025-09-29T22:11:37.933603] [INFO ] [MAIN ] LPL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:37.949912] [DEBUG] [MAIN ] LPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:37.951068] [INFO ] [MAIN ] LPG: Generated 1794 derivative records from 39930 primary records. [2025-09-29T22:11:37.951136] [DEBUG] [LOCAL ] LPG: Saving derivative data. [2025-09-29T22:11:37.980298] [DEBUG] [LOCAL ] LPG: Derivative data saved (1794 records). [2025-09-29T22:11:37.990258] [INFO ] [MAIN ] LPG: Successfully saved derivative data. [2025-09-29T22:11:37.993399] [INFO ] [MAIN ] Derivative Progress: 1076/2057 symbols completed. LPG took 1.3s. Estimated remaining: 6m 39s. Rate: 147.5 symbols/min [2025-09-29T22:11:37.995293] [INFO ] [MAIN ] LPX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:37.997177] [DEBUG] [LOCAL ] LPL: Loaded 26121 existing records from primary storage. [2025-09-29T22:11:38.012188] [INFO ] [MAIN ] LPL: Loaded 26121 primary data records. [2025-09-29T22:11:38.012514] [DEBUG] [MAIN ] LOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:38.026200] [INFO ] [MAIN ] LOW: Generated 1794 derivative records from 52947 primary records. [2025-09-29T22:11:38.052720] [DEBUG] [LOCAL ] LOW: Saving derivative data. [2025-09-29T22:11:38.405270] [DEBUG] [LOCAL ] LPX: Loaded 39661 existing records from primary storage. [2025-09-29T22:11:38.406456] [INFO ] [MAIN ] LPX: Loaded 39661 primary data records. [2025-09-29T22:11:38.406228] [DEBUG] [LOCAL ] LOW: Derivative data saved (1794 records). [2025-09-29T22:11:38.418793] [INFO ] [MAIN ] LOW: Successfully saved derivative data. [2025-09-29T22:11:38.442951] [INFO ] [MAIN ] Derivative Progress: 1077/2057 symbols completed. LOW took 1.8s. Estimated remaining: 6m 39s. Rate: 147.5 symbols/min [2025-09-29T22:11:38.482560] [INFO ] [MAIN ] LRN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:38.759390] [DEBUG] [MAIN ] LPL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:38.761675] [INFO ] [MAIN ] LPL: Generated 1794 derivative records from 26121 primary records. [2025-09-29T22:11:38.761831] [DEBUG] [LOCAL ] LPL: Saving derivative data. [2025-09-29T22:11:38.791531] [DEBUG] [LOCAL ] LPL: Derivative data saved (1794 records). [2025-09-29T22:11:38.791985] [INFO ] [MAIN ] LPL: Successfully saved derivative data. [2025-09-29T22:11:38.795269] [INFO ] [MAIN ] Derivative Progress: 1078/2057 symbols completed. LPL took 0.9s. Estimated remaining: 6m 38s. Rate: 147.5 symbols/min [2025-09-29T22:11:38.792863] [DEBUG] [LOCAL ] LRN: Loaded 39826 existing records from primary storage. [2025-09-29T22:11:38.796028] [INFO ] [MAIN ] LRN: Loaded 39826 primary data records. [2025-09-29T22:11:38.957944] [DEBUG] [MAIN ] LPX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:38.987706] [INFO ] [MAIN ] LPX: Generated 1794 derivative records from 39661 primary records. [2025-09-29T22:11:39.008210] [DEBUG] [LOCAL ] LPX: Saving derivative data. [2025-09-29T22:11:39.178473] [DEBUG] [LOCAL ] LPX: Derivative data saved (1794 records). [2025-09-29T22:11:39.178621] [INFO ] [MAIN ] LPX: Successfully saved derivative data. [2025-09-29T22:11:39.180918] [INFO ] [MAIN ] Derivative Progress: 1079/2057 symbols completed. LPX took 1.2s. Estimated remaining: 6m 38s. Rate: 147.5 symbols/min [2025-09-29T22:11:39.204532] [DEBUG] [MAIN ] LRN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:39.205207] [INFO ] [MAIN ] LRN: Generated 1794 derivative records from 39826 primary records. [2025-09-29T22:11:39.205273] [DEBUG] [LOCAL ] LRN: Saving derivative data. [2025-09-29T22:11:39.222412] [DEBUG] [LOCAL ] LRN: Derivative data saved (1794 records). [2025-09-29T22:11:39.222566] [INFO ] [MAIN ] LRN: Successfully saved derivative data. [2025-09-29T22:11:39.224745] [INFO ] [MAIN ] Derivative Progress: 1080/2057 symbols completed. LRN took 0.7s. Estimated remaining: 6m 37s. Rate: 147.6 symbols/min [2025-09-29T22:11:39.225474] [INFO ] [MAIN ] LTH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:39.225375] [INFO ] [MAIN ] LTC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:39.225772] [INFO ] [MAIN ] LSPD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:39.263058] [DEBUG] [LOCAL ] LTC: Loaded 29954 existing records from primary storage. [2025-09-29T22:11:39.263373] [INFO ] [MAIN ] LTC: Loaded 29954 primary data records. [2025-09-29T22:11:39.497324] [DEBUG] [LOCAL ] LSPD: Loaded 42949 existing records from primary storage. [2025-09-29T22:11:39.499176] [INFO ] [MAIN ] LSPD: Loaded 42949 primary data records. [2025-09-29T22:11:39.499005] [DEBUG] [LOCAL ] LTH: Loaded 51770 existing records from primary storage. [2025-09-29T22:11:39.508333] [INFO ] [MAIN ] LTH: Loaded 51770 primary data records. [2025-09-29T22:11:40.407297] [DEBUG] [MAIN ] LTC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:40.408638] [INFO ] [MAIN ] LTC: Generated 1794 derivative records from 29954 primary records. [2025-09-29T22:11:40.408971] [DEBUG] [LOCAL ] LTC: Saving derivative data. [2025-09-29T22:11:40.434536] [DEBUG] [LOCAL ] LTC: Derivative data saved (1794 records). [2025-09-29T22:11:40.448187] [INFO ] [MAIN ] LTC: Successfully saved derivative data. [2025-09-29T22:11:40.461675] [DEBUG] [MAIN ] LSPD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:40.464216] [INFO ] [MAIN ] Derivative Progress: 1081/2057 symbols completed. LTC took 1.2s. Estimated remaining: 6m 37s. Rate: 147.4 symbols/min [2025-09-29T22:11:40.465821] [INFO ] [MAIN ] LTM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:40.465620] [DEBUG] [MAIN ] LTH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:40.465249] [INFO ] [MAIN ] LSPD: Generated 1794 derivative records from 42949 primary records. [2025-09-29T22:11:40.467207] [DEBUG] [LOCAL ] LSPD: Saving derivative data. [2025-09-29T22:11:40.467064] [INFO ] [MAIN ] LTH: Generated 1794 derivative records from 51770 primary records. [2025-09-29T22:11:40.467313] [DEBUG] [LOCAL ] LTH: Saving derivative data. [2025-09-29T22:11:40.500952] [DEBUG] [LOCAL ] LSPD: Derivative data saved (1794 records). [2025-09-29T22:11:40.502024] [DEBUG] [LOCAL ] LTH: Derivative data saved (1794 records). [2025-09-29T22:11:40.502351] [INFO ] [MAIN ] LTH: Successfully saved derivative data. [2025-09-29T22:11:40.504554] [INFO ] [MAIN ] Derivative Progress: 1082/2057 symbols completed. LTH took 1.3s. Estimated remaining: 6m 37s. Rate: 147.5 symbols/min [2025-09-29T22:11:40.504771] [INFO ] [MAIN ] LSPD: Successfully saved derivative data. [2025-09-29T22:11:40.504982] [INFO ] [MAIN ] LU: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:40.507726] [INFO ] [MAIN ] Derivative Progress: 1083/2057 symbols completed. LSPD took 1.3s. Estimated remaining: 6m 36s. Rate: 147.6 symbols/min [2025-09-29T22:11:40.508697] [INFO ] [MAIN ] LUMN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:40.537358] [DEBUG] [LOCAL ] LTM: Loaded 36751 existing records from primary storage. [2025-09-29T22:11:40.537669] [INFO ] [MAIN ] LTM: Loaded 36751 primary data records. [2025-09-29T22:11:40.899332] [DEBUG] [LOCAL ] LU: Loaded 48923 existing records from primary storage. [2025-09-29T22:11:40.915008] [INFO ] [MAIN ] LU: Loaded 48923 primary data records. [2025-09-29T22:11:40.927372] [DEBUG] [LOCAL ] LUMN: Loaded 53634 existing records from primary storage. [2025-09-29T22:11:40.949267] [INFO ] [MAIN ] LUMN: Loaded 53634 primary data records. [2025-09-29T22:11:41.598817] [DEBUG] [MAIN ] LTM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:41.600362] [INFO ] [MAIN ] LTM: Generated 1794 derivative records from 36751 primary records. [2025-09-29T22:11:41.600606] [DEBUG] [LOCAL ] LTM: Saving derivative data. [2025-09-29T22:11:41.620878] [DEBUG] [LOCAL ] LTM: Derivative data saved (1794 records). [2025-09-29T22:11:41.622076] [INFO ] [MAIN ] LTM: Successfully saved derivative data. [2025-09-29T22:11:41.625293] [INFO ] [MAIN ] Derivative Progress: 1084/2057 symbols completed. LTM took 1.2s. Estimated remaining: 6m 36s. Rate: 147.4 symbols/min [2025-09-29T22:11:41.626917] [INFO ] [MAIN ] LUV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:41.644146] [DEBUG] [MAIN ] LU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:41.645029] [INFO ] [MAIN ] LU: Generated 1794 derivative records from 48923 primary records. [2025-09-29T22:11:41.645509] [DEBUG] [LOCAL ] LU: Saving derivative data. [2025-09-29T22:11:41.663169] [DEBUG] [LOCAL ] LU: Derivative data saved (1794 records). [2025-09-29T22:11:41.664526] [INFO ] [MAIN ] LU: Successfully saved derivative data. [2025-09-29T22:11:41.666590] [INFO ] [MAIN ] Derivative Progress: 1085/2057 symbols completed. LU took 1.2s. Estimated remaining: 6m 35s. Rate: 147.5 symbols/min [2025-09-29T22:11:41.668902] [INFO ] [MAIN ] LVS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:41.684335] [DEBUG] [MAIN ] LUMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:41.685251] [INFO ] [MAIN ] LUMN: Generated 1794 derivative records from 53634 primary records. [2025-09-29T22:11:41.685508] [DEBUG] [LOCAL ] LUMN: Saving derivative data. [2025-09-29T22:11:41.725325] [DEBUG] [LOCAL ] LUMN: Derivative data saved (1794 records). [2025-09-29T22:11:41.725601] [INFO ] [MAIN ] LUMN: Successfully saved derivative data. [2025-09-29T22:11:41.728003] [INFO ] [MAIN ] Derivative Progress: 1086/2057 symbols completed. LUMN took 1.2s. Estimated remaining: 6m 35s. Rate: 147.6 symbols/min [2025-09-29T22:11:41.728388] [INFO ] [MAIN ] LVWR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:41.763292] [DEBUG] [LOCAL ] LUV: Loaded 53689 existing records from primary storage. [2025-09-29T22:11:41.763735] [INFO ] [MAIN ] LUV: Loaded 53689 primary data records. [2025-09-29T22:11:41.866324] [DEBUG] [LOCAL ] LVWR: Loaded 17628 existing records from primary storage. [2025-09-29T22:11:41.884620] [INFO ] [MAIN ] LVWR: Loaded 17628 primary data records. [2025-09-29T22:11:41.908916] [DEBUG] [LOCAL ] LVS: Loaded 53564 existing records from primary storage. [2025-09-29T22:11:41.918272] [INFO ] [MAIN ] LVS: Loaded 53564 primary data records. [2025-09-29T22:11:42.863845] [DEBUG] [MAIN ] LUV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:42.878094] [INFO ] [MAIN ] LUV: Generated 1794 derivative records from 53689 primary records. [2025-09-29T22:11:42.879038] [DEBUG] [LOCAL ] LUV: Saving derivative data. [2025-09-29T22:11:42.878877] [DEBUG] [MAIN ] LVWR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:42.880986] [INFO ] [MAIN ] LVWR: Generated 1794 derivative records from 17628 primary records. [2025-09-29T22:11:42.881292] [DEBUG] [LOCAL ] LVWR: Saving derivative data. [2025-09-29T22:11:42.928486] [DEBUG] [MAIN ] LVS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:42.930907] [INFO ] [MAIN ] LVS: Generated 1794 derivative records from 53564 primary records. [2025-09-29T22:11:42.932213] [DEBUG] [LOCAL ] LUV: Derivative data saved (1794 records). [2025-09-29T22:11:42.932369] [DEBUG] [LOCAL ] LVWR: Derivative data saved (1794 records). [2025-09-29T22:11:42.932571] [INFO ] [MAIN ] LUV: Successfully saved derivative data. [2025-09-29T22:11:42.931722] [DEBUG] [LOCAL ] LVS: Saving derivative data. [2025-09-29T22:11:42.933300] [INFO ] [MAIN ] LVWR: Successfully saved derivative data. [2025-09-29T22:11:42.935542] [INFO ] [MAIN ] Derivative Progress: 1087/2057 symbols completed. LUV took 1.3s. Estimated remaining: 6m 35s. Rate: 147.4 symbols/min [2025-09-29T22:11:42.937943] [INFO ] [MAIN ] LW: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:42.938459] [INFO ] [MAIN ] Derivative Progress: 1088/2057 symbols completed. LVWR took 1.2s. Estimated remaining: 6m 34s. Rate: 147.5 symbols/min [2025-09-29T22:11:42.947870] [INFO ] [MAIN ] LXFR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:42.956522] [DEBUG] [LOCAL ] LVS: Derivative data saved (1794 records). [2025-09-29T22:11:42.956727] [INFO ] [MAIN ] LVS: Successfully saved derivative data. [2025-09-29T22:11:42.959051] [INFO ] [MAIN ] Derivative Progress: 1089/2057 symbols completed. LVS took 1.3s. Estimated remaining: 6m 33s. Rate: 147.6 symbols/min [2025-09-29T22:11:42.959282] [INFO ] [MAIN ] LXP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:42.978497] [DEBUG] [LOCAL ] LXFR: Loaded 16896 existing records from primary storage. [2025-09-29T22:11:42.978719] [INFO ] [MAIN ] LXFR: Loaded 16896 primary data records. [2025-09-29T22:11:43.215313] [DEBUG] [LOCAL ] LW: Loaded 51154 existing records from primary storage. [2025-09-29T22:11:43.250006] [INFO ] [MAIN ] LW: Loaded 51154 primary data records. [2025-09-29T22:11:43.403031] [DEBUG] [LOCAL ] LXP: Loaded 50667 existing records from primary storage. [2025-09-29T22:11:43.422975] [INFO ] [MAIN ] LXP: Loaded 50667 primary data records. [2025-09-29T22:11:44.079166] [DEBUG] [MAIN ] LXFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:44.080322] [INFO ] [MAIN ] LXFR: Generated 1794 derivative records from 16896 primary records. [2025-09-29T22:11:44.080924] [DEBUG] [LOCAL ] LXFR: Saving derivative data. [2025-09-29T22:11:44.105833] [DEBUG] [LOCAL ] LXFR: Derivative data saved (1794 records). [2025-09-29T22:11:44.106138] [INFO ] [MAIN ] LXFR: Successfully saved derivative data. [2025-09-29T22:11:44.108638] [INFO ] [MAIN ] Derivative Progress: 1090/2057 symbols completed. LXFR took 1.2s. Estimated remaining: 6m 34s. Rate: 147.4 symbols/min [2025-09-29T22:11:44.109011] [INFO ] [MAIN ] LXU: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:44.131197] [DEBUG] [MAIN ] LXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:44.144304] [INFO ] [MAIN ] LXP: Generated 1794 derivative records from 50667 primary records. [2025-09-29T22:11:44.144478] [DEBUG] [LOCAL ] LXP: Saving derivative data. [2025-09-29T22:11:44.146267] [DEBUG] [MAIN ] LW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:44.147505] [INFO ] [MAIN ] LW: Generated 1794 derivative records from 51154 primary records. [2025-09-29T22:11:44.158608] [DEBUG] [LOCAL ] LW: Saving derivative data. [2025-09-29T22:11:44.189264] [DEBUG] [LOCAL ] LW: Derivative data saved (1794 records). [2025-09-29T22:11:44.189791] [INFO ] [MAIN ] LW: Successfully saved derivative data. [2025-09-29T22:11:44.192373] [INFO ] [MAIN ] Derivative Progress: 1091/2057 symbols completed. LW took 1.3s. Estimated remaining: 6m 33s. Rate: 147.5 symbols/min [2025-09-29T22:11:44.190370] [DEBUG] [LOCAL ] LXP: Derivative data saved (1794 records). [2025-09-29T22:11:44.192877] [INFO ] [MAIN ] LYB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:44.192760] [INFO ] [MAIN ] LXP: Successfully saved derivative data. [2025-09-29T22:11:44.195785] [INFO ] [MAIN ] Derivative Progress: 1092/2057 symbols completed. LXP took 1.2s. Estimated remaining: 6m 32s. Rate: 147.6 symbols/min [2025-09-29T22:11:44.196159] [INFO ] [MAIN ] LYG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:44.212952] [DEBUG] [LOCAL ] LXU: Loaded 31780 existing records from primary storage. [2025-09-29T22:11:44.213282] [INFO ] [MAIN ] LXU: Loaded 31780 primary data records. [2025-09-29T22:11:44.645580] [DEBUG] [LOCAL ] LYG: Loaded 52817 existing records from primary storage. [2025-09-29T22:11:44.646014] [INFO ] [MAIN ] LYG: Loaded 52817 primary data records. [2025-09-29T22:11:44.647208] [DEBUG] [LOCAL ] LYB: Loaded 53599 existing records from primary storage. [2025-09-29T22:11:44.670978] [INFO ] [MAIN ] LYB: Loaded 53599 primary data records. [2025-09-29T22:11:45.351253] [DEBUG] [MAIN ] LXU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:45.353134] [INFO ] [MAIN ] LXU: Generated 1794 derivative records from 31780 primary records. [2025-09-29T22:11:45.353669] [DEBUG] [LOCAL ] LXU: Saving derivative data. [2025-09-29T22:11:45.375227] [DEBUG] [LOCAL ] LXU: Derivative data saved (1794 records). [2025-09-29T22:11:45.375473] [INFO ] [MAIN ] LXU: Successfully saved derivative data. [2025-09-29T22:11:45.377814] [INFO ] [MAIN ] Derivative Progress: 1093/2057 symbols completed. LXU took 1.3s. Estimated remaining: 6m 33s. Rate: 147.4 symbols/min [2025-09-29T22:11:45.419061] [DEBUG] [MAIN ] LYG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:45.420570] [INFO ] [MAIN ] LYG: Generated 1794 derivative records from 52817 primary records. [2025-09-29T22:11:45.419312] [DEBUG] [MAIN ] LYB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:45.420803] [DEBUG] [LOCAL ] LYG: Saving derivative data. [2025-09-29T22:11:45.422319] [INFO ] [MAIN ] LYB: Generated 1794 derivative records from 53599 primary records. [2025-09-29T22:11:45.422710] [DEBUG] [LOCAL ] LYB: Saving derivative data. [2025-09-29T22:11:45.456960] [DEBUG] [LOCAL ] LYG: Derivative data saved (1794 records). [2025-09-29T22:11:45.457673] [INFO ] [MAIN ] LYG: Successfully saved derivative data. [2025-09-29T22:11:45.459637] [INFO ] [MAIN ] Derivative Progress: 1094/2057 symbols completed. LYG took 1.3s. Estimated remaining: 6m 32s. Rate: 147.5 symbols/min [2025-09-29T22:11:45.460515] [DEBUG] [LOCAL ] LYB: Derivative data saved (1794 records). [2025-09-29T22:11:45.460682] [INFO ] [MAIN ] LYB: Successfully saved derivative data. [2025-09-29T22:11:45.462739] [INFO ] [MAIN ] Derivative Progress: 1095/2057 symbols completed. LYB took 1.3s. Estimated remaining: 6m 31s. Rate: 147.6 symbols/min [2025-09-29T22:11:45.463173] [INFO ] [MAIN ] LYV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:45.463308] [INFO ] [MAIN ] LZM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:45.463253] [INFO ] [MAIN ] LZB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:45.478574] [DEBUG] [LOCAL ] LZM: Loaded 13838 existing records from primary storage. [2025-09-29T22:11:45.478892] [INFO ] [MAIN ] LZM: Loaded 13838 primary data records. [2025-09-29T22:11:45.818971] [DEBUG] [LOCAL ] LZB: Loaded 35586 existing records from primary storage. [2025-09-29T22:11:45.829780] [INFO ] [MAIN ] LZB: Loaded 35586 primary data records. [2025-09-29T22:11:45.878053] [DEBUG] [LOCAL ] LYV: Loaded 51121 existing records from primary storage. [2025-09-29T22:11:45.896023] [INFO ] [MAIN ] LYV: Loaded 51121 primary data records. [2025-09-29T22:11:46.571562] [DEBUG] [MAIN ] LZM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:46.573222] [INFO ] [MAIN ] LZM: Generated 1794 derivative records from 13838 primary records. [2025-09-29T22:11:46.573457] [DEBUG] [LOCAL ] LZM: Saving derivative data. [2025-09-29T22:11:46.592439] [DEBUG] [LOCAL ] LZM: Derivative data saved (1794 records). [2025-09-29T22:11:46.592874] [INFO ] [MAIN ] LZM: Successfully saved derivative data. [2025-09-29T22:11:46.595011] [INFO ] [MAIN ] Derivative Progress: 1096/2057 symbols completed. LZM took 1.1s. Estimated remaining: 6m 31s. Rate: 147.4 symbols/min [2025-09-29T22:11:46.595385] [INFO ] [MAIN ] M: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:46.614683] [DEBUG] [MAIN ] LYV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:46.617183] [INFO ] [MAIN ] LYV: Generated 1794 derivative records from 51121 primary records. [2025-09-29T22:11:46.618082] [DEBUG] [LOCAL ] LYV: Saving derivative data. [2025-09-29T22:11:46.646167] [DEBUG] [MAIN ] LZB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:46.648255] [INFO ] [MAIN ] LZB: Generated 1794 derivative records from 35586 primary records. [2025-09-29T22:11:46.648443] [DEBUG] [LOCAL ] LZB: Saving derivative data. [2025-09-29T22:11:46.651306] [DEBUG] [LOCAL ] LYV: Derivative data saved (1794 records). [2025-09-29T22:11:46.651478] [INFO ] [MAIN ] LYV: Successfully saved derivative data. [2025-09-29T22:11:46.653994] [INFO ] [MAIN ] Derivative Progress: 1097/2057 symbols completed. LYV took 1.2s. Estimated remaining: 6m 31s. Rate: 147.5 symbols/min [2025-09-29T22:11:46.654198] [INFO ] [MAIN ] MA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:46.672262] [DEBUG] [LOCAL ] LZB: Derivative data saved (1794 records). [2025-09-29T22:11:46.672499] [INFO ] [MAIN ] LZB: Successfully saved derivative data. [2025-09-29T22:11:46.674986] [INFO ] [MAIN ] Derivative Progress: 1098/2057 symbols completed. LZB took 1.2s. Estimated remaining: 6m 30s. Rate: 147.6 symbols/min [2025-09-29T22:11:46.675193] [INFO ] [MAIN ] MAA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:46.724739] [DEBUG] [LOCAL ] M: Loaded 53537 existing records from primary storage. [2025-09-29T22:11:46.724968] [INFO ] [MAIN ] M: Loaded 53537 primary data records. [2025-09-29T22:11:46.889040] [DEBUG] [LOCAL ] MAA: Loaded 42690 existing records from primary storage. [2025-09-29T22:11:46.899970] [INFO ] [MAIN ] MAA: Loaded 42690 primary data records. [2025-09-29T22:11:46.916296] [DEBUG] [LOCAL ] MA: Loaded 52540 existing records from primary storage. [2025-09-29T22:11:46.952822] [INFO ] [MAIN ] MA: Loaded 52540 primary data records. [2025-09-29T22:11:47.770059] [DEBUG] [MAIN ] M: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:47.771419] [INFO ] [MAIN ] M: Generated 1794 derivative records from 53537 primary records. [2025-09-29T22:11:47.771862] [DEBUG] [LOCAL ] M: Saving derivative data. [2025-09-29T22:11:47.797035] [DEBUG] [LOCAL ] M: Derivative data saved (1794 records). [2025-09-29T22:11:47.811479] [INFO ] [MAIN ] M: Successfully saved derivative data. [2025-09-29T22:11:47.813749] [INFO ] [MAIN ] Derivative Progress: 1099/2057 symbols completed. M took 1.2s. Estimated remaining: 6m 30s. Rate: 147.4 symbols/min [2025-09-29T22:11:47.822795] [DEBUG] [MAIN ] MA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:47.828715] [INFO ] [MAIN ] MAC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:47.830472] [INFO ] [MAIN ] MA: Generated 1794 derivative records from 52540 primary records. [2025-09-29T22:11:47.830609] [DEBUG] [LOCAL ] MA: Saving derivative data. [2025-09-29T22:11:47.829112] [DEBUG] [MAIN ] MAA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:47.833383] [INFO ] [MAIN ] MAA: Generated 1794 derivative records from 42690 primary records. [2025-09-29T22:11:47.833623] [DEBUG] [LOCAL ] MAA: Saving derivative data. [2025-09-29T22:11:47.868573] [DEBUG] [LOCAL ] MAA: Derivative data saved (1794 records). [2025-09-29T22:11:47.869888] [INFO ] [MAIN ] MAA: Successfully saved derivative data. [2025-09-29T22:11:47.872639] [INFO ] [MAIN ] Derivative Progress: 1100/2057 symbols completed. MAA took 1.2s. Estimated remaining: 6m 29s. Rate: 147.5 symbols/min [2025-09-29T22:11:47.873088] [INFO ] [MAIN ] MAGN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:47.872930] [DEBUG] [LOCAL ] MA: Derivative data saved (1794 records). [2025-09-29T22:11:47.873925] [INFO ] [MAIN ] MA: Successfully saved derivative data. [2025-09-29T22:11:47.876067] [INFO ] [MAIN ] Derivative Progress: 1101/2057 symbols completed. MA took 1.2s. Estimated remaining: 6m 29s. Rate: 147.6 symbols/min [2025-09-29T22:11:47.876522] [INFO ] [MAIN ] MAIN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:47.915860] [DEBUG] [LOCAL ] MAC: Loaded 49693 existing records from primary storage. [2025-09-29T22:11:47.924607] [INFO ] [MAIN ] MAC: Loaded 49693 primary data records. [2025-09-29T22:11:48.051838] [DEBUG] [LOCAL ] MAGN: Loaded 34851 existing records from primary storage. [2025-09-29T22:11:48.068795] [INFO ] [MAIN ] MAGN: Loaded 34851 primary data records. [2025-09-29T22:11:48.113943] [DEBUG] [LOCAL ] MAIN: Loaded 41208 existing records from primary storage. [2025-09-29T22:11:48.330686] [INFO ] [MAIN ] MAIN: Loaded 41208 primary data records. [2025-09-29T22:11:49.060423] [DEBUG] [MAIN ] MAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:49.061993] [INFO ] [MAIN ] MAC: Generated 1794 derivative records from 49693 primary records. [2025-09-29T22:11:49.062359] [DEBUG] [LOCAL ] MAC: Saving derivative data. [2025-09-29T22:11:49.086946] [DEBUG] [LOCAL ] MAC: Derivative data saved (1794 records). [2025-09-29T22:11:49.087257] [INFO ] [MAIN ] MAC: Successfully saved derivative data. [2025-09-29T22:11:49.089397] [INFO ] [MAIN ] Derivative Progress: 1102/2057 symbols completed. MAC took 1.3s. Estimated remaining: 6m 29s. Rate: 147.3 symbols/min [2025-09-29T22:11:49.098212] [INFO ] [MAIN ] MAN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:49.104850] [DEBUG] [MAIN ] MAGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:49.106568] [INFO ] [MAIN ] MAGN: Generated 1794 derivative records from 34851 primary records. [2025-09-29T22:11:49.107976] [DEBUG] [LOCAL ] MAGN: Saving derivative data. [2025-09-29T22:11:49.138970] [DEBUG] [MAIN ] MAIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:49.140677] [INFO ] [MAIN ] MAIN: Generated 1794 derivative records from 41208 primary records. [2025-09-29T22:11:49.140779] [DEBUG] [LOCAL ] MAIN: Saving derivative data. [2025-09-29T22:11:49.161678] [DEBUG] [LOCAL ] MAIN: Derivative data saved (1794 records). [2025-09-29T22:11:49.162806] [INFO ] [MAIN ] MAIN: Successfully saved derivative data. [2025-09-29T22:11:49.162636] [DEBUG] [LOCAL ] MAGN: Derivative data saved (1794 records). [2025-09-29T22:11:49.165181] [INFO ] [MAIN ] Derivative Progress: 1103/2057 symbols completed. MAIN took 1.3s. Estimated remaining: 6m 28s. Rate: 147.4 symbols/min [2025-09-29T22:11:49.165523] [INFO ] [MAIN ] MAGN: Successfully saved derivative data. [2025-09-29T22:11:49.165388] [INFO ] [MAIN ] MANU: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:49.168891] [INFO ] [MAIN ] Derivative Progress: 1104/2057 symbols completed. MAGN took 1.3s. Estimated remaining: 6m 27s. Rate: 147.6 symbols/min [2025-09-29T22:11:49.169443] [INFO ] [MAIN ] MAS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:49.207969] [DEBUG] [LOCAL ] MAN: Loaded 43536 existing records from primary storage. [2025-09-29T22:11:49.208204] [INFO ] [MAIN ] MAN: Loaded 43536 primary data records. [2025-09-29T22:11:49.263557] [DEBUG] [LOCAL ] MANU: Loaded 27013 existing records from primary storage. [2025-09-29T22:11:49.286802] [INFO ] [MAIN ] MANU: Loaded 27013 primary data records. [2025-09-29T22:11:49.575066] [DEBUG] [LOCAL ] MAS: Loaded 52336 existing records from primary storage. [2025-09-29T22:11:49.722546] [INFO ] [MAIN ] MAS: Loaded 52336 primary data records. [2025-09-29T22:11:50.275981] [DEBUG] [MAIN ] MAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:50.279174] [INFO ] [MAIN ] MAN: Generated 1794 derivative records from 43536 primary records. [2025-09-29T22:11:50.279395] [DEBUG] [LOCAL ] MAN: Saving derivative data. [2025-09-29T22:11:50.293952] [DEBUG] [MAIN ] MANU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:50.303017] [INFO ] [MAIN ] MANU: Generated 1794 derivative records from 27013 primary records. [2025-09-29T22:11:50.308790] [DEBUG] [LOCAL ] MANU: Saving derivative data. [2025-09-29T22:11:50.329998] [DEBUG] [LOCAL ] MANU: Derivative data saved (1794 records). [2025-09-29T22:11:50.331405] [INFO ] [MAIN ] MANU: Successfully saved derivative data. [2025-09-29T22:11:50.334623] [INFO ] [MAIN ] Derivative Progress: 1105/2057 symbols completed. MANU took 1.2s. Estimated remaining: 6m 28s. Rate: 147.3 symbols/min [2025-09-29T22:11:50.332350] [DEBUG] [LOCAL ] MAN: Derivative data saved (1794 records). [2025-09-29T22:11:50.335038] [INFO ] [MAIN ] MAN: Successfully saved derivative data. [2025-09-29T22:11:50.338521] [INFO ] [MAIN ] Derivative Progress: 1106/2057 symbols completed. MAN took 1.2s. Estimated remaining: 6m 27s. Rate: 147.5 symbols/min [2025-09-29T22:11:50.338824] [INFO ] [MAIN ] MATX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:50.338384] [INFO ] [MAIN ] MATV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:50.357665] [DEBUG] [MAIN ] MAS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:50.358543] [INFO ] [MAIN ] MAS: Generated 1794 derivative records from 52336 primary records. [2025-09-29T22:11:50.358617] [DEBUG] [LOCAL ] MAS: Saving derivative data. [2025-09-29T22:11:50.378515] [DEBUG] [LOCAL ] MAS: Derivative data saved (1794 records). [2025-09-29T22:11:50.378912] [INFO ] [MAIN ] MAS: Successfully saved derivative data. [2025-09-29T22:11:50.381314] [INFO ] [MAIN ] Derivative Progress: 1107/2057 symbols completed. MAS took 1.2s. Estimated remaining: 6m 26s. Rate: 147.6 symbols/min [2025-09-29T22:11:50.391153] [INFO ] [MAIN ] MAX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:50.415213] [DEBUG] [LOCAL ] MATV: Loaded 37051 existing records from primary storage. [2025-09-29T22:11:50.425352] [INFO ] [MAIN ] MATV: Loaded 37051 primary data records. [2025-09-29T22:11:50.425937] [DEBUG] [LOCAL ] MATX: Loaded 31452 existing records from primary storage. [2025-09-29T22:11:50.446906] [INFO ] [MAIN ] MATX: Loaded 31452 primary data records. [2025-09-29T22:11:50.684125] [DEBUG] [LOCAL ] MAX: Loaded 30602 existing records from primary storage. [2025-09-29T22:11:50.784293] [INFO ] [MAIN ] MAX: Loaded 30602 primary data records. [2025-09-29T22:11:51.494565] [DEBUG] [MAIN ] MATX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:51.495836] [INFO ] [MAIN ] MATX: Generated 1794 derivative records from 31452 primary records. [2025-09-29T22:11:51.509852] [DEBUG] [LOCAL ] MATX: Saving derivative data. [2025-09-29T22:11:51.510532] [DEBUG] [MAIN ] MATV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:51.511484] [INFO ] [MAIN ] MATV: Generated 1794 derivative records from 37051 primary records. [2025-09-29T22:11:51.512579] [DEBUG] [LOCAL ] MATV: Saving derivative data. [2025-09-29T22:11:51.543933] [DEBUG] [LOCAL ] MATX: Derivative data saved (1794 records). [2025-09-29T22:11:51.548299] [INFO ] [MAIN ] MATX: Successfully saved derivative data. [2025-09-29T22:11:51.548150] [DEBUG] [LOCAL ] MATV: Derivative data saved (1794 records). [2025-09-29T22:11:51.550435] [INFO ] [MAIN ] Derivative Progress: 1108/2057 symbols completed. MATX took 1.2s. Estimated remaining: 6m 26s. Rate: 147.3 symbols/min [2025-09-29T22:11:51.550601] [INFO ] [MAIN ] MATV: Successfully saved derivative data. [2025-09-29T22:11:51.553265] [INFO ] [MAIN ] Derivative Progress: 1109/2057 symbols completed. MATV took 1.2s. Estimated remaining: 6m 26s. Rate: 147.5 symbols/min [2025-09-29T22:11:51.569995] [DEBUG] [MAIN ] MAX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:51.570763] [INFO ] [MAIN ] MAX: Generated 1794 derivative records from 30602 primary records. [2025-09-29T22:11:51.570833] [DEBUG] [LOCAL ] MAX: Saving derivative data. [2025-09-29T22:11:51.587879] [DEBUG] [LOCAL ] MAX: Derivative data saved (1794 records). [2025-09-29T22:11:51.588056] [INFO ] [MAIN ] MAX: Successfully saved derivative data. [2025-09-29T22:11:51.590156] [INFO ] [MAIN ] Derivative Progress: 1110/2057 symbols completed. MAX took 1.2s. Estimated remaining: 6m 25s. Rate: 147.6 symbols/min [2025-09-29T22:11:51.590606] [INFO ] [MAIN ] MBC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:51.590820] [INFO ] [MAIN ] MC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:51.590924] [INFO ] [MAIN ] MBI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:51.641360] [DEBUG] [LOCAL ] MBI: Loaded 24353 existing records from primary storage. [2025-09-29T22:11:51.641518] [INFO ] [MAIN ] MBI: Loaded 24353 primary data records. [2025-09-29T22:11:51.722714] [DEBUG] [LOCAL ] MC: Loaded 44106 existing records from primary storage. [2025-09-29T22:11:51.751636] [INFO ] [MAIN ] MC: Loaded 44106 primary data records. [2025-09-29T22:11:51.757546] [DEBUG] [LOCAL ] MBC: Loaded 43180 existing records from primary storage. [2025-09-29T22:11:51.763114] [INFO ] [MAIN ] MBC: Loaded 43180 primary data records. [2025-09-29T22:11:52.688284] [DEBUG] [MAIN ] MBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:52.691169] [INFO ] [MAIN ] MBI: Generated 1794 derivative records from 24353 primary records. [2025-09-29T22:11:52.691323] [DEBUG] [LOCAL ] MBI: Saving derivative data. [2025-09-29T22:11:52.717957] [DEBUG] [MAIN ] MBC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:52.719601] [INFO ] [MAIN ] MBC: Generated 1794 derivative records from 43180 primary records. [2025-09-29T22:11:52.720234] [DEBUG] [LOCAL ] MBC: Saving derivative data. [2025-09-29T22:11:52.738684] [DEBUG] [LOCAL ] MBI: Derivative data saved (1794 records). [2025-09-29T22:11:52.741419] [INFO ] [MAIN ] MBI: Successfully saved derivative data. [2025-09-29T22:11:52.743282] [INFO ] [MAIN ] Derivative Progress: 1111/2057 symbols completed. MBI took 1.2s. Estimated remaining: 6m 25s. Rate: 147.3 symbols/min [2025-09-29T22:11:52.743575] [INFO ] [MAIN ] MCB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:52.760388] [DEBUG] [LOCAL ] MBC: Derivative data saved (1794 records). [2025-09-29T22:11:52.760666] [INFO ] [MAIN ] MBC: Successfully saved derivative data. [2025-09-29T22:11:52.760981] [DEBUG] [MAIN ] MC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:52.763096] [INFO ] [MAIN ] Derivative Progress: 1112/2057 symbols completed. MBC took 1.2s. Estimated remaining: 6m 24s. Rate: 147.5 symbols/min [2025-09-29T22:11:52.764053] [INFO ] [MAIN ] MC: Generated 1794 derivative records from 44106 primary records. [2025-09-29T22:11:52.764428] [DEBUG] [LOCAL ] MC: Saving derivative data. [2025-09-29T22:11:52.764214] [INFO ] [MAIN ] MCI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:52.787435] [DEBUG] [LOCAL ] MCB: Loaded 11659 existing records from primary storage. [2025-09-29T22:11:52.790053] [INFO ] [MAIN ] MCB: Loaded 11659 primary data records. [2025-09-29T22:11:52.796746] [DEBUG] [LOCAL ] MC: Derivative data saved (1794 records). [2025-09-29T22:11:52.797046] [DEBUG] [LOCAL ] MCI: Loaded 6387 existing records from primary storage. [2025-09-29T22:11:52.809027] [INFO ] [MAIN ] MC: Successfully saved derivative data. [2025-09-29T22:11:52.802491] [INFO ] [MAIN ] MCI: Loaded 6387 primary data records. [2025-09-29T22:11:52.841401] [INFO ] [MAIN ] Derivative Progress: 1113/2057 symbols completed. MC took 1.3s. Estimated remaining: 6m 24s. Rate: 147.6 symbols/min [2025-09-29T22:11:52.917833] [INFO ] [MAIN ] MCK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:53.512548] [DEBUG] [LOCAL ] MCK: Loaded 39218 existing records from primary storage. [2025-09-29T22:11:53.513502] [INFO ] [MAIN ] MCK: Loaded 39218 primary data records. [2025-09-29T22:11:53.750042] [DEBUG] [MAIN ] MCB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:53.778931] [INFO ] [MAIN ] MCB: Generated 1794 derivative records from 11659 primary records. [2025-09-29T22:11:53.926908] [DEBUG] [LOCAL ] MCB: Saving derivative data. [2025-09-29T22:11:53.967037] [DEBUG] [MAIN ] MCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:53.968096] [INFO ] [MAIN ] MCI: Generated 1794 derivative records from 6387 primary records. [2025-09-29T22:11:53.968193] [DEBUG] [LOCAL ] MCI: Saving derivative data. [2025-09-29T22:11:54.014201] [DEBUG] [LOCAL ] MCB: Derivative data saved (1794 records). [2025-09-29T22:11:54.014852] [INFO ] [MAIN ] MCB: Successfully saved derivative data. [2025-09-29T22:11:54.028928] [INFO ] [MAIN ] Derivative Progress: 1114/2057 symbols completed. MCB took 1.3s. Estimated remaining: 6m 24s. Rate: 147.3 symbols/min [2025-09-29T22:11:54.029567] [INFO ] [MAIN ] MCN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:54.045857] [DEBUG] [LOCAL ] MCI: Derivative data saved (1794 records). [2025-09-29T22:11:54.053147] [INFO ] [MAIN ] MCI: Successfully saved derivative data. [2025-09-29T22:11:54.064253] [INFO ] [MAIN ] Derivative Progress: 1115/2057 symbols completed. MCI took 1.3s. Estimated remaining: 6m 23s. Rate: 147.4 symbols/min [2025-09-29T22:11:54.064637] [INFO ] [MAIN ] MCO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:54.060610] [DEBUG] [MAIN ] MCK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:54.066682] [INFO ] [MAIN ] MCK: Generated 1794 derivative records from 39218 primary records. [2025-09-29T22:11:54.066769] [DEBUG] [LOCAL ] MCK: Saving derivative data. [2025-09-29T22:11:54.091586] [DEBUG] [LOCAL ] MCN: Loaded 8133 existing records from primary storage. [2025-09-29T22:11:54.091793] [INFO ] [MAIN ] MCN: Loaded 8133 primary data records. [2025-09-29T22:11:54.198285] [DEBUG] [LOCAL ] MCK: Derivative data saved (1794 records). [2025-09-29T22:11:54.218869] [INFO ] [MAIN ] MCK: Successfully saved derivative data. [2025-09-29T22:11:54.222709] [INFO ] [MAIN ] Derivative Progress: 1116/2057 symbols completed. MCK took 1.3s. Estimated remaining: 6m 23s. Rate: 147.5 symbols/min [2025-09-29T22:11:54.223188] [INFO ] [MAIN ] MCR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:54.307708] [DEBUG] [LOCAL ] MCR: Loaded 8763 existing records from primary storage. [2025-09-29T22:11:54.319031] [INFO ] [MAIN ] MCR: Loaded 8763 primary data records. [2025-09-29T22:11:54.374835] [DEBUG] [LOCAL ] MCO: Loaded 39341 existing records from primary storage. [2025-09-29T22:11:54.455531] [INFO ] [MAIN ] MCO: Loaded 39341 primary data records. [2025-09-29T22:11:55.337321] [DEBUG] [MAIN ] MCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:55.339935] [INFO ] [MAIN ] MCN: Generated 1794 derivative records from 8133 primary records. [2025-09-29T22:11:55.340180] [DEBUG] [LOCAL ] MCN: Saving derivative data. [2025-09-29T22:11:55.372049] [DEBUG] [MAIN ] MCR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:55.374078] [INFO ] [MAIN ] MCR: Generated 1794 derivative records from 8763 primary records. [2025-09-29T22:11:55.375814] [DEBUG] [LOCAL ] MCR: Saving derivative data. [2025-09-29T22:11:55.390320] [DEBUG] [LOCAL ] MCN: Derivative data saved (1794 records). [2025-09-29T22:11:55.392990] [INFO ] [MAIN ] MCN: Successfully saved derivative data. [2025-09-29T22:11:55.404603] [DEBUG] [LOCAL ] MCR: Derivative data saved (1794 records). [2025-09-29T22:11:55.396584] [INFO ] [MAIN ] Derivative Progress: 1117/2057 symbols completed. MCN took 1.4s. Estimated remaining: 6m 23s. Rate: 147.3 symbols/min [2025-09-29T22:11:55.409708] [INFO ] [MAIN ] MCR: Successfully saved derivative data. [2025-09-29T22:11:55.409874] [INFO ] [MAIN ] MCS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:55.412698] [INFO ] [MAIN ] Derivative Progress: 1118/2057 symbols completed. MCR took 1.2s. Estimated remaining: 6m 22s. Rate: 147.4 symbols/min [2025-09-29T22:11:55.413434] [DEBUG] [MAIN ] MCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:55.412956] [INFO ] [MAIN ] MCY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:55.414889] [INFO ] [MAIN ] MCO: Generated 1794 derivative records from 39341 primary records. [2025-09-29T22:11:55.415001] [DEBUG] [LOCAL ] MCO: Saving derivative data. [2025-09-29T22:11:55.440576] [DEBUG] [LOCAL ] MCO: Derivative data saved (1794 records). [2025-09-29T22:11:55.454854] [DEBUG] [LOCAL ] MCS: Loaded 20946 existing records from primary storage. [2025-09-29T22:11:55.455165] [INFO ] [MAIN ] MCO: Successfully saved derivative data. [2025-09-29T22:11:55.455265] [INFO ] [MAIN ] MCS: Loaded 20946 primary data records. [2025-09-29T22:11:55.463231] [INFO ] [MAIN ] Derivative Progress: 1119/2057 symbols completed. MCO took 1.4s. Estimated remaining: 6m 22s. Rate: 147.5 symbols/min [2025-09-29T22:11:55.480821] [INFO ] [MAIN ] MD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:55.588141] [DEBUG] [LOCAL ] MCY: Loaded 24642 existing records from primary storage. [2025-09-29T22:11:55.590569] [INFO ] [MAIN ] MCY: Loaded 24642 primary data records. [2025-09-29T22:11:55.988036] [DEBUG] [LOCAL ] MD: Loaded 38420 existing records from primary storage. [2025-09-29T22:11:55.994166] [INFO ] [MAIN ] MD: Loaded 38420 primary data records. [2025-09-29T22:11:56.561334] [DEBUG] [MAIN ] MCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:56.563485] [INFO ] [MAIN ] MCS: Generated 1794 derivative records from 20946 primary records. [2025-09-29T22:11:56.563968] [DEBUG] [LOCAL ] MCS: Saving derivative data. [2025-09-29T22:11:56.579049] [DEBUG] [MAIN ] MCY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:56.579863] [INFO ] [MAIN ] MCY: Generated 1794 derivative records from 24642 primary records. [2025-09-29T22:11:56.580279] [DEBUG] [LOCAL ] MCY: Saving derivative data. [2025-09-29T22:11:56.610191] [DEBUG] [LOCAL ] MCY: Derivative data saved (1794 records). [2025-09-29T22:11:56.611093] [INFO ] [MAIN ] MCY: Successfully saved derivative data. [2025-09-29T22:11:56.613341] [INFO ] [MAIN ] Derivative Progress: 1120/2057 symbols completed. MCY took 1.2s. Estimated remaining: 6m 22s. Rate: 147.3 symbols/min [2025-09-29T22:11:56.614077] [INFO ] [MAIN ] MDST: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:56.621791] [DEBUG] [LOCAL ] MCS: Derivative data saved (1794 records). [2025-09-29T22:11:56.621963] [INFO ] [MAIN ] MCS: Successfully saved derivative data. [2025-09-29T22:11:56.624304] [INFO ] [MAIN ] Derivative Progress: 1121/2057 symbols completed. MCS took 1.2s. Estimated remaining: 6m 21s. Rate: 147.4 symbols/min [2025-09-29T22:11:56.624631] [INFO ] [MAIN ] MDT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:56.640259] [DEBUG] [MAIN ] MD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:56.641115] [INFO ] [MAIN ] MD: Generated 1794 derivative records from 38420 primary records. [2025-09-29T22:11:56.645680] [DEBUG] [LOCAL ] MD: Saving derivative data. [2025-09-29T22:11:56.645521] [DEBUG] [LOCAL ] MDST: Loaded 5616 existing records from primary storage. [2025-09-29T22:11:56.646732] [INFO ] [MAIN ] MDST: Loaded 5616 primary data records. [2025-09-29T22:11:56.775709] [DEBUG] [LOCAL ] MD: Derivative data saved (1794 records). [2025-09-29T22:11:56.775992] [INFO ] [MAIN ] MD: Successfully saved derivative data. [2025-09-29T22:11:56.778347] [INFO ] [MAIN ] Derivative Progress: 1122/2057 symbols completed. MD took 1.3s. Estimated remaining: 6m 20s. Rate: 147.5 symbols/min [2025-09-29T22:11:56.789474] [INFO ] [MAIN ] MDU: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:57.020576] [DEBUG] [LOCAL ] MDT: Loaded 53678 existing records from primary storage. [2025-09-29T22:11:57.021368] [INFO ] [MAIN ] MDT: Loaded 53678 primary data records. [2025-09-29T22:11:57.355738] [DEBUG] [LOCAL ] MDU: Loaded 47900 existing records from primary storage. [2025-09-29T22:11:57.370348] [INFO ] [MAIN ] MDU: Loaded 47900 primary data records. [2025-09-29T22:11:57.751828] [DEBUG] [MAIN ] MDST: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:11:57.753046] [INFO ] [MAIN ] MDST: Generated 1793 derivative records from 5616 primary records. [2025-09-29T22:11:57.753198] [DEBUG] [LOCAL ] MDST: Saving derivative data. [2025-09-29T22:11:57.773139] [DEBUG] [LOCAL ] MDST: Derivative data saved (1793 records). [2025-09-29T22:11:57.775080] [INFO ] [MAIN ] MDST: Successfully saved derivative data. [2025-09-29T22:11:57.778341] [INFO ] [MAIN ] Derivative Progress: 1123/2057 symbols completed. MDST took 1.2s. Estimated remaining: 6m 20s. Rate: 147.3 symbols/min [2025-09-29T22:11:57.793128] [DEBUG] [MAIN ] MDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:57.794163] [INFO ] [MAIN ] MDT: Generated 1794 derivative records from 53678 primary records. [2025-09-29T22:11:57.794439] [DEBUG] [LOCAL ] MDT: Saving derivative data. [2025-09-29T22:11:57.826021] [DEBUG] [LOCAL ] MDT: Derivative data saved (1794 records). [2025-09-29T22:11:57.825954] [DEBUG] [MAIN ] MDU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:57.826152] [INFO ] [MAIN ] MDT: Successfully saved derivative data. [2025-09-29T22:11:57.828409] [INFO ] [MAIN ] Derivative Progress: 1124/2057 symbols completed. MDT took 1.2s. Estimated remaining: 6m 20s. Rate: 147.4 symbols/min [2025-09-29T22:11:57.829273] [INFO ] [MAIN ] MDU: Generated 1794 derivative records from 47900 primary records. [2025-09-29T22:11:57.829338] [DEBUG] [LOCAL ] MDU: Saving derivative data. [2025-09-29T22:11:57.844803] [DEBUG] [LOCAL ] MDU: Derivative data saved (1794 records). [2025-09-29T22:11:57.844879] [INFO ] [MAIN ] MDU: Successfully saved derivative data. [2025-09-29T22:11:57.847035] [INFO ] [MAIN ] Derivative Progress: 1125/2057 symbols completed. MDU took 1.1s. Estimated remaining: 6m 19s. Rate: 147.5 symbols/min [2025-09-29T22:11:57.847419] [INFO ] [MAIN ] MDV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:57.847500] [INFO ] [MAIN ] MEC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:57.847577] [INFO ] [MAIN ] MED: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:57.867618] [DEBUG] [LOCAL ] MDV: Loaded 8553 existing records from primary storage. [2025-09-29T22:11:57.868157] [INFO ] [MAIN ] MDV: Loaded 8553 primary data records. [2025-09-29T22:11:57.878521] [DEBUG] [LOCAL ] MEC: Loaded 16296 existing records from primary storage. [2025-09-29T22:11:57.884021] [INFO ] [MAIN ] MEC: Loaded 16296 primary data records. [2025-09-29T22:11:57.975220] [DEBUG] [LOCAL ] MED: Loaded 21598 existing records from primary storage. [2025-09-29T22:11:58.049086] [INFO ] [MAIN ] MED: Loaded 21598 primary data records. [2025-09-29T22:11:58.889151] [DEBUG] [MAIN ] MDV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:58.892752] [INFO ] [MAIN ] MDV: Generated 1794 derivative records from 8553 primary records. [2025-09-29T22:11:58.893132] [DEBUG] [LOCAL ] MDV: Saving derivative data. [2025-09-29T22:11:58.907240] [DEBUG] [MAIN ] MEC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:58.918007] [INFO ] [MAIN ] MEC: Generated 1794 derivative records from 16296 primary records. [2025-09-29T22:11:58.921888] [DEBUG] [LOCAL ] MEC: Saving derivative data. [2025-09-29T22:11:58.928606] [DEBUG] [LOCAL ] MDV: Derivative data saved (1794 records). [2025-09-29T22:11:58.945006] [INFO ] [MAIN ] MDV: Successfully saved derivative data. [2025-09-29T22:11:58.955364] [INFO ] [MAIN ] Derivative Progress: 1126/2057 symbols completed. MDV took 1.1s. Estimated remaining: 6m 19s. Rate: 147.3 symbols/min [2025-09-29T22:11:58.955793] [INFO ] [MAIN ] MEG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:58.958518] [DEBUG] [MAIN ] MED: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:11:58.959995] [INFO ] [MAIN ] MED: Generated 1794 derivative records from 21598 primary records. [2025-09-29T22:11:58.960726] [DEBUG] [LOCAL ] MED: Saving derivative data. [2025-09-29T22:11:58.972356] [DEBUG] [LOCAL ] MEC: Derivative data saved (1794 records). [2025-09-29T22:11:58.976289] [INFO ] [MAIN ] MEC: Successfully saved derivative data. [2025-09-29T22:11:58.979908] [DEBUG] [LOCAL ] MED: Derivative data saved (1794 records). [2025-09-29T22:11:58.982831] [INFO ] [MAIN ] Derivative Progress: 1127/2057 symbols completed. MEC took 1.1s. Estimated remaining: 6m 18s. Rate: 147.4 symbols/min [2025-09-29T22:11:58.983051] [INFO ] [MAIN ] MED: Successfully saved derivative data. [2025-09-29T22:11:58.985622] [INFO ] [MAIN ] MEGI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:58.985741] [INFO ] [MAIN ] Derivative Progress: 1128/2057 symbols completed. MED took 1.1s. Estimated remaining: 6m 18s. Rate: 147.6 symbols/min [2025-09-29T22:11:58.986341] [INFO ] [MAIN ] MEI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:11:59.021537] [DEBUG] [LOCAL ] MEG: Loaded 31838 existing records from primary storage. [2025-09-29T22:11:59.022257] [INFO ] [MAIN ] MEG: Loaded 31838 primary data records. [2025-09-29T22:11:59.107871] [DEBUG] [LOCAL ] MEGI: Loaded 20146 existing records from primary storage. [2025-09-29T22:11:59.120448] [INFO ] [MAIN ] MEGI: Loaded 20146 primary data records. [2025-09-29T22:11:59.313227] [DEBUG] [LOCAL ] MEI: Loaded 32162 existing records from primary storage. [2025-09-29T22:11:59.460223] [INFO ] [MAIN ] MEI: Loaded 32162 primary data records. [2025-09-29T22:12:00.090523] [DEBUG] [MAIN ] MEG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:00.092468] [INFO ] [MAIN ] MEG: Generated 1794 derivative records from 31838 primary records. [2025-09-29T22:12:00.093527] [DEBUG] [LOCAL ] MEG: Saving derivative data. [2025-09-29T22:12:00.120290] [DEBUG] [MAIN ] MEGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:00.122302] [INFO ] [MAIN ] MEGI: Generated 1794 derivative records from 20146 primary records. [2025-09-29T22:12:00.123365] [DEBUG] [LOCAL ] MEGI: Saving derivative data. [2025-09-29T22:12:00.146501] [DEBUG] [LOCAL ] MEGI: Derivative data saved (1794 records). [2025-09-29T22:12:00.146584] [DEBUG] [LOCAL ] MEG: Derivative data saved (1794 records). [2025-09-29T22:12:00.147014] [INFO ] [MAIN ] MEGI: Successfully saved derivative data. [2025-09-29T22:12:00.149678] [INFO ] [MAIN ] Derivative Progress: 1129/2057 symbols completed. MEGI took 1.2s. Estimated remaining: 6m 18s. Rate: 147.3 symbols/min [2025-09-29T22:12:00.147237] [INFO ] [MAIN ] MEG: Successfully saved derivative data. [2025-09-29T22:12:00.163068] [INFO ] [MAIN ] MET: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:00.165904] [DEBUG] [MAIN ] MEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:00.166760] [INFO ] [MAIN ] MEI: Generated 1794 derivative records from 32162 primary records. [2025-09-29T22:12:00.166932] [DEBUG] [LOCAL ] MEI: Saving derivative data. [2025-09-29T22:12:00.165384] [INFO ] [MAIN ] Derivative Progress: 1130/2057 symbols completed. MEG took 1.2s. Estimated remaining: 6m 17s. Rate: 147.4 symbols/min [2025-09-29T22:12:00.167527] [INFO ] [MAIN ] MFA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:00.187453] [DEBUG] [LOCAL ] MEI: Derivative data saved (1794 records). [2025-09-29T22:12:00.187597] [INFO ] [MAIN ] MEI: Successfully saved derivative data. [2025-09-29T22:12:00.189951] [INFO ] [MAIN ] Derivative Progress: 1131/2057 symbols completed. MEI took 1.2s. Estimated remaining: 6m 17s. Rate: 147.6 symbols/min [2025-09-29T22:12:00.190141] [INFO ] [MAIN ] MFAN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:00.200602] [DEBUG] [LOCAL ] MFAN: Loaded 4198 existing records from primary storage. [2025-09-29T22:12:00.200777] [INFO ] [MAIN ] MFAN: Loaded 4198 primary data records. [2025-09-29T22:12:00.400066] [DEBUG] [LOCAL ] MFA: Loaded 45387 existing records from primary storage. [2025-09-29T22:12:00.547204] [INFO ] [MAIN ] MFA: Loaded 45387 primary data records. [2025-09-29T22:12:00.572392] [DEBUG] [LOCAL ] MET: Loaded 53311 existing records from primary storage. [2025-09-29T22:12:00.613713] [INFO ] [MAIN ] MET: Loaded 53311 primary data records. [2025-09-29T22:12:01.271786] [DEBUG] [MAIN ] MFAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:01.272897] [INFO ] [MAIN ] MFAN: Generated 1794 derivative records from 4198 primary records. [2025-09-29T22:12:01.273691] [DEBUG] [LOCAL ] MFAN: Saving derivative data. [2025-09-29T22:12:01.297371] [DEBUG] [LOCAL ] MFAN: Derivative data saved (1794 records). [2025-09-29T22:12:01.297556] [INFO ] [MAIN ] MFAN: Successfully saved derivative data. [2025-09-29T22:12:01.300836] [INFO ] [MAIN ] Derivative Progress: 1132/2057 symbols completed. MFAN took 1.1s. Estimated remaining: 6m 17s. Rate: 147.3 symbols/min [2025-09-29T22:12:01.301422] [INFO ] [MAIN ] MFAO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:01.318294] [DEBUG] [MAIN ] MFA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:01.319619] [INFO ] [MAIN ] MFA: Generated 1794 derivative records from 45387 primary records. [2025-09-29T22:12:01.333439] [DEBUG] [MAIN ] MET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:01.333894] [DEBUG] [LOCAL ] MFA: Saving derivative data. [2025-09-29T22:12:01.347327] [INFO ] [MAIN ] MET: Generated 1794 derivative records from 53311 primary records. [2025-09-29T22:12:01.353844] [DEBUG] [LOCAL ] MET: Saving derivative data. [2025-09-29T22:12:01.357444] [DEBUG] [LOCAL ] MFA: Derivative data saved (1794 records). [2025-09-29T22:12:01.358768] [INFO ] [MAIN ] MFA: Successfully saved derivative data. [2025-09-29T22:12:01.363137] [INFO ] [MAIN ] Derivative Progress: 1133/2057 symbols completed. MFA took 1.2s. Estimated remaining: 6m 16s. Rate: 147.4 symbols/min [2025-09-29T22:12:01.363397] [DEBUG] [LOCAL ] MFAO: Loaded 3789 existing records from primary storage. [2025-09-29T22:12:01.363983] [INFO ] [MAIN ] MFC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:01.371539] [INFO ] [MAIN ] MFAO: Loaded 3789 primary data records. [2025-09-29T22:12:01.520377] [DEBUG] [LOCAL ] MET: Derivative data saved (1794 records). [2025-09-29T22:12:01.536404] [INFO ] [MAIN ] MET: Successfully saved derivative data. [2025-09-29T22:12:01.560024] [INFO ] [MAIN ] Derivative Progress: 1134/2057 symbols completed. MET took 1.4s. Estimated remaining: 6m 15s. Rate: 147.5 symbols/min [2025-09-29T22:12:01.594183] [INFO ] [MAIN ] MFG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:01.757887] [DEBUG] [LOCAL ] MFC: Loaded 51201 existing records from primary storage. [2025-09-29T22:12:01.758299] [INFO ] [MAIN ] MFC: Loaded 51201 primary data records. [2025-09-29T22:12:02.185851] [DEBUG] [LOCAL ] MFG: Loaded 49118 existing records from primary storage. [2025-09-29T22:12:02.187460] [DEBUG] [MAIN ] MFAO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:02.187587] [INFO ] [MAIN ] MFG: Loaded 49118 primary data records. [2025-09-29T22:12:02.188695] [INFO ] [MAIN ] MFAO: Generated 1794 derivative records from 3789 primary records. [2025-09-29T22:12:02.194020] [DEBUG] [LOCAL ] MFAO: Saving derivative data. [2025-09-29T22:12:02.358816] [DEBUG] [LOCAL ] MFAO: Derivative data saved (1794 records). [2025-09-29T22:12:02.419566] [INFO ] [MAIN ] MFAO: Successfully saved derivative data. [2025-09-29T22:12:02.530599] [INFO ] [MAIN ] Derivative Progress: 1135/2057 symbols completed. MFAO took 1.2s. Estimated remaining: 6m 15s. Rate: 147.3 symbols/min [2025-09-29T22:12:02.545461] [INFO ] [MAIN ] MFM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:02.572848] [DEBUG] [MAIN ] MFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:02.574008] [INFO ] [MAIN ] MFC: Generated 1794 derivative records from 51201 primary records. [2025-09-29T22:12:02.574219] [DEBUG] [LOCAL ] MFC: Saving derivative data. [2025-09-29T22:12:02.589775] [DEBUG] [LOCAL ] MFM: Loaded 14381 existing records from primary storage. [2025-09-29T22:12:02.594319] [INFO ] [MAIN ] MFM: Loaded 14381 primary data records. [2025-09-29T22:12:02.710710] [DEBUG] [LOCAL ] MFC: Derivative data saved (1794 records). [2025-09-29T22:12:02.764163] [INFO ] [MAIN ] MFC: Successfully saved derivative data. [2025-09-29T22:12:02.799031] [INFO ] [MAIN ] Derivative Progress: 1136/2057 symbols completed. MFC took 1.4s. Estimated remaining: 6m 15s. Rate: 147.4 symbols/min [2025-09-29T22:12:02.904220] [INFO ] [MAIN ] MFSG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:02.933774] [DEBUG] [MAIN ] MFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:02.934403] [INFO ] [MAIN ] MFG: Generated 1794 derivative records from 49118 primary records. [2025-09-29T22:12:02.934467] [DEBUG] [LOCAL ] MFG: Saving derivative data. [2025-09-29T22:12:02.956888] [DEBUG] [LOCAL ] MFSG: Loaded 5270 existing records from primary storage. [2025-09-29T22:12:02.957856] [INFO ] [MAIN ] MFSG: Loaded 5270 primary data records. [2025-09-29T22:12:03.012142] [DEBUG] [LOCAL ] MFG: Derivative data saved (1794 records). [2025-09-29T22:12:03.048615] [INFO ] [MAIN ] MFG: Successfully saved derivative data. [2025-09-29T22:12:03.067408] [INFO ] [MAIN ] Derivative Progress: 1137/2057 symbols completed. MFG took 1.5s. Estimated remaining: 6m 14s. Rate: 147.4 symbols/min [2025-09-29T22:12:03.080441] [INFO ] [MAIN ] MFSI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:03.298605] [DEBUG] [LOCAL ] MFSI: Loaded 11308 existing records from primary storage. [2025-09-29T22:12:03.306617] [INFO ] [MAIN ] MFSI: Loaded 11308 primary data records. [2025-09-29T22:12:03.353181] [DEBUG] [MAIN ] MFM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:03.389970] [INFO ] [MAIN ] MFM: Generated 1794 derivative records from 14381 primary records. [2025-09-29T22:12:03.410867] [DEBUG] [LOCAL ] MFM: Saving derivative data. [2025-09-29T22:12:03.668898] [DEBUG] [LOCAL ] MFM: Derivative data saved (1794 records). [2025-09-29T22:12:03.670769] [INFO ] [MAIN ] MFM: Successfully saved derivative data. [2025-09-29T22:12:03.673035] [INFO ] [MAIN ] Derivative Progress: 1138/2057 symbols completed. MFM took 1.1s. Estimated remaining: 6m 14s. Rate: 147.4 symbols/min [2025-09-29T22:12:03.689996] [DEBUG] [MAIN ] MFSG: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:12:03.691158] [INFO ] [MAIN ] MFSG: Generated 1793 derivative records from 5270 primary records. [2025-09-29T22:12:03.691355] [DEBUG] [LOCAL ] MFSG: Saving derivative data. [2025-09-29T22:12:03.709578] [DEBUG] [LOCAL ] MFSG: Derivative data saved (1793 records). [2025-09-29T22:12:03.709777] [INFO ] [MAIN ] MFSG: Successfully saved derivative data. [2025-09-29T22:12:03.712496] [INFO ] [MAIN ] Derivative Progress: 1139/2057 symbols completed. MFSG took 0.8s. Estimated remaining: 6m 13s. Rate: 147.5 symbols/min [2025-09-29T22:12:03.728542] [DEBUG] [MAIN ] MFSI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:03.729323] [INFO ] [MAIN ] MFSI: Generated 1794 derivative records from 11308 primary records. [2025-09-29T22:12:03.729391] [DEBUG] [LOCAL ] MFSI: Saving derivative data. [2025-09-29T22:12:03.745668] [DEBUG] [LOCAL ] MFSI: Derivative data saved (1794 records). [2025-09-29T22:12:03.745813] [INFO ] [MAIN ] MFSI: Successfully saved derivative data. [2025-09-29T22:12:03.747722] [INFO ] [MAIN ] Derivative Progress: 1140/2057 symbols completed. MFSI took 0.7s. Estimated remaining: 6m 13s. Rate: 147.6 symbols/min [2025-09-29T22:12:03.748206] [INFO ] [MAIN ] MG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:03.748145] [INFO ] [MAIN ] MGA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:03.748399] [INFO ] [MAIN ] MFSV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:03.755703] [DEBUG] [LOCAL ] MFSV: Loaded 2499 existing records from primary storage. [2025-09-29T22:12:03.755947] [INFO ] [MAIN ] MFSV: Loaded 2499 primary data records. [2025-09-29T22:12:03.876047] [DEBUG] [LOCAL ] MG: Loaded 16410 existing records from primary storage. [2025-09-29T22:12:03.887415] [INFO ] [MAIN ] MG: Loaded 16410 primary data records. [2025-09-29T22:12:04.285134] [DEBUG] [LOCAL ] MGA: Loaded 50645 existing records from primary storage. [2025-09-29T22:12:04.315271] [INFO ] [MAIN ] MGA: Loaded 50645 primary data records. [2025-09-29T22:12:04.824744] [DEBUG] [MAIN ] MFSV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:12:04.826133] [INFO ] [MAIN ] MFSV: Generated 1793 derivative records from 2499 primary records. [2025-09-29T22:12:04.826257] [DEBUG] [LOCAL ] MFSV: Saving derivative data. [2025-09-29T22:12:04.857958] [DEBUG] [MAIN ] MG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:04.860568] [INFO ] [MAIN ] MG: Generated 1794 derivative records from 16410 primary records. [2025-09-29T22:12:04.862472] [DEBUG] [LOCAL ] MG: Saving derivative data. [2025-09-29T22:12:04.862328] [DEBUG] [LOCAL ] MFSV: Derivative data saved (1793 records). [2025-09-29T22:12:04.863866] [INFO ] [MAIN ] MFSV: Successfully saved derivative data. [2025-09-29T22:12:04.866023] [INFO ] [MAIN ] Derivative Progress: 1141/2057 symbols completed. MFSV took 1.1s. Estimated remaining: 6m 13s. Rate: 147.4 symbols/min [2025-09-29T22:12:04.873403] [INFO ] [MAIN ] MGF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:04.882559] [DEBUG] [LOCAL ] MG: Derivative data saved (1794 records). [2025-09-29T22:12:04.882995] [INFO ] [MAIN ] MG: Successfully saved derivative data. [2025-09-29T22:12:04.885217] [INFO ] [MAIN ] Derivative Progress: 1142/2057 symbols completed. MG took 1.1s. Estimated remaining: 6m 12s. Rate: 147.5 symbols/min [2025-09-29T22:12:04.885459] [INFO ] [MAIN ] MGM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:04.893876] [DEBUG] [LOCAL ] MGF: Loaded 4186 existing records from primary storage. [2025-09-29T22:12:04.902129] [INFO ] [MAIN ] MGF: Loaded 4186 primary data records. [2025-09-29T22:12:04.940504] [DEBUG] [MAIN ] MGA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:04.976920] [INFO ] [MAIN ] MGA: Generated 1794 derivative records from 50645 primary records. [2025-09-29T22:12:05.006586] [DEBUG] [LOCAL ] MGA: Saving derivative data. [2025-09-29T22:12:05.272557] [DEBUG] [LOCAL ] MGA: Derivative data saved (1794 records). [2025-09-29T22:12:05.275853] [DEBUG] [LOCAL ] MGM: Loaded 53608 existing records from primary storage. [2025-09-29T22:12:05.274412] [INFO ] [MAIN ] MGA: Successfully saved derivative data. [2025-09-29T22:12:05.278246] [INFO ] [MAIN ] Derivative Progress: 1143/2057 symbols completed. MGA took 1.5s. Estimated remaining: 6m 12s. Rate: 147.5 symbols/min [2025-09-29T22:12:05.278684] [INFO ] [MAIN ] MGM: Loaded 53608 primary data records. [2025-09-29T22:12:05.279432] [INFO ] [MAIN ] MGR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:05.396726] [DEBUG] [LOCAL ] MGR: Loaded 5598 existing records from primary storage. [2025-09-29T22:12:05.396941] [INFO ] [MAIN ] MGR: Loaded 5598 primary data records. [2025-09-29T22:12:05.779407] [DEBUG] [MAIN ] MGF: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:12:05.819858] [INFO ] [MAIN ] MGF: Generated 1793 derivative records from 4186 primary records. [2025-09-29T22:12:05.977158] [DEBUG] [LOCAL ] MGF: Saving derivative data. [2025-09-29T22:12:06.009818] [DEBUG] [LOCAL ] MGF: Derivative data saved (1793 records). [2025-09-29T22:12:06.010852] [INFO ] [MAIN ] MGF: Successfully saved derivative data. [2025-09-29T22:12:06.013282] [INFO ] [MAIN ] Derivative Progress: 1144/2057 symbols completed. MGF took 1.1s. Estimated remaining: 6m 12s. Rate: 147.4 symbols/min [2025-09-29T22:12:06.014146] [INFO ] [MAIN ] MGRB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:06.037270] [DEBUG] [LOCAL ] MGRB: Loaded 4057 existing records from primary storage. [2025-09-29T22:12:06.039415] [INFO ] [MAIN ] MGRB: Loaded 4057 primary data records. [2025-09-29T22:12:06.040961] [DEBUG] [MAIN ] MGM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:06.060318] [INFO ] [MAIN ] MGM: Generated 1794 derivative records from 53608 primary records. [2025-09-29T22:12:06.078725] [DEBUG] [LOCAL ] MGM: Saving derivative data. [2025-09-29T22:12:06.156196] [DEBUG] [MAIN ] MGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:06.172163] [INFO ] [MAIN ] MGR: Generated 1794 derivative records from 5598 primary records. [2025-09-29T22:12:06.184741] [DEBUG] [LOCAL ] MGR: Saving derivative data. [2025-09-29T22:12:06.311445] [DEBUG] [LOCAL ] MGR: Derivative data saved (1794 records). [2025-09-29T22:12:06.344747] [INFO ] [MAIN ] MGR: Successfully saved derivative data. [2025-09-29T22:12:06.411541] [INFO ] [MAIN ] Derivative Progress: 1145/2057 symbols completed. MGR took 1.1s. Estimated remaining: 6m 11s. Rate: 147.4 symbols/min [2025-09-29T22:12:06.312762] [DEBUG] [LOCAL ] MGM: Derivative data saved (1794 records). [2025-09-29T22:12:06.425991] [INFO ] [MAIN ] MGM: Successfully saved derivative data. [2025-09-29T22:12:06.426163] [INFO ] [MAIN ] MGRD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:06.428614] [INFO ] [MAIN ] Derivative Progress: 1146/2057 symbols completed. MGM took 1.5s. Estimated remaining: 6m 11s. Rate: 147.5 symbols/min [2025-09-29T22:12:06.429024] [INFO ] [MAIN ] MGRE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:06.436683] [DEBUG] [LOCAL ] MGRD: Loaded 2194 existing records from primary storage. [2025-09-29T22:12:06.436910] [INFO ] [MAIN ] MGRD: Loaded 2194 primary data records. [2025-09-29T22:12:06.513955] [DEBUG] [LOCAL ] MGRE: Loaded 6643 existing records from primary storage. [2025-09-29T22:12:06.532015] [INFO ] [MAIN ] MGRE: Loaded 6643 primary data records. [2025-09-29T22:12:06.962561] [DEBUG] [MAIN ] MGRB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:06.982987] [INFO ] [MAIN ] MGRB: Generated 1794 derivative records from 4057 primary records. [2025-09-29T22:12:06.996852] [DEBUG] [LOCAL ] MGRB: Saving derivative data. [2025-09-29T22:12:07.146198] [DEBUG] [LOCAL ] MGRB: Derivative data saved (1794 records). [2025-09-29T22:12:07.146755] [INFO ] [MAIN ] MGRB: Successfully saved derivative data. [2025-09-29T22:12:07.149217] [INFO ] [MAIN ] Derivative Progress: 1147/2057 symbols completed. MGRB took 1.1s. Estimated remaining: 6m 10s. Rate: 147.4 symbols/min [2025-09-29T22:12:07.149809] [INFO ] [MAIN ] MGY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:07.170482] [DEBUG] [MAIN ] MGRD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:07.171606] [INFO ] [MAIN ] MGRD: Generated 1794 derivative records from 2194 primary records. [2025-09-29T22:12:07.171962] [DEBUG] [LOCAL ] MGRD: Saving derivative data. [2025-09-29T22:12:07.191560] [DEBUG] [LOCAL ] MGRD: Derivative data saved (1794 records). [2025-09-29T22:12:07.200129] [INFO ] [MAIN ] MGRD: Successfully saved derivative data. [2025-09-29T22:12:07.207206] [INFO ] [MAIN ] Derivative Progress: 1148/2057 symbols completed. MGRD took 0.8s. Estimated remaining: 6m 10s. Rate: 147.5 symbols/min [2025-09-29T22:12:07.208124] [INFO ] [MAIN ] MHD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:07.207999] [DEBUG] [MAIN ] MGRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:07.209153] [INFO ] [MAIN ] MGRE: Generated 1794 derivative records from 6643 primary records. [2025-09-29T22:12:07.223414] [DEBUG] [LOCAL ] MGRE: Saving derivative data. [2025-09-29T22:12:07.262850] [DEBUG] [LOCAL ] MHD: Loaded 12230 existing records from primary storage. [2025-09-29T22:12:07.264254] [DEBUG] [LOCAL ] MGY: Loaded 52421 existing records from primary storage. [2025-09-29T22:12:07.264504] [INFO ] [MAIN ] MHD: Loaded 12230 primary data records. [2025-09-29T22:12:07.264433] [DEBUG] [LOCAL ] MGRE: Derivative data saved (1794 records). [2025-09-29T22:12:07.264782] [INFO ] [MAIN ] MGRE: Successfully saved derivative data. [2025-09-29T22:12:07.264670] [INFO ] [MAIN ] MGY: Loaded 52421 primary data records. [2025-09-29T22:12:07.304632] [INFO ] [MAIN ] Derivative Progress: 1149/2057 symbols completed. MGRE took 0.9s. Estimated remaining: 6m 9s. Rate: 147.6 symbols/min [2025-09-29T22:12:07.343719] [INFO ] [MAIN ] MHF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:07.512392] [DEBUG] [LOCAL ] MHF: Loaded 8646 existing records from primary storage. [2025-09-29T22:12:07.528081] [INFO ] [MAIN ] MHF: Loaded 8646 primary data records. [2025-09-29T22:12:08.326877] [DEBUG] [MAIN ] MHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:08.329401] [INFO ] [MAIN ] MHD: Generated 1794 derivative records from 12230 primary records. [2025-09-29T22:12:08.330447] [DEBUG] [LOCAL ] MHD: Saving derivative data. [2025-09-29T22:12:08.360607] [DEBUG] [MAIN ] MGY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:08.366251] [INFO ] [MAIN ] MGY: Generated 1794 derivative records from 52421 primary records. [2025-09-29T22:12:08.365218] [DEBUG] [LOCAL ] MHD: Derivative data saved (1794 records). [2025-09-29T22:12:08.367423] [INFO ] [MAIN ] MHD: Successfully saved derivative data. [2025-09-29T22:12:08.369756] [INFO ] [MAIN ] Derivative Progress: 1150/2057 symbols completed. MHD took 1.2s. Estimated remaining: 6m 9s. Rate: 147.4 symbols/min [2025-09-29T22:12:08.370818] [INFO ] [MAIN ] MHK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:08.370607] [DEBUG] [LOCAL ] MGY: Saving derivative data. [2025-09-29T22:12:08.395449] [DEBUG] [MAIN ] MHF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:08.399497] [INFO ] [MAIN ] MHF: Generated 1794 derivative records from 8646 primary records. [2025-09-29T22:12:08.400379] [DEBUG] [LOCAL ] MHF: Saving derivative data. [2025-09-29T22:12:08.419562] [DEBUG] [LOCAL ] MHF: Derivative data saved (1794 records). [2025-09-29T22:12:08.418953] [DEBUG] [LOCAL ] MGY: Derivative data saved (1794 records). [2025-09-29T22:12:08.419790] [INFO ] [MAIN ] MHF: Successfully saved derivative data. [2025-09-29T22:12:08.419899] [INFO ] [MAIN ] MGY: Successfully saved derivative data. [2025-09-29T22:12:08.421952] [INFO ] [MAIN ] Derivative Progress: 1151/2057 symbols completed. MHF took 1.1s. Estimated remaining: 6m 8s. Rate: 147.5 symbols/min [2025-09-29T22:12:08.424892] [INFO ] [MAIN ] MHN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:08.425015] [INFO ] [MAIN ] Derivative Progress: 1152/2057 symbols completed. MGY took 1.3s. Estimated remaining: 6m 8s. Rate: 147.7 symbols/min [2025-09-29T22:12:08.425665] [INFO ] [MAIN ] MHO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:08.446957] [DEBUG] [LOCAL ] MHN: Loaded 7704 existing records from primary storage. [2025-09-29T22:12:08.447342] [INFO ] [MAIN ] MHN: Loaded 7704 primary data records. [2025-09-29T22:12:08.536370] [DEBUG] [LOCAL ] MHK: Loaded 42333 existing records from primary storage. [2025-09-29T22:12:08.564066] [INFO ] [MAIN ] MHK: Loaded 42333 primary data records. [2025-09-29T22:12:08.666195] [DEBUG] [LOCAL ] MHO: Loaded 24091 existing records from primary storage. [2025-09-29T22:12:08.689027] [INFO ] [MAIN ] MHO: Loaded 24091 primary data records. [2025-09-29T22:12:09.479569] [DEBUG] [MAIN ] MHN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:09.494973] [INFO ] [MAIN ] MHN: Generated 1794 derivative records from 7704 primary records. [2025-09-29T22:12:09.495498] [DEBUG] [LOCAL ] MHN: Saving derivative data. [2025-09-29T22:12:09.495396] [DEBUG] [MAIN ] MHK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:09.497860] [INFO ] [MAIN ] MHK: Generated 1794 derivative records from 42333 primary records. [2025-09-29T22:12:09.497982] [DEBUG] [LOCAL ] MHK: Saving derivative data. [2025-09-29T22:12:09.532310] [DEBUG] [LOCAL ] MHK: Derivative data saved (1794 records). [2025-09-29T22:12:09.533865] [INFO ] [MAIN ] MHK: Successfully saved derivative data. [2025-09-29T22:12:09.536919] [INFO ] [MAIN ] Derivative Progress: 1153/2057 symbols completed. MHK took 1.2s. Estimated remaining: 6m 8s. Rate: 147.4 symbols/min [2025-09-29T22:12:09.541471] [DEBUG] [LOCAL ] MHN: Derivative data saved (1794 records). [2025-09-29T22:12:09.542540] [INFO ] [MAIN ] MHN: Successfully saved derivative data. [2025-09-29T22:12:09.545506] [INFO ] [MAIN ] Derivative Progress: 1154/2057 symbols completed. MHN took 1.1s. Estimated remaining: 6m 7s. Rate: 147.6 symbols/min [2025-09-29T22:12:09.559124] [DEBUG] [MAIN ] MHO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:09.559746] [INFO ] [MAIN ] MHO: Generated 1794 derivative records from 24091 primary records. [2025-09-29T22:12:09.559812] [DEBUG] [LOCAL ] MHO: Saving derivative data. [2025-09-29T22:12:09.576141] [DEBUG] [LOCAL ] MHO: Derivative data saved (1794 records). [2025-09-29T22:12:09.576205] [INFO ] [MAIN ] MHO: Successfully saved derivative data. [2025-09-29T22:12:09.578219] [INFO ] [MAIN ] Derivative Progress: 1155/2057 symbols completed. MHO took 1.2s. Estimated remaining: 6m 6s. Rate: 147.7 symbols/min [2025-09-29T22:12:09.578807] [INFO ] [MAIN ] MIN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:09.578982] [INFO ] [MAIN ] MIR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:09.579397] [INFO ] [MAIN ] MITP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:09.586196] [DEBUG] [LOCAL ] MITP: Loaded 2411 existing records from primary storage. [2025-09-29T22:12:09.586501] [INFO ] [MAIN ] MITP: Loaded 2411 primary data records. [2025-09-29T22:12:09.717666] [DEBUG] [LOCAL ] MIN: Loaded 13101 existing records from primary storage. [2025-09-29T22:12:09.731204] [INFO ] [MAIN ] MIN: Loaded 13101 primary data records. [2025-09-29T22:12:10.208522] [DEBUG] [LOCAL ] MIR: Loaded 50898 existing records from primary storage. [2025-09-29T22:12:10.377713] [INFO ] [MAIN ] MIR: Loaded 50898 primary data records. [2025-09-29T22:12:10.746289] [DEBUG] [MAIN ] MITP: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:12:10.748175] [INFO ] [MAIN ] MITP: Generated 1793 derivative records from 2411 primary records. [2025-09-29T22:12:10.749153] [DEBUG] [LOCAL ] MITP: Saving derivative data. [2025-09-29T22:12:10.778601] [DEBUG] [MAIN ] MIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:10.781776] [INFO ] [MAIN ] MIN: Generated 1794 derivative records from 13101 primary records. [2025-09-29T22:12:10.782882] [DEBUG] [LOCAL ] MITP: Derivative data saved (1793 records). [2025-09-29T22:12:10.782780] [DEBUG] [LOCAL ] MIN: Saving derivative data. [2025-09-29T22:12:10.783476] [INFO ] [MAIN ] MITP: Successfully saved derivative data. [2025-09-29T22:12:10.787833] [INFO ] [MAIN ] Derivative Progress: 1156/2057 symbols completed. MITP took 1.2s. Estimated remaining: 6m 7s. Rate: 147.4 symbols/min [2025-09-29T22:12:10.788254] [INFO ] [MAIN ] MITT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:10.807155] [DEBUG] [LOCAL ] MIN: Derivative data saved (1794 records). [2025-09-29T22:12:10.807526] [INFO ] [MAIN ] MIN: Successfully saved derivative data. [2025-09-29T22:12:10.810297] [INFO ] [MAIN ] Derivative Progress: 1157/2057 symbols completed. MIN took 1.2s. Estimated remaining: 6m 6s. Rate: 147.5 symbols/min [2025-09-29T22:12:10.810546] [INFO ] [MAIN ] MIY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:10.835446] [DEBUG] [MAIN ] MIR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:10.836258] [INFO ] [MAIN ] MIR: Generated 1794 derivative records from 50898 primary records. [2025-09-29T22:12:10.836459] [DEBUG] [LOCAL ] MIR: Saving derivative data. [2025-09-29T22:12:10.854826] [DEBUG] [LOCAL ] MIY: Loaded 5996 existing records from primary storage. [2025-09-29T22:12:10.863725] [DEBUG] [LOCAL ] MITT: Loaded 22903 existing records from primary storage. [2025-09-29T22:12:10.863875] [INFO ] [MAIN ] MITT: Loaded 22903 primary data records. [2025-09-29T22:12:10.864191] [INFO ] [MAIN ] MIY: Loaded 5996 primary data records. [2025-09-29T22:12:11.025225] [DEBUG] [LOCAL ] MIR: Derivative data saved (1794 records). [2025-09-29T22:12:11.037045] [INFO ] [MAIN ] MIR: Successfully saved derivative data. [2025-09-29T22:12:11.085428] [INFO ] [MAIN ] Derivative Progress: 1158/2057 symbols completed. MIR took 1.5s. Estimated remaining: 6m 5s. Rate: 147.6 symbols/min [2025-09-29T22:12:11.085944] [INFO ] [MAIN ] MKC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:11.544751] [DEBUG] [LOCAL ] MKC: Loaded 52432 existing records from primary storage. [2025-09-29T22:12:11.545402] [INFO ] [MAIN ] MKC: Loaded 52432 primary data records. [2025-09-29T22:12:11.768331] [DEBUG] [MAIN ] MIY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:11.883035] [DEBUG] [MAIN ] MITT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:11.889483] [INFO ] [MAIN ] MIY: Generated 1794 derivative records from 5996 primary records. [2025-09-29T22:12:11.899727] [INFO ] [MAIN ] MITT: Generated 1794 derivative records from 22903 primary records. [2025-09-29T22:12:11.899892] [DEBUG] [LOCAL ] MITT: Saving derivative data. [2025-09-29T22:12:11.899995] [DEBUG] [LOCAL ] MIY: Saving derivative data. [2025-09-29T22:12:11.934915] [DEBUG] [LOCAL ] MIY: Derivative data saved (1794 records). [2025-09-29T22:12:11.935598] [INFO ] [MAIN ] MIY: Successfully saved derivative data. [2025-09-29T22:12:11.938865] [INFO ] [MAIN ] Derivative Progress: 1159/2057 symbols completed. MIY took 1.1s. Estimated remaining: 6m 5s. Rate: 147.5 symbols/min [2025-09-29T22:12:11.940372] [DEBUG] [LOCAL ] MITT: Derivative data saved (1794 records). [2025-09-29T22:12:11.939523] [INFO ] [MAIN ] MKL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:11.941212] [INFO ] [MAIN ] MITT: Successfully saved derivative data. [2025-09-29T22:12:11.943428] [INFO ] [MAIN ] Derivative Progress: 1160/2057 symbols completed. MITT took 1.2s. Estimated remaining: 6m 5s. Rate: 147.6 symbols/min [2025-09-29T22:12:11.943695] [INFO ] [MAIN ] MLI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:11.964942] [DEBUG] [MAIN ] MKC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:11.965846] [INFO ] [MAIN ] MKC: Generated 1794 derivative records from 52432 primary records. [2025-09-29T22:12:11.966094] [DEBUG] [LOCAL ] MKC: Saving derivative data. [2025-09-29T22:12:11.992053] [DEBUG] [LOCAL ] MKC: Derivative data saved (1794 records). [2025-09-29T22:12:12.001511] [INFO ] [MAIN ] MKC: Successfully saved derivative data. [2025-09-29T22:12:12.004030] [INFO ] [MAIN ] Derivative Progress: 1161/2057 symbols completed. MKC took 0.9s. Estimated remaining: 6m 4s. Rate: 147.7 symbols/min [2025-09-29T22:12:12.004406] [INFO ] [MAIN ] MLNK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:12.016269] [DEBUG] [LOCAL ] MKL: Loaded 34012 existing records from primary storage. [2025-09-29T22:12:12.016407] [INFO ] [MAIN ] MKL: Loaded 34012 primary data records. [2025-09-29T22:12:12.143863] [DEBUG] [LOCAL ] MLI: Loaded 43645 existing records from primary storage. [2025-09-29T22:12:12.197351] [INFO ] [MAIN ] MLI: Loaded 43645 primary data records. [2025-09-29T22:12:12.198273] [DEBUG] [LOCAL ] MLNK: Loaded 25428 existing records from primary storage. [2025-09-29T22:12:12.393702] [INFO ] [MAIN ] MLNK: Loaded 25428 primary data records. [2025-09-29T22:12:13.091842] [DEBUG] [MAIN ] MKL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:13.093960] [INFO ] [MAIN ] MKL: Generated 1794 derivative records from 34012 primary records. [2025-09-29T22:12:13.094298] [DEBUG] [LOCAL ] MKL: Saving derivative data. [2025-09-29T22:12:13.118189] [DEBUG] [LOCAL ] MKL: Derivative data saved (1794 records). [2025-09-29T22:12:13.119055] [INFO ] [MAIN ] MKL: Successfully saved derivative data. [2025-09-29T22:12:13.123542] [INFO ] [MAIN ] Derivative Progress: 1162/2057 symbols completed. MKL took 1.2s. Estimated remaining: 6m 4s. Rate: 147.5 symbols/min [2025-09-29T22:12:13.124183] [INFO ] [MAIN ] MLP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:13.148410] [DEBUG] [LOCAL ] MLP: Loaded 2991 existing records from primary storage. [2025-09-29T22:12:13.150160] [INFO ] [MAIN ] MLP: Loaded 2991 primary data records. [2025-09-29T22:12:13.155738] [DEBUG] [MAIN ] MLNK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:13.185522] [INFO ] [MAIN ] MLNK: Generated 1794 derivative records from 25428 primary records. [2025-09-29T22:12:13.198836] [DEBUG] [LOCAL ] MLNK: Saving derivative data. [2025-09-29T22:12:13.220780] [DEBUG] [MAIN ] MLI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:13.257150] [INFO ] [MAIN ] MLI: Generated 1794 derivative records from 43645 primary records. [2025-09-29T22:12:13.276122] [DEBUG] [LOCAL ] MLI: Saving derivative data. [2025-09-29T22:12:13.337319] [DEBUG] [LOCAL ] MLI: Derivative data saved (1794 records). [2025-09-29T22:12:13.343512] [INFO ] [MAIN ] MLI: Successfully saved derivative data. [2025-09-29T22:12:13.405610] [INFO ] [MAIN ] Derivative Progress: 1163/2057 symbols completed. MLI took 1.4s. Estimated remaining: 6m 4s. Rate: 147.5 symbols/min [2025-09-29T22:12:13.414529] [INFO ] [MAIN ] MLR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:13.414332] [DEBUG] [LOCAL ] MLNK: Derivative data saved (1794 records). [2025-09-29T22:12:13.432229] [INFO ] [MAIN ] MLNK: Successfully saved derivative data. [2025-09-29T22:12:13.439599] [INFO ] [MAIN ] Derivative Progress: 1164/2057 symbols completed. MLNK took 1.4s. Estimated remaining: 6m 3s. Rate: 147.6 symbols/min [2025-09-29T22:12:13.540171] [INFO ] [MAIN ] MMC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:13.557998] [DEBUG] [LOCAL ] MLR: Loaded 12553 existing records from primary storage. [2025-09-29T22:12:13.558535] [INFO ] [MAIN ] MLR: Loaded 12553 primary data records. [2025-09-29T22:12:13.796700] [DEBUG] [MAIN ] MLP: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:12:13.798391] [INFO ] [MAIN ] MLP: Generated 1793 derivative records from 2991 primary records. [2025-09-29T22:12:13.923038] [DEBUG] [LOCAL ] MLP: Saving derivative data. [2025-09-29T22:12:13.940699] [DEBUG] [LOCAL ] MMC: Loaded 51782 existing records from primary storage. [2025-09-29T22:12:13.948786] [INFO ] [MAIN ] MMC: Loaded 51782 primary data records. [2025-09-29T22:12:14.000575] [DEBUG] [LOCAL ] MLP: Derivative data saved (1793 records). [2025-09-29T22:12:14.029347] [INFO ] [MAIN ] MLP: Successfully saved derivative data. [2025-09-29T22:12:14.044556] [INFO ] [MAIN ] Derivative Progress: 1165/2057 symbols completed. MLP took 0.9s. Estimated remaining: 6m 3s. Rate: 147.6 symbols/min [2025-09-29T22:12:14.070033] [INFO ] [MAIN ] MMD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:14.348596] [DEBUG] [LOCAL ] MMD: Loaded 11387 existing records from primary storage. [2025-09-29T22:12:14.349529] [INFO ] [MAIN ] MMD: Loaded 11387 primary data records. [2025-09-29T22:12:14.459744] [DEBUG] [MAIN ] MLR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:14.480730] [INFO ] [MAIN ] MLR: Generated 1794 derivative records from 12553 primary records. [2025-09-29T22:12:14.505897] [DEBUG] [LOCAL ] MLR: Saving derivative data. [2025-09-29T22:12:14.740447] [DEBUG] [LOCAL ] MLR: Derivative data saved (1794 records). [2025-09-29T22:12:14.741584] [INFO ] [MAIN ] MLR: Successfully saved derivative data. [2025-09-29T22:12:14.744312] [INFO ] [MAIN ] Derivative Progress: 1166/2057 symbols completed. MLR took 1.3s. Estimated remaining: 6m 3s. Rate: 147.5 symbols/min [2025-09-29T22:12:14.759969] [INFO ] [MAIN ] MMI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:14.759846] [DEBUG] [MAIN ] MMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:14.761117] [INFO ] [MAIN ] MMC: Generated 1794 derivative records from 51782 primary records. [2025-09-29T22:12:14.762080] [DEBUG] [LOCAL ] MMC: Saving derivative data. [2025-09-29T22:12:14.793150] [DEBUG] [LOCAL ] MMC: Derivative data saved (1794 records). [2025-09-29T22:12:14.794049] [DEBUG] [LOCAL ] MMI: Loaded 15142 existing records from primary storage. [2025-09-29T22:12:14.794575] [INFO ] [MAIN ] MMI: Loaded 15142 primary data records. [2025-09-29T22:12:14.815974] [INFO ] [MAIN ] MMC: Successfully saved derivative data. [2025-09-29T22:12:14.859164] [INFO ] [MAIN ] Derivative Progress: 1167/2057 symbols completed. MMC took 1.3s. Estimated remaining: 6m 2s. Rate: 147.6 symbols/min [2025-09-29T22:12:14.888543] [INFO ] [MAIN ] MMM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:14.932275] [DEBUG] [MAIN ] MMD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:14.944222] [INFO ] [MAIN ] MMD: Generated 1794 derivative records from 11387 primary records. [2025-09-29T22:12:14.955700] [DEBUG] [LOCAL ] MMD: Saving derivative data. [2025-09-29T22:12:15.169546] [DEBUG] [LOCAL ] MMD: Derivative data saved (1794 records). [2025-09-29T22:12:15.170234] [INFO ] [MAIN ] MMD: Successfully saved derivative data. [2025-09-29T22:12:15.172724] [INFO ] [MAIN ] Derivative Progress: 1168/2057 symbols completed. MMD took 1.1s. Estimated remaining: 6m 1s. Rate: 147.6 symbols/min [2025-09-29T22:12:15.208710] [DEBUG] [MAIN ] MMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:15.209440] [INFO ] [MAIN ] MMI: Generated 1794 derivative records from 15142 primary records. [2025-09-29T22:12:15.209517] [DEBUG] [LOCAL ] MMI: Saving derivative data. [2025-09-29T22:12:15.239822] [DEBUG] [LOCAL ] MMM: Loaded 53201 existing records from primary storage. [2025-09-29T22:12:15.240283] [INFO ] [MAIN ] MMM: Loaded 53201 primary data records. [2025-09-29T22:12:15.350175] [DEBUG] [LOCAL ] MMI: Derivative data saved (1794 records). [2025-09-29T22:12:15.355987] [INFO ] [MAIN ] MMI: Successfully saved derivative data. [2025-09-29T22:12:15.374465] [INFO ] [MAIN ] Derivative Progress: 1169/2057 symbols completed. MMI took 0.6s. Estimated remaining: 6m 1s. Rate: 147.6 symbols/min [2025-09-29T22:12:15.571828] [DEBUG] [MAIN ] MMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:15.572562] [INFO ] [MAIN ] MMM: Generated 1794 derivative records from 53201 primary records. [2025-09-29T22:12:15.572631] [DEBUG] [LOCAL ] MMM: Saving derivative data. [2025-09-29T22:12:15.588354] [DEBUG] [LOCAL ] MMM: Derivative data saved (1794 records). [2025-09-29T22:12:15.588476] [INFO ] [MAIN ] MMM: Successfully saved derivative data. [2025-09-29T22:12:15.590552] [INFO ] [MAIN ] Derivative Progress: 1170/2057 symbols completed. MMM took 0.7s. Estimated remaining: 6m 0s. Rate: 147.7 symbols/min [2025-09-29T22:12:15.591143] [INFO ] [MAIN ] MMS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:15.591247] [INFO ] [MAIN ] MMT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:15.591319] [INFO ] [MAIN ] MMU: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:15.611396] [DEBUG] [LOCAL ] MMT: Loaded 10929 existing records from primary storage. [2025-09-29T22:12:15.611601] [INFO ] [MAIN ] MMT: Loaded 10929 primary data records. [2025-09-29T22:12:15.655240] [DEBUG] [LOCAL ] MMU: Loaded 16811 existing records from primary storage. [2025-09-29T22:12:15.705524] [INFO ] [MAIN ] MMU: Loaded 16811 primary data records. [2025-09-29T22:12:15.915342] [DEBUG] [LOCAL ] MMS: Loaded 33771 existing records from primary storage. [2025-09-29T22:12:15.946865] [INFO ] [MAIN ] MMS: Loaded 33771 primary data records. [2025-09-29T22:12:16.741891] [DEBUG] [MAIN ] MMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:16.757377] [INFO ] [MAIN ] MMT: Generated 1794 derivative records from 10929 primary records. [2025-09-29T22:12:16.758084] [DEBUG] [LOCAL ] MMT: Saving derivative data. [2025-09-29T22:12:16.758401] [DEBUG] [MAIN ] MMU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:16.759221] [INFO ] [MAIN ] MMU: Generated 1794 derivative records from 16811 primary records. [2025-09-29T22:12:16.759763] [DEBUG] [LOCAL ] MMU: Saving derivative data. [2025-09-29T22:12:16.785568] [DEBUG] [LOCAL ] MMT: Derivative data saved (1794 records). [2025-09-29T22:12:16.788929] [INFO ] [MAIN ] MMT: Successfully saved derivative data. [2025-09-29T22:12:16.791133] [INFO ] [MAIN ] Derivative Progress: 1171/2057 symbols completed. MMT took 1.2s. Estimated remaining: 6m 1s. Rate: 147.5 symbols/min [2025-09-29T22:12:16.792075] [INFO ] [MAIN ] MNR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:16.800166] [DEBUG] [LOCAL ] MMU: Derivative data saved (1794 records). [2025-09-29T22:12:16.800521] [INFO ] [MAIN ] MMU: Successfully saved derivative data. [2025-09-29T22:12:16.802903] [INFO ] [MAIN ] Derivative Progress: 1172/2057 symbols completed. MMU took 1.2s. Estimated remaining: 5m 60s. Rate: 147.6 symbols/min [2025-09-29T22:12:16.817262] [INFO ] [MAIN ] MNSO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:16.817772] [DEBUG] [MAIN ] MMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:16.819136] [INFO ] [MAIN ] MMS: Generated 1794 derivative records from 33771 primary records. [2025-09-29T22:12:16.819513] [DEBUG] [LOCAL ] MMS: Saving derivative data. [2025-09-29T22:12:16.845064] [DEBUG] [LOCAL ] MMS: Derivative data saved (1794 records). [2025-09-29T22:12:16.845231] [INFO ] [MAIN ] MMS: Successfully saved derivative data. [2025-09-29T22:12:16.847927] [INFO ] [MAIN ] Derivative Progress: 1173/2057 symbols completed. MMS took 1.3s. Estimated remaining: 5m 59s. Rate: 147.7 symbols/min [2025-09-29T22:12:16.848271] [INFO ] [MAIN ] MOD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:16.860055] [DEBUG] [LOCAL ] MNR: Loaded 24542 existing records from primary storage. [2025-09-29T22:12:16.860572] [INFO ] [MAIN ] MNR: Loaded 24542 primary data records. [2025-09-29T22:12:17.034792] [DEBUG] [LOCAL ] MNSO: Loaded 44433 existing records from primary storage. [2025-09-29T22:12:17.096039] [INFO ] [MAIN ] MNSO: Loaded 44433 primary data records. [2025-09-29T22:12:17.264818] [DEBUG] [LOCAL ] MOD: Loaded 45386 existing records from primary storage. [2025-09-29T22:12:17.305091] [INFO ] [MAIN ] MOD: Loaded 45386 primary data records. [2025-09-29T22:12:17.929542] [DEBUG] [MAIN ] MNR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:17.932301] [INFO ] [MAIN ] MNR: Generated 1794 derivative records from 24542 primary records. [2025-09-29T22:12:17.932777] [DEBUG] [LOCAL ] MNR: Saving derivative data. [2025-09-29T22:12:17.960075] [DEBUG] [LOCAL ] MNR: Derivative data saved (1794 records). [2025-09-29T22:12:17.960263] [INFO ] [MAIN ] MNR: Successfully saved derivative data. [2025-09-29T22:12:17.962461] [INFO ] [MAIN ] Derivative Progress: 1174/2057 symbols completed. MNR took 1.2s. Estimated remaining: 5m 59s. Rate: 147.5 symbols/min [2025-09-29T22:12:17.962974] [INFO ] [MAIN ] MODG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:17.980181] [DEBUG] [MAIN ] MNSO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:17.981158] [INFO ] [MAIN ] MNSO: Generated 1794 derivative records from 44433 primary records. [2025-09-29T22:12:17.994713] [DEBUG] [LOCAL ] MNSO: Saving derivative data. [2025-09-29T22:12:17.995420] [DEBUG] [MAIN ] MOD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:17.997361] [INFO ] [MAIN ] MOD: Generated 1794 derivative records from 45386 primary records. [2025-09-29T22:12:17.997866] [DEBUG] [LOCAL ] MOD: Saving derivative data. [2025-09-29T22:12:18.033475] [DEBUG] [LOCAL ] MNSO: Derivative data saved (1794 records). [2025-09-29T22:12:18.036127] [INFO ] [MAIN ] MNSO: Successfully saved derivative data. [2025-09-29T22:12:18.038981] [INFO ] [MAIN ] Derivative Progress: 1175/2057 symbols completed. MNSO took 1.2s. Estimated remaining: 5m 59s. Rate: 147.6 symbols/min [2025-09-29T22:12:18.039220] [INFO ] [MAIN ] MOH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:18.044609] [DEBUG] [LOCAL ] MOD: Derivative data saved (1794 records). [2025-09-29T22:12:18.044834] [INFO ] [MAIN ] MOD: Successfully saved derivative data. [2025-09-29T22:12:18.047792] [INFO ] [MAIN ] Derivative Progress: 1176/2057 symbols completed. MOD took 1.2s. Estimated remaining: 5m 58s. Rate: 147.7 symbols/min [2025-09-29T22:12:18.048116] [INFO ] [MAIN ] MOS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:18.099519] [DEBUG] [LOCAL ] MODG: Loaded 51575 existing records from primary storage. [2025-09-29T22:12:18.099961] [INFO ] [MAIN ] MODG: Loaded 51575 primary data records. [2025-09-29T22:12:18.238148] [DEBUG] [LOCAL ] MOH: Loaded 41824 existing records from primary storage. [2025-09-29T22:12:18.254059] [INFO ] [MAIN ] MOH: Loaded 41824 primary data records. [2025-09-29T22:12:18.653782] [DEBUG] [LOCAL ] MOS: Loaded 53505 existing records from primary storage. [2025-09-29T22:12:18.663502] [INFO ] [MAIN ] MOS: Loaded 53505 primary data records. [2025-09-29T22:12:19.218588] [DEBUG] [MAIN ] MODG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:19.219599] [INFO ] [MAIN ] MODG: Generated 1794 derivative records from 51575 primary records. [2025-09-29T22:12:19.219818] [DEBUG] [LOCAL ] MODG: Saving derivative data. [2025-09-29T22:12:19.250247] [DEBUG] [MAIN ] MOH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:19.252079] [INFO ] [MAIN ] MOH: Generated 1794 derivative records from 41824 primary records. [2025-09-29T22:12:19.252846] [DEBUG] [LOCAL ] MOH: Saving derivative data. [2025-09-29T22:12:19.269858] [DEBUG] [LOCAL ] MODG: Derivative data saved (1794 records). [2025-09-29T22:12:19.272165] [INFO ] [MAIN ] MODG: Successfully saved derivative data. [2025-09-29T22:12:19.274493] [INFO ] [MAIN ] Derivative Progress: 1177/2057 symbols completed. MODG took 1.3s. Estimated remaining: 5m 58s. Rate: 147.4 symbols/min [2025-09-29T22:12:19.275160] [INFO ] [MAIN ] MOV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:19.278784] [DEBUG] [LOCAL ] MOH: Derivative data saved (1794 records). [2025-09-29T22:12:19.278879] [INFO ] [MAIN ] MOH: Successfully saved derivative data. [2025-09-29T22:12:19.281678] [INFO ] [MAIN ] Derivative Progress: 1178/2057 symbols completed. MOH took 1.2s. Estimated remaining: 5m 57s. Rate: 147.6 symbols/min [2025-09-29T22:12:19.289873] [INFO ] [MAIN ] MP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:19.295281] [DEBUG] [MAIN ] MOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:19.296178] [INFO ] [MAIN ] MOS: Generated 1794 derivative records from 53505 primary records. [2025-09-29T22:12:19.296683] [DEBUG] [LOCAL ] MOS: Saving derivative data. [2025-09-29T22:12:19.319550] [DEBUG] [LOCAL ] MOS: Derivative data saved (1794 records). [2025-09-29T22:12:19.319781] [INFO ] [MAIN ] MOS: Successfully saved derivative data. [2025-09-29T22:12:19.321841] [INFO ] [MAIN ] Derivative Progress: 1179/2057 symbols completed. MOS took 1.3s. Estimated remaining: 5m 57s. Rate: 147.7 symbols/min [2025-09-29T22:12:19.322074] [INFO ] [MAIN ] MPA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:19.335521] [DEBUG] [LOCAL ] MOV: Loaded 22031 existing records from primary storage. [2025-09-29T22:12:19.335799] [INFO ] [MAIN ] MOV: Loaded 22031 primary data records. [2025-09-29T22:12:19.388710] [DEBUG] [LOCAL ] MPA: Loaded 5231 existing records from primary storage. [2025-09-29T22:12:19.432247] [INFO ] [MAIN ] MPA: Loaded 5231 primary data records. [2025-09-29T22:12:19.671721] [DEBUG] [LOCAL ] MP: Loaded 53669 existing records from primary storage. [2025-09-29T22:12:19.687103] [INFO ] [MAIN ] MP: Loaded 53669 primary data records. [2025-09-29T22:12:20.393497] [DEBUG] [MAIN ] MOV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:20.397256] [INFO ] [MAIN ] MOV: Generated 1794 derivative records from 22031 primary records. [2025-09-29T22:12:20.397598] [DEBUG] [LOCAL ] MOV: Saving derivative data. [2025-09-29T22:12:20.424408] [DEBUG] [MAIN ] MPA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:20.425976] [INFO ] [MAIN ] MPA: Generated 1794 derivative records from 5231 primary records. [2025-09-29T22:12:20.426680] [DEBUG] [LOCAL ] MPA: Saving derivative data. [2025-09-29T22:12:20.445581] [DEBUG] [LOCAL ] MOV: Derivative data saved (1794 records). [2025-09-29T22:12:20.446207] [INFO ] [MAIN ] MOV: Successfully saved derivative data. [2025-09-29T22:12:20.461211] [INFO ] [MAIN ] Derivative Progress: 1180/2057 symbols completed. MOV took 1.2s. Estimated remaining: 5m 57s. Rate: 147.5 symbols/min [2025-09-29T22:12:20.463412] [INFO ] [MAIN ] MPC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:20.463044] [DEBUG] [MAIN ] MP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:20.465506] [INFO ] [MAIN ] MP: Generated 1794 derivative records from 53669 primary records. [2025-09-29T22:12:20.466112] [DEBUG] [LOCAL ] MP: Saving derivative data. [2025-09-29T22:12:20.467953] [DEBUG] [LOCAL ] MPA: Derivative data saved (1794 records). [2025-09-29T22:12:20.468044] [INFO ] [MAIN ] MPA: Successfully saved derivative data. [2025-09-29T22:12:20.478964] [INFO ] [MAIN ] Derivative Progress: 1181/2057 symbols completed. MPA took 1.2s. Estimated remaining: 5m 56s. Rate: 147.6 symbols/min [2025-09-29T22:12:20.482259] [INFO ] [MAIN ] MPLX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:20.488426] [DEBUG] [LOCAL ] MP: Derivative data saved (1794 records). [2025-09-29T22:12:20.488541] [INFO ] [MAIN ] MP: Successfully saved derivative data. [2025-09-29T22:12:20.490586] [INFO ] [MAIN ] Derivative Progress: 1182/2057 symbols completed. MP took 1.2s. Estimated remaining: 5m 55s. Rate: 147.7 symbols/min [2025-09-29T22:12:20.490952] [INFO ] [MAIN ] MPV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:20.499544] [DEBUG] [LOCAL ] MPV: Loaded 4996 existing records from primary storage. [2025-09-29T22:12:20.500012] [INFO ] [MAIN ] MPV: Loaded 4996 primary data records. [2025-09-29T22:12:20.922891] [DEBUG] [LOCAL ] MPLX: Loaded 50731 existing records from primary storage. [2025-09-29T22:12:20.925579] [INFO ] [MAIN ] MPLX: Loaded 50731 primary data records. [2025-09-29T22:12:20.926543] [DEBUG] [LOCAL ] MPC: Loaded 52108 existing records from primary storage. [2025-09-29T22:12:20.951769] [INFO ] [MAIN ] MPC: Loaded 52108 primary data records. [2025-09-29T22:12:21.614446] [DEBUG] [MAIN ] MPV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:12:21.616187] [INFO ] [MAIN ] MPV: Generated 1793 derivative records from 4996 primary records. [2025-09-29T22:12:21.616634] [DEBUG] [LOCAL ] MPV: Saving derivative data. [2025-09-29T22:12:21.641631] [DEBUG] [LOCAL ] MPV: Derivative data saved (1793 records). [2025-09-29T22:12:21.643918] [INFO ] [MAIN ] MPV: Successfully saved derivative data. [2025-09-29T22:12:21.646575] [INFO ] [MAIN ] Derivative Progress: 1183/2057 symbols completed. MPV took 1.2s. Estimated remaining: 5m 56s. Rate: 147.5 symbols/min [2025-09-29T22:12:21.660587] [DEBUG] [MAIN ] MPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:21.673847] [DEBUG] [MAIN ] MPLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:21.674927] [INFO ] [MAIN ] MPC: Generated 1794 derivative records from 52108 primary records. [2025-09-29T22:12:21.675886] [INFO ] [MAIN ] MPLX: Generated 1794 derivative records from 50731 primary records. [2025-09-29T22:12:21.676000] [DEBUG] [LOCAL ] MPLX: Saving derivative data. [2025-09-29T22:12:21.676099] [DEBUG] [LOCAL ] MPC: Saving derivative data. [2025-09-29T22:12:21.712994] [DEBUG] [LOCAL ] MPLX: Derivative data saved (1794 records). [2025-09-29T22:12:21.713687] [INFO ] [MAIN ] MPLX: Successfully saved derivative data. [2025-09-29T22:12:21.715894] [INFO ] [MAIN ] Derivative Progress: 1184/2057 symbols completed. MPLX took 1.2s. Estimated remaining: 5m 55s. Rate: 147.6 symbols/min [2025-09-29T22:12:21.717155] [DEBUG] [LOCAL ] MPC: Derivative data saved (1794 records). [2025-09-29T22:12:21.717319] [INFO ] [MAIN ] MPC: Successfully saved derivative data. [2025-09-29T22:12:21.719802] [INFO ] [MAIN ] Derivative Progress: 1185/2057 symbols completed. MPC took 1.3s. Estimated remaining: 5m 54s. Rate: 147.7 symbols/min [2025-09-29T22:12:21.720327] [INFO ] [MAIN ] MPW: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:21.720466] [INFO ] [MAIN ] MQT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:21.720925] [INFO ] [MAIN ] MPX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:21.732353] [DEBUG] [LOCAL ] MPX: Loaded 4085 existing records from primary storage. [2025-09-29T22:12:21.732591] [INFO ] [MAIN ] MPX: Loaded 4085 primary data records. [2025-09-29T22:12:21.771991] [DEBUG] [LOCAL ] MQT: Loaded 8558 existing records from primary storage. [2025-09-29T22:12:21.799887] [INFO ] [MAIN ] MQT: Loaded 8558 primary data records. [2025-09-29T22:12:22.254100] [DEBUG] [LOCAL ] MPW: Loaded 53495 existing records from primary storage. [2025-09-29T22:12:22.300332] [INFO ] [MAIN ] MPW: Loaded 53495 primary data records. [2025-09-29T22:12:22.796846] [DEBUG] [MAIN ] MPX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:22.806915] [INFO ] [MAIN ] MPX: Generated 1794 derivative records from 4085 primary records. [2025-09-29T22:12:22.807047] [DEBUG] [LOCAL ] MPX: Saving derivative data. [2025-09-29T22:12:22.812736] [DEBUG] [MAIN ] MQT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:22.814695] [INFO ] [MAIN ] MQT: Generated 1794 derivative records from 8558 primary records. [2025-09-29T22:12:22.814895] [DEBUG] [LOCAL ] MQT: Saving derivative data. [2025-09-29T22:12:22.838009] [DEBUG] [LOCAL ] MPX: Derivative data saved (1794 records). [2025-09-29T22:12:22.838142] [INFO ] [MAIN ] MPX: Successfully saved derivative data. [2025-09-29T22:12:22.844027] [INFO ] [MAIN ] Derivative Progress: 1186/2057 symbols completed. MPX took 1.1s. Estimated remaining: 5m 54s. Rate: 147.5 symbols/min [2025-09-29T22:12:22.844433] [INFO ] [MAIN ] MQY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:22.863045] [DEBUG] [LOCAL ] MQT: Derivative data saved (1794 records). [2025-09-29T22:12:22.868602] [DEBUG] [MAIN ] MPW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:22.868840] [INFO ] [MAIN ] MQT: Successfully saved derivative data. [2025-09-29T22:12:22.872454] [INFO ] [MAIN ] MPW: Generated 1794 derivative records from 53495 primary records. [2025-09-29T22:12:22.871574] [INFO ] [MAIN ] Derivative Progress: 1187/2057 symbols completed. MQT took 1.2s. Estimated remaining: 5m 54s. Rate: 147.6 symbols/min [2025-09-29T22:12:22.877086] [DEBUG] [LOCAL ] MPW: Saving derivative data. [2025-09-29T22:12:22.877240] [INFO ] [MAIN ] MRC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:22.897125] [DEBUG] [LOCAL ] MQY: Loaded 16850 existing records from primary storage. [2025-09-29T22:12:22.897749] [INFO ] [MAIN ] MQY: Loaded 16850 primary data records. [2025-09-29T22:12:22.998349] [DEBUG] [LOCAL ] MPW: Derivative data saved (1794 records). [2025-09-29T22:12:23.020585] [INFO ] [MAIN ] MPW: Successfully saved derivative data. [2025-09-29T22:12:23.039256] [INFO ] [MAIN ] Derivative Progress: 1188/2057 symbols completed. MPW took 1.3s. Estimated remaining: 5m 53s. Rate: 147.7 symbols/min [2025-09-29T22:12:23.100608] [INFO ] [MAIN ] MRK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:23.260991] [DEBUG] [LOCAL ] MRC: Loaded 37586 existing records from primary storage. [2025-09-29T22:12:23.261308] [INFO ] [MAIN ] MRC: Loaded 37586 primary data records. [2025-09-29T22:12:23.639623] [DEBUG] [MAIN ] MQY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:23.640829] [INFO ] [MAIN ] MQY: Generated 1794 derivative records from 16850 primary records. [2025-09-29T22:12:23.657467] [DEBUG] [LOCAL ] MQY: Saving derivative data. [2025-09-29T22:12:23.661428] [DEBUG] [LOCAL ] MRK: Loaded 53789 existing records from primary storage. [2025-09-29T22:12:23.661802] [INFO ] [MAIN ] MRK: Loaded 53789 primary data records. [2025-09-29T22:12:23.866279] [DEBUG] [LOCAL ] MQY: Derivative data saved (1794 records). [2025-09-29T22:12:23.872806] [INFO ] [MAIN ] MQY: Successfully saved derivative data. [2025-09-29T22:12:24.012039] [DEBUG] [MAIN ] MRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:24.011515] [INFO ] [MAIN ] Derivative Progress: 1189/2057 symbols completed. MQY took 1.2s. Estimated remaining: 5m 53s. Rate: 147.5 symbols/min [2025-09-29T22:12:24.013275] [INFO ] [MAIN ] MRC: Generated 1794 derivative records from 37586 primary records. [2025-09-29T22:12:24.013519] [INFO ] [MAIN ] MS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:24.014473] [DEBUG] [LOCAL ] MRC: Saving derivative data. [2025-09-29T22:12:24.034240] [DEBUG] [LOCAL ] MRC: Derivative data saved (1794 records). [2025-09-29T22:12:24.034858] [INFO ] [MAIN ] MRC: Successfully saved derivative data. [2025-09-29T22:12:24.037252] [INFO ] [MAIN ] Derivative Progress: 1190/2057 symbols completed. MRC took 1.2s. Estimated remaining: 5m 52s. Rate: 147.6 symbols/min [2025-09-29T22:12:24.037554] [INFO ] [MAIN ] MSA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:24.060977] [DEBUG] [MAIN ] MRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:24.061778] [INFO ] [MAIN ] MRK: Generated 1794 derivative records from 53789 primary records. [2025-09-29T22:12:24.062059] [DEBUG] [LOCAL ] MRK: Saving derivative data. [2025-09-29T22:12:24.105234] [DEBUG] [LOCAL ] MRK: Derivative data saved (1794 records). [2025-09-29T22:12:24.105425] [INFO ] [MAIN ] MRK: Successfully saved derivative data. [2025-09-29T22:12:24.105131] [DEBUG] [LOCAL ] MSA: Loaded 18823 existing records from primary storage. [2025-09-29T22:12:24.105555] [INFO ] [MAIN ] MSA: Loaded 18823 primary data records. [2025-09-29T22:12:24.108148] [INFO ] [MAIN ] Derivative Progress: 1191/2057 symbols completed. MRK took 1.0s. Estimated remaining: 5m 52s. Rate: 147.7 symbols/min [2025-09-29T22:12:24.131215] [INFO ] [MAIN ] MSB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:24.222743] [DEBUG] [LOCAL ] MS: Loaded 53692 existing records from primary storage. [2025-09-29T22:12:24.236232] [INFO ] [MAIN ] MS: Loaded 53692 primary data records. [2025-09-29T22:12:24.392004] [DEBUG] [LOCAL ] MSB: Loaded 7854 existing records from primary storage. [2025-09-29T22:12:24.521279] [INFO ] [MAIN ] MSB: Loaded 7854 primary data records. [2025-09-29T22:12:25.209410] [DEBUG] [MAIN ] MSA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:25.210530] [INFO ] [MAIN ] MSA: Generated 1794 derivative records from 18823 primary records. [2025-09-29T22:12:25.210638] [DEBUG] [LOCAL ] MSA: Saving derivative data. [2025-09-29T22:12:25.250567] [DEBUG] [MAIN ] MS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:25.252575] [DEBUG] [LOCAL ] MSA: Derivative data saved (1794 records). [2025-09-29T22:12:25.253606] [INFO ] [MAIN ] MS: Generated 1794 derivative records from 53692 primary records. [2025-09-29T22:12:25.254460] [DEBUG] [LOCAL ] MS: Saving derivative data. [2025-09-29T22:12:25.254715] [INFO ] [MAIN ] MSA: Successfully saved derivative data. [2025-09-29T22:12:25.257966] [INFO ] [MAIN ] Derivative Progress: 1192/2057 symbols completed. MSA took 1.2s. Estimated remaining: 5m 52s. Rate: 147.5 symbols/min [2025-09-29T22:12:25.258381] [INFO ] [MAIN ] MSCI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:25.285965] [DEBUG] [MAIN ] MSB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:25.288263] [INFO ] [MAIN ] MSB: Generated 1794 derivative records from 7854 primary records. [2025-09-29T22:12:25.288724] [DEBUG] [LOCAL ] MSB: Saving derivative data. [2025-09-29T22:12:25.292447] [DEBUG] [LOCAL ] MS: Derivative data saved (1794 records). [2025-09-29T22:12:25.292885] [INFO ] [MAIN ] MS: Successfully saved derivative data. [2025-09-29T22:12:25.295302] [INFO ] [MAIN ] Derivative Progress: 1193/2057 symbols completed. MS took 1.3s. Estimated remaining: 5m 51s. Rate: 147.6 symbols/min [2025-09-29T22:12:25.303134] [INFO ] [MAIN ] MSD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:25.314399] [DEBUG] [LOCAL ] MSB: Derivative data saved (1794 records). [2025-09-29T22:12:25.314803] [INFO ] [MAIN ] MSB: Successfully saved derivative data. [2025-09-29T22:12:25.317560] [INFO ] [MAIN ] Derivative Progress: 1194/2057 symbols completed. MSB took 1.2s. Estimated remaining: 5m 51s. Rate: 147.7 symbols/min [2025-09-29T22:12:25.330330] [INFO ] [MAIN ] MSDL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:25.338596] [DEBUG] [LOCAL ] MSD: Loaded 15734 existing records from primary storage. [2025-09-29T22:12:25.338962] [INFO ] [MAIN ] MSD: Loaded 15734 primary data records. [2025-09-29T22:12:25.448920] [DEBUG] [LOCAL ] MSCI: Loaded 34572 existing records from primary storage. [2025-09-29T22:12:25.457617] [INFO ] [MAIN ] MSCI: Loaded 34572 primary data records. [2025-09-29T22:12:25.725770] [DEBUG] [LOCAL ] MSDL: Loaded 38124 existing records from primary storage. [2025-09-29T22:12:25.860345] [INFO ] [MAIN ] MSDL: Loaded 38124 primary data records. [2025-09-29T22:12:26.452051] [DEBUG] [MAIN ] MSCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:26.454398] [INFO ] [MAIN ] MSCI: Generated 1794 derivative records from 34572 primary records. [2025-09-29T22:12:26.454556] [DEBUG] [LOCAL ] MSCI: Saving derivative data. [2025-09-29T22:12:26.453157] [DEBUG] [MAIN ] MSD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:26.456153] [INFO ] [MAIN ] MSD: Generated 1794 derivative records from 15734 primary records. [2025-09-29T22:12:26.458064] [DEBUG] [LOCAL ] MSD: Saving derivative data. [2025-09-29T22:12:26.493333] [DEBUG] [LOCAL ] MSCI: Derivative data saved (1794 records). [2025-09-29T22:12:26.493526] [INFO ] [MAIN ] MSCI: Successfully saved derivative data. [2025-09-29T22:12:26.496173] [INFO ] [MAIN ] Derivative Progress: 1195/2057 symbols completed. MSCI took 1.2s. Estimated remaining: 5m 51s. Rate: 147.5 symbols/min [2025-09-29T22:12:26.496522] [INFO ] [MAIN ] MSGE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:26.500047] [DEBUG] [LOCAL ] MSD: Derivative data saved (1794 records). [2025-09-29T22:12:26.501913] [INFO ] [MAIN ] MSD: Successfully saved derivative data. [2025-09-29T22:12:26.505418] [INFO ] [MAIN ] Derivative Progress: 1196/2057 symbols completed. MSD took 1.2s. Estimated remaining: 5m 50s. Rate: 147.6 symbols/min [2025-09-29T22:12:26.506636] [INFO ] [MAIN ] MSGS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:26.522845] [DEBUG] [MAIN ] MSDL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:26.523819] [INFO ] [MAIN ] MSDL: Generated 1794 derivative records from 38124 primary records. [2025-09-29T22:12:26.523942] [DEBUG] [LOCAL ] MSDL: Saving derivative data. [2025-09-29T22:12:26.550220] [DEBUG] [LOCAL ] MSDL: Derivative data saved (1794 records). [2025-09-29T22:12:26.554172] [INFO ] [MAIN ] MSDL: Successfully saved derivative data. [2025-09-29T22:12:26.556498] [INFO ] [MAIN ] Derivative Progress: 1197/2057 symbols completed. MSDL took 1.2s. Estimated remaining: 5m 49s. Rate: 147.7 symbols/min [2025-09-29T22:12:26.556846] [INFO ] [MAIN ] MSI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:26.579222] [DEBUG] [LOCAL ] MSGE: Loaded 26891 existing records from primary storage. [2025-09-29T22:12:26.579430] [INFO ] [MAIN ] MSGE: Loaded 26891 primary data records. [2025-09-29T22:12:26.580182] [DEBUG] [LOCAL ] MSGS: Loaded 17098 existing records from primary storage. [2025-09-29T22:12:26.591997] [INFO ] [MAIN ] MSGS: Loaded 17098 primary data records. [2025-09-29T22:12:27.330186] [DEBUG] [LOCAL ] MSI: Loaded 40336 existing records from primary storage. [2025-09-29T22:12:27.347011] [INFO ] [MAIN ] MSI: Loaded 40336 primary data records. [2025-09-29T22:12:27.693970] [DEBUG] [MAIN ] MSGE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:27.696523] [INFO ] [MAIN ] MSGE: Generated 1794 derivative records from 26891 primary records. [2025-09-29T22:12:27.697406] [DEBUG] [LOCAL ] MSGE: Saving derivative data. [2025-09-29T22:12:27.734102] [DEBUG] [LOCAL ] MSGE: Derivative data saved (1794 records). [2025-09-29T22:12:27.734709] [DEBUG] [MAIN ] MSGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:27.734803] [INFO ] [MAIN ] MSGE: Successfully saved derivative data. [2025-09-29T22:12:27.737922] [INFO ] [MAIN ] Derivative Progress: 1198/2057 symbols completed. MSGE took 1.2s. Estimated remaining: 5m 49s. Rate: 147.5 symbols/min [2025-09-29T22:12:27.735638] [INFO ] [MAIN ] MSGS: Generated 1794 derivative records from 17098 primary records. [2025-09-29T22:12:27.738111] [DEBUG] [LOCAL ] MSGS: Saving derivative data. [2025-09-29T22:12:27.756418] [DEBUG] [LOCAL ] MSGS: Derivative data saved (1794 records). [2025-09-29T22:12:27.756848] [INFO ] [MAIN ] MSGS: Successfully saved derivative data. [2025-09-29T22:12:27.759317] [INFO ] [MAIN ] Derivative Progress: 1199/2057 symbols completed. MSGS took 1.3s. Estimated remaining: 5m 49s. Rate: 147.6 symbols/min [2025-09-29T22:12:27.776331] [DEBUG] [MAIN ] MSI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:27.777063] [INFO ] [MAIN ] MSI: Generated 1794 derivative records from 40336 primary records. [2025-09-29T22:12:27.777131] [DEBUG] [LOCAL ] MSI: Saving derivative data. [2025-09-29T22:12:27.792753] [DEBUG] [LOCAL ] MSI: Derivative data saved (1794 records). [2025-09-29T22:12:27.792813] [INFO ] [MAIN ] MSI: Successfully saved derivative data. [2025-09-29T22:12:27.795091] [INFO ] [MAIN ] Derivative Progress: 1200/2057 symbols completed. MSI took 1.2s. Estimated remaining: 5m 48s. Rate: 147.7 symbols/min [2025-09-29T22:12:27.795570] [INFO ] [MAIN ] MT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:27.795773] [INFO ] [MAIN ] MTAL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:27.795627] [INFO ] [MAIN ] MSM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:27.864614] [DEBUG] [LOCAL ] MSM: Loaded 35446 existing records from primary storage. [2025-09-29T22:12:27.867176] [INFO ] [MAIN ] MSM: Loaded 35446 primary data records. [2025-09-29T22:12:27.879404] [DEBUG] [LOCAL ] MTAL: Loaded 36514 existing records from primary storage. [2025-09-29T22:12:27.904199] [INFO ] [MAIN ] MTAL: Loaded 36514 primary data records. [2025-09-29T22:12:27.973784] [DEBUG] [LOCAL ] MT: Loaded 50612 existing records from primary storage. [2025-09-29T22:12:28.074085] [INFO ] [MAIN ] MT: Loaded 50612 primary data records. [2025-09-29T22:12:28.894438] [DEBUG] [MAIN ] MTAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:28.894929] [DEBUG] [MAIN ] MSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:28.897038] [INFO ] [MAIN ] MSM: Generated 1794 derivative records from 35446 primary records. [2025-09-29T22:12:28.896104] [INFO ] [MAIN ] MTAL: Generated 1794 derivative records from 36514 primary records. [2025-09-29T22:12:28.897337] [DEBUG] [LOCAL ] MTAL: Saving derivative data. [2025-09-29T22:12:28.897579] [DEBUG] [LOCAL ] MSM: Saving derivative data. [2025-09-29T22:12:28.931679] [DEBUG] [LOCAL ] MTAL: Derivative data saved (1794 records). [2025-09-29T22:12:28.934771] [INFO ] [MAIN ] MTAL: Successfully saved derivative data. [2025-09-29T22:12:28.933838] [DEBUG] [LOCAL ] MSM: Derivative data saved (1794 records). [2025-09-29T22:12:28.937755] [INFO ] [MAIN ] MSM: Successfully saved derivative data. [2025-09-29T22:12:28.937503] [INFO ] [MAIN ] Derivative Progress: 1201/2057 symbols completed. MTAL took 1.1s. Estimated remaining: 5m 48s. Rate: 147.5 symbols/min [2025-09-29T22:12:28.953292] [INFO ] [MAIN ] MTB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:28.953674] [DEBUG] [MAIN ] MT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:28.954367] [INFO ] [MAIN ] Derivative Progress: 1202/2057 symbols completed. MSM took 1.2s. Estimated remaining: 5m 48s. Rate: 147.6 symbols/min [2025-09-29T22:12:28.955210] [INFO ] [MAIN ] MT: Generated 1794 derivative records from 50612 primary records. [2025-09-29T22:12:28.955391] [DEBUG] [LOCAL ] MT: Saving derivative data. [2025-09-29T22:12:28.955322] [INFO ] [MAIN ] MTD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:28.973056] [DEBUG] [LOCAL ] MT: Derivative data saved (1794 records). [2025-09-29T22:12:28.973205] [INFO ] [MAIN ] MT: Successfully saved derivative data. [2025-09-29T22:12:28.975432] [INFO ] [MAIN ] Derivative Progress: 1203/2057 symbols completed. MT took 1.2s. Estimated remaining: 5m 47s. Rate: 147.7 symbols/min [2025-09-29T22:12:28.975732] [INFO ] [MAIN ] MTDR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:28.991169] [DEBUG] [LOCAL ] MTD: Loaded 15072 existing records from primary storage. [2025-09-29T22:12:28.991406] [INFO ] [MAIN ] MTD: Loaded 15072 primary data records. [2025-09-29T22:12:29.172475] [DEBUG] [LOCAL ] MTB: Loaded 46781 existing records from primary storage. [2025-09-29T22:12:29.181953] [INFO ] [MAIN ] MTB: Loaded 46781 primary data records. [2025-09-29T22:12:29.487278] [DEBUG] [LOCAL ] MTDR: Loaded 51558 existing records from primary storage. [2025-09-29T22:12:29.528827] [INFO ] [MAIN ] MTDR: Loaded 51558 primary data records. [2025-09-29T22:12:30.111297] [DEBUG] [MAIN ] MTD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:30.112276] [INFO ] [MAIN ] MTD: Generated 1794 derivative records from 15072 primary records. [2025-09-29T22:12:30.112537] [DEBUG] [LOCAL ] MTD: Saving derivative data. [2025-09-29T22:12:30.132607] [DEBUG] [LOCAL ] MTD: Derivative data saved (1794 records). [2025-09-29T22:12:30.132836] [INFO ] [MAIN ] MTD: Successfully saved derivative data. [2025-09-29T22:12:30.135564] [INFO ] [MAIN ] Derivative Progress: 1204/2057 symbols completed. MTD took 1.2s. Estimated remaining: 5m 47s. Rate: 147.5 symbols/min [2025-09-29T22:12:30.136400] [INFO ] [MAIN ] MTG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:30.157437] [DEBUG] [MAIN ] MTB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:30.158775] [INFO ] [MAIN ] MTB: Generated 1794 derivative records from 46781 primary records. [2025-09-29T22:12:30.159065] [DEBUG] [LOCAL ] MTB: Saving derivative data. [2025-09-29T22:12:30.179833] [DEBUG] [LOCAL ] MTB: Derivative data saved (1794 records). [2025-09-29T22:12:30.181979] [INFO ] [MAIN ] MTB: Successfully saved derivative data. [2025-09-29T22:12:30.185221] [INFO ] [MAIN ] Derivative Progress: 1205/2057 symbols completed. MTB took 1.2s. Estimated remaining: 5m 46s. Rate: 147.6 symbols/min [2025-09-29T22:12:30.185527] [INFO ] [MAIN ] MTH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:30.200136] [DEBUG] [MAIN ] MTDR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:30.200915] [INFO ] [MAIN ] MTDR: Generated 1794 derivative records from 51558 primary records. [2025-09-29T22:12:30.201074] [DEBUG] [LOCAL ] MTDR: Saving derivative data. [2025-09-29T22:12:30.217229] [DEBUG] [LOCAL ] MTDR: Derivative data saved (1794 records). [2025-09-29T22:12:30.217380] [INFO ] [MAIN ] MTDR: Successfully saved derivative data. [2025-09-29T22:12:30.219867] [INFO ] [MAIN ] Derivative Progress: 1206/2057 symbols completed. MTDR took 1.2s. Estimated remaining: 5m 46s. Rate: 147.7 symbols/min [2025-09-29T22:12:30.220111] [INFO ] [MAIN ] MTN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:30.266580] [DEBUG] [LOCAL ] MTG: Loaded 51299 existing records from primary storage. [2025-09-29T22:12:30.279814] [INFO ] [MAIN ] MTG: Loaded 51299 primary data records. [2025-09-29T22:12:30.280627] [DEBUG] [LOCAL ] MTH: Loaded 43822 existing records from primary storage. [2025-09-29T22:12:30.312211] [INFO ] [MAIN ] MTH: Loaded 43822 primary data records. [2025-09-29T22:12:30.500615] [DEBUG] [LOCAL ] MTN: Loaded 38902 existing records from primary storage. [2025-09-29T22:12:30.506381] [INFO ] [MAIN ] MTN: Loaded 38902 primary data records. [2025-09-29T22:12:31.340454] [DEBUG] [MAIN ] MTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:31.341578] [INFO ] [MAIN ] MTG: Generated 1794 derivative records from 51299 primary records. [2025-09-29T22:12:31.341859] [DEBUG] [LOCAL ] MTG: Saving derivative data. [2025-09-29T22:12:31.361900] [DEBUG] [LOCAL ] MTG: Derivative data saved (1794 records). [2025-09-29T22:12:31.363506] [INFO ] [MAIN ] MTG: Successfully saved derivative data. [2025-09-29T22:12:31.365875] [INFO ] [MAIN ] Derivative Progress: 1207/2057 symbols completed. MTG took 1.2s. Estimated remaining: 5m 46s. Rate: 147.5 symbols/min [2025-09-29T22:12:31.366893] [INFO ] [MAIN ] MTRN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:31.381983] [DEBUG] [MAIN ] MTH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:31.392297] [INFO ] [MAIN ] MTH: Generated 1794 derivative records from 43822 primary records. [2025-09-29T22:12:31.397934] [DEBUG] [LOCAL ] MTH: Saving derivative data. [2025-09-29T22:12:31.398456] [DEBUG] [MAIN ] MTN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:31.400243] [INFO ] [MAIN ] MTN: Generated 1794 derivative records from 38902 primary records. [2025-09-29T22:12:31.400704] [DEBUG] [LOCAL ] MTN: Saving derivative data. [2025-09-29T22:12:31.431989] [DEBUG] [LOCAL ] MTH: Derivative data saved (1794 records). [2025-09-29T22:12:31.435424] [INFO ] [MAIN ] MTH: Successfully saved derivative data. [2025-09-29T22:12:31.438320] [INFO ] [MAIN ] Derivative Progress: 1208/2057 symbols completed. MTH took 1.3s. Estimated remaining: 5m 45s. Rate: 147.6 symbols/min [2025-09-29T22:12:31.438503] [INFO ] [MAIN ] MTUS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:31.451321] [DEBUG] [LOCAL ] MTN: Derivative data saved (1794 records). [2025-09-29T22:12:31.451462] [INFO ] [MAIN ] MTN: Successfully saved derivative data. [2025-09-29T22:12:31.455873] [INFO ] [MAIN ] Derivative Progress: 1209/2057 symbols completed. MTN took 1.2s. Estimated remaining: 5m 44s. Rate: 147.7 symbols/min [2025-09-29T22:12:31.451925] [DEBUG] [LOCAL ] MTRN: Loaded 18039 existing records from primary storage. [2025-09-29T22:12:31.456286] [INFO ] [MAIN ] MTW: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:31.456469] [INFO ] [MAIN ] MTRN: Loaded 18039 primary data records. [2025-09-29T22:12:31.588911] [DEBUG] [LOCAL ] MTUS: Loaded 28394 existing records from primary storage. [2025-09-29T22:12:31.589030] [INFO ] [MAIN ] MTUS: Loaded 28394 primary data records. [2025-09-29T22:12:31.873574] [DEBUG] [LOCAL ] MTW: Loaded 26431 existing records from primary storage. [2025-09-29T22:12:31.974529] [INFO ] [MAIN ] MTW: Loaded 26431 primary data records. [2025-09-29T22:12:32.528015] [DEBUG] [MAIN ] MTRN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:32.530953] [INFO ] [MAIN ] MTRN: Generated 1794 derivative records from 18039 primary records. [2025-09-29T22:12:32.532055] [DEBUG] [LOCAL ] MTRN: Saving derivative data. [2025-09-29T22:12:32.559871] [DEBUG] [MAIN ] MTUS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:32.564436] [INFO ] [MAIN ] MTUS: Generated 1794 derivative records from 28394 primary records. [2025-09-29T22:12:32.563288] [DEBUG] [LOCAL ] MTRN: Derivative data saved (1794 records). [2025-09-29T22:12:32.564686] [DEBUG] [LOCAL ] MTUS: Saving derivative data. [2025-09-29T22:12:32.565429] [INFO ] [MAIN ] MTRN: Successfully saved derivative data. [2025-09-29T22:12:32.567976] [INFO ] [MAIN ] Derivative Progress: 1210/2057 symbols completed. MTRN took 1.2s. Estimated remaining: 5m 45s. Rate: 147.5 symbols/min [2025-09-29T22:12:32.576353] [INFO ] [MAIN ] MTX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:32.600908] [DEBUG] [LOCAL ] MTUS: Derivative data saved (1794 records). [2025-09-29T22:12:32.600372] [DEBUG] [MAIN ] MTW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:32.601028] [INFO ] [MAIN ] MTUS: Successfully saved derivative data. [2025-09-29T22:12:32.604440] [INFO ] [MAIN ] MTW: Generated 1794 derivative records from 26431 primary records. [2025-09-29T22:12:32.603544] [INFO ] [MAIN ] Derivative Progress: 1211/2057 symbols completed. MTUS took 1.2s. Estimated remaining: 5m 44s. Rate: 147.6 symbols/min [2025-09-29T22:12:32.604796] [INFO ] [MAIN ] MTZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:32.605262] [DEBUG] [LOCAL ] MTW: Saving derivative data. [2025-09-29T22:12:32.627993] [DEBUG] [LOCAL ] MTW: Derivative data saved (1794 records). [2025-09-29T22:12:32.635950] [INFO ] [MAIN ] MTW: Successfully saved derivative data. [2025-09-29T22:12:32.638807] [DEBUG] [LOCAL ] MTX: Loaded 22808 existing records from primary storage. [2025-09-29T22:12:32.638959] [INFO ] [MAIN ] MTX: Loaded 22808 primary data records. [2025-09-29T22:12:32.638097] [INFO ] [MAIN ] Derivative Progress: 1212/2057 symbols completed. MTW took 1.2s. Estimated remaining: 5m 43s. Rate: 147.7 symbols/min [2025-09-29T22:12:32.639253] [INFO ] [MAIN ] MUA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:32.825183] [DEBUG] [LOCAL ] MUA: Loaded 12245 existing records from primary storage. [2025-09-29T22:12:32.880913] [DEBUG] [LOCAL ] MTZ: Loaded 43082 existing records from primary storage. [2025-09-29T22:12:32.884388] [INFO ] [MAIN ] MUA: Loaded 12245 primary data records. [2025-09-29T22:12:33.002140] [INFO ] [MAIN ] MTZ: Loaded 43082 primary data records. [2025-09-29T22:12:33.713525] [DEBUG] [MAIN ] MTX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:33.714580] [INFO ] [MAIN ] MTX: Generated 1794 derivative records from 22808 primary records. [2025-09-29T22:12:33.714990] [DEBUG] [LOCAL ] MTX: Saving derivative data. [2025-09-29T22:12:33.735941] [DEBUG] [LOCAL ] MTX: Derivative data saved (1794 records). [2025-09-29T22:12:33.736409] [INFO ] [MAIN ] MTX: Successfully saved derivative data. [2025-09-29T22:12:33.738418] [INFO ] [MAIN ] Derivative Progress: 1213/2057 symbols completed. MTX took 1.2s. Estimated remaining: 5m 43s. Rate: 147.5 symbols/min [2025-09-29T22:12:33.754391] [DEBUG] [MAIN ] MUA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:33.755245] [INFO ] [MAIN ] MUA: Generated 1794 derivative records from 12245 primary records. [2025-09-29T22:12:33.755499] [DEBUG] [LOCAL ] MUA: Saving derivative data. [2025-09-29T22:12:33.773483] [DEBUG] [LOCAL ] MUA: Derivative data saved (1794 records). [2025-09-29T22:12:33.773605] [INFO ] [MAIN ] MUA: Successfully saved derivative data. [2025-09-29T22:12:33.776335] [INFO ] [MAIN ] Derivative Progress: 1214/2057 symbols completed. MUA took 1.1s. Estimated remaining: 5m 43s. Rate: 147.6 symbols/min [2025-09-29T22:12:33.790784] [DEBUG] [MAIN ] MTZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:33.791456] [INFO ] [MAIN ] MTZ: Generated 1794 derivative records from 43082 primary records. [2025-09-29T22:12:33.791523] [DEBUG] [LOCAL ] MTZ: Saving derivative data. [2025-09-29T22:12:33.807320] [DEBUG] [LOCAL ] MTZ: Derivative data saved (1794 records). [2025-09-29T22:12:33.807409] [INFO ] [MAIN ] MTZ: Successfully saved derivative data. [2025-09-29T22:12:33.809607] [INFO ] [MAIN ] Derivative Progress: 1215/2057 symbols completed. MTZ took 1.2s. Estimated remaining: 5m 42s. Rate: 147.7 symbols/min [2025-09-29T22:12:33.810283] [INFO ] [MAIN ] MUC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:33.810220] [INFO ] [MAIN ] MUE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:33.810550] [INFO ] [MAIN ] MUFG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:33.829636] [DEBUG] [LOCAL ] MUE: Loaded 11961 existing records from primary storage. [2025-09-29T22:12:33.829988] [INFO ] [MAIN ] MUE: Loaded 11961 primary data records. [2025-09-29T22:12:33.940998] [DEBUG] [LOCAL ] MUC: Loaded 20497 existing records from primary storage. [2025-09-29T22:12:33.949195] [INFO ] [MAIN ] MUC: Loaded 20497 primary data records. [2025-09-29T22:12:34.296418] [DEBUG] [LOCAL ] MUFG: Loaded 52580 existing records from primary storage. [2025-09-29T22:12:34.309356] [INFO ] [MAIN ] MUFG: Loaded 52580 primary data records. [2025-09-29T22:12:34.888767] [DEBUG] [MAIN ] MUE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:34.890452] [INFO ] [MAIN ] MUE: Generated 1794 derivative records from 11961 primary records. [2025-09-29T22:12:34.890876] [DEBUG] [LOCAL ] MUE: Saving derivative data. [2025-09-29T22:12:34.916229] [DEBUG] [LOCAL ] MUE: Derivative data saved (1794 records). [2025-09-29T22:12:34.916778] [INFO ] [MAIN ] MUE: Successfully saved derivative data. [2025-09-29T22:12:34.932449] [INFO ] [MAIN ] Derivative Progress: 1216/2057 symbols completed. MUE took 1.1s. Estimated remaining: 5m 42s. Rate: 147.5 symbols/min [2025-09-29T22:12:34.933475] [DEBUG] [MAIN ] MUC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:34.933923] [INFO ] [MAIN ] MUJ: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:34.934851] [INFO ] [MAIN ] MUC: Generated 1794 derivative records from 20497 primary records. [2025-09-29T22:12:34.935047] [DEBUG] [LOCAL ] MUC: Saving derivative data. [2025-09-29T22:12:34.953610] [DEBUG] [LOCAL ] MUC: Derivative data saved (1794 records). [2025-09-29T22:12:34.955332] [INFO ] [MAIN ] MUC: Successfully saved derivative data. [2025-09-29T22:12:34.958017] [INFO ] [MAIN ] Derivative Progress: 1217/2057 symbols completed. MUC took 1.1s. Estimated remaining: 5m 41s. Rate: 147.6 symbols/min [2025-09-29T22:12:34.958393] [INFO ] [MAIN ] MUR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:34.978700] [DEBUG] [MAIN ] MUFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:34.979541] [INFO ] [MAIN ] MUFG: Generated 1794 derivative records from 52580 primary records. [2025-09-29T22:12:34.979739] [DEBUG] [LOCAL ] MUFG: Saving derivative data. [2025-09-29T22:12:34.994920] [DEBUG] [LOCAL ] MUJ: Loaded 13159 existing records from primary storage. [2025-09-29T22:12:35.000126] [INFO ] [MAIN ] MUJ: Loaded 13159 primary data records. [2025-09-29T22:12:35.048711] [DEBUG] [LOCAL ] MUFG: Derivative data saved (1794 records). [2025-09-29T22:12:35.093587] [INFO ] [MAIN ] MUFG: Successfully saved derivative data. [2025-09-29T22:12:35.102831] [INFO ] [MAIN ] Derivative Progress: 1218/2057 symbols completed. MUFG took 1.3s. Estimated remaining: 5m 41s. Rate: 147.7 symbols/min [2025-09-29T22:12:35.109610] [INFO ] [MAIN ] MUSA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:35.383851] [DEBUG] [LOCAL ] MUR: Loaded 52928 existing records from primary storage. [2025-09-29T22:12:35.384117] [INFO ] [MAIN ] MUR: Loaded 52928 primary data records. [2025-09-29T22:12:35.464171] [DEBUG] [LOCAL ] MUSA: Loaded 24753 existing records from primary storage. [2025-09-29T22:12:35.502841] [INFO ] [MAIN ] MUSA: Loaded 24753 primary data records. [2025-09-29T22:12:36.114118] [DEBUG] [MAIN ] MUJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:36.116124] [INFO ] [MAIN ] MUJ: Generated 1794 derivative records from 13159 primary records. [2025-09-29T22:12:36.116729] [DEBUG] [LOCAL ] MUJ: Saving derivative data. [2025-09-29T22:12:36.143486] [DEBUG] [LOCAL ] MUJ: Derivative data saved (1794 records). [2025-09-29T22:12:36.151499] [INFO ] [MAIN ] MUJ: Successfully saved derivative data. [2025-09-29T22:12:36.158962] [INFO ] [MAIN ] Derivative Progress: 1219/2057 symbols completed. MUJ took 1.2s. Estimated remaining: 5m 41s. Rate: 147.5 symbols/min [2025-09-29T22:12:36.159375] [INFO ] [MAIN ] MUX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:36.160817] [DEBUG] [MAIN ] MUR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:36.163743] [INFO ] [MAIN ] MUR: Generated 1794 derivative records from 52928 primary records. [2025-09-29T22:12:36.163837] [DEBUG] [LOCAL ] MUR: Saving derivative data. [2025-09-29T22:12:36.187361] [DEBUG] [MAIN ] MUSA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:36.191593] [INFO ] [MAIN ] MUSA: Generated 1794 derivative records from 24753 primary records. [2025-09-29T22:12:36.192213] [DEBUG] [LOCAL ] MUSA: Saving derivative data. [2025-09-29T22:12:36.211333] [DEBUG] [LOCAL ] MUSA: Derivative data saved (1794 records). [2025-09-29T22:12:36.211813] [INFO ] [MAIN ] MUSA: Successfully saved derivative data. [2025-09-29T22:12:36.214108] [INFO ] [MAIN ] Derivative Progress: 1220/2057 symbols completed. MUSA took 1.1s. Estimated remaining: 5m 40s. Rate: 147.6 symbols/min [2025-09-29T22:12:36.214671] [INFO ] [MAIN ] MVF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:36.215781] [DEBUG] [LOCAL ] MUR: Derivative data saved (1794 records). [2025-09-29T22:12:36.216350] [INFO ] [MAIN ] MUR: Successfully saved derivative data. [2025-09-29T22:12:36.218727] [INFO ] [MAIN ] Derivative Progress: 1221/2057 symbols completed. MUR took 1.3s. Estimated remaining: 5m 40s. Rate: 147.7 symbols/min [2025-09-29T22:12:36.218985] [INFO ] [MAIN ] MVO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:36.244923] [DEBUG] [LOCAL ] MVF: Loaded 12865 existing records from primary storage. [2025-09-29T22:12:36.263436] [DEBUG] [LOCAL ] MVO: Loaded 9024 existing records from primary storage. [2025-09-29T22:12:36.263732] [INFO ] [MAIN ] MVF: Loaded 12865 primary data records. [2025-09-29T22:12:36.286220] [INFO ] [MAIN ] MVO: Loaded 9024 primary data records. [2025-09-29T22:12:36.303949] [DEBUG] [LOCAL ] MUX: Loaded 42714 existing records from primary storage. [2025-09-29T22:12:36.377052] [INFO ] [MAIN ] MUX: Loaded 42714 primary data records. [2025-09-29T22:12:37.281531] [DEBUG] [MAIN ] MVF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:37.282581] [INFO ] [MAIN ] MVF: Generated 1794 derivative records from 12865 primary records. [2025-09-29T22:12:37.282987] [DEBUG] [LOCAL ] MVF: Saving derivative data. [2025-09-29T22:12:37.318990] [DEBUG] [LOCAL ] MVF: Derivative data saved (1794 records). [2025-09-29T22:12:37.319478] [DEBUG] [MAIN ] MUX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:37.334062] [INFO ] [MAIN ] MUX: Generated 1794 derivative records from 42714 primary records. [2025-09-29T22:12:37.333028] [INFO ] [MAIN ] MVF: Successfully saved derivative data. [2025-09-29T22:12:37.334399] [DEBUG] [LOCAL ] MUX: Saving derivative data. [2025-09-29T22:12:37.337101] [INFO ] [MAIN ] Derivative Progress: 1222/2057 symbols completed. MVF took 1.1s. Estimated remaining: 5m 40s. Rate: 147.5 symbols/min [2025-09-29T22:12:37.334848] [DEBUG] [MAIN ] MVO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:37.337362] [INFO ] [MAIN ] MVT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:37.339953] [INFO ] [MAIN ] MVO: Generated 1794 derivative records from 9024 primary records. [2025-09-29T22:12:37.340102] [DEBUG] [LOCAL ] MVO: Saving derivative data. [2025-09-29T22:12:37.356744] [DEBUG] [LOCAL ] MUX: Derivative data saved (1794 records). [2025-09-29T22:12:37.357228] [INFO ] [MAIN ] MUX: Successfully saved derivative data. [2025-09-29T22:12:37.369889] [INFO ] [MAIN ] Derivative Progress: 1223/2057 symbols completed. MUX took 1.2s. Estimated remaining: 5m 39s. Rate: 147.6 symbols/min [2025-09-29T22:12:37.376454] [INFO ] [MAIN ] MWA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:37.382802] [DEBUG] [LOCAL ] MVT: Loaded 10243 existing records from primary storage. [2025-09-29T22:12:37.383029] [DEBUG] [LOCAL ] MVO: Derivative data saved (1794 records). [2025-09-29T22:12:37.383727] [INFO ] [MAIN ] MVO: Successfully saved derivative data. [2025-09-29T22:12:37.386673] [INFO ] [MAIN ] Derivative Progress: 1224/2057 symbols completed. MVO took 1.2s. Estimated remaining: 5m 38s. Rate: 147.7 symbols/min [2025-09-29T22:12:37.387033] [INFO ] [MAIN ] MX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:37.387177] [INFO ] [MAIN ] MVT: Loaded 10243 primary data records. [2025-09-29T22:12:37.564537] [DEBUG] [LOCAL ] MX: Loaded 22922 existing records from primary storage. [2025-09-29T22:12:37.611202] [INFO ] [MAIN ] MX: Loaded 22922 primary data records. [2025-09-29T22:12:37.854821] [DEBUG] [LOCAL ] MWA: Loaded 46764 existing records from primary storage. [2025-09-29T22:12:37.866708] [INFO ] [MAIN ] MWA: Loaded 46764 primary data records. [2025-09-29T22:12:38.495669] [DEBUG] [MAIN ] MVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:38.497398] [INFO ] [MAIN ] MVT: Generated 1794 derivative records from 10243 primary records. [2025-09-29T22:12:38.498128] [DEBUG] [LOCAL ] MVT: Saving derivative data. [2025-09-29T22:12:38.525957] [DEBUG] [LOCAL ] MVT: Derivative data saved (1794 records). [2025-09-29T22:12:38.526239] [INFO ] [MAIN ] MVT: Successfully saved derivative data. [2025-09-29T22:12:38.529541] [INFO ] [MAIN ] Derivative Progress: 1225/2057 symbols completed. MVT took 1.2s. Estimated remaining: 5m 38s. Rate: 147.5 symbols/min [2025-09-29T22:12:38.530223] [INFO ] [MAIN ] MXF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:38.545230] [DEBUG] [MAIN ] MX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:38.546511] [INFO ] [MAIN ] MX: Generated 1794 derivative records from 22922 primary records. [2025-09-29T22:12:38.546789] [DEBUG] [LOCAL ] MX: Saving derivative data. [2025-09-29T22:12:38.568594] [DEBUG] [LOCAL ] MX: Derivative data saved (1794 records). [2025-09-29T22:12:38.568783] [INFO ] [MAIN ] MX: Successfully saved derivative data. [2025-09-29T22:12:38.571424] [INFO ] [MAIN ] Derivative Progress: 1226/2057 symbols completed. MX took 1.2s. Estimated remaining: 5m 38s. Rate: 147.6 symbols/min [2025-09-29T22:12:38.571815] [INFO ] [MAIN ] MYD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:38.590154] [DEBUG] [LOCAL ] MXF: Loaded 5828 existing records from primary storage. [2025-09-29T22:12:38.590748] [DEBUG] [MAIN ] MWA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:38.590852] [INFO ] [MAIN ] MXF: Loaded 5828 primary data records. [2025-09-29T22:12:38.599930] [INFO ] [MAIN ] MWA: Generated 1794 derivative records from 46764 primary records. [2025-09-29T22:12:38.627253] [DEBUG] [LOCAL ] MWA: Saving derivative data. [2025-09-29T22:12:38.743567] [DEBUG] [LOCAL ] MYD: Loaded 13769 existing records from primary storage. [2025-09-29T22:12:38.753107] [INFO ] [MAIN ] MYD: Loaded 13769 primary data records. [2025-09-29T22:12:38.937540] [DEBUG] [LOCAL ] MWA: Derivative data saved (1794 records). [2025-09-29T22:12:39.011115] [INFO ] [MAIN ] MWA: Successfully saved derivative data. [2025-09-29T22:12:39.162986] [INFO ] [MAIN ] Derivative Progress: 1227/2057 symbols completed. MWA took 1.8s. Estimated remaining: 5m 37s. Rate: 147.6 symbols/min [2025-09-29T22:12:39.199030] [INFO ] [MAIN ] MYE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:39.439042] [DEBUG] [LOCAL ] MYE: Loaded 24717 existing records from primary storage. [2025-09-29T22:12:39.439560] [INFO ] [MAIN ] MYE: Loaded 24717 primary data records. [2025-09-29T22:12:39.572884] [DEBUG] [MAIN ] MXF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:39.610294] [INFO ] [MAIN ] MXF: Generated 1794 derivative records from 5828 primary records. [2025-09-29T22:12:39.645046] [DEBUG] [LOCAL ] MXF: Saving derivative data. [2025-09-29T22:12:39.796572] [DEBUG] [MAIN ] MYD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:39.801956] [INFO ] [MAIN ] MYD: Generated 1794 derivative records from 13769 primary records. [2025-09-29T22:12:39.802877] [DEBUG] [LOCAL ] MYD: Saving derivative data. [2025-09-29T22:12:39.822491] [DEBUG] [LOCAL ] MXF: Derivative data saved (1794 records). [2025-09-29T22:12:39.823290] [INFO ] [MAIN ] MXF: Successfully saved derivative data. [2025-09-29T22:12:39.826263] [INFO ] [MAIN ] Derivative Progress: 1228/2057 symbols completed. MXF took 1.3s. Estimated remaining: 5m 37s. Rate: 147.5 symbols/min [2025-09-29T22:12:39.831174] [DEBUG] [LOCAL ] MYD: Derivative data saved (1794 records). [2025-09-29T22:12:39.831404] [INFO ] [MAIN ] MYD: Successfully saved derivative data. [2025-09-29T22:12:39.834113] [INFO ] [MAIN ] Derivative Progress: 1229/2057 symbols completed. MYD took 1.3s. Estimated remaining: 5m 37s. Rate: 147.6 symbols/min [2025-09-29T22:12:39.852840] [DEBUG] [MAIN ] MYE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:39.853447] [INFO ] [MAIN ] MYE: Generated 1794 derivative records from 24717 primary records. [2025-09-29T22:12:39.853512] [DEBUG] [LOCAL ] MYE: Saving derivative data. [2025-09-29T22:12:39.872259] [DEBUG] [LOCAL ] MYE: Derivative data saved (1794 records). [2025-09-29T22:12:39.872408] [INFO ] [MAIN ] MYE: Successfully saved derivative data. [2025-09-29T22:12:39.875105] [INFO ] [MAIN ] Derivative Progress: 1230/2057 symbols completed. MYE took 0.7s. Estimated remaining: 5m 36s. Rate: 147.7 symbols/min [2025-09-29T22:12:39.875572] [INFO ] [MAIN ] MYI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:39.875719] [INFO ] [MAIN ] NABL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:39.876534] [INFO ] [MAIN ] MYN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:39.890361] [DEBUG] [LOCAL ] MYN: Loaded 10052 existing records from primary storage. [2025-09-29T22:12:39.891040] [INFO ] [MAIN ] MYN: Loaded 10052 primary data records. [2025-09-29T22:12:40.015834] [DEBUG] [LOCAL ] MYI: Loaded 19380 existing records from primary storage. [2025-09-29T22:12:40.024485] [INFO ] [MAIN ] MYI: Loaded 19380 primary data records. [2025-09-29T22:12:40.224620] [DEBUG] [LOCAL ] NABL: Loaded 39507 existing records from primary storage. [2025-09-29T22:12:40.340072] [INFO ] [MAIN ] NABL: Loaded 39507 primary data records. [2025-09-29T22:12:40.959560] [DEBUG] [MAIN ] MYN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:40.963737] [INFO ] [MAIN ] MYN: Generated 1794 derivative records from 10052 primary records. [2025-09-29T22:12:40.963986] [DEBUG] [LOCAL ] MYN: Saving derivative data. [2025-09-29T22:12:40.991666] [DEBUG] [MAIN ] MYI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:40.993457] [INFO ] [MAIN ] MYI: Generated 1794 derivative records from 19380 primary records. [2025-09-29T22:12:40.994090] [DEBUG] [LOCAL ] MYI: Saving derivative data. [2025-09-29T22:12:40.999150] [DEBUG] [LOCAL ] MYN: Derivative data saved (1794 records). [2025-09-29T22:12:41.007333] [INFO ] [MAIN ] MYN: Successfully saved derivative data. [2025-09-29T22:12:41.012436] [INFO ] [MAIN ] Derivative Progress: 1231/2057 symbols completed. MYN took 1.1s. Estimated remaining: 5m 36s. Rate: 147.5 symbols/min [2025-09-29T22:12:41.015373] [INFO ] [MAIN ] NAC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:41.032903] [DEBUG] [MAIN ] NABL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:41.034986] [INFO ] [MAIN ] NABL: Generated 1794 derivative records from 39507 primary records. [2025-09-29T22:12:41.035070] [DEBUG] [LOCAL ] NABL: Saving derivative data. [2025-09-29T22:12:41.036126] [DEBUG] [LOCAL ] MYI: Derivative data saved (1794 records). [2025-09-29T22:12:41.036698] [INFO ] [MAIN ] MYI: Successfully saved derivative data. [2025-09-29T22:12:41.039978] [INFO ] [MAIN ] Derivative Progress: 1232/2057 symbols completed. MYI took 1.2s. Estimated remaining: 5m 35s. Rate: 147.6 symbols/min [2025-09-29T22:12:41.051454] [INFO ] [MAIN ] NAD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:41.064252] [DEBUG] [LOCAL ] NABL: Derivative data saved (1794 records). [2025-09-29T22:12:41.064368] [INFO ] [MAIN ] NABL: Successfully saved derivative data. [2025-09-29T22:12:41.066989] [INFO ] [MAIN ] Derivative Progress: 1233/2057 symbols completed. NABL took 1.2s. Estimated remaining: 5m 35s. Rate: 147.7 symbols/min [2025-09-29T22:12:41.067395] [INFO ] [MAIN ] NAN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:41.079888] [DEBUG] [LOCAL ] NAC: Loaded 24774 existing records from primary storage. [2025-09-29T22:12:41.082608] [INFO ] [MAIN ] NAC: Loaded 24774 primary data records. [2025-09-29T22:12:41.133617] [DEBUG] [LOCAL ] NAN: Loaded 8966 existing records from primary storage. [2025-09-29T22:12:41.143290] [INFO ] [MAIN ] NAN: Loaded 8966 primary data records. [2025-09-29T22:12:41.350065] [DEBUG] [LOCAL ] NAD: Loaded 33881 existing records from primary storage. [2025-09-29T22:12:41.388720] [INFO ] [MAIN ] NAD: Loaded 33881 primary data records. [2025-09-29T22:12:42.157487] [DEBUG] [MAIN ] NAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:42.159216] [INFO ] [MAIN ] NAC: Generated 1794 derivative records from 24774 primary records. [2025-09-29T22:12:42.159580] [DEBUG] [LOCAL ] NAC: Saving derivative data. [2025-09-29T22:12:42.182747] [DEBUG] [MAIN ] NAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:42.188183] [INFO ] [MAIN ] NAN: Generated 1794 derivative records from 8966 primary records. [2025-09-29T22:12:42.191678] [DEBUG] [LOCAL ] NAN: Saving derivative data. [2025-09-29T22:12:42.197192] [DEBUG] [LOCAL ] NAC: Derivative data saved (1794 records). [2025-09-29T22:12:42.208790] [INFO ] [MAIN ] NAC: Successfully saved derivative data. [2025-09-29T22:12:42.219267] [INFO ] [MAIN ] Derivative Progress: 1234/2057 symbols completed. NAC took 1.2s. Estimated remaining: 5m 35s. Rate: 147.5 symbols/min [2025-09-29T22:12:42.219747] [INFO ] [MAIN ] NAT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:42.227825] [DEBUG] [MAIN ] NAD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:42.228745] [INFO ] [MAIN ] NAD: Generated 1794 derivative records from 33881 primary records. [2025-09-29T22:12:42.229065] [DEBUG] [LOCAL ] NAD: Saving derivative data. [2025-09-29T22:12:42.231839] [DEBUG] [LOCAL ] NAN: Derivative data saved (1794 records). [2025-09-29T22:12:42.232113] [INFO ] [MAIN ] NAN: Successfully saved derivative data. [2025-09-29T22:12:42.242010] [INFO ] [MAIN ] Derivative Progress: 1235/2057 symbols completed. NAN took 1.2s. Estimated remaining: 5m 34s. Rate: 147.6 symbols/min [2025-09-29T22:12:42.243578] [INFO ] [MAIN ] NATL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:42.251965] [DEBUG] [LOCAL ] NAD: Derivative data saved (1794 records). [2025-09-29T22:12:42.252237] [INFO ] [MAIN ] NAD: Successfully saved derivative data. [2025-09-29T22:12:42.254975] [INFO ] [MAIN ] Derivative Progress: 1236/2057 symbols completed. NAD took 1.2s. Estimated remaining: 5m 33s. Rate: 147.7 symbols/min [2025-09-29T22:12:42.255974] [INFO ] [MAIN ] NAZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:42.269399] [DEBUG] [LOCAL ] NAZ: Loaded 2642 existing records from primary storage. [2025-09-29T22:12:42.280634] [INFO ] [MAIN ] NAZ: Loaded 2642 primary data records. [2025-09-29T22:12:42.421214] [DEBUG] [LOCAL ] NATL: Loaded 32751 existing records from primary storage. [2025-09-29T22:12:42.451428] [DEBUG] [LOCAL ] NAT: Loaded 49122 existing records from primary storage. [2025-09-29T22:12:42.456740] [INFO ] [MAIN ] NATL: Loaded 32751 primary data records. [2025-09-29T22:12:42.467402] [INFO ] [MAIN ] NAT: Loaded 49122 primary data records. [2025-09-29T22:12:43.374114] [DEBUG] [MAIN ] NAZ: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:12:43.375295] [INFO ] [MAIN ] NAZ: Generated 1793 derivative records from 2642 primary records. [2025-09-29T22:12:43.375513] [DEBUG] [LOCAL ] NAZ: Saving derivative data. [2025-09-29T22:12:43.396605] [DEBUG] [LOCAL ] NAZ: Derivative data saved (1793 records). [2025-09-29T22:12:43.398127] [INFO ] [MAIN ] NAZ: Successfully saved derivative data. [2025-09-29T22:12:43.401725] [INFO ] [MAIN ] Derivative Progress: 1237/2057 symbols completed. NAZ took 1.1s. Estimated remaining: 5m 33s. Rate: 147.5 symbols/min [2025-09-29T22:12:43.401956] [INFO ] [MAIN ] NBB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:43.421139] [DEBUG] [MAIN ] NATL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:43.442563] [INFO ] [MAIN ] NATL: Generated 1794 derivative records from 32751 primary records. [2025-09-29T22:12:43.444232] [DEBUG] [MAIN ] NAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:43.445056] [INFO ] [MAIN ] NAT: Generated 1794 derivative records from 49122 primary records. [2025-09-29T22:12:43.445194] [DEBUG] [LOCAL ] NAT: Saving derivative data. [2025-09-29T22:12:43.443940] [DEBUG] [LOCAL ] NATL: Saving derivative data. [2025-09-29T22:12:43.461371] [DEBUG] [LOCAL ] NBB: Loaded 8939 existing records from primary storage. [2025-09-29T22:12:43.474567] [INFO ] [MAIN ] NBB: Loaded 8939 primary data records. [2025-09-29T22:12:43.541310] [DEBUG] [LOCAL ] NATL: Derivative data saved (1794 records). [2025-09-29T22:12:43.562965] [INFO ] [MAIN ] NATL: Successfully saved derivative data. [2025-09-29T22:12:43.570671] [INFO ] [MAIN ] Derivative Progress: 1238/2057 symbols completed. NATL took 1.3s. Estimated remaining: 5m 33s. Rate: 147.6 symbols/min [2025-09-29T22:12:43.571143] [INFO ] [MAIN ] NBHC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:43.612755] [DEBUG] [LOCAL ] NAT: Derivative data saved (1794 records). [2025-09-29T22:12:43.628387] [INFO ] [MAIN ] NAT: Successfully saved derivative data. [2025-09-29T22:12:43.643452] [INFO ] [MAIN ] Derivative Progress: 1239/2057 symbols completed. NAT took 1.4s. Estimated remaining: 5m 32s. Rate: 147.7 symbols/min [2025-09-29T22:12:43.653162] [INFO ] [MAIN ] NBR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:43.833543] [DEBUG] [LOCAL ] NBHC: Loaded 23140 existing records from primary storage. [2025-09-29T22:12:43.833722] [INFO ] [MAIN ] NBHC: Loaded 23140 primary data records. [2025-09-29T22:12:44.036808] [DEBUG] [LOCAL ] NBR: Loaded 34782 existing records from primary storage. [2025-09-29T22:12:44.166307] [INFO ] [MAIN ] NBR: Loaded 34782 primary data records. [2025-09-29T22:12:44.391515] [DEBUG] [MAIN ] NBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:44.572809] [INFO ] [MAIN ] NBB: Generated 1794 derivative records from 8939 primary records. [2025-09-29T22:12:44.573710] [DEBUG] [LOCAL ] NBB: Saving derivative data. [2025-09-29T22:12:44.595506] [DEBUG] [LOCAL ] NBB: Derivative data saved (1794 records). [2025-09-29T22:12:44.597428] [INFO ] [MAIN ] NBB: Successfully saved derivative data. [2025-09-29T22:12:44.600577] [INFO ] [MAIN ] Derivative Progress: 1240/2057 symbols completed. NBB took 1.2s. Estimated remaining: 5m 32s. Rate: 147.5 symbols/min [2025-09-29T22:12:44.600891] [INFO ] [MAIN ] NBXG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:44.617132] [DEBUG] [MAIN ] NBHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:44.618030] [INFO ] [MAIN ] NBHC: Generated 1794 derivative records from 23140 primary records. [2025-09-29T22:12:44.618131] [DEBUG] [LOCAL ] NBHC: Saving derivative data. [2025-09-29T22:12:44.643469] [DEBUG] [LOCAL ] NBHC: Derivative data saved (1794 records). [2025-09-29T22:12:44.643987] [INFO ] [MAIN ] NBHC: Successfully saved derivative data. [2025-09-29T22:12:44.646589] [INFO ] [MAIN ] Derivative Progress: 1241/2057 symbols completed. NBHC took 1.1s. Estimated remaining: 5m 32s. Rate: 147.6 symbols/min [2025-09-29T22:12:44.647088] [INFO ] [MAIN ] NC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:44.659013] [DEBUG] [LOCAL ] NBXG: Loaded 22289 existing records from primary storage. [2025-09-29T22:12:44.667980] [INFO ] [MAIN ] NBXG: Loaded 22289 primary data records. [2025-09-29T22:12:44.674151] [DEBUG] [MAIN ] NBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:44.713372] [DEBUG] [LOCAL ] NC: Loaded 1913 existing records from primary storage. [2025-09-29T22:12:44.734267] [INFO ] [MAIN ] NBR: Generated 1794 derivative records from 34782 primary records. [2025-09-29T22:12:44.755608] [DEBUG] [LOCAL ] NBR: Saving derivative data. [2025-09-29T22:12:44.755742] [INFO ] [MAIN ] NC: Loaded 1913 primary data records. [2025-09-29T22:12:44.876633] [DEBUG] [LOCAL ] NBR: Derivative data saved (1794 records). [2025-09-29T22:12:44.907808] [INFO ] [MAIN ] NBR: Successfully saved derivative data. [2025-09-29T22:12:44.948766] [INFO ] [MAIN ] Derivative Progress: 1242/2057 symbols completed. NBR took 1.3s. Estimated remaining: 5m 31s. Rate: 147.7 symbols/min [2025-09-29T22:12:44.961739] [INFO ] [MAIN ] NCA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:45.329120] [DEBUG] [LOCAL ] NCA: Loaded 10176 existing records from primary storage. [2025-09-29T22:12:45.330982] [INFO ] [MAIN ] NCA: Loaded 10176 primary data records. [2025-09-29T22:12:45.698560] [DEBUG] [MAIN ] NBXG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:45.713513] [INFO ] [MAIN ] NBXG: Generated 1794 derivative records from 22289 primary records. [2025-09-29T22:12:45.713947] [DEBUG] [MAIN ] NC: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:12:45.714767] [INFO ] [MAIN ] NC: Generated 1793 derivative records from 1913 primary records. [2025-09-29T22:12:45.714928] [DEBUG] [LOCAL ] NC: Saving derivative data. [2025-09-29T22:12:45.714891] [DEBUG] [LOCAL ] NBXG: Saving derivative data. [2025-09-29T22:12:45.747724] [DEBUG] [LOCAL ] NBXG: Derivative data saved (1794 records). [2025-09-29T22:12:45.748554] [DEBUG] [LOCAL ] NC: Derivative data saved (1793 records). [2025-09-29T22:12:45.748503] [INFO ] [MAIN ] NBXG: Successfully saved derivative data. [2025-09-29T22:12:45.751015] [INFO ] [MAIN ] Derivative Progress: 1243/2057 symbols completed. NBXG took 1.2s. Estimated remaining: 5m 31s. Rate: 147.6 symbols/min [2025-09-29T22:12:45.751251] [INFO ] [MAIN ] NC: Successfully saved derivative data. [2025-09-29T22:12:45.753938] [INFO ] [MAIN ] Derivative Progress: 1244/2057 symbols completed. NC took 1.1s. Estimated remaining: 5m 30s. Rate: 147.7 symbols/min [2025-09-29T22:12:45.777461] [DEBUG] [MAIN ] NCA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:45.778556] [INFO ] [MAIN ] NCA: Generated 1794 derivative records from 10176 primary records. [2025-09-29T22:12:45.778636] [DEBUG] [LOCAL ] NCA: Saving derivative data. [2025-09-29T22:12:45.795044] [DEBUG] [LOCAL ] NCA: Derivative data saved (1794 records). [2025-09-29T22:12:45.795175] [INFO ] [MAIN ] NCA: Successfully saved derivative data. [2025-09-29T22:12:45.797785] [INFO ] [MAIN ] Derivative Progress: 1245/2057 symbols completed. NCA took 0.8s. Estimated remaining: 5m 30s. Rate: 147.8 symbols/min [2025-09-29T22:12:45.798308] [INFO ] [MAIN ] NCDL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:45.798483] [INFO ] [MAIN ] NCLH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:45.799507] [INFO ] [MAIN ] NCV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:45.818494] [DEBUG] [LOCAL ] NCV: Loaded 13489 existing records from primary storage. [2025-09-29T22:12:45.818696] [INFO ] [MAIN ] NCV: Loaded 13489 primary data records. [2025-09-29T22:12:45.934445] [DEBUG] [LOCAL ] NCDL: Loaded 21474 existing records from primary storage. [2025-09-29T22:12:45.966067] [INFO ] [MAIN ] NCDL: Loaded 21474 primary data records. [2025-09-29T22:12:46.224371] [DEBUG] [LOCAL ] NCLH: Loaded 53753 existing records from primary storage. [2025-09-29T22:12:46.292152] [INFO ] [MAIN ] NCLH: Loaded 53753 primary data records. [2025-09-29T22:12:47.198491] [DEBUG] [MAIN ] NCV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:47.199496] [INFO ] [MAIN ] NCV: Generated 1794 derivative records from 13489 primary records. [2025-09-29T22:12:47.200004] [DEBUG] [LOCAL ] NCV: Saving derivative data. [2025-09-29T22:12:47.236446] [DEBUG] [MAIN ] NCDL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:47.239153] [INFO ] [MAIN ] NCDL: Generated 1794 derivative records from 21474 primary records. [2025-09-29T22:12:47.239559] [DEBUG] [LOCAL ] NCDL: Saving derivative data. [2025-09-29T22:12:47.238133] [DEBUG] [LOCAL ] NCV: Derivative data saved (1794 records). [2025-09-29T22:12:47.240621] [INFO ] [MAIN ] NCV: Successfully saved derivative data. [2025-09-29T22:12:47.242861] [INFO ] [MAIN ] Derivative Progress: 1246/2057 symbols completed. NCV took 1.4s. Estimated remaining: 5m 30s. Rate: 147.5 symbols/min [2025-09-29T22:12:47.243706] [INFO ] [MAIN ] NCZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:47.288749] [DEBUG] [MAIN ] NCLH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:47.289588] [INFO ] [MAIN ] NCLH: Generated 1794 derivative records from 53753 primary records. [2025-09-29T22:12:47.289749] [DEBUG] [LOCAL ] NCLH: Saving derivative data. [2025-09-29T22:12:47.288388] [DEBUG] [LOCAL ] NCDL: Derivative data saved (1794 records). [2025-09-29T22:12:47.294911] [INFO ] [MAIN ] NCDL: Successfully saved derivative data. [2025-09-29T22:12:47.295485] [DEBUG] [LOCAL ] NCZ: Loaded 11850 existing records from primary storage. [2025-09-29T22:12:47.299065] [INFO ] [MAIN ] NCZ: Loaded 11850 primary data records. [2025-09-29T22:12:47.298932] [INFO ] [MAIN ] Derivative Progress: 1247/2057 symbols completed. NCDL took 1.5s. Estimated remaining: 5m 29s. Rate: 147.6 symbols/min [2025-09-29T22:12:47.346329] [INFO ] [MAIN ] NDMO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:47.492901] [DEBUG] [LOCAL ] NCLH: Derivative data saved (1794 records). [2025-09-29T22:12:47.628120] [INFO ] [MAIN ] NCLH: Successfully saved derivative data. [2025-09-29T22:12:47.628016] [DEBUG] [LOCAL ] NDMO: Loaded 16873 existing records from primary storage. [2025-09-29T22:12:47.646316] [INFO ] [MAIN ] Derivative Progress: 1248/2057 symbols completed. NCLH took 1.8s. Estimated remaining: 5m 29s. Rate: 147.6 symbols/min [2025-09-29T22:12:47.646724] [INFO ] [MAIN ] NDMO: Loaded 16873 primary data records. [2025-09-29T22:12:47.647064] [INFO ] [MAIN ] NE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:48.085605] [DEBUG] [LOCAL ] NE: Loaded 52378 existing records from primary storage. [2025-09-29T22:12:48.086179] [INFO ] [MAIN ] NE: Loaded 52378 primary data records. [2025-09-29T22:12:48.211608] [DEBUG] [MAIN ] NCZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:48.216695] [INFO ] [MAIN ] NCZ: Generated 1794 derivative records from 11850 primary records. [2025-09-29T22:12:48.216890] [DEBUG] [LOCAL ] NCZ: Saving derivative data. [2025-09-29T22:12:48.444071] [DEBUG] [LOCAL ] NCZ: Derivative data saved (1794 records). [2025-09-29T22:12:48.445144] [INFO ] [MAIN ] NCZ: Successfully saved derivative data. [2025-09-29T22:12:48.447526] [INFO ] [MAIN ] Derivative Progress: 1249/2057 symbols completed. NCZ took 1.2s. Estimated remaining: 5m 29s. Rate: 147.5 symbols/min [2025-09-29T22:12:48.447879] [INFO ] [MAIN ] NEA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:48.468529] [DEBUG] [MAIN ] NDMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:48.469631] [INFO ] [MAIN ] NDMO: Generated 1794 derivative records from 16873 primary records. [2025-09-29T22:12:48.470243] [DEBUG] [LOCAL ] NDMO: Saving derivative data. [2025-09-29T22:12:48.490206] [DEBUG] [LOCAL ] NDMO: Derivative data saved (1794 records). [2025-09-29T22:12:48.490632] [INFO ] [MAIN ] NDMO: Successfully saved derivative data. [2025-09-29T22:12:48.493215] [INFO ] [MAIN ] Derivative Progress: 1250/2057 symbols completed. NDMO took 1.1s. Estimated remaining: 5m 28s. Rate: 147.6 symbols/min [2025-09-29T22:12:48.493684] [INFO ] [MAIN ] NEE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:48.520620] [DEBUG] [MAIN ] NE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:48.521518] [INFO ] [MAIN ] NE: Generated 1794 derivative records from 52378 primary records. [2025-09-29T22:12:48.521769] [DEBUG] [LOCAL ] NE: Saving derivative data. [2025-09-29T22:12:48.543183] [DEBUG] [LOCAL ] NEA: Loaded 35357 existing records from primary storage. [2025-09-29T22:12:48.547419] [INFO ] [MAIN ] NEA: Loaded 35357 primary data records. [2025-09-29T22:12:48.744870] [DEBUG] [LOCAL ] NE: Derivative data saved (1794 records). [2025-09-29T22:12:48.782468] [INFO ] [MAIN ] NE: Successfully saved derivative data. [2025-09-29T22:12:48.796926] [DEBUG] [LOCAL ] NEE: Loaded 53707 existing records from primary storage. [2025-09-29T22:12:48.897737] [INFO ] [MAIN ] Derivative Progress: 1251/2057 symbols completed. NE took 1.3s. Estimated remaining: 5m 28s. Rate: 147.6 symbols/min [2025-09-29T22:12:48.898008] [INFO ] [MAIN ] NEE: Loaded 53707 primary data records. [2025-09-29T22:12:48.898427] [INFO ] [MAIN ] NEM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:49.333055] [DEBUG] [MAIN ] NEA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:49.335696] [INFO ] [MAIN ] NEA: Generated 1794 derivative records from 35357 primary records. [2025-09-29T22:12:49.335846] [DEBUG] [LOCAL ] NEA: Saving derivative data. [2025-09-29T22:12:49.337824] [DEBUG] [LOCAL ] NEM: Loaded 53708 existing records from primary storage. [2025-09-29T22:12:49.345975] [INFO ] [MAIN ] NEM: Loaded 53708 primary data records. [2025-09-29T22:12:49.464040] [DEBUG] [LOCAL ] NEA: Derivative data saved (1794 records). [2025-09-29T22:12:49.464846] [INFO ] [MAIN ] NEA: Successfully saved derivative data. [2025-09-29T22:12:49.467063] [INFO ] [MAIN ] Derivative Progress: 1252/2057 symbols completed. NEA took 1.0s. Estimated remaining: 5m 27s. Rate: 147.5 symbols/min [2025-09-29T22:12:49.472516] [INFO ] [MAIN ] NET: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:49.700927] [DEBUG] [MAIN ] NEE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:49.717979] [INFO ] [MAIN ] NEE: Generated 1794 derivative records from 53707 primary records. [2025-09-29T22:12:49.718143] [DEBUG] [LOCAL ] NEE: Saving derivative data. [2025-09-29T22:12:49.771637] [DEBUG] [LOCAL ] NEE: Derivative data saved (1794 records). [2025-09-29T22:12:49.772158] [INFO ] [MAIN ] NEE: Successfully saved derivative data. [2025-09-29T22:12:49.776423] [INFO ] [MAIN ] Derivative Progress: 1253/2057 symbols completed. NEE took 1.3s. Estimated remaining: 5m 27s. Rate: 147.6 symbols/min [2025-09-29T22:12:49.777585] [INFO ] [MAIN ] NEU: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:49.817293] [DEBUG] [MAIN ] NEM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:49.818446] [INFO ] [MAIN ] NEM: Generated 1794 derivative records from 53708 primary records. [2025-09-29T22:12:49.820182] [DEBUG] [LOCAL ] NEM: Saving derivative data. [2025-09-29T22:12:49.819925] [DEBUG] [LOCAL ] NET: Loaded 53016 existing records from primary storage. [2025-09-29T22:12:49.826242] [DEBUG] [LOCAL ] NEU: Loaded 8230 existing records from primary storage. [2025-09-29T22:12:49.820983] [INFO ] [MAIN ] NET: Loaded 53016 primary data records. [2025-09-29T22:12:49.834810] [INFO ] [MAIN ] NEU: Loaded 8230 primary data records. [2025-09-29T22:12:50.053808] [DEBUG] [LOCAL ] NEM: Derivative data saved (1794 records). [2025-09-29T22:12:50.058153] [INFO ] [MAIN ] NEM: Successfully saved derivative data. [2025-09-29T22:12:50.067019] [INFO ] [MAIN ] Derivative Progress: 1254/2057 symbols completed. NEM took 1.2s. Estimated remaining: 5m 26s. Rate: 147.6 symbols/min [2025-09-29T22:12:50.078238] [INFO ] [MAIN ] NEUE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:50.451077] [DEBUG] [LOCAL ] NEUE: Loaded 2207 existing records from primary storage. [2025-09-29T22:12:50.451513] [INFO ] [MAIN ] NEUE: Loaded 2207 primary data records. [2025-09-29T22:12:50.809684] [DEBUG] [MAIN ] NET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:50.812087] [INFO ] [MAIN ] NET: Generated 1794 derivative records from 53016 primary records. [2025-09-29T22:12:50.812546] [DEBUG] [LOCAL ] NET: Saving derivative data. [2025-09-29T22:12:50.841493] [DEBUG] [MAIN ] NEU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:50.846555] [INFO ] [MAIN ] NEU: Generated 1794 derivative records from 8230 primary records. [2025-09-29T22:12:50.848253] [DEBUG] [LOCAL ] NET: Derivative data saved (1794 records). [2025-09-29T22:12:50.848685] [INFO ] [MAIN ] NET: Successfully saved derivative data. [2025-09-29T22:12:50.848605] [DEBUG] [LOCAL ] NEU: Saving derivative data. [2025-09-29T22:12:50.851772] [INFO ] [MAIN ] Derivative Progress: 1255/2057 symbols completed. NET took 1.4s. Estimated remaining: 5m 26s. Rate: 147.5 symbols/min [2025-09-29T22:12:50.853567] [INFO ] [MAIN ] NEXA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:50.873280] [DEBUG] [LOCAL ] NEU: Derivative data saved (1794 records). [2025-09-29T22:12:50.875259] [INFO ] [MAIN ] NEU: Successfully saved derivative data. [2025-09-29T22:12:50.878258] [INFO ] [MAIN ] Derivative Progress: 1256/2057 symbols completed. NEU took 1.1s. Estimated remaining: 5m 26s. Rate: 147.6 symbols/min [2025-09-29T22:12:50.878952] [INFO ] [MAIN ] NFG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:50.899018] [DEBUG] [LOCAL ] NEXA: Loaded 4289 existing records from primary storage. [2025-09-29T22:12:50.894716] [DEBUG] [MAIN ] NEUE: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:12:50.899453] [INFO ] [MAIN ] NEXA: Loaded 4289 primary data records. [2025-09-29T22:12:50.905824] [INFO ] [MAIN ] NEUE: Generated 1793 derivative records from 2207 primary records. [2025-09-29T22:12:50.913712] [DEBUG] [LOCAL ] NEUE: Saving derivative data. [2025-09-29T22:12:51.040130] [DEBUG] [LOCAL ] NEUE: Derivative data saved (1793 records). [2025-09-29T22:12:51.077334] [INFO ] [MAIN ] NEUE: Successfully saved derivative data. [2025-09-29T22:12:51.139938] [INFO ] [MAIN ] Derivative Progress: 1257/2057 symbols completed. NEUE took 1.1s. Estimated remaining: 5m 25s. Rate: 147.6 symbols/min [2025-09-29T22:12:51.140500] [INFO ] [MAIN ] NFJ: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:51.323186] [DEBUG] [LOCAL ] NFG: Loaded 38473 existing records from primary storage. [2025-09-29T22:12:51.323591] [INFO ] [MAIN ] NFG: Loaded 38473 primary data records. [2025-09-29T22:12:51.642458] [DEBUG] [LOCAL ] NFJ: Loaded 20308 existing records from primary storage. [2025-09-29T22:12:51.644205] [INFO ] [MAIN ] NFJ: Loaded 20308 primary data records. [2025-09-29T22:12:51.838460] [DEBUG] [MAIN ] NEXA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:51.866102] [INFO ] [MAIN ] NEXA: Generated 1794 derivative records from 4289 primary records. [2025-09-29T22:12:51.980862] [DEBUG] [LOCAL ] NEXA: Saving derivative data. [2025-09-29T22:12:52.020150] [DEBUG] [LOCAL ] NEXA: Derivative data saved (1794 records). [2025-09-29T22:12:52.021669] [INFO ] [MAIN ] NEXA: Successfully saved derivative data. [2025-09-29T22:12:52.028551] [INFO ] [MAIN ] Derivative Progress: 1258/2057 symbols completed. NEXA took 1.2s. Estimated remaining: 5m 25s. Rate: 147.5 symbols/min [2025-09-29T22:12:52.044782] [DEBUG] [MAIN ] NFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:52.045920] [INFO ] [MAIN ] NFG: Generated 1794 derivative records from 38473 primary records. [2025-09-29T22:12:52.046041] [DEBUG] [LOCAL ] NFG: Saving derivative data. [2025-09-29T22:12:52.065552] [DEBUG] [LOCAL ] NFG: Derivative data saved (1794 records). [2025-09-29T22:12:52.065743] [INFO ] [MAIN ] NFG: Successfully saved derivative data. [2025-09-29T22:12:52.068126] [INFO ] [MAIN ] Derivative Progress: 1259/2057 symbols completed. NFG took 1.2s. Estimated remaining: 5m 24s. Rate: 147.6 symbols/min [2025-09-29T22:12:52.088733] [DEBUG] [MAIN ] NFJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:52.089506] [INFO ] [MAIN ] NFJ: Generated 1794 derivative records from 20308 primary records. [2025-09-29T22:12:52.089576] [DEBUG] [LOCAL ] NFJ: Saving derivative data. [2025-09-29T22:12:52.109066] [DEBUG] [LOCAL ] NFJ: Derivative data saved (1794 records). [2025-09-29T22:12:52.109231] [INFO ] [MAIN ] NFJ: Successfully saved derivative data. [2025-09-29T22:12:52.113757] [INFO ] [MAIN ] Derivative Progress: 1260/2057 symbols completed. NFJ took 1.0s. Estimated remaining: 5m 24s. Rate: 147.7 symbols/min [2025-09-29T22:12:52.114432] [INFO ] [MAIN ] NGG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:52.114837] [INFO ] [MAIN ] NGS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:52.114691] [INFO ] [MAIN ] NGL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:52.132358] [DEBUG] [LOCAL ] NGS: Loaded 11523 existing records from primary storage. [2025-09-29T22:12:52.133387] [INFO ] [MAIN ] NGS: Loaded 11523 primary data records. [2025-09-29T22:12:52.273971] [DEBUG] [LOCAL ] NGL: Loaded 30336 existing records from primary storage. [2025-09-29T22:12:52.287888] [INFO ] [MAIN ] NGL: Loaded 30336 primary data records. [2025-09-29T22:12:52.637612] [DEBUG] [LOCAL ] NGG: Loaded 46169 existing records from primary storage. [2025-09-29T22:12:52.638159] [INFO ] [MAIN ] NGG: Loaded 46169 primary data records. [2025-09-29T22:12:53.290022] [DEBUG] [MAIN ] NGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:53.292252] [INFO ] [MAIN ] NGS: Generated 1794 derivative records from 11523 primary records. [2025-09-29T22:12:53.292534] [DEBUG] [LOCAL ] NGS: Saving derivative data. [2025-09-29T22:12:53.328292] [DEBUG] [LOCAL ] NGS: Derivative data saved (1794 records). [2025-09-29T22:12:53.329586] [DEBUG] [MAIN ] NGL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:53.329791] [INFO ] [MAIN ] NGS: Successfully saved derivative data. [2025-09-29T22:12:53.333073] [INFO ] [MAIN ] NGL: Generated 1794 derivative records from 30336 primary records. [2025-09-29T22:12:53.332101] [INFO ] [MAIN ] Derivative Progress: 1261/2057 symbols completed. NGS took 1.2s. Estimated remaining: 5m 24s. Rate: 147.5 symbols/min [2025-09-29T22:12:53.333473] [INFO ] [MAIN ] NGVC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:53.335429] [DEBUG] [LOCAL ] NGL: Saving derivative data. [2025-09-29T22:12:53.363155] [DEBUG] [MAIN ] NGG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:53.368618] [INFO ] [MAIN ] NGG: Generated 1794 derivative records from 46169 primary records. [2025-09-29T22:12:53.368738] [DEBUG] [LOCAL ] NGG: Saving derivative data. [2025-09-29T22:12:53.367789] [DEBUG] [LOCAL ] NGL: Derivative data saved (1794 records). [2025-09-29T22:12:53.368851] [INFO ] [MAIN ] NGL: Successfully saved derivative data. [2025-09-29T22:12:53.371481] [INFO ] [MAIN ] Derivative Progress: 1262/2057 symbols completed. NGL took 1.3s. Estimated remaining: 5m 23s. Rate: 147.6 symbols/min [2025-09-29T22:12:53.372613] [INFO ] [MAIN ] NGVT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:53.395351] [DEBUG] [LOCAL ] NGG: Derivative data saved (1794 records). [2025-09-29T22:12:53.403360] [INFO ] [MAIN ] NGG: Successfully saved derivative data. [2025-09-29T22:12:53.403967] [DEBUG] [LOCAL ] NGVC: Loaded 22321 existing records from primary storage. [2025-09-29T22:12:53.406032] [INFO ] [MAIN ] Derivative Progress: 1263/2057 symbols completed. NGG took 1.3s. Estimated remaining: 5m 23s. Rate: 147.7 symbols/min [2025-09-29T22:12:53.411775] [INFO ] [MAIN ] NHI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:53.412008] [INFO ] [MAIN ] NGVC: Loaded 22321 primary data records. [2025-09-29T22:12:53.546701] [DEBUG] [LOCAL ] NGVT: Loaded 24102 existing records from primary storage. [2025-09-29T22:12:53.547028] [INFO ] [MAIN ] NGVT: Loaded 24102 primary data records. [2025-09-29T22:12:53.620201] [DEBUG] [LOCAL ] NHI: Loaded 21861 existing records from primary storage. [2025-09-29T22:12:53.650417] [INFO ] [MAIN ] NHI: Loaded 21861 primary data records. [2025-09-29T22:12:54.454493] [DEBUG] [MAIN ] NGVC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:54.455882] [INFO ] [MAIN ] NGVC: Generated 1794 derivative records from 22321 primary records. [2025-09-29T22:12:54.456674] [DEBUG] [LOCAL ] NGVC: Saving derivative data. [2025-09-29T22:12:54.499172] [DEBUG] [MAIN ] NGVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:54.500698] [INFO ] [MAIN ] NGVT: Generated 1794 derivative records from 24102 primary records. [2025-09-29T22:12:54.501309] [DEBUG] [LOCAL ] NGVT: Saving derivative data. [2025-09-29T22:12:54.502558] [DEBUG] [LOCAL ] NGVC: Derivative data saved (1794 records). [2025-09-29T22:12:54.503328] [INFO ] [MAIN ] NGVC: Successfully saved derivative data. [2025-09-29T22:12:54.505481] [INFO ] [MAIN ] Derivative Progress: 1264/2057 symbols completed. NGVC took 1.2s. Estimated remaining: 5m 23s. Rate: 147.5 symbols/min [2025-09-29T22:12:54.506203] [INFO ] [MAIN ] NI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:54.536069] [DEBUG] [LOCAL ] NGVT: Derivative data saved (1794 records). [2025-09-29T22:12:54.536184] [INFO ] [MAIN ] NGVT: Successfully saved derivative data. [2025-09-29T22:12:54.535442] [DEBUG] [MAIN ] NHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:54.537052] [INFO ] [MAIN ] NHI: Generated 1794 derivative records from 21861 primary records. [2025-09-29T22:12:54.539408] [INFO ] [MAIN ] Derivative Progress: 1265/2057 symbols completed. NGVT took 1.2s. Estimated remaining: 5m 22s. Rate: 147.6 symbols/min [2025-09-29T22:12:54.539753] [INFO ] [MAIN ] NIC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:54.539494] [DEBUG] [LOCAL ] NHI: Saving derivative data. [2025-09-29T22:12:54.563113] [DEBUG] [LOCAL ] NIC: Loaded 8914 existing records from primary storage. [2025-09-29T22:12:54.564229] [INFO ] [MAIN ] NIC: Loaded 8914 primary data records. [2025-09-29T22:12:54.601865] [DEBUG] [LOCAL ] NHI: Derivative data saved (1794 records). [2025-09-29T22:12:54.644697] [INFO ] [MAIN ] NHI: Successfully saved derivative data. [2025-09-29T22:12:54.659475] [INFO ] [MAIN ] Derivative Progress: 1266/2057 symbols completed. NHI took 1.2s. Estimated remaining: 5m 21s. Rate: 147.7 symbols/min [2025-09-29T22:12:54.684693] [INFO ] [MAIN ] NIE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:54.937481] [DEBUG] [LOCAL ] NI: Loaded 53420 existing records from primary storage. [2025-09-29T22:12:54.937324] [DEBUG] [LOCAL ] NIE: Loaded 11756 existing records from primary storage. [2025-09-29T22:12:54.937748] [INFO ] [MAIN ] NIE: Loaded 11756 primary data records. [2025-09-29T22:12:54.937673] [INFO ] [MAIN ] NI: Loaded 53420 primary data records. [2025-09-29T22:12:55.714014] [DEBUG] [MAIN ] NIC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:55.716059] [INFO ] [MAIN ] NIC: Generated 1794 derivative records from 8914 primary records. [2025-09-29T22:12:55.716267] [DEBUG] [LOCAL ] NIC: Saving derivative data. [2025-09-29T22:12:55.735885] [DEBUG] [LOCAL ] NIC: Derivative data saved (1794 records). [2025-09-29T22:12:55.736302] [INFO ] [MAIN ] NIC: Successfully saved derivative data. [2025-09-29T22:12:55.738723] [INFO ] [MAIN ] Derivative Progress: 1267/2057 symbols completed. NIC took 1.2s. Estimated remaining: 5m 21s. Rate: 147.5 symbols/min [2025-09-29T22:12:55.739328] [INFO ] [MAIN ] NIM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:55.751169] [DEBUG] [LOCAL ] NIM: Loaded 4102 existing records from primary storage. [2025-09-29T22:12:55.751531] [INFO ] [MAIN ] NIM: Loaded 4102 primary data records. [2025-09-29T22:12:55.779059] [DEBUG] [MAIN ] NIE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:55.785563] [INFO ] [MAIN ] NIE: Generated 1794 derivative records from 11756 primary records. [2025-09-29T22:12:55.831278] [DEBUG] [LOCAL ] NIE: Saving derivative data. [2025-09-29T22:12:55.858597] [DEBUG] [MAIN ] NI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:55.892372] [INFO ] [MAIN ] NI: Generated 1794 derivative records from 53420 primary records. [2025-09-29T22:12:55.906435] [DEBUG] [LOCAL ] NI: Saving derivative data. [2025-09-29T22:12:56.162264] [DEBUG] [LOCAL ] NI: Derivative data saved (1794 records). [2025-09-29T22:12:56.162914] [DEBUG] [LOCAL ] NIE: Derivative data saved (1794 records). [2025-09-29T22:12:56.162977] [INFO ] [MAIN ] NI: Successfully saved derivative data. [2025-09-29T22:12:56.165484] [INFO ] [MAIN ] Derivative Progress: 1268/2057 symbols completed. NI took 1.7s. Estimated remaining: 5m 21s. Rate: 147.5 symbols/min [2025-09-29T22:12:56.165666] [INFO ] [MAIN ] NIE: Successfully saved derivative data. [2025-09-29T22:12:56.169099] [INFO ] [MAIN ] Derivative Progress: 1269/2057 symbols completed. NIE took 1.5s. Estimated remaining: 5m 20s. Rate: 147.6 symbols/min [2025-09-29T22:12:56.168891] [INFO ] [MAIN ] NINE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:56.169264] [INFO ] [MAIN ] NIO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:56.206150] [DEBUG] [MAIN ] NIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:56.207093] [INFO ] [MAIN ] NIM: Generated 1794 derivative records from 4102 primary records. [2025-09-29T22:12:56.207202] [DEBUG] [LOCAL ] NIM: Saving derivative data. [2025-09-29T22:12:56.229508] [DEBUG] [LOCAL ] NINE: Loaded 28246 existing records from primary storage. [2025-09-29T22:12:56.230292] [INFO ] [MAIN ] NINE: Loaded 28246 primary data records. [2025-09-29T22:12:56.322275] [DEBUG] [LOCAL ] NIM: Derivative data saved (1794 records). [2025-09-29T22:12:56.340253] [INFO ] [MAIN ] NIM: Successfully saved derivative data. [2025-09-29T22:12:56.358180] [INFO ] [MAIN ] Derivative Progress: 1270/2057 symbols completed. NIM took 0.6s. Estimated remaining: 5m 20s. Rate: 147.7 symbols/min [2025-09-29T22:12:56.380872] [INFO ] [MAIN ] NJR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:56.394025] [DEBUG] [LOCAL ] NIO: Loaded 53802 existing records from primary storage. [2025-09-29T22:12:56.394158] [INFO ] [MAIN ] NIO: Loaded 53802 primary data records. [2025-09-29T22:12:56.947204] [DEBUG] [LOCAL ] NJR: Loaded 38049 existing records from primary storage. [2025-09-29T22:12:56.948386] [INFO ] [MAIN ] NJR: Loaded 38049 primary data records. [2025-09-29T22:12:57.169473] [DEBUG] [MAIN ] NINE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:57.225492] [INFO ] [MAIN ] NINE: Generated 1794 derivative records from 28246 primary records. [2025-09-29T22:12:57.296133] [DEBUG] [LOCAL ] NINE: Saving derivative data. [2025-09-29T22:12:57.331226] [DEBUG] [LOCAL ] NINE: Derivative data saved (1794 records). [2025-09-29T22:12:57.332237] [INFO ] [MAIN ] NINE: Successfully saved derivative data. [2025-09-29T22:12:57.335023] [INFO ] [MAIN ] Derivative Progress: 1271/2057 symbols completed. NINE took 1.2s. Estimated remaining: 5m 20s. Rate: 147.5 symbols/min [2025-09-29T22:12:57.335510] [INFO ] [MAIN ] NKX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:57.355547] [DEBUG] [MAIN ] NIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:57.356416] [INFO ] [MAIN ] NIO: Generated 1794 derivative records from 53802 primary records. [2025-09-29T22:12:57.356512] [DEBUG] [LOCAL ] NIO: Saving derivative data. [2025-09-29T22:12:57.380115] [DEBUG] [LOCAL ] NIO: Derivative data saved (1794 records). [2025-09-29T22:12:57.380410] [INFO ] [MAIN ] NIO: Successfully saved derivative data. [2025-09-29T22:12:57.383025] [INFO ] [MAIN ] Derivative Progress: 1272/2057 symbols completed. NIO took 1.2s. Estimated remaining: 5m 19s. Rate: 147.6 symbols/min [2025-09-29T22:12:57.383313] [INFO ] [MAIN ] NLOP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:57.393743] [DEBUG] [LOCAL ] NKX: Loaded 13526 existing records from primary storage. [2025-09-29T22:12:57.394994] [INFO ] [MAIN ] NKX: Loaded 13526 primary data records. [2025-09-29T22:12:57.506960] [DEBUG] [LOCAL ] NLOP: Loaded 11780 existing records from primary storage. [2025-09-29T22:12:57.517761] [INFO ] [MAIN ] NLOP: Loaded 11780 primary data records. [2025-09-29T22:12:57.535022] [DEBUG] [MAIN ] NJR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:57.586480] [INFO ] [MAIN ] NJR: Generated 1794 derivative records from 38049 primary records. [2025-09-29T22:12:57.646680] [DEBUG] [LOCAL ] NJR: Saving derivative data. [2025-09-29T22:12:58.160713] [DEBUG] [LOCAL ] NJR: Derivative data saved (1794 records). [2025-09-29T22:12:58.162769] [INFO ] [MAIN ] NJR: Successfully saved derivative data. [2025-09-29T22:12:58.166392] [INFO ] [MAIN ] Derivative Progress: 1273/2057 symbols completed. NJR took 1.8s. Estimated remaining: 5m 19s. Rate: 147.5 symbols/min [2025-09-29T22:12:58.213632] [DEBUG] [MAIN ] NLOP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:58.215330] [INFO ] [MAIN ] NLOP: Generated 1794 derivative records from 11780 primary records. [2025-09-29T22:12:58.215427] [DEBUG] [LOCAL ] NLOP: Saving derivative data. [2025-09-29T22:12:58.214435] [DEBUG] [MAIN ] NKX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:58.217172] [INFO ] [MAIN ] NKX: Generated 1794 derivative records from 13526 primary records. [2025-09-29T22:12:58.224727] [DEBUG] [LOCAL ] NKX: Saving derivative data. [2025-09-29T22:12:58.234068] [DEBUG] [LOCAL ] NLOP: Derivative data saved (1794 records). [2025-09-29T22:12:58.234681] [INFO ] [MAIN ] NLOP: Successfully saved derivative data. [2025-09-29T22:12:58.236985] [INFO ] [MAIN ] Derivative Progress: 1274/2057 symbols completed. NLOP took 0.9s. Estimated remaining: 5m 18s. Rate: 147.6 symbols/min [2025-09-29T22:12:58.261471] [DEBUG] [LOCAL ] NKX: Derivative data saved (1794 records). [2025-09-29T22:12:58.261685] [INFO ] [MAIN ] NKX: Successfully saved derivative data. [2025-09-29T22:12:58.264684] [INFO ] [MAIN ] Derivative Progress: 1275/2057 symbols completed. NKX took 0.9s. Estimated remaining: 5m 18s. Rate: 147.7 symbols/min [2025-09-29T22:12:58.265236] [INFO ] [MAIN ] NLY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:58.265470] [INFO ] [MAIN ] NMCO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:58.265326] [INFO ] [MAIN ] NMAI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:58.287867] [DEBUG] [LOCAL ] NMAI: Loaded 12900 existing records from primary storage. [2025-09-29T22:12:58.288009] [INFO ] [MAIN ] NMAI: Loaded 12900 primary data records. [2025-09-29T22:12:58.354984] [DEBUG] [LOCAL ] NMCO: Loaded 16721 existing records from primary storage. [2025-09-29T22:12:58.387120] [INFO ] [MAIN ] NMCO: Loaded 16721 primary data records. [2025-09-29T22:12:58.830816] [DEBUG] [LOCAL ] NLY: Loaded 53580 existing records from primary storage. [2025-09-29T22:12:58.848865] [INFO ] [MAIN ] NLY: Loaded 53580 primary data records. [2025-09-29T22:12:59.332439] [DEBUG] [MAIN ] NMAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:59.333752] [INFO ] [MAIN ] NMAI: Generated 1794 derivative records from 12900 primary records. [2025-09-29T22:12:59.334387] [DEBUG] [LOCAL ] NMAI: Saving derivative data. [2025-09-29T22:12:59.377552] [DEBUG] [MAIN ] NMCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:59.379923] [INFO ] [MAIN ] NMCO: Generated 1794 derivative records from 16721 primary records. [2025-09-29T22:12:59.380124] [DEBUG] [LOCAL ] NMCO: Saving derivative data. [2025-09-29T22:12:59.379056] [DEBUG] [LOCAL ] NMAI: Derivative data saved (1794 records). [2025-09-29T22:12:59.380594] [INFO ] [MAIN ] NMAI: Successfully saved derivative data. [2025-09-29T22:12:59.384189] [INFO ] [MAIN ] Derivative Progress: 1276/2057 symbols completed. NMAI took 1.1s. Estimated remaining: 5m 18s. Rate: 147.5 symbols/min [2025-09-29T22:12:59.384843] [INFO ] [MAIN ] NMG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:59.404578] [DEBUG] [LOCAL ] NMCO: Derivative data saved (1794 records). [2025-09-29T22:12:59.405043] [INFO ] [MAIN ] NMCO: Successfully saved derivative data. [2025-09-29T22:12:59.407127] [INFO ] [MAIN ] Derivative Progress: 1277/2057 symbols completed. NMCO took 1.1s. Estimated remaining: 5m 17s. Rate: 147.6 symbols/min [2025-09-29T22:12:59.410197] [INFO ] [MAIN ] NMI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:12:59.424914] [DEBUG] [MAIN ] NLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:12:59.430933] [DEBUG] [LOCAL ] NMG: Loaded 8008 existing records from primary storage. [2025-09-29T22:12:59.433193] [INFO ] [MAIN ] NLY: Generated 1794 derivative records from 53580 primary records. [2025-09-29T22:12:59.433379] [INFO ] [MAIN ] NMG: Loaded 8008 primary data records. [2025-09-29T22:12:59.433514] [DEBUG] [LOCAL ] NLY: Saving derivative data. [2025-09-29T22:12:59.473969] [DEBUG] [LOCAL ] NMI: Loaded 4049 existing records from primary storage. [2025-09-29T22:12:59.501493] [INFO ] [MAIN ] NMI: Loaded 4049 primary data records. [2025-09-29T22:12:59.681992] [DEBUG] [LOCAL ] NLY: Derivative data saved (1794 records). [2025-09-29T22:12:59.690517] [INFO ] [MAIN ] NLY: Successfully saved derivative data. [2025-09-29T22:12:59.693172] [INFO ] [MAIN ] Derivative Progress: 1278/2057 symbols completed. NLY took 1.4s. Estimated remaining: 5m 17s. Rate: 147.6 symbols/min [2025-09-29T22:12:59.706491] [INFO ] [MAIN ] NMM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:00.162994] [DEBUG] [LOCAL ] NMM: Loaded 14289 existing records from primary storage. [2025-09-29T22:13:00.163919] [INFO ] [MAIN ] NMM: Loaded 14289 primary data records. [2025-09-29T22:13:00.530238] [DEBUG] [MAIN ] NMG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:00.532461] [INFO ] [MAIN ] NMG: Generated 1794 derivative records from 8008 primary records. [2025-09-29T22:13:00.532912] [DEBUG] [LOCAL ] NMG: Saving derivative data. [2025-09-29T22:13:00.555520] [DEBUG] [MAIN ] NMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:00.557103] [INFO ] [MAIN ] NMI: Generated 1794 derivative records from 4049 primary records. [2025-09-29T22:13:00.568587] [DEBUG] [LOCAL ] NMI: Saving derivative data. [2025-09-29T22:13:00.573454] [DEBUG] [LOCAL ] NMG: Derivative data saved (1794 records). [2025-09-29T22:13:00.573575] [INFO ] [MAIN ] NMG: Successfully saved derivative data. [2025-09-29T22:13:00.576956] [INFO ] [MAIN ] Derivative Progress: 1279/2057 symbols completed. NMG took 1.2s. Estimated remaining: 5m 16s. Rate: 147.5 symbols/min [2025-09-29T22:13:00.588819] [INFO ] [MAIN ] NMR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:00.604182] [DEBUG] [LOCAL ] NMI: Derivative data saved (1794 records). [2025-09-29T22:13:00.604446] [INFO ] [MAIN ] NMI: Successfully saved derivative data. [2025-09-29T22:13:00.607764] [INFO ] [MAIN ] Derivative Progress: 1280/2057 symbols completed. NMI took 1.2s. Estimated remaining: 5m 16s. Rate: 147.6 symbols/min [2025-09-29T22:13:00.609469] [INFO ] [MAIN ] NMS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:00.635596] [DEBUG] [MAIN ] NMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:00.637689] [INFO ] [MAIN ] NMM: Generated 1794 derivative records from 14289 primary records. [2025-09-29T22:13:00.637918] [DEBUG] [LOCAL ] NMM: Saving derivative data. [2025-09-29T22:13:00.650335] [DEBUG] [LOCAL ] NMS: Loaded 2854 existing records from primary storage. [2025-09-29T22:13:00.655062] [INFO ] [MAIN ] NMS: Loaded 2854 primary data records. [2025-09-29T22:13:00.738110] [DEBUG] [LOCAL ] NMR: Loaded 34961 existing records from primary storage. [2025-09-29T22:13:00.738949] [DEBUG] [LOCAL ] NMM: Derivative data saved (1794 records). [2025-09-29T22:13:00.761798] [INFO ] [MAIN ] NMM: Successfully saved derivative data. [2025-09-29T22:13:00.781470] [INFO ] [MAIN ] Derivative Progress: 1281/2057 symbols completed. NMM took 1.1s. Estimated remaining: 5m 15s. Rate: 147.7 symbols/min [2025-09-29T22:13:00.781773] [INFO ] [MAIN ] NMR: Loaded 34961 primary data records. [2025-09-29T22:13:00.796813] [INFO ] [MAIN ] NMT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:00.993196] [DEBUG] [LOCAL ] NMT: Loaded 2846 existing records from primary storage. [2025-09-29T22:13:01.114214] [INFO ] [MAIN ] NMT: Loaded 2846 primary data records. [2025-09-29T22:13:01.760598] [DEBUG] [MAIN ] NMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:01.761881] [INFO ] [MAIN ] NMS: Generated 1794 derivative records from 2854 primary records. [2025-09-29T22:13:01.762484] [DEBUG] [LOCAL ] NMS: Saving derivative data. [2025-09-29T22:13:01.783003] [DEBUG] [LOCAL ] NMS: Derivative data saved (1794 records). [2025-09-29T22:13:01.798091] [INFO ] [MAIN ] NMS: Successfully saved derivative data. [2025-09-29T22:13:01.800105] [DEBUG] [MAIN ] NMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:01.802625] [INFO ] [MAIN ] Derivative Progress: 1282/2057 symbols completed. NMS took 1.2s. Estimated remaining: 5m 15s. Rate: 147.5 symbols/min [2025-09-29T22:13:01.803124] [INFO ] [MAIN ] NMZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:01.804408] [INFO ] [MAIN ] NMR: Generated 1794 derivative records from 34961 primary records. [2025-09-29T22:13:01.804937] [DEBUG] [LOCAL ] NMR: Saving derivative data. [2025-09-29T22:13:01.840679] [DEBUG] [MAIN ] NMT: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:13:01.841607] [INFO ] [MAIN ] NMT: Generated 1793 derivative records from 2846 primary records. [2025-09-29T22:13:01.847740] [DEBUG] [LOCAL ] NMT: Saving derivative data. [2025-09-29T22:13:01.849886] [DEBUG] [LOCAL ] NMR: Derivative data saved (1794 records). [2025-09-29T22:13:01.850001] [INFO ] [MAIN ] NMR: Successfully saved derivative data. [2025-09-29T22:13:01.852744] [INFO ] [MAIN ] Derivative Progress: 1283/2057 symbols completed. NMR took 1.3s. Estimated remaining: 5m 15s. Rate: 147.6 symbols/min [2025-09-29T22:13:01.860626] [INFO ] [MAIN ] NNI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:01.876817] [DEBUG] [LOCAL ] NMZ: Loaded 21748 existing records from primary storage. [2025-09-29T22:13:01.880192] [INFO ] [MAIN ] NMZ: Loaded 21748 primary data records. [2025-09-29T22:13:01.900612] [DEBUG] [LOCAL ] NMT: Derivative data saved (1793 records). [2025-09-29T22:13:01.906276] [INFO ] [MAIN ] NMT: Successfully saved derivative data. [2025-09-29T22:13:01.906213] [DEBUG] [LOCAL ] NNI: Loaded 10094 existing records from primary storage. [2025-09-29T22:13:01.927726] [INFO ] [MAIN ] Derivative Progress: 1284/2057 symbols completed. NMT took 1.1s. Estimated remaining: 5m 14s. Rate: 147.7 symbols/min [2025-09-29T22:13:01.956060] [INFO ] [MAIN ] NNN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:01.941315] [INFO ] [MAIN ] NNI: Loaded 10094 primary data records. [2025-09-29T22:13:02.612042] [DEBUG] [LOCAL ] NNN: Loaded 48364 existing records from primary storage. [2025-09-29T22:13:02.613594] [INFO ] [MAIN ] NNN: Loaded 48364 primary data records. [2025-09-29T22:13:02.977200] [DEBUG] [MAIN ] NNI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:02.979215] [INFO ] [MAIN ] NNI: Generated 1794 derivative records from 10094 primary records. [2025-09-29T22:13:02.979845] [DEBUG] [MAIN ] NMZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:02.979963] [DEBUG] [LOCAL ] NNI: Saving derivative data. [2025-09-29T22:13:02.981262] [INFO ] [MAIN ] NMZ: Generated 1794 derivative records from 21748 primary records. [2025-09-29T22:13:02.981388] [DEBUG] [LOCAL ] NMZ: Saving derivative data. [2025-09-29T22:13:03.017789] [DEBUG] [LOCAL ] NMZ: Derivative data saved (1794 records). [2025-09-29T22:13:03.019213] [INFO ] [MAIN ] NMZ: Successfully saved derivative data. [2025-09-29T22:13:03.019082] [DEBUG] [LOCAL ] NNI: Derivative data saved (1794 records). [2025-09-29T22:13:03.021463] [INFO ] [MAIN ] Derivative Progress: 1285/2057 symbols completed. NMZ took 1.2s. Estimated remaining: 5m 14s. Rate: 147.5 symbols/min [2025-09-29T22:13:03.021857] [INFO ] [MAIN ] NNY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:03.021992] [INFO ] [MAIN ] NNI: Successfully saved derivative data. [2025-09-29T22:13:03.025921] [INFO ] [MAIN ] Derivative Progress: 1286/2057 symbols completed. NNI took 1.2s. Estimated remaining: 5m 13s. Rate: 147.6 symbols/min [2025-09-29T22:13:03.026130] [INFO ] [MAIN ] NOA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:03.043104] [DEBUG] [MAIN ] NNN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:03.044019] [INFO ] [MAIN ] NNN: Generated 1794 derivative records from 48364 primary records. [2025-09-29T22:13:03.045955] [DEBUG] [LOCAL ] NNN: Saving derivative data. [2025-09-29T22:13:03.050496] [DEBUG] [LOCAL ] NNY: Loaded 5683 existing records from primary storage. [2025-09-29T22:13:03.050927] [INFO ] [MAIN ] NNY: Loaded 5683 primary data records. [2025-09-29T22:13:03.181887] [DEBUG] [LOCAL ] NOA: Loaded 16234 existing records from primary storage. [2025-09-29T22:13:03.192464] [INFO ] [MAIN ] NOA: Loaded 16234 primary data records. [2025-09-29T22:13:03.197724] [DEBUG] [LOCAL ] NNN: Derivative data saved (1794 records). [2025-09-29T22:13:03.198058] [INFO ] [MAIN ] NNN: Successfully saved derivative data. [2025-09-29T22:13:03.205990] [INFO ] [MAIN ] Derivative Progress: 1287/2057 symbols completed. NNN took 1.2s. Estimated remaining: 5m 13s. Rate: 147.7 symbols/min [2025-09-29T22:13:03.238575] [INFO ] [MAIN ] NOAH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:03.732074] [DEBUG] [LOCAL ] NOAH: Loaded 20185 existing records from primary storage. [2025-09-29T22:13:03.732392] [INFO ] [MAIN ] NOAH: Loaded 20185 primary data records. [2025-09-29T22:13:04.114687] [DEBUG] [MAIN ] NNY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:04.116381] [INFO ] [MAIN ] NNY: Generated 1794 derivative records from 5683 primary records. [2025-09-29T22:13:04.116719] [DEBUG] [LOCAL ] NNY: Saving derivative data. [2025-09-29T22:13:04.135381] [DEBUG] [LOCAL ] NNY: Derivative data saved (1794 records). [2025-09-29T22:13:04.137477] [INFO ] [MAIN ] NNY: Successfully saved derivative data. [2025-09-29T22:13:04.139766] [INFO ] [MAIN ] Derivative Progress: 1288/2057 symbols completed. NNY took 1.1s. Estimated remaining: 5m 13s. Rate: 147.5 symbols/min [2025-09-29T22:13:04.155346] [DEBUG] [MAIN ] NOA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:04.156371] [INFO ] [MAIN ] NOA: Generated 1794 derivative records from 16234 primary records. [2025-09-29T22:13:04.156593] [DEBUG] [LOCAL ] NOA: Saving derivative data. [2025-09-29T22:13:04.177794] [DEBUG] [LOCAL ] NOA: Derivative data saved (1794 records). [2025-09-29T22:13:04.178713] [INFO ] [MAIN ] NOA: Successfully saved derivative data. [2025-09-29T22:13:04.181053] [INFO ] [MAIN ] Derivative Progress: 1289/2057 symbols completed. NOA took 1.2s. Estimated remaining: 5m 12s. Rate: 147.6 symbols/min [2025-09-29T22:13:04.194084] [DEBUG] [MAIN ] NOAH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:04.194706] [INFO ] [MAIN ] NOAH: Generated 1794 derivative records from 20185 primary records. [2025-09-29T22:13:04.194770] [DEBUG] [LOCAL ] NOAH: Saving derivative data. [2025-09-29T22:13:04.210483] [DEBUG] [LOCAL ] NOAH: Derivative data saved (1794 records). [2025-09-29T22:13:04.210550] [INFO ] [MAIN ] NOAH: Successfully saved derivative data. [2025-09-29T22:13:04.212899] [INFO ] [MAIN ] Derivative Progress: 1290/2057 symbols completed. NOAH took 1.0s. Estimated remaining: 5m 11s. Rate: 147.7 symbols/min [2025-09-29T22:13:04.213319] [INFO ] [MAIN ] NOC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:04.213483] [INFO ] [MAIN ] NOG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:04.213626] [INFO ] [MAIN ] NOK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:04.258432] [DEBUG] [LOCAL ] NOC: Loaded 42285 existing records from primary storage. [2025-09-29T22:13:04.258840] [INFO ] [MAIN ] NOC: Loaded 42285 primary data records. [2025-09-29T22:13:04.454243] [DEBUG] [LOCAL ] NOK: Loaded 53621 existing records from primary storage. [2025-09-29T22:13:04.515937] [INFO ] [MAIN ] NOK: Loaded 53621 primary data records. [2025-09-29T22:13:04.480012] [DEBUG] [LOCAL ] NOG: Loaded 51168 existing records from primary storage. [2025-09-29T22:13:04.516215] [INFO ] [MAIN ] NOG: Loaded 51168 primary data records. [2025-09-29T22:13:05.301367] [DEBUG] [MAIN ] NOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:05.302282] [INFO ] [MAIN ] NOC: Generated 1794 derivative records from 42285 primary records. [2025-09-29T22:13:05.302506] [DEBUG] [LOCAL ] NOC: Saving derivative data. [2025-09-29T22:13:05.325463] [DEBUG] [LOCAL ] NOC: Derivative data saved (1794 records). [2025-09-29T22:13:05.326390] [INFO ] [MAIN ] NOC: Successfully saved derivative data. [2025-09-29T22:13:05.329216] [INFO ] [MAIN ] Derivative Progress: 1291/2057 symbols completed. NOC took 1.1s. Estimated remaining: 5m 12s. Rate: 147.5 symbols/min [2025-09-29T22:13:05.330256] [INFO ] [MAIN ] NOMD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:05.348340] [DEBUG] [MAIN ] NOK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:05.362466] [INFO ] [MAIN ] NOK: Generated 1794 derivative records from 53621 primary records. [2025-09-29T22:13:05.362799] [DEBUG] [LOCAL ] NOK: Saving derivative data. [2025-09-29T22:13:05.362982] [DEBUG] [MAIN ] NOG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:05.363946] [INFO ] [MAIN ] NOG: Generated 1794 derivative records from 51168 primary records. [2025-09-29T22:13:05.364733] [DEBUG] [LOCAL ] NOG: Saving derivative data. [2025-09-29T22:13:05.394287] [DEBUG] [LOCAL ] NOK: Derivative data saved (1794 records). [2025-09-29T22:13:05.395074] [INFO ] [MAIN ] NOK: Successfully saved derivative data. [2025-09-29T22:13:05.398037] [INFO ] [MAIN ] Derivative Progress: 1292/2057 symbols completed. NOK took 1.2s. Estimated remaining: 5m 11s. Rate: 147.6 symbols/min [2025-09-29T22:13:05.398499] [INFO ] [MAIN ] NOTE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:05.410331] [DEBUG] [LOCAL ] NOG: Derivative data saved (1794 records). [2025-09-29T22:13:05.410481] [INFO ] [MAIN ] NOG: Successfully saved derivative data. [2025-09-29T22:13:05.412725] [INFO ] [MAIN ] Derivative Progress: 1293/2057 symbols completed. NOG took 1.2s. Estimated remaining: 5m 10s. Rate: 147.7 symbols/min [2025-09-29T22:13:05.413126] [INFO ] [MAIN ] NOV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:05.431501] [DEBUG] [LOCAL ] NOMD: Loaded 41391 existing records from primary storage. [2025-09-29T22:13:05.431772] [INFO ] [MAIN ] NOMD: Loaded 41391 primary data records. [2025-09-29T22:13:05.684854] [DEBUG] [LOCAL ] NOTE: Loaded 42302 existing records from primary storage. [2025-09-29T22:13:05.794514] [INFO ] [MAIN ] NOTE: Loaded 42302 primary data records. [2025-09-29T22:13:05.871406] [DEBUG] [LOCAL ] NOV: Loaded 53181 existing records from primary storage. [2025-09-29T22:13:05.877949] [INFO ] [MAIN ] NOV: Loaded 53181 primary data records. [2025-09-29T22:13:06.548706] [DEBUG] [MAIN ] NOMD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:06.550870] [INFO ] [MAIN ] NOMD: Generated 1794 derivative records from 41391 primary records. [2025-09-29T22:13:06.551052] [DEBUG] [LOCAL ] NOMD: Saving derivative data. [2025-09-29T22:13:06.572872] [DEBUG] [LOCAL ] NOMD: Derivative data saved (1794 records). [2025-09-29T22:13:06.573256] [INFO ] [MAIN ] NOMD: Successfully saved derivative data. [2025-09-29T22:13:06.576661] [INFO ] [MAIN ] Derivative Progress: 1294/2057 symbols completed. NOMD took 1.2s. Estimated remaining: 5m 10s. Rate: 147.5 symbols/min [2025-09-29T22:13:06.577931] [INFO ] [MAIN ] NOW: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:06.599532] [DEBUG] [MAIN ] NOV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:06.602033] [INFO ] [MAIN ] NOV: Generated 1794 derivative records from 53181 primary records. [2025-09-29T22:13:06.602468] [DEBUG] [LOCAL ] NOV: Saving derivative data. [2025-09-29T22:13:06.624421] [DEBUG] [MAIN ] NOTE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:06.629721] [INFO ] [MAIN ] NOTE: Generated 1794 derivative records from 42302 primary records. [2025-09-29T22:13:06.630262] [DEBUG] [LOCAL ] NOTE: Saving derivative data. [2025-09-29T22:13:06.647679] [DEBUG] [LOCAL ] NOV: Derivative data saved (1794 records). [2025-09-29T22:13:06.649258] [INFO ] [MAIN ] NOV: Successfully saved derivative data. [2025-09-29T22:13:06.663754] [INFO ] [MAIN ] Derivative Progress: 1295/2057 symbols completed. NOV took 1.3s. Estimated remaining: 5m 10s. Rate: 147.6 symbols/min [2025-09-29T22:13:06.663951] [DEBUG] [LOCAL ] NOTE: Derivative data saved (1794 records). [2025-09-29T22:13:06.664368] [INFO ] [MAIN ] NOTE: Successfully saved derivative data. [2025-09-29T22:13:06.664277] [INFO ] [MAIN ] NPCT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:06.666591] [INFO ] [MAIN ] Derivative Progress: 1296/2057 symbols completed. NOTE took 1.3s. Estimated remaining: 5m 9s. Rate: 147.7 symbols/min [2025-09-29T22:13:06.667434] [INFO ] [MAIN ] NPFD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:06.694487] [DEBUG] [LOCAL ] NOW: Loaded 48581 existing records from primary storage. [2025-09-29T22:13:06.694805] [INFO ] [MAIN ] NOW: Loaded 48581 primary data records. [2025-09-29T22:13:06.769637] [DEBUG] [LOCAL ] NPFD: Loaded 9726 existing records from primary storage. [2025-09-29T22:13:06.794427] [INFO ] [MAIN ] NPFD: Loaded 9726 primary data records. [2025-09-29T22:13:06.794325] [DEBUG] [LOCAL ] NPCT: Loaded 16956 existing records from primary storage. [2025-09-29T22:13:06.868092] [INFO ] [MAIN ] NPCT: Loaded 16956 primary data records. [2025-09-29T22:13:07.762079] [DEBUG] [MAIN ] NOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:07.764508] [INFO ] [MAIN ] NOW: Generated 1794 derivative records from 48581 primary records. [2025-09-29T22:13:07.765102] [DEBUG] [LOCAL ] NOW: Saving derivative data. [2025-09-29T22:13:07.791982] [DEBUG] [LOCAL ] NOW: Derivative data saved (1794 records). [2025-09-29T22:13:07.792822] [INFO ] [MAIN ] NOW: Successfully saved derivative data. [2025-09-29T22:13:07.795246] [INFO ] [MAIN ] Derivative Progress: 1297/2057 symbols completed. NOW took 1.2s. Estimated remaining: 5m 9s. Rate: 147.5 symbols/min [2025-09-29T22:13:07.795791] [INFO ] [MAIN ] NPK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:07.823533] [DEBUG] [MAIN ] NPCT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:07.823225] [DEBUG] [MAIN ] NPFD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:07.824585] [INFO ] [MAIN ] NPCT: Generated 1794 derivative records from 16956 primary records. [2025-09-29T22:13:07.825447] [INFO ] [MAIN ] NPFD: Generated 1794 derivative records from 9726 primary records. [2025-09-29T22:13:07.827669] [DEBUG] [LOCAL ] NPFD: Saving derivative data. [2025-09-29T22:13:07.824770] [DEBUG] [LOCAL ] NPCT: Saving derivative data. [2025-09-29T22:13:07.833596] [DEBUG] [LOCAL ] NPK: Loaded 7996 existing records from primary storage. [2025-09-29T22:13:07.857051] [INFO ] [MAIN ] NPK: Loaded 7996 primary data records. [2025-09-29T22:13:07.893349] [DEBUG] [LOCAL ] NPFD: Derivative data saved (1794 records). [2025-09-29T22:13:07.907559] [INFO ] [MAIN ] NPFD: Successfully saved derivative data. [2025-09-29T22:13:07.915017] [INFO ] [MAIN ] Derivative Progress: 1298/2057 symbols completed. NPFD took 1.2s. Estimated remaining: 5m 9s. Rate: 147.6 symbols/min [2025-09-29T22:13:07.915478] [INFO ] [MAIN ] NPO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:07.977914] [DEBUG] [LOCAL ] NPCT: Derivative data saved (1794 records). [2025-09-29T22:13:07.988727] [INFO ] [MAIN ] NPCT: Successfully saved derivative data. [2025-09-29T22:13:08.032940] [INFO ] [MAIN ] Derivative Progress: 1299/2057 symbols completed. NPCT took 1.4s. Estimated remaining: 5m 8s. Rate: 147.7 symbols/min [2025-09-29T22:13:08.063702] [INFO ] [MAIN ] NPV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:08.183558] [DEBUG] [LOCAL ] NPO: Loaded 12875 existing records from primary storage. [2025-09-29T22:13:08.194245] [INFO ] [MAIN ] NPO: Loaded 12875 primary data records. [2025-09-29T22:13:08.257312] [DEBUG] [LOCAL ] NPV: Loaded 5045 existing records from primary storage. [2025-09-29T22:13:08.281265] [INFO ] [MAIN ] NPV: Loaded 5045 primary data records. [2025-09-29T22:13:08.996831] [DEBUG] [MAIN ] NPK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:08.998206] [INFO ] [MAIN ] NPK: Generated 1794 derivative records from 7996 primary records. [2025-09-29T22:13:08.998316] [DEBUG] [LOCAL ] NPK: Saving derivative data. [2025-09-29T22:13:09.018676] [DEBUG] [LOCAL ] NPK: Derivative data saved (1794 records). [2025-09-29T22:13:09.019020] [INFO ] [MAIN ] NPK: Successfully saved derivative data. [2025-09-29T22:13:09.021278] [INFO ] [MAIN ] Derivative Progress: 1300/2057 symbols completed. NPK took 1.2s. Estimated remaining: 5m 8s. Rate: 147.5 symbols/min [2025-09-29T22:13:09.022184] [INFO ] [MAIN ] NPWR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:09.041493] [DEBUG] [MAIN ] NPV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:13:09.042443] [INFO ] [MAIN ] NPV: Generated 1793 derivative records from 5045 primary records. [2025-09-29T22:13:09.042531] [DEBUG] [LOCAL ] NPV: Saving derivative data. [2025-09-29T22:13:09.077028] [DEBUG] [MAIN ] NPO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:09.087499] [INFO ] [MAIN ] NPO: Generated 1794 derivative records from 12875 primary records. [2025-09-29T22:13:09.088573] [DEBUG] [LOCAL ] NPO: Saving derivative data. [2025-09-29T22:13:09.117228] [DEBUG] [LOCAL ] NPV: Derivative data saved (1793 records). [2025-09-29T22:13:09.118434] [INFO ] [MAIN ] NPV: Successfully saved derivative data. [2025-09-29T22:13:09.122432] [INFO ] [MAIN ] Derivative Progress: 1301/2057 symbols completed. NPV took 1.1s. Estimated remaining: 5m 7s. Rate: 147.6 symbols/min [2025-09-29T22:13:09.123877] [INFO ] [MAIN ] NQP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:09.119934] [DEBUG] [LOCAL ] NPWR: Loaded 43014 existing records from primary storage. [2025-09-29T22:13:09.125100] [DEBUG] [LOCAL ] NPO: Derivative data saved (1794 records). [2025-09-29T22:13:09.125929] [INFO ] [MAIN ] NPO: Successfully saved derivative data. [2025-09-29T22:13:09.128786] [INFO ] [MAIN ] Derivative Progress: 1302/2057 symbols completed. NPO took 1.2s. Estimated remaining: 5m 7s. Rate: 147.7 symbols/min [2025-09-29T22:13:09.129209] [INFO ] [MAIN ] NRDY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:09.125701] [INFO ] [MAIN ] NPWR: Loaded 43014 primary data records. [2025-09-29T22:13:09.250508] [DEBUG] [LOCAL ] NQP: Loaded 9279 existing records from primary storage. [2025-09-29T22:13:09.256016] [INFO ] [MAIN ] NQP: Loaded 9279 primary data records. [2025-09-29T22:13:09.591983] [DEBUG] [LOCAL ] NRDY: Loaded 32658 existing records from primary storage. [2025-09-29T22:13:09.598189] [INFO ] [MAIN ] NRDY: Loaded 32658 primary data records. [2025-09-29T22:13:10.152255] [DEBUG] [MAIN ] NPWR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:10.153219] [INFO ] [MAIN ] NPWR: Generated 1794 derivative records from 43014 primary records. [2025-09-29T22:13:10.153475] [DEBUG] [LOCAL ] NPWR: Saving derivative data. [2025-09-29T22:13:10.183690] [DEBUG] [LOCAL ] NPWR: Derivative data saved (1794 records). [2025-09-29T22:13:10.189292] [INFO ] [MAIN ] NPWR: Successfully saved derivative data. [2025-09-29T22:13:10.192407] [DEBUG] [MAIN ] NQP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:10.191714] [INFO ] [MAIN ] Derivative Progress: 1303/2057 symbols completed. NPWR took 1.2s. Estimated remaining: 5m 7s. Rate: 147.5 symbols/min [2025-09-29T22:13:10.193740] [INFO ] [MAIN ] NQP: Generated 1794 derivative records from 9279 primary records. [2025-09-29T22:13:10.194074] [DEBUG] [LOCAL ] NQP: Saving derivative data. [2025-09-29T22:13:10.224537] [DEBUG] [MAIN ] NRDY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:10.225801] [INFO ] [MAIN ] NRDY: Generated 1794 derivative records from 32658 primary records. [2025-09-29T22:13:10.226129] [DEBUG] [LOCAL ] NRDY: Saving derivative data. [2025-09-29T22:13:10.235266] [DEBUG] [LOCAL ] NQP: Derivative data saved (1794 records). [2025-09-29T22:13:10.236160] [INFO ] [MAIN ] NQP: Successfully saved derivative data. [2025-09-29T22:13:10.240856] [INFO ] [MAIN ] Derivative Progress: 1304/2057 symbols completed. NQP took 1.1s. Estimated remaining: 5m 6s. Rate: 147.6 symbols/min [2025-09-29T22:13:10.245200] [DEBUG] [LOCAL ] NRDY: Derivative data saved (1794 records). [2025-09-29T22:13:10.245267] [INFO ] [MAIN ] NRDY: Successfully saved derivative data. [2025-09-29T22:13:10.247371] [INFO ] [MAIN ] Derivative Progress: 1305/2057 symbols completed. NRDY took 1.1s. Estimated remaining: 5m 5s. Rate: 147.8 symbols/min [2025-09-29T22:13:10.247952] [INFO ] [MAIN ] NRGV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:10.247877] [INFO ] [MAIN ] NREF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:10.248213] [INFO ] [MAIN ] NRK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:10.260784] [DEBUG] [LOCAL ] NREF: Loaded 7859 existing records from primary storage. [2025-09-29T22:13:10.261002] [INFO ] [MAIN ] NREF: Loaded 7859 primary data records. [2025-09-29T22:13:10.378277] [DEBUG] [LOCAL ] NRK: Loaded 19832 existing records from primary storage. [2025-09-29T22:13:10.398203] [INFO ] [MAIN ] NRK: Loaded 19832 primary data records. [2025-09-29T22:13:10.711134] [DEBUG] [LOCAL ] NRGV: Loaded 43174 existing records from primary storage. [2025-09-29T22:13:10.743322] [INFO ] [MAIN ] NRGV: Loaded 43174 primary data records. [2025-09-29T22:13:11.312601] [DEBUG] [MAIN ] NREF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:11.314147] [INFO ] [MAIN ] NREF: Generated 1794 derivative records from 7859 primary records. [2025-09-29T22:13:11.314444] [DEBUG] [LOCAL ] NREF: Saving derivative data. [2025-09-29T22:13:11.351776] [DEBUG] [LOCAL ] NREF: Derivative data saved (1794 records). [2025-09-29T22:13:11.353780] [DEBUG] [MAIN ] NRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:11.354665] [INFO ] [MAIN ] NRK: Generated 1794 derivative records from 19832 primary records. [2025-09-29T22:13:11.354775] [DEBUG] [LOCAL ] NRK: Saving derivative data. [2025-09-29T22:13:11.364879] [INFO ] [MAIN ] NREF: Successfully saved derivative data. [2025-09-29T22:13:11.367466] [INFO ] [MAIN ] Derivative Progress: 1306/2057 symbols completed. NREF took 1.1s. Estimated remaining: 5m 5s. Rate: 147.6 symbols/min [2025-09-29T22:13:11.371959] [INFO ] [MAIN ] NRP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:11.387801] [DEBUG] [MAIN ] NRGV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:11.389681] [INFO ] [MAIN ] NRGV: Generated 1794 derivative records from 43174 primary records. [2025-09-29T22:13:11.390268] [DEBUG] [LOCAL ] NRGV: Saving derivative data. [2025-09-29T22:13:11.410933] [DEBUG] [LOCAL ] NRP: Loaded 4053 existing records from primary storage. [2025-09-29T22:13:11.412747] [INFO ] [MAIN ] NRP: Loaded 4053 primary data records. [2025-09-29T22:13:11.413401] [DEBUG] [LOCAL ] NRK: Derivative data saved (1794 records). [2025-09-29T22:13:11.459965] [INFO ] [MAIN ] NRK: Successfully saved derivative data. [2025-09-29T22:13:11.484533] [INFO ] [MAIN ] Derivative Progress: 1307/2057 symbols completed. NRK took 1.2s. Estimated remaining: 5m 5s. Rate: 147.6 symbols/min [2025-09-29T22:13:11.510090] [INFO ] [MAIN ] NRT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:11.543131] [DEBUG] [LOCAL ] NRGV: Derivative data saved (1794 records). [2025-09-29T22:13:11.548626] [INFO ] [MAIN ] NRGV: Successfully saved derivative data. [2025-09-29T22:13:11.562973] [INFO ] [MAIN ] Derivative Progress: 1308/2057 symbols completed. NRGV took 1.3s. Estimated remaining: 5m 4s. Rate: 147.7 symbols/min [2025-09-29T22:13:11.579041] [INFO ] [MAIN ] NRUC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:11.624940] [DEBUG] [LOCAL ] NRT: Loaded 4946 existing records from primary storage. [2025-09-29T22:13:11.625113] [INFO ] [MAIN ] NRT: Loaded 4946 primary data records. [2025-09-29T22:13:11.813750] [DEBUG] [LOCAL ] NRUC: Loaded 3083 existing records from primary storage. [2025-09-29T22:13:11.854129] [INFO ] [MAIN ] NRUC: Loaded 3083 primary data records. [2025-09-29T22:13:12.474323] [DEBUG] [MAIN ] NRP: Filtered 7001 bins outside market hours, 7823 incomplete bins [2025-09-29T22:13:12.475499] [INFO ] [MAIN ] NRP: Generated 1791 derivative records from 4053 primary records. [2025-09-29T22:13:12.475747] [DEBUG] [LOCAL ] NRP: Saving derivative data. [2025-09-29T22:13:12.495938] [DEBUG] [LOCAL ] NRP: Derivative data saved (1791 records). [2025-09-29T22:13:12.496088] [INFO ] [MAIN ] NRP: Successfully saved derivative data. [2025-09-29T22:13:12.498538] [INFO ] [MAIN ] Derivative Progress: 1309/2057 symbols completed. NRP took 1.1s. Estimated remaining: 5m 4s. Rate: 147.6 symbols/min [2025-09-29T22:13:12.498823] [INFO ] [MAIN ] NSA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:12.518006] [DEBUG] [MAIN ] NRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:12.519079] [INFO ] [MAIN ] NRT: Generated 1794 derivative records from 4946 primary records. [2025-09-29T22:13:12.519392] [DEBUG] [LOCAL ] NRT: Saving derivative data. [2025-09-29T22:13:12.552195] [DEBUG] [MAIN ] NRUC: Filtered 7001 bins outside market hours, 7825 incomplete bins [2025-09-29T22:13:12.553017] [DEBUG] [LOCAL ] NRT: Derivative data saved (1794 records). [2025-09-29T22:13:12.553850] [INFO ] [MAIN ] NRUC: Generated 1789 derivative records from 3083 primary records. [2025-09-29T22:13:12.554158] [INFO ] [MAIN ] NRT: Successfully saved derivative data. [2025-09-29T22:13:12.554238] [DEBUG] [LOCAL ] NRUC: Saving derivative data. [2025-09-29T22:13:12.556639] [INFO ] [MAIN ] Derivative Progress: 1310/2057 symbols completed. NRT took 1.0s. Estimated remaining: 5m 3s. Rate: 147.7 symbols/min [2025-09-29T22:13:12.557253] [INFO ] [MAIN ] NSP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:12.582801] [DEBUG] [LOCAL ] NRUC: Derivative data saved (1789 records). [2025-09-29T22:13:12.583001] [INFO ] [MAIN ] NRUC: Successfully saved derivative data. [2025-09-29T22:13:12.584985] [INFO ] [MAIN ] Derivative Progress: 1311/2057 symbols completed. NRUC took 1.0s. Estimated remaining: 5m 3s. Rate: 147.8 symbols/min [2025-09-29T22:13:12.585315] [INFO ] [MAIN ] NTB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:12.601701] [DEBUG] [LOCAL ] NSA: Loaded 44760 existing records from primary storage. [2025-09-29T22:13:12.602009] [INFO ] [MAIN ] NSA: Loaded 44760 primary data records. [2025-09-29T22:13:12.767348] [DEBUG] [LOCAL ] NTB: Loaded 20433 existing records from primary storage. [2025-09-29T22:13:12.835135] [INFO ] [MAIN ] NTB: Loaded 20433 primary data records. [2025-09-29T22:13:12.868344] [DEBUG] [LOCAL ] NSP: Loaded 34896 existing records from primary storage. [2025-09-29T22:13:12.972191] [INFO ] [MAIN ] NSP: Loaded 34896 primary data records. [2025-09-29T22:13:13.651590] [DEBUG] [MAIN ] NSA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:13.652986] [INFO ] [MAIN ] NSA: Generated 1794 derivative records from 44760 primary records. [2025-09-29T22:13:13.653169] [DEBUG] [LOCAL ] NSA: Saving derivative data. [2025-09-29T22:13:13.677499] [DEBUG] [LOCAL ] NSA: Derivative data saved (1794 records). [2025-09-29T22:13:13.677809] [INFO ] [MAIN ] NSA: Successfully saved derivative data. [2025-09-29T22:13:13.679925] [INFO ] [MAIN ] Derivative Progress: 1312/2057 symbols completed. NSA took 1.2s. Estimated remaining: 5m 3s. Rate: 147.6 symbols/min [2025-09-29T22:13:13.683314] [INFO ] [MAIN ] NTR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:13.715727] [DEBUG] [MAIN ] NTB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:13.717282] [INFO ] [MAIN ] NTB: Generated 1794 derivative records from 20433 primary records. [2025-09-29T22:13:13.716338] [DEBUG] [MAIN ] NSP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:13.718163] [DEBUG] [LOCAL ] NTB: Saving derivative data. [2025-09-29T22:13:13.718273] [INFO ] [MAIN ] NSP: Generated 1794 derivative records from 34896 primary records. [2025-09-29T22:13:13.718783] [DEBUG] [LOCAL ] NSP: Saving derivative data. [2025-09-29T22:13:13.754219] [DEBUG] [LOCAL ] NSP: Derivative data saved (1794 records). [2025-09-29T22:13:13.755248] [INFO ] [MAIN ] NSP: Successfully saved derivative data. [2025-09-29T22:13:13.755342] [DEBUG] [LOCAL ] NTB: Derivative data saved (1794 records). [2025-09-29T22:13:13.755452] [INFO ] [MAIN ] NTB: Successfully saved derivative data. [2025-09-29T22:13:13.757923] [INFO ] [MAIN ] Derivative Progress: 1313/2057 symbols completed. NSP took 1.2s. Estimated remaining: 5m 2s. Rate: 147.7 symbols/min [2025-09-29T22:13:13.758122] [INFO ] [MAIN ] NTST: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:13.760696] [INFO ] [MAIN ] Derivative Progress: 1314/2057 symbols completed. NTB took 1.2s. Estimated remaining: 5m 2s. Rate: 147.8 symbols/min [2025-09-29T22:13:13.761013] [INFO ] [MAIN ] NU: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:13.807771] [DEBUG] [LOCAL ] NTR: Loaded 52580 existing records from primary storage. [2025-09-29T22:13:13.807979] [INFO ] [MAIN ] NTR: Loaded 52580 primary data records. [2025-09-29T22:13:13.965192] [DEBUG] [LOCAL ] NTST: Loaded 43486 existing records from primary storage. [2025-09-29T22:13:13.971378] [INFO ] [MAIN ] NTST: Loaded 43486 primary data records. [2025-09-29T22:13:14.132715] [DEBUG] [LOCAL ] NU: Loaded 53746 existing records from primary storage. [2025-09-29T22:13:14.159100] [INFO ] [MAIN ] NU: Loaded 53746 primary data records. [2025-09-29T22:13:14.894905] [DEBUG] [MAIN ] NTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:14.897467] [INFO ] [MAIN ] NTR: Generated 1794 derivative records from 52580 primary records. [2025-09-29T22:13:14.897878] [DEBUG] [LOCAL ] NTR: Saving derivative data. [2025-09-29T22:13:14.917988] [DEBUG] [LOCAL ] NTR: Derivative data saved (1794 records). [2025-09-29T22:13:14.918476] [INFO ] [MAIN ] NTR: Successfully saved derivative data. [2025-09-29T22:13:14.928330] [INFO ] [MAIN ] Derivative Progress: 1315/2057 symbols completed. NTR took 1.2s. Estimated remaining: 5m 2s. Rate: 147.6 symbols/min [2025-09-29T22:13:14.933685] [INFO ] [MAIN ] NUS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:14.934884] [DEBUG] [MAIN ] NTST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:14.935703] [INFO ] [MAIN ] NTST: Generated 1794 derivative records from 43486 primary records. [2025-09-29T22:13:14.935789] [DEBUG] [LOCAL ] NTST: Saving derivative data. [2025-09-29T22:13:14.968095] [DEBUG] [MAIN ] NU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:14.969621] [INFO ] [MAIN ] NU: Generated 1794 derivative records from 53746 primary records. [2025-09-29T22:13:14.970047] [DEBUG] [LOCAL ] NU: Saving derivative data. [2025-09-29T22:13:14.971720] [DEBUG] [LOCAL ] NTST: Derivative data saved (1794 records). [2025-09-29T22:13:14.972156] [INFO ] [MAIN ] NTST: Successfully saved derivative data. [2025-09-29T22:13:14.981946] [INFO ] [MAIN ] Derivative Progress: 1316/2057 symbols completed. NTST took 1.2s. Estimated remaining: 5m 1s. Rate: 147.7 symbols/min [2025-09-29T22:13:14.982093] [INFO ] [MAIN ] NUV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:15.001199] [DEBUG] [LOCAL ] NU: Derivative data saved (1794 records). [2025-09-29T22:13:15.016955] [INFO ] [MAIN ] NU: Successfully saved derivative data. [2025-09-29T22:13:15.019169] [INFO ] [MAIN ] Derivative Progress: 1317/2057 symbols completed. NU took 1.3s. Estimated remaining: 5m 0s. Rate: 147.8 symbols/min [2025-09-29T22:13:15.019395] [INFO ] [MAIN ] NUVB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:15.020323] [DEBUG] [LOCAL ] NUS: Loaded 36394 existing records from primary storage. [2025-09-29T22:13:15.020947] [INFO ] [MAIN ] NUS: Loaded 36394 primary data records. [2025-09-29T22:13:15.080834] [DEBUG] [LOCAL ] NUV: Loaded 23326 existing records from primary storage. [2025-09-29T22:13:15.103627] [INFO ] [MAIN ] NUV: Loaded 23326 primary data records. [2025-09-29T22:13:15.698496] [DEBUG] [LOCAL ] NUVB: Loaded 51242 existing records from primary storage. [2025-09-29T22:13:15.700515] [INFO ] [MAIN ] NUVB: Loaded 51242 primary data records. [2025-09-29T22:13:16.051557] [DEBUG] [MAIN ] NUS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:16.053184] [INFO ] [MAIN ] NUS: Generated 1794 derivative records from 36394 primary records. [2025-09-29T22:13:16.053282] [DEBUG] [LOCAL ] NUS: Saving derivative data. [2025-09-29T22:13:16.088324] [DEBUG] [LOCAL ] NUS: Derivative data saved (1794 records). [2025-09-29T22:13:16.088616] [DEBUG] [MAIN ] NUV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:16.089896] [INFO ] [MAIN ] NUV: Generated 1794 derivative records from 23326 primary records. [2025-09-29T22:13:16.088922] [INFO ] [MAIN ] NUS: Successfully saved derivative data. [2025-09-29T22:13:16.092220] [INFO ] [MAIN ] Derivative Progress: 1318/2057 symbols completed. NUS took 1.2s. Estimated remaining: 5m 0s. Rate: 147.6 symbols/min [2025-09-29T22:13:16.092298] [DEBUG] [LOCAL ] NUV: Saving derivative data. [2025-09-29T22:13:16.109920] [DEBUG] [LOCAL ] NUV: Derivative data saved (1794 records). [2025-09-29T22:13:16.110295] [INFO ] [MAIN ] NUV: Successfully saved derivative data. [2025-09-29T22:13:16.112750] [INFO ] [MAIN ] Derivative Progress: 1319/2057 symbols completed. NUV took 1.1s. Estimated remaining: 4m 60s. Rate: 147.7 symbols/min [2025-09-29T22:13:16.129018] [DEBUG] [MAIN ] NUVB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:16.129699] [INFO ] [MAIN ] NUVB: Generated 1794 derivative records from 51242 primary records. [2025-09-29T22:13:16.129768] [DEBUG] [LOCAL ] NUVB: Saving derivative data. [2025-09-29T22:13:16.145936] [DEBUG] [LOCAL ] NUVB: Derivative data saved (1794 records). [2025-09-29T22:13:16.146040] [INFO ] [MAIN ] NUVB: Successfully saved derivative data. [2025-09-29T22:13:16.148088] [INFO ] [MAIN ] Derivative Progress: 1320/2057 symbols completed. NUVB took 1.1s. Estimated remaining: 4m 59s. Rate: 147.8 symbols/min [2025-09-29T22:13:16.148672] [INFO ] [MAIN ] NVG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:16.148582] [INFO ] [MAIN ] NUW: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:16.149258] [INFO ] [MAIN ] NVGS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:16.161082] [DEBUG] [LOCAL ] NUW: Loaded 7406 existing records from primary storage. [2025-09-29T22:13:16.161412] [INFO ] [MAIN ] NUW: Loaded 7406 primary data records. [2025-09-29T22:13:16.392372] [DEBUG] [LOCAL ] NVG: Loaded 27366 existing records from primary storage. [2025-09-29T22:13:16.505032] [DEBUG] [LOCAL ] NVGS: Loaded 30869 existing records from primary storage. [2025-09-29T22:13:16.510527] [INFO ] [MAIN ] NVGS: Loaded 30869 primary data records. [2025-09-29T22:13:16.510419] [INFO ] [MAIN ] NVG: Loaded 27366 primary data records. [2025-09-29T22:13:17.225758] [DEBUG] [MAIN ] NUW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:17.228573] [INFO ] [MAIN ] NUW: Generated 1794 derivative records from 7406 primary records. [2025-09-29T22:13:17.229224] [DEBUG] [LOCAL ] NUW: Saving derivative data. [2025-09-29T22:13:17.251858] [DEBUG] [LOCAL ] NUW: Derivative data saved (1794 records). [2025-09-29T22:13:17.252511] [INFO ] [MAIN ] NUW: Successfully saved derivative data. [2025-09-29T22:13:17.254853] [INFO ] [MAIN ] Derivative Progress: 1321/2057 symbols completed. NUW took 1.1s. Estimated remaining: 4m 59s. Rate: 147.6 symbols/min [2025-09-29T22:13:17.255148] [INFO ] [MAIN ] NVO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:17.290937] [DEBUG] [MAIN ] NVG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:17.291484] [DEBUG] [MAIN ] NVGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:17.292458] [INFO ] [MAIN ] NVG: Generated 1794 derivative records from 27366 primary records. [2025-09-29T22:13:17.292737] [DEBUG] [LOCAL ] NVG: Saving derivative data. [2025-09-29T22:13:17.293613] [INFO ] [MAIN ] NVGS: Generated 1794 derivative records from 30869 primary records. [2025-09-29T22:13:17.294305] [DEBUG] [LOCAL ] NVGS: Saving derivative data. [2025-09-29T22:13:17.324525] [DEBUG] [LOCAL ] NVGS: Derivative data saved (1794 records). [2025-09-29T22:13:17.325280] [INFO ] [MAIN ] NVGS: Successfully saved derivative data. [2025-09-29T22:13:17.327869] [INFO ] [MAIN ] Derivative Progress: 1322/2057 symbols completed. NVGS took 1.2s. Estimated remaining: 4m 59s. Rate: 147.7 symbols/min [2025-09-29T22:13:17.328503] [INFO ] [MAIN ] NVR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:17.332514] [DEBUG] [LOCAL ] NVG: Derivative data saved (1794 records). [2025-09-29T22:13:17.332832] [INFO ] [MAIN ] NVG: Successfully saved derivative data. [2025-09-29T22:13:17.335090] [INFO ] [MAIN ] Derivative Progress: 1323/2057 symbols completed. NVG took 1.2s. Estimated remaining: 4m 58s. Rate: 147.8 symbols/min [2025-09-29T22:13:17.335269] [INFO ] [MAIN ] NVRI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:17.366674] [DEBUG] [LOCAL ] NVR: Loaded 18774 existing records from primary storage. [2025-09-29T22:13:17.366866] [INFO ] [MAIN ] NVR: Loaded 18774 primary data records. [2025-09-29T22:13:17.456851] [DEBUG] [LOCAL ] NVO: Loaded 53784 existing records from primary storage. [2025-09-29T22:13:17.469202] [INFO ] [MAIN ] NVO: Loaded 53784 primary data records. [2025-09-29T22:13:17.650014] [DEBUG] [LOCAL ] NVRI: Loaded 38743 existing records from primary storage. [2025-09-29T22:13:17.672738] [INFO ] [MAIN ] NVRI: Loaded 38743 primary data records. [2025-09-29T22:13:18.377577] [DEBUG] [MAIN ] NVR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:18.378788] [INFO ] [MAIN ] NVR: Generated 1794 derivative records from 18774 primary records. [2025-09-29T22:13:18.379005] [DEBUG] [LOCAL ] NVR: Saving derivative data. [2025-09-29T22:13:18.412379] [DEBUG] [MAIN ] NVO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:18.414510] [INFO ] [MAIN ] NVO: Generated 1794 derivative records from 53784 primary records. [2025-09-29T22:13:18.415076] [DEBUG] [LOCAL ] NVO: Saving derivative data. [2025-09-29T22:13:18.430949] [DEBUG] [MAIN ] NVRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:18.441381] [INFO ] [MAIN ] NVRI: Generated 1794 derivative records from 38743 primary records. [2025-09-29T22:13:18.442047] [DEBUG] [LOCAL ] NVRI: Saving derivative data. [2025-09-29T22:13:18.446608] [DEBUG] [LOCAL ] NVR: Derivative data saved (1794 records). [2025-09-29T22:13:18.456288] [INFO ] [MAIN ] NVR: Successfully saved derivative data. [2025-09-29T22:13:18.460309] [INFO ] [MAIN ] Derivative Progress: 1324/2057 symbols completed. NVR took 1.1s. Estimated remaining: 4m 58s. Rate: 147.6 symbols/min [2025-09-29T22:13:18.460795] [INFO ] [MAIN ] NVS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:18.463638] [DEBUG] [LOCAL ] NVO: Derivative data saved (1794 records). [2025-09-29T22:13:18.466444] [INFO ] [MAIN ] NVO: Successfully saved derivative data. [2025-09-29T22:13:18.469457] [INFO ] [MAIN ] Derivative Progress: 1325/2057 symbols completed. NVO took 1.2s. Estimated remaining: 4m 57s. Rate: 147.7 symbols/min [2025-09-29T22:13:18.470246] [INFO ] [MAIN ] NVST: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:18.475248] [DEBUG] [LOCAL ] NVRI: Derivative data saved (1794 records). [2025-09-29T22:13:18.475397] [INFO ] [MAIN ] NVRI: Successfully saved derivative data. [2025-09-29T22:13:18.477766] [INFO ] [MAIN ] Derivative Progress: 1326/2057 symbols completed. NVRI took 1.1s. Estimated remaining: 4m 57s. Rate: 147.8 symbols/min [2025-09-29T22:13:18.478141] [INFO ] [MAIN ] NVT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:18.550547] [DEBUG] [LOCAL ] NVST: Loaded 51609 existing records from primary storage. [2025-09-29T22:13:18.550775] [INFO ] [MAIN ] NVST: Loaded 51609 primary data records. [2025-09-29T22:13:18.675581] [DEBUG] [LOCAL ] NVS: Loaded 51549 existing records from primary storage. [2025-09-29T22:13:18.684413] [DEBUG] [LOCAL ] NVT: Loaded 51518 existing records from primary storage. [2025-09-29T22:13:18.697887] [INFO ] [MAIN ] NVS: Loaded 51549 primary data records. [2025-09-29T22:13:18.739403] [INFO ] [MAIN ] NVT: Loaded 51518 primary data records. [2025-09-29T22:13:19.629122] [DEBUG] [MAIN ] NVST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:19.631159] [INFO ] [MAIN ] NVST: Generated 1794 derivative records from 51609 primary records. [2025-09-29T22:13:19.631427] [DEBUG] [LOCAL ] NVST: Saving derivative data. [2025-09-29T22:13:19.655413] [DEBUG] [LOCAL ] NVST: Derivative data saved (1794 records). [2025-09-29T22:13:19.656311] [INFO ] [MAIN ] NVST: Successfully saved derivative data. [2025-09-29T22:13:19.666921] [INFO ] [MAIN ] Derivative Progress: 1327/2057 symbols completed. NVST took 1.2s. Estimated remaining: 4m 57s. Rate: 147.6 symbols/min [2025-09-29T22:13:19.667350] [INFO ] [MAIN ] NWG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:19.674207] [DEBUG] [MAIN ] NVS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:19.675827] [INFO ] [MAIN ] NVS: Generated 1794 derivative records from 51549 primary records. [2025-09-29T22:13:19.676095] [DEBUG] [LOCAL ] NVS: Saving derivative data. [2025-09-29T22:13:19.696424] [DEBUG] [LOCAL ] NVS: Derivative data saved (1794 records). [2025-09-29T22:13:19.710121] [INFO ] [MAIN ] NVS: Successfully saved derivative data. [2025-09-29T22:13:19.712820] [INFO ] [MAIN ] Derivative Progress: 1328/2057 symbols completed. NVS took 1.3s. Estimated remaining: 4m 56s. Rate: 147.7 symbols/min [2025-09-29T22:13:19.713459] [INFO ] [MAIN ] NWN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:19.713172] [DEBUG] [MAIN ] NVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:19.714952] [INFO ] [MAIN ] NVT: Generated 1794 derivative records from 51518 primary records. [2025-09-29T22:13:19.715083] [DEBUG] [LOCAL ] NVT: Saving derivative data. [2025-09-29T22:13:19.734097] [DEBUG] [LOCAL ] NVT: Derivative data saved (1794 records). [2025-09-29T22:13:19.734194] [INFO ] [MAIN ] NVT: Successfully saved derivative data. [2025-09-29T22:13:19.736335] [INFO ] [MAIN ] Derivative Progress: 1329/2057 symbols completed. NVT took 1.3s. Estimated remaining: 4m 55s. Rate: 147.8 symbols/min [2025-09-29T22:13:19.736535] [INFO ] [MAIN ] NX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:19.781961] [DEBUG] [LOCAL ] NWN: Loaded 26774 existing records from primary storage. [2025-09-29T22:13:19.782243] [INFO ] [MAIN ] NWN: Loaded 26774 primary data records. [2025-09-29T22:13:19.940692] [DEBUG] [LOCAL ] NX: Loaded 33165 existing records from primary storage. [2025-09-29T22:13:19.936662] [DEBUG] [LOCAL ] NWG: Loaded 51537 existing records from primary storage. [2025-09-29T22:13:19.941364] [INFO ] [MAIN ] NWG: Loaded 51537 primary data records. [2025-09-29T22:13:19.941584] [INFO ] [MAIN ] NX: Loaded 33165 primary data records. [2025-09-29T22:13:20.945694] [DEBUG] [MAIN ] NX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:20.961447] [INFO ] [MAIN ] NX: Generated 1794 derivative records from 33165 primary records. [2025-09-29T22:13:20.961853] [DEBUG] [LOCAL ] NX: Saving derivative data. [2025-09-29T22:13:20.963510] [DEBUG] [MAIN ] NWN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:20.978844] [INFO ] [MAIN ] NWN: Generated 1794 derivative records from 26774 primary records. [2025-09-29T22:13:20.980974] [DEBUG] [LOCAL ] NWN: Saving derivative data. [2025-09-29T22:13:20.985520] [DEBUG] [LOCAL ] NX: Derivative data saved (1794 records). [2025-09-29T22:13:20.985727] [INFO ] [MAIN ] NX: Successfully saved derivative data. [2025-09-29T22:13:20.988711] [INFO ] [MAIN ] Derivative Progress: 1330/2057 symbols completed. NX took 1.3s. Estimated remaining: 4m 56s. Rate: 147.6 symbols/min [2025-09-29T22:13:20.989038] [INFO ] [MAIN ] NXC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:21.017084] [DEBUG] [MAIN ] NWG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:21.020500] [INFO ] [MAIN ] NWG: Generated 1794 derivative records from 51537 primary records. [2025-09-29T22:13:21.021358] [DEBUG] [LOCAL ] NWG: Saving derivative data. [2025-09-29T22:13:21.024064] [DEBUG] [LOCAL ] NWN: Derivative data saved (1794 records). [2025-09-29T22:13:21.031981] [INFO ] [MAIN ] NWN: Successfully saved derivative data. [2025-09-29T22:13:21.041436] [DEBUG] [LOCAL ] NXC: Loaded 4221 existing records from primary storage. [2025-09-29T22:13:21.041931] [INFO ] [MAIN ] NXC: Loaded 4221 primary data records. [2025-09-29T22:13:21.040760] [INFO ] [MAIN ] Derivative Progress: 1331/2057 symbols completed. NWN took 1.3s. Estimated remaining: 4m 55s. Rate: 147.7 symbols/min [2025-09-29T22:13:21.047548] [INFO ] [MAIN ] NXDT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:21.159187] [DEBUG] [LOCAL ] NWG: Derivative data saved (1794 records). [2025-09-29T22:13:21.159377] [INFO ] [MAIN ] NWG: Successfully saved derivative data. [2025-09-29T22:13:21.161760] [INFO ] [MAIN ] Derivative Progress: 1332/2057 symbols completed. NWG took 1.5s. Estimated remaining: 4m 54s. Rate: 147.8 symbols/min [2025-09-29T22:13:21.188250] [INFO ] [MAIN ] NXE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:21.219878] [DEBUG] [LOCAL ] NXDT: Loaded 16219 existing records from primary storage. [2025-09-29T22:13:21.278109] [INFO ] [MAIN ] NXDT: Loaded 16219 primary data records. [2025-09-29T22:13:21.749223] [DEBUG] [LOCAL ] NXE: Loaded 52987 existing records from primary storage. [2025-09-29T22:13:21.749623] [INFO ] [MAIN ] NXE: Loaded 52987 primary data records. [2025-09-29T22:13:21.853390] [DEBUG] [MAIN ] NXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:21.869787] [INFO ] [MAIN ] NXC: Generated 1794 derivative records from 4221 primary records. [2025-09-29T22:13:21.874801] [DEBUG] [LOCAL ] NXC: Saving derivative data. [2025-09-29T22:13:22.119635] [DEBUG] [LOCAL ] NXC: Derivative data saved (1794 records). [2025-09-29T22:13:22.121085] [INFO ] [MAIN ] NXC: Successfully saved derivative data. [2025-09-29T22:13:22.123380] [INFO ] [MAIN ] Derivative Progress: 1333/2057 symbols completed. NXC took 1.1s. Estimated remaining: 4m 54s. Rate: 147.6 symbols/min [2025-09-29T22:13:22.143985] [DEBUG] [MAIN ] NXDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:22.145538] [INFO ] [MAIN ] NXDT: Generated 1794 derivative records from 16219 primary records. [2025-09-29T22:13:22.145838] [DEBUG] [LOCAL ] NXDT: Saving derivative data. [2025-09-29T22:13:22.168845] [DEBUG] [LOCAL ] NXDT: Derivative data saved (1794 records). [2025-09-29T22:13:22.170055] [INFO ] [MAIN ] NXDT: Successfully saved derivative data. [2025-09-29T22:13:22.173854] [INFO ] [MAIN ] Derivative Progress: 1334/2057 symbols completed. NXDT took 1.1s. Estimated remaining: 4m 54s. Rate: 147.7 symbols/min [2025-09-29T22:13:22.188552] [DEBUG] [MAIN ] NXE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:22.189337] [INFO ] [MAIN ] NXE: Generated 1794 derivative records from 52987 primary records. [2025-09-29T22:13:22.189406] [DEBUG] [LOCAL ] NXE: Saving derivative data. [2025-09-29T22:13:22.205713] [DEBUG] [LOCAL ] NXE: Derivative data saved (1794 records). [2025-09-29T22:13:22.205847] [INFO ] [MAIN ] NXE: Successfully saved derivative data. [2025-09-29T22:13:22.208202] [INFO ] [MAIN ] Derivative Progress: 1335/2057 symbols completed. NXE took 1.0s. Estimated remaining: 4m 53s. Rate: 147.8 symbols/min [2025-09-29T22:13:22.208770] [INFO ] [MAIN ] NXN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:22.209046] [INFO ] [MAIN ] NXJ: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:22.208931] [INFO ] [MAIN ] NXG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:22.215062] [DEBUG] [LOCAL ] NXN: Loaded 2325 existing records from primary storage. [2025-09-29T22:13:22.215505] [INFO ] [MAIN ] NXN: Loaded 2325 primary data records. [2025-09-29T22:13:22.334704] [DEBUG] [LOCAL ] NXG: Loaded 10411 existing records from primary storage. [2025-09-29T22:13:22.353779] [INFO ] [MAIN ] NXG: Loaded 10411 primary data records. [2025-09-29T22:13:22.348015] [DEBUG] [LOCAL ] NXJ: Loaded 14931 existing records from primary storage. [2025-09-29T22:13:22.359200] [INFO ] [MAIN ] NXJ: Loaded 14931 primary data records. [2025-09-29T22:13:23.313968] [DEBUG] [MAIN ] NXN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:23.316042] [INFO ] [MAIN ] NXN: Generated 1794 derivative records from 2325 primary records. [2025-09-29T22:13:23.316325] [DEBUG] [LOCAL ] NXN: Saving derivative data. [2025-09-29T22:13:23.336123] [DEBUG] [LOCAL ] NXN: Derivative data saved (1794 records). [2025-09-29T22:13:23.336748] [INFO ] [MAIN ] NXN: Successfully saved derivative data. [2025-09-29T22:13:23.354902] [INFO ] [MAIN ] Derivative Progress: 1336/2057 symbols completed. NXN took 1.1s. Estimated remaining: 4m 53s. Rate: 147.6 symbols/min [2025-09-29T22:13:23.357055] [INFO ] [MAIN ] NXP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:23.356603] [DEBUG] [MAIN ] NXJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:23.372495] [INFO ] [MAIN ] NXJ: Generated 1794 derivative records from 14931 primary records. [2025-09-29T22:13:23.372887] [DEBUG] [MAIN ] NXG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:23.373158] [DEBUG] [LOCAL ] NXJ: Saving derivative data. [2025-09-29T22:13:23.374311] [INFO ] [MAIN ] NXG: Generated 1794 derivative records from 10411 primary records. [2025-09-29T22:13:23.374606] [DEBUG] [LOCAL ] NXG: Saving derivative data. [2025-09-29T22:13:23.407727] [DEBUG] [LOCAL ] NXG: Derivative data saved (1794 records). [2025-09-29T22:13:23.408280] [INFO ] [MAIN ] NXG: Successfully saved derivative data. [2025-09-29T22:13:23.410885] [INFO ] [MAIN ] Derivative Progress: 1337/2057 symbols completed. NXG took 1.2s. Estimated remaining: 4m 52s. Rate: 147.7 symbols/min [2025-09-29T22:13:23.411706] [INFO ] [MAIN ] NXRT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:23.421692] [DEBUG] [LOCAL ] NXP: Loaded 12362 existing records from primary storage. [2025-09-29T22:13:23.422812] [INFO ] [MAIN ] NXP: Loaded 12362 primary data records. [2025-09-29T22:13:23.465297] [DEBUG] [LOCAL ] NXJ: Derivative data saved (1794 records). [2025-09-29T22:13:23.494974] [INFO ] [MAIN ] NXJ: Successfully saved derivative data. [2025-09-29T22:13:23.523952] [INFO ] [MAIN ] Derivative Progress: 1338/2057 symbols completed. NXJ took 1.3s. Estimated remaining: 4m 52s. Rate: 147.8 symbols/min [2025-09-29T22:13:23.557177] [DEBUG] [LOCAL ] NXRT: Loaded 19043 existing records from primary storage. [2025-09-29T22:13:23.556682] [INFO ] [MAIN ] NYT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:23.557575] [INFO ] [MAIN ] NXRT: Loaded 19043 primary data records. [2025-09-29T22:13:24.134443] [DEBUG] [LOCAL ] NYT: Loaded 49852 existing records from primary storage. [2025-09-29T22:13:24.135388] [INFO ] [MAIN ] NYT: Loaded 49852 primary data records. [2025-09-29T22:13:24.247401] [DEBUG] [MAIN ] NXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:24.268891] [INFO ] [MAIN ] NXP: Generated 1794 derivative records from 12362 primary records. [2025-09-29T22:13:24.269595] [DEBUG] [LOCAL ] NXP: Saving derivative data. [2025-09-29T22:13:24.499523] [DEBUG] [LOCAL ] NXP: Derivative data saved (1794 records). [2025-09-29T22:13:24.513059] [INFO ] [MAIN ] NXP: Successfully saved derivative data. [2025-09-29T22:13:24.514348] [DEBUG] [MAIN ] NXRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:24.516747] [INFO ] [MAIN ] Derivative Progress: 1339/2057 symbols completed. NXP took 1.2s. Estimated remaining: 4m 52s. Rate: 147.6 symbols/min [2025-09-29T22:13:24.517593] [INFO ] [MAIN ] NXRT: Generated 1794 derivative records from 19043 primary records. [2025-09-29T22:13:24.518722] [INFO ] [MAIN ] NZF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:24.518383] [DEBUG] [LOCAL ] NXRT: Saving derivative data. [2025-09-29T22:13:24.537872] [DEBUG] [LOCAL ] NXRT: Derivative data saved (1794 records). [2025-09-29T22:13:24.538148] [INFO ] [MAIN ] NXRT: Successfully saved derivative data. [2025-09-29T22:13:24.540586] [INFO ] [MAIN ] Derivative Progress: 1340/2057 symbols completed. NXRT took 1.1s. Estimated remaining: 4m 51s. Rate: 147.7 symbols/min [2025-09-29T22:13:24.541346] [INFO ] [MAIN ] OBDC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:24.572259] [DEBUG] [MAIN ] NYT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:24.573115] [INFO ] [MAIN ] NYT: Generated 1794 derivative records from 49852 primary records. [2025-09-29T22:13:24.573330] [DEBUG] [LOCAL ] NYT: Saving derivative data. [2025-09-29T22:13:24.597294] [DEBUG] [LOCAL ] NZF: Loaded 28963 existing records from primary storage. [2025-09-29T22:13:24.598691] [INFO ] [MAIN ] NZF: Loaded 28963 primary data records. [2025-09-29T22:13:24.691465] [DEBUG] [LOCAL ] NYT: Derivative data saved (1794 records). [2025-09-29T22:13:24.733469] [INFO ] [MAIN ] NYT: Successfully saved derivative data. [2025-09-29T22:13:24.736067] [INFO ] [MAIN ] Derivative Progress: 1341/2057 symbols completed. NYT took 1.2s. Estimated remaining: 4m 51s. Rate: 147.8 symbols/min [2025-09-29T22:13:24.751904] [INFO ] [MAIN ] OBK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:24.954237] [DEBUG] [LOCAL ] OBDC: Loaded 51654 existing records from primary storage. [2025-09-29T22:13:24.954460] [INFO ] [MAIN ] OBDC: Loaded 51654 primary data records. [2025-09-29T22:13:25.072475] [DEBUG] [LOCAL ] OBK: Loaded 16211 existing records from primary storage. [2025-09-29T22:13:25.085521] [INFO ] [MAIN ] OBK: Loaded 16211 primary data records. [2025-09-29T22:13:25.545055] [DEBUG] [MAIN ] NZF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:25.660210] [INFO ] [MAIN ] NZF: Generated 1794 derivative records from 28963 primary records. [2025-09-29T22:13:25.675760] [DEBUG] [LOCAL ] NZF: Saving derivative data. [2025-09-29T22:13:25.709080] [DEBUG] [LOCAL ] NZF: Derivative data saved (1794 records). [2025-09-29T22:13:25.709964] [INFO ] [MAIN ] NZF: Successfully saved derivative data. [2025-09-29T22:13:25.712251] [INFO ] [MAIN ] Derivative Progress: 1342/2057 symbols completed. NZF took 1.2s. Estimated remaining: 4m 51s. Rate: 147.6 symbols/min [2025-09-29T22:13:25.712597] [INFO ] [MAIN ] OCFT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:25.729943] [DEBUG] [MAIN ] OBDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:25.730729] [INFO ] [MAIN ] OBDC: Generated 1794 derivative records from 51654 primary records. [2025-09-29T22:13:25.730940] [DEBUG] [LOCAL ] OBDC: Saving derivative data. [2025-09-29T22:13:25.756273] [DEBUG] [LOCAL ] OBDC: Derivative data saved (1794 records). [2025-09-29T22:13:25.757568] [DEBUG] [LOCAL ] OCFT: Loaded 8542 existing records from primary storage. [2025-09-29T22:13:25.758608] [INFO ] [MAIN ] OBDC: Successfully saved derivative data. [2025-09-29T22:13:25.758878] [INFO ] [MAIN ] OCFT: Loaded 8542 primary data records. [2025-09-29T22:13:25.761270] [INFO ] [MAIN ] Derivative Progress: 1343/2057 symbols completed. OBDC took 1.2s. Estimated remaining: 4m 50s. Rate: 147.7 symbols/min [2025-09-29T22:13:25.811433] [INFO ] [MAIN ] ODC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:25.832376] [DEBUG] [MAIN ] OBK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:25.854602] [INFO ] [MAIN ] OBK: Generated 1794 derivative records from 16211 primary records. [2025-09-29T22:13:25.870896] [DEBUG] [LOCAL ] OBK: Saving derivative data. [2025-09-29T22:13:26.090216] [DEBUG] [LOCAL ] ODC: Loaded 8441 existing records from primary storage. [2025-09-29T22:13:26.095843] [INFO ] [MAIN ] ODC: Loaded 8441 primary data records. [2025-09-29T22:13:26.207801] [DEBUG] [LOCAL ] OBK: Derivative data saved (1794 records). [2025-09-29T22:13:26.225876] [INFO ] [MAIN ] OBK: Successfully saved derivative data. [2025-09-29T22:13:26.228504] [INFO ] [MAIN ] Derivative Progress: 1344/2057 symbols completed. OBK took 1.5s. Estimated remaining: 4m 50s. Rate: 147.7 symbols/min [2025-09-29T22:13:26.234146] [INFO ] [MAIN ] ODV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:26.467872] [DEBUG] [LOCAL ] ODV: Loaded 26437 existing records from primary storage. [2025-09-29T22:13:26.483393] [DEBUG] [MAIN ] OCFT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:26.483755] [INFO ] [MAIN ] ODV: Loaded 26437 primary data records. [2025-09-29T22:13:26.484559] [INFO ] [MAIN ] OCFT: Generated 1794 derivative records from 8542 primary records. [2025-09-29T22:13:26.484907] [DEBUG] [LOCAL ] OCFT: Saving derivative data. [2025-09-29T22:13:26.629522] [DEBUG] [LOCAL ] OCFT: Derivative data saved (1794 records). [2025-09-29T22:13:26.635867] [INFO ] [MAIN ] OCFT: Successfully saved derivative data. [2025-09-29T22:13:26.646097] [INFO ] [MAIN ] Derivative Progress: 1345/2057 symbols completed. OCFT took 0.9s. Estimated remaining: 4m 49s. Rate: 147.7 symbols/min [2025-09-29T22:13:26.652829] [INFO ] [MAIN ] OEC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:26.699460] [DEBUG] [MAIN ] ODC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:26.729473] [INFO ] [MAIN ] ODC: Generated 1794 derivative records from 8441 primary records. [2025-09-29T22:13:26.734974] [DEBUG] [LOCAL ] ODC: Saving derivative data. [2025-09-29T22:13:26.930216] [DEBUG] [LOCAL ] ODC: Derivative data saved (1794 records). [2025-09-29T22:13:26.931575] [INFO ] [MAIN ] ODC: Successfully saved derivative data. [2025-09-29T22:13:26.934808] [INFO ] [MAIN ] Derivative Progress: 1346/2057 symbols completed. ODC took 1.1s. Estimated remaining: 4m 49s. Rate: 147.7 symbols/min [2025-09-29T22:13:26.935982] [INFO ] [MAIN ] OFG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:26.950288] [DEBUG] [LOCAL ] OEC: Loaded 37066 existing records from primary storage. [2025-09-29T22:13:26.950489] [INFO ] [MAIN ] OEC: Loaded 37066 primary data records. [2025-09-29T22:13:27.164870] [DEBUG] [LOCAL ] OFG: Loaded 21736 existing records from primary storage. [2025-09-29T22:13:27.171304] [INFO ] [MAIN ] OFG: Loaded 21736 primary data records. [2025-09-29T22:13:27.382577] [DEBUG] [MAIN ] ODV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:27.423243] [INFO ] [MAIN ] ODV: Generated 1794 derivative records from 26437 primary records. [2025-09-29T22:13:27.450785] [DEBUG] [LOCAL ] ODV: Saving derivative data. [2025-09-29T22:13:27.696266] [DEBUG] [LOCAL ] ODV: Derivative data saved (1794 records). [2025-09-29T22:13:27.697773] [INFO ] [MAIN ] ODV: Successfully saved derivative data. [2025-09-29T22:13:27.700315] [INFO ] [MAIN ] Derivative Progress: 1347/2057 symbols completed. ODV took 1.5s. Estimated remaining: 4m 49s. Rate: 147.7 symbols/min [2025-09-29T22:13:27.701016] [INFO ] [MAIN ] OGN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:27.723233] [DEBUG] [MAIN ] OEC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:27.724155] [INFO ] [MAIN ] OEC: Generated 1794 derivative records from 37066 primary records. [2025-09-29T22:13:27.724364] [DEBUG] [LOCAL ] OEC: Saving derivative data. [2025-09-29T22:13:27.758737] [DEBUG] [MAIN ] OFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:27.760362] [INFO ] [MAIN ] OFG: Generated 1794 derivative records from 21736 primary records. [2025-09-29T22:13:27.760547] [DEBUG] [LOCAL ] OFG: Saving derivative data. [2025-09-29T22:13:27.761549] [DEBUG] [LOCAL ] OEC: Derivative data saved (1794 records). [2025-09-29T22:13:27.761958] [INFO ] [MAIN ] OEC: Successfully saved derivative data. [2025-09-29T22:13:27.764474] [INFO ] [MAIN ] Derivative Progress: 1348/2057 symbols completed. OEC took 1.1s. Estimated remaining: 4m 48s. Rate: 147.7 symbols/min [2025-09-29T22:13:27.794017] [DEBUG] [LOCAL ] OFG: Derivative data saved (1794 records). [2025-09-29T22:13:27.794245] [INFO ] [MAIN ] OFG: Successfully saved derivative data. [2025-09-29T22:13:27.796886] [INFO ] [MAIN ] Derivative Progress: 1349/2057 symbols completed. OFG took 0.9s. Estimated remaining: 4m 47s. Rate: 147.8 symbols/min [2025-09-29T22:13:27.817412] [DEBUG] [LOCAL ] OGN: Loaded 53096 existing records from primary storage. [2025-09-29T22:13:27.817573] [INFO ] [MAIN ] OGN: Loaded 53096 primary data records. [2025-09-29T22:13:28.156520] [DEBUG] [MAIN ] OGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:28.157329] [INFO ] [MAIN ] OGN: Generated 1794 derivative records from 53096 primary records. [2025-09-29T22:13:28.157396] [DEBUG] [LOCAL ] OGN: Saving derivative data. [2025-09-29T22:13:28.173778] [DEBUG] [LOCAL ] OGN: Derivative data saved (1794 records). [2025-09-29T22:13:28.173913] [INFO ] [MAIN ] OGN: Successfully saved derivative data. [2025-09-29T22:13:28.176077] [INFO ] [MAIN ] Derivative Progress: 1350/2057 symbols completed. OGN took 0.5s. Estimated remaining: 4m 47s. Rate: 147.9 symbols/min [2025-09-29T22:13:28.176769] [INFO ] [MAIN ] OHI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:28.176992] [INFO ] [MAIN ] OI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:28.176676] [INFO ] [MAIN ] OGS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:28.225513] [DEBUG] [LOCAL ] OGS: Loaded 34112 existing records from primary storage. [2025-09-29T22:13:28.225805] [INFO ] [MAIN ] OGS: Loaded 34112 primary data records. [2025-09-29T22:13:28.388572] [DEBUG] [LOCAL ] OI: Loaded 47163 existing records from primary storage. [2025-09-29T22:13:28.458368] [INFO ] [MAIN ] OI: Loaded 47163 primary data records. [2025-09-29T22:13:28.569704] [DEBUG] [LOCAL ] OHI: Loaded 52015 existing records from primary storage. [2025-09-29T22:13:28.585179] [INFO ] [MAIN ] OHI: Loaded 52015 primary data records. [2025-09-29T22:13:29.267163] [DEBUG] [MAIN ] OGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:29.268145] [INFO ] [MAIN ] OGS: Generated 1794 derivative records from 34112 primary records. [2025-09-29T22:13:29.268243] [DEBUG] [LOCAL ] OGS: Saving derivative data. [2025-09-29T22:13:29.303201] [DEBUG] [LOCAL ] OGS: Derivative data saved (1794 records). [2025-09-29T22:13:29.303934] [INFO ] [MAIN ] OGS: Successfully saved derivative data. [2025-09-29T22:13:29.303847] [DEBUG] [MAIN ] OI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:29.306145] [INFO ] [MAIN ] Derivative Progress: 1351/2057 symbols completed. OGS took 1.1s. Estimated remaining: 4m 47s. Rate: 147.7 symbols/min [2025-09-29T22:13:29.307299] [INFO ] [MAIN ] OI: Generated 1794 derivative records from 47163 primary records. [2025-09-29T22:13:29.306432] [INFO ] [MAIN ] OIA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:29.308341] [DEBUG] [LOCAL ] OI: Saving derivative data. [2025-09-29T22:13:29.339333] [DEBUG] [MAIN ] OHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:29.345449] [INFO ] [MAIN ] OHI: Generated 1794 derivative records from 52015 primary records. [2025-09-29T22:13:29.346009] [DEBUG] [LOCAL ] OHI: Saving derivative data. [2025-09-29T22:13:29.347027] [DEBUG] [LOCAL ] OI: Derivative data saved (1794 records). [2025-09-29T22:13:29.348377] [INFO ] [MAIN ] OI: Successfully saved derivative data. [2025-09-29T22:13:29.350534] [INFO ] [MAIN ] Derivative Progress: 1352/2057 symbols completed. OI took 1.2s. Estimated remaining: 4m 46s. Rate: 147.8 symbols/min [2025-09-29T22:13:29.359812] [INFO ] [MAIN ] OII: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:29.368470] [DEBUG] [LOCAL ] OIA: Loaded 13902 existing records from primary storage. [2025-09-29T22:13:29.369169] [INFO ] [MAIN ] OIA: Loaded 13902 primary data records. [2025-09-29T22:13:29.499078] [DEBUG] [LOCAL ] OHI: Derivative data saved (1794 records). [2025-09-29T22:13:29.503044] [INFO ] [MAIN ] OHI: Successfully saved derivative data. [2025-09-29T22:13:29.513239] [INFO ] [MAIN ] Derivative Progress: 1353/2057 symbols completed. OHI took 1.3s. Estimated remaining: 4m 46s. Rate: 147.8 symbols/min [2025-09-29T22:13:29.524111] [INFO ] [MAIN ] OIS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:29.768805] [DEBUG] [LOCAL ] OII: Loaded 42631 existing records from primary storage. [2025-09-29T22:13:29.769158] [INFO ] [MAIN ] OII: Loaded 42631 primary data records. [2025-09-29T22:13:29.930336] [DEBUG] [LOCAL ] OIS: Loaded 40448 existing records from primary storage. [2025-09-29T22:13:29.953197] [INFO ] [MAIN ] OIS: Loaded 40448 primary data records. [2025-09-29T22:13:30.446606] [DEBUG] [MAIN ] OIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:30.447702] [INFO ] [MAIN ] OIA: Generated 1794 derivative records from 13902 primary records. [2025-09-29T22:13:30.448184] [DEBUG] [LOCAL ] OIA: Saving derivative data. [2025-09-29T22:13:30.470076] [DEBUG] [LOCAL ] OIA: Derivative data saved (1794 records). [2025-09-29T22:13:30.471269] [INFO ] [MAIN ] OIA: Successfully saved derivative data. [2025-09-29T22:13:30.473500] [INFO ] [MAIN ] Derivative Progress: 1354/2057 symbols completed. OIA took 1.2s. Estimated remaining: 4m 46s. Rate: 147.7 symbols/min [2025-09-29T22:13:30.476812] [INFO ] [MAIN ] OKE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:30.491978] [DEBUG] [MAIN ] OII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:30.492910] [INFO ] [MAIN ] OII: Generated 1794 derivative records from 42631 primary records. [2025-09-29T22:13:30.493162] [DEBUG] [LOCAL ] OII: Saving derivative data. [2025-09-29T22:13:30.513599] [DEBUG] [LOCAL ] OII: Derivative data saved (1794 records). [2025-09-29T22:13:30.514120] [INFO ] [MAIN ] OII: Successfully saved derivative data. [2025-09-29T22:13:30.516294] [INFO ] [MAIN ] Derivative Progress: 1355/2057 symbols completed. OII took 1.2s. Estimated remaining: 4m 45s. Rate: 147.8 symbols/min [2025-09-29T22:13:30.517719] [INFO ] [MAIN ] OLN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:30.533897] [DEBUG] [MAIN ] OIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:30.534774] [INFO ] [MAIN ] OIS: Generated 1794 derivative records from 40448 primary records. [2025-09-29T22:13:30.534844] [DEBUG] [LOCAL ] OIS: Saving derivative data. [2025-09-29T22:13:30.552072] [DEBUG] [LOCAL ] OIS: Derivative data saved (1794 records). [2025-09-29T22:13:30.552305] [INFO ] [MAIN ] OIS: Successfully saved derivative data. [2025-09-29T22:13:30.554911] [INFO ] [MAIN ] Derivative Progress: 1356/2057 symbols completed. OIS took 1.0s. Estimated remaining: 4m 44s. Rate: 147.9 symbols/min [2025-09-29T22:13:30.555130] [INFO ] [MAIN ] OLP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:30.579914] [DEBUG] [LOCAL ] OLP: Loaded 9852 existing records from primary storage. [2025-09-29T22:13:30.580092] [INFO ] [MAIN ] OLP: Loaded 9852 primary data records. [2025-09-29T22:13:30.750200] [DEBUG] [LOCAL ] OKE: Loaded 53536 existing records from primary storage. [2025-09-29T22:13:30.814026] [INFO ] [MAIN ] OKE: Loaded 53536 primary data records. [2025-09-29T22:13:30.938264] [DEBUG] [LOCAL ] OLN: Loaded 51761 existing records from primary storage. [2025-09-29T22:13:30.982068] [INFO ] [MAIN ] OLN: Loaded 51761 primary data records. [2025-09-29T22:13:31.653345] [DEBUG] [MAIN ] OLP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:31.654862] [INFO ] [MAIN ] OLP: Generated 1794 derivative records from 9852 primary records. [2025-09-29T22:13:31.655055] [DEBUG] [LOCAL ] OLP: Saving derivative data. [2025-09-29T22:13:31.678773] [DEBUG] [LOCAL ] OLP: Derivative data saved (1794 records). [2025-09-29T22:13:31.679305] [INFO ] [MAIN ] OLP: Successfully saved derivative data. [2025-09-29T22:13:31.682617] [INFO ] [MAIN ] Derivative Progress: 1357/2057 symbols completed. OLP took 1.1s. Estimated remaining: 4m 44s. Rate: 147.7 symbols/min [2025-09-29T22:13:31.684326] [INFO ] [MAIN ] OMC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:31.704156] [DEBUG] [MAIN ] OKE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:31.713328] [INFO ] [MAIN ] OKE: Generated 1794 derivative records from 53536 primary records. [2025-09-29T22:13:31.721325] [DEBUG] [LOCAL ] OKE: Saving derivative data. [2025-09-29T22:13:31.721955] [DEBUG] [MAIN ] OLN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:31.723938] [INFO ] [MAIN ] OLN: Generated 1794 derivative records from 51761 primary records. [2025-09-29T22:13:31.724078] [DEBUG] [LOCAL ] OLN: Saving derivative data. [2025-09-29T22:13:31.756745] [DEBUG] [LOCAL ] OLN: Derivative data saved (1794 records). [2025-09-29T22:13:31.759022] [INFO ] [MAIN ] OLN: Successfully saved derivative data. [2025-09-29T22:13:31.761233] [INFO ] [MAIN ] Derivative Progress: 1358/2057 symbols completed. OLN took 1.2s. Estimated remaining: 4m 44s. Rate: 147.8 symbols/min [2025-09-29T22:13:31.758767] [DEBUG] [LOCAL ] OKE: Derivative data saved (1794 records). [2025-09-29T22:13:31.761487] [INFO ] [MAIN ] OMF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:31.761694] [INFO ] [MAIN ] OKE: Successfully saved derivative data. [2025-09-29T22:13:31.764118] [INFO ] [MAIN ] Derivative Progress: 1359/2057 symbols completed. OKE took 1.3s. Estimated remaining: 4m 43s. Rate: 147.9 symbols/min [2025-09-29T22:13:31.764399] [INFO ] [MAIN ] OMI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:31.811995] [DEBUG] [LOCAL ] OMC: Loaded 53288 existing records from primary storage. [2025-09-29T22:13:31.812267] [INFO ] [MAIN ] OMC: Loaded 53288 primary data records. [2025-09-29T22:13:31.982122] [DEBUG] [LOCAL ] OMI: Loaded 45834 existing records from primary storage. [2025-09-29T22:13:31.982914] [DEBUG] [LOCAL ] OMF: Loaded 46132 existing records from primary storage. [2025-09-29T22:13:31.993244] [INFO ] [MAIN ] OMI: Loaded 45834 primary data records. [2025-09-29T22:13:32.022559] [INFO ] [MAIN ] OMF: Loaded 46132 primary data records. [2025-09-29T22:13:32.859199] [DEBUG] [MAIN ] OMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:32.860711] [INFO ] [MAIN ] OMC: Generated 1794 derivative records from 53288 primary records. [2025-09-29T22:13:32.861154] [DEBUG] [LOCAL ] OMC: Saving derivative data. [2025-09-29T22:13:32.897691] [DEBUG] [LOCAL ] OMC: Derivative data saved (1794 records). [2025-09-29T22:13:32.903714] [INFO ] [MAIN ] OMC: Successfully saved derivative data. [2025-09-29T22:13:32.903413] [DEBUG] [MAIN ] OMF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:32.904705] [INFO ] [MAIN ] OMF: Generated 1794 derivative records from 46132 primary records. [2025-09-29T22:13:32.907150] [INFO ] [MAIN ] Derivative Progress: 1360/2057 symbols completed. OMC took 1.2s. Estimated remaining: 4m 43s. Rate: 147.7 symbols/min [2025-09-29T22:13:32.905014] [DEBUG] [LOCAL ] OMF: Saving derivative data. [2025-09-29T22:13:32.915925] [INFO ] [MAIN ] ONIT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:32.929939] [DEBUG] [MAIN ] OMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:32.932169] [INFO ] [MAIN ] OMI: Generated 1794 derivative records from 45834 primary records. [2025-09-29T22:13:32.935883] [DEBUG] [LOCAL ] OMI: Saving derivative data. [2025-09-29T22:13:32.956256] [DEBUG] [LOCAL ] OMF: Derivative data saved (1794 records). [2025-09-29T22:13:32.963742] [DEBUG] [LOCAL ] OMI: Derivative data saved (1794 records). [2025-09-29T22:13:32.963910] [INFO ] [MAIN ] OMF: Successfully saved derivative data. [2025-09-29T22:13:32.964456] [INFO ] [MAIN ] OMI: Successfully saved derivative data. [2025-09-29T22:13:32.964286] [DEBUG] [LOCAL ] ONIT: Loaded 7730 existing records from primary storage. [2025-09-29T22:13:32.973177] [INFO ] [MAIN ] Derivative Progress: 1361/2057 symbols completed. OMF took 1.2s. Estimated remaining: 4m 43s. Rate: 147.8 symbols/min [2025-09-29T22:13:32.973803] [INFO ] [MAIN ] ONL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:32.976504] [INFO ] [MAIN ] Derivative Progress: 1362/2057 symbols completed. OMI took 1.2s. Estimated remaining: 4m 42s. Rate: 147.9 symbols/min [2025-09-29T22:13:32.976702] [INFO ] [MAIN ] ONIT: Loaded 7730 primary data records. [2025-09-29T22:13:32.976957] [INFO ] [MAIN ] ONON: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:33.312813] [DEBUG] [LOCAL ] ONL: Loaded 30907 existing records from primary storage. [2025-09-29T22:13:33.326827] [INFO ] [MAIN ] ONL: Loaded 30907 primary data records. [2025-09-29T22:13:33.460743] [DEBUG] [LOCAL ] ONON: Loaded 53612 existing records from primary storage. [2025-09-29T22:13:33.465025] [INFO ] [MAIN ] ONON: Loaded 53612 primary data records. [2025-09-29T22:13:34.094597] [DEBUG] [MAIN ] ONIT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:34.095579] [INFO ] [MAIN ] ONIT: Generated 1794 derivative records from 7730 primary records. [2025-09-29T22:13:34.096335] [DEBUG] [LOCAL ] ONIT: Saving derivative data. [2025-09-29T22:13:34.122932] [DEBUG] [LOCAL ] ONIT: Derivative data saved (1794 records). [2025-09-29T22:13:34.124704] [INFO ] [MAIN ] ONIT: Successfully saved derivative data. [2025-09-29T22:13:34.128147] [INFO ] [MAIN ] Derivative Progress: 1363/2057 symbols completed. ONIT took 1.2s. Estimated remaining: 4m 42s. Rate: 147.7 symbols/min [2025-09-29T22:13:34.147912] [DEBUG] [MAIN ] ONL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:34.148997] [INFO ] [MAIN ] ONL: Generated 1794 derivative records from 30907 primary records. [2025-09-29T22:13:34.149087] [DEBUG] [LOCAL ] ONL: Saving derivative data. [2025-09-29T22:13:34.179755] [DEBUG] [MAIN ] ONON: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:34.181259] [INFO ] [MAIN ] ONON: Generated 1794 derivative records from 53612 primary records. [2025-09-29T22:13:34.181861] [DEBUG] [LOCAL ] ONON: Saving derivative data. [2025-09-29T22:13:34.198261] [DEBUG] [LOCAL ] ONL: Derivative data saved (1794 records). [2025-09-29T22:13:34.199718] [INFO ] [MAIN ] ONL: Successfully saved derivative data. [2025-09-29T22:13:34.205213] [DEBUG] [LOCAL ] ONON: Derivative data saved (1794 records). [2025-09-29T22:13:34.204292] [INFO ] [MAIN ] Derivative Progress: 1364/2057 symbols completed. ONL took 1.2s. Estimated remaining: 4m 41s. Rate: 147.8 symbols/min [2025-09-29T22:13:34.205486] [INFO ] [MAIN ] ONON: Successfully saved derivative data. [2025-09-29T22:13:34.209733] [INFO ] [MAIN ] Derivative Progress: 1365/2057 symbols completed. ONON took 1.2s. Estimated remaining: 4m 41s. Rate: 147.9 symbols/min [2025-09-29T22:13:34.210467] [INFO ] [MAIN ] ONTO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:34.210607] [INFO ] [MAIN ] OOMA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:34.211593] [INFO ] [MAIN ] ONTF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:34.241537] [DEBUG] [LOCAL ] OOMA: Loaded 18881 existing records from primary storage. [2025-09-29T22:13:34.241968] [INFO ] [MAIN ] OOMA: Loaded 18881 primary data records. [2025-09-29T22:13:34.321113] [DEBUG] [LOCAL ] ONTF: Loaded 22638 existing records from primary storage. [2025-09-29T22:13:34.344928] [INFO ] [MAIN ] ONTF: Loaded 22638 primary data records. [2025-09-29T22:13:34.479120] [DEBUG] [LOCAL ] ONTO: Loaded 46628 existing records from primary storage. [2025-09-29T22:13:34.543205] [INFO ] [MAIN ] ONTO: Loaded 46628 primary data records. [2025-09-29T22:13:35.332384] [DEBUG] [MAIN ] OOMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:35.333842] [INFO ] [MAIN ] OOMA: Generated 1794 derivative records from 18881 primary records. [2025-09-29T22:13:35.334499] [DEBUG] [LOCAL ] OOMA: Saving derivative data. [2025-09-29T22:13:35.354456] [DEBUG] [LOCAL ] OOMA: Derivative data saved (1794 records). [2025-09-29T22:13:35.355340] [INFO ] [MAIN ] OOMA: Successfully saved derivative data. [2025-09-29T22:13:35.357539] [INFO ] [MAIN ] Derivative Progress: 1366/2057 symbols completed. OOMA took 1.1s. Estimated remaining: 4m 41s. Rate: 147.7 symbols/min [2025-09-29T22:13:35.360772] [INFO ] [MAIN ] OPAD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:35.391839] [DEBUG] [MAIN ] ONTF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:35.392899] [DEBUG] [MAIN ] ONTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:35.394183] [INFO ] [MAIN ] ONTF: Generated 1794 derivative records from 22638 primary records. [2025-09-29T22:13:35.395226] [INFO ] [MAIN ] ONTO: Generated 1794 derivative records from 46628 primary records. [2025-09-29T22:13:35.395390] [DEBUG] [LOCAL ] ONTF: Saving derivative data. [2025-09-29T22:13:35.395685] [DEBUG] [LOCAL ] ONTO: Saving derivative data. [2025-09-29T22:13:35.436114] [DEBUG] [LOCAL ] ONTF: Derivative data saved (1794 records). [2025-09-29T22:13:35.443232] [INFO ] [MAIN ] ONTF: Successfully saved derivative data. [2025-09-29T22:13:35.447691] [INFO ] [MAIN ] Derivative Progress: 1367/2057 symbols completed. ONTF took 1.2s. Estimated remaining: 4m 40s. Rate: 147.8 symbols/min [2025-09-29T22:13:35.435990] [DEBUG] [LOCAL ] ONTO: Derivative data saved (1794 records). [2025-09-29T22:13:35.448032] [INFO ] [MAIN ] ONTO: Successfully saved derivative data. [2025-09-29T22:13:35.448207] [INFO ] [MAIN ] OPFI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:35.450953] [INFO ] [MAIN ] Derivative Progress: 1368/2057 symbols completed. ONTO took 1.2s. Estimated remaining: 4m 40s. Rate: 147.9 symbols/min [2025-09-29T22:13:35.451155] [INFO ] [MAIN ] OPP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:35.451737] [DEBUG] [LOCAL ] OPAD: Loaded 21052 existing records from primary storage. [2025-09-29T22:13:35.452017] [INFO ] [MAIN ] OPAD: Loaded 21052 primary data records. [2025-09-29T22:13:35.575337] [DEBUG] [LOCAL ] OPP: Loaded 11581 existing records from primary storage. [2025-09-29T22:13:35.581398] [INFO ] [MAIN ] OPP: Loaded 11581 primary data records. [2025-09-29T22:13:35.979761] [DEBUG] [LOCAL ] OPFI: Loaded 46507 existing records from primary storage. [2025-09-29T22:13:35.996946] [INFO ] [MAIN ] OPFI: Loaded 46507 primary data records. [2025-09-29T22:13:36.546734] [DEBUG] [MAIN ] OPAD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:36.548003] [INFO ] [MAIN ] OPAD: Generated 1794 derivative records from 21052 primary records. [2025-09-29T22:13:36.548236] [DEBUG] [LOCAL ] OPAD: Saving derivative data. [2025-09-29T22:13:36.567928] [DEBUG] [LOCAL ] OPAD: Derivative data saved (1794 records). [2025-09-29T22:13:36.568488] [INFO ] [MAIN ] OPAD: Successfully saved derivative data. [2025-09-29T22:13:36.570526] [INFO ] [MAIN ] Derivative Progress: 1369/2057 symbols completed. OPAD took 1.2s. Estimated remaining: 4m 40s. Rate: 147.7 symbols/min [2025-09-29T22:13:36.571315] [INFO ] [MAIN ] OR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:36.591514] [DEBUG] [MAIN ] OPP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:36.594596] [INFO ] [MAIN ] OPP: Generated 1794 derivative records from 11581 primary records. [2025-09-29T22:13:36.594942] [DEBUG] [LOCAL ] OPP: Saving derivative data. [2025-09-29T22:13:36.609594] [DEBUG] [MAIN ] OPFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:36.619394] [INFO ] [MAIN ] OPFI: Generated 1794 derivative records from 46507 primary records. [2025-09-29T22:13:36.622300] [DEBUG] [LOCAL ] OPFI: Saving derivative data. [2025-09-29T22:13:36.627256] [DEBUG] [LOCAL ] OPP: Derivative data saved (1794 records). [2025-09-29T22:13:36.627423] [INFO ] [MAIN ] OPP: Successfully saved derivative data. [2025-09-29T22:13:36.630804] [INFO ] [MAIN ] Derivative Progress: 1370/2057 symbols completed. OPP took 1.2s. Estimated remaining: 4m 39s. Rate: 147.8 symbols/min [2025-09-29T22:13:36.649813] [INFO ] [MAIN ] ORA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:36.674922] [DEBUG] [LOCAL ] OPFI: Derivative data saved (1794 records). [2025-09-29T22:13:36.675224] [INFO ] [MAIN ] OPFI: Successfully saved derivative data. [2025-09-29T22:13:36.678784] [DEBUG] [LOCAL ] OR: Loaded 46068 existing records from primary storage. [2025-09-29T22:13:36.679038] [INFO ] [MAIN ] OR: Loaded 46068 primary data records. [2025-09-29T22:13:36.677606] [INFO ] [MAIN ] Derivative Progress: 1371/2057 symbols completed. OPFI took 1.2s. Estimated remaining: 4m 38s. Rate: 147.9 symbols/min [2025-09-29T22:13:36.684549] [INFO ] [MAIN ] ORC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:36.921037] [DEBUG] [LOCAL ] ORA: Loaded 32437 existing records from primary storage. [2025-09-29T22:13:37.067255] [INFO ] [MAIN ] ORA: Loaded 32437 primary data records. [2025-09-29T22:13:37.204421] [DEBUG] [LOCAL ] ORC: Loaded 52330 existing records from primary storage. [2025-09-29T22:13:37.208475] [INFO ] [MAIN ] ORC: Loaded 52330 primary data records. [2025-09-29T22:13:37.627307] [DEBUG] [MAIN ] OR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:37.750363] [INFO ] [MAIN ] OR: Generated 1794 derivative records from 46068 primary records. [2025-09-29T22:13:37.751070] [DEBUG] [LOCAL ] OR: Saving derivative data. [2025-09-29T22:13:37.770934] [DEBUG] [LOCAL ] OR: Derivative data saved (1794 records). [2025-09-29T22:13:37.771224] [INFO ] [MAIN ] OR: Successfully saved derivative data. [2025-09-29T22:13:37.773418] [INFO ] [MAIN ] Derivative Progress: 1372/2057 symbols completed. OR took 1.2s. Estimated remaining: 4m 38s. Rate: 147.7 symbols/min [2025-09-29T22:13:37.774377] [INFO ] [MAIN ] ORN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:37.808001] [DEBUG] [MAIN ] ORA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:37.809105] [INFO ] [MAIN ] ORA: Generated 1794 derivative records from 32437 primary records. [2025-09-29T22:13:37.809345] [DEBUG] [LOCAL ] ORA: Saving derivative data. [2025-09-29T22:13:37.837285] [DEBUG] [LOCAL ] ORA: Derivative data saved (1794 records). [2025-09-29T22:13:37.838960] [DEBUG] [LOCAL ] ORN: Loaded 31200 existing records from primary storage. [2025-09-29T22:13:37.839073] [INFO ] [MAIN ] ORA: Successfully saved derivative data. [2025-09-29T22:13:37.839133] [INFO ] [MAIN ] ORN: Loaded 31200 primary data records. [2025-09-29T22:13:37.842099] [INFO ] [MAIN ] Derivative Progress: 1373/2057 symbols completed. ORA took 1.2s. Estimated remaining: 4m 38s. Rate: 147.8 symbols/min [2025-09-29T22:13:37.859948] [INFO ] [MAIN ] OSCR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:37.945788] [DEBUG] [MAIN ] ORC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:37.965687] [INFO ] [MAIN ] ORC: Generated 1794 derivative records from 52330 primary records. [2025-09-29T22:13:37.978526] [DEBUG] [LOCAL ] ORC: Saving derivative data. [2025-09-29T22:13:38.183101] [DEBUG] [LOCAL ] ORC: Derivative data saved (1794 records). [2025-09-29T22:13:38.240004] [INFO ] [MAIN ] ORC: Successfully saved derivative data. [2025-09-29T22:13:38.242423] [INFO ] [MAIN ] Derivative Progress: 1374/2057 symbols completed. ORC took 1.6s. Estimated remaining: 4m 37s. Rate: 147.8 symbols/min [2025-09-29T22:13:38.242781] [INFO ] [MAIN ] OUT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:38.302511] [DEBUG] [LOCAL ] OSCR: Loaded 53722 existing records from primary storage. [2025-09-29T22:13:38.300804] [DEBUG] [MAIN ] ORN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:38.302707] [INFO ] [MAIN ] OSCR: Loaded 53722 primary data records. [2025-09-29T22:13:38.303570] [INFO ] [MAIN ] ORN: Generated 1794 derivative records from 31200 primary records. [2025-09-29T22:13:38.303805] [DEBUG] [LOCAL ] ORN: Saving derivative data. [2025-09-29T22:13:38.451487] [DEBUG] [LOCAL ] ORN: Derivative data saved (1794 records). [2025-09-29T22:13:38.456921] [INFO ] [MAIN ] ORN: Successfully saved derivative data. [2025-09-29T22:13:38.485294] [INFO ] [MAIN ] Derivative Progress: 1375/2057 symbols completed. ORN took 0.7s. Estimated remaining: 4m 37s. Rate: 147.8 symbols/min [2025-09-29T22:13:38.506837] [INFO ] [MAIN ] OVV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:38.528891] [DEBUG] [LOCAL ] OUT: Loaded 47841 existing records from primary storage. [2025-09-29T22:13:38.553563] [INFO ] [MAIN ] OUT: Loaded 47841 primary data records. [2025-09-29T22:13:39.086012] [DEBUG] [LOCAL ] OVV: Loaded 53519 existing records from primary storage. [2025-09-29T22:13:39.087822] [INFO ] [MAIN ] OVV: Loaded 53519 primary data records. [2025-09-29T22:13:39.376629] [DEBUG] [MAIN ] OSCR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:39.397840] [INFO ] [MAIN ] OSCR: Generated 1794 derivative records from 53722 primary records. [2025-09-29T22:13:39.403243] [DEBUG] [LOCAL ] OSCR: Saving derivative data. [2025-09-29T22:13:39.697231] [DEBUG] [LOCAL ] OSCR: Derivative data saved (1794 records). [2025-09-29T22:13:39.697613] [INFO ] [MAIN ] OSCR: Successfully saved derivative data. [2025-09-29T22:13:39.700974] [INFO ] [MAIN ] Derivative Progress: 1376/2057 symbols completed. OSCR took 1.8s. Estimated remaining: 4m 37s. Rate: 147.6 symbols/min [2025-09-29T22:13:39.701893] [INFO ] [MAIN ] OWL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:39.723358] [DEBUG] [MAIN ] OUT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:39.724531] [INFO ] [MAIN ] OUT: Generated 1794 derivative records from 47841 primary records. [2025-09-29T22:13:39.725968] [DEBUG] [LOCAL ] OUT: Saving derivative data. [2025-09-29T22:13:39.747323] [DEBUG] [LOCAL ] OUT: Derivative data saved (1794 records). [2025-09-29T22:13:39.747594] [INFO ] [MAIN ] OUT: Successfully saved derivative data. [2025-09-29T22:13:39.749880] [INFO ] [MAIN ] Derivative Progress: 1377/2057 symbols completed. OUT took 1.5s. Estimated remaining: 4m 36s. Rate: 147.7 symbols/min [2025-09-29T22:13:39.750501] [INFO ] [MAIN ] OWLT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:39.769024] [DEBUG] [MAIN ] OVV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:39.769915] [INFO ] [MAIN ] OVV: Generated 1794 derivative records from 53519 primary records. [2025-09-29T22:13:39.772363] [DEBUG] [LOCAL ] OVV: Saving derivative data. [2025-09-29T22:13:39.807533] [DEBUG] [LOCAL ] OWLT: Loaded 8898 existing records from primary storage. [2025-09-29T22:13:39.808430] [INFO ] [MAIN ] OWLT: Loaded 8898 primary data records. [2025-09-29T22:13:39.955112] [DEBUG] [LOCAL ] OWL: Loaded 53555 existing records from primary storage. [2025-09-29T22:13:39.961134] [DEBUG] [LOCAL ] OVV: Derivative data saved (1794 records). [2025-09-29T22:13:39.966420] [INFO ] [MAIN ] OWL: Loaded 53555 primary data records. [2025-09-29T22:13:39.977045] [INFO ] [MAIN ] OVV: Successfully saved derivative data. [2025-09-29T22:13:40.031187] [INFO ] [MAIN ] Derivative Progress: 1378/2057 symbols completed. OVV took 1.5s. Estimated remaining: 4m 36s. Rate: 147.7 symbols/min [2025-09-29T22:13:40.588440] [DEBUG] [MAIN ] OWLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:40.589351] [INFO ] [MAIN ] OWLT: Generated 1794 derivative records from 8898 primary records. [2025-09-29T22:13:40.589525] [DEBUG] [LOCAL ] OWLT: Saving derivative data. [2025-09-29T22:13:40.606132] [DEBUG] [LOCAL ] OWLT: Derivative data saved (1794 records). [2025-09-29T22:13:40.606570] [INFO ] [MAIN ] OWLT: Successfully saved derivative data. [2025-09-29T22:13:40.608850] [INFO ] [MAIN ] Derivative Progress: 1379/2057 symbols completed. OWLT took 0.9s. Estimated remaining: 4m 35s. Rate: 147.7 symbols/min [2025-09-29T22:13:40.624472] [DEBUG] [MAIN ] OWL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:40.625285] [INFO ] [MAIN ] OWL: Generated 1794 derivative records from 53555 primary records. [2025-09-29T22:13:40.625359] [DEBUG] [LOCAL ] OWL: Saving derivative data. [2025-09-29T22:13:40.642570] [DEBUG] [LOCAL ] OWL: Derivative data saved (1794 records). [2025-09-29T22:13:40.642724] [INFO ] [MAIN ] OWL: Successfully saved derivative data. [2025-09-29T22:13:40.645049] [INFO ] [MAIN ] Derivative Progress: 1380/2057 symbols completed. OWL took 0.9s. Estimated remaining: 4m 35s. Rate: 147.8 symbols/min [2025-09-29T22:13:40.645511] [INFO ] [MAIN ] OXM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:40.645670] [INFO ] [MAIN ] PAAS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:40.646362] [INFO ] [MAIN ] PAC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:40.660999] [DEBUG] [LOCAL ] PAC: Loaded 11581 existing records from primary storage. [2025-09-29T22:13:40.661208] [INFO ] [MAIN ] PAC: Loaded 11581 primary data records. [2025-09-29T22:13:40.998315] [DEBUG] [LOCAL ] OXM: Loaded 33382 existing records from primary storage. [2025-09-29T22:13:41.012101] [INFO ] [MAIN ] OXM: Loaded 33382 primary data records. [2025-09-29T22:13:41.060937] [DEBUG] [LOCAL ] PAAS: Loaded 53603 existing records from primary storage. [2025-09-29T22:13:41.067409] [INFO ] [MAIN ] PAAS: Loaded 53603 primary data records. [2025-09-29T22:13:41.707387] [DEBUG] [MAIN ] PAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:41.708790] [INFO ] [MAIN ] PAC: Generated 1794 derivative records from 11581 primary records. [2025-09-29T22:13:41.709335] [DEBUG] [LOCAL ] PAC: Saving derivative data. [2025-09-29T22:13:41.736158] [DEBUG] [LOCAL ] PAC: Derivative data saved (1794 records). [2025-09-29T22:13:41.736682] [INFO ] [MAIN ] PAC: Successfully saved derivative data. [2025-09-29T22:13:41.738974] [INFO ] [MAIN ] Derivative Progress: 1381/2057 symbols completed. PAC took 1.1s. Estimated remaining: 4m 35s. Rate: 147.6 symbols/min [2025-09-29T22:13:41.739389] [INFO ] [MAIN ] PACK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:41.765707] [DEBUG] [MAIN ] OXM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:41.781371] [INFO ] [MAIN ] OXM: Generated 1794 derivative records from 33382 primary records. [2025-09-29T22:13:41.781490] [DEBUG] [LOCAL ] OXM: Saving derivative data. [2025-09-29T22:13:41.783791] [DEBUG] [MAIN ] PAAS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:41.807527] [INFO ] [MAIN ] PAAS: Generated 1794 derivative records from 53603 primary records. [2025-09-29T22:13:41.809141] [DEBUG] [LOCAL ] PAAS: Saving derivative data. [2025-09-29T22:13:41.837032] [DEBUG] [LOCAL ] OXM: Derivative data saved (1794 records). [2025-09-29T22:13:41.837454] [INFO ] [MAIN ] OXM: Successfully saved derivative data. [2025-09-29T22:13:41.836606] [DEBUG] [LOCAL ] PACK: Loaded 31769 existing records from primary storage. [2025-09-29T22:13:41.839766] [INFO ] [MAIN ] Derivative Progress: 1382/2057 symbols completed. OXM took 1.2s. Estimated remaining: 4m 34s. Rate: 147.7 symbols/min [2025-09-29T22:13:41.840908] [INFO ] [MAIN ] PACS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:41.841702] [INFO ] [MAIN ] PACK: Loaded 31769 primary data records. [2025-09-29T22:13:41.844662] [DEBUG] [LOCAL ] PAAS: Derivative data saved (1794 records). [2025-09-29T22:13:41.866139] [INFO ] [MAIN ] PAAS: Successfully saved derivative data. [2025-09-29T22:13:41.880195] [INFO ] [MAIN ] Derivative Progress: 1383/2057 symbols completed. PAAS took 1.2s. Estimated remaining: 4m 34s. Rate: 147.8 symbols/min [2025-09-29T22:13:41.885668] [INFO ] [MAIN ] PAG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:42.203115] [DEBUG] [LOCAL ] PAG: Loaded 21760 existing records from primary storage. [2025-09-29T22:13:42.213145] [DEBUG] [LOCAL ] PACS: Loaded 34371 existing records from primary storage. [2025-09-29T22:13:42.213979] [INFO ] [MAIN ] PAG: Loaded 21760 primary data records. [2025-09-29T22:13:42.214139] [INFO ] [MAIN ] PACS: Loaded 34371 primary data records. [2025-09-29T22:13:42.953150] [DEBUG] [MAIN ] PACK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:42.955068] [INFO ] [MAIN ] PACK: Generated 1794 derivative records from 31769 primary records. [2025-09-29T22:13:42.955708] [DEBUG] [LOCAL ] PACK: Saving derivative data. [2025-09-29T22:13:42.995245] [DEBUG] [MAIN ] PAG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:42.994557] [DEBUG] [LOCAL ] PACK: Derivative data saved (1794 records). [2025-09-29T22:13:42.997984] [INFO ] [MAIN ] PAG: Generated 1794 derivative records from 21760 primary records. [2025-09-29T22:13:42.998406] [INFO ] [MAIN ] PACK: Successfully saved derivative data. [2025-09-29T22:13:43.001436] [INFO ] [MAIN ] Derivative Progress: 1384/2057 symbols completed. PACK took 1.3s. Estimated remaining: 4m 34s. Rate: 147.6 symbols/min [2025-09-29T22:13:43.001817] [DEBUG] [LOCAL ] PAG: Saving derivative data. [2025-09-29T22:13:43.001713] [INFO ] [MAIN ] PAGS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:43.026264] [DEBUG] [MAIN ] PACS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:43.031438] [INFO ] [MAIN ] PACS: Generated 1794 derivative records from 34371 primary records. [2025-09-29T22:13:43.032313] [DEBUG] [LOCAL ] PACS: Saving derivative data. [2025-09-29T22:13:43.036808] [DEBUG] [LOCAL ] PAG: Derivative data saved (1794 records). [2025-09-29T22:13:43.044245] [INFO ] [MAIN ] PAG: Successfully saved derivative data. [2025-09-29T22:13:43.046727] [INFO ] [MAIN ] Derivative Progress: 1385/2057 symbols completed. PAG took 1.2s. Estimated remaining: 4m 33s. Rate: 147.7 symbols/min [2025-09-29T22:13:43.051470] [INFO ] [MAIN ] PAI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:43.061688] [DEBUG] [LOCAL ] PAI: Loaded 2720 existing records from primary storage. [2025-09-29T22:13:43.062547] [INFO ] [MAIN ] PAI: Loaded 2720 primary data records. [2025-09-29T22:13:43.068432] [DEBUG] [LOCAL ] PACS: Derivative data saved (1794 records). [2025-09-29T22:13:43.096443] [INFO ] [MAIN ] PACS: Successfully saved derivative data. [2025-09-29T22:13:43.111064] [INFO ] [MAIN ] Derivative Progress: 1386/2057 symbols completed. PACS took 1.3s. Estimated remaining: 4m 32s. Rate: 147.8 symbols/min [2025-09-29T22:13:43.166045] [INFO ] [MAIN ] PAM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:43.410976] [DEBUG] [LOCAL ] PAGS: Loaded 52691 existing records from primary storage. [2025-09-29T22:13:43.432122] [INFO ] [MAIN ] PAGS: Loaded 52691 primary data records. [2025-09-29T22:13:43.551515] [DEBUG] [LOCAL ] PAM: Loaded 28012 existing records from primary storage. [2025-09-29T22:13:43.551735] [INFO ] [MAIN ] PAM: Loaded 28012 primary data records. [2025-09-29T22:13:44.108470] [DEBUG] [MAIN ] PAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:44.110948] [INFO ] [MAIN ] PAI: Generated 1794 derivative records from 2720 primary records. [2025-09-29T22:13:44.112296] [DEBUG] [LOCAL ] PAI: Saving derivative data. [2025-09-29T22:13:44.132268] [DEBUG] [LOCAL ] PAI: Derivative data saved (1794 records). [2025-09-29T22:13:44.133496] [INFO ] [MAIN ] PAI: Successfully saved derivative data. [2025-09-29T22:13:44.137576] [INFO ] [MAIN ] Derivative Progress: 1387/2057 symbols completed. PAI took 1.1s. Estimated remaining: 4m 32s. Rate: 147.6 symbols/min [2025-09-29T22:13:44.138306] [INFO ] [MAIN ] PAR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:44.158754] [DEBUG] [MAIN ] PAGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:44.159841] [INFO ] [MAIN ] PAGS: Generated 1794 derivative records from 52691 primary records. [2025-09-29T22:13:44.168161] [DEBUG] [LOCAL ] PAGS: Saving derivative data. [2025-09-29T22:13:44.173667] [DEBUG] [MAIN ] PAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:44.175565] [INFO ] [MAIN ] PAM: Generated 1794 derivative records from 28012 primary records. [2025-09-29T22:13:44.184339] [DEBUG] [LOCAL ] PAM: Saving derivative data. [2025-09-29T22:13:44.225879] [DEBUG] [LOCAL ] PAGS: Derivative data saved (1794 records). [2025-09-29T22:13:44.227492] [INFO ] [MAIN ] PAGS: Successfully saved derivative data. [2025-09-29T22:13:44.228198] [DEBUG] [LOCAL ] PAR: Loaded 32589 existing records from primary storage. [2025-09-29T22:13:44.227577] [DEBUG] [LOCAL ] PAM: Derivative data saved (1794 records). [2025-09-29T22:13:44.230385] [INFO ] [MAIN ] Derivative Progress: 1388/2057 symbols completed. PAGS took 1.2s. Estimated remaining: 4m 32s. Rate: 147.7 symbols/min [2025-09-29T22:13:44.228347] [INFO ] [MAIN ] PAM: Successfully saved derivative data. [2025-09-29T22:13:44.232920] [INFO ] [MAIN ] PAR: Loaded 32589 primary data records. [2025-09-29T22:13:44.233031] [INFO ] [MAIN ] Derivative Progress: 1389/2057 symbols completed. PAM took 1.1s. Estimated remaining: 4m 31s. Rate: 147.8 symbols/min [2025-09-29T22:13:44.232807] [INFO ] [MAIN ] PARR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:44.244997] [INFO ] [MAIN ] PATH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:44.608082] [DEBUG] [LOCAL ] PARR: Loaded 48354 existing records from primary storage. [2025-09-29T22:13:44.609681] [INFO ] [MAIN ] PARR: Loaded 48354 primary data records. [2025-09-29T22:13:44.671262] [DEBUG] [LOCAL ] PATH: Loaded 53677 existing records from primary storage. [2025-09-29T22:13:44.702303] [INFO ] [MAIN ] PATH: Loaded 53677 primary data records. [2025-09-29T22:13:44.994350] [DEBUG] [MAIN ] PAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:45.109261] [INFO ] [MAIN ] PAR: Generated 1794 derivative records from 32589 primary records. [2025-09-29T22:13:45.120492] [DEBUG] [LOCAL ] PAR: Saving derivative data. [2025-09-29T22:13:45.342741] [DEBUG] [LOCAL ] PAR: Derivative data saved (1794 records). [2025-09-29T22:13:45.343497] [INFO ] [MAIN ] PAR: Successfully saved derivative data. [2025-09-29T22:13:45.346122] [INFO ] [MAIN ] Derivative Progress: 1390/2057 symbols completed. PAR took 1.2s. Estimated remaining: 4m 31s. Rate: 147.6 symbols/min [2025-09-29T22:13:45.347051] [INFO ] [MAIN ] PAXS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:45.369098] [DEBUG] [MAIN ] PARR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:45.370029] [INFO ] [MAIN ] PARR: Generated 1794 derivative records from 48354 primary records. [2025-09-29T22:13:45.370280] [DEBUG] [LOCAL ] PARR: Saving derivative data. [2025-09-29T22:13:45.404796] [DEBUG] [LOCAL ] PAXS: Loaded 20778 existing records from primary storage. [2025-09-29T22:13:45.405221] [DEBUG] [LOCAL ] PARR: Derivative data saved (1794 records). [2025-09-29T22:13:45.405485] [INFO ] [MAIN ] PARR: Successfully saved derivative data. [2025-09-29T22:13:45.407833] [INFO ] [MAIN ] Derivative Progress: 1391/2057 symbols completed. PARR took 1.2s. Estimated remaining: 4m 31s. Rate: 147.7 symbols/min [2025-09-29T22:13:45.405728] [INFO ] [MAIN ] PAXS: Loaded 20778 primary data records. [2025-09-29T22:13:45.442829] [DEBUG] [MAIN ] PATH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:45.433251] [INFO ] [MAIN ] PAY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:45.486927] [INFO ] [MAIN ] PATH: Generated 1794 derivative records from 53677 primary records. [2025-09-29T22:13:45.493411] [DEBUG] [LOCAL ] PATH: Saving derivative data. [2025-09-29T22:13:45.782612] [DEBUG] [LOCAL ] PATH: Derivative data saved (1794 records). [2025-09-29T22:13:45.783691] [INFO ] [MAIN ] PATH: Successfully saved derivative data. [2025-09-29T22:13:45.786095] [INFO ] [MAIN ] Derivative Progress: 1392/2057 symbols completed. PATH took 1.5s. Estimated remaining: 4m 30s. Rate: 147.7 symbols/min [2025-09-29T22:13:45.786400] [INFO ] [MAIN ] PAYC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:45.788571] [DEBUG] [LOCAL ] PAY: Loaded 38117 existing records from primary storage. [2025-09-29T22:13:45.789455] [INFO ] [MAIN ] PAY: Loaded 38117 primary data records. [2025-09-29T22:13:46.162998] [DEBUG] [LOCAL ] PAYC: Loaded 36232 existing records from primary storage. [2025-09-29T22:13:46.164290] [INFO ] [MAIN ] PAYC: Loaded 36232 primary data records. [2025-09-29T22:13:46.163827] [DEBUG] [MAIN ] PAXS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:46.190784] [INFO ] [MAIN ] PAXS: Generated 1794 derivative records from 20778 primary records. [2025-09-29T22:13:46.222200] [DEBUG] [LOCAL ] PAXS: Saving derivative data. [2025-09-29T22:13:46.502016] [DEBUG] [LOCAL ] PAXS: Derivative data saved (1794 records). [2025-09-29T22:13:46.511422] [INFO ] [MAIN ] PAXS: Successfully saved derivative data. [2025-09-29T22:13:46.521629] [INFO ] [MAIN ] Derivative Progress: 1393/2057 symbols completed. PAXS took 1.2s. Estimated remaining: 4m 30s. Rate: 147.6 symbols/min [2025-09-29T22:13:46.527789] [DEBUG] [MAIN ] PAY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:46.528863] [INFO ] [MAIN ] PAY: Generated 1794 derivative records from 38117 primary records. [2025-09-29T22:13:46.529040] [DEBUG] [LOCAL ] PAY: Saving derivative data. [2025-09-29T22:13:46.549186] [DEBUG] [LOCAL ] PAY: Derivative data saved (1794 records). [2025-09-29T22:13:46.549357] [INFO ] [MAIN ] PAY: Successfully saved derivative data. [2025-09-29T22:13:46.551542] [INFO ] [MAIN ] Derivative Progress: 1394/2057 symbols completed. PAY took 1.1s. Estimated remaining: 4m 29s. Rate: 147.7 symbols/min [2025-09-29T22:13:46.571178] [DEBUG] [MAIN ] PAYC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:46.571828] [INFO ] [MAIN ] PAYC: Generated 1794 derivative records from 36232 primary records. [2025-09-29T22:13:46.571896] [DEBUG] [LOCAL ] PAYC: Saving derivative data. [2025-09-29T22:13:46.588095] [DEBUG] [LOCAL ] PAYC: Derivative data saved (1794 records). [2025-09-29T22:13:46.588195] [INFO ] [MAIN ] PAYC: Successfully saved derivative data. [2025-09-29T22:13:46.590288] [INFO ] [MAIN ] Derivative Progress: 1395/2057 symbols completed. PAYC took 0.8s. Estimated remaining: 4m 29s. Rate: 147.8 symbols/min [2025-09-29T22:13:46.590954] [INFO ] [MAIN ] PBA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:46.591069] [INFO ] [MAIN ] PBF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:46.590834] [INFO ] [MAIN ] PB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:46.674814] [DEBUG] [LOCAL ] PBA: Loaded 48910 existing records from primary storage. [2025-09-29T22:13:46.676587] [INFO ] [MAIN ] PBA: Loaded 48910 primary data records. [2025-09-29T22:13:46.676429] [DEBUG] [LOCAL ] PB: Loaded 41341 existing records from primary storage. [2025-09-29T22:13:46.717857] [INFO ] [MAIN ] PB: Loaded 41341 primary data records. [2025-09-29T22:13:46.742569] [DEBUG] [LOCAL ] PBF: Loaded 53095 existing records from primary storage. [2025-09-29T22:13:46.763286] [INFO ] [MAIN ] PBF: Loaded 53095 primary data records. [2025-09-29T22:13:47.788004] [DEBUG] [MAIN ] PB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:47.789291] [INFO ] [MAIN ] PB: Generated 1794 derivative records from 41341 primary records. [2025-09-29T22:13:47.809689] [DEBUG] [LOCAL ] PB: Saving derivative data. [2025-09-29T22:13:47.816376] [DEBUG] [MAIN ] PBF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:47.817346] [INFO ] [MAIN ] PBF: Generated 1794 derivative records from 53095 primary records. [2025-09-29T22:13:47.815946] [DEBUG] [MAIN ] PBA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:47.818779] [INFO ] [MAIN ] PBA: Generated 1794 derivative records from 48910 primary records. [2025-09-29T22:13:47.817830] [DEBUG] [LOCAL ] PBF: Saving derivative data. [2025-09-29T22:13:47.829706] [DEBUG] [LOCAL ] PBA: Saving derivative data. [2025-09-29T22:13:47.855820] [DEBUG] [LOCAL ] PB: Derivative data saved (1794 records). [2025-09-29T22:13:47.859338] [INFO ] [MAIN ] PB: Successfully saved derivative data. [2025-09-29T22:13:47.862107] [INFO ] [MAIN ] Derivative Progress: 1396/2057 symbols completed. PB took 1.3s. Estimated remaining: 4m 29s. Rate: 147.6 symbols/min [2025-09-29T22:13:47.863081] [INFO ] [MAIN ] PBH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:47.870843] [DEBUG] [LOCAL ] PBA: Derivative data saved (1794 records). [2025-09-29T22:13:47.871564] [INFO ] [MAIN ] PBA: Successfully saved derivative data. [2025-09-29T22:13:47.874104] [INFO ] [MAIN ] Derivative Progress: 1397/2057 symbols completed. PBA took 1.3s. Estimated remaining: 4m 28s. Rate: 147.7 symbols/min [2025-09-29T22:13:47.874427] [INFO ] [MAIN ] PBI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:47.874196] [DEBUG] [LOCAL ] PBF: Derivative data saved (1794 records). [2025-09-29T22:13:47.875128] [INFO ] [MAIN ] PBF: Successfully saved derivative data. [2025-09-29T22:13:47.877491] [INFO ] [MAIN ] Derivative Progress: 1398/2057 symbols completed. PBF took 1.3s. Estimated remaining: 4m 28s. Rate: 147.8 symbols/min [2025-09-29T22:13:47.877941] [INFO ] [MAIN ] PBR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:47.906002] [DEBUG] [LOCAL ] PBH: Loaded 31703 existing records from primary storage. [2025-09-29T22:13:47.906292] [INFO ] [MAIN ] PBH: Loaded 31703 primary data records. [2025-09-29T22:13:48.291018] [DEBUG] [LOCAL ] PBI: Loaded 50003 existing records from primary storage. [2025-09-29T22:13:48.305837] [INFO ] [MAIN ] PBI: Loaded 50003 primary data records. [2025-09-29T22:13:48.306808] [DEBUG] [LOCAL ] PBR: Loaded 53712 existing records from primary storage. [2025-09-29T22:13:48.306977] [INFO ] [MAIN ] PBR: Loaded 53712 primary data records. [2025-09-29T22:13:49.040890] [DEBUG] [MAIN ] PBH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:49.042503] [INFO ] [MAIN ] PBH: Generated 1794 derivative records from 31703 primary records. [2025-09-29T22:13:49.043085] [DEBUG] [LOCAL ] PBH: Saving derivative data. [2025-09-29T22:13:49.065916] [DEBUG] [LOCAL ] PBH: Derivative data saved (1794 records). [2025-09-29T22:13:49.066097] [INFO ] [MAIN ] PBH: Successfully saved derivative data. [2025-09-29T22:13:49.068108] [INFO ] [MAIN ] Derivative Progress: 1399/2057 symbols completed. PBH took 1.2s. Estimated remaining: 4m 28s. Rate: 147.6 symbols/min [2025-09-29T22:13:49.068508] [INFO ] [MAIN ] PBT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:49.090233] [DEBUG] [MAIN ] PBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:49.109318] [DEBUG] [MAIN ] PBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:49.108994] [INFO ] [MAIN ] PBI: Generated 1794 derivative records from 50003 primary records. [2025-09-29T22:13:49.109553] [DEBUG] [LOCAL ] PBI: Saving derivative data. [2025-09-29T22:13:49.110145] [INFO ] [MAIN ] PBR: Generated 1794 derivative records from 53712 primary records. [2025-09-29T22:13:49.110315] [DEBUG] [LOCAL ] PBR: Saving derivative data. [2025-09-29T22:13:49.136602] [DEBUG] [LOCAL ] PBT: Loaded 17219 existing records from primary storage. [2025-09-29T22:13:49.138405] [INFO ] [MAIN ] PBT: Loaded 17219 primary data records. [2025-09-29T22:13:49.239384] [DEBUG] [LOCAL ] PBI: Derivative data saved (1794 records). [2025-09-29T22:13:49.259754] [INFO ] [MAIN ] PBI: Successfully saved derivative data. [2025-09-29T22:13:49.260930] [DEBUG] [LOCAL ] PBR: Derivative data saved (1794 records). [2025-09-29T22:13:49.271467] [INFO ] [MAIN ] PBR: Successfully saved derivative data. [2025-09-29T22:13:49.274223] [INFO ] [MAIN ] Derivative Progress: 1400/2057 symbols completed. PBI took 1.4s. Estimated remaining: 4m 27s. Rate: 147.6 symbols/min [2025-09-29T22:13:49.282067] [INFO ] [MAIN ] Derivative Progress: 1401/2057 symbols completed. PBR took 1.4s. Estimated remaining: 4m 26s. Rate: 147.7 symbols/min [2025-09-29T22:13:49.281936] [INFO ] [MAIN ] PCF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:49.282366] [INFO ] [MAIN ] PCM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:49.485575] [DEBUG] [LOCAL ] PCF: Loaded 8692 existing records from primary storage. [2025-09-29T22:13:49.489705] [INFO ] [MAIN ] PCF: Loaded 8692 primary data records. [2025-09-29T22:13:49.489906] [DEBUG] [LOCAL ] PCM: Loaded 6781 existing records from primary storage. [2025-09-29T22:13:49.490058] [INFO ] [MAIN ] PCM: Loaded 6781 primary data records. [2025-09-29T22:13:50.163811] [DEBUG] [MAIN ] PBT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:50.165186] [INFO ] [MAIN ] PBT: Generated 1794 derivative records from 17219 primary records. [2025-09-29T22:13:50.166039] [DEBUG] [LOCAL ] PBT: Saving derivative data. [2025-09-29T22:13:50.203128] [DEBUG] [LOCAL ] PBT: Derivative data saved (1794 records). [2025-09-29T22:13:50.208528] [INFO ] [MAIN ] PBT: Successfully saved derivative data. [2025-09-29T22:13:50.210930] [INFO ] [MAIN ] Derivative Progress: 1402/2057 symbols completed. PBT took 1.1s. Estimated remaining: 4m 26s. Rate: 147.6 symbols/min [2025-09-29T22:13:50.209018] [DEBUG] [MAIN ] PCF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:50.213143] [INFO ] [MAIN ] PCF: Generated 1794 derivative records from 8692 primary records. [2025-09-29T22:13:50.214072] [INFO ] [MAIN ] PCN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:50.214440] [DEBUG] [LOCAL ] PCF: Saving derivative data. [2025-09-29T22:13:50.240345] [DEBUG] [MAIN ] PCM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:50.241448] [INFO ] [MAIN ] PCM: Generated 1794 derivative records from 6781 primary records. [2025-09-29T22:13:50.241813] [DEBUG] [LOCAL ] PCM: Saving derivative data. [2025-09-29T22:13:50.266155] [DEBUG] [LOCAL ] PCF: Derivative data saved (1794 records). [2025-09-29T22:13:50.266840] [INFO ] [MAIN ] PCF: Successfully saved derivative data. [2025-09-29T22:13:50.269270] [INFO ] [MAIN ] Derivative Progress: 1403/2057 symbols completed. PCF took 1.0s. Estimated remaining: 4m 26s. Rate: 147.7 symbols/min [2025-09-29T22:13:50.269962] [INFO ] [MAIN ] PCQ: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:50.271624] [DEBUG] [LOCAL ] PCM: Derivative data saved (1794 records). [2025-09-29T22:13:50.271760] [INFO ] [MAIN ] PCM: Successfully saved derivative data. [2025-09-29T22:13:50.274021] [INFO ] [MAIN ] Derivative Progress: 1404/2057 symbols completed. PCM took 1.0s. Estimated remaining: 4m 25s. Rate: 147.8 symbols/min [2025-09-29T22:13:50.274354] [INFO ] [MAIN ] PD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:50.285148] [DEBUG] [LOCAL ] PCN: Loaded 24404 existing records from primary storage. [2025-09-29T22:13:50.285284] [INFO ] [MAIN ] PCN: Loaded 24404 primary data records. [2025-09-29T22:13:50.407737] [DEBUG] [LOCAL ] PCQ: Loaded 12253 existing records from primary storage. [2025-09-29T22:13:50.412267] [INFO ] [MAIN ] PCQ: Loaded 12253 primary data records. [2025-09-29T22:13:50.904504] [DEBUG] [LOCAL ] PD: Loaded 47885 existing records from primary storage. [2025-09-29T22:13:50.907256] [INFO ] [MAIN ] PD: Loaded 47885 primary data records. [2025-09-29T22:13:51.429124] [DEBUG] [MAIN ] PCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:51.431449] [INFO ] [MAIN ] PCN: Generated 1794 derivative records from 24404 primary records. [2025-09-29T22:13:51.431678] [DEBUG] [LOCAL ] PCN: Saving derivative data. [2025-09-29T22:13:51.459096] [DEBUG] [MAIN ] PCQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:51.461349] [INFO ] [MAIN ] PCQ: Generated 1794 derivative records from 12253 primary records. [2025-09-29T22:13:51.461939] [DEBUG] [LOCAL ] PCQ: Saving derivative data. [2025-09-29T22:13:51.481211] [DEBUG] [LOCAL ] PCN: Derivative data saved (1794 records). [2025-09-29T22:13:51.482225] [INFO ] [MAIN ] PCN: Successfully saved derivative data. [2025-09-29T22:13:51.484864] [INFO ] [MAIN ] Derivative Progress: 1405/2057 symbols completed. PCN took 1.3s. Estimated remaining: 4m 25s. Rate: 147.6 symbols/min [2025-09-29T22:13:51.485310] [INFO ] [MAIN ] PDI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:51.486223] [DEBUG] [LOCAL ] PCQ: Derivative data saved (1794 records). [2025-09-29T22:13:51.487232] [INFO ] [MAIN ] PCQ: Successfully saved derivative data. [2025-09-29T22:13:51.491362] [INFO ] [MAIN ] Derivative Progress: 1406/2057 symbols completed. PCQ took 1.2s. Estimated remaining: 4m 24s. Rate: 147.7 symbols/min [2025-09-29T22:13:51.491741] [INFO ] [MAIN ] PDM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:51.507104] [DEBUG] [MAIN ] PD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:51.507982] [INFO ] [MAIN ] PD: Generated 1794 derivative records from 47885 primary records. [2025-09-29T22:13:51.508111] [DEBUG] [LOCAL ] PD: Saving derivative data. [2025-09-29T22:13:51.525436] [DEBUG] [LOCAL ] PD: Derivative data saved (1794 records). [2025-09-29T22:13:51.525557] [INFO ] [MAIN ] PD: Successfully saved derivative data. [2025-09-29T22:13:51.531787] [INFO ] [MAIN ] Derivative Progress: 1407/2057 symbols completed. PD took 1.3s. Estimated remaining: 4m 24s. Rate: 147.8 symbols/min [2025-09-29T22:13:51.532149] [INFO ] [MAIN ] PDO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:51.600946] [DEBUG] [LOCAL ] PDM: Loaded 39713 existing records from primary storage. [2025-09-29T22:13:51.614008] [DEBUG] [LOCAL ] PDO: Loaded 31451 existing records from primary storage. [2025-09-29T22:13:51.616012] [DEBUG] [LOCAL ] PDI: Loaded 50108 existing records from primary storage. [2025-09-29T22:13:51.614469] [INFO ] [MAIN ] PDO: Loaded 31451 primary data records. [2025-09-29T22:13:51.621544] [INFO ] [MAIN ] PDI: Loaded 50108 primary data records. [2025-09-29T22:13:51.614202] [INFO ] [MAIN ] PDM: Loaded 39713 primary data records. [2025-09-29T22:13:52.681489] [DEBUG] [MAIN ] PDO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:52.683690] [INFO ] [MAIN ] PDO: Generated 1794 derivative records from 31451 primary records. [2025-09-29T22:13:52.682285] [DEBUG] [MAIN ] PDM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:52.685377] [DEBUG] [MAIN ] PDI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:52.684987] [INFO ] [MAIN ] PDM: Generated 1794 derivative records from 39713 primary records. [2025-09-29T22:13:52.685639] [DEBUG] [LOCAL ] PDM: Saving derivative data. [2025-09-29T22:13:52.685852] [DEBUG] [LOCAL ] PDO: Saving derivative data. [2025-09-29T22:13:52.688386] [INFO ] [MAIN ] PDI: Generated 1794 derivative records from 50108 primary records. [2025-09-29T22:13:52.697597] [DEBUG] [LOCAL ] PDI: Saving derivative data. [2025-09-29T22:13:52.735146] [DEBUG] [LOCAL ] PDI: Derivative data saved (1794 records). [2025-09-29T22:13:52.735887] [INFO ] [MAIN ] PDI: Successfully saved derivative data. [2025-09-29T22:13:52.738474] [INFO ] [MAIN ] Derivative Progress: 1408/2057 symbols completed. PDI took 1.3s. Estimated remaining: 4m 24s. Rate: 147.6 symbols/min [2025-09-29T22:13:52.742405] [DEBUG] [LOCAL ] PDM: Derivative data saved (1794 records). [2025-09-29T22:13:52.743010] [INFO ] [MAIN ] PDM: Successfully saved derivative data. [2025-09-29T22:13:52.745601] [INFO ] [MAIN ] Derivative Progress: 1409/2057 symbols completed. PDM took 1.3s. Estimated remaining: 4m 23s. Rate: 147.7 symbols/min [2025-09-29T22:13:52.746116] [DEBUG] [LOCAL ] PDO: Derivative data saved (1794 records). [2025-09-29T22:13:52.746309] [INFO ] [MAIN ] PDO: Successfully saved derivative data. [2025-09-29T22:13:52.748240] [INFO ] [MAIN ] Derivative Progress: 1410/2057 symbols completed. PDO took 1.2s. Estimated remaining: 4m 23s. Rate: 147.8 symbols/min [2025-09-29T22:13:52.748885] [INFO ] [MAIN ] PDS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:52.748825] [INFO ] [MAIN ] PDT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:52.749059] [INFO ] [MAIN ] PDX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:52.785532] [DEBUG] [LOCAL ] PDT: Loaded 17301 existing records from primary storage. [2025-09-29T22:13:52.791920] [INFO ] [MAIN ] PDT: Loaded 17301 primary data records. [2025-09-29T22:13:52.785096] [DEBUG] [LOCAL ] PDX: Loaded 14358 existing records from primary storage. [2025-09-29T22:13:52.797692] [DEBUG] [LOCAL ] PDS: Loaded 17807 existing records from primary storage. [2025-09-29T22:13:52.797799] [INFO ] [MAIN ] PDX: Loaded 14358 primary data records. [2025-09-29T22:13:52.805055] [INFO ] [MAIN ] PDS: Loaded 17807 primary data records. [2025-09-29T22:13:53.855426] [DEBUG] [MAIN ] PDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:53.856995] [INFO ] [MAIN ] PDT: Generated 1794 derivative records from 17301 primary records. [2025-09-29T22:13:53.859679] [DEBUG] [LOCAL ] PDT: Saving derivative data. [2025-09-29T22:13:53.884346] [DEBUG] [MAIN ] PDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:53.906017] [DEBUG] [LOCAL ] PDT: Derivative data saved (1794 records). [2025-09-29T22:13:53.896227] [INFO ] [MAIN ] PDS: Generated 1794 derivative records from 17807 primary records. [2025-09-29T22:13:53.906298] [DEBUG] [LOCAL ] PDS: Saving derivative data. [2025-09-29T22:13:53.906228] [INFO ] [MAIN ] PDT: Successfully saved derivative data. [2025-09-29T22:13:53.909248] [INFO ] [MAIN ] Derivative Progress: 1411/2057 symbols completed. PDT took 1.2s. Estimated remaining: 4m 23s. Rate: 147.6 symbols/min [2025-09-29T22:13:53.906725] [DEBUG] [MAIN ] PDX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:53.910804] [INFO ] [MAIN ] PEB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:53.910682] [INFO ] [MAIN ] PDX: Generated 1794 derivative records from 14358 primary records. [2025-09-29T22:13:53.911298] [DEBUG] [LOCAL ] PDX: Saving derivative data. [2025-09-29T22:13:53.941851] [DEBUG] [LOCAL ] PDX: Derivative data saved (1794 records). [2025-09-29T22:13:53.942795] [INFO ] [MAIN ] PDX: Successfully saved derivative data. [2025-09-29T22:13:53.945323] [INFO ] [MAIN ] Derivative Progress: 1412/2057 symbols completed. PDX took 1.2s. Estimated remaining: 4m 22s. Rate: 147.7 symbols/min [2025-09-29T22:13:53.945490] [INFO ] [MAIN ] PEN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:53.949420] [DEBUG] [LOCAL ] PDS: Derivative data saved (1794 records). [2025-09-29T22:13:53.949562] [INFO ] [MAIN ] PDS: Successfully saved derivative data. [2025-09-29T22:13:53.952187] [INFO ] [MAIN ] Derivative Progress: 1413/2057 symbols completed. PDS took 1.2s. Estimated remaining: 4m 21s. Rate: 147.8 symbols/min [2025-09-29T22:13:53.952546] [INFO ] [MAIN ] PEO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:53.977501] [DEBUG] [LOCAL ] PEO: Loaded 10930 existing records from primary storage. [2025-09-29T22:13:53.977756] [INFO ] [MAIN ] PEO: Loaded 10930 primary data records. [2025-09-29T22:13:54.088676] [DEBUG] [LOCAL ] PEN: Loaded 30229 existing records from primary storage. [2025-09-29T22:13:54.107283] [INFO ] [MAIN ] PEN: Loaded 30229 primary data records. [2025-09-29T22:13:54.229316] [DEBUG] [LOCAL ] PEB: Loaded 50664 existing records from primary storage. [2025-09-29T22:13:54.430292] [INFO ] [MAIN ] PEB: Loaded 50664 primary data records. [2025-09-29T22:13:55.022756] [DEBUG] [MAIN ] PEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:55.023960] [INFO ] [MAIN ] PEO: Generated 1794 derivative records from 10930 primary records. [2025-09-29T22:13:55.024172] [DEBUG] [LOCAL ] PEO: Saving derivative data. [2025-09-29T22:13:55.057372] [DEBUG] [MAIN ] PEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:55.059432] [INFO ] [MAIN ] PEN: Generated 1794 derivative records from 30229 primary records. [2025-09-29T22:13:55.059735] [DEBUG] [LOCAL ] PEN: Saving derivative data. [2025-09-29T22:13:55.077178] [DEBUG] [LOCAL ] PEO: Derivative data saved (1794 records). [2025-09-29T22:13:55.080924] [INFO ] [MAIN ] PEO: Successfully saved derivative data. [2025-09-29T22:13:55.082924] [INFO ] [MAIN ] Derivative Progress: 1414/2057 symbols completed. PEO took 1.1s. Estimated remaining: 4m 21s. Rate: 147.6 symbols/min [2025-09-29T22:13:55.083515] [INFO ] [MAIN ] PERF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:55.085779] [DEBUG] [LOCAL ] PEN: Derivative data saved (1794 records). [2025-09-29T22:13:55.098850] [INFO ] [MAIN ] PEN: Successfully saved derivative data. [2025-09-29T22:13:55.101800] [INFO ] [MAIN ] Derivative Progress: 1415/2057 symbols completed. PEN took 1.2s. Estimated remaining: 4m 21s. Rate: 147.7 symbols/min [2025-09-29T22:13:55.102472] [INFO ] [MAIN ] PFD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:55.102232] [DEBUG] [MAIN ] PEB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:55.103870] [INFO ] [MAIN ] PEB: Generated 1794 derivative records from 50664 primary records. [2025-09-29T22:13:55.104004] [DEBUG] [LOCAL ] PEB: Saving derivative data. [2025-09-29T22:13:55.135551] [DEBUG] [LOCAL ] PEB: Derivative data saved (1794 records). [2025-09-29T22:13:55.135080] [DEBUG] [LOCAL ] PERF: Loaded 14019 existing records from primary storage. [2025-09-29T22:13:55.135894] [DEBUG] [LOCAL ] PFD: Loaded 5130 existing records from primary storage. [2025-09-29T22:13:55.136195] [INFO ] [MAIN ] PEB: Successfully saved derivative data. [2025-09-29T22:13:55.136130] [INFO ] [MAIN ] PFD: Loaded 5130 primary data records. [2025-09-29T22:13:55.136001] [INFO ] [MAIN ] PERF: Loaded 14019 primary data records. [2025-09-29T22:13:55.150034] [INFO ] [MAIN ] Derivative Progress: 1416/2057 symbols completed. PEB took 1.2s. Estimated remaining: 4m 20s. Rate: 147.8 symbols/min [2025-09-29T22:13:55.160672] [INFO ] [MAIN ] PFGC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:55.863371] [DEBUG] [LOCAL ] PFGC: Loaded 46839 existing records from primary storage. [2025-09-29T22:13:55.863613] [INFO ] [MAIN ] PFGC: Loaded 46839 primary data records. [2025-09-29T22:13:56.254310] [DEBUG] [MAIN ] PFD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:56.255750] [INFO ] [MAIN ] PFD: Generated 1794 derivative records from 5130 primary records. [2025-09-29T22:13:56.256194] [DEBUG] [MAIN ] PERF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:56.257583] [INFO ] [MAIN ] PERF: Generated 1794 derivative records from 14019 primary records. [2025-09-29T22:13:56.256722] [DEBUG] [LOCAL ] PFD: Saving derivative data. [2025-09-29T22:13:56.257904] [DEBUG] [LOCAL ] PERF: Saving derivative data. [2025-09-29T22:13:56.290547] [DEBUG] [LOCAL ] PERF: Derivative data saved (1794 records). [2025-09-29T22:13:56.291544] [INFO ] [MAIN ] PERF: Successfully saved derivative data. [2025-09-29T22:13:56.294260] [INFO ] [MAIN ] Derivative Progress: 1417/2057 symbols completed. PERF took 1.2s. Estimated remaining: 4m 20s. Rate: 147.6 symbols/min [2025-09-29T22:13:56.295336] [INFO ] [MAIN ] PFH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:56.298766] [DEBUG] [LOCAL ] PFD: Derivative data saved (1794 records). [2025-09-29T22:13:56.299045] [INFO ] [MAIN ] PFD: Successfully saved derivative data. [2025-09-29T22:13:56.313904] [INFO ] [MAIN ] Derivative Progress: 1418/2057 symbols completed. PFD took 1.2s. Estimated remaining: 4m 20s. Rate: 147.7 symbols/min [2025-09-29T22:13:56.314355] [INFO ] [MAIN ] PFL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:56.314678] [DEBUG] [MAIN ] PFGC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:56.315754] [INFO ] [MAIN ] PFGC: Generated 1794 derivative records from 46839 primary records. [2025-09-29T22:13:56.315823] [DEBUG] [LOCAL ] PFGC: Saving derivative data. [2025-09-29T22:13:56.340758] [DEBUG] [LOCAL ] PFH: Loaded 6838 existing records from primary storage. [2025-09-29T22:13:56.342204] [INFO ] [MAIN ] PFH: Loaded 6838 primary data records. [2025-09-29T22:13:56.359194] [DEBUG] [LOCAL ] PFGC: Derivative data saved (1794 records). [2025-09-29T22:13:56.380343] [INFO ] [MAIN ] PFGC: Successfully saved derivative data. [2025-09-29T22:13:56.422104] [INFO ] [MAIN ] Derivative Progress: 1419/2057 symbols completed. PFGC took 1.3s. Estimated remaining: 4m 19s. Rate: 147.8 symbols/min [2025-09-29T22:13:56.428044] [INFO ] [MAIN ] PFLT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:56.445071] [DEBUG] [LOCAL ] PFL: Loaded 13656 existing records from primary storage. [2025-09-29T22:13:56.460802] [INFO ] [MAIN ] PFL: Loaded 13656 primary data records. [2025-09-29T22:13:57.045917] [DEBUG] [LOCAL ] PFLT: Loaded 43669 existing records from primary storage. [2025-09-29T22:13:57.046547] [INFO ] [MAIN ] PFLT: Loaded 43669 primary data records. [2025-09-29T22:13:57.186198] [DEBUG] [MAIN ] PFH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:57.224716] [INFO ] [MAIN ] PFH: Generated 1794 derivative records from 6838 primary records. [2025-09-29T22:13:57.251596] [DEBUG] [LOCAL ] PFH: Saving derivative data. [2025-09-29T22:13:57.409565] [DEBUG] [MAIN ] PFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:57.412607] [INFO ] [MAIN ] PFL: Generated 1794 derivative records from 13656 primary records. [2025-09-29T22:13:57.413565] [DEBUG] [LOCAL ] PFL: Saving derivative data. [2025-09-29T22:13:57.431421] [DEBUG] [LOCAL ] PFH: Derivative data saved (1794 records). [2025-09-29T22:13:57.432244] [INFO ] [MAIN ] PFH: Successfully saved derivative data. [2025-09-29T22:13:57.434993] [INFO ] [MAIN ] Derivative Progress: 1420/2057 symbols completed. PFH took 1.1s. Estimated remaining: 4m 19s. Rate: 147.6 symbols/min [2025-09-29T22:13:57.436859] [INFO ] [MAIN ] PFN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:57.443388] [DEBUG] [LOCAL ] PFL: Derivative data saved (1794 records). [2025-09-29T22:13:57.443979] [INFO ] [MAIN ] PFL: Successfully saved derivative data. [2025-09-29T22:13:57.446266] [INFO ] [MAIN ] Derivative Progress: 1421/2057 symbols completed. PFL took 1.1s. Estimated remaining: 4m 18s. Rate: 147.7 symbols/min [2025-09-29T22:13:57.447765] [INFO ] [MAIN ] PFO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:57.474864] [DEBUG] [LOCAL ] PFO: Loaded 5913 existing records from primary storage. [2025-09-29T22:13:57.475710] [DEBUG] [LOCAL ] PFN: Loaded 21645 existing records from primary storage. [2025-09-29T22:13:57.489425] [INFO ] [MAIN ] PFN: Loaded 21645 primary data records. [2025-09-29T22:13:57.484100] [INFO ] [MAIN ] PFO: Loaded 5913 primary data records. [2025-09-29T22:13:57.532994] [DEBUG] [MAIN ] PFLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:57.568262] [INFO ] [MAIN ] PFLT: Generated 1794 derivative records from 43669 primary records. [2025-09-29T22:13:57.583782] [DEBUG] [LOCAL ] PFLT: Saving derivative data. [2025-09-29T22:13:58.190438] [DEBUG] [LOCAL ] PFLT: Derivative data saved (1794 records). [2025-09-29T22:13:58.191176] [INFO ] [MAIN ] PFLT: Successfully saved derivative data. [2025-09-29T22:13:58.193245] [INFO ] [MAIN ] Derivative Progress: 1422/2057 symbols completed. PFLT took 1.8s. Estimated remaining: 4m 18s. Rate: 147.6 symbols/min [2025-09-29T22:13:58.194182] [INFO ] [MAIN ] PFS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:58.223586] [DEBUG] [MAIN ] PFN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:58.225291] [INFO ] [MAIN ] PFN: Generated 1794 derivative records from 21645 primary records. [2025-09-29T22:13:58.236432] [DEBUG] [LOCAL ] PFN: Saving derivative data. [2025-09-29T22:13:58.260145] [DEBUG] [MAIN ] PFO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:58.264792] [INFO ] [MAIN ] PFO: Generated 1794 derivative records from 5913 primary records. [2025-09-29T22:13:58.276708] [DEBUG] [LOCAL ] PFO: Saving derivative data. [2025-09-29T22:13:58.281376] [DEBUG] [LOCAL ] PFS: Loaded 35575 existing records from primary storage. [2025-09-29T22:13:58.288842] [INFO ] [MAIN ] PFS: Loaded 35575 primary data records. [2025-09-29T22:13:58.290593] [DEBUG] [LOCAL ] PFN: Derivative data saved (1794 records). [2025-09-29T22:13:58.327959] [INFO ] [MAIN ] PFN: Successfully saved derivative data. [2025-09-29T22:13:58.342700] [INFO ] [MAIN ] Derivative Progress: 1423/2057 symbols completed. PFN took 0.9s. Estimated remaining: 4m 18s. Rate: 147.7 symbols/min [2025-09-29T22:13:58.410206] [DEBUG] [LOCAL ] PFO: Derivative data saved (1794 records). [2025-09-29T22:13:58.421021] [INFO ] [MAIN ] PFO: Successfully saved derivative data. [2025-09-29T22:13:58.433879] [INFO ] [MAIN ] Derivative Progress: 1424/2057 symbols completed. PFO took 1.0s. Estimated remaining: 4m 17s. Rate: 147.8 symbols/min [2025-09-29T22:13:58.647964] [DEBUG] [MAIN ] PFS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:58.649074] [INFO ] [MAIN ] PFS: Generated 1794 derivative records from 35575 primary records. [2025-09-29T22:13:58.649198] [DEBUG] [LOCAL ] PFS: Saving derivative data. [2025-09-29T22:13:58.670487] [DEBUG] [LOCAL ] PFS: Derivative data saved (1794 records). [2025-09-29T22:13:58.670598] [INFO ] [MAIN ] PFS: Successfully saved derivative data. [2025-09-29T22:13:58.673042] [INFO ] [MAIN ] Derivative Progress: 1425/2057 symbols completed. PFS took 0.5s. Estimated remaining: 4m 17s. Rate: 147.8 symbols/min [2025-09-29T22:13:58.673489] [INFO ] [MAIN ] PFSI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:58.673599] [INFO ] [MAIN ] PGRE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:58.673733] [INFO ] [MAIN ] PGP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:58.683737] [DEBUG] [LOCAL ] PGP: Loaded 5454 existing records from primary storage. [2025-09-29T22:13:58.684071] [INFO ] [MAIN ] PGP: Loaded 5454 primary data records. [2025-09-29T22:13:58.882438] [DEBUG] [LOCAL ] PFSI: Loaded 28694 existing records from primary storage. [2025-09-29T22:13:58.920781] [INFO ] [MAIN ] PFSI: Loaded 28694 primary data records. [2025-09-29T22:13:59.062008] [DEBUG] [LOCAL ] PGRE: Loaded 46603 existing records from primary storage. [2025-09-29T22:13:59.093587] [INFO ] [MAIN ] PGRE: Loaded 46603 primary data records. [2025-09-29T22:13:59.802068] [DEBUG] [MAIN ] PGP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:59.803210] [INFO ] [MAIN ] PGP: Generated 1794 derivative records from 5454 primary records. [2025-09-29T22:13:59.803680] [DEBUG] [LOCAL ] PGP: Saving derivative data. [2025-09-29T22:13:59.822401] [DEBUG] [LOCAL ] PGP: Derivative data saved (1794 records). [2025-09-29T22:13:59.822831] [INFO ] [MAIN ] PGP: Successfully saved derivative data. [2025-09-29T22:13:59.827173] [INFO ] [MAIN ] Derivative Progress: 1426/2057 symbols completed. PGP took 1.2s. Estimated remaining: 4m 16s. Rate: 147.6 symbols/min [2025-09-29T22:13:59.828330] [INFO ] [MAIN ] PGZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:13:59.842719] [DEBUG] [MAIN ] PFSI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:59.843565] [INFO ] [MAIN ] PFSI: Generated 1794 derivative records from 28694 primary records. [2025-09-29T22:13:59.843770] [DEBUG] [LOCAL ] PFSI: Saving derivative data. [2025-09-29T22:13:59.880439] [DEBUG] [MAIN ] PGRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:13:59.881214] [INFO ] [MAIN ] PGRE: Generated 1794 derivative records from 46603 primary records. [2025-09-29T22:13:59.880105] [DEBUG] [LOCAL ] PGZ: Loaded 5422 existing records from primary storage. [2025-09-29T22:13:59.882236] [INFO ] [MAIN ] PGZ: Loaded 5422 primary data records. [2025-09-29T22:13:59.881556] [DEBUG] [LOCAL ] PGRE: Saving derivative data. [2025-09-29T22:13:59.943748] [DEBUG] [LOCAL ] PFSI: Derivative data saved (1794 records). [2025-09-29T22:13:59.971279] [INFO ] [MAIN ] PFSI: Successfully saved derivative data. [2025-09-29T22:13:59.983349] [INFO ] [MAIN ] Derivative Progress: 1427/2057 symbols completed. PFSI took 1.3s. Estimated remaining: 4m 16s. Rate: 147.7 symbols/min [2025-09-29T22:14:00.004301] [INFO ] [MAIN ] PH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:00.042155] [DEBUG] [LOCAL ] PGRE: Derivative data saved (1794 records). [2025-09-29T22:14:00.042428] [INFO ] [MAIN ] PGRE: Successfully saved derivative data. [2025-09-29T22:14:00.050064] [INFO ] [MAIN ] Derivative Progress: 1428/2057 symbols completed. PGRE took 1.4s. Estimated remaining: 4m 15s. Rate: 147.8 symbols/min [2025-09-29T22:14:00.114504] [INFO ] [MAIN ] PHD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:00.253182] [DEBUG] [LOCAL ] PHD: Loaded 10144 existing records from primary storage. [2025-09-29T22:14:00.253585] [INFO ] [MAIN ] PHD: Loaded 10144 primary data records. [2025-09-29T22:14:00.418996] [DEBUG] [LOCAL ] PH: Loaded 38362 existing records from primary storage. [2025-09-29T22:14:00.487146] [INFO ] [MAIN ] PH: Loaded 38362 primary data records. [2025-09-29T22:14:00.665773] [DEBUG] [MAIN ] PGZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:00.679584] [INFO ] [MAIN ] PGZ: Generated 1794 derivative records from 5422 primary records. [2025-09-29T22:14:00.693951] [DEBUG] [LOCAL ] PGZ: Saving derivative data. [2025-09-29T22:14:00.773773] [DEBUG] [LOCAL ] PGZ: Derivative data saved (1794 records). [2025-09-29T22:14:00.823146] [INFO ] [MAIN ] PGZ: Successfully saved derivative data. [2025-09-29T22:14:00.858415] [INFO ] [MAIN ] Derivative Progress: 1429/2057 symbols completed. PGZ took 1.0s. Estimated remaining: 4m 15s. Rate: 147.7 symbols/min [2025-09-29T22:14:00.974916] [INFO ] [MAIN ] PHG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:01.012207] [DEBUG] [MAIN ] PHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:01.013508] [INFO ] [MAIN ] PHD: Generated 1794 derivative records from 10144 primary records. [2025-09-29T22:14:01.013809] [DEBUG] [LOCAL ] PHD: Saving derivative data. [2025-09-29T22:14:01.034398] [DEBUG] [LOCAL ] PHD: Derivative data saved (1794 records). [2025-09-29T22:14:01.034855] [INFO ] [MAIN ] PHD: Successfully saved derivative data. [2025-09-29T22:14:01.037280] [INFO ] [MAIN ] Derivative Progress: 1430/2057 symbols completed. PHD took 0.9s. Estimated remaining: 4m 15s. Rate: 147.7 symbols/min [2025-09-29T22:14:01.037720] [INFO ] [MAIN ] PHI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:01.068738] [DEBUG] [MAIN ] PH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:01.069840] [INFO ] [MAIN ] PH: Generated 1794 derivative records from 38362 primary records. [2025-09-29T22:14:01.070818] [DEBUG] [LOCAL ] PH: Saving derivative data. [2025-09-29T22:14:01.107760] [DEBUG] [LOCAL ] PHG: Loaded 46113 existing records from primary storage. [2025-09-29T22:14:01.114992] [DEBUG] [LOCAL ] PHI: Loaded 14967 existing records from primary storage. [2025-09-29T22:14:01.114236] [INFO ] [MAIN ] PHG: Loaded 46113 primary data records. [2025-09-29T22:14:01.115541] [INFO ] [MAIN ] PHI: Loaded 14967 primary data records. [2025-09-29T22:14:01.236022] [DEBUG] [LOCAL ] PH: Derivative data saved (1794 records). [2025-09-29T22:14:01.265014] [INFO ] [MAIN ] PH: Successfully saved derivative data. [2025-09-29T22:14:01.315929] [INFO ] [MAIN ] Derivative Progress: 1431/2057 symbols completed. PH took 1.3s. Estimated remaining: 4m 14s. Rate: 147.8 symbols/min [2025-09-29T22:14:01.325558] [INFO ] [MAIN ] PHIN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:01.858422] [DEBUG] [LOCAL ] PHIN: Loaded 32759 existing records from primary storage. [2025-09-29T22:14:01.859689] [INFO ] [MAIN ] PHIN: Loaded 32759 primary data records. [2025-09-29T22:14:02.233584] [DEBUG] [MAIN ] PHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:02.227460] [DEBUG] [MAIN ] PHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:02.235391] [INFO ] [MAIN ] PHG: Generated 1794 derivative records from 46113 primary records. [2025-09-29T22:14:02.237220] [DEBUG] [LOCAL ] PHG: Saving derivative data. [2025-09-29T22:14:02.236841] [INFO ] [MAIN ] PHI: Generated 1794 derivative records from 14967 primary records. [2025-09-29T22:14:02.238863] [DEBUG] [LOCAL ] PHI: Saving derivative data. [2025-09-29T22:14:02.274927] [DEBUG] [LOCAL ] PHG: Derivative data saved (1794 records). [2025-09-29T22:14:02.275830] [INFO ] [MAIN ] PHG: Successfully saved derivative data. [2025-09-29T22:14:02.278634] [INFO ] [MAIN ] Derivative Progress: 1432/2057 symbols completed. PHG took 1.3s. Estimated remaining: 4m 14s. Rate: 147.6 symbols/min [2025-09-29T22:14:02.280345] [DEBUG] [LOCAL ] PHI: Derivative data saved (1794 records). [2025-09-29T22:14:02.280515] [INFO ] [MAIN ] PHI: Successfully saved derivative data. [2025-09-29T22:14:02.282834] [INFO ] [MAIN ] Derivative Progress: 1433/2057 symbols completed. PHI took 1.2s. Estimated remaining: 4m 13s. Rate: 147.7 symbols/min [2025-09-29T22:14:02.279264] [INFO ] [MAIN ] PHK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:02.286023] [INFO ] [MAIN ] PHR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:02.305835] [DEBUG] [MAIN ] PHIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:02.306624] [INFO ] [MAIN ] PHIN: Generated 1794 derivative records from 32759 primary records. [2025-09-29T22:14:02.306797] [DEBUG] [LOCAL ] PHIN: Saving derivative data. [2025-09-29T22:14:02.331005] [DEBUG] [LOCAL ] PHIN: Derivative data saved (1794 records). [2025-09-29T22:14:02.331537] [INFO ] [MAIN ] PHIN: Successfully saved derivative data. [2025-09-29T22:14:02.333818] [INFO ] [MAIN ] Derivative Progress: 1434/2057 symbols completed. PHIN took 1.0s. Estimated remaining: 4m 13s. Rate: 147.8 symbols/min [2025-09-29T22:14:02.343155] [INFO ] [MAIN ] PII: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:02.344123] [DEBUG] [LOCAL ] PHK: Loaded 26245 existing records from primary storage. [2025-09-29T22:14:02.344742] [INFO ] [MAIN ] PHK: Loaded 26245 primary data records. [2025-09-29T22:14:02.502506] [DEBUG] [LOCAL ] PHR: Loaded 37457 existing records from primary storage. [2025-09-29T22:14:02.549580] [INFO ] [MAIN ] PHR: Loaded 37457 primary data records. [2025-09-29T22:14:02.827554] [DEBUG] [LOCAL ] PII: Loaded 49021 existing records from primary storage. [2025-09-29T22:14:02.831561] [INFO ] [MAIN ] PII: Loaded 49021 primary data records. [2025-09-29T22:14:03.384667] [DEBUG] [MAIN ] PHK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:03.386992] [INFO ] [MAIN ] PHK: Generated 1794 derivative records from 26245 primary records. [2025-09-29T22:14:03.387926] [DEBUG] [LOCAL ] PHK: Saving derivative data. [2025-09-29T22:14:03.409279] [DEBUG] [LOCAL ] PHK: Derivative data saved (1794 records). [2025-09-29T22:14:03.410869] [INFO ] [MAIN ] PHK: Successfully saved derivative data. [2025-09-29T22:14:03.413021] [INFO ] [MAIN ] Derivative Progress: 1435/2057 symbols completed. PHK took 1.1s. Estimated remaining: 4m 13s. Rate: 147.7 symbols/min [2025-09-29T22:14:03.413636] [INFO ] [MAIN ] PIM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:03.431599] [DEBUG] [MAIN ] PHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:03.432445] [INFO ] [MAIN ] PHR: Generated 1794 derivative records from 37457 primary records. [2025-09-29T22:14:03.432677] [DEBUG] [LOCAL ] PHR: Saving derivative data. [2025-09-29T22:14:03.451298] [DEBUG] [LOCAL ] PIM: Loaded 4773 existing records from primary storage. [2025-09-29T22:14:03.452370] [INFO ] [MAIN ] PIM: Loaded 4773 primary data records. [2025-09-29T22:14:03.532834] [DEBUG] [LOCAL ] PHR: Derivative data saved (1794 records). [2025-09-29T22:14:03.553929] [INFO ] [MAIN ] PHR: Successfully saved derivative data. [2025-09-29T22:14:03.583930] [DEBUG] [MAIN ] PII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:03.586909] [INFO ] [MAIN ] Derivative Progress: 1436/2057 symbols completed. PHR took 1.3s. Estimated remaining: 4m 12s. Rate: 147.7 symbols/min [2025-09-29T22:14:03.588726] [INFO ] [MAIN ] PINE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:03.588426] [INFO ] [MAIN ] PII: Generated 1794 derivative records from 49021 primary records. [2025-09-29T22:14:03.599978] [DEBUG] [LOCAL ] PII: Saving derivative data. [2025-09-29T22:14:03.881720] [DEBUG] [LOCAL ] PII: Derivative data saved (1794 records). [2025-09-29T22:14:03.889162] [DEBUG] [LOCAL ] PINE: Loaded 14067 existing records from primary storage. [2025-09-29T22:14:03.889449] [INFO ] [MAIN ] PINE: Loaded 14067 primary data records. [2025-09-29T22:14:03.887864] [INFO ] [MAIN ] PII: Successfully saved derivative data. [2025-09-29T22:14:03.896920] [INFO ] [MAIN ] Derivative Progress: 1437/2057 symbols completed. PII took 1.6s. Estimated remaining: 4m 12s. Rate: 147.7 symbols/min [2025-09-29T22:14:03.903705] [INFO ] [MAIN ] PINS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:04.250993] [DEBUG] [MAIN ] PIM: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:14:04.268309] [INFO ] [MAIN ] PIM: Generated 1793 derivative records from 4773 primary records. [2025-09-29T22:14:04.268486] [DEBUG] [LOCAL ] PIM: Saving derivative data. [2025-09-29T22:14:04.270216] [DEBUG] [LOCAL ] PINS: Loaded 53693 existing records from primary storage. [2025-09-29T22:14:04.270525] [INFO ] [MAIN ] PINS: Loaded 53693 primary data records. [2025-09-29T22:14:04.378339] [DEBUG] [LOCAL ] PIM: Derivative data saved (1793 records). [2025-09-29T22:14:04.385308] [INFO ] [MAIN ] PIM: Successfully saved derivative data. [2025-09-29T22:14:04.399852] [INFO ] [MAIN ] Derivative Progress: 1438/2057 symbols completed. PIM took 1.0s. Estimated remaining: 4m 11s. Rate: 147.7 symbols/min [2025-09-29T22:14:04.625801] [DEBUG] [MAIN ] PINE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:04.626624] [INFO ] [MAIN ] PINE: Generated 1794 derivative records from 14067 primary records. [2025-09-29T22:14:04.626734] [DEBUG] [LOCAL ] PINE: Saving derivative data. [2025-09-29T22:14:04.644359] [DEBUG] [LOCAL ] PINE: Derivative data saved (1794 records). [2025-09-29T22:14:04.644888] [INFO ] [MAIN ] PINE: Successfully saved derivative data. [2025-09-29T22:14:04.653486] [INFO ] [MAIN ] Derivative Progress: 1439/2057 symbols completed. PINE took 1.1s. Estimated remaining: 4m 11s. Rate: 147.8 symbols/min [2025-09-29T22:14:04.679075] [DEBUG] [MAIN ] PINS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:04.679891] [INFO ] [MAIN ] PINS: Generated 1794 derivative records from 53693 primary records. [2025-09-29T22:14:04.679960] [DEBUG] [LOCAL ] PINS: Saving derivative data. [2025-09-29T22:14:04.696665] [DEBUG] [LOCAL ] PINS: Derivative data saved (1794 records). [2025-09-29T22:14:04.696781] [INFO ] [MAIN ] PINS: Successfully saved derivative data. [2025-09-29T22:14:04.699135] [INFO ] [MAIN ] Derivative Progress: 1440/2057 symbols completed. PINS took 0.8s. Estimated remaining: 4m 10s. Rate: 147.9 symbols/min [2025-09-29T22:14:04.699583] [INFO ] [MAIN ] PIPR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:04.699630] [INFO ] [MAIN ] PK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:04.699764] [INFO ] [MAIN ] PJT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:04.718778] [DEBUG] [LOCAL ] PIPR: Loaded 14914 existing records from primary storage. [2025-09-29T22:14:04.718922] [INFO ] [MAIN ] PIPR: Loaded 14914 primary data records. [2025-09-29T22:14:04.884393] [DEBUG] [LOCAL ] PJT: Loaded 21931 existing records from primary storage. [2025-09-29T22:14:04.920705] [INFO ] [MAIN ] PJT: Loaded 21931 primary data records. [2025-09-29T22:14:05.192669] [DEBUG] [LOCAL ] PK: Loaded 52830 existing records from primary storage. [2025-09-29T22:14:05.197490] [INFO ] [MAIN ] PK: Loaded 52830 primary data records. [2025-09-29T22:14:05.755907] [DEBUG] [MAIN ] PIPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:05.756741] [INFO ] [MAIN ] PIPR: Generated 1794 derivative records from 14914 primary records. [2025-09-29T22:14:05.757921] [DEBUG] [LOCAL ] PIPR: Saving derivative data. [2025-09-29T22:14:05.780412] [DEBUG] [LOCAL ] PIPR: Derivative data saved (1794 records). [2025-09-29T22:14:05.781507] [INFO ] [MAIN ] PIPR: Successfully saved derivative data. [2025-09-29T22:14:05.783936] [INFO ] [MAIN ] Derivative Progress: 1441/2057 symbols completed. PIPR took 1.1s. Estimated remaining: 4m 10s. Rate: 147.7 symbols/min [2025-09-29T22:14:05.792589] [INFO ] [MAIN ] PKE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:05.798383] [DEBUG] [MAIN ] PJT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:05.799287] [INFO ] [MAIN ] PJT: Generated 1794 derivative records from 21931 primary records. [2025-09-29T22:14:05.799548] [DEBUG] [LOCAL ] PJT: Saving derivative data. [2025-09-29T22:14:05.818434] [DEBUG] [LOCAL ] PJT: Derivative data saved (1794 records). [2025-09-29T22:14:05.818868] [INFO ] [MAIN ] PJT: Successfully saved derivative data. [2025-09-29T22:14:05.826743] [INFO ] [MAIN ] Derivative Progress: 1442/2057 symbols completed. PJT took 1.1s. Estimated remaining: 4m 10s. Rate: 147.8 symbols/min [2025-09-29T22:14:05.827126] [INFO ] [MAIN ] PKG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:05.846009] [DEBUG] [LOCAL ] PKE: Loaded 12743 existing records from primary storage. [2025-09-29T22:14:05.846488] [INFO ] [MAIN ] PKE: Loaded 12743 primary data records. [2025-09-29T22:14:05.846316] [DEBUG] [MAIN ] PK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:05.847347] [INFO ] [MAIN ] PK: Generated 1794 derivative records from 52830 primary records. [2025-09-29T22:14:05.868905] [DEBUG] [LOCAL ] PK: Saving derivative data. [2025-09-29T22:14:06.062762] [DEBUG] [LOCAL ] PK: Derivative data saved (1794 records). [2025-09-29T22:14:06.066564] [INFO ] [MAIN ] PK: Successfully saved derivative data. [2025-09-29T22:14:06.169195] [INFO ] [MAIN ] Derivative Progress: 1443/2057 symbols completed. PK took 1.5s. Estimated remaining: 4m 9s. Rate: 147.8 symbols/min [2025-09-29T22:14:06.231152] [INFO ] [MAIN ] PKST: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:06.245798] [DEBUG] [LOCAL ] PKG: Loaded 39062 existing records from primary storage. [2025-09-29T22:14:06.247228] [INFO ] [MAIN ] PKG: Loaded 39062 primary data records. [2025-09-29T22:14:06.374596] [DEBUG] [LOCAL ] PKST: Loaded 18985 existing records from primary storage. [2025-09-29T22:14:06.374844] [INFO ] [MAIN ] PKST: Loaded 18985 primary data records. [2025-09-29T22:14:06.925923] [DEBUG] [MAIN ] PKE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:06.926980] [INFO ] [MAIN ] PKE: Generated 1794 derivative records from 12743 primary records. [2025-09-29T22:14:06.928874] [DEBUG] [LOCAL ] PKE: Saving derivative data. [2025-09-29T22:14:06.951757] [DEBUG] [LOCAL ] PKE: Derivative data saved (1794 records). [2025-09-29T22:14:06.953356] [INFO ] [MAIN ] PKE: Successfully saved derivative data. [2025-09-29T22:14:06.956665] [INFO ] [MAIN ] Derivative Progress: 1444/2057 symbols completed. PKE took 1.2s. Estimated remaining: 4m 9s. Rate: 147.7 symbols/min [2025-09-29T22:14:06.958061] [INFO ] [MAIN ] PKX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:06.973119] [DEBUG] [MAIN ] PKG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:06.974528] [INFO ] [MAIN ] PKG: Generated 1794 derivative records from 39062 primary records. [2025-09-29T22:14:06.975144] [DEBUG] [LOCAL ] PKG: Saving derivative data. [2025-09-29T22:14:07.012087] [DEBUG] [MAIN ] PKST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:07.014017] [INFO ] [MAIN ] PKST: Generated 1794 derivative records from 18985 primary records. [2025-09-29T22:14:07.014454] [DEBUG] [LOCAL ] PKST: Saving derivative data. [2025-09-29T22:14:07.031103] [DEBUG] [LOCAL ] PKG: Derivative data saved (1794 records). [2025-09-29T22:14:07.040537] [DEBUG] [LOCAL ] PKX: Loaded 24464 existing records from primary storage. [2025-09-29T22:14:07.042124] [INFO ] [MAIN ] PKG: Successfully saved derivative data. [2025-09-29T22:14:07.041090] [INFO ] [MAIN ] PKX: Loaded 24464 primary data records. [2025-09-29T22:14:07.068432] [INFO ] [MAIN ] Derivative Progress: 1445/2057 symbols completed. PKG took 1.2s. Estimated remaining: 4m 9s. Rate: 147.8 symbols/min [2025-09-29T22:14:07.068686] [DEBUG] [LOCAL ] PKST: Derivative data saved (1794 records). [2025-09-29T22:14:07.093508] [INFO ] [MAIN ] PL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:07.114819] [INFO ] [MAIN ] PKST: Successfully saved derivative data. [2025-09-29T22:14:07.144735] [INFO ] [MAIN ] Derivative Progress: 1446/2057 symbols completed. PKST took 0.9s. Estimated remaining: 4m 8s. Rate: 147.8 symbols/min [2025-09-29T22:14:07.156196] [INFO ] [MAIN ] PLD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:07.411210] [DEBUG] [LOCAL ] PL: Loaded 53119 existing records from primary storage. [2025-09-29T22:14:07.411547] [INFO ] [MAIN ] PL: Loaded 53119 primary data records. [2025-09-29T22:14:07.544236] [DEBUG] [LOCAL ] PLD: Loaded 53437 existing records from primary storage. [2025-09-29T22:14:07.544437] [INFO ] [MAIN ] PLD: Loaded 53437 primary data records. [2025-09-29T22:14:07.642567] [DEBUG] [MAIN ] PKX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:07.662889] [INFO ] [MAIN ] PKX: Generated 1794 derivative records from 24464 primary records. [2025-09-29T22:14:07.682392] [DEBUG] [LOCAL ] PKX: Saving derivative data. [2025-09-29T22:14:08.151215] [DEBUG] [LOCAL ] PKX: Derivative data saved (1794 records). [2025-09-29T22:14:08.151460] [INFO ] [MAIN ] PKX: Successfully saved derivative data. [2025-09-29T22:14:08.154071] [INFO ] [MAIN ] Derivative Progress: 1447/2057 symbols completed. PKX took 1.2s. Estimated remaining: 4m 8s. Rate: 147.7 symbols/min [2025-09-29T22:14:08.154460] [INFO ] [MAIN ] PLNT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:08.180602] [DEBUG] [MAIN ] PL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:08.181701] [INFO ] [MAIN ] PL: Generated 1794 derivative records from 53119 primary records. [2025-09-29T22:14:08.181920] [DEBUG] [LOCAL ] PL: Saving derivative data. [2025-09-29T22:14:08.221899] [DEBUG] [MAIN ] PLD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:08.226899] [INFO ] [MAIN ] PLD: Generated 1794 derivative records from 53437 primary records. [2025-09-29T22:14:08.227032] [DEBUG] [LOCAL ] PLD: Saving derivative data. [2025-09-29T22:14:08.226010] [DEBUG] [LOCAL ] PL: Derivative data saved (1794 records). [2025-09-29T22:14:08.227187] [INFO ] [MAIN ] PL: Successfully saved derivative data. [2025-09-29T22:14:08.230242] [INFO ] [MAIN ] Derivative Progress: 1448/2057 symbols completed. PL took 1.1s. Estimated remaining: 4m 7s. Rate: 147.8 symbols/min [2025-09-29T22:14:08.230412] [INFO ] [MAIN ] PLOW: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:08.261787] [DEBUG] [LOCAL ] PLNT: Loaded 48343 existing records from primary storage. [2025-09-29T22:14:08.263765] [INFO ] [MAIN ] PLNT: Loaded 48343 primary data records. [2025-09-29T22:14:08.288617] [DEBUG] [LOCAL ] PLD: Derivative data saved (1794 records). [2025-09-29T22:14:08.299631] [INFO ] [MAIN ] PLD: Successfully saved derivative data. [2025-09-29T22:14:08.320218] [INFO ] [MAIN ] Derivative Progress: 1449/2057 symbols completed. PLD took 1.2s. Estimated remaining: 4m 7s. Rate: 147.9 symbols/min [2025-09-29T22:14:08.343782] [INFO ] [MAIN ] PLYM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:08.379413] [DEBUG] [LOCAL ] PLOW: Loaded 20412 existing records from primary storage. [2025-09-29T22:14:08.399431] [INFO ] [MAIN ] PLOW: Loaded 20412 primary data records. [2025-09-29T22:14:08.849347] [DEBUG] [LOCAL ] PLYM: Loaded 33468 existing records from primary storage. [2025-09-29T22:14:08.863395] [INFO ] [MAIN ] PLYM: Loaded 33468 primary data records. [2025-09-29T22:14:09.375429] [DEBUG] [MAIN ] PLNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:09.378000] [INFO ] [MAIN ] PLNT: Generated 1794 derivative records from 48343 primary records. [2025-09-29T22:14:09.378141] [DEBUG] [LOCAL ] PLNT: Saving derivative data. [2025-09-29T22:14:09.414336] [DEBUG] [MAIN ] PLOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:09.414924] [DEBUG] [LOCAL ] PLNT: Derivative data saved (1794 records). [2025-09-29T22:14:09.416048] [INFO ] [MAIN ] PLOW: Generated 1794 derivative records from 20412 primary records. [2025-09-29T22:14:09.416266] [DEBUG] [LOCAL ] PLOW: Saving derivative data. [2025-09-29T22:14:09.416349] [INFO ] [MAIN ] PLNT: Successfully saved derivative data. [2025-09-29T22:14:09.420281] [INFO ] [MAIN ] Derivative Progress: 1450/2057 symbols completed. PLNT took 1.3s. Estimated remaining: 4m 7s. Rate: 147.7 symbols/min [2025-09-29T22:14:09.420582] [INFO ] [MAIN ] PML: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:09.456124] [DEBUG] [LOCAL ] PLOW: Derivative data saved (1794 records). [2025-09-29T22:14:09.461533] [DEBUG] [MAIN ] PLYM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:09.461731] [INFO ] [MAIN ] PLOW: Successfully saved derivative data. [2025-09-29T22:14:09.464052] [INFO ] [MAIN ] Derivative Progress: 1451/2057 symbols completed. PLOW took 1.2s. Estimated remaining: 4m 6s. Rate: 147.8 symbols/min [2025-09-29T22:14:09.465095] [INFO ] [MAIN ] PLYM: Generated 1794 derivative records from 33468 primary records. [2025-09-29T22:14:09.465555] [DEBUG] [LOCAL ] PLYM: Saving derivative data. [2025-09-29T22:14:09.465406] [INFO ] [MAIN ] PMM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:09.493849] [DEBUG] [LOCAL ] PML: Loaded 20988 existing records from primary storage. [2025-09-29T22:14:09.494938] [DEBUG] [LOCAL ] PLYM: Derivative data saved (1794 records). [2025-09-29T22:14:09.497907] [INFO ] [MAIN ] PML: Loaded 20988 primary data records. [2025-09-29T22:14:09.503422] [INFO ] [MAIN ] PLYM: Successfully saved derivative data. [2025-09-29T22:14:09.512848] [INFO ] [MAIN ] Derivative Progress: 1452/2057 symbols completed. PLYM took 1.2s. Estimated remaining: 4m 5s. Rate: 147.9 symbols/min [2025-09-29T22:14:09.556705] [INFO ] [MAIN ] PMO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:09.580477] [DEBUG] [LOCAL ] PMM: Loaded 10617 existing records from primary storage. [2025-09-29T22:14:09.597480] [INFO ] [MAIN ] PMM: Loaded 10617 primary data records. [2025-09-29T22:14:09.787537] [DEBUG] [LOCAL ] PMO: Loaded 10477 existing records from primary storage. [2025-09-29T22:14:09.841671] [INFO ] [MAIN ] PMO: Loaded 10477 primary data records. [2025-09-29T22:14:10.584392] [DEBUG] [MAIN ] PML: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:10.585675] [INFO ] [MAIN ] PML: Generated 1794 derivative records from 20988 primary records. [2025-09-29T22:14:10.586322] [DEBUG] [LOCAL ] PML: Saving derivative data. [2025-09-29T22:14:10.612552] [DEBUG] [MAIN ] PMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:10.615896] [INFO ] [MAIN ] PMM: Generated 1794 derivative records from 10617 primary records. [2025-09-29T22:14:10.618433] [DEBUG] [LOCAL ] PMM: Saving derivative data. [2025-09-29T22:14:10.620468] [DEBUG] [LOCAL ] PML: Derivative data saved (1794 records). [2025-09-29T22:14:10.621033] [INFO ] [MAIN ] PML: Successfully saved derivative data. [2025-09-29T22:14:10.646797] [INFO ] [MAIN ] Derivative Progress: 1453/2057 symbols completed. PML took 1.2s. Estimated remaining: 4m 5s. Rate: 147.7 symbols/min [2025-09-29T22:14:10.648333] [DEBUG] [MAIN ] PMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:10.649056] [INFO ] [MAIN ] PMO: Generated 1794 derivative records from 10477 primary records. [2025-09-29T22:14:10.649148] [DEBUG] [LOCAL ] PMO: Saving derivative data. [2025-09-29T22:14:10.668941] [DEBUG] [LOCAL ] PMM: Derivative data saved (1794 records). [2025-09-29T22:14:10.669632] [DEBUG] [LOCAL ] PMO: Derivative data saved (1794 records). [2025-09-29T22:14:10.669781] [INFO ] [MAIN ] PMM: Successfully saved derivative data. [2025-09-29T22:14:10.669892] [INFO ] [MAIN ] PMO: Successfully saved derivative data. [2025-09-29T22:14:10.672207] [INFO ] [MAIN ] Derivative Progress: 1454/2057 symbols completed. PMO took 1.1s. Estimated remaining: 4m 5s. Rate: 147.8 symbols/min [2025-09-29T22:14:10.674611] [INFO ] [MAIN ] Derivative Progress: 1455/2057 symbols completed. PMM took 1.2s. Estimated remaining: 4m 4s. Rate: 147.9 symbols/min [2025-09-29T22:14:10.675196] [INFO ] [MAIN ] PNI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:10.675315] [INFO ] [MAIN ] PNNT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:10.675125] [INFO ] [MAIN ] PMT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:10.685781] [DEBUG] [LOCAL ] PNI: Loaded 6771 existing records from primary storage. [2025-09-29T22:14:10.685905] [INFO ] [MAIN ] PNI: Loaded 6771 primary data records. [2025-09-29T22:14:10.899514] [DEBUG] [LOCAL ] PNNT: Loaded 32747 existing records from primary storage. [2025-09-29T22:14:10.902821] [INFO ] [MAIN ] PNNT: Loaded 32747 primary data records. [2025-09-29T22:14:10.902692] [DEBUG] [LOCAL ] PMT: Loaded 40058 existing records from primary storage. [2025-09-29T22:14:11.054277] [INFO ] [MAIN ] PMT: Loaded 40058 primary data records. [2025-09-29T22:14:11.765706] [DEBUG] [MAIN ] PNI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:11.766743] [INFO ] [MAIN ] PNI: Generated 1794 derivative records from 6771 primary records. [2025-09-29T22:14:11.766847] [DEBUG] [LOCAL ] PNI: Saving derivative data. [2025-09-29T22:14:11.783969] [DEBUG] [LOCAL ] PNI: Derivative data saved (1794 records). [2025-09-29T22:14:11.784466] [INFO ] [MAIN ] PNI: Successfully saved derivative data. [2025-09-29T22:14:11.786511] [INFO ] [MAIN ] Derivative Progress: 1456/2057 symbols completed. PNI took 1.1s. Estimated remaining: 4m 4s. Rate: 147.7 symbols/min [2025-09-29T22:14:11.787039] [INFO ] [MAIN ] PNW: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:11.806413] [DEBUG] [MAIN ] PNNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:11.807478] [INFO ] [MAIN ] PNNT: Generated 1794 derivative records from 32747 primary records. [2025-09-29T22:14:11.807814] [DEBUG] [LOCAL ] PNNT: Saving derivative data. [2025-09-29T22:14:11.855962] [DEBUG] [LOCAL ] PNNT: Derivative data saved (1794 records). [2025-09-29T22:14:11.856378] [DEBUG] [MAIN ] PMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:11.856446] [INFO ] [MAIN ] PNNT: Successfully saved derivative data. [2025-09-29T22:14:11.857311] [INFO ] [MAIN ] PMT: Generated 1794 derivative records from 40058 primary records. [2025-09-29T22:14:11.859522] [INFO ] [MAIN ] Derivative Progress: 1457/2057 symbols completed. PNNT took 1.2s. Estimated remaining: 4m 4s. Rate: 147.8 symbols/min [2025-09-29T22:14:11.859863] [DEBUG] [LOCAL ] PMT: Saving derivative data. [2025-09-29T22:14:11.860433] [INFO ] [MAIN ] POR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:11.890468] [DEBUG] [LOCAL ] PMT: Derivative data saved (1794 records). [2025-09-29T22:14:11.890622] [INFO ] [MAIN ] PMT: Successfully saved derivative data. [2025-09-29T22:14:11.892846] [INFO ] [MAIN ] Derivative Progress: 1458/2057 symbols completed. PMT took 1.2s. Estimated remaining: 4m 3s. Rate: 147.9 symbols/min [2025-09-29T22:14:11.893102] [INFO ] [MAIN ] POST: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:11.917175] [DEBUG] [LOCAL ] PNW: Loaded 45786 existing records from primary storage. [2025-09-29T22:14:11.917794] [INFO ] [MAIN ] PNW: Loaded 45786 primary data records. [2025-09-29T22:14:12.272255] [DEBUG] [LOCAL ] POR: Loaded 46997 existing records from primary storage. [2025-09-29T22:14:12.286850] [DEBUG] [LOCAL ] POST: Loaded 38818 existing records from primary storage. [2025-09-29T22:14:12.287136] [INFO ] [MAIN ] POST: Loaded 38818 primary data records. [2025-09-29T22:14:12.286958] [INFO ] [MAIN ] POR: Loaded 46997 primary data records. [2025-09-29T22:14:12.990782] [DEBUG] [MAIN ] PNW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:12.992592] [INFO ] [MAIN ] PNW: Generated 1794 derivative records from 45786 primary records. [2025-09-29T22:14:12.992822] [DEBUG] [LOCAL ] PNW: Saving derivative data. [2025-09-29T22:14:13.015404] [DEBUG] [LOCAL ] PNW: Derivative data saved (1794 records). [2025-09-29T22:14:13.015831] [INFO ] [MAIN ] PNW: Successfully saved derivative data. [2025-09-29T22:14:13.018235] [INFO ] [MAIN ] Derivative Progress: 1459/2057 symbols completed. PNW took 1.2s. Estimated remaining: 4m 3s. Rate: 147.7 symbols/min [2025-09-29T22:14:13.018562] [INFO ] [MAIN ] PPG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:13.047701] [DEBUG] [MAIN ] POR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:13.054056] [INFO ] [MAIN ] POR: Generated 1794 derivative records from 46997 primary records. [2025-09-29T22:14:13.054687] [DEBUG] [LOCAL ] POR: Saving derivative data. [2025-09-29T22:14:13.054411] [DEBUG] [MAIN ] POST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:13.055542] [INFO ] [MAIN ] POST: Generated 1794 derivative records from 38818 primary records. [2025-09-29T22:14:13.056542] [DEBUG] [LOCAL ] POST: Saving derivative data. [2025-09-29T22:14:13.104715] [DEBUG] [LOCAL ] POST: Derivative data saved (1794 records). [2025-09-29T22:14:13.105389] [INFO ] [MAIN ] POST: Successfully saved derivative data. [2025-09-29T22:14:13.108505] [INFO ] [MAIN ] Derivative Progress: 1460/2057 symbols completed. POST took 1.2s. Estimated remaining: 4m 2s. Rate: 147.8 symbols/min [2025-09-29T22:14:13.109535] [INFO ] [MAIN ] PPT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:13.109379] [DEBUG] [LOCAL ] POR: Derivative data saved (1794 records). [2025-09-29T22:14:13.109855] [INFO ] [MAIN ] POR: Successfully saved derivative data. [2025-09-29T22:14:13.112285] [INFO ] [MAIN ] Derivative Progress: 1461/2057 symbols completed. POR took 1.3s. Estimated remaining: 4m 2s. Rate: 147.9 symbols/min [2025-09-29T22:14:13.112619] [INFO ] [MAIN ] PR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:13.131967] [DEBUG] [LOCAL ] PPG: Loaded 50704 existing records from primary storage. [2025-09-29T22:14:13.132287] [INFO ] [MAIN ] PPG: Loaded 50704 primary data records. [2025-09-29T22:14:13.258617] [DEBUG] [LOCAL ] PPT: Loaded 19892 existing records from primary storage. [2025-09-29T22:14:13.269690] [INFO ] [MAIN ] PPT: Loaded 19892 primary data records. [2025-09-29T22:14:13.636743] [DEBUG] [LOCAL ] PR: Loaded 53609 existing records from primary storage. [2025-09-29T22:14:13.648201] [INFO ] [MAIN ] PR: Loaded 53609 primary data records. [2025-09-29T22:14:14.176969] [DEBUG] [MAIN ] PPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:14.178004] [INFO ] [MAIN ] PPG: Generated 1794 derivative records from 50704 primary records. [2025-09-29T22:14:14.178367] [DEBUG] [LOCAL ] PPG: Saving derivative data. [2025-09-29T22:14:14.198164] [DEBUG] [LOCAL ] PPG: Derivative data saved (1794 records). [2025-09-29T22:14:14.199416] [INFO ] [MAIN ] PPG: Successfully saved derivative data. [2025-09-29T22:14:14.202767] [INFO ] [MAIN ] Derivative Progress: 1462/2057 symbols completed. PPG took 1.2s. Estimated remaining: 4m 2s. Rate: 147.7 symbols/min [2025-09-29T22:14:14.202983] [INFO ] [MAIN ] PRA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:14.217551] [DEBUG] [MAIN ] PPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:14.219193] [INFO ] [MAIN ] PPT: Generated 1794 derivative records from 19892 primary records. [2025-09-29T22:14:14.219387] [DEBUG] [LOCAL ] PPT: Saving derivative data. [2025-09-29T22:14:14.236241] [DEBUG] [LOCAL ] PPT: Derivative data saved (1794 records). [2025-09-29T22:14:14.236391] [INFO ] [MAIN ] PPT: Successfully saved derivative data. [2025-09-29T22:14:14.238542] [INFO ] [MAIN ] Derivative Progress: 1463/2057 symbols completed. PPT took 1.1s. Estimated remaining: 4m 1s. Rate: 147.8 symbols/min [2025-09-29T22:14:14.238885] [INFO ] [MAIN ] PRG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:14.265347] [DEBUG] [MAIN ] PR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:14.266157] [INFO ] [MAIN ] PR: Generated 1794 derivative records from 53609 primary records. [2025-09-29T22:14:14.266383] [DEBUG] [LOCAL ] PR: Saving derivative data. [2025-09-29T22:14:14.291362] [DEBUG] [LOCAL ] PRA: Loaded 34933 existing records from primary storage. [2025-09-29T22:14:14.292312] [INFO ] [MAIN ] PRA: Loaded 34933 primary data records. [2025-09-29T22:14:14.384751] [DEBUG] [LOCAL ] PR: Derivative data saved (1794 records). [2025-09-29T22:14:14.402872] [INFO ] [MAIN ] PR: Successfully saved derivative data. [2025-09-29T22:14:14.410781] [INFO ] [MAIN ] Derivative Progress: 1464/2057 symbols completed. PR took 1.3s. Estimated remaining: 4m 1s. Rate: 147.9 symbols/min [2025-09-29T22:14:14.420554] [INFO ] [MAIN ] PRGO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:14.420393] [DEBUG] [LOCAL ] PRG: Loaded 29834 existing records from primary storage. [2025-09-29T22:14:14.433584] [INFO ] [MAIN ] PRG: Loaded 29834 primary data records. [2025-09-29T22:14:15.019886] [DEBUG] [LOCAL ] PRGO: Loaded 46914 existing records from primary storage. [2025-09-29T22:14:15.021419] [INFO ] [MAIN ] PRGO: Loaded 46914 primary data records. [2025-09-29T22:14:15.369465] [DEBUG] [MAIN ] PRA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:15.372238] [INFO ] [MAIN ] PRA: Generated 1794 derivative records from 34933 primary records. [2025-09-29T22:14:15.373057] [DEBUG] [LOCAL ] PRA: Saving derivative data. [2025-09-29T22:14:15.398467] [DEBUG] [MAIN ] PRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:15.403427] [INFO ] [MAIN ] PRG: Generated 1794 derivative records from 29834 primary records. [2025-09-29T22:14:15.404310] [DEBUG] [LOCAL ] PRG: Saving derivative data. [2025-09-29T22:14:15.418668] [DEBUG] [LOCAL ] PRA: Derivative data saved (1794 records). [2025-09-29T22:14:15.423158] [INFO ] [MAIN ] PRA: Successfully saved derivative data. [2025-09-29T22:14:15.425254] [INFO ] [MAIN ] Derivative Progress: 1465/2057 symbols completed. PRA took 1.2s. Estimated remaining: 4m 0s. Rate: 147.7 symbols/min [2025-09-29T22:14:15.426277] [INFO ] [MAIN ] PRH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:15.432889] [DEBUG] [LOCAL ] PRG: Derivative data saved (1794 records). [2025-09-29T22:14:15.434460] [INFO ] [MAIN ] PRG: Successfully saved derivative data. [2025-09-29T22:14:15.436681] [INFO ] [MAIN ] Derivative Progress: 1466/2057 symbols completed. PRG took 1.2s. Estimated remaining: 3m 60s. Rate: 147.8 symbols/min [2025-09-29T22:14:15.436907] [INFO ] [MAIN ] PRI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:15.441117] [DEBUG] [LOCAL ] PRH: Loaded 4770 existing records from primary storage. [2025-09-29T22:14:15.441364] [INFO ] [MAIN ] PRH: Loaded 4770 primary data records. [2025-09-29T22:14:15.583111] [DEBUG] [LOCAL ] PRI: Loaded 18275 existing records from primary storage. [2025-09-29T22:14:15.582672] [DEBUG] [MAIN ] PRGO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:15.595014] [INFO ] [MAIN ] PRGO: Generated 1794 derivative records from 46914 primary records. [2025-09-29T22:14:15.595133] [DEBUG] [LOCAL ] PRGO: Saving derivative data. [2025-09-29T22:14:15.583749] [INFO ] [MAIN ] PRI: Loaded 18275 primary data records. [2025-09-29T22:14:15.943329] [DEBUG] [LOCAL ] PRGO: Derivative data saved (1794 records). [2025-09-29T22:14:15.948904] [INFO ] [MAIN ] PRGO: Successfully saved derivative data. [2025-09-29T22:14:15.965749] [INFO ] [MAIN ] Derivative Progress: 1467/2057 symbols completed. PRGO took 1.5s. Estimated remaining: 3m 60s. Rate: 147.8 symbols/min [2025-09-29T22:14:16.002549] [INFO ] [MAIN ] PRIM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:16.155260] [DEBUG] [MAIN ] PRH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:16.156131] [INFO ] [MAIN ] PRH: Generated 1794 derivative records from 4770 primary records. [2025-09-29T22:14:16.156421] [DEBUG] [LOCAL ] PRH: Saving derivative data. [2025-09-29T22:14:16.188557] [DEBUG] [LOCAL ] PRH: Derivative data saved (1794 records). [2025-09-29T22:14:16.202419] [INFO ] [MAIN ] PRH: Successfully saved derivative data. [2025-09-29T22:14:16.205798] [DEBUG] [MAIN ] PRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:16.205283] [INFO ] [MAIN ] Derivative Progress: 1468/2057 symbols completed. PRH took 0.8s. Estimated remaining: 3m 59s. Rate: 147.8 symbols/min [2025-09-29T22:14:16.206761] [INFO ] [MAIN ] PRI: Generated 1794 derivative records from 18275 primary records. [2025-09-29T22:14:16.206947] [DEBUG] [LOCAL ] PRI: Saving derivative data. [2025-09-29T22:14:16.234631] [DEBUG] [LOCAL ] PRIM: Loaded 44317 existing records from primary storage. [2025-09-29T22:14:16.235462] [INFO ] [MAIN ] PRIM: Loaded 44317 primary data records. [2025-09-29T22:14:16.339738] [DEBUG] [LOCAL ] PRI: Derivative data saved (1794 records). [2025-09-29T22:14:16.339930] [INFO ] [MAIN ] PRI: Successfully saved derivative data. [2025-09-29T22:14:16.342172] [INFO ] [MAIN ] Derivative Progress: 1469/2057 symbols completed. PRI took 0.9s. Estimated remaining: 3m 59s. Rate: 147.9 symbols/min [2025-09-29T22:14:16.594391] [DEBUG] [MAIN ] PRIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:16.595213] [INFO ] [MAIN ] PRIM: Generated 1794 derivative records from 44317 primary records. [2025-09-29T22:14:16.595281] [DEBUG] [LOCAL ] PRIM: Saving derivative data. [2025-09-29T22:14:16.611355] [DEBUG] [LOCAL ] PRIM: Derivative data saved (1794 records). [2025-09-29T22:14:16.611457] [INFO ] [MAIN ] PRIM: Successfully saved derivative data. [2025-09-29T22:14:16.613611] [INFO ] [MAIN ] Derivative Progress: 1470/2057 symbols completed. PRIM took 0.6s. Estimated remaining: 3m 58s. Rate: 147.9 symbols/min [2025-09-29T22:14:16.614425] [INFO ] [MAIN ] PRM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:16.614511] [INFO ] [MAIN ] PRLB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:16.614327] [INFO ] [MAIN ] PRKS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:16.640595] [DEBUG] [LOCAL ] PRLB: Loaded 20527 existing records from primary storage. [2025-09-29T22:14:16.661769] [INFO ] [MAIN ] PRLB: Loaded 20527 primary data records. [2025-09-29T22:14:16.780093] [DEBUG] [LOCAL ] PRKS: Loaded 42559 existing records from primary storage. [2025-09-29T22:14:16.807537] [INFO ] [MAIN ] PRKS: Loaded 42559 primary data records. [2025-09-29T22:14:16.814000] [DEBUG] [LOCAL ] PRM: Loaded 44611 existing records from primary storage. [2025-09-29T22:14:16.831301] [INFO ] [MAIN ] PRM: Loaded 44611 primary data records. [2025-09-29T22:14:17.700239] [DEBUG] [MAIN ] PRLB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:17.701797] [INFO ] [MAIN ] PRLB: Generated 1794 derivative records from 20527 primary records. [2025-09-29T22:14:17.702957] [DEBUG] [LOCAL ] PRLB: Saving derivative data. [2025-09-29T22:14:17.762473] [DEBUG] [MAIN ] PRM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:17.763921] [DEBUG] [MAIN ] PRKS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:17.765876] [INFO ] [MAIN ] PRKS: Generated 1794 derivative records from 42559 primary records. [2025-09-29T22:14:17.763408] [DEBUG] [LOCAL ] PRLB: Derivative data saved (1794 records). [2025-09-29T22:14:17.766070] [INFO ] [MAIN ] PRLB: Successfully saved derivative data. [2025-09-29T22:14:17.765048] [INFO ] [MAIN ] PRM: Generated 1794 derivative records from 44611 primary records. [2025-09-29T22:14:17.768480] [DEBUG] [LOCAL ] PRM: Saving derivative data. [2025-09-29T22:14:17.766159] [DEBUG] [LOCAL ] PRKS: Saving derivative data. [2025-09-29T22:14:17.768374] [INFO ] [MAIN ] Derivative Progress: 1471/2057 symbols completed. PRLB took 1.2s. Estimated remaining: 3m 58s. Rate: 147.7 symbols/min [2025-09-29T22:14:17.770176] [INFO ] [MAIN ] PRMB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:17.803063] [DEBUG] [LOCAL ] PRKS: Derivative data saved (1794 records). [2025-09-29T22:14:17.803468] [INFO ] [MAIN ] PRKS: Successfully saved derivative data. [2025-09-29T22:14:17.807407] [INFO ] [MAIN ] Derivative Progress: 1472/2057 symbols completed. PRKS took 1.2s. Estimated remaining: 3m 57s. Rate: 147.8 symbols/min [2025-09-29T22:14:17.808127] [INFO ] [MAIN ] PRO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:17.809475] [DEBUG] [LOCAL ] PRM: Derivative data saved (1794 records). [2025-09-29T22:14:17.809684] [INFO ] [MAIN ] PRM: Successfully saved derivative data. [2025-09-29T22:14:17.811794] [INFO ] [MAIN ] Derivative Progress: 1473/2057 symbols completed. PRM took 1.2s. Estimated remaining: 3m 57s. Rate: 147.9 symbols/min [2025-09-29T22:14:17.812085] [INFO ] [MAIN ] PRT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:17.821000] [DEBUG] [LOCAL ] PRT: Loaded 5310 existing records from primary storage. [2025-09-29T22:14:17.821204] [INFO ] [MAIN ] PRT: Loaded 5310 primary data records. [2025-09-29T22:14:18.000899] [DEBUG] [LOCAL ] PRMB: Loaded 53145 existing records from primary storage. [2025-09-29T22:14:18.058731] [INFO ] [MAIN ] PRMB: Loaded 53145 primary data records. [2025-09-29T22:14:18.232581] [DEBUG] [LOCAL ] PRO: Loaded 38051 existing records from primary storage. [2025-09-29T22:14:18.257707] [INFO ] [MAIN ] PRO: Loaded 38051 primary data records. [2025-09-29T22:14:18.889146] [DEBUG] [MAIN ] PRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:18.892690] [INFO ] [MAIN ] PRT: Generated 1794 derivative records from 5310 primary records. [2025-09-29T22:14:18.893376] [DEBUG] [LOCAL ] PRT: Saving derivative data. [2025-09-29T22:14:18.912971] [DEBUG] [LOCAL ] PRT: Derivative data saved (1794 records). [2025-09-29T22:14:18.913632] [INFO ] [MAIN ] PRT: Successfully saved derivative data. [2025-09-29T22:14:18.915786] [INFO ] [MAIN ] Derivative Progress: 1474/2057 symbols completed. PRT took 1.1s. Estimated remaining: 3m 57s. Rate: 147.7 symbols/min [2025-09-29T22:14:18.916054] [INFO ] [MAIN ] PRU: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:18.938124] [DEBUG] [MAIN ] PRMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:18.951633] [DEBUG] [MAIN ] PRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:18.953169] [INFO ] [MAIN ] PRO: Generated 1794 derivative records from 38051 primary records. [2025-09-29T22:14:18.952468] [INFO ] [MAIN ] PRMB: Generated 1794 derivative records from 53145 primary records. [2025-09-29T22:14:18.953330] [DEBUG] [LOCAL ] PRMB: Saving derivative data. [2025-09-29T22:14:18.953818] [DEBUG] [LOCAL ] PRO: Saving derivative data. [2025-09-29T22:14:18.988155] [DEBUG] [LOCAL ] PRO: Derivative data saved (1794 records). [2025-09-29T22:14:18.989069] [INFO ] [MAIN ] PRO: Successfully saved derivative data. [2025-09-29T22:14:18.991378] [INFO ] [MAIN ] Derivative Progress: 1475/2057 symbols completed. PRO took 1.2s. Estimated remaining: 3m 56s. Rate: 147.8 symbols/min [2025-09-29T22:14:18.991971] [DEBUG] [LOCAL ] PRMB: Derivative data saved (1794 records). [2025-09-29T22:14:18.992111] [INFO ] [MAIN ] PSA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:18.992623] [INFO ] [MAIN ] PRMB: Successfully saved derivative data. [2025-09-29T22:14:18.994840] [INFO ] [MAIN ] Derivative Progress: 1476/2057 symbols completed. PRMB took 1.2s. Estimated remaining: 3m 56s. Rate: 147.9 symbols/min [2025-09-29T22:14:18.995290] [INFO ] [MAIN ] PSBD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:19.019356] [DEBUG] [LOCAL ] PSBD: Loaded 7045 existing records from primary storage. [2025-09-29T22:14:19.019590] [INFO ] [MAIN ] PSBD: Loaded 7045 primary data records. [2025-09-29T22:14:19.151776] [DEBUG] [LOCAL ] PRU: Loaded 51419 existing records from primary storage. [2025-09-29T22:14:19.162958] [INFO ] [MAIN ] PRU: Loaded 51419 primary data records. [2025-09-29T22:14:19.489316] [DEBUG] [LOCAL ] PSA: Loaded 41781 existing records from primary storage. [2025-09-29T22:14:19.495623] [INFO ] [MAIN ] PSA: Loaded 41781 primary data records. [2025-09-29T22:14:20.045080] [DEBUG] [MAIN ] PSBD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:14:20.049023] [INFO ] [MAIN ] PSBD: Generated 1793 derivative records from 7045 primary records. [2025-09-29T22:14:20.049715] [DEBUG] [LOCAL ] PSBD: Saving derivative data. [2025-09-29T22:14:20.067087] [DEBUG] [MAIN ] PRU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:20.078927] [INFO ] [MAIN ] PRU: Generated 1794 derivative records from 51419 primary records. [2025-09-29T22:14:20.079667] [DEBUG] [LOCAL ] PRU: Saving derivative data. [2025-09-29T22:14:20.098767] [DEBUG] [LOCAL ] PSBD: Derivative data saved (1793 records). [2025-09-29T22:14:20.100294] [INFO ] [MAIN ] PSBD: Successfully saved derivative data. [2025-09-29T22:14:20.102277] [INFO ] [MAIN ] Derivative Progress: 1477/2057 symbols completed. PSBD took 1.1s. Estimated remaining: 3m 56s. Rate: 147.8 symbols/min [2025-09-29T22:14:20.103986] [INFO ] [MAIN ] PSF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:20.122789] [DEBUG] [LOCAL ] PRU: Derivative data saved (1794 records). [2025-09-29T22:14:20.123507] [DEBUG] [MAIN ] PSA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:20.123561] [INFO ] [MAIN ] PRU: Successfully saved derivative data. [2025-09-29T22:14:20.124353] [INFO ] [MAIN ] PSA: Generated 1794 derivative records from 41781 primary records. [2025-09-29T22:14:20.124460] [DEBUG] [LOCAL ] PSA: Saving derivative data. [2025-09-29T22:14:20.127366] [INFO ] [MAIN ] Derivative Progress: 1478/2057 symbols completed. PRU took 1.2s. Estimated remaining: 3m 55s. Rate: 147.8 symbols/min [2025-09-29T22:14:20.141578] [INFO ] [MAIN ] PSFE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:20.146898] [DEBUG] [LOCAL ] PSF: Loaded 6845 existing records from primary storage. [2025-09-29T22:14:20.148366] [INFO ] [MAIN ] PSF: Loaded 6845 primary data records. [2025-09-29T22:14:20.242628] [DEBUG] [LOCAL ] PSA: Derivative data saved (1794 records). [2025-09-29T22:14:20.274807] [INFO ] [MAIN ] PSA: Successfully saved derivative data. [2025-09-29T22:14:20.277559] [INFO ] [MAIN ] Derivative Progress: 1479/2057 symbols completed. PSA took 1.3s. Estimated remaining: 3m 54s. Rate: 147.9 symbols/min [2025-09-29T22:14:20.283787] [INFO ] [MAIN ] PSN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:20.348633] [DEBUG] [LOCAL ] PSFE: Loaded 30137 existing records from primary storage. [2025-09-29T22:14:20.351800] [INFO ] [MAIN ] PSFE: Loaded 30137 primary data records. [2025-09-29T22:14:20.713575] [DEBUG] [LOCAL ] PSN: Loaded 46058 existing records from primary storage. [2025-09-29T22:14:20.733768] [INFO ] [MAIN ] PSN: Loaded 46058 primary data records. [2025-09-29T22:14:21.238850] [DEBUG] [MAIN ] PSF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:21.240462] [INFO ] [MAIN ] PSF: Generated 1794 derivative records from 6845 primary records. [2025-09-29T22:14:21.240869] [DEBUG] [LOCAL ] PSF: Saving derivative data. [2025-09-29T22:14:21.279904] [DEBUG] [MAIN ] PSFE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:21.279542] [DEBUG] [LOCAL ] PSF: Derivative data saved (1794 records). [2025-09-29T22:14:21.281010] [INFO ] [MAIN ] PSF: Successfully saved derivative data. [2025-09-29T22:14:21.280933] [INFO ] [MAIN ] PSFE: Generated 1794 derivative records from 30137 primary records. [2025-09-29T22:14:21.281233] [DEBUG] [LOCAL ] PSFE: Saving derivative data. [2025-09-29T22:14:21.283477] [INFO ] [MAIN ] Derivative Progress: 1480/2057 symbols completed. PSF took 1.2s. Estimated remaining: 3m 54s. Rate: 147.8 symbols/min [2025-09-29T22:14:21.284717] [INFO ] [MAIN ] PSO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:21.302469] [DEBUG] [LOCAL ] PSFE: Derivative data saved (1794 records). [2025-09-29T22:14:21.304580] [INFO ] [MAIN ] PSFE: Successfully saved derivative data. [2025-09-29T22:14:21.306729] [INFO ] [MAIN ] Derivative Progress: 1481/2057 symbols completed. PSFE took 1.2s. Estimated remaining: 3m 54s. Rate: 147.9 symbols/min [2025-09-29T22:14:21.307872] [INFO ] [MAIN ] PSQH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:21.322392] [DEBUG] [MAIN ] PSN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:21.323164] [INFO ] [MAIN ] PSN: Generated 1794 derivative records from 46058 primary records. [2025-09-29T22:14:21.323322] [DEBUG] [LOCAL ] PSN: Saving derivative data. [2025-09-29T22:14:21.341277] [DEBUG] [LOCAL ] PSN: Derivative data saved (1794 records). [2025-09-29T22:14:21.341475] [INFO ] [MAIN ] PSN: Successfully saved derivative data. [2025-09-29T22:14:21.343479] [INFO ] [MAIN ] Derivative Progress: 1482/2057 symbols completed. PSN took 1.1s. Estimated remaining: 3m 53s. Rate: 147.9 symbols/min [2025-09-29T22:14:21.352806] [INFO ] [MAIN ] PSTG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:21.381046] [DEBUG] [LOCAL ] PSQH: Loaded 34827 existing records from primary storage. [2025-09-29T22:14:21.381258] [INFO ] [MAIN ] PSQH: Loaded 34827 primary data records. [2025-09-29T22:14:21.497410] [DEBUG] [LOCAL ] PSO: Loaded 37066 existing records from primary storage. [2025-09-29T22:14:21.540458] [INFO ] [MAIN ] PSO: Loaded 37066 primary data records. [2025-09-29T22:14:21.885162] [DEBUG] [LOCAL ] PSTG: Loaded 52845 existing records from primary storage. [2025-09-29T22:14:21.902136] [INFO ] [MAIN ] PSTG: Loaded 52845 primary data records. [2025-09-29T22:14:22.439665] [DEBUG] [MAIN ] PSQH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:22.440934] [INFO ] [MAIN ] PSQH: Generated 1794 derivative records from 34827 primary records. [2025-09-29T22:14:22.441293] [DEBUG] [LOCAL ] PSQH: Saving derivative data. [2025-09-29T22:14:22.473810] [DEBUG] [MAIN ] PSO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:22.475842] [INFO ] [MAIN ] PSO: Generated 1794 derivative records from 37066 primary records. [2025-09-29T22:14:22.476234] [DEBUG] [LOCAL ] PSO: Saving derivative data. [2025-09-29T22:14:22.478086] [DEBUG] [LOCAL ] PSQH: Derivative data saved (1794 records). [2025-09-29T22:14:22.478457] [INFO ] [MAIN ] PSQH: Successfully saved derivative data. [2025-09-29T22:14:22.487709] [INFO ] [MAIN ] Derivative Progress: 1483/2057 symbols completed. PSQH took 1.2s. Estimated remaining: 3m 53s. Rate: 147.8 symbols/min [2025-09-29T22:14:22.511684] [DEBUG] [LOCAL ] PSO: Derivative data saved (1794 records). [2025-09-29T22:14:22.511588] [DEBUG] [MAIN ] PSTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:22.511809] [INFO ] [MAIN ] PSO: Successfully saved derivative data. [2025-09-29T22:14:22.512463] [INFO ] [MAIN ] PSTG: Generated 1794 derivative records from 52845 primary records. [2025-09-29T22:14:22.514401] [INFO ] [MAIN ] Derivative Progress: 1484/2057 symbols completed. PSO took 1.2s. Estimated remaining: 3m 53s. Rate: 147.9 symbols/min [2025-09-29T22:14:22.514520] [DEBUG] [LOCAL ] PSTG: Saving derivative data. [2025-09-29T22:14:22.530675] [DEBUG] [LOCAL ] PSTG: Derivative data saved (1794 records). [2025-09-29T22:14:22.530764] [INFO ] [MAIN ] PSTG: Successfully saved derivative data. [2025-09-29T22:14:22.532803] [INFO ] [MAIN ] Derivative Progress: 1485/2057 symbols completed. PSTG took 1.2s. Estimated remaining: 3m 52s. Rate: 148.0 symbols/min [2025-09-29T22:14:22.533260] [INFO ] [MAIN ] PSTL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:22.533466] [INFO ] [MAIN ] PSX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:22.533389] [INFO ] [MAIN ] PTA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:22.568709] [DEBUG] [LOCAL ] PTA: Loaded 14948 existing records from primary storage. [2025-09-29T22:14:22.569201] [DEBUG] [LOCAL ] PSTL: Loaded 20077 existing records from primary storage. [2025-09-29T22:14:22.569496] [INFO ] [MAIN ] PSTL: Loaded 20077 primary data records. [2025-09-29T22:14:22.569613] [INFO ] [MAIN ] PTA: Loaded 14948 primary data records. [2025-09-29T22:14:22.887613] [DEBUG] [LOCAL ] PSX: Loaded 53131 existing records from primary storage. [2025-09-29T22:14:22.965493] [INFO ] [MAIN ] PSX: Loaded 53131 primary data records. [2025-09-29T22:14:23.664561] [DEBUG] [MAIN ] PTA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:23.666859] [INFO ] [MAIN ] PTA: Generated 1794 derivative records from 14948 primary records. [2025-09-29T22:14:23.669702] [DEBUG] [LOCAL ] PTA: Saving derivative data. [2025-09-29T22:14:23.701023] [DEBUG] [MAIN ] PSTL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:23.702987] [INFO ] [MAIN ] PSTL: Generated 1794 derivative records from 20077 primary records. [2025-09-29T22:14:23.703157] [DEBUG] [LOCAL ] PSTL: Saving derivative data. [2025-09-29T22:14:23.726816] [DEBUG] [LOCAL ] PSTL: Derivative data saved (1794 records). [2025-09-29T22:14:23.733833] [INFO ] [MAIN ] PSTL: Successfully saved derivative data. [2025-09-29T22:14:23.743337] [DEBUG] [MAIN ] PSX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:23.742933] [DEBUG] [LOCAL ] PTA: Derivative data saved (1794 records). [2025-09-29T22:14:23.743508] [INFO ] [MAIN ] PTA: Successfully saved derivative data. [2025-09-29T22:14:23.747128] [INFO ] [MAIN ] PSX: Generated 1794 derivative records from 53131 primary records. [2025-09-29T22:14:23.745943] [INFO ] [MAIN ] Derivative Progress: 1486/2057 symbols completed. PSTL took 1.2s. Estimated remaining: 3m 52s. Rate: 147.8 symbols/min [2025-09-29T22:14:23.749966] [INFO ] [MAIN ] PTY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:23.750221] [DEBUG] [LOCAL ] PSX: Saving derivative data. [2025-09-29T22:14:23.750753] [INFO ] [MAIN ] Derivative Progress: 1487/2057 symbols completed. PTA took 1.2s. Estimated remaining: 3m 51s. Rate: 147.9 symbols/min [2025-09-29T22:14:23.752267] [INFO ] [MAIN ] PUK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:23.772717] [DEBUG] [LOCAL ] PSX: Derivative data saved (1794 records). [2025-09-29T22:14:23.772866] [INFO ] [MAIN ] PSX: Successfully saved derivative data. [2025-09-29T22:14:23.775275] [INFO ] [MAIN ] Derivative Progress: 1488/2057 symbols completed. PSX took 1.2s. Estimated remaining: 3m 51s. Rate: 147.9 symbols/min [2025-09-29T22:14:23.775593] [INFO ] [MAIN ] PUMP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:23.829836] [DEBUG] [LOCAL ] PTY: Loaded 37300 existing records from primary storage. [2025-09-29T22:14:23.830070] [INFO ] [MAIN ] PTY: Loaded 37300 primary data records. [2025-09-29T22:14:23.976404] [DEBUG] [LOCAL ] PUK: Loaded 44780 existing records from primary storage. [2025-09-29T22:14:23.993566] [INFO ] [MAIN ] PUK: Loaded 44780 primary data records. [2025-09-29T22:14:24.018809] [DEBUG] [LOCAL ] PUMP: Loaded 49364 existing records from primary storage. [2025-09-29T22:14:24.024323] [INFO ] [MAIN ] PUMP: Loaded 49364 primary data records. [2025-09-29T22:14:24.879841] [DEBUG] [MAIN ] PTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:24.883243] [INFO ] [MAIN ] PTY: Generated 1794 derivative records from 37300 primary records. [2025-09-29T22:14:24.885502] [DEBUG] [LOCAL ] PTY: Saving derivative data. [2025-09-29T22:14:24.915976] [DEBUG] [MAIN ] PUK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:24.917379] [DEBUG] [LOCAL ] PTY: Derivative data saved (1794 records). [2025-09-29T22:14:24.918416] [INFO ] [MAIN ] PUK: Generated 1794 derivative records from 44780 primary records. [2025-09-29T22:14:24.917533] [INFO ] [MAIN ] PTY: Successfully saved derivative data. [2025-09-29T22:14:24.924454] [INFO ] [MAIN ] Derivative Progress: 1489/2057 symbols completed. PTY took 1.2s. Estimated remaining: 3m 51s. Rate: 147.8 symbols/min [2025-09-29T22:14:24.924359] [DEBUG] [LOCAL ] PUK: Saving derivative data. [2025-09-29T22:14:24.924890] [INFO ] [MAIN ] PVH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:24.949010] [DEBUG] [LOCAL ] PUK: Derivative data saved (1794 records). [2025-09-29T22:14:24.949411] [INFO ] [MAIN ] PUK: Successfully saved derivative data. [2025-09-29T22:14:24.951706] [INFO ] [MAIN ] Derivative Progress: 1490/2057 symbols completed. PUK took 1.2s. Estimated remaining: 3m 50s. Rate: 147.9 symbols/min [2025-09-29T22:14:24.952195] [INFO ] [MAIN ] PVL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:24.966408] [DEBUG] [MAIN ] PUMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:24.968939] [INFO ] [MAIN ] PUMP: Generated 1794 derivative records from 49364 primary records. [2025-09-29T22:14:24.970031] [DEBUG] [LOCAL ] PUMP: Saving derivative data. [2025-09-29T22:14:24.992677] [DEBUG] [LOCAL ] PVL: Loaded 4750 existing records from primary storage. [2025-09-29T22:14:24.994384] [INFO ] [MAIN ] PVL: Loaded 4750 primary data records. [2025-09-29T22:14:24.994490] [DEBUG] [LOCAL ] PUMP: Derivative data saved (1794 records). [2025-09-29T22:14:25.027310] [INFO ] [MAIN ] PUMP: Successfully saved derivative data. [2025-09-29T22:14:25.042727] [INFO ] [MAIN ] Derivative Progress: 1491/2057 symbols completed. PUMP took 1.3s. Estimated remaining: 3m 50s. Rate: 147.9 symbols/min [2025-09-29T22:14:25.042965] [INFO ] [MAIN ] PWR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:25.222343] [DEBUG] [LOCAL ] PVH: Loaded 50416 existing records from primary storage. [2025-09-29T22:14:25.226576] [INFO ] [MAIN ] PVH: Loaded 50416 primary data records. [2025-09-29T22:14:25.733400] [DEBUG] [LOCAL ] PWR: Loaded 47204 existing records from primary storage. [2025-09-29T22:14:25.733940] [INFO ] [MAIN ] PWR: Loaded 47204 primary data records. [2025-09-29T22:14:26.069405] [DEBUG] [MAIN ] PVL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:26.084362] [INFO ] [MAIN ] PVL: Generated 1794 derivative records from 4750 primary records. [2025-09-29T22:14:26.084899] [DEBUG] [LOCAL ] PVL: Saving derivative data. [2025-09-29T22:14:26.104226] [DEBUG] [LOCAL ] PVL: Derivative data saved (1794 records). [2025-09-29T22:14:26.107105] [INFO ] [MAIN ] PVL: Successfully saved derivative data. [2025-09-29T22:14:26.110496] [INFO ] [MAIN ] Derivative Progress: 1492/2057 symbols completed. PVL took 1.2s. Estimated remaining: 3m 49s. Rate: 147.8 symbols/min [2025-09-29T22:14:26.110819] [INFO ] [MAIN ] PX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:26.126114] [DEBUG] [MAIN ] PVH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:26.128051] [INFO ] [MAIN ] PVH: Generated 1794 derivative records from 50416 primary records. [2025-09-29T22:14:26.128151] [DEBUG] [LOCAL ] PVH: Saving derivative data. [2025-09-29T22:14:26.146078] [DEBUG] [LOCAL ] PVH: Derivative data saved (1794 records). [2025-09-29T22:14:26.146681] [INFO ] [MAIN ] PVH: Successfully saved derivative data. [2025-09-29T22:14:26.148980] [INFO ] [MAIN ] Derivative Progress: 1493/2057 symbols completed. PVH took 1.2s. Estimated remaining: 3m 49s. Rate: 147.9 symbols/min [2025-09-29T22:14:26.149406] [INFO ] [MAIN ] QD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:26.190316] [DEBUG] [LOCAL ] PX: Loaded 34549 existing records from primary storage. [2025-09-29T22:14:26.190805] [DEBUG] [MAIN ] PWR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:26.191938] [INFO ] [MAIN ] PWR: Generated 1794 derivative records from 47204 primary records. [2025-09-29T22:14:26.192213] [DEBUG] [LOCAL ] PWR: Saving derivative data. [2025-09-29T22:14:26.192136] [INFO ] [MAIN ] PX: Loaded 34549 primary data records. [2025-09-29T22:14:26.343416] [DEBUG] [LOCAL ] QD: Loaded 28038 existing records from primary storage. [2025-09-29T22:14:26.345219] [DEBUG] [LOCAL ] PWR: Derivative data saved (1794 records). [2025-09-29T22:14:26.350631] [INFO ] [MAIN ] QD: Loaded 28038 primary data records. [2025-09-29T22:14:26.399170] [INFO ] [MAIN ] PWR: Successfully saved derivative data. [2025-09-29T22:14:26.420098] [INFO ] [MAIN ] Derivative Progress: 1494/2057 symbols completed. PWR took 1.4s. Estimated remaining: 3m 48s. Rate: 147.9 symbols/min [2025-09-29T22:14:26.430619] [INFO ] [MAIN ] QGEN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:26.922321] [DEBUG] [LOCAL ] QGEN: Loaded 49070 existing records from primary storage. [2025-09-29T22:14:26.924496] [INFO ] [MAIN ] QGEN: Loaded 49070 primary data records. [2025-09-29T22:14:27.028149] [DEBUG] [MAIN ] PX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:27.034406] [INFO ] [MAIN ] PX: Generated 1794 derivative records from 34549 primary records. [2025-09-29T22:14:27.034516] [DEBUG] [LOCAL ] PX: Saving derivative data. [2025-09-29T22:14:27.104860] [DEBUG] [MAIN ] QD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:27.128564] [DEBUG] [LOCAL ] PX: Derivative data saved (1794 records). [2025-09-29T22:14:27.144909] [INFO ] [MAIN ] PX: Successfully saved derivative data. [2025-09-29T22:14:27.150340] [INFO ] [MAIN ] Derivative Progress: 1495/2057 symbols completed. PX took 1.0s. Estimated remaining: 3m 48s. Rate: 147.8 symbols/min [2025-09-29T22:14:27.174872] [INFO ] [MAIN ] QS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:27.148327] [INFO ] [MAIN ] QD: Generated 1794 derivative records from 28038 primary records. [2025-09-29T22:14:27.175598] [DEBUG] [LOCAL ] QD: Saving derivative data. [2025-09-29T22:14:27.352244] [DEBUG] [LOCAL ] QD: Derivative data saved (1794 records). [2025-09-29T22:14:27.352885] [INFO ] [MAIN ] QD: Successfully saved derivative data. [2025-09-29T22:14:27.355104] [INFO ] [MAIN ] Derivative Progress: 1496/2057 symbols completed. QD took 1.2s. Estimated remaining: 3m 48s. Rate: 147.9 symbols/min [2025-09-29T22:14:27.355276] [INFO ] [MAIN ] QSR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:27.394010] [DEBUG] [MAIN ] QGEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:27.395094] [INFO ] [MAIN ] QGEN: Generated 1794 derivative records from 49070 primary records. [2025-09-29T22:14:27.395251] [DEBUG] [LOCAL ] QGEN: Saving derivative data. [2025-09-29T22:14:27.412371] [DEBUG] [LOCAL ] QGEN: Derivative data saved (1794 records). [2025-09-29T22:14:27.412516] [INFO ] [MAIN ] QGEN: Successfully saved derivative data. [2025-09-29T22:14:27.414783] [INFO ] [MAIN ] Derivative Progress: 1497/2057 symbols completed. QGEN took 1.0s. Estimated remaining: 3m 47s. Rate: 148.0 symbols/min [2025-09-29T22:14:27.414993] [INFO ] [MAIN ] QTWO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:27.446250] [DEBUG] [LOCAL ] QS: Loaded 53742 existing records from primary storage. [2025-09-29T22:14:27.446561] [INFO ] [MAIN ] QS: Loaded 53742 primary data records. [2025-09-29T22:14:27.581087] [DEBUG] [LOCAL ] QSR: Loaded 52403 existing records from primary storage. [2025-09-29T22:14:27.601064] [INFO ] [MAIN ] QSR: Loaded 52403 primary data records. [2025-09-29T22:14:27.773358] [DEBUG] [LOCAL ] QTWO: Loaded 38996 existing records from primary storage. [2025-09-29T22:14:27.906724] [INFO ] [MAIN ] QTWO: Loaded 38996 primary data records. [2025-09-29T22:14:28.491732] [DEBUG] [MAIN ] QS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:28.492810] [INFO ] [MAIN ] QS: Generated 1794 derivative records from 53742 primary records. [2025-09-29T22:14:28.493207] [DEBUG] [LOCAL ] QS: Saving derivative data. [2025-09-29T22:14:28.515499] [DEBUG] [MAIN ] QSR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:28.516436] [INFO ] [MAIN ] QSR: Generated 1794 derivative records from 52403 primary records. [2025-09-29T22:14:28.520548] [DEBUG] [LOCAL ] QSR: Saving derivative data. [2025-09-29T22:14:28.526109] [DEBUG] [LOCAL ] QS: Derivative data saved (1794 records). [2025-09-29T22:14:28.526264] [INFO ] [MAIN ] QS: Successfully saved derivative data. [2025-09-29T22:14:28.528445] [INFO ] [MAIN ] Derivative Progress: 1498/2057 symbols completed. QS took 1.4s. Estimated remaining: 3m 47s. Rate: 147.8 symbols/min [2025-09-29T22:14:28.546798] [DEBUG] [LOCAL ] QSR: Derivative data saved (1794 records). [2025-09-29T22:14:28.547111] [INFO ] [MAIN ] QSR: Successfully saved derivative data. [2025-09-29T22:14:28.549242] [INFO ] [MAIN ] Derivative Progress: 1499/2057 symbols completed. QSR took 1.2s. Estimated remaining: 3m 46s. Rate: 147.9 symbols/min [2025-09-29T22:14:28.562112] [DEBUG] [MAIN ] QTWO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:28.562845] [INFO ] [MAIN ] QTWO: Generated 1794 derivative records from 38996 primary records. [2025-09-29T22:14:28.562924] [DEBUG] [LOCAL ] QTWO: Saving derivative data. [2025-09-29T22:14:28.579544] [DEBUG] [LOCAL ] QTWO: Derivative data saved (1794 records). [2025-09-29T22:14:28.579624] [INFO ] [MAIN ] QTWO: Successfully saved derivative data. [2025-09-29T22:14:28.581856] [INFO ] [MAIN ] Derivative Progress: 1500/2057 symbols completed. QTWO took 1.2s. Estimated remaining: 3m 46s. Rate: 148.0 symbols/min [2025-09-29T22:14:28.582276] [INFO ] [MAIN ] QVCD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:28.582376] [INFO ] [MAIN ] QUAD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:28.582480] [INFO ] [MAIN ] QVCC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:28.594459] [DEBUG] [LOCAL ] QVCD: Loaded 4498 existing records from primary storage. [2025-09-29T22:14:28.594702] [INFO ] [MAIN ] QVCD: Loaded 4498 primary data records. [2025-09-29T22:14:28.667132] [DEBUG] [LOCAL ] QVCC: Loaded 8934 existing records from primary storage. [2025-09-29T22:14:28.691873] [INFO ] [MAIN ] QVCC: Loaded 8934 primary data records. [2025-09-29T22:14:28.756706] [DEBUG] [LOCAL ] QUAD: Loaded 23399 existing records from primary storage. [2025-09-29T22:14:28.803927] [INFO ] [MAIN ] QUAD: Loaded 23399 primary data records. [2025-09-29T22:14:29.647842] [DEBUG] [MAIN ] QVCD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:14:29.649255] [INFO ] [MAIN ] QVCD: Generated 1793 derivative records from 4498 primary records. [2025-09-29T22:14:29.649543] [DEBUG] [LOCAL ] QVCD: Saving derivative data. [2025-09-29T22:14:29.681512] [DEBUG] [MAIN ] QVCC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:29.682582] [DEBUG] [LOCAL ] QVCD: Derivative data saved (1793 records). [2025-09-29T22:14:29.683337] [INFO ] [MAIN ] QVCC: Generated 1794 derivative records from 8934 primary records. [2025-09-29T22:14:29.683675] [INFO ] [MAIN ] QVCD: Successfully saved derivative data. [2025-09-29T22:14:29.686002] [INFO ] [MAIN ] Derivative Progress: 1501/2057 symbols completed. QVCD took 1.1s. Estimated remaining: 3m 46s. Rate: 147.8 symbols/min [2025-09-29T22:14:29.686166] [INFO ] [MAIN ] QXO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:29.683806] [DEBUG] [LOCAL ] QVCC: Saving derivative data. [2025-09-29T22:14:29.705384] [DEBUG] [LOCAL ] QVCC: Derivative data saved (1794 records). [2025-09-29T22:14:29.718235] [INFO ] [MAIN ] QVCC: Successfully saved derivative data. [2025-09-29T22:14:29.720565] [INFO ] [MAIN ] Derivative Progress: 1502/2057 symbols completed. QVCC took 1.1s. Estimated remaining: 3m 45s. Rate: 147.9 symbols/min [2025-09-29T22:14:29.721316] [DEBUG] [MAIN ] QUAD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:29.720956] [INFO ] [MAIN ] R: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:29.722444] [INFO ] [MAIN ] QUAD: Generated 1794 derivative records from 23399 primary records. [2025-09-29T22:14:29.722510] [DEBUG] [LOCAL ] QUAD: Saving derivative data. [2025-09-29T22:14:29.739234] [DEBUG] [LOCAL ] QUAD: Derivative data saved (1794 records). [2025-09-29T22:14:29.739595] [INFO ] [MAIN ] QUAD: Successfully saved derivative data. [2025-09-29T22:14:29.742046] [INFO ] [MAIN ] Derivative Progress: 1503/2057 symbols completed. QUAD took 1.2s. Estimated remaining: 3m 45s. Rate: 148.0 symbols/min [2025-09-29T22:14:29.742603] [INFO ] [MAIN ] RA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:29.784814] [DEBUG] [LOCAL ] R: Loaded 29166 existing records from primary storage. [2025-09-29T22:14:29.791707] [INFO ] [MAIN ] R: Loaded 29166 primary data records. [2025-09-29T22:14:29.793810] [DEBUG] [LOCAL ] RA: Loaded 21729 existing records from primary storage. [2025-09-29T22:14:29.845986] [INFO ] [MAIN ] RA: Loaded 21729 primary data records. [2025-09-29T22:14:29.867404] [DEBUG] [LOCAL ] QXO: Loaded 53206 existing records from primary storage. [2025-09-29T22:14:29.903772] [INFO ] [MAIN ] QXO: Loaded 53206 primary data records. [2025-09-29T22:14:30.787845] [DEBUG] [MAIN ] R: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:30.790182] [INFO ] [MAIN ] R: Generated 1794 derivative records from 29166 primary records. [2025-09-29T22:14:30.792032] [DEBUG] [LOCAL ] R: Saving derivative data. [2025-09-29T22:14:30.808747] [DEBUG] [MAIN ] QXO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:30.821238] [INFO ] [MAIN ] QXO: Generated 1794 derivative records from 53206 primary records. [2025-09-29T22:14:30.821902] [DEBUG] [LOCAL ] QXO: Saving derivative data. [2025-09-29T22:14:30.844364] [DEBUG] [MAIN ] RA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:30.849105] [INFO ] [MAIN ] RA: Generated 1794 derivative records from 21729 primary records. [2025-09-29T22:14:30.849946] [DEBUG] [LOCAL ] RA: Saving derivative data. [2025-09-29T22:14:30.855810] [DEBUG] [LOCAL ] QXO: Derivative data saved (1794 records). [2025-09-29T22:14:30.856443] [INFO ] [MAIN ] QXO: Successfully saved derivative data. [2025-09-29T22:14:30.870770] [INFO ] [MAIN ] Derivative Progress: 1504/2057 symbols completed. QXO took 1.2s. Estimated remaining: 3m 44s. Rate: 147.8 symbols/min [2025-09-29T22:14:30.871255] [INFO ] [MAIN ] RACE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:30.873160] [DEBUG] [LOCAL ] R: Derivative data saved (1794 records). [2025-09-29T22:14:30.873750] [INFO ] [MAIN ] R: Successfully saved derivative data. [2025-09-29T22:14:30.877701] [INFO ] [MAIN ] Derivative Progress: 1505/2057 symbols completed. R took 1.2s. Estimated remaining: 3m 44s. Rate: 147.9 symbols/min [2025-09-29T22:14:30.878050] [INFO ] [MAIN ] RAMP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:30.880328] [DEBUG] [LOCAL ] RA: Derivative data saved (1794 records). [2025-09-29T22:14:30.880420] [INFO ] [MAIN ] RA: Successfully saved derivative data. [2025-09-29T22:14:30.882548] [INFO ] [MAIN ] Derivative Progress: 1506/2057 symbols completed. RA took 1.1s. Estimated remaining: 3m 43s. Rate: 148.0 symbols/min [2025-09-29T22:14:30.882832] [INFO ] [MAIN ] RBA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:30.977061] [DEBUG] [LOCAL ] RACE: Loaded 32637 existing records from primary storage. [2025-09-29T22:14:30.987820] [INFO ] [MAIN ] RACE: Loaded 32637 primary data records. [2025-09-29T22:14:30.999973] [DEBUG] [LOCAL ] RAMP: Loaded 37464 existing records from primary storage. [2025-09-29T22:14:31.020310] [INFO ] [MAIN ] RAMP: Loaded 37464 primary data records. [2025-09-29T22:14:31.140000] [DEBUG] [LOCAL ] RBA: Loaded 45859 existing records from primary storage. [2025-09-29T22:14:31.184011] [INFO ] [MAIN ] RBA: Loaded 45859 primary data records. [2025-09-29T22:14:32.045859] [DEBUG] [MAIN ] RACE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:32.062318] [INFO ] [MAIN ] RACE: Generated 1794 derivative records from 32637 primary records. [2025-09-29T22:14:32.064418] [DEBUG] [LOCAL ] RACE: Saving derivative data. [2025-09-29T22:14:32.066243] [DEBUG] [MAIN ] RAMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:32.068123] [INFO ] [MAIN ] RAMP: Generated 1794 derivative records from 37464 primary records. [2025-09-29T22:14:32.086635] [DEBUG] [LOCAL ] RAMP: Saving derivative data. [2025-09-29T22:14:32.101872] [DEBUG] [LOCAL ] RACE: Derivative data saved (1794 records). [2025-09-29T22:14:32.111529] [INFO ] [MAIN ] RACE: Successfully saved derivative data. [2025-09-29T22:14:32.102542] [DEBUG] [MAIN ] RBA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:32.116418] [INFO ] [MAIN ] Derivative Progress: 1507/2057 symbols completed. RACE took 1.2s. Estimated remaining: 3m 43s. Rate: 147.8 symbols/min [2025-09-29T22:14:32.119558] [INFO ] [MAIN ] RBC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:32.122300] [INFO ] [MAIN ] RBA: Generated 1794 derivative records from 45859 primary records. [2025-09-29T22:14:32.121169] [DEBUG] [LOCAL ] RAMP: Derivative data saved (1794 records). [2025-09-29T22:14:32.123077] [INFO ] [MAIN ] RAMP: Successfully saved derivative data. [2025-09-29T22:14:32.122516] [DEBUG] [LOCAL ] RBA: Saving derivative data. [2025-09-29T22:14:32.126089] [INFO ] [MAIN ] Derivative Progress: 1508/2057 symbols completed. RAMP took 1.2s. Estimated remaining: 3m 43s. Rate: 147.9 symbols/min [2025-09-29T22:14:32.126564] [INFO ] [MAIN ] RBLX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:32.150178] [DEBUG] [LOCAL ] RBA: Derivative data saved (1794 records). [2025-09-29T22:14:32.150349] [INFO ] [MAIN ] RBA: Successfully saved derivative data. [2025-09-29T22:14:32.153042] [INFO ] [MAIN ] Derivative Progress: 1509/2057 symbols completed. RBA took 1.3s. Estimated remaining: 3m 42s. Rate: 148.0 symbols/min [2025-09-29T22:14:32.153347] [INFO ] [MAIN ] RBOT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:32.161005] [DEBUG] [LOCAL ] RBC: Loaded 15132 existing records from primary storage. [2025-09-29T22:14:32.161170] [INFO ] [MAIN ] RBC: Loaded 15132 primary data records. [2025-09-29T22:14:32.273990] [DEBUG] [LOCAL ] RBOT: Loaded 5172 existing records from primary storage. [2025-09-29T22:14:32.277947] [INFO ] [MAIN ] RBOT: Loaded 5172 primary data records. [2025-09-29T22:14:32.717449] [DEBUG] [LOCAL ] RBLX: Loaded 53716 existing records from primary storage. [2025-09-29T22:14:32.815045] [INFO ] [MAIN ] RBLX: Loaded 53716 primary data records. [2025-09-29T22:14:33.224912] [DEBUG] [MAIN ] RBC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:33.226928] [INFO ] [MAIN ] RBC: Generated 1794 derivative records from 15132 primary records. [2025-09-29T22:14:33.229403] [DEBUG] [LOCAL ] RBC: Saving derivative data. [2025-09-29T22:14:33.262873] [DEBUG] [MAIN ] RBOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:33.266568] [INFO ] [MAIN ] RBOT: Generated 1794 derivative records from 5172 primary records. [2025-09-29T22:14:33.267377] [DEBUG] [LOCAL ] RBOT: Saving derivative data. [2025-09-29T22:14:33.267219] [DEBUG] [LOCAL ] RBC: Derivative data saved (1794 records). [2025-09-29T22:14:33.268700] [INFO ] [MAIN ] RBC: Successfully saved derivative data. [2025-09-29T22:14:33.272347] [INFO ] [MAIN ] Derivative Progress: 1510/2057 symbols completed. RBC took 1.2s. Estimated remaining: 3m 42s. Rate: 147.8 symbols/min [2025-09-29T22:14:33.280813] [INFO ] [MAIN ] RBRK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:33.289294] [DEBUG] [LOCAL ] RBOT: Derivative data saved (1794 records). [2025-09-29T22:14:33.289399] [INFO ] [MAIN ] RBOT: Successfully saved derivative data. [2025-09-29T22:14:33.291466] [INFO ] [MAIN ] Derivative Progress: 1511/2057 symbols completed. RBOT took 1.1s. Estimated remaining: 3m 41s. Rate: 147.9 symbols/min [2025-09-29T22:14:33.291707] [INFO ] [MAIN ] RC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:33.312633] [DEBUG] [MAIN ] RBLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:33.314976] [INFO ] [MAIN ] RBLX: Generated 1794 derivative records from 53716 primary records. [2025-09-29T22:14:33.315111] [DEBUG] [LOCAL ] RBLX: Saving derivative data. [2025-09-29T22:14:33.333980] [DEBUG] [LOCAL ] RBLX: Derivative data saved (1794 records). [2025-09-29T22:14:33.334173] [INFO ] [MAIN ] RBLX: Successfully saved derivative data. [2025-09-29T22:14:33.336259] [INFO ] [MAIN ] Derivative Progress: 1512/2057 symbols completed. RBLX took 1.2s. Estimated remaining: 3m 41s. Rate: 148.0 symbols/min [2025-09-29T22:14:33.336602] [INFO ] [MAIN ] RCI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:33.401803] [DEBUG] [LOCAL ] RC: Loaded 48910 existing records from primary storage. [2025-09-29T22:14:33.402078] [INFO ] [MAIN ] RC: Loaded 48910 primary data records. [2025-09-29T22:14:33.427675] [DEBUG] [LOCAL ] RBRK: Loaded 53123 existing records from primary storage. [2025-09-29T22:14:33.444434] [INFO ] [MAIN ] RBRK: Loaded 53123 primary data records. [2025-09-29T22:14:33.723421] [DEBUG] [LOCAL ] RCI: Loaded 48607 existing records from primary storage. [2025-09-29T22:14:33.848949] [INFO ] [MAIN ] RCI: Loaded 48607 primary data records. [2025-09-29T22:14:34.521464] [DEBUG] [MAIN ] RC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:34.522221] [DEBUG] [MAIN ] RBRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:34.523293] [INFO ] [MAIN ] RC: Generated 1794 derivative records from 48910 primary records. [2025-09-29T22:14:34.525948] [DEBUG] [LOCAL ] RC: Saving derivative data. [2025-09-29T22:14:34.524427] [INFO ] [MAIN ] RBRK: Generated 1794 derivative records from 53123 primary records. [2025-09-29T22:14:34.526684] [DEBUG] [LOCAL ] RBRK: Saving derivative data. [2025-09-29T22:14:34.564420] [DEBUG] [LOCAL ] RC: Derivative data saved (1794 records). [2025-09-29T22:14:34.565454] [INFO ] [MAIN ] RC: Successfully saved derivative data. [2025-09-29T22:14:34.568116] [INFO ] [MAIN ] Derivative Progress: 1513/2057 symbols completed. RC took 1.3s. Estimated remaining: 3m 41s. Rate: 147.8 symbols/min [2025-09-29T22:14:34.583619] [DEBUG] [MAIN ] RCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:34.584633] [INFO ] [MAIN ] RCI: Generated 1794 derivative records from 48607 primary records. [2025-09-29T22:14:34.584910] [DEBUG] [LOCAL ] RCI: Saving derivative data. [2025-09-29T22:14:34.584843] [DEBUG] [LOCAL ] RBRK: Derivative data saved (1794 records). [2025-09-29T22:14:34.585333] [INFO ] [MAIN ] RBRK: Successfully saved derivative data. [2025-09-29T22:14:34.587872] [INFO ] [MAIN ] Derivative Progress: 1514/2057 symbols completed. RBRK took 1.3s. Estimated remaining: 3m 40s. Rate: 147.9 symbols/min [2025-09-29T22:14:34.603872] [DEBUG] [LOCAL ] RCI: Derivative data saved (1794 records). [2025-09-29T22:14:34.603968] [INFO ] [MAIN ] RCI: Successfully saved derivative data. [2025-09-29T22:14:34.606112] [INFO ] [MAIN ] Derivative Progress: 1515/2057 symbols completed. RCI took 1.3s. Estimated remaining: 3m 40s. Rate: 148.0 symbols/min [2025-09-29T22:14:34.606550] [INFO ] [MAIN ] RDDT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:34.607128] [INFO ] [MAIN ] RCUS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:34.607297] [INFO ] [MAIN ] RCS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:34.622529] [DEBUG] [LOCAL ] RCS: Loaded 11451 existing records from primary storage. [2025-09-29T22:14:34.622870] [INFO ] [MAIN ] RCS: Loaded 11451 primary data records. [2025-09-29T22:14:34.885217] [DEBUG] [LOCAL ] RCUS: Loaded 42401 existing records from primary storage. [2025-09-29T22:14:34.900324] [INFO ] [MAIN ] RCUS: Loaded 42401 primary data records. [2025-09-29T22:14:35.047748] [DEBUG] [LOCAL ] RDDT: Loaded 53781 existing records from primary storage. [2025-09-29T22:14:35.053092] [INFO ] [MAIN ] RDDT: Loaded 53781 primary data records. [2025-09-29T22:14:35.756564] [DEBUG] [MAIN ] RCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:35.758908] [INFO ] [MAIN ] RCS: Generated 1794 derivative records from 11451 primary records. [2025-09-29T22:14:35.759094] [DEBUG] [LOCAL ] RCS: Saving derivative data. [2025-09-29T22:14:35.784149] [DEBUG] [LOCAL ] RCS: Derivative data saved (1794 records). [2025-09-29T22:14:35.785398] [INFO ] [MAIN ] RCS: Successfully saved derivative data. [2025-09-29T22:14:35.787799] [INFO ] [MAIN ] Derivative Progress: 1516/2057 symbols completed. RCS took 1.2s. Estimated remaining: 3m 40s. Rate: 147.8 symbols/min [2025-09-29T22:14:35.788000] [INFO ] [MAIN ] RDN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:35.802913] [DEBUG] [MAIN ] RCUS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:35.804927] [INFO ] [MAIN ] RCUS: Generated 1794 derivative records from 42401 primary records. [2025-09-29T22:14:35.805813] [DEBUG] [LOCAL ] RCUS: Saving derivative data. [2025-09-29T22:14:35.835700] [DEBUG] [LOCAL ] RCUS: Derivative data saved (1794 records). [2025-09-29T22:14:35.836264] [INFO ] [MAIN ] RCUS: Successfully saved derivative data. [2025-09-29T22:14:35.836177] [DEBUG] [MAIN ] RDDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:35.838379] [INFO ] [MAIN ] Derivative Progress: 1517/2057 symbols completed. RCUS took 1.2s. Estimated remaining: 3m 39s. Rate: 147.9 symbols/min [2025-09-29T22:14:35.838666] [INFO ] [MAIN ] RDW: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:35.839526] [INFO ] [MAIN ] RDDT: Generated 1794 derivative records from 53781 primary records. [2025-09-29T22:14:35.839858] [DEBUG] [LOCAL ] RDDT: Saving derivative data. [2025-09-29T22:14:35.858148] [DEBUG] [LOCAL ] RDDT: Derivative data saved (1794 records). [2025-09-29T22:14:35.858503] [INFO ] [MAIN ] RDDT: Successfully saved derivative data. [2025-09-29T22:14:35.870459] [INFO ] [MAIN ] Derivative Progress: 1518/2057 symbols completed. RDDT took 1.3s. Estimated remaining: 3m 39s. Rate: 148.0 symbols/min [2025-09-29T22:14:35.870923] [INFO ] [MAIN ] RDY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:35.889807] [DEBUG] [LOCAL ] RDN: Loaded 45150 existing records from primary storage. [2025-09-29T22:14:35.889956] [INFO ] [MAIN ] RDN: Loaded 45150 primary data records. [2025-09-29T22:14:36.251596] [DEBUG] [LOCAL ] RDW: Loaded 52017 existing records from primary storage. [2025-09-29T22:14:36.252410] [INFO ] [MAIN ] RDW: Loaded 52017 primary data records. [2025-09-29T22:14:36.319480] [DEBUG] [LOCAL ] RDY: Loaded 46769 existing records from primary storage. [2025-09-29T22:14:36.339966] [INFO ] [MAIN ] RDY: Loaded 46769 primary data records. [2025-09-29T22:14:36.976253] [DEBUG] [MAIN ] RDN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:36.977569] [INFO ] [MAIN ] RDN: Generated 1794 derivative records from 45150 primary records. [2025-09-29T22:14:36.978033] [DEBUG] [LOCAL ] RDN: Saving derivative data. [2025-09-29T22:14:37.003474] [DEBUG] [LOCAL ] RDN: Derivative data saved (1794 records). [2025-09-29T22:14:37.016932] [INFO ] [MAIN ] RDN: Successfully saved derivative data. [2025-09-29T22:14:37.017963] [DEBUG] [MAIN ] RDW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:37.021772] [INFO ] [MAIN ] RDW: Generated 1794 derivative records from 52017 primary records. [2025-09-29T22:14:37.020765] [INFO ] [MAIN ] Derivative Progress: 1519/2057 symbols completed. RDN took 1.2s. Estimated remaining: 3m 38s. Rate: 147.8 symbols/min [2025-09-29T22:14:37.023132] [DEBUG] [LOCAL ] RDW: Saving derivative data. [2025-09-29T22:14:37.023293] [INFO ] [MAIN ] RELX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:37.043294] [DEBUG] [LOCAL ] RDW: Derivative data saved (1794 records). [2025-09-29T22:14:37.056199] [INFO ] [MAIN ] RDW: Successfully saved derivative data. [2025-09-29T22:14:37.058934] [INFO ] [MAIN ] Derivative Progress: 1520/2057 symbols completed. RDW took 1.2s. Estimated remaining: 3m 38s. Rate: 147.9 symbols/min [2025-09-29T22:14:37.056637] [DEBUG] [MAIN ] RDY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:37.060189] [INFO ] [MAIN ] RDY: Generated 1794 derivative records from 46769 primary records. [2025-09-29T22:14:37.059248] [INFO ] [MAIN ] RERE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:37.061098] [DEBUG] [LOCAL ] RDY: Saving derivative data. [2025-09-29T22:14:37.080258] [DEBUG] [LOCAL ] RDY: Derivative data saved (1794 records). [2025-09-29T22:14:37.080447] [INFO ] [MAIN ] RDY: Successfully saved derivative data. [2025-09-29T22:14:37.082750] [INFO ] [MAIN ] Derivative Progress: 1521/2057 symbols completed. RDY took 1.2s. Estimated remaining: 3m 37s. Rate: 148.0 symbols/min [2025-09-29T22:14:37.093699] [INFO ] [MAIN ] RES: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:37.124612] [DEBUG] [LOCAL ] RELX: Loaded 47858 existing records from primary storage. [2025-09-29T22:14:37.124934] [INFO ] [MAIN ] RELX: Loaded 47858 primary data records. [2025-09-29T22:14:37.205141] [DEBUG] [LOCAL ] RERE: Loaded 41027 existing records from primary storage. [2025-09-29T22:14:37.235740] [INFO ] [MAIN ] RERE: Loaded 41027 primary data records. [2025-09-29T22:14:37.481000] [DEBUG] [LOCAL ] RES: Loaded 47471 existing records from primary storage. [2025-09-29T22:14:37.658486] [INFO ] [MAIN ] RES: Loaded 47471 primary data records. [2025-09-29T22:14:38.195538] [DEBUG] [MAIN ] RELX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:38.197045] [INFO ] [MAIN ] RELX: Generated 1794 derivative records from 47858 primary records. [2025-09-29T22:14:38.198405] [DEBUG] [LOCAL ] RELX: Saving derivative data. [2025-09-29T22:14:38.229756] [DEBUG] [MAIN ] RERE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:38.231742] [INFO ] [MAIN ] RERE: Generated 1794 derivative records from 41027 primary records. [2025-09-29T22:14:38.232525] [DEBUG] [LOCAL ] RERE: Saving derivative data. [2025-09-29T22:14:38.253010] [DEBUG] [LOCAL ] RELX: Derivative data saved (1794 records). [2025-09-29T22:14:38.254351] [DEBUG] [LOCAL ] RERE: Derivative data saved (1794 records). [2025-09-29T22:14:38.255553] [INFO ] [MAIN ] RERE: Successfully saved derivative data. [2025-09-29T22:14:38.255459] [INFO ] [MAIN ] RELX: Successfully saved derivative data. [2025-09-29T22:14:38.258811] [INFO ] [MAIN ] Derivative Progress: 1522/2057 symbols completed. RERE took 1.2s. Estimated remaining: 3m 37s. Rate: 147.8 symbols/min [2025-09-29T22:14:38.261458] [INFO ] [MAIN ] REVG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:38.269554] [INFO ] [MAIN ] Derivative Progress: 1523/2057 symbols completed. RELX took 1.2s. Estimated remaining: 3m 37s. Rate: 147.9 symbols/min [2025-09-29T22:14:38.275144] [INFO ] [MAIN ] REX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:38.275764] [DEBUG] [MAIN ] RES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:38.276817] [INFO ] [MAIN ] RES: Generated 1794 derivative records from 47471 primary records. [2025-09-29T22:14:38.276889] [DEBUG] [LOCAL ] RES: Saving derivative data. [2025-09-29T22:14:38.298300] [DEBUG] [LOCAL ] RES: Derivative data saved (1794 records). [2025-09-29T22:14:38.298562] [INFO ] [MAIN ] RES: Successfully saved derivative data. [2025-09-29T22:14:38.300734] [INFO ] [MAIN ] Derivative Progress: 1524/2057 symbols completed. RES took 1.2s. Estimated remaining: 3m 36s. Rate: 148.0 symbols/min [2025-09-29T22:14:38.300941] [INFO ] [MAIN ] REXR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:38.307734] [DEBUG] [LOCAL ] REX: Loaded 14051 existing records from primary storage. [2025-09-29T22:14:38.308560] [INFO ] [MAIN ] REX: Loaded 14051 primary data records. [2025-09-29T22:14:38.685465] [DEBUG] [LOCAL ] REVG: Loaded 40770 existing records from primary storage. [2025-09-29T22:14:38.685965] [INFO ] [MAIN ] REVG: Loaded 40770 primary data records. [2025-09-29T22:14:38.812314] [DEBUG] [LOCAL ] REXR: Loaded 52096 existing records from primary storage. [2025-09-29T22:14:38.824855] [INFO ] [MAIN ] REXR: Loaded 52096 primary data records. [2025-09-29T22:14:39.436785] [DEBUG] [MAIN ] REX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:39.437882] [INFO ] [MAIN ] REX: Generated 1794 derivative records from 14051 primary records. [2025-09-29T22:14:39.438102] [DEBUG] [LOCAL ] REX: Saving derivative data. [2025-09-29T22:14:39.462407] [DEBUG] [LOCAL ] REX: Derivative data saved (1794 records). [2025-09-29T22:14:39.463962] [INFO ] [MAIN ] REX: Successfully saved derivative data. [2025-09-29T22:14:39.466955] [INFO ] [MAIN ] Derivative Progress: 1525/2057 symbols completed. REX took 1.2s. Estimated remaining: 3m 36s. Rate: 147.8 symbols/min [2025-09-29T22:14:39.467529] [INFO ] [MAIN ] REZI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:39.487301] [DEBUG] [MAIN ] REVG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:39.488212] [INFO ] [MAIN ] REVG: Generated 1794 derivative records from 40770 primary records. [2025-09-29T22:14:39.488398] [DEBUG] [LOCAL ] REVG: Saving derivative data. [2025-09-29T22:14:39.523311] [DEBUG] [MAIN ] REXR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:39.525494] [INFO ] [MAIN ] REXR: Generated 1794 derivative records from 52096 primary records. [2025-09-29T22:14:39.525916] [DEBUG] [LOCAL ] REXR: Saving derivative data. [2025-09-29T22:14:39.527541] [DEBUG] [LOCAL ] REVG: Derivative data saved (1794 records). [2025-09-29T22:14:39.527707] [INFO ] [MAIN ] REVG: Successfully saved derivative data. [2025-09-29T22:14:39.530154] [INFO ] [MAIN ] Derivative Progress: 1526/2057 symbols completed. REVG took 1.3s. Estimated remaining: 3m 35s. Rate: 147.9 symbols/min [2025-09-29T22:14:39.541665] [INFO ] [MAIN ] RF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:39.576486] [DEBUG] [LOCAL ] REXR: Derivative data saved (1794 records). [2025-09-29T22:14:39.578353] [INFO ] [MAIN ] REXR: Successfully saved derivative data. [2025-09-29T22:14:39.582231] [DEBUG] [LOCAL ] REZI: Loaded 46908 existing records from primary storage. [2025-09-29T22:14:39.580807] [INFO ] [MAIN ] Derivative Progress: 1527/2057 symbols completed. REXR took 1.3s. Estimated remaining: 3m 35s. Rate: 148.0 symbols/min [2025-09-29T22:14:39.582568] [INFO ] [MAIN ] RFI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:39.582679] [INFO ] [MAIN ] REZI: Loaded 46908 primary data records. [2025-09-29T22:14:39.745817] [DEBUG] [LOCAL ] RFI: Loaded 10468 existing records from primary storage. [2025-09-29T22:14:39.796890] [INFO ] [MAIN ] RFI: Loaded 10468 primary data records. [2025-09-29T22:14:40.062543] [DEBUG] [LOCAL ] RF: Loaded 53630 existing records from primary storage. [2025-09-29T22:14:40.073834] [INFO ] [MAIN ] RF: Loaded 53630 primary data records. [2025-09-29T22:14:40.671772] [DEBUG] [MAIN ] REZI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:40.672726] [INFO ] [MAIN ] REZI: Generated 1794 derivative records from 46908 primary records. [2025-09-29T22:14:40.673033] [DEBUG] [LOCAL ] REZI: Saving derivative data. [2025-09-29T22:14:40.692348] [DEBUG] [LOCAL ] REZI: Derivative data saved (1794 records). [2025-09-29T22:14:40.693426] [INFO ] [MAIN ] REZI: Successfully saved derivative data. [2025-09-29T22:14:40.696717] [INFO ] [MAIN ] Derivative Progress: 1528/2057 symbols completed. REZI took 1.2s. Estimated remaining: 3m 35s. Rate: 147.8 symbols/min [2025-09-29T22:14:40.716095] [DEBUG] [MAIN ] RFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:40.716857] [INFO ] [MAIN ] RFI: Generated 1794 derivative records from 10468 primary records. [2025-09-29T22:14:40.717201] [DEBUG] [LOCAL ] RFI: Saving derivative data. [2025-09-29T22:14:40.736947] [DEBUG] [LOCAL ] RFI: Derivative data saved (1794 records). [2025-09-29T22:14:40.737132] [INFO ] [MAIN ] RFI: Successfully saved derivative data. [2025-09-29T22:14:40.739726] [INFO ] [MAIN ] Derivative Progress: 1529/2057 symbols completed. RFI took 1.2s. Estimated remaining: 3m 34s. Rate: 147.9 symbols/min [2025-09-29T22:14:40.753991] [DEBUG] [MAIN ] RF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:40.754944] [INFO ] [MAIN ] RF: Generated 1794 derivative records from 53630 primary records. [2025-09-29T22:14:40.755034] [DEBUG] [LOCAL ] RF: Saving derivative data. [2025-09-29T22:14:40.773601] [DEBUG] [LOCAL ] RF: Derivative data saved (1794 records). [2025-09-29T22:14:40.773711] [INFO ] [MAIN ] RF: Successfully saved derivative data. [2025-09-29T22:14:40.775963] [INFO ] [MAIN ] Derivative Progress: 1530/2057 symbols completed. RF took 1.2s. Estimated remaining: 3m 34s. Rate: 148.0 symbols/min [2025-09-29T22:14:40.776736] [INFO ] [MAIN ] RFM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:40.776552] [INFO ] [MAIN ] RFL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:40.776631] [INFO ] [MAIN ] RFMZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:40.790259] [DEBUG] [LOCAL ] RFM: Loaded 4158 existing records from primary storage. [2025-09-29T22:14:40.790467] [INFO ] [MAIN ] RFM: Loaded 4158 primary data records. [2025-09-29T22:14:40.820595] [DEBUG] [LOCAL ] RFMZ: Loaded 8794 existing records from primary storage. [2025-09-29T22:14:40.836739] [INFO ] [MAIN ] RFMZ: Loaded 8794 primary data records. [2025-09-29T22:14:40.837137] [DEBUG] [LOCAL ] RFL: Loaded 11077 existing records from primary storage. [2025-09-29T22:14:40.850536] [INFO ] [MAIN ] RFL: Loaded 11077 primary data records. [2025-09-29T22:14:41.793594] [DEBUG] [MAIN ] RFM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:41.794841] [INFO ] [MAIN ] RFM: Generated 1794 derivative records from 4158 primary records. [2025-09-29T22:14:41.794955] [DEBUG] [LOCAL ] RFM: Saving derivative data. [2025-09-29T22:14:41.829338] [DEBUG] [LOCAL ] RFM: Derivative data saved (1794 records). [2025-09-29T22:14:41.835834] [INFO ] [MAIN ] RFM: Successfully saved derivative data. [2025-09-29T22:14:41.836167] [DEBUG] [MAIN ] RFMZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:41.838520] [INFO ] [MAIN ] Derivative Progress: 1531/2057 symbols completed. RFM took 1.1s. Estimated remaining: 3m 34s. Rate: 147.8 symbols/min [2025-09-29T22:14:41.852278] [INFO ] [MAIN ] RFMZ: Generated 1794 derivative records from 8794 primary records. [2025-09-29T22:14:41.852856] [DEBUG] [MAIN ] RFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:41.853862] [INFO ] [MAIN ] RFL: Generated 1794 derivative records from 11077 primary records. [2025-09-29T22:14:41.853213] [DEBUG] [LOCAL ] RFMZ: Saving derivative data. [2025-09-29T22:14:41.853074] [INFO ] [MAIN ] RGA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:41.854749] [DEBUG] [LOCAL ] RFL: Saving derivative data. [2025-09-29T22:14:41.883783] [DEBUG] [LOCAL ] RFL: Derivative data saved (1794 records). [2025-09-29T22:14:41.884320] [INFO ] [MAIN ] RFL: Successfully saved derivative data. [2025-09-29T22:14:41.886791] [INFO ] [MAIN ] Derivative Progress: 1532/2057 symbols completed. RFL took 1.1s. Estimated remaining: 3m 33s. Rate: 147.9 symbols/min [2025-09-29T22:14:41.887374] [INFO ] [MAIN ] RGR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:41.892994] [DEBUG] [LOCAL ] RFMZ: Derivative data saved (1794 records). [2025-09-29T22:14:41.893228] [INFO ] [MAIN ] RFMZ: Successfully saved derivative data. [2025-09-29T22:14:41.896087] [INFO ] [MAIN ] Derivative Progress: 1533/2057 symbols completed. RFMZ took 1.1s. Estimated remaining: 3m 32s. Rate: 148.0 symbols/min [2025-09-29T22:14:41.896388] [INFO ] [MAIN ] RGT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:41.910898] [DEBUG] [LOCAL ] RGT: Loaded 2805 existing records from primary storage. [2025-09-29T22:14:41.915440] [INFO ] [MAIN ] RGT: Loaded 2805 primary data records. [2025-09-29T22:14:41.978821] [DEBUG] [LOCAL ] RGA: Loaded 29809 existing records from primary storage. [2025-09-29T22:14:41.990979] [INFO ] [MAIN ] RGA: Loaded 29809 primary data records. [2025-09-29T22:14:42.011589] [DEBUG] [LOCAL ] RGR: Loaded 20577 existing records from primary storage. [2025-09-29T22:14:42.027256] [INFO ] [MAIN ] RGR: Loaded 20577 primary data records. [2025-09-29T22:14:43.003775] [DEBUG] [MAIN ] RGT: Filtered 7001 bins outside market hours, 7823 incomplete bins [2025-09-29T22:14:43.005055] [INFO ] [MAIN ] RGT: Generated 1791 derivative records from 2805 primary records. [2025-09-29T22:14:43.005289] [DEBUG] [LOCAL ] RGT: Saving derivative data. [2025-09-29T22:14:43.026693] [DEBUG] [LOCAL ] RGT: Derivative data saved (1791 records). [2025-09-29T22:14:43.027471] [INFO ] [MAIN ] RGT: Successfully saved derivative data. [2025-09-29T22:14:43.029808] [INFO ] [MAIN ] Derivative Progress: 1534/2057 symbols completed. RGT took 1.1s. Estimated remaining: 3m 32s. Rate: 147.8 symbols/min [2025-09-29T22:14:43.030104] [INFO ] [MAIN ] RH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:43.052541] [DEBUG] [MAIN ] RGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:43.059169] [INFO ] [MAIN ] RGR: Generated 1794 derivative records from 20577 primary records. [2025-09-29T22:14:43.059695] [DEBUG] [LOCAL ] RGR: Saving derivative data. [2025-09-29T22:14:43.059556] [DEBUG] [MAIN ] RGA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:43.061396] [INFO ] [MAIN ] RGA: Generated 1794 derivative records from 29809 primary records. [2025-09-29T22:14:43.070545] [DEBUG] [LOCAL ] RGA: Saving derivative data. [2025-09-29T22:14:43.095881] [DEBUG] [LOCAL ] RGR: Derivative data saved (1794 records). [2025-09-29T22:14:43.096002] [INFO ] [MAIN ] RGR: Successfully saved derivative data. [2025-09-29T22:14:43.095718] [DEBUG] [LOCAL ] RGA: Derivative data saved (1794 records). [2025-09-29T22:14:43.098572] [INFO ] [MAIN ] Derivative Progress: 1535/2057 symbols completed. RGR took 1.2s. Estimated remaining: 3m 32s. Rate: 147.9 symbols/min [2025-09-29T22:14:43.098757] [INFO ] [MAIN ] RGA: Successfully saved derivative data. [2025-09-29T22:14:43.101492] [INFO ] [MAIN ] RHI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:43.101753] [INFO ] [MAIN ] Derivative Progress: 1536/2057 symbols completed. RGA took 1.2s. Estimated remaining: 3m 31s. Rate: 148.0 symbols/min [2025-09-29T22:14:43.113197] [INFO ] [MAIN ] RHP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:43.135282] [DEBUG] [LOCAL ] RH: Loaded 47622 existing records from primary storage. [2025-09-29T22:14:43.135444] [INFO ] [MAIN ] RH: Loaded 47622 primary data records. [2025-09-29T22:14:43.388349] [DEBUG] [LOCAL ] RHP: Loaded 41395 existing records from primary storage. [2025-09-29T22:14:43.402961] [INFO ] [MAIN ] RHP: Loaded 41395 primary data records. [2025-09-29T22:14:43.558778] [DEBUG] [LOCAL ] RHI: Loaded 49231 existing records from primary storage. [2025-09-29T22:14:43.586422] [INFO ] [MAIN ] RHI: Loaded 49231 primary data records. [2025-09-29T22:14:44.226686] [DEBUG] [MAIN ] RH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:44.228195] [INFO ] [MAIN ] RH: Generated 1794 derivative records from 47622 primary records. [2025-09-29T22:14:44.228424] [DEBUG] [LOCAL ] RH: Saving derivative data. [2025-09-29T22:14:44.263587] [DEBUG] [MAIN ] RHP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:44.265583] [INFO ] [MAIN ] RHP: Generated 1794 derivative records from 41395 primary records. [2025-09-29T22:14:44.265841] [DEBUG] [LOCAL ] RHP: Saving derivative data. [2025-09-29T22:14:44.285524] [DEBUG] [LOCAL ] RH: Derivative data saved (1794 records). [2025-09-29T22:14:44.286240] [INFO ] [MAIN ] RH: Successfully saved derivative data. [2025-09-29T22:14:44.289531] [INFO ] [MAIN ] Derivative Progress: 1537/2057 symbols completed. RH took 1.3s. Estimated remaining: 3m 31s. Rate: 147.8 symbols/min [2025-09-29T22:14:44.290330] [INFO ] [MAIN ] RIG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:44.306810] [DEBUG] [MAIN ] RHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:44.308551] [INFO ] [MAIN ] RHI: Generated 1794 derivative records from 49231 primary records. [2025-09-29T22:14:44.308914] [DEBUG] [LOCAL ] RHI: Saving derivative data. [2025-09-29T22:14:44.319063] [DEBUG] [LOCAL ] RHP: Derivative data saved (1794 records). [2025-09-29T22:14:44.324203] [INFO ] [MAIN ] RHP: Successfully saved derivative data. [2025-09-29T22:14:44.327763] [INFO ] [MAIN ] Derivative Progress: 1538/2057 symbols completed. RHP took 1.2s. Estimated remaining: 3m 31s. Rate: 147.9 symbols/min [2025-09-29T22:14:44.328762] [INFO ] [MAIN ] RIO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:44.332241] [DEBUG] [LOCAL ] RHI: Derivative data saved (1794 records). [2025-09-29T22:14:44.332427] [INFO ] [MAIN ] RHI: Successfully saved derivative data. [2025-09-29T22:14:44.334767] [INFO ] [MAIN ] Derivative Progress: 1539/2057 symbols completed. RHI took 1.2s. Estimated remaining: 3m 30s. Rate: 148.0 symbols/min [2025-09-29T22:14:44.335141] [INFO ] [MAIN ] RITM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:44.398496] [DEBUG] [LOCAL ] RIG: Loaded 53670 existing records from primary storage. [2025-09-29T22:14:44.398804] [INFO ] [MAIN ] RIG: Loaded 53670 primary data records. [2025-09-29T22:14:44.548913] [DEBUG] [LOCAL ] RIO: Loaded 53394 existing records from primary storage. [2025-09-29T22:14:44.560067] [INFO ] [MAIN ] RIO: Loaded 53394 primary data records. [2025-09-29T22:14:44.795945] [DEBUG] [LOCAL ] RITM: Loaded 52816 existing records from primary storage. [2025-09-29T22:14:44.905688] [INFO ] [MAIN ] RITM: Loaded 52816 primary data records. [2025-09-29T22:14:45.473383] [DEBUG] [MAIN ] RIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:45.474820] [INFO ] [MAIN ] RIG: Generated 1794 derivative records from 53670 primary records. [2025-09-29T22:14:45.482970] [DEBUG] [LOCAL ] RIG: Saving derivative data. [2025-09-29T22:14:45.489605] [DEBUG] [MAIN ] RIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:45.500132] [INFO ] [MAIN ] RIO: Generated 1794 derivative records from 53394 primary records. [2025-09-29T22:14:45.503604] [DEBUG] [LOCAL ] RIO: Saving derivative data. [2025-09-29T22:14:45.549090] [DEBUG] [LOCAL ] RIG: Derivative data saved (1794 records). [2025-09-29T22:14:45.549284] [INFO ] [MAIN ] RIG: Successfully saved derivative data. [2025-09-29T22:14:45.549007] [DEBUG] [MAIN ] RITM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:45.550274] [INFO ] [MAIN ] RITM: Generated 1794 derivative records from 52816 primary records. [2025-09-29T22:14:45.553233] [INFO ] [MAIN ] Derivative Progress: 1540/2057 symbols completed. RIG took 1.3s. Estimated remaining: 3m 30s. Rate: 147.8 symbols/min [2025-09-29T22:14:45.547976] [DEBUG] [LOCAL ] RIO: Derivative data saved (1794 records). [2025-09-29T22:14:45.553530] [DEBUG] [LOCAL ] RITM: Saving derivative data. [2025-09-29T22:14:45.553778] [INFO ] [MAIN ] RIV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:45.554609] [INFO ] [MAIN ] RIO: Successfully saved derivative data. [2025-09-29T22:14:45.560915] [INFO ] [MAIN ] Derivative Progress: 1541/2057 symbols completed. RIO took 1.2s. Estimated remaining: 3m 29s. Rate: 147.9 symbols/min [2025-09-29T22:14:45.568799] [INFO ] [MAIN ] RJF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:45.579720] [DEBUG] [LOCAL ] RITM: Derivative data saved (1794 records). [2025-09-29T22:14:45.580969] [INFO ] [MAIN ] RITM: Successfully saved derivative data. [2025-09-29T22:14:45.583482] [INFO ] [MAIN ] Derivative Progress: 1542/2057 symbols completed. RITM took 1.2s. Estimated remaining: 3m 29s. Rate: 148.0 symbols/min [2025-09-29T22:14:45.583881] [INFO ] [MAIN ] RKT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:45.601513] [DEBUG] [LOCAL ] RIV: Loaded 12068 existing records from primary storage. [2025-09-29T22:14:45.601713] [INFO ] [MAIN ] RIV: Loaded 12068 primary data records. [2025-09-29T22:14:45.832745] [DEBUG] [LOCAL ] RJF: Loaded 47030 existing records from primary storage. [2025-09-29T22:14:45.868417] [INFO ] [MAIN ] RJF: Loaded 47030 primary data records. [2025-09-29T22:14:45.994538] [DEBUG] [LOCAL ] RKT: Loaded 53721 existing records from primary storage. [2025-09-29T22:14:46.018164] [INFO ] [MAIN ] RKT: Loaded 53721 primary data records. [2025-09-29T22:14:46.723859] [DEBUG] [MAIN ] RIV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:46.726125] [INFO ] [MAIN ] RIV: Generated 1794 derivative records from 12068 primary records. [2025-09-29T22:14:46.727107] [DEBUG] [LOCAL ] RIV: Saving derivative data. [2025-09-29T22:14:46.750712] [DEBUG] [LOCAL ] RIV: Derivative data saved (1794 records). [2025-09-29T22:14:46.751194] [INFO ] [MAIN ] RIV: Successfully saved derivative data. [2025-09-29T22:14:46.753762] [INFO ] [MAIN ] Derivative Progress: 1543/2057 symbols completed. RIV took 1.2s. Estimated remaining: 3m 29s. Rate: 147.8 symbols/min [2025-09-29T22:14:46.779934] [DEBUG] [MAIN ] RKT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:46.780974] [INFO ] [MAIN ] RKT: Generated 1794 derivative records from 53721 primary records. [2025-09-29T22:14:46.781173] [DEBUG] [LOCAL ] RKT: Saving derivative data. [2025-09-29T22:14:46.815944] [DEBUG] [MAIN ] RJF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:46.818719] [DEBUG] [LOCAL ] RKT: Derivative data saved (1794 records). [2025-09-29T22:14:46.819840] [INFO ] [MAIN ] RJF: Generated 1794 derivative records from 47030 primary records. [2025-09-29T22:14:46.819961] [INFO ] [MAIN ] RKT: Successfully saved derivative data. [2025-09-29T22:14:46.822395] [INFO ] [MAIN ] Derivative Progress: 1544/2057 symbols completed. RKT took 1.2s. Estimated remaining: 3m 28s. Rate: 147.9 symbols/min [2025-09-29T22:14:46.822680] [DEBUG] [LOCAL ] RJF: Saving derivative data. [2025-09-29T22:14:46.846540] [DEBUG] [LOCAL ] RJF: Derivative data saved (1794 records). [2025-09-29T22:14:46.846631] [INFO ] [MAIN ] RJF: Successfully saved derivative data. [2025-09-29T22:14:46.849202] [INFO ] [MAIN ] Derivative Progress: 1545/2057 symbols completed. RJF took 1.3s. Estimated remaining: 3m 28s. Rate: 148.0 symbols/min [2025-09-29T22:14:46.849827] [INFO ] [MAIN ] RLI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:46.849938] [INFO ] [MAIN ] RLJ: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:46.849758] [INFO ] [MAIN ] RL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:46.894242] [DEBUG] [LOCAL ] RLI: Loaded 33377 existing records from primary storage. [2025-09-29T22:14:46.894610] [INFO ] [MAIN ] RLI: Loaded 33377 primary data records. [2025-09-29T22:14:47.045678] [DEBUG] [LOCAL ] RL: Loaded 41166 existing records from primary storage. [2025-09-29T22:14:47.079165] [DEBUG] [LOCAL ] RLJ: Loaded 48129 existing records from primary storage. [2025-09-29T22:14:47.104816] [INFO ] [MAIN ] RLJ: Loaded 48129 primary data records. [2025-09-29T22:14:47.073112] [INFO ] [MAIN ] RL: Loaded 41166 primary data records. [2025-09-29T22:14:47.930287] [DEBUG] [MAIN ] RLI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:47.932896] [INFO ] [MAIN ] RLI: Generated 1794 derivative records from 33377 primary records. [2025-09-29T22:14:47.933161] [DEBUG] [LOCAL ] RLI: Saving derivative data. [2025-09-29T22:14:47.960609] [DEBUG] [MAIN ] RLJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:47.962373] [INFO ] [MAIN ] RLJ: Generated 1794 derivative records from 48129 primary records. [2025-09-29T22:14:47.962901] [DEBUG] [LOCAL ] RLJ: Saving derivative data. [2025-09-29T22:14:47.979046] [DEBUG] [LOCAL ] RLI: Derivative data saved (1794 records). [2025-09-29T22:14:47.982382] [INFO ] [MAIN ] RLI: Successfully saved derivative data. [2025-09-29T22:14:47.987075] [INFO ] [MAIN ] Derivative Progress: 1546/2057 symbols completed. RLI took 1.1s. Estimated remaining: 3m 27s. Rate: 147.8 symbols/min [2025-09-29T22:14:47.987384] [INFO ] [MAIN ] RLTY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:47.984927] [DEBUG] [LOCAL ] RLJ: Derivative data saved (1794 records). [2025-09-29T22:14:47.987738] [INFO ] [MAIN ] RLJ: Successfully saved derivative data. [2025-09-29T22:14:47.990504] [INFO ] [MAIN ] Derivative Progress: 1547/2057 symbols completed. RLJ took 1.1s. Estimated remaining: 3m 27s. Rate: 147.9 symbols/min [2025-09-29T22:14:47.990993] [INFO ] [MAIN ] RLX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:48.004964] [DEBUG] [MAIN ] RL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:48.005905] [INFO ] [MAIN ] RL: Generated 1794 derivative records from 41166 primary records. [2025-09-29T22:14:48.006095] [DEBUG] [LOCAL ] RL: Saving derivative data. [2025-09-29T22:14:48.025869] [DEBUG] [LOCAL ] RL: Derivative data saved (1794 records). [2025-09-29T22:14:48.026082] [INFO ] [MAIN ] RL: Successfully saved derivative data. [2025-09-29T22:14:48.029051] [INFO ] [MAIN ] Derivative Progress: 1548/2057 symbols completed. RL took 1.2s. Estimated remaining: 3m 26s. Rate: 148.0 symbols/min [2025-09-29T22:14:48.029330] [INFO ] [MAIN ] RM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:48.035042] [DEBUG] [LOCAL ] RLTY: Loaded 11119 existing records from primary storage. [2025-09-29T22:14:48.035211] [INFO ] [MAIN ] RLTY: Loaded 11119 primary data records. [2025-09-29T22:14:48.125437] [DEBUG] [LOCAL ] RM: Loaded 7558 existing records from primary storage. [2025-09-29T22:14:48.148489] [INFO ] [MAIN ] RM: Loaded 7558 primary data records. [2025-09-29T22:14:48.522093] [DEBUG] [LOCAL ] RLX: Loaded 48326 existing records from primary storage. [2025-09-29T22:14:48.538004] [INFO ] [MAIN ] RLX: Loaded 48326 primary data records. [2025-09-29T22:14:49.112086] [DEBUG] [MAIN ] RLTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:49.113113] [INFO ] [MAIN ] RLTY: Generated 1794 derivative records from 11119 primary records. [2025-09-29T22:14:49.113215] [DEBUG] [LOCAL ] RLTY: Saving derivative data. [2025-09-29T22:14:49.127544] [DEBUG] [MAIN ] RM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:49.143485] [INFO ] [MAIN ] RM: Generated 1794 derivative records from 7558 primary records. [2025-09-29T22:14:49.144832] [DEBUG] [LOCAL ] RLTY: Derivative data saved (1794 records). [2025-09-29T22:14:49.144950] [DEBUG] [LOCAL ] RM: Saving derivative data. [2025-09-29T22:14:49.145034] [INFO ] [MAIN ] RLTY: Successfully saved derivative data. [2025-09-29T22:14:49.148265] [INFO ] [MAIN ] Derivative Progress: 1549/2057 symbols completed. RLTY took 1.2s. Estimated remaining: 3m 26s. Rate: 147.8 symbols/min [2025-09-29T22:14:49.156354] [INFO ] [MAIN ] RMAX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:49.166243] [DEBUG] [LOCAL ] RM: Derivative data saved (1794 records). [2025-09-29T22:14:49.166615] [INFO ] [MAIN ] RM: Successfully saved derivative data. [2025-09-29T22:14:49.169151] [INFO ] [MAIN ] Derivative Progress: 1550/2057 symbols completed. RM took 1.1s. Estimated remaining: 3m 26s. Rate: 147.9 symbols/min [2025-09-29T22:14:49.169390] [INFO ] [MAIN ] RMD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:49.192827] [DEBUG] [MAIN ] RLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:49.193557] [INFO ] [MAIN ] RLX: Generated 1794 derivative records from 48326 primary records. [2025-09-29T22:14:49.193822] [DEBUG] [LOCAL ] RLX: Saving derivative data. [2025-09-29T22:14:49.216062] [DEBUG] [LOCAL ] RMAX: Loaded 21510 existing records from primary storage. [2025-09-29T22:14:49.219267] [DEBUG] [LOCAL ] RLX: Derivative data saved (1794 records). [2025-09-29T22:14:49.218579] [INFO ] [MAIN ] RMAX: Loaded 21510 primary data records. [2025-09-29T22:14:49.219887] [INFO ] [MAIN ] RLX: Successfully saved derivative data. [2025-09-29T22:14:49.222116] [INFO ] [MAIN ] Derivative Progress: 1551/2057 symbols completed. RLX took 1.2s. Estimated remaining: 3m 25s. Rate: 148.0 symbols/min [2025-09-29T22:14:49.222526] [INFO ] [MAIN ] RMI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:49.357206] [DEBUG] [LOCAL ] RMI: Loaded 4681 existing records from primary storage. [2025-09-29T22:14:49.357793] [INFO ] [MAIN ] RMI: Loaded 4681 primary data records. [2025-09-29T22:14:49.391080] [DEBUG] [LOCAL ] RMD: Loaded 42059 existing records from primary storage. [2025-09-29T22:14:49.466738] [INFO ] [MAIN ] RMD: Loaded 42059 primary data records. [2025-09-29T22:14:50.224418] [DEBUG] [MAIN ] RMAX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:50.225758] [INFO ] [MAIN ] RMAX: Generated 1794 derivative records from 21510 primary records. [2025-09-29T22:14:50.226109] [DEBUG] [LOCAL ] RMAX: Saving derivative data. [2025-09-29T22:14:50.242085] [DEBUG] [MAIN ] RMI: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-09-29T22:14:50.254332] [INFO ] [MAIN ] RMI: Generated 1792 derivative records from 4681 primary records. [2025-09-29T22:14:50.255119] [DEBUG] [LOCAL ] RMI: Saving derivative data. [2025-09-29T22:14:50.277071] [DEBUG] [LOCAL ] RMI: Derivative data saved (1792 records). [2025-09-29T22:14:50.278959] [DEBUG] [LOCAL ] RMAX: Derivative data saved (1794 records). [2025-09-29T22:14:50.280023] [INFO ] [MAIN ] RMI: Successfully saved derivative data. [2025-09-29T22:14:50.282889] [INFO ] [MAIN ] Derivative Progress: 1552/2057 symbols completed. RMI took 1.1s. Estimated remaining: 3m 25s. Rate: 147.8 symbols/min [2025-09-29T22:14:50.283098] [INFO ] [MAIN ] RMAX: Successfully saved derivative data. [2025-09-29T22:14:50.283509] [INFO ] [MAIN ] RMM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:50.286095] [INFO ] [MAIN ] Derivative Progress: 1553/2057 symbols completed. RMAX took 1.1s. Estimated remaining: 3m 24s. Rate: 147.9 symbols/min [2025-09-29T22:14:50.300091] [INFO ] [MAIN ] RMMZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:50.302110] [DEBUG] [MAIN ] RMD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:50.303349] [INFO ] [MAIN ] RMD: Generated 1794 derivative records from 42059 primary records. [2025-09-29T22:14:50.303564] [DEBUG] [LOCAL ] RMD: Saving derivative data. [2025-09-29T22:14:50.328098] [DEBUG] [LOCAL ] RMD: Derivative data saved (1794 records). [2025-09-29T22:14:50.328436] [INFO ] [MAIN ] RMD: Successfully saved derivative data. [2025-09-29T22:14:50.334210] [INFO ] [MAIN ] Derivative Progress: 1554/2057 symbols completed. RMD took 1.2s. Estimated remaining: 3m 24s. Rate: 148.0 symbols/min [2025-09-29T22:14:50.331820] [DEBUG] [LOCAL ] RMMZ: Loaded 4827 existing records from primary storage. [2025-09-29T22:14:50.334757] [INFO ] [MAIN ] RMMZ: Loaded 4827 primary data records. [2025-09-29T22:14:50.352158] [DEBUG] [LOCAL ] RMM: Loaded 10536 existing records from primary storage. [2025-09-29T22:14:50.375020] [INFO ] [MAIN ] RMT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:50.380569] [INFO ] [MAIN ] RMM: Loaded 10536 primary data records. [2025-09-29T22:14:50.684186] [DEBUG] [LOCAL ] RMT: Loaded 17362 existing records from primary storage. [2025-09-29T22:14:50.694447] [INFO ] [MAIN ] RMT: Loaded 17362 primary data records. [2025-09-29T22:14:51.736534] [DEBUG] [MAIN ] RMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:51.740191] [INFO ] [MAIN ] RMM: Generated 1794 derivative records from 10536 primary records. [2025-09-29T22:14:51.741189] [DEBUG] [LOCAL ] RMM: Saving derivative data. [2025-09-29T22:14:51.770420] [DEBUG] [MAIN ] RMMZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:51.771909] [INFO ] [MAIN ] RMMZ: Generated 1794 derivative records from 4827 primary records. [2025-09-29T22:14:51.772425] [DEBUG] [LOCAL ] RMMZ: Saving derivative data. [2025-09-29T22:14:51.791068] [DEBUG] [LOCAL ] RMM: Derivative data saved (1794 records). [2025-09-29T22:14:51.795683] [INFO ] [MAIN ] RMM: Successfully saved derivative data. [2025-09-29T22:14:51.799441] [INFO ] [MAIN ] Derivative Progress: 1555/2057 symbols completed. RMM took 1.5s. Estimated remaining: 3m 24s. Rate: 147.7 symbols/min [2025-09-29T22:14:51.800262] [INFO ] [MAIN ] RNG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:51.801295] [DEBUG] [LOCAL ] RMMZ: Derivative data saved (1794 records). [2025-09-29T22:14:51.801572] [INFO ] [MAIN ] RMMZ: Successfully saved derivative data. [2025-09-29T22:14:51.818770] [INFO ] [MAIN ] Derivative Progress: 1556/2057 symbols completed. RMMZ took 1.5s. Estimated remaining: 3m 23s. Rate: 147.8 symbols/min [2025-09-29T22:14:51.819794] [INFO ] [MAIN ] RNGR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:51.819603] [DEBUG] [MAIN ] RMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:51.820995] [INFO ] [MAIN ] RMT: Generated 1794 derivative records from 17362 primary records. [2025-09-29T22:14:51.821414] [DEBUG] [LOCAL ] RMT: Saving derivative data. [2025-09-29T22:14:51.841099] [DEBUG] [LOCAL ] RMT: Derivative data saved (1794 records). [2025-09-29T22:14:51.841288] [INFO ] [MAIN ] RMT: Successfully saved derivative data. [2025-09-29T22:14:51.844104] [INFO ] [MAIN ] Derivative Progress: 1557/2057 symbols completed. RMT took 1.5s. Estimated remaining: 3m 23s. Rate: 147.9 symbols/min [2025-09-29T22:14:51.844474] [INFO ] [MAIN ] RNR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:51.863480] [DEBUG] [LOCAL ] RNGR: Loaded 20343 existing records from primary storage. [2025-09-29T22:14:51.875897] [INFO ] [MAIN ] RNGR: Loaded 20343 primary data records. [2025-09-29T22:14:52.022913] [DEBUG] [LOCAL ] RNG: Loaded 48025 existing records from primary storage. [2025-09-29T22:14:52.053580] [INFO ] [MAIN ] RNG: Loaded 48025 primary data records. [2025-09-29T22:14:52.118067] [DEBUG] [LOCAL ] RNR: Loaded 33947 existing records from primary storage. [2025-09-29T22:14:52.124437] [INFO ] [MAIN ] RNR: Loaded 33947 primary data records. [2025-09-29T22:14:52.916375] [DEBUG] [MAIN ] RNGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:52.917984] [INFO ] [MAIN ] RNGR: Generated 1794 derivative records from 20343 primary records. [2025-09-29T22:14:52.918269] [DEBUG] [LOCAL ] RNGR: Saving derivative data. [2025-09-29T22:14:52.940703] [DEBUG] [LOCAL ] RNGR: Derivative data saved (1794 records). [2025-09-29T22:14:52.940937] [INFO ] [MAIN ] RNGR: Successfully saved derivative data. [2025-09-29T22:14:52.943035] [INFO ] [MAIN ] Derivative Progress: 1558/2057 symbols completed. RNGR took 1.1s. Estimated remaining: 3m 23s. Rate: 147.8 symbols/min [2025-09-29T22:14:52.957090] [DEBUG] [MAIN ] RNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:52.957932] [INFO ] [MAIN ] RNG: Generated 1794 derivative records from 48025 primary records. [2025-09-29T22:14:52.958017] [DEBUG] [LOCAL ] RNG: Saving derivative data. [2025-09-29T22:14:52.990883] [DEBUG] [LOCAL ] RNG: Derivative data saved (1794 records). [2025-09-29T22:14:52.991460] [INFO ] [MAIN ] RNG: Successfully saved derivative data. [2025-09-29T22:14:52.991224] [DEBUG] [MAIN ] RNR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:52.994698] [INFO ] [MAIN ] RNR: Generated 1794 derivative records from 33947 primary records. [2025-09-29T22:14:52.993915] [INFO ] [MAIN ] Derivative Progress: 1559/2057 symbols completed. RNG took 1.2s. Estimated remaining: 3m 22s. Rate: 147.8 symbols/min [2025-09-29T22:14:52.994852] [DEBUG] [LOCAL ] RNR: Saving derivative data. [2025-09-29T22:14:53.011845] [DEBUG] [LOCAL ] RNR: Derivative data saved (1794 records). [2025-09-29T22:14:53.011979] [INFO ] [MAIN ] RNR: Successfully saved derivative data. [2025-09-29T22:14:53.014012] [INFO ] [MAIN ] Derivative Progress: 1560/2057 symbols completed. RNR took 1.2s. Estimated remaining: 3m 22s. Rate: 147.9 symbols/min [2025-09-29T22:14:53.014635] [INFO ] [MAIN ] ROG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:53.015054] [INFO ] [MAIN ] ROK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:53.014576] [INFO ] [MAIN ] RNST: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:53.068639] [DEBUG] [LOCAL ] ROG: Loaded 23095 existing records from primary storage. [2025-09-29T22:14:53.068905] [INFO ] [MAIN ] ROG: Loaded 23095 primary data records. [2025-09-29T22:14:53.256212] [DEBUG] [LOCAL ] ROK: Loaded 43765 existing records from primary storage. [2025-09-29T22:14:53.283426] [INFO ] [MAIN ] ROK: Loaded 43765 primary data records. [2025-09-29T22:14:53.288060] [DEBUG] [LOCAL ] RNST: Loaded 37044 existing records from primary storage. [2025-09-29T22:14:53.317541] [INFO ] [MAIN ] RNST: Loaded 37044 primary data records. [2025-09-29T22:14:54.184710] [DEBUG] [MAIN ] ROG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:54.185921] [INFO ] [MAIN ] ROG: Generated 1794 derivative records from 23095 primary records. [2025-09-29T22:14:54.186218] [DEBUG] [LOCAL ] ROG: Saving derivative data. [2025-09-29T22:14:54.207363] [DEBUG] [LOCAL ] ROG: Derivative data saved (1794 records). [2025-09-29T22:14:54.207858] [INFO ] [MAIN ] ROG: Successfully saved derivative data. [2025-09-29T22:14:54.210185] [INFO ] [MAIN ] Derivative Progress: 1561/2057 symbols completed. ROG took 1.2s. Estimated remaining: 3m 21s. Rate: 147.8 symbols/min [2025-09-29T22:14:54.210701] [INFO ] [MAIN ] ROL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:54.231002] [DEBUG] [MAIN ] ROK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:54.243994] [INFO ] [MAIN ] ROK: Generated 1794 derivative records from 43765 primary records. [2025-09-29T22:14:54.244801] [DEBUG] [LOCAL ] ROK: Saving derivative data. [2025-09-29T22:14:54.244750] [DEBUG] [MAIN ] RNST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:54.245445] [INFO ] [MAIN ] RNST: Generated 1794 derivative records from 37044 primary records. [2025-09-29T22:14:54.246063] [DEBUG] [LOCAL ] RNST: Saving derivative data. [2025-09-29T22:14:54.277999] [DEBUG] [LOCAL ] RNST: Derivative data saved (1794 records). [2025-09-29T22:14:54.278613] [INFO ] [MAIN ] RNST: Successfully saved derivative data. [2025-09-29T22:14:54.281143] [INFO ] [MAIN ] Derivative Progress: 1562/2057 symbols completed. RNST took 1.3s. Estimated remaining: 3m 21s. Rate: 147.8 symbols/min [2025-09-29T22:14:54.281631] [DEBUG] [LOCAL ] ROK: Derivative data saved (1794 records). [2025-09-29T22:14:54.281840] [INFO ] [MAIN ] RPM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:54.282395] [INFO ] [MAIN ] ROK: Successfully saved derivative data. [2025-09-29T22:14:54.284815] [INFO ] [MAIN ] Derivative Progress: 1563/2057 symbols completed. ROK took 1.3s. Estimated remaining: 3m 20s. Rate: 147.9 symbols/min [2025-09-29T22:14:54.296693] [INFO ] [MAIN ] RPT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:54.323681] [DEBUG] [LOCAL ] ROL: Loaded 50261 existing records from primary storage. [2025-09-29T22:14:54.324616] [INFO ] [MAIN ] ROL: Loaded 50261 primary data records. [2025-09-29T22:14:54.419389] [DEBUG] [LOCAL ] RPT: Loaded 19317 existing records from primary storage. [2025-09-29T22:14:54.459235] [INFO ] [MAIN ] RPT: Loaded 19317 primary data records. [2025-09-29T22:14:54.656953] [DEBUG] [LOCAL ] RPM: Loaded 41277 existing records from primary storage. [2025-09-29T22:14:54.803529] [INFO ] [MAIN ] RPM: Loaded 41277 primary data records. [2025-09-29T22:14:55.434388] [DEBUG] [MAIN ] ROL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:55.436523] [INFO ] [MAIN ] ROL: Generated 1794 derivative records from 50261 primary records. [2025-09-29T22:14:55.436694] [DEBUG] [LOCAL ] ROL: Saving derivative data. [2025-09-29T22:14:55.472908] [DEBUG] [LOCAL ] ROL: Derivative data saved (1794 records). [2025-09-29T22:14:55.473711] [DEBUG] [MAIN ] RPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:55.474665] [INFO ] [MAIN ] ROL: Successfully saved derivative data. [2025-09-29T22:14:55.477078] [INFO ] [MAIN ] Derivative Progress: 1564/2057 symbols completed. ROL took 1.3s. Estimated remaining: 3m 20s. Rate: 147.7 symbols/min [2025-09-29T22:14:55.474551] [INFO ] [MAIN ] RPT: Generated 1794 derivative records from 19317 primary records. [2025-09-29T22:14:55.477466] [INFO ] [MAIN ] RQI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:55.477738] [DEBUG] [LOCAL ] RPT: Saving derivative data. [2025-09-29T22:14:55.498906] [DEBUG] [LOCAL ] RPT: Derivative data saved (1794 records). [2025-09-29T22:14:55.499174] [INFO ] [MAIN ] RPT: Successfully saved derivative data. [2025-09-29T22:14:55.501846] [INFO ] [MAIN ] Derivative Progress: 1565/2057 symbols completed. RPT took 1.2s. Estimated remaining: 3m 20s. Rate: 147.8 symbols/min [2025-09-29T22:14:55.502163] [INFO ] [MAIN ] RRC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:55.516519] [DEBUG] [MAIN ] RPM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:55.525575] [INFO ] [MAIN ] RPM: Generated 1794 derivative records from 41277 primary records. [2025-09-29T22:14:55.525945] [DEBUG] [LOCAL ] RPM: Saving derivative data. [2025-09-29T22:14:55.543886] [DEBUG] [LOCAL ] RPM: Derivative data saved (1794 records). [2025-09-29T22:14:55.553530] [INFO ] [MAIN ] RPM: Successfully saved derivative data. [2025-09-29T22:14:55.556535] [INFO ] [MAIN ] Derivative Progress: 1566/2057 symbols completed. RPM took 1.3s. Estimated remaining: 3m 19s. Rate: 147.9 symbols/min [2025-09-29T22:14:55.558197] [DEBUG] [LOCAL ] RQI: Loaded 29133 existing records from primary storage. [2025-09-29T22:14:55.558447] [INFO ] [MAIN ] RRX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:55.558620] [INFO ] [MAIN ] RQI: Loaded 29133 primary data records. [2025-09-29T22:14:55.915269] [DEBUG] [LOCAL ] RRC: Loaded 52775 existing records from primary storage. [2025-09-29T22:14:55.915750] [INFO ] [MAIN ] RRC: Loaded 52775 primary data records. [2025-09-29T22:14:56.041106] [DEBUG] [LOCAL ] RRX: Loaded 41073 existing records from primary storage. [2025-09-29T22:14:56.045230] [INFO ] [MAIN ] RRX: Loaded 41073 primary data records. [2025-09-29T22:14:56.600718] [DEBUG] [MAIN ] RQI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:56.602280] [INFO ] [MAIN ] RQI: Generated 1794 derivative records from 29133 primary records. [2025-09-29T22:14:56.602710] [DEBUG] [LOCAL ] RQI: Saving derivative data. [2025-09-29T22:14:56.630489] [DEBUG] [LOCAL ] RQI: Derivative data saved (1794 records). [2025-09-29T22:14:56.638517] [INFO ] [MAIN ] RQI: Successfully saved derivative data. [2025-09-29T22:14:56.645921] [INFO ] [MAIN ] Derivative Progress: 1567/2057 symbols completed. RQI took 1.2s. Estimated remaining: 3m 19s. Rate: 147.8 symbols/min [2025-09-29T22:14:56.646710] [INFO ] [MAIN ] RS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:56.646591] [DEBUG] [MAIN ] RRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:56.647911] [INFO ] [MAIN ] RRC: Generated 1794 derivative records from 52775 primary records. [2025-09-29T22:14:56.648208] [DEBUG] [LOCAL ] RRC: Saving derivative data. [2025-09-29T22:14:56.665564] [DEBUG] [LOCAL ] RRC: Derivative data saved (1794 records). [2025-09-29T22:14:56.667124] [INFO ] [MAIN ] RRC: Successfully saved derivative data. [2025-09-29T22:14:56.669317] [INFO ] [MAIN ] Derivative Progress: 1568/2057 symbols completed. RRC took 1.2s. Estimated remaining: 3m 18s. Rate: 147.8 symbols/min [2025-09-29T22:14:56.671021] [INFO ] [MAIN ] RSF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:56.700637] [DEBUG] [LOCAL ] RSF: Loaded 4180 existing records from primary storage. [2025-09-29T22:14:56.709071] [INFO ] [MAIN ] RSF: Loaded 4180 primary data records. [2025-09-29T22:14:56.709532] [DEBUG] [MAIN ] RRX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:56.722632] [INFO ] [MAIN ] RRX: Generated 1794 derivative records from 41073 primary records. [2025-09-29T22:14:56.799915] [DEBUG] [LOCAL ] RRX: Saving derivative data. [2025-09-29T22:14:56.826356] [DEBUG] [LOCAL ] RS: Loaded 25466 existing records from primary storage. [2025-09-29T22:14:56.837859] [INFO ] [MAIN ] RS: Loaded 25466 primary data records. [2025-09-29T22:14:57.173114] [DEBUG] [LOCAL ] RRX: Derivative data saved (1794 records). [2025-09-29T22:14:57.189895] [INFO ] [MAIN ] RRX: Successfully saved derivative data. [2025-09-29T22:14:57.254628] [INFO ] [MAIN ] Derivative Progress: 1569/2057 symbols completed. RRX took 1.7s. Estimated remaining: 3m 18s. Rate: 147.8 symbols/min [2025-09-29T22:14:57.411536] [INFO ] [MAIN ] RSG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:57.451076] [DEBUG] [MAIN ] RSF: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:14:57.452041] [INFO ] [MAIN ] RSF: Generated 1793 derivative records from 4180 primary records. [2025-09-29T22:14:57.452267] [DEBUG] [LOCAL ] RSF: Saving derivative data. [2025-09-29T22:14:57.481199] [DEBUG] [LOCAL ] RSF: Derivative data saved (1793 records). [2025-09-29T22:14:57.481361] [INFO ] [MAIN ] RSF: Successfully saved derivative data. [2025-09-29T22:14:57.483755] [INFO ] [MAIN ] Derivative Progress: 1570/2057 symbols completed. RSF took 0.8s. Estimated remaining: 3m 18s. Rate: 147.8 symbols/min [2025-09-29T22:14:57.484084] [INFO ] [MAIN ] RSI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:57.498850] [DEBUG] [MAIN ] RS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:57.499896] [INFO ] [MAIN ] RS: Generated 1794 derivative records from 25466 primary records. [2025-09-29T22:14:57.513033] [DEBUG] [LOCAL ] RS: Saving derivative data. [2025-09-29T22:14:57.514435] [DEBUG] [LOCAL ] RSG: Loaded 47404 existing records from primary storage. [2025-09-29T22:14:57.514850] [INFO ] [MAIN ] RSG: Loaded 47404 primary data records. [2025-09-29T22:14:57.680548] [DEBUG] [LOCAL ] RS: Derivative data saved (1794 records). [2025-09-29T22:14:57.738194] [INFO ] [MAIN ] RS: Successfully saved derivative data. [2025-09-29T22:14:57.864030] [INFO ] [MAIN ] Derivative Progress: 1571/2057 symbols completed. RS took 1.2s. Estimated remaining: 3m 17s. Rate: 147.8 symbols/min [2025-09-29T22:14:57.882333] [INFO ] [MAIN ] RSKD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:57.886066] [DEBUG] [LOCAL ] RSI: Loaded 46865 existing records from primary storage. [2025-09-29T22:14:57.886482] [INFO ] [MAIN ] RSI: Loaded 46865 primary data records. [2025-09-29T22:14:58.221364] [DEBUG] [LOCAL ] RSKD: Loaded 33624 existing records from primary storage. [2025-09-29T22:14:58.231929] [INFO ] [MAIN ] RSKD: Loaded 33624 primary data records. [2025-09-29T22:14:58.373850] [DEBUG] [MAIN ] RSG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:58.380623] [INFO ] [MAIN ] RSG: Generated 1794 derivative records from 47404 primary records. [2025-09-29T22:14:58.386047] [DEBUG] [LOCAL ] RSG: Saving derivative data. [2025-09-29T22:14:58.591360] [DEBUG] [LOCAL ] RSG: Derivative data saved (1794 records). [2025-09-29T22:14:58.605539] [INFO ] [MAIN ] RSG: Successfully saved derivative data. [2025-09-29T22:14:58.609324] [INFO ] [MAIN ] Derivative Progress: 1572/2057 symbols completed. RSG took 1.2s. Estimated remaining: 3m 17s. Rate: 147.8 symbols/min [2025-09-29T22:14:58.609897] [INFO ] [MAIN ] RTO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:58.633253] [DEBUG] [MAIN ] RSI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:58.634417] [INFO ] [MAIN ] RSI: Generated 1794 derivative records from 46865 primary records. [2025-09-29T22:14:58.634585] [DEBUG] [LOCAL ] RSI: Saving derivative data. [2025-09-29T22:14:58.664161] [DEBUG] [LOCAL ] RSI: Derivative data saved (1794 records). [2025-09-29T22:14:58.664298] [INFO ] [MAIN ] RSI: Successfully saved derivative data. [2025-09-29T22:14:58.666436] [INFO ] [MAIN ] Derivative Progress: 1573/2057 symbols completed. RSI took 1.2s. Estimated remaining: 3m 16s. Rate: 147.9 symbols/min [2025-09-29T22:14:58.686819] [DEBUG] [MAIN ] RSKD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:58.688174] [INFO ] [MAIN ] RSKD: Generated 1794 derivative records from 33624 primary records. [2025-09-29T22:14:58.698778] [DEBUG] [LOCAL ] RSKD: Saving derivative data. [2025-09-29T22:14:58.701964] [DEBUG] [LOCAL ] RTO: Loaded 40007 existing records from primary storage. [2025-09-29T22:14:58.711013] [INFO ] [MAIN ] RTO: Loaded 40007 primary data records. [2025-09-29T22:14:58.856131] [DEBUG] [LOCAL ] RSKD: Derivative data saved (1794 records). [2025-09-29T22:14:58.888267] [INFO ] [MAIN ] RSKD: Successfully saved derivative data. [2025-09-29T22:14:58.892815] [INFO ] [MAIN ] Derivative Progress: 1574/2057 symbols completed. RSKD took 1.0s. Estimated remaining: 3m 16s. Rate: 147.9 symbols/min [2025-09-29T22:14:59.054114] [DEBUG] [MAIN ] RTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:14:59.054899] [INFO ] [MAIN ] RTO: Generated 1794 derivative records from 40007 primary records. [2025-09-29T22:14:59.054968] [DEBUG] [LOCAL ] RTO: Saving derivative data. [2025-09-29T22:14:59.070466] [DEBUG] [LOCAL ] RTO: Derivative data saved (1794 records). [2025-09-29T22:14:59.070566] [INFO ] [MAIN ] RTO: Successfully saved derivative data. [2025-09-29T22:14:59.072637] [INFO ] [MAIN ] Derivative Progress: 1575/2057 symbols completed. RTO took 0.5s. Estimated remaining: 3m 15s. Rate: 147.9 symbols/min [2025-09-29T22:14:59.073429] [INFO ] [MAIN ] RVLV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:59.073328] [INFO ] [MAIN ] RTX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:59.073598] [INFO ] [MAIN ] RVT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:14:59.110477] [DEBUG] [LOCAL ] RVT: Loaded 26812 existing records from primary storage. [2025-09-29T22:14:59.110759] [INFO ] [MAIN ] RVT: Loaded 26812 primary data records. [2025-09-29T22:14:59.327142] [DEBUG] [LOCAL ] RVLV: Loaded 47658 existing records from primary storage. [2025-09-29T22:14:59.386419] [DEBUG] [LOCAL ] RTX: Loaded 53708 existing records from primary storage. [2025-09-29T22:14:59.491308] [INFO ] [MAIN ] RTX: Loaded 53708 primary data records. [2025-09-29T22:14:59.491070] [INFO ] [MAIN ] RVLV: Loaded 47658 primary data records. [2025-09-29T22:15:00.222284] [DEBUG] [MAIN ] RVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:00.224218] [INFO ] [MAIN ] RVT: Generated 1794 derivative records from 26812 primary records. [2025-09-29T22:15:00.224590] [DEBUG] [LOCAL ] RVT: Saving derivative data. [2025-09-29T22:15:00.247468] [DEBUG] [LOCAL ] RVT: Derivative data saved (1794 records). [2025-09-29T22:15:00.248926] [INFO ] [MAIN ] RVT: Successfully saved derivative data. [2025-09-29T22:15:00.251802] [INFO ] [MAIN ] Derivative Progress: 1576/2057 symbols completed. RVT took 1.2s. Estimated remaining: 3m 15s. Rate: 147.8 symbols/min [2025-09-29T22:15:00.252971] [INFO ] [MAIN ] RVTY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:00.270059] [DEBUG] [MAIN ] RTX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:00.283546] [INFO ] [MAIN ] RTX: Generated 1794 derivative records from 53708 primary records. [2025-09-29T22:15:00.283889] [DEBUG] [LOCAL ] RTX: Saving derivative data. [2025-09-29T22:15:00.284185] [DEBUG] [MAIN ] RVLV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:00.285276] [INFO ] [MAIN ] RVLV: Generated 1794 derivative records from 47658 primary records. [2025-09-29T22:15:00.285719] [DEBUG] [LOCAL ] RVLV: Saving derivative data. [2025-09-29T22:15:00.316843] [DEBUG] [LOCAL ] RTX: Derivative data saved (1794 records). [2025-09-29T22:15:00.317985] [INFO ] [MAIN ] RTX: Successfully saved derivative data. [2025-09-29T22:15:00.320837] [INFO ] [MAIN ] Derivative Progress: 1577/2057 symbols completed. RTX took 1.2s. Estimated remaining: 3m 15s. Rate: 147.8 symbols/min [2025-09-29T22:15:00.321557] [INFO ] [MAIN ] RWT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:00.335535] [DEBUG] [LOCAL ] RVLV: Derivative data saved (1794 records). [2025-09-29T22:15:00.335906] [INFO ] [MAIN ] RVLV: Successfully saved derivative data. [2025-09-29T22:15:00.338177] [INFO ] [MAIN ] Derivative Progress: 1578/2057 symbols completed. RVLV took 1.3s. Estimated remaining: 3m 14s. Rate: 147.9 symbols/min [2025-09-29T22:15:00.338481] [INFO ] [MAIN ] RXO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:00.359790] [DEBUG] [LOCAL ] RVTY: Loaded 47459 existing records from primary storage. [2025-09-29T22:15:00.360150] [INFO ] [MAIN ] RVTY: Loaded 47459 primary data records. [2025-09-29T22:15:00.529246] [DEBUG] [LOCAL ] RWT: Loaded 40791 existing records from primary storage. [2025-09-29T22:15:00.540231] [INFO ] [MAIN ] RWT: Loaded 40791 primary data records. [2025-09-29T22:15:00.671066] [DEBUG] [LOCAL ] RXO: Loaded 47788 existing records from primary storage. [2025-09-29T22:15:00.833678] [INFO ] [MAIN ] RXO: Loaded 47788 primary data records. [2025-09-29T22:15:01.456465] [DEBUG] [MAIN ] RVTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:01.458126] [INFO ] [MAIN ] RVTY: Generated 1794 derivative records from 47459 primary records. [2025-09-29T22:15:01.458341] [DEBUG] [LOCAL ] RVTY: Saving derivative data. [2025-09-29T22:15:01.478813] [DEBUG] [LOCAL ] RVTY: Derivative data saved (1794 records). [2025-09-29T22:15:01.480474] [INFO ] [MAIN ] RVTY: Successfully saved derivative data. [2025-09-29T22:15:01.482734] [INFO ] [MAIN ] Derivative Progress: 1579/2057 symbols completed. RVTY took 1.2s. Estimated remaining: 3m 14s. Rate: 147.8 symbols/min [2025-09-29T22:15:01.483957] [INFO ] [MAIN ] RY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:01.498347] [DEBUG] [MAIN ] RWT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:01.499388] [INFO ] [MAIN ] RWT: Generated 1794 derivative records from 40791 primary records. [2025-09-29T22:15:01.499991] [DEBUG] [LOCAL ] RWT: Saving derivative data. [2025-09-29T22:15:01.529958] [DEBUG] [MAIN ] RXO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:01.533014] [INFO ] [MAIN ] RXO: Generated 1794 derivative records from 47788 primary records. [2025-09-29T22:15:01.533218] [DEBUG] [LOCAL ] RXO: Saving derivative data. [2025-09-29T22:15:01.534370] [DEBUG] [LOCAL ] RWT: Derivative data saved (1794 records). [2025-09-29T22:15:01.535049] [INFO ] [MAIN ] RWT: Successfully saved derivative data. [2025-09-29T22:15:01.537870] [INFO ] [MAIN ] Derivative Progress: 1580/2057 symbols completed. RWT took 1.2s. Estimated remaining: 3m 14s. Rate: 147.8 symbols/min [2025-09-29T22:15:01.538053] [INFO ] [MAIN ] RYAM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:01.556056] [DEBUG] [LOCAL ] RXO: Derivative data saved (1794 records). [2025-09-29T22:15:01.556265] [INFO ] [MAIN ] RXO: Successfully saved derivative data. [2025-09-29T22:15:01.558729] [INFO ] [MAIN ] Derivative Progress: 1581/2057 symbols completed. RXO took 1.2s. Estimated remaining: 3m 13s. Rate: 147.9 symbols/min [2025-09-29T22:15:01.559172] [INFO ] [MAIN ] RYAN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:01.620068] [DEBUG] [LOCAL ] RY: Loaded 47856 existing records from primary storage. [2025-09-29T22:15:01.629943] [INFO ] [MAIN ] RY: Loaded 47856 primary data records. [2025-09-29T22:15:01.630838] [DEBUG] [LOCAL ] RYAM: Loaded 35124 existing records from primary storage. [2025-09-29T22:15:01.631042] [INFO ] [MAIN ] RYAM: Loaded 35124 primary data records. [2025-09-29T22:15:01.772335] [DEBUG] [LOCAL ] RYAN: Loaded 44405 existing records from primary storage. [2025-09-29T22:15:01.884055] [INFO ] [MAIN ] RYAN: Loaded 44405 primary data records. [2025-09-29T22:15:02.726131] [DEBUG] [MAIN ] RY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:02.727328] [INFO ] [MAIN ] RY: Generated 1794 derivative records from 47856 primary records. [2025-09-29T22:15:02.727432] [DEBUG] [LOCAL ] RY: Saving derivative data. [2025-09-29T22:15:02.762690] [DEBUG] [MAIN ] RYAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:02.764234] [INFO ] [MAIN ] RYAM: Generated 1794 derivative records from 35124 primary records. [2025-09-29T22:15:02.764986] [DEBUG] [LOCAL ] RYAM: Saving derivative data. [2025-09-29T22:15:02.785377] [DEBUG] [LOCAL ] RY: Derivative data saved (1794 records). [2025-09-29T22:15:02.788636] [INFO ] [MAIN ] RY: Successfully saved derivative data. [2025-09-29T22:15:02.791697] [INFO ] [MAIN ] Derivative Progress: 1582/2057 symbols completed. RY took 1.3s. Estimated remaining: 3m 13s. Rate: 147.7 symbols/min [2025-09-29T22:15:02.792297] [INFO ] [MAIN ] RYI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:02.808862] [DEBUG] [LOCAL ] RYAM: Derivative data saved (1794 records). [2025-09-29T22:15:02.817397] [INFO ] [MAIN ] RYAM: Successfully saved derivative data. [2025-09-29T22:15:02.817210] [DEBUG] [MAIN ] RYAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:02.820117] [INFO ] [MAIN ] Derivative Progress: 1583/2057 symbols completed. RYAM took 1.3s. Estimated remaining: 3m 12s. Rate: 147.8 symbols/min [2025-09-29T22:15:02.820417] [INFO ] [MAIN ] RYN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:02.822313] [INFO ] [MAIN ] RYAN: Generated 1794 derivative records from 44405 primary records. [2025-09-29T22:15:02.822611] [DEBUG] [LOCAL ] RYAN: Saving derivative data. [2025-09-29T22:15:02.849033] [DEBUG] [LOCAL ] RYAN: Derivative data saved (1794 records). [2025-09-29T22:15:02.849262] [INFO ] [MAIN ] RYAN: Successfully saved derivative data. [2025-09-29T22:15:02.851537] [INFO ] [MAIN ] Derivative Progress: 1584/2057 symbols completed. RYAN took 1.3s. Estimated remaining: 3m 12s. Rate: 147.9 symbols/min [2025-09-29T22:15:02.864702] [DEBUG] [LOCAL ] RYI: Loaded 21503 existing records from primary storage. [2025-09-29T22:15:02.863862] [INFO ] [MAIN ] RZB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:02.865147] [INFO ] [MAIN ] RYI: Loaded 21503 primary data records. [2025-09-29T22:15:02.984930] [DEBUG] [LOCAL ] RZB: Loaded 6216 existing records from primary storage. [2025-09-29T22:15:03.015708] [INFO ] [MAIN ] RZB: Loaded 6216 primary data records. [2025-09-29T22:15:03.085583] [DEBUG] [LOCAL ] RYN: Loaded 45587 existing records from primary storage. [2025-09-29T22:15:03.155292] [INFO ] [MAIN ] RYN: Loaded 45587 primary data records. [2025-09-29T22:15:04.016036] [DEBUG] [MAIN ] RYI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:04.017068] [INFO ] [MAIN ] RYI: Generated 1794 derivative records from 21503 primary records. [2025-09-29T22:15:04.017289] [DEBUG] [LOCAL ] RYI: Saving derivative data. [2025-09-29T22:15:04.049778] [DEBUG] [LOCAL ] RYI: Derivative data saved (1794 records). [2025-09-29T22:15:04.056326] [DEBUG] [MAIN ] RZB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:04.056663] [INFO ] [MAIN ] RYI: Successfully saved derivative data. [2025-09-29T22:15:04.057501] [INFO ] [MAIN ] RZB: Generated 1794 derivative records from 6216 primary records. [2025-09-29T22:15:04.057635] [DEBUG] [LOCAL ] RZB: Saving derivative data. [2025-09-29T22:15:04.060074] [INFO ] [MAIN ] Derivative Progress: 1585/2057 symbols completed. RYI took 1.3s. Estimated remaining: 3m 12s. Rate: 147.7 symbols/min [2025-09-29T22:15:04.060365] [INFO ] [MAIN ] RZC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:04.095854] [DEBUG] [MAIN ] RYN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:04.097538] [INFO ] [MAIN ] RYN: Generated 1794 derivative records from 45587 primary records. [2025-09-29T22:15:04.097964] [DEBUG] [LOCAL ] RYN: Saving derivative data. [2025-09-29T22:15:04.109815] [DEBUG] [LOCAL ] RZB: Derivative data saved (1794 records). [2025-09-29T22:15:04.114624] [DEBUG] [LOCAL ] RZC: Loaded 6776 existing records from primary storage. [2025-09-29T22:15:04.117939] [INFO ] [MAIN ] RZB: Successfully saved derivative data. [2025-09-29T22:15:04.118320] [INFO ] [MAIN ] RZC: Loaded 6776 primary data records. [2025-09-29T22:15:04.120869] [INFO ] [MAIN ] Derivative Progress: 1586/2057 symbols completed. RZB took 1.3s. Estimated remaining: 3m 11s. Rate: 147.8 symbols/min [2025-09-29T22:15:04.126490] [INFO ] [MAIN ] S: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:04.240520] [DEBUG] [LOCAL ] RYN: Derivative data saved (1794 records). [2025-09-29T22:15:04.246487] [INFO ] [MAIN ] RYN: Successfully saved derivative data. [2025-09-29T22:15:04.264316] [INFO ] [MAIN ] Derivative Progress: 1587/2057 symbols completed. RYN took 1.4s. Estimated remaining: 3m 11s. Rate: 147.9 symbols/min [2025-09-29T22:15:04.271090] [INFO ] [MAIN ] SA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:04.513899] [DEBUG] [LOCAL ] S: Loaded 53535 existing records from primary storage. [2025-09-29T22:15:04.514311] [INFO ] [MAIN ] S: Loaded 53535 primary data records. [2025-09-29T22:15:04.605323] [DEBUG] [MAIN ] RZC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:04.631995] [DEBUG] [LOCAL ] SA: Loaded 43225 existing records from primary storage. [2025-09-29T22:15:04.645061] [INFO ] [MAIN ] RZC: Generated 1794 derivative records from 6776 primary records. [2025-09-29T22:15:04.656872] [INFO ] [MAIN ] SA: Loaded 43225 primary data records. [2025-09-29T22:15:04.657124] [DEBUG] [LOCAL ] RZC: Saving derivative data. [2025-09-29T22:15:05.091721] [DEBUG] [LOCAL ] RZC: Derivative data saved (1794 records). [2025-09-29T22:15:05.217159] [INFO ] [MAIN ] RZC: Successfully saved derivative data. [2025-09-29T22:15:05.220504] [INFO ] [MAIN ] Derivative Progress: 1588/2057 symbols completed. RZC took 1.2s. Estimated remaining: 3m 10s. Rate: 147.7 symbols/min [2025-09-29T22:15:05.248325] [DEBUG] [MAIN ] S: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:05.249305] [INFO ] [MAIN ] S: Generated 1794 derivative records from 53535 primary records. [2025-09-29T22:15:05.249498] [DEBUG] [LOCAL ] S: Saving derivative data. [2025-09-29T22:15:05.281081] [DEBUG] [MAIN ] SA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:05.282941] [INFO ] [MAIN ] SA: Generated 1794 derivative records from 43225 primary records. [2025-09-29T22:15:05.283457] [DEBUG] [LOCAL ] SA: Saving derivative data. [2025-09-29T22:15:05.285523] [DEBUG] [LOCAL ] S: Derivative data saved (1794 records). [2025-09-29T22:15:05.292745] [INFO ] [MAIN ] S: Successfully saved derivative data. [2025-09-29T22:15:05.295566] [INFO ] [MAIN ] Derivative Progress: 1589/2057 symbols completed. S took 1.2s. Estimated remaining: 3m 10s. Rate: 147.8 symbols/min [2025-09-29T22:15:05.303051] [DEBUG] [LOCAL ] SA: Derivative data saved (1794 records). [2025-09-29T22:15:05.303118] [INFO ] [MAIN ] SA: Successfully saved derivative data. [2025-09-29T22:15:05.305175] [INFO ] [MAIN ] Derivative Progress: 1590/2057 symbols completed. SA took 1.0s. Estimated remaining: 3m 9s. Rate: 147.9 symbols/min [2025-09-29T22:15:05.305631] [INFO ] [MAIN ] SAFE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:05.305577] [INFO ] [MAIN ] SABA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:05.306191] [INFO ] [MAIN ] SAH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:05.317687] [DEBUG] [LOCAL ] SABA: Loaded 9189 existing records from primary storage. [2025-09-29T22:15:05.317859] [INFO ] [MAIN ] SABA: Loaded 9189 primary data records. [2025-09-29T22:15:05.453545] [DEBUG] [LOCAL ] SAH: Loaded 22003 existing records from primary storage. [2025-09-29T22:15:05.459523] [INFO ] [MAIN ] SAH: Loaded 22003 primary data records. [2025-09-29T22:15:05.594855] [DEBUG] [LOCAL ] SAFE: Loaded 30266 existing records from primary storage. [2025-09-29T22:15:05.639737] [INFO ] [MAIN ] SAFE: Loaded 30266 primary data records. [2025-09-29T22:15:06.430300] [DEBUG] [MAIN ] SABA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:06.431480] [INFO ] [MAIN ] SABA: Generated 1794 derivative records from 9189 primary records. [2025-09-29T22:15:06.431889] [DEBUG] [LOCAL ] SABA: Saving derivative data. [2025-09-29T22:15:06.452889] [DEBUG] [LOCAL ] SABA: Derivative data saved (1794 records). [2025-09-29T22:15:06.453458] [INFO ] [MAIN ] SABA: Successfully saved derivative data. [2025-09-29T22:15:06.455559] [INFO ] [MAIN ] Derivative Progress: 1591/2057 symbols completed. SABA took 1.1s. Estimated remaining: 3m 9s. Rate: 147.7 symbols/min [2025-09-29T22:15:06.455877] [INFO ] [MAIN ] SAM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:06.473207] [DEBUG] [MAIN ] SAH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:06.474816] [INFO ] [MAIN ] SAH: Generated 1794 derivative records from 22003 primary records. [2025-09-29T22:15:06.475034] [DEBUG] [LOCAL ] SAH: Saving derivative data. [2025-09-29T22:15:06.500417] [DEBUG] [MAIN ] SAFE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:06.501625] [INFO ] [MAIN ] SAFE: Generated 1794 derivative records from 30266 primary records. [2025-09-29T22:15:06.502484] [DEBUG] [LOCAL ] SAFE: Saving derivative data. [2025-09-29T22:15:06.532591] [DEBUG] [LOCAL ] SAM: Loaded 21311 existing records from primary storage. [2025-09-29T22:15:06.532179] [DEBUG] [LOCAL ] SAH: Derivative data saved (1794 records). [2025-09-29T22:15:06.533232] [INFO ] [MAIN ] SAM: Loaded 21311 primary data records. [2025-09-29T22:15:06.534261] [INFO ] [MAIN ] SAH: Successfully saved derivative data. [2025-09-29T22:15:06.567468] [INFO ] [MAIN ] Derivative Progress: 1592/2057 symbols completed. SAH took 1.3s. Estimated remaining: 3m 9s. Rate: 147.8 symbols/min [2025-09-29T22:15:06.602749] [INFO ] [MAIN ] SAN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:06.580951] [DEBUG] [LOCAL ] SAFE: Derivative data saved (1794 records). [2025-09-29T22:15:06.608274] [INFO ] [MAIN ] SAFE: Successfully saved derivative data. [2025-09-29T22:15:06.647043] [INFO ] [MAIN ] Derivative Progress: 1593/2057 symbols completed. SAFE took 1.3s. Estimated remaining: 3m 8s. Rate: 147.9 symbols/min [2025-09-29T22:15:06.653225] [INFO ] [MAIN ] SAND: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:06.923020] [DEBUG] [LOCAL ] SAN: Loaded 52995 existing records from primary storage. [2025-09-29T22:15:06.923745] [DEBUG] [MAIN ] SAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:06.924562] [INFO ] [MAIN ] SAM: Generated 1794 derivative records from 21311 primary records. [2025-09-29T22:15:06.923844] [INFO ] [MAIN ] SAN: Loaded 52995 primary data records. [2025-09-29T22:15:06.924720] [DEBUG] [LOCAL ] SAM: Saving derivative data. [2025-09-29T22:15:07.043477] [DEBUG] [LOCAL ] SAND: Loaded 51791 existing records from primary storage. [2025-09-29T22:15:07.050492] [INFO ] [MAIN ] SAND: Loaded 51791 primary data records. [2025-09-29T22:15:07.175544] [DEBUG] [LOCAL ] SAM: Derivative data saved (1794 records). [2025-09-29T22:15:07.372681] [INFO ] [MAIN ] SAM: Successfully saved derivative data. [2025-09-29T22:15:07.375700] [INFO ] [MAIN ] Derivative Progress: 1594/2057 symbols completed. SAM took 0.9s. Estimated remaining: 3m 8s. Rate: 147.8 symbols/min [2025-09-29T22:15:07.387423] [INFO ] [MAIN ] SAP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:07.606884] [DEBUG] [MAIN ] SAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:07.607979] [INFO ] [MAIN ] SAN: Generated 1794 derivative records from 52995 primary records. [2025-09-29T22:15:07.608125] [DEBUG] [LOCAL ] SAN: Saving derivative data. [2025-09-29T22:15:07.653971] [DEBUG] [LOCAL ] SAN: Derivative data saved (1794 records). [2025-09-29T22:15:07.668297] [DEBUG] [LOCAL ] SAP: Loaded 50034 existing records from primary storage. [2025-09-29T22:15:07.667265] [INFO ] [MAIN ] SAN: Successfully saved derivative data. [2025-09-29T22:15:07.667148] [DEBUG] [MAIN ] SAND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:07.670616] [INFO ] [MAIN ] Derivative Progress: 1595/2057 symbols completed. SAN took 1.1s. Estimated remaining: 3m 8s. Rate: 147.8 symbols/min [2025-09-29T22:15:07.671932] [INFO ] [MAIN ] SAR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:07.670716] [INFO ] [MAIN ] SAP: Loaded 50034 primary data records. [2025-09-29T22:15:07.671763] [INFO ] [MAIN ] SAND: Generated 1794 derivative records from 51791 primary records. [2025-09-29T22:15:07.677824] [DEBUG] [LOCAL ] SAND: Saving derivative data. [2025-09-29T22:15:07.819568] [DEBUG] [LOCAL ] SAND: Derivative data saved (1794 records). [2025-09-29T22:15:07.853239] [INFO ] [MAIN ] SAND: Successfully saved derivative data. [2025-09-29T22:15:07.890126] [DEBUG] [LOCAL ] SAR: Loaded 16143 existing records from primary storage. [2025-09-29T22:15:07.942745] [INFO ] [MAIN ] Derivative Progress: 1596/2057 symbols completed. SAND took 1.3s. Estimated remaining: 3m 7s. Rate: 147.9 symbols/min [2025-09-29T22:15:08.011637] [INFO ] [MAIN ] SAR: Loaded 16143 primary data records. [2025-09-29T22:15:08.011910] [INFO ] [MAIN ] SARO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:08.416099] [DEBUG] [MAIN ] SAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:08.417198] [INFO ] [MAIN ] SAP: Generated 1794 derivative records from 50034 primary records. [2025-09-29T22:15:08.417872] [DEBUG] [LOCAL ] SAP: Saving derivative data. [2025-09-29T22:15:08.448916] [DEBUG] [LOCAL ] SARO: Loaded 48625 existing records from primary storage. [2025-09-29T22:15:08.450514] [INFO ] [MAIN ] SARO: Loaded 48625 primary data records. [2025-09-29T22:15:08.535521] [DEBUG] [LOCAL ] SAP: Derivative data saved (1794 records). [2025-09-29T22:15:08.563083] [INFO ] [MAIN ] SAP: Successfully saved derivative data. [2025-09-29T22:15:08.565561] [INFO ] [MAIN ] Derivative Progress: 1597/2057 symbols completed. SAP took 1.2s. Estimated remaining: 3m 7s. Rate: 147.8 symbols/min [2025-09-29T22:15:08.567398] [INFO ] [MAIN ] SB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:08.672386] [DEBUG] [MAIN ] SAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:08.673506] [INFO ] [MAIN ] SAR: Generated 1794 derivative records from 16143 primary records. [2025-09-29T22:15:08.673720] [DEBUG] [LOCAL ] SAR: Saving derivative data. [2025-09-29T22:15:08.823995] [DEBUG] [LOCAL ] SAR: Derivative data saved (1794 records). [2025-09-29T22:15:08.824902] [INFO ] [MAIN ] SAR: Successfully saved derivative data. [2025-09-29T22:15:08.827615] [INFO ] [MAIN ] Derivative Progress: 1598/2057 symbols completed. SAR took 1.2s. Estimated remaining: 3m 6s. Rate: 147.8 symbols/min [2025-09-29T22:15:08.828278] [INFO ] [MAIN ] SBH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:08.842882] [DEBUG] [LOCAL ] SB: Loaded 33129 existing records from primary storage. [2025-09-29T22:15:08.843359] [INFO ] [MAIN ] SB: Loaded 33129 primary data records. [2025-09-29T22:15:09.048734] [DEBUG] [MAIN ] SARO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:09.072092] [INFO ] [MAIN ] SARO: Generated 1794 derivative records from 48625 primary records. [2025-09-29T22:15:09.085216] [DEBUG] [LOCAL ] SARO: Saving derivative data. [2025-09-29T22:15:09.201051] [DEBUG] [LOCAL ] SBH: Loaded 49790 existing records from primary storage. [2025-09-29T22:15:09.201537] [INFO ] [MAIN ] SBH: Loaded 49790 primary data records. [2025-09-29T22:15:09.396409] [DEBUG] [LOCAL ] SARO: Derivative data saved (1794 records). [2025-09-29T22:15:09.403848] [INFO ] [MAIN ] SARO: Successfully saved derivative data. [2025-09-29T22:15:09.405960] [INFO ] [MAIN ] Derivative Progress: 1599/2057 symbols completed. SARO took 1.4s. Estimated remaining: 3m 6s. Rate: 147.8 symbols/min [2025-09-29T22:15:09.408518] [INFO ] [MAIN ] SBI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:09.580210] [DEBUG] [LOCAL ] SBI: Loaded 7679 existing records from primary storage. [2025-09-29T22:15:09.580916] [INFO ] [MAIN ] SBI: Loaded 7679 primary data records. [2025-09-29T22:15:09.704132] [DEBUG] [MAIN ] SB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:09.722607] [INFO ] [MAIN ] SB: Generated 1794 derivative records from 33129 primary records. [2025-09-29T22:15:09.722722] [DEBUG] [LOCAL ] SB: Saving derivative data. [2025-09-29T22:15:09.945588] [DEBUG] [LOCAL ] SB: Derivative data saved (1794 records). [2025-09-29T22:15:09.945776] [INFO ] [MAIN ] SB: Successfully saved derivative data. [2025-09-29T22:15:09.947919] [INFO ] [MAIN ] Derivative Progress: 1600/2057 symbols completed. SB took 1.4s. Estimated remaining: 3m 6s. Rate: 147.8 symbols/min [2025-09-29T22:15:09.948690] [INFO ] [MAIN ] SBR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:09.973173] [DEBUG] [MAIN ] SBH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:09.976860] [DEBUG] [LOCAL ] SBR: Loaded 7282 existing records from primary storage. [2025-09-29T22:15:09.978180] [INFO ] [MAIN ] SBH: Generated 1794 derivative records from 49790 primary records. [2025-09-29T22:15:09.977421] [INFO ] [MAIN ] SBR: Loaded 7282 primary data records. [2025-09-29T22:15:09.978363] [DEBUG] [LOCAL ] SBH: Saving derivative data. [2025-09-29T22:15:10.069894] [DEBUG] [LOCAL ] SBH: Derivative data saved (1794 records). [2025-09-29T22:15:10.087494] [INFO ] [MAIN ] SBH: Successfully saved derivative data. [2025-09-29T22:15:10.096158] [INFO ] [MAIN ] Derivative Progress: 1601/2057 symbols completed. SBH took 1.3s. Estimated remaining: 3m 5s. Rate: 147.8 symbols/min [2025-09-29T22:15:10.108685] [INFO ] [MAIN ] SBS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:10.369778] [DEBUG] [MAIN ] SBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:10.371360] [INFO ] [MAIN ] SBI: Generated 1794 derivative records from 7679 primary records. [2025-09-29T22:15:10.371463] [DEBUG] [LOCAL ] SBI: Saving derivative data. [2025-09-29T22:15:10.393085] [DEBUG] [LOCAL ] SBI: Derivative data saved (1794 records). [2025-09-29T22:15:10.393565] [INFO ] [MAIN ] SBI: Successfully saved derivative data. [2025-09-29T22:15:10.395686] [INFO ] [MAIN ] Derivative Progress: 1602/2057 symbols completed. SBI took 1.0s. Estimated remaining: 3m 5s. Rate: 147.9 symbols/min [2025-09-29T22:15:10.396010] [INFO ] [MAIN ] SBSI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:10.430964] [DEBUG] [MAIN ] SBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:10.432000] [INFO ] [MAIN ] SBR: Generated 1794 derivative records from 7282 primary records. [2025-09-29T22:15:10.445053] [DEBUG] [LOCAL ] SBR: Saving derivative data. [2025-09-29T22:15:10.454500] [DEBUG] [LOCAL ] SBS: Loaded 49491 existing records from primary storage. [2025-09-29T22:15:10.455351] [DEBUG] [LOCAL ] SBSI: Loaded 14718 existing records from primary storage. [2025-09-29T22:15:10.455014] [INFO ] [MAIN ] SBS: Loaded 49491 primary data records. [2025-09-29T22:15:10.466793] [INFO ] [MAIN ] SBSI: Loaded 14718 primary data records. [2025-09-29T22:15:10.554046] [DEBUG] [LOCAL ] SBR: Derivative data saved (1794 records). [2025-09-29T22:15:10.578687] [INFO ] [MAIN ] SBR: Successfully saved derivative data. [2025-09-29T22:15:10.620892] [INFO ] [MAIN ] Derivative Progress: 1603/2057 symbols completed. SBR took 0.7s. Estimated remaining: 3m 4s. Rate: 147.9 symbols/min [2025-09-29T22:15:11.263575] [DEBUG] [MAIN ] SBSI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:11.264791] [INFO ] [MAIN ] SBSI: Generated 1794 derivative records from 14718 primary records. [2025-09-29T22:15:11.265000] [DEBUG] [LOCAL ] SBSI: Saving derivative data. [2025-09-29T22:15:11.286046] [DEBUG] [MAIN ] SBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:11.294610] [INFO ] [MAIN ] SBS: Generated 1794 derivative records from 49491 primary records. [2025-09-29T22:15:11.295108] [DEBUG] [LOCAL ] SBSI: Derivative data saved (1794 records). [2025-09-29T22:15:11.295213] [DEBUG] [LOCAL ] SBS: Saving derivative data. [2025-09-29T22:15:11.295389] [INFO ] [MAIN ] SBSI: Successfully saved derivative data. [2025-09-29T22:15:11.298585] [INFO ] [MAIN ] Derivative Progress: 1604/2057 symbols completed. SBSI took 0.9s. Estimated remaining: 3m 4s. Rate: 147.8 symbols/min [2025-09-29T22:15:11.314608] [DEBUG] [LOCAL ] SBS: Derivative data saved (1794 records). [2025-09-29T22:15:11.314706] [INFO ] [MAIN ] SBS: Successfully saved derivative data. [2025-09-29T22:15:11.316587] [INFO ] [MAIN ] Derivative Progress: 1605/2057 symbols completed. SBS took 1.2s. Estimated remaining: 3m 3s. Rate: 147.9 symbols/min [2025-09-29T22:15:11.317195] [INFO ] [MAIN ] SCD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:11.317099] [INFO ] [MAIN ] SBSW: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:11.317400] [INFO ] [MAIN ] SCCO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:11.337141] [DEBUG] [LOCAL ] SCD: Loaded 12679 existing records from primary storage. [2025-09-29T22:15:11.337357] [INFO ] [MAIN ] SCD: Loaded 12679 primary data records. [2025-09-29T22:15:11.701571] [DEBUG] [LOCAL ] SBSW: Loaded 52993 existing records from primary storage. [2025-09-29T22:15:11.701829] [INFO ] [MAIN ] SBSW: Loaded 52993 primary data records. [2025-09-29T22:15:11.740141] [DEBUG] [LOCAL ] SCCO: Loaded 49404 existing records from primary storage. [2025-09-29T22:15:11.751439] [INFO ] [MAIN ] SCCO: Loaded 49404 primary data records. [2025-09-29T22:15:12.408914] [DEBUG] [MAIN ] SCD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:12.409812] [INFO ] [MAIN ] SCD: Generated 1794 derivative records from 12679 primary records. [2025-09-29T22:15:12.410245] [DEBUG] [LOCAL ] SCD: Saving derivative data. [2025-09-29T22:15:12.432700] [DEBUG] [LOCAL ] SCD: Derivative data saved (1794 records). [2025-09-29T22:15:12.433153] [INFO ] [MAIN ] SCD: Successfully saved derivative data. [2025-09-29T22:15:12.435523] [INFO ] [MAIN ] Derivative Progress: 1606/2057 symbols completed. SCD took 1.1s. Estimated remaining: 3m 3s. Rate: 147.8 symbols/min [2025-09-29T22:15:12.436022] [INFO ] [MAIN ] SCHW: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:12.456580] [DEBUG] [MAIN ] SBSW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:12.458379] [INFO ] [MAIN ] SBSW: Generated 1794 derivative records from 52993 primary records. [2025-09-29T22:15:12.458527] [DEBUG] [LOCAL ] SBSW: Saving derivative data. [2025-09-29T22:15:12.480370] [DEBUG] [MAIN ] SCCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:12.486338] [INFO ] [MAIN ] SCCO: Generated 1794 derivative records from 49404 primary records. [2025-09-29T22:15:12.487562] [DEBUG] [LOCAL ] SCCO: Saving derivative data. [2025-09-29T22:15:12.506056] [DEBUG] [LOCAL ] SBSW: Derivative data saved (1794 records). [2025-09-29T22:15:12.507076] [INFO ] [MAIN ] SBSW: Successfully saved derivative data. [2025-09-29T22:15:12.509070] [INFO ] [MAIN ] Derivative Progress: 1607/2057 symbols completed. SBSW took 1.2s. Estimated remaining: 3m 3s. Rate: 147.8 symbols/min [2025-09-29T22:15:12.509804] [INFO ] [MAIN ] SCI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:12.525354] [DEBUG] [LOCAL ] SCCO: Derivative data saved (1794 records). [2025-09-29T22:15:12.525685] [INFO ] [MAIN ] SCCO: Successfully saved derivative data. [2025-09-29T22:15:12.535186] [INFO ] [MAIN ] Derivative Progress: 1608/2057 symbols completed. SCCO took 1.2s. Estimated remaining: 3m 2s. Rate: 147.9 symbols/min [2025-09-29T22:15:12.536186] [INFO ] [MAIN ] SCL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:12.558023] [DEBUG] [LOCAL ] SCHW: Loaded 53685 existing records from primary storage. [2025-09-29T22:15:12.558341] [INFO ] [MAIN ] SCHW: Loaded 53685 primary data records. [2025-09-29T22:15:12.639496] [DEBUG] [LOCAL ] SCL: Loaded 14886 existing records from primary storage. [2025-09-29T22:15:12.692734] [INFO ] [MAIN ] SCL: Loaded 14886 primary data records. [2025-09-29T22:15:13.048219] [DEBUG] [LOCAL ] SCI: Loaded 46497 existing records from primary storage. [2025-09-29T22:15:13.078147] [INFO ] [MAIN ] SCI: Loaded 46497 primary data records. [2025-09-29T22:15:13.634187] [DEBUG] [MAIN ] SCHW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:13.636830] [INFO ] [MAIN ] SCHW: Generated 1794 derivative records from 53685 primary records. [2025-09-29T22:15:13.638209] [DEBUG] [LOCAL ] SCHW: Saving derivative data. [2025-09-29T22:15:13.676090] [DEBUG] [MAIN ] SCL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:13.678688] [INFO ] [MAIN ] SCL: Generated 1794 derivative records from 14886 primary records. [2025-09-29T22:15:13.679906] [DEBUG] [LOCAL ] SCL: Saving derivative data. [2025-09-29T22:15:13.699700] [DEBUG] [LOCAL ] SCHW: Derivative data saved (1794 records). [2025-09-29T22:15:13.702294] [INFO ] [MAIN ] SCHW: Successfully saved derivative data. [2025-09-29T22:15:13.707705] [INFO ] [MAIN ] Derivative Progress: 1609/2057 symbols completed. SCHW took 1.3s. Estimated remaining: 3m 2s. Rate: 147.8 symbols/min [2025-09-29T22:15:13.708190] [INFO ] [MAIN ] SCM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:13.725320] [DEBUG] [MAIN ] SCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:13.726179] [INFO ] [MAIN ] SCI: Generated 1794 derivative records from 46497 primary records. [2025-09-29T22:15:13.724764] [DEBUG] [LOCAL ] SCL: Derivative data saved (1794 records). [2025-09-29T22:15:13.726313] [DEBUG] [LOCAL ] SCI: Saving derivative data. [2025-09-29T22:15:13.726423] [INFO ] [MAIN ] SCL: Successfully saved derivative data. [2025-09-29T22:15:13.729307] [INFO ] [MAIN ] Derivative Progress: 1610/2057 symbols completed. SCL took 1.2s. Estimated remaining: 3m 1s. Rate: 147.8 symbols/min [2025-09-29T22:15:13.729927] [INFO ] [MAIN ] SCS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:13.763122] [DEBUG] [LOCAL ] SCM: Loaded 19770 existing records from primary storage. [2025-09-29T22:15:13.763359] [INFO ] [MAIN ] SCM: Loaded 19770 primary data records. [2025-09-29T22:15:13.770859] [DEBUG] [LOCAL ] SCI: Derivative data saved (1794 records). [2025-09-29T22:15:13.770925] [INFO ] [MAIN ] SCI: Successfully saved derivative data. [2025-09-29T22:15:13.773124] [INFO ] [MAIN ] Derivative Progress: 1611/2057 symbols completed. SCI took 1.3s. Estimated remaining: 3m 1s. Rate: 147.9 symbols/min [2025-09-29T22:15:13.774231] [INFO ] [MAIN ] SD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:14.041170] [DEBUG] [LOCAL ] SD: Loaded 28722 existing records from primary storage. [2025-09-29T22:15:14.045341] [INFO ] [MAIN ] SD: Loaded 28722 primary data records. [2025-09-29T22:15:14.161455] [DEBUG] [LOCAL ] SCS: Loaded 43337 existing records from primary storage. [2025-09-29T22:15:14.204994] [INFO ] [MAIN ] SCS: Loaded 43337 primary data records. [2025-09-29T22:15:14.917634] [DEBUG] [MAIN ] SCM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:14.918914] [INFO ] [MAIN ] SCM: Generated 1794 derivative records from 19770 primary records. [2025-09-29T22:15:14.919345] [DEBUG] [LOCAL ] SCM: Saving derivative data. [2025-09-29T22:15:14.943894] [DEBUG] [LOCAL ] SCM: Derivative data saved (1794 records). [2025-09-29T22:15:14.944136] [INFO ] [MAIN ] SCM: Successfully saved derivative data. [2025-09-29T22:15:14.946302] [INFO ] [MAIN ] Derivative Progress: 1612/2057 symbols completed. SCM took 1.2s. Estimated remaining: 3m 1s. Rate: 147.7 symbols/min [2025-09-29T22:15:14.954627] [INFO ] [MAIN ] SDHC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:14.961135] [DEBUG] [MAIN ] SD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:14.961860] [INFO ] [MAIN ] SD: Generated 1794 derivative records from 28722 primary records. [2025-09-29T22:15:14.962036] [DEBUG] [LOCAL ] SD: Saving derivative data. [2025-09-29T22:15:14.994412] [DEBUG] [MAIN ] SCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:14.995928] [INFO ] [MAIN ] SCS: Generated 1794 derivative records from 43337 primary records. [2025-09-29T22:15:15.001941] [DEBUG] [LOCAL ] SDHC: Loaded 10477 existing records from primary storage. [2025-09-29T22:15:15.001124] [DEBUG] [LOCAL ] SCS: Saving derivative data. [2025-09-29T22:15:15.002543] [INFO ] [MAIN ] SDHC: Loaded 10477 primary data records. [2025-09-29T22:15:15.091712] [DEBUG] [LOCAL ] SD: Derivative data saved (1794 records). [2025-09-29T22:15:15.104463] [INFO ] [MAIN ] SD: Successfully saved derivative data. [2025-09-29T22:15:15.111956] [INFO ] [MAIN ] Derivative Progress: 1613/2057 symbols completed. SD took 1.3s. Estimated remaining: 3m 0s. Rate: 147.8 symbols/min [2025-09-29T22:15:15.119018] [INFO ] [MAIN ] SDHY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:15.176026] [DEBUG] [LOCAL ] SCS: Derivative data saved (1794 records). [2025-09-29T22:15:15.218412] [INFO ] [MAIN ] SCS: Successfully saved derivative data. [2025-09-29T22:15:15.334695] [INFO ] [MAIN ] Derivative Progress: 1614/2057 symbols completed. SCS took 1.6s. Estimated remaining: 2m 60s. Rate: 147.8 symbols/min [2025-09-29T22:15:15.344442] [INFO ] [MAIN ] SDRL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:15.350497] [DEBUG] [LOCAL ] SDHY: Loaded 10460 existing records from primary storage. [2025-09-29T22:15:15.351505] [INFO ] [MAIN ] SDHY: Loaded 10460 primary data records. [2025-09-29T22:15:15.712404] [DEBUG] [LOCAL ] SDRL: Loaded 41692 existing records from primary storage. [2025-09-29T22:15:15.713792] [INFO ] [MAIN ] SDRL: Loaded 41692 primary data records. [2025-09-29T22:15:15.867993] [DEBUG] [MAIN ] SDHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:15.874449] [INFO ] [MAIN ] SDHC: Generated 1794 derivative records from 10477 primary records. [2025-09-29T22:15:15.874597] [DEBUG] [LOCAL ] SDHC: Saving derivative data. [2025-09-29T22:15:16.080266] [DEBUG] [LOCAL ] SDHC: Derivative data saved (1794 records). [2025-09-29T22:15:16.081155] [INFO ] [MAIN ] SDHC: Successfully saved derivative data. [2025-09-29T22:15:16.083696] [INFO ] [MAIN ] Derivative Progress: 1615/2057 symbols completed. SDHC took 1.1s. Estimated remaining: 2m 59s. Rate: 147.8 symbols/min [2025-09-29T22:15:16.084097] [INFO ] [MAIN ] SEE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:16.098530] [DEBUG] [MAIN ] SDHY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:16.099626] [INFO ] [MAIN ] SDHY: Generated 1794 derivative records from 10460 primary records. [2025-09-29T22:15:16.099735] [DEBUG] [LOCAL ] SDHY: Saving derivative data. [2025-09-29T22:15:16.117050] [DEBUG] [LOCAL ] SDHY: Derivative data saved (1794 records). [2025-09-29T22:15:16.117417] [INFO ] [MAIN ] SDHY: Successfully saved derivative data. [2025-09-29T22:15:16.119729] [INFO ] [MAIN ] Derivative Progress: 1616/2057 symbols completed. SDHY took 1.0s. Estimated remaining: 2m 59s. Rate: 147.9 symbols/min [2025-09-29T22:15:16.120586] [INFO ] [MAIN ] SEG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:16.140224] [DEBUG] [LOCAL ] SEG: Loaded 13602 existing records from primary storage. [2025-09-29T22:15:16.140534] [INFO ] [MAIN ] SEG: Loaded 13602 primary data records. [2025-09-29T22:15:16.197479] [DEBUG] [MAIN ] SDRL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:16.271557] [INFO ] [MAIN ] SDRL: Generated 1794 derivative records from 41692 primary records. [2025-09-29T22:15:16.290023] [DEBUG] [LOCAL ] SDRL: Saving derivative data. [2025-09-29T22:15:16.291609] [DEBUG] [LOCAL ] SEE: Loaded 48292 existing records from primary storage. [2025-09-29T22:15:16.302994] [INFO ] [MAIN ] SEE: Loaded 48292 primary data records. [2025-09-29T22:15:16.604143] [DEBUG] [LOCAL ] SDRL: Derivative data saved (1794 records). [2025-09-29T22:15:16.619402] [INFO ] [MAIN ] SDRL: Successfully saved derivative data. [2025-09-29T22:15:16.632974] [INFO ] [MAIN ] Derivative Progress: 1617/2057 symbols completed. SDRL took 1.3s. Estimated remaining: 2m 59s. Rate: 147.8 symbols/min [2025-09-29T22:15:16.664399] [INFO ] [MAIN ] SEI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:16.934068] [DEBUG] [MAIN ] SEG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:16.935107] [INFO ] [MAIN ] SEG: Generated 1794 derivative records from 13602 primary records. [2025-09-29T22:15:16.936706] [DEBUG] [LOCAL ] SEG: Saving derivative data. [2025-09-29T22:15:16.984825] [DEBUG] [LOCAL ] SEG: Derivative data saved (1794 records). [2025-09-29T22:15:16.985050] [INFO ] [MAIN ] SEG: Successfully saved derivative data. [2025-09-29T22:15:16.987279] [INFO ] [MAIN ] Derivative Progress: 1618/2057 symbols completed. SEG took 0.9s. Estimated remaining: 2m 58s. Rate: 147.8 symbols/min [2025-09-29T22:15:16.989147] [DEBUG] [LOCAL ] SEI: Loaded 49639 existing records from primary storage. [2025-09-29T22:15:16.990415] [INFO ] [MAIN ] SEI: Loaded 49639 primary data records. [2025-09-29T22:15:17.122283] [DEBUG] [MAIN ] SEE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:17.128629] [INFO ] [MAIN ] SEE: Generated 1794 derivative records from 48292 primary records. [2025-09-29T22:15:17.144063] [DEBUG] [LOCAL ] SEE: Saving derivative data. [2025-09-29T22:15:17.347146] [DEBUG] [LOCAL ] SEE: Derivative data saved (1794 records). [2025-09-29T22:15:17.347899] [INFO ] [MAIN ] SEE: Successfully saved derivative data. [2025-09-29T22:15:17.350157] [INFO ] [MAIN ] Derivative Progress: 1619/2057 symbols completed. SEE took 1.3s. Estimated remaining: 2m 58s. Rate: 147.8 symbols/min [2025-09-29T22:15:17.372504] [DEBUG] [MAIN ] SEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:17.373408] [INFO ] [MAIN ] SEI: Generated 1794 derivative records from 49639 primary records. [2025-09-29T22:15:17.373491] [DEBUG] [LOCAL ] SEI: Saving derivative data. [2025-09-29T22:15:17.390934] [DEBUG] [LOCAL ] SEI: Derivative data saved (1794 records). [2025-09-29T22:15:17.391049] [INFO ] [MAIN ] SEI: Successfully saved derivative data. [2025-09-29T22:15:17.393192] [INFO ] [MAIN ] Derivative Progress: 1620/2057 symbols completed. SEI took 0.7s. Estimated remaining: 2m 57s. Rate: 147.9 symbols/min [2025-09-29T22:15:17.393833] [INFO ] [MAIN ] SEM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:17.393922] [INFO ] [MAIN ] SEMR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:17.394233] [INFO ] [MAIN ] SES: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:17.476186] [DEBUG] [LOCAL ] SEMR: Loaded 41505 existing records from primary storage. [2025-09-29T22:15:17.477936] [INFO ] [MAIN ] SEMR: Loaded 41505 primary data records. [2025-09-29T22:15:17.484178] [DEBUG] [LOCAL ] SEM: Loaded 42796 existing records from primary storage. [2025-09-29T22:15:17.517201] [INFO ] [MAIN ] SEM: Loaded 42796 primary data records. [2025-09-29T22:15:17.640202] [DEBUG] [LOCAL ] SES: Loaded 51559 existing records from primary storage. [2025-09-29T22:15:17.703356] [INFO ] [MAIN ] SES: Loaded 51559 primary data records. [2025-09-29T22:15:18.561600] [DEBUG] [MAIN ] SEM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:18.563045] [INFO ] [MAIN ] SEM: Generated 1794 derivative records from 42796 primary records. [2025-09-29T22:15:18.563358] [DEBUG] [LOCAL ] SEM: Saving derivative data. [2025-09-29T22:15:18.562069] [DEBUG] [MAIN ] SEMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:18.566260] [INFO ] [MAIN ] SEMR: Generated 1794 derivative records from 41505 primary records. [2025-09-29T22:15:18.566389] [DEBUG] [LOCAL ] SEMR: Saving derivative data. [2025-09-29T22:15:18.594033] [DEBUG] [LOCAL ] SEM: Derivative data saved (1794 records). [2025-09-29T22:15:18.599787] [INFO ] [MAIN ] SEM: Successfully saved derivative data. [2025-09-29T22:15:18.602768] [INFO ] [MAIN ] Derivative Progress: 1621/2057 symbols completed. SEM took 1.2s. Estimated remaining: 2m 57s. Rate: 147.7 symbols/min [2025-09-29T22:15:18.604089] [INFO ] [MAIN ] SF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:18.620010] [DEBUG] [LOCAL ] SEMR: Derivative data saved (1794 records). [2025-09-29T22:15:18.620219] [INFO ] [MAIN ] SEMR: Successfully saved derivative data. [2025-09-29T22:15:18.622385] [DEBUG] [MAIN ] SES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:18.623264] [INFO ] [MAIN ] SES: Generated 1794 derivative records from 51559 primary records. [2025-09-29T22:15:18.622021] [INFO ] [MAIN ] Derivative Progress: 1622/2057 symbols completed. SEMR took 1.2s. Estimated remaining: 2m 57s. Rate: 147.8 symbols/min [2025-09-29T22:15:18.623563] [INFO ] [MAIN ] SFB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:18.623460] [DEBUG] [LOCAL ] SES: Saving derivative data. [2025-09-29T22:15:18.645873] [DEBUG] [LOCAL ] SFB: Loaded 4000 existing records from primary storage. [2025-09-29T22:15:18.647323] [INFO ] [MAIN ] SFB: Loaded 4000 primary data records. [2025-09-29T22:15:18.706842] [DEBUG] [LOCAL ] SES: Derivative data saved (1794 records). [2025-09-29T22:15:18.763873] [INFO ] [MAIN ] SES: Successfully saved derivative data. [2025-09-29T22:15:18.769795] [INFO ] [MAIN ] Derivative Progress: 1623/2057 symbols completed. SES took 1.4s. Estimated remaining: 2m 56s. Rate: 147.9 symbols/min [2025-09-29T22:15:18.770500] [INFO ] [MAIN ] SFBS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:18.978299] [DEBUG] [LOCAL ] SF: Loaded 41603 existing records from primary storage. [2025-09-29T22:15:18.993585] [INFO ] [MAIN ] SF: Loaded 41603 primary data records. [2025-09-29T22:15:19.103251] [DEBUG] [LOCAL ] SFBS: Loaded 21030 existing records from primary storage. [2025-09-29T22:15:19.130485] [INFO ] [MAIN ] SFBS: Loaded 21030 primary data records. [2025-09-29T22:15:19.730482] [DEBUG] [MAIN ] SFB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:19.732801] [INFO ] [MAIN ] SFB: Generated 1794 derivative records from 4000 primary records. [2025-09-29T22:15:19.733089] [DEBUG] [LOCAL ] SFB: Saving derivative data. [2025-09-29T22:15:19.758210] [DEBUG] [LOCAL ] SFB: Derivative data saved (1794 records). [2025-09-29T22:15:19.758869] [INFO ] [MAIN ] SFB: Successfully saved derivative data. [2025-09-29T22:15:19.760916] [INFO ] [MAIN ] Derivative Progress: 1624/2057 symbols completed. SFB took 1.1s. Estimated remaining: 2m 56s. Rate: 147.8 symbols/min [2025-09-29T22:15:19.763333] [INFO ] [MAIN ] SFL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:19.778855] [DEBUG] [MAIN ] SF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:19.780778] [INFO ] [MAIN ] SF: Generated 1794 derivative records from 41603 primary records. [2025-09-29T22:15:19.780964] [DEBUG] [LOCAL ] SF: Saving derivative data. [2025-09-29T22:15:19.811493] [DEBUG] [MAIN ] SFBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:19.812735] [INFO ] [MAIN ] SFBS: Generated 1794 derivative records from 21030 primary records. [2025-09-29T22:15:19.813486] [DEBUG] [LOCAL ] SFBS: Saving derivative data. [2025-09-29T22:15:19.815291] [DEBUG] [LOCAL ] SF: Derivative data saved (1794 records). [2025-09-29T22:15:19.815693] [INFO ] [MAIN ] SF: Successfully saved derivative data. [2025-09-29T22:15:19.825484] [INFO ] [MAIN ] Derivative Progress: 1625/2057 symbols completed. SF took 1.2s. Estimated remaining: 2m 55s. Rate: 147.8 symbols/min [2025-09-29T22:15:19.829856] [INFO ] [MAIN ] SG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:19.846851] [DEBUG] [LOCAL ] SFBS: Derivative data saved (1794 records). [2025-09-29T22:15:19.847001] [INFO ] [MAIN ] SFBS: Successfully saved derivative data. [2025-09-29T22:15:19.850747] [INFO ] [MAIN ] Derivative Progress: 1626/2057 symbols completed. SFBS took 1.1s. Estimated remaining: 2m 55s. Rate: 147.9 symbols/min [2025-09-29T22:15:19.851229] [INFO ] [MAIN ] SGHC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:19.869439] [DEBUG] [LOCAL ] SFL: Loaded 45250 existing records from primary storage. [2025-09-29T22:15:19.869696] [INFO ] [MAIN ] SFL: Loaded 45250 primary data records. [2025-09-29T22:15:20.266904] [DEBUG] [LOCAL ] SG: Loaded 53451 existing records from primary storage. [2025-09-29T22:15:20.268064] [INFO ] [MAIN ] SG: Loaded 53451 primary data records. [2025-09-29T22:15:20.268205] [DEBUG] [LOCAL ] SGHC: Loaded 45832 existing records from primary storage. [2025-09-29T22:15:20.274555] [INFO ] [MAIN ] SGHC: Loaded 45832 primary data records. [2025-09-29T22:15:20.993606] [DEBUG] [MAIN ] SFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:20.994774] [INFO ] [MAIN ] SFL: Generated 1794 derivative records from 45250 primary records. [2025-09-29T22:15:20.994891] [DEBUG] [LOCAL ] SFL: Saving derivative data. [2025-09-29T22:15:21.014489] [DEBUG] [LOCAL ] SFL: Derivative data saved (1794 records). [2025-09-29T22:15:21.014809] [INFO ] [MAIN ] SFL: Successfully saved derivative data. [2025-09-29T22:15:21.016967] [INFO ] [MAIN ] Derivative Progress: 1627/2057 symbols completed. SFL took 1.3s. Estimated remaining: 2m 55s. Rate: 147.8 symbols/min [2025-09-29T22:15:21.017579] [INFO ] [MAIN ] SGU: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:21.054510] [DEBUG] [MAIN ] SGHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:21.055108] [DEBUG] [MAIN ] SG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:21.055957] [INFO ] [MAIN ] SGHC: Generated 1794 derivative records from 45832 primary records. [2025-09-29T22:15:21.056675] [INFO ] [MAIN ] SG: Generated 1794 derivative records from 53451 primary records. [2025-09-29T22:15:21.056832] [DEBUG] [LOCAL ] SG: Saving derivative data. [2025-09-29T22:15:21.057999] [DEBUG] [LOCAL ] SGHC: Saving derivative data. [2025-09-29T22:15:21.061349] [DEBUG] [LOCAL ] SGU: Loaded 6691 existing records from primary storage. [2025-09-29T22:15:21.062053] [INFO ] [MAIN ] SGU: Loaded 6691 primary data records. [2025-09-29T22:15:21.201927] [DEBUG] [LOCAL ] SG: Derivative data saved (1794 records). [2025-09-29T22:15:21.203359] [INFO ] [MAIN ] SG: Successfully saved derivative data. [2025-09-29T22:15:21.220812] [INFO ] [MAIN ] Derivative Progress: 1628/2057 symbols completed. SG took 1.4s. Estimated remaining: 2m 54s. Rate: 147.8 symbols/min [2025-09-29T22:15:21.226518] [INFO ] [MAIN ] SHAK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:21.256667] [DEBUG] [LOCAL ] SGHC: Derivative data saved (1794 records). [2025-09-29T22:15:21.256893] [INFO ] [MAIN ] SGHC: Successfully saved derivative data. [2025-09-29T22:15:21.259295] [INFO ] [MAIN ] Derivative Progress: 1629/2057 symbols completed. SGHC took 1.4s. Estimated remaining: 2m 54s. Rate: 147.9 symbols/min [2025-09-29T22:15:21.304358] [INFO ] [MAIN ] SHCO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:21.495492] [DEBUG] [MAIN ] SGU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:21.496301] [INFO ] [MAIN ] SGU: Generated 1794 derivative records from 6691 primary records. [2025-09-29T22:15:21.503753] [DEBUG] [LOCAL ] SGU: Saving derivative data. [2025-09-29T22:15:21.514405] [DEBUG] [LOCAL ] SHCO: Loaded 25899 existing records from primary storage. [2025-09-29T22:15:21.532105] [INFO ] [MAIN ] SHCO: Loaded 25899 primary data records. [2025-09-29T22:15:21.565697] [DEBUG] [LOCAL ] SHAK: Loaded 49035 existing records from primary storage. [2025-09-29T22:15:21.573709] [INFO ] [MAIN ] SHAK: Loaded 49035 primary data records. [2025-09-29T22:15:21.626416] [DEBUG] [LOCAL ] SGU: Derivative data saved (1794 records). [2025-09-29T22:15:21.669633] [INFO ] [MAIN ] SGU: Successfully saved derivative data. [2025-09-29T22:15:21.719795] [INFO ] [MAIN ] Derivative Progress: 1630/2057 symbols completed. SGU took 0.7s. Estimated remaining: 2m 53s. Rate: 147.9 symbols/min [2025-09-29T22:15:21.767894] [INFO ] [MAIN ] SHEL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:22.239450] [DEBUG] [MAIN ] SHCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:22.240955] [DEBUG] [LOCAL ] SHEL: Loaded 53671 existing records from primary storage. [2025-09-29T22:15:22.242678] [INFO ] [MAIN ] SHCO: Generated 1794 derivative records from 25899 primary records. [2025-09-29T22:15:22.244259] [DEBUG] [LOCAL ] SHCO: Saving derivative data. [2025-09-29T22:15:22.244342] [INFO ] [MAIN ] SHEL: Loaded 53671 primary data records. [2025-09-29T22:15:22.308953] [DEBUG] [MAIN ] SHAK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:22.323364] [INFO ] [MAIN ] SHAK: Generated 1794 derivative records from 49035 primary records. [2025-09-29T22:15:22.332453] [DEBUG] [LOCAL ] SHAK: Saving derivative data. [2025-09-29T22:15:22.466634] [DEBUG] [LOCAL ] SHCO: Derivative data saved (1794 records). [2025-09-29T22:15:22.599720] [DEBUG] [LOCAL ] SHAK: Derivative data saved (1794 records). [2025-09-29T22:15:22.613823] [INFO ] [MAIN ] SHCO: Successfully saved derivative data. [2025-09-29T22:15:22.616008] [INFO ] [MAIN ] Derivative Progress: 1631/2057 symbols completed. SHCO took 1.3s. Estimated remaining: 2m 53s. Rate: 147.8 symbols/min [2025-09-29T22:15:22.616176] [INFO ] [MAIN ] SHAK: Successfully saved derivative data. [2025-09-29T22:15:22.616311] [INFO ] [MAIN ] SHG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:22.619934] [INFO ] [MAIN ] Derivative Progress: 1632/2057 symbols completed. SHAK took 1.4s. Estimated remaining: 2m 52s. Rate: 147.8 symbols/min [2025-09-29T22:15:22.620598] [INFO ] [MAIN ] SHO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:22.660241] [DEBUG] [MAIN ] SHEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:22.668855] [INFO ] [MAIN ] SHEL: Generated 1794 derivative records from 53671 primary records. [2025-09-29T22:15:22.670632] [DEBUG] [LOCAL ] SHEL: Saving derivative data. [2025-09-29T22:15:22.670440] [DEBUG] [LOCAL ] SHG: Loaded 26594 existing records from primary storage. [2025-09-29T22:15:22.671439] [INFO ] [MAIN ] SHG: Loaded 26594 primary data records. [2025-09-29T22:15:22.789395] [DEBUG] [LOCAL ] SHEL: Derivative data saved (1794 records). [2025-09-29T22:15:22.809602] [INFO ] [MAIN ] SHEL: Successfully saved derivative data. [2025-09-29T22:15:22.830890] [INFO ] [MAIN ] Derivative Progress: 1633/2057 symbols completed. SHEL took 1.1s. Estimated remaining: 2m 52s. Rate: 147.9 symbols/min [2025-09-29T22:15:22.848720] [DEBUG] [LOCAL ] SHO: Loaded 49778 existing records from primary storage. [2025-09-29T22:15:22.859117] [INFO ] [MAIN ] SHO: Loaded 49778 primary data records. [2025-09-29T22:15:23.437795] [DEBUG] [MAIN ] SHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:23.438801] [INFO ] [MAIN ] SHG: Generated 1794 derivative records from 26594 primary records. [2025-09-29T22:15:23.439171] [DEBUG] [LOCAL ] SHG: Saving derivative data. [2025-09-29T22:15:23.458348] [DEBUG] [LOCAL ] SHG: Derivative data saved (1794 records). [2025-09-29T22:15:23.459210] [INFO ] [MAIN ] SHG: Successfully saved derivative data. [2025-09-29T22:15:23.461268] [INFO ] [MAIN ] Derivative Progress: 1634/2057 symbols completed. SHG took 0.8s. Estimated remaining: 2m 52s. Rate: 147.8 symbols/min [2025-09-29T22:15:23.474553] [DEBUG] [MAIN ] SHO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:23.475301] [INFO ] [MAIN ] SHO: Generated 1794 derivative records from 49778 primary records. [2025-09-29T22:15:23.475395] [DEBUG] [LOCAL ] SHO: Saving derivative data. [2025-09-29T22:15:23.491611] [DEBUG] [LOCAL ] SHO: Derivative data saved (1794 records). [2025-09-29T22:15:23.491705] [INFO ] [MAIN ] SHO: Successfully saved derivative data. [2025-09-29T22:15:23.493636] [INFO ] [MAIN ] Derivative Progress: 1635/2057 symbols completed. SHO took 0.9s. Estimated remaining: 2m 51s. Rate: 147.9 symbols/min [2025-09-29T22:15:23.494278] [INFO ] [MAIN ] SID: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:23.494186] [INFO ] [MAIN ] SHOC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:23.494417] [INFO ] [MAIN ] SHW: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:23.505040] [DEBUG] [LOCAL ] SHOC: Loaded 3522 existing records from primary storage. [2025-09-29T22:15:23.505300] [INFO ] [MAIN ] SHOC: Loaded 3522 primary data records. [2025-09-29T22:15:23.866604] [DEBUG] [LOCAL ] SID: Loaded 42361 existing records from primary storage. [2025-09-29T22:15:23.866898] [INFO ] [MAIN ] SID: Loaded 42361 primary data records. [2025-09-29T22:15:23.978355] [DEBUG] [LOCAL ] SHW: Loaded 50382 existing records from primary storage. [2025-09-29T22:15:23.994983] [INFO ] [MAIN ] SHW: Loaded 50382 primary data records. [2025-09-29T22:15:24.563554] [DEBUG] [MAIN ] SHOC: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:15:24.566990] [INFO ] [MAIN ] SHOC: Generated 1793 derivative records from 3522 primary records. [2025-09-29T22:15:24.567667] [DEBUG] [LOCAL ] SHOC: Saving derivative data. [2025-09-29T22:15:24.587988] [DEBUG] [LOCAL ] SHOC: Derivative data saved (1793 records). [2025-09-29T22:15:24.588149] [INFO ] [MAIN ] SHOC: Successfully saved derivative data. [2025-09-29T22:15:24.590355] [INFO ] [MAIN ] Derivative Progress: 1636/2057 symbols completed. SHOC took 1.1s. Estimated remaining: 2m 51s. Rate: 147.8 symbols/min [2025-09-29T22:15:24.590782] [INFO ] [MAIN ] SIG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:24.613739] [DEBUG] [MAIN ] SID: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:24.614776] [INFO ] [MAIN ] SID: Generated 1794 derivative records from 42361 primary records. [2025-09-29T22:15:24.615241] [DEBUG] [LOCAL ] SID: Saving derivative data. [2025-09-29T22:15:24.636986] [DEBUG] [LOCAL ] SID: Derivative data saved (1794 records). [2025-09-29T22:15:24.637369] [INFO ] [MAIN ] SID: Successfully saved derivative data. [2025-09-29T22:15:24.639255] [INFO ] [MAIN ] Derivative Progress: 1637/2057 symbols completed. SID took 1.1s. Estimated remaining: 2m 50s. Rate: 147.9 symbols/min [2025-09-29T22:15:24.639473] [INFO ] [MAIN ] SII: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:24.655124] [DEBUG] [MAIN ] SHW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:24.667160] [INFO ] [MAIN ] SHW: Generated 1794 derivative records from 50382 primary records. [2025-09-29T22:15:24.667345] [DEBUG] [LOCAL ] SHW: Saving derivative data. [2025-09-29T22:15:24.684913] [DEBUG] [LOCAL ] SHW: Derivative data saved (1794 records). [2025-09-29T22:15:24.685160] [INFO ] [MAIN ] SHW: Successfully saved derivative data. [2025-09-29T22:15:24.699605] [INFO ] [MAIN ] Derivative Progress: 1638/2057 symbols completed. SHW took 1.2s. Estimated remaining: 2m 50s. Rate: 147.9 symbols/min [2025-09-29T22:15:24.701780] [INFO ] [MAIN ] SILA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:24.703016] [DEBUG] [LOCAL ] SIG: Loaded 46323 existing records from primary storage. [2025-09-29T22:15:24.708098] [INFO ] [MAIN ] SIG: Loaded 46323 primary data records. [2025-09-29T22:15:24.796120] [DEBUG] [LOCAL ] SII: Loaded 23405 existing records from primary storage. [2025-09-29T22:15:24.812711] [INFO ] [MAIN ] SII: Loaded 23405 primary data records. [2025-09-29T22:15:25.179824] [DEBUG] [LOCAL ] SILA: Loaded 31020 existing records from primary storage. [2025-09-29T22:15:25.233903] [INFO ] [MAIN ] SILA: Loaded 31020 primary data records. [2025-09-29T22:15:25.783067] [DEBUG] [MAIN ] SIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:25.784712] [INFO ] [MAIN ] SIG: Generated 1794 derivative records from 46323 primary records. [2025-09-29T22:15:25.785681] [DEBUG] [LOCAL ] SIG: Saving derivative data. [2025-09-29T22:15:25.819524] [DEBUG] [MAIN ] SII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:25.820986] [INFO ] [MAIN ] SII: Generated 1794 derivative records from 23405 primary records. [2025-09-29T22:15:25.822381] [DEBUG] [LOCAL ] SIG: Derivative data saved (1794 records). [2025-09-29T22:15:25.822818] [DEBUG] [LOCAL ] SII: Saving derivative data. [2025-09-29T22:15:25.822877] [INFO ] [MAIN ] SIG: Successfully saved derivative data. [2025-09-29T22:15:25.825259] [INFO ] [MAIN ] Derivative Progress: 1639/2057 symbols completed. SIG took 1.2s. Estimated remaining: 2m 50s. Rate: 147.8 symbols/min [2025-09-29T22:15:25.827172] [INFO ] [MAIN ] SITC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:25.844997] [DEBUG] [LOCAL ] SII: Derivative data saved (1794 records). [2025-09-29T22:15:25.845379] [INFO ] [MAIN ] SII: Successfully saved derivative data. [2025-09-29T22:15:25.847822] [INFO ] [MAIN ] Derivative Progress: 1640/2057 symbols completed. SII took 1.2s. Estimated remaining: 2m 49s. Rate: 147.9 symbols/min [2025-09-29T22:15:25.848052] [INFO ] [MAIN ] SITE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:25.866887] [DEBUG] [MAIN ] SILA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:25.867939] [INFO ] [MAIN ] SILA: Generated 1794 derivative records from 31020 primary records. [2025-09-29T22:15:25.872210] [DEBUG] [LOCAL ] SILA: Saving derivative data. [2025-09-29T22:15:25.901057] [DEBUG] [LOCAL ] SILA: Derivative data saved (1794 records). [2025-09-29T22:15:25.901225] [INFO ] [MAIN ] SILA: Successfully saved derivative data. [2025-09-29T22:15:25.903456] [INFO ] [MAIN ] Derivative Progress: 1641/2057 symbols completed. SILA took 1.2s. Estimated remaining: 2m 49s. Rate: 147.9 symbols/min [2025-09-29T22:15:25.903699] [INFO ] [MAIN ] SJM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:25.920213] [DEBUG] [LOCAL ] SITC: Loaded 41628 existing records from primary storage. [2025-09-29T22:15:25.920396] [INFO ] [MAIN ] SITC: Loaded 41628 primary data records. [2025-09-29T22:15:26.084970] [DEBUG] [LOCAL ] SITE: Loaded 35027 existing records from primary storage. [2025-09-29T22:15:26.088203] [INFO ] [MAIN ] SITE: Loaded 35027 primary data records. [2025-09-29T22:15:26.516703] [DEBUG] [LOCAL ] SJM: Loaded 50123 existing records from primary storage. [2025-09-29T22:15:26.543062] [INFO ] [MAIN ] SJM: Loaded 50123 primary data records. [2025-09-29T22:15:27.040411] [DEBUG] [MAIN ] SITC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:27.047138] [INFO ] [MAIN ] SITC: Generated 1794 derivative records from 41628 primary records. [2025-09-29T22:15:27.047445] [DEBUG] [LOCAL ] SITC: Saving derivative data. [2025-09-29T22:15:27.077727] [DEBUG] [MAIN ] SITE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:27.080715] [DEBUG] [LOCAL ] SITC: Derivative data saved (1794 records). [2025-09-29T22:15:27.080462] [INFO ] [MAIN ] SITE: Generated 1794 derivative records from 35027 primary records. [2025-09-29T22:15:27.081126] [DEBUG] [LOCAL ] SITE: Saving derivative data. [2025-09-29T22:15:27.081208] [INFO ] [MAIN ] SITC: Successfully saved derivative data. [2025-09-29T22:15:27.083709] [INFO ] [MAIN ] Derivative Progress: 1642/2057 symbols completed. SITC took 1.3s. Estimated remaining: 2m 49s. Rate: 147.8 symbols/min [2025-09-29T22:15:27.084855] [INFO ] [MAIN ] SJT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:27.103861] [DEBUG] [LOCAL ] SITE: Derivative data saved (1794 records). [2025-09-29T22:15:27.104187] [INFO ] [MAIN ] SITE: Successfully saved derivative data. [2025-09-29T22:15:27.106596] [INFO ] [MAIN ] Derivative Progress: 1643/2057 symbols completed. SITE took 1.3s. Estimated remaining: 2m 48s. Rate: 147.8 symbols/min [2025-09-29T22:15:27.107314] [INFO ] [MAIN ] SKE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:27.121675] [DEBUG] [MAIN ] SJM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:27.122457] [INFO ] [MAIN ] SJM: Generated 1794 derivative records from 50123 primary records. [2025-09-29T22:15:27.122681] [DEBUG] [LOCAL ] SJM: Saving derivative data. [2025-09-29T22:15:27.139912] [DEBUG] [LOCAL ] SJM: Derivative data saved (1794 records). [2025-09-29T22:15:27.145769] [INFO ] [MAIN ] SJM: Successfully saved derivative data. [2025-09-29T22:15:27.148177] [INFO ] [MAIN ] Derivative Progress: 1644/2057 symbols completed. SJM took 1.2s. Estimated remaining: 2m 48s. Rate: 147.9 symbols/min [2025-09-29T22:15:27.148667] [INFO ] [MAIN ] SKIL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:27.166741] [DEBUG] [LOCAL ] SJT: Loaded 22132 existing records from primary storage. [2025-09-29T22:15:27.166930] [INFO ] [MAIN ] SJT: Loaded 22132 primary data records. [2025-09-29T22:15:27.200826] [DEBUG] [LOCAL ] SKIL: Loaded 6287 existing records from primary storage. [2025-09-29T22:15:27.231245] [INFO ] [MAIN ] SKIL: Loaded 6287 primary data records. [2025-09-29T22:15:27.438363] [DEBUG] [LOCAL ] SKE: Loaded 35818 existing records from primary storage. [2025-09-29T22:15:27.442079] [INFO ] [MAIN ] SKE: Loaded 35818 primary data records. [2025-09-29T22:15:28.289167] [DEBUG] [MAIN ] SJT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:28.290286] [INFO ] [MAIN ] SJT: Generated 1794 derivative records from 22132 primary records. [2025-09-29T22:15:28.291364] [DEBUG] [LOCAL ] SJT: Saving derivative data. [2025-09-29T22:15:28.322432] [DEBUG] [MAIN ] SKIL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:28.326970] [INFO ] [MAIN ] SKIL: Generated 1794 derivative records from 6287 primary records. [2025-09-29T22:15:28.328779] [DEBUG] [LOCAL ] SKIL: Saving derivative data. [2025-09-29T22:15:28.344581] [DEBUG] [MAIN ] SKE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:28.357340] [INFO ] [MAIN ] SKE: Generated 1794 derivative records from 35818 primary records. [2025-09-29T22:15:28.358351] [DEBUG] [LOCAL ] SKE: Saving derivative data. [2025-09-29T22:15:28.363976] [DEBUG] [LOCAL ] SJT: Derivative data saved (1794 records). [2025-09-29T22:15:28.363848] [DEBUG] [LOCAL ] SKIL: Derivative data saved (1794 records). [2025-09-29T22:15:28.372346] [INFO ] [MAIN ] SJT: Successfully saved derivative data. [2025-09-29T22:15:28.378121] [INFO ] [MAIN ] Derivative Progress: 1645/2057 symbols completed. SJT took 1.3s. Estimated remaining: 2m 47s. Rate: 147.7 symbols/min [2025-09-29T22:15:28.378895] [INFO ] [MAIN ] SKLZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:28.378774] [INFO ] [MAIN ] SKIL: Successfully saved derivative data. [2025-09-29T22:15:28.381540] [INFO ] [MAIN ] Derivative Progress: 1646/2057 symbols completed. SKIL took 1.2s. Estimated remaining: 2m 47s. Rate: 147.8 symbols/min [2025-09-29T22:15:28.382230] [INFO ] [MAIN ] SKM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:28.392132] [DEBUG] [LOCAL ] SKE: Derivative data saved (1794 records). [2025-09-29T22:15:28.392488] [INFO ] [MAIN ] SKE: Successfully saved derivative data. [2025-09-29T22:15:28.394907] [INFO ] [MAIN ] Derivative Progress: 1647/2057 symbols completed. SKE took 1.3s. Estimated remaining: 2m 46s. Rate: 147.9 symbols/min [2025-09-29T22:15:28.395176] [INFO ] [MAIN ] SKT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:28.402110] [DEBUG] [LOCAL ] SKLZ: Loaded 11939 existing records from primary storage. [2025-09-29T22:15:28.403119] [INFO ] [MAIN ] SKLZ: Loaded 11939 primary data records. [2025-09-29T22:15:28.563333] [DEBUG] [LOCAL ] SKM: Loaded 34959 existing records from primary storage. [2025-09-29T22:15:28.584517] [INFO ] [MAIN ] SKM: Loaded 34959 primary data records. [2025-09-29T22:15:28.881814] [DEBUG] [LOCAL ] SKT: Loaded 42517 existing records from primary storage. [2025-09-29T22:15:28.906021] [INFO ] [MAIN ] SKT: Loaded 42517 primary data records. [2025-09-29T22:15:29.464575] [DEBUG] [MAIN ] SKLZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:29.466697] [INFO ] [MAIN ] SKLZ: Generated 1794 derivative records from 11939 primary records. [2025-09-29T22:15:29.466957] [DEBUG] [LOCAL ] SKLZ: Saving derivative data. [2025-09-29T22:15:29.487901] [DEBUG] [LOCAL ] SKLZ: Derivative data saved (1794 records). [2025-09-29T22:15:29.489003] [INFO ] [MAIN ] SKLZ: Successfully saved derivative data. [2025-09-29T22:15:29.491491] [INFO ] [MAIN ] Derivative Progress: 1648/2057 symbols completed. SKLZ took 1.1s. Estimated remaining: 2m 46s. Rate: 147.8 symbols/min [2025-09-29T22:15:29.513517] [DEBUG] [MAIN ] SKM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:29.514588] [INFO ] [MAIN ] SKM: Generated 1794 derivative records from 34959 primary records. [2025-09-29T22:15:29.514785] [DEBUG] [LOCAL ] SKM: Saving derivative data. [2025-09-29T22:15:29.548226] [DEBUG] [MAIN ] SKT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:29.549873] [INFO ] [MAIN ] SKT: Generated 1794 derivative records from 42517 primary records. [2025-09-29T22:15:29.550428] [DEBUG] [LOCAL ] SKT: Saving derivative data. [2025-09-29T22:15:29.566212] [DEBUG] [LOCAL ] SKM: Derivative data saved (1794 records). [2025-09-29T22:15:29.566549] [INFO ] [MAIN ] SKM: Successfully saved derivative data. [2025-09-29T22:15:29.569513] [INFO ] [MAIN ] Derivative Progress: 1649/2057 symbols completed. SKM took 1.2s. Estimated remaining: 2m 46s. Rate: 147.8 symbols/min [2025-09-29T22:15:29.573074] [DEBUG] [LOCAL ] SKT: Derivative data saved (1794 records). [2025-09-29T22:15:29.573145] [INFO ] [MAIN ] SKT: Successfully saved derivative data. [2025-09-29T22:15:29.575582] [INFO ] [MAIN ] Derivative Progress: 1650/2057 symbols completed. SKT took 1.2s. Estimated remaining: 2m 45s. Rate: 147.9 symbols/min [2025-09-29T22:15:29.576194] [INFO ] [MAIN ] SKYH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:29.576135] [INFO ] [MAIN ] SKY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:29.576410] [INFO ] [MAIN ] SLB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:29.597364] [DEBUG] [LOCAL ] SKYH: Loaded 16530 existing records from primary storage. [2025-09-29T22:15:29.597672] [INFO ] [MAIN ] SKYH: Loaded 16530 primary data records. [2025-09-29T22:15:29.737898] [DEBUG] [LOCAL ] SKY: Loaded 37686 existing records from primary storage. [2025-09-29T22:15:29.761320] [INFO ] [MAIN ] SKY: Loaded 37686 primary data records. [2025-09-29T22:15:30.118264] [DEBUG] [LOCAL ] SLB: Loaded 53697 existing records from primary storage. [2025-09-29T22:15:30.130983] [INFO ] [MAIN ] SLB: Loaded 53697 primary data records. [2025-09-29T22:15:30.693697] [DEBUG] [MAIN ] SKYH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:30.695059] [INFO ] [MAIN ] SKYH: Generated 1794 derivative records from 16530 primary records. [2025-09-29T22:15:30.695283] [DEBUG] [LOCAL ] SKYH: Saving derivative data. [2025-09-29T22:15:30.714832] [DEBUG] [LOCAL ] SKYH: Derivative data saved (1794 records). [2025-09-29T22:15:30.716509] [INFO ] [MAIN ] SKYH: Successfully saved derivative data. [2025-09-29T22:15:30.719264] [INFO ] [MAIN ] Derivative Progress: 1651/2057 symbols completed. SKYH took 1.1s. Estimated remaining: 2m 45s. Rate: 147.8 symbols/min [2025-09-29T22:15:30.719853] [INFO ] [MAIN ] SLF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:30.734916] [DEBUG] [MAIN ] SKY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:30.735932] [INFO ] [MAIN ] SKY: Generated 1794 derivative records from 37686 primary records. [2025-09-29T22:15:30.736169] [DEBUG] [LOCAL ] SKY: Saving derivative data. [2025-09-29T22:15:30.769987] [DEBUG] [MAIN ] SLB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:30.771749] [DEBUG] [LOCAL ] SKY: Derivative data saved (1794 records). [2025-09-29T22:15:30.771918] [INFO ] [MAIN ] SKY: Successfully saved derivative data. [2025-09-29T22:15:30.771632] [INFO ] [MAIN ] SLB: Generated 1794 derivative records from 53697 primary records. [2025-09-29T22:15:30.774315] [INFO ] [MAIN ] Derivative Progress: 1652/2057 symbols completed. SKY took 1.2s. Estimated remaining: 2m 44s. Rate: 147.8 symbols/min [2025-09-29T22:15:30.774422] [DEBUG] [LOCAL ] SLB: Saving derivative data. [2025-09-29T22:15:30.775487] [INFO ] [MAIN ] SLG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:30.804945] [DEBUG] [LOCAL ] SLB: Derivative data saved (1794 records). [2025-09-29T22:15:30.805236] [INFO ] [MAIN ] SLB: Successfully saved derivative data. [2025-09-29T22:15:30.808139] [INFO ] [MAIN ] Derivative Progress: 1653/2057 symbols completed. SLB took 1.2s. Estimated remaining: 2m 44s. Rate: 147.9 symbols/min [2025-09-29T22:15:30.808561] [INFO ] [MAIN ] SLGN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:30.828628] [DEBUG] [LOCAL ] SLF: Loaded 38739 existing records from primary storage. [2025-09-29T22:15:30.828889] [INFO ] [MAIN ] SLF: Loaded 38739 primary data records. [2025-09-29T22:15:31.033820] [DEBUG] [LOCAL ] SLG: Loaded 45400 existing records from primary storage. [2025-09-29T22:15:31.076985] [INFO ] [MAIN ] SLG: Loaded 45400 primary data records. [2025-09-29T22:15:31.310012] [DEBUG] [LOCAL ] SLGN: Loaded 40384 existing records from primary storage. [2025-09-29T22:15:31.325042] [INFO ] [MAIN ] SLGN: Loaded 40384 primary data records. [2025-09-29T22:15:31.944061] [DEBUG] [MAIN ] SLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:31.945733] [INFO ] [MAIN ] SLF: Generated 1794 derivative records from 38739 primary records. [2025-09-29T22:15:31.945870] [DEBUG] [LOCAL ] SLF: Saving derivative data. [2025-09-29T22:15:31.980292] [DEBUG] [MAIN ] SLG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:31.982357] [INFO ] [MAIN ] SLG: Generated 1794 derivative records from 45400 primary records. [2025-09-29T22:15:31.983149] [DEBUG] [LOCAL ] SLG: Saving derivative data. [2025-09-29T22:15:31.984796] [DEBUG] [LOCAL ] SLF: Derivative data saved (1794 records). [2025-09-29T22:15:31.985228] [INFO ] [MAIN ] SLF: Successfully saved derivative data. [2025-09-29T22:15:31.995118] [INFO ] [MAIN ] Derivative Progress: 1654/2057 symbols completed. SLF took 1.3s. Estimated remaining: 2m 44s. Rate: 147.8 symbols/min [2025-09-29T22:15:31.995339] [INFO ] [MAIN ] SLQT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:32.022331] [DEBUG] [LOCAL ] SLG: Derivative data saved (1794 records). [2025-09-29T22:15:32.023226] [INFO ] [MAIN ] SLG: Successfully saved derivative data. [2025-09-29T22:15:32.025979] [INFO ] [MAIN ] Derivative Progress: 1655/2057 symbols completed. SLG took 1.3s. Estimated remaining: 2m 43s. Rate: 147.8 symbols/min [2025-09-29T22:15:32.023151] [DEBUG] [MAIN ] SLGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:32.027326] [INFO ] [MAIN ] SLGN: Generated 1794 derivative records from 40384 primary records. [2025-09-29T22:15:32.027451] [DEBUG] [LOCAL ] SLGN: Saving derivative data. [2025-09-29T22:15:32.026325] [INFO ] [MAIN ] SLVM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:32.059129] [DEBUG] [LOCAL ] SLGN: Derivative data saved (1794 records). [2025-09-29T22:15:32.059267] [INFO ] [MAIN ] SLGN: Successfully saved derivative data. [2025-09-29T22:15:32.061851] [INFO ] [MAIN ] Derivative Progress: 1656/2057 symbols completed. SLGN took 1.3s. Estimated remaining: 2m 43s. Rate: 147.9 symbols/min [2025-09-29T22:15:32.062180] [INFO ] [MAIN ] SM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:32.094510] [DEBUG] [LOCAL ] SLVM: Loaded 27843 existing records from primary storage. [2025-09-29T22:15:32.095710] [DEBUG] [LOCAL ] SLQT: Loaded 43566 existing records from primary storage. [2025-09-29T22:15:32.094734] [INFO ] [MAIN ] SLVM: Loaded 27843 primary data records. [2025-09-29T22:15:32.096024] [INFO ] [MAIN ] SLQT: Loaded 43566 primary data records. [2025-09-29T22:15:32.860560] [DEBUG] [LOCAL ] SM: Loaded 52302 existing records from primary storage. [2025-09-29T22:15:32.861885] [INFO ] [MAIN ] SM: Loaded 52302 primary data records. [2025-09-29T22:15:33.237877] [DEBUG] [MAIN ] SLVM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:33.239084] [INFO ] [MAIN ] SLVM: Generated 1794 derivative records from 27843 primary records. [2025-09-29T22:15:33.253983] [DEBUG] [MAIN ] SLQT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:33.253687] [DEBUG] [LOCAL ] SLVM: Saving derivative data. [2025-09-29T22:15:33.255612] [INFO ] [MAIN ] SLQT: Generated 1794 derivative records from 43566 primary records. [2025-09-29T22:15:33.263316] [DEBUG] [LOCAL ] SLQT: Saving derivative data. [2025-09-29T22:15:33.273203] [DEBUG] [LOCAL ] SLVM: Derivative data saved (1794 records). [2025-09-29T22:15:33.273992] [INFO ] [MAIN ] SLVM: Successfully saved derivative data. [2025-09-29T22:15:33.276929] [INFO ] [MAIN ] Derivative Progress: 1657/2057 symbols completed. SLVM took 1.3s. Estimated remaining: 2m 42s. Rate: 147.7 symbols/min [2025-09-29T22:15:33.284620] [INFO ] [MAIN ] SMBK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:33.314904] [DEBUG] [MAIN ] SM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:33.316289] [INFO ] [MAIN ] SM: Generated 1794 derivative records from 52302 primary records. [2025-09-29T22:15:33.315323] [DEBUG] [LOCAL ] SLQT: Derivative data saved (1794 records). [2025-09-29T22:15:33.320769] [DEBUG] [LOCAL ] SM: Saving derivative data. [2025-09-29T22:15:33.320564] [DEBUG] [LOCAL ] SMBK: Loaded 8162 existing records from primary storage. [2025-09-29T22:15:33.320681] [INFO ] [MAIN ] SLQT: Successfully saved derivative data. [2025-09-29T22:15:33.321801] [INFO ] [MAIN ] SMBK: Loaded 8162 primary data records. [2025-09-29T22:15:33.324627] [INFO ] [MAIN ] Derivative Progress: 1658/2057 symbols completed. SLQT took 1.3s. Estimated remaining: 2m 42s. Rate: 147.8 symbols/min [2025-09-29T22:15:33.340194] [INFO ] [MAIN ] SMC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:33.488829] [DEBUG] [LOCAL ] SMC: Loaded 11332 existing records from primary storage. [2025-09-29T22:15:33.517376] [INFO ] [MAIN ] SMC: Loaded 11332 primary data records. [2025-09-29T22:15:33.536772] [DEBUG] [LOCAL ] SM: Derivative data saved (1794 records). [2025-09-29T22:15:33.537509] [INFO ] [MAIN ] SM: Successfully saved derivative data. [2025-09-29T22:15:33.717929] [INFO ] [MAIN ] Derivative Progress: 1659/2057 symbols completed. SM took 1.7s. Estimated remaining: 2m 42s. Rate: 147.8 symbols/min [2025-09-29T22:15:33.747347] [INFO ] [MAIN ] SMFG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:34.094900] [DEBUG] [MAIN ] SMBK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:34.095931] [INFO ] [MAIN ] SMBK: Generated 1794 derivative records from 8162 primary records. [2025-09-29T22:15:34.096938] [DEBUG] [LOCAL ] SMBK: Saving derivative data. [2025-09-29T22:15:34.125884] [DEBUG] [LOCAL ] SMFG: Loaded 48091 existing records from primary storage. [2025-09-29T22:15:34.127385] [INFO ] [MAIN ] SMFG: Loaded 48091 primary data records. [2025-09-29T22:15:34.218618] [DEBUG] [LOCAL ] SMBK: Derivative data saved (1794 records). [2025-09-29T22:15:34.237694] [INFO ] [MAIN ] SMBK: Successfully saved derivative data. [2025-09-29T22:15:34.260148] [INFO ] [MAIN ] Derivative Progress: 1660/2057 symbols completed. SMBK took 1.0s. Estimated remaining: 2m 41s. Rate: 147.8 symbols/min [2025-09-29T22:15:34.260929] [INFO ] [MAIN ] SMG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:34.318933] [DEBUG] [MAIN ] SMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:34.364101] [INFO ] [MAIN ] SMC: Generated 1794 derivative records from 11332 primary records. [2025-09-29T22:15:34.526081] [DEBUG] [LOCAL ] SMC: Saving derivative data. [2025-09-29T22:15:34.556774] [DEBUG] [LOCAL ] SMC: Derivative data saved (1794 records). [2025-09-29T22:15:34.568579] [INFO ] [MAIN ] SMC: Successfully saved derivative data. [2025-09-29T22:15:34.571535] [INFO ] [MAIN ] Derivative Progress: 1661/2057 symbols completed. SMC took 1.2s. Estimated remaining: 2m 41s. Rate: 147.8 symbols/min [2025-09-29T22:15:34.572102] [INFO ] [MAIN ] SMHI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:34.603053] [DEBUG] [LOCAL ] SMG: Loaded 43774 existing records from primary storage. [2025-09-29T22:15:34.601865] [DEBUG] [LOCAL ] SMHI: Loaded 13369 existing records from primary storage. [2025-09-29T22:15:34.603539] [INFO ] [MAIN ] SMG: Loaded 43774 primary data records. [2025-09-29T22:15:34.603448] [INFO ] [MAIN ] SMHI: Loaded 13369 primary data records. [2025-09-29T22:15:34.628671] [DEBUG] [MAIN ] SMFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:34.663549] [INFO ] [MAIN ] SMFG: Generated 1794 derivative records from 48091 primary records. [2025-09-29T22:15:34.698286] [DEBUG] [LOCAL ] SMFG: Saving derivative data. [2025-09-29T22:15:35.188733] [DEBUG] [LOCAL ] SMFG: Derivative data saved (1794 records). [2025-09-29T22:15:35.293572] [INFO ] [MAIN ] SMFG: Successfully saved derivative data. [2025-09-29T22:15:35.296755] [INFO ] [MAIN ] Derivative Progress: 1662/2057 symbols completed. SMFG took 1.5s. Estimated remaining: 2m 40s. Rate: 147.7 symbols/min [2025-09-29T22:15:35.297116] [INFO ] [MAIN ] SMP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:35.322228] [DEBUG] [LOCAL ] SMP: Loaded 19461 existing records from primary storage. [2025-09-29T22:15:35.322424] [INFO ] [MAIN ] SMP: Loaded 19461 primary data records. [2025-09-29T22:15:35.481716] [DEBUG] [MAIN ] SMHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:35.521379] [INFO ] [MAIN ] SMHI: Generated 1794 derivative records from 13369 primary records. [2025-09-29T22:15:35.492619] [DEBUG] [MAIN ] SMG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:35.550211] [INFO ] [MAIN ] SMG: Generated 1794 derivative records from 43774 primary records. [2025-09-29T22:15:35.658756] [DEBUG] [LOCAL ] SMHI: Saving derivative data. [2025-09-29T22:15:35.658690] [DEBUG] [LOCAL ] SMG: Saving derivative data. [2025-09-29T22:15:35.705737] [DEBUG] [LOCAL ] SMG: Derivative data saved (1794 records). [2025-09-29T22:15:35.707620] [INFO ] [MAIN ] SMG: Successfully saved derivative data. [2025-09-29T22:15:35.710918] [INFO ] [MAIN ] Derivative Progress: 1663/2057 symbols completed. SMG took 1.4s. Estimated remaining: 2m 40s. Rate: 147.7 symbols/min [2025-09-29T22:15:35.712803] [DEBUG] [LOCAL ] SMHI: Derivative data saved (1794 records). [2025-09-29T22:15:35.712890] [INFO ] [MAIN ] SMHI: Successfully saved derivative data. [2025-09-29T22:15:35.715104] [INFO ] [MAIN ] Derivative Progress: 1664/2057 symbols completed. SMHI took 1.1s. Estimated remaining: 2m 40s. Rate: 147.8 symbols/min [2025-09-29T22:15:35.734938] [DEBUG] [MAIN ] SMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:35.735544] [INFO ] [MAIN ] SMP: Generated 1794 derivative records from 19461 primary records. [2025-09-29T22:15:35.735606] [DEBUG] [LOCAL ] SMP: Saving derivative data. [2025-09-29T22:15:35.751303] [DEBUG] [LOCAL ] SMP: Derivative data saved (1794 records). [2025-09-29T22:15:35.751388] [INFO ] [MAIN ] SMP: Successfully saved derivative data. [2025-09-29T22:15:35.753857] [INFO ] [MAIN ] Derivative Progress: 1665/2057 symbols completed. SMP took 0.5s. Estimated remaining: 2m 39s. Rate: 147.9 symbols/min [2025-09-29T22:15:35.754680] [INFO ] [MAIN ] SN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:35.754560] [INFO ] [MAIN ] SMRT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:35.754814] [INFO ] [MAIN ] SMWB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:35.810959] [DEBUG] [LOCAL ] SMWB: Loaded 32507 existing records from primary storage. [2025-09-29T22:15:35.811241] [INFO ] [MAIN ] SMWB: Loaded 32507 primary data records. [2025-09-29T22:15:35.938761] [DEBUG] [LOCAL ] SMRT: Loaded 43880 existing records from primary storage. [2025-09-29T22:15:35.950924] [INFO ] [MAIN ] SMRT: Loaded 43880 primary data records. [2025-09-29T22:15:35.955882] [DEBUG] [LOCAL ] SN: Loaded 49744 existing records from primary storage. [2025-09-29T22:15:35.966749] [INFO ] [MAIN ] SN: Loaded 49744 primary data records. [2025-09-29T22:15:36.915049] [DEBUG] [MAIN ] SMWB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:36.916192] [INFO ] [MAIN ] SMWB: Generated 1794 derivative records from 32507 primary records. [2025-09-29T22:15:36.916509] [DEBUG] [LOCAL ] SMWB: Saving derivative data. [2025-09-29T22:15:36.941800] [DEBUG] [LOCAL ] SMWB: Derivative data saved (1794 records). [2025-09-29T22:15:36.956735] [INFO ] [MAIN ] SMWB: Successfully saved derivative data. [2025-09-29T22:15:36.958781] [INFO ] [MAIN ] Derivative Progress: 1666/2057 symbols completed. SMWB took 1.2s. Estimated remaining: 2m 39s. Rate: 147.7 symbols/min [2025-09-29T22:15:36.959853] [INFO ] [MAIN ] SNA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:36.959578] [DEBUG] [MAIN ] SN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:36.973620] [DEBUG] [MAIN ] SMRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:36.974632] [INFO ] [MAIN ] SMRT: Generated 1794 derivative records from 43880 primary records. [2025-09-29T22:15:36.976164] [DEBUG] [LOCAL ] SMRT: Saving derivative data. [2025-09-29T22:15:36.975713] [INFO ] [MAIN ] SN: Generated 1794 derivative records from 49744 primary records. [2025-09-29T22:15:36.977037] [DEBUG] [LOCAL ] SN: Saving derivative data. [2025-09-29T22:15:37.008052] [DEBUG] [LOCAL ] SN: Derivative data saved (1794 records). [2025-09-29T22:15:37.009248] [INFO ] [MAIN ] SN: Successfully saved derivative data. [2025-09-29T22:15:37.012016] [INFO ] [MAIN ] Derivative Progress: 1667/2057 symbols completed. SN took 1.3s. Estimated remaining: 2m 38s. Rate: 147.8 symbols/min [2025-09-29T22:15:37.013239] [INFO ] [MAIN ] SNAP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:37.015470] [DEBUG] [LOCAL ] SMRT: Derivative data saved (1794 records). [2025-09-29T22:15:37.015619] [INFO ] [MAIN ] SMRT: Successfully saved derivative data. [2025-09-29T22:15:37.018285] [INFO ] [MAIN ] Derivative Progress: 1668/2057 symbols completed. SMRT took 1.3s. Estimated remaining: 2m 38s. Rate: 147.9 symbols/min [2025-09-29T22:15:37.018619] [INFO ] [MAIN ] SNDA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:37.033375] [DEBUG] [LOCAL ] SNDA: Loaded 4575 existing records from primary storage. [2025-09-29T22:15:37.033616] [INFO ] [MAIN ] SNDA: Loaded 4575 primary data records. [2025-09-29T22:15:37.153765] [DEBUG] [LOCAL ] SNA: Loaded 26015 existing records from primary storage. [2025-09-29T22:15:37.164866] [INFO ] [MAIN ] SNA: Loaded 26015 primary data records. [2025-09-29T22:15:37.495998] [DEBUG] [LOCAL ] SNAP: Loaded 53796 existing records from primary storage. [2025-09-29T22:15:37.511309] [INFO ] [MAIN ] SNAP: Loaded 53796 primary data records. [2025-09-29T22:15:38.094074] [DEBUG] [MAIN ] SNDA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:38.095700] [INFO ] [MAIN ] SNDA: Generated 1794 derivative records from 4575 primary records. [2025-09-29T22:15:38.096026] [DEBUG] [LOCAL ] SNDA: Saving derivative data. [2025-09-29T22:15:38.114968] [DEBUG] [LOCAL ] SNDA: Derivative data saved (1794 records). [2025-09-29T22:15:38.115885] [INFO ] [MAIN ] SNDA: Successfully saved derivative data. [2025-09-29T22:15:38.118374] [INFO ] [MAIN ] Derivative Progress: 1669/2057 symbols completed. SNDA took 1.1s. Estimated remaining: 2m 38s. Rate: 147.7 symbols/min [2025-09-29T22:15:38.118995] [INFO ] [MAIN ] SNDR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:38.138461] [DEBUG] [MAIN ] SNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:38.139372] [INFO ] [MAIN ] SNA: Generated 1794 derivative records from 26015 primary records. [2025-09-29T22:15:38.139667] [DEBUG] [LOCAL ] SNA: Saving derivative data. [2025-09-29T22:15:38.167299] [DEBUG] [LOCAL ] SNA: Derivative data saved (1794 records). [2025-09-29T22:15:38.172957] [INFO ] [MAIN ] SNA: Successfully saved derivative data. [2025-09-29T22:15:38.172900] [DEBUG] [MAIN ] SNAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:38.175164] [INFO ] [MAIN ] Derivative Progress: 1670/2057 symbols completed. SNA took 1.2s. Estimated remaining: 2m 37s. Rate: 147.8 symbols/min [2025-09-29T22:15:38.176189] [INFO ] [MAIN ] SNAP: Generated 1794 derivative records from 53796 primary records. [2025-09-29T22:15:38.176340] [DEBUG] [LOCAL ] SNAP: Saving derivative data. [2025-09-29T22:15:38.176564] [INFO ] [MAIN ] SNN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:38.219967] [DEBUG] [LOCAL ] SNDR: Loaded 40706 existing records from primary storage. [2025-09-29T22:15:38.219076] [DEBUG] [LOCAL ] SNAP: Derivative data saved (1794 records). [2025-09-29T22:15:38.220294] [INFO ] [MAIN ] SNAP: Successfully saved derivative data. [2025-09-29T22:15:38.222496] [INFO ] [MAIN ] Derivative Progress: 1671/2057 symbols completed. SNAP took 1.2s. Estimated remaining: 2m 37s. Rate: 147.9 symbols/min [2025-09-29T22:15:38.222731] [INFO ] [MAIN ] SNDR: Loaded 40706 primary data records. [2025-09-29T22:15:38.222932] [INFO ] [MAIN ] SNV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:38.420180] [DEBUG] [LOCAL ] SNN: Loaded 44340 existing records from primary storage. [2025-09-29T22:15:38.421310] [INFO ] [MAIN ] SNN: Loaded 44340 primary data records. [2025-09-29T22:15:38.780212] [DEBUG] [LOCAL ] SNV: Loaded 48851 existing records from primary storage. [2025-09-29T22:15:38.791684] [INFO ] [MAIN ] SNV: Loaded 48851 primary data records. [2025-09-29T22:15:39.371288] [DEBUG] [MAIN ] SNDR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:39.383308] [INFO ] [MAIN ] SNDR: Generated 1794 derivative records from 40706 primary records. [2025-09-29T22:15:39.383453] [DEBUG] [LOCAL ] SNDR: Saving derivative data. [2025-09-29T22:15:39.424420] [DEBUG] [LOCAL ] SNDR: Derivative data saved (1794 records). [2025-09-29T22:15:39.425630] [DEBUG] [MAIN ] SNN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:39.427986] [INFO ] [MAIN ] SNN: Generated 1794 derivative records from 44340 primary records. [2025-09-29T22:15:39.425726] [INFO ] [MAIN ] SNDR: Successfully saved derivative data. [2025-09-29T22:15:39.430555] [INFO ] [MAIN ] Derivative Progress: 1672/2057 symbols completed. SNDR took 1.3s. Estimated remaining: 2m 36s. Rate: 147.7 symbols/min [2025-09-29T22:15:39.428322] [DEBUG] [LOCAL ] SNN: Saving derivative data. [2025-09-29T22:15:39.430768] [INFO ] [MAIN ] SNX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:39.452832] [DEBUG] [LOCAL ] SNN: Derivative data saved (1794 records). [2025-09-29T22:15:39.453385] [INFO ] [MAIN ] SNN: Successfully saved derivative data. [2025-09-29T22:15:39.455962] [INFO ] [MAIN ] Derivative Progress: 1673/2057 symbols completed. SNN took 1.3s. Estimated remaining: 2m 36s. Rate: 147.8 symbols/min [2025-09-29T22:15:39.456371] [INFO ] [MAIN ] SOBO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:39.473954] [DEBUG] [MAIN ] SNV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:39.474764] [INFO ] [MAIN ] SNV: Generated 1794 derivative records from 48851 primary records. [2025-09-29T22:15:39.474982] [DEBUG] [LOCAL ] SNV: Saving derivative data. [2025-09-29T22:15:39.492045] [DEBUG] [LOCAL ] SNV: Derivative data saved (1794 records). [2025-09-29T22:15:39.492219] [INFO ] [MAIN ] SNV: Successfully saved derivative data. [2025-09-29T22:15:39.494376] [INFO ] [MAIN ] Derivative Progress: 1674/2057 symbols completed. SNV took 1.3s. Estimated remaining: 2m 35s. Rate: 147.9 symbols/min [2025-09-29T22:15:39.494565] [INFO ] [MAIN ] SOC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:39.526478] [DEBUG] [LOCAL ] SNX: Loaded 39916 existing records from primary storage. [2025-09-29T22:15:39.526908] [INFO ] [MAIN ] SNX: Loaded 39916 primary data records. [2025-09-29T22:15:39.686192] [DEBUG] [LOCAL ] SOBO: Loaded 39451 existing records from primary storage. [2025-09-29T22:15:39.728997] [INFO ] [MAIN ] SOBO: Loaded 39451 primary data records. [2025-09-29T22:15:40.020158] [DEBUG] [LOCAL ] SOC: Loaded 50346 existing records from primary storage. [2025-09-29T22:15:40.036138] [INFO ] [MAIN ] SOC: Loaded 50346 primary data records. [2025-09-29T22:15:40.629062] [DEBUG] [MAIN ] SNX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:40.630699] [INFO ] [MAIN ] SNX: Generated 1794 derivative records from 39916 primary records. [2025-09-29T22:15:40.631143] [DEBUG] [LOCAL ] SNX: Saving derivative data. [2025-09-29T22:15:40.672725] [DEBUG] [LOCAL ] SNX: Derivative data saved (1794 records). [2025-09-29T22:15:40.674020] [INFO ] [MAIN ] SNX: Successfully saved derivative data. [2025-09-29T22:15:40.673673] [DEBUG] [MAIN ] SOBO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:40.677856] [INFO ] [MAIN ] SOBO: Generated 1794 derivative records from 39451 primary records. [2025-09-29T22:15:40.676416] [INFO ] [MAIN ] Derivative Progress: 1675/2057 symbols completed. SNX took 1.2s. Estimated remaining: 2m 35s. Rate: 147.7 symbols/min [2025-09-29T22:15:40.678662] [INFO ] [MAIN ] SOJC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:40.678368] [DEBUG] [LOCAL ] SOBO: Saving derivative data. [2025-09-29T22:15:40.713684] [DEBUG] [MAIN ] SOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:40.719421] [INFO ] [MAIN ] SOC: Generated 1794 derivative records from 50346 primary records. [2025-09-29T22:15:40.719867] [DEBUG] [LOCAL ] SOC: Saving derivative data. [2025-09-29T22:15:40.718054] [DEBUG] [LOCAL ] SOJC: Loaded 5050 existing records from primary storage. [2025-09-29T22:15:40.721854] [INFO ] [MAIN ] SOJC: Loaded 5050 primary data records. [2025-09-29T22:15:40.722377] [DEBUG] [LOCAL ] SOBO: Derivative data saved (1794 records). [2025-09-29T22:15:40.734782] [INFO ] [MAIN ] SOBO: Successfully saved derivative data. [2025-09-29T22:15:40.787456] [INFO ] [MAIN ] Derivative Progress: 1676/2057 symbols completed. SOBO took 1.3s. Estimated remaining: 2m 35s. Rate: 147.8 symbols/min [2025-09-29T22:15:40.816220] [INFO ] [MAIN ] SOJD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:40.835721] [DEBUG] [LOCAL ] SOC: Derivative data saved (1794 records). [2025-09-29T22:15:40.845272] [INFO ] [MAIN ] SOC: Successfully saved derivative data. [2025-09-29T22:15:40.847591] [INFO ] [MAIN ] Derivative Progress: 1677/2057 symbols completed. SOC took 1.4s. Estimated remaining: 2m 34s. Rate: 147.9 symbols/min [2025-09-29T22:15:40.860792] [INFO ] [MAIN ] SOJE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:40.962939] [DEBUG] [LOCAL ] SOJD: Loaded 13039 existing records from primary storage. [2025-09-29T22:15:41.016362] [DEBUG] [LOCAL ] SOJE: Loaded 9332 existing records from primary storage. [2025-09-29T22:15:41.048780] [INFO ] [MAIN ] SOJD: Loaded 13039 primary data records. [2025-09-29T22:15:41.129543] [INFO ] [MAIN ] SOJE: Loaded 9332 primary data records. [2025-09-29T22:15:41.797400] [DEBUG] [MAIN ] SOJC: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:15:41.799370] [INFO ] [MAIN ] SOJC: Generated 1793 derivative records from 5050 primary records. [2025-09-29T22:15:41.799968] [DEBUG] [LOCAL ] SOJC: Saving derivative data. [2025-09-29T22:15:41.820114] [DEBUG] [LOCAL ] SOJC: Derivative data saved (1793 records). [2025-09-29T22:15:41.820599] [INFO ] [MAIN ] SOJC: Successfully saved derivative data. [2025-09-29T22:15:41.823113] [INFO ] [MAIN ] Derivative Progress: 1678/2057 symbols completed. SOJC took 1.1s. Estimated remaining: 2m 34s. Rate: 147.7 symbols/min [2025-09-29T22:15:41.845522] [DEBUG] [MAIN ] SOJE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:41.846473] [INFO ] [MAIN ] SOJE: Generated 1794 derivative records from 9332 primary records. [2025-09-29T22:15:41.846728] [DEBUG] [LOCAL ] SOJE: Saving derivative data. [2025-09-29T22:15:41.879921] [DEBUG] [LOCAL ] SOJE: Derivative data saved (1794 records). [2025-09-29T22:15:41.880440] [INFO ] [MAIN ] SOJE: Successfully saved derivative data. [2025-09-29T22:15:41.882531] [INFO ] [MAIN ] Derivative Progress: 1679/2057 symbols completed. SOJE took 1.0s. Estimated remaining: 2m 33s. Rate: 147.8 symbols/min [2025-09-29T22:15:41.880303] [DEBUG] [MAIN ] SOJD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:41.883507] [INFO ] [MAIN ] SOJD: Generated 1794 derivative records from 13039 primary records. [2025-09-29T22:15:41.883583] [DEBUG] [LOCAL ] SOJD: Saving derivative data. [2025-09-29T22:15:41.899874] [DEBUG] [LOCAL ] SOJD: Derivative data saved (1794 records). [2025-09-29T22:15:41.900008] [INFO ] [MAIN ] SOJD: Successfully saved derivative data. [2025-09-29T22:15:41.902149] [INFO ] [MAIN ] Derivative Progress: 1680/2057 symbols completed. SOJD took 1.1s. Estimated remaining: 2m 33s. Rate: 147.9 symbols/min [2025-09-29T22:15:41.902698] [INFO ] [MAIN ] SOL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:41.902847] [INFO ] [MAIN ] SON: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:41.903570] [INFO ] [MAIN ] SOLV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:41.919815] [DEBUG] [LOCAL ] SOL: Loaded 13458 existing records from primary storage. [2025-09-29T22:15:41.920115] [INFO ] [MAIN ] SOL: Loaded 13458 primary data records. [2025-09-29T22:15:42.149945] [DEBUG] [LOCAL ] SOLV: Loaded 44046 existing records from primary storage. [2025-09-29T22:15:42.167577] [DEBUG] [LOCAL ] SON: Loaded 42977 existing records from primary storage. [2025-09-29T22:15:42.225700] [INFO ] [MAIN ] SON: Loaded 42977 primary data records. [2025-09-29T22:15:42.173940] [INFO ] [MAIN ] SOLV: Loaded 44046 primary data records. [2025-09-29T22:15:43.041310] [DEBUG] [MAIN ] SOL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:43.043874] [INFO ] [MAIN ] SOL: Generated 1794 derivative records from 13458 primary records. [2025-09-29T22:15:43.044343] [DEBUG] [LOCAL ] SOL: Saving derivative data. [2025-09-29T22:15:43.065760] [DEBUG] [LOCAL ] SOL: Derivative data saved (1794 records). [2025-09-29T22:15:43.066217] [INFO ] [MAIN ] SOL: Successfully saved derivative data. [2025-09-29T22:15:43.069727] [INFO ] [MAIN ] Derivative Progress: 1681/2057 symbols completed. SOL took 1.2s. Estimated remaining: 2m 33s. Rate: 147.7 symbols/min [2025-09-29T22:15:43.071488] [INFO ] [MAIN ] SONY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:43.089239] [DEBUG] [MAIN ] SOLV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:43.091788] [INFO ] [MAIN ] SOLV: Generated 1794 derivative records from 44046 primary records. [2025-09-29T22:15:43.092214] [DEBUG] [LOCAL ] SOLV: Saving derivative data. [2025-09-29T22:15:43.127047] [DEBUG] [MAIN ] SON: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:43.129561] [INFO ] [MAIN ] SON: Generated 1794 derivative records from 42977 primary records. [2025-09-29T22:15:43.130347] [DEBUG] [LOCAL ] SON: Saving derivative data. [2025-09-29T22:15:43.134266] [DEBUG] [LOCAL ] SOLV: Derivative data saved (1794 records). [2025-09-29T22:15:43.148026] [INFO ] [MAIN ] SOLV: Successfully saved derivative data. [2025-09-29T22:15:43.154465] [INFO ] [MAIN ] Derivative Progress: 1682/2057 symbols completed. SOLV took 1.3s. Estimated remaining: 2m 32s. Rate: 147.8 symbols/min [2025-09-29T22:15:43.156724] [INFO ] [MAIN ] SOR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:43.156582] [DEBUG] [LOCAL ] SON: Derivative data saved (1794 records). [2025-09-29T22:15:43.157455] [INFO ] [MAIN ] SON: Successfully saved derivative data. [2025-09-29T22:15:43.160010] [INFO ] [MAIN ] Derivative Progress: 1683/2057 symbols completed. SON took 1.3s. Estimated remaining: 2m 32s. Rate: 147.9 symbols/min [2025-09-29T22:15:43.160462] [INFO ] [MAIN ] SOS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:43.182015] [DEBUG] [LOCAL ] SOR: Loaded 2891 existing records from primary storage. [2025-09-29T22:15:43.182348] [INFO ] [MAIN ] SOR: Loaded 2891 primary data records. [2025-09-29T22:15:43.266779] [DEBUG] [LOCAL ] SOS: Loaded 8457 existing records from primary storage. [2025-09-29T22:15:43.281541] [INFO ] [MAIN ] SOS: Loaded 8457 primary data records. [2025-09-29T22:15:43.362111] [DEBUG] [LOCAL ] SONY: Loaded 53357 existing records from primary storage. [2025-09-29T22:15:43.393194] [INFO ] [MAIN ] SONY: Loaded 53357 primary data records. [2025-09-29T22:15:44.563403] [DEBUG] [MAIN ] SOR: Filtered 7001 bins outside market hours, 7824 incomplete bins [2025-09-29T22:15:44.564481] [INFO ] [MAIN ] SOR: Generated 1790 derivative records from 2891 primary records. [2025-09-29T22:15:44.566061] [DEBUG] [LOCAL ] SOR: Saving derivative data. [2025-09-29T22:15:44.607979] [DEBUG] [MAIN ] SOS: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-09-29T22:15:44.615057] [DEBUG] [MAIN ] SONY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:44.615982] [INFO ] [MAIN ] SOS: Generated 1792 derivative records from 8457 primary records. [2025-09-29T22:15:44.616768] [DEBUG] [LOCAL ] SOR: Derivative data saved (1790 records). [2025-09-29T22:15:44.616990] [DEBUG] [LOCAL ] SOS: Saving derivative data. [2025-09-29T22:15:44.617189] [INFO ] [MAIN ] SOR: Successfully saved derivative data. [2025-09-29T22:15:44.620035] [INFO ] [MAIN ] SONY: Generated 1794 derivative records from 53357 primary records. [2025-09-29T22:15:44.619122] [INFO ] [MAIN ] Derivative Progress: 1684/2057 symbols completed. SOR took 1.5s. Estimated remaining: 2m 32s. Rate: 147.7 symbols/min [2025-09-29T22:15:44.620771] [INFO ] [MAIN ] SPB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:44.621526] [DEBUG] [LOCAL ] SONY: Saving derivative data. [2025-09-29T22:15:44.647691] [DEBUG] [LOCAL ] SOS: Derivative data saved (1792 records). [2025-09-29T22:15:44.653102] [INFO ] [MAIN ] SOS: Successfully saved derivative data. [2025-09-29T22:15:44.656360] [INFO ] [MAIN ] Derivative Progress: 1685/2057 symbols completed. SOS took 1.5s. Estimated remaining: 2m 31s. Rate: 147.7 symbols/min [2025-09-29T22:15:44.656767] [INFO ] [MAIN ] SPCE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:44.659191] [DEBUG] [LOCAL ] SONY: Derivative data saved (1794 records). [2025-09-29T22:15:44.659612] [INFO ] [MAIN ] SONY: Successfully saved derivative data. [2025-09-29T22:15:44.661823] [INFO ] [MAIN ] Derivative Progress: 1686/2057 symbols completed. SONY took 1.6s. Estimated remaining: 2m 31s. Rate: 147.8 symbols/min [2025-09-29T22:15:44.662255] [INFO ] [MAIN ] SPE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:44.682004] [DEBUG] [LOCAL ] SPE: Loaded 6363 existing records from primary storage. [2025-09-29T22:15:44.691419] [INFO ] [MAIN ] SPE: Loaded 6363 primary data records. [2025-09-29T22:15:44.717898] [DEBUG] [LOCAL ] SPB: Loaded 34134 existing records from primary storage. [2025-09-29T22:15:44.735079] [INFO ] [MAIN ] SPB: Loaded 34134 primary data records. [2025-09-29T22:15:45.060607] [DEBUG] [LOCAL ] SPCE: Loaded 49882 existing records from primary storage. [2025-09-29T22:15:45.099197] [INFO ] [MAIN ] SPCE: Loaded 49882 primary data records. [2025-09-29T22:15:45.825330] [DEBUG] [MAIN ] SPE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:45.827063] [INFO ] [MAIN ] SPE: Generated 1794 derivative records from 6363 primary records. [2025-09-29T22:15:45.827999] [DEBUG] [LOCAL ] SPE: Saving derivative data. [2025-09-29T22:15:45.843597] [DEBUG] [MAIN ] SPB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:45.845421] [INFO ] [MAIN ] SPB: Generated 1794 derivative records from 34134 primary records. [2025-09-29T22:15:45.852533] [DEBUG] [LOCAL ] SPB: Saving derivative data. [2025-09-29T22:15:45.882950] [DEBUG] [LOCAL ] SPE: Derivative data saved (1794 records). [2025-09-29T22:15:45.883837] [INFO ] [MAIN ] SPE: Successfully saved derivative data. [2025-09-29T22:15:45.886214] [INFO ] [MAIN ] Derivative Progress: 1687/2057 symbols completed. SPE took 1.2s. Estimated remaining: 2m 30s. Rate: 147.6 symbols/min [2025-09-29T22:15:45.900515] [INFO ] [MAIN ] SPG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:45.901589] [DEBUG] [MAIN ] SPCE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:45.903077] [INFO ] [MAIN ] SPCE: Generated 1794 derivative records from 49882 primary records. [2025-09-29T22:15:45.903828] [DEBUG] [LOCAL ] SPCE: Saving derivative data. [2025-09-29T22:15:45.903944] [DEBUG] [LOCAL ] SPB: Derivative data saved (1794 records). [2025-09-29T22:15:45.904197] [INFO ] [MAIN ] SPB: Successfully saved derivative data. [2025-09-29T22:15:45.907054] [INFO ] [MAIN ] Derivative Progress: 1688/2057 symbols completed. SPB took 1.3s. Estimated remaining: 2m 30s. Rate: 147.7 symbols/min [2025-09-29T22:15:45.907752] [INFO ] [MAIN ] SPGI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:45.925179] [DEBUG] [LOCAL ] SPCE: Derivative data saved (1794 records). [2025-09-29T22:15:45.925371] [INFO ] [MAIN ] SPCE: Successfully saved derivative data. [2025-09-29T22:15:45.927828] [INFO ] [MAIN ] Derivative Progress: 1689/2057 symbols completed. SPCE took 1.3s. Estimated remaining: 2m 29s. Rate: 147.8 symbols/min [2025-09-29T22:15:45.928128] [INFO ] [MAIN ] SPH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:45.950320] [DEBUG] [LOCAL ] SPH: Loaded 17676 existing records from primary storage. [2025-09-29T22:15:45.950578] [INFO ] [MAIN ] SPH: Loaded 17676 primary data records. [2025-09-29T22:15:46.212003] [DEBUG] [LOCAL ] SPG: Loaded 50320 existing records from primary storage. [2025-09-29T22:15:46.212773] [DEBUG] [LOCAL ] SPGI: Loaded 45801 existing records from primary storage. [2025-09-29T22:15:46.315750] [INFO ] [MAIN ] SPG: Loaded 50320 primary data records. [2025-09-29T22:15:46.334379] [INFO ] [MAIN ] SPGI: Loaded 45801 primary data records. [2025-09-29T22:15:46.992508] [DEBUG] [MAIN ] SPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:46.996794] [INFO ] [MAIN ] SPH: Generated 1794 derivative records from 17676 primary records. [2025-09-29T22:15:46.997005] [DEBUG] [LOCAL ] SPH: Saving derivative data. [2025-09-29T22:15:47.017319] [DEBUG] [LOCAL ] SPH: Derivative data saved (1794 records). [2025-09-29T22:15:47.017800] [INFO ] [MAIN ] SPH: Successfully saved derivative data. [2025-09-29T22:15:47.019868] [INFO ] [MAIN ] Derivative Progress: 1690/2057 symbols completed. SPH took 1.1s. Estimated remaining: 2m 29s. Rate: 147.7 symbols/min [2025-09-29T22:15:47.020269] [INFO ] [MAIN ] SPHR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:47.040141] [DEBUG] [MAIN ] SPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:47.041083] [INFO ] [MAIN ] SPG: Generated 1794 derivative records from 50320 primary records. [2025-09-29T22:15:47.054146] [DEBUG] [MAIN ] SPGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:47.053882] [DEBUG] [LOCAL ] SPG: Saving derivative data. [2025-09-29T22:15:47.055809] [INFO ] [MAIN ] SPGI: Generated 1794 derivative records from 45801 primary records. [2025-09-29T22:15:47.056474] [DEBUG] [LOCAL ] SPGI: Saving derivative data. [2025-09-29T22:15:47.095323] [DEBUG] [LOCAL ] SPGI: Derivative data saved (1794 records). [2025-09-29T22:15:47.096547] [INFO ] [MAIN ] SPGI: Successfully saved derivative data. [2025-09-29T22:15:47.099125] [INFO ] [MAIN ] Derivative Progress: 1691/2057 symbols completed. SPGI took 1.2s. Estimated remaining: 2m 29s. Rate: 147.7 symbols/min [2025-09-29T22:15:47.099612] [INFO ] [MAIN ] SPIR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:47.102104] [DEBUG] [LOCAL ] SPG: Derivative data saved (1794 records). [2025-09-29T22:15:47.102236] [INFO ] [MAIN ] SPG: Successfully saved derivative data. [2025-09-29T22:15:47.104530] [INFO ] [MAIN ] Derivative Progress: 1692/2057 symbols completed. SPG took 1.2s. Estimated remaining: 2m 28s. Rate: 147.8 symbols/min [2025-09-29T22:15:47.104941] [INFO ] [MAIN ] SPMC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:47.118907] [DEBUG] [LOCAL ] SPHR: Loaded 40022 existing records from primary storage. [2025-09-29T22:15:47.119111] [INFO ] [MAIN ] SPHR: Loaded 40022 primary data records. [2025-09-29T22:15:47.199405] [DEBUG] [LOCAL ] SPMC: Loaded 5454 existing records from primary storage. [2025-09-29T22:15:47.226733] [INFO ] [MAIN ] SPMC: Loaded 5454 primary data records. [2025-09-29T22:15:47.451122] [DEBUG] [LOCAL ] SPIR: Loaded 37260 existing records from primary storage. [2025-09-29T22:15:47.584524] [INFO ] [MAIN ] SPIR: Loaded 37260 primary data records. [2025-09-29T22:15:48.214948] [DEBUG] [MAIN ] SPHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:48.217106] [INFO ] [MAIN ] SPHR: Generated 1794 derivative records from 40022 primary records. [2025-09-29T22:15:48.217388] [DEBUG] [LOCAL ] SPHR: Saving derivative data. [2025-09-29T22:15:48.239238] [DEBUG] [LOCAL ] SPHR: Derivative data saved (1794 records). [2025-09-29T22:15:48.239708] [INFO ] [MAIN ] SPHR: Successfully saved derivative data. [2025-09-29T22:15:48.243728] [INFO ] [MAIN ] Derivative Progress: 1693/2057 symbols completed. SPHR took 1.2s. Estimated remaining: 2m 28s. Rate: 147.7 symbols/min [2025-09-29T22:15:48.270840] [DEBUG] [MAIN ] SPMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:48.272317] [INFO ] [MAIN ] SPMC: Generated 1794 derivative records from 5454 primary records. [2025-09-29T22:15:48.273685] [DEBUG] [LOCAL ] SPMC: Saving derivative data. [2025-09-29T22:15:48.311028] [DEBUG] [MAIN ] SPIR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:48.312080] [DEBUG] [LOCAL ] SPMC: Derivative data saved (1794 records). [2025-09-29T22:15:48.313119] [INFO ] [MAIN ] SPIR: Generated 1794 derivative records from 37260 primary records. [2025-09-29T22:15:48.313245] [INFO ] [MAIN ] SPMC: Successfully saved derivative data. [2025-09-29T22:15:48.313321] [DEBUG] [LOCAL ] SPIR: Saving derivative data. [2025-09-29T22:15:48.315734] [INFO ] [MAIN ] Derivative Progress: 1694/2057 symbols completed. SPMC took 1.2s. Estimated remaining: 2m 27s. Rate: 147.7 symbols/min [2025-09-29T22:15:48.332455] [DEBUG] [LOCAL ] SPIR: Derivative data saved (1794 records). [2025-09-29T22:15:48.332543] [INFO ] [MAIN ] SPIR: Successfully saved derivative data. [2025-09-29T22:15:48.334590] [INFO ] [MAIN ] Derivative Progress: 1695/2057 symbols completed. SPIR took 1.2s. Estimated remaining: 2m 27s. Rate: 147.8 symbols/min [2025-09-29T22:15:48.335118] [INFO ] [MAIN ] SPNT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:48.335381] [INFO ] [MAIN ] SPRU: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:48.335275] [INFO ] [MAIN ] SPR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:48.351443] [DEBUG] [LOCAL ] SPRU: Loaded 8757 existing records from primary storage. [2025-09-29T22:15:48.351693] [INFO ] [MAIN ] SPRU: Loaded 8757 primary data records. [2025-09-29T22:15:48.519743] [DEBUG] [LOCAL ] SPNT: Loaded 34745 existing records from primary storage. [2025-09-29T22:15:48.525181] [INFO ] [MAIN ] SPNT: Loaded 34745 primary data records. [2025-09-29T22:15:48.689265] [DEBUG] [LOCAL ] SPR: Loaded 41141 existing records from primary storage. [2025-09-29T22:15:48.827103] [INFO ] [MAIN ] SPR: Loaded 41141 primary data records. [2025-09-29T22:15:49.400155] [DEBUG] [MAIN ] SPRU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:49.401440] [INFO ] [MAIN ] SPRU: Generated 1794 derivative records from 8757 primary records. [2025-09-29T22:15:49.405887] [DEBUG] [LOCAL ] SPRU: Saving derivative data. [2025-09-29T22:15:49.422018] [DEBUG] [MAIN ] SPNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:49.425436] [INFO ] [MAIN ] SPNT: Generated 1794 derivative records from 34745 primary records. [2025-09-29T22:15:49.441781] [DEBUG] [LOCAL ] SPNT: Saving derivative data. [2025-09-29T22:15:49.447106] [DEBUG] [LOCAL ] SPRU: Derivative data saved (1794 records). [2025-09-29T22:15:49.448669] [INFO ] [MAIN ] SPRU: Successfully saved derivative data. [2025-09-29T22:15:49.451298] [INFO ] [MAIN ] Derivative Progress: 1696/2057 symbols completed. SPRU took 1.1s. Estimated remaining: 2m 27s. Rate: 147.7 symbols/min [2025-09-29T22:15:49.459857] [INFO ] [MAIN ] SPXC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:49.469381] [DEBUG] [LOCAL ] SPNT: Derivative data saved (1794 records). [2025-09-29T22:15:49.470020] [INFO ] [MAIN ] SPNT: Successfully saved derivative data. [2025-09-29T22:15:49.473249] [INFO ] [MAIN ] Derivative Progress: 1697/2057 symbols completed. SPNT took 1.1s. Estimated remaining: 2m 26s. Rate: 147.7 symbols/min [2025-09-29T22:15:49.473478] [INFO ] [MAIN ] SPXX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:49.490988] [DEBUG] [MAIN ] SPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:49.491817] [INFO ] [MAIN ] SPR: Generated 1794 derivative records from 41141 primary records. [2025-09-29T22:15:49.491895] [DEBUG] [LOCAL ] SPR: Saving derivative data. [2025-09-29T22:15:49.518733] [DEBUG] [LOCAL ] SPXX: Loaded 9028 existing records from primary storage. [2025-09-29T22:15:49.519699] [INFO ] [MAIN ] SPXX: Loaded 9028 primary data records. [2025-09-29T22:15:49.579412] [DEBUG] [LOCAL ] SPXC: Loaded 23250 existing records from primary storage. [2025-09-29T22:15:49.585585] [INFO ] [MAIN ] SPXC: Loaded 23250 primary data records. [2025-09-29T22:15:49.655033] [DEBUG] [LOCAL ] SPR: Derivative data saved (1794 records). [2025-09-29T22:15:49.687543] [INFO ] [MAIN ] SPR: Successfully saved derivative data. [2025-09-29T22:15:49.705486] [INFO ] [MAIN ] Derivative Progress: 1698/2057 symbols completed. SPR took 1.4s. Estimated remaining: 2m 26s. Rate: 147.8 symbols/min [2025-09-29T22:15:49.706756] [INFO ] [MAIN ] SQM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:50.289698] [DEBUG] [LOCAL ] SQM: Loaded 48530 existing records from primary storage. [2025-09-29T22:15:50.290875] [INFO ] [MAIN ] SQM: Loaded 48530 primary data records. [2025-09-29T22:15:50.465177] [DEBUG] [MAIN ] SPXX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:50.482549] [INFO ] [MAIN ] SPXX: Generated 1794 derivative records from 9028 primary records. [2025-09-29T22:15:50.530350] [DEBUG] [LOCAL ] SPXX: Saving derivative data. [2025-09-29T22:15:50.667623] [DEBUG] [MAIN ] SPXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:50.677582] [INFO ] [MAIN ] SPXC: Generated 1794 derivative records from 23250 primary records. [2025-09-29T22:15:50.678119] [DEBUG] [LOCAL ] SPXC: Saving derivative data. [2025-09-29T22:15:50.707034] [DEBUG] [LOCAL ] SPXX: Derivative data saved (1794 records). [2025-09-29T22:15:50.708171] [INFO ] [MAIN ] SPXX: Successfully saved derivative data. [2025-09-29T22:15:50.710669] [INFO ] [MAIN ] Derivative Progress: 1699/2057 symbols completed. SPXX took 1.2s. Estimated remaining: 2m 25s. Rate: 147.7 symbols/min [2025-09-29T22:15:50.712294] [INFO ] [MAIN ] SQNS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:50.719515] [DEBUG] [LOCAL ] SPXC: Derivative data saved (1794 records). [2025-09-29T22:15:50.720868] [INFO ] [MAIN ] SPXC: Successfully saved derivative data. [2025-09-29T22:15:50.723264] [INFO ] [MAIN ] Derivative Progress: 1700/2057 symbols completed. SPXC took 1.3s. Estimated remaining: 2m 25s. Rate: 147.7 symbols/min [2025-09-29T22:15:50.723699] [INFO ] [MAIN ] SR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:50.748900] [DEBUG] [LOCAL ] SQNS: Loaded 26214 existing records from primary storage. [2025-09-29T22:15:50.749275] [INFO ] [MAIN ] SQNS: Loaded 26214 primary data records. [2025-09-29T22:15:50.811028] [DEBUG] [MAIN ] SQM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:50.826299] [INFO ] [MAIN ] SQM: Generated 1794 derivative records from 48530 primary records. [2025-09-29T22:15:50.843802] [DEBUG] [LOCAL ] SQM: Saving derivative data. [2025-09-29T22:15:51.141965] [DEBUG] [LOCAL ] SR: Loaded 32873 existing records from primary storage. [2025-09-29T22:15:51.144612] [DEBUG] [LOCAL ] SQM: Derivative data saved (1794 records). [2025-09-29T22:15:51.144898] [INFO ] [MAIN ] SR: Loaded 32873 primary data records. [2025-09-29T22:15:51.145119] [INFO ] [MAIN ] SQM: Successfully saved derivative data. [2025-09-29T22:15:51.148354] [INFO ] [MAIN ] Derivative Progress: 1701/2057 symbols completed. SQM took 1.4s. Estimated remaining: 2m 25s. Rate: 147.7 symbols/min [2025-09-29T22:15:51.148696] [INFO ] [MAIN ] SREA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:51.338709] [DEBUG] [LOCAL ] SREA: Loaded 10419 existing records from primary storage. [2025-09-29T22:15:51.377898] [INFO ] [MAIN ] SREA: Loaded 10419 primary data records. [2025-09-29T22:15:51.672740] [DEBUG] [MAIN ] SQNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:51.705587] [INFO ] [MAIN ] SQNS: Generated 1794 derivative records from 26214 primary records. [2025-09-29T22:15:51.733288] [DEBUG] [LOCAL ] SQNS: Saving derivative data. [2025-09-29T22:15:51.961989] [DEBUG] [LOCAL ] SQNS: Derivative data saved (1794 records). [2025-09-29T22:15:51.963420] [INFO ] [MAIN ] SQNS: Successfully saved derivative data. [2025-09-29T22:15:51.962228] [DEBUG] [MAIN ] SR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:51.964274] [INFO ] [MAIN ] SR: Generated 1794 derivative records from 32873 primary records. [2025-09-29T22:15:51.964706] [DEBUG] [LOCAL ] SR: Saving derivative data. [2025-09-29T22:15:51.967388] [INFO ] [MAIN ] Derivative Progress: 1702/2057 symbols completed. SQNS took 1.3s. Estimated remaining: 2m 24s. Rate: 147.6 symbols/min [2025-09-29T22:15:51.968399] [INFO ] [MAIN ] SRFM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:51.986307] [DEBUG] [LOCAL ] SR: Derivative data saved (1794 records). [2025-09-29T22:15:51.986474] [INFO ] [MAIN ] SR: Successfully saved derivative data. [2025-09-29T22:15:51.988855] [INFO ] [MAIN ] Derivative Progress: 1703/2057 symbols completed. SR took 1.3s. Estimated remaining: 2m 24s. Rate: 147.7 symbols/min [2025-09-29T22:15:51.989216] [INFO ] [MAIN ] SRG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:52.008816] [DEBUG] [MAIN ] SREA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:52.010111] [INFO ] [MAIN ] SREA: Generated 1794 derivative records from 10419 primary records. [2025-09-29T22:15:52.010320] [DEBUG] [LOCAL ] SREA: Saving derivative data. [2025-09-29T22:15:52.042589] [DEBUG] [LOCAL ] SRG: Loaded 15524 existing records from primary storage. [2025-09-29T22:15:52.056744] [INFO ] [MAIN ] SRG: Loaded 15524 primary data records. [2025-09-29T22:15:52.046281] [DEBUG] [LOCAL ] SREA: Derivative data saved (1794 records). [2025-09-29T22:15:52.069497] [INFO ] [MAIN ] SREA: Successfully saved derivative data. [2025-09-29T22:15:52.091881] [DEBUG] [LOCAL ] SRFM: Loaded 36247 existing records from primary storage. [2025-09-29T22:15:52.109163] [INFO ] [MAIN ] Derivative Progress: 1704/2057 symbols completed. SREA took 1.0s. Estimated remaining: 2m 23s. Rate: 147.8 symbols/min [2025-09-29T22:15:52.114620] [INFO ] [MAIN ] SRI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:52.114768] [INFO ] [MAIN ] SRFM: Loaded 36247 primary data records. [2025-09-29T22:15:52.632246] [DEBUG] [LOCAL ] SRI: Loaded 27306 existing records from primary storage. [2025-09-29T22:15:52.665450] [INFO ] [MAIN ] SRI: Loaded 27306 primary data records. [2025-09-29T22:15:53.159050] [DEBUG] [MAIN ] SRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:53.160325] [INFO ] [MAIN ] SRG: Generated 1794 derivative records from 15524 primary records. [2025-09-29T22:15:53.174894] [DEBUG] [LOCAL ] SRG: Saving derivative data. [2025-09-29T22:15:53.175227] [DEBUG] [MAIN ] SRFM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:53.176390] [INFO ] [MAIN ] SRFM: Generated 1794 derivative records from 36247 primary records. [2025-09-29T22:15:53.176802] [DEBUG] [LOCAL ] SRFM: Saving derivative data. [2025-09-29T22:15:53.237690] [DEBUG] [LOCAL ] SRG: Derivative data saved (1794 records). [2025-09-29T22:15:53.238882] [INFO ] [MAIN ] SRG: Successfully saved derivative data. [2025-09-29T22:15:53.238984] [DEBUG] [LOCAL ] SRFM: Derivative data saved (1794 records). [2025-09-29T22:15:53.238669] [DEBUG] [MAIN ] SRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:53.242719] [INFO ] [MAIN ] SRFM: Successfully saved derivative data. [2025-09-29T22:15:53.242593] [INFO ] [MAIN ] Derivative Progress: 1705/2057 symbols completed. SRG took 1.3s. Estimated remaining: 2m 23s. Rate: 147.6 symbols/min [2025-09-29T22:15:53.246639] [INFO ] [MAIN ] Derivative Progress: 1706/2057 symbols completed. SRFM took 1.3s. Estimated remaining: 2m 23s. Rate: 147.7 symbols/min [2025-09-29T22:15:53.243771] [INFO ] [MAIN ] SRI: Generated 1794 derivative records from 27306 primary records. [2025-09-29T22:15:53.244134] [INFO ] [MAIN ] SRV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:53.247351] [DEBUG] [LOCAL ] SRI: Saving derivative data. [2025-09-29T22:15:53.246964] [INFO ] [MAIN ] SSB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:53.266004] [DEBUG] [LOCAL ] SRI: Derivative data saved (1794 records). [2025-09-29T22:15:53.268924] [INFO ] [MAIN ] SRI: Successfully saved derivative data. [2025-09-29T22:15:53.271187] [INFO ] [MAIN ] Derivative Progress: 1707/2057 symbols completed. SRI took 1.2s. Estimated remaining: 2m 22s. Rate: 147.8 symbols/min [2025-09-29T22:15:53.271500] [INFO ] [MAIN ] SSD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:53.278499] [DEBUG] [LOCAL ] SRV: Loaded 7429 existing records from primary storage. [2025-09-29T22:15:53.278957] [INFO ] [MAIN ] SRV: Loaded 7429 primary data records. [2025-09-29T22:15:53.433604] [DEBUG] [LOCAL ] SSD: Loaded 22375 existing records from primary storage. [2025-09-29T22:15:53.445074] [INFO ] [MAIN ] SSD: Loaded 22375 primary data records. [2025-09-29T22:15:53.587714] [DEBUG] [LOCAL ] SSB: Loaded 42740 existing records from primary storage. [2025-09-29T22:15:53.600687] [INFO ] [MAIN ] SSB: Loaded 42740 primary data records. [2025-09-29T22:15:54.466525] [DEBUG] [MAIN ] SRV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:54.468845] [INFO ] [MAIN ] SRV: Generated 1794 derivative records from 7429 primary records. [2025-09-29T22:15:54.469582] [DEBUG] [LOCAL ] SRV: Saving derivative data. [2025-09-29T22:15:54.506272] [DEBUG] [MAIN ] SSD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:54.506754] [DEBUG] [LOCAL ] SRV: Derivative data saved (1794 records). [2025-09-29T22:15:54.508322] [INFO ] [MAIN ] SSD: Generated 1794 derivative records from 22375 primary records. [2025-09-29T22:15:54.508597] [DEBUG] [LOCAL ] SSD: Saving derivative data. [2025-09-29T22:15:54.507303] [INFO ] [MAIN ] SRV: Successfully saved derivative data. [2025-09-29T22:15:54.512508] [INFO ] [MAIN ] Derivative Progress: 1708/2057 symbols completed. SRV took 1.3s. Estimated remaining: 2m 22s. Rate: 147.6 symbols/min [2025-09-29T22:15:54.534483] [DEBUG] [LOCAL ] SSD: Derivative data saved (1794 records). [2025-09-29T22:15:54.547639] [INFO ] [MAIN ] SSD: Successfully saved derivative data. [2025-09-29T22:15:54.550219] [INFO ] [MAIN ] Derivative Progress: 1709/2057 symbols completed. SSD took 1.3s. Estimated remaining: 2m 21s. Rate: 147.7 symbols/min [2025-09-29T22:15:54.548026] [DEBUG] [MAIN ] SSB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:54.551224] [INFO ] [MAIN ] SSB: Generated 1794 derivative records from 42740 primary records. [2025-09-29T22:15:54.551307] [DEBUG] [LOCAL ] SSB: Saving derivative data. [2025-09-29T22:15:54.567928] [DEBUG] [LOCAL ] SSB: Derivative data saved (1794 records). [2025-09-29T22:15:54.567999] [INFO ] [MAIN ] SSB: Successfully saved derivative data. [2025-09-29T22:15:54.570244] [INFO ] [MAIN ] Derivative Progress: 1710/2057 symbols completed. SSB took 1.3s. Estimated remaining: 2m 21s. Rate: 147.8 symbols/min [2025-09-29T22:15:54.570910] [INFO ] [MAIN ] SSL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:54.571031] [INFO ] [MAIN ] SSTK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:54.571203] [INFO ] [MAIN ] SST: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:54.586744] [DEBUG] [LOCAL ] SST: Loaded 11966 existing records from primary storage. [2025-09-29T22:15:54.586965] [INFO ] [MAIN ] SST: Loaded 11966 primary data records. [2025-09-29T22:15:54.784400] [DEBUG] [LOCAL ] SSTK: Loaded 26016 existing records from primary storage. [2025-09-29T22:15:54.793896] [INFO ] [MAIN ] SSTK: Loaded 26016 primary data records. [2025-09-29T22:15:54.821484] [DEBUG] [LOCAL ] SSL: Loaded 41163 existing records from primary storage. [2025-09-29T22:15:54.830113] [INFO ] [MAIN ] SSL: Loaded 41163 primary data records. [2025-09-29T22:15:55.751175] [DEBUG] [MAIN ] SST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:55.752671] [INFO ] [MAIN ] SST: Generated 1794 derivative records from 11966 primary records. [2025-09-29T22:15:55.753461] [DEBUG] [LOCAL ] SST: Saving derivative data. [2025-09-29T22:15:55.772861] [DEBUG] [LOCAL ] SST: Derivative data saved (1794 records). [2025-09-29T22:15:55.773436] [INFO ] [MAIN ] SST: Successfully saved derivative data. [2025-09-29T22:15:55.775901] [INFO ] [MAIN ] Derivative Progress: 1711/2057 symbols completed. SST took 1.2s. Estimated remaining: 2m 21s. Rate: 147.6 symbols/min [2025-09-29T22:15:55.776743] [INFO ] [MAIN ] ST: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:55.807499] [DEBUG] [MAIN ] SSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:55.814212] [INFO ] [MAIN ] SSL: Generated 1794 derivative records from 41163 primary records. [2025-09-29T22:15:55.813345] [DEBUG] [MAIN ] SSTK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:55.814321] [DEBUG] [LOCAL ] SSL: Saving derivative data. [2025-09-29T22:15:55.815405] [INFO ] [MAIN ] SSTK: Generated 1794 derivative records from 26016 primary records. [2025-09-29T22:15:55.816353] [DEBUG] [LOCAL ] SSTK: Saving derivative data. [2025-09-29T22:15:55.848333] [DEBUG] [LOCAL ] SSTK: Derivative data saved (1794 records). [2025-09-29T22:15:55.849040] [INFO ] [MAIN ] SSTK: Successfully saved derivative data. [2025-09-29T22:15:55.851252] [INFO ] [MAIN ] Derivative Progress: 1712/2057 symbols completed. SSTK took 1.3s. Estimated remaining: 2m 20s. Rate: 147.7 symbols/min [2025-09-29T22:15:55.851713] [INFO ] [MAIN ] STAG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:55.852509] [DEBUG] [LOCAL ] SSL: Derivative data saved (1794 records). [2025-09-29T22:15:55.852625] [INFO ] [MAIN ] SSL: Successfully saved derivative data. [2025-09-29T22:15:55.855207] [INFO ] [MAIN ] Derivative Progress: 1713/2057 symbols completed. SSL took 1.3s. Estimated remaining: 2m 20s. Rate: 147.8 symbols/min [2025-09-29T22:15:55.855865] [INFO ] [MAIN ] STC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:55.943480] [DEBUG] [LOCAL ] STC: Loaded 17536 existing records from primary storage. [2025-09-29T22:15:55.944704] [DEBUG] [LOCAL ] ST: Loaded 49729 existing records from primary storage. [2025-09-29T22:15:55.944949] [INFO ] [MAIN ] ST: Loaded 49729 primary data records. [2025-09-29T22:15:55.945043] [INFO ] [MAIN ] STC: Loaded 17536 primary data records. [2025-09-29T22:15:56.263838] [DEBUG] [LOCAL ] STAG: Loaded 50034 existing records from primary storage. [2025-09-29T22:15:56.342037] [INFO ] [MAIN ] STAG: Loaded 50034 primary data records. [2025-09-29T22:15:57.045917] [DEBUG] [MAIN ] ST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:57.048961] [INFO ] [MAIN ] ST: Generated 1794 derivative records from 49729 primary records. [2025-09-29T22:15:57.050234] [DEBUG] [LOCAL ] ST: Saving derivative data. [2025-09-29T22:15:57.086718] [DEBUG] [MAIN ] STC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:57.089761] [INFO ] [MAIN ] STC: Generated 1794 derivative records from 17536 primary records. [2025-09-29T22:15:57.088875] [DEBUG] [LOCAL ] ST: Derivative data saved (1794 records). [2025-09-29T22:15:57.089990] [DEBUG] [LOCAL ] STC: Saving derivative data. [2025-09-29T22:15:57.091399] [INFO ] [MAIN ] ST: Successfully saved derivative data. [2025-09-29T22:15:57.095764] [INFO ] [MAIN ] Derivative Progress: 1714/2057 symbols completed. ST took 1.3s. Estimated remaining: 2m 19s. Rate: 147.6 symbols/min [2025-09-29T22:15:57.105969] [INFO ] [MAIN ] STE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:57.125704] [DEBUG] [MAIN ] STAG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:57.128915] [DEBUG] [LOCAL ] STC: Derivative data saved (1794 records). [2025-09-29T22:15:57.130058] [INFO ] [MAIN ] STAG: Generated 1794 derivative records from 50034 primary records. [2025-09-29T22:15:57.129230] [INFO ] [MAIN ] STC: Successfully saved derivative data. [2025-09-29T22:15:57.132573] [INFO ] [MAIN ] Derivative Progress: 1715/2057 symbols completed. STC took 1.3s. Estimated remaining: 2m 19s. Rate: 147.7 symbols/min [2025-09-29T22:15:57.130230] [DEBUG] [LOCAL ] STAG: Saving derivative data. [2025-09-29T22:15:57.133312] [INFO ] [MAIN ] STEL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:57.153305] [DEBUG] [LOCAL ] STAG: Derivative data saved (1794 records). [2025-09-29T22:15:57.153493] [INFO ] [MAIN ] STAG: Successfully saved derivative data. [2025-09-29T22:15:57.163598] [INFO ] [MAIN ] Derivative Progress: 1716/2057 symbols completed. STAG took 1.3s. Estimated remaining: 2m 18s. Rate: 147.8 symbols/min [2025-09-29T22:15:57.163893] [INFO ] [MAIN ] STEM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:57.184008] [DEBUG] [LOCAL ] STEL: Loaded 23292 existing records from primary storage. [2025-09-29T22:15:57.184311] [INFO ] [MAIN ] STEL: Loaded 23292 primary data records. [2025-09-29T22:15:57.307333] [DEBUG] [LOCAL ] STE: Loaded 35218 existing records from primary storage. [2025-09-29T22:15:57.321160] [INFO ] [MAIN ] STE: Loaded 35218 primary data records. [2025-09-29T22:15:57.646995] [DEBUG] [LOCAL ] STEM: Loaded 39510 existing records from primary storage. [2025-09-29T22:15:57.656905] [INFO ] [MAIN ] STEM: Loaded 39510 primary data records. [2025-09-29T22:15:58.223181] [DEBUG] [MAIN ] STEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:58.224942] [INFO ] [MAIN ] STEL: Generated 1794 derivative records from 23292 primary records. [2025-09-29T22:15:58.225044] [DEBUG] [LOCAL ] STEL: Saving derivative data. [2025-09-29T22:15:58.246823] [DEBUG] [LOCAL ] STEL: Derivative data saved (1794 records). [2025-09-29T22:15:58.261593] [DEBUG] [MAIN ] STE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:58.261090] [INFO ] [MAIN ] STEL: Successfully saved derivative data. [2025-09-29T22:15:58.264032] [INFO ] [MAIN ] Derivative Progress: 1717/2057 symbols completed. STEL took 1.1s. Estimated remaining: 2m 18s. Rate: 147.6 symbols/min [2025-09-29T22:15:58.265196] [INFO ] [MAIN ] STE: Generated 1794 derivative records from 35218 primary records. [2025-09-29T22:15:58.265912] [DEBUG] [LOCAL ] STE: Saving derivative data. [2025-09-29T22:15:58.265835] [INFO ] [MAIN ] STK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:58.291944] [DEBUG] [LOCAL ] STE: Derivative data saved (1794 records). [2025-09-29T22:15:58.304139] [INFO ] [MAIN ] STE: Successfully saved derivative data. [2025-09-29T22:15:58.315246] [DEBUG] [LOCAL ] STK: Loaded 9304 existing records from primary storage. [2025-09-29T22:15:58.315493] [INFO ] [MAIN ] STK: Loaded 9304 primary data records. [2025-09-29T22:15:58.319516] [INFO ] [MAIN ] Derivative Progress: 1718/2057 symbols completed. STE took 1.2s. Estimated remaining: 2m 18s. Rate: 147.7 symbols/min [2025-09-29T22:15:58.320705] [INFO ] [MAIN ] STLA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:58.321263] [DEBUG] [MAIN ] STEM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:58.363270] [INFO ] [MAIN ] STEM: Generated 1794 derivative records from 39510 primary records. [2025-09-29T22:15:58.402795] [DEBUG] [LOCAL ] STEM: Saving derivative data. [2025-09-29T22:15:58.734328] [DEBUG] [LOCAL ] STEM: Derivative data saved (1794 records). [2025-09-29T22:15:58.734517] [INFO ] [MAIN ] STEM: Successfully saved derivative data. [2025-09-29T22:15:58.736614] [INFO ] [MAIN ] Derivative Progress: 1719/2057 symbols completed. STEM took 1.6s. Estimated remaining: 2m 17s. Rate: 147.7 symbols/min [2025-09-29T22:15:58.737983] [INFO ] [MAIN ] STM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:58.770083] [DEBUG] [LOCAL ] STLA: Loaded 53542 existing records from primary storage. [2025-09-29T22:15:58.770927] [INFO ] [MAIN ] STLA: Loaded 53542 primary data records. [2025-09-29T22:15:59.172557] [DEBUG] [MAIN ] STK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:59.172172] [DEBUG] [LOCAL ] STM: Loaded 53582 existing records from primary storage. [2025-09-29T22:15:59.173463] [INFO ] [MAIN ] STM: Loaded 53582 primary data records. [2025-09-29T22:15:59.173389] [INFO ] [MAIN ] STK: Generated 1794 derivative records from 9304 primary records. [2025-09-29T22:15:59.173721] [DEBUG] [LOCAL ] STK: Saving derivative data. [2025-09-29T22:15:59.303218] [DEBUG] [LOCAL ] STK: Derivative data saved (1794 records). [2025-09-29T22:15:59.313835] [INFO ] [MAIN ] STK: Successfully saved derivative data. [2025-09-29T22:15:59.321622] [INFO ] [MAIN ] Derivative Progress: 1720/2057 symbols completed. STK took 1.1s. Estimated remaining: 2m 17s. Rate: 147.6 symbols/min [2025-09-29T22:15:59.352320] [INFO ] [MAIN ] STN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:59.539355] [DEBUG] [MAIN ] STLA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:59.548609] [DEBUG] [LOCAL ] STN: Loaded 22940 existing records from primary storage. [2025-09-29T22:15:59.540479] [INFO ] [MAIN ] STLA: Generated 1794 derivative records from 53542 primary records. [2025-09-29T22:15:59.548927] [DEBUG] [LOCAL ] STLA: Saving derivative data. [2025-09-29T22:15:59.549911] [INFO ] [MAIN ] STN: Loaded 22940 primary data records. [2025-09-29T22:15:59.641120] [DEBUG] [LOCAL ] STLA: Derivative data saved (1794 records). [2025-09-29T22:15:59.659733] [INFO ] [MAIN ] STLA: Successfully saved derivative data. [2025-09-29T22:15:59.667406] [INFO ] [MAIN ] Derivative Progress: 1721/2057 symbols completed. STLA took 1.3s. Estimated remaining: 2m 17s. Rate: 147.7 symbols/min [2025-09-29T22:15:59.687945] [INFO ] [MAIN ] STNG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:59.896224] [DEBUG] [MAIN ] STM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:15:59.915632] [INFO ] [MAIN ] STM: Generated 1794 derivative records from 53582 primary records. [2025-09-29T22:15:59.915903] [DEBUG] [LOCAL ] STM: Saving derivative data. [2025-09-29T22:15:59.950162] [DEBUG] [LOCAL ] STM: Derivative data saved (1794 records). [2025-09-29T22:15:59.951423] [INFO ] [MAIN ] STM: Successfully saved derivative data. [2025-09-29T22:15:59.953808] [INFO ] [MAIN ] Derivative Progress: 1722/2057 symbols completed. STM took 1.2s. Estimated remaining: 2m 16s. Rate: 147.7 symbols/min [2025-09-29T22:15:59.954254] [INFO ] [MAIN ] STRV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:15:59.970083] [DEBUG] [LOCAL ] STNG: Loaded 43903 existing records from primary storage. [2025-09-29T22:15:59.970329] [INFO ] [MAIN ] STNG: Loaded 43903 primary data records. [2025-09-29T22:16:00.069775] [DEBUG] [LOCAL ] STRV: Loaded 11439 existing records from primary storage. [2025-09-29T22:16:00.090058] [INFO ] [MAIN ] STRV: Loaded 11439 primary data records. [2025-09-29T22:16:00.488292] [DEBUG] [MAIN ] STN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:00.547667] [INFO ] [MAIN ] STN: Generated 1794 derivative records from 22940 primary records. [2025-09-29T22:16:00.715398] [DEBUG] [LOCAL ] STN: Saving derivative data. [2025-09-29T22:16:00.751836] [DEBUG] [LOCAL ] STN: Derivative data saved (1794 records). [2025-09-29T22:16:00.753880] [INFO ] [MAIN ] STN: Successfully saved derivative data. [2025-09-29T22:16:00.756735] [INFO ] [MAIN ] Derivative Progress: 1723/2057 symbols completed. STN took 1.4s. Estimated remaining: 2m 16s. Rate: 147.6 symbols/min [2025-09-29T22:16:00.777850] [DEBUG] [MAIN ] STNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:00.778831] [INFO ] [MAIN ] STNG: Generated 1794 derivative records from 43903 primary records. [2025-09-29T22:16:00.778992] [DEBUG] [LOCAL ] STNG: Saving derivative data. [2025-09-29T22:16:00.808138] [DEBUG] [MAIN ] STRV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:16:00.811467] [INFO ] [MAIN ] STRV: Generated 1793 derivative records from 11439 primary records. [2025-09-29T22:16:00.810776] [DEBUG] [LOCAL ] STNG: Derivative data saved (1794 records). [2025-09-29T22:16:00.811572] [INFO ] [MAIN ] STNG: Successfully saved derivative data. [2025-09-29T22:16:00.811684] [DEBUG] [LOCAL ] STRV: Saving derivative data. [2025-09-29T22:16:00.813797] [INFO ] [MAIN ] Derivative Progress: 1724/2057 symbols completed. STNG took 1.1s. Estimated remaining: 2m 15s. Rate: 147.7 symbols/min [2025-09-29T22:16:00.829944] [DEBUG] [LOCAL ] STRV: Derivative data saved (1793 records). [2025-09-29T22:16:00.830034] [INFO ] [MAIN ] STRV: Successfully saved derivative data. [2025-09-29T22:16:00.832219] [INFO ] [MAIN ] Derivative Progress: 1725/2057 symbols completed. STRV took 0.9s. Estimated remaining: 2m 15s. Rate: 147.8 symbols/min [2025-09-29T22:16:00.832914] [INFO ] [MAIN ] STWD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:00.833067] [INFO ] [MAIN ] STXD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:00.832855] [INFO ] [MAIN ] STVN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:00.838076] [DEBUG] [LOCAL ] STXD: Loaded 1289 existing records from primary storage. [2025-09-29T22:16:00.838395] [INFO ] [MAIN ] STXD: Loaded 1289 primary data records. [2025-09-29T22:16:01.061435] [DEBUG] [LOCAL ] STVN: Loaded 26204 existing records from primary storage. [2025-09-29T22:16:01.061630] [INFO ] [MAIN ] STVN: Loaded 26204 primary data records. [2025-09-29T22:16:01.408474] [DEBUG] [LOCAL ] STWD: Loaded 51877 existing records from primary storage. [2025-09-29T22:16:01.409195] [INFO ] [MAIN ] STWD: Loaded 51877 primary data records. [2025-09-29T22:16:01.954431] [DEBUG] [MAIN ] STXD: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-09-29T22:16:01.956035] [INFO ] [MAIN ] STXD: Generated 1792 derivative records from 1289 primary records. [2025-09-29T22:16:01.956768] [DEBUG] [LOCAL ] STXD: Saving derivative data. [2025-09-29T22:16:01.978083] [DEBUG] [LOCAL ] STXD: Derivative data saved (1792 records). [2025-09-29T22:16:01.978483] [INFO ] [MAIN ] STXD: Successfully saved derivative data. [2025-09-29T22:16:01.981062] [INFO ] [MAIN ] Derivative Progress: 1726/2057 symbols completed. STXD took 1.1s. Estimated remaining: 2m 15s. Rate: 147.6 symbols/min [2025-09-29T22:16:01.996022] [DEBUG] [MAIN ] STVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:01.996286] [INFO ] [MAIN ] STXE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:01.997247] [INFO ] [MAIN ] STVN: Generated 1794 derivative records from 26204 primary records. [2025-09-29T22:16:01.997761] [DEBUG] [LOCAL ] STVN: Saving derivative data. [2025-09-29T22:16:02.016409] [DEBUG] [LOCAL ] STXE: Loaded 2172 existing records from primary storage. [2025-09-29T22:16:02.017684] [INFO ] [MAIN ] STXE: Loaded 2172 primary data records. [2025-09-29T22:16:02.067532] [DEBUG] [LOCAL ] STVN: Derivative data saved (1794 records). [2025-09-29T22:16:02.096335] [INFO ] [MAIN ] STVN: Successfully saved derivative data. [2025-09-29T22:16:02.144421] [DEBUG] [MAIN ] STWD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:02.150482] [INFO ] [MAIN ] Derivative Progress: 1727/2057 symbols completed. STVN took 1.3s. Estimated remaining: 2m 14s. Rate: 147.6 symbols/min [2025-09-29T22:16:02.150843] [INFO ] [MAIN ] STXG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:02.151758] [INFO ] [MAIN ] STWD: Generated 1794 derivative records from 51877 primary records. [2025-09-29T22:16:02.151970] [DEBUG] [LOCAL ] STWD: Saving derivative data. [2025-09-29T22:16:02.372200] [DEBUG] [LOCAL ] STXG: Loaded 2515 existing records from primary storage. [2025-09-29T22:16:02.382548] [INFO ] [MAIN ] STXG: Loaded 2515 primary data records. [2025-09-29T22:16:02.464900] [DEBUG] [LOCAL ] STWD: Derivative data saved (1794 records). [2025-09-29T22:16:02.478777] [INFO ] [MAIN ] STWD: Successfully saved derivative data. [2025-09-29T22:16:02.493792] [INFO ] [MAIN ] Derivative Progress: 1728/2057 symbols completed. STWD took 1.7s. Estimated remaining: 2m 14s. Rate: 147.7 symbols/min [2025-09-29T22:16:02.506697] [INFO ] [MAIN ] STXK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:02.718124] [DEBUG] [LOCAL ] STXK: Loaded 1495 existing records from primary storage. [2025-09-29T22:16:02.719280] [INFO ] [MAIN ] STXK: Loaded 1495 primary data records. [2025-09-29T22:16:02.951506] [DEBUG] [MAIN ] STXE: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:16:03.119500] [INFO ] [MAIN ] STXE: Generated 1793 derivative records from 2172 primary records. [2025-09-29T22:16:03.128621] [DEBUG] [LOCAL ] STXE: Saving derivative data. [2025-09-29T22:16:03.151620] [DEBUG] [LOCAL ] STXE: Derivative data saved (1793 records). [2025-09-29T22:16:03.165227] [INFO ] [MAIN ] STXE: Successfully saved derivative data. [2025-09-29T22:16:03.168376] [INFO ] [MAIN ] Derivative Progress: 1729/2057 symbols completed. STXE took 1.2s. Estimated remaining: 2m 13s. Rate: 147.6 symbols/min [2025-09-29T22:16:03.169938] [INFO ] [MAIN ] STXT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:03.169690] [DEBUG] [MAIN ] STXG: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:16:03.171915] [INFO ] [MAIN ] STXG: Generated 1793 derivative records from 2515 primary records. [2025-09-29T22:16:03.172273] [DEBUG] [LOCAL ] STXG: Saving derivative data. [2025-09-29T22:16:03.189273] [DEBUG] [LOCAL ] STXT: Loaded 2526 existing records from primary storage. [2025-09-29T22:16:03.191239] [INFO ] [MAIN ] STXT: Loaded 2526 primary data records. [2025-09-29T22:16:03.213678] [DEBUG] [LOCAL ] STXG: Derivative data saved (1793 records). [2025-09-29T22:16:03.213783] [INFO ] [MAIN ] STXG: Successfully saved derivative data. [2025-09-29T22:16:03.216189] [INFO ] [MAIN ] Derivative Progress: 1730/2057 symbols completed. STXG took 1.1s. Estimated remaining: 2m 13s. Rate: 147.7 symbols/min [2025-09-29T22:16:03.216353] [INFO ] [MAIN ] STXV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:03.344885] [DEBUG] [LOCAL ] STXV: Loaded 1590 existing records from primary storage. [2025-09-29T22:16:03.361152] [DEBUG] [MAIN ] STXK: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:16:03.367362] [INFO ] [MAIN ] STXK: Generated 1793 derivative records from 1495 primary records. [2025-09-29T22:16:03.361239] [INFO ] [MAIN ] STXV: Loaded 1590 primary data records. [2025-09-29T22:16:03.383822] [DEBUG] [LOCAL ] STXK: Saving derivative data. [2025-09-29T22:16:03.717238] [DEBUG] [LOCAL ] STXK: Derivative data saved (1793 records). [2025-09-29T22:16:03.728410] [INFO ] [MAIN ] STXK: Successfully saved derivative data. [2025-09-29T22:16:03.731030] [INFO ] [MAIN ] Derivative Progress: 1731/2057 symbols completed. STXK took 1.2s. Estimated remaining: 2m 12s. Rate: 147.7 symbols/min [2025-09-29T22:16:03.746758] [INFO ] [MAIN ] STZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:03.947599] [DEBUG] [MAIN ] STXT: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:16:03.963465] [INFO ] [MAIN ] STXT: Generated 1793 derivative records from 2526 primary records. [2025-09-29T22:16:03.963742] [DEBUG] [LOCAL ] STXT: Saving derivative data. [2025-09-29T22:16:03.980406] [DEBUG] [LOCAL ] STXT: Derivative data saved (1793 records). [2025-09-29T22:16:03.994503] [INFO ] [MAIN ] STXT: Successfully saved derivative data. [2025-09-29T22:16:03.996822] [INFO ] [MAIN ] Derivative Progress: 1732/2057 symbols completed. STXT took 0.8s. Estimated remaining: 2m 12s. Rate: 147.7 symbols/min [2025-09-29T22:16:03.998319] [INFO ] [MAIN ] SU: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:03.999926] [DEBUG] [LOCAL ] STZ: Loaded 52277 existing records from primary storage. [2025-09-29T22:16:04.001778] [INFO ] [MAIN ] STZ: Loaded 52277 primary data records. [2025-09-29T22:16:04.115624] [DEBUG] [MAIN ] STXV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:16:04.129512] [INFO ] [MAIN ] STXV: Generated 1793 derivative records from 1590 primary records. [2025-09-29T22:16:04.129793] [DEBUG] [LOCAL ] STXV: Saving derivative data. [2025-09-29T22:16:04.371923] [DEBUG] [LOCAL ] STXV: Derivative data saved (1793 records). [2025-09-29T22:16:04.382111] [INFO ] [MAIN ] STXV: Successfully saved derivative data. [2025-09-29T22:16:04.402287] [INFO ] [MAIN ] Derivative Progress: 1733/2057 symbols completed. STXV took 1.2s. Estimated remaining: 2m 12s. Rate: 147.7 symbols/min [2025-09-29T22:16:04.402819] [INFO ] [MAIN ] SUI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:04.405493] [DEBUG] [LOCAL ] SU: Loaded 53451 existing records from primary storage. [2025-09-29T22:16:04.405826] [INFO ] [MAIN ] SU: Loaded 53451 primary data records. [2025-09-29T22:16:04.773982] [DEBUG] [LOCAL ] SUI: Loaded 41785 existing records from primary storage. [2025-09-29T22:16:04.776452] [INFO ] [MAIN ] SUI: Loaded 41785 primary data records. [2025-09-29T22:16:04.901903] [DEBUG] [MAIN ] STZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:04.921226] [INFO ] [MAIN ] STZ: Generated 1794 derivative records from 52277 primary records. [2025-09-29T22:16:04.921675] [DEBUG] [LOCAL ] STZ: Saving derivative data. [2025-09-29T22:16:05.212600] [DEBUG] [LOCAL ] STZ: Derivative data saved (1794 records). [2025-09-29T22:16:05.212821] [DEBUG] [MAIN ] SU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:05.213631] [INFO ] [MAIN ] SU: Generated 1794 derivative records from 53451 primary records. [2025-09-29T22:16:05.213846] [DEBUG] [LOCAL ] SU: Saving derivative data. [2025-09-29T22:16:05.213787] [INFO ] [MAIN ] STZ: Successfully saved derivative data. [2025-09-29T22:16:05.217589] [INFO ] [MAIN ] Derivative Progress: 1734/2057 symbols completed. STZ took 1.5s. Estimated remaining: 2m 11s. Rate: 147.6 symbols/min [2025-09-29T22:16:05.225362] [INFO ] [MAIN ] SUN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:05.241109] [DEBUG] [LOCAL ] SU: Derivative data saved (1794 records). [2025-09-29T22:16:05.241427] [INFO ] [MAIN ] SU: Successfully saved derivative data. [2025-09-29T22:16:05.243693] [INFO ] [MAIN ] Derivative Progress: 1735/2057 symbols completed. SU took 1.2s. Estimated remaining: 2m 11s. Rate: 147.7 symbols/min [2025-09-29T22:16:05.244070] [INFO ] [MAIN ] SUPV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:05.277390] [DEBUG] [MAIN ] SUI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:05.288098] [INFO ] [MAIN ] SUI: Generated 1794 derivative records from 41785 primary records. [2025-09-29T22:16:05.290138] [DEBUG] [LOCAL ] SUI: Saving derivative data. [2025-09-29T22:16:05.292420] [DEBUG] [LOCAL ] SUN: Loaded 37437 existing records from primary storage. [2025-09-29T22:16:05.300631] [INFO ] [MAIN ] SUN: Loaded 37437 primary data records. [2025-09-29T22:16:05.450110] [DEBUG] [LOCAL ] SUI: Derivative data saved (1794 records). [2025-09-29T22:16:05.452605] [INFO ] [MAIN ] SUI: Successfully saved derivative data. [2025-09-29T22:16:05.455079] [INFO ] [MAIN ] Derivative Progress: 1736/2057 symbols completed. SUI took 1.1s. Estimated remaining: 2m 10s. Rate: 147.7 symbols/min [2025-09-29T22:16:05.455382] [INFO ] [MAIN ] SUZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:05.468729] [DEBUG] [LOCAL ] SUPV: Loaded 47228 existing records from primary storage. [2025-09-29T22:16:05.509726] [INFO ] [MAIN ] SUPV: Loaded 47228 primary data records. [2025-09-29T22:16:06.049929] [DEBUG] [LOCAL ] SUZ: Loaded 45751 existing records from primary storage. [2025-09-29T22:16:06.050357] [INFO ] [MAIN ] SUZ: Loaded 45751 primary data records. [2025-09-29T22:16:06.278180] [DEBUG] [MAIN ] SUN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:06.286263] [INFO ] [MAIN ] SUN: Generated 1794 derivative records from 37437 primary records. [2025-09-29T22:16:06.414783] [DEBUG] [LOCAL ] SUN: Saving derivative data. [2025-09-29T22:16:06.435878] [DEBUG] [LOCAL ] SUN: Derivative data saved (1794 records). [2025-09-29T22:16:06.436540] [INFO ] [MAIN ] SUN: Successfully saved derivative data. [2025-09-29T22:16:06.438847] [INFO ] [MAIN ] Derivative Progress: 1737/2057 symbols completed. SUN took 1.2s. Estimated remaining: 2m 10s. Rate: 147.6 symbols/min [2025-09-29T22:16:06.440445] [INFO ] [MAIN ] SVV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:06.462799] [DEBUG] [MAIN ] SUPV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:06.463947] [INFO ] [MAIN ] SUPV: Generated 1794 derivative records from 47228 primary records. [2025-09-29T22:16:06.464384] [DEBUG] [LOCAL ] SUPV: Saving derivative data. [2025-09-29T22:16:06.490986] [DEBUG] [LOCAL ] SUPV: Derivative data saved (1794 records). [2025-09-29T22:16:06.492665] [INFO ] [MAIN ] SUPV: Successfully saved derivative data. [2025-09-29T22:16:06.504778] [INFO ] [MAIN ] Derivative Progress: 1738/2057 symbols completed. SUPV took 1.3s. Estimated remaining: 2m 10s. Rate: 147.7 symbols/min [2025-09-29T22:16:06.518990] [DEBUG] [MAIN ] SUZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:06.519720] [INFO ] [MAIN ] SUZ: Generated 1794 derivative records from 45751 primary records. [2025-09-29T22:16:06.519792] [DEBUG] [LOCAL ] SUZ: Saving derivative data. [2025-09-29T22:16:06.547269] [DEBUG] [LOCAL ] SVV: Loaded 39617 existing records from primary storage. [2025-09-29T22:16:06.547891] [INFO ] [MAIN ] SVV: Loaded 39617 primary data records. [2025-09-29T22:16:06.606299] [DEBUG] [LOCAL ] SUZ: Derivative data saved (1794 records). [2025-09-29T22:16:06.620958] [INFO ] [MAIN ] SUZ: Successfully saved derivative data. [2025-09-29T22:16:06.634099] [INFO ] [MAIN ] Derivative Progress: 1739/2057 symbols completed. SUZ took 1.2s. Estimated remaining: 2m 9s. Rate: 147.7 symbols/min [2025-09-29T22:16:06.876327] [DEBUG] [MAIN ] SVV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:06.877003] [INFO ] [MAIN ] SVV: Generated 1794 derivative records from 39617 primary records. [2025-09-29T22:16:06.877095] [DEBUG] [LOCAL ] SVV: Saving derivative data. [2025-09-29T22:16:06.892238] [DEBUG] [LOCAL ] SVV: Derivative data saved (1794 records). [2025-09-29T22:16:06.892313] [INFO ] [MAIN ] SVV: Successfully saved derivative data. [2025-09-29T22:16:06.894533] [INFO ] [MAIN ] Derivative Progress: 1740/2057 symbols completed. SVV took 0.5s. Estimated remaining: 2m 9s. Rate: 147.8 symbols/min [2025-09-29T22:16:06.895174] [INFO ] [MAIN ] SWX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:06.895108] [INFO ] [MAIN ] SWK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:06.894998] [INFO ] [MAIN ] SW: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:06.928221] [DEBUG] [LOCAL ] SWX: Loaded 31090 existing records from primary storage. [2025-09-29T22:16:06.928506] [INFO ] [MAIN ] SWX: Loaded 31090 primary data records. [2025-09-29T22:16:07.176213] [DEBUG] [LOCAL ] SW: Loaded 53160 existing records from primary storage. [2025-09-29T22:16:07.204235] [INFO ] [MAIN ] SW: Loaded 53160 primary data records. [2025-09-29T22:16:07.351035] [DEBUG] [LOCAL ] SWK: Loaded 52392 existing records from primary storage. [2025-09-29T22:16:07.366819] [INFO ] [MAIN ] SWK: Loaded 52392 primary data records. [2025-09-29T22:16:08.095416] [DEBUG] [MAIN ] SWX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:08.098145] [INFO ] [MAIN ] SWX: Generated 1794 derivative records from 31090 primary records. [2025-09-29T22:16:08.098625] [DEBUG] [LOCAL ] SWX: Saving derivative data. [2025-09-29T22:16:08.119069] [DEBUG] [LOCAL ] SWX: Derivative data saved (1794 records). [2025-09-29T22:16:08.119769] [INFO ] [MAIN ] SWX: Successfully saved derivative data. [2025-09-29T22:16:08.122122] [INFO ] [MAIN ] Derivative Progress: 1741/2057 symbols completed. SWX took 1.2s. Estimated remaining: 2m 8s. Rate: 147.6 symbols/min [2025-09-29T22:16:08.122908] [INFO ] [MAIN ] SWZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:08.147963] [DEBUG] [LOCAL ] SWZ: Loaded 6005 existing records from primary storage. [2025-09-29T22:16:08.148611] [DEBUG] [MAIN ] SW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:08.148735] [INFO ] [MAIN ] SWZ: Loaded 6005 primary data records. [2025-09-29T22:16:08.149436] [INFO ] [MAIN ] SW: Generated 1794 derivative records from 53160 primary records. [2025-09-29T22:16:08.155374] [DEBUG] [LOCAL ] SW: Saving derivative data. [2025-09-29T22:16:08.268188] [DEBUG] [MAIN ] SWK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:08.284450] [INFO ] [MAIN ] SWK: Generated 1794 derivative records from 52392 primary records. [2025-09-29T22:16:08.290358] [DEBUG] [LOCAL ] SWK: Saving derivative data. [2025-09-29T22:16:08.394986] [DEBUG] [LOCAL ] SW: Derivative data saved (1794 records). [2025-09-29T22:16:08.395512] [INFO ] [MAIN ] SW: Successfully saved derivative data. [2025-09-29T22:16:08.397941] [INFO ] [MAIN ] Derivative Progress: 1742/2057 symbols completed. SW took 1.5s. Estimated remaining: 2m 8s. Rate: 147.6 symbols/min [2025-09-29T22:16:08.523542] [INFO ] [MAIN ] SXC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:08.529549] [DEBUG] [LOCAL ] SWK: Derivative data saved (1794 records). [2025-09-29T22:16:08.529839] [INFO ] [MAIN ] SWK: Successfully saved derivative data. [2025-09-29T22:16:08.532231] [INFO ] [MAIN ] Derivative Progress: 1743/2057 symbols completed. SWK took 1.6s. Estimated remaining: 2m 8s. Rate: 147.7 symbols/min [2025-09-29T22:16:08.532491] [INFO ] [MAIN ] SXI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:08.548428] [DEBUG] [LOCAL ] SXI: Loaded 11510 existing records from primary storage. [2025-09-29T22:16:08.548887] [INFO ] [MAIN ] SXI: Loaded 11510 primary data records. [2025-09-29T22:16:08.774945] [DEBUG] [LOCAL ] SXC: Loaded 41438 existing records from primary storage. [2025-09-29T22:16:08.797352] [DEBUG] [MAIN ] SWZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:08.798554] [INFO ] [MAIN ] SXC: Loaded 41438 primary data records. [2025-09-29T22:16:08.798359] [INFO ] [MAIN ] SWZ: Generated 1794 derivative records from 6005 primary records. [2025-09-29T22:16:08.798701] [DEBUG] [LOCAL ] SWZ: Saving derivative data. [2025-09-29T22:16:09.096401] [DEBUG] [LOCAL ] SWZ: Derivative data saved (1794 records). [2025-09-29T22:16:09.128766] [INFO ] [MAIN ] SWZ: Successfully saved derivative data. [2025-09-29T22:16:09.281481] [INFO ] [MAIN ] Derivative Progress: 1744/2057 symbols completed. SWZ took 1.2s. Estimated remaining: 2m 7s. Rate: 147.6 symbols/min [2025-09-29T22:16:09.282633] [INFO ] [MAIN ] SXT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:09.322504] [DEBUG] [MAIN ] SXI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:09.323418] [INFO ] [MAIN ] SXI: Generated 1794 derivative records from 11510 primary records. [2025-09-29T22:16:09.323852] [DEBUG] [LOCAL ] SXI: Saving derivative data. [2025-09-29T22:16:09.348497] [DEBUG] [LOCAL ] SXT: Loaded 29225 existing records from primary storage. [2025-09-29T22:16:09.349253] [INFO ] [MAIN ] SXT: Loaded 29225 primary data records. [2025-09-29T22:16:09.453251] [DEBUG] [LOCAL ] SXI: Derivative data saved (1794 records). [2025-09-29T22:16:09.462254] [INFO ] [MAIN ] SXI: Successfully saved derivative data. [2025-09-29T22:16:09.498032] [DEBUG] [MAIN ] SXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:09.481524] [INFO ] [MAIN ] Derivative Progress: 1745/2057 symbols completed. SXI took 0.9s. Estimated remaining: 2m 7s. Rate: 147.6 symbols/min [2025-09-29T22:16:09.505678] [INFO ] [MAIN ] SXC: Generated 1794 derivative records from 41438 primary records. [2025-09-29T22:16:09.505900] [INFO ] [MAIN ] SYF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:09.506235] [DEBUG] [LOCAL ] SXC: Saving derivative data. [2025-09-29T22:16:09.770067] [DEBUG] [LOCAL ] SXC: Derivative data saved (1794 records). [2025-09-29T22:16:09.770522] [INFO ] [MAIN ] SXC: Successfully saved derivative data. [2025-09-29T22:16:09.772949] [INFO ] [MAIN ] Derivative Progress: 1746/2057 symbols completed. SXC took 1.2s. Estimated remaining: 2m 6s. Rate: 147.7 symbols/min [2025-09-29T22:16:09.774020] [INFO ] [MAIN ] SYK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:09.816989] [DEBUG] [MAIN ] SXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:09.834613] [INFO ] [MAIN ] SXT: Generated 1794 derivative records from 29225 primary records. [2025-09-29T22:16:09.834839] [DEBUG] [LOCAL ] SXT: Saving derivative data. [2025-09-29T22:16:09.836800] [DEBUG] [LOCAL ] SYF: Loaded 53442 existing records from primary storage. [2025-09-29T22:16:09.856032] [INFO ] [MAIN ] SYF: Loaded 53442 primary data records. [2025-09-29T22:16:09.986506] [DEBUG] [LOCAL ] SYK: Loaded 46905 existing records from primary storage. [2025-09-29T22:16:10.000730] [INFO ] [MAIN ] SYK: Loaded 46905 primary data records. [2025-09-29T22:16:10.012138] [DEBUG] [LOCAL ] SXT: Derivative data saved (1794 records). [2025-09-29T22:16:10.026714] [INFO ] [MAIN ] SXT: Successfully saved derivative data. [2025-09-29T22:16:10.034157] [INFO ] [MAIN ] Derivative Progress: 1747/2057 symbols completed. SXT took 0.8s. Estimated remaining: 2m 6s. Rate: 147.7 symbols/min [2025-09-29T22:16:10.039610] [INFO ] [MAIN ] SYY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:10.611774] [DEBUG] [LOCAL ] SYY: Loaded 53228 existing records from primary storage. [2025-09-29T22:16:10.620391] [INFO ] [MAIN ] SYY: Loaded 53228 primary data records. [2025-09-29T22:16:10.626030] [DEBUG] [MAIN ] SYF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:10.632283] [INFO ] [MAIN ] SYF: Generated 1794 derivative records from 53442 primary records. [2025-09-29T22:16:10.632510] [DEBUG] [LOCAL ] SYF: Saving derivative data. [2025-09-29T22:16:10.762920] [DEBUG] [LOCAL ] SYF: Derivative data saved (1794 records). [2025-09-29T22:16:10.768570] [INFO ] [MAIN ] SYF: Successfully saved derivative data. [2025-09-29T22:16:10.775988] [INFO ] [MAIN ] Derivative Progress: 1748/2057 symbols completed. SYF took 1.3s. Estimated remaining: 2m 6s. Rate: 147.6 symbols/min [2025-09-29T22:16:10.799584] [INFO ] [MAIN ] T: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:10.810839] [DEBUG] [MAIN ] SYK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:10.827171] [INFO ] [MAIN ] SYK: Generated 1794 derivative records from 46905 primary records. [2025-09-29T22:16:10.827296] [DEBUG] [LOCAL ] SYK: Saving derivative data. [2025-09-29T22:16:11.068078] [DEBUG] [LOCAL ] SYK: Derivative data saved (1794 records). [2025-09-29T22:16:11.068609] [INFO ] [MAIN ] SYK: Successfully saved derivative data. [2025-09-29T22:16:11.071148] [INFO ] [MAIN ] Derivative Progress: 1749/2057 symbols completed. SYK took 1.3s. Estimated remaining: 2m 5s. Rate: 147.6 symbols/min [2025-09-29T22:16:11.071354] [INFO ] [MAIN ] TAC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:11.129942] [DEBUG] [MAIN ] SYY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:11.130844] [INFO ] [MAIN ] SYY: Generated 1794 derivative records from 53228 primary records. [2025-09-29T22:16:11.130993] [DEBUG] [LOCAL ] SYY: Saving derivative data. [2025-09-29T22:16:11.137572] [DEBUG] [LOCAL ] T: Loaded 53798 existing records from primary storage. [2025-09-29T22:16:11.137979] [INFO ] [MAIN ] T: Loaded 53798 primary data records. [2025-09-29T22:16:11.352840] [DEBUG] [LOCAL ] TAC: Loaded 42590 existing records from primary storage. [2025-09-29T22:16:11.356333] [DEBUG] [LOCAL ] SYY: Derivative data saved (1794 records). [2025-09-29T22:16:11.379146] [INFO ] [MAIN ] SYY: Successfully saved derivative data. [2025-09-29T22:16:11.356496] [INFO ] [MAIN ] TAC: Loaded 42590 primary data records. [2025-09-29T22:16:11.381223] [INFO ] [MAIN ] Derivative Progress: 1750/2057 symbols completed. SYY took 1.3s. Estimated remaining: 2m 5s. Rate: 147.7 symbols/min [2025-09-29T22:16:11.523516] [INFO ] [MAIN ] TAK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:11.930741] [DEBUG] [LOCAL ] TAK: Loaded 49800 existing records from primary storage. [2025-09-29T22:16:11.931824] [DEBUG] [MAIN ] T: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:11.932611] [INFO ] [MAIN ] T: Generated 1794 derivative records from 53798 primary records. [2025-09-29T22:16:11.932836] [DEBUG] [LOCAL ] T: Saving derivative data. [2025-09-29T22:16:11.933150] [INFO ] [MAIN ] TAK: Loaded 49800 primary data records. [2025-09-29T22:16:12.091951] [DEBUG] [LOCAL ] T: Derivative data saved (1794 records). [2025-09-29T22:16:12.149970] [INFO ] [MAIN ] T: Successfully saved derivative data. [2025-09-29T22:16:12.159891] [INFO ] [MAIN ] Derivative Progress: 1751/2057 symbols completed. T took 1.4s. Estimated remaining: 2m 4s. Rate: 147.6 symbols/min [2025-09-29T22:16:12.288344] [INFO ] [MAIN ] TAL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:12.290703] [DEBUG] [MAIN ] TAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:12.291569] [INFO ] [MAIN ] TAC: Generated 1794 derivative records from 42590 primary records. [2025-09-29T22:16:12.291806] [DEBUG] [LOCAL ] TAC: Saving derivative data. [2025-09-29T22:16:12.317303] [DEBUG] [LOCAL ] TAC: Derivative data saved (1794 records). [2025-09-29T22:16:12.317817] [INFO ] [MAIN ] TAC: Successfully saved derivative data. [2025-09-29T22:16:12.320951] [INFO ] [MAIN ] Derivative Progress: 1752/2057 symbols completed. TAC took 1.2s. Estimated remaining: 2m 4s. Rate: 147.6 symbols/min [2025-09-29T22:16:12.322314] [INFO ] [MAIN ] TALO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:12.348484] [DEBUG] [MAIN ] TAK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:12.363519] [INFO ] [MAIN ] TAK: Generated 1794 derivative records from 49800 primary records. [2025-09-29T22:16:12.363722] [DEBUG] [LOCAL ] TAK: Saving derivative data. [2025-09-29T22:16:12.397002] [DEBUG] [LOCAL ] TAK: Derivative data saved (1794 records). [2025-09-29T22:16:12.398710] [INFO ] [MAIN ] TAK: Successfully saved derivative data. [2025-09-29T22:16:12.401367] [INFO ] [MAIN ] Derivative Progress: 1753/2057 symbols completed. TAK took 0.9s. Estimated remaining: 2m 3s. Rate: 147.7 symbols/min [2025-09-29T22:16:12.402786] [DEBUG] [LOCAL ] TAL: Loaded 51990 existing records from primary storage. [2025-09-29T22:16:12.417423] [INFO ] [MAIN ] TAL: Loaded 51990 primary data records. [2025-09-29T22:16:12.585870] [DEBUG] [LOCAL ] TALO: Loaded 50798 existing records from primary storage. [2025-09-29T22:16:12.605770] [INFO ] [MAIN ] TALO: Loaded 50798 primary data records. [2025-09-29T22:16:13.111933] [DEBUG] [MAIN ] TAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:13.112863] [INFO ] [MAIN ] TAL: Generated 1794 derivative records from 51990 primary records. [2025-09-29T22:16:13.113213] [DEBUG] [LOCAL ] TAL: Saving derivative data. [2025-09-29T22:16:13.147504] [DEBUG] [MAIN ] TALO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:13.148028] [DEBUG] [LOCAL ] TAL: Derivative data saved (1794 records). [2025-09-29T22:16:13.148964] [INFO ] [MAIN ] TALO: Generated 1794 derivative records from 50798 primary records. [2025-09-29T22:16:13.149059] [DEBUG] [LOCAL ] TALO: Saving derivative data. [2025-09-29T22:16:13.149158] [INFO ] [MAIN ] TAL: Successfully saved derivative data. [2025-09-29T22:16:13.151920] [INFO ] [MAIN ] Derivative Progress: 1754/2057 symbols completed. TAL took 0.9s. Estimated remaining: 2m 3s. Rate: 147.6 symbols/min [2025-09-29T22:16:13.167842] [DEBUG] [LOCAL ] TALO: Derivative data saved (1794 records). [2025-09-29T22:16:13.167962] [INFO ] [MAIN ] TALO: Successfully saved derivative data. [2025-09-29T22:16:13.169999] [INFO ] [MAIN ] Derivative Progress: 1755/2057 symbols completed. TALO took 0.8s. Estimated remaining: 2m 3s. Rate: 147.7 symbols/min [2025-09-29T22:16:13.170574] [INFO ] [MAIN ] TAP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:13.170499] [INFO ] [MAIN ] TBB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:13.170798] [INFO ] [MAIN ] TBBB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:13.186385] [DEBUG] [LOCAL ] TBB: Loaded 11736 existing records from primary storage. [2025-09-29T22:16:13.186621] [INFO ] [MAIN ] TBB: Loaded 11736 primary data records. [2025-09-29T22:16:13.415157] [DEBUG] [LOCAL ] TBBB: Loaded 35550 existing records from primary storage. [2025-09-29T22:16:13.421627] [INFO ] [MAIN ] TBBB: Loaded 35550 primary data records. [2025-09-29T22:16:13.680171] [DEBUG] [LOCAL ] TAP: Loaded 52873 existing records from primary storage. [2025-09-29T22:16:13.690981] [INFO ] [MAIN ] TAP: Loaded 52873 primary data records. [2025-09-29T22:16:14.324021] [DEBUG] [MAIN ] TBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:14.324808] [INFO ] [MAIN ] TBB: Generated 1794 derivative records from 11736 primary records. [2025-09-29T22:16:14.325220] [DEBUG] [LOCAL ] TBB: Saving derivative data. [2025-09-29T22:16:14.352170] [DEBUG] [LOCAL ] TBB: Derivative data saved (1794 records). [2025-09-29T22:16:14.353269] [INFO ] [MAIN ] TBB: Successfully saved derivative data. [2025-09-29T22:16:14.356140] [INFO ] [MAIN ] Derivative Progress: 1756/2057 symbols completed. TBB took 1.2s. Estimated remaining: 2m 2s. Rate: 147.6 symbols/min [2025-09-29T22:16:14.356413] [INFO ] [MAIN ] TBI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:14.372185] [DEBUG] [MAIN ] TBBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:14.373277] [INFO ] [MAIN ] TBBB: Generated 1794 derivative records from 35550 primary records. [2025-09-29T22:16:14.373494] [DEBUG] [LOCAL ] TBBB: Saving derivative data. [2025-09-29T22:16:14.403426] [DEBUG] [LOCAL ] TBBB: Derivative data saved (1794 records). [2025-09-29T22:16:14.417286] [INFO ] [MAIN ] TBBB: Successfully saved derivative data. [2025-09-29T22:16:14.417592] [DEBUG] [MAIN ] TAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:14.418513] [INFO ] [MAIN ] TAP: Generated 1794 derivative records from 52873 primary records. [2025-09-29T22:16:14.420986] [DEBUG] [LOCAL ] TAP: Saving derivative data. [2025-09-29T22:16:14.420898] [INFO ] [MAIN ] Derivative Progress: 1757/2057 symbols completed. TBBB took 1.3s. Estimated remaining: 2m 2s. Rate: 147.6 symbols/min [2025-09-29T22:16:14.422569] [INFO ] [MAIN ] TBN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:14.444462] [DEBUG] [LOCAL ] TBI: Loaded 22581 existing records from primary storage. [2025-09-29T22:16:14.445169] [INFO ] [MAIN ] TBI: Loaded 22581 primary data records. [2025-09-29T22:16:14.513069] [DEBUG] [LOCAL ] TBN: Loaded 2993 existing records from primary storage. [2025-09-29T22:16:14.536804] [DEBUG] [LOCAL ] TAP: Derivative data saved (1794 records). [2025-09-29T22:16:14.542120] [INFO ] [MAIN ] TAP: Successfully saved derivative data. [2025-09-29T22:16:14.536699] [INFO ] [MAIN ] TBN: Loaded 2993 primary data records. [2025-09-29T22:16:14.593012] [INFO ] [MAIN ] Derivative Progress: 1758/2057 symbols completed. TAP took 1.4s. Estimated remaining: 2m 1s. Rate: 147.7 symbols/min [2025-09-29T22:16:14.627461] [INFO ] [MAIN ] TD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:15.212162] [DEBUG] [LOCAL ] TD: Loaded 52270 existing records from primary storage. [2025-09-29T22:16:15.213002] [INFO ] [MAIN ] TD: Loaded 52270 primary data records. [2025-09-29T22:16:15.420514] [DEBUG] [MAIN ] TBN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:15.456398] [INFO ] [MAIN ] TBN: Generated 1794 derivative records from 2993 primary records. [2025-09-29T22:16:15.582018] [DEBUG] [MAIN ] TBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:15.582979] [INFO ] [MAIN ] TBI: Generated 1794 derivative records from 22581 primary records. [2025-09-29T22:16:15.581338] [DEBUG] [LOCAL ] TBN: Saving derivative data. [2025-09-29T22:16:15.584071] [DEBUG] [LOCAL ] TBI: Saving derivative data. [2025-09-29T22:16:15.617455] [DEBUG] [LOCAL ] TBN: Derivative data saved (1794 records). [2025-09-29T22:16:15.618501] [INFO ] [MAIN ] TBN: Successfully saved derivative data. [2025-09-29T22:16:15.621153] [INFO ] [MAIN ] Derivative Progress: 1759/2057 symbols completed. TBN took 1.2s. Estimated remaining: 2m 1s. Rate: 147.5 symbols/min [2025-09-29T22:16:15.621686] [INFO ] [MAIN ] TDC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:15.623742] [DEBUG] [LOCAL ] TBI: Derivative data saved (1794 records). [2025-09-29T22:16:15.624062] [INFO ] [MAIN ] TBI: Successfully saved derivative data. [2025-09-29T22:16:15.626980] [INFO ] [MAIN ] Derivative Progress: 1760/2057 symbols completed. TBI took 1.3s. Estimated remaining: 2m 1s. Rate: 147.6 symbols/min [2025-09-29T22:16:15.627711] [INFO ] [MAIN ] TDF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:15.648022] [DEBUG] [MAIN ] TD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:15.650597] [INFO ] [MAIN ] TD: Generated 1794 derivative records from 52270 primary records. [2025-09-29T22:16:15.650809] [DEBUG] [LOCAL ] TD: Saving derivative data. [2025-09-29T22:16:15.655672] [DEBUG] [LOCAL ] TDF: Loaded 6433 existing records from primary storage. [2025-09-29T22:16:15.663364] [INFO ] [MAIN ] TDF: Loaded 6433 primary data records. [2025-09-29T22:16:15.808775] [DEBUG] [LOCAL ] TD: Derivative data saved (1794 records). [2025-09-29T22:16:15.830191] [INFO ] [MAIN ] TD: Successfully saved derivative data. [2025-09-29T22:16:15.862482] [INFO ] [MAIN ] Derivative Progress: 1761/2057 symbols completed. TD took 1.2s. Estimated remaining: 2m 0s. Rate: 147.7 symbols/min [2025-09-29T22:16:15.905612] [INFO ] [MAIN ] TDG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:16.010980] [DEBUG] [LOCAL ] TDC: Loaded 46688 existing records from primary storage. [2025-09-29T22:16:16.016368] [INFO ] [MAIN ] TDC: Loaded 46688 primary data records. [2025-09-29T22:16:16.404269] [DEBUG] [LOCAL ] TDG: Loaded 21894 existing records from primary storage. [2025-09-29T22:16:16.414687] [INFO ] [MAIN ] TDG: Loaded 21894 primary data records. [2025-09-29T22:16:16.563638] [DEBUG] [MAIN ] TDF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:16.604933] [INFO ] [MAIN ] TDF: Generated 1794 derivative records from 6433 primary records. [2025-09-29T22:16:16.761411] [DEBUG] [LOCAL ] TDF: Saving derivative data. [2025-09-29T22:16:16.787666] [DEBUG] [LOCAL ] TDF: Derivative data saved (1794 records). [2025-09-29T22:16:16.795736] [INFO ] [MAIN ] TDF: Successfully saved derivative data. [2025-09-29T22:16:16.804664] [INFO ] [MAIN ] Derivative Progress: 1762/2057 symbols completed. TDF took 1.2s. Estimated remaining: 1m 60s. Rate: 147.6 symbols/min [2025-09-29T22:16:16.802285] [DEBUG] [MAIN ] TDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:16.805930] [INFO ] [MAIN ] TDC: Generated 1794 derivative records from 46688 primary records. [2025-09-29T22:16:16.806266] [DEBUG] [LOCAL ] TDC: Saving derivative data. [2025-09-29T22:16:16.806125] [INFO ] [MAIN ] TDOC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:16.831576] [DEBUG] [LOCAL ] TDC: Derivative data saved (1794 records). [2025-09-29T22:16:16.831900] [INFO ] [MAIN ] TDC: Successfully saved derivative data. [2025-09-29T22:16:16.834315] [INFO ] [MAIN ] Derivative Progress: 1763/2057 symbols completed. TDC took 1.2s. Estimated remaining: 1m 59s. Rate: 147.6 symbols/min [2025-09-29T22:16:16.834630] [INFO ] [MAIN ] TDS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:16.849038] [DEBUG] [MAIN ] TDG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:16.849892] [INFO ] [MAIN ] TDG: Generated 1794 derivative records from 21894 primary records. [2025-09-29T22:16:16.850002] [DEBUG] [LOCAL ] TDG: Saving derivative data. [2025-09-29T22:16:16.871416] [DEBUG] [LOCAL ] TDG: Derivative data saved (1794 records). [2025-09-29T22:16:16.871631] [INFO ] [MAIN ] TDG: Successfully saved derivative data. [2025-09-29T22:16:16.874917] [INFO ] [MAIN ] Derivative Progress: 1764/2057 symbols completed. TDG took 1.0s. Estimated remaining: 1m 59s. Rate: 147.7 symbols/min [2025-09-29T22:16:16.875421] [INFO ] [MAIN ] TDW: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:16.936369] [DEBUG] [LOCAL ] TDS: Loaded 42693 existing records from primary storage. [2025-09-29T22:16:16.937269] [INFO ] [MAIN ] TDS: Loaded 42693 primary data records. [2025-09-29T22:16:17.003766] [DEBUG] [LOCAL ] TDOC: Loaded 53344 existing records from primary storage. [2025-09-29T22:16:17.072369] [INFO ] [MAIN ] TDOC: Loaded 53344 primary data records. [2025-09-29T22:16:17.089329] [DEBUG] [LOCAL ] TDW: Loaded 45406 existing records from primary storage. [2025-09-29T22:16:17.089576] [INFO ] [MAIN ] TDW: Loaded 45406 primary data records. [2025-09-29T22:16:18.021937] [DEBUG] [MAIN ] TDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:18.023213] [INFO ] [MAIN ] TDS: Generated 1794 derivative records from 42693 primary records. [2025-09-29T22:16:18.023715] [DEBUG] [LOCAL ] TDS: Saving derivative data. [2025-09-29T22:16:18.076619] [DEBUG] [MAIN ] TDOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:18.076930] [DEBUG] [MAIN ] TDW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:18.078863] [INFO ] [MAIN ] TDW: Generated 1794 derivative records from 45406 primary records. [2025-09-29T22:16:18.078989] [DEBUG] [LOCAL ] TDS: Derivative data saved (1794 records). [2025-09-29T22:16:18.079866] [INFO ] [MAIN ] TDOC: Generated 1794 derivative records from 53344 primary records. [2025-09-29T22:16:18.079957] [DEBUG] [LOCAL ] TDW: Saving derivative data. [2025-09-29T22:16:18.080064] [DEBUG] [LOCAL ] TDOC: Saving derivative data. [2025-09-29T22:16:18.080954] [INFO ] [MAIN ] TDS: Successfully saved derivative data. [2025-09-29T22:16:18.084173] [INFO ] [MAIN ] Derivative Progress: 1765/2057 symbols completed. TDS took 1.2s. Estimated remaining: 1m 59s. Rate: 147.5 symbols/min [2025-09-29T22:16:18.092522] [INFO ] [MAIN ] TDY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:18.121679] [DEBUG] [LOCAL ] TDW: Derivative data saved (1794 records). [2025-09-29T22:16:18.129951] [DEBUG] [LOCAL ] TDOC: Derivative data saved (1794 records). [2025-09-29T22:16:18.130045] [INFO ] [MAIN ] TDW: Successfully saved derivative data. [2025-09-29T22:16:18.132367] [INFO ] [MAIN ] Derivative Progress: 1766/2057 symbols completed. TDW took 1.3s. Estimated remaining: 1m 58s. Rate: 147.6 symbols/min [2025-09-29T22:16:18.132510] [INFO ] [MAIN ] TDOC: Successfully saved derivative data. [2025-09-29T22:16:18.132681] [INFO ] [MAIN ] TEAF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:18.135297] [INFO ] [MAIN ] Derivative Progress: 1767/2057 symbols completed. TDOC took 1.3s. Estimated remaining: 1m 58s. Rate: 147.7 symbols/min [2025-09-29T22:16:18.136059] [INFO ] [MAIN ] TECK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:18.148384] [DEBUG] [LOCAL ] TDY: Loaded 22545 existing records from primary storage. [2025-09-29T22:16:18.150527] [INFO ] [MAIN ] TDY: Loaded 22545 primary data records. [2025-09-29T22:16:18.203216] [DEBUG] [LOCAL ] TEAF: Loaded 7473 existing records from primary storage. [2025-09-29T22:16:18.232624] [INFO ] [MAIN ] TEAF: Loaded 7473 primary data records. [2025-09-29T22:16:18.846055] [DEBUG] [LOCAL ] TECK: Loaded 53436 existing records from primary storage. [2025-09-29T22:16:18.886973] [INFO ] [MAIN ] TECK: Loaded 53436 primary data records. [2025-09-29T22:16:19.245479] [DEBUG] [MAIN ] TEAF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:19.246351] [INFO ] [MAIN ] TEAF: Generated 1794 derivative records from 7473 primary records. [2025-09-29T22:16:19.247597] [DEBUG] [MAIN ] TDY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:19.249087] [INFO ] [MAIN ] TDY: Generated 1794 derivative records from 22545 primary records. [2025-09-29T22:16:19.250020] [DEBUG] [LOCAL ] TDY: Saving derivative data. [2025-09-29T22:16:19.250974] [DEBUG] [LOCAL ] TEAF: Saving derivative data. [2025-09-29T22:16:19.284050] [DEBUG] [LOCAL ] TDY: Derivative data saved (1794 records). [2025-09-29T22:16:19.285154] [INFO ] [MAIN ] TDY: Successfully saved derivative data. [2025-09-29T22:16:19.288263] [INFO ] [MAIN ] Derivative Progress: 1768/2057 symbols completed. TDY took 1.2s. Estimated remaining: 1m 58s. Rate: 147.5 symbols/min [2025-09-29T22:16:19.294674] [DEBUG] [LOCAL ] TEAF: Derivative data saved (1794 records). [2025-09-29T22:16:19.294821] [INFO ] [MAIN ] TEAF: Successfully saved derivative data. [2025-09-29T22:16:19.297052] [INFO ] [MAIN ] Derivative Progress: 1769/2057 symbols completed. TEAF took 1.2s. Estimated remaining: 1m 57s. Rate: 147.6 symbols/min [2025-09-29T22:16:19.310383] [DEBUG] [MAIN ] TECK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:19.311588] [INFO ] [MAIN ] TECK: Generated 1794 derivative records from 53436 primary records. [2025-09-29T22:16:19.311731] [DEBUG] [LOCAL ] TECK: Saving derivative data. [2025-09-29T22:16:19.328707] [DEBUG] [LOCAL ] TECK: Derivative data saved (1794 records). [2025-09-29T22:16:19.328835] [INFO ] [MAIN ] TECK: Successfully saved derivative data. [2025-09-29T22:16:19.331032] [INFO ] [MAIN ] Derivative Progress: 1770/2057 symbols completed. TECK took 1.2s. Estimated remaining: 1m 57s. Rate: 147.7 symbols/min [2025-09-29T22:16:19.331772] [INFO ] [MAIN ] TEI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:19.331670] [INFO ] [MAIN ] TEF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:19.331864] [INFO ] [MAIN ] TEL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:19.393529] [DEBUG] [LOCAL ] TEF: Loaded 37364 existing records from primary storage. [2025-09-29T22:16:19.393749] [INFO ] [MAIN ] TEF: Loaded 37364 primary data records. [2025-09-29T22:16:19.478182] [DEBUG] [LOCAL ] TEI: Loaded 20866 existing records from primary storage. [2025-09-29T22:16:19.494204] [INFO ] [MAIN ] TEI: Loaded 20866 primary data records. [2025-09-29T22:16:19.557151] [DEBUG] [LOCAL ] TEL: Loaded 51130 existing records from primary storage. [2025-09-29T22:16:19.562589] [INFO ] [MAIN ] TEL: Loaded 51130 primary data records. [2025-09-29T22:16:20.512502] [DEBUG] [MAIN ] TEF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:20.513836] [INFO ] [MAIN ] TEF: Generated 1794 derivative records from 37364 primary records. [2025-09-29T22:16:20.515126] [DEBUG] [LOCAL ] TEF: Saving derivative data. [2025-09-29T22:16:20.545742] [DEBUG] [MAIN ] TEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:20.548695] [INFO ] [MAIN ] TEL: Generated 1794 derivative records from 51130 primary records. [2025-09-29T22:16:20.548810] [DEBUG] [LOCAL ] TEL: Saving derivative data. [2025-09-29T22:16:20.581243] [DEBUG] [MAIN ] TEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:20.583196] [INFO ] [MAIN ] TEI: Generated 1794 derivative records from 20866 primary records. [2025-09-29T22:16:20.583608] [DEBUG] [LOCAL ] TEI: Saving derivative data. [2025-09-29T22:16:20.585503] [DEBUG] [LOCAL ] TEF: Derivative data saved (1794 records). [2025-09-29T22:16:20.593563] [INFO ] [MAIN ] TEF: Successfully saved derivative data. [2025-09-29T22:16:20.596484] [INFO ] [MAIN ] Derivative Progress: 1771/2057 symbols completed. TEF took 1.3s. Estimated remaining: 1m 56s. Rate: 147.5 symbols/min [2025-09-29T22:16:20.602299] [INFO ] [MAIN ] TEO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:20.605806] [DEBUG] [LOCAL ] TEL: Derivative data saved (1794 records). [2025-09-29T22:16:20.606412] [INFO ] [MAIN ] TEL: Successfully saved derivative data. [2025-09-29T22:16:20.609359] [INFO ] [MAIN ] Derivative Progress: 1772/2057 symbols completed. TEL took 1.3s. Estimated remaining: 1m 56s. Rate: 147.6 symbols/min [2025-09-29T22:16:20.609968] [INFO ] [MAIN ] TEVA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:20.613549] [DEBUG] [LOCAL ] TEI: Derivative data saved (1794 records). [2025-09-29T22:16:20.613718] [INFO ] [MAIN ] TEI: Successfully saved derivative data. [2025-09-29T22:16:20.615791] [INFO ] [MAIN ] Derivative Progress: 1773/2057 symbols completed. TEI took 1.3s. Estimated remaining: 1m 55s. Rate: 147.7 symbols/min [2025-09-29T22:16:20.615927] [INFO ] [MAIN ] TEX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:20.639787] [DEBUG] [LOCAL ] TEO: Loaded 22040 existing records from primary storage. [2025-09-29T22:16:20.639937] [INFO ] [MAIN ] TEO: Loaded 22040 primary data records. [2025-09-29T22:16:21.038807] [DEBUG] [LOCAL ] TEVA: Loaded 53632 existing records from primary storage. [2025-09-29T22:16:21.039055] [INFO ] [MAIN ] TEVA: Loaded 53632 primary data records. [2025-09-29T22:16:21.039712] [DEBUG] [LOCAL ] TEX: Loaded 44379 existing records from primary storage. [2025-09-29T22:16:21.039905] [INFO ] [MAIN ] TEX: Loaded 44379 primary data records. [2025-09-29T22:16:21.729977] [DEBUG] [MAIN ] TEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:21.730894] [INFO ] [MAIN ] TEO: Generated 1794 derivative records from 22040 primary records. [2025-09-29T22:16:21.731117] [DEBUG] [LOCAL ] TEO: Saving derivative data. [2025-09-29T22:16:21.755288] [DEBUG] [LOCAL ] TEO: Derivative data saved (1794 records). [2025-09-29T22:16:21.757918] [INFO ] [MAIN ] TEO: Successfully saved derivative data. [2025-09-29T22:16:21.761015] [INFO ] [MAIN ] Derivative Progress: 1774/2057 symbols completed. TEO took 1.2s. Estimated remaining: 1m 55s. Rate: 147.5 symbols/min [2025-09-29T22:16:21.774750] [INFO ] [MAIN ] TFC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:21.783671] [DEBUG] [MAIN ] TEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:21.788895] [DEBUG] [MAIN ] TEVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:21.789911] [INFO ] [MAIN ] TEVA: Generated 1794 derivative records from 53632 primary records. [2025-09-29T22:16:21.790467] [INFO ] [MAIN ] TEX: Generated 1794 derivative records from 44379 primary records. [2025-09-29T22:16:21.790584] [DEBUG] [LOCAL ] TEVA: Saving derivative data. [2025-09-29T22:16:21.790679] [DEBUG] [LOCAL ] TEX: Saving derivative data. [2025-09-29T22:16:21.825742] [DEBUG] [LOCAL ] TEX: Derivative data saved (1794 records). [2025-09-29T22:16:21.825923] [INFO ] [MAIN ] TEX: Successfully saved derivative data. [2025-09-29T22:16:21.825418] [DEBUG] [LOCAL ] TEVA: Derivative data saved (1794 records). [2025-09-29T22:16:21.828616] [INFO ] [MAIN ] TEVA: Successfully saved derivative data. [2025-09-29T22:16:21.828424] [INFO ] [MAIN ] Derivative Progress: 1775/2057 symbols completed. TEX took 1.2s. Estimated remaining: 1m 55s. Rate: 147.6 symbols/min [2025-09-29T22:16:21.831522] [INFO ] [MAIN ] TFII: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:21.831607] [INFO ] [MAIN ] Derivative Progress: 1776/2057 symbols completed. TEVA took 1.2s. Estimated remaining: 1m 54s. Rate: 147.7 symbols/min [2025-09-29T22:16:21.832360] [INFO ] [MAIN ] TFIN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:21.878607] [DEBUG] [LOCAL ] TFC: Loaded 53667 existing records from primary storage. [2025-09-29T22:16:21.886701] [INFO ] [MAIN ] TFC: Loaded 53667 primary data records. [2025-09-29T22:16:21.887341] [DEBUG] [LOCAL ] TFIN: Loaded 23487 existing records from primary storage. [2025-09-29T22:16:21.892635] [INFO ] [MAIN ] TFIN: Loaded 23487 primary data records. [2025-09-29T22:16:22.099423] [DEBUG] [LOCAL ] TFII: Loaded 33910 existing records from primary storage. [2025-09-29T22:16:22.109953] [INFO ] [MAIN ] TFII: Loaded 33910 primary data records. [2025-09-29T22:16:22.943953] [DEBUG] [MAIN ] TFIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:22.950421] [INFO ] [MAIN ] TFIN: Generated 1794 derivative records from 23487 primary records. [2025-09-29T22:16:22.949557] [DEBUG] [MAIN ] TFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:22.950854] [DEBUG] [LOCAL ] TFIN: Saving derivative data. [2025-09-29T22:16:22.951460] [INFO ] [MAIN ] TFC: Generated 1794 derivative records from 53667 primary records. [2025-09-29T22:16:22.951763] [DEBUG] [LOCAL ] TFC: Saving derivative data. [2025-09-29T22:16:22.999736] [DEBUG] [MAIN ] TFII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:23.001263] [INFO ] [MAIN ] TFII: Generated 1794 derivative records from 33910 primary records. [2025-09-29T22:16:23.001878] [DEBUG] [LOCAL ] TFII: Saving derivative data. [2025-09-29T22:16:23.005526] [DEBUG] [LOCAL ] TFIN: Derivative data saved (1794 records). [2025-09-29T22:16:23.012796] [DEBUG] [LOCAL ] TFC: Derivative data saved (1794 records). [2025-09-29T22:16:23.016463] [INFO ] [MAIN ] TFC: Successfully saved derivative data. [2025-09-29T22:16:23.019297] [INFO ] [MAIN ] Derivative Progress: 1777/2057 symbols completed. TFC took 1.2s. Estimated remaining: 1m 54s. Rate: 147.5 symbols/min [2025-09-29T22:16:23.019955] [INFO ] [MAIN ] TFPM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:23.020318] [INFO ] [MAIN ] TFIN: Successfully saved derivative data. [2025-09-29T22:16:23.022629] [INFO ] [MAIN ] Derivative Progress: 1778/2057 symbols completed. TFIN took 1.2s. Estimated remaining: 1m 53s. Rate: 147.6 symbols/min [2025-09-29T22:16:23.023993] [INFO ] [MAIN ] TFX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:23.027967] [DEBUG] [LOCAL ] TFII: Derivative data saved (1794 records). [2025-09-29T22:16:23.028140] [INFO ] [MAIN ] TFII: Successfully saved derivative data. [2025-09-29T22:16:23.030463] [INFO ] [MAIN ] Derivative Progress: 1779/2057 symbols completed. TFII took 1.2s. Estimated remaining: 1m 53s. Rate: 147.7 symbols/min [2025-09-29T22:16:23.030876] [INFO ] [MAIN ] TG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:23.062827] [DEBUG] [LOCAL ] TG: Loaded 10383 existing records from primary storage. [2025-09-29T22:16:23.063384] [INFO ] [MAIN ] TG: Loaded 10383 primary data records. [2025-09-29T22:16:23.181863] [DEBUG] [LOCAL ] TFPM: Loaded 37691 existing records from primary storage. [2025-09-29T22:16:23.208797] [INFO ] [MAIN ] TFPM: Loaded 37691 primary data records. [2025-09-29T22:16:23.283549] [DEBUG] [LOCAL ] TFX: Loaded 37180 existing records from primary storage. [2025-09-29T22:16:23.349288] [INFO ] [MAIN ] TFX: Loaded 37180 primary data records. [2025-09-29T22:16:24.108076] [DEBUG] [MAIN ] TG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:24.109292] [INFO ] [MAIN ] TG: Generated 1794 derivative records from 10383 primary records. [2025-09-29T22:16:24.109427] [DEBUG] [LOCAL ] TG: Saving derivative data. [2025-09-29T22:16:24.155600] [DEBUG] [LOCAL ] TG: Derivative data saved (1794 records). [2025-09-29T22:16:24.161240] [DEBUG] [MAIN ] TFX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:24.161680] [DEBUG] [MAIN ] TFPM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:24.163283] [INFO ] [MAIN ] TFPM: Generated 1794 derivative records from 37691 primary records. [2025-09-29T22:16:24.163404] [DEBUG] [LOCAL ] TFPM: Saving derivative data. [2025-09-29T22:16:24.161751] [INFO ] [MAIN ] TG: Successfully saved derivative data. [2025-09-29T22:16:24.162522] [INFO ] [MAIN ] TFX: Generated 1794 derivative records from 37180 primary records. [2025-09-29T22:16:24.164446] [DEBUG] [LOCAL ] TFX: Saving derivative data. [2025-09-29T22:16:24.166803] [INFO ] [MAIN ] Derivative Progress: 1780/2057 symbols completed. TG took 1.1s. Estimated remaining: 1m 53s. Rate: 147.5 symbols/min [2025-09-29T22:16:24.167621] [INFO ] [MAIN ] TGLS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:24.198519] [DEBUG] [LOCAL ] TFX: Derivative data saved (1794 records). [2025-09-29T22:16:24.199320] [INFO ] [MAIN ] TFX: Successfully saved derivative data. [2025-09-29T22:16:24.201745] [INFO ] [MAIN ] Derivative Progress: 1781/2057 symbols completed. TFX took 1.2s. Estimated remaining: 1m 52s. Rate: 147.6 symbols/min [2025-09-29T22:16:24.202084] [INFO ] [MAIN ] TGNA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:24.207521] [DEBUG] [LOCAL ] TFPM: Derivative data saved (1794 records). [2025-09-29T22:16:24.207881] [INFO ] [MAIN ] TFPM: Successfully saved derivative data. [2025-09-29T22:16:24.210384] [INFO ] [MAIN ] Derivative Progress: 1782/2057 symbols completed. TFPM took 1.2s. Estimated remaining: 1m 52s. Rate: 147.7 symbols/min [2025-09-29T22:16:24.210667] [INFO ] [MAIN ] TGS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:24.236224] [DEBUG] [LOCAL ] TGLS: Loaded 28129 existing records from primary storage. [2025-09-29T22:16:24.236374] [INFO ] [MAIN ] TGLS: Loaded 28129 primary data records. [2025-09-29T22:16:24.453926] [DEBUG] [LOCAL ] TGS: Loaded 32648 existing records from primary storage. [2025-09-29T22:16:24.489493] [INFO ] [MAIN ] TGS: Loaded 32648 primary data records. [2025-09-29T22:16:24.656261] [DEBUG] [LOCAL ] TGNA: Loaded 48677 existing records from primary storage. [2025-09-29T22:16:24.682264] [INFO ] [MAIN ] TGNA: Loaded 48677 primary data records. [2025-09-29T22:16:25.341512] [DEBUG] [MAIN ] TGLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:25.343081] [INFO ] [MAIN ] TGLS: Generated 1794 derivative records from 28129 primary records. [2025-09-29T22:16:25.343595] [DEBUG] [LOCAL ] TGLS: Saving derivative data. [2025-09-29T22:16:25.365110] [DEBUG] [LOCAL ] TGLS: Derivative data saved (1794 records). [2025-09-29T22:16:25.365902] [INFO ] [MAIN ] TGLS: Successfully saved derivative data. [2025-09-29T22:16:25.368397] [INFO ] [MAIN ] Derivative Progress: 1783/2057 symbols completed. TGLS took 1.2s. Estimated remaining: 1m 51s. Rate: 147.5 symbols/min [2025-09-29T22:16:25.383135] [DEBUG] [MAIN ] TGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:25.384204] [INFO ] [MAIN ] TGS: Generated 1794 derivative records from 32648 primary records. [2025-09-29T22:16:25.384411] [DEBUG] [LOCAL ] TGS: Saving derivative data. [2025-09-29T22:16:25.415885] [DEBUG] [MAIN ] TGNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:25.417158] [INFO ] [MAIN ] TGNA: Generated 1794 derivative records from 48677 primary records. [2025-09-29T22:16:25.418411] [DEBUG] [LOCAL ] TGS: Derivative data saved (1794 records). [2025-09-29T22:16:25.418500] [DEBUG] [LOCAL ] TGNA: Saving derivative data. [2025-09-29T22:16:25.418859] [INFO ] [MAIN ] TGS: Successfully saved derivative data. [2025-09-29T22:16:25.421178] [INFO ] [MAIN ] Derivative Progress: 1784/2057 symbols completed. TGS took 1.2s. Estimated remaining: 1m 51s. Rate: 147.6 symbols/min [2025-09-29T22:16:25.436386] [DEBUG] [LOCAL ] TGNA: Derivative data saved (1794 records). [2025-09-29T22:16:25.436467] [INFO ] [MAIN ] TGNA: Successfully saved derivative data. [2025-09-29T22:16:25.439125] [INFO ] [MAIN ] Derivative Progress: 1785/2057 symbols completed. TGNA took 1.2s. Estimated remaining: 1m 50s. Rate: 147.7 symbols/min [2025-09-29T22:16:25.439683] [INFO ] [MAIN ] THC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:25.439592] [INFO ] [MAIN ] TGT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:25.439841] [INFO ] [MAIN ] THG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:25.467855] [DEBUG] [LOCAL ] THG: Loaded 21717 existing records from primary storage. [2025-09-29T22:16:25.468030] [INFO ] [MAIN ] THG: Loaded 21717 primary data records. [2025-09-29T22:16:25.846455] [DEBUG] [LOCAL ] THC: Loaded 47803 existing records from primary storage. [2025-09-29T22:16:25.856297] [INFO ] [MAIN ] THC: Loaded 47803 primary data records. [2025-09-29T22:16:25.856159] [DEBUG] [LOCAL ] TGT: Loaded 53778 existing records from primary storage. [2025-09-29T22:16:25.856537] [INFO ] [MAIN ] TGT: Loaded 53778 primary data records. [2025-09-29T22:16:26.538404] [DEBUG] [MAIN ] THG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:26.540363] [INFO ] [MAIN ] THG: Generated 1794 derivative records from 21717 primary records. [2025-09-29T22:16:26.540565] [DEBUG] [LOCAL ] THG: Saving derivative data. [2025-09-29T22:16:26.562173] [DEBUG] [LOCAL ] THG: Derivative data saved (1794 records). [2025-09-29T22:16:26.562521] [INFO ] [MAIN ] THG: Successfully saved derivative data. [2025-09-29T22:16:26.567214] [INFO ] [MAIN ] Derivative Progress: 1786/2057 symbols completed. THG took 1.1s. Estimated remaining: 1m 50s. Rate: 147.6 symbols/min [2025-09-29T22:16:26.567793] [INFO ] [MAIN ] THIR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:26.578305] [DEBUG] [LOCAL ] THIR: Loaded 2188 existing records from primary storage. [2025-09-29T22:16:26.579194] [INFO ] [MAIN ] THIR: Loaded 2188 primary data records. [2025-09-29T22:16:26.787901] [DEBUG] [MAIN ] TGT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:26.787525] [DEBUG] [MAIN ] THC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:26.988502] [INFO ] [MAIN ] TGT: Generated 1794 derivative records from 53778 primary records. [2025-09-29T22:16:26.994631] [INFO ] [MAIN ] THC: Generated 1794 derivative records from 47803 primary records. [2025-09-29T22:16:27.004187] [DEBUG] [LOCAL ] THC: Saving derivative data. [2025-09-29T22:16:27.003934] [DEBUG] [LOCAL ] TGT: Saving derivative data. [2025-09-29T22:16:27.037165] [DEBUG] [LOCAL ] TGT: Derivative data saved (1794 records). [2025-09-29T22:16:27.041518] [INFO ] [MAIN ] TGT: Successfully saved derivative data. [2025-09-29T22:16:27.047146] [INFO ] [MAIN ] Derivative Progress: 1787/2057 symbols completed. TGT took 1.6s. Estimated remaining: 1m 50s. Rate: 147.5 symbols/min [2025-09-29T22:16:27.048287] [INFO ] [MAIN ] THLV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:27.051377] [DEBUG] [LOCAL ] THC: Derivative data saved (1794 records). [2025-09-29T22:16:27.051501] [INFO ] [MAIN ] THC: Successfully saved derivative data. [2025-09-29T22:16:27.054131] [INFO ] [MAIN ] Derivative Progress: 1788/2057 symbols completed. THC took 1.6s. Estimated remaining: 1m 49s. Rate: 147.6 symbols/min [2025-09-29T22:16:27.056877] [INFO ] [MAIN ] THO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:27.061295] [DEBUG] [LOCAL ] THLV: Loaded 1564 existing records from primary storage. [2025-09-29T22:16:27.061779] [INFO ] [MAIN ] THLV: Loaded 1564 primary data records. [2025-09-29T22:16:27.215186] [DEBUG] [MAIN ] THIR: Filtered 7001 bins outside market hours, 7825 incomplete bins [2025-09-29T22:16:27.284601] [INFO ] [MAIN ] THIR: Generated 1789 derivative records from 2188 primary records. [2025-09-29T22:16:27.415781] [DEBUG] [LOCAL ] THIR: Saving derivative data. [2025-09-29T22:16:27.478396] [DEBUG] [LOCAL ] THO: Loaded 42119 existing records from primary storage. [2025-09-29T22:16:27.482187] [INFO ] [MAIN ] THO: Loaded 42119 primary data records. [2025-09-29T22:16:27.567553] [DEBUG] [LOCAL ] THIR: Derivative data saved (1789 records). [2025-09-29T22:16:27.587535] [INFO ] [MAIN ] THIR: Successfully saved derivative data. [2025-09-29T22:16:27.616189] [INFO ] [MAIN ] Derivative Progress: 1789/2057 symbols completed. THIR took 1.0s. Estimated remaining: 1m 49s. Rate: 147.6 symbols/min [2025-09-29T22:16:27.633800] [INFO ] [MAIN ] THQ: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:27.870142] [DEBUG] [MAIN ] THLV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:16:27.879814] [INFO ] [MAIN ] THLV: Generated 1793 derivative records from 1564 primary records. [2025-09-29T22:16:27.880280] [DEBUG] [LOCAL ] THQ: Loaded 24768 existing records from primary storage. [2025-09-29T22:16:27.880538] [DEBUG] [LOCAL ] THLV: Saving derivative data. [2025-09-29T22:16:27.880630] [INFO ] [MAIN ] THQ: Loaded 24768 primary data records. [2025-09-29T22:16:27.995337] [DEBUG] [LOCAL ] THLV: Derivative data saved (1793 records). [2025-09-29T22:16:28.018928] [INFO ] [MAIN ] THLV: Successfully saved derivative data. [2025-09-29T22:16:28.048173] [INFO ] [MAIN ] Derivative Progress: 1790/2057 symbols completed. THLV took 1.0s. Estimated remaining: 1m 49s. Rate: 147.6 symbols/min [2025-09-29T22:16:28.074516] [INFO ] [MAIN ] THR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:28.254599] [DEBUG] [MAIN ] THO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:28.255442] [INFO ] [MAIN ] THO: Generated 1794 derivative records from 42119 primary records. [2025-09-29T22:16:28.255629] [DEBUG] [LOCAL ] THO: Saving derivative data. [2025-09-29T22:16:28.283880] [DEBUG] [LOCAL ] THO: Derivative data saved (1794 records). [2025-09-29T22:16:28.284325] [INFO ] [MAIN ] THO: Successfully saved derivative data. [2025-09-29T22:16:28.286832] [INFO ] [MAIN ] Derivative Progress: 1791/2057 symbols completed. THO took 1.2s. Estimated remaining: 1m 48s. Rate: 147.6 symbols/min [2025-09-29T22:16:28.294972] [INFO ] [MAIN ] THS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:28.295743] [DEBUG] [LOCAL ] THR: Loaded 19815 existing records from primary storage. [2025-09-29T22:16:28.296339] [INFO ] [MAIN ] THR: Loaded 19815 primary data records. [2025-09-29T22:16:28.667361] [DEBUG] [MAIN ] THQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:28.668414] [INFO ] [MAIN ] THQ: Generated 1794 derivative records from 24768 primary records. [2025-09-29T22:16:28.668931] [DEBUG] [LOCAL ] THQ: Saving derivative data. [2025-09-29T22:16:28.660514] [DEBUG] [LOCAL ] THS: Loaded 38036 existing records from primary storage. [2025-09-29T22:16:28.670208] [INFO ] [MAIN ] THS: Loaded 38036 primary data records. [2025-09-29T22:16:28.800080] [DEBUG] [LOCAL ] THQ: Derivative data saved (1794 records). [2025-09-29T22:16:28.811124] [INFO ] [MAIN ] THQ: Successfully saved derivative data. [2025-09-29T22:16:28.818714] [INFO ] [MAIN ] Derivative Progress: 1792/2057 symbols completed. THQ took 1.2s. Estimated remaining: 1m 48s. Rate: 147.6 symbols/min [2025-09-29T22:16:28.829501] [INFO ] [MAIN ] THW: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:29.031432] [DEBUG] [MAIN ] THR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:29.032463] [INFO ] [MAIN ] THR: Generated 1794 derivative records from 19815 primary records. [2025-09-29T22:16:29.033130] [DEBUG] [LOCAL ] THR: Saving derivative data. [2025-09-29T22:16:29.063632] [DEBUG] [LOCAL ] THW: Loaded 19211 existing records from primary storage. [2025-09-29T22:16:29.064830] [INFO ] [MAIN ] THW: Loaded 19211 primary data records. [2025-09-29T22:16:29.139461] [DEBUG] [LOCAL ] THR: Derivative data saved (1794 records). [2025-09-29T22:16:29.164252] [INFO ] [MAIN ] THR: Successfully saved derivative data. [2025-09-29T22:16:29.183115] [INFO ] [MAIN ] Derivative Progress: 1793/2057 symbols completed. THR took 1.1s. Estimated remaining: 1m 47s. Rate: 147.6 symbols/min [2025-09-29T22:16:29.193265] [INFO ] [MAIN ] TIMB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:29.458228] [DEBUG] [MAIN ] THS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:29.459970] [INFO ] [MAIN ] THS: Generated 1794 derivative records from 38036 primary records. [2025-09-29T22:16:29.460216] [DEBUG] [LOCAL ] THS: Saving derivative data. [2025-09-29T22:16:29.502693] [DEBUG] [LOCAL ] THS: Derivative data saved (1794 records). [2025-09-29T22:16:29.502878] [INFO ] [MAIN ] THS: Successfully saved derivative data. [2025-09-29T22:16:29.505134] [INFO ] [MAIN ] Derivative Progress: 1794/2057 symbols completed. THS took 1.2s. Estimated remaining: 1m 47s. Rate: 147.6 symbols/min [2025-09-29T22:16:29.505545] [INFO ] [MAIN ] TISI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:29.508094] [DEBUG] [LOCAL ] TIMB: Loaded 36222 existing records from primary storage. [2025-09-29T22:16:29.508357] [INFO ] [MAIN ] TIMB: Loaded 36222 primary data records. [2025-09-29T22:16:29.595797] [DEBUG] [LOCAL ] TISI: Loaded 3729 existing records from primary storage. [2025-09-29T22:16:29.612122] [INFO ] [MAIN ] TISI: Loaded 3729 primary data records. [2025-09-29T22:16:29.859222] [DEBUG] [MAIN ] THW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:30.010039] [INFO ] [MAIN ] THW: Generated 1794 derivative records from 19211 primary records. [2025-09-29T22:16:30.036125] [DEBUG] [LOCAL ] THW: Saving derivative data. [2025-09-29T22:16:30.286240] [DEBUG] [LOCAL ] THW: Derivative data saved (1794 records). [2025-09-29T22:16:30.286667] [INFO ] [MAIN ] THW: Successfully saved derivative data. [2025-09-29T22:16:30.289208] [INFO ] [MAIN ] Derivative Progress: 1795/2057 symbols completed. THW took 1.5s. Estimated remaining: 1m 47s. Rate: 147.5 symbols/min [2025-09-29T22:16:30.290265] [INFO ] [MAIN ] TIXT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:30.312672] [DEBUG] [MAIN ] TIMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:30.313426] [INFO ] [MAIN ] TIMB: Generated 1794 derivative records from 36222 primary records. [2025-09-29T22:16:30.313752] [DEBUG] [LOCAL ] TIMB: Saving derivative data. [2025-09-29T22:16:30.339183] [DEBUG] [LOCAL ] TIMB: Derivative data saved (1794 records). [2025-09-29T22:16:30.339448] [INFO ] [MAIN ] TIMB: Successfully saved derivative data. [2025-09-29T22:16:30.341747] [INFO ] [MAIN ] Derivative Progress: 1796/2057 symbols completed. TIMB took 1.1s. Estimated remaining: 1m 46s. Rate: 147.6 symbols/min [2025-09-29T22:16:30.342157] [INFO ] [MAIN ] TJX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:30.357368] [DEBUG] [LOCAL ] TIXT: Loaded 31355 existing records from primary storage. [2025-09-29T22:16:30.358491] [INFO ] [MAIN ] TIXT: Loaded 31355 primary data records. [2025-09-29T22:16:30.412740] [DEBUG] [MAIN ] TISI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:30.443007] [INFO ] [MAIN ] TISI: Generated 1794 derivative records from 3729 primary records. [2025-09-29T22:16:30.443132] [DEBUG] [LOCAL ] TISI: Saving derivative data. [2025-09-29T22:16:30.489501] [DEBUG] [LOCAL ] TISI: Derivative data saved (1794 records). [2025-09-29T22:16:30.508313] [INFO ] [MAIN ] TISI: Successfully saved derivative data. [2025-09-29T22:16:30.511521] [INFO ] [MAIN ] Derivative Progress: 1797/2057 symbols completed. TISI took 1.0s. Estimated remaining: 1m 46s. Rate: 147.7 symbols/min [2025-09-29T22:16:30.517102] [INFO ] [MAIN ] TK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:30.777942] [DEBUG] [LOCAL ] TJX: Loaded 53669 existing records from primary storage. [2025-09-29T22:16:30.779220] [INFO ] [MAIN ] TJX: Loaded 53669 primary data records. [2025-09-29T22:16:30.963349] [DEBUG] [LOCAL ] TK: Loaded 39550 existing records from primary storage. [2025-09-29T22:16:30.973955] [INFO ] [MAIN ] TK: Loaded 39550 primary data records. [2025-09-29T22:16:31.553345] [DEBUG] [MAIN ] TIXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:31.555924] [INFO ] [MAIN ] TIXT: Generated 1794 derivative records from 31355 primary records. [2025-09-29T22:16:31.556185] [DEBUG] [LOCAL ] TIXT: Saving derivative data. [2025-09-29T22:16:31.584737] [DEBUG] [LOCAL ] TIXT: Derivative data saved (1794 records). [2025-09-29T22:16:31.597960] [INFO ] [MAIN ] TIXT: Successfully saved derivative data. [2025-09-29T22:16:31.599192] [DEBUG] [MAIN ] TJX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:31.602342] [INFO ] [MAIN ] Derivative Progress: 1798/2057 symbols completed. TIXT took 1.3s. Estimated remaining: 1m 45s. Rate: 147.5 symbols/min [2025-09-29T22:16:31.603063] [INFO ] [MAIN ] TJX: Generated 1794 derivative records from 53669 primary records. [2025-09-29T22:16:31.603687] [DEBUG] [LOCAL ] TJX: Saving derivative data. [2025-09-29T22:16:31.639886] [DEBUG] [MAIN ] TK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:31.639483] [DEBUG] [LOCAL ] TJX: Derivative data saved (1794 records). [2025-09-29T22:16:31.640936] [INFO ] [MAIN ] TJX: Successfully saved derivative data. [2025-09-29T22:16:31.640859] [INFO ] [MAIN ] TK: Generated 1794 derivative records from 39550 primary records. [2025-09-29T22:16:31.643186] [INFO ] [MAIN ] Derivative Progress: 1799/2057 symbols completed. TJX took 1.3s. Estimated remaining: 1m 45s. Rate: 147.6 symbols/min [2025-09-29T22:16:31.643439] [DEBUG] [LOCAL ] TK: Saving derivative data. [2025-09-29T22:16:31.658818] [DEBUG] [LOCAL ] TK: Derivative data saved (1794 records). [2025-09-29T22:16:31.658880] [INFO ] [MAIN ] TK: Successfully saved derivative data. [2025-09-29T22:16:31.661171] [INFO ] [MAIN ] Derivative Progress: 1800/2057 symbols completed. TK took 1.1s. Estimated remaining: 1m 44s. Rate: 147.7 symbols/min [2025-09-29T22:16:31.661757] [INFO ] [MAIN ] TKO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:31.662108] [INFO ] [MAIN ] TKR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:31.661873] [INFO ] [MAIN ] TKC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:31.705497] [DEBUG] [LOCAL ] TKC: Loaded 38704 existing records from primary storage. [2025-09-29T22:16:31.705763] [INFO ] [MAIN ] TKC: Loaded 38704 primary data records. [2025-09-29T22:16:31.915935] [DEBUG] [LOCAL ] TKR: Loaded 40096 existing records from primary storage. [2025-09-29T22:16:31.958094] [INFO ] [MAIN ] TKR: Loaded 40096 primary data records. [2025-09-29T22:16:32.064823] [DEBUG] [LOCAL ] TKO: Loaded 44049 existing records from primary storage. [2025-09-29T22:16:32.070214] [INFO ] [MAIN ] TKO: Loaded 44049 primary data records. [2025-09-29T22:16:32.820541] [DEBUG] [MAIN ] TKC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:32.821684] [INFO ] [MAIN ] TKC: Generated 1794 derivative records from 38704 primary records. [2025-09-29T22:16:32.823541] [DEBUG] [LOCAL ] TKC: Saving derivative data. [2025-09-29T22:16:32.850232] [DEBUG] [LOCAL ] TKC: Derivative data saved (1794 records). [2025-09-29T22:16:32.853310] [INFO ] [MAIN ] TKC: Successfully saved derivative data. [2025-09-29T22:16:32.855690] [INFO ] [MAIN ] Derivative Progress: 1801/2057 symbols completed. TKC took 1.2s. Estimated remaining: 1m 44s. Rate: 147.5 symbols/min [2025-09-29T22:16:32.869482] [INFO ] [MAIN ] TLK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:32.870437] [DEBUG] [MAIN ] TKO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:32.882226] [INFO ] [MAIN ] TKO: Generated 1794 derivative records from 44049 primary records. [2025-09-29T22:16:32.889525] [DEBUG] [LOCAL ] TKO: Saving derivative data. [2025-09-29T22:16:32.890287] [DEBUG] [MAIN ] TKR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:32.892552] [INFO ] [MAIN ] TKR: Generated 1794 derivative records from 40096 primary records. [2025-09-29T22:16:32.892721] [DEBUG] [LOCAL ] TKR: Saving derivative data. [2025-09-29T22:16:32.929986] [DEBUG] [LOCAL ] TKO: Derivative data saved (1794 records). [2025-09-29T22:16:32.930121] [INFO ] [MAIN ] TKO: Successfully saved derivative data. [2025-09-29T22:16:32.932287] [INFO ] [MAIN ] Derivative Progress: 1802/2057 symbols completed. TKO took 1.3s. Estimated remaining: 1m 44s. Rate: 147.6 symbols/min [2025-09-29T22:16:32.932609] [INFO ] [MAIN ] TLYS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:32.934694] [DEBUG] [LOCAL ] TKR: Derivative data saved (1794 records). [2025-09-29T22:16:32.934897] [INFO ] [MAIN ] TKR: Successfully saved derivative data. [2025-09-29T22:16:32.947009] [INFO ] [MAIN ] Derivative Progress: 1803/2057 symbols completed. TKR took 1.3s. Estimated remaining: 1m 43s. Rate: 147.7 symbols/min [2025-09-29T22:16:32.947484] [INFO ] [MAIN ] TM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:32.969255] [DEBUG] [LOCAL ] TLK: Loaded 39177 existing records from primary storage. [2025-09-29T22:16:32.969542] [INFO ] [MAIN ] TLK: Loaded 39177 primary data records. [2025-09-29T22:16:33.037576] [DEBUG] [LOCAL ] TLYS: Loaded 16915 existing records from primary storage. [2025-09-29T22:16:33.070173] [INFO ] [MAIN ] TLYS: Loaded 16915 primary data records. [2025-09-29T22:16:33.195103] [DEBUG] [LOCAL ] TM: Loaded 36388 existing records from primary storage. [2025-09-29T22:16:33.246370] [INFO ] [MAIN ] TM: Loaded 36388 primary data records. [2025-09-29T22:16:34.106258] [DEBUG] [MAIN ] TLK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:34.107827] [INFO ] [MAIN ] TLK: Generated 1794 derivative records from 39177 primary records. [2025-09-29T22:16:34.108282] [DEBUG] [LOCAL ] TLK: Saving derivative data. [2025-09-29T22:16:34.140183] [DEBUG] [MAIN ] TLYS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:34.141899] [INFO ] [MAIN ] TLYS: Generated 1794 derivative records from 16915 primary records. [2025-09-29T22:16:34.144916] [DEBUG] [LOCAL ] TLYS: Saving derivative data. [2025-09-29T22:16:34.147052] [DEBUG] [LOCAL ] TLK: Derivative data saved (1794 records). [2025-09-29T22:16:34.161718] [INFO ] [MAIN ] TLK: Successfully saved derivative data. [2025-09-29T22:16:34.166711] [INFO ] [MAIN ] Derivative Progress: 1804/2057 symbols completed. TLK took 1.3s. Estimated remaining: 1m 43s. Rate: 147.5 symbols/min [2025-09-29T22:16:34.183124] [INFO ] [MAIN ] TME: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:34.184242] [DEBUG] [MAIN ] TM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:34.185787] [DEBUG] [LOCAL ] TLYS: Derivative data saved (1794 records). [2025-09-29T22:16:34.185961] [INFO ] [MAIN ] TLYS: Successfully saved derivative data. [2025-09-29T22:16:34.189010] [INFO ] [MAIN ] Derivative Progress: 1805/2057 symbols completed. TLYS took 1.3s. Estimated remaining: 1m 42s. Rate: 147.6 symbols/min [2025-09-29T22:16:34.190331] [INFO ] [MAIN ] TM: Generated 1794 derivative records from 36388 primary records. [2025-09-29T22:16:34.191133] [DEBUG] [LOCAL ] TM: Saving derivative data. [2025-09-29T22:16:34.190509] [INFO ] [MAIN ] TMHC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:34.213769] [DEBUG] [LOCAL ] TM: Derivative data saved (1794 records). [2025-09-29T22:16:34.213999] [INFO ] [MAIN ] TM: Successfully saved derivative data. [2025-09-29T22:16:34.216984] [INFO ] [MAIN ] Derivative Progress: 1806/2057 symbols completed. TM took 1.3s. Estimated remaining: 1m 42s. Rate: 147.7 symbols/min [2025-09-29T22:16:34.217423] [INFO ] [MAIN ] TMO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:34.268836] [DEBUG] [LOCAL ] TMHC: Loaded 45505 existing records from primary storage. [2025-09-29T22:16:34.268993] [INFO ] [MAIN ] TMHC: Loaded 45505 primary data records. [2025-09-29T22:16:34.413715] [DEBUG] [LOCAL ] TME: Loaded 53194 existing records from primary storage. [2025-09-29T22:16:34.425145] [INFO ] [MAIN ] TME: Loaded 53194 primary data records. [2025-09-29T22:16:34.597950] [DEBUG] [LOCAL ] TMO: Loaded 52328 existing records from primary storage. [2025-09-29T22:16:34.715592] [INFO ] [MAIN ] TMO: Loaded 52328 primary data records. [2025-09-29T22:16:35.345902] [DEBUG] [MAIN ] TMHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:35.347468] [INFO ] [MAIN ] TMHC: Generated 1794 derivative records from 45505 primary records. [2025-09-29T22:16:35.349824] [DEBUG] [LOCAL ] TMHC: Saving derivative data. [2025-09-29T22:16:35.366471] [DEBUG] [MAIN ] TME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:35.379929] [INFO ] [MAIN ] TME: Generated 1794 derivative records from 53194 primary records. [2025-09-29T22:16:35.383149] [DEBUG] [LOCAL ] TMHC: Derivative data saved (1794 records). [2025-09-29T22:16:35.383311] [DEBUG] [LOCAL ] TME: Saving derivative data. [2025-09-29T22:16:35.384242] [INFO ] [MAIN ] TMHC: Successfully saved derivative data. [2025-09-29T22:16:35.386428] [INFO ] [MAIN ] Derivative Progress: 1807/2057 symbols completed. TMHC took 1.2s. Estimated remaining: 1m 42s. Rate: 147.5 symbols/min [2025-09-29T22:16:35.386782] [INFO ] [MAIN ] TNC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:35.419625] [DEBUG] [MAIN ] TMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:35.420991] [INFO ] [MAIN ] TMO: Generated 1794 derivative records from 52328 primary records. [2025-09-29T22:16:35.421452] [DEBUG] [LOCAL ] TMO: Saving derivative data. [2025-09-29T22:16:35.437558] [DEBUG] [LOCAL ] TME: Derivative data saved (1794 records). [2025-09-29T22:16:35.448121] [DEBUG] [LOCAL ] TNC: Loaded 14964 existing records from primary storage. [2025-09-29T22:16:35.447708] [INFO ] [MAIN ] TME: Successfully saved derivative data. [2025-09-29T22:16:35.450547] [INFO ] [MAIN ] Derivative Progress: 1808/2057 symbols completed. TME took 1.3s. Estimated remaining: 1m 41s. Rate: 147.6 symbols/min [2025-09-29T22:16:35.454367] [DEBUG] [LOCAL ] TMO: Derivative data saved (1794 records). [2025-09-29T22:16:35.454790] [INFO ] [MAIN ] TMO: Successfully saved derivative data. [2025-09-29T22:16:35.454519] [INFO ] [MAIN ] TNC: Loaded 14964 primary data records. [2025-09-29T22:16:35.457441] [INFO ] [MAIN ] Derivative Progress: 1809/2057 symbols completed. TMO took 1.2s. Estimated remaining: 1m 41s. Rate: 147.6 symbols/min [2025-09-29T22:16:35.454984] [INFO ] [MAIN ] TNET: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:35.457725] [INFO ] [MAIN ] TNK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:35.689299] [DEBUG] [LOCAL ] TNET: Loaded 28664 existing records from primary storage. [2025-09-29T22:16:35.697365] [INFO ] [MAIN ] TNET: Loaded 28664 primary data records. [2025-09-29T22:16:36.008781] [DEBUG] [LOCAL ] TNK: Loaded 35166 existing records from primary storage. [2025-09-29T22:16:36.009168] [INFO ] [MAIN ] TNK: Loaded 35166 primary data records. [2025-09-29T22:16:36.393953] [DEBUG] [MAIN ] TNC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:36.408107] [INFO ] [MAIN ] TNC: Generated 1794 derivative records from 14964 primary records. [2025-09-29T22:16:36.408246] [DEBUG] [LOCAL ] TNC: Saving derivative data. [2025-09-29T22:16:36.510588] [DEBUG] [LOCAL ] TNC: Derivative data saved (1794 records). [2025-09-29T22:16:36.510714] [INFO ] [MAIN ] TNC: Successfully saved derivative data. [2025-09-29T22:16:36.513262] [INFO ] [MAIN ] Derivative Progress: 1810/2057 symbols completed. TNC took 1.1s. Estimated remaining: 1m 40s. Rate: 147.5 symbols/min [2025-09-29T22:16:36.676114] [INFO ] [MAIN ] TNL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:36.952789] [DEBUG] [MAIN ] TNET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:36.954861] [INFO ] [MAIN ] TNET: Generated 1794 derivative records from 28664 primary records. [2025-09-29T22:16:36.955732] [DEBUG] [LOCAL ] TNET: Saving derivative data. [2025-09-29T22:16:36.975044] [DEBUG] [LOCAL ] TNL: Loaded 41762 existing records from primary storage. [2025-09-29T22:16:36.987613] [INFO ] [MAIN ] TNL: Loaded 41762 primary data records. [2025-09-29T22:16:37.016012] [DEBUG] [MAIN ] TNK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:37.045392] [INFO ] [MAIN ] TNK: Generated 1794 derivative records from 35166 primary records. [2025-09-29T22:16:37.079630] [DEBUG] [LOCAL ] TNK: Saving derivative data. [2025-09-29T22:16:37.086340] [DEBUG] [LOCAL ] TNET: Derivative data saved (1794 records). [2025-09-29T22:16:37.105199] [INFO ] [MAIN ] TNET: Successfully saved derivative data. [2025-09-29T22:16:37.114466] [INFO ] [MAIN ] Derivative Progress: 1811/2057 symbols completed. TNET took 1.7s. Estimated remaining: 1m 40s. Rate: 147.5 symbols/min [2025-09-29T22:16:37.118496] [INFO ] [MAIN ] TOL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:37.340388] [DEBUG] [LOCAL ] TNK: Derivative data saved (1794 records). [2025-09-29T22:16:37.349586] [INFO ] [MAIN ] TNK: Successfully saved derivative data. [2025-09-29T22:16:37.351871] [INFO ] [MAIN ] Derivative Progress: 1812/2057 symbols completed. TNK took 1.9s. Estimated remaining: 1m 40s. Rate: 147.5 symbols/min [2025-09-29T22:16:37.352139] [INFO ] [MAIN ] TOST: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:37.394860] [DEBUG] [MAIN ] TNL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:37.395618] [INFO ] [MAIN ] TNL: Generated 1794 derivative records from 41762 primary records. [2025-09-29T22:16:37.395732] [DEBUG] [LOCAL ] TNL: Saving derivative data. [2025-09-29T22:16:37.439392] [DEBUG] [LOCAL ] TNL: Derivative data saved (1794 records). [2025-09-29T22:16:37.441039] [INFO ] [MAIN ] TNL: Successfully saved derivative data. [2025-09-29T22:16:37.443414] [INFO ] [MAIN ] Derivative Progress: 1813/2057 symbols completed. TNL took 0.8s. Estimated remaining: 1m 39s. Rate: 147.6 symbols/min [2025-09-29T22:16:37.445357] [DEBUG] [LOCAL ] TOL: Loaded 50929 existing records from primary storage. [2025-09-29T22:16:37.445617] [INFO ] [MAIN ] TOL: Loaded 50929 primary data records. [2025-09-29T22:16:37.526396] [DEBUG] [LOCAL ] TOST: Loaded 53681 existing records from primary storage. [2025-09-29T22:16:37.538795] [INFO ] [MAIN ] TOST: Loaded 53681 primary data records. [2025-09-29T22:16:38.114186] [DEBUG] [MAIN ] TOL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:38.115262] [INFO ] [MAIN ] TOL: Generated 1794 derivative records from 50929 primary records. [2025-09-29T22:16:38.116331] [DEBUG] [LOCAL ] TOL: Saving derivative data. [2025-09-29T22:16:38.143618] [DEBUG] [MAIN ] TOST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:38.145316] [INFO ] [MAIN ] TOST: Generated 1794 derivative records from 53681 primary records. [2025-09-29T22:16:38.145847] [DEBUG] [LOCAL ] TOST: Saving derivative data. [2025-09-29T22:16:38.161741] [DEBUG] [LOCAL ] TOL: Derivative data saved (1794 records). [2025-09-29T22:16:38.164417] [INFO ] [MAIN ] TOL: Successfully saved derivative data. [2025-09-29T22:16:38.164318] [DEBUG] [LOCAL ] TOST: Derivative data saved (1794 records). [2025-09-29T22:16:38.166562] [INFO ] [MAIN ] Derivative Progress: 1814/2057 symbols completed. TOL took 1.0s. Estimated remaining: 1m 39s. Rate: 147.5 symbols/min [2025-09-29T22:16:38.166872] [INFO ] [MAIN ] TOST: Successfully saved derivative data. [2025-09-29T22:16:38.168754] [INFO ] [MAIN ] Derivative Progress: 1815/2057 symbols completed. TOST took 0.8s. Estimated remaining: 1m 38s. Rate: 147.6 symbols/min [2025-09-29T22:16:38.169166] [INFO ] [MAIN ] TPB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:38.169283] [INFO ] [MAIN ] TPC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:38.169336] [INFO ] [MAIN ] TPL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:38.184435] [DEBUG] [LOCAL ] TPL: Loaded 12304 existing records from primary storage. [2025-09-29T22:16:38.184749] [INFO ] [MAIN ] TPL: Loaded 12304 primary data records. [2025-09-29T22:16:38.403072] [DEBUG] [LOCAL ] TPB: Loaded 25081 existing records from primary storage. [2025-09-29T22:16:38.468735] [INFO ] [MAIN ] TPB: Loaded 25081 primary data records. [2025-09-29T22:16:38.597606] [DEBUG] [LOCAL ] TPC: Loaded 38713 existing records from primary storage. [2025-09-29T22:16:38.621284] [INFO ] [MAIN ] TPC: Loaded 38713 primary data records. [2025-09-29T22:16:39.277748] [DEBUG] [MAIN ] TPL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:39.279278] [INFO ] [MAIN ] TPL: Generated 1794 derivative records from 12304 primary records. [2025-09-29T22:16:39.279596] [DEBUG] [LOCAL ] TPL: Saving derivative data. [2025-09-29T22:16:39.298835] [DEBUG] [LOCAL ] TPL: Derivative data saved (1794 records). [2025-09-29T22:16:39.300494] [INFO ] [MAIN ] TPL: Successfully saved derivative data. [2025-09-29T22:16:39.303228] [INFO ] [MAIN ] Derivative Progress: 1816/2057 symbols completed. TPL took 1.1s. Estimated remaining: 1m 38s. Rate: 147.4 symbols/min [2025-09-29T22:16:39.303720] [INFO ] [MAIN ] TPR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:39.322608] [DEBUG] [MAIN ] TPB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:39.323601] [INFO ] [MAIN ] TPB: Generated 1794 derivative records from 25081 primary records. [2025-09-29T22:16:39.323748] [DEBUG] [LOCAL ] TPB: Saving derivative data. [2025-09-29T22:16:39.357365] [DEBUG] [MAIN ] TPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:39.358902] [INFO ] [MAIN ] TPC: Generated 1794 derivative records from 38713 primary records. [2025-09-29T22:16:39.360669] [DEBUG] [LOCAL ] TPC: Saving derivative data. [2025-09-29T22:16:39.360532] [DEBUG] [LOCAL ] TPB: Derivative data saved (1794 records). [2025-09-29T22:16:39.360911] [INFO ] [MAIN ] TPB: Successfully saved derivative data. [2025-09-29T22:16:39.363747] [INFO ] [MAIN ] Derivative Progress: 1817/2057 symbols completed. TPB took 1.2s. Estimated remaining: 1m 38s. Rate: 147.5 symbols/min [2025-09-29T22:16:39.364330] [INFO ] [MAIN ] TPVG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:39.396103] [DEBUG] [LOCAL ] TPC: Derivative data saved (1794 records). [2025-09-29T22:16:39.396287] [INFO ] [MAIN ] TPC: Successfully saved derivative data. [2025-09-29T22:16:39.398723] [INFO ] [MAIN ] Derivative Progress: 1818/2057 symbols completed. TPC took 1.2s. Estimated remaining: 1m 37s. Rate: 147.6 symbols/min [2025-09-29T22:16:39.399075] [INFO ] [MAIN ] TPYP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:39.418369] [DEBUG] [LOCAL ] TPYP: Loaded 7911 existing records from primary storage. [2025-09-29T22:16:39.418727] [INFO ] [MAIN ] TPYP: Loaded 7911 primary data records. [2025-09-29T22:16:39.540945] [DEBUG] [LOCAL ] TPVG: Loaded 26999 existing records from primary storage. [2025-09-29T22:16:39.541047] [INFO ] [MAIN ] TPVG: Loaded 26999 primary data records. [2025-09-29T22:16:39.530222] [DEBUG] [LOCAL ] TPR: Loaded 53470 existing records from primary storage. [2025-09-29T22:16:39.565931] [INFO ] [MAIN ] TPR: Loaded 53470 primary data records. [2025-09-29T22:16:40.548136] [DEBUG] [MAIN ] TPYP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:40.549208] [INFO ] [MAIN ] TPYP: Generated 1794 derivative records from 7911 primary records. [2025-09-29T22:16:40.550522] [DEBUG] [LOCAL ] TPYP: Saving derivative data. [2025-09-29T22:16:40.582894] [DEBUG] [MAIN ] TPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:40.598379] [INFO ] [MAIN ] TPR: Generated 1794 derivative records from 53470 primary records. [2025-09-29T22:16:40.598745] [DEBUG] [MAIN ] TPVG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:40.601068] [DEBUG] [LOCAL ] TPR: Saving derivative data. [2025-09-29T22:16:40.601928] [INFO ] [MAIN ] TPVG: Generated 1794 derivative records from 26999 primary records. [2025-09-29T22:16:40.601154] [DEBUG] [LOCAL ] TPYP: Derivative data saved (1794 records). [2025-09-29T22:16:40.602667] [INFO ] [MAIN ] TPYP: Successfully saved derivative data. [2025-09-29T22:16:40.602998] [DEBUG] [LOCAL ] TPVG: Saving derivative data. [2025-09-29T22:16:40.605730] [INFO ] [MAIN ] Derivative Progress: 1819/2057 symbols completed. TPYP took 1.2s. Estimated remaining: 1m 37s. Rate: 147.4 symbols/min [2025-09-29T22:16:40.605972] [INFO ] [MAIN ] TPZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:40.635096] [DEBUG] [LOCAL ] TPVG: Derivative data saved (1794 records). [2025-09-29T22:16:40.637568] [INFO ] [MAIN ] TPVG: Successfully saved derivative data. [2025-09-29T22:16:40.639762] [INFO ] [MAIN ] Derivative Progress: 1820/2057 symbols completed. TPVG took 1.3s. Estimated remaining: 1m 36s. Rate: 147.5 symbols/min [2025-09-29T22:16:40.640672] [INFO ] [MAIN ] TR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:40.643170] [DEBUG] [LOCAL ] TPR: Derivative data saved (1794 records). [2025-09-29T22:16:40.643498] [INFO ] [MAIN ] TPR: Successfully saved derivative data. [2025-09-29T22:16:40.645774] [INFO ] [MAIN ] Derivative Progress: 1821/2057 symbols completed. TPR took 1.3s. Estimated remaining: 1m 36s. Rate: 147.6 symbols/min [2025-09-29T22:16:40.646128] [INFO ] [MAIN ] TRAK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:40.650160] [DEBUG] [LOCAL ] TPZ: Loaded 5014 existing records from primary storage. [2025-09-29T22:16:40.650702] [INFO ] [MAIN ] TPZ: Loaded 5014 primary data records. [2025-09-29T22:16:40.780399] [DEBUG] [LOCAL ] TRAK: Loaded 9222 existing records from primary storage. [2025-09-29T22:16:40.793924] [INFO ] [MAIN ] TRAK: Loaded 9222 primary data records. [2025-09-29T22:16:40.793796] [DEBUG] [LOCAL ] TR: Loaded 18290 existing records from primary storage. [2025-09-29T22:16:40.852731] [INFO ] [MAIN ] TR: Loaded 18290 primary data records. [2025-09-29T22:16:41.706625] [DEBUG] [MAIN ] TPZ: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:16:41.709063] [INFO ] [MAIN ] TPZ: Generated 1793 derivative records from 5014 primary records. [2025-09-29T22:16:41.711246] [DEBUG] [LOCAL ] TPZ: Saving derivative data. [2025-09-29T22:16:41.738101] [DEBUG] [MAIN ] TRAK: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:16:41.742295] [INFO ] [MAIN ] TRAK: Generated 1793 derivative records from 9222 primary records. [2025-09-29T22:16:41.742402] [DEBUG] [LOCAL ] TRAK: Saving derivative data. [2025-09-29T22:16:41.743714] [DEBUG] [LOCAL ] TPZ: Derivative data saved (1793 records). [2025-09-29T22:16:41.744070] [INFO ] [MAIN ] TPZ: Successfully saved derivative data. [2025-09-29T22:16:41.757950] [INFO ] [MAIN ] Derivative Progress: 1822/2057 symbols completed. TPZ took 1.2s. Estimated remaining: 1m 36s. Rate: 147.4 symbols/min [2025-09-29T22:16:41.760853] [INFO ] [MAIN ] TREX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:41.766730] [DEBUG] [LOCAL ] TRAK: Derivative data saved (1793 records). [2025-09-29T22:16:41.767962] [INFO ] [MAIN ] TRAK: Successfully saved derivative data. [2025-09-29T22:16:41.770112] [INFO ] [MAIN ] Derivative Progress: 1823/2057 symbols completed. TRAK took 1.1s. Estimated remaining: 1m 35s. Rate: 147.5 symbols/min [2025-09-29T22:16:41.770438] [INFO ] [MAIN ] TRGP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:41.785258] [DEBUG] [MAIN ] TR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:41.786178] [INFO ] [MAIN ] TR: Generated 1794 derivative records from 18290 primary records. [2025-09-29T22:16:41.786361] [DEBUG] [LOCAL ] TR: Saving derivative data. [2025-09-29T22:16:41.805991] [DEBUG] [LOCAL ] TR: Derivative data saved (1794 records). [2025-09-29T22:16:41.806133] [INFO ] [MAIN ] TR: Successfully saved derivative data. [2025-09-29T22:16:41.812521] [INFO ] [MAIN ] Derivative Progress: 1824/2057 symbols completed. TR took 1.2s. Estimated remaining: 1m 35s. Rate: 147.6 symbols/min [2025-09-29T22:16:41.812768] [INFO ] [MAIN ] TRN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:41.860013] [DEBUG] [LOCAL ] TREX: Loaded 49972 existing records from primary storage. [2025-09-29T22:16:41.860389] [INFO ] [MAIN ] TREX: Loaded 49972 primary data records. [2025-09-29T22:16:41.985032] [DEBUG] [LOCAL ] TRGP: Loaded 50707 existing records from primary storage. [2025-09-29T22:16:41.999819] [INFO ] [MAIN ] TRGP: Loaded 50707 primary data records. [2025-09-29T22:16:42.154498] [DEBUG] [LOCAL ] TRN: Loaded 37138 existing records from primary storage. [2025-09-29T22:16:42.171095] [INFO ] [MAIN ] TRN: Loaded 37138 primary data records. [2025-09-29T22:16:42.966026] [DEBUG] [MAIN ] TREX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:42.967006] [INFO ] [MAIN ] TREX: Generated 1794 derivative records from 49972 primary records. [2025-09-29T22:16:42.967146] [DEBUG] [LOCAL ] TREX: Saving derivative data. [2025-09-29T22:16:42.993092] [DEBUG] [LOCAL ] TREX: Derivative data saved (1794 records). [2025-09-29T22:16:42.993263] [INFO ] [MAIN ] TREX: Successfully saved derivative data. [2025-09-29T22:16:42.995425] [INFO ] [MAIN ] Derivative Progress: 1825/2057 symbols completed. TREX took 1.2s. Estimated remaining: 1m 34s. Rate: 147.4 symbols/min [2025-09-29T22:16:42.995733] [INFO ] [MAIN ] TRNO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:43.009833] [DEBUG] [MAIN ] TRGP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:43.010793] [INFO ] [MAIN ] TRGP: Generated 1794 derivative records from 50707 primary records. [2025-09-29T22:16:43.010898] [DEBUG] [LOCAL ] TRGP: Saving derivative data. [2025-09-29T22:16:43.042356] [DEBUG] [MAIN ] TRN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:43.044000] [INFO ] [MAIN ] TRN: Generated 1794 derivative records from 37138 primary records. [2025-09-29T22:16:43.044148] [DEBUG] [LOCAL ] TRN: Saving derivative data. [2025-09-29T22:16:43.057470] [DEBUG] [LOCAL ] TRGP: Derivative data saved (1794 records). [2025-09-29T22:16:43.057688] [INFO ] [MAIN ] TRGP: Successfully saved derivative data. [2025-09-29T22:16:43.063167] [INFO ] [MAIN ] Derivative Progress: 1826/2057 symbols completed. TRGP took 1.3s. Estimated remaining: 1m 34s. Rate: 147.5 symbols/min [2025-09-29T22:16:43.063622] [INFO ] [MAIN ] TROX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:43.074952] [DEBUG] [LOCAL ] TRN: Derivative data saved (1794 records). [2025-09-29T22:16:43.075057] [INFO ] [MAIN ] TRN: Successfully saved derivative data. [2025-09-29T22:16:43.077046] [INFO ] [MAIN ] Derivative Progress: 1827/2057 symbols completed. TRN took 1.3s. Estimated remaining: 1m 34s. Rate: 147.6 symbols/min [2025-09-29T22:16:43.077386] [INFO ] [MAIN ] TRP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:43.095364] [DEBUG] [LOCAL ] TRNO: Loaded 43949 existing records from primary storage. [2025-09-29T22:16:43.095627] [INFO ] [MAIN ] TRNO: Loaded 43949 primary data records. [2025-09-29T22:16:43.460084] [DEBUG] [LOCAL ] TROX: Loaded 51813 existing records from primary storage. [2025-09-29T22:16:43.460833] [INFO ] [MAIN ] TROX: Loaded 51813 primary data records. [2025-09-29T22:16:43.567829] [DEBUG] [LOCAL ] TRP: Loaded 52103 existing records from primary storage. [2025-09-29T22:16:43.598366] [INFO ] [MAIN ] TRP: Loaded 52103 primary data records. [2025-09-29T22:16:44.170531] [DEBUG] [MAIN ] TRNO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:44.172085] [INFO ] [MAIN ] TRNO: Generated 1794 derivative records from 43949 primary records. [2025-09-29T22:16:44.172336] [DEBUG] [LOCAL ] TRNO: Saving derivative data. [2025-09-29T22:16:44.208677] [DEBUG] [MAIN ] TROX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:44.210271] [INFO ] [MAIN ] TROX: Generated 1794 derivative records from 51813 primary records. [2025-09-29T22:16:44.210942] [DEBUG] [LOCAL ] TRNO: Derivative data saved (1794 records). [2025-09-29T22:16:44.210499] [DEBUG] [LOCAL ] TROX: Saving derivative data. [2025-09-29T22:16:44.211243] [INFO ] [MAIN ] TRNO: Successfully saved derivative data. [2025-09-29T22:16:44.213797] [INFO ] [MAIN ] Derivative Progress: 1828/2057 symbols completed. TRNO took 1.2s. Estimated remaining: 1m 33s. Rate: 147.4 symbols/min [2025-09-29T22:16:44.232363] [DEBUG] [LOCAL ] TROX: Derivative data saved (1794 records). [2025-09-29T22:16:44.233338] [INFO ] [MAIN ] TROX: Successfully saved derivative data. [2025-09-29T22:16:44.235292] [INFO ] [MAIN ] Derivative Progress: 1829/2057 symbols completed. TROX took 1.2s. Estimated remaining: 1m 33s. Rate: 147.5 symbols/min [2025-09-29T22:16:44.248236] [DEBUG] [MAIN ] TRP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:44.248845] [INFO ] [MAIN ] TRP: Generated 1794 derivative records from 52103 primary records. [2025-09-29T22:16:44.248909] [DEBUG] [LOCAL ] TRP: Saving derivative data. [2025-09-29T22:16:44.264731] [DEBUG] [LOCAL ] TRP: Derivative data saved (1794 records). [2025-09-29T22:16:44.264838] [INFO ] [MAIN ] TRP: Successfully saved derivative data. [2025-09-29T22:16:44.266866] [INFO ] [MAIN ] Derivative Progress: 1830/2057 symbols completed. TRP took 1.2s. Estimated remaining: 1m 32s. Rate: 147.6 symbols/min [2025-09-29T22:16:44.267327] [INFO ] [MAIN ] TRTX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:44.267739] [INFO ] [MAIN ] TRV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:44.267667] [INFO ] [MAIN ] TRU: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:44.305447] [DEBUG] [LOCAL ] TRTX: Loaded 37400 existing records from primary storage. [2025-09-29T22:16:44.329090] [INFO ] [MAIN ] TRTX: Loaded 37400 primary data records. [2025-09-29T22:16:44.478053] [DEBUG] [LOCAL ] TRU: Loaded 51194 existing records from primary storage. [2025-09-29T22:16:44.490473] [DEBUG] [LOCAL ] TRV: Loaded 47907 existing records from primary storage. [2025-09-29T22:16:44.501246] [INFO ] [MAIN ] TRU: Loaded 51194 primary data records. [2025-09-29T22:16:44.506614] [INFO ] [MAIN ] TRV: Loaded 47907 primary data records. [2025-09-29T22:16:45.447760] [DEBUG] [MAIN ] TRTX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:45.448974] [INFO ] [MAIN ] TRTX: Generated 1794 derivative records from 37400 primary records. [2025-09-29T22:16:45.449185] [DEBUG] [LOCAL ] TRTX: Saving derivative data. [2025-09-29T22:16:45.483332] [DEBUG] [MAIN ] TRV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:45.483036] [DEBUG] [LOCAL ] TRTX: Derivative data saved (1794 records). [2025-09-29T22:16:45.484367] [INFO ] [MAIN ] TRTX: Successfully saved derivative data. [2025-09-29T22:16:45.486293] [INFO ] [MAIN ] Derivative Progress: 1831/2057 symbols completed. TRTX took 1.2s. Estimated remaining: 1m 32s. Rate: 147.4 symbols/min [2025-09-29T22:16:45.488869] [INFO ] [MAIN ] TS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:45.489105] [INFO ] [MAIN ] TRV: Generated 1794 derivative records from 47907 primary records. [2025-09-29T22:16:45.489269] [DEBUG] [LOCAL ] TRV: Saving derivative data. [2025-09-29T22:16:45.504124] [DEBUG] [MAIN ] TRU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:45.513494] [INFO ] [MAIN ] TRU: Generated 1794 derivative records from 51194 primary records. [2025-09-29T22:16:45.516512] [DEBUG] [LOCAL ] TRU: Saving derivative data. [2025-09-29T22:16:45.536098] [DEBUG] [LOCAL ] TRV: Derivative data saved (1794 records). [2025-09-29T22:16:45.536610] [INFO ] [MAIN ] TRV: Successfully saved derivative data. [2025-09-29T22:16:45.538909] [INFO ] [MAIN ] Derivative Progress: 1832/2057 symbols completed. TRV took 1.3s. Estimated remaining: 1m 32s. Rate: 147.5 symbols/min [2025-09-29T22:16:45.539519] [INFO ] [MAIN ] TSE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:45.541451] [DEBUG] [LOCAL ] TRU: Derivative data saved (1794 records). [2025-09-29T22:16:45.541531] [INFO ] [MAIN ] TRU: Successfully saved derivative data. [2025-09-29T22:16:45.543830] [INFO ] [MAIN ] Derivative Progress: 1833/2057 symbols completed. TRU took 1.3s. Estimated remaining: 1m 31s. Rate: 147.6 symbols/min [2025-09-29T22:16:45.544024] [INFO ] [MAIN ] TSI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:45.554323] [DEBUG] [LOCAL ] TSI: Loaded 7626 existing records from primary storage. [2025-09-29T22:16:45.554467] [INFO ] [MAIN ] TSI: Loaded 7626 primary data records. [2025-09-29T22:16:45.721972] [DEBUG] [LOCAL ] TSE: Loaded 28538 existing records from primary storage. [2025-09-29T22:16:45.728632] [INFO ] [MAIN ] TSE: Loaded 28538 primary data records. [2025-09-29T22:16:45.765379] [DEBUG] [LOCAL ] TS: Loaded 51664 existing records from primary storage. [2025-09-29T22:16:45.936127] [INFO ] [MAIN ] TS: Loaded 51664 primary data records. [2025-09-29T22:16:46.611135] [DEBUG] [MAIN ] TSI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:46.613125] [INFO ] [MAIN ] TSI: Generated 1794 derivative records from 7626 primary records. [2025-09-29T22:16:46.613477] [DEBUG] [LOCAL ] TSI: Saving derivative data. [2025-09-29T22:16:46.629185] [DEBUG] [LOCAL ] TSI: Derivative data saved (1794 records). [2025-09-29T22:16:46.629624] [INFO ] [MAIN ] TSI: Successfully saved derivative data. [2025-09-29T22:16:46.631484] [INFO ] [MAIN ] Derivative Progress: 1834/2057 symbols completed. TSI took 1.1s. Estimated remaining: 1m 31s. Rate: 147.4 symbols/min [2025-09-29T22:16:46.631806] [INFO ] [MAIN ] TSLX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:46.652611] [DEBUG] [MAIN ] TSE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:46.653569] [INFO ] [MAIN ] TSE: Generated 1794 derivative records from 28538 primary records. [2025-09-29T22:16:46.653842] [DEBUG] [LOCAL ] TSE: Saving derivative data. [2025-09-29T22:16:46.667107] [DEBUG] [MAIN ] TS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:46.668037] [INFO ] [MAIN ] TS: Generated 1794 derivative records from 51664 primary records. [2025-09-29T22:16:46.668382] [DEBUG] [LOCAL ] TS: Saving derivative data. [2025-09-29T22:16:46.692231] [DEBUG] [LOCAL ] TSE: Derivative data saved (1794 records). [2025-09-29T22:16:46.692517] [INFO ] [MAIN ] TSE: Successfully saved derivative data. [2025-09-29T22:16:46.707562] [INFO ] [MAIN ] Derivative Progress: 1835/2057 symbols completed. TSE took 1.2s. Estimated remaining: 1m 30s. Rate: 147.5 symbols/min [2025-09-29T22:16:46.708100] [INFO ] [MAIN ] TSM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:46.712375] [DEBUG] [LOCAL ] TS: Derivative data saved (1794 records). [2025-09-29T22:16:46.713192] [INFO ] [MAIN ] TS: Successfully saved derivative data. [2025-09-29T22:16:46.715341] [INFO ] [MAIN ] Derivative Progress: 1836/2057 symbols completed. TS took 1.2s. Estimated remaining: 1m 30s. Rate: 147.6 symbols/min [2025-09-29T22:16:46.725785] [INFO ] [MAIN ] TSN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:46.726975] [DEBUG] [LOCAL ] TSLX: Loaded 35148 existing records from primary storage. [2025-09-29T22:16:46.727263] [INFO ] [MAIN ] TSLX: Loaded 35148 primary data records. [2025-09-29T22:16:47.153435] [DEBUG] [LOCAL ] TSM: Loaded 53819 existing records from primary storage. [2025-09-29T22:16:47.154577] [INFO ] [MAIN ] TSM: Loaded 53819 primary data records. [2025-09-29T22:16:47.193966] [DEBUG] [LOCAL ] TSN: Loaded 52896 existing records from primary storage. [2025-09-29T22:16:47.222709] [INFO ] [MAIN ] TSN: Loaded 52896 primary data records. [2025-09-29T22:16:47.698488] [DEBUG] [MAIN ] TSLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:47.705816] [INFO ] [MAIN ] TSLX: Generated 1794 derivative records from 35148 primary records. [2025-09-29T22:16:47.824723] [DEBUG] [LOCAL ] TSLX: Saving derivative data. [2025-09-29T22:16:47.846506] [DEBUG] [LOCAL ] TSLX: Derivative data saved (1794 records). [2025-09-29T22:16:47.847325] [INFO ] [MAIN ] TSLX: Successfully saved derivative data. [2025-09-29T22:16:47.849856] [INFO ] [MAIN ] Derivative Progress: 1837/2057 symbols completed. TSLX took 1.2s. Estimated remaining: 1m 30s. Rate: 147.4 symbols/min [2025-09-29T22:16:47.850580] [INFO ] [MAIN ] TSQ: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:47.875210] [DEBUG] [MAIN ] TSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:47.876513] [INFO ] [MAIN ] TSM: Generated 1794 derivative records from 53819 primary records. [2025-09-29T22:16:47.881746] [DEBUG] [LOCAL ] TSQ: Loaded 12000 existing records from primary storage. [2025-09-29T22:16:47.882698] [DEBUG] [LOCAL ] TSM: Saving derivative data. [2025-09-29T22:16:47.883731] [INFO ] [MAIN ] TSQ: Loaded 12000 primary data records. [2025-09-29T22:16:47.982930] [DEBUG] [MAIN ] TSN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:47.999582] [DEBUG] [LOCAL ] TSM: Derivative data saved (1794 records). [2025-09-29T22:16:48.009992] [INFO ] [MAIN ] TSM: Successfully saved derivative data. [2025-09-29T22:16:48.031268] [INFO ] [MAIN ] Derivative Progress: 1838/2057 symbols completed. TSM took 1.3s. Estimated remaining: 1m 29s. Rate: 147.5 symbols/min [2025-09-29T22:16:48.017715] [INFO ] [MAIN ] TSN: Generated 1794 derivative records from 52896 primary records. [2025-09-29T22:16:48.031513] [INFO ] [MAIN ] TT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:48.031817] [DEBUG] [LOCAL ] TSN: Saving derivative data. [2025-09-29T22:16:48.272942] [DEBUG] [LOCAL ] TSN: Derivative data saved (1794 records). [2025-09-29T22:16:48.273686] [INFO ] [MAIN ] TSN: Successfully saved derivative data. [2025-09-29T22:16:48.276311] [INFO ] [MAIN ] Derivative Progress: 1839/2057 symbols completed. TSN took 1.6s. Estimated remaining: 1m 29s. Rate: 147.5 symbols/min [2025-09-29T22:16:48.277520] [INFO ] [MAIN ] TTC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:48.301696] [DEBUG] [MAIN ] TSQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:48.302384] [INFO ] [MAIN ] TSQ: Generated 1794 derivative records from 12000 primary records. [2025-09-29T22:16:48.302451] [DEBUG] [LOCAL ] TSQ: Saving derivative data. [2025-09-29T22:16:48.318795] [DEBUG] [LOCAL ] TSQ: Derivative data saved (1794 records). [2025-09-29T22:16:48.318920] [INFO ] [MAIN ] TSQ: Successfully saved derivative data. [2025-09-29T22:16:48.321077] [INFO ] [MAIN ] Derivative Progress: 1840/2057 symbols completed. TSQ took 0.5s. Estimated remaining: 1m 28s. Rate: 147.6 symbols/min [2025-09-29T22:16:48.321263] [INFO ] [MAIN ] TTE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:48.362576] [DEBUG] [LOCAL ] TT: Loaded 47762 existing records from primary storage. [2025-09-29T22:16:48.363529] [INFO ] [MAIN ] TT: Loaded 47762 primary data records. [2025-09-29T22:16:48.453233] [DEBUG] [LOCAL ] TTC: Loaded 42206 existing records from primary storage. [2025-09-29T22:16:48.458608] [INFO ] [MAIN ] TTC: Loaded 42206 primary data records. [2025-09-29T22:16:48.848542] [DEBUG] [LOCAL ] TTE: Loaded 51619 existing records from primary storage. [2025-09-29T22:16:48.860204] [INFO ] [MAIN ] TTE: Loaded 51619 primary data records. [2025-09-29T22:16:49.438512] [DEBUG] [MAIN ] TT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:49.440164] [INFO ] [MAIN ] TT: Generated 1794 derivative records from 47762 primary records. [2025-09-29T22:16:49.440399] [DEBUG] [LOCAL ] TT: Saving derivative data. [2025-09-29T22:16:49.472194] [DEBUG] [MAIN ] TTC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:49.473994] [INFO ] [MAIN ] TTC: Generated 1794 derivative records from 42206 primary records. [2025-09-29T22:16:49.474594] [DEBUG] [LOCAL ] TTC: Saving derivative data. [2025-09-29T22:16:49.477275] [DEBUG] [LOCAL ] TT: Derivative data saved (1794 records). [2025-09-29T22:16:49.484583] [INFO ] [MAIN ] TT: Successfully saved derivative data. [2025-09-29T22:16:49.490353] [INFO ] [MAIN ] Derivative Progress: 1841/2057 symbols completed. TT took 1.5s. Estimated remaining: 1m 28s. Rate: 147.4 symbols/min [2025-09-29T22:16:49.494236] [INFO ] [MAIN ] TTI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:49.495214] [DEBUG] [LOCAL ] TTC: Derivative data saved (1794 records). [2025-09-29T22:16:49.496763] [INFO ] [MAIN ] TTC: Successfully saved derivative data. [2025-09-29T22:16:49.498763] [INFO ] [MAIN ] Derivative Progress: 1842/2057 symbols completed. TTC took 1.2s. Estimated remaining: 1m 27s. Rate: 147.5 symbols/min [2025-09-29T22:16:49.501248] [INFO ] [MAIN ] TU: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:49.518016] [DEBUG] [MAIN ] TTE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:49.518884] [INFO ] [MAIN ] TTE: Generated 1794 derivative records from 51619 primary records. [2025-09-29T22:16:49.518976] [DEBUG] [LOCAL ] TTE: Saving derivative data. [2025-09-29T22:16:49.539696] [DEBUG] [LOCAL ] TTE: Derivative data saved (1794 records). [2025-09-29T22:16:49.539891] [INFO ] [MAIN ] TTE: Successfully saved derivative data. [2025-09-29T22:16:49.542599] [INFO ] [MAIN ] Derivative Progress: 1843/2057 symbols completed. TTE took 1.2s. Estimated remaining: 1m 27s. Rate: 147.6 symbols/min [2025-09-29T22:16:49.606867] [DEBUG] [LOCAL ] TU: Loaded 49845 existing records from primary storage. [2025-09-29T22:16:49.607065] [INFO ] [MAIN ] TU: Loaded 49845 primary data records. [2025-09-29T22:16:49.607800] [DEBUG] [LOCAL ] TTI: Loaded 45490 existing records from primary storage. [2025-09-29T22:16:49.639583] [INFO ] [MAIN ] TTI: Loaded 45490 primary data records. [2025-09-29T22:16:50.278467] [DEBUG] [MAIN ] TU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:50.278733] [DEBUG] [MAIN ] TTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:50.279709] [INFO ] [MAIN ] TTI: Generated 1794 derivative records from 45490 primary records. [2025-09-29T22:16:50.280499] [DEBUG] [LOCAL ] TTI: Saving derivative data. [2025-09-29T22:16:50.280425] [INFO ] [MAIN ] TU: Generated 1794 derivative records from 49845 primary records. [2025-09-29T22:16:50.288680] [DEBUG] [LOCAL ] TU: Saving derivative data. [2025-09-29T22:16:50.297570] [DEBUG] [LOCAL ] TTI: Derivative data saved (1794 records). [2025-09-29T22:16:50.298064] [INFO ] [MAIN ] TTI: Successfully saved derivative data. [2025-09-29T22:16:50.300006] [INFO ] [MAIN ] Derivative Progress: 1844/2057 symbols completed. TTI took 0.8s. Estimated remaining: 1m 27s. Rate: 147.5 symbols/min [2025-09-29T22:16:50.316473] [DEBUG] [LOCAL ] TU: Derivative data saved (1794 records). [2025-09-29T22:16:50.316600] [INFO ] [MAIN ] TU: Successfully saved derivative data. [2025-09-29T22:16:50.318720] [INFO ] [MAIN ] Derivative Progress: 1845/2057 symbols completed. TU took 0.8s. Estimated remaining: 1m 26s. Rate: 147.6 symbols/min [2025-09-29T22:16:50.319175] [INFO ] [MAIN ] TUYA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:50.319739] [INFO ] [MAIN ] TVC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:50.319666] [INFO ] [MAIN ] TV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:50.326180] [DEBUG] [LOCAL ] TVC: Loaded 3412 existing records from primary storage. [2025-09-29T22:16:50.326434] [INFO ] [MAIN ] TVC: Loaded 3412 primary data records. [2025-09-29T22:16:50.689879] [DEBUG] [LOCAL ] TV: Loaded 42765 existing records from primary storage. [2025-09-29T22:16:50.690878] [INFO ] [MAIN ] TV: Loaded 42765 primary data records. [2025-09-29T22:16:50.696899] [DEBUG] [LOCAL ] TUYA: Loaded 46346 existing records from primary storage. [2025-09-29T22:16:50.704895] [INFO ] [MAIN ] TUYA: Loaded 46346 primary data records. [2025-09-29T22:16:51.439833] [DEBUG] [MAIN ] TVC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:51.442935] [INFO ] [MAIN ] TVC: Generated 1794 derivative records from 3412 primary records. [2025-09-29T22:16:51.443472] [DEBUG] [LOCAL ] TVC: Saving derivative data. [2025-09-29T22:16:51.468969] [DEBUG] [LOCAL ] TVC: Derivative data saved (1794 records). [2025-09-29T22:16:51.469317] [INFO ] [MAIN ] TVC: Successfully saved derivative data. [2025-09-29T22:16:51.472271] [INFO ] [MAIN ] Derivative Progress: 1846/2057 symbols completed. TVC took 1.2s. Estimated remaining: 1m 26s. Rate: 147.5 symbols/min [2025-09-29T22:16:51.472630] [INFO ] [MAIN ] TVE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:51.480433] [DEBUG] [LOCAL ] TVE: Loaded 2753 existing records from primary storage. [2025-09-29T22:16:51.481200] [INFO ] [MAIN ] TVE: Loaded 2753 primary data records. [2025-09-29T22:16:51.629538] [DEBUG] [MAIN ] TUYA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:51.666626] [INFO ] [MAIN ] TUYA: Generated 1794 derivative records from 46346 primary records. [2025-09-29T22:16:51.666846] [DEBUG] [LOCAL ] TUYA: Saving derivative data. [2025-09-29T22:16:51.667338] [DEBUG] [MAIN ] TV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:51.697785] [INFO ] [MAIN ] TV: Generated 1794 derivative records from 42765 primary records. [2025-09-29T22:16:51.704618] [DEBUG] [LOCAL ] TV: Saving derivative data. [2025-09-29T22:16:51.872404] [DEBUG] [LOCAL ] TUYA: Derivative data saved (1794 records). [2025-09-29T22:16:51.883516] [INFO ] [MAIN ] TUYA: Successfully saved derivative data. [2025-09-29T22:16:51.886397] [INFO ] [MAIN ] Derivative Progress: 1847/2057 symbols completed. TUYA took 1.6s. Estimated remaining: 1m 25s. Rate: 147.5 symbols/min [2025-09-29T22:16:51.887278] [INFO ] [MAIN ] TWI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:51.897002] [DEBUG] [LOCAL ] TV: Derivative data saved (1794 records). [2025-09-29T22:16:51.897170] [INFO ] [MAIN ] TV: Successfully saved derivative data. [2025-09-29T22:16:51.901855] [INFO ] [MAIN ] Derivative Progress: 1848/2057 symbols completed. TV took 1.6s. Estimated remaining: 1m 25s. Rate: 147.5 symbols/min [2025-09-29T22:16:51.902218] [INFO ] [MAIN ] TWLO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:51.933148] [DEBUG] [MAIN ] TVE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:51.934049] [INFO ] [MAIN ] TVE: Generated 1794 derivative records from 2753 primary records. [2025-09-29T22:16:51.934152] [DEBUG] [LOCAL ] TVE: Saving derivative data. [2025-09-29T22:16:51.959092] [DEBUG] [LOCAL ] TVE: Derivative data saved (1794 records). [2025-09-29T22:16:51.959232] [INFO ] [MAIN ] TVE: Successfully saved derivative data. [2025-09-29T22:16:51.959850] [DEBUG] [LOCAL ] TWI: Loaded 34294 existing records from primary storage. [2025-09-29T22:16:51.961993] [INFO ] [MAIN ] Derivative Progress: 1849/2057 symbols completed. TVE took 0.5s. Estimated remaining: 1m 25s. Rate: 147.6 symbols/min [2025-09-29T22:16:51.962157] [INFO ] [MAIN ] TWN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:51.959978] [INFO ] [MAIN ] TWI: Loaded 34294 primary data records. [2025-09-29T22:16:52.066071] [DEBUG] [LOCAL ] TWN: Loaded 3153 existing records from primary storage. [2025-09-29T22:16:52.095561] [INFO ] [MAIN ] TWN: Loaded 3153 primary data records. [2025-09-29T22:16:52.246396] [DEBUG] [LOCAL ] TWLO: Loaded 52709 existing records from primary storage. [2025-09-29T22:16:52.384237] [INFO ] [MAIN ] TWLO: Loaded 52709 primary data records. [2025-09-29T22:16:53.013693] [DEBUG] [MAIN ] TWI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:53.015188] [INFO ] [MAIN ] TWI: Generated 1794 derivative records from 34294 primary records. [2025-09-29T22:16:53.016040] [DEBUG] [LOCAL ] TWI: Saving derivative data. [2025-09-29T22:16:53.049303] [DEBUG] [MAIN ] TWN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:53.052084] [INFO ] [MAIN ] TWN: Generated 1794 derivative records from 3153 primary records. [2025-09-29T22:16:53.052871] [DEBUG] [LOCAL ] TWN: Saving derivative data. [2025-09-29T22:16:53.063563] [DEBUG] [LOCAL ] TWI: Derivative data saved (1794 records). [2025-09-29T22:16:53.069707] [INFO ] [MAIN ] TWI: Successfully saved derivative data. [2025-09-29T22:16:53.072898] [INFO ] [MAIN ] Derivative Progress: 1850/2057 symbols completed. TWI took 1.2s. Estimated remaining: 1m 24s. Rate: 147.5 symbols/min [2025-09-29T22:16:53.074056] [INFO ] [MAIN ] TWO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:53.092276] [DEBUG] [LOCAL ] TWN: Derivative data saved (1794 records). [2025-09-29T22:16:53.091608] [DEBUG] [MAIN ] TWLO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:53.092562] [INFO ] [MAIN ] TWN: Successfully saved derivative data. [2025-09-29T22:16:53.093583] [INFO ] [MAIN ] TWLO: Generated 1794 derivative records from 52709 primary records. [2025-09-29T22:16:53.096104] [INFO ] [MAIN ] Derivative Progress: 1851/2057 symbols completed. TWN took 1.1s. Estimated remaining: 1m 24s. Rate: 147.5 symbols/min [2025-09-29T22:16:53.096598] [INFO ] [MAIN ] TX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:53.096897] [DEBUG] [LOCAL ] TWLO: Saving derivative data. [2025-09-29T22:16:53.118312] [DEBUG] [LOCAL ] TWLO: Derivative data saved (1794 records). [2025-09-29T22:16:53.118514] [INFO ] [MAIN ] TWLO: Successfully saved derivative data. [2025-09-29T22:16:53.121303] [INFO ] [MAIN ] Derivative Progress: 1852/2057 symbols completed. TWLO took 1.2s. Estimated remaining: 1m 23s. Rate: 147.6 symbols/min [2025-09-29T22:16:53.121704] [INFO ] [MAIN ] TXNM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:53.156746] [DEBUG] [LOCAL ] TX: Loaded 23300 existing records from primary storage. [2025-09-29T22:16:53.156966] [INFO ] [MAIN ] TX: Loaded 23300 primary data records. [2025-09-29T22:16:53.312407] [DEBUG] [LOCAL ] TWO: Loaded 48311 existing records from primary storage. [2025-09-29T22:16:53.313182] [INFO ] [MAIN ] TWO: Loaded 48311 primary data records. [2025-09-29T22:16:53.487250] [DEBUG] [LOCAL ] TXNM: Loaded 43630 existing records from primary storage. [2025-09-29T22:16:53.535218] [INFO ] [MAIN ] TXNM: Loaded 43630 primary data records. [2025-09-29T22:16:54.351377] [DEBUG] [MAIN ] TX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:54.354094] [INFO ] [MAIN ] TX: Generated 1794 derivative records from 23300 primary records. [2025-09-29T22:16:54.355410] [DEBUG] [LOCAL ] TX: Saving derivative data. [2025-09-29T22:16:54.390107] [DEBUG] [LOCAL ] TX: Derivative data saved (1794 records). [2025-09-29T22:16:54.390559] [INFO ] [MAIN ] TX: Successfully saved derivative data. [2025-09-29T22:16:54.393094] [DEBUG] [MAIN ] TWO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:54.392611] [INFO ] [MAIN ] Derivative Progress: 1853/2057 symbols completed. TX took 1.3s. Estimated remaining: 1m 23s. Rate: 147.4 symbols/min [2025-09-29T22:16:54.394512] [INFO ] [MAIN ] TWO: Generated 1794 derivative records from 48311 primary records. [2025-09-29T22:16:54.394732] [DEBUG] [LOCAL ] TWO: Saving derivative data. [2025-09-29T22:16:54.395761] [INFO ] [MAIN ] TXO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:54.429153] [DEBUG] [MAIN ] TXNM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:54.431695] [INFO ] [MAIN ] TXNM: Generated 1794 derivative records from 43630 primary records. [2025-09-29T22:16:54.436101] [DEBUG] [LOCAL ] TXNM: Saving derivative data. [2025-09-29T22:16:54.430882] [DEBUG] [LOCAL ] TWO: Derivative data saved (1794 records). [2025-09-29T22:16:54.436286] [INFO ] [MAIN ] TWO: Successfully saved derivative data. [2025-09-29T22:16:54.439115] [INFO ] [MAIN ] Derivative Progress: 1854/2057 symbols completed. TWO took 1.4s. Estimated remaining: 1m 23s. Rate: 147.5 symbols/min [2025-09-29T22:16:54.439424] [INFO ] [MAIN ] TXT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:54.459620] [DEBUG] [LOCAL ] TXO: Loaded 18852 existing records from primary storage. [2025-09-29T22:16:54.460406] [INFO ] [MAIN ] TXO: Loaded 18852 primary data records. [2025-09-29T22:16:54.576026] [DEBUG] [LOCAL ] TXNM: Derivative data saved (1794 records). [2025-09-29T22:16:54.579764] [INFO ] [MAIN ] TXNM: Successfully saved derivative data. [2025-09-29T22:16:54.582465] [INFO ] [MAIN ] Derivative Progress: 1855/2057 symbols completed. TXNM took 1.5s. Estimated remaining: 1m 22s. Rate: 147.6 symbols/min [2025-09-29T22:16:54.623322] [INFO ] [MAIN ] TY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:54.816718] [DEBUG] [LOCAL ] TXT: Loaded 49733 existing records from primary storage. [2025-09-29T22:16:54.817628] [INFO ] [MAIN ] TXT: Loaded 49733 primary data records. [2025-09-29T22:16:54.936387] [DEBUG] [LOCAL ] TY: Loaded 7581 existing records from primary storage. [2025-09-29T22:16:54.943686] [INFO ] [MAIN ] TY: Loaded 7581 primary data records. [2025-09-29T22:16:55.565327] [DEBUG] [MAIN ] TXO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:55.567701] [INFO ] [MAIN ] TXO: Generated 1794 derivative records from 18852 primary records. [2025-09-29T22:16:55.567915] [DEBUG] [LOCAL ] TXO: Saving derivative data. [2025-09-29T22:16:55.590551] [DEBUG] [LOCAL ] TXO: Derivative data saved (1794 records). [2025-09-29T22:16:55.591151] [INFO ] [MAIN ] TXO: Successfully saved derivative data. [2025-09-29T22:16:55.593564] [INFO ] [MAIN ] Derivative Progress: 1856/2057 symbols completed. TXO took 1.2s. Estimated remaining: 1m 22s. Rate: 147.4 symbols/min [2025-09-29T22:16:55.594061] [INFO ] [MAIN ] TYG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:55.613739] [DEBUG] [MAIN ] TXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:55.619092] [INFO ] [MAIN ] TXT: Generated 1794 derivative records from 49733 primary records. [2025-09-29T22:16:55.619752] [DEBUG] [LOCAL ] TXT: Saving derivative data. [2025-09-29T22:16:55.638495] [DEBUG] [LOCAL ] TYG: Loaded 14195 existing records from primary storage. [2025-09-29T22:16:55.639573] [INFO ] [MAIN ] TYG: Loaded 14195 primary data records. [2025-09-29T22:16:55.770511] [DEBUG] [LOCAL ] TXT: Derivative data saved (1794 records). [2025-09-29T22:16:55.771131] [DEBUG] [MAIN ] TY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:55.771884] [INFO ] [MAIN ] TXT: Successfully saved derivative data. [2025-09-29T22:16:55.788780] [INFO ] [MAIN ] TY: Generated 1794 derivative records from 7581 primary records. [2025-09-29T22:16:55.799338] [DEBUG] [LOCAL ] TY: Saving derivative data. [2025-09-29T22:16:55.821906] [INFO ] [MAIN ] Derivative Progress: 1857/2057 symbols completed. TXT took 1.4s. Estimated remaining: 1m 21s. Rate: 147.5 symbols/min [2025-09-29T22:16:55.855678] [INFO ] [MAIN ] TYL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:56.005183] [DEBUG] [LOCAL ] TY: Derivative data saved (1794 records). [2025-09-29T22:16:56.005680] [INFO ] [MAIN ] TY: Successfully saved derivative data. [2025-09-29T22:16:56.008121] [INFO ] [MAIN ] Derivative Progress: 1858/2057 symbols completed. TY took 1.4s. Estimated remaining: 1m 21s. Rate: 147.5 symbols/min [2025-09-29T22:16:56.019628] [DEBUG] [LOCAL ] TYL: Loaded 22172 existing records from primary storage. [2025-09-29T22:16:56.019828] [INFO ] [MAIN ] TYL: Loaded 22172 primary data records. [2025-09-29T22:16:56.201844] [DEBUG] [MAIN ] TYG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:56.225171] [INFO ] [MAIN ] TYG: Generated 1794 derivative records from 14195 primary records. [2025-09-29T22:16:56.336728] [DEBUG] [LOCAL ] TYG: Saving derivative data. [2025-09-29T22:16:56.367148] [DEBUG] [LOCAL ] TYG: Derivative data saved (1794 records). [2025-09-29T22:16:56.367619] [INFO ] [MAIN ] TYG: Successfully saved derivative data. [2025-09-29T22:16:56.369946] [INFO ] [MAIN ] Derivative Progress: 1859/2057 symbols completed. TYG took 0.8s. Estimated remaining: 1m 21s. Rate: 147.5 symbols/min [2025-09-29T22:16:56.392266] [DEBUG] [MAIN ] TYL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:56.393136] [INFO ] [MAIN ] TYL: Generated 1794 derivative records from 22172 primary records. [2025-09-29T22:16:56.393216] [DEBUG] [LOCAL ] TYL: Saving derivative data. [2025-09-29T22:16:56.410219] [DEBUG] [LOCAL ] TYL: Derivative data saved (1794 records). [2025-09-29T22:16:56.410299] [INFO ] [MAIN ] TYL: Successfully saved derivative data. [2025-09-29T22:16:56.412981] [INFO ] [MAIN ] Derivative Progress: 1860/2057 symbols completed. TYL took 0.6s. Estimated remaining: 1m 20s. Rate: 147.6 symbols/min [2025-09-29T22:16:56.413677] [INFO ] [MAIN ] UAN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:56.413576] [INFO ] [MAIN ] UBER: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:56.413476] [INFO ] [MAIN ] U: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:56.423246] [DEBUG] [LOCAL ] UAN: Loaded 5404 existing records from primary storage. [2025-09-29T22:16:56.423509] [INFO ] [MAIN ] UAN: Loaded 5404 primary data records. [2025-09-29T22:16:56.820186] [DEBUG] [LOCAL ] UBER: Loaded 53806 existing records from primary storage. [2025-09-29T22:16:56.821811] [INFO ] [MAIN ] UBER: Loaded 53806 primary data records. [2025-09-29T22:16:56.835525] [DEBUG] [LOCAL ] U: Loaded 53799 existing records from primary storage. [2025-09-29T22:16:56.862387] [INFO ] [MAIN ] U: Loaded 53799 primary data records. [2025-09-29T22:16:57.564848] [DEBUG] [MAIN ] UAN: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:16:57.567503] [INFO ] [MAIN ] UAN: Generated 1793 derivative records from 5404 primary records. [2025-09-29T22:16:57.567812] [DEBUG] [LOCAL ] UAN: Saving derivative data. [2025-09-29T22:16:57.588156] [DEBUG] [LOCAL ] UAN: Derivative data saved (1793 records). [2025-09-29T22:16:57.588759] [INFO ] [MAIN ] UAN: Successfully saved derivative data. [2025-09-29T22:16:57.591466] [INFO ] [MAIN ] Derivative Progress: 1861/2057 symbols completed. UAN took 1.2s. Estimated remaining: 1m 20s. Rate: 147.5 symbols/min [2025-09-29T22:16:57.592018] [INFO ] [MAIN ] UBS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:57.611509] [DEBUG] [MAIN ] UBER: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:57.614266] [INFO ] [MAIN ] UBER: Generated 1794 derivative records from 53806 primary records. [2025-09-29T22:16:57.614744] [DEBUG] [LOCAL ] UBER: Saving derivative data. [2025-09-29T22:16:57.644861] [DEBUG] [MAIN ] U: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:57.647064] [INFO ] [MAIN ] U: Generated 1794 derivative records from 53799 primary records. [2025-09-29T22:16:57.647271] [DEBUG] [LOCAL ] U: Saving derivative data. [2025-09-29T22:16:57.646154] [DEBUG] [LOCAL ] UBER: Derivative data saved (1794 records). [2025-09-29T22:16:57.647383] [INFO ] [MAIN ] UBER: Successfully saved derivative data. [2025-09-29T22:16:57.649800] [INFO ] [MAIN ] Derivative Progress: 1862/2057 symbols completed. UBER took 1.2s. Estimated remaining: 1m 19s. Rate: 147.5 symbols/min [2025-09-29T22:16:57.650307] [INFO ] [MAIN ] UCB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:57.671954] [DEBUG] [LOCAL ] U: Derivative data saved (1794 records). [2025-09-29T22:16:57.672132] [INFO ] [MAIN ] U: Successfully saved derivative data. [2025-09-29T22:16:57.675002] [INFO ] [MAIN ] Derivative Progress: 1863/2057 symbols completed. U took 1.3s. Estimated remaining: 1m 19s. Rate: 147.6 symbols/min [2025-09-29T22:16:57.675314] [INFO ] [MAIN ] UDR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:57.735436] [DEBUG] [LOCAL ] UBS: Loaded 52406 existing records from primary storage. [2025-09-29T22:16:57.735740] [INFO ] [MAIN ] UBS: Loaded 52406 primary data records. [2025-09-29T22:16:57.861127] [DEBUG] [LOCAL ] UCB: Loaded 37898 existing records from primary storage. [2025-09-29T22:16:57.872166] [INFO ] [MAIN ] UCB: Loaded 37898 primary data records. [2025-09-29T22:16:58.253841] [DEBUG] [LOCAL ] UDR: Loaded 51792 existing records from primary storage. [2025-09-29T22:16:58.275336] [INFO ] [MAIN ] UDR: Loaded 51792 primary data records. [2025-09-29T22:16:58.814508] [DEBUG] [MAIN ] UBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:58.815817] [INFO ] [MAIN ] UBS: Generated 1794 derivative records from 52406 primary records. [2025-09-29T22:16:58.816618] [DEBUG] [LOCAL ] UBS: Saving derivative data. [2025-09-29T22:16:58.835856] [DEBUG] [LOCAL ] UBS: Derivative data saved (1794 records). [2025-09-29T22:16:58.836126] [INFO ] [MAIN ] UBS: Successfully saved derivative data. [2025-09-29T22:16:58.838509] [INFO ] [MAIN ] Derivative Progress: 1864/2057 symbols completed. UBS took 1.2s. Estimated remaining: 1m 19s. Rate: 147.4 symbols/min [2025-09-29T22:16:58.839104] [INFO ] [MAIN ] UE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:58.857089] [DEBUG] [MAIN ] UCB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:58.858176] [INFO ] [MAIN ] UCB: Generated 1794 derivative records from 37898 primary records. [2025-09-29T22:16:58.858696] [DEBUG] [LOCAL ] UCB: Saving derivative data. [2025-09-29T22:16:58.890525] [DEBUG] [LOCAL ] UCB: Derivative data saved (1794 records). [2025-09-29T22:16:58.890847] [INFO ] [MAIN ] UCB: Successfully saved derivative data. [2025-09-29T22:16:58.893554] [INFO ] [MAIN ] Derivative Progress: 1865/2057 symbols completed. UCB took 1.2s. Estimated remaining: 1m 18s. Rate: 147.5 symbols/min [2025-09-29T22:16:58.894252] [DEBUG] [MAIN ] UDR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:16:58.895235] [INFO ] [MAIN ] UDR: Generated 1794 derivative records from 51792 primary records. [2025-09-29T22:16:58.895321] [DEBUG] [LOCAL ] UDR: Saving derivative data. [2025-09-29T22:16:58.893845] [INFO ] [MAIN ] UFI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:58.928816] [DEBUG] [LOCAL ] UFI: Loaded 8088 existing records from primary storage. [2025-09-29T22:16:58.929329] [INFO ] [MAIN ] UFI: Loaded 8088 primary data records. [2025-09-29T22:16:58.929388] [DEBUG] [LOCAL ] UDR: Derivative data saved (1794 records). [2025-09-29T22:16:58.941245] [INFO ] [MAIN ] UDR: Successfully saved derivative data. [2025-09-29T22:16:59.001052] [INFO ] [MAIN ] Derivative Progress: 1866/2057 symbols completed. UDR took 1.3s. Estimated remaining: 1m 18s. Rate: 147.6 symbols/min [2025-09-29T22:16:59.006397] [INFO ] [MAIN ] UGI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:16:59.075548] [DEBUG] [LOCAL ] UE: Loaded 42769 existing records from primary storage. [2025-09-29T22:16:59.100727] [INFO ] [MAIN ] UE: Loaded 42769 primary data records. [2025-09-29T22:16:59.508589] [DEBUG] [LOCAL ] UGI: Loaded 50508 existing records from primary storage. [2025-09-29T22:16:59.631505] [INFO ] [MAIN ] UGI: Loaded 50508 primary data records. [2025-09-29T22:16:59.935994] [DEBUG] [MAIN ] UFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:00.035132] [INFO ] [MAIN ] UFI: Generated 1794 derivative records from 8088 primary records. [2025-09-29T22:17:00.035685] [DEBUG] [LOCAL ] UFI: Saving derivative data. [2025-09-29T22:17:00.057635] [DEBUG] [LOCAL ] UFI: Derivative data saved (1794 records). [2025-09-29T22:17:00.058169] [INFO ] [MAIN ] UFI: Successfully saved derivative data. [2025-09-29T22:17:00.060596] [INFO ] [MAIN ] Derivative Progress: 1867/2057 symbols completed. UFI took 1.2s. Estimated remaining: 1m 17s. Rate: 147.4 symbols/min [2025-09-29T22:17:00.061669] [INFO ] [MAIN ] UGP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:00.076888] [DEBUG] [MAIN ] UE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:00.079166] [INFO ] [MAIN ] UE: Generated 1794 derivative records from 42769 primary records. [2025-09-29T22:17:00.079313] [DEBUG] [LOCAL ] UE: Saving derivative data. [2025-09-29T22:17:00.099390] [DEBUG] [LOCAL ] UE: Derivative data saved (1794 records). [2025-09-29T22:17:00.099909] [INFO ] [MAIN ] UE: Successfully saved derivative data. [2025-09-29T22:17:00.103474] [INFO ] [MAIN ] Derivative Progress: 1868/2057 symbols completed. UE took 1.3s. Estimated remaining: 1m 17s. Rate: 147.5 symbols/min [2025-09-29T22:17:00.104331] [INFO ] [MAIN ] UHAL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:00.132193] [DEBUG] [MAIN ] UGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:00.133151] [INFO ] [MAIN ] UGI: Generated 1794 derivative records from 50508 primary records. [2025-09-29T22:17:00.133219] [DEBUG] [LOCAL ] UGI: Saving derivative data. [2025-09-29T22:17:00.149595] [DEBUG] [LOCAL ] UGI: Derivative data saved (1794 records). [2025-09-29T22:17:00.149897] [INFO ] [MAIN ] UGI: Successfully saved derivative data. [2025-09-29T22:17:00.152124] [INFO ] [MAIN ] Derivative Progress: 1869/2057 symbols completed. UGI took 1.1s. Estimated remaining: 1m 16s. Rate: 147.6 symbols/min [2025-09-29T22:17:00.152415] [INFO ] [MAIN ] UHS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:00.173021] [DEBUG] [LOCAL ] UGP: Loaded 42809 existing records from primary storage. [2025-09-29T22:17:00.179787] [DEBUG] [LOCAL ] UHAL: Loaded 16542 existing records from primary storage. [2025-09-29T22:17:00.179950] [INFO ] [MAIN ] UHAL: Loaded 16542 primary data records. [2025-09-29T22:17:00.180067] [INFO ] [MAIN ] UGP: Loaded 42809 primary data records. [2025-09-29T22:17:00.886690] [DEBUG] [LOCAL ] UHS: Loaded 40961 existing records from primary storage. [2025-09-29T22:17:00.887110] [INFO ] [MAIN ] UHS: Loaded 40961 primary data records. [2025-09-29T22:17:01.241812] [DEBUG] [MAIN ] UGP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:01.245617] [INFO ] [MAIN ] UGP: Generated 1794 derivative records from 42809 primary records. [2025-09-29T22:17:01.245980] [DEBUG] [LOCAL ] UGP: Saving derivative data. [2025-09-29T22:17:01.272057] [DEBUG] [MAIN ] UHAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:01.276435] [INFO ] [MAIN ] UHAL: Generated 1794 derivative records from 16542 primary records. [2025-09-29T22:17:01.278377] [DEBUG] [LOCAL ] UGP: Derivative data saved (1794 records). [2025-09-29T22:17:01.278047] [DEBUG] [LOCAL ] UHAL: Saving derivative data. [2025-09-29T22:17:01.279488] [INFO ] [MAIN ] UGP: Successfully saved derivative data. [2025-09-29T22:17:01.281961] [INFO ] [MAIN ] Derivative Progress: 1870/2057 symbols completed. UGP took 1.2s. Estimated remaining: 1m 16s. Rate: 147.4 symbols/min [2025-09-29T22:17:01.293722] [INFO ] [MAIN ] UHT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:01.302039] [DEBUG] [LOCAL ] UHAL: Derivative data saved (1794 records). [2025-09-29T22:17:01.303698] [INFO ] [MAIN ] UHAL: Successfully saved derivative data. [2025-09-29T22:17:01.309732] [INFO ] [MAIN ] Derivative Progress: 1871/2057 symbols completed. UHAL took 1.2s. Estimated remaining: 1m 16s. Rate: 147.5 symbols/min [2025-09-29T22:17:01.311525] [INFO ] [MAIN ] UI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:01.336904] [DEBUG] [LOCAL ] UHT: Loaded 9973 existing records from primary storage. [2025-09-29T22:17:01.338956] [DEBUG] [MAIN ] UHS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:01.339112] [INFO ] [MAIN ] UHT: Loaded 9973 primary data records. [2025-09-29T22:17:01.367766] [INFO ] [MAIN ] UHS: Generated 1794 derivative records from 40961 primary records. [2025-09-29T22:17:01.395912] [DEBUG] [LOCAL ] UHS: Saving derivative data. [2025-09-29T22:17:01.466207] [DEBUG] [LOCAL ] UI: Loaded 12807 existing records from primary storage. [2025-09-29T22:17:01.483103] [INFO ] [MAIN ] UI: Loaded 12807 primary data records. [2025-09-29T22:17:01.667059] [DEBUG] [LOCAL ] UHS: Derivative data saved (1794 records). [2025-09-29T22:17:01.679763] [INFO ] [MAIN ] UHS: Successfully saved derivative data. [2025-09-29T22:17:01.684761] [INFO ] [MAIN ] Derivative Progress: 1872/2057 symbols completed. UHS took 1.5s. Estimated remaining: 1m 15s. Rate: 147.5 symbols/min [2025-09-29T22:17:01.684949] [INFO ] [MAIN ] UIS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:02.137988] [DEBUG] [LOCAL ] UIS: Loaded 36931 existing records from primary storage. [2025-09-29T22:17:02.138393] [INFO ] [MAIN ] UIS: Loaded 36931 primary data records. [2025-09-29T22:17:02.199859] [DEBUG] [MAIN ] UHT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:02.229373] [INFO ] [MAIN ] UHT: Generated 1794 derivative records from 9973 primary records. [2025-09-29T22:17:02.255598] [DEBUG] [LOCAL ] UHT: Saving derivative data. [2025-09-29T22:17:02.479591] [DEBUG] [MAIN ] UI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:02.506028] [INFO ] [MAIN ] UI: Generated 1794 derivative records from 12807 primary records. [2025-09-29T22:17:02.520234] [DEBUG] [LOCAL ] UI: Saving derivative data. [2025-09-29T22:17:02.543199] [DEBUG] [LOCAL ] UHT: Derivative data saved (1794 records). [2025-09-29T22:17:02.543812] [INFO ] [MAIN ] UHT: Successfully saved derivative data. [2025-09-29T22:17:02.546149] [INFO ] [MAIN ] Derivative Progress: 1873/2057 symbols completed. UHT took 1.3s. Estimated remaining: 1m 15s. Rate: 147.4 symbols/min [2025-09-29T22:17:02.547378] [DEBUG] [LOCAL ] UI: Derivative data saved (1794 records). [2025-09-29T22:17:02.547853] [INFO ] [MAIN ] UI: Successfully saved derivative data. [2025-09-29T22:17:02.550294] [INFO ] [MAIN ] Derivative Progress: 1874/2057 symbols completed. UI took 1.2s. Estimated remaining: 1m 14s. Rate: 147.5 symbols/min [2025-09-29T22:17:02.572143] [DEBUG] [MAIN ] UIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:02.572867] [INFO ] [MAIN ] UIS: Generated 1794 derivative records from 36931 primary records. [2025-09-29T22:17:02.572972] [DEBUG] [LOCAL ] UIS: Saving derivative data. [2025-09-29T22:17:02.589032] [DEBUG] [LOCAL ] UIS: Derivative data saved (1794 records). [2025-09-29T22:17:02.589115] [INFO ] [MAIN ] UIS: Successfully saved derivative data. [2025-09-29T22:17:02.591624] [INFO ] [MAIN ] Derivative Progress: 1875/2057 symbols completed. UIS took 0.9s. Estimated remaining: 1m 14s. Rate: 147.6 symbols/min [2025-09-29T22:17:02.592088] [INFO ] [MAIN ] UL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:02.592518] [INFO ] [MAIN ] UMC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:02.593986] [INFO ] [MAIN ] ULS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:02.673953] [DEBUG] [LOCAL ] UL: Loaded 53060 existing records from primary storage. [2025-09-29T22:17:02.674686] [INFO ] [MAIN ] UL: Loaded 53060 primary data records. [2025-09-29T22:17:02.770762] [DEBUG] [LOCAL ] ULS: Loaded 39257 existing records from primary storage. [2025-09-29T22:17:02.810796] [INFO ] [MAIN ] ULS: Loaded 39257 primary data records. [2025-09-29T22:17:02.816500] [DEBUG] [LOCAL ] UMC: Loaded 52708 existing records from primary storage. [2025-09-29T22:17:02.816882] [INFO ] [MAIN ] UMC: Loaded 52708 primary data records. [2025-09-29T22:17:03.751044] [DEBUG] [MAIN ] UL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:03.752122] [INFO ] [MAIN ] UL: Generated 1794 derivative records from 53060 primary records. [2025-09-29T22:17:03.752260] [DEBUG] [LOCAL ] UL: Saving derivative data. [2025-09-29T22:17:03.791544] [DEBUG] [MAIN ] UMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:03.794072] [INFO ] [MAIN ] UMC: Generated 1794 derivative records from 52708 primary records. [2025-09-29T22:17:03.794546] [DEBUG] [LOCAL ] UMC: Saving derivative data. [2025-09-29T22:17:03.795539] [DEBUG] [LOCAL ] UL: Derivative data saved (1794 records). [2025-09-29T22:17:03.797226] [INFO ] [MAIN ] UL: Successfully saved derivative data. [2025-09-29T22:17:03.801011] [INFO ] [MAIN ] Derivative Progress: 1876/2057 symbols completed. UL took 1.2s. Estimated remaining: 1m 14s. Rate: 147.4 symbols/min [2025-09-29T22:17:03.808639] [INFO ] [MAIN ] UMH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:03.834188] [DEBUG] [MAIN ] ULS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:03.836031] [DEBUG] [LOCAL ] UMC: Derivative data saved (1794 records). [2025-09-29T22:17:03.836970] [INFO ] [MAIN ] ULS: Generated 1794 derivative records from 39257 primary records. [2025-09-29T22:17:03.837197] [INFO ] [MAIN ] UMC: Successfully saved derivative data. [2025-09-29T22:17:03.837323] [DEBUG] [LOCAL ] ULS: Saving derivative data. [2025-09-29T22:17:03.840132] [INFO ] [MAIN ] Derivative Progress: 1877/2057 symbols completed. UMC took 1.2s. Estimated remaining: 1m 13s. Rate: 147.5 symbols/min [2025-09-29T22:17:03.840805] [INFO ] [MAIN ] UNF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:03.866147] [DEBUG] [LOCAL ] ULS: Derivative data saved (1794 records). [2025-09-29T22:17:03.875553] [INFO ] [MAIN ] ULS: Successfully saved derivative data. [2025-09-29T22:17:03.878905] [INFO ] [MAIN ] Derivative Progress: 1878/2057 symbols completed. ULS took 1.3s. Estimated remaining: 1m 13s. Rate: 147.6 symbols/min [2025-09-29T22:17:03.884720] [INFO ] [MAIN ] UNFI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:03.885779] [DEBUG] [LOCAL ] UNF: Loaded 11964 existing records from primary storage. [2025-09-29T22:17:03.885869] [INFO ] [MAIN ] UNF: Loaded 11964 primary data records. [2025-09-29T22:17:03.999512] [DEBUG] [LOCAL ] UMH: Loaded 33623 existing records from primary storage. [2025-09-29T22:17:04.011374] [INFO ] [MAIN ] UMH: Loaded 33623 primary data records. [2025-09-29T22:17:04.416029] [DEBUG] [LOCAL ] UNFI: Loaded 41830 existing records from primary storage. [2025-09-29T22:17:04.432760] [INFO ] [MAIN ] UNFI: Loaded 41830 primary data records. [2025-09-29T22:17:04.969875] [DEBUG] [MAIN ] UNF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:04.971379] [INFO ] [MAIN ] UNF: Generated 1794 derivative records from 11964 primary records. [2025-09-29T22:17:04.971714] [DEBUG] [LOCAL ] UNF: Saving derivative data. [2025-09-29T22:17:04.995473] [DEBUG] [LOCAL ] UNF: Derivative data saved (1794 records). [2025-09-29T22:17:04.996080] [INFO ] [MAIN ] UNF: Successfully saved derivative data. [2025-09-29T22:17:04.998299] [INFO ] [MAIN ] Derivative Progress: 1879/2057 symbols completed. UNF took 1.2s. Estimated remaining: 1m 12s. Rate: 147.4 symbols/min [2025-09-29T22:17:05.006787] [INFO ] [MAIN ] UNH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:05.015429] [DEBUG] [MAIN ] UMH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:05.016897] [INFO ] [MAIN ] UMH: Generated 1794 derivative records from 33623 primary records. [2025-09-29T22:17:05.017229] [DEBUG] [LOCAL ] UMH: Saving derivative data. [2025-09-29T22:17:05.040853] [DEBUG] [LOCAL ] UMH: Derivative data saved (1794 records). [2025-09-29T22:17:05.041291] [INFO ] [MAIN ] UMH: Successfully saved derivative data. [2025-09-29T22:17:05.043755] [INFO ] [MAIN ] Derivative Progress: 1880/2057 symbols completed. UMH took 1.2s. Estimated remaining: 1m 12s. Rate: 147.5 symbols/min [2025-09-29T22:17:05.057831] [INFO ] [MAIN ] UNM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:05.058619] [DEBUG] [MAIN ] UNFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:05.059416] [INFO ] [MAIN ] UNFI: Generated 1794 derivative records from 41830 primary records. [2025-09-29T22:17:05.059484] [DEBUG] [LOCAL ] UNFI: Saving derivative data. [2025-09-29T22:17:05.077075] [DEBUG] [LOCAL ] UNFI: Derivative data saved (1794 records). [2025-09-29T22:17:05.077149] [INFO ] [MAIN ] UNFI: Successfully saved derivative data. [2025-09-29T22:17:05.079614] [INFO ] [MAIN ] Derivative Progress: 1881/2057 symbols completed. UNFI took 1.2s. Estimated remaining: 1m 12s. Rate: 147.6 symbols/min [2025-09-29T22:17:05.079786] [INFO ] [MAIN ] UNMA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:05.087331] [DEBUG] [LOCAL ] UNMA: Loaded 3529 existing records from primary storage. [2025-09-29T22:17:05.087516] [INFO ] [MAIN ] UNMA: Loaded 3529 primary data records. [2025-09-29T22:17:05.247758] [DEBUG] [LOCAL ] UNH: Loaded 53794 existing records from primary storage. [2025-09-29T22:17:05.253714] [INFO ] [MAIN ] UNH: Loaded 53794 primary data records. [2025-09-29T22:17:05.320365] [DEBUG] [LOCAL ] UNM: Loaded 48581 existing records from primary storage. [2025-09-29T22:17:05.386977] [INFO ] [MAIN ] UNM: Loaded 48581 primary data records. [2025-09-29T22:17:06.158758] [DEBUG] [MAIN ] UNMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:06.159894] [INFO ] [MAIN ] UNMA: Generated 1794 derivative records from 3529 primary records. [2025-09-29T22:17:06.160468] [DEBUG] [LOCAL ] UNMA: Saving derivative data. [2025-09-29T22:17:06.180125] [DEBUG] [LOCAL ] UNMA: Derivative data saved (1794 records). [2025-09-29T22:17:06.194551] [INFO ] [MAIN ] UNMA: Successfully saved derivative data. [2025-09-29T22:17:06.195073] [DEBUG] [MAIN ] UNH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:06.197100] [INFO ] [MAIN ] Derivative Progress: 1882/2057 symbols completed. UNMA took 1.1s. Estimated remaining: 1m 11s. Rate: 147.4 symbols/min [2025-09-29T22:17:06.198330] [INFO ] [MAIN ] UNH: Generated 1794 derivative records from 53794 primary records. [2025-09-29T22:17:06.198431] [INFO ] [MAIN ] UNP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:06.198971] [DEBUG] [LOCAL ] UNH: Saving derivative data. [2025-09-29T22:17:06.221743] [DEBUG] [LOCAL ] UNH: Derivative data saved (1794 records). [2025-09-29T22:17:06.221975] [INFO ] [MAIN ] UNH: Successfully saved derivative data. [2025-09-29T22:17:06.224336] [INFO ] [MAIN ] Derivative Progress: 1883/2057 symbols completed. UNH took 1.2s. Estimated remaining: 1m 11s. Rate: 147.5 symbols/min [2025-09-29T22:17:06.224597] [INFO ] [MAIN ] UP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:06.238999] [DEBUG] [MAIN ] UNM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:06.239665] [INFO ] [MAIN ] UNM: Generated 1794 derivative records from 48581 primary records. [2025-09-29T22:17:06.239768] [DEBUG] [LOCAL ] UNM: Saving derivative data. [2025-09-29T22:17:06.257457] [DEBUG] [LOCAL ] UNM: Derivative data saved (1794 records). [2025-09-29T22:17:06.257822] [INFO ] [MAIN ] UNM: Successfully saved derivative data. [2025-09-29T22:17:06.260071] [INFO ] [MAIN ] Derivative Progress: 1884/2057 symbols completed. UNM took 1.2s. Estimated remaining: 1m 10s. Rate: 147.6 symbols/min [2025-09-29T22:17:06.260294] [INFO ] [MAIN ] UPS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:06.324723] [DEBUG] [LOCAL ] UNP: Loaded 53265 existing records from primary storage. [2025-09-29T22:17:06.325468] [DEBUG] [LOCAL ] UP: Loaded 43110 existing records from primary storage. [2025-09-29T22:17:06.325576] [INFO ] [MAIN ] UNP: Loaded 53265 primary data records. [2025-09-29T22:17:06.325786] [INFO ] [MAIN ] UP: Loaded 43110 primary data records. [2025-09-29T22:17:06.588232] [DEBUG] [LOCAL ] UPS: Loaded 53711 existing records from primary storage. [2025-09-29T22:17:06.612577] [INFO ] [MAIN ] UPS: Loaded 53711 primary data records. [2025-09-29T22:17:07.404210] [DEBUG] [MAIN ] UP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:07.410831] [INFO ] [MAIN ] UP: Generated 1794 derivative records from 43110 primary records. [2025-09-29T22:17:07.411318] [DEBUG] [LOCAL ] UP: Saving derivative data. [2025-09-29T22:17:07.411241] [DEBUG] [MAIN ] UNP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:07.414090] [INFO ] [MAIN ] UNP: Generated 1794 derivative records from 53265 primary records. [2025-09-29T22:17:07.414210] [DEBUG] [LOCAL ] UNP: Saving derivative data. [2025-09-29T22:17:07.456984] [DEBUG] [LOCAL ] UP: Derivative data saved (1794 records). [2025-09-29T22:17:07.457511] [DEBUG] [MAIN ] UPS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:07.457666] [INFO ] [MAIN ] UP: Successfully saved derivative data. [2025-09-29T22:17:07.459517] [INFO ] [MAIN ] Derivative Progress: 1885/2057 symbols completed. UP took 1.2s. Estimated remaining: 1m 10s. Rate: 147.4 symbols/min [2025-09-29T22:17:07.460628] [INFO ] [MAIN ] UPS: Generated 1794 derivative records from 53711 primary records. [2025-09-29T22:17:07.460789] [INFO ] [MAIN ] URI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:07.460971] [DEBUG] [LOCAL ] UPS: Saving derivative data. [2025-09-29T22:17:07.480876] [DEBUG] [LOCAL ] UPS: Derivative data saved (1794 records). [2025-09-29T22:17:07.481630] [INFO ] [MAIN ] UPS: Successfully saved derivative data. [2025-09-29T22:17:07.484186] [INFO ] [MAIN ] Derivative Progress: 1886/2057 symbols completed. UPS took 1.2s. Estimated remaining: 1m 10s. Rate: 147.5 symbols/min [2025-09-29T22:17:07.485121] [INFO ] [MAIN ] USA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:07.486018] [DEBUG] [LOCAL ] UNP: Derivative data saved (1794 records). [2025-09-29T22:17:07.486273] [INFO ] [MAIN ] UNP: Successfully saved derivative data. [2025-09-29T22:17:07.488674] [INFO ] [MAIN ] Derivative Progress: 1887/2057 symbols completed. UNP took 1.3s. Estimated remaining: 1m 9s. Rate: 147.6 symbols/min [2025-09-29T22:17:07.489334] [INFO ] [MAIN ] USAC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:07.544076] [DEBUG] [LOCAL ] URI: Loaded 35898 existing records from primary storage. [2025-09-29T22:17:07.551714] [INFO ] [MAIN ] URI: Loaded 35898 primary data records. [2025-09-29T22:17:07.552597] [DEBUG] [LOCAL ] USA: Loaded 35934 existing records from primary storage. [2025-09-29T22:17:07.587073] [INFO ] [MAIN ] USA: Loaded 35934 primary data records. [2025-09-29T22:17:07.688869] [DEBUG] [LOCAL ] USAC: Loaded 22553 existing records from primary storage. [2025-09-29T22:17:07.724782] [INFO ] [MAIN ] USAC: Loaded 22553 primary data records. [2025-09-29T22:17:08.750533] [DEBUG] [MAIN ] URI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:08.766252] [INFO ] [MAIN ] URI: Generated 1794 derivative records from 35898 primary records. [2025-09-29T22:17:08.766576] [DEBUG] [MAIN ] USAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:08.767537] [INFO ] [MAIN ] USAC: Generated 1794 derivative records from 22553 primary records. [2025-09-29T22:17:08.766700] [DEBUG] [LOCAL ] URI: Saving derivative data. [2025-09-29T22:17:08.768106] [DEBUG] [LOCAL ] USAC: Saving derivative data. [2025-09-29T22:17:08.803919] [DEBUG] [LOCAL ] URI: Derivative data saved (1794 records). [2025-09-29T22:17:08.806507] [INFO ] [MAIN ] URI: Successfully saved derivative data. [2025-09-29T22:17:08.806286] [DEBUG] [LOCAL ] USAC: Derivative data saved (1794 records). [2025-09-29T22:17:08.806675] [INFO ] [MAIN ] USAC: Successfully saved derivative data. [2025-09-29T22:17:08.808667] [INFO ] [MAIN ] Derivative Progress: 1888/2057 symbols completed. URI took 1.3s. Estimated remaining: 1m 9s. Rate: 147.4 symbols/min [2025-09-29T22:17:08.811328] [INFO ] [MAIN ] Derivative Progress: 1889/2057 symbols completed. USAC took 1.3s. Estimated remaining: 1m 8s. Rate: 147.5 symbols/min [2025-09-29T22:17:08.825520] [DEBUG] [MAIN ] USA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:08.826270] [INFO ] [MAIN ] USA: Generated 1794 derivative records from 35934 primary records. [2025-09-29T22:17:08.826337] [DEBUG] [LOCAL ] USA: Saving derivative data. [2025-09-29T22:17:08.842776] [DEBUG] [LOCAL ] USA: Derivative data saved (1794 records). [2025-09-29T22:17:08.842868] [INFO ] [MAIN ] USA: Successfully saved derivative data. [2025-09-29T22:17:08.845551] [INFO ] [MAIN ] Derivative Progress: 1890/2057 symbols completed. USA took 1.4s. Estimated remaining: 1m 8s. Rate: 147.6 symbols/min [2025-09-29T22:17:08.846264] [INFO ] [MAIN ] USFD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:08.846417] [INFO ] [MAIN ] USNA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:08.846185] [INFO ] [MAIN ] USB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:08.872762] [DEBUG] [LOCAL ] USNA: Loaded 17984 existing records from primary storage. [2025-09-29T22:17:08.873106] [INFO ] [MAIN ] USNA: Loaded 17984 primary data records. [2025-09-29T22:17:09.187211] [DEBUG] [LOCAL ] USFD: Loaded 51182 existing records from primary storage. [2025-09-29T22:17:09.263868] [INFO ] [MAIN ] USFD: Loaded 51182 primary data records. [2025-09-29T22:17:09.278563] [DEBUG] [LOCAL ] USB: Loaded 53688 existing records from primary storage. [2025-09-29T22:17:09.301548] [INFO ] [MAIN ] USB: Loaded 53688 primary data records. [2025-09-29T22:17:09.983911] [DEBUG] [MAIN ] USNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:09.987292] [INFO ] [MAIN ] USNA: Generated 1794 derivative records from 17984 primary records. [2025-09-29T22:17:09.987504] [DEBUG] [LOCAL ] USNA: Saving derivative data. [2025-09-29T22:17:10.010759] [DEBUG] [LOCAL ] USNA: Derivative data saved (1794 records). [2025-09-29T22:17:10.011941] [INFO ] [MAIN ] USNA: Successfully saved derivative data. [2025-09-29T22:17:10.014255] [INFO ] [MAIN ] Derivative Progress: 1891/2057 symbols completed. USNA took 1.2s. Estimated remaining: 1m 8s. Rate: 147.4 symbols/min [2025-09-29T22:17:10.015671] [INFO ] [MAIN ] USPH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:10.032789] [DEBUG] [MAIN ] USFD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:10.033801] [INFO ] [MAIN ] USFD: Generated 1794 derivative records from 51182 primary records. [2025-09-29T22:17:10.033915] [DEBUG] [LOCAL ] USFD: Saving derivative data. [2025-09-29T22:17:10.071634] [DEBUG] [MAIN ] USB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:10.073027] [INFO ] [MAIN ] USB: Generated 1794 derivative records from 53688 primary records. [2025-09-29T22:17:10.073962] [DEBUG] [LOCAL ] USB: Saving derivative data. [2025-09-29T22:17:10.084072] [DEBUG] [LOCAL ] USPH: Loaded 16571 existing records from primary storage. [2025-09-29T22:17:10.083018] [DEBUG] [LOCAL ] USFD: Derivative data saved (1794 records). [2025-09-29T22:17:10.084418] [INFO ] [MAIN ] USFD: Successfully saved derivative data. [2025-09-29T22:17:10.084548] [INFO ] [MAIN ] USPH: Loaded 16571 primary data records. [2025-09-29T22:17:10.087273] [INFO ] [MAIN ] Derivative Progress: 1892/2057 symbols completed. USFD took 1.2s. Estimated remaining: 1m 7s. Rate: 147.5 symbols/min [2025-09-29T22:17:10.100122] [INFO ] [MAIN ] UTF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:10.289609] [DEBUG] [LOCAL ] USB: Derivative data saved (1794 records). [2025-09-29T22:17:10.293693] [INFO ] [MAIN ] USB: Successfully saved derivative data. [2025-09-29T22:17:10.297290] [INFO ] [MAIN ] Derivative Progress: 1893/2057 symbols completed. USB took 1.5s. Estimated remaining: 1m 7s. Rate: 147.5 symbols/min [2025-09-29T22:17:10.322873] [INFO ] [MAIN ] UTI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:10.455574] [DEBUG] [LOCAL ] UTF: Loaded 28893 existing records from primary storage. [2025-09-29T22:17:10.455974] [INFO ] [MAIN ] UTF: Loaded 28893 primary data records. [2025-09-29T22:17:10.685895] [DEBUG] [LOCAL ] UTI: Loaded 40490 existing records from primary storage. [2025-09-29T22:17:10.842877] [INFO ] [MAIN ] UTI: Loaded 40490 primary data records. [2025-09-29T22:17:11.023199] [DEBUG] [MAIN ] USPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:11.052912] [INFO ] [MAIN ] USPH: Generated 1794 derivative records from 16571 primary records. [2025-09-29T22:17:11.089091] [DEBUG] [LOCAL ] USPH: Saving derivative data. [2025-09-29T22:17:11.237717] [DEBUG] [LOCAL ] USPH: Derivative data saved (1794 records). [2025-09-29T22:17:11.237911] [INFO ] [MAIN ] USPH: Successfully saved derivative data. [2025-09-29T22:17:11.240067] [INFO ] [MAIN ] Derivative Progress: 1894/2057 symbols completed. USPH took 1.2s. Estimated remaining: 1m 6s. Rate: 147.4 symbols/min [2025-09-29T22:17:11.240497] [INFO ] [MAIN ] UTL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:11.256101] [DEBUG] [MAIN ] UTF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:11.256891] [INFO ] [MAIN ] UTF: Generated 1794 derivative records from 28893 primary records. [2025-09-29T22:17:11.256976] [DEBUG] [LOCAL ] UTF: Saving derivative data. [2025-09-29T22:17:11.284804] [DEBUG] [LOCAL ] UTL: Loaded 11195 existing records from primary storage. [2025-09-29T22:17:11.285469] [DEBUG] [LOCAL ] UTF: Derivative data saved (1794 records). [2025-09-29T22:17:11.286315] [INFO ] [MAIN ] UTF: Successfully saved derivative data. [2025-09-29T22:17:11.286809] [INFO ] [MAIN ] UTL: Loaded 11195 primary data records. [2025-09-29T22:17:11.289175] [INFO ] [MAIN ] Derivative Progress: 1895/2057 symbols completed. UTF took 1.2s. Estimated remaining: 1m 6s. Rate: 147.5 symbols/min [2025-09-29T22:17:11.322292] [INFO ] [MAIN ] UTZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:11.417178] [DEBUG] [MAIN ] UTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:11.428833] [INFO ] [MAIN ] UTI: Generated 1794 derivative records from 40490 primary records. [2025-09-29T22:17:11.454202] [DEBUG] [LOCAL ] UTI: Saving derivative data. [2025-09-29T22:17:11.650185] [DEBUG] [LOCAL ] UTI: Derivative data saved (1794 records). [2025-09-29T22:17:11.650665] [INFO ] [MAIN ] UTI: Successfully saved derivative data. [2025-09-29T22:17:11.653108] [INFO ] [MAIN ] Derivative Progress: 1896/2057 symbols completed. UTI took 1.3s. Estimated remaining: 1m 5s. Rate: 147.5 symbols/min [2025-09-29T22:17:11.653461] [INFO ] [MAIN ] UVE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:11.671058] [DEBUG] [LOCAL ] UTZ: Loaded 44683 existing records from primary storage. [2025-09-29T22:17:11.671310] [INFO ] [MAIN ] UTZ: Loaded 44683 primary data records. [2025-09-29T22:17:11.809201] [DEBUG] [LOCAL ] UVE: Loaded 21806 existing records from primary storage. [2025-09-29T22:17:11.809473] [INFO ] [MAIN ] UVE: Loaded 21806 primary data records. [2025-09-29T22:17:12.164901] [DEBUG] [MAIN ] UTL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:12.182541] [INFO ] [MAIN ] UTL: Generated 1794 derivative records from 11195 primary records. [2025-09-29T22:17:12.193213] [DEBUG] [LOCAL ] UTL: Saving derivative data. [2025-09-29T22:17:12.406810] [DEBUG] [LOCAL ] UTL: Derivative data saved (1794 records). [2025-09-29T22:17:12.407587] [INFO ] [MAIN ] UTL: Successfully saved derivative data. [2025-09-29T22:17:12.410292] [INFO ] [MAIN ] Derivative Progress: 1897/2057 symbols completed. UTL took 1.2s. Estimated remaining: 1m 5s. Rate: 147.4 symbols/min [2025-09-29T22:17:12.411400] [INFO ] [MAIN ] UVV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:12.432301] [DEBUG] [MAIN ] UTZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:12.433763] [INFO ] [MAIN ] UTZ: Generated 1794 derivative records from 44683 primary records. [2025-09-29T22:17:12.433902] [DEBUG] [LOCAL ] UTZ: Saving derivative data. [2025-09-29T22:17:12.476127] [DEBUG] [LOCAL ] UTZ: Derivative data saved (1794 records). [2025-09-29T22:17:12.476288] [INFO ] [MAIN ] UTZ: Successfully saved derivative data. [2025-09-29T22:17:12.478607] [INFO ] [MAIN ] Derivative Progress: 1898/2057 symbols completed. UTZ took 1.2s. Estimated remaining: 1m 5s. Rate: 147.5 symbols/min [2025-09-29T22:17:12.479879] [DEBUG] [MAIN ] UVE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:12.480804] [INFO ] [MAIN ] UVE: Generated 1794 derivative records from 21806 primary records. [2025-09-29T22:17:12.479455] [INFO ] [MAIN ] UWMC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:12.501218] [DEBUG] [LOCAL ] UVE: Saving derivative data. [2025-09-29T22:17:12.504032] [DEBUG] [LOCAL ] UVV: Loaded 22450 existing records from primary storage. [2025-09-29T22:17:12.505314] [INFO ] [MAIN ] UVV: Loaded 22450 primary data records. [2025-09-29T22:17:12.654337] [DEBUG] [LOCAL ] UVE: Derivative data saved (1794 records). [2025-09-29T22:17:12.654542] [INFO ] [MAIN ] UVE: Successfully saved derivative data. [2025-09-29T22:17:12.657327] [INFO ] [MAIN ] Derivative Progress: 1899/2057 symbols completed. UVE took 1.0s. Estimated remaining: 1m 4s. Rate: 147.5 symbols/min [2025-09-29T22:17:12.668766] [INFO ] [MAIN ] UZD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:12.915734] [DEBUG] [LOCAL ] UZD: Loaded 6366 existing records from primary storage. [2025-09-29T22:17:12.915940] [INFO ] [MAIN ] UZD: Loaded 6366 primary data records. [2025-09-29T22:17:12.917636] [DEBUG] [LOCAL ] UWMC: Loaded 52754 existing records from primary storage. [2025-09-29T22:17:12.940671] [INFO ] [MAIN ] UWMC: Loaded 52754 primary data records. [2025-09-29T22:17:13.641496] [DEBUG] [MAIN ] UVV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:13.642829] [INFO ] [MAIN ] UVV: Generated 1794 derivative records from 22450 primary records. [2025-09-29T22:17:13.643100] [DEBUG] [LOCAL ] UVV: Saving derivative data. [2025-09-29T22:17:13.665605] [DEBUG] [LOCAL ] UVV: Derivative data saved (1794 records). [2025-09-29T22:17:13.668744] [INFO ] [MAIN ] UVV: Successfully saved derivative data. [2025-09-29T22:17:13.683482] [INFO ] [MAIN ] Derivative Progress: 1900/2057 symbols completed. UVV took 1.3s. Estimated remaining: 1m 4s. Rate: 147.4 symbols/min [2025-09-29T22:17:13.684512] [INFO ] [MAIN ] UZE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:13.693200] [DEBUG] [MAIN ] UWMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:13.699313] [DEBUG] [MAIN ] UZD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:13.700268] [INFO ] [MAIN ] UWMC: Generated 1794 derivative records from 52754 primary records. [2025-09-29T22:17:13.701208] [INFO ] [MAIN ] UZD: Generated 1794 derivative records from 6366 primary records. [2025-09-29T22:17:13.701572] [DEBUG] [LOCAL ] UZD: Saving derivative data. [2025-09-29T22:17:13.701361] [DEBUG] [LOCAL ] UWMC: Saving derivative data. [2025-09-29T22:17:13.737169] [DEBUG] [LOCAL ] UZE: Loaded 7414 existing records from primary storage. [2025-09-29T22:17:13.736880] [DEBUG] [LOCAL ] UZD: Derivative data saved (1794 records). [2025-09-29T22:17:13.738240] [INFO ] [MAIN ] UZD: Successfully saved derivative data. [2025-09-29T22:17:13.737915] [INFO ] [MAIN ] UZE: Loaded 7414 primary data records. [2025-09-29T22:17:13.740739] [INFO ] [MAIN ] Derivative Progress: 1901/2057 symbols completed. UZD took 1.1s. Estimated remaining: 1m 3s. Rate: 147.5 symbols/min [2025-09-29T22:17:13.746063] [INFO ] [MAIN ] UZF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:13.819768] [DEBUG] [LOCAL ] UWMC: Derivative data saved (1794 records). [2025-09-29T22:17:13.833102] [INFO ] [MAIN ] UWMC: Successfully saved derivative data. [2025-09-29T22:17:13.847244] [INFO ] [MAIN ] Derivative Progress: 1902/2057 symbols completed. UWMC took 1.4s. Estimated remaining: 1m 3s. Rate: 147.5 symbols/min [2025-09-29T22:17:13.862487] [INFO ] [MAIN ] V: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:13.868570] [DEBUG] [LOCAL ] UZF: Loaded 6423 existing records from primary storage. [2025-09-29T22:17:13.889811] [INFO ] [MAIN ] UZF: Loaded 6423 primary data records. [2025-09-29T22:17:14.448206] [DEBUG] [LOCAL ] V: Loaded 53755 existing records from primary storage. [2025-09-29T22:17:14.447104] [DEBUG] [MAIN ] UZE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:14.449356] [INFO ] [MAIN ] V: Loaded 53755 primary data records. [2025-09-29T22:17:14.449242] [INFO ] [MAIN ] UZE: Generated 1794 derivative records from 7414 primary records. [2025-09-29T22:17:14.449500] [DEBUG] [LOCAL ] UZE: Saving derivative data. [2025-09-29T22:17:14.585564] [DEBUG] [MAIN ] UZF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:14.593032] [INFO ] [MAIN ] UZF: Generated 1794 derivative records from 6423 primary records. [2025-09-29T22:17:14.593138] [DEBUG] [LOCAL ] UZF: Saving derivative data. [2025-09-29T22:17:14.600260] [DEBUG] [LOCAL ] UZE: Derivative data saved (1794 records). [2025-09-29T22:17:14.605770] [INFO ] [MAIN ] UZE: Successfully saved derivative data. [2025-09-29T22:17:14.633011] [INFO ] [MAIN ] Derivative Progress: 1903/2057 symbols completed. UZE took 0.9s. Estimated remaining: 1m 3s. Rate: 147.5 symbols/min [2025-09-29T22:17:14.800040] [DEBUG] [LOCAL ] UZF: Derivative data saved (1794 records). [2025-09-29T22:17:14.813893] [INFO ] [MAIN ] UZF: Successfully saved derivative data. [2025-09-29T22:17:14.817258] [INFO ] [MAIN ] Derivative Progress: 1904/2057 symbols completed. UZF took 1.1s. Estimated remaining: 1m 2s. Rate: 147.5 symbols/min [2025-09-29T22:17:14.841077] [DEBUG] [MAIN ] V: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:14.841831] [INFO ] [MAIN ] V: Generated 1794 derivative records from 53755 primary records. [2025-09-29T22:17:14.841906] [DEBUG] [LOCAL ] V: Saving derivative data. [2025-09-29T22:17:14.858292] [DEBUG] [LOCAL ] V: Derivative data saved (1794 records). [2025-09-29T22:17:14.858380] [INFO ] [MAIN ] V: Successfully saved derivative data. [2025-09-29T22:17:14.860331] [INFO ] [MAIN ] Derivative Progress: 1905/2057 symbols completed. V took 1.0s. Estimated remaining: 1m 2s. Rate: 147.6 symbols/min [2025-09-29T22:17:14.861179] [INFO ] [MAIN ] VALE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:14.860969] [INFO ] [MAIN ] VAC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:14.861094] [INFO ] [MAIN ] VAL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:14.928529] [DEBUG] [LOCAL ] VAC: Loaded 34360 existing records from primary storage. [2025-09-29T22:17:14.928883] [INFO ] [MAIN ] VAC: Loaded 34360 primary data records. [2025-09-29T22:17:15.060113] [DEBUG] [LOCAL ] VAL: Loaded 50344 existing records from primary storage. [2025-09-29T22:17:15.075636] [INFO ] [MAIN ] VAL: Loaded 50344 primary data records. [2025-09-29T22:17:15.082366] [DEBUG] [LOCAL ] VALE: Loaded 53694 existing records from primary storage. [2025-09-29T22:17:15.114874] [INFO ] [MAIN ] VALE: Loaded 53694 primary data records. [2025-09-29T22:17:16.026085] [DEBUG] [MAIN ] VAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:16.029044] [INFO ] [MAIN ] VAC: Generated 1794 derivative records from 34360 primary records. [2025-09-29T22:17:16.029441] [DEBUG] [LOCAL ] VAC: Saving derivative data. [2025-09-29T22:17:16.057331] [DEBUG] [MAIN ] VAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:16.061827] [INFO ] [MAIN ] VAL: Generated 1794 derivative records from 50344 primary records. [2025-09-29T22:17:16.062754] [DEBUG] [LOCAL ] VAL: Saving derivative data. [2025-09-29T22:17:16.063199] [DEBUG] [LOCAL ] VAC: Derivative data saved (1794 records). [2025-09-29T22:17:16.064617] [INFO ] [MAIN ] VAC: Successfully saved derivative data. [2025-09-29T22:17:16.074280] [INFO ] [MAIN ] Derivative Progress: 1906/2057 symbols completed. VAC took 1.2s. Estimated remaining: 1m 1s. Rate: 147.4 symbols/min [2025-09-29T22:17:16.079217] [INFO ] [MAIN ] VATE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:16.102765] [DEBUG] [MAIN ] VALE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:16.105732] [INFO ] [MAIN ] VALE: Generated 1794 derivative records from 53694 primary records. [2025-09-29T22:17:16.105896] [DEBUG] [LOCAL ] VALE: Saving derivative data. [2025-09-29T22:17:16.106499] [DEBUG] [LOCAL ] VAL: Derivative data saved (1794 records). [2025-09-29T22:17:16.107367] [INFO ] [MAIN ] VAL: Successfully saved derivative data. [2025-09-29T22:17:16.122067] [INFO ] [MAIN ] Derivative Progress: 1907/2057 symbols completed. VAL took 1.3s. Estimated remaining: 1m 1s. Rate: 147.5 symbols/min [2025-09-29T22:17:16.124407] [INFO ] [MAIN ] VBF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:16.127109] [DEBUG] [LOCAL ] VALE: Derivative data saved (1794 records). [2025-09-29T22:17:16.131735] [DEBUG] [LOCAL ] VATE: Loaded 5353 existing records from primary storage. [2025-09-29T22:17:16.131931] [INFO ] [MAIN ] VALE: Successfully saved derivative data. [2025-09-29T22:17:16.134229] [INFO ] [MAIN ] Derivative Progress: 1908/2057 symbols completed. VALE took 1.3s. Estimated remaining: 1m 1s. Rate: 147.6 symbols/min [2025-09-29T22:17:16.134486] [INFO ] [MAIN ] VATE: Loaded 5353 primary data records. [2025-09-29T22:17:16.134609] [INFO ] [MAIN ] VCV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:16.256821] [DEBUG] [LOCAL ] VBF: Loaded 6989 existing records from primary storage. [2025-09-29T22:17:16.262985] [INFO ] [MAIN ] VBF: Loaded 6989 primary data records. [2025-09-29T22:17:16.305814] [DEBUG] [LOCAL ] VCV: Loaded 13647 existing records from primary storage. [2025-09-29T22:17:16.321475] [INFO ] [MAIN ] VCV: Loaded 13647 primary data records. [2025-09-29T22:17:17.214157] [DEBUG] [MAIN ] VATE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:17.232438] [INFO ] [MAIN ] VATE: Generated 1794 derivative records from 5353 primary records. [2025-09-29T22:17:17.233044] [DEBUG] [MAIN ] VBF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:17.233946] [DEBUG] [LOCAL ] VATE: Saving derivative data. [2025-09-29T22:17:17.233785] [INFO ] [MAIN ] VBF: Generated 1794 derivative records from 6989 primary records. [2025-09-29T22:17:17.247677] [DEBUG] [LOCAL ] VBF: Saving derivative data. [2025-09-29T22:17:17.255176] [DEBUG] [MAIN ] VCV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:17.268892] [INFO ] [MAIN ] VCV: Generated 1794 derivative records from 13647 primary records. [2025-09-29T22:17:17.274233] [DEBUG] [LOCAL ] VCV: Saving derivative data. [2025-09-29T22:17:17.296176] [DEBUG] [LOCAL ] VCV: Derivative data saved (1794 records). [2025-09-29T22:17:17.296615] [DEBUG] [LOCAL ] VATE: Derivative data saved (1794 records). [2025-09-29T22:17:17.298339] [INFO ] [MAIN ] VCV: Successfully saved derivative data. [2025-09-29T22:17:17.301374] [INFO ] [MAIN ] Derivative Progress: 1909/2057 symbols completed. VCV took 1.2s. Estimated remaining: 1m 0s. Rate: 147.4 symbols/min [2025-09-29T22:17:17.298674] [INFO ] [MAIN ] VATE: Successfully saved derivative data. [2025-09-29T22:17:17.301893] [INFO ] [MAIN ] VEEV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:17.303917] [INFO ] [MAIN ] Derivative Progress: 1910/2057 symbols completed. VATE took 1.2s. Estimated remaining: 59.8s. Rate: 147.5 symbols/min [2025-09-29T22:17:17.304723] [INFO ] [MAIN ] VEL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:17.304573] [DEBUG] [LOCAL ] VBF: Derivative data saved (1794 records). [2025-09-29T22:17:17.305194] [INFO ] [MAIN ] VBF: Successfully saved derivative data. [2025-09-29T22:17:17.307975] [INFO ] [MAIN ] Derivative Progress: 1911/2057 symbols completed. VBF took 1.2s. Estimated remaining: 59.4s. Rate: 147.6 symbols/min [2025-09-29T22:17:17.308382] [INFO ] [MAIN ] VET: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:17.323467] [DEBUG] [LOCAL ] VEL: Loaded 12859 existing records from primary storage. [2025-09-29T22:17:17.323720] [INFO ] [MAIN ] VEL: Loaded 12859 primary data records. [2025-09-29T22:17:17.685706] [DEBUG] [LOCAL ] VEEV: Loaded 47036 existing records from primary storage. [2025-09-29T22:17:17.699810] [INFO ] [MAIN ] VEEV: Loaded 47036 primary data records. [2025-09-29T22:17:17.774908] [DEBUG] [LOCAL ] VET: Loaded 43955 existing records from primary storage. [2025-09-29T22:17:17.792017] [INFO ] [MAIN ] VET: Loaded 43955 primary data records. [2025-09-29T22:17:18.418017] [DEBUG] [MAIN ] VEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:18.421092] [INFO ] [MAIN ] VEL: Generated 1794 derivative records from 12859 primary records. [2025-09-29T22:17:18.421832] [DEBUG] [LOCAL ] VEL: Saving derivative data. [2025-09-29T22:17:18.460354] [DEBUG] [MAIN ] VEEV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:18.461871] [INFO ] [MAIN ] VEEV: Generated 1794 derivative records from 47036 primary records. [2025-09-29T22:17:18.462456] [DEBUG] [LOCAL ] VEL: Derivative data saved (1794 records). [2025-09-29T22:17:18.462768] [DEBUG] [LOCAL ] VEEV: Saving derivative data. [2025-09-29T22:17:18.462904] [INFO ] [MAIN ] VEL: Successfully saved derivative data. [2025-09-29T22:17:18.466469] [INFO ] [MAIN ] Derivative Progress: 1912/2057 symbols completed. VEL took 1.2s. Estimated remaining: 59.0s. Rate: 147.4 symbols/min [2025-09-29T22:17:18.476412] [INFO ] [MAIN ] VFC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:18.488555] [DEBUG] [LOCAL ] VEEV: Derivative data saved (1794 records). [2025-09-29T22:17:18.488741] [INFO ] [MAIN ] VEEV: Successfully saved derivative data. [2025-09-29T22:17:18.491067] [INFO ] [MAIN ] Derivative Progress: 1913/2057 symbols completed. VEEV took 1.2s. Estimated remaining: 58.6s. Rate: 147.5 symbols/min [2025-09-29T22:17:18.491471] [INFO ] [MAIN ] VGI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:18.511712] [DEBUG] [MAIN ] VET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:18.512834] [INFO ] [MAIN ] VET: Generated 1794 derivative records from 43955 primary records. [2025-09-29T22:17:18.513024] [DEBUG] [LOCAL ] VET: Saving derivative data. [2025-09-29T22:17:18.534732] [DEBUG] [LOCAL ] VGI: Loaded 5132 existing records from primary storage. [2025-09-29T22:17:18.535569] [INFO ] [MAIN ] VGI: Loaded 5132 primary data records. [2025-09-29T22:17:18.593078] [DEBUG] [LOCAL ] VET: Derivative data saved (1794 records). [2025-09-29T22:17:18.630693] [INFO ] [MAIN ] VET: Successfully saved derivative data. [2025-09-29T22:17:18.666603] [INFO ] [MAIN ] Derivative Progress: 1914/2057 symbols completed. VET took 1.4s. Estimated remaining: 58.2s. Rate: 147.5 symbols/min [2025-09-29T22:17:18.667420] [INFO ] [MAIN ] VGM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:18.918923] [DEBUG] [LOCAL ] VFC: Loaded 53610 existing records from primary storage. [2025-09-29T22:17:18.920001] [INFO ] [MAIN ] VFC: Loaded 53610 primary data records. [2025-09-29T22:17:18.929912] [DEBUG] [LOCAL ] VGM: Loaded 18241 existing records from primary storage. [2025-09-29T22:17:18.950075] [INFO ] [MAIN ] VGM: Loaded 18241 primary data records. [2025-09-29T22:17:19.681102] [DEBUG] [MAIN ] VGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:19.683425] [INFO ] [MAIN ] VGI: Generated 1794 derivative records from 5132 primary records. [2025-09-29T22:17:19.684074] [DEBUG] [LOCAL ] VGI: Saving derivative data. [2025-09-29T22:17:19.703332] [DEBUG] [LOCAL ] VGI: Derivative data saved (1794 records). [2025-09-29T22:17:19.704240] [INFO ] [MAIN ] VGI: Successfully saved derivative data. [2025-09-29T22:17:19.707109] [INFO ] [MAIN ] Derivative Progress: 1915/2057 symbols completed. VGI took 1.2s. Estimated remaining: 57.8s. Rate: 147.4 symbols/min [2025-09-29T22:17:19.707568] [INFO ] [MAIN ] VHI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:19.716476] [DEBUG] [LOCAL ] VHI: Loaded 2784 existing records from primary storage. [2025-09-29T22:17:19.729290] [INFO ] [MAIN ] VHI: Loaded 2784 primary data records. [2025-09-29T22:17:19.729810] [DEBUG] [MAIN ] VFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:19.730625] [INFO ] [MAIN ] VFC: Generated 1794 derivative records from 53610 primary records. [2025-09-29T22:17:19.751765] [DEBUG] [LOCAL ] VFC: Saving derivative data. [2025-09-29T22:17:19.907670] [DEBUG] [MAIN ] VGM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:19.923286] [INFO ] [MAIN ] VGM: Generated 1794 derivative records from 18241 primary records. [2025-09-29T22:17:19.945029] [DEBUG] [LOCAL ] VFC: Derivative data saved (1794 records). [2025-09-29T22:17:19.947096] [INFO ] [MAIN ] VFC: Successfully saved derivative data. [2025-09-29T22:17:19.966177] [INFO ] [MAIN ] Derivative Progress: 1916/2057 symbols completed. VFC took 1.5s. Estimated remaining: 57.4s. Rate: 147.5 symbols/min [2025-09-29T22:17:19.972800] [INFO ] [MAIN ] VICI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:19.946412] [DEBUG] [LOCAL ] VGM: Saving derivative data. [2025-09-29T22:17:20.124782] [DEBUG] [LOCAL ] VGM: Derivative data saved (1794 records). [2025-09-29T22:17:20.124918] [INFO ] [MAIN ] VGM: Successfully saved derivative data. [2025-09-29T22:17:20.127592] [INFO ] [MAIN ] Derivative Progress: 1917/2057 symbols completed. VGM took 1.5s. Estimated remaining: 56.9s. Rate: 147.5 symbols/min [2025-09-29T22:17:20.128546] [INFO ] [MAIN ] VIK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:20.151056] [DEBUG] [MAIN ] VHI: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:17:20.151905] [INFO ] [MAIN ] VHI: Generated 1793 derivative records from 2784 primary records. [2025-09-29T22:17:20.152072] [DEBUG] [LOCAL ] VHI: Saving derivative data. [2025-09-29T22:17:20.181895] [DEBUG] [LOCAL ] VHI: Derivative data saved (1793 records). [2025-09-29T22:17:20.182146] [INFO ] [MAIN ] VHI: Successfully saved derivative data. [2025-09-29T22:17:20.184395] [INFO ] [MAIN ] Derivative Progress: 1918/2057 symbols completed. VHI took 0.5s. Estimated remaining: 56.5s. Rate: 147.6 symbols/min [2025-09-29T22:17:20.219479] [DEBUG] [LOCAL ] VICI: Loaded 53647 existing records from primary storage. [2025-09-29T22:17:20.219754] [INFO ] [MAIN ] VICI: Loaded 53647 primary data records. [2025-09-29T22:17:20.348973] [DEBUG] [LOCAL ] VIK: Loaded 52469 existing records from primary storage. [2025-09-29T22:17:20.359759] [INFO ] [MAIN ] VIK: Loaded 52469 primary data records. [2025-09-29T22:17:20.911945] [DEBUG] [MAIN ] VICI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:20.913202] [INFO ] [MAIN ] VICI: Generated 1794 derivative records from 53647 primary records. [2025-09-29T22:17:20.913328] [DEBUG] [LOCAL ] VICI: Saving derivative data. [2025-09-29T22:17:20.944819] [DEBUG] [MAIN ] VIK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:20.946900] [INFO ] [MAIN ] VIK: Generated 1794 derivative records from 52469 primary records. [2025-09-29T22:17:20.947603] [DEBUG] [LOCAL ] VIK: Saving derivative data. [2025-09-29T22:17:20.949543] [DEBUG] [LOCAL ] VICI: Derivative data saved (1794 records). [2025-09-29T22:17:20.958222] [INFO ] [MAIN ] VICI: Successfully saved derivative data. [2025-09-29T22:17:20.963244] [INFO ] [MAIN ] Derivative Progress: 1919/2057 symbols completed. VICI took 1.0s. Estimated remaining: 56.1s. Rate: 147.5 symbols/min [2025-09-29T22:17:20.967679] [DEBUG] [LOCAL ] VIK: Derivative data saved (1794 records). [2025-09-29T22:17:20.967776] [INFO ] [MAIN ] VIK: Successfully saved derivative data. [2025-09-29T22:17:20.970132] [INFO ] [MAIN ] Derivative Progress: 1920/2057 symbols completed. VIK took 0.8s. Estimated remaining: 55.7s. Rate: 147.6 symbols/min [2025-09-29T22:17:20.970820] [INFO ] [MAIN ] VIRT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:20.970722] [INFO ] [MAIN ] VIST: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:20.970594] [INFO ] [MAIN ] VIPS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:21.081504] [DEBUG] [LOCAL ] VIPS: Loaded 51313 existing records from primary storage. [2025-09-29T22:17:21.083429] [INFO ] [MAIN ] VIPS: Loaded 51313 primary data records. [2025-09-29T22:17:21.083285] [DEBUG] [LOCAL ] VIST: Loaded 45967 existing records from primary storage. [2025-09-29T22:17:21.083692] [INFO ] [MAIN ] VIST: Loaded 45967 primary data records. [2025-09-29T22:17:21.129031] [DEBUG] [LOCAL ] VIRT: Loaded 46674 existing records from primary storage. [2025-09-29T22:17:21.182628] [INFO ] [MAIN ] VIRT: Loaded 46674 primary data records. [2025-09-29T22:17:22.225295] [DEBUG] [MAIN ] VIPS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:22.231509] [DEBUG] [MAIN ] VIST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:22.232477] [INFO ] [MAIN ] VIPS: Generated 1794 derivative records from 51313 primary records. [2025-09-29T22:17:22.233452] [INFO ] [MAIN ] VIST: Generated 1794 derivative records from 45967 primary records. [2025-09-29T22:17:22.232776] [DEBUG] [LOCAL ] VIPS: Saving derivative data. [2025-09-29T22:17:22.234590] [DEBUG] [LOCAL ] VIST: Saving derivative data. [2025-09-29T22:17:22.282045] [DEBUG] [LOCAL ] VIPS: Derivative data saved (1794 records). [2025-09-29T22:17:22.283616] [DEBUG] [MAIN ] VIRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:22.286891] [DEBUG] [LOCAL ] VIST: Derivative data saved (1794 records). [2025-09-29T22:17:22.287087] [INFO ] [MAIN ] VIST: Successfully saved derivative data. [2025-09-29T22:17:22.283766] [INFO ] [MAIN ] VIPS: Successfully saved derivative data. [2025-09-29T22:17:22.291250] [INFO ] [MAIN ] Derivative Progress: 1921/2057 symbols completed. VIST took 1.3s. Estimated remaining: 55.4s. Rate: 147.4 symbols/min [2025-09-29T22:17:22.293514] [INFO ] [MAIN ] VIV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:22.286537] [INFO ] [MAIN ] VIRT: Generated 1794 derivative records from 46674 primary records. [2025-09-29T22:17:22.293859] [DEBUG] [LOCAL ] VIRT: Saving derivative data. [2025-09-29T22:17:22.294637] [INFO ] [MAIN ] Derivative Progress: 1922/2057 symbols completed. VIPS took 1.3s. Estimated remaining: 54.9s. Rate: 147.5 symbols/min [2025-09-29T22:17:22.295968] [INFO ] [MAIN ] VKQ: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:22.314461] [DEBUG] [LOCAL ] VIRT: Derivative data saved (1794 records). [2025-09-29T22:17:22.314787] [INFO ] [MAIN ] VIRT: Successfully saved derivative data. [2025-09-29T22:17:22.317142] [INFO ] [MAIN ] Derivative Progress: 1923/2057 symbols completed. VIRT took 1.3s. Estimated remaining: 54.5s. Rate: 147.5 symbols/min [2025-09-29T22:17:22.317498] [INFO ] [MAIN ] VLN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:22.333226] [DEBUG] [LOCAL ] VKQ: Loaded 17477 existing records from primary storage. [2025-09-29T22:17:22.333363] [INFO ] [MAIN ] VKQ: Loaded 17477 primary data records. [2025-09-29T22:17:22.497137] [DEBUG] [LOCAL ] VIV: Loaded 44940 existing records from primary storage. [2025-09-29T22:17:22.530319] [INFO ] [MAIN ] VIV: Loaded 44940 primary data records. [2025-09-29T22:17:22.707402] [DEBUG] [LOCAL ] VLN: Loaded 28862 existing records from primary storage. [2025-09-29T22:17:22.746726] [INFO ] [MAIN ] VLN: Loaded 28862 primary data records. [2025-09-29T22:17:23.425361] [DEBUG] [MAIN ] VKQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:23.427595] [INFO ] [MAIN ] VKQ: Generated 1794 derivative records from 17477 primary records. [2025-09-29T22:17:23.427823] [DEBUG] [LOCAL ] VKQ: Saving derivative data. [2025-09-29T22:17:23.454161] [DEBUG] [LOCAL ] VKQ: Derivative data saved (1794 records). [2025-09-29T22:17:23.473539] [INFO ] [MAIN ] VKQ: Successfully saved derivative data. [2025-09-29T22:17:23.474365] [DEBUG] [MAIN ] VIV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:23.476384] [INFO ] [MAIN ] Derivative Progress: 1924/2057 symbols completed. VKQ took 1.2s. Estimated remaining: 54.1s. Rate: 147.4 symbols/min [2025-09-29T22:17:23.476871] [INFO ] [MAIN ] VLO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:23.478374] [INFO ] [MAIN ] VIV: Generated 1794 derivative records from 44940 primary records. [2025-09-29T22:17:23.478458] [DEBUG] [LOCAL ] VIV: Saving derivative data. [2025-09-29T22:17:23.511027] [DEBUG] [MAIN ] VLN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:23.512673] [INFO ] [MAIN ] VLN: Generated 1794 derivative records from 28862 primary records. [2025-09-29T22:17:23.513066] [DEBUG] [LOCAL ] VLN: Saving derivative data. [2025-09-29T22:17:23.523812] [DEBUG] [LOCAL ] VIV: Derivative data saved (1794 records). [2025-09-29T22:17:23.528599] [INFO ] [MAIN ] VIV: Successfully saved derivative data. [2025-09-29T22:17:23.531615] [INFO ] [MAIN ] Derivative Progress: 1925/2057 symbols completed. VIV took 1.2s. Estimated remaining: 53.7s. Rate: 147.5 symbols/min [2025-09-29T22:17:23.532676] [INFO ] [MAIN ] VLRS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:23.539872] [DEBUG] [LOCAL ] VLN: Derivative data saved (1794 records). [2025-09-29T22:17:23.540041] [INFO ] [MAIN ] VLN: Successfully saved derivative data. [2025-09-29T22:17:23.542382] [INFO ] [MAIN ] Derivative Progress: 1926/2057 symbols completed. VLN took 1.2s. Estimated remaining: 53.3s. Rate: 147.5 symbols/min [2025-09-29T22:17:23.542686] [INFO ] [MAIN ] VLT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:23.566796] [DEBUG] [LOCAL ] VLT: Loaded 4558 existing records from primary storage. [2025-09-29T22:17:23.567061] [INFO ] [MAIN ] VLT: Loaded 4558 primary data records. [2025-09-29T22:17:23.698913] [DEBUG] [LOCAL ] VLO: Loaded 53086 existing records from primary storage. [2025-09-29T22:17:23.717113] [INFO ] [MAIN ] VLO: Loaded 53086 primary data records. [2025-09-29T22:17:23.835794] [DEBUG] [LOCAL ] VLRS: Loaded 40414 existing records from primary storage. [2025-09-29T22:17:23.887676] [INFO ] [MAIN ] VLRS: Loaded 40414 primary data records. [2025-09-29T22:17:24.666561] [DEBUG] [MAIN ] VLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:24.667635] [INFO ] [MAIN ] VLT: Generated 1794 derivative records from 4558 primary records. [2025-09-29T22:17:24.668235] [DEBUG] [LOCAL ] VLT: Saving derivative data. [2025-09-29T22:17:24.702983] [DEBUG] [MAIN ] VLO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:24.705247] [INFO ] [MAIN ] VLO: Generated 1794 derivative records from 53086 primary records. [2025-09-29T22:17:24.706130] [DEBUG] [LOCAL ] VLT: Derivative data saved (1794 records). [2025-09-29T22:17:24.706296] [INFO ] [MAIN ] VLT: Successfully saved derivative data. [2025-09-29T22:17:24.706236] [DEBUG] [LOCAL ] VLO: Saving derivative data. [2025-09-29T22:17:24.709131] [INFO ] [MAIN ] Derivative Progress: 1927/2057 symbols completed. VLT took 1.2s. Estimated remaining: 52.9s. Rate: 147.4 symbols/min [2025-09-29T22:17:24.709991] [INFO ] [MAIN ] VLTO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:24.738530] [DEBUG] [LOCAL ] VLO: Derivative data saved (1794 records). [2025-09-29T22:17:24.743945] [INFO ] [MAIN ] VLO: Successfully saved derivative data. [2025-09-29T22:17:24.743890] [DEBUG] [MAIN ] VLRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:24.746163] [INFO ] [MAIN ] Derivative Progress: 1928/2057 symbols completed. VLO took 1.3s. Estimated remaining: 52.5s. Rate: 147.5 symbols/min [2025-09-29T22:17:24.746364] [INFO ] [MAIN ] VMC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:24.747776] [INFO ] [MAIN ] VLRS: Generated 1794 derivative records from 40414 primary records. [2025-09-29T22:17:24.747955] [DEBUG] [LOCAL ] VLRS: Saving derivative data. [2025-09-29T22:17:24.768405] [DEBUG] [LOCAL ] VLRS: Derivative data saved (1794 records). [2025-09-29T22:17:24.768787] [INFO ] [MAIN ] VLRS: Successfully saved derivative data. [2025-09-29T22:17:24.771853] [INFO ] [MAIN ] Derivative Progress: 1929/2057 symbols completed. VLRS took 1.2s. Estimated remaining: 52.1s. Rate: 147.5 symbols/min [2025-09-29T22:17:24.772078] [INFO ] [MAIN ] VMI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:24.802593] [DEBUG] [LOCAL ] VMI: Loaded 15416 existing records from primary storage. [2025-09-29T22:17:24.802803] [INFO ] [MAIN ] VMI: Loaded 15416 primary data records. [2025-09-29T22:17:24.928399] [DEBUG] [LOCAL ] VLTO: Loaded 45975 existing records from primary storage. [2025-09-29T22:17:24.958697] [INFO ] [MAIN ] VLTO: Loaded 45975 primary data records. [2025-09-29T22:17:25.135915] [DEBUG] [LOCAL ] VMC: Loaded 43401 existing records from primary storage. [2025-09-29T22:17:25.251137] [INFO ] [MAIN ] VMC: Loaded 43401 primary data records. [2025-09-29T22:17:25.922092] [DEBUG] [MAIN ] VMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:25.923271] [INFO ] [MAIN ] VMI: Generated 1794 derivative records from 15416 primary records. [2025-09-29T22:17:25.923388] [DEBUG] [LOCAL ] VMI: Saving derivative data. [2025-09-29T22:17:25.942151] [DEBUG] [LOCAL ] VMI: Derivative data saved (1794 records). [2025-09-29T22:17:25.942444] [INFO ] [MAIN ] VMI: Successfully saved derivative data. [2025-09-29T22:17:25.944469] [INFO ] [MAIN ] Derivative Progress: 1930/2057 symbols completed. VMI took 1.2s. Estimated remaining: 51.7s. Rate: 147.4 symbols/min [2025-09-29T22:17:25.944874] [INFO ] [MAIN ] VMO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:25.965085] [DEBUG] [MAIN ] VLTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:25.966322] [INFO ] [MAIN ] VLTO: Generated 1794 derivative records from 45975 primary records. [2025-09-29T22:17:25.966475] [DEBUG] [LOCAL ] VLTO: Saving derivative data. [2025-09-29T22:17:26.008235] [DEBUG] [MAIN ] VMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:26.012668] [DEBUG] [LOCAL ] VLTO: Derivative data saved (1794 records). [2025-09-29T22:17:26.014039] [INFO ] [MAIN ] VLTO: Successfully saved derivative data. [2025-09-29T22:17:26.013919] [INFO ] [MAIN ] VMC: Generated 1794 derivative records from 43401 primary records. [2025-09-29T22:17:26.017772] [DEBUG] [LOCAL ] VMC: Saving derivative data. [2025-09-29T22:17:26.017476] [INFO ] [MAIN ] Derivative Progress: 1931/2057 symbols completed. VLTO took 1.3s. Estimated remaining: 51.3s. Rate: 147.5 symbols/min [2025-09-29T22:17:26.019286] [INFO ] [MAIN ] VNCE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:26.041827] [DEBUG] [LOCAL ] VMO: Loaded 20979 existing records from primary storage. [2025-09-29T22:17:26.048460] [INFO ] [MAIN ] VMO: Loaded 20979 primary data records. [2025-09-29T22:17:26.048583] [DEBUG] [LOCAL ] VMC: Derivative data saved (1794 records). [2025-09-29T22:17:26.054388] [INFO ] [MAIN ] VMC: Successfully saved derivative data. [2025-09-29T22:17:26.060988] [INFO ] [MAIN ] Derivative Progress: 1932/2057 symbols completed. VMC took 1.3s. Estimated remaining: 50.8s. Rate: 147.5 symbols/min [2025-09-29T22:17:26.061485] [DEBUG] [LOCAL ] VNCE: Loaded 7694 existing records from primary storage. [2025-09-29T22:17:26.069131] [INFO ] [MAIN ] VNO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:26.074872] [INFO ] [MAIN ] VNCE: Loaded 7694 primary data records. [2025-09-29T22:17:26.722989] [DEBUG] [LOCAL ] VNO: Loaded 48911 existing records from primary storage. [2025-09-29T22:17:26.723424] [INFO ] [MAIN ] VNO: Loaded 48911 primary data records. [2025-09-29T22:17:27.099266] [DEBUG] [MAIN ] VMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:27.101402] [INFO ] [MAIN ] VMO: Generated 1794 derivative records from 20979 primary records. [2025-09-29T22:17:27.102709] [DEBUG] [LOCAL ] VMO: Saving derivative data. [2025-09-29T22:17:27.132792] [DEBUG] [MAIN ] VNCE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:27.134425] [INFO ] [MAIN ] VNCE: Generated 1794 derivative records from 7694 primary records. [2025-09-29T22:17:27.135107] [DEBUG] [LOCAL ] VNCE: Saving derivative data. [2025-09-29T22:17:27.152510] [DEBUG] [LOCAL ] VMO: Derivative data saved (1794 records). [2025-09-29T22:17:27.154701] [INFO ] [MAIN ] VMO: Successfully saved derivative data. [2025-09-29T22:17:27.157242] [INFO ] [MAIN ] Derivative Progress: 1933/2057 symbols completed. VMO took 1.2s. Estimated remaining: 50.5s. Rate: 147.4 symbols/min [2025-09-29T22:17:27.160288] [DEBUG] [LOCAL ] VNCE: Derivative data saved (1794 records). [2025-09-29T22:17:27.161111] [INFO ] [MAIN ] VNCE: Successfully saved derivative data. [2025-09-29T22:17:27.163381] [INFO ] [MAIN ] Derivative Progress: 1934/2057 symbols completed. VNCE took 1.1s. Estimated remaining: 50.0s. Rate: 147.5 symbols/min [2025-09-29T22:17:27.176251] [DEBUG] [MAIN ] VNO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:27.176891] [INFO ] [MAIN ] VNO: Generated 1794 derivative records from 48911 primary records. [2025-09-29T22:17:27.176957] [DEBUG] [LOCAL ] VNO: Saving derivative data. [2025-09-29T22:17:27.192473] [DEBUG] [LOCAL ] VNO: Derivative data saved (1794 records). [2025-09-29T22:17:27.192553] [INFO ] [MAIN ] VNO: Successfully saved derivative data. [2025-09-29T22:17:27.194623] [INFO ] [MAIN ] Derivative Progress: 1935/2057 symbols completed. VNO took 1.1s. Estimated remaining: 49.6s. Rate: 147.5 symbols/min [2025-09-29T22:17:27.195265] [INFO ] [MAIN ] VOYA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:27.195082] [INFO ] [MAIN ] VNT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:27.195160] [INFO ] [MAIN ] VOC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:27.208102] [DEBUG] [LOCAL ] VOC: Loaded 8895 existing records from primary storage. [2025-09-29T22:17:27.208295] [INFO ] [MAIN ] VOC: Loaded 8895 primary data records. [2025-09-29T22:17:27.583861] [DEBUG] [LOCAL ] VNT: Loaded 43608 existing records from primary storage. [2025-09-29T22:17:27.596368] [INFO ] [MAIN ] VNT: Loaded 43608 primary data records. [2025-09-29T22:17:27.611273] [DEBUG] [LOCAL ] VOYA: Loaded 42548 existing records from primary storage. [2025-09-29T22:17:27.640210] [INFO ] [MAIN ] VOYA: Loaded 42548 primary data records. [2025-09-29T22:17:28.435506] [DEBUG] [MAIN ] VOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:28.438368] [INFO ] [MAIN ] VOC: Generated 1794 derivative records from 8895 primary records. [2025-09-29T22:17:28.440096] [DEBUG] [LOCAL ] VOC: Saving derivative data. [2025-09-29T22:17:28.477075] [DEBUG] [LOCAL ] VOC: Derivative data saved (1794 records). [2025-09-29T22:17:28.477602] [INFO ] [MAIN ] VOC: Successfully saved derivative data. [2025-09-29T22:17:28.494943] [DEBUG] [MAIN ] VOYA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:28.497803] [INFO ] [MAIN ] Derivative Progress: 1936/2057 symbols completed. VOC took 1.3s. Estimated remaining: 49.3s. Rate: 147.4 symbols/min [2025-09-29T22:17:28.499629] [INFO ] [MAIN ] VOYA: Generated 1794 derivative records from 42548 primary records. [2025-09-29T22:17:28.498104] [INFO ] [MAIN ] VPG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:28.500881] [DEBUG] [LOCAL ] VOYA: Saving derivative data. [2025-09-29T22:17:28.551763] [DEBUG] [LOCAL ] VOYA: Derivative data saved (1794 records). [2025-09-29T22:17:28.560986] [INFO ] [MAIN ] VOYA: Successfully saved derivative data. [2025-09-29T22:17:28.563956] [INFO ] [MAIN ] Derivative Progress: 1937/2057 symbols completed. VOYA took 1.4s. Estimated remaining: 48.8s. Rate: 147.4 symbols/min [2025-09-29T22:17:28.564390] [INFO ] [MAIN ] VPV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:28.566131] [DEBUG] [MAIN ] VNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:28.567183] [INFO ] [MAIN ] VNT: Generated 1794 derivative records from 43608 primary records. [2025-09-29T22:17:28.567421] [DEBUG] [LOCAL ] VNT: Saving derivative data. [2025-09-29T22:17:28.580950] [DEBUG] [LOCAL ] VPG: Loaded 17049 existing records from primary storage. [2025-09-29T22:17:28.602039] [INFO ] [MAIN ] VPG: Loaded 17049 primary data records. [2025-09-29T22:17:28.631669] [DEBUG] [LOCAL ] VPV: Loaded 5403 existing records from primary storage. [2025-09-29T22:17:28.643507] [INFO ] [MAIN ] VPV: Loaded 5403 primary data records. [2025-09-29T22:17:28.717569] [DEBUG] [LOCAL ] VNT: Derivative data saved (1794 records). [2025-09-29T22:17:28.742315] [INFO ] [MAIN ] VNT: Successfully saved derivative data. [2025-09-29T22:17:28.791609] [INFO ] [MAIN ] Derivative Progress: 1938/2057 symbols completed. VNT took 1.6s. Estimated remaining: 48.4s. Rate: 147.5 symbols/min [2025-09-29T22:17:28.847835] [INFO ] [MAIN ] VRE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:29.446880] [DEBUG] [LOCAL ] VRE: Loaded 34845 existing records from primary storage. [2025-09-29T22:17:29.447891] [INFO ] [MAIN ] VRE: Loaded 34845 primary data records. [2025-09-29T22:17:29.795326] [DEBUG] [MAIN ] VPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:29.798127] [INFO ] [MAIN ] VPG: Generated 1794 derivative records from 17049 primary records. [2025-09-29T22:17:29.798701] [DEBUG] [LOCAL ] VPG: Saving derivative data. [2025-09-29T22:17:29.814211] [DEBUG] [MAIN ] VPV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:29.828611] [INFO ] [MAIN ] VPV: Generated 1794 derivative records from 5403 primary records. [2025-09-29T22:17:29.832795] [DEBUG] [LOCAL ] VPV: Saving derivative data. [2025-09-29T22:17:29.833088] [DEBUG] [LOCAL ] VPG: Derivative data saved (1794 records). [2025-09-29T22:17:29.841216] [INFO ] [MAIN ] VPG: Successfully saved derivative data. [2025-09-29T22:17:29.848447] [INFO ] [MAIN ] Derivative Progress: 1939/2057 symbols completed. VPG took 1.4s. Estimated remaining: 48.0s. Rate: 147.4 symbols/min [2025-09-29T22:17:29.849291] [INFO ] [MAIN ] VRT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:29.856316] [DEBUG] [LOCAL ] VPV: Derivative data saved (1794 records). [2025-09-29T22:17:29.856536] [INFO ] [MAIN ] VPV: Successfully saved derivative data. [2025-09-29T22:17:29.858923] [INFO ] [MAIN ] Derivative Progress: 1940/2057 symbols completed. VPV took 1.3s. Estimated remaining: 47.6s. Rate: 147.4 symbols/min [2025-09-29T22:17:29.872449] [DEBUG] [MAIN ] VRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:29.873280] [INFO ] [MAIN ] VRE: Generated 1794 derivative records from 34845 primary records. [2025-09-29T22:17:29.873422] [DEBUG] [LOCAL ] VRE: Saving derivative data. [2025-09-29T22:17:29.872162] [INFO ] [MAIN ] VRTS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:29.896731] [DEBUG] [LOCAL ] VRE: Derivative data saved (1794 records). [2025-09-29T22:17:29.901673] [INFO ] [MAIN ] VRE: Successfully saved derivative data. [2025-09-29T22:17:29.901554] [DEBUG] [LOCAL ] VRTS: Loaded 9211 existing records from primary storage. [2025-09-29T22:17:29.904216] [INFO ] [MAIN ] Derivative Progress: 1941/2057 symbols completed. VRE took 1.1s. Estimated remaining: 47.2s. Rate: 147.5 symbols/min [2025-09-29T22:17:29.904453] [INFO ] [MAIN ] VRTS: Loaded 9211 primary data records. [2025-09-29T22:17:29.904614] [INFO ] [MAIN ] VSCO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:30.103890] [DEBUG] [LOCAL ] VRT: Loaded 53753 existing records from primary storage. [2025-09-29T22:17:30.136675] [INFO ] [MAIN ] VRT: Loaded 53753 primary data records. [2025-09-29T22:17:30.441596] [DEBUG] [LOCAL ] VSCO: Loaded 52776 existing records from primary storage. [2025-09-29T22:17:30.482343] [INFO ] [MAIN ] VSCO: Loaded 52776 primary data records. [2025-09-29T22:17:30.844104] [DEBUG] [MAIN ] VRTS: Filtered 7001 bins outside market hours, 7825 incomplete bins [2025-09-29T22:17:30.864744] [INFO ] [MAIN ] VRTS: Generated 1789 derivative records from 9211 primary records. [2025-09-29T22:17:30.899575] [DEBUG] [LOCAL ] VRTS: Saving derivative data. [2025-09-29T22:17:31.085903] [DEBUG] [LOCAL ] VRTS: Derivative data saved (1789 records). [2025-09-29T22:17:31.086255] [INFO ] [MAIN ] VRTS: Successfully saved derivative data. [2025-09-29T22:17:31.090927] [INFO ] [MAIN ] Derivative Progress: 1942/2057 symbols completed. VRTS took 1.2s. Estimated remaining: 46.8s. Rate: 147.4 symbols/min [2025-09-29T22:17:31.091367] [INFO ] [MAIN ] VSH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:31.106600] [DEBUG] [MAIN ] VRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:31.108157] [INFO ] [MAIN ] VRT: Generated 1794 derivative records from 53753 primary records. [2025-09-29T22:17:31.108444] [DEBUG] [LOCAL ] VRT: Saving derivative data. [2025-09-29T22:17:31.131687] [DEBUG] [LOCAL ] VRT: Derivative data saved (1794 records). [2025-09-29T22:17:31.132194] [INFO ] [MAIN ] VRT: Successfully saved derivative data. [2025-09-29T22:17:31.136347] [INFO ] [MAIN ] Derivative Progress: 1943/2057 symbols completed. VRT took 1.3s. Estimated remaining: 46.4s. Rate: 147.4 symbols/min [2025-09-29T22:17:31.136754] [INFO ] [MAIN ] VST: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:31.169784] [DEBUG] [MAIN ] VSCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:31.170812] [INFO ] [MAIN ] VSCO: Generated 1794 derivative records from 52776 primary records. [2025-09-29T22:17:31.171026] [DEBUG] [LOCAL ] VSCO: Saving derivative data. [2025-09-29T22:17:31.211044] [DEBUG] [LOCAL ] VSCO: Derivative data saved (1794 records). [2025-09-29T22:17:31.211233] [INFO ] [MAIN ] VSCO: Successfully saved derivative data. [2025-09-29T22:17:31.214976] [INFO ] [MAIN ] Derivative Progress: 1944/2057 symbols completed. VSCO took 1.3s. Estimated remaining: 46.0s. Rate: 147.5 symbols/min [2025-09-29T22:17:31.212285] [DEBUG] [LOCAL ] VSH: Loaded 48383 existing records from primary storage. [2025-09-29T22:17:31.215203] [INFO ] [MAIN ] VSTS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:31.215539] [INFO ] [MAIN ] VSH: Loaded 48383 primary data records. [2025-09-29T22:17:31.571233] [DEBUG] [LOCAL ] VST: Loaded 53718 existing records from primary storage. [2025-09-29T22:17:31.571545] [INFO ] [MAIN ] VST: Loaded 53718 primary data records. [2025-09-29T22:17:31.686163] [DEBUG] [LOCAL ] VSTS: Loaded 49016 existing records from primary storage. [2025-09-29T22:17:31.711982] [INFO ] [MAIN ] VSTS: Loaded 49016 primary data records. [2025-09-29T22:17:32.267448] [DEBUG] [MAIN ] VSH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:32.268715] [INFO ] [MAIN ] VSH: Generated 1794 derivative records from 48383 primary records. [2025-09-29T22:17:32.269493] [DEBUG] [LOCAL ] VSH: Saving derivative data. [2025-09-29T22:17:32.292391] [DEBUG] [LOCAL ] VSH: Derivative data saved (1794 records). [2025-09-29T22:17:32.294252] [INFO ] [MAIN ] VSH: Successfully saved derivative data. [2025-09-29T22:17:32.296285] [INFO ] [MAIN ] Derivative Progress: 1945/2057 symbols completed. VSH took 1.2s. Estimated remaining: 45.6s. Rate: 147.4 symbols/min [2025-09-29T22:17:32.296590] [INFO ] [MAIN ] VTEX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:32.312322] [DEBUG] [MAIN ] VST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:32.313189] [INFO ] [MAIN ] VST: Generated 1794 derivative records from 53718 primary records. [2025-09-29T22:17:32.313368] [DEBUG] [LOCAL ] VST: Saving derivative data. [2025-09-29T22:17:32.341235] [DEBUG] [LOCAL ] VST: Derivative data saved (1794 records). [2025-09-29T22:17:32.347691] [INFO ] [MAIN ] VST: Successfully saved derivative data. [2025-09-29T22:17:32.347301] [DEBUG] [MAIN ] VSTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:32.351048] [INFO ] [MAIN ] VSTS: Generated 1794 derivative records from 49016 primary records. [2025-09-29T22:17:32.349932] [INFO ] [MAIN ] Derivative Progress: 1946/2057 symbols completed. VST took 1.2s. Estimated remaining: 45.2s. Rate: 147.4 symbols/min [2025-09-29T22:17:32.351254] [INFO ] [MAIN ] VTLE: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:32.351374] [DEBUG] [LOCAL ] VSTS: Saving derivative data. [2025-09-29T22:17:32.379236] [DEBUG] [LOCAL ] VSTS: Derivative data saved (1794 records). [2025-09-29T22:17:32.379377] [INFO ] [MAIN ] VSTS: Successfully saved derivative data. [2025-09-29T22:17:32.381632] [INFO ] [MAIN ] Derivative Progress: 1947/2057 symbols completed. VSTS took 1.2s. Estimated remaining: 44.7s. Rate: 147.5 symbols/min [2025-09-29T22:17:32.382473] [INFO ] [MAIN ] VTMX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:32.398179] [DEBUG] [LOCAL ] VTEX: Loaded 43304 existing records from primary storage. [2025-09-29T22:17:32.398453] [INFO ] [MAIN ] VTEX: Loaded 43304 primary data records. [2025-09-29T22:17:32.529310] [DEBUG] [LOCAL ] VTMX: Loaded 17534 existing records from primary storage. [2025-09-29T22:17:32.568405] [INFO ] [MAIN ] VTMX: Loaded 17534 primary data records. [2025-09-29T22:17:32.626301] [DEBUG] [LOCAL ] VTLE: Loaded 48538 existing records from primary storage. [2025-09-29T22:17:32.801992] [INFO ] [MAIN ] VTLE: Loaded 48538 primary data records. [2025-09-29T22:17:33.484240] [DEBUG] [MAIN ] VTEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:33.485463] [INFO ] [MAIN ] VTEX: Generated 1794 derivative records from 43304 primary records. [2025-09-29T22:17:33.486497] [DEBUG] [LOCAL ] VTEX: Saving derivative data. [2025-09-29T22:17:33.514970] [DEBUG] [MAIN ] VTMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:33.516044] [INFO ] [MAIN ] VTMX: Generated 1794 derivative records from 17534 primary records. [2025-09-29T22:17:33.516394] [DEBUG] [LOCAL ] VTMX: Saving derivative data. [2025-09-29T22:17:33.548128] [DEBUG] [MAIN ] VTLE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:33.550466] [INFO ] [MAIN ] VTLE: Generated 1794 derivative records from 48538 primary records. [2025-09-29T22:17:33.550584] [DEBUG] [LOCAL ] VTEX: Derivative data saved (1794 records). [2025-09-29T22:17:33.551021] [DEBUG] [LOCAL ] VTLE: Saving derivative data. [2025-09-29T22:17:33.551361] [INFO ] [MAIN ] VTEX: Successfully saved derivative data. [2025-09-29T22:17:33.555060] [INFO ] [MAIN ] Derivative Progress: 1948/2057 symbols completed. VTEX took 1.3s. Estimated remaining: 44.4s. Rate: 147.3 symbols/min [2025-09-29T22:17:33.556590] [DEBUG] [LOCAL ] VTMX: Derivative data saved (1794 records). [2025-09-29T22:17:33.564054] [INFO ] [MAIN ] VTMX: Successfully saved derivative data. [2025-09-29T22:17:33.570032] [INFO ] [MAIN ] Derivative Progress: 1949/2057 symbols completed. VTMX took 1.2s. Estimated remaining: 44.0s. Rate: 147.4 symbols/min [2025-09-29T22:17:33.574338] [DEBUG] [LOCAL ] VTLE: Derivative data saved (1794 records). [2025-09-29T22:17:33.574411] [INFO ] [MAIN ] VTLE: Successfully saved derivative data. [2025-09-29T22:17:33.576494] [INFO ] [MAIN ] Derivative Progress: 1950/2057 symbols completed. VTLE took 1.2s. Estimated remaining: 43.5s. Rate: 147.5 symbols/min [2025-09-29T22:17:33.577002] [INFO ] [MAIN ] VTOL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:33.577171] [INFO ] [MAIN ] VTR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:33.576927] [INFO ] [MAIN ] VTN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:33.588718] [DEBUG] [LOCAL ] VTN: Loaded 7072 existing records from primary storage. [2025-09-29T22:17:33.588964] [INFO ] [MAIN ] VTN: Loaded 7072 primary data records. [2025-09-29T22:17:33.686897] [DEBUG] [LOCAL ] VTOL: Loaded 19534 existing records from primary storage. [2025-09-29T22:17:33.713903] [INFO ] [MAIN ] VTOL: Loaded 19534 primary data records. [2025-09-29T22:17:34.060054] [DEBUG] [LOCAL ] VTR: Loaded 52839 existing records from primary storage. [2025-09-29T22:17:34.078455] [INFO ] [MAIN ] VTR: Loaded 52839 primary data records. [2025-09-29T22:17:34.670602] [DEBUG] [MAIN ] VTN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:34.673015] [INFO ] [MAIN ] VTN: Generated 1794 derivative records from 7072 primary records. [2025-09-29T22:17:34.673613] [DEBUG] [LOCAL ] VTN: Saving derivative data. [2025-09-29T22:17:34.699392] [DEBUG] [MAIN ] VTOL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:34.708815] [INFO ] [MAIN ] VTOL: Generated 1794 derivative records from 19534 primary records. [2025-09-29T22:17:34.710619] [DEBUG] [LOCAL ] VTOL: Saving derivative data. [2025-09-29T22:17:34.730882] [DEBUG] [LOCAL ] VTN: Derivative data saved (1794 records). [2025-09-29T22:17:34.733588] [INFO ] [MAIN ] VTN: Successfully saved derivative data. [2025-09-29T22:17:34.737277] [INFO ] [MAIN ] Derivative Progress: 1951/2057 symbols completed. VTN took 1.2s. Estimated remaining: 43.2s. Rate: 147.4 symbols/min [2025-09-29T22:17:34.739043] [INFO ] [MAIN ] VTS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:34.738865] [DEBUG] [LOCAL ] VTOL: Derivative data saved (1794 records). [2025-09-29T22:17:34.739324] [INFO ] [MAIN ] VTOL: Successfully saved derivative data. [2025-09-29T22:17:34.742267] [INFO ] [MAIN ] Derivative Progress: 1952/2057 symbols completed. VTOL took 1.2s. Estimated remaining: 42.7s. Rate: 147.4 symbols/min [2025-09-29T22:17:34.743550] [INFO ] [MAIN ] VVR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:34.761229] [DEBUG] [MAIN ] VTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:34.762117] [INFO ] [MAIN ] VTR: Generated 1794 derivative records from 52839 primary records. [2025-09-29T22:17:34.762293] [DEBUG] [LOCAL ] VTR: Saving derivative data. [2025-09-29T22:17:34.798990] [DEBUG] [LOCAL ] VTR: Derivative data saved (1794 records). [2025-09-29T22:17:34.799393] [INFO ] [MAIN ] VTR: Successfully saved derivative data. [2025-09-29T22:17:34.801713] [INFO ] [MAIN ] Derivative Progress: 1953/2057 symbols completed. VTR took 1.2s. Estimated remaining: 42.3s. Rate: 147.5 symbols/min [2025-09-29T22:17:34.802033] [INFO ] [MAIN ] VVV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:34.830150] [DEBUG] [LOCAL ] VTS: Loaded 30560 existing records from primary storage. [2025-09-29T22:17:34.831614] [INFO ] [MAIN ] VTS: Loaded 30560 primary data records. [2025-09-29T22:17:34.837487] [DEBUG] [LOCAL ] VVR: Loaded 31013 existing records from primary storage. [2025-09-29T22:17:34.854678] [INFO ] [MAIN ] VVR: Loaded 31013 primary data records. [2025-09-29T22:17:35.534334] [DEBUG] [LOCAL ] VVV: Loaded 50186 existing records from primary storage. [2025-09-29T22:17:35.535910] [INFO ] [MAIN ] VVV: Loaded 50186 primary data records. [2025-09-29T22:17:35.927905] [DEBUG] [MAIN ] VTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:35.930215] [INFO ] [MAIN ] VTS: Generated 1794 derivative records from 30560 primary records. [2025-09-29T22:17:35.930565] [DEBUG] [LOCAL ] VTS: Saving derivative data. [2025-09-29T22:17:35.961444] [DEBUG] [MAIN ] VVR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:35.962904] [INFO ] [MAIN ] VVR: Generated 1794 derivative records from 31013 primary records. [2025-09-29T22:17:35.963205] [DEBUG] [LOCAL ] VVR: Saving derivative data. [2025-09-29T22:17:35.980340] [DEBUG] [LOCAL ] VTS: Derivative data saved (1794 records). [2025-09-29T22:17:35.981077] [INFO ] [MAIN ] VTS: Successfully saved derivative data. [2025-09-29T22:17:35.983781] [INFO ] [MAIN ] Derivative Progress: 1954/2057 symbols completed. VTS took 1.2s. Estimated remaining: 41.9s. Rate: 147.3 symbols/min [2025-09-29T22:17:35.984321] [INFO ] [MAIN ] VVX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:35.992565] [DEBUG] [LOCAL ] VVR: Derivative data saved (1794 records). [2025-09-29T22:17:35.992893] [INFO ] [MAIN ] VVR: Successfully saved derivative data. [2025-09-29T22:17:35.995098] [INFO ] [MAIN ] Derivative Progress: 1955/2057 symbols completed. VVR took 1.3s. Estimated remaining: 41.5s. Rate: 147.4 symbols/min [2025-09-29T22:17:35.995473] [INFO ] [MAIN ] VYX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:36.014453] [DEBUG] [MAIN ] VVV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:36.015302] [INFO ] [MAIN ] VVV: Generated 1794 derivative records from 50186 primary records. [2025-09-29T22:17:36.015439] [DEBUG] [LOCAL ] VVV: Saving derivative data. [2025-09-29T22:17:36.045136] [DEBUG] [LOCAL ] VVX: Loaded 23189 existing records from primary storage. [2025-09-29T22:17:36.045610] [INFO ] [MAIN ] VVX: Loaded 23189 primary data records. [2025-09-29T22:17:36.144402] [DEBUG] [LOCAL ] VVV: Derivative data saved (1794 records). [2025-09-29T22:17:36.165439] [INFO ] [MAIN ] VVV: Successfully saved derivative data. [2025-09-29T22:17:36.171986] [INFO ] [MAIN ] Derivative Progress: 1956/2057 symbols completed. VVV took 1.4s. Estimated remaining: 41.1s. Rate: 147.5 symbols/min [2025-09-29T22:17:36.188949] [INFO ] [MAIN ] VZ: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:36.390831] [DEBUG] [LOCAL ] VYX: Loaded 48802 existing records from primary storage. [2025-09-29T22:17:36.398754] [INFO ] [MAIN ] VYX: Loaded 48802 primary data records. [2025-09-29T22:17:36.761599] [DEBUG] [LOCAL ] VZ: Loaded 53791 existing records from primary storage. [2025-09-29T22:17:36.762972] [INFO ] [MAIN ] VZ: Loaded 53791 primary data records. [2025-09-29T22:17:36.949080] [DEBUG] [MAIN ] VVX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:36.984163] [INFO ] [MAIN ] VVX: Generated 1794 derivative records from 23189 primary records. [2025-09-29T22:17:37.138970] [DEBUG] [LOCAL ] VVX: Saving derivative data. [2025-09-29T22:17:37.193394] [DEBUG] [MAIN ] VYX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:37.195342] [INFO ] [MAIN ] VYX: Generated 1794 derivative records from 48802 primary records. [2025-09-29T22:17:37.195453] [DEBUG] [LOCAL ] VYX: Saving derivative data. [2025-09-29T22:17:37.197173] [DEBUG] [LOCAL ] VVX: Derivative data saved (1794 records). [2025-09-29T22:17:37.205320] [INFO ] [MAIN ] VVX: Successfully saved derivative data. [2025-09-29T22:17:37.211834] [INFO ] [MAIN ] Derivative Progress: 1957/2057 symbols completed. VVX took 1.2s. Estimated remaining: 40.7s. Rate: 147.3 symbols/min [2025-09-29T22:17:37.212523] [INFO ] [MAIN ] W: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:37.219157] [DEBUG] [LOCAL ] VYX: Derivative data saved (1794 records). [2025-09-29T22:17:37.219474] [INFO ] [MAIN ] VYX: Successfully saved derivative data. [2025-09-29T22:17:37.221659] [INFO ] [MAIN ] Derivative Progress: 1958/2057 symbols completed. VYX took 1.2s. Estimated remaining: 40.3s. Rate: 147.4 symbols/min [2025-09-29T22:17:37.221945] [INFO ] [MAIN ] WAB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:37.240021] [DEBUG] [MAIN ] VZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:37.240894] [INFO ] [MAIN ] VZ: Generated 1794 derivative records from 53791 primary records. [2025-09-29T22:17:37.241024] [DEBUG] [LOCAL ] VZ: Saving derivative data. [2025-09-29T22:17:37.259801] [DEBUG] [LOCAL ] VZ: Derivative data saved (1794 records). [2025-09-29T22:17:37.259899] [INFO ] [MAIN ] VZ: Successfully saved derivative data. [2025-09-29T22:17:37.262283] [INFO ] [MAIN ] Derivative Progress: 1959/2057 symbols completed. VZ took 1.1s. Estimated remaining: 39.9s. Rate: 147.5 symbols/min [2025-09-29T22:17:37.262598] [INFO ] [MAIN ] WAL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:37.327966] [DEBUG] [LOCAL ] W: Loaded 53489 existing records from primary storage. [2025-09-29T22:17:37.328832] [INFO ] [MAIN ] W: Loaded 53489 primary data records. [2025-09-29T22:17:37.451088] [DEBUG] [LOCAL ] WAB: Loaded 44166 existing records from primary storage. [2025-09-29T22:17:37.472552] [INFO ] [MAIN ] WAB: Loaded 44166 primary data records. [2025-09-29T22:17:37.539230] [DEBUG] [LOCAL ] WAL: Loaded 45253 existing records from primary storage. [2025-09-29T22:17:37.583851] [INFO ] [MAIN ] WAL: Loaded 45253 primary data records. [2025-09-29T22:17:38.370501] [DEBUG] [MAIN ] W: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:38.372810] [INFO ] [MAIN ] W: Generated 1794 derivative records from 53489 primary records. [2025-09-29T22:17:38.373028] [DEBUG] [LOCAL ] W: Saving derivative data. [2025-09-29T22:17:38.404701] [DEBUG] [MAIN ] WAB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:38.408393] [INFO ] [MAIN ] WAB: Generated 1794 derivative records from 44166 primary records. [2025-09-29T22:17:38.408851] [DEBUG] [LOCAL ] WAB: Saving derivative data. [2025-09-29T22:17:38.441506] [DEBUG] [MAIN ] WAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:38.447212] [DEBUG] [LOCAL ] WAB: Derivative data saved (1794 records). [2025-09-29T22:17:38.448615] [INFO ] [MAIN ] WAL: Generated 1794 derivative records from 45253 primary records. [2025-09-29T22:17:38.449815] [DEBUG] [LOCAL ] W: Derivative data saved (1794 records). [2025-09-29T22:17:38.449018] [INFO ] [MAIN ] WAB: Successfully saved derivative data. [2025-09-29T22:17:38.451885] [INFO ] [MAIN ] Derivative Progress: 1960/2057 symbols completed. WAB took 1.2s. Estimated remaining: 39.5s. Rate: 147.3 symbols/min [2025-09-29T22:17:38.452028] [INFO ] [MAIN ] W: Successfully saved derivative data. [2025-09-29T22:17:38.449245] [DEBUG] [LOCAL ] WAL: Saving derivative data. [2025-09-29T22:17:38.454538] [INFO ] [MAIN ] WAT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:38.455253] [INFO ] [MAIN ] Derivative Progress: 1961/2057 symbols completed. W took 1.2s. Estimated remaining: 39.1s. Rate: 147.4 symbols/min [2025-09-29T22:17:38.456001] [INFO ] [MAIN ] WBS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:38.472711] [DEBUG] [LOCAL ] WAL: Derivative data saved (1794 records). [2025-09-29T22:17:38.472972] [INFO ] [MAIN ] WAL: Successfully saved derivative data. [2025-09-29T22:17:38.475198] [INFO ] [MAIN ] Derivative Progress: 1962/2057 symbols completed. WAL took 1.2s. Estimated remaining: 38.6s. Rate: 147.5 symbols/min [2025-09-29T22:17:38.475538] [INFO ] [MAIN ] WBX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:38.498558] [DEBUG] [LOCAL ] WBX: Loaded 11843 existing records from primary storage. [2025-09-29T22:17:38.498829] [INFO ] [MAIN ] WBX: Loaded 11843 primary data records. [2025-09-29T22:17:38.638893] [DEBUG] [LOCAL ] WAT: Loaded 35125 existing records from primary storage. [2025-09-29T22:17:38.643618] [INFO ] [MAIN ] WAT: Loaded 35125 primary data records. [2025-09-29T22:17:38.839080] [DEBUG] [LOCAL ] WBS: Loaded 48686 existing records from primary storage. [2025-09-29T22:17:38.991727] [INFO ] [MAIN ] WBS: Loaded 48686 primary data records. [2025-09-29T22:17:39.631564] [DEBUG] [MAIN ] WBX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:39.632908] [INFO ] [MAIN ] WBX: Generated 1794 derivative records from 11843 primary records. [2025-09-29T22:17:39.633383] [DEBUG] [LOCAL ] WBX: Saving derivative data. [2025-09-29T22:17:39.651487] [DEBUG] [LOCAL ] WBX: Derivative data saved (1794 records). [2025-09-29T22:17:39.651996] [INFO ] [MAIN ] WBX: Successfully saved derivative data. [2025-09-29T22:17:39.654359] [INFO ] [MAIN ] Derivative Progress: 1963/2057 symbols completed. WBX took 1.2s. Estimated remaining: 38.3s. Rate: 147.3 symbols/min [2025-09-29T22:17:39.674541] [DEBUG] [MAIN ] WAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:39.675516] [INFO ] [MAIN ] WAT: Generated 1794 derivative records from 35125 primary records. [2025-09-29T22:17:39.676422] [DEBUG] [LOCAL ] WAT: Saving derivative data. [2025-09-29T22:17:39.707311] [DEBUG] [MAIN ] WBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:39.708854] [INFO ] [MAIN ] WBS: Generated 1794 derivative records from 48686 primary records. [2025-09-29T22:17:39.709168] [DEBUG] [LOCAL ] WBS: Saving derivative data. [2025-09-29T22:17:39.713195] [DEBUG] [LOCAL ] WAT: Derivative data saved (1794 records). [2025-09-29T22:17:39.726046] [INFO ] [MAIN ] WAT: Successfully saved derivative data. [2025-09-29T22:17:39.730271] [DEBUG] [LOCAL ] WBS: Derivative data saved (1794 records). [2025-09-29T22:17:39.730396] [INFO ] [MAIN ] WBS: Successfully saved derivative data. [2025-09-29T22:17:39.732242] [INFO ] [MAIN ] Derivative Progress: 1964/2057 symbols completed. WAT took 1.3s. Estimated remaining: 37.9s. Rate: 147.4 symbols/min [2025-09-29T22:17:39.734447] [INFO ] [MAIN ] Derivative Progress: 1965/2057 symbols completed. WBS took 1.3s. Estimated remaining: 37.4s. Rate: 147.5 symbols/min [2025-09-29T22:17:39.734906] [INFO ] [MAIN ] WCN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:39.735052] [INFO ] [MAIN ] WCC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:39.735422] [INFO ] [MAIN ] WD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:39.773987] [DEBUG] [LOCAL ] WD: Loaded 23224 existing records from primary storage. [2025-09-29T22:17:39.774160] [INFO ] [MAIN ] WD: Loaded 23224 primary data records. [2025-09-29T22:17:39.890683] [DEBUG] [LOCAL ] WCC: Loaded 39763 existing records from primary storage. [2025-09-29T22:17:39.914435] [INFO ] [MAIN ] WCC: Loaded 39763 primary data records. [2025-09-29T22:17:40.254285] [DEBUG] [LOCAL ] WCN: Loaded 47959 existing records from primary storage. [2025-09-29T22:17:40.299587] [INFO ] [MAIN ] WCN: Loaded 47959 primary data records. [2025-09-29T22:17:40.901384] [DEBUG] [MAIN ] WD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:40.902592] [INFO ] [MAIN ] WD: Generated 1794 derivative records from 23224 primary records. [2025-09-29T22:17:40.902857] [DEBUG] [LOCAL ] WD: Saving derivative data. [2025-09-29T22:17:40.939454] [DEBUG] [MAIN ] WCC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:40.940528] [INFO ] [MAIN ] WCC: Generated 1794 derivative records from 39763 primary records. [2025-09-29T22:17:40.938871] [DEBUG] [LOCAL ] WD: Derivative data saved (1794 records). [2025-09-29T22:17:40.940800] [DEBUG] [LOCAL ] WCC: Saving derivative data. [2025-09-29T22:17:40.940906] [INFO ] [MAIN ] WD: Successfully saved derivative data. [2025-09-29T22:17:40.943356] [INFO ] [MAIN ] Derivative Progress: 1966/2057 symbols completed. WD took 1.2s. Estimated remaining: 37.1s. Rate: 147.3 symbols/min [2025-09-29T22:17:40.944476] [INFO ] [MAIN ] WDH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:40.962847] [DEBUG] [LOCAL ] WCC: Derivative data saved (1794 records). [2025-09-29T22:17:40.963467] [INFO ] [MAIN ] WCC: Successfully saved derivative data. [2025-09-29T22:17:40.966859] [INFO ] [MAIN ] Derivative Progress: 1967/2057 symbols completed. WCC took 1.2s. Estimated remaining: 36.6s. Rate: 147.4 symbols/min [2025-09-29T22:17:40.969218] [INFO ] [MAIN ] WDI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:40.989035] [DEBUG] [MAIN ] WCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:40.990054] [INFO ] [MAIN ] WCN: Generated 1794 derivative records from 47959 primary records. [2025-09-29T22:17:40.990225] [DEBUG] [LOCAL ] WCN: Saving derivative data. [2025-09-29T22:17:41.010611] [DEBUG] [LOCAL ] WDH: Loaded 17598 existing records from primary storage. [2025-09-29T22:17:41.019558] [DEBUG] [LOCAL ] WCN: Derivative data saved (1794 records). [2025-09-29T22:17:41.019777] [INFO ] [MAIN ] WCN: Successfully saved derivative data. [2025-09-29T22:17:41.019899] [INFO ] [MAIN ] WDH: Loaded 17598 primary data records. [2025-09-29T22:17:41.022105] [INFO ] [MAIN ] Derivative Progress: 1968/2057 symbols completed. WCN took 1.3s. Estimated remaining: 36.2s. Rate: 147.5 symbols/min [2025-09-29T22:17:41.034786] [INFO ] [MAIN ] WDS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:41.110682] [DEBUG] [LOCAL ] WDI: Loaded 21038 existing records from primary storage. [2025-09-29T22:17:41.128101] [INFO ] [MAIN ] WDI: Loaded 21038 primary data records. [2025-09-29T22:17:41.745342] [DEBUG] [LOCAL ] WDS: Loaded 43456 existing records from primary storage. [2025-09-29T22:17:41.745723] [INFO ] [MAIN ] WDS: Loaded 43456 primary data records. [2025-09-29T22:17:42.129407] [DEBUG] [MAIN ] WDH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:42.130518] [INFO ] [MAIN ] WDH: Generated 1794 derivative records from 17598 primary records. [2025-09-29T22:17:42.130882] [DEBUG] [LOCAL ] WDH: Saving derivative data. [2025-09-29T22:17:42.167051] [DEBUG] [MAIN ] WDI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:42.168952] [INFO ] [MAIN ] WDI: Generated 1794 derivative records from 21038 primary records. [2025-09-29T22:17:42.169479] [DEBUG] [LOCAL ] WDI: Saving derivative data. [2025-09-29T22:17:42.169407] [DEBUG] [LOCAL ] WDH: Derivative data saved (1794 records). [2025-09-29T22:17:42.169616] [INFO ] [MAIN ] WDH: Successfully saved derivative data. [2025-09-29T22:17:42.175922] [INFO ] [MAIN ] Derivative Progress: 1969/2057 symbols completed. WDH took 1.2s. Estimated remaining: 35.8s. Rate: 147.3 symbols/min [2025-09-29T22:17:42.176574] [INFO ] [MAIN ] WEA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:42.199091] [DEBUG] [LOCAL ] WDI: Derivative data saved (1794 records). [2025-09-29T22:17:42.199298] [INFO ] [MAIN ] WDI: Successfully saved derivative data. [2025-09-29T22:17:42.201430] [INFO ] [MAIN ] Derivative Progress: 1970/2057 symbols completed. WDI took 1.2s. Estimated remaining: 35.4s. Rate: 147.4 symbols/min [2025-09-29T22:17:42.201987] [INFO ] [MAIN ] WEAV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:42.209683] [DEBUG] [LOCAL ] WEA: Loaded 7302 existing records from primary storage. [2025-09-29T22:17:42.210007] [INFO ] [MAIN ] WEA: Loaded 7302 primary data records. [2025-09-29T22:17:42.320170] [DEBUG] [MAIN ] WDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:42.341816] [INFO ] [MAIN ] WDS: Generated 1794 derivative records from 43456 primary records. [2025-09-29T22:17:42.345849] [DEBUG] [LOCAL ] WDS: Saving derivative data. [2025-09-29T22:17:42.604203] [DEBUG] [LOCAL ] WEAV: Loaded 41848 existing records from primary storage. [2025-09-29T22:17:42.604790] [INFO ] [MAIN ] WEAV: Loaded 41848 primary data records. [2025-09-29T22:17:42.604866] [DEBUG] [LOCAL ] WDS: Derivative data saved (1794 records). [2025-09-29T22:17:42.617069] [INFO ] [MAIN ] WDS: Successfully saved derivative data. [2025-09-29T22:17:42.640007] [INFO ] [MAIN ] Derivative Progress: 1971/2057 symbols completed. WDS took 1.6s. Estimated remaining: 35.0s. Rate: 147.4 symbols/min [2025-09-29T22:17:42.667593] [INFO ] [MAIN ] WEC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:42.953887] [DEBUG] [MAIN ] WEA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:42.955378] [INFO ] [MAIN ] WEA: Generated 1794 derivative records from 7302 primary records. [2025-09-29T22:17:42.955476] [DEBUG] [LOCAL ] WEA: Saving derivative data. [2025-09-29T22:17:42.986710] [DEBUG] [LOCAL ] WEA: Derivative data saved (1794 records). [2025-09-29T22:17:42.986857] [INFO ] [MAIN ] WEA: Successfully saved derivative data. [2025-09-29T22:17:42.989112] [INFO ] [MAIN ] Derivative Progress: 1972/2057 symbols completed. WEA took 0.8s. Estimated remaining: 34.6s. Rate: 147.4 symbols/min [2025-09-29T22:17:42.989507] [INFO ] [MAIN ] WELL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:43.011415] [DEBUG] [LOCAL ] WEC: Loaded 52172 existing records from primary storage. [2025-09-29T22:17:43.011847] [INFO ] [MAIN ] WEC: Loaded 52172 primary data records. [2025-09-29T22:17:43.158298] [DEBUG] [MAIN ] WEAV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:43.174840] [INFO ] [MAIN ] WEAV: Generated 1794 derivative records from 41848 primary records. [2025-09-29T22:17:43.211027] [DEBUG] [LOCAL ] WEAV: Saving derivative data. [2025-09-29T22:17:43.424014] [DEBUG] [LOCAL ] WELL: Loaded 52365 existing records from primary storage. [2025-09-29T22:17:43.424757] [INFO ] [MAIN ] WELL: Loaded 52365 primary data records. [2025-09-29T22:17:43.498007] [DEBUG] [LOCAL ] WEAV: Derivative data saved (1794 records). [2025-09-29T22:17:43.521074] [INFO ] [MAIN ] WEAV: Successfully saved derivative data. [2025-09-29T22:17:43.533909] [INFO ] [MAIN ] Derivative Progress: 1973/2057 symbols completed. WEAV took 1.3s. Estimated remaining: 34.2s. Rate: 147.4 symbols/min [2025-09-29T22:17:43.534300] [INFO ] [MAIN ] WES: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:43.801868] [DEBUG] [MAIN ] WEC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:43.802908] [INFO ] [MAIN ] WEC: Generated 1794 derivative records from 52172 primary records. [2025-09-29T22:17:43.803420] [DEBUG] [LOCAL ] WEC: Saving derivative data. [2025-09-29T22:17:43.833547] [DEBUG] [LOCAL ] WEC: Derivative data saved (1794 records). [2025-09-29T22:17:43.835133] [INFO ] [MAIN ] WEC: Successfully saved derivative data. [2025-09-29T22:17:43.837617] [INFO ] [MAIN ] Derivative Progress: 1974/2057 symbols completed. WEC took 1.2s. Estimated remaining: 33.8s. Rate: 147.4 symbols/min [2025-09-29T22:17:43.838172] [INFO ] [MAIN ] WEX: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:43.855376] [DEBUG] [LOCAL ] WES: Loaded 47949 existing records from primary storage. [2025-09-29T22:17:43.855814] [INFO ] [MAIN ] WES: Loaded 47949 primary data records. [2025-09-29T22:17:43.982085] [DEBUG] [MAIN ] WELL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:43.993900] [INFO ] [MAIN ] WELL: Generated 1794 derivative records from 52365 primary records. [2025-09-29T22:17:44.004754] [DEBUG] [LOCAL ] WELL: Saving derivative data. [2025-09-29T22:17:44.225029] [DEBUG] [LOCAL ] WEX: Loaded 34822 existing records from primary storage. [2025-09-29T22:17:44.228817] [INFO ] [MAIN ] WEX: Loaded 34822 primary data records. [2025-09-29T22:17:44.349607] [DEBUG] [LOCAL ] WELL: Derivative data saved (1794 records). [2025-09-29T22:17:44.349843] [INFO ] [MAIN ] WELL: Successfully saved derivative data. [2025-09-29T22:17:44.352114] [INFO ] [MAIN ] Derivative Progress: 1975/2057 symbols completed. WELL took 1.4s. Estimated remaining: 33.4s. Rate: 147.4 symbols/min [2025-09-29T22:17:44.352975] [INFO ] [MAIN ] WF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:44.564845] [DEBUG] [LOCAL ] WF: Loaded 10719 existing records from primary storage. [2025-09-29T22:17:44.565109] [INFO ] [MAIN ] WF: Loaded 10719 primary data records. [2025-09-29T22:17:44.774078] [DEBUG] [MAIN ] WES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:44.897708] [INFO ] [MAIN ] WES: Generated 1794 derivative records from 47949 primary records. [2025-09-29T22:17:44.906456] [DEBUG] [LOCAL ] WES: Saving derivative data. [2025-09-29T22:17:44.925583] [DEBUG] [LOCAL ] WES: Derivative data saved (1794 records). [2025-09-29T22:17:44.926346] [INFO ] [MAIN ] WES: Successfully saved derivative data. [2025-09-29T22:17:44.930241] [INFO ] [MAIN ] Derivative Progress: 1976/2057 symbols completed. WES took 1.4s. Estimated remaining: 33.0s. Rate: 147.4 symbols/min [2025-09-29T22:17:44.933078] [INFO ] [MAIN ] WFC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:44.949296] [DEBUG] [MAIN ] WEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:44.950209] [INFO ] [MAIN ] WEX: Generated 1794 derivative records from 34822 primary records. [2025-09-29T22:17:44.950377] [DEBUG] [LOCAL ] WEX: Saving derivative data. [2025-09-29T22:17:44.971675] [DEBUG] [LOCAL ] WEX: Derivative data saved (1794 records). [2025-09-29T22:17:44.971836] [INFO ] [MAIN ] WEX: Successfully saved derivative data. [2025-09-29T22:17:44.975285] [INFO ] [MAIN ] Derivative Progress: 1977/2057 symbols completed. WEX took 1.1s. Estimated remaining: 32.6s. Rate: 147.4 symbols/min [2025-09-29T22:17:44.976344] [INFO ] [MAIN ] WFG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:44.991561] [DEBUG] [MAIN ] WF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:44.992348] [INFO ] [MAIN ] WF: Generated 1794 derivative records from 10719 primary records. [2025-09-29T22:17:44.992445] [DEBUG] [LOCAL ] WF: Saving derivative data. [2025-09-29T22:17:45.038332] [DEBUG] [LOCAL ] WF: Derivative data saved (1794 records). [2025-09-29T22:17:45.049524] [INFO ] [MAIN ] WF: Successfully saved derivative data. [2025-09-29T22:17:45.067699] [DEBUG] [LOCAL ] WFG: Loaded 24760 existing records from primary storage. [2025-09-29T22:17:45.067128] [INFO ] [MAIN ] Derivative Progress: 1978/2057 symbols completed. WF took 0.7s. Estimated remaining: 32.1s. Rate: 147.5 symbols/min [2025-09-29T22:17:45.068263] [INFO ] [MAIN ] WFG: Loaded 24760 primary data records. [2025-09-29T22:17:45.069408] [DEBUG] [LOCAL ] WFC: Loaded 53748 existing records from primary storage. [2025-09-29T22:17:45.104287] [INFO ] [MAIN ] WFC: Loaded 53748 primary data records. [2025-09-29T22:17:45.774002] [DEBUG] [MAIN ] WFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:45.787258] [INFO ] [MAIN ] WFG: Generated 1794 derivative records from 24760 primary records. [2025-09-29T22:17:45.787599] [DEBUG] [MAIN ] WFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:45.787691] [DEBUG] [LOCAL ] WFG: Saving derivative data. [2025-09-29T22:17:45.788728] [INFO ] [MAIN ] WFC: Generated 1794 derivative records from 53748 primary records. [2025-09-29T22:17:45.789053] [DEBUG] [LOCAL ] WFC: Saving derivative data. [2025-09-29T22:17:45.818591] [DEBUG] [LOCAL ] WFC: Derivative data saved (1794 records). [2025-09-29T22:17:45.819159] [INFO ] [MAIN ] WFC: Successfully saved derivative data. [2025-09-29T22:17:45.821801] [INFO ] [MAIN ] Derivative Progress: 1979/2057 symbols completed. WFC took 0.9s. Estimated remaining: 31.7s. Rate: 147.4 symbols/min [2025-09-29T22:17:45.823542] [DEBUG] [LOCAL ] WFG: Derivative data saved (1794 records). [2025-09-29T22:17:45.823632] [INFO ] [MAIN ] WFG: Successfully saved derivative data. [2025-09-29T22:17:45.825935] [INFO ] [MAIN ] Derivative Progress: 1980/2057 symbols completed. WFG took 0.8s. Estimated remaining: 31.3s. Rate: 147.5 symbols/min [2025-09-29T22:17:45.826374] [INFO ] [MAIN ] WHD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:45.826299] [INFO ] [MAIN ] WH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:45.826442] [INFO ] [MAIN ] WGO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:45.921071] [DEBUG] [LOCAL ] WGO: Loaded 39119 existing records from primary storage. [2025-09-29T22:17:45.921688] [DEBUG] [LOCAL ] WHD: Loaded 40413 existing records from primary storage. [2025-09-29T22:17:45.922189] [INFO ] [MAIN ] WHD: Loaded 40413 primary data records. [2025-09-29T22:17:45.922092] [INFO ] [MAIN ] WGO: Loaded 39119 primary data records. [2025-09-29T22:17:45.991363] [DEBUG] [LOCAL ] WH: Loaded 45535 existing records from primary storage. [2025-09-29T22:17:46.012706] [INFO ] [MAIN ] WH: Loaded 45535 primary data records. [2025-09-29T22:17:46.938111] [DEBUG] [MAIN ] WHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:46.940628] [INFO ] [MAIN ] WHD: Generated 1794 derivative records from 40413 primary records. [2025-09-29T22:17:46.940874] [DEBUG] [LOCAL ] WHD: Saving derivative data. [2025-09-29T22:17:46.970083] [DEBUG] [MAIN ] WGO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:46.975711] [DEBUG] [LOCAL ] WHD: Derivative data saved (1794 records). [2025-09-29T22:17:46.975233] [INFO ] [MAIN ] WGO: Generated 1794 derivative records from 39119 primary records. [2025-09-29T22:17:46.975859] [INFO ] [MAIN ] WHD: Successfully saved derivative data. [2025-09-29T22:17:46.979631] [INFO ] [MAIN ] Derivative Progress: 1981/2057 symbols completed. WHD took 1.2s. Estimated remaining: 30.9s. Rate: 147.3 symbols/min [2025-09-29T22:17:46.979873] [DEBUG] [LOCAL ] WGO: Saving derivative data. [2025-09-29T22:17:46.988936] [INFO ] [MAIN ] WHG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:47.006674] [DEBUG] [MAIN ] WH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:47.008104] [INFO ] [MAIN ] WH: Generated 1794 derivative records from 45535 primary records. [2025-09-29T22:17:47.009743] [DEBUG] [LOCAL ] WH: Saving derivative data. [2025-09-29T22:17:47.024905] [DEBUG] [LOCAL ] WHG: Loaded 3311 existing records from primary storage. [2025-09-29T22:17:47.033175] [DEBUG] [LOCAL ] WH: Derivative data saved (1794 records). [2025-09-29T22:17:47.033333] [INFO ] [MAIN ] WH: Successfully saved derivative data. [2025-09-29T22:17:47.029408] [DEBUG] [LOCAL ] WGO: Derivative data saved (1794 records). [2025-09-29T22:17:47.033561] [INFO ] [MAIN ] WGO: Successfully saved derivative data. [2025-09-29T22:17:47.036985] [INFO ] [MAIN ] Derivative Progress: 1982/2057 symbols completed. WGO took 1.2s. Estimated remaining: 30.5s. Rate: 147.4 symbols/min [2025-09-29T22:17:47.028607] [INFO ] [MAIN ] WHG: Loaded 3311 primary data records. [2025-09-29T22:17:47.044686] [INFO ] [MAIN ] WHR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:47.070300] [INFO ] [MAIN ] Derivative Progress: 1983/2057 symbols completed. WH took 1.2s. Estimated remaining: 30.1s. Rate: 147.5 symbols/min [2025-09-29T22:17:47.070604] [INFO ] [MAIN ] WIA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:47.162141] [DEBUG] [LOCAL ] WIA: Loaded 4851 existing records from primary storage. [2025-09-29T22:17:47.184209] [INFO ] [MAIN ] WIA: Loaded 4851 primary data records. [2025-09-29T22:17:47.591241] [DEBUG] [LOCAL ] WHR: Loaded 48178 existing records from primary storage. [2025-09-29T22:17:47.621966] [INFO ] [MAIN ] WHR: Loaded 48178 primary data records. [2025-09-29T22:17:48.144308] [DEBUG] [MAIN ] WHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:48.145191] [INFO ] [MAIN ] WHG: Generated 1794 derivative records from 3311 primary records. [2025-09-29T22:17:48.145471] [DEBUG] [LOCAL ] WHG: Saving derivative data. [2025-09-29T22:17:48.165504] [DEBUG] [LOCAL ] WHG: Derivative data saved (1794 records). [2025-09-29T22:17:48.166112] [INFO ] [MAIN ] WHG: Successfully saved derivative data. [2025-09-29T22:17:48.168797] [INFO ] [MAIN ] Derivative Progress: 1984/2057 symbols completed. WHG took 1.2s. Estimated remaining: 29.7s. Rate: 147.4 symbols/min [2025-09-29T22:17:48.169304] [INFO ] [MAIN ] WINN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:48.187840] [DEBUG] [MAIN ] WIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:48.191951] [INFO ] [MAIN ] WIA: Generated 1794 derivative records from 4851 primary records. [2025-09-29T22:17:48.192121] [DEBUG] [LOCAL ] WIA: Saving derivative data. [2025-09-29T22:17:48.207941] [DEBUG] [LOCAL ] WINN: Loaded 11668 existing records from primary storage. [2025-09-29T22:17:48.209764] [INFO ] [MAIN ] WINN: Loaded 11668 primary data records. [2025-09-29T22:17:48.286866] [DEBUG] [LOCAL ] WIA: Derivative data saved (1794 records). [2025-09-29T22:17:48.317279] [INFO ] [MAIN ] WIA: Successfully saved derivative data. [2025-09-29T22:17:48.335575] [INFO ] [MAIN ] Derivative Progress: 1985/2057 symbols completed. WIA took 1.3s. Estimated remaining: 29.3s. Rate: 147.4 symbols/min [2025-09-29T22:17:48.341858] [DEBUG] [MAIN ] WHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:48.353333] [INFO ] [MAIN ] WHR: Generated 1794 derivative records from 48178 primary records. [2025-09-29T22:17:48.347188] [INFO ] [MAIN ] WIT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:48.363751] [DEBUG] [LOCAL ] WHR: Saving derivative data. [2025-09-29T22:17:48.553338] [DEBUG] [LOCAL ] WHR: Derivative data saved (1794 records). [2025-09-29T22:17:48.562685] [INFO ] [MAIN ] WHR: Successfully saved derivative data. [2025-09-29T22:17:48.564976] [INFO ] [MAIN ] Derivative Progress: 1986/2057 symbols completed. WHR took 1.5s. Estimated remaining: 28.9s. Rate: 147.4 symbols/min [2025-09-29T22:17:48.565195] [INFO ] [MAIN ] WIW: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:48.604050] [DEBUG] [LOCAL ] WIW: Loaded 20346 existing records from primary storage. [2025-09-29T22:17:48.604519] [INFO ] [MAIN ] WIW: Loaded 20346 primary data records. [2025-09-29T22:17:48.746760] [DEBUG] [LOCAL ] WIT: Loaded 52326 existing records from primary storage. [2025-09-29T22:17:48.752859] [INFO ] [MAIN ] WIT: Loaded 52326 primary data records. [2025-09-29T22:17:48.753178] [DEBUG] [MAIN ] WINN: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:17:48.759140] [INFO ] [MAIN ] WINN: Generated 1793 derivative records from 11668 primary records. [2025-09-29T22:17:48.764379] [DEBUG] [LOCAL ] WINN: Saving derivative data. [2025-09-29T22:17:49.250718] [DEBUG] [LOCAL ] WINN: Derivative data saved (1793 records). [2025-09-29T22:17:49.315907] [INFO ] [MAIN ] WINN: Successfully saved derivative data. [2025-09-29T22:17:49.319042] [INFO ] [MAIN ] Derivative Progress: 1987/2057 symbols completed. WINN took 1.1s. Estimated remaining: 28.5s. Rate: 147.4 symbols/min [2025-09-29T22:17:49.319557] [INFO ] [MAIN ] WK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:49.347799] [DEBUG] [MAIN ] WIW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:49.348737] [INFO ] [MAIN ] WIW: Generated 1794 derivative records from 20346 primary records. [2025-09-29T22:17:49.351724] [DEBUG] [LOCAL ] WIW: Saving derivative data. [2025-09-29T22:17:49.413423] [DEBUG] [MAIN ] WIT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:49.415684] [INFO ] [MAIN ] WIT: Generated 1794 derivative records from 52326 primary records. [2025-09-29T22:17:49.414701] [DEBUG] [LOCAL ] WIW: Derivative data saved (1794 records). [2025-09-29T22:17:49.415862] [INFO ] [MAIN ] WIW: Successfully saved derivative data. [2025-09-29T22:17:49.415960] [DEBUG] [LOCAL ] WIT: Saving derivative data. [2025-09-29T22:17:49.416795] [DEBUG] [LOCAL ] WK: Loaded 36964 existing records from primary storage. [2025-09-29T22:17:49.418982] [INFO ] [MAIN ] Derivative Progress: 1988/2057 symbols completed. WIW took 0.9s. Estimated remaining: 28.1s. Rate: 147.4 symbols/min [2025-09-29T22:17:49.419203] [INFO ] [MAIN ] WKC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:49.419297] [INFO ] [MAIN ] WK: Loaded 36964 primary data records. [2025-09-29T22:17:49.635778] [DEBUG] [LOCAL ] WIT: Derivative data saved (1794 records). [2025-09-29T22:17:49.766025] [INFO ] [MAIN ] WIT: Successfully saved derivative data. [2025-09-29T22:17:49.769711] [INFO ] [MAIN ] Derivative Progress: 1989/2057 symbols completed. WIT took 1.4s. Estimated remaining: 27.7s. Rate: 147.4 symbols/min [2025-09-29T22:17:49.780310] [INFO ] [MAIN ] WLK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:49.781638] [DEBUG] [LOCAL ] WKC: Loaded 34919 existing records from primary storage. [2025-09-29T22:17:49.781877] [INFO ] [MAIN ] WKC: Loaded 34919 primary data records. [2025-09-29T22:17:50.207718] [DEBUG] [LOCAL ] WLK: Loaded 45427 existing records from primary storage. [2025-09-29T22:17:50.208327] [INFO ] [MAIN ] WLK: Loaded 45427 primary data records. [2025-09-29T22:17:50.317114] [DEBUG] [MAIN ] WK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:50.337183] [INFO ] [MAIN ] WK: Generated 1794 derivative records from 36964 primary records. [2025-09-29T22:17:50.342759] [DEBUG] [LOCAL ] WK: Saving derivative data. [2025-09-29T22:17:50.577144] [DEBUG] [LOCAL ] WK: Derivative data saved (1794 records). [2025-09-29T22:17:50.577460] [INFO ] [MAIN ] WK: Successfully saved derivative data. [2025-09-29T22:17:50.579727] [INFO ] [MAIN ] Derivative Progress: 1990/2057 symbols completed. WK took 1.3s. Estimated remaining: 27.3s. Rate: 147.4 symbols/min [2025-09-29T22:17:50.580951] [INFO ] [MAIN ] WLKP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:50.606512] [DEBUG] [LOCAL ] WLKP: Loaded 6768 existing records from primary storage. [2025-09-29T22:17:50.607352] [INFO ] [MAIN ] WLKP: Loaded 6768 primary data records. [2025-09-29T22:17:50.606860] [DEBUG] [MAIN ] WKC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:50.652697] [INFO ] [MAIN ] WKC: Generated 1794 derivative records from 34919 primary records. [2025-09-29T22:17:50.665866] [DEBUG] [LOCAL ] WKC: Saving derivative data. [2025-09-29T22:17:50.832743] [DEBUG] [LOCAL ] WKC: Derivative data saved (1794 records). [2025-09-29T22:17:50.955573] [INFO ] [MAIN ] WKC: Successfully saved derivative data. [2025-09-29T22:17:50.987463] [INFO ] [MAIN ] Derivative Progress: 1991/2057 symbols completed. WKC took 1.6s. Estimated remaining: 26.9s. Rate: 147.4 symbols/min [2025-09-29T22:17:50.988388] [INFO ] [MAIN ] WLY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:50.988116] [DEBUG] [MAIN ] WLK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:50.990542] [INFO ] [MAIN ] WLK: Generated 1794 derivative records from 45427 primary records. [2025-09-29T22:17:50.991245] [DEBUG] [LOCAL ] WLK: Saving derivative data. [2025-09-29T22:17:51.011165] [DEBUG] [LOCAL ] WLK: Derivative data saved (1794 records). [2025-09-29T22:17:51.011533] [INFO ] [MAIN ] WLK: Successfully saved derivative data. [2025-09-29T22:17:51.013865] [INFO ] [MAIN ] Derivative Progress: 1992/2057 symbols completed. WLK took 1.2s. Estimated remaining: 26.5s. Rate: 147.4 symbols/min [2025-09-29T22:17:51.015688] [INFO ] [MAIN ] WM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:51.062997] [DEBUG] [LOCAL ] WLY: Loaded 29803 existing records from primary storage. [2025-09-29T22:17:51.063994] [INFO ] [MAIN ] WLY: Loaded 29803 primary data records. [2025-09-29T22:17:51.063918] [DEBUG] [MAIN ] WLKP: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:17:51.065092] [INFO ] [MAIN ] WLKP: Generated 1793 derivative records from 6768 primary records. [2025-09-29T22:17:51.065258] [DEBUG] [LOCAL ] WLKP: Saving derivative data. [2025-09-29T22:17:51.436955] [DEBUG] [LOCAL ] WLKP: Derivative data saved (1793 records). [2025-09-29T22:17:51.436433] [DEBUG] [LOCAL ] WM: Loaded 50916 existing records from primary storage. [2025-09-29T22:17:51.437146] [INFO ] [MAIN ] WM: Loaded 50916 primary data records. [2025-09-29T22:17:51.437333] [INFO ] [MAIN ] WLKP: Successfully saved derivative data. [2025-09-29T22:17:51.452227] [INFO ] [MAIN ] Derivative Progress: 1993/2057 symbols completed. WLKP took 0.9s. Estimated remaining: 26.0s. Rate: 147.4 symbols/min [2025-09-29T22:17:51.782441] [DEBUG] [MAIN ] WLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:51.783625] [INFO ] [MAIN ] WLY: Generated 1794 derivative records from 29803 primary records. [2025-09-29T22:17:51.783739] [DEBUG] [LOCAL ] WLY: Saving derivative data. [2025-09-29T22:17:51.807601] [DEBUG] [LOCAL ] WLY: Derivative data saved (1794 records). [2025-09-29T22:17:51.807914] [INFO ] [MAIN ] WLY: Successfully saved derivative data. [2025-09-29T22:17:51.810585] [INFO ] [MAIN ] Derivative Progress: 1994/2057 symbols completed. WLY took 0.8s. Estimated remaining: 25.6s. Rate: 147.4 symbols/min [2025-09-29T22:17:51.828213] [DEBUG] [MAIN ] WM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:51.828865] [INFO ] [MAIN ] WM: Generated 1794 derivative records from 50916 primary records. [2025-09-29T22:17:51.828930] [DEBUG] [LOCAL ] WM: Saving derivative data. [2025-09-29T22:17:51.845155] [DEBUG] [LOCAL ] WM: Derivative data saved (1794 records). [2025-09-29T22:17:51.845265] [INFO ] [MAIN ] WM: Successfully saved derivative data. [2025-09-29T22:17:51.847572] [INFO ] [MAIN ] Derivative Progress: 1995/2057 symbols completed. WM took 0.8s. Estimated remaining: 25.2s. Rate: 147.5 symbols/min [2025-09-29T22:17:51.848128] [INFO ] [MAIN ] WMS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:51.848192] [INFO ] [MAIN ] WMK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:51.848080] [INFO ] [MAIN ] WMB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:51.866945] [DEBUG] [LOCAL ] WMK: Loaded 14479 existing records from primary storage. [2025-09-29T22:17:51.867266] [INFO ] [MAIN ] WMK: Loaded 14479 primary data records. [2025-09-29T22:17:52.264779] [DEBUG] [LOCAL ] WMS: Loaded 39540 existing records from primary storage. [2025-09-29T22:17:52.265841] [INFO ] [MAIN ] WMS: Loaded 39540 primary data records. [2025-09-29T22:17:52.325059] [DEBUG] [LOCAL ] WMB: Loaded 53671 existing records from primary storage. [2025-09-29T22:17:52.325541] [INFO ] [MAIN ] WMB: Loaded 53671 primary data records. [2025-09-29T22:17:52.950762] [DEBUG] [MAIN ] WMK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:52.952176] [INFO ] [MAIN ] WMK: Generated 1794 derivative records from 14479 primary records. [2025-09-29T22:17:52.952277] [DEBUG] [LOCAL ] WMK: Saving derivative data. [2025-09-29T22:17:52.976575] [DEBUG] [LOCAL ] WMK: Derivative data saved (1794 records). [2025-09-29T22:17:52.976812] [INFO ] [MAIN ] WMK: Successfully saved derivative data. [2025-09-29T22:17:52.979283] [INFO ] [MAIN ] Derivative Progress: 1996/2057 symbols completed. WMK took 1.1s. Estimated remaining: 24.8s. Rate: 147.4 symbols/min [2025-09-29T22:17:52.980158] [INFO ] [MAIN ] WMT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:53.000907] [DEBUG] [MAIN ] WMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:53.001681] [INFO ] [MAIN ] WMS: Generated 1794 derivative records from 39540 primary records. [2025-09-29T22:17:53.001771] [DEBUG] [LOCAL ] WMS: Saving derivative data. [2025-09-29T22:17:53.031857] [DEBUG] [MAIN ] WMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:53.033134] [INFO ] [MAIN ] WMB: Generated 1794 derivative records from 53671 primary records. [2025-09-29T22:17:53.033580] [DEBUG] [LOCAL ] WMB: Saving derivative data. [2025-09-29T22:17:53.048843] [DEBUG] [LOCAL ] WMS: Derivative data saved (1794 records). [2025-09-29T22:17:53.049069] [INFO ] [MAIN ] WMS: Successfully saved derivative data. [2025-09-29T22:17:53.051442] [INFO ] [MAIN ] Derivative Progress: 1997/2057 symbols completed. WMS took 1.2s. Estimated remaining: 24.4s. Rate: 147.4 symbols/min [2025-09-29T22:17:53.051881] [INFO ] [MAIN ] WNC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:53.057464] [DEBUG] [LOCAL ] WMB: Derivative data saved (1794 records). [2025-09-29T22:17:53.071422] [INFO ] [MAIN ] WMB: Successfully saved derivative data. [2025-09-29T22:17:53.073491] [INFO ] [MAIN ] Derivative Progress: 1998/2057 symbols completed. WMB took 1.2s. Estimated remaining: 24.0s. Rate: 147.5 symbols/min [2025-09-29T22:17:53.073931] [INFO ] [MAIN ] WNS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:53.098008] [DEBUG] [LOCAL ] WMT: Loaded 53800 existing records from primary storage. [2025-09-29T22:17:53.098461] [INFO ] [MAIN ] WMT: Loaded 53800 primary data records. [2025-09-29T22:17:53.269073] [DEBUG] [LOCAL ] WNC: Loaded 39559 existing records from primary storage. [2025-09-29T22:17:53.320304] [INFO ] [MAIN ] WNC: Loaded 39559 primary data records. [2025-09-29T22:17:53.478892] [DEBUG] [LOCAL ] WNS: Loaded 40019 existing records from primary storage. [2025-09-29T22:17:53.504691] [INFO ] [MAIN ] WNS: Loaded 40019 primary data records. [2025-09-29T22:17:54.199308] [DEBUG] [MAIN ] WMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:54.200963] [INFO ] [MAIN ] WMT: Generated 1794 derivative records from 53800 primary records. [2025-09-29T22:17:54.201075] [DEBUG] [LOCAL ] WMT: Saving derivative data. [2025-09-29T22:17:54.220042] [DEBUG] [LOCAL ] WMT: Derivative data saved (1794 records). [2025-09-29T22:17:54.220494] [INFO ] [MAIN ] WMT: Successfully saved derivative data. [2025-09-29T22:17:54.223276] [INFO ] [MAIN ] Derivative Progress: 1999/2057 symbols completed. WMT took 1.2s. Estimated remaining: 23.6s. Rate: 147.4 symbols/min [2025-09-29T22:17:54.223775] [INFO ] [MAIN ] WOLF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:54.248105] [DEBUG] [MAIN ] WNC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:54.255093] [INFO ] [MAIN ] WNC: Generated 1794 derivative records from 39559 primary records. [2025-09-29T22:17:54.255261] [DEBUG] [LOCAL ] WNC: Saving derivative data. [2025-09-29T22:17:54.270479] [DEBUG] [MAIN ] WNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:54.279743] [INFO ] [MAIN ] WNS: Generated 1794 derivative records from 40019 primary records. [2025-09-29T22:17:54.284018] [DEBUG] [LOCAL ] WNS: Saving derivative data. [2025-09-29T22:17:54.323074] [DEBUG] [LOCAL ] WNC: Derivative data saved (1794 records). [2025-09-29T22:17:54.323953] [DEBUG] [LOCAL ] WNS: Derivative data saved (1794 records). [2025-09-29T22:17:54.324145] [INFO ] [MAIN ] WNC: Successfully saved derivative data. [2025-09-29T22:17:54.324261] [INFO ] [MAIN ] WNS: Successfully saved derivative data. [2025-09-29T22:17:54.326242] [INFO ] [MAIN ] Derivative Progress: 2000/2057 symbols completed. WNS took 1.3s. Estimated remaining: 23.2s. Rate: 147.4 symbols/min [2025-09-29T22:17:54.326525] [INFO ] [MAIN ] WOR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:54.329442] [INFO ] [MAIN ] Derivative Progress: 2001/2057 symbols completed. WNC took 1.3s. Estimated remaining: 22.8s. Rate: 147.5 symbols/min [2025-09-29T22:17:54.329860] [INFO ] [MAIN ] WOW: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:54.350151] [DEBUG] [LOCAL ] WOLF: Loaded 53184 existing records from primary storage. [2025-09-29T22:17:54.350443] [INFO ] [MAIN ] WOLF: Loaded 53184 primary data records. [2025-09-29T22:17:54.471892] [DEBUG] [LOCAL ] WOR: Loaded 24903 existing records from primary storage. [2025-09-29T22:17:54.472160] [INFO ] [MAIN ] WOR: Loaded 24903 primary data records. [2025-09-29T22:17:54.695559] [DEBUG] [LOCAL ] WOW: Loaded 30401 existing records from primary storage. [2025-09-29T22:17:54.827894] [INFO ] [MAIN ] WOW: Loaded 30401 primary data records. [2025-09-29T22:17:55.396194] [DEBUG] [MAIN ] WOLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:55.397438] [INFO ] [MAIN ] WOLF: Generated 1794 derivative records from 53184 primary records. [2025-09-29T22:17:55.397630] [DEBUG] [LOCAL ] WOLF: Saving derivative data. [2025-09-29T22:17:55.432439] [DEBUG] [LOCAL ] WOLF: Derivative data saved (1794 records). [2025-09-29T22:17:55.442596] [INFO ] [MAIN ] WOLF: Successfully saved derivative data. [2025-09-29T22:17:55.443111] [DEBUG] [MAIN ] WOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:55.445106] [INFO ] [MAIN ] Derivative Progress: 2002/2057 symbols completed. WOLF took 1.2s. Estimated remaining: 22.4s. Rate: 147.4 symbols/min [2025-09-29T22:17:55.446298] [INFO ] [MAIN ] WOR: Generated 1794 derivative records from 24903 primary records. [2025-09-29T22:17:55.447707] [DEBUG] [LOCAL ] WOR: Saving derivative data. [2025-09-29T22:17:55.448724] [INFO ] [MAIN ] WPC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:55.478153] [DEBUG] [MAIN ] WOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:55.479527] [INFO ] [MAIN ] WOW: Generated 1794 derivative records from 30401 primary records. [2025-09-29T22:17:55.479858] [DEBUG] [LOCAL ] WOW: Saving derivative data. [2025-09-29T22:17:55.495666] [DEBUG] [LOCAL ] WOR: Derivative data saved (1794 records). [2025-09-29T22:17:55.496902] [INFO ] [MAIN ] WOR: Successfully saved derivative data. [2025-09-29T22:17:55.500002] [INFO ] [MAIN ] Derivative Progress: 2003/2057 symbols completed. WOR took 1.2s. Estimated remaining: 22.0s. Rate: 147.4 symbols/min [2025-09-29T22:17:55.501003] [DEBUG] [LOCAL ] WOW: Derivative data saved (1794 records). [2025-09-29T22:17:55.501684] [INFO ] [MAIN ] WOW: Successfully saved derivative data. [2025-09-29T22:17:55.501129] [INFO ] [MAIN ] WPM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:55.503560] [INFO ] [MAIN ] Derivative Progress: 2004/2057 symbols completed. WOW took 1.2s. Estimated remaining: 21.6s. Rate: 147.5 symbols/min [2025-09-29T22:17:55.504095] [INFO ] [MAIN ] WPP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:55.550993] [DEBUG] [LOCAL ] WPC: Loaded 48399 existing records from primary storage. [2025-09-29T22:17:55.551376] [INFO ] [MAIN ] WPC: Loaded 48399 primary data records. [2025-09-29T22:17:55.652034] [DEBUG] [LOCAL ] WPP: Loaded 33859 existing records from primary storage. [2025-09-29T22:17:55.683169] [INFO ] [MAIN ] WPP: Loaded 33859 primary data records. [2025-09-29T22:17:56.044432] [DEBUG] [LOCAL ] WPM: Loaded 52729 existing records from primary storage. [2025-09-29T22:17:56.074535] [INFO ] [MAIN ] WPM: Loaded 52729 primary data records. [2025-09-29T22:17:56.634944] [DEBUG] [MAIN ] WPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:56.638770] [INFO ] [MAIN ] WPC: Generated 1794 derivative records from 48399 primary records. [2025-09-29T22:17:56.639253] [DEBUG] [LOCAL ] WPC: Saving derivative data. [2025-09-29T22:17:56.670009] [DEBUG] [MAIN ] WPP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:56.672929] [INFO ] [MAIN ] WPP: Generated 1794 derivative records from 33859 primary records. [2025-09-29T22:17:56.673315] [DEBUG] [LOCAL ] WPP: Saving derivative data. [2025-09-29T22:17:56.688834] [DEBUG] [LOCAL ] WPC: Derivative data saved (1794 records). [2025-09-29T22:17:56.690607] [INFO ] [MAIN ] WPC: Successfully saved derivative data. [2025-09-29T22:17:56.693822] [INFO ] [MAIN ] Derivative Progress: 2005/2057 symbols completed. WPC took 1.2s. Estimated remaining: 21.2s. Rate: 147.4 symbols/min [2025-09-29T22:17:56.694363] [INFO ] [MAIN ] WRB: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:56.701049] [DEBUG] [LOCAL ] WPP: Derivative data saved (1794 records). [2025-09-29T22:17:56.701434] [INFO ] [MAIN ] WPP: Successfully saved derivative data. [2025-09-29T22:17:56.703976] [INFO ] [MAIN ] Derivative Progress: 2006/2057 symbols completed. WPP took 1.2s. Estimated remaining: 20.8s. Rate: 147.4 symbols/min [2025-09-29T22:17:56.704359] [INFO ] [MAIN ] WRBY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:56.719123] [DEBUG] [MAIN ] WPM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:56.719932] [INFO ] [MAIN ] WPM: Generated 1794 derivative records from 52729 primary records. [2025-09-29T22:17:56.719999] [DEBUG] [LOCAL ] WPM: Saving derivative data. [2025-09-29T22:17:56.738740] [DEBUG] [LOCAL ] WPM: Derivative data saved (1794 records). [2025-09-29T22:17:56.738887] [INFO ] [MAIN ] WPM: Successfully saved derivative data. [2025-09-29T22:17:56.740923] [INFO ] [MAIN ] Derivative Progress: 2007/2057 symbols completed. WPM took 1.2s. Estimated remaining: 20.3s. Rate: 147.5 symbols/min [2025-09-29T22:17:56.741364] [INFO ] [MAIN ] WS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:56.812697] [DEBUG] [LOCAL ] WRB: Loaded 50549 existing records from primary storage. [2025-09-29T22:17:56.814260] [INFO ] [MAIN ] WRB: Loaded 50549 primary data records. [2025-09-29T22:17:56.815121] [DEBUG] [LOCAL ] WRBY: Loaded 50810 existing records from primary storage. [2025-09-29T22:17:56.822477] [INFO ] [MAIN ] WRBY: Loaded 50810 primary data records. [2025-09-29T22:17:56.884059] [DEBUG] [LOCAL ] WS: Loaded 24030 existing records from primary storage. [2025-09-29T22:17:56.939506] [INFO ] [MAIN ] WS: Loaded 24030 primary data records. [2025-09-29T22:17:57.833242] [DEBUG] [MAIN ] WRB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:57.835800] [INFO ] [MAIN ] WRB: Generated 1794 derivative records from 50549 primary records. [2025-09-29T22:17:57.837066] [DEBUG] [LOCAL ] WRB: Saving derivative data. [2025-09-29T22:17:57.870163] [DEBUG] [LOCAL ] WRB: Derivative data saved (1794 records). [2025-09-29T22:17:57.870877] [DEBUG] [MAIN ] WRBY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:57.871092] [INFO ] [MAIN ] WRB: Successfully saved derivative data. [2025-09-29T22:17:57.873392] [INFO ] [MAIN ] Derivative Progress: 2008/2057 symbols completed. WRB took 1.2s. Estimated remaining: 20.0s. Rate: 147.4 symbols/min [2025-09-29T22:17:57.874684] [INFO ] [MAIN ] WRBY: Generated 1794 derivative records from 50810 primary records. [2025-09-29T22:17:57.886998] [DEBUG] [LOCAL ] WRBY: Saving derivative data. [2025-09-29T22:17:57.888073] [DEBUG] [MAIN ] WS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:57.889302] [INFO ] [MAIN ] WS: Generated 1794 derivative records from 24030 primary records. [2025-09-29T22:17:57.897746] [DEBUG] [LOCAL ] WS: Saving derivative data. [2025-09-29T22:17:57.919608] [DEBUG] [LOCAL ] WRBY: Derivative data saved (1794 records). [2025-09-29T22:17:57.920356] [INFO ] [MAIN ] WRBY: Successfully saved derivative data. [2025-09-29T22:17:57.922974] [INFO ] [MAIN ] Derivative Progress: 2009/2057 symbols completed. WRBY took 1.2s. Estimated remaining: 19.5s. Rate: 147.4 symbols/min [2025-09-29T22:17:57.920613] [DEBUG] [LOCAL ] WS: Derivative data saved (1794 records). [2025-09-29T22:17:57.923122] [INFO ] [MAIN ] WS: Successfully saved derivative data. [2025-09-29T22:17:57.925675] [INFO ] [MAIN ] Derivative Progress: 2010/2057 symbols completed. WS took 1.2s. Estimated remaining: 19.1s. Rate: 147.5 symbols/min [2025-09-29T22:17:57.926284] [INFO ] [MAIN ] WSO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:57.926425] [INFO ] [MAIN ] WSR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:57.926561] [INFO ] [MAIN ] WSM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:57.966608] [DEBUG] [LOCAL ] WSR: Loaded 23065 existing records from primary storage. [2025-09-29T22:17:57.967360] [DEBUG] [LOCAL ] WSO: Loaded 24534 existing records from primary storage. [2025-09-29T22:17:57.967508] [INFO ] [MAIN ] WSO: Loaded 24534 primary data records. [2025-09-29T22:17:57.967772] [INFO ] [MAIN ] WSR: Loaded 23065 primary data records. [2025-09-29T22:17:58.255939] [DEBUG] [LOCAL ] WSM: Loaded 49743 existing records from primary storage. [2025-09-29T22:17:58.292083] [INFO ] [MAIN ] WSM: Loaded 49743 primary data records. [2025-09-29T22:17:59.074890] [DEBUG] [MAIN ] WSO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:59.076323] [INFO ] [MAIN ] WSO: Generated 1794 derivative records from 24534 primary records. [2025-09-29T22:17:59.075089] [DEBUG] [MAIN ] WSR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:59.077338] [INFO ] [MAIN ] WSR: Generated 1794 derivative records from 23065 primary records. [2025-09-29T22:17:59.076597] [DEBUG] [LOCAL ] WSO: Saving derivative data. [2025-09-29T22:17:59.078375] [DEBUG] [LOCAL ] WSR: Saving derivative data. [2025-09-29T22:17:59.127295] [DEBUG] [MAIN ] WSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:17:59.130180] [DEBUG] [LOCAL ] WSO: Derivative data saved (1794 records). [2025-09-29T22:17:59.129529] [INFO ] [MAIN ] WSM: Generated 1794 derivative records from 49743 primary records. [2025-09-29T22:17:59.130829] [INFO ] [MAIN ] WSO: Successfully saved derivative data. [2025-09-29T22:17:59.131030] [DEBUG] [LOCAL ] WSM: Saving derivative data. [2025-09-29T22:17:59.135127] [INFO ] [MAIN ] Derivative Progress: 2011/2057 symbols completed. WSO took 1.2s. Estimated remaining: 18.7s. Rate: 147.4 symbols/min [2025-09-29T22:17:59.136037] [INFO ] [MAIN ] WST: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:59.143514] [DEBUG] [LOCAL ] WSR: Derivative data saved (1794 records). [2025-09-29T22:17:59.147527] [INFO ] [MAIN ] WSR: Successfully saved derivative data. [2025-09-29T22:17:59.149815] [INFO ] [MAIN ] Derivative Progress: 2012/2057 symbols completed. WSR took 1.2s. Estimated remaining: 18.3s. Rate: 147.4 symbols/min [2025-09-29T22:17:59.150186] [INFO ] [MAIN ] WT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:59.155798] [DEBUG] [LOCAL ] WSM: Derivative data saved (1794 records). [2025-09-29T22:17:59.156034] [INFO ] [MAIN ] WSM: Successfully saved derivative data. [2025-09-29T22:17:59.158355] [INFO ] [MAIN ] Derivative Progress: 2013/2057 symbols completed. WSM took 1.2s. Estimated remaining: 17.9s. Rate: 147.5 symbols/min [2025-09-29T22:17:59.158616] [INFO ] [MAIN ] WTI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:17:59.214912] [DEBUG] [LOCAL ] WST: Loaded 37372 existing records from primary storage. [2025-09-29T22:17:59.215113] [INFO ] [MAIN ] WST: Loaded 37372 primary data records. [2025-09-29T22:17:59.318071] [DEBUG] [LOCAL ] WT: Loaded 47632 existing records from primary storage. [2025-09-29T22:17:59.335239] [INFO ] [MAIN ] WT: Loaded 47632 primary data records. [2025-09-29T22:17:59.418034] [DEBUG] [LOCAL ] WTI: Loaded 43885 existing records from primary storage. [2025-09-29T22:17:59.448236] [INFO ] [MAIN ] WTI: Loaded 43885 primary data records. [2025-09-29T22:18:00.291701] [DEBUG] [MAIN ] WST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:18:00.293143] [INFO ] [MAIN ] WST: Generated 1794 derivative records from 37372 primary records. [2025-09-29T22:18:00.293568] [DEBUG] [LOCAL ] WST: Saving derivative data. [2025-09-29T22:18:00.316411] [DEBUG] [MAIN ] WT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:18:00.322931] [INFO ] [MAIN ] WT: Generated 1794 derivative records from 47632 primary records. [2025-09-29T22:18:00.323285] [DEBUG] [LOCAL ] WT: Saving derivative data. [2025-09-29T22:18:00.328090] [DEBUG] [LOCAL ] WST: Derivative data saved (1794 records). [2025-09-29T22:18:00.328407] [INFO ] [MAIN ] WST: Successfully saved derivative data. [2025-09-29T22:18:00.330805] [INFO ] [MAIN ] Derivative Progress: 2014/2057 symbols completed. WST took 1.2s. Estimated remaining: 17.5s. Rate: 147.4 symbols/min [2025-09-29T22:18:00.331189] [INFO ] [MAIN ] WTRG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:18:00.348583] [DEBUG] [LOCAL ] WT: Derivative data saved (1794 records). [2025-09-29T22:18:00.349929] [INFO ] [MAIN ] WT: Successfully saved derivative data. [2025-09-29T22:18:00.353292] [INFO ] [MAIN ] Derivative Progress: 2015/2057 symbols completed. WT took 1.2s. Estimated remaining: 17.1s. Rate: 147.4 symbols/min [2025-09-29T22:18:00.354834] [INFO ] [MAIN ] WTS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:18:00.369959] [DEBUG] [MAIN ] WTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:18:00.370683] [INFO ] [MAIN ] WTI: Generated 1794 derivative records from 43885 primary records. [2025-09-29T22:18:00.370809] [DEBUG] [LOCAL ] WTI: Saving derivative data. [2025-09-29T22:18:00.395410] [DEBUG] [LOCAL ] WTI: Derivative data saved (1794 records). [2025-09-29T22:18:00.395760] [INFO ] [MAIN ] WTI: Successfully saved derivative data. [2025-09-29T22:18:00.398056] [INFO ] [MAIN ] Derivative Progress: 2016/2057 symbols completed. WTI took 1.2s. Estimated remaining: 16.7s. Rate: 147.5 symbols/min [2025-09-29T22:18:00.398547] [INFO ] [MAIN ] WTTR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:18:00.421226] [DEBUG] [LOCAL ] WTS: Loaded 18250 existing records from primary storage. [2025-09-29T22:18:00.421444] [INFO ] [MAIN ] WTS: Loaded 18250 primary data records. [2025-09-29T22:18:00.571799] [DEBUG] [LOCAL ] WTRG: Loaded 50896 existing records from primary storage. [2025-09-29T22:18:00.572558] [INFO ] [MAIN ] WTRG: Loaded 50896 primary data records. [2025-09-29T22:18:00.984533] [DEBUG] [LOCAL ] WTTR: Loaded 44970 existing records from primary storage. [2025-09-29T22:18:00.996296] [INFO ] [MAIN ] WTTR: Loaded 44970 primary data records. [2025-09-29T22:18:01.553218] [DEBUG] [MAIN ] WTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:18:01.555049] [INFO ] [MAIN ] WTS: Generated 1794 derivative records from 18250 primary records. [2025-09-29T22:18:01.555279] [DEBUG] [LOCAL ] WTS: Saving derivative data. [2025-09-29T22:18:01.581382] [DEBUG] [LOCAL ] WTS: Derivative data saved (1794 records). [2025-09-29T22:18:01.581856] [INFO ] [MAIN ] WTS: Successfully saved derivative data. [2025-09-29T22:18:01.597693] [INFO ] [MAIN ] Derivative Progress: 2017/2057 symbols completed. WTS took 1.2s. Estimated remaining: 16.3s. Rate: 147.4 symbols/min [2025-09-29T22:18:01.598101] [INFO ] [MAIN ] WU: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:18:01.598569] [DEBUG] [MAIN ] WTRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:18:01.600108] [INFO ] [MAIN ] WTRG: Generated 1794 derivative records from 50896 primary records. [2025-09-29T22:18:01.600267] [DEBUG] [LOCAL ] WTRG: Saving derivative data. [2025-09-29T22:18:01.634285] [DEBUG] [LOCAL ] WTRG: Derivative data saved (1794 records). [2025-09-29T22:18:01.634434] [INFO ] [MAIN ] WTRG: Successfully saved derivative data. [2025-09-29T22:18:01.633900] [DEBUG] [MAIN ] WTTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:18:01.635299] [INFO ] [MAIN ] WTTR: Generated 1794 derivative records from 44970 primary records. [2025-09-29T22:18:01.637556] [INFO ] [MAIN ] Derivative Progress: 2018/2057 symbols completed. WTRG took 1.3s. Estimated remaining: 15.9s. Rate: 147.4 symbols/min [2025-09-29T22:18:01.637713] [DEBUG] [LOCAL ] WTTR: Saving derivative data. [2025-09-29T22:18:01.637870] [INFO ] [MAIN ] WWW: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:18:01.656568] [DEBUG] [LOCAL ] WTTR: Derivative data saved (1794 records). [2025-09-29T22:18:01.656826] [INFO ] [MAIN ] WTTR: Successfully saved derivative data. [2025-09-29T22:18:01.659107] [INFO ] [MAIN ] Derivative Progress: 2019/2057 symbols completed. WTTR took 1.3s. Estimated remaining: 15.5s. Rate: 147.5 symbols/min [2025-09-29T22:18:01.659328] [INFO ] [MAIN ] WY: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:18:01.714784] [DEBUG] [LOCAL ] WU: Loaded 53452 existing records from primary storage. [2025-09-29T22:18:01.715023] [INFO ] [MAIN ] WU: Loaded 53452 primary data records. [2025-09-29T22:18:01.824517] [DEBUG] [LOCAL ] WWW: Loaded 49142 existing records from primary storage. [2025-09-29T22:18:01.875817] [INFO ] [MAIN ] WWW: Loaded 49142 primary data records. [2025-09-29T22:18:02.264497] [DEBUG] [LOCAL ] WY: Loaded 53120 existing records from primary storage. [2025-09-29T22:18:02.271293] [INFO ] [MAIN ] WY: Loaded 53120 primary data records. [2025-09-29T22:18:02.845796] [DEBUG] [MAIN ] WU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:18:02.847271] [INFO ] [MAIN ] WU: Generated 1794 derivative records from 53452 primary records. [2025-09-29T22:18:02.847447] [DEBUG] [LOCAL ] WU: Saving derivative data. [2025-09-29T22:18:02.878542] [DEBUG] [MAIN ] WWW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:18:02.880318] [INFO ] [MAIN ] WWW: Generated 1794 derivative records from 49142 primary records. [2025-09-29T22:18:02.880938] [DEBUG] [LOCAL ] WWW: Saving derivative data. [2025-09-29T22:18:02.883081] [DEBUG] [LOCAL ] WU: Derivative data saved (1794 records). [2025-09-29T22:18:02.883192] [INFO ] [MAIN ] WU: Successfully saved derivative data. [2025-09-29T22:18:02.885663] [INFO ] [MAIN ] Derivative Progress: 2020/2057 symbols completed. WU took 1.3s. Estimated remaining: 15.1s. Rate: 147.3 symbols/min [2025-09-29T22:18:02.897698] [INFO ] [MAIN ] XFLT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:18:02.903484] [DEBUG] [LOCAL ] WWW: Derivative data saved (1794 records). [2025-09-29T22:18:02.903584] [INFO ] [MAIN ] WWW: Successfully saved derivative data. [2025-09-29T22:18:02.905716] [INFO ] [MAIN ] Derivative Progress: 2021/2057 symbols completed. WWW took 1.3s. Estimated remaining: 14.7s. Rate: 147.4 symbols/min [2025-09-29T22:18:02.906074] [INFO ] [MAIN ] XHR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:18:02.923465] [DEBUG] [MAIN ] WY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:18:02.924277] [INFO ] [MAIN ] WY: Generated 1794 derivative records from 53120 primary records. [2025-09-29T22:18:02.924443] [DEBUG] [LOCAL ] WY: Saving derivative data. [2025-09-29T22:18:02.943339] [DEBUG] [LOCAL ] WY: Derivative data saved (1794 records). [2025-09-29T22:18:02.952224] [INFO ] [MAIN ] WY: Successfully saved derivative data. [2025-09-29T22:18:02.954374] [INFO ] [MAIN ] Derivative Progress: 2022/2057 symbols completed. WY took 1.3s. Estimated remaining: 14.2s. Rate: 147.5 symbols/min [2025-09-29T22:18:02.954794] [INFO ] [MAIN ] XOM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:18:02.977854] [DEBUG] [LOCAL ] XFLT: Loaded 29722 existing records from primary storage. [2025-09-29T22:18:02.978214] [INFO ] [MAIN ] XFLT: Loaded 29722 primary data records. [2025-09-29T22:18:03.118300] [DEBUG] [LOCAL ] XHR: Loaded 43843 existing records from primary storage. [2025-09-29T22:18:03.118822] [INFO ] [MAIN ] XHR: Loaded 43843 primary data records. [2025-09-29T22:18:03.514213] [DEBUG] [LOCAL ] XOM: Loaded 53793 existing records from primary storage. [2025-09-29T22:18:03.543073] [INFO ] [MAIN ] XOM: Loaded 53793 primary data records. [2025-09-29T22:18:04.108672] [DEBUG] [MAIN ] XFLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:18:04.110748] [INFO ] [MAIN ] XFLT: Generated 1794 derivative records from 29722 primary records. [2025-09-29T22:18:04.111116] [DEBUG] [LOCAL ] XFLT: Saving derivative data. [2025-09-29T22:18:04.149257] [DEBUG] [LOCAL ] XFLT: Derivative data saved (1794 records). [2025-09-29T22:18:04.149445] [INFO ] [MAIN ] XFLT: Successfully saved derivative data. [2025-09-29T22:18:04.153481] [INFO ] [MAIN ] Derivative Progress: 2023/2057 symbols completed. XFLT took 1.3s. Estimated remaining: 13.8s. Rate: 147.3 symbols/min [2025-09-29T22:18:04.149839] [DEBUG] [MAIN ] XHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:18:04.155070] [INFO ] [MAIN ] XHR: Generated 1794 derivative records from 43843 primary records. [2025-09-29T22:18:04.155299] [DEBUG] [LOCAL ] XHR: Saving derivative data. [2025-09-29T22:18:04.190324] [DEBUG] [LOCAL ] XHR: Derivative data saved (1794 records). [2025-09-29T22:18:04.189825] [DEBUG] [MAIN ] XOM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:18:04.191220] [INFO ] [MAIN ] XOM: Generated 1794 derivative records from 53793 primary records. [2025-09-29T22:18:04.191329] [DEBUG] [LOCAL ] XOM: Saving derivative data. [2025-09-29T22:18:04.191398] [INFO ] [MAIN ] XHR: Successfully saved derivative data. [2025-09-29T22:18:04.193769] [INFO ] [MAIN ] Derivative Progress: 2024/2057 symbols completed. XHR took 1.3s. Estimated remaining: 13.4s. Rate: 147.4 symbols/min [2025-09-29T22:18:04.211190] [DEBUG] [LOCAL ] XOM: Derivative data saved (1794 records). [2025-09-29T22:18:04.211259] [INFO ] [MAIN ] XOM: Successfully saved derivative data. [2025-09-29T22:18:04.213787] [INFO ] [MAIN ] Derivative Progress: 2025/2057 symbols completed. XOM took 1.3s. Estimated remaining: 13.0s. Rate: 147.5 symbols/min [2025-09-29T22:18:04.214307] [INFO ] [MAIN ] XPEV: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:18:04.214484] [INFO ] [MAIN ] XPER: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:18:04.214694] [INFO ] [MAIN ] XPO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:18:04.254080] [DEBUG] [LOCAL ] XPER: Loaded 29702 existing records from primary storage. [2025-09-29T22:18:04.268134] [INFO ] [MAIN ] XPER: Loaded 29702 primary data records. [2025-09-29T22:18:04.434779] [DEBUG] [LOCAL ] XPO: Loaded 47863 existing records from primary storage. [2025-09-29T22:18:04.446869] [DEBUG] [LOCAL ] XPEV: Loaded 53637 existing records from primary storage. [2025-09-29T22:18:04.457405] [INFO ] [MAIN ] XPO: Loaded 47863 primary data records. [2025-09-29T22:18:04.462622] [INFO ] [MAIN ] XPEV: Loaded 53637 primary data records. [2025-09-29T22:18:05.431848] [DEBUG] [MAIN ] XPER: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:18:05.433448] [INFO ] [MAIN ] XPER: Generated 1794 derivative records from 29702 primary records. [2025-09-29T22:18:05.433895] [DEBUG] [LOCAL ] XPER: Saving derivative data. [2025-09-29T22:18:05.457684] [DEBUG] [LOCAL ] XPER: Derivative data saved (1794 records). [2025-09-29T22:18:05.459904] [INFO ] [MAIN ] XPER: Successfully saved derivative data. [2025-09-29T22:18:05.462143] [INFO ] [MAIN ] Derivative Progress: 2026/2057 symbols completed. XPER took 1.2s. Estimated remaining: 12.6s. Rate: 147.3 symbols/min [2025-09-29T22:18:05.462592] [INFO ] [MAIN ] XPOF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:18:05.491784] [DEBUG] [MAIN ] XPEV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:18:05.493564] [INFO ] [MAIN ] XPEV: Generated 1794 derivative records from 53637 primary records. [2025-09-29T22:18:05.492506] [DEBUG] [MAIN ] XPO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:18:05.494942] [INFO ] [MAIN ] XPO: Generated 1794 derivative records from 47863 primary records. [2025-09-29T22:18:05.493975] [DEBUG] [LOCAL ] XPEV: Saving derivative data. [2025-09-29T22:18:05.495207] [DEBUG] [LOCAL ] XPO: Saving derivative data. [2025-09-29T22:18:05.526218] [DEBUG] [LOCAL ] XPEV: Derivative data saved (1794 records). [2025-09-29T22:18:05.527559] [INFO ] [MAIN ] XPEV: Successfully saved derivative data. [2025-09-29T22:18:05.531236] [INFO ] [MAIN ] Derivative Progress: 2027/2057 symbols completed. XPEV took 1.3s. Estimated remaining: 12.2s. Rate: 147.4 symbols/min [2025-09-29T22:18:05.531450] [INFO ] [MAIN ] XPRO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:18:05.533603] [DEBUG] [LOCAL ] XPO: Derivative data saved (1794 records). [2025-09-29T22:18:05.533747] [INFO ] [MAIN ] XPO: Successfully saved derivative data. [2025-09-29T22:18:05.535982] [INFO ] [MAIN ] Derivative Progress: 2028/2057 symbols completed. XPO took 1.3s. Estimated remaining: 11.8s. Rate: 147.5 symbols/min [2025-09-29T22:18:05.545914] [INFO ] [MAIN ] XYF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:18:05.563454] [DEBUG] [LOCAL ] XPOF: Loaded 38417 existing records from primary storage. [2025-09-29T22:18:05.563629] [INFO ] [MAIN ] XPOF: Loaded 38417 primary data records. [2025-09-29T22:18:05.701796] [DEBUG] [LOCAL ] XYF: Loaded 28397 existing records from primary storage. [2025-09-29T22:18:05.731968] [INFO ] [MAIN ] XYF: Loaded 28397 primary data records. [2025-09-29T22:18:05.809980] [DEBUG] [LOCAL ] XPRO: Loaded 45851 existing records from primary storage. [2025-09-29T22:18:05.863609] [INFO ] [MAIN ] XPRO: Loaded 45851 primary data records. [2025-09-29T22:18:06.690632] [DEBUG] [MAIN ] XPOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:18:06.691865] [INFO ] [MAIN ] XPOF: Generated 1794 derivative records from 38417 primary records. [2025-09-29T22:18:06.691981] [DEBUG] [LOCAL ] XPOF: Saving derivative data. [2025-09-29T22:18:06.713124] [DEBUG] [LOCAL ] XPOF: Derivative data saved (1794 records). [2025-09-29T22:18:06.713513] [INFO ] [MAIN ] XPOF: Successfully saved derivative data. [2025-09-29T22:18:06.715698] [INFO ] [MAIN ] Derivative Progress: 2029/2057 symbols completed. XPOF took 1.3s. Estimated remaining: 11.4s. Rate: 147.3 symbols/min [2025-09-29T22:18:06.716238] [INFO ] [MAIN ] XYL: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:18:06.740178] [DEBUG] [MAIN ] XYF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:18:06.754622] [INFO ] [MAIN ] XYF: Generated 1794 derivative records from 28397 primary records. [2025-09-29T22:18:06.755033] [DEBUG] [LOCAL ] XYF: Saving derivative data. [2025-09-29T22:18:06.755335] [DEBUG] [MAIN ] XPRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:18:06.756897] [INFO ] [MAIN ] XPRO: Generated 1794 derivative records from 45851 primary records. [2025-09-29T22:18:06.757098] [DEBUG] [LOCAL ] XPRO: Saving derivative data. [2025-09-29T22:18:06.791482] [DEBUG] [LOCAL ] XPRO: Derivative data saved (1794 records). [2025-09-29T22:18:06.803094] [INFO ] [MAIN ] XPRO: Successfully saved derivative data. [2025-09-29T22:18:06.807717] [INFO ] [MAIN ] Derivative Progress: 2030/2057 symbols completed. XPRO took 1.3s. Estimated remaining: 11.0s. Rate: 147.4 symbols/min [2025-09-29T22:18:06.809668] [DEBUG] [LOCAL ] XYF: Derivative data saved (1794 records). [2025-09-29T22:18:06.810135] [INFO ] [MAIN ] XYF: Successfully saved derivative data. [2025-09-29T22:18:06.812487] [INFO ] [MAIN ] Derivative Progress: 2031/2057 symbols completed. XYF took 1.3s. Estimated remaining: 10.6s. Rate: 147.4 symbols/min [2025-09-29T22:18:06.809853] [INFO ] [MAIN ] YALA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:18:06.813031] [INFO ] [MAIN ] YELP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:18:06.832373] [DEBUG] [LOCAL ] XYL: Loaded 47998 existing records from primary storage. [2025-09-29T22:18:06.832573] [INFO ] [MAIN ] XYL: Loaded 47998 primary data records. [2025-09-29T22:18:07.040248] [DEBUG] [LOCAL ] YALA: Loaded 37355 existing records from primary storage. [2025-09-29T22:18:07.056908] [INFO ] [MAIN ] YALA: Loaded 37355 primary data records. [2025-09-29T22:18:07.237188] [DEBUG] [LOCAL ] YELP: Loaded 45246 existing records from primary storage. [2025-09-29T22:18:07.290865] [INFO ] [MAIN ] YELP: Loaded 45246 primary data records. [2025-09-29T22:18:07.955152] [DEBUG] [MAIN ] XYL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:18:07.958408] [INFO ] [MAIN ] XYL: Generated 1794 derivative records from 47998 primary records. [2025-09-29T22:18:07.959308] [DEBUG] [LOCAL ] XYL: Saving derivative data. [2025-09-29T22:18:07.983350] [DEBUG] [LOCAL ] XYL: Derivative data saved (1794 records). [2025-09-29T22:18:07.985194] [INFO ] [MAIN ] XYL: Successfully saved derivative data. [2025-09-29T22:18:07.987715] [INFO ] [MAIN ] Derivative Progress: 2032/2057 symbols completed. XYL took 1.3s. Estimated remaining: 10.2s. Rate: 147.3 symbols/min [2025-09-29T22:18:07.989555] [INFO ] [MAIN ] YETI: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:18:08.006357] [DEBUG] [MAIN ] YALA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:18:08.007719] [INFO ] [MAIN ] YALA: Generated 1794 derivative records from 37355 primary records. [2025-09-29T22:18:08.007881] [DEBUG] [LOCAL ] YALA: Saving derivative data. [2025-09-29T22:18:08.041166] [DEBUG] [MAIN ] YELP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:18:08.042639] [INFO ] [MAIN ] YELP: Generated 1794 derivative records from 45246 primary records. [2025-09-29T22:18:08.043536] [DEBUG] [LOCAL ] YALA: Derivative data saved (1794 records). [2025-09-29T22:18:08.043672] [INFO ] [MAIN ] YALA: Successfully saved derivative data. [2025-09-29T22:18:08.046561] [INFO ] [MAIN ] Derivative Progress: 2033/2057 symbols completed. YALA took 1.2s. Estimated remaining: 9.8s. Rate: 147.4 symbols/min [2025-09-29T22:18:08.043039] [DEBUG] [LOCAL ] YELP: Saving derivative data. [2025-09-29T22:18:08.046894] [INFO ] [MAIN ] YEXT: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:18:08.080079] [DEBUG] [LOCAL ] YELP: Derivative data saved (1794 records). [2025-09-29T22:18:08.080400] [INFO ] [MAIN ] YELP: Successfully saved derivative data. [2025-09-29T22:18:08.083453] [INFO ] [MAIN ] Derivative Progress: 2034/2057 symbols completed. YELP took 1.3s. Estimated remaining: 9.4s. Rate: 147.4 symbols/min [2025-09-29T22:18:08.083855] [INFO ] [MAIN ] YMM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:18:08.107291] [DEBUG] [LOCAL ] YETI: Loaded 52480 existing records from primary storage. [2025-09-29T22:18:08.107710] [INFO ] [MAIN ] YETI: Loaded 52480 primary data records. [2025-09-29T22:18:08.275748] [DEBUG] [LOCAL ] YEXT: Loaded 43143 existing records from primary storage. [2025-09-29T22:18:08.338108] [INFO ] [MAIN ] YEXT: Loaded 43143 primary data records. [2025-09-29T22:18:08.625304] [DEBUG] [LOCAL ] YMM: Loaded 52637 existing records from primary storage. [2025-09-29T22:18:08.626308] [INFO ] [MAIN ] YMM: Loaded 52637 primary data records. [2025-09-29T22:18:09.208812] [DEBUG] [MAIN ] YETI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:18:09.209916] [INFO ] [MAIN ] YETI: Generated 1794 derivative records from 52480 primary records. [2025-09-29T22:18:09.210668] [DEBUG] [LOCAL ] YETI: Saving derivative data. [2025-09-29T22:18:09.232335] [DEBUG] [LOCAL ] YETI: Derivative data saved (1794 records). [2025-09-29T22:18:09.233354] [INFO ] [MAIN ] YETI: Successfully saved derivative data. [2025-09-29T22:18:09.236609] [INFO ] [MAIN ] Derivative Progress: 2035/2057 symbols completed. YETI took 1.2s. Estimated remaining: 9.0s. Rate: 147.3 symbols/min [2025-09-29T22:18:09.238709] [INFO ] [MAIN ] YOU: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:18:09.254468] [DEBUG] [MAIN ] YEXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:18:09.255626] [INFO ] [MAIN ] YEXT: Generated 1794 derivative records from 43143 primary records. [2025-09-29T22:18:09.255743] [DEBUG] [LOCAL ] YEXT: Saving derivative data. [2025-09-29T22:18:09.292117] [DEBUG] [LOCAL ] YEXT: Derivative data saved (1794 records). [2025-09-29T22:18:09.292275] [INFO ] [MAIN ] YEXT: Successfully saved derivative data. [2025-09-29T22:18:09.294579] [INFO ] [MAIN ] Derivative Progress: 2036/2057 symbols completed. YEXT took 1.2s. Estimated remaining: 8.6s. Rate: 147.4 symbols/min [2025-09-29T22:18:09.291935] [DEBUG] [MAIN ] YMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:18:09.294916] [INFO ] [MAIN ] YPF: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:18:09.295935] [INFO ] [MAIN ] YMM: Generated 1794 derivative records from 52637 primary records. [2025-09-29T22:18:09.296343] [DEBUG] [LOCAL ] YMM: Saving derivative data. [2025-09-29T22:18:09.327758] [DEBUG] [LOCAL ] YMM: Derivative data saved (1794 records). [2025-09-29T22:18:09.327859] [INFO ] [MAIN ] YMM: Successfully saved derivative data. [2025-09-29T22:18:09.330296] [INFO ] [MAIN ] Derivative Progress: 2037/2057 symbols completed. YMM took 1.2s. Estimated remaining: 8.1s. Rate: 147.4 symbols/min [2025-09-29T22:18:09.331255] [INFO ] [MAIN ] YRD: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:18:09.346441] [DEBUG] [LOCAL ] YOU: Loaded 49695 existing records from primary storage. [2025-09-29T22:18:09.346688] [INFO ] [MAIN ] YOU: Loaded 49695 primary data records. [2025-09-29T22:18:09.463626] [DEBUG] [LOCAL ] YRD: Loaded 12556 existing records from primary storage. [2025-09-29T22:18:09.469451] [INFO ] [MAIN ] YRD: Loaded 12556 primary data records. [2025-09-29T22:18:09.841122] [DEBUG] [LOCAL ] YPF: Loaded 50484 existing records from primary storage. [2025-09-29T22:18:09.898979] [INFO ] [MAIN ] YPF: Loaded 50484 primary data records. [2025-09-29T22:18:10.423387] [DEBUG] [MAIN ] YOU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:18:10.426133] [INFO ] [MAIN ] YOU: Generated 1794 derivative records from 49695 primary records. [2025-09-29T22:18:10.427933] [DEBUG] [LOCAL ] YOU: Saving derivative data. [2025-09-29T22:18:10.461187] [DEBUG] [MAIN ] YRD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:18:10.462758] [INFO ] [MAIN ] YRD: Generated 1794 derivative records from 12556 primary records. [2025-09-29T22:18:10.463120] [DEBUG] [LOCAL ] YRD: Saving derivative data. [2025-09-29T22:18:10.480422] [DEBUG] [LOCAL ] YOU: Derivative data saved (1794 records). [2025-09-29T22:18:10.482778] [INFO ] [MAIN ] YOU: Successfully saved derivative data. [2025-09-29T22:18:10.486099] [INFO ] [MAIN ] Derivative Progress: 2038/2057 symbols completed. YOU took 1.2s. Estimated remaining: 7.7s. Rate: 147.3 symbols/min [2025-09-29T22:18:10.490343] [DEBUG] [LOCAL ] YRD: Derivative data saved (1794 records). [2025-09-29T22:18:10.490966] [INFO ] [MAIN ] YRD: Successfully saved derivative data. [2025-09-29T22:18:10.493336] [INFO ] [MAIN ] Derivative Progress: 2039/2057 symbols completed. YRD took 1.2s. Estimated remaining: 7.3s. Rate: 147.4 symbols/min [2025-09-29T22:18:10.508891] [DEBUG] [MAIN ] YPF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:18:10.509707] [INFO ] [MAIN ] YPF: Generated 1794 derivative records from 50484 primary records. [2025-09-29T22:18:10.509781] [DEBUG] [LOCAL ] YPF: Saving derivative data. [2025-09-29T22:18:10.526431] [DEBUG] [LOCAL ] YPF: Derivative data saved (1794 records). [2025-09-29T22:18:10.526603] [INFO ] [MAIN ] YPF: Successfully saved derivative data. [2025-09-29T22:18:10.529294] [INFO ] [MAIN ] Derivative Progress: 2040/2057 symbols completed. YPF took 1.2s. Estimated remaining: 6.9s. Rate: 147.4 symbols/min [2025-09-29T22:18:10.529971] [INFO ] [MAIN ] YUM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:18:10.530065] [INFO ] [MAIN ] YUMC: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:18:10.530229] [INFO ] [MAIN ] YSG: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:18:10.569431] [DEBUG] [LOCAL ] YSG: Loaded 25406 existing records from primary storage. [2025-09-29T22:18:10.569590] [INFO ] [MAIN ] YSG: Loaded 25406 primary data records. [2025-09-29T22:18:10.744443] [DEBUG] [LOCAL ] YUM: Loaded 51166 existing records from primary storage. [2025-09-29T22:18:10.755109] [INFO ] [MAIN ] YUM: Loaded 51166 primary data records. [2025-09-29T22:18:11.066385] [DEBUG] [LOCAL ] YUMC: Loaded 52675 existing records from primary storage. [2025-09-29T22:18:11.073198] [INFO ] [MAIN ] YUMC: Loaded 52675 primary data records. [2025-09-29T22:18:11.639824] [DEBUG] [MAIN ] YSG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:18:11.642102] [INFO ] [MAIN ] YSG: Generated 1794 derivative records from 25406 primary records. [2025-09-29T22:18:11.642904] [DEBUG] [LOCAL ] YSG: Saving derivative data. [2025-09-29T22:18:11.673324] [DEBUG] [LOCAL ] YSG: Derivative data saved (1794 records). [2025-09-29T22:18:11.680983] [DEBUG] [MAIN ] YUM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:18:11.682150] [INFO ] [MAIN ] YSG: Successfully saved derivative data. [2025-09-29T22:18:11.683087] [INFO ] [MAIN ] YUM: Generated 1794 derivative records from 51166 primary records. [2025-09-29T22:18:11.685705] [INFO ] [MAIN ] Derivative Progress: 2041/2057 symbols completed. YSG took 1.2s. Estimated remaining: 6.5s. Rate: 147.3 symbols/min [2025-09-29T22:18:11.683360] [DEBUG] [LOCAL ] YUM: Saving derivative data. [2025-09-29T22:18:11.686005] [INFO ] [MAIN ] ZBH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:18:11.714969] [DEBUG] [MAIN ] YUMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:18:11.716398] [INFO ] [MAIN ] YUMC: Generated 1794 derivative records from 52675 primary records. [2025-09-29T22:18:11.716971] [DEBUG] [LOCAL ] YUMC: Saving derivative data. [2025-09-29T22:18:11.735296] [DEBUG] [LOCAL ] YUM: Derivative data saved (1794 records). [2025-09-29T22:18:11.735855] [INFO ] [MAIN ] YUM: Successfully saved derivative data. [2025-09-29T22:18:11.738511] [INFO ] [MAIN ] Derivative Progress: 2042/2057 symbols completed. YUM took 1.2s. Estimated remaining: 6.1s. Rate: 147.4 symbols/min [2025-09-29T22:18:11.738823] [INFO ] [MAIN ] ZEPP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:18:11.742878] [DEBUG] [LOCAL ] YUMC: Derivative data saved (1794 records). [2025-09-29T22:18:11.743239] [INFO ] [MAIN ] YUMC: Successfully saved derivative data. [2025-09-29T22:18:11.746502] [INFO ] [MAIN ] Derivative Progress: 2043/2057 symbols completed. YUMC took 1.2s. Estimated remaining: 5.7s. Rate: 147.4 symbols/min [2025-09-29T22:18:11.746864] [INFO ] [MAIN ] ZETA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:18:11.777145] [DEBUG] [LOCAL ] ZEPP: Loaded 17429 existing records from primary storage. [2025-09-29T22:18:11.777404] [INFO ] [MAIN ] ZEPP: Loaded 17429 primary data records. [2025-09-29T22:18:11.912477] [DEBUG] [LOCAL ] ZBH: Loaded 51156 existing records from primary storage. [2025-09-29T22:18:11.937735] [INFO ] [MAIN ] ZBH: Loaded 51156 primary data records. [2025-09-29T22:18:12.296617] [DEBUG] [LOCAL ] ZETA: Loaded 53595 existing records from primary storage. [2025-09-29T22:18:12.310553] [INFO ] [MAIN ] ZETA: Loaded 53595 primary data records. [2025-09-29T22:18:12.871712] [DEBUG] [MAIN ] ZEPP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:18:12.873078] [INFO ] [MAIN ] ZEPP: Generated 1794 derivative records from 17429 primary records. [2025-09-29T22:18:12.873214] [DEBUG] [LOCAL ] ZEPP: Saving derivative data. [2025-09-29T22:18:12.915831] [DEBUG] [LOCAL ] ZEPP: Derivative data saved (1794 records). [2025-09-29T22:18:12.916593] [INFO ] [MAIN ] ZEPP: Successfully saved derivative data. [2025-09-29T22:18:12.916518] [DEBUG] [MAIN ] ZBH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:18:12.919946] [INFO ] [MAIN ] ZBH: Generated 1794 derivative records from 51156 primary records. [2025-09-29T22:18:12.918911] [INFO ] [MAIN ] Derivative Progress: 2044/2057 symbols completed. ZEPP took 1.2s. Estimated remaining: 5.3s. Rate: 147.3 symbols/min [2025-09-29T22:18:12.920341] [DEBUG] [LOCAL ] ZBH: Saving derivative data. [2025-09-29T22:18:12.920257] [INFO ] [MAIN ] ZGN: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:18:12.942380] [DEBUG] [LOCAL ] ZBH: Derivative data saved (1794 records). [2025-09-29T22:18:12.942594] [INFO ] [MAIN ] ZBH: Successfully saved derivative data. [2025-09-29T22:18:12.945023] [INFO ] [MAIN ] Derivative Progress: 2045/2057 symbols completed. ZBH took 1.3s. Estimated remaining: 4.9s. Rate: 147.4 symbols/min [2025-09-29T22:18:12.953363] [INFO ] [MAIN ] ZH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:18:12.958951] [DEBUG] [MAIN ] ZETA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:18:12.959770] [INFO ] [MAIN ] ZETA: Generated 1794 derivative records from 53595 primary records. [2025-09-29T22:18:12.959904] [DEBUG] [LOCAL ] ZETA: Saving derivative data. [2025-09-29T22:18:12.988244] [DEBUG] [LOCAL ] ZETA: Derivative data saved (1794 records). [2025-09-29T22:18:12.988384] [INFO ] [MAIN ] ZETA: Successfully saved derivative data. [2025-09-29T22:18:12.990674] [INFO ] [MAIN ] Derivative Progress: 2046/2057 symbols completed. ZETA took 1.2s. Estimated remaining: 4.5s. Rate: 147.4 symbols/min [2025-09-29T22:18:12.991069] [INFO ] [MAIN ] ZIM: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:18:13.012131] [DEBUG] [LOCAL ] ZGN: Loaded 40692 existing records from primary storage. [2025-09-29T22:18:13.012430] [INFO ] [MAIN ] ZGN: Loaded 40692 primary data records. [2025-09-29T22:18:13.130722] [DEBUG] [LOCAL ] ZH: Loaded 26791 existing records from primary storage. [2025-09-29T22:18:13.141700] [INFO ] [MAIN ] ZH: Loaded 26791 primary data records. [2025-09-29T22:18:13.566879] [DEBUG] [LOCAL ] ZIM: Loaded 53516 existing records from primary storage. [2025-09-29T22:18:13.699419] [INFO ] [MAIN ] ZIM: Loaded 53516 primary data records. [2025-09-29T22:18:14.103212] [DEBUG] [MAIN ] ZGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:18:14.105264] [INFO ] [MAIN ] ZGN: Generated 1794 derivative records from 40692 primary records. [2025-09-29T22:18:14.105469] [DEBUG] [LOCAL ] ZGN: Saving derivative data. [2025-09-29T22:18:14.131100] [DEBUG] [LOCAL ] ZGN: Derivative data saved (1794 records). [2025-09-29T22:18:14.131587] [INFO ] [MAIN ] ZGN: Successfully saved derivative data. [2025-09-29T22:18:14.133997] [INFO ] [MAIN ] Derivative Progress: 2047/2057 symbols completed. ZGN took 1.2s. Estimated remaining: 4.1s. Rate: 147.3 symbols/min [2025-09-29T22:18:14.134452] [INFO ] [MAIN ] ZIP: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:18:14.149387] [DEBUG] [MAIN ] ZH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:18:14.150347] [INFO ] [MAIN ] ZH: Generated 1794 derivative records from 26791 primary records. [2025-09-29T22:18:14.150764] [DEBUG] [LOCAL ] ZH: Saving derivative data. [2025-09-29T22:18:14.181812] [DEBUG] [MAIN ] ZIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:18:14.183518] [DEBUG] [LOCAL ] ZH: Derivative data saved (1794 records). [2025-09-29T22:18:14.183677] [INFO ] [MAIN ] ZH: Successfully saved derivative data. [2025-09-29T22:18:14.189526] [INFO ] [MAIN ] Derivative Progress: 2048/2057 symbols completed. ZH took 1.2s. Estimated remaining: 3.7s. Rate: 147.4 symbols/min [2025-09-29T22:18:14.190813] [INFO ] [MAIN ] ZIM: Generated 1794 derivative records from 53516 primary records. [2025-09-29T22:18:14.190970] [INFO ] [MAIN ] ZK: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:18:14.191405] [DEBUG] [LOCAL ] ZIM: Saving derivative data. [2025-09-29T22:18:14.221316] [DEBUG] [LOCAL ] ZIM: Derivative data saved (1794 records). [2025-09-29T22:18:14.234935] [INFO ] [MAIN ] ZIM: Successfully saved derivative data. [2025-09-29T22:18:14.238348] [DEBUG] [LOCAL ] ZIP: Loaded 44171 existing records from primary storage. [2025-09-29T22:18:14.237264] [INFO ] [MAIN ] Derivative Progress: 2049/2057 symbols completed. ZIM took 1.2s. Estimated remaining: 3.3s. Rate: 147.4 symbols/min [2025-09-29T22:18:14.238768] [INFO ] [MAIN ] ZKH: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:18:14.238884] [INFO ] [MAIN ] ZIP: Loaded 44171 primary data records. [2025-09-29T22:18:14.370330] [DEBUG] [LOCAL ] ZKH: Loaded 7929 existing records from primary storage. [2025-09-29T22:18:14.390573] [DEBUG] [LOCAL ] ZK: Loaded 39661 existing records from primary storage. [2025-09-29T22:18:14.395860] [INFO ] [MAIN ] ZK: Loaded 39661 primary data records. [2025-09-29T22:18:14.384212] [INFO ] [MAIN ] ZKH: Loaded 7929 primary data records. [2025-09-29T22:18:15.267432] [DEBUG] [MAIN ] ZIP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:18:15.269221] [INFO ] [MAIN ] ZIP: Generated 1794 derivative records from 44171 primary records. [2025-09-29T22:18:15.269456] [DEBUG] [LOCAL ] ZIP: Saving derivative data. [2025-09-29T22:18:15.304854] [DEBUG] [MAIN ] ZK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:18:15.308085] [INFO ] [MAIN ] ZK: Generated 1794 derivative records from 39661 primary records. [2025-09-29T22:18:15.308199] [DEBUG] [LOCAL ] ZK: Saving derivative data. [2025-09-29T22:18:15.308818] [DEBUG] [LOCAL ] ZIP: Derivative data saved (1794 records). [2025-09-29T22:18:15.309953] [INFO ] [MAIN ] ZIP: Successfully saved derivative data. [2025-09-29T22:18:15.312201] [INFO ] [MAIN ] Derivative Progress: 2050/2057 symbols completed. ZIP took 1.2s. Estimated remaining: 2.9s. Rate: 147.3 symbols/min [2025-09-29T22:18:15.333943] [INFO ] [MAIN ] ZTO: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:18:15.334728] [DEBUG] [MAIN ] ZKH: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-29T22:18:15.341230] [INFO ] [MAIN ] ZKH: Generated 1793 derivative records from 7929 primary records. [2025-09-29T22:18:15.341325] [DEBUG] [LOCAL ] ZKH: Saving derivative data. [2025-09-29T22:18:15.358293] [DEBUG] [LOCAL ] ZK: Derivative data saved (1794 records). [2025-09-29T22:18:15.358923] [INFO ] [MAIN ] ZK: Successfully saved derivative data. [2025-09-29T22:18:15.361339] [INFO ] [MAIN ] Derivative Progress: 2051/2057 symbols completed. ZK took 1.2s. Estimated remaining: 2.4s. Rate: 147.4 symbols/min [2025-09-29T22:18:15.361542] [INFO ] [MAIN ] ZTR: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:18:15.365457] [DEBUG] [LOCAL ] ZKH: Derivative data saved (1793 records). [2025-09-29T22:18:15.365637] [INFO ] [MAIN ] ZKH: Successfully saved derivative data. [2025-09-29T22:18:15.368214] [INFO ] [MAIN ] Derivative Progress: 2052/2057 symbols completed. ZKH took 1.1s. Estimated remaining: 2.0s. Rate: 147.4 symbols/min [2025-09-29T22:18:15.368487] [INFO ] [MAIN ] ZTS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:18:15.384395] [DEBUG] [LOCAL ] ZTR: Loaded 16651 existing records from primary storage. [2025-09-29T22:18:15.384725] [INFO ] [MAIN ] ZTR: Loaded 16651 primary data records. [2025-09-29T22:18:15.555536] [DEBUG] [LOCAL ] ZTO: Loaded 49966 existing records from primary storage. [2025-09-29T22:18:15.586189] [INFO ] [MAIN ] ZTO: Loaded 49966 primary data records. [2025-09-29T22:18:15.906349] [DEBUG] [LOCAL ] ZTS: Loaded 52993 existing records from primary storage. [2025-09-29T22:18:15.929687] [INFO ] [MAIN ] ZTS: Loaded 52993 primary data records. [2025-09-29T22:18:16.546480] [DEBUG] [MAIN ] ZTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:18:16.547979] [INFO ] [MAIN ] ZTR: Generated 1794 derivative records from 16651 primary records. [2025-09-29T22:18:16.548402] [DEBUG] [LOCAL ] ZTR: Saving derivative data. [2025-09-29T22:18:16.566878] [DEBUG] [LOCAL ] ZTR: Derivative data saved (1794 records). [2025-09-29T22:18:16.567299] [INFO ] [MAIN ] ZTR: Successfully saved derivative data. [2025-09-29T22:18:16.569965] [INFO ] [MAIN ] Derivative Progress: 2053/2057 symbols completed. ZTR took 1.2s. Estimated remaining: 1.6s. Rate: 147.3 symbols/min [2025-09-29T22:18:16.589152] [DEBUG] [MAIN ] ZTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:18:16.590097] [INFO ] [MAIN ] ZTO: Generated 1794 derivative records from 49966 primary records. [2025-09-29T22:18:16.590313] [DEBUG] [LOCAL ] ZTO: Saving derivative data. [2025-09-29T22:18:16.613875] [DEBUG] [LOCAL ] ZTO: Derivative data saved (1794 records). [2025-09-29T22:18:16.614010] [INFO ] [MAIN ] ZTO: Successfully saved derivative data. [2025-09-29T22:18:16.617061] [INFO ] [MAIN ] Derivative Progress: 2054/2057 symbols completed. ZTO took 1.3s. Estimated remaining: 1.2s. Rate: 147.4 symbols/min [2025-09-29T22:18:16.636685] [DEBUG] [MAIN ] ZTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:18:16.637363] [INFO ] [MAIN ] ZTS: Generated 1794 derivative records from 52993 primary records. [2025-09-29T22:18:16.637429] [DEBUG] [LOCAL ] ZTS: Saving derivative data. [2025-09-29T22:18:16.654037] [DEBUG] [LOCAL ] ZTS: Derivative data saved (1794 records). [2025-09-29T22:18:16.654115] [INFO ] [MAIN ] ZTS: Successfully saved derivative data. [2025-09-29T22:18:16.656301] [INFO ] [MAIN ] Derivative Progress: 2055/2057 symbols completed. ZTS took 1.3s. Estimated remaining: 0.8s. Rate: 147.4 symbols/min [2025-09-29T22:18:16.656793] [INFO ] [MAIN ] ZWS: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:18:16.656742] [INFO ] [MAIN ] ZVIA: Starting derivative data generation with 30-minute intervals. [2025-09-29T22:18:16.706421] [DEBUG] [LOCAL ] ZVIA: Loaded 35419 existing records from primary storage. [2025-09-29T22:18:16.718576] [INFO ] [MAIN ] ZVIA: Loaded 35419 primary data records. [2025-09-29T22:18:16.719284] [DEBUG] [LOCAL ] ZWS: Loaded 42344 existing records from primary storage. [2025-09-29T22:18:16.770245] [INFO ] [MAIN ] ZWS: Loaded 42344 primary data records. [2025-09-29T22:18:17.381199] [DEBUG] [MAIN ] ZVIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:18:17.382224] [INFO ] [MAIN ] ZVIA: Generated 1794 derivative records from 35419 primary records. [2025-09-29T22:18:17.382487] [DEBUG] [LOCAL ] ZVIA: Saving derivative data. [2025-09-29T22:18:17.401005] [DEBUG] [LOCAL ] ZVIA: Derivative data saved (1794 records). [2025-09-29T22:18:17.401226] [INFO ] [MAIN ] ZVIA: Successfully saved derivative data. [2025-09-29T22:18:17.403414] [INFO ] [MAIN ] Derivative Progress: 2056/2057 symbols completed. ZVIA took 0.7s. Estimated remaining: 0.4s. Rate: 147.4 symbols/min [2025-09-29T22:18:17.416376] [DEBUG] [MAIN ] ZWS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-29T22:18:17.417119] [INFO ] [MAIN ] ZWS: Generated 1794 derivative records from 42344 primary records. [2025-09-29T22:18:17.417214] [DEBUG] [LOCAL ] ZWS: Saving derivative data. [2025-09-29T22:18:17.433191] [DEBUG] [LOCAL ] ZWS: Derivative data saved (1794 records). [2025-09-29T22:18:17.433278] [INFO ] [MAIN ] ZWS: Successfully saved derivative data. [2025-09-29T22:18:17.435879] [INFO ] [MAIN ] Derivative Progress: 2057/2057 symbols completed. ZWS took 0.8s. Estimated remaining: 0.0s. Rate: 147.4 symbols/min [2025-09-29T22:18:17.436886] [INFO ] [MAIN ] Parallel derivative generation completed in 13m 57s [2025-09-29T22:18:17.437082] [INFO ] [MAIN ] Derivative generation success rate: 100.0% (2057/2057 symbols) [2025-09-29T22:18:18.015753] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Derivative Generation Completed (2057/2057 @ 100.00%)' [2025-09-29T22:18:18.017330] [INFO ] [MAIN ] Both primary update and derivative generation completed successfully. [2025-09-29T22:18:18.017738] [WARN ] [STATE ] State set to: COMPLETED_OK [2025-09-29T22:18:18.017983] [INFO ] [STATE ] Last completion updated: 2025-09-29T22:18:18.017828